2024-09-11T21:56:07.078 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T21:56:07.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T21:56:07.195 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901414 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/scrub} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901414' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds cache max size: 1000 mds debug frag: true mds debug scatterstat: true mds log max segments: 1 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPJ7TWZogTp0OuRs7WmLTZDnHvzJ4juQlVI3e0Uo73F3coD2O0ZBcUAy3pgxx7bUH4m9gOvxKppUUG8amAAZMyQ= smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXHSd9LbLo2ZTGgy1ULvmPc6yw0YxXo1HHEi+Kf3xrxBX/vdR6qgcqxrdBCdahwLGZxm8EaOLJ8AHNCKFvZXV8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T21:56:07.195 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-11T21:56:07.196 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-11T21:56:07.196 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T21:56:07.198 INFO:teuthology.task.internal:Checking packages... 2024-09-11T21:56:07.220 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T21:56:07.220 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T21:56:07.220 INFO:teuthology.packaging:ref: None 2024-09-11T21:56:07.220 INFO:teuthology.packaging:tag: None 2024-09-11T21:56:07.220 INFO:teuthology.packaging:branch: squid 2024-09-11T21:56:07.220 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T21:56:07.220 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-11T21:56:07.457 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-11T21:56:07.459 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T21:56:07.465 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T21:56:07.465 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T21:56:07.473 INFO:teuthology.task.internal:Saving configuration 2024-09-11T21:56:07.501 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T21:56:07.507 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T21:56:07.530 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 21:51:09.622914', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPJ7TWZogTp0OuRs7WmLTZDnHvzJ4juQlVI3e0Uo73F3coD2O0ZBcUAy3pgxx7bUH4m9gOvxKppUUG8amAAZMyQ='} 2024-09-11T21:56:07.552 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 21:51:09.621681', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXHSd9LbLo2ZTGgy1ULvmPc6yw0YxXo1HHEi+Kf3xrxBX/vdR6qgcqxrdBCdahwLGZxm8EaOLJ8AHNCKFvZXV8='} 2024-09-11T21:56:07.552 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T21:56:07.557 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-11T21:56:07.558 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-11T21:56:07.558 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T21:56:07.688 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4da627fbe0>, signals=[15]) 2024-09-11T21:56:07.688 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T21:56:07.694 INFO:teuthology.task.internal:Opening connections... 2024-09-11T21:56:07.694 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T21:56:07.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T21:56:07.772 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-09-11T21:56:07.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T21:56:07.846 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T21:56:07.852 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-09-11T21:56:07.871 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-09-11T21:56:07.871 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-09-11T21:56:07.929 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2024-09-11T21:56:07.929 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2024-09-11T21:56:07.929 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2024-09-11T21:56:07.929 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2024-09-11T21:56:07.929 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2024-09-11T21:56:07.929 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2024-09-11T21:56:07.929 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T21:56:07.929 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-09-11T21:56:07.930 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2024-09-11T21:56:07.930 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T21:56:07.930 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2024-09-11T21:56:07.930 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T21:56:07.930 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T21:56:07.930 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T21:56:07.931 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-09-11T21:56:07.950 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-09-11T21:56:07.969 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-09-11T21:56:07.969 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-09-11T21:56:08.027 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-09-11T21:56:08.027 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-09-11T21:56:08.027 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-09-11T21:56:08.027 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-09-11T21:56:08.027 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-09-11T21:56:08.027 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-09-11T21:56:08.027 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T21:56:08.027 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-09-11T21:56:08.028 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-09-11T21:56:08.028 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T21:56:08.028 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-09-11T21:56:08.028 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T21:56:08.028 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T21:56:08.028 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T21:56:08.028 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-09-11T21:56:08.051 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T21:56:08.059 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T21:56:08.064 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T21:56:08.064 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-09-11T21:56:08.066 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-09-11T21:56:08.084 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T21:56:08.090 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T21:56:08.090 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-09-11T21:56:08.124 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-09-11T21:56:08.213 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T21:56:08.268 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T21:56:08.281 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-11T21:56:08.282 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-11T21:56:08.282 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-11T21:56:08.282 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T21:56:08.282 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T21:56:08.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T21:56:08.299 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-11T21:56:08.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T21:56:08.300 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-09-11T21:56:08.356 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-503.el9.x86_64 2024-09-11T21:56:08.357 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.14.0-503.el9.x86_64 2024-09-11T21:56:08.357 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum install -y kernel 2024-09-11T21:56:08.358 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-503.el9.x86_64 2024-09-11T21:56:08.358 INFO:teuthology.task.kernel:Running kernel on smithi077: 5.14.0-503.el9.x86_64 2024-09-11T21:56:08.358 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y kernel 2024-09-11T21:56:10.867 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-11T21:56:15.952 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 5.2 MB/s | 20 MB 00:03 2024-09-11T21:56:29.935 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 664 kB/s | 6.5 MB 00:10 2024-09-11T21:58:45.947 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 54 kB/s | 8.2 MB 02:35 2024-09-11T22:00:26.025 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 81 B/s | 19 kB 03:54 2024-09-11T22:00:26.954 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-11T22:00:32.551 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-11T22:00:34.616 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T22:00:34.617 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T22:00:34.712 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-09-11T22:00:34.720 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-09-11T22:00:34.720 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2024-09-11T22:00:34.720 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-09-11T22:00:34.721 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-09-11T22:00:34.721 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T22:00:34.721 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-09-11T22:00:34.721 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T22:00:34.721 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T22:00:34.721 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T22:00:34.721 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:00:34.721 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-09-11T22:00:34.721 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-09-11T22:00:34.721 INFO:teuthology.orchestra.run.smithi050.stdout:Install 4 Packages 2024-09-11T22:00:34.721 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:00:34.722 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 79 M 2024-09-11T22:00:34.722 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 126 M 2024-09-11T22:00:34.722 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-09-11T22:00:34.928 INFO:teuthology.orchestra.run.smithi050.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 230 kB/s | 23 kB 00:00 2024-09-11T22:00:35.311 INFO:teuthology.orchestra.run.smithi050.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-11T22:00:35.753 INFO:teuthology.orchestra.run.smithi050.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-11T22:00:36.004 INFO:teuthology.orchestra.run.smithi050.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 27 MB/s | 29 MB 00:01 2024-09-11T22:00:36.004 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:00:36.004 INFO:teuthology.orchestra.run.smithi050.stdout:Total 61 MB/s | 79 MB 00:01 2024-09-11T22:00:36.708 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-09-11T22:00:37.133 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-09-11T22:00:37.133 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-09-11T22:00:38.116 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-09-11T22:00:38.117 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-09-11T22:00:40.730 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-09-11T22:00:41.408 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T22:00:41.498 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:00:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:00:44.411 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:00:49.534 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:00:49.578 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:00:54.715 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:00:59.726 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 158 kB/s | 20 MB 02:12 2024-09-11T22:01:33.833 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:01:33.873 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:01:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:01:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T22:01:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:01:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:01:35.220 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:01:35.220 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:01:35.220 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-09-11T22:01:35.220 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T22:01:35.220 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T22:01:35.220 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T22:01:35.220 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T22:01:35.220 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:01:35.221 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-09-11T22:01:35.551 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T22:01:35.639 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T22:01:35.639 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T22:01:35.639 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T22:01:35.639 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T22:01:35.639 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T22:01:35.639 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-11T22:01:35.640 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T22:01:35.640 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T22:01:35.698 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T22:01:35.698 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T22:01:35.699 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2024-09-11T22:01:35.733 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2024-09-11T22:01:35.733 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2024-09-11T22:01:35.733 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.06 2024-09-11T22:01:35.733 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 82.el9 2024-09-11T22:01:35.733 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:Group : Unspecified 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 8274670 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : builder@centos.org 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:01:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T22:01:35.735 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T22:01:35.735 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T22:01:35.735 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2024-09-11T22:01:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:01:35.735 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T22:01:35.736 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T22:01:35.736 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 5.14.0-505.el9.x86_64 2024-09-11T22:01:35.736 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T22:01:36.312 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-09-11T22:01:37.565 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 196 kB/s | 6.5 MB 00:33 2024-09-11T22:01:37.748 INFO:teuthology.orchestra.run.smithi050.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T22:01:37.778 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-09-11T22:01:37.780 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-11T22:01:37.795 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.hsTImFMlM3 2024-09-11T22:01:37.795 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hsTImFMlM3 2024-09-11T22:01:37.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.hsTImFMlM3 2024-09-11T22:01:38.002 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.hsTImFMlM3 is 6KB 2024-09-11T22:01:38.050 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.hsTImFMlM3 2024-09-11T22:01:38.065 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T22:01:38.129 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T22:01:38.130 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T22:01:38.130 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T22:01:38.130 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T22:01:38.130 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T22:01:38.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2024-09-11T22:01:39.090 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-11T22:01:40.011 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-11T22:01:45.351 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-11T22:01:47.365 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T22:01:47.365 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T22:01:47.471 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-11T22:01:47.481 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-11T22:01:47.481 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-09-11T22:01:47.481 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-11T22:01:47.481 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-11T22:01:47.481 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T22:01:47.481 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-11T22:01:47.481 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T22:01:47.481 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T22:01:47.481 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T22:01:47.481 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:01:47.481 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-11T22:01:47.482 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-11T22:01:47.482 INFO:teuthology.orchestra.run.smithi077.stdout:Install 4 Packages 2024-09-11T22:01:47.482 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:01:47.482 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 79 M 2024-09-11T22:01:47.482 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 126 M 2024-09-11T22:01:47.482 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-11T22:01:47.735 INFO:teuthology.orchestra.run.smithi077.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 164 kB/s | 23 kB 00:00 2024-09-11T22:01:48.236 INFO:teuthology.orchestra.run.smithi077.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-11T22:01:48.703 INFO:teuthology.orchestra.run.smithi077.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 31 MB/s | 35 MB 00:01 2024-09-11T22:01:48.966 INFO:teuthology.orchestra.run.smithi077.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 23 MB/s | 29 MB 00:01 2024-09-11T22:01:48.966 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:01:48.966 INFO:teuthology.orchestra.run.smithi077.stdout:Total 53 MB/s | 79 MB 00:01 2024-09-11T22:01:49.645 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-11T22:01:49.968 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-11T22:01:49.968 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-11T22:01:50.943 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-11T22:01:50.943 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-11T22:01:53.397 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-11T22:01:54.087 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T22:01:54.179 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:01:56.978 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:01:57.117 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:02:01.933 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:02:01.975 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:02:06.807 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:02:08.285 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-11T22:02:08.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-11T22:02:08.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:02:44.873 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:02:44.913 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:02:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:02:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T22:02:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:02:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:02:46.117 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:02:46.117 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:02:46.118 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-11T22:02:46.118 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T22:02:46.118 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T22:02:46.118 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T22:02:46.118 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T22:02:46.118 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:02:46.118 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-11T22:02:46.456 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T22:02:46.571 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T22:02:46.572 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T22:02:46.572 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T22:02:46.572 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T22:02:46.572 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T22:02:46.572 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-11T22:02:46.572 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi077.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T22:02:46.573 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T22:02:46.630 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T22:02:46.631 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T22:02:46.631 DEBUG:teuthology.orchestra.run.smithi077:> sudo rpm -qi grub2-tools 2024-09-11T22:02:46.669 INFO:teuthology.orchestra.run.smithi077.stdout:Name : grub2-tools 2024-09-11T22:02:46.669 INFO:teuthology.orchestra.run.smithi077.stdout:Epoch : 1 2024-09-11T22:02:46.669 INFO:teuthology.orchestra.run.smithi077.stdout:Version : 2.06 2024-09-11T22:02:46.669 INFO:teuthology.orchestra.run.smithi077.stdout:Release : 82.el9 2024-09-11T22:02:46.669 INFO:teuthology.orchestra.run.smithi077.stdout:Architecture: x86_64 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout:Group : Unspecified 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout:Size : 8274670 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout:License : GPLv3+ 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout:Packager : builder@centos.org 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout:Vendor : CentOS 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout:Summary : Support tools for GRUB. 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout:Description : 2024-09-11T22:02:46.670 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:02:46.671 INFO:teuthology.orchestra.run.smithi077.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T22:02:46.671 INFO:teuthology.orchestra.run.smithi077.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T22:02:46.671 INFO:teuthology.orchestra.run.smithi077.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T22:02:46.671 INFO:teuthology.orchestra.run.smithi077.stdout:hardware devices. 2024-09-11T22:02:46.671 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:02:46.671 INFO:teuthology.orchestra.run.smithi077.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T22:02:46.672 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T22:02:46.672 INFO:teuthology.task.kernel:Updating grub on smithi077 to boot 5.14.0-505.el9.x86_64 2024-09-11T22:02:46.672 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T22:02:47.333 INFO:teuthology.orchestra.run.smithi077.stderr:Generating grub configuration file ... 2024-09-11T22:02:48.654 INFO:teuthology.orchestra.run.smithi077.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T22:02:48.672 INFO:teuthology.orchestra.run.smithi077.stderr:done 2024-09-11T22:02:48.679 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-09-11T22:02:48.695 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.qbakWrCZye 2024-09-11T22:02:48.695 DEBUG:teuthology.orchestra.run.smithi077:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qbakWrCZye 2024-09-11T22:02:48.763 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.qbakWrCZye 2024-09-11T22:02:48.913 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.qbakWrCZye is 6KB 2024-09-11T22:02:48.933 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.qbakWrCZye 2024-09-11T22:02:48.948 DEBUG:teuthology.orchestra.run.smithi077:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T22:02:49.020 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T22:02:49.020 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T22:02:49.020 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T22:02:49.020 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T22:02:49.021 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T22:02:49.176 DEBUG:teuthology.orchestra.run.smithi077:> sudo shutdown -r now 2024-09-11T22:03:08.305 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T22:03:17.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-11T22:03:17.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:03:17.742 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-11T22:03:18.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-11T22:03:18.137 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-11T22:03:18.137 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-11T22:03:18.152 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-505.el9.x86_64 2024-09-11T22:03:18.152 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T22:03:18.152 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T22:03:18.153 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T22:03:19.154 DEBUG:teuthology.parallel:result is None 2024-09-11T22:03:19.179 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-11T22:03:19.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-11T22:03:19.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:03:37.665 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-11T22:03:46.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-11T22:03:46.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:03:49.725 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-11T22:04:01.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-11T22:04:01.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:04:20.157 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-11T22:04:35.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-11T22:04:35.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:04:35.632 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-11T22:04:35.939 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-11T22:04:35.939 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-505.el9.x86_64"... 2024-09-11T22:04:35.940 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-09-11T22:04:35.954 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-505.el9.x86_64 2024-09-11T22:04:35.954 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T22:04:35.954 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T22:04:35.954 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T22:04:36.955 DEBUG:teuthology.parallel:result is None 2024-09-11T22:04:36.956 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T22:04:36.962 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T22:04:36.963 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T22:04:36.966 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T22:04:36.984 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T22:04:36.990 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T22:04:36.998 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T22:04:36.998 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T22:04:37.027 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T22:04:37.082 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T22:04:37.088 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T22:04:37.089 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T22:04:37.097 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T22:04:37.198 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:04:37.221 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:04:37.251 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:04:37.616 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:04:37.619 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T22:04:37.626 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T22:04:37.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T22:04:37.629 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T22:04:37.690 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T22:04:37.699 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T22:04:37.700 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T22:04:37.702 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T22:04:37.732 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:04:37.806 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:04:37.861 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:04:37.946 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:04:37.992 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:04:37.992 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T22:04:38.061 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:04:38.136 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:04:38.197 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:04:38.240 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:04:38.277 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:04:38.277 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T22:04:38.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-09-11T22:04:38.344 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-09-11T22:04:38.398 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:04:38.417 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:04:38.827 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T22:04:38.835 INFO:teuthology.task.internal:Starting timer... 2024-09-11T22:04:38.836 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T22:04:38.884 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T22:04:38.917 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-11T22:04:38.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2024-09-11T22:04:38.974 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2024-09-11T22:04:38.976 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2024-09-11T22:04:39.099 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2024-09-11T22:04:39.102 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T22:04:39.102 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2024-09-11T22:04:39.137 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2024-09-11T22:04:39.137 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2024-09-11T22:04:39.155 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2024-09-11T22:04:39.156 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi077.front.sepia.ceph.com': 'permissive'} 2024-09-11T22:04:39.156 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:04:39.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:04:39.206 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:04:39.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:04:39.231 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T22:04:39.232 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2024-09-11T22:04:39.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2024-09-11T22:04:39.328 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T22:04:39.337 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T22:04:39.341 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T22:04:39.518 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T22:04:39.529 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T22:04:39.544 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi077.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T22:08:27.138 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi077.front.sepia.ceph.com')] 2024-09-11T22:08:27.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-11T22:08:27.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:08:27.219 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-11T22:08:27.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-11T22:08:27.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-11T22:08:27.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:08:27.376 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-11T22:08:27.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-11T22:08:27.458 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T22:08:27.468 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T22:08:27.468 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T22:08:27.469 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:08:27.471 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T22:08:27.472 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:08:27.501 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T22:08:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T22:08:27.527 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T22:08:27.542 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T22:08:27.544 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2024-09-11T22:08:27.556 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2024-09-11T22:08:27.566 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2024-09-11T22:08:27.572 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T22:08:27.577 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2024-09-11T22:08:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T22:08:27.591 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T22:08:27.605 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T22:08:27.645 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:08:27.649 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:08:27.649 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-09-11T22:08:27.649 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:08:27.650 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:08:27.650 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:08:27.650 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:08:27.658 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:08:27.662 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:08:27.662 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-09-11T22:08:27.662 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:08:27.662 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:08:27.662 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:08:27.662 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:08:27.663 INFO:teuthology.run_tasks:Running task install... 2024-09-11T22:08:27.671 DEBUG:teuthology.task.install:project ceph 2024-09-11T22:08:27.671 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T22:08:27.671 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T22:08:27.671 INFO:teuthology.task.install:Using flavor: default 2024-09-11T22:08:27.677 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T22:08:27.677 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T22:08:27.677 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T22:08:27.678 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:08:27.679 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T22:08:27.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:08:27.821 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T22:08:27.821 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T22:08:27.853 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T22:08:27.854 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T22:08:27.930 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T22:08:27.930 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:08:27.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T22:08:27.958 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T22:08:27.958 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:08:27.958 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T22:08:27.960 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T22:08:27.960 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T22:08:27.985 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T22:08:27.985 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T22:08:28.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T22:08:28.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T22:08:28.104 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T22:08:28.125 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T22:08:28.170 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2024-09-11T22:08:28.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2024-09-11T22:08:28.189 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2024-09-11T22:08:28.190 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2024-09-11T22:08:28.412 INFO:teuthology.orchestra.run.smithi050.stdout:45 files removed 2024-09-11T22:08:28.433 INFO:teuthology.orchestra.run.smithi077.stdout:45 files removed 2024-09-11T22:08:28.439 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T22:08:28.460 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T22:08:29.010 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-11T22:08:29.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 278 kB/s | 84 kB 00:00 2024-09-11T22:08:29.302 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-11T22:08:29.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-11T22:08:29.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-11T22:08:29.694 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2024-09-11T22:08:30.315 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-11T22:08:32.450 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-11T22:08:32.719 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-09-11T22:08:34.595 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-11T22:08:38.967 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-11T22:08:39.054 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-11T22:08:40.618 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-11T22:08:41.355 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-11T22:08:41.756 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-11T22:08:42.176 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-11T22:08:47.261 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-11T22:08:49.548 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:08:49.549 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:08:49.562 INFO:teuthology.orchestra.run.smithi077.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T22:08:49.563 INFO:teuthology.orchestra.run.smithi077.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T22:08:49.564 INFO:teuthology.orchestra.run.smithi077.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T22:08:49.565 INFO:teuthology.orchestra.run.smithi077.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T22:08:49.567 INFO:teuthology.orchestra.run.smithi077.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T22:08:49.570 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T22:08:49.571 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T22:08:49.632 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-11T22:08:49.647 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================== 2024-09-11T22:08:49.647 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-11T22:08:49.647 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================== 2024-09-11T22:08:49.648 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-11T22:08:49.648 INFO:teuthology.orchestra.run.smithi077.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T22:08:49.648 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T22:08:49.648 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T22:08:49.648 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T22:08:49.648 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T22:08:49.648 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T22:08:49.648 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T22:08:49.648 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T22:08:49.649 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T22:08:49.649 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T22:08:49.649 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T22:08:49.649 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T22:08:49.649 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T22:08:49.649 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T22:08:49.649 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T22:08:49.649 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T22:08:49.649 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T22:08:49.649 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T22:08:49.650 INFO:teuthology.orchestra.run.smithi077.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T22:08:49.650 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T22:08:49.650 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T22:08:49.650 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T22:08:49.650 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T22:08:49.650 INFO:teuthology.orchestra.run.smithi077.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T22:08:49.650 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T22:08:49.650 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T22:08:49.650 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T22:08:49.650 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T22:08:49.650 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T22:08:49.650 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T22:08:49.651 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T22:08:49.651 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T22:08:49.651 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T22:08:49.651 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T22:08:49.651 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T22:08:49.651 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T22:08:49.651 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T22:08:49.651 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-09-11T22:08:49.651 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T22:08:49.651 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T22:08:49.651 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T22:08:49.651 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T22:08:49.651 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T22:08:49.652 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T22:08:49.652 INFO:teuthology.orchestra.run.smithi077.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T22:08:49.652 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T22:08:49.652 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-11T22:08:49.652 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T22:08:49.652 INFO:teuthology.orchestra.run.smithi077.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T22:08:49.652 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T22:08:49.652 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T22:08:49.652 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T22:08:49.652 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T22:08:49.652 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T22:08:49.652 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T22:08:49.652 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T22:08:49.653 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T22:08:49.653 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T22:08:49.653 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T22:08:49.653 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T22:08:49.653 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T22:08:49.653 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T22:08:49.653 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T22:08:49.653 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T22:08:49.653 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T22:08:49.653 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T22:08:49.653 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T22:08:49.654 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T22:08:49.655 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T22:08:49.655 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T22:08:49.655 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T22:08:49.655 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T22:08:49.655 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T22:08:49.655 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T22:08:49.655 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T22:08:49.655 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T22:08:49.655 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T22:08:49.655 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T22:08:49.655 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T22:08:49.655 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T22:08:49.656 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T22:08:49.656 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T22:08:49.656 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T22:08:49.656 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T22:08:49.656 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T22:08:49.656 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T22:08:49.656 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T22:08:49.656 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T22:08:49.656 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T22:08:49.656 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T22:08:49.656 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T22:08:49.657 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T22:08:49.658 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T22:08:49.658 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T22:08:49.658 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T22:08:49.658 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T22:08:49.658 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T22:08:49.658 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T22:08:49.658 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T22:08:49.658 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T22:08:49.658 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T22:08:49.658 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T22:08:49.658 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T22:08:49.658 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T22:08:49.659 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T22:08:49.659 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T22:08:49.659 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T22:08:49.659 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T22:08:49.659 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T22:08:49.659 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T22:08:49.659 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T22:08:49.659 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T22:08:49.659 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T22:08:49.659 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T22:08:49.659 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T22:08:49.659 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T22:08:49.659 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T22:08:49.660 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T22:08:49.660 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T22:08:49.660 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T22:08:49.660 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T22:08:49.660 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T22:08:49.660 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T22:08:49.660 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T22:08:49.660 INFO:teuthology.orchestra.run.smithi077.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T22:08:49.660 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T22:08:49.660 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T22:08:49.660 INFO:teuthology.orchestra.run.smithi077.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T22:08:49.660 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T22:08:49.661 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T22:08:49.661 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-09-11T22:08:49.661 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T22:08:49.661 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:08:49.661 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-11T22:08:49.661 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================== 2024-09-11T22:08:49.661 INFO:teuthology.orchestra.run.smithi077.stdout:Install 148 Packages 2024-09-11T22:08:49.661 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 8 Packages 2024-09-11T22:08:49.661 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:08:49.662 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 226 M 2024-09-11T22:08:49.662 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-11T22:08:49.966 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 775 B/s | 1.7 kB 00:02 2024-09-11T22:08:50.221 INFO:teuthology.orchestra.run.smithi077.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-11T22:08:50.546 INFO:teuthology.orchestra.run.smithi077.stdout:(2/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-11T22:08:50.571 INFO:teuthology.orchestra.run.smithi077.stdout:(3/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.5 MB/s | 897 kB 00:00 2024-09-11T22:08:50.596 INFO:teuthology.orchestra.run.smithi077.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 2.8 MB/s | 145 kB 00:00 2024-09-11T22:08:50.680 INFO:teuthology.orchestra.run.smithi077.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 18 MB/s | 1.5 MB 00:00 2024-09-11T22:08:50.964 INFO:teuthology.orchestra.run.smithi077.stdout:(6/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-11T22:08:51.022 INFO:teuthology.orchestra.run.smithi077.stdout:(7/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 5.3 MB/s | 2.4 MB 00:00 2024-09-11T22:08:51.248 INFO:teuthology.orchestra.run.smithi077.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 18 MB/s | 21 MB 00:01 2024-09-11T22:08:51.298 INFO:teuthology.orchestra.run.smithi077.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 506 kB/s | 25 kB 00:00 2024-09-11T22:08:51.850 INFO:teuthology.orchestra.run.smithi077.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 19 MB/s | 17 MB 00:00 2024-09-11T22:08:51.900 INFO:teuthology.orchestra.run.smithi077.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-11T22:08:51.959 INFO:teuthology.orchestra.run.smithi077.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 464 kB/s | 27 kB 00:00 2024-09-11T22:08:52.009 INFO:teuthology.orchestra.run.smithi077.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 638 kB/s | 32 kB 00:00 2024-09-11T22:08:52.093 INFO:teuthology.orchestra.run.smithi077.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.8 MB/s | 752 kB 00:00 2024-09-11T22:08:52.168 INFO:teuthology.orchestra.run.smithi077.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 163 kB 00:00 2024-09-11T22:08:52.243 INFO:teuthology.orchestra.run.smithi077.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.6 MB/s | 127 kB 00:00 2024-09-11T22:08:52.327 INFO:teuthology.orchestra.run.smithi077.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.9 MB/s | 506 kB 00:00 2024-09-11T22:08:52.452 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:08:52.453 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:08:52.465 INFO:teuthology.orchestra.run.smithi050.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T22:08:52.466 INFO:teuthology.orchestra.run.smithi050.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T22:08:52.467 INFO:teuthology.orchestra.run.smithi050.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T22:08:52.468 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T22:08:52.469 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T22:08:52.472 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T22:08:52.473 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T22:08:52.527 INFO:teuthology.orchestra.run.smithi077.stdout:(18/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 7.0 MB/s | 11 MB 00:01 2024-09-11T22:08:52.542 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-09-11T22:08:52.558 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================== 2024-09-11T22:08:52.558 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-09-11T22:08:52.558 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================== 2024-09-11T22:08:52.558 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-09-11T22:08:52.558 INFO:teuthology.orchestra.run.smithi050.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T22:08:52.558 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T22:08:52.558 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T22:08:52.558 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T22:08:52.558 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T22:08:52.558 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T22:08:52.559 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T22:08:52.559 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T22:08:52.559 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T22:08:52.559 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T22:08:52.559 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T22:08:52.559 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T22:08:52.559 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T22:08:52.559 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T22:08:52.559 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T22:08:52.559 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T22:08:52.559 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T22:08:52.559 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T22:08:52.560 INFO:teuthology.orchestra.run.smithi050.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T22:08:52.560 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T22:08:52.560 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T22:08:52.560 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T22:08:52.560 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T22:08:52.560 INFO:teuthology.orchestra.run.smithi050.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T22:08:52.560 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T22:08:52.560 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T22:08:52.560 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T22:08:52.560 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T22:08:52.560 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T22:08:52.560 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T22:08:52.561 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T22:08:52.561 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T22:08:52.561 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T22:08:52.561 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T22:08:52.561 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T22:08:52.561 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T22:08:52.561 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T22:08:52.561 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2024-09-11T22:08:52.561 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T22:08:52.561 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T22:08:52.561 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T22:08:52.561 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T22:08:52.562 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T22:08:52.562 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T22:08:52.562 INFO:teuthology.orchestra.run.smithi050.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T22:08:52.562 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T22:08:52.562 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-09-11T22:08:52.562 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T22:08:52.562 INFO:teuthology.orchestra.run.smithi050.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T22:08:52.562 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T22:08:52.562 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T22:08:52.562 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T22:08:52.562 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T22:08:52.562 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T22:08:52.562 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T22:08:52.563 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T22:08:52.564 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T22:08:52.564 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T22:08:52.564 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T22:08:52.564 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T22:08:52.564 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T22:08:52.564 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T22:08:52.564 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T22:08:52.564 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T22:08:52.564 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T22:08:52.564 INFO:teuthology.orchestra.run.smithi050.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T22:08:52.564 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T22:08:52.565 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T22:08:52.565 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T22:08:52.565 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T22:08:52.565 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T22:08:52.565 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T22:08:52.565 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T22:08:52.565 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T22:08:52.565 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T22:08:52.565 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T22:08:52.565 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T22:08:52.565 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T22:08:52.565 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T22:08:52.565 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T22:08:52.566 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T22:08:52.566 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T22:08:52.566 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T22:08:52.566 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T22:08:52.566 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T22:08:52.566 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T22:08:52.566 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T22:08:52.566 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T22:08:52.566 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T22:08:52.566 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T22:08:52.567 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T22:08:52.567 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T22:08:52.567 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T22:08:52.567 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T22:08:52.567 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T22:08:52.567 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T22:08:52.568 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T22:08:52.568 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T22:08:52.568 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T22:08:52.568 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T22:08:52.568 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T22:08:52.569 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T22:08:52.569 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T22:08:52.569 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T22:08:52.569 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T22:08:52.569 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T22:08:52.569 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T22:08:52.569 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T22:08:52.569 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T22:08:52.569 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T22:08:52.569 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T22:08:52.570 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T22:08:52.570 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T22:08:52.570 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T22:08:52.570 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T22:08:52.570 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T22:08:52.570 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T22:08:52.570 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T22:08:52.570 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T22:08:52.570 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T22:08:52.570 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T22:08:52.570 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T22:08:52.570 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T22:08:52.571 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T22:08:52.571 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T22:08:52.571 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T22:08:52.571 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T22:08:52.571 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T22:08:52.571 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T22:08:52.571 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T22:08:52.571 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T22:08:52.571 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T22:08:52.571 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T22:08:52.571 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T22:08:52.571 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T22:08:52.571 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================== 2024-09-11T22:08:52.572 INFO:teuthology.orchestra.run.smithi050.stdout:Install 148 Packages 2024-09-11T22:08:52.573 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 8 Packages 2024-09-11T22:08:52.573 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:08:52.573 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 226 M 2024-09-11T22:08:52.573 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-09-11T22:08:52.577 INFO:teuthology.orchestra.run.smithi077.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 906 kB/s | 45 kB 00:00 2024-09-11T22:08:52.653 INFO:teuthology.orchestra.run.smithi077.stdout:(20/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-11T22:08:52.678 INFO:teuthology.orchestra.run.smithi077.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 1.3 MB/s | 136 kB 00:00 2024-09-11T22:08:52.712 INFO:teuthology.orchestra.run.smithi077.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.7 MB/s | 162 kB 00:00 2024-09-11T22:08:52.737 INFO:teuthology.orchestra.run.smithi077.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-11T22:08:52.770 INFO:teuthology.orchestra.run.smithi077.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-11T22:08:52.795 INFO:teuthology.orchestra.run.smithi077.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 100 kB 00:00 2024-09-11T22:08:52.821 INFO:teuthology.orchestra.run.smithi077.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-11T22:08:52.871 INFO:teuthology.orchestra.run.smithi077.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-11T22:08:53.288 INFO:teuthology.orchestra.run.smithi077.stdout:(28/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 24 MB/s | 49 MB 00:01 2024-09-11T22:08:53.313 INFO:teuthology.orchestra.run.smithi077.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 72 kB/s | 32 kB 00:00 2024-09-11T22:08:53.339 INFO:teuthology.orchestra.run.smithi077.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-11T22:08:53.406 INFO:teuthology.orchestra.run.smithi077.stdout:(31/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 5.1 MB/s | 3.1 MB 00:00 2024-09-11T22:08:53.481 INFO:teuthology.orchestra.run.smithi077.stdout:(32/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 21 MB/s | 3.6 MB 00:00 2024-09-11T22:08:53.506 INFO:teuthology.orchestra.run.smithi077.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.4 MB/s | 249 kB 00:00 2024-09-11T22:08:53.531 INFO:teuthology.orchestra.run.smithi077.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 986 kB/s | 49 kB 00:00 2024-09-11T22:08:53.565 INFO:teuthology.orchestra.run.smithi077.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 281 kB/s | 16 kB 00:00 2024-09-11T22:08:53.590 INFO:teuthology.orchestra.run.smithi077.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.8 MB/s | 285 kB 00:00 2024-09-11T22:08:53.608 INFO:teuthology.orchestra.run.smithi050.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 44 kB/s | 6.5 kB 00:00 2024-09-11T22:08:53.632 INFO:teuthology.orchestra.run.smithi077.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 438 kB/s | 18 kB 00:00 2024-09-11T22:08:53.716 INFO:teuthology.orchestra.run.smithi077.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 20 MB/s | 7.4 MB 00:00 2024-09-11T22:08:53.741 INFO:teuthology.orchestra.run.smithi077.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.3 MB/s | 765 kB 00:00 2024-09-11T22:08:53.825 INFO:teuthology.orchestra.run.smithi077.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 416 kB/s | 80 kB 00:00 2024-09-11T22:08:53.884 INFO:teuthology.orchestra.run.smithi050.stdout:(2/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 13 MB/s | 5.4 MB 00:00 2024-09-11T22:08:53.900 INFO:teuthology.orchestra.run.smithi077.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-11T22:08:53.925 INFO:teuthology.orchestra.run.smithi050.stdout:(3/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.8 MB/s | 897 kB 00:00 2024-09-11T22:08:53.933 INFO:teuthology.orchestra.run.smithi077.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-11T22:08:53.951 INFO:teuthology.orchestra.run.smithi050.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 2.1 MB/s | 145 kB 00:00 2024-09-11T22:08:53.967 INFO:teuthology.orchestra.run.smithi077.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 801 kB 00:00 2024-09-11T22:08:53.984 INFO:teuthology.orchestra.run.smithi077.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-11T22:08:54.018 INFO:teuthology.orchestra.run.smithi077.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-11T22:08:54.043 INFO:teuthology.orchestra.run.smithi050.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 1.5 MB 00:00 2024-09-11T22:08:54.043 INFO:teuthology.orchestra.run.smithi077.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-11T22:08:54.068 INFO:teuthology.orchestra.run.smithi077.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-11T22:08:54.102 INFO:teuthology.orchestra.run.smithi077.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-11T22:08:54.261 INFO:teuthology.orchestra.run.smithi077.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 675 kB/s | 107 kB 00:00 2024-09-11T22:08:54.268 INFO:teuthology.orchestra.run.smithi050.stdout:(6/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 21 MB/s | 4.7 MB 00:00 2024-09-11T22:08:54.311 INFO:teuthology.orchestra.run.smithi077.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-09-11T22:08:54.344 INFO:teuthology.orchestra.run.smithi077.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-11T22:08:54.378 INFO:teuthology.orchestra.run.smithi077.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-11T22:08:54.403 INFO:teuthology.orchestra.run.smithi077.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-11T22:08:54.418 INFO:teuthology.orchestra.run.smithi050.stdout:(7/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 4.8 MB/s | 2.4 MB 00:00 2024-09-11T22:08:54.428 INFO:teuthology.orchestra.run.smithi077.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-11T22:08:54.454 INFO:teuthology.orchestra.run.smithi077.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-11T22:08:54.479 INFO:teuthology.orchestra.run.smithi077.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-11T22:08:54.504 INFO:teuthology.orchestra.run.smithi077.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-11T22:08:54.529 INFO:teuthology.orchestra.run.smithi077.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-09-11T22:08:54.646 INFO:teuthology.orchestra.run.smithi077.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-09-11T22:08:54.697 INFO:teuthology.orchestra.run.smithi077.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 492 kB/s | 24 kB 00:00 2024-09-11T22:08:54.747 INFO:teuthology.orchestra.run.smithi077.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-09-11T22:08:54.772 INFO:teuthology.orchestra.run.smithi077.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.4 MB/s | 662 kB 00:00 2024-09-11T22:08:54.839 INFO:teuthology.orchestra.run.smithi077.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.5 MB/s | 3.0 MB 00:00 2024-09-11T22:08:54.864 INFO:teuthology.orchestra.run.smithi077.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-11T22:08:54.898 INFO:teuthology.orchestra.run.smithi077.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-11T22:08:54.923 INFO:teuthology.orchestra.run.smithi077.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 461 kB/s | 38 kB 00:00 2024-09-11T22:08:54.977 INFO:teuthology.orchestra.run.smithi050.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 14 MB/s | 21 MB 00:01 2024-09-11T22:08:55.165 INFO:teuthology.orchestra.run.smithi077.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 6.6 MB/s | 1.6 MB 00:00 2024-09-11T22:08:55.169 INFO:teuthology.orchestra.run.smithi050.stdout:(9/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86_ 19 MB/s | 17 MB 00:00 2024-09-11T22:08:55.194 INFO:teuthology.orchestra.run.smithi050.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 116 kB/s | 25 kB 00:00 2024-09-11T22:08:55.261 INFO:teuthology.orchestra.run.smithi050.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.3 MB/s | 228 kB 00:00 2024-09-11T22:08:55.323 INFO:teuthology.orchestra.run.smithi077.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 5.6 MB/s | 910 kB 00:00 2024-09-11T22:08:55.328 INFO:teuthology.orchestra.run.smithi050.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 407 kB/s | 27 kB 00:00 2024-09-11T22:08:55.386 INFO:teuthology.orchestra.run.smithi050.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 546 kB/s | 32 kB 00:00 2024-09-11T22:08:55.390 INFO:teuthology.orchestra.run.smithi077.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-11T22:08:55.470 INFO:teuthology.orchestra.run.smithi050.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.8 MB/s | 752 kB 00:00 2024-09-11T22:08:55.529 INFO:teuthology.orchestra.run.smithi050.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.8 MB/s | 163 kB 00:00 2024-09-11T22:08:55.596 INFO:teuthology.orchestra.run.smithi050.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.8 MB/s | 127 kB 00:00 2024-09-11T22:08:55.649 INFO:teuthology.orchestra.run.smithi077.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 6.3 MB/s | 4.9 MB 00:00 2024-09-11T22:08:55.671 INFO:teuthology.orchestra.run.smithi050.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 6.6 MB/s | 506 kB 00:00 2024-09-11T22:08:55.708 INFO:teuthology.orchestra.run.smithi077.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.5 MB/s | 4.4 MB 00:00 2024-09-11T22:08:55.766 INFO:teuthology.orchestra.run.smithi077.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-11T22:08:55.883 INFO:teuthology.orchestra.run.smithi077.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-09-11T22:08:56.000 INFO:teuthology.orchestra.run.smithi077.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 526 kB/s | 61 kB 00:00 2024-09-11T22:08:56.005 INFO:teuthology.orchestra.run.smithi050.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-11T22:08:56.117 INFO:teuthology.orchestra.run.smithi077.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-11T22:08:56.138 INFO:teuthology.orchestra.run.smithi050.stdout:(19/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 6.2 MB/s | 11 MB 00:01 2024-09-11T22:08:56.155 INFO:teuthology.orchestra.run.smithi050.stdout:(20/156): python3-ceph-argparse-19.1.1-298.gb53 300 kB/s | 45 kB 00:00 2024-09-11T22:08:56.189 INFO:teuthology.orchestra.run.smithi050.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 2.6 MB/s | 136 kB 00:00 2024-09-11T22:08:56.201 INFO:teuthology.orchestra.run.smithi077.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-11T22:08:56.223 INFO:teuthology.orchestra.run.smithi050.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-11T22:08:56.265 INFO:teuthology.orchestra.run.smithi050.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.2 MB/s | 321 kB 00:00 2024-09-11T22:08:56.290 INFO:teuthology.orchestra.run.smithi050.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 4.4 MB/s | 301 kB 00:00 2024-09-11T22:08:56.301 INFO:teuthology.orchestra.run.smithi077.stdout:(77/156): postgresql-server-13.16-1.el9.x86_64. 6.3 MB/s | 5.8 MB 00:00 2024-09-11T22:08:56.315 INFO:teuthology.orchestra.run.smithi050.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-11T22:08:56.326 INFO:teuthology.orchestra.run.smithi077.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 205 kB/s | 26 kB 00:00 2024-09-11T22:08:56.340 INFO:teuthology.orchestra.run.smithi050.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-11T22:08:56.351 INFO:teuthology.orchestra.run.smithi077.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-11T22:08:56.399 INFO:teuthology.orchestra.run.smithi050.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-11T22:08:56.402 INFO:teuthology.orchestra.run.smithi077.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-11T22:08:56.427 INFO:teuthology.orchestra.run.smithi077.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-11T22:08:56.466 INFO:teuthology.orchestra.run.smithi050.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 479 kB/s | 32 kB 00:00 2024-09-11T22:08:56.527 INFO:teuthology.orchestra.run.smithi077.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-11T22:08:56.533 INFO:teuthology.orchestra.run.smithi050.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.1 MB/s | 146 kB 00:00 2024-09-11T22:08:56.644 INFO:teuthology.orchestra.run.smithi077.stdout:(83/156): python3-babel-2.9.1-2.el9.noarch.rpm 6.8 MB/s | 6.0 MB 00:00 2024-09-11T22:08:56.669 INFO:teuthology.orchestra.run.smithi077.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-09-11T22:08:56.695 INFO:teuthology.orchestra.run.smithi077.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-11T22:08:56.720 INFO:teuthology.orchestra.run.smithi077.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 838 kB/s | 42 kB 00:00 2024-09-11T22:08:56.779 INFO:teuthology.orchestra.run.smithi077.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-09-11T22:08:56.795 INFO:teuthology.orchestra.run.smithi077.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-11T22:08:56.846 INFO:teuthology.orchestra.run.smithi077.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-11T22:08:56.879 INFO:teuthology.orchestra.run.smithi077.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-11T22:08:56.905 INFO:teuthology.orchestra.run.smithi077.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 916 kB/s | 54 kB 00:00 2024-09-11T22:08:56.955 INFO:teuthology.orchestra.run.smithi077.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-09-11T22:08:57.005 INFO:teuthology.orchestra.run.smithi077.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-11T22:08:57.089 INFO:teuthology.orchestra.run.smithi077.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-11T22:08:57.134 INFO:teuthology.orchestra.run.smithi050.stdout:(30/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 25 MB/s | 49 MB 00:01 2024-09-11T22:08:57.139 INFO:teuthology.orchestra.run.smithi077.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-11T22:08:57.184 INFO:teuthology.orchestra.run.smithi050.stdout:(31/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 3.6 MB/s | 3.1 MB 00:00 2024-09-11T22:08:57.189 INFO:teuthology.orchestra.run.smithi077.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-09-11T22:08:57.248 INFO:teuthology.orchestra.run.smithi077.stdout:(97/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.0 MB/s | 5.1 MB 00:00 2024-09-11T22:08:57.259 INFO:teuthology.orchestra.run.smithi050.stdout:(32/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 4.9 MB/s | 3.6 MB 00:00 2024-09-11T22:08:57.298 INFO:teuthology.orchestra.run.smithi077.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-11T22:08:57.309 INFO:teuthology.orchestra.run.smithi050.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 1.9 MB/s | 249 kB 00:00 2024-09-11T22:08:57.323 INFO:teuthology.orchestra.run.smithi077.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 767 kB/s | 58 kB 00:00 2024-09-11T22:08:57.335 INFO:teuthology.orchestra.run.smithi050.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 658 kB/s | 49 kB 00:00 2024-09-11T22:08:57.348 INFO:teuthology.orchestra.run.smithi077.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-11T22:08:57.368 INFO:teuthology.orchestra.run.smithi050.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 281 kB/s | 16 kB 00:00 2024-09-11T22:08:57.374 INFO:teuthology.orchestra.run.smithi077.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-11T22:08:57.394 INFO:teuthology.orchestra.run.smithi050.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.7 MB/s | 285 kB 00:00 2024-09-11T22:08:57.399 INFO:teuthology.orchestra.run.smithi077.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-11T22:08:57.458 INFO:teuthology.orchestra.run.smithi077.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-11T22:08:57.486 INFO:teuthology.orchestra.run.smithi050.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 21 MB/s | 7.4 MB 00:00 2024-09-11T22:08:57.511 INFO:teuthology.orchestra.run.smithi050.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 156 kB/s | 18 kB 00:00 2024-09-11T22:08:57.516 INFO:teuthology.orchestra.run.smithi077.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.1 MB/s | 548 kB 00:00 2024-09-11T22:08:57.542 INFO:teuthology.orchestra.run.smithi077.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-11T22:08:57.544 INFO:teuthology.orchestra.run.smithi050.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.3 MB/s | 765 kB 00:00 2024-09-11T22:08:57.567 INFO:teuthology.orchestra.run.smithi077.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-11T22:08:57.601 INFO:teuthology.orchestra.run.smithi077.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-09-11T22:08:57.651 INFO:teuthology.orchestra.run.smithi077.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 518 kB/s | 26 kB 00:00 2024-09-11T22:08:57.653 INFO:teuthology.orchestra.run.smithi050.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-09-11T22:08:57.676 INFO:teuthology.orchestra.run.smithi077.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T22:08:57.702 INFO:teuthology.orchestra.run.smithi077.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T22:08:57.727 INFO:teuthology.orchestra.run.smithi077.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-11T22:08:57.736 INFO:teuthology.orchestra.run.smithi050.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 997 kB/s | 191 kB 00:00 2024-09-11T22:08:57.762 INFO:teuthology.orchestra.run.smithi050.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-11T22:08:57.785 INFO:teuthology.orchestra.run.smithi077.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-11T22:08:57.787 INFO:teuthology.orchestra.run.smithi050.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-11T22:08:57.812 INFO:teuthology.orchestra.run.smithi050.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-11T22:08:57.819 INFO:teuthology.orchestra.run.smithi077.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-11T22:08:57.838 INFO:teuthology.orchestra.run.smithi050.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-11T22:08:57.844 INFO:teuthology.orchestra.run.smithi077.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T22:08:57.863 INFO:teuthology.orchestra.run.smithi050.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-11T22:08:57.878 INFO:teuthology.orchestra.run.smithi077.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-11T22:08:57.903 INFO:teuthology.orchestra.run.smithi077.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-09-11T22:08:57.913 INFO:teuthology.orchestra.run.smithi050.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-11T22:08:57.928 INFO:teuthology.orchestra.run.smithi077.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-11T22:08:57.954 INFO:teuthology.orchestra.run.smithi077.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T22:08:57.955 INFO:teuthology.orchestra.run.smithi050.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.6 MB/s | 1.2 MB 00:00 2024-09-11T22:08:57.979 INFO:teuthology.orchestra.run.smithi077.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-11T22:08:58.013 INFO:teuthology.orchestra.run.smithi077.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-11T22:08:58.038 INFO:teuthology.orchestra.run.smithi077.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-11T22:08:58.063 INFO:teuthology.orchestra.run.smithi077.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-11T22:08:58.088 INFO:teuthology.orchestra.run.smithi077.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-11T22:08:58.105 INFO:teuthology.orchestra.run.smithi077.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-11T22:08:58.122 INFO:teuthology.orchestra.run.smithi077.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-11T22:08:58.131 INFO:teuthology.orchestra.run.smithi050.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 612 kB/s | 107 kB 00:00 2024-09-11T22:08:58.139 INFO:teuthology.orchestra.run.smithi077.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-11T22:08:58.156 INFO:teuthology.orchestra.run.smithi077.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.1 MB/s | 20 kB 00:00 2024-09-11T22:08:58.157 INFO:teuthology.orchestra.run.smithi050.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-11T22:08:58.181 INFO:teuthology.orchestra.run.smithi050.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-11T22:08:58.212 INFO:teuthology.orchestra.run.smithi077.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-09-11T22:08:58.215 INFO:teuthology.orchestra.run.smithi077.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-11T22:08:58.223 INFO:teuthology.orchestra.run.smithi050.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 784 kB/s | 33 kB 00:00 2024-09-11T22:08:58.240 INFO:teuthology.orchestra.run.smithi077.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T22:08:58.249 INFO:teuthology.orchestra.run.smithi050.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-11T22:08:58.265 INFO:teuthology.orchestra.run.smithi077.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T22:08:58.282 INFO:teuthology.orchestra.run.smithi050.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-11T22:08:58.291 INFO:teuthology.orchestra.run.smithi077.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-11T22:08:58.308 INFO:teuthology.orchestra.run.smithi050.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-09-11T22:08:58.325 INFO:teuthology.orchestra.run.smithi077.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-11T22:08:58.332 INFO:teuthology.orchestra.run.smithi050.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-11T22:08:58.350 INFO:teuthology.orchestra.run.smithi077.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-11T22:08:58.375 INFO:teuthology.orchestra.run.smithi077.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-11T22:08:58.383 INFO:teuthology.orchestra.run.smithi050.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-11T22:08:58.400 INFO:teuthology.orchestra.run.smithi077.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-11T22:08:58.408 INFO:teuthology.orchestra.run.smithi050.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-11T22:08:58.426 INFO:teuthology.orchestra.run.smithi077.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 608 kB/s | 31 kB 00:00 2024-09-11T22:08:58.450 INFO:teuthology.orchestra.run.smithi050.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-11T22:08:58.451 INFO:teuthology.orchestra.run.smithi077.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T22:08:58.476 INFO:teuthology.orchestra.run.smithi077.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-11T22:08:58.500 INFO:teuthology.orchestra.run.smithi050.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-11T22:08:58.502 INFO:teuthology.orchestra.run.smithi077.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-11T22:08:58.526 INFO:teuthology.orchestra.run.smithi050.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-11T22:08:58.527 INFO:teuthology.orchestra.run.smithi077.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-11T22:08:58.553 INFO:teuthology.orchestra.run.smithi050.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-11T22:08:58.553 INFO:teuthology.orchestra.run.smithi077.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-11T22:08:58.586 INFO:teuthology.orchestra.run.smithi077.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-11T22:08:58.609 INFO:teuthology.orchestra.run.smithi050.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-11T22:08:58.611 INFO:teuthology.orchestra.run.smithi077.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-11T22:08:58.636 INFO:teuthology.orchestra.run.smithi077.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-11T22:08:58.660 INFO:teuthology.orchestra.run.smithi050.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-11T22:08:58.662 INFO:teuthology.orchestra.run.smithi077.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T22:08:58.693 INFO:teuthology.orchestra.run.smithi050.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-11T22:08:58.712 INFO:teuthology.orchestra.run.smithi077.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-11T22:08:58.888 INFO:teuthology.orchestra.run.smithi077.stdout:(148/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.1 MB/s | 16 MB 00:02 2024-09-11T22:08:59.021 INFO:teuthology.orchestra.run.smithi077.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-11T22:08:59.063 INFO:teuthology.orchestra.run.smithi077.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-09-11T22:08:59.138 INFO:teuthology.orchestra.run.smithi077.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 15 MB/s | 1.8 MB 00:00 2024-09-11T22:08:59.172 INFO:teuthology.orchestra.run.smithi077.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 376 kB/s | 41 kB 00:00 2024-09-11T22:08:59.222 INFO:teuthology.orchestra.run.smithi077.stdout:(153/156): librados2-19.1.1-298.gb53b6d3e.el9.x 6.1 MB/s | 3.4 MB 00:00 2024-09-11T22:08:59.247 INFO:teuthology.orchestra.run.smithi077.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 2.2 MB/s | 249 kB 00:00 2024-09-11T22:08:59.381 INFO:teuthology.orchestra.run.smithi077.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 1.4 MB 00:00 2024-09-11T22:08:59.427 INFO:teuthology.orchestra.run.smithi050.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-09-11T22:08:59.531 INFO:teuthology.orchestra.run.smithi077.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.8 MB/s | 2.4 MB 00:00 2024-09-11T22:08:59.535 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:08:59.535 INFO:teuthology.orchestra.run.smithi077.stdout:Total 23 MB/s | 226 MB 00:09 2024-09-11T22:09:00.303 INFO:teuthology.orchestra.run.smithi050.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 1.8 MB/s | 1.6 MB 00:00 2024-09-11T22:09:00.726 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-11T22:09:00.786 INFO:teuthology.orchestra.run.smithi050.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 1.8 MB/s | 910 kB 00:00 2024-09-11T22:09:00.878 INFO:teuthology.orchestra.run.smithi050.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.2 MB/s | 4.9 MB 00:02 2024-09-11T22:09:00.879 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-11T22:09:00.879 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-11T22:09:00.945 INFO:teuthology.orchestra.run.smithi050.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 867 kB/s | 137 kB 00:00 2024-09-11T22:09:01.078 INFO:teuthology.orchestra.run.smithi050.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 4.4 MB 00:02 2024-09-11T22:09:01.170 INFO:teuthology.orchestra.run.smithi050.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 954 kB/s | 87 kB 00:00 2024-09-11T22:09:01.404 INFO:teuthology.orchestra.run.smithi050.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.2 MB/s | 1.0 MB 00:00 2024-09-11T22:09:01.454 INFO:teuthology.orchestra.run.smithi050.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-11T22:09:01.605 INFO:teuthology.orchestra.run.smithi050.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-11T22:09:01.763 INFO:teuthology.orchestra.run.smithi050.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-11T22:09:01.805 INFO:teuthology.orchestra.run.smithi050.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 617 kB/s | 26 kB 00:00 2024-09-11T22:09:01.847 INFO:teuthology.orchestra.run.smithi050.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 460 kB/s | 19 kB 00:00 2024-09-11T22:09:01.956 INFO:teuthology.orchestra.run.smithi050.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-11T22:09:01.998 INFO:teuthology.orchestra.run.smithi050.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 837 kB/s | 35 kB 00:00 2024-09-11T22:09:03.085 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-11T22:09:03.085 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-11T22:09:03.190 INFO:teuthology.orchestra.run.smithi050.stdout:(81/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-09-11T22:09:03.257 INFO:teuthology.orchestra.run.smithi050.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-11T22:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-11T22:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-11T22:09:03.416 INFO:teuthology.orchestra.run.smithi050.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-09-11T22:09:03.483 INFO:teuthology.orchestra.run.smithi050.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-09-11T22:09:03.542 INFO:teuthology.orchestra.run.smithi050.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-11T22:09:03.600 INFO:teuthology.orchestra.run.smithi050.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-11T22:09:03.659 INFO:teuthology.orchestra.run.smithi050.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 873 kB/s | 51 kB 00:00 2024-09-11T22:09:03.709 INFO:teuthology.orchestra.run.smithi050.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-09-11T22:09:04.076 INFO:teuthology.orchestra.run.smithi050.stdout:(91/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-09-11T22:09:04.160 INFO:teuthology.orchestra.run.smithi050.stdout:(92/156): postgresql-server-13.16-1.el9.x86_64. 1.8 MB/s | 5.8 MB 00:03 2024-09-11T22:09:04.185 INFO:teuthology.orchestra.run.smithi050.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-11T22:09:04.260 INFO:teuthology.orchestra.run.smithi050.stdout:(94/156): python3-babel-2.9.1-2.el9.noarch.rpm 1.9 MB/s | 6.0 MB 00:03 2024-09-11T22:09:04.285 INFO:teuthology.orchestra.run.smithi050.stdout:(95/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 352 kB/s | 44 kB 00:00 2024-09-11T22:09:04.311 INFO:teuthology.orchestra.run.smithi050.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-11T22:09:04.336 INFO:teuthology.orchestra.run.smithi050.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 477 kB/s | 36 kB 00:00 2024-09-11T22:09:04.370 INFO:teuthology.orchestra.run.smithi050.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-11T22:09:04.395 INFO:teuthology.orchestra.run.smithi050.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 986 kB/s | 58 kB 00:00 2024-09-11T22:09:04.420 INFO:teuthology.orchestra.run.smithi050.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-11T22:09:04.454 INFO:teuthology.orchestra.run.smithi050.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-11T22:09:04.479 INFO:teuthology.orchestra.run.smithi050.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 762 kB/s | 45 kB 00:00 2024-09-11T22:09:04.505 INFO:teuthology.orchestra.run.smithi050.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 581 kB/s | 64 kB 00:00 2024-09-11T22:09:04.555 INFO:teuthology.orchestra.run.smithi050.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-11T22:09:04.580 INFO:teuthology.orchestra.run.smithi050.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-11T22:09:04.605 INFO:teuthology.orchestra.run.smithi050.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-11T22:09:04.706 INFO:teuthology.orchestra.run.smithi050.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-09-11T22:09:04.731 INFO:teuthology.orchestra.run.smithi050.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T22:09:04.757 INFO:teuthology.orchestra.run.smithi050.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T22:09:04.782 INFO:teuthology.orchestra.run.smithi050.stdout:(110/156): lua-devel-5.4.4-4.el9.x86_64.rpm 68 kB/s | 22 kB 00:00 2024-09-11T22:09:04.815 INFO:teuthology.orchestra.run.smithi050.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-11T22:09:04.849 INFO:teuthology.orchestra.run.smithi050.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-11T22:09:04.874 INFO:teuthology.orchestra.run.smithi050.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-11T22:09:04.899 INFO:teuthology.orchestra.run.smithi050.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T22:09:04.925 INFO:teuthology.orchestra.run.smithi050.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T22:09:04.950 INFO:teuthology.orchestra.run.smithi050.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-11T22:09:04.984 INFO:teuthology.orchestra.run.smithi050.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-09-11T22:09:05.009 INFO:teuthology.orchestra.run.smithi050.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-11T22:09:05.042 INFO:teuthology.orchestra.run.smithi050.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-11T22:09:05.068 INFO:teuthology.orchestra.run.smithi050.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-11T22:09:05.093 INFO:teuthology.orchestra.run.smithi050.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-11T22:09:05.126 INFO:teuthology.orchestra.run.smithi050.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-11T22:09:05.152 INFO:teuthology.orchestra.run.smithi050.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-11T22:09:05.177 INFO:teuthology.orchestra.run.smithi050.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-11T22:09:05.202 INFO:teuthology.orchestra.run.smithi050.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-11T22:09:05.228 INFO:teuthology.orchestra.run.smithi050.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-09-11T22:09:05.261 INFO:teuthology.orchestra.run.smithi050.stdout:(127/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-09-11T22:09:05.295 INFO:teuthology.orchestra.run.smithi050.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 293 kB/s | 20 kB 00:00 2024-09-11T22:09:05.320 INFO:teuthology.orchestra.run.smithi050.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.0 MB/s | 46 kB 00:00 2024-09-11T22:09:05.354 INFO:teuthology.orchestra.run.smithi050.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-11T22:09:05.380 INFO:teuthology.orchestra.run.smithi050.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T22:09:05.430 INFO:teuthology.orchestra.run.smithi050.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-09-11T22:09:05.472 INFO:teuthology.orchestra.run.smithi050.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 394 kB/s | 16 kB 00:00 2024-09-11T22:09:05.497 INFO:teuthology.orchestra.run.smithi050.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-11T22:09:05.522 INFO:teuthology.orchestra.run.smithi050.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-11T22:09:05.548 INFO:teuthology.orchestra.run.smithi050.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-11T22:09:05.573 INFO:teuthology.orchestra.run.smithi050.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-11T22:09:05.598 INFO:teuthology.orchestra.run.smithi050.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T22:09:05.632 INFO:teuthology.orchestra.run.smithi050.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-11T22:09:05.657 INFO:teuthology.orchestra.run.smithi050.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 609 kB/s | 36 kB 00:00 2024-09-11T22:09:05.682 INFO:teuthology.orchestra.run.smithi050.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-11T22:09:05.708 INFO:teuthology.orchestra.run.smithi050.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-11T22:09:05.741 INFO:teuthology.orchestra.run.smithi050.stdout:(143/156): python3-kubernetes-26.1.0-2.el9.noar 2.1 MB/s | 1.0 MB 00:00 2024-09-11T22:09:05.767 INFO:teuthology.orchestra.run.smithi050.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-11T22:09:05.792 INFO:teuthology.orchestra.run.smithi050.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-11T22:09:05.818 INFO:teuthology.orchestra.run.smithi050.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 7.2 MB/s | 191 kB 00:00 2024-09-11T22:09:05.843 INFO:teuthology.orchestra.run.smithi050.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-11T22:09:05.894 INFO:teuthology.orchestra.run.smithi050.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T22:09:06.161 INFO:teuthology.orchestra.run.smithi050.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 10 MB/s | 3.4 MB 00:00 2024-09-11T22:09:06.261 INFO:teuthology.orchestra.run.smithi050.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 7.6 MB/s | 3.2 MB 00:00 2024-09-11T22:09:06.328 INFO:teuthology.orchestra.run.smithi050.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 5.4 MB/s | 2.3 MB 00:00 2024-09-11T22:09:06.387 INFO:teuthology.orchestra.run.smithi050.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-11T22:09:06.403 INFO:teuthology.orchestra.run.smithi050.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 287 kB/s | 41 kB 00:00 2024-09-11T22:09:06.462 INFO:teuthology.orchestra.run.smithi050.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 6.0 MB/s | 1.8 MB 00:00 2024-09-11T22:09:06.562 INFO:teuthology.orchestra.run.smithi050.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 7.7 MB/s | 1.4 MB 00:00 2024-09-11T22:09:06.887 INFO:teuthology.orchestra.run.smithi050.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.9 MB/s | 2.4 MB 00:00 2024-09-11T22:09:06.893 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:09:06.894 INFO:teuthology.orchestra.run.smithi050.stdout:Total 16 MB/s | 226 MB 00:14 2024-09-11T22:09:08.169 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-09-11T22:09:08.342 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-09-11T22:09:08.342 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-09-11T22:09:09.521 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-11T22:09:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T22:09:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T22:09:09.759 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T22:09:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T22:09:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T22:09:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T22:09:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T22:09:10.328 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:09:10.451 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:09:10.479 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:09:10.555 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:09:10.584 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:09:10.660 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-09-11T22:09:10.661 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-09-11T22:09:10.754 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T22:09:10.813 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T22:09:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:09:10.946 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:09:10.976 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:09:11.039 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:09:11.069 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:09:11.095 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:09:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:09:11.446 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:09:11.558 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T22:09:11.666 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:09:11.743 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:09:12.001 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:09:12.107 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T22:09:12.201 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T22:09:12.240 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T22:09:12.274 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T22:09:12.346 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T22:09:12.391 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T22:09:12.424 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T22:09:12.467 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T22:09:12.500 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T22:09:12.528 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T22:09:12.596 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T22:09:12.651 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T22:09:12.690 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T22:09:12.733 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T22:09:12.816 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T22:09:12.860 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T22:09:12.904 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T22:09:12.932 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T22:09:13.000 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T22:09:13.046 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T22:09:13.121 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T22:09:13.252 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T22:09:13.307 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T22:09:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T22:09:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T22:09:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T22:09:13.966 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T22:09:14.004 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T22:09:14.046 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T22:09:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T22:09:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T22:09:14.312 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T22:09:14.383 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T22:09:14.417 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T22:09:14.452 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T22:09:14.499 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T22:09:14.535 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T22:09:14.578 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T22:09:14.620 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T22:09:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T22:09:14.805 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T22:09:14.846 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T22:09:14.948 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T22:09:14.981 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T22:09:15.021 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T22:09:15.046 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T22:09:15.086 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T22:09:15.182 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T22:09:15.312 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T22:09:15.529 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T22:09:15.588 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T22:09:15.630 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T22:09:15.672 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T22:09:15.715 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T22:09:15.744 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T22:09:15.779 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T22:09:15.812 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T22:09:15.866 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T22:09:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T22:09:15.987 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T22:09:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T22:09:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T22:09:16.177 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T22:09:16.233 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T22:09:16.953 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T22:09:17.005 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T22:09:17.030 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T22:09:17.110 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-09-11T22:09:17.130 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T22:09:17.177 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T22:09:17.230 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T22:09:17.234 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T22:09:17.301 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T22:09:17.318 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T22:09:17.376 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T22:09:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T22:09:17.559 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T22:09:17.561 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T22:09:17.580 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T22:09:17.585 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T22:09:17.642 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T22:09:17.665 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T22:09:17.995 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T22:09:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:09:18.237 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:09:18.262 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:09:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T22:09:18.355 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:09:18.392 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:09:18.445 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T22:09:18.570 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T22:09:18.631 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T22:09:18.658 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:09:18.765 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:09:18.792 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:09:18.839 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:09:18.868 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:09:18.888 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:09:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:09:19.274 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:09:19.425 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T22:09:19.529 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:09:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:09:19.687 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T22:09:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T22:09:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T22:09:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T22:09:19.868 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:09:19.979 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T22:09:20.074 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T22:09:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T22:09:20.145 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T22:09:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T22:09:20.182 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:09:20.227 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T22:09:20.264 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:09:20.277 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T22:09:20.295 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T22:09:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T22:09:20.331 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T22:09:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T22:09:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T22:09:20.420 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T22:09:20.501 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T22:09:20.561 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T22:09:20.591 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T22:09:20.634 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T22:09:20.714 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T22:09:20.745 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T22:09:20.789 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T22:09:20.811 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T22:09:20.817 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T22:09:20.843 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:09:20.891 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T22:09:20.915 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:09:20.945 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T22:09:20.949 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T22:09:21.028 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T22:09:21.173 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T22:09:21.227 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T22:09:21.788 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T22:09:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T22:09:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T22:09:21.969 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T22:09:22.007 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T22:09:22.050 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T22:09:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T22:09:22.318 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T22:09:22.374 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T22:09:22.449 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T22:09:22.486 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T22:09:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T22:09:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T22:09:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T22:09:22.657 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T22:09:22.708 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T22:09:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T22:09:23.001 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T22:09:23.043 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T22:09:23.150 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T22:09:23.184 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T22:09:23.228 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T22:09:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T22:09:23.288 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T22:09:23.384 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T22:09:23.406 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:09:23.450 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:09:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T22:09:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T22:09:23.597 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T22:09:23.636 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T22:09:23.678 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T22:09:23.718 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T22:09:23.747 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T22:09:23.782 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T22:09:23.824 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T22:09:23.866 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T22:09:23.925 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T22:09:23.997 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:09:24.016 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T22:09:24.037 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:09:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T22:09:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T22:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T22:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T22:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:09:24.155 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:09:24.212 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T22:09:24.272 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T22:09:25.042 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T22:09:25.096 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T22:09:25.130 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T22:09:25.234 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T22:09:25.285 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T22:09:25.330 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T22:09:25.430 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T22:09:25.466 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T22:09:25.660 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T22:09:25.696 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T22:09:25.778 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T22:09:26.471 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T22:09:26.599 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T22:09:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T22:09:28.009 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T22:09:28.037 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T22:09:28.070 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T22:09:28.403 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T22:09:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:09:28.566 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:09:28.596 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T22:09:28.633 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T22:09:29.138 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T22:09:29.177 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:09:29.249 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:09:29.279 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T22:09:32.094 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:09:32.134 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:09:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:09:32.771 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:09:32.869 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:09:32.869 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T22:09:32.869 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T22:09:32.869 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:09:32.914 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:09:36.320 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:09:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2024-09-11T22:09:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2024-09-11T22:09:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2024-09-11T22:09:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2024-09-11T22:09:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2024-09-11T22:09:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2024-09-11T22:09:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2024-09-11T22:09:36.321 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:09:36.492 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:09:36.508 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:09:36.508 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:36.508 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T22:09:36.508 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:09:37.995 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:09:38.021 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:09:38.022 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:38.022 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T22:09:38.022 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:09:38.022 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:09:38.022 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:09:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:09:38.269 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:09:38.269 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:38.269 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T22:09:38.269 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:09:38.269 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:09:38.269 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:09:38.705 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:09:38.728 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:09:38.728 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:38.728 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T22:09:38.728 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:09:38.728 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:09:38.729 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:09:38.835 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T22:09:38.892 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T22:09:38.947 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T22:09:39.131 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T22:09:39.180 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T22:09:39.250 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T22:09:39.337 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T22:09:39.477 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T22:09:39.523 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T22:09:39.554 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T22:09:39.582 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T22:09:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:09:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:09:40.045 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T22:09:40.107 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T22:09:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:09:41.169 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:09:41.205 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:09:42.163 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:09:42.197 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:09:42.297 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:09:42.450 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T22:09:42.482 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:09:42.506 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:09:42.506 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:42.506 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T22:09:42.506 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:09:42.506 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:09:42.506 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:09:42.558 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:09:42.569 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:09:42.667 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T22:09:42.722 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T22:09:43.647 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T22:09:43.685 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:09:43.709 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:09:43.709 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:43.709 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T22:09:43.709 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:09:43.709 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:09:43.709 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:09:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:09:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:09:43.775 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:43.775 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T22:09:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:09:43.820 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:09:43.842 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:09:43.842 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:43.843 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T22:09:43.843 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:09:43.843 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:09:43.843 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:09:44.146 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:09:44.168 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:09:44.169 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:44.169 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T22:09:44.169 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:09:44.169 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:09:44.169 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:09:45.155 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:09:45.155 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2024-09-11T22:09:45.155 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2024-09-11T22:09:45.155 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2024-09-11T22:09:45.155 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2024-09-11T22:09:45.155 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2024-09-11T22:09:45.155 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /root 2024-09-11T22:09:45.155 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2024-09-11T22:09:45.155 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:09:45.334 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:09:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:09:45.351 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:45.351 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T22:09:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:09:46.895 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:09:46.924 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:09:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T22:09:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:09:46.924 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:09:46.924 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:09:47.162 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:09:47.187 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:09:47.187 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:47.188 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T22:09:47.188 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:09:47.188 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:09:47.188 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:09:47.647 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:09:47.672 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:09:47.672 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:47.672 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T22:09:47.672 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:09:47.672 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:09:47.672 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:09:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T22:09:47.844 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T22:09:47.916 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T22:09:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T22:09:48.182 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T22:09:48.263 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T22:09:48.352 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T22:09:48.504 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T22:09:48.548 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T22:09:48.588 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T22:09:48.615 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T22:09:48.733 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T22:09:48.782 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T22:09:48.831 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T22:09:48.863 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T22:09:48.891 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T22:09:49.076 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:09:49.091 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T22:09:49.106 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:09:49.138 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T22:09:49.145 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T22:09:49.176 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T22:09:49.204 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T22:09:49.205 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T22:09:49.229 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:09:49.243 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T22:09:49.815 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:09:49.849 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:09:49.869 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:09:50.339 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:09:50.389 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:09:50.698 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T22:09:50.795 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T22:09:50.843 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T22:09:50.933 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T22:09:50.965 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T22:09:50.991 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T22:09:51.016 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T22:09:51.016 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:09:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:09:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:09:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:09:51.226 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T22:09:51.231 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:09:51.231 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:09:51.407 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:09:51.419 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:09:51.420 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:09:51.440 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:09:51.512 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:09:51.551 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:09:51.577 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:09:51.726 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T22:09:51.750 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:09:51.776 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:09:51.776 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:51.776 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T22:09:51.776 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:09:51.776 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:09:51.776 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:09:51.826 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:09:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:09:51.940 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T22:09:51.997 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T22:09:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T22:09:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:09:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:09:53.029 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:53.029 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T22:09:53.029 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:09:53.029 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:09:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:09:53.079 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:09:53.103 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:09:53.103 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:53.103 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T22:09:53.103 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:09:53.163 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:09:53.188 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:09:53.188 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:53.188 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T22:09:53.188 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:09:53.188 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:09:53.188 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:09:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:09:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:09:53.531 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:09:53.531 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T22:09:53.531 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:09:53.531 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:09:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:09:57.107 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:09:57.108 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T22:09:57.108 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T22:09:57.108 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T22:09:57.108 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T22:09:57.108 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T22:09:57.108 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T22:09:57.108 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T22:09:57.108 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:09:57.109 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:09:57.109 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:09:57.109 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T22:09:57.109 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T22:09:57.109 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:09:57.109 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T22:09:57.109 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T22:09:57.109 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T22:09:57.109 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T22:09:57.109 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T22:09:57.109 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T22:09:57.109 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T22:09:57.110 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T22:09:57.110 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T22:09:57.110 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T22:09:57.110 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T22:09:57.110 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T22:09:57.110 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T22:09:57.110 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T22:09:57.110 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T22:09:57.110 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T22:09:57.121 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T22:09:57.121 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T22:09:57.121 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T22:09:57.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T22:09:57.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T22:09:57.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T22:09:57.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T22:09:57.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T22:09:57.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T22:09:57.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T22:09:57.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T22:09:57.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T22:09:57.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T22:09:57.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T22:09:57.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T22:09:57.123 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T22:09:57.123 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T22:09:57.123 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T22:09:57.123 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T22:09:57.123 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T22:09:57.123 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T22:09:57.123 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T22:09:57.123 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T22:09:57.123 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T22:09:57.123 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T22:09:57.123 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T22:09:57.123 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T22:09:57.124 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T22:09:57.124 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T22:09:57.124 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T22:09:57.124 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T22:09:57.124 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T22:09:57.124 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T22:09:57.124 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T22:09:57.124 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T22:09:57.124 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T22:09:57.124 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T22:09:57.124 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T22:09:57.124 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T22:09:57.125 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T22:09:57.126 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T22:09:57.126 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T22:09:57.126 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T22:09:57.126 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T22:09:57.126 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T22:09:57.126 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T22:09:57.126 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T22:09:57.126 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T22:09:57.126 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T22:09:57.126 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T22:09:57.126 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T22:09:57.127 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T22:09:57.128 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T22:09:57.128 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T22:09:57.128 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T22:09:57.128 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T22:09:57.128 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T22:09:57.128 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T22:09:57.128 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T22:09:57.128 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T22:09:57.128 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T22:09:57.128 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T22:09:57.128 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T22:09:57.128 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T22:09:57.129 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T22:09:57.129 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T22:09:57.129 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T22:09:57.129 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T22:09:57.129 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T22:09:57.129 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T22:09:57.129 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T22:09:57.129 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T22:09:57.129 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T22:09:57.129 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T22:09:57.129 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T22:09:57.129 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T22:09:57.129 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T22:09:57.130 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T22:09:57.130 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T22:09:57.130 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T22:09:57.130 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T22:09:57.130 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T22:09:57.130 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T22:09:57.130 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T22:09:57.130 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T22:09:57.130 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T22:09:57.130 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T22:09:57.130 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T22:09:57.130 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T22:09:57.130 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T22:09:57.131 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T22:09:57.132 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T22:09:57.132 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T22:09:57.132 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T22:09:57.132 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T22:09:58.376 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T22:09:58.418 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T22:09:58.459 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T22:09:58.490 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T22:09:58.518 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T22:09:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T22:09:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T22:09:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T22:09:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T22:09:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T22:09:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:09:59.568 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:09:59.590 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:09:59.712 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:09:59.752 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:09:59.752 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-09-11T22:09:59.752 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T22:09:59.752 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T22:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T22:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T22:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T22:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T22:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-11T22:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T22:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T22:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T22:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T22:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:09:59.755 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.755 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.755 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:09:59.755 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.755 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.755 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.755 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:09:59.755 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:09:59.755 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.755 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.755 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:09:59.755 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T22:09:59.756 INFO:teuthology.orchestra.run.smithi077.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T22:09:59.756 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T22:09:59.756 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T22:09:59.756 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T22:09:59.756 INFO:teuthology.orchestra.run.smithi077.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T22:09:59.756 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T22:09:59.756 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T22:09:59.756 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T22:09:59.756 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T22:09:59.756 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T22:09:59.756 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.756 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.756 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.757 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T22:09:59.757 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T22:09:59.757 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T22:09:59.757 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T22:09:59.757 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T22:09:59.757 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.757 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.757 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T22:09:59.757 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.757 INFO:teuthology.orchestra.run.smithi077.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T22:09:59.757 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T22:09:59.757 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T22:09:59.757 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T22:09:59.758 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T22:09:59.758 INFO:teuthology.orchestra.run.smithi077.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T22:09:59.758 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T22:09:59.758 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T22:09:59.758 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T22:09:59.758 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T22:09:59.758 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T22:09:59.758 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T22:09:59.758 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T22:09:59.758 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T22:09:59.758 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T22:09:59.758 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T22:09:59.759 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T22:09:59.759 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T22:09:59.759 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T22:09:59.759 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T22:09:59.759 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T22:09:59.759 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T22:09:59.759 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T22:09:59.759 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.759 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.759 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.759 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T22:09:59.759 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T22:09:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T22:09:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T22:09:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T22:09:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T22:09:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T22:09:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T22:09:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T22:09:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T22:09:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T22:09:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T22:09:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T22:09:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T22:09:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T22:09:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T22:09:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T22:09:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T22:09:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T22:09:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T22:09:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T22:09:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T22:09:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T22:09:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T22:09:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T22:09:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T22:09:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T22:09:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T22:09:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T22:09:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T22:09:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T22:09:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T22:09:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T22:09:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T22:09:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T22:09:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T22:09:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T22:09:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T22:09:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T22:09:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T22:09:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T22:09:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T22:09:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T22:09:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T22:09:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T22:09:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T22:09:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T22:09:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T22:09:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T22:09:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T22:09:59.764 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T22:09:59.764 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T22:09:59.764 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T22:09:59.764 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T22:09:59.764 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T22:09:59.764 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T22:09:59.764 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T22:09:59.764 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T22:09:59.764 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.764 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.764 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:09:59.764 INFO:teuthology.orchestra.run.smithi077.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T22:09:59.765 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T22:09:59.765 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T22:09:59.765 INFO:teuthology.orchestra.run.smithi077.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T22:09:59.765 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T22:09:59.765 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T22:09:59.765 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T22:09:59.765 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:09:59.765 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-11T22:10:00.139 DEBUG:teuthology.parallel:result is None 2024-09-11T22:10:00.516 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T22:10:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T22:10:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T22:10:00.774 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T22:10:00.818 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T22:10:00.852 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T22:10:00.878 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T22:10:00.878 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:10:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:10:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:10:01.054 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:10:01.079 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T22:10:01.085 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:10:01.085 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:10:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:10:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:10:01.349 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:10:01.417 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:10:07.068 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:10:07.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T22:10:07.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T22:10:07.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T22:10:07.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T22:10:07.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T22:10:07.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T22:10:07.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T22:10:07.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:10:07.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:10:07.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:10:07.069 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T22:10:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T22:10:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:10:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T22:10:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T22:10:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T22:10:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T22:10:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T22:10:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T22:10:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T22:10:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T22:10:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T22:10:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T22:10:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T22:10:07.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T22:10:07.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T22:10:07.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T22:10:07.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T22:10:07.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T22:10:07.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T22:10:07.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T22:10:07.071 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T22:10:07.082 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T22:10:07.082 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T22:10:07.082 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T22:10:07.082 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T22:10:07.082 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T22:10:07.082 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T22:10:07.082 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T22:10:07.082 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T22:10:07.083 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T22:10:07.083 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T22:10:07.083 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T22:10:07.083 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T22:10:07.083 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T22:10:07.083 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T22:10:07.083 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T22:10:07.083 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T22:10:07.083 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T22:10:07.083 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T22:10:07.083 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T22:10:07.083 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T22:10:07.084 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T22:10:07.084 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T22:10:07.084 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T22:10:07.084 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T22:10:07.084 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T22:10:07.084 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T22:10:07.084 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T22:10:07.084 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T22:10:07.084 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T22:10:07.084 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T22:10:07.084 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T22:10:07.084 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T22:10:07.084 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T22:10:07.085 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T22:10:07.085 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T22:10:07.085 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T22:10:07.085 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T22:10:07.085 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T22:10:07.085 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T22:10:07.085 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T22:10:07.085 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T22:10:07.085 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T22:10:07.085 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T22:10:07.085 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T22:10:07.085 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T22:10:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T22:10:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T22:10:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T22:10:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T22:10:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T22:10:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T22:10:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T22:10:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T22:10:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T22:10:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T22:10:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T22:10:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T22:10:07.086 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T22:10:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T22:10:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T22:10:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T22:10:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T22:10:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T22:10:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T22:10:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T22:10:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T22:10:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T22:10:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T22:10:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T22:10:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T22:10:07.087 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T22:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T22:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T22:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T22:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T22:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T22:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T22:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T22:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T22:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T22:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T22:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T22:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T22:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T22:10:07.089 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T22:10:07.090 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T22:10:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T22:10:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T22:10:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T22:10:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T22:10:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T22:10:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T22:10:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T22:10:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T22:10:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T22:10:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T22:10:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T22:10:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T22:10:07.091 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T22:10:07.092 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T22:10:07.092 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T22:10:07.092 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T22:10:07.092 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T22:10:07.092 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T22:10:07.092 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T22:10:09.860 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:10:09.861 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:09.861 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2024-09-11T22:10:09.861 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T22:10:09.861 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T22:10:09.861 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T22:10:09.861 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T22:10:09.861 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.861 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.861 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T22:10:09.861 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T22:10:09.861 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-09-11T22:10:09.862 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T22:10:09.862 INFO:teuthology.orchestra.run.smithi050.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T22:10:09.862 INFO:teuthology.orchestra.run.smithi050.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T22:10:09.862 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T22:10:09.862 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.862 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.862 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.862 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.862 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:10:09.862 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.862 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.863 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.863 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:10:09.863 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:10:09.863 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:10:09.863 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:10:09.863 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:10:09.863 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.863 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.863 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:10:09.863 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.863 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.863 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.863 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:10:09.864 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:10:09.864 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.864 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.864 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:10:09.864 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T22:10:09.864 INFO:teuthology.orchestra.run.smithi050.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T22:10:09.864 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T22:10:09.864 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T22:10:09.864 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T22:10:09.864 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T22:10:09.865 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T22:10:09.865 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T22:10:09.865 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T22:10:09.865 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T22:10:09.865 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T22:10:09.865 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.865 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.865 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.865 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T22:10:09.865 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T22:10:09.865 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T22:10:09.866 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T22:10:09.866 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T22:10:09.866 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.866 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.866 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T22:10:09.866 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.866 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T22:10:09.866 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T22:10:09.866 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T22:10:09.866 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T22:10:09.866 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T22:10:09.866 INFO:teuthology.orchestra.run.smithi050.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T22:10:09.867 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T22:10:09.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T22:10:09.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T22:10:09.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T22:10:09.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T22:10:09.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T22:10:09.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T22:10:09.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T22:10:09.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T22:10:09.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T22:10:09.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T22:10:09.869 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T22:10:09.869 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T22:10:09.869 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T22:10:09.869 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T22:10:09.869 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T22:10:09.869 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T22:10:09.869 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T22:10:09.869 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T22:10:09.869 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T22:10:09.869 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T22:10:09.869 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T22:10:09.869 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T22:10:09.869 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T22:10:09.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T22:10:09.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T22:10:09.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T22:10:09.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T22:10:09.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T22:10:09.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T22:10:09.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T22:10:09.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T22:10:09.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T22:10:09.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T22:10:09.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T22:10:09.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T22:10:09.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T22:10:09.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T22:10:09.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T22:10:09.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T22:10:09.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T22:10:09.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T22:10:09.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T22:10:09.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T22:10:09.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.871 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T22:10:09.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T22:10:09.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T22:10:09.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T22:10:09.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T22:10:09.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T22:10:09.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T22:10:09.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T22:10:09.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T22:10:09.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T22:10:09.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T22:10:09.872 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T22:10:09.873 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T22:10:09.873 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T22:10:09.873 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T22:10:09.873 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T22:10:09.873 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T22:10:09.873 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T22:10:09.873 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.873 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.873 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:10:09.873 INFO:teuthology.orchestra.run.smithi050.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T22:10:09.873 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T22:10:09.873 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T22:10:09.873 INFO:teuthology.orchestra.run.smithi050.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T22:10:09.874 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T22:10:09.874 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T22:10:09.874 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T22:10:09.874 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:09.874 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-09-11T22:10:10.310 DEBUG:teuthology.parallel:result is None 2024-09-11T22:10:10.311 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:10:10.464 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T22:10:10.488 INFO:teuthology.orchestra.run.smithi050.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T22:10:10.489 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T22:10:10.489 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T22:10:10.490 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:10:10.632 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T22:10:10.660 INFO:teuthology.orchestra.run.smithi077.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T22:10:10.660 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T22:10:10.660 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T22:10:10.662 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T22:10:10.662 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:10.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T22:10:10.693 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:10.693 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T22:10:10.732 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T22:10:10.732 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:10.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T22:10:10.760 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T22:10:10.826 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:10.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T22:10:10.855 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T22:10:10.923 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T22:10:10.923 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:10.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T22:10:10.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T22:10:11.014 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:11.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T22:10:11.041 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T22:10:11.108 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T22:10:11.108 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:11.108 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T22:10:11.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T22:10:11.199 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:11.199 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T22:10:11.224 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T22:10:11.290 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T22:10:11.371 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T22:10:11.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2024-09-11T22:10:11.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /var/log/ceph 2024-09-11T22:10:11.398 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T22:10:11.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T22:10:11.439 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T22:10:11.465 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T22:10:11.465 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T22:10:11.505 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T22:10:11.536 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-11T22:10:11.536 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-11T22:10:11.536 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-11T22:10:11.537 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:11.537 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T22:10:11.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T22:10:11.697 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-11T22:10:11.722 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:11.722 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T22:10:11.738 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T22:10:11.848 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-11T22:10:11.878 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T22:10:11.878 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T22:10:11.878 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901414', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/scrub}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901414', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPJ7TWZogTp0OuRs7WmLTZDnHvzJ4juQlVI3e0Uo73F3coD2O0ZBcUAy3pgxx7bUH4m9gOvxKppUUG8amAAZMyQ=', 'smithi077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXHSd9LbLo2ZTGgy1ULvmPc6yw0YxXo1HHEi+Kf3xrxBX/vdR6qgcqxrdBCdahwLGZxm8EaOLJ8AHNCKFvZXV8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T22:10:11.879 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T22:10:11.881 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T22:10:11.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T22:10:11.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T22:10:11.992 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:11.992 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T22:10:12.018 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T22:10:12.018 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-09-11T22:10:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T22:10:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:10:12.073 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-11T22:10:12.073 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:10:12.074 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:10:12.074 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-11 22:10:01.802657147 +0000 2024-09-11T22:10:12.074 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-11 22:08:07.882075193 +0000 2024-09-11T22:10:12.074 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-11 22:08:07.882075193 +0000 2024-09-11T22:10:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-09-11 22:08:07.882075193 +0000 2024-09-11T22:10:12.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T22:10:12.137 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:10:12.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:10:12.138 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000102078 s, 5.0 MB/s 2024-09-11T22:10:12.139 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T22:10:12.196 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-09-11T22:10:12.252 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T22:10:12.252 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:10:12.252 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-11T22:10:12.252 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:10:12.252 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:10:12.253 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-11 22:10:01.802657147 +0000 2024-09-11T22:10:12.253 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-11 22:08:08.202066891 +0000 2024-09-11T22:10:12.253 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-11 22:08:08.202066891 +0000 2024-09-11T22:10:12.253 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-09-11 22:08:08.202066891 +0000 2024-09-11T22:10:12.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T22:10:12.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:10:12.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:10:12.316 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 8.6697e-05 s, 5.9 MB/s 2024-09-11T22:10:12.318 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T22:10:12.374 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-09-11T22:10:12.430 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T22:10:12.430 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:10:12.430 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-11T22:10:12.430 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:10:12.430 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:10:12.430 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-11 22:10:01.803657121 +0000 2024-09-11T22:10:12.431 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-11 22:08:08.531058356 +0000 2024-09-11T22:10:12.431 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-11 22:08:08.531058356 +0000 2024-09-11T22:10:12.431 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-09-11 22:08:08.531058356 +0000 2024-09-11T22:10:12.431 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T22:10:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:10:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:10:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.9463e-05 s, 5.1 MB/s 2024-09-11T22:10:12.495 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T22:10:12.551 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-09-11T22:10:12.607 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T22:10:12.607 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:10:12.607 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-11T22:10:12.607 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:10:12.607 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:10:12.608 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-11 22:10:01.803657121 +0000 2024-09-11T22:10:12.608 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-11 22:08:08.846050183 +0000 2024-09-11T22:10:12.608 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-11 22:08:08.846050183 +0000 2024-09-11T22:10:12.608 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-09-11 22:08:08.846050183 +0000 2024-09-11T22:10:12.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T22:10:12.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:10:12.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:10:12.671 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.0001016 s, 5.0 MB/s 2024-09-11T22:10:12.673 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T22:10:12.730 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T22:10:12.730 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:12.730 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T22:10:12.746 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T22:10:12.746 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-09-11T22:10:12.801 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T22:10:12.801 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:10:12.802 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T22:10:12.802 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:10:12.802 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:10:12.802 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-11 22:09:51.919181477 +0000 2024-09-11T22:10:12.802 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-11 22:08:04.191370616 +0000 2024-09-11T22:10:12.802 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-11 22:08:04.191370616 +0000 2024-09-11T22:10:12.802 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-11 22:08:04.191370616 +0000 2024-09-11T22:10:12.802 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T22:10:12.864 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-11T22:10:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-11T22:10:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000187897 s, 2.7 MB/s 2024-09-11T22:10:12.866 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T22:10:12.922 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-09-11T22:10:12.977 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T22:10:12.977 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:10:12.977 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-11T22:10:12.977 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:10:12.977 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:10:12.978 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-11 22:09:51.919181477 +0000 2024-09-11T22:10:12.978 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-11 22:08:04.518363430 +0000 2024-09-11T22:10:12.978 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-11 22:08:04.518363430 +0000 2024-09-11T22:10:12.978 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-11 22:08:04.518363430 +0000 2024-09-11T22:10:12.978 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T22:10:13.040 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-11T22:10:13.040 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-11T22:10:13.040 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000210891 s, 2.4 MB/s 2024-09-11T22:10:13.042 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T22:10:13.098 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-09-11T22:10:13.153 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T22:10:13.153 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:10:13.153 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-11T22:10:13.153 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:10:13.154 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:10:13.154 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-11 22:09:51.919181477 +0000 2024-09-11T22:10:13.154 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-11 22:08:04.841356331 +0000 2024-09-11T22:10:13.154 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-11 22:08:04.841356331 +0000 2024-09-11T22:10:13.154 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-11 22:08:04.841356331 +0000 2024-09-11T22:10:13.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T22:10:13.216 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-11T22:10:13.216 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-11T22:10:13.216 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000170552 s, 3.0 MB/s 2024-09-11T22:10:13.217 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T22:10:13.273 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-09-11T22:10:13.328 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T22:10:13.328 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:10:13.329 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-11T22:10:13.329 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:10:13.329 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:10:13.329 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-11 22:09:51.920181456 +0000 2024-09-11T22:10:13.329 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-11 22:08:05.176348968 +0000 2024-09-11T22:10:13.329 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-11 22:08:05.176348968 +0000 2024-09-11T22:10:13.330 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-11 22:08:05.176348968 +0000 2024-09-11T22:10:13.330 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T22:10:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-11T22:10:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-11T22:10:13.391 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000172677 s, 3.0 MB/s 2024-09-11T22:10:13.392 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T22:10:13.448 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T22:10:13.448 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T22:10:13.448 INFO:tasks.ceph:Generating config... 2024-09-11T22:10:13.449 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-11T22:10:13.449 INFO:tasks.ceph:[client] debug client = 20 2024-09-11T22:10:13.449 INFO:tasks.ceph:[client] debug ms = 1 2024-09-11T22:10:13.449 INFO:tasks.ceph:[client] pid file = 2024-09-11T22:10:13.449 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-11T22:10:13.450 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-11T22:10:13.450 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-11T22:10:13.450 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-11T22:10:13.450 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-11T22:10:13.450 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-11T22:10:13.450 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-09-11T22:10:13.450 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-11T22:10:13.450 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-11T22:10:13.450 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-09-11T22:10:13.450 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-11T22:10:13.450 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-11T22:10:13.450 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-11T22:10:13.450 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-11T22:10:13.450 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-11T22:10:13.451 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-11T22:10:13.451 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T22:10:13.451 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T22:10:13.451 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T22:10:13.451 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T22:10:13.451 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T22:10:13.451 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-11T22:10:13.451 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-11T22:10:13.451 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-11T22:10:13.451 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-11T22:10:13.451 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-11T22:10:13.451 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-11T22:10:13.451 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T22:10:13.451 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T22:10:13.452 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-11T22:10:13.452 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-11T22:10:13.452 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T22:10:13.452 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T22:10:13.452 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-11T22:10:13.452 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T22:10:13.452 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T22:10:13.452 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T22:10:13.452 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T22:10:13.452 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T22:10:13.452 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-11T22:10:13.452 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T22:10:13.453 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T22:10:13.508 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T22:10:13.511 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T22:10:13.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T22:10:13.583 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50'), ('mon.b', '172.21.15.77'), ('mon.c', '[v2:172.21.15.77:3301,v1:172.21.15.77:6790]')] 2024-09-11T22:10:13.583 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-11T22:10:13.584 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:13.584 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T22:10:13.640 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --add b 172.21.15.77 --addv c '[v2:172.21.15.77:3301,v1:172.21.15.77:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:13.727 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:13.727 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid a6d32825-9a2d-4e99-ad9a-1aac010fe65a 2024-09-11T22:10:13.727 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = quincy 2024-09-11T22:10:13.727 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2024-09-11T22:10:13.727 INFO:teuthology.orchestra.run.smithi050.stdout:fsid a6d32825-9a2d-4e99-ad9a-1aac010fe65a 2024-09-11T22:10:13.727 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2024-09-11T22:10:13.727733+0000 2024-09-11T22:10:13.728 INFO:teuthology.orchestra.run.smithi050.stdout:created 2024-09-11T22:10:13.727733+0000 2024-09-11T22:10:13.728 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 17 (quincy) 2024-09-11T22:10:13.728 INFO:teuthology.orchestra.run.smithi050.stdout:election_strategy: 1 2024-09-11T22:10:13.728 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-11T22:10:13.728 INFO:teuthology.orchestra.run.smithi050.stdout:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-11T22:10:13.728 INFO:teuthology.orchestra.run.smithi050.stdout:2: [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] mon.c 2024-09-11T22:10:13.728 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-11T22:10:13.729 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T22:10:13.744 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a6d32825-9a2d-4e99-ad9a-1aac010fe65a... 2024-09-11T22:10:13.745 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T22:10:13.787 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T22:10:13.829 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-09-11T22:10:13.829 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-09-11T22:10:13.829 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T22:10:13.829 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-09-11T22:10:13.829 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.829 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-09-11T22:10:13.829 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.829 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-09-11T22:10:13.829 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-09-11T22:10:13.830 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.831 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-09-11T22:10:13.831 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-09-11T22:10:13.831 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-09-11T22:10:13.831 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-09-11T22:10:13.831 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-09-11T22:10:13.831 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-09-11T22:10:13.831 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-09-11T22:10:13.831 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T22:10:13.831 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T22:10:13.831 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-09-11T22:10:13.831 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.831 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T22:10:13.831 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.832 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-09-11T22:10:13.832 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.832 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-09-11T22:10:13.832 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.832 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-09-11T22:10:13.832 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-09-11T22:10:13.832 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-09-11T22:10:13.832 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-11T22:10:13.832 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on skipped message = False 2024-09-11T22:10:13.832 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = a6d32825-9a2d-4e99-ad9a-1aac010fe65a 2024-09-11T22:10:13.832 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.832 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug trim objects = true 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.833 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: bdev async discard = True 2024-09-11T22:10:13.834 INFO:teuthology.orchestra.run.smithi050.stdout: bdev enable discard = True 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore allocator = bitmap 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 1/20 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 1/20 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 4/10 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-09-11T22:10:13.835 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:10:13.836 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-11T22:10:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-09-11T22:10:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-11T22:10:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-09-11T22:10:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-09-11T22:10:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:10:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-09-11T22:10:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-09-11T22:10:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:10:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T22:10:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T22:10:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T22:10:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.838 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T22:10:13.838 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T22:10:13.838 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T22:10:13.838 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.838 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-09-11T22:10:13.838 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-09-11T22:10:13.838 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.838 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-09-11T22:10:13.838 INFO:teuthology.orchestra.run.smithi050.stdout: mon down mkfs grace = 300 2024-09-11T22:10:13.838 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2024-09-11T22:10:13.838 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on pool no app = False 2024-09-11T22:10:13.838 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:13.838 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-09-11T22:10:13.839 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-09-11T22:10:13.839 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2024-09-11T22:10:13.839 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-09-11T22:10:13.839 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T22:10:13.839 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T22:10:13.839 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2024-09-11T22:10:13.839 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-09-11T22:10:13.839 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:10:13.839 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = "" 2024-09-11T22:10:13.839 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-09-11T22:10:13.839 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-09-11T22:10:13.839 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-09-11T22:10:13.840 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2024-09-11T22:10:13.840 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2024-09-11T22:10:13.840 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-09-11T22:10:13.840 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2024-09-11T22:10:13.840 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-09-11T22:10:13.840 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2024-09-11T22:10:13.840 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2024-09-11T22:10:13.840 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2024-09-11T22:10:13.840 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds balancer = 20 2024-09-11T22:10:13.840 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:10:13.840 INFO:teuthology.orchestra.run.smithi050.stdout: mds cache max size = 1000 2024-09-11T22:10:13.840 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2024-09-11T22:10:13.840 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2024-09-11T22:10:13.841 INFO:teuthology.orchestra.run.smithi050.stdout: mds log max segments = 1 2024-09-11T22:10:13.841 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2024-09-11T22:10:13.841 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2024-09-11T22:10:13.841 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-09-11T22:10:13.841 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-09-11T22:10:13.841 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-09-11T22:10:13.841 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-09-11T22:10:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-09-11T22:10:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T22:10:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-09-11T22:10:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-09-11T22:10:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-09-11T22:10:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-09-11T22:10:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-09-11T22:10:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-09-11T22:10:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-09-11T22:10:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T22:10:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-09-11T22:10:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T22:10:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T22:10:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-09-11T22:10:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-09-11T22:10:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-09-11T22:10:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-09-11T22:10:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-09-11T22:10:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-09-11T22:10:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-09-11T22:10:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-09-11T22:10:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T22:10:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T22:10:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-09-11T22:10:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T22:10:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-09-11T22:10:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.50,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on skipped message = False 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = a6d32825-9a2d-4e99-ad9a-1aac010fe65a 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-09-11T22:10:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-09-11T22:10:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-09-11T22:10:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-09-11T22:10:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-09-11T22:10:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-09-11T22:10:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-09-11T22:10:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-09-11T22:10:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: bdev async discard = True 2024-09-11T22:10:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: bdev enable discard = True 2024-09-11T22:10:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore allocator = bitmap 2024-09-11T22:10:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 1/20 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 1/20 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 4/10 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.848 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-09-11T22:10:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T22:10:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: mon down mkfs grace = 300 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: mon op complaint time = 120 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on pool no app = False 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T22:10:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T22:10:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 600 2024-09-11T22:10:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-09-11T22:10:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:10:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2024-09-11T22:10:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-09-11T22:10:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-09-11T22:10:13.852 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-09-11T22:10:13.852 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-09-11T22:10:13.852 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-09-11T22:10:13.852 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-09-11T22:10:13.852 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-09-11T22:10:13.852 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-09-11T22:10:13.852 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-09-11T22:10:13.853 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2024-09-11T22:10:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds = 20 2024-09-11T22:10:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds balancer = 20 2024-09-11T22:10:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:10:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: mds cache max size = 1000 2024-09-11T22:10:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug frag = True 2024-09-11T22:10:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = True 2024-09-11T22:10:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: mds log max segments = 1 2024-09-11T22:10:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: mds op complaint time = 180 2024-09-11T22:10:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = True 2024-09-11T22:10:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-09-11T22:10:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-09-11T22:10:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-09-11T22:10:13.855 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T22:10:13.855 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T22:10:13.949 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T22:10:13.950 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:13.950 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T22:10:13.965 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:13.965 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T22:10:14.021 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:10:14.021 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:14.021 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T22:10:14.021 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T22:10:14.097 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:14.097 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:14.153 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi077.front.sepia.ceph.com 2024-09-11T22:10:14.153 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:14.153 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T22:10:14.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T22:10:14.189 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:14.189 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:14.245 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T22:10:14.245 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T22:10:14.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T22:10:14.298 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T22:10:14.300 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T22:10:14.373 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T22:10:14.375 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T22:10:14.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T22:10:14.428 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T22:10:14.430 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-11T22:10:14.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T22:10:14.548 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T22:10:14.551 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-11T22:10:14.576 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T22:10:14.627 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T22:10:14.630 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-11T22:10:14.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T22:10:14.745 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T22:10:14.747 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-11T22:10:14.771 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T22:10:14.772 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T22:10:14.814 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T22:10:14.827 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-11T22:10:14.909 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-11T22:10:14.923 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T22:10:14.964 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T22:10:14.977 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-11T22:10:15.057 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-11T22:10:15.070 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T22:10:15.070 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T22:10:15.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T22:10:15.097 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T22:10:15.097 INFO:tasks.ceph:role: osd.0 2024-09-11T22:10:15.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:10:15.097 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T22:10:15.162 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:10:15.162 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:10:15.163 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:10:15.163 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:10:15.163 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:10:15.163 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:10:15.163 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:10:15.163 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:10:15.163 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:10:15.163 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:10:15.195 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-11T22:10:15.197 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-11T22:10:15.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T22:10:15.267 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T22:10:15.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T22:10:15.406 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T22:10:15.406 INFO:tasks.ceph:role: osd.1 2024-09-11T22:10:15.406 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:10:15.406 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T22:10:15.471 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:10:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:10:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:10:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:10:15.472 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:10:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:10:15.472 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:10:15.472 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:10:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:10:15.472 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:10:15.504 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-11T22:10:15.505 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-11T22:10:15.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T22:10:15.575 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T22:10:15.647 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T22:10:15.713 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T22:10:15.713 INFO:tasks.ceph:role: osd.2 2024-09-11T22:10:15.713 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:10:15.713 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T22:10:15.778 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:10:15.778 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:10:15.778 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:10:15.778 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:10:15.778 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:10:15.778 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:10:15.779 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:10:15.779 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:10:15.779 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:10:15.779 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:10:15.810 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-11T22:10:15.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-11T22:10:15.812 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T22:10:15.882 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T22:10:15.955 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T22:10:16.021 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T22:10:16.021 INFO:tasks.ceph:role: osd.3 2024-09-11T22:10:16.021 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:10:16.021 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T22:10:16.086 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:10:16.086 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:10:16.086 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:10:16.086 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:10:16.086 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:10:16.087 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:10:16.087 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:10:16.087 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:10:16.087 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:10:16.087 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:10:16.120 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-11T22:10:16.122 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-11T22:10:16.122 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-11T22:10:16.191 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T22:10:16.260 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:16.352+0000 7fc21edae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T22:10:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:16.352+0000 7fc21edae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T22:10:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:16.352+0000 7fc21edae640 -1 bdev(0x55e3e76c9800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T22:10:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:16.352+0000 7fc21edae640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T22:10:19.258 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T22:10:19.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:19.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:19.382+0000 7f023500f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T22:10:19.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:19.382+0000 7f023500f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T22:10:19.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:19.382+0000 7f023500f640 -1 bdev(0x5609b68b1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T22:10:19.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:19.382+0000 7f023500f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T22:10:22.823 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T22:10:22.853 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:22.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:22.945+0000 7feffce62640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T22:10:22.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:22.946+0000 7feffce62640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T22:10:22.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:22.946+0000 7feffce62640 -1 bdev(0x562efd5cd800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T22:10:22.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:22.946+0000 7feffce62640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T22:10:26.126 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T22:10:26.157 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:26.249+0000 7f38d7832640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-11T22:10:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:26.249+0000 7f38d7832640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-11T22:10:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:26.249+0000 7f38d7832640 -1 bdev(0x561af884d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-11T22:10:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:26.249+0000 7f38d7832640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-11T22:10:29.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T22:10:29.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-11T22:10:29.222 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T22:10:29.222 INFO:tasks.ceph:role: osd.4 2024-09-11T22:10:29.222 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-11T22:10:29.222 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T22:10:29.298 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:10:29.298 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:10:29.298 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:10:29.298 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:10:29.298 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:10:29.299 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:10:29.299 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:10:29.299 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:10:29.299 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:10:29.299 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:10:29.811 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-11T22:10:29.813 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-11T22:10:29.813 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-11T22:10:29.926 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-11T22:10:29.962 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-11T22:10:30.029 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T22:10:30.029 INFO:tasks.ceph:role: osd.5 2024-09-11T22:10:30.029 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-11T22:10:30.030 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T22:10:30.103 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:10:30.103 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:10:30.104 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:10:30.104 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:10:30.104 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:10:30.104 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:10:30.104 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:10:30.104 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:10:30.104 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:10:30.104 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:10:30.569 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-11T22:10:30.571 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-11T22:10:30.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-11T22:10:30.675 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-11T22:10:30.706 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-11T22:10:30.773 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T22:10:30.773 INFO:tasks.ceph:role: osd.6 2024-09-11T22:10:30.773 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-11T22:10:30.774 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T22:10:30.846 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:10:30.846 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:10:30.847 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:10:30.847 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:10:30.847 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:10:30.847 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:10:30.847 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:10:30.847 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:10:30.847 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:10:30.847 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:10:31.335 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-11T22:10:31.337 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-11T22:10:31.338 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-11T22:10:31.503 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-11T22:10:31.535 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-11T22:10:31.602 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T22:10:31.602 INFO:tasks.ceph:role: osd.7 2024-09-11T22:10:31.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-11T22:10:31.602 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T22:10:31.676 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:10:31.676 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:10:31.676 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:10:31.676 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:10:31.676 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:10:31.676 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:10:31.677 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:10:31.677 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:10:31.677 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:10:31.677 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:10:32.181 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-11T22:10:32.184 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-11T22:10:32.184 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-11T22:10:32.317 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-11T22:10:32.353 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:32.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:32.463+0000 7f9d2ca1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-11T22:10:32.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:32.463+0000 7f9d2ca1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-11T22:10:32.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:32.463+0000 7f9d2ca1e640 -1 bdev(0x565404ef9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-11T22:10:32.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:32.463+0000 7f9d2ca1e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-11T22:10:36.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T22:10:36.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:36.498+0000 7f6eb7c40640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-11T22:10:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:36.498+0000 7f6eb7c40640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-11T22:10:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:36.499+0000 7f6eb7c40640 -1 bdev(0x564ceab57800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-11T22:10:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:36.499+0000 7f6eb7c40640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-11T22:10:40.143 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T22:10:40.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:40.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:40.263+0000 7ff0eb525640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-11T22:10:40.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:40.263+0000 7ff0eb525640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-11T22:10:40.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:40.263+0000 7ff0eb525640 -1 bdev(0x565549447800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-11T22:10:40.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:40.263+0000 7ff0eb525640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-11T22:10:41.880 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:10:41.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:10:44.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-11T22:10:44.202 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:44.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:44.293+0000 7fa427811640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-11T22:10:44.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:44.293+0000 7fa427811640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-11T22:10:44.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:44.293+0000 7fa427811640 -1 bdev(0x5560f7623800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-11T22:10:44.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:44.294+0000 7fa427811640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-11T22:10:48.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-11T22:10:48.233 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T22:10:48.233 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:48.234 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-11T22:10:48.265 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:48.265 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-11T22:10:48.336 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:48.336 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-11T22:10:48.406 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:48.406 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T22:10:48.475 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:48.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T22:10:48.543 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:48.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T22:10:48.610 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:48.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T22:10:48.675 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:48.675 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T22:10:48.704 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:48.705 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-11T22:10:48.773 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:48.773 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-11T22:10:48.841 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:48.841 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-11T22:10:48.908 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:48.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-11T22:10:48.977 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:48.977 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-11T22:10:49.043 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:49.043 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-11T22:10:49.109 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:49.109 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T22:10:49.124 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:49.124 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-11T22:10:49.181 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:49.181 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T22:10:49.197 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:49.197 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-11T22:10:49.252 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T22:10:49.252 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T22:10:49.255 DEBUG:teuthology.orchestra.run.smithi077:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T22:10:49.295 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2024-09-11T22:10:49.295 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg== 2024-09-11T22:10:49.295 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-09-11T22:10:49.295 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w== 2024-09-11T22:10:49.296 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2024-09-11T22:10:49.296 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ== 2024-09-11T22:10:49.296 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2024-09-11T22:10:49.296 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg== 2024-09-11T22:10:49.296 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2024-09-11T22:10:49.296 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ== 2024-09-11T22:10:49.296 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2024-09-11T22:10:49.296 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg== 2024-09-11T22:10:49.296 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2024-09-11T22:10:49.296 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg== 2024-09-11T22:10:49.296 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2024-09-11T22:10:49.296 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g== 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg== 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw== 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A== 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw== 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A== 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw== 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:10:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:[client.2] 2024-09-11T22:10:49.298 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg== 2024-09-11T22:10:49.298 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2024-09-11T22:10:49.298 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw== 2024-09-11T22:10:49.298 INFO:teuthology.orchestra.run.smithi050.stdout:[client.3] 2024-09-11T22:10:49.298 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw== 2024-09-11T22:10:49.315 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.y] 2024-09-11T22:10:49.315 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg== 2024-09-11T22:10:49.315 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-09-11T22:10:49.315 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w== 2024-09-11T22:10:49.315 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-09-11T22:10:49.315 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ== 2024-09-11T22:10:49.315 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2024-09-11T22:10:49.315 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg== 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ== 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg== 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg== 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.x] 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g== 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg== 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw== 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.4] 2024-09-11T22:10:49.316 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A== 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.5] 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw== 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.6] 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A== 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.7] 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw== 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout:[client.2] 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg== 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout:[client.1] 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw== 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout:[client.3] 2024-09-11T22:10:49.317 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw== 2024-09-11T22:10:49.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T22:10:49.341 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T22:10:49.410 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:10:49.412 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:10:49.465 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:10:49.467 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:10:49.521 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:49.523 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:49.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:49.576 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:49.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:49.628 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:49.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:49.682 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:49.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T22:10:49.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T22:10:49.786 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:10:49.788 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:10:49.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:10:49.845 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:10:49.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:49.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:49.951 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:49.953 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:50.003 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:50.006 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:50.056 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:50.059 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:10:50.111 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T22:10:50.113 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T22:10:50.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T22:10:50.169 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T22:10:50.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T22:10:50.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T22:10:50.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T22:10:50.282 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T22:10:50.335 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T22:10:50.336 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T22:10:50.361 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T22:10:50.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T22:10:50.484 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-11T22:10:50.510 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T22:10:50.605 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-11T22:10:50.630 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-11T22:10:50.695 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T22:10:50.790 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-11T22:10:50.817 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:50.820 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:10:50.873 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T22:10:50.873 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:10:50.873 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:10:50.877 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:10:50.877 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T22:10:50.877 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T22:10:50.916 INFO:tasks.ceph.mon.b:Started 2024-09-11T22:10:50.916 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-11T22:10:50.916 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-11T22:10:50.918 INFO:tasks.ceph.mon.c:Started 2024-09-11T22:10:50.918 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T22:10:50.918 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-11T22:10:50.918 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-11T22:10:50.921 INFO:tasks.ceph.mgr.y:Started 2024-09-11T22:10:50.921 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T22:10:50.921 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T22:10:50.923 INFO:tasks.ceph.mgr.x:Started 2024-09-11T22:10:50.923 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T22:10:50.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T22:10:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.026+0000 7f20a3ed0640 1 Processor -- start 2024-09-11T22:10:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.027+0000 7f20a3ed0640 1 -- start start 2024-09-11T22:10:51.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.027+0000 7f20a3ed0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f209c0d18a0 0x7f209c0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.027+0000 7f20a3ed0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f209c0d3a30 0x7f209c0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.027+0000 7f20a3ed0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209c0cfa80 con 0x7f209c15e870 2024-09-11T22:10:51.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.027+0000 7f20a3ed0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f209c0d3ea0 con 0x7f209c0d3a30 2024-09-11T22:10:51.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.027+0000 7f20a3ed0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f209c0d40d0 con 0x7f209c0d18a0 2024-09-11T22:10:51.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.028+0000 7f20a246d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f209c0d3a30 0x7f209c0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.028+0000 7f20a246d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f209c0d3a30 0x7f209c0b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42682/0 (socket says 172.21.15.50:42682) 2024-09-11T22:10:51.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.028+0000 7f20a246d640 1 -- 172.21.15.50:0/507532517 learned_addr learned my addr 172.21.15.50:0/507532517 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:10:51.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.028+0000 7f20a146b640 1 --2- 172.21.15.50:0/507532517 >> v2:172.21.15.77:3300/0 conn(0x7f209c0d18a0 0x7f209c0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.028+0000 7f20a246d640 1 -- 172.21.15.50:0/507532517 >> v2:172.21.15.50:3300/0 conn(0x7f209c0d3a30 msgr2=0x7f209c0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:10:51.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.028+0000 7f20a246d640 1 -- 172.21.15.50:0/507532517 >> v2:172.21.15.50:3300/0 conn(0x7f209c0d3a30 msgr2=0x7f209c0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:10:51.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.028+0000 7f20a246d640 1 --2- 172.21.15.50:0/507532517 >> v2:172.21.15.50:3300/0 conn(0x7f209c0d3a30 0x7f209c0b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:10:51.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.028+0000 7f20a246d640 1 --2- 172.21.15.50:0/507532517 >> v2:172.21.15.50:3300/0 conn(0x7f209c0d3a30 0x7f209c0b8400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:10:51.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.028+0000 7f20a146b640 1 -- 172.21.15.50:0/507532517 >> v2:172.21.15.77:3300/0 conn(0x7f209c0d18a0 msgr2=0x7f209c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:10:51.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.028+0000 7f20a146b640 1 -- 172.21.15.50:0/507532517 >> v2:172.21.15.77:3300/0 conn(0x7f209c0d18a0 msgr2=0x7f209c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:10:51.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.028+0000 7f20a146b640 1 --2- 172.21.15.50:0/507532517 >> v2:172.21.15.77:3300/0 conn(0x7f209c0d18a0 0x7f209c0d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:10:51.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.028+0000 7f20a146b640 1 --2- 172.21.15.50:0/507532517 >> v2:172.21.15.77:3300/0 conn(0x7f209c0d18a0 0x7f209c0d34f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:10:51.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.184+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992299929 0 0) 0x7f2098001490 con 0x7f209c15e870 2024-09-11T22:10:51.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.184+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2088003520 con 0x7f209c15e870 2024-09-11T22:10:51.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 <== mon.1 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3816343853 0 0) 0x7f2088003520 con 0x7f209c15e870 2024-09-11T22:10:51.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 >> v2:172.21.15.77:3300/0 conn(0x7f209c0d18a0 msgr2=0x7f209c0d34f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:10:51.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 --2- 172.21.15.50:0/507532517 >> v2:172.21.15.77:3300/0 conn(0x7f209c0d18a0 0x7f209c0d34f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 >> v2:172.21.15.50:3300/0 conn(0x7f209c0d3a30 msgr2=0x7f209c0b8400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:10:51.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 --2- 172.21.15.50:0/507532517 >> v2:172.21.15.50:3300/0 conn(0x7f209c0d3a30 0x7f209c0b8400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c0d43b0 con 0x7f209c15e870 2024-09-11T22:10:51.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 <== mon.1 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f2098001bc0 con 0x7f209c15e870 2024-09-11T22:10:51.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 >> v1:172.21.15.77:6789/0 conn(0x7f209c15e870 legacy=0x7f209c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 --2- 172.21.15.50:0/507532517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880039b0 0x7f2088003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 --2- 172.21.15.50:0/507532517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2088004800 0x7f2088004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 --2- 172.21.15.50:0/507532517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20880051c0 0x7f208800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f209c0d40d0 con 0x7f2088004800 2024-09-11T22:10:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f208800c040 con 0x7f20880039b0 2024-09-11T22:10:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f208800c240 con 0x7f20880051c0 2024-09-11T22:10:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a146b640 1 --2- 172.21.15.50:0/507532517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2088004800 0x7f2088004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a1c6c640 1 --2- 172.21.15.50:0/507532517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880039b0 0x7f2088003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a246d640 1 --2- 172.21.15.50:0/507532517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20880051c0 0x7f208800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a146b640 1 -- 172.21.15.50:0/507532517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20880051c0 msgr2=0x7f208800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a146b640 1 --2- 172.21.15.50:0/507532517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20880051c0 0x7f208800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a146b640 1 -- 172.21.15.50:0/507532517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880039b0 msgr2=0x7f2088003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a146b640 1 --2- 172.21.15.50:0/507532517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880039b0 0x7f2088003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a146b640 1 -- 172.21.15.50:0/507532517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2088003520 con 0x7f2088004800 2024-09-11T22:10:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.186+0000 7f20a246d640 1 -- 172.21.15.50:0/507532517 reap_dead start 2024-09-11T22:10:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.187+0000 7f20a146b640 1 --2- 172.21.15.50:0/507532517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2088004800 0x7f2088004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f208c00b9e0 tx=0x7f2088005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582887eab945ebf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.187+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c030070 con 0x7f2088004800 2024-09-11T22:10:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.187+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c02ada0 con 0x7f2088004800 2024-09-11T22:10:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.187+0000 7f20a0c6a640 1 -- 172.21.15.50:0/507532517 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c00b5e0 con 0x7f2088004800 2024-09-11T22:10:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.188+0000 7f20a3ed0640 1 -- 172.21.15.50:0/507532517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2088004800 msgr2=0x7f2088004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.188+0000 7f20a3ed0640 1 --2- 172.21.15.50:0/507532517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2088004800 0x7f2088004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f208c00b9e0 tx=0x7f2088005830 comp rx=0 tx=0).stop 2024-09-11T22:10:51.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.188+0000 7f20a3ed0640 1 -- 172.21.15.50:0/507532517 shutdown_connections 2024-09-11T22:10:51.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.188+0000 7f20a3ed0640 1 --2- 172.21.15.50:0/507532517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2088004800 0x7f2088004c80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.188+0000 7f20a3ed0640 1 -- 172.21.15.50:0/507532517 >> 172.21.15.50:0/507532517 conn(0x7f209c0727a0 msgr2=0x7f209c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:51.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.188+0000 7f20a3ed0640 1 -- 172.21.15.50:0/507532517 shutdown_connections 2024-09-11T22:10:51.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.188+0000 7f20a3ed0640 1 -- 172.21.15.50:0/507532517 wait complete. 2024-09-11T22:10:51.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.189+0000 7f20a3ed0640 1 Processor -- start 2024-09-11T22:10:51.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.189+0000 7f20a3ed0640 1 -- start start 2024-09-11T22:10:51.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.190+0000 7f20a3ed0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2088004800 0x7f209c158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.190+0000 7f20a3ed0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f209c15d640 0x7f209c155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.190+0000 7f20a3ed0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f209c0b9a20 0x7f209c0b9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.190+0000 7f20a3ed0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f209c15ec50 con 0x7f209c15d640 2024-09-11T22:10:51.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.190+0000 7f20a3ed0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f209c0b7ee0 con 0x7f2088004800 2024-09-11T22:10:51.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.190+0000 7f20a3ed0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f209c0b78b0 con 0x7f209c0b9a20 2024-09-11T22:10:51.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.190+0000 7f20a146b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f209c15d640 0x7f209c155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.190+0000 7f20a1c6c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2088004800 0x7f209c158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.190+0000 7f20a146b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f209c15d640 0x7f209c155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42700/0 (socket says 172.21.15.50:42700) 2024-09-11T22:10:51.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.190+0000 7f20a1c6c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2088004800 0x7f209c158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:44070/0 (socket says 172.21.15.50:44070) 2024-09-11T22:10:51.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.190+0000 7f20a146b640 1 -- 172.21.15.50:0/3170089505 learned_addr learned my addr 172.21.15.50:0/3170089505 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:10:51.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.190+0000 7f20a246d640 1 --2- 172.21.15.50:0/3170089505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f209c0b9a20 0x7f209c0b9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20a246d640 1 -- 172.21.15.50:0/3170089505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2088004800 msgr2=0x7f209c158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20a246d640 1 --2- 172.21.15.50:0/3170089505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2088004800 0x7f209c158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20a246d640 1 -- 172.21.15.50:0/3170089505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f209c15d640 msgr2=0x7f209c155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20a246d640 1 --2- 172.21.15.50:0/3170089505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f209c15d640 0x7f209c155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20a246d640 1 -- 172.21.15.50:0/3170089505 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c15ddb0 con 0x7f209c0b9a20 2024-09-11T22:10:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20a146b640 1 --2- 172.21.15.50:0/3170089505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f209c15d640 0x7f209c155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20a1c6c640 1 --2- 172.21.15.50:0/3170089505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2088004800 0x7f209c158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20a246d640 1 --2- 172.21.15.50:0/3170089505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f209c0b9a20 0x7f209c0b9ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f209c0d5790 tx=0x7f2094011920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20927fc640 1 -- 172.21.15.50:0/3170089505 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209400f040 con 0x7f209c0b9a20 2024-09-11T22:10:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20927fc640 1 -- 172.21.15.50:0/3170089505 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2094004020 con 0x7f209c0b9a20 2024-09-11T22:10:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20a3ed0640 1 -- 172.21.15.50:0/3170089505 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c1597e0 con 0x7f209c0b9a20 2024-09-11T22:10:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20927fc640 1 -- 172.21.15.50:0/3170089505 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2094004410 con 0x7f209c0b9a20 2024-09-11T22:10:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20a3ed0640 1 -- 172.21.15.50:0/3170089505 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c159da0 con 0x7f209c0b9a20 2024-09-11T22:10:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20927fc640 1 -- 172.21.15.50:0/3170089505 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f209401e030 con 0x7f209c0b9a20 2024-09-11T22:10:51.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.191+0000 7f20927fc640 1 -- 172.21.15.50:0/3170089505 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2094020750 con 0x7f209c0b9a20 2024-09-11T22:10:51.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.192+0000 7f20a3ed0640 1 -- 172.21.15.50:0/3170089505 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c0b7040 con 0x7f209c0b9a20 2024-09-11T22:10:51.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.194+0000 7f20927fc640 1 -- 172.21.15.50:0/3170089505 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2094025020 con 0x7f209c0b9a20 2024-09-11T22:10:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.259+0000 7f20a3ed0640 1 -- 172.21.15.50:0/3170089505 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f209c15c890 con 0x7f209c0b9a20 2024-09-11T22:10:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.265+0000 7f20927fc640 1 -- 172.21.15.50:0/3170089505 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f2094003ca0 con 0x7f209c0b9a20 2024-09-11T22:10:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2024-09-11T22:10:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.266+0000 7f20a3ed0640 1 -- 172.21.15.50:0/3170089505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f209c0b9a20 msgr2=0x7f209c0b9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.266+0000 7f20a3ed0640 1 --2- 172.21.15.50:0/3170089505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f209c0b9a20 0x7f209c0b9ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f209c0d5790 tx=0x7f2094011920 comp rx=0 tx=0).stop 2024-09-11T22:10:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.266+0000 7f20a3ed0640 1 -- 172.21.15.50:0/3170089505 shutdown_connections 2024-09-11T22:10:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.266+0000 7f20a3ed0640 1 --2- 172.21.15.50:0/3170089505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f209c0b9a20 0x7f209c0b9ed0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.266+0000 7f20a3ed0640 1 --2- 172.21.15.50:0/3170089505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f209c15d640 0x7f209c155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.266+0000 7f20a3ed0640 1 --2- 172.21.15.50:0/3170089505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2088004800 0x7f209c158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.266+0000 7f20a3ed0640 1 -- 172.21.15.50:0/3170089505 >> 172.21.15.50:0/3170089505 conn(0x7f209c0727a0 msgr2=0x7f209c15c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.266+0000 7f20a3ed0640 1 -- 172.21.15.50:0/3170089505 shutdown_connections 2024-09-11T22:10:51.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:51.266+0000 7f20a3ed0640 1 -- 172.21.15.50:0/3170089505 wait complete. 2024-09-11T22:10:51.277 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T22:10:51.277 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T22:10:51.278 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:51.278 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T22:10:51.290 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:51.288+0000 7f08e8a13040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:10:51.304 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:51.304 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T22:10:51.305 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:51.304+0000 7f2bf9673040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:10:51.329 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:51.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T22:10:51.330 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:51.328+0000 7f08e8a13040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:10:51.348 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:51.348+0000 7f2bf9673040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:10:51.374 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:10:51.374 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T22:10:51.440 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:51.440 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-11T22:10:51.465 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:51.465 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-11T22:10:51.466 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:51.465+0000 7f08e8a13040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:10:51.490 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:51.490 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-11T22:10:51.498 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:51.498+0000 7f2bf9673040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:10:51.519 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:51.518+0000 7f08e8a13040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:10:51.543 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:10:51.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-11T22:10:51.551 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:51.551+0000 7f2bf9673040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:10:51.608 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new fc71803a-7700-4360-a3cb-8faf8b68d7af 0 2024-09-11T22:10:51.724 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:51.722+0000 7f08e8a13040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:10:51.729 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:51.728+0000 7f2bf9673040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:10:51.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.745+0000 7f515cce6640 1 Processor -- start 2024-09-11T22:10:51.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.745+0000 7f515cce6640 1 -- start start 2024-09-11T22:10:51.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.746+0000 7f515cce6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f515815b1e0 0x7f515815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.746+0000 7f515cce6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f51580d0460 0x7f515815ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.746+0000 7f515cce6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51580d0cb0 con 0x7f515815f4a0 2024-09-11T22:10:51.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.746+0000 7f515cce6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f51580d0f90 con 0x7f51580d0460 2024-09-11T22:10:51.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.746+0000 7f515cce6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f51580d1270 con 0x7f515815b1e0 2024-09-11T22:10:51.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.746+0000 7f515659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f515815b1e0 0x7f515815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.746+0000 7f515659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f515815b1e0 0x7f515815b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38132/0 (socket says 172.21.15.77:38132) 2024-09-11T22:10:51.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.746+0000 7f515659c640 1 -- 172.21.15.77:0/2147322502 learned_addr learned my addr 172.21.15.77:0/2147322502 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:51.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.746+0000 7f5155d9b640 1 --2- 172.21.15.77:0/2147322502 >> v2:172.21.15.50:3300/0 conn(0x7f51580d0460 0x7f515815ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.747+0000 7f515659c640 1 -- 172.21.15.77:0/2147322502 >> v2:172.21.15.50:3300/0 conn(0x7f51580d0460 msgr2=0x7f515815ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:51.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.747+0000 7f515659c640 1 --2- 172.21.15.77:0/2147322502 >> v2:172.21.15.50:3300/0 conn(0x7f51580d0460 0x7f515815ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.747+0000 7f515659c640 1 -- 172.21.15.77:0/2147322502 >> v1:172.21.15.50:6789/0 conn(0x7f515815f4a0 legacy=0x7f51580ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.747+0000 7f515659c640 1 -- 172.21.15.77:0/2147322502 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515806e200 con 0x7f515815b1e0 2024-09-11T22:10:51.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.747+0000 7f515659c640 1 --2- 172.21.15.77:0/2147322502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f515815b1e0 0x7f515815b5c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f515806c4a0 tx=0x7f514c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d737f7c759fc236b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:51.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.747+0000 7f515559a640 1 -- 172.21.15.77:0/2147322502 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c037070 con 0x7f515815b1e0 2024-09-11T22:10:51.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.747+0000 7f515559a640 1 -- 172.21.15.77:0/2147322502 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514c032440 con 0x7f515815b1e0 2024-09-11T22:10:51.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.747+0000 7f515559a640 1 -- 172.21.15.77:0/2147322502 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c032810 con 0x7f515815b1e0 2024-09-11T22:10:51.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.748+0000 7f515cce6640 1 -- 172.21.15.77:0/2147322502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f515815b1e0 msgr2=0x7f515815b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.748+0000 7f515cce6640 1 --2- 172.21.15.77:0/2147322502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f515815b1e0 0x7f515815b5c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f515806c4a0 tx=0x7f514c02a270 comp rx=0 tx=0).stop 2024-09-11T22:10:51.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.748+0000 7f515cce6640 1 -- 172.21.15.77:0/2147322502 shutdown_connections 2024-09-11T22:10:51.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.748+0000 7f515cce6640 1 --2- 172.21.15.77:0/2147322502 >> v2:172.21.15.50:3300/0 conn(0x7f51580d0460 0x7f515815ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.748+0000 7f515cce6640 1 --2- 172.21.15.77:0/2147322502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f515815b1e0 0x7f515815b5c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.748+0000 7f515cce6640 1 -- 172.21.15.77:0/2147322502 >> 172.21.15.77:0/2147322502 conn(0x7f5158075030 msgr2=0x7f515806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:51.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.748+0000 7f515cce6640 1 -- 172.21.15.77:0/2147322502 shutdown_connections 2024-09-11T22:10:51.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.748+0000 7f515cce6640 1 -- 172.21.15.77:0/2147322502 wait complete. 2024-09-11T22:10:51.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.750+0000 7f515cce6640 1 Processor -- start 2024-09-11T22:10:51.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.751+0000 7f515cce6640 1 -- start start 2024-09-11T22:10:51.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515cce6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51580d0460 0x7f5158150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515cce6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f515815b1e0 0x7f515814b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515cce6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f515815f4a0 0x7f5158147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515cce6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f51580d08d0 con 0x7f515815b1e0 2024-09-11T22:10:51.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515cce6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f515806fa10 con 0x7f51580d0460 2024-09-11T22:10:51.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515cce6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f51580d0a50 con 0x7f515815f4a0 2024-09-11T22:10:51.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51580d0460 0x7f5158150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51580d0460 0x7f5158150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38140/0 (socket says 172.21.15.77:38140) 2024-09-11T22:10:51.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515659c640 1 -- 172.21.15.77:0/1834351049 learned_addr learned my addr 172.21.15.77:0/1834351049 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:51.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f5156d9d640 1 --2- 172.21.15.77:0/1834351049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f515815f4a0 0x7f5158147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f5155d9b640 1 --2- 172.21.15.77:0/1834351049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f515815b1e0 0x7f515814b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515659c640 1 -- 172.21.15.77:0/1834351049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f515815f4a0 msgr2=0x7f5158147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515659c640 1 --2- 172.21.15.77:0/1834351049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f515815f4a0 0x7f5158147970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515659c640 1 -- 172.21.15.77:0/1834351049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f515815b1e0 msgr2=0x7f515814b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515659c640 1 --2- 172.21.15.77:0/1834351049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f515815b1e0 0x7f515814b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515659c640 1 -- 172.21.15.77:0/1834351049 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5158147eb0 con 0x7f51580d0460 2024-09-11T22:10:51.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.752+0000 7f515659c640 1 --2- 172.21.15.77:0/1834351049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51580d0460 0x7f5158150900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f514c02a2b0 tx=0x7f514c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:51.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.753+0000 7f5146ffd640 1 -- 172.21.15.77:0/1834351049 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c037040 con 0x7f51580d0460 2024-09-11T22:10:51.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.753+0000 7f5146ffd640 1 -- 172.21.15.77:0/1834351049 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514c042070 con 0x7f51580d0460 2024-09-11T22:10:51.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.753+0000 7f515cce6640 1 -- 172.21.15.77:0/1834351049 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515814bda0 con 0x7f51580d0460 2024-09-11T22:10:51.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.753+0000 7f5146ffd640 1 -- 172.21.15.77:0/1834351049 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c030880 con 0x7f51580d0460 2024-09-11T22:10:51.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.753+0000 7f515cce6640 1 -- 172.21.15.77:0/1834351049 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f515814c360 con 0x7f51580d0460 2024-09-11T22:10:51.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.753+0000 7f5146ffd640 1 -- 172.21.15.77:0/1834351049 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f514c030a20 con 0x7f51580d0460 2024-09-11T22:10:51.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.753+0000 7f5146ffd640 1 -- 172.21.15.77:0/1834351049 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f514c047bd0 con 0x7f51580d0460 2024-09-11T22:10:51.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.754+0000 7f515cce6640 1 -- 172.21.15.77:0/1834351049 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f515815ef60 con 0x7f51580d0460 2024-09-11T22:10:51.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.756+0000 7f5146ffd640 1 -- 172.21.15.77:0/1834351049 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f514c047e20 con 0x7f51580d0460 2024-09-11T22:10:51.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.823+0000 7f515cce6640 1 -- 172.21.15.77:0/1834351049 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fc71803a-7700-4360-a3cb-8faf8b68d7af", "id": 0} v 0) -- 0x7f5158072250 con 0x7f51580d0460 2024-09-11T22:10:51.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.829+0000 7f5146ffd640 1 -- 172.21.15.77:0/1834351049 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc71803a-7700-4360-a3cb-8faf8b68d7af", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f514c047460 con 0x7f51580d0460 2024-09-11T22:10:51.830 INFO:teuthology.orchestra.run.smithi077.stdout:0 2024-09-11T22:10:51.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.830+0000 7f515cce6640 1 -- 172.21.15.77:0/1834351049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51580d0460 msgr2=0x7f5158150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.830+0000 7f515cce6640 1 --2- 172.21.15.77:0/1834351049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51580d0460 0x7f5158150900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f514c02a2b0 tx=0x7f514c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.830+0000 7f515cce6640 1 -- 172.21.15.77:0/1834351049 shutdown_connections 2024-09-11T22:10:51.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.830+0000 7f515cce6640 1 --2- 172.21.15.77:0/1834351049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f515815f4a0 0x7f5158147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.830+0000 7f515cce6640 1 --2- 172.21.15.77:0/1834351049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f515815b1e0 0x7f515814b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.830+0000 7f515cce6640 1 --2- 172.21.15.77:0/1834351049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51580d0460 0x7f5158150900 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.830+0000 7f515cce6640 1 -- 172.21.15.77:0/1834351049 >> 172.21.15.77:0/1834351049 conn(0x7f5158075030 msgr2=0x7f51580cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:51.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.830+0000 7f515cce6640 1 -- 172.21.15.77:0/1834351049 shutdown_connections 2024-09-11T22:10:51.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.830+0000 7f515cce6640 1 -- 172.21.15.77:0/1834351049 wait complete. 2024-09-11T22:10:51.839 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:51.838+0000 7f08e8a13040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:10:51.841 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 2b7bd0a5-e817-4719-8b2f-60c73a078699 1 2024-09-11T22:10:51.845 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:51.845+0000 7f2bf9673040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:10:51.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.938+0000 7f1f8c853640 1 Processor -- start 2024-09-11T22:10:51.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.938+0000 7f1f8c853640 1 -- start start 2024-09-11T22:10:51.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f8c853640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 0x7f1f88072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f8c853640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1f8806ef00 0x7f1f880b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f8c853640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f8815dae0 con 0x7f1f880cec80 2024-09-11T22:10:51.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f8c853640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1f880b3c60 con 0x7f1f8806ef00 2024-09-11T22:10:51.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f8c853640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1f88072e10 con 0x7f1f880b3340 2024-09-11T22:10:51.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f8659c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 0x7f1f88072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f8659c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 0x7f1f88072830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:37354/0 (socket says 172.21.15.77:37354) 2024-09-11T22:10:51.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f8659c640 1 -- 172.21.15.77:0/3667112830 learned_addr learned my addr 172.21.15.77:0/3667112830 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:51.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f7ffff640 1 --2- 172.21.15.77:0/3667112830 >> v2:172.21.15.50:3300/0 conn(0x7f1f8806ef00 0x7f1f880b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f8659c640 1 -- 172.21.15.77:0/3667112830 >> v2:172.21.15.50:3300/0 conn(0x7f1f8806ef00 msgr2=0x7f1f880b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:51.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f8659c640 1 --2- 172.21.15.77:0/3667112830 >> v2:172.21.15.50:3300/0 conn(0x7f1f8806ef00 0x7f1f880b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f8659c640 1 -- 172.21.15.77:0/3667112830 >> v1:172.21.15.50:6789/0 conn(0x7f1f880cec80 legacy=0x7f1f880679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f8659c640 1 -- 172.21.15.77:0/3667112830 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8806e140 con 0x7f1f880b3340 2024-09-11T22:10:51.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.939+0000 7f1f7ffff640 1 --2- 172.21.15.77:0/3667112830 >> v2:172.21.15.50:3300/0 conn(0x7f1f8806ef00 0x7f1f880b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:10:51.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.940+0000 7f1f8659c640 1 --2- 172.21.15.77:0/3667112830 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 0x7f1f88072830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009870 tx=0x7f1f7802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bedffc7bcaf540e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:51.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.940+0000 7f1f85d9b640 1 -- 172.21.15.77:0/3667112830 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f78037070 con 0x7f1f880b3340 2024-09-11T22:10:51.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.940+0000 7f1f85d9b640 1 -- 172.21.15.77:0/3667112830 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f78032440 con 0x7f1f880b3340 2024-09-11T22:10:51.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.940+0000 7f1f85d9b640 1 -- 172.21.15.77:0/3667112830 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f78032810 con 0x7f1f880b3340 2024-09-11T22:10:51.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.941+0000 7f1f8c853640 1 -- 172.21.15.77:0/3667112830 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 msgr2=0x7f1f88072830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.941+0000 7f1f8c853640 1 --2- 172.21.15.77:0/3667112830 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 0x7f1f88072830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009870 tx=0x7f1f7802a270 comp rx=0 tx=0).stop 2024-09-11T22:10:51.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.941+0000 7f1f8c853640 1 -- 172.21.15.77:0/3667112830 shutdown_connections 2024-09-11T22:10:51.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.941+0000 7f1f8c853640 1 --2- 172.21.15.77:0/3667112830 >> v2:172.21.15.50:3300/0 conn(0x7f1f8806ef00 0x7f1f880b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.941+0000 7f1f8c853640 1 --2- 172.21.15.77:0/3667112830 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 0x7f1f88072830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.941+0000 7f1f8c853640 1 -- 172.21.15.77:0/3667112830 >> 172.21.15.77:0/3667112830 conn(0x7f1f88074c40 msgr2=0x7f1f88075020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:51.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.941+0000 7f1f8c853640 1 -- 172.21.15.77:0/3667112830 shutdown_connections 2024-09-11T22:10:51.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.941+0000 7f1f8c853640 1 -- 172.21.15.77:0/3667112830 wait complete. 2024-09-11T22:10:51.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.942+0000 7f1f8c853640 1 Processor -- start 2024-09-11T22:10:51.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.942+0000 7f1f8c853640 1 -- start start 2024-09-11T22:10:51.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8c853640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ef00 0x7f1f8815c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8c853640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 0x7f1f880b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8c853640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f880cec80 0x7f1f880b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:51.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8c853640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8806e9e0 con 0x7f1f880cec80 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8c853640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8806e700 con 0x7f1f8806ef00 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8c853640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1f881462c0 con 0x7f1f880b3340 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ef00 0x7f1f8815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f7ffff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 0x7f1f880b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ef00 0x7f1f8815c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38148/0 (socket says 172.21.15.77:38148) 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f7ffff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 0x7f1f880b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:37366/0 (socket says 172.21.15.77:37366) 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8659c640 1 -- 172.21.15.77:0/3039266661 learned_addr learned my addr 172.21.15.77:0/3039266661 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f86d9d640 1 --2- 172.21.15.77:0/3039266661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f880cec80 0x7f1f880b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8659c640 1 -- 172.21.15.77:0/3039266661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 msgr2=0x7f1f880b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8659c640 1 --2- 172.21.15.77:0/3039266661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 0x7f1f880b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8659c640 1 -- 172.21.15.77:0/3039266661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f880cec80 msgr2=0x7f1f880b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8659c640 1 --2- 172.21.15.77:0/3039266661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f880cec80 0x7f1f880b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8659c640 1 -- 172.21.15.77:0/3039266661 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8815c5c0 con 0x7f1f8806ef00 2024-09-11T22:10:51.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f7ffff640 1 --2- 172.21.15.77:0/3039266661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 0x7f1f880b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:51.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.943+0000 7f1f8659c640 1 --2- 172.21.15.77:0/3039266661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ef00 0x7f1f8815c080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1f78000c00 tx=0x7f1f780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:51.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.944+0000 7f1f7effd640 1 -- 172.21.15.77:0/3039266661 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f78041020 con 0x7f1f8806ef00 2024-09-11T22:10:51.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.944+0000 7f1f7effd640 1 -- 172.21.15.77:0/3039266661 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f780306c0 con 0x7f1f8806ef00 2024-09-11T22:10:51.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.944+0000 7f1f7effd640 1 -- 172.21.15.77:0/3039266661 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f78037040 con 0x7f1f8806ef00 2024-09-11T22:10:51.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.944+0000 7f1f8c853640 1 -- 172.21.15.77:0/3039266661 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f881f5410 con 0x7f1f8806ef00 2024-09-11T22:10:51.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.944+0000 7f1f8c853640 1 -- 172.21.15.77:0/3039266661 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f881f59d0 con 0x7f1f8806ef00 2024-09-11T22:10:51.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.944+0000 7f1f7effd640 1 -- 172.21.15.77:0/3039266661 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f78044020 con 0x7f1f8806ef00 2024-09-11T22:10:51.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.944+0000 7f1f7effd640 1 -- 172.21.15.77:0/3039266661 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f1f7803dd60 con 0x7f1f8806ef00 2024-09-11T22:10:51.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.945+0000 7f1f8c853640 1 -- 172.21.15.77:0/3039266661 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8806cb60 con 0x7f1f8806ef00 2024-09-11T22:10:51.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:51.947+0000 7f1f7effd640 1 -- 172.21.15.77:0/3039266661 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1f7804b030 con 0x7f1f8806ef00 2024-09-11T22:10:52.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.015+0000 7f1f8c853640 1 -- 172.21.15.77:0/3039266661 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2b7bd0a5-e817-4719-8b2f-60c73a078699", "id": 1} v 0) -- 0x7f1f8815ec50 con 0x7f1f8806ef00 2024-09-11T22:10:52.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.018+0000 7f1f7effd640 1 -- 172.21.15.77:0/3039266661 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2b7bd0a5-e817-4719-8b2f-60c73a078699", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f1f8815c5c0 con 0x7f1f8806ef00 2024-09-11T22:10:52.020 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-09-11T22:10:52.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.019+0000 7f1f8c853640 1 -- 172.21.15.77:0/3039266661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ef00 msgr2=0x7f1f8815c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.019+0000 7f1f8c853640 1 --2- 172.21.15.77:0/3039266661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ef00 0x7f1f8815c080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1f78000c00 tx=0x7f1f780046c0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.019+0000 7f1f8c853640 1 -- 172.21.15.77:0/3039266661 shutdown_connections 2024-09-11T22:10:52.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.019+0000 7f1f8c853640 1 --2- 172.21.15.77:0/3039266661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f880b3340 0x7f1f880b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.019+0000 7f1f8c853640 1 --2- 172.21.15.77:0/3039266661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f880cec80 0x7f1f880b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.019+0000 7f1f8c853640 1 --2- 172.21.15.77:0/3039266661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f8806ef00 0x7f1f8815c080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.019+0000 7f1f8c853640 1 -- 172.21.15.77:0/3039266661 >> 172.21.15.77:0/3039266661 conn(0x7f1f88074c40 msgr2=0x7f1f8815de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:52.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.019+0000 7f1f8c853640 1 -- 172.21.15.77:0/3039266661 shutdown_connections 2024-09-11T22:10:52.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.019+0000 7f1f8c853640 1 -- 172.21.15.77:0/3039266661 wait complete. 2024-09-11T22:10:52.031 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new fa8c2b13-3785-408e-83eb-bdc6aebde1bd 2 2024-09-11T22:10:52.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.126+0000 7fa00c1af640 1 Processor -- start 2024-09-11T22:10:52.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.127+0000 7fa00c1af640 1 -- start start 2024-09-11T22:10:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.127+0000 7fa00c1af640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa00415b1e0 0x7fa00415b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.127+0000 7fa00c1af640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0040d0460 0x7fa00415ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.127+0000 7fa00c1af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa00415f4a0 0x7fa00415f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.127+0000 7fa00c1af640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa0040d0cb0 con 0x7fa0040d0460 2024-09-11T22:10:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.127+0000 7fa00c1af640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa0040d0f90 con 0x7fa00415b1e0 2024-09-11T22:10:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.127+0000 7fa00c1af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa0040d1270 con 0x7fa00415f4a0 2024-09-11T22:10:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.128+0000 7fa00a74c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa00415f4a0 0x7fa00415f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.128+0000 7fa009f4b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa00415b1e0 0x7fa00415b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.128+0000 7fa00a74c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa00415f4a0 0x7fa00415f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:37380/0 (socket says 172.21.15.77:37380) 2024-09-11T22:10:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.128+0000 7fa00a74c640 1 -- 172.21.15.77:0/615463739 learned_addr learned my addr 172.21.15.77:0/615463739 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.128+0000 7fa00974a640 1 --2- 172.21.15.77:0/615463739 >> v2:172.21.15.50:3300/0 conn(0x7fa0040d0460 0x7fa00415ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.128+0000 7fa00a74c640 1 -- 172.21.15.77:0/615463739 >> v2:172.21.15.77:3300/0 conn(0x7fa00415b1e0 msgr2=0x7fa00415b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.128+0000 7fa00a74c640 1 --2- 172.21.15.77:0/615463739 >> v2:172.21.15.77:3300/0 conn(0x7fa00415b1e0 0x7fa00415b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.128+0000 7fa00a74c640 1 -- 172.21.15.77:0/615463739 >> v2:172.21.15.50:3300/0 conn(0x7fa0040d0460 msgr2=0x7fa00415ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.128+0000 7fa00a74c640 1 --2- 172.21.15.77:0/615463739 >> v2:172.21.15.50:3300/0 conn(0x7fa0040d0460 0x7fa00415ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.128+0000 7fa00a74c640 1 -- 172.21.15.77:0/615463739 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00406e200 con 0x7fa00415f4a0 2024-09-11T22:10:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.128+0000 7fa00974a640 1 --2- 172.21.15.77:0/615463739 >> v2:172.21.15.50:3300/0 conn(0x7fa0040d0460 0x7fa00415ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:10:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.129+0000 7fa00a74c640 1 --2- 172.21.15.77:0/615463739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa00415f4a0 0x7fa00415f910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa00406c4a0 tx=0x7f9ffc02a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62a934061a89c92e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:52.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.129+0000 7fa008f49640 1 -- 172.21.15.77:0/615463739 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc036070 con 0x7fa00415f4a0 2024-09-11T22:10:52.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.129+0000 7fa008f49640 1 -- 172.21.15.77:0/615463739 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ffc031600 con 0x7fa00415f4a0 2024-09-11T22:10:52.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.129+0000 7fa008f49640 1 -- 172.21.15.77:0/615463739 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc0319d0 con 0x7fa00415f4a0 2024-09-11T22:10:52.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.129+0000 7fa00c1af640 1 -- 172.21.15.77:0/615463739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa00415f4a0 msgr2=0x7fa00415f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.129+0000 7fa00c1af640 1 --2- 172.21.15.77:0/615463739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa00415f4a0 0x7fa00415f910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa00406c4a0 tx=0x7f9ffc02a6a0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.129+0000 7fa00c1af640 1 -- 172.21.15.77:0/615463739 shutdown_connections 2024-09-11T22:10:52.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.129+0000 7fa00c1af640 1 --2- 172.21.15.77:0/615463739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa00415f4a0 0x7fa00415f910 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.129+0000 7fa00c1af640 1 --2- 172.21.15.77:0/615463739 >> v2:172.21.15.50:3300/0 conn(0x7fa0040d0460 0x7fa00415ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.129+0000 7fa00c1af640 1 --2- 172.21.15.77:0/615463739 >> v2:172.21.15.77:3300/0 conn(0x7fa00415b1e0 0x7fa00415b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.129+0000 7fa00c1af640 1 -- 172.21.15.77:0/615463739 >> 172.21.15.77:0/615463739 conn(0x7fa004075030 msgr2=0x7fa00406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:52.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.130+0000 7fa00c1af640 1 -- 172.21.15.77:0/615463739 shutdown_connections 2024-09-11T22:10:52.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.130+0000 7fa00c1af640 1 -- 172.21.15.77:0/615463739 wait complete. 2024-09-11T22:10:52.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.131+0000 7fa00c1af640 1 Processor -- start 2024-09-11T22:10:52.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.131+0000 7fa00c1af640 1 -- start start 2024-09-11T22:10:52.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa00c1af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0040d0460 0x7fa00414bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa00c1af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa00415b1e0 0x7fa0041485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa00c1af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa00415f4a0 0x7fa004148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa00c1af640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0040d0a50 con 0x7fa00415f4a0 2024-09-11T22:10:52.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa00c1af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa0040d08d0 con 0x7fa00415b1e0 2024-09-11T22:10:52.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa00c1af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa0040ce6b0 con 0x7fa0040d0460 2024-09-11T22:10:52.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa009f4b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0040d0460 0x7fa00414bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa00974a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa00415b1e0 0x7fa0041485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa009f4b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0040d0460 0x7fa00414bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:37384/0 (socket says 172.21.15.77:37384) 2024-09-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa009f4b640 1 -- 172.21.15.77:0/3210050601 learned_addr learned my addr 172.21.15.77:0/3210050601 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa00a74c640 1 --2- 172.21.15.77:0/3210050601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa00415f4a0 0x7fa004148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa009f4b640 1 -- 172.21.15.77:0/3210050601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa00415b1e0 msgr2=0x7fa0041485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa009f4b640 1 --2- 172.21.15.77:0/3210050601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa00415b1e0 0x7fa0041485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa009f4b640 1 -- 172.21.15.77:0/3210050601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa00415f4a0 msgr2=0x7fa004148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa009f4b640 1 --2- 172.21.15.77:0/3210050601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa00415f4a0 0x7fa004148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa009f4b640 1 -- 172.21.15.77:0/3210050601 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00414fad0 con 0x7fa0040d0460 2024-09-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa00974a640 1 --2- 172.21.15.77:0/3210050601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa00415b1e0 0x7fa0041485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa009f4b640 1 --2- 172.21.15.77:0/3210050601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0040d0460 0x7fa00414bd40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa00000e9e0 tx=0x7fa00000eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7f9ffa7fc640 1 -- 172.21.15.77:0/3210050601 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000017070 con 0x7fa0040d0460 2024-09-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7f9ffa7fc640 1 -- 172.21.15.77:0/3210050601 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00000c9d0 con 0x7fa0040d0460 2024-09-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa00c1af640 1 -- 172.21.15.77:0/3210050601 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa004149eb0 con 0x7fa0040d0460 2024-09-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7f9ffa7fc640 1 -- 172.21.15.77:0/3210050601 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00000cdc0 con 0x7fa0040d0460 2024-09-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.133+0000 7fa00c1af640 1 -- 172.21.15.77:0/3210050601 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa004148260 con 0x7fa0040d0460 2024-09-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.134+0000 7f9ffa7fc640 1 -- 172.21.15.77:0/3210050601 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa00001a070 con 0x7fa0040d0460 2024-09-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.134+0000 7f9ffa7fc640 1 -- 172.21.15.77:0/3210050601 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fa00001c9b0 con 0x7fa0040d0460 2024-09-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.134+0000 7fa00c1af640 1 -- 172.21.15.77:0/3210050601 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa00415ef60 con 0x7fa0040d0460 2024-09-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.137+0000 7f9ffa7fc640 1 -- 172.21.15.77:0/3210050601 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa00001ccc0 con 0x7fa0040d0460 2024-09-11T22:10:52.176 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:52.175+0000 7f08e8a13040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:10:52.204 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:52.204+0000 7f2bf9673040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:10:52.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.207+0000 7fa00c1af640 1 -- 172.21.15.77:0/3210050601 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fa8c2b13-3785-408e-83eb-bdc6aebde1bd", "id": 2} v 0) -- 0x7fa00415fc30 con 0x7fa0040d0460 2024-09-11T22:10:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.210+0000 7f9ffa7fc640 1 -- 172.21.15.77:0/3210050601 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa8c2b13-3785-408e-83eb-bdc6aebde1bd", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa00001c590 con 0x7fa0040d0460 2024-09-11T22:10:52.212 INFO:teuthology.orchestra.run.smithi077.stdout:2 2024-09-11T22:10:52.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.211+0000 7fa00c1af640 1 -- 172.21.15.77:0/3210050601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0040d0460 msgr2=0x7fa00414bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.211+0000 7fa00c1af640 1 --2- 172.21.15.77:0/3210050601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0040d0460 0x7fa00414bd40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa00000e9e0 tx=0x7fa00000eea0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.211+0000 7fa00c1af640 1 -- 172.21.15.77:0/3210050601 shutdown_connections 2024-09-11T22:10:52.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.211+0000 7fa00c1af640 1 --2- 172.21.15.77:0/3210050601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa00415f4a0 0x7fa004148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.211+0000 7fa00c1af640 1 --2- 172.21.15.77:0/3210050601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa00415b1e0 0x7fa0041485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.211+0000 7fa00c1af640 1 --2- 172.21.15.77:0/3210050601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0040d0460 0x7fa00414bd40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.211+0000 7fa00c1af640 1 -- 172.21.15.77:0/3210050601 >> 172.21.15.77:0/3210050601 conn(0x7fa004075030 msgr2=0x7fa00414c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:52.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.211+0000 7fa00c1af640 1 -- 172.21.15.77:0/3210050601 shutdown_connections 2024-09-11T22:10:52.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.211+0000 7fa00c1af640 1 -- 172.21.15.77:0/3210050601 wait complete. 2024-09-11T22:10:52.223 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new aacbe13f-b97b-45f2-b57f-bdf55d6693ba 3 2024-09-11T22:10:52.230 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:52.228+0000 7f08e8a13040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:10:52.262 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:52.261+0000 7f2bf9673040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:10:52.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.320+0000 7fc92470a640 1 Processor -- start 2024-09-11T22:10:52.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.320+0000 7fc92470a640 1 -- start start 2024-09-11T22:10:52.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc92470a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc91c15c000 0x7fc91c06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc92470a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc91c15c3e0 0x7fc91c0679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc92470a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc91c067f00 0x7fc91c15fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc92470a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc91c068370 con 0x7fc91c067f00 2024-09-11T22:10:52.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc92470a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc91c1631b0 con 0x7fc91c15c3e0 2024-09-11T22:10:52.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc92470a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc91c162ed0 con 0x7fc91c15c000 2024-09-11T22:10:52.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc921ca5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc91c15c3e0 0x7fc91c0679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc9224a6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc91c15c000 0x7fc91c06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc921ca5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc91c15c3e0 0x7fc91c0679c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38164/0 (socket says 172.21.15.77:38164) 2024-09-11T22:10:52.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc921ca5640 1 -- 172.21.15.77:0/246712838 learned_addr learned my addr 172.21.15.77:0/246712838 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:52.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc922ca7640 1 --2- 172.21.15.77:0/246712838 >> v2:172.21.15.50:3300/0 conn(0x7fc91c067f00 0x7fc91c15fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc921ca5640 1 -- 172.21.15.77:0/246712838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc91c15c000 msgr2=0x7fc91c06ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:52.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc921ca5640 1 --2- 172.21.15.77:0/246712838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc91c15c000 0x7fc91c06ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc921ca5640 1 -- 172.21.15.77:0/246712838 >> v2:172.21.15.50:3300/0 conn(0x7fc91c067f00 msgr2=0x7fc91c15fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:52.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc921ca5640 1 --2- 172.21.15.77:0/246712838 >> v2:172.21.15.50:3300/0 conn(0x7fc91c067f00 0x7fc91c15fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc921ca5640 1 -- 172.21.15.77:0/246712838 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91c06e290 con 0x7fc91c15c3e0 2024-09-11T22:10:52.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.321+0000 7fc9224a6640 1 --2- 172.21.15.77:0/246712838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc91c15c000 0x7fc91c06ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:52.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.322+0000 7fc921ca5640 1 --2- 172.21.15.77:0/246712838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc91c15c3e0 0x7fc91c0679c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc91c068680 tx=0x7fc90c02a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=606a81ca5f37592 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:52.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.322+0000 7fc9214a4640 1 -- 172.21.15.77:0/246712838 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c037070 con 0x7fc91c15c3e0 2024-09-11T22:10:52.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.322+0000 7fc9214a4640 1 -- 172.21.15.77:0/246712838 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc90c032440 con 0x7fc91c15c3e0 2024-09-11T22:10:52.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.322+0000 7fc9214a4640 1 -- 172.21.15.77:0/246712838 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c032810 con 0x7fc91c15c3e0 2024-09-11T22:10:52.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.323+0000 7fc92470a640 1 -- 172.21.15.77:0/246712838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc91c15c3e0 msgr2=0x7fc91c0679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.323+0000 7fc92470a640 1 --2- 172.21.15.77:0/246712838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc91c15c3e0 0x7fc91c0679c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc91c068680 tx=0x7fc90c02a140 comp rx=0 tx=0).stop 2024-09-11T22:10:52.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.323+0000 7fc92470a640 1 -- 172.21.15.77:0/246712838 shutdown_connections 2024-09-11T22:10:52.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.323+0000 7fc92470a640 1 --2- 172.21.15.77:0/246712838 >> v2:172.21.15.50:3300/0 conn(0x7fc91c067f00 0x7fc91c15fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.323+0000 7fc92470a640 1 --2- 172.21.15.77:0/246712838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc91c15c3e0 0x7fc91c0679c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.323+0000 7fc92470a640 1 --2- 172.21.15.77:0/246712838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc91c15c000 0x7fc91c06ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.323+0000 7fc92470a640 1 -- 172.21.15.77:0/246712838 >> 172.21.15.77:0/246712838 conn(0x7fc91c075030 msgr2=0x7fc91c06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:52.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.323+0000 7fc92470a640 1 -- 172.21.15.77:0/246712838 shutdown_connections 2024-09-11T22:10:52.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.323+0000 7fc92470a640 1 -- 172.21.15.77:0/246712838 wait complete. 2024-09-11T22:10:52.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.324+0000 7fc92470a640 1 Processor -- start 2024-09-11T22:10:52.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.324+0000 7fc92470a640 1 -- start start 2024-09-11T22:10:52.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc92470a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc91c067f00 0x7fc91c142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc92470a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc91c15c000 0x7fc91c143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc92470a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc91c15c3e0 0x7fc91c0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc92470a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c06f2b0 con 0x7fc91c067f00 2024-09-11T22:10:52.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc92470a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c06e850 con 0x7fc91c15c000 2024-09-11T22:10:52.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc92470a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc91c06f430 con 0x7fc91c15c3e0 2024-09-11T22:10:52.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc921ca5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc91c15c000 0x7fc91c143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc922ca7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc91c15c3e0 0x7fc91c0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc921ca5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc91c15c000 0x7fc91c143190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38166/0 (socket says 172.21.15.77:38166) 2024-09-11T22:10:52.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc922ca7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc91c15c3e0 0x7fc91c0b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:37408/0 (socket says 172.21.15.77:37408) 2024-09-11T22:10:52.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc921ca5640 1 -- 172.21.15.77:0/289872698 learned_addr learned my addr 172.21.15.77:0/289872698 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:52.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc9224a6640 1 --2- 172.21.15.77:0/289872698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc91c067f00 0x7fc91c142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc922ca7640 1 -- 172.21.15.77:0/289872698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc91c15c000 msgr2=0x7fc91c143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc922ca7640 1 --2- 172.21.15.77:0/289872698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc91c15c000 0x7fc91c143190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc922ca7640 1 -- 172.21.15.77:0/289872698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc91c067f00 msgr2=0x7fc91c142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc922ca7640 1 --2- 172.21.15.77:0/289872698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc91c067f00 0x7fc91c142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc922ca7640 1 -- 172.21.15.77:0/289872698 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91c142e60 con 0x7fc91c15c3e0 2024-09-11T22:10:52.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc9224a6640 1 --2- 172.21.15.77:0/289872698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc91c067f00 0x7fc91c142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:52.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc921ca5640 1 --2- 172.21.15.77:0/289872698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc91c15c000 0x7fc91c143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:52.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.325+0000 7fc922ca7640 1 --2- 172.21.15.77:0/289872698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc91c15c3e0 0x7fc91c0b51d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc91400efc0 tx=0x7fc91400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:52.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.326+0000 7fc912ffd640 1 -- 172.21.15.77:0/289872698 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914018020 con 0x7fc91c15c3e0 2024-09-11T22:10:52.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.326+0000 7fc912ffd640 1 -- 172.21.15.77:0/289872698 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc914014480 con 0x7fc91c15c3e0 2024-09-11T22:10:52.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.326+0000 7fc912ffd640 1 -- 172.21.15.77:0/289872698 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914014870 con 0x7fc91c15c3e0 2024-09-11T22:10:52.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.326+0000 7fc92470a640 1 -- 172.21.15.77:0/289872698 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc91c143c50 con 0x7fc91c15c3e0 2024-09-11T22:10:52.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.326+0000 7fc92470a640 1 -- 172.21.15.77:0/289872698 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc91c1444f0 con 0x7fc91c15c3e0 2024-09-11T22:10:52.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.326+0000 7fc912ffd640 1 -- 172.21.15.77:0/289872698 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc914005d10 con 0x7fc91c15c3e0 2024-09-11T22:10:52.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.326+0000 7fc912ffd640 1 -- 172.21.15.77:0/289872698 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fc914014da0 con 0x7fc91c15c3e0 2024-09-11T22:10:52.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.327+0000 7fc92470a640 1 -- 172.21.15.77:0/289872698 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc91c144040 con 0x7fc91c15c3e0 2024-09-11T22:10:52.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.329+0000 7fc912ffd640 1 -- 172.21.15.77:0/289872698 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc914022030 con 0x7fc91c15c3e0 2024-09-11T22:10:52.388 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:52.386+0000 7f08e8a13040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:10:52.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.398+0000 7fc92470a640 1 -- 172.21.15.77:0/289872698 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aacbe13f-b97b-45f2-b57f-bdf55d6693ba", "id": 3} v 0) -- 0x7fc91c06c740 con 0x7fc91c15c3e0 2024-09-11T22:10:52.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.401+0000 7fc912ffd640 1 -- 172.21.15.77:0/289872698 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aacbe13f-b97b-45f2-b57f-bdf55d6693ba", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fc914010040 con 0x7fc91c15c3e0 2024-09-11T22:10:52.403 INFO:teuthology.orchestra.run.smithi077.stdout:3 2024-09-11T22:10:52.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.402+0000 7fc92470a640 1 -- 172.21.15.77:0/289872698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc91c15c3e0 msgr2=0x7fc91c0b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.402+0000 7fc92470a640 1 --2- 172.21.15.77:0/289872698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc91c15c3e0 0x7fc91c0b51d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc91400efc0 tx=0x7fc91400c490 comp rx=0 tx=0).stop 2024-09-11T22:10:52.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.402+0000 7fc92470a640 1 -- 172.21.15.77:0/289872698 shutdown_connections 2024-09-11T22:10:52.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.402+0000 7fc92470a640 1 --2- 172.21.15.77:0/289872698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc91c15c3e0 0x7fc91c0b51d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.402+0000 7fc92470a640 1 --2- 172.21.15.77:0/289872698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc91c15c000 0x7fc91c143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.402+0000 7fc92470a640 1 --2- 172.21.15.77:0/289872698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc91c067f00 0x7fc91c142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.402+0000 7fc92470a640 1 -- 172.21.15.77:0/289872698 >> 172.21.15.77:0/289872698 conn(0x7fc91c075030 msgr2=0x7fc91c15dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:52.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.402+0000 7fc92470a640 1 -- 172.21.15.77:0/289872698 shutdown_connections 2024-09-11T22:10:52.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.402+0000 7fc92470a640 1 -- 172.21.15.77:0/289872698 wait complete. 2024-09-11T22:10:52.414 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new c055cfa0-4d24-4a11-8008-69a4e696492c 4 2024-09-11T22:10:52.419 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:52.418+0000 7f2bf9673040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:10:52.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.551+0000 7f8ca8c1e640 1 Processor -- start 2024-09-11T22:10:52.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.552+0000 7f8ca8c1e640 1 -- start start 2024-09-11T22:10:52.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.552+0000 7f8ca8c1e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ca4070430 0x7f8ca40b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.552+0000 7f8ca8c1e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca4070910 con 0x7f8ca40d0d00 2024-09-11T22:10:52.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.552+0000 7f8ca8c1e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca40affe0 con 0x7f8ca415fb40 2024-09-11T22:10:52.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.552+0000 7f8ca8c1e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca40b0630 con 0x7f8ca4070430 2024-09-11T22:10:52.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.552+0000 7f8ca2d9d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ca4070430 0x7f8ca40b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.552+0000 7f8ca259c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8ca415fb40 0x7f8ca40d05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48896/0 (socket says 172.21.15.77:48896) 2024-09-11T22:10:52.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.552+0000 7f8ca259c640 1 -- 172.21.15.77:0/1527963384 learned_addr learned my addr 172.21.15.77:0/1527963384 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-09-11T22:10:52.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.553+0000 7f8ca1d9b640 1 -- 172.21.15.77:0/1527963384 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138784937 0 0) 0x7f8ca40affe0 con 0x7f8ca415fb40 2024-09-11T22:10:52.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.553+0000 7f8ca2d9d640 1 -- 172.21.15.77:0/1527963384 >> v1:172.21.15.77:6789/0 conn(0x7f8ca415fb40 legacy=0x7f8ca40d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.553+0000 7f8ca2d9d640 1 -- 172.21.15.77:0/1527963384 >> v1:172.21.15.50:6789/0 conn(0x7f8ca40d0d00 legacy=0x7f8ca40b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.553+0000 7f8ca2d9d640 1 -- 172.21.15.77:0/1527963384 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca40b02c0 con 0x7f8ca4070430 2024-09-11T22:10:52.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.553+0000 7f8ca2d9d640 1 --2- 172.21.15.77:0/1527963384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ca4070430 0x7f8ca40b11d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009dc0 tx=0x7f8c9c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fb17c91bc0e836e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:52.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.554+0000 7f8ca1d9b640 1 -- 172.21.15.77:0/1527963384 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c007740 con 0x7f8ca4070430 2024-09-11T22:10:52.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.554+0000 7f8ca1d9b640 1 -- 172.21.15.77:0/1527963384 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c9c0078e0 con 0x7f8ca4070430 2024-09-11T22:10:52.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.554+0000 7f8ca1d9b640 1 -- 172.21.15.77:0/1527963384 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c007cb0 con 0x7f8ca4070430 2024-09-11T22:10:52.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.554+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/1527963384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ca4070430 msgr2=0x7f8ca40b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.554+0000 7f8ca8c1e640 1 --2- 172.21.15.77:0/1527963384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ca4070430 0x7f8ca40b11d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009dc0 tx=0x7f8c9c02a6d0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.554+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/1527963384 shutdown_connections 2024-09-11T22:10:52.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.554+0000 7f8ca8c1e640 1 --2- 172.21.15.77:0/1527963384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ca4070430 0x7f8ca40b11d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.554+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/1527963384 >> 172.21.15.77:0/1527963384 conn(0x7f8ca40b4150 msgr2=0x7f8ca40b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:52.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.554+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/1527963384 shutdown_connections 2024-09-11T22:10:52.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.554+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/1527963384 wait complete. 2024-09-11T22:10:52.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.556+0000 7f8ca8c1e640 1 Processor -- start 2024-09-11T22:10:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.556+0000 7f8ca8c1e640 1 -- start start 2024-09-11T22:10:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.556+0000 7f8ca8c1e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca4070430 0x7f8ca40c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.556+0000 7f8ca8c1e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ca40d0d00 0x7f8ca41f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.556+0000 7f8ca8c1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca415fb40 0x7f8ca41f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.556+0000 7f8ca8c1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca40d1310 con 0x7f8ca415fb40 2024-09-11T22:10:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.556+0000 7f8ca8c1e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca40d1190 con 0x7f8ca4070430 2024-09-11T22:10:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.556+0000 7f8ca8c1e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca4070ed0 con 0x7f8ca40d0d00 2024-09-11T22:10:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.556+0000 7f8ca259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca4070430 0x7f8ca40c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8c9bfff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ca40d0d00 0x7f8ca41f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8ca259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca4070430 0x7f8ca40c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57848/0 (socket says 172.21.15.77:57848) 2024-09-11T22:10:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8ca259c640 1 -- 172.21.15.77:0/626005806 learned_addr learned my addr 172.21.15.77:0/626005806 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8ca2d9d640 1 --2- 172.21.15.77:0/626005806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca415fb40 0x7f8ca41f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8ca259c640 1 -- 172.21.15.77:0/626005806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ca40d0d00 msgr2=0x7f8ca41f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8ca259c640 1 --2- 172.21.15.77:0/626005806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ca40d0d00 0x7f8ca41f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8ca259c640 1 -- 172.21.15.77:0/626005806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca415fb40 msgr2=0x7f8ca41f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8ca259c640 1 --2- 172.21.15.77:0/626005806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca415fb40 0x7f8ca41f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8ca259c640 1 -- 172.21.15.77:0/626005806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca40b1cb0 con 0x7f8ca4070430 2024-09-11T22:10:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8c9bfff640 1 --2- 172.21.15.77:0/626005806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ca40d0d00 0x7f8ca41f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8ca259c640 1 --2- 172.21.15.77:0/626005806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca4070430 0x7f8ca40c8a00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400c3f0 tx=0x7f8c9400c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8c9affd640 1 -- 172.21.15.77:0/626005806 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c940074e0 con 0x7f8ca4070430 2024-09-11T22:10:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8c9affd640 1 -- 172.21.15.77:0/626005806 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c940047e0 con 0x7f8ca4070430 2024-09-11T22:10:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/626005806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca40cbe40 con 0x7f8ca4070430 2024-09-11T22:10:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8c9affd640 1 -- 172.21.15.77:0/626005806 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94004c10 con 0x7f8ca4070430 2024-09-11T22:10:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/626005806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca40cc400 con 0x7f8ca4070430 2024-09-11T22:10:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8c9affd640 1 -- 172.21.15.77:0/626005806 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8c94011070 con 0x7f8ca4070430 2024-09-11T22:10:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.557+0000 7f8c9affd640 1 -- 172.21.15.77:0/626005806 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8c940138d0 con 0x7f8ca4070430 2024-09-11T22:10:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.558+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/626005806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca40d05f0 con 0x7f8ca4070430 2024-09-11T22:10:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.560+0000 7f8c9affd640 1 -- 172.21.15.77:0/626005806 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8c94004db0 con 0x7f8ca4070430 2024-09-11T22:10:52.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.630+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/626005806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c055cfa0-4d24-4a11-8008-69a4e696492c", "id": 4} v 0) -- 0x7f8ca40b8420 con 0x7f8ca4070430 2024-09-11T22:10:52.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.633+0000 7f8c9affd640 1 -- 172.21.15.77:0/626005806 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c055cfa0-4d24-4a11-8008-69a4e696492c", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f8c94013bf0 con 0x7f8ca4070430 2024-09-11T22:10:52.635 INFO:teuthology.orchestra.run.smithi077.stdout:4 2024-09-11T22:10:52.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.634+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/626005806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca4070430 msgr2=0x7f8ca40c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.634+0000 7f8ca8c1e640 1 --2- 172.21.15.77:0/626005806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca4070430 0x7f8ca40c8a00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400c3f0 tx=0x7f8c9400c8b0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.634+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/626005806 shutdown_connections 2024-09-11T22:10:52.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.634+0000 7f8ca8c1e640 1 --2- 172.21.15.77:0/626005806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ca40d0d00 0x7f8ca41f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.634+0000 7f8ca8c1e640 1 --2- 172.21.15.77:0/626005806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ca415fb40 0x7f8ca41f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.634+0000 7f8ca8c1e640 1 --2- 172.21.15.77:0/626005806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ca4070430 0x7f8ca40c8a00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.634+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/626005806 >> 172.21.15.77:0/626005806 conn(0x7f8ca40b4150 msgr2=0x7f8ca406f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:52.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.634+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/626005806 shutdown_connections 2024-09-11T22:10:52.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.634+0000 7f8ca8c1e640 1 -- 172.21.15.77:0/626005806 wait complete. 2024-09-11T22:10:52.645 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 6d5829dd-b5e7-40ab-a57e-147ac7d2ee29 5 2024-09-11T22:10:52.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.741+0000 7f09c5e82640 1 Processor -- start 2024-09-11T22:10:52.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.741+0000 7f09c5e82640 1 -- start start 2024-09-11T22:10:52.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09c5e82640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c015e870 0x7f09c00d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09c5e82640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f09c00d16d0 0x7f09c00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09c5e82640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c00cfa80 con 0x7f09c00d3a30 2024-09-11T22:10:52.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09c5e82640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f09c00d3ea0 con 0x7f09c00d16d0 2024-09-11T22:10:52.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09c5e82640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f09c00d1b10 con 0x7f09c015e870 2024-09-11T22:10:52.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c015e870 0x7f09c00d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c015e870 0x7f09c00d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:50530/0 (socket says 172.21.15.77:50530) 2024-09-11T22:10:52.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09bf7fe640 1 -- 172.21.15.77:0/1887369026 learned_addr learned my addr 172.21.15.77:0/1887369026 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:52.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09beffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f09c00d16d0 0x7f09c00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09bf7fe640 1 -- 172.21.15.77:0/1887369026 >> v2:172.21.15.77:3300/0 conn(0x7f09c00d16d0 msgr2=0x7f09c00d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:52.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09bf7fe640 1 --2- 172.21.15.77:0/1887369026 >> v2:172.21.15.77:3300/0 conn(0x7f09c00d16d0 0x7f09c00d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09bf7fe640 1 -- 172.21.15.77:0/1887369026 >> v1:172.21.15.77:6789/0 conn(0x7f09c00d3a30 legacy=0x7f09c00b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09bf7fe640 1 -- 172.21.15.77:0/1887369026 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c00d40d0 con 0x7f09c015e870 2024-09-11T22:10:52.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.742+0000 7f09beffd640 1 --2- 172.21.15.77:0/1887369026 >> v2:172.21.15.77:3300/0 conn(0x7f09c00d16d0 0x7f09c00d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:52.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.743+0000 7f09bf7fe640 1 --2- 172.21.15.77:0/1887369026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c015e870 0x7f09c00d1190 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009870 tx=0x7f09b002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97118e5d26ef6608 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:52.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.743+0000 7f09be7fc640 1 -- 172.21.15.77:0/1887369026 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0037070 con 0x7f09c015e870 2024-09-11T22:10:52.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.743+0000 7f09be7fc640 1 -- 172.21.15.77:0/1887369026 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b0032440 con 0x7f09c015e870 2024-09-11T22:10:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.743+0000 7f09be7fc640 1 -- 172.21.15.77:0/1887369026 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0032810 con 0x7f09c015e870 2024-09-11T22:10:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.744+0000 7f09c5e82640 1 -- 172.21.15.77:0/1887369026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c015e870 msgr2=0x7f09c00d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.744+0000 7f09c5e82640 1 --2- 172.21.15.77:0/1887369026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c015e870 0x7f09c00d1190 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009870 tx=0x7f09b002a250 comp rx=0 tx=0).stop 2024-09-11T22:10:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.744+0000 7f09c5e82640 1 -- 172.21.15.77:0/1887369026 shutdown_connections 2024-09-11T22:10:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.744+0000 7f09c5e82640 1 --2- 172.21.15.77:0/1887369026 >> v2:172.21.15.77:3300/0 conn(0x7f09c00d16d0 0x7f09c00d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.744+0000 7f09c5e82640 1 --2- 172.21.15.77:0/1887369026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c015e870 0x7f09c00d1190 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.744+0000 7f09c5e82640 1 -- 172.21.15.77:0/1887369026 >> 172.21.15.77:0/1887369026 conn(0x7f09c00727a0 msgr2=0x7f09c00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.744+0000 7f09c5e82640 1 -- 172.21.15.77:0/1887369026 shutdown_connections 2024-09-11T22:10:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.744+0000 7f09c5e82640 1 -- 172.21.15.77:0/1887369026 wait complete. 2024-09-11T22:10:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.745+0000 7f09c5e82640 1 Processor -- start 2024-09-11T22:10:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.745+0000 7f09c5e82640 1 -- start start 2024-09-11T22:10:52.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09c5e82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c00d16d0 0x7f09c0152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09c5e82640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c00d3a30 0x7f09c00b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09c5e82640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c015e870 0x7f09c00b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09c5e82640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09c00b7ee0 con 0x7f09c00d3a30 2024-09-11T22:10:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09c5e82640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f09c00b7c00 con 0x7f09c00d16d0 2024-09-11T22:10:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09c5e82640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f09c015ec50 con 0x7f09c015e870 2024-09-11T22:10:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c00d16d0 0x7f09c0152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09bffff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c015e870 0x7f09c00b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c00d16d0 0x7f09c0152310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57868/0 (socket says 172.21.15.77:57868) 2024-09-11T22:10:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09bf7fe640 1 -- 172.21.15.77:0/3559617818 learned_addr learned my addr 172.21.15.77:0/3559617818 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09beffd640 1 --2- 172.21.15.77:0/3559617818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c00d3a30 0x7f09c00b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09bffff640 1 -- 172.21.15.77:0/3559617818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c00d16d0 msgr2=0x7f09c0152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09bffff640 1 --2- 172.21.15.77:0/3559617818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c00d16d0 0x7f09c0152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09bffff640 1 -- 172.21.15.77:0/3559617818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c00d3a30 msgr2=0x7f09c00b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09bffff640 1 --2- 172.21.15.77:0/3559617818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c00d3a30 0x7f09c00b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09bffff640 1 -- 172.21.15.77:0/3559617818 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c01e8090 con 0x7f09c015e870 2024-09-11T22:10:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09bf7fe640 1 --2- 172.21.15.77:0/3559617818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c00d16d0 0x7f09c0152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09beffd640 1 --2- 172.21.15.77:0/3559617818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c00d3a30 0x7f09c00b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:10:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09bffff640 1 --2- 172.21.15.77:0/3559617818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c015e870 0x7f09c00b5bc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f09b800c6c0 tx=0x7f09b800cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09a7fff640 1 -- 172.21.15.77:0/3559617818 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b8003b70 con 0x7f09c015e870 2024-09-11T22:10:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09a7fff640 1 -- 172.21.15.77:0/3559617818 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b8003d10 con 0x7f09c015e870 2024-09-11T22:10:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09c5e82640 1 -- 172.21.15.77:0/3559617818 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c01e8330 con 0x7f09c015e870 2024-09-11T22:10:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.746+0000 7f09a7fff640 1 -- 172.21.15.77:0/3559617818 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b80052f0 con 0x7f09c015e870 2024-09-11T22:10:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.747+0000 7f09c5e82640 1 -- 172.21.15.77:0/3559617818 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c01e88f0 con 0x7f09c015e870 2024-09-11T22:10:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.747+0000 7f09a7fff640 1 -- 172.21.15.77:0/3559617818 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f09b8005490 con 0x7f09c015e870 2024-09-11T22:10:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.747+0000 7f09a7fff640 1 -- 172.21.15.77:0/3559617818 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f09b80129f0 con 0x7f09c015e870 2024-09-11T22:10:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.747+0000 7f09c5e82640 1 -- 172.21.15.77:0/3559617818 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c0075770 con 0x7f09c015e870 2024-09-11T22:10:52.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.749+0000 7f09a7fff640 1 -- 172.21.15.77:0/3559617818 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f09c00cfa80 con 0x7f09c015e870 2024-09-11T22:10:52.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.819+0000 7f09c5e82640 1 -- 172.21.15.77:0/3559617818 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6d5829dd-b5e7-40ab-a57e-147ac7d2ee29", "id": 5} v 0) -- 0x7f09c00b7940 con 0x7f09c015e870 2024-09-11T22:10:52.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.823+0000 7f09a7fff640 1 -- 172.21.15.77:0/3559617818 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6d5829dd-b5e7-40ab-a57e-147ac7d2ee29", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f09b8012cd0 con 0x7f09c015e870 2024-09-11T22:10:52.824 INFO:teuthology.orchestra.run.smithi077.stdout:5 2024-09-11T22:10:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.823+0000 7f09c5e82640 1 -- 172.21.15.77:0/3559617818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c015e870 msgr2=0x7f09c00b5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.823+0000 7f09c5e82640 1 --2- 172.21.15.77:0/3559617818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c015e870 0x7f09c00b5bc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f09b800c6c0 tx=0x7f09b800cb80 comp rx=0 tx=0).stop 2024-09-11T22:10:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.823+0000 7f09c5e82640 1 -- 172.21.15.77:0/3559617818 shutdown_connections 2024-09-11T22:10:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.823+0000 7f09c5e82640 1 --2- 172.21.15.77:0/3559617818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c015e870 0x7f09c00b5bc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.823+0000 7f09c5e82640 1 --2- 172.21.15.77:0/3559617818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c00d3a30 0x7f09c00b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.823+0000 7f09c5e82640 1 --2- 172.21.15.77:0/3559617818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c00d16d0 0x7f09c0152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.823+0000 7f09c5e82640 1 -- 172.21.15.77:0/3559617818 >> 172.21.15.77:0/3559617818 conn(0x7f09c00727a0 msgr2=0x7f09c00cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:52.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.824+0000 7f09c5e82640 1 -- 172.21.15.77:0/3559617818 shutdown_connections 2024-09-11T22:10:52.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.824+0000 7f09c5e82640 1 -- 172.21.15.77:0/3559617818 wait complete. 2024-09-11T22:10:52.835 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 1ba39422-f5e9-4d24-bc07-c9837bfa32f6 6 2024-09-11T22:10:52.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.932+0000 7f0c38017640 1 Processor -- start 2024-09-11T22:10:52.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.932+0000 7f0c38017640 1 -- start start 2024-09-11T22:10:52.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.933+0000 7f0c38017640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0c3015c000 0x7f0c3006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.933+0000 7f0c38017640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c300680d0 0x7f0c3015fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.933+0000 7f0c38017640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c30162ed0 con 0x7f0c3015c3e0 2024-09-11T22:10:52.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.933+0000 7f0c38017640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0c301631b0 con 0x7f0c300680d0 2024-09-11T22:10:52.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.933+0000 7f0c38017640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0c3006e290 con 0x7f0c3015c000 2024-09-11T22:10:52.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.933+0000 7f0c35db3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0c3015c000 0x7f0c3006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.933+0000 7f0c35db3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0c3015c000 0x7f0c3006ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57878/0 (socket says 172.21.15.77:57878) 2024-09-11T22:10:52.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.933+0000 7f0c35db3640 1 -- 172.21.15.77:0/1201577288 learned_addr learned my addr 172.21.15.77:0/1201577288 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:52.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.934+0000 7f0c365b4640 1 --2- 172.21.15.77:0/1201577288 >> v2:172.21.15.50:3300/0 conn(0x7f0c300680d0 0x7f0c3015fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.934+0000 7f0c35db3640 1 -- 172.21.15.77:0/1201577288 >> v2:172.21.15.50:3300/0 conn(0x7f0c300680d0 msgr2=0x7f0c3015fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:52.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.934+0000 7f0c35db3640 1 --2- 172.21.15.77:0/1201577288 >> v2:172.21.15.50:3300/0 conn(0x7f0c300680d0 0x7f0c3015fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.934+0000 7f0c35db3640 1 -- 172.21.15.77:0/1201577288 >> v1:172.21.15.50:6789/0 conn(0x7f0c3015c3e0 legacy=0x7f0c300679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.934+0000 7f0c35db3640 1 -- 172.21.15.77:0/1201577288 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3006e570 con 0x7f0c3015c000 2024-09-11T22:10:52.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.934+0000 7f0c35db3640 1 --2- 172.21.15.77:0/1201577288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c3015c000 0x7f0c3006ed70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0c30073380 tx=0x7f0c2c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d7b3693328bb171 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:52.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.935+0000 7f0c34db1640 1 -- 172.21.15.77:0/1201577288 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c037070 con 0x7f0c3015c000 2024-09-11T22:10:52.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.935+0000 7f0c34db1640 1 -- 172.21.15.77:0/1201577288 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c032440 con 0x7f0c3015c000 2024-09-11T22:10:52.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.935+0000 7f0c34db1640 1 -- 172.21.15.77:0/1201577288 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c032810 con 0x7f0c3015c000 2024-09-11T22:10:52.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.935+0000 7f0c38017640 1 -- 172.21.15.77:0/1201577288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c3015c000 msgr2=0x7f0c3006ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.935+0000 7f0c38017640 1 --2- 172.21.15.77:0/1201577288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c3015c000 0x7f0c3006ed70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0c30073380 tx=0x7f0c2c02a1e0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.935+0000 7f0c38017640 1 -- 172.21.15.77:0/1201577288 shutdown_connections 2024-09-11T22:10:52.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.935+0000 7f0c38017640 1 --2- 172.21.15.77:0/1201577288 >> v2:172.21.15.50:3300/0 conn(0x7f0c300680d0 0x7f0c3015fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.935+0000 7f0c38017640 1 --2- 172.21.15.77:0/1201577288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c3015c000 0x7f0c3006ed70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.935+0000 7f0c38017640 1 -- 172.21.15.77:0/1201577288 >> 172.21.15.77:0/1201577288 conn(0x7f0c30075030 msgr2=0x7f0c3006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:52.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.935+0000 7f0c38017640 1 -- 172.21.15.77:0/1201577288 shutdown_connections 2024-09-11T22:10:52.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.935+0000 7f0c38017640 1 -- 172.21.15.77:0/1201577288 wait complete. 2024-09-11T22:10:52.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c38017640 1 Processor -- start 2024-09-11T22:10:52.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c38017640 1 -- start start 2024-09-11T22:10:52.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c38017640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c300680d0 0x7f0c30145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c38017640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c3015c000 0x7f0c301612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c38017640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c3015c3e0 0x7f0c30161810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:52.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c38017640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3006f430 con 0x7f0c3015c000 2024-09-11T22:10:52.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c38017640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3006f2b0 con 0x7f0c3015c3e0 2024-09-11T22:10:52.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c38017640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0c30160320 con 0x7f0c300680d0 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c35db3640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c300680d0 0x7f0c30145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c365b4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c3015c3e0 0x7f0c30161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c365b4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c3015c3e0 0x7f0c30161810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57880/0 (socket says 172.21.15.77:57880) 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c365b4640 1 -- 172.21.15.77:0/564787602 learned_addr learned my addr 172.21.15.77:0/564787602 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c35db3640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c300680d0 0x7f0c30145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:50554/0 (socket says 172.21.15.77:50554) 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.937+0000 7f0c355b2640 1 --2- 172.21.15.77:0/564787602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c3015c000 0x7f0c301612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c35db3640 1 -- 172.21.15.77:0/564787602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c3015c3e0 msgr2=0x7f0c30161810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c35db3640 1 --2- 172.21.15.77:0/564787602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c3015c3e0 0x7f0c30161810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c35db3640 1 -- 172.21.15.77:0/564787602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c3015c000 msgr2=0x7f0c301612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c35db3640 1 --2- 172.21.15.77:0/564787602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c3015c000 0x7f0c301612d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c35db3640 1 -- 172.21.15.77:0/564787602 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c300ccc80 con 0x7f0c300680d0 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c365b4640 1 --2- 172.21.15.77:0/564787602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c3015c3e0 0x7f0c30161810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c355b2640 1 --2- 172.21.15.77:0/564787602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c3015c000 0x7f0c301612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c35db3640 1 --2- 172.21.15.77:0/564787602 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c300680d0 0x7f0c30145f60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0c300d0d70 tx=0x7f0c2c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:52.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c227fc640 1 -- 172.21.15.77:0/564787602 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c041030 con 0x7f0c300680d0 2024-09-11T22:10:52.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c227fc640 1 -- 172.21.15.77:0/564787602 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c030440 con 0x7f0c300680d0 2024-09-11T22:10:52.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c38017640 1 -- 172.21.15.77:0/564787602 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c30161ea0 con 0x7f0c300680d0 2024-09-11T22:10:52.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c227fc640 1 -- 172.21.15.77:0/564787602 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c037040 con 0x7f0c300680d0 2024-09-11T22:10:52.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c38017640 1 -- 172.21.15.77:0/564787602 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c300cd1d0 con 0x7f0c300680d0 2024-09-11T22:10:52.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c227fc640 1 -- 172.21.15.77:0/564787602 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0c2c044070 con 0x7f0c300680d0 2024-09-11T22:10:52.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.938+0000 7f0c227fc640 1 -- 172.21.15.77:0/564787602 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f0c2c03db50 con 0x7f0c300680d0 2024-09-11T22:10:52.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.939+0000 7f0c38017640 1 -- 172.21.15.77:0/564787602 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c301606e0 con 0x7f0c300680d0 2024-09-11T22:10:52.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:52.943+0000 7f0c227fc640 1 -- 172.21.15.77:0/564787602 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0c2c03dd50 con 0x7f0c300680d0 2024-09-11T22:10:53.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.012+0000 7f0c38017640 1 -- 172.21.15.77:0/564787602 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1ba39422-f5e9-4d24-bc07-c9837bfa32f6", "id": 6} v 0) -- 0x7f0c3006f7c0 con 0x7f0c300680d0 2024-09-11T22:10:53.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.016+0000 7f0c227fc640 1 -- 172.21.15.77:0/564787602 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ba39422-f5e9-4d24-bc07-c9837bfa32f6", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f0c2c03d560 con 0x7f0c300680d0 2024-09-11T22:10:53.018 INFO:teuthology.orchestra.run.smithi077.stdout:6 2024-09-11T22:10:53.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.017+0000 7f0c38017640 1 -- 172.21.15.77:0/564787602 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c300680d0 msgr2=0x7f0c30145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.017+0000 7f0c38017640 1 --2- 172.21.15.77:0/564787602 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c300680d0 0x7f0c30145f60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0c300d0d70 tx=0x7f0c2c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.017+0000 7f0c38017640 1 -- 172.21.15.77:0/564787602 shutdown_connections 2024-09-11T22:10:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.017+0000 7f0c38017640 1 --2- 172.21.15.77:0/564787602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c3015c3e0 0x7f0c30161810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.017+0000 7f0c38017640 1 --2- 172.21.15.77:0/564787602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c3015c000 0x7f0c301612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.017+0000 7f0c38017640 1 --2- 172.21.15.77:0/564787602 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c300680d0 0x7f0c30145f60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.017+0000 7f0c38017640 1 -- 172.21.15.77:0/564787602 >> 172.21.15.77:0/564787602 conn(0x7f0c30075030 msgr2=0x7f0c300b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.017+0000 7f0c38017640 1 -- 172.21.15.77:0/564787602 shutdown_connections 2024-09-11T22:10:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.017+0000 7f0c38017640 1 -- 172.21.15.77:0/564787602 wait complete. 2024-09-11T22:10:53.029 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 50d64521-840a-4e13-b3ea-a861978fe0b6 7 2024-09-11T22:10:53.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.124+0000 7fd73b8fa640 1 Processor -- start 2024-09-11T22:10:53.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.125+0000 7fd73b8fa640 1 -- start start 2024-09-11T22:10:53.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.125+0000 7fd73b8fa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd73415c4a0 0x7fd7340679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:53.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.125+0000 7fd73b8fa640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd734161030 con 0x7fd7341607c0 2024-09-11T22:10:53.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.125+0000 7fd73b8fa640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd734160d50 con 0x7fd734067f00 2024-09-11T22:10:53.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.125+0000 7fd73b8fa640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd734068340 con 0x7fd73415c4a0 2024-09-11T22:10:53.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.126+0000 7fd738e95640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd734067f00 0x7fd7341600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48910/0 (socket says 172.21.15.77:48910) 2024-09-11T22:10:53.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.126+0000 7fd738e95640 1 -- 172.21.15.77:0/1737852807 learned_addr learned my addr 172.21.15.77:0/1737852807 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-09-11T22:10:53.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.126+0000 7fd739696640 1 --2- 172.21.15.77:0/1737852807 >> v2:172.21.15.50:3300/0 conn(0x7fd73415c4a0 0x7fd7340679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:53.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.126+0000 7fd72bfff640 1 -- 172.21.15.77:0/1737852807 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4232591506 0 0) 0x7fd734160d50 con 0x7fd734067f00 2024-09-11T22:10:53.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.126+0000 7fd72bfff640 1 -- 172.21.15.77:0/1737852807 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd720003520 con 0x7fd734067f00 2024-09-11T22:10:53.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.126+0000 7fd739696640 1 -- 172.21.15.77:0/1737852807 >> v1:172.21.15.77:6789/0 conn(0x7fd734067f00 legacy=0x7fd7341600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:53.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.126+0000 7fd739696640 1 -- 172.21.15.77:0/1737852807 >> v1:172.21.15.50:6789/0 conn(0x7fd7341607c0 legacy=0x7fd73406ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:53.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.126+0000 7fd739696640 1 -- 172.21.15.77:0/1737852807 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73406e270 con 0x7fd73415c4a0 2024-09-11T22:10:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.127+0000 7fd739696640 1 --2- 172.21.15.77:0/1737852807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73415c4a0 0x7fd7340679c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd7300097a0 tx=0x7fd73002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7402370aab1960 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.127+0000 7fd72bfff640 1 -- 172.21.15.77:0/1737852807 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730037070 con 0x7fd73415c4a0 2024-09-11T22:10:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.127+0000 7fd72bfff640 1 -- 172.21.15.77:0/1737852807 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd730032440 con 0x7fd73415c4a0 2024-09-11T22:10:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.127+0000 7fd72bfff640 1 -- 172.21.15.77:0/1737852807 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730032810 con 0x7fd73415c4a0 2024-09-11T22:10:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.127+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1737852807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73415c4a0 msgr2=0x7fd7340679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.127+0000 7fd73b8fa640 1 --2- 172.21.15.77:0/1737852807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73415c4a0 0x7fd7340679c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd7300097a0 tx=0x7fd73002a230 comp rx=0 tx=0).stop 2024-09-11T22:10:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.127+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1737852807 shutdown_connections 2024-09-11T22:10:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.127+0000 7fd73b8fa640 1 --2- 172.21.15.77:0/1737852807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73415c4a0 0x7fd7340679c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.127+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1737852807 >> 172.21.15.77:0/1737852807 conn(0x7fd734075030 msgr2=0x7fd73406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.128+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1737852807 shutdown_connections 2024-09-11T22:10:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.128+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1737852807 wait complete. 2024-09-11T22:10:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.129+0000 7fd73b8fa640 1 Processor -- start 2024-09-11T22:10:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.129+0000 7fd73b8fa640 1 -- start start 2024-09-11T22:10:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.129+0000 7fd73b8fa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd734067f00 0x7fd73414b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.129+0000 7fd73b8fa640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73415c4a0 0x7fd734147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.129+0000 7fd73b8fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7341607c0 0x7fd73406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.129+0000 7fd73b8fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd73415c880 con 0x7fd7341607c0 2024-09-11T22:10:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd73b8fa640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd73406e830 con 0x7fd734067f00 2024-09-11T22:10:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd73b8fa640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd73415ca00 con 0x7fd73415c4a0 2024-09-11T22:10:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd739696640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd734067f00 0x7fd73414b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd739696640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd734067f00 0x7fd73414b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57888/0 (socket says 172.21.15.77:57888) 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd739696640 1 -- 172.21.15.77:0/1298636349 learned_addr learned my addr 172.21.15.77:0/1298636349 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd738e95640 1 --2- 172.21.15.77:0/1298636349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73415c4a0 0x7fd734147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd739e97640 1 --2- 172.21.15.77:0/1298636349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7341607c0 0x7fd73406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd739696640 1 -- 172.21.15.77:0/1298636349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73415c4a0 msgr2=0x7fd734147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd739696640 1 --2- 172.21.15.77:0/1298636349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73415c4a0 0x7fd734147200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd739696640 1 -- 172.21.15.77:0/1298636349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7341607c0 msgr2=0x7fd73406ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd739696640 1 --2- 172.21.15.77:0/1298636349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7341607c0 0x7fd73406ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd739696640 1 -- 172.21.15.77:0/1298636349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73414bfe0 con 0x7fd734067f00 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd739696640 1 --2- 172.21.15.77:0/1298636349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd734067f00 0x7fd73414b130 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd730035040 tx=0x7fd7300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd729ffb640 1 -- 172.21.15.77:0/1298636349 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730037040 con 0x7fd734067f00 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd729ffb640 1 -- 172.21.15.77:0/1298636349 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd730030500 con 0x7fd734067f00 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd729ffb640 1 -- 172.21.15.77:0/1298636349 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730030910 con 0x7fd734067f00 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1298636349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd73414c280 con 0x7fd734067f00 2024-09-11T22:10:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.130+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1298636349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd73414c840 con 0x7fd734067f00 2024-09-11T22:10:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.131+0000 7fd729ffb640 1 -- 172.21.15.77:0/1298636349 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd730044020 con 0x7fd734067f00 2024-09-11T22:10:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.131+0000 7fd729ffb640 1 -- 172.21.15.77:0/1298636349 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fd73003bbb0 con 0x7fd734067f00 2024-09-11T22:10:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.131+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1298636349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7340679c0 con 0x7fd734067f00 2024-09-11T22:10:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.133+0000 7fd729ffb640 1 -- 172.21.15.77:0/1298636349 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd73003b430 con 0x7fd734067f00 2024-09-11T22:10:53.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.203+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1298636349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd new", "uuid": "50d64521-840a-4e13-b3ea-a861978fe0b6", "id": 7} v 0) -- 0x7fd73406c530 con 0x7fd734067f00 2024-09-11T22:10:53.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.209+0000 7fd729ffb640 1 -- 172.21.15.77:0/1298636349 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "50d64521-840a-4e13-b3ea-a861978fe0b6", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fd73003b610 con 0x7fd734067f00 2024-09-11T22:10:53.210 INFO:teuthology.orchestra.run.smithi077.stdout:7 2024-09-11T22:10:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.210+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1298636349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd734067f00 msgr2=0x7fd73414b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.210+0000 7fd73b8fa640 1 --2- 172.21.15.77:0/1298636349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd734067f00 0x7fd73414b130 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd730035040 tx=0x7fd7300046c0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.210+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1298636349 shutdown_connections 2024-09-11T22:10:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.210+0000 7fd73b8fa640 1 --2- 172.21.15.77:0/1298636349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73415c4a0 0x7fd734147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.210+0000 7fd73b8fa640 1 --2- 172.21.15.77:0/1298636349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7341607c0 0x7fd73406ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.210+0000 7fd73b8fa640 1 --2- 172.21.15.77:0/1298636349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd734067f00 0x7fd73414b130 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.210+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1298636349 >> 172.21.15.77:0/1298636349 conn(0x7fd734075030 msgr2=0x7fd7340c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.210+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1298636349 shutdown_connections 2024-09-11T22:10:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:10:53.210+0000 7fd73b8fa640 1 -- 172.21.15.77:0/1298636349 wait complete. 2024-09-11T22:10:53.221 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T22:10:53.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T22:10:53.224 INFO:tasks.ceph.osd.0:Started 2024-09-11T22:10:53.224 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T22:10:53.224 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T22:10:53.226 INFO:tasks.ceph.osd.1:Started 2024-09-11T22:10:53.226 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T22:10:53.226 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T22:10:53.228 INFO:tasks.ceph.osd.2:Started 2024-09-11T22:10:53.229 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T22:10:53.229 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-11T22:10:53.231 INFO:tasks.ceph.osd.3:Started 2024-09-11T22:10:53.231 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-11T22:10:53.231 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-11T22:10:53.233 INFO:tasks.ceph.osd.4:Started 2024-09-11T22:10:53.234 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-11T22:10:53.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-11T22:10:53.236 INFO:tasks.ceph.osd.5:Started 2024-09-11T22:10:53.236 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-11T22:10:53.236 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-11T22:10:53.238 INFO:tasks.ceph.osd.6:Started 2024-09-11T22:10:53.238 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-11T22:10:53.238 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-11T22:10:53.240 INFO:tasks.ceph.osd.7:Started 2024-09-11T22:10:53.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:10:53.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.389+0000 7fd51487b640 1 Processor -- start 2024-09-11T22:10:53.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.389+0000 7fd51487b640 1 -- start start 2024-09-11T22:10:53.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.390+0000 7fd51487b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd51015e9a0 0x7fd5100cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:53.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.390+0000 7fd51487b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5100d19b0 0x7fd5100cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:53.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.390+0000 7fd51487b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd510070770 con 0x7fd51006fcf0 2024-09-11T22:10:53.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.390+0000 7fd51487b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd51015ed80 con 0x7fd5100d19b0 2024-09-11T22:10:53.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.390+0000 7fd51487b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5100701b0 con 0x7fd51015e9a0 2024-09-11T22:10:53.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.390+0000 7fd50ed9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd51006fcf0 0x7fd5100d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48544/0 (socket says 172.21.15.50:48544) 2024-09-11T22:10:53.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.390+0000 7fd50ed9d640 1 -- 172.21.15.50:0/3899456857 learned_addr learned my addr 172.21.15.50:0/3899456857 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:10:53.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.390+0000 7fd50e59c640 1 --2- 172.21.15.50:0/3899456857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd51015e9a0 0x7fd5100cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:53.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.390+0000 7fd50dd9b640 1 --2- 172.21.15.50:0/3899456857 >> v2:172.21.15.77:3300/0 conn(0x7fd5100d19b0 0x7fd5100cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:53.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.390+0000 7fd50d59a640 1 -- 172.21.15.50:0/3899456857 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1707452040 0 0) 0x7fd510070770 con 0x7fd51006fcf0 2024-09-11T22:10:53.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.390+0000 7fd50d59a640 1 -- 172.21.15.50:0/3899456857 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4fc003520 con 0x7fd51006fcf0 2024-09-11T22:10:53.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.391+0000 7fd50dd9b640 1 -- 172.21.15.50:0/3899456857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd51015e9a0 msgr2=0x7fd5100cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:53.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.391+0000 7fd50dd9b640 1 --2- 172.21.15.50:0/3899456857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd51015e9a0 0x7fd5100cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.391+0000 7fd50dd9b640 1 -- 172.21.15.50:0/3899456857 >> v1:172.21.15.50:6789/0 conn(0x7fd51006fcf0 legacy=0x7fd5100d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:53.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.391+0000 7fd50dd9b640 1 -- 172.21.15.50:0/3899456857 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd510070490 con 0x7fd5100d19b0 2024-09-11T22:10:53.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.391+0000 7fd50e59c640 1 --2- 172.21.15.50:0/3899456857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd51015e9a0 0x7fd5100cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:53.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.391+0000 7fd50dd9b640 1 --2- 172.21.15.50:0/3899456857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5100d19b0 0x7fd5100cf460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80097a0 tx=0x7fd4f802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb90f25be3edf02e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:53.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.391+0000 7fd50d59a640 1 -- 172.21.15.50:0/3899456857 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8037070 con 0x7fd5100d19b0 2024-09-11T22:10:53.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.391+0000 7fd50d59a640 1 -- 172.21.15.50:0/3899456857 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f8032440 con 0x7fd5100d19b0 2024-09-11T22:10:53.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.392+0000 7fd50d59a640 1 -- 172.21.15.50:0/3899456857 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8032810 con 0x7fd5100d19b0 2024-09-11T22:10:53.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.392+0000 7fd51487b640 1 -- 172.21.15.50:0/3899456857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5100d19b0 msgr2=0x7fd5100cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:53.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.392+0000 7fd51487b640 1 --2- 172.21.15.50:0/3899456857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5100d19b0 0x7fd5100cf460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80097a0 tx=0x7fd4f802a180 comp rx=0 tx=0).stop 2024-09-11T22:10:53.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.392+0000 7fd51487b640 1 -- 172.21.15.50:0/3899456857 shutdown_connections 2024-09-11T22:10:53.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.392+0000 7fd51487b640 1 --2- 172.21.15.50:0/3899456857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5100d19b0 0x7fd5100cf460 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.392+0000 7fd51487b640 1 --2- 172.21.15.50:0/3899456857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd51015e9a0 0x7fd5100cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.392+0000 7fd51487b640 1 -- 172.21.15.50:0/3899456857 >> 172.21.15.50:0/3899456857 conn(0x7fd5100b4150 msgr2=0x7fd5100b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:53.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.392+0000 7fd51487b640 1 -- 172.21.15.50:0/3899456857 shutdown_connections 2024-09-11T22:10:53.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.392+0000 7fd51487b640 1 -- 172.21.15.50:0/3899456857 wait complete. 2024-09-11T22:10:53.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.393+0000 7fd51487b640 1 Processor -- start 2024-09-11T22:10:53.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.394+0000 7fd51487b640 1 -- start start 2024-09-11T22:10:53.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.394+0000 7fd51487b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd51006fcf0 0x7fd51015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:53.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.394+0000 7fd51487b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5100d19b0 0x7fd5100b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:53.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.394+0000 7fd51487b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd51015e9a0 0x7fd51015c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:53.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.394+0000 7fd51487b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd51006d500 con 0x7fd51006fcf0 2024-09-11T22:10:53.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.394+0000 7fd51487b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd51006bfd0 con 0x7fd51015e9a0 2024-09-11T22:10:53.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.394+0000 7fd51487b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd51006d680 con 0x7fd5100d19b0 2024-09-11T22:10:53.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.394+0000 7fd50e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd51006fcf0 0x7fd51015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:53.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.394+0000 7fd50e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd51006fcf0 0x7fd51015a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42760/0 (socket says 172.21.15.50:42760) 2024-09-11T22:10:53.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.394+0000 7fd50e59c640 1 -- 172.21.15.50:0/1089757901 learned_addr learned my addr 172.21.15.50:0/1089757901 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:10:53.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.394+0000 7fd50ed9d640 1 --2- 172.21.15.50:0/1089757901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd51015e9a0 0x7fd51015c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:53.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.394+0000 7fd50dd9b640 1 --2- 172.21.15.50:0/1089757901 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5100d19b0 0x7fd5100b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:53.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd50ed9d640 1 -- 172.21.15.50:0/1089757901 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5100d19b0 msgr2=0x7fd5100b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:53.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd50ed9d640 1 --2- 172.21.15.50:0/1089757901 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5100d19b0 0x7fd5100b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd50ed9d640 1 -- 172.21.15.50:0/1089757901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd51006fcf0 msgr2=0x7fd51015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:53.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd50ed9d640 1 --2- 172.21.15.50:0/1089757901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd51006fcf0 0x7fd51015a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd50ed9d640 1 -- 172.21.15.50:0/1089757901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5100b5e60 con 0x7fd51015e9a0 2024-09-11T22:10:53.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd50e59c640 1 --2- 172.21.15.50:0/1089757901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd51006fcf0 0x7fd51015a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:53.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd50dd9b640 1 --2- 172.21.15.50:0/1089757901 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5100d19b0 0x7fd5100b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:53.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd50ed9d640 1 --2- 172.21.15.50:0/1089757901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd51015e9a0 0x7fd51015c6f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd50800ca80 tx=0x7fd50800cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:53.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd506ffd640 1 -- 172.21.15.50:0/1089757901 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508017070 con 0x7fd51015e9a0 2024-09-11T22:10:53.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd506ffd640 1 -- 172.21.15.50:0/1089757901 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50800ac30 con 0x7fd51015e9a0 2024-09-11T22:10:53.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd51487b640 1 -- 172.21.15.50:0/1089757901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5100b6140 con 0x7fd51015e9a0 2024-09-11T22:10:53.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd506ffd640 1 -- 172.21.15.50:0/1089757901 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508012400 con 0x7fd51015e9a0 2024-09-11T22:10:53.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd51487b640 1 -- 172.21.15.50:0/1089757901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5100b6700 con 0x7fd51015e9a0 2024-09-11T22:10:53.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd506ffd640 1 -- 172.21.15.50:0/1089757901 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd50801a070 con 0x7fd51015e9a0 2024-09-11T22:10:53.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.395+0000 7fd506ffd640 1 -- 172.21.15.50:0/1089757901 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd508007070 con 0x7fd51015e9a0 2024-09-11T22:10:53.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.396+0000 7fd51487b640 1 -- 172.21.15.50:0/1089757901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5100b1a30 con 0x7fd51015e9a0 2024-09-11T22:10:53.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.398+0000 7fd506ffd640 1 -- 172.21.15.50:0/1089757901 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd5080126e0 con 0x7fd51015e9a0 2024-09-11T22:10:53.443 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:53.442+0000 7f2bf9673040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:10:53.453 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:53.452+0000 7f08e8a13040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:10:53.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.458+0000 7fd51487b640 1 -- 172.21.15.50:0/1089757901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5100b1440 con 0x7fd51015e9a0 2024-09-11T22:10:53.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.459+0000 7fd506ffd640 1 -- 172.21.15.50:0/1089757901 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd5080128c0 con 0x7fd51015e9a0 2024-09-11T22:10:53.460 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:10:53.460 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:10:53.206017+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:10:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.460+0000 7fd51487b640 1 -- 172.21.15.50:0/1089757901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd51015e9a0 msgr2=0x7fd51015c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.460+0000 7fd51487b640 1 --2- 172.21.15.50:0/1089757901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd51015e9a0 0x7fd51015c6f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd50800ca80 tx=0x7fd50800cf40 comp rx=0 tx=0).stop 2024-09-11T22:10:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.460+0000 7fd51487b640 1 -- 172.21.15.50:0/1089757901 shutdown_connections 2024-09-11T22:10:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.460+0000 7fd51487b640 1 --2- 172.21.15.50:0/1089757901 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5100d19b0 0x7fd5100b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.460+0000 7fd51487b640 1 --2- 172.21.15.50:0/1089757901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd51015e9a0 0x7fd51015c6f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.460+0000 7fd51487b640 1 --2- 172.21.15.50:0/1089757901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd51006fcf0 0x7fd51015a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.460+0000 7fd51487b640 1 -- 172.21.15.50:0/1089757901 >> 172.21.15.50:0/1089757901 conn(0x7fd5100b4150 msgr2=0x7fd5100b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.460+0000 7fd51487b640 1 -- 172.21.15.50:0/1089757901 shutdown_connections 2024-09-11T22:10:53.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:10:53.460+0000 7fd51487b640 1 -- 172.21.15.50:0/1089757901 wait complete. 2024-09-11T22:10:53.471 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T22:10:53.471 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T22:10:53.500 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:53.499+0000 7f2bf9673040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:10:53.505 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:53.503+0000 7f08e8a13040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:10:53.873 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:53.871+0000 7f08e8a13040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:10:53.887 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:53.886+0000 7f2bf9673040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:10:53.958 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:53.956+0000 7f08e8a13040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:10:53.976 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:53.975+0000 7f2bf9673040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:10:54.063 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:54.061+0000 7f08e8a13040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:10:54.088 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:54.087+0000 7f2bf9673040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:10:54.108 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:54.107+0000 7f08e8a13040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:10:54.136 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:54.136+0000 7f2bf9673040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:10:54.224 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:54.222+0000 7f08e8a13040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:10:54.256 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:54.255+0000 7f2bf9673040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:10:54.277 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:54.275+0000 7f08e8a13040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:10:54.277 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T22:10:54.312 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:54.312+0000 7f2bf9673040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:10:54.321 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:54.319+0000 7f08e8a13040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:10:54.360 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:54.360+0000 7f2bf9673040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:10:54.370 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.370+0000 7f59631e4640 1 Processor -- start 2024-09-11T22:10:54.370 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.370+0000 7f59631e4640 1 -- start start 2024-09-11T22:10:54.372 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.370+0000 7f59631e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c15b630 0x7f595c0ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:54.372 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.370+0000 7f59631e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f595c0b56b0 0x7f595c0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:54.372 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.370+0000 7f59631e4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595c15ba10 con 0x7f595c0cfce0 2024-09-11T22:10:54.372 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.370+0000 7f59631e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f595c070870 con 0x7f595c0b56b0 2024-09-11T22:10:54.372 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.370+0000 7f59631e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f595c06fc60 con 0x7f595c15b630 2024-09-11T22:10:54.372 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.371+0000 7f595bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f595c0cfce0 0x7f595c072100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48556/0 (socket says 172.21.15.50:48556) 2024-09-11T22:10:54.372 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.371+0000 7f595bfff640 1 -- 172.21.15.50:0/234557152 learned_addr learned my addr 172.21.15.50:0/234557152 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:10:54.372 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.371+0000 7f5961781640 1 --2- 172.21.15.50:0/234557152 >> v2:172.21.15.77:3300/0 conn(0x7f595c0b56b0 0x7f595c0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:54.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.371+0000 7f5960f80640 1 --2- 172.21.15.50:0/234557152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c15b630 0x7f595c0ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:54.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.371+0000 7f595b7fe640 1 -- 172.21.15.50:0/234557152 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243615494 0 0) 0x7f595c15ba10 con 0x7f595c0cfce0 2024-09-11T22:10:54.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.371+0000 7f595b7fe640 1 -- 172.21.15.50:0/234557152 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f594c003520 con 0x7f595c0cfce0 2024-09-11T22:10:54.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.371+0000 7f595b7fe640 1 -- 172.21.15.50:0/234557152 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3597595856 0 0) 0x7f594c003520 con 0x7f595c0cfce0 2024-09-11T22:10:54.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.371+0000 7f5960f80640 1 -- 172.21.15.50:0/234557152 >> v2:172.21.15.77:3300/0 conn(0x7f595c0b56b0 msgr2=0x7f595c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:10:54.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.371+0000 7f5960f80640 1 --2- 172.21.15.50:0/234557152 >> v2:172.21.15.77:3300/0 conn(0x7f595c0b56b0 0x7f595c0ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:54.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.371+0000 7f5960f80640 1 -- 172.21.15.50:0/234557152 >> v1:172.21.15.50:6789/0 conn(0x7f595c0cfce0 legacy=0x7f595c072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:54.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.371+0000 7f5960f80640 1 -- 172.21.15.50:0/234557152 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c06ff40 con 0x7f595c15b630 2024-09-11T22:10:54.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.371+0000 7f5961781640 1 --2- 172.21.15.50:0/234557152 >> v2:172.21.15.77:3300/0 conn(0x7f595c0b56b0 0x7f595c0ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:10:54.374 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.372+0000 7f5960f80640 1 --2- 172.21.15.50:0/234557152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c15b630 0x7f595c0ce400 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f59500097a0 tx=0x7f595002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0e984ffe292d8c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:54.374 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.372+0000 7f595b7fe640 1 -- 172.21.15.50:0/234557152 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950037070 con 0x7f595c15b630 2024-09-11T22:10:54.374 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.372+0000 7f595b7fe640 1 -- 172.21.15.50:0/234557152 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595002aba0 con 0x7f595c15b630 2024-09-11T22:10:54.374 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.372+0000 7f595b7fe640 1 -- 172.21.15.50:0/234557152 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948001670 con 0x7f595c15b630 2024-09-11T22:10:54.374 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.373+0000 7f59631e4640 1 -- 172.21.15.50:0/234557152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c15b630 msgr2=0x7f595c0ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:54.374 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.373+0000 7f59631e4640 1 --2- 172.21.15.50:0/234557152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c15b630 0x7f595c0ce400 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f59500097a0 tx=0x7f595002a110 comp rx=0 tx=0).stop 2024-09-11T22:10:54.375 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.373+0000 7f59631e4640 1 -- 172.21.15.50:0/234557152 shutdown_connections 2024-09-11T22:10:54.375 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.373+0000 7f59631e4640 1 --2- 172.21.15.50:0/234557152 >> v2:172.21.15.77:3300/0 conn(0x7f595c0b56b0 0x7f595c0ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:54.375 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.373+0000 7f59631e4640 1 --2- 172.21.15.50:0/234557152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c15b630 0x7f595c0ce400 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:54.375 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.373+0000 7f59631e4640 1 -- 172.21.15.50:0/234557152 >> 172.21.15.50:0/234557152 conn(0x7f595c06bd40 msgr2=0x7f595c06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:54.375 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.373+0000 7f59631e4640 1 -- 172.21.15.50:0/234557152 shutdown_connections 2024-09-11T22:10:54.375 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.373+0000 7f59631e4640 1 -- 172.21.15.50:0/234557152 wait complete. 2024-09-11T22:10:54.377 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.374+0000 7f59631e4640 1 Processor -- start 2024-09-11T22:10:54.377 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.374+0000 7f59631e4640 1 -- start start 2024-09-11T22:10:54.377 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f59631e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c0b56b0 0x7f595c15da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:54.377 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f59631e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f595c0cfce0 0x7f595c14cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:54.377 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f59631e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595c15b630 0x7f595c150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:10:54.377 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f59631e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f595c06f930 con 0x7f595c15b630 2024-09-11T22:10:54.377 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f59631e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f595c070500 con 0x7f595c0cfce0 2024-09-11T22:10:54.377 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f59631e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f595c0d0b60 con 0x7f595c0b56b0 2024-09-11T22:10:54.377 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f5961781640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595c15b630 0x7f595c150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:54.378 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f5961781640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595c15b630 0x7f595c150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42764/0 (socket says 172.21.15.50:42764) 2024-09-11T22:10:54.378 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f5961781640 1 -- 172.21.15.50:0/1357387425 learned_addr learned my addr 172.21.15.50:0/1357387425 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:10:54.378 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f595bfff640 1 --2- 172.21.15.50:0/1357387425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f595c0cfce0 0x7f595c14cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:54.378 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f5960f80640 1 --2- 172.21.15.50:0/1357387425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c0b56b0 0x7f595c15da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:10:54.378 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f5961781640 1 -- 172.21.15.50:0/1357387425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c0b56b0 msgr2=0x7f595c15da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:54.378 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f5961781640 1 --2- 172.21.15.50:0/1357387425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c0b56b0 0x7f595c15da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:54.378 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f5961781640 1 -- 172.21.15.50:0/1357387425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f595c0cfce0 msgr2=0x7f595c14cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:54.378 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f5961781640 1 --2- 172.21.15.50:0/1357387425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f595c0cfce0 0x7f595c14cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:54.378 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f5961781640 1 -- 172.21.15.50:0/1357387425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c14d520 con 0x7f595c15b630 2024-09-11T22:10:54.378 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.375+0000 7f5961781640 1 --2- 172.21.15.50:0/1357387425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595c15b630 0x7f595c150f70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f595400ef90 tx=0x7f5954009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:10:54.378 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.376+0000 7f59597fa640 1 -- 172.21.15.50:0/1357387425 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954018020 con 0x7f595c15b630 2024-09-11T22:10:54.378 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.376+0000 7f59597fa640 1 -- 172.21.15.50:0/1357387425 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5954014480 con 0x7f595c15b630 2024-09-11T22:10:54.378 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.376+0000 7f59597fa640 1 -- 172.21.15.50:0/1357387425 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954014870 con 0x7f595c15b630 2024-09-11T22:10:54.379 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.376+0000 7f59631e4640 1 -- 172.21.15.50:0/1357387425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595c15c9b0 con 0x7f595c15b630 2024-09-11T22:10:54.379 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.376+0000 7f59631e4640 1 -- 172.21.15.50:0/1357387425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f595c15cf70 con 0x7f595c15b630 2024-09-11T22:10:54.379 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.376+0000 7f59597fa640 1 -- 172.21.15.50:0/1357387425 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5954005d10 con 0x7f595c15b630 2024-09-11T22:10:54.379 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.376+0000 7f59597fa640 1 -- 172.21.15.50:0/1357387425 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f5954013ab0 con 0x7f595c15b630 2024-09-11T22:10:54.379 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.377+0000 7f59631e4640 1 -- 172.21.15.50:0/1357387425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f595c0ce400 con 0x7f595c15b630 2024-09-11T22:10:54.380 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.379+0000 7f59597fa640 1 -- 172.21.15.50:0/1357387425 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5954022030 con 0x7f595c15b630 2024-09-11T22:10:54.434 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:54.432+0000 7f08e8a13040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:10:54.453 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.453+0000 7f59631e4640 1 -- 172.21.15.50:0/1357387425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f595c069160 con 0x7f595c15b630 2024-09-11T22:10:54.454 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.453+0000 7f59597fa640 1 -- 172.21.15.50:0/1357387425 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f5954010040 con 0x7f595c15b630 2024-09-11T22:10:54.454 INFO:teuthology.misc.health.smithi050.stdout: 2024-09-11T22:10:54.454 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":10,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:10:53.206017+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:10:54.455 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.454+0000 7f59631e4640 1 -- 172.21.15.50:0/1357387425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595c15b630 msgr2=0x7f595c150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:10:54.455 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.454+0000 7f59631e4640 1 --2- 172.21.15.50:0/1357387425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595c15b630 0x7f595c150f70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f595400ef90 tx=0x7f5954009f90 comp rx=0 tx=0).stop 2024-09-11T22:10:54.455 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.454+0000 7f59631e4640 1 -- 172.21.15.50:0/1357387425 shutdown_connections 2024-09-11T22:10:54.455 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.454+0000 7f59631e4640 1 --2- 172.21.15.50:0/1357387425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595c15b630 0x7f595c150f70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:54.455 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.454+0000 7f59631e4640 1 --2- 172.21.15.50:0/1357387425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f595c0cfce0 0x7f595c14cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:54.455 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.454+0000 7f59631e4640 1 --2- 172.21.15.50:0/1357387425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c0b56b0 0x7f595c15da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:10:54.455 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.454+0000 7f59631e4640 1 -- 172.21.15.50:0/1357387425 >> 172.21.15.50:0/1357387425 conn(0x7f595c06bd40 msgr2=0x7f595c06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:10:54.455 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.454+0000 7f59631e4640 1 -- 172.21.15.50:0/1357387425 shutdown_connections 2024-09-11T22:10:54.455 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:10:54.454+0000 7f59631e4640 1 -- 172.21.15.50:0/1357387425 wait complete. 2024-09-11T22:10:54.464 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T22:10:54.483 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:54.482+0000 7f08e8a13040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:10:54.492 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:54.492+0000 7f2bf9673040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:10:54.533 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:54.532+0000 7f08e8a13040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:10:54.545 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:54.544+0000 7f2bf9673040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:10:54.599 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:54.598+0000 7f2bf9673040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:10:54.600 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:54.598+0000 7f08e8a13040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:10:54.643 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:54.642+0000 7f08e8a13040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:10:54.670 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:54.669+0000 7f2bf9673040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:10:54.687 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:54.686+0000 7f08e8a13040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:10:54.717 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:54.716+0000 7f2bf9673040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:10:54.763 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:54.763+0000 7f2bf9673040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:10:54.932 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-11T22:10:54.931+0000 7f90bb00d640 -1 Falling back to public interface 2024-09-11T22:10:54.949 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-11T22:10:54.947+0000 7f5c44d89640 -1 Falling back to public interface 2024-09-11T22:10:54.951 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-11T22:10:54.950+0000 7fbab7a44640 -1 Falling back to public interface 2024-09-11T22:10:54.957 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-11T22:10:54.955+0000 7f05bfe1e640 -1 Falling back to public interface 2024-09-11T22:10:55.192 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-11T22:10:55.192+0000 7f03d0b45640 -1 Falling back to public interface 2024-09-11T22:10:55.204 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-11T22:10:55.203+0000 7f782afa4640 -1 Falling back to public interface 2024-09-11T22:10:55.218 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-11T22:10:55.216+0000 7ff49fe11640 -1 Falling back to public interface 2024-09-11T22:10:55.223 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-11T22:10:55.222+0000 7f153360c640 -1 Falling back to public interface 2024-09-11T22:10:55.350 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:55.349+0000 7f08e8a13040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:10:55.460 INFO:tasks.ceph.mgr.y.smithi050.stderr:2024-09-11T22:10:55.459+0000 7f2bf9673040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:10:56.367 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:56.366+0000 7f0888586640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-11T22:10:56.370 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-11T22:10:56.369+0000 7f0888586640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-11T22:10:59.259 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-11T22:10:59.259+0000 7fbab7a44640 -1 osd.2 0 log_to_monitors true 2024-09-11T22:10:59.304 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-11T22:10:59.304+0000 7ff49fe11640 -1 osd.7 0 log_to_monitors true 2024-09-11T22:10:59.438 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-11T22:10:59.437+0000 7f03d0b45640 -1 osd.0 0 log_to_monitors true 2024-09-11T22:10:59.452 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-11T22:10:59.451+0000 7f5c44d89640 -1 osd.4 0 log_to_monitors true 2024-09-11T22:10:59.509 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-11T22:10:59.509+0000 7f90bb00d640 -1 osd.3 0 log_to_monitors true 2024-09-11T22:10:59.514 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-11T22:10:59.514+0000 7f05bfe1e640 -1 osd.6 0 log_to_monitors true 2024-09-11T22:10:59.522 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-11T22:10:59.521+0000 7f782afa4640 -1 osd.1 0 log_to_monitors true 2024-09-11T22:10:59.564 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-11T22:10:59.564+0000 7f153360c640 -1 osd.5 0 log_to_monitors true 2024-09-11T22:11:01.206 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-11T22:11:01.205+0000 7fbab31b0640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T22:11:01.220 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-11T22:11:01.219+0000 7fbaab7e2640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:11:01.242 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-11T22:11:01.241+0000 7ff49aeca640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T22:11:01.252 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-11T22:11:01.252+0000 7ff4934fc640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:11:01.271 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:01.364 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.363+0000 7f352d6f1640 1 Processor -- start 2024-09-11T22:11:01.364 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.363+0000 7f352d6f1640 1 -- start start 2024-09-11T22:11:01.365 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.364+0000 7f352d6f1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35280d1e30 0x7f352815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:01.365 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.364+0000 7f352d6f1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35280cf8f0 con 0x7f35281627c0 2024-09-11T22:11:01.365 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.364+0000 7f352d6f1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35280cfbd0 con 0x7f352815e9a0 2024-09-11T22:11:01.366 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.364+0000 7f352d6f1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f35280b4070 con 0x7f35280d1e30 2024-09-11T22:11:01.366 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.364+0000 7f35267fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35280d1e30 0x7f352815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:01.366 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.364+0000 7f35277fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f35281627c0 0x7f35280d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54928/0 (socket says 172.21.15.50:54928) 2024-09-11T22:11:01.366 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.364+0000 7f35277fe640 1 -- 172.21.15.50:0/1499744011 learned_addr learned my addr 172.21.15.50:0/1499744011 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:01.366 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.364+0000 7f35267fc640 1 -- 172.21.15.50:0/1499744011 >> v1:172.21.15.77:6789/0 conn(0x7f352815e9a0 legacy=0x7f35280d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:01.366 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.364+0000 7f35267fc640 1 -- 172.21.15.50:0/1499744011 >> v1:172.21.15.50:6789/0 conn(0x7f35281627c0 legacy=0x7f35280d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:01.366 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.364+0000 7f3525ffb640 1 -- 172.21.15.50:0/1499744011 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991801018 0 0) 0x7f35280cf8f0 con 0x7f35281627c0 2024-09-11T22:11:01.366 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.364+0000 7f35267fc640 1 -- 172.21.15.50:0/1499744011 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35280cfeb0 con 0x7f35280d1e30 2024-09-11T22:11:01.367 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.365+0000 7f35267fc640 1 --2- 172.21.15.50:0/1499744011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35280d1e30 0x7f352815ed80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f35100097d0 tx=0x7f351002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fad6fe9e886814 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:01.367 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.365+0000 7f3525ffb640 1 -- 172.21.15.50:0/1499744011 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510037070 con 0x7f35280d1e30 2024-09-11T22:11:01.367 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.365+0000 7f3525ffb640 1 -- 172.21.15.50:0/1499744011 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3510032640 con 0x7f35280d1e30 2024-09-11T22:11:01.367 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.365+0000 7f3525ffb640 1 -- 172.21.15.50:0/1499744011 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510032a10 con 0x7f35280d1e30 2024-09-11T22:11:01.367 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.366+0000 7f352d6f1640 1 -- 172.21.15.50:0/1499744011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35280d1e30 msgr2=0x7f352815ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:01.368 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.366+0000 7f352d6f1640 1 --2- 172.21.15.50:0/1499744011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35280d1e30 0x7f352815ed80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f35100097d0 tx=0x7f351002a300 comp rx=0 tx=0).stop 2024-09-11T22:11:01.368 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.366+0000 7f352d6f1640 1 -- 172.21.15.50:0/1499744011 shutdown_connections 2024-09-11T22:11:01.368 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.366+0000 7f352d6f1640 1 --2- 172.21.15.50:0/1499744011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35280d1e30 0x7f352815ed80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:01.368 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.366+0000 7f352d6f1640 1 -- 172.21.15.50:0/1499744011 >> 172.21.15.50:0/1499744011 conn(0x7f3528067cb0 msgr2=0x7f35280680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:01.368 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.366+0000 7f352d6f1640 1 -- 172.21.15.50:0/1499744011 shutdown_connections 2024-09-11T22:11:01.368 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.366+0000 7f352d6f1640 1 -- 172.21.15.50:0/1499744011 wait complete. 2024-09-11T22:11:01.370 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.367+0000 7f352d6f1640 1 Processor -- start 2024-09-11T22:11:01.370 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.367+0000 7f352d6f1640 1 -- start start 2024-09-11T22:11:01.370 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f352d6f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35280d1e30 0x7f35281592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:01.370 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f352d6f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f352815e9a0 0x7f3528159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:01.370 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f352d6f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35281627c0 0x7f35281f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:01.370 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f352d6f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f35280b7ed0 con 0x7f35280d1e30 2024-09-11T22:11:01.370 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f352d6f1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f35280b7d50 con 0x7f352815e9a0 2024-09-11T22:11:01.370 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f352d6f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f35280cf180 con 0x7f35281627c0 2024-09-11T22:11:01.371 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f3526ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35280d1e30 0x7f35281592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:01.371 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f3526ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35280d1e30 0x7f35281592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33274/0 (socket says 172.21.15.50:33274) 2024-09-11T22:11:01.371 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f3526ffd640 1 -- 172.21.15.50:0/3222044636 learned_addr learned my addr 172.21.15.50:0/3222044636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:01.371 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f35277fe640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35281627c0 0x7f35281f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:01.371 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f35267fc640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f352815e9a0 0x7f3528159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:01.371 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f3526ffd640 1 -- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35281627c0 msgr2=0x7f35281f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:01.371 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f3526ffd640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35281627c0 0x7f35281f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:01.371 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f3526ffd640 1 -- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f352815e9a0 msgr2=0x7f3528159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:01.371 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f3526ffd640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f352815e9a0 0x7f3528159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:01.371 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.368+0000 7f3526ffd640 1 -- 172.21.15.50:0/3222044636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3528159e80 con 0x7f35280d1e30 2024-09-11T22:11:01.371 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.369+0000 7f3526ffd640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35280d1e30 0x7f35281592e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f352000c450 tx=0x7f352000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:01.371 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.369+0000 7f351f7fe640 1 -- 172.21.15.50:0/3222044636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35200052d0 con 0x7f35280d1e30 2024-09-11T22:11:01.371 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.369+0000 7f351f7fe640 1 -- 172.21.15.50:0/3222044636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3520005470 con 0x7f35280d1e30 2024-09-11T22:11:01.372 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.369+0000 7f351f7fe640 1 -- 172.21.15.50:0/3222044636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520012870 con 0x7f35280d1e30 2024-09-11T22:11:01.372 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.369+0000 7f352d6f1640 1 -- 172.21.15.50:0/3222044636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f352815a160 con 0x7f35280d1e30 2024-09-11T22:11:01.372 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.369+0000 7f352d6f1640 1 -- 172.21.15.50:0/3222044636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f352815f790 con 0x7f35280d1e30 2024-09-11T22:11:01.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.370+0000 7f352d6f1640 1 -- 172.21.15.50:0/3222044636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35281636d0 con 0x7f35280d1e30 2024-09-11T22:11:01.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.370+0000 7f351f7fe640 1 -- 172.21.15.50:0/3222044636 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f3520012a10 con 0x7f35280d1e30 2024-09-11T22:11:01.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.371+0000 7f351f7fe640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f350806bda0 0x7f350806e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:01.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.371+0000 7f351f7fe640 1 -- 172.21.15.50:0/3222044636 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2135+0+0 (secure 0 0 0) 0x7f3520089a00 con 0x7f35280d1e30 2024-09-11T22:11:01.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.371+0000 7f35267fc640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f350806bda0 0x7f350806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:01.373 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.371+0000 7f35267fc640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f350806bda0 0x7f350806e260 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3510034000 tx=0x7f351002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:01.376 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.375+0000 7f351f7fe640 1 -- 172.21.15.50:0/3222044636 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f35281636d0 con 0x7f35280d1e30 2024-09-11T22:11:01.614 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.613+0000 7f352d6f1640 1 -- 172.21.15.50:0/3222044636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35280b70b0 con 0x7f35280d1e30 2024-09-11T22:11:01.615 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.614+0000 7f351f7fe640 1 -- 172.21.15.50:0/3222044636 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8029 (secure 0 0 0) 0x7f35280b70b0 con 0x7f35280d1e30 2024-09-11T22:11:01.615 INFO:teuthology.misc.health.smithi050.stdout: 2024-09-11T22:11:01.615 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":13,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:01.376347+0000","last_up_change":"2024-09-11T22:11:01.376347+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:01.618 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.617+0000 7f352d6f1640 1 -- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f350806bda0 msgr2=0x7f350806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:01.618 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.617+0000 7f352d6f1640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f350806bda0 0x7f350806e260 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3510034000 tx=0x7f351002e000 comp rx=0 tx=0).stop 2024-09-11T22:11:01.618 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.617+0000 7f352d6f1640 1 -- 172.21.15.50:0/3222044636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35280d1e30 msgr2=0x7f35281592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:01.618 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.617+0000 7f352d6f1640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35280d1e30 0x7f35281592e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f352000c450 tx=0x7f352000c910 comp rx=0 tx=0).stop 2024-09-11T22:11:01.618 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.617+0000 7f352d6f1640 1 -- 172.21.15.50:0/3222044636 shutdown_connections 2024-09-11T22:11:01.618 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.617+0000 7f352d6f1640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f350806bda0 0x7f350806e260 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:01.618 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.617+0000 7f352d6f1640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35281627c0 0x7f35281f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:01.618 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.617+0000 7f352d6f1640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f352815e9a0 0x7f3528159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:01.619 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.617+0000 7f352d6f1640 1 --2- 172.21.15.50:0/3222044636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35280d1e30 0x7f35281592e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:01.619 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.617+0000 7f352d6f1640 1 -- 172.21.15.50:0/3222044636 >> 172.21.15.50:0/3222044636 conn(0x7f3528067cb0 msgr2=0x7f35280b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:01.619 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.617+0000 7f352d6f1640 1 -- 172.21.15.50:0/3222044636 shutdown_connections 2024-09-11T22:11:01.619 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:01.617+0000 7f352d6f1640 1 -- 172.21.15.50:0/3222044636 wait complete. 2024-09-11T22:11:01.631 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-09-11T22:11:02.605 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-11T22:11:02.605+0000 7f03cc2b1640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T22:11:02.621 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-11T22:11:02.621+0000 7f03c48e3640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:11:02.625 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-11T22:11:02.625+0000 7f90b60ca640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T22:11:02.643 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-11T22:11:02.643+0000 7f90ae6fc640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:11:02.646 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-11T22:11:02.645+0000 7f7827747640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T22:11:02.659 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-11T22:11:02.659+0000 7f781ed42640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:11:03.052 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-11T22:11:03.051+0000 7f5c404f5640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T22:11:03.060 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-11T22:11:03.060+0000 7f5c38b27640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:11:03.078 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-11T22:11:03.078+0000 7f152e6a6640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T22:11:03.082 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-11T22:11:03.082+0000 7f05bb03b640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T22:11:03.092 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-11T22:11:03.092+0000 7f1526cd8640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:11:03.096 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-11T22:11:03.096+0000 7f05b366d640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:11:08.438 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:08.544 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.542+0000 7f08d725e640 1 Processor -- start 2024-09-11T22:11:08.545 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.543+0000 7f08d725e640 1 -- start start 2024-09-11T22:11:08.546 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.543+0000 7f08d725e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f08d015ea90 0x7f08d00cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:08.546 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.543+0000 7f08d725e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08d00d1660 0x7f08d00d3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:08.546 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.543+0000 7f08d725e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08d00cf7b0 con 0x7f08d00cf310 2024-09-11T22:11:08.546 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.543+0000 7f08d725e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f08d00d0050 con 0x7f08d00d1660 2024-09-11T22:11:08.546 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.543+0000 7f08d725e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f08d00d2b90 con 0x7f08d015ea90 2024-09-11T22:11:08.546 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.544+0000 7f08d57fb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08d00d1660 0x7f08d00d3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:08.546 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.544+0000 7f08cffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f08d00cf310 0x7f08d00d0f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57884/0 (socket says 172.21.15.50:57884) 2024-09-11T22:11:08.546 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.544+0000 7f08cffff640 1 -- 172.21.15.50:0/3171330480 learned_addr learned my addr 172.21.15.50:0/3171330480 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:08.547 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.544+0000 7f08d4ffa640 1 --2- 172.21.15.50:0/3171330480 >> v2:172.21.15.77:3300/0 conn(0x7f08d015ea90 0x7f08d00cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:08.547 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.544+0000 7f08d57fb640 1 -- 172.21.15.50:0/3171330480 >> v2:172.21.15.77:3300/0 conn(0x7f08d015ea90 msgr2=0x7f08d00cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:08.547 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.544+0000 7f08d57fb640 1 --2- 172.21.15.50:0/3171330480 >> v2:172.21.15.77:3300/0 conn(0x7f08d015ea90 0x7f08d00cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.547 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.544+0000 7f08d57fb640 1 -- 172.21.15.50:0/3171330480 >> v1:172.21.15.50:6789/0 conn(0x7f08d00cf310 legacy=0x7f08d00d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:08.547 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.544+0000 7f08d57fb640 1 -- 172.21.15.50:0/3171330480 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d00cfa90 con 0x7f08d00d1660 2024-09-11T22:11:08.548 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.545+0000 7f08d57fb640 1 --2- 172.21.15.50:0/3171330480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d00d1660 0x7f08d00d3300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f08d0076420 tx=0x7f08c802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4103494df977222f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:08.548 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.545+0000 7f08cf7fe640 1 -- 172.21.15.50:0/3171330480 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c8007740 con 0x7f08d00d1660 2024-09-11T22:11:08.549 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.545+0000 7f08cf7fe640 1 -- 172.21.15.50:0/3171330480 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c80078e0 con 0x7f08d00d1660 2024-09-11T22:11:08.549 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.545+0000 7f08cf7fe640 1 -- 172.21.15.50:0/3171330480 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c8007cb0 con 0x7f08d00d1660 2024-09-11T22:11:08.549 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.545+0000 7f08d725e640 1 -- 172.21.15.50:0/3171330480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d00d1660 msgr2=0x7f08d00d3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:08.549 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.545+0000 7f08d725e640 1 --2- 172.21.15.50:0/3171330480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d00d1660 0x7f08d00d3300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f08d0076420 tx=0x7f08c802a680 comp rx=0 tx=0).stop 2024-09-11T22:11:08.549 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.546+0000 7f08d725e640 1 -- 172.21.15.50:0/3171330480 shutdown_connections 2024-09-11T22:11:08.549 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.546+0000 7f08d725e640 1 --2- 172.21.15.50:0/3171330480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d00d1660 0x7f08d00d3300 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.549 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.546+0000 7f08d725e640 1 --2- 172.21.15.50:0/3171330480 >> v2:172.21.15.77:3300/0 conn(0x7f08d015ea90 0x7f08d00cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.549 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.546+0000 7f08d725e640 1 -- 172.21.15.50:0/3171330480 >> 172.21.15.50:0/3171330480 conn(0x7f08d0067890 msgr2=0x7f08d0067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:08.549 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.546+0000 7f08d725e640 1 -- 172.21.15.50:0/3171330480 shutdown_connections 2024-09-11T22:11:08.549 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.546+0000 7f08d725e640 1 -- 172.21.15.50:0/3171330480 wait complete. 2024-09-11T22:11:08.550 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.547+0000 7f08d725e640 1 Processor -- start 2024-09-11T22:11:08.550 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.547+0000 7f08d725e640 1 -- start start 2024-09-11T22:11:08.552 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d725e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d00cf310 0x7f08d00ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:08.552 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d725e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d00d1660 0x7f08d014ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:08.552 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d725e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d015ea90 0x7f08d0161b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:08.552 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d725e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f08d00b79b0 con 0x7f08d015ea90 2024-09-11T22:11:08.552 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d725e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f08d00d2de0 con 0x7f08d00cf310 2024-09-11T22:11:08.553 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d725e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f08d01625a0 con 0x7f08d00d1660 2024-09-11T22:11:08.553 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d57fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d015ea90 0x7f08d0161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:08.553 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d57fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d015ea90 0x7f08d0161b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48788/0 (socket says 172.21.15.50:48788) 2024-09-11T22:11:08.553 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d57fb640 1 -- 172.21.15.50:0/1799789142 learned_addr learned my addr 172.21.15.50:0/1799789142 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:08.553 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d4ffa640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d00cf310 0x7f08d00ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:08.553 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08cffff640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d00d1660 0x7f08d014ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:08.553 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d57fb640 1 -- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d00d1660 msgr2=0x7f08d014ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:08.553 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d57fb640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d00d1660 0x7f08d014ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.553 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d57fb640 1 -- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d00cf310 msgr2=0x7f08d00ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:08.554 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d57fb640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d00cf310 0x7f08d00ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.554 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d57fb640 1 -- 172.21.15.50:0/1799789142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d014f100 con 0x7f08d015ea90 2024-09-11T22:11:08.554 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08cffff640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d00d1660 0x7f08d014ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:08.554 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08d57fb640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d015ea90 0x7f08d0161b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f08c802ac70 tx=0x7f08c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:08.554 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.548+0000 7f08cd7fa640 1 -- 172.21.15.50:0/1799789142 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c8040070 con 0x7f08d015ea90 2024-09-11T22:11:08.554 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.549+0000 7f08cd7fa640 1 -- 172.21.15.50:0/1799789142 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c8031bc0 con 0x7f08d015ea90 2024-09-11T22:11:08.554 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.549+0000 7f08d725e640 1 -- 172.21.15.50:0/1799789142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d01607a0 con 0x7f08d015ea90 2024-09-11T22:11:08.554 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.549+0000 7f08cd7fa640 1 -- 172.21.15.50:0/1799789142 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c8009450 con 0x7f08d015ea90 2024-09-11T22:11:08.554 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.549+0000 7f08d725e640 1 -- 172.21.15.50:0/1799789142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d0160d60 con 0x7f08d015ea90 2024-09-11T22:11:08.554 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.550+0000 7f08d725e640 1 -- 172.21.15.50:0/1799789142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d00cedd0 con 0x7f08d015ea90 2024-09-11T22:11:08.555 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.550+0000 7f08cd7fa640 1 -- 172.21.15.50:0/1799789142 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08c8039040 con 0x7f08d015ea90 2024-09-11T22:11:08.555 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.551+0000 7f08cd7fa640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08bc06be30 0x7f08bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:08.555 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.551+0000 7f08cd7fa640 1 -- 172.21.15.50:0/1799789142 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f08c80ac3e0 con 0x7f08d015ea90 2024-09-11T22:11:08.555 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.551+0000 7f08d4ffa640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08bc06be30 0x7f08bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:08.555 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.551+0000 7f08d4ffa640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08bc06be30 0x7f08bc06e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009a30 tx=0x7f08c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:08.557 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.556+0000 7f08cd7fa640 1 -- 172.21.15.50:0/1799789142 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f08d014f100 con 0x7f08d015ea90 2024-09-11T22:11:08.736 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.733+0000 7f08d725e640 1 -- 172.21.15.50:0/1799789142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08d00ba700 con 0x7f08d015ea90 2024-09-11T22:11:08.736 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.734+0000 7f08cd7fa640 1 -- 172.21.15.50:0/1799789142 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7f08c807b0e0 con 0x7f08d015ea90 2024-09-11T22:11:08.737 INFO:teuthology.misc.health.smithi050.stdout: 2024-09-11T22:11:08.737 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":17,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:05.616081+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:08.739 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.736+0000 7f08d725e640 1 -- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08bc06be30 msgr2=0x7f08bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:08.739 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.736+0000 7f08d725e640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08bc06be30 0x7f08bc06e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009a30 tx=0x7f08c0008040 comp rx=0 tx=0).stop 2024-09-11T22:11:08.739 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.736+0000 7f08d725e640 1 -- 172.21.15.50:0/1799789142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d015ea90 msgr2=0x7f08d0161b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:08.739 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.736+0000 7f08d725e640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d015ea90 0x7f08d0161b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f08c802ac70 tx=0x7f08c8004a40 comp rx=0 tx=0).stop 2024-09-11T22:11:08.739 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.736+0000 7f08d725e640 1 -- 172.21.15.50:0/1799789142 shutdown_connections 2024-09-11T22:11:08.739 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.736+0000 7f08d725e640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08bc06be30 0x7f08bc06e2f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.739 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.736+0000 7f08d725e640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d00d1660 0x7f08d014ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.739 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.736+0000 7f08d725e640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d015ea90 0x7f08d0161b20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.739 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.736+0000 7f08d725e640 1 --2- 172.21.15.50:0/1799789142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d00cf310 0x7f08d00ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.739 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.736+0000 7f08d725e640 1 -- 172.21.15.50:0/1799789142 >> 172.21.15.50:0/1799789142 conn(0x7f08d0067890 msgr2=0x7f08d00b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:08.740 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.736+0000 7f08d725e640 1 -- 172.21.15.50:0/1799789142 shutdown_connections 2024-09-11T22:11:08.740 INFO:teuthology.misc.health.smithi050.stderr:2024-09-11T22:11:08.736+0000 7f08d725e640 1 -- 172.21.15.50:0/1799789142 wait complete. 2024-09-11T22:11:08.748 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-11T22:11:08.748 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T22:11:08.749 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:11:08.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:11:08.751 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:11:08.751 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:11:08.751 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:11:08.753 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:11:08.754 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:11:08.754 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:11:08.757 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:11:08.757 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:11:08.757 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:11:08.759 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:11:08.759 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-11T22:11:08.760 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:11:08.828 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:11:08.828 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:11:08.842 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:11:08.845 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:11:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.865+0000 7f7e94c3c640 1 Processor -- start 2024-09-11T22:11:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.865+0000 7f7e94c3c640 1 -- start start 2024-09-11T22:11:08.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.866+0000 7f7e94c3c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e9015f030 0x7f7e900b5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:08.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.866+0000 7f7e94c3c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e900af440 0x7f7e9015f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.866+0000 7f7e94c3c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e900afc20 con 0x7f7e9015f950 2024-09-11T22:11:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.866+0000 7f7e94c3c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7e900b0830 con 0x7f7e9015f030 2024-09-11T22:11:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.866+0000 7f7e94c3c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7e900aff00 con 0x7f7e900af440 2024-09-11T22:11:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.866+0000 7f7e8e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e9015f030 0x7f7e900b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.866+0000 7f7e8e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e9015f030 0x7f7e900b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48844/0 (socket says 172.21.15.50:48844) 2024-09-11T22:11:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.866+0000 7f7e8e59c640 1 -- 172.21.15.50:0/3494570966 learned_addr learned my addr 172.21.15.50:0/3494570966 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.866+0000 7f7e87fff640 1 --2- 172.21.15.50:0/3494570966 >> v2:172.21.15.77:3300/0 conn(0x7f7e900af440 0x7f7e9015f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.867+0000 7f7e8e59c640 1 -- 172.21.15.50:0/3494570966 >> v2:172.21.15.77:3300/0 conn(0x7f7e900af440 msgr2=0x7f7e9015f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.867+0000 7f7e8e59c640 1 --2- 172.21.15.50:0/3494570966 >> v2:172.21.15.77:3300/0 conn(0x7f7e900af440 0x7f7e9015f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.867+0000 7f7e8e59c640 1 -- 172.21.15.50:0/3494570966 >> v1:172.21.15.77:6789/0 conn(0x7f7e9015f950 legacy=0x7f7e9006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:08.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.867+0000 7f7e8e59c640 1 -- 172.21.15.50:0/3494570966 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e900b01e0 con 0x7f7e9015f030 2024-09-11T22:11:08.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.867+0000 7f7e87fff640 1 --2- 172.21.15.50:0/3494570966 >> v2:172.21.15.77:3300/0 conn(0x7f7e900af440 0x7f7e9015f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:08.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.867+0000 7f7e8e59c640 1 --2- 172.21.15.50:0/3494570966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9015f030 0x7f7e900b5280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7e900b4110 tx=0x7f7e8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c1ba9d18810df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:08.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.868+0000 7f7e8dd9b640 1 -- 172.21.15.50:0/3494570966 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e80037070 con 0x7f7e9015f030 2024-09-11T22:11:08.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.868+0000 7f7e8dd9b640 1 -- 172.21.15.50:0/3494570966 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e80032440 con 0x7f7e9015f030 2024-09-11T22:11:08.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.868+0000 7f7e8dd9b640 1 -- 172.21.15.50:0/3494570966 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e80032810 con 0x7f7e9015f030 2024-09-11T22:11:08.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.868+0000 7f7e94c3c640 1 -- 172.21.15.50:0/3494570966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9015f030 msgr2=0x7f7e900b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:08.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.868+0000 7f7e94c3c640 1 --2- 172.21.15.50:0/3494570966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9015f030 0x7f7e900b5280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7e900b4110 tx=0x7f7e8002a270 comp rx=0 tx=0).stop 2024-09-11T22:11:08.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.868+0000 7f7e94c3c640 1 -- 172.21.15.50:0/3494570966 shutdown_connections 2024-09-11T22:11:08.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.868+0000 7f7e94c3c640 1 --2- 172.21.15.50:0/3494570966 >> v2:172.21.15.77:3300/0 conn(0x7f7e900af440 0x7f7e9015f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.868+0000 7f7e94c3c640 1 --2- 172.21.15.50:0/3494570966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9015f030 0x7f7e900b5280 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.868+0000 7f7e94c3c640 1 -- 172.21.15.50:0/3494570966 >> 172.21.15.50:0/3494570966 conn(0x7f7e9006bb50 msgr2=0x7f7e9006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.868+0000 7f7e94c3c640 1 -- 172.21.15.50:0/3494570966 shutdown_connections 2024-09-11T22:11:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.868+0000 7f7e94c3c640 1 -- 172.21.15.50:0/3494570966 wait complete. 2024-09-11T22:11:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.869+0000 7f7e94c3c640 1 Processor -- start 2024-09-11T22:11:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.870+0000 7f7e94c3c640 1 -- start start 2024-09-11T22:11:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.870+0000 7f7e94c3c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e900af440 0x7f7e901f1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.870+0000 7f7e94c3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9015f030 0x7f7e901f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.870+0000 7f7e94c3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9015f950 0x7f7e901f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.870+0000 7f7e94c3c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9006e450 con 0x7f7e9015f030 2024-09-11T22:11:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.870+0000 7f7e94c3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7e900af8a0 con 0x7f7e9015f950 2024-09-11T22:11:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.870+0000 7f7e94c3c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7e9006e5d0 con 0x7f7e900af440 2024-09-11T22:11:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.870+0000 7f7e87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9015f030 0x7f7e901f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.870+0000 7f7e87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9015f030 0x7f7e901f4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48860/0 (socket says 172.21.15.50:48860) 2024-09-11T22:11:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.870+0000 7f7e87fff640 1 -- 172.21.15.50:0/877464505 learned_addr learned my addr 172.21.15.50:0/877464505 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.870+0000 7f7e8e59c640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e900af440 0x7f7e901f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.870+0000 7f7e8ed9d640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9015f950 0x7f7e901f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.871+0000 7f7e87fff640 1 -- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e900af440 msgr2=0x7f7e901f1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.871+0000 7f7e87fff640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e900af440 0x7f7e901f1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.871+0000 7f7e87fff640 1 -- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9015f950 msgr2=0x7f7e901f7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.871+0000 7f7e87fff640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9015f950 0x7f7e901f7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.871+0000 7f7e87fff640 1 -- 172.21.15.50:0/877464505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e901f53e0 con 0x7f7e9015f030 2024-09-11T22:11:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.871+0000 7f7e87fff640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9015f030 0x7f7e901f4ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800ebe0 tx=0x7f7e7800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.871+0000 7f7e86ffd640 1 -- 172.21.15.50:0/877464505 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78017070 con 0x7f7e9015f030 2024-09-11T22:11:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.871+0000 7f7e86ffd640 1 -- 172.21.15.50:0/877464505 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7800cc30 con 0x7f7e9015f030 2024-09-11T22:11:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.871+0000 7f7e86ffd640 1 -- 172.21.15.50:0/877464505 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78013470 con 0x7f7e9015f030 2024-09-11T22:11:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.871+0000 7f7e94c3c640 1 -- 172.21.15.50:0/877464505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e901f4410 con 0x7f7e9015f030 2024-09-11T22:11:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.871+0000 7f7e94c3c640 1 -- 172.21.15.50:0/877464505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e901f8740 con 0x7f7e9015f030 2024-09-11T22:11:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.872+0000 7f7e94c3c640 1 -- 172.21.15.50:0/877464505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e9015f410 con 0x7f7e9015f030 2024-09-11T22:11:08.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.872+0000 7f7e86ffd640 1 -- 172.21.15.50:0/877464505 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e7801a070 con 0x7f7e9015f030 2024-09-11T22:11:08.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.873+0000 7f7e86ffd640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7006be30 0x7f7e7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:08.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.873+0000 7f7e86ffd640 1 -- 172.21.15.50:0/877464505 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f7e7808a950 con 0x7f7e9015f030 2024-09-11T22:11:08.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.873+0000 7f7e8e59c640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7006be30 0x7f7e7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:08.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.874+0000 7f7e8e59c640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7006be30 0x7f7e7006e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7e80034000 tx=0x7f7e8002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:08.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:08.877+0000 7f7e86ffd640 1 -- 172.21.15.50:0/877464505 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e901f53e0 con 0x7f7e9015f030 2024-09-11T22:11:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.091+0000 7f7e94c3c640 1 -- 172.21.15.50:0/877464505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e9006c340 con 0x7f7e9015f030 2024-09-11T22:11:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.091+0000 7f7e86ffd640 1 -- 172.21.15.50:0/877464505 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f7e78059070 con 0x7f7e9015f030 2024-09-11T22:11:09.093 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:09.093 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":2,"btime":"2024-09-11T22:11:08:833375+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4087237334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4087237334},{"type":"v1","addr":"172.21.15.50:6834","nonce":4087237334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T22:11:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 2 2024-09-11T22:11:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.094+0000 7f7e94c3c640 1 -- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7006be30 msgr2=0x7f7e7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.094+0000 7f7e94c3c640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7006be30 0x7f7e7006e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7e80034000 tx=0x7f7e8002e000 comp rx=0 tx=0).stop 2024-09-11T22:11:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.094+0000 7f7e94c3c640 1 -- 172.21.15.50:0/877464505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9015f030 msgr2=0x7f7e901f4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.094+0000 7f7e94c3c640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9015f030 0x7f7e901f4ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800ebe0 tx=0x7f7e7800c520 comp rx=0 tx=0).stop 2024-09-11T22:11:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.094+0000 7f7e94c3c640 1 -- 172.21.15.50:0/877464505 shutdown_connections 2024-09-11T22:11:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.094+0000 7f7e94c3c640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7006be30 0x7f7e7006e2f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.094+0000 7f7e94c3c640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9015f950 0x7f7e901f7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.094+0000 7f7e94c3c640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9015f030 0x7f7e901f4ea0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.094+0000 7f7e94c3c640 1 --2- 172.21.15.50:0/877464505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e900af440 0x7f7e901f1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.094+0000 7f7e94c3c640 1 -- 172.21.15.50:0/877464505 >> 172.21.15.50:0/877464505 conn(0x7f7e9006bb50 msgr2=0x7f7e900b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.094+0000 7f7e94c3c640 1 -- 172.21.15.50:0/877464505 shutdown_connections 2024-09-11T22:11:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:09.094+0000 7f7e94c3c640 1 -- 172.21.15.50:0/877464505 wait complete. 2024-09-11T22:11:11.107 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:11:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.221+0000 7faa19133640 1 Processor -- start 2024-09-11T22:11:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.221+0000 7faa19133640 1 -- start start 2024-09-11T22:11:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa19133640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa14161fa0 0x7faa140b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa19133640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faa140b1600 0x7faa140cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa19133640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa140cf440 0x7faa1406bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa19133640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7faa140d1220 con 0x7faa140cf440 2024-09-11T22:11:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa19133640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7faa140d17e0 con 0x7faa140b1600 2024-09-11T22:11:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa19133640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faa140cfbd0 con 0x7faa14161fa0 2024-09-11T22:11:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa1359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa140cf440 0x7faa1406bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa1359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa140cf440 0x7faa1406bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48874/0 (socket says 172.21.15.50:48874) 2024-09-11T22:11:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa1359e640 1 -- 172.21.15.50:0/2388546934 learned_addr learned my addr 172.21.15.50:0/2388546934 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa1259c640 1 --2- 172.21.15.50:0/2388546934 >> v2:172.21.15.77:3300/0 conn(0x7faa140b1600 0x7faa140cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa12d9d640 1 --2- 172.21.15.50:0/2388546934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa14161fa0 0x7faa140b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa1359e640 1 -- 172.21.15.50:0/2388546934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa14161fa0 msgr2=0x7faa140b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa1359e640 1 --2- 172.21.15.50:0/2388546934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa14161fa0 0x7faa140b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa1359e640 1 -- 172.21.15.50:0/2388546934 >> v2:172.21.15.77:3300/0 conn(0x7faa140b1600 msgr2=0x7faa140cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa1359e640 1 --2- 172.21.15.50:0/2388546934 >> v2:172.21.15.77:3300/0 conn(0x7faa140b1600 0x7faa140cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa1359e640 1 -- 172.21.15.50:0/2388546934 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa140cfeb0 con 0x7faa140cf440 2024-09-11T22:11:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.222+0000 7faa1259c640 1 --2- 172.21.15.50:0/2388546934 >> v2:172.21.15.77:3300/0 conn(0x7faa140b1600 0x7faa140cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.223+0000 7faa1359e640 1 --2- 172.21.15.50:0/2388546934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cf440 0x7faa1406bb50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faa140b8810 tx=0x7faa0c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445dda6449e399a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.223+0000 7faa11d9b640 1 -- 172.21.15.50:0/2388546934 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c036070 con 0x7faa140cf440 2024-09-11T22:11:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.223+0000 7faa11d9b640 1 -- 172.21.15.50:0/2388546934 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa0c031600 con 0x7faa140cf440 2024-09-11T22:11:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.223+0000 7faa11d9b640 1 -- 172.21.15.50:0/2388546934 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0319d0 con 0x7faa140cf440 2024-09-11T22:11:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.224+0000 7faa19133640 1 -- 172.21.15.50:0/2388546934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cf440 msgr2=0x7faa1406bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.224+0000 7faa19133640 1 --2- 172.21.15.50:0/2388546934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cf440 0x7faa1406bb50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faa140b8810 tx=0x7faa0c02a6a0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.224+0000 7faa19133640 1 -- 172.21.15.50:0/2388546934 shutdown_connections 2024-09-11T22:11:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.224+0000 7faa19133640 1 --2- 172.21.15.50:0/2388546934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cf440 0x7faa1406bb50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.224+0000 7faa19133640 1 --2- 172.21.15.50:0/2388546934 >> v2:172.21.15.77:3300/0 conn(0x7faa140b1600 0x7faa140cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.224+0000 7faa19133640 1 --2- 172.21.15.50:0/2388546934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa14161fa0 0x7faa140b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.224+0000 7faa19133640 1 -- 172.21.15.50:0/2388546934 >> 172.21.15.50:0/2388546934 conn(0x7faa1409ba50 msgr2=0x7faa140b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.224+0000 7faa19133640 1 -- 172.21.15.50:0/2388546934 shutdown_connections 2024-09-11T22:11:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.224+0000 7faa19133640 1 -- 172.21.15.50:0/2388546934 wait complete. 2024-09-11T22:11:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.226+0000 7faa19133640 1 Processor -- start 2024-09-11T22:11:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.226+0000 7faa19133640 1 -- start start 2024-09-11T22:11:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.226+0000 7faa19133640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa140b1600 0x7faa14154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.226+0000 7faa19133640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cf440 0x7faa141f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.226+0000 7faa19133640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa14161fa0 0x7faa1415fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.226+0000 7faa19133640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faa14162380 con 0x7faa140cf440 2024-09-11T22:11:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.226+0000 7faa19133640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa140cf8f0 con 0x7faa14161fa0 2024-09-11T22:11:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.226+0000 7faa19133640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faa14162500 con 0x7faa140b1600 2024-09-11T22:11:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.226+0000 7faa1259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cf440 0x7faa141f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7faa1259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cf440 0x7faa141f7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48878/0 (socket says 172.21.15.50:48878) 2024-09-11T22:11:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7faa1259c640 1 -- 172.21.15.50:0/3432078718 learned_addr learned my addr 172.21.15.50:0/3432078718 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7faa12d9d640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa140b1600 0x7faa14154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7faa1359e640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa14161fa0 0x7faa1415fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7faa1259c640 1 -- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa140b1600 msgr2=0x7faa14154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7faa1259c640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa140b1600 0x7faa14154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7faa1259c640 1 -- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa14161fa0 msgr2=0x7faa1415fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7faa1259c640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa14161fa0 0x7faa1415fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7faa1259c640 1 -- 172.21.15.50:0/3432078718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1415c3d0 con 0x7faa140cf440 2024-09-11T22:11:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7faa1259c640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cf440 0x7faa141f7b70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faa0800c820 tx=0x7faa0800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7fa9fb7fe640 1 -- 172.21.15.50:0/3432078718 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08004230 con 0x7faa140cf440 2024-09-11T22:11:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7fa9fb7fe640 1 -- 172.21.15.50:0/3432078718 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa080043d0 con 0x7faa140cf440 2024-09-11T22:11:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7fa9fb7fe640 1 -- 172.21.15.50:0/3432078718 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08007a70 con 0x7faa140cf440 2024-09-11T22:11:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7faa19133640 1 -- 172.21.15.50:0/3432078718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa141f8610 con 0x7faa140cf440 2024-09-11T22:11:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.227+0000 7faa19133640 1 -- 172.21.15.50:0/3432078718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa1415c670 con 0x7faa140cf440 2024-09-11T22:11:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.228+0000 7faa19133640 1 -- 172.21.15.50:0/3432078718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa140d1c70 con 0x7faa140cf440 2024-09-11T22:11:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.229+0000 7fa9fb7fe640 1 -- 172.21.15.50:0/3432078718 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa08007c10 con 0x7faa140cf440 2024-09-11T22:11:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.229+0000 7fa9fb7fe640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa0006be60 0x7faa0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.229+0000 7fa9fb7fe640 1 -- 172.21.15.50:0/3432078718 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7faa0808aa80 con 0x7faa140cf440 2024-09-11T22:11:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.229+0000 7faa12d9d640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa0006be60 0x7faa0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.230+0000 7faa12d9d640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa0006be60 0x7faa0006e320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa04007920 tx=0x7faa04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.234+0000 7fa9fb7fe640 1 -- 172.21.15.50:0/3432078718 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faa08015020 con 0x7faa140cf440 2024-09-11T22:11:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.446+0000 7faa19133640 1 -- 172.21.15.50:0/3432078718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa140a0830 con 0x7faa140cf440 2024-09-11T22:11:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.446+0000 7fa9fb7fe640 1 -- 172.21.15.50:0/3432078718 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3903 (secure 0 0 0) 0x7faa08059130 con 0x7faa140cf440 2024-09-11T22:11:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:11.447 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"btime":"2024-09-11T22:11:09:834343+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2971042772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2971042772},{"type":"v1","addr":"172.21.15.77:6837","nonce":2971042772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/293208439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":293208439},{"type":"v1","addr":"172.21.15.77:6835","nonce":293208439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4087237334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4087237334},{"type":"v1","addr":"172.21.15.50:6834","nonce":4087237334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2305531878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2305531878},{"type":"v1","addr":"172.21.15.50:6835","nonce":2305531878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-11T22:11:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2024-09-11T22:11:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.448+0000 7faa19133640 1 -- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa0006be60 msgr2=0x7faa0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.448+0000 7faa19133640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa0006be60 0x7faa0006e320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa04007920 tx=0x7faa04008040 comp rx=0 tx=0).stop 2024-09-11T22:11:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.448+0000 7faa19133640 1 -- 172.21.15.50:0/3432078718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cf440 msgr2=0x7faa141f7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.448+0000 7faa19133640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cf440 0x7faa141f7b70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faa0800c820 tx=0x7faa0800cce0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.448+0000 7faa19133640 1 -- 172.21.15.50:0/3432078718 shutdown_connections 2024-09-11T22:11:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.448+0000 7faa19133640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa0006be60 0x7faa0006e320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.448+0000 7faa19133640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa14161fa0 0x7faa1415fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.448+0000 7faa19133640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa140cf440 0x7faa141f7b70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.448+0000 7faa19133640 1 --2- 172.21.15.50:0/3432078718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa140b1600 0x7faa14154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.448+0000 7faa19133640 1 -- 172.21.15.50:0/3432078718 >> 172.21.15.50:0/3432078718 conn(0x7faa1409ba50 msgr2=0x7faa140af930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.448+0000 7faa19133640 1 -- 172.21.15.50:0/3432078718 shutdown_connections 2024-09-11T22:11:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.448+0000 7faa19133640 1 -- 172.21.15.50:0/3432078718 wait complete. 2024-09-11T22:11:11.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:11:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.561+0000 7fa1b33e8640 1 Processor -- start 2024-09-11T22:11:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.562+0000 7fa1b33e8640 1 -- start start 2024-09-11T22:11:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.562+0000 7fa1b33e8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1ac06bb50 0x7fa1ac15f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.562+0000 7fa1b33e8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1ac0b6d90 0x7fa1ac0b7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.563+0000 7fa1b33e8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1ac0b5fd0 con 0x7fa1ac15e9b0 2024-09-11T22:11:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.563+0000 7fa1b33e8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa1ac0b6900 con 0x7fa1ac06bb50 2024-09-11T22:11:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.563+0000 7fa1b33e8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa1ac0b62b0 con 0x7fa1ac0b6d90 2024-09-11T22:11:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.563+0000 7fa1b0983640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1ac06bb50 0x7fa1ac15f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.563+0000 7fa1b0983640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1ac06bb50 0x7fa1ac15f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48882/0 (socket says 172.21.15.50:48882) 2024-09-11T22:11:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.563+0000 7fa1b0983640 1 -- 172.21.15.50:0/2216738644 learned_addr learned my addr 172.21.15.50:0/2216738644 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.563+0000 7fa1b1985640 1 --2- 172.21.15.50:0/2216738644 >> v2:172.21.15.77:3300/0 conn(0x7fa1ac0b6d90 0x7fa1ac0b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.563+0000 7fa1b0983640 1 -- 172.21.15.50:0/2216738644 >> v2:172.21.15.77:3300/0 conn(0x7fa1ac0b6d90 msgr2=0x7fa1ac0b7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.563+0000 7fa1b0983640 1 --2- 172.21.15.50:0/2216738644 >> v2:172.21.15.77:3300/0 conn(0x7fa1ac0b6d90 0x7fa1ac0b7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.563+0000 7fa1b0983640 1 -- 172.21.15.50:0/2216738644 >> v1:172.21.15.77:6789/0 conn(0x7fa1ac15e9b0 legacy=0x7fa1ac0af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.563+0000 7fa1b0983640 1 -- 172.21.15.50:0/2216738644 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ac0b6590 con 0x7fa1ac06bb50 2024-09-11T22:11:11.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.563+0000 7fa1b1985640 1 --2- 172.21.15.50:0/2216738644 >> v2:172.21.15.77:3300/0 conn(0x7fa1ac0b6d90 0x7fa1ac0b7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.564+0000 7fa1b0983640 1 --2- 172.21.15.50:0/2216738644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1ac06bb50 0x7fa1ac15f820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac1633f0 tx=0x7fa1a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b571b47ba258193 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.564+0000 7fa1abfff640 1 -- 172.21.15.50:0/2216738644 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0037070 con 0x7fa1ac06bb50 2024-09-11T22:11:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.564+0000 7fa1abfff640 1 -- 172.21.15.50:0/2216738644 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a0032440 con 0x7fa1ac06bb50 2024-09-11T22:11:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.564+0000 7fa1abfff640 1 -- 172.21.15.50:0/2216738644 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0032810 con 0x7fa1ac06bb50 2024-09-11T22:11:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.564+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2216738644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1ac06bb50 msgr2=0x7fa1ac15f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.564+0000 7fa1b33e8640 1 --2- 172.21.15.50:0/2216738644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1ac06bb50 0x7fa1ac15f820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac1633f0 tx=0x7fa1a002a270 comp rx=0 tx=0).stop 2024-09-11T22:11:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.564+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2216738644 shutdown_connections 2024-09-11T22:11:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.564+0000 7fa1b33e8640 1 --2- 172.21.15.50:0/2216738644 >> v2:172.21.15.77:3300/0 conn(0x7fa1ac0b6d90 0x7fa1ac0b7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.564+0000 7fa1b33e8640 1 --2- 172.21.15.50:0/2216738644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1ac06bb50 0x7fa1ac15f820 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.564+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2216738644 >> 172.21.15.50:0/2216738644 conn(0x7fa1ac0b7940 msgr2=0x7fa1ac0b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.565+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2216738644 shutdown_connections 2024-09-11T22:11:11.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.565+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2216738644 wait complete. 2024-09-11T22:11:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.566+0000 7fa1b33e8640 1 Processor -- start 2024-09-11T22:11:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.566+0000 7fa1b33e8640 1 -- start start 2024-09-11T22:11:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.566+0000 7fa1b33e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac06bb50 0x7fa1ac160e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.566+0000 7fa1b33e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1ac0b6d90 0x7fa1ac161340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.566+0000 7fa1b33e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1ac0cde30 0x7fa1ac0ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.566+0000 7fa1b33e8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac06d310 con 0x7fa1ac0cde30 2024-09-11T22:11:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.566+0000 7fa1b33e8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac15feb0 con 0x7fa1ac06bb50 2024-09-11T22:11:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.566+0000 7fa1b33e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa1ac06d490 con 0x7fa1ac0b6d90 2024-09-11T22:11:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1b1985640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1ac0cde30 0x7fa1ac0ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1b1985640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1ac0cde30 0x7fa1ac0ce2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48888/0 (socket says 172.21.15.50:48888) 2024-09-11T22:11:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1b1985640 1 -- 172.21.15.50:0/2758129703 learned_addr learned my addr 172.21.15.50:0/2758129703 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1b1184640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac06bb50 0x7fa1ac160e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1b0983640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1ac0b6d90 0x7fa1ac161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1b1985640 1 -- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1ac0b6d90 msgr2=0x7fa1ac161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1b1985640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1ac0b6d90 0x7fa1ac161340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1b1985640 1 -- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac06bb50 msgr2=0x7fa1ac160e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1b1985640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac06bb50 0x7fa1ac160e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1b1985640 1 -- 172.21.15.50:0/2758129703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ac1619a0 con 0x7fa1ac0cde30 2024-09-11T22:11:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1b1985640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1ac0cde30 0x7fa1ac0ce2c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400e7e0 tx=0x7fa1a400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1a9ffb640 1 -- 172.21.15.50:0/2758129703 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400f040 con 0x7fa1ac0cde30 2024-09-11T22:11:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1a9ffb640 1 -- 172.21.15.50:0/2758129703 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a4004030 con 0x7fa1ac0cde30 2024-09-11T22:11:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1a9ffb640 1 -- 172.21.15.50:0/2758129703 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40043e0 con 0x7fa1ac0cde30 2024-09-11T22:11:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2758129703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1ac161c80 con 0x7fa1ac0cde30 2024-09-11T22:11:11.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.567+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2758129703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1ac146430 con 0x7fa1ac0cde30 2024-09-11T22:11:11.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.568+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2758129703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1ac0b5730 con 0x7fa1ac0cde30 2024-09-11T22:11:11.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.569+0000 7fa1a9ffb640 1 -- 172.21.15.50:0/2758129703 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1a400c6d0 con 0x7fa1ac0cde30 2024-09-11T22:11:11.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.569+0000 7fa1a9ffb640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa19806be60 0x7fa19806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.569+0000 7fa1a9ffb640 1 -- 172.21.15.50:0/2758129703 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa1a408a780 con 0x7fa1ac0cde30 2024-09-11T22:11:11.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.569+0000 7fa1b1184640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa19806be60 0x7fa19806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.570+0000 7fa1b1184640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa19806be60 0x7fa19806e320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0012e0 tx=0x7fa19c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.573+0000 7fa1a9ffb640 1 -- 172.21.15.50:0/2758129703 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1ac0b5730 con 0x7fa1ac0cde30 2024-09-11T22:11:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.752+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2758129703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa1ac15f820 con 0x7fa1ac0cde30 2024-09-11T22:11:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.752+0000 7fa1a9ffb640 1 -- 172.21.15.50:0/2758129703 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fa1a4017020 con 0x7fa1ac0cde30 2024-09-11T22:11:11.753 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:11.753 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:11:11.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:11.753 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:11:11.753 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:11:11.753 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:11.753 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:11:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.754+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa19806be60 msgr2=0x7fa19806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.754+0000 7fa1b33e8640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa19806be60 0x7fa19806e320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0012e0 tx=0x7fa19c009040 comp rx=0 tx=0).stop 2024-09-11T22:11:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.754+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2758129703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1ac0cde30 msgr2=0x7fa1ac0ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.754+0000 7fa1b33e8640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1ac0cde30 0x7fa1ac0ce2c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400e7e0 tx=0x7fa1a400eca0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.754+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2758129703 shutdown_connections 2024-09-11T22:11:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.754+0000 7fa1b33e8640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa19806be60 0x7fa19806e320 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.754+0000 7fa1b33e8640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1ac0b6d90 0x7fa1ac161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.754+0000 7fa1b33e8640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1ac0cde30 0x7fa1ac0ce2c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.754+0000 7fa1b33e8640 1 --2- 172.21.15.50:0/2758129703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac06bb50 0x7fa1ac160e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.754+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2758129703 >> 172.21.15.50:0/2758129703 conn(0x7fa1ac0b7940 msgr2=0x7fa1ac15eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.754+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2758129703 shutdown_connections 2024-09-11T22:11:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.754+0000 7fa1b33e8640 1 -- 172.21.15.50:0/2758129703 wait complete. 2024-09-11T22:11:11.765 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:11:11.765 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:11:11.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.871+0000 7f4d3c942640 1 Processor -- start 2024-09-11T22:11:11.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.871+0000 7f4d3c942640 1 -- start start 2024-09-11T22:11:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d3c942640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d38161d30 0x7f4d380cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d3c942640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4d380b78f0 0x7f4d38162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d3c942640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d381632e0 con 0x7f4d380d11d0 2024-09-11T22:11:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d3c942640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4d380d3450 con 0x7f4d38161d30 2024-09-11T22:11:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d3c942640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4d38162110 con 0x7f4d380b78f0 2024-09-11T22:11:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d3659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d38161d30 0x7f4d380cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d3659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d38161d30 0x7f4d380cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48902/0 (socket says 172.21.15.50:48902) 2024-09-11T22:11:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d3659c640 1 -- 172.21.15.50:0/3792479571 learned_addr learned my addr 172.21.15.50:0/3792479571 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d35d9b640 1 --2- 172.21.15.50:0/3792479571 >> v2:172.21.15.77:3300/0 conn(0x7f4d380b78f0 0x7f4d38162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d3659c640 1 -- 172.21.15.50:0/3792479571 >> v2:172.21.15.77:3300/0 conn(0x7f4d380b78f0 msgr2=0x7f4d38162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d3659c640 1 --2- 172.21.15.50:0/3792479571 >> v2:172.21.15.77:3300/0 conn(0x7f4d380b78f0 0x7f4d38162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d3659c640 1 -- 172.21.15.50:0/3792479571 >> v1:172.21.15.77:6789/0 conn(0x7f4d380d11d0 legacy=0x7f4d380d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d3659c640 1 -- 172.21.15.50:0/3792479571 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d380cfd70 con 0x7f4d38161d30 2024-09-11T22:11:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.872+0000 7f4d35d9b640 1 --2- 172.21.15.50:0/3792479571 >> v2:172.21.15.77:3300/0 conn(0x7f4d380b78f0 0x7f4d38162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.873+0000 7f4d3659c640 1 --2- 172.21.15.50:0/3792479571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d38161d30 0x7f4d380cf790 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4d38068730 tx=0x7f4d2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7c406466df5e94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.873+0000 7f4d3559a640 1 -- 172.21.15.50:0/3792479571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28037070 con 0x7f4d38161d30 2024-09-11T22:11:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.873+0000 7f4d3559a640 1 -- 172.21.15.50:0/3792479571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d28032440 con 0x7f4d38161d30 2024-09-11T22:11:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.873+0000 7f4d3559a640 1 -- 172.21.15.50:0/3792479571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28032810 con 0x7f4d38161d30 2024-09-11T22:11:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.874+0000 7f4d3c942640 1 -- 172.21.15.50:0/3792479571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d38161d30 msgr2=0x7f4d380cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.874+0000 7f4d3c942640 1 --2- 172.21.15.50:0/3792479571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d38161d30 0x7f4d380cf790 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4d38068730 tx=0x7f4d2802a270 comp rx=0 tx=0).stop 2024-09-11T22:11:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.874+0000 7f4d3c942640 1 -- 172.21.15.50:0/3792479571 shutdown_connections 2024-09-11T22:11:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.874+0000 7f4d3c942640 1 --2- 172.21.15.50:0/3792479571 >> v2:172.21.15.77:3300/0 conn(0x7f4d380b78f0 0x7f4d38162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.874+0000 7f4d3c942640 1 --2- 172.21.15.50:0/3792479571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d38161d30 0x7f4d380cf790 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.874+0000 7f4d3c942640 1 -- 172.21.15.50:0/3792479571 >> 172.21.15.50:0/3792479571 conn(0x7f4d380727a0 msgr2=0x7f4d380679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.874+0000 7f4d3c942640 1 -- 172.21.15.50:0/3792479571 shutdown_connections 2024-09-11T22:11:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.874+0000 7f4d3c942640 1 -- 172.21.15.50:0/3792479571 wait complete. 2024-09-11T22:11:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.875+0000 7f4d3c942640 1 Processor -- start 2024-09-11T22:11:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.875+0000 7f4d3c942640 1 -- start start 2024-09-11T22:11:11.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3c942640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d380b78f0 0x7f4d3815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3c942640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d380d11d0 0x7f4d380b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3c942640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38161d30 0x7f4d381f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3c942640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d380d30e0 con 0x7f4d380b78f0 2024-09-11T22:11:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3c942640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d380d2e00 con 0x7f4d38161d30 2024-09-11T22:11:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3c942640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d380b7d60 con 0x7f4d380d11d0 2024-09-11T22:11:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d380b78f0 0x7f4d3815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d380b78f0 0x7f4d3815ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48914/0 (socket says 172.21.15.50:48914) 2024-09-11T22:11:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3659c640 1 -- 172.21.15.50:0/2354227323 learned_addr learned my addr 172.21.15.50:0/2354227323 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d36d9d640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38161d30 0x7f4d381f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d35d9b640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d380d11d0 0x7f4d380b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3659c640 1 -- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d380d11d0 msgr2=0x7f4d380b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3659c640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d380d11d0 0x7f4d380b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3659c640 1 -- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38161d30 msgr2=0x7f4d381f8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3659c640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38161d30 0x7f4d381f8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3659c640 1 -- 172.21.15.50:0/2354227323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d380b5b50 con 0x7f4d380b78f0 2024-09-11T22:11:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d35d9b640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d380d11d0 0x7f4d380b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d3659c640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d380b78f0 0x7f4d3815ad30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4d2802a2b0 tx=0x7f4d280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.876+0000 7f4d26ffd640 1 -- 172.21.15.50:0/2354227323 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28041020 con 0x7f4d380b78f0 2024-09-11T22:11:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.877+0000 7f4d26ffd640 1 -- 172.21.15.50:0/2354227323 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d280306c0 con 0x7f4d380b78f0 2024-09-11T22:11:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.877+0000 7f4d26ffd640 1 -- 172.21.15.50:0/2354227323 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28037040 con 0x7f4d380b78f0 2024-09-11T22:11:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.877+0000 7f4d3c942640 1 -- 172.21.15.50:0/2354227323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d380b5e30 con 0x7f4d380b78f0 2024-09-11T22:11:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.877+0000 7f4d3c942640 1 -- 172.21.15.50:0/2354227323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d380b63f0 con 0x7f4d380b78f0 2024-09-11T22:11:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.878+0000 7f4d3c942640 1 -- 172.21.15.50:0/2354227323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d380b6bf0 con 0x7f4d380b78f0 2024-09-11T22:11:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.878+0000 7f4d26ffd640 1 -- 172.21.15.50:0/2354227323 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d28044020 con 0x7f4d380b78f0 2024-09-11T22:11:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.879+0000 7f4d26ffd640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d1806be30 0x7f4d1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.879+0000 7f4d26ffd640 1 -- 172.21.15.50:0/2354227323 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4d280ab3f0 con 0x7f4d380b78f0 2024-09-11T22:11:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.879+0000 7f4d35d9b640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d1806be30 0x7f4d1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.879+0000 7f4d35d9b640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d1806be30 0x7f4d1806e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c006fd0 tx=0x7f4d2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:11.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:11.883+0000 7f4d26ffd640 1 -- 172.21.15.50:0/2354227323 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d2804b030 con 0x7f4d380b78f0 2024-09-11T22:11:11.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:11:11.962 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:11:12.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.059+0000 7f4d3c942640 1 -- 172.21.15.50:0/2354227323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4d38162da0 con 0x7f4d380b78f0 2024-09-11T22:11:12.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.845+0000 7f4d26ffd640 1 -- 172.21.15.50:0/2354227323 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f4d2807a050 con 0x7f4d380b78f0 2024-09-11T22:11:12.846 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:11:12.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.848+0000 7f4d3c942640 1 -- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d1806be30 msgr2=0x7f4d1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:12.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.848+0000 7f4d3c942640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d1806be30 0x7f4d1806e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c006fd0 tx=0x7f4d2c008040 comp rx=0 tx=0).stop 2024-09-11T22:11:12.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.848+0000 7f4d3c942640 1 -- 172.21.15.50:0/2354227323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d380b78f0 msgr2=0x7f4d3815ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:12.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.848+0000 7f4d3c942640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d380b78f0 0x7f4d3815ad30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4d2802a2b0 tx=0x7f4d280046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:12.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.849+0000 7f4d3c942640 1 -- 172.21.15.50:0/2354227323 shutdown_connections 2024-09-11T22:11:12.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.849+0000 7f4d3c942640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d1806be30 0x7f4d1806e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:12.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.849+0000 7f4d3c942640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d380d11d0 0x7f4d380b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:12.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.849+0000 7f4d3c942640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d38161d30 0x7f4d381f8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:12.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.849+0000 7f4d3c942640 1 --2- 172.21.15.50:0/2354227323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d380b78f0 0x7f4d3815ad30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:12.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.849+0000 7f4d3c942640 1 -- 172.21.15.50:0/2354227323 >> 172.21.15.50:0/2354227323 conn(0x7f4d380727a0 msgr2=0x7f4d380b9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:12.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.851+0000 7f4d3c942640 1 -- 172.21.15.50:0/2354227323 shutdown_connections 2024-09-11T22:11:12.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.851+0000 7f4d3c942640 1 -- 172.21.15.50:0/2354227323 wait complete. 2024-09-11T22:11:12.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:11:12.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.983+0000 7fde05eaf640 1 Processor -- start 2024-09-11T22:11:12.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.983+0000 7fde05eaf640 1 -- start start 2024-09-11T22:11:12.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.984+0000 7fde05eaf640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fde000d1c90 0x7fde000b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:12.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.984+0000 7fde05eaf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde00163080 con 0x7fde0015e8e0 2024-09-11T22:11:12.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.984+0000 7fde05eaf640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde000d2d20 con 0x7fde00162350 2024-09-11T22:11:12.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.984+0000 7fde05eaf640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fde0015ecc0 con 0x7fde000d1c90 2024-09-11T22:11:12.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.984+0000 7fddff7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fde0015e8e0 0x7fde000d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57906/0 (socket says 172.21.15.50:57906) 2024-09-11T22:11:12.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.984+0000 7fddff7fe640 1 -- 172.21.15.50:0/3004675642 learned_addr learned my addr 172.21.15.50:0/3004675642 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:12.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.984+0000 7fddfeffd640 1 --2- 172.21.15.50:0/3004675642 >> v2:172.21.15.77:3300/0 conn(0x7fde000d1c90 0x7fde000b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:12.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.984+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353822622 0 0) 0x7fde00163080 con 0x7fde0015e8e0 2024-09-11T22:11:12.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.984+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdde8003520 con 0x7fde0015e8e0 2024-09-11T22:11:12.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.984+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4204858077 0 0) 0x7fdde8003520 con 0x7fde0015e8e0 2024-09-11T22:11:12.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.984+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 >> v2:172.21.15.77:3300/0 conn(0x7fde000d1c90 msgr2=0x7fde000b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:12.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.984+0000 7fddfe7fc640 1 --2- 172.21.15.50:0/3004675642 >> v2:172.21.15.77:3300/0 conn(0x7fde000d1c90 0x7fde000b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:12.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.984+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 >> v1:172.21.15.77:6789/0 conn(0x7fde00162350 legacy=0x7fde001627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:12.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde000d3000 con 0x7fde0015e8e0 2024-09-11T22:11:12.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fddf0001670 con 0x7fde0015e8e0 2024-09-11T22:11:12.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 >> v1:172.21.15.50:6789/0 conn(0x7fde0015e8e0 legacy=0x7fde000d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:12.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfe7fc640 1 --2- 172.21.15.50:0/3004675642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde80039b0 0x7fdde8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:12.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfe7fc640 1 --2- 172.21.15.50:0/3004675642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde8004800 0x7fdde8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:12.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfe7fc640 1 --2- 172.21.15.50:0/3004675642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde80051c0 0x7fdde800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:12.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdde800c040 con 0x7fdde80051c0 2024-09-11T22:11:12.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdde800c1f0 con 0x7fdde8004800 2024-09-11T22:11:12.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdde800c3f0 con 0x7fdde80039b0 2024-09-11T22:11:12.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfeffd640 1 --2- 172.21.15.50:0/3004675642 >> v2:172.21.15.77:3300/0 conn(0x7fde000d1c90 0x7fde000b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:12.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfffff640 1 --2- 172.21.15.50:0/3004675642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde80051c0 0x7fdde800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:12.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddff7fe640 1 --2- 172.21.15.50:0/3004675642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde80039b0 0x7fdde8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:12.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfeffd640 1 --2- 172.21.15.50:0/3004675642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde8004800 0x7fdde8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:12.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfffff640 1 -- 172.21.15.50:0/3004675642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde80039b0 msgr2=0x7fdde8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:12.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfffff640 1 --2- 172.21.15.50:0/3004675642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde80039b0 0x7fdde8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:12.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfffff640 1 -- 172.21.15.50:0/3004675642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde8004800 msgr2=0x7fdde8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:12.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfffff640 1 --2- 172.21.15.50:0/3004675642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde8004800 0x7fdde8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:12.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.985+0000 7fddfffff640 1 -- 172.21.15.50:0/3004675642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde8003520 con 0x7fdde80051c0 2024-09-11T22:11:12.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.986+0000 7fddfffff640 1 -- 172.21.15.50:0/3004675642 reap_dead start 2024-09-11T22:11:12.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.986+0000 7fddfffff640 1 --2- 172.21.15.50:0/3004675642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde80051c0 0x7fdde800b9c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fddf8001e50 tx=0x7fdde8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a061fd1980d9e793 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:12.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.986+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8001a70 con 0x7fdde80051c0 2024-09-11T22:11:12.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.986+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf8003970 con 0x7fdde80051c0 2024-09-11T22:11:12.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.986+0000 7fddfe7fc640 1 -- 172.21.15.50:0/3004675642 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8003d60 con 0x7fdde80051c0 2024-09-11T22:11:12.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.986+0000 7fde05eaf640 1 -- 172.21.15.50:0/3004675642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde80051c0 msgr2=0x7fdde800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:12.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.986+0000 7fde05eaf640 1 --2- 172.21.15.50:0/3004675642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde80051c0 0x7fdde800b9c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fddf8001e50 tx=0x7fdde8005830 comp rx=0 tx=0).stop 2024-09-11T22:11:12.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.986+0000 7fde05eaf640 1 -- 172.21.15.50:0/3004675642 shutdown_connections 2024-09-11T22:11:12.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.986+0000 7fde05eaf640 1 --2- 172.21.15.50:0/3004675642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdde80051c0 0x7fdde800b9c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:12.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.986+0000 7fde05eaf640 1 -- 172.21.15.50:0/3004675642 >> 172.21.15.50:0/3004675642 conn(0x7fde00067ba0 msgr2=0x7fde00067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:12.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.986+0000 7fde05eaf640 1 -- 172.21.15.50:0/3004675642 shutdown_connections 2024-09-11T22:11:12.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.986+0000 7fde05eaf640 1 -- 172.21.15.50:0/3004675642 wait complete. 2024-09-11T22:11:12.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.988+0000 7fde05eaf640 1 Processor -- start 2024-09-11T22:11:12.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.988+0000 7fde05eaf640 1 -- start start 2024-09-11T22:11:12.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fde05eaf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde80051c0 0x7fde0015fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:12.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fde05eaf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde000ce930 0x7fde00160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:12.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fde05eaf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde00160790 0x7fde00159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:12.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fde05eaf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fde000b7c10 con 0x7fde00160790 2024-09-11T22:11:12.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fde05eaf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fde000b7a90 con 0x7fde000ce930 2024-09-11T22:11:12.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fde05eaf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fde000d2ad0 con 0x7fdde80051c0 2024-09-11T22:11:12.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fddfffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde00160790 0x7fde00159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:12.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fddfffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde00160790 0x7fde00159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48936/0 (socket says 172.21.15.50:48936) 2024-09-11T22:11:12.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fddfffff640 1 -- 172.21.15.50:0/2357061738 learned_addr learned my addr 172.21.15.50:0/2357061738 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:12.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fddfeffd640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde000ce930 0x7fde00160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:12.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fddff7fe640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde80051c0 0x7fde0015fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:12.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fddfffff640 1 -- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde80051c0 msgr2=0x7fde0015fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:12.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fddfffff640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde80051c0 0x7fde0015fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:12.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fddfffff640 1 -- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde000ce930 msgr2=0x7fde00160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:12.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fddfffff640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde000ce930 0x7fde00160250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:12.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fddfffff640 1 -- 172.21.15.50:0/2357061738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde000cc830 con 0x7fde00160790 2024-09-11T22:11:12.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fddfffff640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde00160790 0x7fde00159ff0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fddf802a920 tx=0x7fddf80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:12.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fdde7fff640 1 -- 172.21.15.50:0/2357061738 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8007db0 con 0x7fde00160790 2024-09-11T22:11:12.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fdde7fff640 1 -- 172.21.15.50:0/2357061738 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf8006b50 con 0x7fde00160790 2024-09-11T22:11:12.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.989+0000 7fde05eaf640 1 -- 172.21.15.50:0/2357061738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde000ccad0 con 0x7fde00160790 2024-09-11T22:11:12.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.990+0000 7fdde7fff640 1 -- 172.21.15.50:0/2357061738 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8001a70 con 0x7fde00160790 2024-09-11T22:11:12.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.990+0000 7fde05eaf640 1 -- 172.21.15.50:0/2357061738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde000cd090 con 0x7fde00160790 2024-09-11T22:11:12.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.991+0000 7fde05eaf640 1 -- 172.21.15.50:0/2357061738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde000d1580 con 0x7fde00160790 2024-09-11T22:11:12.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.991+0000 7fdde7fff640 1 -- 172.21.15.50:0/2357061738 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fddf8007030 con 0x7fde00160790 2024-09-11T22:11:12.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.992+0000 7fdde7fff640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddec06be60 0x7fddec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:12.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.992+0000 7fdde7fff640 1 -- 172.21.15.50:0/2357061738 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fddf80aa2f0 con 0x7fde00160790 2024-09-11T22:11:12.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.992+0000 7fddff7fe640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddec06be60 0x7fddec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:12.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.992+0000 7fddff7fe640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddec06be60 0x7fddec06e320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fddf0000f60 tx=0x7fddf0000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:12.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:12.996+0000 7fdde7fff640 1 -- 172.21.15.50:0/2357061738 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fddf8078750 con 0x7fde00160790 2024-09-11T22:11:13.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.171+0000 7fde05eaf640 1 -- 172.21.15.50:0/2357061738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fde000ba770 con 0x7fde00160790 2024-09-11T22:11:13.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.850+0000 7fdde7fff640 1 -- 172.21.15.50:0/2357061738 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7fddf80aa0d0 con 0x7fde00160790 2024-09-11T22:11:13.851 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:11:13.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.854+0000 7fde05eaf640 1 -- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddec06be60 msgr2=0x7fddec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:13.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.854+0000 7fde05eaf640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddec06be60 0x7fddec06e320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fddf0000f60 tx=0x7fddf0000ed0 comp rx=0 tx=0).stop 2024-09-11T22:11:13.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.854+0000 7fde05eaf640 1 -- 172.21.15.50:0/2357061738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde00160790 msgr2=0x7fde00159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:13.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.854+0000 7fde05eaf640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde00160790 0x7fde00159ff0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fddf802a920 tx=0x7fddf80014a0 comp rx=0 tx=0).stop 2024-09-11T22:11:13.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.854+0000 7fde05eaf640 1 -- 172.21.15.50:0/2357061738 shutdown_connections 2024-09-11T22:11:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.854+0000 7fde05eaf640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddec06be60 0x7fddec06e320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.854+0000 7fde05eaf640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde00160790 0x7fde00159ff0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.854+0000 7fde05eaf640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde000ce930 0x7fde00160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.854+0000 7fde05eaf640 1 --2- 172.21.15.50:0/2357061738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde80051c0 0x7fde0015fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.854+0000 7fde05eaf640 1 -- 172.21.15.50:0/2357061738 >> 172.21.15.50:0/2357061738 conn(0x7fde00067ba0 msgr2=0x7fde000d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.855+0000 7fde05eaf640 1 -- 172.21.15.50:0/2357061738 shutdown_connections 2024-09-11T22:11:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.856+0000 7fde05eaf640 1 -- 172.21.15.50:0/2357061738 wait complete. 2024-09-11T22:11:13.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:11:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.993+0000 7f5d16a8d640 1 Processor -- start 2024-09-11T22:11:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.993+0000 7f5d16a8d640 1 -- start start 2024-09-11T22:11:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.994+0000 7f5d16a8d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5d10161d30 0x7f5d100cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.994+0000 7f5d16a8d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5d100b78f0 0x7f5d10162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.994+0000 7f5d16a8d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d101632e0 con 0x7f5d100d11d0 2024-09-11T22:11:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.994+0000 7f5d16a8d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5d100d3450 con 0x7f5d10161d30 2024-09-11T22:11:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.994+0000 7f5d16a8d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5d10162110 con 0x7f5d100b78f0 2024-09-11T22:11:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.994+0000 7f5d14829640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5d10161d30 0x7f5d100cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.994+0000 7f5d14829640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5d10161d30 0x7f5d100cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48948/0 (socket says 172.21.15.50:48948) 2024-09-11T22:11:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.994+0000 7f5d14829640 1 -- 172.21.15.50:0/3890513809 learned_addr learned my addr 172.21.15.50:0/3890513809 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.994+0000 7f5d0ffff640 1 --2- 172.21.15.50:0/3890513809 >> v2:172.21.15.77:3300/0 conn(0x7f5d100b78f0 0x7f5d10162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.994+0000 7f5d14829640 1 -- 172.21.15.50:0/3890513809 >> v2:172.21.15.77:3300/0 conn(0x7f5d100b78f0 msgr2=0x7f5d10162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.994+0000 7f5d14829640 1 --2- 172.21.15.50:0/3890513809 >> v2:172.21.15.77:3300/0 conn(0x7f5d100b78f0 0x7f5d10162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.995+0000 7f5d14829640 1 -- 172.21.15.50:0/3890513809 >> v1:172.21.15.77:6789/0 conn(0x7f5d100d11d0 legacy=0x7f5d100d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.995+0000 7f5d14829640 1 -- 172.21.15.50:0/3890513809 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d100cfd70 con 0x7f5d10161d30 2024-09-11T22:11:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.995+0000 7f5d14829640 1 --2- 172.21.15.50:0/3890513809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d10161d30 0x7f5d100cf790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d10068730 tx=0x7f5d0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6584ecd6dd9fe9e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.995+0000 7f5d0f7fe640 1 -- 172.21.15.50:0/3890513809 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d00037070 con 0x7f5d10161d30 2024-09-11T22:11:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.995+0000 7f5d0f7fe640 1 -- 172.21.15.50:0/3890513809 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d00032440 con 0x7f5d10161d30 2024-09-11T22:11:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.995+0000 7f5d0f7fe640 1 -- 172.21.15.50:0/3890513809 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d00032810 con 0x7f5d10161d30 2024-09-11T22:11:13.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.996+0000 7f5d16a8d640 1 -- 172.21.15.50:0/3890513809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d10161d30 msgr2=0x7f5d100cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:13.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.996+0000 7f5d16a8d640 1 --2- 172.21.15.50:0/3890513809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d10161d30 0x7f5d100cf790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d10068730 tx=0x7f5d0002a270 comp rx=0 tx=0).stop 2024-09-11T22:11:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.996+0000 7f5d16a8d640 1 -- 172.21.15.50:0/3890513809 shutdown_connections 2024-09-11T22:11:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.996+0000 7f5d16a8d640 1 --2- 172.21.15.50:0/3890513809 >> v2:172.21.15.77:3300/0 conn(0x7f5d100b78f0 0x7f5d10162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.996+0000 7f5d16a8d640 1 --2- 172.21.15.50:0/3890513809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d10161d30 0x7f5d100cf790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.996+0000 7f5d16a8d640 1 -- 172.21.15.50:0/3890513809 >> 172.21.15.50:0/3890513809 conn(0x7f5d100727a0 msgr2=0x7f5d100679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.996+0000 7f5d16a8d640 1 -- 172.21.15.50:0/3890513809 shutdown_connections 2024-09-11T22:11:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.996+0000 7f5d16a8d640 1 -- 172.21.15.50:0/3890513809 wait complete. 2024-09-11T22:11:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.997+0000 7f5d16a8d640 1 Processor -- start 2024-09-11T22:11:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.997+0000 7f5d16a8d640 1 -- start start 2024-09-11T22:11:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.998+0000 7f5d16a8d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d100b78f0 0x7f5d1015af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.998+0000 7f5d16a8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d100d11d0 0x7f5d100c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.998+0000 7f5d16a8d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d10161d30 0x7f5d100c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.998+0000 7f5d16a8d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d100d30e0 con 0x7f5d100b78f0 2024-09-11T22:11:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.998+0000 7f5d16a8d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d100d2e00 con 0x7f5d100d11d0 2024-09-11T22:11:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.998+0000 7f5d16a8d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d100b7d60 con 0x7f5d10161d30 2024-09-11T22:11:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.998+0000 7f5d14829640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d100b78f0 0x7f5d1015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.998+0000 7f5d14829640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d100b78f0 0x7f5d1015af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48956/0 (socket says 172.21.15.50:48956) 2024-09-11T22:11:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.998+0000 7f5d14829640 1 -- 172.21.15.50:0/1760058556 learned_addr learned my addr 172.21.15.50:0/1760058556 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d0ffff640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d100d11d0 0x7f5d100c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d1502a640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d10161d30 0x7f5d100c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d14829640 1 -- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d10161d30 msgr2=0x7f5d100c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d14829640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d10161d30 0x7f5d100c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d14829640 1 -- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d100d11d0 msgr2=0x7f5d100c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d14829640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d100d11d0 0x7f5d100c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d14829640 1 -- 172.21.15.50:0/1760058556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d101f4ef0 con 0x7f5d100b78f0 2024-09-11T22:11:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d1502a640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d10161d30 0x7f5d100c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d14829640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d100b78f0 0x7f5d1015af50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d0002a2b0 tx=0x7f5d000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d0d7fa640 1 -- 172.21.15.50:0/1760058556 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d00041020 con 0x7f5d100b78f0 2024-09-11T22:11:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d0d7fa640 1 -- 172.21.15.50:0/1760058556 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d000306c0 con 0x7f5d100b78f0 2024-09-11T22:11:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d16a8d640 1 -- 172.21.15.50:0/1760058556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d101f51d0 con 0x7f5d100b78f0 2024-09-11T22:11:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d0d7fa640 1 -- 172.21.15.50:0/1760058556 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d00037040 con 0x7f5d100b78f0 2024-09-11T22:11:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:13.999+0000 7f5d16a8d640 1 -- 172.21.15.50:0/1760058556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d101f5790 con 0x7f5d100b78f0 2024-09-11T22:11:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.000+0000 7f5d16a8d640 1 -- 172.21.15.50:0/1760058556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d10162da0 con 0x7f5d100b78f0 2024-09-11T22:11:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.001+0000 7f5d0d7fa640 1 -- 172.21.15.50:0/1760058556 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d00044020 con 0x7f5d100b78f0 2024-09-11T22:11:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.001+0000 7f5d0d7fa640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5cfc06be30 0x7f5cfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.001+0000 7f5d0d7fa640 1 -- 172.21.15.50:0/1760058556 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f5d000ab510 con 0x7f5d100b78f0 2024-09-11T22:11:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.002+0000 7f5d0ffff640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5cfc06be30 0x7f5cfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.002+0000 7f5d0ffff640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5cfc06be30 0x7f5cfc06e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d10160b90 tx=0x7f5d04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:14.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.006+0000 7f5d0d7fa640 1 -- 172.21.15.50:0/1760058556 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d0004b030 con 0x7f5d100b78f0 2024-09-11T22:11:14.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.219+0000 7f5d16a8d640 1 -- 172.21.15.50:0/1760058556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5d100d2900 con 0x7f5d100b78f0 2024-09-11T22:11:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.852+0000 7f5d0d7fa640 1 -- 172.21.15.50:0/1760058556 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f5d00079fb0 con 0x7f5d100b78f0 2024-09-11T22:11:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T22:11:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.857+0000 7f5d16a8d640 1 -- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5cfc06be30 msgr2=0x7f5cfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.857+0000 7f5d16a8d640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5cfc06be30 0x7f5cfc06e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d10160b90 tx=0x7f5d04008040 comp rx=0 tx=0).stop 2024-09-11T22:11:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.858+0000 7f5d16a8d640 1 -- 172.21.15.50:0/1760058556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d100b78f0 msgr2=0x7f5d1015af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.858+0000 7f5d16a8d640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d100b78f0 0x7f5d1015af50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d0002a2b0 tx=0x7f5d000046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.858+0000 7f5d16a8d640 1 -- 172.21.15.50:0/1760058556 shutdown_connections 2024-09-11T22:11:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.858+0000 7f5d16a8d640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5cfc06be30 0x7f5cfc06e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.858+0000 7f5d16a8d640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d10161d30 0x7f5d100c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.858+0000 7f5d16a8d640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d100d11d0 0x7f5d100c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.858+0000 7f5d16a8d640 1 --2- 172.21.15.50:0/1760058556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d100b78f0 0x7f5d1015af50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.858+0000 7f5d16a8d640 1 -- 172.21.15.50:0/1760058556 >> 172.21.15.50:0/1760058556 conn(0x7f5d100727a0 msgr2=0x7f5d100b9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:14.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.859+0000 7f5d16a8d640 1 -- 172.21.15.50:0/1760058556 shutdown_connections 2024-09-11T22:11:14.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.859+0000 7f5d16a8d640 1 -- 172.21.15.50:0/1760058556 wait complete. 2024-09-11T22:11:14.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:15.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:14.999+0000 7ff8c7376640 1 Processor -- start 2024-09-11T22:11:15.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.000+0000 7ff8c7376640 1 -- start start 2024-09-11T22:11:15.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.000+0000 7ff8c7376640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8c015e8d0 0x7ff8c00d11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.000+0000 7ff8c7376640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8c00d1b50 con 0x7ff8c00d3bf0 2024-09-11T22:11:15.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.000+0000 7ff8c7376640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8c00d4220 con 0x7ff8c00d1710 2024-09-11T22:11:15.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.000+0000 7ff8c7376640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c015ecb0 con 0x7ff8c015e8d0 2024-09-11T22:11:15.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.001+0000 7ff8c5913640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff8c00d3bf0 0x7ff8c00b83c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57920/0 (socket says 172.21.15.50:57920) 2024-09-11T22:11:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.001+0000 7ff8c5913640 1 -- 172.21.15.50:0/1015288188 learned_addr learned my addr 172.21.15.50:0/1015288188 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.001+0000 7ff8c5112640 1 --2- 172.21.15.50:0/1015288188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8c015e8d0 0x7ff8c00d11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.001+0000 7ff8bffff640 1 -- 172.21.15.50:0/1015288188 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865145191 0 0) 0x7ff8c00d1b50 con 0x7ff8c00d3bf0 2024-09-11T22:11:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.001+0000 7ff8bffff640 1 -- 172.21.15.50:0/1015288188 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8a8003520 con 0x7ff8c00d3bf0 2024-09-11T22:11:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.001+0000 7ff8bffff640 1 -- 172.21.15.50:0/1015288188 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807007768 0 0) 0x7ff8c00d4220 con 0x7ff8c00d1710 2024-09-11T22:11:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.001+0000 7ff8bffff640 1 -- 172.21.15.50:0/1015288188 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8c00d1b50 con 0x7ff8c00d1710 2024-09-11T22:11:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.001+0000 7ff8bffff640 1 -- 172.21.15.50:0/1015288188 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3313852394 0 0) 0x7ff8a8003520 con 0x7ff8c00d3bf0 2024-09-11T22:11:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.001+0000 7ff8c5112640 1 -- 172.21.15.50:0/1015288188 >> v1:172.21.15.77:6789/0 conn(0x7ff8c00d1710 legacy=0x7ff8c00d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.001+0000 7ff8c5112640 1 -- 172.21.15.50:0/1015288188 >> v1:172.21.15.50:6789/0 conn(0x7ff8c00d3bf0 legacy=0x7ff8c00b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.001+0000 7ff8c5112640 1 -- 172.21.15.50:0/1015288188 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c00d4500 con 0x7ff8c015e8d0 2024-09-11T22:11:15.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.002+0000 7ff8c5112640 1 --2- 172.21.15.50:0/1015288188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8c015e8d0 0x7ff8c00d11d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009dc0 tx=0x7ff8b002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f967c1ec30578ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.002+0000 7ff8bffff640 1 -- 172.21.15.50:0/1015288188 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8001670 con 0x7ff8c015e8d0 2024-09-11T22:11:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.002+0000 7ff8bffff640 1 -- 172.21.15.50:0/1015288188 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b0007540 con 0x7ff8c015e8d0 2024-09-11T22:11:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.002+0000 7ff8bffff640 1 -- 172.21.15.50:0/1015288188 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0007910 con 0x7ff8c015e8d0 2024-09-11T22:11:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.003+0000 7ff8c7376640 1 -- 172.21.15.50:0/1015288188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8c015e8d0 msgr2=0x7ff8c00d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.003+0000 7ff8c7376640 1 --2- 172.21.15.50:0/1015288188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8c015e8d0 0x7ff8c00d11d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009dc0 tx=0x7ff8b002a660 comp rx=0 tx=0).stop 2024-09-11T22:11:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.003+0000 7ff8c7376640 1 -- 172.21.15.50:0/1015288188 shutdown_connections 2024-09-11T22:11:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.003+0000 7ff8c7376640 1 --2- 172.21.15.50:0/1015288188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8c015e8d0 0x7ff8c00d11d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.003+0000 7ff8c7376640 1 -- 172.21.15.50:0/1015288188 >> 172.21.15.50:0/1015288188 conn(0x7ff8c00727a0 msgr2=0x7ff8c00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.003+0000 7ff8c7376640 1 -- 172.21.15.50:0/1015288188 shutdown_connections 2024-09-11T22:11:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.003+0000 7ff8c7376640 1 -- 172.21.15.50:0/1015288188 wait complete. 2024-09-11T22:11:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.004+0000 7ff8c7376640 1 Processor -- start 2024-09-11T22:11:15.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.004+0000 7ff8c7376640 1 -- start start 2024-09-11T22:11:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c7376640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8c00d1710 0x7ff8c0160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c7376640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8c00d3bf0 0x7ff8c0160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c7376640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8c015e8d0 0x7ff8c0160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c7376640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c00b7960 con 0x7ff8c00d1710 2024-09-11T22:11:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c7376640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c00b77e0 con 0x7ff8c00d3bf0 2024-09-11T22:11:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c7376640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c00b8ad0 con 0x7ff8c015e8d0 2024-09-11T22:11:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c5112640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8c00d1710 0x7ff8c0160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c5112640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8c00d1710 0x7ff8c0160450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48966/0 (socket says 172.21.15.50:48966) 2024-09-11T22:11:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c5112640 1 -- 172.21.15.50:0/2416593883 learned_addr learned my addr 172.21.15.50:0/2416593883 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c5913640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8c015e8d0 0x7ff8c0160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c4911640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8c00d3bf0 0x7ff8c0160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c5112640 1 -- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8c015e8d0 msgr2=0x7ff8c0160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c5112640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8c015e8d0 0x7ff8c0160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c5112640 1 -- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8c00d3bf0 msgr2=0x7ff8c0160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c5112640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8c00d3bf0 0x7ff8c0160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c5112640 1 -- 172.21.15.50:0/2416593883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c01e8a80 con 0x7ff8c00d1710 2024-09-11T22:11:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8c5112640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8c00d1710 0x7ff8c0160450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0000f80 tx=0x7ff8b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.005+0000 7ff8bdffb640 1 -- 172.21.15.50:0/2416593883 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0040070 con 0x7ff8c00d1710 2024-09-11T22:11:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.006+0000 7ff8bdffb640 1 -- 172.21.15.50:0/2416593883 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b0031c40 con 0x7ff8c00d1710 2024-09-11T22:11:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.006+0000 7ff8c7376640 1 -- 172.21.15.50:0/2416593883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c01e8d60 con 0x7ff8c00d1710 2024-09-11T22:11:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.006+0000 7ff8bdffb640 1 -- 172.21.15.50:0/2416593883 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0009450 con 0x7ff8c00d1710 2024-09-11T22:11:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.006+0000 7ff8c7376640 1 -- 172.21.15.50:0/2416593883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c015ff30 con 0x7ff8c00d1710 2024-09-11T22:11:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.007+0000 7ff8c7376640 1 -- 172.21.15.50:0/2416593883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c00d11d0 con 0x7ff8c00d1710 2024-09-11T22:11:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.007+0000 7ff8bdffb640 1 -- 172.21.15.50:0/2416593883 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8b0039040 con 0x7ff8c00d1710 2024-09-11T22:11:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.008+0000 7ff8bdffb640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff8ac06be30 0x7ff8ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.008+0000 7ff8bdffb640 1 -- 172.21.15.50:0/2416593883 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff8b00ac450 con 0x7ff8c00d1710 2024-09-11T22:11:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.008+0000 7ff8c4911640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff8ac06be30 0x7ff8ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.008+0000 7ff8c4911640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff8ac06be30 0x7ff8ac06e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff8c01f7a10 tx=0x7ff8b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:15.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.012+0000 7ff8bdffb640 1 -- 172.21.15.50:0/2416593883 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff8b007a840 con 0x7ff8c00d1710 2024-09-11T22:11:15.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.190+0000 7ff8c7376640 1 -- 172.21.15.50:0/2416593883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8c00b9ad0 con 0x7ff8c00d1710 2024-09-11T22:11:15.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.191+0000 7ff8bdffb640 1 -- 172.21.15.50:0/2416593883 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16642 (secure 0 0 0) 0x7ff8b007eb40 con 0x7ff8c00d1710 2024-09-11T22:11:15.192 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:15.192 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":20,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:14.221053+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:12.090736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:13.202114+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.193+0000 7ff8c7376640 1 -- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff8ac06be30 msgr2=0x7ff8ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.193+0000 7ff8c7376640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff8ac06be30 0x7ff8ac06e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff8c01f7a10 tx=0x7ff8b4009040 comp rx=0 tx=0).stop 2024-09-11T22:11:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.193+0000 7ff8c7376640 1 -- 172.21.15.50:0/2416593883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8c00d1710 msgr2=0x7ff8c0160450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.193+0000 7ff8c7376640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8c00d1710 0x7ff8c0160450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0000f80 tx=0x7ff8b0004a40 comp rx=0 tx=0).stop 2024-09-11T22:11:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.193+0000 7ff8c7376640 1 -- 172.21.15.50:0/2416593883 shutdown_connections 2024-09-11T22:11:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.193+0000 7ff8c7376640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff8ac06be30 0x7ff8ac06e2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.193+0000 7ff8c7376640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8c015e8d0 0x7ff8c0160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.193+0000 7ff8c7376640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8c00d3bf0 0x7ff8c0160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.193+0000 7ff8c7376640 1 --2- 172.21.15.50:0/2416593883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8c00d1710 0x7ff8c0160450 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.193+0000 7ff8c7376640 1 -- 172.21.15.50:0/2416593883 >> 172.21.15.50:0/2416593883 conn(0x7ff8c00727a0 msgr2=0x7ff8c00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.193+0000 7ff8c7376640 1 -- 172.21.15.50:0/2416593883 shutdown_connections 2024-09-11T22:11:15.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.193+0000 7ff8c7376640 1 -- 172.21.15.50:0/2416593883 wait complete. 2024-09-11T22:11:15.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:15.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.306+0000 7fe24039f640 1 Processor -- start 2024-09-11T22:11:15.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.306+0000 7fe24039f640 1 -- start start 2024-09-11T22:11:15.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.307+0000 7fe24039f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe23815e790 0x7fe2380d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.307+0000 7fe24039f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe23815eb70 0x7fe2380d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.307+0000 7fe24039f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2380ba230 0x7fe2380d11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.307+0000 7fe24039f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe2380d3dc0 con 0x7fe23815eb70 2024-09-11T22:11:15.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.307+0000 7fe24039f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe2380ba6e0 con 0x7fe23815e790 2024-09-11T22:11:15.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.307+0000 7fe24039f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe2380d31b0 con 0x7fe2380ba230 2024-09-11T22:11:15.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.307+0000 7fe23d93a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe23815eb70 0x7fe2380d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.307+0000 7fe23d93a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe23815eb70 0x7fe2380d2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48980/0 (socket says 172.21.15.50:48980) 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.307+0000 7fe23d93a640 1 -- 172.21.15.50:0/599957589 learned_addr learned my addr 172.21.15.50:0/599957589 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.308+0000 7fe23e13b640 1 --2- 172.21.15.50:0/599957589 >> v2:172.21.15.77:3300/0 conn(0x7fe23815e790 0x7fe2380d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.308+0000 7fe23d93a640 1 -- 172.21.15.50:0/599957589 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2380ba230 msgr2=0x7fe2380d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.308+0000 7fe23e93c640 1 --2- 172.21.15.50:0/599957589 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2380ba230 0x7fe2380d11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.308+0000 7fe23d93a640 1 --2- 172.21.15.50:0/599957589 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2380ba230 0x7fe2380d11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.308+0000 7fe23d93a640 1 -- 172.21.15.50:0/599957589 >> v2:172.21.15.77:3300/0 conn(0x7fe23815e790 msgr2=0x7fe2380d4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.308+0000 7fe23d93a640 1 --2- 172.21.15.50:0/599957589 >> v2:172.21.15.77:3300/0 conn(0x7fe23815e790 0x7fe2380d4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.308+0000 7fe23d93a640 1 -- 172.21.15.50:0/599957589 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2380d3490 con 0x7fe23815eb70 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.308+0000 7fe23e13b640 1 --2- 172.21.15.50:0/599957589 >> v2:172.21.15.77:3300/0 conn(0x7fe23815e790 0x7fe2380d4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.308+0000 7fe23d93a640 1 --2- 172.21.15.50:0/599957589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe23815eb70 0x7fe2380d2b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe238073050 tx=0x7fe22c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa05a00c0689230f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.309+0000 7fe23d139640 1 -- 172.21.15.50:0/599957589 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c037070 con 0x7fe23815eb70 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.309+0000 7fe23d139640 1 -- 172.21.15.50:0/599957589 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe22c032440 con 0x7fe23815eb70 2024-09-11T22:11:15.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.309+0000 7fe23d139640 1 -- 172.21.15.50:0/599957589 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c032810 con 0x7fe23815eb70 2024-09-11T22:11:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.309+0000 7fe24039f640 1 -- 172.21.15.50:0/599957589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe23815eb70 msgr2=0x7fe2380d2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.309+0000 7fe24039f640 1 --2- 172.21.15.50:0/599957589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe23815eb70 0x7fe2380d2b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe238073050 tx=0x7fe22c02a1e0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.309+0000 7fe24039f640 1 -- 172.21.15.50:0/599957589 shutdown_connections 2024-09-11T22:11:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.309+0000 7fe24039f640 1 --2- 172.21.15.50:0/599957589 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2380ba230 0x7fe2380d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.309+0000 7fe24039f640 1 --2- 172.21.15.50:0/599957589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe23815eb70 0x7fe2380d2b20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.309+0000 7fe24039f640 1 --2- 172.21.15.50:0/599957589 >> v2:172.21.15.77:3300/0 conn(0x7fe23815e790 0x7fe2380d4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.309+0000 7fe24039f640 1 -- 172.21.15.50:0/599957589 >> 172.21.15.50:0/599957589 conn(0x7fe2380727a0 msgr2=0x7fe2380679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.309+0000 7fe24039f640 1 -- 172.21.15.50:0/599957589 shutdown_connections 2024-09-11T22:11:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.309+0000 7fe24039f640 1 -- 172.21.15.50:0/599957589 wait complete. 2024-09-11T22:11:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.310+0000 7fe24039f640 1 Processor -- start 2024-09-11T22:11:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.311+0000 7fe24039f640 1 -- start start 2024-09-11T22:11:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.311+0000 7fe24039f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2380ba230 0x7fe2380cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.311+0000 7fe24039f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe23815e790 0x7fe238154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.311+0000 7fe24039f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe23815eb70 0x7fe2380ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.311+0000 7fe24039f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe2380d1710 con 0x7fe2380ba230 2024-09-11T22:11:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.311+0000 7fe24039f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe2380d3a50 con 0x7fe23815eb70 2024-09-11T22:11:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.311+0000 7fe24039f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe2380d1890 con 0x7fe23815e790 2024-09-11T22:11:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.311+0000 7fe23e13b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2380ba230 0x7fe2380cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.311+0000 7fe23e13b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2380ba230 0x7fe2380cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48990/0 (socket says 172.21.15.50:48990) 2024-09-11T22:11:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.311+0000 7fe23e13b640 1 -- 172.21.15.50:0/206312756 learned_addr learned my addr 172.21.15.50:0/206312756 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.312+0000 7fe23e93c640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe23815eb70 0x7fe2380ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.312+0000 7fe23d93a640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe23815e790 0x7fe238154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.312+0000 7fe23e13b640 1 -- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe23815e790 msgr2=0x7fe238154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.312+0000 7fe23e13b640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe23815e790 0x7fe238154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.312+0000 7fe23e13b640 1 -- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe23815eb70 msgr2=0x7fe2380ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.312+0000 7fe23e13b640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe23815eb70 0x7fe2380ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.312+0000 7fe23e13b640 1 -- 172.21.15.50:0/206312756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2381f7ef0 con 0x7fe2380ba230 2024-09-11T22:11:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.312+0000 7fe23e13b640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2380ba230 0x7fe2380cd7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe23000c7f0 tx=0x7fe23000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.312+0000 7fe236ffd640 1 -- 172.21.15.50:0/206312756 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230015070 con 0x7fe2380ba230 2024-09-11T22:11:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.312+0000 7fe236ffd640 1 -- 172.21.15.50:0/206312756 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe230007820 con 0x7fe2380ba230 2024-09-11T22:11:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.312+0000 7fe236ffd640 1 -- 172.21.15.50:0/206312756 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230007bd0 con 0x7fe2380ba230 2024-09-11T22:11:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.312+0000 7fe24039f640 1 -- 172.21.15.50:0/206312756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2381f8190 con 0x7fe2380ba230 2024-09-11T22:11:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.312+0000 7fe24039f640 1 -- 172.21.15.50:0/206312756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2381f8750 con 0x7fe2380ba230 2024-09-11T22:11:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.313+0000 7fe24039f640 1 -- 172.21.15.50:0/206312756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2380d11d0 con 0x7fe2380ba230 2024-09-11T22:11:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.313+0000 7fe236ffd640 1 -- 172.21.15.50:0/206312756 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe230018070 con 0x7fe2380ba230 2024-09-11T22:11:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.314+0000 7fe236ffd640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe22406be30 0x7fe22406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.314+0000 7fe236ffd640 1 -- 172.21.15.50:0/206312756 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe23008af10 con 0x7fe2380ba230 2024-09-11T22:11:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.314+0000 7fe23d93a640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe22406be30 0x7fe22406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.315+0000 7fe23d93a640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe22406be30 0x7fe22406e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe22c034000 tx=0x7fe22c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.318+0000 7fe236ffd640 1 -- 172.21.15.50:0/206312756 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2300598c0 con 0x7fe2380ba230 2024-09-11T22:11:15.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.494+0000 7fe24039f640 1 -- 172.21.15.50:0/206312756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe238068390 con 0x7fe2380ba230 2024-09-11T22:11:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.495+0000 7fe236ffd640 1 -- 172.21.15.50:0/206312756 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16642 (secure 0 0 0) 0x7fe2300591c0 con 0x7fe2380ba230 2024-09-11T22:11:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:15.496 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":20,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:14.221053+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:12.090736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:13.202114+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:15.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.497+0000 7fe24039f640 1 -- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe22406be30 msgr2=0x7fe22406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.497+0000 7fe24039f640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe22406be30 0x7fe22406e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe22c034000 tx=0x7fe22c02e000 comp rx=0 tx=0).stop 2024-09-11T22:11:15.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.497+0000 7fe24039f640 1 -- 172.21.15.50:0/206312756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2380ba230 msgr2=0x7fe2380cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.497+0000 7fe24039f640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2380ba230 0x7fe2380cd7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe23000c7f0 tx=0x7fe23000ccb0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.497+0000 7fe24039f640 1 -- 172.21.15.50:0/206312756 shutdown_connections 2024-09-11T22:11:15.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.497+0000 7fe24039f640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe22406be30 0x7fe22406e2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.497+0000 7fe24039f640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe23815e790 0x7fe238154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.497+0000 7fe24039f640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe23815eb70 0x7fe2380ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.497+0000 7fe24039f640 1 --2- 172.21.15.50:0/206312756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2380ba230 0x7fe2380cd7a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.497+0000 7fe24039f640 1 -- 172.21.15.50:0/206312756 >> 172.21.15.50:0/206312756 conn(0x7fe2380727a0 msgr2=0x7fe2380b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:15.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.497+0000 7fe24039f640 1 -- 172.21.15.50:0/206312756 shutdown_connections 2024-09-11T22:11:15.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.497+0000 7fe24039f640 1 -- 172.21.15.50:0/206312756 wait complete. 2024-09-11T22:11:15.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:11:15.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.613+0000 7f6382aaf640 1 Processor -- start 2024-09-11T22:11:15.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.613+0000 7f6382aaf640 1 -- start start 2024-09-11T22:11:15.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f6382aaf640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f637c15e870 0x7f637c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f6382aaf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637c0d3c00 0x7f637c0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f6382aaf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f637c0cfa80 con 0x7f637c0d16d0 2024-09-11T22:11:15.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f6382aaf640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f637c0d1b40 con 0x7f637c15e870 2024-09-11T22:11:15.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f6382aaf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f637c0d40d0 con 0x7f637c0d3c00 2024-09-11T22:11:15.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f637bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f637c0d16d0 0x7f637c0d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57936/0 (socket says 172.21.15.50:57936) 2024-09-11T22:11:15.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f637bfff640 1 -- 172.21.15.50:0/3317466407 learned_addr learned my addr 172.21.15.50:0/3317466407 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:15.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f638104c640 1 --2- 172.21.15.50:0/3317466407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637c0d3c00 0x7f637c0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f638084b640 1 --2- 172.21.15.50:0/3317466407 >> v2:172.21.15.77:3300/0 conn(0x7f637c15e870 0x7f637c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f637b7fe640 1 -- 172.21.15.50:0/3317466407 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2026063893 0 0) 0x7f6368001110 con 0x7f637c0d16d0 2024-09-11T22:11:15.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f637b7fe640 1 -- 172.21.15.50:0/3317466407 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f636c003520 con 0x7f637c0d16d0 2024-09-11T22:11:15.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f638104c640 1 -- 172.21.15.50:0/3317466407 >> v2:172.21.15.77:3300/0 conn(0x7f637c15e870 msgr2=0x7f637c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:15.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f638104c640 1 --2- 172.21.15.50:0/3317466407 >> v2:172.21.15.77:3300/0 conn(0x7f637c15e870 0x7f637c0d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f638104c640 1 -- 172.21.15.50:0/3317466407 >> v1:172.21.15.50:6789/0 conn(0x7f637c0d16d0 legacy=0x7f637c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f638104c640 1 -- 172.21.15.50:0/3317466407 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c0d43b0 con 0x7f637c0d3c00 2024-09-11T22:11:15.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.614+0000 7f638084b640 1 --2- 172.21.15.50:0/3317466407 >> v2:172.21.15.77:3300/0 conn(0x7f637c15e870 0x7f637c0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:15.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.615+0000 7f638104c640 1 --2- 172.21.15.50:0/3317466407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637c0d3c00 0x7f637c0b8400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6374009d90 tx=0x7f637402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f876e7d52b051537 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:15.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.615+0000 7f637b7fe640 1 -- 172.21.15.50:0/3317466407 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6374007740 con 0x7f637c0d3c00 2024-09-11T22:11:15.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.615+0000 7f637b7fe640 1 -- 172.21.15.50:0/3317466407 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63740078e0 con 0x7f637c0d3c00 2024-09-11T22:11:15.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.615+0000 7f637b7fe640 1 -- 172.21.15.50:0/3317466407 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6374007c90 con 0x7f637c0d3c00 2024-09-11T22:11:15.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.616+0000 7f6382aaf640 1 -- 172.21.15.50:0/3317466407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637c0d3c00 msgr2=0x7f637c0b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.616+0000 7f6382aaf640 1 --2- 172.21.15.50:0/3317466407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637c0d3c00 0x7f637c0b8400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6374009d90 tx=0x7f637402a660 comp rx=0 tx=0).stop 2024-09-11T22:11:15.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.616+0000 7f6382aaf640 1 -- 172.21.15.50:0/3317466407 shutdown_connections 2024-09-11T22:11:15.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.616+0000 7f6382aaf640 1 --2- 172.21.15.50:0/3317466407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637c0d3c00 0x7f637c0b8400 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.616+0000 7f6382aaf640 1 --2- 172.21.15.50:0/3317466407 >> v2:172.21.15.77:3300/0 conn(0x7f637c15e870 0x7f637c0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.616+0000 7f6382aaf640 1 -- 172.21.15.50:0/3317466407 >> 172.21.15.50:0/3317466407 conn(0x7f637c0727a0 msgr2=0x7f637c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:15.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.616+0000 7f6382aaf640 1 -- 172.21.15.50:0/3317466407 shutdown_connections 2024-09-11T22:11:15.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.616+0000 7f6382aaf640 1 -- 172.21.15.50:0/3317466407 wait complete. 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.617+0000 7f6382aaf640 1 Processor -- start 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.617+0000 7f6382aaf640 1 -- start start 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.618+0000 7f6382aaf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f637c0d16d0 0x7f637c0c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.618+0000 7f6382aaf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f637c0d3c00 0x7f637c0ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.618+0000 7f6382aaf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637c15e870 0x7f637c0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.618+0000 7f6382aaf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f637c15ec50 con 0x7f637c0d16d0 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.618+0000 7f6382aaf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f637c0b7ee0 con 0x7f637c0d3c00 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.618+0000 7f6382aaf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f637c0b78b0 con 0x7f637c15e870 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.618+0000 7f638084b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f637c0d16d0 0x7f637c0c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.618+0000 7f638084b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f637c0d16d0 0x7f637c0c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49002/0 (socket says 172.21.15.50:49002) 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.618+0000 7f638084b640 1 -- 172.21.15.50:0/569449032 learned_addr learned my addr 172.21.15.50:0/569449032 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.619+0000 7f638104c640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637c15e870 0x7f637c0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.619+0000 7f637bfff640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f637c0d3c00 0x7f637c0ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.619+0000 7f638084b640 1 -- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637c15e870 msgr2=0x7f637c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.619+0000 7f638084b640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637c15e870 0x7f637c0cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.619+0000 7f638084b640 1 -- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f637c0d3c00 msgr2=0x7f637c0ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.619+0000 7f638084b640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f637c0d3c00 0x7f637c0ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.619+0000 7f638084b640 1 -- 172.21.15.50:0/569449032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c0ca9b0 con 0x7f637c0d16d0 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.619+0000 7f638084b640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f637c0d16d0 0x7f637c0c9e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f637000ec10 tx=0x7f637000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.619+0000 7f63797fa640 1 -- 172.21.15.50:0/569449032 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370017070 con 0x7f637c0d16d0 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.619+0000 7f63797fa640 1 -- 172.21.15.50:0/569449032 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f637000cc30 con 0x7f637c0d16d0 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.619+0000 7f6382aaf640 1 -- 172.21.15.50:0/569449032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637c0cac90 con 0x7f637c0d16d0 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.619+0000 7f63797fa640 1 -- 172.21.15.50:0/569449032 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370013470 con 0x7f637c0d16d0 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.619+0000 7f6382aaf640 1 -- 172.21.15.50:0/569449032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f637c15f000 con 0x7f637c0d16d0 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.620+0000 7f6382aaf640 1 -- 172.21.15.50:0/569449032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f637c0cb1b0 con 0x7f637c0d16d0 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.620+0000 7f63797fa640 1 -- 172.21.15.50:0/569449032 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f637001a070 con 0x7f637c0d16d0 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.621+0000 7f63797fa640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f636006be30 0x7f636006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.621+0000 7f63797fa640 1 -- 172.21.15.50:0/569449032 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f637008b160 con 0x7f637c0d16d0 2024-09-11T22:11:15.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.621+0000 7f637bfff640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f636006be30 0x7f636006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.622+0000 7f637bfff640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f636006be30 0x7f636006e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f637c0b4e20 tx=0x7f6368009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:15.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.626+0000 7f63797fa640 1 -- 172.21.15.50:0/569449032 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f637c0cb1b0 con 0x7f637c0d16d0 2024-09-11T22:11:15.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.837+0000 7f6382aaf640 1 -- 172.21.15.50:0/569449032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f637c0d1190 con 0x7f637c0d16d0 2024-09-11T22:11:15.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.865+0000 7f63797fa640 1 -- 172.21.15.50:0/569449032 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f6370059b10 con 0x7f637c0d16d0 2024-09-11T22:11:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.867+0000 7f6382aaf640 1 -- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f636006be30 msgr2=0x7f636006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.867+0000 7f6382aaf640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f636006be30 0x7f636006e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f637c0b4e20 tx=0x7f6368009040 comp rx=0 tx=0).stop 2024-09-11T22:11:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.867+0000 7f6382aaf640 1 -- 172.21.15.50:0/569449032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f637c0d16d0 msgr2=0x7f637c0c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.867+0000 7f6382aaf640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f637c0d16d0 0x7f637c0c9e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f637000ec10 tx=0x7f637000c520 comp rx=0 tx=0).stop 2024-09-11T22:11:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.867+0000 7f6382aaf640 1 -- 172.21.15.50:0/569449032 shutdown_connections 2024-09-11T22:11:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.867+0000 7f6382aaf640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f636006be30 0x7f636006e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.867+0000 7f6382aaf640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637c15e870 0x7f637c0cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.867+0000 7f6382aaf640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f637c0d3c00 0x7f637c0ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.867+0000 7f6382aaf640 1 --2- 172.21.15.50:0/569449032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f637c0d16d0 0x7f637c0c9e10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.867+0000 7f6382aaf640 1 -- 172.21.15.50:0/569449032 >> 172.21.15.50:0/569449032 conn(0x7f637c0727a0 msgr2=0x7f637c0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.867+0000 7f6382aaf640 1 -- 172.21.15.50:0/569449032 shutdown_connections 2024-09-11T22:11:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.867+0000 7f6382aaf640 1 -- 172.21.15.50:0/569449032 wait complete. 2024-09-11T22:11:15.878 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:11:15.879 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:11:15.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.983+0000 7f79ed5f1640 1 Processor -- start 2024-09-11T22:11:15.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.983+0000 7f79ed5f1640 1 -- start start 2024-09-11T22:11:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.984+0000 7f79ed5f1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79e80d3c00 0x7f79e8169420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.984+0000 7f79ed5f1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79e80cfa80 con 0x7f79e815e870 2024-09-11T22:11:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.984+0000 7f79ed5f1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79e80d40d0 con 0x7f79e80d18a0 2024-09-11T22:11:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.984+0000 7f79ed5f1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f79e80d43b0 con 0x7f79e80d3c00 2024-09-11T22:11:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.984+0000 7f79e77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79e80d3c00 0x7f79e8169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.984+0000 7f79e6ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f79e815e870 0x7f79e80d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57942/0 (socket says 172.21.15.50:57942) 2024-09-11T22:11:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.984+0000 7f79e6ffd640 1 -- 172.21.15.50:0/125149234 learned_addr learned my addr 172.21.15.50:0/125149234 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.984+0000 7f79e77fe640 1 -- 172.21.15.50:0/125149234 >> v1:172.21.15.77:6789/0 conn(0x7f79e80d18a0 legacy=0x7f79e80d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.985+0000 7f79e77fe640 1 -- 172.21.15.50:0/125149234 >> v1:172.21.15.50:6789/0 conn(0x7f79e815e870 legacy=0x7f79e80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.985+0000 7f79e77fe640 1 -- 172.21.15.50:0/125149234 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e80b7c00 con 0x7f79e80d3c00 2024-09-11T22:11:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.985+0000 7f79e5ffb640 1 -- 172.21.15.50:0/125149234 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998484531 0 0) 0x7f79d8001490 con 0x7f79e815e870 2024-09-11T22:11:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.985+0000 7f79e77fe640 1 --2- 172.21.15.50:0/125149234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e80d3c00 0x7f79e8169420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f79e00097a0 tx=0x7f79e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c15b90a5c11aea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.985+0000 7f79e5ffb640 1 -- 172.21.15.50:0/125149234 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0037070 con 0x7f79e80d3c00 2024-09-11T22:11:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.985+0000 7f79e5ffb640 1 -- 172.21.15.50:0/125149234 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e0032440 con 0x7f79e80d3c00 2024-09-11T22:11:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.985+0000 7f79e5ffb640 1 -- 172.21.15.50:0/125149234 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0032810 con 0x7f79e80d3c00 2024-09-11T22:11:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.986+0000 7f79ed5f1640 1 -- 172.21.15.50:0/125149234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e80d3c00 msgr2=0x7f79e8169420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.986+0000 7f79ed5f1640 1 --2- 172.21.15.50:0/125149234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e80d3c00 0x7f79e8169420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f79e00097a0 tx=0x7f79e002a1e0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.986+0000 7f79ed5f1640 1 -- 172.21.15.50:0/125149234 shutdown_connections 2024-09-11T22:11:15.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.986+0000 7f79ed5f1640 1 --2- 172.21.15.50:0/125149234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e80d3c00 0x7f79e8169420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.986+0000 7f79ed5f1640 1 -- 172.21.15.50:0/125149234 >> 172.21.15.50:0/125149234 conn(0x7f79e80727a0 msgr2=0x7f79e80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:15.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.986+0000 7f79ed5f1640 1 -- 172.21.15.50:0/125149234 shutdown_connections 2024-09-11T22:11:15.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.986+0000 7f79ed5f1640 1 -- 172.21.15.50:0/125149234 wait complete. 2024-09-11T22:11:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.987+0000 7f79ed5f1640 1 Processor -- start 2024-09-11T22:11:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.987+0000 7f79ed5f1640 1 -- start start 2024-09-11T22:11:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.988+0000 7f79ed5f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79e80d18a0 0x7f79e8150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.988+0000 7f79ed5f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79e80d3c00 0x7f79e80ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.988+0000 7f79ed5f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e815e870 0x7f79e80ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.988+0000 7f79ed5f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f79e80b78b0 con 0x7f79e815e870 2024-09-11T22:11:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.988+0000 7f79ed5f1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f79e815ec50 con 0x7f79e80d18a0 2024-09-11T22:11:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.988+0000 7f79ed5f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f79e80b9410 con 0x7f79e80d3c00 2024-09-11T22:11:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.988+0000 7f79e77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e815e870 0x7f79e80ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.988+0000 7f79e77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e815e870 0x7f79e80ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49028/0 (socket says 172.21.15.50:49028) 2024-09-11T22:11:15.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.988+0000 7f79e77fe640 1 -- 172.21.15.50:0/1504434911 learned_addr learned my addr 172.21.15.50:0/1504434911 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.988+0000 7f79e6ffd640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79e80d18a0 0x7f79e8150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.988+0000 7f79e67fc640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79e80d3c00 0x7f79e80ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.989+0000 7f79e77fe640 1 -- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79e80d3c00 msgr2=0x7f79e80ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.989+0000 7f79e77fe640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79e80d3c00 0x7f79e80ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.989+0000 7f79e77fe640 1 -- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79e80d18a0 msgr2=0x7f79e8150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.989+0000 7f79e77fe640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79e80d18a0 0x7f79e8150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.989+0000 7f79e77fe640 1 -- 172.21.15.50:0/1504434911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e80cbaa0 con 0x7f79e815e870 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.989+0000 7f79e67fc640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79e80d3c00 0x7f79e80ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.989+0000 7f79e77fe640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e815e870 0x7f79e80ca6c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f79e0035040 tx=0x7f79e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.989+0000 7f79df7fe640 1 -- 172.21.15.50:0/1504434911 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0037040 con 0x7f79e815e870 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.989+0000 7f79df7fe640 1 -- 172.21.15.50:0/1504434911 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e0004230 con 0x7f79e815e870 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.989+0000 7f79ed5f1640 1 -- 172.21.15.50:0/1504434911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e80cbd80 con 0x7f79e815e870 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.989+0000 7f79df7fe640 1 -- 172.21.15.50:0/1504434911 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0032e20 con 0x7f79e815e870 2024-09-11T22:11:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.989+0000 7f79ed5f1640 1 -- 172.21.15.50:0/1504434911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e8151170 con 0x7f79e815e870 2024-09-11T22:11:15.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.990+0000 7f79ed5f1640 1 -- 172.21.15.50:0/1504434911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e80d34f0 con 0x7f79e815e870 2024-09-11T22:11:15.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.990+0000 7f79df7fe640 1 -- 172.21.15.50:0/1504434911 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79e0030770 con 0x7f79e815e870 2024-09-11T22:11:15.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.991+0000 7f79df7fe640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79c806be30 0x7f79c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:15.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.991+0000 7f79df7fe640 1 -- 172.21.15.50:0/1504434911 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f79e00ac240 con 0x7f79e815e870 2024-09-11T22:11:15.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.991+0000 7f79e6ffd640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79c806be30 0x7f79c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:15.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.992+0000 7f79e6ffd640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79c806be30 0x7f79c806e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79d8007ed0 tx=0x7f79d8007e60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:15.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:15.996+0000 7f79df7fe640 1 -- 172.21.15.50:0/1504434911 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79e007ad00 con 0x7f79e815e870 2024-09-11T22:11:16.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.208+0000 7f79ed5f1640 1 -- 172.21.15.50:0/1504434911 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f79e80ba700 con 0x7f79e815e870 2024-09-11T22:11:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.866+0000 7f79df7fe640 1 -- 172.21.15.50:0/1504434911 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f79e007a600 con 0x7f79e815e870 2024-09-11T22:11:16.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.869+0000 7f79ed5f1640 1 -- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79c806be30 msgr2=0x7f79c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:16.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.869+0000 7f79ed5f1640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79c806be30 0x7f79c806e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79d8007ed0 tx=0x7f79d8007e60 comp rx=0 tx=0).stop 2024-09-11T22:11:16.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.869+0000 7f79ed5f1640 1 -- 172.21.15.50:0/1504434911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e815e870 msgr2=0x7f79e80ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:16.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.869+0000 7f79ed5f1640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e815e870 0x7f79e80ca6c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f79e0035040 tx=0x7f79e00046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:16.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.869+0000 7f79ed5f1640 1 -- 172.21.15.50:0/1504434911 shutdown_connections 2024-09-11T22:11:16.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.869+0000 7f79ed5f1640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79c806be30 0x7f79c806e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:16.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.869+0000 7f79ed5f1640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79e80d3c00 0x7f79e80ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:16.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.869+0000 7f79ed5f1640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e815e870 0x7f79e80ca6c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:16.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.869+0000 7f79ed5f1640 1 --2- 172.21.15.50:0/1504434911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79e80d18a0 0x7f79e8150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.869+0000 7f79ed5f1640 1 -- 172.21.15.50:0/1504434911 >> 172.21.15.50:0/1504434911 conn(0x7f79e80727a0 msgr2=0x7f79e815ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.869+0000 7f79ed5f1640 1 -- 172.21.15.50:0/1504434911 shutdown_connections 2024-09-11T22:11:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.869+0000 7f79ed5f1640 1 -- 172.21.15.50:0/1504434911 wait complete. 2024-09-11T22:11:16.884 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:11:16.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:11:16.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.992+0000 7f52bafbd640 1 Processor -- start 2024-09-11T22:11:16.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.992+0000 7f52bafbd640 1 -- start start 2024-09-11T22:11:16.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.992+0000 7f52bafbd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52b40b5fd0 0x7f52b40b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:16.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.992+0000 7f52bafbd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52b415e050 0x7f52b415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:16.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52bafbd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52b415cef0 con 0x7f52b415c770 2024-09-11T22:11:16.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52bafbd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f52b40b6960 con 0x7f52b40b5fd0 2024-09-11T22:11:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52bafbd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52b415d1d0 con 0x7f52b415e050 2024-09-11T22:11:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b8d59640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f52b415c770 0x7f52b40b53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57946/0 (socket says 172.21.15.50:57946) 2024-09-11T22:11:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b8d59640 1 -- 172.21.15.50:0/1413744828 learned_addr learned my addr 172.21.15.50:0/1413744828 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b955a640 1 --2- 172.21.15.50:0/1413744828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52b415e050 0x7f52b415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b3fff640 1 --2- 172.21.15.50:0/1413744828 >> v2:172.21.15.77:3300/0 conn(0x7f52b40b5fd0 0x7f52b40b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 960287191 0 0) 0x7f52b415cef0 con 0x7f52b415c770 2024-09-11T22:11:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52a0003520 con 0x7f52b415c770 2024-09-11T22:11:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2225943750 0 0) 0x7f52a0003520 con 0x7f52b415c770 2024-09-11T22:11:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52b415e050 msgr2=0x7f52b415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 --2- 172.21.15.50:0/1413744828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52b415e050 0x7f52b415e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 >> v2:172.21.15.77:3300/0 conn(0x7f52b40b5fd0 msgr2=0x7f52b40b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 --2- 172.21.15.50:0/1413744828 >> v2:172.21.15.77:3300/0 conn(0x7f52b40b5fd0 0x7f52b40b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b415d4b0 con 0x7f52b415c770 2024-09-11T22:11:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f52a40019f0 con 0x7f52b415c770 2024-09-11T22:11:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 >> v1:172.21.15.50:6789/0 conn(0x7f52b415c770 legacy=0x7f52b40b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 --2- 172.21.15.50:0/1413744828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52b415e050 0x7f52a00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 --2- 172.21.15.50:0/1413744828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52a0003f30 0x7f52a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 --2- 172.21.15.50:0/1413744828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52a0004d40 0x7f52a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f52b40b6960 con 0x7f52a0004d40 2024-09-11T22:11:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52b415d1d0 con 0x7f52a0003f30 2024-09-11T22:11:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52a000b9c0 con 0x7f52b415e050 2024-09-11T22:11:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b3fff640 1 --2- 172.21.15.50:0/1413744828 >> v2:172.21.15.77:3300/0 conn(0x7f52b40b5fd0 0x7f52b40b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b955a640 1 --2- 172.21.15.50:0/1413744828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52a0004d40 0x7f52a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.993+0000 7f52b8d59640 1 --2- 172.21.15.50:0/1413744828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52b415e050 0x7f52a00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.994+0000 7f52b3fff640 1 --2- 172.21.15.50:0/1413744828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52a0003f30 0x7f52a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:16.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.994+0000 7f52b955a640 1 -- 172.21.15.50:0/1413744828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52b415e050 msgr2=0x7f52a00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:16.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.994+0000 7f52b955a640 1 --2- 172.21.15.50:0/1413744828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52b415e050 0x7f52a00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:16.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.994+0000 7f52b955a640 1 -- 172.21.15.50:0/1413744828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52a0003f30 msgr2=0x7f52a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:16.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.994+0000 7f52b955a640 1 --2- 172.21.15.50:0/1413744828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52a0003f30 0x7f52a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:16.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.994+0000 7f52b955a640 1 -- 172.21.15.50:0/1413744828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a0003520 con 0x7f52a0004d40 2024-09-11T22:11:16.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.994+0000 7f52b955a640 1 --2- 172.21.15.50:0/1413744828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52a0004d40 0x7f52a00051c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009ac0 tx=0x7f52a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8171266b51602c3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:16.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.995+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac036070 con 0x7f52a0004d40 2024-09-11T22:11:16.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.995+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac031400 con 0x7f52a0004d40 2024-09-11T22:11:16.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.995+0000 7f52b37fe640 1 -- 172.21.15.50:0/1413744828 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac009690 con 0x7f52a0004d40 2024-09-11T22:11:16.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.995+0000 7f52bafbd640 1 -- 172.21.15.50:0/1413744828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52a0004d40 msgr2=0x7f52a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:16.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.995+0000 7f52bafbd640 1 --2- 172.21.15.50:0/1413744828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52a0004d40 0x7f52a00051c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009ac0 tx=0x7f52a0005830 comp rx=0 tx=0).stop 2024-09-11T22:11:16.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.995+0000 7f52b955a640 1 -- 172.21.15.50:0/1413744828 reap_dead start 2024-09-11T22:11:17.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.995+0000 7f52bafbd640 1 -- 172.21.15.50:0/1413744828 shutdown_connections 2024-09-11T22:11:17.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.995+0000 7f52bafbd640 1 -- 172.21.15.50:0/1413744828 >> 172.21.15.50:0/1413744828 conn(0x7f52b40b7940 msgr2=0x7f52b40b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:17.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.995+0000 7f52bafbd640 1 -- 172.21.15.50:0/1413744828 shutdown_connections 2024-09-11T22:11:17.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.995+0000 7f52bafbd640 1 -- 172.21.15.50:0/1413744828 wait complete. 2024-09-11T22:11:17.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.996+0000 7f52bafbd640 1 Processor -- start 2024-09-11T22:11:17.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.997+0000 7f52bafbd640 1 -- start start 2024-09-11T22:11:17.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.997+0000 7f52bafbd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52a0004d40 0x7f52b414f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.997+0000 7f52bafbd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52b406d8b0 0x7f52b406cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.997+0000 7f52bafbd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52b40b4000 0x7f52b40b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.997+0000 7f52bafbd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f52b40b5af0 con 0x7f52b40b4000 2024-09-11T22:11:17.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.997+0000 7f52bafbd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52b415dcb0 con 0x7f52b406d8b0 2024-09-11T22:11:17.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.997+0000 7f52bafbd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52b415cb50 con 0x7f52a0004d40 2024-09-11T22:11:17.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b955a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52b40b4000 0x7f52b40b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b955a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52b40b4000 0x7f52b40b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49036/0 (socket says 172.21.15.50:49036) 2024-09-11T22:11:17.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b955a640 1 -- 172.21.15.50:0/3664570496 learned_addr learned my addr 172.21.15.50:0/3664570496 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:17.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b8d59640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52a0004d40 0x7f52b414f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b3fff640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52b406d8b0 0x7f52b406cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b955a640 1 -- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52a0004d40 msgr2=0x7f52b414f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b955a640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52a0004d40 0x7f52b414f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b955a640 1 -- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52b406d8b0 msgr2=0x7f52b406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b955a640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52b406d8b0 0x7f52b406cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b955a640 1 -- 172.21.15.50:0/3664570496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b406bda0 con 0x7f52b40b4000 2024-09-11T22:11:17.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b955a640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52b40b4000 0x7f52b40b4480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009be0 tx=0x7f52ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:17.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b17fa640 1 -- 172.21.15.50:0/3664570496 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac036040 con 0x7f52b40b4000 2024-09-11T22:11:17.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b17fa640 1 -- 172.21.15.50:0/3664570496 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac041070 con 0x7f52b40b4000 2024-09-11T22:11:17.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52bafbd640 1 -- 172.21.15.50:0/3664570496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b406c080 con 0x7f52b40b4000 2024-09-11T22:11:17.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52b17fa640 1 -- 172.21.15.50:0/3664570496 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac009690 con 0x7f52b40b4000 2024-09-11T22:11:17.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.998+0000 7f52bafbd640 1 -- 172.21.15.50:0/3664570496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b406c640 con 0x7f52b40b4000 2024-09-11T22:11:17.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:16.999+0000 7f52bafbd640 1 -- 172.21.15.50:0/3664570496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b40b49c0 con 0x7f52b40b4000 2024-09-11T22:11:17.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.000+0000 7f52b17fa640 1 -- 172.21.15.50:0/3664570496 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52ac039070 con 0x7f52b40b4000 2024-09-11T22:11:17.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.000+0000 7f52b17fa640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f529406be60 0x7f529406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.000+0000 7f52b17fa640 1 -- 172.21.15.50:0/3664570496 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f52ac0aac70 con 0x7f52b40b4000 2024-09-11T22:11:17.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.000+0000 7f52b8d59640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f529406be60 0x7f529406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.001+0000 7f52b8d59640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f529406be60 0x7f529406e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f52b40b4c10 tx=0x7f52a4006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:17.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.005+0000 7f52b17fa640 1 -- 172.21.15.50:0/3664570496 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52ac078ea0 con 0x7f52b40b4000 2024-09-11T22:11:17.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.219+0000 7f52bafbd640 1 -- 172.21.15.50:0/3664570496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52b406c840 con 0x7f52b40b4000 2024-09-11T22:11:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.220+0000 7f52b17fa640 1 -- 172.21.15.50:0/3664570496 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5214 (secure 0 0 0) 0x7f52b406c840 con 0x7f52b40b4000 2024-09-11T22:11:17.221 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:17.221 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"btime":"2024-09-11T22:11:16:865918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2971042772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2971042772},{"type":"v1","addr":"172.21.15.77:6837","nonce":2971042772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/293208439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":293208439},{"type":"v1","addr":"172.21.15.77:6835","nonce":293208439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4087237334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4087237334},{"type":"v1","addr":"172.21.15.50:6834","nonce":4087237334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:11:14.221375+0000","modified":"2024-09-11T22:11:16.209817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2305531878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2305531878},{"type":"v1","addr":"172.21.15.50:6835","nonce":2305531878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-11T22:11:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2024-09-11T22:11:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.222+0000 7f52bafbd640 1 -- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f529406be60 msgr2=0x7f529406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.222+0000 7f52bafbd640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f529406be60 0x7f529406e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f52b40b4c10 tx=0x7f52a4006040 comp rx=0 tx=0).stop 2024-09-11T22:11:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.222+0000 7f52bafbd640 1 -- 172.21.15.50:0/3664570496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52b40b4000 msgr2=0x7f52b40b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.222+0000 7f52bafbd640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52b40b4000 0x7f52b40b4480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009be0 tx=0x7f52ac004730 comp rx=0 tx=0).stop 2024-09-11T22:11:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.222+0000 7f52bafbd640 1 -- 172.21.15.50:0/3664570496 shutdown_connections 2024-09-11T22:11:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.222+0000 7f52bafbd640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f529406be60 0x7f529406e320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.222+0000 7f52bafbd640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52b40b4000 0x7f52b40b4480 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.222+0000 7f52bafbd640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52b406d8b0 0x7f52b406cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.222+0000 7f52bafbd640 1 --2- 172.21.15.50:0/3664570496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52a0004d40 0x7f52b414f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.222+0000 7f52bafbd640 1 -- 172.21.15.50:0/3664570496 >> 172.21.15.50:0/3664570496 conn(0x7f52b40b7940 msgr2=0x7f52b4070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.222+0000 7f52bafbd640 1 -- 172.21.15.50:0/3664570496 shutdown_connections 2024-09-11T22:11:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.222+0000 7f52bafbd640 1 -- 172.21.15.50:0/3664570496 wait complete. 2024-09-11T22:11:17.234 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:17.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.335+0000 7fedc03fd640 1 Processor -- start 2024-09-11T22:11:17.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.335+0000 7fedc03fd640 1 -- start start 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.336+0000 7fedc03fd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb8162a60 0x7fedb80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.336+0000 7fedc03fd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb8163080 con 0x7fedb815e8e0 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.336+0000 7fedc03fd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb80d2d20 con 0x7fedb80d1c90 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.336+0000 7fedc03fd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fedb815ecc0 con 0x7fedb8162a60 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.336+0000 7fedbe199640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fedb815e8e0 0x7fedb80d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57952/0 (socket says 172.21.15.50:57952) 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.336+0000 7fedbe199640 1 -- 172.21.15.50:0/47590624 learned_addr learned my addr 172.21.15.50:0/47590624 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.336+0000 7fedbe99a640 1 --2- 172.21.15.50:0/47590624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb8162a60 0x7fedb80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.336+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2109352387 0 0) 0x7fedb8163080 con 0x7fedb815e8e0 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.336+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feda4003520 con 0x7fedb815e8e0 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174463545 0 0) 0x7fedb80d2d20 con 0x7fedb80d1c90 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedb8163080 con 0x7fedb80d1c90 2024-09-11T22:11:17.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1512981829 0 0) 0x7feda4003520 con 0x7fedb815e8e0 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb8162a60 msgr2=0x7fedb80b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 --2- 172.21.15.50:0/47590624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb8162a60 0x7fedb80b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 >> v1:172.21.15.77:6789/0 conn(0x7fedb80d1c90 legacy=0x7fedb8162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb80d3000 con 0x7fedb815e8e0 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fedb4001670 con 0x7fedb815e8e0 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 >> v1:172.21.15.50:6789/0 conn(0x7fedb815e8e0 legacy=0x7fedb80d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 --2- 172.21.15.50:0/47590624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb8162a60 0x7feda4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 --2- 172.21.15.50:0/47590624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4004120 0x7feda4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 --2- 172.21.15.50:0/47590624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda4004d40 0x7feda40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feda400bad0 con 0x7feda4004d40 2024-09-11T22:11:17.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feda400bc80 con 0x7feda4004120 2024-09-11T22:11:17.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7feda400be80 con 0x7fedb8162a60 2024-09-11T22:11:17.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbe99a640 1 --2- 172.21.15.50:0/47590624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda4004d40 0x7feda40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbe199640 1 --2- 172.21.15.50:0/47590624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb8162a60 0x7feda4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbd998640 1 --2- 172.21.15.50:0/47590624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4004120 0x7feda4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbe99a640 1 -- 172.21.15.50:0/47590624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb8162a60 msgr2=0x7feda4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:17.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbe99a640 1 --2- 172.21.15.50:0/47590624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb8162a60 0x7feda4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbe99a640 1 -- 172.21.15.50:0/47590624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4004120 msgr2=0x7feda4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:17.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbe99a640 1 --2- 172.21.15.50:0/47590624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4004120 0x7feda4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.337+0000 7fedbe99a640 1 -- 172.21.15.50:0/47590624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda4003520 con 0x7feda4004d40 2024-09-11T22:11:17.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.338+0000 7fedbe99a640 1 --2- 172.21.15.50:0/47590624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda4004d40 0x7feda40051c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009fc0 tx=0x7feda4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272b8104159902a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:17.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.338+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0009c10 con 0x7feda4004d40 2024-09-11T22:11:17.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.338+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb0036070 con 0x7feda4004d40 2024-09-11T22:11:17.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.338+0000 7fedbd197640 1 -- 172.21.15.50:0/47590624 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0031880 con 0x7feda4004d40 2024-09-11T22:11:17.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.338+0000 7fedc03fd640 1 -- 172.21.15.50:0/47590624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda4004d40 msgr2=0x7feda40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.338+0000 7fedc03fd640 1 --2- 172.21.15.50:0/47590624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda4004d40 0x7feda40051c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009fc0 tx=0x7feda4005830 comp rx=0 tx=0).stop 2024-09-11T22:11:17.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.338+0000 7fedbe99a640 1 -- 172.21.15.50:0/47590624 reap_dead start 2024-09-11T22:11:17.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.339+0000 7fedc03fd640 1 -- 172.21.15.50:0/47590624 shutdown_connections 2024-09-11T22:11:17.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.339+0000 7fedc03fd640 1 -- 172.21.15.50:0/47590624 >> 172.21.15.50:0/47590624 conn(0x7fedb8067ba0 msgr2=0x7fedb8067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:17.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.339+0000 7fedc03fd640 1 -- 172.21.15.50:0/47590624 shutdown_connections 2024-09-11T22:11:17.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.339+0000 7fedc03fd640 1 -- 172.21.15.50:0/47590624 wait complete. 2024-09-11T22:11:17.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.340+0000 7fedc03fd640 1 Processor -- start 2024-09-11T22:11:17.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.340+0000 7fedc03fd640 1 -- start start 2024-09-11T22:11:17.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedc03fd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feda4004d40 0x7fedb815d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedc03fd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb815ce10 0x7fedb81f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedc03fd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb80cc6e0 0x7fedb80ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedc03fd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fedb80b7c90 con 0x7fedb80cc6e0 2024-09-11T22:11:17.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedc03fd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fedb80b7b10 con 0x7fedb815ce10 2024-09-11T22:11:17.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedc03fd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fedb80d2ad0 con 0x7feda4004d40 2024-09-11T22:11:17.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedbe99a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb80cc6e0 0x7fedb80ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedbe99a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb80cc6e0 0x7fedb80ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49056/0 (socket says 172.21.15.50:49056) 2024-09-11T22:11:17.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedbe99a640 1 -- 172.21.15.50:0/2582366634 learned_addr learned my addr 172.21.15.50:0/2582366634 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:17.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedbe199640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feda4004d40 0x7fedb815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedbd998640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb815ce10 0x7fedb81f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedbe99a640 1 -- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feda4004d40 msgr2=0x7fedb815d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedbe99a640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feda4004d40 0x7fedb815d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedbe99a640 1 -- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb815ce10 msgr2=0x7fedb81f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedbe99a640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb815ce10 0x7fedb81f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedbe99a640 1 -- 172.21.15.50:0/2582366634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb80cb960 con 0x7fedb80cc6e0 2024-09-11T22:11:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedbe99a640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb80cc6e0 0x7fedb80ccb60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fedb0033040 tx=0x7fedb0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedaeffd640 1 -- 172.21.15.50:0/2582366634 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0009c10 con 0x7fedb80cc6e0 2024-09-11T22:11:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedaeffd640 1 -- 172.21.15.50:0/2582366634 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb0031dd0 con 0x7fedb80cc6e0 2024-09-11T22:11:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedc03fd640 1 -- 172.21.15.50:0/2582366634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb80cbc00 con 0x7fedb80cc6e0 2024-09-11T22:11:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.341+0000 7fedaeffd640 1 -- 172.21.15.50:0/2582366634 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0003bd0 con 0x7fedb80cc6e0 2024-09-11T22:11:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.342+0000 7fedc03fd640 1 -- 172.21.15.50:0/2582366634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb815d290 con 0x7fedb80cc6e0 2024-09-11T22:11:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.343+0000 7fedc03fd640 1 -- 172.21.15.50:0/2582366634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb8162350 con 0x7fedb80cc6e0 2024-09-11T22:11:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.343+0000 7fedaeffd640 1 -- 172.21.15.50:0/2582366634 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fedb0005d10 con 0x7fedb80cc6e0 2024-09-11T22:11:17.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.343+0000 7fedaeffd640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed9c06be30 0x7fed9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.344+0000 7fedaeffd640 1 -- 172.21.15.50:0/2582366634 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fedb00ac450 con 0x7fedb80cc6e0 2024-09-11T22:11:17.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.344+0000 7fedbe199640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed9c06be30 0x7fed9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.344+0000 7fedbe199640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed9c06be30 0x7fed9c06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fedb4001050 tx=0x7fedb4000f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:17.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.348+0000 7fedaeffd640 1 -- 172.21.15.50:0/2582366634 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fedb004a060 con 0x7fedb80cc6e0 2024-09-11T22:11:17.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.524+0000 7fedc03fd640 1 -- 172.21.15.50:0/2582366634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fedb80ba770 con 0x7fedb80cc6e0 2024-09-11T22:11:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.525+0000 7fedaeffd640 1 -- 172.21.15.50:0/2582366634 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7fedb007a7b0 con 0x7fedb80cc6e0 2024-09-11T22:11:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:17.526 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:15.853220+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:12.090736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:13.202114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.527+0000 7fedc03fd640 1 -- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed9c06be30 msgr2=0x7fed9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.527+0000 7fedc03fd640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed9c06be30 0x7fed9c06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fedb4001050 tx=0x7fedb4000f80 comp rx=0 tx=0).stop 2024-09-11T22:11:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.527+0000 7fedc03fd640 1 -- 172.21.15.50:0/2582366634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb80cc6e0 msgr2=0x7fedb80ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.527+0000 7fedc03fd640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb80cc6e0 0x7fedb80ccb60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fedb0033040 tx=0x7fedb0009750 comp rx=0 tx=0).stop 2024-09-11T22:11:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.527+0000 7fedc03fd640 1 -- 172.21.15.50:0/2582366634 shutdown_connections 2024-09-11T22:11:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.527+0000 7fedc03fd640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed9c06be30 0x7fed9c06e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.527+0000 7fedc03fd640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb80cc6e0 0x7fedb80ccb60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.527+0000 7fedc03fd640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb815ce10 0x7fedb81f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.527+0000 7fedc03fd640 1 --2- 172.21.15.50:0/2582366634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feda4004d40 0x7fedb815d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.527+0000 7fedc03fd640 1 -- 172.21.15.50:0/2582366634 >> 172.21.15.50:0/2582366634 conn(0x7fedb8067ba0 msgr2=0x7fedb80d4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.527+0000 7fedc03fd640 1 -- 172.21.15.50:0/2582366634 shutdown_connections 2024-09-11T22:11:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.527+0000 7fedc03fd640 1 -- 172.21.15.50:0/2582366634 wait complete. 2024-09-11T22:11:17.539 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:11:17.539 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:11:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.640+0000 7f67e47d6640 1 Processor -- start 2024-09-11T22:11:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.640+0000 7f67e47d6640 1 -- start start 2024-09-11T22:11:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.641+0000 7f67e47d6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67dc0cf790 0x7f67dc0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.641+0000 7f67e47d6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc162110 con 0x7f67dc161d30 2024-09-11T22:11:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.641+0000 7f67e47d6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc0cfd70 con 0x7f67dc0d11d0 2024-09-11T22:11:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.641+0000 7f67e47d6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f67dc0d3450 con 0x7f67dc0cf790 2024-09-11T22:11:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.641+0000 7f67e1d71640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67dc0cf790 0x7f67dc0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.641+0000 7f67e2572640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f67dc161d30 0x7f67dc162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41098/0 (socket says 172.21.15.50:41098) 2024-09-11T22:11:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.641+0000 7f67e2572640 1 -- 172.21.15.50:0/3800769347 learned_addr learned my addr 172.21.15.50:0/3800769347 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.641+0000 7f67e1d71640 1 -- 172.21.15.50:0/3800769347 >> v1:172.21.15.77:6789/0 conn(0x7f67dc0d11d0 legacy=0x7f67dc0d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.641+0000 7f67e1d71640 1 -- 172.21.15.50:0/3800769347 >> v1:172.21.15.50:6789/0 conn(0x7f67dc161d30 legacy=0x7f67dc162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.641+0000 7f67e1d71640 1 -- 172.21.15.50:0/3800769347 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67dc0d2b20 con 0x7f67dc0cf790 2024-09-11T22:11:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.641+0000 7f67e1570640 1 -- 172.21.15.50:0/3800769347 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2304177698 0 0) 0x7f67dc162110 con 0x7f67dc161d30 2024-09-11T22:11:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.642+0000 7f67e1d71640 1 --2- 172.21.15.50:0/3800769347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67dc0cf790 0x7f67dc0b78f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f67d80097a0 tx=0x7f67d802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ed8b8fc5171ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.642+0000 7f67e1570640 1 -- 172.21.15.50:0/3800769347 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d8037070 con 0x7f67dc0cf790 2024-09-11T22:11:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.642+0000 7f67e1570640 1 -- 172.21.15.50:0/3800769347 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d8032440 con 0x7f67dc0cf790 2024-09-11T22:11:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.642+0000 7f67e1570640 1 -- 172.21.15.50:0/3800769347 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d8032810 con 0x7f67dc0cf790 2024-09-11T22:11:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.643+0000 7f67e47d6640 1 -- 172.21.15.50:0/3800769347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67dc0cf790 msgr2=0x7f67dc0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.643+0000 7f67e47d6640 1 --2- 172.21.15.50:0/3800769347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67dc0cf790 0x7f67dc0b78f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f67d80097a0 tx=0x7f67d802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.643+0000 7f67e47d6640 1 -- 172.21.15.50:0/3800769347 shutdown_connections 2024-09-11T22:11:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.643+0000 7f67e47d6640 1 --2- 172.21.15.50:0/3800769347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67dc0cf790 0x7f67dc0b78f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.643+0000 7f67e47d6640 1 -- 172.21.15.50:0/3800769347 >> 172.21.15.50:0/3800769347 conn(0x7f67dc0727a0 msgr2=0x7f67dc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.643+0000 7f67e47d6640 1 -- 172.21.15.50:0/3800769347 shutdown_connections 2024-09-11T22:11:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.643+0000 7f67e47d6640 1 -- 172.21.15.50:0/3800769347 wait complete. 2024-09-11T22:11:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.644+0000 7f67e47d6640 1 Processor -- start 2024-09-11T22:11:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.644+0000 7f67e47d6640 1 -- start start 2024-09-11T22:11:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e47d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67dc0cf790 0x7f67dc1f4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e47d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67dc0d11d0 0x7f67dc14d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e47d6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67dc161d30 0x7f67dc0c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e47d6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f67dc0d30e0 con 0x7f67dc0cf790 2024-09-11T22:11:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e47d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f67dc0b7e30 con 0x7f67dc0d11d0 2024-09-11T22:11:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e47d6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f67dc0d1600 con 0x7f67dc161d30 2024-09-11T22:11:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e2572640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67dc0cf790 0x7f67dc1f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e2572640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67dc0cf790 0x7f67dc1f4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46244/0 (socket says 172.21.15.50:46244) 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e2572640 1 -- 172.21.15.50:0/3211151869 learned_addr learned my addr 172.21.15.50:0/3211151869 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e1d71640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67dc0d11d0 0x7f67dc14d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e2572640 1 -- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67dc161d30 msgr2=0x7f67dc0c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e2d73640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67dc161d30 0x7f67dc0c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e2572640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67dc161d30 0x7f67dc0c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e2572640 1 -- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67dc0d11d0 msgr2=0x7f67dc14d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e2572640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67dc0d11d0 0x7f67dc14d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e2572640 1 -- 172.21.15.50:0/3211151869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67dc14e3d0 con 0x7f67dc0cf790 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e1d71640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67dc0d11d0 0x7f67dc14d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e2d73640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67dc161d30 0x7f67dc0c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e2572640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67dc0cf790 0x7f67dc1f4180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67d000c460 tx=0x7f67d000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67ceffd640 1 -- 172.21.15.50:0/3211151869 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d0018070 con 0x7f67dc0cf790 2024-09-11T22:11:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67ceffd640 1 -- 172.21.15.50:0/3211151869 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d0007500 con 0x7f67dc0cf790 2024-09-11T22:11:17.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67ceffd640 1 -- 172.21.15.50:0/3211151869 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d0004a20 con 0x7f67dc0cf790 2024-09-11T22:11:17.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e47d6640 1 -- 172.21.15.50:0/3211151869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67dc14e6b0 con 0x7f67dc0cf790 2024-09-11T22:11:17.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.645+0000 7f67e47d6640 1 -- 172.21.15.50:0/3211151869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67dc14ec70 con 0x7f67dc0cf790 2024-09-11T22:11:17.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.646+0000 7f67e47d6640 1 -- 172.21.15.50:0/3211151869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67dc0d1920 con 0x7f67dc0cf790 2024-09-11T22:11:17.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.647+0000 7f67ceffd640 1 -- 172.21.15.50:0/3211151869 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67d001b070 con 0x7f67dc0cf790 2024-09-11T22:11:17.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.647+0000 7f67ceffd640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67c006be30 0x7f67c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.648+0000 7f67ceffd640 1 -- 172.21.15.50:0/3211151869 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f67d008a110 con 0x7f67dc0cf790 2024-09-11T22:11:17.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.648+0000 7f67e1d71640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67c006be30 0x7f67c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.648+0000 7f67e1d71640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67c006be30 0x7f67c006e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f67d8034000 tx=0x7f67d802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:17.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.652+0000 7f67ceffd640 1 -- 172.21.15.50:0/3211151869 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67d0058ac0 con 0x7f67dc0cf790 2024-09-11T22:11:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.824+0000 7f67e47d6640 1 -- 172.21.15.50:0/3211151869 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67dc0d2900 con 0x7f67c006be30 2024-09-11T22:11:17.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.830+0000 7f67ceffd640 1 -- 172.21.15.50:0/3211151869 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245277 (secure 0 0 0) 0x7f67dc0d2900 con 0x7f67c006be30 2024-09-11T22:11:17.834 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:17.835 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:11:17.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.834+0000 7f67e47d6640 1 -- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67c006be30 msgr2=0x7f67c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.834+0000 7f67e47d6640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67c006be30 0x7f67c006e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f67d8034000 tx=0x7f67d802e000 comp rx=0 tx=0).stop 2024-09-11T22:11:17.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.834+0000 7f67e47d6640 1 -- 172.21.15.50:0/3211151869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67dc0cf790 msgr2=0x7f67dc1f4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.834+0000 7f67e47d6640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67dc0cf790 0x7f67dc1f4180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67d000c460 tx=0x7f67d000c920 comp rx=0 tx=0).stop 2024-09-11T22:11:17.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.834+0000 7f67e47d6640 1 -- 172.21.15.50:0/3211151869 shutdown_connections 2024-09-11T22:11:17.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.834+0000 7f67e47d6640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67c006be30 0x7f67c006e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.834+0000 7f67e47d6640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67dc161d30 0x7f67dc0c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.834+0000 7f67e47d6640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67dc0d11d0 0x7f67dc14d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.834+0000 7f67e47d6640 1 --2- 172.21.15.50:0/3211151869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67dc0cf790 0x7f67dc1f4180 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.834+0000 7f67e47d6640 1 -- 172.21.15.50:0/3211151869 >> 172.21.15.50:0/3211151869 conn(0x7f67dc0727a0 msgr2=0x7f67dc0cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:17.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.834+0000 7f67e47d6640 1 -- 172.21.15.50:0/3211151869 shutdown_connections 2024-09-11T22:11:17.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.834+0000 7f67e47d6640 1 -- 172.21.15.50:0/3211151869 wait complete. 2024-09-11T22:11:17.845 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-11T22:11:17.363984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240164,"kb_used_data":2516,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734556,"statfs":{"total":773094113280,"available":772848185344,"internally_reserved":0,"allocated":2576384,"data_stored":1615145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.516729"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859411+0000","last_change":"2024-09-11T22:11:13.859411+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859411+0000","last_undegraded":"2024-09-11T22:11:13.859411+0000","last_fullsized":"2024-09-11T22:11:13.859411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862599+0000","last_change":"2024-09-11T22:11:13.862599+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862599+0000","last_undegraded":"2024-09-11T22:11:13.862599+0000","last_fullsized":"2024-09-11T22:11:13.862599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861017+0000","last_change":"2024-09-11T22:11:13.861017+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861017+0000","last_undegraded":"2024-09-11T22:11:13.861017+0000","last_fullsized":"2024-09-11T22:11:13.861017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861590+0000","last_change":"2024-09-11T22:11:13.861590+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861590+0000","last_undegraded":"2024-09-11T22:11:13.861590+0000","last_fullsized":"2024-09-11T22:11:13.861590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860051+0000","last_change":"2024-09-11T22:11:13.860051+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860051+0000","last_undegraded":"2024-09-11T22:11:13.860051+0000","last_fullsized":"2024-09-11T22:11:13.860051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862308+0000","last_change":"2024-09-11T22:11:13.862308+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862308+0000","last_undegraded":"2024-09-11T22:11:13.862308+0000","last_fullsized":"2024-09-11T22:11:13.862308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862604+0000","last_change":"2024-09-11T22:11:13.862604+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862604+0000","last_undegraded":"2024-09-11T22:11:13.862604+0000","last_fullsized":"2024-09-11T22:11:13.862604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.856300+0000","last_change":"2024-09-11T22:11:13.856300+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.856300+0000","last_undegraded":"2024-09-11T22:11:13.856300+0000","last_fullsized":"2024-09-11T22:11:13.856300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860205+0000","last_change":"2024-09-11T22:11:13.860205+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860205+0000","last_undegraded":"2024-09-11T22:11:13.860205+0000","last_fullsized":"2024-09-11T22:11:13.860205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862690+0000","last_change":"2024-09-11T22:11:13.862690+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862690+0000","last_undegraded":"2024-09-11T22:11:13.862690+0000","last_fullsized":"2024-09-11T22:11:13.862690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861883+0000","last_change":"2024-09-11T22:11:13.861883+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861883+0000","last_undegraded":"2024-09-11T22:11:13.861883+0000","last_fullsized":"2024-09-11T22:11:13.861883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860012+0000","last_change":"2024-09-11T22:11:13.860012+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860012+0000","last_undegraded":"2024-09-11T22:11:13.860012+0000","last_fullsized":"2024-09-11T22:11:13.860012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857285+0000","last_change":"2024-09-11T22:11:13.857285+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857285+0000","last_undegraded":"2024-09-11T22:11:13.857285+0000","last_fullsized":"2024-09-11T22:11:13.857285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.873986+0000","last_change":"2024-09-11T22:11:14.869711+0000","last_active":"2024-09-11T22:11:14.873986+0000","last_peered":"2024-09-11T22:11:14.873986+0000","last_clean":"2024-09-11T22:11:14.873986+0000","last_became_active":"2024-09-11T22:11:14.869409+0000","last_became_peered":"2024-09-11T22:11:14.869409+0000","last_unstale":"2024-09-11T22:11:14.873986+0000","last_undegraded":"2024-09-11T22:11:14.873986+0000","last_fullsized":"2024-09-11T22:11:14.873986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:38.715172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860357+0000","last_change":"2024-09-11T22:11:13.860357+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860357+0000","last_undegraded":"2024-09-11T22:11:13.860357+0000","last_fullsized":"2024-09-11T22:11:13.860357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862078+0000","last_change":"2024-09-11T22:11:13.862078+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862078+0000","last_undegraded":"2024-09-11T22:11:13.862078+0000","last_fullsized":"2024-09-11T22:11:13.862078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859418+0000","last_change":"2024-09-11T22:11:13.859418+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859418+0000","last_undegraded":"2024-09-11T22:11:13.859418+0000","last_fullsized":"2024-09-11T22:11:13.859418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859088+0000","last_change":"2024-09-11T22:11:13.859088+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859088+0000","last_undegraded":"2024-09-11T22:11:13.859088+0000","last_fullsized":"2024-09-11T22:11:13.859088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857107+0000","last_change":"2024-09-11T22:11:13.857107+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857107+0000","last_undegraded":"2024-09-11T22:11:13.857107+0000","last_fullsized":"2024-09-11T22:11:13.857107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860681+0000","last_change":"2024-09-11T22:11:13.860681+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860681+0000","last_undegraded":"2024-09-11T22:11:13.860681+0000","last_fullsized":"2024-09-11T22:11:13.860681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861820+0000","last_change":"2024-09-11T22:11:13.861820+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861820+0000","last_undegraded":"2024-09-11T22:11:13.861820+0000","last_fullsized":"2024-09-11T22:11:13.861820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862280+0000","last_change":"2024-09-11T22:11:13.862280+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862280+0000","last_undegraded":"2024-09-11T22:11:13.862280+0000","last_fullsized":"2024-09-11T22:11:13.862280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858813+0000","last_change":"2024-09-11T22:11:13.858813+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858813+0000","last_undegraded":"2024-09-11T22:11:13.858813+0000","last_fullsized":"2024-09-11T22:11:13.858813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861391+0000","last_change":"2024-09-11T22:11:13.861391+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861391+0000","last_undegraded":"2024-09-11T22:11:13.861391+0000","last_fullsized":"2024-09-11T22:11:13.861391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858569+0000","last_change":"2024-09-11T22:11:13.858569+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858569+0000","last_undegraded":"2024-09-11T22:11:13.858569+0000","last_fullsized":"2024-09-11T22:11:13.858569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.877104+0000","last_change":"2024-09-11T22:11:14.872267+0000","last_active":"2024-09-11T22:11:14.877104+0000","last_peered":"2024-09-11T22:11:14.877104+0000","last_clean":"2024-09-11T22:11:14.877104+0000","last_became_active":"2024-09-11T22:11:14.871979+0000","last_became_peered":"2024-09-11T22:11:14.871979+0000","last_unstale":"2024-09-11T22:11:14.877104+0000","last_undegraded":"2024-09-11T22:11:14.877104+0000","last_fullsized":"2024-09-11T22:11:14.877104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:27.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861026+0000","last_change":"2024-09-11T22:11:13.861026+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861026+0000","last_undegraded":"2024-09-11T22:11:13.861026+0000","last_fullsized":"2024-09-11T22:11:13.861026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.855770+0000","last_change":"2024-09-11T22:11:13.855770+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.855770+0000","last_undegraded":"2024-09-11T22:11:13.855770+0000","last_fullsized":"2024-09-11T22:11:13.855770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872936+0000","last_change":"2024-09-11T22:11:13.870101+0000","last_active":"2024-09-11T22:11:13.872936+0000","last_peered":"2024-09-11T22:11:13.872936+0000","last_clean":"2024-09-11T22:11:13.872936+0000","last_became_active":"2024-09-11T22:11:13.869798+0000","last_became_peered":"2024-09-11T22:11:13.869798+0000","last_unstale":"2024-09-11T22:11:13.872936+0000","last_undegraded":"2024-09-11T22:11:13.872936+0000","last_fullsized":"2024-09-11T22:11:13.872936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859814+0000","last_change":"2024-09-11T22:11:13.859814+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859814+0000","last_undegraded":"2024-09-11T22:11:13.859814+0000","last_fullsized":"2024-09-11T22:11:13.859814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875333+0000","last_change":"2024-09-11T22:11:13.871132+0000","last_active":"2024-09-11T22:11:13.875333+0000","last_peered":"2024-09-11T22:11:13.875333+0000","last_clean":"2024-09-11T22:11:13.875333+0000","last_became_active":"2024-09-11T22:11:13.870831+0000","last_became_peered":"2024-09-11T22:11:13.870831+0000","last_unstale":"2024-09-11T22:11:13.875333+0000","last_undegraded":"2024-09-11T22:11:13.875333+0000","last_fullsized":"2024-09-11T22:11:13.875333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872921+0000","last_change":"2024-09-11T22:11:13.871011+0000","last_active":"2024-09-11T22:11:13.872921+0000","last_peered":"2024-09-11T22:11:13.872921+0000","last_clean":"2024-09-11T22:11:13.872921+0000","last_became_active":"2024-09-11T22:11:13.870723+0000","last_became_peered":"2024-09-11T22:11:13.870723+0000","last_unstale":"2024-09-11T22:11:13.872921+0000","last_undegraded":"2024-09-11T22:11:13.872921+0000","last_fullsized":"2024-09-11T22:11:13.872921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859534+0000","last_change":"2024-09-11T22:11:13.859534+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859534+0000","last_undegraded":"2024-09-11T22:11:13.859534+0000","last_fullsized":"2024-09-11T22:11:13.859534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873131+0000","last_change":"2024-09-11T22:11:13.867235+0000","last_active":"2024-09-11T22:11:13.873131+0000","last_peered":"2024-09-11T22:11:13.873131+0000","last_clean":"2024-09-11T22:11:13.873131+0000","last_became_active":"2024-09-11T22:11:13.866963+0000","last_became_peered":"2024-09-11T22:11:13.866963+0000","last_unstale":"2024-09-11T22:11:13.873131+0000","last_undegraded":"2024-09-11T22:11:13.873131+0000","last_fullsized":"2024-09-11T22:11:13.873131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.864339+0000","last_change":"2024-09-11T22:11:13.864339+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.864339+0000","last_undegraded":"2024-09-11T22:11:13.864339+0000","last_fullsized":"2024-09-11T22:11:13.864339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875784+0000","last_change":"2024-09-11T22:11:13.874393+0000","last_active":"2024-09-11T22:11:13.875784+0000","last_peered":"2024-09-11T22:11:13.875784+0000","last_clean":"2024-09-11T22:11:13.875784+0000","last_became_active":"2024-09-11T22:11:13.874074+0000","last_became_peered":"2024-09-11T22:11:13.874074+0000","last_unstale":"2024-09-11T22:11:13.875784+0000","last_undegraded":"2024-09-11T22:11:13.875784+0000","last_fullsized":"2024-09-11T22:11:13.875784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:15.850187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857158+0000","last_change":"2024-09-11T22:11:13.857158+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857158+0000","last_undegraded":"2024-09-11T22:11:13.857158+0000","last_fullsized":"2024-09-11T22:11:13.857158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875288+0000","last_change":"2024-09-11T22:11:13.870015+0000","last_active":"2024-09-11T22:11:13.875288+0000","last_peered":"2024-09-11T22:11:13.875288+0000","last_clean":"2024-09-11T22:11:13.875288+0000","last_became_active":"2024-09-11T22:11:13.869685+0000","last_became_peered":"2024-09-11T22:11:13.869685+0000","last_unstale":"2024-09-11T22:11:13.875288+0000","last_undegraded":"2024-09-11T22:11:13.875288+0000","last_fullsized":"2024-09-11T22:11:13.875288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:15.850187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858952+0000","last_change":"2024-09-11T22:11:13.858952+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858952+0000","last_undegraded":"2024-09-11T22:11:13.858952+0000","last_fullsized":"2024-09-11T22:11:13.858952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873044+0000","last_change":"2024-09-11T22:11:13.870967+0000","last_active":"2024-09-11T22:11:13.873044+0000","last_peered":"2024-09-11T22:11:13.873044+0000","last_clean":"2024-09-11T22:11:13.873044+0000","last_became_active":"2024-09-11T22:11:13.870687+0000","last_became_peered":"2024-09-11T22:11:13.870687+0000","last_unstale":"2024-09-11T22:11:13.873044+0000","last_undegraded":"2024-09-11T22:11:13.873044+0000","last_fullsized":"2024-09-11T22:11:13.873044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.855170+0000","last_change":"2024-09-11T22:11:13.855170+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.855170+0000","last_undegraded":"2024-09-11T22:11:13.855170+0000","last_fullsized":"2024-09-11T22:11:13.855170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875742+0000","last_change":"2024-09-11T22:11:13.873578+0000","last_active":"2024-09-11T22:11:13.875742+0000","last_peered":"2024-09-11T22:11:13.875742+0000","last_clean":"2024-09-11T22:11:13.875742+0000","last_became_active":"2024-09-11T22:11:13.873273+0000","last_became_peered":"2024-09-11T22:11:13.873273+0000","last_unstale":"2024-09-11T22:11:13.875742+0000","last_undegraded":"2024-09-11T22:11:13.875742+0000","last_fullsized":"2024-09-11T22:11:13.875742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.867715+0000","last_change":"2024-09-11T22:11:13.863099+0000","last_active":"2024-09-11T22:11:13.867715+0000","last_peered":"2024-09-11T22:11:13.867715+0000","last_clean":"2024-09-11T22:11:13.867715+0000","last_became_active":"2024-09-11T22:11:13.862812+0000","last_became_peered":"2024-09-11T22:11:13.862812+0000","last_unstale":"2024-09-11T22:11:13.867715+0000","last_undegraded":"2024-09-11T22:11:13.867715+0000","last_fullsized":"2024-09-11T22:11:13.867715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:53.690138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857829+0000","last_change":"2024-09-11T22:11:13.857829+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857829+0000","last_undegraded":"2024-09-11T22:11:13.857829+0000","last_fullsized":"2024-09-11T22:11:13.857829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873043+0000","last_change":"2024-09-11T22:11:13.866150+0000","last_active":"2024-09-11T22:11:13.873043+0000","last_peered":"2024-09-11T22:11:13.873043+0000","last_clean":"2024-09-11T22:11:13.873043+0000","last_became_active":"2024-09-11T22:11:13.865864+0000","last_became_peered":"2024-09-11T22:11:13.865864+0000","last_unstale":"2024-09-11T22:11:13.873043+0000","last_undegraded":"2024-09-11T22:11:13.873043+0000","last_fullsized":"2024-09-11T22:11:13.873043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875718+0000","last_change":"2024-09-11T22:11:13.873542+0000","last_active":"2024-09-11T22:11:13.875718+0000","last_peered":"2024-09-11T22:11:13.875718+0000","last_clean":"2024-09-11T22:11:13.875718+0000","last_became_active":"2024-09-11T22:11:13.873248+0000","last_became_peered":"2024-09-11T22:11:13.873248+0000","last_unstale":"2024-09-11T22:11:13.875718+0000","last_undegraded":"2024-09-11T22:11:13.875718+0000","last_fullsized":"2024-09-11T22:11:13.875718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859651+0000","last_change":"2024-09-11T22:11:13.859651+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859651+0000","last_undegraded":"2024-09-11T22:11:13.859651+0000","last_fullsized":"2024-09-11T22:11:13.859651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.889885+0000","last_change":"2024-09-11T22:11:13.870778+0000","last_active":"2024-09-11T22:11:14.889885+0000","last_peered":"2024-09-11T22:11:14.889885+0000","last_clean":"2024-09-11T22:11:14.889885+0000","last_became_active":"2024-09-11T22:11:13.870346+0000","last_became_peered":"2024-09-11T22:11:13.870346+0000","last_unstale":"2024-09-11T22:11:14.889885+0000","last_undegraded":"2024-09-11T22:11:14.889885+0000","last_fullsized":"2024-09-11T22:11:14.889885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:43.931796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.865199+0000","last_change":"2024-09-11T22:11:13.864325+0000","last_active":"2024-09-11T22:11:13.865199+0000","last_peered":"2024-09-11T22:11:13.865199+0000","last_clean":"2024-09-11T22:11:13.865199+0000","last_became_active":"2024-09-11T22:11:13.862906+0000","last_became_peered":"2024-09-11T22:11:13.862906+0000","last_unstale":"2024-09-11T22:11:13.865199+0000","last_undegraded":"2024-09-11T22:11:13.865199+0000","last_fullsized":"2024-09-11T22:11:13.865199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.888351+0000","last_change":"2024-09-11T22:11:13.865829+0000","last_active":"2024-09-11T22:11:14.888351+0000","last_peered":"2024-09-11T22:11:14.888351+0000","last_clean":"2024-09-11T22:11:14.888351+0000","last_became_active":"2024-09-11T22:11:13.865535+0000","last_became_peered":"2024-09-11T22:11:13.865535+0000","last_unstale":"2024-09-11T22:11:14.888351+0000","last_undegraded":"2024-09-11T22:11:14.888351+0000","last_fullsized":"2024-09-11T22:11:14.888351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:47.814287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.874256+0000","last_change":"2024-09-11T22:11:13.873640+0000","last_active":"2024-09-11T22:11:13.874256+0000","last_peered":"2024-09-11T22:11:13.874256+0000","last_clean":"2024-09-11T22:11:13.874256+0000","last_became_active":"2024-09-11T22:11:13.873311+0000","last_became_peered":"2024-09-11T22:11:13.873311+0000","last_unstale":"2024-09-11T22:11:13.874256+0000","last_undegraded":"2024-09-11T22:11:13.874256+0000","last_fullsized":"2024-09-11T22:11:13.874256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857262+0000","last_change":"2024-09-11T22:11:13.857262+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857262+0000","last_undegraded":"2024-09-11T22:11:13.857262+0000","last_fullsized":"2024-09-11T22:11:13.857262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.864960+0000","last_change":"2024-09-11T22:11:13.870777+0000","last_active":"2024-09-11T22:11:14.864960+0000","last_peered":"2024-09-11T22:11:14.864960+0000","last_clean":"2024-09-11T22:11:14.864960+0000","last_became_active":"2024-09-11T22:11:13.869718+0000","last_became_peered":"2024-09-11T22:11:13.869718+0000","last_unstale":"2024-09-11T22:11:14.864960+0000","last_undegraded":"2024-09-11T22:11:14.864960+0000","last_fullsized":"2024-09-11T22:11:14.864960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:24.001331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-11T22:11:06.461014+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:11:06.461014+0000","last_peered":"2024-09-11T22:11:06.461014+0000","last_clean":"2024-09-11T22:11:06.461014+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:11:06.461014+0000","last_undegraded":"2024-09-11T22:11:06.461014+0000","last_fullsized":"2024-09-11T22:11:06.461014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.865987+0000","last_change":"2024-09-11T22:11:13.863848+0000","last_active":"2024-09-11T22:11:13.865987+0000","last_peered":"2024-09-11T22:11:13.865987+0000","last_clean":"2024-09-11T22:11:13.865987+0000","last_became_active":"2024-09-11T22:11:13.863555+0000","last_became_peered":"2024-09-11T22:11:13.863555+0000","last_unstale":"2024-09-11T22:11:13.865987+0000","last_undegraded":"2024-09-11T22:11:13.865987+0000","last_fullsized":"2024-09-11T22:11:13.865987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858270+0000","last_change":"2024-09-11T22:11:13.858270+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858270+0000","last_undegraded":"2024-09-11T22:11:13.858270+0000","last_fullsized":"2024-09-11T22:11:13.858270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857452+0000","last_change":"2024-09-11T22:11:13.857452+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857452+0000","last_undegraded":"2024-09-11T22:11:13.857452+0000","last_fullsized":"2024-09-11T22:11:13.857452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.865376+0000","last_change":"2024-09-11T22:11:13.865189+0000","last_active":"2024-09-11T22:11:14.865376+0000","last_peered":"2024-09-11T22:11:14.865376+0000","last_clean":"2024-09-11T22:11:14.865376+0000","last_became_active":"2024-09-11T22:11:13.864912+0000","last_became_peered":"2024-09-11T22:11:13.864912+0000","last_unstale":"2024-09-11T22:11:14.865376+0000","last_undegraded":"2024-09-11T22:11:14.865376+0000","last_fullsized":"2024-09-11T22:11:14.865376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:20.511994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859844+0000","last_change":"2024-09-11T22:11:13.859844+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859844+0000","last_undegraded":"2024-09-11T22:11:13.859844+0000","last_fullsized":"2024-09-11T22:11:13.859844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873228+0000","last_change":"2024-09-11T22:11:13.867676+0000","last_active":"2024-09-11T22:11:13.873228+0000","last_peered":"2024-09-11T22:11:13.873228+0000","last_clean":"2024-09-11T22:11:13.873228+0000","last_became_active":"2024-09-11T22:11:13.867391+0000","last_became_peered":"2024-09-11T22:11:13.867391+0000","last_unstale":"2024-09-11T22:11:13.873228+0000","last_undegraded":"2024-09-11T22:11:13.873228+0000","last_fullsized":"2024-09-11T22:11:13.873228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.856164+0000","last_change":"2024-09-11T22:11:13.856164+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.856164+0000","last_undegraded":"2024-09-11T22:11:13.856164+0000","last_fullsized":"2024-09-11T22:11:13.856164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.870592+0000","last_change":"2024-09-11T22:11:13.868171+0000","last_active":"2024-09-11T22:11:13.870592+0000","last_peered":"2024-09-11T22:11:13.870592+0000","last_clean":"2024-09-11T22:11:13.870592+0000","last_became_active":"2024-09-11T22:11:13.867826+0000","last_became_peered":"2024-09-11T22:11:13.867826+0000","last_unstale":"2024-09-11T22:11:13.870592+0000","last_undegraded":"2024-09-11T22:11:13.870592+0000","last_fullsized":"2024-09-11T22:11:13.870592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:53.690138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858030+0000","last_change":"2024-09-11T22:11:13.858030+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858030+0000","last_undegraded":"2024-09-11T22:11:13.858030+0000","last_fullsized":"2024-09-11T22:11:13.858030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857970+0000","last_change":"2024-09-11T22:11:13.857970+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857970+0000","last_undegraded":"2024-09-11T22:11:13.857970+0000","last_fullsized":"2024-09-11T22:11:13.857970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873159+0000","last_change":"2024-09-11T22:11:13.872366+0000","last_active":"2024-09-11T22:11:13.873159+0000","last_peered":"2024-09-11T22:11:13.873159+0000","last_clean":"2024-09-11T22:11:13.873159+0000","last_became_active":"2024-09-11T22:11:13.872085+0000","last_became_peered":"2024-09-11T22:11:13.872085+0000","last_unstale":"2024-09-11T22:11:13.873159+0000","last_undegraded":"2024-09-11T22:11:13.873159+0000","last_fullsized":"2024-09-11T22:11:13.873159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857777+0000","last_change":"2024-09-11T22:11:13.857777+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857777+0000","last_undegraded":"2024-09-11T22:11:13.857777+0000","last_fullsized":"2024-09-11T22:11:13.857777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872843+0000","last_change":"2024-09-11T22:11:13.869408+0000","last_active":"2024-09-11T22:11:13.872843+0000","last_peered":"2024-09-11T22:11:13.872843+0000","last_clean":"2024-09-11T22:11:13.872843+0000","last_became_active":"2024-09-11T22:11:13.869118+0000","last_became_peered":"2024-09-11T22:11:13.869118+0000","last_unstale":"2024-09-11T22:11:13.872843+0000","last_undegraded":"2024-09-11T22:11:13.872843+0000","last_fullsized":"2024-09-11T22:11:13.872843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.856979+0000","last_change":"2024-09-11T22:11:13.856979+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.856979+0000","last_undegraded":"2024-09-11T22:11:13.856979+0000","last_fullsized":"2024-09-11T22:11:13.856979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.855308+0000","last_change":"2024-09-11T22:11:13.855308+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.855308+0000","last_undegraded":"2024-09-11T22:11:13.855308+0000","last_fullsized":"2024-09-11T22:11:13.855308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873166+0000","last_change":"2024-09-11T22:11:13.872102+0000","last_active":"2024-09-11T22:11:13.873166+0000","last_peered":"2024-09-11T22:11:13.873166+0000","last_clean":"2024-09-11T22:11:13.873166+0000","last_became_active":"2024-09-11T22:11:13.871744+0000","last_became_peered":"2024-09-11T22:11:13.871744+0000","last_unstale":"2024-09-11T22:11:13.873166+0000","last_undegraded":"2024-09-11T22:11:13.873166+0000","last_fullsized":"2024-09-11T22:11:13.873166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858251+0000","last_change":"2024-09-11T22:11:13.858251+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858251+0000","last_undegraded":"2024-09-11T22:11:13.858251+0000","last_fullsized":"2024-09-11T22:11:13.858251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.867429+0000","last_change":"2024-09-11T22:11:13.866539+0000","last_active":"2024-09-11T22:11:13.867429+0000","last_peered":"2024-09-11T22:11:13.867429+0000","last_clean":"2024-09-11T22:11:13.867429+0000","last_became_active":"2024-09-11T22:11:13.866049+0000","last_became_peered":"2024-09-11T22:11:13.866049+0000","last_unstale":"2024-09-11T22:11:13.867429+0000","last_undegraded":"2024-09-11T22:11:13.867429+0000","last_fullsized":"2024-09-11T22:11:13.867429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:52.623769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859720+0000","last_change":"2024-09-11T22:11:13.859720+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859720+0000","last_undegraded":"2024-09-11T22:11:13.859720+0000","last_fullsized":"2024-09-11T22:11:13.859720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862009+0000","last_change":"2024-09-11T22:11:13.862009+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862009+0000","last_undegraded":"2024-09-11T22:11:13.862009+0000","last_fullsized":"2024-09-11T22:11:13.862009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859680+0000","last_change":"2024-09-11T22:11:13.859680+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859680+0000","last_undegraded":"2024-09-11T22:11:13.859680+0000","last_fullsized":"2024-09-11T22:11:13.859680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859918+0000","last_change":"2024-09-11T22:11:13.859918+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859918+0000","last_undegraded":"2024-09-11T22:11:13.859918+0000","last_fullsized":"2024-09-11T22:11:13.859918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859730+0000","last_change":"2024-09-11T22:11:13.859730+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859730+0000","last_undegraded":"2024-09-11T22:11:13.859730+0000","last_fullsized":"2024-09-11T22:11:13.859730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872861+0000","last_change":"2024-09-11T22:11:13.869743+0000","last_active":"2024-09-11T22:11:13.872861+0000","last_peered":"2024-09-11T22:11:13.872861+0000","last_clean":"2024-09-11T22:11:13.872861+0000","last_became_active":"2024-09-11T22:11:13.868457+0000","last_became_peered":"2024-09-11T22:11:13.868457+0000","last_unstale":"2024-09-11T22:11:13.872861+0000","last_undegraded":"2024-09-11T22:11:13.872861+0000","last_fullsized":"2024-09-11T22:11:13.872861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:53.690138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859809+0000","last_change":"2024-09-11T22:11:13.859809+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859809+0000","last_undegraded":"2024-09-11T22:11:13.859809+0000","last_fullsized":"2024-09-11T22:11:13.859809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.869281+0000","last_change":"2024-09-11T22:11:13.866359+0000","last_active":"2024-09-11T22:11:13.869281+0000","last_peered":"2024-09-11T22:11:13.869281+0000","last_clean":"2024-09-11T22:11:13.869281+0000","last_became_active":"2024-09-11T22:11:13.866072+0000","last_became_peered":"2024-09-11T22:11:13.866072+0000","last_unstale":"2024-09-11T22:11:13.869281+0000","last_undegraded":"2024-09-11T22:11:13.869281+0000","last_fullsized":"2024-09-11T22:11:13.869281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":52,"acting":52,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509443,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":753664,"data_stored":637948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35544,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336296,"statfs":{"total":96636764160,"available":96600367104,"internally_reserved":0,"allocated":196608,"data_stored":66447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:11:17.849 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:11:17.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.987+0000 7f788f78d640 1 Processor -- start 2024-09-11T22:11:17.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.987+0000 7f788f78d640 1 -- start start 2024-09-11T22:11:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.988+0000 7f788f78d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f788815e870 0x7f78880d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.988+0000 7f788f78d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78880d16d0 0x7f78880d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.988+0000 7f788f78d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78880cfa80 con 0x7f78880d3a30 2024-09-11T22:11:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.988+0000 7f788f78d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f78880d1b40 con 0x7f78880d16d0 2024-09-11T22:11:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.988+0000 7f788f78d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f78880d3e50 con 0x7f788815e870 2024-09-11T22:11:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.988+0000 7f788cd28640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78880d16d0 0x7f78880d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.988+0000 7f788cd28640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78880d16d0 0x7f78880d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46252/0 (socket says 172.21.15.50:46252) 2024-09-11T22:11:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.988+0000 7f788cd28640 1 -- 172.21.15.50:0/217579493 learned_addr learned my addr 172.21.15.50:0/217579493 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.988+0000 7f788d529640 1 --2- 172.21.15.50:0/217579493 >> v2:172.21.15.77:3300/0 conn(0x7f788815e870 0x7f78880d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.988+0000 7f788cd28640 1 -- 172.21.15.50:0/217579493 >> v2:172.21.15.77:3300/0 conn(0x7f788815e870 msgr2=0x7f78880d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:17.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.988+0000 7f788cd28640 1 --2- 172.21.15.50:0/217579493 >> v2:172.21.15.77:3300/0 conn(0x7f788815e870 0x7f78880d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.988+0000 7f788cd28640 1 -- 172.21.15.50:0/217579493 >> v1:172.21.15.77:6789/0 conn(0x7f78880d3a30 legacy=0x7f78880b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.988+0000 7f788cd28640 1 -- 172.21.15.50:0/217579493 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78880d40d0 con 0x7f78880d16d0 2024-09-11T22:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.989+0000 7f788cd28640 1 --2- 172.21.15.50:0/217579493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78880d16d0 0x7f78880d34f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f78880d57c0 tx=0x7f787802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce9918fa1028c00 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.989+0000 7f787ffff640 1 -- 172.21.15.50:0/217579493 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878037070 con 0x7f78880d16d0 2024-09-11T22:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.989+0000 7f787ffff640 1 -- 172.21.15.50:0/217579493 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7878032440 con 0x7f78880d16d0 2024-09-11T22:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.989+0000 7f787ffff640 1 -- 172.21.15.50:0/217579493 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878032810 con 0x7f78880d16d0 2024-09-11T22:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.990+0000 7f788f78d640 1 -- 172.21.15.50:0/217579493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78880d16d0 msgr2=0x7f78880d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.990+0000 7f788f78d640 1 --2- 172.21.15.50:0/217579493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78880d16d0 0x7f78880d34f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f78880d57c0 tx=0x7f787802a270 comp rx=0 tx=0).stop 2024-09-11T22:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.990+0000 7f788f78d640 1 -- 172.21.15.50:0/217579493 shutdown_connections 2024-09-11T22:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.990+0000 7f788f78d640 1 --2- 172.21.15.50:0/217579493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78880d16d0 0x7f78880d34f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.990+0000 7f788f78d640 1 --2- 172.21.15.50:0/217579493 >> v2:172.21.15.77:3300/0 conn(0x7f788815e870 0x7f78880d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.990+0000 7f788f78d640 1 -- 172.21.15.50:0/217579493 >> 172.21.15.50:0/217579493 conn(0x7f78880727a0 msgr2=0x7f78880679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:17.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.990+0000 7f788f78d640 1 -- 172.21.15.50:0/217579493 shutdown_connections 2024-09-11T22:11:17.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.990+0000 7f788f78d640 1 -- 172.21.15.50:0/217579493 wait complete. 2024-09-11T22:11:17.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.991+0000 7f788f78d640 1 Processor -- start 2024-09-11T22:11:17.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.991+0000 7f788f78d640 1 -- start start 2024-09-11T22:11:17.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788f78d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78880d16d0 0x7f788814db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788f78d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880d3a30 0x7f78880c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788f78d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f788815e870 0x7f78880b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788f78d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f78880b7ee0 con 0x7f78880d16d0 2024-09-11T22:11:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788f78d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f78880b7c00 con 0x7f78880d3a30 2024-09-11T22:11:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788f78d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f788815ec50 con 0x7f788815e870 2024-09-11T22:11:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788d529640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78880d16d0 0x7f788814db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788d529640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78880d16d0 0x7f788814db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46260/0 (socket says 172.21.15.50:46260) 2024-09-11T22:11:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788d529640 1 -- 172.21.15.50:0/2910363812 learned_addr learned my addr 172.21.15.50:0/2910363812 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788cd28640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880d3a30 0x7f78880c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788dd2a640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f788815e870 0x7f78880b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788d529640 1 -- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f788815e870 msgr2=0x7f78880b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788d529640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f788815e870 0x7f78880b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788d529640 1 -- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880d3a30 msgr2=0x7f78880c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788d529640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880d3a30 0x7f78880c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788d529640 1 -- 172.21.15.50:0/2910363812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78880ca280 con 0x7f78880d16d0 2024-09-11T22:11:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788d529640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78880d16d0 0x7f788814db20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f788400e8a0 tx=0x7f788400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f787dffb640 1 -- 172.21.15.50:0/2910363812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7884017070 con 0x7f78880d16d0 2024-09-11T22:11:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f787dffb640 1 -- 172.21.15.50:0/2910363812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788400c940 con 0x7f78880d16d0 2024-09-11T22:11:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f787dffb640 1 -- 172.21.15.50:0/2910363812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788400cd30 con 0x7f78880d16d0 2024-09-11T22:11:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.992+0000 7f788f78d640 1 -- 172.21.15.50:0/2910363812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78880ca560 con 0x7f78880d16d0 2024-09-11T22:11:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.993+0000 7f788f78d640 1 -- 172.21.15.50:0/2910363812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78880cab20 con 0x7f78880d16d0 2024-09-11T22:11:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.993+0000 7f788f78d640 1 -- 172.21.15.50:0/2910363812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7888068600 con 0x7f78880d16d0 2024-09-11T22:11:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.994+0000 7f787dffb640 1 -- 172.21.15.50:0/2910363812 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f788401a070 con 0x7f78880d16d0 2024-09-11T22:11:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.994+0000 7f787dffb640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f786c06be60 0x7f786c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.995+0000 7f787dffb640 1 -- 172.21.15.50:0/2910363812 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f788408afc0 con 0x7f78880d16d0 2024-09-11T22:11:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.995+0000 7f788cd28640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f786c06be60 0x7f786c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:17.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.995+0000 7f788cd28640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f786c06be60 0x7f786c06e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7878034000 tx=0x7f787802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:17.999+0000 7f787dffb640 1 -- 172.21.15.50:0/2910363812 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7888068600 con 0x7f78880d16d0 2024-09-11T22:11:18.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.170+0000 7f788f78d640 1 -- 172.21.15.50:0/2910363812 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78880b78b0 con 0x7f786c06be60 2024-09-11T22:11:18.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.176+0000 7f787dffb640 1 -- 172.21.15.50:0/2910363812 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245277 (secure 0 0 0) 0x7f78880b78b0 con 0x7f786c06be60 2024-09-11T22:11:18.179 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:11:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.179+0000 7f788f78d640 1 -- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f786c06be60 msgr2=0x7f786c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.179+0000 7f788f78d640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f786c06be60 0x7f786c06e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7878034000 tx=0x7f787802e000 comp rx=0 tx=0).stop 2024-09-11T22:11:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.179+0000 7f788f78d640 1 -- 172.21.15.50:0/2910363812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78880d16d0 msgr2=0x7f788814db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.179+0000 7f788f78d640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78880d16d0 0x7f788814db20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f788400e8a0 tx=0x7f788400ed60 comp rx=0 tx=0).stop 2024-09-11T22:11:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.179+0000 7f788f78d640 1 -- 172.21.15.50:0/2910363812 shutdown_connections 2024-09-11T22:11:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.179+0000 7f788f78d640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f786c06be60 0x7f786c06e320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.179+0000 7f788f78d640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f788815e870 0x7f78880b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.179+0000 7f788f78d640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880d3a30 0x7f78880c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.179+0000 7f788f78d640 1 --2- 172.21.15.50:0/2910363812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78880d16d0 0x7f788814db20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.179+0000 7f788f78d640 1 -- 172.21.15.50:0/2910363812 >> 172.21.15.50:0/2910363812 conn(0x7f78880727a0 msgr2=0x7f788815eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.179+0000 7f788f78d640 1 -- 172.21.15.50:0/2910363812 shutdown_connections 2024-09-11T22:11:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.179+0000 7f788f78d640 1 -- 172.21.15.50:0/2910363812 wait complete. 2024-09-11T22:11:18.191 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-11T22:11:17.363984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240164,"kb_used_data":2516,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734556,"statfs":{"total":773094113280,"available":772848185344,"internally_reserved":0,"allocated":2576384,"data_stored":1615145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.516729"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859411+0000","last_change":"2024-09-11T22:11:13.859411+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859411+0000","last_undegraded":"2024-09-11T22:11:13.859411+0000","last_fullsized":"2024-09-11T22:11:13.859411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862599+0000","last_change":"2024-09-11T22:11:13.862599+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862599+0000","last_undegraded":"2024-09-11T22:11:13.862599+0000","last_fullsized":"2024-09-11T22:11:13.862599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861017+0000","last_change":"2024-09-11T22:11:13.861017+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861017+0000","last_undegraded":"2024-09-11T22:11:13.861017+0000","last_fullsized":"2024-09-11T22:11:13.861017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861590+0000","last_change":"2024-09-11T22:11:13.861590+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861590+0000","last_undegraded":"2024-09-11T22:11:13.861590+0000","last_fullsized":"2024-09-11T22:11:13.861590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860051+0000","last_change":"2024-09-11T22:11:13.860051+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860051+0000","last_undegraded":"2024-09-11T22:11:13.860051+0000","last_fullsized":"2024-09-11T22:11:13.860051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862308+0000","last_change":"2024-09-11T22:11:13.862308+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862308+0000","last_undegraded":"2024-09-11T22:11:13.862308+0000","last_fullsized":"2024-09-11T22:11:13.862308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862604+0000","last_change":"2024-09-11T22:11:13.862604+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862604+0000","last_undegraded":"2024-09-11T22:11:13.862604+0000","last_fullsized":"2024-09-11T22:11:13.862604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.856300+0000","last_change":"2024-09-11T22:11:13.856300+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.856300+0000","last_undegraded":"2024-09-11T22:11:13.856300+0000","last_fullsized":"2024-09-11T22:11:13.856300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860205+0000","last_change":"2024-09-11T22:11:13.860205+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860205+0000","last_undegraded":"2024-09-11T22:11:13.860205+0000","last_fullsized":"2024-09-11T22:11:13.860205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862690+0000","last_change":"2024-09-11T22:11:13.862690+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862690+0000","last_undegraded":"2024-09-11T22:11:13.862690+0000","last_fullsized":"2024-09-11T22:11:13.862690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861883+0000","last_change":"2024-09-11T22:11:13.861883+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861883+0000","last_undegraded":"2024-09-11T22:11:13.861883+0000","last_fullsized":"2024-09-11T22:11:13.861883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860012+0000","last_change":"2024-09-11T22:11:13.860012+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860012+0000","last_undegraded":"2024-09-11T22:11:13.860012+0000","last_fullsized":"2024-09-11T22:11:13.860012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857285+0000","last_change":"2024-09-11T22:11:13.857285+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857285+0000","last_undegraded":"2024-09-11T22:11:13.857285+0000","last_fullsized":"2024-09-11T22:11:13.857285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.873986+0000","last_change":"2024-09-11T22:11:14.869711+0000","last_active":"2024-09-11T22:11:14.873986+0000","last_peered":"2024-09-11T22:11:14.873986+0000","last_clean":"2024-09-11T22:11:14.873986+0000","last_became_active":"2024-09-11T22:11:14.869409+0000","last_became_peered":"2024-09-11T22:11:14.869409+0000","last_unstale":"2024-09-11T22:11:14.873986+0000","last_undegraded":"2024-09-11T22:11:14.873986+0000","last_fullsized":"2024-09-11T22:11:14.873986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:38.715172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860357+0000","last_change":"2024-09-11T22:11:13.860357+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860357+0000","last_undegraded":"2024-09-11T22:11:13.860357+0000","last_fullsized":"2024-09-11T22:11:13.860357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862078+0000","last_change":"2024-09-11T22:11:13.862078+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862078+0000","last_undegraded":"2024-09-11T22:11:13.862078+0000","last_fullsized":"2024-09-11T22:11:13.862078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859418+0000","last_change":"2024-09-11T22:11:13.859418+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859418+0000","last_undegraded":"2024-09-11T22:11:13.859418+0000","last_fullsized":"2024-09-11T22:11:13.859418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859088+0000","last_change":"2024-09-11T22:11:13.859088+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859088+0000","last_undegraded":"2024-09-11T22:11:13.859088+0000","last_fullsized":"2024-09-11T22:11:13.859088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857107+0000","last_change":"2024-09-11T22:11:13.857107+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857107+0000","last_undegraded":"2024-09-11T22:11:13.857107+0000","last_fullsized":"2024-09-11T22:11:13.857107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860681+0000","last_change":"2024-09-11T22:11:13.860681+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860681+0000","last_undegraded":"2024-09-11T22:11:13.860681+0000","last_fullsized":"2024-09-11T22:11:13.860681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861820+0000","last_change":"2024-09-11T22:11:13.861820+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861820+0000","last_undegraded":"2024-09-11T22:11:13.861820+0000","last_fullsized":"2024-09-11T22:11:13.861820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862280+0000","last_change":"2024-09-11T22:11:13.862280+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862280+0000","last_undegraded":"2024-09-11T22:11:13.862280+0000","last_fullsized":"2024-09-11T22:11:13.862280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858813+0000","last_change":"2024-09-11T22:11:13.858813+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858813+0000","last_undegraded":"2024-09-11T22:11:13.858813+0000","last_fullsized":"2024-09-11T22:11:13.858813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861391+0000","last_change":"2024-09-11T22:11:13.861391+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861391+0000","last_undegraded":"2024-09-11T22:11:13.861391+0000","last_fullsized":"2024-09-11T22:11:13.861391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858569+0000","last_change":"2024-09-11T22:11:13.858569+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858569+0000","last_undegraded":"2024-09-11T22:11:13.858569+0000","last_fullsized":"2024-09-11T22:11:13.858569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.877104+0000","last_change":"2024-09-11T22:11:14.872267+0000","last_active":"2024-09-11T22:11:14.877104+0000","last_peered":"2024-09-11T22:11:14.877104+0000","last_clean":"2024-09-11T22:11:14.877104+0000","last_became_active":"2024-09-11T22:11:14.871979+0000","last_became_peered":"2024-09-11T22:11:14.871979+0000","last_unstale":"2024-09-11T22:11:14.877104+0000","last_undegraded":"2024-09-11T22:11:14.877104+0000","last_fullsized":"2024-09-11T22:11:14.877104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:27.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861026+0000","last_change":"2024-09-11T22:11:13.861026+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861026+0000","last_undegraded":"2024-09-11T22:11:13.861026+0000","last_fullsized":"2024-09-11T22:11:13.861026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.855770+0000","last_change":"2024-09-11T22:11:13.855770+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.855770+0000","last_undegraded":"2024-09-11T22:11:13.855770+0000","last_fullsized":"2024-09-11T22:11:13.855770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872936+0000","last_change":"2024-09-11T22:11:13.870101+0000","last_active":"2024-09-11T22:11:13.872936+0000","last_peered":"2024-09-11T22:11:13.872936+0000","last_clean":"2024-09-11T22:11:13.872936+0000","last_became_active":"2024-09-11T22:11:13.869798+0000","last_became_peered":"2024-09-11T22:11:13.869798+0000","last_unstale":"2024-09-11T22:11:13.872936+0000","last_undegraded":"2024-09-11T22:11:13.872936+0000","last_fullsized":"2024-09-11T22:11:13.872936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859814+0000","last_change":"2024-09-11T22:11:13.859814+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859814+0000","last_undegraded":"2024-09-11T22:11:13.859814+0000","last_fullsized":"2024-09-11T22:11:13.859814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875333+0000","last_change":"2024-09-11T22:11:13.871132+0000","last_active":"2024-09-11T22:11:13.875333+0000","last_peered":"2024-09-11T22:11:13.875333+0000","last_clean":"2024-09-11T22:11:13.875333+0000","last_became_active":"2024-09-11T22:11:13.870831+0000","last_became_peered":"2024-09-11T22:11:13.870831+0000","last_unstale":"2024-09-11T22:11:13.875333+0000","last_undegraded":"2024-09-11T22:11:13.875333+0000","last_fullsized":"2024-09-11T22:11:13.875333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872921+0000","last_change":"2024-09-11T22:11:13.871011+0000","last_active":"2024-09-11T22:11:13.872921+0000","last_peered":"2024-09-11T22:11:13.872921+0000","last_clean":"2024-09-11T22:11:13.872921+0000","last_became_active":"2024-09-11T22:11:13.870723+0000","last_became_peered":"2024-09-11T22:11:13.870723+0000","last_unstale":"2024-09-11T22:11:13.872921+0000","last_undegraded":"2024-09-11T22:11:13.872921+0000","last_fullsized":"2024-09-11T22:11:13.872921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859534+0000","last_change":"2024-09-11T22:11:13.859534+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859534+0000","last_undegraded":"2024-09-11T22:11:13.859534+0000","last_fullsized":"2024-09-11T22:11:13.859534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873131+0000","last_change":"2024-09-11T22:11:13.867235+0000","last_active":"2024-09-11T22:11:13.873131+0000","last_peered":"2024-09-11T22:11:13.873131+0000","last_clean":"2024-09-11T22:11:13.873131+0000","last_became_active":"2024-09-11T22:11:13.866963+0000","last_became_peered":"2024-09-11T22:11:13.866963+0000","last_unstale":"2024-09-11T22:11:13.873131+0000","last_undegraded":"2024-09-11T22:11:13.873131+0000","last_fullsized":"2024-09-11T22:11:13.873131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.864339+0000","last_change":"2024-09-11T22:11:13.864339+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.864339+0000","last_undegraded":"2024-09-11T22:11:13.864339+0000","last_fullsized":"2024-09-11T22:11:13.864339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875784+0000","last_change":"2024-09-11T22:11:13.874393+0000","last_active":"2024-09-11T22:11:13.875784+0000","last_peered":"2024-09-11T22:11:13.875784+0000","last_clean":"2024-09-11T22:11:13.875784+0000","last_became_active":"2024-09-11T22:11:13.874074+0000","last_became_peered":"2024-09-11T22:11:13.874074+0000","last_unstale":"2024-09-11T22:11:13.875784+0000","last_undegraded":"2024-09-11T22:11:13.875784+0000","last_fullsized":"2024-09-11T22:11:13.875784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:15.850187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857158+0000","last_change":"2024-09-11T22:11:13.857158+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857158+0000","last_undegraded":"2024-09-11T22:11:13.857158+0000","last_fullsized":"2024-09-11T22:11:13.857158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875288+0000","last_change":"2024-09-11T22:11:13.870015+0000","last_active":"2024-09-11T22:11:13.875288+0000","last_peered":"2024-09-11T22:11:13.875288+0000","last_clean":"2024-09-11T22:11:13.875288+0000","last_became_active":"2024-09-11T22:11:13.869685+0000","last_became_peered":"2024-09-11T22:11:13.869685+0000","last_unstale":"2024-09-11T22:11:13.875288+0000","last_undegraded":"2024-09-11T22:11:13.875288+0000","last_fullsized":"2024-09-11T22:11:13.875288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:15.850187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858952+0000","last_change":"2024-09-11T22:11:13.858952+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858952+0000","last_undegraded":"2024-09-11T22:11:13.858952+0000","last_fullsized":"2024-09-11T22:11:13.858952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873044+0000","last_change":"2024-09-11T22:11:13.870967+0000","last_active":"2024-09-11T22:11:13.873044+0000","last_peered":"2024-09-11T22:11:13.873044+0000","last_clean":"2024-09-11T22:11:13.873044+0000","last_became_active":"2024-09-11T22:11:13.870687+0000","last_became_peered":"2024-09-11T22:11:13.870687+0000","last_unstale":"2024-09-11T22:11:13.873044+0000","last_undegraded":"2024-09-11T22:11:13.873044+0000","last_fullsized":"2024-09-11T22:11:13.873044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.855170+0000","last_change":"2024-09-11T22:11:13.855170+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.855170+0000","last_undegraded":"2024-09-11T22:11:13.855170+0000","last_fullsized":"2024-09-11T22:11:13.855170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875742+0000","last_change":"2024-09-11T22:11:13.873578+0000","last_active":"2024-09-11T22:11:13.875742+0000","last_peered":"2024-09-11T22:11:13.875742+0000","last_clean":"2024-09-11T22:11:13.875742+0000","last_became_active":"2024-09-11T22:11:13.873273+0000","last_became_peered":"2024-09-11T22:11:13.873273+0000","last_unstale":"2024-09-11T22:11:13.875742+0000","last_undegraded":"2024-09-11T22:11:13.875742+0000","last_fullsized":"2024-09-11T22:11:13.875742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.867715+0000","last_change":"2024-09-11T22:11:13.863099+0000","last_active":"2024-09-11T22:11:13.867715+0000","last_peered":"2024-09-11T22:11:13.867715+0000","last_clean":"2024-09-11T22:11:13.867715+0000","last_became_active":"2024-09-11T22:11:13.862812+0000","last_became_peered":"2024-09-11T22:11:13.862812+0000","last_unstale":"2024-09-11T22:11:13.867715+0000","last_undegraded":"2024-09-11T22:11:13.867715+0000","last_fullsized":"2024-09-11T22:11:13.867715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:53.690138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857829+0000","last_change":"2024-09-11T22:11:13.857829+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857829+0000","last_undegraded":"2024-09-11T22:11:13.857829+0000","last_fullsized":"2024-09-11T22:11:13.857829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873043+0000","last_change":"2024-09-11T22:11:13.866150+0000","last_active":"2024-09-11T22:11:13.873043+0000","last_peered":"2024-09-11T22:11:13.873043+0000","last_clean":"2024-09-11T22:11:13.873043+0000","last_became_active":"2024-09-11T22:11:13.865864+0000","last_became_peered":"2024-09-11T22:11:13.865864+0000","last_unstale":"2024-09-11T22:11:13.873043+0000","last_undegraded":"2024-09-11T22:11:13.873043+0000","last_fullsized":"2024-09-11T22:11:13.873043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875718+0000","last_change":"2024-09-11T22:11:13.873542+0000","last_active":"2024-09-11T22:11:13.875718+0000","last_peered":"2024-09-11T22:11:13.875718+0000","last_clean":"2024-09-11T22:11:13.875718+0000","last_became_active":"2024-09-11T22:11:13.873248+0000","last_became_peered":"2024-09-11T22:11:13.873248+0000","last_unstale":"2024-09-11T22:11:13.875718+0000","last_undegraded":"2024-09-11T22:11:13.875718+0000","last_fullsized":"2024-09-11T22:11:13.875718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859651+0000","last_change":"2024-09-11T22:11:13.859651+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859651+0000","last_undegraded":"2024-09-11T22:11:13.859651+0000","last_fullsized":"2024-09-11T22:11:13.859651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.889885+0000","last_change":"2024-09-11T22:11:13.870778+0000","last_active":"2024-09-11T22:11:14.889885+0000","last_peered":"2024-09-11T22:11:14.889885+0000","last_clean":"2024-09-11T22:11:14.889885+0000","last_became_active":"2024-09-11T22:11:13.870346+0000","last_became_peered":"2024-09-11T22:11:13.870346+0000","last_unstale":"2024-09-11T22:11:14.889885+0000","last_undegraded":"2024-09-11T22:11:14.889885+0000","last_fullsized":"2024-09-11T22:11:14.889885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:43.931796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.865199+0000","last_change":"2024-09-11T22:11:13.864325+0000","last_active":"2024-09-11T22:11:13.865199+0000","last_peered":"2024-09-11T22:11:13.865199+0000","last_clean":"2024-09-11T22:11:13.865199+0000","last_became_active":"2024-09-11T22:11:13.862906+0000","last_became_peered":"2024-09-11T22:11:13.862906+0000","last_unstale":"2024-09-11T22:11:13.865199+0000","last_undegraded":"2024-09-11T22:11:13.865199+0000","last_fullsized":"2024-09-11T22:11:13.865199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.888351+0000","last_change":"2024-09-11T22:11:13.865829+0000","last_active":"2024-09-11T22:11:14.888351+0000","last_peered":"2024-09-11T22:11:14.888351+0000","last_clean":"2024-09-11T22:11:14.888351+0000","last_became_active":"2024-09-11T22:11:13.865535+0000","last_became_peered":"2024-09-11T22:11:13.865535+0000","last_unstale":"2024-09-11T22:11:14.888351+0000","last_undegraded":"2024-09-11T22:11:14.888351+0000","last_fullsized":"2024-09-11T22:11:14.888351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:47.814287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.874256+0000","last_change":"2024-09-11T22:11:13.873640+0000","last_active":"2024-09-11T22:11:13.874256+0000","last_peered":"2024-09-11T22:11:13.874256+0000","last_clean":"2024-09-11T22:11:13.874256+0000","last_became_active":"2024-09-11T22:11:13.873311+0000","last_became_peered":"2024-09-11T22:11:13.873311+0000","last_unstale":"2024-09-11T22:11:13.874256+0000","last_undegraded":"2024-09-11T22:11:13.874256+0000","last_fullsized":"2024-09-11T22:11:13.874256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857262+0000","last_change":"2024-09-11T22:11:13.857262+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857262+0000","last_undegraded":"2024-09-11T22:11:13.857262+0000","last_fullsized":"2024-09-11T22:11:13.857262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.864960+0000","last_change":"2024-09-11T22:11:13.870777+0000","last_active":"2024-09-11T22:11:14.864960+0000","last_peered":"2024-09-11T22:11:14.864960+0000","last_clean":"2024-09-11T22:11:14.864960+0000","last_became_active":"2024-09-11T22:11:13.869718+0000","last_became_peered":"2024-09-11T22:11:13.869718+0000","last_unstale":"2024-09-11T22:11:14.864960+0000","last_undegraded":"2024-09-11T22:11:14.864960+0000","last_fullsized":"2024-09-11T22:11:14.864960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:24.001331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-11T22:11:06.461014+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:11:06.461014+0000","last_peered":"2024-09-11T22:11:06.461014+0000","last_clean":"2024-09-11T22:11:06.461014+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:11:06.461014+0000","last_undegraded":"2024-09-11T22:11:06.461014+0000","last_fullsized":"2024-09-11T22:11:06.461014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.865987+0000","last_change":"2024-09-11T22:11:13.863848+0000","last_active":"2024-09-11T22:11:13.865987+0000","last_peered":"2024-09-11T22:11:13.865987+0000","last_clean":"2024-09-11T22:11:13.865987+0000","last_became_active":"2024-09-11T22:11:13.863555+0000","last_became_peered":"2024-09-11T22:11:13.863555+0000","last_unstale":"2024-09-11T22:11:13.865987+0000","last_undegraded":"2024-09-11T22:11:13.865987+0000","last_fullsized":"2024-09-11T22:11:13.865987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858270+0000","last_change":"2024-09-11T22:11:13.858270+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858270+0000","last_undegraded":"2024-09-11T22:11:13.858270+0000","last_fullsized":"2024-09-11T22:11:13.858270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857452+0000","last_change":"2024-09-11T22:11:13.857452+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857452+0000","last_undegraded":"2024-09-11T22:11:13.857452+0000","last_fullsized":"2024-09-11T22:11:13.857452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.865376+0000","last_change":"2024-09-11T22:11:13.865189+0000","last_active":"2024-09-11T22:11:14.865376+0000","last_peered":"2024-09-11T22:11:14.865376+0000","last_clean":"2024-09-11T22:11:14.865376+0000","last_became_active":"2024-09-11T22:11:13.864912+0000","last_became_peered":"2024-09-11T22:11:13.864912+0000","last_unstale":"2024-09-11T22:11:14.865376+0000","last_undegraded":"2024-09-11T22:11:14.865376+0000","last_fullsized":"2024-09-11T22:11:14.865376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:20.511994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859844+0000","last_change":"2024-09-11T22:11:13.859844+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859844+0000","last_undegraded":"2024-09-11T22:11:13.859844+0000","last_fullsized":"2024-09-11T22:11:13.859844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873228+0000","last_change":"2024-09-11T22:11:13.867676+0000","last_active":"2024-09-11T22:11:13.873228+0000","last_peered":"2024-09-11T22:11:13.873228+0000","last_clean":"2024-09-11T22:11:13.873228+0000","last_became_active":"2024-09-11T22:11:13.867391+0000","last_became_peered":"2024-09-11T22:11:13.867391+0000","last_unstale":"2024-09-11T22:11:13.873228+0000","last_undegraded":"2024-09-11T22:11:13.873228+0000","last_fullsized":"2024-09-11T22:11:13.873228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.856164+0000","last_change":"2024-09-11T22:11:13.856164+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.856164+0000","last_undegraded":"2024-09-11T22:11:13.856164+0000","last_fullsized":"2024-09-11T22:11:13.856164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.870592+0000","last_change":"2024-09-11T22:11:13.868171+0000","last_active":"2024-09-11T22:11:13.870592+0000","last_peered":"2024-09-11T22:11:13.870592+0000","last_clean":"2024-09-11T22:11:13.870592+0000","last_became_active":"2024-09-11T22:11:13.867826+0000","last_became_peered":"2024-09-11T22:11:13.867826+0000","last_unstale":"2024-09-11T22:11:13.870592+0000","last_undegraded":"2024-09-11T22:11:13.870592+0000","last_fullsized":"2024-09-11T22:11:13.870592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:53.690138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858030+0000","last_change":"2024-09-11T22:11:13.858030+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858030+0000","last_undegraded":"2024-09-11T22:11:13.858030+0000","last_fullsized":"2024-09-11T22:11:13.858030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857970+0000","last_change":"2024-09-11T22:11:13.857970+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857970+0000","last_undegraded":"2024-09-11T22:11:13.857970+0000","last_fullsized":"2024-09-11T22:11:13.857970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873159+0000","last_change":"2024-09-11T22:11:13.872366+0000","last_active":"2024-09-11T22:11:13.873159+0000","last_peered":"2024-09-11T22:11:13.873159+0000","last_clean":"2024-09-11T22:11:13.873159+0000","last_became_active":"2024-09-11T22:11:13.872085+0000","last_became_peered":"2024-09-11T22:11:13.872085+0000","last_unstale":"2024-09-11T22:11:13.873159+0000","last_undegraded":"2024-09-11T22:11:13.873159+0000","last_fullsized":"2024-09-11T22:11:13.873159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857777+0000","last_change":"2024-09-11T22:11:13.857777+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857777+0000","last_undegraded":"2024-09-11T22:11:13.857777+0000","last_fullsized":"2024-09-11T22:11:13.857777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872843+0000","last_change":"2024-09-11T22:11:13.869408+0000","last_active":"2024-09-11T22:11:13.872843+0000","last_peered":"2024-09-11T22:11:13.872843+0000","last_clean":"2024-09-11T22:11:13.872843+0000","last_became_active":"2024-09-11T22:11:13.869118+0000","last_became_peered":"2024-09-11T22:11:13.869118+0000","last_unstale":"2024-09-11T22:11:13.872843+0000","last_undegraded":"2024-09-11T22:11:13.872843+0000","last_fullsized":"2024-09-11T22:11:13.872843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.856979+0000","last_change":"2024-09-11T22:11:13.856979+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.856979+0000","last_undegraded":"2024-09-11T22:11:13.856979+0000","last_fullsized":"2024-09-11T22:11:13.856979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.855308+0000","last_change":"2024-09-11T22:11:13.855308+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.855308+0000","last_undegraded":"2024-09-11T22:11:13.855308+0000","last_fullsized":"2024-09-11T22:11:13.855308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873166+0000","last_change":"2024-09-11T22:11:13.872102+0000","last_active":"2024-09-11T22:11:13.873166+0000","last_peered":"2024-09-11T22:11:13.873166+0000","last_clean":"2024-09-11T22:11:13.873166+0000","last_became_active":"2024-09-11T22:11:13.871744+0000","last_became_peered":"2024-09-11T22:11:13.871744+0000","last_unstale":"2024-09-11T22:11:13.873166+0000","last_undegraded":"2024-09-11T22:11:13.873166+0000","last_fullsized":"2024-09-11T22:11:13.873166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858251+0000","last_change":"2024-09-11T22:11:13.858251+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858251+0000","last_undegraded":"2024-09-11T22:11:13.858251+0000","last_fullsized":"2024-09-11T22:11:13.858251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.867429+0000","last_change":"2024-09-11T22:11:13.866539+0000","last_active":"2024-09-11T22:11:13.867429+0000","last_peered":"2024-09-11T22:11:13.867429+0000","last_clean":"2024-09-11T22:11:13.867429+0000","last_became_active":"2024-09-11T22:11:13.866049+0000","last_became_peered":"2024-09-11T22:11:13.866049+0000","last_unstale":"2024-09-11T22:11:13.867429+0000","last_undegraded":"2024-09-11T22:11:13.867429+0000","last_fullsized":"2024-09-11T22:11:13.867429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:52.623769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859720+0000","last_change":"2024-09-11T22:11:13.859720+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859720+0000","last_undegraded":"2024-09-11T22:11:13.859720+0000","last_fullsized":"2024-09-11T22:11:13.859720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862009+0000","last_change":"2024-09-11T22:11:13.862009+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862009+0000","last_undegraded":"2024-09-11T22:11:13.862009+0000","last_fullsized":"2024-09-11T22:11:13.862009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859680+0000","last_change":"2024-09-11T22:11:13.859680+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859680+0000","last_undegraded":"2024-09-11T22:11:13.859680+0000","last_fullsized":"2024-09-11T22:11:13.859680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859918+0000","last_change":"2024-09-11T22:11:13.859918+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859918+0000","last_undegraded":"2024-09-11T22:11:13.859918+0000","last_fullsized":"2024-09-11T22:11:13.859918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859730+0000","last_change":"2024-09-11T22:11:13.859730+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859730+0000","last_undegraded":"2024-09-11T22:11:13.859730+0000","last_fullsized":"2024-09-11T22:11:13.859730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872861+0000","last_change":"2024-09-11T22:11:13.869743+0000","last_active":"2024-09-11T22:11:13.872861+0000","last_peered":"2024-09-11T22:11:13.872861+0000","last_clean":"2024-09-11T22:11:13.872861+0000","last_became_active":"2024-09-11T22:11:13.868457+0000","last_became_peered":"2024-09-11T22:11:13.868457+0000","last_unstale":"2024-09-11T22:11:13.872861+0000","last_undegraded":"2024-09-11T22:11:13.872861+0000","last_fullsized":"2024-09-11T22:11:13.872861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:53.690138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859809+0000","last_change":"2024-09-11T22:11:13.859809+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859809+0000","last_undegraded":"2024-09-11T22:11:13.859809+0000","last_fullsized":"2024-09-11T22:11:13.859809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.869281+0000","last_change":"2024-09-11T22:11:13.866359+0000","last_active":"2024-09-11T22:11:13.869281+0000","last_peered":"2024-09-11T22:11:13.869281+0000","last_clean":"2024-09-11T22:11:13.869281+0000","last_became_active":"2024-09-11T22:11:13.866072+0000","last_became_peered":"2024-09-11T22:11:13.866072+0000","last_unstale":"2024-09-11T22:11:13.869281+0000","last_undegraded":"2024-09-11T22:11:13.869281+0000","last_fullsized":"2024-09-11T22:11:13.869281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":52,"acting":52,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509443,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":753664,"data_stored":637948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35544,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336296,"statfs":{"total":96636764160,"available":96600367104,"internally_reserved":0,"allocated":196608,"data_stored":66447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:11:18.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:11:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.333+0000 7f30b0e42640 1 Processor -- start 2024-09-11T22:11:18.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.333+0000 7f30b0e42640 1 -- start start 2024-09-11T22:11:18.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.333+0000 7f30b0e42640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30ac15e870 0x7f30ac0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:18.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.334+0000 7f30b0e42640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30ac0cfa80 con 0x7f30ac0d16d0 2024-09-11T22:11:18.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.334+0000 7f30b0e42640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30ac0d40d0 con 0x7f30ac0d3c00 2024-09-11T22:11:18.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.334+0000 7f30b0e42640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f30ac0d1b40 con 0x7f30ac15e870 2024-09-11T22:11:18.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.334+0000 7f30aa59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30ac15e870 0x7f30ac0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:18.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.334+0000 7f30a9d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f30ac0d16d0 0x7f30ac0d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41112/0 (socket says 172.21.15.50:41112) 2024-09-11T22:11:18.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.334+0000 7f30a9d9b640 1 -- 172.21.15.50:0/2253609473 learned_addr learned my addr 172.21.15.50:0/2253609473 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:18.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.334+0000 7f30aa59c640 1 -- 172.21.15.50:0/2253609473 >> v1:172.21.15.77:6789/0 conn(0x7f30ac0d3c00 legacy=0x7f30ac0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:18.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.334+0000 7f30aa59c640 1 -- 172.21.15.50:0/2253609473 >> v1:172.21.15.50:6789/0 conn(0x7f30ac0d16d0 legacy=0x7f30ac0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.334+0000 7f30aa59c640 1 -- 172.21.15.50:0/2253609473 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac0d43b0 con 0x7f30ac15e870 2024-09-11T22:11:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.335+0000 7f30aa59c640 1 --2- 172.21.15.50:0/2253609473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30ac15e870 0x7f30ac0d1190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009d90 tx=0x7f30a402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda09ea981a26fca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.335+0000 7f30a959a640 1 -- 172.21.15.50:0/2253609473 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4007740 con 0x7f30ac15e870 2024-09-11T22:11:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.335+0000 7f30a959a640 1 -- 172.21.15.50:0/2253609473 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a40078e0 con 0x7f30ac15e870 2024-09-11T22:11:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.335+0000 7f30a959a640 1 -- 172.21.15.50:0/2253609473 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4007cb0 con 0x7f30ac15e870 2024-09-11T22:11:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.335+0000 7f30b0e42640 1 -- 172.21.15.50:0/2253609473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30ac15e870 msgr2=0x7f30ac0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.335+0000 7f30b0e42640 1 --2- 172.21.15.50:0/2253609473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30ac15e870 0x7f30ac0d1190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009d90 tx=0x7f30a402a6a0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.335+0000 7f30b0e42640 1 -- 172.21.15.50:0/2253609473 shutdown_connections 2024-09-11T22:11:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.335+0000 7f30b0e42640 1 --2- 172.21.15.50:0/2253609473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30ac15e870 0x7f30ac0d1190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.335+0000 7f30b0e42640 1 -- 172.21.15.50:0/2253609473 >> 172.21.15.50:0/2253609473 conn(0x7f30ac0727a0 msgr2=0x7f30ac0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.335+0000 7f30b0e42640 1 -- 172.21.15.50:0/2253609473 shutdown_connections 2024-09-11T22:11:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.335+0000 7f30b0e42640 1 -- 172.21.15.50:0/2253609473 wait complete. 2024-09-11T22:11:18.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.337+0000 7f30b0e42640 1 Processor -- start 2024-09-11T22:11:18.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.337+0000 7f30b0e42640 1 -- start start 2024-09-11T22:11:18.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.337+0000 7f30b0e42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30ac0d16d0 0x7f30ac154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:18.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.337+0000 7f30b0e42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30ac0d3c00 0x7f30ac0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:18.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.337+0000 7f30b0e42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30ac15e870 0x7f30ac1e8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:18.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.337+0000 7f30b0e42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac15ec50 con 0x7f30ac15e870 2024-09-11T22:11:18.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.337+0000 7f30b0e42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac0b7ee0 con 0x7f30ac0d3c00 2024-09-11T22:11:18.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.337+0000 7f30b0e42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f30ac0b78b0 con 0x7f30ac0d16d0 2024-09-11T22:11:18.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30aad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30ac15e870 0x7f30ac1e8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:18.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30aad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30ac15e870 0x7f30ac1e8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46278/0 (socket says 172.21.15.50:46278) 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30aad9d640 1 -- 172.21.15.50:0/889728465 learned_addr learned my addr 172.21.15.50:0/889728465 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30aa59c640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30ac0d16d0 0x7f30ac154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30a9d9b640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30ac0d3c00 0x7f30ac0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30aad9d640 1 -- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30ac0d16d0 msgr2=0x7f30ac154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30aad9d640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30ac0d16d0 0x7f30ac154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30aad9d640 1 -- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30ac0d3c00 msgr2=0x7f30ac0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30aad9d640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30ac0d3c00 0x7f30ac0cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30aad9d640 1 -- 172.21.15.50:0/889728465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac1551d0 con 0x7f30ac15e870 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30a9d9b640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30ac0d3c00 0x7f30ac0cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30aad9d640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30ac15e870 0x7f30ac1e8e40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f309c00c410 tx=0x7f309c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30a2ffd640 1 -- 172.21.15.50:0/889728465 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c017070 con 0x7f30ac15e870 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30a2ffd640 1 -- 172.21.15.50:0/889728465 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c007230 con 0x7f30ac15e870 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30a2ffd640 1 -- 172.21.15.50:0/889728465 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c007660 con 0x7f30ac15e870 2024-09-11T22:11:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30b0e42640 1 -- 172.21.15.50:0/889728465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ac0ce180 con 0x7f30ac15e870 2024-09-11T22:11:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.338+0000 7f30b0e42640 1 -- 172.21.15.50:0/889728465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ac159f80 con 0x7f30ac15e870 2024-09-11T22:11:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.339+0000 7f30b0e42640 1 -- 172.21.15.50:0/889728465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ac0d1190 con 0x7f30ac15e870 2024-09-11T22:11:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.340+0000 7f30a2ffd640 1 -- 172.21.15.50:0/889728465 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f309c01a070 con 0x7f30ac15e870 2024-09-11T22:11:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.340+0000 7f30a2ffd640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f308c06be60 0x7f308c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.340+0000 7f30a2ffd640 1 -- 172.21.15.50:0/889728465 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f309c08a170 con 0x7f30ac15e870 2024-09-11T22:11:18.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.340+0000 7f30aa59c640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f308c06be60 0x7f308c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:18.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.341+0000 7f30aa59c640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f308c06be60 0x7f308c06e320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f30a4034000 tx=0x7f30a402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:18.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.344+0000 7f30a2ffd640 1 -- 172.21.15.50:0/889728465 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f30ac1551d0 con 0x7f30ac15e870 2024-09-11T22:11:18.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.517+0000 7f30b0e42640 1 -- 172.21.15.50:0/889728465 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30ac15de60 con 0x7f308c06be60 2024-09-11T22:11:18.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.523+0000 7f30a2ffd640 1 -- 172.21.15.50:0/889728465 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245277 (secure 0 0 0) 0x7f30ac15de60 con 0x7f308c06be60 2024-09-11T22:11:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:11:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.526+0000 7f30b0e42640 1 -- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f308c06be60 msgr2=0x7f308c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.526+0000 7f30b0e42640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f308c06be60 0x7f308c06e320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f30a4034000 tx=0x7f30a402f000 comp rx=0 tx=0).stop 2024-09-11T22:11:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.526+0000 7f30b0e42640 1 -- 172.21.15.50:0/889728465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30ac15e870 msgr2=0x7f30ac1e8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.526+0000 7f30b0e42640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30ac15e870 0x7f30ac1e8e40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f309c00c410 tx=0x7f309c00c8d0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.526+0000 7f30b0e42640 1 -- 172.21.15.50:0/889728465 shutdown_connections 2024-09-11T22:11:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.526+0000 7f30b0e42640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f308c06be60 0x7f308c06e320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.526+0000 7f30b0e42640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30ac15e870 0x7f30ac1e8e40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.527+0000 7f30b0e42640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30ac0d3c00 0x7f30ac0cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.527+0000 7f30b0e42640 1 --2- 172.21.15.50:0/889728465 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30ac0d16d0 0x7f30ac154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.527+0000 7f30b0e42640 1 -- 172.21.15.50:0/889728465 >> 172.21.15.50:0/889728465 conn(0x7f30ac0727a0 msgr2=0x7f30ac160c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.527+0000 7f30b0e42640 1 -- 172.21.15.50:0/889728465 shutdown_connections 2024-09-11T22:11:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.527+0000 7f30b0e42640 1 -- 172.21.15.50:0/889728465 wait complete. 2024-09-11T22:11:18.538 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-11T22:11:17.363984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240164,"kb_used_data":2516,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734556,"statfs":{"total":773094113280,"available":772848185344,"internally_reserved":0,"allocated":2576384,"data_stored":1615145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.516729"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859411+0000","last_change":"2024-09-11T22:11:13.859411+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859411+0000","last_undegraded":"2024-09-11T22:11:13.859411+0000","last_fullsized":"2024-09-11T22:11:13.859411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862599+0000","last_change":"2024-09-11T22:11:13.862599+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862599+0000","last_undegraded":"2024-09-11T22:11:13.862599+0000","last_fullsized":"2024-09-11T22:11:13.862599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861017+0000","last_change":"2024-09-11T22:11:13.861017+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861017+0000","last_undegraded":"2024-09-11T22:11:13.861017+0000","last_fullsized":"2024-09-11T22:11:13.861017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861590+0000","last_change":"2024-09-11T22:11:13.861590+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861590+0000","last_undegraded":"2024-09-11T22:11:13.861590+0000","last_fullsized":"2024-09-11T22:11:13.861590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860051+0000","last_change":"2024-09-11T22:11:13.860051+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860051+0000","last_undegraded":"2024-09-11T22:11:13.860051+0000","last_fullsized":"2024-09-11T22:11:13.860051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862308+0000","last_change":"2024-09-11T22:11:13.862308+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862308+0000","last_undegraded":"2024-09-11T22:11:13.862308+0000","last_fullsized":"2024-09-11T22:11:13.862308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862604+0000","last_change":"2024-09-11T22:11:13.862604+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862604+0000","last_undegraded":"2024-09-11T22:11:13.862604+0000","last_fullsized":"2024-09-11T22:11:13.862604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.856300+0000","last_change":"2024-09-11T22:11:13.856300+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.856300+0000","last_undegraded":"2024-09-11T22:11:13.856300+0000","last_fullsized":"2024-09-11T22:11:13.856300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860205+0000","last_change":"2024-09-11T22:11:13.860205+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860205+0000","last_undegraded":"2024-09-11T22:11:13.860205+0000","last_fullsized":"2024-09-11T22:11:13.860205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862690+0000","last_change":"2024-09-11T22:11:13.862690+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862690+0000","last_undegraded":"2024-09-11T22:11:13.862690+0000","last_fullsized":"2024-09-11T22:11:13.862690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861883+0000","last_change":"2024-09-11T22:11:13.861883+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861883+0000","last_undegraded":"2024-09-11T22:11:13.861883+0000","last_fullsized":"2024-09-11T22:11:13.861883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860012+0000","last_change":"2024-09-11T22:11:13.860012+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860012+0000","last_undegraded":"2024-09-11T22:11:13.860012+0000","last_fullsized":"2024-09-11T22:11:13.860012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857285+0000","last_change":"2024-09-11T22:11:13.857285+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857285+0000","last_undegraded":"2024-09-11T22:11:13.857285+0000","last_fullsized":"2024-09-11T22:11:13.857285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.873986+0000","last_change":"2024-09-11T22:11:14.869711+0000","last_active":"2024-09-11T22:11:14.873986+0000","last_peered":"2024-09-11T22:11:14.873986+0000","last_clean":"2024-09-11T22:11:14.873986+0000","last_became_active":"2024-09-11T22:11:14.869409+0000","last_became_peered":"2024-09-11T22:11:14.869409+0000","last_unstale":"2024-09-11T22:11:14.873986+0000","last_undegraded":"2024-09-11T22:11:14.873986+0000","last_fullsized":"2024-09-11T22:11:14.873986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:38.715172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860357+0000","last_change":"2024-09-11T22:11:13.860357+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860357+0000","last_undegraded":"2024-09-11T22:11:13.860357+0000","last_fullsized":"2024-09-11T22:11:13.860357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862078+0000","last_change":"2024-09-11T22:11:13.862078+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862078+0000","last_undegraded":"2024-09-11T22:11:13.862078+0000","last_fullsized":"2024-09-11T22:11:13.862078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859418+0000","last_change":"2024-09-11T22:11:13.859418+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859418+0000","last_undegraded":"2024-09-11T22:11:13.859418+0000","last_fullsized":"2024-09-11T22:11:13.859418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859088+0000","last_change":"2024-09-11T22:11:13.859088+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859088+0000","last_undegraded":"2024-09-11T22:11:13.859088+0000","last_fullsized":"2024-09-11T22:11:13.859088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857107+0000","last_change":"2024-09-11T22:11:13.857107+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857107+0000","last_undegraded":"2024-09-11T22:11:13.857107+0000","last_fullsized":"2024-09-11T22:11:13.857107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860681+0000","last_change":"2024-09-11T22:11:13.860681+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860681+0000","last_undegraded":"2024-09-11T22:11:13.860681+0000","last_fullsized":"2024-09-11T22:11:13.860681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861820+0000","last_change":"2024-09-11T22:11:13.861820+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861820+0000","last_undegraded":"2024-09-11T22:11:13.861820+0000","last_fullsized":"2024-09-11T22:11:13.861820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862280+0000","last_change":"2024-09-11T22:11:13.862280+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862280+0000","last_undegraded":"2024-09-11T22:11:13.862280+0000","last_fullsized":"2024-09-11T22:11:13.862280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858813+0000","last_change":"2024-09-11T22:11:13.858813+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858813+0000","last_undegraded":"2024-09-11T22:11:13.858813+0000","last_fullsized":"2024-09-11T22:11:13.858813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861391+0000","last_change":"2024-09-11T22:11:13.861391+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861391+0000","last_undegraded":"2024-09-11T22:11:13.861391+0000","last_fullsized":"2024-09-11T22:11:13.861391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858569+0000","last_change":"2024-09-11T22:11:13.858569+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858569+0000","last_undegraded":"2024-09-11T22:11:13.858569+0000","last_fullsized":"2024-09-11T22:11:13.858569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.877104+0000","last_change":"2024-09-11T22:11:14.872267+0000","last_active":"2024-09-11T22:11:14.877104+0000","last_peered":"2024-09-11T22:11:14.877104+0000","last_clean":"2024-09-11T22:11:14.877104+0000","last_became_active":"2024-09-11T22:11:14.871979+0000","last_became_peered":"2024-09-11T22:11:14.871979+0000","last_unstale":"2024-09-11T22:11:14.877104+0000","last_undegraded":"2024-09-11T22:11:14.877104+0000","last_fullsized":"2024-09-11T22:11:14.877104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:27.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861026+0000","last_change":"2024-09-11T22:11:13.861026+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861026+0000","last_undegraded":"2024-09-11T22:11:13.861026+0000","last_fullsized":"2024-09-11T22:11:13.861026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.855770+0000","last_change":"2024-09-11T22:11:13.855770+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.855770+0000","last_undegraded":"2024-09-11T22:11:13.855770+0000","last_fullsized":"2024-09-11T22:11:13.855770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872936+0000","last_change":"2024-09-11T22:11:13.870101+0000","last_active":"2024-09-11T22:11:13.872936+0000","last_peered":"2024-09-11T22:11:13.872936+0000","last_clean":"2024-09-11T22:11:13.872936+0000","last_became_active":"2024-09-11T22:11:13.869798+0000","last_became_peered":"2024-09-11T22:11:13.869798+0000","last_unstale":"2024-09-11T22:11:13.872936+0000","last_undegraded":"2024-09-11T22:11:13.872936+0000","last_fullsized":"2024-09-11T22:11:13.872936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859814+0000","last_change":"2024-09-11T22:11:13.859814+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859814+0000","last_undegraded":"2024-09-11T22:11:13.859814+0000","last_fullsized":"2024-09-11T22:11:13.859814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875333+0000","last_change":"2024-09-11T22:11:13.871132+0000","last_active":"2024-09-11T22:11:13.875333+0000","last_peered":"2024-09-11T22:11:13.875333+0000","last_clean":"2024-09-11T22:11:13.875333+0000","last_became_active":"2024-09-11T22:11:13.870831+0000","last_became_peered":"2024-09-11T22:11:13.870831+0000","last_unstale":"2024-09-11T22:11:13.875333+0000","last_undegraded":"2024-09-11T22:11:13.875333+0000","last_fullsized":"2024-09-11T22:11:13.875333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872921+0000","last_change":"2024-09-11T22:11:13.871011+0000","last_active":"2024-09-11T22:11:13.872921+0000","last_peered":"2024-09-11T22:11:13.872921+0000","last_clean":"2024-09-11T22:11:13.872921+0000","last_became_active":"2024-09-11T22:11:13.870723+0000","last_became_peered":"2024-09-11T22:11:13.870723+0000","last_unstale":"2024-09-11T22:11:13.872921+0000","last_undegraded":"2024-09-11T22:11:13.872921+0000","last_fullsized":"2024-09-11T22:11:13.872921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859534+0000","last_change":"2024-09-11T22:11:13.859534+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859534+0000","last_undegraded":"2024-09-11T22:11:13.859534+0000","last_fullsized":"2024-09-11T22:11:13.859534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873131+0000","last_change":"2024-09-11T22:11:13.867235+0000","last_active":"2024-09-11T22:11:13.873131+0000","last_peered":"2024-09-11T22:11:13.873131+0000","last_clean":"2024-09-11T22:11:13.873131+0000","last_became_active":"2024-09-11T22:11:13.866963+0000","last_became_peered":"2024-09-11T22:11:13.866963+0000","last_unstale":"2024-09-11T22:11:13.873131+0000","last_undegraded":"2024-09-11T22:11:13.873131+0000","last_fullsized":"2024-09-11T22:11:13.873131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.864339+0000","last_change":"2024-09-11T22:11:13.864339+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.864339+0000","last_undegraded":"2024-09-11T22:11:13.864339+0000","last_fullsized":"2024-09-11T22:11:13.864339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875784+0000","last_change":"2024-09-11T22:11:13.874393+0000","last_active":"2024-09-11T22:11:13.875784+0000","last_peered":"2024-09-11T22:11:13.875784+0000","last_clean":"2024-09-11T22:11:13.875784+0000","last_became_active":"2024-09-11T22:11:13.874074+0000","last_became_peered":"2024-09-11T22:11:13.874074+0000","last_unstale":"2024-09-11T22:11:13.875784+0000","last_undegraded":"2024-09-11T22:11:13.875784+0000","last_fullsized":"2024-09-11T22:11:13.875784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:15.850187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857158+0000","last_change":"2024-09-11T22:11:13.857158+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857158+0000","last_undegraded":"2024-09-11T22:11:13.857158+0000","last_fullsized":"2024-09-11T22:11:13.857158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875288+0000","last_change":"2024-09-11T22:11:13.870015+0000","last_active":"2024-09-11T22:11:13.875288+0000","last_peered":"2024-09-11T22:11:13.875288+0000","last_clean":"2024-09-11T22:11:13.875288+0000","last_became_active":"2024-09-11T22:11:13.869685+0000","last_became_peered":"2024-09-11T22:11:13.869685+0000","last_unstale":"2024-09-11T22:11:13.875288+0000","last_undegraded":"2024-09-11T22:11:13.875288+0000","last_fullsized":"2024-09-11T22:11:13.875288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:15.850187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858952+0000","last_change":"2024-09-11T22:11:13.858952+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858952+0000","last_undegraded":"2024-09-11T22:11:13.858952+0000","last_fullsized":"2024-09-11T22:11:13.858952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873044+0000","last_change":"2024-09-11T22:11:13.870967+0000","last_active":"2024-09-11T22:11:13.873044+0000","last_peered":"2024-09-11T22:11:13.873044+0000","last_clean":"2024-09-11T22:11:13.873044+0000","last_became_active":"2024-09-11T22:11:13.870687+0000","last_became_peered":"2024-09-11T22:11:13.870687+0000","last_unstale":"2024-09-11T22:11:13.873044+0000","last_undegraded":"2024-09-11T22:11:13.873044+0000","last_fullsized":"2024-09-11T22:11:13.873044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.855170+0000","last_change":"2024-09-11T22:11:13.855170+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.855170+0000","last_undegraded":"2024-09-11T22:11:13.855170+0000","last_fullsized":"2024-09-11T22:11:13.855170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875742+0000","last_change":"2024-09-11T22:11:13.873578+0000","last_active":"2024-09-11T22:11:13.875742+0000","last_peered":"2024-09-11T22:11:13.875742+0000","last_clean":"2024-09-11T22:11:13.875742+0000","last_became_active":"2024-09-11T22:11:13.873273+0000","last_became_peered":"2024-09-11T22:11:13.873273+0000","last_unstale":"2024-09-11T22:11:13.875742+0000","last_undegraded":"2024-09-11T22:11:13.875742+0000","last_fullsized":"2024-09-11T22:11:13.875742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.867715+0000","last_change":"2024-09-11T22:11:13.863099+0000","last_active":"2024-09-11T22:11:13.867715+0000","last_peered":"2024-09-11T22:11:13.867715+0000","last_clean":"2024-09-11T22:11:13.867715+0000","last_became_active":"2024-09-11T22:11:13.862812+0000","last_became_peered":"2024-09-11T22:11:13.862812+0000","last_unstale":"2024-09-11T22:11:13.867715+0000","last_undegraded":"2024-09-11T22:11:13.867715+0000","last_fullsized":"2024-09-11T22:11:13.867715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:53.690138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857829+0000","last_change":"2024-09-11T22:11:13.857829+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857829+0000","last_undegraded":"2024-09-11T22:11:13.857829+0000","last_fullsized":"2024-09-11T22:11:13.857829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873043+0000","last_change":"2024-09-11T22:11:13.866150+0000","last_active":"2024-09-11T22:11:13.873043+0000","last_peered":"2024-09-11T22:11:13.873043+0000","last_clean":"2024-09-11T22:11:13.873043+0000","last_became_active":"2024-09-11T22:11:13.865864+0000","last_became_peered":"2024-09-11T22:11:13.865864+0000","last_unstale":"2024-09-11T22:11:13.873043+0000","last_undegraded":"2024-09-11T22:11:13.873043+0000","last_fullsized":"2024-09-11T22:11:13.873043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875718+0000","last_change":"2024-09-11T22:11:13.873542+0000","last_active":"2024-09-11T22:11:13.875718+0000","last_peered":"2024-09-11T22:11:13.875718+0000","last_clean":"2024-09-11T22:11:13.875718+0000","last_became_active":"2024-09-11T22:11:13.873248+0000","last_became_peered":"2024-09-11T22:11:13.873248+0000","last_unstale":"2024-09-11T22:11:13.875718+0000","last_undegraded":"2024-09-11T22:11:13.875718+0000","last_fullsized":"2024-09-11T22:11:13.875718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859651+0000","last_change":"2024-09-11T22:11:13.859651+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859651+0000","last_undegraded":"2024-09-11T22:11:13.859651+0000","last_fullsized":"2024-09-11T22:11:13.859651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.889885+0000","last_change":"2024-09-11T22:11:13.870778+0000","last_active":"2024-09-11T22:11:14.889885+0000","last_peered":"2024-09-11T22:11:14.889885+0000","last_clean":"2024-09-11T22:11:14.889885+0000","last_became_active":"2024-09-11T22:11:13.870346+0000","last_became_peered":"2024-09-11T22:11:13.870346+0000","last_unstale":"2024-09-11T22:11:14.889885+0000","last_undegraded":"2024-09-11T22:11:14.889885+0000","last_fullsized":"2024-09-11T22:11:14.889885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:43.931796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.865199+0000","last_change":"2024-09-11T22:11:13.864325+0000","last_active":"2024-09-11T22:11:13.865199+0000","last_peered":"2024-09-11T22:11:13.865199+0000","last_clean":"2024-09-11T22:11:13.865199+0000","last_became_active":"2024-09-11T22:11:13.862906+0000","last_became_peered":"2024-09-11T22:11:13.862906+0000","last_unstale":"2024-09-11T22:11:13.865199+0000","last_undegraded":"2024-09-11T22:11:13.865199+0000","last_fullsized":"2024-09-11T22:11:13.865199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.888351+0000","last_change":"2024-09-11T22:11:13.865829+0000","last_active":"2024-09-11T22:11:14.888351+0000","last_peered":"2024-09-11T22:11:14.888351+0000","last_clean":"2024-09-11T22:11:14.888351+0000","last_became_active":"2024-09-11T22:11:13.865535+0000","last_became_peered":"2024-09-11T22:11:13.865535+0000","last_unstale":"2024-09-11T22:11:14.888351+0000","last_undegraded":"2024-09-11T22:11:14.888351+0000","last_fullsized":"2024-09-11T22:11:14.888351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:47.814287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.874256+0000","last_change":"2024-09-11T22:11:13.873640+0000","last_active":"2024-09-11T22:11:13.874256+0000","last_peered":"2024-09-11T22:11:13.874256+0000","last_clean":"2024-09-11T22:11:13.874256+0000","last_became_active":"2024-09-11T22:11:13.873311+0000","last_became_peered":"2024-09-11T22:11:13.873311+0000","last_unstale":"2024-09-11T22:11:13.874256+0000","last_undegraded":"2024-09-11T22:11:13.874256+0000","last_fullsized":"2024-09-11T22:11:13.874256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857262+0000","last_change":"2024-09-11T22:11:13.857262+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857262+0000","last_undegraded":"2024-09-11T22:11:13.857262+0000","last_fullsized":"2024-09-11T22:11:13.857262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.864960+0000","last_change":"2024-09-11T22:11:13.870777+0000","last_active":"2024-09-11T22:11:14.864960+0000","last_peered":"2024-09-11T22:11:14.864960+0000","last_clean":"2024-09-11T22:11:14.864960+0000","last_became_active":"2024-09-11T22:11:13.869718+0000","last_became_peered":"2024-09-11T22:11:13.869718+0000","last_unstale":"2024-09-11T22:11:14.864960+0000","last_undegraded":"2024-09-11T22:11:14.864960+0000","last_fullsized":"2024-09-11T22:11:14.864960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:24.001331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-11T22:11:06.461014+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:11:06.461014+0000","last_peered":"2024-09-11T22:11:06.461014+0000","last_clean":"2024-09-11T22:11:06.461014+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:11:06.461014+0000","last_undegraded":"2024-09-11T22:11:06.461014+0000","last_fullsized":"2024-09-11T22:11:06.461014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.865987+0000","last_change":"2024-09-11T22:11:13.863848+0000","last_active":"2024-09-11T22:11:13.865987+0000","last_peered":"2024-09-11T22:11:13.865987+0000","last_clean":"2024-09-11T22:11:13.865987+0000","last_became_active":"2024-09-11T22:11:13.863555+0000","last_became_peered":"2024-09-11T22:11:13.863555+0000","last_unstale":"2024-09-11T22:11:13.865987+0000","last_undegraded":"2024-09-11T22:11:13.865987+0000","last_fullsized":"2024-09-11T22:11:13.865987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858270+0000","last_change":"2024-09-11T22:11:13.858270+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858270+0000","last_undegraded":"2024-09-11T22:11:13.858270+0000","last_fullsized":"2024-09-11T22:11:13.858270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857452+0000","last_change":"2024-09-11T22:11:13.857452+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857452+0000","last_undegraded":"2024-09-11T22:11:13.857452+0000","last_fullsized":"2024-09-11T22:11:13.857452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.865376+0000","last_change":"2024-09-11T22:11:13.865189+0000","last_active":"2024-09-11T22:11:14.865376+0000","last_peered":"2024-09-11T22:11:14.865376+0000","last_clean":"2024-09-11T22:11:14.865376+0000","last_became_active":"2024-09-11T22:11:13.864912+0000","last_became_peered":"2024-09-11T22:11:13.864912+0000","last_unstale":"2024-09-11T22:11:14.865376+0000","last_undegraded":"2024-09-11T22:11:14.865376+0000","last_fullsized":"2024-09-11T22:11:14.865376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:20.511994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859844+0000","last_change":"2024-09-11T22:11:13.859844+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859844+0000","last_undegraded":"2024-09-11T22:11:13.859844+0000","last_fullsized":"2024-09-11T22:11:13.859844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873228+0000","last_change":"2024-09-11T22:11:13.867676+0000","last_active":"2024-09-11T22:11:13.873228+0000","last_peered":"2024-09-11T22:11:13.873228+0000","last_clean":"2024-09-11T22:11:13.873228+0000","last_became_active":"2024-09-11T22:11:13.867391+0000","last_became_peered":"2024-09-11T22:11:13.867391+0000","last_unstale":"2024-09-11T22:11:13.873228+0000","last_undegraded":"2024-09-11T22:11:13.873228+0000","last_fullsized":"2024-09-11T22:11:13.873228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.856164+0000","last_change":"2024-09-11T22:11:13.856164+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.856164+0000","last_undegraded":"2024-09-11T22:11:13.856164+0000","last_fullsized":"2024-09-11T22:11:13.856164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.870592+0000","last_change":"2024-09-11T22:11:13.868171+0000","last_active":"2024-09-11T22:11:13.870592+0000","last_peered":"2024-09-11T22:11:13.870592+0000","last_clean":"2024-09-11T22:11:13.870592+0000","last_became_active":"2024-09-11T22:11:13.867826+0000","last_became_peered":"2024-09-11T22:11:13.867826+0000","last_unstale":"2024-09-11T22:11:13.870592+0000","last_undegraded":"2024-09-11T22:11:13.870592+0000","last_fullsized":"2024-09-11T22:11:13.870592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:53.690138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858030+0000","last_change":"2024-09-11T22:11:13.858030+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858030+0000","last_undegraded":"2024-09-11T22:11:13.858030+0000","last_fullsized":"2024-09-11T22:11:13.858030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857970+0000","last_change":"2024-09-11T22:11:13.857970+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857970+0000","last_undegraded":"2024-09-11T22:11:13.857970+0000","last_fullsized":"2024-09-11T22:11:13.857970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873159+0000","last_change":"2024-09-11T22:11:13.872366+0000","last_active":"2024-09-11T22:11:13.873159+0000","last_peered":"2024-09-11T22:11:13.873159+0000","last_clean":"2024-09-11T22:11:13.873159+0000","last_became_active":"2024-09-11T22:11:13.872085+0000","last_became_peered":"2024-09-11T22:11:13.872085+0000","last_unstale":"2024-09-11T22:11:13.873159+0000","last_undegraded":"2024-09-11T22:11:13.873159+0000","last_fullsized":"2024-09-11T22:11:13.873159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857777+0000","last_change":"2024-09-11T22:11:13.857777+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857777+0000","last_undegraded":"2024-09-11T22:11:13.857777+0000","last_fullsized":"2024-09-11T22:11:13.857777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872843+0000","last_change":"2024-09-11T22:11:13.869408+0000","last_active":"2024-09-11T22:11:13.872843+0000","last_peered":"2024-09-11T22:11:13.872843+0000","last_clean":"2024-09-11T22:11:13.872843+0000","last_became_active":"2024-09-11T22:11:13.869118+0000","last_became_peered":"2024-09-11T22:11:13.869118+0000","last_unstale":"2024-09-11T22:11:13.872843+0000","last_undegraded":"2024-09-11T22:11:13.872843+0000","last_fullsized":"2024-09-11T22:11:13.872843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.856979+0000","last_change":"2024-09-11T22:11:13.856979+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.856979+0000","last_undegraded":"2024-09-11T22:11:13.856979+0000","last_fullsized":"2024-09-11T22:11:13.856979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.855308+0000","last_change":"2024-09-11T22:11:13.855308+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.855308+0000","last_undegraded":"2024-09-11T22:11:13.855308+0000","last_fullsized":"2024-09-11T22:11:13.855308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873166+0000","last_change":"2024-09-11T22:11:13.872102+0000","last_active":"2024-09-11T22:11:13.873166+0000","last_peered":"2024-09-11T22:11:13.873166+0000","last_clean":"2024-09-11T22:11:13.873166+0000","last_became_active":"2024-09-11T22:11:13.871744+0000","last_became_peered":"2024-09-11T22:11:13.871744+0000","last_unstale":"2024-09-11T22:11:13.873166+0000","last_undegraded":"2024-09-11T22:11:13.873166+0000","last_fullsized":"2024-09-11T22:11:13.873166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858251+0000","last_change":"2024-09-11T22:11:13.858251+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858251+0000","last_undegraded":"2024-09-11T22:11:13.858251+0000","last_fullsized":"2024-09-11T22:11:13.858251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.867429+0000","last_change":"2024-09-11T22:11:13.866539+0000","last_active":"2024-09-11T22:11:13.867429+0000","last_peered":"2024-09-11T22:11:13.867429+0000","last_clean":"2024-09-11T22:11:13.867429+0000","last_became_active":"2024-09-11T22:11:13.866049+0000","last_became_peered":"2024-09-11T22:11:13.866049+0000","last_unstale":"2024-09-11T22:11:13.867429+0000","last_undegraded":"2024-09-11T22:11:13.867429+0000","last_fullsized":"2024-09-11T22:11:13.867429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:52.623769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859720+0000","last_change":"2024-09-11T22:11:13.859720+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859720+0000","last_undegraded":"2024-09-11T22:11:13.859720+0000","last_fullsized":"2024-09-11T22:11:13.859720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862009+0000","last_change":"2024-09-11T22:11:13.862009+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862009+0000","last_undegraded":"2024-09-11T22:11:13.862009+0000","last_fullsized":"2024-09-11T22:11:13.862009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859680+0000","last_change":"2024-09-11T22:11:13.859680+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859680+0000","last_undegraded":"2024-09-11T22:11:13.859680+0000","last_fullsized":"2024-09-11T22:11:13.859680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859918+0000","last_change":"2024-09-11T22:11:13.859918+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859918+0000","last_undegraded":"2024-09-11T22:11:13.859918+0000","last_fullsized":"2024-09-11T22:11:13.859918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859730+0000","last_change":"2024-09-11T22:11:13.859730+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859730+0000","last_undegraded":"2024-09-11T22:11:13.859730+0000","last_fullsized":"2024-09-11T22:11:13.859730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872861+0000","last_change":"2024-09-11T22:11:13.869743+0000","last_active":"2024-09-11T22:11:13.872861+0000","last_peered":"2024-09-11T22:11:13.872861+0000","last_clean":"2024-09-11T22:11:13.872861+0000","last_became_active":"2024-09-11T22:11:13.868457+0000","last_became_peered":"2024-09-11T22:11:13.868457+0000","last_unstale":"2024-09-11T22:11:13.872861+0000","last_undegraded":"2024-09-11T22:11:13.872861+0000","last_fullsized":"2024-09-11T22:11:13.872861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:53.690138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859809+0000","last_change":"2024-09-11T22:11:13.859809+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859809+0000","last_undegraded":"2024-09-11T22:11:13.859809+0000","last_fullsized":"2024-09-11T22:11:13.859809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.869281+0000","last_change":"2024-09-11T22:11:13.866359+0000","last_active":"2024-09-11T22:11:13.869281+0000","last_peered":"2024-09-11T22:11:13.869281+0000","last_clean":"2024-09-11T22:11:13.869281+0000","last_became_active":"2024-09-11T22:11:13.866072+0000","last_became_peered":"2024-09-11T22:11:13.866072+0000","last_unstale":"2024-09-11T22:11:13.869281+0000","last_undegraded":"2024-09-11T22:11:13.869281+0000","last_fullsized":"2024-09-11T22:11:13.869281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":52,"acting":52,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509443,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":753664,"data_stored":637948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35544,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336296,"statfs":{"total":96636764160,"available":96600367104,"internally_reserved":0,"allocated":196608,"data_stored":66447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:11:18.542 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-11T22:11:18.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:13.846965+0000', 'last_change': '2024-09-11T22:11:13.846965+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.846965+0000', 'last_undegraded': '2024-09-11T22:11:13.846965+0000', 'last_fullsized': '2024-09-11T22:11:13.846965+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.542 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-11T22:11:18.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.859411+0000', 'last_change': '2024-09-11T22:11:13.859411+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.859411+0000', 'last_undegraded': '2024-09-11T22:11:13.859411+0000', 'last_fullsized': '2024-09-11T22:11:13.859411+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:18.542 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-11T22:11:18.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.862599+0000', 'last_change': '2024-09-11T22:11:13.862599+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.862599+0000', 'last_undegraded': '2024-09-11T22:11:13.862599+0000', 'last_fullsized': '2024-09-11T22:11:13.862599+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:18.542 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-11T22:11:18.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.861017+0000', 'last_change': '2024-09-11T22:11:13.861017+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.861017+0000', 'last_undegraded': '2024-09-11T22:11:13.861017+0000', 'last_fullsized': '2024-09-11T22:11:13.861017+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:18.543 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-11T22:11:18.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:13.846965+0000', 'last_change': '2024-09-11T22:11:13.846965+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.846965+0000', 'last_undegraded': '2024-09-11T22:11:13.846965+0000', 'last_fullsized': '2024-09-11T22:11:13.846965+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.543 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-11T22:11:18.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.861590+0000', 'last_change': '2024-09-11T22:11:13.861590+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.861590+0000', 'last_undegraded': '2024-09-11T22:11:13.861590+0000', 'last_fullsized': '2024-09-11T22:11:13.861590+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:18.543 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-11T22:11:18.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:13.846965+0000', 'last_change': '2024-09-11T22:11:13.846965+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.846965+0000', 'last_undegraded': '2024-09-11T22:11:13.846965+0000', 'last_fullsized': '2024-09-11T22:11:13.846965+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.543 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-11T22:11:18.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.860051+0000', 'last_change': '2024-09-11T22:11:13.860051+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.860051+0000', 'last_undegraded': '2024-09-11T22:11:13.860051+0000', 'last_fullsized': '2024-09-11T22:11:13.860051+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:18.543 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-11T22:11:18.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:13.846965+0000', 'last_change': '2024-09-11T22:11:13.846965+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.846965+0000', 'last_undegraded': '2024-09-11T22:11:13.846965+0000', 'last_fullsized': '2024-09-11T22:11:13.846965+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.544 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-11T22:11:18.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.862308+0000', 'last_change': '2024-09-11T22:11:13.862308+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.862308+0000', 'last_undegraded': '2024-09-11T22:11:13.862308+0000', 'last_fullsized': '2024-09-11T22:11:13.862308+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:11:18.544 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-11T22:11:18.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.862604+0000', 'last_change': '2024-09-11T22:11:13.862604+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.862604+0000', 'last_undegraded': '2024-09-11T22:11:13.862604+0000', 'last_fullsized': '2024-09-11T22:11:13.862604+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:11:18.544 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-11T22:11:18.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.856300+0000', 'last_change': '2024-09-11T22:11:13.856300+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.856300+0000', 'last_undegraded': '2024-09-11T22:11:13.856300+0000', 'last_fullsized': '2024-09-11T22:11:13.856300+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:11:18.544 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-11T22:11:18.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.860205+0000', 'last_change': '2024-09-11T22:11:13.860205+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.860205+0000', 'last_undegraded': '2024-09-11T22:11:13.860205+0000', 'last_fullsized': '2024-09-11T22:11:13.860205+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:18.544 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-11T22:11:18.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.862690+0000', 'last_change': '2024-09-11T22:11:13.862690+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.862690+0000', 'last_undegraded': '2024-09-11T22:11:13.862690+0000', 'last_fullsized': '2024-09-11T22:11:13.862690+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:18.544 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-11T22:11:18.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.861883+0000', 'last_change': '2024-09-11T22:11:13.861883+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.861883+0000', 'last_undegraded': '2024-09-11T22:11:13.861883+0000', 'last_fullsized': '2024-09-11T22:11:13.861883+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:18.545 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-11T22:11:18.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.860012+0000', 'last_change': '2024-09-11T22:11:13.860012+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.860012+0000', 'last_undegraded': '2024-09-11T22:11:13.860012+0000', 'last_fullsized': '2024-09-11T22:11:13.860012+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:18.545 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-11T22:11:18.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.857285+0000', 'last_change': '2024-09-11T22:11:13.857285+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.857285+0000', 'last_undegraded': '2024-09-11T22:11:13.857285+0000', 'last_fullsized': '2024-09-11T22:11:13.857285+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:18.545 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-11T22:11:18.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:13.846965+0000', 'last_change': '2024-09-11T22:11:13.846965+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.846965+0000', 'last_undegraded': '2024-09-11T22:11:13.846965+0000', 'last_fullsized': '2024-09-11T22:11:13.846965+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.545 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-11T22:11:18.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.860357+0000', 'last_change': '2024-09-11T22:11:13.860357+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.860357+0000', 'last_undegraded': '2024-09-11T22:11:13.860357+0000', 'last_fullsized': '2024-09-11T22:11:13.860357+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:11:18.545 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-11T22:11:18.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.862078+0000', 'last_change': '2024-09-11T22:11:13.862078+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.862078+0000', 'last_undegraded': '2024-09-11T22:11:13.862078+0000', 'last_fullsized': '2024-09-11T22:11:13.862078+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:18.546 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-11T22:11:18.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.859418+0000', 'last_change': '2024-09-11T22:11:13.859418+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.859418+0000', 'last_undegraded': '2024-09-11T22:11:13.859418+0000', 'last_fullsized': '2024-09-11T22:11:13.859418+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:18.546 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-11T22:11:18.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.859088+0000', 'last_change': '2024-09-11T22:11:13.859088+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.859088+0000', 'last_undegraded': '2024-09-11T22:11:13.859088+0000', 'last_fullsized': '2024-09-11T22:11:13.859088+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:18.546 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-11T22:11:18.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.857107+0000', 'last_change': '2024-09-11T22:11:13.857107+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.857107+0000', 'last_undegraded': '2024-09-11T22:11:13.857107+0000', 'last_fullsized': '2024-09-11T22:11:13.857107+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:18.546 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-11T22:11:18.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.860681+0000', 'last_change': '2024-09-11T22:11:13.860681+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.860681+0000', 'last_undegraded': '2024-09-11T22:11:13.860681+0000', 'last_fullsized': '2024-09-11T22:11:13.860681+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:18.546 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-11T22:11:18.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.861820+0000', 'last_change': '2024-09-11T22:11:13.861820+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.861820+0000', 'last_undegraded': '2024-09-11T22:11:13.861820+0000', 'last_fullsized': '2024-09-11T22:11:13.861820+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:11:18.547 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-11T22:11:18.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.862280+0000', 'last_change': '2024-09-11T22:11:13.862280+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.862280+0000', 'last_undegraded': '2024-09-11T22:11:13.862280+0000', 'last_fullsized': '2024-09-11T22:11:13.862280+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:18.547 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-11T22:11:18.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.858813+0000', 'last_change': '2024-09-11T22:11:13.858813+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.858813+0000', 'last_undegraded': '2024-09-11T22:11:13.858813+0000', 'last_fullsized': '2024-09-11T22:11:13.858813+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:18.547 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-11T22:11:18.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.861391+0000', 'last_change': '2024-09-11T22:11:13.861391+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.861391+0000', 'last_undegraded': '2024-09-11T22:11:13.861391+0000', 'last_fullsized': '2024-09-11T22:11:13.861391+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:18.547 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-11T22:11:18.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.858569+0000', 'last_change': '2024-09-11T22:11:13.858569+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.858569+0000', 'last_undegraded': '2024-09-11T22:11:13.858569+0000', 'last_fullsized': '2024-09-11T22:11:13.858569+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:18.547 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-11T22:11:18.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.861026+0000', 'last_change': '2024-09-11T22:11:13.861026+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.861026+0000', 'last_undegraded': '2024-09-11T22:11:13.861026+0000', 'last_fullsized': '2024-09-11T22:11:13.861026+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:11:18.547 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-11T22:11:18.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.855770+0000', 'last_change': '2024-09-11T22:11:13.855770+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.855770+0000', 'last_undegraded': '2024-09-11T22:11:13.855770+0000', 'last_fullsized': '2024-09-11T22:11:13.855770+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:11:18.548 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-11T22:11:18.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.859814+0000', 'last_change': '2024-09-11T22:11:13.859814+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.859814+0000', 'last_undegraded': '2024-09-11T22:11:13.859814+0000', 'last_fullsized': '2024-09-11T22:11:13.859814+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:18.548 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-11T22:11:18.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.859534+0000', 'last_change': '2024-09-11T22:11:13.859534+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.859534+0000', 'last_undegraded': '2024-09-11T22:11:13.859534+0000', 'last_fullsized': '2024-09-11T22:11:13.859534+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:18.548 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-11T22:11:18.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.864339+0000', 'last_change': '2024-09-11T22:11:13.864339+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.864339+0000', 'last_undegraded': '2024-09-11T22:11:13.864339+0000', 'last_fullsized': '2024-09-11T22:11:13.864339+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:18.548 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-11T22:11:18.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.857158+0000', 'last_change': '2024-09-11T22:11:13.857158+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.857158+0000', 'last_undegraded': '2024-09-11T22:11:13.857158+0000', 'last_fullsized': '2024-09-11T22:11:13.857158+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:18.548 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-11T22:11:18.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.858952+0000', 'last_change': '2024-09-11T22:11:13.858952+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.858952+0000', 'last_undegraded': '2024-09-11T22:11:13.858952+0000', 'last_fullsized': '2024-09-11T22:11:13.858952+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:18.549 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-11T22:11:18.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.855170+0000', 'last_change': '2024-09-11T22:11:13.855170+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.855170+0000', 'last_undegraded': '2024-09-11T22:11:13.855170+0000', 'last_fullsized': '2024-09-11T22:11:13.855170+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:11:18.549 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-11T22:11:18.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:13.846965+0000', 'last_change': '2024-09-11T22:11:13.846965+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.846965+0000', 'last_undegraded': '2024-09-11T22:11:13.846965+0000', 'last_fullsized': '2024-09-11T22:11:13.846965+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.549 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-11T22:11:18.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.857829+0000', 'last_change': '2024-09-11T22:11:13.857829+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.857829+0000', 'last_undegraded': '2024-09-11T22:11:13.857829+0000', 'last_fullsized': '2024-09-11T22:11:13.857829+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:18.549 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-11T22:11:18.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:13.846965+0000', 'last_change': '2024-09-11T22:11:13.846965+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.846965+0000', 'last_undegraded': '2024-09-11T22:11:13.846965+0000', 'last_fullsized': '2024-09-11T22:11:13.846965+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.549 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-11T22:11:18.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.859651+0000', 'last_change': '2024-09-11T22:11:13.859651+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.859651+0000', 'last_undegraded': '2024-09-11T22:11:13.859651+0000', 'last_fullsized': '2024-09-11T22:11:13.859651+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:11:18.550 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-11T22:11:18.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:13.846965+0000', 'last_change': '2024-09-11T22:11:13.846965+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.846965+0000', 'last_undegraded': '2024-09-11T22:11:13.846965+0000', 'last_fullsized': '2024-09-11T22:11:13.846965+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.550 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-11T22:11:18.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:13.846965+0000', 'last_change': '2024-09-11T22:11:13.846965+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.846965+0000', 'last_undegraded': '2024-09-11T22:11:13.846965+0000', 'last_fullsized': '2024-09-11T22:11:13.846965+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.550 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-11T22:11:18.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:13.846965+0000', 'last_change': '2024-09-11T22:11:13.846965+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.846965+0000', 'last_undegraded': '2024-09-11T22:11:13.846965+0000', 'last_fullsized': '2024-09-11T22:11:13.846965+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.550 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-11T22:11:18.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.857262+0000', 'last_change': '2024-09-11T22:11:13.857262+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.857262+0000', 'last_undegraded': '2024-09-11T22:11:13.857262+0000', 'last_fullsized': '2024-09-11T22:11:13.857262+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:18.550 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-11T22:11:18.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:13.846965+0000', 'last_change': '2024-09-11T22:11:13.846965+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.846965+0000', 'last_undegraded': '2024-09-11T22:11:13.846965+0000', 'last_fullsized': '2024-09-11T22:11:13.846965+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.551 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-11T22:11:18.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.858270+0000', 'last_change': '2024-09-11T22:11:13.858270+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.858270+0000', 'last_undegraded': '2024-09-11T22:11:13.858270+0000', 'last_fullsized': '2024-09-11T22:11:13.858270+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:18.551 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-11T22:11:18.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:12.841731+0000', 'last_change': '2024-09-11T22:11:12.841731+0000', 'last_active': '2024-09-11T22:11:12.841731+0000', 'last_peered': '2024-09-11T22:11:12.841731+0000', 'last_clean': '2024-09-11T22:11:12.841731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:12.841731+0000', 'last_undegraded': '2024-09-11T22:11:12.841731+0000', 'last_fullsized': '2024-09-11T22:11:12.841731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.551 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-11T22:11:18.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.857452+0000', 'last_change': '2024-09-11T22:11:13.857452+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.857452+0000', 'last_undegraded': '2024-09-11T22:11:13.857452+0000', 'last_fullsized': '2024-09-11T22:11:13.857452+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:18.551 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-11T22:11:18.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.859844+0000', 'last_change': '2024-09-11T22:11:13.859844+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.859844+0000', 'last_undegraded': '2024-09-11T22:11:13.859844+0000', 'last_fullsized': '2024-09-11T22:11:13.859844+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:18.551 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-11T22:11:18.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.856164+0000', 'last_change': '2024-09-11T22:11:13.856164+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.856164+0000', 'last_undegraded': '2024-09-11T22:11:13.856164+0000', 'last_fullsized': '2024-09-11T22:11:13.856164+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:11:18.552 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-11T22:11:18.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.858030+0000', 'last_change': '2024-09-11T22:11:13.858030+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.858030+0000', 'last_undegraded': '2024-09-11T22:11:13.858030+0000', 'last_fullsized': '2024-09-11T22:11:13.858030+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:18.552 INFO:tasks.ceph.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-11T22:11:18.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:12.841731+0000', 'last_change': '2024-09-11T22:11:12.841731+0000', 'last_active': '2024-09-11T22:11:12.841731+0000', 'last_peered': '2024-09-11T22:11:12.841731+0000', 'last_clean': '2024-09-11T22:11:12.841731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:12.841731+0000', 'last_undegraded': '2024-09-11T22:11:12.841731+0000', 'last_fullsized': '2024-09-11T22:11:12.841731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.552 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-11T22:11:18.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.857970+0000', 'last_change': '2024-09-11T22:11:13.857970+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.857970+0000', 'last_undegraded': '2024-09-11T22:11:13.857970+0000', 'last_fullsized': '2024-09-11T22:11:13.857970+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:18.552 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-11T22:11:18.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.857777+0000', 'last_change': '2024-09-11T22:11:13.857777+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.857777+0000', 'last_undegraded': '2024-09-11T22:11:13.857777+0000', 'last_fullsized': '2024-09-11T22:11:13.857777+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:18.552 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-11T22:11:18.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.856979+0000', 'last_change': '2024-09-11T22:11:13.856979+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.856979+0000', 'last_undegraded': '2024-09-11T22:11:13.856979+0000', 'last_fullsized': '2024-09-11T22:11:13.856979+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:18.552 INFO:tasks.ceph.ceph_manager.ceph:PG 2.8 is not active+clean 2024-09-11T22:11:18.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:12.841731+0000', 'last_change': '2024-09-11T22:11:12.841731+0000', 'last_active': '2024-09-11T22:11:12.841731+0000', 'last_peered': '2024-09-11T22:11:12.841731+0000', 'last_clean': '2024-09-11T22:11:12.841731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:12.841731+0000', 'last_undegraded': '2024-09-11T22:11:12.841731+0000', 'last_fullsized': '2024-09-11T22:11:12.841731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.553 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-11T22:11:18.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.855308+0000', 'last_change': '2024-09-11T22:11:13.855308+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.855308+0000', 'last_undegraded': '2024-09-11T22:11:13.855308+0000', 'last_fullsized': '2024-09-11T22:11:13.855308+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:11:18.553 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-11T22:11:18.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.858251+0000', 'last_change': '2024-09-11T22:11:13.858251+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.858251+0000', 'last_undegraded': '2024-09-11T22:11:13.858251+0000', 'last_fullsized': '2024-09-11T22:11:13.858251+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:18.553 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-11T22:11:18.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.859720+0000', 'last_change': '2024-09-11T22:11:13.859720+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.859720+0000', 'last_undegraded': '2024-09-11T22:11:13.859720+0000', 'last_fullsized': '2024-09-11T22:11:13.859720+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:18.553 INFO:tasks.ceph.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-11T22:11:18.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:12.841731+0000', 'last_change': '2024-09-11T22:11:12.841731+0000', 'last_active': '2024-09-11T22:11:12.841731+0000', 'last_peered': '2024-09-11T22:11:12.841731+0000', 'last_clean': '2024-09-11T22:11:12.841731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:12.841731+0000', 'last_undegraded': '2024-09-11T22:11:12.841731+0000', 'last_fullsized': '2024-09-11T22:11:12.841731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.553 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-11T22:11:18.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.862009+0000', 'last_change': '2024-09-11T22:11:13.862009+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.862009+0000', 'last_undegraded': '2024-09-11T22:11:13.862009+0000', 'last_fullsized': '2024-09-11T22:11:13.862009+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:11:18.554 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-11T22:11:18.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.859680+0000', 'last_change': '2024-09-11T22:11:13.859680+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.859680+0000', 'last_undegraded': '2024-09-11T22:11:13.859680+0000', 'last_fullsized': '2024-09-11T22:11:13.859680+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:18.554 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-11T22:11:18.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:12.841731+0000', 'last_change': '2024-09-11T22:11:12.841731+0000', 'last_active': '2024-09-11T22:11:12.841731+0000', 'last_peered': '2024-09-11T22:11:12.841731+0000', 'last_clean': '2024-09-11T22:11:12.841731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:12.841731+0000', 'last_undegraded': '2024-09-11T22:11:12.841731+0000', 'last_fullsized': '2024-09-11T22:11:12.841731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.554 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-11T22:11:18.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.859918+0000', 'last_change': '2024-09-11T22:11:13.859918+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.859918+0000', 'last_undegraded': '2024-09-11T22:11:13.859918+0000', 'last_fullsized': '2024-09-11T22:11:13.859918+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:18.554 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1d is not active+clean 2024-09-11T22:11:18.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:11:12.841731+0000', 'last_change': '2024-09-11T22:11:12.841731+0000', 'last_active': '2024-09-11T22:11:12.841731+0000', 'last_peered': '2024-09-11T22:11:12.841731+0000', 'last_clean': '2024-09-11T22:11:12.841731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:12.841731+0000', 'last_undegraded': '2024-09-11T22:11:12.841731+0000', 'last_fullsized': '2024-09-11T22:11:12.841731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:12.841731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:11:18.554 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-11T22:11:18.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.859730+0000', 'last_change': '2024-09-11T22:11:13.859730+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.859730+0000', 'last_undegraded': '2024-09-11T22:11:13.859730+0000', 'last_fullsized': '2024-09-11T22:11:13.859730+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:18.555 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-11T22:11:18.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:13.859809+0000', 'last_change': '2024-09-11T22:11:13.859809+0000', 'last_active': '2024-09-11T22:11:13.846965+0000', 'last_peered': '2024-09-11T22:11:13.846965+0000', 'last_clean': '2024-09-11T22:11:13.846965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:13.859809+0000', 'last_undegraded': '2024-09-11T22:11:13.859809+0000', 'last_fullsized': '2024-09-11T22:11:13.859809+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:13.846965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:18.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:11:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.680+0000 7fc158b8f640 1 Processor -- start 2024-09-11T22:11:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.680+0000 7fc158b8f640 1 -- start start 2024-09-11T22:11:18.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.681+0000 7fc158b8f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1540d1c90 0x7fc1540b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:18.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.681+0000 7fc158b8f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc154162350 0x7fc1541627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:18.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.681+0000 7fc158b8f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc154163080 con 0x7fc15415e8e0 2024-09-11T22:11:18.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.681+0000 7fc158b8f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc15415ecc0 con 0x7fc154162350 2024-09-11T22:11:18.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.681+0000 7fc158b8f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc1540d2ad0 con 0x7fc1540d1c90 2024-09-11T22:11:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.681+0000 7fc152d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc154162350 0x7fc1541627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.681+0000 7fc152d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc154162350 0x7fc1541627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46292/0 (socket says 172.21.15.50:46292) 2024-09-11T22:11:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.681+0000 7fc152d9d640 1 -- 172.21.15.50:0/3346853662 learned_addr learned my addr 172.21.15.50:0/3346853662 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.681+0000 7fc151d9b640 1 --2- 172.21.15.50:0/3346853662 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1540d1c90 0x7fc1540b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.681+0000 7fc152d9d640 1 -- 172.21.15.50:0/3346853662 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1540d1c90 msgr2=0x7fc1540b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.681+0000 7fc152d9d640 1 --2- 172.21.15.50:0/3346853662 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1540d1c90 0x7fc1540b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.681+0000 7fc152d9d640 1 -- 172.21.15.50:0/3346853662 >> v1:172.21.15.77:6789/0 conn(0x7fc15415e8e0 legacy=0x7fc1540d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.681+0000 7fc152d9d640 1 -- 172.21.15.50:0/3346853662 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1540d2d20 con 0x7fc154162350 2024-09-11T22:11:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.682+0000 7fc152d9d640 1 --2- 172.21.15.50:0/3346853662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc154162350 0x7fc1541627e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009e50 tx=0x7fc14c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c26681a2a78939 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.682+0000 7fc15159a640 1 -- 172.21.15.50:0/3346853662 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c036070 con 0x7fc154162350 2024-09-11T22:11:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.682+0000 7fc15159a640 1 -- 172.21.15.50:0/3346853662 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc14c031600 con 0x7fc154162350 2024-09-11T22:11:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.682+0000 7fc15159a640 1 -- 172.21.15.50:0/3346853662 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c0319d0 con 0x7fc154162350 2024-09-11T22:11:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.683+0000 7fc158b8f640 1 -- 172.21.15.50:0/3346853662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc154162350 msgr2=0x7fc1541627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.683+0000 7fc158b8f640 1 --2- 172.21.15.50:0/3346853662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc154162350 0x7fc1541627e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009e50 tx=0x7fc14c02a7a0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.683+0000 7fc158b8f640 1 -- 172.21.15.50:0/3346853662 shutdown_connections 2024-09-11T22:11:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.683+0000 7fc158b8f640 1 --2- 172.21.15.50:0/3346853662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc154162350 0x7fc1541627e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.683+0000 7fc158b8f640 1 --2- 172.21.15.50:0/3346853662 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1540d1c90 0x7fc1540b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.683+0000 7fc158b8f640 1 -- 172.21.15.50:0/3346853662 >> 172.21.15.50:0/3346853662 conn(0x7fc154067ba0 msgr2=0x7fc154067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.683+0000 7fc158b8f640 1 -- 172.21.15.50:0/3346853662 shutdown_connections 2024-09-11T22:11:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.683+0000 7fc158b8f640 1 -- 172.21.15.50:0/3346853662 wait complete. 2024-09-11T22:11:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.684+0000 7fc158b8f640 1 Processor -- start 2024-09-11T22:11:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.684+0000 7fc158b8f640 1 -- start start 2024-09-11T22:11:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc158b8f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1540d1c90 0x7fc1540cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc158b8f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc15415e8e0 0x7fc154153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc158b8f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc154162350 0x7fc15415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc158b8f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc154162d20 con 0x7fc154162350 2024-09-11T22:11:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc158b8f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc1540d3370 con 0x7fc15415e8e0 2024-09-11T22:11:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc158b8f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc1540d3800 con 0x7fc1540d1c90 2024-09-11T22:11:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc152d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc154162350 0x7fc15415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc152d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc154162350 0x7fc15415cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46302/0 (socket says 172.21.15.50:46302) 2024-09-11T22:11:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc152d9d640 1 -- 172.21.15.50:0/1148975484 learned_addr learned my addr 172.21.15.50:0/1148975484 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc151d9b640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc15415e8e0 0x7fc154153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc15259c640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1540d1c90 0x7fc1540cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc152d9d640 1 -- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1540d1c90 msgr2=0x7fc1540cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc152d9d640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1540d1c90 0x7fc1540cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc152d9d640 1 -- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc15415e8e0 msgr2=0x7fc154153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc152d9d640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc15415e8e0 0x7fc154153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc152d9d640 1 -- 172.21.15.50:0/1148975484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1540cdd80 con 0x7fc154162350 2024-09-11T22:11:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.685+0000 7fc15259c640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1540d1c90 0x7fc1540cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.686+0000 7fc152d9d640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc154162350 0x7fc15415cee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc14c034040 tx=0x7fc14c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.686+0000 7fc142ffd640 1 -- 172.21.15.50:0/1148975484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c036050 con 0x7fc154162350 2024-09-11T22:11:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.686+0000 7fc142ffd640 1 -- 172.21.15.50:0/1148975484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc14c042070 con 0x7fc154162350 2024-09-11T22:11:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.686+0000 7fc158b8f640 1 -- 172.21.15.50:0/1148975484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1540b43f0 con 0x7fc154162350 2024-09-11T22:11:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.686+0000 7fc142ffd640 1 -- 172.21.15.50:0/1148975484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c009510 con 0x7fc154162350 2024-09-11T22:11:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.686+0000 7fc158b8f640 1 -- 172.21.15.50:0/1148975484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1540b49b0 con 0x7fc154162350 2024-09-11T22:11:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.687+0000 7fc158b8f640 1 -- 172.21.15.50:0/1148975484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1540b7880 con 0x7fc154162350 2024-09-11T22:11:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.687+0000 7fc142ffd640 1 -- 172.21.15.50:0/1148975484 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc14c007bb0 con 0x7fc154162350 2024-09-11T22:11:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.688+0000 7fc142ffd640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc13406be30 0x7fc13406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.688+0000 7fc142ffd640 1 -- 172.21.15.50:0/1148975484 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc14c0abb80 con 0x7fc154162350 2024-09-11T22:11:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.688+0000 7fc15259c640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc13406be30 0x7fc13406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.688+0000 7fc15259c640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc13406be30 0x7fc13406e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc144007fd0 tx=0x7fc144009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.692+0000 7fc142ffd640 1 -- 172.21.15.50:0/1148975484 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc14c07a5c0 con 0x7fc154162350 2024-09-11T22:11:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.933+0000 7fc158b8f640 1 -- 172.21.15.50:0/1148975484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc1540ba770 con 0x7fc154162350 2024-09-11T22:11:18.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.934+0000 7fc142ffd640 1 -- 172.21.15.50:0/1148975484 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1211 (secure 0 0 0) 0x7fc14c079ec0 con 0x7fc154162350 2024-09-11T22:11:18.935 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:18.935 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":27,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":51},{"state_name":"active+clean","count":29},{"state_name":"unknown","count":17}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590368,"bytes_used":245927936,"bytes_avail":772848185344,"bytes_total":773094113280,"unknown_pgs_ratio":0.17525772750377655,"inactive_pgs_ratio":0.52577316761016846,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":6,"btime":"2024-09-11T22:11:16:865918+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4284}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-11T22:10:51.176397+0000","services":{}},"progress_events":{}} 2024-09-11T22:11:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.936+0000 7fc158b8f640 1 -- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc13406be30 msgr2=0x7fc13406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.936+0000 7fc158b8f640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc13406be30 0x7fc13406e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc144007fd0 tx=0x7fc144009040 comp rx=0 tx=0).stop 2024-09-11T22:11:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.936+0000 7fc158b8f640 1 -- 172.21.15.50:0/1148975484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc154162350 msgr2=0x7fc15415cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.936+0000 7fc158b8f640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc154162350 0x7fc15415cee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc14c034040 tx=0x7fc14c004a40 comp rx=0 tx=0).stop 2024-09-11T22:11:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.936+0000 7fc158b8f640 1 -- 172.21.15.50:0/1148975484 shutdown_connections 2024-09-11T22:11:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.936+0000 7fc158b8f640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc13406be30 0x7fc13406e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.936+0000 7fc158b8f640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc154162350 0x7fc15415cee0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.936+0000 7fc158b8f640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc15415e8e0 0x7fc154153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.936+0000 7fc158b8f640 1 --2- 172.21.15.50:0/1148975484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1540d1c90 0x7fc1540cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.936+0000 7fc158b8f640 1 -- 172.21.15.50:0/1148975484 >> 172.21.15.50:0/1148975484 conn(0x7fc154067ba0 msgr2=0x7fc15415dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.936+0000 7fc158b8f640 1 -- 172.21.15.50:0/1148975484 shutdown_connections 2024-09-11T22:11:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:18.936+0000 7fc158b8f640 1 -- 172.21.15.50:0/1148975484 wait complete. 2024-09-11T22:11:18.947 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:11:18.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:11:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.048+0000 7f9f2a08d640 1 Processor -- start 2024-09-11T22:11:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.048+0000 7f9f2a08d640 1 -- start start 2024-09-11T22:11:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.049+0000 7f9f2a08d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9f240d0d00 0x7f9f240b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.049+0000 7f9f2a08d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9f24070430 0x7f9f240b1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.049+0000 7f9f2a08d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f24070910 con 0x7f9f2415fb40 2024-09-11T22:11:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.049+0000 7f9f2a08d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9f240b0630 con 0x7f9f240d0d00 2024-09-11T22:11:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.049+0000 7f9f2a08d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9f240affe0 con 0x7f9f24070430 2024-09-11T22:11:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.049+0000 7f9f22ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9f240d0d00 0x7f9f240b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.049+0000 7f9f237fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9f2415fb40 0x7f9f240d05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41124/0 (socket says 172.21.15.50:41124) 2024-09-11T22:11:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.049+0000 7f9f237fe640 1 -- 172.21.15.50:0/611073974 learned_addr learned my addr 172.21.15.50:0/611073974 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.049+0000 7f9f23fff640 1 --2- 172.21.15.50:0/611073974 >> v2:172.21.15.77:3300/0 conn(0x7f9f24070430 0x7f9f240b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.050+0000 7f9f227fc640 1 -- 172.21.15.50:0/611073974 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1641625137 0 0) 0x7f9f24070910 con 0x7f9f2415fb40 2024-09-11T22:11:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.050+0000 7f9f227fc640 1 -- 172.21.15.50:0/611073974 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f0c003520 con 0x7f9f2415fb40 2024-09-11T22:11:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.050+0000 7f9f22ffd640 1 -- 172.21.15.50:0/611073974 >> v2:172.21.15.77:3300/0 conn(0x7f9f24070430 msgr2=0x7f9f240b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.050+0000 7f9f22ffd640 1 --2- 172.21.15.50:0/611073974 >> v2:172.21.15.77:3300/0 conn(0x7f9f24070430 0x7f9f240b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.050+0000 7f9f22ffd640 1 -- 172.21.15.50:0/611073974 >> v1:172.21.15.50:6789/0 conn(0x7f9f2415fb40 legacy=0x7f9f240d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.050+0000 7f9f22ffd640 1 -- 172.21.15.50:0/611073974 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f240b02c0 con 0x7f9f240d0d00 2024-09-11T22:11:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.050+0000 7f9f22ffd640 1 --2- 172.21.15.50:0/611073974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240d0d00 0x7f9f240b0ac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9f24072a60 tx=0x7f9f1802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c394110d4d89eddc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.051+0000 7f9f227fc640 1 -- 172.21.15.50:0/611073974 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18037070 con 0x7f9f240d0d00 2024-09-11T22:11:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.051+0000 7f9f227fc640 1 -- 172.21.15.50:0/611073974 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f18032440 con 0x7f9f240d0d00 2024-09-11T22:11:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.051+0000 7f9f227fc640 1 -- 172.21.15.50:0/611073974 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18032810 con 0x7f9f240d0d00 2024-09-11T22:11:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.051+0000 7f9f2a08d640 1 -- 172.21.15.50:0/611073974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240d0d00 msgr2=0x7f9f240b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.051+0000 7f9f2a08d640 1 --2- 172.21.15.50:0/611073974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240d0d00 0x7f9f240b0ac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9f24072a60 tx=0x7f9f1802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.051+0000 7f9f2a08d640 1 -- 172.21.15.50:0/611073974 shutdown_connections 2024-09-11T22:11:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.051+0000 7f9f2a08d640 1 --2- 172.21.15.50:0/611073974 >> v2:172.21.15.77:3300/0 conn(0x7f9f24070430 0x7f9f240b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.051+0000 7f9f2a08d640 1 --2- 172.21.15.50:0/611073974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240d0d00 0x7f9f240b0ac0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.051+0000 7f9f2a08d640 1 -- 172.21.15.50:0/611073974 >> 172.21.15.50:0/611073974 conn(0x7f9f240b4150 msgr2=0x7f9f240b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.051+0000 7f9f2a08d640 1 -- 172.21.15.50:0/611073974 shutdown_connections 2024-09-11T22:11:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.051+0000 7f9f2a08d640 1 -- 172.21.15.50:0/611073974 wait complete. 2024-09-11T22:11:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.052+0000 7f9f2a08d640 1 Processor -- start 2024-09-11T22:11:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.053+0000 7f9f2a08d640 1 -- start start 2024-09-11T22:11:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.053+0000 7f9f2a08d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f24070430 0x7f9f241f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.053+0000 7f9f2a08d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f240d0d00 0x7f9f2414b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.053+0000 7f9f2a08d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f2415fb40 0x7f9f2414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.053+0000 7f9f2a08d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9f240d1310 con 0x7f9f24070430 2024-09-11T22:11:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.053+0000 7f9f2a08d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9f240d1190 con 0x7f9f2415fb40 2024-09-11T22:11:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.053+0000 7f9f2a08d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9f24070ed0 con 0x7f9f240d0d00 2024-09-11T22:11:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.053+0000 7f9f237fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f24070430 0x7f9f241f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.053+0000 7f9f237fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f24070430 0x7f9f241f5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46330/0 (socket says 172.21.15.50:46330) 2024-09-11T22:11:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.053+0000 7f9f237fe640 1 -- 172.21.15.50:0/973274252 learned_addr learned my addr 172.21.15.50:0/973274252 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f23fff640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f2415fb40 0x7f9f2414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f22ffd640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f240d0d00 0x7f9f2414b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f237fe640 1 -- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f240d0d00 msgr2=0x7f9f2414b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f237fe640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f240d0d00 0x7f9f2414b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f237fe640 1 -- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f2415fb40 msgr2=0x7f9f2414b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f237fe640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f2415fb40 0x7f9f2414b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f237fe640 1 -- 172.21.15.50:0/973274252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f241f6130 con 0x7f9f24070430 2024-09-11T22:11:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f23fff640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f2415fb40 0x7f9f2414b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f237fe640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f24070430 0x7f9f241f5bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400c390 tx=0x7f9f1400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f0bfff640 1 -- 172.21.15.50:0/973274252 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14017070 con 0x7f9f24070430 2024-09-11T22:11:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f0bfff640 1 -- 172.21.15.50:0/973274252 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f14005ce0 con 0x7f9f24070430 2024-09-11T22:11:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f2a08d640 1 -- 172.21.15.50:0/973274252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f240cc420 con 0x7f9f24070430 2024-09-11T22:11:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f0bfff640 1 -- 172.21.15.50:0/973274252 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f140072f0 con 0x7f9f24070430 2024-09-11T22:11:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.054+0000 7f9f2a08d640 1 -- 172.21.15.50:0/973274252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f240c7240 con 0x7f9f24070430 2024-09-11T22:11:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.055+0000 7f9f2a08d640 1 -- 172.21.15.50:0/973274252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f240d05f0 con 0x7f9f24070430 2024-09-11T22:11:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.056+0000 7f9f0bfff640 1 -- 172.21.15.50:0/973274252 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f1401a070 con 0x7f9f24070430 2024-09-11T22:11:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.056+0000 7f9f0bfff640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f1006be30 0x7f9f1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.056+0000 7f9f0bfff640 1 -- 172.21.15.50:0/973274252 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9f1408a260 con 0x7f9f24070430 2024-09-11T22:11:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.056+0000 7f9f22ffd640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f1006be30 0x7f9f1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.057+0000 7f9f22ffd640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f1006be30 0x7f9f1006e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9f18034000 tx=0x7f9f1802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:19.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.060+0000 7f9f0bfff640 1 -- 172.21.15.50:0/973274252 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f241f6130 con 0x7f9f24070430 2024-09-11T22:11:19.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.232+0000 7f9f2a08d640 1 -- 172.21.15.50:0/973274252 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f2406e240 con 0x7f9f1006be30 2024-09-11T22:11:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.238+0000 7f9f0bfff640 1 -- 172.21.15.50:0/973274252 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245277 (secure 0 0 0) 0x7f9f2406e240 con 0x7f9f1006be30 2024-09-11T22:11:19.241 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:11:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.241+0000 7f9f2a08d640 1 -- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f1006be30 msgr2=0x7f9f1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.241+0000 7f9f2a08d640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f1006be30 0x7f9f1006e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9f18034000 tx=0x7f9f1802e000 comp rx=0 tx=0).stop 2024-09-11T22:11:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.241+0000 7f9f2a08d640 1 -- 172.21.15.50:0/973274252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f24070430 msgr2=0x7f9f241f5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.241+0000 7f9f2a08d640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f24070430 0x7f9f241f5bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400c390 tx=0x7f9f1400c850 comp rx=0 tx=0).stop 2024-09-11T22:11:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.241+0000 7f9f2a08d640 1 -- 172.21.15.50:0/973274252 shutdown_connections 2024-09-11T22:11:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.241+0000 7f9f2a08d640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f1006be30 0x7f9f1006e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.241+0000 7f9f2a08d640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f240d0d00 0x7f9f2414b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.241+0000 7f9f2a08d640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f2415fb40 0x7f9f2414b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.241+0000 7f9f2a08d640 1 --2- 172.21.15.50:0/973274252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f24070430 0x7f9f241f5bf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.241+0000 7f9f2a08d640 1 -- 172.21.15.50:0/973274252 >> 172.21.15.50:0/973274252 conn(0x7f9f240b4150 msgr2=0x7f9f240b5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.241+0000 7f9f2a08d640 1 -- 172.21.15.50:0/973274252 shutdown_connections 2024-09-11T22:11:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:19.241+0000 7f9f2a08d640 1 -- 172.21.15.50:0/973274252 wait complete. 2024-09-11T22:11:19.252 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-11T22:11:17.363984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240164,"kb_used_data":2516,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734556,"statfs":{"total":773094113280,"available":772848185344,"internally_reserved":0,"allocated":2576384,"data_stored":1615145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.516729"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859411+0000","last_change":"2024-09-11T22:11:13.859411+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859411+0000","last_undegraded":"2024-09-11T22:11:13.859411+0000","last_fullsized":"2024-09-11T22:11:13.859411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862599+0000","last_change":"2024-09-11T22:11:13.862599+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862599+0000","last_undegraded":"2024-09-11T22:11:13.862599+0000","last_fullsized":"2024-09-11T22:11:13.862599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861017+0000","last_change":"2024-09-11T22:11:13.861017+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861017+0000","last_undegraded":"2024-09-11T22:11:13.861017+0000","last_fullsized":"2024-09-11T22:11:13.861017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861590+0000","last_change":"2024-09-11T22:11:13.861590+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861590+0000","last_undegraded":"2024-09-11T22:11:13.861590+0000","last_fullsized":"2024-09-11T22:11:13.861590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860051+0000","last_change":"2024-09-11T22:11:13.860051+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860051+0000","last_undegraded":"2024-09-11T22:11:13.860051+0000","last_fullsized":"2024-09-11T22:11:13.860051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862308+0000","last_change":"2024-09-11T22:11:13.862308+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862308+0000","last_undegraded":"2024-09-11T22:11:13.862308+0000","last_fullsized":"2024-09-11T22:11:13.862308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862604+0000","last_change":"2024-09-11T22:11:13.862604+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862604+0000","last_undegraded":"2024-09-11T22:11:13.862604+0000","last_fullsized":"2024-09-11T22:11:13.862604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.856300+0000","last_change":"2024-09-11T22:11:13.856300+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.856300+0000","last_undegraded":"2024-09-11T22:11:13.856300+0000","last_fullsized":"2024-09-11T22:11:13.856300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860205+0000","last_change":"2024-09-11T22:11:13.860205+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860205+0000","last_undegraded":"2024-09-11T22:11:13.860205+0000","last_fullsized":"2024-09-11T22:11:13.860205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862690+0000","last_change":"2024-09-11T22:11:13.862690+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862690+0000","last_undegraded":"2024-09-11T22:11:13.862690+0000","last_fullsized":"2024-09-11T22:11:13.862690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861883+0000","last_change":"2024-09-11T22:11:13.861883+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861883+0000","last_undegraded":"2024-09-11T22:11:13.861883+0000","last_fullsized":"2024-09-11T22:11:13.861883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860012+0000","last_change":"2024-09-11T22:11:13.860012+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860012+0000","last_undegraded":"2024-09-11T22:11:13.860012+0000","last_fullsized":"2024-09-11T22:11:13.860012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857285+0000","last_change":"2024-09-11T22:11:13.857285+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857285+0000","last_undegraded":"2024-09-11T22:11:13.857285+0000","last_fullsized":"2024-09-11T22:11:13.857285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.873986+0000","last_change":"2024-09-11T22:11:14.869711+0000","last_active":"2024-09-11T22:11:14.873986+0000","last_peered":"2024-09-11T22:11:14.873986+0000","last_clean":"2024-09-11T22:11:14.873986+0000","last_became_active":"2024-09-11T22:11:14.869409+0000","last_became_peered":"2024-09-11T22:11:14.869409+0000","last_unstale":"2024-09-11T22:11:14.873986+0000","last_undegraded":"2024-09-11T22:11:14.873986+0000","last_fullsized":"2024-09-11T22:11:14.873986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:38.715172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860357+0000","last_change":"2024-09-11T22:11:13.860357+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860357+0000","last_undegraded":"2024-09-11T22:11:13.860357+0000","last_fullsized":"2024-09-11T22:11:13.860357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862078+0000","last_change":"2024-09-11T22:11:13.862078+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862078+0000","last_undegraded":"2024-09-11T22:11:13.862078+0000","last_fullsized":"2024-09-11T22:11:13.862078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859418+0000","last_change":"2024-09-11T22:11:13.859418+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859418+0000","last_undegraded":"2024-09-11T22:11:13.859418+0000","last_fullsized":"2024-09-11T22:11:13.859418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859088+0000","last_change":"2024-09-11T22:11:13.859088+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859088+0000","last_undegraded":"2024-09-11T22:11:13.859088+0000","last_fullsized":"2024-09-11T22:11:13.859088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857107+0000","last_change":"2024-09-11T22:11:13.857107+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857107+0000","last_undegraded":"2024-09-11T22:11:13.857107+0000","last_fullsized":"2024-09-11T22:11:13.857107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.860681+0000","last_change":"2024-09-11T22:11:13.860681+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.860681+0000","last_undegraded":"2024-09-11T22:11:13.860681+0000","last_fullsized":"2024-09-11T22:11:13.860681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861820+0000","last_change":"2024-09-11T22:11:13.861820+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861820+0000","last_undegraded":"2024-09-11T22:11:13.861820+0000","last_fullsized":"2024-09-11T22:11:13.861820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862280+0000","last_change":"2024-09-11T22:11:13.862280+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862280+0000","last_undegraded":"2024-09-11T22:11:13.862280+0000","last_fullsized":"2024-09-11T22:11:13.862280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858813+0000","last_change":"2024-09-11T22:11:13.858813+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858813+0000","last_undegraded":"2024-09-11T22:11:13.858813+0000","last_fullsized":"2024-09-11T22:11:13.858813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861391+0000","last_change":"2024-09-11T22:11:13.861391+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861391+0000","last_undegraded":"2024-09-11T22:11:13.861391+0000","last_fullsized":"2024-09-11T22:11:13.861391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858569+0000","last_change":"2024-09-11T22:11:13.858569+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858569+0000","last_undegraded":"2024-09-11T22:11:13.858569+0000","last_fullsized":"2024-09-11T22:11:13.858569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.877104+0000","last_change":"2024-09-11T22:11:14.872267+0000","last_active":"2024-09-11T22:11:14.877104+0000","last_peered":"2024-09-11T22:11:14.877104+0000","last_clean":"2024-09-11T22:11:14.877104+0000","last_became_active":"2024-09-11T22:11:14.871979+0000","last_became_peered":"2024-09-11T22:11:14.871979+0000","last_unstale":"2024-09-11T22:11:14.877104+0000","last_undegraded":"2024-09-11T22:11:14.877104+0000","last_fullsized":"2024-09-11T22:11:14.877104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:27.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.861026+0000","last_change":"2024-09-11T22:11:13.861026+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.861026+0000","last_undegraded":"2024-09-11T22:11:13.861026+0000","last_fullsized":"2024-09-11T22:11:13.861026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.855770+0000","last_change":"2024-09-11T22:11:13.855770+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.855770+0000","last_undegraded":"2024-09-11T22:11:13.855770+0000","last_fullsized":"2024-09-11T22:11:13.855770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872936+0000","last_change":"2024-09-11T22:11:13.870101+0000","last_active":"2024-09-11T22:11:13.872936+0000","last_peered":"2024-09-11T22:11:13.872936+0000","last_clean":"2024-09-11T22:11:13.872936+0000","last_became_active":"2024-09-11T22:11:13.869798+0000","last_became_peered":"2024-09-11T22:11:13.869798+0000","last_unstale":"2024-09-11T22:11:13.872936+0000","last_undegraded":"2024-09-11T22:11:13.872936+0000","last_fullsized":"2024-09-11T22:11:13.872936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859814+0000","last_change":"2024-09-11T22:11:13.859814+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859814+0000","last_undegraded":"2024-09-11T22:11:13.859814+0000","last_fullsized":"2024-09-11T22:11:13.859814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875333+0000","last_change":"2024-09-11T22:11:13.871132+0000","last_active":"2024-09-11T22:11:13.875333+0000","last_peered":"2024-09-11T22:11:13.875333+0000","last_clean":"2024-09-11T22:11:13.875333+0000","last_became_active":"2024-09-11T22:11:13.870831+0000","last_became_peered":"2024-09-11T22:11:13.870831+0000","last_unstale":"2024-09-11T22:11:13.875333+0000","last_undegraded":"2024-09-11T22:11:13.875333+0000","last_fullsized":"2024-09-11T22:11:13.875333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872921+0000","last_change":"2024-09-11T22:11:13.871011+0000","last_active":"2024-09-11T22:11:13.872921+0000","last_peered":"2024-09-11T22:11:13.872921+0000","last_clean":"2024-09-11T22:11:13.872921+0000","last_became_active":"2024-09-11T22:11:13.870723+0000","last_became_peered":"2024-09-11T22:11:13.870723+0000","last_unstale":"2024-09-11T22:11:13.872921+0000","last_undegraded":"2024-09-11T22:11:13.872921+0000","last_fullsized":"2024-09-11T22:11:13.872921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859534+0000","last_change":"2024-09-11T22:11:13.859534+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859534+0000","last_undegraded":"2024-09-11T22:11:13.859534+0000","last_fullsized":"2024-09-11T22:11:13.859534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873131+0000","last_change":"2024-09-11T22:11:13.867235+0000","last_active":"2024-09-11T22:11:13.873131+0000","last_peered":"2024-09-11T22:11:13.873131+0000","last_clean":"2024-09-11T22:11:13.873131+0000","last_became_active":"2024-09-11T22:11:13.866963+0000","last_became_peered":"2024-09-11T22:11:13.866963+0000","last_unstale":"2024-09-11T22:11:13.873131+0000","last_undegraded":"2024-09-11T22:11:13.873131+0000","last_fullsized":"2024-09-11T22:11:13.873131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.864339+0000","last_change":"2024-09-11T22:11:13.864339+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.864339+0000","last_undegraded":"2024-09-11T22:11:13.864339+0000","last_fullsized":"2024-09-11T22:11:13.864339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875784+0000","last_change":"2024-09-11T22:11:13.874393+0000","last_active":"2024-09-11T22:11:13.875784+0000","last_peered":"2024-09-11T22:11:13.875784+0000","last_clean":"2024-09-11T22:11:13.875784+0000","last_became_active":"2024-09-11T22:11:13.874074+0000","last_became_peered":"2024-09-11T22:11:13.874074+0000","last_unstale":"2024-09-11T22:11:13.875784+0000","last_undegraded":"2024-09-11T22:11:13.875784+0000","last_fullsized":"2024-09-11T22:11:13.875784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:15.850187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857158+0000","last_change":"2024-09-11T22:11:13.857158+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857158+0000","last_undegraded":"2024-09-11T22:11:13.857158+0000","last_fullsized":"2024-09-11T22:11:13.857158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875288+0000","last_change":"2024-09-11T22:11:13.870015+0000","last_active":"2024-09-11T22:11:13.875288+0000","last_peered":"2024-09-11T22:11:13.875288+0000","last_clean":"2024-09-11T22:11:13.875288+0000","last_became_active":"2024-09-11T22:11:13.869685+0000","last_became_peered":"2024-09-11T22:11:13.869685+0000","last_unstale":"2024-09-11T22:11:13.875288+0000","last_undegraded":"2024-09-11T22:11:13.875288+0000","last_fullsized":"2024-09-11T22:11:13.875288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:15.850187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858952+0000","last_change":"2024-09-11T22:11:13.858952+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858952+0000","last_undegraded":"2024-09-11T22:11:13.858952+0000","last_fullsized":"2024-09-11T22:11:13.858952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873044+0000","last_change":"2024-09-11T22:11:13.870967+0000","last_active":"2024-09-11T22:11:13.873044+0000","last_peered":"2024-09-11T22:11:13.873044+0000","last_clean":"2024-09-11T22:11:13.873044+0000","last_became_active":"2024-09-11T22:11:13.870687+0000","last_became_peered":"2024-09-11T22:11:13.870687+0000","last_unstale":"2024-09-11T22:11:13.873044+0000","last_undegraded":"2024-09-11T22:11:13.873044+0000","last_fullsized":"2024-09-11T22:11:13.873044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.855170+0000","last_change":"2024-09-11T22:11:13.855170+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.855170+0000","last_undegraded":"2024-09-11T22:11:13.855170+0000","last_fullsized":"2024-09-11T22:11:13.855170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875742+0000","last_change":"2024-09-11T22:11:13.873578+0000","last_active":"2024-09-11T22:11:13.875742+0000","last_peered":"2024-09-11T22:11:13.875742+0000","last_clean":"2024-09-11T22:11:13.875742+0000","last_became_active":"2024-09-11T22:11:13.873273+0000","last_became_peered":"2024-09-11T22:11:13.873273+0000","last_unstale":"2024-09-11T22:11:13.875742+0000","last_undegraded":"2024-09-11T22:11:13.875742+0000","last_fullsized":"2024-09-11T22:11:13.875742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.867715+0000","last_change":"2024-09-11T22:11:13.863099+0000","last_active":"2024-09-11T22:11:13.867715+0000","last_peered":"2024-09-11T22:11:13.867715+0000","last_clean":"2024-09-11T22:11:13.867715+0000","last_became_active":"2024-09-11T22:11:13.862812+0000","last_became_peered":"2024-09-11T22:11:13.862812+0000","last_unstale":"2024-09-11T22:11:13.867715+0000","last_undegraded":"2024-09-11T22:11:13.867715+0000","last_fullsized":"2024-09-11T22:11:13.867715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:53.690138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857829+0000","last_change":"2024-09-11T22:11:13.857829+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857829+0000","last_undegraded":"2024-09-11T22:11:13.857829+0000","last_fullsized":"2024-09-11T22:11:13.857829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873043+0000","last_change":"2024-09-11T22:11:13.866150+0000","last_active":"2024-09-11T22:11:13.873043+0000","last_peered":"2024-09-11T22:11:13.873043+0000","last_clean":"2024-09-11T22:11:13.873043+0000","last_became_active":"2024-09-11T22:11:13.865864+0000","last_became_peered":"2024-09-11T22:11:13.865864+0000","last_unstale":"2024-09-11T22:11:13.873043+0000","last_undegraded":"2024-09-11T22:11:13.873043+0000","last_fullsized":"2024-09-11T22:11:13.873043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.875718+0000","last_change":"2024-09-11T22:11:13.873542+0000","last_active":"2024-09-11T22:11:13.875718+0000","last_peered":"2024-09-11T22:11:13.875718+0000","last_clean":"2024-09-11T22:11:13.875718+0000","last_became_active":"2024-09-11T22:11:13.873248+0000","last_became_peered":"2024-09-11T22:11:13.873248+0000","last_unstale":"2024-09-11T22:11:13.875718+0000","last_undegraded":"2024-09-11T22:11:13.875718+0000","last_fullsized":"2024-09-11T22:11:13.875718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859651+0000","last_change":"2024-09-11T22:11:13.859651+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859651+0000","last_undegraded":"2024-09-11T22:11:13.859651+0000","last_fullsized":"2024-09-11T22:11:13.859651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.889885+0000","last_change":"2024-09-11T22:11:13.870778+0000","last_active":"2024-09-11T22:11:14.889885+0000","last_peered":"2024-09-11T22:11:14.889885+0000","last_clean":"2024-09-11T22:11:14.889885+0000","last_became_active":"2024-09-11T22:11:13.870346+0000","last_became_peered":"2024-09-11T22:11:13.870346+0000","last_unstale":"2024-09-11T22:11:14.889885+0000","last_undegraded":"2024-09-11T22:11:14.889885+0000","last_fullsized":"2024-09-11T22:11:14.889885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:43.931796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.865199+0000","last_change":"2024-09-11T22:11:13.864325+0000","last_active":"2024-09-11T22:11:13.865199+0000","last_peered":"2024-09-11T22:11:13.865199+0000","last_clean":"2024-09-11T22:11:13.865199+0000","last_became_active":"2024-09-11T22:11:13.862906+0000","last_became_peered":"2024-09-11T22:11:13.862906+0000","last_unstale":"2024-09-11T22:11:13.865199+0000","last_undegraded":"2024-09-11T22:11:13.865199+0000","last_fullsized":"2024-09-11T22:11:13.865199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.888351+0000","last_change":"2024-09-11T22:11:13.865829+0000","last_active":"2024-09-11T22:11:14.888351+0000","last_peered":"2024-09-11T22:11:14.888351+0000","last_clean":"2024-09-11T22:11:14.888351+0000","last_became_active":"2024-09-11T22:11:13.865535+0000","last_became_peered":"2024-09-11T22:11:13.865535+0000","last_unstale":"2024-09-11T22:11:14.888351+0000","last_undegraded":"2024-09-11T22:11:14.888351+0000","last_fullsized":"2024-09-11T22:11:14.888351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:47.814287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.874256+0000","last_change":"2024-09-11T22:11:13.873640+0000","last_active":"2024-09-11T22:11:13.874256+0000","last_peered":"2024-09-11T22:11:13.874256+0000","last_clean":"2024-09-11T22:11:13.874256+0000","last_became_active":"2024-09-11T22:11:13.873311+0000","last_became_peered":"2024-09-11T22:11:13.873311+0000","last_unstale":"2024-09-11T22:11:13.874256+0000","last_undegraded":"2024-09-11T22:11:13.874256+0000","last_fullsized":"2024-09-11T22:11:13.874256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857262+0000","last_change":"2024-09-11T22:11:13.857262+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857262+0000","last_undegraded":"2024-09-11T22:11:13.857262+0000","last_fullsized":"2024-09-11T22:11:13.857262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.864960+0000","last_change":"2024-09-11T22:11:13.870777+0000","last_active":"2024-09-11T22:11:14.864960+0000","last_peered":"2024-09-11T22:11:14.864960+0000","last_clean":"2024-09-11T22:11:14.864960+0000","last_became_active":"2024-09-11T22:11:13.869718+0000","last_became_peered":"2024-09-11T22:11:13.869718+0000","last_unstale":"2024-09-11T22:11:14.864960+0000","last_undegraded":"2024-09-11T22:11:14.864960+0000","last_fullsized":"2024-09-11T22:11:14.864960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:24.001331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:13.846965+0000","last_change":"2024-09-11T22:11:13.846965+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.846965+0000","last_undegraded":"2024-09-11T22:11:13.846965+0000","last_fullsized":"2024-09-11T22:11:13.846965+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-11T22:11:06.461014+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:11:06.461014+0000","last_peered":"2024-09-11T22:11:06.461014+0000","last_clean":"2024-09-11T22:11:06.461014+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:11:06.461014+0000","last_undegraded":"2024-09-11T22:11:06.461014+0000","last_fullsized":"2024-09-11T22:11:06.461014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.865987+0000","last_change":"2024-09-11T22:11:13.863848+0000","last_active":"2024-09-11T22:11:13.865987+0000","last_peered":"2024-09-11T22:11:13.865987+0000","last_clean":"2024-09-11T22:11:13.865987+0000","last_became_active":"2024-09-11T22:11:13.863555+0000","last_became_peered":"2024-09-11T22:11:13.863555+0000","last_unstale":"2024-09-11T22:11:13.865987+0000","last_undegraded":"2024-09-11T22:11:13.865987+0000","last_fullsized":"2024-09-11T22:11:13.865987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858270+0000","last_change":"2024-09-11T22:11:13.858270+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858270+0000","last_undegraded":"2024-09-11T22:11:13.858270+0000","last_fullsized":"2024-09-11T22:11:13.858270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857452+0000","last_change":"2024-09-11T22:11:13.857452+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857452+0000","last_undegraded":"2024-09-11T22:11:13.857452+0000","last_fullsized":"2024-09-11T22:11:13.857452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.865376+0000","last_change":"2024-09-11T22:11:13.865189+0000","last_active":"2024-09-11T22:11:14.865376+0000","last_peered":"2024-09-11T22:11:14.865376+0000","last_clean":"2024-09-11T22:11:14.865376+0000","last_became_active":"2024-09-11T22:11:13.864912+0000","last_became_peered":"2024-09-11T22:11:13.864912+0000","last_unstale":"2024-09-11T22:11:14.865376+0000","last_undegraded":"2024-09-11T22:11:14.865376+0000","last_fullsized":"2024-09-11T22:11:14.865376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:20.511994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859844+0000","last_change":"2024-09-11T22:11:13.859844+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859844+0000","last_undegraded":"2024-09-11T22:11:13.859844+0000","last_fullsized":"2024-09-11T22:11:13.859844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873228+0000","last_change":"2024-09-11T22:11:13.867676+0000","last_active":"2024-09-11T22:11:13.873228+0000","last_peered":"2024-09-11T22:11:13.873228+0000","last_clean":"2024-09-11T22:11:13.873228+0000","last_became_active":"2024-09-11T22:11:13.867391+0000","last_became_peered":"2024-09-11T22:11:13.867391+0000","last_unstale":"2024-09-11T22:11:13.873228+0000","last_undegraded":"2024-09-11T22:11:13.873228+0000","last_fullsized":"2024-09-11T22:11:13.873228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.856164+0000","last_change":"2024-09-11T22:11:13.856164+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.856164+0000","last_undegraded":"2024-09-11T22:11:13.856164+0000","last_fullsized":"2024-09-11T22:11:13.856164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.870592+0000","last_change":"2024-09-11T22:11:13.868171+0000","last_active":"2024-09-11T22:11:13.870592+0000","last_peered":"2024-09-11T22:11:13.870592+0000","last_clean":"2024-09-11T22:11:13.870592+0000","last_became_active":"2024-09-11T22:11:13.867826+0000","last_became_peered":"2024-09-11T22:11:13.867826+0000","last_unstale":"2024-09-11T22:11:13.870592+0000","last_undegraded":"2024-09-11T22:11:13.870592+0000","last_fullsized":"2024-09-11T22:11:13.870592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:53.690138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858030+0000","last_change":"2024-09-11T22:11:13.858030+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858030+0000","last_undegraded":"2024-09-11T22:11:13.858030+0000","last_fullsized":"2024-09-11T22:11:13.858030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857970+0000","last_change":"2024-09-11T22:11:13.857970+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857970+0000","last_undegraded":"2024-09-11T22:11:13.857970+0000","last_fullsized":"2024-09-11T22:11:13.857970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873159+0000","last_change":"2024-09-11T22:11:13.872366+0000","last_active":"2024-09-11T22:11:13.873159+0000","last_peered":"2024-09-11T22:11:13.873159+0000","last_clean":"2024-09-11T22:11:13.873159+0000","last_became_active":"2024-09-11T22:11:13.872085+0000","last_became_peered":"2024-09-11T22:11:13.872085+0000","last_unstale":"2024-09-11T22:11:13.873159+0000","last_undegraded":"2024-09-11T22:11:13.873159+0000","last_fullsized":"2024-09-11T22:11:13.873159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.857777+0000","last_change":"2024-09-11T22:11:13.857777+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.857777+0000","last_undegraded":"2024-09-11T22:11:13.857777+0000","last_fullsized":"2024-09-11T22:11:13.857777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872843+0000","last_change":"2024-09-11T22:11:13.869408+0000","last_active":"2024-09-11T22:11:13.872843+0000","last_peered":"2024-09-11T22:11:13.872843+0000","last_clean":"2024-09-11T22:11:13.872843+0000","last_became_active":"2024-09-11T22:11:13.869118+0000","last_became_peered":"2024-09-11T22:11:13.869118+0000","last_unstale":"2024-09-11T22:11:13.872843+0000","last_undegraded":"2024-09-11T22:11:13.872843+0000","last_fullsized":"2024-09-11T22:11:13.872843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.856979+0000","last_change":"2024-09-11T22:11:13.856979+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.856979+0000","last_undegraded":"2024-09-11T22:11:13.856979+0000","last_fullsized":"2024-09-11T22:11:13.856979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.855308+0000","last_change":"2024-09-11T22:11:13.855308+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.855308+0000","last_undegraded":"2024-09-11T22:11:13.855308+0000","last_fullsized":"2024-09-11T22:11:13.855308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.873166+0000","last_change":"2024-09-11T22:11:13.872102+0000","last_active":"2024-09-11T22:11:13.873166+0000","last_peered":"2024-09-11T22:11:13.873166+0000","last_clean":"2024-09-11T22:11:13.873166+0000","last_became_active":"2024-09-11T22:11:13.871744+0000","last_became_peered":"2024-09-11T22:11:13.871744+0000","last_unstale":"2024-09-11T22:11:13.873166+0000","last_undegraded":"2024-09-11T22:11:13.873166+0000","last_fullsized":"2024-09-11T22:11:13.873166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.858251+0000","last_change":"2024-09-11T22:11:13.858251+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.858251+0000","last_undegraded":"2024-09-11T22:11:13.858251+0000","last_fullsized":"2024-09-11T22:11:13.858251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.867429+0000","last_change":"2024-09-11T22:11:13.866539+0000","last_active":"2024-09-11T22:11:13.867429+0000","last_peered":"2024-09-11T22:11:13.867429+0000","last_clean":"2024-09-11T22:11:13.867429+0000","last_became_active":"2024-09-11T22:11:13.866049+0000","last_became_peered":"2024-09-11T22:11:13.866049+0000","last_unstale":"2024-09-11T22:11:13.867429+0000","last_undegraded":"2024-09-11T22:11:13.867429+0000","last_fullsized":"2024-09-11T22:11:13.867429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:52.623769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859720+0000","last_change":"2024-09-11T22:11:13.859720+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859720+0000","last_undegraded":"2024-09-11T22:11:13.859720+0000","last_fullsized":"2024-09-11T22:11:13.859720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.862009+0000","last_change":"2024-09-11T22:11:13.862009+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.862009+0000","last_undegraded":"2024-09-11T22:11:13.862009+0000","last_fullsized":"2024-09-11T22:11:13.862009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859680+0000","last_change":"2024-09-11T22:11:13.859680+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859680+0000","last_undegraded":"2024-09-11T22:11:13.859680+0000","last_fullsized":"2024-09-11T22:11:13.859680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859918+0000","last_change":"2024-09-11T22:11:13.859918+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859918+0000","last_undegraded":"2024-09-11T22:11:13.859918+0000","last_fullsized":"2024-09-11T22:11:13.859918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:12.841731+0000","last_change":"2024-09-11T22:11:12.841731+0000","last_active":"2024-09-11T22:11:12.841731+0000","last_peered":"2024-09-11T22:11:12.841731+0000","last_clean":"2024-09-11T22:11:12.841731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:12.841731+0000","last_undegraded":"2024-09-11T22:11:12.841731+0000","last_fullsized":"2024-09-11T22:11:12.841731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859730+0000","last_change":"2024-09-11T22:11:13.859730+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859730+0000","last_undegraded":"2024-09-11T22:11:13.859730+0000","last_fullsized":"2024-09-11T22:11:13.859730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.872861+0000","last_change":"2024-09-11T22:11:13.869743+0000","last_active":"2024-09-11T22:11:13.872861+0000","last_peered":"2024-09-11T22:11:13.872861+0000","last_clean":"2024-09-11T22:11:13.872861+0000","last_became_active":"2024-09-11T22:11:13.868457+0000","last_became_peered":"2024-09-11T22:11:13.868457+0000","last_unstale":"2024-09-11T22:11:13.872861+0000","last_undegraded":"2024-09-11T22:11:13.872861+0000","last_fullsized":"2024-09-11T22:11:13.872861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:53.690138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T22:11:13.859809+0000","last_change":"2024-09-11T22:11:13.859809+0000","last_active":"2024-09-11T22:11:13.846965+0000","last_peered":"2024-09-11T22:11:13.846965+0000","last_clean":"2024-09-11T22:11:13.846965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:13.859809+0000","last_undegraded":"2024-09-11T22:11:13.859809+0000","last_fullsized":"2024-09-11T22:11:13.859809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T22:11:13.869281+0000","last_change":"2024-09-11T22:11:13.866359+0000","last_active":"2024-09-11T22:11:13.869281+0000","last_peered":"2024-09-11T22:11:13.869281+0000","last_clean":"2024-09-11T22:11:13.869281+0000","last_became_active":"2024-09-11T22:11:13.866072+0000","last_became_peered":"2024-09-11T22:11:13.866072+0000","last_unstale":"2024-09-11T22:11:13.869281+0000","last_undegraded":"2024-09-11T22:11:13.869281+0000","last_fullsized":"2024-09-11T22:11:13.869281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:17.759883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":52,"acting":52,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509443,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":753664,"data_stored":637948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35544,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336296,"statfs":{"total":96636764160,"available":96600367104,"internally_reserved":0,"allocated":196608,"data_stored":66447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:11:20.841 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-09-11T22:11:20.840+0000 7f1969105640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:11:22.257 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:11:22.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.371+0000 7f882578f640 1 Processor -- start 2024-09-11T22:11:22.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.371+0000 7f882578f640 1 -- start start 2024-09-11T22:11:22.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.372+0000 7f882578f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f882015e7b0 0x7f88200b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.372+0000 7f882578f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f882006eb00 0x7f882015f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.372+0000 7f882578f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f882006f000 con 0x7f882015f910 2024-09-11T22:11:22.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.372+0000 7f882578f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f882015ef40 con 0x7f882015e7b0 2024-09-11T22:11:22.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.372+0000 7f882578f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f882006f2e0 con 0x7f882006eb00 2024-09-11T22:11:22.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.373+0000 7f881effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f882015e7b0 0x7f88200b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.373+0000 7f881e7fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f882006eb00 0x7f882015f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.373+0000 7f881f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f882015f910 0x7f88200679c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:58624/0 (socket says 172.21.15.50:58624) 2024-09-11T22:11:22.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.373+0000 7f881f7fe640 1 -- 172.21.15.50:0/2506392971 learned_addr learned my addr 172.21.15.50:0/2506392971 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:22.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.373+0000 7f881effd640 1 -- 172.21.15.50:0/2506392971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f882006eb00 msgr2=0x7f882015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:22.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.373+0000 7f881effd640 1 --2- 172.21.15.50:0/2506392971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f882006eb00 0x7f882015f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.373+0000 7f881effd640 1 -- 172.21.15.50:0/2506392971 >> v1:172.21.15.77:6789/0 conn(0x7f882015f910 legacy=0x7f88200679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.373+0000 7f881effd640 1 -- 172.21.15.50:0/2506392971 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882006f5c0 con 0x7f882015e7b0 2024-09-11T22:11:22.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.373+0000 7f881dffb640 1 -- 172.21.15.50:0/2506392971 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2026424669 0 0) 0x7f882006f000 con 0x7f882015f910 2024-09-11T22:11:22.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.374+0000 7f881effd640 1 --2- 172.21.15.50:0/2506392971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882015e7b0 0x7f88200b70d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f88180097a0 tx=0x7f881802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=698b62b9d5d12aa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:22.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.374+0000 7f881dffb640 1 -- 172.21.15.50:0/2506392971 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818037070 con 0x7f882015e7b0 2024-09-11T22:11:22.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.374+0000 7f881dffb640 1 -- 172.21.15.50:0/2506392971 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8818032440 con 0x7f882015e7b0 2024-09-11T22:11:22.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.374+0000 7f881dffb640 1 -- 172.21.15.50:0/2506392971 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818032810 con 0x7f882015e7b0 2024-09-11T22:11:22.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.374+0000 7f882578f640 1 -- 172.21.15.50:0/2506392971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882015e7b0 msgr2=0x7f88200b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.374+0000 7f882578f640 1 --2- 172.21.15.50:0/2506392971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882015e7b0 0x7f88200b70d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f88180097a0 tx=0x7f881802a180 comp rx=0 tx=0).stop 2024-09-11T22:11:22.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.375+0000 7f882578f640 1 -- 172.21.15.50:0/2506392971 shutdown_connections 2024-09-11T22:11:22.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.375+0000 7f882578f640 1 --2- 172.21.15.50:0/2506392971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f882006eb00 0x7f882015f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.375+0000 7f882578f640 1 --2- 172.21.15.50:0/2506392971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882015e7b0 0x7f88200b70d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.375+0000 7f882578f640 1 -- 172.21.15.50:0/2506392971 >> 172.21.15.50:0/2506392971 conn(0x7f882006bd30 msgr2=0x7f882006c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:22.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.375+0000 7f882578f640 1 -- 172.21.15.50:0/2506392971 shutdown_connections 2024-09-11T22:11:22.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.375+0000 7f882578f640 1 -- 172.21.15.50:0/2506392971 wait complete. 2024-09-11T22:11:22.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.376+0000 7f882578f640 1 Processor -- start 2024-09-11T22:11:22.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.376+0000 7f882578f640 1 -- start start 2024-09-11T22:11:22.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f882578f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882006eb00 0x7f882015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f882578f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f882015e7b0 0x7f8820146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f882578f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88201e8830 0x7f88201e8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f882578f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88200680d0 con 0x7f88201e8830 2024-09-11T22:11:22.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f882578f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88200b7610 con 0x7f882006eb00 2024-09-11T22:11:22.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f882578f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8820068250 con 0x7f882015e7b0 2024-09-11T22:11:22.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f881f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88201e8830 0x7f88201e8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f881f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88201e8830 0x7f88201e8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46332/0 (socket says 172.21.15.50:46332) 2024-09-11T22:11:22.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f881f7fe640 1 -- 172.21.15.50:0/2336812309 learned_addr learned my addr 172.21.15.50:0/2336812309 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:22.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f881effd640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882006eb00 0x7f882015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f881e7fc640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f882015e7b0 0x7f8820146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f881f7fe640 1 -- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f882015e7b0 msgr2=0x7f8820146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f881f7fe640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f882015e7b0 0x7f8820146e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f881f7fe640 1 -- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882006eb00 msgr2=0x7f882015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f881f7fe640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882006eb00 0x7f882015bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f881f7fe640 1 -- 172.21.15.50:0/2336812309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882015c190 con 0x7f88201e8830 2024-09-11T22:11:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.377+0000 7f881f7fe640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88201e8830 0x7f88201e8cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f881000c780 tx=0x7f881000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.378+0000 7f88177fe640 1 -- 172.21.15.50:0/2336812309 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8810018070 con 0x7f88201e8830 2024-09-11T22:11:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.378+0000 7f88177fe640 1 -- 172.21.15.50:0/2336812309 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f881000ce30 con 0x7f88201e8830 2024-09-11T22:11:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.378+0000 7f882578f640 1 -- 172.21.15.50:0/2336812309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882015abb0 con 0x7f88201e8830 2024-09-11T22:11:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.378+0000 7f88177fe640 1 -- 172.21.15.50:0/2336812309 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881000a840 con 0x7f88201e8830 2024-09-11T22:11:22.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.378+0000 7f882578f640 1 -- 172.21.15.50:0/2336812309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882015b170 con 0x7f88201e8830 2024-09-11T22:11:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.379+0000 7f882578f640 1 -- 172.21.15.50:0/2336812309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f882015f3b0 con 0x7f88201e8830 2024-09-11T22:11:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.379+0000 7f88177fe640 1 -- 172.21.15.50:0/2336812309 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f881001b070 con 0x7f88201e8830 2024-09-11T22:11:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.380+0000 7f88177fe640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f880006be30 0x7f880006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.380+0000 7f88177fe640 1 -- 172.21.15.50:0/2336812309 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f881008a3e0 con 0x7f88201e8830 2024-09-11T22:11:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.380+0000 7f881effd640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f880006be30 0x7f880006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.380+0000 7f881effd640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f880006be30 0x7f880006e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8818034000 tx=0x7f881802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:22.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.384+0000 7f88177fe640 1 -- 172.21.15.50:0/2336812309 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8810058d90 con 0x7f88201e8830 2024-09-11T22:11:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.555+0000 7f882578f640 1 -- 172.21.15.50:0/2336812309 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88201473a0 con 0x7f880006be30 2024-09-11T22:11:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.562+0000 7f88177fe640 1 -- 172.21.15.50:0/2336812309 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7f88201473a0 con 0x7f880006be30 2024-09-11T22:11:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:11:22.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.565+0000 7f882578f640 1 -- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f880006be30 msgr2=0x7f880006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.565+0000 7f882578f640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f880006be30 0x7f880006e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8818034000 tx=0x7f881802e000 comp rx=0 tx=0).stop 2024-09-11T22:11:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.565+0000 7f882578f640 1 -- 172.21.15.50:0/2336812309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88201e8830 msgr2=0x7f88201e8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.565+0000 7f882578f640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88201e8830 0x7f88201e8cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f881000c780 tx=0x7f881000cc40 comp rx=0 tx=0).stop 2024-09-11T22:11:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.565+0000 7f882578f640 1 -- 172.21.15.50:0/2336812309 shutdown_connections 2024-09-11T22:11:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.565+0000 7f882578f640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f880006be30 0x7f880006e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.565+0000 7f882578f640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f882015e7b0 0x7f8820146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.565+0000 7f882578f640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88201e8830 0x7f88201e8cc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.565+0000 7f882578f640 1 --2- 172.21.15.50:0/2336812309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882006eb00 0x7f882015bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.565+0000 7f882578f640 1 -- 172.21.15.50:0/2336812309 >> 172.21.15.50:0/2336812309 conn(0x7f882006bd30 msgr2=0x7f8820160e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.565+0000 7f882578f640 1 -- 172.21.15.50:0/2336812309 shutdown_connections 2024-09-11T22:11:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.565+0000 7f882578f640 1 -- 172.21.15.50:0/2336812309 wait complete. 2024-09-11T22:11:22.576 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-11T22:11:21.364875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239892,"kb_used_data":2844,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734828,"statfs":{"total":773094113280,"available":772848463872,"internally_reserved":0,"allocated":2912256,"data_stored":1761232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.512020"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111198+0000","last_change":"2024-09-11T22:11:14.877003+0000","last_active":"2024-09-11T22:11:16.111198+0000","last_peered":"2024-09-11T22:11:16.111198+0000","last_clean":"2024-09-11T22:11:16.111198+0000","last_became_active":"2024-09-11T22:11:14.875875+0000","last_became_peered":"2024-09-11T22:11:14.875875+0000","last_unstale":"2024-09-11T22:11:16.111198+0000","last_undegraded":"2024-09-11T22:11:16.111198+0000","last_fullsized":"2024-09-11T22:11:16.111198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:10.814560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856466+0000","last_change":"2024-09-11T22:11:14.870455+0000","last_active":"2024-09-11T22:11:15.856466+0000","last_peered":"2024-09-11T22:11:15.856466+0000","last_clean":"2024-09-11T22:11:15.856466+0000","last_became_active":"2024-09-11T22:11:14.870099+0000","last_became_peered":"2024-09-11T22:11:14.870099+0000","last_unstale":"2024-09-11T22:11:15.856466+0000","last_undegraded":"2024-09-11T22:11:15.856466+0000","last_fullsized":"2024-09-11T22:11:15.856466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722493+0000","last_change":"2024-09-11T22:11:14.873524+0000","last_active":"2024-09-11T22:11:16.722493+0000","last_peered":"2024-09-11T22:11:16.722493+0000","last_clean":"2024-09-11T22:11:16.722493+0000","last_became_active":"2024-09-11T22:11:14.873148+0000","last_became_peered":"2024-09-11T22:11:14.873148+0000","last_unstale":"2024-09-11T22:11:16.722493+0000","last_undegraded":"2024-09-11T22:11:16.722493+0000","last_fullsized":"2024-09-11T22:11:16.722493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860390+0000","last_change":"2024-09-11T22:11:14.880383+0000","last_active":"2024-09-11T22:11:15.860390+0000","last_peered":"2024-09-11T22:11:15.860390+0000","last_clean":"2024-09-11T22:11:15.860390+0000","last_became_active":"2024-09-11T22:11:14.880104+0000","last_became_peered":"2024-09-11T22:11:14.880104+0000","last_unstale":"2024-09-11T22:11:15.860390+0000","last_undegraded":"2024-09-11T22:11:15.860390+0000","last_fullsized":"2024-09-11T22:11:15.860390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:49.232203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110946+0000","last_change":"2024-09-11T22:11:14.873339+0000","last_active":"2024-09-11T22:11:16.110946+0000","last_peered":"2024-09-11T22:11:16.110946+0000","last_clean":"2024-09-11T22:11:16.110946+0000","last_became_active":"2024-09-11T22:11:14.873054+0000","last_became_peered":"2024-09-11T22:11:14.873054+0000","last_unstale":"2024-09-11T22:11:16.110946+0000","last_undegraded":"2024-09-11T22:11:16.110946+0000","last_fullsized":"2024-09-11T22:11:16.110946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:59.654960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860174+0000","last_change":"2024-09-11T22:11:14.870895+0000","last_active":"2024-09-11T22:11:15.860174+0000","last_peered":"2024-09-11T22:11:15.860174+0000","last_clean":"2024-09-11T22:11:15.860174+0000","last_became_active":"2024-09-11T22:11:14.870514+0000","last_became_peered":"2024-09-11T22:11:14.870514+0000","last_unstale":"2024-09-11T22:11:15.860174+0000","last_undegraded":"2024-09-11T22:11:15.860174+0000","last_fullsized":"2024-09-11T22:11:15.860174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110583+0000","last_change":"2024-09-11T22:11:14.872287+0000","last_active":"2024-09-11T22:11:16.110583+0000","last_peered":"2024-09-11T22:11:16.110583+0000","last_clean":"2024-09-11T22:11:16.110583+0000","last_became_active":"2024-09-11T22:11:14.871977+0000","last_became_peered":"2024-09-11T22:11:14.871977+0000","last_unstale":"2024-09-11T22:11:16.110583+0000","last_undegraded":"2024-09-11T22:11:16.110583+0000","last_fullsized":"2024-09-11T22:11:16.110583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:14.914022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720946+0000","last_change":"2024-09-11T22:11:14.875401+0000","last_active":"2024-09-11T22:11:16.720946+0000","last_peered":"2024-09-11T22:11:16.720946+0000","last_clean":"2024-09-11T22:11:16.720946+0000","last_became_active":"2024-09-11T22:11:14.875082+0000","last_became_peered":"2024-09-11T22:11:14.875082+0000","last_unstale":"2024-09-11T22:11:16.720946+0000","last_undegraded":"2024-09-11T22:11:16.720946+0000","last_fullsized":"2024-09-11T22:11:16.720946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.370344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111194+0000","last_change":"2024-09-11T22:11:14.876721+0000","last_active":"2024-09-11T22:11:16.111194+0000","last_peered":"2024-09-11T22:11:16.111194+0000","last_clean":"2024-09-11T22:11:16.111194+0000","last_became_active":"2024-09-11T22:11:14.875811+0000","last_became_peered":"2024-09-11T22:11:14.875811+0000","last_unstale":"2024-09-11T22:11:16.111194+0000","last_undegraded":"2024-09-11T22:11:16.111194+0000","last_fullsized":"2024-09-11T22:11:16.111194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:54.472996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860289+0000","last_change":"2024-09-11T22:11:14.871993+0000","last_active":"2024-09-11T22:11:15.860289+0000","last_peered":"2024-09-11T22:11:15.860289+0000","last_clean":"2024-09-11T22:11:15.860289+0000","last_became_active":"2024-09-11T22:11:14.871514+0000","last_became_peered":"2024-09-11T22:11:14.871514+0000","last_unstale":"2024-09-11T22:11:15.860289+0000","last_undegraded":"2024-09-11T22:11:15.860289+0000","last_fullsized":"2024-09-11T22:11:15.860289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859950+0000","last_change":"2024-09-11T22:11:14.871449+0000","last_active":"2024-09-11T22:11:15.859950+0000","last_peered":"2024-09-11T22:11:15.859950+0000","last_clean":"2024-09-11T22:11:15.859950+0000","last_became_active":"2024-09-11T22:11:14.871199+0000","last_became_peered":"2024-09-11T22:11:14.871199+0000","last_unstale":"2024-09-11T22:11:15.859950+0000","last_undegraded":"2024-09-11T22:11:15.859950+0000","last_fullsized":"2024-09-11T22:11:15.859950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.504256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721036+0000","last_change":"2024-09-11T22:11:14.873836+0000","last_active":"2024-09-11T22:11:16.721036+0000","last_peered":"2024-09-11T22:11:16.721036+0000","last_clean":"2024-09-11T22:11:16.721036+0000","last_became_active":"2024-09-11T22:11:14.873416+0000","last_became_peered":"2024-09-11T22:11:14.873416+0000","last_unstale":"2024-09-11T22:11:16.721036+0000","last_undegraded":"2024-09-11T22:11:16.721036+0000","last_fullsized":"2024-09-11T22:11:16.721036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:21.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721985+0000","last_change":"2024-09-11T22:11:14.869438+0000","last_active":"2024-09-11T22:11:16.721985+0000","last_peered":"2024-09-11T22:11:16.721985+0000","last_clean":"2024-09-11T22:11:16.721985+0000","last_became_active":"2024-09-11T22:11:14.869123+0000","last_became_peered":"2024-09-11T22:11:14.869123+0000","last_unstale":"2024-09-11T22:11:16.721985+0000","last_undegraded":"2024-09-11T22:11:16.721985+0000","last_fullsized":"2024-09-11T22:11:16.721985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:24.265434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721027+0000","last_change":"2024-09-11T22:11:14.869092+0000","last_active":"2024-09-11T22:11:16.721027+0000","last_peered":"2024-09-11T22:11:16.721027+0000","last_clean":"2024-09-11T22:11:16.721027+0000","last_became_active":"2024-09-11T22:11:14.868753+0000","last_became_peered":"2024-09-11T22:11:14.868753+0000","last_unstale":"2024-09-11T22:11:16.721027+0000","last_undegraded":"2024-09-11T22:11:16.721027+0000","last_fullsized":"2024-09-11T22:11:16.721027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:21.821517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856216+0000","last_change":"2024-09-11T22:11:14.860104+0000","last_active":"2024-09-11T22:11:15.856216+0000","last_peered":"2024-09-11T22:11:15.856216+0000","last_clean":"2024-09-11T22:11:15.856216+0000","last_became_active":"2024-09-11T22:11:14.859804+0000","last_became_peered":"2024-09-11T22:11:14.859804+0000","last_unstale":"2024-09-11T22:11:15.856216+0000","last_undegraded":"2024-09-11T22:11:15.856216+0000","last_fullsized":"2024-09-11T22:11:15.856216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.504256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859806+0000","last_change":"2024-09-11T22:11:14.869261+0000","last_active":"2024-09-11T22:11:15.859806+0000","last_peered":"2024-09-11T22:11:15.859806+0000","last_clean":"2024-09-11T22:11:15.859806+0000","last_became_active":"2024-09-11T22:11:14.868403+0000","last_became_peered":"2024-09-11T22:11:14.868403+0000","last_unstale":"2024-09-11T22:11:15.859806+0000","last_undegraded":"2024-09-11T22:11:15.859806+0000","last_fullsized":"2024-09-11T22:11:15.859806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.861121+0000","last_change":"2024-09-11T22:11:14.873272+0000","last_active":"2024-09-11T22:11:15.861121+0000","last_peered":"2024-09-11T22:11:15.861121+0000","last_clean":"2024-09-11T22:11:15.861121+0000","last_became_active":"2024-09-11T22:11:14.873003+0000","last_became_peered":"2024-09-11T22:11:14.873003+0000","last_unstale":"2024-09-11T22:11:15.861121+0000","last_undegraded":"2024-09-11T22:11:15.861121+0000","last_fullsized":"2024-09-11T22:11:15.861121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.623451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.873986+0000","last_change":"2024-09-11T22:11:14.869711+0000","last_active":"2024-09-11T22:11:14.873986+0000","last_peered":"2024-09-11T22:11:14.873986+0000","last_clean":"2024-09-11T22:11:14.873986+0000","last_became_active":"2024-09-11T22:11:14.869409+0000","last_became_peered":"2024-09-11T22:11:14.869409+0000","last_unstale":"2024-09-11T22:11:14.873986+0000","last_undegraded":"2024-09-11T22:11:14.873986+0000","last_fullsized":"2024-09-11T22:11:14.873986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:38.715172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111027+0000","last_change":"2024-09-11T22:11:14.879040+0000","last_active":"2024-09-11T22:11:16.111027+0000","last_peered":"2024-09-11T22:11:16.111027+0000","last_clean":"2024-09-11T22:11:16.111027+0000","last_became_active":"2024-09-11T22:11:14.877938+0000","last_became_peered":"2024-09-11T22:11:14.877938+0000","last_unstale":"2024-09-11T22:11:16.111027+0000","last_undegraded":"2024-09-11T22:11:16.111027+0000","last_fullsized":"2024-09-11T22:11:16.111027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:07.443098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860231+0000","last_change":"2024-09-11T22:11:14.874997+0000","last_active":"2024-09-11T22:11:15.860231+0000","last_peered":"2024-09-11T22:11:15.860231+0000","last_clean":"2024-09-11T22:11:15.860231+0000","last_became_active":"2024-09-11T22:11:14.874597+0000","last_became_peered":"2024-09-11T22:11:14.874597+0000","last_unstale":"2024-09-11T22:11:15.860231+0000","last_undegraded":"2024-09-11T22:11:15.860231+0000","last_fullsized":"2024-09-11T22:11:15.860231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:02.999213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721437+0000","last_change":"2024-09-11T22:11:14.879236+0000","last_active":"2024-09-11T22:11:16.721437+0000","last_peered":"2024-09-11T22:11:16.721437+0000","last_clean":"2024-09-11T22:11:16.721437+0000","last_became_active":"2024-09-11T22:11:14.878980+0000","last_became_peered":"2024-09-11T22:11:14.878980+0000","last_unstale":"2024-09-11T22:11:16.721437+0000","last_undegraded":"2024-09-11T22:11:16.721437+0000","last_fullsized":"2024-09-11T22:11:16.721437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:23.884038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860346+0000","last_change":"2024-09-11T22:11:14.874326+0000","last_active":"2024-09-11T22:11:15.860346+0000","last_peered":"2024-09-11T22:11:15.860346+0000","last_clean":"2024-09-11T22:11:15.860346+0000","last_became_active":"2024-09-11T22:11:14.873996+0000","last_became_peered":"2024-09-11T22:11:14.873996+0000","last_unstale":"2024-09-11T22:11:15.860346+0000","last_undegraded":"2024-09-11T22:11:15.860346+0000","last_fullsized":"2024-09-11T22:11:15.860346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:41.100253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721611+0000","last_change":"2024-09-11T22:11:14.876744+0000","last_active":"2024-09-11T22:11:16.721611+0000","last_peered":"2024-09-11T22:11:16.721611+0000","last_clean":"2024-09-11T22:11:16.721611+0000","last_became_active":"2024-09-11T22:11:14.875632+0000","last_became_peered":"2024-09-11T22:11:14.875632+0000","last_unstale":"2024-09-11T22:11:16.721611+0000","last_undegraded":"2024-09-11T22:11:16.721611+0000","last_fullsized":"2024-09-11T22:11:16.721611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:41.100253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860407+0000","last_change":"2024-09-11T22:11:14.869931+0000","last_active":"2024-09-11T22:11:15.860407+0000","last_peered":"2024-09-11T22:11:15.860407+0000","last_clean":"2024-09-11T22:11:15.860407+0000","last_became_active":"2024-09-11T22:11:14.869668+0000","last_became_peered":"2024-09-11T22:11:14.869668+0000","last_unstale":"2024-09-11T22:11:15.860407+0000","last_undegraded":"2024-09-11T22:11:15.860407+0000","last_fullsized":"2024-09-11T22:11:15.860407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:24.265434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720826+0000","last_change":"2024-09-11T22:11:14.877381+0000","last_active":"2024-09-11T22:11:16.720826+0000","last_peered":"2024-09-11T22:11:16.720826+0000","last_clean":"2024-09-11T22:11:16.720826+0000","last_became_active":"2024-09-11T22:11:14.876638+0000","last_became_peered":"2024-09-11T22:11:14.876638+0000","last_unstale":"2024-09-11T22:11:16.720826+0000","last_undegraded":"2024-09-11T22:11:16.720826+0000","last_fullsized":"2024-09-11T22:11:16.720826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:23.884038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860422+0000","last_change":"2024-09-11T22:11:14.873836+0000","last_active":"2024-09-11T22:11:15.860422+0000","last_peered":"2024-09-11T22:11:15.860422+0000","last_clean":"2024-09-11T22:11:15.860422+0000","last_became_active":"2024-09-11T22:11:14.873277+0000","last_became_peered":"2024-09-11T22:11:14.873277+0000","last_unstale":"2024-09-11T22:11:15.860422+0000","last_undegraded":"2024-09-11T22:11:15.860422+0000","last_fullsized":"2024-09-11T22:11:15.860422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856398+0000","last_change":"2024-09-11T22:11:14.872571+0000","last_active":"2024-09-11T22:11:15.856398+0000","last_peered":"2024-09-11T22:11:15.856398+0000","last_clean":"2024-09-11T22:11:15.856398+0000","last_became_active":"2024-09-11T22:11:14.872286+0000","last_became_peered":"2024-09-11T22:11:14.872286+0000","last_unstale":"2024-09-11T22:11:15.856398+0000","last_undegraded":"2024-09-11T22:11:15.856398+0000","last_fullsized":"2024-09-11T22:11:15.856398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:02.999213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721392+0000","last_change":"2024-09-11T22:11:14.875536+0000","last_active":"2024-09-11T22:11:16.721392+0000","last_peered":"2024-09-11T22:11:16.721392+0000","last_clean":"2024-09-11T22:11:16.721392+0000","last_became_active":"2024-09-11T22:11:14.875253+0000","last_became_peered":"2024-09-11T22:11:14.875253+0000","last_unstale":"2024-09-11T22:11:16.721392+0000","last_undegraded":"2024-09-11T22:11:16.721392+0000","last_fullsized":"2024-09-11T22:11:16.721392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721577+0000","last_change":"2024-09-11T22:11:14.876898+0000","last_active":"2024-09-11T22:11:16.721577+0000","last_peered":"2024-09-11T22:11:16.721577+0000","last_clean":"2024-09-11T22:11:16.721577+0000","last_became_active":"2024-09-11T22:11:14.876337+0000","last_became_peered":"2024-09-11T22:11:14.876337+0000","last_unstale":"2024-09-11T22:11:16.721577+0000","last_undegraded":"2024-09-11T22:11:16.721577+0000","last_fullsized":"2024-09-11T22:11:16.721577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.370344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860606+0000","last_change":"2024-09-11T22:11:14.880080+0000","last_active":"2024-09-11T22:11:15.860606+0000","last_peered":"2024-09-11T22:11:15.860606+0000","last_clean":"2024-09-11T22:11:15.860606+0000","last_became_active":"2024-09-11T22:11:14.879830+0000","last_became_peered":"2024-09-11T22:11:14.879830+0000","last_unstale":"2024-09-11T22:11:15.860606+0000","last_undegraded":"2024-09-11T22:11:15.860606+0000","last_fullsized":"2024-09-11T22:11:15.860606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:58.767744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.877104+0000","last_change":"2024-09-11T22:11:14.872267+0000","last_active":"2024-09-11T22:11:14.877104+0000","last_peered":"2024-09-11T22:11:14.877104+0000","last_clean":"2024-09-11T22:11:14.877104+0000","last_became_active":"2024-09-11T22:11:14.871979+0000","last_became_peered":"2024-09-11T22:11:14.871979+0000","last_unstale":"2024-09-11T22:11:14.877104+0000","last_undegraded":"2024-09-11T22:11:14.877104+0000","last_fullsized":"2024-09-11T22:11:14.877104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:27.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859741+0000","last_change":"2024-09-11T22:11:14.876761+0000","last_active":"2024-09-11T22:11:15.859741+0000","last_peered":"2024-09-11T22:11:15.859741+0000","last_clean":"2024-09-11T22:11:15.859741+0000","last_became_active":"2024-09-11T22:11:14.876471+0000","last_became_peered":"2024-09-11T22:11:14.876471+0000","last_unstale":"2024-09-11T22:11:15.859741+0000","last_undegraded":"2024-09-11T22:11:15.859741+0000","last_fullsized":"2024-09-11T22:11:15.859741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:23.884038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720774+0000","last_change":"2024-09-11T22:11:14.860824+0000","last_active":"2024-09-11T22:11:16.720774+0000","last_peered":"2024-09-11T22:11:16.720774+0000","last_clean":"2024-09-11T22:11:16.720774+0000","last_became_active":"2024-09-11T22:11:14.860544+0000","last_became_peered":"2024-09-11T22:11:14.860544+0000","last_unstale":"2024-09-11T22:11:16.720774+0000","last_undegraded":"2024-09-11T22:11:16.720774+0000","last_fullsized":"2024-09-11T22:11:16.720774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:54.339754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722220+0000","last_change":"2024-09-11T22:11:13.870101+0000","last_active":"2024-09-11T22:11:16.722220+0000","last_peered":"2024-09-11T22:11:16.722220+0000","last_clean":"2024-09-11T22:11:16.722220+0000","last_became_active":"2024-09-11T22:11:13.869798+0000","last_became_peered":"2024-09-11T22:11:13.869798+0000","last_unstale":"2024-09-11T22:11:16.722220+0000","last_undegraded":"2024-09-11T22:11:16.722220+0000","last_fullsized":"2024-09-11T22:11:16.722220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721719+0000","last_change":"2024-09-11T22:11:14.874507+0000","last_active":"2024-09-11T22:11:16.721719+0000","last_peered":"2024-09-11T22:11:16.721719+0000","last_clean":"2024-09-11T22:11:16.721719+0000","last_became_active":"2024-09-11T22:11:14.874159+0000","last_became_peered":"2024-09-11T22:11:14.874159+0000","last_unstale":"2024-09-11T22:11:16.721719+0000","last_undegraded":"2024-09-11T22:11:16.721719+0000","last_fullsized":"2024-09-11T22:11:16.721719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.504256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859877+0000","last_change":"2024-09-11T22:11:13.871132+0000","last_active":"2024-09-11T22:11:15.859877+0000","last_peered":"2024-09-11T22:11:15.859877+0000","last_clean":"2024-09-11T22:11:15.859877+0000","last_became_active":"2024-09-11T22:11:13.870831+0000","last_became_peered":"2024-09-11T22:11:13.870831+0000","last_unstale":"2024-09-11T22:11:15.859877+0000","last_undegraded":"2024-09-11T22:11:15.859877+0000","last_fullsized":"2024-09-11T22:11:15.859877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:16.770079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721708+0000","last_change":"2024-09-11T22:11:13.871011+0000","last_active":"2024-09-11T22:11:16.721708+0000","last_peered":"2024-09-11T22:11:16.721708+0000","last_clean":"2024-09-11T22:11:16.721708+0000","last_became_active":"2024-09-11T22:11:13.870723+0000","last_became_peered":"2024-09-11T22:11:13.870723+0000","last_unstale":"2024-09-11T22:11:16.721708+0000","last_undegraded":"2024-09-11T22:11:16.721708+0000","last_fullsized":"2024-09-11T22:11:16.721708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721121+0000","last_change":"2024-09-11T22:11:14.881540+0000","last_active":"2024-09-11T22:11:16.721121+0000","last_peered":"2024-09-11T22:11:16.721121+0000","last_clean":"2024-09-11T22:11:16.721121+0000","last_became_active":"2024-09-11T22:11:14.881249+0000","last_became_peered":"2024-09-11T22:11:14.881249+0000","last_unstale":"2024-09-11T22:11:16.721121+0000","last_undegraded":"2024-09-11T22:11:16.721121+0000","last_fullsized":"2024-09-11T22:11:16.721121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860180+0000","last_change":"2024-09-11T22:11:13.867235+0000","last_active":"2024-09-11T22:11:15.860180+0000","last_peered":"2024-09-11T22:11:15.860180+0000","last_clean":"2024-09-11T22:11:15.860180+0000","last_became_active":"2024-09-11T22:11:13.866963+0000","last_became_peered":"2024-09-11T22:11:13.866963+0000","last_unstale":"2024-09-11T22:11:15.860180+0000","last_undegraded":"2024-09-11T22:11:15.860180+0000","last_fullsized":"2024-09-11T22:11:15.860180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:53.334520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856208+0000","last_change":"2024-09-11T22:11:14.873284+0000","last_active":"2024-09-11T22:11:15.856208+0000","last_peered":"2024-09-11T22:11:15.856208+0000","last_clean":"2024-09-11T22:11:15.856208+0000","last_became_active":"2024-09-11T22:11:14.873030+0000","last_became_peered":"2024-09-11T22:11:14.873030+0000","last_unstale":"2024-09-11T22:11:15.856208+0000","last_undegraded":"2024-09-11T22:11:15.856208+0000","last_fullsized":"2024-09-11T22:11:15.856208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.370344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859886+0000","last_change":"2024-09-11T22:11:13.874393+0000","last_active":"2024-09-11T22:11:15.859886+0000","last_peered":"2024-09-11T22:11:15.859886+0000","last_clean":"2024-09-11T22:11:15.859886+0000","last_became_active":"2024-09-11T22:11:13.874074+0000","last_became_peered":"2024-09-11T22:11:13.874074+0000","last_unstale":"2024-09-11T22:11:15.859886+0000","last_undegraded":"2024-09-11T22:11:15.859886+0000","last_fullsized":"2024-09-11T22:11:15.859886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:37.267640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860641+0000","last_change":"2024-09-11T22:11:14.872584+0000","last_active":"2024-09-11T22:11:15.860641+0000","last_peered":"2024-09-11T22:11:15.860641+0000","last_clean":"2024-09-11T22:11:15.860641+0000","last_became_active":"2024-09-11T22:11:14.872284+0000","last_became_peered":"2024-09-11T22:11:14.872284+0000","last_unstale":"2024-09-11T22:11:15.860641+0000","last_undegraded":"2024-09-11T22:11:15.860641+0000","last_fullsized":"2024-09-11T22:11:15.860641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:04.047452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860682+0000","last_change":"2024-09-11T22:11:13.870015+0000","last_active":"2024-09-11T22:11:15.860682+0000","last_peered":"2024-09-11T22:11:15.860682+0000","last_clean":"2024-09-11T22:11:15.860682+0000","last_became_active":"2024-09-11T22:11:13.869685+0000","last_became_peered":"2024-09-11T22:11:13.869685+0000","last_unstale":"2024-09-11T22:11:15.860682+0000","last_undegraded":"2024-09-11T22:11:15.860682+0000","last_fullsized":"2024-09-11T22:11:15.860682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:37.267640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722219+0000","last_change":"2024-09-11T22:11:14.873692+0000","last_active":"2024-09-11T22:11:16.722219+0000","last_peered":"2024-09-11T22:11:16.722219+0000","last_clean":"2024-09-11T22:11:16.722219+0000","last_became_active":"2024-09-11T22:11:14.873206+0000","last_became_peered":"2024-09-11T22:11:14.873206+0000","last_unstale":"2024-09-11T22:11:16.722219+0000","last_undegraded":"2024-09-11T22:11:16.722219+0000","last_fullsized":"2024-09-11T22:11:16.722219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856400+0000","last_change":"2024-09-11T22:11:13.870967+0000","last_active":"2024-09-11T22:11:15.856400+0000","last_peered":"2024-09-11T22:11:15.856400+0000","last_clean":"2024-09-11T22:11:15.856400+0000","last_became_active":"2024-09-11T22:11:13.870687+0000","last_became_peered":"2024-09-11T22:11:13.870687+0000","last_unstale":"2024-09-11T22:11:15.856400+0000","last_undegraded":"2024-09-11T22:11:15.856400+0000","last_fullsized":"2024-09-11T22:11:15.856400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:20.377207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721034+0000","last_change":"2024-09-11T22:11:14.877068+0000","last_active":"2024-09-11T22:11:16.721034+0000","last_peered":"2024-09-11T22:11:16.721034+0000","last_clean":"2024-09-11T22:11:16.721034+0000","last_became_active":"2024-09-11T22:11:14.876709+0000","last_became_peered":"2024-09-11T22:11:14.876709+0000","last_unstale":"2024-09-11T22:11:16.721034+0000","last_undegraded":"2024-09-11T22:11:16.721034+0000","last_fullsized":"2024-09-11T22:11:16.721034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:51:40.769228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860328+0000","last_change":"2024-09-11T22:11:13.873578+0000","last_active":"2024-09-11T22:11:15.860328+0000","last_peered":"2024-09-11T22:11:15.860328+0000","last_clean":"2024-09-11T22:11:15.860328+0000","last_became_active":"2024-09-11T22:11:13.873273+0000","last_became_peered":"2024-09-11T22:11:13.873273+0000","last_unstale":"2024-09-11T22:11:15.860328+0000","last_undegraded":"2024-09-11T22:11:15.860328+0000","last_fullsized":"2024-09-11T22:11:15.860328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.543280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110782+0000","last_change":"2024-09-11T22:11:14.879023+0000","last_active":"2024-09-11T22:11:16.110782+0000","last_peered":"2024-09-11T22:11:16.110782+0000","last_clean":"2024-09-11T22:11:16.110782+0000","last_became_active":"2024-09-11T22:11:14.876039+0000","last_became_peered":"2024-09-11T22:11:14.876039+0000","last_unstale":"2024-09-11T22:11:16.110782+0000","last_undegraded":"2024-09-11T22:11:16.110782+0000","last_fullsized":"2024-09-11T22:11:16.110782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:38.090077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721813+0000","last_change":"2024-09-11T22:11:13.863099+0000","last_active":"2024-09-11T22:11:16.721813+0000","last_peered":"2024-09-11T22:11:16.721813+0000","last_clean":"2024-09-11T22:11:16.721813+0000","last_became_active":"2024-09-11T22:11:13.862812+0000","last_became_peered":"2024-09-11T22:11:13.862812+0000","last_unstale":"2024-09-11T22:11:16.721813+0000","last_undegraded":"2024-09-11T22:11:16.721813+0000","last_fullsized":"2024-09-11T22:11:16.721813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721180+0000","last_change":"2024-09-11T22:11:14.878517+0000","last_active":"2024-09-11T22:11:16.721180+0000","last_peered":"2024-09-11T22:11:16.721180+0000","last_clean":"2024-09-11T22:11:16.721180+0000","last_became_active":"2024-09-11T22:11:14.878209+0000","last_became_peered":"2024-09-11T22:11:14.878209+0000","last_unstale":"2024-09-11T22:11:16.721180+0000","last_undegraded":"2024-09-11T22:11:16.721180+0000","last_fullsized":"2024-09-11T22:11:16.721180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:34.949017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860892+0000","last_change":"2024-09-11T22:11:13.866150+0000","last_active":"2024-09-11T22:11:15.860892+0000","last_peered":"2024-09-11T22:11:15.860892+0000","last_clean":"2024-09-11T22:11:15.860892+0000","last_became_active":"2024-09-11T22:11:13.865864+0000","last_became_peered":"2024-09-11T22:11:13.865864+0000","last_unstale":"2024-09-11T22:11:15.860892+0000","last_undegraded":"2024-09-11T22:11:15.860892+0000","last_fullsized":"2024-09-11T22:11:15.860892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:16.770079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110900+0000","last_change":"2024-09-11T22:11:14.874944+0000","last_active":"2024-09-11T22:11:16.110900+0000","last_peered":"2024-09-11T22:11:16.110900+0000","last_clean":"2024-09-11T22:11:16.110900+0000","last_became_active":"2024-09-11T22:11:14.874659+0000","last_became_peered":"2024-09-11T22:11:14.874659+0000","last_unstale":"2024-09-11T22:11:16.110900+0000","last_undegraded":"2024-09-11T22:11:16.110900+0000","last_fullsized":"2024-09-11T22:11:16.110900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:32.470561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859729+0000","last_change":"2024-09-11T22:11:13.873542+0000","last_active":"2024-09-11T22:11:15.859729+0000","last_peered":"2024-09-11T22:11:15.859729+0000","last_clean":"2024-09-11T22:11:15.859729+0000","last_became_active":"2024-09-11T22:11:13.873248+0000","last_became_peered":"2024-09-11T22:11:13.873248+0000","last_unstale":"2024-09-11T22:11:15.859729+0000","last_undegraded":"2024-09-11T22:11:15.859729+0000","last_fullsized":"2024-09-11T22:11:15.859729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:45.183251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860222+0000","last_change":"2024-09-11T22:11:14.869832+0000","last_active":"2024-09-11T22:11:15.860222+0000","last_peered":"2024-09-11T22:11:15.860222+0000","last_clean":"2024-09-11T22:11:15.860222+0000","last_became_active":"2024-09-11T22:11:14.869351+0000","last_became_peered":"2024-09-11T22:11:14.869351+0000","last_unstale":"2024-09-11T22:11:15.860222+0000","last_undegraded":"2024-09-11T22:11:15.860222+0000","last_fullsized":"2024-09-11T22:11:15.860222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.889885+0000","last_change":"2024-09-11T22:11:13.870778+0000","last_active":"2024-09-11T22:11:14.889885+0000","last_peered":"2024-09-11T22:11:14.889885+0000","last_clean":"2024-09-11T22:11:14.889885+0000","last_became_active":"2024-09-11T22:11:13.870346+0000","last_became_peered":"2024-09-11T22:11:13.870346+0000","last_unstale":"2024-09-11T22:11:14.889885+0000","last_undegraded":"2024-09-11T22:11:14.889885+0000","last_fullsized":"2024-09-11T22:11:14.889885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:43.931796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110657+0000","last_change":"2024-09-11T22:11:14.880819+0000","last_active":"2024-09-11T22:11:16.110657+0000","last_peered":"2024-09-11T22:11:16.110657+0000","last_clean":"2024-09-11T22:11:16.110657+0000","last_became_active":"2024-09-11T22:11:14.880536+0000","last_became_peered":"2024-09-11T22:11:14.880536+0000","last_unstale":"2024-09-11T22:11:16.110657+0000","last_undegraded":"2024-09-11T22:11:16.110657+0000","last_fullsized":"2024-09-11T22:11:16.110657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:02.658218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720999+0000","last_change":"2024-09-11T22:11:13.864325+0000","last_active":"2024-09-11T22:11:16.720999+0000","last_peered":"2024-09-11T22:11:16.720999+0000","last_clean":"2024-09-11T22:11:16.720999+0000","last_became_active":"2024-09-11T22:11:13.862906+0000","last_became_peered":"2024-09-11T22:11:13.862906+0000","last_unstale":"2024-09-11T22:11:16.720999+0000","last_undegraded":"2024-09-11T22:11:16.720999+0000","last_fullsized":"2024-09-11T22:11:16.720999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111015+0000","last_change":"2024-09-11T22:11:14.874987+0000","last_active":"2024-09-11T22:11:16.111015+0000","last_peered":"2024-09-11T22:11:16.111015+0000","last_clean":"2024-09-11T22:11:16.111015+0000","last_became_active":"2024-09-11T22:11:14.874705+0000","last_became_peered":"2024-09-11T22:11:14.874705+0000","last_unstale":"2024-09-11T22:11:16.111015+0000","last_undegraded":"2024-09-11T22:11:16.111015+0000","last_fullsized":"2024-09-11T22:11:16.111015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:23.382930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.888351+0000","last_change":"2024-09-11T22:11:13.865829+0000","last_active":"2024-09-11T22:11:14.888351+0000","last_peered":"2024-09-11T22:11:14.888351+0000","last_clean":"2024-09-11T22:11:14.888351+0000","last_became_active":"2024-09-11T22:11:13.865535+0000","last_became_peered":"2024-09-11T22:11:13.865535+0000","last_unstale":"2024-09-11T22:11:14.888351+0000","last_undegraded":"2024-09-11T22:11:14.888351+0000","last_fullsized":"2024-09-11T22:11:14.888351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:47.814287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111285+0000","last_change":"2024-09-11T22:11:14.878706+0000","last_active":"2024-09-11T22:11:16.111285+0000","last_peered":"2024-09-11T22:11:16.111285+0000","last_clean":"2024-09-11T22:11:16.111285+0000","last_became_active":"2024-09-11T22:11:14.876102+0000","last_became_peered":"2024-09-11T22:11:14.876102+0000","last_unstale":"2024-09-11T22:11:16.111285+0000","last_undegraded":"2024-09-11T22:11:16.111285+0000","last_fullsized":"2024-09-11T22:11:16.111285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:15.113361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856490+0000","last_change":"2024-09-11T22:11:13.873640+0000","last_active":"2024-09-11T22:11:15.856490+0000","last_peered":"2024-09-11T22:11:15.856490+0000","last_clean":"2024-09-11T22:11:15.856490+0000","last_became_active":"2024-09-11T22:11:13.873311+0000","last_became_peered":"2024-09-11T22:11:13.873311+0000","last_unstale":"2024-09-11T22:11:15.856490+0000","last_undegraded":"2024-09-11T22:11:15.856490+0000","last_fullsized":"2024-09-11T22:11:15.856490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:51:39.763993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860808+0000","last_change":"2024-09-11T22:11:14.868944+0000","last_active":"2024-09-11T22:11:15.860808+0000","last_peered":"2024-09-11T22:11:15.860808+0000","last_clean":"2024-09-11T22:11:15.860808+0000","last_became_active":"2024-09-11T22:11:14.868668+0000","last_became_peered":"2024-09-11T22:11:14.868668+0000","last_unstale":"2024-09-11T22:11:15.860808+0000","last_undegraded":"2024-09-11T22:11:15.860808+0000","last_fullsized":"2024-09-11T22:11:15.860808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:05:25.843711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.864960+0000","last_change":"2024-09-11T22:11:13.870777+0000","last_active":"2024-09-11T22:11:14.864960+0000","last_peered":"2024-09-11T22:11:14.864960+0000","last_clean":"2024-09-11T22:11:14.864960+0000","last_became_active":"2024-09-11T22:11:13.869718+0000","last_became_peered":"2024-09-11T22:11:13.869718+0000","last_unstale":"2024-09-11T22:11:14.864960+0000","last_undegraded":"2024-09-11T22:11:14.864960+0000","last_fullsized":"2024-09-11T22:11:14.864960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:24.001331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110830+0000","last_change":"2024-09-11T22:11:14.878531+0000","last_active":"2024-09-11T22:11:16.110830+0000","last_peered":"2024-09-11T22:11:16.110830+0000","last_clean":"2024-09-11T22:11:16.110830+0000","last_became_active":"2024-09-11T22:11:14.875925+0000","last_became_peered":"2024-09-11T22:11:14.875925+0000","last_unstale":"2024-09-11T22:11:16.110830+0000","last_undegraded":"2024-09-11T22:11:16.110830+0000","last_fullsized":"2024-09-11T22:11:16.110830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:03.171917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110562+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:11:16.110562+0000","last_peered":"2024-09-11T22:11:16.110562+0000","last_clean":"2024-09-11T22:11:16.110562+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:11:16.110562+0000","last_undegraded":"2024-09-11T22:11:16.110562+0000","last_fullsized":"2024-09-11T22:11:16.110562+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860054+0000","last_change":"2024-09-11T22:11:13.863848+0000","last_active":"2024-09-11T22:11:15.860054+0000","last_peered":"2024-09-11T22:11:15.860054+0000","last_clean":"2024-09-11T22:11:15.860054+0000","last_became_active":"2024-09-11T22:11:13.863555+0000","last_became_peered":"2024-09-11T22:11:13.863555+0000","last_unstale":"2024-09-11T22:11:15.860054+0000","last_undegraded":"2024-09-11T22:11:15.860054+0000","last_fullsized":"2024-09-11T22:11:15.860054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:45.183251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721078+0000","last_change":"2024-09-11T22:11:14.876698+0000","last_active":"2024-09-11T22:11:16.721078+0000","last_peered":"2024-09-11T22:11:16.721078+0000","last_clean":"2024-09-11T22:11:16.721078+0000","last_became_active":"2024-09-11T22:11:14.875680+0000","last_became_peered":"2024-09-11T22:11:14.875680+0000","last_unstale":"2024-09-11T22:11:16.721078+0000","last_undegraded":"2024-09-11T22:11:16.721078+0000","last_fullsized":"2024-09-11T22:11:16.721078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.504256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110456+0000","last_change":"2024-09-11T22:11:13.871233+0000","last_active":"2024-09-11T22:11:16.110456+0000","last_peered":"2024-09-11T22:11:16.110456+0000","last_clean":"2024-09-11T22:11:16.110456+0000","last_became_active":"2024-09-11T22:11:13.870954+0000","last_became_peered":"2024-09-11T22:11:13.870954+0000","last_unstale":"2024-09-11T22:11:16.110456+0000","last_undegraded":"2024-09-11T22:11:16.110456+0000","last_fullsized":"2024-09-11T22:11:16.110456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:12.996024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721857+0000","last_change":"2024-09-11T22:11:14.875279+0000","last_active":"2024-09-11T22:11:16.721857+0000","last_peered":"2024-09-11T22:11:16.721857+0000","last_clean":"2024-09-11T22:11:16.721857+0000","last_became_active":"2024-09-11T22:11:14.874757+0000","last_became_peered":"2024-09-11T22:11:14.874757+0000","last_unstale":"2024-09-11T22:11:16.721857+0000","last_undegraded":"2024-09-11T22:11:16.721857+0000","last_fullsized":"2024-09-11T22:11:16.721857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T22:11:14.865376+0000","last_change":"2024-09-11T22:11:13.865189+0000","last_active":"2024-09-11T22:11:14.865376+0000","last_peered":"2024-09-11T22:11:14.865376+0000","last_clean":"2024-09-11T22:11:14.865376+0000","last_became_active":"2024-09-11T22:11:13.864912+0000","last_became_peered":"2024-09-11T22:11:13.864912+0000","last_unstale":"2024-09-11T22:11:14.865376+0000","last_undegraded":"2024-09-11T22:11:14.865376+0000","last_fullsized":"2024-09-11T22:11:14.865376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:20.511994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856228+0000","last_change":"2024-09-11T22:11:14.867477+0000","last_active":"2024-09-11T22:11:15.856228+0000","last_peered":"2024-09-11T22:11:15.856228+0000","last_clean":"2024-09-11T22:11:15.856228+0000","last_became_active":"2024-09-11T22:11:14.867198+0000","last_became_peered":"2024-09-11T22:11:14.867198+0000","last_unstale":"2024-09-11T22:11:15.856228+0000","last_undegraded":"2024-09-11T22:11:15.856228+0000","last_fullsized":"2024-09-11T22:11:15.856228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860938+0000","last_change":"2024-09-11T22:11:13.867676+0000","last_active":"2024-09-11T22:11:15.860938+0000","last_peered":"2024-09-11T22:11:15.860938+0000","last_clean":"2024-09-11T22:11:15.860938+0000","last_became_active":"2024-09-11T22:11:13.867391+0000","last_became_peered":"2024-09-11T22:11:13.867391+0000","last_unstale":"2024-09-11T22:11:15.860938+0000","last_undegraded":"2024-09-11T22:11:15.860938+0000","last_fullsized":"2024-09-11T22:11:15.860938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.543280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720999+0000","last_change":"2024-09-11T22:11:14.872333+0000","last_active":"2024-09-11T22:11:16.720999+0000","last_peered":"2024-09-11T22:11:16.720999+0000","last_clean":"2024-09-11T22:11:16.720999+0000","last_became_active":"2024-09-11T22:11:14.872066+0000","last_became_peered":"2024-09-11T22:11:14.872066+0000","last_unstale":"2024-09-11T22:11:16.720999+0000","last_undegraded":"2024-09-11T22:11:16.720999+0000","last_fullsized":"2024-09-11T22:11:16.720999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:06.548515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856337+0000","last_change":"2024-09-11T22:11:13.868171+0000","last_active":"2024-09-11T22:11:15.856337+0000","last_peered":"2024-09-11T22:11:15.856337+0000","last_clean":"2024-09-11T22:11:15.856337+0000","last_became_active":"2024-09-11T22:11:13.867826+0000","last_became_peered":"2024-09-11T22:11:13.867826+0000","last_unstale":"2024-09-11T22:11:15.856337+0000","last_undegraded":"2024-09-11T22:11:15.856337+0000","last_fullsized":"2024-09-11T22:11:15.856337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:53.334520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860761+0000","last_change":"2024-09-11T22:11:14.880771+0000","last_active":"2024-09-11T22:11:15.860761+0000","last_peered":"2024-09-11T22:11:15.860761+0000","last_clean":"2024-09-11T22:11:15.860761+0000","last_became_active":"2024-09-11T22:11:14.879966+0000","last_became_peered":"2024-09-11T22:11:14.879966+0000","last_unstale":"2024-09-11T22:11:15.860761+0000","last_undegraded":"2024-09-11T22:11:15.860761+0000","last_fullsized":"2024-09-11T22:11:15.860761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:39.616151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111068+0000","last_change":"2024-09-11T22:11:13.871639+0000","last_active":"2024-09-11T22:11:16.111068+0000","last_peered":"2024-09-11T22:11:16.111068+0000","last_clean":"2024-09-11T22:11:16.111068+0000","last_became_active":"2024-09-11T22:11:13.870825+0000","last_became_peered":"2024-09-11T22:11:13.870825+0000","last_unstale":"2024-09-11T22:11:16.111068+0000","last_undegraded":"2024-09-11T22:11:16.111068+0000","last_fullsized":"2024-09-11T22:11:16.111068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:04.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856421+0000","last_change":"2024-09-11T22:11:14.866676+0000","last_active":"2024-09-11T22:11:15.856421+0000","last_peered":"2024-09-11T22:11:15.856421+0000","last_clean":"2024-09-11T22:11:15.856421+0000","last_became_active":"2024-09-11T22:11:14.866402+0000","last_became_peered":"2024-09-11T22:11:14.866402+0000","last_unstale":"2024-09-11T22:11:15.856421+0000","last_undegraded":"2024-09-11T22:11:15.856421+0000","last_fullsized":"2024-09-11T22:11:15.856421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856557+0000","last_change":"2024-09-11T22:11:13.872366+0000","last_active":"2024-09-11T22:11:15.856557+0000","last_peered":"2024-09-11T22:11:15.856557+0000","last_clean":"2024-09-11T22:11:15.856557+0000","last_became_active":"2024-09-11T22:11:13.872085+0000","last_became_peered":"2024-09-11T22:11:13.872085+0000","last_unstale":"2024-09-11T22:11:15.856557+0000","last_undegraded":"2024-09-11T22:11:15.856557+0000","last_fullsized":"2024-09-11T22:11:15.856557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.543280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721020+0000","last_change":"2024-09-11T22:11:14.879201+0000","last_active":"2024-09-11T22:11:16.721020+0000","last_peered":"2024-09-11T22:11:16.721020+0000","last_clean":"2024-09-11T22:11:16.721020+0000","last_became_active":"2024-09-11T22:11:14.877959+0000","last_became_peered":"2024-09-11T22:11:14.877959+0000","last_unstale":"2024-09-11T22:11:16.721020+0000","last_undegraded":"2024-09-11T22:11:16.721020+0000","last_fullsized":"2024-09-11T22:11:16.721020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860117+0000","last_change":"2024-09-11T22:11:13.869408+0000","last_active":"2024-09-11T22:11:15.860117+0000","last_peered":"2024-09-11T22:11:15.860117+0000","last_clean":"2024-09-11T22:11:15.860117+0000","last_became_active":"2024-09-11T22:11:13.869118+0000","last_became_peered":"2024-09-11T22:11:13.869118+0000","last_unstale":"2024-09-11T22:11:15.860117+0000","last_undegraded":"2024-09-11T22:11:15.860117+0000","last_fullsized":"2024-09-11T22:11:15.860117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:53.334520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721337+0000","last_change":"2024-09-11T22:11:14.872499+0000","last_active":"2024-09-11T22:11:16.721337+0000","last_peered":"2024-09-11T22:11:16.721337+0000","last_clean":"2024-09-11T22:11:16.721337+0000","last_became_active":"2024-09-11T22:11:14.871587+0000","last_became_peered":"2024-09-11T22:11:14.871587+0000","last_unstale":"2024-09-11T22:11:16.721337+0000","last_undegraded":"2024-09-11T22:11:16.721337+0000","last_fullsized":"2024-09-11T22:11:16.721337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:35.612025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110425+0000","last_change":"2024-09-11T22:11:13.870364+0000","last_active":"2024-09-11T22:11:16.110425+0000","last_peered":"2024-09-11T22:11:16.110425+0000","last_clean":"2024-09-11T22:11:16.110425+0000","last_became_active":"2024-09-11T22:11:13.870090+0000","last_became_peered":"2024-09-11T22:11:13.870090+0000","last_unstale":"2024-09-11T22:11:16.110425+0000","last_undegraded":"2024-09-11T22:11:16.110425+0000","last_fullsized":"2024-09-11T22:11:16.110425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:26.952937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720829+0000","last_change":"2024-09-11T22:11:14.867034+0000","last_active":"2024-09-11T22:11:16.720829+0000","last_peered":"2024-09-11T22:11:16.720829+0000","last_clean":"2024-09-11T22:11:16.720829+0000","last_became_active":"2024-09-11T22:11:14.865159+0000","last_became_peered":"2024-09-11T22:11:14.865159+0000","last_unstale":"2024-09-11T22:11:16.720829+0000","last_undegraded":"2024-09-11T22:11:16.720829+0000","last_fullsized":"2024-09-11T22:11:16.720829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:17.775314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856326+0000","last_change":"2024-09-11T22:11:13.872102+0000","last_active":"2024-09-11T22:11:15.856326+0000","last_peered":"2024-09-11T22:11:15.856326+0000","last_clean":"2024-09-11T22:11:15.856326+0000","last_became_active":"2024-09-11T22:11:13.871744+0000","last_became_peered":"2024-09-11T22:11:13.871744+0000","last_unstale":"2024-09-11T22:11:15.856326+0000","last_undegraded":"2024-09-11T22:11:15.856326+0000","last_fullsized":"2024-09-11T22:11:15.856326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:16.770079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721304+0000","last_change":"2024-09-11T22:11:14.877095+0000","last_active":"2024-09-11T22:11:16.721304+0000","last_peered":"2024-09-11T22:11:16.721304+0000","last_clean":"2024-09-11T22:11:16.721304+0000","last_became_active":"2024-09-11T22:11:14.876804+0000","last_became_peered":"2024-09-11T22:11:14.876804+0000","last_unstale":"2024-09-11T22:11:16.721304+0000","last_undegraded":"2024-09-11T22:11:16.721304+0000","last_fullsized":"2024-09-11T22:11:16.721304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:02.999213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856278+0000","last_change":"2024-09-11T22:11:13.866539+0000","last_active":"2024-09-11T22:11:15.856278+0000","last_peered":"2024-09-11T22:11:15.856278+0000","last_clean":"2024-09-11T22:11:15.856278+0000","last_became_active":"2024-09-11T22:11:13.866049+0000","last_became_peered":"2024-09-11T22:11:13.866049+0000","last_unstale":"2024-09-11T22:11:15.856278+0000","last_undegraded":"2024-09-11T22:11:15.856278+0000","last_fullsized":"2024-09-11T22:11:15.856278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:37.267640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722128+0000","last_change":"2024-09-11T22:11:14.880391+0000","last_active":"2024-09-11T22:11:16.722128+0000","last_peered":"2024-09-11T22:11:16.722128+0000","last_clean":"2024-09-11T22:11:16.722128+0000","last_became_active":"2024-09-11T22:11:14.880107+0000","last_became_peered":"2024-09-11T22:11:14.880107+0000","last_unstale":"2024-09-11T22:11:16.722128+0000","last_undegraded":"2024-09-11T22:11:16.722128+0000","last_fullsized":"2024-09-11T22:11:16.722128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:58.767744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111012+0000","last_change":"2024-09-11T22:11:13.871354+0000","last_active":"2024-09-11T22:11:16.111012+0000","last_peered":"2024-09-11T22:11:16.111012+0000","last_clean":"2024-09-11T22:11:16.111012+0000","last_became_active":"2024-09-11T22:11:13.871001+0000","last_became_peered":"2024-09-11T22:11:13.871001+0000","last_unstale":"2024-09-11T22:11:16.111012+0000","last_undegraded":"2024-09-11T22:11:16.111012+0000","last_fullsized":"2024-09-11T22:11:16.111012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:51.873061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859743+0000","last_change":"2024-09-11T22:11:14.875629+0000","last_active":"2024-09-11T22:11:15.859743+0000","last_peered":"2024-09-11T22:11:15.859743+0000","last_clean":"2024-09-11T22:11:15.859743+0000","last_became_active":"2024-09-11T22:11:14.875371+0000","last_became_peered":"2024-09-11T22:11:14.875371+0000","last_unstale":"2024-09-11T22:11:15.859743+0000","last_undegraded":"2024-09-11T22:11:15.859743+0000","last_fullsized":"2024-09-11T22:11:15.859743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.370344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860610+0000","last_change":"2024-09-11T22:11:14.867613+0000","last_active":"2024-09-11T22:11:15.860610+0000","last_peered":"2024-09-11T22:11:15.860610+0000","last_clean":"2024-09-11T22:11:15.860610+0000","last_became_active":"2024-09-11T22:11:14.865673+0000","last_became_peered":"2024-09-11T22:11:14.865673+0000","last_unstale":"2024-09-11T22:11:15.860610+0000","last_undegraded":"2024-09-11T22:11:15.860610+0000","last_fullsized":"2024-09-11T22:11:15.860610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:20.925559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110863+0000","last_change":"2024-09-11T22:11:13.874968+0000","last_active":"2024-09-11T22:11:16.110863+0000","last_peered":"2024-09-11T22:11:16.110863+0000","last_clean":"2024-09-11T22:11:16.110863+0000","last_became_active":"2024-09-11T22:11:13.874621+0000","last_became_peered":"2024-09-11T22:11:13.874621+0000","last_unstale":"2024-09-11T22:11:16.110863+0000","last_undegraded":"2024-09-11T22:11:16.110863+0000","last_fullsized":"2024-09-11T22:11:16.110863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:09.164832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860836+0000","last_change":"2024-09-11T22:11:14.868006+0000","last_active":"2024-09-11T22:11:15.860836+0000","last_peered":"2024-09-11T22:11:15.860836+0000","last_clean":"2024-09-11T22:11:15.860836+0000","last_became_active":"2024-09-11T22:11:14.867573+0000","last_became_peered":"2024-09-11T22:11:14.867573+0000","last_unstale":"2024-09-11T22:11:15.860836+0000","last_undegraded":"2024-09-11T22:11:15.860836+0000","last_fullsized":"2024-09-11T22:11:15.860836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:17.480305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110928+0000","last_change":"2024-09-11T22:11:13.873703+0000","last_active":"2024-09-11T22:11:16.110928+0000","last_peered":"2024-09-11T22:11:16.110928+0000","last_clean":"2024-09-11T22:11:16.110928+0000","last_became_active":"2024-09-11T22:11:13.873310+0000","last_became_peered":"2024-09-11T22:11:13.873310+0000","last_unstale":"2024-09-11T22:11:16.110928+0000","last_undegraded":"2024-09-11T22:11:16.110928+0000","last_fullsized":"2024-09-11T22:11:16.110928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:39.514326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722052+0000","last_change":"2024-09-11T22:11:14.873241+0000","last_active":"2024-09-11T22:11:16.722052+0000","last_peered":"2024-09-11T22:11:16.722052+0000","last_clean":"2024-09-11T22:11:16.722052+0000","last_became_active":"2024-09-11T22:11:14.872638+0000","last_became_peered":"2024-09-11T22:11:14.872638+0000","last_unstale":"2024-09-11T22:11:16.722052+0000","last_undegraded":"2024-09-11T22:11:16.722052+0000","last_fullsized":"2024-09-11T22:11:16.722052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:02.999213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722066+0000","last_change":"2024-09-11T22:11:13.869743+0000","last_active":"2024-09-11T22:11:16.722066+0000","last_peered":"2024-09-11T22:11:16.722066+0000","last_clean":"2024-09-11T22:11:16.722066+0000","last_became_active":"2024-09-11T22:11:13.868457+0000","last_became_peered":"2024-09-11T22:11:13.868457+0000","last_unstale":"2024-09-11T22:11:16.722066+0000","last_undegraded":"2024-09-11T22:11:16.722066+0000","last_fullsized":"2024-09-11T22:11:16.722066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:15.850187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721967+0000","last_change":"2024-09-11T22:11:14.870523+0000","last_active":"2024-09-11T22:11:16.721967+0000","last_peered":"2024-09-11T22:11:16.721967+0000","last_clean":"2024-09-11T22:11:16.721967+0000","last_became_active":"2024-09-11T22:11:14.870160+0000","last_became_peered":"2024-09-11T22:11:14.870160+0000","last_unstale":"2024-09-11T22:11:16.721967+0000","last_undegraded":"2024-09-11T22:11:16.721967+0000","last_fullsized":"2024-09-11T22:11:16.721967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:49.232203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722394+0000","last_change":"2024-09-11T22:11:13.866359+0000","last_active":"2024-09-11T22:11:16.722394+0000","last_peered":"2024-09-11T22:11:16.722394+0000","last_clean":"2024-09-11T22:11:16.722394+0000","last_became_active":"2024-09-11T22:11:13.866072+0000","last_became_peered":"2024-09-11T22:11:13.866072+0000","last_unstale":"2024-09-11T22:11:16.722394+0000","last_undegraded":"2024-09-11T22:11:16.722394+0000","last_fullsized":"2024-09-11T22:11:16.722394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":663753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35544,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336296,"statfs":{"total":96636764160,"available":96600367104,"internally_reserved":0,"allocated":196608,"data_stored":66447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:11:22.580 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:11:22.580 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T22:11:22.580 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T22:11:22.581 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T22:11:22.581 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T22:11:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.718+0000 7f979e617640 1 Processor -- start 2024-09-11T22:11:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.718+0000 7f979e617640 1 -- start start 2024-09-11T22:11:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.718+0000 7f979e617640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97980cf580 0x7f97980b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.718+0000 7f979e617640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97980ce5f0 con 0x7f979815e840 2024-09-11T22:11:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.718+0000 7f979e617640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97980ce310 con 0x7f97980cdd50 2024-09-11T22:11:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.718+0000 7f979e617640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f979806c240 con 0x7f97980cf580 2024-09-11T22:11:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.719+0000 7f97977fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97980cf580 0x7f97980b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.719+0000 7f9797fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f979815e840 0x7f97980cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41138/0 (socket says 172.21.15.50:41138) 2024-09-11T22:11:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.719+0000 7f9797fff640 1 -- 172.21.15.50:0/1881174988 learned_addr learned my addr 172.21.15.50:0/1881174988 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.719+0000 7f97977fe640 1 -- 172.21.15.50:0/1881174988 >> v1:172.21.15.77:6789/0 conn(0x7f97980cdd50 legacy=0x7f979806c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.719+0000 7f97977fe640 1 -- 172.21.15.50:0/1881174988 >> v1:172.21.15.50:6789/0 conn(0x7f979815e840 legacy=0x7f97980cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.719+0000 7f97977fe640 1 -- 172.21.15.50:0/1881174988 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979806bbf0 con 0x7f97980cf580 2024-09-11T22:11:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.720+0000 7f97977fe640 1 --2- 172.21.15.50:0/1881174988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97980cf580 0x7f97980b4c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f978c0097a0 tx=0x7f978c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bcd49969601f602 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.720+0000 7f9796ffd640 1 -- 172.21.15.50:0/1881174988 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c037070 con 0x7f97980cf580 2024-09-11T22:11:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.720+0000 7f9796ffd640 1 -- 172.21.15.50:0/1881174988 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c032440 con 0x7f97980cf580 2024-09-11T22:11:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.720+0000 7f9796ffd640 1 -- 172.21.15.50:0/1881174988 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c032810 con 0x7f97980cf580 2024-09-11T22:11:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.720+0000 7f979e617640 1 -- 172.21.15.50:0/1881174988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97980cf580 msgr2=0x7f97980b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.720+0000 7f979e617640 1 --2- 172.21.15.50:0/1881174988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97980cf580 0x7f97980b4c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f978c0097a0 tx=0x7f978c02a1e0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.720+0000 7f979e617640 1 -- 172.21.15.50:0/1881174988 shutdown_connections 2024-09-11T22:11:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.720+0000 7f979e617640 1 --2- 172.21.15.50:0/1881174988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97980cf580 0x7f97980b4c70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.720+0000 7f979e617640 1 -- 172.21.15.50:0/1881174988 >> 172.21.15.50:0/1881174988 conn(0x7f97980b4150 msgr2=0x7f97980b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.720+0000 7f979e617640 1 -- 172.21.15.50:0/1881174988 shutdown_connections 2024-09-11T22:11:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.720+0000 7f979e617640 1 -- 172.21.15.50:0/1881174988 wait complete. 2024-09-11T22:11:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.722+0000 7f979e617640 1 Processor -- start 2024-09-11T22:11:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.722+0000 7f979e617640 1 -- start start 2024-09-11T22:11:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.722+0000 7f979e617640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97980cdd50 0x7f9798156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.722+0000 7f979e617640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97980cf580 0x7f9798159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.722+0000 7f979e617640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979815e840 0x7f9798158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.722+0000 7f979e617640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f979815ec20 con 0x7f979815e840 2024-09-11T22:11:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.722+0000 7f979e617640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f97980d0470 con 0x7f97980cf580 2024-09-11T22:11:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.722+0000 7f979e617640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f979815eda0 con 0x7f97980cdd50 2024-09-11T22:11:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f979cbb4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979815e840 0x7f9798158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f979cbb4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979815e840 0x7f9798158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46344/0 (socket says 172.21.15.50:46344) 2024-09-11T22:11:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f979cbb4640 1 -- 172.21.15.50:0/1339472558 learned_addr learned my addr 172.21.15.50:0/1339472558 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f97977fe640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97980cf580 0x7f9798159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f9797fff640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97980cdd50 0x7f9798156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f979cbb4640 1 -- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97980cdd50 msgr2=0x7f9798156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f979cbb4640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97980cdd50 0x7f9798156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f979cbb4640 1 -- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97980cf580 msgr2=0x7f9798159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f979cbb4640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97980cf580 0x7f9798159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f979cbb4640 1 -- 172.21.15.50:0/1339472558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979815b4b0 con 0x7f979815e840 2024-09-11T22:11:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f979cbb4640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979815e840 0x7f9798158580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f979000b9c0 tx=0x7f979000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f9794ff9640 1 -- 172.21.15.50:0/1339472558 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790019070 con 0x7f979815e840 2024-09-11T22:11:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f9794ff9640 1 -- 172.21.15.50:0/1339472558 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f979000cba0 con 0x7f979815e840 2024-09-11T22:11:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f9794ff9640 1 -- 172.21.15.50:0/1339472558 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790014440 con 0x7f979815e840 2024-09-11T22:11:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f979e617640 1 -- 172.21.15.50:0/1339472558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979815a410 con 0x7f979815e840 2024-09-11T22:11:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.723+0000 7f979e617640 1 -- 172.21.15.50:0/1339472558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979815a9d0 con 0x7f979815e840 2024-09-11T22:11:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.724+0000 7f979e617640 1 -- 172.21.15.50:0/1339472558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97980b4c70 con 0x7f979815e840 2024-09-11T22:11:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.725+0000 7f9794ff9640 1 -- 172.21.15.50:0/1339472558 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f979001c070 con 0x7f979815e840 2024-09-11T22:11:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.725+0000 7f9794ff9640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f978406be30 0x7f978406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.725+0000 7f9794ff9640 1 -- 172.21.15.50:0/1339472558 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f979008abe0 con 0x7f979815e840 2024-09-11T22:11:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.725+0000 7f9797fff640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f978406be30 0x7f978406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.726+0000 7f9797fff640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f978406be30 0x7f978406e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9798149880 tx=0x7f9788007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:22.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.730+0000 7f9794ff9640 1 -- 172.21.15.50:0/1339472558 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9790058ea0 con 0x7f979815e840 2024-09-11T22:11:22.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.954+0000 7f979e617640 1 -- 172.21.15.50:0/1339472558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f979806e1d0 con 0x7f979815e840 2024-09-11T22:11:22.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.957+0000 7f9794ff9640 1 -- 172.21.15.50:0/1339472558 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172939 (secure 0 0 0) 0x7f979005d1a0 con 0x7f979815e840 2024-09-11T22:11:22.959 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.959+0000 7f979e617640 1 -- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f978406be30 msgr2=0x7f978406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.959+0000 7f979e617640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f978406be30 0x7f978406e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9798149880 tx=0x7f9788007e80 comp rx=0 tx=0).stop 2024-09-11T22:11:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.959+0000 7f979e617640 1 -- 172.21.15.50:0/1339472558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979815e840 msgr2=0x7f9798158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.959+0000 7f979e617640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979815e840 0x7f9798158580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f979000b9c0 tx=0x7f979000be80 comp rx=0 tx=0).stop 2024-09-11T22:11:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.959+0000 7f979e617640 1 -- 172.21.15.50:0/1339472558 shutdown_connections 2024-09-11T22:11:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.959+0000 7f979e617640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f978406be30 0x7f978406e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.959+0000 7f979e617640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979815e840 0x7f9798158580 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.959+0000 7f979e617640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97980cf580 0x7f9798159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.959+0000 7f979e617640 1 --2- 172.21.15.50:0/1339472558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97980cdd50 0x7f9798156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:22.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.959+0000 7f979e617640 1 -- 172.21.15.50:0/1339472558 >> 172.21.15.50:0/1339472558 conn(0x7f97980b4150 msgr2=0x7f97980b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:22.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.959+0000 7f979e617640 1 -- 172.21.15.50:0/1339472558 shutdown_connections 2024-09-11T22:11:22.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:22.959+0000 7f979e617640 1 -- 172.21.15.50:0/1339472558 wait complete. 2024-09-11T22:11:22.971 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2944691311},{"type":"v1","addr":"172.21.15.77:6833","nonce":2944691311}]},"active_addr":"172.21.15.77:6833/2944691311","active_change":"2024-09-11T22:10:55.353032+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":1931956757}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":3367514001}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2866587680}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":4236478699}]}]} 2024-09-11T22:11:22.974 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T22:11:22.974 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T22:11:22.974 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.076+0000 7fe804265640 1 Processor -- start 2024-09-11T22:11:23.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.076+0000 7fe804265640 1 -- start start 2024-09-11T22:11:23.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.077+0000 7fe804265640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe7fc15fb60 0x7fe7fc0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.077+0000 7fe804265640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7fc0d0fd0 0x7fe7fc0af670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.077+0000 7fe804265640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7fc15ff40 con 0x7fe7fc0d0150 2024-09-11T22:11:23.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.077+0000 7fe804265640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe7fc0cf510 con 0x7fe7fc15fb60 2024-09-11T22:11:23.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.077+0000 7fe804265640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe7fc0cfdb0 con 0x7fe7fc0d0fd0 2024-09-11T22:11:23.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.077+0000 7fe801800640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe7fc0d0150 0x7fe7fc0d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:58646/0 (socket says 172.21.15.50:58646) 2024-09-11T22:11:23.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.077+0000 7fe801800640 1 -- 172.21.15.50:0/582413140 learned_addr learned my addr 172.21.15.50:0/582413140 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:23.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.078+0000 7fe802001640 1 --2- 172.21.15.50:0/582413140 >> v2:172.21.15.77:3300/0 conn(0x7fe7fc15fb60 0x7fe7fc0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.078+0000 7fe802802640 1 --2- 172.21.15.50:0/582413140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7fc0d0fd0 0x7fe7fc0af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.078+0000 7fe800fff640 1 -- 172.21.15.50:0/582413140 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 261573806 0 0) 0x7fe7fc15ff40 con 0x7fe7fc0d0150 2024-09-11T22:11:23.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.078+0000 7fe800fff640 1 -- 172.21.15.50:0/582413140 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7e8003520 con 0x7fe7fc0d0150 2024-09-11T22:11:23.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.078+0000 7fe802001640 1 -- 172.21.15.50:0/582413140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7fc0d0fd0 msgr2=0x7fe7fc0af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.078+0000 7fe802001640 1 --2- 172.21.15.50:0/582413140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7fc0d0fd0 0x7fe7fc0af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.078+0000 7fe802001640 1 -- 172.21.15.50:0/582413140 >> v1:172.21.15.77:6789/0 conn(0x7fe7fc0d0150 legacy=0x7fe7fc0d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.078+0000 7fe802001640 1 -- 172.21.15.50:0/582413140 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc0d05e0 con 0x7fe7fc15fb60 2024-09-11T22:11:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.079+0000 7fe802001640 1 --2- 172.21.15.50:0/582413140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7fc15fb60 0x7fe7fc0b4c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80097a0 tx=0x7fe7f802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2e00a74ba205e07 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.079+0000 7fe800fff640 1 -- 172.21.15.50:0/582413140 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8037070 con 0x7fe7fc15fb60 2024-09-11T22:11:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.079+0000 7fe800fff640 1 -- 172.21.15.50:0/582413140 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f802ae50 con 0x7fe7fc15fb60 2024-09-11T22:11:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.079+0000 7fe800fff640 1 -- 172.21.15.50:0/582413140 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8032660 con 0x7fe7fc15fb60 2024-09-11T22:11:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.079+0000 7fe804265640 1 -- 172.21.15.50:0/582413140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7fc15fb60 msgr2=0x7fe7fc0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.079+0000 7fe804265640 1 --2- 172.21.15.50:0/582413140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7fc15fb60 0x7fe7fc0b4c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80097a0 tx=0x7fe7f802a100 comp rx=0 tx=0).stop 2024-09-11T22:11:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.080+0000 7fe804265640 1 -- 172.21.15.50:0/582413140 shutdown_connections 2024-09-11T22:11:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.080+0000 7fe804265640 1 --2- 172.21.15.50:0/582413140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7fc0d0fd0 0x7fe7fc0af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.080+0000 7fe804265640 1 --2- 172.21.15.50:0/582413140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7fc15fb60 0x7fe7fc0b4c70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.080+0000 7fe804265640 1 -- 172.21.15.50:0/582413140 >> 172.21.15.50:0/582413140 conn(0x7fe7fc0b4150 msgr2=0x7fe7fc0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.080+0000 7fe804265640 1 -- 172.21.15.50:0/582413140 shutdown_connections 2024-09-11T22:11:23.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.080+0000 7fe804265640 1 -- 172.21.15.50:0/582413140 wait complete. 2024-09-11T22:11:23.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.081+0000 7fe804265640 1 Processor -- start 2024-09-11T22:11:23.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.081+0000 7fe804265640 1 -- start start 2024-09-11T22:11:23.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe804265640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7fc0d0fd0 0x7fe7fc06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe804265640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7fc15fb60 0x7fe7fc0afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe804265640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7fc06bb50 0x7fe7fc152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe804265640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc0b1930 con 0x7fe7fc06bb50 2024-09-11T22:11:23.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe804265640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc0cfa40 con 0x7fe7fc15fb60 2024-09-11T22:11:23.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe804265640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe7fc0b1ab0 con 0x7fe7fc0d0fd0 2024-09-11T22:11:23.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe802802640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7fc06bb50 0x7fe7fc152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe802802640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7fc06bb50 0x7fe7fc152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46352/0 (socket says 172.21.15.50:46352) 2024-09-11T22:11:23.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe802802640 1 -- 172.21.15.50:0/1646452224 learned_addr learned my addr 172.21.15.50:0/1646452224 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:23.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe801800640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7fc15fb60 0x7fe7fc0afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe802001640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7fc0d0fd0 0x7fe7fc06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe802802640 1 -- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7fc0d0fd0 msgr2=0x7fe7fc06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe802802640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7fc0d0fd0 0x7fe7fc06d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe802802640 1 -- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7fc15fb60 msgr2=0x7fe7fc0afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe802802640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7fc15fb60 0x7fe7fc0afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe802802640 1 -- 172.21.15.50:0/1646452224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc06c050 con 0x7fe7fc06bb50 2024-09-11T22:11:23.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe801800640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7fc15fb60 0x7fe7fc0afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:23.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe802001640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7fc0d0fd0 0x7fe7fc06d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:23.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe802802640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7fc06bb50 0x7fe7fc152720 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400efc0 tx=0x7fe7f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe7f27fc640 1 -- 172.21.15.50:0/1646452224 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4018020 con 0x7fe7fc06bb50 2024-09-11T22:11:23.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.082+0000 7fe7f27fc640 1 -- 172.21.15.50:0/1646452224 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f4014480 con 0x7fe7fc06bb50 2024-09-11T22:11:23.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.083+0000 7fe804265640 1 -- 172.21.15.50:0/1646452224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7fc06c330 con 0x7fe7fc06bb50 2024-09-11T22:11:23.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.083+0000 7fe7f27fc640 1 -- 172.21.15.50:0/1646452224 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4014870 con 0x7fe7fc06bb50 2024-09-11T22:11:23.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.083+0000 7fe804265640 1 -- 172.21.15.50:0/1646452224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7fc06c8f0 con 0x7fe7fc06bb50 2024-09-11T22:11:23.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.084+0000 7fe804265640 1 -- 172.21.15.50:0/1646452224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7fc0b4c70 con 0x7fe7fc06bb50 2024-09-11T22:11:23.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.084+0000 7fe7f27fc640 1 -- 172.21.15.50:0/1646452224 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe7f4005d10 con 0x7fe7fc06bb50 2024-09-11T22:11:23.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.085+0000 7fe7f27fc640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe7e006be30 0x7fe7e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.085+0000 7fe7f27fc640 1 -- 172.21.15.50:0/1646452224 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe7f408b9a0 con 0x7fe7fc06bb50 2024-09-11T22:11:23.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.085+0000 7fe802001640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe7e006be30 0x7fe7e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.085+0000 7fe802001640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe7e006be30 0x7fe7e006e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8034000 tx=0x7fe7f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.089+0000 7fe7f27fc640 1 -- 172.21.15.50:0/1646452224 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7f4022070 con 0x7fe7fc06bb50 2024-09-11T22:11:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.265+0000 7fe804265640 1 -- 172.21.15.50:0/1646452224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7fc0b2ff0 con 0x7fe7fc06bb50 2024-09-11T22:11:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.266+0000 7fe7f27fc640 1 -- 172.21.15.50:0/1646452224 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7fe7f4010040 con 0x7fe7fc06bb50 2024-09-11T22:11:23.267 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:23.267 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:15.853220+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:12.090736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:13.202114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:23.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.269+0000 7fe804265640 1 -- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe7e006be30 msgr2=0x7fe7e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.269+0000 7fe804265640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe7e006be30 0x7fe7e006e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8034000 tx=0x7fe7f802e000 comp rx=0 tx=0).stop 2024-09-11T22:11:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.269+0000 7fe804265640 1 -- 172.21.15.50:0/1646452224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7fc06bb50 msgr2=0x7fe7fc152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.269+0000 7fe804265640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7fc06bb50 0x7fe7fc152720 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400efc0 tx=0x7fe7f400c490 comp rx=0 tx=0).stop 2024-09-11T22:11:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.269+0000 7fe804265640 1 -- 172.21.15.50:0/1646452224 shutdown_connections 2024-09-11T22:11:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.269+0000 7fe804265640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe7e006be30 0x7fe7e006e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.269+0000 7fe804265640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7fc06bb50 0x7fe7fc152720 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.269+0000 7fe804265640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7fc15fb60 0x7fe7fc0afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.269+0000 7fe804265640 1 --2- 172.21.15.50:0/1646452224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7fc0d0fd0 0x7fe7fc06d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.269+0000 7fe804265640 1 -- 172.21.15.50:0/1646452224 >> 172.21.15.50:0/1646452224 conn(0x7fe7fc0b4150 msgr2=0x7fe7fc06fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.269+0000 7fe804265640 1 -- 172.21.15.50:0/1646452224 shutdown_connections 2024-09-11T22:11:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.269+0000 7fe804265640 1 -- 172.21.15.50:0/1646452224 wait complete. 2024-09-11T22:11:23.280 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T22:11:23.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:23.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.382+0000 7f09a7b9f640 1 Processor -- start 2024-09-11T22:11:23.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.382+0000 7f09a7b9f640 1 -- start start 2024-09-11T22:11:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a7b9f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00d18a0 0x7f09a00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a7b9f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f09a00d3a30 0x7f09a00b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a7b9f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a00cfa80 con 0x7f09a015e870 2024-09-11T22:11:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a7b9f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f09a00d3ea0 con 0x7f09a00d3a30 2024-09-11T22:11:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a7b9f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f09a00d40d0 con 0x7f09a00d18a0 2024-09-11T22:11:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a593b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f09a015e870 0x7f09a00d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41150/0 (socket says 172.21.15.50:41150) 2024-09-11T22:11:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a593b640 1 -- 172.21.15.50:0/3006728962 learned_addr learned my addr 172.21.15.50:0/3006728962 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885918276 0 0) 0x7f0998001110 con 0x7f09a015e870 2024-09-11T22:11:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0988003520 con 0x7f09a015e870 2024-09-11T22:11:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a613c640 1 --2- 172.21.15.50:0/3006728962 >> v2:172.21.15.77:3300/0 conn(0x7f09a00d3a30 0x7f09a00b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a513a640 1 --2- 172.21.15.50:0/3006728962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00d18a0 0x7f09a00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2927849734 0 0) 0x7f0988003520 con 0x7f09a015e870 2024-09-11T22:11:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00d18a0 msgr2=0x7f09a00d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 --2- 172.21.15.50:0/3006728962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00d18a0 0x7f09a00d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 >> v2:172.21.15.77:3300/0 conn(0x7f09a00d3a30 msgr2=0x7f09a00b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 --2- 172.21.15.50:0/3006728962 >> v2:172.21.15.77:3300/0 conn(0x7f09a00d3a30 0x7f09a00b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a00d43b0 con 0x7f09a015e870 2024-09-11T22:11:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f0998001840 con 0x7f09a015e870 2024-09-11T22:11:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 >> v1:172.21.15.50:6789/0 conn(0x7f09a015e870 legacy=0x7f09a00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 --2- 172.21.15.50:0/3006728962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09880039b0 0x7f0988003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 --2- 172.21.15.50:0/3006728962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0988004800 0x7f0988004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 --2- 172.21.15.50:0/3006728962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00d18a0 0x7f09880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09a00d40d0 con 0x7f0988004800 2024-09-11T22:11:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f098800b9c0 con 0x7f09880039b0 2024-09-11T22:11:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f098800bb40 con 0x7f09a00d18a0 2024-09-11T22:11:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.383+0000 7f09a513a640 1 --2- 172.21.15.50:0/3006728962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0988004800 0x7f0988004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.384+0000 7f09a593b640 1 --2- 172.21.15.50:0/3006728962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09880039b0 0x7f0988003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.384+0000 7f09a613c640 1 --2- 172.21.15.50:0/3006728962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00d18a0 0x7f09880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.384+0000 7f09a513a640 1 -- 172.21.15.50:0/3006728962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00d18a0 msgr2=0x7f09880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.384+0000 7f09a513a640 1 --2- 172.21.15.50:0/3006728962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00d18a0 0x7f09880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.384+0000 7f09a513a640 1 -- 172.21.15.50:0/3006728962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09880039b0 msgr2=0x7f0988003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.384+0000 7f09a513a640 1 --2- 172.21.15.50:0/3006728962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09880039b0 0x7f0988003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.384+0000 7f09a513a640 1 -- 172.21.15.50:0/3006728962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0988003520 con 0x7f0988004800 2024-09-11T22:11:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.384+0000 7f09a513a640 1 --2- 172.21.15.50:0/3006728962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0988004800 0x7f0988004c80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0994009aa0 tx=0x7f0988005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bbec2b882dd42d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.385+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994036070 con 0x7f0988004800 2024-09-11T22:11:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.385+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0994031400 con 0x7f0988004800 2024-09-11T22:11:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.385+0000 7f09a4939640 1 -- 172.21.15.50:0/3006728962 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994009670 con 0x7f0988004800 2024-09-11T22:11:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.385+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3006728962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0988004800 msgr2=0x7f0988004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.385+0000 7f09a7b9f640 1 --2- 172.21.15.50:0/3006728962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0988004800 0x7f0988004c80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0994009aa0 tx=0x7f0988005830 comp rx=0 tx=0).stop 2024-09-11T22:11:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.385+0000 7f09a613c640 1 -- 172.21.15.50:0/3006728962 reap_dead start 2024-09-11T22:11:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.385+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3006728962 shutdown_connections 2024-09-11T22:11:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.385+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3006728962 >> 172.21.15.50:0/3006728962 conn(0x7f09a00727a0 msgr2=0x7f09a00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.385+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3006728962 shutdown_connections 2024-09-11T22:11:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.385+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3006728962 wait complete. 2024-09-11T22:11:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.386+0000 7f09a7b9f640 1 Processor -- start 2024-09-11T22:11:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.386+0000 7f09a7b9f640 1 -- start start 2024-09-11T22:11:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.387+0000 7f09a7b9f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0988004800 0x7f09a015a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.387+0000 7f09a7b9f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09a015b4a0 0x7f09a015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.387+0000 7f09a7b9f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00acaa0 0x7f09a00acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.387+0000 7f09a7b9f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09a015ec50 con 0x7f0988004800 2024-09-11T22:11:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.387+0000 7f09a7b9f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f09a00b7ee0 con 0x7f09a015b4a0 2024-09-11T22:11:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.387+0000 7f09a7b9f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f09a00b78b0 con 0x7f09a00acaa0 2024-09-11T22:11:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.387+0000 7f09a593b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0988004800 0x7f09a015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.387+0000 7f09a593b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0988004800 0x7f09a015a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46370/0 (socket says 172.21.15.50:46370) 2024-09-11T22:11:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.387+0000 7f09a593b640 1 -- 172.21.15.50:0/3808539218 learned_addr learned my addr 172.21.15.50:0/3808539218 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.387+0000 7f09a513a640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09a015b4a0 0x7f09a015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.387+0000 7f09a613c640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00acaa0 0x7f09a00acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.388+0000 7f09a593b640 1 -- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00acaa0 msgr2=0x7f09a00acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.388+0000 7f09a593b640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00acaa0 0x7f09a00acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.388+0000 7f09a593b640 1 -- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09a015b4a0 msgr2=0x7f09a015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.388+0000 7f09a593b640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09a015b4a0 0x7f09a015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.388+0000 7f09a593b640 1 -- 172.21.15.50:0/3808539218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a00cbc70 con 0x7f0988004800 2024-09-11T22:11:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.388+0000 7f09a613c640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00acaa0 0x7f09a00acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.388+0000 7f09a593b640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0988004800 0x7f09a015a930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0998004f40 tx=0x7f09980074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.388+0000 7f099e7fc640 1 -- 172.21.15.50:0/3808539218 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099800f7b0 con 0x7f0988004800 2024-09-11T22:11:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.388+0000 7f099e7fc640 1 -- 172.21.15.50:0/3808539218 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0998018070 con 0x7f0988004800 2024-09-11T22:11:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.388+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3808539218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a00cf440 con 0x7f0988004800 2024-09-11T22:11:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.388+0000 7f099e7fc640 1 -- 172.21.15.50:0/3808539218 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099800fb70 con 0x7f0988004800 2024-09-11T22:11:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.388+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3808539218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a00cb0d0 con 0x7f0988004800 2024-09-11T22:11:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.389+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3808539218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a00d34f0 con 0x7f0988004800 2024-09-11T22:11:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.389+0000 7f099e7fc640 1 -- 172.21.15.50:0/3808539218 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f099800fd10 con 0x7f0988004800 2024-09-11T22:11:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.390+0000 7f099e7fc640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f098c06be30 0x7f098c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.390+0000 7f099e7fc640 1 -- 172.21.15.50:0/3808539218 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f099808ae10 con 0x7f0988004800 2024-09-11T22:11:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.390+0000 7f09a513a640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f098c06be30 0x7f098c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.390+0000 7f09a513a640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f098c06be30 0x7f098c06e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0994033000 tx=0x7f0994008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.394+0000 7f099e7fc640 1 -- 172.21.15.50:0/3808539218 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09a00cfa80 con 0x7f0988004800 2024-09-11T22:11:23.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.573+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3808539218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09a0160e60 con 0x7f0988004800 2024-09-11T22:11:23.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.575+0000 7f099e7fc640 1 -- 172.21.15.50:0/3808539218 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7f09980597c0 con 0x7f0988004800 2024-09-11T22:11:23.576 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:23.576 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:15.853220+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:12.090736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:13.202114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.577+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f098c06be30 msgr2=0x7f098c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.577+0000 7f09a7b9f640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f098c06be30 0x7f098c06e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0994033000 tx=0x7f0994008030 comp rx=0 tx=0).stop 2024-09-11T22:11:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.577+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3808539218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0988004800 msgr2=0x7f09a015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.577+0000 7f09a7b9f640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0988004800 0x7f09a015a930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0998004f40 tx=0x7f09980074f0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.577+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3808539218 shutdown_connections 2024-09-11T22:11:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.577+0000 7f09a7b9f640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f098c06be30 0x7f098c06e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.577+0000 7f09a7b9f640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09a00acaa0 0x7f09a00acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.577+0000 7f09a7b9f640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09a015b4a0 0x7f09a015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.577+0000 7f09a7b9f640 1 --2- 172.21.15.50:0/3808539218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0988004800 0x7f09a015a930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.577+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3808539218 >> 172.21.15.50:0/3808539218 conn(0x7f09a00727a0 msgr2=0x7f09a00b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.577+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3808539218 shutdown_connections 2024-09-11T22:11:23.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.577+0000 7f09a7b9f640 1 -- 172.21.15.50:0/3808539218 wait complete. 2024-09-11T22:11:23.589 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T22:11:23.589 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T22:11:23.590 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T22:11:23.590 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T22:11:23.590 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T22:11:23.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T22:11:23.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T22:11:23.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T22:11:23.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.767+0000 7fbaa7fff640 1 Processor -- start 2024-09-11T22:11:23.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.767+0000 7fbaa7fff640 1 -- start start 2024-09-11T22:11:23.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.767+0000 7fe4af928640 1 Processor -- start 2024-09-11T22:11:23.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.768+0000 7fe4af928640 1 -- start start 2024-09-11T22:11:23.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.768+0000 7fbaa7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbaa8154ff0 0x7fbaa8074c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.768+0000 7fbaa7fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa806f930 0x7fbaa806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.768+0000 7f8fbf4a5640 1 Processor -- start 2024-09-11T22:11:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.768+0000 7fbaa7fff640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa815e810 con 0x7fbaa80b5780 2024-09-11T22:11:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.768+0000 7fbaa7fff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa815e5c0 con 0x7fbaa8154ff0 2024-09-11T22:11:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.768+0000 7fbaa7fff640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa815eaf0 con 0x7fbaa806f930 2024-09-11T22:11:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.769+0000 7fbaa77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbaa80b5780 0x7fbaa80b3d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41152/0 (socket says 172.21.15.50:41152) 2024-09-11T22:11:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.769+0000 7fbaa77fe640 1 -- 172.21.15.50:0/2286438467 learned_addr learned my addr 172.21.15.50:0/2286438467 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.769+0000 7fe4af928640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a815ff10 0x7fe4a80ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.769+0000 7fe4af928640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe4a80ce4b0 0x7fe4a80ce960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.769+0000 7fe4af928640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a80aeba0 con 0x7fe4a81602f0 2024-09-11T22:11:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.769+0000 7fe4af928640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe4a8160e20 con 0x7fe4a80ce4b0 2024-09-11T22:11:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.769+0000 7fe4af928640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a80aee80 con 0x7fe4a815ff10 2024-09-11T22:11:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.769+0000 7fbaa6ffd640 1 --2- 172.21.15.50:0/2286438467 >> v2:172.21.15.50:3300/0 conn(0x7fbaa8154ff0 0x7fbaa8074c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.768+0000 7fb87c22e640 1 Processor -- start 2024-09-11T22:11:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.769+0000 7fb87c22e640 1 -- start start 2024-09-11T22:11:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.769+0000 7fbaa67fc640 1 --2- 172.21.15.50:0/2286438467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa806f930 0x7fbaa806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.769+0000 7fe4acec3640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe4a81602f0 0x7fe4a8160710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41166/0 (socket says 172.21.15.50:41166) 2024-09-11T22:11:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fe4acec3640 1 -- 172.21.15.50:0/3824439227 learned_addr learned my addr 172.21.15.50:0/3824439227 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fe4ad6c4640 1 --2- 172.21.15.50:0/3824439227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a815ff10 0x7fe4a80ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fbaa5ffb640 1 -- 172.21.15.50:0/2286438467 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264220343 0 0) 0x7fbaa815e810 con 0x7fbaa80b5780 2024-09-11T22:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7f29fda82640 1 Processor -- start 2024-09-11T22:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fbaa6ffd640 1 -- 172.21.15.50:0/2286438467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa806f930 msgr2=0x7fbaa806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fbaa6ffd640 1 --2- 172.21.15.50:0/2286438467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa806f930 0x7fbaa806fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7f29fda82640 1 -- start start 2024-09-11T22:11:23.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fbaa6ffd640 1 -- 172.21.15.50:0/2286438467 >> v1:172.21.15.50:6789/0 conn(0x7fbaa80b5780 legacy=0x7fbaa80b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fbaa6ffd640 1 -- 172.21.15.50:0/2286438467 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa815edd0 con 0x7fbaa8154ff0 2024-09-11T22:11:23.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fe4adec5640 1 --2- 172.21.15.50:0/3824439227 >> v2:172.21.15.77:3300/0 conn(0x7fe4a80ce4b0 0x7fe4a80ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fb87c22e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8741666e0 0x7fb874166b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fb87c22e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb87406edc0 0x7fb87406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fb87c22e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8741630f0 con 0x7fb874160790 2024-09-11T22:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fb87c22e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb874160b70 con 0x7fb87406edc0 2024-09-11T22:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fb87c22e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb874167180 con 0x7fb8741666e0 2024-09-11T22:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fe4ad6c4640 1 -- 172.21.15.50:0/3824439227 >> v2:172.21.15.77:3300/0 conn(0x7fe4a80ce4b0 msgr2=0x7fe4a80ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fe4ad6c4640 1 --2- 172.21.15.50:0/3824439227 >> v2:172.21.15.77:3300/0 conn(0x7fe4a80ce4b0 0x7fe4a80ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7f6435366640 1 Processor -- start 2024-09-11T22:11:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.769+0000 7f8fbf4a5640 1 -- start start 2024-09-11T22:11:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7f8fbf4a5640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb0036d00 0x7f8fb001dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7f8fbf4a5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8fb0033490 0x7f8fb00311c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7f8fbf4a5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb0033e10 con 0x7f8fb004eb90 2024-09-11T22:11:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7f8fbf4a5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8fb0033b30 con 0x7f8fb0033490 2024-09-11T22:11:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7f8fbf4a5640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb001d000 con 0x7f8fb0036d00 2024-09-11T22:11:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7f6435366640 1 -- start start 2024-09-11T22:11:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fb879fca640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb874160790 0x7fb874163b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41180/0 (socket says 172.21.15.50:41180) 2024-09-11T22:11:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fb879fca640 1 -- 172.21.15.50:0/2439352733 learned_addr learned my addr 172.21.15.50:0/2439352733 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.770+0000 7fb87a7cb640 1 --2- 172.21.15.50:0/2439352733 >> v2:172.21.15.50:3300/0 conn(0x7fb87406edc0 0x7fb87406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.771+0000 7fb8797c9640 1 --2- 172.21.15.50:0/2439352733 >> v2:172.21.15.77:3300/0 conn(0x7fb8741666e0 0x7fb874166b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.771+0000 7f03316e0640 1 Processor -- start 2024-09-11T22:11:23.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.771+0000 7fe49ffff640 1 -- 172.21.15.50:0/3824439227 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3964475461 0 0) 0x7fe4a80aeba0 con 0x7fe4a81602f0 2024-09-11T22:11:23.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.771+0000 7f03316e0640 1 -- start start 2024-09-11T22:11:23.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.771+0000 7fe4ad6c4640 1 -- 172.21.15.50:0/3824439227 >> v1:172.21.15.50:6789/0 conn(0x7fe4a81602f0 legacy=0x7fe4a8160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.771+0000 7fe4ad6c4640 1 -- 172.21.15.50:0/3824439227 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a80af160 con 0x7fe4a815ff10 2024-09-11T22:11:23.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.771+0000 7fbaa6ffd640 1 --2- 172.21.15.50:0/2286438467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaa8154ff0 0x7fbaa8074c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00097a0 tx=0x7fbaa002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e558b0efae31711e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7fb87a7cb640 1 -- 172.21.15.50:0/2439352733 >> v2:172.21.15.77:3300/0 conn(0x7fb8741666e0 msgr2=0x7fb874166b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f29fda82640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29f0036720 0x7f29f0006f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7fb87a7cb640 1 --2- 172.21.15.50:0/2439352733 >> v2:172.21.15.77:3300/0 conn(0x7fb8741666e0 0x7fb874166b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7fb87a7cb640 1 -- 172.21.15.50:0/2439352733 >> v1:172.21.15.50:6789/0 conn(0x7fb874160790 legacy=0x7fb874163b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7fb87a7cb640 1 -- 172.21.15.50:0/2439352733 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb874167460 con 0x7fb87406edc0 2024-09-11T22:11:23.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f29fda82640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29f0039240 0x7f29f00de1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f6435366640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6430162b40 0x7f6430167030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f6435366640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64300d18a0 0x7f64300d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f6435366640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64300cedd0 con 0x7f6430068510 2024-09-11T22:11:23.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f29fca80640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f29f00337f0 0x7f29f0036010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41190/0 (socket says 172.21.15.50:41190) 2024-09-11T22:11:23.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f29fca80640 1 -- 172.21.15.50:0/2241333078 learned_addr learned my addr 172.21.15.50:0/2241333078 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:23.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f29fda82640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f00397e0 con 0x7f29f00337f0 2024-09-11T22:11:23.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f29fda82640 1 -- 172.21.15.50:0/2241333078 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f29f00074c0 con 0x7f29f0036720 2024-09-11T22:11:23.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f29fda82640 1 -- 172.21.15.50:0/2241333078 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f29f003a3f0 con 0x7f29f0039240 2024-09-11T22:11:23.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f03316e0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0324036020 0x7f03240070c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f29f7fff640 1 --2- 172.21.15.50:0/2241333078 >> v2:172.21.15.50:3300/0 conn(0x7f29f0036720 0x7f29f0006f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f29fd281640 1 --2- 172.21.15.50:0/2241333078 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29f0039240 0x7f29f00de1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f03316e0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0324036400 0x7f0324036850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f03316e0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0324052280 con 0x7f03240e1ab0 2024-09-11T22:11:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f03316e0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0324054420 con 0x7f0324036020 2024-09-11T22:11:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f03316e0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f03240525b0 con 0x7f0324036400 2024-09-11T22:11:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.771+0000 7f8fbd241640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8fb004eb90 0x7f8fb004ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:58652/0 (socket says 172.21.15.50:58652) 2024-09-11T22:11:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.771+0000 7f8fbd241640 1 -- 172.21.15.50:0/4146281081 learned_addr learned my addr 172.21.15.50:0/4146281081 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.771+0000 7f8fbda42640 1 --2- 172.21.15.50:0/4146281081 >> v2:172.21.15.77:3300/0 conn(0x7f8fb0033490 0x7f8fb00311c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.771+0000 7f8faffff640 1 -- 172.21.15.50:0/4146281081 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2408914803 0 0) 0x7f8fb0033e10 con 0x7f8fb004eb90 2024-09-11T22:11:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.771+0000 7f8faffff640 1 -- 172.21.15.50:0/4146281081 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fa4003520 con 0x7f8fb004eb90 2024-09-11T22:11:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.771+0000 7f8fbca40640 1 --2- 172.21.15.50:0/4146281081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb0036d00 0x7f8fb001dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7fdcea991640 1 Processor -- start 2024-09-11T22:11:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f032b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f03240e1ab0 0x7f0324054cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41210/0 (socket says 172.21.15.50:41210) 2024-09-11T22:11:23.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f032b7fe640 1 -- 172.21.15.50:0/3951887572 learned_addr learned my addr 172.21.15.50:0/3951887572 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:23.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f6435366640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6430162f20 con 0x7f64300d18a0 2024-09-11T22:11:23.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7fdcea991640 1 -- start start 2024-09-11T22:11:23.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f6435366640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f64300d4230 con 0x7f6430162b40 2024-09-11T22:11:23.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f642effd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6430162b40 0x7f6430167030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f642effd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6430162b40 0x7f6430167030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47302/0 (socket says 172.21.15.50:47302) 2024-09-11T22:11:23.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f642effd640 1 -- 172.21.15.50:0/2662709412 learned_addr learned my addr 172.21.15.50:0/2662709412 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:23.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f642f7fe640 1 --2- 172.21.15.50:0/2662709412 >> v2:172.21.15.50:3300/0 conn(0x7f64300d18a0 0x7f64300d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f642effd640 1 -- 172.21.15.50:0/2662709412 >> v2:172.21.15.50:3300/0 conn(0x7f64300d18a0 msgr2=0x7f64300d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f642effd640 1 --2- 172.21.15.50:0/2662709412 >> v2:172.21.15.50:3300/0 conn(0x7f64300d18a0 0x7f64300d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7fbaa5ffb640 1 -- 172.21.15.50:0/2286438467 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0037070 con 0x7fbaa8154ff0 2024-09-11T22:11:23.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7fbaa5ffb640 1 -- 172.21.15.50:0/2286438467 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa0032440 con 0x7fbaa8154ff0 2024-09-11T22:11:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f0330edf640 1 --2- 172.21.15.50:0/3951887572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0324036400 0x7f0324036850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f29fd281640 1 -- 172.21.15.50:0/2241333078 >> v2:172.21.15.50:3300/0 conn(0x7f29f0036720 msgr2=0x7f29f0006f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f29fd281640 1 --2- 172.21.15.50:0/2241333078 >> v2:172.21.15.50:3300/0 conn(0x7f29f0036720 0x7f29f0006f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f29fd281640 1 -- 172.21.15.50:0/2241333078 >> v1:172.21.15.50:6789/0 conn(0x7f29f00337f0 legacy=0x7f29f0036010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f29fd281640 1 -- 172.21.15.50:0/2241333078 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f0039ac0 con 0x7f29f0039240 2024-09-11T22:11:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f29f7fff640 1 --2- 172.21.15.50:0/2241333078 >> v2:172.21.15.50:3300/0 conn(0x7f29f0036720 0x7f29f0006f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f642effd640 1 -- 172.21.15.50:0/2662709412 >> v1:172.21.15.50:6789/0 conn(0x7f6430068510 legacy=0x7f64300d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f642effd640 1 -- 172.21.15.50:0/2662709412 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64300cf090 con 0x7f6430162b40 2024-09-11T22:11:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f0330edf640 1 -- 172.21.15.50:0/3951887572 >> v2:172.21.15.77:3300/0 conn(0x7f0324036020 msgr2=0x7f03240070c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:11:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f0330edf640 1 --2- 172.21.15.50:0/3951887572 >> v2:172.21.15.77:3300/0 conn(0x7f0324036020 0x7f03240070c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f0330edf640 1 -- 172.21.15.50:0/3951887572 >> v1:172.21.15.50:6789/0 conn(0x7f03240e1ab0 legacy=0x7f0324054cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7f0330edf640 1 -- 172.21.15.50:0/3951887572 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0324053e60 con 0x7f0324036400 2024-09-11T22:11:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7fe4adec5640 1 --2- 172.21.15.50:0/3824439227 >> v2:172.21.15.77:3300/0 conn(0x7fe4a80ce4b0 0x7fe4a80ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7fe4ad6c4640 1 --2- 172.21.15.50:0/3824439227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a815ff10 0x7fe4a80ae160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009d90 tx=0x7fe4a002a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78542b0c5a5d9ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7fe49ffff640 1 -- 172.21.15.50:0/3824439227 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0007740 con 0x7fe4a815ff10 2024-09-11T22:11:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7fe49ffff640 1 -- 172.21.15.50:0/3824439227 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a00078e0 con 0x7fe4a815ff10 2024-09-11T22:11:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7fe49ffff640 1 -- 172.21.15.50:0/3824439227 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0007cb0 con 0x7fe4a815ff10 2024-09-11T22:11:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.773+0000 7fbaa5ffb640 1 -- 172.21.15.50:0/2286438467 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0032810 con 0x7fbaa8154ff0 2024-09-11T22:11:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f8fbda42640 1 -- 172.21.15.50:0/4146281081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb0036d00 msgr2=0x7f8fb001dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f8fbda42640 1 --2- 172.21.15.50:0/4146281081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb0036d00 0x7f8fb001dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f8fbda42640 1 -- 172.21.15.50:0/4146281081 >> v1:172.21.15.77:6789/0 conn(0x7f8fb004eb90 legacy=0x7f8fb004ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f8fbda42640 1 -- 172.21.15.50:0/4146281081 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb001d2e0 con 0x7f8fb0033490 2024-09-11T22:11:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.772+0000 7f8fbca40640 1 --2- 172.21.15.50:0/4146281081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb0036d00 0x7f8fb001dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fb87a7cb640 1 --2- 172.21.15.50:0/2439352733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb87406edc0 0x7fb87406f1c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb874073860 tx=0x7fb87002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e564c066ddab4be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fbaa7fff640 1 -- 172.21.15.50:0/2286438467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaa8154ff0 msgr2=0x7fbaa8074c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fbaa7fff640 1 --2- 172.21.15.50:0/2286438467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaa8154ff0 0x7fbaa8074c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00097a0 tx=0x7fbaa002a230 comp rx=0 tx=0).stop 2024-09-11T22:11:23.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fbaa7fff640 1 -- 172.21.15.50:0/2286438467 shutdown_connections 2024-09-11T22:11:23.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fbaa7fff640 1 --2- 172.21.15.50:0/2286438467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa806f930 0x7fbaa806fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fbaa7fff640 1 --2- 172.21.15.50:0/2286438467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaa8154ff0 0x7fbaa8074c40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fbaa7fff640 1 -- 172.21.15.50:0/2286438467 >> 172.21.15.50:0/2286438467 conn(0x7fbaa80b09f0 msgr2=0x7fbaa80b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7f29fd281640 1 --2- 172.21.15.50:0/2241333078 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29f0039240 0x7f29f00de1e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0097a0 tx=0x7f29ec02e5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49a2f2952b3db033 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7f8fbda42640 1 --2- 172.21.15.50:0/4146281081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb0033490 0x7f8fb00311c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80097a0 tx=0x7f8fa802a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48828713c0db571c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fbaa7fff640 1 -- 172.21.15.50:0/2286438467 shutdown_connections 2024-09-11T22:11:23.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fdcea991640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdce406f390 0x7fdce40b3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fdcea991640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdce40b3880 0x7fdce40cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fe4af928640 1 -- 172.21.15.50:0/3824439227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a815ff10 msgr2=0x7fe4a80ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fe4af928640 1 --2- 172.21.15.50:0/3824439227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a815ff10 0x7fe4a80ae160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009d90 tx=0x7fe4a002a5f0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7f29f77fe640 1 -- 172.21.15.50:0/2241333078 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec03a070 con 0x7f29f0039240 2024-09-11T22:11:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7f29f77fe640 1 -- 172.21.15.50:0/2241333078 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ec033710 con 0x7f29f0039240 2024-09-11T22:11:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7f29f77fe640 1 -- 172.21.15.50:0/2241333078 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec033ae0 con 0x7f29f0039240 2024-09-11T22:11:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7f642effd640 1 --2- 172.21.15.50:0/2662709412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6430162b40 0x7f6430167030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6420009870 tx=0x7f642002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0c338f61e97af53 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fdcea991640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce415bb40 con 0x7fdce415b430 2024-09-11T22:11:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fb878fc8640 1 -- 172.21.15.50:0/2439352733 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870037070 con 0x7fb87406edc0 2024-09-11T22:11:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fb878fc8640 1 -- 172.21.15.50:0/2439352733 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb870032440 con 0x7fb87406edc0 2024-09-11T22:11:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fb878fc8640 1 -- 172.21.15.50:0/2439352733 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870032810 con 0x7fb87406edc0 2024-09-11T22:11:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fe4af928640 1 -- 172.21.15.50:0/3824439227 shutdown_connections 2024-09-11T22:11:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fe4af928640 1 --2- 172.21.15.50:0/3824439227 >> v2:172.21.15.77:3300/0 conn(0x7fe4a80ce4b0 0x7fe4a80ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fe4af928640 1 --2- 172.21.15.50:0/3824439227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a815ff10 0x7fe4a80ae160 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fe4af928640 1 -- 172.21.15.50:0/3824439227 >> 172.21.15.50:0/3824439227 conn(0x7fe4a8067ff0 msgr2=0x7fe4a80b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fbaa7fff640 1 -- 172.21.15.50:0/2286438467 wait complete. 2024-09-11T22:11:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fdcea991640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fdce415c750 con 0x7fdce40b3880 2024-09-11T22:11:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fdce8f2e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdce40b3880 0x7fdce40cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7f8faffff640 1 -- 172.21.15.50:0/4146281081 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8037070 con 0x7f8fb0033490 2024-09-11T22:11:23.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7f8faffff640 1 -- 172.21.15.50:0/4146281081 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa802ae40 con 0x7f8fb0033490 2024-09-11T22:11:23.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7f8faffff640 1 -- 172.21.15.50:0/4146281081 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8032660 con 0x7f8fb0033490 2024-09-11T22:11:23.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7f0330edf640 1 --2- 172.21.15.50:0/3951887572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0324036400 0x7f0324036850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f03180097a0 tx=0x7f031802a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b2a60d1e9ccc667 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.774+0000 7fdce3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdce415b430 0x7fdce415f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:58668/0 (socket says 172.21.15.50:58668) 2024-09-11T22:11:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7f642dffb640 1 -- 172.21.15.50:0/2662709412 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420037070 con 0x7f6430162b40 2024-09-11T22:11:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7f642dffb640 1 -- 172.21.15.50:0/2662709412 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6420032440 con 0x7f6430162b40 2024-09-11T22:11:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7f642dffb640 1 -- 172.21.15.50:0/2662709412 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420037070 con 0x7f6430162b40 2024-09-11T22:11:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7fdcea991640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdce415be20 con 0x7fdce406f390 2024-09-11T22:11:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7fdce3fff640 1 -- 172.21.15.50:0/2657868178 learned_addr learned my addr 172.21.15.50:0/2657868178 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7fdce37fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdce406f390 0x7fdce40b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7f29fda82640 1 -- 172.21.15.50:0/2241333078 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29f0039240 msgr2=0x7f29f00de1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7f29fda82640 1 --2- 172.21.15.50:0/2241333078 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29f0039240 0x7f29f00de1e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0097a0 tx=0x7f29ec02e5d0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7fdce8f2e640 1 -- 172.21.15.50:0/2657868178 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdce406f390 msgr2=0x7fdce40b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:23.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7f29fda82640 1 -- 172.21.15.50:0/2241333078 shutdown_connections 2024-09-11T22:11:23.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7f29fda82640 1 --2- 172.21.15.50:0/2241333078 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29f0039240 0x7f29f00de1e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7f29fda82640 1 --2- 172.21.15.50:0/2241333078 >> v2:172.21.15.50:3300/0 conn(0x7f29f0036720 0x7f29f0006f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7f29fda82640 1 -- 172.21.15.50:0/2241333078 >> 172.21.15.50:0/2241333078 conn(0x7f29f001d920 msgr2=0x7f29f0054590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7fdce8f2e640 1 --2- 172.21.15.50:0/2657868178 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdce406f390 0x7fdce40b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7fdce8f2e640 1 -- 172.21.15.50:0/2657868178 >> v1:172.21.15.77:6789/0 conn(0x7fdce415b430 legacy=0x7fdce415f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7fdce8f2e640 1 -- 172.21.15.50:0/2657868178 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce415c100 con 0x7fdce40b3880 2024-09-11T22:11:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7fb87c22e640 1 -- 172.21.15.50:0/2439352733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb87406edc0 msgr2=0x7fb87406f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7fb87c22e640 1 --2- 172.21.15.50:0/2439352733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb87406edc0 0x7fb87406f1c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb874073860 tx=0x7fb87002a1a0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7f032affd640 1 -- 172.21.15.50:0/3951887572 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0318037070 con 0x7f0324036400 2024-09-11T22:11:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7f032affd640 1 -- 172.21.15.50:0/3951887572 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0318032440 con 0x7f0324036400 2024-09-11T22:11:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7f032affd640 1 -- 172.21.15.50:0/3951887572 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0318032850 con 0x7f0324036400 2024-09-11T22:11:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.775+0000 7fe4af928640 1 -- 172.21.15.50:0/3824439227 shutdown_connections 2024-09-11T22:11:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7fe4af928640 1 -- 172.21.15.50:0/3824439227 wait complete. 2024-09-11T22:11:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f6435366640 1 -- 172.21.15.50:0/2662709412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6430162b40 msgr2=0x7f6430167030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f6435366640 1 --2- 172.21.15.50:0/2662709412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6430162b40 0x7f6430167030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6420009870 tx=0x7f642002a210 comp rx=0 tx=0).stop 2024-09-11T22:11:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f6435366640 1 -- 172.21.15.50:0/2662709412 shutdown_connections 2024-09-11T22:11:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f6435366640 1 --2- 172.21.15.50:0/2662709412 >> v2:172.21.15.50:3300/0 conn(0x7f64300d18a0 0x7f64300d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f6435366640 1 --2- 172.21.15.50:0/2662709412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6430162b40 0x7f6430167030 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f6435366640 1 -- 172.21.15.50:0/2662709412 >> 172.21.15.50:0/2662709412 conn(0x7f64300727a0 msgr2=0x7f64300679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7fb87c22e640 1 -- 172.21.15.50:0/2439352733 shutdown_connections 2024-09-11T22:11:23.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7fb87c22e640 1 --2- 172.21.15.50:0/2439352733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb87406edc0 0x7fb87406f1c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7fb87c22e640 1 --2- 172.21.15.50:0/2439352733 >> v2:172.21.15.77:3300/0 conn(0x7fb8741666e0 0x7fb874166b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7fb87c22e640 1 -- 172.21.15.50:0/2439352733 >> 172.21.15.50:0/2439352733 conn(0x7fb8740b2100 msgr2=0x7fb8740b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7fbaa7fff640 1 Processor -- start 2024-09-11T22:11:23.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7fbaa7fff640 1 -- start start 2024-09-11T22:11:23.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f29fda82640 1 -- 172.21.15.50:0/2241333078 shutdown_connections 2024-09-11T22:11:23.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f29fda82640 1 -- 172.21.15.50:0/2241333078 wait complete. 2024-09-11T22:11:23.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f8fbf4a5640 1 -- 172.21.15.50:0/4146281081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb0033490 msgr2=0x7f8fb00311c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f8fbf4a5640 1 --2- 172.21.15.50:0/4146281081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb0033490 0x7f8fb00311c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80097a0 tx=0x7f8fa802a0f0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f03316e0640 1 -- 172.21.15.50:0/3951887572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0324036400 msgr2=0x7f0324036850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f03316e0640 1 --2- 172.21.15.50:0/3951887572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0324036400 0x7f0324036850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f03180097a0 tx=0x7f031802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f6435366640 1 -- 172.21.15.50:0/2662709412 shutdown_connections 2024-09-11T22:11:23.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f03316e0640 1 -- 172.21.15.50:0/3951887572 shutdown_connections 2024-09-11T22:11:23.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f03316e0640 1 --2- 172.21.15.50:0/3951887572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0324036400 0x7f0324036850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f03316e0640 1 --2- 172.21.15.50:0/3951887572 >> v2:172.21.15.77:3300/0 conn(0x7f0324036020 0x7f03240070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f03316e0640 1 -- 172.21.15.50:0/3951887572 >> 172.21.15.50:0/3951887572 conn(0x7f032401d930 msgr2=0x7f03240545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f8fbf4a5640 1 -- 172.21.15.50:0/4146281081 shutdown_connections 2024-09-11T22:11:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f8fbf4a5640 1 --2- 172.21.15.50:0/4146281081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb0033490 0x7f8fb00311c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7fdce37fe640 1 --2- 172.21.15.50:0/2657868178 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdce406f390 0x7fdce40b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f8fbf4a5640 1 --2- 172.21.15.50:0/4146281081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb0036d00 0x7f8fb001dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.777+0000 7f8fbf4a5640 1 -- 172.21.15.50:0/4146281081 >> 172.21.15.50:0/4146281081 conn(0x7f8fb00360c0 msgr2=0x7f8fb00364d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7fb87c22e640 1 -- 172.21.15.50:0/2439352733 shutdown_connections 2024-09-11T22:11:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7fb87c22e640 1 -- 172.21.15.50:0/2439352733 wait complete. 2024-09-11T22:11:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.777+0000 7fdce8f2e640 1 --2- 172.21.15.50:0/2657868178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdce40b3880 0x7fdce40cf740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009d90 tx=0x7fdcdc02a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb2285f262893074 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.776+0000 7f6435366640 1 -- 172.21.15.50:0/2662709412 wait complete. 2024-09-11T22:11:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.777+0000 7fdce2ffd640 1 -- 172.21.15.50:0/2657868178 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc007740 con 0x7fdce40b3880 2024-09-11T22:11:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.777+0000 7fdce2ffd640 1 -- 172.21.15.50:0/2657868178 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcdc0078e0 con 0x7fdce40b3880 2024-09-11T22:11:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.777+0000 7fdce2ffd640 1 -- 172.21.15.50:0/2657868178 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc007740 con 0x7fdce40b3880 2024-09-11T22:11:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.777+0000 7f03316e0640 1 -- 172.21.15.50:0/3951887572 shutdown_connections 2024-09-11T22:11:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.777+0000 7f03316e0640 1 -- 172.21.15.50:0/3951887572 wait complete. 2024-09-11T22:11:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.777+0000 7f8fbf4a5640 1 -- 172.21.15.50:0/4146281081 shutdown_connections 2024-09-11T22:11:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.777+0000 7fbaa7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaa806f930 0x7fbaa8156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7f8fbf4a5640 1 -- 172.21.15.50:0/4146281081 wait complete. 2024-09-11T22:11:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7fe4af928640 1 Processor -- start 2024-09-11T22:11:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7fe4af928640 1 -- start start 2024-09-11T22:11:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7f29fda82640 1 Processor -- start 2024-09-11T22:11:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7fbaa6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaa806f930 0x7fbaa8156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7fbaa6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaa806f930 0x7fbaa8156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46426/0 (socket says 172.21.15.50:46426) 2024-09-11T22:11:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7fbaa6ffd640 1 -- 172.21.15.50:0/1056154526 learned_addr learned my addr 172.21.15.50:0/1056154526 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7fbaa7fff640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa80b5780 0x7fbaa815cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7f29fda82640 1 -- start start 2024-09-11T22:11:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7fdcea991640 1 -- 172.21.15.50:0/2657868178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdce40b3880 msgr2=0x7fdce40cf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7fdcea991640 1 --2- 172.21.15.50:0/2657868178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdce40b3880 0x7fdce40cf740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009d90 tx=0x7fdcdc02a6a0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7f6435366640 1 Processor -- start 2024-09-11T22:11:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7fb87c22e640 1 Processor -- start 2024-09-11T22:11:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7fb87c22e640 1 -- start start 2024-09-11T22:11:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7fbaa7fff640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa8154ff0 0x7fbaa815d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7f6435366640 1 -- start start 2024-09-11T22:11:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.778+0000 7fbaa67fc640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa80b5780 0x7fbaa815cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fbaa77fe640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa8154ff0 0x7fbaa815d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fbaa7fff640 1 -- 172.21.15.50:0/1056154526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa8075180 con 0x7fbaa806f930 2024-09-11T22:11:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fb87c22e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb87406edc0 0x7fb8741f98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fbaa7fff640 1 -- 172.21.15.50:0/1056154526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81553d0 con 0x7fbaa8154ff0 2024-09-11T22:11:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fb87c22e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb874160790 0x7fb8741586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fb87c22e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8741666e0 0x7fb874165bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fbaa7fff640 1 -- 172.21.15.50:0/1056154526 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa8075300 con 0x7fbaa80b5780 2024-09-11T22:11:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fb87c22e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb8740d0090 con 0x7fb874160790 2024-09-11T22:11:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7f03316e0640 1 Processor -- start 2024-09-11T22:11:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fb87c22e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb874163650 con 0x7fb8741666e0 2024-09-11T22:11:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fb87c22e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb87406f700 con 0x7fb87406edc0 2024-09-11T22:11:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fb879fca640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb87406edc0 0x7fb8741f98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fb8797c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb874160790 0x7fb8741586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fb879fca640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb87406edc0 0x7fb8741f98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47362/0 (socket says 172.21.15.50:47362) 2024-09-11T22:11:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fb879fca640 1 -- 172.21.15.50:0/1071559760 learned_addr learned my addr 172.21.15.50:0/1071559760 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fb87a7cb640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8741666e0 0x7fb874165bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7fe4af928640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4a80ce4b0 0x7fe4a80b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fb87a7cb640 1 -- 172.21.15.50:0/1071559760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb87406edc0 msgr2=0x7fb8741f98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fb87a7cb640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb87406edc0 0x7fb8741f98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fb87a7cb640 1 -- 172.21.15.50:0/1071559760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb874160790 msgr2=0x7fb8741586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f29fda82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29f00337f0 0x7f29f00d7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fb87a7cb640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb874160790 0x7fb8741586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fb87a7cb640 1 -- 172.21.15.50:0/1071559760 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8741f9e10 con 0x7fb8741666e0 2024-09-11T22:11:23.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f8fbf4a5640 1 Processor -- start 2024-09-11T22:11:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fe4ad6c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4a80ce4b0 0x7fe4a80b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f29fda82640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29f0036720 0x7f29f00d8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fe4ad6c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4a80ce4b0 0x7fe4a80b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46452/0 (socket says 172.21.15.50:46452) 2024-09-11T22:11:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f6435366640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6430068510 0x7f64301630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fb8797c9640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb874160790 0x7fb8741586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fdcea991640 1 -- 172.21.15.50:0/2657868178 shutdown_connections 2024-09-11T22:11:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fe4ad6c4640 1 -- 172.21.15.50:0/4291915696 learned_addr learned my addr 172.21.15.50:0/4291915696 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f29fca80640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29f00337f0 0x7f29f00d7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f29fca80640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29f00337f0 0x7f29f00d7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54634/0 (socket says 172.21.15.50:54634) 2024-09-11T22:11:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f29fca80640 1 -- 172.21.15.50:0/2656259027 learned_addr learned my addr 172.21.15.50:0/2656259027 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fdcea991640 1 --2- 172.21.15.50:0/2657868178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdce40b3880 0x7fdce40cf740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fe4af928640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4a815ff10 0x7fe4a8071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fdcea991640 1 --2- 172.21.15.50:0/2657868178 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdce406f390 0x7fdce40b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fe4af928640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a81602f0 0x7fe4a8148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fdcea991640 1 -- 172.21.15.50:0/2657868178 >> 172.21.15.50:0/2657868178 conn(0x7fdce4074c40 msgr2=0x7fdce4075020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f6435366640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64300d18a0 0x7f64300ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fe4af928640 1 -- 172.21.15.50:0/4291915696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a80afc40 con 0x7fe4a80ce4b0 2024-09-11T22:11:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f29fda82640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29f0039240 0x7f29f00db570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f6435366640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6430162b40 0x7f64300cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fe4af928640 1 -- 172.21.15.50:0/4291915696 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a80ae6a0 con 0x7fe4a815ff10 2024-09-11T22:11:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fe4af928640 1 -- 172.21.15.50:0/4291915696 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a80afdc0 con 0x7fe4a81602f0 2024-09-11T22:11:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f8fbf4a5640 1 -- start start 2024-09-11T22:11:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f6435366640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f64300cf7d0 con 0x7f6430068510 2024-09-11T22:11:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f29fda82640 1 -- 172.21.15.50:0/2656259027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29f0033bd0 con 0x7f29f0036720 2024-09-11T22:11:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f29fd281640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29f0039240 0x7f29f00db570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f29f7fff640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29f0036720 0x7f29f00d8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f6435366640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f64300cf650 con 0x7f6430162b40 2024-09-11T22:11:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fdcea991640 1 -- 172.21.15.50:0/2657868178 shutdown_connections 2024-09-11T22:11:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f6435366640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f64300b75d0 con 0x7f64300d18a0 2024-09-11T22:11:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f642f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6430162b40 0x7f64300cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f642effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6430068510 0x7f64301630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f642f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6430162b40 0x7f64300cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54642/0 (socket says 172.21.15.50:54642) 2024-09-11T22:11:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f642f7fe640 1 -- 172.21.15.50:0/1358016135 learned_addr learned my addr 172.21.15.50:0/1358016135 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7fdcea991640 1 -- 172.21.15.50:0/2657868178 wait complete. 2024-09-11T22:11:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f29fda82640 1 -- 172.21.15.50:0/2656259027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29f003a080 con 0x7f29f00337f0 2024-09-11T22:11:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.780+0000 7f29fda82640 1 -- 172.21.15.50:0/2656259027 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f29f0054ca0 con 0x7f29f0039240 2024-09-11T22:11:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f642e7fc640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64300d18a0 0x7f64300ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7fb87a7cb640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8741666e0 0x7fb874165bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb870031000 tx=0x7fb8700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7fe4ad6c4640 1 -- 172.21.15.50:0/4291915696 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a81602f0 msgr2=0x7fe4a8148d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:11:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.779+0000 7f03316e0640 1 -- start start 2024-09-11T22:11:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7fe4ad6c4640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a81602f0 0x7fe4a8148d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7fb86a7fc640 1 -- 172.21.15.50:0/1071559760 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870037050 con 0x7fb8741666e0 2024-09-11T22:11:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f03316e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0324036020 0x7f03240d2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f03316e0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0324036400 0x7f032404bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f03316e0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03240e1ab0 0x7f032404c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f03316e0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f03240553c0 con 0x7f0324036400 2024-09-11T22:11:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f03316e0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f03240e1730 con 0x7f0324036020 2024-09-11T22:11:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f03316e0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f03240e1ed0 con 0x7f03240e1ab0 2024-09-11T22:11:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f032b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0324036400 0x7f032404bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f8fbf4a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb0033490 0x7f8fb00e9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f032b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0324036400 0x7f032404bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46476/0 (socket says 172.21.15.50:46476) 2024-09-11T22:11:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f032b7fe640 1 -- 172.21.15.50:0/2308040261 learned_addr learned my addr 172.21.15.50:0/2308040261 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f032bfff640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0324036020 0x7f03240d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f29fca80640 1 -- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29f0039240 msgr2=0x7f29f00db570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f29fca80640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29f0039240 0x7f29f00db570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f29fca80640 1 -- 172.21.15.50:0/2656259027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29f0036720 msgr2=0x7f29f00d8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f29fca80640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29f0036720 0x7f29f00d8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f29fca80640 1 -- 172.21.15.50:0/2656259027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f004e830 con 0x7f29f00337f0 2024-09-11T22:11:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f0330edf640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03240e1ab0 0x7f032404c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f8fbf4a5640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb0036d00 0x7f8fb00e4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f8fbd241640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb0033490 0x7f8fb00e9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f8fbd241640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb0033490 0x7f8fb00e9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54676/0 (socket says 172.21.15.50:54676) 2024-09-11T22:11:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f8fbd241640 1 -- 172.21.15.50:0/3454215139 learned_addr learned my addr 172.21.15.50:0/3454215139 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f8fbf4a5640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fb004eb90 0x7f8fb00ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f8fbf4a5640 1 -- 172.21.15.50:0/3454215139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb00e72f0 con 0x7f8fb004eb90 2024-09-11T22:11:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f8fbf4a5640 1 -- 172.21.15.50:0/3454215139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb00e7170 con 0x7f8fb0033490 2024-09-11T22:11:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f8fbf4a5640 1 -- 172.21.15.50:0/3454215139 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb00072c0 con 0x7f8fb0036d00 2024-09-11T22:11:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f642effd640 1 -- 172.21.15.50:0/1358016135 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64300d18a0 msgr2=0x7f64300ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f8fbca40640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb0036d00 0x7f8fb00e4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7fe4acec3640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4a815ff10 0x7fe4a8071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f032b7fe640 1 -- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03240e1ab0 msgr2=0x7f032404c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f032b7fe640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03240e1ab0 0x7f032404c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f032b7fe640 1 -- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0324036020 msgr2=0x7f03240d2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f032b7fe640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0324036020 0x7f03240d2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f032b7fe640 1 -- 172.21.15.50:0/2308040261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03240dd680 con 0x7f0324036400 2024-09-11T22:11:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f29fca80640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29f00337f0 0x7f29f00d7e80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f29f80504d0 tx=0x7f29f80697c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7f642effd640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64300d18a0 0x7f64300ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f642effd640 1 -- 172.21.15.50:0/1358016135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6430162b40 msgr2=0x7f64300cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f642effd640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6430162b40 0x7f64300cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f642effd640 1 -- 172.21.15.50:0/1358016135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64300ce360 con 0x7f6430068510 2024-09-11T22:11:23.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7fe4ad6c4640 1 -- 172.21.15.50:0/4291915696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4a815ff10 msgr2=0x7fe4a8071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f642f7fe640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6430162b40 0x7f64300cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:23.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7fe4ad6c4640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4a815ff10 0x7fe4a8071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f8fbd241640 1 -- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb0036d00 msgr2=0x7f8fb00e4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f8fbd241640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb0036d00 0x7f8fb00e4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f8fbd241640 1 -- 172.21.15.50:0/3454215139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fb004eb90 msgr2=0x7f8fb00ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f8fbd241640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fb004eb90 0x7f8fb00ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f29f57fa640 1 -- 172.21.15.50:0/2656259027 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8090070 con 0x7f29f00337f0 2024-09-11T22:11:23.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f8fbd241640 1 -- 172.21.15.50:0/3454215139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb00cebe0 con 0x7f8fb0033490 2024-09-11T22:11:23.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7fe4ad6c4640 1 -- 172.21.15.50:0/4291915696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a814a430 con 0x7fe4a80ce4b0 2024-09-11T22:11:23.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7fe4acec3640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4a815ff10 0x7fe4a8071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:23.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f032b7fe640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0324036400 0x7f032404bfa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f032000c460 tx=0x7f032000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f29f57fa640 1 -- 172.21.15.50:0/2656259027 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f806a0d0 con 0x7f29f00337f0 2024-09-11T22:11:23.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f29fda82640 1 -- 172.21.15.50:0/2656259027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f004e270 con 0x7f29f00337f0 2024-09-11T22:11:23.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f642effd640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6430068510 0x7f64301630a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6420031000 tx=0x7f64200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f29fda82640 1 -- 172.21.15.50:0/2656259027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f00db050 con 0x7f29f00337f0 2024-09-11T22:11:23.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f64177fe640 1 -- 172.21.15.50:0/1358016135 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420042070 con 0x7f6430068510 2024-09-11T22:11:23.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7fe4ad6c4640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4a80ce4b0 0x7fe4a80b0480 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009d90 tx=0x7fe4a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7fdcea991640 1 Processor -- start 2024-09-11T22:11:23.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7f6435366640 1 -- 172.21.15.50:0/1358016135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64300ce640 con 0x7f6430068510 2024-09-11T22:11:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7f8fbd241640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb0033490 0x7f8fb00e9e60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8fb802dd50 tx=0x7f8fb80697c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7f6435366640 1 -- 172.21.15.50:0/1358016135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64300c9f60 con 0x7f6430068510 2024-09-11T22:11:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7f0328ff9640 1 -- 172.21.15.50:0/2308040261 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0320005ce0 con 0x7f0324036400 2024-09-11T22:11:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.781+0000 7fb86a7fc640 1 -- 172.21.15.50:0/1071559760 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb870038040 con 0x7fb8741666e0 2024-09-11T22:11:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7fb87c22e640 1 -- 172.21.15.50:0/1071559760 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8741f8c80 con 0x7fb8741666e0 2024-09-11T22:11:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7fb87c22e640 1 -- 172.21.15.50:0/1071559760 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8741f9240 con 0x7fb8741666e0 2024-09-11T22:11:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7fdcea991640 1 -- start start 2024-09-11T22:11:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7fbaa6ffd640 1 -- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa80b5780 msgr2=0x7fbaa815cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7fbaa6ffd640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa80b5780 0x7fbaa815cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7fbaa6ffd640 1 -- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa8154ff0 msgr2=0x7fbaa815d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7fbaa6ffd640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa8154ff0 0x7fbaa815d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.782+0000 7fbaa6ffd640 1 -- 172.21.15.50:0/1056154526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa815c1a0 con 0x7fbaa806f930 2024-09-11T22:11:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7fbaa6ffd640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaa806f930 0x7fbaa8156180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbaa002a820 tx=0x7fbaa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7fbaa77fe640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa8154ff0 0x7fbaa815d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7f03316e0640 1 -- 172.21.15.50:0/2308040261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03240dd960 con 0x7f0324036400 2024-09-11T22:11:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7f03316e0640 1 -- 172.21.15.50:0/2308040261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03240df4e0 con 0x7f0324036400 2024-09-11T22:11:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7f8fadffb640 1 -- 172.21.15.50:0/3454215139 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8090070 con 0x7f8fb0033490 2024-09-11T22:11:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7fba9f7fe640 1 -- 172.21.15.50:0/1056154526 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0040020 con 0x7fbaa806f930 2024-09-11T22:11:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7fb86a7fc640 1 -- 172.21.15.50:0/1071559760 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870037050 con 0x7fb8741666e0 2024-09-11T22:11:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7f0328ff9640 1 -- 172.21.15.50:0/2308040261 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0320007070 con 0x7f0324036400 2024-09-11T22:11:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7f0328ff9640 1 -- 172.21.15.50:0/2308040261 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0320007460 con 0x7f0324036400 2024-09-11T22:11:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7fba9f7fe640 1 -- 172.21.15.50:0/1056154526 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa0038040 con 0x7fbaa806f930 2024-09-11T22:11:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7fbaa7fff640 1 -- 172.21.15.50:0/1056154526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa815c480 con 0x7fbaa806f930 2024-09-11T22:11:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7fbaa7fff640 1 -- 172.21.15.50:0/1056154526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa815ca40 con 0x7fbaa806f930 2024-09-11T22:11:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.784+0000 7fba9f7fe640 1 -- 172.21.15.50:0/1056154526 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0037070 con 0x7fbaa806f930 2024-09-11T22:11:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7f8fadffb640 1 -- 172.21.15.50:0/3454215139 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb8068f90 con 0x7f8fb0033490 2024-09-11T22:11:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7f8fbf4a5640 1 -- 172.21.15.50:0/3454215139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb000ba20 con 0x7f8fb0033490 2024-09-11T22:11:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.784+0000 7f8fbf4a5640 1 -- 172.21.15.50:0/3454215139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb00e7c50 con 0x7f8fb0033490 2024-09-11T22:11:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.784+0000 7fe49dffb640 1 -- 172.21.15.50:0/4291915696 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0040070 con 0x7fe4a80ce4b0 2024-09-11T22:11:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.784+0000 7fe4af928640 1 -- 172.21.15.50:0/4291915696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a814a710 con 0x7fe4a80ce4b0 2024-09-11T22:11:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.784+0000 7fdcea991640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdce406f390 0x7fdce41504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.784+0000 7fdcea991640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdce40b3880 0x7fdce4068490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.784+0000 7fdcea991640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415b430 0x7fdce4072390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.785+0000 7fdce37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdce40b3880 0x7fdce4068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.785+0000 7fdce37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdce40b3880 0x7fdce4068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54690/0 (socket says 172.21.15.50:54690) 2024-09-11T22:11:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.785+0000 7fdce37fe640 1 -- 172.21.15.50:0/3126701819 learned_addr learned my addr 172.21.15.50:0/3126701819 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.785+0000 7fdcea991640 1 -- 172.21.15.50:0/3126701819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdce40cfc80 con 0x7fdce415b430 2024-09-11T22:11:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.785+0000 7fdcea991640 1 -- 172.21.15.50:0/3126701819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdce415b810 con 0x7fdce40b3880 2024-09-11T22:11:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.785+0000 7fdcea991640 1 -- 172.21.15.50:0/3126701819 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdce40cfe00 con 0x7fdce406f390 2024-09-11T22:11:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.785+0000 7fe4af928640 1 -- 172.21.15.50:0/4291915696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a80b1e30 con 0x7fe4a80ce4b0 2024-09-11T22:11:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.785+0000 7fe49dffb640 1 -- 172.21.15.50:0/4291915696 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a0031d00 con 0x7fe4a80ce4b0 2024-09-11T22:11:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.785+0000 7fe49dffb640 1 -- 172.21.15.50:0/4291915696 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00456a0 con 0x7fe4a80ce4b0 2024-09-11T22:11:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.784+0000 7f29f57fa640 1 -- 172.21.15.50:0/2656259027 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f80945b0 con 0x7f29f00337f0 2024-09-11T22:11:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.785+0000 7f29f57fa640 1 -- 172.21.15.50:0/2656259027 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29f8093070 con 0x7f29f00337f0 2024-09-11T22:11:23.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.783+0000 7f64177fe640 1 -- 172.21.15.50:0/1358016135 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6420030790 con 0x7f6430068510 2024-09-11T22:11:23.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.784+0000 7f64177fe640 1 -- 172.21.15.50:0/1358016135 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420037070 con 0x7f6430068510 2024-09-11T22:11:23.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.784+0000 7f64157fa640 1 -- 172.21.15.50:0/1358016135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6430167030 con 0x7f6430068510 2024-09-11T22:11:23.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.785+0000 7f8fadffb640 1 -- 172.21.15.50:0/3454215139 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb80943b0 con 0x7f8fb0033490 2024-09-11T22:11:23.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7f29f57fa640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29e406bf00 0x7f29e406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7fdce37fe640 1 -- 172.21.15.50:0/3126701819 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdce406f390 msgr2=0x7fdce41504c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:11:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7fdce37fe640 1 --2- 172.21.15.50:0/3126701819 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdce406f390 0x7fdce41504c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7fdce37fe640 1 -- 172.21.15.50:0/3126701819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415b430 msgr2=0x7fdce4072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7fdce37fe640 1 --2- 172.21.15.50:0/3126701819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdce415b430 0x7fdce4072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7fdce37fe640 1 -- 172.21.15.50:0/3126701819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce41417a0 con 0x7fdce40b3880 2024-09-11T22:11:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.785+0000 7fb87c22e640 1 -- 172.21.15.50:0/1071559760 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb87406f1c0 con 0x7fb8741666e0 2024-09-11T22:11:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7fb86a7fc640 1 -- 172.21.15.50:0/1071559760 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb87003c910 con 0x7fb8741666e0 2024-09-11T22:11:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7f29f7fff640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29e406bf00 0x7f29e406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7f8fa37fe640 1 -- 172.21.15.50:0/3454215139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8fb001dae0 con 0x7f8fb0033490 2024-09-11T22:11:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7fbaa7fff640 1 -- 172.21.15.50:0/1056154526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fba8c001030 con 0x7fbaa806f930 2024-09-11T22:11:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7fdce37fe640 1 --2- 172.21.15.50:0/3126701819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdce40b3880 0x7fdce4068490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00c7b0 tx=0x7fdccc00cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7f29f57fa640 1 -- 172.21.15.50:0/2656259027 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f29f8106740 con 0x7f29f00337f0 2024-09-11T22:11:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7fb86a7fc640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb85806c030 0x7fb85806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.787+0000 7f29f7fff640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29e406bf00 0x7f29e406e3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f29f0032ba0 tx=0x7f29e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7fdce0ff9640 1 -- 172.21.15.50:0/3126701819 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc015070 con 0x7fdce40b3880 2024-09-11T22:11:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7fdce0ff9640 1 -- 172.21.15.50:0/3126701819 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdccc00aac0 con 0x7fdce40b3880 2024-09-11T22:11:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7fe4af928640 1 -- 172.21.15.50:0/4291915696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe4a80b0ab0 con 0x7fe4a80ce4b0 2024-09-11T22:11:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.787+0000 7fb86a7fc640 1 -- 172.21.15.50:0/1071559760 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb8700ab380 con 0x7fb8741666e0 2024-09-11T22:11:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.787+0000 7fdce0ff9640 1 -- 172.21.15.50:0/3126701819 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc0113f0 con 0x7fdce40b3880 2024-09-11T22:11:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.787+0000 7fb86a7fc640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] conn(0x7fb8580741d0 0x7fb8580765f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.787+0000 7fb86a7fc640 1 -- 172.21.15.50:0/1071559760 --> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb858076ca0 con 0x7fb8580741d0 2024-09-11T22:11:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.787+0000 7fb86a7fc640 1 -- 172.21.15.50:0/1071559760 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb8700b2050 con 0x7fb8741666e0 2024-09-11T22:11:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.787+0000 7fb879fca640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb85806c030 0x7fb85806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.786+0000 7f03316e0640 1 -- 172.21.15.50:0/2308040261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f030c001030 con 0x7f0324036400 2024-09-11T22:11:23.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.787+0000 7fb8797c9640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] conn(0x7fb8580741d0 0x7fb8580765f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.787+0000 7fdcea991640 1 -- 172.21.15.50:0/3126701819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce4141a80 con 0x7fdce40b3880 2024-09-11T22:11:23.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.787+0000 7fba9f7fe640 1 -- 172.21.15.50:0/1056154526 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbaa0043020 con 0x7fbaa806f930 2024-09-11T22:11:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.787+0000 7fdcea991640 1 -- 172.21.15.50:0/3126701819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce4142040 con 0x7fdce40b3880 2024-09-11T22:11:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.788+0000 7fb8797c9640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] conn(0x7fb8580741d0 0x7fb8580765f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.788+0000 7fb879fca640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb85806c030 0x7fb85806e4f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb864005880 tx=0x7fb864009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.788+0000 7f29fda82640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x7f29f00dbab0 0x7f29f0175740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.788+0000 7f29fda82640 1 -- 172.21.15.50:0/2656259027 --> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29f00d9190 con 0x7f29f00dbab0 2024-09-11T22:11:23.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.788+0000 7f0328ff9640 1 -- 172.21.15.50:0/2308040261 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0320007600 con 0x7f0324036400 2024-09-11T22:11:23.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.788+0000 7fe49dffb640 1 -- 172.21.15.50:0/4291915696 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe4a0039040 con 0x7fe4a80ce4b0 2024-09-11T22:11:23.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.788+0000 7fba9f7fe640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fba8806beb0 0x7fba8806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.788+0000 7fba9f7fe640 1 -- 172.21.15.50:0/1056154526 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbaa00ab160 con 0x7fbaa806f930 2024-09-11T22:11:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7fbaa67fc640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fba8806beb0 0x7fba8806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7fba9f7fe640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x7fba880740d0 0x7fba880764f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7fba9f7fe640 1 -- 172.21.15.50:0/1056154526 --> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbaa0008eb0 con 0x7fba880740d0 2024-09-11T22:11:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7f8fadffb640 1 -- 172.21.15.50:0/3454215139 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8fb8093070 con 0x7f8fb0033490 2024-09-11T22:11:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7f29fd281640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x7f29f00dbab0 0x7f29f0175740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7fba9f7fe640 1 -- 172.21.15.50:0/1056154526 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbaa00b2050 con 0x7fbaa806f930 2024-09-11T22:11:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7fe49dffb640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe48c06bf00 0x7fe48c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7fb86a7fc640 1 -- 172.21.15.50:0/1071559760 <== osd.2 v2:172.21.15.50:6808/2284963545 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb858076ca0 con 0x7fb8580741d0 2024-09-11T22:11:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7fbaa67fc640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fba8806beb0 0x7fba8806e370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbaa81503e0 tx=0x7fba90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7f0328ff9640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f031006be80 0x7f031006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7f0328ff9640 1 -- 172.21.15.50:0/2308040261 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f032008a850 con 0x7f0324036400 2024-09-11T22:11:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7fe49dffb640 1 -- 172.21.15.50:0/4291915696 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe4a00ac7f0 con 0x7fe4a80ce4b0 2024-09-11T22:11:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7fdcea991640 1 -- 172.21.15.50:0/3126701819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdce4141550 con 0x7fdce40b3880 2024-09-11T22:11:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7f032bfff640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f031006be80 0x7f031006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7f0328ff9640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] conn(0x7f0310074100 0x7f0310076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7f0328ff9640 1 -- 172.21.15.50:0/2308040261 --> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0310076bd0 con 0x7f0310074100 2024-09-11T22:11:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7f0328ff9640 1 -- 172.21.15.50:0/2308040261 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f032008f2c0 con 0x7f0324036400 2024-09-11T22:11:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7fbaa77fe640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x7fba880740d0 0x7fba880764f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.789+0000 7fe49dffb640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x7fe48c074120 0x7fe48c076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7fe4acec3640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe48c06bf00 0x7fe48c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7fdce0ff9640 1 -- 172.21.15.50:0/3126701819 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdccc018070 con 0x7fdce40b3880 2024-09-11T22:11:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7f8fadffb640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f9c06bf00 0x7f8f9c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7f64177fe640 1 -- 172.21.15.50:0/1358016135 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6420045070 con 0x7f6430068510 2024-09-11T22:11:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7f0330edf640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] conn(0x7f0310074100 0x7f0310076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7f29fd281640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x7f29f00dbab0 0x7f29f0175740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7fe49dffb640 1 -- 172.21.15.50:0/4291915696 --> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe4a00091a0 con 0x7fe48c074120 2024-09-11T22:11:23.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7fe49dffb640 1 -- 172.21.15.50:0/4291915696 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe4a00b3050 con 0x7fe4a80ce4b0 2024-09-11T22:11:23.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7fe4adec5640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x7fe48c074120 0x7fe48c076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7f8fbca40640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f9c06bf00 0x7f8f9c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7f8fadffb640 1 -- 172.21.15.50:0/3454215139 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8fb8106410 con 0x7f8fb0033490 2024-09-11T22:11:23.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7f8fadffb640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] conn(0x7f8f9c074180 0x7f8f9c0765a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7f8fadffb640 1 -- 172.21.15.50:0/3454215139 --> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fb808ee80 con 0x7f8f9c074180 2024-09-11T22:11:23.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7f8fadffb640 1 -- 172.21.15.50:0/3454215139 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8fb810d050 con 0x7f8fb0033490 2024-09-11T22:11:23.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7fbaa77fe640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x7fba880740d0 0x7fba880764f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7fdce0ff9640 1 --2- 172.21.15.50:0/3126701819 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdcc406bf00 0x7fdcc406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7f0330edf640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] conn(0x7f0310074100 0x7f0310076520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7f032bfff640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f031006be80 0x7f031006e340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f032c0518b0 tx=0x7f032c06e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.790+0000 7f8fbda42640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] conn(0x7f8f9c074180 0x7f8f9c0765a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7fdce0ff9640 1 -- 172.21.15.50:0/3126701819 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdccc08af20 con 0x7fdce40b3880 2024-09-11T22:11:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7fdce3fff640 1 --2- 172.21.15.50:0/3126701819 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdcc406bf00 0x7fdcc406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7f64177fe640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f641c06be60 0x7f641c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7fe4adec5640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x7fe48c074120 0x7fe48c076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7f8fbca40640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f9c06bf00 0x7f8f9c06e3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8fb003a660 tx=0x7f8fb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7fdce0ff9640 1 --2- 172.21.15.50:0/3126701819 >> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] conn(0x7fdcc4074120 0x7fdcc4076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7fdce0ff9640 1 -- 172.21.15.50:0/3126701819 --> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcc4076bf0 con 0x7fdcc4074120 2024-09-11T22:11:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7fdce0ff9640 1 -- 172.21.15.50:0/3126701819 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdccc090530 con 0x7fdce40b3880 2024-09-11T22:11:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7fe4acec3640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe48c06bf00 0x7fe48c06e3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4a81fbaa0 tx=0x7fe498009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7f64177fe640 1 -- 172.21.15.50:0/1358016135 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f64200ab650 con 0x7f6430068510 2024-09-11T22:11:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7f642e7fc640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f641c06be60 0x7f641c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7f64177fe640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] conn(0x7f641c074060 0x7f641c076480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7f64177fe640 1 -- 172.21.15.50:0/1358016135 --> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6420034ec0 con 0x7f641c074060 2024-09-11T22:11:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7f64177fe640 1 -- 172.21.15.50:0/1358016135 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f64200abae0 con 0x7f6430068510 2024-09-11T22:11:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7f29f57fa640 1 -- 172.21.15.50:0/2656259027 <== osd.6 v2:172.21.15.77:6808/2920422022 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29f00d9190 con 0x7f29f00dbab0 2024-09-11T22:11:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7fdce8f2e640 1 --2- 172.21.15.50:0/3126701819 >> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] conn(0x7fdcc4074120 0x7fdcc4076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7f642f7fe640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] conn(0x7f641c074060 0x7f641c076480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7f8fbda42640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] conn(0x7f8f9c074180 0x7f8f9c0765a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7fba9f7fe640 1 -- 172.21.15.50:0/1056154526 <== osd.4 v2:172.21.15.77:6800/1015337735 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbaa0008eb0 con 0x7fba880740d0 2024-09-11T22:11:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7f0328ff9640 1 -- 172.21.15.50:0/2308040261 <== osd.5 v2:172.21.15.77:6824/2559965953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0310076bd0 con 0x7f0310074100 2024-09-11T22:11:23.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.791+0000 7f642e7fc640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f641c06be60 0x7f641c06e320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f64300cae10 tx=0x7f6424007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.792+0000 7f642f7fe640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] conn(0x7f641c074060 0x7f641c076480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.792+0000 7fe49dffb640 1 -- 172.21.15.50:0/4291915696 <== osd.3 v2:172.21.15.50:6800/593319808 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe4a00091a0 con 0x7fe48c074120 2024-09-11T22:11:23.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.792+0000 7fdce8f2e640 1 --2- 172.21.15.50:0/3126701819 >> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] conn(0x7fdcc4074120 0x7fdcc4076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.792+0000 7fdce3fff640 1 --2- 172.21.15.50:0/3126701819 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdcc406bf00 0x7fdcc406e3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40014e0 tx=0x7fdcd4007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:23.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.792+0000 7f64177fe640 1 -- 172.21.15.50:0/1358016135 <== osd.1 v2:172.21.15.50:6824/3862509209 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6420034ec0 con 0x7f641c074060 2024-09-11T22:11:23.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.792+0000 7f8fadffb640 1 -- 172.21.15.50:0/3454215139 <== osd.7 v2:172.21.15.77:6816/3980920894 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8fb808ee80 con 0x7f8f9c074180 2024-09-11T22:11:23.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.793+0000 7fdce0ff9640 1 -- 172.21.15.50:0/3126701819 <== osd.0 v2:172.21.15.50:6816/3121805052 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdcc4076bf0 con 0x7fdcc4074120 2024-09-11T22:11:23.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.812+0000 7f29fda82640 1 -- 172.21.15.50:0/2656259027 --> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29f0006f80 con 0x7f29f00dbab0 2024-09-11T22:11:23.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.814+0000 7f29f57fa640 1 -- 172.21.15.50:0/2656259027 <== osd.6 v2:172.21.15.77:6808/2920422022 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f29f0006f80 con 0x7f29f00dbab0 2024-09-11T22:11:23.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.814+0000 7f29deffd640 1 -- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x7f29f00dbab0 msgr2=0x7f29f0175740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.814+0000 7f29deffd640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x7f29f00dbab0 0x7f29f0175740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.815+0000 7f29deffd640 1 -- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29e406bf00 msgr2=0x7f29e406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.815+0000 7f29deffd640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29e406bf00 0x7f29e406e3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f29f0032ba0 tx=0x7f29e8008040 comp rx=0 tx=0).stop 2024-09-11T22:11:23.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.815+0000 7f29deffd640 1 -- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29f00337f0 msgr2=0x7f29f00d7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.815+0000 7f29deffd640 1 --2- 172.21.15.50:0/2656259027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29f00337f0 0x7f29f00d7e80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f29f80504d0 tx=0x7f29f80697c0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.815+0000 7f29fd281640 1 -- 172.21.15.50:0/2656259027 reap_dead start 2024-09-11T22:11:23.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.815+0000 7f29deffd640 1 -- 172.21.15.50:0/2656259027 shutdown_connections 2024-09-11T22:11:23.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.815+0000 7f29deffd640 1 -- 172.21.15.50:0/2656259027 >> 172.21.15.50:0/2656259027 conn(0x7f29f001d920 msgr2=0x7f29f00531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.816+0000 7f29deffd640 1 -- 172.21.15.50:0/2656259027 shutdown_connections 2024-09-11T22:11:23.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.816+0000 7f29deffd640 1 -- 172.21.15.50:0/2656259027 wait complete. 2024-09-11T22:11:23.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.820+0000 7fb87c22e640 1 -- 172.21.15.50:0/1071559760 --> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb874159110 con 0x7fb8580741d0 2024-09-11T22:11:23.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.821+0000 7fb86a7fc640 1 -- 172.21.15.50:0/1071559760 <== osd.2 v2:172.21.15.50:6808/2284963545 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb858076ca0 con 0x7fb8580741d0 2024-09-11T22:11:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.822+0000 7fb87c22e640 1 -- 172.21.15.50:0/1071559760 >> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] conn(0x7fb8580741d0 msgr2=0x7fb8580765f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.822+0000 7fb87c22e640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] conn(0x7fb8580741d0 0x7fb8580765f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.822+0000 7fb87c22e640 1 -- 172.21.15.50:0/1071559760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb85806c030 msgr2=0x7fb85806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.822+0000 7fb87c22e640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb85806c030 0x7fb85806e4f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb864005880 tx=0x7fb864009040 comp rx=0 tx=0).stop 2024-09-11T22:11:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.822+0000 7fb87c22e640 1 -- 172.21.15.50:0/1071559760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8741666e0 msgr2=0x7fb874165bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.822+0000 7fb87c22e640 1 --2- 172.21.15.50:0/1071559760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8741666e0 0x7fb874165bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb870031000 tx=0x7fb8700046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.822+0000 7fb87a7cb640 1 -- 172.21.15.50:0/1071559760 reap_dead start 2024-09-11T22:11:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.822+0000 7fb87c22e640 1 -- 172.21.15.50:0/1071559760 shutdown_connections 2024-09-11T22:11:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.822+0000 7fb87c22e640 1 -- 172.21.15.50:0/1071559760 >> 172.21.15.50:0/1071559760 conn(0x7fb8740b2100 msgr2=0x7fb874161220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.823+0000 7f03316e0640 1 -- 172.21.15.50:0/2308040261 --> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f030c002dd0 con 0x7f0310074100 2024-09-11T22:11:23.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.823+0000 7fb87c22e640 1 -- 172.21.15.50:0/1071559760 shutdown_connections 2024-09-11T22:11:23.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.823+0000 7fb87c22e640 1 -- 172.21.15.50:0/1071559760 wait complete. 2024-09-11T22:11:23.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.823+0000 7f0328ff9640 1 -- 172.21.15.50:0/2308040261 <== osd.5 v2:172.21.15.77:6824/2559965953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f030c002dd0 con 0x7f0310074100 2024-09-11T22:11:23.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7fdcea991640 1 -- 172.21.15.50:0/3126701819 --> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdce40b3340 con 0x7fdcc4074120 2024-09-11T22:11:23.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7f64157fa640 1 -- 172.21.15.50:0/1358016135 --> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6430167030 con 0x7f641c074060 2024-09-11T22:11:23.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7fbaa7fff640 1 -- 172.21.15.50:0/1056154526 --> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fba8c002dd0 con 0x7fba880740d0 2024-09-11T22:11:23.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7f8fa37fe640 1 -- 172.21.15.50:0/3454215139 --> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8fb0006f80 con 0x7f8f9c074180 2024-09-11T22:11:23.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7f03167fc640 1 -- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] conn(0x7f0310074100 msgr2=0x7f0310076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7f03167fc640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] conn(0x7f0310074100 0x7f0310076520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7fdce0ff9640 1 -- 172.21.15.50:0/3126701819 <== osd.0 v2:172.21.15.50:6816/3121805052 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdce40b3340 con 0x7fdcc4074120 2024-09-11T22:11:23.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7f03167fc640 1 -- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f031006be80 msgr2=0x7f031006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7f03167fc640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f031006be80 0x7f031006e340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f032c0518b0 tx=0x7f032c06e040 comp rx=0 tx=0).stop 2024-09-11T22:11:23.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7f03167fc640 1 -- 172.21.15.50:0/2308040261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0324036400 msgr2=0x7f032404bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7f03167fc640 1 --2- 172.21.15.50:0/2308040261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0324036400 0x7f032404bfa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f032000c460 tx=0x7f032000c920 comp rx=0 tx=0).stop 2024-09-11T22:11:23.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7f0330edf640 1 -- 172.21.15.50:0/2308040261 reap_dead start 2024-09-11T22:11:23.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7f03167fc640 1 -- 172.21.15.50:0/2308040261 shutdown_connections 2024-09-11T22:11:23.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7f03167fc640 1 -- 172.21.15.50:0/2308040261 >> 172.21.15.50:0/2308040261 conn(0x7f032401d930 msgr2=0x7f032404eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7f8fadffb640 1 -- 172.21.15.50:0/3454215139 <== osd.7 v2:172.21.15.77:6816/3980920894 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8fb0006f80 con 0x7f8f9c074180 2024-09-11T22:11:23.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.824+0000 7f64177fe640 1 -- 172.21.15.50:0/1358016135 <== osd.1 v2:172.21.15.50:6824/3862509209 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6430167030 con 0x7f641c074060 2024-09-11T22:11:23.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7f03167fc640 1 -- 172.21.15.50:0/2308040261 shutdown_connections 2024-09-11T22:11:23.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fba9f7fe640 1 -- 172.21.15.50:0/1056154526 <== osd.4 v2:172.21.15.77:6800/1015337735 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fba8c002dd0 con 0x7fba880740d0 2024-09-11T22:11:23.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7f03167fc640 1 -- 172.21.15.50:0/2308040261 wait complete. 2024-09-11T22:11:23.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fdcda7fc640 1 -- 172.21.15.50:0/3126701819 >> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] conn(0x7fdcc4074120 msgr2=0x7fdcc4076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fdcda7fc640 1 --2- 172.21.15.50:0/3126701819 >> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] conn(0x7fdcc4074120 0x7fdcc4076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fdcda7fc640 1 -- 172.21.15.50:0/3126701819 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdcc406bf00 msgr2=0x7fdcc406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fdcda7fc640 1 --2- 172.21.15.50:0/3126701819 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdcc406bf00 0x7fdcc406e3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40014e0 tx=0x7fdcd4007a40 comp rx=0 tx=0).stop 2024-09-11T22:11:23.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fdcda7fc640 1 -- 172.21.15.50:0/3126701819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdce40b3880 msgr2=0x7fdce4068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fdcda7fc640 1 --2- 172.21.15.50:0/3126701819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdce40b3880 0x7fdce4068490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00c7b0 tx=0x7fdccc00cc70 comp rx=0 tx=0).stop 2024-09-11T22:11:23.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7f64157fa640 1 -- 172.21.15.50:0/1358016135 >> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] conn(0x7f641c074060 msgr2=0x7f641c076480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7f64157fa640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] conn(0x7f641c074060 0x7f641c076480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fba9d7fa640 1 -- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x7fba880740d0 msgr2=0x7fba880764f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fba9d7fa640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x7fba880740d0 0x7fba880764f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7f8fa37fe640 1 -- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] conn(0x7f8f9c074180 msgr2=0x7f8f9c0765a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7f8fa37fe640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] conn(0x7f8f9c074180 0x7f8f9c0765a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fdce8f2e640 1 -- 172.21.15.50:0/3126701819 reap_dead start 2024-09-11T22:11:23.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fba9d7fa640 1 -- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fba8806beb0 msgr2=0x7fba8806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fdcda7fc640 1 -- 172.21.15.50:0/3126701819 shutdown_connections 2024-09-11T22:11:23.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fdcda7fc640 1 -- 172.21.15.50:0/3126701819 >> 172.21.15.50:0/3126701819 conn(0x7fdce4074c40 msgr2=0x7fdce415dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fba9d7fa640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fba8806beb0 0x7fba8806e370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbaa81503e0 tx=0x7fba90008040 comp rx=0 tx=0).stop 2024-09-11T22:11:23.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fba9d7fa640 1 -- 172.21.15.50:0/1056154526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaa806f930 msgr2=0x7fbaa8156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fba9d7fa640 1 --2- 172.21.15.50:0/1056154526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaa806f930 0x7fbaa8156180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbaa002a820 tx=0x7fbaa00046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.825+0000 7fbaa77fe640 1 -- 172.21.15.50:0/1056154526 reap_dead start 2024-09-11T22:11:23.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f64157fa640 1 -- 172.21.15.50:0/1358016135 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f641c06be60 msgr2=0x7f641c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f64157fa640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f641c06be60 0x7f641c06e320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f64300cae10 tx=0x7f6424007e30 comp rx=0 tx=0).stop 2024-09-11T22:11:23.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7fba9d7fa640 1 -- 172.21.15.50:0/1056154526 shutdown_connections 2024-09-11T22:11:23.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7fba9d7fa640 1 -- 172.21.15.50:0/1056154526 >> 172.21.15.50:0/1056154526 conn(0x7fbaa80b09f0 msgr2=0x7fbaa8159ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f8fa37fe640 1 -- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f9c06bf00 msgr2=0x7f8f9c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7fdcda7fc640 1 -- 172.21.15.50:0/3126701819 shutdown_connections 2024-09-11T22:11:23.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f64157fa640 1 -- 172.21.15.50:0/1358016135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6430068510 msgr2=0x7f64301630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f8fa37fe640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f9c06bf00 0x7f8f9c06e3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8fb003a660 tx=0x7f8fb4008040 comp rx=0 tx=0).stop 2024-09-11T22:11:23.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7fdcda7fc640 1 -- 172.21.15.50:0/3126701819 wait complete. 2024-09-11T22:11:23.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f64157fa640 1 --2- 172.21.15.50:0/1358016135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6430068510 0x7f64301630a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6420031000 tx=0x7f64200046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f642f7fe640 1 -- 172.21.15.50:0/1358016135 reap_dead start 2024-09-11T22:11:23.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f8fa37fe640 1 -- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb0033490 msgr2=0x7f8fb00e9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f8fa37fe640 1 --2- 172.21.15.50:0/3454215139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb0033490 0x7f8fb00e9e60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8fb802dd50 tx=0x7f8fb80697c0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f64157fa640 1 -- 172.21.15.50:0/1358016135 shutdown_connections 2024-09-11T22:11:23.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f64157fa640 1 -- 172.21.15.50:0/1358016135 >> 172.21.15.50:0/1358016135 conn(0x7f64300727a0 msgr2=0x7f64300b9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f8fbda42640 1 -- 172.21.15.50:0/3454215139 reap_dead start 2024-09-11T22:11:23.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f64157fa640 1 -- 172.21.15.50:0/1358016135 shutdown_connections 2024-09-11T22:11:23.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f64157fa640 1 -- 172.21.15.50:0/1358016135 wait complete. 2024-09-11T22:11:23.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7fba9d7fa640 1 -- 172.21.15.50:0/1056154526 shutdown_connections 2024-09-11T22:11:23.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f8fa37fe640 1 -- 172.21.15.50:0/3454215139 shutdown_connections 2024-09-11T22:11:23.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f8fa37fe640 1 -- 172.21.15.50:0/3454215139 >> 172.21.15.50:0/3454215139 conn(0x7f8fb00360c0 msgr2=0x7f8fb00e5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7fba9d7fa640 1 -- 172.21.15.50:0/1056154526 wait complete. 2024-09-11T22:11:23.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f8fa37fe640 1 -- 172.21.15.50:0/3454215139 shutdown_connections 2024-09-11T22:11:23.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.826+0000 7f8fa37fe640 1 -- 172.21.15.50:0/3454215139 wait complete. 2024-09-11T22:11:23.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.831+0000 7fe4af928640 1 -- 172.21.15.50:0/4291915696 --> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe4a814ac30 con 0x7fe48c074120 2024-09-11T22:11:23.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.831+0000 7fe49dffb640 1 -- 172.21.15.50:0/4291915696 <== osd.3 v2:172.21.15.50:6800/593319808 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe4a814ac30 con 0x7fe48c074120 2024-09-11T22:11:23.886 INFO:teuthology.orchestra.run.smithi050.stdout:64424509448 2024-09-11T22:11:23.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T22:11:23.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.832+0000 7fe4937fe640 1 -- 172.21.15.50:0/4291915696 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x7fe48c074120 msgr2=0x7fe48c076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.832+0000 7fe4937fe640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x7fe48c074120 0x7fe48c076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:23.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.832+0000 7fe4937fe640 1 -- 172.21.15.50:0/4291915696 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe48c06bf00 msgr2=0x7fe48c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.833+0000 7fe4937fe640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe48c06bf00 0x7fe48c06e3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4a81fbaa0 tx=0x7fe498009040 comp rx=0 tx=0).stop 2024-09-11T22:11:23.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.833+0000 7fe4937fe640 1 -- 172.21.15.50:0/4291915696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4a80ce4b0 msgr2=0x7fe4a80b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:23.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.833+0000 7fe4937fe640 1 --2- 172.21.15.50:0/4291915696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4a80ce4b0 0x7fe4a80b0480 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009d90 tx=0x7fe4a0004a40 comp rx=0 tx=0).stop 2024-09-11T22:11:23.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.833+0000 7fe4adec5640 1 -- 172.21.15.50:0/4291915696 reap_dead start 2024-09-11T22:11:23.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.833+0000 7fe4937fe640 1 -- 172.21.15.50:0/4291915696 shutdown_connections 2024-09-11T22:11:23.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.833+0000 7fe4937fe640 1 -- 172.21.15.50:0/4291915696 >> 172.21.15.50:0/4291915696 conn(0x7fe4a8067ff0 msgr2=0x7fe4a8150510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:23.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.833+0000 7fe4937fe640 1 -- 172.21.15.50:0/4291915696 shutdown_connections 2024-09-11T22:11:23.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:23.833+0000 7fe4937fe640 1 -- 172.21.15.50:0/4291915696 wait complete. 2024-09-11T22:11:23.889 INFO:teuthology.orchestra.run.smithi050.stdout:64424509445 2024-09-11T22:11:23.889 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T22:11:23.890 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2024-09-11T22:11:23.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T22:11:23.891 INFO:teuthology.orchestra.run.smithi050.stdout:64424509447 2024-09-11T22:11:23.891 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T22:11:23.892 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-09-11T22:11:23.892 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T22:11:23.893 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2024-09-11T22:11:23.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T22:11:23.894 INFO:teuthology.orchestra.run.smithi050.stdout:64424509447 2024-09-11T22:11:23.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T22:11:23.895 INFO:teuthology.orchestra.run.smithi050.stdout:64424509447 2024-09-11T22:11:23.895 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T22:11:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.099+0000 7fc562796640 1 Processor -- start 2024-09-11T22:11:24.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.099+0000 7fc562796640 1 -- start start 2024-09-11T22:11:24.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.101+0000 7f65abb76640 1 Processor -- start 2024-09-11T22:11:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.101+0000 7fc562796640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc55c0b2bf0 0x7fc55c15a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.102+0000 7fc562796640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc55c072fd0 0x7fc55c15e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.102+0000 7fc562796640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55c0b3400 con 0x7fc55c0728f0 2024-09-11T22:11:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.102+0000 7fc562796640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc55c071e90 con 0x7fc55c0b2bf0 2024-09-11T22:11:24.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.102+0000 7fc562796640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc55c0720e0 con 0x7fc55c072fd0 2024-09-11T22:11:24.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.102+0000 7fc55b7fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc55c072fd0 0x7fc55c15e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.102+0000 7fc55b7fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc55c072fd0 0x7fc55c15e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47416/0 (socket says 172.21.15.50:47416) 2024-09-11T22:11:24.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.102+0000 7fc55b7fe640 1 -- 172.21.15.50:0/677438454 learned_addr learned my addr 172.21.15.50:0/677438454 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:24.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7f964da55640 1 Processor -- start 2024-09-11T22:11:24.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7fc55b7fe640 1 -- 172.21.15.50:0/677438454 >> v2:172.21.15.50:3300/0 conn(0x7fc55c0b2bf0 msgr2=0x7fc55c15a5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:11:24.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7fc55affd640 1 -- 172.21.15.50:0/677438454 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 988073272 0 0) 0x7fc55c0b3400 con 0x7fc55c0728f0 2024-09-11T22:11:24.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7fc55b7fe640 1 --2- 172.21.15.50:0/677438454 >> v2:172.21.15.50:3300/0 conn(0x7fc55c0b2bf0 0x7fc55c15a5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7fc55b7fe640 1 -- 172.21.15.50:0/677438454 >> v1:172.21.15.50:6789/0 conn(0x7fc55c0728f0 legacy=0x7fc55c15e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7fc55b7fe640 1 -- 172.21.15.50:0/677438454 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55c0723c0 con 0x7fc55c072fd0 2024-09-11T22:11:24.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.101+0000 7f65abb76640 1 -- start start 2024-09-11T22:11:24.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7f65abb76640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f65a406d780 0x7f65a40b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7f65abb76640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65a40b3400 con 0x7f65a415a5f0 2024-09-11T22:11:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7f65abb76640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65a40720e0 con 0x7f65a415a9d0 2024-09-11T22:11:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7f65abb76640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f65a4071e90 con 0x7f65a406d780 2024-09-11T22:11:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7f65a9111640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f65a415a9d0 0x7f65a40b3bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:58680/0 (socket says 172.21.15.50:58680) 2024-09-11T22:11:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7f65a9111640 1 -- 172.21.15.50:0/4179804340 learned_addr learned my addr 172.21.15.50:0/4179804340 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.104+0000 7f65aa113640 1 --2- 172.21.15.50:0/4179804340 >> v2:172.21.15.50:3300/0 conn(0x7f65a406d780 0x7f65a40b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7f33a5f28640 1 Processor -- start 2024-09-11T22:11:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.104+0000 7f65a8910640 1 -- 172.21.15.50:0/4179804340 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2774513869 0 0) 0x7f65a40720e0 con 0x7f65a415a9d0 2024-09-11T22:11:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.104+0000 7f65a8910640 1 -- 172.21.15.50:0/4179804340 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6590003520 con 0x7f65a415a9d0 2024-09-11T22:11:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.104+0000 7fc55b7fe640 1 --2- 172.21.15.50:0/677438454 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc55c072fd0 0x7fc55c15e300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc55c072010 tx=0x7fc54c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c3cf5e37b743588 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7f33a5f28640 1 -- start start 2024-09-11T22:11:24.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.103+0000 7f964da55640 1 -- start start 2024-09-11T22:11:24.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.104+0000 7f964da55640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f964000ba50 0x7f9640008b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.104+0000 7f65a8910640 1 -- 172.21.15.50:0/4179804340 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3267338579 0 0) 0x7f65a40b3400 con 0x7f65a415a5f0 2024-09-11T22:11:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7fc55affd640 1 -- 172.21.15.50:0/677438454 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c004030 con 0x7fc55c072fd0 2024-09-11T22:11:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7fc55affd640 1 -- 172.21.15.50:0/677438454 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54c0041d0 con 0x7fc55c072fd0 2024-09-11T22:11:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7fc55affd640 1 -- 172.21.15.50:0/677438454 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c003610 con 0x7fc55c072fd0 2024-09-11T22:11:24.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.104+0000 7f964da55640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f964000be30 0x7f9640037180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f33a5f28640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33a006ee20 0x7f33a00d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f33a5f28640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a00b44a0 con 0x7f33a0162940 2024-09-11T22:11:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f33a5f28640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a00b3400 con 0x7f33a00d0760 2024-09-11T22:11:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f33a5f28640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f33a00b36e0 con 0x7f33a006ee20 2024-09-11T22:11:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f65aa113640 1 -- 172.21.15.50:0/4179804340 >> v1:172.21.15.77:6789/0 conn(0x7f65a415a9d0 legacy=0x7f65a40b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f65aa113640 1 -- 172.21.15.50:0/4179804340 >> v1:172.21.15.50:6789/0 conn(0x7f65a415a5f0 legacy=0x7f65a406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f339f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f33a0162940 0x7f33a006e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41238/0 (socket says 172.21.15.50:41238) 2024-09-11T22:11:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f339f7fe640 1 -- 172.21.15.50:0/3614715479 learned_addr learned my addr 172.21.15.50:0/3614715479 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f339effd640 1 --2- 172.21.15.50:0/3614715479 >> v2:172.21.15.77:3300/0 conn(0x7f33a006ee20 0x7f33a00d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f65aa113640 1 -- 172.21.15.50:0/4179804340 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a40723c0 con 0x7f65a406d780 2024-09-11T22:11:24.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f339e7fc640 1 -- 172.21.15.50:0/3614715479 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 817375624 0 0) 0x7f33a00b44a0 con 0x7f33a0162940 2024-09-11T22:11:24.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.106+0000 7fc562796640 1 -- 172.21.15.50:0/677438454 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc55c072fd0 msgr2=0x7fc55c15e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.106+0000 7fc562796640 1 --2- 172.21.15.50:0/677438454 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc55c072fd0 0x7fc55c15e300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc55c072010 tx=0x7fc54c02a250 comp rx=0 tx=0).stop 2024-09-11T22:11:24.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.106+0000 7fc562796640 1 -- 172.21.15.50:0/677438454 shutdown_connections 2024-09-11T22:11:24.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.106+0000 7fc562796640 1 --2- 172.21.15.50:0/677438454 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc55c072fd0 0x7fc55c15e300 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.106+0000 7fc562796640 1 --2- 172.21.15.50:0/677438454 >> v2:172.21.15.50:3300/0 conn(0x7fc55c0b2bf0 0x7fc55c15a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.106+0000 7fc562796640 1 -- 172.21.15.50:0/677438454 >> 172.21.15.50:0/677438454 conn(0x7fc55c0b2100 msgr2=0x7fc55c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.106+0000 7f339effd640 1 -- 172.21.15.50:0/3614715479 >> v1:172.21.15.77:6789/0 conn(0x7f33a00d0760 legacy=0x7f33a0071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.106+0000 7f339effd640 1 -- 172.21.15.50:0/3614715479 >> v1:172.21.15.50:6789/0 conn(0x7f33a0162940 legacy=0x7f33a006e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.106+0000 7f339effd640 1 -- 172.21.15.50:0/3614715479 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a00b39c0 con 0x7f33a006ee20 2024-09-11T22:11:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.104+0000 7f964da55640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96400322b0 con 0x7f96400376c0 2024-09-11T22:11:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.104+0000 7f964da55640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9640034e80 con 0x7f964000be30 2024-09-11T22:11:24.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.104+0000 7f964da55640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f964000acb0 con 0x7f964000ba50 2024-09-11T22:11:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.106+0000 7fc562796640 1 -- 172.21.15.50:0/677438454 shutdown_connections 2024-09-11T22:11:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.106+0000 7fc562796640 1 -- 172.21.15.50:0/677438454 wait complete. 2024-09-11T22:11:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.106+0000 7fe03e791640 1 Processor -- start 2024-09-11T22:11:24.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.106+0000 7fe03e791640 1 -- start start 2024-09-11T22:11:24.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.107+0000 7f339effd640 1 --2- 172.21.15.50:0/3614715479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a006ee20 0x7f33a00d0220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f33900097a0 tx=0x7f339002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c412887e295aab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.107+0000 7f65aa113640 1 --2- 172.21.15.50:0/4179804340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a406d780 0x7f65a40b42d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f65940093c0 tx=0x7f659402b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1530e1e0257f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f964ca53640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f964000ba50 0x7f9640008b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f964ca53640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f964000ba50 0x7f9640008b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47432/0 (socket says 172.21.15.50:47432) 2024-09-11T22:11:24.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f964ca53640 1 -- 172.21.15.50:0/817073326 learned_addr learned my addr 172.21.15.50:0/817073326 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:24.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f964ca53640 1 -- 172.21.15.50:0/817073326 >> v2:172.21.15.77:3300/0 conn(0x7f964000be30 msgr2=0x7f9640037180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:11:24.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f964ca53640 1 --2- 172.21.15.50:0/817073326 >> v2:172.21.15.77:3300/0 conn(0x7f964000be30 0x7f9640037180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f964ca53640 1 -- 172.21.15.50:0/817073326 >> v1:172.21.15.50:6789/0 conn(0x7f96400376c0 legacy=0x7f96400eb100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:11:24.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.105+0000 7f964ca53640 1 -- 172.21.15.50:0/817073326 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964000af90 con 0x7f964000ba50 2024-09-11T22:11:24.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.107+0000 7f964ca53640 1 --2- 172.21.15.50:0/817073326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f964000ba50 0x7f9640008b70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9634009850 tx=0x7f963402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35e24686dd803298 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.107+0000 7f96477fe640 1 -- 172.21.15.50:0/817073326 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634004030 con 0x7f964000ba50 2024-09-11T22:11:24.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.107+0000 7f96477fe640 1 -- 172.21.15.50:0/817073326 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96340041d0 con 0x7f964000ba50 2024-09-11T22:11:24.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.107+0000 7f96477fe640 1 -- 172.21.15.50:0/817073326 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634003610 con 0x7f964000ba50 2024-09-11T22:11:24.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.107+0000 7f65a8910640 1 -- 172.21.15.50:0/4179804340 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594037070 con 0x7f65a406d780 2024-09-11T22:11:24.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.107+0000 7f65a8910640 1 -- 172.21.15.50:0/4179804340 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6594032400 con 0x7f65a406d780 2024-09-11T22:11:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.107+0000 7f339e7fc640 1 -- 172.21.15.50:0/3614715479 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3390037070 con 0x7f33a006ee20 2024-09-11T22:11:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.107+0000 7f65a8910640 1 -- 172.21.15.50:0/4179804340 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c001a40 con 0x7f65a406d780 2024-09-11T22:11:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.108+0000 7f339e7fc640 1 -- 172.21.15.50:0/3614715479 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3390032440 con 0x7f33a006ee20 2024-09-11T22:11:24.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.108+0000 7f339e7fc640 1 -- 172.21.15.50:0/3614715479 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3390037070 con 0x7f33a006ee20 2024-09-11T22:11:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.108+0000 7fc562796640 1 Processor -- start 2024-09-11T22:11:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.108+0000 7fe03e791640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe038158310 0x7fe03815b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.108+0000 7fe03e791640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe038071110 0x7fe03806da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.108+0000 7f65abb76640 1 -- 172.21.15.50:0/4179804340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a406d780 msgr2=0x7f65a40b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.108+0000 7fc562796640 1 -- start start 2024-09-11T22:11:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.108+0000 7f65abb76640 1 --2- 172.21.15.50:0/4179804340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a406d780 0x7f65a40b42d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f65940093c0 tx=0x7f659402b5e0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.108+0000 7f65abb76640 1 -- 172.21.15.50:0/4179804340 shutdown_connections 2024-09-11T22:11:24.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.108+0000 7fe03e791640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe0380d0290 0x7fe0380d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.108+0000 7f65abb76640 1 --2- 172.21.15.50:0/4179804340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a406d780 0x7f65a40b42d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.108+0000 7f65abb76640 1 -- 172.21.15.50:0/4179804340 >> 172.21.15.50:0/4179804340 conn(0x7f65a40b2100 msgr2=0x7f65a40b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7fe0377fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe038071110 0x7fe03806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7f193ad31640 1 Processor -- start 2024-09-11T22:11:24.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7fb09026e640 1 Processor -- start 2024-09-11T22:11:24.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7f33a5f28640 1 -- 172.21.15.50:0/3614715479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a006ee20 msgr2=0x7f33a00d0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7f33a5f28640 1 --2- 172.21.15.50:0/3614715479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a006ee20 0x7f33a00d0220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f33900097a0 tx=0x7f339002a1e0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7fe0377fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe038071110 0x7fe03806da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46528/0 (socket says 172.21.15.50:46528) 2024-09-11T22:11:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7f33a5f28640 1 -- 172.21.15.50:0/3614715479 shutdown_connections 2024-09-11T22:11:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7f33a5f28640 1 --2- 172.21.15.50:0/3614715479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a006ee20 0x7f33a00d0220 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7f33a5f28640 1 -- 172.21.15.50:0/3614715479 >> 172.21.15.50:0/3614715479 conn(0x7f33a00679c0 msgr2=0x7f33a0067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7fb09026e640 1 -- start start 2024-09-11T22:11:24.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7fa0ee9cc640 1 Processor -- start 2024-09-11T22:11:24.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7f964da55640 1 -- 172.21.15.50:0/817073326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f964000ba50 msgr2=0x7f9640008b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7f964da55640 1 --2- 172.21.15.50:0/817073326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f964000ba50 0x7f9640008b70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9634009850 tx=0x7f963402a180 comp rx=0 tx=0).stop 2024-09-11T22:11:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7f33a5f28640 1 -- 172.21.15.50:0/3614715479 shutdown_connections 2024-09-11T22:11:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7f33a5f28640 1 -- 172.21.15.50:0/3614715479 wait complete. 2024-09-11T22:11:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7fe03e791640 1 -- 172.21.15.50:0/3442505357 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe0380d0c40 con 0x7fe038071110 2024-09-11T22:11:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7fe03e791640 1 -- 172.21.15.50:0/3442505357 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe03806d5c0 con 0x7fe0380d0290 2024-09-11T22:11:24.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7fe03e791640 1 -- 172.21.15.50:0/3442505357 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe0381586f0 con 0x7fe038158310 2024-09-11T22:11:24.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7fe03cd2e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe0380d0290 0x7fe0380d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7fe0377fe640 1 -- 172.21.15.50:0/3442505357 learned_addr learned my addr 172.21.15.50:0/3442505357 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:24.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7fc562796640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc55c0728f0 0x7fc55c1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.108+0000 7fe037fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe038158310 0x7fe03815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7f964da55640 1 -- 172.21.15.50:0/817073326 shutdown_connections 2024-09-11T22:11:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7f964da55640 1 --2- 172.21.15.50:0/817073326 >> v2:172.21.15.77:3300/0 conn(0x7f964000be30 0x7f9640037180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7fe03cd2e640 1 -- 172.21.15.50:0/3442505357 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe038158310 msgr2=0x7fe03815b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7fe03cd2e640 1 --2- 172.21.15.50:0/3442505357 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe038158310 0x7fe03815b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7fe03cd2e640 1 -- 172.21.15.50:0/3442505357 >> v2:172.21.15.50:3300/0 conn(0x7fe038071110 msgr2=0x7fe03806da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7f964da55640 1 --2- 172.21.15.50:0/817073326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f964000ba50 0x7f9640008b70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7fc562796640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc55c072fd0 0x7fc55c154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7f964da55640 1 -- 172.21.15.50:0/817073326 >> 172.21.15.50:0/817073326 conn(0x7f964001ea50 msgr2=0x7f9640038650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7fc55bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc55c0728f0 0x7fc55c1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7fc55bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc55c0728f0 0x7fc55c1571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54716/0 (socket says 172.21.15.50:54716) 2024-09-11T22:11:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7fc55bfff640 1 -- 172.21.15.50:0/1650004603 learned_addr learned my addr 172.21.15.50:0/1650004603 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7f964da55640 1 -- 172.21.15.50:0/817073326 shutdown_connections 2024-09-11T22:11:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7f964da55640 1 -- 172.21.15.50:0/817073326 wait complete. 2024-09-11T22:11:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7f65abb76640 1 -- 172.21.15.50:0/4179804340 shutdown_connections 2024-09-11T22:11:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7f193ad31640 1 -- start start 2024-09-11T22:11:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7fc55b7fe640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc55c072fd0 0x7fc55c154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7f193ad31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 0x7f193415b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7f193ad31640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f19340d0580 0x7f193415ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fc562796640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc55c0b2bf0 0x7fc55c1f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7f1938acd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 0x7f193415b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.109+0000 7fa0ee9cc640 1 -- start start 2024-09-11T22:11:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fa0ee9cc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0e0005ab0 0x7fa0e0053f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fc562796640 1 -- 172.21.15.50:0/1650004603 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c15ef50 con 0x7fc55c072fd0 2024-09-11T22:11:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fc562796640 1 -- 172.21.15.50:0/1650004603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c15ab30 con 0x7fc55c0728f0 2024-09-11T22:11:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fb08e00a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb08815e980 0x7fb0880d2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41254/0 (socket says 172.21.15.50:41254) 2024-09-11T22:11:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7f1938acd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 0x7f193415b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47452/0 (socket says 172.21.15.50:47452) 2024-09-11T22:11:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7f1938acd640 1 -- 172.21.15.50:0/1631696216 learned_addr learned my addr 172.21.15.50:0/1631696216 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7f1933fff640 1 --2- 172.21.15.50:0/1631696216 >> v2:172.21.15.77:3300/0 conn(0x7f19340d0580 0x7f193415ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7fe03cd2e640 1 --2- 172.21.15.50:0/3442505357 >> v2:172.21.15.50:3300/0 conn(0x7fe038071110 0x7fe03806da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.110+0000 7fe03cd2e640 1 -- 172.21.15.50:0/3442505357 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03815bc70 con 0x7fe0380d0290 2024-09-11T22:11:24.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fb08e00a640 1 -- 172.21.15.50:0/2089533785 learned_addr learned my addr 172.21.15.50:0/2089533785 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:24.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fa0ee9cc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa0e004eb60 0x7fa0e001d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fa0ed9ca640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0e0005ab0 0x7fa0e0053f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fa0ed9ca640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0e0005ab0 0x7fa0e0053f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47456/0 (socket says 172.21.15.50:47456) 2024-09-11T22:11:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fe037fff640 1 --2- 172.21.15.50:0/3442505357 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe038158310 0x7fe03815b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7f193ad31640 1 -- 172.21.15.50:0/1631696216 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f193406faa0 con 0x7f193415f4b0 2024-09-11T22:11:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fb09026e640 1 --2- 172.21.15.50:0/2089533785 >> v2:172.21.15.77:3300/0 conn(0x7fb0880d4100 0x7fb0880d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fb09026e640 1 --2- 172.21.15.50:0/2089533785 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0880d14c0 0x7fb0880b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fe0377fe640 1 --2- 172.21.15.50:0/3442505357 >> v2:172.21.15.50:3300/0 conn(0x7fe038071110 0x7fe03806da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fc560d33640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc55c0b2bf0 0x7fc55c1f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7f193ad31640 1 -- 172.21.15.50:0/1631696216 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f19340d1320 con 0x7f19340d0580 2024-09-11T22:11:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fc562796640 1 -- 172.21.15.50:0/1650004603 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc55c15f0d0 con 0x7fc55c0b2bf0 2024-09-11T22:11:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fb08d809640 1 --2- 172.21.15.50:0/2089533785 >> v2:172.21.15.77:3300/0 conn(0x7fb0880d4100 0x7fb0880d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fa0ed1c9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa0e00e7120 0x7fa0e0005e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41268/0 (socket says 172.21.15.50:41268) 2024-09-11T22:11:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fb08e80b640 1 --2- 172.21.15.50:0/2089533785 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0880d14c0 0x7fb0880b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fa0ed9ca640 1 -- 172.21.15.50:0/3244851359 learned_addr learned my addr 172.21.15.50:0/3244851359 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7f193ad31640 1 -- 172.21.15.50:0/1631696216 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f193406e600 con 0x7f193415b320 2024-09-11T22:11:24.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7f33a5f28640 1 Processor -- start 2024-09-11T22:11:24.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fe03cd2e640 1 --2- 172.21.15.50:0/3442505357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0380d0290 0x7fe0380d0700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe03806edc0 tx=0x7fe03002ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7379b2832788618f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7fb09026e640 1 -- 172.21.15.50:0/2089533785 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0880d1930 con 0x7fb08815e980 2024-09-11T22:11:24.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/3244851359 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e0052330 con 0x7fa0e00e7120 2024-09-11T22:11:24.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/3244851359 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e00520e0 con 0x7fa0e004eb60 2024-09-11T22:11:24.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/3244851359 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e0006cd0 con 0x7fa0e0005ab0 2024-09-11T22:11:24.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fe036ffd640 1 -- 172.21.15.50:0/3442505357 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03002f800 con 0x7fe0380d0290 2024-09-11T22:11:24.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7f964da55640 1 Processor -- start 2024-09-11T22:11:24.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7f33a5f28640 1 -- start start 2024-09-11T22:11:24.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fe036ffd640 1 -- 172.21.15.50:0/3442505357 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe03002f9a0 con 0x7fe0380d0290 2024-09-11T22:11:24.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fc55bfff640 1 -- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc55c0b2bf0 msgr2=0x7fc55c1f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fc55bfff640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc55c0b2bf0 0x7fc55c1f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fc55bfff640 1 -- 172.21.15.50:0/1650004603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc55c072fd0 msgr2=0x7fc55c154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fc55bfff640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc55c072fd0 0x7fc55c154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fc55bfff640 1 -- 172.21.15.50:0/1650004603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55c1550b0 con 0x7fc55c0728f0 2024-09-11T22:11:24.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fe036ffd640 1 -- 172.21.15.50:0/3442505357 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03002f800 con 0x7fe0380d0290 2024-09-11T22:11:24.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7f964da55640 1 -- start start 2024-09-11T22:11:24.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7f1938acd640 1 -- 172.21.15.50:0/1631696216 >> v2:172.21.15.77:3300/0 conn(0x7f19340d0580 msgr2=0x7f193415ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:24.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7f1938acd640 1 --2- 172.21.15.50:0/1631696216 >> v2:172.21.15.77:3300/0 conn(0x7f19340d0580 0x7f193415ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7f1938acd640 1 -- 172.21.15.50:0/1631696216 >> v1:172.21.15.77:6789/0 conn(0x7f193415f4b0 legacy=0x7f19340ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7f1938acd640 1 -- 172.21.15.50:0/1631696216 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19340d0d60 con 0x7f193415b320 2024-09-11T22:11:24.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7f19337fe640 1 -- 172.21.15.50:0/1631696216 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1957201972 0 0) 0x7f193406faa0 con 0x7f193415f4b0 2024-09-11T22:11:24.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fc55bfff640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc55c0728f0 0x7fc55c1571d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc55000b3e0 tx=0x7fc55000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fc558ff9640 1 -- 172.21.15.50:0/1650004603 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550015020 con 0x7fc55c0728f0 2024-09-11T22:11:24.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fc558ff9640 1 -- 172.21.15.50:0/1650004603 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc550011830 con 0x7fc55c0728f0 2024-09-11T22:11:24.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fc558ff9640 1 -- 172.21.15.50:0/1650004603 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550011c20 con 0x7fc55c0728f0 2024-09-11T22:11:24.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.111+0000 7f65abb76640 1 -- 172.21.15.50:0/4179804340 wait complete. 2024-09-11T22:11:24.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fc55b7fe640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc55c072fd0 0x7fc55c154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:24.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fc562796640 1 -- 172.21.15.50:0/1650004603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc55c155390 con 0x7fc55c0728f0 2024-09-11T22:11:24.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fc562796640 1 -- 172.21.15.50:0/1650004603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc55c155950 con 0x7fc55c0728f0 2024-09-11T22:11:24.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fb09026e640 1 -- 172.21.15.50:0/2089533785 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb0880d39d0 con 0x7fb0880d4100 2024-09-11T22:11:24.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fb09026e640 1 -- 172.21.15.50:0/2089533785 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb0880d2dc0 con 0x7fb0880d14c0 2024-09-11T22:11:24.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 635577450 0 0) 0x7fb0880d1930 con 0x7fb08815e980 2024-09-11T22:11:24.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb074003520 con 0x7fb08815e980 2024-09-11T22:11:24.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fe03e791640 1 -- 172.21.15.50:0/3442505357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0380d0290 msgr2=0x7fe0380d0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fe03e791640 1 --2- 172.21.15.50:0/3442505357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0380d0290 0x7fe0380d0700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe03806edc0 tx=0x7fe03002ba40 comp rx=0 tx=0).stop 2024-09-11T22:11:24.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7f1938acd640 1 --2- 172.21.15.50:0/1631696216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 0x7f193415b700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1920009870 tx=0x7f192002a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed28f44a82dc8270 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fa0ec9c8640 1 -- 172.21.15.50:0/3244851359 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3795547998 0 0) 0x7fa0e0052330 con 0x7fa0e00e7120 2024-09-11T22:11:24.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fa0ec9c8640 1 -- 172.21.15.50:0/3244851359 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0d4003520 con 0x7fa0e00e7120 2024-09-11T22:11:24.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fa0ed9ca640 1 -- 172.21.15.50:0/3244851359 >> v2:172.21.15.77:3300/0 conn(0x7fa0e004eb60 msgr2=0x7fa0e001d530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:11:24.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fa0ed9ca640 1 --2- 172.21.15.50:0/3244851359 >> v2:172.21.15.77:3300/0 conn(0x7fa0e004eb60 0x7fa0e001d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fa0ed9ca640 1 -- 172.21.15.50:0/3244851359 >> v1:172.21.15.50:6789/0 conn(0x7fa0e00e7120 legacy=0x7fa0e0005e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.112+0000 7fa0ed9ca640 1 -- 172.21.15.50:0/3244851359 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e0006fb0 con 0x7fa0e0005ab0 2024-09-11T22:11:24.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7f19337fe640 1 -- 172.21.15.50:0/1631696216 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920036070 con 0x7f193415b320 2024-09-11T22:11:24.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7f19337fe640 1 -- 172.21.15.50:0/1631696216 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f192002f710 con 0x7f193415b320 2024-09-11T22:11:24.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7f19337fe640 1 -- 172.21.15.50:0/1631696216 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192002fae0 con 0x7f193415b320 2024-09-11T22:11:24.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7f33a5f28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a006ee20 0x7f33a00cef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1087642261 0 0) 0x7fb074003520 con 0x7fb08815e980 2024-09-11T22:11:24.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0880d14c0 msgr2=0x7fb0880b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:24.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fb08d008640 1 --2- 172.21.15.50:0/2089533785 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0880d14c0 0x7fb0880b7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 >> v2:172.21.15.77:3300/0 conn(0x7fb0880d4100 msgr2=0x7fb0880d0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:24.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fb08d008640 1 --2- 172.21.15.50:0/2089533785 >> v2:172.21.15.77:3300/0 conn(0x7fb0880d4100 0x7fb0880d0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0880d30a0 con 0x7fb08815e980 2024-09-11T22:11:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f964da55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964000ba50 0x7f964004b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f964da55640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f964000be30 0x7f96400d4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fb084001670 con 0x7fb08815e980 2024-09-11T22:11:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 >> v1:172.21.15.50:6789/0 conn(0x7fb08815e980 legacy=0x7fb0880d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7fb08d008640 1 --2- 172.21.15.50:0/2089533785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0740039b0 0x7fb074003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7fb08d008640 1 --2- 172.21.15.50:0/2089533785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb074004800 0x7fb074004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7fb08e00a640 1 --2- 172.21.15.50:0/2089533785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0740039b0 0x7fb074003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7fb08d008640 1 --2- 172.21.15.50:0/2089533785 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0740051c0 0x7fb07400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0880d39d0 con 0x7fb074004800 2024-09-11T22:11:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0880d2dc0 con 0x7fb0740039b0 2024-09-11T22:11:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb07400c030 con 0x7fb0740051c0 2024-09-11T22:11:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7f33a5f28640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33a00d0760 0x7f33a0156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7f33a5f28640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a0162940 0x7f33a015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7f33a5f28640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00d0bb0 con 0x7f33a006ee20 2024-09-11T22:11:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7f33a5f28640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00b3f80 con 0x7f33a0162940 2024-09-11T22:11:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7f33a5f28640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f33a0162d20 con 0x7f33a00d0760 2024-09-11T22:11:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f339f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a006ee20 0x7f33a00cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f339f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a006ee20 0x7f33a00cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46550/0 (socket says 172.21.15.50:46550) 2024-09-11T22:11:24.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f339f7fe640 1 -- 172.21.15.50:0/184479578 learned_addr learned my addr 172.21.15.50:0/184479578 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:24.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f964ca53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964000ba50 0x7f964004b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f964ca53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964000ba50 0x7f964004b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46562/0 (socket says 172.21.15.50:46562) 2024-09-11T22:11:24.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f964da55640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96400376c0 0x7f96400d4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f9647fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f964000be30 0x7f96400d4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.113+0000 7f65abb76640 1 Processor -- start 2024-09-11T22:11:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f65abb76640 1 -- start start 2024-09-11T22:11:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f9647fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f964000be30 0x7f96400d4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47480/0 (socket says 172.21.15.50:47480) 2024-09-11T22:11:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f964da55640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9640034b50 con 0x7f964000ba50 2024-09-11T22:11:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f964ca53640 1 -- 172.21.15.50:0/1427398406 learned_addr learned my addr 172.21.15.50:0/1427398406 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f964da55640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f964000b550 con 0x7f96400376c0 2024-09-11T22:11:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f964da55640 1 -- 172.21.15.50:0/1427398406 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f964000c460 con 0x7f964000be30 2024-09-11T22:11:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f964d254640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96400376c0 0x7f96400d4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7fe03e791640 1 -- 172.21.15.50:0/3442505357 shutdown_connections 2024-09-11T22:11:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7fe03e791640 1 --2- 172.21.15.50:0/3442505357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0380d0290 0x7fe0380d0700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7fe03e791640 1 --2- 172.21.15.50:0/3442505357 >> v2:172.21.15.50:3300/0 conn(0x7fe038071110 0x7fe03806da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7fe03e791640 1 --2- 172.21.15.50:0/3442505357 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe038158310 0x7fe03815b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7fe03e791640 1 -- 172.21.15.50:0/3442505357 >> 172.21.15.50:0/3442505357 conn(0x7fe0380679c0 msgr2=0x7fe038067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f339f7fe640 1 -- 172.21.15.50:0/184479578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33a00d0760 msgr2=0x7f33a0156ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:11:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f339f7fe640 1 --2- 172.21.15.50:0/184479578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33a00d0760 0x7f33a0156ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f339f7fe640 1 -- 172.21.15.50:0/184479578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a0162940 msgr2=0x7f33a015b040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:11:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f339f7fe640 1 --2- 172.21.15.50:0/184479578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a0162940 0x7f33a015b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7f339f7fe640 1 -- 172.21.15.50:0/184479578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a00cf470 con 0x7f33a006ee20 2024-09-11T22:11:24.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.114+0000 7fb08d809640 1 --2- 172.21.15.50:0/2089533785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb074004800 0x7fb074004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7fa0ed9ca640 1 --2- 172.21.15.50:0/3244851359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0e0005ab0 0x7fa0e0053f50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80637b0 tx=0x7fa0e80a6260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16b3e2521ccfbaa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7fe03e791640 1 -- 172.21.15.50:0/3442505357 shutdown_connections 2024-09-11T22:11:24.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f964ca53640 1 -- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f964000be30 msgr2=0x7f96400d4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f964ca53640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f964000be30 0x7f96400d4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f964ca53640 1 -- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96400376c0 msgr2=0x7f96400d4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f193ad31640 1 -- 172.21.15.50:0/1631696216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 msgr2=0x7f193415b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f193ad31640 1 --2- 172.21.15.50:0/1631696216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 0x7f193415b700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1920009870 tx=0x7f192002a3f0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f964ca53640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96400376c0 0x7f96400d4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f964ca53640 1 -- 172.21.15.50:0/1427398406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96400d6b30 con 0x7f964000ba50 2024-09-11T22:11:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f193ad31640 1 -- 172.21.15.50:0/1631696216 shutdown_connections 2024-09-11T22:11:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f193ad31640 1 --2- 172.21.15.50:0/1631696216 >> v2:172.21.15.77:3300/0 conn(0x7f19340d0580 0x7f193415ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f193ad31640 1 --2- 172.21.15.50:0/1631696216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 0x7f193415b700 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f193ad31640 1 -- 172.21.15.50:0/1631696216 >> 172.21.15.50:0/1631696216 conn(0x7f1934075030 msgr2=0x7f193406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f964d254640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96400376c0 0x7f96400d4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f65abb76640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a406d780 0x7f65a4151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7fb08d809640 1 -- 172.21.15.50:0/2089533785 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0740051c0 msgr2=0x7fb07400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7fb08d809640 1 --2- 172.21.15.50:0/2089533785 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0740051c0 0x7fb07400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7fb08d809640 1 -- 172.21.15.50:0/2089533785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0740039b0 msgr2=0x7fb074003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7fb08d809640 1 --2- 172.21.15.50:0/2089533785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0740039b0 0x7fb074003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f339f7fe640 1 --2- 172.21.15.50:0/184479578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a006ee20 0x7f33a00cef30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f339800c780 tx=0x7f339800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7fe03e791640 1 -- 172.21.15.50:0/3442505357 wait complete. 2024-09-11T22:11:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f65abb76640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a415a5f0 0x7f65a40cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f65abb76640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a40af6d0 0x7f65a40b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f65abb76640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f65a40b2df0 con 0x7f65a406d780 2024-09-11T22:11:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f65abb76640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f65a40b2c70 con 0x7f65a415a5f0 2024-09-11T22:11:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f65abb76640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f65a4072fd0 con 0x7f65a40af6d0 2024-09-11T22:11:24.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f65a9912640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a406d780 0x7f65a4151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f65a9912640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a406d780 0x7f65a4151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46578/0 (socket says 172.21.15.50:46578) 2024-09-11T22:11:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7fb08d809640 1 -- 172.21.15.50:0/2089533785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb074003520 con 0x7fb074004800 2024-09-11T22:11:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f3387fff640 1 -- 172.21.15.50:0/184479578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398018070 con 0x7f33a006ee20 2024-09-11T22:11:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7fa0ec9c8640 1 -- 172.21.15.50:0/3244851359 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80b3070 con 0x7fa0e0005ab0 2024-09-11T22:11:24.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7fa0ec9c8640 1 -- 172.21.15.50:0/3244851359 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e80ae680 con 0x7fa0e0005ab0 2024-09-11T22:11:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7fa0ec9c8640 1 -- 172.21.15.50:0/3244851359 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80aeaf0 con 0x7fa0e0005ab0 2024-09-11T22:11:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f3387fff640 1 -- 172.21.15.50:0/184479578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339800a640 con 0x7f33a006ee20 2024-09-11T22:11:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f33a5f28640 1 -- 172.21.15.50:0/184479578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a00cc210 con 0x7f33a006ee20 2024-09-11T22:11:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f193ad31640 1 -- 172.21.15.50:0/1631696216 shutdown_connections 2024-09-11T22:11:24.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7f3387fff640 1 -- 172.21.15.50:0/184479578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339800aa70 con 0x7f33a006ee20 2024-09-11T22:11:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f65a9912640 1 -- 172.21.15.50:0/1801234169 learned_addr learned my addr 172.21.15.50:0/1801234169 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/3244851359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0e0005ab0 msgr2=0x7fa0e0053f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7fa0ee9cc640 1 --2- 172.21.15.50:0/3244851359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0e0005ab0 0x7fa0e0053f50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80637b0 tx=0x7fa0e80a6260 comp rx=0 tx=0).stop 2024-09-11T22:11:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/3244851359 shutdown_connections 2024-09-11T22:11:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7fa0ee9cc640 1 --2- 172.21.15.50:0/3244851359 >> v2:172.21.15.77:3300/0 conn(0x7fa0e004eb60 0x7fa0e001d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7fa0ee9cc640 1 --2- 172.21.15.50:0/3244851359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0e0005ab0 0x7fa0e0053f50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/3244851359 >> 172.21.15.50:0/3244851359 conn(0x7fa0e0036090 msgr2=0x7fa0e00364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f65a9111640 1 --2- 172.21.15.50:0/1801234169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a415a5f0 0x7f65a40cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7f65a9912640 1 -- 172.21.15.50:0/1801234169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a40af6d0 msgr2=0x7f65a40b0560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:11:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7f65a9912640 1 --2- 172.21.15.50:0/1801234169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a40af6d0 0x7f65a40b0560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7f65a9912640 1 -- 172.21.15.50:0/1801234169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a415a5f0 msgr2=0x7f65a40cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7f65a9912640 1 --2- 172.21.15.50:0/1801234169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a415a5f0 0x7f65a40cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7f65a9912640 1 -- 172.21.15.50:0/1801234169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a40ce4f0 con 0x7f65a406d780 2024-09-11T22:11:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7fc562796640 1 -- 172.21.15.50:0/1650004603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc53c005290 con 0x7fc55c0728f0 2024-09-11T22:11:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7fc558ff9640 1 -- 172.21.15.50:0/1650004603 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc550018020 con 0x7fc55c0728f0 2024-09-11T22:11:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/3244851359 shutdown_connections 2024-09-11T22:11:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.117+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/3244851359 wait complete. 2024-09-11T22:11:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.117+0000 7f33a5f28640 1 -- 172.21.15.50:0/184479578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a00ce880 con 0x7f33a006ee20 2024-09-11T22:11:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.117+0000 7f65a9912640 1 --2- 172.21.15.50:0/1801234169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a406d780 0x7f65a4151f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f65a000c460 tx=0x7f65a000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.115+0000 7f964ca53640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964000ba50 0x7f964004b970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f96340090b0 tx=0x7f96340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7f96457fa640 1 -- 172.21.15.50:0/1427398406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634041020 con 0x7f964000ba50 2024-09-11T22:11:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7f96457fa640 1 -- 172.21.15.50:0/1427398406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f963403c660 con 0x7f964000ba50 2024-09-11T22:11:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7f96457fa640 1 -- 172.21.15.50:0/1427398406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963403ca30 con 0x7f964000ba50 2024-09-11T22:11:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.117+0000 7f964da55640 1 -- 172.21.15.50:0/1427398406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96400d4110 con 0x7f964000ba50 2024-09-11T22:11:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.117+0000 7f964da55640 1 -- 172.21.15.50:0/1427398406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96400d6570 con 0x7f964000ba50 2024-09-11T22:11:24.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.117+0000 7fc558ff9640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc54806be80 0x7fc54806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.117+0000 7fc558ff9640 1 -- 172.21.15.50:0/1650004603 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc55008ac50 con 0x7fc55c0728f0 2024-09-11T22:11:24.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.117+0000 7f659a7fc640 1 -- 172.21.15.50:0/1801234169 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a00052d0 con 0x7f65a406d780 2024-09-11T22:11:24.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.118+0000 7f659a7fc640 1 -- 172.21.15.50:0/1801234169 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a0005470 con 0x7f65a406d780 2024-09-11T22:11:24.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.118+0000 7f659a7fc640 1 -- 172.21.15.50:0/1801234169 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0012830 con 0x7f65a406d780 2024-09-11T22:11:24.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.117+0000 7fe03e791640 1 Processor -- start 2024-09-11T22:11:24.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.116+0000 7f193ad31640 1 -- 172.21.15.50:0/1631696216 wait complete. 2024-09-11T22:11:24.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.117+0000 7f193ad31640 1 Processor -- start 2024-09-11T22:11:24.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.118+0000 7fc55b7fe640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc54806be80 0x7fc54806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.118+0000 7fb08d809640 1 --2- 172.21.15.50:0/2089533785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb074004800 0x7fb074004c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb07800ba30 tx=0x7fb074005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0022296185416cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.118+0000 7f33a5f28640 1 -- 172.21.15.50:0/184479578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a00d0220 con 0x7f33a006ee20 2024-09-11T22:11:24.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.118+0000 7fa0ee9cc640 1 Processor -- start 2024-09-11T22:11:24.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.118+0000 7f3387fff640 1 -- 172.21.15.50:0/184479578 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f339801b070 con 0x7f33a006ee20 2024-09-11T22:11:24.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.118+0000 7fa0ee9cc640 1 -- start start 2024-09-11T22:11:24.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.119+0000 7fc55b7fe640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc54806be80 0x7fc54806e340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc54c033000 tx=0x7fc54c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.119+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078030070 con 0x7fb074004800 2024-09-11T22:11:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.119+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07802ae10 con 0x7fb074004800 2024-09-11T22:11:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.119+0000 7fb08d008640 1 -- 172.21.15.50:0/2089533785 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07800b600 con 0x7fb074004800 2024-09-11T22:11:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.119+0000 7f964da55640 1 -- 172.21.15.50:0/1427398406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9640034690 con 0x7f964000ba50 2024-09-11T22:11:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.119+0000 7fe03e791640 1 -- start start 2024-09-11T22:11:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.119+0000 7f65abb76640 1 -- 172.21.15.50:0/1801234169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a40ce7d0 con 0x7f65a406d780 2024-09-11T22:11:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.118+0000 7f193ad31640 1 -- start start 2024-09-11T22:11:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.119+0000 7f65abb76640 1 -- 172.21.15.50:0/1801234169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a415c020 con 0x7f65a406d780 2024-09-11T22:11:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.119+0000 7f193ad31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19340d0580 0x7f1934157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.119+0000 7f193ad31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 0x7f19341fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.119+0000 7f193ad31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193415f4b0 0x7f19341f9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7f1933fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 0x7f19341fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7f1933fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 0x7f19341fb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47502/0 (socket says 172.21.15.50:47502) 2024-09-11T22:11:24.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fb09026e640 1 -- 172.21.15.50:0/2089533785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb074004800 msgr2=0x7fb074004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fb09026e640 1 --2- 172.21.15.50:0/2089533785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb074004800 0x7fb074004c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb07800ba30 tx=0x7fb074005830 comp rx=0 tx=0).stop 2024-09-11T22:11:24.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fb08e80b640 1 -- 172.21.15.50:0/2089533785 reap_dead start 2024-09-11T22:11:24.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7f19392ce640 1 --2- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193415f4b0 0x7f19341f9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7f1933fff640 1 -- 172.21.15.50:0/985788002 learned_addr learned my addr 172.21.15.50:0/985788002 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:24.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fa0ee9cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0e0005ab0 0x7fa0e0049920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fb09026e640 1 -- 172.21.15.50:0/2089533785 shutdown_connections 2024-09-11T22:11:24.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fb09026e640 1 -- 172.21.15.50:0/2089533785 >> 172.21.15.50:0/2089533785 conn(0x7fb0880679c0 msgr2=0x7fb088067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fe03e791640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe038071110 0x7fe0381560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7f193ad31640 1 -- 172.21.15.50:0/985788002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f19340d09e0 con 0x7f19340d0580 2024-09-11T22:11:24.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fa0ee9cc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0e004eb60 0x7fa0e017d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fe03e791640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0380d0290 0x7fe038153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fe03e791640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe038158310 0x7fe038154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fa0ee9cc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0e00e7120 0x7fa0e0048f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fe037fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe038071110 0x7fe0381560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fe037fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe038071110 0x7fe0381560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54814/0 (socket says 172.21.15.50:54814) 2024-09-11T22:11:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fe037fff640 1 -- 172.21.15.50:0/2506751055 learned_addr learned my addr 172.21.15.50:0/2506751055 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fa0ed1c9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0e004eb60 0x7fa0e017d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fa0ed9ca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0e0005ab0 0x7fa0e0049920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fa0ed1c9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0e004eb60 0x7fa0e017d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47514/0 (socket says 172.21.15.50:47514) 2024-09-11T22:11:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fa0ed1c9640 1 -- 172.21.15.50:0/2749912702 learned_addr learned my addr 172.21.15.50:0/2749912702 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fa0ed9ca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0e0005ab0 0x7fa0e0049920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46592/0 (socket says 172.21.15.50:46592) 2024-09-11T22:11:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/2749912702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e0047b50 con 0x7fa0e0005ab0 2024-09-11T22:11:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fe03e791640 1 -- 172.21.15.50:0/2506751055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe03806d250 con 0x7fe0380d0290 2024-09-11T22:11:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/2749912702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e0053a10 con 0x7fa0e00e7120 2024-09-11T22:11:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fa0ee1cb640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0e00e7120 0x7fa0e0048f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fe03cd2e640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe038158310 0x7fe038154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fe0377fe640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0380d0290 0x7fe038153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/2749912702 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e0047cd0 con 0x7fa0e004eb60 2024-09-11T22:11:24.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7f96457fa640 1 -- 172.21.15.50:0/1427398406 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9634044020 con 0x7f964000ba50 2024-09-11T22:11:24.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.120+0000 7fe03e791640 1 -- 172.21.15.50:0/2506751055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe038073130 con 0x7fe038071110 2024-09-11T22:11:24.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7fe03e791640 1 -- 172.21.15.50:0/2506751055 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe03806df90 con 0x7fe038158310 2024-09-11T22:11:24.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7f193ad31640 1 -- 172.21.15.50:0/985788002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f193406e290 con 0x7f193415f4b0 2024-09-11T22:11:24.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7f193ad31640 1 -- 172.21.15.50:0/985788002 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f193415f940 con 0x7f193415b320 2024-09-11T22:11:24.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7f65abb76640 1 -- 172.21.15.50:0/1801234169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a415be10 con 0x7f65a406d780 2024-09-11T22:11:24.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7fe037fff640 1 -- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe038158310 msgr2=0x7fe038154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7fe037fff640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe038158310 0x7fe038154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7fe037fff640 1 -- 172.21.15.50:0/2506751055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0380d0290 msgr2=0x7fe038153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7fe037fff640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0380d0290 0x7fe038153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7fe037fff640 1 -- 172.21.15.50:0/2506751055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0381f3880 con 0x7fe038071110 2024-09-11T22:11:24.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7f96457fa640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f962c06bf00 0x7f962c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7f1933fff640 1 -- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193415f4b0 msgr2=0x7f19341f9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7fa0ee1cb640 1 -- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0e004eb60 msgr2=0x7fa0e017d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7fa0ee1cb640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0e004eb60 0x7fa0e017d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7fa0ee1cb640 1 -- 172.21.15.50:0/2749912702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0e0005ab0 msgr2=0x7fa0e0049920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7f3387fff640 1 --2- 172.21.15.50:0/184479578 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f338c06beb0 0x7f338c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7f9647fff640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f962c06bf00 0x7f962c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7f1933fff640 1 --2- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193415f4b0 0x7f19341f9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7f96457fa640 1 -- 172.21.15.50:0/1427398406 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f96340ab960 con 0x7f964000ba50 2024-09-11T22:11:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7f1933fff640 1 -- 172.21.15.50:0/985788002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19340d0580 msgr2=0x7f1934157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7fa0ee1cb640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0e0005ab0 0x7fa0e0049920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7fa0ee1cb640 1 -- 172.21.15.50:0/2749912702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e0048170 con 0x7fa0e00e7120 2024-09-11T22:11:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7fa0ed9ca640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0e0005ab0 0x7fa0e0049920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7f1933fff640 1 --2- 172.21.15.50:0/985788002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19340d0580 0x7f1934157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.121+0000 7f1933fff640 1 -- 172.21.15.50:0/985788002 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193415cea0 con 0x7f193415b320 2024-09-11T22:11:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7f3387fff640 1 -- 172.21.15.50:0/184479578 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f339808a2a0 con 0x7f33a006ee20 2024-09-11T22:11:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7f1933fff640 1 --2- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 0x7f19341fb960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f192800d830 tx=0x7f192800dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7f339effd640 1 --2- 172.21.15.50:0/184479578 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f338c06beb0 0x7f338c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7fe037fff640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe038071110 0x7fe0381560b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe02800c7f0 tx=0x7fe02800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7fa0ee1cb640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0e00e7120 0x7fa0e0048f30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800b3e0 tx=0x7fa0d800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7fb09026e640 1 -- 172.21.15.50:0/2089533785 shutdown_connections 2024-09-11T22:11:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7f19317fa640 1 -- 172.21.15.50:0/985788002 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192800b6c0 con 0x7f193415b320 2024-09-11T22:11:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7f19317fa640 1 -- 172.21.15.50:0/985788002 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1928019070 con 0x7f193415b320 2024-09-11T22:11:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7fb09026e640 1 -- 172.21.15.50:0/2089533785 wait complete. 2024-09-11T22:11:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7f19317fa640 1 -- 172.21.15.50:0/985788002 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192800ba80 con 0x7f193415b320 2024-09-11T22:11:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7f193ad31640 1 -- 172.21.15.50:0/985788002 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193415d180 con 0x7f193415b320 2024-09-11T22:11:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7f9647fff640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f962c06bf00 0x7f962c06e3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96480518b0 tx=0x7f964806e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7f193ad31640 1 -- 172.21.15.50:0/985788002 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f193415d740 con 0x7f193415b320 2024-09-11T22:11:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7f339effd640 1 --2- 172.21.15.50:0/184479578 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f338c06beb0 0x7f338c06e370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3390034000 tx=0x7f339002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7fe034ff9640 1 -- 172.21.15.50:0/2506751055 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028015070 con 0x7fe038071110 2024-09-11T22:11:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.122+0000 7fa0de7fc640 1 -- 172.21.15.50:0/2749912702 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8015020 con 0x7fa0e00e7120 2024-09-11T22:11:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.123+0000 7fe03e791640 1 -- 172.21.15.50:0/2506751055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0381f3b60 con 0x7fe038071110 2024-09-11T22:11:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.123+0000 7fa0de7fc640 1 -- 172.21.15.50:0/2749912702 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d8011850 con 0x7fa0e00e7120 2024-09-11T22:11:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.123+0000 7fa0de7fc640 1 -- 172.21.15.50:0/2749912702 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8011c40 con 0x7fa0e00e7120 2024-09-11T22:11:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.123+0000 7fe034ff9640 1 -- 172.21.15.50:0/2506751055 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe028007820 con 0x7fe038071110 2024-09-11T22:11:24.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.123+0000 7fe03e791640 1 -- 172.21.15.50:0/2506751055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0381f4120 con 0x7fe038071110 2024-09-11T22:11:24.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.123+0000 7fc558ff9640 1 -- 172.21.15.50:0/1650004603 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc55001f020 con 0x7fc55c0728f0 2024-09-11T22:11:24.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.123+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/2749912702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e0048450 con 0x7fa0e00e7120 2024-09-11T22:11:24.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.123+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/2749912702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e0049470 con 0x7fa0e00e7120 2024-09-11T22:11:24.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.124+0000 7fe034ff9640 1 -- 172.21.15.50:0/2506751055 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028007bd0 con 0x7fe038071110 2024-09-11T22:11:24.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.124+0000 7f193ad31640 1 -- 172.21.15.50:0/985788002 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193415d940 con 0x7f193415b320 2024-09-11T22:11:24.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.124+0000 7fb09026e640 1 Processor -- start 2024-09-11T22:11:24.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.124+0000 7fb09026e640 1 -- start start 2024-09-11T22:11:24.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.124+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/2749912702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e0008860 con 0x7fa0e00e7120 2024-09-11T22:11:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.124+0000 7f19317fa640 1 -- 172.21.15.50:0/985788002 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f192801e460 con 0x7f193415b320 2024-09-11T22:11:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.125+0000 7f19317fa640 1 --2- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f191806be30 0x7f191806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.125+0000 7fe03e791640 1 -- 172.21.15.50:0/2506751055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe038072b00 con 0x7fe038071110 2024-09-11T22:11:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.125+0000 7fe034ff9640 1 -- 172.21.15.50:0/2506751055 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe028018070 con 0x7fe038071110 2024-09-11T22:11:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.125+0000 7f19317fa640 1 -- 172.21.15.50:0/985788002 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f192808b480 con 0x7f193415b320 2024-09-11T22:11:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.125+0000 7f1938acd640 1 --2- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f191806be30 0x7f191806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.125+0000 7fa0de7fc640 1 -- 172.21.15.50:0/2749912702 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0d8018020 con 0x7fa0e00e7120 2024-09-11T22:11:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fa0de7fc640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa0cc06be30 0x7fa0cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fb09026e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0881576f0 0x7fb088158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fb09026e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb08815b0b0 0x7fb08815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fe034ff9640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe02006be30 0x7fe02006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fb09026e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0880c9f70 0x7fb0880ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fe034ff9640 1 -- 172.21.15.50:0/2506751055 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe02808aef0 con 0x7fe038071110 2024-09-11T22:11:24.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fb09026e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb08815ed60 con 0x7fb0881576f0 2024-09-11T22:11:24.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fa0ed9ca640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa0cc06be30 0x7fa0cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fb08e00a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0881576f0 0x7fb088158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fb08e80b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0880c9f70 0x7fb0880ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fb08e00a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0881576f0 0x7fb088158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46620/0 (socket says 172.21.15.50:46620) 2024-09-11T22:11:24.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fb08e00a640 1 -- 172.21.15.50:0/1209237383 learned_addr learned my addr 172.21.15.50:0/1209237383 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:24.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fb08e80b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0880c9f70 0x7fb0880ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47530/0 (socket says 172.21.15.50:47530) 2024-09-11T22:11:24.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7f1938acd640 1 --2- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f191806be30 0x7f191806e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1920033000 tx=0x7f192002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fb09026e640 1 -- 172.21.15.50:0/1209237383 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0880d3660 con 0x7fb08815b0b0 2024-09-11T22:11:24.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fb08d809640 1 --2- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb08815b0b0 0x7fb08815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fb09026e640 1 -- 172.21.15.50:0/1209237383 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb0880b7dc0 con 0x7fb0880c9f70 2024-09-11T22:11:24.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fa0de7fc640 1 -- 172.21.15.50:0/2749912702 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa0d808ac40 con 0x7fa0e00e7120 2024-09-11T22:11:24.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.126+0000 7fe0377fe640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe02006be30 0x7fe02006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.127+0000 7fa0ed9ca640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa0cc06be30 0x7fa0cc06e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0052260 tx=0x7fa0e8068a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.127+0000 7f3387fff640 1 -- 172.21.15.50:0/184479578 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3398058c40 con 0x7f33a006ee20 2024-09-11T22:11:24.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.127+0000 7fb08e80b640 1 -- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb08815b0b0 msgr2=0x7fb08815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.127+0000 7fb08e80b640 1 --2- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb08815b0b0 0x7fb08815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.127+0000 7fb08e80b640 1 -- 172.21.15.50:0/1209237383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0881576f0 msgr2=0x7fb088158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.127+0000 7fb08e80b640 1 --2- 172.21.15.50:0/1209237383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0881576f0 0x7fb088158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.127+0000 7fb08e80b640 1 -- 172.21.15.50:0/1209237383 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0881604f0 con 0x7fb0880c9f70 2024-09-11T22:11:24.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.127+0000 7fe0377fe640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe02006be30 0x7fe02006e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe038152680 tx=0x7fe024008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.127+0000 7fb08e80b640 1 --2- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0880c9f70 0x7fb0880ca3f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb088075aa0 tx=0x7fb08000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.128+0000 7f659a7fc640 1 -- 172.21.15.50:0/1801234169 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65a00129d0 con 0x7f65a406d780 2024-09-11T22:11:24.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.129+0000 7f659a7fc640 1 --2- 172.21.15.50:0/1801234169 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f658806be80 0x7f658806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.129+0000 7f65a9111640 1 --2- 172.21.15.50:0/1801234169 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f658806be80 0x7f658806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.129+0000 7f65a9111640 1 --2- 172.21.15.50:0/1801234169 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f658806be80 0x7f658806e340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f65a4154d40 tx=0x7f659c005b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.130+0000 7fb07effd640 1 -- 172.21.15.50:0/1209237383 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08000ed10 con 0x7fb0880c9f70 2024-09-11T22:11:24.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.130+0000 7fb07effd640 1 -- 172.21.15.50:0/1209237383 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb080019070 con 0x7fb0880c9f70 2024-09-11T22:11:24.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.130+0000 7f19317fa640 1 -- 172.21.15.50:0/985788002 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f193415d940 con 0x7f193415b320 2024-09-11T22:11:24.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.131+0000 7fb07effd640 1 -- 172.21.15.50:0/1209237383 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080014660 con 0x7fb0880c9f70 2024-09-11T22:11:24.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.131+0000 7fe034ff9640 1 -- 172.21.15.50:0/2506751055 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe028059240 con 0x7fe038071110 2024-09-11T22:11:24.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.131+0000 7fb09026e640 1 -- 172.21.15.50:0/1209237383 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb088160790 con 0x7fb0880c9f70 2024-09-11T22:11:24.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.131+0000 7fb09026e640 1 -- 172.21.15.50:0/1209237383 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb088160d50 con 0x7fb0880c9f70 2024-09-11T22:11:24.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.132+0000 7f659a7fc640 1 -- 172.21.15.50:0/1801234169 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f65a00579a0 con 0x7f65a406d780 2024-09-11T22:11:24.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.133+0000 7f96457fa640 1 -- 172.21.15.50:0/1427398406 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f963404b030 con 0x7f964000ba50 2024-09-11T22:11:24.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.133+0000 7fb07cff9640 1 -- 172.21.15.50:0/1209237383 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0880d0f80 con 0x7fb0880c9f70 2024-09-11T22:11:24.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.133+0000 7fb07effd640 1 -- 172.21.15.50:0/1209237383 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb080014800 con 0x7fb0880c9f70 2024-09-11T22:11:24.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.134+0000 7fb07effd640 1 --2- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb06c06be80 0x7fb06c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:24.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.134+0000 7fb07effd640 1 -- 172.21.15.50:0/1209237383 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb08008aff0 con 0x7fb0880c9f70 2024-09-11T22:11:24.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.134+0000 7fb08e00a640 1 --2- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb06c06be80 0x7fb06c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:24.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.135+0000 7fb08e00a640 1 --2- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb06c06be80 0x7fb06c06e340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb084001860 tx=0x7fb084001e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:24.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.135+0000 7fa0de7fc640 1 -- 172.21.15.50:0/2749912702 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0d801f020 con 0x7fa0e00e7120 2024-09-11T22:11:24.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.138+0000 7fb07effd640 1 -- 172.21.15.50:0/1209237383 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb080059430 con 0x7fb0880c9f70 2024-09-11T22:11:24.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.141+0000 7f659a7fc640 1 -- 172.21.15.50:0/1801234169 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65a0019300 con 0x7f65a406d780 2024-09-11T22:11:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.530+0000 7fc562796640 1 -- 172.21.15.50:0/1650004603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc53c005580 con 0x7fc55c0728f0 2024-09-11T22:11:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.531+0000 7fc558ff9640 1 -- 172.21.15.50:0/1650004603 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc550059020 con 0x7fc55c0728f0 2024-09-11T22:11:24.531 INFO:teuthology.orchestra.run.smithi050.stdout:64424509447 2024-09-11T22:11:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.534+0000 7fc5427fc640 1 -- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc54806be80 msgr2=0x7fc54806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.535+0000 7fc5427fc640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc54806be80 0x7fc54806e340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc54c033000 tx=0x7fc54c02e000 comp rx=0 tx=0).stop 2024-09-11T22:11:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.535+0000 7fc5427fc640 1 -- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc55c0728f0 msgr2=0x7fc55c1571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.535+0000 7fc5427fc640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc55c0728f0 0x7fc55c1571d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc55000b3e0 tx=0x7fc55000b8a0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.535+0000 7fc5427fc640 1 -- 172.21.15.50:0/1650004603 shutdown_connections 2024-09-11T22:11:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.535+0000 7fc5427fc640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc54806be80 0x7fc54806e340 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.535+0000 7fc5427fc640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc55c0b2bf0 0x7fc55c1f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.535+0000 7fc5427fc640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc55c072fd0 0x7fc55c154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.535+0000 7fc5427fc640 1 --2- 172.21.15.50:0/1650004603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc55c0728f0 0x7fc55c1571d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.535+0000 7fc5427fc640 1 -- 172.21.15.50:0/1650004603 >> 172.21.15.50:0/1650004603 conn(0x7fc55c0b2100 msgr2=0x7fc55c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.536+0000 7fc5427fc640 1 -- 172.21.15.50:0/1650004603 shutdown_connections 2024-09-11T22:11:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.536+0000 7fc5427fc640 1 -- 172.21.15.50:0/1650004603 wait complete. 2024-09-11T22:11:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.540+0000 7f33a5f28640 1 -- 172.21.15.50:0/184479578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f33a015fcd0 con 0x7f33a006ee20 2024-09-11T22:11:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.540+0000 7f193ad31640 1 -- 172.21.15.50:0/985788002 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f193415fda0 con 0x7f193415b320 2024-09-11T22:11:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.541+0000 7f3387fff640 1 -- 172.21.15.50:0/184479578 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3398058540 con 0x7f33a006ee20 2024-09-11T22:11:24.541 INFO:teuthology.orchestra.run.smithi050.stdout:64424509445 2024-09-11T22:11:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.542+0000 7f19317fa640 1 -- 172.21.15.50:0/985788002 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1928059e20 con 0x7f193415b320 2024-09-11T22:11:24.542 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-09-11T22:11:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.544+0000 7fe03e791640 1 -- 172.21.15.50:0/2506751055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe0380b5410 con 0x7fe038071110 2024-09-11T22:11:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.544+0000 7fe034ff9640 1 -- 172.21.15.50:0/2506751055 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe02805d540 con 0x7fe038071110 2024-09-11T22:11:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.544+0000 7f33a5f28640 1 -- 172.21.15.50:0/184479578 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f338c06beb0 msgr2=0x7f338c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.544+0000 7f33a5f28640 1 --2- 172.21.15.50:0/184479578 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f338c06beb0 0x7f338c06e370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3390034000 tx=0x7f339002e000 comp rx=0 tx=0).stop 2024-09-11T22:11:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.545+0000 7f33a5f28640 1 -- 172.21.15.50:0/184479578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a006ee20 msgr2=0x7f33a00cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.545+0000 7f33a5f28640 1 --2- 172.21.15.50:0/184479578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a006ee20 0x7f33a00cef30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f339800c780 tx=0x7f339800cc40 comp rx=0 tx=0).stop 2024-09-11T22:11:24.546 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2024-09-11T22:11:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.545+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/2749912702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa0e001d180 con 0x7fa0e00e7120 2024-09-11T22:11:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.545+0000 7f33a5f28640 1 -- 172.21.15.50:0/184479578 shutdown_connections 2024-09-11T22:11:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.545+0000 7f33a5f28640 1 --2- 172.21.15.50:0/184479578 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f338c06beb0 0x7f338c06e370 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.545+0000 7f33a5f28640 1 --2- 172.21.15.50:0/184479578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33a00d0760 0x7f33a0156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.545+0000 7f33a5f28640 1 --2- 172.21.15.50:0/184479578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a0162940 0x7f33a015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.545+0000 7f33a5f28640 1 --2- 172.21.15.50:0/184479578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a006ee20 0x7f33a00cef30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.545+0000 7f33a5f28640 1 -- 172.21.15.50:0/184479578 >> 172.21.15.50:0/184479578 conn(0x7f33a00679c0 msgr2=0x7f33a0159740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.545+0000 7fa0de7fc640 1 -- 172.21.15.50:0/2749912702 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa0d801f020 con 0x7fa0e00e7120 2024-09-11T22:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-09-11T22:11:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.546+0000 7f33a5f28640 1 -- 172.21.15.50:0/184479578 shutdown_connections 2024-09-11T22:11:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.546+0000 7f33a5f28640 1 -- 172.21.15.50:0/184479578 wait complete. 2024-09-11T22:11:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.545+0000 7f193ad31640 1 -- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f191806be30 msgr2=0x7f191806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.545+0000 7f193ad31640 1 --2- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f191806be30 0x7f191806e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1920033000 tx=0x7f192002e000 comp rx=0 tx=0).stop 2024-09-11T22:11:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.546+0000 7f193ad31640 1 -- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 msgr2=0x7f19341fb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.546+0000 7f193ad31640 1 --2- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 0x7f19341fb960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f192800d830 tx=0x7f192800dcf0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.546+0000 7f193ad31640 1 -- 172.21.15.50:0/985788002 shutdown_connections 2024-09-11T22:11:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.546+0000 7f193ad31640 1 --2- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f191806be30 0x7f191806e2f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.546+0000 7f193ad31640 1 --2- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f193415b320 0x7f19341fb960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.546+0000 7f193ad31640 1 --2- 172.21.15.50:0/985788002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193415f4b0 0x7f19341f9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.546+0000 7f193ad31640 1 --2- 172.21.15.50:0/985788002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19340d0580 0x7f1934157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.546+0000 7f193ad31640 1 -- 172.21.15.50:0/985788002 >> 172.21.15.50:0/985788002 conn(0x7f1934075030 msgr2=0x7f19340b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.546+0000 7f193ad31640 1 -- 172.21.15.50:0/985788002 shutdown_connections 2024-09-11T22:11:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.546+0000 7f193ad31640 1 -- 172.21.15.50:0/985788002 wait complete. 2024-09-11T22:11:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.546+0000 7f964da55640 1 -- 172.21.15.50:0/1427398406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9640032910 con 0x7f964000ba50 2024-09-11T22:11:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.547+0000 7f96457fa640 1 -- 172.21.15.50:0/1427398406 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9634079d30 con 0x7f964000ba50 2024-09-11T22:11:24.550 INFO:teuthology.orchestra.run.smithi050.stdout:64424509444 2024-09-11T22:11:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.548+0000 7fb07cff9640 1 -- 172.21.15.50:0/1209237383 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb0880d01e0 con 0x7fb0880c9f70 2024-09-11T22:11:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.548+0000 7fe03e791640 1 -- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe02006be30 msgr2=0x7fe02006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.548+0000 7fe03e791640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe02006be30 0x7fe02006e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe038152680 tx=0x7fe024008040 comp rx=0 tx=0).stop 2024-09-11T22:11:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.548+0000 7fe03e791640 1 -- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe038071110 msgr2=0x7fe0381560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.548+0000 7fe03e791640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe038071110 0x7fe0381560b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe02800c7f0 tx=0x7fe02800ccb0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.548+0000 7fe03e791640 1 -- 172.21.15.50:0/2506751055 shutdown_connections 2024-09-11T22:11:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.548+0000 7fe03e791640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe02006be30 0x7fe02006e2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.548+0000 7fe03e791640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe038158310 0x7fe038154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.548+0000 7fe03e791640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0380d0290 0x7fe038153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.548+0000 7fe03e791640 1 --2- 172.21.15.50:0/2506751055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe038071110 0x7fe0381560b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.549+0000 7fe03e791640 1 -- 172.21.15.50:0/2506751055 >> 172.21.15.50:0/2506751055 conn(0x7fe0380679c0 msgr2=0x7fe03815a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.549+0000 7fb07effd640 1 -- 172.21.15.50:0/1209237383 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb08005d730 con 0x7fb0880c9f70 2024-09-11T22:11:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.549+0000 7fe03e791640 1 -- 172.21.15.50:0/2506751055 shutdown_connections 2024-09-11T22:11:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.549+0000 7fe03e791640 1 -- 172.21.15.50:0/2506751055 wait complete. 2024-09-11T22:11:24.553 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-09-11T22:11:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.549+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa0cc06be30 msgr2=0x7fa0cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.549+0000 7fa0ee9cc640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa0cc06be30 0x7fa0cc06e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0052260 tx=0x7fa0e8068a90 comp rx=0 tx=0).stop 2024-09-11T22:11:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.549+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0e00e7120 msgr2=0x7fa0e0048f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.549+0000 7fa0ee9cc640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0e00e7120 0x7fa0e0048f30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800b3e0 tx=0x7fa0d800b8a0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.550+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/2749912702 shutdown_connections 2024-09-11T22:11:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.550+0000 7fa0ee9cc640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa0cc06be30 0x7fa0cc06e2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.550+0000 7fa0ee9cc640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0e004eb60 0x7fa0e017d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.550+0000 7fa0ee9cc640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0e00e7120 0x7fa0e0048f30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.550+0000 7fa0ee9cc640 1 --2- 172.21.15.50:0/2749912702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0e0005ab0 0x7fa0e0049920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.550+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/2749912702 >> 172.21.15.50:0/2749912702 conn(0x7fa0e0036090 msgr2=0x7fa0e001d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.550+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/2749912702 shutdown_connections 2024-09-11T22:11:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.550+0000 7fa0ee9cc640 1 -- 172.21.15.50:0/2749912702 wait complete. 2024-09-11T22:11:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.551+0000 7f964da55640 1 -- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f962c06bf00 msgr2=0x7f962c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.551+0000 7f964da55640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f962c06bf00 0x7f962c06e3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96480518b0 tx=0x7f964806e040 comp rx=0 tx=0).stop 2024-09-11T22:11:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.551+0000 7f964da55640 1 -- 172.21.15.50:0/1427398406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964000ba50 msgr2=0x7f964004b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.551+0000 7f964da55640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964000ba50 0x7f964004b970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f96340090b0 tx=0x7f96340046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.551+0000 7f964da55640 1 -- 172.21.15.50:0/1427398406 shutdown_connections 2024-09-11T22:11:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.551+0000 7f964da55640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f962c06bf00 0x7f962c06e3c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.551+0000 7f964da55640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f964000be30 0x7f96400d4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.551+0000 7f964da55640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96400376c0 0x7f96400d4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.551+0000 7f964da55640 1 --2- 172.21.15.50:0/1427398406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964000ba50 0x7f964004b970 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.551+0000 7f964da55640 1 -- 172.21.15.50:0/1427398406 >> 172.21.15.50:0/1427398406 conn(0x7f964001ea50 msgr2=0x7f9640037ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.551+0000 7f964da55640 1 -- 172.21.15.50:0/1427398406 shutdown_connections 2024-09-11T22:11:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.551+0000 7f964da55640 1 -- 172.21.15.50:0/1427398406 wait complete. 2024-09-11T22:11:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.553+0000 7fb07cff9640 1 -- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb06c06be80 msgr2=0x7fb06c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.553+0000 7fb07cff9640 1 --2- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb06c06be80 0x7fb06c06e340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb084001860 tx=0x7fb084001e30 comp rx=0 tx=0).stop 2024-09-11T22:11:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.553+0000 7fb07cff9640 1 -- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0880c9f70 msgr2=0x7fb0880ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.553+0000 7fb07cff9640 1 --2- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0880c9f70 0x7fb0880ca3f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb088075aa0 tx=0x7fb08000e4b0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.553+0000 7fb07cff9640 1 -- 172.21.15.50:0/1209237383 shutdown_connections 2024-09-11T22:11:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.553+0000 7fb07cff9640 1 --2- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb06c06be80 0x7fb06c06e340 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.553+0000 7fb07cff9640 1 --2- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0880c9f70 0x7fb0880ca3f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.553+0000 7fb07cff9640 1 --2- 172.21.15.50:0/1209237383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb08815b0b0 0x7fb08815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.553+0000 7fb07cff9640 1 --2- 172.21.15.50:0/1209237383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0881576f0 0x7fb088158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.553+0000 7fb07cff9640 1 -- 172.21.15.50:0/1209237383 >> 172.21.15.50:0/1209237383 conn(0x7fb0880679c0 msgr2=0x7fb0880cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.554+0000 7fb07cff9640 1 -- 172.21.15.50:0/1209237383 shutdown_connections 2024-09-11T22:11:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.554+0000 7fb07cff9640 1 -- 172.21.15.50:0/1209237383 wait complete. 2024-09-11T22:11:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.555+0000 7f65abb76640 1 -- 172.21.15.50:0/1801234169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f65a40728f0 con 0x7f65a406d780 2024-09-11T22:11:24.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.6 2024-09-11T22:11:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.556+0000 7f659a7fc640 1 -- 172.21.15.50:0/1801234169 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f65a005a000 con 0x7f65a406d780 2024-09-11T22:11:24.560 INFO:teuthology.orchestra.run.smithi050.stdout:55834574853 2024-09-11T22:11:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.560+0000 7f65abb76640 1 -- 172.21.15.50:0/1801234169 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f658806be80 msgr2=0x7f658806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.560+0000 7f65abb76640 1 --2- 172.21.15.50:0/1801234169 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f658806be80 0x7f658806e340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f65a4154d40 tx=0x7f659c005b70 comp rx=0 tx=0).stop 2024-09-11T22:11:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.560+0000 7f65abb76640 1 -- 172.21.15.50:0/1801234169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a406d780 msgr2=0x7f65a4151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.560+0000 7f65abb76640 1 --2- 172.21.15.50:0/1801234169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a406d780 0x7f65a4151f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f65a000c460 tx=0x7f65a000c920 comp rx=0 tx=0).stop 2024-09-11T22:11:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.561+0000 7f65abb76640 1 -- 172.21.15.50:0/1801234169 shutdown_connections 2024-09-11T22:11:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.561+0000 7f65abb76640 1 --2- 172.21.15.50:0/1801234169 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f658806be80 0x7f658806e340 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.561+0000 7f65abb76640 1 --2- 172.21.15.50:0/1801234169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a40af6d0 0x7f65a40b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.561+0000 7f65abb76640 1 --2- 172.21.15.50:0/1801234169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a415a5f0 0x7f65a40cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.561+0000 7f65abb76640 1 --2- 172.21.15.50:0/1801234169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a406d780 0x7f65a4151f70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.561+0000 7f65abb76640 1 -- 172.21.15.50:0/1801234169 >> 172.21.15.50:0/1801234169 conn(0x7f65a40b2100 msgr2=0x7f65a40b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.561+0000 7f65abb76640 1 -- 172.21.15.50:0/1801234169 shutdown_connections 2024-09-11T22:11:24.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:24.561+0000 7f65abb76640 1 -- 172.21.15.50:0/1801234169 wait complete. 2024-09-11T22:11:24.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2024-09-11T22:11:24.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-09-11T22:11:24.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-09-11T22:11:24.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.5 2024-09-11T22:11:24.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-09-11T22:11:24.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.4 2024-09-11T22:11:24.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-09-11T22:11:25.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T22:11:25.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T22:11:25.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T22:11:25.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T22:11:25.575 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T22:11:25.576 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T22:11:25.576 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T22:11:25.579 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T22:11:25.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.729+0000 7efed6359640 1 Processor -- start 2024-09-11T22:11:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.731+0000 7efed6359640 1 -- start start 2024-09-11T22:11:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.732+0000 7efed6359640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efed015a5f0 0x7efed006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.732+0000 7efed6359640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efed015a9d0 0x7efed006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.732+0000 7efed6359640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed00b3400 con 0x7efed0072fd0 2024-09-11T22:11:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.732+0000 7efed6359640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7efed0071e90 con 0x7efed015a5f0 2024-09-11T22:11:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.732+0000 7efed6359640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efed00720e0 con 0x7efed015a9d0 2024-09-11T22:11:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.733+0000 7efed48f6640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7efed0072fd0 0x7efed015e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:58704/0 (socket says 172.21.15.50:58704) 2024-09-11T22:11:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.733+0000 7efecffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efed015a5f0 0x7efed006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.733+0000 7efed48f6640 1 -- 172.21.15.50:0/3369624720 learned_addr learned my addr 172.21.15.50:0/3369624720 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.734+0000 7efecffff640 1 -- 172.21.15.50:0/3369624720 >> v2:172.21.15.77:3300/0 conn(0x7efed015a9d0 msgr2=0x7efed006d5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:11:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.734+0000 7efecffff640 1 --2- 172.21.15.50:0/3369624720 >> v2:172.21.15.77:3300/0 conn(0x7efed015a9d0 0x7efed006d5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.734+0000 7efecffff640 1 -- 172.21.15.50:0/3369624720 >> v1:172.21.15.77:6789/0 conn(0x7efed0072fd0 legacy=0x7efed015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.735+0000 7efecffff640 1 -- 172.21.15.50:0/3369624720 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed00723c0 con 0x7efed015a5f0 2024-09-11T22:11:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.736+0000 7efecffff640 1 --2- 172.21.15.50:0/3369624720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efed015a5f0 0x7efed006d070 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efed0072010 tx=0x7efec002a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3ef2e06a7cdf1c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.736+0000 7efeceffd640 1 -- 172.21.15.50:0/3369624720 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec0037070 con 0x7efed015a5f0 2024-09-11T22:11:25.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.737+0000 7efeceffd640 1 -- 172.21.15.50:0/3369624720 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec002ada0 con 0x7efed015a5f0 2024-09-11T22:11:25.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.738+0000 7efed6359640 1 -- 172.21.15.50:0/3369624720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efed015a5f0 msgr2=0x7efed006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.738+0000 7efed6359640 1 --2- 172.21.15.50:0/3369624720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efed015a5f0 0x7efed006d070 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efed0072010 tx=0x7efec002a320 comp rx=0 tx=0).stop 2024-09-11T22:11:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.738+0000 7efed6359640 1 -- 172.21.15.50:0/3369624720 shutdown_connections 2024-09-11T22:11:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.738+0000 7efed6359640 1 --2- 172.21.15.50:0/3369624720 >> v2:172.21.15.77:3300/0 conn(0x7efed015a9d0 0x7efed006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.738+0000 7efed6359640 1 --2- 172.21.15.50:0/3369624720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efed015a5f0 0x7efed006d070 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.738+0000 7efed6359640 1 -- 172.21.15.50:0/3369624720 >> 172.21.15.50:0/3369624720 conn(0x7efed00b2100 msgr2=0x7efed00b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.739+0000 7efed6359640 1 -- 172.21.15.50:0/3369624720 shutdown_connections 2024-09-11T22:11:25.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.739+0000 7efed6359640 1 -- 172.21.15.50:0/3369624720 wait complete. 2024-09-11T22:11:25.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.741+0000 7efed6359640 1 Processor -- start 2024-09-11T22:11:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.741+0000 7efed6359640 1 -- start start 2024-09-11T22:11:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.742+0000 7efed6359640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efed0072fd0 0x7efed014b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.742+0000 7efed6359640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efed015a5f0 0x7efed01579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.742+0000 7efed6359640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efed01f8d50 0x7efed014cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.742+0000 7efed6359640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efed00b2d70 con 0x7efed01f8d50 2024-09-11T22:11:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.743+0000 7efed6359640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efed00b2bf0 con 0x7efed0072fd0 2024-09-11T22:11:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.743+0000 7efed6359640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efed00728f0 con 0x7efed015a5f0 2024-09-11T22:11:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.743+0000 7efed48f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efed01f8d50 0x7efed014cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.743+0000 7efed48f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efed01f8d50 0x7efed014cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46642/0 (socket says 172.21.15.50:46642) 2024-09-11T22:11:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.744+0000 7efed48f6640 1 -- 172.21.15.50:0/4171940898 learned_addr learned my addr 172.21.15.50:0/4171940898 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.744+0000 7efed48f6640 1 -- 172.21.15.50:0/4171940898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efed015a5f0 msgr2=0x7efed01579f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:11:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.744+0000 7efed48f6640 1 --2- 172.21.15.50:0/4171940898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efed015a5f0 0x7efed01579f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.744+0000 7efed48f6640 1 -- 172.21.15.50:0/4171940898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efed0072fd0 msgr2=0x7efed014b0d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:11:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.744+0000 7efed48f6640 1 --2- 172.21.15.50:0/4171940898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efed0072fd0 0x7efed014b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.745+0000 7efed48f6640 1 -- 172.21.15.50:0/4171940898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed014b610 con 0x7efed01f8d50 2024-09-11T22:11:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.745+0000 7efed48f6640 1 --2- 172.21.15.50:0/4171940898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efed01f8d50 0x7efed014cd90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efec800cb30 tx=0x7efec800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.745+0000 7efeccff9640 1 -- 172.21.15.50:0/4171940898 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec8018070 con 0x7efed01f8d50 2024-09-11T22:11:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.745+0000 7efeccff9640 1 -- 172.21.15.50:0/4171940898 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec8004d60 con 0x7efed01f8d50 2024-09-11T22:11:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.745+0000 7efeccff9640 1 -- 172.21.15.50:0/4171940898 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec800aa90 con 0x7efed01f8d50 2024-09-11T22:11:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.745+0000 7efed6359640 1 -- 172.21.15.50:0/4171940898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed01582f0 con 0x7efed01f8d50 2024-09-11T22:11:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.745+0000 7efed6359640 1 -- 172.21.15.50:0/4171940898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed01588b0 con 0x7efed01f8d50 2024-09-11T22:11:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.748+0000 7efeccff9640 1 -- 172.21.15.50:0/4171940898 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efec801b070 con 0x7efed01f8d50 2024-09-11T22:11:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.749+0000 7efeccff9640 1 --2- 172.21.15.50:0/4171940898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efebc06be30 0x7efebc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.749+0000 7efeccff9640 1 -- 172.21.15.50:0/4171940898 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efec808a720 con 0x7efed01f8d50 2024-09-11T22:11:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.749+0000 7efed6359640 1 -- 172.21.15.50:0/4171940898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb0005290 con 0x7efed01f8d50 2024-09-11T22:11:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.751+0000 7efecffff640 1 --2- 172.21.15.50:0/4171940898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efebc06be30 0x7efebc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.759+0000 7efeccff9640 1 -- 172.21.15.50:0/4171940898 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efec80590c0 con 0x7efed01f8d50 2024-09-11T22:11:25.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.768+0000 7efecffff640 1 --2- 172.21.15.50:0/4171940898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efebc06be30 0x7efebc06e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efec0034000 tx=0x7efec002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.785+0000 7f67f680e640 1 Processor -- start 2024-09-11T22:11:25.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.785+0000 7f67f680e640 1 -- start start 2024-09-11T22:11:25.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.786+0000 7f0561c7b640 1 Processor -- start 2024-09-11T22:11:25.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.786+0000 7f8b76a43640 1 Processor -- start 2024-09-11T22:11:25.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.786+0000 7f8b76a43640 1 -- start start 2024-09-11T22:11:25.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.787+0000 7f67f680e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67f006ee20 0x7f67f00d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.787+0000 7f67f680e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67f00b44a0 con 0x7f67f0162940 2024-09-11T22:11:25.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.787+0000 7f67f680e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67f00b3400 con 0x7f67f00d0760 2024-09-11T22:11:25.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.787+0000 7f67f680e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f67f00b36e0 con 0x7f67f006ee20 2024-09-11T22:11:25.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.787+0000 7f67effff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f67f0162940 0x7f67f006e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41272/0 (socket says 172.21.15.50:41272) 2024-09-11T22:11:25.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.787+0000 7f0561c7b640 1 -- start start 2024-09-11T22:11:25.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.787+0000 7f67effff640 1 -- 172.21.15.50:0/2098691372 learned_addr learned my addr 172.21.15.50:0/2098691372 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:25.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364456124 0 0) 0x7f67f00b44a0 con 0x7f67f0162940 2024-09-11T22:11:25.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67d8003520 con 0x7f67f0162940 2024-09-11T22:11:25.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1058646028 0 0) 0x7f67d8003520 con 0x7f67f0162940 2024-09-11T22:11:25.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f0561c7b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f055c0b3a50 0x7f055c16d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f0561c7b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055c067c10 con 0x7f055c0b4920 2024-09-11T22:11:25.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f0561c7b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055c067ef0 con 0x7f055c0b0ce0 2024-09-11T22:11:25.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f0561c7b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f055c0679c0 con 0x7f055c0b3a50 2024-09-11T22:11:25.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67f006ee20 msgr2=0x7f67f00d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:25.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 --2- 172.21.15.50:0/2098691372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67f006ee20 0x7f67f00d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 >> v1:172.21.15.77:6789/0 conn(0x7f67f00d0760 legacy=0x7f67f0071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:25.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f00b39c0 con 0x7f67f0162940 2024-09-11T22:11:25.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f67e4001670 con 0x7f67f0162940 2024-09-11T22:11:25.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 >> v1:172.21.15.50:6789/0 conn(0x7f67f0162940 legacy=0x7f67f006e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 --2- 172.21.15.50:0/2098691372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67f006ee20 0x7f67d80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f8b76a43640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b6803d790 0x7f8b68057ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 --2- 172.21.15.50:0/2098691372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67d80040d0 0x7f67d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 --2- 172.21.15.50:0/2098691372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d8004db0 0x7f67d8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f67f00b36e0 con 0x7f67d8004db0 2024-09-11T22:11:25.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f67d800bc20 con 0x7f67d80040d0 2024-09-11T22:11:25.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f67d800be20 con 0x7f67f006ee20 2024-09-11T22:11:25.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f67f4dab640 1 --2- 172.21.15.50:0/2098691372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d8004db0 0x7f67d8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f055bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f055c0b3a50 0x7f055c16d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f5326455640 1 Processor -- start 2024-09-11T22:11:25.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f055bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f055c0b3a50 0x7f055c16d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54828/0 (socket says 172.21.15.50:54828) 2024-09-11T22:11:25.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f055bfff640 1 -- 172.21.15.50:0/2230725637 learned_addr learned my addr 172.21.15.50:0/2230725637 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:25.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.788+0000 7f055b7fe640 1 --1- 172.21.15.50:0/2230725637 >> v1:172.21.15.77:6789/0 conn(0x7f055c0b0ce0 0x7f055c072bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:58722/0 (socket says 172.21.15.50:58722) 2024-09-11T22:11:25.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f055bfff640 1 -- 172.21.15.50:0/2230725637 >> v1:172.21.15.77:6789/0 conn(0x7f055c0b0ce0 legacy=0x7f055c072bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f055bfff640 1 -- 172.21.15.50:0/2230725637 >> v1:172.21.15.50:6789/0 conn(0x7f055c0b4920 legacy=0x7f055c0b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:25.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f055bfff640 1 -- 172.21.15.50:0/2230725637 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c0681d0 con 0x7f055c0b3a50 2024-09-11T22:11:25.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f67effff640 1 --2- 172.21.15.50:0/2098691372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67f006ee20 0x7f67d80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f67ef7fe640 1 --2- 172.21.15.50:0/2098691372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67d80040d0 0x7f67d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f8b76a43640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b68005dc0 0x7f8b68006270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f8b75a41640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8b680e2af0 0x7f8b680577e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41280/0 (socket says 172.21.15.50:41280) 2024-09-11T22:11:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f8b75a41640 1 -- 172.21.15.50:0/4197236218 learned_addr learned my addr 172.21.15.50:0/4197236218 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f8b76a43640 1 -- 172.21.15.50:0/4197236218 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b680e2ed0 con 0x7f8b680e2af0 2024-09-11T22:11:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f8b76a43640 1 -- 172.21.15.50:0/4197236218 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8b6803ba70 con 0x7f8b68005dc0 2024-09-11T22:11:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f8b76a43640 1 -- 172.21.15.50:0/4197236218 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6803c2f0 con 0x7f8b6803d790 2024-09-11T22:11:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f8b76242640 1 --2- 172.21.15.50:0/4197236218 >> v2:172.21.15.50:3300/0 conn(0x7f8b68005dc0 0x7f8b68006270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f67ef7fe640 1 -- 172.21.15.50:0/2098691372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67f006ee20 msgr2=0x7f67d80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:25.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f67ef7fe640 1 --2- 172.21.15.50:0/2098691372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67f006ee20 0x7f67d80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f67ef7fe640 1 -- 172.21.15.50:0/2098691372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d8004db0 msgr2=0x7f67d8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:25.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f67ef7fe640 1 --2- 172.21.15.50:0/2098691372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d8004db0 0x7f67d8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f67ef7fe640 1 -- 172.21.15.50:0/2098691372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f00b39c0 con 0x7f67d80040d0 2024-09-11T22:11:25.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.789+0000 7f5326455640 1 -- start start 2024-09-11T22:11:25.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.790+0000 7f8b74a3f640 1 -- 172.21.15.50:0/4197236218 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 945642686 0 0) 0x7f8b680e2ed0 con 0x7f8b680e2af0 2024-09-11T22:11:25.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.790+0000 7f8b74a3f640 1 -- 172.21.15.50:0/4197236218 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b5c003520 con 0x7f8b680e2af0 2024-09-11T22:11:25.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.790+0000 7f8b75240640 1 --2- 172.21.15.50:0/4197236218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b6803d790 0x7f8b68057ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.790+0000 7f284fad9640 1 Processor -- start 2024-09-11T22:11:25.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.790+0000 7f055bfff640 1 --2- 172.21.15.50:0/2230725637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055c0b3a50 0x7f055c16d840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f055c068a60 tx=0x7f055402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ede427c084709ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.790+0000 7f8b75240640 1 -- 172.21.15.50:0/4197236218 >> v2:172.21.15.50:3300/0 conn(0x7f8b68005dc0 msgr2=0x7f8b68006270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:25.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.790+0000 7f8b75240640 1 --2- 172.21.15.50:0/4197236218 >> v2:172.21.15.50:3300/0 conn(0x7f8b68005dc0 0x7f8b68006270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.790+0000 7f8b75240640 1 -- 172.21.15.50:0/4197236218 >> v1:172.21.15.50:6789/0 conn(0x7f8b680e2af0 legacy=0x7f8b680577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.790+0000 7f8b75240640 1 -- 172.21.15.50:0/4197236218 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b68058560 con 0x7f8b6803d790 2024-09-11T22:11:25.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.791+0000 7f67ef7fe640 1 --2- 172.21.15.50:0/2098691372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67d80040d0 0x7f67d8004800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009860 tx=0x7f67d8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ceda17e3e547f893 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.791+0000 7f284fad9640 1 -- start start 2024-09-11T22:11:25.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.791+0000 7f055a7fc640 1 -- 172.21.15.50:0/2230725637 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554036070 con 0x7f055c0b3a50 2024-09-11T22:11:25.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.791+0000 7f055a7fc640 1 -- 172.21.15.50:0/2230725637 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0554031600 con 0x7f055c0b3a50 2024-09-11T22:11:25.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.791+0000 7f2b307a6640 1 Processor -- start 2024-09-11T22:11:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.791+0000 7f5326455640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f53180dec70 0x7f5318006550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.791+0000 7f5326455640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5318009af0 0x7f5318009f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.791+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0037070 con 0x7f67d80040d0 2024-09-11T22:11:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.791+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e002aa40 con 0x7f67d80040d0 2024-09-11T22:11:25.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.791+0000 7f67eeffd640 1 -- 172.21.15.50:0/2098691372 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0037070 con 0x7f67d80040d0 2024-09-11T22:11:25.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f055a7fc640 1 -- 172.21.15.50:0/2230725637 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05540319d0 con 0x7f055c0b3a50 2024-09-11T22:11:25.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.791+0000 7f7b19f86640 1 Processor -- start 2024-09-11T22:11:25.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.791+0000 7f2b307a6640 1 -- start start 2024-09-11T22:11:25.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.791+0000 7f5326455640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531801c5c0 con 0x7f53180323c0 2024-09-11T22:11:25.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f5326455640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f531800a480 con 0x7f53180dec70 2024-09-11T22:11:25.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f5326455640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f531801c830 con 0x7f5318009af0 2024-09-11T22:11:25.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f5325c54640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5318009af0 0x7f5318009f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f5325c54640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5318009af0 0x7f5318009f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47568/0 (socket says 172.21.15.50:47568) 2024-09-11T22:11:25.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f5325c54640 1 -- 172.21.15.50:0/3898202697 learned_addr learned my addr 172.21.15.50:0/3898202697 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:25.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f5325453640 1 --2- 172.21.15.50:0/3898202697 >> v2:172.21.15.77:3300/0 conn(0x7f53180dec70 0x7f5318006550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f5325c54640 1 -- 172.21.15.50:0/3898202697 >> v2:172.21.15.77:3300/0 conn(0x7f53180dec70 msgr2=0x7f5318006550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:25.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f0561c7b640 1 -- 172.21.15.50:0/2230725637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055c0b3a50 msgr2=0x7f055c16d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f0561c7b640 1 --2- 172.21.15.50:0/2230725637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055c0b3a50 0x7f055c16d840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f055c068a60 tx=0x7f055402a660 comp rx=0 tx=0).stop 2024-09-11T22:11:25.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f5325c54640 1 --2- 172.21.15.50:0/3898202697 >> v2:172.21.15.77:3300/0 conn(0x7f53180dec70 0x7f5318006550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f5325c54640 1 -- 172.21.15.50:0/3898202697 >> v1:172.21.15.77:6789/0 conn(0x7f53180323c0 legacy=0x7f5318052350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f5325c54640 1 -- 172.21.15.50:0/3898202697 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531801cb10 con 0x7f5318009af0 2024-09-11T22:11:25.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f0561c7b640 1 -- 172.21.15.50:0/2230725637 shutdown_connections 2024-09-11T22:11:25.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f0561c7b640 1 --2- 172.21.15.50:0/2230725637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055c0b3a50 0x7f055c16d840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f0561c7b640 1 -- 172.21.15.50:0/2230725637 >> 172.21.15.50:0/2230725637 conn(0x7f055c074c40 msgr2=0x7f055c075020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:25.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f5325453640 1 --2- 172.21.15.50:0/3898202697 >> v2:172.21.15.77:3300/0 conn(0x7f53180dec70 0x7f5318006550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:25.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f7b19f86640 1 -- start start 2024-09-11T22:11:25.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.792+0000 7f284fad9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2840036d00 0x7f284001dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f284fad9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2840033e10 con 0x7f2840033490 2024-09-11T22:11:25.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f284fad9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2840033b30 con 0x7f284004eb90 2024-09-11T22:11:25.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f284fad9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f284001d000 con 0x7f2840036d00 2024-09-11T22:11:25.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f67f680e640 1 -- 172.21.15.50:0/2098691372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67d80040d0 msgr2=0x7f67d8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f8b75240640 1 --2- 172.21.15.50:0/4197236218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b6803d790 0x7f8b68057ef0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8b600097a0 tx=0x7f8b6002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58a4b4a2680cbfff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f67f680e640 1 --2- 172.21.15.50:0/2098691372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67d80040d0 0x7f67d8004800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009860 tx=0x7f67d8005830 comp rx=0 tx=0).stop 2024-09-11T22:11:25.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f284d074640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2840036d00 0x7f284001dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f2b307a6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2b20033830 0x7f2b20006fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f7b19f86640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b0c005d60 0x7f7b0c053880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f7b19f86640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b0c056610 0x7f7b0c03bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f8b74a3f640 1 -- 172.21.15.50:0/4197236218 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60037070 con 0x7f8b6803d790 2024-09-11T22:11:25.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f8b74a3f640 1 -- 172.21.15.50:0/4197236218 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b60032440 con 0x7f8b6803d790 2024-09-11T22:11:25.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f8b74a3f640 1 -- 172.21.15.50:0/4197236218 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60032810 con 0x7f8b6803d790 2024-09-11T22:11:25.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f7b19f86640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b0c056f90 con 0x7f7b0c053dc0 2024-09-11T22:11:25.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f7b19f86640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7b0c056d40 con 0x7f7b0c056610 2024-09-11T22:11:25.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f7b19f86640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0c057270 con 0x7f7b0c005d60 2024-09-11T22:11:25.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f2b307a6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b20039820 con 0x7f2b20036760 2024-09-11T22:11:25.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f2b307a6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b20039b00 con 0x7f2b20039280 2024-09-11T22:11:25.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f2b307a6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2b20007500 con 0x7f2b20033830 2024-09-11T22:11:25.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f67f4dab640 1 -- 172.21.15.50:0/2098691372 reap_dead start 2024-09-11T22:11:25.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f284e076640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2840033490 0x7f28400311c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41286/0 (socket says 172.21.15.50:41286) 2024-09-11T22:11:25.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f2b2e542640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2b20033830 0x7f2b20006fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f2b2e542640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2b20033830 0x7f2b20006fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54870/0 (socket says 172.21.15.50:54870) 2024-09-11T22:11:25.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f2b2e542640 1 -- 172.21.15.50:0/1545683598 learned_addr learned my addr 172.21.15.50:0/1545683598 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:25.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f5325c54640 1 --2- 172.21.15.50:0/3898202697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5318009af0 0x7f5318009f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53200655c0 tx=0x7f53200a86a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54c834dc74ed7acd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f7b18f84640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b0c005d60 0x7f7b0c053880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f7b13fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b0c056610 0x7f7b0c03bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f7b13fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b0c056610 0x7f7b0c03bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54854/0 (socket says 172.21.15.50:54854) 2024-09-11T22:11:25.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f7b13fff640 1 -- 172.21.15.50:0/3091618524 learned_addr learned my addr 172.21.15.50:0/3091618524 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:25.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f284e076640 1 -- 172.21.15.50:0/2034333160 learned_addr learned my addr 172.21.15.50:0/2034333160 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f284d875640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f284004eb90 0x7f284004ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:58736/0 (socket says 172.21.15.50:58736) 2024-09-11T22:11:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f0561c7b640 1 -- 172.21.15.50:0/2230725637 shutdown_connections 2024-09-11T22:11:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f7b13fff640 1 -- 172.21.15.50:0/3091618524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b0c005d60 msgr2=0x7f7b0c053880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.793+0000 7f7b13fff640 1 --2- 172.21.15.50:0/3091618524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b0c005d60 0x7f7b0c053880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f7b13fff640 1 -- 172.21.15.50:0/3091618524 >> v1:172.21.15.50:6789/0 conn(0x7f7b0c053dc0 legacy=0x7f7b0c057d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f7b13fff640 1 -- 172.21.15.50:0/3091618524 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0c057550 con 0x7f7b0c056610 2024-09-11T22:11:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f5317fff640 1 -- 172.21.15.50:0/3898202697 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53200b6070 con 0x7f5318009af0 2024-09-11T22:11:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f8b76a43640 1 -- 172.21.15.50:0/4197236218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b6803d790 msgr2=0x7f8b68057ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f2b2e542640 1 -- 172.21.15.50:0/1545683598 >> v1:172.21.15.77:6789/0 conn(0x7f2b20039280 legacy=0x7f2b20036050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:11:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f2b2e542640 1 -- 172.21.15.50:0/1545683598 >> v1:172.21.15.50:6789/0 conn(0x7f2b20036760 legacy=0x7f2b200de220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f2b2d540640 1 -- 172.21.15.50:0/1545683598 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519288487 0 0) 0x7f2b20039820 con 0x7f2b20036760 2024-09-11T22:11:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f2b2e542640 1 -- 172.21.15.50:0/1545683598 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b20039de0 con 0x7f2b20033830 2024-09-11T22:11:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f5317fff640 1 -- 172.21.15.50:0/3898202697 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53200ae540 con 0x7f5318009af0 2024-09-11T22:11:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f8b76a43640 1 --2- 172.21.15.50:0/4197236218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b6803d790 0x7f8b68057ef0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8b600097a0 tx=0x7f8b6002a180 comp rx=0 tx=0).stop 2024-09-11T22:11:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f284c873640 1 -- 172.21.15.50:0/2034333160 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 495200333 0 0) 0x7f2840033e10 con 0x7f2840033490 2024-09-11T22:11:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f284c873640 1 -- 172.21.15.50:0/2034333160 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2834003520 con 0x7f2840033490 2024-09-11T22:11:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f5317fff640 1 -- 172.21.15.50:0/3898202697 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53200ae9b0 con 0x7f5318009af0 2024-09-11T22:11:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f0561c7b640 1 -- 172.21.15.50:0/2230725637 wait complete. 2024-09-11T22:11:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f284c873640 1 -- 172.21.15.50:0/2034333160 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374322054 0 0) 0x7f2840033b30 con 0x7f284004eb90 2024-09-11T22:11:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f284c873640 1 -- 172.21.15.50:0/2034333160 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2840033e10 con 0x7f284004eb90 2024-09-11T22:11:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f284d074640 1 -- 172.21.15.50:0/2034333160 >> v1:172.21.15.77:6789/0 conn(0x7f284004eb90 legacy=0x7f284004ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f284d074640 1 -- 172.21.15.50:0/2034333160 >> v1:172.21.15.50:6789/0 conn(0x7f2840033490 legacy=0x7f28400311c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f284d074640 1 -- 172.21.15.50:0/2034333160 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284001d2e0 con 0x7f2840036d00 2024-09-11T22:11:25.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f67f680e640 1 -- 172.21.15.50:0/2098691372 shutdown_connections 2024-09-11T22:11:25.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.794+0000 7f67f680e640 1 -- 172.21.15.50:0/2098691372 >> 172.21.15.50:0/2098691372 conn(0x7f67f00679c0 msgr2=0x7f67f0067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:25.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f5326455640 1 -- 172.21.15.50:0/3898202697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5318009af0 msgr2=0x7f5318009f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f5326455640 1 --2- 172.21.15.50:0/3898202697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5318009af0 0x7f5318009f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53200655c0 tx=0x7f53200a86a0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f5326455640 1 -- 172.21.15.50:0/3898202697 shutdown_connections 2024-09-11T22:11:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f5326455640 1 --2- 172.21.15.50:0/3898202697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5318009af0 0x7f5318009f40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f5326455640 1 --2- 172.21.15.50:0/3898202697 >> v2:172.21.15.77:3300/0 conn(0x7f53180dec70 0x7f5318006550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f5326455640 1 -- 172.21.15.50:0/3898202697 >> 172.21.15.50:0/3898202697 conn(0x7f5318036090 msgr2=0x7f53180364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f8b76a43640 1 -- 172.21.15.50:0/4197236218 shutdown_connections 2024-09-11T22:11:25.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f8b76a43640 1 --2- 172.21.15.50:0/4197236218 >> v2:172.21.15.50:3300/0 conn(0x7f8b68005dc0 0x7f8b68006270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f8b76a43640 1 --2- 172.21.15.50:0/4197236218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b6803d790 0x7f8b68057ef0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f8b76a43640 1 -- 172.21.15.50:0/4197236218 >> 172.21.15.50:0/4197236218 conn(0x7f8b6803a4f0 msgr2=0x7f8b6803a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:25.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f8b76a43640 1 -- 172.21.15.50:0/4197236218 shutdown_connections 2024-09-11T22:11:25.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f8b76a43640 1 -- 172.21.15.50:0/4197236218 wait complete. 2024-09-11T22:11:25.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f67f680e640 1 -- 172.21.15.50:0/2098691372 shutdown_connections 2024-09-11T22:11:25.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f67f680e640 1 -- 172.21.15.50:0/2098691372 wait complete. 2024-09-11T22:11:25.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f7b13fff640 1 --2- 172.21.15.50:0/3091618524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0c056610 0x7f7b0c03bb50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b140637b0 tx=0x7f7b140a6160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a752005cd3e6290e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f7b137fe640 1 -- 172.21.15.50:0/3091618524 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b140b3070 con 0x7f7b0c056610 2024-09-11T22:11:25.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f2b2e542640 1 --2- 172.21.15.50:0/1545683598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b20033830 0x7f2b20006fc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b24008850 tx=0x7f2b2402c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1064266c7c9cf354 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f5326455640 1 -- 172.21.15.50:0/3898202697 shutdown_connections 2024-09-11T22:11:25.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f5326455640 1 -- 172.21.15.50:0/3898202697 wait complete. 2024-09-11T22:11:25.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f284d074640 1 --2- 172.21.15.50:0/2034333160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2840036d00 0x7f284001dae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f28380097a0 tx=0x7f283802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a4d98bfaf9a7f43 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f7b137fe640 1 -- 172.21.15.50:0/3091618524 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b140ae440 con 0x7f7b0c056610 2024-09-11T22:11:25.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.795+0000 7f7b137fe640 1 -- 172.21.15.50:0/3091618524 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b140ae8b0 con 0x7f7b0c056610 2024-09-11T22:11:25.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f0561c7b640 1 Processor -- start 2024-09-11T22:11:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f284c873640 1 -- 172.21.15.50:0/2034333160 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838037070 con 0x7f2840036d00 2024-09-11T22:11:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f284c873640 1 -- 172.21.15.50:0/2034333160 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2838032440 con 0x7f2840036d00 2024-09-11T22:11:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f2b2d540640 1 -- 172.21.15.50:0/1545683598 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b24004030 con 0x7f2b20033830 2024-09-11T22:11:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f2b2d540640 1 -- 172.21.15.50:0/1545683598 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b240041d0 con 0x7f2b20033830 2024-09-11T22:11:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f7b19f86640 1 -- 172.21.15.50:0/3091618524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0c056610 msgr2=0x7f7b0c03bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f7b19f86640 1 --2- 172.21.15.50:0/3091618524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0c056610 0x7f7b0c03bb50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b140637b0 tx=0x7f7b140a6160 comp rx=0 tx=0).stop 2024-09-11T22:11:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f2b2d540640 1 -- 172.21.15.50:0/1545683598 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b24004030 con 0x7f2b20033830 2024-09-11T22:11:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f0561c7b640 1 -- start start 2024-09-11T22:11:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.797+0000 7f5326455640 1 Processor -- start 2024-09-11T22:11:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f7b19f86640 1 -- 172.21.15.50:0/3091618524 shutdown_connections 2024-09-11T22:11:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f7b19f86640 1 --2- 172.21.15.50:0/3091618524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0c056610 0x7f7b0c03bb50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f7b19f86640 1 --2- 172.21.15.50:0/3091618524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b0c005d60 0x7f7b0c053880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f7b19f86640 1 -- 172.21.15.50:0/3091618524 >> 172.21.15.50:0/3091618524 conn(0x7f7b0c03a4a0 msgr2=0x7f7b0c03a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f7b19f86640 1 -- 172.21.15.50:0/3091618524 shutdown_connections 2024-09-11T22:11:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.796+0000 7f7b19f86640 1 -- 172.21.15.50:0/3091618524 wait complete. 2024-09-11T22:11:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.797+0000 7f5326455640 1 -- start start 2024-09-11T22:11:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.797+0000 7f284fad9640 1 -- 172.21.15.50:0/2034333160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2840036d00 msgr2=0x7f284001dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.797+0000 7f284fad9640 1 --2- 172.21.15.50:0/2034333160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2840036d00 0x7f284001dae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f28380097a0 tx=0x7f283802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.797+0000 7f67f680e640 1 Processor -- start 2024-09-11T22:11:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.797+0000 7f67f680e640 1 -- start start 2024-09-11T22:11:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.797+0000 7f8b76a43640 1 Processor -- start 2024-09-11T22:11:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f8b76a43640 1 -- start start 2024-09-11T22:11:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f284fad9640 1 -- 172.21.15.50:0/2034333160 shutdown_connections 2024-09-11T22:11:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f284fad9640 1 --2- 172.21.15.50:0/2034333160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2840036d00 0x7f284001dae0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f284fad9640 1 -- 172.21.15.50:0/2034333160 >> 172.21.15.50:0/2034333160 conn(0x7f28400360c0 msgr2=0x7f28400364d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f5326455640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5318009af0 0x7f53180d1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f0561c7b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055c0b0ce0 0x7f055c154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f5326455640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53180323c0 0x7f53180dac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f0561c7b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f055c0b3a50 0x7f055c164220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f5326455640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53180dec70 0x7f5318053360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f5326455640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f53180df050 con 0x7f53180323c0 2024-09-11T22:11:25.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f5326455640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5318006a90 con 0x7f5318009af0 2024-09-11T22:11:25.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f5326455640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5318032980 con 0x7f53180dec70 2024-09-11T22:11:25.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f2b307a6640 1 -- 172.21.15.50:0/1545683598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b20033830 msgr2=0x7f2b20006fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f2b307a6640 1 --2- 172.21.15.50:0/1545683598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b20033830 0x7f2b20006fc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b24008850 tx=0x7f2b2402c7a0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f7b19f86640 1 Processor -- start 2024-09-11T22:11:25.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f284fad9640 1 -- 172.21.15.50:0/2034333160 shutdown_connections 2024-09-11T22:11:25.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f2b307a6640 1 -- 172.21.15.50:0/1545683598 shutdown_connections 2024-09-11T22:11:25.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f2b307a6640 1 --2- 172.21.15.50:0/1545683598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b20033830 0x7f2b20006fc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f2b307a6640 1 -- 172.21.15.50:0/1545683598 >> 172.21.15.50:0/1545683598 conn(0x7f2b2001d960 msgr2=0x7f2b200545d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f5324c52640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53180323c0 0x7f53180dac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f5325453640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5318009af0 0x7f53180d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f5324c52640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53180323c0 0x7f53180dac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46664/0 (socket says 172.21.15.50:46664) 2024-09-11T22:11:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f5324c52640 1 -- 172.21.15.50:0/332979473 learned_addr learned my addr 172.21.15.50:0/332979473 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f5325c54640 1 --2- 172.21.15.50:0/332979473 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53180dec70 0x7f5318053360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f7b19f86640 1 -- start start 2024-09-11T22:11:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f055b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055c0b0ce0 0x7f055c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f055b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055c0b0ce0 0x7f055c154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54882/0 (socket says 172.21.15.50:54882) 2024-09-11T22:11:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f055b7fe640 1 -- 172.21.15.50:0/301665199 learned_addr learned my addr 172.21.15.50:0/301665199 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f67f680e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f0159690 0x7f67f00cf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f0561c7b640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f055c0b4920 0x7f055c164760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f8b76a43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b68005dc0 0x7f8b680d7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f055affd640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f055c0b3a50 0x7f055c164220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f67f680e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67f00cd930 0x7f67f015ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f67effff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f0159690 0x7f67f00cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f67effff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f0159690 0x7f67f00cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46672/0 (socket says 172.21.15.50:46672) 2024-09-11T22:11:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f0561c7b640 1 -- 172.21.15.50:0/301665199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f055c1666c0 con 0x7f055c0b4920 2024-09-11T22:11:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f2b307a6640 1 -- 172.21.15.50:0/1545683598 shutdown_connections 2024-09-11T22:11:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f0561c7b640 1 -- 172.21.15.50:0/301665199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f055c068540 con 0x7f055c0b0ce0 2024-09-11T22:11:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f67effff640 1 -- 172.21.15.50:0/4281903097 learned_addr learned my addr 172.21.15.50:0/4281903097 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:25.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f0561c7b640 1 -- 172.21.15.50:0/301665199 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f055c166840 con 0x7f055c0b3a50 2024-09-11T22:11:25.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f8b76a43640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b6803d790 0x7f8b680db650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f055bfff640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f055c0b4920 0x7f055c164760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f8b75a41640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b68005dc0 0x7f8b680d7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f8b75a41640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b68005dc0 0x7f8b680d7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54908/0 (socket says 172.21.15.50:54908) 2024-09-11T22:11:25.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f67ef7fe640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67f00cd930 0x7f67f015ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f67f680e640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67f015f250 0x7f67f00cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f5324c52640 1 -- 172.21.15.50:0/332979473 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53180dec70 msgr2=0x7f5318053360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f5324c52640 1 --2- 172.21.15.50:0/332979473 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53180dec70 0x7f5318053360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f5324c52640 1 -- 172.21.15.50:0/332979473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5318009af0 msgr2=0x7f53180d1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f5324c52640 1 --2- 172.21.15.50:0/332979473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5318009af0 0x7f53180d1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f5324c52640 1 -- 172.21.15.50:0/332979473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53180db580 con 0x7f53180323c0 2024-09-11T22:11:25.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f5324c52640 1 --2- 172.21.15.50:0/332979473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53180323c0 0x7f53180dac10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f531000c450 tx=0x7f531000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.799+0000 7f8b75a41640 1 -- 172.21.15.50:0/3358099118 learned_addr learned my addr 172.21.15.50:0/3358099118 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:25.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f8b76a43640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b680e2af0 0x7f8b680d87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f67f680e640 1 -- 172.21.15.50:0/4281903097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f67f00d0bb0 con 0x7f67f0159690 2024-09-11T22:11:25.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f67f4dab640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67f015f250 0x7f67f00cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f67f680e640 1 -- 172.21.15.50:0/4281903097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f67f00b3f80 con 0x7f67f00cd930 2024-09-11T22:11:25.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f5315ffb640 1 -- 172.21.15.50:0/332979473 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53100052d0 con 0x7f53180323c0 2024-09-11T22:11:25.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f67f680e640 1 -- 172.21.15.50:0/4281903097 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f67f0162d20 con 0x7f67f015f250 2024-09-11T22:11:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f055bfff640 1 -- 172.21.15.50:0/301665199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f055c0b3a50 msgr2=0x7f055c164220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f055bfff640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f055c0b3a50 0x7f055c164220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f055bfff640 1 -- 172.21.15.50:0/301665199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055c0b0ce0 msgr2=0x7f055c154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f055bfff640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055c0b0ce0 0x7f055c154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f055bfff640 1 -- 172.21.15.50:0/301665199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c164dc0 con 0x7f055c0b4920 2024-09-11T22:11:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f5315ffb640 1 -- 172.21.15.50:0/332979473 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5310005470 con 0x7f53180323c0 2024-09-11T22:11:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f5326455640 1 -- 172.21.15.50:0/332979473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53180d57d0 con 0x7f53180323c0 2024-09-11T22:11:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f5315ffb640 1 -- 172.21.15.50:0/332979473 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5310012850 con 0x7f53180323c0 2024-09-11T22:11:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f2b307a6640 1 -- 172.21.15.50:0/1545683598 wait complete. 2024-09-11T22:11:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f055bfff640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f055c0b4920 0x7f055c164760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0554030000 tx=0x7f0554004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f67effff640 1 -- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67f015f250 msgr2=0x7f67f00cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f67effff640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67f015f250 0x7f67f00cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f67effff640 1 -- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67f00cd930 msgr2=0x7f67f015ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f67effff640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67f00cd930 0x7f67f015ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f67effff640 1 -- 172.21.15.50:0/4281903097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f015f6d0 con 0x7f67f0159690 2024-09-11T22:11:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.801+0000 7f67effff640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f0159690 0x7f67f00cf520 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f67e400eb70 tx=0x7f67e400c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.798+0000 7f284fad9640 1 -- 172.21.15.50:0/2034333160 wait complete. 2024-09-11T22:11:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f284fad9640 1 Processor -- start 2024-09-11T22:11:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.801+0000 7f284fad9640 1 -- start start 2024-09-11T22:11:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f5326455640 1 -- 172.21.15.50:0/332979473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53180d5d90 con 0x7f53180323c0 2024-09-11T22:11:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.801+0000 7f2b307a6640 1 Processor -- start 2024-09-11T22:11:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.801+0000 7f0543fff640 1 -- 172.21.15.50:0/301665199 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554036070 con 0x7f055c0b4920 2024-09-11T22:11:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.801+0000 7f0543fff640 1 -- 172.21.15.50:0/301665199 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0554037040 con 0x7f055c0b4920 2024-09-11T22:11:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.801+0000 7f0543fff640 1 -- 172.21.15.50:0/301665199 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554003b90 con 0x7f055c0b4920 2024-09-11T22:11:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f8b76a43640 1 -- 172.21.15.50:0/3358099118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8b680067b0 con 0x7f8b680e2af0 2024-09-11T22:11:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f0561c7b640 1 -- 172.21.15.50:0/301665199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055c1650a0 con 0x7f055c0b4920 2024-09-11T22:11:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f8b76a43640 1 -- 172.21.15.50:0/3358099118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6803bf80 con 0x7f8b68005dc0 2024-09-11T22:11:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f284fad9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2840033490 0x7f28400395a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f0561c7b640 1 -- 172.21.15.50:0/301665199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f055c0aa9e0 con 0x7f055c0b4920 2024-09-11T22:11:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f7b19f86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0c005d60 0x7f7b0c0d1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f7b19f86640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b0c053dc0 0x7f7b0c0de070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f7b19f86640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b0c056610 0x7f7b0c0de5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f7b19f86640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0c0585e0 con 0x7f7b0c053dc0 2024-09-11T22:11:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f7b19f86640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0c058460 con 0x7f7b0c005d60 2024-09-11T22:11:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f7b19f86640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0c058760 con 0x7f7b0c056610 2024-09-11T22:11:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.803+0000 7f5315ffb640 1 -- 172.21.15.50:0/332979473 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53100129f0 con 0x7f53180323c0 2024-09-11T22:11:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f2b307a6640 1 -- start start 2024-09-11T22:11:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.803+0000 7f2b307a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b20033830 0x7f2b2004de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.803+0000 7f2b307a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b20036760 0x7f2b2004d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.803+0000 7f2b307a6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b20039280 0x7f2b20176600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.803+0000 7f2b307a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2b20033c10 con 0x7f2b20036760 2024-09-11T22:11:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.803+0000 7f2b307a6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2003a430 con 0x7f2b20033830 2024-09-11T22:11:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.803+0000 7f2b307a6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2b20054ce0 con 0x7f2b20039280 2024-09-11T22:11:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.803+0000 7f284fad9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2840036d00 0x7f2840048460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f284fad9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f284004eb90 0x7f28400dec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f67ecff9640 1 -- 172.21.15.50:0/4281903097 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e400ee70 con 0x7f67f0159690 2024-09-11T22:11:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f67ecff9640 1 -- 172.21.15.50:0/4281903097 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e4018070 con 0x7f67f0159690 2024-09-11T22:11:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f67ecff9640 1 -- 172.21.15.50:0/4281903097 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e400ce00 con 0x7f67f0159690 2024-09-11T22:11:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f67f680e640 1 -- 172.21.15.50:0/4281903097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f00c57a0 con 0x7f67f0159690 2024-09-11T22:11:25.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f2b2dd41640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b20036760 0x7f2b2004d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f5326455640 1 -- 172.21.15.50:0/332979473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531800bb70 con 0x7f53180323c0 2024-09-11T22:11:25.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f2b2dd41640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b20036760 0x7f2b2004d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46712/0 (socket says 172.21.15.50:46712) 2024-09-11T22:11:25.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f2b2dd41640 1 -- 172.21.15.50:0/1201135533 learned_addr learned my addr 172.21.15.50:0/1201135533 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:25.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f284fad9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f28400e72f0 con 0x7f2840036d00 2024-09-11T22:11:25.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f67f680e640 1 -- 172.21.15.50:0/4281903097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f00ce2d0 con 0x7f67f0159690 2024-09-11T22:11:25.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f2b2ed43640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b20039280 0x7f2b20176600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f284d875640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2840033490 0x7f28400395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f284d875640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2840033490 0x7f28400395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54920/0 (socket says 172.21.15.50:54920) 2024-09-11T22:11:25.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f284d875640 1 -- 172.21.15.50:0/2652927369 learned_addr learned my addr 172.21.15.50:0/2652927369 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:25.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f284fad9640 1 -- 172.21.15.50:0/2652927369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f28400e7170 con 0x7f2840033490 2024-09-11T22:11:25.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f284fad9640 1 -- 172.21.15.50:0/2652927369 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f28400072c0 con 0x7f284004eb90 2024-09-11T22:11:25.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f2b2e542640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b20033830 0x7f2b2004de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f2b2dd41640 1 -- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b20039280 msgr2=0x7f2b20176600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.805+0000 7f284d074640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2840036d00 0x7f2840048460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f2b2dd41640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b20039280 0x7f2b20176600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f284e076640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f284004eb90 0x7f28400dec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f2b2dd41640 1 -- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b20033830 msgr2=0x7f2b2004de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f8b76a43640 1 -- 172.21.15.50:0/3358099118 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8b68006930 con 0x7f8b6803d790 2024-09-11T22:11:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.800+0000 7f8b76242640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b680e2af0 0x7f8b680d87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.801+0000 7f8b75240640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b6803d790 0x7f8b680db650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.801+0000 7f8b76242640 1 -- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b6803d790 msgr2=0x7f8b680db650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.801+0000 7f8b76242640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b6803d790 0x7f8b680db650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.801+0000 7f8b76242640 1 -- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b68005dc0 msgr2=0x7f8b680d7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.801+0000 7f8b76242640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b68005dc0 0x7f8b680d7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.801+0000 7f8b76242640 1 -- 172.21.15.50:0/3358099118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b680dc0c0 con 0x7f8b680e2af0 2024-09-11T22:11:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f8b75a41640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b68005dc0 0x7f8b680d7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f8b76242640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b680e2af0 0x7f8b680d87d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8b70000b60 tx=0x7f8b700697c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f8b667fc640 1 -- 172.21.15.50:0/3358099118 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70099070 con 0x7f8b680e2af0 2024-09-11T22:11:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f8b667fc640 1 -- 172.21.15.50:0/3358099118 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b70094430 con 0x7f8b680e2af0 2024-09-11T22:11:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f8b76a43640 1 -- 172.21.15.50:0/3358099118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b680dc3a0 con 0x7f8b680e2af0 2024-09-11T22:11:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.802+0000 7f8b667fc640 1 -- 172.21.15.50:0/3358099118 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70094800 con 0x7f8b680e2af0 2024-09-11T22:11:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.803+0000 7f8b76a43640 1 -- 172.21.15.50:0/3358099118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b680c8cc0 con 0x7f8b680e2af0 2024-09-11T22:11:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f8b667fc640 1 -- 172.21.15.50:0/3358099118 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b7009c070 con 0x7f8b680e2af0 2024-09-11T22:11:25.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.805+0000 7f8b76a43640 1 -- 172.21.15.50:0/3358099118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b68006270 con 0x7f8b680e2af0 2024-09-11T22:11:25.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.805+0000 7f8b667fc640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b5406be80 0x7f8b5406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f2b2dd41640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b20033830 0x7f2b2004de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.805+0000 7f8b667fc640 1 -- 172.21.15.50:0/3358099118 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8b701064e0 con 0x7f8b680e2af0 2024-09-11T22:11:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.805+0000 7f7b13fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b0c053dc0 0x7f7b0c0de070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.805+0000 7f7b13fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b0c053dc0 0x7f7b0c0de070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46740/0 (socket says 172.21.15.50:46740) 2024-09-11T22:11:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.805+0000 7f7b13fff640 1 -- 172.21.15.50:0/1282205014 learned_addr learned my addr 172.21.15.50:0/1282205014 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.805+0000 7f7b19785640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b0c056610 0x7f7b0c0de5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f0561c7b640 1 -- 172.21.15.50:0/301665199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f055c06cb60 con 0x7f055c0b4920 2024-09-11T22:11:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f2b2dd41640 1 -- 172.21.15.50:0/1201135533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2017db00 con 0x7f2b20036760 2024-09-11T22:11:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.804+0000 7f2b2e542640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b20033830 0x7f2b2004de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.805+0000 7f2b2dd41640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b20036760 0x7f2b2004d1d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800b3e0 tx=0x7f2b1800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.805+0000 7f0543fff640 1 -- 172.21.15.50:0/301665199 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05540078b0 con 0x7f055c0b4920 2024-09-11T22:11:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f7b18f84640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0c005d60 0x7f7b0c0d1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.805+0000 7f8b75a41640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b5406be80 0x7f8b5406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f284d074640 1 -- 172.21.15.50:0/2652927369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f284004eb90 msgr2=0x7f28400dec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f284d074640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f284004eb90 0x7f28400dec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f284d074640 1 -- 172.21.15.50:0/2652927369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2840033490 msgr2=0x7f28400395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f284d074640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2840033490 0x7f28400395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f284d074640 1 -- 172.21.15.50:0/2652927369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2840048c90 con 0x7f2840036d00 2024-09-11T22:11:25.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f7b13fff640 1 -- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b0c056610 msgr2=0x7f7b0c0de5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f7b13fff640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b0c056610 0x7f7b0c0de5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f7b13fff640 1 -- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0c005d60 msgr2=0x7f7b0c0d1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f7b13fff640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0c005d60 0x7f7b0c0d1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f7b13fff640 1 -- 172.21.15.50:0/1282205014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0c0d24b0 con 0x7f7b0c053dc0 2024-09-11T22:11:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f284d074640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2840036d00 0x7f2840048460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2838031000 tx=0x7f28380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f0543fff640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f054806bf00 0x7f054806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f7b19785640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b0c056610 0x7f7b0c0de5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f7b18f84640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0c005d60 0x7f7b0c0d1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:25.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f0543fff640 1 -- 172.21.15.50:0/301665199 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f05540abdd0 con 0x7f055c0b4920 2024-09-11T22:11:25.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f055b7fe640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f054806bf00 0x7f054806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f7b13fff640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b0c053dc0 0x7f7b0c0de070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7b1406b040 tx=0x7f7b1406a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f8b75a41640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b5406be80 0x7f8b5406e340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c005880 tx=0x7f8b6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f5315ffb640 1 --2- 172.21.15.50:0/332979473 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f530406be80 0x7f530406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f5325453640 1 --2- 172.21.15.50:0/332979473 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f530406be80 0x7f530406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.806+0000 7f5315ffb640 1 -- 172.21.15.50:0/332979473 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f531008a040 con 0x7f53180323c0 2024-09-11T22:11:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.807+0000 7f67f680e640 1 -- 172.21.15.50:0/4281903097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67f00d0220 con 0x7f67f0159690 2024-09-11T22:11:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.807+0000 7f055b7fe640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f054806bf00 0x7f054806e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0550000f60 tx=0x7f0550007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.807+0000 7f5325453640 1 --2- 172.21.15.50:0/332979473 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f530406be80 0x7f530406e340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5318053f70 tx=0x7f531c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.810+0000 7f5315ffb640 1 -- 172.21.15.50:0/332979473 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5310058390 con 0x7f53180323c0 2024-09-11T22:11:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.811+0000 7f67ecff9640 1 -- 172.21.15.50:0/4281903097 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67e4026430 con 0x7f67f0159690 2024-09-11T22:11:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.811+0000 7f67ecff9640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67dc06beb0 0x7f67dc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.812+0000 7f67ef7fe640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67dc06beb0 0x7f67dc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.812+0000 7f67ef7fe640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67dc06beb0 0x7f67dc06e370 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f67e0034000 tx=0x7f67e002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.815+0000 7f0543fff640 1 -- 172.21.15.50:0/301665199 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05540af030 con 0x7f055c0b4920 2024-09-11T22:11:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.819+0000 7f2b1effd640 1 -- 172.21.15.50:0/1201135533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18015020 con 0x7f2b20036760 2024-09-11T22:11:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.819+0000 7f8b667fc640 1 -- 172.21.15.50:0/3358099118 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b700d4830 con 0x7f8b680e2af0 2024-09-11T22:11:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.819+0000 7f7b117fa640 1 -- 172.21.15.50:0/1282205014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b140b3050 con 0x7f7b0c053dc0 2024-09-11T22:11:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.819+0000 7f2b307a6640 1 -- 172.21.15.50:0/1201135533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2004b7b0 con 0x7f2b20036760 2024-09-11T22:11:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.819+0000 7f2b307a6640 1 -- 172.21.15.50:0/1201135533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2004c050 con 0x7f2b20036760 2024-09-11T22:11:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.819+0000 7f283e7fc640 1 -- 172.21.15.50:0/2652927369 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838040020 con 0x7f2840036d00 2024-09-11T22:11:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.819+0000 7f7b19f86640 1 -- 172.21.15.50:0/1282205014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b0c03c510 con 0x7f7b0c053dc0 2024-09-11T22:11:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.820+0000 7f7b19f86640 1 -- 172.21.15.50:0/1282205014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b0c03ca90 con 0x7f7b0c053dc0 2024-09-11T22:11:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.820+0000 7f67ecff9640 1 -- 172.21.15.50:0/4281903097 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f67e4057870 con 0x7f67f0159690 2024-09-11T22:11:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.820+0000 7f284fad9640 1 -- 172.21.15.50:0/2652927369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2840048f70 con 0x7f2840036d00 2024-09-11T22:11:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.820+0000 7f284fad9640 1 -- 172.21.15.50:0/2652927369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2840049530 con 0x7f2840036d00 2024-09-11T22:11:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.820+0000 7f2b1effd640 1 -- 172.21.15.50:0/1201135533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b18011830 con 0x7f2b20036760 2024-09-11T22:11:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.820+0000 7f2b1effd640 1 -- 172.21.15.50:0/1201135533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18011c60 con 0x7f2b20036760 2024-09-11T22:11:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.821+0000 7f7b117fa640 1 -- 172.21.15.50:0/1282205014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b140b4040 con 0x7f7b0c053dc0 2024-09-11T22:11:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.821+0000 7f7b117fa640 1 -- 172.21.15.50:0/1282205014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b140b88d0 con 0x7f7b0c053dc0 2024-09-11T22:11:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.821+0000 7f283e7fc640 1 -- 172.21.15.50:0/2652927369 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2838038040 con 0x7f2840036d00 2024-09-11T22:11:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.821+0000 7f283e7fc640 1 -- 172.21.15.50:0/2652927369 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838037070 con 0x7f2840036d00 2024-09-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.821+0000 7f2b307a6640 1 -- 172.21.15.50:0/1201135533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b10005290 con 0x7f2b20036760 2024-09-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.822+0000 7f284fad9640 1 -- 172.21.15.50:0/2652927369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2840049b80 con 0x7f2840036d00 2024-09-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.823+0000 7f7b19f86640 1 -- 172.21.15.50:0/1282205014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af4005290 con 0x7f7b0c053dc0 2024-09-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.826+0000 7f67ecff9640 1 -- 172.21.15.50:0/4281903097 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67f00c57a0 con 0x7f67f0159690 2024-09-11T22:11:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.829+0000 7f2b1effd640 1 -- 172.21.15.50:0/1201135533 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b18018020 con 0x7f2b20036760 2024-09-11T22:11:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.829+0000 7f283e7fc640 1 -- 172.21.15.50:0/2652927369 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2838043020 con 0x7f2840036d00 2024-09-11T22:11:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.829+0000 7f2b1effd640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2b0c06be30 0x7f2b0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.830+0000 7f283e7fc640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f282c06be30 0x7f282c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.830+0000 7f2b1effd640 1 -- 172.21.15.50:0/1201135533 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2b18011e00 con 0x7f2b20036760 2024-09-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.830+0000 7f2b2e542640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2b0c06be30 0x7f2b0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.830+0000 7f283e7fc640 1 -- 172.21.15.50:0/2652927369 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2838077b80 con 0x7f2840036d00 2024-09-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.831+0000 7f2b2e542640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2b0c06be30 0x7f2b0c06e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2b24036000 tx=0x7f2b24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.832+0000 7f284d875640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f282c06be30 0x7f282c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.832+0000 7f7b117fa640 1 -- 172.21.15.50:0/1282205014 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b140c1020 con 0x7f7b0c053dc0 2024-09-11T22:11:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.832+0000 7f284d875640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f282c06be30 0x7f282c06e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2844001230 tx=0x7f2844007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.832+0000 7f7b117fa640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7af806be60 0x7f7af806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.832+0000 7f7b117fa640 1 -- 172.21.15.50:0/1282205014 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7b14127b40 con 0x7f7b0c053dc0 2024-09-11T22:11:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.833+0000 7f7b18f84640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7af806be60 0x7f7af806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.833+0000 7f7b18f84640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7af806be60 0x7f7af806e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7b08013a20 tx=0x7f7b08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.835+0000 7f2b1effd640 1 -- 172.21.15.50:0/1201135533 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b1801f020 con 0x7f2b20036760 2024-09-11T22:11:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.840+0000 7f283e7fc640 1 -- 172.21.15.50:0/2652927369 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f283804a030 con 0x7f2840036d00 2024-09-11T22:11:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:25.849+0000 7f7b117fa640 1 -- 172.21.15.50:0/1282205014 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b0c0d24b0 con 0x7f7b0c053dc0 2024-09-11T22:11:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.160+0000 7efed6359640 1 -- 172.21.15.50:0/4171940898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7efeb0005580 con 0x7efed01f8d50 2024-09-11T22:11:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.161+0000 7efeccff9640 1 -- 172.21.15.50:0/4171940898 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efec80589c0 con 0x7efed01f8d50 2024-09-11T22:11:26.162 INFO:teuthology.orchestra.run.smithi050.stdout:64424509449 2024-09-11T22:11:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.164+0000 7efeb67fc640 1 -- 172.21.15.50:0/4171940898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efebc06be30 msgr2=0x7efebc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.164+0000 7efeb67fc640 1 --2- 172.21.15.50:0/4171940898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efebc06be30 0x7efebc06e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efec0034000 tx=0x7efec002e000 comp rx=0 tx=0).stop 2024-09-11T22:11:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.164+0000 7efeb67fc640 1 -- 172.21.15.50:0/4171940898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efed01f8d50 msgr2=0x7efed014cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.165+0000 7efeb67fc640 1 --2- 172.21.15.50:0/4171940898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efed01f8d50 0x7efed014cd90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efec800cb30 tx=0x7efec800a060 comp rx=0 tx=0).stop 2024-09-11T22:11:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.165+0000 7efeb67fc640 1 -- 172.21.15.50:0/4171940898 shutdown_connections 2024-09-11T22:11:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.165+0000 7efeb67fc640 1 --2- 172.21.15.50:0/4171940898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efebc06be30 0x7efebc06e2f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.165+0000 7efeb67fc640 1 --2- 172.21.15.50:0/4171940898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efed015a5f0 0x7efed01579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.165+0000 7efeb67fc640 1 --2- 172.21.15.50:0/4171940898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efed01f8d50 0x7efed014cd90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.165+0000 7efeb67fc640 1 --2- 172.21.15.50:0/4171940898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efed0072fd0 0x7efed014b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.165+0000 7efeb67fc640 1 -- 172.21.15.50:0/4171940898 >> 172.21.15.50:0/4171940898 conn(0x7efed00b2100 msgr2=0x7efed0156c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.166+0000 7efeb67fc640 1 -- 172.21.15.50:0/4171940898 shutdown_connections 2024-09-11T22:11:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.166+0000 7efeb67fc640 1 -- 172.21.15.50:0/4171940898 wait complete. 2024-09-11T22:11:26.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.6 2024-09-11T22:11:26.184 DEBUG:teuthology.parallel:result is None 2024-09-11T22:11:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.198+0000 7f5326455640 1 -- 172.21.15.50:0/332979473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5318035990 con 0x7f53180323c0 2024-09-11T22:11:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.199+0000 7f5315ffb640 1 -- 172.21.15.50:0/332979473 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f531005c690 con 0x7f53180323c0 2024-09-11T22:11:26.200 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2024-09-11T22:11:26.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.201+0000 7f5326455640 1 -- 172.21.15.50:0/332979473 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f530406be80 msgr2=0x7f530406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.201+0000 7f5326455640 1 --2- 172.21.15.50:0/332979473 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f530406be80 0x7f530406e340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5318053f70 tx=0x7f531c008040 comp rx=0 tx=0).stop 2024-09-11T22:11:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.201+0000 7f5326455640 1 -- 172.21.15.50:0/332979473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53180323c0 msgr2=0x7f53180dac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.201+0000 7f5326455640 1 --2- 172.21.15.50:0/332979473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53180323c0 0x7f53180dac10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f531000c450 tx=0x7f531000c910 comp rx=0 tx=0).stop 2024-09-11T22:11:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.201+0000 7f5326455640 1 -- 172.21.15.50:0/332979473 shutdown_connections 2024-09-11T22:11:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.201+0000 7f5326455640 1 --2- 172.21.15.50:0/332979473 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f530406be80 0x7f530406e340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.201+0000 7f5326455640 1 --2- 172.21.15.50:0/332979473 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53180dec70 0x7f5318053360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.201+0000 7f5326455640 1 --2- 172.21.15.50:0/332979473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53180323c0 0x7f53180dac10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.201+0000 7f5326455640 1 --2- 172.21.15.50:0/332979473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5318009af0 0x7f53180d1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.201+0000 7f5326455640 1 -- 172.21.15.50:0/332979473 >> 172.21.15.50:0/332979473 conn(0x7f5318036090 msgr2=0x7f5318033e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.202+0000 7f5326455640 1 -- 172.21.15.50:0/332979473 shutdown_connections 2024-09-11T22:11:26.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.202+0000 7f5326455640 1 -- 172.21.15.50:0/332979473 wait complete. 2024-09-11T22:11:26.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-09-11T22:11:26.214 DEBUG:teuthology.parallel:result is None 2024-09-11T22:11:26.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.219+0000 7f0561c7b640 1 -- 172.21.15.50:0/301665199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f055c0b3340 con 0x7f055c0b4920 2024-09-11T22:11:26.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.220+0000 7f0543fff640 1 -- 172.21.15.50:0/301665199 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f055407a1a0 con 0x7f055c0b4920 2024-09-11T22:11:26.220 INFO:teuthology.orchestra.run.smithi050.stdout:64424509448 2024-09-11T22:11:26.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.223+0000 7f0561c7b640 1 -- 172.21.15.50:0/301665199 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f054806bf00 msgr2=0x7f054806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.223+0000 7f0561c7b640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f054806bf00 0x7f054806e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0550000f60 tx=0x7f0550007ea0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.223+0000 7f0561c7b640 1 -- 172.21.15.50:0/301665199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f055c0b4920 msgr2=0x7f055c164760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.223+0000 7f0561c7b640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f055c0b4920 0x7f055c164760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0554030000 tx=0x7f0554004a40 comp rx=0 tx=0).stop 2024-09-11T22:11:26.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.223+0000 7f0561c7b640 1 -- 172.21.15.50:0/301665199 shutdown_connections 2024-09-11T22:11:26.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.223+0000 7f0561c7b640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f054806bf00 0x7f054806e3c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.223+0000 7f0561c7b640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f055c0b3a50 0x7f055c164220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.223+0000 7f0561c7b640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f055c0b4920 0x7f055c164760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.223+0000 7f0561c7b640 1 --2- 172.21.15.50:0/301665199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f055c0b0ce0 0x7f055c154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.223+0000 7f0561c7b640 1 -- 172.21.15.50:0/301665199 >> 172.21.15.50:0/301665199 conn(0x7f055c074c40 msgr2=0x7f055c0b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:26.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.223+0000 7f0561c7b640 1 -- 172.21.15.50:0/301665199 shutdown_connections 2024-09-11T22:11:26.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.223+0000 7f0561c7b640 1 -- 172.21.15.50:0/301665199 wait complete. 2024-09-11T22:11:26.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.227+0000 7f8b76a43640 1 -- 172.21.15.50:0/3358099118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8b680e6340 con 0x7f8b680e2af0 2024-09-11T22:11:26.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.228+0000 7f8b667fc640 1 -- 172.21.15.50:0/3358099118 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8b700d8b30 con 0x7f8b680e2af0 2024-09-11T22:11:26.228 INFO:teuthology.orchestra.run.smithi050.stdout:64424509447 2024-09-11T22:11:26.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.231+0000 7f8b76a43640 1 -- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b5406be80 msgr2=0x7f8b5406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.231+0000 7f8b76a43640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b5406be80 0x7f8b5406e340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c005880 tx=0x7f8b6c009040 comp rx=0 tx=0).stop 2024-09-11T22:11:26.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.231+0000 7f8b76a43640 1 -- 172.21.15.50:0/3358099118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b680e2af0 msgr2=0x7f8b680d87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.231+0000 7f8b76a43640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b680e2af0 0x7f8b680d87d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8b70000b60 tx=0x7f8b700697c0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.231+0000 7f8b76a43640 1 -- 172.21.15.50:0/3358099118 shutdown_connections 2024-09-11T22:11:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.231+0000 7f8b76a43640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b5406be80 0x7f8b5406e340 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.231+0000 7f8b76a43640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b6803d790 0x7f8b680db650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.231+0000 7f8b76a43640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b680e2af0 0x7f8b680d87d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.231+0000 7f8b76a43640 1 --2- 172.21.15.50:0/3358099118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b68005dc0 0x7f8b680d7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.231+0000 7f8b76a43640 1 -- 172.21.15.50:0/3358099118 >> 172.21.15.50:0/3358099118 conn(0x7f8b6803a4f0 msgr2=0x7f8b68057750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.231+0000 7f8b76a43640 1 -- 172.21.15.50:0/3358099118 shutdown_connections 2024-09-11T22:11:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.231+0000 7f8b76a43640 1 -- 172.21.15.50:0/3358099118 wait complete. 2024-09-11T22:11:26.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.237+0000 7f67f680e640 1 -- 172.21.15.50:0/4281903097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f67f015fcf0 con 0x7f67f0159690 2024-09-11T22:11:26.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.238+0000 7f67ecff9640 1 -- 172.21.15.50:0/4281903097 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f67e40597d0 con 0x7f67f0159690 2024-09-11T22:11:26.238 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2024-09-11T22:11:26.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.1 2024-09-11T22:11:26.240 DEBUG:teuthology.parallel:result is None 2024-09-11T22:11:26.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.240+0000 7f67f680e640 1 -- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67dc06beb0 msgr2=0x7f67dc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.240+0000 7f67f680e640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67dc06beb0 0x7f67dc06e370 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f67e0034000 tx=0x7f67e002e000 comp rx=0 tx=0).stop 2024-09-11T22:11:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.240+0000 7f67f680e640 1 -- 172.21.15.50:0/4281903097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f0159690 msgr2=0x7f67f00cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.240+0000 7f67f680e640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f0159690 0x7f67f00cf520 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f67e400eb70 tx=0x7f67e400c4b0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.240+0000 7f67f680e640 1 -- 172.21.15.50:0/4281903097 shutdown_connections 2024-09-11T22:11:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.240+0000 7f67f680e640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67dc06beb0 0x7f67dc06e370 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.240+0000 7f67f680e640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67f015f250 0x7f67f00cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.240+0000 7f67f680e640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67f00cd930 0x7f67f015ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.240+0000 7f67f680e640 1 --2- 172.21.15.50:0/4281903097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67f0159690 0x7f67f00cf520 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.240+0000 7f67f680e640 1 -- 172.21.15.50:0/4281903097 >> 172.21.15.50:0/4281903097 conn(0x7f67f00679c0 msgr2=0x7f67f0072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.240+0000 7f67f680e640 1 -- 172.21.15.50:0/4281903097 shutdown_connections 2024-09-11T22:11:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.240+0000 7f67f680e640 1 -- 172.21.15.50:0/4281903097 wait complete. 2024-09-11T22:11:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.240+0000 7f2b307a6640 1 -- 172.21.15.50:0/1201135533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2b10005850 con 0x7f2b20036760 2024-09-11T22:11:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.241+0000 7f2b1effd640 1 -- 172.21.15.50:0/1201135533 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2b18059c60 con 0x7f2b20036760 2024-09-11T22:11:26.243 INFO:teuthology.orchestra.run.smithi050.stdout:64424509448 2024-09-11T22:11:26.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.244+0000 7f2b307a6640 1 -- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2b0c06be30 msgr2=0x7f2b0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.244+0000 7f2b307a6640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2b0c06be30 0x7f2b0c06e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2b24036000 tx=0x7f2b24008040 comp rx=0 tx=0).stop 2024-09-11T22:11:26.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.244+0000 7f2b307a6640 1 -- 172.21.15.50:0/1201135533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b20036760 msgr2=0x7f2b2004d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.244+0000 7f2b307a6640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b20036760 0x7f2b2004d1d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800b3e0 tx=0x7f2b1800b8a0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.244+0000 7f2b307a6640 1 -- 172.21.15.50:0/1201135533 shutdown_connections 2024-09-11T22:11:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.244+0000 7f2b307a6640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2b0c06be30 0x7f2b0c06e2f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.244+0000 7f2b307a6640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b20039280 0x7f2b20176600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.244+0000 7f2b307a6640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b20036760 0x7f2b2004d1d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.244+0000 7f2b307a6640 1 --2- 172.21.15.50:0/1201135533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b20033830 0x7f2b2004de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.244+0000 7f2b307a6640 1 -- 172.21.15.50:0/1201135533 >> 172.21.15.50:0/1201135533 conn(0x7f2b2001d960 msgr2=0x7f2b2004f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.244+0000 7f2b307a6640 1 -- 172.21.15.50:0/1201135533 shutdown_connections 2024-09-11T22:11:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.244+0000 7f2b307a6640 1 -- 172.21.15.50:0/1201135533 wait complete. 2024-09-11T22:11:26.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.0 2024-09-11T22:11:26.247 DEBUG:teuthology.parallel:result is None 2024-09-11T22:11:26.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-09-11T22:11:26.255 DEBUG:teuthology.parallel:result is None 2024-09-11T22:11:26.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.4 2024-09-11T22:11:26.256 DEBUG:teuthology.parallel:result is None 2024-09-11T22:11:26.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.259+0000 7f284fad9640 1 -- 172.21.15.50:0/2652927369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f284001dae0 con 0x7f2840036d00 2024-09-11T22:11:26.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.259+0000 7f283e7fc640 1 -- 172.21.15.50:0/2652927369 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f283807a1e0 con 0x7f2840036d00 2024-09-11T22:11:26.260 INFO:teuthology.orchestra.run.smithi050.stdout:64424509448 2024-09-11T22:11:26.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.261+0000 7f7b19f86640 1 -- 172.21.15.50:0/1282205014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7af4005850 con 0x7f7b0c053dc0 2024-09-11T22:11:26.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.261+0000 7f7b117fa640 1 -- 172.21.15.50:0/1282205014 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b140f64d0 con 0x7f7b0c053dc0 2024-09-11T22:11:26.261 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-09-11T22:11:26.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.262+0000 7f284fad9640 1 -- 172.21.15.50:0/2652927369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f282c06be30 msgr2=0x7f282c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.262+0000 7f284fad9640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f282c06be30 0x7f282c06e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2844001230 tx=0x7f2844007d30 comp rx=0 tx=0).stop 2024-09-11T22:11:26.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.262+0000 7f284fad9640 1 -- 172.21.15.50:0/2652927369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2840036d00 msgr2=0x7f2840048460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.262+0000 7f284fad9640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2840036d00 0x7f2840048460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2838031000 tx=0x7f28380046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.262+0000 7f284fad9640 1 -- 172.21.15.50:0/2652927369 shutdown_connections 2024-09-11T22:11:26.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.262+0000 7f284fad9640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f282c06be30 0x7f282c06e2f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.262+0000 7f284fad9640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f284004eb90 0x7f28400dec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.262+0000 7f284fad9640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2840036d00 0x7f2840048460 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.262+0000 7f284fad9640 1 --2- 172.21.15.50:0/2652927369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2840033490 0x7f28400395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.262+0000 7f284fad9640 1 -- 172.21.15.50:0/2652927369 >> 172.21.15.50:0/2652927369 conn(0x7f28400360c0 msgr2=0x7f28400e5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:26.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.262+0000 7f284fad9640 1 -- 172.21.15.50:0/2652927369 shutdown_connections 2024-09-11T22:11:26.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.262+0000 7f284fad9640 1 -- 172.21.15.50:0/2652927369 wait complete. 2024-09-11T22:11:26.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.263+0000 7f7b19f86640 1 -- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7af806be60 msgr2=0x7f7af806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.263+0000 7f7b19f86640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7af806be60 0x7f7af806e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7b08013a20 tx=0x7f7b08008040 comp rx=0 tx=0).stop 2024-09-11T22:11:26.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.263+0000 7f7b19f86640 1 -- 172.21.15.50:0/1282205014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b0c053dc0 msgr2=0x7f7b0c0de070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.263+0000 7f7b19f86640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b0c053dc0 0x7f7b0c0de070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7b1406b040 tx=0x7f7b1406a6d0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.264+0000 7f7b19f86640 1 -- 172.21.15.50:0/1282205014 shutdown_connections 2024-09-11T22:11:26.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.264+0000 7f7b19f86640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7af806be60 0x7f7af806e320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.264+0000 7f7b19f86640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b0c056610 0x7f7b0c0de5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.264+0000 7f7b19f86640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b0c053dc0 0x7f7b0c0de070 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.264+0000 7f7b19f86640 1 --2- 172.21.15.50:0/1282205014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b0c005d60 0x7f7b0c0d1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.264+0000 7f7b19f86640 1 -- 172.21.15.50:0/1282205014 >> 172.21.15.50:0/1282205014 conn(0x7f7b0c03a4a0 msgr2=0x7f7b0c0e1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:26.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.264+0000 7f7b19f86640 1 -- 172.21.15.50:0/1282205014 shutdown_connections 2024-09-11T22:11:26.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.264+0000 7f7b19f86640 1 -- 172.21.15.50:0/1282205014 wait complete. 2024-09-11T22:11:26.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.3 2024-09-11T22:11:26.277 DEBUG:teuthology.parallel:result is None 2024-09-11T22:11:26.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.5 2024-09-11T22:11:26.278 DEBUG:teuthology.parallel:result is None 2024-09-11T22:11:26.278 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:11:26.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:11:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.420+0000 7f7c39c77640 1 Processor -- start 2024-09-11T22:11:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.420+0000 7f7c39c77640 1 -- start start 2024-09-11T22:11:26.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.421+0000 7f7c39c77640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7c3415c2c0 0x7f7c340b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.421+0000 7f7c39c77640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c340b3e10 0x7f7c340cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.421+0000 7f7c39c77640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c340b4f00 con 0x7f7c340d0410 2024-09-11T22:11:26.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.421+0000 7f7c39c77640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7c340cf7a0 con 0x7f7c3415c2c0 2024-09-11T22:11:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.421+0000 7f7c39c77640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c340d0840 con 0x7f7c340b3e10 2024-09-11T22:11:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.421+0000 7f7c33fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7c340d0410 0x7f7c3415fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41310/0 (socket says 172.21.15.50:41310) 2024-09-11T22:11:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.421+0000 7f7c33fff640 1 -- 172.21.15.50:0/3047369841 learned_addr learned my addr 172.21.15.50:0/3047369841 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.421+0000 7f7c337fe640 1 --2- 172.21.15.50:0/3047369841 >> v2:172.21.15.77:3300/0 conn(0x7f7c3415c2c0 0x7f7c340b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.421+0000 7f7c32ffd640 1 --2- 172.21.15.50:0/3047369841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c340b3e10 0x7f7c340cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.421+0000 7f7c327fc640 1 -- 172.21.15.50:0/3047369841 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2791379072 0 0) 0x7f7c340b4f00 con 0x7f7c340d0410 2024-09-11T22:11:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.421+0000 7f7c327fc640 1 -- 172.21.15.50:0/3047369841 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c1c003520 con 0x7f7c340d0410 2024-09-11T22:11:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.422+0000 7f7c32ffd640 1 -- 172.21.15.50:0/3047369841 >> v2:172.21.15.77:3300/0 conn(0x7f7c3415c2c0 msgr2=0x7f7c340b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.422+0000 7f7c32ffd640 1 --2- 172.21.15.50:0/3047369841 >> v2:172.21.15.77:3300/0 conn(0x7f7c3415c2c0 0x7f7c340b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.422+0000 7f7c32ffd640 1 -- 172.21.15.50:0/3047369841 >> v1:172.21.15.50:6789/0 conn(0x7f7c340d0410 legacy=0x7f7c3415fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.422+0000 7f7c32ffd640 1 -- 172.21.15.50:0/3047369841 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c340b4360 con 0x7f7c340b3e10 2024-09-11T22:11:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.422+0000 7f7c337fe640 1 --2- 172.21.15.50:0/3047369841 >> v2:172.21.15.77:3300/0 conn(0x7f7c3415c2c0 0x7f7c340b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:26.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.422+0000 7f7c32ffd640 1 --2- 172.21.15.50:0/3047369841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c340b3e10 0x7f7c340cfed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7c280097a0 tx=0x7f7c2802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9096019e8e36070 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.423+0000 7f7c327fc640 1 -- 172.21.15.50:0/3047369841 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28037070 con 0x7f7c340b3e10 2024-09-11T22:11:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.423+0000 7f7c327fc640 1 -- 172.21.15.50:0/3047369841 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2802ae50 con 0x7f7c340b3e10 2024-09-11T22:11:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.423+0000 7f7c327fc640 1 -- 172.21.15.50:0/3047369841 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28032660 con 0x7f7c340b3e10 2024-09-11T22:11:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.423+0000 7f7c39c77640 1 -- 172.21.15.50:0/3047369841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c340b3e10 msgr2=0x7f7c340cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.423+0000 7f7c39c77640 1 --2- 172.21.15.50:0/3047369841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c340b3e10 0x7f7c340cfed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7c280097a0 tx=0x7f7c2802a100 comp rx=0 tx=0).stop 2024-09-11T22:11:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.423+0000 7f7c39c77640 1 -- 172.21.15.50:0/3047369841 shutdown_connections 2024-09-11T22:11:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.423+0000 7f7c39c77640 1 --2- 172.21.15.50:0/3047369841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c340b3e10 0x7f7c340cfed0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.423+0000 7f7c39c77640 1 --2- 172.21.15.50:0/3047369841 >> v2:172.21.15.77:3300/0 conn(0x7f7c3415c2c0 0x7f7c340b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.423+0000 7f7c39c77640 1 -- 172.21.15.50:0/3047369841 >> 172.21.15.50:0/3047369841 conn(0x7f7c340679c0 msgr2=0x7f7c34067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.423+0000 7f7c39c77640 1 -- 172.21.15.50:0/3047369841 shutdown_connections 2024-09-11T22:11:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.423+0000 7f7c39c77640 1 -- 172.21.15.50:0/3047369841 wait complete. 2024-09-11T22:11:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.424+0000 7f7c39c77640 1 Processor -- start 2024-09-11T22:11:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.425+0000 7f7c39c77640 1 -- start start 2024-09-11T22:11:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.425+0000 7f7c39c77640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c340b3e10 0x7f7c3415a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.425+0000 7f7c39c77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c340d0410 0x7f7c341545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.425+0000 7f7c39c77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c3415c2c0 0x7f7c341509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.425+0000 7f7c39c77640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c340cfc10 con 0x7f7c340d0410 2024-09-11T22:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.425+0000 7f7c39c77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c340b54a0 con 0x7f7c3415c2c0 2024-09-11T22:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.425+0000 7f7c39c77640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c340ce200 con 0x7f7c340b3e10 2024-09-11T22:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.425+0000 7f7c32ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c340d0410 0x7f7c341545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.425+0000 7f7c32ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c340d0410 0x7f7c341545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46746/0 (socket says 172.21.15.50:46746) 2024-09-11T22:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.425+0000 7f7c32ffd640 1 -- 172.21.15.50:0/2147867964 learned_addr learned my addr 172.21.15.50:0/2147867964 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.426+0000 7f7c337fe640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c340b3e10 0x7f7c3415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.426+0000 7f7c33fff640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c3415c2c0 0x7f7c341509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.426+0000 7f7c32ffd640 1 -- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c340b3e10 msgr2=0x7f7c3415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.426+0000 7f7c32ffd640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c340b3e10 0x7f7c3415a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.426+0000 7f7c32ffd640 1 -- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c3415c2c0 msgr2=0x7f7c341509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.426+0000 7f7c32ffd640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c3415c2c0 0x7f7c341509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.426+0000 7f7c32ffd640 1 -- 172.21.15.50:0/2147867964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c34072200 con 0x7f7c340d0410 2024-09-11T22:11:26.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.426+0000 7f7c32ffd640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c340d0410 0x7f7c341545c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7c28035040 tx=0x7f7c280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:26.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.426+0000 7f7c1bfff640 1 -- 172.21.15.50:0/2147867964 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28041070 con 0x7f7c340d0410 2024-09-11T22:11:26.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.426+0000 7f7c1bfff640 1 -- 172.21.15.50:0/2147867964 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2803c460 con 0x7f7c340d0410 2024-09-11T22:11:26.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.426+0000 7f7c39c77640 1 -- 172.21.15.50:0/2147867964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c340724e0 con 0x7f7c340d0410 2024-09-11T22:11:26.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.426+0000 7f7c1bfff640 1 -- 172.21.15.50:0/2147867964 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28037040 con 0x7f7c340d0410 2024-09-11T22:11:26.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.426+0000 7f7c39c77640 1 -- 172.21.15.50:0/2147867964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c34072fc0 con 0x7f7c340d0410 2024-09-11T22:11:26.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.427+0000 7f7c39c77640 1 -- 172.21.15.50:0/2147867964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c340726b0 con 0x7f7c340d0410 2024-09-11T22:11:26.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.427+0000 7f7c1bfff640 1 -- 172.21.15.50:0/2147867964 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c2803a070 con 0x7f7c340d0410 2024-09-11T22:11:26.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.428+0000 7f7c1bfff640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c2006be60 0x7f7c2006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.428+0000 7f7c1bfff640 1 -- 172.21.15.50:0/2147867964 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7c280aaf50 con 0x7f7c340d0410 2024-09-11T22:11:26.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.428+0000 7f7c337fe640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c2006be60 0x7f7c2006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.429+0000 7f7c337fe640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c2006be60 0x7f7c2006e320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009560 tx=0x7f7c24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:26.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.432+0000 7f7c1bfff640 1 -- 172.21.15.50:0/2147867964 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c28079990 con 0x7f7c340d0410 2024-09-11T22:11:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.604+0000 7f7c39c77640 1 -- 172.21.15.50:0/2147867964 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7c3406d070 con 0x7f7c2006be60 2024-09-11T22:11:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.611+0000 7f7c1bfff640 1 -- 172.21.15.50:0/2147867964 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f7c3406d070 con 0x7f7c2006be60 2024-09-11T22:11:26.614 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:26.615 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:11:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.613+0000 7f7c39c77640 1 -- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c2006be60 msgr2=0x7f7c2006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.613+0000 7f7c39c77640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c2006be60 0x7f7c2006e320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009560 tx=0x7f7c24008040 comp rx=0 tx=0).stop 2024-09-11T22:11:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.613+0000 7f7c39c77640 1 -- 172.21.15.50:0/2147867964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c340d0410 msgr2=0x7f7c341545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.613+0000 7f7c39c77640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c340d0410 0x7f7c341545c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7c28035040 tx=0x7f7c280046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.613+0000 7f7c39c77640 1 -- 172.21.15.50:0/2147867964 shutdown_connections 2024-09-11T22:11:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.613+0000 7f7c39c77640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c2006be60 0x7f7c2006e320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.613+0000 7f7c39c77640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c3415c2c0 0x7f7c341509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.613+0000 7f7c39c77640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c340d0410 0x7f7c341545c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.613+0000 7f7c39c77640 1 --2- 172.21.15.50:0/2147867964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c340b3e10 0x7f7c3415a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.614+0000 7f7c39c77640 1 -- 172.21.15.50:0/2147867964 >> 172.21.15.50:0/2147867964 conn(0x7f7c340679c0 msgr2=0x7f7c3406d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.614+0000 7f7c39c77640 1 -- 172.21.15.50:0/2147867964 shutdown_connections 2024-09-11T22:11:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.614+0000 7f7c39c77640 1 -- 172.21.15.50:0/2147867964 wait complete. 2024-09-11T22:11:26.625 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-11T22:11:25.365872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239900,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734820,"statfs":{"total":773094113280,"available":772848455680,"internally_reserved":0,"allocated":2924544,"data_stored":1767532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002233"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111198+0000","last_change":"2024-09-11T22:11:14.877003+0000","last_active":"2024-09-11T22:11:16.111198+0000","last_peered":"2024-09-11T22:11:16.111198+0000","last_clean":"2024-09-11T22:11:16.111198+0000","last_became_active":"2024-09-11T22:11:14.875875+0000","last_became_peered":"2024-09-11T22:11:14.875875+0000","last_unstale":"2024-09-11T22:11:16.111198+0000","last_undegraded":"2024-09-11T22:11:16.111198+0000","last_fullsized":"2024-09-11T22:11:16.111198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:10.814560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856466+0000","last_change":"2024-09-11T22:11:14.870455+0000","last_active":"2024-09-11T22:11:15.856466+0000","last_peered":"2024-09-11T22:11:15.856466+0000","last_clean":"2024-09-11T22:11:15.856466+0000","last_became_active":"2024-09-11T22:11:14.870099+0000","last_became_peered":"2024-09-11T22:11:14.870099+0000","last_unstale":"2024-09-11T22:11:15.856466+0000","last_undegraded":"2024-09-11T22:11:15.856466+0000","last_fullsized":"2024-09-11T22:11:15.856466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722493+0000","last_change":"2024-09-11T22:11:14.873524+0000","last_active":"2024-09-11T22:11:16.722493+0000","last_peered":"2024-09-11T22:11:16.722493+0000","last_clean":"2024-09-11T22:11:16.722493+0000","last_became_active":"2024-09-11T22:11:14.873148+0000","last_became_peered":"2024-09-11T22:11:14.873148+0000","last_unstale":"2024-09-11T22:11:16.722493+0000","last_undegraded":"2024-09-11T22:11:16.722493+0000","last_fullsized":"2024-09-11T22:11:16.722493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860390+0000","last_change":"2024-09-11T22:11:14.880383+0000","last_active":"2024-09-11T22:11:15.860390+0000","last_peered":"2024-09-11T22:11:15.860390+0000","last_clean":"2024-09-11T22:11:15.860390+0000","last_became_active":"2024-09-11T22:11:14.880104+0000","last_became_peered":"2024-09-11T22:11:14.880104+0000","last_unstale":"2024-09-11T22:11:15.860390+0000","last_undegraded":"2024-09-11T22:11:15.860390+0000","last_fullsized":"2024-09-11T22:11:15.860390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:49.232203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110946+0000","last_change":"2024-09-11T22:11:14.873339+0000","last_active":"2024-09-11T22:11:16.110946+0000","last_peered":"2024-09-11T22:11:16.110946+0000","last_clean":"2024-09-11T22:11:16.110946+0000","last_became_active":"2024-09-11T22:11:14.873054+0000","last_became_peered":"2024-09-11T22:11:14.873054+0000","last_unstale":"2024-09-11T22:11:16.110946+0000","last_undegraded":"2024-09-11T22:11:16.110946+0000","last_fullsized":"2024-09-11T22:11:16.110946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:59.654960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860174+0000","last_change":"2024-09-11T22:11:14.870895+0000","last_active":"2024-09-11T22:11:15.860174+0000","last_peered":"2024-09-11T22:11:15.860174+0000","last_clean":"2024-09-11T22:11:15.860174+0000","last_became_active":"2024-09-11T22:11:14.870514+0000","last_became_peered":"2024-09-11T22:11:14.870514+0000","last_unstale":"2024-09-11T22:11:15.860174+0000","last_undegraded":"2024-09-11T22:11:15.860174+0000","last_fullsized":"2024-09-11T22:11:15.860174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110583+0000","last_change":"2024-09-11T22:11:14.872287+0000","last_active":"2024-09-11T22:11:16.110583+0000","last_peered":"2024-09-11T22:11:16.110583+0000","last_clean":"2024-09-11T22:11:16.110583+0000","last_became_active":"2024-09-11T22:11:14.871977+0000","last_became_peered":"2024-09-11T22:11:14.871977+0000","last_unstale":"2024-09-11T22:11:16.110583+0000","last_undegraded":"2024-09-11T22:11:16.110583+0000","last_fullsized":"2024-09-11T22:11:16.110583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:14.914022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720946+0000","last_change":"2024-09-11T22:11:14.875401+0000","last_active":"2024-09-11T22:11:16.720946+0000","last_peered":"2024-09-11T22:11:16.720946+0000","last_clean":"2024-09-11T22:11:16.720946+0000","last_became_active":"2024-09-11T22:11:14.875082+0000","last_became_peered":"2024-09-11T22:11:14.875082+0000","last_unstale":"2024-09-11T22:11:16.720946+0000","last_undegraded":"2024-09-11T22:11:16.720946+0000","last_fullsized":"2024-09-11T22:11:16.720946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.370344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111194+0000","last_change":"2024-09-11T22:11:14.876721+0000","last_active":"2024-09-11T22:11:16.111194+0000","last_peered":"2024-09-11T22:11:16.111194+0000","last_clean":"2024-09-11T22:11:16.111194+0000","last_became_active":"2024-09-11T22:11:14.875811+0000","last_became_peered":"2024-09-11T22:11:14.875811+0000","last_unstale":"2024-09-11T22:11:16.111194+0000","last_undegraded":"2024-09-11T22:11:16.111194+0000","last_fullsized":"2024-09-11T22:11:16.111194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:54.472996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860289+0000","last_change":"2024-09-11T22:11:14.871993+0000","last_active":"2024-09-11T22:11:15.860289+0000","last_peered":"2024-09-11T22:11:15.860289+0000","last_clean":"2024-09-11T22:11:15.860289+0000","last_became_active":"2024-09-11T22:11:14.871514+0000","last_became_peered":"2024-09-11T22:11:14.871514+0000","last_unstale":"2024-09-11T22:11:15.860289+0000","last_undegraded":"2024-09-11T22:11:15.860289+0000","last_fullsized":"2024-09-11T22:11:15.860289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859950+0000","last_change":"2024-09-11T22:11:14.871449+0000","last_active":"2024-09-11T22:11:15.859950+0000","last_peered":"2024-09-11T22:11:15.859950+0000","last_clean":"2024-09-11T22:11:15.859950+0000","last_became_active":"2024-09-11T22:11:14.871199+0000","last_became_peered":"2024-09-11T22:11:14.871199+0000","last_unstale":"2024-09-11T22:11:15.859950+0000","last_undegraded":"2024-09-11T22:11:15.859950+0000","last_fullsized":"2024-09-11T22:11:15.859950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.504256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721036+0000","last_change":"2024-09-11T22:11:14.873836+0000","last_active":"2024-09-11T22:11:16.721036+0000","last_peered":"2024-09-11T22:11:16.721036+0000","last_clean":"2024-09-11T22:11:16.721036+0000","last_became_active":"2024-09-11T22:11:14.873416+0000","last_became_peered":"2024-09-11T22:11:14.873416+0000","last_unstale":"2024-09-11T22:11:16.721036+0000","last_undegraded":"2024-09-11T22:11:16.721036+0000","last_fullsized":"2024-09-11T22:11:16.721036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:21.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721985+0000","last_change":"2024-09-11T22:11:14.869438+0000","last_active":"2024-09-11T22:11:16.721985+0000","last_peered":"2024-09-11T22:11:16.721985+0000","last_clean":"2024-09-11T22:11:16.721985+0000","last_became_active":"2024-09-11T22:11:14.869123+0000","last_became_peered":"2024-09-11T22:11:14.869123+0000","last_unstale":"2024-09-11T22:11:16.721985+0000","last_undegraded":"2024-09-11T22:11:16.721985+0000","last_fullsized":"2024-09-11T22:11:16.721985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:24.265434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721027+0000","last_change":"2024-09-11T22:11:14.869092+0000","last_active":"2024-09-11T22:11:16.721027+0000","last_peered":"2024-09-11T22:11:16.721027+0000","last_clean":"2024-09-11T22:11:16.721027+0000","last_became_active":"2024-09-11T22:11:14.868753+0000","last_became_peered":"2024-09-11T22:11:14.868753+0000","last_unstale":"2024-09-11T22:11:16.721027+0000","last_undegraded":"2024-09-11T22:11:16.721027+0000","last_fullsized":"2024-09-11T22:11:16.721027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:21.821517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856216+0000","last_change":"2024-09-11T22:11:14.860104+0000","last_active":"2024-09-11T22:11:15.856216+0000","last_peered":"2024-09-11T22:11:15.856216+0000","last_clean":"2024-09-11T22:11:15.856216+0000","last_became_active":"2024-09-11T22:11:14.859804+0000","last_became_peered":"2024-09-11T22:11:14.859804+0000","last_unstale":"2024-09-11T22:11:15.856216+0000","last_undegraded":"2024-09-11T22:11:15.856216+0000","last_fullsized":"2024-09-11T22:11:15.856216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.504256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859806+0000","last_change":"2024-09-11T22:11:14.869261+0000","last_active":"2024-09-11T22:11:15.859806+0000","last_peered":"2024-09-11T22:11:15.859806+0000","last_clean":"2024-09-11T22:11:15.859806+0000","last_became_active":"2024-09-11T22:11:14.868403+0000","last_became_peered":"2024-09-11T22:11:14.868403+0000","last_unstale":"2024-09-11T22:11:15.859806+0000","last_undegraded":"2024-09-11T22:11:15.859806+0000","last_fullsized":"2024-09-11T22:11:15.859806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.861121+0000","last_change":"2024-09-11T22:11:14.873272+0000","last_active":"2024-09-11T22:11:15.861121+0000","last_peered":"2024-09-11T22:11:15.861121+0000","last_clean":"2024-09-11T22:11:15.861121+0000","last_became_active":"2024-09-11T22:11:14.873003+0000","last_became_peered":"2024-09-11T22:11:14.873003+0000","last_unstale":"2024-09-11T22:11:15.861121+0000","last_undegraded":"2024-09-11T22:11:15.861121+0000","last_fullsized":"2024-09-11T22:11:15.861121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.623451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720994+0000","last_change":"2024-09-11T22:11:14.869711+0000","last_active":"2024-09-11T22:11:16.720994+0000","last_peered":"2024-09-11T22:11:16.720994+0000","last_clean":"2024-09-11T22:11:16.720994+0000","last_became_active":"2024-09-11T22:11:14.869409+0000","last_became_peered":"2024-09-11T22:11:14.869409+0000","last_unstale":"2024-09-11T22:11:16.720994+0000","last_undegraded":"2024-09-11T22:11:16.720994+0000","last_fullsized":"2024-09-11T22:11:16.720994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:52.878296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111027+0000","last_change":"2024-09-11T22:11:14.879040+0000","last_active":"2024-09-11T22:11:16.111027+0000","last_peered":"2024-09-11T22:11:16.111027+0000","last_clean":"2024-09-11T22:11:16.111027+0000","last_became_active":"2024-09-11T22:11:14.877938+0000","last_became_peered":"2024-09-11T22:11:14.877938+0000","last_unstale":"2024-09-11T22:11:16.111027+0000","last_undegraded":"2024-09-11T22:11:16.111027+0000","last_fullsized":"2024-09-11T22:11:16.111027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:07.443098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860231+0000","last_change":"2024-09-11T22:11:14.874997+0000","last_active":"2024-09-11T22:11:15.860231+0000","last_peered":"2024-09-11T22:11:15.860231+0000","last_clean":"2024-09-11T22:11:15.860231+0000","last_became_active":"2024-09-11T22:11:14.874597+0000","last_became_peered":"2024-09-11T22:11:14.874597+0000","last_unstale":"2024-09-11T22:11:15.860231+0000","last_undegraded":"2024-09-11T22:11:15.860231+0000","last_fullsized":"2024-09-11T22:11:15.860231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:02.999213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721437+0000","last_change":"2024-09-11T22:11:14.879236+0000","last_active":"2024-09-11T22:11:16.721437+0000","last_peered":"2024-09-11T22:11:16.721437+0000","last_clean":"2024-09-11T22:11:16.721437+0000","last_became_active":"2024-09-11T22:11:14.878980+0000","last_became_peered":"2024-09-11T22:11:14.878980+0000","last_unstale":"2024-09-11T22:11:16.721437+0000","last_undegraded":"2024-09-11T22:11:16.721437+0000","last_fullsized":"2024-09-11T22:11:16.721437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:23.884038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860346+0000","last_change":"2024-09-11T22:11:14.874326+0000","last_active":"2024-09-11T22:11:15.860346+0000","last_peered":"2024-09-11T22:11:15.860346+0000","last_clean":"2024-09-11T22:11:15.860346+0000","last_became_active":"2024-09-11T22:11:14.873996+0000","last_became_peered":"2024-09-11T22:11:14.873996+0000","last_unstale":"2024-09-11T22:11:15.860346+0000","last_undegraded":"2024-09-11T22:11:15.860346+0000","last_fullsized":"2024-09-11T22:11:15.860346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:41.100253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721611+0000","last_change":"2024-09-11T22:11:14.876744+0000","last_active":"2024-09-11T22:11:16.721611+0000","last_peered":"2024-09-11T22:11:16.721611+0000","last_clean":"2024-09-11T22:11:16.721611+0000","last_became_active":"2024-09-11T22:11:14.875632+0000","last_became_peered":"2024-09-11T22:11:14.875632+0000","last_unstale":"2024-09-11T22:11:16.721611+0000","last_undegraded":"2024-09-11T22:11:16.721611+0000","last_fullsized":"2024-09-11T22:11:16.721611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:41.100253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860407+0000","last_change":"2024-09-11T22:11:14.869931+0000","last_active":"2024-09-11T22:11:15.860407+0000","last_peered":"2024-09-11T22:11:15.860407+0000","last_clean":"2024-09-11T22:11:15.860407+0000","last_became_active":"2024-09-11T22:11:14.869668+0000","last_became_peered":"2024-09-11T22:11:14.869668+0000","last_unstale":"2024-09-11T22:11:15.860407+0000","last_undegraded":"2024-09-11T22:11:15.860407+0000","last_fullsized":"2024-09-11T22:11:15.860407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:24.265434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720826+0000","last_change":"2024-09-11T22:11:14.877381+0000","last_active":"2024-09-11T22:11:16.720826+0000","last_peered":"2024-09-11T22:11:16.720826+0000","last_clean":"2024-09-11T22:11:16.720826+0000","last_became_active":"2024-09-11T22:11:14.876638+0000","last_became_peered":"2024-09-11T22:11:14.876638+0000","last_unstale":"2024-09-11T22:11:16.720826+0000","last_undegraded":"2024-09-11T22:11:16.720826+0000","last_fullsized":"2024-09-11T22:11:16.720826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:23.884038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860422+0000","last_change":"2024-09-11T22:11:14.873836+0000","last_active":"2024-09-11T22:11:15.860422+0000","last_peered":"2024-09-11T22:11:15.860422+0000","last_clean":"2024-09-11T22:11:15.860422+0000","last_became_active":"2024-09-11T22:11:14.873277+0000","last_became_peered":"2024-09-11T22:11:14.873277+0000","last_unstale":"2024-09-11T22:11:15.860422+0000","last_undegraded":"2024-09-11T22:11:15.860422+0000","last_fullsized":"2024-09-11T22:11:15.860422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856398+0000","last_change":"2024-09-11T22:11:14.872571+0000","last_active":"2024-09-11T22:11:15.856398+0000","last_peered":"2024-09-11T22:11:15.856398+0000","last_clean":"2024-09-11T22:11:15.856398+0000","last_became_active":"2024-09-11T22:11:14.872286+0000","last_became_peered":"2024-09-11T22:11:14.872286+0000","last_unstale":"2024-09-11T22:11:15.856398+0000","last_undegraded":"2024-09-11T22:11:15.856398+0000","last_fullsized":"2024-09-11T22:11:15.856398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:02.999213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721392+0000","last_change":"2024-09-11T22:11:14.875536+0000","last_active":"2024-09-11T22:11:16.721392+0000","last_peered":"2024-09-11T22:11:16.721392+0000","last_clean":"2024-09-11T22:11:16.721392+0000","last_became_active":"2024-09-11T22:11:14.875253+0000","last_became_peered":"2024-09-11T22:11:14.875253+0000","last_unstale":"2024-09-11T22:11:16.721392+0000","last_undegraded":"2024-09-11T22:11:16.721392+0000","last_fullsized":"2024-09-11T22:11:16.721392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721577+0000","last_change":"2024-09-11T22:11:14.876898+0000","last_active":"2024-09-11T22:11:16.721577+0000","last_peered":"2024-09-11T22:11:16.721577+0000","last_clean":"2024-09-11T22:11:16.721577+0000","last_became_active":"2024-09-11T22:11:14.876337+0000","last_became_peered":"2024-09-11T22:11:14.876337+0000","last_unstale":"2024-09-11T22:11:16.721577+0000","last_undegraded":"2024-09-11T22:11:16.721577+0000","last_fullsized":"2024-09-11T22:11:16.721577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.370344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860606+0000","last_change":"2024-09-11T22:11:14.880080+0000","last_active":"2024-09-11T22:11:15.860606+0000","last_peered":"2024-09-11T22:11:15.860606+0000","last_clean":"2024-09-11T22:11:15.860606+0000","last_became_active":"2024-09-11T22:11:14.879830+0000","last_became_peered":"2024-09-11T22:11:14.879830+0000","last_unstale":"2024-09-11T22:11:15.860606+0000","last_undegraded":"2024-09-11T22:11:15.860606+0000","last_fullsized":"2024-09-11T22:11:15.860606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:58.767744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720886+0000","last_change":"2024-09-11T22:11:14.872267+0000","last_active":"2024-09-11T22:11:16.720886+0000","last_peered":"2024-09-11T22:11:16.720886+0000","last_clean":"2024-09-11T22:11:16.720886+0000","last_became_active":"2024-09-11T22:11:14.871979+0000","last_became_peered":"2024-09-11T22:11:14.871979+0000","last_unstale":"2024-09-11T22:11:16.720886+0000","last_undegraded":"2024-09-11T22:11:16.720886+0000","last_fullsized":"2024-09-11T22:11:16.720886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:10.170067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859741+0000","last_change":"2024-09-11T22:11:14.876761+0000","last_active":"2024-09-11T22:11:15.859741+0000","last_peered":"2024-09-11T22:11:15.859741+0000","last_clean":"2024-09-11T22:11:15.859741+0000","last_became_active":"2024-09-11T22:11:14.876471+0000","last_became_peered":"2024-09-11T22:11:14.876471+0000","last_unstale":"2024-09-11T22:11:15.859741+0000","last_undegraded":"2024-09-11T22:11:15.859741+0000","last_fullsized":"2024-09-11T22:11:15.859741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:23.884038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720774+0000","last_change":"2024-09-11T22:11:14.860824+0000","last_active":"2024-09-11T22:11:16.720774+0000","last_peered":"2024-09-11T22:11:16.720774+0000","last_clean":"2024-09-11T22:11:16.720774+0000","last_became_active":"2024-09-11T22:11:14.860544+0000","last_became_peered":"2024-09-11T22:11:14.860544+0000","last_unstale":"2024-09-11T22:11:16.720774+0000","last_undegraded":"2024-09-11T22:11:16.720774+0000","last_fullsized":"2024-09-11T22:11:16.720774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:54.339754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722220+0000","last_change":"2024-09-11T22:11:13.870101+0000","last_active":"2024-09-11T22:11:16.722220+0000","last_peered":"2024-09-11T22:11:16.722220+0000","last_clean":"2024-09-11T22:11:16.722220+0000","last_became_active":"2024-09-11T22:11:13.869798+0000","last_became_peered":"2024-09-11T22:11:13.869798+0000","last_unstale":"2024-09-11T22:11:16.722220+0000","last_undegraded":"2024-09-11T22:11:16.722220+0000","last_fullsized":"2024-09-11T22:11:16.722220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721719+0000","last_change":"2024-09-11T22:11:14.874507+0000","last_active":"2024-09-11T22:11:16.721719+0000","last_peered":"2024-09-11T22:11:16.721719+0000","last_clean":"2024-09-11T22:11:16.721719+0000","last_became_active":"2024-09-11T22:11:14.874159+0000","last_became_peered":"2024-09-11T22:11:14.874159+0000","last_unstale":"2024-09-11T22:11:16.721719+0000","last_undegraded":"2024-09-11T22:11:16.721719+0000","last_fullsized":"2024-09-11T22:11:16.721719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.504256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859877+0000","last_change":"2024-09-11T22:11:13.871132+0000","last_active":"2024-09-11T22:11:15.859877+0000","last_peered":"2024-09-11T22:11:15.859877+0000","last_clean":"2024-09-11T22:11:15.859877+0000","last_became_active":"2024-09-11T22:11:13.870831+0000","last_became_peered":"2024-09-11T22:11:13.870831+0000","last_unstale":"2024-09-11T22:11:15.859877+0000","last_undegraded":"2024-09-11T22:11:15.859877+0000","last_fullsized":"2024-09-11T22:11:15.859877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:16.770079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721708+0000","last_change":"2024-09-11T22:11:13.871011+0000","last_active":"2024-09-11T22:11:16.721708+0000","last_peered":"2024-09-11T22:11:16.721708+0000","last_clean":"2024-09-11T22:11:16.721708+0000","last_became_active":"2024-09-11T22:11:13.870723+0000","last_became_peered":"2024-09-11T22:11:13.870723+0000","last_unstale":"2024-09-11T22:11:16.721708+0000","last_undegraded":"2024-09-11T22:11:16.721708+0000","last_fullsized":"2024-09-11T22:11:16.721708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721121+0000","last_change":"2024-09-11T22:11:14.881540+0000","last_active":"2024-09-11T22:11:16.721121+0000","last_peered":"2024-09-11T22:11:16.721121+0000","last_clean":"2024-09-11T22:11:16.721121+0000","last_became_active":"2024-09-11T22:11:14.881249+0000","last_became_peered":"2024-09-11T22:11:14.881249+0000","last_unstale":"2024-09-11T22:11:16.721121+0000","last_undegraded":"2024-09-11T22:11:16.721121+0000","last_fullsized":"2024-09-11T22:11:16.721121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860180+0000","last_change":"2024-09-11T22:11:13.867235+0000","last_active":"2024-09-11T22:11:15.860180+0000","last_peered":"2024-09-11T22:11:15.860180+0000","last_clean":"2024-09-11T22:11:15.860180+0000","last_became_active":"2024-09-11T22:11:13.866963+0000","last_became_peered":"2024-09-11T22:11:13.866963+0000","last_unstale":"2024-09-11T22:11:15.860180+0000","last_undegraded":"2024-09-11T22:11:15.860180+0000","last_fullsized":"2024-09-11T22:11:15.860180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:53.334520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856208+0000","last_change":"2024-09-11T22:11:14.873284+0000","last_active":"2024-09-11T22:11:15.856208+0000","last_peered":"2024-09-11T22:11:15.856208+0000","last_clean":"2024-09-11T22:11:15.856208+0000","last_became_active":"2024-09-11T22:11:14.873030+0000","last_became_peered":"2024-09-11T22:11:14.873030+0000","last_unstale":"2024-09-11T22:11:15.856208+0000","last_undegraded":"2024-09-11T22:11:15.856208+0000","last_fullsized":"2024-09-11T22:11:15.856208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.370344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859886+0000","last_change":"2024-09-11T22:11:13.874393+0000","last_active":"2024-09-11T22:11:15.859886+0000","last_peered":"2024-09-11T22:11:15.859886+0000","last_clean":"2024-09-11T22:11:15.859886+0000","last_became_active":"2024-09-11T22:11:13.874074+0000","last_became_peered":"2024-09-11T22:11:13.874074+0000","last_unstale":"2024-09-11T22:11:15.859886+0000","last_undegraded":"2024-09-11T22:11:15.859886+0000","last_fullsized":"2024-09-11T22:11:15.859886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:37.267640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860641+0000","last_change":"2024-09-11T22:11:14.872584+0000","last_active":"2024-09-11T22:11:15.860641+0000","last_peered":"2024-09-11T22:11:15.860641+0000","last_clean":"2024-09-11T22:11:15.860641+0000","last_became_active":"2024-09-11T22:11:14.872284+0000","last_became_peered":"2024-09-11T22:11:14.872284+0000","last_unstale":"2024-09-11T22:11:15.860641+0000","last_undegraded":"2024-09-11T22:11:15.860641+0000","last_fullsized":"2024-09-11T22:11:15.860641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:04.047452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860682+0000","last_change":"2024-09-11T22:11:13.870015+0000","last_active":"2024-09-11T22:11:15.860682+0000","last_peered":"2024-09-11T22:11:15.860682+0000","last_clean":"2024-09-11T22:11:15.860682+0000","last_became_active":"2024-09-11T22:11:13.869685+0000","last_became_peered":"2024-09-11T22:11:13.869685+0000","last_unstale":"2024-09-11T22:11:15.860682+0000","last_undegraded":"2024-09-11T22:11:15.860682+0000","last_fullsized":"2024-09-11T22:11:15.860682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:37.267640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722219+0000","last_change":"2024-09-11T22:11:14.873692+0000","last_active":"2024-09-11T22:11:16.722219+0000","last_peered":"2024-09-11T22:11:16.722219+0000","last_clean":"2024-09-11T22:11:16.722219+0000","last_became_active":"2024-09-11T22:11:14.873206+0000","last_became_peered":"2024-09-11T22:11:14.873206+0000","last_unstale":"2024-09-11T22:11:16.722219+0000","last_undegraded":"2024-09-11T22:11:16.722219+0000","last_fullsized":"2024-09-11T22:11:16.722219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856400+0000","last_change":"2024-09-11T22:11:13.870967+0000","last_active":"2024-09-11T22:11:15.856400+0000","last_peered":"2024-09-11T22:11:15.856400+0000","last_clean":"2024-09-11T22:11:15.856400+0000","last_became_active":"2024-09-11T22:11:13.870687+0000","last_became_peered":"2024-09-11T22:11:13.870687+0000","last_unstale":"2024-09-11T22:11:15.856400+0000","last_undegraded":"2024-09-11T22:11:15.856400+0000","last_fullsized":"2024-09-11T22:11:15.856400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:20.377207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721034+0000","last_change":"2024-09-11T22:11:14.877068+0000","last_active":"2024-09-11T22:11:16.721034+0000","last_peered":"2024-09-11T22:11:16.721034+0000","last_clean":"2024-09-11T22:11:16.721034+0000","last_became_active":"2024-09-11T22:11:14.876709+0000","last_became_peered":"2024-09-11T22:11:14.876709+0000","last_unstale":"2024-09-11T22:11:16.721034+0000","last_undegraded":"2024-09-11T22:11:16.721034+0000","last_fullsized":"2024-09-11T22:11:16.721034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:51:40.769228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860328+0000","last_change":"2024-09-11T22:11:13.873578+0000","last_active":"2024-09-11T22:11:15.860328+0000","last_peered":"2024-09-11T22:11:15.860328+0000","last_clean":"2024-09-11T22:11:15.860328+0000","last_became_active":"2024-09-11T22:11:13.873273+0000","last_became_peered":"2024-09-11T22:11:13.873273+0000","last_unstale":"2024-09-11T22:11:15.860328+0000","last_undegraded":"2024-09-11T22:11:15.860328+0000","last_fullsized":"2024-09-11T22:11:15.860328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.543280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110782+0000","last_change":"2024-09-11T22:11:14.879023+0000","last_active":"2024-09-11T22:11:16.110782+0000","last_peered":"2024-09-11T22:11:16.110782+0000","last_clean":"2024-09-11T22:11:16.110782+0000","last_became_active":"2024-09-11T22:11:14.876039+0000","last_became_peered":"2024-09-11T22:11:14.876039+0000","last_unstale":"2024-09-11T22:11:16.110782+0000","last_undegraded":"2024-09-11T22:11:16.110782+0000","last_fullsized":"2024-09-11T22:11:16.110782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:38.090077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721813+0000","last_change":"2024-09-11T22:11:13.863099+0000","last_active":"2024-09-11T22:11:16.721813+0000","last_peered":"2024-09-11T22:11:16.721813+0000","last_clean":"2024-09-11T22:11:16.721813+0000","last_became_active":"2024-09-11T22:11:13.862812+0000","last_became_peered":"2024-09-11T22:11:13.862812+0000","last_unstale":"2024-09-11T22:11:16.721813+0000","last_undegraded":"2024-09-11T22:11:16.721813+0000","last_fullsized":"2024-09-11T22:11:16.721813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721180+0000","last_change":"2024-09-11T22:11:14.878517+0000","last_active":"2024-09-11T22:11:16.721180+0000","last_peered":"2024-09-11T22:11:16.721180+0000","last_clean":"2024-09-11T22:11:16.721180+0000","last_became_active":"2024-09-11T22:11:14.878209+0000","last_became_peered":"2024-09-11T22:11:14.878209+0000","last_unstale":"2024-09-11T22:11:16.721180+0000","last_undegraded":"2024-09-11T22:11:16.721180+0000","last_fullsized":"2024-09-11T22:11:16.721180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:34.949017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860892+0000","last_change":"2024-09-11T22:11:13.866150+0000","last_active":"2024-09-11T22:11:15.860892+0000","last_peered":"2024-09-11T22:11:15.860892+0000","last_clean":"2024-09-11T22:11:15.860892+0000","last_became_active":"2024-09-11T22:11:13.865864+0000","last_became_peered":"2024-09-11T22:11:13.865864+0000","last_unstale":"2024-09-11T22:11:15.860892+0000","last_undegraded":"2024-09-11T22:11:15.860892+0000","last_fullsized":"2024-09-11T22:11:15.860892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:16.770079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110900+0000","last_change":"2024-09-11T22:11:14.874944+0000","last_active":"2024-09-11T22:11:16.110900+0000","last_peered":"2024-09-11T22:11:16.110900+0000","last_clean":"2024-09-11T22:11:16.110900+0000","last_became_active":"2024-09-11T22:11:14.874659+0000","last_became_peered":"2024-09-11T22:11:14.874659+0000","last_unstale":"2024-09-11T22:11:16.110900+0000","last_undegraded":"2024-09-11T22:11:16.110900+0000","last_fullsized":"2024-09-11T22:11:16.110900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:32.470561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859729+0000","last_change":"2024-09-11T22:11:13.873542+0000","last_active":"2024-09-11T22:11:15.859729+0000","last_peered":"2024-09-11T22:11:15.859729+0000","last_clean":"2024-09-11T22:11:15.859729+0000","last_became_active":"2024-09-11T22:11:13.873248+0000","last_became_peered":"2024-09-11T22:11:13.873248+0000","last_unstale":"2024-09-11T22:11:15.859729+0000","last_undegraded":"2024-09-11T22:11:15.859729+0000","last_fullsized":"2024-09-11T22:11:15.859729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:45.183251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860222+0000","last_change":"2024-09-11T22:11:14.869832+0000","last_active":"2024-09-11T22:11:15.860222+0000","last_peered":"2024-09-11T22:11:15.860222+0000","last_clean":"2024-09-11T22:11:15.860222+0000","last_became_active":"2024-09-11T22:11:14.869351+0000","last_became_peered":"2024-09-11T22:11:14.869351+0000","last_unstale":"2024-09-11T22:11:15.860222+0000","last_undegraded":"2024-09-11T22:11:15.860222+0000","last_fullsized":"2024-09-11T22:11:15.860222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720569+0000","last_change":"2024-09-11T22:11:13.870778+0000","last_active":"2024-09-11T22:11:16.720569+0000","last_peered":"2024-09-11T22:11:16.720569+0000","last_clean":"2024-09-11T22:11:16.720569+0000","last_became_active":"2024-09-11T22:11:13.870346+0000","last_became_peered":"2024-09-11T22:11:13.870346+0000","last_unstale":"2024-09-11T22:11:16.720569+0000","last_undegraded":"2024-09-11T22:11:16.720569+0000","last_fullsized":"2024-09-11T22:11:16.720569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:43.931796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110657+0000","last_change":"2024-09-11T22:11:14.880819+0000","last_active":"2024-09-11T22:11:16.110657+0000","last_peered":"2024-09-11T22:11:16.110657+0000","last_clean":"2024-09-11T22:11:16.110657+0000","last_became_active":"2024-09-11T22:11:14.880536+0000","last_became_peered":"2024-09-11T22:11:14.880536+0000","last_unstale":"2024-09-11T22:11:16.110657+0000","last_undegraded":"2024-09-11T22:11:16.110657+0000","last_fullsized":"2024-09-11T22:11:16.110657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:02.658218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720999+0000","last_change":"2024-09-11T22:11:13.864325+0000","last_active":"2024-09-11T22:11:16.720999+0000","last_peered":"2024-09-11T22:11:16.720999+0000","last_clean":"2024-09-11T22:11:16.720999+0000","last_became_active":"2024-09-11T22:11:13.862906+0000","last_became_peered":"2024-09-11T22:11:13.862906+0000","last_unstale":"2024-09-11T22:11:16.720999+0000","last_undegraded":"2024-09-11T22:11:16.720999+0000","last_fullsized":"2024-09-11T22:11:16.720999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111015+0000","last_change":"2024-09-11T22:11:14.874987+0000","last_active":"2024-09-11T22:11:16.111015+0000","last_peered":"2024-09-11T22:11:16.111015+0000","last_clean":"2024-09-11T22:11:16.111015+0000","last_became_active":"2024-09-11T22:11:14.874705+0000","last_became_peered":"2024-09-11T22:11:14.874705+0000","last_unstale":"2024-09-11T22:11:16.111015+0000","last_undegraded":"2024-09-11T22:11:16.111015+0000","last_fullsized":"2024-09-11T22:11:16.111015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:23.382930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721113+0000","last_change":"2024-09-11T22:11:13.865829+0000","last_active":"2024-09-11T22:11:16.721113+0000","last_peered":"2024-09-11T22:11:16.721113+0000","last_clean":"2024-09-11T22:11:16.721113+0000","last_became_active":"2024-09-11T22:11:13.865535+0000","last_became_peered":"2024-09-11T22:11:13.865535+0000","last_unstale":"2024-09-11T22:11:16.721113+0000","last_undegraded":"2024-09-11T22:11:16.721113+0000","last_fullsized":"2024-09-11T22:11:16.721113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:47.814287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111285+0000","last_change":"2024-09-11T22:11:14.878706+0000","last_active":"2024-09-11T22:11:16.111285+0000","last_peered":"2024-09-11T22:11:16.111285+0000","last_clean":"2024-09-11T22:11:16.111285+0000","last_became_active":"2024-09-11T22:11:14.876102+0000","last_became_peered":"2024-09-11T22:11:14.876102+0000","last_unstale":"2024-09-11T22:11:16.111285+0000","last_undegraded":"2024-09-11T22:11:16.111285+0000","last_fullsized":"2024-09-11T22:11:16.111285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:15.113361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856490+0000","last_change":"2024-09-11T22:11:13.873640+0000","last_active":"2024-09-11T22:11:15.856490+0000","last_peered":"2024-09-11T22:11:15.856490+0000","last_clean":"2024-09-11T22:11:15.856490+0000","last_became_active":"2024-09-11T22:11:13.873311+0000","last_became_peered":"2024-09-11T22:11:13.873311+0000","last_unstale":"2024-09-11T22:11:15.856490+0000","last_undegraded":"2024-09-11T22:11:15.856490+0000","last_fullsized":"2024-09-11T22:11:15.856490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:51:39.763993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860808+0000","last_change":"2024-09-11T22:11:14.868944+0000","last_active":"2024-09-11T22:11:15.860808+0000","last_peered":"2024-09-11T22:11:15.860808+0000","last_clean":"2024-09-11T22:11:15.860808+0000","last_became_active":"2024-09-11T22:11:14.868668+0000","last_became_peered":"2024-09-11T22:11:14.868668+0000","last_unstale":"2024-09-11T22:11:15.860808+0000","last_undegraded":"2024-09-11T22:11:15.860808+0000","last_fullsized":"2024-09-11T22:11:15.860808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:05:25.843711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720774+0000","last_change":"2024-09-11T22:11:13.870777+0000","last_active":"2024-09-11T22:11:16.720774+0000","last_peered":"2024-09-11T22:11:16.720774+0000","last_clean":"2024-09-11T22:11:16.720774+0000","last_became_active":"2024-09-11T22:11:13.869718+0000","last_became_peered":"2024-09-11T22:11:13.869718+0000","last_unstale":"2024-09-11T22:11:16.720774+0000","last_undegraded":"2024-09-11T22:11:16.720774+0000","last_fullsized":"2024-09-11T22:11:16.720774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:24.001331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110830+0000","last_change":"2024-09-11T22:11:14.878531+0000","last_active":"2024-09-11T22:11:16.110830+0000","last_peered":"2024-09-11T22:11:16.110830+0000","last_clean":"2024-09-11T22:11:16.110830+0000","last_became_active":"2024-09-11T22:11:14.875925+0000","last_became_peered":"2024-09-11T22:11:14.875925+0000","last_unstale":"2024-09-11T22:11:16.110830+0000","last_undegraded":"2024-09-11T22:11:16.110830+0000","last_fullsized":"2024-09-11T22:11:16.110830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:03.171917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110562+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:11:16.110562+0000","last_peered":"2024-09-11T22:11:16.110562+0000","last_clean":"2024-09-11T22:11:16.110562+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:11:16.110562+0000","last_undegraded":"2024-09-11T22:11:16.110562+0000","last_fullsized":"2024-09-11T22:11:16.110562+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860054+0000","last_change":"2024-09-11T22:11:13.863848+0000","last_active":"2024-09-11T22:11:15.860054+0000","last_peered":"2024-09-11T22:11:15.860054+0000","last_clean":"2024-09-11T22:11:15.860054+0000","last_became_active":"2024-09-11T22:11:13.863555+0000","last_became_peered":"2024-09-11T22:11:13.863555+0000","last_unstale":"2024-09-11T22:11:15.860054+0000","last_undegraded":"2024-09-11T22:11:15.860054+0000","last_fullsized":"2024-09-11T22:11:15.860054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:45.183251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721078+0000","last_change":"2024-09-11T22:11:14.876698+0000","last_active":"2024-09-11T22:11:16.721078+0000","last_peered":"2024-09-11T22:11:16.721078+0000","last_clean":"2024-09-11T22:11:16.721078+0000","last_became_active":"2024-09-11T22:11:14.875680+0000","last_became_peered":"2024-09-11T22:11:14.875680+0000","last_unstale":"2024-09-11T22:11:16.721078+0000","last_undegraded":"2024-09-11T22:11:16.721078+0000","last_fullsized":"2024-09-11T22:11:16.721078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.504256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110456+0000","last_change":"2024-09-11T22:11:13.871233+0000","last_active":"2024-09-11T22:11:16.110456+0000","last_peered":"2024-09-11T22:11:16.110456+0000","last_clean":"2024-09-11T22:11:16.110456+0000","last_became_active":"2024-09-11T22:11:13.870954+0000","last_became_peered":"2024-09-11T22:11:13.870954+0000","last_unstale":"2024-09-11T22:11:16.110456+0000","last_undegraded":"2024-09-11T22:11:16.110456+0000","last_fullsized":"2024-09-11T22:11:16.110456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:12.996024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721857+0000","last_change":"2024-09-11T22:11:14.875279+0000","last_active":"2024-09-11T22:11:16.721857+0000","last_peered":"2024-09-11T22:11:16.721857+0000","last_clean":"2024-09-11T22:11:16.721857+0000","last_became_active":"2024-09-11T22:11:14.874757+0000","last_became_peered":"2024-09-11T22:11:14.874757+0000","last_unstale":"2024-09-11T22:11:16.721857+0000","last_undegraded":"2024-09-11T22:11:16.721857+0000","last_fullsized":"2024-09-11T22:11:16.721857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721567+0000","last_change":"2024-09-11T22:11:13.865189+0000","last_active":"2024-09-11T22:11:16.721567+0000","last_peered":"2024-09-11T22:11:16.721567+0000","last_clean":"2024-09-11T22:11:16.721567+0000","last_became_active":"2024-09-11T22:11:13.864912+0000","last_became_peered":"2024-09-11T22:11:13.864912+0000","last_unstale":"2024-09-11T22:11:16.721567+0000","last_undegraded":"2024-09-11T22:11:16.721567+0000","last_fullsized":"2024-09-11T22:11:16.721567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:20.511994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856228+0000","last_change":"2024-09-11T22:11:14.867477+0000","last_active":"2024-09-11T22:11:15.856228+0000","last_peered":"2024-09-11T22:11:15.856228+0000","last_clean":"2024-09-11T22:11:15.856228+0000","last_became_active":"2024-09-11T22:11:14.867198+0000","last_became_peered":"2024-09-11T22:11:14.867198+0000","last_unstale":"2024-09-11T22:11:15.856228+0000","last_undegraded":"2024-09-11T22:11:15.856228+0000","last_fullsized":"2024-09-11T22:11:15.856228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860938+0000","last_change":"2024-09-11T22:11:13.867676+0000","last_active":"2024-09-11T22:11:15.860938+0000","last_peered":"2024-09-11T22:11:15.860938+0000","last_clean":"2024-09-11T22:11:15.860938+0000","last_became_active":"2024-09-11T22:11:13.867391+0000","last_became_peered":"2024-09-11T22:11:13.867391+0000","last_unstale":"2024-09-11T22:11:15.860938+0000","last_undegraded":"2024-09-11T22:11:15.860938+0000","last_fullsized":"2024-09-11T22:11:15.860938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.543280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720999+0000","last_change":"2024-09-11T22:11:14.872333+0000","last_active":"2024-09-11T22:11:16.720999+0000","last_peered":"2024-09-11T22:11:16.720999+0000","last_clean":"2024-09-11T22:11:16.720999+0000","last_became_active":"2024-09-11T22:11:14.872066+0000","last_became_peered":"2024-09-11T22:11:14.872066+0000","last_unstale":"2024-09-11T22:11:16.720999+0000","last_undegraded":"2024-09-11T22:11:16.720999+0000","last_fullsized":"2024-09-11T22:11:16.720999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:06.548515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856337+0000","last_change":"2024-09-11T22:11:13.868171+0000","last_active":"2024-09-11T22:11:15.856337+0000","last_peered":"2024-09-11T22:11:15.856337+0000","last_clean":"2024-09-11T22:11:15.856337+0000","last_became_active":"2024-09-11T22:11:13.867826+0000","last_became_peered":"2024-09-11T22:11:13.867826+0000","last_unstale":"2024-09-11T22:11:15.856337+0000","last_undegraded":"2024-09-11T22:11:15.856337+0000","last_fullsized":"2024-09-11T22:11:15.856337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:53.334520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860761+0000","last_change":"2024-09-11T22:11:14.880771+0000","last_active":"2024-09-11T22:11:15.860761+0000","last_peered":"2024-09-11T22:11:15.860761+0000","last_clean":"2024-09-11T22:11:15.860761+0000","last_became_active":"2024-09-11T22:11:14.879966+0000","last_became_peered":"2024-09-11T22:11:14.879966+0000","last_unstale":"2024-09-11T22:11:15.860761+0000","last_undegraded":"2024-09-11T22:11:15.860761+0000","last_fullsized":"2024-09-11T22:11:15.860761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:39.616151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111068+0000","last_change":"2024-09-11T22:11:13.871639+0000","last_active":"2024-09-11T22:11:16.111068+0000","last_peered":"2024-09-11T22:11:16.111068+0000","last_clean":"2024-09-11T22:11:16.111068+0000","last_became_active":"2024-09-11T22:11:13.870825+0000","last_became_peered":"2024-09-11T22:11:13.870825+0000","last_unstale":"2024-09-11T22:11:16.111068+0000","last_undegraded":"2024-09-11T22:11:16.111068+0000","last_fullsized":"2024-09-11T22:11:16.111068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:04.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856421+0000","last_change":"2024-09-11T22:11:14.866676+0000","last_active":"2024-09-11T22:11:15.856421+0000","last_peered":"2024-09-11T22:11:15.856421+0000","last_clean":"2024-09-11T22:11:15.856421+0000","last_became_active":"2024-09-11T22:11:14.866402+0000","last_became_peered":"2024-09-11T22:11:14.866402+0000","last_unstale":"2024-09-11T22:11:15.856421+0000","last_undegraded":"2024-09-11T22:11:15.856421+0000","last_fullsized":"2024-09-11T22:11:15.856421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856557+0000","last_change":"2024-09-11T22:11:13.872366+0000","last_active":"2024-09-11T22:11:15.856557+0000","last_peered":"2024-09-11T22:11:15.856557+0000","last_clean":"2024-09-11T22:11:15.856557+0000","last_became_active":"2024-09-11T22:11:13.872085+0000","last_became_peered":"2024-09-11T22:11:13.872085+0000","last_unstale":"2024-09-11T22:11:15.856557+0000","last_undegraded":"2024-09-11T22:11:15.856557+0000","last_fullsized":"2024-09-11T22:11:15.856557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.543280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721020+0000","last_change":"2024-09-11T22:11:14.879201+0000","last_active":"2024-09-11T22:11:16.721020+0000","last_peered":"2024-09-11T22:11:16.721020+0000","last_clean":"2024-09-11T22:11:16.721020+0000","last_became_active":"2024-09-11T22:11:14.877959+0000","last_became_peered":"2024-09-11T22:11:14.877959+0000","last_unstale":"2024-09-11T22:11:16.721020+0000","last_undegraded":"2024-09-11T22:11:16.721020+0000","last_fullsized":"2024-09-11T22:11:16.721020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860117+0000","last_change":"2024-09-11T22:11:13.869408+0000","last_active":"2024-09-11T22:11:15.860117+0000","last_peered":"2024-09-11T22:11:15.860117+0000","last_clean":"2024-09-11T22:11:15.860117+0000","last_became_active":"2024-09-11T22:11:13.869118+0000","last_became_peered":"2024-09-11T22:11:13.869118+0000","last_unstale":"2024-09-11T22:11:15.860117+0000","last_undegraded":"2024-09-11T22:11:15.860117+0000","last_fullsized":"2024-09-11T22:11:15.860117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:53.334520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721337+0000","last_change":"2024-09-11T22:11:14.872499+0000","last_active":"2024-09-11T22:11:16.721337+0000","last_peered":"2024-09-11T22:11:16.721337+0000","last_clean":"2024-09-11T22:11:16.721337+0000","last_became_active":"2024-09-11T22:11:14.871587+0000","last_became_peered":"2024-09-11T22:11:14.871587+0000","last_unstale":"2024-09-11T22:11:16.721337+0000","last_undegraded":"2024-09-11T22:11:16.721337+0000","last_fullsized":"2024-09-11T22:11:16.721337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:35.612025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110425+0000","last_change":"2024-09-11T22:11:13.870364+0000","last_active":"2024-09-11T22:11:16.110425+0000","last_peered":"2024-09-11T22:11:16.110425+0000","last_clean":"2024-09-11T22:11:16.110425+0000","last_became_active":"2024-09-11T22:11:13.870090+0000","last_became_peered":"2024-09-11T22:11:13.870090+0000","last_unstale":"2024-09-11T22:11:16.110425+0000","last_undegraded":"2024-09-11T22:11:16.110425+0000","last_fullsized":"2024-09-11T22:11:16.110425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:26.952937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720829+0000","last_change":"2024-09-11T22:11:14.867034+0000","last_active":"2024-09-11T22:11:16.720829+0000","last_peered":"2024-09-11T22:11:16.720829+0000","last_clean":"2024-09-11T22:11:16.720829+0000","last_became_active":"2024-09-11T22:11:14.865159+0000","last_became_peered":"2024-09-11T22:11:14.865159+0000","last_unstale":"2024-09-11T22:11:16.720829+0000","last_undegraded":"2024-09-11T22:11:16.720829+0000","last_fullsized":"2024-09-11T22:11:16.720829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:17.775314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856326+0000","last_change":"2024-09-11T22:11:13.872102+0000","last_active":"2024-09-11T22:11:15.856326+0000","last_peered":"2024-09-11T22:11:15.856326+0000","last_clean":"2024-09-11T22:11:15.856326+0000","last_became_active":"2024-09-11T22:11:13.871744+0000","last_became_peered":"2024-09-11T22:11:13.871744+0000","last_unstale":"2024-09-11T22:11:15.856326+0000","last_undegraded":"2024-09-11T22:11:15.856326+0000","last_fullsized":"2024-09-11T22:11:15.856326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:16.770079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721304+0000","last_change":"2024-09-11T22:11:14.877095+0000","last_active":"2024-09-11T22:11:16.721304+0000","last_peered":"2024-09-11T22:11:16.721304+0000","last_clean":"2024-09-11T22:11:16.721304+0000","last_became_active":"2024-09-11T22:11:14.876804+0000","last_became_peered":"2024-09-11T22:11:14.876804+0000","last_unstale":"2024-09-11T22:11:16.721304+0000","last_undegraded":"2024-09-11T22:11:16.721304+0000","last_fullsized":"2024-09-11T22:11:16.721304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:02.999213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856278+0000","last_change":"2024-09-11T22:11:13.866539+0000","last_active":"2024-09-11T22:11:15.856278+0000","last_peered":"2024-09-11T22:11:15.856278+0000","last_clean":"2024-09-11T22:11:15.856278+0000","last_became_active":"2024-09-11T22:11:13.866049+0000","last_became_peered":"2024-09-11T22:11:13.866049+0000","last_unstale":"2024-09-11T22:11:15.856278+0000","last_undegraded":"2024-09-11T22:11:15.856278+0000","last_fullsized":"2024-09-11T22:11:15.856278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:37.267640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722128+0000","last_change":"2024-09-11T22:11:14.880391+0000","last_active":"2024-09-11T22:11:16.722128+0000","last_peered":"2024-09-11T22:11:16.722128+0000","last_clean":"2024-09-11T22:11:16.722128+0000","last_became_active":"2024-09-11T22:11:14.880107+0000","last_became_peered":"2024-09-11T22:11:14.880107+0000","last_unstale":"2024-09-11T22:11:16.722128+0000","last_undegraded":"2024-09-11T22:11:16.722128+0000","last_fullsized":"2024-09-11T22:11:16.722128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:58.767744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111012+0000","last_change":"2024-09-11T22:11:13.871354+0000","last_active":"2024-09-11T22:11:16.111012+0000","last_peered":"2024-09-11T22:11:16.111012+0000","last_clean":"2024-09-11T22:11:16.111012+0000","last_became_active":"2024-09-11T22:11:13.871001+0000","last_became_peered":"2024-09-11T22:11:13.871001+0000","last_unstale":"2024-09-11T22:11:16.111012+0000","last_undegraded":"2024-09-11T22:11:16.111012+0000","last_fullsized":"2024-09-11T22:11:16.111012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:51.873061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859743+0000","last_change":"2024-09-11T22:11:14.875629+0000","last_active":"2024-09-11T22:11:15.859743+0000","last_peered":"2024-09-11T22:11:15.859743+0000","last_clean":"2024-09-11T22:11:15.859743+0000","last_became_active":"2024-09-11T22:11:14.875371+0000","last_became_peered":"2024-09-11T22:11:14.875371+0000","last_unstale":"2024-09-11T22:11:15.859743+0000","last_undegraded":"2024-09-11T22:11:15.859743+0000","last_fullsized":"2024-09-11T22:11:15.859743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.370344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860610+0000","last_change":"2024-09-11T22:11:14.867613+0000","last_active":"2024-09-11T22:11:15.860610+0000","last_peered":"2024-09-11T22:11:15.860610+0000","last_clean":"2024-09-11T22:11:15.860610+0000","last_became_active":"2024-09-11T22:11:14.865673+0000","last_became_peered":"2024-09-11T22:11:14.865673+0000","last_unstale":"2024-09-11T22:11:15.860610+0000","last_undegraded":"2024-09-11T22:11:15.860610+0000","last_fullsized":"2024-09-11T22:11:15.860610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:20.925559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110863+0000","last_change":"2024-09-11T22:11:13.874968+0000","last_active":"2024-09-11T22:11:16.110863+0000","last_peered":"2024-09-11T22:11:16.110863+0000","last_clean":"2024-09-11T22:11:16.110863+0000","last_became_active":"2024-09-11T22:11:13.874621+0000","last_became_peered":"2024-09-11T22:11:13.874621+0000","last_unstale":"2024-09-11T22:11:16.110863+0000","last_undegraded":"2024-09-11T22:11:16.110863+0000","last_fullsized":"2024-09-11T22:11:16.110863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:09.164832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860836+0000","last_change":"2024-09-11T22:11:14.868006+0000","last_active":"2024-09-11T22:11:15.860836+0000","last_peered":"2024-09-11T22:11:15.860836+0000","last_clean":"2024-09-11T22:11:15.860836+0000","last_became_active":"2024-09-11T22:11:14.867573+0000","last_became_peered":"2024-09-11T22:11:14.867573+0000","last_unstale":"2024-09-11T22:11:15.860836+0000","last_undegraded":"2024-09-11T22:11:15.860836+0000","last_fullsized":"2024-09-11T22:11:15.860836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:17.480305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110928+0000","last_change":"2024-09-11T22:11:13.873703+0000","last_active":"2024-09-11T22:11:16.110928+0000","last_peered":"2024-09-11T22:11:16.110928+0000","last_clean":"2024-09-11T22:11:16.110928+0000","last_became_active":"2024-09-11T22:11:13.873310+0000","last_became_peered":"2024-09-11T22:11:13.873310+0000","last_unstale":"2024-09-11T22:11:16.110928+0000","last_undegraded":"2024-09-11T22:11:16.110928+0000","last_fullsized":"2024-09-11T22:11:16.110928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:39.514326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722052+0000","last_change":"2024-09-11T22:11:14.873241+0000","last_active":"2024-09-11T22:11:16.722052+0000","last_peered":"2024-09-11T22:11:16.722052+0000","last_clean":"2024-09-11T22:11:16.722052+0000","last_became_active":"2024-09-11T22:11:14.872638+0000","last_became_peered":"2024-09-11T22:11:14.872638+0000","last_unstale":"2024-09-11T22:11:16.722052+0000","last_undegraded":"2024-09-11T22:11:16.722052+0000","last_fullsized":"2024-09-11T22:11:16.722052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:02.999213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722066+0000","last_change":"2024-09-11T22:11:13.869743+0000","last_active":"2024-09-11T22:11:16.722066+0000","last_peered":"2024-09-11T22:11:16.722066+0000","last_clean":"2024-09-11T22:11:16.722066+0000","last_became_active":"2024-09-11T22:11:13.868457+0000","last_became_peered":"2024-09-11T22:11:13.868457+0000","last_unstale":"2024-09-11T22:11:16.722066+0000","last_undegraded":"2024-09-11T22:11:16.722066+0000","last_fullsized":"2024-09-11T22:11:16.722066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:15.850187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721967+0000","last_change":"2024-09-11T22:11:14.870523+0000","last_active":"2024-09-11T22:11:16.721967+0000","last_peered":"2024-09-11T22:11:16.721967+0000","last_clean":"2024-09-11T22:11:16.721967+0000","last_became_active":"2024-09-11T22:11:14.870160+0000","last_became_peered":"2024-09-11T22:11:14.870160+0000","last_unstale":"2024-09-11T22:11:16.721967+0000","last_undegraded":"2024-09-11T22:11:16.721967+0000","last_fullsized":"2024-09-11T22:11:16.721967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:49.232203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722394+0000","last_change":"2024-09-11T22:11:13.866359+0000","last_active":"2024-09-11T22:11:16.722394+0000","last_peered":"2024-09-11T22:11:16.722394+0000","last_clean":"2024-09-11T22:11:16.722394+0000","last_became_active":"2024-09-11T22:11:13.866072+0000","last_became_peered":"2024-09-11T22:11:13.866072+0000","last_unstale":"2024-09-11T22:11:16.722394+0000","last_undegraded":"2024-09-11T22:11:16.722394+0000","last_fullsized":"2024-09-11T22:11:16.722394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":663753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:11:26.629 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:11:26.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.767+0000 7f741348d640 1 Processor -- start 2024-09-11T22:11:26.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.767+0000 7f741348d640 1 -- start start 2024-09-11T22:11:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.768+0000 7f741348d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f740c0d18e0 0x7f740c0d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.768+0000 7f741348d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f740c0d31b0 con 0x7f740c15eb70 2024-09-11T22:11:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.768+0000 7f741348d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f740c0d3490 con 0x7f740c15e790 2024-09-11T22:11:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.768+0000 7f741348d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f740c0d3dc0 con 0x7f740c0d18e0 2024-09-11T22:11:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.768+0000 7f7411a2a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f740c15eb70 0x7f740c0b78f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41312/0 (socket says 172.21.15.50:41312) 2024-09-11T22:11:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.768+0000 7f7411a2a640 1 -- 172.21.15.50:0/4057253204 learned_addr learned my addr 172.21.15.50:0/4057253204 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.768+0000 7f7410a28640 1 --2- 172.21.15.50:0/4057253204 >> v2:172.21.15.77:3300/0 conn(0x7f740c0d18e0 0x7f740c0d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985941162 0 0) 0x7f740c0d31b0 con 0x7f740c15eb70 2024-09-11T22:11:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73f8003520 con 0x7f740c15eb70 2024-09-11T22:11:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1404384086 0 0) 0x7f73f8003520 con 0x7f740c15eb70 2024-09-11T22:11:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 >> v2:172.21.15.77:3300/0 conn(0x7f740c0d18e0 msgr2=0x7f740c0d4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 --2- 172.21.15.50:0/4057253204 >> v2:172.21.15.77:3300/0 conn(0x7f740c0d18e0 0x7f740c0d4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 >> v1:172.21.15.77:6789/0 conn(0x7f740c15e790 legacy=0x7f740c0d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740c0d3770 con 0x7f740c15eb70 2024-09-11T22:11:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f74040019f0 con 0x7f740c15eb70 2024-09-11T22:11:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7410a28640 1 --2- 172.21.15.50:0/4057253204 >> v2:172.21.15.77:3300/0 conn(0x7f740c0d18e0 0x7f740c0d4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 >> v1:172.21.15.50:6789/0 conn(0x7f740c15eb70 legacy=0x7f740c0b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 --2- 172.21.15.50:0/4057253204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f80039b0 0x7f73f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 --2- 172.21.15.50:0/4057253204 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73f8004800 0x7f73f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 --2- 172.21.15.50:0/4057253204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f80051c0 0x7f73f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f740c0d3dc0 con 0x7f73f80051c0 2024-09-11T22:11:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73f800c060 con 0x7f73f80039b0 2024-09-11T22:11:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f73f800c260 con 0x7f73f8004800 2024-09-11T22:11:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7411a2a640 1 --2- 172.21.15.50:0/4057253204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f80051c0 0x7f73f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7411229640 1 --2- 172.21.15.50:0/4057253204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f80039b0 0x7f73f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7410a28640 1 --2- 172.21.15.50:0/4057253204 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73f8004800 0x7f73f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7411a2a640 1 -- 172.21.15.50:0/4057253204 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73f8004800 msgr2=0x7f73f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7411a2a640 1 --2- 172.21.15.50:0/4057253204 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73f8004800 0x7f73f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7411a2a640 1 -- 172.21.15.50:0/4057253204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f80039b0 msgr2=0x7f73f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7411a2a640 1 --2- 172.21.15.50:0/4057253204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f80039b0 0x7f73f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7411a2a640 1 -- 172.21.15.50:0/4057253204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f8003520 con 0x7f73f80051c0 2024-09-11T22:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.769+0000 7f7411229640 1 --2- 172.21.15.50:0/4057253204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73f80039b0 0x7f73f8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.770+0000 7f7411a2a640 1 -- 172.21.15.50:0/4057253204 reap_dead start 2024-09-11T22:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.770+0000 7f7411a2a640 1 --2- 172.21.15.50:0/4057253204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f80051c0 0x7f73f800b9c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f740400a810 tx=0x7f73f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02c900f3a9d19d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.770+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7408001370 con 0x7f73f80051c0 2024-09-11T22:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.770+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740402f070 con 0x7f73f80051c0 2024-09-11T22:11:26.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.770+0000 7f7403fff640 1 -- 172.21.15.50:0/4057253204 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740400a460 con 0x7f73f80051c0 2024-09-11T22:11:26.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.771+0000 7f741348d640 1 -- 172.21.15.50:0/4057253204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f80051c0 msgr2=0x7f73f800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.771+0000 7f741348d640 1 --2- 172.21.15.50:0/4057253204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f80051c0 0x7f73f800b9c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f740400a810 tx=0x7f73f8005830 comp rx=0 tx=0).stop 2024-09-11T22:11:26.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.771+0000 7f741348d640 1 -- 172.21.15.50:0/4057253204 shutdown_connections 2024-09-11T22:11:26.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.771+0000 7f741348d640 1 --2- 172.21.15.50:0/4057253204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f80051c0 0x7f73f800b9c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.771+0000 7f741348d640 1 -- 172.21.15.50:0/4057253204 >> 172.21.15.50:0/4057253204 conn(0x7f740c0727a0 msgr2=0x7f740c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:26.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.771+0000 7f741348d640 1 -- 172.21.15.50:0/4057253204 shutdown_connections 2024-09-11T22:11:26.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.771+0000 7f741348d640 1 -- 172.21.15.50:0/4057253204 wait complete. 2024-09-11T22:11:26.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.772+0000 7f741348d640 1 Processor -- start 2024-09-11T22:11:26.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.772+0000 7f741348d640 1 -- start start 2024-09-11T22:11:26.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f741348d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f80051c0 0x7f740c0cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f741348d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f740c1f57f0 0x7f740c1f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f741348d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f740c0ce6a0 0x7f740c1f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f741348d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f740c0d43d0 con 0x7f73f80051c0 2024-09-11T22:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f741348d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f740c0d4250 con 0x7f740c1f57f0 2024-09-11T22:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f741348d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f740c0d4550 con 0x7f740c0ce6a0 2024-09-11T22:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f7411229640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f80051c0 0x7f740c0cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f7411229640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f80051c0 0x7f740c0cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46752/0 (socket says 172.21.15.50:46752) 2024-09-11T22:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f7411229640 1 -- 172.21.15.50:0/217263170 learned_addr learned my addr 172.21.15.50:0/217263170 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f7410a28640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f740c1f57f0 0x7f740c1f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f7411a2a640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f740c0ce6a0 0x7f740c1f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f7411229640 1 -- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f740c0ce6a0 msgr2=0x7f740c1f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f7411229640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f740c0ce6a0 0x7f740c1f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f7411229640 1 -- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f740c1f57f0 msgr2=0x7f740c1f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f7411229640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f740c1f57f0 0x7f740c1f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f7411229640 1 -- 172.21.15.50:0/217263170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740c152da0 con 0x7f73f80051c0 2024-09-11T22:11:26.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f7411229640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f80051c0 0x7f740c0cd410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f740800f850 tx=0x7f740800fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.773+0000 7f7401ffb640 1 -- 172.21.15.50:0/217263170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7408001ce0 con 0x7f73f80051c0 2024-09-11T22:11:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.774+0000 7f7401ffb640 1 -- 172.21.15.50:0/217263170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7408018070 con 0x7f73f80051c0 2024-09-11T22:11:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.774+0000 7f741348d640 1 -- 172.21.15.50:0/217263170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f740c155140 con 0x7f73f80051c0 2024-09-11T22:11:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.774+0000 7f7401ffb640 1 -- 172.21.15.50:0/217263170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740800d6d0 con 0x7f73f80051c0 2024-09-11T22:11:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.774+0000 7f741348d640 1 -- 172.21.15.50:0/217263170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f740c155700 con 0x7f73f80051c0 2024-09-11T22:11:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.775+0000 7f741348d640 1 -- 172.21.15.50:0/217263170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f740c154f70 con 0x7f73f80051c0 2024-09-11T22:11:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.775+0000 7f7401ffb640 1 -- 172.21.15.50:0/217263170 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f740800d870 con 0x7f73f80051c0 2024-09-11T22:11:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.776+0000 7f7401ffb640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f73f006be60 0x7f73f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.776+0000 7f7401ffb640 1 -- 172.21.15.50:0/217263170 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f740808aa60 con 0x7f73f80051c0 2024-09-11T22:11:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.776+0000 7f7410a28640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f73f006be60 0x7f73f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:26.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.776+0000 7f7410a28640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f73f006be60 0x7f73f006e320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f740c0ca7b0 tx=0x7f73fc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:26.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.780+0000 7f7401ffb640 1 -- 172.21.15.50:0/217263170 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7408058dc0 con 0x7f73f80051c0 2024-09-11T22:11:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.954+0000 7f741348d640 1 -- 172.21.15.50:0/217263170 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f740c153080 con 0x7f73f006be60 2024-09-11T22:11:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.961+0000 7f7401ffb640 1 -- 172.21.15.50:0/217263170 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f740c153080 con 0x7f73f006be60 2024-09-11T22:11:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:26.965 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:11:26.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.964+0000 7f741348d640 1 -- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f73f006be60 msgr2=0x7f73f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.964+0000 7f741348d640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f73f006be60 0x7f73f006e320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f740c0ca7b0 tx=0x7f73fc009190 comp rx=0 tx=0).stop 2024-09-11T22:11:26.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.964+0000 7f741348d640 1 -- 172.21.15.50:0/217263170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f80051c0 msgr2=0x7f740c0cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:26.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.964+0000 7f741348d640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f80051c0 0x7f740c0cd410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f740800f850 tx=0x7f740800fd10 comp rx=0 tx=0).stop 2024-09-11T22:11:26.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.964+0000 7f741348d640 1 -- 172.21.15.50:0/217263170 shutdown_connections 2024-09-11T22:11:26.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.964+0000 7f741348d640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f73f006be60 0x7f73f006e320 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.964+0000 7f741348d640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f740c0ce6a0 0x7f740c1f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.964+0000 7f741348d640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f740c1f57f0 0x7f740c1f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.964+0000 7f741348d640 1 --2- 172.21.15.50:0/217263170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73f80051c0 0x7f740c0cd410 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:26.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.964+0000 7f741348d640 1 -- 172.21.15.50:0/217263170 >> 172.21.15.50:0/217263170 conn(0x7f740c0727a0 msgr2=0x7f740c0ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:26.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.964+0000 7f741348d640 1 -- 172.21.15.50:0/217263170 shutdown_connections 2024-09-11T22:11:26.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:26.964+0000 7f741348d640 1 -- 172.21.15.50:0/217263170 wait complete. 2024-09-11T22:11:26.976 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-11T22:11:25.365872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239900,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734820,"statfs":{"total":773094113280,"available":772848455680,"internally_reserved":0,"allocated":2924544,"data_stored":1767532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002233"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111198+0000","last_change":"2024-09-11T22:11:14.877003+0000","last_active":"2024-09-11T22:11:16.111198+0000","last_peered":"2024-09-11T22:11:16.111198+0000","last_clean":"2024-09-11T22:11:16.111198+0000","last_became_active":"2024-09-11T22:11:14.875875+0000","last_became_peered":"2024-09-11T22:11:14.875875+0000","last_unstale":"2024-09-11T22:11:16.111198+0000","last_undegraded":"2024-09-11T22:11:16.111198+0000","last_fullsized":"2024-09-11T22:11:16.111198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:10.814560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856466+0000","last_change":"2024-09-11T22:11:14.870455+0000","last_active":"2024-09-11T22:11:15.856466+0000","last_peered":"2024-09-11T22:11:15.856466+0000","last_clean":"2024-09-11T22:11:15.856466+0000","last_became_active":"2024-09-11T22:11:14.870099+0000","last_became_peered":"2024-09-11T22:11:14.870099+0000","last_unstale":"2024-09-11T22:11:15.856466+0000","last_undegraded":"2024-09-11T22:11:15.856466+0000","last_fullsized":"2024-09-11T22:11:15.856466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722493+0000","last_change":"2024-09-11T22:11:14.873524+0000","last_active":"2024-09-11T22:11:16.722493+0000","last_peered":"2024-09-11T22:11:16.722493+0000","last_clean":"2024-09-11T22:11:16.722493+0000","last_became_active":"2024-09-11T22:11:14.873148+0000","last_became_peered":"2024-09-11T22:11:14.873148+0000","last_unstale":"2024-09-11T22:11:16.722493+0000","last_undegraded":"2024-09-11T22:11:16.722493+0000","last_fullsized":"2024-09-11T22:11:16.722493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860390+0000","last_change":"2024-09-11T22:11:14.880383+0000","last_active":"2024-09-11T22:11:15.860390+0000","last_peered":"2024-09-11T22:11:15.860390+0000","last_clean":"2024-09-11T22:11:15.860390+0000","last_became_active":"2024-09-11T22:11:14.880104+0000","last_became_peered":"2024-09-11T22:11:14.880104+0000","last_unstale":"2024-09-11T22:11:15.860390+0000","last_undegraded":"2024-09-11T22:11:15.860390+0000","last_fullsized":"2024-09-11T22:11:15.860390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:49.232203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110946+0000","last_change":"2024-09-11T22:11:14.873339+0000","last_active":"2024-09-11T22:11:16.110946+0000","last_peered":"2024-09-11T22:11:16.110946+0000","last_clean":"2024-09-11T22:11:16.110946+0000","last_became_active":"2024-09-11T22:11:14.873054+0000","last_became_peered":"2024-09-11T22:11:14.873054+0000","last_unstale":"2024-09-11T22:11:16.110946+0000","last_undegraded":"2024-09-11T22:11:16.110946+0000","last_fullsized":"2024-09-11T22:11:16.110946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:59.654960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860174+0000","last_change":"2024-09-11T22:11:14.870895+0000","last_active":"2024-09-11T22:11:15.860174+0000","last_peered":"2024-09-11T22:11:15.860174+0000","last_clean":"2024-09-11T22:11:15.860174+0000","last_became_active":"2024-09-11T22:11:14.870514+0000","last_became_peered":"2024-09-11T22:11:14.870514+0000","last_unstale":"2024-09-11T22:11:15.860174+0000","last_undegraded":"2024-09-11T22:11:15.860174+0000","last_fullsized":"2024-09-11T22:11:15.860174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110583+0000","last_change":"2024-09-11T22:11:14.872287+0000","last_active":"2024-09-11T22:11:16.110583+0000","last_peered":"2024-09-11T22:11:16.110583+0000","last_clean":"2024-09-11T22:11:16.110583+0000","last_became_active":"2024-09-11T22:11:14.871977+0000","last_became_peered":"2024-09-11T22:11:14.871977+0000","last_unstale":"2024-09-11T22:11:16.110583+0000","last_undegraded":"2024-09-11T22:11:16.110583+0000","last_fullsized":"2024-09-11T22:11:16.110583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:14.914022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720946+0000","last_change":"2024-09-11T22:11:14.875401+0000","last_active":"2024-09-11T22:11:16.720946+0000","last_peered":"2024-09-11T22:11:16.720946+0000","last_clean":"2024-09-11T22:11:16.720946+0000","last_became_active":"2024-09-11T22:11:14.875082+0000","last_became_peered":"2024-09-11T22:11:14.875082+0000","last_unstale":"2024-09-11T22:11:16.720946+0000","last_undegraded":"2024-09-11T22:11:16.720946+0000","last_fullsized":"2024-09-11T22:11:16.720946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.370344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111194+0000","last_change":"2024-09-11T22:11:14.876721+0000","last_active":"2024-09-11T22:11:16.111194+0000","last_peered":"2024-09-11T22:11:16.111194+0000","last_clean":"2024-09-11T22:11:16.111194+0000","last_became_active":"2024-09-11T22:11:14.875811+0000","last_became_peered":"2024-09-11T22:11:14.875811+0000","last_unstale":"2024-09-11T22:11:16.111194+0000","last_undegraded":"2024-09-11T22:11:16.111194+0000","last_fullsized":"2024-09-11T22:11:16.111194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:54.472996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860289+0000","last_change":"2024-09-11T22:11:14.871993+0000","last_active":"2024-09-11T22:11:15.860289+0000","last_peered":"2024-09-11T22:11:15.860289+0000","last_clean":"2024-09-11T22:11:15.860289+0000","last_became_active":"2024-09-11T22:11:14.871514+0000","last_became_peered":"2024-09-11T22:11:14.871514+0000","last_unstale":"2024-09-11T22:11:15.860289+0000","last_undegraded":"2024-09-11T22:11:15.860289+0000","last_fullsized":"2024-09-11T22:11:15.860289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859950+0000","last_change":"2024-09-11T22:11:14.871449+0000","last_active":"2024-09-11T22:11:15.859950+0000","last_peered":"2024-09-11T22:11:15.859950+0000","last_clean":"2024-09-11T22:11:15.859950+0000","last_became_active":"2024-09-11T22:11:14.871199+0000","last_became_peered":"2024-09-11T22:11:14.871199+0000","last_unstale":"2024-09-11T22:11:15.859950+0000","last_undegraded":"2024-09-11T22:11:15.859950+0000","last_fullsized":"2024-09-11T22:11:15.859950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.504256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721036+0000","last_change":"2024-09-11T22:11:14.873836+0000","last_active":"2024-09-11T22:11:16.721036+0000","last_peered":"2024-09-11T22:11:16.721036+0000","last_clean":"2024-09-11T22:11:16.721036+0000","last_became_active":"2024-09-11T22:11:14.873416+0000","last_became_peered":"2024-09-11T22:11:14.873416+0000","last_unstale":"2024-09-11T22:11:16.721036+0000","last_undegraded":"2024-09-11T22:11:16.721036+0000","last_fullsized":"2024-09-11T22:11:16.721036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:21.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721985+0000","last_change":"2024-09-11T22:11:14.869438+0000","last_active":"2024-09-11T22:11:16.721985+0000","last_peered":"2024-09-11T22:11:16.721985+0000","last_clean":"2024-09-11T22:11:16.721985+0000","last_became_active":"2024-09-11T22:11:14.869123+0000","last_became_peered":"2024-09-11T22:11:14.869123+0000","last_unstale":"2024-09-11T22:11:16.721985+0000","last_undegraded":"2024-09-11T22:11:16.721985+0000","last_fullsized":"2024-09-11T22:11:16.721985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:24.265434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721027+0000","last_change":"2024-09-11T22:11:14.869092+0000","last_active":"2024-09-11T22:11:16.721027+0000","last_peered":"2024-09-11T22:11:16.721027+0000","last_clean":"2024-09-11T22:11:16.721027+0000","last_became_active":"2024-09-11T22:11:14.868753+0000","last_became_peered":"2024-09-11T22:11:14.868753+0000","last_unstale":"2024-09-11T22:11:16.721027+0000","last_undegraded":"2024-09-11T22:11:16.721027+0000","last_fullsized":"2024-09-11T22:11:16.721027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:21.821517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856216+0000","last_change":"2024-09-11T22:11:14.860104+0000","last_active":"2024-09-11T22:11:15.856216+0000","last_peered":"2024-09-11T22:11:15.856216+0000","last_clean":"2024-09-11T22:11:15.856216+0000","last_became_active":"2024-09-11T22:11:14.859804+0000","last_became_peered":"2024-09-11T22:11:14.859804+0000","last_unstale":"2024-09-11T22:11:15.856216+0000","last_undegraded":"2024-09-11T22:11:15.856216+0000","last_fullsized":"2024-09-11T22:11:15.856216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.504256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859806+0000","last_change":"2024-09-11T22:11:14.869261+0000","last_active":"2024-09-11T22:11:15.859806+0000","last_peered":"2024-09-11T22:11:15.859806+0000","last_clean":"2024-09-11T22:11:15.859806+0000","last_became_active":"2024-09-11T22:11:14.868403+0000","last_became_peered":"2024-09-11T22:11:14.868403+0000","last_unstale":"2024-09-11T22:11:15.859806+0000","last_undegraded":"2024-09-11T22:11:15.859806+0000","last_fullsized":"2024-09-11T22:11:15.859806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.861121+0000","last_change":"2024-09-11T22:11:14.873272+0000","last_active":"2024-09-11T22:11:15.861121+0000","last_peered":"2024-09-11T22:11:15.861121+0000","last_clean":"2024-09-11T22:11:15.861121+0000","last_became_active":"2024-09-11T22:11:14.873003+0000","last_became_peered":"2024-09-11T22:11:14.873003+0000","last_unstale":"2024-09-11T22:11:15.861121+0000","last_undegraded":"2024-09-11T22:11:15.861121+0000","last_fullsized":"2024-09-11T22:11:15.861121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.623451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720994+0000","last_change":"2024-09-11T22:11:14.869711+0000","last_active":"2024-09-11T22:11:16.720994+0000","last_peered":"2024-09-11T22:11:16.720994+0000","last_clean":"2024-09-11T22:11:16.720994+0000","last_became_active":"2024-09-11T22:11:14.869409+0000","last_became_peered":"2024-09-11T22:11:14.869409+0000","last_unstale":"2024-09-11T22:11:16.720994+0000","last_undegraded":"2024-09-11T22:11:16.720994+0000","last_fullsized":"2024-09-11T22:11:16.720994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:52.878296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111027+0000","last_change":"2024-09-11T22:11:14.879040+0000","last_active":"2024-09-11T22:11:16.111027+0000","last_peered":"2024-09-11T22:11:16.111027+0000","last_clean":"2024-09-11T22:11:16.111027+0000","last_became_active":"2024-09-11T22:11:14.877938+0000","last_became_peered":"2024-09-11T22:11:14.877938+0000","last_unstale":"2024-09-11T22:11:16.111027+0000","last_undegraded":"2024-09-11T22:11:16.111027+0000","last_fullsized":"2024-09-11T22:11:16.111027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:07.443098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860231+0000","last_change":"2024-09-11T22:11:14.874997+0000","last_active":"2024-09-11T22:11:15.860231+0000","last_peered":"2024-09-11T22:11:15.860231+0000","last_clean":"2024-09-11T22:11:15.860231+0000","last_became_active":"2024-09-11T22:11:14.874597+0000","last_became_peered":"2024-09-11T22:11:14.874597+0000","last_unstale":"2024-09-11T22:11:15.860231+0000","last_undegraded":"2024-09-11T22:11:15.860231+0000","last_fullsized":"2024-09-11T22:11:15.860231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:02.999213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721437+0000","last_change":"2024-09-11T22:11:14.879236+0000","last_active":"2024-09-11T22:11:16.721437+0000","last_peered":"2024-09-11T22:11:16.721437+0000","last_clean":"2024-09-11T22:11:16.721437+0000","last_became_active":"2024-09-11T22:11:14.878980+0000","last_became_peered":"2024-09-11T22:11:14.878980+0000","last_unstale":"2024-09-11T22:11:16.721437+0000","last_undegraded":"2024-09-11T22:11:16.721437+0000","last_fullsized":"2024-09-11T22:11:16.721437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:23.884038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860346+0000","last_change":"2024-09-11T22:11:14.874326+0000","last_active":"2024-09-11T22:11:15.860346+0000","last_peered":"2024-09-11T22:11:15.860346+0000","last_clean":"2024-09-11T22:11:15.860346+0000","last_became_active":"2024-09-11T22:11:14.873996+0000","last_became_peered":"2024-09-11T22:11:14.873996+0000","last_unstale":"2024-09-11T22:11:15.860346+0000","last_undegraded":"2024-09-11T22:11:15.860346+0000","last_fullsized":"2024-09-11T22:11:15.860346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:41.100253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721611+0000","last_change":"2024-09-11T22:11:14.876744+0000","last_active":"2024-09-11T22:11:16.721611+0000","last_peered":"2024-09-11T22:11:16.721611+0000","last_clean":"2024-09-11T22:11:16.721611+0000","last_became_active":"2024-09-11T22:11:14.875632+0000","last_became_peered":"2024-09-11T22:11:14.875632+0000","last_unstale":"2024-09-11T22:11:16.721611+0000","last_undegraded":"2024-09-11T22:11:16.721611+0000","last_fullsized":"2024-09-11T22:11:16.721611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:41.100253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860407+0000","last_change":"2024-09-11T22:11:14.869931+0000","last_active":"2024-09-11T22:11:15.860407+0000","last_peered":"2024-09-11T22:11:15.860407+0000","last_clean":"2024-09-11T22:11:15.860407+0000","last_became_active":"2024-09-11T22:11:14.869668+0000","last_became_peered":"2024-09-11T22:11:14.869668+0000","last_unstale":"2024-09-11T22:11:15.860407+0000","last_undegraded":"2024-09-11T22:11:15.860407+0000","last_fullsized":"2024-09-11T22:11:15.860407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:24.265434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720826+0000","last_change":"2024-09-11T22:11:14.877381+0000","last_active":"2024-09-11T22:11:16.720826+0000","last_peered":"2024-09-11T22:11:16.720826+0000","last_clean":"2024-09-11T22:11:16.720826+0000","last_became_active":"2024-09-11T22:11:14.876638+0000","last_became_peered":"2024-09-11T22:11:14.876638+0000","last_unstale":"2024-09-11T22:11:16.720826+0000","last_undegraded":"2024-09-11T22:11:16.720826+0000","last_fullsized":"2024-09-11T22:11:16.720826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:23.884038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860422+0000","last_change":"2024-09-11T22:11:14.873836+0000","last_active":"2024-09-11T22:11:15.860422+0000","last_peered":"2024-09-11T22:11:15.860422+0000","last_clean":"2024-09-11T22:11:15.860422+0000","last_became_active":"2024-09-11T22:11:14.873277+0000","last_became_peered":"2024-09-11T22:11:14.873277+0000","last_unstale":"2024-09-11T22:11:15.860422+0000","last_undegraded":"2024-09-11T22:11:15.860422+0000","last_fullsized":"2024-09-11T22:11:15.860422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856398+0000","last_change":"2024-09-11T22:11:14.872571+0000","last_active":"2024-09-11T22:11:15.856398+0000","last_peered":"2024-09-11T22:11:15.856398+0000","last_clean":"2024-09-11T22:11:15.856398+0000","last_became_active":"2024-09-11T22:11:14.872286+0000","last_became_peered":"2024-09-11T22:11:14.872286+0000","last_unstale":"2024-09-11T22:11:15.856398+0000","last_undegraded":"2024-09-11T22:11:15.856398+0000","last_fullsized":"2024-09-11T22:11:15.856398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:02.999213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721392+0000","last_change":"2024-09-11T22:11:14.875536+0000","last_active":"2024-09-11T22:11:16.721392+0000","last_peered":"2024-09-11T22:11:16.721392+0000","last_clean":"2024-09-11T22:11:16.721392+0000","last_became_active":"2024-09-11T22:11:14.875253+0000","last_became_peered":"2024-09-11T22:11:14.875253+0000","last_unstale":"2024-09-11T22:11:16.721392+0000","last_undegraded":"2024-09-11T22:11:16.721392+0000","last_fullsized":"2024-09-11T22:11:16.721392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721577+0000","last_change":"2024-09-11T22:11:14.876898+0000","last_active":"2024-09-11T22:11:16.721577+0000","last_peered":"2024-09-11T22:11:16.721577+0000","last_clean":"2024-09-11T22:11:16.721577+0000","last_became_active":"2024-09-11T22:11:14.876337+0000","last_became_peered":"2024-09-11T22:11:14.876337+0000","last_unstale":"2024-09-11T22:11:16.721577+0000","last_undegraded":"2024-09-11T22:11:16.721577+0000","last_fullsized":"2024-09-11T22:11:16.721577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.370344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860606+0000","last_change":"2024-09-11T22:11:14.880080+0000","last_active":"2024-09-11T22:11:15.860606+0000","last_peered":"2024-09-11T22:11:15.860606+0000","last_clean":"2024-09-11T22:11:15.860606+0000","last_became_active":"2024-09-11T22:11:14.879830+0000","last_became_peered":"2024-09-11T22:11:14.879830+0000","last_unstale":"2024-09-11T22:11:15.860606+0000","last_undegraded":"2024-09-11T22:11:15.860606+0000","last_fullsized":"2024-09-11T22:11:15.860606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:58.767744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720886+0000","last_change":"2024-09-11T22:11:14.872267+0000","last_active":"2024-09-11T22:11:16.720886+0000","last_peered":"2024-09-11T22:11:16.720886+0000","last_clean":"2024-09-11T22:11:16.720886+0000","last_became_active":"2024-09-11T22:11:14.871979+0000","last_became_peered":"2024-09-11T22:11:14.871979+0000","last_unstale":"2024-09-11T22:11:16.720886+0000","last_undegraded":"2024-09-11T22:11:16.720886+0000","last_fullsized":"2024-09-11T22:11:16.720886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:10.170067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859741+0000","last_change":"2024-09-11T22:11:14.876761+0000","last_active":"2024-09-11T22:11:15.859741+0000","last_peered":"2024-09-11T22:11:15.859741+0000","last_clean":"2024-09-11T22:11:15.859741+0000","last_became_active":"2024-09-11T22:11:14.876471+0000","last_became_peered":"2024-09-11T22:11:14.876471+0000","last_unstale":"2024-09-11T22:11:15.859741+0000","last_undegraded":"2024-09-11T22:11:15.859741+0000","last_fullsized":"2024-09-11T22:11:15.859741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:23.884038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720774+0000","last_change":"2024-09-11T22:11:14.860824+0000","last_active":"2024-09-11T22:11:16.720774+0000","last_peered":"2024-09-11T22:11:16.720774+0000","last_clean":"2024-09-11T22:11:16.720774+0000","last_became_active":"2024-09-11T22:11:14.860544+0000","last_became_peered":"2024-09-11T22:11:14.860544+0000","last_unstale":"2024-09-11T22:11:16.720774+0000","last_undegraded":"2024-09-11T22:11:16.720774+0000","last_fullsized":"2024-09-11T22:11:16.720774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:54.339754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722220+0000","last_change":"2024-09-11T22:11:13.870101+0000","last_active":"2024-09-11T22:11:16.722220+0000","last_peered":"2024-09-11T22:11:16.722220+0000","last_clean":"2024-09-11T22:11:16.722220+0000","last_became_active":"2024-09-11T22:11:13.869798+0000","last_became_peered":"2024-09-11T22:11:13.869798+0000","last_unstale":"2024-09-11T22:11:16.722220+0000","last_undegraded":"2024-09-11T22:11:16.722220+0000","last_fullsized":"2024-09-11T22:11:16.722220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:02.455733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721719+0000","last_change":"2024-09-11T22:11:14.874507+0000","last_active":"2024-09-11T22:11:16.721719+0000","last_peered":"2024-09-11T22:11:16.721719+0000","last_clean":"2024-09-11T22:11:16.721719+0000","last_became_active":"2024-09-11T22:11:14.874159+0000","last_became_peered":"2024-09-11T22:11:14.874159+0000","last_unstale":"2024-09-11T22:11:16.721719+0000","last_undegraded":"2024-09-11T22:11:16.721719+0000","last_fullsized":"2024-09-11T22:11:16.721719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.504256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859877+0000","last_change":"2024-09-11T22:11:13.871132+0000","last_active":"2024-09-11T22:11:15.859877+0000","last_peered":"2024-09-11T22:11:15.859877+0000","last_clean":"2024-09-11T22:11:15.859877+0000","last_became_active":"2024-09-11T22:11:13.870831+0000","last_became_peered":"2024-09-11T22:11:13.870831+0000","last_unstale":"2024-09-11T22:11:15.859877+0000","last_undegraded":"2024-09-11T22:11:15.859877+0000","last_fullsized":"2024-09-11T22:11:15.859877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:16.770079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721708+0000","last_change":"2024-09-11T22:11:13.871011+0000","last_active":"2024-09-11T22:11:16.721708+0000","last_peered":"2024-09-11T22:11:16.721708+0000","last_clean":"2024-09-11T22:11:16.721708+0000","last_became_active":"2024-09-11T22:11:13.870723+0000","last_became_peered":"2024-09-11T22:11:13.870723+0000","last_unstale":"2024-09-11T22:11:16.721708+0000","last_undegraded":"2024-09-11T22:11:16.721708+0000","last_fullsized":"2024-09-11T22:11:16.721708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721121+0000","last_change":"2024-09-11T22:11:14.881540+0000","last_active":"2024-09-11T22:11:16.721121+0000","last_peered":"2024-09-11T22:11:16.721121+0000","last_clean":"2024-09-11T22:11:16.721121+0000","last_became_active":"2024-09-11T22:11:14.881249+0000","last_became_peered":"2024-09-11T22:11:14.881249+0000","last_unstale":"2024-09-11T22:11:16.721121+0000","last_undegraded":"2024-09-11T22:11:16.721121+0000","last_fullsized":"2024-09-11T22:11:16.721121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860180+0000","last_change":"2024-09-11T22:11:13.867235+0000","last_active":"2024-09-11T22:11:15.860180+0000","last_peered":"2024-09-11T22:11:15.860180+0000","last_clean":"2024-09-11T22:11:15.860180+0000","last_became_active":"2024-09-11T22:11:13.866963+0000","last_became_peered":"2024-09-11T22:11:13.866963+0000","last_unstale":"2024-09-11T22:11:15.860180+0000","last_undegraded":"2024-09-11T22:11:15.860180+0000","last_fullsized":"2024-09-11T22:11:15.860180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:53.334520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856208+0000","last_change":"2024-09-11T22:11:14.873284+0000","last_active":"2024-09-11T22:11:15.856208+0000","last_peered":"2024-09-11T22:11:15.856208+0000","last_clean":"2024-09-11T22:11:15.856208+0000","last_became_active":"2024-09-11T22:11:14.873030+0000","last_became_peered":"2024-09-11T22:11:14.873030+0000","last_unstale":"2024-09-11T22:11:15.856208+0000","last_undegraded":"2024-09-11T22:11:15.856208+0000","last_fullsized":"2024-09-11T22:11:15.856208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.370344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859886+0000","last_change":"2024-09-11T22:11:13.874393+0000","last_active":"2024-09-11T22:11:15.859886+0000","last_peered":"2024-09-11T22:11:15.859886+0000","last_clean":"2024-09-11T22:11:15.859886+0000","last_became_active":"2024-09-11T22:11:13.874074+0000","last_became_peered":"2024-09-11T22:11:13.874074+0000","last_unstale":"2024-09-11T22:11:15.859886+0000","last_undegraded":"2024-09-11T22:11:15.859886+0000","last_fullsized":"2024-09-11T22:11:15.859886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:37.267640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860641+0000","last_change":"2024-09-11T22:11:14.872584+0000","last_active":"2024-09-11T22:11:15.860641+0000","last_peered":"2024-09-11T22:11:15.860641+0000","last_clean":"2024-09-11T22:11:15.860641+0000","last_became_active":"2024-09-11T22:11:14.872284+0000","last_became_peered":"2024-09-11T22:11:14.872284+0000","last_unstale":"2024-09-11T22:11:15.860641+0000","last_undegraded":"2024-09-11T22:11:15.860641+0000","last_fullsized":"2024-09-11T22:11:15.860641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:04.047452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860682+0000","last_change":"2024-09-11T22:11:13.870015+0000","last_active":"2024-09-11T22:11:15.860682+0000","last_peered":"2024-09-11T22:11:15.860682+0000","last_clean":"2024-09-11T22:11:15.860682+0000","last_became_active":"2024-09-11T22:11:13.869685+0000","last_became_peered":"2024-09-11T22:11:13.869685+0000","last_unstale":"2024-09-11T22:11:15.860682+0000","last_undegraded":"2024-09-11T22:11:15.860682+0000","last_fullsized":"2024-09-11T22:11:15.860682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:37.267640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722219+0000","last_change":"2024-09-11T22:11:14.873692+0000","last_active":"2024-09-11T22:11:16.722219+0000","last_peered":"2024-09-11T22:11:16.722219+0000","last_clean":"2024-09-11T22:11:16.722219+0000","last_became_active":"2024-09-11T22:11:14.873206+0000","last_became_peered":"2024-09-11T22:11:14.873206+0000","last_unstale":"2024-09-11T22:11:16.722219+0000","last_undegraded":"2024-09-11T22:11:16.722219+0000","last_fullsized":"2024-09-11T22:11:16.722219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856400+0000","last_change":"2024-09-11T22:11:13.870967+0000","last_active":"2024-09-11T22:11:15.856400+0000","last_peered":"2024-09-11T22:11:15.856400+0000","last_clean":"2024-09-11T22:11:15.856400+0000","last_became_active":"2024-09-11T22:11:13.870687+0000","last_became_peered":"2024-09-11T22:11:13.870687+0000","last_unstale":"2024-09-11T22:11:15.856400+0000","last_undegraded":"2024-09-11T22:11:15.856400+0000","last_fullsized":"2024-09-11T22:11:15.856400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:20.377207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721034+0000","last_change":"2024-09-11T22:11:14.877068+0000","last_active":"2024-09-11T22:11:16.721034+0000","last_peered":"2024-09-11T22:11:16.721034+0000","last_clean":"2024-09-11T22:11:16.721034+0000","last_became_active":"2024-09-11T22:11:14.876709+0000","last_became_peered":"2024-09-11T22:11:14.876709+0000","last_unstale":"2024-09-11T22:11:16.721034+0000","last_undegraded":"2024-09-11T22:11:16.721034+0000","last_fullsized":"2024-09-11T22:11:16.721034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:51:40.769228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860328+0000","last_change":"2024-09-11T22:11:13.873578+0000","last_active":"2024-09-11T22:11:15.860328+0000","last_peered":"2024-09-11T22:11:15.860328+0000","last_clean":"2024-09-11T22:11:15.860328+0000","last_became_active":"2024-09-11T22:11:13.873273+0000","last_became_peered":"2024-09-11T22:11:13.873273+0000","last_unstale":"2024-09-11T22:11:15.860328+0000","last_undegraded":"2024-09-11T22:11:15.860328+0000","last_fullsized":"2024-09-11T22:11:15.860328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.543280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110782+0000","last_change":"2024-09-11T22:11:14.879023+0000","last_active":"2024-09-11T22:11:16.110782+0000","last_peered":"2024-09-11T22:11:16.110782+0000","last_clean":"2024-09-11T22:11:16.110782+0000","last_became_active":"2024-09-11T22:11:14.876039+0000","last_became_peered":"2024-09-11T22:11:14.876039+0000","last_unstale":"2024-09-11T22:11:16.110782+0000","last_undegraded":"2024-09-11T22:11:16.110782+0000","last_fullsized":"2024-09-11T22:11:16.110782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:38.090077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721813+0000","last_change":"2024-09-11T22:11:13.863099+0000","last_active":"2024-09-11T22:11:16.721813+0000","last_peered":"2024-09-11T22:11:16.721813+0000","last_clean":"2024-09-11T22:11:16.721813+0000","last_became_active":"2024-09-11T22:11:13.862812+0000","last_became_peered":"2024-09-11T22:11:13.862812+0000","last_unstale":"2024-09-11T22:11:16.721813+0000","last_undegraded":"2024-09-11T22:11:16.721813+0000","last_fullsized":"2024-09-11T22:11:16.721813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:59.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721180+0000","last_change":"2024-09-11T22:11:14.878517+0000","last_active":"2024-09-11T22:11:16.721180+0000","last_peered":"2024-09-11T22:11:16.721180+0000","last_clean":"2024-09-11T22:11:16.721180+0000","last_became_active":"2024-09-11T22:11:14.878209+0000","last_became_peered":"2024-09-11T22:11:14.878209+0000","last_unstale":"2024-09-11T22:11:16.721180+0000","last_undegraded":"2024-09-11T22:11:16.721180+0000","last_fullsized":"2024-09-11T22:11:16.721180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:34.949017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860892+0000","last_change":"2024-09-11T22:11:13.866150+0000","last_active":"2024-09-11T22:11:15.860892+0000","last_peered":"2024-09-11T22:11:15.860892+0000","last_clean":"2024-09-11T22:11:15.860892+0000","last_became_active":"2024-09-11T22:11:13.865864+0000","last_became_peered":"2024-09-11T22:11:13.865864+0000","last_unstale":"2024-09-11T22:11:15.860892+0000","last_undegraded":"2024-09-11T22:11:15.860892+0000","last_fullsized":"2024-09-11T22:11:15.860892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:16.770079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110900+0000","last_change":"2024-09-11T22:11:14.874944+0000","last_active":"2024-09-11T22:11:16.110900+0000","last_peered":"2024-09-11T22:11:16.110900+0000","last_clean":"2024-09-11T22:11:16.110900+0000","last_became_active":"2024-09-11T22:11:14.874659+0000","last_became_peered":"2024-09-11T22:11:14.874659+0000","last_unstale":"2024-09-11T22:11:16.110900+0000","last_undegraded":"2024-09-11T22:11:16.110900+0000","last_fullsized":"2024-09-11T22:11:16.110900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:32.470561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859729+0000","last_change":"2024-09-11T22:11:13.873542+0000","last_active":"2024-09-11T22:11:15.859729+0000","last_peered":"2024-09-11T22:11:15.859729+0000","last_clean":"2024-09-11T22:11:15.859729+0000","last_became_active":"2024-09-11T22:11:13.873248+0000","last_became_peered":"2024-09-11T22:11:13.873248+0000","last_unstale":"2024-09-11T22:11:15.859729+0000","last_undegraded":"2024-09-11T22:11:15.859729+0000","last_fullsized":"2024-09-11T22:11:15.859729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:45.183251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860222+0000","last_change":"2024-09-11T22:11:14.869832+0000","last_active":"2024-09-11T22:11:15.860222+0000","last_peered":"2024-09-11T22:11:15.860222+0000","last_clean":"2024-09-11T22:11:15.860222+0000","last_became_active":"2024-09-11T22:11:14.869351+0000","last_became_peered":"2024-09-11T22:11:14.869351+0000","last_unstale":"2024-09-11T22:11:15.860222+0000","last_undegraded":"2024-09-11T22:11:15.860222+0000","last_fullsized":"2024-09-11T22:11:15.860222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720569+0000","last_change":"2024-09-11T22:11:13.870778+0000","last_active":"2024-09-11T22:11:16.720569+0000","last_peered":"2024-09-11T22:11:16.720569+0000","last_clean":"2024-09-11T22:11:16.720569+0000","last_became_active":"2024-09-11T22:11:13.870346+0000","last_became_peered":"2024-09-11T22:11:13.870346+0000","last_unstale":"2024-09-11T22:11:16.720569+0000","last_undegraded":"2024-09-11T22:11:16.720569+0000","last_fullsized":"2024-09-11T22:11:16.720569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:43.931796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110657+0000","last_change":"2024-09-11T22:11:14.880819+0000","last_active":"2024-09-11T22:11:16.110657+0000","last_peered":"2024-09-11T22:11:16.110657+0000","last_clean":"2024-09-11T22:11:16.110657+0000","last_became_active":"2024-09-11T22:11:14.880536+0000","last_became_peered":"2024-09-11T22:11:14.880536+0000","last_unstale":"2024-09-11T22:11:16.110657+0000","last_undegraded":"2024-09-11T22:11:16.110657+0000","last_fullsized":"2024-09-11T22:11:16.110657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:02.658218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720999+0000","last_change":"2024-09-11T22:11:13.864325+0000","last_active":"2024-09-11T22:11:16.720999+0000","last_peered":"2024-09-11T22:11:16.720999+0000","last_clean":"2024-09-11T22:11:16.720999+0000","last_became_active":"2024-09-11T22:11:13.862906+0000","last_became_peered":"2024-09-11T22:11:13.862906+0000","last_unstale":"2024-09-11T22:11:16.720999+0000","last_undegraded":"2024-09-11T22:11:16.720999+0000","last_fullsized":"2024-09-11T22:11:16.720999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111015+0000","last_change":"2024-09-11T22:11:14.874987+0000","last_active":"2024-09-11T22:11:16.111015+0000","last_peered":"2024-09-11T22:11:16.111015+0000","last_clean":"2024-09-11T22:11:16.111015+0000","last_became_active":"2024-09-11T22:11:14.874705+0000","last_became_peered":"2024-09-11T22:11:14.874705+0000","last_unstale":"2024-09-11T22:11:16.111015+0000","last_undegraded":"2024-09-11T22:11:16.111015+0000","last_fullsized":"2024-09-11T22:11:16.111015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:23.382930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721113+0000","last_change":"2024-09-11T22:11:13.865829+0000","last_active":"2024-09-11T22:11:16.721113+0000","last_peered":"2024-09-11T22:11:16.721113+0000","last_clean":"2024-09-11T22:11:16.721113+0000","last_became_active":"2024-09-11T22:11:13.865535+0000","last_became_peered":"2024-09-11T22:11:13.865535+0000","last_unstale":"2024-09-11T22:11:16.721113+0000","last_undegraded":"2024-09-11T22:11:16.721113+0000","last_fullsized":"2024-09-11T22:11:16.721113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:47.814287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111285+0000","last_change":"2024-09-11T22:11:14.878706+0000","last_active":"2024-09-11T22:11:16.111285+0000","last_peered":"2024-09-11T22:11:16.111285+0000","last_clean":"2024-09-11T22:11:16.111285+0000","last_became_active":"2024-09-11T22:11:14.876102+0000","last_became_peered":"2024-09-11T22:11:14.876102+0000","last_unstale":"2024-09-11T22:11:16.111285+0000","last_undegraded":"2024-09-11T22:11:16.111285+0000","last_fullsized":"2024-09-11T22:11:16.111285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:15.113361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856490+0000","last_change":"2024-09-11T22:11:13.873640+0000","last_active":"2024-09-11T22:11:15.856490+0000","last_peered":"2024-09-11T22:11:15.856490+0000","last_clean":"2024-09-11T22:11:15.856490+0000","last_became_active":"2024-09-11T22:11:13.873311+0000","last_became_peered":"2024-09-11T22:11:13.873311+0000","last_unstale":"2024-09-11T22:11:15.856490+0000","last_undegraded":"2024-09-11T22:11:15.856490+0000","last_fullsized":"2024-09-11T22:11:15.856490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:51:39.763993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860808+0000","last_change":"2024-09-11T22:11:14.868944+0000","last_active":"2024-09-11T22:11:15.860808+0000","last_peered":"2024-09-11T22:11:15.860808+0000","last_clean":"2024-09-11T22:11:15.860808+0000","last_became_active":"2024-09-11T22:11:14.868668+0000","last_became_peered":"2024-09-11T22:11:14.868668+0000","last_unstale":"2024-09-11T22:11:15.860808+0000","last_undegraded":"2024-09-11T22:11:15.860808+0000","last_fullsized":"2024-09-11T22:11:15.860808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:05:25.843711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720774+0000","last_change":"2024-09-11T22:11:13.870777+0000","last_active":"2024-09-11T22:11:16.720774+0000","last_peered":"2024-09-11T22:11:16.720774+0000","last_clean":"2024-09-11T22:11:16.720774+0000","last_became_active":"2024-09-11T22:11:13.869718+0000","last_became_peered":"2024-09-11T22:11:13.869718+0000","last_unstale":"2024-09-11T22:11:16.720774+0000","last_undegraded":"2024-09-11T22:11:16.720774+0000","last_fullsized":"2024-09-11T22:11:16.720774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:24.001331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110830+0000","last_change":"2024-09-11T22:11:14.878531+0000","last_active":"2024-09-11T22:11:16.110830+0000","last_peered":"2024-09-11T22:11:16.110830+0000","last_clean":"2024-09-11T22:11:16.110830+0000","last_became_active":"2024-09-11T22:11:14.875925+0000","last_became_peered":"2024-09-11T22:11:14.875925+0000","last_unstale":"2024-09-11T22:11:16.110830+0000","last_undegraded":"2024-09-11T22:11:16.110830+0000","last_fullsized":"2024-09-11T22:11:16.110830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:03.171917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110562+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:11:16.110562+0000","last_peered":"2024-09-11T22:11:16.110562+0000","last_clean":"2024-09-11T22:11:16.110562+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:11:16.110562+0000","last_undegraded":"2024-09-11T22:11:16.110562+0000","last_fullsized":"2024-09-11T22:11:16.110562+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860054+0000","last_change":"2024-09-11T22:11:13.863848+0000","last_active":"2024-09-11T22:11:15.860054+0000","last_peered":"2024-09-11T22:11:15.860054+0000","last_clean":"2024-09-11T22:11:15.860054+0000","last_became_active":"2024-09-11T22:11:13.863555+0000","last_became_peered":"2024-09-11T22:11:13.863555+0000","last_unstale":"2024-09-11T22:11:15.860054+0000","last_undegraded":"2024-09-11T22:11:15.860054+0000","last_fullsized":"2024-09-11T22:11:15.860054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:45.183251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721078+0000","last_change":"2024-09-11T22:11:14.876698+0000","last_active":"2024-09-11T22:11:16.721078+0000","last_peered":"2024-09-11T22:11:16.721078+0000","last_clean":"2024-09-11T22:11:16.721078+0000","last_became_active":"2024-09-11T22:11:14.875680+0000","last_became_peered":"2024-09-11T22:11:14.875680+0000","last_unstale":"2024-09-11T22:11:16.721078+0000","last_undegraded":"2024-09-11T22:11:16.721078+0000","last_fullsized":"2024-09-11T22:11:16.721078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.504256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110456+0000","last_change":"2024-09-11T22:11:13.871233+0000","last_active":"2024-09-11T22:11:16.110456+0000","last_peered":"2024-09-11T22:11:16.110456+0000","last_clean":"2024-09-11T22:11:16.110456+0000","last_became_active":"2024-09-11T22:11:13.870954+0000","last_became_peered":"2024-09-11T22:11:13.870954+0000","last_unstale":"2024-09-11T22:11:16.110456+0000","last_undegraded":"2024-09-11T22:11:16.110456+0000","last_fullsized":"2024-09-11T22:11:16.110456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:12.996024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721857+0000","last_change":"2024-09-11T22:11:14.875279+0000","last_active":"2024-09-11T22:11:16.721857+0000","last_peered":"2024-09-11T22:11:16.721857+0000","last_clean":"2024-09-11T22:11:16.721857+0000","last_became_active":"2024-09-11T22:11:14.874757+0000","last_became_peered":"2024-09-11T22:11:14.874757+0000","last_unstale":"2024-09-11T22:11:16.721857+0000","last_undegraded":"2024-09-11T22:11:16.721857+0000","last_fullsized":"2024-09-11T22:11:16.721857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721567+0000","last_change":"2024-09-11T22:11:13.865189+0000","last_active":"2024-09-11T22:11:16.721567+0000","last_peered":"2024-09-11T22:11:16.721567+0000","last_clean":"2024-09-11T22:11:16.721567+0000","last_became_active":"2024-09-11T22:11:13.864912+0000","last_became_peered":"2024-09-11T22:11:13.864912+0000","last_unstale":"2024-09-11T22:11:16.721567+0000","last_undegraded":"2024-09-11T22:11:16.721567+0000","last_fullsized":"2024-09-11T22:11:16.721567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:20.511994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856228+0000","last_change":"2024-09-11T22:11:14.867477+0000","last_active":"2024-09-11T22:11:15.856228+0000","last_peered":"2024-09-11T22:11:15.856228+0000","last_clean":"2024-09-11T22:11:15.856228+0000","last_became_active":"2024-09-11T22:11:14.867198+0000","last_became_peered":"2024-09-11T22:11:14.867198+0000","last_unstale":"2024-09-11T22:11:15.856228+0000","last_undegraded":"2024-09-11T22:11:15.856228+0000","last_fullsized":"2024-09-11T22:11:15.856228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.509094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860938+0000","last_change":"2024-09-11T22:11:13.867676+0000","last_active":"2024-09-11T22:11:15.860938+0000","last_peered":"2024-09-11T22:11:15.860938+0000","last_clean":"2024-09-11T22:11:15.860938+0000","last_became_active":"2024-09-11T22:11:13.867391+0000","last_became_peered":"2024-09-11T22:11:13.867391+0000","last_unstale":"2024-09-11T22:11:15.860938+0000","last_undegraded":"2024-09-11T22:11:15.860938+0000","last_fullsized":"2024-09-11T22:11:15.860938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.543280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720999+0000","last_change":"2024-09-11T22:11:14.872333+0000","last_active":"2024-09-11T22:11:16.720999+0000","last_peered":"2024-09-11T22:11:16.720999+0000","last_clean":"2024-09-11T22:11:16.720999+0000","last_became_active":"2024-09-11T22:11:14.872066+0000","last_became_peered":"2024-09-11T22:11:14.872066+0000","last_unstale":"2024-09-11T22:11:16.720999+0000","last_undegraded":"2024-09-11T22:11:16.720999+0000","last_fullsized":"2024-09-11T22:11:16.720999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:06.548515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856337+0000","last_change":"2024-09-11T22:11:13.868171+0000","last_active":"2024-09-11T22:11:15.856337+0000","last_peered":"2024-09-11T22:11:15.856337+0000","last_clean":"2024-09-11T22:11:15.856337+0000","last_became_active":"2024-09-11T22:11:13.867826+0000","last_became_peered":"2024-09-11T22:11:13.867826+0000","last_unstale":"2024-09-11T22:11:15.856337+0000","last_undegraded":"2024-09-11T22:11:15.856337+0000","last_fullsized":"2024-09-11T22:11:15.856337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:53.334520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860761+0000","last_change":"2024-09-11T22:11:14.880771+0000","last_active":"2024-09-11T22:11:15.860761+0000","last_peered":"2024-09-11T22:11:15.860761+0000","last_clean":"2024-09-11T22:11:15.860761+0000","last_became_active":"2024-09-11T22:11:14.879966+0000","last_became_peered":"2024-09-11T22:11:14.879966+0000","last_unstale":"2024-09-11T22:11:15.860761+0000","last_undegraded":"2024-09-11T22:11:15.860761+0000","last_fullsized":"2024-09-11T22:11:15.860761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:39.616151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111068+0000","last_change":"2024-09-11T22:11:13.871639+0000","last_active":"2024-09-11T22:11:16.111068+0000","last_peered":"2024-09-11T22:11:16.111068+0000","last_clean":"2024-09-11T22:11:16.111068+0000","last_became_active":"2024-09-11T22:11:13.870825+0000","last_became_peered":"2024-09-11T22:11:13.870825+0000","last_unstale":"2024-09-11T22:11:16.111068+0000","last_undegraded":"2024-09-11T22:11:16.111068+0000","last_fullsized":"2024-09-11T22:11:16.111068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:04.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856421+0000","last_change":"2024-09-11T22:11:14.866676+0000","last_active":"2024-09-11T22:11:15.856421+0000","last_peered":"2024-09-11T22:11:15.856421+0000","last_clean":"2024-09-11T22:11:15.856421+0000","last_became_active":"2024-09-11T22:11:14.866402+0000","last_became_peered":"2024-09-11T22:11:14.866402+0000","last_unstale":"2024-09-11T22:11:15.856421+0000","last_undegraded":"2024-09-11T22:11:15.856421+0000","last_fullsized":"2024-09-11T22:11:15.856421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.506512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856557+0000","last_change":"2024-09-11T22:11:13.872366+0000","last_active":"2024-09-11T22:11:15.856557+0000","last_peered":"2024-09-11T22:11:15.856557+0000","last_clean":"2024-09-11T22:11:15.856557+0000","last_became_active":"2024-09-11T22:11:13.872085+0000","last_became_peered":"2024-09-11T22:11:13.872085+0000","last_unstale":"2024-09-11T22:11:15.856557+0000","last_undegraded":"2024-09-11T22:11:15.856557+0000","last_fullsized":"2024-09-11T22:11:15.856557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.543280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721020+0000","last_change":"2024-09-11T22:11:14.879201+0000","last_active":"2024-09-11T22:11:16.721020+0000","last_peered":"2024-09-11T22:11:16.721020+0000","last_clean":"2024-09-11T22:11:16.721020+0000","last_became_active":"2024-09-11T22:11:14.877959+0000","last_became_peered":"2024-09-11T22:11:14.877959+0000","last_unstale":"2024-09-11T22:11:16.721020+0000","last_undegraded":"2024-09-11T22:11:16.721020+0000","last_fullsized":"2024-09-11T22:11:16.721020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.016889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860117+0000","last_change":"2024-09-11T22:11:13.869408+0000","last_active":"2024-09-11T22:11:15.860117+0000","last_peered":"2024-09-11T22:11:15.860117+0000","last_clean":"2024-09-11T22:11:15.860117+0000","last_became_active":"2024-09-11T22:11:13.869118+0000","last_became_peered":"2024-09-11T22:11:13.869118+0000","last_unstale":"2024-09-11T22:11:15.860117+0000","last_undegraded":"2024-09-11T22:11:15.860117+0000","last_fullsized":"2024-09-11T22:11:15.860117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:53.334520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721337+0000","last_change":"2024-09-11T22:11:14.872499+0000","last_active":"2024-09-11T22:11:16.721337+0000","last_peered":"2024-09-11T22:11:16.721337+0000","last_clean":"2024-09-11T22:11:16.721337+0000","last_became_active":"2024-09-11T22:11:14.871587+0000","last_became_peered":"2024-09-11T22:11:14.871587+0000","last_unstale":"2024-09-11T22:11:16.721337+0000","last_undegraded":"2024-09-11T22:11:16.721337+0000","last_fullsized":"2024-09-11T22:11:16.721337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:35.612025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110425+0000","last_change":"2024-09-11T22:11:13.870364+0000","last_active":"2024-09-11T22:11:16.110425+0000","last_peered":"2024-09-11T22:11:16.110425+0000","last_clean":"2024-09-11T22:11:16.110425+0000","last_became_active":"2024-09-11T22:11:13.870090+0000","last_became_peered":"2024-09-11T22:11:13.870090+0000","last_unstale":"2024-09-11T22:11:16.110425+0000","last_undegraded":"2024-09-11T22:11:16.110425+0000","last_fullsized":"2024-09-11T22:11:16.110425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:26.952937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.720829+0000","last_change":"2024-09-11T22:11:14.867034+0000","last_active":"2024-09-11T22:11:16.720829+0000","last_peered":"2024-09-11T22:11:16.720829+0000","last_clean":"2024-09-11T22:11:16.720829+0000","last_became_active":"2024-09-11T22:11:14.865159+0000","last_became_peered":"2024-09-11T22:11:14.865159+0000","last_unstale":"2024-09-11T22:11:16.720829+0000","last_undegraded":"2024-09-11T22:11:16.720829+0000","last_fullsized":"2024-09-11T22:11:16.720829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:17.775314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856326+0000","last_change":"2024-09-11T22:11:13.872102+0000","last_active":"2024-09-11T22:11:15.856326+0000","last_peered":"2024-09-11T22:11:15.856326+0000","last_clean":"2024-09-11T22:11:15.856326+0000","last_became_active":"2024-09-11T22:11:13.871744+0000","last_became_peered":"2024-09-11T22:11:13.871744+0000","last_unstale":"2024-09-11T22:11:15.856326+0000","last_undegraded":"2024-09-11T22:11:15.856326+0000","last_fullsized":"2024-09-11T22:11:15.856326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:16.770079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721304+0000","last_change":"2024-09-11T22:11:14.877095+0000","last_active":"2024-09-11T22:11:16.721304+0000","last_peered":"2024-09-11T22:11:16.721304+0000","last_clean":"2024-09-11T22:11:16.721304+0000","last_became_active":"2024-09-11T22:11:14.876804+0000","last_became_peered":"2024-09-11T22:11:14.876804+0000","last_unstale":"2024-09-11T22:11:16.721304+0000","last_undegraded":"2024-09-11T22:11:16.721304+0000","last_fullsized":"2024-09-11T22:11:16.721304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:02.999213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.856278+0000","last_change":"2024-09-11T22:11:13.866539+0000","last_active":"2024-09-11T22:11:15.856278+0000","last_peered":"2024-09-11T22:11:15.856278+0000","last_clean":"2024-09-11T22:11:15.856278+0000","last_became_active":"2024-09-11T22:11:13.866049+0000","last_became_peered":"2024-09-11T22:11:13.866049+0000","last_unstale":"2024-09-11T22:11:15.856278+0000","last_undegraded":"2024-09-11T22:11:15.856278+0000","last_fullsized":"2024-09-11T22:11:15.856278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:37.267640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722128+0000","last_change":"2024-09-11T22:11:14.880391+0000","last_active":"2024-09-11T22:11:16.722128+0000","last_peered":"2024-09-11T22:11:16.722128+0000","last_clean":"2024-09-11T22:11:16.722128+0000","last_became_active":"2024-09-11T22:11:14.880107+0000","last_became_peered":"2024-09-11T22:11:14.880107+0000","last_unstale":"2024-09-11T22:11:16.722128+0000","last_undegraded":"2024-09-11T22:11:16.722128+0000","last_fullsized":"2024-09-11T22:11:16.722128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:58.767744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.111012+0000","last_change":"2024-09-11T22:11:13.871354+0000","last_active":"2024-09-11T22:11:16.111012+0000","last_peered":"2024-09-11T22:11:16.111012+0000","last_clean":"2024-09-11T22:11:16.111012+0000","last_became_active":"2024-09-11T22:11:13.871001+0000","last_became_peered":"2024-09-11T22:11:13.871001+0000","last_unstale":"2024-09-11T22:11:16.111012+0000","last_undegraded":"2024-09-11T22:11:16.111012+0000","last_fullsized":"2024-09-11T22:11:16.111012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:51.873061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.859743+0000","last_change":"2024-09-11T22:11:14.875629+0000","last_active":"2024-09-11T22:11:15.859743+0000","last_peered":"2024-09-11T22:11:15.859743+0000","last_clean":"2024-09-11T22:11:15.859743+0000","last_became_active":"2024-09-11T22:11:14.875371+0000","last_became_peered":"2024-09-11T22:11:14.875371+0000","last_unstale":"2024-09-11T22:11:15.859743+0000","last_undegraded":"2024-09-11T22:11:15.859743+0000","last_fullsized":"2024-09-11T22:11:15.859743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.370344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860610+0000","last_change":"2024-09-11T22:11:14.867613+0000","last_active":"2024-09-11T22:11:15.860610+0000","last_peered":"2024-09-11T22:11:15.860610+0000","last_clean":"2024-09-11T22:11:15.860610+0000","last_became_active":"2024-09-11T22:11:14.865673+0000","last_became_peered":"2024-09-11T22:11:14.865673+0000","last_unstale":"2024-09-11T22:11:15.860610+0000","last_undegraded":"2024-09-11T22:11:15.860610+0000","last_fullsized":"2024-09-11T22:11:15.860610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:20.925559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110863+0000","last_change":"2024-09-11T22:11:13.874968+0000","last_active":"2024-09-11T22:11:16.110863+0000","last_peered":"2024-09-11T22:11:16.110863+0000","last_clean":"2024-09-11T22:11:16.110863+0000","last_became_active":"2024-09-11T22:11:13.874621+0000","last_became_peered":"2024-09-11T22:11:13.874621+0000","last_unstale":"2024-09-11T22:11:16.110863+0000","last_undegraded":"2024-09-11T22:11:16.110863+0000","last_fullsized":"2024-09-11T22:11:16.110863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:09.164832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:15.860836+0000","last_change":"2024-09-11T22:11:14.868006+0000","last_active":"2024-09-11T22:11:15.860836+0000","last_peered":"2024-09-11T22:11:15.860836+0000","last_clean":"2024-09-11T22:11:15.860836+0000","last_became_active":"2024-09-11T22:11:14.867573+0000","last_became_peered":"2024-09-11T22:11:14.867573+0000","last_unstale":"2024-09-11T22:11:15.860836+0000","last_undegraded":"2024-09-11T22:11:15.860836+0000","last_fullsized":"2024-09-11T22:11:15.860836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:17.480305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.110928+0000","last_change":"2024-09-11T22:11:13.873703+0000","last_active":"2024-09-11T22:11:16.110928+0000","last_peered":"2024-09-11T22:11:16.110928+0000","last_clean":"2024-09-11T22:11:16.110928+0000","last_became_active":"2024-09-11T22:11:13.873310+0000","last_became_peered":"2024-09-11T22:11:13.873310+0000","last_unstale":"2024-09-11T22:11:16.110928+0000","last_undegraded":"2024-09-11T22:11:16.110928+0000","last_fullsized":"2024-09-11T22:11:16.110928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:39.514326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722052+0000","last_change":"2024-09-11T22:11:14.873241+0000","last_active":"2024-09-11T22:11:16.722052+0000","last_peered":"2024-09-11T22:11:16.722052+0000","last_clean":"2024-09-11T22:11:16.722052+0000","last_became_active":"2024-09-11T22:11:14.872638+0000","last_became_peered":"2024-09-11T22:11:14.872638+0000","last_unstale":"2024-09-11T22:11:16.722052+0000","last_undegraded":"2024-09-11T22:11:16.722052+0000","last_fullsized":"2024-09-11T22:11:16.722052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:02.999213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722066+0000","last_change":"2024-09-11T22:11:13.869743+0000","last_active":"2024-09-11T22:11:16.722066+0000","last_peered":"2024-09-11T22:11:16.722066+0000","last_clean":"2024-09-11T22:11:16.722066+0000","last_became_active":"2024-09-11T22:11:13.868457+0000","last_became_peered":"2024-09-11T22:11:13.868457+0000","last_unstale":"2024-09-11T22:11:16.722066+0000","last_undegraded":"2024-09-11T22:11:16.722066+0000","last_fullsized":"2024-09-11T22:11:16.722066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:15.850187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.721967+0000","last_change":"2024-09-11T22:11:14.870523+0000","last_active":"2024-09-11T22:11:16.721967+0000","last_peered":"2024-09-11T22:11:16.721967+0000","last_clean":"2024-09-11T22:11:16.721967+0000","last_became_active":"2024-09-11T22:11:14.870160+0000","last_became_peered":"2024-09-11T22:11:14.870160+0000","last_unstale":"2024-09-11T22:11:16.721967+0000","last_undegraded":"2024-09-11T22:11:16.721967+0000","last_fullsized":"2024-09-11T22:11:16.721967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:13.846965+0000","last_clean_scrub_stamp":"2024-09-11T22:11:13.846965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:49.232203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T22:11:16.722394+0000","last_change":"2024-09-11T22:11:13.866359+0000","last_active":"2024-09-11T22:11:16.722394+0000","last_peered":"2024-09-11T22:11:16.722394+0000","last_clean":"2024-09-11T22:11:16.722394+0000","last_became_active":"2024-09-11T22:11:13.866072+0000","last_became_peered":"2024-09-11T22:11:13.866072+0000","last_unstale":"2024-09-11T22:11:16.722394+0000","last_undegraded":"2024-09-11T22:11:16.722394+0000","last_fullsized":"2024-09-11T22:11:16.722394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:12.841731+0000","last_clean_scrub_stamp":"2024-09-11T22:11:12.841731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.274583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":663753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:11:26.979 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:11:26.979 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T22:11:26.980 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T22:11:26.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T22:11:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.116+0000 7f7b7604c640 1 Processor -- start 2024-09-11T22:11:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.116+0000 7f7b7604c640 1 -- start start 2024-09-11T22:11:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b7604c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b70161d30 0x7f7b700cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b7604c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b700b78f0 0x7f7b70162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b7604c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b700d11d0 0x7f7b700d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b7604c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7b700d3450 con 0x7f7b700b78f0 2024-09-11T22:11:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b7604c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7b701632e0 con 0x7f7b700d11d0 2024-09-11T22:11:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b7604c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7b70162110 con 0x7f7b70161d30 2024-09-11T22:11:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b6effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b700b78f0 0x7f7b70162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b6effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b700b78f0 0x7f7b70162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46768/0 (socket says 172.21.15.50:46768) 2024-09-11T22:11:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b6effd640 1 -- 172.21.15.50:0/2937147213 learned_addr learned my addr 172.21.15.50:0/2937147213 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b6ffff640 1 --2- 172.21.15.50:0/2937147213 >> v2:172.21.15.77:3300/0 conn(0x7f7b700d11d0 0x7f7b700d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b6effd640 1 -- 172.21.15.50:0/2937147213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b70161d30 msgr2=0x7f7b700cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b6effd640 1 --2- 172.21.15.50:0/2937147213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b70161d30 0x7f7b700cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b6effd640 1 -- 172.21.15.50:0/2937147213 >> v2:172.21.15.77:3300/0 conn(0x7f7b700d11d0 msgr2=0x7f7b700d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b6effd640 1 --2- 172.21.15.50:0/2937147213 >> v2:172.21.15.77:3300/0 conn(0x7f7b700d11d0 0x7f7b700d1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b6effd640 1 -- 172.21.15.50:0/2937147213 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b700cfd70 con 0x7f7b700b78f0 2024-09-11T22:11:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.117+0000 7f7b6ffff640 1 --2- 172.21.15.50:0/2937147213 >> v2:172.21.15.77:3300/0 conn(0x7f7b700d11d0 0x7f7b700d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.118+0000 7f7b6effd640 1 --2- 172.21.15.50:0/2937147213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b700b78f0 0x7f7b70162da0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7b700d1d70 tx=0x7f7b6402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7e8a3b1d51dd96 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.118+0000 7f7b6e7fc640 1 -- 172.21.15.50:0/2937147213 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64037070 con 0x7f7b700b78f0 2024-09-11T22:11:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.118+0000 7f7b6e7fc640 1 -- 172.21.15.50:0/2937147213 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b64032440 con 0x7f7b700b78f0 2024-09-11T22:11:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.118+0000 7f7b6e7fc640 1 -- 172.21.15.50:0/2937147213 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64032810 con 0x7f7b700b78f0 2024-09-11T22:11:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.119+0000 7f7b7604c640 1 -- 172.21.15.50:0/2937147213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b700b78f0 msgr2=0x7f7b70162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.119+0000 7f7b7604c640 1 --2- 172.21.15.50:0/2937147213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b700b78f0 0x7f7b70162da0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7b700d1d70 tx=0x7f7b6402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.119+0000 7f7b7604c640 1 -- 172.21.15.50:0/2937147213 shutdown_connections 2024-09-11T22:11:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.119+0000 7f7b7604c640 1 --2- 172.21.15.50:0/2937147213 >> v2:172.21.15.77:3300/0 conn(0x7f7b700d11d0 0x7f7b700d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.119+0000 7f7b7604c640 1 --2- 172.21.15.50:0/2937147213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b700b78f0 0x7f7b70162da0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.119+0000 7f7b7604c640 1 --2- 172.21.15.50:0/2937147213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b70161d30 0x7f7b700cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.119+0000 7f7b7604c640 1 -- 172.21.15.50:0/2937147213 >> 172.21.15.50:0/2937147213 conn(0x7f7b700727a0 msgr2=0x7f7b700679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.119+0000 7f7b7604c640 1 -- 172.21.15.50:0/2937147213 shutdown_connections 2024-09-11T22:11:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.119+0000 7f7b7604c640 1 -- 172.21.15.50:0/2937147213 wait complete. 2024-09-11T22:11:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.120+0000 7f7b7604c640 1 Processor -- start 2024-09-11T22:11:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.120+0000 7f7b7604c640 1 -- start start 2024-09-11T22:11:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b7604c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b700b78f0 0x7f7b70157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b7604c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b700d11d0 0x7f7b70157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b7604c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b70161d30 0x7f7b701e9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b7604c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7b700d30e0 con 0x7f7b700d11d0 2024-09-11T22:11:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b7604c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7b700d2e00 con 0x7f7b70161d30 2024-09-11T22:11:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b7604c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7b700b7d30 con 0x7f7b700b78f0 2024-09-11T22:11:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b6effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b700d11d0 0x7f7b70157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b6effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b700d11d0 0x7f7b70157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46774/0 (socket says 172.21.15.50:46774) 2024-09-11T22:11:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b6effd640 1 -- 172.21.15.50:0/313199808 learned_addr learned my addr 172.21.15.50:0/313199808 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b6ffff640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b70161d30 0x7f7b701e9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b6f7fe640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b700b78f0 0x7f7b70157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b6effd640 1 -- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b700b78f0 msgr2=0x7f7b70157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b6effd640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b700b78f0 0x7f7b70157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b6effd640 1 -- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b70161d30 msgr2=0x7f7b701e9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b6effd640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b70161d30 0x7f7b701e9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b6effd640 1 -- 172.21.15.50:0/313199808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b701e83f0 con 0x7f7b700d11d0 2024-09-11T22:11:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b6effd640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b700d11d0 0x7f7b70157c40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7b64000c00 tx=0x7f7b640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.121+0000 7f7b57fff640 1 -- 172.21.15.50:0/313199808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64041020 con 0x7f7b700d11d0 2024-09-11T22:11:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.122+0000 7f7b57fff640 1 -- 172.21.15.50:0/313199808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b64030970 con 0x7f7b700d11d0 2024-09-11T22:11:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.122+0000 7f7b7604c640 1 -- 172.21.15.50:0/313199808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b701e86b0 con 0x7f7b700d11d0 2024-09-11T22:11:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.122+0000 7f7b57fff640 1 -- 172.21.15.50:0/313199808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64037040 con 0x7f7b700d11d0 2024-09-11T22:11:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.122+0000 7f7b7604c640 1 -- 172.21.15.50:0/313199808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b701e8c70 con 0x7f7b700d11d0 2024-09-11T22:11:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.122+0000 7f7b7604c640 1 -- 172.21.15.50:0/313199808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b70162da0 con 0x7f7b700d11d0 2024-09-11T22:11:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.123+0000 7f7b57fff640 1 -- 172.21.15.50:0/313199808 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b64044020 con 0x7f7b700d11d0 2024-09-11T22:11:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.123+0000 7f7b57fff640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7b5c06be30 0x7f7b5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.124+0000 7f7b57fff640 1 -- 172.21.15.50:0/313199808 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7b640ab640 con 0x7f7b700d11d0 2024-09-11T22:11:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.124+0000 7f7b6f7fe640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7b5c06be30 0x7f7b5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.124+0000 7f7b6f7fe640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7b5c06be30 0x7f7b5c06e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009990 tx=0x7f7b60009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.128+0000 7f7b57fff640 1 -- 172.21.15.50:0/313199808 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b6404b030 con 0x7f7b700d11d0 2024-09-11T22:11:27.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.341+0000 7f7b7604c640 1 -- 172.21.15.50:0/313199808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7b700d2900 con 0x7f7b700d11d0 2024-09-11T22:11:27.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.341+0000 7f7b57fff640 1 -- 172.21.15.50:0/313199808 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7b6407a080 con 0x7f7b700d11d0 2024-09-11T22:11:27.342 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:27.343 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T22:11:27.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.343+0000 7f7b7604c640 1 -- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7b5c06be30 msgr2=0x7f7b5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.343+0000 7f7b7604c640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7b5c06be30 0x7f7b5c06e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009990 tx=0x7f7b60009110 comp rx=0 tx=0).stop 2024-09-11T22:11:27.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.343+0000 7f7b7604c640 1 -- 172.21.15.50:0/313199808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b700d11d0 msgr2=0x7f7b70157c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.343+0000 7f7b7604c640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b700d11d0 0x7f7b70157c40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7b64000c00 tx=0x7f7b640046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.343+0000 7f7b7604c640 1 -- 172.21.15.50:0/313199808 shutdown_connections 2024-09-11T22:11:27.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.343+0000 7f7b7604c640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7b5c06be30 0x7f7b5c06e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.343+0000 7f7b7604c640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b70161d30 0x7f7b701e9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.343+0000 7f7b7604c640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b700d11d0 0x7f7b70157c40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.343+0000 7f7b7604c640 1 --2- 172.21.15.50:0/313199808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b700b78f0 0x7f7b70157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.343+0000 7f7b7604c640 1 -- 172.21.15.50:0/313199808 >> 172.21.15.50:0/313199808 conn(0x7f7b700727a0 msgr2=0x7f7b700cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:27.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.344+0000 7f7b7604c640 1 -- 172.21.15.50:0/313199808 shutdown_connections 2024-09-11T22:11:27.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.344+0000 7f7b7604c640 1 -- 172.21.15.50:0/313199808 wait complete. 2024-09-11T22:11:27.355 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T22:11:27.355 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:11:27.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.456+0000 7f7374ffd640 1 Processor -- start 2024-09-11T22:11:27.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.456+0000 7f7374ffd640 1 -- start start 2024-09-11T22:11:27.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.457+0000 7f7374ffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f737015e870 0x7f73700d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.457+0000 7f7374ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73700d3c00 0x7f73700b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.457+0000 7f7374ffd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73700cfa80 con 0x7f73700d16d0 2024-09-11T22:11:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.457+0000 7f7374ffd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f73700d1b10 con 0x7f73700d3c00 2024-09-11T22:11:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.457+0000 7f7374ffd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f73700d40d0 con 0x7f737015e870 2024-09-11T22:11:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.457+0000 7f736ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73700d3c00 0x7f73700b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.457+0000 7f736ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73700d3c00 0x7f73700b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46776/0 (socket says 172.21.15.50:46776) 2024-09-11T22:11:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.457+0000 7f736ed9d640 1 -- 172.21.15.50:0/1167300646 learned_addr learned my addr 172.21.15.50:0/1167300646 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.458+0000 7f736e59c640 1 --2- 172.21.15.50:0/1167300646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f737015e870 0x7f73700d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.458+0000 7f736ed9d640 1 -- 172.21.15.50:0/1167300646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f737015e870 msgr2=0x7f73700d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.458+0000 7f736ed9d640 1 --2- 172.21.15.50:0/1167300646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f737015e870 0x7f73700d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.458+0000 7f736ed9d640 1 -- 172.21.15.50:0/1167300646 >> v1:172.21.15.77:6789/0 conn(0x7f73700d16d0 legacy=0x7f73700d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.458+0000 7f736ed9d640 1 -- 172.21.15.50:0/1167300646 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73700d43b0 con 0x7f73700d3c00 2024-09-11T22:11:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.458+0000 7f736e59c640 1 --2- 172.21.15.50:0/1167300646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f737015e870 0x7f73700d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.458+0000 7f736ed9d640 1 --2- 172.21.15.50:0/1167300646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73700d3c00 0x7f73700b8400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7368009870 tx=0x7f736802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e533b2ea358332e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.459+0000 7f736d59a640 1 -- 172.21.15.50:0/1167300646 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368037070 con 0x7f73700d3c00 2024-09-11T22:11:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.459+0000 7f736d59a640 1 -- 172.21.15.50:0/1167300646 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7368032440 con 0x7f73700d3c00 2024-09-11T22:11:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.459+0000 7f736d59a640 1 -- 172.21.15.50:0/1167300646 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368032810 con 0x7f73700d3c00 2024-09-11T22:11:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.459+0000 7f7374ffd640 1 -- 172.21.15.50:0/1167300646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73700d3c00 msgr2=0x7f73700b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.459+0000 7f7374ffd640 1 --2- 172.21.15.50:0/1167300646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73700d3c00 0x7f73700b8400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7368009870 tx=0x7f736802a270 comp rx=0 tx=0).stop 2024-09-11T22:11:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.459+0000 7f7374ffd640 1 -- 172.21.15.50:0/1167300646 shutdown_connections 2024-09-11T22:11:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.459+0000 7f7374ffd640 1 --2- 172.21.15.50:0/1167300646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73700d3c00 0x7f73700b8400 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.459+0000 7f7374ffd640 1 --2- 172.21.15.50:0/1167300646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f737015e870 0x7f73700d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.459+0000 7f7374ffd640 1 -- 172.21.15.50:0/1167300646 >> 172.21.15.50:0/1167300646 conn(0x7f73700727a0 msgr2=0x7f73700679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.459+0000 7f7374ffd640 1 -- 172.21.15.50:0/1167300646 shutdown_connections 2024-09-11T22:11:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.459+0000 7f7374ffd640 1 -- 172.21.15.50:0/1167300646 wait complete. 2024-09-11T22:11:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.461+0000 7f7374ffd640 1 Processor -- start 2024-09-11T22:11:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.461+0000 7f7374ffd640 1 -- start start 2024-09-11T22:11:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.461+0000 7f7374ffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73700d16d0 0x7f73701593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.461+0000 7f7374ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73700d3c00 0x7f73701547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.461+0000 7f7374ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737015e870 0x7f7370155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.461+0000 7f7374ffd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f737015ec50 con 0x7f737015e870 2024-09-11T22:11:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.461+0000 7f7374ffd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73700b7ee0 con 0x7f73700d3c00 2024-09-11T22:11:27.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.461+0000 7f7374ffd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f73700b78b0 con 0x7f73700d16d0 2024-09-11T22:11:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.461+0000 7f736ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737015e870 0x7f7370155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.461+0000 7f736ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737015e870 0x7f7370155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46790/0 (socket says 172.21.15.50:46790) 2024-09-11T22:11:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.461+0000 7f736ed9d640 1 -- 172.21.15.50:0/1973220777 learned_addr learned my addr 172.21.15.50:0/1973220777 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.461+0000 7f736dd9b640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73700d3c00 0x7f73701547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.462+0000 7f736e59c640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73700d16d0 0x7f73701593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.462+0000 7f736ed9d640 1 -- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73700d16d0 msgr2=0x7f73701593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.462+0000 7f736ed9d640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73700d16d0 0x7f73701593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.462+0000 7f736ed9d640 1 -- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73700d3c00 msgr2=0x7f73701547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.462+0000 7f736ed9d640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73700d3c00 0x7f73701547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.462+0000 7f736ed9d640 1 -- 172.21.15.50:0/1973220777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7370155170 con 0x7f737015e870 2024-09-11T22:11:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.462+0000 7f736ed9d640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737015e870 0x7f7370155850 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7368009870 tx=0x7f73680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.462+0000 7f7366ffd640 1 -- 172.21.15.50:0/1973220777 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368037040 con 0x7f737015e870 2024-09-11T22:11:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.462+0000 7f7366ffd640 1 -- 172.21.15.50:0/1973220777 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7368042070 con 0x7f737015e870 2024-09-11T22:11:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.462+0000 7f7374ffd640 1 -- 172.21.15.50:0/1973220777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7370159af0 con 0x7f737015e870 2024-09-11T22:11:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.462+0000 7f7366ffd640 1 -- 172.21.15.50:0/1973220777 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368030bd0 con 0x7f737015e870 2024-09-11T22:11:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.462+0000 7f7374ffd640 1 -- 172.21.15.50:0/1973220777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737015a830 con 0x7f737015e870 2024-09-11T22:11:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.463+0000 7f7374ffd640 1 -- 172.21.15.50:0/1973220777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73700cf1c0 con 0x7f737015e870 2024-09-11T22:11:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.464+0000 7f7366ffd640 1 -- 172.21.15.50:0/1973220777 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7368047460 con 0x7f737015e870 2024-09-11T22:11:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.464+0000 7f7366ffd640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f735006be30 0x7f735006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.464+0000 7f7366ffd640 1 -- 172.21.15.50:0/1973220777 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f73680ab800 con 0x7f737015e870 2024-09-11T22:11:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.464+0000 7f736e59c640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f735006be30 0x7f735006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.465+0000 7f736e59c640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f735006be30 0x7f735006e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f736000d620 tx=0x7f7360007810 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:27.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.468+0000 7f7366ffd640 1 -- 172.21.15.50:0/1973220777 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73700cf1c0 con 0x7f737015e870 2024-09-11T22:11:27.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.680+0000 7f7374ffd640 1 -- 172.21.15.50:0/1973220777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73700b8400 con 0x7f737015e870 2024-09-11T22:11:27.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.681+0000 7f7366ffd640 1 -- 172.21.15.50:0/1973220777 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5214 (secure 0 0 0) 0x7f7368079bf0 con 0x7f737015e870 2024-09-11T22:11:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:27.682 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"btime":"2024-09-11T22:11:16:865918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2971042772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2971042772},{"type":"v1","addr":"172.21.15.77:6837","nonce":2971042772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/293208439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":293208439},{"type":"v1","addr":"172.21.15.77:6835","nonce":293208439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4087237334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4087237334},{"type":"v1","addr":"172.21.15.50:6834","nonce":4087237334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:11:14.221375+0000","modified":"2024-09-11T22:11:16.209817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2305531878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2305531878},{"type":"v1","addr":"172.21.15.50:6835","nonce":2305531878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-11T22:11:27.682 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2024-09-11T22:11:27.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.683+0000 7f7374ffd640 1 -- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f735006be30 msgr2=0x7f735006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.683+0000 7f7374ffd640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f735006be30 0x7f735006e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f736000d620 tx=0x7f7360007810 comp rx=0 tx=0).stop 2024-09-11T22:11:27.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.683+0000 7f7374ffd640 1 -- 172.21.15.50:0/1973220777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737015e870 msgr2=0x7f7370155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.683+0000 7f7374ffd640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737015e870 0x7f7370155850 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7368009870 tx=0x7f73680046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.683+0000 7f7374ffd640 1 -- 172.21.15.50:0/1973220777 shutdown_connections 2024-09-11T22:11:27.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.683+0000 7f7374ffd640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f735006be30 0x7f735006e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.683+0000 7f7374ffd640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f737015e870 0x7f7370155850 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.683+0000 7f7374ffd640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73700d3c00 0x7f73701547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.683+0000 7f7374ffd640 1 --2- 172.21.15.50:0/1973220777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73700d16d0 0x7f73701593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.683+0000 7f7374ffd640 1 -- 172.21.15.50:0/1973220777 >> 172.21.15.50:0/1973220777 conn(0x7f73700727a0 msgr2=0x7f73700679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:27.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.683+0000 7f7374ffd640 1 -- 172.21.15.50:0/1973220777 shutdown_connections 2024-09-11T22:11:27.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.683+0000 7f7374ffd640 1 -- 172.21.15.50:0/1973220777 wait complete. 2024-09-11T22:11:27.695 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:11:27.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.796+0000 7f6deafe4640 1 Processor -- start 2024-09-11T22:11:27.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.796+0000 7f6deafe4640 1 -- start start 2024-09-11T22:11:27.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.797+0000 7f6deafe4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6de40d18e0 0x7f6de40d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.797+0000 7f6deafe4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6de415eb70 0x7f6de40d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.797+0000 7f6deafe4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de40d31b0 con 0x7f6de415e790 2024-09-11T22:11:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.797+0000 7f6deafe4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6de40d3dc0 con 0x7f6de40d18e0 2024-09-11T22:11:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.797+0000 7f6deafe4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6de40d3490 con 0x7f6de415eb70 2024-09-11T22:11:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.797+0000 7f6de3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6de40d18e0 0x7f6de40d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.797+0000 7f6de3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6de40d18e0 0x7f6de40d4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38312/0 (socket says 172.21.15.50:38312) 2024-09-11T22:11:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.797+0000 7f6de3fff640 1 -- 172.21.15.50:0/3771165493 learned_addr learned my addr 172.21.15.50:0/3771165493 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.797+0000 7f6de9581640 1 --2- 172.21.15.50:0/3771165493 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6de415eb70 0x7f6de40d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.798+0000 7f6de3fff640 1 -- 172.21.15.50:0/3771165493 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6de415eb70 msgr2=0x7f6de40d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.798+0000 7f6de3fff640 1 --2- 172.21.15.50:0/3771165493 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6de415eb70 0x7f6de40d2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.798+0000 7f6de3fff640 1 -- 172.21.15.50:0/3771165493 >> v1:172.21.15.77:6789/0 conn(0x7f6de415e790 legacy=0x7f6de40d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.798+0000 7f6de3fff640 1 -- 172.21.15.50:0/3771165493 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de40d3770 con 0x7f6de40d18e0 2024-09-11T22:11:27.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.798+0000 7f6de9581640 1 --2- 172.21.15.50:0/3771165493 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6de415eb70 0x7f6de40d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:27.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.798+0000 7f6de3fff640 1 --2- 172.21.15.50:0/3771165493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de40d18e0 0x7f6de40d4250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009870 tx=0x7f6dd802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cb7c09434e326c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:27.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.799+0000 7f6de37fe640 1 -- 172.21.15.50:0/3771165493 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8037070 con 0x7f6de40d18e0 2024-09-11T22:11:27.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.799+0000 7f6de37fe640 1 -- 172.21.15.50:0/3771165493 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd8032440 con 0x7f6de40d18e0 2024-09-11T22:11:27.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.799+0000 7f6de37fe640 1 -- 172.21.15.50:0/3771165493 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8032810 con 0x7f6de40d18e0 2024-09-11T22:11:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.799+0000 7f6deafe4640 1 -- 172.21.15.50:0/3771165493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de40d18e0 msgr2=0x7f6de40d4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.799+0000 7f6deafe4640 1 --2- 172.21.15.50:0/3771165493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de40d18e0 0x7f6de40d4250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009870 tx=0x7f6dd802a270 comp rx=0 tx=0).stop 2024-09-11T22:11:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.799+0000 7f6deafe4640 1 -- 172.21.15.50:0/3771165493 shutdown_connections 2024-09-11T22:11:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.799+0000 7f6deafe4640 1 --2- 172.21.15.50:0/3771165493 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6de415eb70 0x7f6de40d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.799+0000 7f6deafe4640 1 --2- 172.21.15.50:0/3771165493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de40d18e0 0x7f6de40d4250 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.799+0000 7f6deafe4640 1 -- 172.21.15.50:0/3771165493 >> 172.21.15.50:0/3771165493 conn(0x7f6de40727a0 msgr2=0x7f6de40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.799+0000 7f6deafe4640 1 -- 172.21.15.50:0/3771165493 shutdown_connections 2024-09-11T22:11:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.799+0000 7f6deafe4640 1 -- 172.21.15.50:0/3771165493 wait complete. 2024-09-11T22:11:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.800+0000 7f6deafe4640 1 Processor -- start 2024-09-11T22:11:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.800+0000 7f6deafe4640 1 -- start start 2024-09-11T22:11:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.801+0000 7f6deafe4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6de40d18e0 0x7f6de41598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.801+0000 7f6deafe4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de415e790 0x7f6de40cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.801+0000 7f6deafe4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6de415eb70 0x7f6de40ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.801+0000 7f6deafe4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6de40ba3b0 con 0x7f6de415e790 2024-09-11T22:11:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.801+0000 7f6deafe4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6de40ba230 con 0x7f6de40d18e0 2024-09-11T22:11:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.801+0000 7f6deafe4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6de40ba530 con 0x7f6de415eb70 2024-09-11T22:11:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.801+0000 7f6de3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de415e790 0x7f6de40cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.801+0000 7f6de3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de415e790 0x7f6de40cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38322/0 (socket says 172.21.15.50:38322) 2024-09-11T22:11:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.801+0000 7f6de3fff640 1 -- 172.21.15.50:0/2083458682 learned_addr learned my addr 172.21.15.50:0/2083458682 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6de8d80640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6de40d18e0 0x7f6de41598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6de9581640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6de415eb70 0x7f6de40ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6de3fff640 1 -- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6de415eb70 msgr2=0x7f6de40ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6de3fff640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6de415eb70 0x7f6de40ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6de3fff640 1 -- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6de40d18e0 msgr2=0x7f6de41598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6de3fff640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6de40d18e0 0x7f6de41598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6de3fff640 1 -- 172.21.15.50:0/2083458682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de41e70a0 con 0x7f6de415e790 2024-09-11T22:11:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6de8d80640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6de40d18e0 0x7f6de41598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6de9581640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6de415eb70 0x7f6de40ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6de3fff640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de415e790 0x7f6de40cca80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8000c00 tx=0x7f6dd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6de17fa640 1 -- 172.21.15.50:0/2083458682 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8037040 con 0x7f6de415e790 2024-09-11T22:11:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6de17fa640 1 -- 172.21.15.50:0/2083458682 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd8042070 con 0x7f6de415e790 2024-09-11T22:11:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6deafe4640 1 -- 172.21.15.50:0/2083458682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de41e7380 con 0x7f6de415e790 2024-09-11T22:11:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6de17fa640 1 -- 172.21.15.50:0/2083458682 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8030bb0 con 0x7f6de415e790 2024-09-11T22:11:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.802+0000 7f6deafe4640 1 -- 172.21.15.50:0/2083458682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de414c1a0 con 0x7f6de415e790 2024-09-11T22:11:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.803+0000 7f6deafe4640 1 -- 172.21.15.50:0/2083458682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de40d4250 con 0x7f6de415e790 2024-09-11T22:11:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.804+0000 7f6de17fa640 1 -- 172.21.15.50:0/2083458682 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6dd8047460 con 0x7f6de415e790 2024-09-11T22:11:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.804+0000 7f6de17fa640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6dd006be30 0x7f6dd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.804+0000 7f6de17fa640 1 -- 172.21.15.50:0/2083458682 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6dd80aba60 con 0x7f6de415e790 2024-09-11T22:11:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.804+0000 7f6de8d80640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6dd006be30 0x7f6dd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.805+0000 7f6de8d80640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6dd006be30 0x7f6dd006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4001680 tx=0x7f6dd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:27.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:27.808+0000 7f6de17fa640 1 -- 172.21.15.50:0/2083458682 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6dd807a4a0 con 0x7f6de415e790 2024-09-11T22:11:28.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.023+0000 7f6deafe4640 1 -- 172.21.15.50:0/2083458682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6de40d5410 con 0x7f6de415e790 2024-09-11T22:11:28.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.024+0000 7f6de17fa640 1 -- 172.21.15.50:0/2083458682 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5214 (secure 0 0 0) 0x7f6dd8079da0 con 0x7f6de415e790 2024-09-11T22:11:28.025 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:28.025 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"btime":"2024-09-11T22:11:16:865918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2971042772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2971042772},{"type":"v1","addr":"172.21.15.77:6837","nonce":2971042772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/293208439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":293208439},{"type":"v1","addr":"172.21.15.77:6835","nonce":293208439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4087237334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4087237334},{"type":"v1","addr":"172.21.15.50:6834","nonce":4087237334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:11:14.221375+0000","modified":"2024-09-11T22:11:16.209817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2305531878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2305531878},{"type":"v1","addr":"172.21.15.50:6835","nonce":2305531878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-11T22:11:28.025 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2024-09-11T22:11:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.026+0000 7f6deafe4640 1 -- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6dd006be30 msgr2=0x7f6dd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.026+0000 7f6deafe4640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6dd006be30 0x7f6dd006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4001680 tx=0x7f6dd4009040 comp rx=0 tx=0).stop 2024-09-11T22:11:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.026+0000 7f6deafe4640 1 -- 172.21.15.50:0/2083458682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de415e790 msgr2=0x7f6de40cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.026+0000 7f6deafe4640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de415e790 0x7f6de40cca80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8000c00 tx=0x7f6dd80046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.026+0000 7f6deafe4640 1 -- 172.21.15.50:0/2083458682 shutdown_connections 2024-09-11T22:11:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.026+0000 7f6deafe4640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6dd006be30 0x7f6dd006e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.026+0000 7f6deafe4640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6de415eb70 0x7f6de40ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.026+0000 7f6deafe4640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6de415e790 0x7f6de40cca80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.026+0000 7f6deafe4640 1 --2- 172.21.15.50:0/2083458682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6de40d18e0 0x7f6de41598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.026+0000 7f6deafe4640 1 -- 172.21.15.50:0/2083458682 >> 172.21.15.50:0/2083458682 conn(0x7f6de40727a0 msgr2=0x7f6de40cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.026+0000 7f6deafe4640 1 -- 172.21.15.50:0/2083458682 shutdown_connections 2024-09-11T22:11:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.026+0000 7f6deafe4640 1 -- 172.21.15.50:0/2083458682 wait complete. 2024-09-11T22:11:28.038 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.139+0000 7fcb6b3f6640 1 Processor -- start 2024-09-11T22:11:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.139+0000 7fcb6b3f6640 1 -- start start 2024-09-11T22:11:28.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb6b3f6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb6415c3c0 0x7fcb6415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb6b3f6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcb6415ec40 0x7fcb6415f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb6b3f6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb640679c0 0x7fcb64067e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb6b3f6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6415f5c0 con 0x7fcb640679c0 2024-09-11T22:11:28.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb6b3f6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6406e700 con 0x7fcb6415ec40 2024-09-11T22:11:28.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb6b3f6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcb64068340 con 0x7fcb6415c3c0 2024-09-11T22:11:28.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb69993640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb640679c0 0x7fcb64067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb69993640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb640679c0 0x7fcb64067e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38326/0 (socket says 172.21.15.50:38326) 2024-09-11T22:11:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb69993640 1 -- 172.21.15.50:0/887589950 learned_addr learned my addr 172.21.15.50:0/887589950 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb68991640 1 --2- 172.21.15.50:0/887589950 >> v2:172.21.15.77:3300/0 conn(0x7fcb6415ec40 0x7fcb6415f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb69192640 1 --2- 172.21.15.50:0/887589950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb6415c3c0 0x7fcb6415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb69993640 1 -- 172.21.15.50:0/887589950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb6415c3c0 msgr2=0x7fcb6415fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb69993640 1 --2- 172.21.15.50:0/887589950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb6415c3c0 0x7fcb6415fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb69993640 1 -- 172.21.15.50:0/887589950 >> v2:172.21.15.77:3300/0 conn(0x7fcb6415ec40 msgr2=0x7fcb6415f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb69993640 1 --2- 172.21.15.50:0/887589950 >> v2:172.21.15.77:3300/0 conn(0x7fcb6415ec40 0x7fcb6415f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb69993640 1 -- 172.21.15.50:0/887589950 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6415f7f0 con 0x7fcb640679c0 2024-09-11T22:11:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.140+0000 7fcb69192640 1 --2- 172.21.15.50:0/887589950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb6415c3c0 0x7fcb6415fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.141+0000 7fcb69993640 1 --2- 172.21.15.50:0/887589950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640679c0 0x7fcb64067e00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb640b6d70 tx=0x7fcb5c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4176f3f6cc914c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:28.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.141+0000 7fcb5bfff640 1 -- 172.21.15.50:0/887589950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c036070 con 0x7fcb640679c0 2024-09-11T22:11:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.141+0000 7fcb5bfff640 1 -- 172.21.15.50:0/887589950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb5c031600 con 0x7fcb640679c0 2024-09-11T22:11:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.141+0000 7fcb5bfff640 1 -- 172.21.15.50:0/887589950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0319d0 con 0x7fcb640679c0 2024-09-11T22:11:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.142+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/887589950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640679c0 msgr2=0x7fcb64067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.142+0000 7fcb6b3f6640 1 --2- 172.21.15.50:0/887589950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640679c0 0x7fcb64067e00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb640b6d70 tx=0x7fcb5c02a610 comp rx=0 tx=0).stop 2024-09-11T22:11:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.142+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/887589950 shutdown_connections 2024-09-11T22:11:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.142+0000 7fcb6b3f6640 1 --2- 172.21.15.50:0/887589950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640679c0 0x7fcb64067e00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.142+0000 7fcb6b3f6640 1 --2- 172.21.15.50:0/887589950 >> v2:172.21.15.77:3300/0 conn(0x7fcb6415ec40 0x7fcb6415f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.142+0000 7fcb6b3f6640 1 --2- 172.21.15.50:0/887589950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb6415c3c0 0x7fcb6415fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.142+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/887589950 >> 172.21.15.50:0/887589950 conn(0x7fcb64075060 msgr2=0x7fcb6406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.142+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/887589950 shutdown_connections 2024-09-11T22:11:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.142+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/887589950 wait complete. 2024-09-11T22:11:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.143+0000 7fcb6b3f6640 1 Processor -- start 2024-09-11T22:11:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.143+0000 7fcb6b3f6640 1 -- start start 2024-09-11T22:11:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb6b3f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640679c0 0x7fcb641f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb6b3f6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb6415c3c0 0x7fcb640ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb6b3f6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6415ec40 0x7fcb640ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb6b3f6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6406ec30 con 0x7fcb640679c0 2024-09-11T22:11:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb6b3f6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6406e950 con 0x7fcb6415ec40 2024-09-11T22:11:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb6b3f6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcb640d0940 con 0x7fcb6415c3c0 2024-09-11T22:11:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb69192640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640679c0 0x7fcb641f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb69192640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640679c0 0x7fcb641f4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38332/0 (socket says 172.21.15.50:38332) 2024-09-11T22:11:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb69192640 1 -- 172.21.15.50:0/3512451726 learned_addr learned my addr 172.21.15.50:0/3512451726 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb69993640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6415ec40 0x7fcb640ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb68991640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb6415c3c0 0x7fcb640ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb69192640 1 -- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb6415c3c0 msgr2=0x7fcb640ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb69192640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb6415c3c0 0x7fcb640ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb69192640 1 -- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6415ec40 msgr2=0x7fcb640ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb69192640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6415ec40 0x7fcb640ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb69192640 1 -- 172.21.15.50:0/3512451726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb641f5200 con 0x7fcb640679c0 2024-09-11T22:11:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb69993640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6415ec40 0x7fcb640ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb69192640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640679c0 0x7fcb641f4cc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000e810 tx=0x7fcb6000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb59ffb640 1 -- 172.21.15.50:0/3512451726 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6000f040 con 0x7fcb640679c0 2024-09-11T22:11:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb59ffb640 1 -- 172.21.15.50:0/3512451726 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb60004030 con 0x7fcb640679c0 2024-09-11T22:11:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/3512451726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb640cd0e0 con 0x7fcb640679c0 2024-09-11T22:11:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.144+0000 7fcb59ffb640 1 -- 172.21.15.50:0/3512451726 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb60004400 con 0x7fcb640679c0 2024-09-11T22:11:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.145+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/3512451726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb640aab30 con 0x7fcb640679c0 2024-09-11T22:11:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.146+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/3512451726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6406cae0 con 0x7fcb640679c0 2024-09-11T22:11:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.146+0000 7fcb59ffb640 1 -- 172.21.15.50:0/3512451726 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb6000c6d0 con 0x7fcb640679c0 2024-09-11T22:11:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.146+0000 7fcb59ffb640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb4806be30 0x7fcb4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.146+0000 7fcb59ffb640 1 -- 172.21.15.50:0/3512451726 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcb6008aae0 con 0x7fcb640679c0 2024-09-11T22:11:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.147+0000 7fcb68991640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb4806be30 0x7fcb4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.147+0000 7fcb68991640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb4806be30 0x7fcb4806e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009970 tx=0x7fcb54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.151+0000 7fcb59ffb640 1 -- 172.21.15.50:0/3512451726 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb641f5200 con 0x7fcb640679c0 2024-09-11T22:11:28.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.327+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/3512451726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb640cf100 con 0x7fcb640679c0 2024-09-11T22:11:28.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.328+0000 7fcb59ffb640 1 -- 172.21.15.50:0/3512451726 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7fcb60017020 con 0x7fcb640679c0 2024-09-11T22:11:28.329 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:28.329 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:15.853220+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:12.090736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:13.202114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:28.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.330+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb4806be30 msgr2=0x7fcb4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.330+0000 7fcb6b3f6640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb4806be30 0x7fcb4806e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009970 tx=0x7fcb54008040 comp rx=0 tx=0).stop 2024-09-11T22:11:28.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.330+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/3512451726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640679c0 msgr2=0x7fcb641f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.330+0000 7fcb6b3f6640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640679c0 0x7fcb641f4cc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000e810 tx=0x7fcb6000ecd0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.330+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/3512451726 shutdown_connections 2024-09-11T22:11:28.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.330+0000 7fcb6b3f6640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb4806be30 0x7fcb4806e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.330+0000 7fcb6b3f6640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb6415c3c0 0x7fcb640ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.330+0000 7fcb6b3f6640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6415ec40 0x7fcb640ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.330+0000 7fcb6b3f6640 1 --2- 172.21.15.50:0/3512451726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb640679c0 0x7fcb641f4cc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.330+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/3512451726 >> 172.21.15.50:0/3512451726 conn(0x7fcb64075060 msgr2=0x7fcb64160aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:28.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.330+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/3512451726 shutdown_connections 2024-09-11T22:11:28.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.330+0000 7fcb6b3f6640 1 -- 172.21.15.50:0/3512451726 wait complete. 2024-09-11T22:11:28.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:11:28.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.443+0000 7fc109682640 1 Processor -- start 2024-09-11T22:11:28.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.443+0000 7fc109682640 1 -- start start 2024-09-11T22:11:28.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.444+0000 7fc109682640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1040cf610 0x7fc1040b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.444+0000 7fc109682640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1040cfbd0 con 0x7fc1040b1600 2024-09-11T22:11:28.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.444+0000 7fc109682640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1040cfeb0 con 0x7fc104161fa0 2024-09-11T22:11:28.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.444+0000 7fc109682640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc1040d1220 con 0x7fc1040cf610 2024-09-11T22:11:28.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.444+0000 7fc1037fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc1040b1600 0x7fc1040cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34708/0 (socket says 172.21.15.50:34708) 2024-09-11T22:11:28.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.444+0000 7fc1037fe640 1 -- 172.21.15.50:0/877753577 learned_addr learned my addr 172.21.15.50:0/877753577 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:28.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.444+0000 7fc1027fc640 1 --2- 172.21.15.50:0/877753577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1040cf610 0x7fc1040b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2297181726 0 0) 0x7fc1040cfbd0 con 0x7fc1040b1600 2024-09-11T22:11:28.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0f0003520 con 0x7fc1040b1600 2024-09-11T22:11:28.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2490926983 0 0) 0x7fc0f0003520 con 0x7fc1040b1600 2024-09-11T22:11:28.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1040cf610 msgr2=0x7fc1040b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:28.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 --2- 172.21.15.50:0/877753577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1040cf610 0x7fc1040b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 >> v1:172.21.15.77:6789/0 conn(0x7fc104161fa0 legacy=0x7fc1040cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1040d1470 con 0x7fc1040b1600 2024-09-11T22:11:28.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fc0f40019f0 con 0x7fc1040b1600 2024-09-11T22:11:28.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 >> v1:172.21.15.50:6789/0 conn(0x7fc1040b1600 legacy=0x7fc1040cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 --2- 172.21.15.50:0/877753577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f00039e0 0x7fc0f0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 --2- 172.21.15.50:0/877753577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0f0004390 0x7fc0f0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 --2- 172.21.15.50:0/877753577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1040cf610 0x7fc0f00050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc1040d1220 con 0x7fc0f0004390 2024-09-11T22:11:28.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f000b9c0 con 0x7fc0f00039e0 2024-09-11T22:11:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f000bbc0 con 0x7fc1040cf610 2024-09-11T22:11:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc1027fc640 1 --2- 172.21.15.50:0/877753577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0f0004390 0x7fc0f0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc102ffd640 1 --2- 172.21.15.50:0/877753577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f00039e0 0x7fc0f0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc1037fe640 1 --2- 172.21.15.50:0/877753577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1040cf610 0x7fc0f00050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc1027fc640 1 -- 172.21.15.50:0/877753577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1040cf610 msgr2=0x7fc0f00050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc1027fc640 1 --2- 172.21.15.50:0/877753577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1040cf610 0x7fc0f00050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc1027fc640 1 -- 172.21.15.50:0/877753577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f00039e0 msgr2=0x7fc0f0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc1027fc640 1 --2- 172.21.15.50:0/877753577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f00039e0 0x7fc0f0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.445+0000 7fc1027fc640 1 -- 172.21.15.50:0/877753577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f0003520 con 0x7fc0f0004390 2024-09-11T22:11:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.446+0000 7fc1027fc640 1 --2- 172.21.15.50:0/877753577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0f0004390 0x7fc0f0004860 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec009a90 tx=0x7fc0f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9565b1403b02df server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.446+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec036070 con 0x7fc0f0004390 2024-09-11T22:11:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.446+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ec031400 con 0x7fc0f0004390 2024-09-11T22:11:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.446+0000 7fc101ffb640 1 -- 172.21.15.50:0/877753577 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec009690 con 0x7fc0f0004390 2024-09-11T22:11:28.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.447+0000 7fc109682640 1 -- 172.21.15.50:0/877753577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0f0004390 msgr2=0x7fc0f0004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.447+0000 7fc109682640 1 --2- 172.21.15.50:0/877753577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0f0004390 0x7fc0f0004860 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec009a90 tx=0x7fc0f0005830 comp rx=0 tx=0).stop 2024-09-11T22:11:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.447+0000 7fc1037fe640 1 -- 172.21.15.50:0/877753577 reap_dead start 2024-09-11T22:11:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.447+0000 7fc109682640 1 -- 172.21.15.50:0/877753577 shutdown_connections 2024-09-11T22:11:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.447+0000 7fc109682640 1 -- 172.21.15.50:0/877753577 >> 172.21.15.50:0/877753577 conn(0x7fc10409ba50 msgr2=0x7fc1040b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.447+0000 7fc109682640 1 -- 172.21.15.50:0/877753577 shutdown_connections 2024-09-11T22:11:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.447+0000 7fc109682640 1 -- 172.21.15.50:0/877753577 wait complete. 2024-09-11T22:11:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.448+0000 7fc109682640 1 Processor -- start 2024-09-11T22:11:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.448+0000 7fc109682640 1 -- start start 2024-09-11T22:11:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc109682640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0f0004390 0x7fc10414bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc109682640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10415d5b0 0x7fc10415da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc109682640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc104160610 0x7fc104160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc109682640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc1040d1c70 con 0x7fc0f0004390 2024-09-11T22:11:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc109682640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc1040d17e0 con 0x7fc10415d5b0 2024-09-11T22:11:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc109682640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc1040d1df0 con 0x7fc104160610 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc102ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0f0004390 0x7fc10414bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc102ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0f0004390 0x7fc10414bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38348/0 (socket says 172.21.15.50:38348) 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc102ffd640 1 -- 172.21.15.50:0/1146882369 learned_addr learned my addr 172.21.15.50:0/1146882369 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc1037fe640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc104160610 0x7fc104160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc1027fc640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10415d5b0 0x7fc10415da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc102ffd640 1 -- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc104160610 msgr2=0x7fc104160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc102ffd640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc104160610 0x7fc104160a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc102ffd640 1 -- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10415d5b0 msgr2=0x7fc10415da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc102ffd640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10415d5b0 0x7fc10415da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc102ffd640 1 -- 172.21.15.50:0/1146882369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1040b5950 con 0x7fc0f0004390 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc1027fc640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10415d5b0 0x7fc10415da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc1037fe640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc104160610 0x7fc104160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.449+0000 7fc102ffd640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0f0004390 0x7fc10414bb20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00f7c0 tx=0x7fc0fc00fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.450+0000 7fc0fb7fe640 1 -- 172.21.15.50:0/1146882369 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc0052e0 con 0x7fc0f0004390 2024-09-11T22:11:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.450+0000 7fc0fb7fe640 1 -- 172.21.15.50:0/1146882369 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0fc018070 con 0x7fc0f0004390 2024-09-11T22:11:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.450+0000 7fc109682640 1 -- 172.21.15.50:0/1146882369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1041613e0 con 0x7fc0f0004390 2024-09-11T22:11:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.450+0000 7fc0fb7fe640 1 -- 172.21.15.50:0/1146882369 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc00d970 con 0x7fc0f0004390 2024-09-11T22:11:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.450+0000 7fc109682640 1 -- 172.21.15.50:0/1146882369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1040c9c40 con 0x7fc0f0004390 2024-09-11T22:11:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.451+0000 7fc109682640 1 -- 172.21.15.50:0/1146882369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc10415df70 con 0x7fc0f0004390 2024-09-11T22:11:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.451+0000 7fc0fb7fe640 1 -- 172.21.15.50:0/1146882369 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0fc00db10 con 0x7fc0f0004390 2024-09-11T22:11:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.451+0000 7fc0fb7fe640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc0e406be30 0x7fc0e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.452+0000 7fc0fb7fe640 1 -- 172.21.15.50:0/1146882369 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc0fc08ae30 con 0x7fc0f0004390 2024-09-11T22:11:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.452+0000 7fc1027fc640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc0e406be30 0x7fc0e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.452+0000 7fc1027fc640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc0e406be30 0x7fc0e406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec009a90 tx=0x7fc0ec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:28.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.456+0000 7fc0fb7fe640 1 -- 172.21.15.50:0/1146882369 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1040b5950 con 0x7fc0f0004390 2024-09-11T22:11:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.670+0000 7fc109682640 1 -- 172.21.15.50:0/1146882369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1040b4d20 con 0x7fc0f0004390 2024-09-11T22:11:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.670+0000 7fc0fb7fe640 1 -- 172.21.15.50:0/1146882369 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5214 (secure 0 0 0) 0x7fc0fc01a310 con 0x7fc0f0004390 2024-09-11T22:11:28.671 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:28.671 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"btime":"2024-09-11T22:11:16:865918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2971042772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2971042772},{"type":"v1","addr":"172.21.15.77:6837","nonce":2971042772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/293208439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":293208439},{"type":"v1","addr":"172.21.15.77:6835","nonce":293208439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4087237334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4087237334},{"type":"v1","addr":"172.21.15.50:6834","nonce":4087237334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:11:14.221375+0000","modified":"2024-09-11T22:11:16.209817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2305531878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2305531878},{"type":"v1","addr":"172.21.15.50:6835","nonce":2305531878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-11T22:11:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2024-09-11T22:11:28.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.672+0000 7fc109682640 1 -- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc0e406be30 msgr2=0x7fc0e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.672+0000 7fc109682640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc0e406be30 0x7fc0e406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec009a90 tx=0x7fc0ec008030 comp rx=0 tx=0).stop 2024-09-11T22:11:28.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.672+0000 7fc109682640 1 -- 172.21.15.50:0/1146882369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0f0004390 msgr2=0x7fc10414bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.672+0000 7fc109682640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0f0004390 0x7fc10414bb20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00f7c0 tx=0x7fc0fc00fc80 comp rx=0 tx=0).stop 2024-09-11T22:11:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.672+0000 7fc109682640 1 -- 172.21.15.50:0/1146882369 shutdown_connections 2024-09-11T22:11:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.672+0000 7fc109682640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc0e406be30 0x7fc0e406e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.672+0000 7fc109682640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc104160610 0x7fc104160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.672+0000 7fc109682640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10415d5b0 0x7fc10415da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.672+0000 7fc109682640 1 --2- 172.21.15.50:0/1146882369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0f0004390 0x7fc10414bb20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.672+0000 7fc109682640 1 -- 172.21.15.50:0/1146882369 >> 172.21.15.50:0/1146882369 conn(0x7fc10409ba50 msgr2=0x7fc1040aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.672+0000 7fc109682640 1 -- 172.21.15.50:0/1146882369 shutdown_connections 2024-09-11T22:11:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:28.672+0000 7fc109682640 1 -- 172.21.15.50:0/1146882369 wait complete. 2024-09-11T22:11:29.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:11:14.221375+0000', 'modified': '2024-09-11T22:11:16.209817+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/2305531878', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6833', 'nonce': 2305531878}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 2305531878}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4284, 'qdb_cluster': [4284]} 2024-09-11T22:11:29.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:11:29.087 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T22:11:29.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.192+0000 7f98b200e640 1 Processor -- start 2024-09-11T22:11:29.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.192+0000 7f98b200e640 1 -- start start 2024-09-11T22:11:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.193+0000 7f98b200e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac0680d0 0x7f98ac15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.193+0000 7f98b200e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98ac15f7f0 con 0x7f98ac15c3c0 2024-09-11T22:11:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.193+0000 7f98b200e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98ac15fad0 con 0x7f98ac15f350 2024-09-11T22:11:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.193+0000 7f98b200e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f98ac06e700 con 0x7f98ac0680d0 2024-09-11T22:11:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.193+0000 7f98ab7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f98ac15c3c0 0x7f98ac15ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34722/0 (socket says 172.21.15.50:34722) 2024-09-11T22:11:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.193+0000 7f98ab7fe640 1 -- 172.21.15.50:0/2503438354 learned_addr learned my addr 172.21.15.50:0/2503438354 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.193+0000 7f98abfff640 1 --2- 172.21.15.50:0/2503438354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac0680d0 0x7f98ac15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.193+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 220966533 0 0) 0x7f98ac15f7f0 con 0x7f98ac15c3c0 2024-09-11T22:11:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.193+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9894003520 con 0x7f98ac15c3c0 2024-09-11T22:11:29.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.193+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3182900320 0 0) 0x7f98ac15fad0 con 0x7f98ac15f350 2024-09-11T22:11:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98ac15f7f0 con 0x7f98ac15f350 2024-09-11T22:11:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2761293252 0 0) 0x7f9894003520 con 0x7f98ac15c3c0 2024-09-11T22:11:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac0680d0 msgr2=0x7f98ac15fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 --2- 172.21.15.50:0/2503438354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac0680d0 0x7f98ac15fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 >> v1:172.21.15.77:6789/0 conn(0x7f98ac15f350 legacy=0x7f98ac0679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ac06e950 con 0x7f98ac15c3c0 2024-09-11T22:11:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98abfff640 1 --2- 172.21.15.50:0/2503438354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac0680d0 0x7f98ac15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f989c001670 con 0x7f98ac15c3c0 2024-09-11T22:11:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 >> v1:172.21.15.50:6789/0 conn(0x7f98ac15c3c0 legacy=0x7f98ac15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 --2- 172.21.15.50:0/2503438354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9894003b70 0x7f9894003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 --2- 172.21.15.50:0/2503438354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9894004800 0x7f9894004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 --2- 172.21.15.50:0/2503438354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac0680d0 0x7f98940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac06e700 con 0x7f9894004800 2024-09-11T22:11:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f989400baf0 con 0x7f9894003b70 2024-09-11T22:11:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f989400bcf0 con 0x7f98ac0680d0 2024-09-11T22:11:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aaffd640 1 --2- 172.21.15.50:0/2503438354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9894004800 0x7f9894004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/2503438354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9894003b70 0x7f9894003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98abfff640 1 --2- 172.21.15.50:0/2503438354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac0680d0 0x7f98940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aaffd640 1 -- 172.21.15.50:0/2503438354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac0680d0 msgr2=0x7f98940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aaffd640 1 --2- 172.21.15.50:0/2503438354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac0680d0 0x7f98940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aaffd640 1 -- 172.21.15.50:0/2503438354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9894003b70 msgr2=0x7f9894003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aaffd640 1 --2- 172.21.15.50:0/2503438354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9894003b70 0x7f9894003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.194+0000 7f98aaffd640 1 -- 172.21.15.50:0/2503438354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9894003520 con 0x7f9894004800 2024-09-11T22:11:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.195+0000 7f98aaffd640 1 --2- 172.21.15.50:0/2503438354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9894004800 0x7f9894004c80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f98a00018a0 tx=0x7f9894005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8cca1eac215d6f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.195+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a00014f0 con 0x7f9894004800 2024-09-11T22:11:29.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.195+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a00052d0 con 0x7f9894004800 2024-09-11T22:11:29.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.195+0000 7f98aa7fc640 1 -- 172.21.15.50:0/2503438354 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a002ac60 con 0x7f9894004800 2024-09-11T22:11:29.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.196+0000 7f98b200e640 1 -- 172.21.15.50:0/2503438354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9894004800 msgr2=0x7f9894004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.196+0000 7f98b200e640 1 --2- 172.21.15.50:0/2503438354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9894004800 0x7f9894004c80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f98a00018a0 tx=0x7f9894005830 comp rx=0 tx=0).stop 2024-09-11T22:11:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.196+0000 7f98abfff640 1 -- 172.21.15.50:0/2503438354 reap_dead start 2024-09-11T22:11:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.196+0000 7f98b200e640 1 -- 172.21.15.50:0/2503438354 shutdown_connections 2024-09-11T22:11:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.196+0000 7f98b200e640 1 -- 172.21.15.50:0/2503438354 >> 172.21.15.50:0/2503438354 conn(0x7f98ac075060 msgr2=0x7f98ac06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.196+0000 7f98b200e640 1 -- 172.21.15.50:0/2503438354 shutdown_connections 2024-09-11T22:11:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.196+0000 7f98b200e640 1 -- 172.21.15.50:0/2503438354 wait complete. 2024-09-11T22:11:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.197+0000 7f98b200e640 1 Processor -- start 2024-09-11T22:11:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.197+0000 7f98b200e640 1 -- start start 2024-09-11T22:11:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98b200e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9894004800 0x7f98ac1f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98b200e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac1542b0 0x7f98ac15d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98b200e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98ac15dd30 0x7f98ac1f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98b200e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac15fe60 con 0x7f9894004800 2024-09-11T22:11:29.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98b200e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac0d0940 con 0x7f98ac15dd30 2024-09-11T22:11:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98b200e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f98ac15ffe0 con 0x7f98ac1542b0 2024-09-11T22:11:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98ab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9894004800 0x7f98ac1f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98ab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9894004800 0x7f98ac1f4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38368/0 (socket says 172.21.15.50:38368) 2024-09-11T22:11:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98ab7fe640 1 -- 172.21.15.50:0/1878802554 learned_addr learned my addr 172.21.15.50:0/1878802554 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98aaffd640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac1542b0 0x7f98ac15d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98abfff640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98ac15dd30 0x7f98ac1f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98ab7fe640 1 -- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac1542b0 msgr2=0x7f98ac15d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac1542b0 0x7f98ac15d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98ab7fe640 1 -- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98ac15dd30 msgr2=0x7f98ac1f7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98ac15dd30 0x7f98ac1f7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98ab7fe640 1 -- 172.21.15.50:0/1878802554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ac155a30 con 0x7f9894004800 2024-09-11T22:11:29.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98aaffd640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac1542b0 0x7f98ac15d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98abfff640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98ac15dd30 0x7f98ac1f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9894004800 0x7f98ac1f4b10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f989c0017e0 tx=0x7f989c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f9893fff640 1 -- 172.21.15.50:0/1878802554 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c00f750 con 0x7f9894004800 2024-09-11T22:11:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f9893fff640 1 -- 172.21.15.50:0/1878802554 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989c018070 con 0x7f9894004800 2024-09-11T22:11:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f9893fff640 1 -- 172.21.15.50:0/1878802554 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c00fb50 con 0x7f9894004800 2024-09-11T22:11:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98b200e640 1 -- 172.21.15.50:0/1878802554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98ac154e20 con 0x7f9894004800 2024-09-11T22:11:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.198+0000 7f98b200e640 1 -- 172.21.15.50:0/1878802554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98ac1553e0 con 0x7f9894004800 2024-09-11T22:11:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.200+0000 7f9893fff640 1 -- 172.21.15.50:0/1878802554 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f989c00fcf0 con 0x7f9894004800 2024-09-11T22:11:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.200+0000 7f9893fff640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f989806be30 0x7f989806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.201+0000 7f9893fff640 1 -- 172.21.15.50:0/1878802554 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f989c08ae00 con 0x7f9894004800 2024-09-11T22:11:29.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.201+0000 7f98aaffd640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f989806be30 0x7f989806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.201+0000 7f98aaffd640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f989806be30 0x7f989806e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f98a0032000 tx=0x7f98a0009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.201+0000 7f98b4e85740 1 Processor -- start 2024-09-11T22:11:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.201+0000 7f98b4e85740 1 -- start start 2024-09-11T22:11:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.202+0000 7f98b4e85740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 0x55570f995a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.202+0000 7f98b4e85740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f94da80 0x55570f9506a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.202+0000 7f98b4e85740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f951a50 0x55570f94a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.202+0000 7f98b4e85740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55570f8b2520 con 0x55570f9502c0 2024-09-11T22:11:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.202+0000 7f98b4e85740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55570f85a3e0 con 0x55570f94da80 2024-09-11T22:11:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.202+0000 7f98b4e85740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55570f8ae4e0 con 0x55570f951a50 2024-09-11T22:11:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.202+0000 7f98ab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 0x55570f995a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.202+0000 7f98ab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 0x55570f995a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38380/0 (socket says 172.21.15.50:38380) 2024-09-11T22:11:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.202+0000 7f98ab7fe640 1 -- 172.21.15.50:0/2603224694 learned_addr learned my addr 172.21.15.50:0/2603224694 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.203+0000 7f98aaffd640 1 --2- 172.21.15.50:0/2603224694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f94da80 0x55570f9506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.203+0000 7f98abfff640 1 --2- 172.21.15.50:0/2603224694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f951a50 0x55570f94a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.203+0000 7f98ab7fe640 1 -- 172.21.15.50:0/2603224694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f951a50 msgr2=0x55570f94a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.203+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/2603224694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f951a50 0x55570f94a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.203+0000 7f98ab7fe640 1 -- 172.21.15.50:0/2603224694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f94da80 msgr2=0x55570f9506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.203+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/2603224694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f94da80 0x55570f9506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.203+0000 7f98ab7fe640 1 -- 172.21.15.50:0/2603224694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55570f8752f0 con 0x55570f9502c0 2024-09-11T22:11:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.203+0000 7f98abfff640 1 --2- 172.21.15.50:0/2603224694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f951a50 0x55570f94a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.203+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/2603224694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 0x55570f995a60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f989c089270 tx=0x7f989c0598f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e4fcf3c3a36692 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.203+0000 7f98917fa640 1 -- 172.21.15.50:0/2603224694 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c0710d0 con 0x55570f9502c0 2024-09-11T22:11:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.203+0000 7f98917fa640 1 -- 172.21.15.50:0/2603224694 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989c061c90 con 0x55570f9502c0 2024-09-11T22:11:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.203+0000 7f98917fa640 1 -- 172.21.15.50:0/2603224694 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c05d0e0 con 0x55570f9502c0 2024-09-11T22:11:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.204+0000 7f98b4e85740 1 -- 172.21.15.50:0/2603224694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 msgr2=0x55570f995a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.204+0000 7f98b4e85740 1 --2- 172.21.15.50:0/2603224694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 0x55570f995a60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f989c089270 tx=0x7f989c0598f0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.204+0000 7f98b4e85740 1 -- 172.21.15.50:0/2603224694 shutdown_connections 2024-09-11T22:11:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.204+0000 7f98b4e85740 1 --2- 172.21.15.50:0/2603224694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f951a50 0x55570f94a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.204+0000 7f98b4e85740 1 --2- 172.21.15.50:0/2603224694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f94da80 0x55570f9506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.204+0000 7f98b4e85740 1 --2- 172.21.15.50:0/2603224694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 0x55570f995a60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.204+0000 7f98b4e85740 1 -- 172.21.15.50:0/2603224694 >> 172.21.15.50:0/2603224694 conn(0x55570f94ca80 msgr2=0x55570f994f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.204+0000 7f98b4e85740 1 -- 172.21.15.50:0/2603224694 shutdown_connections 2024-09-11T22:11:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.204+0000 7f98b4e85740 1 -- 172.21.15.50:0/2603224694 wait complete. 2024-09-11T22:11:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.204+0000 7f98b4e85740 1 -- start start 2024-09-11T22:11:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.205+0000 7f98b4e85740 1 Processor -- start 2024-09-11T22:11:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.205+0000 7f98b4e85740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f9502c0 0x55570f94b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.205+0000 7f98b4e85740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f951a50 0x55570f96b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.205+0000 7f98b4e85740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f977dc0 0x55570f976260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.205+0000 7f98b4e85740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55570f94bf20 con 0x55570f951a50 2024-09-11T22:11:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.205+0000 7f98b4e85740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55570f83b450 con 0x55570f9502c0 2024-09-11T22:11:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.205+0000 7f98b4e85740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55570f996290 con 0x55570f977dc0 2024-09-11T22:11:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.205+0000 7f98aaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f951a50 0x55570f96b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.205+0000 7f98b4e85740 10 client.0 _ll_register_callbacks cb 0x55570f5c4ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.205+0000 7f98aaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f951a50 0x55570f96b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38382/0 (socket says 172.21.15.50:38382) 2024-09-11T22:11:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.205+0000 7f98aaffd640 1 -- 172.21.15.50:0/166348964 learned_addr learned my addr 172.21.15.50:0/166348964 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/166348964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f9502c0 0x55570f94b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f98abfff640 1 --2- 172.21.15.50:0/166348964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f977dc0 0x55570f976260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f98aaffd640 1 -- 172.21.15.50:0/166348964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f977dc0 msgr2=0x55570f976260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f98aaffd640 1 --2- 172.21.15.50:0/166348964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f977dc0 0x55570f976260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f98aaffd640 1 -- 172.21.15.50:0/166348964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f9502c0 msgr2=0x55570f94b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f98aaffd640 1 --2- 172.21.15.50:0/166348964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f9502c0 0x55570f94b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f98aaffd640 1 -- 172.21.15.50:0/166348964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55570f5c52d0 con 0x55570f951a50 2024-09-11T22:11:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f98aaffd640 1 --2- 172.21.15.50:0/166348964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f951a50 0x55570f96b6f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f98a0005040 tx=0x7f98a002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4041b81f34385e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f988a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:11:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f988a7fc640 1 -- 172.21.15.50:0/166348964 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0050060 con 0x55570f951a50 2024-09-11T22:11:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f988a7fc640 1 -- 172.21.15.50:0/166348964 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f98a0006c60 con 0x55570f951a50 2024-09-11T22:11:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f98b4e85740 1 -- 172.21.15.50:0/166348964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f989c061c90 con 0x55570f951a50 2024-09-11T22:11:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f988a7fc640 1 -- 172.21.15.50:0/166348964 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f98a0056050 con 0x55570f951a50 2024-09-11T22:11:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f98b4e85740 10 client.4608 fetch_fsmap learned FSMap version 6 2024-09-11T22:11:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f98b4e85740 1 -- 172.21.15.50:0/166348964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55570f68f6b0 con 0x55570f951a50 2024-09-11T22:11:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f988a7fc640 1 -- 172.21.15.50:0/166348964 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989c061c90 con 0x55570f951a50 2024-09-11T22:11:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.206+0000 7f988a7fc640 1 -- 172.21.15.50:0/166348964 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f98a0059020 con 0x55570f951a50 2024-09-11T22:11:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.207+0000 7f98b4e85740 10 client.4608 fetch_fsmap finished waiting for FSMap version 6 2024-09-11T22:11:29.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.207+0000 7f98b4e85740 10 client.4608 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:11:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.207+0000 7f98b4e85740 20 client.4608 populate_metadata read hostname 'smithi050' 2024-09-11T22:11:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.207+0000 7f98b4e85740 1 --2- 172.21.15.50:0/166348964 >> [v2:172.21.15.50:6833/2305531878,v1:172.21.15.50:6835/2305531878] conn(0x55570f96f760 0x55570f949950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.207+0000 7f98b4e85740 4 client.4608 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:11:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.207+0000 7f98b4e85740 1 -- 172.21.15.50:0/166348964 --> [v2:172.21.15.50:6833/2305531878,v1:172.21.15.50:6835/2305531878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55570f8bfc50 con 0x55570f96f760 2024-09-11T22:11:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.207+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/166348964 >> [v2:172.21.15.50:6833/2305531878,v1:172.21.15.50:6835/2305531878] conn(0x55570f96f760 0x55570f949950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.207+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/166348964 >> [v2:172.21.15.50:6833/2305531878,v1:172.21.15.50:6835/2305531878] conn(0x55570f96f760 0x55570f949950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adba7f45270bd856 server_cookie=86dda97869cdfc37 in_seq=0 out_seq=0 2024-09-11T22:11:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.207+0000 7f988a7fc640 10 client.4608 ms_handle_connect on v2:172.21.15.50:6833/2305531878 2024-09-11T22:11:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f988a7fc640 1 -- 172.21.15.50:0/166348964 <== mds.0 v2:172.21.15.50:6833/2305531878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55570f8bfc50 con 0x55570f96f760 2024-09-11T22:11:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f988a7fc640 10 client.4608 handle_command_reply: tid=0 2024-09-11T22:11:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f98b4e85740 1 client.4608 shutdown 2024-09-11T22:11:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f98b4e85740 1 -- 172.21.15.50:0/166348964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f951a50 msgr2=0x55570f96b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f98b4e85740 1 --2- 172.21.15.50:0/166348964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f951a50 0x55570f96b6f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f98a0005040 tx=0x7f98a002c070 comp rx=0 tx=0).stop 2024-09-11T22:11:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f98b4e85740 1 -- 172.21.15.50:0/166348964 shutdown_connections 2024-09-11T22:11:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f98b4e85740 1 --2- 172.21.15.50:0/166348964 >> [v2:172.21.15.50:6833/2305531878,v1:172.21.15.50:6835/2305531878] conn(0x55570f96f760 0x55570f949950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f98b4e85740 1 --2- 172.21.15.50:0/166348964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f977dc0 0x55570f976260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f988a7fc640 0 client.4608 ms_handle_reset on v2:172.21.15.50:6833/2305531878 2024-09-11T22:11:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f98b4e85740 1 --2- 172.21.15.50:0/166348964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f951a50 0x55570f96b6f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f98b4e85740 1 --2- 172.21.15.50:0/166348964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f9502c0 0x55570f94b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f98b4e85740 1 -- 172.21.15.50:0/166348964 >> 172.21.15.50:0/166348964 conn(0x55570f94da80 msgr2=0x55570f994490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f98b4e85740 1 -- 172.21.15.50:0/166348964 shutdown_connections 2024-09-11T22:11:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f98b4e85740 1 -- 172.21.15.50:0/166348964 wait complete. 2024-09-11T22:11:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.208+0000 7f98b4e85740 20 client.4608 trim_cache size 0 max 16384 2024-09-11T22:11:29.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.226+0000 7f98b4e85740 1 Processor -- start 2024-09-11T22:11:29.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.226+0000 7f98b4e85740 1 -- start start 2024-09-11T22:11:29.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98b4e85740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 0x55570f98ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98b4e85740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f951a50 0x55570f992fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98b4e85740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f977dc0 0x55570f9934f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98b4e85740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac200350 con 0x55570f9502c0 2024-09-11T22:11:29.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98b4e85740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac0ce850 con 0x55570f951a50 2024-09-11T22:11:29.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98b4e85740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f98ac1ffd00 con 0x55570f977dc0 2024-09-11T22:11:29.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98ab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 0x55570f98ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98ab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 0x55570f98ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38384/0 (socket says 172.21.15.50:38384) 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98ab7fe640 1 -- 172.21.15.50:0/3783873431 learned_addr learned my addr 172.21.15.50:0/3783873431 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98aaffd640 1 --2- 172.21.15.50:0/3783873431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f951a50 0x55570f992fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98abfff640 1 --2- 172.21.15.50:0/3783873431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f977dc0 0x55570f9934f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98ab7fe640 1 -- 172.21.15.50:0/3783873431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f977dc0 msgr2=0x55570f9934f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/3783873431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f977dc0 0x55570f9934f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98ab7fe640 1 -- 172.21.15.50:0/3783873431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f951a50 msgr2=0x55570f992fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/3783873431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f951a50 0x55570f992fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98ab7fe640 1 -- 172.21.15.50:0/3783873431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55570f977370 con 0x55570f9502c0 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98aaffd640 1 --2- 172.21.15.50:0/3783873431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f951a50 0x55570f992fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.227+0000 7f98abfff640 1 --2- 172.21.15.50:0/3783873431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f977dc0 0x55570f9934f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.228+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/3783873431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 0x55570f98ee00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f989c059270 tx=0x7f989c05d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d7b487e5bf8743 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.228+0000 7f9890ff9640 1 -- 172.21.15.50:0/3783873431 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c061c90 con 0x55570f9502c0 2024-09-11T22:11:29.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.228+0000 7f9890ff9640 1 -- 172.21.15.50:0/3783873431 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989c086070 con 0x55570f9502c0 2024-09-11T22:11:29.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.228+0000 7f9890ff9640 1 -- 172.21.15.50:0/3783873431 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c05d0e0 con 0x55570f9502c0 2024-09-11T22:11:29.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.228+0000 7f98b4e85740 1 -- 172.21.15.50:0/3783873431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 msgr2=0x55570f98ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.228+0000 7f98b4e85740 1 --2- 172.21.15.50:0/3783873431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 0x55570f98ee00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f989c059270 tx=0x7f989c05d000 comp rx=0 tx=0).stop 2024-09-11T22:11:29.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.228+0000 7f98b4e85740 1 -- 172.21.15.50:0/3783873431 shutdown_connections 2024-09-11T22:11:29.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.228+0000 7f98b4e85740 1 --2- 172.21.15.50:0/3783873431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f977dc0 0x55570f9934f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.228+0000 7f98b4e85740 1 --2- 172.21.15.50:0/3783873431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f951a50 0x55570f992fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.228+0000 7f98b4e85740 1 --2- 172.21.15.50:0/3783873431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f9502c0 0x55570f98ee00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.228+0000 7f98b4e85740 1 -- 172.21.15.50:0/3783873431 >> 172.21.15.50:0/3783873431 conn(0x55570f94da80 msgr2=0x55570f9a44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:29.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.228+0000 7f98b4e85740 1 -- 172.21.15.50:0/3783873431 shutdown_connections 2024-09-11T22:11:29.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.228+0000 7f98b4e85740 1 -- 172.21.15.50:0/3783873431 wait complete. 2024-09-11T22:11:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.229+0000 7f98b4e85740 1 -- start start 2024-09-11T22:11:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.229+0000 7f98b4e85740 1 Processor -- start 2024-09-11T22:11:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98b4e85740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f9502c0 0x55570f96ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98b4e85740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f951a50 0x55570f9f97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98b4e85740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f977dc0 0x55570f992fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98b4e85740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55570f9a9420 con 0x55570f977dc0 2024-09-11T22:11:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98b4e85740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55570f9a8e70 con 0x55570f951a50 2024-09-11T22:11:29.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98b4e85740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55570f96fbb0 con 0x55570f9502c0 2024-09-11T22:11:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98b4e85740 10 client.0 _ll_register_callbacks cb 0x7f9894003880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:11:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98abfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f977dc0 0x55570f992fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98abfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f977dc0 0x55570f992fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38386/0 (socket says 172.21.15.50:38386) 2024-09-11T22:11:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98abfff640 1 -- 172.21.15.50:0/1522919947 learned_addr learned my addr 172.21.15.50:0/1522919947 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/1522919947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f9502c0 0x55570f96ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98aaffd640 1 --2- 172.21.15.50:0/1522919947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f951a50 0x55570f9f97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98abfff640 1 -- 172.21.15.50:0/1522919947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f9502c0 msgr2=0x55570f96ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98abfff640 1 --2- 172.21.15.50:0/1522919947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f9502c0 0x55570f96ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98abfff640 1 -- 172.21.15.50:0/1522919947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f951a50 msgr2=0x55570f9f97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98abfff640 1 --2- 172.21.15.50:0/1522919947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f951a50 0x55570f9f97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98abfff640 1 -- 172.21.15.50:0/1522919947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55570f98f340 con 0x55570f977dc0 2024-09-11T22:11:29.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f98abfff640 1 --2- 172.21.15.50:0/1522919947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f977dc0 0x55570f992fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f98a4019e20 tx=0x7f98a4017780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdab5c4223c257e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f988a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:11:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.230+0000 7f988a7fc640 1 -- 172.21.15.50:0/1522919947 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4003b90 con 0x55570f977dc0 2024-09-11T22:11:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f988a7fc640 1 -- 172.21.15.50:0/1522919947 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f98a4003d30 con 0x55570f977dc0 2024-09-11T22:11:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f98b4e85740 1 -- 172.21.15.50:0/1522919947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f989c086070 con 0x55570f977dc0 2024-09-11T22:11:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f988a7fc640 1 -- 172.21.15.50:0/1522919947 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f98a4004030 con 0x55570f977dc0 2024-09-11T22:11:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f98b4e85740 10 client.4614 fetch_fsmap learned FSMap version 6 2024-09-11T22:11:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f98b4e85740 1 -- 172.21.15.50:0/1522919947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55570f9f9cf0 con 0x55570f977dc0 2024-09-11T22:11:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f988a7fc640 1 -- 172.21.15.50:0/1522919947 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989c086070 con 0x55570f977dc0 2024-09-11T22:11:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f988a7fc640 1 -- 172.21.15.50:0/1522919947 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f98a402a050 con 0x55570f977dc0 2024-09-11T22:11:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f98b4e85740 10 client.4614 fetch_fsmap finished waiting for FSMap version 6 2024-09-11T22:11:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f98b4e85740 10 client.4614 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:11:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f98b4e85740 20 client.4614 populate_metadata read hostname 'smithi050' 2024-09-11T22:11:29.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f98b4e85740 1 --2- 172.21.15.50:0/1522919947 >> [v2:172.21.15.50:6833/2305531878,v1:172.21.15.50:6835/2305531878] conn(0x55570f96e6b0 0x55570fa13a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f98b4e85740 4 client.4614 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:11:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f98b4e85740 1 -- 172.21.15.50:0/1522919947 --> [v2:172.21.15.50:6833/2305531878,v1:172.21.15.50:6835/2305531878] -- command(tid 0: {"prefix": "status"}) -- 0x55570f8b9fa0 con 0x55570f96e6b0 2024-09-11T22:11:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/1522919947 >> [v2:172.21.15.50:6833/2305531878,v1:172.21.15.50:6835/2305531878] conn(0x55570f96e6b0 0x55570fa13a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f988a7fc640 10 client.4614 ms_handle_connect on v2:172.21.15.50:6833/2305531878 2024-09-11T22:11:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.231+0000 7f98ab7fe640 1 --2- 172.21.15.50:0/1522919947 >> [v2:172.21.15.50:6833/2305531878,v1:172.21.15.50:6835/2305531878] conn(0x55570f96e6b0 0x55570fa13a90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=785a2769ec3c6656 server_cookie=cd4fc03a286ea1da in_seq=0 out_seq=0 2024-09-11T22:11:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f988a7fc640 1 -- 172.21.15.50:0/1522919947 <== mds.0 v2:172.21.15.50:6833/2305531878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55570f8b9fa0 con 0x55570f96e6b0 2024-09-11T22:11:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f988a7fc640 10 client.4614 handle_command_reply: tid=0 2024-09-11T22:11:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b4e85740 1 client.4614 shutdown 2024-09-11T22:11:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b4e85740 1 -- 172.21.15.50:0/1522919947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f977dc0 msgr2=0x55570f992fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b4e85740 1 --2- 172.21.15.50:0/1522919947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f977dc0 0x55570f992fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f98a4019e20 tx=0x7f98a4017780 comp rx=0 tx=0).stop 2024-09-11T22:11:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b4e85740 1 -- 172.21.15.50:0/1522919947 shutdown_connections 2024-09-11T22:11:29.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b4e85740 1 --2- 172.21.15.50:0/1522919947 >> [v2:172.21.15.50:6833/2305531878,v1:172.21.15.50:6835/2305531878] conn(0x55570f96e6b0 0x55570fa13a90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b4e85740 1 --2- 172.21.15.50:0/1522919947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55570f977dc0 0x55570f992fb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f988a7fc640 0 client.4614 ms_handle_reset on v2:172.21.15.50:6833/2305531878 2024-09-11T22:11:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b4e85740 1 --2- 172.21.15.50:0/1522919947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55570f951a50 0x55570f9f97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b4e85740 1 --2- 172.21.15.50:0/1522919947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55570f9502c0 0x55570f96ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b4e85740 1 -- 172.21.15.50:0/1522919947 >> 172.21.15.50:0/1522919947 conn(0x55570f94da80 msgr2=0x55570f96b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b4e85740 1 -- 172.21.15.50:0/1522919947 shutdown_connections 2024-09-11T22:11:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b4e85740 1 -- 172.21.15.50:0/1522919947 wait complete. 2024-09-11T22:11:29.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b4e85740 20 client.4614 trim_cache size 0 max 16384 2024-09-11T22:11:29.240 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:11:29.241 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:11:29.241 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:11:29.241 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4284, 2024-09-11T22:11:29.241 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:11:29.241 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:11:29.241 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:11:29.241 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 14.378917095, 2024-09-11T22:11:29.241 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 6, 2024-09-11T22:11:29.241 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 21, 2024-09-11T22:11:29.241 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 21, 2024-09-11T22:11:29.241 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 20.401518114999998 2024-09-11T22:11:29.241 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:11:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b200e640 1 -- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f989806be30 msgr2=0x7f989806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b200e640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f989806be30 0x7f989806e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f98a0032000 tx=0x7f98a0009030 comp rx=0 tx=0).stop 2024-09-11T22:11:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b200e640 1 -- 172.21.15.50:0/1878802554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9894004800 msgr2=0x7f98ac1f4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b200e640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9894004800 0x7f98ac1f4b10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f989c0017e0 tx=0x7f989c007430 comp rx=0 tx=0).stop 2024-09-11T22:11:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b200e640 1 -- 172.21.15.50:0/1878802554 shutdown_connections 2024-09-11T22:11:29.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b200e640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f989806be30 0x7f989806e2f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b200e640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ac1542b0 0x7f98ac15d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b200e640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98ac15dd30 0x7f98ac1f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b200e640 1 --2- 172.21.15.50:0/1878802554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9894004800 0x7f98ac1f4b10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.232+0000 7f98b200e640 1 -- 172.21.15.50:0/1878802554 >> 172.21.15.50:0/1878802554 conn(0x7f98ac075060 msgr2=0x7f98ac15b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:29.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.233+0000 7f98b200e640 1 -- 172.21.15.50:0/1878802554 shutdown_connections 2024-09-11T22:11:29.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.233+0000 7f98b200e640 1 -- 172.21.15.50:0/1878802554 wait complete. 2024-09-11T22:11:29.244 INFO:teuthology.run_tasks:Running task sequential... 2024-09-11T22:11:29.253 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-11T22:11:29.253 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-11T22:11:29.254 INFO:teuthology.task.print:Enabling mgr modules 2024-09-11T22:11:29.254 INFO:teuthology.run_tasks:Running task kclient... 2024-09-11T22:11:29.287 INFO:tasks.kclient:Mounting kernel clients... 2024-09-11T22:11:29.287 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-11T22:11:29.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:29.287 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:11:29.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:29.304 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-09-11T22:11:29.371 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2024-09-11T22:11:29.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:11:29.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:29.373 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:11:29.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:29.430 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-09-11T22:11:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2024-09-11T22:11:29.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:11:29.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:29.499 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-11T22:11:29.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:29.518 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-09-11T22:11:29.590 INFO:teuthology.orchestra.run.smithi077.stderr:Cannot find device "ceph-brx" 2024-09-11T22:11:29.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:11:29.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:29.592 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-11T22:11:29.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:29.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-09-11T22:11:29.718 INFO:teuthology.orchestra.run.smithi077.stderr:Cannot find device "ceph-brx" 2024-09-11T22:11:29.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:11:29.720 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-11T22:11:29.720 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T22:11:29.720 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:11:29.721 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:11:29.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.823+0000 7fcb98b9f640 1 Processor -- start 2024-09-11T22:11:29.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.823+0000 7fcb98b9f640 1 -- start start 2024-09-11T22:11:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.824+0000 7fcb98b9f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9415c2c0 0x7fcb940b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.824+0000 7fcb98b9f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcb940d05e0 0x7fcb940ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.824+0000 7fcb98b9f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb940b4f00 con 0x7fcb940b3e10 2024-09-11T22:11:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.824+0000 7fcb98b9f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcb940b4360 con 0x7fcb940d05e0 2024-09-11T22:11:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.824+0000 7fcb98b9f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcb940b51c0 con 0x7fcb9415c2c0 2024-09-11T22:11:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.824+0000 7fcb91d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcb940b3e10 0x7fcb940cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34724/0 (socket says 172.21.15.50:34724) 2024-09-11T22:11:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.824+0000 7fcb91d9b640 1 -- 172.21.15.50:0/3007380012 learned_addr learned my addr 172.21.15.50:0/3007380012 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.824+0000 7fcb9259c640 1 --2- 172.21.15.50:0/3007380012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9415c2c0 0x7fcb940b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.824+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1923674111 0 0) 0x7fcb940b4f00 con 0x7fcb940b3e10 2024-09-11T22:11:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.824+0000 7fcb92d9d640 1 --2- 172.21.15.50:0/3007380012 >> v2:172.21.15.77:3300/0 conn(0x7fcb940d05e0 0x7fcb940ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.824+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb80003520 con 0x7fcb940b3e10 2024-09-11T22:11:29.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2507284991 0 0) 0x7fcb80003520 con 0x7fcb940b3e10 2024-09-11T22:11:29.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9415c2c0 msgr2=0x7fcb940b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 --2- 172.21.15.50:0/3007380012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9415c2c0 0x7fcb940b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 >> v2:172.21.15.77:3300/0 conn(0x7fcb940d05e0 msgr2=0x7fcb940ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 --2- 172.21.15.50:0/3007380012 >> v2:172.21.15.77:3300/0 conn(0x7fcb940d05e0 0x7fcb940ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb940b54a0 con 0x7fcb940b3e10 2024-09-11T22:11:29.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fcb7c001670 con 0x7fcb940b3e10 2024-09-11T22:11:29.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 >> v1:172.21.15.50:6789/0 conn(0x7fcb940b3e10 legacy=0x7fcb940cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 --2- 172.21.15.50:0/3007380012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9415c2c0 0x7fcb800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 --2- 172.21.15.50:0/3007380012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb80003f30 0x7fcb80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 --2- 172.21.15.50:0/3007380012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb80004d40 0x7fcb800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb940b4360 con 0x7fcb80004d40 2024-09-11T22:11:29.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb940b51c0 con 0x7fcb80003f30 2024-09-11T22:11:29.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcb8000ba10 con 0x7fcb9415c2c0 2024-09-11T22:11:29.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb92d9d640 1 --2- 172.21.15.50:0/3007380012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb80004d40 0x7fcb800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb9259c640 1 --2- 172.21.15.50:0/3007380012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9415c2c0 0x7fcb800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb91d9b640 1 --2- 172.21.15.50:0/3007380012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb80003f30 0x7fcb80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb92d9d640 1 -- 172.21.15.50:0/3007380012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9415c2c0 msgr2=0x7fcb800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb92d9d640 1 --2- 172.21.15.50:0/3007380012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9415c2c0 0x7fcb800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb92d9d640 1 -- 172.21.15.50:0/3007380012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb80003f30 msgr2=0x7fcb80004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:29.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb92d9d640 1 --2- 172.21.15.50:0/3007380012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb80003f30 0x7fcb80004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.825+0000 7fcb92d9d640 1 -- 172.21.15.50:0/3007380012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb80003520 con 0x7fcb80004d40 2024-09-11T22:11:29.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.826+0000 7fcb92d9d640 1 --2- 172.21.15.50:0/3007380012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb80004d40 0x7fcb800051c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400e170 tx=0x7fcb80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42d57b248fe771b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:29.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.826+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84034020 con 0x7fcb80004d40 2024-09-11T22:11:29.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.826+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb84030430 con 0x7fcb80004d40 2024-09-11T22:11:29.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.826+0000 7fcb9159a640 1 -- 172.21.15.50:0/3007380012 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84009c10 con 0x7fcb80004d40 2024-09-11T22:11:29.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.827+0000 7fcb98b9f640 1 -- 172.21.15.50:0/3007380012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb80004d40 msgr2=0x7fcb800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.827+0000 7fcb98b9f640 1 --2- 172.21.15.50:0/3007380012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb80004d40 0x7fcb800051c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400e170 tx=0x7fcb80005830 comp rx=0 tx=0).stop 2024-09-11T22:11:29.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.827+0000 7fcb92d9d640 1 -- 172.21.15.50:0/3007380012 reap_dead start 2024-09-11T22:11:29.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.827+0000 7fcb98b9f640 1 -- 172.21.15.50:0/3007380012 shutdown_connections 2024-09-11T22:11:29.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.827+0000 7fcb98b9f640 1 -- 172.21.15.50:0/3007380012 >> 172.21.15.50:0/3007380012 conn(0x7fcb940679c0 msgr2=0x7fcb94067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:29.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.827+0000 7fcb98b9f640 1 -- 172.21.15.50:0/3007380012 shutdown_connections 2024-09-11T22:11:29.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.827+0000 7fcb98b9f640 1 -- 172.21.15.50:0/3007380012 wait complete. 2024-09-11T22:11:29.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.828+0000 7fcb98b9f640 1 Processor -- start 2024-09-11T22:11:29.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.828+0000 7fcb98b9f640 1 -- start start 2024-09-11T22:11:29.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb98b9f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb80004d40 0x7fcb9413fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb98b9f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9414d340 0x7fcb9414d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb98b9f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb94159760 0x7fcb94159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb98b9f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9406d070 con 0x7fcb80004d40 2024-09-11T22:11:29.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb98b9f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb940ce200 con 0x7fcb94159760 2024-09-11T22:11:29.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb98b9f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcb9406d1f0 con 0x7fcb9414d340 2024-09-11T22:11:29.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb9259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb80004d40 0x7fcb9413fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb9259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb80004d40 0x7fcb9413fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38410/0 (socket says 172.21.15.50:38410) 2024-09-11T22:11:29.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb9259c640 1 -- 172.21.15.50:0/2999027401 learned_addr learned my addr 172.21.15.50:0/2999027401 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:29.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb91d9b640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9414d340 0x7fcb9414d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb92d9d640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb94159760 0x7fcb94159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb9259c640 1 -- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9414d340 msgr2=0x7fcb9414d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb9259c640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9414d340 0x7fcb9414d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb9259c640 1 -- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb94159760 msgr2=0x7fcb94159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:29.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb9259c640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb94159760 0x7fcb94159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:29.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb9259c640 1 -- 172.21.15.50:0/2999027401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9415a470 con 0x7fcb80004d40 2024-09-11T22:11:29.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb92d9d640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb94159760 0x7fcb94159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:29.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.829+0000 7fcb9259c640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb80004d40 0x7fcb9413fc20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0119a0 tx=0x7fcb8c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:29.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.830+0000 7fcb8affd640 1 -- 172.21.15.50:0/2999027401 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00faf0 con 0x7fcb80004d40 2024-09-11T22:11:29.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.830+0000 7fcb8affd640 1 -- 172.21.15.50:0/2999027401 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb8c00fc90 con 0x7fcb80004d40 2024-09-11T22:11:29.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.830+0000 7fcb8affd640 1 -- 172.21.15.50:0/2999027401 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c014440 con 0x7fcb80004d40 2024-09-11T22:11:29.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.830+0000 7fcb98b9f640 1 -- 172.21.15.50:0/2999027401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb9415a750 con 0x7fcb80004d40 2024-09-11T22:11:29.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.830+0000 7fcb98b9f640 1 -- 172.21.15.50:0/2999027401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb9415ad10 con 0x7fcb80004d40 2024-09-11T22:11:29.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.831+0000 7fcb98b9f640 1 -- 172.21.15.50:0/2999027401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb94075770 con 0x7fcb80004d40 2024-09-11T22:11:29.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.831+0000 7fcb8affd640 1 -- 172.21.15.50:0/2999027401 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb8c012040 con 0x7fcb80004d40 2024-09-11T22:11:29.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.832+0000 7fcb8affd640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb7406be30 0x7fcb7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:29.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.832+0000 7fcb8affd640 1 -- 172.21.15.50:0/2999027401 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcb8c08b540 con 0x7fcb80004d40 2024-09-11T22:11:29.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.832+0000 7fcb91d9b640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb7406be30 0x7fcb7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:29.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.832+0000 7fcb91d9b640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb7406be30 0x7fcb7406e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c001050 tx=0x7fcb7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:29.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:29.836+0000 7fcb8affd640 1 -- 172.21.15.50:0/2999027401 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb8c019030 con 0x7fcb80004d40 2024-09-11T22:11:30.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.046+0000 7fcb98b9f640 1 -- 172.21.15.50:0/2999027401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcb940b2a60 con 0x7fcb80004d40 2024-09-11T22:11:30.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.046+0000 7fcb8affd640 1 -- 172.21.15.50:0/2999027401 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fcb8c059ef0 con 0x7fcb80004d40 2024-09-11T22:11:30.049 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:11:30.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.048+0000 7fcb98b9f640 1 -- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb7406be30 msgr2=0x7fcb7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:30.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.048+0000 7fcb98b9f640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb7406be30 0x7fcb7406e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c001050 tx=0x7fcb7c009040 comp rx=0 tx=0).stop 2024-09-11T22:11:30.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.048+0000 7fcb98b9f640 1 -- 172.21.15.50:0/2999027401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb80004d40 msgr2=0x7fcb9413fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:30.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.048+0000 7fcb98b9f640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb80004d40 0x7fcb9413fc20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0119a0 tx=0x7fcb8c011e60 comp rx=0 tx=0).stop 2024-09-11T22:11:30.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.048+0000 7fcb98b9f640 1 -- 172.21.15.50:0/2999027401 shutdown_connections 2024-09-11T22:11:30.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.048+0000 7fcb98b9f640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb7406be30 0x7fcb7406e2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:30.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.048+0000 7fcb98b9f640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9414d340 0x7fcb9414d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:30.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.048+0000 7fcb98b9f640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb94159760 0x7fcb94159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:30.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.048+0000 7fcb98b9f640 1 --2- 172.21.15.50:0/2999027401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb80004d40 0x7fcb9413fc20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:30.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.048+0000 7fcb98b9f640 1 -- 172.21.15.50:0/2999027401 >> 172.21.15.50:0/2999027401 conn(0x7fcb940679c0 msgr2=0x7fcb940cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:30.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.048+0000 7fcb98b9f640 1 -- 172.21.15.50:0/2999027401 shutdown_connections 2024-09-11T22:11:30.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30.048+0000 7fcb98b9f640 1 -- 172.21.15.50:0/2999027401 wait complete. 2024-09-11T22:11:30.059 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T22:11:30.060 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:11:30.060 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:11:30.060 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:11:30.060 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:11:30.060 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T22:11:30.060 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T22:11:30.060 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:11:30.060 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:11:30.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:30.060 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:11:30.076 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:11:30.076 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:11:30.076 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:11:30.076 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:30.076 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:11:30.076 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:30.076 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:11:30.077 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:30.077 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:11:30.077 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:11:30.077 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:30.077 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:11:30.077 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:11:30.077 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:30.077 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:11:30.077 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:11:30.077 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42705sec preferred_lft 42705sec 2024-09-11T22:11:30.077 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:11:30.077 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:30.077 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:11:30.078 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:30.078 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:11:30.078 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T22:11:30.078 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:30.078 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:11:30.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2024-09-11T22:11:30.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2024-09-11T22:11:30.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2024-09-11T22:11:30.079 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T22:11:30.079 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:11:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:30.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:30.272 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:11:30.298 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:11:30.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:30.300 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:11:30.376 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:11:30.376 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:11:30.376 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:11:30.376 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:11:30.376 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:11:30.377 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:30.377 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:11:30.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:11:30.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:11:30.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:11:30.377 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:11:30.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:30.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:30.669 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:11:30.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:30.686 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2024-09-11T22:11:30.742 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:30.742 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:11:30.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:11:30.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T22:11:30.742 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:11:30.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:30.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:30.862 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T22:11:30.862 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:30.864 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:11:30.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T22:11:30.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T22:11:30.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T22:11:30.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T22:11:30.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T22:11:30.864 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:11:30.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:30.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:31.001 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:31.001 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:11:31.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:11:31.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T22:11:31.001 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:11:31.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:31.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:31.082 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:11:31.082 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:11:31.098 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:11:31.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:11:31.098 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:11:31.154 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:11:31.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:31.154 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:11:31.249 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:11:31.249 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:11:31.369 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:11:31.369 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:11:31.369 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:11:31.370 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:11:31.370 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:11:31.370 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:11:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:11:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:11:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:11:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:11:31.372 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:11:31.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:31.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:11:31.399 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:11:31.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:11:31.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:31.502 INFO:teuthology.orchestra.run.smithi050.stdout:client4567 2024-09-11T22:11:31.502 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:11:31.502 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:31.518 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:11:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:11:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:31.620 INFO:teuthology.orchestra.run.smithi050.stdout:client4567 2024-09-11T22:11:31.620 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:11:31.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:11:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:31.683 INFO:teuthology.orchestra.run.smithi050.stdout:client4567 2024-09-11T22:11:31.683 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a6d32825-9a2d-4e99-ad9a-1aac010fe65a.client4567/status') 2024-09-11T22:11:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:31.746 INFO:teuthology.orchestra.run.smithi050.stdout:instance: client.4567 (3)172.21.15.50:0/1101502825 2024-09-11T22:11:31.746 INFO:teuthology.orchestra.run.smithi050.stdout:blocklisted: false 2024-09-11T22:11:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records in 2024-09-11T22:11:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records out 2024-09-11T22:11:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:70 bytes copied, 2.4023e-05 s, 2.9 MB/s 2024-09-11T22:11:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:31.754 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-11T22:11:31.754 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T22:11:31.754 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-11T22:11:31.754 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:11:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.857+0000 7f753ecdd640 1 Processor -- start 2024-09-11T22:11:31.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.857+0000 7f753ecdd640 1 -- start start 2024-09-11T22:11:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.858+0000 7f753ecdd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f753815b400 0x7f753806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.858+0000 7f753ecdd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753815b7e0 con 0x7f753806e0f0 2024-09-11T22:11:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.858+0000 7f753ecdd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753815f140 con 0x7f7538072e60 2024-09-11T22:11:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.858+0000 7f753ecdd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f753815f420 con 0x7f753815b400 2024-09-11T22:11:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.858+0000 7f753d27a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f753806e0f0 0x7f75380711c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34732/0 (socket says 172.21.15.50:34732) 2024-09-11T22:11:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.858+0000 7f753d27a640 1 -- 172.21.15.50:0/609446626 learned_addr learned my addr 172.21.15.50:0/609446626 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.858+0000 7f753ca79640 1 --2- 172.21.15.50:0/609446626 >> v2:172.21.15.77:3300/0 conn(0x7f753815b400 0x7f753806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.858+0000 7f75377fe640 1 -- 172.21.15.50:0/609446626 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 313824091 0 0) 0x7f753815b7e0 con 0x7f753806e0f0 2024-09-11T22:11:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.858+0000 7f75377fe640 1 -- 172.21.15.50:0/609446626 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7528003520 con 0x7f753806e0f0 2024-09-11T22:11:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.859+0000 7f753ca79640 1 -- 172.21.15.50:0/609446626 >> v1:172.21.15.77:6789/0 conn(0x7f7538072e60 legacy=0x7f753806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.859+0000 7f75377fe640 1 -- 172.21.15.50:0/609446626 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2373781871 0 0) 0x7f7528003520 con 0x7f753806e0f0 2024-09-11T22:11:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.859+0000 7f753ca79640 1 -- 172.21.15.50:0/609446626 >> v1:172.21.15.50:6789/0 conn(0x7f753806e0f0 legacy=0x7f75380711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.859+0000 7f753ca79640 1 -- 172.21.15.50:0/609446626 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753815f700 con 0x7f753815b400 2024-09-11T22:11:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.860+0000 7f753ca79640 1 --2- 172.21.15.50:0/609446626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753815b400 0x7f753806d070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f752c0097a0 tx=0x7f752c02a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7617f76e66b86b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.860+0000 7f75377fe640 1 -- 172.21.15.50:0/609446626 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c037070 con 0x7f753815b400 2024-09-11T22:11:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.860+0000 7f75377fe640 1 -- 172.21.15.50:0/609446626 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752c02ab60 con 0x7f753815b400 2024-09-11T22:11:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.860+0000 7f75377fe640 1 -- 172.21.15.50:0/609446626 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75300019f0 con 0x7f753815b400 2024-09-11T22:11:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.860+0000 7f753ecdd640 1 -- 172.21.15.50:0/609446626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753815b400 msgr2=0x7f753806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.860+0000 7f753ecdd640 1 --2- 172.21.15.50:0/609446626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753815b400 0x7f753806d070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f752c0097a0 tx=0x7f752c02a0d0 comp rx=0 tx=0).stop 2024-09-11T22:11:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.860+0000 7f753ecdd640 1 -- 172.21.15.50:0/609446626 shutdown_connections 2024-09-11T22:11:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.860+0000 7f753ecdd640 1 --2- 172.21.15.50:0/609446626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753815b400 0x7f753806d070 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.860+0000 7f753ecdd640 1 -- 172.21.15.50:0/609446626 >> 172.21.15.50:0/609446626 conn(0x7f75380679c0 msgr2=0x7f7538067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.860+0000 7f753ecdd640 1 -- 172.21.15.50:0/609446626 shutdown_connections 2024-09-11T22:11:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.861+0000 7f753ecdd640 1 -- 172.21.15.50:0/609446626 wait complete. 2024-09-11T22:11:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.862+0000 7f753ecdd640 1 Processor -- start 2024-09-11T22:11:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.862+0000 7f753ecdd640 1 -- start start 2024-09-11T22:11:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f753ecdd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f753806e0f0 0x7f75381f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f753ecdd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7538072e60 0x7f7538156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f753ecdd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753815b400 0x7f75380add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f753ecdd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f75380718d0 con 0x7f7538072e60 2024-09-11T22:11:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f753ecdd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f75380cfc50 con 0x7f753815b400 2024-09-11T22:11:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f753ecdd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7538071a50 con 0x7f753806e0f0 2024-09-11T22:11:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f7537fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7538072e60 0x7f7538156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f7537fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7538072e60 0x7f7538156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38424/0 (socket says 172.21.15.50:38424) 2024-09-11T22:11:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f7537fff640 1 -- 172.21.15.50:0/808606476 learned_addr learned my addr 172.21.15.50:0/808606476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f753d27a640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753815b400 0x7f75380add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f753ca79640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f753806e0f0 0x7f75381f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f7537fff640 1 -- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f753806e0f0 msgr2=0x7f75381f2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f7537fff640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f753806e0f0 0x7f75381f2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f7537fff640 1 -- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753815b400 msgr2=0x7f75380add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f7537fff640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753815b400 0x7f75380add10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f7537fff640 1 -- 172.21.15.50:0/808606476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75380ae720 con 0x7f7538072e60 2024-09-11T22:11:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f7537fff640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7538072e60 0x7f7538156db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f752400c5a0 tx=0x7f752400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f75357fa640 1 -- 172.21.15.50:0/808606476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524017070 con 0x7f7538072e60 2024-09-11T22:11:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f75357fa640 1 -- 172.21.15.50:0/808606476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75240035f0 con 0x7f7538072e60 2024-09-11T22:11:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.863+0000 7f75357fa640 1 -- 172.21.15.50:0/808606476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75240039e0 con 0x7f7538072e60 2024-09-11T22:11:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.864+0000 7f753ecdd640 1 -- 172.21.15.50:0/808606476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75381f32e0 con 0x7f7538072e60 2024-09-11T22:11:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.864+0000 7f753ecdd640 1 -- 172.21.15.50:0/808606476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75381572f0 con 0x7f7538072e60 2024-09-11T22:11:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.864+0000 7f753ecdd640 1 -- 172.21.15.50:0/808606476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753806d070 con 0x7f7538072e60 2024-09-11T22:11:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.865+0000 7f75357fa640 1 -- 172.21.15.50:0/808606476 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f752401a070 con 0x7f7538072e60 2024-09-11T22:11:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.865+0000 7f75357fa640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f751c06be30 0x7f751c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.866+0000 7f75357fa640 1 -- 172.21.15.50:0/808606476 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f752408a300 con 0x7f7538072e60 2024-09-11T22:11:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.866+0000 7f753ca79640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f751c06be30 0x7f751c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.866+0000 7f753ca79640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f751c06be30 0x7f751c06e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f752c034000 tx=0x7f752c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:31.870+0000 7f75357fa640 1 -- 172.21.15.50:0/808606476 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75240585c0 con 0x7f7538072e60 2024-09-11T22:11:32.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.085+0000 7f753ecdd640 1 -- 172.21.15.50:0/808606476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f75380b3910 con 0x7f7538072e60 2024-09-11T22:11:32.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.085+0000 7f75357fa640 1 -- 172.21.15.50:0/808606476 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f752405c8c0 con 0x7f7538072e60 2024-09-11T22:11:32.089 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:11:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.087+0000 7f753ecdd640 1 -- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f751c06be30 msgr2=0x7f751c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.087+0000 7f753ecdd640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f751c06be30 0x7f751c06e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f752c034000 tx=0x7f752c02e000 comp rx=0 tx=0).stop 2024-09-11T22:11:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.087+0000 7f753ecdd640 1 -- 172.21.15.50:0/808606476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7538072e60 msgr2=0x7f7538156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.087+0000 7f753ecdd640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7538072e60 0x7f7538156db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f752400c5a0 tx=0x7f752400ca60 comp rx=0 tx=0).stop 2024-09-11T22:11:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.087+0000 7f753ecdd640 1 -- 172.21.15.50:0/808606476 shutdown_connections 2024-09-11T22:11:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.087+0000 7f753ecdd640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f751c06be30 0x7f751c06e2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.087+0000 7f753ecdd640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f753815b400 0x7f75380add10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.087+0000 7f753ecdd640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7538072e60 0x7f7538156db0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.087+0000 7f753ecdd640 1 --2- 172.21.15.50:0/808606476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f753806e0f0 0x7f75381f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.087+0000 7f753ecdd640 1 -- 172.21.15.50:0/808606476 >> 172.21.15.50:0/808606476 conn(0x7f75380679c0 msgr2=0x7f753806d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:32.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.087+0000 7f753ecdd640 1 -- 172.21.15.50:0/808606476 shutdown_connections 2024-09-11T22:11:32.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32.087+0000 7f753ecdd640 1 -- 172.21.15.50:0/808606476 wait complete. 2024-09-11T22:11:32.098 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T22:11:32.099 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:11:32.099 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:11:32.099 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-11T22:11:32.099 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-11T22:11:32.099 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T22:11:32.099 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T22:11:32.099 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:11:32.099 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-11T22:11:32.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:32.099 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:11:32.115 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:11:32.116 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:11:32.116 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:11:32.116 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.116 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:11:32.116 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.117 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:11:32.117 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:32.117 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:11:32.117 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:11:32.117 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:32.117 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:11:32.117 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:11:32.117 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:32.117 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:11:32.117 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:11:32.117 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42703sec preferred_lft 42703sec 2024-09-11T22:11:32.117 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:11:32.117 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.118 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:11:32.118 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:32.118 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:11:32.118 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:11:32.118 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:32.118 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:11:32.118 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.118 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:11:32.118 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.118 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:11:32.118 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:11:32.118 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link tentative 2024-09-11T22:11:32.118 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:32.119 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:11:32.180 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:11:32.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:32.182 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:11:32.238 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:11:32.238 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:11:32.238 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:11:32.238 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:11:32.238 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:11:32.239 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:32.239 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:11:32.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:11:32.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:11:32.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:11:32.239 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:11:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:32.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:32.367 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:11:32.383 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:11:32.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:32.383 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2024-09-11T22:11:32.439 INFO:teuthology.orchestra.run.smithi050.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-11T22:11:32.440 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:32.440 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:11:32.440 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:11:32.440 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-11T22:11:32.440 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:11:32.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:32.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:32.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:32.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-11T22:11:32.585 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:11:32.585 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:11:32.585 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:11:32.585 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.586 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:11:32.586 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.586 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:11:32.586 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether da:aa:93:15:43:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T22:11:32.586 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T22:11:32.586 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.586 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d8aa:93ff:fe15:4303/64 scope link 2024-09-11T22:11:32.586 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:32.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-11T22:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether da:aa:93:15:43:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T22:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T22:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d8aa:93ff:fe15:4303/64 scope link 2024-09-11T22:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:32.655 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-11T22:11:32.655 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:32.655 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:11:32.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-11T22:11:32.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-11T22:11:32.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-11T22:11:32.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-11T22:11:32.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-11T22:11:32.656 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:11:32.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:32.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:32.811 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:32.811 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:11:32.811 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.1 up 2024-09-11T22:11:32.811 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.1 master ceph-brx 2024-09-11T22:11:32.811 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:11:32.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:32.890 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:11:32.890 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-11T22:11:32.906 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-11T22:11:32.906 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:11:32.906 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-11T22:11:32.962 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-11T22:11:32.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:32.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:11:33.047 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:11:33.047 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:11:33.060 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:11:33.060 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:11:33.060 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:11:33.060 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 2@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:11:33.060 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:11:33.060 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-11T22:11:33.060 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:11:33.061 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:11:33.061 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:11:33.061 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:11:33.062 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:11:33.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:33.062 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-11T22:11:33.088 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:11:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:11:33.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:33.185 INFO:teuthology.orchestra.run.smithi050.stdout:client4466 2024-09-11T22:11:33.186 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:11:33.186 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:33.202 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:11:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:11:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout:client4466 2024-09-11T22:11:33.299 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:11:33.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:11:33.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout:client4466 2024-09-11T22:11:33.356 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a6d32825-9a2d-4e99-ad9a-1aac010fe65a.client4466/status') 2024-09-11T22:11:33.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:33.416 INFO:teuthology.orchestra.run.smithi050.stdout:instance: client.4466 (3)172.21.15.50:0/3735215883 2024-09-11T22:11:33.416 INFO:teuthology.orchestra.run.smithi050.stdout:blocklisted: false 2024-09-11T22:11:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records in 2024-09-11T22:11:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records out 2024-09-11T22:11:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:70 bytes copied, 2.3215e-05 s, 3.0 MB/s 2024-09-11T22:11:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:33.423 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-11T22:11:33.423 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T22:11:33.423 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T22:11:33.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:11:33.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.525+0000 7fdf0d87b640 1 Processor -- start 2024-09-11T22:11:33.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.525+0000 7fdf0d87b640 1 -- start start 2024-09-11T22:11:33.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.526+0000 7fdf0d87b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdf0815e9b0 0x7fdf0815f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:33.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.526+0000 7fdf0d87b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf0806bb50 0x7fdf080af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:33.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.526+0000 7fdf0d87b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf080b5fd0 con 0x7fdf080af900 2024-09-11T22:11:33.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.526+0000 7fdf0d87b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fdf080b6900 con 0x7fdf0806bb50 2024-09-11T22:11:33.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.526+0000 7fdf0d87b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fdf080b62b0 con 0x7fdf0815e9b0 2024-09-11T22:11:33.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.526+0000 7fdf067fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf0806bb50 0x7fdf080af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:33.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.526+0000 7fdf067fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf0806bb50 0x7fdf080af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38434/0 (socket says 172.21.15.50:38434) 2024-09-11T22:11:33.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.526+0000 7fdf067fc640 1 -- 172.21.15.50:0/3895044962 learned_addr learned my addr 172.21.15.50:0/3895044962 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:33.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.527+0000 7fdf06ffd640 1 --2- 172.21.15.50:0/3895044962 >> v2:172.21.15.77:3300/0 conn(0x7fdf0815e9b0 0x7fdf0815f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:33.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.527+0000 7fdf067fc640 1 -- 172.21.15.50:0/3895044962 >> v2:172.21.15.77:3300/0 conn(0x7fdf0815e9b0 msgr2=0x7fdf0815f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:33.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.527+0000 7fdf067fc640 1 --2- 172.21.15.50:0/3895044962 >> v2:172.21.15.77:3300/0 conn(0x7fdf0815e9b0 0x7fdf0815f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.527+0000 7fdf067fc640 1 -- 172.21.15.50:0/3895044962 >> v1:172.21.15.77:6789/0 conn(0x7fdf080af900 legacy=0x7fdf080b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:33.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.527+0000 7fdf067fc640 1 -- 172.21.15.50:0/3895044962 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf080b6590 con 0x7fdf0806bb50 2024-09-11T22:11:33.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.527+0000 7fdf06ffd640 1 --2- 172.21.15.50:0/3895044962 >> v2:172.21.15.77:3300/0 conn(0x7fdf0815e9b0 0x7fdf0815f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:33.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.527+0000 7fdf067fc640 1 --2- 172.21.15.50:0/3895044962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0806bb50 0x7fdf080af3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdf080b51a0 tx=0x7fdef002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd255ee30c5f4b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:33.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.528+0000 7fdf05ffb640 1 -- 172.21.15.50:0/3895044962 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0037070 con 0x7fdf0806bb50 2024-09-11T22:11:33.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.528+0000 7fdf05ffb640 1 -- 172.21.15.50:0/3895044962 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef0032440 con 0x7fdf0806bb50 2024-09-11T22:11:33.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.528+0000 7fdf05ffb640 1 -- 172.21.15.50:0/3895044962 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0032810 con 0x7fdf0806bb50 2024-09-11T22:11:33.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.528+0000 7fdf0d87b640 1 -- 172.21.15.50:0/3895044962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0806bb50 msgr2=0x7fdf080af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:33.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.528+0000 7fdf0d87b640 1 --2- 172.21.15.50:0/3895044962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0806bb50 0x7fdf080af3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdf080b51a0 tx=0x7fdef002a270 comp rx=0 tx=0).stop 2024-09-11T22:11:33.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.528+0000 7fdf0d87b640 1 -- 172.21.15.50:0/3895044962 shutdown_connections 2024-09-11T22:11:33.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.528+0000 7fdf0d87b640 1 --2- 172.21.15.50:0/3895044962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0806bb50 0x7fdf080af3c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.528+0000 7fdf0d87b640 1 --2- 172.21.15.50:0/3895044962 >> v2:172.21.15.77:3300/0 conn(0x7fdf0815e9b0 0x7fdf0815f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.528+0000 7fdf0d87b640 1 -- 172.21.15.50:0/3895044962 >> 172.21.15.50:0/3895044962 conn(0x7fdf080b7940 msgr2=0x7fdf080b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:33.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.528+0000 7fdf0d87b640 1 -- 172.21.15.50:0/3895044962 shutdown_connections 2024-09-11T22:11:33.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.528+0000 7fdf0d87b640 1 -- 172.21.15.50:0/3895044962 wait complete. 2024-09-11T22:11:33.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.529+0000 7fdf0d87b640 1 Processor -- start 2024-09-11T22:11:33.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.530+0000 7fdf0d87b640 1 -- start start 2024-09-11T22:11:33.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.530+0000 7fdf0d87b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0806bb50 0x7fdf081e8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:33.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.530+0000 7fdf0d87b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf080af900 0x7fdf08143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:33.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.530+0000 7fdf0d87b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0814ff20 0x7fdf080b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:33.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.530+0000 7fdf0d87b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0806d490 con 0x7fdf0814ff20 2024-09-11T22:11:33.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.530+0000 7fdf0d87b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0806d310 con 0x7fdf0806bb50 2024-09-11T22:11:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.530+0000 7fdf0d87b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdf080b74a0 con 0x7fdf080af900 2024-09-11T22:11:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdf077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0814ff20 0x7fdf080b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdf077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0814ff20 0x7fdf080b0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38438/0 (socket says 172.21.15.50:38438) 2024-09-11T22:11:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdf077fe640 1 -- 172.21.15.50:0/878078342 learned_addr learned my addr 172.21.15.50:0/878078342 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdf06ffd640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0806bb50 0x7fdf081e8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdf067fc640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf080af900 0x7fdf08143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdf077fe640 1 -- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf080af900 msgr2=0x7fdf08143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdf077fe640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf080af900 0x7fdf08143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdf077fe640 1 -- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0806bb50 msgr2=0x7fdf081e8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdf077fe640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0806bb50 0x7fdf081e8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdf077fe640 1 -- 172.21.15.50:0/878078342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf081f82f0 con 0x7fdf0814ff20 2024-09-11T22:11:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdf077fe640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0814ff20 0x7fdf080b0660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000c3f0 tx=0x7fdf0000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:33.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdefffff640 1 -- 172.21.15.50:0/878078342 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf00017070 con 0x7fdf0814ff20 2024-09-11T22:11:33.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdefffff640 1 -- 172.21.15.50:0/878078342 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf000052d0 con 0x7fdf0814ff20 2024-09-11T22:11:33.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdf0d87b640 1 -- 172.21.15.50:0/878078342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf081f85d0 con 0x7fdf0814ff20 2024-09-11T22:11:33.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdefffff640 1 -- 172.21.15.50:0/878078342 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf00003830 con 0x7fdf0814ff20 2024-09-11T22:11:33.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.531+0000 7fdf0d87b640 1 -- 172.21.15.50:0/878078342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf081f8b90 con 0x7fdf0814ff20 2024-09-11T22:11:33.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.532+0000 7fdf0d87b640 1 -- 172.21.15.50:0/878078342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf080b4ec0 con 0x7fdf0814ff20 2024-09-11T22:11:33.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.533+0000 7fdefffff640 1 -- 172.21.15.50:0/878078342 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf0001a070 con 0x7fdf0814ff20 2024-09-11T22:11:33.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.533+0000 7fdefffff640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdee806be30 0x7fdee806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:33.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.533+0000 7fdefffff640 1 -- 172.21.15.50:0/878078342 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdf0008a170 con 0x7fdf0814ff20 2024-09-11T22:11:33.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.534+0000 7fdf06ffd640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdee806be30 0x7fdee806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:33.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.534+0000 7fdf06ffd640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdee806be30 0x7fdee806e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdf080b3cc0 tx=0x7fdef8003a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:33.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.538+0000 7fdefffff640 1 -- 172.21.15.50:0/878078342 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf080b4ec0 con 0x7fdf0814ff20 2024-09-11T22:11:33.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.751+0000 7fdf0d87b640 1 -- 172.21.15.50:0/878078342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdf080af3c0 con 0x7fdf0814ff20 2024-09-11T22:11:33.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.751+0000 7fdefffff640 1 -- 172.21.15.50:0/878078342 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fdf00058b20 con 0x7fdf0814ff20 2024-09-11T22:11:33.752 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:11:33.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.754+0000 7fdf0d87b640 1 -- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdee806be30 msgr2=0x7fdee806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:33.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.754+0000 7fdf0d87b640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdee806be30 0x7fdee806e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdf080b3cc0 tx=0x7fdef8003a10 comp rx=0 tx=0).stop 2024-09-11T22:11:33.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.754+0000 7fdf0d87b640 1 -- 172.21.15.50:0/878078342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0814ff20 msgr2=0x7fdf080b0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:33.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.754+0000 7fdf0d87b640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0814ff20 0x7fdf080b0660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000c3f0 tx=0x7fdf0000c8b0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.754+0000 7fdf0d87b640 1 -- 172.21.15.50:0/878078342 shutdown_connections 2024-09-11T22:11:33.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.754+0000 7fdf0d87b640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdee806be30 0x7fdee806e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.754+0000 7fdf0d87b640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf080af900 0x7fdf08143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.754+0000 7fdf0d87b640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0814ff20 0x7fdf080b0660 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.754+0000 7fdf0d87b640 1 --2- 172.21.15.50:0/878078342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0806bb50 0x7fdf081e8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:33.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.754+0000 7fdf0d87b640 1 -- 172.21.15.50:0/878078342 >> 172.21.15.50:0/878078342 conn(0x7fdf080b7940 msgr2=0x7fdf080b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:33.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.754+0000 7fdf0d87b640 1 -- 172.21.15.50:0/878078342 shutdown_connections 2024-09-11T22:11:33.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:33.754+0000 7fdf0d87b640 1 -- 172.21.15.50:0/878078342 wait complete. 2024-09-11T22:11:33.765 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T22:11:33.765 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:11:33.765 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2024-09-11T22:11:33.765 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T22:11:33.765 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T22:11:33.766 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T22:11:33.766 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T22:11:33.766 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:11:33.766 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T22:11:33.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:33.766 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2024-09-11T22:11:33.786 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:11:33.786 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:11:33.786 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:11:33.786 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:33.786 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-09-11T22:11:33.786 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:33.786 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:11:33.787 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:33.787 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2024-09-11T22:11:33.787 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:11:33.787 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:33.787 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2024-09-11T22:11:33.787 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:11:33.787 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:33.787 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:11:33.787 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:33.787 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T22:11:33.787 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42775sec preferred_lft 42775sec 2024-09-11T22:11:33.787 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link noprefixroute 2024-09-11T22:11:33.787 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:33.788 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T22:11:33.788 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:33.788 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-11T22:11:33.788 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2024-09-11T22:11:33.788 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2024-09-11T22:11:33.788 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2024-09-11T22:11:33.788 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T22:11:33.788 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-11T22:11:33.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:33.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:34.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:34.005 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:11:34.029 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-09-11T22:11:34.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:34.031 DEBUG:teuthology.orchestra.run.smithi077:> route 2024-09-11T22:11:34.107 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2024-09-11T22:11:34.107 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:11:34.108 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T22:11:34.108 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T22:11:34.108 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:11:34.108 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:34.108 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-11T22:11:34.108 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T22:11:34.108 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T22:11:34.108 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T22:11:34.108 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-11T22:11:34.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:34.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:34.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:34.415 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-11T22:11:34.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:34.431 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2024-09-11T22:11:34.485 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:34.485 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-11T22:11:34.485 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T22:11:34.485 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-11T22:11:34.485 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-11T22:11:34.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:34.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:34.602 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-11T22:11:34.602 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:34.602 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-11T22:11:34.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-11T22:11:34.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T22:11:34.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-11T22:11:34.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-11T22:11:34.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-11T22:11:34.603 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-11T22:11:34.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:34.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:34.728 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:34.728 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-11T22:11:34.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2024-09-11T22:11:34.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T22:11:34.728 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-11T22:11:34.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:34.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:34.804 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:11:34.804 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T22:11:34.819 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T22:11:34.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:11:34.819 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T22:11:34.874 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-11T22:11:34.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:34.874 DEBUG:teuthology.orchestra.run.smithi077:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:11:34.971 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:11:34.971 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:11:35.093 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:11:35.093 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:11:35.094 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:11:35.094 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: trying mount with new device syntax: 1@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:11:35.094 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:11:35.095 INFO:teuthology.orchestra.run.smithi077.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T22:11:35.095 INFO:teuthology.orchestra.run.smithi077.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:11:35.095 INFO:teuthology.orchestra.run.smithi077.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:11:35.095 INFO:teuthology.orchestra.run.smithi077.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:11:35.095 INFO:teuthology.orchestra.run.smithi077.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:11:35.097 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:11:35.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:35.097 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T22:11:35.121 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:11:35.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:11:35.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:35.217 INFO:teuthology.orchestra.run.smithi077.stdout:client4472 2024-09-11T22:11:35.217 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:11:35.217 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:35.233 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:11:35.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:11:35.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:35.328 INFO:teuthology.orchestra.run.smithi077.stdout:client4472 2024-09-11T22:11:35.328 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:11:35.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:11:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:35.384 INFO:teuthology.orchestra.run.smithi077.stdout:client4472 2024-09-11T22:11:35.384 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a6d32825-9a2d-4e99-ad9a-1aac010fe65a.client4472/status') 2024-09-11T22:11:35.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:35.442 INFO:teuthology.orchestra.run.smithi077.stdout:instance: client.4472 (3)192.168.0.1:0/2683579804 2024-09-11T22:11:35.442 INFO:teuthology.orchestra.run.smithi077.stdout:blocklisted: false 2024-09-11T22:11:35.442 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records in 2024-09-11T22:11:35.442 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records out 2024-09-11T22:11:35.442 INFO:teuthology.orchestra.run.smithi077.stderr:69 bytes copied, 2.2073e-05 s, 3.1 MB/s 2024-09-11T22:11:35.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:35.449 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-11T22:11:35.449 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T22:11:35.449 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-11T22:11:35.450 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:11:35.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.565+0000 7f2730030640 1 Processor -- start 2024-09-11T22:11:35.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.565+0000 7f2730030640 1 -- start start 2024-09-11T22:11:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f2730030640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272815e8e0 0x7f27280b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f2730030640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2728162350 0x7f2728162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f2730030640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2728163080 con 0x7f27280d1580 2024-09-11T22:11:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f2730030640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f272815ecc0 con 0x7f2728162350 2024-09-11T22:11:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f2730030640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f27280d2ad0 con 0x7f272815e8e0 2024-09-11T22:11:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f272d5cb640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f27280d1580 0x7f27280d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34748/0 (socket says 172.21.15.50:34748) 2024-09-11T22:11:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f272d5cb640 1 -- 172.21.15.50:0/3049610095 learned_addr learned my addr 172.21.15.50:0/3049610095 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f272e5cd640 1 --2- 172.21.15.50:0/3049610095 >> v2:172.21.15.77:3300/0 conn(0x7f2728162350 0x7f2728162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f272ddcc640 1 --2- 172.21.15.50:0/3049610095 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272815e8e0 0x7f27280b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f272cdca640 1 -- 172.21.15.50:0/3049610095 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611648040 0 0) 0x7f2728163080 con 0x7f27280d1580 2024-09-11T22:11:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f272cdca640 1 -- 172.21.15.50:0/3049610095 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2714003520 con 0x7f27280d1580 2024-09-11T22:11:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f272e5cd640 1 -- 172.21.15.50:0/3049610095 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272815e8e0 msgr2=0x7f27280b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f272e5cd640 1 --2- 172.21.15.50:0/3049610095 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272815e8e0 0x7f27280b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f272e5cd640 1 -- 172.21.15.50:0/3049610095 >> v1:172.21.15.50:6789/0 conn(0x7f27280d1580 legacy=0x7f27280d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f272e5cd640 1 -- 172.21.15.50:0/3049610095 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27280d2d20 con 0x7f2728162350 2024-09-11T22:11:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.566+0000 7f272ddcc640 1 --2- 172.21.15.50:0/3049610095 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272815e8e0 0x7f27280b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.567+0000 7f272e5cd640 1 --2- 172.21.15.50:0/3049610095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2728162350 0x7f2728162800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2720009d90 tx=0x7f272002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=157f419cd55ca616 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.567+0000 7f272cdca640 1 -- 172.21.15.50:0/3049610095 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720007740 con 0x7f2728162350 2024-09-11T22:11:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.567+0000 7f272cdca640 1 -- 172.21.15.50:0/3049610095 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27200078e0 con 0x7f2728162350 2024-09-11T22:11:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.567+0000 7f272cdca640 1 -- 172.21.15.50:0/3049610095 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720007cb0 con 0x7f2728162350 2024-09-11T22:11:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.568+0000 7f2730030640 1 -- 172.21.15.50:0/3049610095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2728162350 msgr2=0x7f2728162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.568+0000 7f2730030640 1 --2- 172.21.15.50:0/3049610095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2728162350 0x7f2728162800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2720009d90 tx=0x7f272002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.568+0000 7f2730030640 1 -- 172.21.15.50:0/3049610095 shutdown_connections 2024-09-11T22:11:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.568+0000 7f2730030640 1 --2- 172.21.15.50:0/3049610095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2728162350 0x7f2728162800 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.568+0000 7f2730030640 1 --2- 172.21.15.50:0/3049610095 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272815e8e0 0x7f27280b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.568+0000 7f2730030640 1 -- 172.21.15.50:0/3049610095 >> 172.21.15.50:0/3049610095 conn(0x7f2728067ba0 msgr2=0x7f2728067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.568+0000 7f2730030640 1 -- 172.21.15.50:0/3049610095 shutdown_connections 2024-09-11T22:11:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.568+0000 7f2730030640 1 -- 172.21.15.50:0/3049610095 wait complete. 2024-09-11T22:11:35.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.569+0000 7f2730030640 1 Processor -- start 2024-09-11T22:11:35.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.569+0000 7f2730030640 1 -- start start 2024-09-11T22:11:35.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.570+0000 7f2730030640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280d1580 0x7f27281559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.570+0000 7f2730030640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272815e8e0 0x7f27280b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.570+0000 7f2730030640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2728162350 0x7f272815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.570+0000 7f2730030640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2728162d40 con 0x7f27280d1580 2024-09-11T22:11:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.570+0000 7f2730030640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f27280d3370 con 0x7f2728162350 2024-09-11T22:11:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.570+0000 7f2730030640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f27280d3800 con 0x7f272815e8e0 2024-09-11T22:11:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.570+0000 7f272ddcc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280d1580 0x7f27281559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.570+0000 7f272ddcc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280d1580 0x7f27281559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38444/0 (socket says 172.21.15.50:38444) 2024-09-11T22:11:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.570+0000 7f272ddcc640 1 -- 172.21.15.50:0/2865681685 learned_addr learned my addr 172.21.15.50:0/2865681685 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.570+0000 7f272d5cb640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272815e8e0 0x7f27280b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.570+0000 7f272e5cd640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2728162350 0x7f272815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.571+0000 7f272ddcc640 1 -- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272815e8e0 msgr2=0x7f27280b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.571+0000 7f272ddcc640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272815e8e0 0x7f27280b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.571+0000 7f272ddcc640 1 -- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2728162350 msgr2=0x7f272815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.571+0000 7f272ddcc640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2728162350 0x7f272815d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.571+0000 7f272ddcc640 1 -- 172.21.15.50:0/2865681685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27281e9c20 con 0x7f27280d1580 2024-09-11T22:11:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.571+0000 7f272ddcc640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280d1580 0x7f27281559c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f272400ebe0 tx=0x7f272400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.571+0000 7f271e7fc640 1 -- 172.21.15.50:0/2865681685 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724017070 con 0x7f27280d1580 2024-09-11T22:11:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.571+0000 7f271e7fc640 1 -- 172.21.15.50:0/2865681685 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f272400cc30 con 0x7f27280d1580 2024-09-11T22:11:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.571+0000 7f2730030640 1 -- 172.21.15.50:0/2865681685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27281e8b80 con 0x7f27280d1580 2024-09-11T22:11:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.571+0000 7f271e7fc640 1 -- 172.21.15.50:0/2865681685 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724013470 con 0x7f27280d1580 2024-09-11T22:11:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.571+0000 7f2730030640 1 -- 172.21.15.50:0/2865681685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27281e9140 con 0x7f27280d1580 2024-09-11T22:11:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.572+0000 7f2730030640 1 -- 172.21.15.50:0/2865681685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27280b7880 con 0x7f27280d1580 2024-09-11T22:11:35.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.573+0000 7f271e7fc640 1 -- 172.21.15.50:0/2865681685 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f272401a070 con 0x7f27280d1580 2024-09-11T22:11:35.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.573+0000 7f271e7fc640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f270c06be30 0x7f270c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:35.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.573+0000 7f271e7fc640 1 -- 172.21.15.50:0/2865681685 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f272408b140 con 0x7f27280d1580 2024-09-11T22:11:35.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.573+0000 7f272d5cb640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f270c06be30 0x7f270c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:35.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.574+0000 7f272d5cb640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f270c06be30 0x7f270c06e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f27280cee10 tx=0x7f2718009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:35.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.577+0000 7f271e7fc640 1 -- 172.21.15.50:0/2865681685 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2724059410 con 0x7f27280d1580 2024-09-11T22:11:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.790+0000 7f2730030640 1 -- 172.21.15.50:0/2865681685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f27280ba770 con 0x7f27280d1580 2024-09-11T22:11:35.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.790+0000 7f271e7fc640 1 -- 172.21.15.50:0/2865681685 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f272405d710 con 0x7f27280d1580 2024-09-11T22:11:35.791 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:11:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.792+0000 7f2730030640 1 -- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f270c06be30 msgr2=0x7f270c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.792+0000 7f2730030640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f270c06be30 0x7f270c06e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f27280cee10 tx=0x7f2718009040 comp rx=0 tx=0).stop 2024-09-11T22:11:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.792+0000 7f2730030640 1 -- 172.21.15.50:0/2865681685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280d1580 msgr2=0x7f27281559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.792+0000 7f2730030640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280d1580 0x7f27281559c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f272400ebe0 tx=0x7f272400c520 comp rx=0 tx=0).stop 2024-09-11T22:11:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.792+0000 7f2730030640 1 -- 172.21.15.50:0/2865681685 shutdown_connections 2024-09-11T22:11:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.792+0000 7f2730030640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f270c06be30 0x7f270c06e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.792+0000 7f2730030640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272815e8e0 0x7f27280b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.792+0000 7f2730030640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2728162350 0x7f272815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.792+0000 7f2730030640 1 --2- 172.21.15.50:0/2865681685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27280d1580 0x7f27281559c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.792+0000 7f2730030640 1 -- 172.21.15.50:0/2865681685 >> 172.21.15.50:0/2865681685 conn(0x7f2728067ba0 msgr2=0x7f27280b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.793+0000 7f2730030640 1 -- 172.21.15.50:0/2865681685 shutdown_connections 2024-09-11T22:11:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:35.793+0000 7f2730030640 1 -- 172.21.15.50:0/2865681685 wait complete. 2024-09-11T22:11:35.804 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T22:11:35.804 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:11:35.804 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2024-09-11T22:11:35.804 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-11T22:11:35.804 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-11T22:11:35.804 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T22:11:35.804 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T22:11:35.805 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:11:35.805 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-11T22:11:35.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:35.805 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2024-09-11T22:11:35.821 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:11:35.822 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:11:35.822 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:11:35.822 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:35.822 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-09-11T22:11:35.822 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:35.822 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:11:35.822 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:35.822 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2024-09-11T22:11:35.822 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:11:35.822 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:35.822 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2024-09-11T22:11:35.822 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:11:35.823 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:35.823 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:11:35.823 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:35.823 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T22:11:35.823 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42773sec preferred_lft 42773sec 2024-09-11T22:11:35.823 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link noprefixroute 2024-09-11T22:11:35.823 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:35.823 INFO:teuthology.orchestra.run.smithi077.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:11:35.823 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether b6:1b:73:ba:30:bd brd ff:ff:ff:ff:ff:ff 2024-09-11T22:11:35.823 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:11:35.823 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:35.823 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::d405:cdff:fe5d:d01/64 scope link 2024-09-11T22:11:35.823 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:35.824 INFO:teuthology.orchestra.run.smithi077.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:11:35.824 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether b6:1b:73:ba:30:bd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T22:11:35.824 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::b41b:73ff:feba:30bd/64 scope link tentative 2024-09-11T22:11:35.824 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:35.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:35.824 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:11:35.886 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-09-11T22:11:35.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:35.888 DEBUG:teuthology.orchestra.run.smithi077:> route 2024-09-11T22:11:35.945 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2024-09-11T22:11:35.945 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:11:35.945 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T22:11:35.945 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T22:11:35.945 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:11:35.946 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:35.946 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-11T22:11:35.946 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T22:11:35.946 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T22:11:35.946 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T22:11:35.946 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-11T22:11:36.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:36.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:36.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:36.071 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-11T22:11:36.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T22:11:36.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:36.088 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2024-09-11T22:11:36.142 INFO:teuthology.orchestra.run.smithi077.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-11T22:11:36.143 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:36.143 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-11T22:11:36.143 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T22:11:36.143 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-11T22:11:36.143 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-11T22:11:36.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:36.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:36.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:36.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-11T22:11:36.283 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:11:36.283 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:11:36.283 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:11:36.283 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:36.283 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-09-11T22:11:36.283 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:36.283 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:11:36.283 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 96:04:3f:95:fa:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T22:11:36.283 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T22:11:36.284 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:36.284 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::9404:3fff:fe95:faeb/64 scope link tentative 2024-09-11T22:11:36.284 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:36.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:36.285 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-11T22:11:36.348 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:11:36.348 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:11:36.348 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:11:36.349 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:36.349 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-09-11T22:11:36.349 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:36.349 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:11:36.349 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 96:04:3f:95:fa:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T22:11:36.349 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T22:11:36.349 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:36.349 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::9404:3fff:fe95:faeb/64 scope link tentative 2024-09-11T22:11:36.349 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:11:36.350 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-11T22:11:36.350 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:36.350 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-11T22:11:36.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-11T22:11:36.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-11T22:11:36.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-11T22:11:36.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-11T22:11:36.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-11T22:11:36.351 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-11T22:11:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:36.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:36.501 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:11:36.501 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-11T22:11:36.501 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.1 up 2024-09-11T22:11:36.501 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.1 master ceph-brx 2024-09-11T22:11:36.501 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-11T22:11:36.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:36.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:36.577 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:11:36.577 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-11T22:11:36.592 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-11T22:11:36.592 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:11:36.593 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-11T22:11:36.647 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-11T22:11:36.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:36.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:11:36.730 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:11:36.730 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:11:36.741 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:11:36.741 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:11:36.741 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:11:36.742 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: trying mount with new device syntax: 3@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:11:36.742 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:11:36.742 INFO:teuthology.orchestra.run.smithi077.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-11T22:11:36.742 INFO:teuthology.orchestra.run.smithi077.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:11:36.742 INFO:teuthology.orchestra.run.smithi077.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:11:36.742 INFO:teuthology.orchestra.run.smithi077.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:11:36.743 INFO:teuthology.orchestra.run.smithi077.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:11:36.744 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:11:36.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:36.744 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-11T22:11:36.805 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:11:36.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:11:36.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:36.901 INFO:teuthology.orchestra.run.smithi077.stdout:client4594 2024-09-11T22:11:36.901 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:11:36.901 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:36.917 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:11:37.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:11:37.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:37.016 INFO:teuthology.orchestra.run.smithi077.stdout:client4594 2024-09-11T22:11:37.016 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:11:37.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:11:37.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:37.071 INFO:teuthology.orchestra.run.smithi077.stdout:client4594 2024-09-11T22:11:37.072 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a6d32825-9a2d-4e99-ad9a-1aac010fe65a.client4594/status') 2024-09-11T22:11:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:11:37.129 INFO:teuthology.orchestra.run.smithi077.stdout:instance: client.4594 (3)192.168.0.2:0/4083897916 2024-09-11T22:11:37.129 INFO:teuthology.orchestra.run.smithi077.stdout:blocklisted: false 2024-09-11T22:11:37.129 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records in 2024-09-11T22:11:37.129 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records out 2024-09-11T22:11:37.130 INFO:teuthology.orchestra.run.smithi077.stderr:69 bytes copied, 2.2389e-05 s, 3.1 MB/s 2024-09-11T22:11:37.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-11T22:11:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:11:37.136 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-11T22:11:37.582 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-09-11T22:11:37.582 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-11T22:11:37.582 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.698+0000 7ff9998ba640 1 Processor -- start 2024-09-11T22:11:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.698+0000 7ff9998ba640 1 -- start start 2024-09-11T22:11:37.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.698+0000 7ff9998ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff99415e8d0 0x7ff9940d11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:37.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.698+0000 7ff9998ba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff9940d1710 0x7ff9940d34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:37.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.698+0000 7ff9998ba640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9940d4220 con 0x7ff9940d3a20 2024-09-11T22:11:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.698+0000 7ff9998ba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff99415ecb0 con 0x7ff99415e8d0 2024-09-11T22:11:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.698+0000 7ff9998ba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff9940d1b80 con 0x7ff9940d1710 2024-09-11T22:11:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.699+0000 7ff992ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff99415e8d0 0x7ff9940d11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.699+0000 7ff992ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff99415e8d0 0x7ff9940d11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49188/0 (socket says 172.21.15.50:49188) 2024-09-11T22:11:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.699+0000 7ff992ffd640 1 -- 172.21.15.50:0/4131158143 learned_addr learned my addr 172.21.15.50:0/4131158143 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.699+0000 7ff992ffd640 1 -- 172.21.15.50:0/4131158143 >> v2:172.21.15.77:3300/0 conn(0x7ff9940d1710 msgr2=0x7ff9940d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.699+0000 7ff992ffd640 1 --2- 172.21.15.50:0/4131158143 >> v2:172.21.15.77:3300/0 conn(0x7ff9940d1710 0x7ff9940d34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.699+0000 7ff992ffd640 1 -- 172.21.15.50:0/4131158143 >> v1:172.21.15.77:6789/0 conn(0x7ff9940d3a20 legacy=0x7ff9940b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.699+0000 7ff992ffd640 1 -- 172.21.15.50:0/4131158143 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9940d4500 con 0x7ff99415e8d0 2024-09-11T22:11:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.700+0000 7ff992ffd640 1 --2- 172.21.15.50:0/4131158143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99415e8d0 0x7ff9940d11d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff99408d8f0 tx=0x7ff98402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6c027adc7efd8b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.700+0000 7ff991ffb640 1 -- 172.21.15.50:0/4131158143 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984037070 con 0x7ff99415e8d0 2024-09-11T22:11:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.700+0000 7ff991ffb640 1 -- 172.21.15.50:0/4131158143 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff984032440 con 0x7ff99415e8d0 2024-09-11T22:11:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.700+0000 7ff991ffb640 1 -- 172.21.15.50:0/4131158143 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984032810 con 0x7ff99415e8d0 2024-09-11T22:11:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.700+0000 7ff9998ba640 1 -- 172.21.15.50:0/4131158143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99415e8d0 msgr2=0x7ff9940d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.700+0000 7ff9998ba640 1 --2- 172.21.15.50:0/4131158143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99415e8d0 0x7ff9940d11d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff99408d8f0 tx=0x7ff98402a230 comp rx=0 tx=0).stop 2024-09-11T22:11:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.700+0000 7ff9998ba640 1 -- 172.21.15.50:0/4131158143 shutdown_connections 2024-09-11T22:11:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.700+0000 7ff9998ba640 1 --2- 172.21.15.50:0/4131158143 >> v2:172.21.15.77:3300/0 conn(0x7ff9940d1710 0x7ff9940d34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.700+0000 7ff9998ba640 1 --2- 172.21.15.50:0/4131158143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99415e8d0 0x7ff9940d11d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.700+0000 7ff9998ba640 1 -- 172.21.15.50:0/4131158143 >> 172.21.15.50:0/4131158143 conn(0x7ff9940727a0 msgr2=0x7ff9940679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.700+0000 7ff9998ba640 1 -- 172.21.15.50:0/4131158143 shutdown_connections 2024-09-11T22:11:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.700+0000 7ff9998ba640 1 -- 172.21.15.50:0/4131158143 wait complete. 2024-09-11T22:11:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.702+0000 7ff9998ba640 1 Processor -- start 2024-09-11T22:11:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.702+0000 7ff9998ba640 1 -- start start 2024-09-11T22:11:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9998ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9940d1710 0x7ff9940b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9998ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9940d3a20 0x7ff9940ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9998ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99415e8d0 0x7ff9940b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9998ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff9940d3fd0 con 0x7ff99415e8d0 2024-09-11T22:11:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9998ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9940d3e50 con 0x7ff9940d3a20 2024-09-11T22:11:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9998ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff9940b77e0 con 0x7ff9940d1710 2024-09-11T22:11:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99415e8d0 0x7ff9940b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:37.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9937fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99415e8d0 0x7ff9940b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49194/0 (socket says 172.21.15.50:49194) 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9937fe640 1 -- 172.21.15.50:0/3932525206 learned_addr learned my addr 172.21.15.50:0/3932525206 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff992ffd640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9940d1710 0x7ff9940b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9927fc640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9940d3a20 0x7ff9940ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9937fe640 1 -- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9940d1710 msgr2=0x7ff9940b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9937fe640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9940d1710 0x7ff9940b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9937fe640 1 -- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9940d3a20 msgr2=0x7ff9940ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9937fe640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9940d3a20 0x7ff9940ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9937fe640 1 -- 172.21.15.50:0/3932525206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99414c900 con 0x7ff99415e8d0 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9937fe640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99415e8d0 0x7ff9940b57d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00c780 tx=0x7ff98c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff97bfff640 1 -- 172.21.15.50:0/3932525206 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c017070 con 0x7ff99415e8d0 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff97bfff640 1 -- 172.21.15.50:0/3932525206 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff98c003b70 con 0x7ff99415e8d0 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.703+0000 7ff9998ba640 1 -- 172.21.15.50:0/3932525206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99414cbe0 con 0x7ff99415e8d0 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.704+0000 7ff97bfff640 1 -- 172.21.15.50:0/3932525206 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c005070 con 0x7ff99415e8d0 2024-09-11T22:11:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.704+0000 7ff9998ba640 1 -- 172.21.15.50:0/3932525206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff99414d1a0 con 0x7ff99415e8d0 2024-09-11T22:11:37.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.705+0000 7ff9998ba640 1 -- 172.21.15.50:0/3932525206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9940d34e0 con 0x7ff99415e8d0 2024-09-11T22:11:37.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.705+0000 7ff97bfff640 1 -- 172.21.15.50:0/3932525206 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff98c01a070 con 0x7ff99415e8d0 2024-09-11T22:11:37.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.705+0000 7ff97bfff640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff98006be30 0x7ff98006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:37.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.706+0000 7ff97bfff640 1 -- 172.21.15.50:0/3932525206 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff98c08a360 con 0x7ff99415e8d0 2024-09-11T22:11:37.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.706+0000 7ff992ffd640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff98006be30 0x7ff98006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:37.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.706+0000 7ff992ffd640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff98006be30 0x7ff98006e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff984034000 tx=0x7ff98402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:37.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.710+0000 7ff97bfff640 1 -- 172.21.15.50:0/3932525206 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff98c0586c0 con 0x7ff99415e8d0 2024-09-11T22:11:37.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.888+0000 7ff9998ba640 1 -- 172.21.15.50:0/3932525206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9940b8f00 con 0x7ff99415e8d0 2024-09-11T22:11:37.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.889+0000 7ff97bfff640 1 -- 172.21.15.50:0/3932525206 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7ff98c05c9c0 con 0x7ff99415e8d0 2024-09-11T22:11:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:37.890 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:15.853220+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:12.090736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:13.202114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:37.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.891+0000 7ff9998ba640 1 -- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff98006be30 msgr2=0x7ff98006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:37.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.891+0000 7ff9998ba640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff98006be30 0x7ff98006e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff984034000 tx=0x7ff98402e000 comp rx=0 tx=0).stop 2024-09-11T22:11:37.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.891+0000 7ff9998ba640 1 -- 172.21.15.50:0/3932525206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99415e8d0 msgr2=0x7ff9940b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:37.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.891+0000 7ff9998ba640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99415e8d0 0x7ff9940b57d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00c780 tx=0x7ff98c00cb80 comp rx=0 tx=0).stop 2024-09-11T22:11:37.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.891+0000 7ff9998ba640 1 -- 172.21.15.50:0/3932525206 shutdown_connections 2024-09-11T22:11:37.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.891+0000 7ff9998ba640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff98006be30 0x7ff98006e2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:37.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.891+0000 7ff9998ba640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99415e8d0 0x7ff9940b57d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:37.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.891+0000 7ff9998ba640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9940d3a20 0x7ff9940ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:37.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.891+0000 7ff9998ba640 1 --2- 172.21.15.50:0/3932525206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9940d1710 0x7ff9940b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:37.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.891+0000 7ff9998ba640 1 -- 172.21.15.50:0/3932525206 >> 172.21.15.50:0/3932525206 conn(0x7ff9940727a0 msgr2=0x7ff9940b83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:37.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.891+0000 7ff9998ba640 1 -- 172.21.15.50:0/3932525206 shutdown_connections 2024-09-11T22:11:37.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:37.891+0000 7ff9998ba640 1 -- 172.21.15.50:0/3932525206 wait complete. 2024-09-11T22:11:37.903 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:11:03.407373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T22:11:12.090736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T22:11:13.202114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:11:37.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:11:38.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.008+0000 7f6054423640 1 Processor -- start 2024-09-11T22:11:38.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.008+0000 7f6054423640 1 -- start start 2024-09-11T22:11:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.009+0000 7f6054423640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f604c15e7b0 0x7f604c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.009+0000 7f6054423640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604c06eb00 0x7f604c15f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.009+0000 7f6054423640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f604c15f910 0x7f604c0679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.009+0000 7f6054423640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f604c15ef40 con 0x7f604c15f910 2024-09-11T22:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.009+0000 7f6054423640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f604c06f000 con 0x7f604c15e7b0 2024-09-11T22:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.009+0000 7f6054423640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f604c06f2e0 con 0x7f604c06eb00 2024-09-11T22:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.009+0000 7f60529c0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f604c15f910 0x7f604c0679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.009+0000 7f60529c0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f604c15f910 0x7f604c0679c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49202/0 (socket says 172.21.15.50:49202) 2024-09-11T22:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.009+0000 7f60529c0640 1 -- 172.21.15.50:0/2026137506 learned_addr learned my addr 172.21.15.50:0/2026137506 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.010+0000 7f60519be640 1 --2- 172.21.15.50:0/2026137506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604c06eb00 0x7f604c15f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.010+0000 7f60521bf640 1 --2- 172.21.15.50:0/2026137506 >> v2:172.21.15.77:3300/0 conn(0x7f604c15e7b0 0x7f604c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.010+0000 7f60529c0640 1 -- 172.21.15.50:0/2026137506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604c06eb00 msgr2=0x7f604c15f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.010+0000 7f60529c0640 1 --2- 172.21.15.50:0/2026137506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604c06eb00 0x7f604c15f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.010+0000 7f60529c0640 1 -- 172.21.15.50:0/2026137506 >> v2:172.21.15.77:3300/0 conn(0x7f604c15e7b0 msgr2=0x7f604c0b70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.010+0000 7f60529c0640 1 --2- 172.21.15.50:0/2026137506 >> v2:172.21.15.77:3300/0 conn(0x7f604c15e7b0 0x7f604c0b70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.010+0000 7f60529c0640 1 -- 172.21.15.50:0/2026137506 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604c06f5c0 con 0x7f604c15f910 2024-09-11T22:11:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.010+0000 7f60519be640 1 --2- 172.21.15.50:0/2026137506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604c06eb00 0x7f604c15f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.010+0000 7f60521bf640 1 --2- 172.21.15.50:0/2026137506 >> v2:172.21.15.77:3300/0 conn(0x7f604c15e7b0 0x7f604c0b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.010+0000 7f60529c0640 1 --2- 172.21.15.50:0/2026137506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f604c15f910 0x7f604c0679c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f604c06ea90 tx=0x7f604402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9c46fd1d815150 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.011+0000 7f60511bd640 1 -- 172.21.15.50:0/2026137506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044037070 con 0x7f604c15f910 2024-09-11T22:11:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.011+0000 7f60511bd640 1 -- 172.21.15.50:0/2026137506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6044032440 con 0x7f604c15f910 2024-09-11T22:11:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.011+0000 7f60511bd640 1 -- 172.21.15.50:0/2026137506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044032810 con 0x7f604c15f910 2024-09-11T22:11:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.011+0000 7f6054423640 1 -- 172.21.15.50:0/2026137506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f604c15f910 msgr2=0x7f604c0679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.011+0000 7f6054423640 1 --2- 172.21.15.50:0/2026137506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f604c15f910 0x7f604c0679c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f604c06ea90 tx=0x7f604402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.011+0000 7f6054423640 1 -- 172.21.15.50:0/2026137506 shutdown_connections 2024-09-11T22:11:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.011+0000 7f6054423640 1 --2- 172.21.15.50:0/2026137506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f604c15f910 0x7f604c0679c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.011+0000 7f6054423640 1 --2- 172.21.15.50:0/2026137506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604c06eb00 0x7f604c15f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.011+0000 7f6054423640 1 --2- 172.21.15.50:0/2026137506 >> v2:172.21.15.77:3300/0 conn(0x7f604c15e7b0 0x7f604c0b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.011+0000 7f6054423640 1 -- 172.21.15.50:0/2026137506 >> 172.21.15.50:0/2026137506 conn(0x7f604c06bd30 msgr2=0x7f604c06c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.011+0000 7f6054423640 1 -- 172.21.15.50:0/2026137506 shutdown_connections 2024-09-11T22:11:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.011+0000 7f6054423640 1 -- 172.21.15.50:0/2026137506 wait complete. 2024-09-11T22:11:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.012+0000 7f6054423640 1 Processor -- start 2024-09-11T22:11:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.013+0000 7f6054423640 1 -- start start 2024-09-11T22:11:38.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.013+0000 7f6054423640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604c06eb00 0x7f604c145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.013+0000 7f6054423640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f604c15e7b0 0x7f604c1460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.013+0000 7f6054423640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604c1465f0 0x7f604c0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.013+0000 7f6054423640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f604c067f00 con 0x7f604c15e7b0 2024-09-11T22:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.013+0000 7f6054423640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f604c0b7610 con 0x7f604c1465f0 2024-09-11T22:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.013+0000 7f6054423640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f604c068080 con 0x7f604c06eb00 2024-09-11T22:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.013+0000 7f60519be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f604c15e7b0 0x7f604c1460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.013+0000 7f60519be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f604c15e7b0 0x7f604c1460b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49204/0 (socket says 172.21.15.50:49204) 2024-09-11T22:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.013+0000 7f60519be640 1 -- 172.21.15.50:0/3791930217 learned_addr learned my addr 172.21.15.50:0/3791930217 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.013+0000 7f60521bf640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604c06eb00 0x7f604c145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.013+0000 7f60529c0640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604c1465f0 0x7f604c0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.014+0000 7f60519be640 1 -- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604c06eb00 msgr2=0x7f604c145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.014+0000 7f60519be640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604c06eb00 0x7f604c145a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.014+0000 7f60519be640 1 -- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604c1465f0 msgr2=0x7f604c0cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.014+0000 7f60519be640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604c1465f0 0x7f604c0cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.014+0000 7f60519be640 1 -- 172.21.15.50:0/3791930217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604c0ce160 con 0x7f604c15e7b0 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.014+0000 7f60529c0640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604c1465f0 0x7f604c0cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.014+0000 7f60521bf640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604c06eb00 0x7f604c145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.014+0000 7f60519be640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f604c15e7b0 0x7f604c1460b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f604000e7e0 tx=0x7f604000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.014+0000 7f604affd640 1 -- 172.21.15.50:0/3791930217 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040017070 con 0x7f604c15e7b0 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.014+0000 7f604affd640 1 -- 172.21.15.50:0/3791930217 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604000c6d0 con 0x7f604c15e7b0 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.014+0000 7f6054423640 1 -- 172.21.15.50:0/3791930217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f604c0ce400 con 0x7f604c15e7b0 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.014+0000 7f604affd640 1 -- 172.21.15.50:0/3791930217 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604000f040 con 0x7f604c15e7b0 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.014+0000 7f6054423640 1 -- 172.21.15.50:0/3791930217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f604c0ce9c0 con 0x7f604c15e7b0 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.015+0000 7f6054423640 1 -- 172.21.15.50:0/3791930217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f604c0b70d0 con 0x7f604c15e7b0 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.016+0000 7f604affd640 1 -- 172.21.15.50:0/3791930217 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f604001a070 con 0x7f604c15e7b0 2024-09-11T22:11:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.016+0000 7f604affd640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f603806be30 0x7f603806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.016+0000 7f604affd640 1 -- 172.21.15.50:0/3791930217 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f604008aa60 con 0x7f604c15e7b0 2024-09-11T22:11:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.017+0000 7f60521bf640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f603806be30 0x7f603806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.017+0000 7f60521bf640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f603806be30 0x7f603806e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f603c009b40 tx=0x7f603c003a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:38.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.020+0000 7f604affd640 1 -- 172.21.15.50:0/3791930217 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6040059410 con 0x7f604c15e7b0 2024-09-11T22:11:38.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.195+0000 7f6054423640 1 -- 172.21.15.50:0/3791930217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f604c15a500 con 0x7f604c15e7b0 2024-09-11T22:11:38.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.195+0000 7f604affd640 1 -- 172.21.15.50:0/3791930217 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f6040058d10 con 0x7f604c15e7b0 2024-09-11T22:11:38.196 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-11T22:11:38.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.197+0000 7f6054423640 1 -- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f603806be30 msgr2=0x7f603806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.197+0000 7f6054423640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f603806be30 0x7f603806e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f603c009b40 tx=0x7f603c003a30 comp rx=0 tx=0).stop 2024-09-11T22:11:38.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.197+0000 7f6054423640 1 -- 172.21.15.50:0/3791930217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f604c15e7b0 msgr2=0x7f604c1460b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.197+0000 7f6054423640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f604c15e7b0 0x7f604c1460b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f604000e7e0 tx=0x7f604000eca0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.197+0000 7f6054423640 1 -- 172.21.15.50:0/3791930217 shutdown_connections 2024-09-11T22:11:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.197+0000 7f6054423640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f603806be30 0x7f603806e2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.197+0000 7f6054423640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604c1465f0 0x7f604c0cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.197+0000 7f6054423640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f604c15e7b0 0x7f604c1460b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.197+0000 7f6054423640 1 --2- 172.21.15.50:0/3791930217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604c06eb00 0x7f604c145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.197+0000 7f6054423640 1 -- 172.21.15.50:0/3791930217 >> 172.21.15.50:0/3791930217 conn(0x7f604c06bd30 msgr2=0x7f604c0af160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.197+0000 7f6054423640 1 -- 172.21.15.50:0/3791930217 shutdown_connections 2024-09-11T22:11:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.197+0000 7f6054423640 1 -- 172.21.15.50:0/3791930217 wait complete. 2024-09-11T22:11:38.209 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T22:11:38.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.314+0000 7f5c529b9640 1 Processor -- start 2024-09-11T22:11:38.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.314+0000 7f5c529b9640 1 -- start start 2024-09-11T22:11:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.315+0000 7f5c529b9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5c4c0cf790 0x7f5c4c0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.315+0000 7f5c529b9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4c162110 con 0x7f5c4c0d11d0 2024-09-11T22:11:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.315+0000 7f5c529b9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4c0cfd70 con 0x7f5c4c161d30 2024-09-11T22:11:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.315+0000 7f5c529b9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5c4c0d3450 con 0x7f5c4c0cf790 2024-09-11T22:11:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.315+0000 7f5c4b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5c4c0cf790 0x7f5c4c0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.315+0000 7f5c50f56640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5c4c0d11d0 0x7f5c4c0d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49062/0 (socket says 172.21.15.50:49062) 2024-09-11T22:11:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.315+0000 7f5c50f56640 1 -- 172.21.15.50:0/719549153 learned_addr learned my addr 172.21.15.50:0/719549153 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.315+0000 7f5c4b7fe640 1 -- 172.21.15.50:0/719549153 >> v1:172.21.15.77:6789/0 conn(0x7f5c4c161d30 legacy=0x7f5c4c162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.315+0000 7f5c4b7fe640 1 -- 172.21.15.50:0/719549153 >> v1:172.21.15.50:6789/0 conn(0x7f5c4c0d11d0 legacy=0x7f5c4c0d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.315+0000 7f5c4b7fe640 1 -- 172.21.15.50:0/719549153 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c0d2b20 con 0x7f5c4c0cf790 2024-09-11T22:11:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.316+0000 7f5c4b7fe640 1 --2- 172.21.15.50:0/719549153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c4c0cf790 0x7f5c4c0b78f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5c400097a0 tx=0x7f5c4002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6581b812b8dae1b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.316+0000 7f5c4affd640 1 -- 172.21.15.50:0/719549153 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c40037070 con 0x7f5c4c0cf790 2024-09-11T22:11:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.316+0000 7f5c4affd640 1 -- 172.21.15.50:0/719549153 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c4002adc0 con 0x7f5c4c0cf790 2024-09-11T22:11:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.316+0000 7f5c4affd640 1 -- 172.21.15.50:0/719549153 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c40032660 con 0x7f5c4c0cf790 2024-09-11T22:11:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.316+0000 7f5c529b9640 1 -- 172.21.15.50:0/719549153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c4c0cf790 msgr2=0x7f5c4c0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.316+0000 7f5c529b9640 1 --2- 172.21.15.50:0/719549153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c4c0cf790 0x7f5c4c0b78f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5c400097a0 tx=0x7f5c4002a130 comp rx=0 tx=0).stop 2024-09-11T22:11:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.317+0000 7f5c529b9640 1 -- 172.21.15.50:0/719549153 shutdown_connections 2024-09-11T22:11:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.317+0000 7f5c529b9640 1 --2- 172.21.15.50:0/719549153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c4c0cf790 0x7f5c4c0b78f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.317+0000 7f5c529b9640 1 -- 172.21.15.50:0/719549153 >> 172.21.15.50:0/719549153 conn(0x7f5c4c0727a0 msgr2=0x7f5c4c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.317+0000 7f5c529b9640 1 -- 172.21.15.50:0/719549153 shutdown_connections 2024-09-11T22:11:38.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.317+0000 7f5c529b9640 1 -- 172.21.15.50:0/719549153 wait complete. 2024-09-11T22:11:38.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.318+0000 7f5c529b9640 1 Processor -- start 2024-09-11T22:11:38.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.318+0000 7f5c529b9640 1 -- start start 2024-09-11T22:11:38.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c529b9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c4c0cf790 0x7f5c4c1f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c529b9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c4c0d11d0 0x7f5c4c1f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c529b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c4c161d30 0x7f5c4c1f8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c529b9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c0d30e0 con 0x7f5c4c0cf790 2024-09-11T22:11:38.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c529b9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c0b7e30 con 0x7f5c4c161d30 2024-09-11T22:11:38.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c529b9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5c4c0d1600 con 0x7f5c4c0d11d0 2024-09-11T22:11:38.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c4bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c4c0cf790 0x7f5c4c1f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c4bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c4c0cf790 0x7f5c4c1f5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49230/0 (socket says 172.21.15.50:49230) 2024-09-11T22:11:38.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c4bfff640 1 -- 172.21.15.50:0/1690671712 learned_addr learned my addr 172.21.15.50:0/1690671712 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c4b7fe640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c4c0d11d0 0x7f5c4c1f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c50f56640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c4c161d30 0x7f5c4c1f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c4bfff640 1 -- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c4c0d11d0 msgr2=0x7f5c4c1f77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c4bfff640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c4c0d11d0 0x7f5c4c1f77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c4bfff640 1 -- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c4c161d30 msgr2=0x7f5c4c1f8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c4bfff640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c4c161d30 0x7f5c4c1f8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c4bfff640 1 -- 172.21.15.50:0/1690671712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c150960 con 0x7f5c4c0cf790 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c50f56640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c4c161d30 0x7f5c4c1f8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c4bfff640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c4c0cf790 0x7f5c4c1f5bd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c3c0 tx=0x7f5c3c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.319+0000 7f5c48ff9640 1 -- 172.21.15.50:0/1690671712 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0052d0 con 0x7f5c4c0cf790 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.320+0000 7f5c48ff9640 1 -- 172.21.15.50:0/1690671712 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c005490 con 0x7f5c4c0cf790 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.320+0000 7f5c529b9640 1 -- 172.21.15.50:0/1690671712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4c150c40 con 0x7f5c4c0cf790 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.320+0000 7f5c48ff9640 1 -- 172.21.15.50:0/1690671712 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c007260 con 0x7f5c4c0cf790 2024-09-11T22:11:38.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.320+0000 7f5c529b9640 1 -- 172.21.15.50:0/1690671712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4c151200 con 0x7f5c4c0cf790 2024-09-11T22:11:38.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.320+0000 7f5c529b9640 1 -- 172.21.15.50:0/1690671712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4c0d1900 con 0x7f5c4c0cf790 2024-09-11T22:11:38.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.321+0000 7f5c48ff9640 1 -- 172.21.15.50:0/1690671712 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c3c007400 con 0x7f5c4c0cf790 2024-09-11T22:11:38.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.321+0000 7f5c48ff9640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5c3806be30 0x7f5c3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.322+0000 7f5c48ff9640 1 -- 172.21.15.50:0/1690671712 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5c3c08a290 con 0x7f5c4c0cf790 2024-09-11T22:11:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.322+0000 7f5c4b7fe640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5c3806be30 0x7f5c3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.322+0000 7f5c4b7fe640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5c3806be30 0x7f5c3806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5c40034000 tx=0x7f5c4002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:38.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.326+0000 7f5c48ff9640 1 -- 172.21.15.50:0/1690671712 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c3c058cd0 con 0x7f5c4c0cf790 2024-09-11T22:11:38.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.501+0000 7f5c529b9640 1 -- 172.21.15.50:0/1690671712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5c4c0d2900 con 0x7f5c4c0cf790 2024-09-11T22:11:38.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.501+0000 7f5c48ff9640 1 -- 172.21.15.50:0/1690671712 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f5c3c0585d0 con 0x7f5c4c0cf790 2024-09-11T22:11:38.502 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-11T22:11:38.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.503+0000 7f5c529b9640 1 -- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5c3806be30 msgr2=0x7f5c3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.503+0000 7f5c529b9640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5c3806be30 0x7f5c3806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5c40034000 tx=0x7f5c4002e000 comp rx=0 tx=0).stop 2024-09-11T22:11:38.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.503+0000 7f5c529b9640 1 -- 172.21.15.50:0/1690671712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c4c0cf790 msgr2=0x7f5c4c1f5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.503+0000 7f5c529b9640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c4c0cf790 0x7f5c4c1f5bd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c3c0 tx=0x7f5c3c00c880 comp rx=0 tx=0).stop 2024-09-11T22:11:38.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.503+0000 7f5c529b9640 1 -- 172.21.15.50:0/1690671712 shutdown_connections 2024-09-11T22:11:38.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.503+0000 7f5c529b9640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5c3806be30 0x7f5c3806e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.503+0000 7f5c529b9640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c4c0d11d0 0x7f5c4c1f77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.503+0000 7f5c529b9640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c4c161d30 0x7f5c4c1f8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.503+0000 7f5c529b9640 1 --2- 172.21.15.50:0/1690671712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c4c0cf790 0x7f5c4c1f5bd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.503+0000 7f5c529b9640 1 -- 172.21.15.50:0/1690671712 >> 172.21.15.50:0/1690671712 conn(0x7f5c4c0727a0 msgr2=0x7f5c4c0b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:38.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.503+0000 7f5c529b9640 1 -- 172.21.15.50:0/1690671712 shutdown_connections 2024-09-11T22:11:38.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.503+0000 7f5c529b9640 1 -- 172.21.15.50:0/1690671712 wait complete. 2024-09-11T22:11:38.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T22:11:38.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.619+0000 7f96e0a53640 1 Processor -- start 2024-09-11T22:11:38.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.619+0000 7f96e0a53640 1 -- start start 2024-09-11T22:11:38.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.620+0000 7f96e0a53640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96dc0d18a0 0x7f96dc0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.620+0000 7f96e0a53640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0d3a30 0x7f96dc0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.620+0000 7f96e0a53640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96dc0cfa80 con 0x7f96dc15e870 2024-09-11T22:11:38.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.620+0000 7f96e0a53640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f96dc0d3ea0 con 0x7f96dc0d18a0 2024-09-11T22:11:38.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.620+0000 7f96e0a53640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f96dc0d40d0 con 0x7f96dc0d3a30 2024-09-11T22:11:38.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.620+0000 7f96d1d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96dc0d18a0 0x7f96dc0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.620+0000 7f96da59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f96dc15e870 0x7f96dc0d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49072/0 (socket says 172.21.15.50:49072) 2024-09-11T22:11:38.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.620+0000 7f96da59c640 1 -- 172.21.15.50:0/4206984032 learned_addr learned my addr 172.21.15.50:0/4206984032 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.620+0000 7f96dad9d640 1 --2- 172.21.15.50:0/4206984032 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0d3a30 0x7f96dc0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.620+0000 7f96d1d9b640 1 -- 172.21.15.50:0/4206984032 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0d3a30 msgr2=0x7f96dc0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.620+0000 7f96d1d9b640 1 --2- 172.21.15.50:0/4206984032 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0d3a30 0x7f96dc0b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.620+0000 7f96d1d9b640 1 -- 172.21.15.50:0/4206984032 >> v1:172.21.15.50:6789/0 conn(0x7f96dc15e870 legacy=0x7f96dc0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.620+0000 7f96d1d9b640 1 -- 172.21.15.50:0/4206984032 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc0d43b0 con 0x7f96dc0d18a0 2024-09-11T22:11:38.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.621+0000 7f96d1d9b640 1 --2- 172.21.15.50:0/4206984032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96dc0d18a0 0x7f96dc0d34f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f96c40097a0 tx=0x7f96c402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1307a1d86adb9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:38.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.621+0000 7f96d9d9b640 1 -- 172.21.15.50:0/4206984032 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4037070 con 0x7f96dc0d18a0 2024-09-11T22:11:38.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.621+0000 7f96d9d9b640 1 -- 172.21.15.50:0/4206984032 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c4032440 con 0x7f96dc0d18a0 2024-09-11T22:11:38.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.621+0000 7f96d9d9b640 1 -- 172.21.15.50:0/4206984032 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4032810 con 0x7f96dc0d18a0 2024-09-11T22:11:38.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.622+0000 7f96e0a53640 1 -- 172.21.15.50:0/4206984032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96dc0d18a0 msgr2=0x7f96dc0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.622+0000 7f96e0a53640 1 --2- 172.21.15.50:0/4206984032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96dc0d18a0 0x7f96dc0d34f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f96c40097a0 tx=0x7f96c402a180 comp rx=0 tx=0).stop 2024-09-11T22:11:38.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.622+0000 7f96e0a53640 1 -- 172.21.15.50:0/4206984032 shutdown_connections 2024-09-11T22:11:38.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.622+0000 7f96e0a53640 1 --2- 172.21.15.50:0/4206984032 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0d3a30 0x7f96dc0b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.622+0000 7f96e0a53640 1 --2- 172.21.15.50:0/4206984032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96dc0d18a0 0x7f96dc0d34f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.622+0000 7f96e0a53640 1 -- 172.21.15.50:0/4206984032 >> 172.21.15.50:0/4206984032 conn(0x7f96dc0727a0 msgr2=0x7f96dc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:38.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.622+0000 7f96e0a53640 1 -- 172.21.15.50:0/4206984032 shutdown_connections 2024-09-11T22:11:38.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.622+0000 7f96e0a53640 1 -- 172.21.15.50:0/4206984032 wait complete. 2024-09-11T22:11:38.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.623+0000 7f96e0a53640 1 Processor -- start 2024-09-11T22:11:38.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.623+0000 7f96e0a53640 1 -- start start 2024-09-11T22:11:38.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96e0a53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96dc0d18a0 0x7f96dc0b9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96e0a53640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0d3a30 0x7f96dc15add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96e0a53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc15e870 0x7f96dc0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96e0a53640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc15ec50 con 0x7f96dc0d18a0 2024-09-11T22:11:38.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96e0a53640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc0b7ee0 con 0x7f96dc15e870 2024-09-11T22:11:38.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96e0a53640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f96dc0b78b0 con 0x7f96dc0d3a30 2024-09-11T22:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96da59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96dc0d18a0 0x7f96dc0b9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96da59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96dc0d18a0 0x7f96dc0b9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49252/0 (socket says 172.21.15.50:49252) 2024-09-11T22:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96da59c640 1 -- 172.21.15.50:0/4035196562 learned_addr learned my addr 172.21.15.50:0/4035196562 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96d1d9b640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0d3a30 0x7f96dc15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96dad9d640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc15e870 0x7f96dc0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96da59c640 1 -- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0d3a30 msgr2=0x7f96dc15add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96da59c640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0d3a30 0x7f96dc15add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96da59c640 1 -- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc15e870 msgr2=0x7f96dc0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96da59c640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc15e870 0x7f96dc0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.624+0000 7f96da59c640 1 -- 172.21.15.50:0/4035196562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc15b780 con 0x7f96dc0d18a0 2024-09-11T22:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.625+0000 7f96da59c640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96dc0d18a0 0x7f96dc0b9610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00c400 tx=0x7f96cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.625+0000 7f96d37fe640 1 -- 172.21.15.50:0/4035196562 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc017070 con 0x7f96dc0d18a0 2024-09-11T22:11:38.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.625+0000 7f96d37fe640 1 -- 172.21.15.50:0/4035196562 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96cc005ce0 con 0x7f96dc0d18a0 2024-09-11T22:11:38.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.625+0000 7f96e0a53640 1 -- 172.21.15.50:0/4035196562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96dc158aa0 con 0x7f96dc0d18a0 2024-09-11T22:11:38.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.625+0000 7f96d37fe640 1 -- 172.21.15.50:0/4035196562 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc007310 con 0x7f96dc0d18a0 2024-09-11T22:11:38.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.625+0000 7f96e0a53640 1 -- 172.21.15.50:0/4035196562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96dc159060 con 0x7f96dc0d18a0 2024-09-11T22:11:38.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.626+0000 7f96e0a53640 1 -- 172.21.15.50:0/4035196562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96dc0d34f0 con 0x7f96dc0d18a0 2024-09-11T22:11:38.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.626+0000 7f96d37fe640 1 -- 172.21.15.50:0/4035196562 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96cc01a070 con 0x7f96dc0d18a0 2024-09-11T22:11:38.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.627+0000 7f96d37fe640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96bc06be30 0x7f96bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.627+0000 7f96d37fe640 1 -- 172.21.15.50:0/4035196562 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f96cc08a290 con 0x7f96dc0d18a0 2024-09-11T22:11:38.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.627+0000 7f96d1d9b640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96bc06be30 0x7f96bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.627+0000 7f96d1d9b640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96bc06be30 0x7f96bc06e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f96c4034000 tx=0x7f96c402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:38.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.631+0000 7f96d37fe640 1 -- 172.21.15.50:0/4035196562 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96dc0cfa80 con 0x7f96dc0d18a0 2024-09-11T22:11:38.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.807+0000 7f96e0a53640 1 -- 172.21.15.50:0/4035196562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f96dc0d1630 con 0x7f96dc0d18a0 2024-09-11T22:11:38.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.807+0000 7f96d37fe640 1 -- 172.21.15.50:0/4035196562 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f96cc058c40 con 0x7f96dc0d18a0 2024-09-11T22:11:38.808 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-11T22:11:38.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.810+0000 7f96e0a53640 1 -- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96bc06be30 msgr2=0x7f96bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.810+0000 7f96e0a53640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96bc06be30 0x7f96bc06e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f96c4034000 tx=0x7f96c402e000 comp rx=0 tx=0).stop 2024-09-11T22:11:38.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.810+0000 7f96e0a53640 1 -- 172.21.15.50:0/4035196562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96dc0d18a0 msgr2=0x7f96dc0b9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.810+0000 7f96e0a53640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96dc0d18a0 0x7f96dc0b9610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00c400 tx=0x7f96cc00c8c0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.810+0000 7f96e0a53640 1 -- 172.21.15.50:0/4035196562 shutdown_connections 2024-09-11T22:11:38.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.810+0000 7f96e0a53640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96bc06be30 0x7f96bc06e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.810+0000 7f96e0a53640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0d3a30 0x7f96dc15add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.810+0000 7f96e0a53640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc15e870 0x7f96dc0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.810+0000 7f96e0a53640 1 --2- 172.21.15.50:0/4035196562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96dc0d18a0 0x7f96dc0b9610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.810+0000 7f96e0a53640 1 -- 172.21.15.50:0/4035196562 >> 172.21.15.50:0/4035196562 conn(0x7f96dc0727a0 msgr2=0x7f96dc161130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:38.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.810+0000 7f96e0a53640 1 -- 172.21.15.50:0/4035196562 shutdown_connections 2024-09-11T22:11:38.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.810+0000 7f96e0a53640 1 -- 172.21.15.50:0/4035196562 wait complete. 2024-09-11T22:11:38.821 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-11T22:11:38.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.925+0000 7fe6dc480640 1 Processor -- start 2024-09-11T22:11:38.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.925+0000 7fe6dc480640 1 -- start start 2024-09-11T22:11:38.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.926+0000 7fe6dc480640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6d415e670 0x7fe6d406fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.926+0000 7fe6dc480640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6d415ea50 0x7fe6d4162460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.926+0000 7fe6dc480640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6d4070360 con 0x7fe6d41629a0 2024-09-11T22:11:38.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.926+0000 7fe6dc480640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe6d4070640 con 0x7fe6d415ea50 2024-09-11T22:11:38.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.926+0000 7fe6dc480640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d406bbf0 con 0x7fe6d415e670 2024-09-11T22:11:38.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.926+0000 7fe6d9a1b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6d415ea50 0x7fe6d4162460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.926+0000 7fe6daa1d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe6d41629a0 0x7fe6d4162df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49088/0 (socket says 172.21.15.50:49088) 2024-09-11T22:11:38.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.926+0000 7fe6daa1d640 1 -- 172.21.15.50:0/1352622859 learned_addr learned my addr 172.21.15.50:0/1352622859 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:38.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.926+0000 7fe6da21c640 1 --2- 172.21.15.50:0/1352622859 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6d415e670 0x7fe6d406fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.927+0000 7fe6d9a1b640 1 -- 172.21.15.50:0/1352622859 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6d415e670 msgr2=0x7fe6d406fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:38.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.927+0000 7fe6d9a1b640 1 --2- 172.21.15.50:0/1352622859 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6d415e670 0x7fe6d406fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.927+0000 7fe6d9a1b640 1 -- 172.21.15.50:0/1352622859 >> v1:172.21.15.50:6789/0 conn(0x7fe6d41629a0 legacy=0x7fe6d4162df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.927+0000 7fe6d9a1b640 1 -- 172.21.15.50:0/1352622859 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d406bed0 con 0x7fe6d415ea50 2024-09-11T22:11:38.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.927+0000 7fe6d921a640 1 -- 172.21.15.50:0/1352622859 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049063662 0 0) 0x7fe6d4070360 con 0x7fe6d41629a0 2024-09-11T22:11:38.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.927+0000 7fe6d9a1b640 1 --2- 172.21.15.50:0/1352622859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d415ea50 0x7fe6d4162460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40097d0 tx=0x7fe6c402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e9fc39e5b7609b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:38.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.927+0000 7fe6d921a640 1 -- 172.21.15.50:0/1352622859 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4037070 con 0x7fe6d415ea50 2024-09-11T22:11:38.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.927+0000 7fe6d921a640 1 -- 172.21.15.50:0/1352622859 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c4032440 con 0x7fe6d415ea50 2024-09-11T22:11:38.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.927+0000 7fe6d921a640 1 -- 172.21.15.50:0/1352622859 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4032810 con 0x7fe6d415ea50 2024-09-11T22:11:38.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.928+0000 7fe6dc480640 1 -- 172.21.15.50:0/1352622859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d415ea50 msgr2=0x7fe6d4162460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.928+0000 7fe6dc480640 1 --2- 172.21.15.50:0/1352622859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d415ea50 0x7fe6d4162460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40097d0 tx=0x7fe6c402a1c0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.928+0000 7fe6dc480640 1 -- 172.21.15.50:0/1352622859 shutdown_connections 2024-09-11T22:11:38.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.928+0000 7fe6dc480640 1 --2- 172.21.15.50:0/1352622859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d415ea50 0x7fe6d4162460 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.928+0000 7fe6dc480640 1 --2- 172.21.15.50:0/1352622859 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6d415e670 0x7fe6d406fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.928+0000 7fe6dc480640 1 -- 172.21.15.50:0/1352622859 >> 172.21.15.50:0/1352622859 conn(0x7fe6d40b4150 msgr2=0x7fe6d40b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:38.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.928+0000 7fe6dc480640 1 -- 172.21.15.50:0/1352622859 shutdown_connections 2024-09-11T22:11:38.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.928+0000 7fe6dc480640 1 -- 172.21.15.50:0/1352622859 wait complete. 2024-09-11T22:11:38.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.929+0000 7fe6dc480640 1 Processor -- start 2024-09-11T22:11:38.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.929+0000 7fe6dc480640 1 -- start start 2024-09-11T22:11:38.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.930+0000 7fe6dc480640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6d415e670 0x7fe6d4161660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.930+0000 7fe6dc480640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d415ea50 0x7fe6d40d11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.930+0000 7fe6dc480640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d41629a0 0x7fe6d414c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.930+0000 7fe6dc480640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d406c850 con 0x7fe6d415ea50 2024-09-11T22:11:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.930+0000 7fe6dc480640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d406c6d0 con 0x7fe6d41629a0 2024-09-11T22:11:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.930+0000 7fe6dc480640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d406c9d0 con 0x7fe6d415e670 2024-09-11T22:11:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.930+0000 7fe6d9a1b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d415ea50 0x7fe6d40d11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.930+0000 7fe6d9a1b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d415ea50 0x7fe6d40d11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49268/0 (socket says 172.21.15.50:49268) 2024-09-11T22:11:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.930+0000 7fe6d9a1b640 1 -- 172.21.15.50:0/3017290535 learned_addr learned my addr 172.21.15.50:0/3017290535 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.930+0000 7fe6da21c640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6d415e670 0x7fe6d4161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.930+0000 7fe6daa1d640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d41629a0 0x7fe6d414c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.931+0000 7fe6d9a1b640 1 -- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6d415e670 msgr2=0x7fe6d4161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.931+0000 7fe6d9a1b640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6d415e670 0x7fe6d4161660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.931+0000 7fe6d9a1b640 1 -- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d41629a0 msgr2=0x7fe6d414c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.931+0000 7fe6d9a1b640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d41629a0 0x7fe6d414c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.931+0000 7fe6d9a1b640 1 -- 172.21.15.50:0/3017290535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d4158180 con 0x7fe6d415ea50 2024-09-11T22:11:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.931+0000 7fe6daa1d640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d41629a0 0x7fe6d414c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:38.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.931+0000 7fe6d9a1b640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d415ea50 0x7fe6d40d11d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4035040 tx=0x7fe6c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:38.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.931+0000 7fe6caffd640 1 -- 172.21.15.50:0/3017290535 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4037040 con 0x7fe6d415ea50 2024-09-11T22:11:38.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.931+0000 7fe6caffd640 1 -- 172.21.15.50:0/3017290535 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c4030500 con 0x7fe6d415ea50 2024-09-11T22:11:38.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.931+0000 7fe6dc480640 1 -- 172.21.15.50:0/3017290535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d40b7790 con 0x7fe6d415ea50 2024-09-11T22:11:38.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.931+0000 7fe6caffd640 1 -- 172.21.15.50:0/3017290535 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4030910 con 0x7fe6d415ea50 2024-09-11T22:11:38.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.931+0000 7fe6dc480640 1 -- 172.21.15.50:0/3017290535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d40b7d50 con 0x7fe6d415ea50 2024-09-11T22:11:38.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.932+0000 7fe6dc480640 1 -- 172.21.15.50:0/3017290535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d406fd10 con 0x7fe6d415ea50 2024-09-11T22:11:38.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.932+0000 7fe6caffd640 1 -- 172.21.15.50:0/3017290535 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6c4044020 con 0x7fe6d415ea50 2024-09-11T22:11:38.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.933+0000 7fe6caffd640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6b806be30 0x7fe6b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:38.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.933+0000 7fe6caffd640 1 -- 172.21.15.50:0/3017290535 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe6c40ab0a0 con 0x7fe6d415ea50 2024-09-11T22:11:38.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.933+0000 7fe6da21c640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6b806be30 0x7fe6b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:38.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.933+0000 7fe6da21c640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6b806be30 0x7fe6b806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0009b40 tx=0x7fe6d0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:38.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:38.937+0000 7fe6caffd640 1 -- 172.21.15.50:0/3017290535 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6c40799c0 con 0x7fe6d415ea50 2024-09-11T22:11:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.181+0000 7fe6dc480640 1 -- 172.21.15.50:0/3017290535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7fe6d4163150 con 0x7fe6d415ea50 2024-09-11T22:11:39.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.929+0000 7fe6caffd640 1 -- 172.21.15.50:0/3017290535 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v45) ==== 151+0+0 (secure 0 0 0) 0x7fe6c40792c0 con 0x7fe6d415ea50 2024-09-11T22:11:39.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.932+0000 7fe6dc480640 1 -- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6b806be30 msgr2=0x7fe6b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:39.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.932+0000 7fe6dc480640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6b806be30 0x7fe6b806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0009b40 tx=0x7fe6d0009190 comp rx=0 tx=0).stop 2024-09-11T22:11:39.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.932+0000 7fe6dc480640 1 -- 172.21.15.50:0/3017290535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d415ea50 msgr2=0x7fe6d40d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.932+0000 7fe6dc480640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d415ea50 0x7fe6d40d11d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4035040 tx=0x7fe6c40046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.933+0000 7fe6dc480640 1 -- 172.21.15.50:0/3017290535 shutdown_connections 2024-09-11T22:11:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.933+0000 7fe6dc480640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6b806be30 0x7fe6b806e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.933+0000 7fe6dc480640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d41629a0 0x7fe6d414c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.933+0000 7fe6dc480640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6d415ea50 0x7fe6d40d11d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.933+0000 7fe6dc480640 1 --2- 172.21.15.50:0/3017290535 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6d415e670 0x7fe6d4161660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.933+0000 7fe6dc480640 1 -- 172.21.15.50:0/3017290535 >> 172.21.15.50:0/3017290535 conn(0x7fe6d40b4150 msgr2=0x7fe6d40d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.933+0000 7fe6dc480640 1 -- 172.21.15.50:0/3017290535 shutdown_connections 2024-09-11T22:11:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:39.933+0000 7fe6dc480640 1 -- 172.21.15.50:0/3017290535 wait complete. 2024-09-11T22:11:39.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T22:11:40.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.058+0000 7f85d359e640 1 Processor -- start 2024-09-11T22:11:40.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.058+0000 7f85d359e640 1 -- start start 2024-09-11T22:11:40.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.059+0000 7f85d359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85d40b3dc0 0x7f85d4165e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:40.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.059+0000 7f85d359e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d40b55d0 con 0x7f85d4155940 2024-09-11T22:11:40.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.059+0000 7f85d359e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d4072410 con 0x7f85d406e800 2024-09-11T22:11:40.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.059+0000 7f85d359e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f85d4155d20 con 0x7f85d40b3dc0 2024-09-11T22:11:40.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.059+0000 7f85d259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f85d4155940 0x7f85d406e0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49102/0 (socket says 172.21.15.50:49102) 2024-09-11T22:11:40.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.059+0000 7f85d259c640 1 -- 172.21.15.50:0/866112869 learned_addr learned my addr 172.21.15.50:0/866112869 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:40.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.059+0000 7f85d2d9d640 1 --2- 172.21.15.50:0/866112869 >> v2:172.21.15.50:3300/0 conn(0x7f85d40b3dc0 0x7f85d4165e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:40.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.059+0000 7f85d159a640 1 -- 172.21.15.50:0/866112869 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3366084823 0 0) 0x7f85d40b55d0 con 0x7f85d4155940 2024-09-11T22:11:40.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.059+0000 7f85d159a640 1 -- 172.21.15.50:0/866112869 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85c0003520 con 0x7f85d4155940 2024-09-11T22:11:40.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.060+0000 7f85d2d9d640 1 -- 172.21.15.50:0/866112869 >> v1:172.21.15.77:6789/0 conn(0x7f85d406e800 legacy=0x7f85d40b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:40.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.060+0000 7f85d2d9d640 1 -- 172.21.15.50:0/866112869 >> v1:172.21.15.50:6789/0 conn(0x7f85d4155940 legacy=0x7f85d406e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:40.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.060+0000 7f85d2d9d640 1 -- 172.21.15.50:0/866112869 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d40726f0 con 0x7f85d40b3dc0 2024-09-11T22:11:40.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.060+0000 7f85d2d9d640 1 --2- 172.21.15.50:0/866112869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d40b3dc0 0x7f85d4165e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0097a0 tx=0x7f85cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc95ddbb33d2429 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:40.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.060+0000 7f85d159a640 1 -- 172.21.15.50:0/866112869 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc037070 con 0x7f85d40b3dc0 2024-09-11T22:11:40.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.060+0000 7f85d159a640 1 -- 172.21.15.50:0/866112869 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc032440 con 0x7f85d40b3dc0 2024-09-11T22:11:40.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.060+0000 7f85d159a640 1 -- 172.21.15.50:0/866112869 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc032810 con 0x7f85d40b3dc0 2024-09-11T22:11:40.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.061+0000 7f85d359e640 1 -- 172.21.15.50:0/866112869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d40b3dc0 msgr2=0x7f85d4165e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:40.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.061+0000 7f85d359e640 1 --2- 172.21.15.50:0/866112869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d40b3dc0 0x7f85d4165e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0097a0 tx=0x7f85cc02a1e0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.061+0000 7f85d359e640 1 -- 172.21.15.50:0/866112869 shutdown_connections 2024-09-11T22:11:40.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.061+0000 7f85d359e640 1 --2- 172.21.15.50:0/866112869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d40b3dc0 0x7f85d4165e20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.061+0000 7f85d359e640 1 -- 172.21.15.50:0/866112869 >> 172.21.15.50:0/866112869 conn(0x7f85d40b5d70 msgr2=0x7f85d40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:40.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.061+0000 7f85d359e640 1 -- 172.21.15.50:0/866112869 shutdown_connections 2024-09-11T22:11:40.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.061+0000 7f85d359e640 1 -- 172.21.15.50:0/866112869 wait complete. 2024-09-11T22:11:40.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.062+0000 7f85d359e640 1 Processor -- start 2024-09-11T22:11:40.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.063+0000 7f85d359e640 1 -- start start 2024-09-11T22:11:40.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.063+0000 7f85d359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85d406e800 0x7f85d415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:40.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.063+0000 7f85d359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d40b3dc0 0x7f85d415a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:40.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.063+0000 7f85d359e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85d4155940 0x7f85d4152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:40.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.063+0000 7f85d359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f85d40731d0 con 0x7f85d40b3dc0 2024-09-11T22:11:40.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.063+0000 7f85d359e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f85d4072d40 con 0x7f85d406e800 2024-09-11T22:11:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.063+0000 7f85d359e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f85d406cfe0 con 0x7f85d4155940 2024-09-11T22:11:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.063+0000 7f85d1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d40b3dc0 0x7f85d415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.063+0000 7f85d1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d40b3dc0 0x7f85d415a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49296/0 (socket says 172.21.15.50:49296) 2024-09-11T22:11:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.063+0000 7f85d1d9b640 1 -- 172.21.15.50:0/3993321219 learned_addr learned my addr 172.21.15.50:0/3993321219 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.064+0000 7f85d259c640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85d406e800 0x7f85d415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.064+0000 7f85d2d9d640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85d4155940 0x7f85d4152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.064+0000 7f85d1d9b640 1 -- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85d4155940 msgr2=0x7f85d4152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.064+0000 7f85d1d9b640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85d4155940 0x7f85d4152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.064+0000 7f85d1d9b640 1 -- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85d406e800 msgr2=0x7f85d415a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.064+0000 7f85d1d9b640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85d406e800 0x7f85d415a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.064+0000 7f85d1d9b640 1 -- 172.21.15.50:0/3993321219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d4153aa0 con 0x7f85d40b3dc0 2024-09-11T22:11:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.064+0000 7f85d1d9b640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d40b3dc0 0x7f85d415a800 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00c430 tx=0x7f85bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.064+0000 7f85caffd640 1 -- 172.21.15.50:0/3993321219 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc011790 con 0x7f85d40b3dc0 2024-09-11T22:11:40.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.064+0000 7f85caffd640 1 -- 172.21.15.50:0/3993321219 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc017070 con 0x7f85d40b3dc0 2024-09-11T22:11:40.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.064+0000 7f85d359e640 1 -- 172.21.15.50:0/3993321219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d4153d80 con 0x7f85d40b3dc0 2024-09-11T22:11:40.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.064+0000 7f85caffd640 1 -- 172.21.15.50:0/3993321219 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc011bb0 con 0x7f85d40b3dc0 2024-09-11T22:11:40.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.064+0000 7f85d359e640 1 -- 172.21.15.50:0/3993321219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d4168420 con 0x7f85d40b3dc0 2024-09-11T22:11:40.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.065+0000 7f85d359e640 1 -- 172.21.15.50:0/3993321219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d40b36b0 con 0x7f85d40b3dc0 2024-09-11T22:11:40.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.066+0000 7f85caffd640 1 -- 172.21.15.50:0/3993321219 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85bc01c460 con 0x7f85d40b3dc0 2024-09-11T22:11:40.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.066+0000 7f85caffd640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f85b406be30 0x7f85b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:40.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.066+0000 7f85caffd640 1 -- 172.21.15.50:0/3993321219 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f85bc08ac60 con 0x7f85d40b3dc0 2024-09-11T22:11:40.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.066+0000 7f85d259c640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f85b406be30 0x7f85b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:40.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.067+0000 7f85d259c640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f85b406be30 0x7f85b406e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f85c4005c00 tx=0x7f85c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:40.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.071+0000 7f85caffd640 1 -- 172.21.15.50:0/3993321219 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85bc0596a0 con 0x7f85d40b3dc0 2024-09-11T22:11:40.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.248+0000 7f85d359e640 1 -- 172.21.15.50:0/3993321219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f85d40b2e70 con 0x7f85d40b3dc0 2024-09-11T22:11:40.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.251+0000 7f85caffd640 1 -- 172.21.15.50:0/3993321219 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f85bc058fa0 con 0x7f85d40b3dc0 2024-09-11T22:11:40.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.253+0000 7f85d359e640 1 -- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f85b406be30 msgr2=0x7f85b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:40.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.253+0000 7f85d359e640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f85b406be30 0x7f85b406e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f85c4005c00 tx=0x7f85c4009040 comp rx=0 tx=0).stop 2024-09-11T22:11:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.253+0000 7f85d359e640 1 -- 172.21.15.50:0/3993321219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d40b3dc0 msgr2=0x7f85d415a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.253+0000 7f85d359e640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d40b3dc0 0x7f85d415a800 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00c430 tx=0x7f85bc00c8f0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.253+0000 7f85d359e640 1 -- 172.21.15.50:0/3993321219 shutdown_connections 2024-09-11T22:11:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.253+0000 7f85d359e640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f85b406be30 0x7f85b406e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.253+0000 7f85d359e640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85d4155940 0x7f85d4152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.253+0000 7f85d359e640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d40b3dc0 0x7f85d415a800 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.253+0000 7f85d359e640 1 --2- 172.21.15.50:0/3993321219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85d406e800 0x7f85d415a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.253+0000 7f85d359e640 1 -- 172.21.15.50:0/3993321219 >> 172.21.15.50:0/3993321219 conn(0x7f85d40b5d70 msgr2=0x7f85d40cf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.253+0000 7f85d359e640 1 -- 172.21.15.50:0/3993321219 shutdown_connections 2024-09-11T22:11:40.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.253+0000 7f85d359e640 1 -- 172.21.15.50:0/3993321219 wait complete. 2024-09-11T22:11:40.265 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:11:40.265 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:11:40.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:11:40.345 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:11:40.345 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:11:40.346 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:40.364 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:11:40.364 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:40.420 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:11:40.421 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:40.477 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:11:40.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.619+0000 7ff1b5a7b640 1 Processor -- start 2024-09-11T22:11:40.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.620+0000 7ff1b5a7b640 1 -- start start 2024-09-11T22:11:40.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.620+0000 7ff1b5a7b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b015e870 0x7ff1b00d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:40.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.620+0000 7ff1b5a7b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1b00cfa80 con 0x7ff1b00d3c00 2024-09-11T22:11:40.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.620+0000 7ff1b5a7b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1b00d40d0 con 0x7ff1b00d16d0 2024-09-11T22:11:40.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.620+0000 7ff1b5a7b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b00d1b10 con 0x7ff1b015e870 2024-09-11T22:11:40.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1affff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff1b00d3c00 0x7ff1b00b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49116/0 (socket says 172.21.15.50:49116) 2024-09-11T22:11:40.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1affff640 1 -- 172.21.15.50:0/2429192106 learned_addr learned my addr 172.21.15.50:0/2429192106 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:40.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1af7fe640 1 --2- 172.21.15.50:0/2429192106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b015e870 0x7ff1b00d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:40.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906870765 0 0) 0x7ff1a8001490 con 0x7ff1b00d3c00 2024-09-11T22:11:40.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff198003520 con 0x7ff1b00d3c00 2024-09-11T22:11:40.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3034748665 0 0) 0x7ff198003520 con 0x7ff1b00d3c00 2024-09-11T22:11:40.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b015e870 msgr2=0x7ff1b00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:40.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 --2- 172.21.15.50:0/2429192106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b015e870 0x7ff1b00d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 >> v1:172.21.15.77:6789/0 conn(0x7ff1b00d16d0 legacy=0x7ff1b00d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:40.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b00d43b0 con 0x7ff1b00d3c00 2024-09-11T22:11:40.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7ff1a8001be0 con 0x7ff1b00d3c00 2024-09-11T22:11:40.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 >> v1:172.21.15.50:6789/0 conn(0x7ff1b00d3c00 legacy=0x7ff1b00b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:40.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 --2- 172.21.15.50:0/2429192106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1980039e0 0x7ff198003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:40.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 --2- 172.21.15.50:0/2429192106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b015e870 0x7ff198004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:40.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 --2- 172.21.15.50:0/2429192106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff198004d40 0x7ff1980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:40.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b00d1b10 con 0x7ff1980039e0 2024-09-11T22:11:40.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff19800b9c0 con 0x7ff198004d40 2024-09-11T22:11:40.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff19800bbc0 con 0x7ff1b015e870 2024-09-11T22:11:40.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1af7fe640 1 --2- 172.21.15.50:0/2429192106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1980039e0 0x7ff198003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:40.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1aeffd640 1 --2- 172.21.15.50:0/2429192106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b015e870 0x7ff198004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:40.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.621+0000 7ff1affff640 1 --2- 172.21.15.50:0/2429192106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff198004d40 0x7ff1980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:40.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.622+0000 7ff1af7fe640 1 -- 172.21.15.50:0/2429192106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b015e870 msgr2=0x7ff198004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:40.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.622+0000 7ff1af7fe640 1 --2- 172.21.15.50:0/2429192106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b015e870 0x7ff198004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.622+0000 7ff1af7fe640 1 -- 172.21.15.50:0/2429192106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff198004d40 msgr2=0x7ff1980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:40.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.622+0000 7ff1af7fe640 1 --2- 172.21.15.50:0/2429192106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff198004d40 0x7ff1980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.622+0000 7ff1af7fe640 1 -- 172.21.15.50:0/2429192106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff198003520 con 0x7ff1980039e0 2024-09-11T22:11:40.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.622+0000 7ff1af7fe640 1 --2- 172.21.15.50:0/2429192106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1980039e0 0x7ff198003dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009ac0 tx=0x7ff198005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a2c3b7d536213f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:40.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.622+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0036070 con 0x7ff1980039e0 2024-09-11T22:11:40.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.623+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a0031400 con 0x7ff1980039e0 2024-09-11T22:11:40.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.623+0000 7ff1ae7fc640 1 -- 172.21.15.50:0/2429192106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0009690 con 0x7ff1980039e0 2024-09-11T22:11:40.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.623+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2429192106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1980039e0 msgr2=0x7ff198003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:40.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.623+0000 7ff1b5a7b640 1 --2- 172.21.15.50:0/2429192106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1980039e0 0x7ff198003dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009ac0 tx=0x7ff198005830 comp rx=0 tx=0).stop 2024-09-11T22:11:40.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.623+0000 7ff1affff640 1 -- 172.21.15.50:0/2429192106 reap_dead start 2024-09-11T22:11:40.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.623+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2429192106 shutdown_connections 2024-09-11T22:11:40.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.623+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2429192106 >> 172.21.15.50:0/2429192106 conn(0x7ff1b00727a0 msgr2=0x7ff1b00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:40.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.623+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2429192106 shutdown_connections 2024-09-11T22:11:40.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.623+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2429192106 wait complete. 2024-09-11T22:11:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.624+0000 7ff1b5a7b640 1 Processor -- start 2024-09-11T22:11:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.624+0000 7ff1b5a7b640 1 -- start start 2024-09-11T22:11:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.625+0000 7ff1b5a7b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1980039e0 0x7ff1b0157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.625+0000 7ff1b5a7b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b00cda20 0x7ff1b00cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.625+0000 7ff1b5a7b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b01f7b50 0x7ff1b01f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.625+0000 7ff1b5a7b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b015ec50 con 0x7ff1b01f7b50 2024-09-11T22:11:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.625+0000 7ff1b5a7b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b00b7ee0 con 0x7ff1980039e0 2024-09-11T22:11:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.625+0000 7ff1b5a7b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b00b78b0 con 0x7ff1b00cda20 2024-09-11T22:11:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.625+0000 7ff1affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b01f7b50 0x7ff1b01f7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.625+0000 7ff1affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b01f7b50 0x7ff1b01f7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49316/0 (socket says 172.21.15.50:49316) 2024-09-11T22:11:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.625+0000 7ff1affff640 1 -- 172.21.15.50:0/2993870036 learned_addr learned my addr 172.21.15.50:0/2993870036 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.625+0000 7ff1af7fe640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1980039e0 0x7ff1b0157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.625+0000 7ff1aeffd640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b00cda20 0x7ff1b00cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.626+0000 7ff1affff640 1 -- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b00cda20 msgr2=0x7ff1b00cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.626+0000 7ff1affff640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b00cda20 0x7ff1b00cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.626+0000 7ff1affff640 1 -- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1980039e0 msgr2=0x7ff1b0157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.626+0000 7ff1affff640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1980039e0 0x7ff1b0157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.626+0000 7ff1affff640 1 -- 172.21.15.50:0/2993870036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b01f8880 con 0x7ff1b01f7b50 2024-09-11T22:11:40.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.626+0000 7ff1aeffd640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b00cda20 0x7ff1b00cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.626+0000 7ff1affff640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b01f7b50 0x7ff1b01f7fd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8000f80 tx=0x7ff1a800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.626+0000 7ff197fff640 1 -- 172.21.15.50:0/2993870036 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8017020 con 0x7ff1b01f7b50 2024-09-11T22:11:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.626+0000 7ff197fff640 1 -- 172.21.15.50:0/2993870036 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a8007980 con 0x7ff1b01f7b50 2024-09-11T22:11:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.626+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2993870036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b0160ce0 con 0x7ff1b01f7b50 2024-09-11T22:11:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.626+0000 7ff197fff640 1 -- 172.21.15.50:0/2993870036 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8013610 con 0x7ff1b01f7b50 2024-09-11T22:11:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.626+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2993870036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b0157d40 con 0x7ff1b01f7b50 2024-09-11T22:11:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.627+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2993870036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b00d1190 con 0x7ff1b01f7b50 2024-09-11T22:11:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.627+0000 7ff197fff640 1 -- 172.21.15.50:0/2993870036 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1a801a020 con 0x7ff1b01f7b50 2024-09-11T22:11:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.628+0000 7ff197fff640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff19c06be30 0x7ff19c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.628+0000 7ff197fff640 1 -- 172.21.15.50:0/2993870036 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff1a808b5e0 con 0x7ff1b01f7b50 2024-09-11T22:11:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.628+0000 7ff1af7fe640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff19c06be30 0x7ff19c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.629+0000 7ff1af7fe640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff19c06be30 0x7ff19c06e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0033000 tx=0x7ff1a0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:40.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.632+0000 7ff197fff640 1 -- 172.21.15.50:0/2993870036 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1a8021020 con 0x7ff1b01f7b50 2024-09-11T22:11:40.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.820+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2993870036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff1b00b4760 con 0x7ff1b01f7b50 2024-09-11T22:11:40.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.820+0000 7ff197fff640 1 -- 172.21.15.50:0/2993870036 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7ff1b00cfa80 con 0x7ff1b01f7b50 2024-09-11T22:11:40.822 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:11:40.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.823+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff19c06be30 msgr2=0x7ff19c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:40.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.823+0000 7ff1b5a7b640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff19c06be30 0x7ff19c06e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0033000 tx=0x7ff1a0008030 comp rx=0 tx=0).stop 2024-09-11T22:11:40.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.823+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2993870036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b01f7b50 msgr2=0x7ff1b01f7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:40.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.823+0000 7ff1b5a7b640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b01f7b50 0x7ff1b01f7fd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8000f80 tx=0x7ff1a800aec0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.823+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2993870036 shutdown_connections 2024-09-11T22:11:40.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.823+0000 7ff1b5a7b640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff19c06be30 0x7ff19c06e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.823+0000 7ff1b5a7b640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1b00cda20 0x7ff1b00cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.823+0000 7ff1b5a7b640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1b01f7b50 0x7ff1b01f7fd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.823+0000 7ff1b5a7b640 1 --2- 172.21.15.50:0/2993870036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1980039e0 0x7ff1b0157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:40.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.823+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2993870036 >> 172.21.15.50:0/2993870036 conn(0x7ff1b00727a0 msgr2=0x7ff1b00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:40.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.823+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2993870036 shutdown_connections 2024-09-11T22:11:40.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:40.823+0000 7ff1b5a7b640 1 -- 172.21.15.50:0/2993870036 wait complete. 2024-09-11T22:11:40.835 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:11:40.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:40.835 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-11T22:11:40.862 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:11:40.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:40.862 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:11:40.925 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:11:40.926 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:40.945 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:11:40.945 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:41.004 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:11:41.005 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:41.062 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:11:41.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.165+0000 7f0924f6d640 1 Processor -- start 2024-09-11T22:11:41.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.165+0000 7f0924f6d640 1 -- start start 2024-09-11T22:11:41.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.166+0000 7f0924f6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0920162a60 0x7f09200b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:41.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.166+0000 7f0924f6d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0920163080 con 0x7f092015e8e0 2024-09-11T22:11:41.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.166+0000 7f0924f6d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09200d2d20 con 0x7f09200d1c90 2024-09-11T22:11:41.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.166+0000 7f0924f6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f092015ecc0 con 0x7f0920162a60 2024-09-11T22:11:41.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.166+0000 7f091e59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f092015e8e0 0x7f09200d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49130/0 (socket says 172.21.15.50:49130) 2024-09-11T22:11:41.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.166+0000 7f091ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0920162a60 0x7f09200b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:41.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.166+0000 7f091e59c640 1 -- 172.21.15.50:0/3746596979 learned_addr learned my addr 172.21.15.50:0/3746596979 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:41.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.167+0000 7f091ed9d640 1 -- 172.21.15.50:0/3746596979 >> v1:172.21.15.77:6789/0 conn(0x7f09200d1c90 legacy=0x7f0920162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:41.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.167+0000 7f091ed9d640 1 -- 172.21.15.50:0/3746596979 >> v1:172.21.15.50:6789/0 conn(0x7f092015e8e0 legacy=0x7f09200d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:41.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.167+0000 7f091ed9d640 1 -- 172.21.15.50:0/3746596979 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09200d3000 con 0x7f0920162a60 2024-09-11T22:11:41.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.167+0000 7f091d59a640 1 -- 172.21.15.50:0/3746596979 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874045920 0 0) 0x7f0920163080 con 0x7f092015e8e0 2024-09-11T22:11:41.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.167+0000 7f091ed9d640 1 --2- 172.21.15.50:0/3746596979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920162a60 0x7f09200b7880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0910009d90 tx=0x7f091002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e5550c1cd102a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.168+0000 7f091d59a640 1 -- 172.21.15.50:0/3746596979 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0910007740 con 0x7f0920162a60 2024-09-11T22:11:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.168+0000 7f091d59a640 1 -- 172.21.15.50:0/3746596979 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09100078e0 con 0x7f0920162a60 2024-09-11T22:11:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.168+0000 7f091d59a640 1 -- 172.21.15.50:0/3746596979 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0910007cb0 con 0x7f0920162a60 2024-09-11T22:11:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.168+0000 7f0924f6d640 1 -- 172.21.15.50:0/3746596979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920162a60 msgr2=0x7f09200b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.168+0000 7f0924f6d640 1 --2- 172.21.15.50:0/3746596979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920162a60 0x7f09200b7880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0910009d90 tx=0x7f091002a730 comp rx=0 tx=0).stop 2024-09-11T22:11:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.168+0000 7f0924f6d640 1 -- 172.21.15.50:0/3746596979 shutdown_connections 2024-09-11T22:11:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.168+0000 7f0924f6d640 1 --2- 172.21.15.50:0/3746596979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920162a60 0x7f09200b7880 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.168+0000 7f0924f6d640 1 -- 172.21.15.50:0/3746596979 >> 172.21.15.50:0/3746596979 conn(0x7f0920067ba0 msgr2=0x7f0920067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.168+0000 7f0924f6d640 1 -- 172.21.15.50:0/3746596979 shutdown_connections 2024-09-11T22:11:41.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.168+0000 7f0924f6d640 1 -- 172.21.15.50:0/3746596979 wait complete. 2024-09-11T22:11:41.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.170+0000 7f0924f6d640 1 Processor -- start 2024-09-11T22:11:41.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.170+0000 7f0924f6d640 1 -- start start 2024-09-11T22:11:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.170+0000 7f0924f6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09200d1c90 0x7f092014cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.170+0000 7f0924f6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092015e8e0 0x7f09200cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.170+0000 7f0924f6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0920162a60 0x7f09200cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.170+0000 7f0924f6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09200d3c10 con 0x7f092015e8e0 2024-09-11T22:11:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.170+0000 7f0924f6d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f09200d3a90 con 0x7f09200d1c90 2024-09-11T22:11:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.170+0000 7f0924f6d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f09200d3d90 con 0x7f0920162a60 2024-09-11T22:11:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.170+0000 7f091dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092015e8e0 0x7f09200cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.170+0000 7f091dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092015e8e0 0x7f09200cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49330/0 (socket says 172.21.15.50:49330) 2024-09-11T22:11:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.170+0000 7f091dd9b640 1 -- 172.21.15.50:0/2545663993 learned_addr learned my addr 172.21.15.50:0/2545663993 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f091e59c640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09200d1c90 0x7f092014cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f091ed9d640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0920162a60 0x7f09200cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:41.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f091dd9b640 1 -- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0920162a60 msgr2=0x7f09200cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f091dd9b640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0920162a60 0x7f09200cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f091dd9b640 1 -- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09200d1c90 msgr2=0x7f092014cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f091dd9b640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09200d1c90 0x7f092014cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f091dd9b640 1 -- 172.21.15.50:0/2545663993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0920150410 con 0x7f092015e8e0 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f091e59c640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09200d1c90 0x7f092014cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f091ed9d640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0920162a60 0x7f09200cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f091dd9b640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092015e8e0 0x7f09200cc2d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f090800c410 tx=0x7f090800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f0916ffd640 1 -- 172.21.15.50:0/2545663993 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908017070 con 0x7f092015e8e0 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f0916ffd640 1 -- 172.21.15.50:0/2545663993 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09080035f0 con 0x7f092015e8e0 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f0924f6d640 1 -- 172.21.15.50:0/2545663993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09200cce90 con 0x7f092015e8e0 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f0916ffd640 1 -- 172.21.15.50:0/2545663993 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908003a20 con 0x7f092015e8e0 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.171+0000 7f0924f6d640 1 -- 172.21.15.50:0/2545663993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09200cd450 con 0x7f092015e8e0 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.172+0000 7f0924f6d640 1 -- 172.21.15.50:0/2545663993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09200b7880 con 0x7f092015e8e0 2024-09-11T22:11:41.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.173+0000 7f0916ffd640 1 -- 172.21.15.50:0/2545663993 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f090801a070 con 0x7f092015e8e0 2024-09-11T22:11:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.173+0000 7f0916ffd640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f090006be30 0x7f090006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.173+0000 7f0916ffd640 1 -- 172.21.15.50:0/2545663993 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f090808a370 con 0x7f092015e8e0 2024-09-11T22:11:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.173+0000 7f091e59c640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f090006be30 0x7f090006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:41.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.174+0000 7f091e59c640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f090006be30 0x7f090006e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0918000f60 tx=0x7f0918007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:41.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.178+0000 7f0916ffd640 1 -- 172.21.15.50:0/2545663993 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0920150410 con 0x7f092015e8e0 2024-09-11T22:11:41.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.367+0000 7f0924f6d640 1 -- 172.21.15.50:0/2545663993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f09200ba770 con 0x7f092015e8e0 2024-09-11T22:11:41.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.367+0000 7f0916ffd640 1 -- 172.21.15.50:0/2545663993 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f0908058c80 con 0x7f092015e8e0 2024-09-11T22:11:41.368 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:11:41.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.369+0000 7f0924f6d640 1 -- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f090006be30 msgr2=0x7f090006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:41.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.369+0000 7f0924f6d640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f090006be30 0x7f090006e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0918000f60 tx=0x7f0918007c10 comp rx=0 tx=0).stop 2024-09-11T22:11:41.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.369+0000 7f0924f6d640 1 -- 172.21.15.50:0/2545663993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092015e8e0 msgr2=0x7f09200cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:41.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.369+0000 7f0924f6d640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092015e8e0 0x7f09200cc2d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f090800c410 tx=0x7f090800c8d0 comp rx=0 tx=0).stop 2024-09-11T22:11:41.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.369+0000 7f0924f6d640 1 -- 172.21.15.50:0/2545663993 shutdown_connections 2024-09-11T22:11:41.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.369+0000 7f0924f6d640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f090006be30 0x7f090006e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:41.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.369+0000 7f0924f6d640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0920162a60 0x7f09200cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:41.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.369+0000 7f0924f6d640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092015e8e0 0x7f09200cc2d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:41.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.369+0000 7f0924f6d640 1 --2- 172.21.15.50:0/2545663993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09200d1c90 0x7f092014cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:41.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.369+0000 7f0924f6d640 1 -- 172.21.15.50:0/2545663993 >> 172.21.15.50:0/2545663993 conn(0x7f0920067ba0 msgr2=0x7f0920067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:41.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.369+0000 7f0924f6d640 1 -- 172.21.15.50:0/2545663993 shutdown_connections 2024-09-11T22:11:41.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:41.369+0000 7f0924f6d640 1 -- 172.21.15.50:0/2545663993 wait complete. 2024-09-11T22:11:41.381 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T22:11:41.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:41.381 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-11T22:11:41.412 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2024-09-11T22:11:41.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:41.412 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T22:11:41.744 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:11:41.744 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:41.761 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:11:41.762 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:41.818 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:11:41.819 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:41.877 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:11:42.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.021+0000 7f61a7749640 1 Processor -- start 2024-09-11T22:11:42.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.022+0000 7f61a7749640 1 -- start start 2024-09-11T22:11:42.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.022+0000 7f61a7749640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61a0161d30 0x7f61a00cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.022+0000 7f61a7749640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61a00d11d0 0x7f61a00d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.022+0000 7f61a7749640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a0162110 con 0x7f61a00b78f0 2024-09-11T22:11:42.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.022+0000 7f61a7749640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f61a00d3450 con 0x7f61a00d11d0 2024-09-11T22:11:42.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.022+0000 7f61a7749640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f61a00d1b40 con 0x7f61a0161d30 2024-09-11T22:11:42.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.023+0000 7f61a5ce6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61a00d11d0 0x7f61a00d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.023+0000 7f61a4ce4640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f61a00b78f0 0x7f61a0162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49140/0 (socket says 172.21.15.50:49140) 2024-09-11T22:11:42.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.023+0000 7f61a5ce6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61a00d11d0 0x7f61a00d1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49338/0 (socket says 172.21.15.50:49338) 2024-09-11T22:11:42.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.023+0000 7f61a5ce6640 1 -- 172.21.15.50:0/2106956650 learned_addr learned my addr 172.21.15.50:0/2106956650 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:42.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.023+0000 7f61a5ce6640 1 -- 172.21.15.50:0/2106956650 >> v2:172.21.15.77:3300/0 conn(0x7f61a0161d30 msgr2=0x7f61a00cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:42.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.023+0000 7f61a5ce6640 1 --2- 172.21.15.50:0/2106956650 >> v2:172.21.15.77:3300/0 conn(0x7f61a0161d30 0x7f61a00cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.023+0000 7f61a5ce6640 1 -- 172.21.15.50:0/2106956650 >> v1:172.21.15.50:6789/0 conn(0x7f61a00b78f0 legacy=0x7f61a0162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.023+0000 7f6197fff640 1 -- 172.21.15.50:0/2106956650 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9717160 0 0) 0x7f61a0162110 con 0x7f61a00b78f0 2024-09-11T22:11:42.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.023+0000 7f61a5ce6640 1 -- 172.21.15.50:0/2106956650 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a00cfd70 con 0x7f61a00d11d0 2024-09-11T22:11:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.024+0000 7f61a5ce6640 1 --2- 172.21.15.50:0/2106956650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61a00d11d0 0x7f61a00d1600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f61a0073050 tx=0x7f619802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a8a8c84720c0e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.024+0000 7f6197fff640 1 -- 172.21.15.50:0/2106956650 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6198036070 con 0x7f61a00d11d0 2024-09-11T22:11:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.024+0000 7f6197fff640 1 -- 172.21.15.50:0/2106956650 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6198031600 con 0x7f61a00d11d0 2024-09-11T22:11:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.024+0000 7f6197fff640 1 -- 172.21.15.50:0/2106956650 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61980319d0 con 0x7f61a00d11d0 2024-09-11T22:11:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.024+0000 7f61a7749640 1 -- 172.21.15.50:0/2106956650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61a00d11d0 msgr2=0x7f61a00d1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.024+0000 7f61a7749640 1 --2- 172.21.15.50:0/2106956650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61a00d11d0 0x7f61a00d1600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f61a0073050 tx=0x7f619802a730 comp rx=0 tx=0).stop 2024-09-11T22:11:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.024+0000 7f61a7749640 1 -- 172.21.15.50:0/2106956650 shutdown_connections 2024-09-11T22:11:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.024+0000 7f61a7749640 1 --2- 172.21.15.50:0/2106956650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61a00d11d0 0x7f61a00d1600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.024+0000 7f61a7749640 1 --2- 172.21.15.50:0/2106956650 >> v2:172.21.15.77:3300/0 conn(0x7f61a0161d30 0x7f61a00cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.024+0000 7f61a7749640 1 -- 172.21.15.50:0/2106956650 >> 172.21.15.50:0/2106956650 conn(0x7f61a00727a0 msgr2=0x7f61a00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:42.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.025+0000 7f61a7749640 1 -- 172.21.15.50:0/2106956650 shutdown_connections 2024-09-11T22:11:42.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.025+0000 7f61a7749640 1 -- 172.21.15.50:0/2106956650 wait complete. 2024-09-11T22:11:42.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:11:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.026+0000 7f61a7749640 1 Processor -- start 2024-09-11T22:11:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.026+0000 7f61a7749640 1 -- start start 2024-09-11T22:11:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.026+0000 7f61a7749640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61a00b78f0 0x7f61a01f7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a7749640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61a00d11d0 0x7f61a01f8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a7749640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61a0161d30 0x7f61a01f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a7749640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61a00d30e0 con 0x7f61a00b78f0 2024-09-11T22:11:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a7749640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f61a00d2e00 con 0x7f61a00d11d0 2024-09-11T22:11:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a7749640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f61a00b7d60 con 0x7f61a0161d30 2024-09-11T22:11:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a54e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61a00b78f0 0x7f61a01f7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a54e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61a00b78f0 0x7f61a01f7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49340/0 (socket says 172.21.15.50:49340) 2024-09-11T22:11:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a54e5640 1 -- 172.21.15.50:0/1756995172 learned_addr learned my addr 172.21.15.50:0/1756995172 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a5ce6640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61a0161d30 0x7f61a01f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a54e5640 1 -- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61a0161d30 msgr2=0x7f61a01f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a4ce4640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61a00d11d0 0x7f61a01f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a54e5640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61a0161d30 0x7f61a01f87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a54e5640 1 -- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61a00d11d0 msgr2=0x7f61a01f8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a54e5640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61a00d11d0 0x7f61a01f8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a54e5640 1 -- 172.21.15.50:0/1756995172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a015b550 con 0x7f61a00b78f0 2024-09-11T22:11:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a5ce6640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61a0161d30 0x7f61a01f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a4ce4640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61a00d11d0 0x7f61a01f8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a54e5640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61a00b78f0 0x7f61a01f7d50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f619c00b440 tx=0x7f619c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f6195ffb640 1 -- 172.21.15.50:0/1756995172 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c015020 con 0x7f61a00b78f0 2024-09-11T22:11:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f6195ffb640 1 -- 172.21.15.50:0/1756995172 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f619c011890 con 0x7f61a00b78f0 2024-09-11T22:11:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f61a7749640 1 -- 172.21.15.50:0/1756995172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a015d920 con 0x7f61a00b78f0 2024-09-11T22:11:42.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.027+0000 7f6195ffb640 1 -- 172.21.15.50:0/1756995172 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c011c80 con 0x7f61a00b78f0 2024-09-11T22:11:42.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.028+0000 7f61a7749640 1 -- 172.21.15.50:0/1756995172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a015dee0 con 0x7f61a00b78f0 2024-09-11T22:11:42.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.028+0000 7f61a7749640 1 -- 172.21.15.50:0/1756995172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a015d710 con 0x7f61a00b78f0 2024-09-11T22:11:42.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.029+0000 7f6195ffb640 1 -- 172.21.15.50:0/1756995172 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f619c018020 con 0x7f61a00b78f0 2024-09-11T22:11:42.032 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:11:42.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.029+0000 7f6195ffb640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f618406be30 0x7f618406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.030+0000 7f6195ffb640 1 -- 172.21.15.50:0/1756995172 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f619c08b030 con 0x7f61a00b78f0 2024-09-11T22:11:42.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.030+0000 7f61a4ce4640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f618406be30 0x7f618406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.030+0000 7f61a4ce4640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f618406be30 0x7f618406e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61a015adc0 tx=0x7f6190009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:42.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.034+0000 7f6195ffb640 1 -- 172.21.15.50:0/1756995172 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f619c01f020 con 0x7f61a00b78f0 2024-09-11T22:11:42.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.221+0000 7f61a7749640 1 -- 172.21.15.50:0/1756995172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f61a00d1600 con 0x7f61a00b78f0 2024-09-11T22:11:42.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.222+0000 7f6195ffb640 1 -- 172.21.15.50:0/1756995172 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f619c00d040 con 0x7f61a00b78f0 2024-09-11T22:11:42.222 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:11:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.223+0000 7f61a7749640 1 -- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f618406be30 msgr2=0x7f618406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.224+0000 7f61a7749640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f618406be30 0x7f618406e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61a015adc0 tx=0x7f6190009040 comp rx=0 tx=0).stop 2024-09-11T22:11:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.224+0000 7f61a7749640 1 -- 172.21.15.50:0/1756995172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61a00b78f0 msgr2=0x7f61a01f7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.224+0000 7f61a7749640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61a00b78f0 0x7f61a01f7d50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f619c00b440 tx=0x7f619c00b900 comp rx=0 tx=0).stop 2024-09-11T22:11:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.224+0000 7f61a7749640 1 -- 172.21.15.50:0/1756995172 shutdown_connections 2024-09-11T22:11:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.224+0000 7f61a7749640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f618406be30 0x7f618406e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.224+0000 7f61a7749640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61a0161d30 0x7f61a01f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.224+0000 7f61a7749640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61a00d11d0 0x7f61a01f8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.224+0000 7f61a7749640 1 --2- 172.21.15.50:0/1756995172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61a00b78f0 0x7f61a01f7d50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.224+0000 7f61a7749640 1 -- 172.21.15.50:0/1756995172 >> 172.21.15.50:0/1756995172 conn(0x7f61a00727a0 msgr2=0x7f61a00cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:42.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.224+0000 7f61a7749640 1 -- 172.21.15.50:0/1756995172 shutdown_connections 2024-09-11T22:11:42.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.224+0000 7f61a7749640 1 -- 172.21.15.50:0/1756995172 wait complete. 2024-09-11T22:11:42.235 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-11T22:11:42.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:42.235 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-11T22:11:42.262 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:11:42.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:42.262 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-11T22:11:42.319 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:11:42.319 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:42.338 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:11:42.338 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:42.397 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:11:42.397 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:11:42.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:11:42.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.558+0000 7f2c911c6640 1 Processor -- start 2024-09-11T22:11:42.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.558+0000 7f2c911c6640 1 -- start start 2024-09-11T22:11:42.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.559+0000 7f2c911c6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c8c15e8e0 0x7f2c8c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.559+0000 7f2c911c6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c8c0d1580 0x7f2c8c0d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.559+0000 7f2c911c6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c8c0d1ee0 con 0x7f2c8c162350 2024-09-11T22:11:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.559+0000 7f2c911c6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2c8c15ecc0 con 0x7f2c8c0d1580 2024-09-11T22:11:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.559+0000 7f2c911c6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8c0d2ad0 con 0x7f2c8c15e8e0 2024-09-11T22:11:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.559+0000 7f2c8a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c8c0d1580 0x7f2c8c0d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.559+0000 7f2c8a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c8c0d1580 0x7f2c8c0d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49342/0 (socket says 172.21.15.50:49342) 2024-09-11T22:11:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.559+0000 7f2c8a59c640 1 -- 172.21.15.50:0/1118896772 learned_addr learned my addr 172.21.15.50:0/1118896772 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.559+0000 7f2c8ad9d640 1 --2- 172.21.15.50:0/1118896772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c8c15e8e0 0x7f2c8c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.559+0000 7f2c8a59c640 1 -- 172.21.15.50:0/1118896772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c8c15e8e0 msgr2=0x7f2c8c0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.559+0000 7f2c8a59c640 1 --2- 172.21.15.50:0/1118896772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c8c15e8e0 0x7f2c8c0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.559+0000 7f2c8a59c640 1 -- 172.21.15.50:0/1118896772 >> v1:172.21.15.77:6789/0 conn(0x7f2c8c162350 legacy=0x7f2c8c162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.559+0000 7f2c8a59c640 1 -- 172.21.15.50:0/1118896772 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8c163080 con 0x7f2c8c0d1580 2024-09-11T22:11:42.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.560+0000 7f2c8a59c640 1 --2- 172.21.15.50:0/1118896772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0d1580 0x7f2c8c0d19a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009870 tx=0x7f2c8002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18110b822dd17590 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:42.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.560+0000 7f2c89d9b640 1 -- 172.21.15.50:0/1118896772 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80037070 con 0x7f2c8c0d1580 2024-09-11T22:11:42.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.560+0000 7f2c89d9b640 1 -- 172.21.15.50:0/1118896772 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c8002ae50 con 0x7f2c8c0d1580 2024-09-11T22:11:42.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.560+0000 7f2c89d9b640 1 -- 172.21.15.50:0/1118896772 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80032860 con 0x7f2c8c0d1580 2024-09-11T22:11:42.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.561+0000 7f2c911c6640 1 -- 172.21.15.50:0/1118896772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0d1580 msgr2=0x7f2c8c0d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.561+0000 7f2c911c6640 1 --2- 172.21.15.50:0/1118896772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0d1580 0x7f2c8c0d19a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009870 tx=0x7f2c8002a300 comp rx=0 tx=0).stop 2024-09-11T22:11:42.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.561+0000 7f2c911c6640 1 -- 172.21.15.50:0/1118896772 shutdown_connections 2024-09-11T22:11:42.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.561+0000 7f2c911c6640 1 --2- 172.21.15.50:0/1118896772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0d1580 0x7f2c8c0d19a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.561+0000 7f2c911c6640 1 --2- 172.21.15.50:0/1118896772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c8c15e8e0 0x7f2c8c0b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.561+0000 7f2c911c6640 1 -- 172.21.15.50:0/1118896772 >> 172.21.15.50:0/1118896772 conn(0x7f2c8c067ba0 msgr2=0x7f2c8c067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:42.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.561+0000 7f2c911c6640 1 -- 172.21.15.50:0/1118896772 shutdown_connections 2024-09-11T22:11:42.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.561+0000 7f2c911c6640 1 -- 172.21.15.50:0/1118896772 wait complete. 2024-09-11T22:11:42.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.562+0000 7f2c911c6640 1 Processor -- start 2024-09-11T22:11:42.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.562+0000 7f2c911c6640 1 -- start start 2024-09-11T22:11:42.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.563+0000 7f2c911c6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0d1580 0x7f2c8c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.563+0000 7f2c911c6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c8c15e8e0 0x7f2c8c0b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.563+0000 7f2c911c6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c8c162350 0x7f2c8c1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.563+0000 7f2c911c6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c0d3000 con 0x7f2c8c0d1580 2024-09-11T22:11:42.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.563+0000 7f2c911c6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c0d3370 con 0x7f2c8c162350 2024-09-11T22:11:42.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.563+0000 7f2c911c6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8c0d3800 con 0x7f2c8c15e8e0 2024-09-11T22:11:42.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.563+0000 7f2c8ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0d1580 0x7f2c8c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.563+0000 7f2c8ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0d1580 0x7f2c8c0b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49354/0 (socket says 172.21.15.50:49354) 2024-09-11T22:11:42.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.563+0000 7f2c8ad9d640 1 -- 172.21.15.50:0/3528802396 learned_addr learned my addr 172.21.15.50:0/3528802396 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:42.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.563+0000 7f2c8a59c640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c8c15e8e0 0x7f2c8c0b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.563+0000 7f2c8b59e640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c8c162350 0x7f2c8c1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.564+0000 7f2c8ad9d640 1 -- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c8c15e8e0 msgr2=0x7f2c8c0b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.564+0000 7f2c8ad9d640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c8c15e8e0 0x7f2c8c0b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.564+0000 7f2c8ad9d640 1 -- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c8c162350 msgr2=0x7f2c8c1525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.564+0000 7f2c8ad9d640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c8c162350 0x7f2c8c1525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.564+0000 7f2c8ad9d640 1 -- 172.21.15.50:0/3528802396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8c1f4b80 con 0x7f2c8c0d1580 2024-09-11T22:11:42.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.564+0000 7f2c8b59e640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c8c162350 0x7f2c8c1525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:42.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.564+0000 7f2c8ad9d640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0d1580 0x7f2c8c0b4250 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00d800 tx=0x7f2c7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:42.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.564+0000 7f2c737fe640 1 -- 172.21.15.50:0/3528802396 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00b6c0 con 0x7f2c8c0d1580 2024-09-11T22:11:42.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.564+0000 7f2c737fe640 1 -- 172.21.15.50:0/3528802396 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7c019070 con 0x7f2c8c0d1580 2024-09-11T22:11:42.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.564+0000 7f2c911c6640 1 -- 172.21.15.50:0/3528802396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8c0b4890 con 0x7f2c8c0d1580 2024-09-11T22:11:42.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.564+0000 7f2c737fe640 1 -- 172.21.15.50:0/3528802396 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00bac0 con 0x7f2c8c0d1580 2024-09-11T22:11:42.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.564+0000 7f2c911c6640 1 -- 172.21.15.50:0/3528802396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c8c0b50d0 con 0x7f2c8c0d1580 2024-09-11T22:11:42.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.565+0000 7f2c911c6640 1 -- 172.21.15.50:0/3528802396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c8c0d19a0 con 0x7f2c8c0d1580 2024-09-11T22:11:42.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.565+0000 7f2c737fe640 1 -- 172.21.15.50:0/3528802396 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c7c00bc60 con 0x7f2c8c0d1580 2024-09-11T22:11:42.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.566+0000 7f2c737fe640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2c7806be30 0x7f2c7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.566+0000 7f2c737fe640 1 -- 172.21.15.50:0/3528802396 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2c7c08b2c0 con 0x7f2c8c0d1580 2024-09-11T22:11:42.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.566+0000 7f2c8a59c640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2c7806be30 0x7f2c7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.567+0000 7f2c8a59c640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2c7806be30 0x7f2c7806e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2c80034000 tx=0x7f2c8002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:42.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.570+0000 7f2c737fe640 1 -- 172.21.15.50:0/3528802396 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c8c0b4890 con 0x7f2c8c0d1580 2024-09-11T22:11:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.758+0000 7f2c911c6640 1 -- 172.21.15.50:0/3528802396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2c8c160240 con 0x7f2c8c0d1580 2024-09-11T22:11:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.758+0000 7f2c737fe640 1 -- 172.21.15.50:0/3528802396 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f2c7c059c70 con 0x7f2c8c0d1580 2024-09-11T22:11:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:11:42.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.760+0000 7f2c911c6640 1 -- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2c7806be30 msgr2=0x7f2c7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.760+0000 7f2c911c6640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2c7806be30 0x7f2c7806e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2c80034000 tx=0x7f2c8002e000 comp rx=0 tx=0).stop 2024-09-11T22:11:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.760+0000 7f2c911c6640 1 -- 172.21.15.50:0/3528802396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0d1580 msgr2=0x7f2c8c0b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.760+0000 7f2c911c6640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0d1580 0x7f2c8c0b4250 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00d800 tx=0x7f2c7c00dcc0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.760+0000 7f2c911c6640 1 -- 172.21.15.50:0/3528802396 shutdown_connections 2024-09-11T22:11:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.760+0000 7f2c911c6640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2c7806be30 0x7f2c7806e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.760+0000 7f2c911c6640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c8c15e8e0 0x7f2c8c0b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.760+0000 7f2c911c6640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c8c162350 0x7f2c8c1525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.760+0000 7f2c911c6640 1 --2- 172.21.15.50:0/3528802396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c8c0d1580 0x7f2c8c0b4250 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.760+0000 7f2c911c6640 1 -- 172.21.15.50:0/3528802396 >> 172.21.15.50:0/3528802396 conn(0x7f2c8c067ba0 msgr2=0x7f2c8c15f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.760+0000 7f2c911c6640 1 -- 172.21.15.50:0/3528802396 shutdown_connections 2024-09-11T22:11:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.760+0000 7f2c911c6640 1 -- 172.21.15.50:0/3528802396 wait complete. 2024-09-11T22:11:42.772 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-11T22:11:42.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:42.772 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-11T22:11:42.804 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2024-09-11T22:11:42.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:11:42.805 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-11T22:11:42.863 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T22:11:42.863 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:11:42.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.965+0000 7f19c2b5b640 1 Processor -- start 2024-09-11T22:11:42.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.965+0000 7f19c2b5b640 1 -- start start 2024-09-11T22:11:42.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.966+0000 7f19c2b5b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc15e8e0 0x7f19bc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.966+0000 7f19c2b5b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19bc163080 con 0x7f19bc0d1580 2024-09-11T22:11:42.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.966+0000 7f19c2b5b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19bc0d2d20 con 0x7f19bc162350 2024-09-11T22:11:42.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.966+0000 7f19c2b5b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f19bc15ecc0 con 0x7f19bc15e8e0 2024-09-11T22:11:42.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.966+0000 7f19bbfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f19bc0d1580 0x7f19bc0d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49144/0 (socket says 172.21.15.50:49144) 2024-09-11T22:11:42.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.966+0000 7f19bbfff640 1 -- 172.21.15.50:0/3370820316 learned_addr learned my addr 172.21.15.50:0/3370820316 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:42.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19c08f7640 1 --2- 172.21.15.50:0/3370820316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc15e8e0 0x7f19bc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1735987302 0 0) 0x7f19bc163080 con 0x7f19bc0d1580 2024-09-11T22:11:42.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19a4003520 con 0x7f19bc0d1580 2024-09-11T22:11:42.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3484981272 0 0) 0x7f19a4003520 con 0x7f19bc0d1580 2024-09-11T22:11:42.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc15e8e0 msgr2=0x7f19bc0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:42.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 --2- 172.21.15.50:0/3370820316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc15e8e0 0x7f19bc0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 >> v1:172.21.15.77:6789/0 conn(0x7f19bc162350 legacy=0x7f19bc162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19bc0d3000 con 0x7f19bc0d1580 2024-09-11T22:11:42.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f19b0001670 con 0x7f19bc0d1580 2024-09-11T22:11:42.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 >> v1:172.21.15.50:6789/0 conn(0x7f19bc0d1580 legacy=0x7f19bc0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 --2- 172.21.15.50:0/3370820316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc15e8e0 0x7f19a40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 --2- 172.21.15.50:0/3370820316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a4003f20 0x7f19a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 --2- 172.21.15.50:0/3370820316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19a4004d40 0x7f19a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f19a400b9f0 con 0x7f19a4003f20 2024-09-11T22:11:42.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f19a400bba0 con 0x7f19a4004d40 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f19a400bda0 con 0x7f19bc15e8e0 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bbfff640 1 --2- 172.21.15.50:0/3370820316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a4003f20 0x7f19a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19c08f7640 1 --2- 172.21.15.50:0/3370820316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc15e8e0 0x7f19a40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19c10f8640 1 --2- 172.21.15.50:0/3370820316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19a4004d40 0x7f19a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bbfff640 1 -- 172.21.15.50:0/3370820316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc15e8e0 msgr2=0x7f19a40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bbfff640 1 --2- 172.21.15.50:0/3370820316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc15e8e0 0x7f19a40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bbfff640 1 -- 172.21.15.50:0/3370820316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19a4004d40 msgr2=0x7f19a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bbfff640 1 --2- 172.21.15.50:0/3370820316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19a4004d40 0x7f19a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19bbfff640 1 -- 172.21.15.50:0/3370820316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a4003520 con 0x7f19a4003f20 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.967+0000 7f19c10f8640 1 --2- 172.21.15.50:0/3370820316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19a4004d40 0x7f19a40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.968+0000 7f19bbfff640 1 --2- 172.21.15.50:0/3370820316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a4003f20 0x7f19a4004800 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f19bc1622b0 tx=0x7f19a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a1c68f31603685 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.968+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b0007ce0 con 0x7f19a4003f20 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.968+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b0005af0 con 0x7f19a4003f20 2024-09-11T22:11:42.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.968+0000 7f19bb7fe640 1 -- 172.21.15.50:0/3370820316 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b0007070 con 0x7f19a4003f20 2024-09-11T22:11:42.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.969+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3370820316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a4003f20 msgr2=0x7f19a4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.969+0000 7f19c2b5b640 1 --2- 172.21.15.50:0/3370820316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19a4003f20 0x7f19a4004800 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f19bc1622b0 tx=0x7f19a4005830 comp rx=0 tx=0).stop 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.969+0000 7f19c10f8640 1 -- 172.21.15.50:0/3370820316 reap_dead start 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.969+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3370820316 shutdown_connections 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.969+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3370820316 >> 172.21.15.50:0/3370820316 conn(0x7f19bc067ba0 msgr2=0x7f19bc067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.969+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3370820316 shutdown_connections 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.969+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3370820316 wait complete. 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.970+0000 7f19c2b5b640 1 Processor -- start 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.970+0000 7f19c2b5b640 1 -- start start 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19c2b5b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19a4003f20 0x7f19bc0b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19c2b5b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19bc15f0e0 0x7f19bc15f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19c2b5b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc0cdf40 0x7f19bc0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19c2b5b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc0b7c10 con 0x7f19bc15f0e0 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19c2b5b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc0b7a90 con 0x7f19a4003f20 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19c2b5b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f19bc0d2ad0 con 0x7f19bc0cdf40 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19bbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19bc15f0e0 0x7f19bc15f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19bbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19bc15f0e0 0x7f19bc15f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49376/0 (socket says 172.21.15.50:49376) 2024-09-11T22:11:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19bbfff640 1 -- 172.21.15.50:0/3481253913 learned_addr learned my addr 172.21.15.50:0/3481253913 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19c10f8640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc0cdf40 0x7f19bc0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19c08f7640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19a4003f20 0x7f19bc0b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19bbfff640 1 -- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc0cdf40 msgr2=0x7f19bc0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19bbfff640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc0cdf40 0x7f19bc0ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19bbfff640 1 -- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19a4003f20 msgr2=0x7f19bc0b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19bbfff640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19a4003f20 0x7f19bc0b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19bbfff640 1 -- 172.21.15.50:0/3481253913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19bc15fba0 con 0x7f19bc15f0e0 2024-09-11T22:11:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.971+0000 7f19c10f8640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc0cdf40 0x7f19bc0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.972+0000 7f19bbfff640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19bc15f0e0 0x7f19bc15f560 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19b002acb0 tx=0x7f19bc0b77d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.972+0000 7f19b97fa640 1 -- 172.21.15.50:0/3481253913 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b0044070 con 0x7f19bc15f0e0 2024-09-11T22:11:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.972+0000 7f19b97fa640 1 -- 172.21.15.50:0/3481253913 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b0038040 con 0x7f19bc15f0e0 2024-09-11T22:11:42.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.972+0000 7f19b97fa640 1 -- 172.21.15.50:0/3481253913 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b0004a20 con 0x7f19bc15f0e0 2024-09-11T22:11:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.972+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3481253913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19bc15fe80 con 0x7f19bc15f0e0 2024-09-11T22:11:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.972+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3481253913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19bc160440 con 0x7f19bc15f0e0 2024-09-11T22:11:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.973+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3481253913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19bc0d19a0 con 0x7f19bc15f0e0 2024-09-11T22:11:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.973+0000 7f19b97fa640 1 -- 172.21.15.50:0/3481253913 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f19b0047070 con 0x7f19bc15f0e0 2024-09-11T22:11:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.974+0000 7f19b97fa640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f19a806be60 0x7f19a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.974+0000 7f19b97fa640 1 -- 172.21.15.50:0/3481253913 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f19b00aa6c0 con 0x7f19bc15f0e0 2024-09-11T22:11:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.974+0000 7f19c08f7640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f19a806be60 0x7f19a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.974+0000 7f19c08f7640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f19a806be60 0x7f19a806e320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f19bc160f10 tx=0x7f19ac009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:42.978+0000 7f19b97fa640 1 -- 172.21.15.50:0/3481253913 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19b0079100 con 0x7f19bc15f0e0 2024-09-11T22:11:43.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.190+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3481253913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19bc0ba770 con 0x7f19bc15f0e0 2024-09-11T22:11:43.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.190+0000 7f19b97fa640 1 -- 172.21.15.50:0/3481253913 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5214 (secure 0 0 0) 0x7f19b0078a00 con 0x7f19bc15f0e0 2024-09-11T22:11:43.191 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:43.191 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"btime":"2024-09-11T22:11:16:865918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2971042772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2971042772},{"type":"v1","addr":"172.21.15.77:6837","nonce":2971042772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/293208439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":293208439},{"type":"v1","addr":"172.21.15.77:6835","nonce":293208439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4087237334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4087237334},{"type":"v1","addr":"172.21.15.50:6834","nonce":4087237334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:11:14.221375+0000","modified":"2024-09-11T22:11:16.209817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2305531878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2305531878},{"type":"v1","addr":"172.21.15.50:6835","nonce":2305531878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-11T22:11:43.191 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2024-09-11T22:11:43.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.192+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f19a806be60 msgr2=0x7f19a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.192+0000 7f19c2b5b640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f19a806be60 0x7f19a806e320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f19bc160f10 tx=0x7f19ac009190 comp rx=0 tx=0).stop 2024-09-11T22:11:43.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.192+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3481253913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19bc15f0e0 msgr2=0x7f19bc15f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.192+0000 7f19c2b5b640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19bc15f0e0 0x7f19bc15f560 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19b002acb0 tx=0x7f19bc0b77d0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.193+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3481253913 shutdown_connections 2024-09-11T22:11:43.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.193+0000 7f19c2b5b640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f19a806be60 0x7f19a806e320 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.193+0000 7f19c2b5b640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19bc0cdf40 0x7f19bc0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.193+0000 7f19c2b5b640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19bc15f0e0 0x7f19bc15f560 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.193+0000 7f19c2b5b640 1 --2- 172.21.15.50:0/3481253913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19a4003f20 0x7f19bc0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.193+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3481253913 >> 172.21.15.50:0/3481253913 conn(0x7f19bc067ba0 msgr2=0x7f19bc067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:43.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.193+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3481253913 shutdown_connections 2024-09-11T22:11:43.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.193+0000 7f19c2b5b640 1 -- 172.21.15.50:0/3481253913 wait complete. 2024-09-11T22:11:43.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:11:43.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.306+0000 7f0c496d0640 1 Processor -- start 2024-09-11T22:11:43.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.306+0000 7f0c496d0640 1 -- start start 2024-09-11T22:11:43.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.307+0000 7f0c496d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c4415e8e0 0x7f0c440b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.307+0000 7f0c496d0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c440d1580 0x7f0c440d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.307+0000 7f0c496d0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c440d1ee0 con 0x7f0c44162350 2024-09-11T22:11:43.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.307+0000 7f0c496d0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0c4415ecc0 con 0x7f0c440d1580 2024-09-11T22:11:43.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.307+0000 7f0c496d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0c440d2ad0 con 0x7f0c4415e8e0 2024-09-11T22:11:43.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.307+0000 7f0c427fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c440d1580 0x7f0c440d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.307+0000 7f0c427fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c440d1580 0x7f0c440d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49380/0 (socket says 172.21.15.50:49380) 2024-09-11T22:11:43.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.307+0000 7f0c427fc640 1 -- 172.21.15.50:0/1444528835 learned_addr learned my addr 172.21.15.50:0/1444528835 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:43.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.307+0000 7f0c42ffd640 1 --2- 172.21.15.50:0/1444528835 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c4415e8e0 0x7f0c440b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.307+0000 7f0c427fc640 1 -- 172.21.15.50:0/1444528835 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c4415e8e0 msgr2=0x7f0c440b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:43.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.307+0000 7f0c427fc640 1 --2- 172.21.15.50:0/1444528835 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c4415e8e0 0x7f0c440b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.307+0000 7f0c427fc640 1 -- 172.21.15.50:0/1444528835 >> v1:172.21.15.77:6789/0 conn(0x7f0c44162350 legacy=0x7f0c44162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.307+0000 7f0c427fc640 1 -- 172.21.15.50:0/1444528835 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c44163080 con 0x7f0c440d1580 2024-09-11T22:11:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.308+0000 7f0c427fc640 1 --2- 172.21.15.50:0/1444528835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c440d1580 0x7f0c440d19a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009870 tx=0x7f0c3802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0bb5c34367af96 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.308+0000 7f0c41ffb640 1 -- 172.21.15.50:0/1444528835 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38037070 con 0x7f0c440d1580 2024-09-11T22:11:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.308+0000 7f0c41ffb640 1 -- 172.21.15.50:0/1444528835 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3802ae50 con 0x7f0c440d1580 2024-09-11T22:11:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.308+0000 7f0c41ffb640 1 -- 172.21.15.50:0/1444528835 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38032860 con 0x7f0c440d1580 2024-09-11T22:11:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.309+0000 7f0c496d0640 1 -- 172.21.15.50:0/1444528835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c440d1580 msgr2=0x7f0c440d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.309+0000 7f0c496d0640 1 --2- 172.21.15.50:0/1444528835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c440d1580 0x7f0c440d19a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009870 tx=0x7f0c3802a300 comp rx=0 tx=0).stop 2024-09-11T22:11:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.309+0000 7f0c496d0640 1 -- 172.21.15.50:0/1444528835 shutdown_connections 2024-09-11T22:11:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.309+0000 7f0c496d0640 1 --2- 172.21.15.50:0/1444528835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c440d1580 0x7f0c440d19a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.309+0000 7f0c496d0640 1 --2- 172.21.15.50:0/1444528835 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c4415e8e0 0x7f0c440b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.309+0000 7f0c496d0640 1 -- 172.21.15.50:0/1444528835 >> 172.21.15.50:0/1444528835 conn(0x7f0c44067ba0 msgr2=0x7f0c44067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.309+0000 7f0c496d0640 1 -- 172.21.15.50:0/1444528835 shutdown_connections 2024-09-11T22:11:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.309+0000 7f0c496d0640 1 -- 172.21.15.50:0/1444528835 wait complete. 2024-09-11T22:11:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.310+0000 7f0c496d0640 1 Processor -- start 2024-09-11T22:11:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.310+0000 7f0c496d0640 1 -- start start 2024-09-11T22:11:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c496d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c440d1580 0x7f0c440b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c496d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c4415e8e0 0x7f0c440b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c496d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c44162350 0x7f0c440b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c496d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0c440d3000 con 0x7f0c44162350 2024-09-11T22:11:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c496d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0c440d3370 con 0x7f0c4415e8e0 2024-09-11T22:11:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c496d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0c440d3800 con 0x7f0c440d1580 2024-09-11T22:11:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c437fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c44162350 0x7f0c440b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c437fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c44162350 0x7f0c440b83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49394/0 (socket says 172.21.15.50:49394) 2024-09-11T22:11:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c437fe640 1 -- 172.21.15.50:0/3692887504 learned_addr learned my addr 172.21.15.50:0/3692887504 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c42ffd640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c440d1580 0x7f0c440b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c427fc640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c4415e8e0 0x7f0c440b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c437fe640 1 -- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c440d1580 msgr2=0x7f0c440b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c437fe640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c440d1580 0x7f0c440b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c437fe640 1 -- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c4415e8e0 msgr2=0x7f0c440b7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c437fe640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c4415e8e0 0x7f0c440b7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c437fe640 1 -- 172.21.15.50:0/3692887504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c440cd170 con 0x7f0c44162350 2024-09-11T22:11:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c427fc640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c4415e8e0 0x7f0c440b7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.311+0000 7f0c437fe640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c44162350 0x7f0c440b83a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c6e0 tx=0x7f0c3c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.312+0000 7f0c2b7fe640 1 -- 172.21.15.50:0/3692887504 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c003b70 con 0x7f0c44162350 2024-09-11T22:11:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.312+0000 7f0c2b7fe640 1 -- 172.21.15.50:0/3692887504 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c003d30 con 0x7f0c44162350 2024-09-11T22:11:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.312+0000 7f0c496d0640 1 -- 172.21.15.50:0/3692887504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c440cd450 con 0x7f0c44162350 2024-09-11T22:11:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.312+0000 7f0c2b7fe640 1 -- 172.21.15.50:0/3692887504 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c005310 con 0x7f0c44162350 2024-09-11T22:11:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.312+0000 7f0c496d0640 1 -- 172.21.15.50:0/3692887504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c440cda10 con 0x7f0c44162350 2024-09-11T22:11:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.313+0000 7f0c496d0640 1 -- 172.21.15.50:0/3692887504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c440d19a0 con 0x7f0c44162350 2024-09-11T22:11:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.313+0000 7f0c2b7fe640 1 -- 172.21.15.50:0/3692887504 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c3c0054b0 con 0x7f0c44162350 2024-09-11T22:11:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.314+0000 7f0c2b7fe640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c3006be30 0x7f0c3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.314+0000 7f0c2b7fe640 1 -- 172.21.15.50:0/3692887504 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0c3c08ab80 con 0x7f0c44162350 2024-09-11T22:11:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.314+0000 7f0c42ffd640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c3006be30 0x7f0c3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.314+0000 7f0c42ffd640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c3006be30 0x7f0c3006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009b40 tx=0x7f0c34009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.318+0000 7f0c2b7fe640 1 -- 172.21.15.50:0/3692887504 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c3c0595c0 con 0x7f0c44162350 2024-09-11T22:11:43.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.532+0000 7f0c496d0640 1 -- 172.21.15.50:0/3692887504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c440ba770 con 0x7f0c44162350 2024-09-11T22:11:43.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.532+0000 7f0c2b7fe640 1 -- 172.21.15.50:0/3692887504 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5214 (secure 0 0 0) 0x7f0c3c058ec0 con 0x7f0c44162350 2024-09-11T22:11:43.533 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:43.533 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"btime":"2024-09-11T22:11:16:865918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2971042772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2971042772},{"type":"v1","addr":"172.21.15.77:6837","nonce":2971042772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/293208439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":293208439},{"type":"v1","addr":"172.21.15.77:6835","nonce":293208439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4087237334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4087237334},{"type":"v1","addr":"172.21.15.50:6834","nonce":4087237334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:11:14.221375+0000","modified":"2024-09-11T22:11:16.209817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2305531878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2305531878},{"type":"v1","addr":"172.21.15.50:6835","nonce":2305531878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-11T22:11:43.533 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2024-09-11T22:11:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.534+0000 7f0c496d0640 1 -- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c3006be30 msgr2=0x7f0c3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.534+0000 7f0c496d0640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c3006be30 0x7f0c3006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009b40 tx=0x7f0c34009190 comp rx=0 tx=0).stop 2024-09-11T22:11:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.534+0000 7f0c496d0640 1 -- 172.21.15.50:0/3692887504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c44162350 msgr2=0x7f0c440b83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.534+0000 7f0c496d0640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c44162350 0x7f0c440b83a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c6e0 tx=0x7f0c3c00cba0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.534+0000 7f0c496d0640 1 -- 172.21.15.50:0/3692887504 shutdown_connections 2024-09-11T22:11:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.534+0000 7f0c496d0640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c3006be30 0x7f0c3006e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.534+0000 7f0c496d0640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c44162350 0x7f0c440b83a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.534+0000 7f0c496d0640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c4415e8e0 0x7f0c440b7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.534+0000 7f0c496d0640 1 --2- 172.21.15.50:0/3692887504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c440d1580 0x7f0c440b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.534+0000 7f0c496d0640 1 -- 172.21.15.50:0/3692887504 >> 172.21.15.50:0/3692887504 conn(0x7f0c44067ba0 msgr2=0x7f0c44067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.534+0000 7f0c496d0640 1 -- 172.21.15.50:0/3692887504 shutdown_connections 2024-09-11T22:11:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.534+0000 7f0c496d0640 1 -- 172.21.15.50:0/3692887504 wait complete. 2024-09-11T22:11:43.546 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.648+0000 7fd76194b640 1 Processor -- start 2024-09-11T22:11:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.648+0000 7fd76194b640 1 -- start start 2024-09-11T22:11:43.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.649+0000 7fd76194b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd75c15b400 0x7fd75c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.649+0000 7fd76194b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75c15b7e0 con 0x7fd75c06e0f0 2024-09-11T22:11:43.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.649+0000 7fd76194b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75c15f140 con 0x7fd75c072e60 2024-09-11T22:11:43.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.649+0000 7fd76194b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd75c15f420 con 0x7fd75c15b400 2024-09-11T22:11:43.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.649+0000 7fd75affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd75c15b400 0x7fd75c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.649+0000 7fd75b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd75c06e0f0 0x7fd75c0711c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49158/0 (socket says 172.21.15.50:49158) 2024-09-11T22:11:43.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.649+0000 7fd75b7fe640 1 -- 172.21.15.50:0/1494853448 learned_addr learned my addr 172.21.15.50:0/1494853448 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:43.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.649+0000 7fd75affd640 1 -- 172.21.15.50:0/1494853448 >> v1:172.21.15.77:6789/0 conn(0x7fd75c072e60 legacy=0x7fd75c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:43.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.649+0000 7fd75affd640 1 -- 172.21.15.50:0/1494853448 >> v1:172.21.15.50:6789/0 conn(0x7fd75c06e0f0 legacy=0x7fd75c0711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.649+0000 7fd75affd640 1 -- 172.21.15.50:0/1494853448 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75c15f700 con 0x7fd75c15b400 2024-09-11T22:11:43.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.650+0000 7fd75affd640 1 --2- 172.21.15.50:0/1494853448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c15b400 0x7fd75c06d070 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0097a0 tx=0x7fd74c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42d53a886ecd256 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.650+0000 7fd759ffb640 1 -- 172.21.15.50:0/1494853448 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c037070 con 0x7fd75c15b400 2024-09-11T22:11:43.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.650+0000 7fd759ffb640 1 -- 172.21.15.50:0/1494853448 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd74c032440 con 0x7fd75c15b400 2024-09-11T22:11:43.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.650+0000 7fd759ffb640 1 -- 172.21.15.50:0/1494853448 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c032810 con 0x7fd75c15b400 2024-09-11T22:11:43.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.650+0000 7fd76194b640 1 -- 172.21.15.50:0/1494853448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c15b400 msgr2=0x7fd75c06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.651+0000 7fd76194b640 1 --2- 172.21.15.50:0/1494853448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c15b400 0x7fd75c06d070 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0097a0 tx=0x7fd74c02a1e0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.651+0000 7fd76194b640 1 -- 172.21.15.50:0/1494853448 shutdown_connections 2024-09-11T22:11:43.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.651+0000 7fd76194b640 1 --2- 172.21.15.50:0/1494853448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c15b400 0x7fd75c06d070 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.651+0000 7fd76194b640 1 -- 172.21.15.50:0/1494853448 >> 172.21.15.50:0/1494853448 conn(0x7fd75c0679c0 msgr2=0x7fd75c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:43.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.651+0000 7fd76194b640 1 -- 172.21.15.50:0/1494853448 shutdown_connections 2024-09-11T22:11:43.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.651+0000 7fd76194b640 1 -- 172.21.15.50:0/1494853448 wait complete. 2024-09-11T22:11:43.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.652+0000 7fd76194b640 1 Processor -- start 2024-09-11T22:11:43.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.652+0000 7fd76194b640 1 -- start start 2024-09-11T22:11:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd76194b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c06e0f0 0x7fd75c14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd76194b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75c072e60 0x7fd75c14e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd76194b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd75c15b400 0x7fd75c0ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd76194b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c0718d0 con 0x7fd75c06e0f0 2024-09-11T22:11:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd76194b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c0cfc50 con 0x7fd75c15b400 2024-09-11T22:11:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd76194b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd75c071a50 con 0x7fd75c072e60 2024-09-11T22:11:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd75affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c06e0f0 0x7fd75c14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd75affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c06e0f0 0x7fd75c14e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49426/0 (socket says 172.21.15.50:49426) 2024-09-11T22:11:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd75affd640 1 -- 172.21.15.50:0/1930024743 learned_addr learned my addr 172.21.15.50:0/1930024743 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd75b7fe640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd75c15b400 0x7fd75c0ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd75a7fc640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75c072e60 0x7fd75c14e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd75affd640 1 -- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75c072e60 msgr2=0x7fd75c14e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd75affd640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75c072e60 0x7fd75c14e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd75affd640 1 -- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd75c15b400 msgr2=0x7fd75c0ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd75affd640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd75c15b400 0x7fd75c0ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd75affd640 1 -- 172.21.15.50:0/1930024743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75c0cdca0 con 0x7fd75c06e0f0 2024-09-11T22:11:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd75b7fe640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd75c15b400 0x7fd75c0ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd75a7fc640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75c072e60 0x7fd75c14e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.653+0000 7fd75affd640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c06e0f0 0x7fd75c14e070 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd74c02a220 tx=0x7fd74c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.654+0000 7fd743fff640 1 -- 172.21.15.50:0/1930024743 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c041070 con 0x7fd75c06e0f0 2024-09-11T22:11:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.654+0000 7fd743fff640 1 -- 172.21.15.50:0/1930024743 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd74c03c890 con 0x7fd75c06e0f0 2024-09-11T22:11:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.654+0000 7fd76194b640 1 -- 172.21.15.50:0/1930024743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75c0cdf40 con 0x7fd75c06e0f0 2024-09-11T22:11:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.654+0000 7fd743fff640 1 -- 172.21.15.50:0/1930024743 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c037040 con 0x7fd75c06e0f0 2024-09-11T22:11:43.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.654+0000 7fd76194b640 1 -- 172.21.15.50:0/1930024743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd75c0cec20 con 0x7fd75c06e0f0 2024-09-11T22:11:43.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.655+0000 7fd76194b640 1 -- 172.21.15.50:0/1930024743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75c06d070 con 0x7fd75c06e0f0 2024-09-11T22:11:43.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.655+0000 7fd743fff640 1 -- 172.21.15.50:0/1930024743 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd74c044070 con 0x7fd75c06e0f0 2024-09-11T22:11:43.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.655+0000 7fd743fff640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd74806be30 0x7fd74806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.656+0000 7fd743fff640 1 -- 172.21.15.50:0/1930024743 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd74c0abc80 con 0x7fd75c06e0f0 2024-09-11T22:11:43.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.656+0000 7fd75a7fc640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd74806be30 0x7fd74806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.656+0000 7fd75a7fc640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd74806be30 0x7fd74806e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd75c15cea0 tx=0x7fd750009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.660+0000 7fd743fff640 1 -- 172.21.15.50:0/1930024743 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd74c07a6b0 con 0x7fd75c06e0f0 2024-09-11T22:11:43.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.835+0000 7fd76194b640 1 -- 172.21.15.50:0/1930024743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd75c0cf5a0 con 0x7fd75c06e0f0 2024-09-11T22:11:43.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.837+0000 7fd743fff640 1 -- 172.21.15.50:0/1930024743 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7fd74c079fb0 con 0x7fd75c06e0f0 2024-09-11T22:11:43.837 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:43.838 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:15.853220+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:12.090736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:13.202114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.838+0000 7fd76194b640 1 -- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd74806be30 msgr2=0x7fd74806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.838+0000 7fd76194b640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd74806be30 0x7fd74806e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd75c15cea0 tx=0x7fd750009040 comp rx=0 tx=0).stop 2024-09-11T22:11:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.839+0000 7fd76194b640 1 -- 172.21.15.50:0/1930024743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c06e0f0 msgr2=0x7fd75c14e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.839+0000 7fd76194b640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c06e0f0 0x7fd75c14e070 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd74c02a220 tx=0x7fd74c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.839+0000 7fd76194b640 1 -- 172.21.15.50:0/1930024743 shutdown_connections 2024-09-11T22:11:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.839+0000 7fd76194b640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd74806be30 0x7fd74806e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.839+0000 7fd76194b640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75c072e60 0x7fd75c14e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.839+0000 7fd76194b640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd75c15b400 0x7fd75c0ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.839+0000 7fd76194b640 1 --2- 172.21.15.50:0/1930024743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c06e0f0 0x7fd75c14e070 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.839+0000 7fd76194b640 1 -- 172.21.15.50:0/1930024743 >> 172.21.15.50:0/1930024743 conn(0x7fd75c0679c0 msgr2=0x7fd75c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.839+0000 7fd76194b640 1 -- 172.21.15.50:0/1930024743 shutdown_connections 2024-09-11T22:11:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.839+0000 7fd76194b640 1 -- 172.21.15.50:0/1930024743 wait complete. 2024-09-11T22:11:43.851 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:11:43.851 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:11:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.953+0000 7fee76323640 1 Processor -- start 2024-09-11T22:11:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.953+0000 7fee76323640 1 -- start start 2024-09-11T22:11:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.954+0000 7fee76323640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee700d3c00 0x7fee70169420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.954+0000 7fee76323640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee700cfa80 con 0x7fee700d18a0 2024-09-11T22:11:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.954+0000 7fee76323640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee700d40d0 con 0x7fee7015e870 2024-09-11T22:11:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.954+0000 7fee76323640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fee700d43b0 con 0x7fee700d3c00 2024-09-11T22:11:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.954+0000 7fee748c0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee700d3c00 0x7fee70169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.954+0000 7fee6f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fee700d18a0 0x7fee700d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49160/0 (socket says 172.21.15.50:49160) 2024-09-11T22:11:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.954+0000 7fee6f7fe640 1 -- 172.21.15.50:0/175595429 learned_addr learned my addr 172.21.15.50:0/175595429 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.954+0000 7fee748c0640 1 -- 172.21.15.50:0/175595429 >> v1:172.21.15.77:6789/0 conn(0x7fee7015e870 legacy=0x7fee700d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.954+0000 7fee748c0640 1 -- 172.21.15.50:0/175595429 >> v1:172.21.15.50:6789/0 conn(0x7fee700d18a0 legacy=0x7fee700d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.954+0000 7fee748c0640 1 -- 172.21.15.50:0/175595429 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee700b7c00 con 0x7fee700d3c00 2024-09-11T22:11:43.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.954+0000 7fee6effd640 1 -- 172.21.15.50:0/175595429 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1680595535 0 0) 0x7fee64001110 con 0x7fee700d18a0 2024-09-11T22:11:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.955+0000 7fee748c0640 1 --2- 172.21.15.50:0/175595429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee700d3c00 0x7fee70169420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fee68009d90 tx=0x7fee6802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798ba58018101beb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.955+0000 7fee6effd640 1 -- 172.21.15.50:0/175595429 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68007740 con 0x7fee700d3c00 2024-09-11T22:11:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.955+0000 7fee6effd640 1 -- 172.21.15.50:0/175595429 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee680078e0 con 0x7fee700d3c00 2024-09-11T22:11:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.955+0000 7fee6effd640 1 -- 172.21.15.50:0/175595429 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68007cb0 con 0x7fee700d3c00 2024-09-11T22:11:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.956+0000 7fee76323640 1 -- 172.21.15.50:0/175595429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee700d3c00 msgr2=0x7fee70169420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.956+0000 7fee76323640 1 --2- 172.21.15.50:0/175595429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee700d3c00 0x7fee70169420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fee68009d90 tx=0x7fee6802a6a0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.956+0000 7fee76323640 1 -- 172.21.15.50:0/175595429 shutdown_connections 2024-09-11T22:11:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.956+0000 7fee76323640 1 --2- 172.21.15.50:0/175595429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee700d3c00 0x7fee70169420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.956+0000 7fee76323640 1 -- 172.21.15.50:0/175595429 >> 172.21.15.50:0/175595429 conn(0x7fee700727a0 msgr2=0x7fee700679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.956+0000 7fee76323640 1 -- 172.21.15.50:0/175595429 shutdown_connections 2024-09-11T22:11:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.956+0000 7fee76323640 1 -- 172.21.15.50:0/175595429 wait complete. 2024-09-11T22:11:43.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.957+0000 7fee76323640 1 Processor -- start 2024-09-11T22:11:43.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.957+0000 7fee76323640 1 -- start start 2024-09-11T22:11:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee76323640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee700d18a0 0x7fee70160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee76323640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee700d3c00 0x7fee701469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee76323640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee7015e870 0x7fee70146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee76323640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fee700b78b0 con 0x7fee700d18a0 2024-09-11T22:11:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee76323640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fee7015ec50 con 0x7fee700d3c00 2024-09-11T22:11:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee76323640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fee700b9410 con 0x7fee7015e870 2024-09-11T22:11:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee6ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee700d18a0 0x7fee70160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee6ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee700d18a0 0x7fee70160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49440/0 (socket says 172.21.15.50:49440) 2024-09-11T22:11:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee6ffff640 1 -- 172.21.15.50:0/369126989 learned_addr learned my addr 172.21.15.50:0/369126989 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:43.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee6f7fe640 1 --2- 172.21.15.50:0/369126989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee700d3c00 0x7fee701469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee6ffff640 1 -- 172.21.15.50:0/369126989 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee7015e870 msgr2=0x7fee70146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee6ffff640 1 --2- 172.21.15.50:0/369126989 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee7015e870 0x7fee70146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee6ffff640 1 -- 172.21.15.50:0/369126989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee700d3c00 msgr2=0x7fee701469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee6ffff640 1 --2- 172.21.15.50:0/369126989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee700d3c00 0x7fee701469d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee6ffff640 1 -- 172.21.15.50:0/369126989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7015f4e0 con 0x7fee700d18a0 2024-09-11T22:11:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.958+0000 7fee6ffff640 1 --2- 172.21.15.50:0/369126989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee700d18a0 0x7fee70160580 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fee6000b3e0 tx=0x7fee6000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.959+0000 7fee6cff9640 1 -- 172.21.15.50:0/369126989 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60015020 con 0x7fee700d18a0 2024-09-11T22:11:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.959+0000 7fee6cff9640 1 -- 172.21.15.50:0/369126989 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee60011850 con 0x7fee700d18a0 2024-09-11T22:11:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.959+0000 7fee76323640 1 -- 172.21.15.50:0/369126989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7015f7c0 con 0x7fee700d18a0 2024-09-11T22:11:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.959+0000 7fee6cff9640 1 -- 172.21.15.50:0/369126989 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60011c40 con 0x7fee700d18a0 2024-09-11T22:11:43.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.959+0000 7fee76323640 1 -- 172.21.15.50:0/369126989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7015fd80 con 0x7fee700d18a0 2024-09-11T22:11:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.960+0000 7fee76323640 1 -- 172.21.15.50:0/369126989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee700d34d0 con 0x7fee700d18a0 2024-09-11T22:11:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.960+0000 7fee6cff9640 1 -- 172.21.15.50:0/369126989 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee60018020 con 0x7fee700d18a0 2024-09-11T22:11:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.961+0000 7fee6cff9640 1 --2- 172.21.15.50:0/369126989 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee5c06be30 0x7fee5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.961+0000 7fee6cff9640 1 -- 172.21.15.50:0/369126989 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fee6008ad50 con 0x7fee700d18a0 2024-09-11T22:11:43.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.961+0000 7fee6f7fe640 1 --2- 172.21.15.50:0/369126989 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee5c06be30 0x7fee5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:43.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.962+0000 7fee6f7fe640 1 --2- 172.21.15.50:0/369126989 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee5c06be30 0x7fee5c06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fee64000f60 tx=0x7fee64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:43.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:43.965+0000 7fee6cff9640 1 -- 172.21.15.50:0/369126989 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee6008e030 con 0x7fee700d18a0 2024-09-11T22:11:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.175+0000 7fee76323640 1 -- 172.21.15.50:0/369126989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee7006bf50 con 0x7fee700d18a0 2024-09-11T22:11:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.176+0000 7fee6cff9640 1 -- 172.21.15.50:0/369126989 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5214 (secure 0 0 0) 0x7fee6001f020 con 0x7fee700d18a0 2024-09-11T22:11:44.176 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:44.177 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"btime":"2024-09-11T22:11:16:865918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2971042772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2971042772},{"type":"v1","addr":"172.21.15.77:6837","nonce":2971042772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/293208439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":293208439},{"type":"v1","addr":"172.21.15.77:6835","nonce":293208439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4087237334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4087237334},{"type":"v1","addr":"172.21.15.50:6834","nonce":4087237334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:11:14.221375+0000","modified":"2024-09-11T22:11:16.209817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2305531878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2305531878},{"type":"v1","addr":"172.21.15.50:6835","nonce":2305531878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-11T22:11:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2024-09-11T22:11:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.178+0000 7fee76323640 1 -- 172.21.15.50:0/369126989 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee5c06be30 msgr2=0x7fee5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.178+0000 7fee76323640 1 --2- 172.21.15.50:0/369126989 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee5c06be30 0x7fee5c06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fee64000f60 tx=0x7fee64009040 comp rx=0 tx=0).stop 2024-09-11T22:11:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.178+0000 7fee76323640 1 -- 172.21.15.50:0/369126989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee700d18a0 msgr2=0x7fee70160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.178+0000 7fee76323640 1 --2- 172.21.15.50:0/369126989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee700d18a0 0x7fee70160580 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fee6000b3e0 tx=0x7fee6000b8a0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.178+0000 7fee76323640 1 -- 172.21.15.50:0/369126989 shutdown_connections 2024-09-11T22:11:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.178+0000 7fee76323640 1 --2- 172.21.15.50:0/369126989 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee5c06be30 0x7fee5c06e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.178+0000 7fee76323640 1 --2- 172.21.15.50:0/369126989 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee7015e870 0x7fee70146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.178+0000 7fee76323640 1 --2- 172.21.15.50:0/369126989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee700d3c00 0x7fee701469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.178+0000 7fee76323640 1 --2- 172.21.15.50:0/369126989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee700d18a0 0x7fee70160580 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.178+0000 7fee76323640 1 -- 172.21.15.50:0/369126989 >> 172.21.15.50:0/369126989 conn(0x7fee700727a0 msgr2=0x7fee700d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:44.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.178+0000 7fee76323640 1 -- 172.21.15.50:0/369126989 shutdown_connections 2024-09-11T22:11:44.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.178+0000 7fee76323640 1 -- 172.21.15.50:0/369126989 wait complete. 2024-09-11T22:11:44.190 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:11:44.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.292+0000 7f2eee586640 1 Processor -- start 2024-09-11T22:11:44.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.292+0000 7f2eee586640 1 -- start start 2024-09-11T22:11:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.292+0000 7f2eee586640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ee815e8e0 0x7f2ee80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.292+0000 7f2eee586640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2ee80d1580 0x7f2ee80d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.292+0000 7f2eee586640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee80d1ee0 con 0x7f2ee8162350 2024-09-11T22:11:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.292+0000 7f2eee586640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee815ecc0 con 0x7f2ee815e8e0 2024-09-11T22:11:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.292+0000 7f2eee586640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee80d2ad0 con 0x7f2ee80d1580 2024-09-11T22:11:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.293+0000 7f2ee7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ee815e8e0 0x7f2ee80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.293+0000 7f2eecb23640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2ee8162350 0x7f2ee81627a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49172/0 (socket says 172.21.15.50:49172) 2024-09-11T22:11:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.293+0000 7f2eecb23640 1 -- 172.21.15.50:0/1971606039 learned_addr learned my addr 172.21.15.50:0/1971606039 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.293+0000 7f2ee77fe640 1 --2- 172.21.15.50:0/1971606039 >> v2:172.21.15.77:3300/0 conn(0x7f2ee80d1580 0x7f2ee80d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.293+0000 7f2ee7fff640 1 -- 172.21.15.50:0/1971606039 >> v2:172.21.15.77:3300/0 conn(0x7f2ee80d1580 msgr2=0x7f2ee80d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:44.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.293+0000 7f2ee7fff640 1 --2- 172.21.15.50:0/1971606039 >> v2:172.21.15.77:3300/0 conn(0x7f2ee80d1580 0x7f2ee80d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.293+0000 7f2ee7fff640 1 -- 172.21.15.50:0/1971606039 >> v1:172.21.15.50:6789/0 conn(0x7f2ee8162350 legacy=0x7f2ee81627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.293+0000 7f2ee7fff640 1 -- 172.21.15.50:0/1971606039 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee8163080 con 0x7f2ee815e8e0 2024-09-11T22:11:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.294+0000 7f2ee7fff640 1 --2- 172.21.15.50:0/1971606039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee815e8e0 0x7f2ee80b7880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2ee81622b0 tx=0x7f2ed802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17ec02d0b011fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.294+0000 7f2ee6ffd640 1 -- 172.21.15.50:0/1971606039 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8037070 con 0x7f2ee815e8e0 2024-09-11T22:11:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.294+0000 7f2ee6ffd640 1 -- 172.21.15.50:0/1971606039 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed8032440 con 0x7f2ee815e8e0 2024-09-11T22:11:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.294+0000 7f2ee6ffd640 1 -- 172.21.15.50:0/1971606039 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8032810 con 0x7f2ee815e8e0 2024-09-11T22:11:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.294+0000 7f2eee586640 1 -- 172.21.15.50:0/1971606039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee815e8e0 msgr2=0x7f2ee80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.294+0000 7f2eee586640 1 --2- 172.21.15.50:0/1971606039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee815e8e0 0x7f2ee80b7880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2ee81622b0 tx=0x7f2ed802a230 comp rx=0 tx=0).stop 2024-09-11T22:11:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.294+0000 7f2eee586640 1 -- 172.21.15.50:0/1971606039 shutdown_connections 2024-09-11T22:11:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.294+0000 7f2eee586640 1 --2- 172.21.15.50:0/1971606039 >> v2:172.21.15.77:3300/0 conn(0x7f2ee80d1580 0x7f2ee80d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.294+0000 7f2eee586640 1 --2- 172.21.15.50:0/1971606039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee815e8e0 0x7f2ee80b7880 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.294+0000 7f2eee586640 1 -- 172.21.15.50:0/1971606039 >> 172.21.15.50:0/1971606039 conn(0x7f2ee8067ba0 msgr2=0x7f2ee8067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.294+0000 7f2eee586640 1 -- 172.21.15.50:0/1971606039 shutdown_connections 2024-09-11T22:11:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.294+0000 7f2eee586640 1 -- 172.21.15.50:0/1971606039 wait complete. 2024-09-11T22:11:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.296+0000 7f2eee586640 1 Processor -- start 2024-09-11T22:11:44.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.296+0000 7f2eee586640 1 -- start start 2024-09-11T22:11:44.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.296+0000 7f2eee586640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee80d1580 0x7f2ee80b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eee586640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee815e8e0 0x7f2ee815d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eee586640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee8162350 0x7f2ee815dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eee586640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee80d3000 con 0x7f2ee8162350 2024-09-11T22:11:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eee586640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee80d3370 con 0x7f2ee815e8e0 2024-09-11T22:11:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eee586640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee80d3800 con 0x7f2ee80d1580 2024-09-11T22:11:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eecb23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee8162350 0x7f2ee815dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eecb23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee8162350 0x7f2ee815dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49452/0 (socket says 172.21.15.50:49452) 2024-09-11T22:11:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eecb23640 1 -- 172.21.15.50:0/61438877 learned_addr learned my addr 172.21.15.50:0/61438877 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2ee7fff640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee80d1580 0x7f2ee80b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2ee77fe640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee815e8e0 0x7f2ee815d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eecb23640 1 -- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee80d1580 msgr2=0x7f2ee80b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eecb23640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee80d1580 0x7f2ee80b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eecb23640 1 -- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee815e8e0 msgr2=0x7f2ee815d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eecb23640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee815e8e0 0x7f2ee815d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eecb23640 1 -- 172.21.15.50:0/61438877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee80cad60 con 0x7f2ee8162350 2024-09-11T22:11:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eecb23640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee8162350 0x7f2ee815dc70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000ca80 tx=0x7f2ee000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2ee4ff9640 1 -- 172.21.15.50:0/61438877 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0017070 con 0x7f2ee8162350 2024-09-11T22:11:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2ee4ff9640 1 -- 172.21.15.50:0/61438877 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee000ac30 con 0x7f2ee8162350 2024-09-11T22:11:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eee586640 1 -- 172.21.15.50:0/61438877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee80b61e0 con 0x7f2ee8162350 2024-09-11T22:11:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2ee4ff9640 1 -- 172.21.15.50:0/61438877 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0012400 con 0x7f2ee8162350 2024-09-11T22:11:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.297+0000 7f2eee586640 1 -- 172.21.15.50:0/61438877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee815c480 con 0x7f2ee8162350 2024-09-11T22:11:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.298+0000 7f2eee586640 1 -- 172.21.15.50:0/61438877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee80d19a0 con 0x7f2ee8162350 2024-09-11T22:11:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.299+0000 7f2ee4ff9640 1 -- 172.21.15.50:0/61438877 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ee001a070 con 0x7f2ee8162350 2024-09-11T22:11:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.299+0000 7f2ee4ff9640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ed406be30 0x7f2ed406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.299+0000 7f2ee4ff9640 1 -- 172.21.15.50:0/61438877 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2ee008a9b0 con 0x7f2ee8162350 2024-09-11T22:11:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.299+0000 7f2ee7fff640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ed406be30 0x7f2ed406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.300+0000 7f2ee7fff640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ed406be30 0x7f2ed406e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8034000 tx=0x7f2ed802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:44.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.302+0000 7f2ee4ff9640 1 -- 172.21.15.50:0/61438877 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ee80cad60 con 0x7f2ee8162350 2024-09-11T22:11:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.518+0000 7f2eee586640 1 -- 172.21.15.50:0/61438877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ee80b6410 con 0x7f2ee8162350 2024-09-11T22:11:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.518+0000 7f2ee4ff9640 1 -- 172.21.15.50:0/61438877 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5214 (secure 0 0 0) 0x7f2ee0058d10 con 0x7f2ee8162350 2024-09-11T22:11:44.520 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:44.520 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"btime":"2024-09-11T22:11:16:865918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2971042772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2971042772},{"type":"v1","addr":"172.21.15.77:6837","nonce":2971042772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/293208439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":293208439},{"type":"v1","addr":"172.21.15.77:6835","nonce":293208439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4087237334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4087237334},{"type":"v1","addr":"172.21.15.50:6834","nonce":4087237334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:11:14.221375+0000","modified":"2024-09-11T22:11:16.209817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2305531878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2305531878},{"type":"v1","addr":"172.21.15.50:6835","nonce":2305531878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-11T22:11:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2024-09-11T22:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.520+0000 7f2eee586640 1 -- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ed406be30 msgr2=0x7f2ed406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.520+0000 7f2eee586640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ed406be30 0x7f2ed406e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8034000 tx=0x7f2ed802e000 comp rx=0 tx=0).stop 2024-09-11T22:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.520+0000 7f2eee586640 1 -- 172.21.15.50:0/61438877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee8162350 msgr2=0x7f2ee815dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.520+0000 7f2eee586640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee8162350 0x7f2ee815dc70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000ca80 tx=0x7f2ee000cf40 comp rx=0 tx=0).stop 2024-09-11T22:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.521+0000 7f2eee586640 1 -- 172.21.15.50:0/61438877 shutdown_connections 2024-09-11T22:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.521+0000 7f2eee586640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ed406be30 0x7f2ed406e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.521+0000 7f2eee586640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee8162350 0x7f2ee815dc70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.521+0000 7f2eee586640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee815e8e0 0x7f2ee815d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.521+0000 7f2eee586640 1 --2- 172.21.15.50:0/61438877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee80d1580 0x7f2ee80b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.521+0000 7f2eee586640 1 -- 172.21.15.50:0/61438877 >> 172.21.15.50:0/61438877 conn(0x7f2ee8067ba0 msgr2=0x7f2ee8067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.521+0000 7f2eee586640 1 -- 172.21.15.50:0/61438877 shutdown_connections 2024-09-11T22:11:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.521+0000 7f2eee586640 1 -- 172.21.15.50:0/61438877 wait complete. 2024-09-11T22:11:44.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:44.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.634+0000 7f12cc2dd640 1 Processor -- start 2024-09-11T22:11:44.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.634+0000 7f12cc2dd640 1 -- start start 2024-09-11T22:11:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.635+0000 7f12cc2dd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f12c40d1c90 0x7f12c40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.635+0000 7f12cc2dd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12c4163080 con 0x7f12c4162350 2024-09-11T22:11:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.635+0000 7f12cc2dd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12c40d2d20 con 0x7f12c415e8e0 2024-09-11T22:11:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.635+0000 7f12cc2dd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f12c415ecc0 con 0x7f12c40d1c90 2024-09-11T22:11:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.635+0000 7f12ca87a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f12c4162350 0x7f12c41627a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49180/0 (socket says 172.21.15.50:49180) 2024-09-11T22:11:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.635+0000 7f12ca87a640 1 -- 172.21.15.50:0/2505125910 learned_addr learned my addr 172.21.15.50:0/2505125910 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.636+0000 7f12c9878640 1 --2- 172.21.15.50:0/2505125910 >> v2:172.21.15.77:3300/0 conn(0x7f12c40d1c90 0x7f12c40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.636+0000 7f12c9077640 1 -- 172.21.15.50:0/2505125910 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 34332944 0 0) 0x7f12c4163080 con 0x7f12c4162350 2024-09-11T22:11:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.636+0000 7f12c9077640 1 -- 172.21.15.50:0/2505125910 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12b0003520 con 0x7f12c4162350 2024-09-11T22:11:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.636+0000 7f12c9077640 1 -- 172.21.15.50:0/2505125910 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851474601 0 0) 0x7f12c40d2d20 con 0x7f12c415e8e0 2024-09-11T22:11:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.636+0000 7f12c9077640 1 -- 172.21.15.50:0/2505125910 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12c4163080 con 0x7f12c415e8e0 2024-09-11T22:11:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.636+0000 7f12c9077640 1 -- 172.21.15.50:0/2505125910 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3575011153 0 0) 0x7f12b0003520 con 0x7f12c4162350 2024-09-11T22:11:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.636+0000 7f12c9878640 1 -- 172.21.15.50:0/2505125910 >> v1:172.21.15.77:6789/0 conn(0x7f12c415e8e0 legacy=0x7f12c40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.636+0000 7f12c9878640 1 -- 172.21.15.50:0/2505125910 >> v1:172.21.15.50:6789/0 conn(0x7f12c4162350 legacy=0x7f12c41627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.636+0000 7f12c9878640 1 -- 172.21.15.50:0/2505125910 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c40d3000 con 0x7f12c40d1c90 2024-09-11T22:11:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.637+0000 7f12c9878640 1 --2- 172.21.15.50:0/2505125910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c40d1c90 0x7f12c40b7880 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f12b40097a0 tx=0x7f12b402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58a9df608e6d272 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.637+0000 7f12c9077640 1 -- 172.21.15.50:0/2505125910 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4037070 con 0x7f12c40d1c90 2024-09-11T22:11:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.637+0000 7f12c9077640 1 -- 172.21.15.50:0/2505125910 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b402ace0 con 0x7f12c40d1c90 2024-09-11T22:11:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.637+0000 7f12c9077640 1 -- 172.21.15.50:0/2505125910 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc001670 con 0x7f12c40d1c90 2024-09-11T22:11:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.638+0000 7f12cc2dd640 1 -- 172.21.15.50:0/2505125910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c40d1c90 msgr2=0x7f12c40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.638+0000 7f12cc2dd640 1 --2- 172.21.15.50:0/2505125910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c40d1c90 0x7f12c40b7880 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f12b40097a0 tx=0x7f12b402a250 comp rx=0 tx=0).stop 2024-09-11T22:11:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.638+0000 7f12cc2dd640 1 -- 172.21.15.50:0/2505125910 shutdown_connections 2024-09-11T22:11:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.638+0000 7f12cc2dd640 1 --2- 172.21.15.50:0/2505125910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c40d1c90 0x7f12c40b7880 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.638+0000 7f12cc2dd640 1 -- 172.21.15.50:0/2505125910 >> 172.21.15.50:0/2505125910 conn(0x7f12c4067ba0 msgr2=0x7f12c4067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.638+0000 7f12cc2dd640 1 -- 172.21.15.50:0/2505125910 shutdown_connections 2024-09-11T22:11:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.638+0000 7f12cc2dd640 1 -- 172.21.15.50:0/2505125910 wait complete. 2024-09-11T22:11:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.639+0000 7f12cc2dd640 1 Processor -- start 2024-09-11T22:11:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.639+0000 7f12cc2dd640 1 -- start start 2024-09-11T22:11:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12cc2dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c40d1c90 0x7f12c4155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12cc2dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c415e8e0 0x7f12c40b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12cc2dd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12c4162350 0x7f12c40b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12cc2dd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f12c40d3c10 con 0x7f12c415e8e0 2024-09-11T22:11:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12cc2dd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f12c40d3a90 con 0x7f12c40d1c90 2024-09-11T22:11:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12cc2dd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f12c40d3d90 con 0x7f12c4162350 2024-09-11T22:11:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12c9878640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c415e8e0 0x7f12c40b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12c9878640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c415e8e0 0x7f12c40b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49460/0 (socket says 172.21.15.50:49460) 2024-09-11T22:11:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12c9878640 1 -- 172.21.15.50:0/241965770 learned_addr learned my addr 172.21.15.50:0/241965770 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12ca079640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c40d1c90 0x7f12c4155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12ca87a640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12c4162350 0x7f12c40b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12c9878640 1 -- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12c4162350 msgr2=0x7f12c40b7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12c9878640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12c4162350 0x7f12c40b7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12c9878640 1 -- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c40d1c90 msgr2=0x7f12c4155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12c9878640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c40d1c90 0x7f12c4155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12c9878640 1 -- 172.21.15.50:0/241965770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c4155c70 con 0x7f12c415e8e0 2024-09-11T22:11:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12ca079640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c40d1c90 0x7f12c4155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.640+0000 7f12c9878640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c415e8e0 0x7f12c40b5770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f12b4035040 tx=0x7f12b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.641+0000 7f12baffd640 1 -- 172.21.15.50:0/241965770 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4041020 con 0x7f12c415e8e0 2024-09-11T22:11:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.641+0000 7f12baffd640 1 -- 172.21.15.50:0/241965770 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b403d620 con 0x7f12c415e8e0 2024-09-11T22:11:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.641+0000 7f12cc2dd640 1 -- 172.21.15.50:0/241965770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c40b6150 con 0x7f12c415e8e0 2024-09-11T22:11:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.641+0000 7f12baffd640 1 -- 172.21.15.50:0/241965770 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4037040 con 0x7f12c415e8e0 2024-09-11T22:11:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.641+0000 7f12cc2dd640 1 -- 172.21.15.50:0/241965770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c40b6710 con 0x7f12c415e8e0 2024-09-11T22:11:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.642+0000 7f12cc2dd640 1 -- 172.21.15.50:0/241965770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c40b7880 con 0x7f12c415e8e0 2024-09-11T22:11:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.642+0000 7f12baffd640 1 -- 172.21.15.50:0/241965770 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12b4044020 con 0x7f12c415e8e0 2024-09-11T22:11:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.643+0000 7f12baffd640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f12a806be30 0x7f12a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.643+0000 7f12baffd640 1 -- 172.21.15.50:0/241965770 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f12b40ab390 con 0x7f12c415e8e0 2024-09-11T22:11:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.643+0000 7f12ca079640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f12a806be30 0x7f12a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.643+0000 7f12ca079640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f12a806be30 0x7f12a806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f12c0007fd0 tx=0x7f12c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:44.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.647+0000 7f12baffd640 1 -- 172.21.15.50:0/241965770 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12b404b030 con 0x7f12c415e8e0 2024-09-11T22:11:44.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.824+0000 7f12cc2dd640 1 -- 172.21.15.50:0/241965770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12c40ba770 con 0x7f12c415e8e0 2024-09-11T22:11:44.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.825+0000 7f12baffd640 1 -- 172.21.15.50:0/241965770 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7f12b4079dd0 con 0x7f12c415e8e0 2024-09-11T22:11:44.827 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:44.827 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:15.853220+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:12.090736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:13.202114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.827+0000 7f12cc2dd640 1 -- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f12a806be30 msgr2=0x7f12a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.827+0000 7f12cc2dd640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f12a806be30 0x7f12a806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f12c0007fd0 tx=0x7f12c0009040 comp rx=0 tx=0).stop 2024-09-11T22:11:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.827+0000 7f12cc2dd640 1 -- 172.21.15.50:0/241965770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c415e8e0 msgr2=0x7f12c40b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.827+0000 7f12cc2dd640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c415e8e0 0x7f12c40b5770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f12b4035040 tx=0x7f12b40046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.827+0000 7f12cc2dd640 1 -- 172.21.15.50:0/241965770 shutdown_connections 2024-09-11T22:11:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.827+0000 7f12cc2dd640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f12a806be30 0x7f12a806e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.827+0000 7f12cc2dd640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12c4162350 0x7f12c40b7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.827+0000 7f12cc2dd640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12c415e8e0 0x7f12c40b5770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.827+0000 7f12cc2dd640 1 --2- 172.21.15.50:0/241965770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12c40d1c90 0x7f12c4155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.827+0000 7f12cc2dd640 1 -- 172.21.15.50:0/241965770 >> 172.21.15.50:0/241965770 conn(0x7f12c4067ba0 msgr2=0x7f12c4067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:44.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.827+0000 7f12cc2dd640 1 -- 172.21.15.50:0/241965770 shutdown_connections 2024-09-11T22:11:44.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.827+0000 7f12cc2dd640 1 -- 172.21.15.50:0/241965770 wait complete. 2024-09-11T22:11:44.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:11:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.942+0000 7fdd6a2dd640 1 Processor -- start 2024-09-11T22:11:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.942+0000 7fdd6a2dd640 1 -- start start 2024-09-11T22:11:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.943+0000 7fdd6a2dd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdd6415e8e0 0x7fdd640b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.943+0000 7fdd6a2dd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd64162350 0x7fdd641627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.943+0000 7fdd6a2dd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd64163080 con 0x7fdd640d1580 2024-09-11T22:11:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.943+0000 7fdd6a2dd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fdd6415ecc0 con 0x7fdd64162350 2024-09-11T22:11:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.943+0000 7fdd6a2dd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fdd640d2ad0 con 0x7fdd6415e8e0 2024-09-11T22:11:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.943+0000 7fdd6887a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd64162350 0x7fdd641627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.943+0000 7fdd6887a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd64162350 0x7fdd641627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49468/0 (socket says 172.21.15.50:49468) 2024-09-11T22:11:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.943+0000 7fdd6887a640 1 -- 172.21.15.50:0/3076747073 learned_addr learned my addr 172.21.15.50:0/3076747073 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.943+0000 7fdd63fff640 1 --2- 172.21.15.50:0/3076747073 >> v2:172.21.15.77:3300/0 conn(0x7fdd6415e8e0 0x7fdd640b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.943+0000 7fdd6887a640 1 -- 172.21.15.50:0/3076747073 >> v2:172.21.15.77:3300/0 conn(0x7fdd6415e8e0 msgr2=0x7fdd640b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.943+0000 7fdd6887a640 1 --2- 172.21.15.50:0/3076747073 >> v2:172.21.15.77:3300/0 conn(0x7fdd6415e8e0 0x7fdd640b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.943+0000 7fdd6887a640 1 -- 172.21.15.50:0/3076747073 >> v1:172.21.15.77:6789/0 conn(0x7fdd640d1580 legacy=0x7fdd640d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.943+0000 7fdd6887a640 1 -- 172.21.15.50:0/3076747073 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd640d2d20 con 0x7fdd64162350 2024-09-11T22:11:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.944+0000 7fdd6887a640 1 --2- 172.21.15.50:0/3076747073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd64162350 0x7fdd641627a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdd6408d630 tx=0x7fdd5c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf84f7b10739bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.944+0000 7fdd637fe640 1 -- 172.21.15.50:0/3076747073 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c036070 con 0x7fdd64162350 2024-09-11T22:11:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.944+0000 7fdd637fe640 1 -- 172.21.15.50:0/3076747073 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5c031600 con 0x7fdd64162350 2024-09-11T22:11:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.944+0000 7fdd637fe640 1 -- 172.21.15.50:0/3076747073 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c0319f0 con 0x7fdd64162350 2024-09-11T22:11:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.945+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/3076747073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd64162350 msgr2=0x7fdd641627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.945+0000 7fdd6a2dd640 1 --2- 172.21.15.50:0/3076747073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd64162350 0x7fdd641627a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdd6408d630 tx=0x7fdd5c02a7c0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.945+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/3076747073 shutdown_connections 2024-09-11T22:11:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.945+0000 7fdd6a2dd640 1 --2- 172.21.15.50:0/3076747073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd64162350 0x7fdd641627a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.945+0000 7fdd6a2dd640 1 --2- 172.21.15.50:0/3076747073 >> v2:172.21.15.77:3300/0 conn(0x7fdd6415e8e0 0x7fdd640b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.945+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/3076747073 >> 172.21.15.50:0/3076747073 conn(0x7fdd64067ba0 msgr2=0x7fdd64067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.945+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/3076747073 shutdown_connections 2024-09-11T22:11:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.945+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/3076747073 wait complete. 2024-09-11T22:11:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.946+0000 7fdd6a2dd640 1 Processor -- start 2024-09-11T22:11:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.946+0000 7fdd6a2dd640 1 -- start start 2024-09-11T22:11:44.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6a2dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd640d1580 0x7fdd640ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6a2dd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd6415e8e0 0x7fdd641e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6a2dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd64162350 0x7fdd641e8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6a2dd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd64162ce0 con 0x7fdd64162350 2024-09-11T22:11:44.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6a2dd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd640d3370 con 0x7fdd640d1580 2024-09-11T22:11:44.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6a2dd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdd64162e60 con 0x7fdd6415e8e0 2024-09-11T22:11:44.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6887a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd64162350 0x7fdd641e8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6887a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd64162350 0x7fdd641e8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49476/0 (socket says 172.21.15.50:49476) 2024-09-11T22:11:44.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6887a640 1 -- 172.21.15.50:0/777277071 learned_addr learned my addr 172.21.15.50:0/777277071 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:44.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd63fff640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd640d1580 0x7fdd640ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd5bfff640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd6415e8e0 0x7fdd641e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6887a640 1 -- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd6415e8e0 msgr2=0x7fdd641e8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6887a640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd6415e8e0 0x7fdd641e8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6887a640 1 -- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd640d1580 msgr2=0x7fdd640ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:44.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6887a640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd640d1580 0x7fdd640ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:44.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.947+0000 7fdd6887a640 1 -- 172.21.15.50:0/777277071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd641eadb0 con 0x7fdd64162350 2024-09-11T22:11:44.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.948+0000 7fdd6887a640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd64162350 0x7fdd641e8690 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c02a800 tx=0x7fdd5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:44.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.948+0000 7fdd617fa640 1 -- 172.21.15.50:0/777277071 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c036050 con 0x7fdd64162350 2024-09-11T22:11:44.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.948+0000 7fdd617fa640 1 -- 172.21.15.50:0/777277071 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5c042070 con 0x7fdd64162350 2024-09-11T22:11:44.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.948+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/777277071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd641eb090 con 0x7fdd64162350 2024-09-11T22:11:44.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.948+0000 7fdd617fa640 1 -- 172.21.15.50:0/777277071 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c009510 con 0x7fdd64162350 2024-09-11T22:11:44.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.948+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/777277071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd640b51b0 con 0x7fdd64162350 2024-09-11T22:11:44.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.949+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/777277071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd640b7880 con 0x7fdd64162350 2024-09-11T22:11:44.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.949+0000 7fdd617fa640 1 -- 172.21.15.50:0/777277071 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd5c004450 con 0x7fdd64162350 2024-09-11T22:11:44.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.950+0000 7fdd617fa640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdd4406be30 0x7fdd4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:44.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.950+0000 7fdd617fa640 1 -- 172.21.15.50:0/777277071 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdd5c0aba80 con 0x7fdd64162350 2024-09-11T22:11:44.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.950+0000 7fdd63fff640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdd4406be30 0x7fdd4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:44.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.951+0000 7fdd63fff640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdd4406be30 0x7fdd4406e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009b40 tx=0x7fdd54009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:44.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:44.954+0000 7fdd617fa640 1 -- 172.21.15.50:0/777277071 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd5c079e70 con 0x7fdd64162350 2024-09-11T22:11:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.168+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/777277071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdd640ba770 con 0x7fdd64162350 2024-09-11T22:11:45.170 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:11:45.168+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:11:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.170+0000 7fdd617fa640 1 -- 172.21.15.50:0/777277071 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7fdd5c07e170 con 0x7fdd64162350 2024-09-11T22:11:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:11:45.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.173+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdd4406be30 msgr2=0x7fdd4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:45.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.173+0000 7fdd6a2dd640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdd4406be30 0x7fdd4406e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009b40 tx=0x7fdd54009190 comp rx=0 tx=0).stop 2024-09-11T22:11:45.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.173+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/777277071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd64162350 msgr2=0x7fdd641e8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:45.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.173+0000 7fdd6a2dd640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd64162350 0x7fdd641e8690 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c02a800 tx=0x7fdd5c004a40 comp rx=0 tx=0).stop 2024-09-11T22:11:45.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.173+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/777277071 shutdown_connections 2024-09-11T22:11:45.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.173+0000 7fdd6a2dd640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdd4406be30 0x7fdd4406e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.173+0000 7fdd6a2dd640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd6415e8e0 0x7fdd641e8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.173+0000 7fdd6a2dd640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd64162350 0x7fdd641e8690 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.173+0000 7fdd6a2dd640 1 --2- 172.21.15.50:0/777277071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd640d1580 0x7fdd640ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.173+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/777277071 >> 172.21.15.50:0/777277071 conn(0x7fdd64067ba0 msgr2=0x7fdd641605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:45.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.173+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/777277071 shutdown_connections 2024-09-11T22:11:45.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.173+0000 7fdd6a2dd640 1 -- 172.21.15.50:0/777277071 wait complete. 2024-09-11T22:11:45.180 INFO:tasks.ceph.mds.a.smithi050.stderr: -6655> 2024-09-11T22:11:20.840+0000 7f1969105640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:11:45.190 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:11:45.216 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:11:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.294+0000 7f73da25e640 1 Processor -- start 2024-09-11T22:11:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.294+0000 7f73da25e640 1 -- start start 2024-09-11T22:11:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.295+0000 7f73da25e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f73d40cf790 0x7f73d40b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.295+0000 7f73da25e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d4162110 con 0x7f73d40d11d0 2024-09-11T22:11:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.295+0000 7f73da25e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d40cfd70 con 0x7f73d4161d30 2024-09-11T22:11:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.295+0000 7f73da25e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f73d40d3450 con 0x7f73d40cf790 2024-09-11T22:11:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.295+0000 7f73d3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f73d40d11d0 0x7f73d40d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49186/0 (socket says 172.21.15.50:49186) 2024-09-11T22:11:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.295+0000 7f73d3fff640 1 -- 172.21.15.50:0/923873428 learned_addr learned my addr 172.21.15.50:0/923873428 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.295+0000 7f73d2ffd640 1 --2- 172.21.15.50:0/923873428 >> v2:172.21.15.77:3300/0 conn(0x7f73d40cf790 0x7f73d40b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.295+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831652533 0 0) 0x7f73d4162110 con 0x7f73d40d11d0 2024-09-11T22:11:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.295+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73bc003520 con 0x7f73d40d11d0 2024-09-11T22:11:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2649128142 0 0) 0x7f73d40cfd70 con 0x7f73d4161d30 2024-09-11T22:11:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73d4162110 con 0x7f73d4161d30 2024-09-11T22:11:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2451455080 0 0) 0x7f73bc003520 con 0x7f73d40d11d0 2024-09-11T22:11:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 >> v2:172.21.15.77:3300/0 conn(0x7f73d40cf790 msgr2=0x7f73d40b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 --2- 172.21.15.50:0/923873428 >> v2:172.21.15.77:3300/0 conn(0x7f73d40cf790 0x7f73d40b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 >> v1:172.21.15.77:6789/0 conn(0x7f73d4161d30 legacy=0x7f73d4162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d40d2b20 con 0x7f73d40d11d0 2024-09-11T22:11:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f73cc0019f0 con 0x7f73d40d11d0 2024-09-11T22:11:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 >> v1:172.21.15.50:6789/0 conn(0x7f73d40d11d0 legacy=0x7f73d40d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 --2- 172.21.15.50:0/923873428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73bc003b90 0x7f73bc003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 --2- 172.21.15.50:0/923873428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73bc004800 0x7f73bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 --2- 172.21.15.50:0/923873428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73bc0051c0 0x7f73bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73d40d3450 con 0x7f73bc004800 2024-09-11T22:11:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc00c090 con 0x7f73bc003b90 2024-09-11T22:11:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f73bc00c290 con 0x7f73bc0051c0 2024-09-11T22:11:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d2ffd640 1 --2- 172.21.15.50:0/923873428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73bc004800 0x7f73bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d37fe640 1 --2- 172.21.15.50:0/923873428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73bc003b90 0x7f73bc003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d3fff640 1 --2- 172.21.15.50:0/923873428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73bc0051c0 0x7f73bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d2ffd640 1 -- 172.21.15.50:0/923873428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73bc0051c0 msgr2=0x7f73bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d2ffd640 1 --2- 172.21.15.50:0/923873428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73bc0051c0 0x7f73bc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d2ffd640 1 -- 172.21.15.50:0/923873428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73bc003b90 msgr2=0x7f73bc003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d2ffd640 1 --2- 172.21.15.50:0/923873428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73bc003b90 0x7f73bc003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d2ffd640 1 -- 172.21.15.50:0/923873428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73bc003520 con 0x7f73bc004800 2024-09-11T22:11:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.296+0000 7f73d3fff640 1 -- 172.21.15.50:0/923873428 reap_dead start 2024-09-11T22:11:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.297+0000 7f73d2ffd640 1 --2- 172.21.15.50:0/923873428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73bc004800 0x7f73bc004c80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f73c8009ac0 tx=0x7f73bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd48f12a4a8d737 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.297+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c8036070 con 0x7f73bc004800 2024-09-11T22:11:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.297+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c8031400 con 0x7f73bc004800 2024-09-11T22:11:45.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.297+0000 7f73d27fc640 1 -- 172.21.15.50:0/923873428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c8009690 con 0x7f73bc004800 2024-09-11T22:11:45.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.298+0000 7f73da25e640 1 -- 172.21.15.50:0/923873428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73bc004800 msgr2=0x7f73bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:45.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.298+0000 7f73da25e640 1 --2- 172.21.15.50:0/923873428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73bc004800 0x7f73bc004c80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f73c8009ac0 tx=0x7f73bc005830 comp rx=0 tx=0).stop 2024-09-11T22:11:45.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.298+0000 7f73da25e640 1 -- 172.21.15.50:0/923873428 shutdown_connections 2024-09-11T22:11:45.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.298+0000 7f73da25e640 1 --2- 172.21.15.50:0/923873428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73bc004800 0x7f73bc004c80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.298+0000 7f73da25e640 1 -- 172.21.15.50:0/923873428 >> 172.21.15.50:0/923873428 conn(0x7f73d40727a0 msgr2=0x7f73d40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.298+0000 7f73da25e640 1 -- 172.21.15.50:0/923873428 shutdown_connections 2024-09-11T22:11:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.298+0000 7f73da25e640 1 -- 172.21.15.50:0/923873428 wait complete. 2024-09-11T22:11:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.299+0000 7f73da25e640 1 Processor -- start 2024-09-11T22:11:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.299+0000 7f73da25e640 1 -- start start 2024-09-11T22:11:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.300+0000 7f73da25e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73bc004800 0x7f73d40cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.300+0000 7f73da25e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d40cb140 0x7f73d40b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.300+0000 7f73da25e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73d40b5630 0x7f73d41f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.300+0000 7f73da25e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73d40b78f0 con 0x7f73d40cb140 2024-09-11T22:11:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.300+0000 7f73da25e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73d40d30e0 con 0x7f73bc004800 2024-09-11T22:11:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.300+0000 7f73da25e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f73d40b7a70 con 0x7f73d40b5630 2024-09-11T22:11:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.300+0000 7f73d2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d40cb140 0x7f73d40b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:45.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.300+0000 7f73d2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d40cb140 0x7f73d40b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49514/0 (socket says 172.21.15.50:49514) 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.300+0000 7f73d2ffd640 1 -- 172.21.15.50:0/3024732110 learned_addr learned my addr 172.21.15.50:0/3024732110 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.300+0000 7f73d37fe640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73bc004800 0x7f73d40cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.300+0000 7f73d3fff640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73d40b5630 0x7f73d41f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.301+0000 7f73d2ffd640 1 -- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73d40b5630 msgr2=0x7f73d41f7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.301+0000 7f73d2ffd640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73d40b5630 0x7f73d41f7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.301+0000 7f73d2ffd640 1 -- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73bc004800 msgr2=0x7f73d40cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.301+0000 7f73d2ffd640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73bc004800 0x7f73d40cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.301+0000 7f73d2ffd640 1 -- 172.21.15.50:0/3024732110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d40b5b00 con 0x7f73d40cb140 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.301+0000 7f73d2ffd640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d40cb140 0x7f73d40b50f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f73c8009be0 tx=0x7f73c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.301+0000 7f73bbfff640 1 -- 172.21.15.50:0/3024732110 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c803f020 con 0x7f73d40cb140 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.301+0000 7f73bbfff640 1 -- 172.21.15.50:0/3024732110 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c8037040 con 0x7f73d40cb140 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.301+0000 7f73da25e640 1 -- 172.21.15.50:0/3024732110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d40b5de0 con 0x7f73d40cb140 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.301+0000 7f73bbfff640 1 -- 172.21.15.50:0/3024732110 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c8036070 con 0x7f73d40cb140 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.301+0000 7f73da25e640 1 -- 172.21.15.50:0/3024732110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d40b63a0 con 0x7f73d40cb140 2024-09-11T22:11:45.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.302+0000 7f73da25e640 1 -- 172.21.15.50:0/3024732110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d40b7da0 con 0x7f73d40cb140 2024-09-11T22:11:45.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.302+0000 7f73bbfff640 1 -- 172.21.15.50:0/3024732110 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f73c8042020 con 0x7f73d40cb140 2024-09-11T22:11:45.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.303+0000 7f73bbfff640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f73c006be30 0x7f73c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:45.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.303+0000 7f73bbfff640 1 -- 172.21.15.50:0/3024732110 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f73c80aae50 con 0x7f73d40cb140 2024-09-11T22:11:45.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.303+0000 7f73d37fe640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f73c006be30 0x7f73c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:45.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.304+0000 7f73d37fe640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f73c006be30 0x7f73c006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f73c40055d0 tx=0x7f73c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:45.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.307+0000 7f73bbfff640 1 -- 172.21.15.50:0/3024732110 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73c8049030 con 0x7f73d40cb140 2024-09-11T22:11:45.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:45.523+0000 7f73da25e640 1 -- 172.21.15.50:0/3024732110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f73d40b9120 con 0x7f73d40cb140 2024-09-11T22:11:46.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.176+0000 7f73bbfff640 1 -- 172.21.15.50:0/3024732110 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f73c80798f0 con 0x7f73d40cb140 2024-09-11T22:11:46.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.179+0000 7f73da25e640 1 -- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f73c006be30 msgr2=0x7f73c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:46.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.179+0000 7f73da25e640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f73c006be30 0x7f73c006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f73c40055d0 tx=0x7f73c4009040 comp rx=0 tx=0).stop 2024-09-11T22:11:46.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.179+0000 7f73da25e640 1 -- 172.21.15.50:0/3024732110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d40cb140 msgr2=0x7f73d40b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:46.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.179+0000 7f73da25e640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d40cb140 0x7f73d40b50f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f73c8009be0 tx=0x7f73c8004730 comp rx=0 tx=0).stop 2024-09-11T22:11:46.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.179+0000 7f73da25e640 1 -- 172.21.15.50:0/3024732110 shutdown_connections 2024-09-11T22:11:46.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.180+0000 7f73da25e640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f73c006be30 0x7f73c006e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.180+0000 7f73da25e640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73d40b5630 0x7f73d41f7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.180+0000 7f73da25e640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73d40cb140 0x7f73d40b50f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.180+0000 7f73da25e640 1 --2- 172.21.15.50:0/3024732110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73bc004800 0x7f73d40cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.180+0000 7f73da25e640 1 -- 172.21.15.50:0/3024732110 >> 172.21.15.50:0/3024732110 conn(0x7f73d40727a0 msgr2=0x7f73d40b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:46.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.180+0000 7f73da25e640 1 -- 172.21.15.50:0/3024732110 shutdown_connections 2024-09-11T22:11:46.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.180+0000 7f73da25e640 1 -- 172.21.15.50:0/3024732110 wait complete. 2024-09-11T22:11:46.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:11:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.350+0000 7f894da17640 1 Processor -- start 2024-09-11T22:11:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.350+0000 7f894da17640 1 -- start start 2024-09-11T22:11:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.350+0000 7f894da17640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8948161d30 0x7f89480cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.350+0000 7f894da17640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89480b78f0 0x7f8948162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.350+0000 7f894da17640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89481632e0 con 0x7f89480d11d0 2024-09-11T22:11:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.350+0000 7f894da17640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f89480d3450 con 0x7f89480b78f0 2024-09-11T22:11:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.350+0000 7f894da17640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8948162110 con 0x7f8948161d30 2024-09-11T22:11:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.351+0000 7f89467fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89480b78f0 0x7f8948162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.351+0000 7f89477fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f89480d11d0 0x7f89480d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49198/0 (socket says 172.21.15.50:49198) 2024-09-11T22:11:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.351+0000 7f89477fe640 1 -- 172.21.15.50:0/193861354 learned_addr learned my addr 172.21.15.50:0/193861354 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.351+0000 7f8946ffd640 1 --2- 172.21.15.50:0/193861354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8948161d30 0x7f89480cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.351+0000 7f89467fc640 1 -- 172.21.15.50:0/193861354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8948161d30 msgr2=0x7f89480cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.351+0000 7f89467fc640 1 --2- 172.21.15.50:0/193861354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8948161d30 0x7f89480cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.351+0000 7f89467fc640 1 -- 172.21.15.50:0/193861354 >> v1:172.21.15.50:6789/0 conn(0x7f89480d11d0 legacy=0x7f89480d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.351+0000 7f89467fc640 1 -- 172.21.15.50:0/193861354 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89480cfd70 con 0x7f89480b78f0 2024-09-11T22:11:46.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.352+0000 7f89467fc640 1 --2- 172.21.15.50:0/193861354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480b78f0 0x7f8948162da0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f89300097a0 tx=0x7f893002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bb2dbfb287a080 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:46.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.352+0000 7f8945ffb640 1 -- 172.21.15.50:0/193861354 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8930037070 con 0x7f89480b78f0 2024-09-11T22:11:46.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.352+0000 7f8945ffb640 1 -- 172.21.15.50:0/193861354 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8930032440 con 0x7f89480b78f0 2024-09-11T22:11:46.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.352+0000 7f8945ffb640 1 -- 172.21.15.50:0/193861354 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8930032810 con 0x7f89480b78f0 2024-09-11T22:11:46.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.352+0000 7f894da17640 1 -- 172.21.15.50:0/193861354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480b78f0 msgr2=0x7f8948162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:46.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.352+0000 7f894da17640 1 --2- 172.21.15.50:0/193861354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480b78f0 0x7f8948162da0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f89300097a0 tx=0x7f893002a180 comp rx=0 tx=0).stop 2024-09-11T22:11:46.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.352+0000 7f894da17640 1 -- 172.21.15.50:0/193861354 shutdown_connections 2024-09-11T22:11:46.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.352+0000 7f894da17640 1 --2- 172.21.15.50:0/193861354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480b78f0 0x7f8948162da0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.352+0000 7f894da17640 1 --2- 172.21.15.50:0/193861354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8948161d30 0x7f89480cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.352+0000 7f894da17640 1 -- 172.21.15.50:0/193861354 >> 172.21.15.50:0/193861354 conn(0x7f89480727a0 msgr2=0x7f89480679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:46.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.352+0000 7f894da17640 1 -- 172.21.15.50:0/193861354 shutdown_connections 2024-09-11T22:11:46.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.352+0000 7f894da17640 1 -- 172.21.15.50:0/193861354 wait complete. 2024-09-11T22:11:46.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.354+0000 7f894da17640 1 Processor -- start 2024-09-11T22:11:46.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.354+0000 7f894da17640 1 -- start start 2024-09-11T22:11:46.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f894da17640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89480b78f0 0x7f8948159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:46.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f894da17640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480d11d0 0x7f89480cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:46.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f894da17640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8948161d30 0x7f89481f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:46.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f894da17640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f89480d30e0 con 0x7f89480d11d0 2024-09-11T22:11:46.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f894da17640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89480d2e00 con 0x7f8948161d30 2024-09-11T22:11:46.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f894da17640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f89480b7d30 con 0x7f89480b78f0 2024-09-11T22:11:46.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f89467fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480d11d0 0x7f89480cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:46.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f89467fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480d11d0 0x7f89480cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49534/0 (socket says 172.21.15.50:49534) 2024-09-11T22:11:46.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f89467fc640 1 -- 172.21.15.50:0/2206466887 learned_addr learned my addr 172.21.15.50:0/2206466887 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:46.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f89477fe640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8948161d30 0x7f89481f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f8946ffd640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89480b78f0 0x7f8948159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f89467fc640 1 -- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89480b78f0 msgr2=0x7f8948159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f89467fc640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89480b78f0 0x7f8948159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f89467fc640 1 -- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8948161d30 msgr2=0x7f89481f82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f89467fc640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8948161d30 0x7f89481f82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f89467fc640 1 -- 172.21.15.50:0/2206466887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89481f8a20 con 0x7f89480d11d0 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f8946ffd640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89480b78f0 0x7f8948159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f89477fe640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8948161d30 0x7f89481f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f89467fc640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480d11d0 0x7f89480cadd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8930035040 tx=0x7f89300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f893ffff640 1 -- 172.21.15.50:0/2206466887 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8930037040 con 0x7f89480d11d0 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f893ffff640 1 -- 172.21.15.50:0/2206466887 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8930030770 con 0x7f89480d11d0 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f894da17640 1 -- 172.21.15.50:0/2206466887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89481f8d00 con 0x7f89480d11d0 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.355+0000 7f893ffff640 1 -- 172.21.15.50:0/2206466887 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8930030b80 con 0x7f89480d11d0 2024-09-11T22:11:46.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.356+0000 7f894da17640 1 -- 172.21.15.50:0/2206466887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89480b42f0 con 0x7f89480d11d0 2024-09-11T22:11:46.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.357+0000 7f894da17640 1 -- 172.21.15.50:0/2206466887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89480b40e0 con 0x7f89480d11d0 2024-09-11T22:11:46.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.357+0000 7f893ffff640 1 -- 172.21.15.50:0/2206466887 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8930044020 con 0x7f89480d11d0 2024-09-11T22:11:46.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.358+0000 7f893ffff640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f892806be30 0x7f892806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:46.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.358+0000 7f893ffff640 1 -- 172.21.15.50:0/2206466887 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f89300ab420 con 0x7f89480d11d0 2024-09-11T22:11:46.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.358+0000 7f8946ffd640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f892806be30 0x7f892806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:46.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.358+0000 7f8946ffd640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f892806be30 0x7f892806e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8940006fd0 tx=0x7f8940008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:46.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.362+0000 7f893ffff640 1 -- 172.21.15.50:0/2206466887 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8930032e20 con 0x7f89480d11d0 2024-09-11T22:11:46.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:46.538+0000 7f894da17640 1 -- 172.21.15.50:0/2206466887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8948162da0 con 0x7f89480d11d0 2024-09-11T22:11:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.178+0000 7f893ffff640 1 -- 172.21.15.50:0/2206466887 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f8930079d70 con 0x7f89480d11d0 2024-09-11T22:11:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.182+0000 7f894da17640 1 -- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f892806be30 msgr2=0x7f892806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.182+0000 7f894da17640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f892806be30 0x7f892806e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8940006fd0 tx=0x7f8940008040 comp rx=0 tx=0).stop 2024-09-11T22:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.182+0000 7f894da17640 1 -- 172.21.15.50:0/2206466887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480d11d0 msgr2=0x7f89480cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.182+0000 7f894da17640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480d11d0 0x7f89480cadd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8930035040 tx=0x7f89300046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.182+0000 7f894da17640 1 -- 172.21.15.50:0/2206466887 shutdown_connections 2024-09-11T22:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.182+0000 7f894da17640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f892806be30 0x7f892806e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.182+0000 7f894da17640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8948161d30 0x7f89481f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.182+0000 7f894da17640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89480d11d0 0x7f89480cadd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.182+0000 7f894da17640 1 --2- 172.21.15.50:0/2206466887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89480b78f0 0x7f8948159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.182+0000 7f894da17640 1 -- 172.21.15.50:0/2206466887 >> 172.21.15.50:0/2206466887 conn(0x7f89480727a0 msgr2=0x7f89480cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.182+0000 7f894da17640 1 -- 172.21.15.50:0/2206466887 shutdown_connections 2024-09-11T22:11:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.182+0000 7f894da17640 1 -- 172.21.15.50:0/2206466887 wait complete. 2024-09-11T22:11:47.199 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:11:47.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.310+0000 7f787be5e640 1 Processor -- start 2024-09-11T22:11:47.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.310+0000 7f787be5e640 1 -- start start 2024-09-11T22:11:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.311+0000 7f787be5e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f78740d1c90 0x7f78740b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.311+0000 7f787be5e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7874163080 con 0x7f787415e8e0 2024-09-11T22:11:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.311+0000 7f787be5e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78740d2d20 con 0x7f7874162350 2024-09-11T22:11:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.311+0000 7f787be5e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f787415ecc0 con 0x7f78740d1c90 2024-09-11T22:11:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.311+0000 7f7879bfa640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f787415e8e0 0x7f78740d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49214/0 (socket says 172.21.15.50:49214) 2024-09-11T22:11:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.311+0000 7f7879bfa640 1 -- 172.21.15.50:0/1989758634 learned_addr learned my addr 172.21.15.50:0/1989758634 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f78793f9640 1 --2- 172.21.15.50:0/1989758634 >> v2:172.21.15.77:3300/0 conn(0x7f78740d1c90 0x7f78740b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262150323 0 0) 0x7f7874163080 con 0x7f787415e8e0 2024-09-11T22:11:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7860003520 con 0x7f787415e8e0 2024-09-11T22:11:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2405233343 0 0) 0x7f7860003520 con 0x7f787415e8e0 2024-09-11T22:11:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 >> v2:172.21.15.77:3300/0 conn(0x7f78740d1c90 msgr2=0x7f78740b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 --2- 172.21.15.50:0/1989758634 >> v2:172.21.15.77:3300/0 conn(0x7f78740d1c90 0x7f78740b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 >> v1:172.21.15.77:6789/0 conn(0x7f7874162350 legacy=0x7f78741627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78740d3000 con 0x7f787415e8e0 2024-09-11T22:11:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f7870001670 con 0x7f787415e8e0 2024-09-11T22:11:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 >> v1:172.21.15.50:6789/0 conn(0x7f787415e8e0 legacy=0x7f78740d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 --2- 172.21.15.50:0/1989758634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7860003a00 0x7f7860003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 --2- 172.21.15.50:0/1989758634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004800 0x7f7860004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 --2- 172.21.15.50:0/1989758634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78600051c0 0x7f786000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f786000c070 con 0x7f7860003a00 2024-09-11T22:11:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f786000c220 con 0x7f7860004800 2024-09-11T22:11:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f786000c420 con 0x7f78600051c0 2024-09-11T22:11:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7879bfa640 1 --2- 172.21.15.50:0/1989758634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7860003a00 0x7f7860003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f78793f9640 1 --2- 172.21.15.50:0/1989758634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004800 0x7f7860004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f787a3fb640 1 --2- 172.21.15.50:0/1989758634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78600051c0 0x7f786000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7879bfa640 1 -- 172.21.15.50:0/1989758634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78600051c0 msgr2=0x7f786000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7879bfa640 1 --2- 172.21.15.50:0/1989758634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78600051c0 0x7f786000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7879bfa640 1 -- 172.21.15.50:0/1989758634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004800 msgr2=0x7f7860004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7879bfa640 1 --2- 172.21.15.50:0/1989758634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004800 0x7f7860004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f7879bfa640 1 -- 172.21.15.50:0/1989758634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7860003520 con 0x7f7860003a00 2024-09-11T22:11:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f787a3fb640 1 --2- 172.21.15.50:0/1989758634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78600051c0 0x7f786000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.312+0000 7f787a3fb640 1 -- 172.21.15.50:0/1989758634 reap_dead start 2024-09-11T22:11:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.313+0000 7f7879bfa640 1 --2- 172.21.15.50:0/1989758634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7860003a00 0x7f7860003e20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f787000c110 tx=0x7f7860005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34eedd3788762e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.313+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870007c40 con 0x7f7860003a00 2024-09-11T22:11:47.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.313+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7870005af0 con 0x7f7860003a00 2024-09-11T22:11:47.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.313+0000 7f7878bf8640 1 -- 172.21.15.50:0/1989758634 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870007070 con 0x7f7860003a00 2024-09-11T22:11:47.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.314+0000 7f787be5e640 1 -- 172.21.15.50:0/1989758634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7860003a00 msgr2=0x7f7860003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:47.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.314+0000 7f787be5e640 1 --2- 172.21.15.50:0/1989758634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7860003a00 0x7f7860003e20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f787000c110 tx=0x7f7860005830 comp rx=0 tx=0).stop 2024-09-11T22:11:47.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.314+0000 7f787be5e640 1 -- 172.21.15.50:0/1989758634 shutdown_connections 2024-09-11T22:11:47.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.314+0000 7f787be5e640 1 --2- 172.21.15.50:0/1989758634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7860003a00 0x7f7860003e20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:47.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.314+0000 7f787be5e640 1 -- 172.21.15.50:0/1989758634 >> 172.21.15.50:0/1989758634 conn(0x7f7874067ba0 msgr2=0x7f7874067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:47.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.314+0000 7f787be5e640 1 -- 172.21.15.50:0/1989758634 shutdown_connections 2024-09-11T22:11:47.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.314+0000 7f787be5e640 1 -- 172.21.15.50:0/1989758634 wait complete. 2024-09-11T22:11:47.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.315+0000 7f787be5e640 1 Processor -- start 2024-09-11T22:11:47.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.315+0000 7f787be5e640 1 -- start start 2024-09-11T22:11:47.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f787be5e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7860003a00 0x7f78740ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:47.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f787be5e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78740ce9e0 0x7f78741f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:47.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f787be5e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78741f83d0 0x7f78741f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:47.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f787be5e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f78740b7c10 con 0x7f7860003a00 2024-09-11T22:11:47.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f787be5e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f78740b7a90 con 0x7f78741f83d0 2024-09-11T22:11:47.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f787be5e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f78740d2ad0 con 0x7f78740ce9e0 2024-09-11T22:11:47.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f7879bfa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7860003a00 0x7f78740ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:47.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f7879bfa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7860003a00 0x7f78740ab260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49564/0 (socket says 172.21.15.50:49564) 2024-09-11T22:11:47.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f7879bfa640 1 -- 172.21.15.50:0/3006132154 learned_addr learned my addr 172.21.15.50:0/3006132154 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:47.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f78793f9640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78740ce9e0 0x7f78741f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f787a3fb640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78741f83d0 0x7f78741f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f7879bfa640 1 -- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78740ce9e0 msgr2=0x7f78741f7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f7879bfa640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78740ce9e0 0x7f78741f7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f7879bfa640 1 -- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78741f83d0 msgr2=0x7f78741f46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f7879bfa640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78741f83d0 0x7f78741f46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f7879bfa640 1 -- 172.21.15.50:0/3006132154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78740ccab0 con 0x7f7860003a00 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.316+0000 7f787a3fb640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78741f83d0 0x7f78741f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.317+0000 7f7879bfa640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7860003a00 0x7f78740ab260 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f787000c230 tx=0x7f78740b77d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.317+0000 7f786a7fc640 1 -- 172.21.15.50:0/3006132154 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870037040 con 0x7f7860003a00 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.317+0000 7f786a7fc640 1 -- 172.21.15.50:0/3006132154 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7870041070 con 0x7f7860003a00 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.317+0000 7f787be5e640 1 -- 172.21.15.50:0/3006132154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78740ccd70 con 0x7f7860003a00 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.317+0000 7f786a7fc640 1 -- 172.21.15.50:0/3006132154 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78700047e0 con 0x7f7860003a00 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.317+0000 7f787be5e640 1 -- 172.21.15.50:0/3006132154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78740cd330 con 0x7f7860003a00 2024-09-11T22:11:47.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.318+0000 7f787be5e640 1 -- 172.21.15.50:0/3006132154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78740d1580 con 0x7f7860003a00 2024-09-11T22:11:47.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.318+0000 7f786a7fc640 1 -- 172.21.15.50:0/3006132154 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78700049a0 con 0x7f7860003a00 2024-09-11T22:11:47.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.319+0000 7f786a7fc640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f785806be30 0x7f785806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:47.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.319+0000 7f786a7fc640 1 -- 172.21.15.50:0/3006132154 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7f78700aaab0 con 0x7f7860003a00 2024-09-11T22:11:47.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.319+0000 7f78793f9640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f785806be30 0x7f785806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:47.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.320+0000 7f78793f9640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f785806be30 0x7f785806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f78740cedc0 tx=0x7f7864009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:47.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.323+0000 7f786a7fc640 1 -- 172.21.15.50:0/3006132154 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7870079540 con 0x7f7860003a00 2024-09-11T22:11:47.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:47.500+0000 7f787be5e640 1 -- 172.21.15.50:0/3006132154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f78740ba770 con 0x7f7860003a00 2024-09-11T22:11:48.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.183+0000 7f786a7fc640 1 -- 172.21.15.50:0/3006132154 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7f7870078e40 con 0x7f7860003a00 2024-09-11T22:11:48.185 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:11:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.186+0000 7f787be5e640 1 -- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f785806be30 msgr2=0x7f785806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.186+0000 7f787be5e640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f785806be30 0x7f785806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f78740cedc0 tx=0x7f7864009190 comp rx=0 tx=0).stop 2024-09-11T22:11:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.187+0000 7f787be5e640 1 -- 172.21.15.50:0/3006132154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7860003a00 msgr2=0x7f78740ab260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.187+0000 7f787be5e640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7860003a00 0x7f78740ab260 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f787000c230 tx=0x7f78740b77d0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.187+0000 7f787be5e640 1 -- 172.21.15.50:0/3006132154 shutdown_connections 2024-09-11T22:11:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.187+0000 7f787be5e640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f785806be30 0x7f785806e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.187+0000 7f787be5e640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78740ce9e0 0x7f78741f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.187+0000 7f787be5e640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78741f83d0 0x7f78741f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.187+0000 7f787be5e640 1 --2- 172.21.15.50:0/3006132154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7860003a00 0x7f78740ab260 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.187+0000 7f787be5e640 1 -- 172.21.15.50:0/3006132154 >> 172.21.15.50:0/3006132154 conn(0x7f7874067ba0 msgr2=0x7f78740d4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.187+0000 7f787be5e640 1 -- 172.21.15.50:0/3006132154 shutdown_connections 2024-09-11T22:11:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.187+0000 7f787be5e640 1 -- 172.21.15.50:0/3006132154 wait complete. 2024-09-11T22:11:48.203 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:11:48.203 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T22:11:48.204 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:11:48.204 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:11:48.204 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:11:48.204 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T22:11:48.204 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:11:48.204 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:11:48.205 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:11:48.205 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T22:11:48.205 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:11:48.205 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:11:48.205 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:11:48.205 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T22:11:48.205 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:11:48.205 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:11:48.215 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:11:48.215 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:11:48.216 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:11:48.216 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:11:48.217 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:11:48.217 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:11:48.218 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:11:48.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:11:48.258 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:11:48.258 DEBUG:teuthology.parallel:result is None 2024-09-11T22:11:48.259 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:11:48.259 DEBUG:teuthology.parallel:result is None 2024-09-11T22:11:48.261 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:11:48.261 DEBUG:teuthology.parallel:result is None 2024-09-11T22:11:48.261 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:11:48.262 DEBUG:teuthology.parallel:result is None 2024-09-11T22:11:48.262 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T22:11:48.341 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:11:48.341 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:11:48.343 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:11:48.343 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:11:48.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.375+0000 7f8fb5c8c640 1 Processor -- start 2024-09-11T22:11:48.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.375+0000 7f8fb5c8c640 1 -- start start 2024-09-11T22:11:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8fb5c8c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb00d0f10 0x7f8fb0072c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8fb5c8c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8fb006eac0 0x7f8fb00679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8fb5c8c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb00d12f0 con 0x7f8fb0067f00 2024-09-11T22:11:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8fb5c8c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8fb0073180 con 0x7f8fb006eac0 2024-09-11T22:11:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8fb5c8c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb0166940 con 0x7f8fb00d0f10 2024-09-11T22:11:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8faeffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8fb006eac0 0x7f8fb00679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8faf7fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb00d0f10 0x7f8fb0072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8faeffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8fb006eac0 0x7f8fb00679c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:59902/0 (socket says 172.21.15.50:59902) 2024-09-11T22:11:48.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8faeffd640 1 -- 172.21.15.50:0/2195326239 learned_addr learned my addr 172.21.15.50:0/2195326239 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:48.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8faffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8fb0067f00 0x7f8fb00b4a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:50252/0 (socket says 172.21.15.50:50252) 2024-09-11T22:11:48.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8faeffd640 1 -- 172.21.15.50:0/2195326239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb00d0f10 msgr2=0x7f8fb0072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:48.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8faeffd640 1 --2- 172.21.15.50:0/2195326239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb00d0f10 0x7f8fb0072c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8faeffd640 1 -- 172.21.15.50:0/2195326239 >> v1:172.21.15.77:6789/0 conn(0x7f8fb0067f00 legacy=0x7f8fb00b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8faeffd640 1 -- 172.21.15.50:0/2195326239 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb0068320 con 0x7f8fb006eac0 2024-09-11T22:11:48.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8fae7fc640 1 -- 172.21.15.50:0/2195326239 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3992817208 0 0) 0x7f8fb00d12f0 con 0x7f8fb0067f00 2024-09-11T22:11:48.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8faeffd640 1 --2- 172.21.15.50:0/2195326239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb006eac0 0x7f8fb00679c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009870 tx=0x7f8fa402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e408c3cce6bdfaa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:48.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8fae7fc640 1 -- 172.21.15.50:0/2195326239 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4037070 con 0x7f8fb006eac0 2024-09-11T22:11:48.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8fae7fc640 1 -- 172.21.15.50:0/2195326239 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa4032440 con 0x7f8fb006eac0 2024-09-11T22:11:48.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.377+0000 7f8fae7fc640 1 -- 172.21.15.50:0/2195326239 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4032810 con 0x7f8fb006eac0 2024-09-11T22:11:48.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.378+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/2195326239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb006eac0 msgr2=0x7f8fb00679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.378+0000 7f8fb5c8c640 1 --2- 172.21.15.50:0/2195326239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb006eac0 0x7f8fb00679c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009870 tx=0x7f8fa402a270 comp rx=0 tx=0).stop 2024-09-11T22:11:48.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.378+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/2195326239 shutdown_connections 2024-09-11T22:11:48.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.378+0000 7f8fb5c8c640 1 --2- 172.21.15.50:0/2195326239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb006eac0 0x7f8fb00679c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.378+0000 7f8fb5c8c640 1 --2- 172.21.15.50:0/2195326239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb00d0f10 0x7f8fb0072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.378+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/2195326239 >> 172.21.15.50:0/2195326239 conn(0x7f8fb006bd30 msgr2=0x7f8fb006c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:48.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.378+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/2195326239 shutdown_connections 2024-09-11T22:11:48.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.378+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/2195326239 wait complete. 2024-09-11T22:11:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.379+0000 7f8fb5c8c640 1 Processor -- start 2024-09-11T22:11:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.379+0000 7f8fb5c8c640 1 -- start start 2024-09-11T22:11:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8fb5c8c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fb0067f00 0x7f8fb0159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8fb5c8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb006eac0 0x7f8fb01485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8fb5c8c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb00d0f10 0x7f8fb015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8fb5c8c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb01671e0 con 0x7f8fb0067f00 2024-09-11T22:11:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8fb5c8c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb0166f00 con 0x7f8fb006eac0 2024-09-11T22:11:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8fb5c8c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb01665a0 con 0x7f8fb00d0f10 2024-09-11T22:11:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8faeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb006eac0 0x7f8fb01485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8faf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fb0067f00 0x7f8fb0159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8faeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb006eac0 0x7f8fb01485e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:59916/0 (socket says 172.21.15.50:59916) 2024-09-11T22:11:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8faeffd640 1 -- 172.21.15.50:0/802888568 learned_addr learned my addr 172.21.15.50:0/802888568 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:48.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8faffff640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb00d0f10 0x7f8fb015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8faeffd640 1 -- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb00d0f10 msgr2=0x7f8fb015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8faeffd640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb00d0f10 0x7f8fb015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8faeffd640 1 -- 172.21.15.50:0/802888568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fb0067f00 msgr2=0x7f8fb0159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8faeffd640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fb0067f00 0x7f8fb0159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8faeffd640 1 -- 172.21.15.50:0/802888568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb0155e10 con 0x7f8fb006eac0 2024-09-11T22:11:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8faf7fe640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fb0067f00 0x7f8fb0159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8faeffd640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb006eac0 0x7f8fb01485e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4000c00 tx=0x7f8fa40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8f97fff640 1 -- 172.21.15.50:0/802888568 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4037040 con 0x7f8fb006eac0 2024-09-11T22:11:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8f97fff640 1 -- 172.21.15.50:0/802888568 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa4042070 con 0x7f8fb006eac0 2024-09-11T22:11:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/802888568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb015c440 con 0x7f8fb006eac0 2024-09-11T22:11:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8f97fff640 1 -- 172.21.15.50:0/802888568 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4030880 con 0x7f8fb006eac0 2024-09-11T22:11:48.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.381+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/802888568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb015ca00 con 0x7f8fb006eac0 2024-09-11T22:11:48.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.382+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/802888568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb00d0750 con 0x7f8fb006eac0 2024-09-11T22:11:48.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.382+0000 7f8f97fff640 1 -- 172.21.15.50:0/802888568 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8fa4030a20 con 0x7f8fb006eac0 2024-09-11T22:11:48.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.384+0000 7f8f97fff640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f9c06be30 0x7f8f9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:48.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.384+0000 7f8f97fff640 1 -- 172.21.15.50:0/802888568 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f8fa40ab2e0 con 0x7f8fb006eac0 2024-09-11T22:11:48.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.384+0000 7f8faf7fe640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f9c06be30 0x7f8f9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:48.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.384+0000 7f8faf7fe640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f9c06be30 0x7f8f9c06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009f30 tx=0x7f8fa0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:48.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.388+0000 7f8f97fff640 1 -- 172.21.15.50:0/802888568 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8fb0155e10 con 0x7f8fb006eac0 2024-09-11T22:11:48.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:48.576+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/802888568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8fb00724d0 con 0x7f8fb006eac0 2024-09-11T22:11:49.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.198+0000 7f8f97fff640 1 -- 172.21.15.50:0/802888568 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f8fa40798a0 con 0x7f8fb006eac0 2024-09-11T22:11:49.200 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-11T22:11:49.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.201+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f9c06be30 msgr2=0x7f8f9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.201+0000 7f8fb5c8c640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f9c06be30 0x7f8f9c06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009f30 tx=0x7f8fa0009190 comp rx=0 tx=0).stop 2024-09-11T22:11:49.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.201+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb006eac0 msgr2=0x7f8fb01485e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.201+0000 7f8fb5c8c640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb006eac0 0x7f8fb01485e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4000c00 tx=0x7f8fa40046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.201+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/802888568 shutdown_connections 2024-09-11T22:11:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.201+0000 7f8fb5c8c640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f9c06be30 0x7f8f9c06e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.201+0000 7f8fb5c8c640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb00d0f10 0x7f8fb015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.201+0000 7f8fb5c8c640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb006eac0 0x7f8fb01485e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.201+0000 7f8fb5c8c640 1 --2- 172.21.15.50:0/802888568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fb0067f00 0x7f8fb0159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.201+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/802888568 >> 172.21.15.50:0/802888568 conn(0x7f8fb006bd30 msgr2=0x7f8fb00b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.201+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/802888568 shutdown_connections 2024-09-11T22:11:49.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.201+0000 7f8fb5c8c640 1 -- 172.21.15.50:0/802888568 wait complete. 2024-09-11T22:11:49.219 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T22:11:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.326+0000 7fadfd59a640 1 Processor -- start 2024-09-11T22:11:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.326+0000 7fadfd59a640 1 -- start start 2024-09-11T22:11:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.327+0000 7fadfd59a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadf815c770 0x7fadf80b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.327+0000 7fadfd59a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fadf80b5920 0x7fadf80b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.327+0000 7fadfd59a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf815f060 con 0x7fadf80b6510 2024-09-11T22:11:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.327+0000 7fadfd59a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fadf815cef0 con 0x7fadf80b5920 2024-09-11T22:11:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.327+0000 7fadfd59a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fadf815d1d0 con 0x7fadf815c770 2024-09-11T22:11:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.327+0000 7fadf77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fadf80b6510 0x7fadf80d24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36750/0 (socket says 172.21.15.50:36750) 2024-09-11T22:11:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.327+0000 7fadf77fe640 1 -- 172.21.15.50:0/2710101851 learned_addr learned my addr 172.21.15.50:0/2710101851 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf6ffd640 1 --2- 172.21.15.50:0/2710101851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadf815c770 0x7fadf80b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf67fc640 1 --2- 172.21.15.50:0/2710101851 >> v2:172.21.15.77:3300/0 conn(0x7fadf80b5920 0x7fadf80b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532410799 0 0) 0x7fadf815f060 con 0x7fadf80b6510 2024-09-11T22:11:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fade4003520 con 0x7fadf80b6510 2024-09-11T22:11:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 977965899 0 0) 0x7fade4003520 con 0x7fadf80b6510 2024-09-11T22:11:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadf815c770 msgr2=0x7fadf80b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 --2- 172.21.15.50:0/2710101851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadf815c770 0x7fadf80b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 >> v2:172.21.15.77:3300/0 conn(0x7fadf80b5920 msgr2=0x7fadf80b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 --2- 172.21.15.50:0/2710101851 >> v2:172.21.15.77:3300/0 conn(0x7fadf80b5920 0x7fadf80b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf815d4b0 con 0x7fadf80b6510 2024-09-11T22:11:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fade8001670 con 0x7fadf80b6510 2024-09-11T22:11:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf67fc640 1 --2- 172.21.15.50:0/2710101851 >> v2:172.21.15.77:3300/0 conn(0x7fadf80b5920 0x7fadf80b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 >> v1:172.21.15.50:6789/0 conn(0x7fadf80b6510 legacy=0x7fadf80d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 --2- 172.21.15.50:0/2710101851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fade40039b0 0x7fade4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 --2- 172.21.15.50:0/2710101851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadf815c770 0x7fade4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 --2- 172.21.15.50:0/2710101851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fade4004d40 0x7fade40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fadf815cef0 con 0x7fade40039b0 2024-09-11T22:11:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fadf815d1d0 con 0x7fade4004d40 2024-09-11T22:11:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fade400b9c0 con 0x7fadf815c770 2024-09-11T22:11:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf6ffd640 1 --2- 172.21.15.50:0/2710101851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fade40039b0 0x7fade4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf67fc640 1 --2- 172.21.15.50:0/2710101851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadf815c770 0x7fade4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.328+0000 7fadf77fe640 1 --2- 172.21.15.50:0/2710101851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fade4004d40 0x7fade40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.329+0000 7fadf6ffd640 1 -- 172.21.15.50:0/2710101851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadf815c770 msgr2=0x7fade4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.329+0000 7fadf6ffd640 1 --2- 172.21.15.50:0/2710101851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadf815c770 0x7fade4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.329+0000 7fadf6ffd640 1 -- 172.21.15.50:0/2710101851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fade4004d40 msgr2=0x7fade40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.329+0000 7fadf6ffd640 1 --2- 172.21.15.50:0/2710101851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fade4004d40 0x7fade40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.329+0000 7fadf6ffd640 1 -- 172.21.15.50:0/2710101851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade4003520 con 0x7fade40039b0 2024-09-11T22:11:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.329+0000 7fadf6ffd640 1 --2- 172.21.15.50:0/2710101851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fade40039b0 0x7fade4003dd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009fc0 tx=0x7fade4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9d499d8e264059 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.329+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0009c10 con 0x7fade40039b0 2024-09-11T22:11:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.329+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf0036070 con 0x7fade40039b0 2024-09-11T22:11:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.329+0000 7fadf5ffb640 1 -- 172.21.15.50:0/2710101851 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0031880 con 0x7fade40039b0 2024-09-11T22:11:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.330+0000 7fadfd59a640 1 -- 172.21.15.50:0/2710101851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fade40039b0 msgr2=0x7fade4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.330+0000 7fadfd59a640 1 --2- 172.21.15.50:0/2710101851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fade40039b0 0x7fade4003dd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009fc0 tx=0x7fade4005830 comp rx=0 tx=0).stop 2024-09-11T22:11:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.330+0000 7fadf77fe640 1 -- 172.21.15.50:0/2710101851 reap_dead start 2024-09-11T22:11:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.330+0000 7fadfd59a640 1 -- 172.21.15.50:0/2710101851 shutdown_connections 2024-09-11T22:11:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.330+0000 7fadfd59a640 1 -- 172.21.15.50:0/2710101851 >> 172.21.15.50:0/2710101851 conn(0x7fadf80b7940 msgr2=0x7fadf80b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.330+0000 7fadfd59a640 1 -- 172.21.15.50:0/2710101851 shutdown_connections 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.330+0000 7fadfd59a640 1 -- 172.21.15.50:0/2710101851 wait complete. 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.331+0000 7fadfd59a640 1 Processor -- start 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.331+0000 7fadfd59a640 1 -- start start 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.332+0000 7fadfd59a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fade40039b0 0x7fadf809c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.332+0000 7fadfd59a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadf8155e10 0x7fadf8149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.332+0000 7fadfd59a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadf81566d0 0x7fadf80b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.332+0000 7fadfd59a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fadf815cb50 con 0x7fade40039b0 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.332+0000 7fadfd59a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fadf815dcb0 con 0x7fadf81566d0 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.332+0000 7fadfd59a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fadf815ccd0 con 0x7fadf8155e10 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.332+0000 7fadf6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fade40039b0 0x7fadf809c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.332+0000 7fadf6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fade40039b0 0x7fadf809c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52742/0 (socket says 172.21.15.50:52742) 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.332+0000 7fadf6ffd640 1 -- 172.21.15.50:0/36450695 learned_addr learned my addr 172.21.15.50:0/36450695 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.332+0000 7fadf67fc640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadf8155e10 0x7fadf8149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.332+0000 7fadf77fe640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadf81566d0 0x7fadf80b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.333+0000 7fadf6ffd640 1 -- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadf8155e10 msgr2=0x7fadf8149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.333+0000 7fadf6ffd640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadf8155e10 0x7fadf8149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.333+0000 7fadf6ffd640 1 -- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadf81566d0 msgr2=0x7fadf80b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.333+0000 7fadf6ffd640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadf81566d0 0x7fadf80b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.333+0000 7fadf6ffd640 1 -- 172.21.15.50:0/36450695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf8154d70 con 0x7fade40039b0 2024-09-11T22:11:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.333+0000 7fadf6ffd640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fade40039b0 0x7fadf809c4d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fadf0033040 tx=0x7fadf0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.333+0000 7fadef7fe640 1 -- 172.21.15.50:0/36450695 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0031e50 con 0x7fade40039b0 2024-09-11T22:11:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.333+0000 7fadef7fe640 1 -- 172.21.15.50:0/36450695 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf0003990 con 0x7fade40039b0 2024-09-11T22:11:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.333+0000 7fadfd59a640 1 -- 172.21.15.50:0/36450695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf8155050 con 0x7fade40039b0 2024-09-11T22:11:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.333+0000 7fadef7fe640 1 -- 172.21.15.50:0/36450695 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0003d80 con 0x7fade40039b0 2024-09-11T22:11:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.333+0000 7fadfd59a640 1 -- 172.21.15.50:0/36450695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf8155610 con 0x7fade40039b0 2024-09-11T22:11:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.334+0000 7fadfd59a640 1 -- 172.21.15.50:0/36450695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf8155a10 con 0x7fade40039b0 2024-09-11T22:11:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.335+0000 7fadef7fe640 1 -- 172.21.15.50:0/36450695 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadf0005d10 con 0x7fade40039b0 2024-09-11T22:11:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.335+0000 7fadef7fe640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fadd806bfd0 0x7fadd806e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.335+0000 7fadef7fe640 1 -- 172.21.15.50:0/36450695 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fadf00abcc0 con 0x7fade40039b0 2024-09-11T22:11:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.335+0000 7fadf67fc640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fadd806bfd0 0x7fadd806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.336+0000 7fadf67fc640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fadd806bfd0 0x7fadd806e490 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fadf80b4b90 tx=0x7fade0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.339+0000 7fadef7fe640 1 -- 172.21.15.50:0/36450695 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fadf007a400 con 0x7fade40039b0 2024-09-11T22:11:49.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.581+0000 7fadfd59a640 1 -- 172.21.15.50:0/36450695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fadf815bc20 con 0x7fade40039b0 2024-09-11T22:11:49.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.581+0000 7fadef7fe640 1 -- 172.21.15.50:0/36450695 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7fadf007e700 con 0x7fade40039b0 2024-09-11T22:11:49.582 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:49.582 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:11:49.582 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-11T22:11:49.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w==", 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg==", 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:11:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:11:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:11:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-11T22:11:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ==", 2024-09-11T22:11:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:11:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:11:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:11:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw==", 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-11T22:11:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg==", 2024-09-11T22:11:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:11:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:11:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-11T22:11:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ==", 2024-09-11T22:11:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:11:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg==", 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg==", 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A==", 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:11:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-11T22:11:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw==", 2024-09-11T22:11:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:11:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:11:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-11T22:11:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A==", 2024-09-11T22:11:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:11:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:11:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-11T22:11:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw==", 2024-09-11T22:11:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:11:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew==", 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw==", 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg==", 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:11:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:11:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:11:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:11:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-11T22:11:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw==", 2024-09-11T22:11:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:11:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:11:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:11:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBFFeJmAq9+OBAAANc9KfDvm3+wt/uED7WCvA==", 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mds", 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBrFeJmeU95ChAAiH+LSzwYegq0nXquuVdVhQ==", 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mds" 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mgr", 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBrFeJmAll5ChAAavOTXyKXhFqQ8xoYFO7ykA==", 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-osd", 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBrFeJmrWF5ChAAgwSnoWNdcfP9IEzd3pv+0w==", 2024-09-11T22:11:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-osd" 2024-09-11T22:11:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd", 2024-09-11T22:11:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBrFeJmI2l5ChAAYA3GuVy+nFJeq6D3uH1QNA==", 2024-09-11T22:11:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-11T22:11:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-11T22:11:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBrFeJmbHJ5ChAA9L8lqvwYuPm3ApKULl2DBw==", 2024-09-11T22:11:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-11T22:11:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rgw", 2024-09-11T22:11:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBrFeJmuod5ChAAaMz62eGJeUTNLMt5Ti+z2g==", 2024-09-11T22:11:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-11T22:11:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-11T22:11:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g==", 2024-09-11T22:11:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:11:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:11:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:11:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-11T22:11:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg==", 2024-09-11T22:11:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:11:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:11:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:11:49.599 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:11:49.599 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.599 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:49.599 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-11T22:11:49.599 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:11:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.583+0000 7fadfd59a640 1 -- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fadd806bfd0 msgr2=0x7fadd806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.583+0000 7fadfd59a640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fadd806bfd0 0x7fadd806e490 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fadf80b4b90 tx=0x7fade0009190 comp rx=0 tx=0).stop 2024-09-11T22:11:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.583+0000 7fadfd59a640 1 -- 172.21.15.50:0/36450695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fade40039b0 msgr2=0x7fadf809c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.583+0000 7fadfd59a640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fade40039b0 0x7fadf809c4d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fadf0033040 tx=0x7fadf0009750 comp rx=0 tx=0).stop 2024-09-11T22:11:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.583+0000 7fadfd59a640 1 -- 172.21.15.50:0/36450695 shutdown_connections 2024-09-11T22:11:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.583+0000 7fadfd59a640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fadd806bfd0 0x7fadd806e490 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.583+0000 7fadfd59a640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadf8155e10 0x7fadf8149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.583+0000 7fadfd59a640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadf81566d0 0x7fadf80b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.583+0000 7fadfd59a640 1 --2- 172.21.15.50:0/36450695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fade40039b0 0x7fadf809c4d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.583+0000 7fadfd59a640 1 -- 172.21.15.50:0/36450695 >> 172.21.15.50:0/36450695 conn(0x7fadf80b7940 msgr2=0x7fadf815a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.584+0000 7fadfd59a640 1 -- 172.21.15.50:0/36450695 shutdown_connections 2024-09-11T22:11:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.584+0000 7fadfd59a640 1 -- 172.21.15.50:0/36450695 wait complete. 2024-09-11T22:11:49.601 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-11T22:11:49.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.704+0000 7f92386e6640 1 Processor -- start 2024-09-11T22:11:49.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.704+0000 7f92386e6640 1 -- start start 2024-09-11T22:11:49.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.705+0000 7f92386e6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f923015e840 0x7f92300b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.705+0000 7f92386e6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92300cdd50 0x7f92300cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.705+0000 7f92386e6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92300ce5f0 con 0x7f92300cf3b0 2024-09-11T22:11:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.705+0000 7f92386e6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f923006c240 con 0x7f923015e840 2024-09-11T22:11:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.705+0000 7f92386e6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f92300d0470 con 0x7f92300cdd50 2024-09-11T22:11:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.705+0000 7f9236482640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f923015e840 0x7f92300b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.705+0000 7f9236482640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f923015e840 0x7f92300b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52744/0 (socket says 172.21.15.50:52744) 2024-09-11T22:11:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.705+0000 7f9236482640 1 -- 172.21.15.50:0/2361475728 learned_addr learned my addr 172.21.15.50:0/2361475728 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.706+0000 7f9236482640 1 -- 172.21.15.50:0/2361475728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92300cdd50 msgr2=0x7f92300cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.705+0000 7f9235c81640 1 --2- 172.21.15.50:0/2361475728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92300cdd50 0x7f92300cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.706+0000 7f9236482640 1 --2- 172.21.15.50:0/2361475728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92300cdd50 0x7f92300cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.706+0000 7f9236482640 1 -- 172.21.15.50:0/2361475728 >> v1:172.21.15.77:6789/0 conn(0x7f92300cf3b0 legacy=0x7f92300d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.706+0000 7f9236482640 1 -- 172.21.15.50:0/2361475728 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92300ce310 con 0x7f923015e840 2024-09-11T22:11:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.706+0000 7f9235c81640 1 --2- 172.21.15.50:0/2361475728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92300cdd50 0x7f92300cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.706+0000 7f9236482640 1 --2- 172.21.15.50:0/2361475728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923015e840 0x7f92300b4c70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f922c0098a0 tx=0x7f922c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4438dbe950f918ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.706+0000 7f9235480640 1 -- 172.21.15.50:0/2361475728 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c037070 con 0x7f923015e840 2024-09-11T22:11:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.706+0000 7f9235480640 1 -- 172.21.15.50:0/2361475728 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c032440 con 0x7f923015e840 2024-09-11T22:11:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.706+0000 7f9235480640 1 -- 172.21.15.50:0/2361475728 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c032810 con 0x7f923015e840 2024-09-11T22:11:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.707+0000 7f92386e6640 1 -- 172.21.15.50:0/2361475728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923015e840 msgr2=0x7f92300b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.707+0000 7f92386e6640 1 --2- 172.21.15.50:0/2361475728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923015e840 0x7f92300b4c70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f922c0098a0 tx=0x7f922c02a250 comp rx=0 tx=0).stop 2024-09-11T22:11:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.707+0000 7f92386e6640 1 -- 172.21.15.50:0/2361475728 shutdown_connections 2024-09-11T22:11:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.707+0000 7f92386e6640 1 --2- 172.21.15.50:0/2361475728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92300cdd50 0x7f92300cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.707+0000 7f92386e6640 1 --2- 172.21.15.50:0/2361475728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923015e840 0x7f92300b4c70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.707+0000 7f92386e6640 1 -- 172.21.15.50:0/2361475728 >> 172.21.15.50:0/2361475728 conn(0x7f92300b4150 msgr2=0x7f92300b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.707+0000 7f92386e6640 1 -- 172.21.15.50:0/2361475728 shutdown_connections 2024-09-11T22:11:49.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.707+0000 7f92386e6640 1 -- 172.21.15.50:0/2361475728 wait complete. 2024-09-11T22:11:49.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.708+0000 7f92386e6640 1 Processor -- start 2024-09-11T22:11:49.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.708+0000 7f92386e6640 1 -- start start 2024-09-11T22:11:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f92386e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92300cdd50 0x7f92300c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f92386e6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92300cf3b0 0x7f923015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f92386e6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f923015e840 0x7f923015d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f92386e6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f923015ec20 con 0x7f92300cdd50 2024-09-11T22:11:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f92386e6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f923006bed0 con 0x7f923015e840 2024-09-11T22:11:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f92386e6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f923015eda0 con 0x7f92300cf3b0 2024-09-11T22:11:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f9236482640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92300cdd50 0x7f92300c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f9236482640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92300cdd50 0x7f92300c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52752/0 (socket says 172.21.15.50:52752) 2024-09-11T22:11:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f9236482640 1 -- 172.21.15.50:0/142648623 learned_addr learned my addr 172.21.15.50:0/142648623 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f9235c81640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92300cf3b0 0x7f923015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f9236c83640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f923015e840 0x7f923015d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f9236482640 1 -- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92300cf3b0 msgr2=0x7f923015cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f9236482640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92300cf3b0 0x7f923015cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f9236482640 1 -- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f923015e840 msgr2=0x7f923015d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f9236482640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f923015e840 0x7f923015d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.709+0000 7f9236482640 1 -- 172.21.15.50:0/142648623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92300c6c40 con 0x7f92300cdd50 2024-09-11T22:11:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.710+0000 7f9236482640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92300cdd50 0x7f92300c5f80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f922c0098a0 tx=0x7f922c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.710+0000 7f9226ffd640 1 -- 172.21.15.50:0/142648623 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c037040 con 0x7f92300cdd50 2024-09-11T22:11:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.710+0000 7f9226ffd640 1 -- 172.21.15.50:0/142648623 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c004230 con 0x7f92300cdd50 2024-09-11T22:11:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.710+0000 7f92386e6640 1 -- 172.21.15.50:0/142648623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92300ca440 con 0x7f92300cdd50 2024-09-11T22:11:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.710+0000 7f9226ffd640 1 -- 172.21.15.50:0/142648623 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c030620 con 0x7f92300cdd50 2024-09-11T22:11:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.710+0000 7f92386e6640 1 -- 172.21.15.50:0/142648623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92300caa00 con 0x7f92300cdd50 2024-09-11T22:11:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.711+0000 7f92386e6640 1 -- 172.21.15.50:0/142648623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92300b4fe0 con 0x7f92300cdd50 2024-09-11T22:11:49.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.711+0000 7f9226ffd640 1 -- 172.21.15.50:0/142648623 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f922c0307c0 con 0x7f92300cdd50 2024-09-11T22:11:49.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.712+0000 7f9226ffd640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f921406be30 0x7f921406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:49.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.712+0000 7f9226ffd640 1 -- 172.21.15.50:0/142648623 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f922c0ab930 con 0x7f92300cdd50 2024-09-11T22:11:49.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.712+0000 7f9235c81640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f921406be30 0x7f921406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:49.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.712+0000 7f9235c81640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f921406be30 0x7f921406e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f92300b3680 tx=0x7f9220008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:49.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.716+0000 7f9226ffd640 1 -- 172.21.15.50:0/142648623 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92300b4fe0 con 0x7f92300cdd50 2024-09-11T22:11:49.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.961+0000 7f92386e6640 1 -- 172.21.15.50:0/142648623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f92300cee70 con 0x7f92300cdd50 2024-09-11T22:11:49.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.963+0000 7f9226ffd640 1 -- 172.21.15.50:0/142648623 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f92300c6c40 con 0x7f92300cdd50 2024-09-11T22:11:49.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.965+0000 7f92386e6640 1 -- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f921406be30 msgr2=0x7f921406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.965+0000 7f92386e6640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f921406be30 0x7f921406e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f92300b3680 tx=0x7f9220008040 comp rx=0 tx=0).stop 2024-09-11T22:11:49.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.965+0000 7f92386e6640 1 -- 172.21.15.50:0/142648623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92300cdd50 msgr2=0x7f92300c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:49.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.965+0000 7f92386e6640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92300cdd50 0x7f92300c5f80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f922c0098a0 tx=0x7f922c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.965+0000 7f92386e6640 1 -- 172.21.15.50:0/142648623 shutdown_connections 2024-09-11T22:11:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.965+0000 7f92386e6640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f921406be30 0x7f921406e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.965+0000 7f92386e6640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92300cf3b0 0x7f923015cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.965+0000 7f92386e6640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f923015e840 0x7f923015d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.965+0000 7f92386e6640 1 --2- 172.21.15.50:0/142648623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92300cdd50 0x7f92300c5f80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.965+0000 7f92386e6640 1 -- 172.21.15.50:0/142648623 >> 172.21.15.50:0/142648623 conn(0x7f92300b4150 msgr2=0x7f92300cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.965+0000 7f92386e6640 1 -- 172.21.15.50:0/142648623 shutdown_connections 2024-09-11T22:11:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:49.965+0000 7f92386e6640 1 -- 172.21.15.50:0/142648623 wait complete. 2024-09-11T22:11:49.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-11T22:11:50.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.079+0000 7f0dcb6c9640 1 Processor -- start 2024-09-11T22:11:50.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.079+0000 7f0dcb6c9640 1 -- start start 2024-09-11T22:11:50.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.080+0000 7f0dcb6c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0dc4161d30 0x7f0dc40cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.080+0000 7f0dcb6c9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0dc40d11d0 0x7f0dc40d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.080+0000 7f0dcb6c9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dc4162110 con 0x7f0dc40b78f0 2024-09-11T22:11:50.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.080+0000 7f0dcb6c9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc40d3450 con 0x7f0dc40d11d0 2024-09-11T22:11:50.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.080+0000 7f0dcb6c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc40d1b40 con 0x7f0dc4161d30 2024-09-11T22:11:50.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.080+0000 7f0dc9c66640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0dc40d11d0 0x7f0dc40d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.080+0000 7f0dc9c66640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0dc40d11d0 0x7f0dc40d1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52758/0 (socket says 172.21.15.50:52758) 2024-09-11T22:11:50.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.080+0000 7f0dc9c66640 1 -- 172.21.15.50:0/2945012880 learned_addr learned my addr 172.21.15.50:0/2945012880 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:50.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.080+0000 7f0dc8c64640 1 --1- 172.21.15.50:0/2945012880 >> v1:172.21.15.50:6789/0 conn(0x7f0dc40b78f0 0x7f0dc4162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36760/0 (socket says 172.21.15.50:36760) 2024-09-11T22:11:50.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.080+0000 7f0dc9465640 1 --2- 172.21.15.50:0/2945012880 >> v2:172.21.15.77:3300/0 conn(0x7f0dc4161d30 0x7f0dc40cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.081+0000 7f0dc9c66640 1 -- 172.21.15.50:0/2945012880 >> v2:172.21.15.77:3300/0 conn(0x7f0dc4161d30 msgr2=0x7f0dc40cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:50.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.081+0000 7f0dc9c66640 1 --2- 172.21.15.50:0/2945012880 >> v2:172.21.15.77:3300/0 conn(0x7f0dc4161d30 0x7f0dc40cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.081+0000 7f0dc9c66640 1 -- 172.21.15.50:0/2945012880 >> v1:172.21.15.50:6789/0 conn(0x7f0dc40b78f0 legacy=0x7f0dc4162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.081+0000 7f0dc9c66640 1 -- 172.21.15.50:0/2945012880 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc40cfd70 con 0x7f0dc40d11d0 2024-09-11T22:11:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.081+0000 7f0dc9c66640 1 --2- 172.21.15.50:0/2945012880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc40d11d0 0x7f0dc40d1600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4073050 tx=0x7f0db402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02d3d2513605d99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.081+0000 7f0dc3fff640 1 -- 172.21.15.50:0/2945012880 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4036070 con 0x7f0dc40d11d0 2024-09-11T22:11:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.081+0000 7f0dc3fff640 1 -- 172.21.15.50:0/2945012880 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db4031600 con 0x7f0dc40d11d0 2024-09-11T22:11:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.082+0000 7f0dc3fff640 1 -- 172.21.15.50:0/2945012880 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db40319d0 con 0x7f0dc40d11d0 2024-09-11T22:11:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.082+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/2945012880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc40d11d0 msgr2=0x7f0dc40d1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.082+0000 7f0dcb6c9640 1 --2- 172.21.15.50:0/2945012880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc40d11d0 0x7f0dc40d1600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4073050 tx=0x7f0db402a730 comp rx=0 tx=0).stop 2024-09-11T22:11:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.082+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/2945012880 shutdown_connections 2024-09-11T22:11:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.082+0000 7f0dcb6c9640 1 --2- 172.21.15.50:0/2945012880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc40d11d0 0x7f0dc40d1600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.082+0000 7f0dcb6c9640 1 --2- 172.21.15.50:0/2945012880 >> v2:172.21.15.77:3300/0 conn(0x7f0dc4161d30 0x7f0dc40cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.082+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/2945012880 >> 172.21.15.50:0/2945012880 conn(0x7f0dc40727a0 msgr2=0x7f0dc40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.082+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/2945012880 shutdown_connections 2024-09-11T22:11:50.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.082+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/2945012880 wait complete. 2024-09-11T22:11:50.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.083+0000 7f0dcb6c9640 1 Processor -- start 2024-09-11T22:11:50.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.083+0000 7f0dcb6c9640 1 -- start start 2024-09-11T22:11:50.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dcb6c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc40b78f0 0x7f0dc4150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dcb6c9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0dc40d11d0 0x7f0dc41f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dcb6c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dc4161d30 0x7f0dc415d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dcb6c9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc40d30e0 con 0x7f0dc40b78f0 2024-09-11T22:11:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dcb6c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc40d2e00 con 0x7f0dc4161d30 2024-09-11T22:11:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dcb6c9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc40b7d60 con 0x7f0dc40d11d0 2024-09-11T22:11:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dc9465640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc40b78f0 0x7f0dc4150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dc9465640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc40b78f0 0x7f0dc4150b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52772/0 (socket says 172.21.15.50:52772) 2024-09-11T22:11:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dc9465640 1 -- 172.21.15.50:0/3756516240 learned_addr learned my addr 172.21.15.50:0/3756516240 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dc9465640 1 -- 172.21.15.50:0/3756516240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0dc40d11d0 msgr2=0x7f0dc41f4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dc9465640 1 --2- 172.21.15.50:0/3756516240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0dc40d11d0 0x7f0dc41f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dc9465640 1 -- 172.21.15.50:0/3756516240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dc4161d30 msgr2=0x7f0dc415d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dc9465640 1 --2- 172.21.15.50:0/3756516240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dc4161d30 0x7f0dc415d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.084+0000 7f0dc9465640 1 -- 172.21.15.50:0/3756516240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc40cb280 con 0x7f0dc40b78f0 2024-09-11T22:11:50.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.085+0000 7f0dc9465640 1 --2- 172.21.15.50:0/3756516240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc40b78f0 0x7f0dc4150b90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00d620 tx=0x7f0dbc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:50.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.085+0000 7f0dc1ffb640 1 -- 172.21.15.50:0/3756516240 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00b620 con 0x7f0dc40b78f0 2024-09-11T22:11:50.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.085+0000 7f0dc1ffb640 1 -- 172.21.15.50:0/3756516240 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dbc019070 con 0x7f0dc40b78f0 2024-09-11T22:11:50.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.085+0000 7f0dc1ffb640 1 -- 172.21.15.50:0/3756516240 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00ba00 con 0x7f0dc40b78f0 2024-09-11T22:11:50.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.085+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/3756516240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc40b56a0 con 0x7f0dc40b78f0 2024-09-11T22:11:50.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.085+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/3756516240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc40b5c60 con 0x7f0dc40b78f0 2024-09-11T22:11:50.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.086+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/3756516240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc40b60a0 con 0x7f0dc40b78f0 2024-09-11T22:11:50.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.086+0000 7f0dc1ffb640 1 -- 172.21.15.50:0/3756516240 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0dbc00bba0 con 0x7f0dc40b78f0 2024-09-11T22:11:50.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.087+0000 7f0dc1ffb640 1 --2- 172.21.15.50:0/3756516240 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0db006be30 0x7f0db006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.087+0000 7f0dc1ffb640 1 -- 172.21.15.50:0/3756516240 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f0dbc08afc0 con 0x7f0dc40b78f0 2024-09-11T22:11:50.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.087+0000 7f0dc8c64640 1 --2- 172.21.15.50:0/3756516240 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0db006be30 0x7f0db006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.088+0000 7f0dc8c64640 1 --2- 172.21.15.50:0/3756516240 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0db006be30 0x7f0db006e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0db8000f60 tx=0x7f0db8007a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:50.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.091+0000 7f0dc1ffb640 1 -- 172.21.15.50:0/3756516240 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0dbc059c20 con 0x7f0dc40b78f0 2024-09-11T22:11:50.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.334+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/3756516240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f0dc40d1600 con 0x7f0dc40b78f0 2024-09-11T22:11:50.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.336+0000 7f0dc1ffb640 1 -- 172.21.15.50:0/3756516240 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f0dbc059520 con 0x7f0dc40b78f0 2024-09-11T22:11:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.339+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/3756516240 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0db006be30 msgr2=0x7f0db006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.339+0000 7f0dcb6c9640 1 --2- 172.21.15.50:0/3756516240 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0db006be30 0x7f0db006e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0db8000f60 tx=0x7f0db8007a00 comp rx=0 tx=0).stop 2024-09-11T22:11:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.339+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/3756516240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc40b78f0 msgr2=0x7f0dc4150b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.339+0000 7f0dcb6c9640 1 --2- 172.21.15.50:0/3756516240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc40b78f0 0x7f0dc4150b90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00d620 tx=0x7f0dbc00dae0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.339+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/3756516240 shutdown_connections 2024-09-11T22:11:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.339+0000 7f0dcb6c9640 1 --2- 172.21.15.50:0/3756516240 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0db006be30 0x7f0db006e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.339+0000 7f0dcb6c9640 1 --2- 172.21.15.50:0/3756516240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0dc40d11d0 0x7f0dc41f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.339+0000 7f0dcb6c9640 1 --2- 172.21.15.50:0/3756516240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dc4161d30 0x7f0dc415d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.339+0000 7f0dcb6c9640 1 --2- 172.21.15.50:0/3756516240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dc40b78f0 0x7f0dc4150b90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.339+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/3756516240 >> 172.21.15.50:0/3756516240 conn(0x7f0dc40727a0 msgr2=0x7f0dc40ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.339+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/3756516240 shutdown_connections 2024-09-11T22:11:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.339+0000 7f0dcb6c9640 1 -- 172.21.15.50:0/3756516240 wait complete. 2024-09-11T22:11:50.350 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-11T22:11:50.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.453+0000 7f1ab22d0640 1 Processor -- start 2024-09-11T22:11:50.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.453+0000 7f1ab22d0640 1 -- start start 2024-09-11T22:11:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.453+0000 7f1ab22d0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1aac0d05e0 0x7f1aac0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.453+0000 7f1ab22d0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aac0b4f00 con 0x7f1aac0b3e10 2024-09-11T22:11:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.454+0000 7f1ab22d0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aac0b4360 con 0x7f1aac15c2c0 2024-09-11T22:11:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.454+0000 7f1ab22d0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1aac0b51c0 con 0x7f1aac0d05e0 2024-09-11T22:11:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.454+0000 7f1aa37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1aac0d05e0 0x7f1aac0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.454+0000 7f1ab086d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1aac0b3e10 0x7f1aac0ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36766/0 (socket says 172.21.15.50:36766) 2024-09-11T22:11:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.454+0000 7f1ab086d640 1 -- 172.21.15.50:0/712404074 learned_addr learned my addr 172.21.15.50:0/712404074 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.454+0000 7f1aa37fe640 1 -- 172.21.15.50:0/712404074 >> v1:172.21.15.77:6789/0 conn(0x7f1aac15c2c0 legacy=0x7f1aac0cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.454+0000 7f1aa37fe640 1 -- 172.21.15.50:0/712404074 >> v1:172.21.15.50:6789/0 conn(0x7f1aac0b3e10 legacy=0x7f1aac0ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.454+0000 7f1aa37fe640 1 -- 172.21.15.50:0/712404074 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aac0b54a0 con 0x7f1aac0d05e0 2024-09-11T22:11:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.454+0000 7f1aab7fe640 1 -- 172.21.15.50:0/712404074 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186722759 0 0) 0x7f1aac0b4f00 con 0x7f1aac0b3e10 2024-09-11T22:11:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.455+0000 7f1aa37fe640 1 --2- 172.21.15.50:0/712404074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aac0d05e0 0x7f1aac0b46a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1a940097a0 tx=0x7f1a9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd1a31ca513cd48 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.455+0000 7f1aab7fe640 1 -- 172.21.15.50:0/712404074 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a94037070 con 0x7f1aac0d05e0 2024-09-11T22:11:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.455+0000 7f1aab7fe640 1 -- 172.21.15.50:0/712404074 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a94032440 con 0x7f1aac0d05e0 2024-09-11T22:11:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.455+0000 7f1aab7fe640 1 -- 172.21.15.50:0/712404074 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a94032810 con 0x7f1aac0d05e0 2024-09-11T22:11:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.455+0000 7f1ab22d0640 1 -- 172.21.15.50:0/712404074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aac0d05e0 msgr2=0x7f1aac0b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.455+0000 7f1ab22d0640 1 --2- 172.21.15.50:0/712404074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aac0d05e0 0x7f1aac0b46a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1a940097a0 tx=0x7f1a9402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.455+0000 7f1ab22d0640 1 -- 172.21.15.50:0/712404074 shutdown_connections 2024-09-11T22:11:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.455+0000 7f1ab22d0640 1 --2- 172.21.15.50:0/712404074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aac0d05e0 0x7f1aac0b46a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.456+0000 7f1ab22d0640 1 -- 172.21.15.50:0/712404074 >> 172.21.15.50:0/712404074 conn(0x7f1aac0679c0 msgr2=0x7f1aac067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.456+0000 7f1ab22d0640 1 -- 172.21.15.50:0/712404074 shutdown_connections 2024-09-11T22:11:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.456+0000 7f1ab22d0640 1 -- 172.21.15.50:0/712404074 wait complete. 2024-09-11T22:11:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.457+0000 7f1ab22d0640 1 Processor -- start 2024-09-11T22:11:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.457+0000 7f1ab22d0640 1 -- start start 2024-09-11T22:11:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1ab22d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aac0b3e10 0x7f1aac1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1ab22d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac0d05e0 0x7f1aac1f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1ab22d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1aac15c2c0 0x7f1aac0b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1ab22d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac06d070 con 0x7f1aac0b3e10 2024-09-11T22:11:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1ab22d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac0ce200 con 0x7f1aac0d05e0 2024-09-11T22:11:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1ab22d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1aac06d1f0 con 0x7f1aac15c2c0 2024-09-11T22:11:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1aabfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aac0b3e10 0x7f1aac1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1aabfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aac0b3e10 0x7f1aac1519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52792/0 (socket says 172.21.15.50:52792) 2024-09-11T22:11:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1aabfff640 1 -- 172.21.15.50:0/669523283 learned_addr learned my addr 172.21.15.50:0/669523283 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1aa37fe640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac0d05e0 0x7f1aac1f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1ab086d640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1aac15c2c0 0x7f1aac0b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1aabfff640 1 -- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1aac15c2c0 msgr2=0x7f1aac0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1aabfff640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1aac15c2c0 0x7f1aac0b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1aabfff640 1 -- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac0d05e0 msgr2=0x7f1aac1f81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1aabfff640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac0d05e0 0x7f1aac1f81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1aabfff640 1 -- 172.21.15.50:0/669523283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aac151ef0 con 0x7f1aac0b3e10 2024-09-11T22:11:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1ab086d640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1aac15c2c0 0x7f1aac0b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1aabfff640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aac0b3e10 0x7f1aac1519b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00b420 tx=0x7f1a9c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.458+0000 7f1aa97fa640 1 -- 172.21.15.50:0/669523283 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c011830 con 0x7f1aac0b3e10 2024-09-11T22:11:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.459+0000 7f1aa97fa640 1 -- 172.21.15.50:0/669523283 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a9c016070 con 0x7f1aac0b3e10 2024-09-11T22:11:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.459+0000 7f1aa97fa640 1 -- 172.21.15.50:0/669523283 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c011c10 con 0x7f1aac0b3e10 2024-09-11T22:11:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.459+0000 7f1ab22d0640 1 -- 172.21.15.50:0/669523283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aac152730 con 0x7f1aac0b3e10 2024-09-11T22:11:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.459+0000 7f1ab22d0640 1 -- 172.21.15.50:0/669523283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aac152450 con 0x7f1aac0b3e10 2024-09-11T22:11:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.460+0000 7f1ab22d0640 1 -- 172.21.15.50:0/669523283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aac075770 con 0x7f1aac0b3e10 2024-09-11T22:11:50.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.460+0000 7f1aa97fa640 1 -- 172.21.15.50:0/669523283 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a9c01b460 con 0x7f1aac0b3e10 2024-09-11T22:11:50.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.461+0000 7f1aa97fa640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1a8c06be30 0x7f1a8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.461+0000 7f1aa97fa640 1 -- 172.21.15.50:0/669523283 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f1a9c08a5f0 con 0x7f1aac0b3e10 2024-09-11T22:11:50.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.461+0000 7f1aa37fe640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1a8c06be30 0x7f1a8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.461+0000 7f1aa37fe640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1a8c06be30 0x7f1a8c06e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a94034000 tx=0x7f1a9402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:50.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.465+0000 7f1aa97fa640 1 -- 172.21.15.50:0/669523283 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1aac075770 con 0x7f1aac0b3e10 2024-09-11T22:11:50.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.709+0000 7f1ab22d0640 1 -- 172.21.15.50:0/669523283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f1aac15c6a0 con 0x7f1aac0b3e10 2024-09-11T22:11:50.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.711+0000 7f1aa97fa640 1 -- 172.21.15.50:0/669523283 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f1a9c020020 con 0x7f1aac0b3e10 2024-09-11T22:11:50.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.714+0000 7f1ab22d0640 1 -- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1a8c06be30 msgr2=0x7f1a8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.714+0000 7f1ab22d0640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1a8c06be30 0x7f1a8c06e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a94034000 tx=0x7f1a9402e000 comp rx=0 tx=0).stop 2024-09-11T22:11:50.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.714+0000 7f1ab22d0640 1 -- 172.21.15.50:0/669523283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aac0b3e10 msgr2=0x7f1aac1519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.714+0000 7f1ab22d0640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aac0b3e10 0x7f1aac1519b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00b420 tx=0x7f1a9c00b8e0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.714+0000 7f1ab22d0640 1 -- 172.21.15.50:0/669523283 shutdown_connections 2024-09-11T22:11:50.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.714+0000 7f1ab22d0640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1a8c06be30 0x7f1a8c06e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.714+0000 7f1ab22d0640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1aac15c2c0 0x7f1aac0b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.714+0000 7f1ab22d0640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac0d05e0 0x7f1aac1f81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.714+0000 7f1ab22d0640 1 --2- 172.21.15.50:0/669523283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aac0b3e10 0x7f1aac1519b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.714+0000 7f1ab22d0640 1 -- 172.21.15.50:0/669523283 >> 172.21.15.50:0/669523283 conn(0x7f1aac0679c0 msgr2=0x7f1aac067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:50.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.714+0000 7f1ab22d0640 1 -- 172.21.15.50:0/669523283 shutdown_connections 2024-09-11T22:11:50.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.714+0000 7f1ab22d0640 1 -- 172.21.15.50:0/669523283 wait complete. 2024-09-11T22:11:50.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-11T22:11:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.827+0000 7fc243d42640 1 Processor -- start 2024-09-11T22:11:50.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.828+0000 7fc243d42640 1 -- start start 2024-09-11T22:11:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.828+0000 7fc243d42640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc23c161fa0 0x7fc23c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.828+0000 7fc243d42640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc23c0cf610 0x7fc23c0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.828+0000 7fc243d42640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23c0cfbd0 con 0x7fc23c0b1600 2024-09-11T22:11:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.828+0000 7fc243d42640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc23c0d1220 con 0x7fc23c0cf610 2024-09-11T22:11:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.828+0000 7fc243d42640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc23c0d17e0 con 0x7fc23c161fa0 2024-09-11T22:11:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.829+0000 7fc2422df640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc23c0cf610 0x7fc23c0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.829+0000 7fc2422df640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc23c0cf610 0x7fc23c0cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52796/0 (socket says 172.21.15.50:52796) 2024-09-11T22:11:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.829+0000 7fc2422df640 1 -- 172.21.15.50:0/1121471836 learned_addr learned my addr 172.21.15.50:0/1121471836 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:50.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.829+0000 7fc241ade640 1 --2- 172.21.15.50:0/1121471836 >> v2:172.21.15.77:3300/0 conn(0x7fc23c161fa0 0x7fc23c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.829+0000 7fc2422df640 1 -- 172.21.15.50:0/1121471836 >> v2:172.21.15.77:3300/0 conn(0x7fc23c161fa0 msgr2=0x7fc23c0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.829+0000 7fc2422df640 1 --2- 172.21.15.50:0/1121471836 >> v2:172.21.15.77:3300/0 conn(0x7fc23c161fa0 0x7fc23c0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.829+0000 7fc2422df640 1 -- 172.21.15.50:0/1121471836 >> v1:172.21.15.77:6789/0 conn(0x7fc23c0b1600 legacy=0x7fc23c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.829+0000 7fc2422df640 1 -- 172.21.15.50:0/1121471836 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c0cfeb0 con 0x7fc23c0cf610 2024-09-11T22:11:50.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.829+0000 7fc241ade640 1 --2- 172.21.15.50:0/1121471836 >> v2:172.21.15.77:3300/0 conn(0x7fc23c161fa0 0x7fc23c0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.830+0000 7fc2422df640 1 --2- 172.21.15.50:0/1121471836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0cf610 0x7fc23c0cccd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc23c072960 tx=0x7fc23402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f84a6205d5d05a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.830+0000 7fc240adc640 1 -- 172.21.15.50:0/1121471836 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234036070 con 0x7fc23c0cf610 2024-09-11T22:11:50.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.830+0000 7fc240adc640 1 -- 172.21.15.50:0/1121471836 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc234031600 con 0x7fc23c0cf610 2024-09-11T22:11:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.830+0000 7fc240adc640 1 -- 172.21.15.50:0/1121471836 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2340319d0 con 0x7fc23c0cf610 2024-09-11T22:11:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.830+0000 7fc243d42640 1 -- 172.21.15.50:0/1121471836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0cf610 msgr2=0x7fc23c0cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.830+0000 7fc243d42640 1 --2- 172.21.15.50:0/1121471836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0cf610 0x7fc23c0cccd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc23c072960 tx=0x7fc23402a6f0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.830+0000 7fc243d42640 1 -- 172.21.15.50:0/1121471836 shutdown_connections 2024-09-11T22:11:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.830+0000 7fc243d42640 1 --2- 172.21.15.50:0/1121471836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0cf610 0x7fc23c0cccd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.830+0000 7fc243d42640 1 --2- 172.21.15.50:0/1121471836 >> v2:172.21.15.77:3300/0 conn(0x7fc23c161fa0 0x7fc23c0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.830+0000 7fc243d42640 1 -- 172.21.15.50:0/1121471836 >> 172.21.15.50:0/1121471836 conn(0x7fc23c09ba50 msgr2=0x7fc23c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.830+0000 7fc243d42640 1 -- 172.21.15.50:0/1121471836 shutdown_connections 2024-09-11T22:11:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.830+0000 7fc243d42640 1 -- 172.21.15.50:0/1121471836 wait complete. 2024-09-11T22:11:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.832+0000 7fc243d42640 1 Processor -- start 2024-09-11T22:11:50.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.832+0000 7fc243d42640 1 -- start start 2024-09-11T22:11:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.832+0000 7fc243d42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc23c0b1600 0x7fc23c0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.832+0000 7fc243d42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0cf610 0x7fc23c1601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.832+0000 7fc243d42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc23c161fa0 0x7fc23c160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.832+0000 7fc243d42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c162500 con 0x7fc23c0cf610 2024-09-11T22:11:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.832+0000 7fc243d42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c162380 con 0x7fc23c0b1600 2024-09-11T22:11:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.832+0000 7fc243d42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc23c0d1c70 con 0x7fc23c161fa0 2024-09-11T22:11:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.832+0000 7fc2412dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0cf610 0x7fc23c1601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.832+0000 7fc2412dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0cf610 0x7fc23c1601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52804/0 (socket says 172.21.15.50:52804) 2024-09-11T22:11:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.832+0000 7fc2412dd640 1 -- 172.21.15.50:0/1469304464 learned_addr learned my addr 172.21.15.50:0/1469304464 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc2422df640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc23c161fa0 0x7fc23c160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc241ade640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc23c0b1600 0x7fc23c0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc2412dd640 1 -- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc23c161fa0 msgr2=0x7fc23c160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc2412dd640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc23c161fa0 0x7fc23c160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc2412dd640 1 -- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc23c0b1600 msgr2=0x7fc23c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:50.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc2412dd640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc23c0b1600 0x7fc23c0cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc2412dd640 1 -- 172.21.15.50:0/1469304464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c0cc560 con 0x7fc23c0cf610 2024-09-11T22:11:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc2422df640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc23c161fa0 0x7fc23c160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc241ade640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc23c0b1600 0x7fc23c0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc2412dd640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0cf610 0x7fc23c1601c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00b420 tx=0x7fc22c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc2327fc640 1 -- 172.21.15.50:0/1469304464 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c011830 con 0x7fc23c0cf610 2024-09-11T22:11:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc2327fc640 1 -- 172.21.15.50:0/1469304464 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc22c016070 con 0x7fc23c0cf610 2024-09-11T22:11:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc243d42640 1 -- 172.21.15.50:0/1469304464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc23c160f30 con 0x7fc23c0cf610 2024-09-11T22:11:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc2327fc640 1 -- 172.21.15.50:0/1469304464 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c011c10 con 0x7fc23c0cf610 2024-09-11T22:11:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.833+0000 7fc243d42640 1 -- 172.21.15.50:0/1469304464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc23c0c9c80 con 0x7fc23c0cf610 2024-09-11T22:11:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.834+0000 7fc243d42640 1 -- 172.21.15.50:0/1469304464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc23c0b4d20 con 0x7fc23c0cf610 2024-09-11T22:11:50.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.835+0000 7fc2327fc640 1 -- 172.21.15.50:0/1469304464 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc22c01b460 con 0x7fc23c0cf610 2024-09-11T22:11:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.835+0000 7fc2327fc640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc22006be60 0x7fc22006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.835+0000 7fc2327fc640 1 -- 172.21.15.50:0/1469304464 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fc22c08a570 con 0x7fc23c0cf610 2024-09-11T22:11:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.835+0000 7fc241ade640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc22006be60 0x7fc22006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:50.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.836+0000 7fc241ade640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc22006be60 0x7fc22006e320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc238006fd0 tx=0x7fc238008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:50.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:50.839+0000 7fc2327fc640 1 -- 172.21.15.50:0/1469304464 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc22c020020 con 0x7fc23c0cf610 2024-09-11T22:11:51.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.083+0000 7fc243d42640 1 -- 172.21.15.50:0/1469304464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fc23c0c9730 con 0x7fc23c0cf610 2024-09-11T22:11:51.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.085+0000 7fc2327fc640 1 -- 172.21.15.50:0/1469304464 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fc22c059270 con 0x7fc23c0cf610 2024-09-11T22:11:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.087+0000 7fc243d42640 1 -- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc22006be60 msgr2=0x7fc22006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.087+0000 7fc243d42640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc22006be60 0x7fc22006e320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc238006fd0 tx=0x7fc238008040 comp rx=0 tx=0).stop 2024-09-11T22:11:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.087+0000 7fc243d42640 1 -- 172.21.15.50:0/1469304464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0cf610 msgr2=0x7fc23c1601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.087+0000 7fc243d42640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0cf610 0x7fc23c1601c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00b420 tx=0x7fc22c00b8e0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.087+0000 7fc243d42640 1 -- 172.21.15.50:0/1469304464 shutdown_connections 2024-09-11T22:11:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.087+0000 7fc243d42640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc22006be60 0x7fc22006e320 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.087+0000 7fc243d42640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc23c161fa0 0x7fc23c160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.087+0000 7fc243d42640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c0cf610 0x7fc23c1601c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.087+0000 7fc243d42640 1 --2- 172.21.15.50:0/1469304464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc23c0b1600 0x7fc23c0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.087+0000 7fc243d42640 1 -- 172.21.15.50:0/1469304464 >> 172.21.15.50:0/1469304464 conn(0x7fc23c09ba50 msgr2=0x7fc23c06f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.087+0000 7fc243d42640 1 -- 172.21.15.50:0/1469304464 shutdown_connections 2024-09-11T22:11:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.087+0000 7fc243d42640 1 -- 172.21.15.50:0/1469304464 wait complete. 2024-09-11T22:11:51.098 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-11T22:11:51.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.202+0000 7f5edd8d0640 1 Processor -- start 2024-09-11T22:11:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.202+0000 7f5edd8d0640 1 -- start start 2024-09-11T22:11:51.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.203+0000 7f5edd8d0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ed80d18a0 0x7f5ed80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.203+0000 7f5edd8d0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ed80cfa80 con 0x7f5ed815e870 2024-09-11T22:11:51.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.203+0000 7f5edd8d0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ed80d40d0 con 0x7f5ed80d3a30 2024-09-11T22:11:51.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.203+0000 7f5edd8d0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5ed80d3ea0 con 0x7f5ed80d18a0 2024-09-11T22:11:51.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.203+0000 7f5ed67fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ed80d18a0 0x7f5ed80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.203+0000 7f5ed67fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ed80d18a0 0x7f5ed80d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52816/0 (socket says 172.21.15.50:52816) 2024-09-11T22:11:51.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.203+0000 7f5ed67fc640 1 -- 172.21.15.50:0/3758113205 learned_addr learned my addr 172.21.15.50:0/3758113205 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:51.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.203+0000 7f5ed6ffd640 1 --1- 172.21.15.50:0/3758113205 >> v1:172.21.15.50:6789/0 conn(0x7f5ed815e870 0x7f5ed80d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36774/0 (socket says 172.21.15.50:36774) 2024-09-11T22:11:51.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.203+0000 7f5ed67fc640 1 -- 172.21.15.50:0/3758113205 >> v1:172.21.15.77:6789/0 conn(0x7f5ed80d3a30 legacy=0x7f5ed80b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.203+0000 7f5ed67fc640 1 -- 172.21.15.50:0/3758113205 >> v1:172.21.15.50:6789/0 conn(0x7f5ed815e870 legacy=0x7f5ed80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.203+0000 7f5ed67fc640 1 -- 172.21.15.50:0/3758113205 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed80d43b0 con 0x7f5ed80d18a0 2024-09-11T22:11:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.204+0000 7f5ed67fc640 1 --2- 172.21.15.50:0/3758113205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed80d18a0 0x7f5ed80d34f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009870 tx=0x7f5ecc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c048ea04e57aa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.204+0000 7f5ed5ffb640 1 -- 172.21.15.50:0/3758113205 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc037070 con 0x7f5ed80d18a0 2024-09-11T22:11:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.204+0000 7f5ed5ffb640 1 -- 172.21.15.50:0/3758113205 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ecc02ae50 con 0x7f5ed80d18a0 2024-09-11T22:11:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.204+0000 7f5ed5ffb640 1 -- 172.21.15.50:0/3758113205 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc032860 con 0x7f5ed80d18a0 2024-09-11T22:11:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.205+0000 7f5edd8d0640 1 -- 172.21.15.50:0/3758113205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed80d18a0 msgr2=0x7f5ed80d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.205+0000 7f5edd8d0640 1 --2- 172.21.15.50:0/3758113205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed80d18a0 0x7f5ed80d34f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009870 tx=0x7f5ecc02a300 comp rx=0 tx=0).stop 2024-09-11T22:11:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.205+0000 7f5edd8d0640 1 -- 172.21.15.50:0/3758113205 shutdown_connections 2024-09-11T22:11:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.205+0000 7f5edd8d0640 1 --2- 172.21.15.50:0/3758113205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed80d18a0 0x7f5ed80d34f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.205+0000 7f5edd8d0640 1 -- 172.21.15.50:0/3758113205 >> 172.21.15.50:0/3758113205 conn(0x7f5ed80727a0 msgr2=0x7f5ed80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.205+0000 7f5edd8d0640 1 -- 172.21.15.50:0/3758113205 shutdown_connections 2024-09-11T22:11:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.205+0000 7f5edd8d0640 1 -- 172.21.15.50:0/3758113205 wait complete. 2024-09-11T22:11:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.206+0000 7f5edd8d0640 1 Processor -- start 2024-09-11T22:11:51.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.206+0000 7f5edd8d0640 1 -- start start 2024-09-11T22:11:51.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5edd8d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed80d18a0 0x7f5ed81e93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5edd8d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed80d3a30 0x7f5ed81e9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5edd8d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ed815e870 0x7f5ed80c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5edd8d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed815ec50 con 0x7f5ed80d3a30 2024-09-11T22:11:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5edd8d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed80b7ee0 con 0x7f5ed815e870 2024-09-11T22:11:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5edd8d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed80b78b0 con 0x7f5ed80d18a0 2024-09-11T22:11:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5ed67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed80d3a30 0x7f5ed81e9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5ed67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed80d3a30 0x7f5ed81e9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52830/0 (socket says 172.21.15.50:52830) 2024-09-11T22:11:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5ed67fc640 1 -- 172.21.15.50:0/1761359006 learned_addr learned my addr 172.21.15.50:0/1761359006 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5ed77fe640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ed815e870 0x7f5ed80c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5ed6ffd640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed80d18a0 0x7f5ed81e93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5ed67fc640 1 -- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed80d18a0 msgr2=0x7f5ed81e93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5ed67fc640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed80d18a0 0x7f5ed81e93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5ed67fc640 1 -- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ed815e870 msgr2=0x7f5ed80c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5ed67fc640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ed815e870 0x7f5ed80c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.207+0000 7f5ed67fc640 1 -- 172.21.15.50:0/1761359006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed8157d40 con 0x7f5ed80d3a30 2024-09-11T22:11:51.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.208+0000 7f5ed67fc640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed80d3a30 0x7f5ed81e9930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc000c00 tx=0x7f5ecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.208+0000 7f5ebffff640 1 -- 172.21.15.50:0/1761359006 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc041070 con 0x7f5ed80d3a30 2024-09-11T22:11:51.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.208+0000 7f5ebffff640 1 -- 172.21.15.50:0/1761359006 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ecc03c890 con 0x7f5ed80d3a30 2024-09-11T22:11:51.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.208+0000 7f5edd8d0640 1 -- 172.21.15.50:0/1761359006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed81e6e30 con 0x7f5ed80d3a30 2024-09-11T22:11:51.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.208+0000 7f5ebffff640 1 -- 172.21.15.50:0/1761359006 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc037040 con 0x7f5ed80d3a30 2024-09-11T22:11:51.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.208+0000 7f5edd8d0640 1 -- 172.21.15.50:0/1761359006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed81e73f0 con 0x7f5ed80d3a30 2024-09-11T22:11:51.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.209+0000 7f5edd8d0640 1 -- 172.21.15.50:0/1761359006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed80d34f0 con 0x7f5ed80d3a30 2024-09-11T22:11:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.209+0000 7f5ebffff640 1 -- 172.21.15.50:0/1761359006 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ecc044070 con 0x7f5ed80d3a30 2024-09-11T22:11:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.210+0000 7f5ebffff640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ec406be30 0x7f5ec406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.210+0000 7f5ebffff640 1 -- 172.21.15.50:0/1761359006 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f5ecc0ab500 con 0x7f5ed80d3a30 2024-09-11T22:11:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.210+0000 7f5ed6ffd640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ec406be30 0x7f5ec406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.210+0000 7f5ed6ffd640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ec406be30 0x7f5ec406e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8000f60 tx=0x7f5ec8000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.214+0000 7f5ebffff640 1 -- 172.21.15.50:0/1761359006 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ecc079cd0 con 0x7f5ed80d3a30 2024-09-11T22:11:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.456+0000 7f5edd8d0640 1 -- 172.21.15.50:0/1761359006 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f5ed806bf50 con 0x7f5ed80d3a30 2024-09-11T22:11:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.458+0000 7f5ebffff640 1 -- 172.21.15.50:0/1761359006 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f5ecc07dfd0 con 0x7f5ed80d3a30 2024-09-11T22:11:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.460+0000 7f5edd8d0640 1 -- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ec406be30 msgr2=0x7f5ec406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.460+0000 7f5edd8d0640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ec406be30 0x7f5ec406e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8000f60 tx=0x7f5ec8000ed0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.460+0000 7f5edd8d0640 1 -- 172.21.15.50:0/1761359006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed80d3a30 msgr2=0x7f5ed81e9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.460+0000 7f5edd8d0640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed80d3a30 0x7f5ed81e9930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc000c00 tx=0x7f5ecc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.460+0000 7f5edd8d0640 1 -- 172.21.15.50:0/1761359006 shutdown_connections 2024-09-11T22:11:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.460+0000 7f5edd8d0640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ec406be30 0x7f5ec406e2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.460+0000 7f5edd8d0640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ed815e870 0x7f5ed80c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.460+0000 7f5edd8d0640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ed80d3a30 0x7f5ed81e9930 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.460+0000 7f5edd8d0640 1 --2- 172.21.15.50:0/1761359006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed80d18a0 0x7f5ed81e93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.460+0000 7f5edd8d0640 1 -- 172.21.15.50:0/1761359006 >> 172.21.15.50:0/1761359006 conn(0x7f5ed80727a0 msgr2=0x7f5ed80b6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.460+0000 7f5edd8d0640 1 -- 172.21.15.50:0/1761359006 shutdown_connections 2024-09-11T22:11:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.460+0000 7f5edd8d0640 1 -- 172.21.15.50:0/1761359006 wait complete. 2024-09-11T22:11:51.472 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-11T22:11:51.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.575+0000 7fdd5fbe8640 1 Processor -- start 2024-09-11T22:11:51.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.575+0000 7fdd5fbe8640 1 -- start start 2024-09-11T22:11:51.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5fbe8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdd58161d30 0x7fdd580cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5fbe8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd580b78f0 0x7fdd58162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5fbe8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd580d11d0 0x7fdd580d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5fbe8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fdd580d1b80 con 0x7fdd580b78f0 2024-09-11T22:11:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5fbe8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fdd580d3450 con 0x7fdd58161d30 2024-09-11T22:11:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5fbe8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdd581632e0 con 0x7fdd580d11d0 2024-09-11T22:11:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5d183640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd580b78f0 0x7fdd58162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5d183640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd580b78f0 0x7fdd58162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52842/0 (socket says 172.21.15.50:52842) 2024-09-11T22:11:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5d183640 1 -- 172.21.15.50:0/1402575091 learned_addr learned my addr 172.21.15.50:0/1402575091 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5e185640 1 --2- 172.21.15.50:0/1402575091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd580d11d0 0x7fdd580d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5d984640 1 --2- 172.21.15.50:0/1402575091 >> v2:172.21.15.77:3300/0 conn(0x7fdd58161d30 0x7fdd580cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5d183640 1 -- 172.21.15.50:0/1402575091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd580d11d0 msgr2=0x7fdd580d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5d183640 1 --2- 172.21.15.50:0/1402575091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd580d11d0 0x7fdd580d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5d183640 1 -- 172.21.15.50:0/1402575091 >> v2:172.21.15.77:3300/0 conn(0x7fdd58161d30 msgr2=0x7fdd580cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:51.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5d183640 1 --2- 172.21.15.50:0/1402575091 >> v2:172.21.15.77:3300/0 conn(0x7fdd58161d30 0x7fdd580cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5d183640 1 -- 172.21.15.50:0/1402575091 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd58162110 con 0x7fdd580b78f0 2024-09-11T22:11:51.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5e185640 1 --2- 172.21.15.50:0/1402575091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd580d11d0 0x7fdd580d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:51.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.576+0000 7fdd5d984640 1 --2- 172.21.15.50:0/1402575091 >> v2:172.21.15.77:3300/0 conn(0x7fdd58161d30 0x7fdd580cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:51.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.577+0000 7fdd5d183640 1 --2- 172.21.15.50:0/1402575091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd580b78f0 0x7fdd58162da0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdd58073050 tx=0x7fdd4802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2550f0b1367f3a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.577+0000 7fdd5c982640 1 -- 172.21.15.50:0/1402575091 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48037070 con 0x7fdd580b78f0 2024-09-11T22:11:51.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.577+0000 7fdd5c982640 1 -- 172.21.15.50:0/1402575091 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd48032440 con 0x7fdd580b78f0 2024-09-11T22:11:51.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.577+0000 7fdd5c982640 1 -- 172.21.15.50:0/1402575091 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48032810 con 0x7fdd580b78f0 2024-09-11T22:11:51.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.577+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/1402575091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd580b78f0 msgr2=0x7fdd58162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.577+0000 7fdd5fbe8640 1 --2- 172.21.15.50:0/1402575091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd580b78f0 0x7fdd58162da0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdd58073050 tx=0x7fdd4802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.578+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/1402575091 shutdown_connections 2024-09-11T22:11:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.578+0000 7fdd5fbe8640 1 --2- 172.21.15.50:0/1402575091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd580d11d0 0x7fdd580d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.578+0000 7fdd5fbe8640 1 --2- 172.21.15.50:0/1402575091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd580b78f0 0x7fdd58162da0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.578+0000 7fdd5fbe8640 1 --2- 172.21.15.50:0/1402575091 >> v2:172.21.15.77:3300/0 conn(0x7fdd58161d30 0x7fdd580cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.578+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/1402575091 >> 172.21.15.50:0/1402575091 conn(0x7fdd580727a0 msgr2=0x7fdd580679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.578+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/1402575091 shutdown_connections 2024-09-11T22:11:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.578+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/1402575091 wait complete. 2024-09-11T22:11:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.579+0000 7fdd5fbe8640 1 Processor -- start 2024-09-11T22:11:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.579+0000 7fdd5fbe8640 1 -- start start 2024-09-11T22:11:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5fbe8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd580b78f0 0x7fdd5814cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5fbe8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd580d11d0 0x7fdd580b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5fbe8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd58161d30 0x7fdd580ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5fbe8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd580d2e00 con 0x7fdd580b78f0 2024-09-11T22:11:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5fbe8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd580d2b20 con 0x7fdd580d11d0 2024-09-11T22:11:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5fbe8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdd580d30e0 con 0x7fdd58161d30 2024-09-11T22:11:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5d984640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd580b78f0 0x7fdd5814cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5d984640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd580b78f0 0x7fdd5814cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52848/0 (socket says 172.21.15.50:52848) 2024-09-11T22:11:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5d984640 1 -- 172.21.15.50:0/533748031 learned_addr learned my addr 172.21.15.50:0/533748031 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5d183640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd580d11d0 0x7fdd580b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5e185640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd58161d30 0x7fdd580ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5d984640 1 -- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd58161d30 msgr2=0x7fdd580ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5d984640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd58161d30 0x7fdd580ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5d984640 1 -- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd580d11d0 msgr2=0x7fdd580b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5d984640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd580d11d0 0x7fdd580b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5d984640 1 -- 172.21.15.50:0/533748031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5814d120 con 0x7fdd580b78f0 2024-09-11T22:11:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5e185640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd58161d30 0x7fdd580ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5d984640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd580b78f0 0x7fdd5814cbe0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400c820 tx=0x7fdd5400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd4e7fc640 1 -- 172.21.15.50:0/533748031 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd54015070 con 0x7fdd580b78f0 2024-09-11T22:11:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd4e7fc640 1 -- 172.21.15.50:0/533748031 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd54007a30 con 0x7fdd580b78f0 2024-09-11T22:11:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/533748031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd580b5b20 con 0x7fdd580b78f0 2024-09-11T22:11:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.580+0000 7fdd4e7fc640 1 -- 172.21.15.50:0/533748031 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd54007de0 con 0x7fdd580b78f0 2024-09-11T22:11:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.581+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/533748031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd5814d780 con 0x7fdd580b78f0 2024-09-11T22:11:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.582+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/533748031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd580b7d60 con 0x7fdd580b78f0 2024-09-11T22:11:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.582+0000 7fdd4e7fc640 1 -- 172.21.15.50:0/533748031 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd54018070 con 0x7fdd580b78f0 2024-09-11T22:11:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.582+0000 7fdd4e7fc640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdd3c06be30 0x7fdd3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.583+0000 7fdd4e7fc640 1 -- 172.21.15.50:0/533748031 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fdd5408a930 con 0x7fdd580b78f0 2024-09-11T22:11:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.583+0000 7fdd5d183640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdd3c06be30 0x7fdd3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.583+0000 7fdd5d183640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdd3c06be30 0x7fdd3c06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdd48034000 tx=0x7fdd4802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.587+0000 7fdd4e7fc640 1 -- 172.21.15.50:0/533748031 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd5814d120 con 0x7fdd580b78f0 2024-09-11T22:11:51.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.828+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/533748031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fdd580d2900 con 0x7fdd580b78f0 2024-09-11T22:11:51.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.830+0000 7fdd4e7fc640 1 -- 172.21.15.50:0/533748031 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fdd54058fe0 con 0x7fdd580b78f0 2024-09-11T22:11:51.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.832+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdd3c06be30 msgr2=0x7fdd3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.832+0000 7fdd5fbe8640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdd3c06be30 0x7fdd3c06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdd48034000 tx=0x7fdd4802e000 comp rx=0 tx=0).stop 2024-09-11T22:11:51.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.832+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/533748031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd580b78f0 msgr2=0x7fdd5814cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.832+0000 7fdd5fbe8640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd580b78f0 0x7fdd5814cbe0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400c820 tx=0x7fdd5400cce0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.832+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/533748031 shutdown_connections 2024-09-11T22:11:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.832+0000 7fdd5fbe8640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdd3c06be30 0x7fdd3c06e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.832+0000 7fdd5fbe8640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd58161d30 0x7fdd580ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.832+0000 7fdd5fbe8640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd580d11d0 0x7fdd580b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.832+0000 7fdd5fbe8640 1 --2- 172.21.15.50:0/533748031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd580b78f0 0x7fdd5814cbe0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.832+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/533748031 >> 172.21.15.50:0/533748031 conn(0x7fdd580727a0 msgr2=0x7fdd580ba1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.833+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/533748031 shutdown_connections 2024-09-11T22:11:51.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.833+0000 7fdd5fbe8640 1 -- 172.21.15.50:0/533748031 wait complete. 2024-09-11T22:11:51.844 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:11:51.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.945+0000 7fc61aa42640 1 Processor -- start 2024-09-11T22:11:51.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.945+0000 7fc61aa42640 1 -- start start 2024-09-11T22:11:51.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.946+0000 7fc61aa42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6140b19f0 0x7fc6141675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.946+0000 7fc61aa42640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6140b2d10 con 0x7fc6140af4c0 2024-09-11T22:11:51.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.946+0000 7fc61aa42640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6140af940 con 0x7fc61415fd80 2024-09-11T22:11:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.946+0000 7fc61aa42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6140d1500 con 0x7fc6140b19f0 2024-09-11T22:11:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.946+0000 7fc6137fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc6140af4c0 0x7fc6140b2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36776/0 (socket says 172.21.15.50:36776) 2024-09-11T22:11:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.946+0000 7fc6137fe640 1 -- 172.21.15.50:0/4245570323 learned_addr learned my addr 172.21.15.50:0/4245570323 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562020056 0 0) 0x7fc6140b2d10 con 0x7fc6140af4c0 2024-09-11T22:11:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5fc003520 con 0x7fc6140af4c0 2024-09-11T22:11:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc618fdf640 1 --2- 172.21.15.50:0/4245570323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6140b19f0 0x7fc6141675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3023634142 0 0) 0x7fc5fc003520 con 0x7fc6140af4c0 2024-09-11T22:11:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6140b19f0 msgr2=0x7fc6141675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 --2- 172.21.15.50:0/4245570323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6140b19f0 0x7fc6141675d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 >> v1:172.21.15.77:6789/0 conn(0x7fc61415fd80 legacy=0x7fc6140b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6140afc20 con 0x7fc6140af4c0 2024-09-11T22:11:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fc608001670 con 0x7fc6140af4c0 2024-09-11T22:11:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 >> v1:172.21.15.50:6789/0 conn(0x7fc6140af4c0 legacy=0x7fc6140b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 --2- 172.21.15.50:0/4245570323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5fc0039e0 0x7fc5fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 --2- 172.21.15.50:0/4245570323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc004800 0x7fc5fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 --2- 172.21.15.50:0/4245570323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6140b19f0 0x7fc5fc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140d1500 con 0x7fc5fc004800 2024-09-11T22:11:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc00bb20 con 0x7fc5fc0039e0 2024-09-11T22:11:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc5fc00bd20 con 0x7fc6140b19f0 2024-09-11T22:11:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc6137fe640 1 --2- 172.21.15.50:0/4245570323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc004800 0x7fc5fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc613fff640 1 --2- 172.21.15.50:0/4245570323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5fc0039e0 0x7fc5fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc618fdf640 1 --2- 172.21.15.50:0/4245570323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6140b19f0 0x7fc5fc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc6137fe640 1 -- 172.21.15.50:0/4245570323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6140b19f0 msgr2=0x7fc5fc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc6137fe640 1 --2- 172.21.15.50:0/4245570323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6140b19f0 0x7fc5fc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.947+0000 7fc6137fe640 1 -- 172.21.15.50:0/4245570323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5fc0039e0 msgr2=0x7fc5fc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:51.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.948+0000 7fc6137fe640 1 --2- 172.21.15.50:0/4245570323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5fc0039e0 0x7fc5fc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.948+0000 7fc6137fe640 1 -- 172.21.15.50:0/4245570323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5fc003520 con 0x7fc5fc004800 2024-09-11T22:11:51.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.948+0000 7fc6137fe640 1 --2- 172.21.15.50:0/4245570323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc004800 0x7fc5fc004c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc60800c210 tx=0x7fc5fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67526001052ba87 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.948+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608007d30 con 0x7fc5fc004800 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.948+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc608005ad0 con 0x7fc5fc004800 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.948+0000 7fc612ffd640 1 -- 172.21.15.50:0/4245570323 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608007070 con 0x7fc5fc004800 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.949+0000 7fc61aa42640 1 -- 172.21.15.50:0/4245570323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc004800 msgr2=0x7fc5fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.949+0000 7fc61aa42640 1 --2- 172.21.15.50:0/4245570323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5fc004800 0x7fc5fc004c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc60800c210 tx=0x7fc5fc005830 comp rx=0 tx=0).stop 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.949+0000 7fc618fdf640 1 -- 172.21.15.50:0/4245570323 reap_dead start 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.949+0000 7fc61aa42640 1 -- 172.21.15.50:0/4245570323 shutdown_connections 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.949+0000 7fc61aa42640 1 -- 172.21.15.50:0/4245570323 >> 172.21.15.50:0/4245570323 conn(0x7fc61409ba50 msgr2=0x7fc6140b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.949+0000 7fc61aa42640 1 -- 172.21.15.50:0/4245570323 shutdown_connections 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.949+0000 7fc61aa42640 1 -- 172.21.15.50:0/4245570323 wait complete. 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.950+0000 7fc61aa42640 1 Processor -- start 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.950+0000 7fc61aa42640 1 -- start start 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.951+0000 7fc61aa42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5fc004800 0x7fc614153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.951+0000 7fc61aa42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc61415a1b0 0x7fc614158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.951+0000 7fc61aa42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b66d0 0x7fc6141594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.951+0000 7fc61aa42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140b04c0 con 0x7fc6140b66d0 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.951+0000 7fc61aa42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140b01e0 con 0x7fc61415a1b0 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.951+0000 7fc61aa42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6140b3ee0 con 0x7fc5fc004800 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.951+0000 7fc618fdf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b66d0 0x7fc6141594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.951+0000 7fc618fdf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b66d0 0x7fc6141594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52856/0 (socket says 172.21.15.50:52856) 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.951+0000 7fc618fdf640 1 -- 172.21.15.50:0/1783687285 learned_addr learned my addr 172.21.15.50:0/1783687285 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.951+0000 7fc613fff640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5fc004800 0x7fc614153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.951+0000 7fc6137fe640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc61415a1b0 0x7fc614158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.951+0000 7fc618fdf640 1 -- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5fc004800 msgr2=0x7fc614153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.951+0000 7fc618fdf640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5fc004800 0x7fc614153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.952+0000 7fc618fdf640 1 -- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc61415a1b0 msgr2=0x7fc614158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.952+0000 7fc618fdf640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc61415a1b0 0x7fc614158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.952+0000 7fc618fdf640 1 -- 172.21.15.50:0/1783687285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6141f6430 con 0x7fc6140b66d0 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.952+0000 7fc6137fe640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc61415a1b0 0x7fc614158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.952+0000 7fc618fdf640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b66d0 0x7fc6141594c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc61409bee0 tx=0x7fc60c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.952+0000 7fc610ff9640 1 -- 172.21.15.50:0/1783687285 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c015430 con 0x7fc6140b66d0 2024-09-11T22:11:51.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.952+0000 7fc610ff9640 1 -- 172.21.15.50:0/1783687285 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60c0155f0 con 0x7fc6140b66d0 2024-09-11T22:11:51.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.952+0000 7fc610ff9640 1 -- 172.21.15.50:0/1783687285 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c0159e0 con 0x7fc6140b66d0 2024-09-11T22:11:51.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.952+0000 7fc61aa42640 1 -- 172.21.15.50:0/1783687285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6141f6710 con 0x7fc6140b66d0 2024-09-11T22:11:51.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.952+0000 7fc61aa42640 1 -- 172.21.15.50:0/1783687285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc614157070 con 0x7fc6140b66d0 2024-09-11T22:11:51.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.953+0000 7fc61aa42640 1 -- 172.21.15.50:0/1783687285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc614160160 con 0x7fc6140b66d0 2024-09-11T22:11:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.953+0000 7fc610ff9640 1 -- 172.21.15.50:0/1783687285 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc60c015b80 con 0x7fc6140b66d0 2024-09-11T22:11:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.954+0000 7fc610ff9640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc60006be60 0x7fc60006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.954+0000 7fc610ff9640 1 -- 172.21.15.50:0/1783687285 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fc60c08b890 con 0x7fc6140b66d0 2024-09-11T22:11:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.954+0000 7fc613fff640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc60006be60 0x7fc60006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.955+0000 7fc613fff640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc60006be60 0x7fc60006e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc604001760 tx=0x7fc604009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:51.958+0000 7fc610ff9640 1 -- 172.21.15.50:0/1783687285 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc60c019030 con 0x7fc6140b66d0 2024-09-11T22:11:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.135+0000 7fc61aa42640 1 -- 172.21.15.50:0/1783687285 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc6140b35d0 con 0x7fc6140b66d0 2024-09-11T22:11:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.135+0000 7fc610ff9640 1 -- 172.21.15.50:0/1783687285 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7fc60c010040 con 0x7fc6140b66d0 2024-09-11T22:11:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:52.136 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:11:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:11:52.136 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:11:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:11:52.137 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:11:52.137 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:11:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.137+0000 7fc61aa42640 1 -- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc60006be60 msgr2=0x7fc60006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.137+0000 7fc61aa42640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc60006be60 0x7fc60006e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc604001760 tx=0x7fc604009040 comp rx=0 tx=0).stop 2024-09-11T22:11:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.137+0000 7fc61aa42640 1 -- 172.21.15.50:0/1783687285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b66d0 msgr2=0x7fc6141594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.137+0000 7fc61aa42640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b66d0 0x7fc6141594c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc61409bee0 tx=0x7fc60c00f580 comp rx=0 tx=0).stop 2024-09-11T22:11:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.137+0000 7fc61aa42640 1 -- 172.21.15.50:0/1783687285 shutdown_connections 2024-09-11T22:11:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.137+0000 7fc61aa42640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc60006be60 0x7fc60006e320 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.137+0000 7fc61aa42640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b66d0 0x7fc6141594c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.137+0000 7fc61aa42640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc61415a1b0 0x7fc614158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.137+0000 7fc61aa42640 1 --2- 172.21.15.50:0/1783687285 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5fc004800 0x7fc614153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.137+0000 7fc61aa42640 1 -- 172.21.15.50:0/1783687285 >> 172.21.15.50:0/1783687285 conn(0x7fc61409ba50 msgr2=0x7fc61406fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.137+0000 7fc61aa42640 1 -- 172.21.15.50:0/1783687285 shutdown_connections 2024-09-11T22:11:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.137+0000 7fc61aa42640 1 -- 172.21.15.50:0/1783687285 wait complete. 2024-09-11T22:11:52.149 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:11:52.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:11:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.256+0000 7f9987d42640 1 Processor -- start 2024-09-11T22:11:52.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.256+0000 7f9987d42640 1 -- start start 2024-09-11T22:11:52.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f9987d42640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f998015e8e0 0x7f99800b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:52.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f9987d42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9980162350 0x7f99801627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:52.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f9987d42640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9980163080 con 0x7f99800d1580 2024-09-11T22:11:52.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f9987d42640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f998015ecc0 con 0x7f998015e8e0 2024-09-11T22:11:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f9987d42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f99800d2ad0 con 0x7f9980162350 2024-09-11T22:11:52.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f99862df640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9980162350 0x7f99801627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:52.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f9985ade640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f998015e8e0 0x7f99800b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:52.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f99862df640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9980162350 0x7f99801627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:49962/0 (socket says 172.21.15.50:49962) 2024-09-11T22:11:52.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f99852dd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f99800d1580 0x7f99800d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:50306/0 (socket says 172.21.15.50:50306) 2024-09-11T22:11:52.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f99862df640 1 -- 172.21.15.50:0/1224989004 learned_addr learned my addr 172.21.15.50:0/1224989004 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:52.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f9985ade640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f998015e8e0 0x7f99800b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:60062/0 (socket says 172.21.15.50:60062) 2024-09-11T22:11:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f9984adc640 1 -- 172.21.15.50:0/1224989004 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2372954882 0 0) 0x7f9980163080 con 0x7f99800d1580 2024-09-11T22:11:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f99862df640 1 -- 172.21.15.50:0/1224989004 >> v2:172.21.15.77:3300/0 conn(0x7f998015e8e0 msgr2=0x7f99800b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f99862df640 1 --2- 172.21.15.50:0/1224989004 >> v2:172.21.15.77:3300/0 conn(0x7f998015e8e0 0x7f99800b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.257+0000 7f99862df640 1 -- 172.21.15.50:0/1224989004 >> v1:172.21.15.77:6789/0 conn(0x7f99800d1580 legacy=0x7f99800d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.258+0000 7f99862df640 1 -- 172.21.15.50:0/1224989004 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99800d2d20 con 0x7f9980162350 2024-09-11T22:11:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.258+0000 7f9985ade640 1 --2- 172.21.15.50:0/1224989004 >> v2:172.21.15.77:3300/0 conn(0x7f998015e8e0 0x7f99800b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.258+0000 7f99862df640 1 --2- 172.21.15.50:0/1224989004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9980162350 0x7f99801627e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9978009e50 tx=0x7f997802a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b5aacc1ee9de5d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.258+0000 7f9984adc640 1 -- 172.21.15.50:0/1224989004 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978036070 con 0x7f9980162350 2024-09-11T22:11:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.259+0000 7f9984adc640 1 -- 172.21.15.50:0/1224989004 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9978031600 con 0x7f9980162350 2024-09-11T22:11:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.259+0000 7f9984adc640 1 -- 172.21.15.50:0/1224989004 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99780319d0 con 0x7f9980162350 2024-09-11T22:11:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.259+0000 7f9987d42640 1 -- 172.21.15.50:0/1224989004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9980162350 msgr2=0x7f99801627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.259+0000 7f9987d42640 1 --2- 172.21.15.50:0/1224989004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9980162350 0x7f99801627e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9978009e50 tx=0x7f997802a7a0 comp rx=0 tx=0).stop 2024-09-11T22:11:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.259+0000 7f9987d42640 1 -- 172.21.15.50:0/1224989004 shutdown_connections 2024-09-11T22:11:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.259+0000 7f9987d42640 1 --2- 172.21.15.50:0/1224989004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9980162350 0x7f99801627e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.259+0000 7f9987d42640 1 --2- 172.21.15.50:0/1224989004 >> v2:172.21.15.77:3300/0 conn(0x7f998015e8e0 0x7f99800b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.259+0000 7f9987d42640 1 -- 172.21.15.50:0/1224989004 >> 172.21.15.50:0/1224989004 conn(0x7f9980067ba0 msgr2=0x7f9980067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.259+0000 7f9987d42640 1 -- 172.21.15.50:0/1224989004 shutdown_connections 2024-09-11T22:11:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.259+0000 7f9987d42640 1 -- 172.21.15.50:0/1224989004 wait complete. 2024-09-11T22:11:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.260+0000 7f9987d42640 1 Processor -- start 2024-09-11T22:11:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.260+0000 7f9987d42640 1 -- start start 2024-09-11T22:11:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.261+0000 7f9987d42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99800d1580 0x7f99801e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.261+0000 7f9987d42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998015e8e0 0x7f998015f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.261+0000 7f9987d42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9980162350 0x7f998015fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.261+0000 7f9987d42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9980162d20 con 0x7f99800d1580 2024-09-11T22:11:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.261+0000 7f9987d42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f99800d3370 con 0x7f998015e8e0 2024-09-11T22:11:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.261+0000 7f9987d42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f99800d3800 con 0x7f9980162350 2024-09-11T22:11:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.261+0000 7f9985ade640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99800d1580 0x7f99801e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.261+0000 7f9985ade640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99800d1580 0x7f99801e7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52864/0 (socket says 172.21.15.50:52864) 2024-09-11T22:11:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.261+0000 7f9985ade640 1 -- 172.21.15.50:0/1543424455 learned_addr learned my addr 172.21.15.50:0/1543424455 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.261+0000 7f99862df640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9980162350 0x7f998015fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.261+0000 7f99852dd640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998015e8e0 0x7f998015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.262+0000 7f9985ade640 1 -- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9980162350 msgr2=0x7f998015fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.262+0000 7f9985ade640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9980162350 0x7f998015fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.262+0000 7f9985ade640 1 -- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998015e8e0 msgr2=0x7f998015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.262+0000 7f9985ade640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998015e8e0 0x7f998015f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.262+0000 7f9985ade640 1 -- 172.21.15.50:0/1543424455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99800b6800 con 0x7f99800d1580 2024-09-11T22:11:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.262+0000 7f99862df640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9980162350 0x7f998015fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.262+0000 7f99852dd640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998015e8e0 0x7f998015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.262+0000 7f9985ade640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99800d1580 0x7f99801e7d90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f997c00ec10 tx=0x7f997c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.262+0000 7f99767fc640 1 -- 172.21.15.50:0/1543424455 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c017070 con 0x7f99800d1580 2024-09-11T22:11:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.262+0000 7f99767fc640 1 -- 172.21.15.50:0/1543424455 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997c00cc30 con 0x7f99800d1580 2024-09-11T22:11:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.262+0000 7f9987d42640 1 -- 172.21.15.50:0/1543424455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99800b6ae0 con 0x7f99800d1580 2024-09-11T22:11:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.262+0000 7f99767fc640 1 -- 172.21.15.50:0/1543424455 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c013470 con 0x7f99800d1580 2024-09-11T22:11:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.262+0000 7f9987d42640 1 -- 172.21.15.50:0/1543424455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99800b70a0 con 0x7f99800d1580 2024-09-11T22:11:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.263+0000 7f9987d42640 1 -- 172.21.15.50:0/1543424455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99801e94d0 con 0x7f99800d1580 2024-09-11T22:11:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.264+0000 7f99767fc640 1 -- 172.21.15.50:0/1543424455 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f997c01a070 con 0x7f99800d1580 2024-09-11T22:11:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.264+0000 7f99767fc640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f996406be60 0x7f996406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.264+0000 7f99767fc640 1 -- 172.21.15.50:0/1543424455 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f997c08ad90 con 0x7f99800d1580 2024-09-11T22:11:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.264+0000 7f99852dd640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f996406be60 0x7f996406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.265+0000 7f99852dd640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f996406be60 0x7f996406e320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f99800ce830 tx=0x7f9970009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:52.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.268+0000 7f99767fc640 1 -- 172.21.15.50:0/1543424455 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99801e94d0 con 0x7f99800d1580 2024-09-11T22:11:52.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:52.443+0000 7f9987d42640 1 -- 172.21.15.50:0/1543424455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f99800b7880 con 0x7f99800d1580 2024-09-11T22:11:53.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.210+0000 7f99767fc640 1 -- 172.21.15.50:0/1543424455 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f997c059a90 con 0x7f99800d1580 2024-09-11T22:11:53.211 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:11:53.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.213+0000 7f9987d42640 1 -- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f996406be60 msgr2=0x7f996406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:53.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.213+0000 7f9987d42640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f996406be60 0x7f996406e320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f99800ce830 tx=0x7f9970009040 comp rx=0 tx=0).stop 2024-09-11T22:11:53.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.213+0000 7f9987d42640 1 -- 172.21.15.50:0/1543424455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99800d1580 msgr2=0x7f99801e7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:53.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.213+0000 7f9987d42640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99800d1580 0x7f99801e7d90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f997c00ec10 tx=0x7f997c00c520 comp rx=0 tx=0).stop 2024-09-11T22:11:53.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.214+0000 7f9987d42640 1 -- 172.21.15.50:0/1543424455 shutdown_connections 2024-09-11T22:11:53.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.214+0000 7f9987d42640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f996406be60 0x7f996406e320 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:53.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.214+0000 7f9987d42640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9980162350 0x7f998015fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:53.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.214+0000 7f9987d42640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998015e8e0 0x7f998015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:53.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.214+0000 7f9987d42640 1 --2- 172.21.15.50:0/1543424455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99800d1580 0x7f99801e7d90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:53.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.214+0000 7f9987d42640 1 -- 172.21.15.50:0/1543424455 >> 172.21.15.50:0/1543424455 conn(0x7f9980067ba0 msgr2=0x7f9980067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:53.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.214+0000 7f9987d42640 1 -- 172.21.15.50:0/1543424455 shutdown_connections 2024-09-11T22:11:53.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.214+0000 7f9987d42640 1 -- 172.21.15.50:0/1543424455 wait complete. 2024-09-11T22:11:53.231 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:11:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.347+0000 7f377bf54640 1 Processor -- start 2024-09-11T22:11:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.347+0000 7f377bf54640 1 -- start start 2024-09-11T22:11:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f377bf54640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f377406e0f0 0x7f377406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f377bf54640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3774072e60 0x7f37740711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f377bf54640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f377415b7e0 con 0x7f377415b400 2024-09-11T22:11:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f377bf54640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f377415f140 con 0x7f377406e0f0 2024-09-11T22:11:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f377bf54640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f377415f420 con 0x7f3774072e60 2024-09-11T22:11:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f3779cf0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f377415b400 0x7f377406d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36784/0 (socket says 172.21.15.50:36784) 2024-09-11T22:11:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f3779cf0640 1 -- 172.21.15.50:0/3312247523 learned_addr learned my addr 172.21.15.50:0/3312247523 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f37794ef640 1 --2- 172.21.15.50:0/3312247523 >> v2:172.21.15.77:3300/0 conn(0x7f377406e0f0 0x7f377406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f377a4f1640 1 --2- 172.21.15.50:0/3312247523 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3774072e60 0x7f37740711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f3778cee640 1 -- 172.21.15.50:0/3312247523 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 191232478 0 0) 0x7f377415b7e0 con 0x7f377415b400 2024-09-11T22:11:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f3778cee640 1 -- 172.21.15.50:0/3312247523 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3760003520 con 0x7f377415b400 2024-09-11T22:11:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f37794ef640 1 -- 172.21.15.50:0/3312247523 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3774072e60 msgr2=0x7f37740711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f37794ef640 1 --2- 172.21.15.50:0/3312247523 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3774072e60 0x7f37740711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f37794ef640 1 -- 172.21.15.50:0/3312247523 >> v1:172.21.15.50:6789/0 conn(0x7f377415b400 legacy=0x7f377406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f37794ef640 1 -- 172.21.15.50:0/3312247523 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377415f700 con 0x7f377406e0f0 2024-09-11T22:11:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.348+0000 7f377a4f1640 1 --2- 172.21.15.50:0/3312247523 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3774072e60 0x7f37740711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.349+0000 7f37794ef640 1 --2- 172.21.15.50:0/3312247523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f377406e0f0 0x7f377406d070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f37640097a0 tx=0x7f376402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afd12357578cbf54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.349+0000 7f3778cee640 1 -- 172.21.15.50:0/3312247523 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764037070 con 0x7f377406e0f0 2024-09-11T22:11:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.349+0000 7f3778cee640 1 -- 172.21.15.50:0/3312247523 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3764032440 con 0x7f377406e0f0 2024-09-11T22:11:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.349+0000 7f3778cee640 1 -- 172.21.15.50:0/3312247523 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764032810 con 0x7f377406e0f0 2024-09-11T22:11:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.350+0000 7f377bf54640 1 -- 172.21.15.50:0/3312247523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f377406e0f0 msgr2=0x7f377406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.350+0000 7f377bf54640 1 --2- 172.21.15.50:0/3312247523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f377406e0f0 0x7f377406d070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f37640097a0 tx=0x7f376402a180 comp rx=0 tx=0).stop 2024-09-11T22:11:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.350+0000 7f377bf54640 1 -- 172.21.15.50:0/3312247523 shutdown_connections 2024-09-11T22:11:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.350+0000 7f377bf54640 1 --2- 172.21.15.50:0/3312247523 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3774072e60 0x7f37740711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.350+0000 7f377bf54640 1 --2- 172.21.15.50:0/3312247523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f377406e0f0 0x7f377406d070 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.350+0000 7f377bf54640 1 -- 172.21.15.50:0/3312247523 >> 172.21.15.50:0/3312247523 conn(0x7f37740679c0 msgr2=0x7f3774067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.350+0000 7f377bf54640 1 -- 172.21.15.50:0/3312247523 shutdown_connections 2024-09-11T22:11:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.350+0000 7f377bf54640 1 -- 172.21.15.50:0/3312247523 wait complete. 2024-09-11T22:11:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.351+0000 7f377bf54640 1 Processor -- start 2024-09-11T22:11:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.351+0000 7f377bf54640 1 -- start start 2024-09-11T22:11:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f377bf54640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f377406e0f0 0x7f37740aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f377bf54640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3774072e60 0x7f37741f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f377bf54640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f377415b400 0x7f37740b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f377bf54640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3774071700 con 0x7f3774072e60 2024-09-11T22:11:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f377bf54640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f37740cfc50 con 0x7f377415b400 2024-09-11T22:11:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f377bf54640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3774071880 con 0x7f377406e0f0 2024-09-11T22:11:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f37794ef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3774072e60 0x7f37741f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f37794ef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3774072e60 0x7f37741f1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52870/0 (socket says 172.21.15.50:52870) 2024-09-11T22:11:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f37794ef640 1 -- 172.21.15.50:0/3257471730 learned_addr learned my addr 172.21.15.50:0/3257471730 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f37794ef640 1 -- 172.21.15.50:0/3257471730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f377406e0f0 msgr2=0x7f37740aa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f37794ef640 1 --2- 172.21.15.50:0/3257471730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f377406e0f0 0x7f37740aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f37794ef640 1 -- 172.21.15.50:0/3257471730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f377415b400 msgr2=0x7f37740b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f37794ef640 1 --2- 172.21.15.50:0/3257471730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f377415b400 0x7f37740b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.352+0000 7f37794ef640 1 -- 172.21.15.50:0/3257471730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37740ab5a0 con 0x7f3774072e60 2024-09-11T22:11:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.353+0000 7f37794ef640 1 --2- 172.21.15.50:0/3257471730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3774072e60 0x7f37741f1f40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f37640098c0 tx=0x7f37640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.353+0000 7f376a7fc640 1 -- 172.21.15.50:0/3257471730 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764041030 con 0x7f3774072e60 2024-09-11T22:11:53.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.353+0000 7f376a7fc640 1 -- 172.21.15.50:0/3257471730 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376403d4e0 con 0x7f3774072e60 2024-09-11T22:11:53.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.353+0000 7f377bf54640 1 -- 172.21.15.50:0/3257471730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37740aad00 con 0x7f3774072e60 2024-09-11T22:11:53.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.353+0000 7f376a7fc640 1 -- 172.21.15.50:0/3257471730 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764037040 con 0x7f3774072e60 2024-09-11T22:11:53.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.353+0000 7f377bf54640 1 -- 172.21.15.50:0/3257471730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37740ab2c0 con 0x7f3774072e60 2024-09-11T22:11:53.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.354+0000 7f377bf54640 1 -- 172.21.15.50:0/3257471730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37740711c0 con 0x7f3774072e60 2024-09-11T22:11:53.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.354+0000 7f376a7fc640 1 -- 172.21.15.50:0/3257471730 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3764044070 con 0x7f3774072e60 2024-09-11T22:11:53.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.355+0000 7f376a7fc640 1 --2- 172.21.15.50:0/3257471730 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f375806be30 0x7f375806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:53.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.355+0000 7f376a7fc640 1 -- 172.21.15.50:0/3257471730 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7f37640ab2d0 con 0x7f3774072e60 2024-09-11T22:11:53.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.355+0000 7f3779cf0640 1 --2- 172.21.15.50:0/3257471730 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f375806be30 0x7f375806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:53.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.356+0000 7f3779cf0640 1 --2- 172.21.15.50:0/3257471730 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f375806be30 0x7f375806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3770000f60 tx=0x7f37700078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:53.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.360+0000 7f376a7fc640 1 -- 172.21.15.50:0/3257471730 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3764044e40 con 0x7f3774072e60 2024-09-11T22:11:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:53.537+0000 7f377bf54640 1 -- 172.21.15.50:0/3257471730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3774158550 con 0x7f3774072e60 2024-09-11T22:11:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.215+0000 7f376a7fc640 1 -- 172.21.15.50:0/3257471730 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7f3764079dd0 con 0x7f3774072e60 2024-09-11T22:11:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:11:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.219+0000 7f377bf54640 1 -- 172.21.15.50:0/3257471730 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f375806be30 msgr2=0x7f375806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.219+0000 7f377bf54640 1 --2- 172.21.15.50:0/3257471730 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f375806be30 0x7f375806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3770000f60 tx=0x7f37700078f0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.219+0000 7f377bf54640 1 -- 172.21.15.50:0/3257471730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3774072e60 msgr2=0x7f37741f1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.219+0000 7f377bf54640 1 --2- 172.21.15.50:0/3257471730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3774072e60 0x7f37741f1f40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f37640098c0 tx=0x7f37640046c0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.219+0000 7f377bf54640 1 -- 172.21.15.50:0/3257471730 shutdown_connections 2024-09-11T22:11:54.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.219+0000 7f377bf54640 1 --2- 172.21.15.50:0/3257471730 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f375806be30 0x7f375806e2f0 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3770000f60 tx=0x7f37700078f0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.219+0000 7f377bf54640 1 --2- 172.21.15.50:0/3257471730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f377415b400 0x7f37740b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.219+0000 7f377bf54640 1 --2- 172.21.15.50:0/3257471730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3774072e60 0x7f37741f1f40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.219+0000 7f377bf54640 1 --2- 172.21.15.50:0/3257471730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f377406e0f0 0x7f37740aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.219+0000 7f377bf54640 1 -- 172.21.15.50:0/3257471730 >> 172.21.15.50:0/3257471730 conn(0x7f37740679c0 msgr2=0x7f37740cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.224+0000 7f377bf54640 1 -- 172.21.15.50:0/3257471730 shutdown_connections 2024-09-11T22:11:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.224+0000 7f377bf54640 1 -- 172.21.15.50:0/3257471730 wait complete. 2024-09-11T22:11:54.248 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:11:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.358+0000 7f8a49b6d640 1 Processor -- start 2024-09-11T22:11:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.358+0000 7f8a49b6d640 1 -- start start 2024-09-11T22:11:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a49b6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a44161fa0 0x7f8a440b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a49b6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a440b1600 0x7f8a440cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a49b6d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a440cfbd0 con 0x7f8a440cf440 2024-09-11T22:11:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a49b6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8a440cdce0 con 0x7f8a44161fa0 2024-09-11T22:11:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a49b6d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8a440d1220 con 0x7f8a440b1600 2024-09-11T22:11:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a437fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a44161fa0 0x7f8a440b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a43fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8a440cf440 0x7f8a4406bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36790/0 (socket says 172.21.15.50:36790) 2024-09-11T22:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a437fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a44161fa0 0x7f8a440b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52884/0 (socket says 172.21.15.50:52884) 2024-09-11T22:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a43fff640 1 -- 172.21.15.50:0/4284778614 learned_addr learned my addr 172.21.15.50:0/4284778614 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a42ffd640 1 --2- 172.21.15.50:0/4284778614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a440b1600 0x7f8a440cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a437fe640 1 -- 172.21.15.50:0/4284778614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a440b1600 msgr2=0x7f8a440cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a437fe640 1 --2- 172.21.15.50:0/4284778614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a440b1600 0x7f8a440cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a437fe640 1 -- 172.21.15.50:0/4284778614 >> v1:172.21.15.50:6789/0 conn(0x7f8a440cf440 legacy=0x7f8a4406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.359+0000 7f8a437fe640 1 -- 172.21.15.50:0/4284778614 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a440cfeb0 con 0x7f8a44161fa0 2024-09-11T22:11:54.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.360+0000 7f8a437fe640 1 --2- 172.21.15.50:0/4284778614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a44161fa0 0x7f8a440b4d20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8a340097a0 tx=0x7f8a3402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b43309f434f10d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:54.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.360+0000 7f8a427fc640 1 -- 172.21.15.50:0/4284778614 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34037070 con 0x7f8a44161fa0 2024-09-11T22:11:54.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.360+0000 7f8a427fc640 1 -- 172.21.15.50:0/4284778614 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a34032440 con 0x7f8a44161fa0 2024-09-11T22:11:54.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.360+0000 7f8a427fc640 1 -- 172.21.15.50:0/4284778614 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34032810 con 0x7f8a44161fa0 2024-09-11T22:11:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.361+0000 7f8a49b6d640 1 -- 172.21.15.50:0/4284778614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a44161fa0 msgr2=0x7f8a440b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.361+0000 7f8a49b6d640 1 --2- 172.21.15.50:0/4284778614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a44161fa0 0x7f8a440b4d20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8a340097a0 tx=0x7f8a3402a180 comp rx=0 tx=0).stop 2024-09-11T22:11:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.361+0000 7f8a49b6d640 1 -- 172.21.15.50:0/4284778614 shutdown_connections 2024-09-11T22:11:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.361+0000 7f8a49b6d640 1 --2- 172.21.15.50:0/4284778614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a440b1600 0x7f8a440cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.361+0000 7f8a49b6d640 1 --2- 172.21.15.50:0/4284778614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a44161fa0 0x7f8a440b4d20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.361+0000 7f8a49b6d640 1 -- 172.21.15.50:0/4284778614 >> 172.21.15.50:0/4284778614 conn(0x7f8a4409ba50 msgr2=0x7f8a440b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.361+0000 7f8a49b6d640 1 -- 172.21.15.50:0/4284778614 shutdown_connections 2024-09-11T22:11:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.361+0000 7f8a49b6d640 1 -- 172.21.15.50:0/4284778614 wait complete. 2024-09-11T22:11:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.362+0000 7f8a49b6d640 1 Processor -- start 2024-09-11T22:11:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.362+0000 7f8a49b6d640 1 -- start start 2024-09-11T22:11:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.363+0000 7f8a49b6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a440b1600 0x7f8a441f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.363+0000 7f8a49b6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a440cf440 0x7f8a4415df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.363+0000 7f8a49b6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a44161fa0 0x7f8a440b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.363+0000 7f8a49b6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a440cf8f0 con 0x7f8a440cf440 2024-09-11T22:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.363+0000 7f8a49b6d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a440d17e0 con 0x7f8a440b1600 2024-09-11T22:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.363+0000 7f8a49b6d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8a44162380 con 0x7f8a44161fa0 2024-09-11T22:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.363+0000 7f8a42ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a440cf440 0x7f8a4415df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.363+0000 7f8a42ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a440cf440 0x7f8a4415df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52890/0 (socket says 172.21.15.50:52890) 2024-09-11T22:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.363+0000 7f8a42ffd640 1 -- 172.21.15.50:0/522018427 learned_addr learned my addr 172.21.15.50:0/522018427 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.363+0000 7f8a43fff640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a44161fa0 0x7f8a440b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.363+0000 7f8a437fe640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a440b1600 0x7f8a441f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.364+0000 7f8a42ffd640 1 -- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a44161fa0 msgr2=0x7f8a440b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.364+0000 7f8a42ffd640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a44161fa0 0x7f8a440b7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.364+0000 7f8a42ffd640 1 -- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a440b1600 msgr2=0x7f8a441f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.364+0000 7f8a42ffd640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a440b1600 0x7f8a441f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.364+0000 7f8a42ffd640 1 -- 172.21.15.50:0/522018427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a441f49b0 con 0x7f8a440cf440 2024-09-11T22:11:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.364+0000 7f8a42ffd640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a440cf440 0x7f8a4415df60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800d5d0 tx=0x7f8a3800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:54.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.364+0000 7f8a2bfff640 1 -- 172.21.15.50:0/522018427 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38004240 con 0x7f8a440cf440 2024-09-11T22:11:54.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.364+0000 7f8a2bfff640 1 -- 172.21.15.50:0/522018427 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a380043e0 con 0x7f8a440cf440 2024-09-11T22:11:54.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.364+0000 7f8a49b6d640 1 -- 172.21.15.50:0/522018427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a441f4c90 con 0x7f8a440cf440 2024-09-11T22:11:54.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.364+0000 7f8a2bfff640 1 -- 172.21.15.50:0/522018427 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38003830 con 0x7f8a440cf440 2024-09-11T22:11:54.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.364+0000 7f8a49b6d640 1 -- 172.21.15.50:0/522018427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a441f5250 con 0x7f8a440cf440 2024-09-11T22:11:54.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.365+0000 7f8a49b6d640 1 -- 172.21.15.50:0/522018427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a440d1c50 con 0x7f8a440cf440 2024-09-11T22:11:54.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.366+0000 7f8a2bfff640 1 -- 172.21.15.50:0/522018427 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a380039d0 con 0x7f8a440cf440 2024-09-11T22:11:54.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.366+0000 7f8a2bfff640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a3006be30 0x7f8a3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:54.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.366+0000 7f8a2bfff640 1 -- 172.21.15.50:0/522018427 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f8a3808af40 con 0x7f8a440cf440 2024-09-11T22:11:54.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.366+0000 7f8a437fe640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a3006be30 0x7f8a3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:54.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.367+0000 7f8a437fe640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a3006be30 0x7f8a3006e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8a34034000 tx=0x7f8a3402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:54.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.371+0000 7f8a2bfff640 1 -- 172.21.15.50:0/522018427 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a38059390 con 0x7f8a440cf440 2024-09-11T22:11:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:54.585+0000 7f8a49b6d640 1 -- 172.21.15.50:0/522018427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8a4406c670 con 0x7f8a440cf440 2024-09-11T22:11:55.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.217+0000 7f8a2bfff640 1 -- 172.21.15.50:0/522018427 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7f8a3805d690 con 0x7f8a440cf440 2024-09-11T22:11:55.218 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 4 and data pool 5 2024-09-11T22:11:55.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.221+0000 7f8a49b6d640 1 -- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a3006be30 msgr2=0x7f8a3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.221+0000 7f8a49b6d640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a3006be30 0x7f8a3006e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8a34034000 tx=0x7f8a3402e000 comp rx=0 tx=0).stop 2024-09-11T22:11:55.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.221+0000 7f8a49b6d640 1 -- 172.21.15.50:0/522018427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a440cf440 msgr2=0x7f8a4415df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.221+0000 7f8a49b6d640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a440cf440 0x7f8a4415df60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800d5d0 tx=0x7f8a3800da90 comp rx=0 tx=0).stop 2024-09-11T22:11:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.221+0000 7f8a49b6d640 1 -- 172.21.15.50:0/522018427 shutdown_connections 2024-09-11T22:11:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.221+0000 7f8a49b6d640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a3006be30 0x7f8a3006e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.221+0000 7f8a49b6d640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a44161fa0 0x7f8a440b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.221+0000 7f8a49b6d640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a440cf440 0x7f8a4415df60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.221+0000 7f8a49b6d640 1 --2- 172.21.15.50:0/522018427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a440b1600 0x7f8a441f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.221+0000 7f8a49b6d640 1 -- 172.21.15.50:0/522018427 >> 172.21.15.50:0/522018427 conn(0x7f8a4409ba50 msgr2=0x7f8a4406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.224+0000 7f8a49b6d640 1 -- 172.21.15.50:0/522018427 shutdown_connections 2024-09-11T22:11:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.226+0000 7f8a49b6d640 1 -- 172.21.15.50:0/522018427 wait complete. 2024-09-11T22:11:55.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.363+0000 7fab15318640 1 Processor -- start 2024-09-11T22:11:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.363+0000 7fab15318640 1 -- start start 2024-09-11T22:11:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab15318640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab1015c2c0 0x7fab100b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab15318640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fab100d05e0 0x7fab100ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab15318640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab100b4f00 con 0x7fab100b3e10 2024-09-11T22:11:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab15318640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fab100b4360 con 0x7fab100d05e0 2024-09-11T22:11:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab15318640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fab100b51c0 con 0x7fab1015c2c0 2024-09-11T22:11:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab07fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fab100b3e10 0x7fab100cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36794/0 (socket says 172.21.15.50:36794) 2024-09-11T22:11:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab07fff640 1 -- 172.21.15.50:0/1309340214 learned_addr learned my addr 172.21.15.50:0/1309340214 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911744235 0 0) 0x7fab100b4f00 con 0x7fab100b3e10 2024-09-11T22:11:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab0effd640 1 --2- 172.21.15.50:0/1309340214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab1015c2c0 0x7fab100b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faafc003520 con 0x7fab100b3e10 2024-09-11T22:11:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab0f7fe640 1 --2- 172.21.15.50:0/1309340214 >> v2:172.21.15.77:3300/0 conn(0x7fab100d05e0 0x7fab100ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2784596142 0 0) 0x7faafc003520 con 0x7fab100b3e10 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab1015c2c0 msgr2=0x7fab100b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab0e7fc640 1 --2- 172.21.15.50:0/1309340214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab1015c2c0 0x7fab100b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 >> v2:172.21.15.77:3300/0 conn(0x7fab100d05e0 msgr2=0x7fab100ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab0e7fc640 1 --2- 172.21.15.50:0/1309340214 >> v2:172.21.15.77:3300/0 conn(0x7fab100d05e0 0x7fab100ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab100b54a0 con 0x7fab100b3e10 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7faaf8001670 con 0x7fab100b3e10 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 >> v1:172.21.15.50:6789/0 conn(0x7fab100b3e10 legacy=0x7fab100cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.364+0000 7fab0e7fc640 1 --2- 172.21.15.50:0/1309340214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faafc0039b0 0x7faafc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.365+0000 7fab0e7fc640 1 --2- 172.21.15.50:0/1309340214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faafc004800 0x7faafc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.365+0000 7fab0e7fc640 1 --2- 172.21.15.50:0/1309340214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab1015c2c0 0x7faafc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.365+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fab100b4360 con 0x7faafc004800 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.365+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fab100b51c0 con 0x7faafc0039b0 2024-09-11T22:11:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.365+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faafc00b9c0 con 0x7fab1015c2c0 2024-09-11T22:11:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.365+0000 7fab07fff640 1 --2- 172.21.15.50:0/1309340214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faafc004800 0x7faafc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.365+0000 7fab0effd640 1 --2- 172.21.15.50:0/1309340214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faafc0039b0 0x7faafc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.365+0000 7fab0f7fe640 1 --2- 172.21.15.50:0/1309340214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab1015c2c0 0x7faafc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.365+0000 7fab07fff640 1 -- 172.21.15.50:0/1309340214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab1015c2c0 msgr2=0x7faafc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.365+0000 7fab07fff640 1 --2- 172.21.15.50:0/1309340214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab1015c2c0 0x7faafc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.365+0000 7fab07fff640 1 -- 172.21.15.50:0/1309340214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faafc0039b0 msgr2=0x7faafc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.365+0000 7fab07fff640 1 --2- 172.21.15.50:0/1309340214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faafc0039b0 0x7faafc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.365+0000 7fab07fff640 1 -- 172.21.15.50:0/1309340214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc003520 con 0x7faafc004800 2024-09-11T22:11:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.366+0000 7fab07fff640 1 --2- 172.21.15.50:0/1309340214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faafc004800 0x7faafc004c80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faaf800c210 tx=0x7faafc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9e7280d867dd9f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.366+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8007d50 con 0x7faafc004800 2024-09-11T22:11:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.366+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf8005ad0 con 0x7faafc004800 2024-09-11T22:11:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.366+0000 7fab0e7fc640 1 -- 172.21.15.50:0/1309340214 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8007070 con 0x7faafc004800 2024-09-11T22:11:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.366+0000 7fab15318640 1 -- 172.21.15.50:0/1309340214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faafc004800 msgr2=0x7faafc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.366+0000 7fab15318640 1 --2- 172.21.15.50:0/1309340214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faafc004800 0x7faafc004c80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faaf800c210 tx=0x7faafc005830 comp rx=0 tx=0).stop 2024-09-11T22:11:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.366+0000 7fab0f7fe640 1 -- 172.21.15.50:0/1309340214 reap_dead start 2024-09-11T22:11:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.367+0000 7fab15318640 1 -- 172.21.15.50:0/1309340214 shutdown_connections 2024-09-11T22:11:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.367+0000 7fab15318640 1 -- 172.21.15.50:0/1309340214 >> 172.21.15.50:0/1309340214 conn(0x7fab100679c0 msgr2=0x7fab10067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.367+0000 7fab15318640 1 -- 172.21.15.50:0/1309340214 shutdown_connections 2024-09-11T22:11:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.367+0000 7fab15318640 1 -- 172.21.15.50:0/1309340214 wait complete. 2024-09-11T22:11:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.368+0000 7fab15318640 1 Processor -- start 2024-09-11T22:11:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.368+0000 7fab15318640 1 -- start start 2024-09-11T22:11:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab15318640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faafc004800 0x7fab10156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab15318640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1015c8b0 0x7fab100ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab15318640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab1015a810 0x7fab1015ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab15318640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fab1006d070 con 0x7fab1015c8b0 2024-09-11T22:11:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab15318640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fab100ce200 con 0x7faafc004800 2024-09-11T22:11:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab15318640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fab1006d1f0 con 0x7fab1015a810 2024-09-11T22:11:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab07fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1015c8b0 0x7fab100ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab07fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1015c8b0 0x7fab100ce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52906/0 (socket says 172.21.15.50:52906) 2024-09-11T22:11:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab07fff640 1 -- 172.21.15.50:0/3664316921 learned_addr learned my addr 172.21.15.50:0/3664316921 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab0f7fe640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab1015a810 0x7fab1015ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab0effd640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faafc004800 0x7fab10156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab07fff640 1 -- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab1015a810 msgr2=0x7fab1015ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab07fff640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab1015a810 0x7fab1015ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab07fff640 1 -- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faafc004800 msgr2=0x7fab10156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab07fff640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faafc004800 0x7fab10156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab07fff640 1 -- 172.21.15.50:0/3664316921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1015cd10 con 0x7fab1015c8b0 2024-09-11T22:11:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab0effd640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faafc004800 0x7fab10156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab07fff640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1015c8b0 0x7fab100ce900 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faaf800c330 tx=0x7fab100b5670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab077fe640 1 -- 172.21.15.50:0/3664316921 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8001cb0 con 0x7fab1015c8b0 2024-09-11T22:11:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab077fe640 1 -- 172.21.15.50:0/3664316921 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf8043070 con 0x7fab1015c8b0 2024-09-11T22:11:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab15318640 1 -- 172.21.15.50:0/3664316921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab1015cfb0 con 0x7fab1015c8b0 2024-09-11T22:11:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab077fe640 1 -- 172.21.15.50:0/3664316921 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf80076a0 con 0x7fab1015c8b0 2024-09-11T22:11:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.369+0000 7fab15318640 1 -- 172.21.15.50:0/3664316921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab1015d570 con 0x7fab1015c8b0 2024-09-11T22:11:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.370+0000 7fab15318640 1 -- 172.21.15.50:0/3664316921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab1015c6a0 con 0x7fab1015c8b0 2024-09-11T22:11:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.371+0000 7fab077fe640 1 -- 172.21.15.50:0/3664316921 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faaf8033440 con 0x7fab1015c8b0 2024-09-11T22:11:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.372+0000 7fab077fe640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faaf006be60 0x7faaf006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.372+0000 7fab077fe640 1 -- 172.21.15.50:0/3664316921 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7faaf80ab330 con 0x7fab1015c8b0 2024-09-11T22:11:55.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.372+0000 7fab0effd640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faaf006be60 0x7faaf006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.372+0000 7fab0effd640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faaf006be60 0x7faaf006e320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fab00006d40 tx=0x7fab00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:55.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.376+0000 7fab077fe640 1 -- 172.21.15.50:0/3664316921 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faaf8079cf0 con 0x7fab1015c8b0 2024-09-11T22:11:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.552+0000 7fab15318640 1 -- 172.21.15.50:0/3664316921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab1015a430 con 0x7fab1015c8b0 2024-09-11T22:11:55.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.553+0000 7fab077fe640 1 -- 172.21.15.50:0/3664316921 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16706 (secure 0 0 0) 0x7faaf80795f0 con 0x7fab1015c8b0 2024-09-11T22:11:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:55.554 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":31,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:54.586869+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:52.474592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:53.568181+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:55.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.555+0000 7fab15318640 1 -- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faaf006be60 msgr2=0x7faaf006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.555+0000 7fab15318640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faaf006be60 0x7faaf006e320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fab00006d40 tx=0x7fab00008040 comp rx=0 tx=0).stop 2024-09-11T22:11:55.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.555+0000 7fab15318640 1 -- 172.21.15.50:0/3664316921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1015c8b0 msgr2=0x7fab100ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.555+0000 7fab15318640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1015c8b0 0x7fab100ce900 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faaf800c330 tx=0x7fab100b5670 comp rx=0 tx=0).stop 2024-09-11T22:11:55.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.555+0000 7fab15318640 1 -- 172.21.15.50:0/3664316921 shutdown_connections 2024-09-11T22:11:55.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.555+0000 7fab15318640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faaf006be60 0x7faaf006e320 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.555+0000 7fab15318640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab1015a810 0x7fab1015ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.555+0000 7fab15318640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab1015c8b0 0x7fab100ce900 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.555+0000 7fab15318640 1 --2- 172.21.15.50:0/3664316921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faafc004800 0x7fab10156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.555+0000 7fab15318640 1 -- 172.21.15.50:0/3664316921 >> 172.21.15.50:0/3664316921 conn(0x7fab100679c0 msgr2=0x7fab100b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:55.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.555+0000 7fab15318640 1 -- 172.21.15.50:0/3664316921 shutdown_connections 2024-09-11T22:11:55.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.555+0000 7fab15318640 1 -- 172.21.15.50:0/3664316921 wait complete. 2024-09-11T22:11:55.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.669+0000 7f6972ae6640 1 Processor -- start 2024-09-11T22:11:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.669+0000 7f6972ae6640 1 -- start start 2024-09-11T22:11:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f6972ae6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f696c15e840 0x7f696c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f6972ae6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f696c0cf580 0x7f696c06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f6972ae6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f696c0ce5f0 con 0x7f696c0cdd50 2024-09-11T22:11:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f6972ae6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f696c06c240 con 0x7f696c15e840 2024-09-11T22:11:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f6972ae6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f696c0d0470 con 0x7f696c0cf580 2024-09-11T22:11:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f696bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f696c0cdd50 0x7f696c0cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36804/0 (socket says 172.21.15.50:36804) 2024-09-11T22:11:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f696bfff640 1 -- 172.21.15.50:0/4118075139 learned_addr learned my addr 172.21.15.50:0/4118075139 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f6970882640 1 --2- 172.21.15.50:0/4118075139 >> v2:172.21.15.77:3300/0 conn(0x7f696c15e840 0x7f696c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f6971083640 1 --2- 172.21.15.50:0/4118075139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f696c0cf580 0x7f696c06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3676708146 0 0) 0x7f696c0ce5f0 con 0x7f696c0cdd50 2024-09-11T22:11:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f695c003520 con 0x7f696c0cdd50 2024-09-11T22:11:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3289872660 0 0) 0x7f695c003520 con 0x7f696c0cdd50 2024-09-11T22:11:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f696c0cf580 msgr2=0x7f696c06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f696b7fe640 1 --2- 172.21.15.50:0/4118075139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f696c0cf580 0x7f696c06c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 >> v2:172.21.15.77:3300/0 conn(0x7f696c15e840 msgr2=0x7f696c0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f696b7fe640 1 --2- 172.21.15.50:0/4118075139 >> v2:172.21.15.77:3300/0 conn(0x7f696c15e840 0x7f696c0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696c0ce310 con 0x7f696c0cdd50 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f6970882640 1 --2- 172.21.15.50:0/4118075139 >> v2:172.21.15.77:3300/0 conn(0x7f696c15e840 0x7f696c0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f6958001670 con 0x7f696c0cdd50 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.670+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 >> v1:172.21.15.50:6789/0 conn(0x7f696c0cdd50 legacy=0x7f696c0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f696b7fe640 1 --2- 172.21.15.50:0/4118075139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f695c0039b0 0x7f695c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f696b7fe640 1 --2- 172.21.15.50:0/4118075139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f696c0cf580 0x7f695c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f696b7fe640 1 --2- 172.21.15.50:0/4118075139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f695c004d40 0x7f695c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f696c06c240 con 0x7f695c0039b0 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f696c0d0470 con 0x7f695c004d40 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f695c00b9c0 con 0x7f696c0cf580 2024-09-11T22:11:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f6970882640 1 --2- 172.21.15.50:0/4118075139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f695c0039b0 0x7f695c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f696bfff640 1 --2- 172.21.15.50:0/4118075139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f696c0cf580 0x7f695c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f6971083640 1 --2- 172.21.15.50:0/4118075139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f695c004d40 0x7f695c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f6970882640 1 -- 172.21.15.50:0/4118075139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f696c0cf580 msgr2=0x7f695c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f6970882640 1 --2- 172.21.15.50:0/4118075139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f696c0cf580 0x7f695c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f6970882640 1 -- 172.21.15.50:0/4118075139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f695c004d40 msgr2=0x7f695c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f6970882640 1 --2- 172.21.15.50:0/4118075139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f695c004d40 0x7f695c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.671+0000 7f6970882640 1 -- 172.21.15.50:0/4118075139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695c003520 con 0x7f695c0039b0 2024-09-11T22:11:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.672+0000 7f6970882640 1 --2- 172.21.15.50:0/4118075139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f695c0039b0 0x7f695c003dd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6960009c90 tx=0x7f695c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35098092b18b1d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.672+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960036070 con 0x7f695c0039b0 2024-09-11T22:11:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.672+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6960031400 con 0x7f695c0039b0 2024-09-11T22:11:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.672+0000 7f696b7fe640 1 -- 172.21.15.50:0/4118075139 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960009860 con 0x7f695c0039b0 2024-09-11T22:11:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.672+0000 7f6972ae6640 1 -- 172.21.15.50:0/4118075139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f695c0039b0 msgr2=0x7f695c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.672+0000 7f6972ae6640 1 --2- 172.21.15.50:0/4118075139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f695c0039b0 0x7f695c003dd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6960009c90 tx=0x7f695c005830 comp rx=0 tx=0).stop 2024-09-11T22:11:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.672+0000 7f6971083640 1 -- 172.21.15.50:0/4118075139 reap_dead start 2024-09-11T22:11:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.672+0000 7f6972ae6640 1 -- 172.21.15.50:0/4118075139 shutdown_connections 2024-09-11T22:11:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.672+0000 7f6972ae6640 1 -- 172.21.15.50:0/4118075139 >> 172.21.15.50:0/4118075139 conn(0x7f696c0b4150 msgr2=0x7f696c0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.672+0000 7f6972ae6640 1 -- 172.21.15.50:0/4118075139 shutdown_connections 2024-09-11T22:11:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.673+0000 7f6972ae6640 1 -- 172.21.15.50:0/4118075139 wait complete. 2024-09-11T22:11:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.674+0000 7f6972ae6640 1 Processor -- start 2024-09-11T22:11:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.674+0000 7f6972ae6640 1 -- start start 2024-09-11T22:11:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6972ae6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f695c0039b0 0x7f696c1f8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6972ae6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c0b7c70 0x7f696c0c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6972ae6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f696c15c0e0 0x7f696c155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6972ae6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f696c15ec20 con 0x7f695c0039b0 2024-09-11T22:11:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6972ae6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f696c06bed0 con 0x7f696c0b7c70 2024-09-11T22:11:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6972ae6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f696c15eda0 con 0x7f696c15c0e0 2024-09-11T22:11:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6970882640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f695c0039b0 0x7f696c1f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6970882640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f695c0039b0 0x7f696c1f8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52922/0 (socket says 172.21.15.50:52922) 2024-09-11T22:11:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6970882640 1 -- 172.21.15.50:0/4162282845 learned_addr learned my addr 172.21.15.50:0/4162282845 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6971083640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f696c15c0e0 0x7f696c155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f696bfff640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c0b7c70 0x7f696c0c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6970882640 1 -- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f696c15c0e0 msgr2=0x7f696c155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6970882640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f696c15c0e0 0x7f696c155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6970882640 1 -- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c0b7c70 msgr2=0x7f696c0c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6970882640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c0b7c70 0x7f696c0c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6970882640 1 -- 172.21.15.50:0/4162282845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696c1f8b50 con 0x7f695c0039b0 2024-09-11T22:11:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6970882640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f695c0039b0 0x7f696c1f8610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6960000c00 tx=0x7f6960004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f69697fa640 1 -- 172.21.15.50:0/4162282845 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960040070 con 0x7f695c0039b0 2024-09-11T22:11:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f69697fa640 1 -- 172.21.15.50:0/4162282845 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696003b680 con 0x7f695c0039b0 2024-09-11T22:11:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6972ae6640 1 -- 172.21.15.50:0/4162282845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696c0b84d0 con 0x7f695c0039b0 2024-09-11T22:11:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f69697fa640 1 -- 172.21.15.50:0/4162282845 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960036040 con 0x7f695c0039b0 2024-09-11T22:11:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.675+0000 7f6972ae6640 1 -- 172.21.15.50:0/4162282845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f696c0b54f0 con 0x7f695c0039b0 2024-09-11T22:11:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.677+0000 7f6972ae6640 1 -- 172.21.15.50:0/4162282845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f696c0b4c70 con 0x7f695c0039b0 2024-09-11T22:11:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.677+0000 7f69697fa640 1 -- 172.21.15.50:0/4162282845 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6960043070 con 0x7f695c0039b0 2024-09-11T22:11:55.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.678+0000 7f69697fa640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f695006be60 0x7f695006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.678+0000 7f69697fa640 1 -- 172.21.15.50:0/4162282845 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f69600ab440 con 0x7f695c0039b0 2024-09-11T22:11:55.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.678+0000 7f696bfff640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f695006be60 0x7f695006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.678+0000 7f696bfff640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f695006be60 0x7f695006e320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f696c0b40e0 tx=0x7f69580078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:55.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.682+0000 7f69697fa640 1 -- 172.21.15.50:0/4162282845 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f696c1f8b50 con 0x7f695c0039b0 2024-09-11T22:11:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.859+0000 7f6972ae6640 1 -- 172.21.15.50:0/4162282845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f696c0b4560 con 0x7f695c0039b0 2024-09-11T22:11:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.860+0000 7f69697fa640 1 -- 172.21.15.50:0/4162282845 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16706 (secure 0 0 0) 0x7f6960079710 con 0x7f695c0039b0 2024-09-11T22:11:55.861 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:55.861 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":31,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:54.586869+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:52.474592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:53.568181+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.862+0000 7f6972ae6640 1 -- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f695006be60 msgr2=0x7f695006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.862+0000 7f6972ae6640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f695006be60 0x7f695006e320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f696c0b40e0 tx=0x7f69580078f0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.862+0000 7f6972ae6640 1 -- 172.21.15.50:0/4162282845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f695c0039b0 msgr2=0x7f696c1f8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.862+0000 7f6972ae6640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f695c0039b0 0x7f696c1f8610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6960000c00 tx=0x7f6960004730 comp rx=0 tx=0).stop 2024-09-11T22:11:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.862+0000 7f6972ae6640 1 -- 172.21.15.50:0/4162282845 shutdown_connections 2024-09-11T22:11:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.862+0000 7f6972ae6640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f695006be60 0x7f695006e320 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.862+0000 7f6972ae6640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f696c15c0e0 0x7f696c155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.862+0000 7f6972ae6640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c0b7c70 0x7f696c0c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.862+0000 7f6972ae6640 1 --2- 172.21.15.50:0/4162282845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f695c0039b0 0x7f696c1f8610 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.862+0000 7f6972ae6640 1 -- 172.21.15.50:0/4162282845 >> 172.21.15.50:0/4162282845 conn(0x7f696c0b4150 msgr2=0x7f696c070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.862+0000 7f6972ae6640 1 -- 172.21.15.50:0/4162282845 shutdown_connections 2024-09-11T22:11:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.862+0000 7f6972ae6640 1 -- 172.21.15.50:0/4162282845 wait complete. 2024-09-11T22:11:55.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:11:55.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.980+0000 7fe535759640 1 Processor -- start 2024-09-11T22:11:55.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.980+0000 7fe535759640 1 -- start start 2024-09-11T22:11:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe535759640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5300d18a0 0x7fe5300d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe535759640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5300d3a30 0x7fe5300b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe535759640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5300cfa80 con 0x7fe53015e870 2024-09-11T22:11:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe535759640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe5300d3ea0 con 0x7fe5300d3a30 2024-09-11T22:11:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe535759640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe5300d40d0 con 0x7fe5300d18a0 2024-09-11T22:11:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe52f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5300d3a30 0x7fe5300b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe52effd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe53015e870 0x7fe5300d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36814/0 (socket says 172.21.15.50:36814) 2024-09-11T22:11:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe52f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5300d3a30 0x7fe5300b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52926/0 (socket says 172.21.15.50:52926) 2024-09-11T22:11:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe52effd640 1 -- 172.21.15.50:0/796817716 learned_addr learned my addr 172.21.15.50:0/796817716 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe52e7fc640 1 --2- 172.21.15.50:0/796817716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5300d18a0 0x7fe5300d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe52f7fe640 1 -- 172.21.15.50:0/796817716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5300d18a0 msgr2=0x7fe5300d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe52f7fe640 1 --2- 172.21.15.50:0/796817716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5300d18a0 0x7fe5300d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe52f7fe640 1 -- 172.21.15.50:0/796817716 >> v1:172.21.15.50:6789/0 conn(0x7fe53015e870 legacy=0x7fe5300d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe52f7fe640 1 -- 172.21.15.50:0/796817716 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5300d43b0 con 0x7fe5300d3a30 2024-09-11T22:11:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.981+0000 7fe52dffb640 1 -- 172.21.15.50:0/796817716 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232913897 0 0) 0x7fe520001110 con 0x7fe53015e870 2024-09-11T22:11:55.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.982+0000 7fe52f7fe640 1 --2- 172.21.15.50:0/796817716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300d3a30 0x7fe5300b8400 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe5280097a0 tx=0x7fe52802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94afb2b2e374c74 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:55.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.982+0000 7fe52dffb640 1 -- 172.21.15.50:0/796817716 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe528037070 con 0x7fe5300d3a30 2024-09-11T22:11:55.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.982+0000 7fe52dffb640 1 -- 172.21.15.50:0/796817716 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe528032440 con 0x7fe5300d3a30 2024-09-11T22:11:55.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.982+0000 7fe52dffb640 1 -- 172.21.15.50:0/796817716 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe528032810 con 0x7fe5300d3a30 2024-09-11T22:11:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.983+0000 7fe535759640 1 -- 172.21.15.50:0/796817716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300d3a30 msgr2=0x7fe5300b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.983+0000 7fe535759640 1 --2- 172.21.15.50:0/796817716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300d3a30 0x7fe5300b8400 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe5280097a0 tx=0x7fe52802a180 comp rx=0 tx=0).stop 2024-09-11T22:11:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.983+0000 7fe535759640 1 -- 172.21.15.50:0/796817716 shutdown_connections 2024-09-11T22:11:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.983+0000 7fe535759640 1 --2- 172.21.15.50:0/796817716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300d3a30 0x7fe5300b8400 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.983+0000 7fe535759640 1 --2- 172.21.15.50:0/796817716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5300d18a0 0x7fe5300d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.983+0000 7fe535759640 1 -- 172.21.15.50:0/796817716 >> 172.21.15.50:0/796817716 conn(0x7fe5300727a0 msgr2=0x7fe5300679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.983+0000 7fe535759640 1 -- 172.21.15.50:0/796817716 shutdown_connections 2024-09-11T22:11:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.983+0000 7fe535759640 1 -- 172.21.15.50:0/796817716 wait complete. 2024-09-11T22:11:55.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.984+0000 7fe535759640 1 Processor -- start 2024-09-11T22:11:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.984+0000 7fe535759640 1 -- start start 2024-09-11T22:11:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe535759640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300d18a0 0x7fe5301f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe535759640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5300d3a30 0x7fe5301f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe535759640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015e870 0x7fe53015d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe535759640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe53015ec50 con 0x7fe5300d18a0 2024-09-11T22:11:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe535759640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe5300b7ee0 con 0x7fe53015e870 2024-09-11T22:11:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe535759640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe5300b78b0 con 0x7fe5300d3a30 2024-09-11T22:11:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe52effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300d18a0 0x7fe5301f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe52effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300d18a0 0x7fe5301f77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52930/0 (socket says 172.21.15.50:52930) 2024-09-11T22:11:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe52effd640 1 -- 172.21.15.50:0/3177179069 learned_addr learned my addr 172.21.15.50:0/3177179069 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe52e7fc640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5300d3a30 0x7fe5301f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe52f7fe640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015e870 0x7fe53015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe52effd640 1 -- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5300d3a30 msgr2=0x7fe5301f48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe52effd640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5300d3a30 0x7fe5301f48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe52effd640 1 -- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015e870 msgr2=0x7fe53015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe52effd640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015e870 0x7fe53015d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.985+0000 7fe52effd640 1 -- 172.21.15.50:0/3177179069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe530157a20 con 0x7fe5300d18a0 2024-09-11T22:11:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.986+0000 7fe52effd640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300d18a0 0x7fe5301f77a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe52000c780 tx=0x7fe52000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.986+0000 7fe5177fe640 1 -- 172.21.15.50:0/3177179069 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe520018070 con 0x7fe5300d18a0 2024-09-11T22:11:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.986+0000 7fe5177fe640 1 -- 172.21.15.50:0/3177179069 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5200072d0 con 0x7fe5300d18a0 2024-09-11T22:11:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.986+0000 7fe535759640 1 -- 172.21.15.50:0/3177179069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5300c9cf0 con 0x7fe5300d18a0 2024-09-11T22:11:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.986+0000 7fe5177fe640 1 -- 172.21.15.50:0/3177179069 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5200047e0 con 0x7fe5300d18a0 2024-09-11T22:11:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.986+0000 7fe535759640 1 -- 172.21.15.50:0/3177179069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe53015de30 con 0x7fe5300d18a0 2024-09-11T22:11:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.987+0000 7fe535759640 1 -- 172.21.15.50:0/3177179069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5300d34f0 con 0x7fe5300d18a0 2024-09-11T22:11:55.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.987+0000 7fe5177fe640 1 -- 172.21.15.50:0/3177179069 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe52001b070 con 0x7fe5300d18a0 2024-09-11T22:11:55.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.988+0000 7fe5177fe640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe51c06be30 0x7fe51c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:55.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.988+0000 7fe5177fe640 1 -- 172.21.15.50:0/3177179069 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe52008a090 con 0x7fe5300d18a0 2024-09-11T22:11:55.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.988+0000 7fe52e7fc640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe51c06be30 0x7fe51c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:55.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.989+0000 7fe52e7fc640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe51c06be30 0x7fe51c06e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe5300cf4e0 tx=0x7fe524003990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:55.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:55.992+0000 7fe5177fe640 1 -- 172.21.15.50:0/3177179069 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5300cfa80 con 0x7fe5300d18a0 2024-09-11T22:11:56.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.204+0000 7fe535759640 1 -- 172.21.15.50:0/3177179069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe5300b67f0 con 0x7fe5300d18a0 2024-09-11T22:11:56.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.973+0000 7fe5177fe640 1 -- 172.21.15.50:0/3177179069 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7fe520058ad0 con 0x7fe5300d18a0 2024-09-11T22:11:56.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.976+0000 7fe535759640 1 -- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe51c06be30 msgr2=0x7fe51c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:56.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.976+0000 7fe535759640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe51c06be30 0x7fe51c06e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe5300cf4e0 tx=0x7fe524003990 comp rx=0 tx=0).stop 2024-09-11T22:11:56.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.976+0000 7fe535759640 1 -- 172.21.15.50:0/3177179069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300d18a0 msgr2=0x7fe5301f77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:56.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.976+0000 7fe535759640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300d18a0 0x7fe5301f77a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe52000c780 tx=0x7fe52000cc40 comp rx=0 tx=0).stop 2024-09-11T22:11:56.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.977+0000 7fe535759640 1 -- 172.21.15.50:0/3177179069 shutdown_connections 2024-09-11T22:11:56.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.977+0000 7fe535759640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe51c06be30 0x7fe51c06e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.977+0000 7fe535759640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5300d3a30 0x7fe5301f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.977+0000 7fe535759640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015e870 0x7fe53015d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.977+0000 7fe535759640 1 --2- 172.21.15.50:0/3177179069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300d18a0 0x7fe5301f77a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:56.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.977+0000 7fe535759640 1 -- 172.21.15.50:0/3177179069 >> 172.21.15.50:0/3177179069 conn(0x7fe5300727a0 msgr2=0x7fe5300d4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:56.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.977+0000 7fe535759640 1 -- 172.21.15.50:0/3177179069 shutdown_connections 2024-09-11T22:11:56.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:56.977+0000 7fe535759640 1 -- 172.21.15.50:0/3177179069 wait complete. 2024-09-11T22:11:56.991 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:11:56.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:11:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.102+0000 7fbf070e6640 1 Processor -- start 2024-09-11T22:11:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.102+0000 7fbf070e6640 1 -- start start 2024-09-11T22:11:57.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.103+0000 7fbf070e6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf000d1c90 0x7fbf000b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.103+0000 7fbf070e6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf00163080 con 0x7fbf00162350 2024-09-11T22:11:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.103+0000 7fbf070e6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf000d2d20 con 0x7fbf0015e8e0 2024-09-11T22:11:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.103+0000 7fbf070e6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0015ecc0 con 0x7fbf000d1c90 2024-09-11T22:11:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.103+0000 7fbf05683640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbf00162350 0x7fbf001627e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36816/0 (socket says 172.21.15.50:36816) 2024-09-11T22:11:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.103+0000 7fbf05683640 1 -- 172.21.15.50:0/1437039083 learned_addr learned my addr 172.21.15.50:0/1437039083 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.103+0000 7fbefffff640 1 --2- 172.21.15.50:0/1437039083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf000d1c90 0x7fbf000b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.103+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 753047795 0 0) 0x7fbf00163080 con 0x7fbf00162350 2024-09-11T22:11:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.103+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbee8003520 con 0x7fbf00162350 2024-09-11T22:11:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3028419367 0 0) 0x7fbf000d2d20 con 0x7fbf0015e8e0 2024-09-11T22:11:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf00163080 con 0x7fbf0015e8e0 2024-09-11T22:11:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2756453220 0 0) 0x7fbee8003520 con 0x7fbf00162350 2024-09-11T22:11:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf000d1c90 msgr2=0x7fbf000b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 --2- 172.21.15.50:0/1437039083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf000d1c90 0x7fbf000b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 >> v1:172.21.15.77:6789/0 conn(0x7fbf0015e8e0 legacy=0x7fbf000d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf000d3000 con 0x7fbf00162350 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fbef80019f0 con 0x7fbf00162350 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 >> v1:172.21.15.50:6789/0 conn(0x7fbf00162350 legacy=0x7fbf001627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 --2- 172.21.15.50:0/1437039083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee8003b70 0x7fbee8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 --2- 172.21.15.50:0/1437039083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf000d1c90 0x7fbee8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 --2- 172.21.15.50:0/1437039083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee8004d40 0x7fbee80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbee800ba70 con 0x7fbee8004d40 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbee800bbf0 con 0x7fbee8003b70 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbee800bdf0 con 0x7fbf000d1c90 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbf05683640 1 --2- 172.21.15.50:0/1437039083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee8004d40 0x7fbee80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbefffff640 1 --2- 172.21.15.50:0/1437039083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf000d1c90 0x7fbee8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:57.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbf04e82640 1 --2- 172.21.15.50:0/1437039083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee8003b70 0x7fbee8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbf05683640 1 -- 172.21.15.50:0/1437039083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf000d1c90 msgr2=0x7fbee8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbf05683640 1 --2- 172.21.15.50:0/1437039083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf000d1c90 0x7fbee8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbf05683640 1 -- 172.21.15.50:0/1437039083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee8003b70 msgr2=0x7fbee8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbf05683640 1 --2- 172.21.15.50:0/1437039083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee8003b70 0x7fbee8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.104+0000 7fbf05683640 1 -- 172.21.15.50:0/1437039083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee8003520 con 0x7fbee8004d40 2024-09-11T22:11:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.105+0000 7fbf05683640 1 --2- 172.21.15.50:0/1437039083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee8004d40 0x7fbee80051c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbef800a7f0 tx=0x7fbee8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d25283a50788b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.105+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef800a410 con 0x7fbee8004d40 2024-09-11T22:11:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.105+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef802f070 con 0x7fbee8004d40 2024-09-11T22:11:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.105+0000 7fbeff7fe640 1 -- 172.21.15.50:0/1437039083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef802bc30 con 0x7fbee8004d40 2024-09-11T22:11:57.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.106+0000 7fbf070e6640 1 -- 172.21.15.50:0/1437039083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee8004d40 msgr2=0x7fbee80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:57.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.106+0000 7fbf070e6640 1 --2- 172.21.15.50:0/1437039083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee8004d40 0x7fbee80051c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbef800a7f0 tx=0x7fbee8005830 comp rx=0 tx=0).stop 2024-09-11T22:11:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.106+0000 7fbf05683640 1 -- 172.21.15.50:0/1437039083 reap_dead start 2024-09-11T22:11:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.106+0000 7fbf070e6640 1 -- 172.21.15.50:0/1437039083 shutdown_connections 2024-09-11T22:11:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.106+0000 7fbf070e6640 1 -- 172.21.15.50:0/1437039083 >> 172.21.15.50:0/1437039083 conn(0x7fbf00067ba0 msgr2=0x7fbf00067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.106+0000 7fbf070e6640 1 -- 172.21.15.50:0/1437039083 shutdown_connections 2024-09-11T22:11:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.106+0000 7fbf070e6640 1 -- 172.21.15.50:0/1437039083 wait complete. 2024-09-11T22:11:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.107+0000 7fbf070e6640 1 Processor -- start 2024-09-11T22:11:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.107+0000 7fbf070e6640 1 -- start start 2024-09-11T22:11:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf070e6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee8004d40 0x7fbf001f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf070e6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf001f52a0 0x7fbf000d4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf070e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf001f6e90 0x7fbf000cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf070e6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbf000b7c10 con 0x7fbf001f6e90 2024-09-11T22:11:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf070e6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbf000b7a90 con 0x7fbee8004d40 2024-09-11T22:11:57.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf070e6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbf000d2ad0 con 0x7fbf001f52a0 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf05683640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf001f6e90 0x7fbf000cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf04e82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee8004d40 0x7fbf001f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf05683640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf001f6e90 0x7fbf000cda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52948/0 (socket says 172.21.15.50:52948) 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf05683640 1 -- 172.21.15.50:0/3208772028 learned_addr learned my addr 172.21.15.50:0/3208772028 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbefffff640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf001f52a0 0x7fbf000d4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf05683640 1 -- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf001f52a0 msgr2=0x7fbf000d4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf05683640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf001f52a0 0x7fbf000d4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf05683640 1 -- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee8004d40 msgr2=0x7fbf001f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf05683640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee8004d40 0x7fbf001f40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf05683640 1 -- 172.21.15.50:0/3208772028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf000d5430 con 0x7fbf001f6e90 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.108+0000 7fbf04e82640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee8004d40 0x7fbf001f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.109+0000 7fbf05683640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf001f6e90 0x7fbf000cda90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbef802b4a0 tx=0x7fbf000b77d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.109+0000 7fbefd7fa640 1 -- 172.21.15.50:0/3208772028 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8044070 con 0x7fbf001f6e90 2024-09-11T22:11:57.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.109+0000 7fbefd7fa640 1 -- 172.21.15.50:0/3208772028 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef8034470 con 0x7fbf001f6e90 2024-09-11T22:11:57.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.109+0000 7fbf070e6640 1 -- 172.21.15.50:0/3208772028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf001f46f0 con 0x7fbf001f6e90 2024-09-11T22:11:57.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.109+0000 7fbefd7fa640 1 -- 172.21.15.50:0/3208772028 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef800a410 con 0x7fbf001f6e90 2024-09-11T22:11:57.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.109+0000 7fbf070e6640 1 -- 172.21.15.50:0/3208772028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf001f4cb0 con 0x7fbf001f6e90 2024-09-11T22:11:57.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.110+0000 7fbf070e6640 1 -- 172.21.15.50:0/3208772028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf000d1580 con 0x7fbf001f6e90 2024-09-11T22:11:57.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.110+0000 7fbefd7fa640 1 -- 172.21.15.50:0/3208772028 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbef8047070 con 0x7fbf001f6e90 2024-09-11T22:11:57.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.111+0000 7fbefd7fa640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbeec06be30 0x7fbeec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:57.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.111+0000 7fbefd7fa640 1 -- 172.21.15.50:0/3208772028 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fbef80aadd0 con 0x7fbf001f6e90 2024-09-11T22:11:57.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.111+0000 7fbf04e82640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbeec06be30 0x7fbeec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:57.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.112+0000 7fbf04e82640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbeec06be30 0x7fbeec06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbef0001cc0 tx=0x7fbef0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.115+0000 7fbefd7fa640 1 -- 172.21.15.50:0/3208772028 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbef8079840 con 0x7fbf001f6e90 2024-09-11T22:11:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:57.326+0000 7fbf070e6640 1 -- 172.21.15.50:0/3208772028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbf000ba770 con 0x7fbf001f6e90 2024-09-11T22:11:58.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.238+0000 7fbefd7fa640 1 -- 172.21.15.50:0/3208772028 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fbef80ac070 con 0x7fbf001f6e90 2024-09-11T22:11:58.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.241+0000 7fbf070e6640 1 -- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbeec06be30 msgr2=0x7fbeec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.241+0000 7fbf070e6640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbeec06be30 0x7fbeec06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbef0001cc0 tx=0x7fbef0009040 comp rx=0 tx=0).stop 2024-09-11T22:11:58.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.241+0000 7fbf070e6640 1 -- 172.21.15.50:0/3208772028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf001f6e90 msgr2=0x7fbf000cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.241+0000 7fbf070e6640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf001f6e90 0x7fbf000cda90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbef802b4a0 tx=0x7fbf000b77d0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.241+0000 7fbf070e6640 1 -- 172.21.15.50:0/3208772028 shutdown_connections 2024-09-11T22:11:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.241+0000 7fbf070e6640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbeec06be30 0x7fbeec06e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.241+0000 7fbf070e6640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf001f52a0 0x7fbf000d4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.241+0000 7fbf070e6640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf001f6e90 0x7fbf000cda90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.241+0000 7fbf070e6640 1 --2- 172.21.15.50:0/3208772028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee8004d40 0x7fbf001f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.241+0000 7fbf070e6640 1 -- 172.21.15.50:0/3208772028 >> 172.21.15.50:0/3208772028 conn(0x7fbf00067ba0 msgr2=0x7fbf000b5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.242+0000 7fbf070e6640 1 -- 172.21.15.50:0/3208772028 shutdown_connections 2024-09-11T22:11:58.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.242+0000 7fbf070e6640 1 -- 172.21.15.50:0/3208772028 wait complete. 2024-09-11T22:11:58.256 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:11:58.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:11:58.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.364+0000 7f6988d52640 1 Processor -- start 2024-09-11T22:11:58.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.364+0000 7f6988d52640 1 -- start start 2024-09-11T22:11:58.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.365+0000 7f6988d52640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6984162a60 0x7f69840b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.365+0000 7f6988d52640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6984163080 con 0x7f69840d1c90 2024-09-11T22:11:58.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.365+0000 7f6988d52640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69840d2d20 con 0x7f698415e8e0 2024-09-11T22:11:58.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.365+0000 7f6988d52640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f698415ecc0 con 0x7f6984162a60 2024-09-11T22:11:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.365+0000 7f6981d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f69840d1c90 0x7f6984162350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35722/0 (socket says 172.21.15.50:35722) 2024-09-11T22:11:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.365+0000 7f6981d9b640 1 -- 172.21.15.50:0/1761272605 learned_addr learned my addr 172.21.15.50:0/1761272605 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.365+0000 7f6982d9d640 1 --2- 172.21.15.50:0/1761272605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6984162a60 0x7f69840b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.365+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3241399389 0 0) 0x7f6984163080 con 0x7f69840d1c90 2024-09-11T22:11:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f696c003520 con 0x7f69840d1c90 2024-09-11T22:11:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4010222360 0 0) 0x7f696c003520 con 0x7f69840d1c90 2024-09-11T22:11:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6984162a60 msgr2=0x7f69840b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 --2- 172.21.15.50:0/1761272605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6984162a60 0x7f69840b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 >> v1:172.21.15.77:6789/0 conn(0x7f698415e8e0 legacy=0x7f69840d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69840d3000 con 0x7f69840d1c90 2024-09-11T22:11:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f6978001670 con 0x7f69840d1c90 2024-09-11T22:11:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 >> v1:172.21.15.50:6789/0 conn(0x7f69840d1c90 legacy=0x7f6984162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 --2- 172.21.15.50:0/1761272605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6984162a60 0x7f696c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 --2- 172.21.15.50:0/1761272605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f696c003f20 0x7f696c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 --2- 172.21.15.50:0/1761272605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c004d40 0x7f696c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f696c00b9f0 con 0x7f696c003f20 2024-09-11T22:11:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f696c00bba0 con 0x7f696c004d40 2024-09-11T22:11:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f696c00bda0 con 0x7f6984162a60 2024-09-11T22:11:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f6981d9b640 1 --2- 172.21.15.50:0/1761272605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f696c003f20 0x7f696c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f698259c640 1 --2- 172.21.15.50:0/1761272605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6984162a60 0x7f696c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f6982d9d640 1 --2- 172.21.15.50:0/1761272605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c004d40 0x7f696c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f6981d9b640 1 -- 172.21.15.50:0/1761272605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6984162a60 msgr2=0x7f696c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f6981d9b640 1 --2- 172.21.15.50:0/1761272605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6984162a60 0x7f696c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f6981d9b640 1 -- 172.21.15.50:0/1761272605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c004d40 msgr2=0x7f696c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f6981d9b640 1 --2- 172.21.15.50:0/1761272605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c004d40 0x7f696c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.366+0000 7f6981d9b640 1 -- 172.21.15.50:0/1761272605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696c003520 con 0x7f696c003f20 2024-09-11T22:11:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.367+0000 7f6981d9b640 1 --2- 172.21.15.50:0/1761272605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f696c003f20 0x7f696c004800 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f697800c210 tx=0x7f696c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc54767fa913a33 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.367+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6978007ce0 con 0x7f696c003f20 2024-09-11T22:11:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.367+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6978005af0 con 0x7f696c003f20 2024-09-11T22:11:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.367+0000 7f698159a640 1 -- 172.21.15.50:0/1761272605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6978007070 con 0x7f696c003f20 2024-09-11T22:11:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.368+0000 7f6988d52640 1 -- 172.21.15.50:0/1761272605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f696c003f20 msgr2=0x7f696c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.368+0000 7f6988d52640 1 --2- 172.21.15.50:0/1761272605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f696c003f20 0x7f696c004800 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f697800c210 tx=0x7f696c005830 comp rx=0 tx=0).stop 2024-09-11T22:11:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.368+0000 7f6982d9d640 1 -- 172.21.15.50:0/1761272605 reap_dead start 2024-09-11T22:11:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.368+0000 7f6988d52640 1 -- 172.21.15.50:0/1761272605 shutdown_connections 2024-09-11T22:11:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.368+0000 7f6988d52640 1 -- 172.21.15.50:0/1761272605 >> 172.21.15.50:0/1761272605 conn(0x7f6984067ba0 msgr2=0x7f6984067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.368+0000 7f6988d52640 1 -- 172.21.15.50:0/1761272605 shutdown_connections 2024-09-11T22:11:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.368+0000 7f6988d52640 1 -- 172.21.15.50:0/1761272605 wait complete. 2024-09-11T22:11:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.369+0000 7f6988d52640 1 Processor -- start 2024-09-11T22:11:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.369+0000 7f6988d52640 1 -- start start 2024-09-11T22:11:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.370+0000 7f6988d52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c003f20 0x7f69840cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.370+0000 7f6988d52640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6984153600 0x7f698415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.370+0000 7f6988d52640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69841f4790 0x7f69841f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.370+0000 7f6988d52640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69840b7c50 con 0x7f69841f4790 2024-09-11T22:11:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.370+0000 7f6988d52640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f69840b7ad0 con 0x7f696c003f20 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.370+0000 7f6988d52640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f69840d2ad0 con 0x7f6984153600 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.370+0000 7f6982d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69841f4790 0x7f69841f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.370+0000 7f6982d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69841f4790 0x7f69841f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52556/0 (socket says 172.21.15.50:52556) 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.370+0000 7f6982d9d640 1 -- 172.21.15.50:0/4096313304 learned_addr learned my addr 172.21.15.50:0/4096313304 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.370+0000 7f6981d9b640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6984153600 0x7f698415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.371+0000 7f698259c640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c003f20 0x7f69840cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.371+0000 7f6982d9d640 1 -- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6984153600 msgr2=0x7f698415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.371+0000 7f6982d9d640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6984153600 0x7f698415ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.371+0000 7f6982d9d640 1 -- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c003f20 msgr2=0x7f69840cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.371+0000 7f6982d9d640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c003f20 0x7f69840cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.371+0000 7f6982d9d640 1 -- 172.21.15.50:0/4096313304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69841f5180 con 0x7f69841f4790 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.371+0000 7f6982d9d640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69841f4790 0x7f69841f4c40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f69840cedf0 tx=0x7f697c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.371+0000 7f6972ffd640 1 -- 172.21.15.50:0/4096313304 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c00fe10 con 0x7f69841f4790 2024-09-11T22:11:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.371+0000 7f6972ffd640 1 -- 172.21.15.50:0/4096313304 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697c01d070 con 0x7f69841f4790 2024-09-11T22:11:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.371+0000 7f6988d52640 1 -- 172.21.15.50:0/4096313304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69840ce390 con 0x7f69841f4790 2024-09-11T22:11:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.371+0000 7f6972ffd640 1 -- 172.21.15.50:0/4096313304 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c015670 con 0x7f69841f4790 2024-09-11T22:11:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.371+0000 7f6988d52640 1 -- 172.21.15.50:0/4096313304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6984161af0 con 0x7f69841f4790 2024-09-11T22:11:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.372+0000 7f6988d52640 1 -- 172.21.15.50:0/4096313304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6984162350 con 0x7f69841f4790 2024-09-11T22:11:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.373+0000 7f6972ffd640 1 -- 172.21.15.50:0/4096313304 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f697c015810 con 0x7f69841f4790 2024-09-11T22:11:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.373+0000 7f6972ffd640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f696406be60 0x7f696406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.373+0000 7f6972ffd640 1 -- 172.21.15.50:0/4096313304 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f697c08b600 con 0x7f69841f4790 2024-09-11T22:11:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.373+0000 7f698259c640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f696406be60 0x7f696406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.374+0000 7f698259c640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f696406be60 0x7f696406e320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6974001940 tx=0x7f6974009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.378+0000 7f6972ffd640 1 -- 172.21.15.50:0/4096313304 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69841f5180 con 0x7f69841f4790 2024-09-11T22:11:58.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.594+0000 7f6988d52640 1 -- 172.21.15.50:0/4096313304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69840ba770 con 0x7f69841f4790 2024-09-11T22:11:58.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.595+0000 7f6972ffd640 1 -- 172.21.15.50:0/4096313304 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5217 (secure 0 0 0) 0x7f697c010040 con 0x7f69841f4790 2024-09-11T22:11:58.596 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:58.596 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":14,"btime":"2024-09-11T22:11:58:235097+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3019059033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3019059033},{"type":"v1","addr":"172.21.15.77:6836","nonce":3019059033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/151985123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":151985123},{"type":"v1","addr":"172.21.15.50:6835","nonce":151985123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4699,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3475311289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3475311289},{"type":"v1","addr":"172.21.15.77:6837","nonce":3475311289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:11:54.587183+0000","modified":"2024-09-11T22:11:57.327278+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4815},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4815":{"gid":4815,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6833/900288576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":900288576},{"type":"v1","addr":"172.21.15.50:6833","nonce":900288576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4815,"qdb_cluster":[4815]},"id":2}]} 2024-09-11T22:11:58.596 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 14 2024-09-11T22:11:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.597+0000 7f6988d52640 1 -- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f696406be60 msgr2=0x7f696406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.597+0000 7f6988d52640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f696406be60 0x7f696406e320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6974001940 tx=0x7f6974009040 comp rx=0 tx=0).stop 2024-09-11T22:11:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.597+0000 7f6988d52640 1 -- 172.21.15.50:0/4096313304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69841f4790 msgr2=0x7f69841f4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.597+0000 7f6988d52640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69841f4790 0x7f69841f4c40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f69840cedf0 tx=0x7f697c00f580 comp rx=0 tx=0).stop 2024-09-11T22:11:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.597+0000 7f6988d52640 1 -- 172.21.15.50:0/4096313304 shutdown_connections 2024-09-11T22:11:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.597+0000 7f6988d52640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f696406be60 0x7f696406e320 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.597+0000 7f6988d52640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6984153600 0x7f698415ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.597+0000 7f6988d52640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69841f4790 0x7f69841f4c40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.597+0000 7f6988d52640 1 --2- 172.21.15.50:0/4096313304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f696c003f20 0x7f69840cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.597+0000 7f6988d52640 1 -- 172.21.15.50:0/4096313304 >> 172.21.15.50:0/4096313304 conn(0x7f6984067ba0 msgr2=0x7f69840b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:58.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.597+0000 7f6988d52640 1 -- 172.21.15.50:0/4096313304 shutdown_connections 2024-09-11T22:11:58.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.597+0000 7f6988d52640 1 -- 172.21.15.50:0/4096313304 wait complete. 2024-09-11T22:11:58.609 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:11:58.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.710+0000 7f39f140a640 1 Processor -- start 2024-09-11T22:11:58.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.710+0000 7f39f140a640 1 -- start start 2024-09-11T22:11:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39f140a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0cf610 0x7f39ec0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39f140a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f39ec0b1600 0x7f39ec0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39f140a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39ec0cfbd0 con 0x7f39ec161fa0 2024-09-11T22:11:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39f140a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f39ec0d1220 con 0x7f39ec0b1600 2024-09-11T22:11:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39f140a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f39ec0d17e0 con 0x7f39ec0cf610 2024-09-11T22:11:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39eaffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f39ec161fa0 0x7f39ec0cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35728/0 (socket says 172.21.15.50:35728) 2024-09-11T22:11:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39eaffd640 1 -- 172.21.15.50:0/3300725496 learned_addr learned my addr 172.21.15.50:0/3300725496 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:11:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39ea7fc640 1 --2- 172.21.15.50:0/3300725496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0cf610 0x7f39ec0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39eb7fe640 1 --2- 172.21.15.50:0/3300725496 >> v2:172.21.15.77:3300/0 conn(0x7f39ec0b1600 0x7f39ec0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860682320 0 0) 0x7f39ec0cfbd0 con 0x7f39ec161fa0 2024-09-11T22:11:58.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39d4003520 con 0x7f39ec161fa0 2024-09-11T22:11:58.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 261153002 0 0) 0x7f39d4003520 con 0x7f39ec161fa0 2024-09-11T22:11:58.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0cf610 msgr2=0x7f39ec0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:58.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39e9ffb640 1 --2- 172.21.15.50:0/3300725496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0cf610 0x7f39ec0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 >> v2:172.21.15.77:3300/0 conn(0x7f39ec0b1600 msgr2=0x7f39ec0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:58.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39e9ffb640 1 --2- 172.21.15.50:0/3300725496 >> v2:172.21.15.77:3300/0 conn(0x7f39ec0b1600 0x7f39ec0cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.711+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ec0cfeb0 con 0x7f39ec161fa0 2024-09-11T22:11:58.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f39dc001670 con 0x7f39ec161fa0 2024-09-11T22:11:58.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 >> v1:172.21.15.50:6789/0 conn(0x7f39ec161fa0 legacy=0x7f39ec0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39e9ffb640 1 --2- 172.21.15.50:0/3300725496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d40039b0 0x7f39d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39e9ffb640 1 --2- 172.21.15.50:0/3300725496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0cf610 0x7f39d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39e9ffb640 1 --2- 172.21.15.50:0/3300725496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d4004d40 0x7f39d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec0d1220 con 0x7f39d4004d40 2024-09-11T22:11:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec0d17e0 con 0x7f39d40039b0 2024-09-11T22:11:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f39d400b9c0 con 0x7f39ec0cf610 2024-09-11T22:11:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39eaffd640 1 --2- 172.21.15.50:0/3300725496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d40039b0 0x7f39d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39eb7fe640 1 --2- 172.21.15.50:0/3300725496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d4004d40 0x7f39d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39ea7fc640 1 --2- 172.21.15.50:0/3300725496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0cf610 0x7f39d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39eb7fe640 1 -- 172.21.15.50:0/3300725496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0cf610 msgr2=0x7f39d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39eb7fe640 1 --2- 172.21.15.50:0/3300725496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0cf610 0x7f39d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39eb7fe640 1 -- 172.21.15.50:0/3300725496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d40039b0 msgr2=0x7f39d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:58.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39eb7fe640 1 --2- 172.21.15.50:0/3300725496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d40039b0 0x7f39d4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.712+0000 7f39eb7fe640 1 -- 172.21.15.50:0/3300725496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d4003520 con 0x7f39d4004d40 2024-09-11T22:11:58.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.713+0000 7f39eb7fe640 1 --2- 172.21.15.50:0/3300725496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d4004d40 0x7f39d40051c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009fc0 tx=0x7f39d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ef9457b02db7d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.713+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4009c10 con 0x7f39d4004d40 2024-09-11T22:11:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.713+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e4036070 con 0x7f39d4004d40 2024-09-11T22:11:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.713+0000 7f39e9ffb640 1 -- 172.21.15.50:0/3300725496 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e402d070 con 0x7f39d4004d40 2024-09-11T22:11:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.713+0000 7f39f140a640 1 -- 172.21.15.50:0/3300725496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d4004d40 msgr2=0x7f39d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.713+0000 7f39f140a640 1 --2- 172.21.15.50:0/3300725496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d4004d40 0x7f39d40051c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009fc0 tx=0x7f39d4005830 comp rx=0 tx=0).stop 2024-09-11T22:11:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.713+0000 7f39eb7fe640 1 -- 172.21.15.50:0/3300725496 reap_dead start 2024-09-11T22:11:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.713+0000 7f39f140a640 1 -- 172.21.15.50:0/3300725496 shutdown_connections 2024-09-11T22:11:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.713+0000 7f39f140a640 1 -- 172.21.15.50:0/3300725496 >> 172.21.15.50:0/3300725496 conn(0x7f39ec09ba50 msgr2=0x7f39ec0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.713+0000 7f39f140a640 1 -- 172.21.15.50:0/3300725496 shutdown_connections 2024-09-11T22:11:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.713+0000 7f39f140a640 1 -- 172.21.15.50:0/3300725496 wait complete. 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.715+0000 7f39f140a640 1 Processor -- start 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.715+0000 7f39f140a640 1 -- start start 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39f140a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d4004d40 0x7f39ec14d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39f140a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39ec160380 0x7f39ec160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39f140a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0b5550 0x7f39ec0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39f140a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec162500 con 0x7f39ec160380 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39f140a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec162380 con 0x7f39d4004d40 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39f140a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f39ec0d1c70 con 0x7f39ec0b5550 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39ea7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39ec160380 0x7f39ec160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39ea7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39ec160380 0x7f39ec160800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52574/0 (socket says 172.21.15.50:52574) 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39ea7fc640 1 -- 172.21.15.50:0/2944694463 learned_addr learned my addr 172.21.15.50:0/2944694463 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39eaffd640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d4004d40 0x7f39ec14d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39eb7fe640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0b5550 0x7f39ec0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39ea7fc640 1 -- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0b5550 msgr2=0x7f39ec0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39ea7fc640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0b5550 0x7f39ec0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39ea7fc640 1 -- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d4004d40 msgr2=0x7f39ec14d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39ea7fc640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d4004d40 0x7f39ec14d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39ea7fc640 1 -- 172.21.15.50:0/2944694463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ec160e40 con 0x7f39ec160380 2024-09-11T22:11:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39eb7fe640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0b5550 0x7f39ec0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39ea7fc640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39ec160380 0x7f39ec160800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f39e0011970 tx=0x7f39e0011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39d37fe640 1 -- 172.21.15.50:0/2944694463 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e000fa90 con 0x7f39ec160380 2024-09-11T22:11:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39f140a640 1 -- 172.21.15.50:0/2944694463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ec161120 con 0x7f39ec160380 2024-09-11T22:11:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39d37fe640 1 -- 172.21.15.50:0/2944694463 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e000fc30 con 0x7f39ec160380 2024-09-11T22:11:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39d37fe640 1 -- 172.21.15.50:0/2944694463 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0014440 con 0x7f39ec160380 2024-09-11T22:11:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.716+0000 7f39f140a640 1 -- 172.21.15.50:0/2944694463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ec0b78a0 con 0x7f39ec160380 2024-09-11T22:11:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.717+0000 7f39f140a640 1 -- 172.21.15.50:0/2944694463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39ec0b4d20 con 0x7f39ec160380 2024-09-11T22:11:58.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.718+0000 7f39d37fe640 1 -- 172.21.15.50:0/2944694463 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39e0012040 con 0x7f39ec160380 2024-09-11T22:11:58.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.718+0000 7f39d37fe640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f39d806be60 0x7f39d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:58.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.719+0000 7f39d37fe640 1 -- 172.21.15.50:0/2944694463 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f39e008b3e0 con 0x7f39ec160380 2024-09-11T22:11:58.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.719+0000 7f39eaffd640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f39d806be60 0x7f39d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:58.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.719+0000 7f39eaffd640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f39d806be60 0x7f39d806e320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f39dc001d30 tx=0x7f39dc007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:58.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.723+0000 7f39d37fe640 1 -- 172.21.15.50:0/2944694463 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39e0019030 con 0x7f39ec160380 2024-09-11T22:11:58.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.898+0000 7f39f140a640 1 -- 172.21.15.50:0/2944694463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39ec0ce940 con 0x7f39ec160380 2024-09-11T22:11:58.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.899+0000 7f39d37fe640 1 -- 172.21.15.50:0/2944694463 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16693 (secure 0 0 0) 0x7f39e0059da0 con 0x7f39ec160380 2024-09-11T22:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":32,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:11:56.229934+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:52.474592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:53.568181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:11:58.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.901+0000 7f39f140a640 1 -- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f39d806be60 msgr2=0x7f39d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.901+0000 7f39f140a640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f39d806be60 0x7f39d806e320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f39dc001d30 tx=0x7f39dc007970 comp rx=0 tx=0).stop 2024-09-11T22:11:58.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.902+0000 7f39f140a640 1 -- 172.21.15.50:0/2944694463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39ec160380 msgr2=0x7f39ec160800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:58.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.902+0000 7f39f140a640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39ec160380 0x7f39ec160800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f39e0011970 tx=0x7f39e0011e30 comp rx=0 tx=0).stop 2024-09-11T22:11:58.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.902+0000 7f39f140a640 1 -- 172.21.15.50:0/2944694463 shutdown_connections 2024-09-11T22:11:58.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.902+0000 7f39f140a640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f39d806be60 0x7f39d806e320 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.902+0000 7f39f140a640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39ec0b5550 0x7f39ec0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.902+0000 7f39f140a640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39ec160380 0x7f39ec160800 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.902+0000 7f39f140a640 1 --2- 172.21.15.50:0/2944694463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d4004d40 0x7f39ec14d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.902+0000 7f39f140a640 1 -- 172.21.15.50:0/2944694463 >> 172.21.15.50:0/2944694463 conn(0x7f39ec09ba50 msgr2=0x7f39ec06fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.902+0000 7f39f140a640 1 -- 172.21.15.50:0/2944694463 shutdown_connections 2024-09-11T22:11:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:58.902+0000 7f39f140a640 1 -- 172.21.15.50:0/2944694463 wait complete. 2024-09-11T22:11:58.914 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:11:58.914 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:11:59.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.016+0000 7faaf9aba640 1 Processor -- start 2024-09-11T22:11:59.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.016+0000 7faaf9aba640 1 -- start start 2024-09-11T22:11:59.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.016+0000 7faaf9aba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faaf415c3c0 0x7faaf415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.016+0000 7faaf9aba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaf415ec40 0x7faaf415f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.016+0000 7faaf9aba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaf40679c0 0x7faaf4067e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.016+0000 7faaf9aba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7faaf4068370 con 0x7faaf40679c0 2024-09-11T22:11:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.016+0000 7faaf9aba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7faaf406e700 con 0x7faaf415c3c0 2024-09-11T22:11:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.016+0000 7faaf9aba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faaf415f7f0 con 0x7faaf415ec40 2024-09-11T22:11:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.017+0000 7faaf3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaf40679c0 0x7faaf4067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.017+0000 7faaf3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaf40679c0 0x7faaf4067e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52586/0 (socket says 172.21.15.50:52586) 2024-09-11T22:11:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.017+0000 7faaf3fff640 1 -- 172.21.15.50:0/653783510 learned_addr learned my addr 172.21.15.50:0/653783510 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.017+0000 7faaf37fe640 1 --2- 172.21.15.50:0/653783510 >> v2:172.21.15.77:3300/0 conn(0x7faaf415c3c0 0x7faaf415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.017+0000 7faaf2ffd640 1 --2- 172.21.15.50:0/653783510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaf415ec40 0x7faaf415f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.017+0000 7faaf3fff640 1 -- 172.21.15.50:0/653783510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaf415ec40 msgr2=0x7faaf415f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.017+0000 7faaf3fff640 1 --2- 172.21.15.50:0/653783510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaf415ec40 0x7faaf415f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.017+0000 7faaf3fff640 1 -- 172.21.15.50:0/653783510 >> v2:172.21.15.77:3300/0 conn(0x7faaf415c3c0 msgr2=0x7faaf415fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.017+0000 7faaf3fff640 1 --2- 172.21.15.50:0/653783510 >> v2:172.21.15.77:3300/0 conn(0x7faaf415c3c0 0x7faaf415fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.017+0000 7faaf3fff640 1 -- 172.21.15.50:0/653783510 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf415fad0 con 0x7faaf40679c0 2024-09-11T22:11:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.017+0000 7faaf37fe640 1 --2- 172.21.15.50:0/653783510 >> v2:172.21.15.77:3300/0 conn(0x7faaf415c3c0 0x7faaf415fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:11:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.018+0000 7faaf3fff640 1 --2- 172.21.15.50:0/653783510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40679c0 0x7faaf4067e30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faaf4071b10 tx=0x7faaec02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b6e7de8d8ba7b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.018+0000 7faaf27fc640 1 -- 172.21.15.50:0/653783510 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec036070 con 0x7faaf40679c0 2024-09-11T22:11:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.018+0000 7faaf27fc640 1 -- 172.21.15.50:0/653783510 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaec031600 con 0x7faaf40679c0 2024-09-11T22:11:59.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.018+0000 7faaf27fc640 1 -- 172.21.15.50:0/653783510 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec0319d0 con 0x7faaf40679c0 2024-09-11T22:11:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.018+0000 7faaf9aba640 1 -- 172.21.15.50:0/653783510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40679c0 msgr2=0x7faaf4067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.018+0000 7faaf9aba640 1 --2- 172.21.15.50:0/653783510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40679c0 0x7faaf4067e30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faaf4071b10 tx=0x7faaec02a610 comp rx=0 tx=0).stop 2024-09-11T22:11:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.019+0000 7faaf9aba640 1 -- 172.21.15.50:0/653783510 shutdown_connections 2024-09-11T22:11:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.019+0000 7faaf9aba640 1 --2- 172.21.15.50:0/653783510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40679c0 0x7faaf4067e30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.019+0000 7faaf9aba640 1 --2- 172.21.15.50:0/653783510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaf415ec40 0x7faaf415f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.019+0000 7faaf9aba640 1 --2- 172.21.15.50:0/653783510 >> v2:172.21.15.77:3300/0 conn(0x7faaf415c3c0 0x7faaf415fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.019+0000 7faaf9aba640 1 -- 172.21.15.50:0/653783510 >> 172.21.15.50:0/653783510 conn(0x7faaf4075060 msgr2=0x7faaf406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.019+0000 7faaf9aba640 1 -- 172.21.15.50:0/653783510 shutdown_connections 2024-09-11T22:11:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.019+0000 7faaf9aba640 1 -- 172.21.15.50:0/653783510 wait complete. 2024-09-11T22:11:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.020+0000 7faaf9aba640 1 Processor -- start 2024-09-11T22:11:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.020+0000 7faaf9aba640 1 -- start start 2024-09-11T22:11:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf9aba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40679c0 0x7faaf40cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf9aba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaf415c3c0 0x7faaf41f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf9aba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf415ec40 0x7faaf41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf9aba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faaf40d0940 con 0x7faaf40679c0 2024-09-11T22:11:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf9aba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faaf406ec30 con 0x7faaf415ec40 2024-09-11T22:11:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf9aba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faaf406f150 con 0x7faaf415c3c0 2024-09-11T22:11:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40679c0 0x7faaf40cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40679c0 0x7faaf40cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52590/0 (socket says 172.21.15.50:52590) 2024-09-11T22:11:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf37fe640 1 -- 172.21.15.50:0/398825933 learned_addr learned my addr 172.21.15.50:0/398825933 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf2ffd640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaf415c3c0 0x7faaf41f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf3fff640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf415ec40 0x7faaf41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf37fe640 1 -- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaf415c3c0 msgr2=0x7faaf41f4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf37fe640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaf415c3c0 0x7faaf41f4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf37fe640 1 -- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf415ec40 msgr2=0x7faaf41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf37fe640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf415ec40 0x7faaf41594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf37fe640 1 -- 172.21.15.50:0/398825933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf40cb2b0 con 0x7faaf40679c0 2024-09-11T22:11:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf2ffd640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaf415c3c0 0x7faaf41f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf3fff640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf415ec40 0x7faaf41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:11:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf37fe640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40679c0 0x7faaf40cab40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faae400e980 tx=0x7faae400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faadbfff640 1 -- 172.21.15.50:0/398825933 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae4017070 con 0x7faaf40679c0 2024-09-11T22:11:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faadbfff640 1 -- 172.21.15.50:0/398825933 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae400ca00 con 0x7faaf40679c0 2024-09-11T22:11:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf9aba640 1 -- 172.21.15.50:0/398825933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf40cb590 con 0x7faaf40679c0 2024-09-11T22:11:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faadbfff640 1 -- 172.21.15.50:0/398825933 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae400cdd0 con 0x7faaf40679c0 2024-09-11T22:11:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.021+0000 7faaf9aba640 1 -- 172.21.15.50:0/398825933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf41f51c0 con 0x7faaf40679c0 2024-09-11T22:11:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.022+0000 7faaf9aba640 1 -- 172.21.15.50:0/398825933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf406cae0 con 0x7faaf40679c0 2024-09-11T22:11:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.023+0000 7faadbfff640 1 -- 172.21.15.50:0/398825933 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faae401a070 con 0x7faaf40679c0 2024-09-11T22:11:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.024+0000 7faadbfff640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faae006be60 0x7faae006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.024+0000 7faadbfff640 1 -- 172.21.15.50:0/398825933 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7faae408b100 con 0x7faaf40679c0 2024-09-11T22:11:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.024+0000 7faaf2ffd640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faae006be60 0x7faae006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.024+0000 7faaf2ffd640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faae006be60 0x7faae006e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faaf4159e00 tx=0x7faae8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:59.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.028+0000 7faadbfff640 1 -- 172.21.15.50:0/398825933 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faae4059aa0 con 0x7faaf40679c0 2024-09-11T22:11:59.196 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-09-11T22:11:59.195+0000 7f0938b62640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:11:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.200+0000 7faaf9aba640 1 -- 172.21.15.50:0/398825933 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faaf4067e30 con 0x7faae006be60 2024-09-11T22:11:59.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.207+0000 7faadbfff640 1 -- 172.21.15.50:0/398825933 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246468 (secure 0 0 0) 0x7faaf4067e30 con 0x7faae006be60 2024-09-11T22:11:59.211 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:59.212 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:11:59.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.210+0000 7faaf9aba640 1 -- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faae006be60 msgr2=0x7faae006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.210+0000 7faaf9aba640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faae006be60 0x7faae006e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faaf4159e00 tx=0x7faae8008040 comp rx=0 tx=0).stop 2024-09-11T22:11:59.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.210+0000 7faaf9aba640 1 -- 172.21.15.50:0/398825933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40679c0 msgr2=0x7faaf40cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.210+0000 7faaf9aba640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40679c0 0x7faaf40cab40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faae400e980 tx=0x7faae400ee40 comp rx=0 tx=0).stop 2024-09-11T22:11:59.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.210+0000 7faaf9aba640 1 -- 172.21.15.50:0/398825933 shutdown_connections 2024-09-11T22:11:59.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.210+0000 7faaf9aba640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faae006be60 0x7faae006e320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.210+0000 7faaf9aba640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaf415c3c0 0x7faaf41f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.210+0000 7faaf9aba640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf415ec40 0x7faaf41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.210+0000 7faaf9aba640 1 --2- 172.21.15.50:0/398825933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40679c0 0x7faaf40cab40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.210+0000 7faaf9aba640 1 -- 172.21.15.50:0/398825933 >> 172.21.15.50:0/398825933 conn(0x7faaf4075060 msgr2=0x7faaf406f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:59.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.210+0000 7faaf9aba640 1 -- 172.21.15.50:0/398825933 shutdown_connections 2024-09-11T22:11:59.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.210+0000 7faaf9aba640 1 -- 172.21.15.50:0/398825933 wait complete. 2024-09-11T22:11:59.222 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-09-11T22:11:57.373296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240680,"kb_used_data":3652,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734040,"statfs":{"total":773094113280,"available":772847656960,"internally_reserved":0,"allocated":3739648,"data_stored":2127107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.160352"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224159+0000","last_change":"2024-09-11T22:11:54.224159+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224159+0000","last_undegraded":"2024-09-11T22:11:54.224159+0000","last_fullsized":"2024-09-11T22:11:54.224159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.229076+0000","last_change":"2024-09-11T22:11:54.229076+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.229076+0000","last_undegraded":"2024-09-11T22:11:54.229076+0000","last_fullsized":"2024-09-11T22:11:54.229076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221597+0000","last_change":"2024-09-11T22:11:54.221597+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221597+0000","last_undegraded":"2024-09-11T22:11:54.221597+0000","last_fullsized":"2024-09-11T22:11:54.221597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227738+0000","last_change":"2024-09-11T22:11:54.227738+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227738+0000","last_undegraded":"2024-09-11T22:11:54.227738+0000","last_fullsized":"2024-09-11T22:11:54.227738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269751+0000","last_change":"2024-09-11T22:11:55.239987+0000","last_active":"2024-09-11T22:11:56.269751+0000","last_peered":"2024-09-11T22:11:56.269751+0000","last_clean":"2024-09-11T22:11:56.269751+0000","last_became_active":"2024-09-11T22:11:55.239721+0000","last_became_peered":"2024-09-11T22:11:55.239721+0000","last_unstale":"2024-09-11T22:11:56.269751+0000","last_undegraded":"2024-09-11T22:11:56.269751+0000","last_fullsized":"2024-09-11T22:11:56.269751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:55.478293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224484+0000","last_change":"2024-09-11T22:11:54.224484+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224484+0000","last_undegraded":"2024-09-11T22:11:54.224484+0000","last_fullsized":"2024-09-11T22:11:54.224484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:54.211897+0000","last_change":"2024-09-11T22:11:54.211897+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.211897+0000","last_undegraded":"2024-09-11T22:11:54.211897+0000","last_fullsized":"2024-09-11T22:11:54.211897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:54.211897+0000","last_change":"2024-09-11T22:11:54.211897+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.211897+0000","last_undegraded":"2024-09-11T22:11:54.211897+0000","last_fullsized":"2024-09-11T22:11:54.211897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221431+0000","last_change":"2024-09-11T22:11:54.221431+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221431+0000","last_undegraded":"2024-09-11T22:11:54.221431+0000","last_fullsized":"2024-09-11T22:11:54.221431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.229724+0000","last_change":"2024-09-11T22:11:54.229724+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.229724+0000","last_undegraded":"2024-09-11T22:11:54.229724+0000","last_fullsized":"2024-09-11T22:11:54.229724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:54.211897+0000","last_change":"2024-09-11T22:11:54.211897+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.211897+0000","last_undegraded":"2024-09-11T22:11:54.211897+0000","last_fullsized":"2024-09-11T22:11:54.211897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.220138+0000","last_change":"2024-09-11T22:11:54.220138+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.220138+0000","last_undegraded":"2024-09-11T22:11:54.220138+0000","last_fullsized":"2024-09-11T22:11:54.220138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269761+0000","last_change":"2024-09-11T22:11:55.245085+0000","last_active":"2024-09-11T22:11:56.269761+0000","last_peered":"2024-09-11T22:11:56.269761+0000","last_clean":"2024-09-11T22:11:56.269761+0000","last_became_active":"2024-09-11T22:11:55.244705+0000","last_became_peered":"2024-09-11T22:11:55.244705+0000","last_unstale":"2024-09-11T22:11:56.269761+0000","last_undegraded":"2024-09-11T22:11:56.269761+0000","last_fullsized":"2024-09-11T22:11:56.269761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:16.047678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224055+0000","last_change":"2024-09-11T22:11:54.224055+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224055+0000","last_undegraded":"2024-09-11T22:11:54.224055+0000","last_fullsized":"2024-09-11T22:11:54.224055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219788+0000","last_change":"2024-09-11T22:11:54.219788+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219788+0000","last_undegraded":"2024-09-11T22:11:54.219788+0000","last_fullsized":"2024-09-11T22:11:54.219788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:54.211897+0000","last_change":"2024-09-11T22:11:54.211897+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.211897+0000","last_undegraded":"2024-09-11T22:11:54.211897+0000","last_fullsized":"2024-09-11T22:11:54.211897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:54.211897+0000","last_change":"2024-09-11T22:11:54.211897+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.211897+0000","last_undegraded":"2024-09-11T22:11:54.211897+0000","last_fullsized":"2024-09-11T22:11:54.211897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228643+0000","last_change":"2024-09-11T22:11:54.228643+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228643+0000","last_undegraded":"2024-09-11T22:11:54.228643+0000","last_fullsized":"2024-09-11T22:11:54.228643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228176+0000","last_change":"2024-09-11T22:11:54.228176+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228176+0000","last_undegraded":"2024-09-11T22:11:54.228176+0000","last_fullsized":"2024-09-11T22:11:54.228176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269902+0000","last_change":"2024-09-11T22:11:55.241292+0000","last_active":"2024-09-11T22:11:56.269902+0000","last_peered":"2024-09-11T22:11:56.269902+0000","last_clean":"2024-09-11T22:11:56.269902+0000","last_became_active":"2024-09-11T22:11:55.241027+0000","last_became_peered":"2024-09-11T22:11:55.241027+0000","last_unstale":"2024-09-11T22:11:56.269902+0000","last_undegraded":"2024-09-11T22:11:56.269902+0000","last_fullsized":"2024-09-11T22:11:56.269902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:22.305162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222305+0000","last_change":"2024-09-11T22:11:54.222305+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222305+0000","last_undegraded":"2024-09-11T22:11:54.222305+0000","last_fullsized":"2024-09-11T22:11:54.222305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223221+0000","last_change":"2024-09-11T22:11:54.223221+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223221+0000","last_undegraded":"2024-09-11T22:11:54.223221+0000","last_fullsized":"2024-09-11T22:11:54.223221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223878+0000","last_change":"2024-09-11T22:11:54.223878+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223878+0000","last_undegraded":"2024-09-11T22:11:54.223878+0000","last_fullsized":"2024-09-11T22:11:54.223878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221189+0000","last_change":"2024-09-11T22:11:54.221189+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221189+0000","last_undegraded":"2024-09-11T22:11:54.221189+0000","last_fullsized":"2024-09-11T22:11:54.221189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.226803+0000","last_change":"2024-09-11T22:11:54.226803+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.226803+0000","last_undegraded":"2024-09-11T22:11:54.226803+0000","last_fullsized":"2024-09-11T22:11:54.226803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228131+0000","last_change":"2024-09-11T22:11:54.228131+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228131+0000","last_undegraded":"2024-09-11T22:11:54.228131+0000","last_fullsized":"2024-09-11T22:11:54.228131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228102+0000","last_change":"2024-09-11T22:11:54.228102+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228102+0000","last_undegraded":"2024-09-11T22:11:54.228102+0000","last_fullsized":"2024-09-11T22:11:54.228102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219566+0000","last_change":"2024-09-11T22:11:54.219566+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219566+0000","last_undegraded":"2024-09-11T22:11:54.219566+0000","last_fullsized":"2024-09-11T22:11:54.219566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221780+0000","last_change":"2024-09-11T22:11:54.221780+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221780+0000","last_undegraded":"2024-09-11T22:11:54.221780+0000","last_fullsized":"2024-09-11T22:11:54.221780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:54.211897+0000","last_change":"2024-09-11T22:11:54.211897+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.211897+0000","last_undegraded":"2024-09-11T22:11:54.211897+0000","last_fullsized":"2024-09-11T22:11:54.211897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223953+0000","last_change":"2024-09-11T22:11:54.223953+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223953+0000","last_undegraded":"2024-09-11T22:11:54.223953+0000","last_fullsized":"2024-09-11T22:11:54.223953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:54.211897+0000","last_change":"2024-09-11T22:11:54.211897+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.211897+0000","last_undegraded":"2024-09-11T22:11:54.211897+0000","last_fullsized":"2024-09-11T22:11:54.211897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222801+0000","last_change":"2024-09-11T22:11:54.222801+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222801+0000","last_undegraded":"2024-09-11T22:11:54.222801+0000","last_fullsized":"2024-09-11T22:11:54.222801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.233686+0000","last_change":"2024-09-11T22:11:54.232005+0000","last_active":"2024-09-11T22:11:54.233686+0000","last_peered":"2024-09-11T22:11:54.233686+0000","last_clean":"2024-09-11T22:11:54.233686+0000","last_became_active":"2024-09-11T22:11:54.231733+0000","last_became_peered":"2024-09-11T22:11:54.231733+0000","last_unstale":"2024-09-11T22:11:54.233686+0000","last_undegraded":"2024-09-11T22:11:54.233686+0000","last_fullsized":"2024-09-11T22:11:54.233686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.252826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223447+0000","last_change":"2024-09-11T22:11:54.223447+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223447+0000","last_undegraded":"2024-09-11T22:11:54.223447+0000","last_fullsized":"2024-09-11T22:11:54.223447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.234329+0000","last_change":"2024-09-11T22:11:54.231904+0000","last_active":"2024-09-11T22:11:54.234329+0000","last_peered":"2024-09-11T22:11:54.234329+0000","last_clean":"2024-09-11T22:11:54.234329+0000","last_became_active":"2024-09-11T22:11:54.231599+0000","last_became_peered":"2024-09-11T22:11:54.231599+0000","last_unstale":"2024-09-11T22:11:54.234329+0000","last_undegraded":"2024-09-11T22:11:54.234329+0000","last_fullsized":"2024-09-11T22:11:54.234329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:40.341037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222896+0000","last_change":"2024-09-11T22:11:54.222896+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222896+0000","last_undegraded":"2024-09-11T22:11:54.222896+0000","last_fullsized":"2024-09-11T22:11:54.222896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.238935+0000","last_change":"2024-09-11T22:11:54.237587+0000","last_active":"2024-09-11T22:11:54.238935+0000","last_peered":"2024-09-11T22:11:54.238935+0000","last_clean":"2024-09-11T22:11:54.238935+0000","last_became_active":"2024-09-11T22:11:54.237269+0000","last_became_peered":"2024-09-11T22:11:54.237269+0000","last_unstale":"2024-09-11T22:11:54.238935+0000","last_undegraded":"2024-09-11T22:11:54.238935+0000","last_fullsized":"2024-09-11T22:11:54.238935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:37.436803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224975+0000","last_change":"2024-09-11T22:11:54.224975+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224975+0000","last_undegraded":"2024-09-11T22:11:54.224975+0000","last_fullsized":"2024-09-11T22:11:54.224975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269864+0000","last_change":"2024-09-11T22:11:54.235284+0000","last_active":"2024-09-11T22:11:56.269864+0000","last_peered":"2024-09-11T22:11:56.269864+0000","last_clean":"2024-09-11T22:11:56.269864+0000","last_became_active":"2024-09-11T22:11:54.234997+0000","last_became_peered":"2024-09-11T22:11:54.234997+0000","last_unstale":"2024-09-11T22:11:56.269864+0000","last_undegraded":"2024-09-11T22:11:56.269864+0000","last_fullsized":"2024-09-11T22:11:56.269864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:10.204976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:54.211897+0000","last_change":"2024-09-11T22:11:54.211897+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.211897+0000","last_undegraded":"2024-09-11T22:11:54.211897+0000","last_fullsized":"2024-09-11T22:11:54.211897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.234552+0000","last_change":"2024-09-11T22:11:54.232989+0000","last_active":"2024-09-11T22:11:54.234552+0000","last_peered":"2024-09-11T22:11:54.234552+0000","last_clean":"2024-09-11T22:11:54.234552+0000","last_became_active":"2024-09-11T22:11:54.232619+0000","last_became_peered":"2024-09-11T22:11:54.232619+0000","last_unstale":"2024-09-11T22:11:54.234552+0000","last_undegraded":"2024-09-11T22:11:54.234552+0000","last_fullsized":"2024-09-11T22:11:54.234552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:05.203238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221366+0000","last_change":"2024-09-11T22:11:54.221366+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221366+0000","last_undegraded":"2024-09-11T22:11:54.221366+0000","last_fullsized":"2024-09-11T22:11:54.221366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240469+0000","last_change":"2024-09-11T22:11:54.235628+0000","last_active":"2024-09-11T22:11:54.240469+0000","last_peered":"2024-09-11T22:11:54.240469+0000","last_clean":"2024-09-11T22:11:54.240469+0000","last_became_active":"2024-09-11T22:11:54.235423+0000","last_became_peered":"2024-09-11T22:11:54.235423+0000","last_unstale":"2024-09-11T22:11:54.240469+0000","last_undegraded":"2024-09-11T22:11:54.240469+0000","last_fullsized":"2024-09-11T22:11:54.240469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:54.817240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222277+0000","last_change":"2024-09-11T22:11:54.222277+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222277+0000","last_undegraded":"2024-09-11T22:11:54.222277+0000","last_fullsized":"2024-09-11T22:11:54.222277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.236777+0000","last_change":"2024-09-11T22:11:54.235445+0000","last_active":"2024-09-11T22:11:54.236777+0000","last_peered":"2024-09-11T22:11:54.236777+0000","last_clean":"2024-09-11T22:11:54.236777+0000","last_became_active":"2024-09-11T22:11:54.235120+0000","last_became_peered":"2024-09-11T22:11:54.235120+0000","last_unstale":"2024-09-11T22:11:54.236777+0000","last_undegraded":"2024-09-11T22:11:54.236777+0000","last_fullsized":"2024-09-11T22:11:54.236777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.226269+0000","last_change":"2024-09-11T22:11:54.226269+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.226269+0000","last_undegraded":"2024-09-11T22:11:54.226269+0000","last_fullsized":"2024-09-11T22:11:54.226269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230815+0000","last_change":"2024-09-11T22:11:54.229723+0000","last_active":"2024-09-11T22:11:54.230815+0000","last_peered":"2024-09-11T22:11:54.230815+0000","last_clean":"2024-09-11T22:11:54.230815+0000","last_became_active":"2024-09-11T22:11:54.228533+0000","last_became_peered":"2024-09-11T22:11:54.228533+0000","last_unstale":"2024-09-11T22:11:54.230815+0000","last_undegraded":"2024-09-11T22:11:54.230815+0000","last_fullsized":"2024-09-11T22:11:54.230815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:18.975678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.220078+0000","last_change":"2024-09-11T22:11:54.220078+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.220078+0000","last_undegraded":"2024-09-11T22:11:54.220078+0000","last_fullsized":"2024-09-11T22:11:54.220078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.238487+0000","last_change":"2024-09-11T22:11:54.237543+0000","last_active":"2024-09-11T22:11:54.238487+0000","last_peered":"2024-09-11T22:11:54.238487+0000","last_clean":"2024-09-11T22:11:54.238487+0000","last_became_active":"2024-09-11T22:11:54.235862+0000","last_became_peered":"2024-09-11T22:11:54.235862+0000","last_unstale":"2024-09-11T22:11:54.238487+0000","last_undegraded":"2024-09-11T22:11:54.238487+0000","last_fullsized":"2024-09-11T22:11:54.238487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:49.788303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227816+0000","last_change":"2024-09-11T22:11:54.227816+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227816+0000","last_undegraded":"2024-09-11T22:11:54.227816+0000","last_fullsized":"2024-09-11T22:11:54.227816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240131+0000","last_change":"2024-09-11T22:11:54.238373+0000","last_active":"2024-09-11T22:11:54.240131+0000","last_peered":"2024-09-11T22:11:54.240131+0000","last_clean":"2024-09-11T22:11:54.240131+0000","last_became_active":"2024-09-11T22:11:54.238087+0000","last_became_peered":"2024-09-11T22:11:54.238087+0000","last_unstale":"2024-09-11T22:11:54.240131+0000","last_undegraded":"2024-09-11T22:11:54.240131+0000","last_fullsized":"2024-09-11T22:11:54.240131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228313+0000","last_change":"2024-09-11T22:11:54.228313+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228313+0000","last_undegraded":"2024-09-11T22:11:54.228313+0000","last_fullsized":"2024-09-11T22:11:54.228313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.233865+0000","last_change":"2024-09-11T22:11:54.231853+0000","last_active":"2024-09-11T22:11:54.233865+0000","last_peered":"2024-09-11T22:11:54.233865+0000","last_clean":"2024-09-11T22:11:54.233865+0000","last_became_active":"2024-09-11T22:11:54.231564+0000","last_became_peered":"2024-09-11T22:11:54.231564+0000","last_unstale":"2024-09-11T22:11:54.233865+0000","last_undegraded":"2024-09-11T22:11:54.233865+0000","last_fullsized":"2024-09-11T22:11:54.233865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:36.010268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224117+0000","last_change":"2024-09-11T22:11:54.224117+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224117+0000","last_undegraded":"2024-09-11T22:11:54.224117+0000","last_fullsized":"2024-09-11T22:11:54.224117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239473+0000","last_change":"2024-09-11T22:11:54.238142+0000","last_active":"2024-09-11T22:11:54.239473+0000","last_peered":"2024-09-11T22:11:54.239473+0000","last_clean":"2024-09-11T22:11:54.239473+0000","last_became_active":"2024-09-11T22:11:54.237819+0000","last_became_peered":"2024-09-11T22:11:54.237819+0000","last_unstale":"2024-09-11T22:11:54.239473+0000","last_undegraded":"2024-09-11T22:11:54.239473+0000","last_fullsized":"2024-09-11T22:11:54.239473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:57.762834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227662+0000","last_change":"2024-09-11T22:11:54.227662+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227662+0000","last_undegraded":"2024-09-11T22:11:54.227662+0000","last_fullsized":"2024-09-11T22:11:54.227662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230860+0000","last_change":"2024-09-11T22:11:54.228141+0000","last_active":"2024-09-11T22:11:54.230860+0000","last_peered":"2024-09-11T22:11:54.230860+0000","last_clean":"2024-09-11T22:11:54.230860+0000","last_became_active":"2024-09-11T22:11:54.227742+0000","last_became_peered":"2024-09-11T22:11:54.227742+0000","last_unstale":"2024-09-11T22:11:54.230860+0000","last_undegraded":"2024-09-11T22:11:54.230860+0000","last_fullsized":"2024-09-11T22:11:54.230860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:00.285086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222828+0000","last_change":"2024-09-11T22:11:54.222828+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222828+0000","last_undegraded":"2024-09-11T22:11:54.222828+0000","last_fullsized":"2024-09-11T22:11:54.222828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239957+0000","last_change":"2024-09-11T22:11:54.238756+0000","last_active":"2024-09-11T22:11:54.239957+0000","last_peered":"2024-09-11T22:11:54.239957+0000","last_clean":"2024-09-11T22:11:54.239957+0000","last_became_active":"2024-09-11T22:11:54.238411+0000","last_became_peered":"2024-09-11T22:11:54.238411+0000","last_unstale":"2024-09-11T22:11:54.239957+0000","last_undegraded":"2024-09-11T22:11:54.239957+0000","last_fullsized":"2024-09-11T22:11:54.239957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.252826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:54.211897+0000","last_change":"2024-09-11T22:11:54.211897+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.211897+0000","last_undegraded":"2024-09-11T22:11:54.211897+0000","last_fullsized":"2024-09-11T22:11:54.211897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.236974+0000","last_change":"2024-09-11T22:11:54.236090+0000","last_active":"2024-09-11T22:11:54.236974+0000","last_peered":"2024-09-11T22:11:54.236974+0000","last_clean":"2024-09-11T22:11:54.236974+0000","last_became_active":"2024-09-11T22:11:54.235800+0000","last_became_peered":"2024-09-11T22:11:54.235800+0000","last_unstale":"2024-09-11T22:11:54.236974+0000","last_undegraded":"2024-09-11T22:11:54.236974+0000","last_fullsized":"2024-09-11T22:11:54.236974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223419+0000","last_change":"2024-09-11T22:11:54.223419+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223419+0000","last_undegraded":"2024-09-11T22:11:54.223419+0000","last_fullsized":"2024-09-11T22:11:54.223419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239458+0000","last_change":"2024-09-11T22:11:54.238384+0000","last_active":"2024-09-11T22:11:54.239458+0000","last_peered":"2024-09-11T22:11:54.239458+0000","last_clean":"2024-09-11T22:11:54.239458+0000","last_became_active":"2024-09-11T22:11:54.237149+0000","last_became_peered":"2024-09-11T22:11:54.237149+0000","last_unstale":"2024-09-11T22:11:54.239458+0000","last_undegraded":"2024-09-11T22:11:54.239458+0000","last_fullsized":"2024-09-11T22:11:54.239458+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:58.538834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219747+0000","last_change":"2024-09-11T22:11:54.219747+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219747+0000","last_undegraded":"2024-09-11T22:11:54.219747+0000","last_fullsized":"2024-09-11T22:11:54.219747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240895+0000","last_change":"2024-09-11T22:11:54.239702+0000","last_active":"2024-09-11T22:11:54.240895+0000","last_peered":"2024-09-11T22:11:54.240895+0000","last_clean":"2024-09-11T22:11:54.240895+0000","last_became_active":"2024-09-11T22:11:54.239399+0000","last_became_peered":"2024-09-11T22:11:54.239399+0000","last_unstale":"2024-09-11T22:11:54.240895+0000","last_undegraded":"2024-09-11T22:11:54.240895+0000","last_fullsized":"2024-09-11T22:11:54.240895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223586+0000","last_change":"2024-09-11T22:11:54.223586+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223586+0000","last_undegraded":"2024-09-11T22:11:54.223586+0000","last_fullsized":"2024-09-11T22:11:54.223586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230828+0000","last_change":"2024-09-11T22:11:54.229239+0000","last_active":"2024-09-11T22:11:54.230828+0000","last_peered":"2024-09-11T22:11:54.230828+0000","last_clean":"2024-09-11T22:11:54.230828+0000","last_became_active":"2024-09-11T22:11:54.228972+0000","last_became_peered":"2024-09-11T22:11:54.228972+0000","last_unstale":"2024-09-11T22:11:54.230828+0000","last_undegraded":"2024-09-11T22:11:54.230828+0000","last_fullsized":"2024-09-11T22:11:54.230828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:43.406978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227247+0000","last_change":"2024-09-11T22:11:54.227247+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227247+0000","last_undegraded":"2024-09-11T22:11:54.227247+0000","last_fullsized":"2024-09-11T22:11:54.227247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230737+0000","last_change":"2024-09-11T22:11:54.227381+0000","last_active":"2024-09-11T22:11:54.230737+0000","last_peered":"2024-09-11T22:11:54.230737+0000","last_clean":"2024-09-11T22:11:54.230737+0000","last_became_active":"2024-09-11T22:11:54.226564+0000","last_became_peered":"2024-09-11T22:11:54.226564+0000","last_unstale":"2024-09-11T22:11:54.230737+0000","last_undegraded":"2024-09-11T22:11:54.230737+0000","last_fullsized":"2024-09-11T22:11:54.230737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:38.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269896+0000","last_change":"2024-09-11T22:11:55.244562+0000","last_active":"2024-09-11T22:11:56.269896+0000","last_peered":"2024-09-11T22:11:56.269896+0000","last_clean":"2024-09-11T22:11:56.269896+0000","last_became_active":"2024-09-11T22:11:55.244183+0000","last_became_peered":"2024-09-11T22:11:55.244183+0000","last_unstale":"2024-09-11T22:11:56.269896+0000","last_undegraded":"2024-09-11T22:11:56.269896+0000","last_fullsized":"2024-09-11T22:11:56.269896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:27.980484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240436+0000","last_change":"2024-09-11T22:11:54.235155+0000","last_active":"2024-09-11T22:11:54.240436+0000","last_peered":"2024-09-11T22:11:54.240436+0000","last_clean":"2024-09-11T22:11:54.240436+0000","last_became_active":"2024-09-11T22:11:54.234931+0000","last_became_peered":"2024-09-11T22:11:54.234931+0000","last_unstale":"2024-09-11T22:11:54.240436+0000","last_undegraded":"2024-09-11T22:11:54.240436+0000","last_fullsized":"2024-09-11T22:11:54.240436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:56.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269770+0000","last_change":"2024-09-11T22:11:55.245345+0000","last_active":"2024-09-11T22:11:56.269770+0000","last_peered":"2024-09-11T22:11:56.269770+0000","last_clean":"2024-09-11T22:11:56.269770+0000","last_became_active":"2024-09-11T22:11:55.245063+0000","last_became_peered":"2024-09-11T22:11:55.245063+0000","last_unstale":"2024-09-11T22:11:56.269770+0000","last_undegraded":"2024-09-11T22:11:56.269770+0000","last_fullsized":"2024-09-11T22:11:56.269770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:48.949134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.236016+0000","last_change":"2024-09-11T22:11:54.233955+0000","last_active":"2024-09-11T22:11:54.236016+0000","last_peered":"2024-09-11T22:11:54.236016+0000","last_clean":"2024-09-11T22:11:54.236016+0000","last_became_active":"2024-09-11T22:11:54.233649+0000","last_became_peered":"2024-09-11T22:11:54.233649+0000","last_unstale":"2024-09-11T22:11:54.236016+0000","last_undegraded":"2024-09-11T22:11:54.236016+0000","last_fullsized":"2024-09-11T22:11:54.236016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.252826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269860+0000","last_change":"2024-09-11T22:11:55.239063+0000","last_active":"2024-09-11T22:11:56.269860+0000","last_peered":"2024-09-11T22:11:56.269860+0000","last_clean":"2024-09-11T22:11:56.269860+0000","last_became_active":"2024-09-11T22:11:55.238715+0000","last_became_peered":"2024-09-11T22:11:55.238715+0000","last_unstale":"2024-09-11T22:11:56.269860+0000","last_undegraded":"2024-09-11T22:11:56.269860+0000","last_fullsized":"2024-09-11T22:11:56.269860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:12.370780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.245895+0000","last_change":"2024-09-11T22:11:54.237992+0000","last_active":"2024-09-11T22:11:54.245895+0000","last_peered":"2024-09-11T22:11:54.245895+0000","last_clean":"2024-09-11T22:11:54.245895+0000","last_became_active":"2024-09-11T22:11:54.237566+0000","last_became_peered":"2024-09-11T22:11:54.237566+0000","last_unstale":"2024-09-11T22:11:54.245895+0000","last_undegraded":"2024-09-11T22:11:54.245895+0000","last_fullsized":"2024-09-11T22:11:54.245895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269723+0000","last_change":"2024-09-11T22:11:55.239964+0000","last_active":"2024-09-11T22:11:56.269723+0000","last_peered":"2024-09-11T22:11:56.269723+0000","last_clean":"2024-09-11T22:11:56.269723+0000","last_became_active":"2024-09-11T22:11:55.239684+0000","last_became_peered":"2024-09-11T22:11:55.239684+0000","last_unstale":"2024-09-11T22:11:56.269723+0000","last_undegraded":"2024-09-11T22:11:56.269723+0000","last_fullsized":"2024-09-11T22:11:56.269723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:34.837927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240493+0000","last_change":"2024-09-11T22:11:54.235334+0000","last_active":"2024-09-11T22:11:54.240493+0000","last_peered":"2024-09-11T22:11:54.240493+0000","last_clean":"2024-09-11T22:11:54.240493+0000","last_became_active":"2024-09-11T22:11:54.235045+0000","last_became_peered":"2024-09-11T22:11:54.235045+0000","last_unstale":"2024-09-11T22:11:54.240493+0000","last_undegraded":"2024-09-11T22:11:54.240493+0000","last_fullsized":"2024-09-11T22:11:54.240493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:05.982977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:54.211897+0000","last_change":"2024-09-11T22:11:54.211897+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.211897+0000","last_undegraded":"2024-09-11T22:11:54.211897+0000","last_fullsized":"2024-09-11T22:11:54.211897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240252+0000","last_change":"2024-09-11T22:11:54.233653+0000","last_active":"2024-09-11T22:11:54.240252+0000","last_peered":"2024-09-11T22:11:54.240252+0000","last_clean":"2024-09-11T22:11:54.240252+0000","last_became_active":"2024-09-11T22:11:54.233372+0000","last_became_peered":"2024-09-11T22:11:54.233372+0000","last_unstale":"2024-09-11T22:11:54.240252+0000","last_undegraded":"2024-09-11T22:11:54.240252+0000","last_fullsized":"2024-09-11T22:11:54.240252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:07.799927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269805+0000","last_change":"2024-09-11T22:11:55.240205+0000","last_active":"2024-09-11T22:11:56.269805+0000","last_peered":"2024-09-11T22:11:56.269805+0000","last_clean":"2024-09-11T22:11:56.269805+0000","last_became_active":"2024-09-11T22:11:55.239329+0000","last_became_peered":"2024-09-11T22:11:55.239329+0000","last_unstale":"2024-09-11T22:11:56.269805+0000","last_undegraded":"2024-09-11T22:11:56.269805+0000","last_fullsized":"2024-09-11T22:11:56.269805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:55.632586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.238633+0000","last_change":"2024-09-11T22:11:54.236587+0000","last_active":"2024-09-11T22:11:54.238633+0000","last_peered":"2024-09-11T22:11:54.238633+0000","last_clean":"2024-09-11T22:11:54.238633+0000","last_became_active":"2024-09-11T22:11:54.236280+0000","last_became_peered":"2024-09-11T22:11:54.236280+0000","last_unstale":"2024-09-11T22:11:54.238633+0000","last_undegraded":"2024-09-11T22:11:54.238633+0000","last_fullsized":"2024-09-11T22:11:54.238633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:40.341037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219602+0000","last_change":"2024-09-11T22:11:54.219602+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219602+0000","last_undegraded":"2024-09-11T22:11:54.219602+0000","last_fullsized":"2024-09-11T22:11:54.219602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.237158+0000","last_change":"2024-09-11T22:11:54.235834+0000","last_active":"2024-09-11T22:11:54.237158+0000","last_peered":"2024-09-11T22:11:54.237158+0000","last_clean":"2024-09-11T22:11:54.237158+0000","last_became_active":"2024-09-11T22:11:54.235561+0000","last_became_peered":"2024-09-11T22:11:54.235561+0000","last_unstale":"2024-09-11T22:11:54.237158+0000","last_undegraded":"2024-09-11T22:11:54.237158+0000","last_fullsized":"2024-09-11T22:11:54.237158+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223044+0000","last_change":"2024-09-11T22:11:54.223044+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223044+0000","last_undegraded":"2024-09-11T22:11:54.223044+0000","last_fullsized":"2024-09-11T22:11:54.223044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.237757+0000","last_change":"2024-09-11T22:11:54.234484+0000","last_active":"2024-09-11T22:11:54.237757+0000","last_peered":"2024-09-11T22:11:54.237757+0000","last_clean":"2024-09-11T22:11:54.237757+0000","last_became_active":"2024-09-11T22:11:54.234219+0000","last_became_peered":"2024-09-11T22:11:54.234219+0000","last_unstale":"2024-09-11T22:11:54.237757+0000","last_undegraded":"2024-09-11T22:11:54.237757+0000","last_fullsized":"2024-09-11T22:11:54.237757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:19.243150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223642+0000","last_change":"2024-09-11T22:11:54.223642+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223642+0000","last_undegraded":"2024-09-11T22:11:54.223642+0000","last_fullsized":"2024-09-11T22:11:54.223642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.228711+0000","last_change":"2024-09-11T22:11:54.227468+0000","last_active":"2024-09-11T22:11:54.228711+0000","last_peered":"2024-09-11T22:11:54.228711+0000","last_clean":"2024-09-11T22:11:54.228711+0000","last_became_active":"2024-09-11T22:11:54.227109+0000","last_became_peered":"2024-09-11T22:11:54.227109+0000","last_unstale":"2024-09-11T22:11:54.228711+0000","last_undegraded":"2024-09-11T22:11:54.228711+0000","last_fullsized":"2024-09-11T22:11:54.228711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:19.243150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223384+0000","last_change":"2024-09-11T22:11:54.223384+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223384+0000","last_undegraded":"2024-09-11T22:11:54.223384+0000","last_fullsized":"2024-09-11T22:11:54.223384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.241442+0000","last_change":"2024-09-11T22:11:54.241027+0000","last_active":"2024-09-11T22:11:54.241442+0000","last_peered":"2024-09-11T22:11:54.241442+0000","last_clean":"2024-09-11T22:11:54.241442+0000","last_became_active":"2024-09-11T22:11:54.240641+0000","last_became_peered":"2024-09-11T22:11:54.240641+0000","last_unstale":"2024-09-11T22:11:54.241442+0000","last_undegraded":"2024-09-11T22:11:54.241442+0000","last_fullsized":"2024-09-11T22:11:54.241442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222388+0000","last_change":"2024-09-11T22:11:54.222388+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222388+0000","last_undegraded":"2024-09-11T22:11:54.222388+0000","last_fullsized":"2024-09-11T22:11:54.222388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230715+0000","last_change":"2024-09-11T22:11:54.227045+0000","last_active":"2024-09-11T22:11:54.230715+0000","last_peered":"2024-09-11T22:11:54.230715+0000","last_clean":"2024-09-11T22:11:54.230715+0000","last_became_active":"2024-09-11T22:11:54.226304+0000","last_became_peered":"2024-09-11T22:11:54.226304+0000","last_unstale":"2024-09-11T22:11:54.230715+0000","last_undegraded":"2024-09-11T22:11:54.230715+0000","last_fullsized":"2024-09-11T22:11:54.230715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:03.624960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.220524+0000","last_change":"2024-09-11T22:11:54.220524+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.220524+0000","last_undegraded":"2024-09-11T22:11:54.220524+0000","last_fullsized":"2024-09-11T22:11:54.220524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239434+0000","last_change":"2024-09-11T22:11:54.238048+0000","last_active":"2024-09-11T22:11:54.239434+0000","last_peered":"2024-09-11T22:11:54.239434+0000","last_clean":"2024-09-11T22:11:54.239434+0000","last_became_active":"2024-09-11T22:11:54.237756+0000","last_became_peered":"2024-09-11T22:11:54.237756+0000","last_unstale":"2024-09-11T22:11:54.239434+0000","last_undegraded":"2024-09-11T22:11:54.239434+0000","last_fullsized":"2024-09-11T22:11:54.239434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:14.245228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:11:54.211897+0000","last_change":"2024-09-11T22:11:54.211897+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.211897+0000","last_undegraded":"2024-09-11T22:11:54.211897+0000","last_fullsized":"2024-09-11T22:11:54.211897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.233260+0000","last_change":"2024-09-11T22:11:54.231109+0000","last_active":"2024-09-11T22:11:54.233260+0000","last_peered":"2024-09-11T22:11:54.233260+0000","last_clean":"2024-09-11T22:11:54.233260+0000","last_became_active":"2024-09-11T22:11:54.230832+0000","last_became_peered":"2024-09-11T22:11:54.230832+0000","last_unstale":"2024-09-11T22:11:54.233260+0000","last_undegraded":"2024-09-11T22:11:54.233260+0000","last_fullsized":"2024-09-11T22:11:54.233260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:40.341037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:11:49.765199+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:11:49.765199+0000","last_peered":"2024-09-11T22:11:49.765199+0000","last_clean":"2024-09-11T22:11:49.765199+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:11:49.765199+0000","last_undegraded":"2024-09-11T22:11:49.765199+0000","last_fullsized":"2024-09-11T22:11:49.765199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":909312,"data_stored":706965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":897024,"data_stored":701148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35696,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336144,"statfs":{"total":96636764160,"available":96600211456,"internally_reserved":0,"allocated":356352,"data_stored":136009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:11:59.227 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:11:59.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.365+0000 7f3dd180e640 1 Processor -- start 2024-09-11T22:11:59.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.365+0000 7f3dd180e640 1 -- start start 2024-09-11T22:11:59.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dd180e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3dcc161fa0 0x7f3dcc0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dd180e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3dcc0cf610 0x7f3dcc0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dd180e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dcc0cfbd0 con 0x7f3dcc0b1600 2024-09-11T22:11:59.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dd180e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f3dcc0d1220 con 0x7f3dcc0cf610 2024-09-11T22:11:59.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dd180e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3dcc0d17e0 con 0x7f3dcc161fa0 2024-09-11T22:11:59.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dcb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3dcc0cf610 0x7f3dcc0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dcb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3dcc0cf610 0x7f3dcc0cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52604/0 (socket says 172.21.15.50:52604) 2024-09-11T22:11:59.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dcb7fe640 1 -- 172.21.15.50:0/1404741951 learned_addr learned my addr 172.21.15.50:0/1404741951 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:59.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dc27fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3dcc0b1600 0x7f3dcc0cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35732/0 (socket says 172.21.15.50:35732) 2024-09-11T22:11:59.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dcaffd640 1 --2- 172.21.15.50:0/1404741951 >> v2:172.21.15.77:3300/0 conn(0x7f3dcc161fa0 0x7f3dcc0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dcb7fe640 1 -- 172.21.15.50:0/1404741951 >> v2:172.21.15.77:3300/0 conn(0x7f3dcc161fa0 msgr2=0x7f3dcc0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:11:59.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dcb7fe640 1 --2- 172.21.15.50:0/1404741951 >> v2:172.21.15.77:3300/0 conn(0x7f3dcc161fa0 0x7f3dcc0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dcb7fe640 1 -- 172.21.15.50:0/1404741951 >> v1:172.21.15.50:6789/0 conn(0x7f3dcc0b1600 legacy=0x7f3dcc0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dcb7fe640 1 -- 172.21.15.50:0/1404741951 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dcc0cfeb0 con 0x7f3dcc0cf610 2024-09-11T22:11:59.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dca7fc640 1 -- 172.21.15.50:0/1404741951 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3856350361 0 0) 0x7f3dcc0cfbd0 con 0x7f3dcc0b1600 2024-09-11T22:11:59.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.366+0000 7f3dcaffd640 1 --2- 172.21.15.50:0/1404741951 >> v2:172.21.15.77:3300/0 conn(0x7f3dcc161fa0 0x7f3dcc0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:11:59.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.367+0000 7f3dcb7fe640 1 --2- 172.21.15.50:0/1404741951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dcc0cf610 0x7f3dcc0cccd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc072960 tx=0x7f3dc402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa781be2bd1c2a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:59.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.367+0000 7f3dca7fc640 1 -- 172.21.15.50:0/1404741951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4036070 con 0x7f3dcc0cf610 2024-09-11T22:11:59.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.367+0000 7f3dca7fc640 1 -- 172.21.15.50:0/1404741951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc4031600 con 0x7f3dcc0cf610 2024-09-11T22:11:59.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.367+0000 7f3dca7fc640 1 -- 172.21.15.50:0/1404741951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc40319d0 con 0x7f3dcc0cf610 2024-09-11T22:11:59.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.368+0000 7f3dd180e640 1 -- 172.21.15.50:0/1404741951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dcc0cf610 msgr2=0x7f3dcc0cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.368+0000 7f3dd180e640 1 --2- 172.21.15.50:0/1404741951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dcc0cf610 0x7f3dcc0cccd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc072960 tx=0x7f3dc402a730 comp rx=0 tx=0).stop 2024-09-11T22:11:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.368+0000 7f3dd180e640 1 -- 172.21.15.50:0/1404741951 shutdown_connections 2024-09-11T22:11:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.368+0000 7f3dd180e640 1 --2- 172.21.15.50:0/1404741951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dcc0cf610 0x7f3dcc0cccd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.368+0000 7f3dd180e640 1 --2- 172.21.15.50:0/1404741951 >> v2:172.21.15.77:3300/0 conn(0x7f3dcc161fa0 0x7f3dcc0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.368+0000 7f3dd180e640 1 -- 172.21.15.50:0/1404741951 >> 172.21.15.50:0/1404741951 conn(0x7f3dcc09ba50 msgr2=0x7f3dcc0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.368+0000 7f3dd180e640 1 -- 172.21.15.50:0/1404741951 shutdown_connections 2024-09-11T22:11:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.368+0000 7f3dd180e640 1 -- 172.21.15.50:0/1404741951 wait complete. 2024-09-11T22:11:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.369+0000 7f3dd180e640 1 Processor -- start 2024-09-11T22:11:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.369+0000 7f3dd180e640 1 -- start start 2024-09-11T22:11:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dd180e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dcc0b1600 0x7f3dcc15b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dd180e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dcc0cf610 0x7f3dcc070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dd180e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dcc161fa0 0x7f3dcc070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dd180e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc162500 con 0x7f3dcc0b1600 2024-09-11T22:11:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dd180e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc162380 con 0x7f3dcc0cf610 2024-09-11T22:11:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dd180e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3dcc0d1c70 con 0x7f3dcc161fa0 2024-09-11T22:11:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dcaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dcc0b1600 0x7f3dcc15b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dcaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dcc0b1600 0x7f3dcc15b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52616/0 (socket says 172.21.15.50:52616) 2024-09-11T22:11:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dcaffd640 1 -- 172.21.15.50:0/2474233477 learned_addr learned my addr 172.21.15.50:0/2474233477 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:59.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dc27fc640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dcc0cf610 0x7f3dcc070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dcb7fe640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dcc161fa0 0x7f3dcc070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dcaffd640 1 -- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dcc161fa0 msgr2=0x7f3dcc070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dcaffd640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dcc161fa0 0x7f3dcc070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dcaffd640 1 -- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dcc0cf610 msgr2=0x7f3dcc070760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dcaffd640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dcc0cf610 0x7f3dcc070760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dcaffd640 1 -- 172.21.15.50:0/2474233477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dcc0c9c10 con 0x7f3dcc0b1600 2024-09-11T22:11:59.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.370+0000 7f3dcaffd640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dcc0b1600 0x7f3dcc15b9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00c820 tx=0x7f3dbc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:59.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.371+0000 7f3dc8ff9640 1 -- 172.21.15.50:0/2474233477 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc015070 con 0x7f3dcc0b1600 2024-09-11T22:11:59.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.371+0000 7f3dd180e640 1 -- 172.21.15.50:0/2474233477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dcc0b7ca0 con 0x7f3dcc0b1600 2024-09-11T22:11:59.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.371+0000 7f3dd180e640 1 -- 172.21.15.50:0/2474233477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dcc0b8260 con 0x7f3dcc0b1600 2024-09-11T22:11:59.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.371+0000 7f3dc8ff9640 1 -- 172.21.15.50:0/2474233477 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dbc0079d0 con 0x7f3dcc0b1600 2024-09-11T22:11:59.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.371+0000 7f3dc8ff9640 1 -- 172.21.15.50:0/2474233477 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc01f060 con 0x7f3dcc0b1600 2024-09-11T22:11:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.372+0000 7f3dd180e640 1 -- 172.21.15.50:0/2474233477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db0005290 con 0x7f3dcc0b1600 2024-09-11T22:11:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.372+0000 7f3dc8ff9640 1 -- 172.21.15.50:0/2474233477 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3dbc018070 con 0x7f3dcc0b1600 2024-09-11T22:11:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.373+0000 7f3dc8ff9640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3dac06be30 0x7f3dac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.373+0000 7f3dc8ff9640 1 -- 172.21.15.50:0/2474233477 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f3dbc08b080 con 0x7f3dcc0b1600 2024-09-11T22:11:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.373+0000 7f3dc27fc640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3dac06be30 0x7f3dac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.373+0000 7f3dc27fc640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3dac06be30 0x7f3dac06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc1f73f0 tx=0x7f3db4007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:59.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.377+0000 7f3dc8ff9640 1 -- 172.21.15.50:0/2474233477 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3dbc059360 con 0x7f3dcc0b1600 2024-09-11T22:11:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.550+0000 7f3dd180e640 1 -- 172.21.15.50:0/2474233477 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3db0000bc0 con 0x7f3dac06be30 2024-09-11T22:11:59.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.557+0000 7f3dc8ff9640 1 -- 172.21.15.50:0/2474233477 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248188 (secure 0 0 0) 0x7f3db0000bc0 con 0x7f3dac06be30 2024-09-11T22:11:59.562 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:11:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.559+0000 7f3dd180e640 1 -- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3dac06be30 msgr2=0x7f3dac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.560+0000 7f3dd180e640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3dac06be30 0x7f3dac06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc1f73f0 tx=0x7f3db4007de0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.560+0000 7f3dd180e640 1 -- 172.21.15.50:0/2474233477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dcc0b1600 msgr2=0x7f3dcc15b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.560+0000 7f3dd180e640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dcc0b1600 0x7f3dcc15b9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00c820 tx=0x7f3dbc00cc20 comp rx=0 tx=0).stop 2024-09-11T22:11:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.560+0000 7f3dd180e640 1 -- 172.21.15.50:0/2474233477 shutdown_connections 2024-09-11T22:11:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.560+0000 7f3dd180e640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3dac06be30 0x7f3dac06e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.560+0000 7f3dd180e640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dcc161fa0 0x7f3dcc070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.560+0000 7f3dd180e640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dcc0cf610 0x7f3dcc070760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.560+0000 7f3dd180e640 1 --2- 172.21.15.50:0/2474233477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dcc0b1600 0x7f3dcc15b9f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.560+0000 7f3dd180e640 1 -- 172.21.15.50:0/2474233477 >> 172.21.15.50:0/2474233477 conn(0x7f3dcc09ba50 msgr2=0x7f3dcc0af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.560+0000 7f3dd180e640 1 -- 172.21.15.50:0/2474233477 shutdown_connections 2024-09-11T22:11:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.560+0000 7f3dd180e640 1 -- 172.21.15.50:0/2474233477 wait complete. 2024-09-11T22:11:59.571 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-11T22:11:59.373736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240732,"kb_used_data":3704,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733988,"statfs":{"total":773094113280,"available":772847603712,"internally_reserved":0,"allocated":3792896,"data_stored":2152356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001165"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224159+0000","last_change":"2024-09-11T22:11:54.224159+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224159+0000","last_undegraded":"2024-09-11T22:11:54.224159+0000","last_fullsized":"2024-09-11T22:11:54.224159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.229076+0000","last_change":"2024-09-11T22:11:54.229076+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.229076+0000","last_undegraded":"2024-09-11T22:11:54.229076+0000","last_fullsized":"2024-09-11T22:11:54.229076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221597+0000","last_change":"2024-09-11T22:11:54.221597+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221597+0000","last_undegraded":"2024-09-11T22:11:54.221597+0000","last_fullsized":"2024-09-11T22:11:54.221597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227738+0000","last_change":"2024-09-11T22:11:54.227738+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227738+0000","last_undegraded":"2024-09-11T22:11:54.227738+0000","last_fullsized":"2024-09-11T22:11:54.227738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269751+0000","last_change":"2024-09-11T22:11:55.239987+0000","last_active":"2024-09-11T22:11:56.269751+0000","last_peered":"2024-09-11T22:11:56.269751+0000","last_clean":"2024-09-11T22:11:56.269751+0000","last_became_active":"2024-09-11T22:11:55.239721+0000","last_became_peered":"2024-09-11T22:11:55.239721+0000","last_unstale":"2024-09-11T22:11:56.269751+0000","last_undegraded":"2024-09-11T22:11:56.269751+0000","last_fullsized":"2024-09-11T22:11:56.269751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:55.478293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224484+0000","last_change":"2024-09-11T22:11:54.224484+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224484+0000","last_undegraded":"2024-09-11T22:11:54.224484+0000","last_fullsized":"2024-09-11T22:11:54.224484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376942+0000","last_change":"2024-09-11T22:11:55.243344+0000","last_active":"2024-09-11T22:11:56.376942+0000","last_peered":"2024-09-11T22:11:56.376942+0000","last_clean":"2024-09-11T22:11:56.376942+0000","last_became_active":"2024-09-11T22:11:55.243030+0000","last_became_peered":"2024-09-11T22:11:55.243030+0000","last_unstale":"2024-09-11T22:11:56.376942+0000","last_undegraded":"2024-09-11T22:11:56.376942+0000","last_fullsized":"2024-09-11T22:11:56.376942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:37.498219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376653+0000","last_change":"2024-09-11T22:11:55.246301+0000","last_active":"2024-09-11T22:11:56.376653+0000","last_peered":"2024-09-11T22:11:56.376653+0000","last_clean":"2024-09-11T22:11:56.376653+0000","last_became_active":"2024-09-11T22:11:55.246028+0000","last_became_peered":"2024-09-11T22:11:55.246028+0000","last_unstale":"2024-09-11T22:11:56.376653+0000","last_undegraded":"2024-09-11T22:11:56.376653+0000","last_fullsized":"2024-09-11T22:11:56.376653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:59.563540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221431+0000","last_change":"2024-09-11T22:11:54.221431+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221431+0000","last_undegraded":"2024-09-11T22:11:54.221431+0000","last_fullsized":"2024-09-11T22:11:54.221431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.229724+0000","last_change":"2024-09-11T22:11:54.229724+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.229724+0000","last_undegraded":"2024-09-11T22:11:54.229724+0000","last_fullsized":"2024-09-11T22:11:54.229724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376923+0000","last_change":"2024-09-11T22:11:55.247502+0000","last_active":"2024-09-11T22:11:56.376923+0000","last_peered":"2024-09-11T22:11:56.376923+0000","last_clean":"2024-09-11T22:11:56.376923+0000","last_became_active":"2024-09-11T22:11:55.247218+0000","last_became_peered":"2024-09-11T22:11:55.247218+0000","last_unstale":"2024-09-11T22:11:56.376923+0000","last_undegraded":"2024-09-11T22:11:56.376923+0000","last_fullsized":"2024-09-11T22:11:56.376923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:18.187116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.220138+0000","last_change":"2024-09-11T22:11:54.220138+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.220138+0000","last_undegraded":"2024-09-11T22:11:54.220138+0000","last_fullsized":"2024-09-11T22:11:54.220138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269761+0000","last_change":"2024-09-11T22:11:55.245085+0000","last_active":"2024-09-11T22:11:56.269761+0000","last_peered":"2024-09-11T22:11:56.269761+0000","last_clean":"2024-09-11T22:11:56.269761+0000","last_became_active":"2024-09-11T22:11:55.244705+0000","last_became_peered":"2024-09-11T22:11:55.244705+0000","last_unstale":"2024-09-11T22:11:56.269761+0000","last_undegraded":"2024-09-11T22:11:56.269761+0000","last_fullsized":"2024-09-11T22:11:56.269761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:16.047678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224055+0000","last_change":"2024-09-11T22:11:54.224055+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224055+0000","last_undegraded":"2024-09-11T22:11:54.224055+0000","last_fullsized":"2024-09-11T22:11:54.224055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219788+0000","last_change":"2024-09-11T22:11:54.219788+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219788+0000","last_undegraded":"2024-09-11T22:11:54.219788+0000","last_fullsized":"2024-09-11T22:11:54.219788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377400+0000","last_change":"2024-09-11T22:11:55.246859+0000","last_active":"2024-09-11T22:11:56.377400+0000","last_peered":"2024-09-11T22:11:56.377400+0000","last_clean":"2024-09-11T22:11:56.377400+0000","last_became_active":"2024-09-11T22:11:55.246525+0000","last_became_peered":"2024-09-11T22:11:55.246525+0000","last_unstale":"2024-09-11T22:11:56.377400+0000","last_undegraded":"2024-09-11T22:11:56.377400+0000","last_fullsized":"2024-09-11T22:11:56.377400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:13.049644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377405+0000","last_change":"2024-09-11T22:11:55.242378+0000","last_active":"2024-09-11T22:11:56.377405+0000","last_peered":"2024-09-11T22:11:56.377405+0000","last_clean":"2024-09-11T22:11:56.377405+0000","last_became_active":"2024-09-11T22:11:55.242045+0000","last_became_peered":"2024-09-11T22:11:55.242045+0000","last_unstale":"2024-09-11T22:11:56.377405+0000","last_undegraded":"2024-09-11T22:11:56.377405+0000","last_fullsized":"2024-09-11T22:11:56.377405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:03.220536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228643+0000","last_change":"2024-09-11T22:11:54.228643+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228643+0000","last_undegraded":"2024-09-11T22:11:54.228643+0000","last_fullsized":"2024-09-11T22:11:54.228643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228176+0000","last_change":"2024-09-11T22:11:54.228176+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228176+0000","last_undegraded":"2024-09-11T22:11:54.228176+0000","last_fullsized":"2024-09-11T22:11:54.228176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269902+0000","last_change":"2024-09-11T22:11:55.241292+0000","last_active":"2024-09-11T22:11:56.269902+0000","last_peered":"2024-09-11T22:11:56.269902+0000","last_clean":"2024-09-11T22:11:56.269902+0000","last_became_active":"2024-09-11T22:11:55.241027+0000","last_became_peered":"2024-09-11T22:11:55.241027+0000","last_unstale":"2024-09-11T22:11:56.269902+0000","last_undegraded":"2024-09-11T22:11:56.269902+0000","last_fullsized":"2024-09-11T22:11:56.269902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:22.305162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222305+0000","last_change":"2024-09-11T22:11:54.222305+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222305+0000","last_undegraded":"2024-09-11T22:11:54.222305+0000","last_fullsized":"2024-09-11T22:11:54.222305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223221+0000","last_change":"2024-09-11T22:11:54.223221+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223221+0000","last_undegraded":"2024-09-11T22:11:54.223221+0000","last_fullsized":"2024-09-11T22:11:54.223221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223878+0000","last_change":"2024-09-11T22:11:54.223878+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223878+0000","last_undegraded":"2024-09-11T22:11:54.223878+0000","last_fullsized":"2024-09-11T22:11:54.223878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221189+0000","last_change":"2024-09-11T22:11:54.221189+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221189+0000","last_undegraded":"2024-09-11T22:11:54.221189+0000","last_fullsized":"2024-09-11T22:11:54.221189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.226803+0000","last_change":"2024-09-11T22:11:54.226803+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.226803+0000","last_undegraded":"2024-09-11T22:11:54.226803+0000","last_fullsized":"2024-09-11T22:11:54.226803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228131+0000","last_change":"2024-09-11T22:11:54.228131+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228131+0000","last_undegraded":"2024-09-11T22:11:54.228131+0000","last_fullsized":"2024-09-11T22:11:54.228131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228102+0000","last_change":"2024-09-11T22:11:54.228102+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228102+0000","last_undegraded":"2024-09-11T22:11:54.228102+0000","last_fullsized":"2024-09-11T22:11:54.228102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219566+0000","last_change":"2024-09-11T22:11:54.219566+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219566+0000","last_undegraded":"2024-09-11T22:11:54.219566+0000","last_fullsized":"2024-09-11T22:11:54.219566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221780+0000","last_change":"2024-09-11T22:11:54.221780+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221780+0000","last_undegraded":"2024-09-11T22:11:54.221780+0000","last_fullsized":"2024-09-11T22:11:54.221780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376796+0000","last_change":"2024-09-11T22:11:55.240071+0000","last_active":"2024-09-11T22:11:56.376796+0000","last_peered":"2024-09-11T22:11:56.376796+0000","last_clean":"2024-09-11T22:11:56.376796+0000","last_became_active":"2024-09-11T22:11:55.239614+0000","last_became_peered":"2024-09-11T22:11:55.239614+0000","last_unstale":"2024-09-11T22:11:56.376796+0000","last_undegraded":"2024-09-11T22:11:56.376796+0000","last_fullsized":"2024-09-11T22:11:56.376796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:27.962254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223953+0000","last_change":"2024-09-11T22:11:54.223953+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223953+0000","last_undegraded":"2024-09-11T22:11:54.223953+0000","last_fullsized":"2024-09-11T22:11:54.223953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377381+0000","last_change":"2024-09-11T22:11:55.240387+0000","last_active":"2024-09-11T22:11:56.377381+0000","last_peered":"2024-09-11T22:11:56.377381+0000","last_clean":"2024-09-11T22:11:56.377381+0000","last_became_active":"2024-09-11T22:11:55.239801+0000","last_became_peered":"2024-09-11T22:11:55.239801+0000","last_unstale":"2024-09-11T22:11:56.377381+0000","last_undegraded":"2024-09-11T22:11:56.377381+0000","last_fullsized":"2024-09-11T22:11:56.377381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:18.124249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222801+0000","last_change":"2024-09-11T22:11:54.222801+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222801+0000","last_undegraded":"2024-09-11T22:11:54.222801+0000","last_fullsized":"2024-09-11T22:11:54.222801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.233686+0000","last_change":"2024-09-11T22:11:54.232005+0000","last_active":"2024-09-11T22:11:54.233686+0000","last_peered":"2024-09-11T22:11:54.233686+0000","last_clean":"2024-09-11T22:11:54.233686+0000","last_became_active":"2024-09-11T22:11:54.231733+0000","last_became_peered":"2024-09-11T22:11:54.231733+0000","last_unstale":"2024-09-11T22:11:54.233686+0000","last_undegraded":"2024-09-11T22:11:54.233686+0000","last_fullsized":"2024-09-11T22:11:54.233686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.252826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223447+0000","last_change":"2024-09-11T22:11:54.223447+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223447+0000","last_undegraded":"2024-09-11T22:11:54.223447+0000","last_fullsized":"2024-09-11T22:11:54.223447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.234329+0000","last_change":"2024-09-11T22:11:54.231904+0000","last_active":"2024-09-11T22:11:54.234329+0000","last_peered":"2024-09-11T22:11:54.234329+0000","last_clean":"2024-09-11T22:11:54.234329+0000","last_became_active":"2024-09-11T22:11:54.231599+0000","last_became_peered":"2024-09-11T22:11:54.231599+0000","last_unstale":"2024-09-11T22:11:54.234329+0000","last_undegraded":"2024-09-11T22:11:54.234329+0000","last_fullsized":"2024-09-11T22:11:54.234329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:40.341037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222896+0000","last_change":"2024-09-11T22:11:54.222896+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222896+0000","last_undegraded":"2024-09-11T22:11:54.222896+0000","last_fullsized":"2024-09-11T22:11:54.222896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.238935+0000","last_change":"2024-09-11T22:11:54.237587+0000","last_active":"2024-09-11T22:11:54.238935+0000","last_peered":"2024-09-11T22:11:54.238935+0000","last_clean":"2024-09-11T22:11:54.238935+0000","last_became_active":"2024-09-11T22:11:54.237269+0000","last_became_peered":"2024-09-11T22:11:54.237269+0000","last_unstale":"2024-09-11T22:11:54.238935+0000","last_undegraded":"2024-09-11T22:11:54.238935+0000","last_fullsized":"2024-09-11T22:11:54.238935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:37.436803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224975+0000","last_change":"2024-09-11T22:11:54.224975+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224975+0000","last_undegraded":"2024-09-11T22:11:54.224975+0000","last_fullsized":"2024-09-11T22:11:54.224975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269864+0000","last_change":"2024-09-11T22:11:54.235284+0000","last_active":"2024-09-11T22:11:56.269864+0000","last_peered":"2024-09-11T22:11:56.269864+0000","last_clean":"2024-09-11T22:11:56.269864+0000","last_became_active":"2024-09-11T22:11:54.234997+0000","last_became_peered":"2024-09-11T22:11:54.234997+0000","last_unstale":"2024-09-11T22:11:56.269864+0000","last_undegraded":"2024-09-11T22:11:56.269864+0000","last_fullsized":"2024-09-11T22:11:56.269864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:10.204976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377327+0000","last_change":"2024-09-11T22:11:55.240321+0000","last_active":"2024-09-11T22:11:56.377327+0000","last_peered":"2024-09-11T22:11:56.377327+0000","last_clean":"2024-09-11T22:11:56.377327+0000","last_became_active":"2024-09-11T22:11:55.240027+0000","last_became_peered":"2024-09-11T22:11:55.240027+0000","last_unstale":"2024-09-11T22:11:56.377327+0000","last_undegraded":"2024-09-11T22:11:56.377327+0000","last_fullsized":"2024-09-11T22:11:56.377327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:41.384734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.234552+0000","last_change":"2024-09-11T22:11:54.232989+0000","last_active":"2024-09-11T22:11:54.234552+0000","last_peered":"2024-09-11T22:11:54.234552+0000","last_clean":"2024-09-11T22:11:54.234552+0000","last_became_active":"2024-09-11T22:11:54.232619+0000","last_became_peered":"2024-09-11T22:11:54.232619+0000","last_unstale":"2024-09-11T22:11:54.234552+0000","last_undegraded":"2024-09-11T22:11:54.234552+0000","last_fullsized":"2024-09-11T22:11:54.234552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:05.203238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221366+0000","last_change":"2024-09-11T22:11:54.221366+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221366+0000","last_undegraded":"2024-09-11T22:11:54.221366+0000","last_fullsized":"2024-09-11T22:11:54.221366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240469+0000","last_change":"2024-09-11T22:11:54.235628+0000","last_active":"2024-09-11T22:11:54.240469+0000","last_peered":"2024-09-11T22:11:54.240469+0000","last_clean":"2024-09-11T22:11:54.240469+0000","last_became_active":"2024-09-11T22:11:54.235423+0000","last_became_peered":"2024-09-11T22:11:54.235423+0000","last_unstale":"2024-09-11T22:11:54.240469+0000","last_undegraded":"2024-09-11T22:11:54.240469+0000","last_fullsized":"2024-09-11T22:11:54.240469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:54.817240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222277+0000","last_change":"2024-09-11T22:11:54.222277+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222277+0000","last_undegraded":"2024-09-11T22:11:54.222277+0000","last_fullsized":"2024-09-11T22:11:54.222277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.236777+0000","last_change":"2024-09-11T22:11:54.235445+0000","last_active":"2024-09-11T22:11:54.236777+0000","last_peered":"2024-09-11T22:11:54.236777+0000","last_clean":"2024-09-11T22:11:54.236777+0000","last_became_active":"2024-09-11T22:11:54.235120+0000","last_became_peered":"2024-09-11T22:11:54.235120+0000","last_unstale":"2024-09-11T22:11:54.236777+0000","last_undegraded":"2024-09-11T22:11:54.236777+0000","last_fullsized":"2024-09-11T22:11:54.236777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.226269+0000","last_change":"2024-09-11T22:11:54.226269+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.226269+0000","last_undegraded":"2024-09-11T22:11:54.226269+0000","last_fullsized":"2024-09-11T22:11:54.226269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230815+0000","last_change":"2024-09-11T22:11:54.229723+0000","last_active":"2024-09-11T22:11:54.230815+0000","last_peered":"2024-09-11T22:11:54.230815+0000","last_clean":"2024-09-11T22:11:54.230815+0000","last_became_active":"2024-09-11T22:11:54.228533+0000","last_became_peered":"2024-09-11T22:11:54.228533+0000","last_unstale":"2024-09-11T22:11:54.230815+0000","last_undegraded":"2024-09-11T22:11:54.230815+0000","last_fullsized":"2024-09-11T22:11:54.230815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:18.975678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.220078+0000","last_change":"2024-09-11T22:11:54.220078+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.220078+0000","last_undegraded":"2024-09-11T22:11:54.220078+0000","last_fullsized":"2024-09-11T22:11:54.220078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.238487+0000","last_change":"2024-09-11T22:11:54.237543+0000","last_active":"2024-09-11T22:11:54.238487+0000","last_peered":"2024-09-11T22:11:54.238487+0000","last_clean":"2024-09-11T22:11:54.238487+0000","last_became_active":"2024-09-11T22:11:54.235862+0000","last_became_peered":"2024-09-11T22:11:54.235862+0000","last_unstale":"2024-09-11T22:11:54.238487+0000","last_undegraded":"2024-09-11T22:11:54.238487+0000","last_fullsized":"2024-09-11T22:11:54.238487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:49.788303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227816+0000","last_change":"2024-09-11T22:11:54.227816+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227816+0000","last_undegraded":"2024-09-11T22:11:54.227816+0000","last_fullsized":"2024-09-11T22:11:54.227816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240131+0000","last_change":"2024-09-11T22:11:54.238373+0000","last_active":"2024-09-11T22:11:54.240131+0000","last_peered":"2024-09-11T22:11:54.240131+0000","last_clean":"2024-09-11T22:11:54.240131+0000","last_became_active":"2024-09-11T22:11:54.238087+0000","last_became_peered":"2024-09-11T22:11:54.238087+0000","last_unstale":"2024-09-11T22:11:54.240131+0000","last_undegraded":"2024-09-11T22:11:54.240131+0000","last_fullsized":"2024-09-11T22:11:54.240131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228313+0000","last_change":"2024-09-11T22:11:54.228313+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228313+0000","last_undegraded":"2024-09-11T22:11:54.228313+0000","last_fullsized":"2024-09-11T22:11:54.228313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.233865+0000","last_change":"2024-09-11T22:11:54.231853+0000","last_active":"2024-09-11T22:11:54.233865+0000","last_peered":"2024-09-11T22:11:54.233865+0000","last_clean":"2024-09-11T22:11:54.233865+0000","last_became_active":"2024-09-11T22:11:54.231564+0000","last_became_peered":"2024-09-11T22:11:54.231564+0000","last_unstale":"2024-09-11T22:11:54.233865+0000","last_undegraded":"2024-09-11T22:11:54.233865+0000","last_fullsized":"2024-09-11T22:11:54.233865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:36.010268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224117+0000","last_change":"2024-09-11T22:11:54.224117+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224117+0000","last_undegraded":"2024-09-11T22:11:54.224117+0000","last_fullsized":"2024-09-11T22:11:54.224117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239473+0000","last_change":"2024-09-11T22:11:54.238142+0000","last_active":"2024-09-11T22:11:54.239473+0000","last_peered":"2024-09-11T22:11:54.239473+0000","last_clean":"2024-09-11T22:11:54.239473+0000","last_became_active":"2024-09-11T22:11:54.237819+0000","last_became_peered":"2024-09-11T22:11:54.237819+0000","last_unstale":"2024-09-11T22:11:54.239473+0000","last_undegraded":"2024-09-11T22:11:54.239473+0000","last_fullsized":"2024-09-11T22:11:54.239473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:57.762834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227662+0000","last_change":"2024-09-11T22:11:54.227662+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227662+0000","last_undegraded":"2024-09-11T22:11:54.227662+0000","last_fullsized":"2024-09-11T22:11:54.227662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230860+0000","last_change":"2024-09-11T22:11:54.228141+0000","last_active":"2024-09-11T22:11:54.230860+0000","last_peered":"2024-09-11T22:11:54.230860+0000","last_clean":"2024-09-11T22:11:54.230860+0000","last_became_active":"2024-09-11T22:11:54.227742+0000","last_became_peered":"2024-09-11T22:11:54.227742+0000","last_unstale":"2024-09-11T22:11:54.230860+0000","last_undegraded":"2024-09-11T22:11:54.230860+0000","last_fullsized":"2024-09-11T22:11:54.230860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:00.285086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222828+0000","last_change":"2024-09-11T22:11:54.222828+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222828+0000","last_undegraded":"2024-09-11T22:11:54.222828+0000","last_fullsized":"2024-09-11T22:11:54.222828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239957+0000","last_change":"2024-09-11T22:11:54.238756+0000","last_active":"2024-09-11T22:11:54.239957+0000","last_peered":"2024-09-11T22:11:54.239957+0000","last_clean":"2024-09-11T22:11:54.239957+0000","last_became_active":"2024-09-11T22:11:54.238411+0000","last_became_peered":"2024-09-11T22:11:54.238411+0000","last_unstale":"2024-09-11T22:11:54.239957+0000","last_undegraded":"2024-09-11T22:11:54.239957+0000","last_fullsized":"2024-09-11T22:11:54.239957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.252826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377052+0000","last_change":"2024-09-11T22:11:55.240613+0000","last_active":"2024-09-11T22:11:56.377052+0000","last_peered":"2024-09-11T22:11:56.377052+0000","last_clean":"2024-09-11T22:11:56.377052+0000","last_became_active":"2024-09-11T22:11:55.240113+0000","last_became_peered":"2024-09-11T22:11:55.240113+0000","last_unstale":"2024-09-11T22:11:56.377052+0000","last_undegraded":"2024-09-11T22:11:56.377052+0000","last_fullsized":"2024-09-11T22:11:56.377052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:11.783248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.236974+0000","last_change":"2024-09-11T22:11:54.236090+0000","last_active":"2024-09-11T22:11:54.236974+0000","last_peered":"2024-09-11T22:11:54.236974+0000","last_clean":"2024-09-11T22:11:54.236974+0000","last_became_active":"2024-09-11T22:11:54.235800+0000","last_became_peered":"2024-09-11T22:11:54.235800+0000","last_unstale":"2024-09-11T22:11:54.236974+0000","last_undegraded":"2024-09-11T22:11:54.236974+0000","last_fullsized":"2024-09-11T22:11:54.236974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223419+0000","last_change":"2024-09-11T22:11:54.223419+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223419+0000","last_undegraded":"2024-09-11T22:11:54.223419+0000","last_fullsized":"2024-09-11T22:11:54.223419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239458+0000","last_change":"2024-09-11T22:11:54.238384+0000","last_active":"2024-09-11T22:11:54.239458+0000","last_peered":"2024-09-11T22:11:54.239458+0000","last_clean":"2024-09-11T22:11:54.239458+0000","last_became_active":"2024-09-11T22:11:54.237149+0000","last_became_peered":"2024-09-11T22:11:54.237149+0000","last_unstale":"2024-09-11T22:11:54.239458+0000","last_undegraded":"2024-09-11T22:11:54.239458+0000","last_fullsized":"2024-09-11T22:11:54.239458+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:58.538834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219747+0000","last_change":"2024-09-11T22:11:54.219747+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219747+0000","last_undegraded":"2024-09-11T22:11:54.219747+0000","last_fullsized":"2024-09-11T22:11:54.219747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240895+0000","last_change":"2024-09-11T22:11:54.239702+0000","last_active":"2024-09-11T22:11:54.240895+0000","last_peered":"2024-09-11T22:11:54.240895+0000","last_clean":"2024-09-11T22:11:54.240895+0000","last_became_active":"2024-09-11T22:11:54.239399+0000","last_became_peered":"2024-09-11T22:11:54.239399+0000","last_unstale":"2024-09-11T22:11:54.240895+0000","last_undegraded":"2024-09-11T22:11:54.240895+0000","last_fullsized":"2024-09-11T22:11:54.240895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223586+0000","last_change":"2024-09-11T22:11:54.223586+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223586+0000","last_undegraded":"2024-09-11T22:11:54.223586+0000","last_fullsized":"2024-09-11T22:11:54.223586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230828+0000","last_change":"2024-09-11T22:11:54.229239+0000","last_active":"2024-09-11T22:11:54.230828+0000","last_peered":"2024-09-11T22:11:54.230828+0000","last_clean":"2024-09-11T22:11:54.230828+0000","last_became_active":"2024-09-11T22:11:54.228972+0000","last_became_peered":"2024-09-11T22:11:54.228972+0000","last_unstale":"2024-09-11T22:11:54.230828+0000","last_undegraded":"2024-09-11T22:11:54.230828+0000","last_fullsized":"2024-09-11T22:11:54.230828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:43.406978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227247+0000","last_change":"2024-09-11T22:11:54.227247+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227247+0000","last_undegraded":"2024-09-11T22:11:54.227247+0000","last_fullsized":"2024-09-11T22:11:54.227247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230737+0000","last_change":"2024-09-11T22:11:54.227381+0000","last_active":"2024-09-11T22:11:54.230737+0000","last_peered":"2024-09-11T22:11:54.230737+0000","last_clean":"2024-09-11T22:11:54.230737+0000","last_became_active":"2024-09-11T22:11:54.226564+0000","last_became_peered":"2024-09-11T22:11:54.226564+0000","last_unstale":"2024-09-11T22:11:54.230737+0000","last_undegraded":"2024-09-11T22:11:54.230737+0000","last_fullsized":"2024-09-11T22:11:54.230737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:38.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269896+0000","last_change":"2024-09-11T22:11:55.244562+0000","last_active":"2024-09-11T22:11:56.269896+0000","last_peered":"2024-09-11T22:11:56.269896+0000","last_clean":"2024-09-11T22:11:56.269896+0000","last_became_active":"2024-09-11T22:11:55.244183+0000","last_became_peered":"2024-09-11T22:11:55.244183+0000","last_unstale":"2024-09-11T22:11:56.269896+0000","last_undegraded":"2024-09-11T22:11:56.269896+0000","last_fullsized":"2024-09-11T22:11:56.269896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:27.980484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240436+0000","last_change":"2024-09-11T22:11:54.235155+0000","last_active":"2024-09-11T22:11:54.240436+0000","last_peered":"2024-09-11T22:11:54.240436+0000","last_clean":"2024-09-11T22:11:54.240436+0000","last_became_active":"2024-09-11T22:11:54.234931+0000","last_became_peered":"2024-09-11T22:11:54.234931+0000","last_unstale":"2024-09-11T22:11:54.240436+0000","last_undegraded":"2024-09-11T22:11:54.240436+0000","last_fullsized":"2024-09-11T22:11:54.240436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:56.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269770+0000","last_change":"2024-09-11T22:11:55.245345+0000","last_active":"2024-09-11T22:11:56.269770+0000","last_peered":"2024-09-11T22:11:56.269770+0000","last_clean":"2024-09-11T22:11:56.269770+0000","last_became_active":"2024-09-11T22:11:55.245063+0000","last_became_peered":"2024-09-11T22:11:55.245063+0000","last_unstale":"2024-09-11T22:11:56.269770+0000","last_undegraded":"2024-09-11T22:11:56.269770+0000","last_fullsized":"2024-09-11T22:11:56.269770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:48.949134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.236016+0000","last_change":"2024-09-11T22:11:54.233955+0000","last_active":"2024-09-11T22:11:54.236016+0000","last_peered":"2024-09-11T22:11:54.236016+0000","last_clean":"2024-09-11T22:11:54.236016+0000","last_became_active":"2024-09-11T22:11:54.233649+0000","last_became_peered":"2024-09-11T22:11:54.233649+0000","last_unstale":"2024-09-11T22:11:54.236016+0000","last_undegraded":"2024-09-11T22:11:54.236016+0000","last_fullsized":"2024-09-11T22:11:54.236016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.252826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269860+0000","last_change":"2024-09-11T22:11:55.239063+0000","last_active":"2024-09-11T22:11:56.269860+0000","last_peered":"2024-09-11T22:11:56.269860+0000","last_clean":"2024-09-11T22:11:56.269860+0000","last_became_active":"2024-09-11T22:11:55.238715+0000","last_became_peered":"2024-09-11T22:11:55.238715+0000","last_unstale":"2024-09-11T22:11:56.269860+0000","last_undegraded":"2024-09-11T22:11:56.269860+0000","last_fullsized":"2024-09-11T22:11:56.269860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:12.370780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.245895+0000","last_change":"2024-09-11T22:11:54.237992+0000","last_active":"2024-09-11T22:11:54.245895+0000","last_peered":"2024-09-11T22:11:54.245895+0000","last_clean":"2024-09-11T22:11:54.245895+0000","last_became_active":"2024-09-11T22:11:54.237566+0000","last_became_peered":"2024-09-11T22:11:54.237566+0000","last_unstale":"2024-09-11T22:11:54.245895+0000","last_undegraded":"2024-09-11T22:11:54.245895+0000","last_fullsized":"2024-09-11T22:11:54.245895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269723+0000","last_change":"2024-09-11T22:11:55.239964+0000","last_active":"2024-09-11T22:11:56.269723+0000","last_peered":"2024-09-11T22:11:56.269723+0000","last_clean":"2024-09-11T22:11:56.269723+0000","last_became_active":"2024-09-11T22:11:55.239684+0000","last_became_peered":"2024-09-11T22:11:55.239684+0000","last_unstale":"2024-09-11T22:11:56.269723+0000","last_undegraded":"2024-09-11T22:11:56.269723+0000","last_fullsized":"2024-09-11T22:11:56.269723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:34.837927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240493+0000","last_change":"2024-09-11T22:11:54.235334+0000","last_active":"2024-09-11T22:11:54.240493+0000","last_peered":"2024-09-11T22:11:54.240493+0000","last_clean":"2024-09-11T22:11:54.240493+0000","last_became_active":"2024-09-11T22:11:54.235045+0000","last_became_peered":"2024-09-11T22:11:54.235045+0000","last_unstale":"2024-09-11T22:11:54.240493+0000","last_undegraded":"2024-09-11T22:11:54.240493+0000","last_fullsized":"2024-09-11T22:11:54.240493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:05.982977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376772+0000","last_change":"2024-09-11T22:11:55.243276+0000","last_active":"2024-09-11T22:11:56.376772+0000","last_peered":"2024-09-11T22:11:56.376772+0000","last_clean":"2024-09-11T22:11:56.376772+0000","last_became_active":"2024-09-11T22:11:55.242986+0000","last_became_peered":"2024-09-11T22:11:55.242986+0000","last_unstale":"2024-09-11T22:11:56.376772+0000","last_undegraded":"2024-09-11T22:11:56.376772+0000","last_fullsized":"2024-09-11T22:11:56.376772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:58.609145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240252+0000","last_change":"2024-09-11T22:11:54.233653+0000","last_active":"2024-09-11T22:11:54.240252+0000","last_peered":"2024-09-11T22:11:54.240252+0000","last_clean":"2024-09-11T22:11:54.240252+0000","last_became_active":"2024-09-11T22:11:54.233372+0000","last_became_peered":"2024-09-11T22:11:54.233372+0000","last_unstale":"2024-09-11T22:11:54.240252+0000","last_undegraded":"2024-09-11T22:11:54.240252+0000","last_fullsized":"2024-09-11T22:11:54.240252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:07.799927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269805+0000","last_change":"2024-09-11T22:11:55.240205+0000","last_active":"2024-09-11T22:11:56.269805+0000","last_peered":"2024-09-11T22:11:56.269805+0000","last_clean":"2024-09-11T22:11:56.269805+0000","last_became_active":"2024-09-11T22:11:55.239329+0000","last_became_peered":"2024-09-11T22:11:55.239329+0000","last_unstale":"2024-09-11T22:11:56.269805+0000","last_undegraded":"2024-09-11T22:11:56.269805+0000","last_fullsized":"2024-09-11T22:11:56.269805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:55.632586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.238633+0000","last_change":"2024-09-11T22:11:54.236587+0000","last_active":"2024-09-11T22:11:54.238633+0000","last_peered":"2024-09-11T22:11:54.238633+0000","last_clean":"2024-09-11T22:11:54.238633+0000","last_became_active":"2024-09-11T22:11:54.236280+0000","last_became_peered":"2024-09-11T22:11:54.236280+0000","last_unstale":"2024-09-11T22:11:54.238633+0000","last_undegraded":"2024-09-11T22:11:54.238633+0000","last_fullsized":"2024-09-11T22:11:54.238633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:40.341037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219602+0000","last_change":"2024-09-11T22:11:54.219602+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219602+0000","last_undegraded":"2024-09-11T22:11:54.219602+0000","last_fullsized":"2024-09-11T22:11:54.219602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.237158+0000","last_change":"2024-09-11T22:11:54.235834+0000","last_active":"2024-09-11T22:11:54.237158+0000","last_peered":"2024-09-11T22:11:54.237158+0000","last_clean":"2024-09-11T22:11:54.237158+0000","last_became_active":"2024-09-11T22:11:54.235561+0000","last_became_peered":"2024-09-11T22:11:54.235561+0000","last_unstale":"2024-09-11T22:11:54.237158+0000","last_undegraded":"2024-09-11T22:11:54.237158+0000","last_fullsized":"2024-09-11T22:11:54.237158+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223044+0000","last_change":"2024-09-11T22:11:54.223044+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223044+0000","last_undegraded":"2024-09-11T22:11:54.223044+0000","last_fullsized":"2024-09-11T22:11:54.223044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.237757+0000","last_change":"2024-09-11T22:11:54.234484+0000","last_active":"2024-09-11T22:11:54.237757+0000","last_peered":"2024-09-11T22:11:54.237757+0000","last_clean":"2024-09-11T22:11:54.237757+0000","last_became_active":"2024-09-11T22:11:54.234219+0000","last_became_peered":"2024-09-11T22:11:54.234219+0000","last_unstale":"2024-09-11T22:11:54.237757+0000","last_undegraded":"2024-09-11T22:11:54.237757+0000","last_fullsized":"2024-09-11T22:11:54.237757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:19.243150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223642+0000","last_change":"2024-09-11T22:11:54.223642+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223642+0000","last_undegraded":"2024-09-11T22:11:54.223642+0000","last_fullsized":"2024-09-11T22:11:54.223642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.228711+0000","last_change":"2024-09-11T22:11:54.227468+0000","last_active":"2024-09-11T22:11:54.228711+0000","last_peered":"2024-09-11T22:11:54.228711+0000","last_clean":"2024-09-11T22:11:54.228711+0000","last_became_active":"2024-09-11T22:11:54.227109+0000","last_became_peered":"2024-09-11T22:11:54.227109+0000","last_unstale":"2024-09-11T22:11:54.228711+0000","last_undegraded":"2024-09-11T22:11:54.228711+0000","last_fullsized":"2024-09-11T22:11:54.228711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:19.243150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223384+0000","last_change":"2024-09-11T22:11:54.223384+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223384+0000","last_undegraded":"2024-09-11T22:11:54.223384+0000","last_fullsized":"2024-09-11T22:11:54.223384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.241442+0000","last_change":"2024-09-11T22:11:54.241027+0000","last_active":"2024-09-11T22:11:54.241442+0000","last_peered":"2024-09-11T22:11:54.241442+0000","last_clean":"2024-09-11T22:11:54.241442+0000","last_became_active":"2024-09-11T22:11:54.240641+0000","last_became_peered":"2024-09-11T22:11:54.240641+0000","last_unstale":"2024-09-11T22:11:54.241442+0000","last_undegraded":"2024-09-11T22:11:54.241442+0000","last_fullsized":"2024-09-11T22:11:54.241442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222388+0000","last_change":"2024-09-11T22:11:54.222388+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222388+0000","last_undegraded":"2024-09-11T22:11:54.222388+0000","last_fullsized":"2024-09-11T22:11:54.222388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230715+0000","last_change":"2024-09-11T22:11:54.227045+0000","last_active":"2024-09-11T22:11:54.230715+0000","last_peered":"2024-09-11T22:11:54.230715+0000","last_clean":"2024-09-11T22:11:54.230715+0000","last_became_active":"2024-09-11T22:11:54.226304+0000","last_became_peered":"2024-09-11T22:11:54.226304+0000","last_unstale":"2024-09-11T22:11:54.230715+0000","last_undegraded":"2024-09-11T22:11:54.230715+0000","last_fullsized":"2024-09-11T22:11:54.230715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:03.624960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.220524+0000","last_change":"2024-09-11T22:11:54.220524+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.220524+0000","last_undegraded":"2024-09-11T22:11:54.220524+0000","last_fullsized":"2024-09-11T22:11:54.220524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239434+0000","last_change":"2024-09-11T22:11:54.238048+0000","last_active":"2024-09-11T22:11:54.239434+0000","last_peered":"2024-09-11T22:11:54.239434+0000","last_clean":"2024-09-11T22:11:54.239434+0000","last_became_active":"2024-09-11T22:11:54.237756+0000","last_became_peered":"2024-09-11T22:11:54.237756+0000","last_unstale":"2024-09-11T22:11:54.239434+0000","last_undegraded":"2024-09-11T22:11:54.239434+0000","last_fullsized":"2024-09-11T22:11:54.239434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:14.245228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376935+0000","last_change":"2024-09-11T22:11:55.246959+0000","last_active":"2024-09-11T22:11:56.376935+0000","last_peered":"2024-09-11T22:11:56.376935+0000","last_clean":"2024-09-11T22:11:56.376935+0000","last_became_active":"2024-09-11T22:11:55.246666+0000","last_became_peered":"2024-09-11T22:11:55.246666+0000","last_unstale":"2024-09-11T22:11:56.376935+0000","last_undegraded":"2024-09-11T22:11:56.376935+0000","last_fullsized":"2024-09-11T22:11:56.376935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:44.417139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.233260+0000","last_change":"2024-09-11T22:11:54.231109+0000","last_active":"2024-09-11T22:11:54.233260+0000","last_peered":"2024-09-11T22:11:54.233260+0000","last_clean":"2024-09-11T22:11:54.233260+0000","last_became_active":"2024-09-11T22:11:54.230832+0000","last_became_peered":"2024-09-11T22:11:54.230832+0000","last_unstale":"2024-09-11T22:11:54.233260+0000","last_undegraded":"2024-09-11T22:11:54.233260+0000","last_fullsized":"2024-09-11T22:11:54.233260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:40.341037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377457+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:11:56.377457+0000","last_peered":"2024-09-11T22:11:56.377457+0000","last_clean":"2024-09-11T22:11:56.377457+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:11:56.377457+0000","last_undegraded":"2024-09-11T22:11:56.377457+0000","last_fullsized":"2024-09-11T22:11:56.377457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":909312,"data_stored":706965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":726397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35696,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336144,"statfs":{"total":96636764160,"available":96600211456,"internally_reserved":0,"allocated":356352,"data_stored":136009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:11:59.575 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:11:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.713+0000 7f573e447640 1 Processor -- start 2024-09-11T22:11:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.713+0000 7f573e447640 1 -- start start 2024-09-11T22:11:59.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.714+0000 7f573e447640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f573806e0f0 0x7f573806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.714+0000 7f573e447640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f573815b7e0 con 0x7f5738072e60 2024-09-11T22:11:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.714+0000 7f573e447640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f573815f140 con 0x7f573815b400 2024-09-11T22:11:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.714+0000 7f573e447640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f573815f420 con 0x7f573806e0f0 2024-09-11T22:11:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.715+0000 7f572ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f573806e0f0 0x7f573806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.715+0000 7f572ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f573806e0f0 0x7f573806d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52618/0 (socket says 172.21.15.50:52618) 2024-09-11T22:11:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.715+0000 7f572ffff640 1 -- 172.21.15.50:0/3381388808 learned_addr learned my addr 172.21.15.50:0/3381388808 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.715+0000 7f573c9e4640 1 --1- 172.21.15.50:0/3381388808 >> v1:172.21.15.50:6789/0 conn(0x7f5738072e60 0x7f57380711c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35742/0 (socket says 172.21.15.50:35742) 2024-09-11T22:11:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.715+0000 7f572ffff640 1 -- 172.21.15.50:0/3381388808 >> v1:172.21.15.77:6789/0 conn(0x7f573815b400 legacy=0x7f573806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.715+0000 7f572ffff640 1 -- 172.21.15.50:0/3381388808 >> v1:172.21.15.50:6789/0 conn(0x7f5738072e60 legacy=0x7f57380711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.715+0000 7f572ffff640 1 -- 172.21.15.50:0/3381388808 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573815f700 con 0x7f573806e0f0 2024-09-11T22:11:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.716+0000 7f572ffff640 1 --2- 172.21.15.50:0/3381388808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573806e0f0 0x7f573806d070 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5720009870 tx=0x7f572002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761b0f11fc8a5298 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.716+0000 7f57377fe640 1 -- 172.21.15.50:0/3381388808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5720037070 con 0x7f573806e0f0 2024-09-11T22:11:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.716+0000 7f57377fe640 1 -- 172.21.15.50:0/3381388808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f572002ae50 con 0x7f573806e0f0 2024-09-11T22:11:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.716+0000 7f57377fe640 1 -- 172.21.15.50:0/3381388808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5720032860 con 0x7f573806e0f0 2024-09-11T22:11:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.716+0000 7f573e447640 1 -- 172.21.15.50:0/3381388808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573806e0f0 msgr2=0x7f573806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.716+0000 7f573e447640 1 --2- 172.21.15.50:0/3381388808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573806e0f0 0x7f573806d070 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5720009870 tx=0x7f572002a300 comp rx=0 tx=0).stop 2024-09-11T22:11:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.717+0000 7f573e447640 1 -- 172.21.15.50:0/3381388808 shutdown_connections 2024-09-11T22:11:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.717+0000 7f573e447640 1 --2- 172.21.15.50:0/3381388808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573806e0f0 0x7f573806d070 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.717+0000 7f573e447640 1 -- 172.21.15.50:0/3381388808 >> 172.21.15.50:0/3381388808 conn(0x7f57380679c0 msgr2=0x7f5738067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.717+0000 7f573e447640 1 -- 172.21.15.50:0/3381388808 shutdown_connections 2024-09-11T22:11:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.717+0000 7f573e447640 1 -- 172.21.15.50:0/3381388808 wait complete. 2024-09-11T22:11:59.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.718+0000 7f573e447640 1 Processor -- start 2024-09-11T22:11:59.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.718+0000 7f573e447640 1 -- start start 2024-09-11T22:11:59.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573e447640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f573806e0f0 0x7f57380cece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573e447640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5738072e60 0x7f573814b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573e447640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573815b400 0x7f57380ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573e447640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f57380718d0 con 0x7f573815b400 2024-09-11T22:11:59.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573e447640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f57380cfc50 con 0x7f5738072e60 2024-09-11T22:11:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573e447640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5738071a50 con 0x7f573806e0f0 2024-09-11T22:11:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573c9e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573815b400 0x7f57380ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573c9e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573815b400 0x7f57380ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52632/0 (socket says 172.21.15.50:52632) 2024-09-11T22:11:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573c9e4640 1 -- 172.21.15.50:0/2629182934 learned_addr learned my addr 172.21.15.50:0/2629182934 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:11:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f572ffff640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5738072e60 0x7f573814b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f5737fff640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f573806e0f0 0x7f57380cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573c9e4640 1 -- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f573806e0f0 msgr2=0x7f57380cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573c9e4640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f573806e0f0 0x7f57380cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573c9e4640 1 -- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5738072e60 msgr2=0x7f573814b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573c9e4640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5738072e60 0x7f573814b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573c9e4640 1 -- 172.21.15.50:0/2629182934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573815e860 con 0x7f573815b400 2024-09-11T22:11:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573c9e4640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573815b400 0x7f57380ae8c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f573000c7a0 tx=0x7f573000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:59.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f57357fa640 1 -- 172.21.15.50:0/2629182934 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730017070 con 0x7f573815b400 2024-09-11T22:11:59.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f57357fa640 1 -- 172.21.15.50:0/2629182934 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f573000a640 con 0x7f573815b400 2024-09-11T22:11:59.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573e447640 1 -- 172.21.15.50:0/2629182934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57381e4dc0 con 0x7f573815b400 2024-09-11T22:11:59.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f57357fa640 1 -- 172.21.15.50:0/2629182934 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573000a9f0 con 0x7f573815b400 2024-09-11T22:11:59.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.719+0000 7f573e447640 1 -- 172.21.15.50:0/2629182934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57381e5380 con 0x7f573815b400 2024-09-11T22:11:59.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.720+0000 7f573e447640 1 -- 172.21.15.50:0/2629182934 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5738075770 con 0x7f573815b400 2024-09-11T22:11:59.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.721+0000 7f57357fa640 1 -- 172.21.15.50:0/2629182934 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f573001a070 con 0x7f573815b400 2024-09-11T22:11:59.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.721+0000 7f57357fa640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f571806be30 0x7f571806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:11:59.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.721+0000 7f57357fa640 1 -- 172.21.15.50:0/2629182934 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f573008a420 con 0x7f573815b400 2024-09-11T22:11:59.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.722+0000 7f5737fff640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f571806be30 0x7f571806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:11:59.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.722+0000 7f5737fff640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f571806be30 0x7f571806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5728000f60 tx=0x7f5728009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:11:59.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.726+0000 7f57357fa640 1 -- 172.21.15.50:0/2629182934 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5738075770 con 0x7f573815b400 2024-09-11T22:11:59.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.896+0000 7f573e447640 1 -- 172.21.15.50:0/2629182934 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f573806d070 con 0x7f571806be30 2024-09-11T22:11:59.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.902+0000 7f57357fa640 1 -- 172.21.15.50:0/2629182934 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248188 (secure 0 0 0) 0x7f573806d070 con 0x7f571806be30 2024-09-11T22:11:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:11:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:11:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.906+0000 7f573e447640 1 -- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f571806be30 msgr2=0x7f571806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.906+0000 7f573e447640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f571806be30 0x7f571806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5728000f60 tx=0x7f5728009040 comp rx=0 tx=0).stop 2024-09-11T22:11:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.906+0000 7f573e447640 1 -- 172.21.15.50:0/2629182934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573815b400 msgr2=0x7f57380ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:11:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.906+0000 7f573e447640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573815b400 0x7f57380ae8c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f573000c7a0 tx=0x7f573000cc60 comp rx=0 tx=0).stop 2024-09-11T22:11:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.906+0000 7f573e447640 1 -- 172.21.15.50:0/2629182934 shutdown_connections 2024-09-11T22:11:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.906+0000 7f573e447640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f571806be30 0x7f571806e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.906+0000 7f573e447640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573815b400 0x7f57380ae8c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.906+0000 7f573e447640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5738072e60 0x7f573814b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.906+0000 7f573e447640 1 --2- 172.21.15.50:0/2629182934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f573806e0f0 0x7f57380cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:11:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.906+0000 7f573e447640 1 -- 172.21.15.50:0/2629182934 >> 172.21.15.50:0/2629182934 conn(0x7f57380679c0 msgr2=0x7f5738159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:11:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.906+0000 7f573e447640 1 -- 172.21.15.50:0/2629182934 shutdown_connections 2024-09-11T22:11:59.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:11:59.906+0000 7f573e447640 1 -- 172.21.15.50:0/2629182934 wait complete. 2024-09-11T22:11:59.917 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-11T22:11:59.373736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240732,"kb_used_data":3704,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733988,"statfs":{"total":773094113280,"available":772847603712,"internally_reserved":0,"allocated":3792896,"data_stored":2152356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001165"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224159+0000","last_change":"2024-09-11T22:11:54.224159+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224159+0000","last_undegraded":"2024-09-11T22:11:54.224159+0000","last_fullsized":"2024-09-11T22:11:54.224159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.229076+0000","last_change":"2024-09-11T22:11:54.229076+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.229076+0000","last_undegraded":"2024-09-11T22:11:54.229076+0000","last_fullsized":"2024-09-11T22:11:54.229076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221597+0000","last_change":"2024-09-11T22:11:54.221597+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221597+0000","last_undegraded":"2024-09-11T22:11:54.221597+0000","last_fullsized":"2024-09-11T22:11:54.221597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227738+0000","last_change":"2024-09-11T22:11:54.227738+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227738+0000","last_undegraded":"2024-09-11T22:11:54.227738+0000","last_fullsized":"2024-09-11T22:11:54.227738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269751+0000","last_change":"2024-09-11T22:11:55.239987+0000","last_active":"2024-09-11T22:11:56.269751+0000","last_peered":"2024-09-11T22:11:56.269751+0000","last_clean":"2024-09-11T22:11:56.269751+0000","last_became_active":"2024-09-11T22:11:55.239721+0000","last_became_peered":"2024-09-11T22:11:55.239721+0000","last_unstale":"2024-09-11T22:11:56.269751+0000","last_undegraded":"2024-09-11T22:11:56.269751+0000","last_fullsized":"2024-09-11T22:11:56.269751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:55.478293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224484+0000","last_change":"2024-09-11T22:11:54.224484+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224484+0000","last_undegraded":"2024-09-11T22:11:54.224484+0000","last_fullsized":"2024-09-11T22:11:54.224484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376942+0000","last_change":"2024-09-11T22:11:55.243344+0000","last_active":"2024-09-11T22:11:56.376942+0000","last_peered":"2024-09-11T22:11:56.376942+0000","last_clean":"2024-09-11T22:11:56.376942+0000","last_became_active":"2024-09-11T22:11:55.243030+0000","last_became_peered":"2024-09-11T22:11:55.243030+0000","last_unstale":"2024-09-11T22:11:56.376942+0000","last_undegraded":"2024-09-11T22:11:56.376942+0000","last_fullsized":"2024-09-11T22:11:56.376942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:37.498219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376653+0000","last_change":"2024-09-11T22:11:55.246301+0000","last_active":"2024-09-11T22:11:56.376653+0000","last_peered":"2024-09-11T22:11:56.376653+0000","last_clean":"2024-09-11T22:11:56.376653+0000","last_became_active":"2024-09-11T22:11:55.246028+0000","last_became_peered":"2024-09-11T22:11:55.246028+0000","last_unstale":"2024-09-11T22:11:56.376653+0000","last_undegraded":"2024-09-11T22:11:56.376653+0000","last_fullsized":"2024-09-11T22:11:56.376653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:59.563540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221431+0000","last_change":"2024-09-11T22:11:54.221431+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221431+0000","last_undegraded":"2024-09-11T22:11:54.221431+0000","last_fullsized":"2024-09-11T22:11:54.221431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.229724+0000","last_change":"2024-09-11T22:11:54.229724+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.229724+0000","last_undegraded":"2024-09-11T22:11:54.229724+0000","last_fullsized":"2024-09-11T22:11:54.229724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376923+0000","last_change":"2024-09-11T22:11:55.247502+0000","last_active":"2024-09-11T22:11:56.376923+0000","last_peered":"2024-09-11T22:11:56.376923+0000","last_clean":"2024-09-11T22:11:56.376923+0000","last_became_active":"2024-09-11T22:11:55.247218+0000","last_became_peered":"2024-09-11T22:11:55.247218+0000","last_unstale":"2024-09-11T22:11:56.376923+0000","last_undegraded":"2024-09-11T22:11:56.376923+0000","last_fullsized":"2024-09-11T22:11:56.376923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:18.187116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.220138+0000","last_change":"2024-09-11T22:11:54.220138+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.220138+0000","last_undegraded":"2024-09-11T22:11:54.220138+0000","last_fullsized":"2024-09-11T22:11:54.220138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269761+0000","last_change":"2024-09-11T22:11:55.245085+0000","last_active":"2024-09-11T22:11:56.269761+0000","last_peered":"2024-09-11T22:11:56.269761+0000","last_clean":"2024-09-11T22:11:56.269761+0000","last_became_active":"2024-09-11T22:11:55.244705+0000","last_became_peered":"2024-09-11T22:11:55.244705+0000","last_unstale":"2024-09-11T22:11:56.269761+0000","last_undegraded":"2024-09-11T22:11:56.269761+0000","last_fullsized":"2024-09-11T22:11:56.269761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:16.047678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224055+0000","last_change":"2024-09-11T22:11:54.224055+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224055+0000","last_undegraded":"2024-09-11T22:11:54.224055+0000","last_fullsized":"2024-09-11T22:11:54.224055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219788+0000","last_change":"2024-09-11T22:11:54.219788+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219788+0000","last_undegraded":"2024-09-11T22:11:54.219788+0000","last_fullsized":"2024-09-11T22:11:54.219788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377400+0000","last_change":"2024-09-11T22:11:55.246859+0000","last_active":"2024-09-11T22:11:56.377400+0000","last_peered":"2024-09-11T22:11:56.377400+0000","last_clean":"2024-09-11T22:11:56.377400+0000","last_became_active":"2024-09-11T22:11:55.246525+0000","last_became_peered":"2024-09-11T22:11:55.246525+0000","last_unstale":"2024-09-11T22:11:56.377400+0000","last_undegraded":"2024-09-11T22:11:56.377400+0000","last_fullsized":"2024-09-11T22:11:56.377400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:13.049644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377405+0000","last_change":"2024-09-11T22:11:55.242378+0000","last_active":"2024-09-11T22:11:56.377405+0000","last_peered":"2024-09-11T22:11:56.377405+0000","last_clean":"2024-09-11T22:11:56.377405+0000","last_became_active":"2024-09-11T22:11:55.242045+0000","last_became_peered":"2024-09-11T22:11:55.242045+0000","last_unstale":"2024-09-11T22:11:56.377405+0000","last_undegraded":"2024-09-11T22:11:56.377405+0000","last_fullsized":"2024-09-11T22:11:56.377405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:03.220536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228643+0000","last_change":"2024-09-11T22:11:54.228643+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228643+0000","last_undegraded":"2024-09-11T22:11:54.228643+0000","last_fullsized":"2024-09-11T22:11:54.228643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228176+0000","last_change":"2024-09-11T22:11:54.228176+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228176+0000","last_undegraded":"2024-09-11T22:11:54.228176+0000","last_fullsized":"2024-09-11T22:11:54.228176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269902+0000","last_change":"2024-09-11T22:11:55.241292+0000","last_active":"2024-09-11T22:11:56.269902+0000","last_peered":"2024-09-11T22:11:56.269902+0000","last_clean":"2024-09-11T22:11:56.269902+0000","last_became_active":"2024-09-11T22:11:55.241027+0000","last_became_peered":"2024-09-11T22:11:55.241027+0000","last_unstale":"2024-09-11T22:11:56.269902+0000","last_undegraded":"2024-09-11T22:11:56.269902+0000","last_fullsized":"2024-09-11T22:11:56.269902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:22.305162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222305+0000","last_change":"2024-09-11T22:11:54.222305+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222305+0000","last_undegraded":"2024-09-11T22:11:54.222305+0000","last_fullsized":"2024-09-11T22:11:54.222305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223221+0000","last_change":"2024-09-11T22:11:54.223221+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223221+0000","last_undegraded":"2024-09-11T22:11:54.223221+0000","last_fullsized":"2024-09-11T22:11:54.223221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223878+0000","last_change":"2024-09-11T22:11:54.223878+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223878+0000","last_undegraded":"2024-09-11T22:11:54.223878+0000","last_fullsized":"2024-09-11T22:11:54.223878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221189+0000","last_change":"2024-09-11T22:11:54.221189+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221189+0000","last_undegraded":"2024-09-11T22:11:54.221189+0000","last_fullsized":"2024-09-11T22:11:54.221189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.226803+0000","last_change":"2024-09-11T22:11:54.226803+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.226803+0000","last_undegraded":"2024-09-11T22:11:54.226803+0000","last_fullsized":"2024-09-11T22:11:54.226803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228131+0000","last_change":"2024-09-11T22:11:54.228131+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228131+0000","last_undegraded":"2024-09-11T22:11:54.228131+0000","last_fullsized":"2024-09-11T22:11:54.228131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228102+0000","last_change":"2024-09-11T22:11:54.228102+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228102+0000","last_undegraded":"2024-09-11T22:11:54.228102+0000","last_fullsized":"2024-09-11T22:11:54.228102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219566+0000","last_change":"2024-09-11T22:11:54.219566+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219566+0000","last_undegraded":"2024-09-11T22:11:54.219566+0000","last_fullsized":"2024-09-11T22:11:54.219566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221780+0000","last_change":"2024-09-11T22:11:54.221780+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221780+0000","last_undegraded":"2024-09-11T22:11:54.221780+0000","last_fullsized":"2024-09-11T22:11:54.221780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376796+0000","last_change":"2024-09-11T22:11:55.240071+0000","last_active":"2024-09-11T22:11:56.376796+0000","last_peered":"2024-09-11T22:11:56.376796+0000","last_clean":"2024-09-11T22:11:56.376796+0000","last_became_active":"2024-09-11T22:11:55.239614+0000","last_became_peered":"2024-09-11T22:11:55.239614+0000","last_unstale":"2024-09-11T22:11:56.376796+0000","last_undegraded":"2024-09-11T22:11:56.376796+0000","last_fullsized":"2024-09-11T22:11:56.376796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:27.962254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223953+0000","last_change":"2024-09-11T22:11:54.223953+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223953+0000","last_undegraded":"2024-09-11T22:11:54.223953+0000","last_fullsized":"2024-09-11T22:11:54.223953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377381+0000","last_change":"2024-09-11T22:11:55.240387+0000","last_active":"2024-09-11T22:11:56.377381+0000","last_peered":"2024-09-11T22:11:56.377381+0000","last_clean":"2024-09-11T22:11:56.377381+0000","last_became_active":"2024-09-11T22:11:55.239801+0000","last_became_peered":"2024-09-11T22:11:55.239801+0000","last_unstale":"2024-09-11T22:11:56.377381+0000","last_undegraded":"2024-09-11T22:11:56.377381+0000","last_fullsized":"2024-09-11T22:11:56.377381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:18.124249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222801+0000","last_change":"2024-09-11T22:11:54.222801+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222801+0000","last_undegraded":"2024-09-11T22:11:54.222801+0000","last_fullsized":"2024-09-11T22:11:54.222801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.233686+0000","last_change":"2024-09-11T22:11:54.232005+0000","last_active":"2024-09-11T22:11:54.233686+0000","last_peered":"2024-09-11T22:11:54.233686+0000","last_clean":"2024-09-11T22:11:54.233686+0000","last_became_active":"2024-09-11T22:11:54.231733+0000","last_became_peered":"2024-09-11T22:11:54.231733+0000","last_unstale":"2024-09-11T22:11:54.233686+0000","last_undegraded":"2024-09-11T22:11:54.233686+0000","last_fullsized":"2024-09-11T22:11:54.233686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.252826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223447+0000","last_change":"2024-09-11T22:11:54.223447+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223447+0000","last_undegraded":"2024-09-11T22:11:54.223447+0000","last_fullsized":"2024-09-11T22:11:54.223447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.234329+0000","last_change":"2024-09-11T22:11:54.231904+0000","last_active":"2024-09-11T22:11:54.234329+0000","last_peered":"2024-09-11T22:11:54.234329+0000","last_clean":"2024-09-11T22:11:54.234329+0000","last_became_active":"2024-09-11T22:11:54.231599+0000","last_became_peered":"2024-09-11T22:11:54.231599+0000","last_unstale":"2024-09-11T22:11:54.234329+0000","last_undegraded":"2024-09-11T22:11:54.234329+0000","last_fullsized":"2024-09-11T22:11:54.234329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:40.341037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222896+0000","last_change":"2024-09-11T22:11:54.222896+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222896+0000","last_undegraded":"2024-09-11T22:11:54.222896+0000","last_fullsized":"2024-09-11T22:11:54.222896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.238935+0000","last_change":"2024-09-11T22:11:54.237587+0000","last_active":"2024-09-11T22:11:54.238935+0000","last_peered":"2024-09-11T22:11:54.238935+0000","last_clean":"2024-09-11T22:11:54.238935+0000","last_became_active":"2024-09-11T22:11:54.237269+0000","last_became_peered":"2024-09-11T22:11:54.237269+0000","last_unstale":"2024-09-11T22:11:54.238935+0000","last_undegraded":"2024-09-11T22:11:54.238935+0000","last_fullsized":"2024-09-11T22:11:54.238935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:37.436803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224975+0000","last_change":"2024-09-11T22:11:54.224975+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224975+0000","last_undegraded":"2024-09-11T22:11:54.224975+0000","last_fullsized":"2024-09-11T22:11:54.224975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269864+0000","last_change":"2024-09-11T22:11:54.235284+0000","last_active":"2024-09-11T22:11:56.269864+0000","last_peered":"2024-09-11T22:11:56.269864+0000","last_clean":"2024-09-11T22:11:56.269864+0000","last_became_active":"2024-09-11T22:11:54.234997+0000","last_became_peered":"2024-09-11T22:11:54.234997+0000","last_unstale":"2024-09-11T22:11:56.269864+0000","last_undegraded":"2024-09-11T22:11:56.269864+0000","last_fullsized":"2024-09-11T22:11:56.269864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:10.204976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377327+0000","last_change":"2024-09-11T22:11:55.240321+0000","last_active":"2024-09-11T22:11:56.377327+0000","last_peered":"2024-09-11T22:11:56.377327+0000","last_clean":"2024-09-11T22:11:56.377327+0000","last_became_active":"2024-09-11T22:11:55.240027+0000","last_became_peered":"2024-09-11T22:11:55.240027+0000","last_unstale":"2024-09-11T22:11:56.377327+0000","last_undegraded":"2024-09-11T22:11:56.377327+0000","last_fullsized":"2024-09-11T22:11:56.377327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:41.384734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.234552+0000","last_change":"2024-09-11T22:11:54.232989+0000","last_active":"2024-09-11T22:11:54.234552+0000","last_peered":"2024-09-11T22:11:54.234552+0000","last_clean":"2024-09-11T22:11:54.234552+0000","last_became_active":"2024-09-11T22:11:54.232619+0000","last_became_peered":"2024-09-11T22:11:54.232619+0000","last_unstale":"2024-09-11T22:11:54.234552+0000","last_undegraded":"2024-09-11T22:11:54.234552+0000","last_fullsized":"2024-09-11T22:11:54.234552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:05.203238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221366+0000","last_change":"2024-09-11T22:11:54.221366+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221366+0000","last_undegraded":"2024-09-11T22:11:54.221366+0000","last_fullsized":"2024-09-11T22:11:54.221366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240469+0000","last_change":"2024-09-11T22:11:54.235628+0000","last_active":"2024-09-11T22:11:54.240469+0000","last_peered":"2024-09-11T22:11:54.240469+0000","last_clean":"2024-09-11T22:11:54.240469+0000","last_became_active":"2024-09-11T22:11:54.235423+0000","last_became_peered":"2024-09-11T22:11:54.235423+0000","last_unstale":"2024-09-11T22:11:54.240469+0000","last_undegraded":"2024-09-11T22:11:54.240469+0000","last_fullsized":"2024-09-11T22:11:54.240469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:54.817240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222277+0000","last_change":"2024-09-11T22:11:54.222277+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222277+0000","last_undegraded":"2024-09-11T22:11:54.222277+0000","last_fullsized":"2024-09-11T22:11:54.222277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.236777+0000","last_change":"2024-09-11T22:11:54.235445+0000","last_active":"2024-09-11T22:11:54.236777+0000","last_peered":"2024-09-11T22:11:54.236777+0000","last_clean":"2024-09-11T22:11:54.236777+0000","last_became_active":"2024-09-11T22:11:54.235120+0000","last_became_peered":"2024-09-11T22:11:54.235120+0000","last_unstale":"2024-09-11T22:11:54.236777+0000","last_undegraded":"2024-09-11T22:11:54.236777+0000","last_fullsized":"2024-09-11T22:11:54.236777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.226269+0000","last_change":"2024-09-11T22:11:54.226269+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.226269+0000","last_undegraded":"2024-09-11T22:11:54.226269+0000","last_fullsized":"2024-09-11T22:11:54.226269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230815+0000","last_change":"2024-09-11T22:11:54.229723+0000","last_active":"2024-09-11T22:11:54.230815+0000","last_peered":"2024-09-11T22:11:54.230815+0000","last_clean":"2024-09-11T22:11:54.230815+0000","last_became_active":"2024-09-11T22:11:54.228533+0000","last_became_peered":"2024-09-11T22:11:54.228533+0000","last_unstale":"2024-09-11T22:11:54.230815+0000","last_undegraded":"2024-09-11T22:11:54.230815+0000","last_fullsized":"2024-09-11T22:11:54.230815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:18.975678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.220078+0000","last_change":"2024-09-11T22:11:54.220078+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.220078+0000","last_undegraded":"2024-09-11T22:11:54.220078+0000","last_fullsized":"2024-09-11T22:11:54.220078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.238487+0000","last_change":"2024-09-11T22:11:54.237543+0000","last_active":"2024-09-11T22:11:54.238487+0000","last_peered":"2024-09-11T22:11:54.238487+0000","last_clean":"2024-09-11T22:11:54.238487+0000","last_became_active":"2024-09-11T22:11:54.235862+0000","last_became_peered":"2024-09-11T22:11:54.235862+0000","last_unstale":"2024-09-11T22:11:54.238487+0000","last_undegraded":"2024-09-11T22:11:54.238487+0000","last_fullsized":"2024-09-11T22:11:54.238487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:49.788303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227816+0000","last_change":"2024-09-11T22:11:54.227816+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227816+0000","last_undegraded":"2024-09-11T22:11:54.227816+0000","last_fullsized":"2024-09-11T22:11:54.227816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240131+0000","last_change":"2024-09-11T22:11:54.238373+0000","last_active":"2024-09-11T22:11:54.240131+0000","last_peered":"2024-09-11T22:11:54.240131+0000","last_clean":"2024-09-11T22:11:54.240131+0000","last_became_active":"2024-09-11T22:11:54.238087+0000","last_became_peered":"2024-09-11T22:11:54.238087+0000","last_unstale":"2024-09-11T22:11:54.240131+0000","last_undegraded":"2024-09-11T22:11:54.240131+0000","last_fullsized":"2024-09-11T22:11:54.240131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228313+0000","last_change":"2024-09-11T22:11:54.228313+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228313+0000","last_undegraded":"2024-09-11T22:11:54.228313+0000","last_fullsized":"2024-09-11T22:11:54.228313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.233865+0000","last_change":"2024-09-11T22:11:54.231853+0000","last_active":"2024-09-11T22:11:54.233865+0000","last_peered":"2024-09-11T22:11:54.233865+0000","last_clean":"2024-09-11T22:11:54.233865+0000","last_became_active":"2024-09-11T22:11:54.231564+0000","last_became_peered":"2024-09-11T22:11:54.231564+0000","last_unstale":"2024-09-11T22:11:54.233865+0000","last_undegraded":"2024-09-11T22:11:54.233865+0000","last_fullsized":"2024-09-11T22:11:54.233865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:36.010268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224117+0000","last_change":"2024-09-11T22:11:54.224117+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224117+0000","last_undegraded":"2024-09-11T22:11:54.224117+0000","last_fullsized":"2024-09-11T22:11:54.224117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239473+0000","last_change":"2024-09-11T22:11:54.238142+0000","last_active":"2024-09-11T22:11:54.239473+0000","last_peered":"2024-09-11T22:11:54.239473+0000","last_clean":"2024-09-11T22:11:54.239473+0000","last_became_active":"2024-09-11T22:11:54.237819+0000","last_became_peered":"2024-09-11T22:11:54.237819+0000","last_unstale":"2024-09-11T22:11:54.239473+0000","last_undegraded":"2024-09-11T22:11:54.239473+0000","last_fullsized":"2024-09-11T22:11:54.239473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:57.762834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227662+0000","last_change":"2024-09-11T22:11:54.227662+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227662+0000","last_undegraded":"2024-09-11T22:11:54.227662+0000","last_fullsized":"2024-09-11T22:11:54.227662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230860+0000","last_change":"2024-09-11T22:11:54.228141+0000","last_active":"2024-09-11T22:11:54.230860+0000","last_peered":"2024-09-11T22:11:54.230860+0000","last_clean":"2024-09-11T22:11:54.230860+0000","last_became_active":"2024-09-11T22:11:54.227742+0000","last_became_peered":"2024-09-11T22:11:54.227742+0000","last_unstale":"2024-09-11T22:11:54.230860+0000","last_undegraded":"2024-09-11T22:11:54.230860+0000","last_fullsized":"2024-09-11T22:11:54.230860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:00.285086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222828+0000","last_change":"2024-09-11T22:11:54.222828+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222828+0000","last_undegraded":"2024-09-11T22:11:54.222828+0000","last_fullsized":"2024-09-11T22:11:54.222828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239957+0000","last_change":"2024-09-11T22:11:54.238756+0000","last_active":"2024-09-11T22:11:54.239957+0000","last_peered":"2024-09-11T22:11:54.239957+0000","last_clean":"2024-09-11T22:11:54.239957+0000","last_became_active":"2024-09-11T22:11:54.238411+0000","last_became_peered":"2024-09-11T22:11:54.238411+0000","last_unstale":"2024-09-11T22:11:54.239957+0000","last_undegraded":"2024-09-11T22:11:54.239957+0000","last_fullsized":"2024-09-11T22:11:54.239957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.252826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377052+0000","last_change":"2024-09-11T22:11:55.240613+0000","last_active":"2024-09-11T22:11:56.377052+0000","last_peered":"2024-09-11T22:11:56.377052+0000","last_clean":"2024-09-11T22:11:56.377052+0000","last_became_active":"2024-09-11T22:11:55.240113+0000","last_became_peered":"2024-09-11T22:11:55.240113+0000","last_unstale":"2024-09-11T22:11:56.377052+0000","last_undegraded":"2024-09-11T22:11:56.377052+0000","last_fullsized":"2024-09-11T22:11:56.377052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:11.783248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.236974+0000","last_change":"2024-09-11T22:11:54.236090+0000","last_active":"2024-09-11T22:11:54.236974+0000","last_peered":"2024-09-11T22:11:54.236974+0000","last_clean":"2024-09-11T22:11:54.236974+0000","last_became_active":"2024-09-11T22:11:54.235800+0000","last_became_peered":"2024-09-11T22:11:54.235800+0000","last_unstale":"2024-09-11T22:11:54.236974+0000","last_undegraded":"2024-09-11T22:11:54.236974+0000","last_fullsized":"2024-09-11T22:11:54.236974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223419+0000","last_change":"2024-09-11T22:11:54.223419+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223419+0000","last_undegraded":"2024-09-11T22:11:54.223419+0000","last_fullsized":"2024-09-11T22:11:54.223419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239458+0000","last_change":"2024-09-11T22:11:54.238384+0000","last_active":"2024-09-11T22:11:54.239458+0000","last_peered":"2024-09-11T22:11:54.239458+0000","last_clean":"2024-09-11T22:11:54.239458+0000","last_became_active":"2024-09-11T22:11:54.237149+0000","last_became_peered":"2024-09-11T22:11:54.237149+0000","last_unstale":"2024-09-11T22:11:54.239458+0000","last_undegraded":"2024-09-11T22:11:54.239458+0000","last_fullsized":"2024-09-11T22:11:54.239458+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:58.538834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219747+0000","last_change":"2024-09-11T22:11:54.219747+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219747+0000","last_undegraded":"2024-09-11T22:11:54.219747+0000","last_fullsized":"2024-09-11T22:11:54.219747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240895+0000","last_change":"2024-09-11T22:11:54.239702+0000","last_active":"2024-09-11T22:11:54.240895+0000","last_peered":"2024-09-11T22:11:54.240895+0000","last_clean":"2024-09-11T22:11:54.240895+0000","last_became_active":"2024-09-11T22:11:54.239399+0000","last_became_peered":"2024-09-11T22:11:54.239399+0000","last_unstale":"2024-09-11T22:11:54.240895+0000","last_undegraded":"2024-09-11T22:11:54.240895+0000","last_fullsized":"2024-09-11T22:11:54.240895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223586+0000","last_change":"2024-09-11T22:11:54.223586+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223586+0000","last_undegraded":"2024-09-11T22:11:54.223586+0000","last_fullsized":"2024-09-11T22:11:54.223586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230828+0000","last_change":"2024-09-11T22:11:54.229239+0000","last_active":"2024-09-11T22:11:54.230828+0000","last_peered":"2024-09-11T22:11:54.230828+0000","last_clean":"2024-09-11T22:11:54.230828+0000","last_became_active":"2024-09-11T22:11:54.228972+0000","last_became_peered":"2024-09-11T22:11:54.228972+0000","last_unstale":"2024-09-11T22:11:54.230828+0000","last_undegraded":"2024-09-11T22:11:54.230828+0000","last_fullsized":"2024-09-11T22:11:54.230828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:43.406978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227247+0000","last_change":"2024-09-11T22:11:54.227247+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227247+0000","last_undegraded":"2024-09-11T22:11:54.227247+0000","last_fullsized":"2024-09-11T22:11:54.227247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230737+0000","last_change":"2024-09-11T22:11:54.227381+0000","last_active":"2024-09-11T22:11:54.230737+0000","last_peered":"2024-09-11T22:11:54.230737+0000","last_clean":"2024-09-11T22:11:54.230737+0000","last_became_active":"2024-09-11T22:11:54.226564+0000","last_became_peered":"2024-09-11T22:11:54.226564+0000","last_unstale":"2024-09-11T22:11:54.230737+0000","last_undegraded":"2024-09-11T22:11:54.230737+0000","last_fullsized":"2024-09-11T22:11:54.230737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:38.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269896+0000","last_change":"2024-09-11T22:11:55.244562+0000","last_active":"2024-09-11T22:11:56.269896+0000","last_peered":"2024-09-11T22:11:56.269896+0000","last_clean":"2024-09-11T22:11:56.269896+0000","last_became_active":"2024-09-11T22:11:55.244183+0000","last_became_peered":"2024-09-11T22:11:55.244183+0000","last_unstale":"2024-09-11T22:11:56.269896+0000","last_undegraded":"2024-09-11T22:11:56.269896+0000","last_fullsized":"2024-09-11T22:11:56.269896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:27.980484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240436+0000","last_change":"2024-09-11T22:11:54.235155+0000","last_active":"2024-09-11T22:11:54.240436+0000","last_peered":"2024-09-11T22:11:54.240436+0000","last_clean":"2024-09-11T22:11:54.240436+0000","last_became_active":"2024-09-11T22:11:54.234931+0000","last_became_peered":"2024-09-11T22:11:54.234931+0000","last_unstale":"2024-09-11T22:11:54.240436+0000","last_undegraded":"2024-09-11T22:11:54.240436+0000","last_fullsized":"2024-09-11T22:11:54.240436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:56.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269770+0000","last_change":"2024-09-11T22:11:55.245345+0000","last_active":"2024-09-11T22:11:56.269770+0000","last_peered":"2024-09-11T22:11:56.269770+0000","last_clean":"2024-09-11T22:11:56.269770+0000","last_became_active":"2024-09-11T22:11:55.245063+0000","last_became_peered":"2024-09-11T22:11:55.245063+0000","last_unstale":"2024-09-11T22:11:56.269770+0000","last_undegraded":"2024-09-11T22:11:56.269770+0000","last_fullsized":"2024-09-11T22:11:56.269770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:48.949134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.236016+0000","last_change":"2024-09-11T22:11:54.233955+0000","last_active":"2024-09-11T22:11:54.236016+0000","last_peered":"2024-09-11T22:11:54.236016+0000","last_clean":"2024-09-11T22:11:54.236016+0000","last_became_active":"2024-09-11T22:11:54.233649+0000","last_became_peered":"2024-09-11T22:11:54.233649+0000","last_unstale":"2024-09-11T22:11:54.236016+0000","last_undegraded":"2024-09-11T22:11:54.236016+0000","last_fullsized":"2024-09-11T22:11:54.236016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.252826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269860+0000","last_change":"2024-09-11T22:11:55.239063+0000","last_active":"2024-09-11T22:11:56.269860+0000","last_peered":"2024-09-11T22:11:56.269860+0000","last_clean":"2024-09-11T22:11:56.269860+0000","last_became_active":"2024-09-11T22:11:55.238715+0000","last_became_peered":"2024-09-11T22:11:55.238715+0000","last_unstale":"2024-09-11T22:11:56.269860+0000","last_undegraded":"2024-09-11T22:11:56.269860+0000","last_fullsized":"2024-09-11T22:11:56.269860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:12.370780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.245895+0000","last_change":"2024-09-11T22:11:54.237992+0000","last_active":"2024-09-11T22:11:54.245895+0000","last_peered":"2024-09-11T22:11:54.245895+0000","last_clean":"2024-09-11T22:11:54.245895+0000","last_became_active":"2024-09-11T22:11:54.237566+0000","last_became_peered":"2024-09-11T22:11:54.237566+0000","last_unstale":"2024-09-11T22:11:54.245895+0000","last_undegraded":"2024-09-11T22:11:54.245895+0000","last_fullsized":"2024-09-11T22:11:54.245895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269723+0000","last_change":"2024-09-11T22:11:55.239964+0000","last_active":"2024-09-11T22:11:56.269723+0000","last_peered":"2024-09-11T22:11:56.269723+0000","last_clean":"2024-09-11T22:11:56.269723+0000","last_became_active":"2024-09-11T22:11:55.239684+0000","last_became_peered":"2024-09-11T22:11:55.239684+0000","last_unstale":"2024-09-11T22:11:56.269723+0000","last_undegraded":"2024-09-11T22:11:56.269723+0000","last_fullsized":"2024-09-11T22:11:56.269723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:34.837927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240493+0000","last_change":"2024-09-11T22:11:54.235334+0000","last_active":"2024-09-11T22:11:54.240493+0000","last_peered":"2024-09-11T22:11:54.240493+0000","last_clean":"2024-09-11T22:11:54.240493+0000","last_became_active":"2024-09-11T22:11:54.235045+0000","last_became_peered":"2024-09-11T22:11:54.235045+0000","last_unstale":"2024-09-11T22:11:54.240493+0000","last_undegraded":"2024-09-11T22:11:54.240493+0000","last_fullsized":"2024-09-11T22:11:54.240493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:05.982977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376772+0000","last_change":"2024-09-11T22:11:55.243276+0000","last_active":"2024-09-11T22:11:56.376772+0000","last_peered":"2024-09-11T22:11:56.376772+0000","last_clean":"2024-09-11T22:11:56.376772+0000","last_became_active":"2024-09-11T22:11:55.242986+0000","last_became_peered":"2024-09-11T22:11:55.242986+0000","last_unstale":"2024-09-11T22:11:56.376772+0000","last_undegraded":"2024-09-11T22:11:56.376772+0000","last_fullsized":"2024-09-11T22:11:56.376772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:58.609145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240252+0000","last_change":"2024-09-11T22:11:54.233653+0000","last_active":"2024-09-11T22:11:54.240252+0000","last_peered":"2024-09-11T22:11:54.240252+0000","last_clean":"2024-09-11T22:11:54.240252+0000","last_became_active":"2024-09-11T22:11:54.233372+0000","last_became_peered":"2024-09-11T22:11:54.233372+0000","last_unstale":"2024-09-11T22:11:54.240252+0000","last_undegraded":"2024-09-11T22:11:54.240252+0000","last_fullsized":"2024-09-11T22:11:54.240252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:07.799927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269805+0000","last_change":"2024-09-11T22:11:55.240205+0000","last_active":"2024-09-11T22:11:56.269805+0000","last_peered":"2024-09-11T22:11:56.269805+0000","last_clean":"2024-09-11T22:11:56.269805+0000","last_became_active":"2024-09-11T22:11:55.239329+0000","last_became_peered":"2024-09-11T22:11:55.239329+0000","last_unstale":"2024-09-11T22:11:56.269805+0000","last_undegraded":"2024-09-11T22:11:56.269805+0000","last_fullsized":"2024-09-11T22:11:56.269805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:55.632586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.238633+0000","last_change":"2024-09-11T22:11:54.236587+0000","last_active":"2024-09-11T22:11:54.238633+0000","last_peered":"2024-09-11T22:11:54.238633+0000","last_clean":"2024-09-11T22:11:54.238633+0000","last_became_active":"2024-09-11T22:11:54.236280+0000","last_became_peered":"2024-09-11T22:11:54.236280+0000","last_unstale":"2024-09-11T22:11:54.238633+0000","last_undegraded":"2024-09-11T22:11:54.238633+0000","last_fullsized":"2024-09-11T22:11:54.238633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:40.341037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219602+0000","last_change":"2024-09-11T22:11:54.219602+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219602+0000","last_undegraded":"2024-09-11T22:11:54.219602+0000","last_fullsized":"2024-09-11T22:11:54.219602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.237158+0000","last_change":"2024-09-11T22:11:54.235834+0000","last_active":"2024-09-11T22:11:54.237158+0000","last_peered":"2024-09-11T22:11:54.237158+0000","last_clean":"2024-09-11T22:11:54.237158+0000","last_became_active":"2024-09-11T22:11:54.235561+0000","last_became_peered":"2024-09-11T22:11:54.235561+0000","last_unstale":"2024-09-11T22:11:54.237158+0000","last_undegraded":"2024-09-11T22:11:54.237158+0000","last_fullsized":"2024-09-11T22:11:54.237158+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223044+0000","last_change":"2024-09-11T22:11:54.223044+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223044+0000","last_undegraded":"2024-09-11T22:11:54.223044+0000","last_fullsized":"2024-09-11T22:11:54.223044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.237757+0000","last_change":"2024-09-11T22:11:54.234484+0000","last_active":"2024-09-11T22:11:54.237757+0000","last_peered":"2024-09-11T22:11:54.237757+0000","last_clean":"2024-09-11T22:11:54.237757+0000","last_became_active":"2024-09-11T22:11:54.234219+0000","last_became_peered":"2024-09-11T22:11:54.234219+0000","last_unstale":"2024-09-11T22:11:54.237757+0000","last_undegraded":"2024-09-11T22:11:54.237757+0000","last_fullsized":"2024-09-11T22:11:54.237757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:19.243150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223642+0000","last_change":"2024-09-11T22:11:54.223642+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223642+0000","last_undegraded":"2024-09-11T22:11:54.223642+0000","last_fullsized":"2024-09-11T22:11:54.223642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.228711+0000","last_change":"2024-09-11T22:11:54.227468+0000","last_active":"2024-09-11T22:11:54.228711+0000","last_peered":"2024-09-11T22:11:54.228711+0000","last_clean":"2024-09-11T22:11:54.228711+0000","last_became_active":"2024-09-11T22:11:54.227109+0000","last_became_peered":"2024-09-11T22:11:54.227109+0000","last_unstale":"2024-09-11T22:11:54.228711+0000","last_undegraded":"2024-09-11T22:11:54.228711+0000","last_fullsized":"2024-09-11T22:11:54.228711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:19.243150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223384+0000","last_change":"2024-09-11T22:11:54.223384+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223384+0000","last_undegraded":"2024-09-11T22:11:54.223384+0000","last_fullsized":"2024-09-11T22:11:54.223384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.241442+0000","last_change":"2024-09-11T22:11:54.241027+0000","last_active":"2024-09-11T22:11:54.241442+0000","last_peered":"2024-09-11T22:11:54.241442+0000","last_clean":"2024-09-11T22:11:54.241442+0000","last_became_active":"2024-09-11T22:11:54.240641+0000","last_became_peered":"2024-09-11T22:11:54.240641+0000","last_unstale":"2024-09-11T22:11:54.241442+0000","last_undegraded":"2024-09-11T22:11:54.241442+0000","last_fullsized":"2024-09-11T22:11:54.241442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222388+0000","last_change":"2024-09-11T22:11:54.222388+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222388+0000","last_undegraded":"2024-09-11T22:11:54.222388+0000","last_fullsized":"2024-09-11T22:11:54.222388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230715+0000","last_change":"2024-09-11T22:11:54.227045+0000","last_active":"2024-09-11T22:11:54.230715+0000","last_peered":"2024-09-11T22:11:54.230715+0000","last_clean":"2024-09-11T22:11:54.230715+0000","last_became_active":"2024-09-11T22:11:54.226304+0000","last_became_peered":"2024-09-11T22:11:54.226304+0000","last_unstale":"2024-09-11T22:11:54.230715+0000","last_undegraded":"2024-09-11T22:11:54.230715+0000","last_fullsized":"2024-09-11T22:11:54.230715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:03.624960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.220524+0000","last_change":"2024-09-11T22:11:54.220524+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.220524+0000","last_undegraded":"2024-09-11T22:11:54.220524+0000","last_fullsized":"2024-09-11T22:11:54.220524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239434+0000","last_change":"2024-09-11T22:11:54.238048+0000","last_active":"2024-09-11T22:11:54.239434+0000","last_peered":"2024-09-11T22:11:54.239434+0000","last_clean":"2024-09-11T22:11:54.239434+0000","last_became_active":"2024-09-11T22:11:54.237756+0000","last_became_peered":"2024-09-11T22:11:54.237756+0000","last_unstale":"2024-09-11T22:11:54.239434+0000","last_undegraded":"2024-09-11T22:11:54.239434+0000","last_fullsized":"2024-09-11T22:11:54.239434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:14.245228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376935+0000","last_change":"2024-09-11T22:11:55.246959+0000","last_active":"2024-09-11T22:11:56.376935+0000","last_peered":"2024-09-11T22:11:56.376935+0000","last_clean":"2024-09-11T22:11:56.376935+0000","last_became_active":"2024-09-11T22:11:55.246666+0000","last_became_peered":"2024-09-11T22:11:55.246666+0000","last_unstale":"2024-09-11T22:11:56.376935+0000","last_undegraded":"2024-09-11T22:11:56.376935+0000","last_fullsized":"2024-09-11T22:11:56.376935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:44.417139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.233260+0000","last_change":"2024-09-11T22:11:54.231109+0000","last_active":"2024-09-11T22:11:54.233260+0000","last_peered":"2024-09-11T22:11:54.233260+0000","last_clean":"2024-09-11T22:11:54.233260+0000","last_became_active":"2024-09-11T22:11:54.230832+0000","last_became_peered":"2024-09-11T22:11:54.230832+0000","last_unstale":"2024-09-11T22:11:54.233260+0000","last_undegraded":"2024-09-11T22:11:54.233260+0000","last_fullsized":"2024-09-11T22:11:54.233260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:40.341037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377457+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:11:56.377457+0000","last_peered":"2024-09-11T22:11:56.377457+0000","last_clean":"2024-09-11T22:11:56.377457+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:11:56.377457+0000","last_undegraded":"2024-09-11T22:11:56.377457+0000","last_fullsized":"2024-09-11T22:11:56.377457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":909312,"data_stored":706965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":726397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35696,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336144,"statfs":{"total":96636764160,"available":96600211456,"internally_reserved":0,"allocated":356352,"data_stored":136009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:11:59.921 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-11T22:11:59.921 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.224159+0000', 'last_change': '2024-09-11T22:11:54.224159+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.224159+0000', 'last_undegraded': '2024-09-11T22:11:54.224159+0000', 'last_fullsized': '2024-09-11T22:11:54.224159+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:11:59.921 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-11T22:11:59.921 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.229076+0000', 'last_change': '2024-09-11T22:11:54.229076+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.229076+0000', 'last_undegraded': '2024-09-11T22:11:54.229076+0000', 'last_fullsized': '2024-09-11T22:11:54.229076+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:59.921 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-11T22:11:59.922 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.221597+0000', 'last_change': '2024-09-11T22:11:54.221597+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.221597+0000', 'last_undegraded': '2024-09-11T22:11:54.221597+0000', 'last_fullsized': '2024-09-11T22:11:54.221597+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:59.922 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-11T22:11:59.922 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.227738+0000', 'last_change': '2024-09-11T22:11:54.227738+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.227738+0000', 'last_undegraded': '2024-09-11T22:11:54.227738+0000', 'last_fullsized': '2024-09-11T22:11:54.227738+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:59.922 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-11T22:11:59.922 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.224484+0000', 'last_change': '2024-09-11T22:11:54.224484+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.224484+0000', 'last_undegraded': '2024-09-11T22:11:54.224484+0000', 'last_fullsized': '2024-09-11T22:11:54.224484+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:59.922 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-11T22:11:59.922 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.221431+0000', 'last_change': '2024-09-11T22:11:54.221431+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.221431+0000', 'last_undegraded': '2024-09-11T22:11:54.221431+0000', 'last_fullsized': '2024-09-11T22:11:54.221431+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:11:59.922 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-11T22:11:59.922 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.229724+0000', 'last_change': '2024-09-11T22:11:54.229724+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.229724+0000', 'last_undegraded': '2024-09-11T22:11:54.229724+0000', 'last_fullsized': '2024-09-11T22:11:54.229724+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:59.922 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-11T22:11:59.922 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.220138+0000', 'last_change': '2024-09-11T22:11:54.220138+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.220138+0000', 'last_undegraded': '2024-09-11T22:11:54.220138+0000', 'last_fullsized': '2024-09-11T22:11:54.220138+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:59.923 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-11T22:11:59.923 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.224055+0000', 'last_change': '2024-09-11T22:11:54.224055+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.224055+0000', 'last_undegraded': '2024-09-11T22:11:54.224055+0000', 'last_fullsized': '2024-09-11T22:11:54.224055+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:59.923 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-11T22:11:59.923 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.219788+0000', 'last_change': '2024-09-11T22:11:54.219788+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.219788+0000', 'last_undegraded': '2024-09-11T22:11:54.219788+0000', 'last_fullsized': '2024-09-11T22:11:54.219788+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:59.923 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-11T22:11:59.923 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.228643+0000', 'last_change': '2024-09-11T22:11:54.228643+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.228643+0000', 'last_undegraded': '2024-09-11T22:11:54.228643+0000', 'last_fullsized': '2024-09-11T22:11:54.228643+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:59.923 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-11T22:11:59.923 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.228176+0000', 'last_change': '2024-09-11T22:11:54.228176+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.228176+0000', 'last_undegraded': '2024-09-11T22:11:54.228176+0000', 'last_fullsized': '2024-09-11T22:11:54.228176+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:59.923 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-11T22:11:59.923 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.222305+0000', 'last_change': '2024-09-11T22:11:54.222305+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.222305+0000', 'last_undegraded': '2024-09-11T22:11:54.222305+0000', 'last_fullsized': '2024-09-11T22:11:54.222305+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:11:59.923 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-11T22:11:59.924 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.223221+0000', 'last_change': '2024-09-11T22:11:54.223221+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.223221+0000', 'last_undegraded': '2024-09-11T22:11:54.223221+0000', 'last_fullsized': '2024-09-11T22:11:54.223221+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:11:59.924 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-11T22:11:59.924 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.223878+0000', 'last_change': '2024-09-11T22:11:54.223878+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.223878+0000', 'last_undegraded': '2024-09-11T22:11:54.223878+0000', 'last_fullsized': '2024-09-11T22:11:54.223878+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:59.924 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-11T22:11:59.924 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.221189+0000', 'last_change': '2024-09-11T22:11:54.221189+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.221189+0000', 'last_undegraded': '2024-09-11T22:11:54.221189+0000', 'last_fullsized': '2024-09-11T22:11:54.221189+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:59.924 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-11T22:11:59.924 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.226803+0000', 'last_change': '2024-09-11T22:11:54.226803+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.226803+0000', 'last_undegraded': '2024-09-11T22:11:54.226803+0000', 'last_fullsized': '2024-09-11T22:11:54.226803+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:59.924 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-11T22:11:59.924 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.228131+0000', 'last_change': '2024-09-11T22:11:54.228131+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.228131+0000', 'last_undegraded': '2024-09-11T22:11:54.228131+0000', 'last_fullsized': '2024-09-11T22:11:54.228131+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:59.924 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-11T22:11:59.924 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.228102+0000', 'last_change': '2024-09-11T22:11:54.228102+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.228102+0000', 'last_undegraded': '2024-09-11T22:11:54.228102+0000', 'last_fullsized': '2024-09-11T22:11:54.228102+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:59.925 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-11T22:11:59.925 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.219566+0000', 'last_change': '2024-09-11T22:11:54.219566+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.219566+0000', 'last_undegraded': '2024-09-11T22:11:54.219566+0000', 'last_fullsized': '2024-09-11T22:11:54.219566+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:59.925 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-11T22:11:59.925 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.221780+0000', 'last_change': '2024-09-11T22:11:54.221780+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.221780+0000', 'last_undegraded': '2024-09-11T22:11:54.221780+0000', 'last_fullsized': '2024-09-11T22:11:54.221780+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:11:59.925 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-11T22:11:59.925 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.223953+0000', 'last_change': '2024-09-11T22:11:54.223953+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.223953+0000', 'last_undegraded': '2024-09-11T22:11:54.223953+0000', 'last_fullsized': '2024-09-11T22:11:54.223953+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:11:59.925 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-11T22:11:59.925 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.222801+0000', 'last_change': '2024-09-11T22:11:54.222801+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.222801+0000', 'last_undegraded': '2024-09-11T22:11:54.222801+0000', 'last_fullsized': '2024-09-11T22:11:54.222801+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:59.926 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-11T22:11:59.926 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.223447+0000', 'last_change': '2024-09-11T22:11:54.223447+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.223447+0000', 'last_undegraded': '2024-09-11T22:11:54.223447+0000', 'last_fullsized': '2024-09-11T22:11:54.223447+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:11:59.926 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-11T22:11:59.926 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.222896+0000', 'last_change': '2024-09-11T22:11:54.222896+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.222896+0000', 'last_undegraded': '2024-09-11T22:11:54.222896+0000', 'last_fullsized': '2024-09-11T22:11:54.222896+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:11:59.926 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-11T22:11:59.926 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.224975+0000', 'last_change': '2024-09-11T22:11:54.224975+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.224975+0000', 'last_undegraded': '2024-09-11T22:11:54.224975+0000', 'last_fullsized': '2024-09-11T22:11:54.224975+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:59.926 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-11T22:11:59.927 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.221366+0000', 'last_change': '2024-09-11T22:11:54.221366+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.221366+0000', 'last_undegraded': '2024-09-11T22:11:54.221366+0000', 'last_fullsized': '2024-09-11T22:11:54.221366+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:59.927 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-11T22:11:59.927 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.222277+0000', 'last_change': '2024-09-11T22:11:54.222277+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.222277+0000', 'last_undegraded': '2024-09-11T22:11:54.222277+0000', 'last_fullsized': '2024-09-11T22:11:54.222277+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:11:59.927 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-11T22:11:59.927 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.226269+0000', 'last_change': '2024-09-11T22:11:54.226269+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.226269+0000', 'last_undegraded': '2024-09-11T22:11:54.226269+0000', 'last_fullsized': '2024-09-11T22:11:54.226269+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:59.927 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-11T22:11:59.927 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.220078+0000', 'last_change': '2024-09-11T22:11:54.220078+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.220078+0000', 'last_undegraded': '2024-09-11T22:11:54.220078+0000', 'last_fullsized': '2024-09-11T22:11:54.220078+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:59.927 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-11T22:11:59.928 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.227816+0000', 'last_change': '2024-09-11T22:11:54.227816+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.227816+0000', 'last_undegraded': '2024-09-11T22:11:54.227816+0000', 'last_fullsized': '2024-09-11T22:11:54.227816+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:59.928 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-11T22:11:59.928 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.228313+0000', 'last_change': '2024-09-11T22:11:54.228313+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.228313+0000', 'last_undegraded': '2024-09-11T22:11:54.228313+0000', 'last_fullsized': '2024-09-11T22:11:54.228313+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:59.928 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-11T22:11:59.928 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.224117+0000', 'last_change': '2024-09-11T22:11:54.224117+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.224117+0000', 'last_undegraded': '2024-09-11T22:11:54.224117+0000', 'last_fullsized': '2024-09-11T22:11:54.224117+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:59.928 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-11T22:11:59.928 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.227662+0000', 'last_change': '2024-09-11T22:11:54.227662+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.227662+0000', 'last_undegraded': '2024-09-11T22:11:54.227662+0000', 'last_fullsized': '2024-09-11T22:11:54.227662+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:59.928 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-11T22:11:59.928 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.222828+0000', 'last_change': '2024-09-11T22:11:54.222828+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.222828+0000', 'last_undegraded': '2024-09-11T22:11:54.222828+0000', 'last_fullsized': '2024-09-11T22:11:54.222828+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:59.929 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-11T22:11:59.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.223419+0000', 'last_change': '2024-09-11T22:11:54.223419+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.223419+0000', 'last_undegraded': '2024-09-11T22:11:54.223419+0000', 'last_fullsized': '2024-09-11T22:11:54.223419+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:11:59.929 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-11T22:11:59.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.219747+0000', 'last_change': '2024-09-11T22:11:54.219747+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.219747+0000', 'last_undegraded': '2024-09-11T22:11:54.219747+0000', 'last_fullsized': '2024-09-11T22:11:54.219747+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:11:59.929 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-11T22:11:59.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.223586+0000', 'last_change': '2024-09-11T22:11:54.223586+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.223586+0000', 'last_undegraded': '2024-09-11T22:11:54.223586+0000', 'last_fullsized': '2024-09-11T22:11:54.223586+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:59.929 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-11T22:11:59.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.227247+0000', 'last_change': '2024-09-11T22:11:54.227247+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.227247+0000', 'last_undegraded': '2024-09-11T22:11:54.227247+0000', 'last_fullsized': '2024-09-11T22:11:54.227247+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:11:59.930 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-11T22:11:59.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.219602+0000', 'last_change': '2024-09-11T22:11:54.219602+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.219602+0000', 'last_undegraded': '2024-09-11T22:11:54.219602+0000', 'last_fullsized': '2024-09-11T22:11:54.219602+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:11:59.930 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-11T22:11:59.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.223044+0000', 'last_change': '2024-09-11T22:11:54.223044+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.223044+0000', 'last_undegraded': '2024-09-11T22:11:54.223044+0000', 'last_fullsized': '2024-09-11T22:11:54.223044+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:59.930 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-11T22:11:59.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.223642+0000', 'last_change': '2024-09-11T22:11:54.223642+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.223642+0000', 'last_undegraded': '2024-09-11T22:11:54.223642+0000', 'last_fullsized': '2024-09-11T22:11:54.223642+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:11:59.930 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-11T22:11:59.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.223384+0000', 'last_change': '2024-09-11T22:11:54.223384+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.223384+0000', 'last_undegraded': '2024-09-11T22:11:54.223384+0000', 'last_fullsized': '2024-09-11T22:11:54.223384+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:11:59.930 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-11T22:11:59.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.222388+0000', 'last_change': '2024-09-11T22:11:54.222388+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.222388+0000', 'last_undegraded': '2024-09-11T22:11:54.222388+0000', 'last_fullsized': '2024-09-11T22:11:54.222388+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:11:59.930 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-11T22:11:59.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:11:54.220524+0000', 'last_change': '2024-09-11T22:11:54.220524+0000', 'last_active': '2024-09-11T22:11:54.211897+0000', 'last_peered': '2024-09-11T22:11:54.211897+0000', 'last_clean': '2024-09-11T22:11:54.211897+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:11:54.220524+0000', 'last_undegraded': '2024-09-11T22:11:54.220524+0000', 'last_fullsized': '2024-09-11T22:11:54.220524+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'last_clean_scrub_stamp': '2024-09-11T22:11:54.211897+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:11:59.931 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:12:00.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.058+0000 7ff7daaf1640 1 Processor -- start 2024-09-11T22:12:00.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.058+0000 7ff7daaf1640 1 -- start start 2024-09-11T22:12:00.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7daaf1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7d40b3e10 0x7ff7d40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:00.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7daaf1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7d40b4f00 con 0x7ff7d40d05e0 2024-09-11T22:12:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7daaf1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7d40b4360 con 0x7ff7d415c2c0 2024-09-11T22:12:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7daaf1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff7d40b51c0 con 0x7ff7d40b3e10 2024-09-11T22:12:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7d3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff7d40d05e0 0x7ff7d40ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35756/0 (socket says 172.21.15.50:35756) 2024-09-11T22:12:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7d3fff640 1 -- 172.21.15.50:0/936045573 learned_addr learned my addr 172.21.15.50:0/936045573 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:12:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7d908e640 1 --2- 172.21.15.50:0/936045573 >> v2:172.21.15.77:3300/0 conn(0x7ff7d40b3e10 0x7ff7d40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7d37fe640 1 -- 172.21.15.50:0/936045573 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895432377 0 0) 0x7ff7d40b4f00 con 0x7ff7d40d05e0 2024-09-11T22:12:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7d37fe640 1 -- 172.21.15.50:0/936045573 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7c4003520 con 0x7ff7d40d05e0 2024-09-11T22:12:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7d37fe640 1 -- 172.21.15.50:0/936045573 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1037395175 0 0) 0x7ff7d40b4360 con 0x7ff7d415c2c0 2024-09-11T22:12:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7d37fe640 1 -- 172.21.15.50:0/936045573 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7d40b4f00 con 0x7ff7d415c2c0 2024-09-11T22:12:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7d37fe640 1 -- 172.21.15.50:0/936045573 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1234046216 0 0) 0x7ff7c4003520 con 0x7ff7d40d05e0 2024-09-11T22:12:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7d908e640 1 -- 172.21.15.50:0/936045573 >> v1:172.21.15.77:6789/0 conn(0x7ff7d415c2c0 legacy=0x7ff7d40cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.059+0000 7ff7d908e640 1 -- 172.21.15.50:0/936045573 >> v1:172.21.15.50:6789/0 conn(0x7ff7d40d05e0 legacy=0x7ff7d40ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.060+0000 7ff7d908e640 1 -- 172.21.15.50:0/936045573 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d40b54a0 con 0x7ff7d40b3e10 2024-09-11T22:12:00.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.060+0000 7ff7d908e640 1 --2- 172.21.15.50:0/936045573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7d40b3e10 0x7ff7d40b46a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009d90 tx=0x7ff7cc02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8b1b91b751bf2cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:00.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.061+0000 7ff7d37fe640 1 -- 172.21.15.50:0/936045573 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0001670 con 0x7ff7d40b3e10 2024-09-11T22:12:00.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.061+0000 7ff7d37fe640 1 -- 172.21.15.50:0/936045573 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7cc007540 con 0x7ff7d40b3e10 2024-09-11T22:12:00.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.061+0000 7ff7d37fe640 1 -- 172.21.15.50:0/936045573 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc007910 con 0x7ff7d40b3e10 2024-09-11T22:12:00.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.061+0000 7ff7daaf1640 1 -- 172.21.15.50:0/936045573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7d40b3e10 msgr2=0x7ff7d40b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.061+0000 7ff7daaf1640 1 --2- 172.21.15.50:0/936045573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7d40b3e10 0x7ff7d40b46a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009d90 tx=0x7ff7cc02a680 comp rx=0 tx=0).stop 2024-09-11T22:12:00.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.061+0000 7ff7daaf1640 1 -- 172.21.15.50:0/936045573 shutdown_connections 2024-09-11T22:12:00.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.061+0000 7ff7daaf1640 1 --2- 172.21.15.50:0/936045573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7d40b3e10 0x7ff7d40b46a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.061+0000 7ff7daaf1640 1 -- 172.21.15.50:0/936045573 >> 172.21.15.50:0/936045573 conn(0x7ff7d40679c0 msgr2=0x7ff7d4067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:00.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.061+0000 7ff7daaf1640 1 -- 172.21.15.50:0/936045573 shutdown_connections 2024-09-11T22:12:00.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.061+0000 7ff7daaf1640 1 -- 172.21.15.50:0/936045573 wait complete. 2024-09-11T22:12:00.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.062+0000 7ff7daaf1640 1 Processor -- start 2024-09-11T22:12:00.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.062+0000 7ff7daaf1640 1 -- start start 2024-09-11T22:12:00.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.063+0000 7ff7daaf1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7d40b3e10 0x7ff7d41e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:00.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.063+0000 7ff7daaf1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7d40d05e0 0x7ff7d414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:00.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.063+0000 7ff7daaf1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7d415c2c0 0x7ff7d4072660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:00.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.063+0000 7ff7daaf1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d406d070 con 0x7ff7d40d05e0 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.063+0000 7ff7daaf1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d40ce200 con 0x7ff7d40b3e10 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.063+0000 7ff7daaf1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d406d1f0 con 0x7ff7d415c2c0 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.063+0000 7ff7d3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7d40d05e0 0x7ff7d414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.063+0000 7ff7d3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7d40d05e0 0x7ff7d414df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52640/0 (socket says 172.21.15.50:52640) 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.063+0000 7ff7d3fff640 1 -- 172.21.15.50:0/568414979 learned_addr learned my addr 172.21.15.50:0/568414979 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.064+0000 7ff7d908e640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7d415c2c0 0x7ff7d4072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.064+0000 7ff7d888d640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7d40b3e10 0x7ff7d41e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.064+0000 7ff7d3fff640 1 -- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7d415c2c0 msgr2=0x7ff7d4072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.064+0000 7ff7d3fff640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7d415c2c0 0x7ff7d4072660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.064+0000 7ff7d3fff640 1 -- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7d40b3e10 msgr2=0x7ff7d41e72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.064+0000 7ff7d3fff640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7d40b3e10 0x7ff7d41e72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.064+0000 7ff7d3fff640 1 -- 172.21.15.50:0/568414979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d414e490 con 0x7ff7d40d05e0 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.064+0000 7ff7d3fff640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7d40d05e0 0x7ff7d414df50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c5a0 tx=0x7ff7c000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:00.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.064+0000 7ff7d17fa640 1 -- 172.21.15.50:0/568414979 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0017070 con 0x7ff7d40d05e0 2024-09-11T22:12:00.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.064+0000 7ff7d17fa640 1 -- 172.21.15.50:0/568414979 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c0005ce0 con 0x7ff7d40d05e0 2024-09-11T22:12:00.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.064+0000 7ff7daaf1640 1 -- 172.21.15.50:0/568414979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d40715c0 con 0x7ff7d40d05e0 2024-09-11T22:12:00.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.064+0000 7ff7d17fa640 1 -- 172.21.15.50:0/568414979 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00072b0 con 0x7ff7d40d05e0 2024-09-11T22:12:00.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.064+0000 7ff7daaf1640 1 -- 172.21.15.50:0/568414979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d4071b80 con 0x7ff7d40d05e0 2024-09-11T22:12:00.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.065+0000 7ff7daaf1640 1 -- 172.21.15.50:0/568414979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7d40b45f0 con 0x7ff7d40d05e0 2024-09-11T22:12:00.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.066+0000 7ff7d17fa640 1 -- 172.21.15.50:0/568414979 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7c001a070 con 0x7ff7d40d05e0 2024-09-11T22:12:00.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.066+0000 7ff7d17fa640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff7b806be30 0x7ff7b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:00.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.066+0000 7ff7d17fa640 1 -- 172.21.15.50:0/568414979 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff7c008a260 con 0x7ff7d40d05e0 2024-09-11T22:12:00.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.067+0000 7ff7d888d640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff7b806be30 0x7ff7b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:00.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.067+0000 7ff7d888d640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff7b806be30 0x7ff7b806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80011e0 tx=0x7ff7c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:00.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.071+0000 7ff7d17fa640 1 -- 172.21.15.50:0/568414979 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff7d40b45f0 con 0x7ff7d40d05e0 2024-09-11T22:12:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.312+0000 7ff7daaf1640 1 -- 172.21.15.50:0/568414979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff7d40cca60 con 0x7ff7d40d05e0 2024-09-11T22:12:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.312+0000 7ff7d17fa640 1 -- 172.21.15.50:0/568414979 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2749 (secure 0 0 0) 0x7ff7d414e490 con 0x7ff7d40d05e0 2024-09-11T22:12:00.313 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:12:00.313 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":69,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":52},{"state_name":"creating+peering","count":45}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590368,"bytes_used":246509568,"bytes_avail":772847603712,"bytes_total":773094113280,"inactive_pgs_ratio":0.46391752362251282,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":14,"btime":"2024-09-11T22:11:58:235097+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4815}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-11T22:11:57.373418+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:12:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.314+0000 7ff7daaf1640 1 -- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff7b806be30 msgr2=0x7ff7b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.314+0000 7ff7daaf1640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff7b806be30 0x7ff7b806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80011e0 tx=0x7ff7c8009040 comp rx=0 tx=0).stop 2024-09-11T22:12:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.314+0000 7ff7daaf1640 1 -- 172.21.15.50:0/568414979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7d40d05e0 msgr2=0x7ff7d414df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.314+0000 7ff7daaf1640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7d40d05e0 0x7ff7d414df50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c5a0 tx=0x7ff7c000ca60 comp rx=0 tx=0).stop 2024-09-11T22:12:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.314+0000 7ff7daaf1640 1 -- 172.21.15.50:0/568414979 shutdown_connections 2024-09-11T22:12:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.314+0000 7ff7daaf1640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff7b806be30 0x7ff7b806e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.314+0000 7ff7daaf1640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7d415c2c0 0x7ff7d4072660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.314+0000 7ff7daaf1640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7d40d05e0 0x7ff7d414df50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.314+0000 7ff7daaf1640 1 --2- 172.21.15.50:0/568414979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7d40b3e10 0x7ff7d41e72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.314+0000 7ff7daaf1640 1 -- 172.21.15.50:0/568414979 >> 172.21.15.50:0/568414979 conn(0x7ff7d40679c0 msgr2=0x7ff7d40b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:00.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.314+0000 7ff7daaf1640 1 -- 172.21.15.50:0/568414979 shutdown_connections 2024-09-11T22:12:00.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.314+0000 7ff7daaf1640 1 -- 172.21.15.50:0/568414979 wait complete. 2024-09-11T22:12:00.326 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:12:00.326 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:12:00.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.428+0000 7f92b7eae640 1 Processor -- start 2024-09-11T22:12:00.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.428+0000 7f92b7eae640 1 -- start start 2024-09-11T22:12:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b7eae640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f92b00728e0 0x7f92b0072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b7eae640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92b00b4e80 con 0x7f92b015c240 2024-09-11T22:12:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b7eae640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92b0073230 con 0x7f92b00735a0 2024-09-11T22:12:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b7eae640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f92b015c620 con 0x7f92b00728e0 2024-09-11T22:12:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b5c4a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f92b015c240 0x7f92b00b4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35764/0 (socket says 172.21.15.50:35764) 2024-09-11T22:12:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b5c4a640 1 -- 172.21.15.50:0/2158994966 learned_addr learned my addr 172.21.15.50:0/2158994966 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:12:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3353648488 0 0) 0x7f92b00b4e80 con 0x7f92b015c240 2024-09-11T22:12:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f929c003520 con 0x7f92b015c240 2024-09-11T22:12:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b644b640 1 --2- 172.21.15.50:0/2158994966 >> v2:172.21.15.77:3300/0 conn(0x7f92b00728e0 0x7f92b0072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1631383069 0 0) 0x7f929c003520 con 0x7f92b015c240 2024-09-11T22:12:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 >> v2:172.21.15.77:3300/0 conn(0x7f92b00728e0 msgr2=0x7f92b0072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:00.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b4c48640 1 --2- 172.21.15.50:0/2158994966 >> v2:172.21.15.77:3300/0 conn(0x7f92b00728e0 0x7f92b0072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 >> v1:172.21.15.77:6789/0 conn(0x7f92b00735a0 legacy=0x7f92b015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b015f2b0 con 0x7f92b015c240 2024-09-11T22:12:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.429+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f92ac001670 con 0x7f92b015c240 2024-09-11T22:12:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 >> v1:172.21.15.50:6789/0 conn(0x7f92b015c240 legacy=0x7f92b00b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b4c48640 1 --2- 172.21.15.50:0/2158994966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f929c0039b0 0x7f929c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b4c48640 1 --2- 172.21.15.50:0/2158994966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f929c004800 0x7f929c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b4c48640 1 --2- 172.21.15.50:0/2158994966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c0051c0 0x7f929c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f92b015c620 con 0x7f929c0051c0 2024-09-11T22:12:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f929c00c110 con 0x7f929c0039b0 2024-09-11T22:12:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f929c00c310 con 0x7f929c004800 2024-09-11T22:12:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b644b640 1 --2- 172.21.15.50:0/2158994966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c0051c0 0x7f929c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b5c4a640 1 --2- 172.21.15.50:0/2158994966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f929c0039b0 0x7f929c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:00.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b5449640 1 --2- 172.21.15.50:0/2158994966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f929c004800 0x7f929c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:00.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b644b640 1 -- 172.21.15.50:0/2158994966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f929c004800 msgr2=0x7f929c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:00.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b644b640 1 --2- 172.21.15.50:0/2158994966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f929c004800 0x7f929c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b644b640 1 -- 172.21.15.50:0/2158994966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f929c0039b0 msgr2=0x7f929c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:00.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b644b640 1 --2- 172.21.15.50:0/2158994966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f929c0039b0 0x7f929c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.430+0000 7f92b644b640 1 -- 172.21.15.50:0/2158994966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929c003520 con 0x7f929c0051c0 2024-09-11T22:12:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.431+0000 7f92b644b640 1 -- 172.21.15.50:0/2158994966 reap_dead start 2024-09-11T22:12:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.431+0000 7f92b644b640 1 --2- 172.21.15.50:0/2158994966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c0051c0 0x7f929c00b9c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f92a8007360 tx=0x7f929c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4a82eda48d24a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.431+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8009be0 con 0x7f929c0051c0 2024-09-11T22:12:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.431+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a8003bd0 con 0x7f929c0051c0 2024-09-11T22:12:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.431+0000 7f92b4c48640 1 -- 172.21.15.50:0/2158994966 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8004020 con 0x7f929c0051c0 2024-09-11T22:12:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.432+0000 7f92b7eae640 1 -- 172.21.15.50:0/2158994966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c0051c0 msgr2=0x7f929c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.432+0000 7f92b7eae640 1 --2- 172.21.15.50:0/2158994966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c0051c0 0x7f929c00b9c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f92a8007360 tx=0x7f929c005830 comp rx=0 tx=0).stop 2024-09-11T22:12:00.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.432+0000 7f92b7eae640 1 -- 172.21.15.50:0/2158994966 shutdown_connections 2024-09-11T22:12:00.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.432+0000 7f92b7eae640 1 --2- 172.21.15.50:0/2158994966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c0051c0 0x7f929c00b9c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.432+0000 7f92b7eae640 1 -- 172.21.15.50:0/2158994966 >> 172.21.15.50:0/2158994966 conn(0x7f92b00b2bd0 msgr2=0x7f92b00b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:00.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.432+0000 7f92b7eae640 1 -- 172.21.15.50:0/2158994966 shutdown_connections 2024-09-11T22:12:00.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.432+0000 7f92b7eae640 1 -- 172.21.15.50:0/2158994966 wait complete. 2024-09-11T22:12:00.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.433+0000 7f92b7eae640 1 Processor -- start 2024-09-11T22:12:00.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.433+0000 7f92b7eae640 1 -- start start 2024-09-11T22:12:00.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b7eae640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f929c0051c0 0x7f92b0147640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:00.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b7eae640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92b00ce0d0 0x7f92b0152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:00.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b7eae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00ce550 0x7f92b01528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:00.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b7eae640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f92b015fb20 con 0x7f92b00ce0d0 2024-09-11T22:12:00.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b7eae640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f92b015f840 con 0x7f92b00ce550 2024-09-11T22:12:00.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b7eae640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f92b00b3f70 con 0x7f929c0051c0 2024-09-11T22:12:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b5449640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92b00ce0d0 0x7f92b0152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b5449640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92b00ce0d0 0x7f92b0152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52658/0 (socket says 172.21.15.50:52658) 2024-09-11T22:12:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b5449640 1 -- 172.21.15.50:0/2986450039 learned_addr learned my addr 172.21.15.50:0/2986450039 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b644b640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00ce550 0x7f92b01528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b5c4a640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f929c0051c0 0x7f92b0147640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b5449640 1 -- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f929c0051c0 msgr2=0x7f92b0147640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b5449640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f929c0051c0 0x7f92b0147640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b5449640 1 -- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00ce550 msgr2=0x7f92b01528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b5449640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00ce550 0x7f92b01528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b5449640 1 -- 172.21.15.50:0/2986450039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b00cf500 con 0x7f92b00ce0d0 2024-09-11T22:12:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.434+0000 7f92b5449640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92b00ce0d0 0x7f92b0152380 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f92a000f540 tx=0x7f92a000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.435+0000 7f92a67fc640 1 -- 172.21.15.50:0/2986450039 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a00052e0 con 0x7f92b00ce0d0 2024-09-11T22:12:00.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.435+0000 7f92a67fc640 1 -- 172.21.15.50:0/2986450039 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a0018070 con 0x7f92b00ce0d0 2024-09-11T22:12:00.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.435+0000 7f92a67fc640 1 -- 172.21.15.50:0/2986450039 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a0003830 con 0x7f92b00ce0d0 2024-09-11T22:12:00.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.435+0000 7f92b7eae640 1 -- 172.21.15.50:0/2986450039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b00cf7a0 con 0x7f92b00ce0d0 2024-09-11T22:12:00.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.435+0000 7f92b7eae640 1 -- 172.21.15.50:0/2986450039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b00cfd60 con 0x7f92b00ce0d0 2024-09-11T22:12:00.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.436+0000 7f92b7eae640 1 -- 172.21.15.50:0/2986450039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b0162530 con 0x7f92b00ce0d0 2024-09-11T22:12:00.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.436+0000 7f92a67fc640 1 -- 172.21.15.50:0/2986450039 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92a00039d0 con 0x7f92b00ce0d0 2024-09-11T22:12:00.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.437+0000 7f92a67fc640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f929406be30 0x7f929406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:00.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.437+0000 7f92a67fc640 1 -- 172.21.15.50:0/2986450039 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f92a008aa80 con 0x7f92b00ce0d0 2024-09-11T22:12:00.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.437+0000 7f92b5c4a640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f929406be30 0x7f929406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:00.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.437+0000 7f92b5c4a640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f929406be30 0x7f929406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92b015a5e0 tx=0x7f92ac000f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:00.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.441+0000 7f92a67fc640 1 -- 172.21.15.50:0/2986450039 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92b0162530 con 0x7f92b00ce0d0 2024-09-11T22:12:00.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.613+0000 7f92b7eae640 1 -- 172.21.15.50:0/2986450039 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92b006ecd0 con 0x7f929406be30 2024-09-11T22:12:00.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.620+0000 7f92a67fc640 1 -- 172.21.15.50:0/2986450039 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248188 (secure 0 0 0) 0x7f92b006ecd0 con 0x7f929406be30 2024-09-11T22:12:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:12:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:12:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.623+0000 7f92b7eae640 1 -- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f929406be30 msgr2=0x7f929406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.623+0000 7f92b7eae640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f929406be30 0x7f929406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92b015a5e0 tx=0x7f92ac000f80 comp rx=0 tx=0).stop 2024-09-11T22:12:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.623+0000 7f92b7eae640 1 -- 172.21.15.50:0/2986450039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92b00ce0d0 msgr2=0x7f92b0152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.623+0000 7f92b7eae640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92b00ce0d0 0x7f92b0152380 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f92a000f540 tx=0x7f92a000fa00 comp rx=0 tx=0).stop 2024-09-11T22:12:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.623+0000 7f92b7eae640 1 -- 172.21.15.50:0/2986450039 shutdown_connections 2024-09-11T22:12:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.623+0000 7f92b7eae640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f929406be30 0x7f929406e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.623+0000 7f92b7eae640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00ce550 0x7f92b01528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.623+0000 7f92b7eae640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92b00ce0d0 0x7f92b0152380 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.623+0000 7f92b7eae640 1 --2- 172.21.15.50:0/2986450039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f929c0051c0 0x7f92b0147640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.623+0000 7f92b7eae640 1 -- 172.21.15.50:0/2986450039 >> 172.21.15.50:0/2986450039 conn(0x7f92b00b2bd0 msgr2=0x7f92b0161e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.623+0000 7f92b7eae640 1 -- 172.21.15.50:0/2986450039 shutdown_connections 2024-09-11T22:12:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:00.623+0000 7f92b7eae640 1 -- 172.21.15.50:0/2986450039 wait complete. 2024-09-11T22:12:00.635 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-11T22:11:59.373736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240732,"kb_used_data":3704,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733988,"statfs":{"total":773094113280,"available":772847603712,"internally_reserved":0,"allocated":3792896,"data_stored":2152356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001165"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224159+0000","last_change":"2024-09-11T22:11:54.224159+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224159+0000","last_undegraded":"2024-09-11T22:11:54.224159+0000","last_fullsized":"2024-09-11T22:11:54.224159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.229076+0000","last_change":"2024-09-11T22:11:54.229076+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.229076+0000","last_undegraded":"2024-09-11T22:11:54.229076+0000","last_fullsized":"2024-09-11T22:11:54.229076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221597+0000","last_change":"2024-09-11T22:11:54.221597+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221597+0000","last_undegraded":"2024-09-11T22:11:54.221597+0000","last_fullsized":"2024-09-11T22:11:54.221597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227738+0000","last_change":"2024-09-11T22:11:54.227738+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227738+0000","last_undegraded":"2024-09-11T22:11:54.227738+0000","last_fullsized":"2024-09-11T22:11:54.227738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269751+0000","last_change":"2024-09-11T22:11:55.239987+0000","last_active":"2024-09-11T22:11:56.269751+0000","last_peered":"2024-09-11T22:11:56.269751+0000","last_clean":"2024-09-11T22:11:56.269751+0000","last_became_active":"2024-09-11T22:11:55.239721+0000","last_became_peered":"2024-09-11T22:11:55.239721+0000","last_unstale":"2024-09-11T22:11:56.269751+0000","last_undegraded":"2024-09-11T22:11:56.269751+0000","last_fullsized":"2024-09-11T22:11:56.269751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:55.478293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224484+0000","last_change":"2024-09-11T22:11:54.224484+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224484+0000","last_undegraded":"2024-09-11T22:11:54.224484+0000","last_fullsized":"2024-09-11T22:11:54.224484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376942+0000","last_change":"2024-09-11T22:11:55.243344+0000","last_active":"2024-09-11T22:11:56.376942+0000","last_peered":"2024-09-11T22:11:56.376942+0000","last_clean":"2024-09-11T22:11:56.376942+0000","last_became_active":"2024-09-11T22:11:55.243030+0000","last_became_peered":"2024-09-11T22:11:55.243030+0000","last_unstale":"2024-09-11T22:11:56.376942+0000","last_undegraded":"2024-09-11T22:11:56.376942+0000","last_fullsized":"2024-09-11T22:11:56.376942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:37.498219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376653+0000","last_change":"2024-09-11T22:11:55.246301+0000","last_active":"2024-09-11T22:11:56.376653+0000","last_peered":"2024-09-11T22:11:56.376653+0000","last_clean":"2024-09-11T22:11:56.376653+0000","last_became_active":"2024-09-11T22:11:55.246028+0000","last_became_peered":"2024-09-11T22:11:55.246028+0000","last_unstale":"2024-09-11T22:11:56.376653+0000","last_undegraded":"2024-09-11T22:11:56.376653+0000","last_fullsized":"2024-09-11T22:11:56.376653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:59.563540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221431+0000","last_change":"2024-09-11T22:11:54.221431+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221431+0000","last_undegraded":"2024-09-11T22:11:54.221431+0000","last_fullsized":"2024-09-11T22:11:54.221431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.229724+0000","last_change":"2024-09-11T22:11:54.229724+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.229724+0000","last_undegraded":"2024-09-11T22:11:54.229724+0000","last_fullsized":"2024-09-11T22:11:54.229724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376923+0000","last_change":"2024-09-11T22:11:55.247502+0000","last_active":"2024-09-11T22:11:56.376923+0000","last_peered":"2024-09-11T22:11:56.376923+0000","last_clean":"2024-09-11T22:11:56.376923+0000","last_became_active":"2024-09-11T22:11:55.247218+0000","last_became_peered":"2024-09-11T22:11:55.247218+0000","last_unstale":"2024-09-11T22:11:56.376923+0000","last_undegraded":"2024-09-11T22:11:56.376923+0000","last_fullsized":"2024-09-11T22:11:56.376923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:18.187116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.220138+0000","last_change":"2024-09-11T22:11:54.220138+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.220138+0000","last_undegraded":"2024-09-11T22:11:54.220138+0000","last_fullsized":"2024-09-11T22:11:54.220138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269761+0000","last_change":"2024-09-11T22:11:55.245085+0000","last_active":"2024-09-11T22:11:56.269761+0000","last_peered":"2024-09-11T22:11:56.269761+0000","last_clean":"2024-09-11T22:11:56.269761+0000","last_became_active":"2024-09-11T22:11:55.244705+0000","last_became_peered":"2024-09-11T22:11:55.244705+0000","last_unstale":"2024-09-11T22:11:56.269761+0000","last_undegraded":"2024-09-11T22:11:56.269761+0000","last_fullsized":"2024-09-11T22:11:56.269761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:16.047678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224055+0000","last_change":"2024-09-11T22:11:54.224055+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224055+0000","last_undegraded":"2024-09-11T22:11:54.224055+0000","last_fullsized":"2024-09-11T22:11:54.224055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219788+0000","last_change":"2024-09-11T22:11:54.219788+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219788+0000","last_undegraded":"2024-09-11T22:11:54.219788+0000","last_fullsized":"2024-09-11T22:11:54.219788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377400+0000","last_change":"2024-09-11T22:11:55.246859+0000","last_active":"2024-09-11T22:11:56.377400+0000","last_peered":"2024-09-11T22:11:56.377400+0000","last_clean":"2024-09-11T22:11:56.377400+0000","last_became_active":"2024-09-11T22:11:55.246525+0000","last_became_peered":"2024-09-11T22:11:55.246525+0000","last_unstale":"2024-09-11T22:11:56.377400+0000","last_undegraded":"2024-09-11T22:11:56.377400+0000","last_fullsized":"2024-09-11T22:11:56.377400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:13.049644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377405+0000","last_change":"2024-09-11T22:11:55.242378+0000","last_active":"2024-09-11T22:11:56.377405+0000","last_peered":"2024-09-11T22:11:56.377405+0000","last_clean":"2024-09-11T22:11:56.377405+0000","last_became_active":"2024-09-11T22:11:55.242045+0000","last_became_peered":"2024-09-11T22:11:55.242045+0000","last_unstale":"2024-09-11T22:11:56.377405+0000","last_undegraded":"2024-09-11T22:11:56.377405+0000","last_fullsized":"2024-09-11T22:11:56.377405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:03.220536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228643+0000","last_change":"2024-09-11T22:11:54.228643+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228643+0000","last_undegraded":"2024-09-11T22:11:54.228643+0000","last_fullsized":"2024-09-11T22:11:54.228643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228176+0000","last_change":"2024-09-11T22:11:54.228176+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228176+0000","last_undegraded":"2024-09-11T22:11:54.228176+0000","last_fullsized":"2024-09-11T22:11:54.228176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269902+0000","last_change":"2024-09-11T22:11:55.241292+0000","last_active":"2024-09-11T22:11:56.269902+0000","last_peered":"2024-09-11T22:11:56.269902+0000","last_clean":"2024-09-11T22:11:56.269902+0000","last_became_active":"2024-09-11T22:11:55.241027+0000","last_became_peered":"2024-09-11T22:11:55.241027+0000","last_unstale":"2024-09-11T22:11:56.269902+0000","last_undegraded":"2024-09-11T22:11:56.269902+0000","last_fullsized":"2024-09-11T22:11:56.269902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:22.305162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222305+0000","last_change":"2024-09-11T22:11:54.222305+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222305+0000","last_undegraded":"2024-09-11T22:11:54.222305+0000","last_fullsized":"2024-09-11T22:11:54.222305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223221+0000","last_change":"2024-09-11T22:11:54.223221+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223221+0000","last_undegraded":"2024-09-11T22:11:54.223221+0000","last_fullsized":"2024-09-11T22:11:54.223221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223878+0000","last_change":"2024-09-11T22:11:54.223878+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223878+0000","last_undegraded":"2024-09-11T22:11:54.223878+0000","last_fullsized":"2024-09-11T22:11:54.223878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221189+0000","last_change":"2024-09-11T22:11:54.221189+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221189+0000","last_undegraded":"2024-09-11T22:11:54.221189+0000","last_fullsized":"2024-09-11T22:11:54.221189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.226803+0000","last_change":"2024-09-11T22:11:54.226803+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.226803+0000","last_undegraded":"2024-09-11T22:11:54.226803+0000","last_fullsized":"2024-09-11T22:11:54.226803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228131+0000","last_change":"2024-09-11T22:11:54.228131+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228131+0000","last_undegraded":"2024-09-11T22:11:54.228131+0000","last_fullsized":"2024-09-11T22:11:54.228131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228102+0000","last_change":"2024-09-11T22:11:54.228102+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228102+0000","last_undegraded":"2024-09-11T22:11:54.228102+0000","last_fullsized":"2024-09-11T22:11:54.228102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219566+0000","last_change":"2024-09-11T22:11:54.219566+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219566+0000","last_undegraded":"2024-09-11T22:11:54.219566+0000","last_fullsized":"2024-09-11T22:11:54.219566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221780+0000","last_change":"2024-09-11T22:11:54.221780+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221780+0000","last_undegraded":"2024-09-11T22:11:54.221780+0000","last_fullsized":"2024-09-11T22:11:54.221780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376796+0000","last_change":"2024-09-11T22:11:55.240071+0000","last_active":"2024-09-11T22:11:56.376796+0000","last_peered":"2024-09-11T22:11:56.376796+0000","last_clean":"2024-09-11T22:11:56.376796+0000","last_became_active":"2024-09-11T22:11:55.239614+0000","last_became_peered":"2024-09-11T22:11:55.239614+0000","last_unstale":"2024-09-11T22:11:56.376796+0000","last_undegraded":"2024-09-11T22:11:56.376796+0000","last_fullsized":"2024-09-11T22:11:56.376796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:27.962254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223953+0000","last_change":"2024-09-11T22:11:54.223953+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223953+0000","last_undegraded":"2024-09-11T22:11:54.223953+0000","last_fullsized":"2024-09-11T22:11:54.223953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377381+0000","last_change":"2024-09-11T22:11:55.240387+0000","last_active":"2024-09-11T22:11:56.377381+0000","last_peered":"2024-09-11T22:11:56.377381+0000","last_clean":"2024-09-11T22:11:56.377381+0000","last_became_active":"2024-09-11T22:11:55.239801+0000","last_became_peered":"2024-09-11T22:11:55.239801+0000","last_unstale":"2024-09-11T22:11:56.377381+0000","last_undegraded":"2024-09-11T22:11:56.377381+0000","last_fullsized":"2024-09-11T22:11:56.377381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:18.124249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222801+0000","last_change":"2024-09-11T22:11:54.222801+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222801+0000","last_undegraded":"2024-09-11T22:11:54.222801+0000","last_fullsized":"2024-09-11T22:11:54.222801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.233686+0000","last_change":"2024-09-11T22:11:54.232005+0000","last_active":"2024-09-11T22:11:54.233686+0000","last_peered":"2024-09-11T22:11:54.233686+0000","last_clean":"2024-09-11T22:11:54.233686+0000","last_became_active":"2024-09-11T22:11:54.231733+0000","last_became_peered":"2024-09-11T22:11:54.231733+0000","last_unstale":"2024-09-11T22:11:54.233686+0000","last_undegraded":"2024-09-11T22:11:54.233686+0000","last_fullsized":"2024-09-11T22:11:54.233686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.252826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223447+0000","last_change":"2024-09-11T22:11:54.223447+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223447+0000","last_undegraded":"2024-09-11T22:11:54.223447+0000","last_fullsized":"2024-09-11T22:11:54.223447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.234329+0000","last_change":"2024-09-11T22:11:54.231904+0000","last_active":"2024-09-11T22:11:54.234329+0000","last_peered":"2024-09-11T22:11:54.234329+0000","last_clean":"2024-09-11T22:11:54.234329+0000","last_became_active":"2024-09-11T22:11:54.231599+0000","last_became_peered":"2024-09-11T22:11:54.231599+0000","last_unstale":"2024-09-11T22:11:54.234329+0000","last_undegraded":"2024-09-11T22:11:54.234329+0000","last_fullsized":"2024-09-11T22:11:54.234329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:40.341037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222896+0000","last_change":"2024-09-11T22:11:54.222896+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222896+0000","last_undegraded":"2024-09-11T22:11:54.222896+0000","last_fullsized":"2024-09-11T22:11:54.222896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.238935+0000","last_change":"2024-09-11T22:11:54.237587+0000","last_active":"2024-09-11T22:11:54.238935+0000","last_peered":"2024-09-11T22:11:54.238935+0000","last_clean":"2024-09-11T22:11:54.238935+0000","last_became_active":"2024-09-11T22:11:54.237269+0000","last_became_peered":"2024-09-11T22:11:54.237269+0000","last_unstale":"2024-09-11T22:11:54.238935+0000","last_undegraded":"2024-09-11T22:11:54.238935+0000","last_fullsized":"2024-09-11T22:11:54.238935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:37.436803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224975+0000","last_change":"2024-09-11T22:11:54.224975+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224975+0000","last_undegraded":"2024-09-11T22:11:54.224975+0000","last_fullsized":"2024-09-11T22:11:54.224975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269864+0000","last_change":"2024-09-11T22:11:54.235284+0000","last_active":"2024-09-11T22:11:56.269864+0000","last_peered":"2024-09-11T22:11:56.269864+0000","last_clean":"2024-09-11T22:11:56.269864+0000","last_became_active":"2024-09-11T22:11:54.234997+0000","last_became_peered":"2024-09-11T22:11:54.234997+0000","last_unstale":"2024-09-11T22:11:56.269864+0000","last_undegraded":"2024-09-11T22:11:56.269864+0000","last_fullsized":"2024-09-11T22:11:56.269864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:10.204976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377327+0000","last_change":"2024-09-11T22:11:55.240321+0000","last_active":"2024-09-11T22:11:56.377327+0000","last_peered":"2024-09-11T22:11:56.377327+0000","last_clean":"2024-09-11T22:11:56.377327+0000","last_became_active":"2024-09-11T22:11:55.240027+0000","last_became_peered":"2024-09-11T22:11:55.240027+0000","last_unstale":"2024-09-11T22:11:56.377327+0000","last_undegraded":"2024-09-11T22:11:56.377327+0000","last_fullsized":"2024-09-11T22:11:56.377327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:41.384734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.234552+0000","last_change":"2024-09-11T22:11:54.232989+0000","last_active":"2024-09-11T22:11:54.234552+0000","last_peered":"2024-09-11T22:11:54.234552+0000","last_clean":"2024-09-11T22:11:54.234552+0000","last_became_active":"2024-09-11T22:11:54.232619+0000","last_became_peered":"2024-09-11T22:11:54.232619+0000","last_unstale":"2024-09-11T22:11:54.234552+0000","last_undegraded":"2024-09-11T22:11:54.234552+0000","last_fullsized":"2024-09-11T22:11:54.234552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:05.203238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.221366+0000","last_change":"2024-09-11T22:11:54.221366+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.221366+0000","last_undegraded":"2024-09-11T22:11:54.221366+0000","last_fullsized":"2024-09-11T22:11:54.221366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240469+0000","last_change":"2024-09-11T22:11:54.235628+0000","last_active":"2024-09-11T22:11:54.240469+0000","last_peered":"2024-09-11T22:11:54.240469+0000","last_clean":"2024-09-11T22:11:54.240469+0000","last_became_active":"2024-09-11T22:11:54.235423+0000","last_became_peered":"2024-09-11T22:11:54.235423+0000","last_unstale":"2024-09-11T22:11:54.240469+0000","last_undegraded":"2024-09-11T22:11:54.240469+0000","last_fullsized":"2024-09-11T22:11:54.240469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:54.817240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222277+0000","last_change":"2024-09-11T22:11:54.222277+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222277+0000","last_undegraded":"2024-09-11T22:11:54.222277+0000","last_fullsized":"2024-09-11T22:11:54.222277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.236777+0000","last_change":"2024-09-11T22:11:54.235445+0000","last_active":"2024-09-11T22:11:54.236777+0000","last_peered":"2024-09-11T22:11:54.236777+0000","last_clean":"2024-09-11T22:11:54.236777+0000","last_became_active":"2024-09-11T22:11:54.235120+0000","last_became_peered":"2024-09-11T22:11:54.235120+0000","last_unstale":"2024-09-11T22:11:54.236777+0000","last_undegraded":"2024-09-11T22:11:54.236777+0000","last_fullsized":"2024-09-11T22:11:54.236777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.226269+0000","last_change":"2024-09-11T22:11:54.226269+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.226269+0000","last_undegraded":"2024-09-11T22:11:54.226269+0000","last_fullsized":"2024-09-11T22:11:54.226269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230815+0000","last_change":"2024-09-11T22:11:54.229723+0000","last_active":"2024-09-11T22:11:54.230815+0000","last_peered":"2024-09-11T22:11:54.230815+0000","last_clean":"2024-09-11T22:11:54.230815+0000","last_became_active":"2024-09-11T22:11:54.228533+0000","last_became_peered":"2024-09-11T22:11:54.228533+0000","last_unstale":"2024-09-11T22:11:54.230815+0000","last_undegraded":"2024-09-11T22:11:54.230815+0000","last_fullsized":"2024-09-11T22:11:54.230815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:18.975678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.220078+0000","last_change":"2024-09-11T22:11:54.220078+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.220078+0000","last_undegraded":"2024-09-11T22:11:54.220078+0000","last_fullsized":"2024-09-11T22:11:54.220078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.238487+0000","last_change":"2024-09-11T22:11:54.237543+0000","last_active":"2024-09-11T22:11:54.238487+0000","last_peered":"2024-09-11T22:11:54.238487+0000","last_clean":"2024-09-11T22:11:54.238487+0000","last_became_active":"2024-09-11T22:11:54.235862+0000","last_became_peered":"2024-09-11T22:11:54.235862+0000","last_unstale":"2024-09-11T22:11:54.238487+0000","last_undegraded":"2024-09-11T22:11:54.238487+0000","last_fullsized":"2024-09-11T22:11:54.238487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:49.788303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227816+0000","last_change":"2024-09-11T22:11:54.227816+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227816+0000","last_undegraded":"2024-09-11T22:11:54.227816+0000","last_fullsized":"2024-09-11T22:11:54.227816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240131+0000","last_change":"2024-09-11T22:11:54.238373+0000","last_active":"2024-09-11T22:11:54.240131+0000","last_peered":"2024-09-11T22:11:54.240131+0000","last_clean":"2024-09-11T22:11:54.240131+0000","last_became_active":"2024-09-11T22:11:54.238087+0000","last_became_peered":"2024-09-11T22:11:54.238087+0000","last_unstale":"2024-09-11T22:11:54.240131+0000","last_undegraded":"2024-09-11T22:11:54.240131+0000","last_fullsized":"2024-09-11T22:11:54.240131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.228313+0000","last_change":"2024-09-11T22:11:54.228313+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.228313+0000","last_undegraded":"2024-09-11T22:11:54.228313+0000","last_fullsized":"2024-09-11T22:11:54.228313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.233865+0000","last_change":"2024-09-11T22:11:54.231853+0000","last_active":"2024-09-11T22:11:54.233865+0000","last_peered":"2024-09-11T22:11:54.233865+0000","last_clean":"2024-09-11T22:11:54.233865+0000","last_became_active":"2024-09-11T22:11:54.231564+0000","last_became_peered":"2024-09-11T22:11:54.231564+0000","last_unstale":"2024-09-11T22:11:54.233865+0000","last_undegraded":"2024-09-11T22:11:54.233865+0000","last_fullsized":"2024-09-11T22:11:54.233865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:36.010268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.224117+0000","last_change":"2024-09-11T22:11:54.224117+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.224117+0000","last_undegraded":"2024-09-11T22:11:54.224117+0000","last_fullsized":"2024-09-11T22:11:54.224117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239473+0000","last_change":"2024-09-11T22:11:54.238142+0000","last_active":"2024-09-11T22:11:54.239473+0000","last_peered":"2024-09-11T22:11:54.239473+0000","last_clean":"2024-09-11T22:11:54.239473+0000","last_became_active":"2024-09-11T22:11:54.237819+0000","last_became_peered":"2024-09-11T22:11:54.237819+0000","last_unstale":"2024-09-11T22:11:54.239473+0000","last_undegraded":"2024-09-11T22:11:54.239473+0000","last_fullsized":"2024-09-11T22:11:54.239473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:57.762834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227662+0000","last_change":"2024-09-11T22:11:54.227662+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227662+0000","last_undegraded":"2024-09-11T22:11:54.227662+0000","last_fullsized":"2024-09-11T22:11:54.227662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230860+0000","last_change":"2024-09-11T22:11:54.228141+0000","last_active":"2024-09-11T22:11:54.230860+0000","last_peered":"2024-09-11T22:11:54.230860+0000","last_clean":"2024-09-11T22:11:54.230860+0000","last_became_active":"2024-09-11T22:11:54.227742+0000","last_became_peered":"2024-09-11T22:11:54.227742+0000","last_unstale":"2024-09-11T22:11:54.230860+0000","last_undegraded":"2024-09-11T22:11:54.230860+0000","last_fullsized":"2024-09-11T22:11:54.230860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:00.285086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222828+0000","last_change":"2024-09-11T22:11:54.222828+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222828+0000","last_undegraded":"2024-09-11T22:11:54.222828+0000","last_fullsized":"2024-09-11T22:11:54.222828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239957+0000","last_change":"2024-09-11T22:11:54.238756+0000","last_active":"2024-09-11T22:11:54.239957+0000","last_peered":"2024-09-11T22:11:54.239957+0000","last_clean":"2024-09-11T22:11:54.239957+0000","last_became_active":"2024-09-11T22:11:54.238411+0000","last_became_peered":"2024-09-11T22:11:54.238411+0000","last_unstale":"2024-09-11T22:11:54.239957+0000","last_undegraded":"2024-09-11T22:11:54.239957+0000","last_fullsized":"2024-09-11T22:11:54.239957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.252826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377052+0000","last_change":"2024-09-11T22:11:55.240613+0000","last_active":"2024-09-11T22:11:56.377052+0000","last_peered":"2024-09-11T22:11:56.377052+0000","last_clean":"2024-09-11T22:11:56.377052+0000","last_became_active":"2024-09-11T22:11:55.240113+0000","last_became_peered":"2024-09-11T22:11:55.240113+0000","last_unstale":"2024-09-11T22:11:56.377052+0000","last_undegraded":"2024-09-11T22:11:56.377052+0000","last_fullsized":"2024-09-11T22:11:56.377052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:11.783248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.236974+0000","last_change":"2024-09-11T22:11:54.236090+0000","last_active":"2024-09-11T22:11:54.236974+0000","last_peered":"2024-09-11T22:11:54.236974+0000","last_clean":"2024-09-11T22:11:54.236974+0000","last_became_active":"2024-09-11T22:11:54.235800+0000","last_became_peered":"2024-09-11T22:11:54.235800+0000","last_unstale":"2024-09-11T22:11:54.236974+0000","last_undegraded":"2024-09-11T22:11:54.236974+0000","last_fullsized":"2024-09-11T22:11:54.236974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223419+0000","last_change":"2024-09-11T22:11:54.223419+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223419+0000","last_undegraded":"2024-09-11T22:11:54.223419+0000","last_fullsized":"2024-09-11T22:11:54.223419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239458+0000","last_change":"2024-09-11T22:11:54.238384+0000","last_active":"2024-09-11T22:11:54.239458+0000","last_peered":"2024-09-11T22:11:54.239458+0000","last_clean":"2024-09-11T22:11:54.239458+0000","last_became_active":"2024-09-11T22:11:54.237149+0000","last_became_peered":"2024-09-11T22:11:54.237149+0000","last_unstale":"2024-09-11T22:11:54.239458+0000","last_undegraded":"2024-09-11T22:11:54.239458+0000","last_fullsized":"2024-09-11T22:11:54.239458+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:58.538834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219747+0000","last_change":"2024-09-11T22:11:54.219747+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219747+0000","last_undegraded":"2024-09-11T22:11:54.219747+0000","last_fullsized":"2024-09-11T22:11:54.219747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240895+0000","last_change":"2024-09-11T22:11:54.239702+0000","last_active":"2024-09-11T22:11:54.240895+0000","last_peered":"2024-09-11T22:11:54.240895+0000","last_clean":"2024-09-11T22:11:54.240895+0000","last_became_active":"2024-09-11T22:11:54.239399+0000","last_became_peered":"2024-09-11T22:11:54.239399+0000","last_unstale":"2024-09-11T22:11:54.240895+0000","last_undegraded":"2024-09-11T22:11:54.240895+0000","last_fullsized":"2024-09-11T22:11:54.240895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223586+0000","last_change":"2024-09-11T22:11:54.223586+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223586+0000","last_undegraded":"2024-09-11T22:11:54.223586+0000","last_fullsized":"2024-09-11T22:11:54.223586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230828+0000","last_change":"2024-09-11T22:11:54.229239+0000","last_active":"2024-09-11T22:11:54.230828+0000","last_peered":"2024-09-11T22:11:54.230828+0000","last_clean":"2024-09-11T22:11:54.230828+0000","last_became_active":"2024-09-11T22:11:54.228972+0000","last_became_peered":"2024-09-11T22:11:54.228972+0000","last_unstale":"2024-09-11T22:11:54.230828+0000","last_undegraded":"2024-09-11T22:11:54.230828+0000","last_fullsized":"2024-09-11T22:11:54.230828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:43.406978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.227247+0000","last_change":"2024-09-11T22:11:54.227247+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.227247+0000","last_undegraded":"2024-09-11T22:11:54.227247+0000","last_fullsized":"2024-09-11T22:11:54.227247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230737+0000","last_change":"2024-09-11T22:11:54.227381+0000","last_active":"2024-09-11T22:11:54.230737+0000","last_peered":"2024-09-11T22:11:54.230737+0000","last_clean":"2024-09-11T22:11:54.230737+0000","last_became_active":"2024-09-11T22:11:54.226564+0000","last_became_peered":"2024-09-11T22:11:54.226564+0000","last_unstale":"2024-09-11T22:11:54.230737+0000","last_undegraded":"2024-09-11T22:11:54.230737+0000","last_fullsized":"2024-09-11T22:11:54.230737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:38.127270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269896+0000","last_change":"2024-09-11T22:11:55.244562+0000","last_active":"2024-09-11T22:11:56.269896+0000","last_peered":"2024-09-11T22:11:56.269896+0000","last_clean":"2024-09-11T22:11:56.269896+0000","last_became_active":"2024-09-11T22:11:55.244183+0000","last_became_peered":"2024-09-11T22:11:55.244183+0000","last_unstale":"2024-09-11T22:11:56.269896+0000","last_undegraded":"2024-09-11T22:11:56.269896+0000","last_fullsized":"2024-09-11T22:11:56.269896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:27.980484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240436+0000","last_change":"2024-09-11T22:11:54.235155+0000","last_active":"2024-09-11T22:11:54.240436+0000","last_peered":"2024-09-11T22:11:54.240436+0000","last_clean":"2024-09-11T22:11:54.240436+0000","last_became_active":"2024-09-11T22:11:54.234931+0000","last_became_peered":"2024-09-11T22:11:54.234931+0000","last_unstale":"2024-09-11T22:11:54.240436+0000","last_undegraded":"2024-09-11T22:11:54.240436+0000","last_fullsized":"2024-09-11T22:11:54.240436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:56.839831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269770+0000","last_change":"2024-09-11T22:11:55.245345+0000","last_active":"2024-09-11T22:11:56.269770+0000","last_peered":"2024-09-11T22:11:56.269770+0000","last_clean":"2024-09-11T22:11:56.269770+0000","last_became_active":"2024-09-11T22:11:55.245063+0000","last_became_peered":"2024-09-11T22:11:55.245063+0000","last_unstale":"2024-09-11T22:11:56.269770+0000","last_undegraded":"2024-09-11T22:11:56.269770+0000","last_fullsized":"2024-09-11T22:11:56.269770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:48.949134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.236016+0000","last_change":"2024-09-11T22:11:54.233955+0000","last_active":"2024-09-11T22:11:54.236016+0000","last_peered":"2024-09-11T22:11:54.236016+0000","last_clean":"2024-09-11T22:11:54.236016+0000","last_became_active":"2024-09-11T22:11:54.233649+0000","last_became_peered":"2024-09-11T22:11:54.233649+0000","last_unstale":"2024-09-11T22:11:54.236016+0000","last_undegraded":"2024-09-11T22:11:54.236016+0000","last_fullsized":"2024-09-11T22:11:54.236016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.252826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269860+0000","last_change":"2024-09-11T22:11:55.239063+0000","last_active":"2024-09-11T22:11:56.269860+0000","last_peered":"2024-09-11T22:11:56.269860+0000","last_clean":"2024-09-11T22:11:56.269860+0000","last_became_active":"2024-09-11T22:11:55.238715+0000","last_became_peered":"2024-09-11T22:11:55.238715+0000","last_unstale":"2024-09-11T22:11:56.269860+0000","last_undegraded":"2024-09-11T22:11:56.269860+0000","last_fullsized":"2024-09-11T22:11:56.269860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:12.370780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.245895+0000","last_change":"2024-09-11T22:11:54.237992+0000","last_active":"2024-09-11T22:11:54.245895+0000","last_peered":"2024-09-11T22:11:54.245895+0000","last_clean":"2024-09-11T22:11:54.245895+0000","last_became_active":"2024-09-11T22:11:54.237566+0000","last_became_peered":"2024-09-11T22:11:54.237566+0000","last_unstale":"2024-09-11T22:11:54.245895+0000","last_undegraded":"2024-09-11T22:11:54.245895+0000","last_fullsized":"2024-09-11T22:11:54.245895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269723+0000","last_change":"2024-09-11T22:11:55.239964+0000","last_active":"2024-09-11T22:11:56.269723+0000","last_peered":"2024-09-11T22:11:56.269723+0000","last_clean":"2024-09-11T22:11:56.269723+0000","last_became_active":"2024-09-11T22:11:55.239684+0000","last_became_peered":"2024-09-11T22:11:55.239684+0000","last_unstale":"2024-09-11T22:11:56.269723+0000","last_undegraded":"2024-09-11T22:11:56.269723+0000","last_fullsized":"2024-09-11T22:11:56.269723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:34.837927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240493+0000","last_change":"2024-09-11T22:11:54.235334+0000","last_active":"2024-09-11T22:11:54.240493+0000","last_peered":"2024-09-11T22:11:54.240493+0000","last_clean":"2024-09-11T22:11:54.240493+0000","last_became_active":"2024-09-11T22:11:54.235045+0000","last_became_peered":"2024-09-11T22:11:54.235045+0000","last_unstale":"2024-09-11T22:11:54.240493+0000","last_undegraded":"2024-09-11T22:11:54.240493+0000","last_fullsized":"2024-09-11T22:11:54.240493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:05.982977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376772+0000","last_change":"2024-09-11T22:11:55.243276+0000","last_active":"2024-09-11T22:11:56.376772+0000","last_peered":"2024-09-11T22:11:56.376772+0000","last_clean":"2024-09-11T22:11:56.376772+0000","last_became_active":"2024-09-11T22:11:55.242986+0000","last_became_peered":"2024-09-11T22:11:55.242986+0000","last_unstale":"2024-09-11T22:11:56.376772+0000","last_undegraded":"2024-09-11T22:11:56.376772+0000","last_fullsized":"2024-09-11T22:11:56.376772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:58.609145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.240252+0000","last_change":"2024-09-11T22:11:54.233653+0000","last_active":"2024-09-11T22:11:54.240252+0000","last_peered":"2024-09-11T22:11:54.240252+0000","last_clean":"2024-09-11T22:11:54.240252+0000","last_became_active":"2024-09-11T22:11:54.233372+0000","last_became_peered":"2024-09-11T22:11:54.233372+0000","last_unstale":"2024-09-11T22:11:54.240252+0000","last_undegraded":"2024-09-11T22:11:54.240252+0000","last_fullsized":"2024-09-11T22:11:54.240252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:07.799927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269805+0000","last_change":"2024-09-11T22:11:55.240205+0000","last_active":"2024-09-11T22:11:56.269805+0000","last_peered":"2024-09-11T22:11:56.269805+0000","last_clean":"2024-09-11T22:11:56.269805+0000","last_became_active":"2024-09-11T22:11:55.239329+0000","last_became_peered":"2024-09-11T22:11:55.239329+0000","last_unstale":"2024-09-11T22:11:56.269805+0000","last_undegraded":"2024-09-11T22:11:56.269805+0000","last_fullsized":"2024-09-11T22:11:56.269805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:55.632586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.238633+0000","last_change":"2024-09-11T22:11:54.236587+0000","last_active":"2024-09-11T22:11:54.238633+0000","last_peered":"2024-09-11T22:11:54.238633+0000","last_clean":"2024-09-11T22:11:54.238633+0000","last_became_active":"2024-09-11T22:11:54.236280+0000","last_became_peered":"2024-09-11T22:11:54.236280+0000","last_unstale":"2024-09-11T22:11:54.238633+0000","last_undegraded":"2024-09-11T22:11:54.238633+0000","last_fullsized":"2024-09-11T22:11:54.238633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:40.341037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.219602+0000","last_change":"2024-09-11T22:11:54.219602+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.219602+0000","last_undegraded":"2024-09-11T22:11:54.219602+0000","last_fullsized":"2024-09-11T22:11:54.219602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.237158+0000","last_change":"2024-09-11T22:11:54.235834+0000","last_active":"2024-09-11T22:11:54.237158+0000","last_peered":"2024-09-11T22:11:54.237158+0000","last_clean":"2024-09-11T22:11:54.237158+0000","last_became_active":"2024-09-11T22:11:54.235561+0000","last_became_peered":"2024-09-11T22:11:54.235561+0000","last_unstale":"2024-09-11T22:11:54.237158+0000","last_undegraded":"2024-09-11T22:11:54.237158+0000","last_fullsized":"2024-09-11T22:11:54.237158+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223044+0000","last_change":"2024-09-11T22:11:54.223044+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223044+0000","last_undegraded":"2024-09-11T22:11:54.223044+0000","last_fullsized":"2024-09-11T22:11:54.223044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.237757+0000","last_change":"2024-09-11T22:11:54.234484+0000","last_active":"2024-09-11T22:11:54.237757+0000","last_peered":"2024-09-11T22:11:54.237757+0000","last_clean":"2024-09-11T22:11:54.237757+0000","last_became_active":"2024-09-11T22:11:54.234219+0000","last_became_peered":"2024-09-11T22:11:54.234219+0000","last_unstale":"2024-09-11T22:11:54.237757+0000","last_undegraded":"2024-09-11T22:11:54.237757+0000","last_fullsized":"2024-09-11T22:11:54.237757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:19.243150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223642+0000","last_change":"2024-09-11T22:11:54.223642+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223642+0000","last_undegraded":"2024-09-11T22:11:54.223642+0000","last_fullsized":"2024-09-11T22:11:54.223642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.228711+0000","last_change":"2024-09-11T22:11:54.227468+0000","last_active":"2024-09-11T22:11:54.228711+0000","last_peered":"2024-09-11T22:11:54.228711+0000","last_clean":"2024-09-11T22:11:54.228711+0000","last_became_active":"2024-09-11T22:11:54.227109+0000","last_became_peered":"2024-09-11T22:11:54.227109+0000","last_unstale":"2024-09-11T22:11:54.228711+0000","last_undegraded":"2024-09-11T22:11:54.228711+0000","last_fullsized":"2024-09-11T22:11:54.228711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:19.243150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.223384+0000","last_change":"2024-09-11T22:11:54.223384+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.223384+0000","last_undegraded":"2024-09-11T22:11:54.223384+0000","last_fullsized":"2024-09-11T22:11:54.223384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.241442+0000","last_change":"2024-09-11T22:11:54.241027+0000","last_active":"2024-09-11T22:11:54.241442+0000","last_peered":"2024-09-11T22:11:54.241442+0000","last_clean":"2024-09-11T22:11:54.241442+0000","last_became_active":"2024-09-11T22:11:54.240641+0000","last_became_peered":"2024-09-11T22:11:54.240641+0000","last_unstale":"2024-09-11T22:11:54.241442+0000","last_undegraded":"2024-09-11T22:11:54.241442+0000","last_fullsized":"2024-09-11T22:11:54.241442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.222388+0000","last_change":"2024-09-11T22:11:54.222388+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.222388+0000","last_undegraded":"2024-09-11T22:11:54.222388+0000","last_fullsized":"2024-09-11T22:11:54.222388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.230715+0000","last_change":"2024-09-11T22:11:54.227045+0000","last_active":"2024-09-11T22:11:54.230715+0000","last_peered":"2024-09-11T22:11:54.230715+0000","last_clean":"2024-09-11T22:11:54.230715+0000","last_became_active":"2024-09-11T22:11:54.226304+0000","last_became_peered":"2024-09-11T22:11:54.226304+0000","last_unstale":"2024-09-11T22:11:54.230715+0000","last_undegraded":"2024-09-11T22:11:54.230715+0000","last_fullsized":"2024-09-11T22:11:54.230715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:03.624960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-11T22:11:54.220524+0000","last_change":"2024-09-11T22:11:54.220524+0000","last_active":"2024-09-11T22:11:54.211897+0000","last_peered":"2024-09-11T22:11:54.211897+0000","last_clean":"2024-09-11T22:11:54.211897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:11:54.220524+0000","last_undegraded":"2024-09-11T22:11:54.220524+0000","last_fullsized":"2024-09-11T22:11:54.220524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.239434+0000","last_change":"2024-09-11T22:11:54.238048+0000","last_active":"2024-09-11T22:11:54.239434+0000","last_peered":"2024-09-11T22:11:54.239434+0000","last_clean":"2024-09-11T22:11:54.239434+0000","last_became_active":"2024-09-11T22:11:54.237756+0000","last_became_peered":"2024-09-11T22:11:54.237756+0000","last_unstale":"2024-09-11T22:11:54.239434+0000","last_undegraded":"2024-09-11T22:11:54.239434+0000","last_fullsized":"2024-09-11T22:11:54.239434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:14.245228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376935+0000","last_change":"2024-09-11T22:11:55.246959+0000","last_active":"2024-09-11T22:11:56.376935+0000","last_peered":"2024-09-11T22:11:56.376935+0000","last_clean":"2024-09-11T22:11:56.376935+0000","last_became_active":"2024-09-11T22:11:55.246666+0000","last_became_peered":"2024-09-11T22:11:55.246666+0000","last_unstale":"2024-09-11T22:11:56.376935+0000","last_undegraded":"2024-09-11T22:11:56.376935+0000","last_fullsized":"2024-09-11T22:11:56.376935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:44.417139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-11T22:11:54.233260+0000","last_change":"2024-09-11T22:11:54.231109+0000","last_active":"2024-09-11T22:11:54.233260+0000","last_peered":"2024-09-11T22:11:54.233260+0000","last_clean":"2024-09-11T22:11:54.233260+0000","last_became_active":"2024-09-11T22:11:54.230832+0000","last_became_peered":"2024-09-11T22:11:54.230832+0000","last_unstale":"2024-09-11T22:11:54.233260+0000","last_undegraded":"2024-09-11T22:11:54.233260+0000","last_fullsized":"2024-09-11T22:11:54.233260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:40.341037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377457+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:11:56.377457+0000","last_peered":"2024-09-11T22:11:56.377457+0000","last_clean":"2024-09-11T22:11:56.377457+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:11:56.377457+0000","last_undegraded":"2024-09-11T22:11:56.377457+0000","last_fullsized":"2024-09-11T22:11:56.377457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":315392,"data_stored":116597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":909312,"data_stored":706965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":726397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35696,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336144,"statfs":{"total":96636764160,"available":96600211456,"internally_reserved":0,"allocated":356352,"data_stored":136009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:12:03.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:12:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.756+0000 7f0d96df6640 1 Processor -- start 2024-09-11T22:12:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.756+0000 7f0d96df6640 1 -- start start 2024-09-11T22:12:03.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.757+0000 7f0d96df6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d9015e870 0x7f0d900d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:03.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.757+0000 7f0d96df6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0d900d16d0 0x7f0d900d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:03.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.757+0000 7f0d96df6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d900cfa80 con 0x7f0d900d3a30 2024-09-11T22:12:03.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.757+0000 7f0d96df6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0d900d3ea0 con 0x7f0d900d16d0 2024-09-11T22:12:03.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.757+0000 7f0d96df6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0d900d1b10 con 0x7f0d9015e870 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.757+0000 7f0d95393640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0d900d3a30 0x7f0d900b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35768/0 (socket says 172.21.15.50:35768) 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d95393640 1 -- 172.21.15.50:0/3967197076 learned_addr learned my addr 172.21.15.50:0/3967197076 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d94b92640 1 --2- 172.21.15.50:0/3967197076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d9015e870 0x7f0d900d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3335379171 0 0) 0x7f0d88001490 con 0x7f0d900d3a30 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8ffff640 1 --2- 172.21.15.50:0/3967197076 >> v2:172.21.15.77:3300/0 conn(0x7f0d900d16d0 0x7f0d900d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d78003520 con 0x7f0d900d3a30 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2653939030 0 0) 0x7f0d78003520 con 0x7f0d900d3a30 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d9015e870 msgr2=0x7f0d900d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 --2- 172.21.15.50:0/3967197076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d9015e870 0x7f0d900d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 >> v2:172.21.15.77:3300/0 conn(0x7f0d900d16d0 msgr2=0x7f0d900d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 --2- 172.21.15.50:0/3967197076 >> v2:172.21.15.77:3300/0 conn(0x7f0d900d16d0 0x7f0d900d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d900d40d0 con 0x7f0d900d3a30 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f0d88001bc0 con 0x7f0d900d3a30 2024-09-11T22:12:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 >> v1:172.21.15.50:6789/0 conn(0x7f0d900d3a30 legacy=0x7f0d900b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:03.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 --2- 172.21.15.50:0/3967197076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d780039b0 0x7f0d78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:03.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 --2- 172.21.15.50:0/3967197076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d9015e870 0x7f0d78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:03.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 --2- 172.21.15.50:0/3967197076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78004d40 0x7f0d780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:03.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0d900d1b10 con 0x7f0d78004d40 2024-09-11T22:12:03.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7800b9c0 con 0x7f0d780039b0 2024-09-11T22:12:03.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0d7800bb40 con 0x7f0d9015e870 2024-09-11T22:12:03.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d95393640 1 --2- 172.21.15.50:0/3967197076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78004d40 0x7f0d780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:03.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d94b92640 1 --2- 172.21.15.50:0/3967197076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d780039b0 0x7f0d78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:03.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.758+0000 7f0d8ffff640 1 --2- 172.21.15.50:0/3967197076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d9015e870 0x7f0d78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.759+0000 7f0d95393640 1 -- 172.21.15.50:0/3967197076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d9015e870 msgr2=0x7f0d78004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.759+0000 7f0d95393640 1 --2- 172.21.15.50:0/3967197076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d9015e870 0x7f0d78004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.759+0000 7f0d95393640 1 -- 172.21.15.50:0/3967197076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d780039b0 msgr2=0x7f0d78003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.759+0000 7f0d95393640 1 --2- 172.21.15.50:0/3967197076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d780039b0 0x7f0d78003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.759+0000 7f0d95393640 1 -- 172.21.15.50:0/3967197076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d78003520 con 0x7f0d78004d40 2024-09-11T22:12:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.759+0000 7f0d94b92640 1 --2- 172.21.15.50:0/3967197076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d780039b0 0x7f0d78003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.759+0000 7f0d95393640 1 --2- 172.21.15.50:0/3967197076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78004d40 0x7f0d780051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800aa40 tx=0x7f0d78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889eff9cdac5506b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.760+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8800a690 con 0x7f0d78004d40 2024-09-11T22:12:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.760+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d8802f070 con 0x7f0d78004d40 2024-09-11T22:12:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.760+0000 7f0d8f7fe640 1 -- 172.21.15.50:0/3967197076 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88034470 con 0x7f0d78004d40 2024-09-11T22:12:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.760+0000 7f0d96df6640 1 -- 172.21.15.50:0/3967197076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78004d40 msgr2=0x7f0d780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.760+0000 7f0d96df6640 1 --2- 172.21.15.50:0/3967197076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d78004d40 0x7f0d780051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800aa40 tx=0x7f0d78005830 comp rx=0 tx=0).stop 2024-09-11T22:12:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.760+0000 7f0d95393640 1 -- 172.21.15.50:0/3967197076 reap_dead start 2024-09-11T22:12:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.760+0000 7f0d96df6640 1 -- 172.21.15.50:0/3967197076 shutdown_connections 2024-09-11T22:12:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.760+0000 7f0d96df6640 1 -- 172.21.15.50:0/3967197076 >> 172.21.15.50:0/3967197076 conn(0x7f0d900727a0 msgr2=0x7f0d900679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.760+0000 7f0d96df6640 1 -- 172.21.15.50:0/3967197076 shutdown_connections 2024-09-11T22:12:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.760+0000 7f0d96df6640 1 -- 172.21.15.50:0/3967197076 wait complete. 2024-09-11T22:12:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.761+0000 7f0d96df6640 1 Processor -- start 2024-09-11T22:12:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.762+0000 7f0d96df6640 1 -- start start 2024-09-11T22:12:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.762+0000 7f0d96df6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d90154d20 0x7f0d900cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.762+0000 7f0d96df6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d90158ff0 0x7f0d900ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.762+0000 7f0d96df6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d90156b20 0x7f0d90156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.762+0000 7f0d96df6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0d900b7ee0 con 0x7f0d90156b20 2024-09-11T22:12:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.762+0000 7f0d96df6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d900b7c00 con 0x7f0d90154d20 2024-09-11T22:12:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.762+0000 7f0d96df6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9015ec50 con 0x7f0d90158ff0 2024-09-11T22:12:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d95393640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d90156b20 0x7f0d90156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d95393640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d90156b20 0x7f0d90156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52684/0 (socket says 172.21.15.50:52684) 2024-09-11T22:12:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d95393640 1 -- 172.21.15.50:0/2437260128 learned_addr learned my addr 172.21.15.50:0/2437260128 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d8ffff640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d90158ff0 0x7f0d900ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d94b92640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d90154d20 0x7f0d900cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d95393640 1 -- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d90158ff0 msgr2=0x7f0d900ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d95393640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d90158ff0 0x7f0d900ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d95393640 1 -- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d90154d20 msgr2=0x7f0d900cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d95393640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d90154d20 0x7f0d900cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d95393640 1 -- 172.21.15.50:0/2437260128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d90157850 con 0x7f0d90156b20 2024-09-11T22:12:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d95393640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d90156b20 0x7f0d90156fa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800ab30 tx=0x7f0d900d42a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d8d7fa640 1 -- 172.21.15.50:0/2437260128 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80009690 con 0x7f0d90156b20 2024-09-11T22:12:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d8d7fa640 1 -- 172.21.15.50:0/2437260128 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d88034470 con 0x7f0d90156b20 2024-09-11T22:12:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d96df6640 1 -- 172.21.15.50:0/2437260128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d900cbaa0 con 0x7f0d90156b20 2024-09-11T22:12:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d8d7fa640 1 -- 172.21.15.50:0/2437260128 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8800a690 con 0x7f0d90156b20 2024-09-11T22:12:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.763+0000 7f0d96df6640 1 -- 172.21.15.50:0/2437260128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d90155100 con 0x7f0d90156b20 2024-09-11T22:12:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.764+0000 7f0d96df6640 1 -- 172.21.15.50:0/2437260128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d900b78b0 con 0x7f0d90156b20 2024-09-11T22:12:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.765+0000 7f0d8d7fa640 1 -- 172.21.15.50:0/2437260128 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d88034820 con 0x7f0d90156b20 2024-09-11T22:12:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.765+0000 7f0d8d7fa640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0d7c06be30 0x7f0d7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.765+0000 7f0d8d7fa640 1 -- 172.21.15.50:0/2437260128 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0d880aa0d0 con 0x7f0d90156b20 2024-09-11T22:12:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.766+0000 7f0d94b92640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0d7c06be30 0x7f0d7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.766+0000 7f0d94b92640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0d7c06be30 0x7f0d7c06e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009ce0 tx=0x7f0d80009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.770+0000 7f0d8d7fa640 1 -- 172.21.15.50:0/2437260128 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d900cfa80 con 0x7f0d90156b20 2024-09-11T22:12:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.943+0000 7f0d96df6640 1 -- 172.21.15.50:0/2437260128 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d9015d760 con 0x7f0d7c06be30 2024-09-11T22:12:03.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.950+0000 7f0d8d7fa640 1 -- 172.21.15.50:0/2437260128 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251927 (secure 0 0 0) 0x7f0d9015d760 con 0x7f0d7c06be30 2024-09-11T22:12:03.953 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:12:03.954 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:12:03.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.953+0000 7f0d96df6640 1 -- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0d7c06be30 msgr2=0x7f0d7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:03.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.953+0000 7f0d96df6640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0d7c06be30 0x7f0d7c06e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009ce0 tx=0x7f0d80009190 comp rx=0 tx=0).stop 2024-09-11T22:12:03.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.953+0000 7f0d96df6640 1 -- 172.21.15.50:0/2437260128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d90156b20 msgr2=0x7f0d90156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:03.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.953+0000 7f0d96df6640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d90156b20 0x7f0d90156fa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800ab30 tx=0x7f0d900d42a0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.953+0000 7f0d96df6640 1 -- 172.21.15.50:0/2437260128 shutdown_connections 2024-09-11T22:12:03.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.953+0000 7f0d96df6640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0d7c06be30 0x7f0d7c06e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.953+0000 7f0d96df6640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d90158ff0 0x7f0d900ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.953+0000 7f0d96df6640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d90156b20 0x7f0d90156fa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.953+0000 7f0d96df6640 1 --2- 172.21.15.50:0/2437260128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d90154d20 0x7f0d900cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:03.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.953+0000 7f0d96df6640 1 -- 172.21.15.50:0/2437260128 >> 172.21.15.50:0/2437260128 conn(0x7f0d900727a0 msgr2=0x7f0d900679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:03.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.953+0000 7f0d96df6640 1 -- 172.21.15.50:0/2437260128 shutdown_connections 2024-09-11T22:12:03.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:03.953+0000 7f0d96df6640 1 -- 172.21.15.50:0/2437260128 wait complete. 2024-09-11T22:12:03.965 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-11T22:12:03.374769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241048,"kb_used_data":3976,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733672,"statfs":{"total":773094113280,"available":772847280128,"internally_reserved":0,"allocated":4071424,"data_stored":2273068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.155741"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377197+0000","last_change":"2024-09-11T22:11:55.242129+0000","last_active":"2024-09-11T22:11:56.377197+0000","last_peered":"2024-09-11T22:11:56.377197+0000","last_clean":"2024-09-11T22:11:56.377197+0000","last_became_active":"2024-09-11T22:11:55.241674+0000","last_became_peered":"2024-09-11T22:11:55.241674+0000","last_unstale":"2024-09-11T22:11:56.377197+0000","last_undegraded":"2024-09-11T22:11:56.377197+0000","last_fullsized":"2024-09-11T22:11:56.377197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:19.467461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235544+0000","last_change":"2024-09-11T22:11:55.232990+0000","last_active":"2024-09-11T22:11:56.235544+0000","last_peered":"2024-09-11T22:11:56.235544+0000","last_clean":"2024-09-11T22:11:56.235544+0000","last_became_active":"2024-09-11T22:11:55.232673+0000","last_became_peered":"2024-09-11T22:11:55.232673+0000","last_unstale":"2024-09-11T22:11:56.235544+0000","last_undegraded":"2024-09-11T22:11:56.235544+0000","last_fullsized":"2024-09-11T22:11:56.235544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:44.178660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236482+0000","last_change":"2024-09-11T22:11:55.239947+0000","last_active":"2024-09-11T22:11:56.236482+0000","last_peered":"2024-09-11T22:11:56.236482+0000","last_clean":"2024-09-11T22:11:56.236482+0000","last_became_active":"2024-09-11T22:11:55.238812+0000","last_became_peered":"2024-09-11T22:11:55.238812+0000","last_unstale":"2024-09-11T22:11:56.236482+0000","last_undegraded":"2024-09-11T22:11:56.236482+0000","last_fullsized":"2024-09-11T22:11:56.236482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:18.939563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376976+0000","last_change":"2024-09-11T22:11:55.240772+0000","last_active":"2024-09-11T22:11:56.376976+0000","last_peered":"2024-09-11T22:11:56.376976+0000","last_clean":"2024-09-11T22:11:56.376976+0000","last_became_active":"2024-09-11T22:11:55.240454+0000","last_became_peered":"2024-09-11T22:11:55.240454+0000","last_unstale":"2024-09-11T22:11:56.376976+0000","last_undegraded":"2024-09-11T22:11:56.376976+0000","last_fullsized":"2024-09-11T22:11:56.376976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:03.055813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269751+0000","last_change":"2024-09-11T22:11:55.239987+0000","last_active":"2024-09-11T22:11:56.269751+0000","last_peered":"2024-09-11T22:11:56.269751+0000","last_clean":"2024-09-11T22:11:56.269751+0000","last_became_active":"2024-09-11T22:11:55.239721+0000","last_became_peered":"2024-09-11T22:11:55.239721+0000","last_unstale":"2024-09-11T22:11:56.269751+0000","last_undegraded":"2024-09-11T22:11:56.269751+0000","last_fullsized":"2024-09-11T22:11:56.269751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:55.478293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235244+0000","last_change":"2024-09-11T22:11:55.241049+0000","last_active":"2024-09-11T22:11:56.235244+0000","last_peered":"2024-09-11T22:11:56.235244+0000","last_clean":"2024-09-11T22:11:56.235244+0000","last_became_active":"2024-09-11T22:11:55.240788+0000","last_became_peered":"2024-09-11T22:11:55.240788+0000","last_unstale":"2024-09-11T22:11:56.235244+0000","last_undegraded":"2024-09-11T22:11:56.235244+0000","last_fullsized":"2024-09-11T22:11:56.235244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:03.531415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376942+0000","last_change":"2024-09-11T22:11:55.243344+0000","last_active":"2024-09-11T22:11:56.376942+0000","last_peered":"2024-09-11T22:11:56.376942+0000","last_clean":"2024-09-11T22:11:56.376942+0000","last_became_active":"2024-09-11T22:11:55.243030+0000","last_became_peered":"2024-09-11T22:11:55.243030+0000","last_unstale":"2024-09-11T22:11:56.376942+0000","last_undegraded":"2024-09-11T22:11:56.376942+0000","last_fullsized":"2024-09-11T22:11:56.376942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:37.498219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376653+0000","last_change":"2024-09-11T22:11:55.246301+0000","last_active":"2024-09-11T22:11:56.376653+0000","last_peered":"2024-09-11T22:11:56.376653+0000","last_clean":"2024-09-11T22:11:56.376653+0000","last_became_active":"2024-09-11T22:11:55.246028+0000","last_became_peered":"2024-09-11T22:11:55.246028+0000","last_unstale":"2024-09-11T22:11:56.376653+0000","last_undegraded":"2024-09-11T22:11:56.376653+0000","last_fullsized":"2024-09-11T22:11:56.376653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:59.563540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.237260+0000","last_change":"2024-09-11T22:11:55.247139+0000","last_active":"2024-09-11T22:11:56.237260+0000","last_peered":"2024-09-11T22:11:56.237260+0000","last_clean":"2024-09-11T22:11:56.237260+0000","last_became_active":"2024-09-11T22:11:55.246856+0000","last_became_peered":"2024-09-11T22:11:55.246856+0000","last_unstale":"2024-09-11T22:11:56.237260+0000","last_undegraded":"2024-09-11T22:11:56.237260+0000","last_fullsized":"2024-09-11T22:11:56.237260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:40.393912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377121+0000","last_change":"2024-09-11T22:11:55.242101+0000","last_active":"2024-09-11T22:11:56.377121+0000","last_peered":"2024-09-11T22:11:56.377121+0000","last_clean":"2024-09-11T22:11:56.377121+0000","last_became_active":"2024-09-11T22:11:55.241780+0000","last_became_peered":"2024-09-11T22:11:55.241780+0000","last_unstale":"2024-09-11T22:11:56.377121+0000","last_undegraded":"2024-09-11T22:11:56.377121+0000","last_fullsized":"2024-09-11T22:11:56.377121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:45.796301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376923+0000","last_change":"2024-09-11T22:11:55.247502+0000","last_active":"2024-09-11T22:11:56.376923+0000","last_peered":"2024-09-11T22:11:56.376923+0000","last_clean":"2024-09-11T22:11:56.376923+0000","last_became_active":"2024-09-11T22:11:55.247218+0000","last_became_peered":"2024-09-11T22:11:55.247218+0000","last_unstale":"2024-09-11T22:11:56.376923+0000","last_undegraded":"2024-09-11T22:11:56.376923+0000","last_fullsized":"2024-09-11T22:11:56.376923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:18.187116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236906+0000","last_change":"2024-09-11T22:11:55.234987+0000","last_active":"2024-09-11T22:11:56.236906+0000","last_peered":"2024-09-11T22:11:56.236906+0000","last_clean":"2024-09-11T22:11:56.236906+0000","last_became_active":"2024-09-11T22:11:55.234696+0000","last_became_peered":"2024-09-11T22:11:55.234696+0000","last_unstale":"2024-09-11T22:11:56.236906+0000","last_undegraded":"2024-09-11T22:11:56.236906+0000","last_fullsized":"2024-09-11T22:11:56.236906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:53.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269761+0000","last_change":"2024-09-11T22:11:55.245085+0000","last_active":"2024-09-11T22:11:56.269761+0000","last_peered":"2024-09-11T22:11:56.269761+0000","last_clean":"2024-09-11T22:11:56.269761+0000","last_became_active":"2024-09-11T22:11:55.244705+0000","last_became_peered":"2024-09-11T22:11:55.244705+0000","last_unstale":"2024-09-11T22:11:56.269761+0000","last_undegraded":"2024-09-11T22:11:56.269761+0000","last_fullsized":"2024-09-11T22:11:56.269761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:16.047678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235218+0000","last_change":"2024-09-11T22:11:55.246652+0000","last_active":"2024-09-11T22:11:56.235218+0000","last_peered":"2024-09-11T22:11:56.235218+0000","last_clean":"2024-09-11T22:11:56.235218+0000","last_became_active":"2024-09-11T22:11:55.246397+0000","last_became_peered":"2024-09-11T22:11:55.246397+0000","last_unstale":"2024-09-11T22:11:56.235218+0000","last_undegraded":"2024-09-11T22:11:56.235218+0000","last_fullsized":"2024-09-11T22:11:56.235218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:25.440453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236443+0000","last_change":"2024-09-11T22:11:55.234613+0000","last_active":"2024-09-11T22:11:56.236443+0000","last_peered":"2024-09-11T22:11:56.236443+0000","last_clean":"2024-09-11T22:11:56.236443+0000","last_became_active":"2024-09-11T22:11:55.234308+0000","last_became_peered":"2024-09-11T22:11:55.234308+0000","last_unstale":"2024-09-11T22:11:56.236443+0000","last_undegraded":"2024-09-11T22:11:56.236443+0000","last_fullsized":"2024-09-11T22:11:56.236443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:56.889619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377400+0000","last_change":"2024-09-11T22:11:55.246859+0000","last_active":"2024-09-11T22:11:56.377400+0000","last_peered":"2024-09-11T22:11:56.377400+0000","last_clean":"2024-09-11T22:11:56.377400+0000","last_became_active":"2024-09-11T22:11:55.246525+0000","last_became_peered":"2024-09-11T22:11:55.246525+0000","last_unstale":"2024-09-11T22:11:56.377400+0000","last_undegraded":"2024-09-11T22:11:56.377400+0000","last_fullsized":"2024-09-11T22:11:56.377400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:13.049644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377405+0000","last_change":"2024-09-11T22:11:55.242378+0000","last_active":"2024-09-11T22:11:56.377405+0000","last_peered":"2024-09-11T22:11:56.377405+0000","last_clean":"2024-09-11T22:11:56.377405+0000","last_became_active":"2024-09-11T22:11:55.242045+0000","last_became_peered":"2024-09-11T22:11:55.242045+0000","last_unstale":"2024-09-11T22:11:56.377405+0000","last_undegraded":"2024-09-11T22:11:56.377405+0000","last_fullsized":"2024-09-11T22:11:56.377405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:03.220536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235579+0000","last_change":"2024-09-11T22:11:55.243109+0000","last_active":"2024-09-11T22:11:56.235579+0000","last_peered":"2024-09-11T22:11:56.235579+0000","last_clean":"2024-09-11T22:11:56.235579+0000","last_became_active":"2024-09-11T22:11:55.242783+0000","last_became_peered":"2024-09-11T22:11:55.242783+0000","last_unstale":"2024-09-11T22:11:56.235579+0000","last_undegraded":"2024-09-11T22:11:56.235579+0000","last_fullsized":"2024-09-11T22:11:56.235579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:49.685695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235372+0000","last_change":"2024-09-11T22:11:55.243134+0000","last_active":"2024-09-11T22:11:56.235372+0000","last_peered":"2024-09-11T22:11:56.235372+0000","last_clean":"2024-09-11T22:11:56.235372+0000","last_became_active":"2024-09-11T22:11:55.242843+0000","last_became_peered":"2024-09-11T22:11:55.242843+0000","last_unstale":"2024-09-11T22:11:56.235372+0000","last_undegraded":"2024-09-11T22:11:56.235372+0000","last_fullsized":"2024-09-11T22:11:56.235372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:50.665961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269902+0000","last_change":"2024-09-11T22:11:55.241292+0000","last_active":"2024-09-11T22:11:56.269902+0000","last_peered":"2024-09-11T22:11:56.269902+0000","last_clean":"2024-09-11T22:11:56.269902+0000","last_became_active":"2024-09-11T22:11:55.241027+0000","last_became_peered":"2024-09-11T22:11:55.241027+0000","last_unstale":"2024-09-11T22:11:56.269902+0000","last_undegraded":"2024-09-11T22:11:56.269902+0000","last_fullsized":"2024-09-11T22:11:56.269902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:22.305162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236959+0000","last_change":"2024-09-11T22:11:55.227571+0000","last_active":"2024-09-11T22:11:56.236959+0000","last_peered":"2024-09-11T22:11:56.236959+0000","last_clean":"2024-09-11T22:11:56.236959+0000","last_became_active":"2024-09-11T22:11:55.227269+0000","last_became_peered":"2024-09-11T22:11:55.227269+0000","last_unstale":"2024-09-11T22:11:56.236959+0000","last_undegraded":"2024-09-11T22:11:56.236959+0000","last_fullsized":"2024-09-11T22:11:56.236959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:55.473133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.237376+0000","last_change":"2024-09-11T22:11:55.236638+0000","last_active":"2024-09-11T22:11:56.237376+0000","last_peered":"2024-09-11T22:11:56.237376+0000","last_clean":"2024-09-11T22:11:56.237376+0000","last_became_active":"2024-09-11T22:11:55.236361+0000","last_became_peered":"2024-09-11T22:11:55.236361+0000","last_unstale":"2024-09-11T22:11:56.237376+0000","last_undegraded":"2024-09-11T22:11:56.237376+0000","last_fullsized":"2024-09-11T22:11:56.237376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:03.055813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376338+0000","last_change":"2024-09-11T22:11:55.234087+0000","last_active":"2024-09-11T22:11:56.376338+0000","last_peered":"2024-09-11T22:11:56.376338+0000","last_clean":"2024-09-11T22:11:56.376338+0000","last_became_active":"2024-09-11T22:11:55.233790+0000","last_became_peered":"2024-09-11T22:11:55.233790+0000","last_unstale":"2024-09-11T22:11:56.376338+0000","last_undegraded":"2024-09-11T22:11:56.376338+0000","last_fullsized":"2024-09-11T22:11:56.376338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:19.467461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236214+0000","last_change":"2024-09-11T22:11:55.241606+0000","last_active":"2024-09-11T22:11:56.236214+0000","last_peered":"2024-09-11T22:11:56.236214+0000","last_clean":"2024-09-11T22:11:56.236214+0000","last_became_active":"2024-09-11T22:11:55.241262+0000","last_became_peered":"2024-09-11T22:11:55.241262+0000","last_unstale":"2024-09-11T22:11:56.236214+0000","last_undegraded":"2024-09-11T22:11:56.236214+0000","last_fullsized":"2024-09-11T22:11:56.236214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:06.163078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377221+0000","last_change":"2024-09-11T22:11:55.246092+0000","last_active":"2024-09-11T22:11:56.377221+0000","last_peered":"2024-09-11T22:11:56.377221+0000","last_clean":"2024-09-11T22:11:56.377221+0000","last_became_active":"2024-09-11T22:11:55.245719+0000","last_became_peered":"2024-09-11T22:11:55.245719+0000","last_unstale":"2024-09-11T22:11:56.377221+0000","last_undegraded":"2024-09-11T22:11:56.377221+0000","last_fullsized":"2024-09-11T22:11:56.377221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.256300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235697+0000","last_change":"2024-09-11T22:11:55.245763+0000","last_active":"2024-09-11T22:11:56.235697+0000","last_peered":"2024-09-11T22:11:56.235697+0000","last_clean":"2024-09-11T22:11:56.235697+0000","last_became_active":"2024-09-11T22:11:55.245476+0000","last_became_peered":"2024-09-11T22:11:55.245476+0000","last_unstale":"2024-09-11T22:11:56.235697+0000","last_undegraded":"2024-09-11T22:11:56.235697+0000","last_fullsized":"2024-09-11T22:11:56.235697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:28.408951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377314+0000","last_change":"2024-09-11T22:11:55.245483+0000","last_active":"2024-09-11T22:11:56.377314+0000","last_peered":"2024-09-11T22:11:56.377314+0000","last_clean":"2024-09-11T22:11:56.377314+0000","last_became_active":"2024-09-11T22:11:55.245148+0000","last_became_peered":"2024-09-11T22:11:55.245148+0000","last_unstale":"2024-09-11T22:11:56.377314+0000","last_undegraded":"2024-09-11T22:11:56.377314+0000","last_fullsized":"2024-09-11T22:11:56.377314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:57.793047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.237012+0000","last_change":"2024-09-11T22:11:55.226884+0000","last_active":"2024-09-11T22:11:56.237012+0000","last_peered":"2024-09-11T22:11:56.237012+0000","last_clean":"2024-09-11T22:11:56.237012+0000","last_became_active":"2024-09-11T22:11:55.226600+0000","last_became_peered":"2024-09-11T22:11:55.226600+0000","last_unstale":"2024-09-11T22:11:56.237012+0000","last_undegraded":"2024-09-11T22:11:56.237012+0000","last_fullsized":"2024-09-11T22:11:56.237012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:25.440453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.237111+0000","last_change":"2024-09-11T22:11:55.236275+0000","last_active":"2024-09-11T22:11:56.237111+0000","last_peered":"2024-09-11T22:11:56.237111+0000","last_clean":"2024-09-11T22:11:56.237111+0000","last_became_active":"2024-09-11T22:11:55.235987+0000","last_became_peered":"2024-09-11T22:11:55.235987+0000","last_unstale":"2024-09-11T22:11:56.237111+0000","last_undegraded":"2024-09-11T22:11:56.237111+0000","last_fullsized":"2024-09-11T22:11:56.237111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:12:38.717707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376796+0000","last_change":"2024-09-11T22:11:55.240071+0000","last_active":"2024-09-11T22:11:56.376796+0000","last_peered":"2024-09-11T22:11:56.376796+0000","last_clean":"2024-09-11T22:11:56.376796+0000","last_became_active":"2024-09-11T22:11:55.239614+0000","last_became_peered":"2024-09-11T22:11:55.239614+0000","last_unstale":"2024-09-11T22:11:56.376796+0000","last_undegraded":"2024-09-11T22:11:56.376796+0000","last_fullsized":"2024-09-11T22:11:56.376796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:27.962254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376898+0000","last_change":"2024-09-11T22:11:55.249677+0000","last_active":"2024-09-11T22:11:56.376898+0000","last_peered":"2024-09-11T22:11:56.376898+0000","last_clean":"2024-09-11T22:11:56.376898+0000","last_became_active":"2024-09-11T22:11:55.249370+0000","last_became_peered":"2024-09-11T22:11:55.249370+0000","last_unstale":"2024-09-11T22:11:56.376898+0000","last_undegraded":"2024-09-11T22:11:56.376898+0000","last_fullsized":"2024-09-11T22:11:56.376898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:39.067618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377381+0000","last_change":"2024-09-11T22:11:55.240387+0000","last_active":"2024-09-11T22:11:56.377381+0000","last_peered":"2024-09-11T22:11:56.377381+0000","last_clean":"2024-09-11T22:11:56.377381+0000","last_became_active":"2024-09-11T22:11:55.239801+0000","last_became_peered":"2024-09-11T22:11:55.239801+0000","last_unstale":"2024-09-11T22:11:56.377381+0000","last_undegraded":"2024-09-11T22:11:56.377381+0000","last_fullsized":"2024-09-11T22:11:56.377381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:18.124249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376553+0000","last_change":"2024-09-11T22:11:55.234896+0000","last_active":"2024-09-11T22:11:56.376553+0000","last_peered":"2024-09-11T22:11:56.376553+0000","last_clean":"2024-09-11T22:11:56.376553+0000","last_became_active":"2024-09-11T22:11:55.234540+0000","last_became_peered":"2024-09-11T22:11:55.234540+0000","last_unstale":"2024-09-11T22:11:56.376553+0000","last_undegraded":"2024-09-11T22:11:56.376553+0000","last_fullsized":"2024-09-11T22:11:56.376553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:03.332490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377324+0000","last_change":"2024-09-11T22:11:54.232005+0000","last_active":"2024-09-11T22:11:56.377324+0000","last_peered":"2024-09-11T22:11:56.377324+0000","last_clean":"2024-09-11T22:11:56.377324+0000","last_became_active":"2024-09-11T22:11:54.231733+0000","last_became_peered":"2024-09-11T22:11:54.231733+0000","last_unstale":"2024-09-11T22:11:56.377324+0000","last_undegraded":"2024-09-11T22:11:56.377324+0000","last_fullsized":"2024-09-11T22:11:56.377324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:49.788303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377375+0000","last_change":"2024-09-11T22:11:55.243896+0000","last_active":"2024-09-11T22:11:56.377375+0000","last_peered":"2024-09-11T22:11:56.377375+0000","last_clean":"2024-09-11T22:11:56.377375+0000","last_became_active":"2024-09-11T22:11:55.243626+0000","last_became_peered":"2024-09-11T22:11:55.243626+0000","last_unstale":"2024-09-11T22:11:56.377375+0000","last_undegraded":"2024-09-11T22:11:56.377375+0000","last_fullsized":"2024-09-11T22:11:56.377375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:03.332490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376501+0000","last_change":"2024-09-11T22:11:54.231904+0000","last_active":"2024-09-11T22:11:56.376501+0000","last_peered":"2024-09-11T22:11:56.376501+0000","last_clean":"2024-09-11T22:11:56.376501+0000","last_became_active":"2024-09-11T22:11:54.231599+0000","last_became_peered":"2024-09-11T22:11:54.231599+0000","last_unstale":"2024-09-11T22:11:56.376501+0000","last_undegraded":"2024-09-11T22:11:56.376501+0000","last_fullsized":"2024-09-11T22:11:56.376501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:49.788303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.237633+0000","last_change":"2024-09-11T22:11:55.236455+0000","last_active":"2024-09-11T22:11:56.237633+0000","last_peered":"2024-09-11T22:11:56.237633+0000","last_clean":"2024-09-11T22:11:56.237633+0000","last_became_active":"2024-09-11T22:11:55.235571+0000","last_became_peered":"2024-09-11T22:11:55.235571+0000","last_unstale":"2024-09-11T22:11:56.237633+0000","last_undegraded":"2024-09-11T22:11:56.237633+0000","last_fullsized":"2024-09-11T22:11:56.237633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:45.796301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235358+0000","last_change":"2024-09-11T22:11:54.237587+0000","last_active":"2024-09-11T22:11:56.235358+0000","last_peered":"2024-09-11T22:11:56.235358+0000","last_clean":"2024-09-11T22:11:56.235358+0000","last_became_active":"2024-09-11T22:11:54.237269+0000","last_became_peered":"2024-09-11T22:11:54.237269+0000","last_unstale":"2024-09-11T22:11:56.235358+0000","last_undegraded":"2024-09-11T22:11:56.235358+0000","last_fullsized":"2024-09-11T22:11:56.235358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:09.667558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377242+0000","last_change":"2024-09-11T22:11:55.249480+0000","last_active":"2024-09-11T22:11:56.377242+0000","last_peered":"2024-09-11T22:11:56.377242+0000","last_clean":"2024-09-11T22:11:56.377242+0000","last_became_active":"2024-09-11T22:11:55.249216+0000","last_became_peered":"2024-09-11T22:11:55.249216+0000","last_unstale":"2024-09-11T22:11:56.377242+0000","last_undegraded":"2024-09-11T22:11:56.377242+0000","last_fullsized":"2024-09-11T22:11:56.377242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:06.163078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269864+0000","last_change":"2024-09-11T22:11:54.235284+0000","last_active":"2024-09-11T22:11:56.269864+0000","last_peered":"2024-09-11T22:11:56.269864+0000","last_clean":"2024-09-11T22:11:56.269864+0000","last_became_active":"2024-09-11T22:11:54.234997+0000","last_became_peered":"2024-09-11T22:11:54.234997+0000","last_unstale":"2024-09-11T22:11:56.269864+0000","last_undegraded":"2024-09-11T22:11:56.269864+0000","last_fullsized":"2024-09-11T22:11:56.269864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:10.204976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377327+0000","last_change":"2024-09-11T22:11:55.240321+0000","last_active":"2024-09-11T22:11:56.377327+0000","last_peered":"2024-09-11T22:11:56.377327+0000","last_clean":"2024-09-11T22:11:56.377327+0000","last_became_active":"2024-09-11T22:11:55.240027+0000","last_became_peered":"2024-09-11T22:11:55.240027+0000","last_unstale":"2024-09-11T22:11:56.377327+0000","last_undegraded":"2024-09-11T22:11:56.377327+0000","last_fullsized":"2024-09-11T22:11:56.377327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:41.384734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.237202+0000","last_change":"2024-09-11T22:11:54.232989+0000","last_active":"2024-09-11T22:11:56.237202+0000","last_peered":"2024-09-11T22:11:56.237202+0000","last_clean":"2024-09-11T22:11:56.237202+0000","last_became_active":"2024-09-11T22:11:54.232619+0000","last_became_peered":"2024-09-11T22:11:54.232619+0000","last_unstale":"2024-09-11T22:11:56.237202+0000","last_undegraded":"2024-09-11T22:11:56.237202+0000","last_fullsized":"2024-09-11T22:11:56.237202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:37.436803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236566+0000","last_change":"2024-09-11T22:11:55.226838+0000","last_active":"2024-09-11T22:11:56.236566+0000","last_peered":"2024-09-11T22:11:56.236566+0000","last_clean":"2024-09-11T22:11:56.236566+0000","last_became_active":"2024-09-11T22:11:55.226529+0000","last_became_peered":"2024-09-11T22:11:55.226529+0000","last_unstale":"2024-09-11T22:11:56.236566+0000","last_undegraded":"2024-09-11T22:11:56.236566+0000","last_fullsized":"2024-09-11T22:11:56.236566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:59.403795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.237396+0000","last_change":"2024-09-11T22:11:54.235628+0000","last_active":"2024-09-11T22:11:56.237396+0000","last_peered":"2024-09-11T22:11:56.237396+0000","last_clean":"2024-09-11T22:11:56.237396+0000","last_became_active":"2024-09-11T22:11:54.235423+0000","last_became_peered":"2024-09-11T22:11:54.235423+0000","last_unstale":"2024-09-11T22:11:56.237396+0000","last_undegraded":"2024-09-11T22:11:56.237396+0000","last_fullsized":"2024-09-11T22:11:56.237396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:19.243150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236304+0000","last_change":"2024-09-11T22:11:55.235095+0000","last_active":"2024-09-11T22:11:56.236304+0000","last_peered":"2024-09-11T22:11:56.236304+0000","last_clean":"2024-09-11T22:11:56.236304+0000","last_became_active":"2024-09-11T22:11:55.234605+0000","last_became_peered":"2024-09-11T22:11:55.234605+0000","last_unstale":"2024-09-11T22:11:56.236304+0000","last_undegraded":"2024-09-11T22:11:56.236304+0000","last_fullsized":"2024-09-11T22:11:56.236304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:03.332490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235095+0000","last_change":"2024-09-11T22:11:54.235445+0000","last_active":"2024-09-11T22:11:56.235095+0000","last_peered":"2024-09-11T22:11:56.235095+0000","last_clean":"2024-09-11T22:11:56.235095+0000","last_became_active":"2024-09-11T22:11:54.235120+0000","last_became_peered":"2024-09-11T22:11:54.235120+0000","last_unstale":"2024-09-11T22:11:56.235095+0000","last_undegraded":"2024-09-11T22:11:56.235095+0000","last_fullsized":"2024-09-11T22:11:56.235095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:07.799927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376823+0000","last_change":"2024-09-11T22:11:55.235739+0000","last_active":"2024-09-11T22:11:56.376823+0000","last_peered":"2024-09-11T22:11:56.376823+0000","last_clean":"2024-09-11T22:11:56.376823+0000","last_became_active":"2024-09-11T22:11:55.234245+0000","last_became_peered":"2024-09-11T22:11:55.234245+0000","last_unstale":"2024-09-11T22:11:56.376823+0000","last_undegraded":"2024-09-11T22:11:56.376823+0000","last_fullsized":"2024-09-11T22:11:56.376823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:12:38.717707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236403+0000","last_change":"2024-09-11T22:11:54.229723+0000","last_active":"2024-09-11T22:11:56.236403+0000","last_peered":"2024-09-11T22:11:56.236403+0000","last_clean":"2024-09-11T22:11:56.236403+0000","last_became_active":"2024-09-11T22:11:54.228533+0000","last_became_peered":"2024-09-11T22:11:54.228533+0000","last_unstale":"2024-09-11T22:11:56.236403+0000","last_undegraded":"2024-09-11T22:11:56.236403+0000","last_fullsized":"2024-09-11T22:11:56.236403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:40.341037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.237174+0000","last_change":"2024-09-11T22:11:55.235619+0000","last_active":"2024-09-11T22:11:56.237174+0000","last_peered":"2024-09-11T22:11:56.237174+0000","last_clean":"2024-09-11T22:11:56.237174+0000","last_became_active":"2024-09-11T22:11:55.235367+0000","last_became_peered":"2024-09-11T22:11:55.235367+0000","last_unstale":"2024-09-11T22:11:56.237174+0000","last_undegraded":"2024-09-11T22:11:56.237174+0000","last_fullsized":"2024-09-11T22:11:56.237174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:50.665961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235426+0000","last_change":"2024-09-11T22:11:54.237543+0000","last_active":"2024-09-11T22:11:56.235426+0000","last_peered":"2024-09-11T22:11:56.235426+0000","last_clean":"2024-09-11T22:11:56.235426+0000","last_became_active":"2024-09-11T22:11:54.235862+0000","last_became_peered":"2024-09-11T22:11:54.235862+0000","last_unstale":"2024-09-11T22:11:56.235426+0000","last_undegraded":"2024-09-11T22:11:56.235426+0000","last_fullsized":"2024-09-11T22:11:56.235426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:27.214461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235297+0000","last_change":"2024-09-11T22:11:55.248884+0000","last_active":"2024-09-11T22:11:56.235297+0000","last_peered":"2024-09-11T22:11:56.235297+0000","last_clean":"2024-09-11T22:11:56.235297+0000","last_became_active":"2024-09-11T22:11:55.248583+0000","last_became_peered":"2024-09-11T22:11:55.248583+0000","last_unstale":"2024-09-11T22:11:56.235297+0000","last_undegraded":"2024-09-11T22:11:56.235297+0000","last_fullsized":"2024-09-11T22:11:56.235297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:04.057569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376637+0000","last_change":"2024-09-11T22:11:54.238373+0000","last_active":"2024-09-11T22:11:56.376637+0000","last_peered":"2024-09-11T22:11:56.376637+0000","last_clean":"2024-09-11T22:11:56.376637+0000","last_became_active":"2024-09-11T22:11:54.238087+0000","last_became_peered":"2024-09-11T22:11:54.238087+0000","last_unstale":"2024-09-11T22:11:56.376637+0000","last_undegraded":"2024-09-11T22:11:56.376637+0000","last_fullsized":"2024-09-11T22:11:56.376637+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:58.538834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235547+0000","last_change":"2024-09-11T22:11:55.245057+0000","last_active":"2024-09-11T22:11:56.235547+0000","last_peered":"2024-09-11T22:11:56.235547+0000","last_clean":"2024-09-11T22:11:56.235547+0000","last_became_active":"2024-09-11T22:11:55.244050+0000","last_became_peered":"2024-09-11T22:11:55.244050+0000","last_unstale":"2024-09-11T22:11:56.235547+0000","last_undegraded":"2024-09-11T22:11:56.235547+0000","last_fullsized":"2024-09-11T22:11:56.235547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:04.722789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236623+0000","last_change":"2024-09-11T22:11:54.231853+0000","last_active":"2024-09-11T22:11:56.236623+0000","last_peered":"2024-09-11T22:11:56.236623+0000","last_clean":"2024-09-11T22:11:56.236623+0000","last_became_active":"2024-09-11T22:11:54.231564+0000","last_became_peered":"2024-09-11T22:11:54.231564+0000","last_unstale":"2024-09-11T22:11:56.236623+0000","last_undegraded":"2024-09-11T22:11:56.236623+0000","last_fullsized":"2024-09-11T22:11:56.236623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:38.062213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236322+0000","last_change":"2024-09-11T22:11:55.240252+0000","last_active":"2024-09-11T22:11:56.236322+0000","last_peered":"2024-09-11T22:11:56.236322+0000","last_clean":"2024-09-11T22:11:56.236322+0000","last_became_active":"2024-09-11T22:11:55.239146+0000","last_became_peered":"2024-09-11T22:11:55.239146+0000","last_unstale":"2024-09-11T22:11:56.236322+0000","last_undegraded":"2024-09-11T22:11:56.236322+0000","last_fullsized":"2024-09-11T22:11:56.236322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:57.793047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235535+0000","last_change":"2024-09-11T22:11:54.238142+0000","last_active":"2024-09-11T22:11:56.235535+0000","last_peered":"2024-09-11T22:11:56.235535+0000","last_clean":"2024-09-11T22:11:56.235535+0000","last_became_active":"2024-09-11T22:11:54.237819+0000","last_became_peered":"2024-09-11T22:11:54.237819+0000","last_unstale":"2024-09-11T22:11:56.235535+0000","last_undegraded":"2024-09-11T22:11:56.235535+0000","last_fullsized":"2024-09-11T22:11:56.235535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:18.462057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376797+0000","last_change":"2024-09-11T22:11:55.235279+0000","last_active":"2024-09-11T22:11:56.376797+0000","last_peered":"2024-09-11T22:11:56.376797+0000","last_clean":"2024-09-11T22:11:56.376797+0000","last_became_active":"2024-09-11T22:11:55.234968+0000","last_became_peered":"2024-09-11T22:11:55.234968+0000","last_unstale":"2024-09-11T22:11:56.376797+0000","last_undegraded":"2024-09-11T22:11:56.376797+0000","last_fullsized":"2024-09-11T22:11:56.376797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:55.473133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.237318+0000","last_change":"2024-09-11T22:11:54.228141+0000","last_active":"2024-09-11T22:11:56.237318+0000","last_peered":"2024-09-11T22:11:56.237318+0000","last_clean":"2024-09-11T22:11:56.237318+0000","last_became_active":"2024-09-11T22:11:54.227742+0000","last_became_peered":"2024-09-11T22:11:54.227742+0000","last_unstale":"2024-09-11T22:11:56.237318+0000","last_undegraded":"2024-09-11T22:11:56.237318+0000","last_fullsized":"2024-09-11T22:11:56.237318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:14.245228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235493+0000","last_change":"2024-09-11T22:11:55.234149+0000","last_active":"2024-09-11T22:11:56.235493+0000","last_peered":"2024-09-11T22:11:56.235493+0000","last_clean":"2024-09-11T22:11:56.235493+0000","last_became_active":"2024-09-11T22:11:55.233859+0000","last_became_peered":"2024-09-11T22:11:55.233859+0000","last_unstale":"2024-09-11T22:11:56.235493+0000","last_undegraded":"2024-09-11T22:11:56.235493+0000","last_fullsized":"2024-09-11T22:11:56.235493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:53.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376757+0000","last_change":"2024-09-11T22:11:54.238756+0000","last_active":"2024-09-11T22:11:56.376757+0000","last_peered":"2024-09-11T22:11:56.376757+0000","last_clean":"2024-09-11T22:11:56.376757+0000","last_became_active":"2024-09-11T22:11:54.238411+0000","last_became_peered":"2024-09-11T22:11:54.238411+0000","last_unstale":"2024-09-11T22:11:56.376757+0000","last_undegraded":"2024-09-11T22:11:56.376757+0000","last_fullsized":"2024-09-11T22:11:56.376757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:37.436803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377052+0000","last_change":"2024-09-11T22:11:55.240613+0000","last_active":"2024-09-11T22:11:56.377052+0000","last_peered":"2024-09-11T22:11:56.377052+0000","last_clean":"2024-09-11T22:11:56.377052+0000","last_became_active":"2024-09-11T22:11:55.240113+0000","last_became_peered":"2024-09-11T22:11:55.240113+0000","last_unstale":"2024-09-11T22:11:56.377052+0000","last_undegraded":"2024-09-11T22:11:56.377052+0000","last_fullsized":"2024-09-11T22:11:56.377052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:11.783248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235145+0000","last_change":"2024-09-11T22:11:54.236090+0000","last_active":"2024-09-11T22:11:56.235145+0000","last_peered":"2024-09-11T22:11:56.235145+0000","last_clean":"2024-09-11T22:11:56.235145+0000","last_became_active":"2024-09-11T22:11:54.235800+0000","last_became_peered":"2024-09-11T22:11:54.235800+0000","last_unstale":"2024-09-11T22:11:56.235145+0000","last_undegraded":"2024-09-11T22:11:56.235145+0000","last_fullsized":"2024-09-11T22:11:56.235145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:38.062213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376914+0000","last_change":"2024-09-11T22:11:55.235947+0000","last_active":"2024-09-11T22:11:56.376914+0000","last_peered":"2024-09-11T22:11:56.376914+0000","last_clean":"2024-09-11T22:11:56.376914+0000","last_became_active":"2024-09-11T22:11:55.235657+0000","last_became_peered":"2024-09-11T22:11:55.235657+0000","last_unstale":"2024-09-11T22:11:56.376914+0000","last_undegraded":"2024-09-11T22:11:56.376914+0000","last_fullsized":"2024-09-11T22:11:56.376914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:10.672963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235057+0000","last_change":"2024-09-11T22:11:54.238384+0000","last_active":"2024-09-11T22:11:56.235057+0000","last_peered":"2024-09-11T22:11:56.235057+0000","last_clean":"2024-09-11T22:11:56.235057+0000","last_became_active":"2024-09-11T22:11:54.237149+0000","last_became_peered":"2024-09-11T22:11:54.237149+0000","last_unstale":"2024-09-11T22:11:56.235057+0000","last_undegraded":"2024-09-11T22:11:56.235057+0000","last_fullsized":"2024-09-11T22:11:56.235057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:02.327085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.237787+0000","last_change":"2024-09-11T22:11:55.231088+0000","last_active":"2024-09-11T22:11:56.237787+0000","last_peered":"2024-09-11T22:11:56.237787+0000","last_clean":"2024-09-11T22:11:56.237787+0000","last_became_active":"2024-09-11T22:11:55.230707+0000","last_became_peered":"2024-09-11T22:11:55.230707+0000","last_unstale":"2024-09-11T22:11:56.237787+0000","last_undegraded":"2024-09-11T22:11:56.237787+0000","last_fullsized":"2024-09-11T22:11:56.237787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.256300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377283+0000","last_change":"2024-09-11T22:11:54.239702+0000","last_active":"2024-09-11T22:11:56.377283+0000","last_peered":"2024-09-11T22:11:56.377283+0000","last_clean":"2024-09-11T22:11:56.377283+0000","last_became_active":"2024-09-11T22:11:54.239399+0000","last_became_peered":"2024-09-11T22:11:54.239399+0000","last_unstale":"2024-09-11T22:11:56.377283+0000","last_undegraded":"2024-09-11T22:11:56.377283+0000","last_fullsized":"2024-09-11T22:11:56.377283+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:57.762834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236906+0000","last_change":"2024-09-11T22:11:55.228821+0000","last_active":"2024-09-11T22:11:56.236906+0000","last_peered":"2024-09-11T22:11:56.236906+0000","last_clean":"2024-09-11T22:11:56.236906+0000","last_became_active":"2024-09-11T22:11:55.228153+0000","last_became_peered":"2024-09-11T22:11:55.228153+0000","last_unstale":"2024-09-11T22:11:56.236906+0000","last_undegraded":"2024-09-11T22:11:56.236906+0000","last_fullsized":"2024-09-11T22:11:56.236906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:03.531415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.237760+0000","last_change":"2024-09-11T22:11:54.229239+0000","last_active":"2024-09-11T22:11:56.237760+0000","last_peered":"2024-09-11T22:11:56.237760+0000","last_clean":"2024-09-11T22:11:56.237760+0000","last_became_active":"2024-09-11T22:11:54.228972+0000","last_became_peered":"2024-09-11T22:11:54.228972+0000","last_unstale":"2024-09-11T22:11:56.237760+0000","last_undegraded":"2024-09-11T22:11:56.237760+0000","last_fullsized":"2024-09-11T22:11:56.237760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:49.788303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377013+0000","last_change":"2024-09-11T22:11:55.233832+0000","last_active":"2024-09-11T22:11:56.377013+0000","last_peered":"2024-09-11T22:11:56.377013+0000","last_clean":"2024-09-11T22:11:56.377013+0000","last_became_active":"2024-09-11T22:11:55.233517+0000","last_became_peered":"2024-09-11T22:11:55.233517+0000","last_unstale":"2024-09-11T22:11:56.377013+0000","last_undegraded":"2024-09-11T22:11:56.377013+0000","last_fullsized":"2024-09-11T22:11:56.377013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:40.393912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.237311+0000","last_change":"2024-09-11T22:11:54.227381+0000","last_active":"2024-09-11T22:11:56.237311+0000","last_peered":"2024-09-11T22:11:56.237311+0000","last_clean":"2024-09-11T22:11:56.237311+0000","last_became_active":"2024-09-11T22:11:54.226564+0000","last_became_peered":"2024-09-11T22:11:54.226564+0000","last_unstale":"2024-09-11T22:11:56.237311+0000","last_undegraded":"2024-09-11T22:11:56.237311+0000","last_fullsized":"2024-09-11T22:11:56.237311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:47:38.324478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269896+0000","last_change":"2024-09-11T22:11:55.244562+0000","last_active":"2024-09-11T22:11:56.269896+0000","last_peered":"2024-09-11T22:11:56.269896+0000","last_clean":"2024-09-11T22:11:56.269896+0000","last_became_active":"2024-09-11T22:11:55.244183+0000","last_became_peered":"2024-09-11T22:11:55.244183+0000","last_unstale":"2024-09-11T22:11:56.269896+0000","last_undegraded":"2024-09-11T22:11:56.269896+0000","last_fullsized":"2024-09-11T22:11:56.269896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:27.980484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.237617+0000","last_change":"2024-09-11T22:11:54.235155+0000","last_active":"2024-09-11T22:11:56.237617+0000","last_peered":"2024-09-11T22:11:56.237617+0000","last_clean":"2024-09-11T22:11:56.237617+0000","last_became_active":"2024-09-11T22:11:54.234931+0000","last_became_peered":"2024-09-11T22:11:54.234931+0000","last_unstale":"2024-09-11T22:11:56.237617+0000","last_undegraded":"2024-09-11T22:11:56.237617+0000","last_fullsized":"2024-09-11T22:11:56.237617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269770+0000","last_change":"2024-09-11T22:11:55.245345+0000","last_active":"2024-09-11T22:11:56.269770+0000","last_peered":"2024-09-11T22:11:56.269770+0000","last_clean":"2024-09-11T22:11:56.269770+0000","last_became_active":"2024-09-11T22:11:55.245063+0000","last_became_peered":"2024-09-11T22:11:55.245063+0000","last_unstale":"2024-09-11T22:11:56.269770+0000","last_undegraded":"2024-09-11T22:11:56.269770+0000","last_fullsized":"2024-09-11T22:11:56.269770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:48.949134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376556+0000","last_change":"2024-09-11T22:11:54.233955+0000","last_active":"2024-09-11T22:11:56.376556+0000","last_peered":"2024-09-11T22:11:56.376556+0000","last_clean":"2024-09-11T22:11:56.376556+0000","last_became_active":"2024-09-11T22:11:54.233649+0000","last_became_peered":"2024-09-11T22:11:54.233649+0000","last_unstale":"2024-09-11T22:11:56.376556+0000","last_undegraded":"2024-09-11T22:11:56.376556+0000","last_fullsized":"2024-09-11T22:11:56.376556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:37.436803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269860+0000","last_change":"2024-09-11T22:11:55.239063+0000","last_active":"2024-09-11T22:11:56.269860+0000","last_peered":"2024-09-11T22:11:56.269860+0000","last_clean":"2024-09-11T22:11:56.269860+0000","last_became_active":"2024-09-11T22:11:55.238715+0000","last_became_peered":"2024-09-11T22:11:55.238715+0000","last_unstale":"2024-09-11T22:11:56.269860+0000","last_undegraded":"2024-09-11T22:11:56.269860+0000","last_fullsized":"2024-09-11T22:11:56.269860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:12.370780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377448+0000","last_change":"2024-09-11T22:11:54.237992+0000","last_active":"2024-09-11T22:11:56.377448+0000","last_peered":"2024-09-11T22:11:56.377448+0000","last_clean":"2024-09-11T22:11:56.377448+0000","last_became_active":"2024-09-11T22:11:54.237566+0000","last_became_peered":"2024-09-11T22:11:54.237566+0000","last_unstale":"2024-09-11T22:11:56.377448+0000","last_undegraded":"2024-09-11T22:11:56.377448+0000","last_fullsized":"2024-09-11T22:11:56.377448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:37.436803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269723+0000","last_change":"2024-09-11T22:11:55.239964+0000","last_active":"2024-09-11T22:11:56.269723+0000","last_peered":"2024-09-11T22:11:56.269723+0000","last_clean":"2024-09-11T22:11:56.269723+0000","last_became_active":"2024-09-11T22:11:55.239684+0000","last_became_peered":"2024-09-11T22:11:55.239684+0000","last_unstale":"2024-09-11T22:11:56.269723+0000","last_undegraded":"2024-09-11T22:11:56.269723+0000","last_fullsized":"2024-09-11T22:11:56.269723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:34.837927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236660+0000","last_change":"2024-09-11T22:11:54.235334+0000","last_active":"2024-09-11T22:11:56.236660+0000","last_peered":"2024-09-11T22:11:56.236660+0000","last_clean":"2024-09-11T22:11:56.236660+0000","last_became_active":"2024-09-11T22:11:54.235045+0000","last_became_peered":"2024-09-11T22:11:54.235045+0000","last_unstale":"2024-09-11T22:11:56.236660+0000","last_undegraded":"2024-09-11T22:11:56.236660+0000","last_fullsized":"2024-09-11T22:11:56.236660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:27:11.944700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376772+0000","last_change":"2024-09-11T22:11:55.243276+0000","last_active":"2024-09-11T22:11:56.376772+0000","last_peered":"2024-09-11T22:11:56.376772+0000","last_clean":"2024-09-11T22:11:56.376772+0000","last_became_active":"2024-09-11T22:11:55.242986+0000","last_became_peered":"2024-09-11T22:11:55.242986+0000","last_unstale":"2024-09-11T22:11:56.376772+0000","last_undegraded":"2024-09-11T22:11:56.376772+0000","last_fullsized":"2024-09-11T22:11:56.376772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:58.609145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236323+0000","last_change":"2024-09-11T22:11:54.233653+0000","last_active":"2024-09-11T22:11:56.236323+0000","last_peered":"2024-09-11T22:11:56.236323+0000","last_clean":"2024-09-11T22:11:56.236323+0000","last_became_active":"2024-09-11T22:11:54.233372+0000","last_became_peered":"2024-09-11T22:11:54.233372+0000","last_unstale":"2024-09-11T22:11:56.236323+0000","last_undegraded":"2024-09-11T22:11:56.236323+0000","last_fullsized":"2024-09-11T22:11:56.236323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:09.667558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.269805+0000","last_change":"2024-09-11T22:11:55.240205+0000","last_active":"2024-09-11T22:11:56.269805+0000","last_peered":"2024-09-11T22:11:56.269805+0000","last_clean":"2024-09-11T22:11:56.269805+0000","last_became_active":"2024-09-11T22:11:55.239329+0000","last_became_peered":"2024-09-11T22:11:55.239329+0000","last_unstale":"2024-09-11T22:11:56.269805+0000","last_undegraded":"2024-09-11T22:11:56.269805+0000","last_fullsized":"2024-09-11T22:11:56.269805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:55.632586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377329+0000","last_change":"2024-09-11T22:11:54.236587+0000","last_active":"2024-09-11T22:11:56.377329+0000","last_peered":"2024-09-11T22:11:56.377329+0000","last_clean":"2024-09-11T22:11:56.377329+0000","last_became_active":"2024-09-11T22:11:54.236280+0000","last_became_peered":"2024-09-11T22:11:54.236280+0000","last_unstale":"2024-09-11T22:11:56.377329+0000","last_undegraded":"2024-09-11T22:11:56.377329+0000","last_fullsized":"2024-09-11T22:11:56.377329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:58.538834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236989+0000","last_change":"2024-09-11T22:11:55.246292+0000","last_active":"2024-09-11T22:11:56.236989+0000","last_peered":"2024-09-11T22:11:56.236989+0000","last_clean":"2024-09-11T22:11:56.236989+0000","last_became_active":"2024-09-11T22:11:55.245952+0000","last_became_peered":"2024-09-11T22:11:55.245952+0000","last_unstale":"2024-09-11T22:11:56.236989+0000","last_undegraded":"2024-09-11T22:11:56.236989+0000","last_fullsized":"2024-09-11T22:11:56.236989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:04.057569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376736+0000","last_change":"2024-09-11T22:11:54.235834+0000","last_active":"2024-09-11T22:11:56.376736+0000","last_peered":"2024-09-11T22:11:56.376736+0000","last_clean":"2024-09-11T22:11:56.376736+0000","last_became_active":"2024-09-11T22:11:54.235561+0000","last_became_peered":"2024-09-11T22:11:54.235561+0000","last_unstale":"2024-09-11T22:11:56.376736+0000","last_undegraded":"2024-09-11T22:11:56.376736+0000","last_fullsized":"2024-09-11T22:11:56.376736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:14.245228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376472+0000","last_change":"2024-09-11T22:11:55.239103+0000","last_active":"2024-09-11T22:11:56.376472+0000","last_peered":"2024-09-11T22:11:56.376472+0000","last_clean":"2024-09-11T22:11:56.376472+0000","last_became_active":"2024-09-11T22:11:55.238686+0000","last_became_peered":"2024-09-11T22:11:55.238686+0000","last_unstale":"2024-09-11T22:11:56.376472+0000","last_undegraded":"2024-09-11T22:11:56.376472+0000","last_fullsized":"2024-09-11T22:11:56.376472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:28.219865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377119+0000","last_change":"2024-09-11T22:11:54.234484+0000","last_active":"2024-09-11T22:11:56.377119+0000","last_peered":"2024-09-11T22:11:56.377119+0000","last_clean":"2024-09-11T22:11:56.377119+0000","last_became_active":"2024-09-11T22:11:54.234219+0000","last_became_peered":"2024-09-11T22:11:54.234219+0000","last_unstale":"2024-09-11T22:11:56.377119+0000","last_undegraded":"2024-09-11T22:11:56.377119+0000","last_fullsized":"2024-09-11T22:11:56.377119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:49.788303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377337+0000","last_change":"2024-09-11T22:11:55.233191+0000","last_active":"2024-09-11T22:11:56.377337+0000","last_peered":"2024-09-11T22:11:56.377337+0000","last_clean":"2024-09-11T22:11:56.377337+0000","last_became_active":"2024-09-11T22:11:55.232902+0000","last_became_peered":"2024-09-11T22:11:55.232902+0000","last_unstale":"2024-09-11T22:11:56.377337+0000","last_undegraded":"2024-09-11T22:11:56.377337+0000","last_fullsized":"2024-09-11T22:11:56.377337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:28.219865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376662+0000","last_change":"2024-09-11T22:11:54.227468+0000","last_active":"2024-09-11T22:11:56.376662+0000","last_peered":"2024-09-11T22:11:56.376662+0000","last_clean":"2024-09-11T22:11:56.376662+0000","last_became_active":"2024-09-11T22:11:54.227109+0000","last_became_peered":"2024-09-11T22:11:54.227109+0000","last_unstale":"2024-09-11T22:11:56.376662+0000","last_undegraded":"2024-09-11T22:11:56.376662+0000","last_fullsized":"2024-09-11T22:11:56.376662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:57.762834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376548+0000","last_change":"2024-09-11T22:11:55.235851+0000","last_active":"2024-09-11T22:11:56.376548+0000","last_peered":"2024-09-11T22:11:56.376548+0000","last_clean":"2024-09-11T22:11:56.376548+0000","last_became_active":"2024-09-11T22:11:55.235485+0000","last_became_peered":"2024-09-11T22:11:55.235485+0000","last_unstale":"2024-09-11T22:11:56.376548+0000","last_undegraded":"2024-09-11T22:11:56.376548+0000","last_fullsized":"2024-09-11T22:11:56.376548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:52.637365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376863+0000","last_change":"2024-09-11T22:11:54.241027+0000","last_active":"2024-09-11T22:11:56.376863+0000","last_peered":"2024-09-11T22:11:56.376863+0000","last_clean":"2024-09-11T22:11:56.376863+0000","last_became_active":"2024-09-11T22:11:54.240641+0000","last_became_peered":"2024-09-11T22:11:54.240641+0000","last_unstale":"2024-09-11T22:11:56.376863+0000","last_undegraded":"2024-09-11T22:11:56.376863+0000","last_fullsized":"2024-09-11T22:11:56.376863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:14.245228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235043+0000","last_change":"2024-09-11T22:11:55.248190+0000","last_active":"2024-09-11T22:11:56.235043+0000","last_peered":"2024-09-11T22:11:56.235043+0000","last_clean":"2024-09-11T22:11:56.235043+0000","last_became_active":"2024-09-11T22:11:55.247927+0000","last_became_peered":"2024-09-11T22:11:55.247927+0000","last_unstale":"2024-09-11T22:11:56.235043+0000","last_undegraded":"2024-09-11T22:11:56.235043+0000","last_fullsized":"2024-09-11T22:11:56.235043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:59.403795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236751+0000","last_change":"2024-09-11T22:11:54.227045+0000","last_active":"2024-09-11T22:11:56.236751+0000","last_peered":"2024-09-11T22:11:56.236751+0000","last_clean":"2024-09-11T22:11:56.236751+0000","last_became_active":"2024-09-11T22:11:54.226304+0000","last_became_peered":"2024-09-11T22:11:54.226304+0000","last_unstale":"2024-09-11T22:11:56.236751+0000","last_undegraded":"2024-09-11T22:11:56.236751+0000","last_fullsized":"2024-09-11T22:11:56.236751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:42.252826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.236563+0000","last_change":"2024-09-11T22:11:55.236535+0000","last_active":"2024-09-11T22:11:56.236563+0000","last_peered":"2024-09-11T22:11:56.236563+0000","last_clean":"2024-09-11T22:11:56.236563+0000","last_became_active":"2024-09-11T22:11:55.236276+0000","last_became_peered":"2024-09-11T22:11:55.236276+0000","last_unstale":"2024-09-11T22:11:56.236563+0000","last_undegraded":"2024-09-11T22:11:56.236563+0000","last_fullsized":"2024-09-11T22:11:56.236563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:52.637365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.235137+0000","last_change":"2024-09-11T22:11:54.238048+0000","last_active":"2024-09-11T22:11:56.235137+0000","last_peered":"2024-09-11T22:11:56.235137+0000","last_clean":"2024-09-11T22:11:56.235137+0000","last_became_active":"2024-09-11T22:11:54.237756+0000","last_became_peered":"2024-09-11T22:11:54.237756+0000","last_unstale":"2024-09-11T22:11:56.235137+0000","last_undegraded":"2024-09-11T22:11:56.235137+0000","last_fullsized":"2024-09-11T22:11:56.235137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:51.631960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376935+0000","last_change":"2024-09-11T22:11:55.246959+0000","last_active":"2024-09-11T22:11:56.376935+0000","last_peered":"2024-09-11T22:11:56.376935+0000","last_clean":"2024-09-11T22:11:56.376935+0000","last_became_active":"2024-09-11T22:11:55.246666+0000","last_became_peered":"2024-09-11T22:11:55.246666+0000","last_unstale":"2024-09-11T22:11:56.376935+0000","last_undegraded":"2024-09-11T22:11:56.376935+0000","last_fullsized":"2024-09-11T22:11:56.376935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:54.211897+0000","last_clean_scrub_stamp":"2024-09-11T22:11:54.211897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:44.417139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.376932+0000","last_change":"2024-09-11T22:11:54.231109+0000","last_active":"2024-09-11T22:11:56.376932+0000","last_peered":"2024-09-11T22:11:56.376932+0000","last_clean":"2024-09-11T22:11:56.376932+0000","last_became_active":"2024-09-11T22:11:54.230832+0000","last_became_peered":"2024-09-11T22:11:54.230832+0000","last_unstale":"2024-09-11T22:11:56.376932+0000","last_undegraded":"2024-09-11T22:11:56.376932+0000","last_fullsized":"2024-09-11T22:11:56.376932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:53.206492+0000","last_clean_scrub_stamp":"2024-09-11T22:11:53.206492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.263300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T22:11:56.377457+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:11:56.377457+0000","last_peered":"2024-09-11T22:11:56.377457+0000","last_clean":"2024-09-11T22:11:56.377457+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:11:56.377457+0000","last_undegraded":"2024-09-11T22:11:56.377457+0000","last_fullsized":"2024-09-11T22:11:56.377457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":360448,"data_stored":136555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":360448,"data_stored":136611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":360448,"data_stored":136043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":368640,"data_stored":137573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":368640,"data_stored":137573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":946176,"data_stored":726307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":726397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35696,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336144,"statfs":{"total":96636764160,"available":96600211456,"internally_reserved":0,"allocated":356352,"data_stored":136009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:12:03.970 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:12:03.970 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T22:12:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.115+0000 7f35b8b49640 1 Processor -- start 2024-09-11T22:12:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.115+0000 7f35b8b49640 1 -- start start 2024-09-11T22:12:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.116+0000 7f35b8b49640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f35b40cf610 0x7f35b40b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.116+0000 7f35b8b49640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35b40cfbd0 con 0x7f35b4161fa0 2024-09-11T22:12:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.116+0000 7f35b8b49640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35b40cfeb0 con 0x7f35b40b1600 2024-09-11T22:12:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.116+0000 7f35b8b49640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f35b40d1220 con 0x7f35b40cf610 2024-09-11T22:12:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.116+0000 7f35b259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f35b4161fa0 0x7f35b40cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35782/0 (socket says 172.21.15.50:35782) 2024-09-11T22:12:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.116+0000 7f35b259c640 1 -- 172.21.15.50:0/3666245378 learned_addr learned my addr 172.21.15.50:0/3666245378 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:12:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.116+0000 7f35b1d9b640 1 --2- 172.21.15.50:0/3666245378 >> v2:172.21.15.77:3300/0 conn(0x7f35b40cf610 0x7f35b40b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.116+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1883423460 0 0) 0x7f35b40cfbd0 con 0x7f35b4161fa0 2024-09-11T22:12:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35a0003520 con 0x7f35b4161fa0 2024-09-11T22:12:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3230318011 0 0) 0x7f35a0003520 con 0x7f35b4161fa0 2024-09-11T22:12:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 >> v2:172.21.15.77:3300/0 conn(0x7f35b40cf610 msgr2=0x7f35b40b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 --2- 172.21.15.50:0/3666245378 >> v2:172.21.15.77:3300/0 conn(0x7f35b40cf610 0x7f35b40b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 >> v1:172.21.15.77:6789/0 conn(0x7f35b40b1600 legacy=0x7f35b40cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b40d1470 con 0x7f35b4161fa0 2024-09-11T22:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f35ac001670 con 0x7f35b4161fa0 2024-09-11T22:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 >> v1:172.21.15.50:6789/0 conn(0x7f35b4161fa0 legacy=0x7f35b40cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 --2- 172.21.15.50:0/3666245378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35a00039b0 0x7f35a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 --2- 172.21.15.50:0/3666245378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a0004800 0x7f35a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 --2- 172.21.15.50:0/3666245378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a00051c0 0x7f35a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f35b40d1220 con 0x7f35a00051c0 2024-09-11T22:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f35a000c060 con 0x7f35a0004800 2024-09-11T22:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f35a000c260 con 0x7f35a00039b0 2024-09-11T22:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b2d9d640 1 --2- 172.21.15.50:0/3666245378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a00051c0 0x7f35a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b1d9b640 1 --2- 172.21.15.50:0/3666245378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a0004800 0x7f35a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b259c640 1 --2- 172.21.15.50:0/3666245378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35a00039b0 0x7f35a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b2d9d640 1 -- 172.21.15.50:0/3666245378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35a00039b0 msgr2=0x7f35a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b2d9d640 1 --2- 172.21.15.50:0/3666245378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35a00039b0 0x7f35a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b2d9d640 1 -- 172.21.15.50:0/3666245378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a0004800 msgr2=0x7f35a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b2d9d640 1 --2- 172.21.15.50:0/3666245378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a0004800 0x7f35a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.117+0000 7f35b2d9d640 1 -- 172.21.15.50:0/3666245378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a0003520 con 0x7f35a00051c0 2024-09-11T22:12:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.118+0000 7f35b2d9d640 1 -- 172.21.15.50:0/3666245378 reap_dead start 2024-09-11T22:12:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.118+0000 7f35b2d9d640 1 --2- 172.21.15.50:0/3666245378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a00051c0 0x7f35a000b9c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f35a4001e50 tx=0x7f35a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d154c32ee264dfcc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.118+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4001a70 con 0x7f35a00051c0 2024-09-11T22:12:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.118+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a4003970 con 0x7f35a00051c0 2024-09-11T22:12:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.118+0000 7f35b159a640 1 -- 172.21.15.50:0/3666245378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4003d60 con 0x7f35a00051c0 2024-09-11T22:12:04.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.119+0000 7f35b8b49640 1 -- 172.21.15.50:0/3666245378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a00051c0 msgr2=0x7f35a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:04.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.119+0000 7f35b8b49640 1 --2- 172.21.15.50:0/3666245378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a00051c0 0x7f35a000b9c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f35a4001e50 tx=0x7f35a0005830 comp rx=0 tx=0).stop 2024-09-11T22:12:04.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.119+0000 7f35b8b49640 1 -- 172.21.15.50:0/3666245378 shutdown_connections 2024-09-11T22:12:04.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.119+0000 7f35b8b49640 1 --2- 172.21.15.50:0/3666245378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a00051c0 0x7f35a000b9c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.119+0000 7f35b8b49640 1 -- 172.21.15.50:0/3666245378 >> 172.21.15.50:0/3666245378 conn(0x7f35b409ba50 msgr2=0x7f35b40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:04.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.119+0000 7f35b8b49640 1 -- 172.21.15.50:0/3666245378 shutdown_connections 2024-09-11T22:12:04.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.119+0000 7f35b8b49640 1 -- 172.21.15.50:0/3666245378 wait complete. 2024-09-11T22:12:04.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.120+0000 7f35b8b49640 1 Processor -- start 2024-09-11T22:12:04.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.120+0000 7f35b8b49640 1 -- start start 2024-09-11T22:12:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b8b49640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a00051c0 0x7f35b415c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b8b49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35b40cb200 0x7f35b41600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b8b49640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35b40b5870 0x7f35b40b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b8b49640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f35b40d1c70 con 0x7f35b40cb200 2024-09-11T22:12:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b8b49640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f35b40d17e0 con 0x7f35a00051c0 2024-09-11T22:12:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b8b49640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f35b40d1df0 con 0x7f35b40b5870 2024-09-11T22:12:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35b40cb200 0x7f35b41600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35b40cb200 0x7f35b41600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52710/0 (socket says 172.21.15.50:52710) 2024-09-11T22:12:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b1d9b640 1 -- 172.21.15.50:0/3770254480 learned_addr learned my addr 172.21.15.50:0/3770254480 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b1d9b640 1 -- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35b40b5870 msgr2=0x7f35b40b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b1d9b640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35b40b5870 0x7f35b40b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b259c640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a00051c0 0x7f35b415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b1d9b640 1 -- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a00051c0 msgr2=0x7f35b415c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b1d9b640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a00051c0 0x7f35b415c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b1d9b640 1 -- 172.21.15.50:0/3770254480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b415cb90 con 0x7f35b40cb200 2024-09-11T22:12:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.121+0000 7f35b259c640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a00051c0 0x7f35b415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.122+0000 7f35b1d9b640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35b40cb200 0x7f35b41600c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f359c0118e0 tx=0x7f359c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.122+0000 7f35aaffd640 1 -- 172.21.15.50:0/3770254480 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c00faf0 con 0x7f35b40cb200 2024-09-11T22:12:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.122+0000 7f35aaffd640 1 -- 172.21.15.50:0/3770254480 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359c00fc90 con 0x7f35b40cb200 2024-09-11T22:12:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.122+0000 7f35aaffd640 1 -- 172.21.15.50:0/3770254480 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c014440 con 0x7f35b40cb200 2024-09-11T22:12:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.122+0000 7f35b8b49640 1 -- 172.21.15.50:0/3770254480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b415ce70 con 0x7f35b40cb200 2024-09-11T22:12:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.122+0000 7f35b8b49640 1 -- 172.21.15.50:0/3770254480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b415d430 con 0x7f35b40cb200 2024-09-11T22:12:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.123+0000 7f35b8b49640 1 -- 172.21.15.50:0/3770254480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b40b4d20 con 0x7f35b40cb200 2024-09-11T22:12:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.123+0000 7f35aaffd640 1 -- 172.21.15.50:0/3770254480 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f359c012040 con 0x7f35b40cb200 2024-09-11T22:12:04.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.124+0000 7f35aaffd640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f359406be60 0x7f359406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.124+0000 7f35aaffd640 1 -- 172.21.15.50:0/3770254480 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f359c08b610 con 0x7f35b40cb200 2024-09-11T22:12:04.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.124+0000 7f35b259c640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f359406be60 0x7f359406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:04.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.124+0000 7f35b259c640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f359406be60 0x7f359406e320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f35b40af7f0 tx=0x7f35ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.128+0000 7f35aaffd640 1 -- 172.21.15.50:0/3770254480 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f359c019030 con 0x7f35b40cb200 2024-09-11T22:12:04.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.370+0000 7f35b8b49640 1 -- 172.21.15.50:0/3770254480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f35b40cead0 con 0x7f35b40cb200 2024-09-11T22:12:04.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.372+0000 7f35aaffd640 1 -- 172.21.15.50:0/3770254480 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f359c059f20 con 0x7f35b40cb200 2024-09-11T22:12:04.373 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:12:04.373 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:12:04.373 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-09-11T22:12:04.373 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-09-11T22:12:04.373 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T22:12:04.373 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-11T22:12:04.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.374+0000 7f35b8b49640 1 -- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f359406be60 msgr2=0x7f359406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:04.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.374+0000 7f35b8b49640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f359406be60 0x7f359406e320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f35b40af7f0 tx=0x7f35ac009040 comp rx=0 tx=0).stop 2024-09-11T22:12:04.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.374+0000 7f35b8b49640 1 -- 172.21.15.50:0/3770254480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35b40cb200 msgr2=0x7f35b41600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:04.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.374+0000 7f35b8b49640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35b40cb200 0x7f35b41600c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f359c0118e0 tx=0x7f359c011da0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.374+0000 7f35b8b49640 1 -- 172.21.15.50:0/3770254480 shutdown_connections 2024-09-11T22:12:04.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.374+0000 7f35b8b49640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f359406be60 0x7f359406e320 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.374+0000 7f35b8b49640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35b40b5870 0x7f35b40b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.374+0000 7f35b8b49640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35b40cb200 0x7f35b41600c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.374+0000 7f35b8b49640 1 --2- 172.21.15.50:0/3770254480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a00051c0 0x7f35b415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.374+0000 7f35b8b49640 1 -- 172.21.15.50:0/3770254480 >> 172.21.15.50:0/3770254480 conn(0x7f35b409ba50 msgr2=0x7f35b406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:04.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.374+0000 7f35b8b49640 1 -- 172.21.15.50:0/3770254480 shutdown_connections 2024-09-11T22:12:04.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.374+0000 7f35b8b49640 1 -- 172.21.15.50:0/3770254480 wait complete. 2024-09-11T22:12:04.386 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:12:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.489+0000 7f6059c84640 1 Processor -- start 2024-09-11T22:12:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.489+0000 7f6059c84640 1 -- start start 2024-09-11T22:12:04.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.489+0000 7f6059c84640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f605415e870 0x7f60540d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.489+0000 7f6059c84640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60540d3c00 0x7f60540b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.489+0000 7f6059c84640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60540cfa80 con 0x7f60540d16d0 2024-09-11T22:12:04.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.489+0000 7f6059c84640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f60540d1b40 con 0x7f605415e870 2024-09-11T22:12:04.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.489+0000 7f6059c84640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f60540d40d0 con 0x7f60540d3c00 2024-09-11T22:12:04.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.490+0000 7f60537fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f605415e870 0x7f60540d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:04.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.490+0000 7f60537fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f605415e870 0x7f60540d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52714/0 (socket says 172.21.15.50:52714) 2024-09-11T22:12:04.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.490+0000 7f60537fe640 1 -- 172.21.15.50:0/2518301874 learned_addr learned my addr 172.21.15.50:0/2518301874 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:04.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.490+0000 7f6053fff640 1 --2- 172.21.15.50:0/2518301874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60540d3c00 0x7f60540b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:04.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.490+0000 7f60537fe640 1 -- 172.21.15.50:0/2518301874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60540d3c00 msgr2=0x7f60540b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:04.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.490+0000 7f60537fe640 1 --2- 172.21.15.50:0/2518301874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60540d3c00 0x7f60540b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.490+0000 7f60537fe640 1 -- 172.21.15.50:0/2518301874 >> v1:172.21.15.77:6789/0 conn(0x7f60540d16d0 legacy=0x7f60540d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.490+0000 7f60537fe640 1 -- 172.21.15.50:0/2518301874 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60540d43b0 con 0x7f605415e870 2024-09-11T22:12:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.490+0000 7f6053fff640 1 --2- 172.21.15.50:0/2518301874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60540d3c00 0x7f60540b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.491+0000 7f60537fe640 1 --2- 172.21.15.50:0/2518301874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605415e870 0x7f60540d1190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6044009870 tx=0x7f604402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9266a38cd9b17f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.491+0000 7f60527fc640 1 -- 172.21.15.50:0/2518301874 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044037070 con 0x7f605415e870 2024-09-11T22:12:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.491+0000 7f60527fc640 1 -- 172.21.15.50:0/2518301874 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6044032440 con 0x7f605415e870 2024-09-11T22:12:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.491+0000 7f60527fc640 1 -- 172.21.15.50:0/2518301874 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044032810 con 0x7f605415e870 2024-09-11T22:12:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.491+0000 7f6059c84640 1 -- 172.21.15.50:0/2518301874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605415e870 msgr2=0x7f60540d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.491+0000 7f6059c84640 1 --2- 172.21.15.50:0/2518301874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605415e870 0x7f60540d1190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6044009870 tx=0x7f604402a270 comp rx=0 tx=0).stop 2024-09-11T22:12:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.491+0000 7f6059c84640 1 -- 172.21.15.50:0/2518301874 shutdown_connections 2024-09-11T22:12:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.491+0000 7f6059c84640 1 --2- 172.21.15.50:0/2518301874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60540d3c00 0x7f60540b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.491+0000 7f6059c84640 1 --2- 172.21.15.50:0/2518301874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605415e870 0x7f60540d1190 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.491+0000 7f6059c84640 1 -- 172.21.15.50:0/2518301874 >> 172.21.15.50:0/2518301874 conn(0x7f60540727a0 msgr2=0x7f60540679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.491+0000 7f6059c84640 1 -- 172.21.15.50:0/2518301874 shutdown_connections 2024-09-11T22:12:04.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.492+0000 7f6059c84640 1 -- 172.21.15.50:0/2518301874 wait complete. 2024-09-11T22:12:04.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.493+0000 7f6059c84640 1 Processor -- start 2024-09-11T22:12:04.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.493+0000 7f6059c84640 1 -- start start 2024-09-11T22:12:04.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6059c84640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60540d16d0 0x7f60541f8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6059c84640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60540d3c00 0x7f60540cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6059c84640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f605415e870 0x7f605414f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6059c84640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f605415ec50 con 0x7f60540d3c00 2024-09-11T22:12:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6059c84640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f60540b7ee0 con 0x7f605415e870 2024-09-11T22:12:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6059c84640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f60540b78b0 con 0x7f60540d16d0 2024-09-11T22:12:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6052ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60540d3c00 0x7f60540cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6052ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60540d3c00 0x7f60540cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52726/0 (socket says 172.21.15.50:52726) 2024-09-11T22:12:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6052ffd640 1 -- 172.21.15.50:0/3958420947 learned_addr learned my addr 172.21.15.50:0/3958420947 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f60537fe640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60540d16d0 0x7f60541f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6053fff640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f605415e870 0x7f605414f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6052ffd640 1 -- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60540d16d0 msgr2=0x7f60541f8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6052ffd640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60540d16d0 0x7f60541f8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6052ffd640 1 -- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f605415e870 msgr2=0x7f605414f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:04.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6052ffd640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f605415e870 0x7f605414f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6052ffd640 1 -- 172.21.15.50:0/3958420947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60540cb8f0 con 0x7f60540d3c00 2024-09-11T22:12:04.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f60537fe640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60540d16d0 0x7f60541f8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:04.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6052ffd640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60540d3c00 0x7f60540cdfe0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f604800c370 tx=0x7f604800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:04.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f603bfff640 1 -- 172.21.15.50:0/3958420947 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048017070 con 0x7f60540d3c00 2024-09-11T22:12:04.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f603bfff640 1 -- 172.21.15.50:0/3958420947 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60480052d0 con 0x7f60540d3c00 2024-09-11T22:12:04.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f603bfff640 1 -- 172.21.15.50:0/3958420947 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048003850 con 0x7f60540d3c00 2024-09-11T22:12:04.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6059c84640 1 -- 172.21.15.50:0/3958420947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60540cbbd0 con 0x7f60540d3c00 2024-09-11T22:12:04.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.494+0000 7f6059c84640 1 -- 172.21.15.50:0/3958420947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60540cc470 con 0x7f60540d3c00 2024-09-11T22:12:04.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.495+0000 7f6059c84640 1 -- 172.21.15.50:0/3958420947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60540d1190 con 0x7f60540d3c00 2024-09-11T22:12:04.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.496+0000 7f603bfff640 1 -- 172.21.15.50:0/3958420947 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f604801a070 con 0x7f60540d3c00 2024-09-11T22:12:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.496+0000 7f603bfff640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f604006be30 0x7f604006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.496+0000 7f603bfff640 1 -- 172.21.15.50:0/3958420947 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f604808a230 con 0x7f60540d3c00 2024-09-11T22:12:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.497+0000 7f60537fe640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f604006be30 0x7f604006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:04.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.497+0000 7f60537fe640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f604006be30 0x7f604006e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6044034000 tx=0x7f604402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:04.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.501+0000 7f603bfff640 1 -- 172.21.15.50:0/3958420947 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f60540cfa80 con 0x7f60540d3c00 2024-09-11T22:12:04.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.715+0000 7f6059c84640 1 -- 172.21.15.50:0/3958420947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60540cc640 con 0x7f60540d3c00 2024-09-11T22:12:04.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.716+0000 7f603bfff640 1 -- 172.21.15.50:0/3958420947 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5217 (secure 0 0 0) 0x7f6048058b40 con 0x7f60540d3c00 2024-09-11T22:12:04.717 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:12:04.717 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":14,"btime":"2024-09-11T22:11:58:235097+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3019059033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3019059033},{"type":"v1","addr":"172.21.15.77:6836","nonce":3019059033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/151985123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":151985123},{"type":"v1","addr":"172.21.15.50:6835","nonce":151985123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4699,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3475311289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3475311289},{"type":"v1","addr":"172.21.15.77:6837","nonce":3475311289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:11:54.587183+0000","modified":"2024-09-11T22:11:57.327278+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4815},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4815":{"gid":4815,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6833/900288576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":900288576},{"type":"v1","addr":"172.21.15.50:6833","nonce":900288576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4815,"qdb_cluster":[4815]},"id":2}]} 2024-09-11T22:12:04.717 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 14 2024-09-11T22:12:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.718+0000 7f6059c84640 1 -- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f604006be30 msgr2=0x7f604006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.718+0000 7f6059c84640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f604006be30 0x7f604006e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6044034000 tx=0x7f604402e000 comp rx=0 tx=0).stop 2024-09-11T22:12:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.718+0000 7f6059c84640 1 -- 172.21.15.50:0/3958420947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60540d3c00 msgr2=0x7f60540cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.718+0000 7f6059c84640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60540d3c00 0x7f60540cdfe0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f604800c370 tx=0x7f604800c830 comp rx=0 tx=0).stop 2024-09-11T22:12:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.718+0000 7f6059c84640 1 -- 172.21.15.50:0/3958420947 shutdown_connections 2024-09-11T22:12:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.718+0000 7f6059c84640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f604006be30 0x7f604006e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.718+0000 7f6059c84640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f605415e870 0x7f605414f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.718+0000 7f6059c84640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60540d3c00 0x7f60540cdfe0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.718+0000 7f6059c84640 1 --2- 172.21.15.50:0/3958420947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60540d16d0 0x7f60541f8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.718+0000 7f6059c84640 1 -- 172.21.15.50:0/3958420947 >> 172.21.15.50:0/3958420947 conn(0x7f60540727a0 msgr2=0x7f60540b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.718+0000 7f6059c84640 1 -- 172.21.15.50:0/3958420947 shutdown_connections 2024-09-11T22:12:04.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:04.718+0000 7f6059c84640 1 -- 172.21.15.50:0/3958420947 wait complete. 2024-09-11T22:12:05.133 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:11:54.587183+0000', 'modified': '2024-09-11T22:11:57.327278+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4815}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4815': {'gid': 4815, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6833/900288576', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 900288576}, {'type': 'v1', 'addr': '172.21.15.50:6833', 'nonce': 900288576}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4815, 'qdb_cluster': [4815]} 2024-09-11T22:12:05.133 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:12:05.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T22:12:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.240+0000 7ff857a3c640 1 Processor -- start 2024-09-11T22:12:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.240+0000 7ff857a3c640 1 -- start start 2024-09-11T22:12:05.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.241+0000 7ff857a3c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff85015e880 0x7ff8500d5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.241+0000 7ff857a3c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8500b6ea0 0x7ff8500b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.241+0000 7ff857a3c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff85015ec60 con 0x7ff8500ceff0 2024-09-11T22:12:05.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.241+0000 7ff857a3c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff8500d4dd0 con 0x7ff85015e880 2024-09-11T22:12:05.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.241+0000 7ff857a3c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff8500cf9d0 con 0x7ff8500b6ea0 2024-09-11T22:12:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.241+0000 7ff854fd7640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff8500ceff0 0x7ff8500b6790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35784/0 (socket says 172.21.15.50:35784) 2024-09-11T22:12:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.241+0000 7ff854fd7640 1 -- 172.21.15.50:0/1018144561 learned_addr learned my addr 172.21.15.50:0/1018144561 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:12:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.241+0000 7ff8557d8640 1 --2- 172.21.15.50:0/1018144561 >> v2:172.21.15.77:3300/0 conn(0x7ff85015e880 0x7ff8500d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.241+0000 7ff855fd9640 1 --2- 172.21.15.50:0/1018144561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8500b6ea0 0x7ff8500b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.241+0000 7ff847fff640 1 -- 172.21.15.50:0/1018144561 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780609854 0 0) 0x7ff85015ec60 con 0x7ff8500ceff0 2024-09-11T22:12:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.242+0000 7ff847fff640 1 -- 172.21.15.50:0/1018144561 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff83c003520 con 0x7ff8500ceff0 2024-09-11T22:12:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.242+0000 7ff855fd9640 1 -- 172.21.15.50:0/1018144561 >> v2:172.21.15.77:3300/0 conn(0x7ff85015e880 msgr2=0x7ff8500d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.242+0000 7ff855fd9640 1 --2- 172.21.15.50:0/1018144561 >> v2:172.21.15.77:3300/0 conn(0x7ff85015e880 0x7ff8500d5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.242+0000 7ff855fd9640 1 -- 172.21.15.50:0/1018144561 >> v1:172.21.15.50:6789/0 conn(0x7ff8500ceff0 legacy=0x7ff8500b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.242+0000 7ff855fd9640 1 -- 172.21.15.50:0/1018144561 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8500cfcb0 con 0x7ff8500b6ea0 2024-09-11T22:12:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.242+0000 7ff8557d8640 1 --2- 172.21.15.50:0/1018144561 >> v2:172.21.15.77:3300/0 conn(0x7ff85015e880 0x7ff8500d5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.242+0000 7ff855fd9640 1 --2- 172.21.15.50:0/1018144561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8500b6ea0 0x7ff8500b7820 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff8480097a0 tx=0x7ff84802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4823a09b957d500b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.243+0000 7ff847fff640 1 -- 172.21.15.50:0/1018144561 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848037070 con 0x7ff8500b6ea0 2024-09-11T22:12:05.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.243+0000 7ff847fff640 1 -- 172.21.15.50:0/1018144561 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff848032440 con 0x7ff8500b6ea0 2024-09-11T22:12:05.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.243+0000 7ff847fff640 1 -- 172.21.15.50:0/1018144561 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8480327f0 con 0x7ff8500b6ea0 2024-09-11T22:12:05.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.243+0000 7ff857a3c640 1 -- 172.21.15.50:0/1018144561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8500b6ea0 msgr2=0x7ff8500b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.243+0000 7ff857a3c640 1 --2- 172.21.15.50:0/1018144561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8500b6ea0 0x7ff8500b7820 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff8480097a0 tx=0x7ff84802a180 comp rx=0 tx=0).stop 2024-09-11T22:12:05.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.243+0000 7ff857a3c640 1 -- 172.21.15.50:0/1018144561 shutdown_connections 2024-09-11T22:12:05.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.243+0000 7ff857a3c640 1 --2- 172.21.15.50:0/1018144561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8500b6ea0 0x7ff8500b7820 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.243+0000 7ff857a3c640 1 --2- 172.21.15.50:0/1018144561 >> v2:172.21.15.77:3300/0 conn(0x7ff85015e880 0x7ff8500d5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.243+0000 7ff857a3c640 1 -- 172.21.15.50:0/1018144561 >> 172.21.15.50:0/1018144561 conn(0x7ff8500723b0 msgr2=0x7ff8500727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:05.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.243+0000 7ff857a3c640 1 -- 172.21.15.50:0/1018144561 shutdown_connections 2024-09-11T22:12:05.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.243+0000 7ff857a3c640 1 -- 172.21.15.50:0/1018144561 wait complete. 2024-09-11T22:12:05.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.245+0000 7ff857a3c640 1 Processor -- start 2024-09-11T22:12:05.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.245+0000 7ff857a3c640 1 -- start start 2024-09-11T22:12:05.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.245+0000 7ff857a3c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8500b6ea0 0x7ff8500ce560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.245+0000 7ff857a3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500ceff0 0x7ff8501e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.245+0000 7ff857a3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff85015e880 0x7ff85014e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.245+0000 7ff857a3c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8500d24b0 con 0x7ff8500ceff0 2024-09-11T22:12:05.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.245+0000 7ff857a3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff8500d4a60 con 0x7ff85015e880 2024-09-11T22:12:05.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.245+0000 7ff857a3c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff8500d2630 con 0x7ff8500b6ea0 2024-09-11T22:12:05.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff854fd7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500ceff0 0x7ff8501e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff854fd7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500ceff0 0x7ff8501e6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52746/0 (socket says 172.21.15.50:52746) 2024-09-11T22:12:05.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff854fd7640 1 -- 172.21.15.50:0/3220092546 learned_addr learned my addr 172.21.15.50:0/3220092546 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:05.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff8557d8640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8500b6ea0 0x7ff8500ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff855fd9640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff85015e880 0x7ff85014e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff854fd7640 1 -- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8500b6ea0 msgr2=0x7ff8500ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff854fd7640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8500b6ea0 0x7ff8500ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff854fd7640 1 -- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff85015e880 msgr2=0x7ff85014e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff854fd7640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff85015e880 0x7ff85014e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff854fd7640 1 -- 172.21.15.50:0/3220092546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8501e74d0 con 0x7ff8500ceff0 2024-09-11T22:12:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff855fd9640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff85015e880 0x7ff85014e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff854fd7640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500ceff0 0x7ff8501e6e40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff84000c430 tx=0x7ff84000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff845ffb640 1 -- 172.21.15.50:0/3220092546 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840017070 con 0x7ff8500ceff0 2024-09-11T22:12:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff845ffb640 1 -- 172.21.15.50:0/3220092546 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff840005ce0 con 0x7ff8500ceff0 2024-09-11T22:12:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff857a3c640 1 -- 172.21.15.50:0/3220092546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8500cc7e0 con 0x7ff8500ceff0 2024-09-11T22:12:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.246+0000 7ff845ffb640 1 -- 172.21.15.50:0/3220092546 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8400072f0 con 0x7ff8500ceff0 2024-09-11T22:12:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.247+0000 7ff857a3c640 1 -- 172.21.15.50:0/3220092546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8500ccda0 con 0x7ff8500ceff0 2024-09-11T22:12:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.248+0000 7ff845ffb640 1 -- 172.21.15.50:0/3220092546 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff84001a070 con 0x7ff8500ceff0 2024-09-11T22:12:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.248+0000 7ff845ffb640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff83406be30 0x7ff83406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.249+0000 7ff845ffb640 1 -- 172.21.15.50:0/3220092546 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff84008a220 con 0x7ff8500ceff0 2024-09-11T22:12:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.249+0000 7ff8557d8640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff83406be30 0x7ff83406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.249+0000 7ff8557d8640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff83406be30 0x7ff83406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009bd0 tx=0x7ff84c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.249+0000 7ff85a7d8740 1 Processor -- start 2024-09-11T22:12:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.249+0000 7ff85a7d8740 1 -- start start 2024-09-11T22:12:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff85a7d8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447a2c0 0x55ccf44bfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff85a7d8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf4477a80 0x55ccf447a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff85a7d8740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf447ba50 0x55ccf44748b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff85a7d8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ccf43dc520 con 0x55ccf4477a80 2024-09-11T22:12:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff85a7d8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ccf43843e0 con 0x55ccf447a2c0 2024-09-11T22:12:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff85a7d8740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ccf43d84e0 con 0x55ccf447ba50 2024-09-11T22:12:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff854fd7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf4477a80 0x55ccf447a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff854fd7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf4477a80 0x55ccf447a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52756/0 (socket says 172.21.15.50:52756) 2024-09-11T22:12:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff854fd7640 1 -- 172.21.15.50:0/1040728915 learned_addr learned my addr 172.21.15.50:0/1040728915 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff8557d8640 1 --2- 172.21.15.50:0/1040728915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447a2c0 0x55ccf44bfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff855fd9640 1 --2- 172.21.15.50:0/1040728915 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf447ba50 0x55ccf44748b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff854fd7640 1 -- 172.21.15.50:0/1040728915 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf447ba50 msgr2=0x55ccf44748b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff854fd7640 1 --2- 172.21.15.50:0/1040728915 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf447ba50 0x55ccf44748b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff854fd7640 1 -- 172.21.15.50:0/1040728915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447a2c0 msgr2=0x55ccf44bfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff854fd7640 1 --2- 172.21.15.50:0/1040728915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447a2c0 0x55ccf44bfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff854fd7640 1 -- 172.21.15.50:0/1040728915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccf439f2f0 con 0x55ccf4477a80 2024-09-11T22:12:05.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.250+0000 7ff855fd9640 1 --2- 172.21.15.50:0/1040728915 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf447ba50 0x55ccf44748b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.251+0000 7ff854fd7640 1 --2- 172.21.15.50:0/1040728915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf4477a80 0x55ccf447a6a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff840000f30 tx=0x7ff8400586d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ab38398946164a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.251+0000 7ff83affd640 1 -- 172.21.15.50:0/1040728915 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840056910 con 0x55ccf4477a80 2024-09-11T22:12:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.251+0000 7ff83affd640 1 -- 172.21.15.50:0/1040728915 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff840054c80 con 0x55ccf4477a80 2024-09-11T22:12:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.251+0000 7ff83affd640 1 -- 172.21.15.50:0/1040728915 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8400076b0 con 0x55ccf4477a80 2024-09-11T22:12:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.251+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1040728915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf4477a80 msgr2=0x55ccf447a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.251+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1040728915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf4477a80 0x55ccf447a6a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff840000f30 tx=0x7ff8400586d0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.251+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1040728915 shutdown_connections 2024-09-11T22:12:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.251+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1040728915 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf447ba50 0x55ccf44748b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.251+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1040728915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf4477a80 0x55ccf447a6a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.251+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1040728915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447a2c0 0x55ccf44bfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.251+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1040728915 >> 172.21.15.50:0/1040728915 conn(0x55ccf4476a80 msgr2=0x55ccf44bef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.251+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1040728915 shutdown_connections 2024-09-11T22:12:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.251+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1040728915 wait complete. 2024-09-11T22:12:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.252+0000 7ff85a7d8740 1 -- start start 2024-09-11T22:12:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.252+0000 7ff85a7d8740 1 Processor -- start 2024-09-11T22:12:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff85a7d8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447a2c0 0x55ccf4474e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff85a7d8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447ba50 0x55ccf44a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff85a7d8740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf44a24f0 0x55ccf448a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff85a7d8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ccf4475f20 con 0x55ccf447ba50 2024-09-11T22:12:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff85a7d8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ccf4365450 con 0x55ccf447a2c0 2024-09-11T22:12:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff85a7d8740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ccf44c0290 con 0x55ccf44a24f0 2024-09-11T22:12:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff85a7d8740 10 client.0 _ll_register_callbacks cb 0x55ccf40eeac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff854fd7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447ba50 0x55ccf44a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff854fd7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447ba50 0x55ccf44a1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52768/0 (socket says 172.21.15.50:52768) 2024-09-11T22:12:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff854fd7640 1 -- 172.21.15.50:0/1818972551 learned_addr learned my addr 172.21.15.50:0/1818972551 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff8557d8640 1 --2- 172.21.15.50:0/1818972551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447a2c0 0x55ccf4474e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff855fd9640 1 --2- 172.21.15.50:0/1818972551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf44a24f0 0x55ccf448a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff854fd7640 1 -- 172.21.15.50:0/1818972551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf44a24f0 msgr2=0x55ccf448a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff854fd7640 1 --2- 172.21.15.50:0/1818972551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf44a24f0 0x55ccf448a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff854fd7640 1 -- 172.21.15.50:0/1818972551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447a2c0 msgr2=0x55ccf4474e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff854fd7640 1 --2- 172.21.15.50:0/1818972551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447a2c0 0x55ccf4474e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.253+0000 7ff854fd7640 1 -- 172.21.15.50:0/1818972551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccf40ef2d0 con 0x55ccf447ba50 2024-09-11T22:12:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff854fd7640 1 --2- 172.21.15.50:0/1818972551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447ba50 0x55ccf44a1fb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff84000cdf0 tx=0x7ff84001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bef39a17de029f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff82ffff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:12:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff82ffff640 1 -- 172.21.15.50:0/1818972551 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840074070 con 0x55ccf447ba50 2024-09-11T22:12:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff82ffff640 1 -- 172.21.15.50:0/1818972551 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff840088380 con 0x55ccf447ba50 2024-09-11T22:12:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1818972551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff840054c80 con 0x55ccf447ba50 2024-09-11T22:12:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff82ffff640 1 -- 172.21.15.50:0/1818972551 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ff840077360 con 0x55ccf447ba50 2024-09-11T22:12:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff85a7d8740 10 client.5004 fetch_fsmap learned FSMap version 14 2024-09-11T22:12:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1818972551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55ccf41b96b0 con 0x55ccf447ba50 2024-09-11T22:12:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff82ffff640 1 -- 172.21.15.50:0/1818972551 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff840054c80 con 0x55ccf447ba50 2024-09-11T22:12:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff82ffff640 1 -- 172.21.15.50:0/1818972551 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7ff840086030 con 0x55ccf447ba50 2024-09-11T22:12:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff85a7d8740 10 client.5004 fetch_fsmap finished waiting for FSMap version 14 2024-09-11T22:12:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff85a7d8740 10 client.5004 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:12:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff85a7d8740 20 client.5004 populate_metadata read hostname 'smithi050' 2024-09-11T22:12:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1818972551 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55ccf44da990 0x55ccf44dcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff85a7d8740 4 client.5004 mds_command: new command op to 4815 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1818972551 --> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ccf43e9c50 con 0x55ccf44da990 2024-09-11T22:12:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.254+0000 7ff8557d8640 1 --2- 172.21.15.50:0/1818972551 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55ccf44da990 0x55ccf44dcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.255+0000 7ff8557d8640 1 --2- 172.21.15.50:0/1818972551 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55ccf44da990 0x55ccf44dcd80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bad1bdded4cccc48 server_cookie=68c555ed4404d138 in_seq=0 out_seq=0 2024-09-11T22:12:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.255+0000 7ff82ffff640 10 client.5004 ms_handle_connect on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.255+0000 7ff82ffff640 1 -- 172.21.15.50:0/1818972551 <== mds.0 v2:172.21.15.50:6832/900288576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ccf43e9c50 con 0x55ccf44da990 2024-09-11T22:12:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.255+0000 7ff82ffff640 10 client.5004 handle_command_reply: tid=0 2024-09-11T22:12:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.255+0000 7ff85a7d8740 1 client.5004 shutdown 2024-09-11T22:12:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.255+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1818972551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447ba50 msgr2=0x55ccf44a1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.255+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1818972551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447ba50 0x55ccf44a1fb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff84000cdf0 tx=0x7ff84001e040 comp rx=0 tx=0).stop 2024-09-11T22:12:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.255+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1818972551 shutdown_connections 2024-09-11T22:12:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.255+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1818972551 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55ccf44da990 0x55ccf44dcd80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.255+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1818972551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf44a24f0 0x55ccf448a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.255+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1818972551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447ba50 0x55ccf44a1fb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.255+0000 7ff82ffff640 0 client.5004 ms_handle_reset on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.255+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1818972551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447a2c0 0x55ccf4474e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.256+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1818972551 >> 172.21.15.50:0/1818972551 conn(0x55ccf4477a80 msgr2=0x55ccf4478020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.256+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1818972551 shutdown_connections 2024-09-11T22:12:05.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.256+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1818972551 wait complete. 2024-09-11T22:12:05.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.256+0000 7ff85a7d8740 20 client.5004 trim_cache size 0 max 16384 2024-09-11T22:12:05.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.274+0000 7ff85a7d8740 1 Processor -- start 2024-09-11T22:12:05.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.274+0000 7ff85a7d8740 1 -- start start 2024-09-11T22:12:05.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.274+0000 7ff85a7d8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447a2c0 0x55ccf449be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.274+0000 7ff85a7d8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447ba50 0x55ccf449c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.274+0000 7ff85a7d8740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf44bd0f0 0x55ccf44a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.274+0000 7ff85a7d8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8501ffb10 con 0x55ccf447a2c0 2024-09-11T22:12:05.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.274+0000 7ff85a7d8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff850160680 con 0x55ccf447ba50 2024-09-11T22:12:05.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.274+0000 7ff85a7d8740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff850160cd0 con 0x55ccf44bd0f0 2024-09-11T22:12:05.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.275+0000 7ff8557d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447a2c0 0x55ccf449be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.275+0000 7ff8557d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447a2c0 0x55ccf449be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52774/0 (socket says 172.21.15.50:52774) 2024-09-11T22:12:05.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.275+0000 7ff8557d8640 1 -- 172.21.15.50:0/1000930881 learned_addr learned my addr 172.21.15.50:0/1000930881 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:05.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.275+0000 7ff8557d8640 1 -- 172.21.15.50:0/1000930881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf44bd0f0 msgr2=0x55ccf44a2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:05.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.275+0000 7ff8557d8640 1 --2- 172.21.15.50:0/1000930881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf44bd0f0 0x55ccf44a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.275+0000 7ff8557d8640 1 -- 172.21.15.50:0/1000930881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447ba50 msgr2=0x55ccf449c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:05.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.275+0000 7ff8557d8640 1 --2- 172.21.15.50:0/1000930881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447ba50 0x55ccf449c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.275+0000 7ff8557d8640 1 -- 172.21.15.50:0/1000930881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccf44bcaf0 con 0x55ccf447a2c0 2024-09-11T22:12:05.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.275+0000 7ff8557d8640 1 --2- 172.21.15.50:0/1000930881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447a2c0 0x55ccf449be90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009fd0 tx=0x7ff84c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc98a0411e3fe20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:05.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.275+0000 7ff83a7fc640 1 -- 172.21.15.50:0/1000930881 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c031070 con 0x55ccf447a2c0 2024-09-11T22:12:05.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.275+0000 7ff83a7fc640 1 -- 172.21.15.50:0/1000930881 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84c02b2d0 con 0x55ccf447a2c0 2024-09-11T22:12:05.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.275+0000 7ff83a7fc640 1 -- 172.21.15.50:0/1000930881 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c02b680 con 0x55ccf447a2c0 2024-09-11T22:12:05.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.276+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1000930881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447a2c0 msgr2=0x55ccf449be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.276+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1000930881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447a2c0 0x55ccf449be90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009fd0 tx=0x7ff84c014000 comp rx=0 tx=0).stop 2024-09-11T22:12:05.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.276+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1000930881 shutdown_connections 2024-09-11T22:12:05.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.276+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1000930881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf44bd0f0 0x55ccf44a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.276+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1000930881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447ba50 0x55ccf449c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.276+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/1000930881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf447a2c0 0x55ccf449be90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.276+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1000930881 >> 172.21.15.50:0/1000930881 conn(0x55ccf4477a80 msgr2=0x55ccf448a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:05.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.276+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1000930881 shutdown_connections 2024-09-11T22:12:05.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.276+0000 7ff85a7d8740 1 -- 172.21.15.50:0/1000930881 wait complete. 2024-09-11T22:12:05.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.276+0000 7ff85a7d8740 1 -- start start 2024-09-11T22:12:05.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.276+0000 7ff85a7d8740 1 Processor -- start 2024-09-11T22:12:05.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.277+0000 7ff85a7d8740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf447a2c0 0x55ccf451fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.277+0000 7ff85a7d8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447ba50 0x55ccf4522dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.277+0000 7ff85a7d8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf44bd0f0 0x55ccf44d4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.277+0000 7ff85a7d8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ccf4475f20 con 0x55ccf44bd0f0 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.277+0000 7ff85a7d8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ccf4365450 con 0x55ccf447ba50 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.277+0000 7ff85a7d8740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ccf448ac70 con 0x55ccf447a2c0 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.277+0000 7ff85a7d8740 10 client.0 _ll_register_callbacks cb 0x7ff84006f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.277+0000 7ff855fd9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf44bd0f0 0x55ccf44d4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.277+0000 7ff855fd9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf44bd0f0 0x55ccf44d4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52776/0 (socket says 172.21.15.50:52776) 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.277+0000 7ff855fd9640 1 -- 172.21.15.50:0/2838442568 learned_addr learned my addr 172.21.15.50:0/2838442568 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff854fd7640 1 --2- 172.21.15.50:0/2838442568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447ba50 0x55ccf4522dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff8557d8640 1 --2- 172.21.15.50:0/2838442568 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf447a2c0 0x55ccf451fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff855fd9640 1 -- 172.21.15.50:0/2838442568 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf447a2c0 msgr2=0x55ccf451fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff855fd9640 1 --2- 172.21.15.50:0/2838442568 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf447a2c0 0x55ccf451fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff855fd9640 1 -- 172.21.15.50:0/2838442568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447ba50 msgr2=0x55ccf4522dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:05.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff855fd9640 1 --2- 172.21.15.50:0/2838442568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447ba50 0x55ccf4522dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff855fd9640 1 -- 172.21.15.50:0/2838442568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccf45410a0 con 0x55ccf44bd0f0 2024-09-11T22:12:05.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff855fd9640 1 --2- 172.21.15.50:0/2838442568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf44bd0f0 0x55ccf44d4010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff848035040 tx=0x7ff848004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4018422570dd5609 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:05.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff82ffff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:12:05.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff82ffff640 1 -- 172.21.15.50:0/2838442568 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848043070 con 0x55ccf44bd0f0 2024-09-11T22:12:05.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff85a7d8740 1 -- 172.21.15.50:0/2838442568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff84c02b2d0 con 0x55ccf44bd0f0 2024-09-11T22:12:05.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff82ffff640 1 -- 172.21.15.50:0/2838442568 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff848032d50 con 0x55ccf44bd0f0 2024-09-11T22:12:05.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff82ffff640 1 -- 172.21.15.50:0/2838442568 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ff84804e050 con 0x55ccf44bd0f0 2024-09-11T22:12:05.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff85a7d8740 10 client.5010 fetch_fsmap learned FSMap version 14 2024-09-11T22:12:05.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.278+0000 7ff85a7d8740 1 -- 172.21.15.50:0/2838442568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55ccf44c27b0 con 0x55ccf44bd0f0 2024-09-11T22:12:05.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff82ffff640 1 -- 172.21.15.50:0/2838442568 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84c02b2d0 con 0x55ccf44bd0f0 2024-09-11T22:12:05.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff82ffff640 1 -- 172.21.15.50:0/2838442568 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7ff848051020 con 0x55ccf44bd0f0 2024-09-11T22:12:05.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff85a7d8740 10 client.5010 fetch_fsmap finished waiting for FSMap version 14 2024-09-11T22:12:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff85a7d8740 10 client.5010 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:12:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff85a7d8740 20 client.5010 populate_metadata read hostname 'smithi050' 2024-09-11T22:12:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/2838442568 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55ccf449c260 0x55ccf44a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff85a7d8740 4 client.5010 mds_command: new command op to 4815 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:12:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff85a7d8740 1 -- 172.21.15.50:0/2838442568 --> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] -- command(tid 0: {"prefix": "status"}) -- 0x55ccf43e3fa0 con 0x55ccf449c260 2024-09-11T22:12:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff8557d8640 1 --2- 172.21.15.50:0/2838442568 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55ccf449c260 0x55ccf44a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff8557d8640 1 --2- 172.21.15.50:0/2838442568 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55ccf449c260 0x55ccf44a2b10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1122b986b8f9c79b server_cookie=8d4cdf81ae9a3c6a in_seq=0 out_seq=0 2024-09-11T22:12:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff82ffff640 10 client.5010 ms_handle_connect on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff82ffff640 1 -- 172.21.15.50:0/2838442568 <== mds.0 v2:172.21.15.50:6832/900288576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55ccf43e3fa0 con 0x55ccf449c260 2024-09-11T22:12:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff82ffff640 10 client.5010 handle_command_reply: tid=0 2024-09-11T22:12:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff85a7d8740 1 client.5010 shutdown 2024-09-11T22:12:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff85a7d8740 1 -- 172.21.15.50:0/2838442568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf44bd0f0 msgr2=0x55ccf44d4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.279+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/2838442568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf44bd0f0 0x55ccf44d4010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff848035040 tx=0x7ff848004730 comp rx=0 tx=0).stop 2024-09-11T22:12:05.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff85a7d8740 1 -- 172.21.15.50:0/2838442568 shutdown_connections 2024-09-11T22:12:05.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/2838442568 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55ccf449c260 0x55ccf44a2b10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/2838442568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ccf44bd0f0 0x55ccf44d4010 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/2838442568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ccf447ba50 0x55ccf4522dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff82ffff640 0 client.5010 ms_handle_reset on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:05.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff85a7d8740 1 --2- 172.21.15.50:0/2838442568 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ccf447a2c0 0x55ccf451fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff85a7d8740 1 -- 172.21.15.50:0/2838442568 >> 172.21.15.50:0/2838442568 conn(0x55ccf4477a80 msgr2=0x55ccf4470010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:05.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff85a7d8740 1 -- 172.21.15.50:0/2838442568 shutdown_connections 2024-09-11T22:12:05.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff85a7d8740 1 -- 172.21.15.50:0/2838442568 wait complete. 2024-09-11T22:12:05.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff85a7d8740 20 client.5010 trim_cache size 0 max 16384 2024-09-11T22:12:05.288 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:12:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:12:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:12:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4815, 2024-09-11T22:12:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:12:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:12:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:12:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 10.062043866, 2024-09-11T22:12:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 14, 2024-09-11T22:12:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 32, 2024-09-11T22:12:05.288 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 32, 2024-09-11T22:12:05.289 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 16.937271490000001 2024-09-11T22:12:05.289 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:12:05.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff857a3c640 1 -- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff83406be30 msgr2=0x7ff83406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff857a3c640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff83406be30 0x7ff83406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009bd0 tx=0x7ff84c00b040 comp rx=0 tx=0).stop 2024-09-11T22:12:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff857a3c640 1 -- 172.21.15.50:0/3220092546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500ceff0 msgr2=0x7ff8501e6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff857a3c640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500ceff0 0x7ff8501e6e40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff84000c430 tx=0x7ff84000c8f0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff857a3c640 1 -- 172.21.15.50:0/3220092546 shutdown_connections 2024-09-11T22:12:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff857a3c640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff83406be30 0x7ff83406e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff857a3c640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff85015e880 0x7ff85014e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff857a3c640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500ceff0 0x7ff8501e6e40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff857a3c640 1 --2- 172.21.15.50:0/3220092546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8500b6ea0 0x7ff8500ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff857a3c640 1 -- 172.21.15.50:0/3220092546 >> 172.21.15.50:0/3220092546 conn(0x7ff8500723b0 msgr2=0x7ff8500b7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff857a3c640 1 -- 172.21.15.50:0/3220092546 shutdown_connections 2024-09-11T22:12:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.280+0000 7ff857a3c640 1 -- 172.21.15.50:0/3220092546 wait complete. 2024-09-11T22:12:05.292 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:12:05.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.394+0000 7f53bf4ba640 1 Processor -- start 2024-09-11T22:12:05.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.395+0000 7f53bf4ba640 1 -- start start 2024-09-11T22:12:05.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.396+0000 7f53bf4ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53b80d18a0 0x7f53b80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.396+0000 7f53bf4ba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53b80cfa80 con 0x7f53b80d3a30 2024-09-11T22:12:05.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.396+0000 7f53bf4ba640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53b80d40d0 con 0x7f53b815e870 2024-09-11T22:12:05.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.396+0000 7f53bf4ba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f53b80d3ea0 con 0x7f53b80d18a0 2024-09-11T22:12:05.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.396+0000 7f53bca55640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53b80d18a0 0x7f53b80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.396+0000 7f53bca55640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53b80d18a0 0x7f53b80d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52782/0 (socket says 172.21.15.50:52782) 2024-09-11T22:12:05.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.396+0000 7f53bca55640 1 -- 172.21.15.50:0/3465115415 learned_addr learned my addr 172.21.15.50:0/3465115415 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:05.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.396+0000 7f53bda57640 1 --1- 172.21.15.50:0/3465115415 >> v1:172.21.15.50:6789/0 conn(0x7f53b80d3a30 0x7f53b80b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35800/0 (socket says 172.21.15.50:35800) 2024-09-11T22:12:05.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.396+0000 7f53bca55640 1 -- 172.21.15.50:0/3465115415 >> v1:172.21.15.77:6789/0 conn(0x7f53b815e870 legacy=0x7f53b80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:05.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.396+0000 7f53bca55640 1 -- 172.21.15.50:0/3465115415 >> v1:172.21.15.50:6789/0 conn(0x7f53b80d3a30 legacy=0x7f53b80b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.396+0000 7f53bca55640 1 -- 172.21.15.50:0/3465115415 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b80d43b0 con 0x7f53b80d18a0 2024-09-11T22:12:05.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.397+0000 7f53bca55640 1 --2- 172.21.15.50:0/3465115415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53b80d18a0 0x7f53b80d34f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009870 tx=0x7f53ac02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdada2332e3513bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:05.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.397+0000 7f53b7fff640 1 -- 172.21.15.50:0/3465115415 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac037070 con 0x7f53b80d18a0 2024-09-11T22:12:05.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.397+0000 7f53b7fff640 1 -- 172.21.15.50:0/3465115415 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ac032440 con 0x7f53b80d18a0 2024-09-11T22:12:05.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.397+0000 7f53b7fff640 1 -- 172.21.15.50:0/3465115415 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac032810 con 0x7f53b80d18a0 2024-09-11T22:12:05.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.397+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3465115415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53b80d18a0 msgr2=0x7f53b80d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.397+0000 7f53bf4ba640 1 --2- 172.21.15.50:0/3465115415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53b80d18a0 0x7f53b80d34f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009870 tx=0x7f53ac02a2a0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.397+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3465115415 shutdown_connections 2024-09-11T22:12:05.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.397+0000 7f53bf4ba640 1 --2- 172.21.15.50:0/3465115415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53b80d18a0 0x7f53b80d34f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.397+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3465115415 >> 172.21.15.50:0/3465115415 conn(0x7f53b80727a0 msgr2=0x7f53b80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:05.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.398+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3465115415 shutdown_connections 2024-09-11T22:12:05.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.398+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3465115415 wait complete. 2024-09-11T22:12:05.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.399+0000 7f53bf4ba640 1 Processor -- start 2024-09-11T22:12:05.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.399+0000 7f53bf4ba640 1 -- start start 2024-09-11T22:12:05.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.399+0000 7f53bf4ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53b80d18a0 0x7f53b81f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.399+0000 7f53bf4ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53b80d3a30 0x7f53b8150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.399+0000 7f53bf4ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53b815e870 0x7f53b80c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.399+0000 7f53bf4ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f53b815ec50 con 0x7f53b80d18a0 2024-09-11T22:12:05.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bf4ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f53b80b7ee0 con 0x7f53b80d3a30 2024-09-11T22:12:05.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bf4ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f53b80b78b0 con 0x7f53b815e870 2024-09-11T22:12:05.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bd256640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53b80d18a0 0x7f53b81f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bd256640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53b80d18a0 0x7f53b81f4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52794/0 (socket says 172.21.15.50:52794) 2024-09-11T22:12:05.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bd256640 1 -- 172.21.15.50:0/3278751000 learned_addr learned my addr 172.21.15.50:0/3278751000 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:05.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bca55640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53b80d3a30 0x7f53b8150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bda57640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53b815e870 0x7f53b80c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bd256640 1 -- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53b815e870 msgr2=0x7f53b80c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bd256640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53b815e870 0x7f53b80c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bd256640 1 -- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53b80d3a30 msgr2=0x7f53b8150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bd256640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53b80d3a30 0x7f53b8150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bd256640 1 -- 172.21.15.50:0/3278751000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b80c91c0 con 0x7f53b80d18a0 2024-09-11T22:12:05.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bda57640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53b815e870 0x7f53b80c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:05.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bd256640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53b80d18a0 0x7f53b81f4890 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f53a800c7c0 tx=0x7f53a800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:05.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53b5ffb640 1 -- 172.21.15.50:0/3278751000 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8016020 con 0x7f53b80d18a0 2024-09-11T22:12:05.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53b5ffb640 1 -- 172.21.15.50:0/3278751000 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53a800aa50 con 0x7f53b80d18a0 2024-09-11T22:12:05.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3278751000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b80cb9f0 con 0x7f53b80d18a0 2024-09-11T22:12:05.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.400+0000 7f53b5ffb640 1 -- 172.21.15.50:0/3278751000 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8012420 con 0x7f53b80d18a0 2024-09-11T22:12:05.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.401+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3278751000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b8151270 con 0x7f53b80d18a0 2024-09-11T22:12:05.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.402+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3278751000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b80d34f0 con 0x7f53b80d18a0 2024-09-11T22:12:05.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.402+0000 7f53b5ffb640 1 -- 172.21.15.50:0/3278751000 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53a8019020 con 0x7f53b80d18a0 2024-09-11T22:12:05.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.402+0000 7f53b5ffb640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f53a406be30 0x7f53a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:05.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.402+0000 7f53b5ffb640 1 -- 172.21.15.50:0/3278751000 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f53a808aac0 con 0x7f53b80d18a0 2024-09-11T22:12:05.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.403+0000 7f53bca55640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f53a406be30 0x7f53a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:05.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.403+0000 7f53bca55640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f53a406be30 0x7f53a406e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53ac034000 tx=0x7f53ac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:05.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.407+0000 7f53b5ffb640 1 -- 172.21.15.50:0/3278751000 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f53a8020070 con 0x7f53b80d18a0 2024-09-11T22:12:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.623+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3278751000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f53b80d2f30 con 0x7f53b80d18a0 2024-09-11T22:12:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.623+0000 7f53b5ffb640 1 -- 172.21.15.50:0/3278751000 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f53a8059500 con 0x7f53b80d18a0 2024-09-11T22:12:05.625 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:12:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.625+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f53a406be30 msgr2=0x7f53a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.625+0000 7f53bf4ba640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f53a406be30 0x7f53a406e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53ac034000 tx=0x7f53ac02e000 comp rx=0 tx=0).stop 2024-09-11T22:12:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.625+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3278751000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53b80d18a0 msgr2=0x7f53b81f4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.625+0000 7f53bf4ba640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53b80d18a0 0x7f53b81f4890 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f53a800c7c0 tx=0x7f53a800cc80 comp rx=0 tx=0).stop 2024-09-11T22:12:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.626+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3278751000 shutdown_connections 2024-09-11T22:12:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.626+0000 7f53bf4ba640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f53a406be30 0x7f53a406e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.626+0000 7f53bf4ba640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53b815e870 0x7f53b80c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.626+0000 7f53bf4ba640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53b80d3a30 0x7f53b8150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.626+0000 7f53bf4ba640 1 --2- 172.21.15.50:0/3278751000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53b80d18a0 0x7f53b81f4890 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.626+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3278751000 >> 172.21.15.50:0/3278751000 conn(0x7f53b80727a0 msgr2=0x7f53b80d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.626+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3278751000 shutdown_connections 2024-09-11T22:12:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05.626+0000 7f53bf4ba640 1 -- 172.21.15.50:0/3278751000 wait complete. 2024-09-11T22:12:05.637 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:12:05.638 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:12:05.638 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:12:05.638 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:12:05.638 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:12:05.638 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:12:05.638 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:12:05.638 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:12:05.638 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:12:05.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:12:05.638 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:12:05.655 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:12:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:12:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:12:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:12:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:12:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:12:05.655 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:12:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:12:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:12:05.655 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:12:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:12:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:12:05.656 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:12:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:12:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:12:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:12:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42670sec preferred_lft 42670sec 2024-09-11T22:12:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:12:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:12:05.656 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:12:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:12:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:12:05.656 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:12:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:12:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:12:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:12:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:12:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:12:05.657 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:12:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:12:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:12:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:12:05.657 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:12:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:12:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:12:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:12:05.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:12:05.658 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:12:05.719 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:12:05.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:12:05.721 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:12:05.778 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:12:05.778 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:12:05.778 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:12:05.779 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:12:05.779 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:12:05.779 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:12:05.779 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:12:05.780 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:12:05.780 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:12:05.780 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:12:05.780 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:12:05.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:12:05.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:12:05.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:12:05.907 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:12:05.922 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:12:05.922 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:12:05.923 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:12:05.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:12:05.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:12:05.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:12:05.989 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:12:06.045 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:12:06.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:12:06.045 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:12:06.101 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:12:06.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:12:06.101 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:12:06.186 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:12:06.186 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:12:06.194 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:12:06.194 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:12:06.194 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:12:06.194 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:12:06.195 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:12:06.195 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:12:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:12:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:12:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:12:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:12:06.202 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:12:06.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:12:06.203 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:12:06.228 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:12:06.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:12:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:12:06.331 INFO:teuthology.orchestra.run.smithi050.stdout:client4700 2024-09-11T22:12:06.331 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:12:06.331 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:12:06.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-11T22:12:06.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.495+0000 7fe554c6e640 1 Processor -- start 2024-09-11T22:12:06.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.495+0000 7fe554c6e640 1 -- start start 2024-09-11T22:12:06.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe554c6e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe550161ea0 0x7fe5500b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:06.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe554c6e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe55006f300 0x7fe55006f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:06.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe554c6e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe55006d7a0 0x7fe55006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:06.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe554c6e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe550162280 con 0x7fe550161ea0 2024-09-11T22:12:06.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe554c6e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe55006c700 con 0x7fe55006f300 2024-09-11T22:12:06.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe554c6e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe55006c9e0 con 0x7fe55006d7a0 2024-09-11T22:12:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe54e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe550161ea0 0x7fe5500b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe54e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe550161ea0 0x7fe5500b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52800/0 (socket says 172.21.15.50:52800) 2024-09-11T22:12:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe54e59c640 1 -- 172.21.15.50:0/1233882925 learned_addr learned my addr 172.21.15.50:0/1233882925 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe54dd9b640 1 --2- 172.21.15.50:0/1233882925 >> v2:172.21.15.77:3300/0 conn(0x7fe55006f300 0x7fe55006f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe54e59c640 1 -- 172.21.15.50:0/1233882925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe55006d7a0 msgr2=0x7fe55006fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe54ed9d640 1 --2- 172.21.15.50:0/1233882925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe55006d7a0 0x7fe55006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe54e59c640 1 --2- 172.21.15.50:0/1233882925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe55006d7a0 0x7fe55006fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe54e59c640 1 -- 172.21.15.50:0/1233882925 >> v2:172.21.15.77:3300/0 conn(0x7fe55006f300 msgr2=0x7fe55006f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe54e59c640 1 --2- 172.21.15.50:0/1233882925 >> v2:172.21.15.77:3300/0 conn(0x7fe55006f300 0x7fe55006f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe54e59c640 1 -- 172.21.15.50:0/1233882925 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55006ccc0 con 0x7fe550161ea0 2024-09-11T22:12:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.496+0000 7fe54dd9b640 1 --2- 172.21.15.50:0/1233882925 >> v2:172.21.15.77:3300/0 conn(0x7fe55006f300 0x7fe55006f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:06.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.497+0000 7fe54e59c640 1 --2- 172.21.15.50:0/1233882925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe550161ea0 0x7fe5500b4c70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe550071550 tx=0x7fe54002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343b0a524f59ec39 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:06.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.497+0000 7fe54d59a640 1 -- 172.21.15.50:0/1233882925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540037070 con 0x7fe550161ea0 2024-09-11T22:12:06.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.497+0000 7fe54d59a640 1 -- 172.21.15.50:0/1233882925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe540032440 con 0x7fe550161ea0 2024-09-11T22:12:06.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.497+0000 7fe54d59a640 1 -- 172.21.15.50:0/1233882925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540032810 con 0x7fe550161ea0 2024-09-11T22:12:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.498+0000 7fe554c6e640 1 -- 172.21.15.50:0/1233882925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe550161ea0 msgr2=0x7fe5500b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.498+0000 7fe554c6e640 1 --2- 172.21.15.50:0/1233882925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe550161ea0 0x7fe5500b4c70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe550071550 tx=0x7fe54002a140 comp rx=0 tx=0).stop 2024-09-11T22:12:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.498+0000 7fe554c6e640 1 -- 172.21.15.50:0/1233882925 shutdown_connections 2024-09-11T22:12:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.498+0000 7fe554c6e640 1 --2- 172.21.15.50:0/1233882925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe55006d7a0 0x7fe55006fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.498+0000 7fe554c6e640 1 --2- 172.21.15.50:0/1233882925 >> v2:172.21.15.77:3300/0 conn(0x7fe55006f300 0x7fe55006f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.498+0000 7fe554c6e640 1 --2- 172.21.15.50:0/1233882925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe550161ea0 0x7fe5500b4c70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.498+0000 7fe554c6e640 1 -- 172.21.15.50:0/1233882925 >> 172.21.15.50:0/1233882925 conn(0x7fe5500b4150 msgr2=0x7fe5500b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.498+0000 7fe554c6e640 1 -- 172.21.15.50:0/1233882925 shutdown_connections 2024-09-11T22:12:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.498+0000 7fe554c6e640 1 -- 172.21.15.50:0/1233882925 wait complete. 2024-09-11T22:12:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.499+0000 7fe554c6e640 1 Processor -- start 2024-09-11T22:12:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.499+0000 7fe554c6e640 1 -- start start 2024-09-11T22:12:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.500+0000 7fe554c6e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe55006d7a0 0x7fe55015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.500+0000 7fe554c6e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe55006f300 0x7fe55015b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.500+0000 7fe554c6e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe550161ea0 0x7fe5501605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.500+0000 7fe554c6e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5500af430 con 0x7fe55006f300 2024-09-11T22:12:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.500+0000 7fe554c6e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe55006d280 con 0x7fe550161ea0 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.500+0000 7fe554c6e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe5500af5b0 con 0x7fe55006d7a0 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.500+0000 7fe54dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe55006f300 0x7fe55015b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.500+0000 7fe54dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe55006f300 0x7fe55015b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52818/0 (socket says 172.21.15.50:52818) 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.500+0000 7fe54dd9b640 1 -- 172.21.15.50:0/1101500476 learned_addr learned my addr 172.21.15.50:0/1101500476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.501+0000 7fe54e59c640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe55006d7a0 0x7fe55015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.501+0000 7fe54dd9b640 1 -- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe55006d7a0 msgr2=0x7fe55015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.501+0000 7fe54ed9d640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe550161ea0 0x7fe5501605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.501+0000 7fe54dd9b640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe55006d7a0 0x7fe55015ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.501+0000 7fe54dd9b640 1 -- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe550161ea0 msgr2=0x7fe5501605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.501+0000 7fe54dd9b640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe550161ea0 0x7fe5501605f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.501+0000 7fe54dd9b640 1 -- 172.21.15.50:0/1101500476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5501f4370 con 0x7fe55006f300 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.501+0000 7fe54dd9b640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe55006f300 0x7fe55015b190 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe54400c7f0 tx=0x7fe54400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.501+0000 7fe53effd640 1 -- 172.21.15.50:0/1101500476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544015070 con 0x7fe55006f300 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.501+0000 7fe53effd640 1 -- 172.21.15.50:0/1101500476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe544007a30 con 0x7fe55006f300 2024-09-11T22:12:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.501+0000 7fe554c6e640 1 -- 172.21.15.50:0/1101500476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5500b6290 con 0x7fe55006f300 2024-09-11T22:12:06.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.501+0000 7fe53effd640 1 -- 172.21.15.50:0/1101500476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544007e00 con 0x7fe55006f300 2024-09-11T22:12:06.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.501+0000 7fe554c6e640 1 -- 172.21.15.50:0/1101500476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5501f48f0 con 0x7fe55006f300 2024-09-11T22:12:06.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.502+0000 7fe554c6e640 1 -- 172.21.15.50:0/1101500476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5500b4c70 con 0x7fe55006f300 2024-09-11T22:12:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.503+0000 7fe53effd640 1 -- 172.21.15.50:0/1101500476 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe544018070 con 0x7fe55006f300 2024-09-11T22:12:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.503+0000 7fe53effd640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe53006be30 0x7fe53006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.503+0000 7fe53effd640 1 -- 172.21.15.50:0/1101500476 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe54408ae50 con 0x7fe55006f300 2024-09-11T22:12:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.503+0000 7fe54e59c640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe53006be30 0x7fe53006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:06.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.504+0000 7fe54e59c640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe53006be30 0x7fe53006e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe540034000 tx=0x7fe54002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:06.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.508+0000 7fe53effd640 1 -- 172.21.15.50:0/1101500476 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe544059800 con 0x7fe55006f300 2024-09-11T22:12:06.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:06.720+0000 7fe554c6e640 1 -- 172.21.15.50:0/1101500476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fe5500d3070 con 0x7fe55006f300 2024-09-11T22:12:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:07.444+0000 7fe53effd640 1 -- 172.21.15.50:0/1101500476 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v15) ==== 167+0+0 (secure 0 0 0) 0x7fe544059100 con 0x7fe55006f300 2024-09-11T22:12:07.445 INFO:teuthology.orchestra.run.smithi050.stderr:enabled new snapshots 2024-09-11T22:12:07.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:07.446+0000 7fe554c6e640 1 -- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe53006be30 msgr2=0x7fe53006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:07.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:07.446+0000 7fe554c6e640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe53006be30 0x7fe53006e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe540034000 tx=0x7fe54002e000 comp rx=0 tx=0).stop 2024-09-11T22:12:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:07.446+0000 7fe554c6e640 1 -- 172.21.15.50:0/1101500476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe55006f300 msgr2=0x7fe55015b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:07.446+0000 7fe554c6e640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe55006f300 0x7fe55015b190 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe54400c7f0 tx=0x7fe54400cbf0 comp rx=0 tx=0).stop 2024-09-11T22:12:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:07.446+0000 7fe554c6e640 1 -- 172.21.15.50:0/1101500476 shutdown_connections 2024-09-11T22:12:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:07.446+0000 7fe554c6e640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe53006be30 0x7fe53006e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:07.446+0000 7fe554c6e640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe550161ea0 0x7fe5501605f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:07.446+0000 7fe554c6e640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe55006f300 0x7fe55015b190 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:07.446+0000 7fe554c6e640 1 --2- 172.21.15.50:0/1101500476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe55006d7a0 0x7fe55015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:07.446+0000 7fe554c6e640 1 -- 172.21.15.50:0/1101500476 >> 172.21.15.50:0/1101500476 conn(0x7fe5500b4150 msgr2=0x7fe5500d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:07.447+0000 7fe554c6e640 1 -- 172.21.15.50:0/1101500476 shutdown_connections 2024-09-11T22:12:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:07.447+0000 7fe554c6e640 1 -- 172.21.15.50:0/1101500476 wait complete. 2024-09-11T22:12:07.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:12:07.459 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-11T22:12:07.481 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:12:07.481 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:12:07.538 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2024-09-11T22:12:07.538 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-11T22:12:07.538 DEBUG:teuthology.orchestra.run.smithi050:> import uuid 2024-09-11T22:12:07.538 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:12:07.538 DEBUG:teuthology.orchestra.run.smithi050:> n = 2000 2024-09-11T22:12:07.538 DEBUG:teuthology.orchestra.run.smithi050:> create_hard_links = False 2024-09-11T22:12:07.538 DEBUG:teuthology.orchestra.run.smithi050:> if 3 > 0: 2024-09-11T22:12:07.538 DEBUG:teuthology.orchestra.run.smithi050:> create_hard_links = True 2024-09-11T22:12:07.538 DEBUG:teuthology.orchestra.run.smithi050:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-11T22:12:07.538 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> dpath = os.path.dirname(path) 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> fnameprefix = os.path.basename(path) 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> os.makedirs(dpath, exist_ok=True) 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> try: 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> for i in range(n): 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> with open(fpath, '"'"'w'"'"') as f: 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> f.write(f"{i}") 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> f.flush() 2024-09-11T22:12:07.539 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(f.fileno()) 2024-09-11T22:12:07.540 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:12:07.540 DEBUG:teuthology.orchestra.run.smithi050:> os.unlink(fpath) 2024-09-11T22:12:07.540 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:12:07.540 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(dirfd) 2024-09-11T22:12:07.540 DEBUG:teuthology.orchestra.run.smithi050:> if create_hard_links: 2024-09-11T22:12:07.540 DEBUG:teuthology.orchestra.run.smithi050:> for j in range(3): 2024-09-11T22:12:07.540 DEBUG:teuthology.orchestra.run.smithi050:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-11T22:12:07.540 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:12:07.540 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(dirfd) 2024-09-11T22:12:07.540 DEBUG:teuthology.orchestra.run.smithi050:> finally: 2024-09-11T22:12:07.540 DEBUG:teuthology.orchestra.run.smithi050:> os.close(dirfd) 2024-09-11T22:12:07.540 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-11T22:12:12.096 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:12:12.099 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:12:27.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:12:27.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:12:27.901 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-11T22:12:28.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:12:28.366 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-11T22:12:42.170 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:12:42.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:12:55.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:12:55.200 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-11T22:12:55.283 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-11T22:12:55.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.387+0000 7f5d4c25c640 1 Processor -- start 2024-09-11T22:12:55.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.387+0000 7f5d4c25c640 1 -- start start 2024-09-11T22:12:55.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.388+0000 7f5d4c25c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4415c3c0 0x7f5d4415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.388+0000 7f5d4c25c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5d4415ec40 0x7f5d4415f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.388+0000 7f5d4c25c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4415f7f0 con 0x7f5d440679c0 2024-09-11T22:12:55.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.388+0000 7f5d4c25c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5d4415f5c0 con 0x7f5d4415ec40 2024-09-11T22:12:55.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.388+0000 7f5d4c25c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4406e700 con 0x7f5d4415c3c0 2024-09-11T22:12:55.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.388+0000 7f5d497f7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5d4415ec40 0x7f5d4415f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.388+0000 7f5d4a7f9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5d440679c0 0x7f5d4406f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52510/0 (socket says 172.21.15.50:52510) 2024-09-11T22:12:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.388+0000 7f5d4a7f9640 1 -- 172.21.15.50:0/1332306090 learned_addr learned my addr 172.21.15.50:0/1332306090 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:12:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.389+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/1332306090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4415c3c0 0x7f5d4415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.389+0000 7f5d497f7640 1 -- 172.21.15.50:0/1332306090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4415c3c0 msgr2=0x7f5d4415fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.389+0000 7f5d497f7640 1 --2- 172.21.15.50:0/1332306090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4415c3c0 0x7f5d4415fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.389+0000 7f5d497f7640 1 -- 172.21.15.50:0/1332306090 >> v1:172.21.15.50:6789/0 conn(0x7f5d440679c0 legacy=0x7f5d4406f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.389+0000 7f5d497f7640 1 -- 172.21.15.50:0/1332306090 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4415fad0 con 0x7f5d4415ec40 2024-09-11T22:12:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.389+0000 7f5d48ff6640 1 -- 172.21.15.50:0/1332306090 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286441274 0 0) 0x7f5d4415f7f0 con 0x7f5d440679c0 2024-09-11T22:12:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.389+0000 7f5d497f7640 1 --2- 172.21.15.50:0/1332306090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d4415ec40 0x7f5d4415f080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5d340097a0 tx=0x7f5d3402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc1fa65693815ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.390+0000 7f5d48ff6640 1 -- 172.21.15.50:0/1332306090 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34037070 con 0x7f5d4415ec40 2024-09-11T22:12:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.390+0000 7f5d48ff6640 1 -- 172.21.15.50:0/1332306090 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3402ae50 con 0x7f5d4415ec40 2024-09-11T22:12:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.390+0000 7f5d48ff6640 1 -- 172.21.15.50:0/1332306090 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34032660 con 0x7f5d4415ec40 2024-09-11T22:12:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.390+0000 7f5d4c25c640 1 -- 172.21.15.50:0/1332306090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d4415ec40 msgr2=0x7f5d4415f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.390+0000 7f5d4c25c640 1 --2- 172.21.15.50:0/1332306090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d4415ec40 0x7f5d4415f080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5d340097a0 tx=0x7f5d3402a100 comp rx=0 tx=0).stop 2024-09-11T22:12:55.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.390+0000 7f5d4c25c640 1 -- 172.21.15.50:0/1332306090 shutdown_connections 2024-09-11T22:12:55.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.390+0000 7f5d4c25c640 1 --2- 172.21.15.50:0/1332306090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d4415ec40 0x7f5d4415f080 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.390+0000 7f5d4c25c640 1 --2- 172.21.15.50:0/1332306090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4415c3c0 0x7f5d4415fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.390+0000 7f5d4c25c640 1 -- 172.21.15.50:0/1332306090 >> 172.21.15.50:0/1332306090 conn(0x7f5d44075060 msgr2=0x7f5d4406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.390+0000 7f5d4c25c640 1 -- 172.21.15.50:0/1332306090 shutdown_connections 2024-09-11T22:12:55.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.390+0000 7f5d4c25c640 1 -- 172.21.15.50:0/1332306090 wait complete. 2024-09-11T22:12:55.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.391+0000 7f5d4c25c640 1 Processor -- start 2024-09-11T22:12:55.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.392+0000 7f5d4c25c640 1 -- start start 2024-09-11T22:12:55.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.392+0000 7f5d4c25c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d440679c0 0x7f5d441574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.392+0000 7f5d4c25c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4415c3c0 0x7f5d4415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.392+0000 7f5d4c25c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4415ec40 0x7f5d441f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.392+0000 7f5d4c25c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d440d0940 con 0x7f5d440679c0 2024-09-11T22:12:55.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.392+0000 7f5d4c25c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4406ec30 con 0x7f5d4415ec40 2024-09-11T22:12:55.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.392+0000 7f5d4c25c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d44067e00 con 0x7f5d4415c3c0 2024-09-11T22:12:55.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.392+0000 7f5d49ff8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d440679c0 0x7f5d441574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.392+0000 7f5d49ff8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d440679c0 0x7f5d441574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39978/0 (socket says 172.21.15.50:39978) 2024-09-11T22:12:55.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.392+0000 7f5d49ff8640 1 -- 172.21.15.50:0/1328923724 learned_addr learned my addr 172.21.15.50:0/1328923724 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d497f7640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4415c3c0 0x7f5d4415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d4a7f9640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4415ec40 0x7f5d441f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d49ff8640 1 -- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4415c3c0 msgr2=0x7f5d4415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4415c3c0 0x7f5d4415d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d49ff8640 1 -- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4415ec40 msgr2=0x7f5d441f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4415ec40 0x7f5d441f3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d49ff8640 1 -- 172.21.15.50:0/1328923724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4415e040 con 0x7f5d440679c0 2024-09-11T22:12:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d4a7f9640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4415ec40 0x7f5d441f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d440679c0 0x7f5d441574c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000d800 tx=0x7f5d4000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d3a7fc640 1 -- 172.21.15.50:0/1328923724 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000b6c0 con 0x7f5d440679c0 2024-09-11T22:12:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d3a7fc640 1 -- 172.21.15.50:0/1328923724 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d40019070 con 0x7f5d440679c0 2024-09-11T22:12:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d4c25c640 1 -- 172.21.15.50:0/1328923724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4415e320 con 0x7f5d440679c0 2024-09-11T22:12:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d3a7fc640 1 -- 172.21.15.50:0/1328923724 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000ba80 con 0x7f5d440679c0 2024-09-11T22:12:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.393+0000 7f5d4c25c640 1 -- 172.21.15.50:0/1328923724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d440cc380 con 0x7f5d440679c0 2024-09-11T22:12:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.394+0000 7f5d3a7fc640 1 -- 172.21.15.50:0/1328923724 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d4000bc20 con 0x7f5d440679c0 2024-09-11T22:12:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.395+0000 7f5d3a7fc640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5d2806be30 0x7f5d2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.395+0000 7f5d3a7fc640 1 -- 172.21.15.50:0/1328923724 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5d4008b2f0 con 0x7f5d440679c0 2024-09-11T22:12:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.395+0000 7f5d497f7640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5d2806be30 0x7f5d2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.396+0000 7f5d497f7640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5d2806be30 0x7f5d2806e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5d34034000 tx=0x7f5d3402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.396+0000 7f5d4eff3740 1 Processor -- start 2024-09-11T22:12:55.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.396+0000 7f5d4eff3740 1 -- start start 2024-09-11T22:12:55.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4eff3740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 0x55cb1009d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4eff3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009ada0 0x55cb1009c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4eff3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 0x55cb1007d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4eff3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cb0ffb98d0 con 0x55cb1009b200 2024-09-11T22:12:55.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4eff3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cb0ff61620 con 0x55cb1009ada0 2024-09-11T22:12:55.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4eff3740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cb0ffb5890 con 0x55cb1009d5e0 2024-09-11T22:12:55.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4a7f9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 0x55cb1007d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4a7f9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 0x55cb1007d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39990/0 (socket says 172.21.15.50:39990) 2024-09-11T22:12:55.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4a7f9640 1 -- 172.21.15.50:0/3371725365 learned_addr learned my addr 172.21.15.50:0/3371725365 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/3371725365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 0x55cb1009d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d497f7640 1 --2- 172.21.15.50:0/3371725365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009ada0 0x55cb1009c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4a7f9640 1 -- 172.21.15.50:0/3371725365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 msgr2=0x55cb1009d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4a7f9640 1 --2- 172.21.15.50:0/3371725365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 0x55cb1009d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4a7f9640 1 -- 172.21.15.50:0/3371725365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009ada0 msgr2=0x55cb1009c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4a7f9640 1 --2- 172.21.15.50:0/3371725365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009ada0 0x55cb1009c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4a7f9640 1 -- 172.21.15.50:0/3371725365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb0fd967d0 con 0x55cb1009b200 2024-09-11T22:12:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d4a7f9640 1 --2- 172.21.15.50:0/3371725365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 0x55cb1007d560 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c001e90 tx=0x7f5d3c00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88186c38d67288f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d277fe640 1 -- 172.21.15.50:0/3371725365 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c004d60 con 0x55cb1009b200 2024-09-11T22:12:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d277fe640 1 -- 172.21.15.50:0/3371725365 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0020a0 con 0x55cb1009b200 2024-09-11T22:12:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.397+0000 7f5d277fe640 1 -- 172.21.15.50:0/3371725365 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c0072d0 con 0x55cb1009b200 2024-09-11T22:12:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.398+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3371725365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 msgr2=0x55cb1007d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.398+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3371725365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 0x55cb1007d560 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c001e90 tx=0x7f5d3c00d520 comp rx=0 tx=0).stop 2024-09-11T22:12:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.398+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3371725365 shutdown_connections 2024-09-11T22:12:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.398+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3371725365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 0x55cb1007d560 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.398+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3371725365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009ada0 0x55cb1009c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.398+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3371725365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 0x55cb1009d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.398+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3371725365 >> 172.21.15.50:0/3371725365 conn(0x55cb10053240 msgr2=0x55cb1009b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.398+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3371725365 shutdown_connections 2024-09-11T22:12:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.398+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3371725365 wait complete. 2024-09-11T22:12:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.399+0000 7f5d4eff3740 1 -- start start 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.399+0000 7f5d4eff3740 1 Processor -- start 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d4eff3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 0x55cb10096ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d4eff3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009d5e0 0x55cb1007c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d4eff3740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb10094560 0x55cb10093450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d4eff3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cb10099d00 con 0x55cb1009b200 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d4eff3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cb0ff42750 con 0x55cb1009d5e0 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d4eff3740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cb10099fe0 con 0x55cb10094560 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d4eff3740 10 client.0 _ll_register_callbacks cb 0x55cb0ff66780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d49ff8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 0x55cb10096ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d49ff8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 0x55cb10096ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40002/0 (socket says 172.21.15.50:40002) 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d49ff8640 1 -- 172.21.15.50:0/3140335061 learned_addr learned my addr 172.21.15.50:0/3140335061 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d497f7640 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009d5e0 0x55cb1007c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d49ff8640 1 -- 172.21.15.50:0/3140335061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb10094560 msgr2=0x55cb10093450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d4a7f9640 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb10094560 0x55cb10093450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb10094560 0x55cb10093450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d49ff8640 1 -- 172.21.15.50:0/3140335061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009d5e0 msgr2=0x55cb1007c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009d5e0 0x55cb1007c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d49ff8640 1 -- 172.21.15.50:0/3140335061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb0fc8c0f0 con 0x55cb1009b200 2024-09-11T22:12:55.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d497f7640 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009d5e0 0x55cb1007c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:55.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 0x55cb10096ff0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5d400559b0 tx=0x7f5d40059dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3742480b640771ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:12:55.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d24ff9640 1 -- 172.21.15.50:0/3140335061 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40071020 con 0x55cb1009b200 2024-09-11T22:12:55.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.400+0000 7f5d24ff9640 1 -- 172.21.15.50:0/3140335061 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5d40055c10 con 0x55cb1009b200 2024-09-11T22:12:55.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3140335061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cb0ffc7000 con 0x55cb1009b200 2024-09-11T22:12:55.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d24ff9640 1 -- 172.21.15.50:0/3140335061 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f5d40076050 con 0x55cb1009b200 2024-09-11T22:12:55.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d4eff3740 10 client.5040 fetch_fsmap learned FSMap version 15 2024-09-11T22:12:55.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3140335061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55cb0fdf6f60 con 0x55cb1009b200 2024-09-11T22:12:55.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d24ff9640 1 -- 172.21.15.50:0/3140335061 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55cb0ffc7000 con 0x55cb1009b200 2024-09-11T22:12:55.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d24ff9640 1 -- 172.21.15.50:0/3140335061 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f5d40013070 con 0x55cb1009b200 2024-09-11T22:12:55.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d4eff3740 10 client.5040 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T22:12:55.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d4eff3740 10 client.5040 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-11T22:12:55.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d4eff3740 20 client.5040 populate_metadata read hostname 'smithi050' 2024-09-11T22:12:55.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cb10095330 0x55cb100aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d4eff3740 4 client.5040 mds_command: new command op to 4815 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3140335061 --> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb0ffc1350 con 0x55cb10095330 2024-09-11T22:12:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d497f7640 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cb10095330 0x55cb100aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d497f7640 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cb10095330 0x55cb100aeb30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=772a6d71284679ca server_cookie=c20c42345d6e935 in_seq=0 out_seq=0 2024-09-11T22:12:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.401+0000 7f5d24ff9640 10 client.5040 ms_handle_connect on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.402+0000 7f5d24ff9640 1 -- 172.21.15.50:0/3140335061 <== mds.0 v2:172.21.15.50:6832/900288576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb0ffc1350 con 0x55cb10095330 2024-09-11T22:12:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.402+0000 7f5d24ff9640 10 client.5040 handle_command_reply: tid=0 2024-09-11T22:12:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.402+0000 7f5d4eff3740 1 client.5040 shutdown 2024-09-11T22:12:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.402+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3140335061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 msgr2=0x55cb10096ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.402+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 0x55cb10096ff0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5d400559b0 tx=0x7f5d40059dd0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.403+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3140335061 shutdown_connections 2024-09-11T22:12:55.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.403+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cb10095330 0x55cb100aeb30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.403+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb10094560 0x55cb10093450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.403+0000 7f5d24ff9640 0 client.5040 ms_handle_reset on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:55.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.403+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009d5e0 0x55cb1007c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.403+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3140335061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1009b200 0x55cb10096ff0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.403+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3140335061 >> 172.21.15.50:0/3140335061 conn(0x55cb1009ada0 msgr2=0x55cb1009eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.403+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3140335061 shutdown_connections 2024-09-11T22:12:55.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.403+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3140335061 wait complete. 2024-09-11T22:12:55.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.403+0000 7f5d4eff3740 20 client.5040 trim_cache size 0 max 16384 2024-09-11T22:12:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.419+0000 7f5d4eff3740 1 Processor -- start 2024-09-11T22:12:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.419+0000 7f5d4eff3740 1 -- start start 2024-09-11T22:12:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d4eff3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 0x55cb1007c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d4eff3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009b200 0x55cb1010fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d4eff3740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 0x55cb1007cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d4eff3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d44200af0 con 0x55cb10094560 2024-09-11T22:12:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d4eff3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d441ffaf0 con 0x55cb1009b200 2024-09-11T22:12:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d4eff3740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d441f8380 con 0x55cb1009d5e0 2024-09-11T22:12:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d49ff8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 0x55cb1007c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d49ff8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 0x55cb1007c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40004/0 (socket says 172.21.15.50:40004) 2024-09-11T22:12:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d49ff8640 1 -- 172.21.15.50:0/72225017 learned_addr learned my addr 172.21.15.50:0/72225017 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d4a7f9640 1 --2- 172.21.15.50:0/72225017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 0x55cb1007cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d49ff8640 1 -- 172.21.15.50:0/72225017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 msgr2=0x55cb1007cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d497f7640 1 --2- 172.21.15.50:0/72225017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009b200 0x55cb1010fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/72225017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 0x55cb1007cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d49ff8640 1 -- 172.21.15.50:0/72225017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009b200 msgr2=0x55cb1010fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/72225017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009b200 0x55cb1010fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d49ff8640 1 -- 172.21.15.50:0/72225017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb10096880 con 0x55cb10094560 2024-09-11T22:12:55.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d4a7f9640 1 --2- 172.21.15.50:0/72225017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 0x55cb1007cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:55.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d497f7640 1 --2- 172.21.15.50:0/72225017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009b200 0x55cb1010fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:12:55.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/72225017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 0x55cb1007c990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5d40059530 tx=0x7f5d4005b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f787640dd559e616 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d26ffd640 1 -- 172.21.15.50:0/72225017 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4007c070 con 0x55cb10094560 2024-09-11T22:12:55.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d26ffd640 1 -- 172.21.15.50:0/72225017 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d40084030 con 0x55cb10094560 2024-09-11T22:12:55.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.420+0000 7f5d26ffd640 1 -- 172.21.15.50:0/72225017 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40071070 con 0x55cb10094560 2024-09-11T22:12:55.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.421+0000 7f5d4eff3740 1 -- 172.21.15.50:0/72225017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 msgr2=0x55cb1007c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.421+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/72225017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 0x55cb1007c990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5d40059530 tx=0x7f5d4005b000 comp rx=0 tx=0).stop 2024-09-11T22:12:55.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.421+0000 7f5d4eff3740 1 -- 172.21.15.50:0/72225017 shutdown_connections 2024-09-11T22:12:55.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.421+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/72225017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 0x55cb1007cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.421+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/72225017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009b200 0x55cb1010fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.421+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/72225017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 0x55cb1007c990 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.421+0000 7f5d4eff3740 1 -- 172.21.15.50:0/72225017 >> 172.21.15.50:0/72225017 conn(0x55cb1009ada0 msgr2=0x55cb1004c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.421+0000 7f5d4eff3740 1 -- 172.21.15.50:0/72225017 shutdown_connections 2024-09-11T22:12:55.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.421+0000 7f5d4eff3740 1 -- 172.21.15.50:0/72225017 wait complete. 2024-09-11T22:12:55.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.421+0000 7f5d4eff3740 1 -- start start 2024-09-11T22:12:55.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.422+0000 7f5d4eff3740 1 Processor -- start 2024-09-11T22:12:55.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.422+0000 7f5d4eff3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 0x55cb1010d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.422+0000 7f5d4eff3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009b200 0x55cb101062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.422+0000 7f5d4eff3740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 0x55cb10106ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.422+0000 7f5d4eff3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cb10096580 con 0x55cb10094560 2024-09-11T22:12:55.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.422+0000 7f5d4eff3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d440cd360 con 0x55cb1009b200 2024-09-11T22:12:55.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.422+0000 7f5d4eff3740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cb100bf550 con 0x55cb1009d5e0 2024-09-11T22:12:55.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d4eff3740 10 client.0 _ll_register_callbacks cb 0x7f5d40058f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:55.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d49ff8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 0x55cb1010d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d49ff8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 0x55cb1010d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40010/0 (socket says 172.21.15.50:40010) 2024-09-11T22:12:55.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d49ff8640 1 -- 172.21.15.50:0/3093190043 learned_addr learned my addr 172.21.15.50:0/3093190043 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d497f7640 1 --2- 172.21.15.50:0/3093190043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009b200 0x55cb101062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d4a7f9640 1 --2- 172.21.15.50:0/3093190043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 0x55cb10106ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d49ff8640 1 -- 172.21.15.50:0/3093190043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 msgr2=0x55cb10106ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/3093190043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 0x55cb10106ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d49ff8640 1 -- 172.21.15.50:0/3093190043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009b200 msgr2=0x55cb101062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/3093190043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009b200 0x55cb101062b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d49ff8640 1 -- 172.21.15.50:0/3093190043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb0fc651b0 con 0x55cb10094560 2024-09-11T22:12:55.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d49ff8640 1 --2- 172.21.15.50:0/3093190043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 0x55cb1010d290 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5d40006fd0 tx=0x7f5d4000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5555d9c5997900e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:12:55.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d24ff9640 1 -- 172.21.15.50:0/3093190043 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4007c020 con 0x55cb10094560 2024-09-11T22:12:55.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d24ff9640 1 -- 172.21.15.50:0/3093190043 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5d40055c10 con 0x55cb10094560 2024-09-11T22:12:55.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3093190043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d40084030 con 0x55cb10094560 2024-09-11T22:12:55.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d24ff9640 1 -- 172.21.15.50:0/3093190043 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f5d40071040 con 0x55cb10094560 2024-09-11T22:12:55.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d4eff3740 10 client.5046 fetch_fsmap learned FSMap version 15 2024-09-11T22:12:55.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.423+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3093190043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55cb1010db30 con 0x55cb10094560 2024-09-11T22:12:55.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.424+0000 7f5d24ff9640 1 -- 172.21.15.50:0/3093190043 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d40084030 con 0x55cb10094560 2024-09-11T22:12:55.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.424+0000 7f5d24ff9640 1 -- 172.21.15.50:0/3093190043 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f5d4005eae0 con 0x55cb10094560 2024-09-11T22:12:55.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.424+0000 7f5d4eff3740 10 client.5046 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T22:12:55.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.424+0000 7f5d4eff3740 10 client.5046 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-11T22:12:55.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.424+0000 7f5d4eff3740 20 client.5046 populate_metadata read hostname 'smithi050' 2024-09-11T22:12:55.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.424+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3093190043 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cb100924f0 0x55cb1007cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.424+0000 7f5d4eff3740 4 client.5046 mds_command: new command op to 4815 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-11T22:12:55.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.424+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3093190043 --> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55cb0ff3df00 con 0x55cb100924f0 2024-09-11T22:12:55.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.424+0000 7f5d497f7640 1 --2- 172.21.15.50:0/3093190043 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cb100924f0 0x55cb1007cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.424+0000 7f5d24ff9640 10 client.5046 ms_handle_connect on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:55.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.424+0000 7f5d497f7640 1 --2- 172.21.15.50:0/3093190043 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cb100924f0 0x55cb1007cff0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9529f438961be661 server_cookie=1a18966a201456b5 in_seq=0 out_seq=0 2024-09-11T22:12:55.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d24ff9640 1 -- 172.21.15.50:0/3093190043 <== mds.0 v2:172.21.15.50:6832/900288576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17988 (crc 0 0 0) 0x55cb0ff3df00 con 0x55cb100924f0 2024-09-11T22:12:55.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d24ff9640 10 client.5046 handle_command_reply: tid=0 2024-09-11T22:12:55.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d4eff3740 1 client.5046 shutdown 2024-09-11T22:12:55.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3093190043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 msgr2=0x55cb1010d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3093190043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 0x55cb1010d290 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5d40006fd0 tx=0x7f5d4000bf90 comp rx=0 tx=0).stop 2024-09-11T22:12:55.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3093190043 shutdown_connections 2024-09-11T22:12:55.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3093190043 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cb100924f0 0x55cb1007cff0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3093190043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cb1009d5e0 0x55cb10106ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3093190043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb1009b200 0x55cb101062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d4eff3740 1 --2- 172.21.15.50:0/3093190043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb10094560 0x55cb1010d290 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d24ff9640 0 client.5046 ms_handle_reset on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:55.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3093190043 >> 172.21.15.50:0/3093190043 conn(0x55cb1009ada0 msgr2=0x55cb100918e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3093190043 shutdown_connections 2024-09-11T22:12:55.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d4eff3740 1 -- 172.21.15.50:0/3093190043 wait complete. 2024-09-11T22:12:55.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.425+0000 7f5d4eff3740 20 client.5046 trim_cache size 0 max 16384 2024-09-11T22:12:55.436 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:12:55.436 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:12:55.436 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 1634, 2024-09-11T22:12:55.436 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 1635, 2024-09-11T22:12:55.436 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 410237, 2024-09-11T22:12:55.436 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 37805376, 2024-09-11T22:12:55.436 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 9, 2024-09-11T22:12:55.436 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 3, 2024-09-11T22:12:55.436 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.256158428, 2024-09-11T22:12:55.437 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.146512074, 2024-09-11T22:12:55.437 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.039667458, 2024-09-11T22:12:55.437 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.059550437, 2024-09-11T22:12:55.437 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:12:55.437 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1634, 2024-09-11T22:12:55.437 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.604341230, 2024-09-11T22:12:55.438 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000369853 2024-09-11T22:12:55.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.438 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:12:55.438 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2, 2024-09-11T22:12:55.438 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000204, 2024-09-11T22:12:55.438 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000102 2024-09-11T22:12:55.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.439 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:12:55.439 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:12:55.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.439 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:12:55.439 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 27748, 2024-09-11T22:12:55.439 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 50074, 2024-09-11T22:12:55.440 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 9655705, 2024-09-11T22:12:55.440 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 43245138, 2024-09-11T22:12:55.440 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 7, 2024-09-11T22:12:55.440 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-09-11T22:12:55.440 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 3.519948919, 2024-09-11T22:12:55.441 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 2.421456698, 2024-09-11T22:12:55.441 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 1.708012853, 2024-09-11T22:12:55.441 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.038097633, 2024-09-11T22:12:55.441 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:12:55.441 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 50074, 2024-09-11T22:12:55.441 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.118215910, 2024-09-11T22:12:55.442 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000022331 2024-09-11T22:12:55.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.442 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:12:55.442 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 73364, 2024-09-11T22:12:55.442 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.008488649, 2024-09-11T22:12:55.443 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000115 2024-09-11T22:12:55.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.443 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 119440, 2024-09-11T22:12:55.443 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 19840 2024-09-11T22:12:55.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.443 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:12:55.444 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 1826, 2024-09-11T22:12:55.444 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 1842, 2024-09-11T22:12:55.444 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 626402, 2024-09-11T22:12:55.444 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 34180548, 2024-09-11T22:12:55.444 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 6, 2024-09-11T22:12:55.445 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-09-11T22:12:55.445 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.228825162, 2024-09-11T22:12:55.445 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.114315873, 2024-09-11T22:12:55.445 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.037891484, 2024-09-11T22:12:55.445 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.066695303, 2024-09-11T22:12:55.445 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:12:55.445 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1840, 2024-09-11T22:12:55.446 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.233718967, 2024-09-11T22:12:55.446 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000127021 2024-09-11T22:12:55.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.446 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:12:55.446 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.447 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.447 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.447 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T22:12:55.447 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 110112 2024-09-11T22:12:55.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.448 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-09-11T22:12:55.448 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-09-11T22:12:55.448 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-09-11T22:12:55.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.448 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-09-11T22:12:55.448 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-09-11T22:12:55.449 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-09-11T22:12:55.449 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1192, 2024-09-11T22:12:55.449 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 16.867480661, 2024-09-11T22:12:55.449 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.014150571 2024-09-11T22:12:55.449 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:12:55.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.450 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-09-11T22:12:55.450 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-09-11T22:12:55.450 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-09-11T22:12:55.450 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1659, 2024-09-11T22:12:55.450 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.125114363, 2024-09-11T22:12:55.450 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000678188 2024-09-11T22:12:55.451 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:12:55.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.451 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-09-11T22:12:55.451 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 25577, 2024-09-11T22:12:55.451 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 25577, 2024-09-11T22:12:55.451 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-09-11T22:12:55.452 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 25577, 2024-09-11T22:12:55.452 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 383.855681200, 2024-09-11T22:12:55.452 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.015007846 2024-09-11T22:12:55.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.452 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 0, 2024-09-11T22:12:55.453 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 0, 2024-09-11T22:12:55.453 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 0, 2024-09-11T22:12:55.453 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-09-11T22:12:55.453 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 12, 2024-09-11T22:12:55.453 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 0, 2024-09-11T22:12:55.453 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 0, 2024-09-11T22:12:55.454 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 19890, 2024-09-11T22:12:55.454 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 0, 2024-09-11T22:12:55.454 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 19890, 2024-09-11T22:12:55.454 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 0, 2024-09-11T22:12:55.454 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 19889, 2024-09-11T22:12:55.454 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 0, 2024-09-11T22:12:55.455 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 102, 2024-09-11T22:12:55.455 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 102, 2024-09-11T22:12:55.455 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 2, 2024-09-11T22:12:55.455 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 46362, 2024-09-11T22:12:55.455 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 45905, 2024-09-11T22:12:55.455 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 0, 2024-09-11T22:12:55.456 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 0, 2024-09-11T22:12:55.456 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:12:55.456 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-09-11T22:12:55.456 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 87, 2024-09-11T22:12:55.456 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 0, 2024-09-11T22:12:55.456 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-09-11T22:12:55.457 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 0, 2024-09-11T22:12:55.457 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 0, 2024-09-11T22:12:55.457 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 0, 2024-09-11T22:12:55.457 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 0, 2024-09-11T22:12:55.457 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-09-11T22:12:55.457 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:12:55.458 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 1273, 2024-09-11T22:12:55.459 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 4046, 2024-09-11T22:12:55.459 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:12:55.459 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:12:55.459 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:12:55.459 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 3276, 2024-09-11T22:12:55.459 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 2382, 2024-09-11T22:12:55.459 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 49, 2024-09-11T22:12:55.459 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 14054 2024-09-11T22:12:55.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.459 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-09-11T22:12:55.459 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 0, 2024-09-11T22:12:55.459 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 0, 2024-09-11T22:12:55.459 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 0, 2024-09-11T22:12:55.460 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 0, 2024-09-11T22:12:55.460 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 0, 2024-09-11T22:12:55.460 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 2000, 2024-09-11T22:12:55.460 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 319, 2024-09-11T22:12:55.460 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:12:55.460 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 4152, 2024-09-11T22:12:55.460 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 1582, 2024-09-11T22:12:55.460 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 2231, 2024-09-11T22:12:55.460 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-09-11T22:12:55.460 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-09-11T22:12:55.460 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:12:55.460 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:12:55.460 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-09-11T22:12:55.461 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-09-11T22:12:55.461 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:12:55.461 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:12:55.461 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:12:55.461 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 0, 2024-09-11T22:12:55.461 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-09-11T22:12:55.461 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:12:55.461 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-09-11T22:12:55.461 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0 2024-09-11T22:12:55.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.461 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-09-11T22:12:55.461 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 0, 2024-09-11T22:12:55.461 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 24491, 2024-09-11T22:12:55.462 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 0, 2024-09-11T22:12:55.462 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 0, 2024-09-11T22:12:55.462 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 24491, 2024-09-11T22:12:55.462 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 0, 2024-09-11T22:12:55.462 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 0, 2024-09-11T22:12:55.462 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 31, 2024-09-11T22:12:55.462 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 0, 2024-09-11T22:12:55.462 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 0, 2024-09-11T22:12:55.462 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 31, 2024-09-11T22:12:55.462 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 3, 2024-09-11T22:12:55.462 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 0, 2024-09-11T22:12:55.462 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 0, 2024-09-11T22:12:55.462 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 4194304, 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 94422413, 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 0, 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2589, 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 109.486483085, 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.042289101 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 0 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 2014, 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 2014, 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 0, 2024-09-11T22:12:55.463 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 13, 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 13, 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 0, 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 19890, 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 19891, 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 1, 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 102, 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 7055, 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 6953, 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 116696, 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 231788 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 28417, 2024-09-11T22:12:55.464 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 0, 2024-09-11T22:12:55.465 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 25577, 2024-09-11T22:12:55.465 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 3, 2024-09-11T22:12:55.465 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 0, 2024-09-11T22:12:55.465 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-09-11T22:12:55.465 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2000, 2024-09-11T22:12:55.465 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.926000466, 2024-09-11T22:12:55.465 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000963000 2024-09-11T22:12:55.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.465 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-09-11T22:12:55.465 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 30, 2024-09-11T22:12:55.465 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.005520411, 2024-09-11T22:12:55.465 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000184013 2024-09-11T22:12:55.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.466 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-09-11T22:12:55.466 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.466 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.466 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.466 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-09-11T22:12:55.466 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 6000, 2024-09-11T22:12:55.466 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 7.880192940, 2024-09-11T22:12:55.466 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.001313365 2024-09-11T22:12:55.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.466 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-09-11T22:12:55.466 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 7302, 2024-09-11T22:12:55.466 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 5.709236919, 2024-09-11T22:12:55.467 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000781873 2024-09-11T22:12:55.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.467 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-09-11T22:12:55.467 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.467 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.467 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.467 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-09-11T22:12:55.467 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.467 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.467 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-09-11T22:12:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-09-11T22:12:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-09-11T22:12:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:12:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000045112, 2024-09-11T22:12:55.469 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000045112 2024-09-11T22:12:55.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.469 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-09-11T22:12:55.469 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.469 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.469 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.469 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-09-11T22:12:55.469 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:12:55.469 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.003023169, 2024-09-11T22:12:55.469 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.003023169 2024-09-11T22:12:55.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.470 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-09-11T22:12:55.470 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.470 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.470 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.470 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-09-11T22:12:55.470 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:12:55.470 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.442395978, 2024-09-11T22:12:55.470 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.442395978 2024-09-11T22:12:55.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.470 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-09-11T22:12:55.470 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:12:55.470 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000140134, 2024-09-11T22:12:55.471 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000140134 2024-09-11T22:12:55.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.471 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-09-11T22:12:55.471 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8, 2024-09-11T22:12:55.471 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.352239013, 2024-09-11T22:12:55.471 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.044029876 2024-09-11T22:12:55.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.471 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-09-11T22:12:55.471 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2231, 2024-09-11T22:12:55.471 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 348.748754199, 2024-09-11T22:12:55.471 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.156319477 2024-09-11T22:12:55.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.472 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-09-11T22:12:55.472 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.472 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.472 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.472 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-09-11T22:12:55.472 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.472 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.472 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.472 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-09-11T22:12:55.472 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.472 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.065474845, 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.065474845 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-09-11T22:12:55.473 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:12:55.474 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000260056, 2024-09-11T22:12:55.474 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000260056 2024-09-11T22:12:55.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.474 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-09-11T22:12:55.474 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.474 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.474 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.474 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-09-11T22:12:55.474 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.474 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.474 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.475 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.476 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-09-11T22:12:55.476 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8000, 2024-09-11T22:12:55.476 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 18.722397958, 2024-09-11T22:12:55.476 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.002340299 2024-09-11T22:12:55.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.476 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:12:55.476 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:12:55.476 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-09-11T22:12:55.476 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.476 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.476 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.477 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:12:55.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.477 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-09-11T22:12:55.477 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 1, 2024-09-11T22:12:55.477 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 1, 2024-09-11T22:12:55.477 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 0, 2024-09-11T22:12:55.477 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 1, 2024-09-11T22:12:55.477 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-09-11T22:12:55.477 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 18470, 2024-09-11T22:12:55.477 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 18470, 2024-09-11T22:12:55.477 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 47, 2024-09-11T22:12:55.477 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-09-11T22:12:55.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.478 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-09-11T22:12:55.478 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:12:55.478 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-09-11T22:12:55.478 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:12:55.478 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:12:55.478 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:12:55.478 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:12:55.478 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:12:55.478 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:12:55.478 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:12:55.478 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:12:55.478 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:12:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:12:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:12:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:12:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:12:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-09-11T22:12:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:12:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-09-11T22:12:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:12:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:12:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:12:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:12:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:12:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 16701038, 2024-09-11T22:12:55.480 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 6211, 2024-09-11T22:12:55.481 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 440, 2024-09-11T22:12:55.481 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 5, 2024-09-11T22:12:55.481 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-09-11T22:12:55.481 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-09-11T22:12:55.481 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:12:55.481 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-09-11T22:12:55.481 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:12:55.481 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-09-11T22:12:55.481 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 5312, 2024-09-11T22:12:55.484 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 75, 2024-09-11T22:12:55.484 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:12:55.484 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:12:55.484 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-09-11T22:12:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-09-11T22:12:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 21242053, 2024-09-11T22:12:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 880636, 2024-09-11T22:12:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-09-11T22:12:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-09-11T22:12:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-09-11T22:12:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-09-11T22:12:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-09-11T22:12:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-09-11T22:12:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-09-11T22:12:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 4405, 2024-09-11T22:12:55.485 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 90683877, 2024-09-11T22:12:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 37, 2024-09-11T22:12:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 4405, 2024-09-11T22:12:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-09-11T22:12:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 4405, 2024-09-11T22:12:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 18.013535346, 2024-09-11T22:12:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.004089338 2024-09-11T22:12:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-09-11T22:12:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-09-11T22:12:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 4405, 2024-09-11T22:12:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 4502 2024-09-11T22:12:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 4405, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 49, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 4356, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 0, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 11, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 49, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 2638, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 31, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 1582, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 0, 2024-09-11T22:12:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 33, 2024-09-11T22:12:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-09-11T22:12:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-09-11T22:12:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-09-11T22:12:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 0, 2024-09-11T22:12:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 22, 2024-09-11T22:12:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:12:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-09-11T22:12:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:12:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-09-11T22:12:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-09-11T22:12:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-09-11T22:12:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-09-11T22:12:55.489 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-09-11T22:12:55.490 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-09-11T22:12:55.490 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-09-11T22:12:55.490 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-09-11T22:12:55.490 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-09-11T22:12:55.490 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-09-11T22:12:55.490 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 32, 2024-09-11T22:12:55.490 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-09-11T22:12:55.490 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 1, 2024-09-11T22:12:55.490 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 8, 2024-09-11T22:12:55.490 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 8, 2024-09-11T22:12:55.490 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 0, 2024-09-11T22:12:55.490 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-09-11T22:12:55.490 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 106, 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 0, 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 30 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 1, 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: "osd-slow-ops": { 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 0 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-09-11T22:12:55.491 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-09-11T22:12:55.492 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 32, 2024-09-11T22:12:55.492 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-09-11T22:12:55.492 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 32, 2024-09-11T22:12:55.492 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 1582, 2024-09-11T22:12:55.492 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 1582, 2024-09-11T22:12:55.492 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-09-11T22:12:55.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.492 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:12:55.492 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:12:55.492 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-09-11T22:12:55.492 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:12:55.492 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 31203, 2024-09-11T22:12:55.492 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 7879083, 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 31203, 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 31203, 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 7879083, 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-09-11T22:12:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:12:55.494 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-09-11T22:12:55.494 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:12:55.494 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-09-11T22:12:55.494 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-09-11T22:12:55.494 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:12:55.494 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-09-11T22:12:55.494 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 4405, 2024-09-11T22:12:55.494 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 90856315, 2024-09-11T22:12:55.494 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 4405, 2024-09-11T22:12:55.494 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 90856315, 2024-09-11T22:12:55.494 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:12:55.494 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 4405, 2024-09-11T22:12:55.495 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 4405, 2024-09-11T22:12:55.496 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 4405, 2024-09-11T22:12:55.496 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 4405, 2024-09-11T22:12:55.496 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:12:55.496 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.496 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.496 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:12:55.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.496 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:12:55.496 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:12:55.496 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-09-11T22:12:55.496 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 1582, 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 172438, 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 1582, 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 49, 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 172438, 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:12:55.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x5567f1cc8500": { 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 84, 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 24491, 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 90228109, 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 24491, 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 2589, 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 90228025, 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:12:55.498 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:12:55.499 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:12:55.499 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:12:55.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:12:55.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:12:55.499 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:12:55.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.426+0000 7f5d4c25c640 1 -- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5d2806be30 msgr2=0x7f5d2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.426+0000 7f5d4c25c640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5d2806be30 0x7f5d2806e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5d34034000 tx=0x7f5d3402e000 comp rx=0 tx=0).stop 2024-09-11T22:12:55.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.426+0000 7f5d4c25c640 1 -- 172.21.15.50:0/1328923724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d440679c0 msgr2=0x7f5d441574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.426+0000 7f5d4c25c640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d440679c0 0x7f5d441574c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000d800 tx=0x7f5d4000dcc0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.426+0000 7f5d4c25c640 1 -- 172.21.15.50:0/1328923724 shutdown_connections 2024-09-11T22:12:55.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.426+0000 7f5d4c25c640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5d2806be30 0x7f5d2806e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.426+0000 7f5d4c25c640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4415c3c0 0x7f5d4415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.426+0000 7f5d4c25c640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4415ec40 0x7f5d441f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.426+0000 7f5d4c25c640 1 --2- 172.21.15.50:0/1328923724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d440679c0 0x7f5d441574c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.426+0000 7f5d4c25c640 1 -- 172.21.15.50:0/1328923724 >> 172.21.15.50:0/1328923724 conn(0x7f5d44075060 msgr2=0x7f5d4415a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.426+0000 7f5d4c25c640 1 -- 172.21.15.50:0/1328923724 shutdown_connections 2024-09-11T22:12:55.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.426+0000 7f5d4c25c640 1 -- 172.21.15.50:0/1328923724 wait complete. 2024-09-11T22:12:55.502 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-11T22:12:55.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:12:55.502 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-09-11T22:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.612+0000 7f4e9685e640 1 Processor -- start 2024-09-11T22:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.612+0000 7f4e9685e640 1 -- start start 2024-09-11T22:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.613+0000 7f4e9685e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9015e8e0 0x7f4e900b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.613+0000 7f4e9685e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e90163080 con 0x7f4e900d1580 2024-09-11T22:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.613+0000 7f4e9685e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e900d2d20 con 0x7f4e90162350 2024-09-11T22:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.613+0000 7f4e9685e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e9015ecc0 con 0x7f4e9015e8e0 2024-09-11T22:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.613+0000 7f4e8f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4e900d1580 0x7f4e900d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52512/0 (socket says 172.21.15.50:52512) 2024-09-11T22:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.613+0000 7f4e8f7fe640 1 -- 172.21.15.50:0/2907607844 learned_addr learned my addr 172.21.15.50:0/2907607844 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.613+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/2907607844 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9015e8e0 0x7f4e900b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.613+0000 7f4e8effd640 1 -- 172.21.15.50:0/2907607844 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297102735 0 0) 0x7f4e90163080 con 0x7f4e900d1580 2024-09-11T22:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.613+0000 7f4e8effd640 1 -- 172.21.15.50:0/2907607844 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e78003520 con 0x7f4e900d1580 2024-09-11T22:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.614+0000 7f4e8effd640 1 -- 172.21.15.50:0/2907607844 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186687711 0 0) 0x7f4e900d2d20 con 0x7f4e90162350 2024-09-11T22:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.614+0000 7f4e8effd640 1 -- 172.21.15.50:0/2907607844 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e90163080 con 0x7f4e90162350 2024-09-11T22:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.614+0000 7f4e8ffff640 1 -- 172.21.15.50:0/2907607844 >> v1:172.21.15.77:6789/0 conn(0x7f4e90162350 legacy=0x7f4e90162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.614+0000 7f4e8ffff640 1 -- 172.21.15.50:0/2907607844 >> v1:172.21.15.50:6789/0 conn(0x7f4e900d1580 legacy=0x7f4e900d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.614+0000 7f4e8effd640 1 -- 172.21.15.50:0/2907607844 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 465823062 0 0) 0x7f4e78003520 con 0x7f4e900d1580 2024-09-11T22:12:55.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.614+0000 7f4e8ffff640 1 -- 172.21.15.50:0/2907607844 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e900d3000 con 0x7f4e9015e8e0 2024-09-11T22:12:55.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.614+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/2907607844 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9015e8e0 0x7f4e900b7880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e800097d0 tx=0x7f4e8002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf29d07227c3a9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.615+0000 7f4e8effd640 1 -- 172.21.15.50:0/2907607844 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e80037070 con 0x7f4e9015e8e0 2024-09-11T22:12:55.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.615+0000 7f4e8effd640 1 -- 172.21.15.50:0/2907607844 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8002acc0 con 0x7f4e9015e8e0 2024-09-11T22:12:55.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.615+0000 7f4e8effd640 1 -- 172.21.15.50:0/2907607844 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84001670 con 0x7f4e9015e8e0 2024-09-11T22:12:55.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.615+0000 7f4e9685e640 1 -- 172.21.15.50:0/2907607844 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9015e8e0 msgr2=0x7f4e900b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.615+0000 7f4e9685e640 1 --2- 172.21.15.50:0/2907607844 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9015e8e0 0x7f4e900b7880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e800097d0 tx=0x7f4e8002a230 comp rx=0 tx=0).stop 2024-09-11T22:12:55.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.615+0000 7f4e9685e640 1 -- 172.21.15.50:0/2907607844 shutdown_connections 2024-09-11T22:12:55.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.615+0000 7f4e9685e640 1 --2- 172.21.15.50:0/2907607844 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9015e8e0 0x7f4e900b7880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.615+0000 7f4e9685e640 1 -- 172.21.15.50:0/2907607844 >> 172.21.15.50:0/2907607844 conn(0x7f4e90067ba0 msgr2=0x7f4e90067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.615+0000 7f4e9685e640 1 -- 172.21.15.50:0/2907607844 shutdown_connections 2024-09-11T22:12:55.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.615+0000 7f4e9685e640 1 -- 172.21.15.50:0/2907607844 wait complete. 2024-09-11T22:12:55.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.617+0000 7f4e9685e640 1 Processor -- start 2024-09-11T22:12:55.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.617+0000 7f4e9685e640 1 -- start start 2024-09-11T22:12:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.617+0000 7f4e9685e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900d1580 0x7f4e9015d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.617+0000 7f4e9685e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e9015e8e0 0x7f4e9015de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.617+0000 7f4e9685e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e90162350 0x7f4e901553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.617+0000 7f4e9685e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e900d3b90 con 0x7f4e9015e8e0 2024-09-11T22:12:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.617+0000 7f4e9685e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e900d3a10 con 0x7f4e900d1580 2024-09-11T22:12:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.617+0000 7f4e9685e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e900d3d10 con 0x7f4e90162350 2024-09-11T22:12:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e9015e8e0 0x7f4e9015de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e9015e8e0 0x7f4e9015de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40012/0 (socket says 172.21.15.50:40012) 2024-09-11T22:12:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e8f7fe640 1 -- 172.21.15.50:0/3779581149 learned_addr learned my addr 172.21.15.50:0/3779581149 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900d1580 0x7f4e9015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e94dfb640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e90162350 0x7f4e901553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e8f7fe640 1 -- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e90162350 msgr2=0x7f4e901553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e8f7fe640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e90162350 0x7f4e901553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e8f7fe640 1 -- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900d1580 msgr2=0x7f4e9015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e8f7fe640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900d1580 0x7f4e9015d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e8f7fe640 1 -- 172.21.15.50:0/3779581149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e900b44a0 con 0x7f4e9015e8e0 2024-09-11T22:12:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e8f7fe640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e9015e8e0 0x7f4e9015de10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4e84000fd0 tx=0x7f4e8400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e8cff9640 1 -- 172.21.15.50:0/3779581149 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84017070 con 0x7f4e9015e8e0 2024-09-11T22:12:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e8cff9640 1 -- 172.21.15.50:0/3779581149 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e84005ad0 con 0x7f4e9015e8e0 2024-09-11T22:12:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e8cff9640 1 -- 172.21.15.50:0/3779581149 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84007070 con 0x7f4e9015e8e0 2024-09-11T22:12:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e9685e640 1 -- 172.21.15.50:0/3779581149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e900b4780 con 0x7f4e9015e8e0 2024-09-11T22:12:55.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.618+0000 7f4e9685e640 1 -- 172.21.15.50:0/3779581149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e900b4d40 con 0x7f4e9015e8e0 2024-09-11T22:12:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.620+0000 7f4e8cff9640 1 -- 172.21.15.50:0/3779581149 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e8401a070 con 0x7f4e9015e8e0 2024-09-11T22:12:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.620+0000 7f4e8cff9640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e7c06be30 0x7f4e7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.620+0000 7f4e8cff9640 1 -- 172.21.15.50:0/3779581149 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4e8408a190 con 0x7f4e9015e8e0 2024-09-11T22:12:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.621+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e7c06be30 0x7f4e7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.621+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e7c06be30 0x7f4e7c06e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4e80034000 tx=0x7f4e8002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.621+0000 7f4e995f8740 1 Processor -- start 2024-09-11T22:12:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.621+0000 7f4e995f8740 1 -- start start 2024-09-11T22:12:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e995f8740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54540b60 0x563d54586300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e995f8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d5453e320 0x563d54540f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e995f8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 0x563d5453b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e995f8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563d545028c0 con 0x563d5453e320 2024-09-11T22:12:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e995f8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563d544a3980 con 0x563d545422f0 2024-09-11T22:12:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e995f8740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563d5444b670 con 0x563d54540b60 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d5453e320 0x563d54540f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d5453e320 0x563d54540f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40020/0 (socket says 172.21.15.50:40020) 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e8f7fe640 1 -- 172.21.15.50:0/4148131407 learned_addr learned my addr 172.21.15.50:0/4148131407 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/4148131407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54540b60 0x563d54586300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e94dfb640 1 --2- 172.21.15.50:0/4148131407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 0x563d5453b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e8f7fe640 1 -- 172.21.15.50:0/4148131407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54540b60 msgr2=0x563d54586300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e8f7fe640 1 --2- 172.21.15.50:0/4148131407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54540b60 0x563d54586300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e8f7fe640 1 -- 172.21.15.50:0/4148131407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 msgr2=0x563d5453b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e8f7fe640 1 --2- 172.21.15.50:0/4148131407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 0x563d5453b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e8f7fe640 1 -- 172.21.15.50:0/4148131407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d54282940 con 0x563d5453e320 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.622+0000 7f4e8f7fe640 1 --2- 172.21.15.50:0/4148131407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d5453e320 0x563d54540f40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4e84054950 tx=0x7f4e84057e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc38698dc65e785 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.623+0000 7f4e75ffb640 1 -- 172.21.15.50:0/4148131407 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84086070 con 0x563d5453e320 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.623+0000 7f4e75ffb640 1 -- 172.21.15.50:0/4148131407 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e84061020 con 0x563d5453e320 2024-09-11T22:12:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.623+0000 7f4e75ffb640 1 -- 172.21.15.50:0/4148131407 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84070020 con 0x563d5453e320 2024-09-11T22:12:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.623+0000 7f4e995f8740 1 -- 172.21.15.50:0/4148131407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d5453e320 msgr2=0x563d54540f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.623+0000 7f4e995f8740 1 --2- 172.21.15.50:0/4148131407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d5453e320 0x563d54540f40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4e84054950 tx=0x7f4e84057e50 comp rx=0 tx=0).stop 2024-09-11T22:12:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.623+0000 7f4e995f8740 1 -- 172.21.15.50:0/4148131407 shutdown_connections 2024-09-11T22:12:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.623+0000 7f4e995f8740 1 --2- 172.21.15.50:0/4148131407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 0x563d5453b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.623+0000 7f4e995f8740 1 --2- 172.21.15.50:0/4148131407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d5453e320 0x563d54540f40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.623+0000 7f4e995f8740 1 --2- 172.21.15.50:0/4148131407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54540b60 0x563d54586300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.623+0000 7f4e995f8740 1 -- 172.21.15.50:0/4148131407 >> 172.21.15.50:0/4148131407 conn(0x563d5453d320 msgr2=0x563d545857d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.623+0000 7f4e995f8740 1 -- 172.21.15.50:0/4148131407 shutdown_connections 2024-09-11T22:12:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.623+0000 7f4e995f8740 1 -- 172.21.15.50:0/4148131407 wait complete. 2024-09-11T22:12:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.624+0000 7f4e995f8740 1 -- start start 2024-09-11T22:12:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.624+0000 7f4e995f8740 1 Processor -- start 2024-09-11T22:12:55.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e995f8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d54540b60 0x563d54568540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e995f8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d545422f0 0x563d54564220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e995f8740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54564760 0x563d54599400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e995f8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563d5442c670 con 0x563d545422f0 2024-09-11T22:12:55.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e995f8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563d5449f940 con 0x563d54540b60 2024-09-11T22:12:55.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e995f8740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563d5453c7c0 con 0x563d54564760 2024-09-11T22:12:55.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e995f8740 10 client.0 _ll_register_callbacks cb 0x563d541b5d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:55.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d545422f0 0x563d54564220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d545422f0 0x563d54564220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40034/0 (socket says 172.21.15.50:40034) 2024-09-11T22:12:55.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e94dfb640 1 --2- 172.21.15.50:0/485991968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54564760 0x563d54599400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e8f7fe640 1 -- 172.21.15.50:0/485991968 learned_addr learned my addr 172.21.15.50:0/485991968 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/485991968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d54540b60 0x563d54568540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e8f7fe640 1 -- 172.21.15.50:0/485991968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54564760 msgr2=0x563d54599400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e8f7fe640 1 --2- 172.21.15.50:0/485991968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54564760 0x563d54599400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e8f7fe640 1 -- 172.21.15.50:0/485991968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d54540b60 msgr2=0x563d54568540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e8f7fe640 1 --2- 172.21.15.50:0/485991968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d54540b60 0x563d54568540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.625+0000 7f4e8f7fe640 1 -- 172.21.15.50:0/485991968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d542e30d0 con 0x563d545422f0 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e8f7fe640 1 --2- 172.21.15.50:0/485991968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d545422f0 0x563d54564220 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4e84058480 tx=0x7f4e84000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b71a08e9401f424 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e6effd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e6effd640 1 -- 172.21.15.50:0/485991968 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84074020 con 0x563d545422f0 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e6effd640 1 -- 172.21.15.50:0/485991968 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4e84077310 con 0x563d545422f0 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e995f8740 1 -- 172.21.15.50:0/485991968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e84061020 con 0x563d545422f0 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e6effd640 1 -- 172.21.15.50:0/485991968 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f4e84086030 con 0x563d545422f0 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e995f8740 10 client.5058 fetch_fsmap learned FSMap version 15 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e995f8740 1 -- 172.21.15.50:0/485991968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x563d54176230 con 0x563d545422f0 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e6effd640 1 -- 172.21.15.50:0/485991968 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e84061020 con 0x563d545422f0 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e6effd640 1 -- 172.21.15.50:0/485991968 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f4e84060b90 con 0x563d545422f0 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e995f8740 10 client.5058 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e995f8740 10 client.5058 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e995f8740 20 client.5058 populate_metadata read hostname 'smithi050' 2024-09-11T22:12:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e995f8740 1 --2- 172.21.15.50:0/485991968 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x563d54599e10 0x563d54561e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e995f8740 4 client.5058 mds_command: new command op to 4815 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e995f8740 1 -- 172.21.15.50:0/485991968 --> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d544b10b0 con 0x563d54599e10 2024-09-11T22:12:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.626+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/485991968 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x563d54599e10 0x563d54561e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.627+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/485991968 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x563d54599e10 0x563d54561e20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d80924fb2094d14a server_cookie=5e1c47e4acf85e54 in_seq=0 out_seq=0 2024-09-11T22:12:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.627+0000 7f4e6effd640 10 client.5058 ms_handle_connect on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.627+0000 7f4e6effd640 1 -- 172.21.15.50:0/485991968 <== mds.0 v2:172.21.15.50:6832/900288576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d544b10b0 con 0x563d54599e10 2024-09-11T22:12:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.627+0000 7f4e6effd640 10 client.5058 handle_command_reply: tid=0 2024-09-11T22:12:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.627+0000 7f4e995f8740 1 client.5058 shutdown 2024-09-11T22:12:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.628+0000 7f4e995f8740 1 -- 172.21.15.50:0/485991968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d545422f0 msgr2=0x563d54564220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.628+0000 7f4e995f8740 1 --2- 172.21.15.50:0/485991968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d545422f0 0x563d54564220 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4e84058480 tx=0x7f4e84000bc0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.628+0000 7f4e995f8740 1 -- 172.21.15.50:0/485991968 shutdown_connections 2024-09-11T22:12:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.628+0000 7f4e995f8740 1 --2- 172.21.15.50:0/485991968 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x563d54599e10 0x563d54561e20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.628+0000 7f4e995f8740 1 --2- 172.21.15.50:0/485991968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54564760 0x563d54599400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.628+0000 7f4e995f8740 1 --2- 172.21.15.50:0/485991968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d545422f0 0x563d54564220 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.628+0000 7f4e995f8740 1 --2- 172.21.15.50:0/485991968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d54540b60 0x563d54568540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.628+0000 7f4e6effd640 0 client.5058 ms_handle_reset on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.628+0000 7f4e995f8740 1 -- 172.21.15.50:0/485991968 >> 172.21.15.50:0/485991968 conn(0x563d5453e320 msgr2=0x563d5453e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.628+0000 7f4e995f8740 1 -- 172.21.15.50:0/485991968 shutdown_connections 2024-09-11T22:12:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.628+0000 7f4e995f8740 1 -- 172.21.15.50:0/485991968 wait complete. 2024-09-11T22:12:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.628+0000 7f4e995f8740 20 client.5058 trim_cache size 0 max 16384 2024-09-11T22:12:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.645+0000 7f4e995f8740 1 Processor -- start 2024-09-11T22:12:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.645+0000 7f4e995f8740 1 -- start start 2024-09-11T22:12:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.646+0000 7f4e995f8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54540b60 0x563d54585b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.646+0000 7f4e995f8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 0x563d5456a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.646+0000 7f4e995f8740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54564760 0x563d5456a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.646+0000 7f4e995f8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e90200ce0 con 0x563d54540b60 2024-09-11T22:12:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.646+0000 7f4e995f8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e901ffdd0 con 0x563d545422f0 2024-09-11T22:12:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.646+0000 7f4e995f8740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e901f8730 con 0x563d54564760 2024-09-11T22:12:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.646+0000 7f4e8ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54540b60 0x563d54585b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.646+0000 7f4e8ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54540b60 0x563d54585b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40048/0 (socket says 172.21.15.50:40048) 2024-09-11T22:12:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.646+0000 7f4e8ffff640 1 -- 172.21.15.50:0/67015125 learned_addr learned my addr 172.21.15.50:0/67015125 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.646+0000 7f4e94dfb640 1 --2- 172.21.15.50:0/67015125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54564760 0x563d5456a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.646+0000 7f4e8f7fe640 1 --2- 172.21.15.50:0/67015125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 0x563d5456a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e8ffff640 1 -- 172.21.15.50:0/67015125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54564760 msgr2=0x563d5456a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/67015125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54564760 0x563d5456a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e8ffff640 1 -- 172.21.15.50:0/67015125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 msgr2=0x563d5456a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/67015125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 0x563d5456a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e8ffff640 1 -- 172.21.15.50:0/67015125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d54569b10 con 0x563d54540b60 2024-09-11T22:12:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/67015125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54540b60 0x563d54585b20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4e8002a820 tx=0x7f4e8002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf7e72410f40096 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e757fa640 1 -- 172.21.15.50:0/67015125 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e80037040 con 0x563d54540b60 2024-09-11T22:12:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e757fa640 1 -- 172.21.15.50:0/67015125 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e80052030 con 0x563d54540b60 2024-09-11T22:12:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e757fa640 1 -- 172.21.15.50:0/67015125 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8003ee20 con 0x563d54540b60 2024-09-11T22:12:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e995f8740 1 -- 172.21.15.50:0/67015125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54540b60 msgr2=0x563d54585b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e995f8740 1 --2- 172.21.15.50:0/67015125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54540b60 0x563d54585b20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4e8002a820 tx=0x7f4e8002c000 comp rx=0 tx=0).stop 2024-09-11T22:12:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e995f8740 1 -- 172.21.15.50:0/67015125 shutdown_connections 2024-09-11T22:12:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e995f8740 1 --2- 172.21.15.50:0/67015125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54564760 0x563d5456a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e995f8740 1 --2- 172.21.15.50:0/67015125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 0x563d5456a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e995f8740 1 --2- 172.21.15.50:0/67015125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54540b60 0x563d54585b20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.647+0000 7f4e995f8740 1 -- 172.21.15.50:0/67015125 >> 172.21.15.50:0/67015125 conn(0x563d5453e320 msgr2=0x563d5453f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.648+0000 7f4e995f8740 1 -- 172.21.15.50:0/67015125 shutdown_connections 2024-09-11T22:12:55.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.648+0000 7f4e995f8740 1 -- 172.21.15.50:0/67015125 wait complete. 2024-09-11T22:12:55.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.648+0000 7f4e995f8740 1 -- start start 2024-09-11T22:12:55.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.648+0000 7f4e995f8740 1 Processor -- start 2024-09-11T22:12:55.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e995f8740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54540b60 0x563d54602650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e995f8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 0x563d545a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e995f8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54564760 0x563d545a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e995f8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e900cc4c0 con 0x563d54564760 2024-09-11T22:12:55.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e995f8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563d5455b140 con 0x563d545422f0 2024-09-11T22:12:55.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e995f8740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563d54564370 con 0x563d54540b60 2024-09-11T22:12:55.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e995f8740 10 client.0 _ll_register_callbacks cb 0x7f4e84084070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:55.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e94dfb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54564760 0x563d545a8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e94dfb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54564760 0x563d545a8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40060/0 (socket says 172.21.15.50:40060) 2024-09-11T22:12:55.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e94dfb640 1 -- 172.21.15.50:0/3353321926 learned_addr learned my addr 172.21.15.50:0/3353321926 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/3353321926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54540b60 0x563d54602650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e8f7fe640 1 --2- 172.21.15.50:0/3353321926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 0x563d545a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e94dfb640 1 -- 172.21.15.50:0/3353321926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54540b60 msgr2=0x563d54602650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.649+0000 7f4e94dfb640 1 --2- 172.21.15.50:0/3353321926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54540b60 0x563d54602650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e94dfb640 1 -- 172.21.15.50:0/3353321926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 msgr2=0x563d545a8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e94dfb640 1 --2- 172.21.15.50:0/3353321926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 0x563d545a8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e94dfb640 1 -- 172.21.15.50:0/3353321926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d5455af30 con 0x563d54564760 2024-09-11T22:12:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e94dfb640 1 --2- 172.21.15.50:0/3353321926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54564760 0x563d545a8fd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4e88003fd0 tx=0x7f4e88001c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf64891505734c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e6effd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:12:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e6effd640 1 -- 172.21.15.50:0/3353321926 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e88006d60 con 0x563d54564760 2024-09-11T22:12:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e6effd640 1 -- 172.21.15.50:0/3353321926 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4e8801c8a0 con 0x563d54564760 2024-09-11T22:12:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e995f8740 1 -- 172.21.15.50:0/3353321926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e80052030 con 0x563d54564760 2024-09-11T22:12:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e6effd640 1 -- 172.21.15.50:0/3353321926 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f4e88027050 con 0x563d54564760 2024-09-11T22:12:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e995f8740 10 client.5064 fetch_fsmap learned FSMap version 15 2024-09-11T22:12:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e995f8740 1 -- 172.21.15.50:0/3353321926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x563d545631b0 con 0x563d54564760 2024-09-11T22:12:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e6effd640 1 -- 172.21.15.50:0/3353321926 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e80052030 con 0x563d54564760 2024-09-11T22:12:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e6effd640 1 -- 172.21.15.50:0/3353321926 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f4e8801cae0 con 0x563d54564760 2024-09-11T22:12:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e995f8740 10 client.5064 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T22:12:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e995f8740 10 client.5064 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-11T22:12:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e995f8740 20 client.5064 populate_metadata read hostname 'smithi050' 2024-09-11T22:12:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e995f8740 1 --2- 172.21.15.50:0/3353321926 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x563d54567b80 0x563d54566940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e995f8740 4 client.5064 mds_command: new command op to 4815 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-09-11T22:12:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e995f8740 1 -- 172.21.15.50:0/3353321926 --> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) -- 0x563d544ab400 con 0x563d54567b80 2024-09-11T22:12:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.650+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/3353321926 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x563d54567b80 0x563d54566940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.651+0000 7f4e6effd640 10 client.5064 ms_handle_connect on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.651+0000 7f4e8ffff640 1 --2- 172.21.15.50:0/3353321926 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x563d54567b80 0x563d54566940 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d29ccee51f3a802 server_cookie=5385683e68e979d6 in_seq=0 out_seq=0 2024-09-11T22:12:55.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e6effd640 1 -- 172.21.15.50:0/3353321926 <== mds.0 v2:172.21.15.50:6832/900288576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563d544ab400 con 0x563d54567b80 2024-09-11T22:12:55.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e6effd640 10 client.5064 handle_command_reply: tid=0 2024-09-11T22:12:55.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e995f8740 1 client.5064 shutdown 2024-09-11T22:12:55.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e995f8740 1 -- 172.21.15.50:0/3353321926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54564760 msgr2=0x563d545a8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e995f8740 1 --2- 172.21.15.50:0/3353321926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54564760 0x563d545a8fd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4e88003fd0 tx=0x7f4e88001c50 comp rx=0 tx=0).stop 2024-09-11T22:12:55.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e995f8740 1 -- 172.21.15.50:0/3353321926 shutdown_connections 2024-09-11T22:12:55.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e995f8740 1 --2- 172.21.15.50:0/3353321926 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x563d54567b80 0x563d54566940 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e995f8740 1 --2- 172.21.15.50:0/3353321926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d54564760 0x563d545a8fd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e995f8740 1 --2- 172.21.15.50:0/3353321926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d545422f0 0x563d545a8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e995f8740 1 --2- 172.21.15.50:0/3353321926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563d54540b60 0x563d54602650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e6effd640 0 client.5064 ms_handle_reset on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:55.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e995f8740 1 -- 172.21.15.50:0/3353321926 >> 172.21.15.50:0/3353321926 conn(0x563d5453e320 msgr2=0x563d5456ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e995f8740 1 -- 172.21.15.50:0/3353321926 shutdown_connections 2024-09-11T22:12:55.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e995f8740 1 -- 172.21.15.50:0/3353321926 wait complete. 2024-09-11T22:12:55.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.657+0000 7f4e995f8740 20 client.5064 trim_cache size 0 max 16384 2024-09-11T22:12:55.659 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:12:55.659 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:12:55.659 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "a76d8149-b54b-42fc-9ad1-917703b936ab", 2024-09-11T22:12:55.659 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:12:55.659 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:12:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.658+0000 7f4e9685e640 1 -- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e7c06be30 msgr2=0x7f4e7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.658+0000 7f4e9685e640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e7c06be30 0x7f4e7c06e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4e80034000 tx=0x7f4e8002e000 comp rx=0 tx=0).stop 2024-09-11T22:12:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.658+0000 7f4e9685e640 1 -- 172.21.15.50:0/3779581149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e9015e8e0 msgr2=0x7f4e9015de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.658+0000 7f4e9685e640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e9015e8e0 0x7f4e9015de10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4e84000fd0 tx=0x7f4e8400cbe0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.658+0000 7f4e9685e640 1 -- 172.21.15.50:0/3779581149 shutdown_connections 2024-09-11T22:12:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.658+0000 7f4e9685e640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e7c06be30 0x7f4e7c06e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.658+0000 7f4e9685e640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e90162350 0x7f4e901553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.658+0000 7f4e9685e640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e9015e8e0 0x7f4e9015de10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.658+0000 7f4e9685e640 1 --2- 172.21.15.50:0/3779581149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900d1580 0x7f4e9015d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.658+0000 7f4e9685e640 1 -- 172.21.15.50:0/3779581149 >> 172.21.15.50:0/3779581149 conn(0x7f4e90067ba0 msgr2=0x7f4e90067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.658+0000 7f4e9685e640 1 -- 172.21.15.50:0/3779581149 shutdown_connections 2024-09-11T22:12:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.658+0000 7f4e9685e640 1 -- 172.21.15.50:0/3779581149 wait complete. 2024-09-11T22:12:55.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:12:55.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-11T22:12:55.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.793+0000 7f6be84d0640 1 Processor -- start 2024-09-11T22:12:55.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.793+0000 7f6be84d0640 1 -- start start 2024-09-11T22:12:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.794+0000 7f6be84d0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6be015b580 0x7f6be00b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.794+0000 7f6be84d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6be00b2de0 0x7f6be006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.794+0000 7f6be84d0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be00b6ae0 con 0x7f6be015b1a0 2024-09-11T22:12:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.794+0000 7f6be84d0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6be00b2320 con 0x7f6be015b580 2024-09-11T22:12:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.794+0000 7f6be84d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6be00b2600 con 0x7f6be00b2de0 2024-09-11T22:12:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.794+0000 7f6be626c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6be015b1a0 0x7f6be00b3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52524/0 (socket says 172.21.15.50:52524) 2024-09-11T22:12:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.794+0000 7f6be626c640 1 -- 172.21.15.50:0/3755300503 learned_addr learned my addr 172.21.15.50:0/3755300503 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:12:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.794+0000 7f6be6a6d640 1 --2- 172.21.15.50:0/3755300503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6be00b2de0 0x7f6be006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.795+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/3755300503 >> v2:172.21.15.77:3300/0 conn(0x7f6be015b580 0x7f6be00b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.795+0000 7f6be6a6d640 1 -- 172.21.15.50:0/3755300503 >> v2:172.21.15.77:3300/0 conn(0x7f6be015b580 msgr2=0x7f6be00b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.795+0000 7f6be6a6d640 1 --2- 172.21.15.50:0/3755300503 >> v2:172.21.15.77:3300/0 conn(0x7f6be015b580 0x7f6be00b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.795+0000 7f6be6a6d640 1 -- 172.21.15.50:0/3755300503 >> v1:172.21.15.50:6789/0 conn(0x7f6be015b1a0 legacy=0x7f6be00b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.795+0000 7f6be526a640 1 -- 172.21.15.50:0/3755300503 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3792696035 0 0) 0x7f6bdc001110 con 0x7f6be015b1a0 2024-09-11T22:12:55.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.795+0000 7f6be6a6d640 1 -- 172.21.15.50:0/3755300503 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be00b28e0 con 0x7f6be00b2de0 2024-09-11T22:12:55.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.796+0000 7f6be6a6d640 1 --2- 172.21.15.50:0/3755300503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6be00b2de0 0x7f6be006e940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009d90 tx=0x7f6bd802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bb50a49a69a3c0f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.796+0000 7f6be526a640 1 -- 172.21.15.50:0/3755300503 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8007740 con 0x7f6be00b2de0 2024-09-11T22:12:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.796+0000 7f6be526a640 1 -- 172.21.15.50:0/3755300503 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd80078e0 con 0x7f6be00b2de0 2024-09-11T22:12:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.796+0000 7f6be526a640 1 -- 172.21.15.50:0/3755300503 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8007cb0 con 0x7f6be00b2de0 2024-09-11T22:12:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.797+0000 7f6be84d0640 1 -- 172.21.15.50:0/3755300503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6be00b2de0 msgr2=0x7f6be006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.797+0000 7f6be84d0640 1 --2- 172.21.15.50:0/3755300503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6be00b2de0 0x7f6be006e940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009d90 tx=0x7f6bd802a660 comp rx=0 tx=0).stop 2024-09-11T22:12:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.797+0000 7f6be84d0640 1 -- 172.21.15.50:0/3755300503 shutdown_connections 2024-09-11T22:12:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.797+0000 7f6be84d0640 1 --2- 172.21.15.50:0/3755300503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6be00b2de0 0x7f6be006e940 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.797+0000 7f6be84d0640 1 --2- 172.21.15.50:0/3755300503 >> v2:172.21.15.77:3300/0 conn(0x7f6be015b580 0x7f6be00b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.797+0000 7f6be84d0640 1 -- 172.21.15.50:0/3755300503 >> 172.21.15.50:0/3755300503 conn(0x7f6be006bb50 msgr2=0x7f6be006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.798+0000 7f6be84d0640 1 -- 172.21.15.50:0/3755300503 shutdown_connections 2024-09-11T22:12:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.798+0000 7f6be84d0640 1 -- 172.21.15.50:0/3755300503 wait complete. 2024-09-11T22:12:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.799+0000 7f6be84d0640 1 Processor -- start 2024-09-11T22:12:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.799+0000 7f6be84d0640 1 -- start start 2024-09-11T22:12:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.800+0000 7f6be84d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6be00b2de0 0x7f6be0150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.800+0000 7f6be84d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be015b1a0 0x7f6be0156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.800+0000 7f6be84d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be015b580 0x7f6be00d0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.800+0000 7f6be84d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6be00cf560 con 0x7f6be015b1a0 2024-09-11T22:12:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.800+0000 7f6be84d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6be006e420 con 0x7f6be015b580 2024-09-11T22:12:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.800+0000 7f6be84d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6be00b3fa0 con 0x7f6be00b2de0 2024-09-11T22:12:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.800+0000 7f6be5a6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be015b1a0 0x7f6be0156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.801+0000 7f6be5a6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be015b1a0 0x7f6be0156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40064/0 (socket says 172.21.15.50:40064) 2024-09-11T22:12:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.801+0000 7f6be5a6b640 1 -- 172.21.15.50:0/3191298264 learned_addr learned my addr 172.21.15.50:0/3191298264 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.801+0000 7f6be626c640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6be00b2de0 0x7f6be0150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.801+0000 7f6be6a6d640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be015b580 0x7f6be00d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.801+0000 7f6be5a6b640 1 -- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6be00b2de0 msgr2=0x7f6be0150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.801+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6be00b2de0 0x7f6be0150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.801+0000 7f6be5a6b640 1 -- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be015b580 msgr2=0x7f6be00d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.801+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be015b580 0x7f6be00d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.801+0000 7f6be5a6b640 1 -- 172.21.15.50:0/3191298264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be0152ed0 con 0x7f6be015b1a0 2024-09-11T22:12:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.801+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be015b1a0 0x7f6be0156980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000e8a0 tx=0x7f6bd000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.801+0000 7f6bd6ffd640 1 -- 172.21.15.50:0/3191298264 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0017070 con 0x7f6be015b1a0 2024-09-11T22:12:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.802+0000 7f6bd6ffd640 1 -- 172.21.15.50:0/3191298264 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd000c940 con 0x7f6be015b1a0 2024-09-11T22:12:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.802+0000 7f6be84d0640 1 -- 172.21.15.50:0/3191298264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be01531b0 con 0x7f6be015b1a0 2024-09-11T22:12:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.802+0000 7f6bd6ffd640 1 -- 172.21.15.50:0/3191298264 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000cd30 con 0x7f6be015b1a0 2024-09-11T22:12:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.802+0000 7f6be84d0640 1 -- 172.21.15.50:0/3191298264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be0153770 con 0x7f6be015b1a0 2024-09-11T22:12:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.804+0000 7f6bd6ffd640 1 -- 172.21.15.50:0/3191298264 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bd001a070 con 0x7f6be015b1a0 2024-09-11T22:12:55.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.804+0000 7f6bd6ffd640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6bc406be30 0x7f6bc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.805+0000 7f6bd6ffd640 1 -- 172.21.15.50:0/3191298264 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6bd008b080 con 0x7f6be015b1a0 2024-09-11T22:12:55.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.805+0000 7f6be626c640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6bc406be30 0x7f6bc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.806+0000 7f6beb269740 1 Processor -- start 2024-09-11T22:12:55.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.806+0000 7f6be626c640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6bc406be30 0x7f6bc406e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc000f60 tx=0x7f6bdc007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.806+0000 7f6beb269740 1 -- start start 2024-09-11T22:12:55.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.807+0000 7f6beb269740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0bda0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.807+0000 7f6beb269740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b920e0 0x55dbf0b94d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.807+0000 7f6beb269740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b960b0 0x55dbf0b8f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.807+0000 7f6beb269740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dbf0af76f0 con 0x55dbf0b920e0 2024-09-11T22:12:55.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.807+0000 7f6beb269740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dbf0a9f330 con 0x55dbf0b960b0 2024-09-11T22:12:55.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.807+0000 7f6beb269740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dbf0af36b0 con 0x55dbf0b94920 2024-09-11T22:12:55.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.807+0000 7f6be5a6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b920e0 0x55dbf0b94d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.807+0000 7f6be6a6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b960b0 0x55dbf0b8f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.807+0000 7f6be5a6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b920e0 0x55dbf0b94d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40080/0 (socket says 172.21.15.50:40080) 2024-09-11T22:12:55.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.807+0000 7f6be5a6b640 1 -- 172.21.15.50:0/1985181277 learned_addr learned my addr 172.21.15.50:0/1985181277 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.807+0000 7f6be6a6d640 1 -- 172.21.15.50:0/1985181277 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 msgr2=0x55dbf0bda0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.808+0000 7f6be626c640 1 --2- 172.21.15.50:0/1985181277 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0bda0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.808+0000 7f6be6a6d640 1 --2- 172.21.15.50:0/1985181277 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0bda0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.808+0000 7f6be6a6d640 1 -- 172.21.15.50:0/1985181277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b920e0 msgr2=0x55dbf0b94d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.808+0000 7f6be6a6d640 1 --2- 172.21.15.50:0/1985181277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b920e0 0x55dbf0b94d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.808+0000 7f6be6a6d640 1 -- 172.21.15.50:0/1985181277 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf0ac50d0 con 0x55dbf0b960b0 2024-09-11T22:12:55.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.808+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/1985181277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b920e0 0x55dbf0b94d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:55.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.809+0000 7f6be6a6d640 1 --2- 172.21.15.50:0/1985181277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b960b0 0x55dbf0b8f1a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6be00b2780 tx=0x7f6bd802e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49b5845b31342582 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.809+0000 7f6bc3fff640 1 -- 172.21.15.50:0/1985181277 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80078c0 con 0x55dbf0b960b0 2024-09-11T22:12:55.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.809+0000 7f6bc3fff640 1 -- 172.21.15.50:0/1985181277 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd8007a60 con 0x55dbf0b960b0 2024-09-11T22:12:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.809+0000 7f6bc3fff640 1 -- 172.21.15.50:0/1985181277 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8007e50 con 0x55dbf0b960b0 2024-09-11T22:12:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.810+0000 7f6beb269740 1 -- 172.21.15.50:0/1985181277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b960b0 msgr2=0x55dbf0b8f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.810+0000 7f6beb269740 1 --2- 172.21.15.50:0/1985181277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b960b0 0x55dbf0b8f1a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6be00b2780 tx=0x7f6bd802e000 comp rx=0 tx=0).stop 2024-09-11T22:12:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.810+0000 7f6beb269740 1 -- 172.21.15.50:0/1985181277 shutdown_connections 2024-09-11T22:12:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.810+0000 7f6beb269740 1 --2- 172.21.15.50:0/1985181277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b960b0 0x55dbf0b8f1a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.810+0000 7f6beb269740 1 --2- 172.21.15.50:0/1985181277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b920e0 0x55dbf0b94d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.810+0000 7f6beb269740 1 --2- 172.21.15.50:0/1985181277 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0bda0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.810+0000 7f6beb269740 1 -- 172.21.15.50:0/1985181277 >> 172.21.15.50:0/1985181277 conn(0x55dbf0b91370 msgr2=0x55dbf0bd9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.810+0000 7f6beb269740 1 -- 172.21.15.50:0/1985181277 shutdown_connections 2024-09-11T22:12:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.810+0000 7f6beb269740 1 -- 172.21.15.50:0/1985181277 wait complete. 2024-09-11T22:12:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.810+0000 7f6beb269740 1 -- start start 2024-09-11T22:12:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.810+0000 7f6beb269740 1 Processor -- start 2024-09-11T22:12:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.811+0000 7f6beb269740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0b8fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.811+0000 7f6beb269740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b960b0 0x55dbf0bb3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6beb269740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0bb94d0 0x55dbf0bb9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6beb269740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dbf0b90810 con 0x55dbf0b960b0 2024-09-11T22:12:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6beb269740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dbf0a804f0 con 0x55dbf0bb94d0 2024-09-11T22:12:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6beb269740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dbf0bda8f0 con 0x55dbf0b94920 2024-09-11T22:12:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6be626c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0b8fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6beb269740 10 client.0 _ll_register_callbacks cb 0x55dbf0aa1b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6be626c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0b8fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:37180/0 (socket says 172.21.15.50:37180) 2024-09-11T22:12:55.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6be626c640 1 -- 172.21.15.50:0/2386607156 learned_addr learned my addr 172.21.15.50:0/2386607156 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b960b0 0x55dbf0bb3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6be6a6d640 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0bb94d0 0x55dbf0bb9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6be626c640 1 -- 172.21.15.50:0/2386607156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0bb94d0 msgr2=0x55dbf0bb9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6be626c640 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0bb94d0 0x55dbf0bb9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6be626c640 1 -- 172.21.15.50:0/2386607156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b960b0 msgr2=0x55dbf0bb3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6be626c640 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b960b0 0x55dbf0bb3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6be626c640 1 -- 172.21.15.50:0/2386607156 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55dbf08d47d0 con 0x55dbf0b94920 2024-09-11T22:12:55.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.812+0000 7f6be6a6d640 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0bb94d0 0x55dbf0bb9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:12:55.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.813+0000 7f6be626c640 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0b8fe40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0136a0 tx=0x7f6bdc000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63d6693493d1f554 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.813+0000 7f6bc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3301/0 2024-09-11T22:12:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.813+0000 7f6bc17fa640 1 -- 172.21.15.50:0/2386607156 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc026060 con 0x55dbf0b94920 2024-09-11T22:12:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.813+0000 7f6bc17fa640 1 -- 172.21.15.50:0/2386607156 <== mon.2 v2:172.21.15.77:3301/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6bdc021aa0 con 0x55dbf0b94920 2024-09-11T22:12:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.813+0000 7f6beb269740 1 -- 172.21.15.50:0/2386607156 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd8007a60 con 0x55dbf0b94920 2024-09-11T22:12:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.813+0000 7f6bc17fa640 1 -- 172.21.15.50:0/2386607156 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f6bdc019070 con 0x55dbf0b94920 2024-09-11T22:12:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.813+0000 7f6beb269740 10 client.4739 fetch_fsmap learned FSMap version 15 2024-09-11T22:12:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.813+0000 7f6beb269740 1 -- 172.21.15.50:0/2386607156 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55dbf080a3f0 con 0x55dbf0b94920 2024-09-11T22:12:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.814+0000 7f6bc17fa640 1 -- 172.21.15.50:0/2386607156 <== mon.2 v2:172.21.15.77:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd8007a60 con 0x55dbf0b94920 2024-09-11T22:12:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.814+0000 7f6bc17fa640 1 -- 172.21.15.50:0/2386607156 <== mon.2 v2:172.21.15.77:3301/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f6bdc01f070 con 0x55dbf0b94920 2024-09-11T22:12:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.814+0000 7f6beb269740 10 client.4739 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T22:12:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.814+0000 7f6beb269740 10 client.4739 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-11T22:12:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.814+0000 7f6beb269740 20 client.4739 populate_metadata read hostname 'smithi050' 2024-09-11T22:12:55.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.814+0000 7f6beb269740 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55dbf0b8eb50 0x55dbf0b8ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.814+0000 7f6beb269740 4 client.4739 mds_command: new command op to 4815 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:12:55.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.814+0000 7f6beb269740 1 -- 172.21.15.50:0/2386607156 --> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbf0b04e20 con 0x55dbf0b8eb50 2024-09-11T22:12:55.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.815+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55dbf0b8eb50 0x55dbf0b8ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.815+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55dbf0b8eb50 0x55dbf0b8ef50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efef429e4a442591 server_cookie=63581c5e4dfdfb51 in_seq=0 out_seq=0 2024-09-11T22:12:55.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.815+0000 7f6bc17fa640 10 client.4739 ms_handle_connect on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.816+0000 7f6bc17fa640 1 -- 172.21.15.50:0/2386607156 <== mds.0 v2:172.21.15.50:6832/900288576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dbf0b04e20 con 0x55dbf0b8eb50 2024-09-11T22:12:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.816+0000 7f6bc17fa640 10 client.4739 handle_command_reply: tid=0 2024-09-11T22:12:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.816+0000 7f6beb269740 1 client.4739 shutdown 2024-09-11T22:12:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.816+0000 7f6beb269740 1 -- 172.21.15.50:0/2386607156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 msgr2=0x55dbf0b8fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.816+0000 7f6beb269740 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0b8fe40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0136a0 tx=0x7f6bdc000ed0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.817+0000 7f6beb269740 1 -- 172.21.15.50:0/2386607156 shutdown_connections 2024-09-11T22:12:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.817+0000 7f6beb269740 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55dbf0b8eb50 0x55dbf0b8ef50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.817+0000 7f6beb269740 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0bb94d0 0x55dbf0bb9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.817+0000 7f6bc17fa640 0 client.4739 ms_handle_reset on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:55.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.817+0000 7f6beb269740 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b960b0 0x55dbf0bb3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.817+0000 7f6beb269740 1 --2- 172.21.15.50:0/2386607156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0b8fe40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.817+0000 7f6beb269740 1 -- 172.21.15.50:0/2386607156 >> 172.21.15.50:0/2386607156 conn(0x55dbf0b920e0 msgr2=0x55dbf0bdb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.817+0000 7f6beb269740 1 -- 172.21.15.50:0/2386607156 shutdown_connections 2024-09-11T22:12:55.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.817+0000 7f6beb269740 1 -- 172.21.15.50:0/2386607156 wait complete. 2024-09-11T22:12:55.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.817+0000 7f6beb269740 20 client.4739 trim_cache size 0 max 16384 2024-09-11T22:12:55.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.845+0000 7f6beb269740 1 Processor -- start 2024-09-11T22:12:55.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.845+0000 7f6beb269740 1 -- start start 2024-09-11T22:12:55.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.846+0000 7f6beb269740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b8eb50 0x55dbf0bb2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.846+0000 7f6beb269740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0b8f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.846+0000 7f6beb269740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b960b0 0x55dbf0b8ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.846+0000 7f6beb269740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0205140 con 0x55dbf0b8eb50 2024-09-11T22:12:55.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.846+0000 7f6beb269740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6be02041a0 con 0x55dbf0b960b0 2024-09-11T22:12:55.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.846+0000 7f6beb269740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6be015c3b0 con 0x55dbf0b94920 2024-09-11T22:12:55.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.846+0000 7f6be6a6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b960b0 0x55dbf0b8ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.846+0000 7f6be6a6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b960b0 0x55dbf0b8ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:59802/0 (socket says 172.21.15.50:59802) 2024-09-11T22:12:55.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.846+0000 7f6be6a6d640 1 -- 172.21.15.50:0/3234751848 learned_addr learned my addr 172.21.15.50:0/3234751848 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.846+0000 7f6be626c640 1 --2- 172.21.15.50:0/3234751848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b8eb50 0x55dbf0bb2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.846+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/3234751848 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0b8f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.847+0000 7f6be5a6b640 1 -- 172.21.15.50:0/3234751848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b960b0 msgr2=0x55dbf0b8ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.847+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/3234751848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b960b0 0x55dbf0b8ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.847+0000 7f6be5a6b640 1 -- 172.21.15.50:0/3234751848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b8eb50 msgr2=0x55dbf0bb2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.847+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/3234751848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b8eb50 0x55dbf0bb2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.847+0000 7f6be5a6b640 1 -- 172.21.15.50:0/3234751848 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf0bb9cc0 con 0x55dbf0b94920 2024-09-11T22:12:55.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.847+0000 7f6be626c640 1 --2- 172.21.15.50:0/3234751848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b8eb50 0x55dbf0bb2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:12:55.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.847+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/3234751848 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0b8f9e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00592d0 tx=0x7f6bd0089460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e60ce7fe9a76092d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.847+0000 7f6bc37fe640 1 -- 172.21.15.50:0/3234751848 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0021040 con 0x55dbf0b94920 2024-09-11T22:12:55.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.847+0000 7f6bc37fe640 1 -- 172.21.15.50:0/3234751848 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd0057640 con 0x55dbf0b94920 2024-09-11T22:12:55.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.847+0000 7f6bc37fe640 1 -- 172.21.15.50:0/3234751848 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00559b0 con 0x55dbf0b94920 2024-09-11T22:12:55.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.848+0000 7f6beb269740 1 -- 172.21.15.50:0/3234751848 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 msgr2=0x55dbf0b8f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.848+0000 7f6beb269740 1 --2- 172.21.15.50:0/3234751848 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0b8f9e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00592d0 tx=0x7f6bd0089460 comp rx=0 tx=0).stop 2024-09-11T22:12:55.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.848+0000 7f6beb269740 1 -- 172.21.15.50:0/3234751848 shutdown_connections 2024-09-11T22:12:55.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.848+0000 7f6beb269740 1 --2- 172.21.15.50:0/3234751848 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b94920 0x55dbf0b8f9e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.848+0000 7f6beb269740 1 --2- 172.21.15.50:0/3234751848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b960b0 0x55dbf0b8ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.848+0000 7f6beb269740 1 --2- 172.21.15.50:0/3234751848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b8eb50 0x55dbf0bb2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.848+0000 7f6beb269740 1 -- 172.21.15.50:0/3234751848 >> 172.21.15.50:0/3234751848 conn(0x55dbf0b920e0 msgr2=0x55dbf0bd9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.848+0000 7f6beb269740 1 -- 172.21.15.50:0/3234751848 shutdown_connections 2024-09-11T22:12:55.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.848+0000 7f6beb269740 1 -- 172.21.15.50:0/3234751848 wait complete. 2024-09-11T22:12:55.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.849+0000 7f6beb269740 1 -- start start 2024-09-11T22:12:55.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.849+0000 7f6beb269740 1 Processor -- start 2024-09-11T22:12:55.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.851+0000 7f6beb269740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b8eb50 0x55dbf0bf3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.851+0000 7f6beb269740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b94920 0x55dbf0bbc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.851+0000 7f6beb269740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b960b0 0x55dbf0bb2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.851+0000 7f6beb269740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dbf0bb3f00 con 0x55dbf0b8eb50 2024-09-11T22:12:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.851+0000 7f6beb269740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6be015ca00 con 0x55dbf0b94920 2024-09-11T22:12:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.851+0000 7f6be5a6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b94920 0x55dbf0bbc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.851+0000 7f6beb269740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dbf0b04e20 con 0x55dbf0b960b0 2024-09-11T22:12:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.852+0000 7f6beb269740 10 client.0 _ll_register_callbacks cb 0x7f6bdc004920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:12:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.852+0000 7f6be5a6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b94920 0x55dbf0bbc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:59814/0 (socket says 172.21.15.50:59814) 2024-09-11T22:12:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.852+0000 7f6be5a6b640 1 -- 172.21.15.50:0/1659931688 learned_addr learned my addr 172.21.15.50:0/1659931688 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:12:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.852+0000 7f6be6a6d640 1 --2- 172.21.15.50:0/1659931688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b960b0 0x55dbf0bb2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.852+0000 7f6be5a6b640 1 -- 172.21.15.50:0/1659931688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b960b0 msgr2=0x55dbf0bb2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.852+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/1659931688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b960b0 0x55dbf0bb2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.852+0000 7f6be5a6b640 1 -- 172.21.15.50:0/1659931688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b8eb50 msgr2=0x55dbf0bf3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:12:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.852+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/1659931688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b8eb50 0x55dbf0bf3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.852+0000 7f6be5a6b640 1 -- 172.21.15.50:0/1659931688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbf0b95070 con 0x55dbf0b94920 2024-09-11T22:12:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.852+0000 7f6be5a6b640 1 --2- 172.21.15.50:0/1659931688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b94920 0x55dbf0bbc290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000e870 tx=0x7f6bd0078040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4b6a8e0b53bc131 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:12:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.852+0000 7f6bc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-11T22:12:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6bc17fa640 1 -- 172.21.15.50:0/1659931688 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0087060 con 0x55dbf0b94920 2024-09-11T22:12:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6bc17fa640 1 -- 172.21.15.50:0/1659931688 <== mon.1 v2:172.21.15.77:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6bd005d120 con 0x55dbf0b94920 2024-09-11T22:12:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6beb269740 1 -- 172.21.15.50:0/1659931688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd0057640 con 0x55dbf0b94920 2024-09-11T22:12:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6bc17fa640 1 -- 172.21.15.50:0/1659931688 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f6bd0021070 con 0x55dbf0b94920 2024-09-11T22:12:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6beb269740 10 client.4885 fetch_fsmap learned FSMap version 15 2024-09-11T22:12:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6beb269740 1 -- 172.21.15.50:0/1659931688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55dbf07ca0f0 con 0x55dbf0b94920 2024-09-11T22:12:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6bc17fa640 1 -- 172.21.15.50:0/1659931688 <== mon.1 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd0057640 con 0x55dbf0b94920 2024-09-11T22:12:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6bc17fa640 1 -- 172.21.15.50:0/1659931688 <== mon.1 v2:172.21.15.77:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f6bd0058790 con 0x55dbf0b94920 2024-09-11T22:12:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6beb269740 10 client.4885 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T22:12:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6beb269740 10 client.4885 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-11T22:12:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6beb269740 20 client.4885 populate_metadata read hostname 'smithi050' 2024-09-11T22:12:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6beb269740 1 --2- 172.21.15.50:0/1659931688 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55dbf0bb94d0 0x55dbf0bb3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:12:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6beb269740 4 client.4885 mds_command: new command op to 4815 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:12:55.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6be626c640 1 --2- 172.21.15.50:0/1659931688 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55dbf0bb94d0 0x55dbf0bb3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:12:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.853+0000 7f6beb269740 1 -- 172.21.15.50:0/1659931688 --> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dbf0aff170 con 0x55dbf0bb94d0 2024-09-11T22:12:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.854+0000 7f6be626c640 1 --2- 172.21.15.50:0/1659931688 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55dbf0bb94d0 0x55dbf0bb3490 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e64148a6f7103398 server_cookie=2ccd07335df420a4 in_seq=0 out_seq=0 2024-09-11T22:12:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.854+0000 7f6bc17fa640 10 client.4885 ms_handle_connect on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6bc17fa640 1 -- 172.21.15.50:0/1659931688 <== mds.0 v2:172.21.15.50:6832/900288576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+274 (crc 0 0 0) 0x55dbf0aff170 con 0x55dbf0bb94d0 2024-09-11T22:12:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6bc17fa640 10 client.4885 handle_command_reply: tid=0 2024-09-11T22:12:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6beb269740 1 client.4885 shutdown 2024-09-11T22:12:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6beb269740 1 -- 172.21.15.50:0/1659931688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b94920 msgr2=0x55dbf0bbc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6beb269740 1 --2- 172.21.15.50:0/1659931688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b94920 0x55dbf0bbc290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000e870 tx=0x7f6bd0078040 comp rx=0 tx=0).stop 2024-09-11T22:12:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6beb269740 1 -- 172.21.15.50:0/1659931688 shutdown_connections 2024-09-11T22:12:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6beb269740 1 --2- 172.21.15.50:0/1659931688 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55dbf0bb94d0 0x55dbf0bb3490 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6beb269740 1 --2- 172.21.15.50:0/1659931688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dbf0b960b0 0x55dbf0bb2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6bc17fa640 0 client.4885 ms_handle_reset on v2:172.21.15.50:6832/900288576 2024-09-11T22:12:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6beb269740 1 --2- 172.21.15.50:0/1659931688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbf0b94920 0x55dbf0bbc290 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6beb269740 1 --2- 172.21.15.50:0/1659931688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dbf0b8eb50 0x55dbf0bf3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6beb269740 1 -- 172.21.15.50:0/1659931688 >> 172.21.15.50:0/1659931688 conn(0x55dbf0b920e0 msgr2=0x55dbf0bb4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6beb269740 1 -- 172.21.15.50:0/1659931688 shutdown_connections 2024-09-11T22:12:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6beb269740 1 -- 172.21.15.50:0/1659931688 wait complete. 2024-09-11T22:12:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.855+0000 7f6beb269740 20 client.4885 trim_cache size 0 max 16384 2024-09-11T22:12:55.861 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:12:55.862 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "scrub active (570 inodes in the stack)", 2024-09-11T22:12:55.862 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-11T22:12:55.862 INFO:teuthology.orchestra.run.smithi050.stdout: "a76d8149-b54b-42fc-9ad1-917703b936ab": { 2024-09-11T22:12:55.862 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-11T22:12:55.862 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "a76d8149-b54b-42fc-9ad1-917703b936ab", 2024-09-11T22:12:55.862 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,scrub_mdsdir" 2024-09-11T22:12:55.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:12:55.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:12:55.862 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:12:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.856+0000 7f6be84d0640 1 -- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6bc406be30 msgr2=0x7f6bc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.856+0000 7f6be84d0640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6bc406be30 0x7f6bc406e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc000f60 tx=0x7f6bdc007b50 comp rx=0 tx=0).stop 2024-09-11T22:12:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.856+0000 7f6be84d0640 1 -- 172.21.15.50:0/3191298264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be015b1a0 msgr2=0x7f6be0156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:12:55.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.856+0000 7f6be84d0640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be015b1a0 0x7f6be0156980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000e8a0 tx=0x7f6bd000ed60 comp rx=0 tx=0).stop 2024-09-11T22:12:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.856+0000 7f6be84d0640 1 -- 172.21.15.50:0/3191298264 shutdown_connections 2024-09-11T22:12:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.856+0000 7f6be84d0640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6bc406be30 0x7f6bc406e2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.856+0000 7f6be84d0640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be015b580 0x7f6be00d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.856+0000 7f6be84d0640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6be015b1a0 0x7f6be0156980 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.856+0000 7f6be84d0640 1 --2- 172.21.15.50:0/3191298264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6be00b2de0 0x7f6be0150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:12:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.856+0000 7f6be84d0640 1 -- 172.21.15.50:0/3191298264 >> 172.21.15.50:0/3191298264 conn(0x7f6be006bb50 msgr2=0x7f6be01511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:12:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.857+0000 7f6be84d0640 1 -- 172.21.15.50:0/3191298264 shutdown_connections 2024-09-11T22:12:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:12:55.857+0000 7f6be84d0640 1 -- 172.21.15.50:0/3191298264 wait complete. 2024-09-11T22:12:55.871 INFO:tasks.cephfs.filesystem:scrub status for tag:a76d8149-b54b-42fc-9ad1-917703b936ab - {'path': '/', 'tag': 'a76d8149-b54b-42fc-9ad1-917703b936ab', 'options': 'recursive,scrub_mdsdir'} 2024-09-11T22:13:12.251 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:13:12.255 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:13:25.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:25.872 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-11T22:13:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.989+0000 7f27320ac640 1 Processor -- start 2024-09-11T22:13:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.989+0000 7f27320ac640 1 -- start start 2024-09-11T22:13:25.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.990+0000 7f27320ac640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f272c15f350 0x7f272c15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:25.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.990+0000 7f27320ac640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f272c15f7f0 con 0x7f272c0679c0 2024-09-11T22:13:25.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.990+0000 7f27320ac640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f272c15fad0 con 0x7f272c15c3c0 2024-09-11T22:13:25.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.990+0000 7f27320ac640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f272c06e700 con 0x7f272c15f350 2024-09-11T22:13:25.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.990+0000 7f272bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f272c0679c0 0x7f272c06f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39886/0 (socket says 172.21.15.50:39886) 2024-09-11T22:13:25.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.990+0000 7f272bfff640 1 -- 172.21.15.50:0/1481377069 learned_addr learned my addr 172.21.15.50:0/1481377069 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272affd640 1 --2- 172.21.15.50:0/1481377069 >> v2:172.21.15.77:3300/0 conn(0x7f272c15f350 0x7f272c15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3644580109 0 0) 0x7f272c15f7f0 con 0x7f272c0679c0 2024-09-11T22:13:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2714003520 con 0x7f272c0679c0 2024-09-11T22:13:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 164117313 0 0) 0x7f2714003520 con 0x7f272c0679c0 2024-09-11T22:13:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 >> v2:172.21.15.77:3300/0 conn(0x7f272c15f350 msgr2=0x7f272c15fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 --2- 172.21.15.50:0/1481377069 >> v2:172.21.15.77:3300/0 conn(0x7f272c15f350 0x7f272c15fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 >> v1:172.21.15.77:6789/0 conn(0x7f272c15c3c0 legacy=0x7f272c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272c06e950 con 0x7f272c0679c0 2024-09-11T22:13:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f27240019f0 con 0x7f272c0679c0 2024-09-11T22:13:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 >> v1:172.21.15.50:6789/0 conn(0x7f272c0679c0 legacy=0x7f272c06f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 --2- 172.21.15.50:0/1481377069 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27140039b0 0x7f2714003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 --2- 172.21.15.50:0/1481377069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2714004800 0x7f2714004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:25.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 --2- 172.21.15.50:0/1481377069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27140051c0 0x7f271400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f272c06e700 con 0x7f2714004800 2024-09-11T22:13:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f271400c160 con 0x7f27140051c0 2024-09-11T22:13:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f271400c360 con 0x7f27140039b0 2024-09-11T22:13:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272affd640 1 --2- 172.21.15.50:0/1481377069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2714004800 0x7f2714004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272b7fe640 1 --2- 172.21.15.50:0/1481377069 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27140039b0 0x7f2714003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.991+0000 7f272bfff640 1 --2- 172.21.15.50:0/1481377069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27140051c0 0x7f271400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.992+0000 7f272affd640 1 -- 172.21.15.50:0/1481377069 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27140039b0 msgr2=0x7f2714003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.992+0000 7f272affd640 1 --2- 172.21.15.50:0/1481377069 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27140039b0 0x7f2714003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.992+0000 7f272affd640 1 -- 172.21.15.50:0/1481377069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27140051c0 msgr2=0x7f271400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.992+0000 7f272affd640 1 --2- 172.21.15.50:0/1481377069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27140051c0 0x7f271400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.992+0000 7f272bfff640 1 -- 172.21.15.50:0/1481377069 reap_dead start 2024-09-11T22:13:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.992+0000 7f272affd640 1 -- 172.21.15.50:0/1481377069 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2714003520 con 0x7f2714004800 2024-09-11T22:13:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.992+0000 7f272affd640 1 --2- 172.21.15.50:0/1481377069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2714004800 0x7f2714004c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2720009a90 tx=0x7f2714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284b83834a20b97f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.993+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720036070 con 0x7f2714004800 2024-09-11T22:13:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.993+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2720031400 con 0x7f2714004800 2024-09-11T22:13:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.993+0000 7f272a7fc640 1 -- 172.21.15.50:0/1481377069 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720009690 con 0x7f2714004800 2024-09-11T22:13:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.993+0000 7f27320ac640 1 -- 172.21.15.50:0/1481377069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2714004800 msgr2=0x7f2714004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.993+0000 7f27320ac640 1 --2- 172.21.15.50:0/1481377069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2714004800 0x7f2714004c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2720009a90 tx=0x7f2714005830 comp rx=0 tx=0).stop 2024-09-11T22:13:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.993+0000 7f27320ac640 1 -- 172.21.15.50:0/1481377069 shutdown_connections 2024-09-11T22:13:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.993+0000 7f27320ac640 1 --2- 172.21.15.50:0/1481377069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2714004800 0x7f2714004c80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.993+0000 7f27320ac640 1 -- 172.21.15.50:0/1481377069 >> 172.21.15.50:0/1481377069 conn(0x7f272c075060 msgr2=0x7f272c06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.993+0000 7f27320ac640 1 -- 172.21.15.50:0/1481377069 shutdown_connections 2024-09-11T22:13:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.993+0000 7f27320ac640 1 -- 172.21.15.50:0/1481377069 wait complete. 2024-09-11T22:13:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.994+0000 7f27320ac640 1 Processor -- start 2024-09-11T22:13:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.995+0000 7f27320ac640 1 -- start start 2024-09-11T22:13:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.995+0000 7f27320ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2714004800 0x7f272c1e8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.995+0000 7f27320ac640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272c155560 0x7f272c157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.995+0000 7f27320ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f272c147ff0 0x7f272c0d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.995+0000 7f27320ac640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f272c15fe60 con 0x7f2714004800 2024-09-11T22:13:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.995+0000 7f27320ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f272c0d0940 con 0x7f272c147ff0 2024-09-11T22:13:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.995+0000 7f27320ac640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f272c15ffe0 con 0x7f272c155560 2024-09-11T22:13:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f272b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2714004800 0x7f272c1e8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f272b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2714004800 0x7f272c1e8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48604/0 (socket says 172.21.15.50:48604) 2024-09-11T22:13:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f272b7fe640 1 -- 172.21.15.50:0/1484361709 learned_addr learned my addr 172.21.15.50:0/1484361709 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f272bfff640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f272c147ff0 0x7f272c0d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f272affd640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272c155560 0x7f272c157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f272b7fe640 1 -- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272c155560 msgr2=0x7f272c157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f272b7fe640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272c155560 0x7f272c157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f272b7fe640 1 -- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f272c147ff0 msgr2=0x7f272c0d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f272b7fe640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f272c147ff0 0x7f272c0d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f272b7fe640 1 -- 172.21.15.50:0/1484361709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272c1e6f30 con 0x7f2714004800 2024-09-11T22:13:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f272bfff640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f272c147ff0 0x7f272c0d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f272affd640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272c155560 0x7f272c157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f272b7fe640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2714004800 0x7f272c1e8270 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f271c00f620 tx=0x7f271c00fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f2713fff640 1 -- 172.21.15.50:0/1484361709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c0052e0 con 0x7f2714004800 2024-09-11T22:13:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f2713fff640 1 -- 172.21.15.50:0/1484361709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c018070 con 0x7f2714004800 2024-09-11T22:13:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f27320ac640 1 -- 172.21.15.50:0/1484361709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f272c1e71d0 con 0x7f2714004800 2024-09-11T22:13:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f2713fff640 1 -- 172.21.15.50:0/1484361709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c003810 con 0x7f2714004800 2024-09-11T22:13:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.996+0000 7f27320ac640 1 -- 172.21.15.50:0/1484361709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f272c1e7790 con 0x7f2714004800 2024-09-11T22:13:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.998+0000 7f2713fff640 1 -- 172.21.15.50:0/1484361709 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f271c0039b0 con 0x7f2714004800 2024-09-11T22:13:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.998+0000 7f2713fff640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f271806be30 0x7f271806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.998+0000 7f2713fff640 1 -- 172.21.15.50:0/1484361709 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7f271c08ac80 con 0x7f2714004800 2024-09-11T22:13:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.999+0000 7f272affd640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f271806be30 0x7f271806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.999+0000 7f272affd640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f271806be30 0x7f271806e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2720033000 tx=0x7f2720008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.999+0000 7f2734e4d740 1 Processor -- start 2024-09-11T22:13:26.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:25.999+0000 7f2734e4d740 1 -- start start 2024-09-11T22:13:26.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.000+0000 7f2734e4d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefafb90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.000+0000 7f2734e4d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf710e0 0x55cefaf73d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.000+0000 7f2734e4d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefaf750b0 0x55cefaf6e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.000+0000 7f2734e4d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cefaed66f0 con 0x55cefaf73920 2024-09-11T22:13:26.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.000+0000 7f2734e4d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cefae7e330 con 0x55cefaf710e0 2024-09-11T22:13:26.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.000+0000 7f2734e4d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cefaed26b0 con 0x55cefaf750b0 2024-09-11T22:13:26.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.000+0000 7f272b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefafb90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.000+0000 7f272b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefafb90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48608/0 (socket says 172.21.15.50:48608) 2024-09-11T22:13:26.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.000+0000 7f272b7fe640 1 -- 172.21.15.50:0/4267147304 learned_addr learned my addr 172.21.15.50:0/4267147304 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.000+0000 7f272affd640 1 --2- 172.21.15.50:0/4267147304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf710e0 0x55cefaf73d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.001+0000 7f272bfff640 1 --2- 172.21.15.50:0/4267147304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefaf750b0 0x55cefaf6e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.001+0000 7f272b7fe640 1 -- 172.21.15.50:0/4267147304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefaf750b0 msgr2=0x55cefaf6e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.001+0000 7f272b7fe640 1 --2- 172.21.15.50:0/4267147304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefaf750b0 0x55cefaf6e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.001+0000 7f272b7fe640 1 -- 172.21.15.50:0/4267147304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf710e0 msgr2=0x55cefaf73d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.001+0000 7f272b7fe640 1 --2- 172.21.15.50:0/4267147304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf710e0 0x55cefaf73d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.001+0000 7f272b7fe640 1 -- 172.21.15.50:0/4267147304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cefaea40d0 con 0x55cefaf73920 2024-09-11T22:13:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.001+0000 7f272b7fe640 1 --2- 172.21.15.50:0/4267147304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefafb90c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f271c0050a0 tx=0x7f271c0588f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858c4d28660c1a17 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.001+0000 7f27117fa640 1 -- 172.21.15.50:0/4267147304 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c087070 con 0x55cefaf73920 2024-09-11T22:13:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.001+0000 7f27117fa640 1 -- 172.21.15.50:0/4267147304 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c05d2c0 con 0x55cefaf73920 2024-09-11T22:13:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.001+0000 7f27117fa640 1 -- 172.21.15.50:0/4267147304 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c061af0 con 0x55cefaf73920 2024-09-11T22:13:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.002+0000 7f2734e4d740 1 -- 172.21.15.50:0/4267147304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 msgr2=0x55cefafb90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.002+0000 7f2734e4d740 1 --2- 172.21.15.50:0/4267147304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefafb90c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f271c0050a0 tx=0x7f271c0588f0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.002+0000 7f2734e4d740 1 -- 172.21.15.50:0/4267147304 shutdown_connections 2024-09-11T22:13:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.002+0000 7f2734e4d740 1 --2- 172.21.15.50:0/4267147304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefaf750b0 0x55cefaf6e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.002+0000 7f2734e4d740 1 --2- 172.21.15.50:0/4267147304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf710e0 0x55cefaf73d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.002+0000 7f2734e4d740 1 --2- 172.21.15.50:0/4267147304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefafb90c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.002+0000 7f2734e4d740 1 -- 172.21.15.50:0/4267147304 >> 172.21.15.50:0/4267147304 conn(0x55cefaf70370 msgr2=0x55cefafb8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.002+0000 7f2734e4d740 1 -- 172.21.15.50:0/4267147304 shutdown_connections 2024-09-11T22:13:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.002+0000 7f2734e4d740 1 -- 172.21.15.50:0/4267147304 wait complete. 2024-09-11T22:13:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.002+0000 7f2734e4d740 1 -- start start 2024-09-11T22:13:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.003+0000 7f2734e4d740 1 Processor -- start 2024-09-11T22:13:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.003+0000 7f2734e4d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefaf967d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.003+0000 7f2734e4d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf750b0 0x55cefafb5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.003+0000 7f2734e4d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefafb35b0 0x55cefafb58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.003+0000 7f2734e4d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cefaf6f810 con 0x55cefaf73920 2024-09-11T22:13:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.003+0000 7f2734e4d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cefae5f4f0 con 0x55cefaf750b0 2024-09-11T22:13:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.003+0000 7f2734e4d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cefafb98f0 con 0x55cefafb35b0 2024-09-11T22:13:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.003+0000 7f2734e4d740 10 client.0 _ll_register_callbacks cb 0x55cefae80b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.003+0000 7f272b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefaf967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.003+0000 7f272b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefaf967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48622/0 (socket says 172.21.15.50:48622) 2024-09-11T22:13:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.003+0000 7f272b7fe640 1 -- 172.21.15.50:0/1399723136 learned_addr learned my addr 172.21.15.50:0/1399723136 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.003+0000 7f272affd640 1 --2- 172.21.15.50:0/1399723136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf750b0 0x55cefafb5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f272bfff640 1 --2- 172.21.15.50:0/1399723136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefafb35b0 0x55cefafb58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f272b7fe640 1 -- 172.21.15.50:0/1399723136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefafb35b0 msgr2=0x55cefafb58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f272b7fe640 1 --2- 172.21.15.50:0/1399723136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefafb35b0 0x55cefafb58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f272b7fe640 1 -- 172.21.15.50:0/1399723136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf750b0 msgr2=0x55cefafb5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f272b7fe640 1 --2- 172.21.15.50:0/1399723136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf750b0 0x55cefafb5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f272b7fe640 1 -- 172.21.15.50:0/1399723136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cefacb37d0 con 0x55cefaf73920 2024-09-11T22:13:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f272b7fe640 1 --2- 172.21.15.50:0/1399723136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefaf967d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f271c058c10 tx=0x7f271c05c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7dd3ee9dd4090c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f270a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f270a7fc640 1 -- 172.21.15.50:0/1399723136 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c072070 con 0x55cefaf73920 2024-09-11T22:13:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f270a7fc640 1 -- 172.21.15.50:0/1399723136 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7f271c057210 con 0x55cefaf73920 2024-09-11T22:13:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f2734e4d740 1 -- 172.21.15.50:0/1399723136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f271c05d2c0 con 0x55cefaf73920 2024-09-11T22:13:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f270a7fc640 1 -- 172.21.15.50:0/1399723136 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f271c087040 con 0x55cefaf73920 2024-09-11T22:13:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f2734e4d740 10 client.5091 fetch_fsmap learned FSMap version 15 2024-09-11T22:13:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f2734e4d740 1 -- 172.21.15.50:0/1399723136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55cefabe93f0 con 0x55cefaf73920 2024-09-11T22:13:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f270a7fc640 1 -- 172.21.15.50:0/1399723136 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c05d2c0 con 0x55cefaf73920 2024-09-11T22:13:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.004+0000 7f270a7fc640 1 -- 172.21.15.50:0/1399723136 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f271c003ca0 con 0x55cefaf73920 2024-09-11T22:13:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.005+0000 7f2734e4d740 10 client.5091 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T22:13:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.005+0000 7f2734e4d740 10 client.5091 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-11T22:13:26.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.005+0000 7f2734e4d740 20 client.5091 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:26.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.005+0000 7f2734e4d740 1 --2- 172.21.15.50:0/1399723136 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cefafc9ab0 0x55cefafc9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.005+0000 7f2734e4d740 4 client.5091 mds_command: new command op to 4815 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:26.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.005+0000 7f2734e4d740 1 -- 172.21.15.50:0/1399723136 --> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cefaee3e20 con 0x55cefafc9ab0 2024-09-11T22:13:26.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.005+0000 7f272affd640 1 --2- 172.21.15.50:0/1399723136 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cefafc9ab0 0x55cefafc9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.005+0000 7f270a7fc640 10 client.5091 ms_handle_connect on v2:172.21.15.50:6832/900288576 2024-09-11T22:13:26.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.005+0000 7f272affd640 1 --2- 172.21.15.50:0/1399723136 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cefafc9ab0 0x55cefafc9eb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63b87bb9baa55ea7 server_cookie=3b2f02b2a9f920c0 in_seq=0 out_seq=0 2024-09-11T22:13:26.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f270a7fc640 1 -- 172.21.15.50:0/1399723136 <== mds.0 v2:172.21.15.50:6832/900288576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cefaee3e20 con 0x55cefafc9ab0 2024-09-11T22:13:26.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f270a7fc640 10 client.5091 handle_command_reply: tid=0 2024-09-11T22:13:26.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f2734e4d740 1 client.5091 shutdown 2024-09-11T22:13:26.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f2734e4d740 1 -- 172.21.15.50:0/1399723136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 msgr2=0x55cefaf967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f2734e4d740 1 --2- 172.21.15.50:0/1399723136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefaf967d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f271c058c10 tx=0x7f271c05c000 comp rx=0 tx=0).stop 2024-09-11T22:13:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f2734e4d740 1 -- 172.21.15.50:0/1399723136 shutdown_connections 2024-09-11T22:13:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f2734e4d740 1 --2- 172.21.15.50:0/1399723136 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cefafc9ab0 0x55cefafc9eb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f2734e4d740 1 --2- 172.21.15.50:0/1399723136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefafb35b0 0x55cefafb58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f2734e4d740 1 --2- 172.21.15.50:0/1399723136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf750b0 0x55cefafb5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f270a7fc640 0 client.5091 ms_handle_reset on v2:172.21.15.50:6832/900288576 2024-09-11T22:13:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f2734e4d740 1 --2- 172.21.15.50:0/1399723136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefaf967d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f2734e4d740 1 -- 172.21.15.50:0/1399723136 >> 172.21.15.50:0/1399723136 conn(0x55cefaf710e0 msgr2=0x55cefafb7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f2734e4d740 1 -- 172.21.15.50:0/1399723136 shutdown_connections 2024-09-11T22:13:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f2734e4d740 1 -- 172.21.15.50:0/1399723136 wait complete. 2024-09-11T22:13:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.006+0000 7f2734e4d740 20 client.5091 trim_cache size 0 max 16384 2024-09-11T22:13:26.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.024+0000 7f2734e4d740 1 Processor -- start 2024-09-11T22:13:26.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.024+0000 7f2734e4d740 1 -- start start 2024-09-11T22:13:26.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f2734e4d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefafb45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f2734e4d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf750b0 0x55cefaf6d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f2734e4d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefafb35b0 0x55cefafc8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f2734e4d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f272c201460 con 0x55cefaf73920 2024-09-11T22:13:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f2734e4d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f272c200460 con 0x55cefaf750b0 2024-09-11T22:13:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f2734e4d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f272c1ff8c0 con 0x55cefafb35b0 2024-09-11T22:13:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f272b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefafb45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f272b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefafb45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48634/0 (socket says 172.21.15.50:48634) 2024-09-11T22:13:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f272b7fe640 1 -- 172.21.15.50:0/522017960 learned_addr learned my addr 172.21.15.50:0/522017960 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f272affd640 1 --2- 172.21.15.50:0/522017960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf750b0 0x55cefaf6d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f272bfff640 1 --2- 172.21.15.50:0/522017960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefafb35b0 0x55cefafc8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f272b7fe640 1 -- 172.21.15.50:0/522017960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefafb35b0 msgr2=0x55cefafc8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f272b7fe640 1 --2- 172.21.15.50:0/522017960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefafb35b0 0x55cefafc8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f272b7fe640 1 -- 172.21.15.50:0/522017960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf750b0 msgr2=0x55cefaf6d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f272b7fe640 1 --2- 172.21.15.50:0/522017960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf750b0 0x55cefaf6d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.025+0000 7f272b7fe640 1 -- 172.21.15.50:0/522017960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cefaba90f0 con 0x55cefaf73920 2024-09-11T22:13:26.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.026+0000 7f272b7fe640 1 --2- 172.21.15.50:0/522017960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefafb45d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f271c057460 tx=0x7f271c088000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd84d1625fb48d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.026+0000 7f2710ff9640 1 -- 172.21.15.50:0/522017960 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c072020 con 0x55cefaf73920 2024-09-11T22:13:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.026+0000 7f2710ff9640 1 -- 172.21.15.50:0/522017960 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c05d2c0 con 0x55cefaf73920 2024-09-11T22:13:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.026+0000 7f2710ff9640 1 -- 172.21.15.50:0/522017960 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c003ca0 con 0x55cefaf73920 2024-09-11T22:13:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.026+0000 7f2734e4d740 1 -- 172.21.15.50:0/522017960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 msgr2=0x55cefafb45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.026+0000 7f2734e4d740 1 --2- 172.21.15.50:0/522017960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefafb45d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f271c057460 tx=0x7f271c088000 comp rx=0 tx=0).stop 2024-09-11T22:13:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.027+0000 7f2734e4d740 1 -- 172.21.15.50:0/522017960 shutdown_connections 2024-09-11T22:13:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.027+0000 7f2734e4d740 1 --2- 172.21.15.50:0/522017960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefafb35b0 0x55cefafc8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.027+0000 7f2734e4d740 1 --2- 172.21.15.50:0/522017960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefaf750b0 0x55cefaf6d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.027+0000 7f2734e4d740 1 --2- 172.21.15.50:0/522017960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefafb45d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.027+0000 7f2734e4d740 1 -- 172.21.15.50:0/522017960 >> 172.21.15.50:0/522017960 conn(0x55cefaf710e0 msgr2=0x55cefaf697e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.027+0000 7f2734e4d740 1 -- 172.21.15.50:0/522017960 shutdown_connections 2024-09-11T22:13:26.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.027+0000 7f2734e4d740 1 -- 172.21.15.50:0/522017960 wait complete. 2024-09-11T22:13:26.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.027+0000 7f2734e4d740 1 -- start start 2024-09-11T22:13:26.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.027+0000 7f2734e4d740 1 Processor -- start 2024-09-11T22:13:26.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f2734e4d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefaf72d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f2734e4d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefaf750b0 0x55cefb030430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f2734e4d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefafb35b0 0x55cefaf6d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f2734e4d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cefaf74c60 con 0x55cefaf73920 2024-09-11T22:13:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f2734e4d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f272c1ffe10 con 0x55cefafb35b0 2024-09-11T22:13:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f2734e4d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cefafb4ee0 con 0x55cefaf750b0 2024-09-11T22:13:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f2734e4d740 10 client.0 _ll_register_callbacks cb 0x7f271c085070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f272b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefaf72d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f272b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefaf72d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48638/0 (socket says 172.21.15.50:48638) 2024-09-11T22:13:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f272b7fe640 1 -- 172.21.15.50:0/1361141969 learned_addr learned my addr 172.21.15.50:0/1361141969 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f272affd640 1 --2- 172.21.15.50:0/1361141969 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefaf750b0 0x55cefb030430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f272bfff640 1 --2- 172.21.15.50:0/1361141969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefafb35b0 0x55cefaf6d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f272b7fe640 1 -- 172.21.15.50:0/1361141969 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefaf750b0 msgr2=0x55cefb030430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f272b7fe640 1 --2- 172.21.15.50:0/1361141969 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefaf750b0 0x55cefb030430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f272b7fe640 1 -- 172.21.15.50:0/1361141969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefafb35b0 msgr2=0x55cefaf6d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.028+0000 7f272b7fe640 1 --2- 172.21.15.50:0/1361141969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefafb35b0 0x55cefaf6d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f272b7fe640 1 -- 172.21.15.50:0/1361141969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cefafdb830 con 0x55cefaf73920 2024-09-11T22:13:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f272b7fe640 1 --2- 172.21.15.50:0/1361141969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefaf72d70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f271c055230 tx=0x7f271c055260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c718f2b9d16e72d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f270a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f270a7fc640 1 -- 172.21.15.50:0/1361141969 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c072060 con 0x55cefaf73920 2024-09-11T22:13:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f270a7fc640 1 -- 172.21.15.50:0/1361141969 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7f271c057210 con 0x55cefaf73920 2024-09-11T22:13:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f2734e4d740 1 -- 172.21.15.50:0/1361141969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f271c05d2c0 con 0x55cefaf73920 2024-09-11T22:13:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f270a7fc640 1 -- 172.21.15.50:0/1361141969 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f271c058690 con 0x55cefaf73920 2024-09-11T22:13:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f2734e4d740 10 client.5097 fetch_fsmap learned FSMap version 15 2024-09-11T22:13:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f2734e4d740 1 -- 172.21.15.50:0/1361141969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55cefafdb830 con 0x55cefaf73920 2024-09-11T22:13:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f270a7fc640 1 -- 172.21.15.50:0/1361141969 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c05d2c0 con 0x55cefaf73920 2024-09-11T22:13:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f270a7fc640 1 -- 172.21.15.50:0/1361141969 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f271c054c60 con 0x55cefaf73920 2024-09-11T22:13:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f2734e4d740 10 client.5097 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T22:13:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f2734e4d740 10 client.5097 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-11T22:13:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f2734e4d740 20 client.5097 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f2734e4d740 1 --2- 172.21.15.50:0/1361141969 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cefaf6d7f0 0x55cefafb07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f2734e4d740 4 client.5097 mds_command: new command op to 4815 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:13:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f2734e4d740 1 -- 172.21.15.50:0/1361141969 --> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cefaede170 con 0x55cefaf6d7f0 2024-09-11T22:13:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.029+0000 7f272affd640 1 --2- 172.21.15.50:0/1361141969 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cefaf6d7f0 0x55cefafb07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f270a7fc640 10 client.5097 ms_handle_connect on v2:172.21.15.50:6832/900288576 2024-09-11T22:13:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f272affd640 1 --2- 172.21.15.50:0/1361141969 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cefaf6d7f0 0x55cefafb07c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dbc7506685d7db7 server_cookie=dc0e69b5fc4622d2 in_seq=0 out_seq=0 2024-09-11T22:13:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f270a7fc640 1 -- 172.21.15.50:0/1361141969 <== mds.0 v2:172.21.15.50:6832/900288576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cefaede170 con 0x55cefaf6d7f0 2024-09-11T22:13:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f270a7fc640 10 client.5097 handle_command_reply: tid=0 2024-09-11T22:13:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f2734e4d740 1 client.5097 shutdown 2024-09-11T22:13:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f2734e4d740 1 -- 172.21.15.50:0/1361141969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 msgr2=0x55cefaf72d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f2734e4d740 1 --2- 172.21.15.50:0/1361141969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefaf72d70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f271c055230 tx=0x7f271c055260 comp rx=0 tx=0).stop 2024-09-11T22:13:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f2734e4d740 1 -- 172.21.15.50:0/1361141969 shutdown_connections 2024-09-11T22:13:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f2734e4d740 1 --2- 172.21.15.50:0/1361141969 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55cefaf6d7f0 0x55cefafb07c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f2734e4d740 1 --2- 172.21.15.50:0/1361141969 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cefaf750b0 0x55cefb030430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f2734e4d740 1 --2- 172.21.15.50:0/1361141969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cefafb35b0 0x55cefaf6d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f2734e4d740 1 --2- 172.21.15.50:0/1361141969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cefaf73920 0x55cefaf72d70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f270a7fc640 0 client.5097 ms_handle_reset on v2:172.21.15.50:6832/900288576 2024-09-11T22:13:26.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f2734e4d740 1 -- 172.21.15.50:0/1361141969 >> 172.21.15.50:0/1361141969 conn(0x55cefaf710e0 msgr2=0x55cefafb6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f2734e4d740 1 -- 172.21.15.50:0/1361141969 shutdown_connections 2024-09-11T22:13:26.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f2734e4d740 1 -- 172.21.15.50:0/1361141969 wait complete. 2024-09-11T22:13:26.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.030+0000 7f2734e4d740 20 client.5097 trim_cache size 0 max 16384 2024-09-11T22:13:26.037 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:26.038 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-11T22:13:26.038 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-11T22:13:26.038 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:26.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.031+0000 7f27320ac640 1 -- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f271806be30 msgr2=0x7f271806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.031+0000 7f27320ac640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f271806be30 0x7f271806e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2720033000 tx=0x7f2720008030 comp rx=0 tx=0).stop 2024-09-11T22:13:26.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.031+0000 7f27320ac640 1 -- 172.21.15.50:0/1484361709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2714004800 msgr2=0x7f272c1e8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.031+0000 7f27320ac640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2714004800 0x7f272c1e8270 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f271c00f620 tx=0x7f271c00fae0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.031+0000 7f27320ac640 1 -- 172.21.15.50:0/1484361709 shutdown_connections 2024-09-11T22:13:26.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.031+0000 7f27320ac640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f271806be30 0x7f271806e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.031+0000 7f27320ac640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f272c155560 0x7f272c157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.031+0000 7f27320ac640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f272c147ff0 0x7f272c0d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.031+0000 7f27320ac640 1 --2- 172.21.15.50:0/1484361709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2714004800 0x7f272c1e8270 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.031+0000 7f27320ac640 1 -- 172.21.15.50:0/1484361709 >> 172.21.15.50:0/1484361709 conn(0x7f272c075060 msgr2=0x7f272c06bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.031+0000 7f27320ac640 1 -- 172.21.15.50:0/1484361709 shutdown_connections 2024-09-11T22:13:26.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.031+0000 7f27320ac640 1 -- 172.21.15.50:0/1484361709 wait complete. 2024-09-11T22:13:26.042 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:13:26.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-11T22:13:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.146+0000 7ff8f9b0a640 1 Processor -- start 2024-09-11T22:13:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.146+0000 7ff8f9b0a640 1 -- start start 2024-09-11T22:13:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.147+0000 7ff8f9b0a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8f40d05e0 0x7ff8f40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.147+0000 7ff8f9b0a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f40b3e10 0x7ff8f40ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.147+0000 7ff8f9b0a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f40b4f00 con 0x7ff8f415c2c0 2024-09-11T22:13:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.147+0000 7ff8f9b0a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff8f40b4360 con 0x7ff8f40d05e0 2024-09-11T22:13:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.147+0000 7ff8f9b0a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f40b51c0 con 0x7ff8f40b3e10 2024-09-11T22:13:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.147+0000 7ff8f37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff8f415c2c0 0x7ff8f40cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39902/0 (socket says 172.21.15.50:39902) 2024-09-11T22:13:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.147+0000 7ff8f37fe640 1 -- 172.21.15.50:0/4072332221 learned_addr learned my addr 172.21.15.50:0/4072332221 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.147+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/4072332221 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f40b3e10 0x7ff8f40ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.147+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/4072332221 >> v2:172.21.15.77:3300/0 conn(0x7ff8f40d05e0 0x7ff8f40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.147+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2241638303 0 0) 0x7ff8f40b4f00 con 0x7ff8f415c2c0 2024-09-11T22:13:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.147+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8dc003520 con 0x7ff8f415c2c0 2024-09-11T22:13:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3632414894 0 0) 0x7ff8dc003520 con 0x7ff8f415c2c0 2024-09-11T22:13:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f40b3e10 msgr2=0x7ff8f40ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 --2- 172.21.15.50:0/4072332221 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f40b3e10 0x7ff8f40ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 >> v2:172.21.15.77:3300/0 conn(0x7ff8f40d05e0 msgr2=0x7ff8f40b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 --2- 172.21.15.50:0/4072332221 >> v2:172.21.15.77:3300/0 conn(0x7ff8f40d05e0 0x7ff8f40b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f40b54a0 con 0x7ff8f415c2c0 2024-09-11T22:13:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7ff8e4001670 con 0x7ff8f415c2c0 2024-09-11T22:13:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 >> v1:172.21.15.50:6789/0 conn(0x7ff8f415c2c0 legacy=0x7ff8f40cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 --2- 172.21.15.50:0/4072332221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8dc0039b0 0x7ff8dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 --2- 172.21.15.50:0/4072332221 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f40b3e10 0x7ff8dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 --2- 172.21.15.50:0/4072332221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8dc004d40 0x7ff8dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f40b4360 con 0x7ff8dc004d40 2024-09-11T22:13:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f40b51c0 con 0x7ff8dc0039b0 2024-09-11T22:13:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff8dc00b9c0 con 0x7ff8f40b3e10 2024-09-11T22:13:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/4072332221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8dc004d40 0x7ff8dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/4072332221 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f40b3e10 0x7ff8dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/4072332221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8dc0039b0 0x7ff8dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f3fff640 1 -- 172.21.15.50:0/4072332221 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f40b3e10 msgr2=0x7ff8dc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/4072332221 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f40b3e10 0x7ff8dc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f3fff640 1 -- 172.21.15.50:0/4072332221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8dc0039b0 msgr2=0x7ff8dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/4072332221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8dc0039b0 0x7ff8dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.148+0000 7ff8f3fff640 1 -- 172.21.15.50:0/4072332221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8dc003520 con 0x7ff8dc004d40 2024-09-11T22:13:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.149+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/4072332221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8dc004d40 0x7ff8dc0051c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009fc0 tx=0x7ff8dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01dc197e2ae23e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.149+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec009c10 con 0x7ff8dc004d40 2024-09-11T22:13:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.149+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ec036070 con 0x7ff8dc004d40 2024-09-11T22:13:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.149+0000 7ff8f27fc640 1 -- 172.21.15.50:0/4072332221 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec031880 con 0x7ff8dc004d40 2024-09-11T22:13:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.149+0000 7ff8f9b0a640 1 -- 172.21.15.50:0/4072332221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8dc004d40 msgr2=0x7ff8dc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.149+0000 7ff8f9b0a640 1 --2- 172.21.15.50:0/4072332221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8dc004d40 0x7ff8dc0051c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009fc0 tx=0x7ff8dc005830 comp rx=0 tx=0).stop 2024-09-11T22:13:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.149+0000 7ff8f3fff640 1 -- 172.21.15.50:0/4072332221 reap_dead start 2024-09-11T22:13:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.150+0000 7ff8f9b0a640 1 -- 172.21.15.50:0/4072332221 shutdown_connections 2024-09-11T22:13:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.150+0000 7ff8f9b0a640 1 -- 172.21.15.50:0/4072332221 >> 172.21.15.50:0/4072332221 conn(0x7ff8f40679c0 msgr2=0x7ff8f4067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.150+0000 7ff8f9b0a640 1 -- 172.21.15.50:0/4072332221 shutdown_connections 2024-09-11T22:13:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.150+0000 7ff8f9b0a640 1 -- 172.21.15.50:0/4072332221 wait complete. 2024-09-11T22:13:26.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.151+0000 7ff8f9b0a640 1 Processor -- start 2024-09-11T22:13:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.151+0000 7ff8f9b0a640 1 -- start start 2024-09-11T22:13:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f9b0a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4147f80 0x7ff8f4158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f9b0a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f414b1a0 0x7ff8f414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f9b0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f414bb40 0x7ff8f4071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f9b0a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f406d070 con 0x7ff8f4147f80 2024-09-11T22:13:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f9b0a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f40ce200 con 0x7ff8f414bb40 2024-09-11T22:13:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f9b0a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f406d1f0 con 0x7ff8f414b1a0 2024-09-11T22:13:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4147f80 0x7ff8f4158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4147f80 0x7ff8f4158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48656/0 (socket says 172.21.15.50:48656) 2024-09-11T22:13:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f37fe640 1 -- 172.21.15.50:0/3531929859 learned_addr learned my addr 172.21.15.50:0/3531929859 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f414b1a0 0x7ff8f414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f414bb40 0x7ff8f4071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f37fe640 1 -- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f414b1a0 msgr2=0x7ff8f414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f414b1a0 0x7ff8f414b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f37fe640 1 -- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f414bb40 msgr2=0x7ff8f4071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f414bb40 0x7ff8f4071030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f37fe640 1 -- 172.21.15.50:0/3531929859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f4148360 con 0x7ff8f4147f80 2024-09-11T22:13:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f414b1a0 0x7ff8f414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4147f80 0x7ff8f4158360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4007290 tx=0x7ff8e4007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8dbfff640 1 -- 172.21.15.50:0/3531929859 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e400f9c0 con 0x7ff8f4147f80 2024-09-11T22:13:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8dbfff640 1 -- 172.21.15.50:0/3531929859 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e4018070 con 0x7ff8f4147f80 2024-09-11T22:13:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8f9b0a640 1 -- 172.21.15.50:0/3531929859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f414a420 con 0x7ff8f4147f80 2024-09-11T22:13:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.152+0000 7ff8dbfff640 1 -- 172.21.15.50:0/3531929859 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e400fdc0 con 0x7ff8f4147f80 2024-09-11T22:13:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.153+0000 7ff8f9b0a640 1 -- 172.21.15.50:0/3531929859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f414d800 con 0x7ff8f4147f80 2024-09-11T22:13:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.154+0000 7ff8dbfff640 1 -- 172.21.15.50:0/3531929859 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8e401d460 con 0x7ff8f4147f80 2024-09-11T22:13:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.155+0000 7ff8dbfff640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff8e006be30 0x7ff8e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.155+0000 7ff8dbfff640 1 -- 172.21.15.50:0/3531929859 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7ff8e408b080 con 0x7ff8f4147f80 2024-09-11T22:13:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.155+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff8e006be30 0x7ff8e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.156+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff8e006be30 0x7ff8e006e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff8f41580b0 tx=0x7ff8e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.156+0000 7ff8fc89e740 1 Processor -- start 2024-09-11T22:13:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.156+0000 7ff8fc89e740 1 -- start start 2024-09-11T22:13:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8fc89e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df4615e0 0x55a4df4619c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8fc89e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45eda0 0x55a4df460930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8fc89e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df45f200 0x55a4df441560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8fc89e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a4df37d8d0 con 0x55a4df4615e0 2024-09-11T22:13:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8fc89e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a4df325620 con 0x55a4df45eda0 2024-09-11T22:13:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8fc89e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a4df379890 con 0x55a4df45f200 2024-09-11T22:13:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df4615e0 0x55a4df4619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df4615e0 0x55a4df4619c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48658/0 (socket says 172.21.15.50:48658) 2024-09-11T22:13:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8f37fe640 1 -- 172.21.15.50:0/3855778363 learned_addr learned my addr 172.21.15.50:0/3855778363 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/3855778363 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df45f200 0x55a4df441560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/3855778363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45eda0 0x55a4df460930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8f37fe640 1 -- 172.21.15.50:0/3855778363 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df45f200 msgr2=0x55a4df441560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/3855778363 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df45f200 0x55a4df441560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8f37fe640 1 -- 172.21.15.50:0/3855778363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45eda0 msgr2=0x55a4df460930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/3855778363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45eda0 0x55a4df460930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8f37fe640 1 -- 172.21.15.50:0/3855778363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4df15a7d0 con 0x55a4df4615e0 2024-09-11T22:13:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/3855778363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45eda0 0x55a4df460930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/3855778363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df4615e0 0x55a4df4619c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4061920 tx=0x7ff8e4059170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1118340656fdde server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8d97fa640 1 -- 172.21.15.50:0/3855778363 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4061e50 con 0x55a4df4615e0 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8d97fa640 1 -- 172.21.15.50:0/3855778363 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e4082e50 con 0x55a4df4615e0 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.157+0000 7ff8d97fa640 1 -- 172.21.15.50:0/3855778363 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4071180 con 0x55a4df4615e0 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.158+0000 7ff8fc89e740 1 -- 172.21.15.50:0/3855778363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df4615e0 msgr2=0x55a4df4619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.158+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/3855778363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df4615e0 0x55a4df4619c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4061920 tx=0x7ff8e4059170 comp rx=0 tx=0).stop 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.158+0000 7ff8fc89e740 1 -- 172.21.15.50:0/3855778363 shutdown_connections 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.158+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/3855778363 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df45f200 0x55a4df441560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.158+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/3855778363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45eda0 0x55a4df460930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.158+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/3855778363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df4615e0 0x55a4df4619c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.158+0000 7ff8fc89e740 1 -- 172.21.15.50:0/3855778363 >> 172.21.15.50:0/3855778363 conn(0x55a4df417240 msgr2=0x55a4df45f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.158+0000 7ff8fc89e740 1 -- 172.21.15.50:0/3855778363 shutdown_connections 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.158+0000 7ff8fc89e740 1 -- 172.21.15.50:0/3855778363 wait complete. 2024-09-11T22:13:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.159+0000 7ff8fc89e740 1 -- start start 2024-09-11T22:13:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.159+0000 7ff8fc89e740 1 Processor -- start 2024-09-11T22:13:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8fc89e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45f200 0x55a4df443c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8fc89e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df4615e0 0x55a4df46edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8fc89e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df46f310 0x55a4df456680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8fc89e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a4df45dd00 con 0x55a4df46f310 2024-09-11T22:13:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8fc89e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a4df306750 con 0x55a4df45f200 2024-09-11T22:13:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8fc89e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a4df45dfe0 con 0x55a4df4615e0 2024-09-11T22:13:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8fc89e740 10 client.0 _ll_register_callbacks cb 0x55a4df32a780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8f3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df46f310 0x55a4df456680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8f3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df46f310 0x55a4df456680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48664/0 (socket says 172.21.15.50:48664) 2024-09-11T22:13:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8f3fff640 1 -- 172.21.15.50:0/2716204963 learned_addr learned my addr 172.21.15.50:0/2716204963 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/2716204963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45f200 0x55a4df443c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/2716204963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df4615e0 0x55a4df46edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8f3fff640 1 -- 172.21.15.50:0/2716204963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df4615e0 msgr2=0x55a4df46edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/2716204963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df4615e0 0x55a4df46edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8f3fff640 1 -- 172.21.15.50:0/2716204963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45f200 msgr2=0x55a4df443c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/2716204963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45f200 0x55a4df443c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8f3fff640 1 -- 172.21.15.50:0/2716204963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4df0500f0 con 0x55a4df46f310 2024-09-11T22:13:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/2716204963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df46f310 0x55a4df456680 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec033040 tx=0x7ff8ec004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbe282a53884a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.160+0000 7ff8d27fc640 1 -- 172.21.15.50:0/2716204963 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec04a060 con 0x55a4df46f310 2024-09-11T22:13:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2716204963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8e4082e50 con 0x55a4df46f310 2024-09-11T22:13:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8d27fc640 1 -- 172.21.15.50:0/2716204963 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7ff8ec0318c0 con 0x55a4df46f310 2024-09-11T22:13:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8d27fc640 1 -- 172.21.15.50:0/2716204963 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7ff8ec050050 con 0x55a4df46f310 2024-09-11T22:13:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8fc89e740 10 client.5109 fetch_fsmap learned FSMap version 15 2024-09-11T22:13:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2716204963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55a4df1baf60 con 0x55a4df46f310 2024-09-11T22:13:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8d27fc640 1 -- 172.21.15.50:0/2716204963 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e4082e50 con 0x55a4df46f310 2024-09-11T22:13:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8d27fc640 1 -- 172.21.15.50:0/2716204963 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7ff8ec053020 con 0x55a4df46f310 2024-09-11T22:13:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8fc89e740 10 client.5109 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T22:13:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8fc89e740 10 client.5109 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-11T22:13:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8fc89e740 20 client.5109 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/2716204963 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55a4df432a20 0x55a4df42f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8fc89e740 4 client.5109 mds_command: new command op to 4815 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2716204963 --> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4df38b000 con 0x55a4df432a20 2024-09-11T22:13:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/2716204963 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55a4df432a20 0x55a4df42f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/2716204963 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55a4df432a20 0x55a4df42f0d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e382f1fbc5cc8f7 server_cookie=9234d88f4e1a697f in_seq=0 out_seq=0 2024-09-11T22:13:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.161+0000 7ff8d27fc640 10 client.5109 ms_handle_connect on v2:172.21.15.50:6832/900288576 2024-09-11T22:13:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8d27fc640 1 -- 172.21.15.50:0/2716204963 <== mds.0 v2:172.21.15.50:6832/900288576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4df38b000 con 0x55a4df432a20 2024-09-11T22:13:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8d27fc640 10 client.5109 handle_command_reply: tid=0 2024-09-11T22:13:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8fc89e740 1 client.5109 shutdown 2024-09-11T22:13:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2716204963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df46f310 msgr2=0x55a4df456680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/2716204963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df46f310 0x55a4df456680 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec033040 tx=0x7ff8ec004ab0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2716204963 shutdown_connections 2024-09-11T22:13:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/2716204963 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55a4df432a20 0x55a4df42f0d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/2716204963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df4615e0 0x55a4df46edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/2716204963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df46f310 0x55a4df456680 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/2716204963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45f200 0x55a4df443c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8d27fc640 0 client.5109 ms_handle_reset on v2:172.21.15.50:6832/900288576 2024-09-11T22:13:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2716204963 >> 172.21.15.50:0/2716204963 conn(0x55a4df45eda0 msgr2=0x55a4df45f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2716204963 shutdown_connections 2024-09-11T22:13:26.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2716204963 wait complete. 2024-09-11T22:13:26.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.162+0000 7ff8fc89e740 20 client.5109 trim_cache size 0 max 16384 2024-09-11T22:13:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.178+0000 7ff8fc89e740 1 Processor -- start 2024-09-11T22:13:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.178+0000 7ff8fc89e740 1 -- start start 2024-09-11T22:13:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.179+0000 7ff8fc89e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 0x55a4df460750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.179+0000 7ff8fc89e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45f200 0x55a4df410710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.179+0000 7ff8fc89e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df4615e0 0x55a4df45f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.179+0000 7ff8fc89e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f42018c0 con 0x55a4df45eda0 2024-09-11T22:13:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.179+0000 7ff8fc89e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f4200920 con 0x55a4df45f200 2024-09-11T22:13:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.179+0000 7ff8fc89e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f414d5e0 con 0x55a4df4615e0 2024-09-11T22:13:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.179+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 0x55a4df460750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.179+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 0x55a4df460750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48668/0 (socket says 172.21.15.50:48668) 2024-09-11T22:13:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.179+0000 7ff8f37fe640 1 -- 172.21.15.50:0/318041126 learned_addr learned my addr 172.21.15.50:0/318041126 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/318041126 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df4615e0 0x55a4df45f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/318041126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45f200 0x55a4df410710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8f37fe640 1 -- 172.21.15.50:0/318041126 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df4615e0 msgr2=0x55a4df45f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/318041126 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df4615e0 0x55a4df45f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8f37fe640 1 -- 172.21.15.50:0/318041126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45f200 msgr2=0x55a4df410710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/318041126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45f200 0x55a4df410710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8f37fe640 1 -- 172.21.15.50:0/318041126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4df4572c0 con 0x55a4df45eda0 2024-09-11T22:13:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/318041126 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df4615e0 0x55a4df45f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/318041126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45f200 0x55a4df410710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/318041126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 0x55a4df460750 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40894f0 tx=0x7ff8e405b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf314bed7e51de7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8d8ff9640 1 -- 172.21.15.50:0/318041126 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4059040 con 0x55a4df45eda0 2024-09-11T22:13:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8d8ff9640 1 -- 172.21.15.50:0/318041126 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e4082e50 con 0x55a4df45eda0 2024-09-11T22:13:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8d8ff9640 1 -- 172.21.15.50:0/318041126 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4057570 con 0x55a4df45eda0 2024-09-11T22:13:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8fc89e740 1 -- 172.21.15.50:0/318041126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 msgr2=0x55a4df460750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.180+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/318041126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 0x55a4df460750 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40894f0 tx=0x7ff8e405b000 comp rx=0 tx=0).stop 2024-09-11T22:13:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.181+0000 7ff8fc89e740 1 -- 172.21.15.50:0/318041126 shutdown_connections 2024-09-11T22:13:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.181+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/318041126 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df4615e0 0x55a4df45f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.181+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/318041126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df45f200 0x55a4df410710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.181+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/318041126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 0x55a4df460750 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.181+0000 7ff8fc89e740 1 -- 172.21.15.50:0/318041126 >> 172.21.15.50:0/318041126 conn(0x55a4df457900 msgr2=0x55a4df462010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.181+0000 7ff8fc89e740 1 -- 172.21.15.50:0/318041126 shutdown_connections 2024-09-11T22:13:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.181+0000 7ff8fc89e740 1 -- 172.21.15.50:0/318041126 wait complete. 2024-09-11T22:13:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.181+0000 7ff8fc89e740 1 -- start start 2024-09-11T22:13:26.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.181+0000 7ff8fc89e740 1 Processor -- start 2024-09-11T22:13:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8fc89e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 0x55a4df45f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8fc89e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df45f200 0x55a4df45fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8fc89e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df4615e0 0x55a4df4df090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8fc89e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f42002d0 con 0x55a4df45eda0 2024-09-11T22:13:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8fc89e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a4df483320 con 0x55a4df4615e0 2024-09-11T22:13:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8fc89e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a4df4e03d0 con 0x55a4df45f200 2024-09-11T22:13:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8fc89e740 10 client.0 _ll_register_callbacks cb 0x7ff8ec009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 0x55a4df45f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 0x55a4df45f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48680/0 (socket says 172.21.15.50:48680) 2024-09-11T22:13:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8f37fe640 1 -- 172.21.15.50:0/2085830503 learned_addr learned my addr 172.21.15.50:0/2085830503 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df4615e0 0x55a4df4df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df45f200 0x55a4df45fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8f37fe640 1 -- 172.21.15.50:0/2085830503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df45f200 msgr2=0x55a4df45fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df45f200 0x55a4df45fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8f37fe640 1 -- 172.21.15.50:0/2085830503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df4615e0 msgr2=0x55a4df4df090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df4615e0 0x55a4df4df090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8f37fe640 1 -- 172.21.15.50:0/2085830503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4df0291b0 con 0x55a4df45eda0 2024-09-11T22:13:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8f3fff640 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df4615e0 0x55a4df4df090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:26.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.182+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df45f200 0x55a4df45fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8f37fe640 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 0x55a4df45f7d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4058f70 tx=0x7ff8e4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed739a7acb81443 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8d27fc640 1 -- 172.21.15.50:0/2085830503 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4075030 con 0x55a4df45eda0 2024-09-11T22:13:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8d27fc640 1 -- 172.21.15.50:0/2085830503 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7ff8e4057570 con 0x55a4df45eda0 2024-09-11T22:13:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2085830503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8e4082e50 con 0x55a4df45eda0 2024-09-11T22:13:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8d27fc640 1 -- 172.21.15.50:0/2085830503 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7ff8e4078320 con 0x55a4df45eda0 2024-09-11T22:13:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8fc89e740 10 client.5115 fetch_fsmap learned FSMap version 15 2024-09-11T22:13:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2085830503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55a4df47f3f0 con 0x55a4df45eda0 2024-09-11T22:13:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8d27fc640 1 -- 172.21.15.50:0/2085830503 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e4082e50 con 0x55a4df45eda0 2024-09-11T22:13:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8d27fc640 1 -- 172.21.15.50:0/2085830503 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7ff8e40558e0 con 0x55a4df45eda0 2024-09-11T22:13:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8fc89e740 10 client.5115 fetch_fsmap finished waiting for FSMap version 15 2024-09-11T22:13:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8fc89e740 10 client.5115 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-11T22:13:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8fc89e740 20 client.5115 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55a4df46f310 0x55a4df4df5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8fc89e740 4 client.5115 mds_command: new command op to 4815 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-11T22:13:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2085830503 --> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55a4df385350 con 0x55a4df46f310 2024-09-11T22:13:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.183+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55a4df46f310 0x55a4df4df5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8f2ffd640 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55a4df46f310 0x55a4df4df5d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb65ff5cbd2be9d5 server_cookie=cfdcc800102d35b4 in_seq=0 out_seq=0 2024-09-11T22:13:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8d27fc640 10 client.5115 ms_handle_connect on v2:172.21.15.50:6832/900288576 2024-09-11T22:13:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8d27fc640 1 -- 172.21.15.50:0/2085830503 <== mds.0 v2:172.21.15.50:6832/900288576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17997 (crc 0 0 0) 0x55a4df385350 con 0x55a4df46f310 2024-09-11T22:13:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8d27fc640 10 client.5115 handle_command_reply: tid=0 2024-09-11T22:13:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8fc89e740 1 client.5115 shutdown 2024-09-11T22:13:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2085830503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 msgr2=0x55a4df45f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 0x55a4df45f7d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4058f70 tx=0x7ff8e4001a40 comp rx=0 tx=0).stop 2024-09-11T22:13:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2085830503 shutdown_connections 2024-09-11T22:13:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.50:6832/900288576,v1:172.21.15.50:6833/900288576] conn(0x55a4df46f310 0x55a4df4df5d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a4df45f200 0x55a4df45fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4df4615e0 0x55a4df4df090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8fc89e740 1 --2- 172.21.15.50:0/2085830503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4df45eda0 0x55a4df45f7d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2085830503 >> 172.21.15.50:0/2085830503 conn(0x55a4df457900 msgr2=0x55a4df460750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8d27fc640 0 client.5115 ms_handle_reset on v2:172.21.15.50:6832/900288576 2024-09-11T22:13:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2085830503 shutdown_connections 2024-09-11T22:13:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.184+0000 7ff8fc89e740 1 -- 172.21.15.50:0/2085830503 wait complete. 2024-09-11T22:13:26.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.185+0000 7ff8fc89e740 20 client.5115 trim_cache size 0 max 16384 2024-09-11T22:13:26.194 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:26.194 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:13:26.194 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 3033, 2024-09-11T22:13:26.194 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 3034, 2024-09-11T22:13:26.194 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 765729, 2024-09-11T22:13:26.194 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 38378973, 2024-09-11T22:13:26.194 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 17, 2024-09-11T22:13:26.194 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 6, 2024-09-11T22:13:26.194 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.354550408, 2024-09-11T22:13:26.194 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.185427095, 2024-09-11T22:13:26.194 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.064410686, 2024-09-11T22:13:26.195 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.088002914, 2024-09-11T22:13:26.195 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:13:26.195 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3033, 2024-09-11T22:13:26.195 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.721507830, 2024-09-11T22:13:26.195 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000237885 2024-09-11T22:13:26.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.195 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:13:26.195 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 10, 2024-09-11T22:13:26.195 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000001246, 2024-09-11T22:13:26.195 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000124 2024-09-11T22:13:26.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:13:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:13:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:13:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 28750, 2024-09-11T22:13:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 51044, 2024-09-11T22:13:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 9917963, 2024-09-11T22:13:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 44782364, 2024-09-11T22:13:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 7, 2024-09-11T22:13:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-09-11T22:13:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 3.603941481, 2024-09-11T22:13:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 2.460403553, 2024-09-11T22:13:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 1.724851755, 2024-09-11T22:13:26.197 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.061744851, 2024-09-11T22:13:26.197 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:13:26.197 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 51044, 2024-09-11T22:13:26.197 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.193655236, 2024-09-11T22:13:26.197 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000023384 2024-09-11T22:13:26.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.197 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:13:26.197 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 73400, 2024-09-11T22:13:26.197 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.008494831, 2024-09-11T22:13:26.197 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000115 2024-09-11T22:13:26.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.197 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 123312, 2024-09-11T22:13:26.197 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 26176 2024-09-11T22:13:26.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.198 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:13:26.198 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 3201, 2024-09-11T22:13:26.198 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 3223, 2024-09-11T22:13:26.198 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 1178184, 2024-09-11T22:13:26.198 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 34845276, 2024-09-11T22:13:26.198 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 6, 2024-09-11T22:13:26.198 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-09-11T22:13:26.198 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.308136981, 2024-09-11T22:13:26.198 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.138297670, 2024-09-11T22:13:26.198 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.057120097, 2024-09-11T22:13:26.198 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.097071197, 2024-09-11T22:13:26.198 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:13:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3221, 2024-09-11T22:13:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.337840358, 2024-09-11T22:13:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000104886 2024-09-11T22:13:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:13:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T22:13:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 121008 2024-09-11T22:13:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.199 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-09-11T22:13:26.200 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-09-11T22:13:26.200 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-09-11T22:13:26.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.200 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-09-11T22:13:26.200 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-09-11T22:13:26.200 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-09-11T22:13:26.200 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2358, 2024-09-11T22:13:26.200 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 17.232992965, 2024-09-11T22:13:26.200 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.007308309 2024-09-11T22:13:26.200 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:26.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.200 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-09-11T22:13:26.200 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-09-11T22:13:26.201 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-09-11T22:13:26.201 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3708, 2024-09-11T22:13:26.201 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.333046277, 2024-09-11T22:13:26.201 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000359505 2024-09-11T22:13:26.201 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:26.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.201 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-09-11T22:13:26.201 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 25577, 2024-09-11T22:13:26.201 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 25577, 2024-09-11T22:13:26.201 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-09-11T22:13:26.201 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 25577, 2024-09-11T22:13:26.201 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 383.855681200, 2024-09-11T22:13:26.201 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.015007846 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 0, 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 0, 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 0, 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 12, 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 0, 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 0, 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 17890, 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 0, 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 17890, 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 0, 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 17889, 2024-09-11T22:13:26.202 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 0, 2024-09-11T22:13:26.203 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 2, 2024-09-11T22:13:26.203 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 2, 2024-09-11T22:13:26.203 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 2, 2024-09-11T22:13:26.203 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 46363, 2024-09-11T22:13:26.203 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 45906, 2024-09-11T22:13:26.203 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 0, 2024-09-11T22:13:26.203 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 0, 2024-09-11T22:13:26.203 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:13:26.203 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-09-11T22:13:26.203 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 87, 2024-09-11T22:13:26.203 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 0, 2024-09-11T22:13:26.203 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 0, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 0, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 0, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 0, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 1695, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 0, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 0, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 0, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 1695, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:13:26.204 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:13:26.205 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 13, 2024-09-11T22:13:26.205 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 2, 2024-09-11T22:13:26.205 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 11, 2024-09-11T22:13:26.205 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 1682, 2024-09-11T22:13:26.205 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:13:26.205 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 1273, 2024-09-11T22:13:26.205 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 4046, 2024-09-11T22:13:26.205 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:13:26.205 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:13:26.205 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:13:26.205 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 3276, 2024-09-11T22:13:26.205 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 2382, 2024-09-11T22:13:26.205 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 50, 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 14054 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 0, 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 0, 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 0, 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 0, 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 0, 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 0, 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 0, 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 4152, 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 3582, 2024-09-11T22:13:26.206 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 2231, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 1, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 0, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-09-11T22:13:26.207 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0 2024-09-11T22:13:26.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.208 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-09-11T22:13:26.208 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 0, 2024-09-11T22:13:26.208 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 26498, 2024-09-11T22:13:26.208 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 0, 2024-09-11T22:13:26.208 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 0, 2024-09-11T22:13:26.208 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 26498, 2024-09-11T22:13:26.208 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 0, 2024-09-11T22:13:26.208 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 0, 2024-09-11T22:13:26.208 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 33, 2024-09-11T22:13:26.208 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 0, 2024-09-11T22:13:26.208 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 0, 2024-09-11T22:13:26.208 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 33, 2024-09-11T22:13:26.209 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 4, 2024-09-11T22:13:26.209 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 0, 2024-09-11T22:13:26.209 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 0, 2024-09-11T22:13:26.209 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 4194304, 2024-09-11T22:13:26.209 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 95639073, 2024-09-11T22:13:26.209 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 0, 2024-09-11T22:13:26.209 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-09-11T22:13:26.209 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2593, 2024-09-11T22:13:26.209 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 109.516967943, 2024-09-11T22:13:26.209 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.042235622 2024-09-11T22:13:26.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.209 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 0 2024-09-11T22:13:26.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 14, 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 2016, 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 2002, 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 13, 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 13, 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 0, 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 17890, 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 19891, 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 2001, 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 2, 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 7055, 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 7053, 2024-09-11T22:13:26.210 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 109612, 2024-09-11T22:13:26.211 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 231788 2024-09-11T22:13:26.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.211 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-09-11T22:13:26.211 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 28417, 2024-09-11T22:13:26.211 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 0, 2024-09-11T22:13:26.211 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 25577, 2024-09-11T22:13:26.211 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 5, 2024-09-11T22:13:26.211 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 0, 2024-09-11T22:13:26.211 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-09-11T22:13:26.211 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2000, 2024-09-11T22:13:26.211 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.926000466, 2024-09-11T22:13:26.211 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000963000 2024-09-11T22:13:26.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.212 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-09-11T22:13:26.212 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 30, 2024-09-11T22:13:26.212 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.005520411, 2024-09-11T22:13:26.212 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000184013 2024-09-11T22:13:26.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.212 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-09-11T22:13:26.212 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.212 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.212 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.212 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-09-11T22:13:26.212 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 6000, 2024-09-11T22:13:26.212 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 7.880192940, 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.001313365 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 7302, 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 5.709236919, 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000781873 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-09-11T22:13:26.213 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.214 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.214 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.214 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-09-11T22:13:26.214 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.214 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.214 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.214 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-09-11T22:13:26.214 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.214 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.214 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.215 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-09-11T22:13:26.215 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:13:26.215 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000045112, 2024-09-11T22:13:26.215 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000045112 2024-09-11T22:13:26.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.215 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-09-11T22:13:26.215 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.215 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.215 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.215 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-09-11T22:13:26.216 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:13:26.216 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.003023169, 2024-09-11T22:13:26.216 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.003023169 2024-09-11T22:13:26.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.216 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-09-11T22:13:26.216 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.216 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.216 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.216 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-09-11T22:13:26.216 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:13:26.217 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.442395978, 2024-09-11T22:13:26.217 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.442395978 2024-09-11T22:13:26.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.217 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-09-11T22:13:26.217 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:13:26.217 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000140134, 2024-09-11T22:13:26.217 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000140134 2024-09-11T22:13:26.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.217 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-09-11T22:13:26.217 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8, 2024-09-11T22:13:26.217 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.352239013, 2024-09-11T22:13:26.217 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.044029876 2024-09-11T22:13:26.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.218 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-09-11T22:13:26.218 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2231, 2024-09-11T22:13:26.218 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 348.748754199, 2024-09-11T22:13:26.218 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.156319477 2024-09-11T22:13:26.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.218 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-09-11T22:13:26.218 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.218 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.218 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.218 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-09-11T22:13:26.218 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.218 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.065474845, 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.065474845 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-09-11T22:13:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.220 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.220 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.220 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-09-11T22:13:26.220 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:13:26.220 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000260056, 2024-09-11T22:13:26.220 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000260056 2024-09-11T22:13:26.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.220 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-09-11T22:13:26.220 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.220 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.220 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.221 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-09-11T22:13:26.221 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.221 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.221 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.221 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-09-11T22:13:26.221 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.221 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.221 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.221 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-09-11T22:13:26.221 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.221 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8000, 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 18.722397958, 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.002340299 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:13:26.222 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 1, 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 1, 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 0, 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 1, 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 18470, 2024-09-11T22:13:26.223 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 18470, 2024-09-11T22:13:26.224 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 77, 2024-09-11T22:13:26.224 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-09-11T22:13:26.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.224 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-09-11T22:13:26.224 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:13:26.224 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-09-11T22:13:26.224 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:13:26.224 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:13:26.224 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:13:26.224 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:13:26.224 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:13:26.224 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:13:26.224 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:13:26.225 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:13:26.226 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 250331, 2024-09-11T22:13:26.227 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 92, 2024-09-11T22:13:26.227 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 440, 2024-09-11T22:13:26.227 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 5, 2024-09-11T22:13:26.227 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-09-11T22:13:26.227 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-09-11T22:13:26.227 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:13:26.227 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-09-11T22:13:26.227 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:13:26.227 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-09-11T22:13:26.227 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 5416, 2024-09-11T22:13:26.227 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 77, 2024-09-11T22:13:26.227 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 13472989, 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 661514, 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-09-11T22:13:26.228 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 8126, 2024-09-11T22:13:26.229 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 92113263, 2024-09-11T22:13:26.229 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 37, 2024-09-11T22:13:26.229 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 8126, 2024-09-11T22:13:26.229 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-09-11T22:13:26.229 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8126, 2024-09-11T22:13:26.229 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 28.251271593, 2024-09-11T22:13:26.229 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.003476651 2024-09-11T22:13:26.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.229 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-09-11T22:13:26.229 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-09-11T22:13:26.229 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8126, 2024-09-11T22:13:26.229 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 8224 2024-09-11T22:13:26.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 8126, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 1754, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 6372, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 0, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 11, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 57, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 2648, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 35, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 1582, 2024-09-11T22:13:26.230 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 0, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 2033, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 1697, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 22, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:13:26.231 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-09-11T22:13:26.232 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-09-11T22:13:26.233 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-09-11T22:13:26.233 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-09-11T22:13:26.233 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-09-11T22:13:26.233 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-09-11T22:13:26.233 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 34, 2024-09-11T22:13:26.233 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-09-11T22:13:26.233 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 3, 2024-09-11T22:13:26.233 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 8, 2024-09-11T22:13:26.233 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 8, 2024-09-11T22:13:26.233 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 0, 2024-09-11T22:13:26.233 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-09-11T22:13:26.233 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 108, 2024-09-11T22:13:26.233 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 0, 2024-09-11T22:13:26.234 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 31 2024-09-11T22:13:26.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.234 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-09-11T22:13:26.234 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 1, 2024-09-11T22:13:26.234 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:13:26.234 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-09-11T22:13:26.234 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-09-11T22:13:26.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.234 INFO:teuthology.orchestra.run.smithi050.stdout: "osd-slow-ops": { 2024-09-11T22:13:26.234 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 0 2024-09-11T22:13:26.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.234 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-09-11T22:13:26.234 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 32, 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 32, 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 3582, 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 3582, 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 34979, 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 8708154, 2024-09-11T22:13:26.235 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:13:26.236 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 34979, 2024-09-11T22:13:26.236 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-11T22:13:26.236 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-11T22:13:26.236 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 34979, 2024-09-11T22:13:26.236 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 8708154, 2024-09-11T22:13:26.236 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:13:26.236 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.236 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.236 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.236 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:26.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.236 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-09-11T22:13:26.236 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:13:26.237 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-09-11T22:13:26.237 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:13:26.237 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-09-11T22:13:26.237 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-09-11T22:13:26.237 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:13:26.237 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-09-11T22:13:26.237 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 8126, 2024-09-11T22:13:26.237 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 92487701, 2024-09-11T22:13:26.237 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 8126, 2024-09-11T22:13:26.237 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 92487701, 2024-09-11T22:13:26.237 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:13:26.237 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.237 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 8126, 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 8126, 2024-09-11T22:13:26.238 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 8126, 2024-09-11T22:13:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 8126, 2024-09-11T22:13:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:13:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:13:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:13:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-09-11T22:13:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:13:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 3582, 2024-09-11T22:13:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 374438, 2024-09-11T22:13:26.240 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:13:26.240 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 3582, 2024-09-11T22:13:26.240 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-11T22:13:26.240 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-11T22:13:26.240 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 55, 2024-09-11T22:13:26.240 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 374438, 2024-09-11T22:13:26.240 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:13:26.240 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.240 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.240 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.240 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:26.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:26.240 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x5567f1cc8500": { 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 26498, 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 91444769, 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 26498, 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 2593, 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 91444769, 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:13:26.241 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:13:26.242 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:13:26.242 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:26.242 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:26.242 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.185+0000 7ff8f9b0a640 1 -- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff8e006be30 msgr2=0x7ff8e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.185+0000 7ff8f9b0a640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff8e006be30 0x7ff8e006e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff8f41580b0 tx=0x7ff8e8008040 comp rx=0 tx=0).stop 2024-09-11T22:13:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.185+0000 7ff8f9b0a640 1 -- 172.21.15.50:0/3531929859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4147f80 msgr2=0x7ff8f4158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.185+0000 7ff8f9b0a640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4147f80 0x7ff8f4158360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4007290 tx=0x7ff8e4007750 comp rx=0 tx=0).stop 2024-09-11T22:13:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.185+0000 7ff8f9b0a640 1 -- 172.21.15.50:0/3531929859 shutdown_connections 2024-09-11T22:13:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.185+0000 7ff8f9b0a640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff8e006be30 0x7ff8e006e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.185+0000 7ff8f9b0a640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8f414b1a0 0x7ff8f414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.185+0000 7ff8f9b0a640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f414bb40 0x7ff8f4071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.185+0000 7ff8f9b0a640 1 --2- 172.21.15.50:0/3531929859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8f4147f80 0x7ff8f4158360 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.185+0000 7ff8f9b0a640 1 -- 172.21.15.50:0/3531929859 >> 172.21.15.50:0/3531929859 conn(0x7ff8f40679c0 msgr2=0x7ff8f40b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.185+0000 7ff8f9b0a640 1 -- 172.21.15.50:0/3531929859 shutdown_connections 2024-09-11T22:13:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.185+0000 7ff8f9b0a640 1 -- 172.21.15.50:0/3531929859 wait complete. 2024-09-11T22:13:26.245 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:13:26.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:13:26.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:13:26.331 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:13:26.331 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:13:26.332 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:13:26.332 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:13:26.348 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:13:26.348 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:13:26.405 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:13:26.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.547+0000 7f67c1949640 1 Processor -- start 2024-09-11T22:13:26.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.547+0000 7f67c1949640 1 -- start start 2024-09-11T22:13:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.548+0000 7f67c1949640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67bc15c510 0x7f67bc06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.548+0000 7f67c1949640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67bc06e730 0x7f67bc0679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.548+0000 7f67c1949640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67bc06ec90 con 0x7f67bc067f00 2024-09-11T22:13:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.548+0000 7f67c1949640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f67bc06ef70 con 0x7f67bc15c510 2024-09-11T22:13:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.548+0000 7f67c1949640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f67bc06f250 con 0x7f67bc06e730 2024-09-11T22:13:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.548+0000 7f67baffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67bc15c510 0x7f67bc06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.548+0000 7f67baffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67bc15c510 0x7f67bc06e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48692/0 (socket says 172.21.15.50:48692) 2024-09-11T22:13:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.548+0000 7f67baffd640 1 -- 172.21.15.50:0/3898798105 learned_addr learned my addr 172.21.15.50:0/3898798105 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.548+0000 7f67ba7fc640 1 --2- 172.21.15.50:0/3898798105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67bc06e730 0x7f67bc0679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.548+0000 7f67baffd640 1 -- 172.21.15.50:0/3898798105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67bc06e730 msgr2=0x7f67bc0679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.548+0000 7f67baffd640 1 --2- 172.21.15.50:0/3898798105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67bc06e730 0x7f67bc0679c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.548+0000 7f67baffd640 1 -- 172.21.15.50:0/3898798105 >> v1:172.21.15.77:6789/0 conn(0x7f67bc067f00 legacy=0x7f67bc072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:26.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.548+0000 7f67baffd640 1 -- 172.21.15.50:0/3898798105 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67bc06f530 con 0x7f67bc15c510 2024-09-11T22:13:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.549+0000 7f67baffd640 1 --2- 172.21.15.50:0/3898798105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67bc15c510 0x7f67bc06e1f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f67ac009870 tx=0x7f67ac02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e9e3d43d32a17d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.549+0000 7f67b9ffb640 1 -- 172.21.15.50:0/3898798105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac037070 con 0x7f67bc15c510 2024-09-11T22:13:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.549+0000 7f67b9ffb640 1 -- 172.21.15.50:0/3898798105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac032440 con 0x7f67bc15c510 2024-09-11T22:13:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.549+0000 7f67b9ffb640 1 -- 172.21.15.50:0/3898798105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac032810 con 0x7f67bc15c510 2024-09-11T22:13:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.550+0000 7f67c1949640 1 -- 172.21.15.50:0/3898798105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67bc15c510 msgr2=0x7f67bc06e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.550+0000 7f67c1949640 1 --2- 172.21.15.50:0/3898798105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67bc15c510 0x7f67bc06e1f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f67ac009870 tx=0x7f67ac02a210 comp rx=0 tx=0).stop 2024-09-11T22:13:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.550+0000 7f67c1949640 1 -- 172.21.15.50:0/3898798105 shutdown_connections 2024-09-11T22:13:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.550+0000 7f67c1949640 1 --2- 172.21.15.50:0/3898798105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67bc06e730 0x7f67bc0679c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.550+0000 7f67c1949640 1 --2- 172.21.15.50:0/3898798105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67bc15c510 0x7f67bc06e1f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.550+0000 7f67c1949640 1 -- 172.21.15.50:0/3898798105 >> 172.21.15.50:0/3898798105 conn(0x7f67bc075060 msgr2=0x7f67bc06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.550+0000 7f67c1949640 1 -- 172.21.15.50:0/3898798105 shutdown_connections 2024-09-11T22:13:26.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.550+0000 7f67c1949640 1 -- 172.21.15.50:0/3898798105 wait complete. 2024-09-11T22:13:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.551+0000 7f67c1949640 1 Processor -- start 2024-09-11T22:13:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.551+0000 7f67c1949640 1 -- start start 2024-09-11T22:13:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67c1949640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67bc067f00 0x7f67bc14eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67c1949640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67bc06e730 0x7f67bc13de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67c1949640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67bc15c510 0x7f67bc14d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67c1949640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc06fd30 con 0x7f67bc15c510 2024-09-11T22:13:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67c1949640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc06c820 con 0x7f67bc06e730 2024-09-11T22:13:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67c1949640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f67bc15d900 con 0x7f67bc067f00 2024-09-11T22:13:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67bb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67bc15c510 0x7f67bc14d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67bb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67bc15c510 0x7f67bc14d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48702/0 (socket says 172.21.15.50:48702) 2024-09-11T22:13:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67bb7fe640 1 -- 172.21.15.50:0/4274032438 learned_addr learned my addr 172.21.15.50:0/4274032438 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67baffd640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67bc067f00 0x7f67bc14eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67ba7fc640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67bc06e730 0x7f67bc13de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67bb7fe640 1 -- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67bc067f00 msgr2=0x7f67bc14eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67bb7fe640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67bc067f00 0x7f67bc14eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67bb7fe640 1 -- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67bc06e730 msgr2=0x7f67bc13de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67bb7fe640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67bc06e730 0x7f67bc13de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67bb7fe640 1 -- 172.21.15.50:0/4274032438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67bc14dad0 con 0x7f67bc15c510 2024-09-11T22:13:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.552+0000 7f67bb7fe640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67bc15c510 0x7f67bc14d160 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b970 tx=0x7f67b400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.553+0000 7f67a3fff640 1 -- 172.21.15.50:0/4274032438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b4019070 con 0x7f67bc15c510 2024-09-11T22:13:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.553+0000 7f67a3fff640 1 -- 172.21.15.50:0/4274032438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b400cb40 con 0x7f67bc15c510 2024-09-11T22:13:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.553+0000 7f67c1949640 1 -- 172.21.15.50:0/4274032438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67bc14ddb0 con 0x7f67bc15c510 2024-09-11T22:13:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.553+0000 7f67a3fff640 1 -- 172.21.15.50:0/4274032438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b4014440 con 0x7f67bc15c510 2024-09-11T22:13:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.553+0000 7f67c1949640 1 -- 172.21.15.50:0/4274032438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67bc14e370 con 0x7f67bc15c510 2024-09-11T22:13:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.554+0000 7f67c1949640 1 -- 172.21.15.50:0/4274032438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67bc0679c0 con 0x7f67bc15c510 2024-09-11T22:13:26.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.554+0000 7f67a3fff640 1 -- 172.21.15.50:0/4274032438 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67b401c070 con 0x7f67bc15c510 2024-09-11T22:13:26.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.555+0000 7f67a3fff640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67a806be60 0x7f67a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:26.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.555+0000 7f67a3fff640 1 -- 172.21.15.50:0/4274032438 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7f67b408aaa0 con 0x7f67bc15c510 2024-09-11T22:13:26.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.555+0000 7f67baffd640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67a806be60 0x7f67a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:26.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.555+0000 7f67baffd640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67a806be60 0x7f67a806e320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f67ac034000 tx=0x7f67ac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:26.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.559+0000 7f67a3fff640 1 -- 172.21.15.50:0/4274032438 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67b4058de0 con 0x7f67bc15c510 2024-09-11T22:13:26.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.745+0000 7f67c1949640 1 -- 172.21.15.50:0/4274032438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f67bc0b40a0 con 0x7f67bc15c510 2024-09-11T22:13:26.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.745+0000 7f67a3fff640 1 -- 172.21.15.50:0/4274032438 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f67b405d0e0 con 0x7f67bc15c510 2024-09-11T22:13:26.746 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:13:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.747+0000 7f67c1949640 1 -- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67a806be60 msgr2=0x7f67a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.747+0000 7f67c1949640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67a806be60 0x7f67a806e320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f67ac034000 tx=0x7f67ac02e000 comp rx=0 tx=0).stop 2024-09-11T22:13:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.747+0000 7f67c1949640 1 -- 172.21.15.50:0/4274032438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67bc15c510 msgr2=0x7f67bc14d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.747+0000 7f67c1949640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67bc15c510 0x7f67bc14d160 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b970 tx=0x7f67b400be30 comp rx=0 tx=0).stop 2024-09-11T22:13:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.747+0000 7f67c1949640 1 -- 172.21.15.50:0/4274032438 shutdown_connections 2024-09-11T22:13:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.747+0000 7f67c1949640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67a806be60 0x7f67a806e320 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.747+0000 7f67c1949640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67bc15c510 0x7f67bc14d160 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.747+0000 7f67c1949640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67bc06e730 0x7f67bc13de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.747+0000 7f67c1949640 1 --2- 172.21.15.50:0/4274032438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67bc067f00 0x7f67bc14eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.747+0000 7f67c1949640 1 -- 172.21.15.50:0/4274032438 >> 172.21.15.50:0/4274032438 conn(0x7f67bc075060 msgr2=0x7f67bc0b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.747+0000 7f67c1949640 1 -- 172.21.15.50:0/4274032438 shutdown_connections 2024-09-11T22:13:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:26.747+0000 7f67c1949640 1 -- 172.21.15.50:0/4274032438 wait complete. 2024-09-11T22:13:26.758 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:13:26.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:26.758 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:13:26.797 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:13:26.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:26.798 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:13:26.854 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:13:26.855 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:13:26.855 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:13:26.872 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:13:26.872 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:13:26.872 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:13:26.872 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:13:26.911 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:13:26.911 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:13:26.911 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:13:26.911 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:13:26.928 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:13:26.929 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:13:27.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.052+0000 7fed1d352640 1 Processor -- start 2024-09-11T22:13:27.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.052+0000 7fed1d352640 1 -- start start 2024-09-11T22:13:27.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed1d352640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed180d1c90 0x7fed180b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed1d352640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed18162350 0x7fed181627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed1d352640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed18163080 con 0x7fed1815e8e0 2024-09-11T22:13:27.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed1d352640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fed1815ecc0 con 0x7fed18162350 2024-09-11T22:13:27.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed1d352640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fed180d2ad0 con 0x7fed180d1c90 2024-09-11T22:13:27.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed177fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed18162350 0x7fed181627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed167fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed180d1c90 0x7fed180b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed167fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed180d1c90 0x7fed180b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:37182/0 (socket says 172.21.15.50:37182) 2024-09-11T22:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed16ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fed1815e8e0 0x7fed180d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:57178/0 (socket says 172.21.15.50:57178) 2024-09-11T22:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed177fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed18162350 0x7fed181627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:32920/0 (socket says 172.21.15.50:32920) 2024-09-11T22:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed167fc640 1 -- 172.21.15.50:0/1547692194 learned_addr learned my addr 172.21.15.50:0/1547692194 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed167fc640 1 -- 172.21.15.50:0/1547692194 >> v2:172.21.15.77:3300/0 conn(0x7fed18162350 msgr2=0x7fed181627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed167fc640 1 --2- 172.21.15.50:0/1547692194 >> v2:172.21.15.77:3300/0 conn(0x7fed18162350 0x7fed181627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed167fc640 1 -- 172.21.15.50:0/1547692194 >> v1:172.21.15.77:6789/0 conn(0x7fed1815e8e0 legacy=0x7fed180d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.053+0000 7fed167fc640 1 -- 172.21.15.50:0/1547692194 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed180d2d20 con 0x7fed180d1c90 2024-09-11T22:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.054+0000 7fed167fc640 1 --2- 172.21.15.50:0/1547692194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed180d1c90 0x7fed180b7880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009870 tx=0x7fed0c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c15b12537ebc3cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.054+0000 7fed15ffb640 1 -- 172.21.15.50:0/1547692194 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c037070 con 0x7fed180d1c90 2024-09-11T22:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.054+0000 7fed15ffb640 1 -- 172.21.15.50:0/1547692194 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed0c02ae50 con 0x7fed180d1c90 2024-09-11T22:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.054+0000 7fed15ffb640 1 -- 172.21.15.50:0/1547692194 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c032860 con 0x7fed180d1c90 2024-09-11T22:13:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.055+0000 7fed1d352640 1 -- 172.21.15.50:0/1547692194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed180d1c90 msgr2=0x7fed180b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.055+0000 7fed1d352640 1 --2- 172.21.15.50:0/1547692194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed180d1c90 0x7fed180b7880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009870 tx=0x7fed0c02a300 comp rx=0 tx=0).stop 2024-09-11T22:13:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.055+0000 7fed1d352640 1 -- 172.21.15.50:0/1547692194 shutdown_connections 2024-09-11T22:13:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.055+0000 7fed1d352640 1 --2- 172.21.15.50:0/1547692194 >> v2:172.21.15.77:3300/0 conn(0x7fed18162350 0x7fed181627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.055+0000 7fed1d352640 1 --2- 172.21.15.50:0/1547692194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed180d1c90 0x7fed180b7880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.055+0000 7fed1d352640 1 -- 172.21.15.50:0/1547692194 >> 172.21.15.50:0/1547692194 conn(0x7fed18067ba0 msgr2=0x7fed18067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.055+0000 7fed1d352640 1 -- 172.21.15.50:0/1547692194 shutdown_connections 2024-09-11T22:13:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.055+0000 7fed1d352640 1 -- 172.21.15.50:0/1547692194 wait complete. 2024-09-11T22:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.056+0000 7fed1d352640 1 Processor -- start 2024-09-11T22:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.057+0000 7fed1d352640 1 -- start start 2024-09-11T22:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.057+0000 7fed1d352640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed180d1c90 0x7fed180ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.057+0000 7fed1d352640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed1815e8e0 0x7fed1814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.057+0000 7fed1d352640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed18162350 0x7fed180b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.057+0000 7fed1d352640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fed18162d20 con 0x7fed180d1c90 2024-09-11T22:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.057+0000 7fed1d352640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed180d3370 con 0x7fed18162350 2024-09-11T22:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.057+0000 7fed1d352640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fed180d3800 con 0x7fed1815e8e0 2024-09-11T22:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.057+0000 7fed16ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed180d1c90 0x7fed180ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.057+0000 7fed16ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed180d1c90 0x7fed180ce5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48718/0 (socket says 172.21.15.50:48718) 2024-09-11T22:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.057+0000 7fed16ffd640 1 -- 172.21.15.50:0/751736637 learned_addr learned my addr 172.21.15.50:0/751736637 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.057+0000 7fed167fc640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed1815e8e0 0x7fed1814ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.057+0000 7fed177fe640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed18162350 0x7fed180b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.058+0000 7fed16ffd640 1 -- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed1815e8e0 msgr2=0x7fed1814ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.058+0000 7fed16ffd640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed1815e8e0 0x7fed1814ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.058+0000 7fed16ffd640 1 -- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed18162350 msgr2=0x7fed180b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.058+0000 7fed16ffd640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed18162350 0x7fed180b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.058+0000 7fed16ffd640 1 -- 172.21.15.50:0/751736637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1814efb0 con 0x7fed180d1c90 2024-09-11T22:13:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.058+0000 7fed16ffd640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed180d1c90 0x7fed180ce5d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fed0800c400 tx=0x7fed0800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.058+0000 7fecff7fe640 1 -- 172.21.15.50:0/751736637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed080074e0 con 0x7fed180d1c90 2024-09-11T22:13:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.058+0000 7fecff7fe640 1 -- 172.21.15.50:0/751736637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed08007680 con 0x7fed180d1c90 2024-09-11T22:13:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.058+0000 7fed1d352640 1 -- 172.21.15.50:0/751736637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed180b5810 con 0x7fed180d1c90 2024-09-11T22:13:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.058+0000 7fecff7fe640 1 -- 172.21.15.50:0/751736637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08004a00 con 0x7fed180d1c90 2024-09-11T22:13:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.058+0000 7fed1d352640 1 -- 172.21.15.50:0/751736637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed180b5dd0 con 0x7fed180d1c90 2024-09-11T22:13:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.059+0000 7fed1d352640 1 -- 172.21.15.50:0/751736637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed180b7880 con 0x7fed180d1c90 2024-09-11T22:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.060+0000 7fecff7fe640 1 -- 172.21.15.50:0/751736637 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed0801a020 con 0x7fed180d1c90 2024-09-11T22:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.060+0000 7fecff7fe640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed0406be60 0x7fed0406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.060+0000 7fecff7fe640 1 -- 172.21.15.50:0/751736637 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7fed0808a4a0 con 0x7fed180d1c90 2024-09-11T22:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.060+0000 7fed167fc640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed0406be60 0x7fed0406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.061+0000 7fed167fc640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed0406be60 0x7fed0406e320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fed0c034000 tx=0x7fed0c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:27.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.064+0000 7fecff7fe640 1 -- 172.21.15.50:0/751736637 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed08058870 con 0x7fed180d1c90 2024-09-11T22:13:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.274+0000 7fed1d352640 1 -- 172.21.15.50:0/751736637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed180ba770 con 0x7fed180d1c90 2024-09-11T22:13:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.274+0000 7fecff7fe640 1 -- 172.21.15.50:0/751736637 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5217 (secure 0 0 0) 0x7fed0805cb70 con 0x7fed180d1c90 2024-09-11T22:13:27.275 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:27.275 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"btime":"2024-09-11T22:12:07:439974+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3019059033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3019059033},{"type":"v1","addr":"172.21.15.77:6836","nonce":3019059033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/151985123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":151985123},{"type":"v1","addr":"172.21.15.50:6835","nonce":151985123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4699,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3475311289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3475311289},{"type":"v1","addr":"172.21.15.77:6837","nonce":3475311289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-11T22:11:54.587183+0000","modified":"2024-09-11T22:12:06.721702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4815},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4815":{"gid":4815,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6833/900288576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":900288576},{"type":"v1","addr":"172.21.15.50:6833","nonce":900288576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4815,"qdb_cluster":[4815]},"id":2}]} 2024-09-11T22:13:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2024-09-11T22:13:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.276+0000 7fed1d352640 1 -- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed0406be60 msgr2=0x7fed0406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.276+0000 7fed1d352640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed0406be60 0x7fed0406e320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fed0c034000 tx=0x7fed0c02e000 comp rx=0 tx=0).stop 2024-09-11T22:13:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.276+0000 7fed1d352640 1 -- 172.21.15.50:0/751736637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed180d1c90 msgr2=0x7fed180ce5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.276+0000 7fed1d352640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed180d1c90 0x7fed180ce5d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fed0800c400 tx=0x7fed0800c8c0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.276+0000 7fed1d352640 1 -- 172.21.15.50:0/751736637 shutdown_connections 2024-09-11T22:13:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.276+0000 7fed1d352640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed0406be60 0x7fed0406e320 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.276+0000 7fed1d352640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed1815e8e0 0x7fed1814ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.276+0000 7fed1d352640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed18162350 0x7fed180b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.276+0000 7fed1d352640 1 --2- 172.21.15.50:0/751736637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed180d1c90 0x7fed180ce5d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.276+0000 7fed1d352640 1 -- 172.21.15.50:0/751736637 >> 172.21.15.50:0/751736637 conn(0x7fed18067ba0 msgr2=0x7fed181616e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.276+0000 7fed1d352640 1 -- 172.21.15.50:0/751736637 shutdown_connections 2024-09-11T22:13:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.276+0000 7fed1d352640 1 -- 172.21.15.50:0/751736637 wait complete. 2024-09-11T22:13:27.288 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:13:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.389+0000 7ff387ad0640 1 Processor -- start 2024-09-11T22:13:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.390+0000 7ff387ad0640 1 -- start start 2024-09-11T22:13:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.390+0000 7ff387ad0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff38015e870 0x7ff3800d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.390+0000 7ff387ad0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3800d16d0 0x7ff3800d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.390+0000 7ff387ad0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3800cfa80 con 0x7ff3800d3a30 2024-09-11T22:13:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.390+0000 7ff387ad0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff3800d1b40 con 0x7ff3800d16d0 2024-09-11T22:13:27.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.390+0000 7ff387ad0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff3800d3e50 con 0x7ff38015e870 2024-09-11T22:13:27.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.390+0000 7ff38506b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3800d16d0 0x7ff3800d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.390+0000 7ff38606d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff3800d3a30 0x7ff3800b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39918/0 (socket says 172.21.15.50:39918) 2024-09-11T22:13:27.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.390+0000 7ff38606d640 1 -- 172.21.15.50:0/3625734460 learned_addr learned my addr 172.21.15.50:0/3625734460 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:27.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.391+0000 7ff38586c640 1 --2- 172.21.15.50:0/3625734460 >> v2:172.21.15.77:3300/0 conn(0x7ff38015e870 0x7ff3800d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.391+0000 7ff38506b640 1 -- 172.21.15.50:0/3625734460 >> v2:172.21.15.77:3300/0 conn(0x7ff38015e870 msgr2=0x7ff3800d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:27.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.391+0000 7ff38506b640 1 --2- 172.21.15.50:0/3625734460 >> v2:172.21.15.77:3300/0 conn(0x7ff38015e870 0x7ff3800d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.391+0000 7ff38506b640 1 -- 172.21.15.50:0/3625734460 >> v1:172.21.15.50:6789/0 conn(0x7ff3800d3a30 legacy=0x7ff3800b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.391+0000 7ff38506b640 1 -- 172.21.15.50:0/3625734460 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3800d40d0 con 0x7ff3800d16d0 2024-09-11T22:13:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.392+0000 7ff38506b640 1 --2- 172.21.15.50:0/3625734460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3800d16d0 0x7ff3800d34f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff3800d57c0 tx=0x7ff37002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24dc1e9dcb4c1b22 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.392+0000 7ff38486a640 1 -- 172.21.15.50:0/3625734460 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370037070 con 0x7ff3800d16d0 2024-09-11T22:13:27.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.392+0000 7ff38486a640 1 -- 172.21.15.50:0/3625734460 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff370032440 con 0x7ff3800d16d0 2024-09-11T22:13:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.392+0000 7ff38486a640 1 -- 172.21.15.50:0/3625734460 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370032810 con 0x7ff3800d16d0 2024-09-11T22:13:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.392+0000 7ff387ad0640 1 -- 172.21.15.50:0/3625734460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3800d16d0 msgr2=0x7ff3800d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.392+0000 7ff387ad0640 1 --2- 172.21.15.50:0/3625734460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3800d16d0 0x7ff3800d34f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff3800d57c0 tx=0x7ff37002a1a0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.392+0000 7ff387ad0640 1 -- 172.21.15.50:0/3625734460 shutdown_connections 2024-09-11T22:13:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.392+0000 7ff387ad0640 1 --2- 172.21.15.50:0/3625734460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3800d16d0 0x7ff3800d34f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.392+0000 7ff387ad0640 1 --2- 172.21.15.50:0/3625734460 >> v2:172.21.15.77:3300/0 conn(0x7ff38015e870 0x7ff3800d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.392+0000 7ff387ad0640 1 -- 172.21.15.50:0/3625734460 >> 172.21.15.50:0/3625734460 conn(0x7ff3800727a0 msgr2=0x7ff3800679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.392+0000 7ff387ad0640 1 -- 172.21.15.50:0/3625734460 shutdown_connections 2024-09-11T22:13:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.392+0000 7ff387ad0640 1 -- 172.21.15.50:0/3625734460 wait complete. 2024-09-11T22:13:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.394+0000 7ff387ad0640 1 Processor -- start 2024-09-11T22:13:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.394+0000 7ff387ad0640 1 -- start start 2024-09-11T22:13:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.394+0000 7ff387ad0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3800d16d0 0x7ff38014db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.394+0000 7ff387ad0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3800d3a30 0x7ff3800c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.394+0000 7ff387ad0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff38015e870 0x7ff3800b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.394+0000 7ff387ad0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff3800b7ee0 con 0x7ff3800d3a30 2024-09-11T22:13:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.394+0000 7ff387ad0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff3800b7c00 con 0x7ff3800d16d0 2024-09-11T22:13:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.394+0000 7ff387ad0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff38015ec50 con 0x7ff38015e870 2024-09-11T22:13:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.394+0000 7ff38506b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3800d3a30 0x7ff3800c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.394+0000 7ff38506b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3800d3a30 0x7ff3800c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48736/0 (socket says 172.21.15.50:48736) 2024-09-11T22:13:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.394+0000 7ff38506b640 1 -- 172.21.15.50:0/1250190392 learned_addr learned my addr 172.21.15.50:0/1250190392 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff38606d640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff38015e870 0x7ff3800b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff38506b640 1 -- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff38015e870 msgr2=0x7ff3800b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff38506b640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff38015e870 0x7ff3800b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff38506b640 1 -- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3800d16d0 msgr2=0x7ff38014db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff38586c640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3800d16d0 0x7ff38014db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff38506b640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3800d16d0 0x7ff38014db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff38506b640 1 -- 172.21.15.50:0/1250190392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3800ca280 con 0x7ff3800d3a30 2024-09-11T22:13:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff38586c640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3800d16d0 0x7ff38014db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff38506b640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3800d3a30 0x7ff3800c9910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff370009890 tx=0x7ff3700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff3767fc640 1 -- 172.21.15.50:0/1250190392 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370037040 con 0x7ff3800d3a30 2024-09-11T22:13:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff3767fc640 1 -- 172.21.15.50:0/1250190392 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff370042070 con 0x7ff3800d3a30 2024-09-11T22:13:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff387ad0640 1 -- 172.21.15.50:0/1250190392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3800ca560 con 0x7ff3800d3a30 2024-09-11T22:13:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff3767fc640 1 -- 172.21.15.50:0/1250190392 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370030bd0 con 0x7ff3800d3a30 2024-09-11T22:13:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.395+0000 7ff387ad0640 1 -- 172.21.15.50:0/1250190392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3800cab20 con 0x7ff3800d3a30 2024-09-11T22:13:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.396+0000 7ff387ad0640 1 -- 172.21.15.50:0/1250190392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff380068600 con 0x7ff3800d3a30 2024-09-11T22:13:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.397+0000 7ff3767fc640 1 -- 172.21.15.50:0/1250190392 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff370047460 con 0x7ff3800d3a30 2024-09-11T22:13:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.397+0000 7ff3767fc640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff36406be60 0x7ff36406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.397+0000 7ff3767fc640 1 -- 172.21.15.50:0/1250190392 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7ff3700ab980 con 0x7ff3800d3a30 2024-09-11T22:13:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.397+0000 7ff38586c640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff36406be60 0x7ff36406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.398+0000 7ff38586c640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff36406be60 0x7ff36406e320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff3800b64d0 tx=0x7ff37c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:27.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.401+0000 7ff3767fc640 1 -- 172.21.15.50:0/1250190392 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff380068600 con 0x7ff3800d3a30 2024-09-11T22:13:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.614+0000 7ff387ad0640 1 -- 172.21.15.50:0/1250190392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3800b78b0 con 0x7ff3800d3a30 2024-09-11T22:13:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.614+0000 7ff3767fc640 1 -- 172.21.15.50:0/1250190392 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5217 (secure 0 0 0) 0x7ff370032e20 con 0x7ff3800d3a30 2024-09-11T22:13:27.615 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:27.615 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"btime":"2024-09-11T22:12:07:439974+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3019059033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3019059033},{"type":"v1","addr":"172.21.15.77:6836","nonce":3019059033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/151985123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":151985123},{"type":"v1","addr":"172.21.15.50:6835","nonce":151985123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4699,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3475311289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3475311289},{"type":"v1","addr":"172.21.15.77:6837","nonce":3475311289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-11T22:11:54.587183+0000","modified":"2024-09-11T22:12:06.721702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4815},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4815":{"gid":4815,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6833/900288576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":900288576},{"type":"v1","addr":"172.21.15.50:6833","nonce":900288576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4815,"qdb_cluster":[4815]},"id":2}]} 2024-09-11T22:13:27.616 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2024-09-11T22:13:27.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.616+0000 7ff387ad0640 1 -- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff36406be60 msgr2=0x7ff36406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.616+0000 7ff387ad0640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff36406be60 0x7ff36406e320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff3800b64d0 tx=0x7ff37c00b040 comp rx=0 tx=0).stop 2024-09-11T22:13:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.616+0000 7ff387ad0640 1 -- 172.21.15.50:0/1250190392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3800d3a30 msgr2=0x7ff3800c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.616+0000 7ff387ad0640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3800d3a30 0x7ff3800c9910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff370009890 tx=0x7ff3700046c0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.616+0000 7ff387ad0640 1 -- 172.21.15.50:0/1250190392 shutdown_connections 2024-09-11T22:13:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.616+0000 7ff387ad0640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff36406be60 0x7ff36406e320 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.616+0000 7ff387ad0640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff38015e870 0x7ff3800b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.616+0000 7ff387ad0640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3800d3a30 0x7ff3800c9910 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.616+0000 7ff387ad0640 1 --2- 172.21.15.50:0/1250190392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3800d16d0 0x7ff38014db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.616+0000 7ff387ad0640 1 -- 172.21.15.50:0/1250190392 >> 172.21.15.50:0/1250190392 conn(0x7ff3800727a0 msgr2=0x7ff38015eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.616+0000 7ff387ad0640 1 -- 172.21.15.50:0/1250190392 shutdown_connections 2024-09-11T22:13:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.617+0000 7ff387ad0640 1 -- 172.21.15.50:0/1250190392 wait complete. 2024-09-11T22:13:27.628 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:13:27.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.728+0000 7fbd8800a640 1 Processor -- start 2024-09-11T22:13:27.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.729+0000 7fbd8800a640 1 -- start start 2024-09-11T22:13:27.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.729+0000 7fbd8800a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd800d18a0 0x7fbd800d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.729+0000 7fbd8800a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd800d3a30 0x7fbd800b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.729+0000 7fbd8800a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd800cfa80 con 0x7fbd8015e870 2024-09-11T22:13:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.729+0000 7fbd8800a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fbd800d3ea0 con 0x7fbd800d18a0 2024-09-11T22:13:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.729+0000 7fbd8800a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbd800d40d0 con 0x7fbd800d3a30 2024-09-11T22:13:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.729+0000 7fbd855a5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd800d18a0 0x7fbd800d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.730+0000 7fbd855a5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd800d18a0 0x7fbd800d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53342/0 (socket says 172.21.15.50:53342) 2024-09-11T22:13:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.730+0000 7fbd855a5640 1 -- 172.21.15.50:0/2446000839 learned_addr learned my addr 172.21.15.50:0/2446000839 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.730+0000 7fbd865a7640 1 --2- 172.21.15.50:0/2446000839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd800d3a30 0x7fbd800b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.730+0000 7fbd855a5640 1 -- 172.21.15.50:0/2446000839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd800d3a30 msgr2=0x7fbd800b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.730+0000 7fbd855a5640 1 --2- 172.21.15.50:0/2446000839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd800d3a30 0x7fbd800b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.730+0000 7fbd855a5640 1 -- 172.21.15.50:0/2446000839 >> v1:172.21.15.77:6789/0 conn(0x7fbd8015e870 legacy=0x7fbd800d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.730+0000 7fbd855a5640 1 -- 172.21.15.50:0/2446000839 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd800d43b0 con 0x7fbd800d18a0 2024-09-11T22:13:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.731+0000 7fbd855a5640 1 --2- 172.21.15.50:0/2446000839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd800d18a0 0x7fbd800d34f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009870 tx=0x7fbd7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a398a76a67d585d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.731+0000 7fbd84da4640 1 -- 172.21.15.50:0/2446000839 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd70037070 con 0x7fbd800d18a0 2024-09-11T22:13:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.731+0000 7fbd84da4640 1 -- 172.21.15.50:0/2446000839 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd70032440 con 0x7fbd800d18a0 2024-09-11T22:13:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.731+0000 7fbd84da4640 1 -- 172.21.15.50:0/2446000839 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd70032810 con 0x7fbd800d18a0 2024-09-11T22:13:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.731+0000 7fbd8800a640 1 -- 172.21.15.50:0/2446000839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd800d18a0 msgr2=0x7fbd800d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.731+0000 7fbd8800a640 1 --2- 172.21.15.50:0/2446000839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd800d18a0 0x7fbd800d34f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009870 tx=0x7fbd7002a270 comp rx=0 tx=0).stop 2024-09-11T22:13:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.731+0000 7fbd8800a640 1 -- 172.21.15.50:0/2446000839 shutdown_connections 2024-09-11T22:13:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.731+0000 7fbd8800a640 1 --2- 172.21.15.50:0/2446000839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd800d3a30 0x7fbd800b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.731+0000 7fbd8800a640 1 --2- 172.21.15.50:0/2446000839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd800d18a0 0x7fbd800d34f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.731+0000 7fbd8800a640 1 -- 172.21.15.50:0/2446000839 >> 172.21.15.50:0/2446000839 conn(0x7fbd800727a0 msgr2=0x7fbd800679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.731+0000 7fbd8800a640 1 -- 172.21.15.50:0/2446000839 shutdown_connections 2024-09-11T22:13:27.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.731+0000 7fbd8800a640 1 -- 172.21.15.50:0/2446000839 wait complete. 2024-09-11T22:13:27.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.732+0000 7fbd8800a640 1 Processor -- start 2024-09-11T22:13:27.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.733+0000 7fbd8800a640 1 -- start start 2024-09-11T22:13:27.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.733+0000 7fbd8800a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd800d18a0 0x7fbd8015c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.733+0000 7fbd8800a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd800d3a30 0x7fbd800cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.733+0000 7fbd8800a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd8015e870 0x7fbd8015cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.733+0000 7fbd8800a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8015ec50 con 0x7fbd800d18a0 2024-09-11T22:13:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.733+0000 7fbd8800a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbd800b7ee0 con 0x7fbd800d3a30 2024-09-11T22:13:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.733+0000 7fbd8800a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbd800b78b0 con 0x7fbd8015e870 2024-09-11T22:13:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.733+0000 7fbd85da6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd800d18a0 0x7fbd8015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.733+0000 7fbd85da6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd800d18a0 0x7fbd8015c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53354/0 (socket says 172.21.15.50:53354) 2024-09-11T22:13:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.733+0000 7fbd85da6640 1 -- 172.21.15.50:0/4235927483 learned_addr learned my addr 172.21.15.50:0/4235927483 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.733+0000 7fbd855a5640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd800d3a30 0x7fbd800cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.733+0000 7fbd865a7640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd8015e870 0x7fbd8015cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.734+0000 7fbd85da6640 1 -- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd8015e870 msgr2=0x7fbd8015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.734+0000 7fbd85da6640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd8015e870 0x7fbd8015cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.734+0000 7fbd85da6640 1 -- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd800d3a30 msgr2=0x7fbd800cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.734+0000 7fbd85da6640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd800d3a30 0x7fbd800cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.734+0000 7fbd85da6640 1 -- 172.21.15.50:0/4235927483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd800cc640 con 0x7fbd800d18a0 2024-09-11T22:13:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.734+0000 7fbd865a7640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd8015e870 0x7fbd8015cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.734+0000 7fbd85da6640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd800d18a0 0x7fbd8015c850 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00c430 tx=0x7fbd7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.734+0000 7fbd767fc640 1 -- 172.21.15.50:0/4235927483 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c017070 con 0x7fbd800d18a0 2024-09-11T22:13:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.734+0000 7fbd767fc640 1 -- 172.21.15.50:0/4235927483 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c0052d0 con 0x7fbd800d18a0 2024-09-11T22:13:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.734+0000 7fbd8800a640 1 -- 172.21.15.50:0/4235927483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd800cc920 con 0x7fbd800d18a0 2024-09-11T22:13:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.734+0000 7fbd767fc640 1 -- 172.21.15.50:0/4235927483 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c003850 con 0x7fbd800d18a0 2024-09-11T22:13:27.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.734+0000 7fbd8800a640 1 -- 172.21.15.50:0/4235927483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd800ccee0 con 0x7fbd800d18a0 2024-09-11T22:13:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.735+0000 7fbd8800a640 1 -- 172.21.15.50:0/4235927483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd800d34f0 con 0x7fbd800d18a0 2024-09-11T22:13:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.736+0000 7fbd767fc640 1 -- 172.21.15.50:0/4235927483 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd7c01a070 con 0x7fbd800d18a0 2024-09-11T22:13:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.736+0000 7fbd767fc640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbd6406be30 0x7fbd6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.737+0000 7fbd767fc640 1 -- 172.21.15.50:0/4235927483 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7fbd7c08a220 con 0x7fbd800d18a0 2024-09-11T22:13:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.737+0000 7fbd855a5640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbd6406be30 0x7fbd6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:27.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.737+0000 7fbd855a5640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbd6406be30 0x7fbd6406e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbd70034000 tx=0x7fbd7002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.741+0000 7fbd767fc640 1 -- 172.21.15.50:0/4235927483 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd800cfa80 con 0x7fbd800d18a0 2024-09-11T22:13:27.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.916+0000 7fbd8800a640 1 -- 172.21.15.50:0/4235927483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd800b4c90 con 0x7fbd800d18a0 2024-09-11T22:13:27.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.917+0000 7fbd767fc640 1 -- 172.21.15.50:0/4235927483 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16758 (secure 0 0 0) 0x7fbd7c0584d0 con 0x7fbd800d18a0 2024-09-11T22:13:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:27.918 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":34,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:13:05.979514+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:52.474592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:53.568181+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":33,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:13:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.919+0000 7fbd8800a640 1 -- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbd6406be30 msgr2=0x7fbd6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.919+0000 7fbd8800a640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbd6406be30 0x7fbd6406e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbd70034000 tx=0x7fbd7002e000 comp rx=0 tx=0).stop 2024-09-11T22:13:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.919+0000 7fbd8800a640 1 -- 172.21.15.50:0/4235927483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd800d18a0 msgr2=0x7fbd8015c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.919+0000 7fbd8800a640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd800d18a0 0x7fbd8015c850 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00c430 tx=0x7fbd7c00c8f0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.919+0000 7fbd8800a640 1 -- 172.21.15.50:0/4235927483 shutdown_connections 2024-09-11T22:13:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.919+0000 7fbd8800a640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbd6406be30 0x7fbd6406e2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.919+0000 7fbd8800a640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd8015e870 0x7fbd8015cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.919+0000 7fbd8800a640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd800d3a30 0x7fbd800cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.919+0000 7fbd8800a640 1 --2- 172.21.15.50:0/4235927483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd800d18a0 0x7fbd8015c850 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.919+0000 7fbd8800a640 1 -- 172.21.15.50:0/4235927483 >> 172.21.15.50:0/4235927483 conn(0x7fbd800727a0 msgr2=0x7fbd800ba160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.919+0000 7fbd8800a640 1 -- 172.21.15.50:0/4235927483 shutdown_connections 2024-09-11T22:13:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:27.919+0000 7fbd8800a640 1 -- 172.21.15.50:0/4235927483 wait complete. 2024-09-11T22:13:27.931 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:13:27.931 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:13:28.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.033+0000 7f5b7b2af640 1 Processor -- start 2024-09-11T22:13:28.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.033+0000 7f5b7b2af640 1 -- start start 2024-09-11T22:13:28.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7b2af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b7415e790 0x7f5b740d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7b2af640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b7415eb70 0x7f5b740d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7b2af640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b740d31b0 con 0x7f5b740ba230 2024-09-11T22:13:28.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7b2af640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5b740d3dc0 con 0x7f5b7415eb70 2024-09-11T22:13:28.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7b2af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5b740d3490 con 0x7f5b7415e790 2024-09-11T22:13:28.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7884a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b7415eb70 0x7f5b740d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7984c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5b740ba230 0x7f5b740d11d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57708/0 (socket says 172.21.15.50:57708) 2024-09-11T22:13:28.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7884a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b7415eb70 0x7f5b740d2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53366/0 (socket says 172.21.15.50:53366) 2024-09-11T22:13:28.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7984c640 1 -- 172.21.15.50:0/3732180945 learned_addr learned my addr 172.21.15.50:0/3732180945 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:28.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7904b640 1 --2- 172.21.15.50:0/3732180945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b7415e790 0x7f5b740d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7884a640 1 -- 172.21.15.50:0/3732180945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b7415e790 msgr2=0x7f5b740d4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:28.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7884a640 1 --2- 172.21.15.50:0/3732180945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b7415e790 0x7f5b740d4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7884a640 1 -- 172.21.15.50:0/3732180945 >> v1:172.21.15.50:6789/0 conn(0x7f5b740ba230 legacy=0x7f5b740d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7884a640 1 -- 172.21.15.50:0/3732180945 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b740d3770 con 0x7f5b7415eb70 2024-09-11T22:13:28.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b6bfff640 1 -- 172.21.15.50:0/3732180945 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2849821428 0 0) 0x7f5b740d31b0 con 0x7f5b740ba230 2024-09-11T22:13:28.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.034+0000 7f5b7904b640 1 --2- 172.21.15.50:0/3732180945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b7415e790 0x7f5b740d4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:28.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.035+0000 7f5b7884a640 1 --2- 172.21.15.50:0/3732180945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7415eb70 0x7f5b740d2b20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5b640097a0 tx=0x7f5b6402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712c2608ce3b55ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:28.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.035+0000 7f5b6bfff640 1 -- 172.21.15.50:0/3732180945 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64037070 con 0x7f5b7415eb70 2024-09-11T22:13:28.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.035+0000 7f5b6bfff640 1 -- 172.21.15.50:0/3732180945 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b64032440 con 0x7f5b7415eb70 2024-09-11T22:13:28.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.035+0000 7f5b6bfff640 1 -- 172.21.15.50:0/3732180945 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64032810 con 0x7f5b7415eb70 2024-09-11T22:13:28.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.036+0000 7f5b7b2af640 1 -- 172.21.15.50:0/3732180945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7415eb70 msgr2=0x7f5b740d2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.036+0000 7f5b7b2af640 1 --2- 172.21.15.50:0/3732180945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7415eb70 0x7f5b740d2b20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5b640097a0 tx=0x7f5b6402a180 comp rx=0 tx=0).stop 2024-09-11T22:13:28.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.036+0000 7f5b7b2af640 1 -- 172.21.15.50:0/3732180945 shutdown_connections 2024-09-11T22:13:28.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.036+0000 7f5b7b2af640 1 --2- 172.21.15.50:0/3732180945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7415eb70 0x7f5b740d2b20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.036+0000 7f5b7b2af640 1 --2- 172.21.15.50:0/3732180945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b7415e790 0x7f5b740d4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.036+0000 7f5b7b2af640 1 -- 172.21.15.50:0/3732180945 >> 172.21.15.50:0/3732180945 conn(0x7f5b740727a0 msgr2=0x7f5b740679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:28.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.036+0000 7f5b7b2af640 1 -- 172.21.15.50:0/3732180945 shutdown_connections 2024-09-11T22:13:28.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.036+0000 7f5b7b2af640 1 -- 172.21.15.50:0/3732180945 wait complete. 2024-09-11T22:13:28.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.037+0000 7f5b7b2af640 1 Processor -- start 2024-09-11T22:13:28.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.037+0000 7f5b7b2af640 1 -- start start 2024-09-11T22:13:28.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7b2af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b740ba230 0x7f5b741f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7b2af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7415e790 0x7f5b74159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7b2af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b7415eb70 0x7f5b7415a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7b2af640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5b740d18e0 con 0x7f5b7415e790 2024-09-11T22:13:28.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7b2af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b740ba6c0 con 0x7f5b740ba230 2024-09-11T22:13:28.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7b2af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5b740d1a60 con 0x7f5b7415eb70 2024-09-11T22:13:28.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7884a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7415e790 0x7f5b74159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7884a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7415e790 0x7f5b74159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53378/0 (socket says 172.21.15.50:53378) 2024-09-11T22:13:28.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7884a640 1 -- 172.21.15.50:0/4277116047 learned_addr learned my addr 172.21.15.50:0/4277116047 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:28.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7984c640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b7415eb70 0x7f5b7415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7904b640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b740ba230 0x7f5b741f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7884a640 1 -- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b7415eb70 msgr2=0x7f5b7415a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7884a640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b7415eb70 0x7f5b7415a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7884a640 1 -- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b740ba230 msgr2=0x7f5b741f4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7884a640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b740ba230 0x7f5b741f4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7884a640 1 -- 172.21.15.50:0/4277116047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b741531f0 con 0x7f5b7415e790 2024-09-11T22:13:28.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.038+0000 7f5b7904b640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b740ba230 0x7f5b741f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:28.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.039+0000 7f5b7884a640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7415e790 0x7f5b74159e40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5b640098c0 tx=0x7f5b640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:28.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.039+0000 7f5b69ffb640 1 -- 172.21.15.50:0/4277116047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64037040 con 0x7f5b7415e790 2024-09-11T22:13:28.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.039+0000 7f5b69ffb640 1 -- 172.21.15.50:0/4277116047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b64042070 con 0x7f5b7415e790 2024-09-11T22:13:28.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.039+0000 7f5b69ffb640 1 -- 172.21.15.50:0/4277116047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64030bd0 con 0x7f5b7415e790 2024-09-11T22:13:28.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.039+0000 7f5b7b2af640 1 -- 172.21.15.50:0/4277116047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b741534d0 con 0x7f5b7415e790 2024-09-11T22:13:28.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.039+0000 7f5b7b2af640 1 -- 172.21.15.50:0/4277116047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b74153a90 con 0x7f5b7415e790 2024-09-11T22:13:28.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.040+0000 7f5b7b2af640 1 -- 172.21.15.50:0/4277116047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b740cb0d0 con 0x7f5b7415e790 2024-09-11T22:13:28.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.041+0000 7f5b69ffb640 1 -- 172.21.15.50:0/4277116047 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b64047460 con 0x7f5b7415e790 2024-09-11T22:13:28.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.041+0000 7f5b69ffb640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b5806be30 0x7f5b5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.041+0000 7f5b69ffb640 1 -- 172.21.15.50:0/4277116047 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7f5b640ab990 con 0x7f5b7415e790 2024-09-11T22:13:28.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.041+0000 7f5b7904b640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b5806be30 0x7f5b5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.042+0000 7f5b7904b640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b5806be30 0x7f5b5806e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b70006fd0 tx=0x7f5b70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.045+0000 7f5b69ffb640 1 -- 172.21.15.50:0/4277116047 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b64032e20 con 0x7f5b7415e790 2024-09-11T22:13:28.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.256+0000 7f5b7b2af640 1 -- 172.21.15.50:0/4277116047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b740d4250 con 0x7f5b7415e790 2024-09-11T22:13:28.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.257+0000 7f5b69ffb640 1 -- 172.21.15.50:0/4277116047 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5217 (secure 0 0 0) 0x7f5b64045360 con 0x7f5b7415e790 2024-09-11T22:13:28.258 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:28.258 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"btime":"2024-09-11T22:12:07:439974+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3019059033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3019059033},{"type":"v1","addr":"172.21.15.77:6836","nonce":3019059033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/151985123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":151985123},{"type":"v1","addr":"172.21.15.50:6835","nonce":151985123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4699,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3475311289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3475311289},{"type":"v1","addr":"172.21.15.77:6837","nonce":3475311289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-11T22:11:54.587183+0000","modified":"2024-09-11T22:12:06.721702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4815},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4815":{"gid":4815,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6833/900288576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":900288576},{"type":"v1","addr":"172.21.15.50:6833","nonce":900288576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4815,"qdb_cluster":[4815]},"id":2}]} 2024-09-11T22:13:28.258 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2024-09-11T22:13:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.259+0000 7f5b7b2af640 1 -- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b5806be30 msgr2=0x7f5b5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.259+0000 7f5b7b2af640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b5806be30 0x7f5b5806e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b70006fd0 tx=0x7f5b70008040 comp rx=0 tx=0).stop 2024-09-11T22:13:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.259+0000 7f5b7b2af640 1 -- 172.21.15.50:0/4277116047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7415e790 msgr2=0x7f5b74159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.259+0000 7f5b7b2af640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7415e790 0x7f5b74159e40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5b640098c0 tx=0x7f5b640046c0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.259+0000 7f5b7b2af640 1 -- 172.21.15.50:0/4277116047 shutdown_connections 2024-09-11T22:13:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.259+0000 7f5b7b2af640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b5806be30 0x7f5b5806e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.259+0000 7f5b7b2af640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b7415eb70 0x7f5b7415a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.259+0000 7f5b7b2af640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7415e790 0x7f5b74159e40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.259+0000 7f5b7b2af640 1 --2- 172.21.15.50:0/4277116047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b740ba230 0x7f5b741f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.259+0000 7f5b7b2af640 1 -- 172.21.15.50:0/4277116047 >> 172.21.15.50:0/4277116047 conn(0x7f5b740727a0 msgr2=0x7f5b740b7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:28.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.259+0000 7f5b7b2af640 1 -- 172.21.15.50:0/4277116047 shutdown_connections 2024-09-11T22:13:28.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.259+0000 7f5b7b2af640 1 -- 172.21.15.50:0/4277116047 wait complete. 2024-09-11T22:13:28.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:13:28.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.372+0000 7f1da8103640 1 Processor -- start 2024-09-11T22:13:28.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.372+0000 7f1da8103640 1 -- start start 2024-09-11T22:13:28.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da8103640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1da015e8e0 0x7f1da00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da8103640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1da0162350 0x7f1da0162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da8103640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da0163080 con 0x7f1da00d1580 2024-09-11T22:13:28.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da8103640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1da015ecc0 con 0x7f1da0162350 2024-09-11T22:13:28.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da8103640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1da00d2ad0 con 0x7f1da015e8e0 2024-09-11T22:13:28.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da66a0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1da0162350 0x7f1da0162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da66a0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1da0162350 0x7f1da0162800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53390/0 (socket says 172.21.15.50:53390) 2024-09-11T22:13:28.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da66a0640 1 -- 172.21.15.50:0/3613666595 learned_addr learned my addr 172.21.15.50:0/3613666595 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:28.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da569e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1da00d1580 0x7f1da00d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57718/0 (socket says 172.21.15.50:57718) 2024-09-11T22:13:28.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da5e9f640 1 --2- 172.21.15.50:0/3613666595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1da015e8e0 0x7f1da00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da66a0640 1 -- 172.21.15.50:0/3613666595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1da015e8e0 msgr2=0x7f1da00b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:28.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da66a0640 1 --2- 172.21.15.50:0/3613666595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1da015e8e0 0x7f1da00b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da66a0640 1 -- 172.21.15.50:0/3613666595 >> v1:172.21.15.50:6789/0 conn(0x7f1da00d1580 legacy=0x7f1da00d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da66a0640 1 -- 172.21.15.50:0/3613666595 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da00d2d20 con 0x7f1da0162350 2024-09-11T22:13:28.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.373+0000 7f1da4e9d640 1 -- 172.21.15.50:0/3613666595 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543354703 0 0) 0x7f1da0163080 con 0x7f1da00d1580 2024-09-11T22:13:28.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.374+0000 7f1da66a0640 1 --2- 172.21.15.50:0/3613666595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da0162350 0x7f1da0162800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009e50 tx=0x7f1d9802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bd1c2fce17704c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:28.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.374+0000 7f1da4e9d640 1 -- 172.21.15.50:0/3613666595 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98036070 con 0x7f1da0162350 2024-09-11T22:13:28.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.374+0000 7f1da4e9d640 1 -- 172.21.15.50:0/3613666595 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d98031600 con 0x7f1da0162350 2024-09-11T22:13:28.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.374+0000 7f1da4e9d640 1 -- 172.21.15.50:0/3613666595 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d980319d0 con 0x7f1da0162350 2024-09-11T22:13:28.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.374+0000 7f1da8103640 1 -- 172.21.15.50:0/3613666595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da0162350 msgr2=0x7f1da0162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.374+0000 7f1da8103640 1 --2- 172.21.15.50:0/3613666595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da0162350 0x7f1da0162800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009e50 tx=0x7f1d9802a7a0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.375+0000 7f1da8103640 1 -- 172.21.15.50:0/3613666595 shutdown_connections 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.375+0000 7f1da8103640 1 --2- 172.21.15.50:0/3613666595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da0162350 0x7f1da0162800 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.375+0000 7f1da8103640 1 --2- 172.21.15.50:0/3613666595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1da015e8e0 0x7f1da00b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.375+0000 7f1da8103640 1 -- 172.21.15.50:0/3613666595 >> 172.21.15.50:0/3613666595 conn(0x7f1da0067ba0 msgr2=0x7f1da0067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.375+0000 7f1da8103640 1 -- 172.21.15.50:0/3613666595 shutdown_connections 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.375+0000 7f1da8103640 1 -- 172.21.15.50:0/3613666595 wait complete. 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.376+0000 7f1da8103640 1 Processor -- start 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.376+0000 7f1da8103640 1 -- start start 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.376+0000 7f1da8103640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da00d1580 0x7f1da00b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.376+0000 7f1da8103640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1da015e8e0 0x7f1da0155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.376+0000 7f1da8103640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1da0162350 0x7f1da01e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.376+0000 7f1da8103640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1da0162d40 con 0x7f1da00d1580 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.376+0000 7f1da8103640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1da00d3370 con 0x7f1da015e8e0 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.376+0000 7f1da8103640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1da00d3800 con 0x7f1da0162350 2024-09-11T22:13:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1da5e9f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da00d1580 0x7f1da00b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1da5e9f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da00d1580 0x7f1da00b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53396/0 (socket says 172.21.15.50:53396) 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1da5e9f640 1 -- 172.21.15.50:0/615837582 learned_addr learned my addr 172.21.15.50:0/615837582 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1da66a0640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1da0162350 0x7f1da01e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1da569e640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1da015e8e0 0x7f1da0155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1da5e9f640 1 -- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1da0162350 msgr2=0x7f1da01e7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1da5e9f640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1da0162350 0x7f1da01e7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1da5e9f640 1 -- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1da015e8e0 msgr2=0x7f1da0155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1da5e9f640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1da015e8e0 0x7f1da0155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1da5e9f640 1 -- 172.21.15.50:0/615837582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da0156ad0 con 0x7f1da00d1580 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1da5e9f640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da00d1580 0x7f1da00b64a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00e9b0 tx=0x7f1d9c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1d967fc640 1 -- 172.21.15.50:0/615837582 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c017070 con 0x7f1da00d1580 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1d967fc640 1 -- 172.21.15.50:0/615837582 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9c00c9a0 con 0x7f1da00d1580 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1da8103640 1 -- 172.21.15.50:0/615837582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da01e85e0 con 0x7f1da00d1580 2024-09-11T22:13:28.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1d967fc640 1 -- 172.21.15.50:0/615837582 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c00cd90 con 0x7f1da00d1580 2024-09-11T22:13:28.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.377+0000 7f1da8103640 1 -- 172.21.15.50:0/615837582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da01e8ba0 con 0x7f1da00d1580 2024-09-11T22:13:28.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.378+0000 7f1da8103640 1 -- 172.21.15.50:0/615837582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da00b7880 con 0x7f1da00d1580 2024-09-11T22:13:28.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.379+0000 7f1d967fc640 1 -- 172.21.15.50:0/615837582 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d9c01a070 con 0x7f1da00d1580 2024-09-11T22:13:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.379+0000 7f1d967fc640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d8406be30 0x7f1d8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.379+0000 7f1d967fc640 1 -- 172.21.15.50:0/615837582 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7f1d9c08ad70 con 0x7f1da00d1580 2024-09-11T22:13:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.380+0000 7f1da569e640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d8406be30 0x7f1d8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.380+0000 7f1da569e640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d8406be30 0x7f1d8406e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1da00b69e0 tx=0x7f1d90007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:28.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.384+0000 7f1d967fc640 1 -- 172.21.15.50:0/615837582 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1da0156ad0 con 0x7f1da00d1580 2024-09-11T22:13:28.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.597+0000 7f1da8103640 1 -- 172.21.15.50:0/615837582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1da00ba770 con 0x7f1da00d1580 2024-09-11T22:13:28.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.597+0000 7f1d967fc640 1 -- 172.21.15.50:0/615837582 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5217 (secure 0 0 0) 0x7f1d9c059140 con 0x7f1da00d1580 2024-09-11T22:13:28.598 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:28.598 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"btime":"2024-09-11T22:12:07:439974+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3019059033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3019059033},{"type":"v1","addr":"172.21.15.77:6836","nonce":3019059033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/151985123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":151985123},{"type":"v1","addr":"172.21.15.50:6835","nonce":151985123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4699,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3475311289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3475311289},{"type":"v1","addr":"172.21.15.77:6837","nonce":3475311289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-11T22:11:54.587183+0000","modified":"2024-09-11T22:12:06.721702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4815},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4815":{"gid":4815,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6833/900288576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":900288576},{"type":"v1","addr":"172.21.15.50:6833","nonce":900288576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4815,"qdb_cluster":[4815]},"id":2}]} 2024-09-11T22:13:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2024-09-11T22:13:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.600+0000 7f1da8103640 1 -- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d8406be30 msgr2=0x7f1d8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.600+0000 7f1da8103640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d8406be30 0x7f1d8406e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1da00b69e0 tx=0x7f1d90007d50 comp rx=0 tx=0).stop 2024-09-11T22:13:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.600+0000 7f1da8103640 1 -- 172.21.15.50:0/615837582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da00d1580 msgr2=0x7f1da00b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.600+0000 7f1da8103640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da00d1580 0x7f1da00b64a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00e9b0 tx=0x7f1d9c00ee70 comp rx=0 tx=0).stop 2024-09-11T22:13:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.600+0000 7f1da8103640 1 -- 172.21.15.50:0/615837582 shutdown_connections 2024-09-11T22:13:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.600+0000 7f1da8103640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d8406be30 0x7f1d8406e2f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.600+0000 7f1da8103640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1da0162350 0x7f1da01e7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.600+0000 7f1da8103640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1da015e8e0 0x7f1da0155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.600+0000 7f1da8103640 1 --2- 172.21.15.50:0/615837582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1da00d1580 0x7f1da00b64a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.600+0000 7f1da8103640 1 -- 172.21.15.50:0/615837582 >> 172.21.15.50:0/615837582 conn(0x7f1da0067ba0 msgr2=0x7f1da00b9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.600+0000 7f1da8103640 1 -- 172.21.15.50:0/615837582 shutdown_connections 2024-09-11T22:13:28.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.600+0000 7f1da8103640 1 -- 172.21.15.50:0/615837582 wait complete. 2024-09-11T22:13:28.612 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:13:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.713+0000 7fc558f49640 1 Processor -- start 2024-09-11T22:13:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.713+0000 7fc558f49640 1 -- start start 2024-09-11T22:13:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.714+0000 7fc558f49640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc55415fb60 0x7fc5540b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.714+0000 7fc558f49640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55415ff40 con 0x7fc5540d0150 2024-09-11T22:13:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.714+0000 7fc558f49640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5540d05e0 con 0x7fc5540d0fd0 2024-09-11T22:13:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.714+0000 7fc558f49640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc5540cf510 con 0x7fc55415fb60 2024-09-11T22:13:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.714+0000 7fc551d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc5540d0150 0x7fc5540d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57726/0 (socket says 172.21.15.50:57726) 2024-09-11T22:13:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.714+0000 7fc551d9b640 1 -- 172.21.15.50:0/2355468449 learned_addr learned my addr 172.21.15.50:0/2355468449 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55259c640 1 --2- 172.21.15.50:0/2355468449 >> v2:172.21.15.77:3300/0 conn(0x7fc55415fb60 0x7fc5540b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 500613211 0 0) 0x7fc55415ff40 con 0x7fc5540d0150 2024-09-11T22:13:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc540003520 con 0x7fc5540d0150 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2435256978 0 0) 0x7fc540003520 con 0x7fc5540d0150 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 >> v2:172.21.15.77:3300/0 conn(0x7fc55415fb60 msgr2=0x7fc5540b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 --2- 172.21.15.50:0/2355468449 >> v2:172.21.15.77:3300/0 conn(0x7fc55415fb60 0x7fc5540b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 >> v1:172.21.15.77:6789/0 conn(0x7fc5540d0fd0 legacy=0x7fc5540af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5540cf760 con 0x7fc5540d0150 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fc53c001670 con 0x7fc5540d0150 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 >> v1:172.21.15.50:6789/0 conn(0x7fc5540d0150 legacy=0x7fc5540d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 --2- 172.21.15.50:0/2355468449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc540003a00 0x7fc540003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 --2- 172.21.15.50:0/2355468449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc540004800 0x7fc540004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 --2- 172.21.15.50:0/2355468449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc540005210 0x7fc54000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540cf510 con 0x7fc540003a00 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc54000c160 con 0x7fc540005210 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc54000c360 con 0x7fc540004800 2024-09-11T22:13:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55259c640 1 --2- 172.21.15.50:0/2355468449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc540003a00 0x7fc540003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc551d9b640 1 --2- 172.21.15.50:0/2355468449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc540004800 0x7fc540004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc552d9d640 1 --2- 172.21.15.50:0/2355468449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc540005210 0x7fc54000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55259c640 1 -- 172.21.15.50:0/2355468449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc540004800 msgr2=0x7fc540004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:28.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55259c640 1 --2- 172.21.15.50:0/2355468449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc540004800 0x7fc540004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55259c640 1 -- 172.21.15.50:0/2355468449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc540005210 msgr2=0x7fc54000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:28.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55259c640 1 --2- 172.21.15.50:0/2355468449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc540005210 0x7fc54000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc55259c640 1 -- 172.21.15.50:0/2355468449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc540003520 con 0x7fc540003a00 2024-09-11T22:13:28.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc552d9d640 1 --2- 172.21.15.50:0/2355468449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc540005210 0x7fc54000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:28.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc551d9b640 1 --2- 172.21.15.50:0/2355468449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc540004800 0x7fc540004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:28.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.715+0000 7fc552d9d640 1 -- 172.21.15.50:0/2355468449 reap_dead start 2024-09-11T22:13:28.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.716+0000 7fc55259c640 1 --2- 172.21.15.50:0/2355468449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc540003a00 0x7fc540003e20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009f90 tx=0x7fc540005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b479434a3aac15 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:28.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.716+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c009c10 con 0x7fc540003a00 2024-09-11T22:13:28.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.716+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54c036070 con 0x7fc540003a00 2024-09-11T22:13:28.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.716+0000 7fc55159a640 1 -- 172.21.15.50:0/2355468449 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c031830 con 0x7fc540003a00 2024-09-11T22:13:28.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.717+0000 7fc558f49640 1 -- 172.21.15.50:0/2355468449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc540003a00 msgr2=0x7fc540003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.717+0000 7fc558f49640 1 --2- 172.21.15.50:0/2355468449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc540003a00 0x7fc540003e20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009f90 tx=0x7fc540005830 comp rx=0 tx=0).stop 2024-09-11T22:13:28.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.717+0000 7fc558f49640 1 -- 172.21.15.50:0/2355468449 shutdown_connections 2024-09-11T22:13:28.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.717+0000 7fc558f49640 1 --2- 172.21.15.50:0/2355468449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc540003a00 0x7fc540003e20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.717+0000 7fc558f49640 1 -- 172.21.15.50:0/2355468449 >> 172.21.15.50:0/2355468449 conn(0x7fc5540b4150 msgr2=0x7fc5540b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:28.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.717+0000 7fc558f49640 1 -- 172.21.15.50:0/2355468449 shutdown_connections 2024-09-11T22:13:28.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.717+0000 7fc558f49640 1 -- 172.21.15.50:0/2355468449 wait complete. 2024-09-11T22:13:28.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.718+0000 7fc558f49640 1 Processor -- start 2024-09-11T22:13:28.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.718+0000 7fc558f49640 1 -- start start 2024-09-11T22:13:28.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.719+0000 7fc558f49640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc540003a00 0x7fc55414cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.719+0000 7fc558f49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5540b6eb0 0x7fc5540b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.719+0000 7fc558f49640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5541597a0 0x7fc554159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.719+0000 7fc558f49640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540b1930 con 0x7fc5540b6eb0 2024-09-11T22:13:28.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.719+0000 7fc558f49640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540cfdb0 con 0x7fc5541597a0 2024-09-11T22:13:28.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.719+0000 7fc558f49640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc5540b1ab0 con 0x7fc540003a00 2024-09-11T22:13:28.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.719+0000 7fc551d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5540b6eb0 0x7fc5540b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.719+0000 7fc551d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5540b6eb0 0x7fc5540b7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53414/0 (socket says 172.21.15.50:53414) 2024-09-11T22:13:28.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.719+0000 7fc551d9b640 1 -- 172.21.15.50:0/1607188971 learned_addr learned my addr 172.21.15.50:0/1607188971 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:28.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.719+0000 7fc552d9d640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5541597a0 0x7fc554159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.719+0000 7fc55259c640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc540003a00 0x7fc55414cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.719+0000 7fc551d9b640 1 -- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc540003a00 msgr2=0x7fc55414cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.719+0000 7fc551d9b640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc540003a00 0x7fc55414cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.720+0000 7fc551d9b640 1 -- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5541597a0 msgr2=0x7fc554159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.720+0000 7fc551d9b640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5541597a0 0x7fc554159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.720+0000 7fc551d9b640 1 -- 172.21.15.50:0/1607188971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55415a160 con 0x7fc5540b6eb0 2024-09-11T22:13:28.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.720+0000 7fc551d9b640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5540b6eb0 0x7fc5540b7330 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc53c001b40 tx=0x7fc53c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:28.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.720+0000 7fc54affd640 1 -- 172.21.15.50:0/1607188971 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00c630 con 0x7fc5540b6eb0 2024-09-11T22:13:28.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.720+0000 7fc54affd640 1 -- 172.21.15.50:0/1607188971 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c018070 con 0x7fc5540b6eb0 2024-09-11T22:13:28.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.720+0000 7fc558f49640 1 -- 172.21.15.50:0/1607188971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5540b7970 con 0x7fc5540b6eb0 2024-09-11T22:13:28.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.720+0000 7fc54affd640 1 -- 172.21.15.50:0/1607188971 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00c9d0 con 0x7fc5540b6eb0 2024-09-11T22:13:28.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.720+0000 7fc558f49640 1 -- 172.21.15.50:0/1607188971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5540c6a80 con 0x7fc5540b6eb0 2024-09-11T22:13:28.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.721+0000 7fc558f49640 1 -- 172.21.15.50:0/1607188971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5540d1cd0 con 0x7fc5540b6eb0 2024-09-11T22:13:28.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.721+0000 7fc54affd640 1 -- 172.21.15.50:0/1607188971 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc53c00cb70 con 0x7fc5540b6eb0 2024-09-11T22:13:28.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.722+0000 7fc54affd640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc53406be30 0x7fc53406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:28.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.722+0000 7fc54affd640 1 -- 172.21.15.50:0/1607188971 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7fc53c08ac30 con 0x7fc5540b6eb0 2024-09-11T22:13:28.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.722+0000 7fc55259c640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc53406be30 0x7fc53406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:28.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.723+0000 7fc55259c640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc53406be30 0x7fc53406e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc54c035000 tx=0x7fc54c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:28.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.726+0000 7fc54affd640 1 -- 172.21.15.50:0/1607188971 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5540d1cd0 con 0x7fc5540b6eb0 2024-09-11T22:13:28.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.903+0000 7fc558f49640 1 -- 172.21.15.50:0/1607188971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5540b4d90 con 0x7fc5540b6eb0 2024-09-11T22:13:28.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.904+0000 7fc54affd640 1 -- 172.21.15.50:0/1607188971 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16758 (secure 0 0 0) 0x7fc53c0595c0 con 0x7fc5540b6eb0 2024-09-11T22:13:28.905 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:28.905 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":34,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:13:05.979514+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:11:52.474592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T22:11:53.568181+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":33,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:13:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.906+0000 7fc558f49640 1 -- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc53406be30 msgr2=0x7fc53406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.906+0000 7fc558f49640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc53406be30 0x7fc53406e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc54c035000 tx=0x7fc54c02f000 comp rx=0 tx=0).stop 2024-09-11T22:13:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.906+0000 7fc558f49640 1 -- 172.21.15.50:0/1607188971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5540b6eb0 msgr2=0x7fc5540b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.906+0000 7fc558f49640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5540b6eb0 0x7fc5540b7330 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc53c001b40 tx=0x7fc53c00eb90 comp rx=0 tx=0).stop 2024-09-11T22:13:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.906+0000 7fc558f49640 1 -- 172.21.15.50:0/1607188971 shutdown_connections 2024-09-11T22:13:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.906+0000 7fc558f49640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc53406be30 0x7fc53406e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.906+0000 7fc558f49640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5541597a0 0x7fc554159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.906+0000 7fc558f49640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5540b6eb0 0x7fc5540b7330 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.906+0000 7fc558f49640 1 --2- 172.21.15.50:0/1607188971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc540003a00 0x7fc55414cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.906+0000 7fc558f49640 1 -- 172.21.15.50:0/1607188971 >> 172.21.15.50:0/1607188971 conn(0x7fc5540b4150 msgr2=0x7fc5540b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.906+0000 7fc558f49640 1 -- 172.21.15.50:0/1607188971 shutdown_connections 2024-09-11T22:13:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:28.906+0000 7fc558f49640 1 -- 172.21.15.50:0/1607188971 wait complete. 2024-09-11T22:13:28.918 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:13:29.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.020+0000 7f580045e640 1 Processor -- start 2024-09-11T22:13:29.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.020+0000 7f580045e640 1 -- start start 2024-09-11T22:13:29.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.021+0000 7f580045e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f57f815e8d0 0x7f57f80d11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:29.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.021+0000 7f580045e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57f80d1710 0x7f57f80d34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:29.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.021+0000 7f580045e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f80d1b50 con 0x7f57f80d3a20 2024-09-11T22:13:29.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.021+0000 7f580045e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f57f815ecb0 con 0x7f57f815e8d0 2024-09-11T22:13:29.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.021+0000 7f580045e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f57f80d4220 con 0x7f57f80d1710 2024-09-11T22:13:29.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.022+0000 7f57fe1fa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f57f815e8d0 0x7f57f80d11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:29.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.022+0000 7f57fd9f9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57f80d1710 0x7f57f80d34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:29.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.022+0000 7f57fe9fb640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f57f80d3a20 0x7f57f80b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:53328/0 (socket says 172.21.15.50:53328) 2024-09-11T22:13:29.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.022+0000 7f57fd9f9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57f80d1710 0x7f57f80d34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47350/0 (socket says 172.21.15.50:47350) 2024-09-11T22:13:29.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.022+0000 7f57fd9f9640 1 -- 172.21.15.50:0/2306973668 learned_addr learned my addr 172.21.15.50:0/2306973668 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.022+0000 7f57fe1fa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f57f815e8d0 0x7f57f80d11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:52018/0 (socket says 172.21.15.50:52018) 2024-09-11T22:13:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.022+0000 7f57fe1fa640 1 -- 172.21.15.50:0/2306973668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57f80d1710 msgr2=0x7f57f80d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.022+0000 7f57fe1fa640 1 --2- 172.21.15.50:0/2306973668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57f80d1710 0x7f57f80d34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.022+0000 7f57fe1fa640 1 -- 172.21.15.50:0/2306973668 >> v1:172.21.15.77:6789/0 conn(0x7f57f80d3a20 legacy=0x7f57f80b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:29.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.022+0000 7f57fe1fa640 1 -- 172.21.15.50:0/2306973668 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f80d4500 con 0x7f57f815e8d0 2024-09-11T22:13:29.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.023+0000 7f57fe1fa640 1 --2- 172.21.15.50:0/2306973668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57f815e8d0 0x7f57f80d11d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009d90 tx=0x7f57e802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a72fb528bd80cfe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:29.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.024+0000 7f57fd1f8640 1 -- 172.21.15.50:0/2306973668 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e8007740 con 0x7f57f815e8d0 2024-09-11T22:13:29.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.024+0000 7f57fd1f8640 1 -- 172.21.15.50:0/2306973668 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e80078e0 con 0x7f57f815e8d0 2024-09-11T22:13:29.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.024+0000 7f57fd1f8640 1 -- 172.21.15.50:0/2306973668 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e8007cb0 con 0x7f57f815e8d0 2024-09-11T22:13:29.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.025+0000 7f580045e640 1 -- 172.21.15.50:0/2306973668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57f815e8d0 msgr2=0x7f57f80d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:29.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.025+0000 7f580045e640 1 --2- 172.21.15.50:0/2306973668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57f815e8d0 0x7f57f80d11d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009d90 tx=0x7f57e802a660 comp rx=0 tx=0).stop 2024-09-11T22:13:29.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.025+0000 7f580045e640 1 -- 172.21.15.50:0/2306973668 shutdown_connections 2024-09-11T22:13:29.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.025+0000 7f580045e640 1 --2- 172.21.15.50:0/2306973668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57f80d1710 0x7f57f80d34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:29.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.025+0000 7f580045e640 1 --2- 172.21.15.50:0/2306973668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57f815e8d0 0x7f57f80d11d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:29.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.025+0000 7f580045e640 1 -- 172.21.15.50:0/2306973668 >> 172.21.15.50:0/2306973668 conn(0x7f57f80727a0 msgr2=0x7f57f80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:29.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.025+0000 7f580045e640 1 -- 172.21.15.50:0/2306973668 shutdown_connections 2024-09-11T22:13:29.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.025+0000 7f580045e640 1 -- 172.21.15.50:0/2306973668 wait complete. 2024-09-11T22:13:29.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.026+0000 7f580045e640 1 Processor -- start 2024-09-11T22:13:29.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.026+0000 7f580045e640 1 -- start start 2024-09-11T22:13:29.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f580045e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57f80d1710 0x7f57f814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:29.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f580045e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57f80d3a20 0x7f57f8158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:29.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f580045e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57f815e8d0 0x7f57f80b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:29.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f580045e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f57f80b77e0 con 0x7f57f815e8d0 2024-09-11T22:13:29.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f580045e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f57f80d3eb0 con 0x7f57f80d1710 2024-09-11T22:13:29.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f580045e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f57f80b7960 con 0x7f57f80d3a20 2024-09-11T22:13:29.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f57fe9fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57f815e8d0 0x7f57f80b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:29.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f57fe9fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57f815e8d0 0x7f57f80b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53416/0 (socket says 172.21.15.50:53416) 2024-09-11T22:13:29.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f57fe9fb640 1 -- 172.21.15.50:0/3467998106 learned_addr learned my addr 172.21.15.50:0/3467998106 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:29.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f57fd9f9640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57f80d3a20 0x7f57f8158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:29.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f57fe1fa640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57f80d1710 0x7f57f814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:29.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f57fe9fb640 1 -- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57f80d3a20 msgr2=0x7f57f8158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:29.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f57fe9fb640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57f80d3a20 0x7f57f8158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:29.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f57fe9fb640 1 -- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57f80d1710 msgr2=0x7f57f814ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:29.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f57fe9fb640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57f80d1710 0x7f57f814ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:29.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f57fe9fb640 1 -- 172.21.15.50:0/3467998106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f8159060 con 0x7f57f815e8d0 2024-09-11T22:13:29.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f57fd9f9640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57f80d3a20 0x7f57f8158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:29.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.027+0000 7f57fe1fa640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57f80d1710 0x7f57f814ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:29.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.028+0000 7f57fe9fb640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57f815e8d0 0x7f57f80b5e20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f57f000c400 tx=0x7f57f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:29.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.028+0000 7f57f6ffd640 1 -- 172.21.15.50:0/3467998106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f00074e0 con 0x7f57f815e8d0 2024-09-11T22:13:29.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.028+0000 7f57f6ffd640 1 -- 172.21.15.50:0/3467998106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f0007680 con 0x7f57f815e8d0 2024-09-11T22:13:29.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.028+0000 7f57f6ffd640 1 -- 172.21.15.50:0/3467998106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f00049e0 con 0x7f57f815e8d0 2024-09-11T22:13:29.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.028+0000 7f580045e640 1 -- 172.21.15.50:0/3467998106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f8159340 con 0x7f57f815e8d0 2024-09-11T22:13:29.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.028+0000 7f580045e640 1 -- 172.21.15.50:0/3467998106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f8159900 con 0x7f57f815e8d0 2024-09-11T22:13:29.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.029+0000 7f580045e640 1 -- 172.21.15.50:0/3467998106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f80d34e0 con 0x7f57f815e8d0 2024-09-11T22:13:29.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.029+0000 7f57f6ffd640 1 -- 172.21.15.50:0/3467998106 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f57f001a020 con 0x7f57f815e8d0 2024-09-11T22:13:29.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.030+0000 7f57f6ffd640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f57e406be30 0x7f57e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:29.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.030+0000 7f57f6ffd640 1 -- 172.21.15.50:0/3467998106 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7f57f008a6a0 con 0x7f57f815e8d0 2024-09-11T22:13:29.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.030+0000 7f57fe1fa640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f57e406be30 0x7f57e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:29.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.030+0000 7f57fe1fa640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f57e406be30 0x7f57e406e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f57e8034000 tx=0x7f57e802f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:29.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.034+0000 7f57f6ffd640 1 -- 172.21.15.50:0/3467998106 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f57f0059030 con 0x7f57f815e8d0 2024-09-11T22:13:29.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.251+0000 7f580045e640 1 -- 172.21.15.50:0/3467998106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f57f8067dc0 con 0x7f57f815e8d0 2024-09-11T22:13:29.252 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:13:29.252+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:13:29.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.253+0000 7f57f6ffd640 1 -- 172.21.15.50:0/3467998106 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7f57f0058930 con 0x7f57f815e8d0 2024-09-11T22:13:29.254 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:13:29.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.256+0000 7f580045e640 1 -- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f57e406be30 msgr2=0x7f57e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:29.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.256+0000 7f580045e640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f57e406be30 0x7f57e406e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f57e8034000 tx=0x7f57e802f000 comp rx=0 tx=0).stop 2024-09-11T22:13:29.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.256+0000 7f580045e640 1 -- 172.21.15.50:0/3467998106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57f815e8d0 msgr2=0x7f57f80b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:29.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.256+0000 7f580045e640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57f815e8d0 0x7f57f80b5e20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f57f000c400 tx=0x7f57f000c8c0 comp rx=0 tx=0).stop 2024-09-11T22:13:29.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.256+0000 7f580045e640 1 -- 172.21.15.50:0/3467998106 shutdown_connections 2024-09-11T22:13:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.256+0000 7f580045e640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f57e406be30 0x7f57e406e2f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.256+0000 7f580045e640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57f80d3a20 0x7f57f8158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.256+0000 7f580045e640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57f815e8d0 0x7f57f80b5e20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.256+0000 7f580045e640 1 --2- 172.21.15.50:0/3467998106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57f80d1710 0x7f57f814ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.256+0000 7f580045e640 1 -- 172.21.15.50:0/3467998106 >> 172.21.15.50:0/3467998106 conn(0x7f57f80727a0 msgr2=0x7f57f80cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.256+0000 7f580045e640 1 -- 172.21.15.50:0/3467998106 shutdown_connections 2024-09-11T22:13:29.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.256+0000 7f580045e640 1 -- 172.21.15.50:0/3467998106 wait complete. 2024-09-11T22:13:29.268 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:13:29.297 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:13:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.373+0000 7fdf65fc4640 1 Processor -- start 2024-09-11T22:13:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.373+0000 7fdf65fc4640 1 -- start start 2024-09-11T22:13:29.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.373+0000 7fdf65fc4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf600d18a0 0x7fdf600d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:29.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.373+0000 7fdf65fc4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf600cfa80 con 0x7fdf6015e870 2024-09-11T22:13:29.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.373+0000 7fdf65fc4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf600d40d0 con 0x7fdf600d3a30 2024-09-11T22:13:29.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.373+0000 7fdf65fc4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fdf600d3ea0 con 0x7fdf600d18a0 2024-09-11T22:13:29.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.374+0000 7fdf5f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdf6015e870 0x7fdf600d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57740/0 (socket says 172.21.15.50:57740) 2024-09-11T22:13:29.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.374+0000 7fdf5f7fe640 1 -- 172.21.15.50:0/3183006730 learned_addr learned my addr 172.21.15.50:0/3183006730 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:29.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.374+0000 7fdf5effd640 1 --2- 172.21.15.50:0/3183006730 >> v2:172.21.15.50:3300/0 conn(0x7fdf600d18a0 0x7fdf600d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:29.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.374+0000 7fdf5e7fc640 1 -- 172.21.15.50:0/3183006730 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428746945 0 0) 0x7fdf50001110 con 0x7fdf6015e870 2024-09-11T22:13:29.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.374+0000 7fdf5e7fc640 1 -- 172.21.15.50:0/3183006730 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf48003520 con 0x7fdf6015e870 2024-09-11T22:13:29.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.374+0000 7fdf5effd640 1 -- 172.21.15.50:0/3183006730 >> v1:172.21.15.77:6789/0 conn(0x7fdf600d3a30 legacy=0x7fdf600b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:29.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.374+0000 7fdf5effd640 1 -- 172.21.15.50:0/3183006730 >> v1:172.21.15.50:6789/0 conn(0x7fdf6015e870 legacy=0x7fdf600d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:29.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.374+0000 7fdf5effd640 1 -- 172.21.15.50:0/3183006730 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf600d43b0 con 0x7fdf600d18a0 2024-09-11T22:13:29.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.375+0000 7fdf5effd640 1 --2- 172.21.15.50:0/3183006730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf600d18a0 0x7fdf600d34f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdf540097a0 tx=0x7fdf5402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6a66653f289c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:29.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.375+0000 7fdf5e7fc640 1 -- 172.21.15.50:0/3183006730 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54037070 con 0x7fdf600d18a0 2024-09-11T22:13:29.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.375+0000 7fdf5e7fc640 1 -- 172.21.15.50:0/3183006730 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf54032440 con 0x7fdf600d18a0 2024-09-11T22:13:29.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.375+0000 7fdf5e7fc640 1 -- 172.21.15.50:0/3183006730 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54032810 con 0x7fdf600d18a0 2024-09-11T22:13:29.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.375+0000 7fdf65fc4640 1 -- 172.21.15.50:0/3183006730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf600d18a0 msgr2=0x7fdf600d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:29.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.375+0000 7fdf65fc4640 1 --2- 172.21.15.50:0/3183006730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf600d18a0 0x7fdf600d34f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdf540097a0 tx=0x7fdf5402a230 comp rx=0 tx=0).stop 2024-09-11T22:13:29.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.375+0000 7fdf65fc4640 1 -- 172.21.15.50:0/3183006730 shutdown_connections 2024-09-11T22:13:29.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.375+0000 7fdf65fc4640 1 --2- 172.21.15.50:0/3183006730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf600d18a0 0x7fdf600d34f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:29.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.375+0000 7fdf65fc4640 1 -- 172.21.15.50:0/3183006730 >> 172.21.15.50:0/3183006730 conn(0x7fdf600727a0 msgr2=0x7fdf600679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:29.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.375+0000 7fdf65fc4640 1 -- 172.21.15.50:0/3183006730 shutdown_connections 2024-09-11T22:13:29.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.375+0000 7fdf65fc4640 1 -- 172.21.15.50:0/3183006730 wait complete. 2024-09-11T22:13:29.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.377+0000 7fdf65fc4640 1 Processor -- start 2024-09-11T22:13:29.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.377+0000 7fdf65fc4640 1 -- start start 2024-09-11T22:13:29.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf65fc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf600d18a0 0x7fdf6015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:29.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf65fc4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf600d3a30 0x7fdf601f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:29.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf65fc4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf6015e870 0x7fdf60157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:29.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf65fc4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6015ec50 con 0x7fdf600d18a0 2024-09-11T22:13:29.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf65fc4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf600b7ee0 con 0x7fdf6015e870 2024-09-11T22:13:29.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf65fc4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdf600b78b0 con 0x7fdf600d3a30 2024-09-11T22:13:29.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf5f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf600d18a0 0x7fdf6015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:29.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf5f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf600d18a0 0x7fdf6015a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53468/0 (socket says 172.21.15.50:53468) 2024-09-11T22:13:29.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf5f7fe640 1 -- 172.21.15.50:0/2168612717 learned_addr learned my addr 172.21.15.50:0/2168612717 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:29.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf5effd640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf600d3a30 0x7fdf601f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:29.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf5ffff640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf6015e870 0x7fdf60157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:29.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf5f7fe640 1 -- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf600d3a30 msgr2=0x7fdf601f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:29.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf5f7fe640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf600d3a30 0x7fdf601f4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:29.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf5f7fe640 1 -- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf6015e870 msgr2=0x7fdf60157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:29.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf5f7fe640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf6015e870 0x7fdf60157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:29.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf5f7fe640 1 -- 172.21.15.50:0/2168612717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6015bb90 con 0x7fdf600d18a0 2024-09-11T22:13:29.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf5f7fe640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf600d18a0 0x7fdf6015a510 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000c760 tx=0x7fdf5000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:29.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.378+0000 7fdf47fff640 1 -- 172.21.15.50:0/2168612717 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50017070 con 0x7fdf600d18a0 2024-09-11T22:13:29.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.379+0000 7fdf47fff640 1 -- 172.21.15.50:0/2168612717 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf50005ab0 con 0x7fdf600d18a0 2024-09-11T22:13:29.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.379+0000 7fdf65fc4640 1 -- 172.21.15.50:0/2168612717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6015aaf0 con 0x7fdf600d18a0 2024-09-11T22:13:29.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.379+0000 7fdf47fff640 1 -- 172.21.15.50:0/2168612717 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50007070 con 0x7fdf600d18a0 2024-09-11T22:13:29.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.379+0000 7fdf65fc4640 1 -- 172.21.15.50:0/2168612717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf6015b0b0 con 0x7fdf600d18a0 2024-09-11T22:13:29.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.380+0000 7fdf65fc4640 1 -- 172.21.15.50:0/2168612717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf600d34d0 con 0x7fdf600d18a0 2024-09-11T22:13:29.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.380+0000 7fdf47fff640 1 -- 172.21.15.50:0/2168612717 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf5001a070 con 0x7fdf600d18a0 2024-09-11T22:13:29.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.380+0000 7fdf47fff640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf4c06be30 0x7fdf4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:29.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.381+0000 7fdf47fff640 1 -- 172.21.15.50:0/2168612717 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fdf5008a200 con 0x7fdf600d18a0 2024-09-11T22:13:29.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.381+0000 7fdf5effd640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf4c06be30 0x7fdf4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:29.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.381+0000 7fdf5effd640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf4c06be30 0x7fdf4c06e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdf54034000 tx=0x7fdf5402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:29.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.385+0000 7fdf47fff640 1 -- 172.21.15.50:0/2168612717 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf6015bb90 con 0x7fdf600d18a0 2024-09-11T22:13:29.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:29.599+0000 7fdf65fc4640 1 -- 172.21.15.50:0/2168612717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fdf601603e0 con 0x7fdf600d18a0 2024-09-11T22:13:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.260+0000 7fdf47fff640 1 -- 172.21.15.50:0/2168612717 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7fdf600cfa80 con 0x7fdf600d18a0 2024-09-11T22:13:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.263+0000 7fdf65fc4640 1 -- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf4c06be30 msgr2=0x7fdf4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.263+0000 7fdf65fc4640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf4c06be30 0x7fdf4c06e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdf54034000 tx=0x7fdf5402e000 comp rx=0 tx=0).stop 2024-09-11T22:13:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.263+0000 7fdf65fc4640 1 -- 172.21.15.50:0/2168612717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf600d18a0 msgr2=0x7fdf6015a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.263+0000 7fdf65fc4640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf600d18a0 0x7fdf6015a510 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000c760 tx=0x7fdf5000cc20 comp rx=0 tx=0).stop 2024-09-11T22:13:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.263+0000 7fdf65fc4640 1 -- 172.21.15.50:0/2168612717 shutdown_connections 2024-09-11T22:13:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.263+0000 7fdf65fc4640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf4c06be30 0x7fdf4c06e2f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.263+0000 7fdf65fc4640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf600d3a30 0x7fdf601f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.263+0000 7fdf65fc4640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf6015e870 0x7fdf60157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.263+0000 7fdf65fc4640 1 --2- 172.21.15.50:0/2168612717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf600d18a0 0x7fdf6015a510 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.263+0000 7fdf65fc4640 1 -- 172.21.15.50:0/2168612717 >> 172.21.15.50:0/2168612717 conn(0x7fdf600727a0 msgr2=0x7fdf6015f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.263+0000 7fdf65fc4640 1 -- 172.21.15.50:0/2168612717 shutdown_connections 2024-09-11T22:13:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.263+0000 7fdf65fc4640 1 -- 172.21.15.50:0/2168612717 wait complete. 2024-09-11T22:13:30.277 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:13:30.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.430+0000 7fcb351c4640 1 Processor -- start 2024-09-11T22:13:30.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.430+0000 7fcb351c4640 1 -- start start 2024-09-11T22:13:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.431+0000 7fcb351c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb300d0810 0x7fcb300b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.431+0000 7fcb351c4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb300b4fe0 con 0x7fcb300b3d80 2024-09-11T22:13:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.431+0000 7fcb351c4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb300b1db0 con 0x7fcb300af490 2024-09-11T22:13:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.431+0000 7fcb351c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcb300b2090 con 0x7fcb300d0810 2024-09-11T22:13:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.431+0000 7fcb2f59e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcb300b3d80 0x7fcb30166290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57746/0 (socket says 172.21.15.50:57746) 2024-09-11T22:13:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.431+0000 7fcb2f59e640 1 -- 172.21.15.50:0/423097108 learned_addr learned my addr 172.21.15.50:0/423097108 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.431+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678119352 0 0) 0x7fcb300b4fe0 con 0x7fcb300b3d80 2024-09-11T22:13:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.431+0000 7fcb2ed9d640 1 --2- 172.21.15.50:0/423097108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb300d0810 0x7fcb300b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.431+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb18003520 con 0x7fcb300b3d80 2024-09-11T22:13:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1532762045 0 0) 0x7fcb18003520 con 0x7fcb300b3d80 2024-09-11T22:13:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb300d0810 msgr2=0x7fcb300b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2dd9b640 1 --2- 172.21.15.50:0/423097108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb300d0810 0x7fcb300b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 >> v1:172.21.15.77:6789/0 conn(0x7fcb300af490 legacy=0x7fcb300b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb300b2370 con 0x7fcb300b3d80 2024-09-11T22:13:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fcb280019f0 con 0x7fcb300b3d80 2024-09-11T22:13:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 >> v1:172.21.15.50:6789/0 conn(0x7fcb300b3d80 legacy=0x7fcb30166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2dd9b640 1 --2- 172.21.15.50:0/423097108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb300d0810 0x7fcb180039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2dd9b640 1 --2- 172.21.15.50:0/423097108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb18003f20 0x7fcb18004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2dd9b640 1 --2- 172.21.15.50:0/423097108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb18004d40 0x7fcb180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb300b2090 con 0x7fcb18004d40 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1800bad0 con 0x7fcb18003f20 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcb1800bcd0 con 0x7fcb300d0810 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2f59e640 1 --2- 172.21.15.50:0/423097108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb18004d40 0x7fcb180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2ed9d640 1 --2- 172.21.15.50:0/423097108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb300d0810 0x7fcb180039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2e59c640 1 --2- 172.21.15.50:0/423097108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb18003f20 0x7fcb18004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2f59e640 1 -- 172.21.15.50:0/423097108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb300d0810 msgr2=0x7fcb180039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2f59e640 1 --2- 172.21.15.50:0/423097108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb300d0810 0x7fcb180039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2f59e640 1 -- 172.21.15.50:0/423097108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb18003f20 msgr2=0x7fcb18004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2f59e640 1 --2- 172.21.15.50:0/423097108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb18003f20 0x7fcb18004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.432+0000 7fcb2f59e640 1 -- 172.21.15.50:0/423097108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb18003520 con 0x7fcb18004d40 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.433+0000 7fcb2f59e640 1 --2- 172.21.15.50:0/423097108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb18004d40 0x7fcb180051c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800a830 tx=0x7fcb18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3032b77be7275 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.433+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800a480 con 0x7fcb18004d40 2024-09-11T22:13:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.433+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb2802f070 con 0x7fcb18004d40 2024-09-11T22:13:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.433+0000 7fcb2dd9b640 1 -- 172.21.15.50:0/423097108 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2802bcd0 con 0x7fcb18004d40 2024-09-11T22:13:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.434+0000 7fcb351c4640 1 -- 172.21.15.50:0/423097108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb18004d40 msgr2=0x7fcb180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.434+0000 7fcb351c4640 1 --2- 172.21.15.50:0/423097108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb18004d40 0x7fcb180051c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800a830 tx=0x7fcb18005830 comp rx=0 tx=0).stop 2024-09-11T22:13:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.434+0000 7fcb2f59e640 1 -- 172.21.15.50:0/423097108 reap_dead start 2024-09-11T22:13:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.434+0000 7fcb351c4640 1 -- 172.21.15.50:0/423097108 shutdown_connections 2024-09-11T22:13:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.434+0000 7fcb351c4640 1 -- 172.21.15.50:0/423097108 >> 172.21.15.50:0/423097108 conn(0x7fcb300b41b0 msgr2=0x7fcb300b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.434+0000 7fcb351c4640 1 -- 172.21.15.50:0/423097108 shutdown_connections 2024-09-11T22:13:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.434+0000 7fcb351c4640 1 -- 172.21.15.50:0/423097108 wait complete. 2024-09-11T22:13:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.435+0000 7fcb351c4640 1 Processor -- start 2024-09-11T22:13:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.435+0000 7fcb351c4640 1 -- start start 2024-09-11T22:13:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb351c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb18004d40 0x7fcb300b7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb351c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb300cb390 0x7fcb301ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb351c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb301ef830 0x7fcb301f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb351c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb300b2c10 con 0x7fcb300cb390 2024-09-11T22:13:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb351c4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb300b2930 con 0x7fcb301ef830 2024-09-11T22:13:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb351c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcb300d1c00 con 0x7fcb18004d40 2024-09-11T22:13:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb2e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb300cb390 0x7fcb301ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb2e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb300cb390 0x7fcb301ef2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53490/0 (socket says 172.21.15.50:53490) 2024-09-11T22:13:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb2e59c640 1 -- 172.21.15.50:0/737254342 learned_addr learned my addr 172.21.15.50:0/737254342 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb2f59e640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb301ef830 0x7fcb301f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb2e59c640 1 -- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb18004d40 msgr2=0x7fcb300b7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb2ed9d640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb18004d40 0x7fcb300b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb2e59c640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb18004d40 0x7fcb300b7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb2e59c640 1 -- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb301ef830 msgr2=0x7fcb301f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.436+0000 7fcb2e59c640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb301ef830 0x7fcb301f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.437+0000 7fcb2e59c640 1 -- 172.21.15.50:0/737254342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb301f3050 con 0x7fcb300cb390 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.437+0000 7fcb2ed9d640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb18004d40 0x7fcb300b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.437+0000 7fcb2f59e640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb301ef830 0x7fcb301f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.437+0000 7fcb2e59c640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb300cb390 0x7fcb301ef2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400f750 tx=0x7fcb2400fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.437+0000 7fcb177fe640 1 -- 172.21.15.50:0/737254342 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400fe60 con 0x7fcb300cb390 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.437+0000 7fcb177fe640 1 -- 172.21.15.50:0/737254342 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb24018070 con 0x7fcb300cb390 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.437+0000 7fcb351c4640 1 -- 172.21.15.50:0/737254342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb300ca8b0 con 0x7fcb300cb390 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.437+0000 7fcb177fe640 1 -- 172.21.15.50:0/737254342 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400d730 con 0x7fcb300cb390 2024-09-11T22:13:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.437+0000 7fcb351c4640 1 -- 172.21.15.50:0/737254342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb300cae70 con 0x7fcb300cb390 2024-09-11T22:13:30.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.438+0000 7fcb351c4640 1 -- 172.21.15.50:0/737254342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb300ca6a0 con 0x7fcb300cb390 2024-09-11T22:13:30.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.439+0000 7fcb177fe640 1 -- 172.21.15.50:0/737254342 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb2400d8d0 con 0x7fcb300cb390 2024-09-11T22:13:30.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.439+0000 7fcb177fe640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb1c06be30 0x7fcb1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:30.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.439+0000 7fcb177fe640 1 -- 172.21.15.50:0/737254342 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fcb2408aeb0 con 0x7fcb300cb390 2024-09-11T22:13:30.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.439+0000 7fcb2ed9d640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb1c06be30 0x7fcb1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:30.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.440+0000 7fcb2ed9d640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb1c06be30 0x7fcb1c06e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009ab0 tx=0x7fcb20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:30.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.443+0000 7fcb177fe640 1 -- 172.21.15.50:0/737254342 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb2401a310 con 0x7fcb300cb390 2024-09-11T22:13:30.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:30.621+0000 7fcb351c4640 1 -- 172.21.15.50:0/737254342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcb300b3130 con 0x7fcb300cb390 2024-09-11T22:13:31.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.261+0000 7fcb177fe640 1 -- 172.21.15.50:0/737254342 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7fcb24059800 con 0x7fcb300cb390 2024-09-11T22:13:31.262 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:13:31.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.265+0000 7fcb351c4640 1 -- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb1c06be30 msgr2=0x7fcb1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:31.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.265+0000 7fcb351c4640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb1c06be30 0x7fcb1c06e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009ab0 tx=0x7fcb20008040 comp rx=0 tx=0).stop 2024-09-11T22:13:31.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.265+0000 7fcb351c4640 1 -- 172.21.15.50:0/737254342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb300cb390 msgr2=0x7fcb301ef2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:31.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.265+0000 7fcb351c4640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb300cb390 0x7fcb301ef2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400f750 tx=0x7fcb2400fc10 comp rx=0 tx=0).stop 2024-09-11T22:13:31.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.265+0000 7fcb351c4640 1 -- 172.21.15.50:0/737254342 shutdown_connections 2024-09-11T22:13:31.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.265+0000 7fcb351c4640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb1c06be30 0x7fcb1c06e2f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:31.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.265+0000 7fcb351c4640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb301ef830 0x7fcb301f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:31.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.265+0000 7fcb351c4640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb300cb390 0x7fcb301ef2f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:31.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.265+0000 7fcb351c4640 1 --2- 172.21.15.50:0/737254342 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb18004d40 0x7fcb300b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:31.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.265+0000 7fcb351c4640 1 -- 172.21.15.50:0/737254342 >> 172.21.15.50:0/737254342 conn(0x7fcb300b41b0 msgr2=0x7fcb3006f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:31.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.265+0000 7fcb351c4640 1 -- 172.21.15.50:0/737254342 shutdown_connections 2024-09-11T22:13:31.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.265+0000 7fcb351c4640 1 -- 172.21.15.50:0/737254342 wait complete. 2024-09-11T22:13:31.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:13:31.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.393+0000 7fea4047b640 1 Processor -- start 2024-09-11T22:13:31.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.393+0000 7fea4047b640 1 -- start start 2024-09-11T22:13:31.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.394+0000 7fea4047b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea3806f300 0x7fea380b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.394+0000 7fea4047b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea38162280 con 0x7fea38161ea0 2024-09-11T22:13:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.394+0000 7fea4047b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea3806c700 con 0x7fea3806ffb0 2024-09-11T22:13:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.394+0000 7fea4047b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fea3806c9e0 con 0x7fea3806f300 2024-09-11T22:13:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.394+0000 7fea3e217640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fea38161ea0 0x7fea3806f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57754/0 (socket says 172.21.15.50:57754) 2024-09-11T22:13:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.394+0000 7fea3e217640 1 -- 172.21.15.50:0/4041310124 learned_addr learned my addr 172.21.15.50:0/4041310124 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.394+0000 7fea3ea18640 1 --2- 172.21.15.50:0/4041310124 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea3806f300 0x7fea380b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.394+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2764708406 0 0) 0x7fea38162280 con 0x7fea38161ea0 2024-09-11T22:13:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.394+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea24003520 con 0x7fea38161ea0 2024-09-11T22:13:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 109738835 0 0) 0x7fea24003520 con 0x7fea38161ea0 2024-09-11T22:13:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea3806f300 msgr2=0x7fea380b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3d215640 1 --2- 172.21.15.50:0/4041310124 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea3806f300 0x7fea380b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 >> v1:172.21.15.77:6789/0 conn(0x7fea3806ffb0 legacy=0x7fea380d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3806ccc0 con 0x7fea38161ea0 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fea34001690 con 0x7fea38161ea0 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 >> v1:172.21.15.50:6789/0 conn(0x7fea38161ea0 legacy=0x7fea3806f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3d215640 1 --2- 172.21.15.50:0/4041310124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea240039e0 0x7fea24003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3d215640 1 --2- 172.21.15.50:0/4041310124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004390 0x7fea24004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3d215640 1 --2- 172.21.15.50:0/4041310124 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea3806f300 0x7fea24005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea3806c9e0 con 0x7fea24004390 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea2400baa0 con 0x7fea240039e0 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fea2400bca0 con 0x7fea3806f300 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3da16640 1 --2- 172.21.15.50:0/4041310124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004390 0x7fea24004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3e217640 1 --2- 172.21.15.50:0/4041310124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea240039e0 0x7fea24003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3ea18640 1 --2- 172.21.15.50:0/4041310124 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea3806f300 0x7fea24005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3da16640 1 -- 172.21.15.50:0/4041310124 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea3806f300 msgr2=0x7fea24005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:31.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3da16640 1 --2- 172.21.15.50:0/4041310124 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea3806f300 0x7fea24005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3da16640 1 -- 172.21.15.50:0/4041310124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea240039e0 msgr2=0x7fea24003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3da16640 1 --2- 172.21.15.50:0/4041310124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea240039e0 0x7fea24003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.395+0000 7fea3da16640 1 -- 172.21.15.50:0/4041310124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea24003520 con 0x7fea24004390 2024-09-11T22:13:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.396+0000 7fea3da16640 1 --2- 172.21.15.50:0/4041310124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004390 0x7fea24004860 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fea28001860 tx=0x7fea24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d232b9e737ce9b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.396+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28037070 con 0x7fea24004390 2024-09-11T22:13:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.396+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea2802abf0 con 0x7fea24004390 2024-09-11T22:13:31.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.396+0000 7fea3d215640 1 -- 172.21.15.50:0/4041310124 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28001430 con 0x7fea24004390 2024-09-11T22:13:31.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.397+0000 7fea4047b640 1 -- 172.21.15.50:0/4041310124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004390 msgr2=0x7fea24004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:31.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.397+0000 7fea4047b640 1 --2- 172.21.15.50:0/4041310124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004390 0x7fea24004860 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fea28001860 tx=0x7fea24005830 comp rx=0 tx=0).stop 2024-09-11T22:13:31.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.397+0000 7fea3ea18640 1 -- 172.21.15.50:0/4041310124 reap_dead start 2024-09-11T22:13:31.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.397+0000 7fea4047b640 1 -- 172.21.15.50:0/4041310124 shutdown_connections 2024-09-11T22:13:31.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.397+0000 7fea4047b640 1 -- 172.21.15.50:0/4041310124 >> 172.21.15.50:0/4041310124 conn(0x7fea380b4150 msgr2=0x7fea380b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:31.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.397+0000 7fea4047b640 1 -- 172.21.15.50:0/4041310124 shutdown_connections 2024-09-11T22:13:31.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.397+0000 7fea4047b640 1 -- 172.21.15.50:0/4041310124 wait complete. 2024-09-11T22:13:31.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.398+0000 7fea4047b640 1 Processor -- start 2024-09-11T22:13:31.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.398+0000 7fea4047b640 1 -- start start 2024-09-11T22:13:31.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea4047b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004390 0x7fea38159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:31.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea4047b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea380b5eb0 0x7fea380c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:31.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea4047b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea381573c0 0x7fea38157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:31.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea4047b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea3806d7a0 con 0x7fea24004390 2024-09-11T22:13:31.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea4047b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea3806d280 con 0x7fea381573c0 2024-09-11T22:13:31.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea4047b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fea3806d920 con 0x7fea380b5eb0 2024-09-11T22:13:31.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea3e217640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004390 0x7fea38159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:31.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea3e217640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004390 0x7fea38159ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53504/0 (socket says 172.21.15.50:53504) 2024-09-11T22:13:31.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea3e217640 1 -- 172.21.15.50:0/2149609341 learned_addr learned my addr 172.21.15.50:0/2149609341 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:31.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea3e217640 1 -- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea380b5eb0 msgr2=0x7fea380c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:31.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea3da16640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea380b5eb0 0x7fea380c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:31.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea3ea18640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea381573c0 0x7fea38157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:31.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea3e217640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea380b5eb0 0x7fea380c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:31.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea3e217640 1 -- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea381573c0 msgr2=0x7fea38157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:31.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea3e217640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea381573c0 0x7fea38157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:31.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea3e217640 1 -- 172.21.15.50:0/2149609341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3815a5f0 con 0x7fea24004390 2024-09-11T22:13:31.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea3da16640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea380b5eb0 0x7fea380c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea3ea18640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea381573c0 0x7fea38157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea3e217640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004390 0x7fea38159ef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fea340072f0 tx=0x7fea340077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.399+0000 7fea2effd640 1 -- 172.21.15.50:0/2149609341 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3401a070 con 0x7fea24004390 2024-09-11T22:13:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.400+0000 7fea2effd640 1 -- 172.21.15.50:0/2149609341 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3400f960 con 0x7fea24004390 2024-09-11T22:13:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.400+0000 7fea4047b640 1 -- 172.21.15.50:0/2149609341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea380b20d0 con 0x7fea24004390 2024-09-11T22:13:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.400+0000 7fea2effd640 1 -- 172.21.15.50:0/2149609341 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3400fd30 con 0x7fea24004390 2024-09-11T22:13:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.400+0000 7fea4047b640 1 -- 172.21.15.50:0/2149609341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea380b2690 con 0x7fea24004390 2024-09-11T22:13:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.401+0000 7fea4047b640 1 -- 172.21.15.50:0/2149609341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea380b4c70 con 0x7fea24004390 2024-09-11T22:13:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.401+0000 7fea2effd640 1 -- 172.21.15.50:0/2149609341 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea3401d060 con 0x7fea24004390 2024-09-11T22:13:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.402+0000 7fea2effd640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fea1c06be60 0x7fea1c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.402+0000 7fea2effd640 1 -- 172.21.15.50:0/2149609341 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7fea3408a030 con 0x7fea24004390 2024-09-11T22:13:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.402+0000 7fea3da16640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fea1c06be60 0x7fea1c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.403+0000 7fea3da16640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fea1c06be60 0x7fea1c06e320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fea28034000 tx=0x7fea28009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.406+0000 7fea2effd640 1 -- 172.21.15.50:0/2149609341 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea34058b50 con 0x7fea24004390 2024-09-11T22:13:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:31.582+0000 7fea4047b640 1 -- 172.21.15.50:0/2149609341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fea3806a020 con 0x7fea24004390 2024-09-11T22:13:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.266+0000 7fea2effd640 1 -- 172.21.15.50:0/2149609341 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7fea34058450 con 0x7fea24004390 2024-09-11T22:13:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:13:32.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.270+0000 7fea4047b640 1 -- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fea1c06be60 msgr2=0x7fea1c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:32.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.270+0000 7fea4047b640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fea1c06be60 0x7fea1c06e320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fea28034000 tx=0x7fea28009030 comp rx=0 tx=0).stop 2024-09-11T22:13:32.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.270+0000 7fea4047b640 1 -- 172.21.15.50:0/2149609341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004390 msgr2=0x7fea38159ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:32.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.270+0000 7fea4047b640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004390 0x7fea38159ef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fea340072f0 tx=0x7fea340077b0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.270+0000 7fea4047b640 1 -- 172.21.15.50:0/2149609341 shutdown_connections 2024-09-11T22:13:32.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.270+0000 7fea4047b640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fea1c06be60 0x7fea1c06e320 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.270+0000 7fea4047b640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea380b5eb0 0x7fea380c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.270+0000 7fea4047b640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea381573c0 0x7fea38157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.270+0000 7fea4047b640 1 --2- 172.21.15.50:0/2149609341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea24004390 0x7fea38159ef0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.270+0000 7fea4047b640 1 -- 172.21.15.50:0/2149609341 >> 172.21.15.50:0/2149609341 conn(0x7fea380b4150 msgr2=0x7fea381604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:32.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.270+0000 7fea4047b640 1 -- 172.21.15.50:0/2149609341 shutdown_connections 2024-09-11T22:13:32.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.270+0000 7fea4047b640 1 -- 172.21.15.50:0/2149609341 wait complete. 2024-09-11T22:13:32.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T22:13:32.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.394+0000 7fd355a0e640 1 Processor -- start 2024-09-11T22:13:32.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.394+0000 7fd355a0e640 1 -- start start 2024-09-11T22:13:32.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.395+0000 7fd355a0e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd35015e880 0x7fd3500d5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:32.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.395+0000 7fd355a0e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3500ceff0 0x7fd3500b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:32.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.395+0000 7fd355a0e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd35015ec60 con 0x7fd3500cf450 2024-09-11T22:13:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.395+0000 7fd355a0e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd3500d4dd0 con 0x7fd35015e880 2024-09-11T22:13:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.395+0000 7fd355a0e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd3500cf9d0 con 0x7fd3500ceff0 2024-09-11T22:13:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.395+0000 7fd34effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd35015e880 0x7fd3500d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.395+0000 7fd34f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd3500cf450 0x7fd3500d2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57764/0 (socket says 172.21.15.50:57764) 2024-09-11T22:13:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.395+0000 7fd34f7fe640 1 -- 172.21.15.50:0/917423234 learned_addr learned my addr 172.21.15.50:0/917423234 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.395+0000 7fd34e7fc640 1 --2- 172.21.15.50:0/917423234 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3500ceff0 0x7fd3500b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.396+0000 7fd34effd640 1 -- 172.21.15.50:0/917423234 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3500ceff0 msgr2=0x7fd3500b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.396+0000 7fd34effd640 1 --2- 172.21.15.50:0/917423234 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3500ceff0 0x7fd3500b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.396+0000 7fd34effd640 1 -- 172.21.15.50:0/917423234 >> v1:172.21.15.50:6789/0 conn(0x7fd3500cf450 legacy=0x7fd3500d2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.396+0000 7fd34effd640 1 -- 172.21.15.50:0/917423234 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3500cfcb0 con 0x7fd35015e880 2024-09-11T22:13:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.396+0000 7fd34dffb640 1 -- 172.21.15.50:0/917423234 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3221666283 0 0) 0x7fd35015ec60 con 0x7fd3500cf450 2024-09-11T22:13:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.396+0000 7fd34effd640 1 --2- 172.21.15.50:0/917423234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd35015e880 0x7fd3500d5260 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd340009d90 tx=0x7fd34002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339e9fea17afafe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.396+0000 7fd34dffb640 1 -- 172.21.15.50:0/917423234 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd340007740 con 0x7fd35015e880 2024-09-11T22:13:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.397+0000 7fd34dffb640 1 -- 172.21.15.50:0/917423234 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3400078e0 con 0x7fd35015e880 2024-09-11T22:13:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.397+0000 7fd34dffb640 1 -- 172.21.15.50:0/917423234 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd340007cb0 con 0x7fd35015e880 2024-09-11T22:13:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.397+0000 7fd355a0e640 1 -- 172.21.15.50:0/917423234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd35015e880 msgr2=0x7fd3500d5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.397+0000 7fd355a0e640 1 --2- 172.21.15.50:0/917423234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd35015e880 0x7fd3500d5260 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd340009d90 tx=0x7fd34002a660 comp rx=0 tx=0).stop 2024-09-11T22:13:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.397+0000 7fd355a0e640 1 -- 172.21.15.50:0/917423234 shutdown_connections 2024-09-11T22:13:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.397+0000 7fd355a0e640 1 --2- 172.21.15.50:0/917423234 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3500ceff0 0x7fd3500b6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.397+0000 7fd355a0e640 1 --2- 172.21.15.50:0/917423234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd35015e880 0x7fd3500d5260 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.397+0000 7fd355a0e640 1 -- 172.21.15.50:0/917423234 >> 172.21.15.50:0/917423234 conn(0x7fd3500723b0 msgr2=0x7fd3500727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.397+0000 7fd355a0e640 1 -- 172.21.15.50:0/917423234 shutdown_connections 2024-09-11T22:13:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.397+0000 7fd355a0e640 1 -- 172.21.15.50:0/917423234 wait complete. 2024-09-11T22:13:32.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.398+0000 7fd355a0e640 1 Processor -- start 2024-09-11T22:13:32.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.399+0000 7fd355a0e640 1 -- start start 2024-09-11T22:13:32.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.399+0000 7fd355a0e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3500ceff0 0x7fd35015d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:32.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.399+0000 7fd355a0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3500cf450 0x7fd35015ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:32.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.399+0000 7fd355a0e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd35015e880 0x7fd35015f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:32.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.399+0000 7fd355a0e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd3500d24b0 con 0x7fd3500ceff0 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.399+0000 7fd355a0e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd3500d4a60 con 0x7fd3500cf450 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.399+0000 7fd355a0e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd3500d2630 con 0x7fd35015e880 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.399+0000 7fd34effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3500ceff0 0x7fd35015d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.399+0000 7fd34effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3500ceff0 0x7fd35015d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53532/0 (socket says 172.21.15.50:53532) 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.399+0000 7fd34effd640 1 -- 172.21.15.50:0/1154815249 learned_addr learned my addr 172.21.15.50:0/1154815249 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd34f7fe640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd35015e880 0x7fd35015f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd34e7fc640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3500cf450 0x7fd35015ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd34effd640 1 -- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd35015e880 msgr2=0x7fd35015f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd34effd640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd35015e880 0x7fd35015f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd34effd640 1 -- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3500cf450 msgr2=0x7fd35015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd34effd640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3500cf450 0x7fd35015ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd34effd640 1 -- 172.21.15.50:0/1154815249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35015f7c0 con 0x7fd3500ceff0 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd34f7fe640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd35015e880 0x7fd35015f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:32.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd34e7fc640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3500cf450 0x7fd35015ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd34effd640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3500ceff0 0x7fd35015d480 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd340009d90 tx=0x7fd340004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd347fff640 1 -- 172.21.15.50:0/1154815249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd340040070 con 0x7fd3500ceff0 2024-09-11T22:13:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd347fff640 1 -- 172.21.15.50:0/1154815249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd340031c40 con 0x7fd3500ceff0 2024-09-11T22:13:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd355a0e640 1 -- 172.21.15.50:0/1154815249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35015fa90 con 0x7fd3500ceff0 2024-09-11T22:13:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd347fff640 1 -- 172.21.15.50:0/1154815249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34003c420 con 0x7fd3500ceff0 2024-09-11T22:13:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.400+0000 7fd355a0e640 1 -- 172.21.15.50:0/1154815249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd350160050 con 0x7fd3500ceff0 2024-09-11T22:13:32.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.401+0000 7fd355a0e640 1 -- 172.21.15.50:0/1154815249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3500b6790 con 0x7fd3500ceff0 2024-09-11T22:13:32.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.402+0000 7fd347fff640 1 -- 172.21.15.50:0/1154815249 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd340039040 con 0x7fd3500ceff0 2024-09-11T22:13:32.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.402+0000 7fd347fff640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd33006be30 0x7fd33006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:32.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.402+0000 7fd347fff640 1 -- 172.21.15.50:0/1154815249 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fd3400ac1c0 con 0x7fd3500ceff0 2024-09-11T22:13:32.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.402+0000 7fd34e7fc640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd33006be30 0x7fd33006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:32.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.403+0000 7fd34e7fc640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd33006be30 0x7fd33006e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd338006fd0 tx=0x7fd338008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:32.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.406+0000 7fd347fff640 1 -- 172.21.15.50:0/1154815249 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd34007ae70 con 0x7fd3500ceff0 2024-09-11T22:13:32.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.581+0000 7fd355a0e640 1 -- 172.21.15.50:0/1154815249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fd350072930 con 0x7fd3500ceff0 2024-09-11T22:13:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.584+0000 7fd347fff640 1 -- 172.21.15.50:0/1154815249 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fd34007a770 con 0x7fd3500ceff0 2024-09-11T22:13:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.586+0000 7fd355a0e640 1 -- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd33006be30 msgr2=0x7fd33006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.586+0000 7fd355a0e640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd33006be30 0x7fd33006e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd338006fd0 tx=0x7fd338008040 comp rx=0 tx=0).stop 2024-09-11T22:13:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.586+0000 7fd355a0e640 1 -- 172.21.15.50:0/1154815249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3500ceff0 msgr2=0x7fd35015d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.586+0000 7fd355a0e640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3500ceff0 0x7fd35015d480 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd340009d90 tx=0x7fd340004a40 comp rx=0 tx=0).stop 2024-09-11T22:13:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.586+0000 7fd355a0e640 1 -- 172.21.15.50:0/1154815249 shutdown_connections 2024-09-11T22:13:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.586+0000 7fd355a0e640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd33006be30 0x7fd33006e2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.586+0000 7fd355a0e640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd35015e880 0x7fd35015f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.586+0000 7fd355a0e640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3500cf450 0x7fd35015ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.586+0000 7fd355a0e640 1 --2- 172.21.15.50:0/1154815249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3500ceff0 0x7fd35015d480 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.586+0000 7fd355a0e640 1 -- 172.21.15.50:0/1154815249 >> 172.21.15.50:0/1154815249 conn(0x7fd3500723b0 msgr2=0x7fd3500b3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.586+0000 7fd355a0e640 1 -- 172.21.15.50:0/1154815249 shutdown_connections 2024-09-11T22:13:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.586+0000 7fd355a0e640 1 -- 172.21.15.50:0/1154815249 wait complete. 2024-09-11T22:13:32.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-11T22:13:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.699+0000 7f5fb91c0640 1 Processor -- start 2024-09-11T22:13:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.700+0000 7f5fb91c0640 1 -- start start 2024-09-11T22:13:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.700+0000 7f5fb91c0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5fb415c770 0x7f5fb40b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.700+0000 7f5fb91c0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fb40b66e0 0x7f5fb415e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.700+0000 7f5fb91c0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb415cef0 con 0x7f5fb40b5920 2024-09-11T22:13:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.700+0000 7f5fb91c0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5fb415d1d0 con 0x7f5fb40b66e0 2024-09-11T22:13:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.700+0000 7f5fb91c0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5fb415d4b0 con 0x7f5fb415c770 2024-09-11T22:13:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.701+0000 7f5fb359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fb40b66e0 0x7f5fb415e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.701+0000 7f5fb359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fb40b66e0 0x7f5fb415e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53548/0 (socket says 172.21.15.50:53548) 2024-09-11T22:13:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.701+0000 7f5fb359e640 1 -- 172.21.15.50:0/50985097 learned_addr learned my addr 172.21.15.50:0/50985097 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.701+0000 7f5fb2d9d640 1 --2- 172.21.15.50:0/50985097 >> v2:172.21.15.77:3300/0 conn(0x7f5fb415c770 0x7f5fb40b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.701+0000 7f5fb359e640 1 -- 172.21.15.50:0/50985097 >> v2:172.21.15.77:3300/0 conn(0x7f5fb415c770 msgr2=0x7f5fb40b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.701+0000 7f5fb359e640 1 --2- 172.21.15.50:0/50985097 >> v2:172.21.15.77:3300/0 conn(0x7f5fb415c770 0x7f5fb40b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.701+0000 7f5fb359e640 1 -- 172.21.15.50:0/50985097 >> v1:172.21.15.77:6789/0 conn(0x7f5fb40b5920 legacy=0x7f5fb40b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.701+0000 7f5fb359e640 1 -- 172.21.15.50:0/50985097 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb415d790 con 0x7f5fb40b66e0 2024-09-11T22:13:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.702+0000 7f5fb359e640 1 --2- 172.21.15.50:0/50985097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb40b66e0 0x7f5fb415e050 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5fb406e560 tx=0x7f5fac02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd466b7d5f5fadd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.702+0000 7f5fb1d9b640 1 -- 172.21.15.50:0/50985097 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac036070 con 0x7f5fb40b66e0 2024-09-11T22:13:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.702+0000 7f5fb1d9b640 1 -- 172.21.15.50:0/50985097 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fac031600 con 0x7f5fb40b66e0 2024-09-11T22:13:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.702+0000 7f5fb1d9b640 1 -- 172.21.15.50:0/50985097 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac0319d0 con 0x7f5fb40b66e0 2024-09-11T22:13:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.702+0000 7f5fb91c0640 1 -- 172.21.15.50:0/50985097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb40b66e0 msgr2=0x7f5fb415e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.702+0000 7f5fb91c0640 1 --2- 172.21.15.50:0/50985097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb40b66e0 0x7f5fb415e050 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5fb406e560 tx=0x7f5fac02a730 comp rx=0 tx=0).stop 2024-09-11T22:13:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.702+0000 7f5fb91c0640 1 -- 172.21.15.50:0/50985097 shutdown_connections 2024-09-11T22:13:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.702+0000 7f5fb91c0640 1 --2- 172.21.15.50:0/50985097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb40b66e0 0x7f5fb415e050 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.702+0000 7f5fb91c0640 1 --2- 172.21.15.50:0/50985097 >> v2:172.21.15.77:3300/0 conn(0x7f5fb415c770 0x7f5fb40b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.702+0000 7f5fb91c0640 1 -- 172.21.15.50:0/50985097 >> 172.21.15.50:0/50985097 conn(0x7f5fb40b7940 msgr2=0x7f5fb40b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.702+0000 7f5fb91c0640 1 -- 172.21.15.50:0/50985097 shutdown_connections 2024-09-11T22:13:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.702+0000 7f5fb91c0640 1 -- 172.21.15.50:0/50985097 wait complete. 2024-09-11T22:13:32.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.704+0000 7f5fb91c0640 1 Processor -- start 2024-09-11T22:13:32.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.704+0000 7f5fb91c0640 1 -- start start 2024-09-11T22:13:32.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb91c0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb40b5920 0x7f5fb409f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:32.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb91c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb40b66e0 0x7f5fb4149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:32.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb91c0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fb415c770 0x7f5fb409d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb91c0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb415ccd0 con 0x7f5fb40b5920 2024-09-11T22:13:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb91c0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb415cb50 con 0x7f5fb40b66e0 2024-09-11T22:13:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb91c0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5fb415e590 con 0x7f5fb415c770 2024-09-11T22:13:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb40b5920 0x7f5fb409f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb40b5920 0x7f5fb409f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53556/0 (socket says 172.21.15.50:53556) 2024-09-11T22:13:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb2d9d640 1 -- 172.21.15.50:0/289092915 learned_addr learned my addr 172.21.15.50:0/289092915 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb259c640 1 --2- 172.21.15.50:0/289092915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb40b66e0 0x7f5fb4149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb2d9d640 1 -- 172.21.15.50:0/289092915 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fb415c770 msgr2=0x7f5fb409d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb2d9d640 1 --2- 172.21.15.50:0/289092915 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fb415c770 0x7f5fb409d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb2d9d640 1 -- 172.21.15.50:0/289092915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb40b66e0 msgr2=0x7f5fb4149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb2d9d640 1 --2- 172.21.15.50:0/289092915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb40b66e0 0x7f5fb4149080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:32.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb2d9d640 1 -- 172.21.15.50:0/289092915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb409d830 con 0x7f5fb40b5920 2024-09-11T22:13:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb2d9d640 1 --2- 172.21.15.50:0/289092915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb40b5920 0x7f5fb409f860 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400e8a0 tx=0x7f5fa400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5f9b7fe640 1 -- 172.21.15.50:0/289092915 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4017070 con 0x7f5fb40b5920 2024-09-11T22:13:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5f9b7fe640 1 -- 172.21.15.50:0/289092915 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa400c940 con 0x7f5fb40b5920 2024-09-11T22:13:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5fb91c0640 1 -- 172.21.15.50:0/289092915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb409fef0 con 0x7f5fb40b5920 2024-09-11T22:13:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.705+0000 7f5f9b7fe640 1 -- 172.21.15.50:0/289092915 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400cd30 con 0x7f5fb40b5920 2024-09-11T22:13:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.706+0000 7f5fb91c0640 1 -- 172.21.15.50:0/289092915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb41541a0 con 0x7f5fb40b5920 2024-09-11T22:13:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.706+0000 7f5fb91c0640 1 -- 172.21.15.50:0/289092915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb415e050 con 0x7f5fb40b5920 2024-09-11T22:13:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.707+0000 7f5f9b7fe640 1 -- 172.21.15.50:0/289092915 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5fa401a070 con 0x7f5fb40b5920 2024-09-11T22:13:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.707+0000 7f5f9b7fe640 1 --2- 172.21.15.50:0/289092915 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5fa006be30 0x7f5fa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:32.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.707+0000 7f5f9b7fe640 1 -- 172.21.15.50:0/289092915 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f5fa408a9d0 con 0x7f5fb40b5920 2024-09-11T22:13:32.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.708+0000 7f5fb259c640 1 --2- 172.21.15.50:0/289092915 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5fa006be30 0x7f5fa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:32.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.708+0000 7f5fb259c640 1 --2- 172.21.15.50:0/289092915 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5fa006be30 0x7f5fa006e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5fb41f59d0 tx=0x7f5fa8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:32.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.712+0000 7f5f9b7fe640 1 -- 172.21.15.50:0/289092915 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5fa4059680 con 0x7f5fb40b5920 2024-09-11T22:13:32.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:32.960+0000 7f5fb91c0640 1 -- 172.21.15.50:0/289092915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f5fb406f530 con 0x7f5fb40b5920 2024-09-11T22:13:33.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.268+0000 7f5f9b7fe640 1 -- 172.21.15.50:0/289092915 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v118) ==== 148+0+0 (secure 0 0 0) 0x7f5fa4058f80 con 0x7f5fb40b5920 2024-09-11T22:13:33.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.271+0000 7f5fb91c0640 1 -- 172.21.15.50:0/289092915 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5fa006be30 msgr2=0x7f5fa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:33.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.271+0000 7f5fb91c0640 1 --2- 172.21.15.50:0/289092915 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5fa006be30 0x7f5fa006e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5fb41f59d0 tx=0x7f5fa8009040 comp rx=0 tx=0).stop 2024-09-11T22:13:33.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.271+0000 7f5fb91c0640 1 -- 172.21.15.50:0/289092915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb40b5920 msgr2=0x7f5fb409f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:33.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.271+0000 7f5fb91c0640 1 --2- 172.21.15.50:0/289092915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb40b5920 0x7f5fb409f860 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400e8a0 tx=0x7f5fa400ed60 comp rx=0 tx=0).stop 2024-09-11T22:13:33.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.271+0000 7f5fb91c0640 1 -- 172.21.15.50:0/289092915 shutdown_connections 2024-09-11T22:13:33.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.271+0000 7f5fb91c0640 1 --2- 172.21.15.50:0/289092915 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5fa006be30 0x7f5fa006e2f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.271+0000 7f5fb91c0640 1 --2- 172.21.15.50:0/289092915 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fb415c770 0x7f5fb409d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.271+0000 7f5fb91c0640 1 --2- 172.21.15.50:0/289092915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb40b66e0 0x7f5fb4149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.271+0000 7f5fb91c0640 1 --2- 172.21.15.50:0/289092915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb40b5920 0x7f5fb409f860 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.271+0000 7f5fb91c0640 1 -- 172.21.15.50:0/289092915 >> 172.21.15.50:0/289092915 conn(0x7f5fb40b7940 msgr2=0x7f5fb415ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:33.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.271+0000 7f5fb91c0640 1 -- 172.21.15.50:0/289092915 shutdown_connections 2024-09-11T22:13:33.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.271+0000 7f5fb91c0640 1 -- 172.21.15.50:0/289092915 wait complete. 2024-09-11T22:13:33.283 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-09-11T22:13:33.283 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-11T22:13:33.283 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:13:33.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.386+0000 7f47504d0640 1 Processor -- start 2024-09-11T22:13:33.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.386+0000 7f47504d0640 1 -- start start 2024-09-11T22:13:33.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f47504d0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47480d5260 0x7f47480b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:33.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f47504d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47480b6cd0 0x7f47480b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:33.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f47504d0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f474815ec60 con 0x7f474815e880 2024-09-11T22:13:33.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f47504d0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f47480b7140 con 0x7f47480d5260 2024-09-11T22:13:33.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f47504d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f47480d4dd0 con 0x7f47480b6cd0 2024-09-11T22:13:33.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f474da6b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47480d5260 0x7f47480b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:33.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f474da6b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47480d5260 0x7f47480b6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53560/0 (socket says 172.21.15.50:53560) 2024-09-11T22:13:33.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f474da6b640 1 -- 172.21.15.50:0/137516733 learned_addr learned my addr 172.21.15.50:0/137516733 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:33.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f474ea6d640 1 --2- 172.21.15.50:0/137516733 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47480b6cd0 0x7f47480b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:33.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f474da6b640 1 -- 172.21.15.50:0/137516733 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47480b6cd0 msgr2=0x7f47480b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:33.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f474da6b640 1 --2- 172.21.15.50:0/137516733 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47480b6cd0 0x7f47480b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f474da6b640 1 -- 172.21.15.50:0/137516733 >> v1:172.21.15.77:6789/0 conn(0x7f474815e880 legacy=0x7f47480ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:33.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f474da6b640 1 -- 172.21.15.50:0/137516733 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47480cf700 con 0x7f47480d5260 2024-09-11T22:13:33.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.387+0000 7f474ea6d640 1 --2- 172.21.15.50:0/137516733 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47480b6cd0 0x7f47480b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:33.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.388+0000 7f474da6b640 1 --2- 172.21.15.50:0/137516733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47480d5260 0x7f47480b6790 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4738009870 tx=0x7f473802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81c4716108f87fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:33.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.388+0000 7f474d26a640 1 -- 172.21.15.50:0/137516733 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738037070 con 0x7f47480d5260 2024-09-11T22:13:33.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.388+0000 7f474d26a640 1 -- 172.21.15.50:0/137516733 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4738032440 con 0x7f47480d5260 2024-09-11T22:13:33.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.388+0000 7f474d26a640 1 -- 172.21.15.50:0/137516733 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738032810 con 0x7f47480d5260 2024-09-11T22:13:33.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.389+0000 7f47504d0640 1 -- 172.21.15.50:0/137516733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47480d5260 msgr2=0x7f47480b6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:33.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.389+0000 7f47504d0640 1 --2- 172.21.15.50:0/137516733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47480d5260 0x7f47480b6790 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4738009870 tx=0x7f473802a210 comp rx=0 tx=0).stop 2024-09-11T22:13:33.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.389+0000 7f47504d0640 1 -- 172.21.15.50:0/137516733 shutdown_connections 2024-09-11T22:13:33.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.389+0000 7f47504d0640 1 --2- 172.21.15.50:0/137516733 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47480b6cd0 0x7f47480b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.389+0000 7f47504d0640 1 --2- 172.21.15.50:0/137516733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47480d5260 0x7f47480b6790 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.389+0000 7f47504d0640 1 -- 172.21.15.50:0/137516733 >> 172.21.15.50:0/137516733 conn(0x7f47480723b0 msgr2=0x7f47480727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:33.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.389+0000 7f47504d0640 1 -- 172.21.15.50:0/137516733 shutdown_connections 2024-09-11T22:13:33.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.389+0000 7f47504d0640 1 -- 172.21.15.50:0/137516733 wait complete. 2024-09-11T22:13:33.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.390+0000 7f47504d0640 1 Processor -- start 2024-09-11T22:13:33.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.390+0000 7f47504d0640 1 -- start start 2024-09-11T22:13:33.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f47504d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47480b6cd0 0x7f47480c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:33.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f47504d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47480d5260 0x7f47480b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:33.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f47504d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f474815e880 0x7f47481f79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f47504d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f47480d4780 con 0x7f47480d5260 2024-09-11T22:13:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f47504d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f47480cfcb0 con 0x7f47480b6cd0 2024-09-11T22:13:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f47504d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f47480d4a60 con 0x7f474815e880 2024-09-11T22:13:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f474da6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47480d5260 0x7f47480b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f474da6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47480d5260 0x7f47480b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53574/0 (socket says 172.21.15.50:53574) 2024-09-11T22:13:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f474da6b640 1 -- 172.21.15.50:0/3843179991 learned_addr learned my addr 172.21.15.50:0/3843179991 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f474da6b640 1 -- 172.21.15.50:0/3843179991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f474815e880 msgr2=0x7f47481f79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f474da6b640 1 --2- 172.21.15.50:0/3843179991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f474815e880 0x7f47481f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f474da6b640 1 -- 172.21.15.50:0/3843179991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47480b6cd0 msgr2=0x7f47480c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f474da6b640 1 --2- 172.21.15.50:0/3843179991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47480b6cd0 0x7f47480c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f474da6b640 1 -- 172.21.15.50:0/3843179991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47480c9390 con 0x7f47480d5260 2024-09-11T22:13:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f474da6b640 1 --2- 172.21.15.50:0/3843179991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47480d5260 0x7f47480b4480 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4738000c00 tx=0x7f47380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:33.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f473effd640 1 -- 172.21.15.50:0/3843179991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738037040 con 0x7f47480d5260 2024-09-11T22:13:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f473effd640 1 -- 172.21.15.50:0/3843179991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4738042070 con 0x7f47480d5260 2024-09-11T22:13:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f47504d0640 1 -- 172.21.15.50:0/3843179991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47480c8af0 con 0x7f47480d5260 2024-09-11T22:13:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.391+0000 7f473effd640 1 -- 172.21.15.50:0/3843179991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738030bb0 con 0x7f47480d5260 2024-09-11T22:13:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.392+0000 7f47504d0640 1 -- 172.21.15.50:0/3843179991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47480c90b0 con 0x7f47480d5260 2024-09-11T22:13:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.392+0000 7f47504d0640 1 -- 172.21.15.50:0/3843179991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47480d24b0 con 0x7f47480d5260 2024-09-11T22:13:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.393+0000 7f473effd640 1 -- 172.21.15.50:0/3843179991 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4738047460 con 0x7f47480d5260 2024-09-11T22:13:33.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.393+0000 7f473effd640 1 --2- 172.21.15.50:0/3843179991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f472c06be30 0x7f472c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:33.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.393+0000 7f473effd640 1 -- 172.21.15.50:0/3843179991 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f47380ab7a0 con 0x7f47480d5260 2024-09-11T22:13:33.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.394+0000 7f474e26c640 1 --2- 172.21.15.50:0/3843179991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f472c06be30 0x7f472c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:33.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.394+0000 7f474e26c640 1 --2- 172.21.15.50:0/3843179991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f472c06be30 0x7f472c06e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4744006fd0 tx=0x7f4744006bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:33.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.398+0000 7f473effd640 1 -- 172.21.15.50:0/3843179991 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4738045360 con 0x7f47480d5260 2024-09-11T22:13:33.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.574+0000 7f47504d0640 1 -- 172.21.15.50:0/3843179991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47480b53a0 con 0x7f47480d5260 2024-09-11T22:13:33.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.575+0000 7f473effd640 1 -- 172.21.15.50:0/3843179991 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+12994 (secure 0 0 0) 0x7f473807a450 con 0x7f47480d5260 2024-09-11T22:13:33.576 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:33.576 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":37,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:13:32.262666+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6833/900288576":"2024-09-12T22:13:29.252610+0000","172.21.15.50:6832/900288576":"2024-09-12T22:13:29.252610+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:13:33.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.577+0000 7f47504d0640 1 -- 172.21.15.50:0/3843179991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f472c06be30 msgr2=0x7f472c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:33.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.577+0000 7f47504d0640 1 --2- 172.21.15.50:0/3843179991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f472c06be30 0x7f472c06e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4744006fd0 tx=0x7f4744006bc0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.577+0000 7f47504d0640 1 -- 172.21.15.50:0/3843179991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47480d5260 msgr2=0x7f47480b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:33.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.577+0000 7f47504d0640 1 --2- 172.21.15.50:0/3843179991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47480d5260 0x7f47480b4480 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4738000c00 tx=0x7f47380046c0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.577+0000 7f47504d0640 1 -- 172.21.15.50:0/3843179991 shutdown_connections 2024-09-11T22:13:33.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.577+0000 7f47504d0640 1 --2- 172.21.15.50:0/3843179991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f472c06be30 0x7f472c06e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.577+0000 7f47504d0640 1 --2- 172.21.15.50:0/3843179991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f474815e880 0x7f47481f79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.577+0000 7f47504d0640 1 --2- 172.21.15.50:0/3843179991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47480d5260 0x7f47480b4480 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.577+0000 7f47504d0640 1 --2- 172.21.15.50:0/3843179991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47480b6cd0 0x7f47480c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.577+0000 7f47504d0640 1 -- 172.21.15.50:0/3843179991 >> 172.21.15.50:0/3843179991 conn(0x7f47480723b0 msgr2=0x7f47480b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:33.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.577+0000 7f47504d0640 1 -- 172.21.15.50:0/3843179991 shutdown_connections 2024-09-11T22:13:33.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.577+0000 7f47504d0640 1 -- 172.21.15.50:0/3843179991 wait complete. 2024-09-11T22:13:33.589 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:11:03.407373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:13:33.589 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:13:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.694+0000 7f9dca352640 1 Processor -- start 2024-09-11T22:13:33.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.694+0000 7f9dca352640 1 -- start start 2024-09-11T22:13:33.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dca352640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9dc415fd80 0x7f9dc40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:33.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dca352640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9dc40af4c0 0x7f9dc40b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:33.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dca352640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc40b2970 0x7f9dc40d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:33.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dca352640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc40af940 con 0x7f9dc415fd80 2024-09-11T22:13:33.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dca352640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc40afc20 con 0x7f9dc40af4c0 2024-09-11T22:13:33.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dca352640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc40aff00 con 0x7f9dc40b2970 2024-09-11T22:13:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dc3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9dc415fd80 0x7f9dc40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dc3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9dc415fd80 0x7f9dc40b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53582/0 (socket says 172.21.15.50:53582) 2024-09-11T22:13:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dc3fff640 1 -- 172.21.15.50:0/670601445 learned_addr learned my addr 172.21.15.50:0/670601445 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dc37fe640 1 --2- 172.21.15.50:0/670601445 >> v2:172.21.15.77:3300/0 conn(0x7f9dc40af4c0 0x7f9dc40b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dc88ef640 1 --2- 172.21.15.50:0/670601445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc40b2970 0x7f9dc40d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dc3fff640 1 -- 172.21.15.50:0/670601445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc40b2970 msgr2=0x7f9dc40d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dc3fff640 1 --2- 172.21.15.50:0/670601445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc40b2970 0x7f9dc40d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dc3fff640 1 -- 172.21.15.50:0/670601445 >> v2:172.21.15.77:3300/0 conn(0x7f9dc40af4c0 msgr2=0x7f9dc40b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dc3fff640 1 --2- 172.21.15.50:0/670601445 >> v2:172.21.15.77:3300/0 conn(0x7f9dc40af4c0 0x7f9dc40b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dc3fff640 1 -- 172.21.15.50:0/670601445 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc40b01e0 con 0x7f9dc415fd80 2024-09-11T22:13:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dc37fe640 1 --2- 172.21.15.50:0/670601445 >> v2:172.21.15.77:3300/0 conn(0x7f9dc40af4c0 0x7f9dc40b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:33.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.695+0000 7f9dc88ef640 1 --2- 172.21.15.50:0/670601445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc40b2970 0x7f9dc40d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:33.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.696+0000 7f9dc3fff640 1 --2- 172.21.15.50:0/670601445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc415fd80 0x7f9dc40b1ef0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40d23d0 tx=0x7f9db402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0bf7709118a04 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:33.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.696+0000 7f9dc2ffd640 1 -- 172.21.15.50:0/670601445 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db4037070 con 0x7f9dc415fd80 2024-09-11T22:13:33.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.696+0000 7f9dc2ffd640 1 -- 172.21.15.50:0/670601445 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db4032440 con 0x7f9dc415fd80 2024-09-11T22:13:33.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.696+0000 7f9dc2ffd640 1 -- 172.21.15.50:0/670601445 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db4032810 con 0x7f9dc415fd80 2024-09-11T22:13:33.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.697+0000 7f9dca352640 1 -- 172.21.15.50:0/670601445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc415fd80 msgr2=0x7f9dc40b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:33.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.697+0000 7f9dca352640 1 --2- 172.21.15.50:0/670601445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc415fd80 0x7f9dc40b1ef0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40d23d0 tx=0x7f9db402a140 comp rx=0 tx=0).stop 2024-09-11T22:13:33.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.697+0000 7f9dca352640 1 -- 172.21.15.50:0/670601445 shutdown_connections 2024-09-11T22:13:33.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.697+0000 7f9dca352640 1 --2- 172.21.15.50:0/670601445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc40b2970 0x7f9dc40d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.697+0000 7f9dca352640 1 --2- 172.21.15.50:0/670601445 >> v2:172.21.15.77:3300/0 conn(0x7f9dc40af4c0 0x7f9dc40b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.697+0000 7f9dca352640 1 --2- 172.21.15.50:0/670601445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc415fd80 0x7f9dc40b1ef0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.697+0000 7f9dca352640 1 -- 172.21.15.50:0/670601445 >> 172.21.15.50:0/670601445 conn(0x7f9dc409ba50 msgr2=0x7f9dc40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:33.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.697+0000 7f9dca352640 1 -- 172.21.15.50:0/670601445 shutdown_connections 2024-09-11T22:13:33.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.697+0000 7f9dca352640 1 -- 172.21.15.50:0/670601445 wait complete. 2024-09-11T22:13:33.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.698+0000 7f9dca352640 1 Processor -- start 2024-09-11T22:13:33.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.698+0000 7f9dca352640 1 -- start start 2024-09-11T22:13:33.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dca352640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc40af4c0 0x7f9dc406bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:33.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dca352640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc40b2970 0x7f9dc41ee700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:33.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dca352640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc415fd80 0x7f9dc40b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:33.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dca352640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc4160160 con 0x7f9dc415fd80 2024-09-11T22:13:33.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dca352640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc40b3ee0 con 0x7f9dc40af4c0 2024-09-11T22:13:33.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dca352640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc41602e0 con 0x7f9dc40b2970 2024-09-11T22:13:33.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc88ef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc415fd80 0x7f9dc40b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:33.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc88ef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc415fd80 0x7f9dc40b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53588/0 (socket says 172.21.15.50:53588) 2024-09-11T22:13:33.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc88ef640 1 -- 172.21.15.50:0/243163780 learned_addr learned my addr 172.21.15.50:0/243163780 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:33.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc3fff640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc40af4c0 0x7f9dc406bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc37fe640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc40b2970 0x7f9dc41ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc88ef640 1 -- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc40b2970 msgr2=0x7f9dc41ee700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc88ef640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc40b2970 0x7f9dc41ee700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc88ef640 1 -- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc40af4c0 msgr2=0x7f9dc406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc88ef640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc40af4c0 0x7f9dc406bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc88ef640 1 -- 172.21.15.50:0/243163780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc406c430 con 0x7f9dc415fd80 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc37fe640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc40b2970 0x7f9dc41ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc88ef640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc415fd80 0x7f9dc40b6e00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00cd50 tx=0x7f9dbc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc0ff9640 1 -- 172.21.15.50:0/243163780 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc00f680 con 0x7f9dc415fd80 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.699+0000 7f9dc0ff9640 1 -- 172.21.15.50:0/243163780 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dbc00f840 con 0x7f9dc415fd80 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.700+0000 7f9dc0ff9640 1 -- 172.21.15.50:0/243163780 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc00fc30 con 0x7f9dc415fd80 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.700+0000 7f9dca352640 1 -- 172.21.15.50:0/243163780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc406c710 con 0x7f9dc415fd80 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.700+0000 7f9dca352640 1 -- 172.21.15.50:0/243163780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc41f5aa0 con 0x7f9dc415fd80 2024-09-11T22:13:33.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.701+0000 7f9dca352640 1 -- 172.21.15.50:0/243163780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc4075770 con 0x7f9dc415fd80 2024-09-11T22:13:33.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.701+0000 7f9dc0ff9640 1 -- 172.21.15.50:0/243163780 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9dbc0213f0 con 0x7f9dc415fd80 2024-09-11T22:13:33.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.702+0000 7f9dc0ff9640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9db006be30 0x7f9db006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:33.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.702+0000 7f9dc0ff9640 1 -- 172.21.15.50:0/243163780 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f9dbc08b830 con 0x7f9dc415fd80 2024-09-11T22:13:33.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.702+0000 7f9dc3fff640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9db006be30 0x7f9db006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:33.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.703+0000 7f9dc3fff640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9db006be30 0x7f9db006e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9db4034000 tx=0x7f9db402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:33.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.706+0000 7f9dc0ff9640 1 -- 172.21.15.50:0/243163780 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9dc4075770 con 0x7f9dc415fd80 2024-09-11T22:13:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.881+0000 7f9dca352640 1 -- 172.21.15.50:0/243163780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9dc40b1ef0 con 0x7f9dc415fd80 2024-09-11T22:13:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.882+0000 7f9dc0ff9640 1 -- 172.21.15.50:0/243163780 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f9dbc014030 con 0x7f9dc415fd80 2024-09-11T22:13:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-11T22:13:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.884+0000 7f9dca352640 1 -- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9db006be30 msgr2=0x7f9db006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.884+0000 7f9dca352640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9db006be30 0x7f9db006e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9db4034000 tx=0x7f9db402e000 comp rx=0 tx=0).stop 2024-09-11T22:13:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.884+0000 7f9dca352640 1 -- 172.21.15.50:0/243163780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc415fd80 msgr2=0x7f9dc40b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.884+0000 7f9dca352640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc415fd80 0x7f9dc40b6e00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00cd50 tx=0x7f9dbc00a650 comp rx=0 tx=0).stop 2024-09-11T22:13:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.884+0000 7f9dca352640 1 -- 172.21.15.50:0/243163780 shutdown_connections 2024-09-11T22:13:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.884+0000 7f9dca352640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9db006be30 0x7f9db006e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.884+0000 7f9dca352640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc40b2970 0x7f9dc41ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.884+0000 7f9dca352640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dc415fd80 0x7f9dc40b6e00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.884+0000 7f9dca352640 1 --2- 172.21.15.50:0/243163780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc40af4c0 0x7f9dc406bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.884+0000 7f9dca352640 1 -- 172.21.15.50:0/243163780 >> 172.21.15.50:0/243163780 conn(0x7f9dc409ba50 msgr2=0x7f9dc40b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.884+0000 7f9dca352640 1 -- 172.21.15.50:0/243163780 shutdown_connections 2024-09-11T22:13:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.884+0000 7f9dca352640 1 -- 172.21.15.50:0/243163780 wait complete. 2024-09-11T22:13:33.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-11T22:13:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.999+0000 7f83317b0640 1 Processor -- start 2024-09-11T22:13:34.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.999+0000 7f83317b0640 1 -- start start 2024-09-11T22:13:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:33.999+0000 7f83317b0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f832c0b5fd0 0x7f832c0b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.000+0000 7f83317b0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f832c0b6930 con 0x7f832c15c770 2024-09-11T22:13:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.000+0000 7f83317b0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f832c15cef0 con 0x7f832c15e050 2024-09-11T22:13:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.000+0000 7f83317b0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f832c15d1d0 con 0x7f832c0b5fd0 2024-09-11T22:13:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.000+0000 7f832affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f832c15c770 0x7f832c0b53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57778/0 (socket says 172.21.15.50:57778) 2024-09-11T22:13:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.000+0000 7f832affd640 1 -- 172.21.15.50:0/2847806699 learned_addr learned my addr 172.21.15.50:0/2847806699 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.000+0000 7f8323fff640 1 --2- 172.21.15.50:0/2847806699 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f832c0b5fd0 0x7f832c0b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.000+0000 7f832a7fc640 1 -- 172.21.15.50:0/2847806699 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1890508680 0 0) 0x7f832c0b6930 con 0x7f832c15c770 2024-09-11T22:13:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.000+0000 7f832a7fc640 1 -- 172.21.15.50:0/2847806699 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8318003520 con 0x7f832c15c770 2024-09-11T22:13:34.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.000+0000 7f832a7fc640 1 -- 172.21.15.50:0/2847806699 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 128107162 0 0) 0x7f832c15cef0 con 0x7f832c15e050 2024-09-11T22:13:34.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.000+0000 7f832a7fc640 1 -- 172.21.15.50:0/2847806699 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f832c0b6930 con 0x7f832c15e050 2024-09-11T22:13:34.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.000+0000 7f8323fff640 1 -- 172.21.15.50:0/2847806699 >> v1:172.21.15.77:6789/0 conn(0x7f832c15e050 legacy=0x7f832c15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.000+0000 7f8323fff640 1 -- 172.21.15.50:0/2847806699 >> v1:172.21.15.50:6789/0 conn(0x7f832c15c770 legacy=0x7f832c0b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.000+0000 7f8323fff640 1 -- 172.21.15.50:0/2847806699 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832c15d4b0 con 0x7f832c0b5fd0 2024-09-11T22:13:34.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.001+0000 7f8323fff640 1 --2- 172.21.15.50:0/2847806699 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f832c0b5fd0 0x7f832c0b63f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f83140097d0 tx=0x7f831402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d69f399184a11d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:34.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.001+0000 7f832a7fc640 1 -- 172.21.15.50:0/2847806699 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314037070 con 0x7f832c0b5fd0 2024-09-11T22:13:34.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.001+0000 7f832a7fc640 1 -- 172.21.15.50:0/2847806699 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8314032440 con 0x7f832c0b5fd0 2024-09-11T22:13:34.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.001+0000 7f832a7fc640 1 -- 172.21.15.50:0/2847806699 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83140327f0 con 0x7f832c0b5fd0 2024-09-11T22:13:34.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.002+0000 7f83317b0640 1 -- 172.21.15.50:0/2847806699 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f832c0b5fd0 msgr2=0x7f832c0b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.002+0000 7f83317b0640 1 --2- 172.21.15.50:0/2847806699 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f832c0b5fd0 0x7f832c0b63f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f83140097d0 tx=0x7f831402a210 comp rx=0 tx=0).stop 2024-09-11T22:13:34.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.002+0000 7f83317b0640 1 -- 172.21.15.50:0/2847806699 shutdown_connections 2024-09-11T22:13:34.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.002+0000 7f83317b0640 1 --2- 172.21.15.50:0/2847806699 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f832c0b5fd0 0x7f832c0b63f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.002+0000 7f83317b0640 1 -- 172.21.15.50:0/2847806699 >> 172.21.15.50:0/2847806699 conn(0x7f832c0b7940 msgr2=0x7f832c0b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:34.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.002+0000 7f83317b0640 1 -- 172.21.15.50:0/2847806699 shutdown_connections 2024-09-11T22:13:34.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.002+0000 7f83317b0640 1 -- 172.21.15.50:0/2847806699 wait complete. 2024-09-11T22:13:34.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.003+0000 7f83317b0640 1 Processor -- start 2024-09-11T22:13:34.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.003+0000 7f83317b0640 1 -- start start 2024-09-11T22:13:34.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f83317b0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f832c0b5fd0 0x7f832c09fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f83317b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c15c770 0x7f832c14fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f83317b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f832c15e050 0x7f832c150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f83317b0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f832c0b5af0 con 0x7f832c15c770 2024-09-11T22:13:34.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f83317b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f832c15dcb0 con 0x7f832c15e050 2024-09-11T22:13:34.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f83317b0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f832c15cb50 con 0x7f832c0b5fd0 2024-09-11T22:13:34.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f8323fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c15c770 0x7f832c14fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f8323fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c15c770 0x7f832c14fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53592/0 (socket says 172.21.15.50:53592) 2024-09-11T22:13:34.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f8323fff640 1 -- 172.21.15.50:0/600876978 learned_addr learned my addr 172.21.15.50:0/600876978 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:34.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f832affd640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f832c0b5fd0 0x7f832c09fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f832b7fe640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f832c15e050 0x7f832c150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f8323fff640 1 -- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f832c0b5fd0 msgr2=0x7f832c09fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f8323fff640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f832c0b5fd0 0x7f832c09fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f8323fff640 1 -- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f832c15e050 msgr2=0x7f832c150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f8323fff640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f832c15e050 0x7f832c150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f8323fff640 1 -- 172.21.15.50:0/600876978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832c152250 con 0x7f832c15c770 2024-09-11T22:13:34.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f8323fff640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c15c770 0x7f832c14fcc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8314035040 tx=0x7f83140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:34.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f83237fe640 1 -- 172.21.15.50:0/600876978 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314037040 con 0x7f832c15c770 2024-09-11T22:13:34.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f83237fe640 1 -- 172.21.15.50:0/600876978 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f831403b430 con 0x7f832c15c770 2024-09-11T22:13:34.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.004+0000 7f83317b0640 1 -- 172.21.15.50:0/600876978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f832c151640 con 0x7f832c15c770 2024-09-11T22:13:34.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.005+0000 7f83237fe640 1 -- 172.21.15.50:0/600876978 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831403b820 con 0x7f832c15c770 2024-09-11T22:13:34.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.005+0000 7f83317b0640 1 -- 172.21.15.50:0/600876978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f832c151c00 con 0x7f832c15c770 2024-09-11T22:13:34.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.006+0000 7f83317b0640 1 -- 172.21.15.50:0/600876978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f832c0b63f0 con 0x7f832c15c770 2024-09-11T22:13:34.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.006+0000 7f83237fe640 1 -- 172.21.15.50:0/600876978 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8314044070 con 0x7f832c15c770 2024-09-11T22:13:34.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.006+0000 7f83237fe640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f830c06be60 0x7f830c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.006+0000 7f83237fe640 1 -- 172.21.15.50:0/600876978 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f83140aa920 con 0x7f832c15c770 2024-09-11T22:13:34.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.007+0000 7f832affd640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f830c06be60 0x7f830c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.007+0000 7f832affd640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f830c06be60 0x7f830c06e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f831c0011e0 tx=0x7f831c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:34.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.011+0000 7f83237fe640 1 -- 172.21.15.50:0/600876978 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f832c152250 con 0x7f832c15c770 2024-09-11T22:13:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.256+0000 7f83317b0640 1 -- 172.21.15.50:0/600876978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f832c06f850 con 0x7f832c15c770 2024-09-11T22:13:34.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.272+0000 7f83237fe640 1 -- 172.21.15.50:0/600876978 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v119) ==== 146+0+0 (secure 0 0 0) 0x7f8314079550 con 0x7f832c15c770 2024-09-11T22:13:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.274+0000 7f83317b0640 1 -- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f830c06be60 msgr2=0x7f830c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.274+0000 7f83317b0640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f830c06be60 0x7f830c06e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f831c0011e0 tx=0x7f831c009040 comp rx=0 tx=0).stop 2024-09-11T22:13:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.274+0000 7f83317b0640 1 -- 172.21.15.50:0/600876978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c15c770 msgr2=0x7f832c14fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.274+0000 7f83317b0640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c15c770 0x7f832c14fcc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8314035040 tx=0x7f83140046c0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.274+0000 7f83317b0640 1 -- 172.21.15.50:0/600876978 shutdown_connections 2024-09-11T22:13:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.274+0000 7f83317b0640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f830c06be60 0x7f830c06e320 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.274+0000 7f83317b0640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f832c15e050 0x7f832c150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.274+0000 7f83317b0640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c15c770 0x7f832c14fcc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.274+0000 7f83317b0640 1 --2- 172.21.15.50:0/600876978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f832c0b5fd0 0x7f832c09fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.274+0000 7f83317b0640 1 -- 172.21.15.50:0/600876978 >> 172.21.15.50:0/600876978 conn(0x7f832c0b7940 msgr2=0x7f832c159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:34.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.274+0000 7f83317b0640 1 -- 172.21.15.50:0/600876978 shutdown_connections 2024-09-11T22:13:34.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.274+0000 7f83317b0640 1 -- 172.21.15.50:0/600876978 wait complete. 2024-09-11T22:13:34.285 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T22:13:34.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.390+0000 7f2ee7277640 1 Processor -- start 2024-09-11T22:13:34.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.390+0000 7f2ee7277640 1 -- start start 2024-09-11T22:13:34.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.391+0000 7f2ee7277640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2ee015c2c0 0x7f2ee00b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.391+0000 7f2ee7277640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ee00b3e10 0x7f2ee00cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.391+0000 7f2ee7277640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee00d0410 0x7f2ee015fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.391+0000 7f2ee7277640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee00d0810 con 0x7f2ee00b3e10 2024-09-11T22:13:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.391+0000 7f2ee7277640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee00b4f00 con 0x7f2ee015c2c0 2024-09-11T22:13:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.391+0000 7f2ee7277640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee00b4360 con 0x7f2ee00d0410 2024-09-11T22:13:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.391+0000 7f2ee4812640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ee00b3e10 0x7f2ee00cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.391+0000 7f2ee4812640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ee00b3e10 0x7f2ee00cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53606/0 (socket says 172.21.15.50:53606) 2024-09-11T22:13:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.391+0000 7f2ee4812640 1 -- 172.21.15.50:0/1865895227 learned_addr learned my addr 172.21.15.50:0/1865895227 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.392+0000 7f2ee5013640 1 --2- 172.21.15.50:0/1865895227 >> v2:172.21.15.77:3300/0 conn(0x7f2ee015c2c0 0x7f2ee00b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.392+0000 7f2ee4812640 1 -- 172.21.15.50:0/1865895227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee00d0410 msgr2=0x7f2ee015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.392+0000 7f2ee5814640 1 --2- 172.21.15.50:0/1865895227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee00d0410 0x7f2ee015fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.392+0000 7f2ee4812640 1 --2- 172.21.15.50:0/1865895227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee00d0410 0x7f2ee015fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.392+0000 7f2ee4812640 1 -- 172.21.15.50:0/1865895227 >> v2:172.21.15.77:3300/0 conn(0x7f2ee015c2c0 msgr2=0x7f2ee00b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:34.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.392+0000 7f2ee4812640 1 --2- 172.21.15.50:0/1865895227 >> v2:172.21.15.77:3300/0 conn(0x7f2ee015c2c0 0x7f2ee00b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.392+0000 7f2ee4812640 1 -- 172.21.15.50:0/1865895227 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee00b51c0 con 0x7f2ee00b3e10 2024-09-11T22:13:34.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.392+0000 7f2ee5013640 1 --2- 172.21.15.50:0/1865895227 >> v2:172.21.15.77:3300/0 conn(0x7f2ee015c2c0 0x7f2ee00b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:34.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.392+0000 7f2ee5814640 1 --2- 172.21.15.50:0/1865895227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee00d0410 0x7f2ee015fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:34.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.392+0000 7f2ee4812640 1 --2- 172.21.15.50:0/1865895227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee00b3e10 0x7f2ee00cfed0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2ee006cdb0 tx=0x7f2ed402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203ea747e1b6958a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:34.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.393+0000 7f2edffff640 1 -- 172.21.15.50:0/1865895227 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4037070 con 0x7f2ee00b3e10 2024-09-11T22:13:34.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.393+0000 7f2edffff640 1 -- 172.21.15.50:0/1865895227 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed4032440 con 0x7f2ee00b3e10 2024-09-11T22:13:34.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.393+0000 7f2edffff640 1 -- 172.21.15.50:0/1865895227 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4032810 con 0x7f2ee00b3e10 2024-09-11T22:13:34.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.393+0000 7f2ee7277640 1 -- 172.21.15.50:0/1865895227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee00b3e10 msgr2=0x7f2ee00cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.393+0000 7f2ee7277640 1 --2- 172.21.15.50:0/1865895227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee00b3e10 0x7f2ee00cfed0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2ee006cdb0 tx=0x7f2ed402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.393+0000 7f2ee7277640 1 -- 172.21.15.50:0/1865895227 shutdown_connections 2024-09-11T22:13:34.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.393+0000 7f2ee7277640 1 --2- 172.21.15.50:0/1865895227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee00d0410 0x7f2ee015fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.393+0000 7f2ee7277640 1 --2- 172.21.15.50:0/1865895227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee00b3e10 0x7f2ee00cfed0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.393+0000 7f2ee7277640 1 --2- 172.21.15.50:0/1865895227 >> v2:172.21.15.77:3300/0 conn(0x7f2ee015c2c0 0x7f2ee00b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.393+0000 7f2ee7277640 1 -- 172.21.15.50:0/1865895227 >> 172.21.15.50:0/1865895227 conn(0x7f2ee00679c0 msgr2=0x7f2ee0067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:34.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.393+0000 7f2ee7277640 1 -- 172.21.15.50:0/1865895227 shutdown_connections 2024-09-11T22:13:34.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.393+0000 7f2ee7277640 1 -- 172.21.15.50:0/1865895227 wait complete. 2024-09-11T22:13:34.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.394+0000 7f2ee7277640 1 Processor -- start 2024-09-11T22:13:34.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.394+0000 7f2ee7277640 1 -- start start 2024-09-11T22:13:34.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.395+0000 7f2ee7277640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee00b3e10 0x7f2ee015a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.395+0000 7f2ee7277640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee00d0410 0x7f2ee0158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.395+0000 7f2ee7277640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee015c2c0 0x7f2ee015f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.395+0000 7f2ee7277640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee00ce200 con 0x7f2ee00d0410 2024-09-11T22:13:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.395+0000 7f2ee7277640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee00cfc10 con 0x7f2ee015c2c0 2024-09-11T22:13:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.395+0000 7f2ee7277640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee006d070 con 0x7f2ee00b3e10 2024-09-11T22:13:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.395+0000 7f2ee4812640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee00d0410 0x7f2ee0158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.395+0000 7f2ee4812640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee00d0410 0x7f2ee0158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53610/0 (socket says 172.21.15.50:53610) 2024-09-11T22:13:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.395+0000 7f2ee4812640 1 -- 172.21.15.50:0/3534495510 learned_addr learned my addr 172.21.15.50:0/3534495510 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.396+0000 7f2ee4812640 1 -- 172.21.15.50:0/3534495510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee00b3e10 msgr2=0x7f2ee015a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.396+0000 7f2ee4812640 1 --2- 172.21.15.50:0/3534495510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee00b3e10 0x7f2ee015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.396+0000 7f2ee5814640 1 --2- 172.21.15.50:0/3534495510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee015c2c0 0x7f2ee015f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.396+0000 7f2ee4812640 1 -- 172.21.15.50:0/3534495510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee015c2c0 msgr2=0x7f2ee015f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.396+0000 7f2ee4812640 1 --2- 172.21.15.50:0/3534495510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee015c2c0 0x7f2ee015f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.396+0000 7f2ee4812640 1 -- 172.21.15.50:0/3534495510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee0158d50 con 0x7f2ee00d0410 2024-09-11T22:13:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.396+0000 7f2ee4812640 1 --2- 172.21.15.50:0/3534495510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee00d0410 0x7f2ee0158600 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2ed402a220 tx=0x7f2ed40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:34.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.396+0000 7f2eddffb640 1 -- 172.21.15.50:0/3534495510 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4037040 con 0x7f2ee00d0410 2024-09-11T22:13:34.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.396+0000 7f2eddffb640 1 -- 172.21.15.50:0/3534495510 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed4042070 con 0x7f2ee00d0410 2024-09-11T22:13:34.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.396+0000 7f2ee7277640 1 -- 172.21.15.50:0/3534495510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee0159030 con 0x7f2ee00d0410 2024-09-11T22:13:34.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.396+0000 7f2eddffb640 1 -- 172.21.15.50:0/3534495510 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4030bb0 con 0x7f2ee00d0410 2024-09-11T22:13:34.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.396+0000 7f2ee7277640 1 -- 172.21.15.50:0/3534495510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee01595f0 con 0x7f2ee00d0410 2024-09-11T22:13:34.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.397+0000 7f2ee7277640 1 -- 172.21.15.50:0/3534495510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee015c6a0 con 0x7f2ee00d0410 2024-09-11T22:13:34.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.398+0000 7f2eddffb640 1 -- 172.21.15.50:0/3534495510 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ed4047460 con 0x7f2ee00d0410 2024-09-11T22:13:34.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.398+0000 7f2eddffb640 1 --2- 172.21.15.50:0/3534495510 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.398+0000 7f2eddffb640 1 -- 172.21.15.50:0/3534495510 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f2ed40ab7a0 con 0x7f2ee00d0410 2024-09-11T22:13:34.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.398+0000 7f2ee5013640 1 --2- 172.21.15.50:0/3534495510 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.399+0000 7f2ee5013640 1 --2- 172.21.15.50:0/3534495510 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0007e70 tx=0x7f2ed00073a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.402+0000 7f2eddffb640 1 -- 172.21.15.50:0/3534495510 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ed4045360 con 0x7f2ee00d0410 2024-09-11T22:13:34.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.579+0000 7f2ee7277640 1 -- 172.21.15.50:0/3534495510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2ee0155e10 con 0x7f2ee00d0410 2024-09-11T22:13:34.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.582+0000 7f2eddffb640 1 -- 172.21.15.50:0/3534495510 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f2ed407a450 con 0x7f2ee00d0410 2024-09-11T22:13:34.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.584+0000 7f2ee7277640 1 -- 172.21.15.50:0/3534495510 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ecc06be30 msgr2=0x7f2ecc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.584+0000 7f2ee7277640 1 --2- 172.21.15.50:0/3534495510 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0007e70 tx=0x7f2ed00073a0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.584+0000 7f2ee7277640 1 -- 172.21.15.50:0/3534495510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee00d0410 msgr2=0x7f2ee0158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.584+0000 7f2ee7277640 1 --2- 172.21.15.50:0/3534495510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee00d0410 0x7f2ee0158600 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2ed402a220 tx=0x7f2ed40046c0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.584+0000 7f2ee7277640 1 -- 172.21.15.50:0/3534495510 shutdown_connections 2024-09-11T22:13:34.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.584+0000 7f2ee7277640 1 --2- 172.21.15.50:0/3534495510 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.584+0000 7f2ee7277640 1 --2- 172.21.15.50:0/3534495510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee015c2c0 0x7f2ee015f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.584+0000 7f2ee7277640 1 --2- 172.21.15.50:0/3534495510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ee00d0410 0x7f2ee0158600 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.584+0000 7f2ee7277640 1 --2- 172.21.15.50:0/3534495510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee00b3e10 0x7f2ee015a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.584+0000 7f2ee7277640 1 -- 172.21.15.50:0/3534495510 >> 172.21.15.50:0/3534495510 conn(0x7f2ee00679c0 msgr2=0x7f2ee0067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:34.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.584+0000 7f2ee7277640 1 -- 172.21.15.50:0/3534495510 shutdown_connections 2024-09-11T22:13:34.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.584+0000 7f2ee7277640 1 -- 172.21.15.50:0/3534495510 wait complete. 2024-09-11T22:13:34.595 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:13:34.595 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:13:34.649 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:13:34.694 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:13:34.694 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:13:34.694 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:13:34.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:13:34.711 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:13:34.711 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:13:34.752 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:13:34.752 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:13:34.752 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:13:34.769 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:13:34.769 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:13:34.769 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:13:34.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:13:34.810 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T22:13:34.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:13:34.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.912+0000 7f5eccc45640 1 Processor -- start 2024-09-11T22:13:34.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.912+0000 7f5eccc45640 1 -- start start 2024-09-11T22:13:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5eccc45640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ec815c2c0 0x7f5ec80b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5eccc45640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5ec80b3e10 0x7f5ec80cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5eccc45640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec80d0810 con 0x7f5ec80d0410 2024-09-11T22:13:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5eccc45640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5ec80cf7a0 con 0x7f5ec815c2c0 2024-09-11T22:13:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5eccc45640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5ec80b4f00 con 0x7f5ec80b3e10 2024-09-11T22:13:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5ec659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ec815c2c0 0x7f5ec80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5ec6d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5ec80d0410 0x7f5ec815fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57780/0 (socket says 172.21.15.50:57780) 2024-09-11T22:13:34.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5ec6d9d640 1 -- 172.21.15.50:0/716248192 learned_addr learned my addr 172.21.15.50:0/716248192 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5ec659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5ec815c2c0 0x7f5ec80b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53626/0 (socket says 172.21.15.50:53626) 2024-09-11T22:13:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5ec5d9b640 1 --2- 172.21.15.50:0/716248192 >> v2:172.21.15.77:3300/0 conn(0x7f5ec80b3e10 0x7f5ec80cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5ec659c640 1 -- 172.21.15.50:0/716248192 >> v2:172.21.15.77:3300/0 conn(0x7f5ec80b3e10 msgr2=0x7f5ec80cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5ec659c640 1 --2- 172.21.15.50:0/716248192 >> v2:172.21.15.77:3300/0 conn(0x7f5ec80b3e10 0x7f5ec80cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5ec659c640 1 -- 172.21.15.50:0/716248192 >> v1:172.21.15.50:6789/0 conn(0x7f5ec80d0410 legacy=0x7f5ec815fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5ec559a640 1 -- 172.21.15.50:0/716248192 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2845462027 0 0) 0x7f5ec80d0810 con 0x7f5ec80d0410 2024-09-11T22:13:34.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.913+0000 7f5ec659c640 1 -- 172.21.15.50:0/716248192 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec80b4360 con 0x7f5ec815c2c0 2024-09-11T22:13:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.914+0000 7f5ec659c640 1 --2- 172.21.15.50:0/716248192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ec815c2c0 0x7f5ec80b46a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5ec815ff20 tx=0x7f5eb802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb25c2cb0ba1b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.914+0000 7f5ec559a640 1 -- 172.21.15.50:0/716248192 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8037070 con 0x7f5ec815c2c0 2024-09-11T22:13:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.914+0000 7f5ec559a640 1 -- 172.21.15.50:0/716248192 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb8032440 con 0x7f5ec815c2c0 2024-09-11T22:13:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.914+0000 7f5ec559a640 1 -- 172.21.15.50:0/716248192 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8032810 con 0x7f5ec815c2c0 2024-09-11T22:13:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.915+0000 7f5eccc45640 1 -- 172.21.15.50:0/716248192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ec815c2c0 msgr2=0x7f5ec80b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.915+0000 7f5eccc45640 1 --2- 172.21.15.50:0/716248192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ec815c2c0 0x7f5ec80b46a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5ec815ff20 tx=0x7f5eb802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.915+0000 7f5eccc45640 1 -- 172.21.15.50:0/716248192 shutdown_connections 2024-09-11T22:13:34.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.915+0000 7f5eccc45640 1 --2- 172.21.15.50:0/716248192 >> v2:172.21.15.77:3300/0 conn(0x7f5ec80b3e10 0x7f5ec80cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.915+0000 7f5eccc45640 1 --2- 172.21.15.50:0/716248192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ec815c2c0 0x7f5ec80b46a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.915+0000 7f5eccc45640 1 -- 172.21.15.50:0/716248192 >> 172.21.15.50:0/716248192 conn(0x7f5ec80679c0 msgr2=0x7f5ec8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:34.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.915+0000 7f5eccc45640 1 -- 172.21.15.50:0/716248192 shutdown_connections 2024-09-11T22:13:34.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.915+0000 7f5eccc45640 1 -- 172.21.15.50:0/716248192 wait complete. 2024-09-11T22:13:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.916+0000 7f5eccc45640 1 Processor -- start 2024-09-11T22:13:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.916+0000 7f5eccc45640 1 -- start start 2024-09-11T22:13:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5eccc45640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ec80b3e10 0x7f5ec81479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5eccc45640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ec80d0410 0x7f5ec814a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5eccc45640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ec815c2c0 0x7f5ec814abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5eccc45640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec80cfc10 con 0x7f5ec815c2c0 2024-09-11T22:13:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5eccc45640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec80b54a0 con 0x7f5ec80d0410 2024-09-11T22:13:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5eccc45640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec80ce200 con 0x7f5ec80b3e10 2024-09-11T22:13:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5ec6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ec815c2c0 0x7f5ec814abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5ec6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ec815c2c0 0x7f5ec814abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53640/0 (socket says 172.21.15.50:53640) 2024-09-11T22:13:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5ec6d9d640 1 -- 172.21.15.50:0/2956138760 learned_addr learned my addr 172.21.15.50:0/2956138760 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5ec5d9b640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ec80d0410 0x7f5ec814a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5ec659c640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ec80b3e10 0x7f5ec81479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5ec6d9d640 1 -- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ec80b3e10 msgr2=0x7f5ec81479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5ec6d9d640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ec80b3e10 0x7f5ec81479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5ec6d9d640 1 -- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ec80d0410 msgr2=0x7f5ec814a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.917+0000 7f5ec6d9d640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ec80d0410 0x7f5ec814a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.918+0000 7f5ec6d9d640 1 -- 172.21.15.50:0/2956138760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec815d5a0 con 0x7f5ec815c2c0 2024-09-11T22:13:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.918+0000 7f5ec5d9b640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ec80d0410 0x7f5ec814a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:34.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.918+0000 7f5ec6d9d640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ec815c2c0 0x7f5ec814abf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000c7a0 tx=0x7f5ec000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.918+0000 7f5eb6ffd640 1 -- 172.21.15.50:0/2956138760 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0018070 con 0x7f5ec815c2c0 2024-09-11T22:13:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.918+0000 7f5eb6ffd640 1 -- 172.21.15.50:0/2956138760 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec000a640 con 0x7f5ec815c2c0 2024-09-11T22:13:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.918+0000 7f5eb6ffd640 1 -- 172.21.15.50:0/2956138760 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec000aab0 con 0x7f5ec815c2c0 2024-09-11T22:13:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.918+0000 7f5eccc45640 1 -- 172.21.15.50:0/2956138760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec815d880 con 0x7f5ec815c2c0 2024-09-11T22:13:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.918+0000 7f5eccc45640 1 -- 172.21.15.50:0/2956138760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec814d5c0 con 0x7f5ec815c2c0 2024-09-11T22:13:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.919+0000 7f5eccc45640 1 -- 172.21.15.50:0/2956138760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec806d070 con 0x7f5ec815c2c0 2024-09-11T22:13:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.919+0000 7f5eb6ffd640 1 -- 172.21.15.50:0/2956138760 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ec001b070 con 0x7f5ec815c2c0 2024-09-11T22:13:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.920+0000 7f5eb6ffd640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ea806be30 0x7f5ea806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.920+0000 7f5eb6ffd640 1 -- 172.21.15.50:0/2956138760 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f5ec008a060 con 0x7f5ec815c2c0 2024-09-11T22:13:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.920+0000 7f5ec659c640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ea806be30 0x7f5ea806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.921+0000 7f5ec659c640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ea806be30 0x7f5ea806e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8034000 tx=0x7f5eb802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:34.924+0000 7f5eb6ffd640 1 -- 172.21.15.50:0/2956138760 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ec0058750 con 0x7f5ec815c2c0 2024-09-11T22:13:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.136+0000 7f5eccc45640 1 -- 172.21.15.50:0/2956138760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ec80b13c0 con 0x7f5ec815c2c0 2024-09-11T22:13:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.136+0000 7f5eb6ffd640 1 -- 172.21.15.50:0/2956138760 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3908 (secure 0 0 0) 0x7f5ec005ca50 con 0x7f5ec815c2c0 2024-09-11T22:13:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:35.138 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"btime":"2024-09-11T22:13:30:254490+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3019059033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3019059033},{"type":"v1","addr":"172.21.15.77:6836","nonce":3019059033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4693,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/151985123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":151985123},{"type":"v1","addr":"172.21.15.50:6835","nonce":151985123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4699,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3475311289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3475311289},{"type":"v1","addr":"172.21.15.77:6837","nonce":3475311289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1148178209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1148178209},{"type":"v1","addr":"172.21.15.50:6833","nonce":1148178209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[]} 2024-09-11T22:13:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2024-09-11T22:13:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.139+0000 7f5eccc45640 1 -- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ea806be30 msgr2=0x7f5ea806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.139+0000 7f5eccc45640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ea806be30 0x7f5ea806e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8034000 tx=0x7f5eb802e000 comp rx=0 tx=0).stop 2024-09-11T22:13:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.139+0000 7f5eccc45640 1 -- 172.21.15.50:0/2956138760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ec815c2c0 msgr2=0x7f5ec814abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.139+0000 7f5eccc45640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ec815c2c0 0x7f5ec814abf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000c7a0 tx=0x7f5ec000cc60 comp rx=0 tx=0).stop 2024-09-11T22:13:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.139+0000 7f5eccc45640 1 -- 172.21.15.50:0/2956138760 shutdown_connections 2024-09-11T22:13:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.139+0000 7f5eccc45640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ea806be30 0x7f5ea806e2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.139+0000 7f5eccc45640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ec815c2c0 0x7f5ec814abf0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.139+0000 7f5eccc45640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ec80d0410 0x7f5ec814a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.139+0000 7f5eccc45640 1 --2- 172.21.15.50:0/2956138760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ec80b3e10 0x7f5ec81479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.139+0000 7f5eccc45640 1 -- 172.21.15.50:0/2956138760 >> 172.21.15.50:0/2956138760 conn(0x7f5ec80679c0 msgr2=0x7f5ec80b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.139+0000 7f5eccc45640 1 -- 172.21.15.50:0/2956138760 shutdown_connections 2024-09-11T22:13:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.139+0000 7f5eccc45640 1 -- 172.21.15.50:0/2956138760 wait complete. 2024-09-11T22:13:35.150 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:13:35.150 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T22:13:35.151 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:13:35.151 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:13:35.151 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:13:35.151 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T22:13:35.151 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:13:35.151 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:13:35.152 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:13:35.152 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T22:13:35.152 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:13:35.152 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:13:35.152 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:13:35.152 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T22:13:35.152 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:13:35.153 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:13:35.160 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:13:35.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:13:35.161 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:13:35.161 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:13:35.164 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:13:35.164 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:13:35.165 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:13:35.165 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:13:35.203 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:13:35.203 DEBUG:teuthology.parallel:result is None 2024-09-11T22:13:35.204 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:13:35.204 DEBUG:teuthology.parallel:result is None 2024-09-11T22:13:35.207 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:13:35.207 DEBUG:teuthology.parallel:result is None 2024-09-11T22:13:35.208 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:13:35.208 DEBUG:teuthology.parallel:result is None 2024-09-11T22:13:35.208 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T22:13:35.282 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:13:35.282 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:13:35.292 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:13:35.292 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:13:35.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.314+0000 7fbe30047640 1 Processor -- start 2024-09-11T22:13:35.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.314+0000 7fbe30047640 1 -- start start 2024-09-11T22:13:35.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.315+0000 7fbe30047640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe280d18a0 0x7fbe280d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:35.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.315+0000 7fbe30047640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe280d3a30 0x7fbe280b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:35.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.315+0000 7fbe30047640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe280cfa80 con 0x7fbe2815e870 2024-09-11T22:13:35.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.315+0000 7fbe30047640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fbe280d3ea0 con 0x7fbe280d3a30 2024-09-11T22:13:35.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.315+0000 7fbe30047640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbe280d40d0 con 0x7fbe280d18a0 2024-09-11T22:13:35.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.315+0000 7fbe2e5e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe280d3a30 0x7fbe280b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:35.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.315+0000 7fbe2e5e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe280d3a30 0x7fbe280b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53668/0 (socket says 172.21.15.50:53668) 2024-09-11T22:13:35.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.315+0000 7fbe2e5e4640 1 -- 172.21.15.50:0/1044757613 learned_addr learned my addr 172.21.15.50:0/1044757613 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:35.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.315+0000 7fbe2d5e2640 1 --2- 172.21.15.50:0/1044757613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe280d18a0 0x7fbe280d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:35.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.315+0000 7fbe2e5e4640 1 -- 172.21.15.50:0/1044757613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe280d18a0 msgr2=0x7fbe280d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:35.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.315+0000 7fbe2e5e4640 1 --2- 172.21.15.50:0/1044757613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe280d18a0 0x7fbe280d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:35.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.315+0000 7fbe2e5e4640 1 -- 172.21.15.50:0/1044757613 >> v1:172.21.15.77:6789/0 conn(0x7fbe2815e870 legacy=0x7fbe280d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:35.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.315+0000 7fbe2e5e4640 1 -- 172.21.15.50:0/1044757613 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe280d43b0 con 0x7fbe280d3a30 2024-09-11T22:13:35.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.316+0000 7fbe2e5e4640 1 --2- 172.21.15.50:0/1044757613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe280d3a30 0x7fbe280b8400 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009e50 tx=0x7fbe2002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fc4f21ab6db07f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:35.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.316+0000 7fbe2cde1640 1 -- 172.21.15.50:0/1044757613 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20036070 con 0x7fbe280d3a30 2024-09-11T22:13:35.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.316+0000 7fbe2cde1640 1 -- 172.21.15.50:0/1044757613 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe20031600 con 0x7fbe280d3a30 2024-09-11T22:13:35.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.316+0000 7fbe2cde1640 1 -- 172.21.15.50:0/1044757613 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe200319d0 con 0x7fbe280d3a30 2024-09-11T22:13:35.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.317+0000 7fbe30047640 1 -- 172.21.15.50:0/1044757613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe280d3a30 msgr2=0x7fbe280b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:35.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.317+0000 7fbe30047640 1 --2- 172.21.15.50:0/1044757613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe280d3a30 0x7fbe280b8400 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009e50 tx=0x7fbe2002a710 comp rx=0 tx=0).stop 2024-09-11T22:13:35.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.317+0000 7fbe30047640 1 -- 172.21.15.50:0/1044757613 shutdown_connections 2024-09-11T22:13:35.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.317+0000 7fbe30047640 1 --2- 172.21.15.50:0/1044757613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe280d3a30 0x7fbe280b8400 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:35.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.317+0000 7fbe30047640 1 --2- 172.21.15.50:0/1044757613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe280d18a0 0x7fbe280d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:35.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.317+0000 7fbe30047640 1 -- 172.21.15.50:0/1044757613 >> 172.21.15.50:0/1044757613 conn(0x7fbe280727a0 msgr2=0x7fbe280679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:35.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.317+0000 7fbe30047640 1 -- 172.21.15.50:0/1044757613 shutdown_connections 2024-09-11T22:13:35.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.317+0000 7fbe30047640 1 -- 172.21.15.50:0/1044757613 wait complete. 2024-09-11T22:13:35.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.318+0000 7fbe30047640 1 Processor -- start 2024-09-11T22:13:35.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.318+0000 7fbe30047640 1 -- start start 2024-09-11T22:13:35.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe30047640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe280d18a0 0x7fbe28156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:35.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe30047640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe280d3a30 0x7fbe28155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:35.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe30047640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2815e870 0x7fbe28158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:35.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe30047640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2815ec50 con 0x7fbe2815e870 2024-09-11T22:13:35.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe30047640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe280b7ee0 con 0x7fbe280d3a30 2024-09-11T22:13:35.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe30047640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbe280b78b0 con 0x7fbe280d18a0 2024-09-11T22:13:35.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe2e5e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2815e870 0x7fbe28158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:35.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe2e5e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2815e870 0x7fbe28158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53676/0 (socket says 172.21.15.50:53676) 2024-09-11T22:13:35.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe2e5e4640 1 -- 172.21.15.50:0/2829026517 learned_addr learned my addr 172.21.15.50:0/2829026517 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe2d5e2640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe280d3a30 0x7fbe28155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe2dde3640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe280d18a0 0x7fbe28156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe2e5e4640 1 -- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe280d18a0 msgr2=0x7fbe28156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe2e5e4640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe280d18a0 0x7fbe28156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe2e5e4640 1 -- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe280d3a30 msgr2=0x7fbe28155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe2e5e4640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe280d3a30 0x7fbe28155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe2e5e4640 1 -- 172.21.15.50:0/2829026517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe280cb3b0 con 0x7fbe2815e870 2024-09-11T22:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe2d5e2640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe280d3a30 0x7fbe28155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.319+0000 7fbe2e5e4640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2815e870 0x7fbe28158cf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbe20034040 tx=0x7fbe20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.320+0000 7fbe1e7fc640 1 -- 172.21.15.50:0/2829026517 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20036050 con 0x7fbe2815e870 2024-09-11T22:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.320+0000 7fbe1e7fc640 1 -- 172.21.15.50:0/2829026517 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe20042070 con 0x7fbe2815e870 2024-09-11T22:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.320+0000 7fbe30047640 1 -- 172.21.15.50:0/2829026517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe281f4fe0 con 0x7fbe2815e870 2024-09-11T22:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.320+0000 7fbe1e7fc640 1 -- 172.21.15.50:0/2829026517 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20009510 con 0x7fbe2815e870 2024-09-11T22:13:35.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.320+0000 7fbe30047640 1 -- 172.21.15.50:0/2829026517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe281f55a0 con 0x7fbe2815e870 2024-09-11T22:13:35.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.321+0000 7fbe30047640 1 -- 172.21.15.50:0/2829026517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe280d34f0 con 0x7fbe2815e870 2024-09-11T22:13:35.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.321+0000 7fbe1e7fc640 1 -- 172.21.15.50:0/2829026517 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe20007bf0 con 0x7fbe2815e870 2024-09-11T22:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.322+0000 7fbe1e7fc640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe0c06be30 0x7fbe0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.322+0000 7fbe1e7fc640 1 -- 172.21.15.50:0/2829026517 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fbe200ab800 con 0x7fbe2815e870 2024-09-11T22:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.322+0000 7fbe2dde3640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe0c06be30 0x7fbe0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.322+0000 7fbe2dde3640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe0c06be30 0x7fbe0c06e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe24001780 tx=0x7fbe24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.326+0000 7fbe1e7fc640 1 -- 172.21.15.50:0/2829026517 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe20079e60 con 0x7fbe2815e870 2024-09-11T22:13:35.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:35.520+0000 7fbe30047640 1 -- 172.21.15.50:0/2829026517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fbe280b4460 con 0x7fbe2815e870 2024-09-11T22:13:36.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.282+0000 7fbe1e7fc640 1 -- 172.21.15.50:0/2829026517 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) ==== 97+0+0 (secure 0 0 0) 0x7fbe2007e160 con 0x7fbe2815e870 2024-09-11T22:13:36.283 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-11T22:13:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.287+0000 7fbe30047640 1 -- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe0c06be30 msgr2=0x7fbe0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.287+0000 7fbe30047640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe0c06be30 0x7fbe0c06e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe24001780 tx=0x7fbe24009040 comp rx=0 tx=0).stop 2024-09-11T22:13:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.287+0000 7fbe30047640 1 -- 172.21.15.50:0/2829026517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2815e870 msgr2=0x7fbe28158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.287+0000 7fbe30047640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2815e870 0x7fbe28158cf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbe20034040 tx=0x7fbe20004a40 comp rx=0 tx=0).stop 2024-09-11T22:13:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.287+0000 7fbe30047640 1 -- 172.21.15.50:0/2829026517 shutdown_connections 2024-09-11T22:13:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.287+0000 7fbe30047640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe0c06be30 0x7fbe0c06e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.287+0000 7fbe30047640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2815e870 0x7fbe28158cf0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.287+0000 7fbe30047640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe280d3a30 0x7fbe28155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.287+0000 7fbe30047640 1 --2- 172.21.15.50:0/2829026517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe280d18a0 0x7fbe28156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.287+0000 7fbe30047640 1 -- 172.21.15.50:0/2829026517 >> 172.21.15.50:0/2829026517 conn(0x7fbe280727a0 msgr2=0x7fbe28161080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:36.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.287+0000 7fbe30047640 1 -- 172.21.15.50:0/2829026517 shutdown_connections 2024-09-11T22:13:36.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.287+0000 7fbe30047640 1 -- 172.21.15.50:0/2829026517 wait complete. 2024-09-11T22:13:36.302 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T22:13:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.410+0000 7f050af66640 1 Processor -- start 2024-09-11T22:13:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.410+0000 7f050af66640 1 -- start start 2024-09-11T22:13:36.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f050af66640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f050415b400 0x7f050406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f050af66640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0504072e60 0x7f050406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f050af66640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f050406df20 0x7f05040b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f050af66640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f050415b7e0 con 0x7f050406df20 2024-09-11T22:13:36.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f050af66640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f050415f140 con 0x7f050415b400 2024-09-11T22:13:36.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f050af66640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f050415f420 con 0x7f0504072e60 2024-09-11T22:13:36.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f0509503640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f050406df20 0x7f05040b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f0509503640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f050406df20 0x7f05040b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53686/0 (socket says 172.21.15.50:53686) 2024-09-11T22:13:36.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f0509503640 1 -- 172.21.15.50:0/3138146029 learned_addr learned my addr 172.21.15.50:0/3138146029 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:36.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f04fbfff640 1 --2- 172.21.15.50:0/3138146029 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0504072e60 0x7f050406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f0508d02640 1 --2- 172.21.15.50:0/3138146029 >> v2:172.21.15.77:3300/0 conn(0x7f050415b400 0x7f050406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f0509503640 1 -- 172.21.15.50:0/3138146029 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0504072e60 msgr2=0x7f050406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f0509503640 1 --2- 172.21.15.50:0/3138146029 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0504072e60 0x7f050406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f0509503640 1 -- 172.21.15.50:0/3138146029 >> v2:172.21.15.77:3300/0 conn(0x7f050415b400 msgr2=0x7f050406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f0509503640 1 --2- 172.21.15.50:0/3138146029 >> v2:172.21.15.77:3300/0 conn(0x7f050415b400 0x7f050406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f0509503640 1 -- 172.21.15.50:0/3138146029 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050415f700 con 0x7f050406df20 2024-09-11T22:13:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f04fbfff640 1 --2- 172.21.15.50:0/3138146029 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0504072e60 0x7f050406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.411+0000 7f0508d02640 1 --2- 172.21.15.50:0/3138146029 >> v2:172.21.15.77:3300/0 conn(0x7f050415b400 0x7f050406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.412+0000 7f0509503640 1 --2- 172.21.15.50:0/3138146029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050406df20 0x7f05040b4610 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f05040b56e0 tx=0x7f04fc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ca159ee17d6292 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.412+0000 7f04fb7fe640 1 -- 172.21.15.50:0/3138146029 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc036070 con 0x7f050406df20 2024-09-11T22:13:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.412+0000 7f04fb7fe640 1 -- 172.21.15.50:0/3138146029 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04fc031600 con 0x7f050406df20 2024-09-11T22:13:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.412+0000 7f04fb7fe640 1 -- 172.21.15.50:0/3138146029 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc0319d0 con 0x7f050406df20 2024-09-11T22:13:36.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.413+0000 7f050af66640 1 -- 172.21.15.50:0/3138146029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050406df20 msgr2=0x7f05040b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.413+0000 7f050af66640 1 --2- 172.21.15.50:0/3138146029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050406df20 0x7f05040b4610 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f05040b56e0 tx=0x7f04fc02a6a0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.413+0000 7f050af66640 1 -- 172.21.15.50:0/3138146029 shutdown_connections 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.413+0000 7f050af66640 1 --2- 172.21.15.50:0/3138146029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050406df20 0x7f05040b4610 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.413+0000 7f050af66640 1 --2- 172.21.15.50:0/3138146029 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0504072e60 0x7f050406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.413+0000 7f050af66640 1 --2- 172.21.15.50:0/3138146029 >> v2:172.21.15.77:3300/0 conn(0x7f050415b400 0x7f050406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.413+0000 7f050af66640 1 -- 172.21.15.50:0/3138146029 >> 172.21.15.50:0/3138146029 conn(0x7f05040679c0 msgr2=0x7f0504067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.413+0000 7f050af66640 1 -- 172.21.15.50:0/3138146029 shutdown_connections 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.413+0000 7f050af66640 1 -- 172.21.15.50:0/3138146029 wait complete. 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.414+0000 7f050af66640 1 Processor -- start 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.414+0000 7f050af66640 1 -- start start 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f050af66640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050406df20 0x7f05040aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f050af66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0504072e60 0x7f050415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f050af66640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050415b400 0x7f050414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f050af66640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f05040b4b50 con 0x7f0504072e60 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f050af66640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f05040cfc50 con 0x7f050415b400 2024-09-11T22:13:36.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f050af66640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f05040b4cd0 con 0x7f050406df20 2024-09-11T22:13:36.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f04fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0504072e60 0x7f050415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f04fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0504072e60 0x7f050415a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53692/0 (socket says 172.21.15.50:53692) 2024-09-11T22:13:36.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f04fbfff640 1 -- 172.21.15.50:0/2299510722 learned_addr learned my addr 172.21.15.50:0/2299510722 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:36.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f0508d02640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050406df20 0x7f05040aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f0509503640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050415b400 0x7f050414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f04fbfff640 1 -- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050406df20 msgr2=0x7f05040aa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f04fbfff640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050406df20 0x7f05040aa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f04fbfff640 1 -- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050415b400 msgr2=0x7f050414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f04fbfff640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050415b400 0x7f050414b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f04fbfff640 1 -- 172.21.15.50:0/2299510722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05040b1b30 con 0x7f0504072e60 2024-09-11T22:13:36.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f0508d02640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050406df20 0x7f05040aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:36.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.415+0000 7f04fbfff640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0504072e60 0x7f050415a790 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f04f400c7c0 tx=0x7f04f400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:36.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.416+0000 7f04f97fa640 1 -- 172.21.15.50:0/2299510722 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4015070 con 0x7f0504072e60 2024-09-11T22:13:36.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.416+0000 7f04f97fa640 1 -- 172.21.15.50:0/2299510722 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f4007a30 con 0x7f0504072e60 2024-09-11T22:13:36.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.416+0000 7f04f97fa640 1 -- 172.21.15.50:0/2299510722 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4007e00 con 0x7f0504072e60 2024-09-11T22:13:36.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.416+0000 7f050af66640 1 -- 172.21.15.50:0/2299510722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05040b1e10 con 0x7f0504072e60 2024-09-11T22:13:36.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.416+0000 7f050af66640 1 -- 172.21.15.50:0/2299510722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f050414d250 con 0x7f0504072e60 2024-09-11T22:13:36.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.417+0000 7f050af66640 1 -- 172.21.15.50:0/2299510722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05040b5100 con 0x7f0504072e60 2024-09-11T22:13:36.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.417+0000 7f04f97fa640 1 -- 172.21.15.50:0/2299510722 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04f4018070 con 0x7f0504072e60 2024-09-11T22:13:36.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.418+0000 7f04f97fa640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04f006be30 0x7f04f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.418+0000 7f04f97fa640 1 -- 172.21.15.50:0/2299510722 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f04f408a9d0 con 0x7f0504072e60 2024-09-11T22:13:36.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.418+0000 7f0508d02640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04f006be30 0x7f04f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.419+0000 7f0508d02640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04f006be30 0x7f04f006e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f050415eee0 tx=0x7f0500008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:36.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.422+0000 7f04f97fa640 1 -- 172.21.15.50:0/2299510722 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04f4059080 con 0x7f0504072e60 2024-09-11T22:13:36.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.665+0000 7f050af66640 1 -- 172.21.15.50:0/2299510722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f050414ef90 con 0x7f0504072e60 2024-09-11T22:13:36.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.666+0000 7f04f97fa640 1 -- 172.21.15.50:0/2299510722 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f04f405d380 con 0x7f0504072e60 2024-09-11T22:13:36.667 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:36.667 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:36.667 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-11T22:13:36.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.667 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-11T22:13:36.667 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w==", 2024-09-11T22:13:36.667 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.667 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:13:36.668 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:13:36.668 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:13:36.668 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.668 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.668 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-11T22:13:36.668 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg==", 2024-09-11T22:13:36.668 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.668 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:13:36.669 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:13:36.669 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:13:36.669 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.669 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.669 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-11T22:13:36.669 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ==", 2024-09-11T22:13:36.669 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.669 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:13:36.669 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:13:36.669 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:13:36.670 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.670 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.670 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-11T22:13:36.670 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw==", 2024-09-11T22:13:36.670 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.670 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:13:36.670 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:13:36.670 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:13:36.670 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.670 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.671 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-11T22:13:36.671 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg==", 2024-09-11T22:13:36.671 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.671 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:13:36.671 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:13:36.671 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.671 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.671 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-11T22:13:36.671 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ==", 2024-09-11T22:13:36.671 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.672 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:13:36.672 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:13:36.672 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.672 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.672 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-11T22:13:36.672 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg==", 2024-09-11T22:13:36.672 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.672 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:13:36.672 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:13:36.672 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.672 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.673 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-11T22:13:36.673 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg==", 2024-09-11T22:13:36.673 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.673 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:13:36.673 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:13:36.673 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.673 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.673 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-11T22:13:36.673 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A==", 2024-09-11T22:13:36.674 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.674 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:13:36.674 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:13:36.674 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.674 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.674 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-11T22:13:36.674 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw==", 2024-09-11T22:13:36.674 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.674 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:13:36.674 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:13:36.674 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.675 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.675 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-11T22:13:36.675 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A==", 2024-09-11T22:13:36.675 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.675 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:13:36.675 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:13:36.675 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.675 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.675 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-11T22:13:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw==", 2024-09-11T22:13:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:13:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:13:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-11T22:13:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew==", 2024-09-11T22:13:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:13:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw==", 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.678 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-11T22:13:36.678 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg==", 2024-09-11T22:13:36.678 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.678 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:13:36.678 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:13:36.678 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:13:36.678 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:13:36.678 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.678 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-11T22:13:36.678 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw==", 2024-09-11T22:13:36.678 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.679 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:13:36.679 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:13:36.679 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:13:36.679 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:13:36.679 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.679 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-11T22:13:36.679 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBFFeJmAq9+OBAAANc9KfDvm3+wt/uED7WCvA==", 2024-09-11T22:13:36.679 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.679 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:13:36.679 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:13:36.679 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:13:36.680 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.680 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.680 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-11T22:13:36.680 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g==", 2024-09-11T22:13:36.680 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.680 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:13:36.680 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:13:36.680 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.680 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:36.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.681 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-11T22:13:36.681 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg==", 2024-09-11T22:13:36.681 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:13:36.681 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:13:36.681 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:13:36.681 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:13:36.681 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.681 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.681 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-11T22:13:36.681 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.667+0000 7f050af66640 1 -- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04f006be30 msgr2=0x7f04f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.667+0000 7f050af66640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04f006be30 0x7f04f006e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f050415eee0 tx=0x7f0500008040 comp rx=0 tx=0).stop 2024-09-11T22:13:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.667+0000 7f050af66640 1 -- 172.21.15.50:0/2299510722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0504072e60 msgr2=0x7f050415a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.667+0000 7f050af66640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0504072e60 0x7f050415a790 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f04f400c7c0 tx=0x7f04f400cc80 comp rx=0 tx=0).stop 2024-09-11T22:13:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.668+0000 7f050af66640 1 -- 172.21.15.50:0/2299510722 shutdown_connections 2024-09-11T22:13:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.668+0000 7f050af66640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04f006be30 0x7f04f006e2f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.668+0000 7f050af66640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050415b400 0x7f050414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.668+0000 7f050af66640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0504072e60 0x7f050415a790 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.668+0000 7f050af66640 1 --2- 172.21.15.50:0/2299510722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050406df20 0x7f05040aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.668+0000 7f050af66640 1 -- 172.21.15.50:0/2299510722 >> 172.21.15.50:0/2299510722 conn(0x7f05040679c0 msgr2=0x7f050414f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:36.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.668+0000 7f050af66640 1 -- 172.21.15.50:0/2299510722 shutdown_connections 2024-09-11T22:13:36.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.668+0000 7f050af66640 1 -- 172.21.15.50:0/2299510722 wait complete. 2024-09-11T22:13:36.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:13:36.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.786+0000 7f2124082640 1 Processor -- start 2024-09-11T22:13:36.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.787+0000 7f2124082640 1 -- start start 2024-09-11T22:13:36.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.787+0000 7f2124082640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f211c15e870 0x7f211c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.787+0000 7f2124082640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f211c0d16d0 0x7f211c0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.787+0000 7f2124082640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211c0cfa80 con 0x7f211c0d3a30 2024-09-11T22:13:36.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.787+0000 7f2124082640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f211c0d1b10 con 0x7f211c15e870 2024-09-11T22:13:36.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.787+0000 7f2124082640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f211c0d3e80 con 0x7f211c0d16d0 2024-09-11T22:13:36.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.787+0000 7f2121e1e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f211c15e870 0x7f211c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.787+0000 7f2121e1e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f211c15e870 0x7f211c0d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53708/0 (socket says 172.21.15.50:53708) 2024-09-11T22:13:36.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.787+0000 7f212261f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f211c0d3a30 0x7f211c0b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57786/0 (socket says 172.21.15.50:57786) 2024-09-11T22:13:36.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.788+0000 7f2121e1e640 1 -- 172.21.15.50:0/773710033 learned_addr learned my addr 172.21.15.50:0/773710033 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:36.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.788+0000 7f212161d640 1 --2- 172.21.15.50:0/773710033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f211c0d16d0 0x7f211c0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.788+0000 7f2121e1e640 1 -- 172.21.15.50:0/773710033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f211c0d16d0 msgr2=0x7f211c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:36.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.788+0000 7f2121e1e640 1 --2- 172.21.15.50:0/773710033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f211c0d16d0 0x7f211c0d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.788+0000 7f2121e1e640 1 -- 172.21.15.50:0/773710033 >> v1:172.21.15.50:6789/0 conn(0x7f211c0d3a30 legacy=0x7f211c0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.788+0000 7f2120e1c640 1 -- 172.21.15.50:0/773710033 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2345984334 0 0) 0x7f210c001490 con 0x7f211c0d3a30 2024-09-11T22:13:36.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.788+0000 7f2121e1e640 1 -- 172.21.15.50:0/773710033 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c0d40d0 con 0x7f211c15e870 2024-09-11T22:13:36.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.789+0000 7f2121e1e640 1 --2- 172.21.15.50:0/773710033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f211c15e870 0x7f211c0d1190 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2114009870 tx=0x7f211402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8cb2df4a36e2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:36.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.789+0000 7f2120e1c640 1 -- 172.21.15.50:0/773710033 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114037070 con 0x7f211c15e870 2024-09-11T22:13:36.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.789+0000 7f2120e1c640 1 -- 172.21.15.50:0/773710033 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2114032440 con 0x7f211c15e870 2024-09-11T22:13:36.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.789+0000 7f2120e1c640 1 -- 172.21.15.50:0/773710033 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114032810 con 0x7f211c15e870 2024-09-11T22:13:36.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.789+0000 7f2124082640 1 -- 172.21.15.50:0/773710033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f211c15e870 msgr2=0x7f211c0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.789+0000 7f2124082640 1 --2- 172.21.15.50:0/773710033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f211c15e870 0x7f211c0d1190 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2114009870 tx=0x7f211402a270 comp rx=0 tx=0).stop 2024-09-11T22:13:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.789+0000 7f2124082640 1 -- 172.21.15.50:0/773710033 shutdown_connections 2024-09-11T22:13:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.789+0000 7f2124082640 1 --2- 172.21.15.50:0/773710033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f211c0d16d0 0x7f211c0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.789+0000 7f2124082640 1 --2- 172.21.15.50:0/773710033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f211c15e870 0x7f211c0d1190 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.789+0000 7f2124082640 1 -- 172.21.15.50:0/773710033 >> 172.21.15.50:0/773710033 conn(0x7f211c0727a0 msgr2=0x7f211c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.789+0000 7f2124082640 1 -- 172.21.15.50:0/773710033 shutdown_connections 2024-09-11T22:13:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.789+0000 7f2124082640 1 -- 172.21.15.50:0/773710033 wait complete. 2024-09-11T22:13:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.791+0000 7f2124082640 1 Processor -- start 2024-09-11T22:13:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.791+0000 7f2124082640 1 -- start start 2024-09-11T22:13:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.791+0000 7f2124082640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f211c0d16d0 0x7f211c157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.791+0000 7f2124082640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f211c0d3a30 0x7f211c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.791+0000 7f2124082640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f211c15e870 0x7f211c15d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.791+0000 7f2124082640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f211c0b7ee0 con 0x7f211c0d3a30 2024-09-11T22:13:36.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.791+0000 7f2124082640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f211c0b7c00 con 0x7f211c15e870 2024-09-11T22:13:36.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.791+0000 7f2124082640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f211c15ec50 con 0x7f211c0d16d0 2024-09-11T22:13:36.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.791+0000 7f212161d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f211c0d3a30 0x7f211c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.791+0000 7f212161d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f211c0d3a30 0x7f211c0ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53724/0 (socket says 172.21.15.50:53724) 2024-09-11T22:13:36.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.791+0000 7f212161d640 1 -- 172.21.15.50:0/2607993424 learned_addr learned my addr 172.21.15.50:0/2607993424 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:36.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f212261f640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f211c15e870 0x7f211c15d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f2121e1e640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f211c0d16d0 0x7f211c157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f212161d640 1 -- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f211c0d16d0 msgr2=0x7f211c157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f212161d640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f211c0d16d0 0x7f211c157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f212161d640 1 -- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f211c15e870 msgr2=0x7f211c15d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f212161d640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f211c15e870 0x7f211c15d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f212161d640 1 -- 172.21.15.50:0/2607993424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c1f8020 con 0x7f211c0d3a30 2024-09-11T22:13:36.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f212261f640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f211c15e870 0x7f211c15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:36.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f212161d640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f211c0d3a30 0x7f211c0ca460 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f211000d830 tx=0x7f211000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:36.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f211a7fc640 1 -- 172.21.15.50:0/2607993424 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211000b6c0 con 0x7f211c0d3a30 2024-09-11T22:13:36.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f211a7fc640 1 -- 172.21.15.50:0/2607993424 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2110019070 con 0x7f211c0d3a30 2024-09-11T22:13:36.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f2124082640 1 -- 172.21.15.50:0/2607993424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211c158220 con 0x7f211c0d3a30 2024-09-11T22:13:36.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f211a7fc640 1 -- 172.21.15.50:0/2607993424 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211000ba80 con 0x7f211c0d3a30 2024-09-11T22:13:36.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.792+0000 7f2124082640 1 -- 172.21.15.50:0/2607993424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211c1f82c0 con 0x7f211c0d3a30 2024-09-11T22:13:36.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.793+0000 7f2124082640 1 -- 172.21.15.50:0/2607993424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f211c0b78b0 con 0x7f211c0d3a30 2024-09-11T22:13:36.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.793+0000 7f211a7fc640 1 -- 172.21.15.50:0/2607993424 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f211001e460 con 0x7f211c0d3a30 2024-09-11T22:13:36.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.794+0000 7f211a7fc640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f210806be30 0x7f210806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:36.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.794+0000 7f211a7fc640 1 -- 172.21.15.50:0/2607993424 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f211008b1f0 con 0x7f211c0d3a30 2024-09-11T22:13:36.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.794+0000 7f2121e1e640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f210806be30 0x7f210806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:36.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.795+0000 7f2121e1e640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f210806be30 0x7f210806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2114034000 tx=0x7f211402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:36.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.798+0000 7f211a7fc640 1 -- 172.21.15.50:0/2607993424 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2110059ef0 con 0x7f211c0d3a30 2024-09-11T22:13:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.974+0000 7f2124082640 1 -- 172.21.15.50:0/2607993424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f211c0b98c0 con 0x7f211c0d3a30 2024-09-11T22:13:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.974+0000 7f211a7fc640 1 -- 172.21.15.50:0/2607993424 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) ==== 84+0+65 (secure 0 0 0) 0x7f21100597f0 con 0x7f211c0d3a30 2024-09-11T22:13:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:36.976 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:13:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:13:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:13:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:13:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:36.976 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:13:36.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.976+0000 7f2124082640 1 -- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f210806be30 msgr2=0x7f210806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.976+0000 7f2124082640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f210806be30 0x7f210806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2114034000 tx=0x7f211402e000 comp rx=0 tx=0).stop 2024-09-11T22:13:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.976+0000 7f2124082640 1 -- 172.21.15.50:0/2607993424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f211c0d3a30 msgr2=0x7f211c0ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.976+0000 7f2124082640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f211c0d3a30 0x7f211c0ca460 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f211000d830 tx=0x7f211000dcf0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.976+0000 7f2124082640 1 -- 172.21.15.50:0/2607993424 shutdown_connections 2024-09-11T22:13:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.976+0000 7f2124082640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f210806be30 0x7f210806e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.976+0000 7f2124082640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f211c15e870 0x7f211c15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.976+0000 7f2124082640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f211c0d3a30 0x7f211c0ca460 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.976+0000 7f2124082640 1 --2- 172.21.15.50:0/2607993424 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f211c0d16d0 0x7f211c157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.976+0000 7f2124082640 1 -- 172.21.15.50:0/2607993424 >> 172.21.15.50:0/2607993424 conn(0x7f211c0727a0 msgr2=0x7f211c0b9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.976+0000 7f2124082640 1 -- 172.21.15.50:0/2607993424 shutdown_connections 2024-09-11T22:13:36.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:36.976+0000 7f2124082640 1 -- 172.21.15.50:0/2607993424 wait complete. 2024-09-11T22:13:36.988 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:13:36.988 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:13:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.093+0000 7fbc466dd640 1 Processor -- start 2024-09-11T22:13:37.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.093+0000 7fbc466dd640 1 -- start start 2024-09-11T22:13:37.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.094+0000 7fbc466dd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbc4006e160 0x7fbc4006e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:37.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.094+0000 7fbc466dd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc4015d460 0x7fbc4015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:37.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.094+0000 7fbc466dd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc400b53a0 con 0x7fbc400cff00 2024-09-11T22:13:37.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.094+0000 7fbc466dd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbc400b5680 con 0x7fbc4006e160 2024-09-11T22:13:37.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.094+0000 7fbc466dd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4015cc60 con 0x7fbc4015d460 2024-09-11T22:13:37.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.095+0000 7fbc3f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbc4006e160 0x7fbc4006e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:37.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.095+0000 7fbc44c7a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc4015d460 0x7fbc4015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:37.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.095+0000 7fbc3f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbc4006e160 0x7fbc4006e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:52246/0 (socket says 172.21.15.50:52246) 2024-09-11T22:13:37.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.095+0000 7fbc3ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbc400cff00 0x7fbc400b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:53424/0 (socket says 172.21.15.50:53424) 2024-09-11T22:13:37.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.095+0000 7fbc3f7fe640 1 -- 172.21.15.50:0/933865911 learned_addr learned my addr 172.21.15.50:0/933865911 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.095+0000 7fbc3f7fe640 1 -- 172.21.15.50:0/933865911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc4015d460 msgr2=0x7fbc4015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.095+0000 7fbc3f7fe640 1 --2- 172.21.15.50:0/933865911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc4015d460 0x7fbc4015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.095+0000 7fbc3f7fe640 1 -- 172.21.15.50:0/933865911 >> v1:172.21.15.77:6789/0 conn(0x7fbc400cff00 legacy=0x7fbc400b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.095+0000 7fbc3effd640 1 -- 172.21.15.50:0/933865911 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2437585899 0 0) 0x7fbc400b53a0 con 0x7fbc400cff00 2024-09-11T22:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.095+0000 7fbc3f7fe640 1 -- 172.21.15.50:0/933865911 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4015cf40 con 0x7fbc4006e160 2024-09-11T22:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.095+0000 7fbc44c7a640 1 --2- 172.21.15.50:0/933865911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc4015d460 0x7fbc4015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.096+0000 7fbc3f7fe640 1 --2- 172.21.15.50:0/933865911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc4006e160 0x7fbc4006e5f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009870 tx=0x7fbc3402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd05fac1d30f24df server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.096+0000 7fbc3effd640 1 -- 172.21.15.50:0/933865911 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34037070 con 0x7fbc4006e160 2024-09-11T22:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.096+0000 7fbc3effd640 1 -- 172.21.15.50:0/933865911 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc34032440 con 0x7fbc4006e160 2024-09-11T22:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.096+0000 7fbc3effd640 1 -- 172.21.15.50:0/933865911 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34032810 con 0x7fbc4006e160 2024-09-11T22:13:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.096+0000 7fbc466dd640 1 -- 172.21.15.50:0/933865911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc4006e160 msgr2=0x7fbc4006e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.096+0000 7fbc466dd640 1 --2- 172.21.15.50:0/933865911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc4006e160 0x7fbc4006e5f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009870 tx=0x7fbc3402a270 comp rx=0 tx=0).stop 2024-09-11T22:13:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.097+0000 7fbc466dd640 1 -- 172.21.15.50:0/933865911 shutdown_connections 2024-09-11T22:13:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.097+0000 7fbc466dd640 1 --2- 172.21.15.50:0/933865911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc4015d460 0x7fbc4015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.097+0000 7fbc466dd640 1 --2- 172.21.15.50:0/933865911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc4006e160 0x7fbc4006e5f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.097+0000 7fbc466dd640 1 -- 172.21.15.50:0/933865911 >> 172.21.15.50:0/933865911 conn(0x7fbc40075270 msgr2=0x7fbc400679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.097+0000 7fbc466dd640 1 -- 172.21.15.50:0/933865911 shutdown_connections 2024-09-11T22:13:37.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.097+0000 7fbc466dd640 1 -- 172.21.15.50:0/933865911 wait complete. 2024-09-11T22:13:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.098+0000 7fbc466dd640 1 Processor -- start 2024-09-11T22:13:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.098+0000 7fbc466dd640 1 -- start start 2024-09-11T22:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc466dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc4006e160 0x7fbc401f8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc466dd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc400cff00 0x7fbc4015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc466dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc4015d460 0x7fbc40140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc466dd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4015bbc0 con 0x7fbc4006e160 2024-09-11T22:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc466dd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbc400b5060 con 0x7fbc4015d460 2024-09-11T22:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc466dd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4015dda0 con 0x7fbc400cff00 2024-09-11T22:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc3ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc4006e160 0x7fbc401f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc3ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc4006e160 0x7fbc401f8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53730/0 (socket says 172.21.15.50:53730) 2024-09-11T22:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc3ffff640 1 -- 172.21.15.50:0/2269681014 learned_addr learned my addr 172.21.15.50:0/2269681014 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc3f7fe640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc400cff00 0x7fbc4015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc44c7a640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc4015d460 0x7fbc40140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc3ffff640 1 -- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc400cff00 msgr2=0x7fbc4015a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc3ffff640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc400cff00 0x7fbc4015a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc3ffff640 1 -- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc4015d460 msgr2=0x7fbc40140690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc3ffff640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc4015d460 0x7fbc40140690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc3ffff640 1 -- 172.21.15.50:0/2269681014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc40155a80 con 0x7fbc4006e160 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc44c7a640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc4015d460 0x7fbc40140690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc3f7fe640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc400cff00 0x7fbc4015a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.099+0000 7fbc3ffff640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc4006e160 0x7fbc401f8710 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000c4d0 tx=0x7fbc3000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.100+0000 7fbc3cff9640 1 -- 172.21.15.50:0/2269681014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30018070 con 0x7fbc4006e160 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.100+0000 7fbc3cff9640 1 -- 172.21.15.50:0/2269681014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc30007500 con 0x7fbc4006e160 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.100+0000 7fbc466dd640 1 -- 172.21.15.50:0/2269681014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc401557a0 con 0x7fbc4006e160 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.100+0000 7fbc3cff9640 1 -- 172.21.15.50:0/2269681014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30004a20 con 0x7fbc4006e160 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.100+0000 7fbc466dd640 1 -- 172.21.15.50:0/2269681014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc401e61a0 con 0x7fbc4006e160 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.101+0000 7fbc466dd640 1 -- 172.21.15.50:0/2269681014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc4015b540 con 0x7fbc4006e160 2024-09-11T22:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.101+0000 7fbc3cff9640 1 -- 172.21.15.50:0/2269681014 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc3001b070 con 0x7fbc4006e160 2024-09-11T22:13:37.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.101+0000 7fbc3cff9640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc2c06be30 0x7fbc2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:37.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.102+0000 7fbc3cff9640 1 -- 172.21.15.50:0/2269681014 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fbc30089db0 con 0x7fbc4006e160 2024-09-11T22:13:37.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.102+0000 7fbc3f7fe640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc2c06be30 0x7fbc2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:37.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.102+0000 7fbc3f7fe640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc2c06be30 0x7fbc2c06e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbc34034000 tx=0x7fbc3402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:37.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.106+0000 7fbc3cff9640 1 -- 172.21.15.50:0/2269681014 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc30058b40 con 0x7fbc4006e160 2024-09-11T22:13:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:37.284+0000 7fbc466dd640 1 -- 172.21.15.50:0/2269681014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbc40068580 con 0x7fbc4006e160 2024-09-11T22:13:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.285+0000 7fbc3cff9640 1 -- 172.21.15.50:0/2269681014 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) ==== 138+0+0 (secure 0 0 0) 0x7fbc30058440 con 0x7fbc4006e160 2024-09-11T22:13:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:13:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.289+0000 7fbc466dd640 1 -- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc2c06be30 msgr2=0x7fbc2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.289+0000 7fbc466dd640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc2c06be30 0x7fbc2c06e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbc34034000 tx=0x7fbc3402e000 comp rx=0 tx=0).stop 2024-09-11T22:13:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.289+0000 7fbc466dd640 1 -- 172.21.15.50:0/2269681014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc4006e160 msgr2=0x7fbc401f8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.289+0000 7fbc466dd640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc4006e160 0x7fbc401f8710 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000c4d0 tx=0x7fbc3000c990 comp rx=0 tx=0).stop 2024-09-11T22:13:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.289+0000 7fbc466dd640 1 -- 172.21.15.50:0/2269681014 shutdown_connections 2024-09-11T22:13:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.289+0000 7fbc466dd640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc2c06be30 0x7fbc2c06e2f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.289+0000 7fbc466dd640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc400cff00 0x7fbc4015a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.289+0000 7fbc466dd640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc4015d460 0x7fbc40140690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.289+0000 7fbc466dd640 1 --2- 172.21.15.50:0/2269681014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc4006e160 0x7fbc401f8710 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.289+0000 7fbc466dd640 1 -- 172.21.15.50:0/2269681014 >> 172.21.15.50:0/2269681014 conn(0x7fbc40075270 msgr2=0x7fbc40067b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.289+0000 7fbc466dd640 1 -- 172.21.15.50:0/2269681014 shutdown_connections 2024-09-11T22:13:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.289+0000 7fbc466dd640 1 -- 172.21.15.50:0/2269681014 wait complete. 2024-09-11T22:13:38.307 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:13:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.421+0000 7f05ec453640 1 Processor -- start 2024-09-11T22:13:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.421+0000 7f05ec453640 1 -- start start 2024-09-11T22:13:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.422+0000 7f05ec453640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05e40b3e10 0x7f05e40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.422+0000 7f05ec453640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e40b4f00 con 0x7f05e40d05e0 2024-09-11T22:13:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.422+0000 7f05ec453640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e40b4360 con 0x7f05e415c2c0 2024-09-11T22:13:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.422+0000 7f05ec453640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f05e40b51c0 con 0x7f05e40b3e10 2024-09-11T22:13:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e99ee640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f05e40d05e0 0x7f05e40ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60962/0 (socket says 172.21.15.50:60962) 2024-09-11T22:13:38.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e99ee640 1 -- 172.21.15.50:0/1285019605 learned_addr learned my addr 172.21.15.50:0/1285019605 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05ea9f0640 1 --2- 172.21.15.50:0/1285019605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05e40b3e10 0x7f05e40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617032357 0 0) 0x7f05e40b4f00 con 0x7f05e40d05e0 2024-09-11T22:13:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05d0003520 con 0x7f05e40d05e0 2024-09-11T22:13:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 171070117 0 0) 0x7f05e40b4360 con 0x7f05e415c2c0 2024-09-11T22:13:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05e40b4f00 con 0x7f05e415c2c0 2024-09-11T22:13:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1435560539 0 0) 0x7f05d0003520 con 0x7f05e40d05e0 2024-09-11T22:13:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05e40b3e10 msgr2=0x7f05e40b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 --2- 172.21.15.50:0/1285019605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05e40b3e10 0x7f05e40b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 >> v1:172.21.15.77:6789/0 conn(0x7f05e415c2c0 legacy=0x7f05e40cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e40b54a0 con 0x7f05e40d05e0 2024-09-11T22:13:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f05d4001670 con 0x7f05e40d05e0 2024-09-11T22:13:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 >> v1:172.21.15.50:6789/0 conn(0x7f05e40d05e0 legacy=0x7f05e40ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 --2- 172.21.15.50:0/1285019605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05d0003b70 0x7f05d0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 --2- 172.21.15.50:0/1285019605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d0004800 0x7f05d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 --2- 172.21.15.50:0/1285019605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05d00051c0 0x7f05d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f05e40b51c0 con 0x7f05d0004800 2024-09-11T22:13:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f05d000bfb0 con 0x7f05d0003b70 2024-09-11T22:13:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f05d000c1b0 con 0x7f05d00051c0 2024-09-11T22:13:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.423+0000 7f05ea9f0640 1 --2- 172.21.15.50:0/1285019605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05e40b3e10 0x7f05e40b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.424+0000 7f05e99ee640 1 --2- 172.21.15.50:0/1285019605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d0004800 0x7f05d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.424+0000 7f05ea1ef640 1 --2- 172.21.15.50:0/1285019605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05d0003b70 0x7f05d0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.424+0000 7f05ea9f0640 1 --2- 172.21.15.50:0/1285019605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05d00051c0 0x7f05d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.424+0000 7f05e99ee640 1 -- 172.21.15.50:0/1285019605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05d00051c0 msgr2=0x7f05d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.424+0000 7f05e99ee640 1 --2- 172.21.15.50:0/1285019605 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05d00051c0 0x7f05d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.424+0000 7f05e99ee640 1 -- 172.21.15.50:0/1285019605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05d0003b70 msgr2=0x7f05d0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.424+0000 7f05e99ee640 1 --2- 172.21.15.50:0/1285019605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05d0003b70 0x7f05d0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.424+0000 7f05e99ee640 1 -- 172.21.15.50:0/1285019605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d0003520 con 0x7f05d0004800 2024-09-11T22:13:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.425+0000 7f05e99ee640 1 --2- 172.21.15.50:0/1285019605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d0004800 0x7f05d0004c80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f05d4007fd0 tx=0x7f05d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2d6f2b4306cd4d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.425+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4007ca0 con 0x7f05d0004800 2024-09-11T22:13:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.425+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d4005af0 con 0x7f05d0004800 2024-09-11T22:13:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.425+0000 7f05e91ed640 1 -- 172.21.15.50:0/1285019605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4007070 con 0x7f05d0004800 2024-09-11T22:13:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.425+0000 7f05ec453640 1 -- 172.21.15.50:0/1285019605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d0004800 msgr2=0x7f05d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.425+0000 7f05ec453640 1 --2- 172.21.15.50:0/1285019605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d0004800 0x7f05d0004c80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f05d4007fd0 tx=0x7f05d0005830 comp rx=0 tx=0).stop 2024-09-11T22:13:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.425+0000 7f05ea9f0640 1 -- 172.21.15.50:0/1285019605 reap_dead start 2024-09-11T22:13:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.425+0000 7f05ec453640 1 -- 172.21.15.50:0/1285019605 shutdown_connections 2024-09-11T22:13:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.425+0000 7f05ec453640 1 -- 172.21.15.50:0/1285019605 >> 172.21.15.50:0/1285019605 conn(0x7f05e40679c0 msgr2=0x7f05e4067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.425+0000 7f05ec453640 1 -- 172.21.15.50:0/1285019605 shutdown_connections 2024-09-11T22:13:38.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.425+0000 7f05ec453640 1 -- 172.21.15.50:0/1285019605 wait complete. 2024-09-11T22:13:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.427+0000 7f05ec453640 1 Processor -- start 2024-09-11T22:13:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.427+0000 7f05ec453640 1 -- start start 2024-09-11T22:13:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.427+0000 7f05ec453640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05d0004800 0x7f05e415c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.427+0000 7f05ec453640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05e4151d00 0x7f05e4146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.427+0000 7f05ec453640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e4146c60 0x7f05e41486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.427+0000 7f05ec453640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f05e406d070 con 0x7f05e4151d00 2024-09-11T22:13:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.427+0000 7f05ec453640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f05e40ce200 con 0x7f05e4146c60 2024-09-11T22:13:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.427+0000 7f05ec453640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f05e406d1f0 con 0x7f05d0004800 2024-09-11T22:13:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05e99ee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05e4151d00 0x7f05e4146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05e99ee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05e4151d00 0x7f05e4146720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35294/0 (socket says 172.21.15.50:35294) 2024-09-11T22:13:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05e99ee640 1 -- 172.21.15.50:0/2901896348 learned_addr learned my addr 172.21.15.50:0/2901896348 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05ea1ef640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05d0004800 0x7f05e415c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05ea9f0640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e4146c60 0x7f05e41486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05e99ee640 1 -- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05d0004800 msgr2=0x7f05e415c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05e99ee640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05d0004800 0x7f05e415c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05e99ee640 1 -- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e4146c60 msgr2=0x7f05e41486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05e99ee640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e4146c60 0x7f05e41486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05e99ee640 1 -- 172.21.15.50:0/2901896348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e415d1b0 con 0x7f05e4151d00 2024-09-11T22:13:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05ea9f0640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e4146c60 0x7f05e41486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05ea1ef640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05d0004800 0x7f05e415c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05e99ee640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05e4151d00 0x7f05e4146720 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c250 tx=0x7f05e40b5670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05daffd640 1 -- 172.21.15.50:0/2901896348 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4037040 con 0x7f05e4151d00 2024-09-11T22:13:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05daffd640 1 -- 172.21.15.50:0/2901896348 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d4041070 con 0x7f05e4151d00 2024-09-11T22:13:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05ec453640 1 -- 172.21.15.50:0/2901896348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e415d490 con 0x7f05e4151d00 2024-09-11T22:13:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05daffd640 1 -- 172.21.15.50:0/2901896348 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d40047e0 con 0x7f05e4151d00 2024-09-11T22:13:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.428+0000 7f05ec453640 1 -- 172.21.15.50:0/2901896348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e415dd30 con 0x7f05e4151d00 2024-09-11T22:13:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.429+0000 7f05ec453640 1 -- 172.21.15.50:0/2901896348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e415c6a0 con 0x7f05e4151d00 2024-09-11T22:13:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.430+0000 7f05daffd640 1 -- 172.21.15.50:0/2901896348 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05d4004980 con 0x7f05e4151d00 2024-09-11T22:13:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.430+0000 7f05daffd640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05c806be60 0x7f05c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.430+0000 7f05daffd640 1 -- 172.21.15.50:0/2901896348 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5227+0+0 (secure 0 0 0) 0x7f05d40aa840 con 0x7f05e4151d00 2024-09-11T22:13:38.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.430+0000 7f05ea1ef640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05c806be60 0x7f05c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:38.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.431+0000 7f05ea1ef640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05c806be60 0x7f05c806e320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05e0005540 tx=0x7f05e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:38.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.435+0000 7f05daffd640 1 -- 172.21.15.50:0/2901896348 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05d40793d0 con 0x7f05e4151d00 2024-09-11T22:13:38.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:38.610+0000 7f05ec453640 1 -- 172.21.15.50:0/2901896348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f05e414a9f0 con 0x7f05e4151d00 2024-09-11T22:13:39.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.291+0000 7f05daffd640 1 -- 172.21.15.50:0/2901896348 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) ==== 170+0+0 (secure 0 0 0) 0x7f05d4078cd0 con 0x7f05e4151d00 2024-09-11T22:13:39.292 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:13:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.301+0000 7f05ec453640 1 -- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05c806be60 msgr2=0x7f05c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:39.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.301+0000 7f05ec453640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05c806be60 0x7f05c806e320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05e0005540 tx=0x7f05e0009040 comp rx=0 tx=0).stop 2024-09-11T22:13:39.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.301+0000 7f05ec453640 1 -- 172.21.15.50:0/2901896348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05e4151d00 msgr2=0x7f05e4146720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:39.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.301+0000 7f05ec453640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05e4151d00 0x7f05e4146720 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c250 tx=0x7f05e40b5670 comp rx=0 tx=0).stop 2024-09-11T22:13:39.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.303+0000 7f05ec453640 1 -- 172.21.15.50:0/2901896348 shutdown_connections 2024-09-11T22:13:39.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.303+0000 7f05ec453640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05c806be60 0x7f05c806e320 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:39.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.303+0000 7f05ec453640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e4146c60 0x7f05e41486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:39.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.303+0000 7f05ec453640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05e4151d00 0x7f05e4146720 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:39.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.303+0000 7f05ec453640 1 --2- 172.21.15.50:0/2901896348 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05d0004800 0x7f05e415c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:39.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.303+0000 7f05ec453640 1 -- 172.21.15.50:0/2901896348 >> 172.21.15.50:0/2901896348 conn(0x7f05e40679c0 msgr2=0x7f05e40b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:39.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.304+0000 7f05ec453640 1 -- 172.21.15.50:0/2901896348 shutdown_connections 2024-09-11T22:13:39.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.305+0000 7f05ec453640 1 -- 172.21.15.50:0/2901896348 wait complete. 2024-09-11T22:13:39.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.434+0000 7f46c3f31640 1 Processor -- start 2024-09-11T22:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.434+0000 7f46c3f31640 1 -- start start 2024-09-11T22:13:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.435+0000 7f46c3f31640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f46bc0cf790 0x7f46bc0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.435+0000 7f46c3f31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46bc0d11d0 0x7f46bc0d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.435+0000 7f46c3f31640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46bc162110 con 0x7f46bc161d30 2024-09-11T22:13:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.435+0000 7f46c3f31640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f46bc0d1b80 con 0x7f46bc0cf790 2024-09-11T22:13:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.435+0000 7f46c3f31640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f46bc0d3450 con 0x7f46bc0d11d0 2024-09-11T22:13:39.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.435+0000 7f46c1ccd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f46bc161d30 0x7f46bc162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60970/0 (socket says 172.21.15.50:60970) 2024-09-11T22:13:39.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.435+0000 7f46c1ccd640 1 -- 172.21.15.50:0/2759291390 learned_addr learned my addr 172.21.15.50:0/2759291390 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:39.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c14cc640 1 --2- 172.21.15.50:0/2759291390 >> v2:172.21.15.77:3300/0 conn(0x7f46bc0cf790 0x7f46bc0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:39.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c24ce640 1 --2- 172.21.15.50:0/2759291390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46bc0d11d0 0x7f46bc0d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:39.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201916860 0 0) 0x7f46bc162110 con 0x7f46bc161d30 2024-09-11T22:13:39.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46a8003520 con 0x7f46bc161d30 2024-09-11T22:13:39.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1154081939 0 0) 0x7f46a8003520 con 0x7f46bc161d30 2024-09-11T22:13:39.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46bc0d11d0 msgr2=0x7f46bc0d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:39.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 --2- 172.21.15.50:0/2759291390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46bc0d11d0 0x7f46bc0d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:39.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 >> v2:172.21.15.77:3300/0 conn(0x7f46bc0cf790 msgr2=0x7f46bc0b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:39.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 --2- 172.21.15.50:0/2759291390 >> v2:172.21.15.77:3300/0 conn(0x7f46bc0cf790 0x7f46bc0b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:39.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46bc0cfd70 con 0x7f46bc161d30 2024-09-11T22:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f46b80019f0 con 0x7f46bc161d30 2024-09-11T22:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c14cc640 1 --2- 172.21.15.50:0/2759291390 >> v2:172.21.15.77:3300/0 conn(0x7f46bc0cf790 0x7f46bc0b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 >> v1:172.21.15.50:6789/0 conn(0x7f46bc161d30 legacy=0x7f46bc162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 --2- 172.21.15.50:0/2759291390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46a80039b0 0x7f46a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 --2- 172.21.15.50:0/2759291390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46bc0d11d0 0x7f46a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 --2- 172.21.15.50:0/2759291390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a8004d40 0x7f46a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc0d1b80 con 0x7f46a8004d40 2024-09-11T22:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc0d3450 con 0x7f46a80039b0 2024-09-11T22:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f46a800b9c0 con 0x7f46bc0d11d0 2024-09-11T22:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c1ccd640 1 --2- 172.21.15.50:0/2759291390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46a80039b0 0x7f46a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c24ce640 1 --2- 172.21.15.50:0/2759291390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a8004d40 0x7f46a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.436+0000 7f46c14cc640 1 --2- 172.21.15.50:0/2759291390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46bc0d11d0 0x7f46a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.437+0000 7f46c24ce640 1 -- 172.21.15.50:0/2759291390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46bc0d11d0 msgr2=0x7f46a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.437+0000 7f46c24ce640 1 --2- 172.21.15.50:0/2759291390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46bc0d11d0 0x7f46a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.437+0000 7f46c24ce640 1 -- 172.21.15.50:0/2759291390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46a80039b0 msgr2=0x7f46a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.437+0000 7f46c24ce640 1 --2- 172.21.15.50:0/2759291390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46a80039b0 0x7f46a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.437+0000 7f46c24ce640 1 -- 172.21.15.50:0/2759291390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a8003520 con 0x7f46a8004d40 2024-09-11T22:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.437+0000 7f46c24ce640 1 --2- 172.21.15.50:0/2759291390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a8004d40 0x7f46a80051c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009ac0 tx=0x7f46a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8cea52f2a68fae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.437+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b4036070 con 0x7f46a8004d40 2024-09-11T22:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.437+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b4031400 con 0x7f46a8004d40 2024-09-11T22:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.437+0000 7f46c0ccb640 1 -- 172.21.15.50:0/2759291390 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b4009690 con 0x7f46a8004d40 2024-09-11T22:13:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.438+0000 7f46c3f31640 1 -- 172.21.15.50:0/2759291390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a8004d40 msgr2=0x7f46a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.438+0000 7f46c3f31640 1 --2- 172.21.15.50:0/2759291390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a8004d40 0x7f46a80051c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009ac0 tx=0x7f46a8005830 comp rx=0 tx=0).stop 2024-09-11T22:13:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.438+0000 7f46c24ce640 1 -- 172.21.15.50:0/2759291390 reap_dead start 2024-09-11T22:13:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.438+0000 7f46c3f31640 1 -- 172.21.15.50:0/2759291390 shutdown_connections 2024-09-11T22:13:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.438+0000 7f46c3f31640 1 -- 172.21.15.50:0/2759291390 >> 172.21.15.50:0/2759291390 conn(0x7f46bc0727a0 msgr2=0x7f46bc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.438+0000 7f46c3f31640 1 -- 172.21.15.50:0/2759291390 shutdown_connections 2024-09-11T22:13:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.438+0000 7f46c3f31640 1 -- 172.21.15.50:0/2759291390 wait complete. 2024-09-11T22:13:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.439+0000 7f46c3f31640 1 Processor -- start 2024-09-11T22:13:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.439+0000 7f46c3f31640 1 -- start start 2024-09-11T22:13:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c3f31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a8004d40 0x7f46bc1f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c3f31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46bc0cae60 0x7f46bc1f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c3f31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46bc0c8c70 0x7f46bc0ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c3f31640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc0d2e00 con 0x7f46a8004d40 2024-09-11T22:13:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c3f31640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc0b7e30 con 0x7f46bc0cae60 2024-09-11T22:13:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c3f31640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f46bc0d30e0 con 0x7f46bc0c8c70 2024-09-11T22:13:39.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c1ccd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a8004d40 0x7f46bc1f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c1ccd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a8004d40 0x7f46bc1f5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35312/0 (socket says 172.21.15.50:35312) 2024-09-11T22:13:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c1ccd640 1 -- 172.21.15.50:0/3085614573 learned_addr learned my addr 172.21.15.50:0/3085614573 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c14cc640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46bc0cae60 0x7f46bc1f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c24ce640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46bc0c8c70 0x7f46bc0ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c1ccd640 1 -- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46bc0c8c70 msgr2=0x7f46bc0ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c1ccd640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46bc0c8c70 0x7f46bc0ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c1ccd640 1 -- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46bc0cae60 msgr2=0x7f46bc1f7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c1ccd640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46bc0cae60 0x7f46bc1f7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.440+0000 7f46c1ccd640 1 -- 172.21.15.50:0/3085614573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46bc0c9660 con 0x7f46a8004d40 2024-09-11T22:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.441+0000 7f46c1ccd640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a8004d40 0x7f46bc1f5ac0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f46b8007a20 tx=0x7f46b800a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.441+0000 7f46b27fc640 1 -- 172.21.15.50:0/3085614573 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b800ae00 con 0x7f46a8004d40 2024-09-11T22:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.441+0000 7f46b27fc640 1 -- 172.21.15.50:0/3085614573 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b8018070 con 0x7f46a8004d40 2024-09-11T22:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.441+0000 7f46c3f31640 1 -- 172.21.15.50:0/3085614573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46bc0b42a0 con 0x7f46a8004d40 2024-09-11T22:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.441+0000 7f46b27fc640 1 -- 172.21.15.50:0/3085614573 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b80127a0 con 0x7f46a8004d40 2024-09-11T22:13:39.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.441+0000 7f46c3f31640 1 -- 172.21.15.50:0/3085614573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46bc0c9940 con 0x7f46a8004d40 2024-09-11T22:13:39.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.442+0000 7f46c3f31640 1 -- 172.21.15.50:0/3085614573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46bc0b78f0 con 0x7f46a8004d40 2024-09-11T22:13:39.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.442+0000 7f46b27fc640 1 -- 172.21.15.50:0/3085614573 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46b8012940 con 0x7f46a8004d40 2024-09-11T22:13:39.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.443+0000 7f46b27fc640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f46a006be30 0x7f46a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:39.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.443+0000 7f46b27fc640 1 -- 172.21.15.50:0/3085614573 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5609+0+0 (secure 0 0 0) 0x7f46b808b650 con 0x7f46a8004d40 2024-09-11T22:13:39.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.443+0000 7f46c14cc640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f46a006be30 0x7f46a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:39.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.444+0000 7f46c14cc640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f46a006be30 0x7f46a006e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0cb280 tx=0x7f46ac009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:39.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.447+0000 7f46b27fc640 1 -- 172.21.15.50:0/3085614573 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46b8059aa0 con 0x7f46a8004d40 2024-09-11T22:13:39.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:39.658+0000 7f46c3f31640 1 -- 172.21.15.50:0/3085614573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f46bc0d02c0 con 0x7f46a8004d40 2024-09-11T22:13:40.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.302+0000 7f46b27fc640 1 -- 172.21.15.50:0/3085614573 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v20) ==== 172+0+0 (secure 0 0 0) 0x7f46b805dda0 con 0x7f46a8004d40 2024-09-11T22:13:40.305 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 6 and data pool 7 2024-09-11T22:13:40.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.316+0000 7f46c3f31640 1 -- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f46a006be30 msgr2=0x7f46a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.316+0000 7f46c3f31640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f46a006be30 0x7f46a006e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0cb280 tx=0x7f46ac009190 comp rx=0 tx=0).stop 2024-09-11T22:13:40.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.316+0000 7f46c3f31640 1 -- 172.21.15.50:0/3085614573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a8004d40 msgr2=0x7f46bc1f5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.316+0000 7f46c3f31640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a8004d40 0x7f46bc1f5ac0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f46b8007a20 tx=0x7f46b800a750 comp rx=0 tx=0).stop 2024-09-11T22:13:40.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.317+0000 7f46c3f31640 1 -- 172.21.15.50:0/3085614573 shutdown_connections 2024-09-11T22:13:40.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.317+0000 7f46c3f31640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f46a006be30 0x7f46a006e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.317+0000 7f46c3f31640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46bc0c8c70 0x7f46bc0ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.317+0000 7f46c3f31640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46bc0cae60 0x7f46bc1f7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.317+0000 7f46c3f31640 1 --2- 172.21.15.50:0/3085614573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46a8004d40 0x7f46bc1f5ac0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.317+0000 7f46c3f31640 1 -- 172.21.15.50:0/3085614573 >> 172.21.15.50:0/3085614573 conn(0x7f46bc0727a0 msgr2=0x7f46bc0b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:40.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.318+0000 7f46c3f31640 1 -- 172.21.15.50:0/3085614573 shutdown_connections 2024-09-11T22:13:40.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.319+0000 7f46c3f31640 1 -- 172.21.15.50:0/3085614573 wait complete. 2024-09-11T22:13:40.339 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:13:40.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.446+0000 7fda3678d640 1 Processor -- start 2024-09-11T22:13:40.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.446+0000 7fda3678d640 1 -- start start 2024-09-11T22:13:40.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.447+0000 7fda3678d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fda3015e8e0 0x7fda300b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.447+0000 7fda3678d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda300d1580 0x7fda300d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.447+0000 7fda3678d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda300d1ee0 con 0x7fda30162350 2024-09-11T22:13:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.447+0000 7fda3678d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fda3015ecc0 con 0x7fda3015e8e0 2024-09-11T22:13:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.447+0000 7fda3678d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fda300d2ad0 con 0x7fda300d1580 2024-09-11T22:13:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.447+0000 7fda34d2a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fda30162350 0x7fda30162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60974/0 (socket says 172.21.15.50:60974) 2024-09-11T22:13:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.447+0000 7fda34d2a640 1 -- 172.21.15.50:0/4204956272 learned_addr learned my addr 172.21.15.50:0/4204956272 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.447+0000 7fda2ffff640 1 --2- 172.21.15.50:0/4204956272 >> v2:172.21.15.77:3300/0 conn(0x7fda3015e8e0 0x7fda300b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2f7fe640 1 --2- 172.21.15.50:0/4204956272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda300d1580 0x7fda300d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550225155 0 0) 0x7fda300d1ee0 con 0x7fda30162350 2024-09-11T22:13:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda18003520 con 0x7fda30162350 2024-09-11T22:13:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1240905334 0 0) 0x7fda18003520 con 0x7fda30162350 2024-09-11T22:13:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda300d1580 msgr2=0x7fda300d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 --2- 172.21.15.50:0/4204956272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda300d1580 0x7fda300d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 >> v2:172.21.15.77:3300/0 conn(0x7fda3015e8e0 msgr2=0x7fda300b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 --2- 172.21.15.50:0/4204956272 >> v2:172.21.15.77:3300/0 conn(0x7fda3015e8e0 0x7fda300b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda30163080 con 0x7fda30162350 2024-09-11T22:13:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fda280019f0 con 0x7fda30162350 2024-09-11T22:13:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2ffff640 1 --2- 172.21.15.50:0/4204956272 >> v2:172.21.15.77:3300/0 conn(0x7fda3015e8e0 0x7fda300b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 >> v1:172.21.15.50:6789/0 conn(0x7fda30162350 legacy=0x7fda30162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 --2- 172.21.15.50:0/4204956272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda180039b0 0x7fda18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 --2- 172.21.15.50:0/4204956272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda300d1580 0x7fda18004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 --2- 172.21.15.50:0/4204956272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda18004d40 0x7fda180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fda300d2ad0 con 0x7fda18004d40 2024-09-11T22:13:40.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fda1800b9c0 con 0x7fda180039b0 2024-09-11T22:13:40.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fda1800bb40 con 0x7fda300d1580 2024-09-11T22:13:40.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda34d2a640 1 --2- 172.21.15.50:0/4204956272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda18004d40 0x7fda180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2ffff640 1 --2- 172.21.15.50:0/4204956272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda180039b0 0x7fda18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda2f7fe640 1 --2- 172.21.15.50:0/4204956272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda300d1580 0x7fda18004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda34d2a640 1 -- 172.21.15.50:0/4204956272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda300d1580 msgr2=0x7fda18004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:40.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda34d2a640 1 --2- 172.21.15.50:0/4204956272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda300d1580 0x7fda18004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda34d2a640 1 -- 172.21.15.50:0/4204956272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda180039b0 msgr2=0x7fda18003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:40.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda34d2a640 1 --2- 172.21.15.50:0/4204956272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda180039b0 0x7fda18003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.448+0000 7fda34d2a640 1 -- 172.21.15.50:0/4204956272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda18003520 con 0x7fda18004d40 2024-09-11T22:13:40.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.449+0000 7fda34d2a640 1 --2- 172.21.15.50:0/4204956272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda18004d40 0x7fda180051c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fda2800a920 tx=0x7fda18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb402b4576b3dfda server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.449+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2800a4c0 con 0x7fda18004d40 2024-09-11T22:13:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.449+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2802f070 con 0x7fda18004d40 2024-09-11T22:13:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.449+0000 7fda2effd640 1 -- 172.21.15.50:0/4204956272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2802bd00 con 0x7fda18004d40 2024-09-11T22:13:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.450+0000 7fda3678d640 1 -- 172.21.15.50:0/4204956272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda18004d40 msgr2=0x7fda180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.450+0000 7fda3678d640 1 --2- 172.21.15.50:0/4204956272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda18004d40 0x7fda180051c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fda2800a920 tx=0x7fda18005830 comp rx=0 tx=0).stop 2024-09-11T22:13:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.450+0000 7fda34d2a640 1 -- 172.21.15.50:0/4204956272 reap_dead start 2024-09-11T22:13:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.450+0000 7fda3678d640 1 -- 172.21.15.50:0/4204956272 shutdown_connections 2024-09-11T22:13:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.450+0000 7fda3678d640 1 -- 172.21.15.50:0/4204956272 >> 172.21.15.50:0/4204956272 conn(0x7fda30067ba0 msgr2=0x7fda30067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.450+0000 7fda3678d640 1 -- 172.21.15.50:0/4204956272 shutdown_connections 2024-09-11T22:13:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.450+0000 7fda3678d640 1 -- 172.21.15.50:0/4204956272 wait complete. 2024-09-11T22:13:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.451+0000 7fda3678d640 1 Processor -- start 2024-09-11T22:13:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.451+0000 7fda3678d640 1 -- start start 2024-09-11T22:13:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda3678d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda18004d40 0x7fda3015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda3678d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda300acc60 0x7fda301f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda3678d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda301f4770 0x7fda300ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda3678d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fda300d3000 con 0x7fda300acc60 2024-09-11T22:13:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda3678d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fda300d3370 con 0x7fda301f4770 2024-09-11T22:13:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda3678d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fda300d19a0 con 0x7fda18004d40 2024-09-11T22:13:40.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda2f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda300acc60 0x7fda301f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda2f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda300acc60 0x7fda301f4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35328/0 (socket says 172.21.15.50:35328) 2024-09-11T22:13:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda2f7fe640 1 -- 172.21.15.50:0/3646780470 learned_addr learned my addr 172.21.15.50:0/3646780470 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda2f7fe640 1 -- 172.21.15.50:0/3646780470 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda18004d40 msgr2=0x7fda3015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda2f7fe640 1 --2- 172.21.15.50:0/3646780470 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda18004d40 0x7fda3015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda2f7fe640 1 -- 172.21.15.50:0/3646780470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda301f4770 msgr2=0x7fda300ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda34d2a640 1 --2- 172.21.15.50:0/3646780470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda301f4770 0x7fda300ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda2f7fe640 1 --2- 172.21.15.50:0/3646780470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda301f4770 0x7fda300ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.452+0000 7fda2f7fe640 1 -- 172.21.15.50:0/3646780470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda301f4d00 con 0x7fda300acc60 2024-09-11T22:13:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.453+0000 7fda2f7fe640 1 --2- 172.21.15.50:0/3646780470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda300acc60 0x7fda301f4230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fda24011910 tx=0x7fda24011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.453+0000 7fda2cff9640 1 -- 172.21.15.50:0/3646780470 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2400faf0 con 0x7fda300acc60 2024-09-11T22:13:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.453+0000 7fda2cff9640 1 -- 172.21.15.50:0/3646780470 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2400fc90 con 0x7fda300acc60 2024-09-11T22:13:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.453+0000 7fda3678d640 1 -- 172.21.15.50:0/3646780470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda301f4fe0 con 0x7fda300acc60 2024-09-11T22:13:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.453+0000 7fda2cff9640 1 -- 172.21.15.50:0/3646780470 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24014440 con 0x7fda300acc60 2024-09-11T22:13:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.453+0000 7fda3678d640 1 -- 172.21.15.50:0/3646780470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3015dbe0 con 0x7fda300acc60 2024-09-11T22:13:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.454+0000 7fda3678d640 1 -- 172.21.15.50:0/3646780470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda300d1d80 con 0x7fda300acc60 2024-09-11T22:13:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.454+0000 7fda2cff9640 1 -- 172.21.15.50:0/3646780470 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda24012040 con 0x7fda300acc60 2024-09-11T22:13:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.455+0000 7fda2cff9640 1 --2- 172.21.15.50:0/3646780470 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fda1c06be30 0x7fda1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.455+0000 7fda2cff9640 1 -- 172.21.15.50:0/3646780470 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fda2408b4e0 con 0x7fda300acc60 2024-09-11T22:13:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.455+0000 7fda2ffff640 1 --2- 172.21.15.50:0/3646780470 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fda1c06be30 0x7fda1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.456+0000 7fda2ffff640 1 --2- 172.21.15.50:0/3646780470 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fda1c06be30 0x7fda1c06e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fda300b2ea0 tx=0x7fda20009760 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.459+0000 7fda2cff9640 1 -- 172.21.15.50:0/3646780470 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda24019030 con 0x7fda300acc60 2024-09-11T22:13:40.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.634+0000 7fda3678d640 1 -- 172.21.15.50:0/3646780470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda300ba770 con 0x7fda300acc60 2024-09-11T22:13:40.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.635+0000 7fda2cff9640 1 -- 172.21.15.50:0/3646780470 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16650 (secure 0 0 0) 0x7fda24059f20 con 0x7fda300acc60 2024-09-11T22:13:40.637 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:40.637 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":44,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:13:39.659717+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:13:37.315617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T22:13:38.641830+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:13:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.637+0000 7fda3678d640 1 -- 172.21.15.50:0/3646780470 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fda1c06be30 msgr2=0x7fda1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.637+0000 7fda3678d640 1 --2- 172.21.15.50:0/3646780470 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fda1c06be30 0x7fda1c06e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fda300b2ea0 tx=0x7fda20009760 comp rx=0 tx=0).stop 2024-09-11T22:13:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.637+0000 7fda3678d640 1 -- 172.21.15.50:0/3646780470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda300acc60 msgr2=0x7fda301f4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.637+0000 7fda3678d640 1 --2- 172.21.15.50:0/3646780470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda300acc60 0x7fda301f4230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fda24011910 tx=0x7fda24011dd0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.637+0000 7fda3678d640 1 -- 172.21.15.50:0/3646780470 shutdown_connections 2024-09-11T22:13:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.637+0000 7fda3678d640 1 --2- 172.21.15.50:0/3646780470 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fda1c06be30 0x7fda1c06e2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.637+0000 7fda3678d640 1 --2- 172.21.15.50:0/3646780470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda301f4770 0x7fda300ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.637+0000 7fda3678d640 1 --2- 172.21.15.50:0/3646780470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda300acc60 0x7fda301f4230 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.637+0000 7fda3678d640 1 --2- 172.21.15.50:0/3646780470 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda18004d40 0x7fda3015d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.637+0000 7fda3678d640 1 -- 172.21.15.50:0/3646780470 >> 172.21.15.50:0/3646780470 conn(0x7fda30067ba0 msgr2=0x7fda300cfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.637+0000 7fda3678d640 1 -- 172.21.15.50:0/3646780470 shutdown_connections 2024-09-11T22:13:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.637+0000 7fda3678d640 1 -- 172.21.15.50:0/3646780470 wait complete. 2024-09-11T22:13:40.650 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:13:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.751+0000 7ff58af31640 1 Processor -- start 2024-09-11T22:13:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.751+0000 7ff58af31640 1 -- start start 2024-09-11T22:13:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff58af31640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff58415b400 0x7ff58406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff58af31640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff584072e60 0x7ff58406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff58af31640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff58415b7e0 con 0x7ff58406df20 2024-09-11T22:13:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff58af31640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff58406e370 con 0x7ff58415b400 2024-09-11T22:13:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff58af31640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff58415f140 con 0x7ff584072e60 2024-09-11T22:13:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff588ccd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff58415b400 0x7ff58406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff5894ce640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff58406df20 0x7ff5840b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60976/0 (socket says 172.21.15.50:60976) 2024-09-11T22:13:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff588ccd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff58415b400 0x7ff58406d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35330/0 (socket says 172.21.15.50:35330) 2024-09-11T22:13:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff5894ce640 1 -- 172.21.15.50:0/3802429294 learned_addr learned my addr 172.21.15.50:0/3802429294 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff57bfff640 1 --2- 172.21.15.50:0/3802429294 >> v2:172.21.15.77:3300/0 conn(0x7ff584072e60 0x7ff58406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff588ccd640 1 -- 172.21.15.50:0/3802429294 >> v2:172.21.15.77:3300/0 conn(0x7ff584072e60 msgr2=0x7ff58406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff588ccd640 1 --2- 172.21.15.50:0/3802429294 >> v2:172.21.15.77:3300/0 conn(0x7ff584072e60 0x7ff58406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff588ccd640 1 -- 172.21.15.50:0/3802429294 >> v1:172.21.15.50:6789/0 conn(0x7ff58406df20 legacy=0x7ff5840b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff588ccd640 1 -- 172.21.15.50:0/3802429294 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58415f420 con 0x7ff58415b400 2024-09-11T22:13:40.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.752+0000 7ff57b7fe640 1 -- 172.21.15.50:0/3802429294 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2091601633 0 0) 0x7ff58415b7e0 con 0x7ff58406df20 2024-09-11T22:13:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.753+0000 7ff588ccd640 1 --2- 172.21.15.50:0/3802429294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58415b400 0x7ff58406d070 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff5840b56b0 tx=0x7ff58002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3548420d60e7dcd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.753+0000 7ff57b7fe640 1 -- 172.21.15.50:0/3802429294 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580037070 con 0x7ff58415b400 2024-09-11T22:13:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.753+0000 7ff57b7fe640 1 -- 172.21.15.50:0/3802429294 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff580032440 con 0x7ff58415b400 2024-09-11T22:13:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.753+0000 7ff57b7fe640 1 -- 172.21.15.50:0/3802429294 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580032810 con 0x7ff58415b400 2024-09-11T22:13:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.754+0000 7ff58af31640 1 -- 172.21.15.50:0/3802429294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58415b400 msgr2=0x7ff58406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.754+0000 7ff58af31640 1 --2- 172.21.15.50:0/3802429294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58415b400 0x7ff58406d070 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff5840b56b0 tx=0x7ff58002a1a0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.754+0000 7ff58af31640 1 -- 172.21.15.50:0/3802429294 shutdown_connections 2024-09-11T22:13:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.754+0000 7ff58af31640 1 --2- 172.21.15.50:0/3802429294 >> v2:172.21.15.77:3300/0 conn(0x7ff584072e60 0x7ff58406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.754+0000 7ff58af31640 1 --2- 172.21.15.50:0/3802429294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58415b400 0x7ff58406d070 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.754+0000 7ff58af31640 1 -- 172.21.15.50:0/3802429294 >> 172.21.15.50:0/3802429294 conn(0x7ff5840679c0 msgr2=0x7ff584067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.754+0000 7ff58af31640 1 -- 172.21.15.50:0/3802429294 shutdown_connections 2024-09-11T22:13:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.754+0000 7ff58af31640 1 -- 172.21.15.50:0/3802429294 wait complete. 2024-09-11T22:13:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.755+0000 7ff58af31640 1 Processor -- start 2024-09-11T22:13:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.755+0000 7ff58af31640 1 -- start start 2024-09-11T22:13:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff58af31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff58406df20 0x7ff584153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff58af31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff584072e60 0x7ff58415e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff58af31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff58415b400 0x7ff584143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff58af31640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff5840cfc50 con 0x7ff584072e60 2024-09-11T22:13:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff58af31640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff58415f9e0 con 0x7ff58415b400 2024-09-11T22:13:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff58af31640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff5840721d0 con 0x7ff58406df20 2024-09-11T22:13:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff57bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff584072e60 0x7ff58415e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff57bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff584072e60 0x7ff58415e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35342/0 (socket says 172.21.15.50:35342) 2024-09-11T22:13:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff57bfff640 1 -- 172.21.15.50:0/919072398 learned_addr learned my addr 172.21.15.50:0/919072398 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff5894ce640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff58415b400 0x7ff584143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff588ccd640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff58406df20 0x7ff584153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff57bfff640 1 -- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff58406df20 msgr2=0x7ff584153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff57bfff640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff58406df20 0x7ff584153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff57bfff640 1 -- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff58415b400 msgr2=0x7ff584143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff57bfff640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff58415b400 0x7ff584143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff57bfff640 1 -- 172.21.15.50:0/919072398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff584152d30 con 0x7ff584072e60 2024-09-11T22:13:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff57bfff640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff584072e60 0x7ff58415e4f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff57400d800 tx=0x7ff57400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.756+0000 7ff5797fa640 1 -- 172.21.15.50:0/919072398 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57400b6c0 con 0x7ff584072e60 2024-09-11T22:13:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.757+0000 7ff5797fa640 1 -- 172.21.15.50:0/919072398 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff574019070 con 0x7ff584072e60 2024-09-11T22:13:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.757+0000 7ff5797fa640 1 -- 172.21.15.50:0/919072398 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57400ba80 con 0x7ff584072e60 2024-09-11T22:13:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.757+0000 7ff58af31640 1 -- 172.21.15.50:0/919072398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff584153010 con 0x7ff584072e60 2024-09-11T22:13:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.757+0000 7ff58af31640 1 -- 172.21.15.50:0/919072398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5841535d0 con 0x7ff584072e60 2024-09-11T22:13:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.757+0000 7ff58af31640 1 -- 172.21.15.50:0/919072398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5840afc80 con 0x7ff584072e60 2024-09-11T22:13:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.758+0000 7ff5797fa640 1 -- 172.21.15.50:0/919072398 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff57400bc20 con 0x7ff584072e60 2024-09-11T22:13:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.758+0000 7ff5797fa640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff57006be30 0x7ff57006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.759+0000 7ff5797fa640 1 -- 172.21.15.50:0/919072398 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7ff57408b3a0 con 0x7ff584072e60 2024-09-11T22:13:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.759+0000 7ff588ccd640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff57006be30 0x7ff57006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.759+0000 7ff588ccd640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff57006be30 0x7ff57006e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff580034000 tx=0x7ff58002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.763+0000 7ff5797fa640 1 -- 172.21.15.50:0/919072398 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5840afc80 con 0x7ff584072e60 2024-09-11T22:13:40.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.937+0000 7ff58af31640 1 -- 172.21.15.50:0/919072398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5840b2ed0 con 0x7ff584072e60 2024-09-11T22:13:40.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.938+0000 7ff5797fa640 1 -- 172.21.15.50:0/919072398 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16650 (secure 0 0 0) 0x7ff574059d50 con 0x7ff584072e60 2024-09-11T22:13:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:40.941 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":44,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:13:39.659717+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:13:37.315617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T22:13:38.641830+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:13:40.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.941+0000 7ff58af31640 1 -- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff57006be30 msgr2=0x7ff57006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.941+0000 7ff58af31640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff57006be30 0x7ff57006e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff580034000 tx=0x7ff58002e000 comp rx=0 tx=0).stop 2024-09-11T22:13:40.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.941+0000 7ff58af31640 1 -- 172.21.15.50:0/919072398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff584072e60 msgr2=0x7ff58415e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:40.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.941+0000 7ff58af31640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff584072e60 0x7ff58415e4f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff57400d800 tx=0x7ff57400dcc0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.941+0000 7ff58af31640 1 -- 172.21.15.50:0/919072398 shutdown_connections 2024-09-11T22:13:40.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.941+0000 7ff58af31640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff57006be30 0x7ff57006e2f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.941+0000 7ff58af31640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff58415b400 0x7ff584143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.941+0000 7ff58af31640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff584072e60 0x7ff58415e4f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.941+0000 7ff58af31640 1 --2- 172.21.15.50:0/919072398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff58406df20 0x7ff584153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:40.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.941+0000 7ff58af31640 1 -- 172.21.15.50:0/919072398 >> 172.21.15.50:0/919072398 conn(0x7ff5840679c0 msgr2=0x7ff5840cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:40.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.941+0000 7ff58af31640 1 -- 172.21.15.50:0/919072398 shutdown_connections 2024-09-11T22:13:40.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:40.941+0000 7ff58af31640 1 -- 172.21.15.50:0/919072398 wait complete. 2024-09-11T22:13:40.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:13:41.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.058+0000 7f2465f9a640 1 Processor -- start 2024-09-11T22:13:41.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.058+0000 7f2465f9a640 1 -- start start 2024-09-11T22:13:41.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f2465f9a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2460161d30 0x7f24600cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:41.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f2465f9a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24600b78f0 0x7f2460162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:41.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f2465f9a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24600d11d0 0x7f24600d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:41.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f2465f9a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f24600d1b80 con 0x7f24600b78f0 2024-09-11T22:13:41.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f2465f9a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f24600d3450 con 0x7f2460161d30 2024-09-11T22:13:41.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f2465f9a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f24601632e0 con 0x7f24600d11d0 2024-09-11T22:13:41.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f245effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24600b78f0 0x7f2460162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:41.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f245effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24600b78f0 0x7f2460162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35348/0 (socket says 172.21.15.50:35348) 2024-09-11T22:13:41.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f245effd640 1 -- 172.21.15.50:0/274080416 learned_addr learned my addr 172.21.15.50:0/274080416 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:41.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f245f7fe640 1 --2- 172.21.15.50:0/274080416 >> v2:172.21.15.77:3300/0 conn(0x7f2460161d30 0x7f24600cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:41.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f245ffff640 1 --2- 172.21.15.50:0/274080416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24600d11d0 0x7f24600d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:41.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f245effd640 1 -- 172.21.15.50:0/274080416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24600d11d0 msgr2=0x7f24600d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:41.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f245effd640 1 --2- 172.21.15.50:0/274080416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24600d11d0 0x7f24600d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:41.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f245effd640 1 -- 172.21.15.50:0/274080416 >> v2:172.21.15.77:3300/0 conn(0x7f2460161d30 msgr2=0x7f24600cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:41.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f245effd640 1 --2- 172.21.15.50:0/274080416 >> v2:172.21.15.77:3300/0 conn(0x7f2460161d30 0x7f24600cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:41.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f245effd640 1 -- 172.21.15.50:0/274080416 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2460162110 con 0x7f24600b78f0 2024-09-11T22:13:41.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.059+0000 7f245ffff640 1 --2- 172.21.15.50:0/274080416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24600d11d0 0x7f24600d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:41.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.060+0000 7f245effd640 1 --2- 172.21.15.50:0/274080416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600b78f0 0x7f2460162da0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2460073050 tx=0x7f245402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b95f806f756710 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:41.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.060+0000 7f245e7fc640 1 -- 172.21.15.50:0/274080416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454037070 con 0x7f24600b78f0 2024-09-11T22:13:41.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.060+0000 7f245e7fc640 1 -- 172.21.15.50:0/274080416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2454032440 con 0x7f24600b78f0 2024-09-11T22:13:41.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.060+0000 7f245e7fc640 1 -- 172.21.15.50:0/274080416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454032810 con 0x7f24600b78f0 2024-09-11T22:13:41.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.060+0000 7f2465f9a640 1 -- 172.21.15.50:0/274080416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600b78f0 msgr2=0x7f2460162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:41.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.060+0000 7f2465f9a640 1 --2- 172.21.15.50:0/274080416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600b78f0 0x7f2460162da0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2460073050 tx=0x7f245402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:13:41.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.061+0000 7f2465f9a640 1 -- 172.21.15.50:0/274080416 shutdown_connections 2024-09-11T22:13:41.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.061+0000 7f2465f9a640 1 --2- 172.21.15.50:0/274080416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24600d11d0 0x7f24600d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:41.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.061+0000 7f2465f9a640 1 --2- 172.21.15.50:0/274080416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600b78f0 0x7f2460162da0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:41.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.061+0000 7f2465f9a640 1 --2- 172.21.15.50:0/274080416 >> v2:172.21.15.77:3300/0 conn(0x7f2460161d30 0x7f24600cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:41.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.061+0000 7f2465f9a640 1 -- 172.21.15.50:0/274080416 >> 172.21.15.50:0/274080416 conn(0x7f24600727a0 msgr2=0x7f24600679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:41.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.061+0000 7f2465f9a640 1 -- 172.21.15.50:0/274080416 shutdown_connections 2024-09-11T22:13:41.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.061+0000 7f2465f9a640 1 -- 172.21.15.50:0/274080416 wait complete. 2024-09-11T22:13:41.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.062+0000 7f2465f9a640 1 Processor -- start 2024-09-11T22:13:41.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.062+0000 7f2465f9a640 1 -- start start 2024-09-11T22:13:41.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f2465f9a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600b78f0 0x7f246015fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:41.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f2465f9a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24600d11d0 0x7f24601f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f2465f9a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2460161d30 0x7f24600aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f2465f9a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24600d2e00 con 0x7f24600b78f0 2024-09-11T22:13:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f2465f9a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24600d2b20 con 0x7f24600d11d0 2024-09-11T22:13:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f2465f9a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f24600d30e0 con 0x7f2460161d30 2024-09-11T22:13:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f245f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600b78f0 0x7f246015fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f245f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600b78f0 0x7f246015fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35358/0 (socket says 172.21.15.50:35358) 2024-09-11T22:13:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f245f7fe640 1 -- 172.21.15.50:0/2707981466 learned_addr learned my addr 172.21.15.50:0/2707981466 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f245effd640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24600d11d0 0x7f24601f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f245ffff640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2460161d30 0x7f24600aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f245f7fe640 1 -- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2460161d30 msgr2=0x7f24600aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f245f7fe640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2460161d30 0x7f24600aba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f245f7fe640 1 -- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24600d11d0 msgr2=0x7f24601f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f245f7fe640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24600d11d0 0x7f24601f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f245f7fe640 1 -- 172.21.15.50:0/2707981466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24601f5ef0 con 0x7f24600b78f0 2024-09-11T22:13:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f245f7fe640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600b78f0 0x7f246015fbc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f245000d5f0 tx=0x7f245000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.063+0000 7f2447fff640 1 -- 172.21.15.50:0/2707981466 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24500125f0 con 0x7f24600b78f0 2024-09-11T22:13:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.064+0000 7f2447fff640 1 -- 172.21.15.50:0/2707981466 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2450019070 con 0x7f24600b78f0 2024-09-11T22:13:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.064+0000 7f2465f9a640 1 -- 172.21.15.50:0/2707981466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24601f5930 con 0x7f24600b78f0 2024-09-11T22:13:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.064+0000 7f2447fff640 1 -- 172.21.15.50:0/2707981466 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24500129d0 con 0x7f24600b78f0 2024-09-11T22:13:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.064+0000 7f2465f9a640 1 -- 172.21.15.50:0/2707981466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24600c9460 con 0x7f24600b78f0 2024-09-11T22:13:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.065+0000 7f2465f9a640 1 -- 172.21.15.50:0/2707981466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24600b8ee0 con 0x7f24600b78f0 2024-09-11T22:13:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.065+0000 7f2447fff640 1 -- 172.21.15.50:0/2707981466 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2450012b70 con 0x7f24600b78f0 2024-09-11T22:13:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.065+0000 7f2447fff640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f244c06be30 0x7f244c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.066+0000 7f2447fff640 1 -- 172.21.15.50:0/2707981466 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f245008b160 con 0x7f24600b78f0 2024-09-11T22:13:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.066+0000 7f245effd640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f244c06be30 0x7f244c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.066+0000 7f245effd640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f244c06be30 0x7f244c06e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2454034000 tx=0x7f245402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:41.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.070+0000 7f2447fff640 1 -- 172.21.15.50:0/2707981466 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2450059b10 con 0x7f24600b78f0 2024-09-11T22:13:41.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.282+0000 7f2465f9a640 1 -- 172.21.15.50:0/2707981466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f24600d2900 con 0x7f24600b78f0 2024-09-11T22:13:41.286 INFO:tasks.ceph.mds.c.smithi050.stderr:2024-09-11T22:13:41.285+0000 7fc303b07640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:13:41.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.985+0000 7f2447fff640 1 -- 172.21.15.50:0/2707981466 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) ==== 118+0+0 (secure 0 0 0) 0x7f2450059410 con 0x7f24600b78f0 2024-09-11T22:13:41.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.988+0000 7f2465f9a640 1 -- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f244c06be30 msgr2=0x7f244c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:41.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.988+0000 7f2465f9a640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f244c06be30 0x7f244c06e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2454034000 tx=0x7f245402e000 comp rx=0 tx=0).stop 2024-09-11T22:13:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.988+0000 7f2465f9a640 1 -- 172.21.15.50:0/2707981466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600b78f0 msgr2=0x7f246015fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.988+0000 7f2465f9a640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600b78f0 0x7f246015fbc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f245000d5f0 tx=0x7f245000dab0 comp rx=0 tx=0).stop 2024-09-11T22:13:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.989+0000 7f2465f9a640 1 -- 172.21.15.50:0/2707981466 shutdown_connections 2024-09-11T22:13:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.989+0000 7f2465f9a640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f244c06be30 0x7f244c06e2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.989+0000 7f2465f9a640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2460161d30 0x7f24600aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.989+0000 7f2465f9a640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24600d11d0 0x7f24601f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.989+0000 7f2465f9a640 1 --2- 172.21.15.50:0/2707981466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24600b78f0 0x7f246015fbc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.989+0000 7f2465f9a640 1 -- 172.21.15.50:0/2707981466 >> 172.21.15.50:0/2707981466 conn(0x7f24600727a0 msgr2=0x7f2460160280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.989+0000 7f2465f9a640 1 -- 172.21.15.50:0/2707981466 shutdown_connections 2024-09-11T22:13:41.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:41.989+0000 7f2465f9a640 1 -- 172.21.15.50:0/2707981466 wait complete. 2024-09-11T22:13:42.004 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:13:42.004 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:13:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.114+0000 7fb7aeed0640 1 Processor -- start 2024-09-11T22:13:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.114+0000 7fb7aeed0640 1 -- start start 2024-09-11T22:13:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.115+0000 7fb7aeed0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7a80d1c90 0x7fb7a80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.115+0000 7fb7aeed0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb7a8162350 0x7fb7a81627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.115+0000 7fb7aeed0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a8163080 con 0x7fb7a815e8e0 2024-09-11T22:13:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.115+0000 7fb7aeed0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb7a815ecc0 con 0x7fb7a80d1c90 2024-09-11T22:13:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.115+0000 7fb7aeed0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb7a80d2ad0 con 0x7fb7a8162350 2024-09-11T22:13:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.115+0000 7fb7a7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7a80d1c90 0x7fb7a80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.115+0000 7fb7a7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7a80d1c90 0x7fb7a80b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35364/0 (socket says 172.21.15.50:35364) 2024-09-11T22:13:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.115+0000 7fb7a7fff640 1 -- 172.21.15.50:0/3192153360 learned_addr learned my addr 172.21.15.50:0/3192153360 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.115+0000 7fb7ad46d640 1 --2- 172.21.15.50:0/3192153360 >> v2:172.21.15.77:3300/0 conn(0x7fb7a8162350 0x7fb7a81627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.116+0000 7fb7a7fff640 1 -- 172.21.15.50:0/3192153360 >> v2:172.21.15.77:3300/0 conn(0x7fb7a8162350 msgr2=0x7fb7a81627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.116+0000 7fb7a7fff640 1 --2- 172.21.15.50:0/3192153360 >> v2:172.21.15.77:3300/0 conn(0x7fb7a8162350 0x7fb7a81627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.116+0000 7fb7a7fff640 1 -- 172.21.15.50:0/3192153360 >> v1:172.21.15.77:6789/0 conn(0x7fb7a815e8e0 legacy=0x7fb7a80d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.116+0000 7fb7a7fff640 1 -- 172.21.15.50:0/3192153360 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a80d2d20 con 0x7fb7a80d1c90 2024-09-11T22:13:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.116+0000 7fb7a7fff640 1 --2- 172.21.15.50:0/3192153360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7a80d1c90 0x7fb7a80b7880 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb7a80d1220 tx=0x7fb79c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c70094fad27105c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.116+0000 7fb7a77fe640 1 -- 172.21.15.50:0/3192153360 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c037070 con 0x7fb7a80d1c90 2024-09-11T22:13:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.116+0000 7fb7a77fe640 1 -- 172.21.15.50:0/3192153360 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c032440 con 0x7fb7a80d1c90 2024-09-11T22:13:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.117+0000 7fb7a77fe640 1 -- 172.21.15.50:0/3192153360 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c032810 con 0x7fb7a80d1c90 2024-09-11T22:13:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.117+0000 7fb7aeed0640 1 -- 172.21.15.50:0/3192153360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7a80d1c90 msgr2=0x7fb7a80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.117+0000 7fb7aeed0640 1 --2- 172.21.15.50:0/3192153360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7a80d1c90 0x7fb7a80b7880 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb7a80d1220 tx=0x7fb79c02a2c0 comp rx=0 tx=0).stop 2024-09-11T22:13:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.117+0000 7fb7aeed0640 1 -- 172.21.15.50:0/3192153360 shutdown_connections 2024-09-11T22:13:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.117+0000 7fb7aeed0640 1 --2- 172.21.15.50:0/3192153360 >> v2:172.21.15.77:3300/0 conn(0x7fb7a8162350 0x7fb7a81627a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.117+0000 7fb7aeed0640 1 --2- 172.21.15.50:0/3192153360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7a80d1c90 0x7fb7a80b7880 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.117+0000 7fb7aeed0640 1 -- 172.21.15.50:0/3192153360 >> 172.21.15.50:0/3192153360 conn(0x7fb7a8067ba0 msgr2=0x7fb7a8067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.117+0000 7fb7aeed0640 1 -- 172.21.15.50:0/3192153360 shutdown_connections 2024-09-11T22:13:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.117+0000 7fb7aeed0640 1 -- 172.21.15.50:0/3192153360 wait complete. 2024-09-11T22:13:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.118+0000 7fb7aeed0640 1 Processor -- start 2024-09-11T22:13:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.118+0000 7fb7aeed0640 1 -- start start 2024-09-11T22:13:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.119+0000 7fb7aeed0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7a80d1c90 0x7fb7a8155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.119+0000 7fb7aeed0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a815e8e0 0x7fb7a81e99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.119+0000 7fb7aeed0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7a8162350 0x7fb7a81e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.119+0000 7fb7aeed0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a8162ce0 con 0x7fb7a8162350 2024-09-11T22:13:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.119+0000 7fb7aeed0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a80d3370 con 0x7fb7a815e8e0 2024-09-11T22:13:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.119+0000 7fb7aeed0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a8162e60 con 0x7fb7a80d1c90 2024-09-11T22:13:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.119+0000 7fb7ad46d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7a8162350 0x7fb7a81e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.119+0000 7fb7ad46d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7a8162350 0x7fb7a81e8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35366/0 (socket says 172.21.15.50:35366) 2024-09-11T22:13:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.119+0000 7fb7ad46d640 1 -- 172.21.15.50:0/2580183542 learned_addr learned my addr 172.21.15.50:0/2580183542 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.119+0000 7fb7acc6c640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7a80d1c90 0x7fb7a8155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.119+0000 7fb7a7fff640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a815e8e0 0x7fb7a81e99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.120+0000 7fb7ad46d640 1 -- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7a80d1c90 msgr2=0x7fb7a8155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.120+0000 7fb7ad46d640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7a80d1c90 0x7fb7a8155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.120+0000 7fb7ad46d640 1 -- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a815e8e0 msgr2=0x7fb7a81e99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.120+0000 7fb7ad46d640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a815e8e0 0x7fb7a81e99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.120+0000 7fb7ad46d640 1 -- 172.21.15.50:0/2580183542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a81e9f20 con 0x7fb7a8162350 2024-09-11T22:13:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.120+0000 7fb7ad46d640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7a8162350 0x7fb7a81e8150 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000cda0 tx=0x7fb7a000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.120+0000 7fb7a57fa640 1 -- 172.21.15.50:0/2580183542 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0003b90 con 0x7fb7a8162350 2024-09-11T22:13:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.120+0000 7fb7a57fa640 1 -- 172.21.15.50:0/2580183542 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a0003d30 con 0x7fb7a8162350 2024-09-11T22:13:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.120+0000 7fb7aeed0640 1 -- 172.21.15.50:0/2580183542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a81e8690 con 0x7fb7a8162350 2024-09-11T22:13:42.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.120+0000 7fb7a57fa640 1 -- 172.21.15.50:0/2580183542 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0004240 con 0x7fb7a8162350 2024-09-11T22:13:42.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.120+0000 7fb7aeed0640 1 -- 172.21.15.50:0/2580183542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a81e8c20 con 0x7fb7a8162350 2024-09-11T22:13:42.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.121+0000 7fb7aeed0640 1 -- 172.21.15.50:0/2580183542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a80b7880 con 0x7fb7a8162350 2024-09-11T22:13:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.121+0000 7fb7a57fa640 1 -- 172.21.15.50:0/2580183542 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7a00043e0 con 0x7fb7a8162350 2024-09-11T22:13:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.122+0000 7fb7a57fa640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb79406be30 0x7fb79406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.122+0000 7fb7a57fa640 1 -- 172.21.15.50:0/2580183542 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb7a008b7c0 con 0x7fb7a8162350 2024-09-11T22:13:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.122+0000 7fb7acc6c640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb79406be30 0x7fb79406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.123+0000 7fb7acc6c640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb79406be30 0x7fb79406e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb7980017f0 tx=0x7fb798009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.126+0000 7fb7a57fa640 1 -- 172.21.15.50:0/2580183542 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7a0059b20 con 0x7fb7a8162350 2024-09-11T22:13:42.309 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:13:42.311 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:13:42.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:42.341+0000 7fb7aeed0640 1 -- 172.21.15.50:0/2580183542 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb7a80ba770 con 0x7fb7a8162350 2024-09-11T22:13:43.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.312+0000 7fb7a57fa640 1 -- 172.21.15.50:0/2580183542 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) ==== 122+0+0 (secure 0 0 0) 0x7fb7a005de20 con 0x7fb7a8162350 2024-09-11T22:13:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.314+0000 7fb7aeed0640 1 -- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb79406be30 msgr2=0x7fb79406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.314+0000 7fb7aeed0640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb79406be30 0x7fb79406e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb7980017f0 tx=0x7fb798009040 comp rx=0 tx=0).stop 2024-09-11T22:13:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.314+0000 7fb7aeed0640 1 -- 172.21.15.50:0/2580183542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7a8162350 msgr2=0x7fb7a81e8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.314+0000 7fb7aeed0640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7a8162350 0x7fb7a81e8150 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000cda0 tx=0x7fb7a000a660 comp rx=0 tx=0).stop 2024-09-11T22:13:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.315+0000 7fb7aeed0640 1 -- 172.21.15.50:0/2580183542 shutdown_connections 2024-09-11T22:13:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.315+0000 7fb7aeed0640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb79406be30 0x7fb79406e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.315+0000 7fb7aeed0640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7a8162350 0x7fb7a81e8150 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.315+0000 7fb7aeed0640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a815e8e0 0x7fb7a81e99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.315+0000 7fb7aeed0640 1 --2- 172.21.15.50:0/2580183542 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7a80d1c90 0x7fb7a8155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.315+0000 7fb7aeed0640 1 -- 172.21.15.50:0/2580183542 >> 172.21.15.50:0/2580183542 conn(0x7fb7a8067ba0 msgr2=0x7fb7a80b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:43.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.315+0000 7fb7aeed0640 1 -- 172.21.15.50:0/2580183542 shutdown_connections 2024-09-11T22:13:43.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.315+0000 7fb7aeed0640 1 -- 172.21.15.50:0/2580183542 wait complete. 2024-09-11T22:13:43.330 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:13:43.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:13:43.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.437+0000 7f745cc77640 1 Processor -- start 2024-09-11T22:13:43.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.437+0000 7f745cc77640 1 -- start start 2024-09-11T22:13:43.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.438+0000 7f745cc77640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f745815c3c0 0x7f745815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.438+0000 7f745cc77640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f745815ec40 0x7f745815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.438+0000 7f745cc77640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74580679c0 0x7f7458067e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.438+0000 7f745cc77640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f745806e700 con 0x7f745815c3c0 2024-09-11T22:13:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.438+0000 7f745cc77640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7458068340 con 0x7f745815ec40 2024-09-11T22:13:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.438+0000 7f745cc77640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f745815f7f0 con 0x7f74580679c0 2024-09-11T22:13:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.438+0000 7f745659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f745815c3c0 0x7f745815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.438+0000 7f745659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f745815c3c0 0x7f745815fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35380/0 (socket says 172.21.15.50:35380) 2024-09-11T22:13:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.438+0000 7f745659c640 1 -- 172.21.15.50:0/2333278715 learned_addr learned my addr 172.21.15.50:0/2333278715 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.439+0000 7f7455d9b640 1 --2- 172.21.15.50:0/2333278715 >> v2:172.21.15.77:3300/0 conn(0x7f745815ec40 0x7f745815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.439+0000 7f7456d9d640 1 --2- 172.21.15.50:0/2333278715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74580679c0 0x7f7458067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.439+0000 7f745659c640 1 -- 172.21.15.50:0/2333278715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74580679c0 msgr2=0x7f7458067e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.439+0000 7f745659c640 1 --2- 172.21.15.50:0/2333278715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74580679c0 0x7f7458067e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.439+0000 7f745659c640 1 -- 172.21.15.50:0/2333278715 >> v2:172.21.15.77:3300/0 conn(0x7f745815ec40 msgr2=0x7f745815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.439+0000 7f745659c640 1 --2- 172.21.15.50:0/2333278715 >> v2:172.21.15.77:3300/0 conn(0x7f745815ec40 0x7f745815f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.439+0000 7f745659c640 1 -- 172.21.15.50:0/2333278715 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745815fad0 con 0x7f745815c3c0 2024-09-11T22:13:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.439+0000 7f745659c640 1 --2- 172.21.15.50:0/2333278715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745815c3c0 0x7f745815fe60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f74581621f0 tx=0x7f744802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a5508942026fdd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.440+0000 7f745559a640 1 -- 172.21.15.50:0/2333278715 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448037070 con 0x7f745815c3c0 2024-09-11T22:13:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.440+0000 7f745559a640 1 -- 172.21.15.50:0/2333278715 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7448032440 con 0x7f745815c3c0 2024-09-11T22:13:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.440+0000 7f745559a640 1 -- 172.21.15.50:0/2333278715 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448032810 con 0x7f745815c3c0 2024-09-11T22:13:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.440+0000 7f745cc77640 1 -- 172.21.15.50:0/2333278715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745815c3c0 msgr2=0x7f745815fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.440+0000 7f745cc77640 1 --2- 172.21.15.50:0/2333278715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745815c3c0 0x7f745815fe60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f74581621f0 tx=0x7f744802a140 comp rx=0 tx=0).stop 2024-09-11T22:13:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.440+0000 7f745cc77640 1 -- 172.21.15.50:0/2333278715 shutdown_connections 2024-09-11T22:13:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.440+0000 7f745cc77640 1 --2- 172.21.15.50:0/2333278715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74580679c0 0x7f7458067e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.440+0000 7f745cc77640 1 --2- 172.21.15.50:0/2333278715 >> v2:172.21.15.77:3300/0 conn(0x7f745815ec40 0x7f745815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.440+0000 7f745cc77640 1 --2- 172.21.15.50:0/2333278715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f745815c3c0 0x7f745815fe60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.440+0000 7f745cc77640 1 -- 172.21.15.50:0/2333278715 >> 172.21.15.50:0/2333278715 conn(0x7f7458075060 msgr2=0x7f745806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.440+0000 7f745cc77640 1 -- 172.21.15.50:0/2333278715 shutdown_connections 2024-09-11T22:13:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.440+0000 7f745cc77640 1 -- 172.21.15.50:0/2333278715 wait complete. 2024-09-11T22:13:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.442+0000 7f745cc77640 1 Processor -- start 2024-09-11T22:13:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.442+0000 7f745cc77640 1 -- start start 2024-09-11T22:13:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.442+0000 7f745cc77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74580679c0 0x7f74581e8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.442+0000 7f745cc77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f745815c3c0 0x7f7458148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.442+0000 7f745cc77640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f745815ec40 0x7f7458157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745cc77640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74580d0940 con 0x7f74580679c0 2024-09-11T22:13:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745cc77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f745806ec30 con 0x7f745815c3c0 2024-09-11T22:13:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745cc77640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f745806f150 con 0x7f745815ec40 2024-09-11T22:13:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74580679c0 0x7f74581e8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74580679c0 0x7f74581e8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35392/0 (socket says 172.21.15.50:35392) 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745659c640 1 -- 172.21.15.50:0/1374203987 learned_addr learned my addr 172.21.15.50:0/1374203987 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f7455d9b640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f745815c3c0 0x7f7458148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f7456d9d640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f745815ec40 0x7f7458157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745659c640 1 -- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f745815ec40 msgr2=0x7f7458157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745659c640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f745815ec40 0x7f7458157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745659c640 1 -- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f745815c3c0 msgr2=0x7f7458148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745659c640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f745815c3c0 0x7f7458148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745659c640 1 -- 172.21.15.50:0/1374203987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74581485a0 con 0x7f74580679c0 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745659c640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74580679c0 0x7f74581e8e40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f744802a180 tx=0x7f74480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f744effd640 1 -- 172.21.15.50:0/1374203987 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448041020 con 0x7f74580679c0 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f744effd640 1 -- 172.21.15.50:0/1374203987 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74480306c0 con 0x7f74580679c0 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745cc77640 1 -- 172.21.15.50:0/1374203987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74581e7da0 con 0x7f74580679c0 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f744effd640 1 -- 172.21.15.50:0/1374203987 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448037040 con 0x7f74580679c0 2024-09-11T22:13:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.443+0000 7f745cc77640 1 -- 172.21.15.50:0/1374203987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74581e8640 con 0x7f74580679c0 2024-09-11T22:13:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.445+0000 7f745cc77640 1 -- 172.21.15.50:0/1374203987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f745806cae0 con 0x7f74580679c0 2024-09-11T22:13:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.445+0000 7f744effd640 1 -- 172.21.15.50:0/1374203987 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7448044020 con 0x7f74580679c0 2024-09-11T22:13:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.446+0000 7f744effd640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f743806be60 0x7f743806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.446+0000 7f744effd640 1 -- 172.21.15.50:0/1374203987 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f74480ab470 con 0x7f74580679c0 2024-09-11T22:13:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.446+0000 7f7455d9b640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f743806be60 0x7f743806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.446+0000 7f7455d9b640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f743806be60 0x7f743806e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7458159230 tx=0x7f7440008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:43.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.450+0000 7f744effd640 1 -- 172.21.15.50:0/1374203987 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f744804b030 con 0x7f74580679c0 2024-09-11T22:13:43.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.660+0000 7f745cc77640 1 -- 172.21.15.50:0/1374203987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7458160650 con 0x7f74580679c0 2024-09-11T22:13:43.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.661+0000 7f744effd640 1 -- 172.21.15.50:0/1374203987 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7f74581485a0 con 0x7f74580679c0 2024-09-11T22:13:43.663 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:43.663 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"btime":"2024-09-11T22:13:43:312858+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2882007728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2882007728},{"type":"v1","addr":"172.21.15.50:6835","nonce":2882007728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1935649711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935649711},{"type":"v1","addr":"172.21.15.77:6837","nonce":1935649711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3208356003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3208356003},{"type":"v1","addr":"172.21.15.77:6836","nonce":3208356003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:13:39.660035+0000","modified":"2024-09-11T22:13:42.344052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/3053142878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3053142878},{"type":"v1","addr":"172.21.15.50:6834","nonce":3053142878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-11T22:13:43.663 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-09-11T22:13:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.663+0000 7f745cc77640 1 -- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f743806be60 msgr2=0x7f743806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.663+0000 7f745cc77640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f743806be60 0x7f743806e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7458159230 tx=0x7f7440008040 comp rx=0 tx=0).stop 2024-09-11T22:13:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.663+0000 7f745cc77640 1 -- 172.21.15.50:0/1374203987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74580679c0 msgr2=0x7f74581e8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.663+0000 7f745cc77640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74580679c0 0x7f74581e8e40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f744802a180 tx=0x7f74480046c0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.663+0000 7f745cc77640 1 -- 172.21.15.50:0/1374203987 shutdown_connections 2024-09-11T22:13:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.663+0000 7f745cc77640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f743806be60 0x7f743806e320 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.663+0000 7f745cc77640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f745815ec40 0x7f7458157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.663+0000 7f745cc77640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f745815c3c0 0x7f7458148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.663+0000 7f745cc77640 1 --2- 172.21.15.50:0/1374203987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74580679c0 0x7f74581e8e40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.663+0000 7f745cc77640 1 -- 172.21.15.50:0/1374203987 >> 172.21.15.50:0/1374203987 conn(0x7f7458075060 msgr2=0x7f745806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.663+0000 7f745cc77640 1 -- 172.21.15.50:0/1374203987 shutdown_connections 2024-09-11T22:13:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.663+0000 7f745cc77640 1 -- 172.21.15.50:0/1374203987 wait complete. 2024-09-11T22:13:43.676 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:13:43.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.776+0000 7f97c5047640 1 Processor -- start 2024-09-11T22:13:43.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.776+0000 7f97c5047640 1 -- start start 2024-09-11T22:13:43.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.777+0000 7f97c5047640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c015b400 0x7f97c006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:43.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.777+0000 7f97c5047640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97c006e0f0 0x7f97c00711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:43.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.777+0000 7f97c5047640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97c015b7e0 con 0x7f97c0072e60 2024-09-11T22:13:43.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.777+0000 7f97c5047640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f97c015f140 con 0x7f97c006e0f0 2024-09-11T22:13:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.777+0000 7f97c5047640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f97c015f420 con 0x7f97c015b400 2024-09-11T22:13:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.777+0000 7f97bf59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97c006e0f0 0x7f97c00711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.777+0000 7f97bed9d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c015b400 0x7f97c006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.777+0000 7f97bf59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97c006e0f0 0x7f97c00711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:48076/0 (socket says 172.21.15.50:48076) 2024-09-11T22:13:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.777+0000 7f97bf59e640 1 -- 172.21.15.50:0/4212439905 learned_addr learned my addr 172.21.15.50:0/4212439905 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.777+0000 7f97be59c640 1 --1- 172.21.15.50:0/4212439905 >> v1:172.21.15.77:6789/0 conn(0x7f97c0072e60 0x7f97c006d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:47866/0 (socket says 172.21.15.50:47866) 2024-09-11T22:13:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.778+0000 7f97bf59e640 1 -- 172.21.15.50:0/4212439905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c015b400 msgr2=0x7f97c006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:43.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.778+0000 7f97bf59e640 1 --2- 172.21.15.50:0/4212439905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c015b400 0x7f97c006d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.778+0000 7f97bf59e640 1 -- 172.21.15.50:0/4212439905 >> v1:172.21.15.77:6789/0 conn(0x7f97c0072e60 legacy=0x7f97c006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.778+0000 7f97bf59e640 1 -- 172.21.15.50:0/4212439905 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c015f700 con 0x7f97c006e0f0 2024-09-11T22:13:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.778+0000 7f97bdd9b640 1 -- 172.21.15.50:0/4212439905 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2119319606 0 0) 0x7f97c015b7e0 con 0x7f97c0072e60 2024-09-11T22:13:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.778+0000 7f97bf59e640 1 --2- 172.21.15.50:0/4212439905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c006e0f0 0x7f97c00711c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009e50 tx=0x7f97b802a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef06c5a28f1b0fca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.778+0000 7f97bdd9b640 1 -- 172.21.15.50:0/4212439905 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8036070 con 0x7f97c006e0f0 2024-09-11T22:13:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.779+0000 7f97bdd9b640 1 -- 172.21.15.50:0/4212439905 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b8031600 con 0x7f97c006e0f0 2024-09-11T22:13:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.779+0000 7f97bdd9b640 1 -- 172.21.15.50:0/4212439905 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b80319d0 con 0x7f97c006e0f0 2024-09-11T22:13:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.779+0000 7f97c5047640 1 -- 172.21.15.50:0/4212439905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c006e0f0 msgr2=0x7f97c00711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:43.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.779+0000 7f97c5047640 1 --2- 172.21.15.50:0/4212439905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c006e0f0 0x7f97c00711c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009e50 tx=0x7f97b802a730 comp rx=0 tx=0).stop 2024-09-11T22:13:43.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.779+0000 7f97c5047640 1 -- 172.21.15.50:0/4212439905 shutdown_connections 2024-09-11T22:13:43.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.779+0000 7f97c5047640 1 --2- 172.21.15.50:0/4212439905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c006e0f0 0x7f97c00711c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.779+0000 7f97c5047640 1 --2- 172.21.15.50:0/4212439905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c015b400 0x7f97c006d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.779+0000 7f97c5047640 1 -- 172.21.15.50:0/4212439905 >> 172.21.15.50:0/4212439905 conn(0x7f97c00679c0 msgr2=0x7f97c0067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:43.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.779+0000 7f97c5047640 1 -- 172.21.15.50:0/4212439905 shutdown_connections 2024-09-11T22:13:43.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.779+0000 7f97c5047640 1 -- 172.21.15.50:0/4212439905 wait complete. 2024-09-11T22:13:43.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.780+0000 7f97c5047640 1 Processor -- start 2024-09-11T22:13:43.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.780+0000 7f97c5047640 1 -- start start 2024-09-11T22:13:43.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.781+0000 7f97c5047640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c006e0f0 0x7f97c014a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:43.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.781+0000 7f97c5047640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c0072e60 0x7f97c014e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:43.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.781+0000 7f97c5047640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c015b400 0x7f97c00ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:43.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.781+0000 7f97c5047640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0071700 con 0x7f97c0072e60 2024-09-11T22:13:43.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.781+0000 7f97c5047640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f97c00cfc50 con 0x7f97c015b400 2024-09-11T22:13:43.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.781+0000 7f97c5047640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f97c0071880 con 0x7f97c006e0f0 2024-09-11T22:13:43.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.781+0000 7f97be59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c0072e60 0x7f97c014e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:43.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.781+0000 7f97be59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c0072e60 0x7f97c014e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35396/0 (socket says 172.21.15.50:35396) 2024-09-11T22:13:43.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.781+0000 7f97be59c640 1 -- 172.21.15.50:0/1191971555 learned_addr learned my addr 172.21.15.50:0/1191971555 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:43.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.781+0000 7f97bf59e640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c015b400 0x7f97c00ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:43.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.781+0000 7f97bed9d640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c006e0f0 0x7f97c014a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:43.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.782+0000 7f97be59c640 1 -- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c006e0f0 msgr2=0x7f97c014a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.782+0000 7f97be59c640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c006e0f0 0x7f97c014a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.782+0000 7f97be59c640 1 -- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c015b400 msgr2=0x7f97c00ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.782+0000 7f97be59c640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c015b400 0x7f97c00ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.782+0000 7f97be59c640 1 -- 172.21.15.50:0/1191971555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c014b0e0 con 0x7f97c0072e60 2024-09-11T22:13:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.782+0000 7f97bf59e640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c015b400 0x7f97c00ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.782+0000 7f97be59c640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c0072e60 0x7f97c014e530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f97b400c480 tx=0x7f97b400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.782+0000 7f97a77fe640 1 -- 172.21.15.50:0/1191971555 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4018070 con 0x7f97c0072e60 2024-09-11T22:13:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.782+0000 7f97a77fe640 1 -- 172.21.15.50:0/1191971555 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b40074e0 con 0x7f97c0072e60 2024-09-11T22:13:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.782+0000 7f97c5047640 1 -- 172.21.15.50:0/1191971555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c014b3c0 con 0x7f97c0072e60 2024-09-11T22:13:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.782+0000 7f97a77fe640 1 -- 172.21.15.50:0/1191971555 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4007690 con 0x7f97c0072e60 2024-09-11T22:13:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.782+0000 7f97c5047640 1 -- 172.21.15.50:0/1191971555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c014b980 con 0x7f97c0072e60 2024-09-11T22:13:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.783+0000 7f97c5047640 1 -- 172.21.15.50:0/1191971555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c00711c0 con 0x7f97c0072e60 2024-09-11T22:13:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.784+0000 7f97a77fe640 1 -- 172.21.15.50:0/1191971555 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97b401b070 con 0x7f97c0072e60 2024-09-11T22:13:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.784+0000 7f97a77fe640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97ac06be30 0x7f97ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.784+0000 7f97a77fe640 1 -- 172.21.15.50:0/1191971555 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f97b408a1f0 con 0x7f97c0072e60 2024-09-11T22:13:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.785+0000 7f97bed9d640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97ac06be30 0x7f97ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:43.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.785+0000 7f97bed9d640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97ac06be30 0x7f97ac06e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009aa0 tx=0x7f97b0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:43.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.789+0000 7f97a77fe640 1 -- 172.21.15.50:0/1191971555 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f97b4058550 con 0x7f97c0072e60 2024-09-11T22:13:43.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.965+0000 7f97c5047640 1 -- 172.21.15.50:0/1191971555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97c0152930 con 0x7f97c0072e60 2024-09-11T22:13:43.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.967+0000 7f97a77fe640 1 -- 172.21.15.50:0/1191971555 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16637 (secure 0 0 0) 0x7f97b405c850 con 0x7f97c0072e60 2024-09-11T22:13:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:43.972 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":45,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:13:41.301458+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:13:37.315617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T22:13:38.641830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:13:43.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.969+0000 7f97c5047640 1 -- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97ac06be30 msgr2=0x7f97ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:43.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.969+0000 7f97c5047640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97ac06be30 0x7f97ac06e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009aa0 tx=0x7f97b0009190 comp rx=0 tx=0).stop 2024-09-11T22:13:43.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.969+0000 7f97c5047640 1 -- 172.21.15.50:0/1191971555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c0072e60 msgr2=0x7f97c014e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:43.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.969+0000 7f97c5047640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c0072e60 0x7f97c014e530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f97b400c480 tx=0x7f97b400c940 comp rx=0 tx=0).stop 2024-09-11T22:13:43.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.969+0000 7f97c5047640 1 -- 172.21.15.50:0/1191971555 shutdown_connections 2024-09-11T22:13:43.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.969+0000 7f97c5047640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97ac06be30 0x7f97ac06e2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.969+0000 7f97c5047640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c015b400 0x7f97c00ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.969+0000 7f97c5047640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c0072e60 0x7f97c014e530 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.969+0000 7f97c5047640 1 --2- 172.21.15.50:0/1191971555 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c006e0f0 0x7f97c014a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:43.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.969+0000 7f97c5047640 1 -- 172.21.15.50:0/1191971555 >> 172.21.15.50:0/1191971555 conn(0x7f97c00679c0 msgr2=0x7f97c00ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:43.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.969+0000 7f97c5047640 1 -- 172.21.15.50:0/1191971555 shutdown_connections 2024-09-11T22:13:43.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:43.969+0000 7f97c5047640 1 -- 172.21.15.50:0/1191971555 wait complete. 2024-09-11T22:13:43.982 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:13:43.982 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:13:44.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.084+0000 7f56757ff640 1 Processor -- start 2024-09-11T22:13:44.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.084+0000 7f56757ff640 1 -- start start 2024-09-11T22:13:44.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.084+0000 7f56757ff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f567015e5d0 0x7f56700cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.084+0000 7f56757ff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56700d1810 0x7f56700b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.084+0000 7f56757ff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56700d2d00 con 0x7f56700cf8a0 2024-09-11T22:13:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.084+0000 7f56757ff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f56700cf3d0 con 0x7f56700d1810 2024-09-11T22:13:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.084+0000 7f56757ff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f56700d2fa0 con 0x7f567015e5d0 2024-09-11T22:13:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.085+0000 7f566f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56700d1810 0x7f56700b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.085+0000 7f566f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56700d1810 0x7f56700b7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35404/0 (socket says 172.21.15.50:35404) 2024-09-11T22:13:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.085+0000 7f566f7fe640 1 -- 172.21.15.50:0/3174014712 learned_addr learned my addr 172.21.15.50:0/3174014712 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.085+0000 7f566effd640 1 --2- 172.21.15.50:0/3174014712 >> v2:172.21.15.77:3300/0 conn(0x7f567015e5d0 0x7f56700cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.085+0000 7f566f7fe640 1 -- 172.21.15.50:0/3174014712 >> v2:172.21.15.77:3300/0 conn(0x7f567015e5d0 msgr2=0x7f56700cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.085+0000 7f566f7fe640 1 --2- 172.21.15.50:0/3174014712 >> v2:172.21.15.77:3300/0 conn(0x7f567015e5d0 0x7f56700cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.085+0000 7f566f7fe640 1 -- 172.21.15.50:0/3174014712 >> v1:172.21.15.77:6789/0 conn(0x7f56700cf8a0 legacy=0x7f56700d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.085+0000 7f566f7fe640 1 -- 172.21.15.50:0/3174014712 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56700d3280 con 0x7f56700d1810 2024-09-11T22:13:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.086+0000 7f566f7fe640 1 --2- 172.21.15.50:0/3174014712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700d1810 0x7f56700b7d30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f56700d5780 tx=0x7f566002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a263ef5816ea40 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.086+0000 7f566dffb640 1 -- 172.21.15.50:0/3174014712 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660036070 con 0x7f56700d1810 2024-09-11T22:13:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.086+0000 7f566dffb640 1 -- 172.21.15.50:0/3174014712 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5660031600 con 0x7f56700d1810 2024-09-11T22:13:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.086+0000 7f566dffb640 1 -- 172.21.15.50:0/3174014712 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56600319f0 con 0x7f56700d1810 2024-09-11T22:13:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.086+0000 7f56757ff640 1 -- 172.21.15.50:0/3174014712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700d1810 msgr2=0x7f56700b7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.086+0000 7f56757ff640 1 --2- 172.21.15.50:0/3174014712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700d1810 0x7f56700b7d30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f56700d5780 tx=0x7f566002a7c0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.086+0000 7f56757ff640 1 -- 172.21.15.50:0/3174014712 shutdown_connections 2024-09-11T22:13:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.086+0000 7f56757ff640 1 --2- 172.21.15.50:0/3174014712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700d1810 0x7f56700b7d30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.086+0000 7f56757ff640 1 --2- 172.21.15.50:0/3174014712 >> v2:172.21.15.77:3300/0 conn(0x7f567015e5d0 0x7f56700cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.086+0000 7f56757ff640 1 -- 172.21.15.50:0/3174014712 >> 172.21.15.50:0/3174014712 conn(0x7f5670072590 msgr2=0x7f56700729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.086+0000 7f56757ff640 1 -- 172.21.15.50:0/3174014712 shutdown_connections 2024-09-11T22:13:44.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.086+0000 7f56757ff640 1 -- 172.21.15.50:0/3174014712 wait complete. 2024-09-11T22:13:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.088+0000 7f56757ff640 1 Processor -- start 2024-09-11T22:13:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.088+0000 7f56757ff640 1 -- start start 2024-09-11T22:13:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.088+0000 7f56757ff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700cf8a0 0x7f56700b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.088+0000 7f56757ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56700d1810 0x7f567015d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.088+0000 7f56757ff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f567015e5d0 0x7f56700ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.088+0000 7f56757ff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56700b8270 con 0x7f56700cf8a0 2024-09-11T22:13:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.088+0000 7f56757ff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f56700cfd10 con 0x7f56700d1810 2024-09-11T22:13:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.088+0000 7f56757ff640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f56700b83f0 con 0x7f567015e5d0 2024-09-11T22:13:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f566effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700cf8a0 0x7f56700b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f566effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700cf8a0 0x7f56700b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35412/0 (socket says 172.21.15.50:35412) 2024-09-11T22:13:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f566effd640 1 -- 172.21.15.50:0/193519011 learned_addr learned my addr 172.21.15.50:0/193519011 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:44.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f566e7fc640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56700d1810 0x7f567015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f566f7fe640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f567015e5d0 0x7f56700ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f566effd640 1 -- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f567015e5d0 msgr2=0x7f56700ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f566effd640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f567015e5d0 0x7f56700ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f566effd640 1 -- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56700d1810 msgr2=0x7f567015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f566effd640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56700d1810 0x7f567015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f566effd640 1 -- 172.21.15.50:0/193519011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56700ab0a0 con 0x7f56700cf8a0 2024-09-11T22:13:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f566effd640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700cf8a0 0x7f56700b00a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f566800d5f0 tx=0x7f566800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f56677fe640 1 -- 172.21.15.50:0/193519011 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56680125f0 con 0x7f56700cf8a0 2024-09-11T22:13:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f56677fe640 1 -- 172.21.15.50:0/193519011 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5668019070 con 0x7f56700cf8a0 2024-09-11T22:13:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f56677fe640 1 -- 172.21.15.50:0/193519011 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56680129d0 con 0x7f56700cf8a0 2024-09-11T22:13:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f56757ff640 1 -- 172.21.15.50:0/193519011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567015d970 con 0x7f56700cf8a0 2024-09-11T22:13:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.089+0000 7f56757ff640 1 -- 172.21.15.50:0/193519011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56700ab620 con 0x7f56700cf8a0 2024-09-11T22:13:44.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.090+0000 7f56757ff640 1 -- 172.21.15.50:0/193519011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56700b7d30 con 0x7f56700cf8a0 2024-09-11T22:13:44.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.091+0000 7f56677fe640 1 -- 172.21.15.50:0/193519011 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5668012b70 con 0x7f56700cf8a0 2024-09-11T22:13:44.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.091+0000 7f56677fe640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f565006be30 0x7f565006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.091+0000 7f56677fe640 1 -- 172.21.15.50:0/193519011 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f566808b160 con 0x7f56700cf8a0 2024-09-11T22:13:44.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.091+0000 7f566e7fc640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f565006be30 0x7f565006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.092+0000 7f566e7fc640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f565006be30 0x7f565006e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5658001780 tx=0x7f5658009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:44.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.096+0000 7f56677fe640 1 -- 172.21.15.50:0/193519011 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f56680594c0 con 0x7f56700cf8a0 2024-09-11T22:13:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.267+0000 7f56757ff640 1 -- 172.21.15.50:0/193519011 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5670160970 con 0x7f565006be30 2024-09-11T22:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.274+0000 7f56677fe640 1 -- 172.21.15.50:0/193519011 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247661 (secure 0 0 0) 0x7f5670160970 con 0x7f565006be30 2024-09-11T22:13:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:13:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.277+0000 7f56757ff640 1 -- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f565006be30 msgr2=0x7f565006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.277+0000 7f56757ff640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f565006be30 0x7f565006e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5658001780 tx=0x7f5658009040 comp rx=0 tx=0).stop 2024-09-11T22:13:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.277+0000 7f56757ff640 1 -- 172.21.15.50:0/193519011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700cf8a0 msgr2=0x7f56700b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.277+0000 7f56757ff640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700cf8a0 0x7f56700b00a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f566800d5f0 tx=0x7f566800dab0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.277+0000 7f56757ff640 1 -- 172.21.15.50:0/193519011 shutdown_connections 2024-09-11T22:13:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.277+0000 7f56757ff640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f565006be30 0x7f565006e2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.277+0000 7f56757ff640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f567015e5d0 0x7f56700ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.277+0000 7f56757ff640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56700d1810 0x7f567015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.277+0000 7f56757ff640 1 --2- 172.21.15.50:0/193519011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700cf8a0 0x7f56700b00a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.277+0000 7f56757ff640 1 -- 172.21.15.50:0/193519011 >> 172.21.15.50:0/193519011 conn(0x7f5670072590 msgr2=0x7f5670160e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.277+0000 7f56757ff640 1 -- 172.21.15.50:0/193519011 shutdown_connections 2024-09-11T22:13:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.277+0000 7f56757ff640 1 -- 172.21.15.50:0/193519011 wait complete. 2024-09-11T22:13:44.290 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2024-09-11T22:13:43.397888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592092,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":173,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304472,"kb_used_data":5028,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754670248,"statfs":{"total":773094113280,"available":772782333952,"internally_reserved":0,"allocated":5148672,"data_stored":2758182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":306433585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1724,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.109942"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784907+0000","last_change":"2024-09-11T22:13:40.311514+0000","last_active":"2024-09-11T22:13:41.784907+0000","last_peered":"2024-09-11T22:13:41.784907+0000","last_clean":"2024-09-11T22:13:41.784907+0000","last_became_active":"2024-09-11T22:13:40.311230+0000","last_became_peered":"2024-09-11T22:13:40.311230+0000","last_unstale":"2024-09-11T22:13:41.784907+0000","last_undegraded":"2024-09-11T22:13:41.784907+0000","last_fullsized":"2024-09-11T22:13:41.784907+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:46.668580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297744+0000","last_change":"2024-09-11T22:13:39.297744+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297744+0000","last_undegraded":"2024-09-11T22:13:39.297744+0000","last_fullsized":"2024-09-11T22:13:39.297744+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.296494+0000","last_change":"2024-09-11T22:13:39.296494+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.296494+0000","last_undegraded":"2024-09-11T22:13:39.296494+0000","last_fullsized":"2024-09-11T22:13:39.296494+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300662+0000","last_change":"2024-09-11T22:13:39.300662+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300662+0000","last_undegraded":"2024-09-11T22:13:39.300662+0000","last_fullsized":"2024-09-11T22:13:39.300662+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297123+0000","last_change":"2024-09-11T22:13:39.297123+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297123+0000","last_undegraded":"2024-09-11T22:13:39.297123+0000","last_fullsized":"2024-09-11T22:13:39.297123+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.303442+0000","last_change":"2024-09-11T22:13:39.303442+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.303442+0000","last_undegraded":"2024-09-11T22:13:39.303442+0000","last_fullsized":"2024-09-11T22:13:39.303442+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785039+0000","last_change":"2024-09-11T22:13:40.311634+0000","last_active":"2024-09-11T22:13:41.785039+0000","last_peered":"2024-09-11T22:13:41.785039+0000","last_clean":"2024-09-11T22:13:41.785039+0000","last_became_active":"2024-09-11T22:13:40.311350+0000","last_became_peered":"2024-09-11T22:13:40.311350+0000","last_unstale":"2024-09-11T22:13:41.785039+0000","last_undegraded":"2024-09-11T22:13:41.785039+0000","last_fullsized":"2024-09-11T22:13:41.785039+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:54.495405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300619+0000","last_change":"2024-09-11T22:13:39.300619+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300619+0000","last_undegraded":"2024-09-11T22:13:39.300619+0000","last_fullsized":"2024-09-11T22:13:39.300619+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300820+0000","last_change":"2024-09-11T22:13:39.300820+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300820+0000","last_undegraded":"2024-09-11T22:13:39.300820+0000","last_fullsized":"2024-09-11T22:13:39.300820+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299878+0000","last_change":"2024-09-11T22:13:39.299878+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299878+0000","last_undegraded":"2024-09-11T22:13:39.299878+0000","last_fullsized":"2024-09-11T22:13:39.299878+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298724+0000","last_change":"2024-09-11T22:13:39.298724+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298724+0000","last_undegraded":"2024-09-11T22:13:39.298724+0000","last_fullsized":"2024-09-11T22:13:39.298724+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298357+0000","last_change":"2024-09-11T22:13:39.298357+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298357+0000","last_undegraded":"2024-09-11T22:13:39.298357+0000","last_fullsized":"2024-09-11T22:13:39.298357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304255+0000","last_change":"2024-09-11T22:13:40.319919+0000","last_active":"2024-09-11T22:13:41.304255+0000","last_peered":"2024-09-11T22:13:41.304255+0000","last_clean":"2024-09-11T22:13:41.304255+0000","last_became_active":"2024-09-11T22:13:40.319595+0000","last_became_peered":"2024-09-11T22:13:40.319595+0000","last_unstale":"2024-09-11T22:13:41.304255+0000","last_undegraded":"2024-09-11T22:13:41.304255+0000","last_fullsized":"2024-09-11T22:13:41.304255+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:01.306291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300326+0000","last_change":"2024-09-11T22:13:39.300326+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300326+0000","last_undegraded":"2024-09-11T22:13:39.300326+0000","last_fullsized":"2024-09-11T22:13:39.300326+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304400+0000","last_change":"2024-09-11T22:13:39.304400+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304400+0000","last_undegraded":"2024-09-11T22:13:39.304400+0000","last_fullsized":"2024-09-11T22:13:39.304400+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.301312+0000","last_change":"2024-09-11T22:13:39.301312+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.301312+0000","last_undegraded":"2024-09-11T22:13:39.301312+0000","last_fullsized":"2024-09-11T22:13:39.301312+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.296968+0000","last_change":"2024-09-11T22:13:39.296968+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.296968+0000","last_undegraded":"2024-09-11T22:13:39.296968+0000","last_fullsized":"2024-09-11T22:13:39.296968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297494+0000","last_change":"2024-09-11T22:13:39.297494+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297494+0000","last_undegraded":"2024-09-11T22:13:39.297494+0000","last_fullsized":"2024-09-11T22:13:39.297494+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302296+0000","last_change":"2024-09-11T22:13:39.302296+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302296+0000","last_undegraded":"2024-09-11T22:13:39.302296+0000","last_fullsized":"2024-09-11T22:13:39.302296+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304411+0000","last_change":"2024-09-11T22:13:40.325041+0000","last_active":"2024-09-11T22:13:41.304411+0000","last_peered":"2024-09-11T22:13:41.304411+0000","last_clean":"2024-09-11T22:13:41.304411+0000","last_became_active":"2024-09-11T22:13:40.324467+0000","last_became_peered":"2024-09-11T22:13:40.324467+0000","last_unstale":"2024-09-11T22:13:41.304411+0000","last_undegraded":"2024-09-11T22:13:41.304411+0000","last_fullsized":"2024-09-11T22:13:41.304411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:50.478469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304800+0000","last_change":"2024-09-11T22:13:39.304800+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304800+0000","last_undegraded":"2024-09-11T22:13:39.304800+0000","last_fullsized":"2024-09-11T22:13:39.304800+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299865+0000","last_change":"2024-09-11T22:13:39.299865+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299865+0000","last_undegraded":"2024-09-11T22:13:39.299865+0000","last_fullsized":"2024-09-11T22:13:39.299865+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.303267+0000","last_change":"2024-09-11T22:13:39.303267+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.303267+0000","last_undegraded":"2024-09-11T22:13:39.303267+0000","last_fullsized":"2024-09-11T22:13:39.303267+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300814+0000","last_change":"2024-09-11T22:13:39.300814+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300814+0000","last_undegraded":"2024-09-11T22:13:39.300814+0000","last_fullsized":"2024-09-11T22:13:39.300814+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.303234+0000","last_change":"2024-09-11T22:13:39.303234+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.303234+0000","last_undegraded":"2024-09-11T22:13:39.303234+0000","last_fullsized":"2024-09-11T22:13:39.303234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304434+0000","last_change":"2024-09-11T22:13:40.318761+0000","last_active":"2024-09-11T22:13:41.304434+0000","last_peered":"2024-09-11T22:13:41.304434+0000","last_clean":"2024-09-11T22:13:41.304434+0000","last_became_active":"2024-09-11T22:13:40.318451+0000","last_became_peered":"2024-09-11T22:13:40.318451+0000","last_unstale":"2024-09-11T22:13:41.304434+0000","last_undegraded":"2024-09-11T22:13:41.304434+0000","last_fullsized":"2024-09-11T22:13:41.304434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:28.473773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.295770+0000","last_change":"2024-09-11T22:13:39.295770+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.295770+0000","last_undegraded":"2024-09-11T22:13:39.295770+0000","last_fullsized":"2024-09-11T22:13:39.295770+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297918+0000","last_change":"2024-09-11T22:13:39.297918+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297918+0000","last_undegraded":"2024-09-11T22:13:39.297918+0000","last_fullsized":"2024-09-11T22:13:39.297918+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.301466+0000","last_change":"2024-09-11T22:13:39.301466+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.301466+0000","last_undegraded":"2024-09-11T22:13:39.301466+0000","last_fullsized":"2024-09-11T22:13:39.301466+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298188+0000","last_change":"2024-09-11T22:13:39.298188+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298188+0000","last_undegraded":"2024-09-11T22:13:39.298188+0000","last_fullsized":"2024-09-11T22:13:39.298188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.303924+0000","last_change":"2024-09-11T22:13:39.303924+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.303924+0000","last_undegraded":"2024-09-11T22:13:39.303924+0000","last_fullsized":"2024-09-11T22:13:39.303924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304147+0000","last_change":"2024-09-11T22:13:40.303372+0000","last_active":"2024-09-11T22:13:41.304147+0000","last_peered":"2024-09-11T22:13:41.304147+0000","last_clean":"2024-09-11T22:13:41.304147+0000","last_became_active":"2024-09-11T22:13:40.303042+0000","last_became_peered":"2024-09-11T22:13:40.303042+0000","last_unstale":"2024-09-11T22:13:41.304147+0000","last_undegraded":"2024-09-11T22:13:41.304147+0000","last_fullsized":"2024-09-11T22:13:41.304147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:50.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298295+0000","last_change":"2024-09-11T22:13:39.298295+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298295+0000","last_undegraded":"2024-09-11T22:13:39.298295+0000","last_fullsized":"2024-09-11T22:13:39.298295+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.314585+0000","last_change":"2024-09-11T22:13:39.312323+0000","last_active":"2024-09-11T22:13:39.314585+0000","last_peered":"2024-09-11T22:13:39.314585+0000","last_clean":"2024-09-11T22:13:39.314585+0000","last_became_active":"2024-09-11T22:13:39.312023+0000","last_became_peered":"2024-09-11T22:13:39.312023+0000","last_unstale":"2024-09-11T22:13:39.314585+0000","last_undegraded":"2024-09-11T22:13:39.314585+0000","last_fullsized":"2024-09-11T22:13:39.314585+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:00.434604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304897+0000","last_change":"2024-09-11T22:13:39.304897+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304897+0000","last_undegraded":"2024-09-11T22:13:39.304897+0000","last_fullsized":"2024-09-11T22:13:39.304897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.310731+0000","last_change":"2024-09-11T22:13:39.307957+0000","last_active":"2024-09-11T22:13:39.310731+0000","last_peered":"2024-09-11T22:13:39.310731+0000","last_clean":"2024-09-11T22:13:39.310731+0000","last_became_active":"2024-09-11T22:13:39.307664+0000","last_became_peered":"2024-09-11T22:13:39.307664+0000","last_unstale":"2024-09-11T22:13:39.310731+0000","last_undegraded":"2024-09-11T22:13:39.310731+0000","last_fullsized":"2024-09-11T22:13:39.310731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:32.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297411+0000","last_change":"2024-09-11T22:13:39.297411+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297411+0000","last_undegraded":"2024-09-11T22:13:39.297411+0000","last_fullsized":"2024-09-11T22:13:39.297411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.307852+0000","last_change":"2024-09-11T22:13:39.306671+0000","last_active":"2024-09-11T22:13:39.307852+0000","last_peered":"2024-09-11T22:13:39.307852+0000","last_clean":"2024-09-11T22:13:39.307852+0000","last_became_active":"2024-09-11T22:13:39.305428+0000","last_became_peered":"2024-09-11T22:13:39.305428+0000","last_unstale":"2024-09-11T22:13:39.307852+0000","last_undegraded":"2024-09-11T22:13:39.307852+0000","last_fullsized":"2024-09-11T22:13:39.307852+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:09.534964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298315+0000","last_change":"2024-09-11T22:13:39.298315+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298315+0000","last_undegraded":"2024-09-11T22:13:39.298315+0000","last_fullsized":"2024-09-11T22:13:39.298315+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785107+0000","last_change":"2024-09-11T22:13:39.306928+0000","last_active":"2024-09-11T22:13:41.785107+0000","last_peered":"2024-09-11T22:13:41.785107+0000","last_clean":"2024-09-11T22:13:41.785107+0000","last_became_active":"2024-09-11T22:13:39.306644+0000","last_became_peered":"2024-09-11T22:13:39.306644+0000","last_unstale":"2024-09-11T22:13:41.785107+0000","last_undegraded":"2024-09-11T22:13:41.785107+0000","last_fullsized":"2024-09-11T22:13:41.785107+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:38.578419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297439+0000","last_change":"2024-09-11T22:13:39.297439+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297439+0000","last_undegraded":"2024-09-11T22:13:39.297439+0000","last_fullsized":"2024-09-11T22:13:39.297439+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313899+0000","last_change":"2024-09-11T22:13:39.312090+0000","last_active":"2024-09-11T22:13:39.313899+0000","last_peered":"2024-09-11T22:13:39.313899+0000","last_clean":"2024-09-11T22:13:39.313899+0000","last_became_active":"2024-09-11T22:13:39.311481+0000","last_became_peered":"2024-09-11T22:13:39.311481+0000","last_unstale":"2024-09-11T22:13:39.313899+0000","last_undegraded":"2024-09-11T22:13:39.313899+0000","last_fullsized":"2024-09-11T22:13:39.313899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:37.846188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.301271+0000","last_change":"2024-09-11T22:13:39.301271+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.301271+0000","last_undegraded":"2024-09-11T22:13:39.301271+0000","last_fullsized":"2024-09-11T22:13:39.301271+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.306124+0000","last_change":"2024-09-11T22:13:39.303131+0000","last_active":"2024-09-11T22:13:39.306124+0000","last_peered":"2024-09-11T22:13:39.306124+0000","last_clean":"2024-09-11T22:13:39.306124+0000","last_became_active":"2024-09-11T22:13:39.302818+0000","last_became_peered":"2024-09-11T22:13:39.302818+0000","last_unstale":"2024-09-11T22:13:39.306124+0000","last_undegraded":"2024-09-11T22:13:39.306124+0000","last_fullsized":"2024-09-11T22:13:39.306124+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:10.642997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298718+0000","last_change":"2024-09-11T22:13:39.298718+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298718+0000","last_undegraded":"2024-09-11T22:13:39.298718+0000","last_fullsized":"2024-09-11T22:13:39.298718+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.304150+0000","last_change":"2024-09-11T22:13:39.300952+0000","last_active":"2024-09-11T22:13:39.304150+0000","last_peered":"2024-09-11T22:13:39.304150+0000","last_clean":"2024-09-11T22:13:39.304150+0000","last_became_active":"2024-09-11T22:13:39.300653+0000","last_became_peered":"2024-09-11T22:13:39.300653+0000","last_unstale":"2024-09-11T22:13:39.304150+0000","last_undegraded":"2024-09-11T22:13:39.304150+0000","last_fullsized":"2024-09-11T22:13:39.304150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:00.154645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.305012+0000","last_change":"2024-09-11T22:13:39.305012+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.305012+0000","last_undegraded":"2024-09-11T22:13:39.305012+0000","last_fullsized":"2024-09-11T22:13:39.305012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.310965+0000","last_change":"2024-09-11T22:13:39.303791+0000","last_active":"2024-09-11T22:13:39.310965+0000","last_peered":"2024-09-11T22:13:39.310965+0000","last_clean":"2024-09-11T22:13:39.310965+0000","last_became_active":"2024-09-11T22:13:39.303375+0000","last_became_peered":"2024-09-11T22:13:39.303375+0000","last_unstale":"2024-09-11T22:13:39.310965+0000","last_undegraded":"2024-09-11T22:13:39.310965+0000","last_fullsized":"2024-09-11T22:13:39.310965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:37.936462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.296932+0000","last_change":"2024-09-11T22:13:39.296932+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.296932+0000","last_undegraded":"2024-09-11T22:13:39.296932+0000","last_fullsized":"2024-09-11T22:13:39.296932+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.312743+0000","last_change":"2024-09-11T22:13:39.310133+0000","last_active":"2024-09-11T22:13:39.312743+0000","last_peered":"2024-09-11T22:13:39.312743+0000","last_clean":"2024-09-11T22:13:39.312743+0000","last_became_active":"2024-09-11T22:13:39.309863+0000","last_became_peered":"2024-09-11T22:13:39.309863+0000","last_unstale":"2024-09-11T22:13:39.312743+0000","last_undegraded":"2024-09-11T22:13:39.312743+0000","last_fullsized":"2024-09-11T22:13:39.312743+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:09.534964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785173+0000","last_change":"2024-09-11T22:13:40.310838+0000","last_active":"2024-09-11T22:13:41.785173+0000","last_peered":"2024-09-11T22:13:41.785173+0000","last_clean":"2024-09-11T22:13:41.785173+0000","last_became_active":"2024-09-11T22:13:40.310520+0000","last_became_peered":"2024-09-11T22:13:40.310520+0000","last_unstale":"2024-09-11T22:13:41.785173+0000","last_undegraded":"2024-09-11T22:13:41.785173+0000","last_fullsized":"2024-09-11T22:13:41.785173+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:02.177660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.312883+0000","last_change":"2024-09-11T22:13:39.310075+0000","last_active":"2024-09-11T22:13:39.312883+0000","last_peered":"2024-09-11T22:13:39.312883+0000","last_clean":"2024-09-11T22:13:39.312883+0000","last_became_active":"2024-09-11T22:13:39.309660+0000","last_became_peered":"2024-09-11T22:13:39.309660+0000","last_unstale":"2024-09-11T22:13:39.312883+0000","last_undegraded":"2024-09-11T22:13:39.312883+0000","last_fullsized":"2024-09-11T22:13:39.312883+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:25.430685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.307094+0000","last_change":"2024-09-11T22:13:39.307094+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.307094+0000","last_undegraded":"2024-09-11T22:13:39.307094+0000","last_fullsized":"2024-09-11T22:13:39.307094+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784958+0000","last_change":"2024-09-11T22:13:39.310563+0000","last_active":"2024-09-11T22:13:41.784958+0000","last_peered":"2024-09-11T22:13:41.784958+0000","last_clean":"2024-09-11T22:13:41.784958+0000","last_became_active":"2024-09-11T22:13:39.310308+0000","last_became_peered":"2024-09-11T22:13:39.310308+0000","last_unstale":"2024-09-11T22:13:41.784958+0000","last_undegraded":"2024-09-11T22:13:41.784958+0000","last_fullsized":"2024-09-11T22:13:41.784958+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:44.471766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784988+0000","last_change":"2024-09-11T22:13:40.314486+0000","last_active":"2024-09-11T22:13:41.784988+0000","last_peered":"2024-09-11T22:13:41.784988+0000","last_clean":"2024-09-11T22:13:41.784988+0000","last_became_active":"2024-09-11T22:13:40.313645+0000","last_became_peered":"2024-09-11T22:13:40.313645+0000","last_unstale":"2024-09-11T22:13:41.784988+0000","last_undegraded":"2024-09-11T22:13:41.784988+0000","last_fullsized":"2024-09-11T22:13:41.784988+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:30.358742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304403+0000","last_change":"2024-09-11T22:13:39.303367+0000","last_active":"2024-09-11T22:13:41.304403+0000","last_peered":"2024-09-11T22:13:41.304403+0000","last_clean":"2024-09-11T22:13:41.304403+0000","last_became_active":"2024-09-11T22:13:39.302860+0000","last_became_peered":"2024-09-11T22:13:39.302860+0000","last_unstale":"2024-09-11T22:13:41.304403+0000","last_undegraded":"2024-09-11T22:13:41.304403+0000","last_fullsized":"2024-09-11T22:13:41.304403+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:48.672367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302420+0000","last_change":"2024-09-11T22:13:39.302420+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302420+0000","last_undegraded":"2024-09-11T22:13:39.302420+0000","last_fullsized":"2024-09-11T22:13:39.302420+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313434+0000","last_change":"2024-09-11T22:13:39.311084+0000","last_active":"2024-09-11T22:13:39.313434+0000","last_peered":"2024-09-11T22:13:39.313434+0000","last_clean":"2024-09-11T22:13:39.313434+0000","last_became_active":"2024-09-11T22:13:39.310795+0000","last_became_peered":"2024-09-11T22:13:39.310795+0000","last_unstale":"2024-09-11T22:13:39.313434+0000","last_undegraded":"2024-09-11T22:13:39.313434+0000","last_fullsized":"2024-09-11T22:13:39.313434+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:00.780320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300848+0000","last_change":"2024-09-11T22:13:39.300848+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300848+0000","last_undegraded":"2024-09-11T22:13:39.300848+0000","last_fullsized":"2024-09-11T22:13:39.300848+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784893+0000","last_change":"2024-09-11T22:13:39.312568+0000","last_active":"2024-09-11T22:13:41.784893+0000","last_peered":"2024-09-11T22:13:41.784893+0000","last_clean":"2024-09-11T22:13:41.784893+0000","last_became_active":"2024-09-11T22:13:39.312266+0000","last_became_peered":"2024-09-11T22:13:39.312266+0000","last_unstale":"2024-09-11T22:13:41.784893+0000","last_undegraded":"2024-09-11T22:13:41.784893+0000","last_fullsized":"2024-09-11T22:13:41.784893+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:52.535028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.307436+0000","last_change":"2024-09-11T22:13:39.307436+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.307436+0000","last_undegraded":"2024-09-11T22:13:39.307436+0000","last_fullsized":"2024-09-11T22:13:39.307436+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313499+0000","last_change":"2024-09-11T22:13:39.311107+0000","last_active":"2024-09-11T22:13:39.313499+0000","last_peered":"2024-09-11T22:13:39.313499+0000","last_clean":"2024-09-11T22:13:39.313499+0000","last_became_active":"2024-09-11T22:13:39.310839+0000","last_became_peered":"2024-09-11T22:13:39.310839+0000","last_unstale":"2024-09-11T22:13:39.313499+0000","last_undegraded":"2024-09-11T22:13:39.313499+0000","last_fullsized":"2024-09-11T22:13:39.313499+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:40.089668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785227+0000","last_change":"2024-09-11T22:13:40.312864+0000","last_active":"2024-09-11T22:13:41.785227+0000","last_peered":"2024-09-11T22:13:41.785227+0000","last_clean":"2024-09-11T22:13:41.785227+0000","last_became_active":"2024-09-11T22:13:40.312064+0000","last_became_peered":"2024-09-11T22:13:40.312064+0000","last_unstale":"2024-09-11T22:13:41.785227+0000","last_undegraded":"2024-09-11T22:13:41.785227+0000","last_fullsized":"2024-09-11T22:13:41.785227+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:52.317665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.310987+0000","last_change":"2024-09-11T22:13:39.305593+0000","last_active":"2024-09-11T22:13:39.310987+0000","last_peered":"2024-09-11T22:13:39.310987+0000","last_clean":"2024-09-11T22:13:39.310987+0000","last_became_active":"2024-09-11T22:13:39.305310+0000","last_became_peered":"2024-09-11T22:13:39.305310+0000","last_unstale":"2024-09-11T22:13:39.310987+0000","last_undegraded":"2024-09-11T22:13:39.310987+0000","last_fullsized":"2024-09-11T22:13:39.310987+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:40:02.722992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304434+0000","last_change":"2024-09-11T22:13:40.301662+0000","last_active":"2024-09-11T22:13:41.304434+0000","last_peered":"2024-09-11T22:13:41.304434+0000","last_clean":"2024-09-11T22:13:41.304434+0000","last_became_active":"2024-09-11T22:13:40.300969+0000","last_became_peered":"2024-09-11T22:13:40.300969+0000","last_unstale":"2024-09-11T22:13:41.304434+0000","last_undegraded":"2024-09-11T22:13:41.304434+0000","last_fullsized":"2024-09-11T22:13:41.304434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:10.319903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304471+0000","last_change":"2024-09-11T22:13:39.315068+0000","last_active":"2024-09-11T22:13:41.304471+0000","last_peered":"2024-09-11T22:13:41.304471+0000","last_clean":"2024-09-11T22:13:41.304471+0000","last_became_active":"2024-09-11T22:13:39.314741+0000","last_became_peered":"2024-09-11T22:13:39.314741+0000","last_unstale":"2024-09-11T22:13:41.304471+0000","last_undegraded":"2024-09-11T22:13:41.304471+0000","last_fullsized":"2024-09-11T22:13:41.304471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:49.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299015+0000","last_change":"2024-09-11T22:13:39.299015+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299015+0000","last_undegraded":"2024-09-11T22:13:39.299015+0000","last_fullsized":"2024-09-11T22:13:39.299015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.306006+0000","last_change":"2024-09-11T22:13:39.301654+0000","last_active":"2024-09-11T22:13:39.306006+0000","last_peered":"2024-09-11T22:13:39.306006+0000","last_clean":"2024-09-11T22:13:39.306006+0000","last_became_active":"2024-09-11T22:13:39.301361+0000","last_became_peered":"2024-09-11T22:13:39.301361+0000","last_unstale":"2024-09-11T22:13:39.306006+0000","last_undegraded":"2024-09-11T22:13:39.306006+0000","last_fullsized":"2024-09-11T22:13:39.306006+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:36.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.301027+0000","last_change":"2024-09-11T22:13:39.301027+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.301027+0000","last_undegraded":"2024-09-11T22:13:39.301027+0000","last_fullsized":"2024-09-11T22:13:39.301027+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.306177+0000","last_change":"2024-09-11T22:13:39.301699+0000","last_active":"2024-09-11T22:13:39.306177+0000","last_peered":"2024-09-11T22:13:39.306177+0000","last_clean":"2024-09-11T22:13:39.306177+0000","last_became_active":"2024-09-11T22:13:39.301425+0000","last_became_peered":"2024-09-11T22:13:39.301425+0000","last_unstale":"2024-09-11T22:13:39.306177+0000","last_undegraded":"2024-09-11T22:13:39.306177+0000","last_fullsized":"2024-09-11T22:13:39.306177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:59.541599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302985+0000","last_change":"2024-09-11T22:13:39.302985+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302985+0000","last_undegraded":"2024-09-11T22:13:39.302985+0000","last_fullsized":"2024-09-11T22:13:39.302985+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.315464+0000","last_change":"2024-09-11T22:13:39.313695+0000","last_active":"2024-09-11T22:13:39.315464+0000","last_peered":"2024-09-11T22:13:39.315464+0000","last_clean":"2024-09-11T22:13:39.315464+0000","last_became_active":"2024-09-11T22:13:39.313451+0000","last_became_peered":"2024-09-11T22:13:39.313451+0000","last_unstale":"2024-09-11T22:13:39.315464+0000","last_undegraded":"2024-09-11T22:13:39.315464+0000","last_fullsized":"2024-09-11T22:13:39.315464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:04.530461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302832+0000","last_change":"2024-09-11T22:13:39.302832+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302832+0000","last_undegraded":"2024-09-11T22:13:39.302832+0000","last_fullsized":"2024-09-11T22:13:39.302832+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313179+0000","last_change":"2024-09-11T22:13:39.310453+0000","last_active":"2024-09-11T22:13:39.313179+0000","last_peered":"2024-09-11T22:13:39.313179+0000","last_clean":"2024-09-11T22:13:39.313179+0000","last_became_active":"2024-09-11T22:13:39.310186+0000","last_became_peered":"2024-09-11T22:13:39.310186+0000","last_unstale":"2024-09-11T22:13:39.313179+0000","last_undegraded":"2024-09-11T22:13:39.313179+0000","last_fullsized":"2024-09-11T22:13:39.313179+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:59.541599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297711+0000","last_change":"2024-09-11T22:13:39.297711+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297711+0000","last_undegraded":"2024-09-11T22:13:39.297711+0000","last_fullsized":"2024-09-11T22:13:39.297711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.309772+0000","last_change":"2024-09-11T22:13:39.308391+0000","last_active":"2024-09-11T22:13:39.309772+0000","last_peered":"2024-09-11T22:13:39.309772+0000","last_clean":"2024-09-11T22:13:39.309772+0000","last_became_active":"2024-09-11T22:13:39.307774+0000","last_became_peered":"2024-09-11T22:13:39.307774+0000","last_unstale":"2024-09-11T22:13:39.309772+0000","last_undegraded":"2024-09-11T22:13:39.309772+0000","last_fullsized":"2024-09-11T22:13:39.309772+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:00.780320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304123+0000","last_change":"2024-09-11T22:13:40.319478+0000","last_active":"2024-09-11T22:13:41.304123+0000","last_peered":"2024-09-11T22:13:41.304123+0000","last_clean":"2024-09-11T22:13:41.304123+0000","last_became_active":"2024-09-11T22:13:40.319188+0000","last_became_peered":"2024-09-11T22:13:40.319188+0000","last_unstale":"2024-09-11T22:13:41.304123+0000","last_undegraded":"2024-09-11T22:13:41.304123+0000","last_fullsized":"2024-09-11T22:13:41.304123+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:14:31.828880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.314263+0000","last_change":"2024-09-11T22:13:39.310780+0000","last_active":"2024-09-11T22:13:39.314263+0000","last_peered":"2024-09-11T22:13:39.314263+0000","last_clean":"2024-09-11T22:13:39.314263+0000","last_became_active":"2024-09-11T22:13:39.310504+0000","last_became_peered":"2024-09-11T22:13:39.310504+0000","last_unstale":"2024-09-11T22:13:39.314263+0000","last_undegraded":"2024-09-11T22:13:39.314263+0000","last_fullsized":"2024-09-11T22:13:39.314263+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:54.307397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299655+0000","last_change":"2024-09-11T22:13:39.299655+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299655+0000","last_undegraded":"2024-09-11T22:13:39.299655+0000","last_fullsized":"2024-09-11T22:13:39.299655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785081+0000","last_change":"2024-09-11T22:13:39.312641+0000","last_active":"2024-09-11T22:13:41.785081+0000","last_peered":"2024-09-11T22:13:41.785081+0000","last_clean":"2024-09-11T22:13:41.785081+0000","last_became_active":"2024-09-11T22:13:39.312308+0000","last_became_peered":"2024-09-11T22:13:39.312308+0000","last_unstale":"2024-09-11T22:13:41.785081+0000","last_undegraded":"2024-09-11T22:13:41.785081+0000","last_fullsized":"2024-09-11T22:13:41.785081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:56.314599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304128+0000","last_change":"2024-09-11T22:13:39.304128+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304128+0000","last_undegraded":"2024-09-11T22:13:39.304128+0000","last_fullsized":"2024-09-11T22:13:39.304128+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.315517+0000","last_change":"2024-09-11T22:13:39.313694+0000","last_active":"2024-09-11T22:13:39.315517+0000","last_peered":"2024-09-11T22:13:39.315517+0000","last_clean":"2024-09-11T22:13:39.315517+0000","last_became_active":"2024-09-11T22:13:39.312332+0000","last_became_peered":"2024-09-11T22:13:39.312332+0000","last_unstale":"2024-09-11T22:13:39.315517+0000","last_undegraded":"2024-09-11T22:13:39.315517+0000","last_fullsized":"2024-09-11T22:13:39.315517+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:24.994673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298863+0000","last_change":"2024-09-11T22:13:39.298863+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298863+0000","last_undegraded":"2024-09-11T22:13:39.298863+0000","last_fullsized":"2024-09-11T22:13:39.298863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785072+0000","last_change":"2024-09-11T22:13:39.310708+0000","last_active":"2024-09-11T22:13:41.785072+0000","last_peered":"2024-09-11T22:13:41.785072+0000","last_clean":"2024-09-11T22:13:41.785072+0000","last_became_active":"2024-09-11T22:13:39.310463+0000","last_became_peered":"2024-09-11T22:13:39.310463+0000","last_unstale":"2024-09-11T22:13:41.785072+0000","last_undegraded":"2024-09-11T22:13:41.785072+0000","last_fullsized":"2024-09-11T22:13:41.785072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:51.589071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784826+0000","last_change":"2024-09-11T22:13:40.318581+0000","last_active":"2024-09-11T22:13:41.784826+0000","last_peered":"2024-09-11T22:13:41.784826+0000","last_clean":"2024-09-11T22:13:41.784826+0000","last_became_active":"2024-09-11T22:13:40.318311+0000","last_became_peered":"2024-09-11T22:13:40.318311+0000","last_unstale":"2024-09-11T22:13:41.784826+0000","last_undegraded":"2024-09-11T22:13:41.784826+0000","last_fullsized":"2024-09-11T22:13:41.784826+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:33.291942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.305898+0000","last_change":"2024-09-11T22:13:39.303899+0000","last_active":"2024-09-11T22:13:39.305898+0000","last_peered":"2024-09-11T22:13:39.305898+0000","last_clean":"2024-09-11T22:13:39.305898+0000","last_became_active":"2024-09-11T22:13:39.303546+0000","last_became_peered":"2024-09-11T22:13:39.303546+0000","last_unstale":"2024-09-11T22:13:39.305898+0000","last_undegraded":"2024-09-11T22:13:39.305898+0000","last_fullsized":"2024-09-11T22:13:39.305898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:32.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302364+0000","last_change":"2024-09-11T22:13:39.302364+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302364+0000","last_undegraded":"2024-09-11T22:13:39.302364+0000","last_fullsized":"2024-09-11T22:13:39.302364+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785042+0000","last_change":"2024-09-11T22:13:39.308982+0000","last_active":"2024-09-11T22:13:41.785042+0000","last_peered":"2024-09-11T22:13:41.785042+0000","last_clean":"2024-09-11T22:13:41.785042+0000","last_became_active":"2024-09-11T22:13:39.308701+0000","last_became_peered":"2024-09-11T22:13:39.308701+0000","last_unstale":"2024-09-11T22:13:41.785042+0000","last_undegraded":"2024-09-11T22:13:41.785042+0000","last_fullsized":"2024-09-11T22:13:41.785042+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:24.944146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304322+0000","last_change":"2024-09-11T22:13:39.304322+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304322+0000","last_undegraded":"2024-09-11T22:13:39.304322+0000","last_fullsized":"2024-09-11T22:13:39.304322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.310345+0000","last_change":"2024-09-11T22:13:39.307907+0000","last_active":"2024-09-11T22:13:39.310345+0000","last_peered":"2024-09-11T22:13:39.310345+0000","last_clean":"2024-09-11T22:13:39.310345+0000","last_became_active":"2024-09-11T22:13:39.307599+0000","last_became_peered":"2024-09-11T22:13:39.307599+0000","last_unstale":"2024-09-11T22:13:39.310345+0000","last_undegraded":"2024-09-11T22:13:39.310345+0000","last_fullsized":"2024-09-11T22:13:39.310345+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:34.308981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.295581+0000","last_change":"2024-09-11T22:13:39.295581+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.295581+0000","last_undegraded":"2024-09-11T22:13:39.295581+0000","last_fullsized":"2024-09-11T22:13:39.295581+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313276+0000","last_change":"2024-09-11T22:13:39.312580+0000","last_active":"2024-09-11T22:13:39.313276+0000","last_peered":"2024-09-11T22:13:39.313276+0000","last_clean":"2024-09-11T22:13:39.313276+0000","last_became_active":"2024-09-11T22:13:39.312239+0000","last_became_peered":"2024-09-11T22:13:39.312239+0000","last_unstale":"2024-09-11T22:13:39.313276+0000","last_undegraded":"2024-09-11T22:13:39.313276+0000","last_fullsized":"2024-09-11T22:13:39.313276+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:24.275744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.296248+0000","last_change":"2024-09-11T22:13:39.296248+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.296248+0000","last_undegraded":"2024-09-11T22:13:39.296248+0000","last_fullsized":"2024-09-11T22:13:39.296248+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.312310+0000","last_change":"2024-09-11T22:13:39.310777+0000","last_active":"2024-09-11T22:13:39.312310+0000","last_peered":"2024-09-11T22:13:39.312310+0000","last_clean":"2024-09-11T22:13:39.312310+0000","last_became_active":"2024-09-11T22:13:39.310498+0000","last_became_peered":"2024-09-11T22:13:39.310498+0000","last_unstale":"2024-09-11T22:13:39.312310+0000","last_undegraded":"2024-09-11T22:13:39.312310+0000","last_fullsized":"2024-09-11T22:13:39.312310+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299434+0000","last_change":"2024-09-11T22:13:39.299434+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299434+0000","last_undegraded":"2024-09-11T22:13:39.299434+0000","last_fullsized":"2024-09-11T22:13:39.299434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.315210+0000","last_change":"2024-09-11T22:13:39.310021+0000","last_active":"2024-09-11T22:13:39.315210+0000","last_peered":"2024-09-11T22:13:39.315210+0000","last_clean":"2024-09-11T22:13:39.315210+0000","last_became_active":"2024-09-11T22:13:39.309718+0000","last_became_peered":"2024-09-11T22:13:39.309718+0000","last_unstale":"2024-09-11T22:13:39.315210+0000","last_undegraded":"2024-09-11T22:13:39.315210+0000","last_fullsized":"2024-09-11T22:13:39.315210+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:40.089668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":213,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785129+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:13:41.785129+0000","last_peered":"2024-09-11T22:13:41.785129+0000","last_clean":"2024-09-11T22:13:41.785129+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:13:41.785129+0000","last_undegraded":"2024-09-11T22:13:41.785129+0000","last_fullsized":"2024-09-11T22:13:41.785129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1724,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35832,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336008,"statfs":{"total":96636764160,"available":96600072192,"internally_reserved":0,"allocated":495616,"data_stored":198405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35820,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":483328,"data_stored":192138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35820,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":483328,"data_stored":192138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":483328,"data_stored":192138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44156,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327684,"statfs":{"total":96636764160,"available":96591548416,"internally_reserved":0,"allocated":495616,"data_stored":198405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36400,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335440,"statfs":{"total":96636764160,"available":96599490560,"internally_reserved":0,"allocated":1077248,"data_stored":782506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36436,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335404,"statfs":{"total":96636764160,"available":96599453696,"internally_reserved":0,"allocated":1105920,"data_stored":795638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":524288,"data_stored":206814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:13:44.294 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:13:44.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.431+0000 7f4f4d95f640 1 Processor -- start 2024-09-11T22:13:44.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.431+0000 7f4f4d95f640 1 -- start start 2024-09-11T22:13:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f4d95f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4f4815e8e0 0x7f4f480b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f4d95f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f480d1580 0x7f4f480d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f4d95f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f480d1ee0 con 0x7f4f48162350 2024-09-11T22:13:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f4d95f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4f4815ecc0 con 0x7f4f480d1580 2024-09-11T22:13:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f4d95f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4f480d2ad0 con 0x7f4f4815e8e0 2024-09-11T22:13:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f467fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f480d1580 0x7f4f480d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f467fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f480d1580 0x7f4f480d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35422/0 (socket says 172.21.15.50:35422) 2024-09-11T22:13:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f467fc640 1 -- 172.21.15.50:0/1992088416 learned_addr learned my addr 172.21.15.50:0/1992088416 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:44.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f467fc640 1 -- 172.21.15.50:0/1992088416 >> v2:172.21.15.77:3300/0 conn(0x7f4f4815e8e0 msgr2=0x7f4f480b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f467fc640 1 --2- 172.21.15.50:0/1992088416 >> v2:172.21.15.77:3300/0 conn(0x7f4f4815e8e0 0x7f4f480b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f467fc640 1 -- 172.21.15.50:0/1992088416 >> v1:172.21.15.77:6789/0 conn(0x7f4f48162350 legacy=0x7f4f481627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f467fc640 1 -- 172.21.15.50:0/1992088416 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f48163080 con 0x7f4f480d1580 2024-09-11T22:13:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f467fc640 1 --2- 172.21.15.50:0/1992088416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f480d1580 0x7f4f480d19a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4f4808d630 tx=0x7f4f3002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c666e85b02a9174e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f45ffb640 1 -- 172.21.15.50:0/1992088416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f30037070 con 0x7f4f480d1580 2024-09-11T22:13:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f45ffb640 1 -- 172.21.15.50:0/1992088416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f30032440 con 0x7f4f480d1580 2024-09-11T22:13:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.433+0000 7f4f45ffb640 1 -- 172.21.15.50:0/1992088416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f30032810 con 0x7f4f480d1580 2024-09-11T22:13:44.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.434+0000 7f4f4d95f640 1 -- 172.21.15.50:0/1992088416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f480d1580 msgr2=0x7f4f480d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.434+0000 7f4f4d95f640 1 --2- 172.21.15.50:0/1992088416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f480d1580 0x7f4f480d19a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4f4808d630 tx=0x7f4f3002a2c0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.434+0000 7f4f4d95f640 1 -- 172.21.15.50:0/1992088416 shutdown_connections 2024-09-11T22:13:44.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.434+0000 7f4f4d95f640 1 --2- 172.21.15.50:0/1992088416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f480d1580 0x7f4f480d19a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.434+0000 7f4f4d95f640 1 --2- 172.21.15.50:0/1992088416 >> v2:172.21.15.77:3300/0 conn(0x7f4f4815e8e0 0x7f4f480b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.434+0000 7f4f4d95f640 1 -- 172.21.15.50:0/1992088416 >> 172.21.15.50:0/1992088416 conn(0x7f4f48067ba0 msgr2=0x7f4f48067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.434+0000 7f4f4d95f640 1 -- 172.21.15.50:0/1992088416 shutdown_connections 2024-09-11T22:13:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.434+0000 7f4f4d95f640 1 -- 172.21.15.50:0/1992088416 wait complete. 2024-09-11T22:13:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.435+0000 7f4f4d95f640 1 Processor -- start 2024-09-11T22:13:44.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.435+0000 7f4f4d95f640 1 -- start start 2024-09-11T22:13:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f4d95f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f480d1580 0x7f4f481f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f4d95f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f4815e8e0 0x7f4f4814ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f4d95f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f48162350 0x7f4f480ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f4d95f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4f480d3000 con 0x7f4f4815e8e0 2024-09-11T22:13:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f4d95f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4f480d3370 con 0x7f4f480d1580 2024-09-11T22:13:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f4d95f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4f480d3800 con 0x7f4f48162350 2024-09-11T22:13:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f467fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f4815e8e0 0x7f4f4814ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f467fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f4815e8e0 0x7f4f4814ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35436/0 (socket says 172.21.15.50:35436) 2024-09-11T22:13:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f467fc640 1 -- 172.21.15.50:0/2364411371 learned_addr learned my addr 172.21.15.50:0/2364411371 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f467fc640 1 -- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f48162350 msgr2=0x7f4f480ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f467fc640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f48162350 0x7f4f480ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f46ffd640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f480d1580 0x7f4f481f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f467fc640 1 -- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f480d1580 msgr2=0x7f4f481f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f467fc640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f480d1580 0x7f4f481f4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.436+0000 7f4f467fc640 1 -- 172.21.15.50:0/2364411371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f480cbb60 con 0x7f4f4815e8e0 2024-09-11T22:13:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.437+0000 7f4f46ffd640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f480d1580 0x7f4f481f4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.437+0000 7f4f467fc640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f4815e8e0 0x7f4f4814ebc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4f30000c00 tx=0x7f4f300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.437+0000 7f4f3ffff640 1 -- 172.21.15.50:0/2364411371 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f30041070 con 0x7f4f4815e8e0 2024-09-11T22:13:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.437+0000 7f4f3ffff640 1 -- 172.21.15.50:0/2364411371 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f3003c870 con 0x7f4f4815e8e0 2024-09-11T22:13:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.437+0000 7f4f3ffff640 1 -- 172.21.15.50:0/2364411371 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f30037040 con 0x7f4f4815e8e0 2024-09-11T22:13:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.437+0000 7f4f4d95f640 1 -- 172.21.15.50:0/2364411371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4814f100 con 0x7f4f4815e8e0 2024-09-11T22:13:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.437+0000 7f4f4d95f640 1 -- 172.21.15.50:0/2364411371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f480b5600 con 0x7f4f4815e8e0 2024-09-11T22:13:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.438+0000 7f4f4d95f640 1 -- 172.21.15.50:0/2364411371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f480d19a0 con 0x7f4f4815e8e0 2024-09-11T22:13:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.438+0000 7f4f3ffff640 1 -- 172.21.15.50:0/2364411371 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f30044070 con 0x7f4f4815e8e0 2024-09-11T22:13:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.440+0000 7f4f3ffff640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4f2806be30 0x7f4f2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.440+0000 7f4f3ffff640 1 -- 172.21.15.50:0/2364411371 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4f300aba50 con 0x7f4f4815e8e0 2024-09-11T22:13:44.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.440+0000 7f4f46ffd640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4f2806be30 0x7f4f2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.440+0000 7f4f46ffd640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4f2806be30 0x7f4f2806e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4f38007eb0 tx=0x7f4f380073c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.444+0000 7f4f3ffff640 1 -- 172.21.15.50:0/2364411371 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f3007a5b0 con 0x7f4f4815e8e0 2024-09-11T22:13:44.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.614+0000 7f4f4d95f640 1 -- 172.21.15.50:0/2364411371 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4f480ba770 con 0x7f4f2806be30 2024-09-11T22:13:44.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.620+0000 7f4f3ffff640 1 -- 172.21.15.50:0/2364411371 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247661 (secure 0 0 0) 0x7f4f480ba770 con 0x7f4f2806be30 2024-09-11T22:13:44.624 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:44.626 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:13:44.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.623+0000 7f4f4d95f640 1 -- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4f2806be30 msgr2=0x7f4f2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.623+0000 7f4f4d95f640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4f2806be30 0x7f4f2806e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4f38007eb0 tx=0x7f4f380073c0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.623+0000 7f4f4d95f640 1 -- 172.21.15.50:0/2364411371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f4815e8e0 msgr2=0x7f4f4814ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.623+0000 7f4f4d95f640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f4815e8e0 0x7f4f4814ebc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4f30000c00 tx=0x7f4f300046c0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.623+0000 7f4f4d95f640 1 -- 172.21.15.50:0/2364411371 shutdown_connections 2024-09-11T22:13:44.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.623+0000 7f4f4d95f640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4f2806be30 0x7f4f2806e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.623+0000 7f4f4d95f640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f48162350 0x7f4f480ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.623+0000 7f4f4d95f640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f4815e8e0 0x7f4f4814ebc0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.623+0000 7f4f4d95f640 1 --2- 172.21.15.50:0/2364411371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f480d1580 0x7f4f481f4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.623+0000 7f4f4d95f640 1 -- 172.21.15.50:0/2364411371 >> 172.21.15.50:0/2364411371 conn(0x7f4f48067ba0 msgr2=0x7f4f480cb060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:44.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.623+0000 7f4f4d95f640 1 -- 172.21.15.50:0/2364411371 shutdown_connections 2024-09-11T22:13:44.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.623+0000 7f4f4d95f640 1 -- 172.21.15.50:0/2364411371 wait complete. 2024-09-11T22:13:44.636 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2024-09-11T22:13:43.397888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592092,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":173,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304472,"kb_used_data":5028,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754670248,"statfs":{"total":773094113280,"available":772782333952,"internally_reserved":0,"allocated":5148672,"data_stored":2758182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":306433585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1724,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.109942"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784907+0000","last_change":"2024-09-11T22:13:40.311514+0000","last_active":"2024-09-11T22:13:41.784907+0000","last_peered":"2024-09-11T22:13:41.784907+0000","last_clean":"2024-09-11T22:13:41.784907+0000","last_became_active":"2024-09-11T22:13:40.311230+0000","last_became_peered":"2024-09-11T22:13:40.311230+0000","last_unstale":"2024-09-11T22:13:41.784907+0000","last_undegraded":"2024-09-11T22:13:41.784907+0000","last_fullsized":"2024-09-11T22:13:41.784907+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:46.668580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297744+0000","last_change":"2024-09-11T22:13:39.297744+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297744+0000","last_undegraded":"2024-09-11T22:13:39.297744+0000","last_fullsized":"2024-09-11T22:13:39.297744+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.296494+0000","last_change":"2024-09-11T22:13:39.296494+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.296494+0000","last_undegraded":"2024-09-11T22:13:39.296494+0000","last_fullsized":"2024-09-11T22:13:39.296494+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300662+0000","last_change":"2024-09-11T22:13:39.300662+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300662+0000","last_undegraded":"2024-09-11T22:13:39.300662+0000","last_fullsized":"2024-09-11T22:13:39.300662+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297123+0000","last_change":"2024-09-11T22:13:39.297123+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297123+0000","last_undegraded":"2024-09-11T22:13:39.297123+0000","last_fullsized":"2024-09-11T22:13:39.297123+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.303442+0000","last_change":"2024-09-11T22:13:39.303442+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.303442+0000","last_undegraded":"2024-09-11T22:13:39.303442+0000","last_fullsized":"2024-09-11T22:13:39.303442+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785039+0000","last_change":"2024-09-11T22:13:40.311634+0000","last_active":"2024-09-11T22:13:41.785039+0000","last_peered":"2024-09-11T22:13:41.785039+0000","last_clean":"2024-09-11T22:13:41.785039+0000","last_became_active":"2024-09-11T22:13:40.311350+0000","last_became_peered":"2024-09-11T22:13:40.311350+0000","last_unstale":"2024-09-11T22:13:41.785039+0000","last_undegraded":"2024-09-11T22:13:41.785039+0000","last_fullsized":"2024-09-11T22:13:41.785039+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:54.495405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300619+0000","last_change":"2024-09-11T22:13:39.300619+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300619+0000","last_undegraded":"2024-09-11T22:13:39.300619+0000","last_fullsized":"2024-09-11T22:13:39.300619+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300820+0000","last_change":"2024-09-11T22:13:39.300820+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300820+0000","last_undegraded":"2024-09-11T22:13:39.300820+0000","last_fullsized":"2024-09-11T22:13:39.300820+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299878+0000","last_change":"2024-09-11T22:13:39.299878+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299878+0000","last_undegraded":"2024-09-11T22:13:39.299878+0000","last_fullsized":"2024-09-11T22:13:39.299878+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298724+0000","last_change":"2024-09-11T22:13:39.298724+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298724+0000","last_undegraded":"2024-09-11T22:13:39.298724+0000","last_fullsized":"2024-09-11T22:13:39.298724+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298357+0000","last_change":"2024-09-11T22:13:39.298357+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298357+0000","last_undegraded":"2024-09-11T22:13:39.298357+0000","last_fullsized":"2024-09-11T22:13:39.298357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304255+0000","last_change":"2024-09-11T22:13:40.319919+0000","last_active":"2024-09-11T22:13:41.304255+0000","last_peered":"2024-09-11T22:13:41.304255+0000","last_clean":"2024-09-11T22:13:41.304255+0000","last_became_active":"2024-09-11T22:13:40.319595+0000","last_became_peered":"2024-09-11T22:13:40.319595+0000","last_unstale":"2024-09-11T22:13:41.304255+0000","last_undegraded":"2024-09-11T22:13:41.304255+0000","last_fullsized":"2024-09-11T22:13:41.304255+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:01.306291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300326+0000","last_change":"2024-09-11T22:13:39.300326+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300326+0000","last_undegraded":"2024-09-11T22:13:39.300326+0000","last_fullsized":"2024-09-11T22:13:39.300326+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304400+0000","last_change":"2024-09-11T22:13:39.304400+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304400+0000","last_undegraded":"2024-09-11T22:13:39.304400+0000","last_fullsized":"2024-09-11T22:13:39.304400+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.301312+0000","last_change":"2024-09-11T22:13:39.301312+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.301312+0000","last_undegraded":"2024-09-11T22:13:39.301312+0000","last_fullsized":"2024-09-11T22:13:39.301312+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.296968+0000","last_change":"2024-09-11T22:13:39.296968+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.296968+0000","last_undegraded":"2024-09-11T22:13:39.296968+0000","last_fullsized":"2024-09-11T22:13:39.296968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297494+0000","last_change":"2024-09-11T22:13:39.297494+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297494+0000","last_undegraded":"2024-09-11T22:13:39.297494+0000","last_fullsized":"2024-09-11T22:13:39.297494+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302296+0000","last_change":"2024-09-11T22:13:39.302296+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302296+0000","last_undegraded":"2024-09-11T22:13:39.302296+0000","last_fullsized":"2024-09-11T22:13:39.302296+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304411+0000","last_change":"2024-09-11T22:13:40.325041+0000","last_active":"2024-09-11T22:13:41.304411+0000","last_peered":"2024-09-11T22:13:41.304411+0000","last_clean":"2024-09-11T22:13:41.304411+0000","last_became_active":"2024-09-11T22:13:40.324467+0000","last_became_peered":"2024-09-11T22:13:40.324467+0000","last_unstale":"2024-09-11T22:13:41.304411+0000","last_undegraded":"2024-09-11T22:13:41.304411+0000","last_fullsized":"2024-09-11T22:13:41.304411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:50.478469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304800+0000","last_change":"2024-09-11T22:13:39.304800+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304800+0000","last_undegraded":"2024-09-11T22:13:39.304800+0000","last_fullsized":"2024-09-11T22:13:39.304800+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299865+0000","last_change":"2024-09-11T22:13:39.299865+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299865+0000","last_undegraded":"2024-09-11T22:13:39.299865+0000","last_fullsized":"2024-09-11T22:13:39.299865+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.303267+0000","last_change":"2024-09-11T22:13:39.303267+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.303267+0000","last_undegraded":"2024-09-11T22:13:39.303267+0000","last_fullsized":"2024-09-11T22:13:39.303267+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300814+0000","last_change":"2024-09-11T22:13:39.300814+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300814+0000","last_undegraded":"2024-09-11T22:13:39.300814+0000","last_fullsized":"2024-09-11T22:13:39.300814+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.303234+0000","last_change":"2024-09-11T22:13:39.303234+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.303234+0000","last_undegraded":"2024-09-11T22:13:39.303234+0000","last_fullsized":"2024-09-11T22:13:39.303234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304434+0000","last_change":"2024-09-11T22:13:40.318761+0000","last_active":"2024-09-11T22:13:41.304434+0000","last_peered":"2024-09-11T22:13:41.304434+0000","last_clean":"2024-09-11T22:13:41.304434+0000","last_became_active":"2024-09-11T22:13:40.318451+0000","last_became_peered":"2024-09-11T22:13:40.318451+0000","last_unstale":"2024-09-11T22:13:41.304434+0000","last_undegraded":"2024-09-11T22:13:41.304434+0000","last_fullsized":"2024-09-11T22:13:41.304434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:28.473773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.295770+0000","last_change":"2024-09-11T22:13:39.295770+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.295770+0000","last_undegraded":"2024-09-11T22:13:39.295770+0000","last_fullsized":"2024-09-11T22:13:39.295770+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297918+0000","last_change":"2024-09-11T22:13:39.297918+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297918+0000","last_undegraded":"2024-09-11T22:13:39.297918+0000","last_fullsized":"2024-09-11T22:13:39.297918+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.301466+0000","last_change":"2024-09-11T22:13:39.301466+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.301466+0000","last_undegraded":"2024-09-11T22:13:39.301466+0000","last_fullsized":"2024-09-11T22:13:39.301466+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298188+0000","last_change":"2024-09-11T22:13:39.298188+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298188+0000","last_undegraded":"2024-09-11T22:13:39.298188+0000","last_fullsized":"2024-09-11T22:13:39.298188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.303924+0000","last_change":"2024-09-11T22:13:39.303924+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.303924+0000","last_undegraded":"2024-09-11T22:13:39.303924+0000","last_fullsized":"2024-09-11T22:13:39.303924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304147+0000","last_change":"2024-09-11T22:13:40.303372+0000","last_active":"2024-09-11T22:13:41.304147+0000","last_peered":"2024-09-11T22:13:41.304147+0000","last_clean":"2024-09-11T22:13:41.304147+0000","last_became_active":"2024-09-11T22:13:40.303042+0000","last_became_peered":"2024-09-11T22:13:40.303042+0000","last_unstale":"2024-09-11T22:13:41.304147+0000","last_undegraded":"2024-09-11T22:13:41.304147+0000","last_fullsized":"2024-09-11T22:13:41.304147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:50.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298295+0000","last_change":"2024-09-11T22:13:39.298295+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298295+0000","last_undegraded":"2024-09-11T22:13:39.298295+0000","last_fullsized":"2024-09-11T22:13:39.298295+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.314585+0000","last_change":"2024-09-11T22:13:39.312323+0000","last_active":"2024-09-11T22:13:39.314585+0000","last_peered":"2024-09-11T22:13:39.314585+0000","last_clean":"2024-09-11T22:13:39.314585+0000","last_became_active":"2024-09-11T22:13:39.312023+0000","last_became_peered":"2024-09-11T22:13:39.312023+0000","last_unstale":"2024-09-11T22:13:39.314585+0000","last_undegraded":"2024-09-11T22:13:39.314585+0000","last_fullsized":"2024-09-11T22:13:39.314585+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:00.434604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304897+0000","last_change":"2024-09-11T22:13:39.304897+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304897+0000","last_undegraded":"2024-09-11T22:13:39.304897+0000","last_fullsized":"2024-09-11T22:13:39.304897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.310731+0000","last_change":"2024-09-11T22:13:39.307957+0000","last_active":"2024-09-11T22:13:39.310731+0000","last_peered":"2024-09-11T22:13:39.310731+0000","last_clean":"2024-09-11T22:13:39.310731+0000","last_became_active":"2024-09-11T22:13:39.307664+0000","last_became_peered":"2024-09-11T22:13:39.307664+0000","last_unstale":"2024-09-11T22:13:39.310731+0000","last_undegraded":"2024-09-11T22:13:39.310731+0000","last_fullsized":"2024-09-11T22:13:39.310731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:32.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297411+0000","last_change":"2024-09-11T22:13:39.297411+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297411+0000","last_undegraded":"2024-09-11T22:13:39.297411+0000","last_fullsized":"2024-09-11T22:13:39.297411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.307852+0000","last_change":"2024-09-11T22:13:39.306671+0000","last_active":"2024-09-11T22:13:39.307852+0000","last_peered":"2024-09-11T22:13:39.307852+0000","last_clean":"2024-09-11T22:13:39.307852+0000","last_became_active":"2024-09-11T22:13:39.305428+0000","last_became_peered":"2024-09-11T22:13:39.305428+0000","last_unstale":"2024-09-11T22:13:39.307852+0000","last_undegraded":"2024-09-11T22:13:39.307852+0000","last_fullsized":"2024-09-11T22:13:39.307852+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:09.534964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298315+0000","last_change":"2024-09-11T22:13:39.298315+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298315+0000","last_undegraded":"2024-09-11T22:13:39.298315+0000","last_fullsized":"2024-09-11T22:13:39.298315+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785107+0000","last_change":"2024-09-11T22:13:39.306928+0000","last_active":"2024-09-11T22:13:41.785107+0000","last_peered":"2024-09-11T22:13:41.785107+0000","last_clean":"2024-09-11T22:13:41.785107+0000","last_became_active":"2024-09-11T22:13:39.306644+0000","last_became_peered":"2024-09-11T22:13:39.306644+0000","last_unstale":"2024-09-11T22:13:41.785107+0000","last_undegraded":"2024-09-11T22:13:41.785107+0000","last_fullsized":"2024-09-11T22:13:41.785107+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:38.578419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297439+0000","last_change":"2024-09-11T22:13:39.297439+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297439+0000","last_undegraded":"2024-09-11T22:13:39.297439+0000","last_fullsized":"2024-09-11T22:13:39.297439+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313899+0000","last_change":"2024-09-11T22:13:39.312090+0000","last_active":"2024-09-11T22:13:39.313899+0000","last_peered":"2024-09-11T22:13:39.313899+0000","last_clean":"2024-09-11T22:13:39.313899+0000","last_became_active":"2024-09-11T22:13:39.311481+0000","last_became_peered":"2024-09-11T22:13:39.311481+0000","last_unstale":"2024-09-11T22:13:39.313899+0000","last_undegraded":"2024-09-11T22:13:39.313899+0000","last_fullsized":"2024-09-11T22:13:39.313899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:37.846188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.301271+0000","last_change":"2024-09-11T22:13:39.301271+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.301271+0000","last_undegraded":"2024-09-11T22:13:39.301271+0000","last_fullsized":"2024-09-11T22:13:39.301271+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.306124+0000","last_change":"2024-09-11T22:13:39.303131+0000","last_active":"2024-09-11T22:13:39.306124+0000","last_peered":"2024-09-11T22:13:39.306124+0000","last_clean":"2024-09-11T22:13:39.306124+0000","last_became_active":"2024-09-11T22:13:39.302818+0000","last_became_peered":"2024-09-11T22:13:39.302818+0000","last_unstale":"2024-09-11T22:13:39.306124+0000","last_undegraded":"2024-09-11T22:13:39.306124+0000","last_fullsized":"2024-09-11T22:13:39.306124+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:10.642997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298718+0000","last_change":"2024-09-11T22:13:39.298718+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298718+0000","last_undegraded":"2024-09-11T22:13:39.298718+0000","last_fullsized":"2024-09-11T22:13:39.298718+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.304150+0000","last_change":"2024-09-11T22:13:39.300952+0000","last_active":"2024-09-11T22:13:39.304150+0000","last_peered":"2024-09-11T22:13:39.304150+0000","last_clean":"2024-09-11T22:13:39.304150+0000","last_became_active":"2024-09-11T22:13:39.300653+0000","last_became_peered":"2024-09-11T22:13:39.300653+0000","last_unstale":"2024-09-11T22:13:39.304150+0000","last_undegraded":"2024-09-11T22:13:39.304150+0000","last_fullsized":"2024-09-11T22:13:39.304150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:00.154645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.305012+0000","last_change":"2024-09-11T22:13:39.305012+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.305012+0000","last_undegraded":"2024-09-11T22:13:39.305012+0000","last_fullsized":"2024-09-11T22:13:39.305012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.310965+0000","last_change":"2024-09-11T22:13:39.303791+0000","last_active":"2024-09-11T22:13:39.310965+0000","last_peered":"2024-09-11T22:13:39.310965+0000","last_clean":"2024-09-11T22:13:39.310965+0000","last_became_active":"2024-09-11T22:13:39.303375+0000","last_became_peered":"2024-09-11T22:13:39.303375+0000","last_unstale":"2024-09-11T22:13:39.310965+0000","last_undegraded":"2024-09-11T22:13:39.310965+0000","last_fullsized":"2024-09-11T22:13:39.310965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:37.936462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.296932+0000","last_change":"2024-09-11T22:13:39.296932+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.296932+0000","last_undegraded":"2024-09-11T22:13:39.296932+0000","last_fullsized":"2024-09-11T22:13:39.296932+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.312743+0000","last_change":"2024-09-11T22:13:39.310133+0000","last_active":"2024-09-11T22:13:39.312743+0000","last_peered":"2024-09-11T22:13:39.312743+0000","last_clean":"2024-09-11T22:13:39.312743+0000","last_became_active":"2024-09-11T22:13:39.309863+0000","last_became_peered":"2024-09-11T22:13:39.309863+0000","last_unstale":"2024-09-11T22:13:39.312743+0000","last_undegraded":"2024-09-11T22:13:39.312743+0000","last_fullsized":"2024-09-11T22:13:39.312743+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:09.534964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785173+0000","last_change":"2024-09-11T22:13:40.310838+0000","last_active":"2024-09-11T22:13:41.785173+0000","last_peered":"2024-09-11T22:13:41.785173+0000","last_clean":"2024-09-11T22:13:41.785173+0000","last_became_active":"2024-09-11T22:13:40.310520+0000","last_became_peered":"2024-09-11T22:13:40.310520+0000","last_unstale":"2024-09-11T22:13:41.785173+0000","last_undegraded":"2024-09-11T22:13:41.785173+0000","last_fullsized":"2024-09-11T22:13:41.785173+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:02.177660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.312883+0000","last_change":"2024-09-11T22:13:39.310075+0000","last_active":"2024-09-11T22:13:39.312883+0000","last_peered":"2024-09-11T22:13:39.312883+0000","last_clean":"2024-09-11T22:13:39.312883+0000","last_became_active":"2024-09-11T22:13:39.309660+0000","last_became_peered":"2024-09-11T22:13:39.309660+0000","last_unstale":"2024-09-11T22:13:39.312883+0000","last_undegraded":"2024-09-11T22:13:39.312883+0000","last_fullsized":"2024-09-11T22:13:39.312883+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:25.430685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.307094+0000","last_change":"2024-09-11T22:13:39.307094+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.307094+0000","last_undegraded":"2024-09-11T22:13:39.307094+0000","last_fullsized":"2024-09-11T22:13:39.307094+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784958+0000","last_change":"2024-09-11T22:13:39.310563+0000","last_active":"2024-09-11T22:13:41.784958+0000","last_peered":"2024-09-11T22:13:41.784958+0000","last_clean":"2024-09-11T22:13:41.784958+0000","last_became_active":"2024-09-11T22:13:39.310308+0000","last_became_peered":"2024-09-11T22:13:39.310308+0000","last_unstale":"2024-09-11T22:13:41.784958+0000","last_undegraded":"2024-09-11T22:13:41.784958+0000","last_fullsized":"2024-09-11T22:13:41.784958+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:44.471766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784988+0000","last_change":"2024-09-11T22:13:40.314486+0000","last_active":"2024-09-11T22:13:41.784988+0000","last_peered":"2024-09-11T22:13:41.784988+0000","last_clean":"2024-09-11T22:13:41.784988+0000","last_became_active":"2024-09-11T22:13:40.313645+0000","last_became_peered":"2024-09-11T22:13:40.313645+0000","last_unstale":"2024-09-11T22:13:41.784988+0000","last_undegraded":"2024-09-11T22:13:41.784988+0000","last_fullsized":"2024-09-11T22:13:41.784988+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:30.358742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304403+0000","last_change":"2024-09-11T22:13:39.303367+0000","last_active":"2024-09-11T22:13:41.304403+0000","last_peered":"2024-09-11T22:13:41.304403+0000","last_clean":"2024-09-11T22:13:41.304403+0000","last_became_active":"2024-09-11T22:13:39.302860+0000","last_became_peered":"2024-09-11T22:13:39.302860+0000","last_unstale":"2024-09-11T22:13:41.304403+0000","last_undegraded":"2024-09-11T22:13:41.304403+0000","last_fullsized":"2024-09-11T22:13:41.304403+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:48.672367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302420+0000","last_change":"2024-09-11T22:13:39.302420+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302420+0000","last_undegraded":"2024-09-11T22:13:39.302420+0000","last_fullsized":"2024-09-11T22:13:39.302420+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313434+0000","last_change":"2024-09-11T22:13:39.311084+0000","last_active":"2024-09-11T22:13:39.313434+0000","last_peered":"2024-09-11T22:13:39.313434+0000","last_clean":"2024-09-11T22:13:39.313434+0000","last_became_active":"2024-09-11T22:13:39.310795+0000","last_became_peered":"2024-09-11T22:13:39.310795+0000","last_unstale":"2024-09-11T22:13:39.313434+0000","last_undegraded":"2024-09-11T22:13:39.313434+0000","last_fullsized":"2024-09-11T22:13:39.313434+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:00.780320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300848+0000","last_change":"2024-09-11T22:13:39.300848+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300848+0000","last_undegraded":"2024-09-11T22:13:39.300848+0000","last_fullsized":"2024-09-11T22:13:39.300848+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784893+0000","last_change":"2024-09-11T22:13:39.312568+0000","last_active":"2024-09-11T22:13:41.784893+0000","last_peered":"2024-09-11T22:13:41.784893+0000","last_clean":"2024-09-11T22:13:41.784893+0000","last_became_active":"2024-09-11T22:13:39.312266+0000","last_became_peered":"2024-09-11T22:13:39.312266+0000","last_unstale":"2024-09-11T22:13:41.784893+0000","last_undegraded":"2024-09-11T22:13:41.784893+0000","last_fullsized":"2024-09-11T22:13:41.784893+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:52.535028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.307436+0000","last_change":"2024-09-11T22:13:39.307436+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.307436+0000","last_undegraded":"2024-09-11T22:13:39.307436+0000","last_fullsized":"2024-09-11T22:13:39.307436+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313499+0000","last_change":"2024-09-11T22:13:39.311107+0000","last_active":"2024-09-11T22:13:39.313499+0000","last_peered":"2024-09-11T22:13:39.313499+0000","last_clean":"2024-09-11T22:13:39.313499+0000","last_became_active":"2024-09-11T22:13:39.310839+0000","last_became_peered":"2024-09-11T22:13:39.310839+0000","last_unstale":"2024-09-11T22:13:39.313499+0000","last_undegraded":"2024-09-11T22:13:39.313499+0000","last_fullsized":"2024-09-11T22:13:39.313499+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:40.089668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785227+0000","last_change":"2024-09-11T22:13:40.312864+0000","last_active":"2024-09-11T22:13:41.785227+0000","last_peered":"2024-09-11T22:13:41.785227+0000","last_clean":"2024-09-11T22:13:41.785227+0000","last_became_active":"2024-09-11T22:13:40.312064+0000","last_became_peered":"2024-09-11T22:13:40.312064+0000","last_unstale":"2024-09-11T22:13:41.785227+0000","last_undegraded":"2024-09-11T22:13:41.785227+0000","last_fullsized":"2024-09-11T22:13:41.785227+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:52.317665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.310987+0000","last_change":"2024-09-11T22:13:39.305593+0000","last_active":"2024-09-11T22:13:39.310987+0000","last_peered":"2024-09-11T22:13:39.310987+0000","last_clean":"2024-09-11T22:13:39.310987+0000","last_became_active":"2024-09-11T22:13:39.305310+0000","last_became_peered":"2024-09-11T22:13:39.305310+0000","last_unstale":"2024-09-11T22:13:39.310987+0000","last_undegraded":"2024-09-11T22:13:39.310987+0000","last_fullsized":"2024-09-11T22:13:39.310987+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:40:02.722992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304434+0000","last_change":"2024-09-11T22:13:40.301662+0000","last_active":"2024-09-11T22:13:41.304434+0000","last_peered":"2024-09-11T22:13:41.304434+0000","last_clean":"2024-09-11T22:13:41.304434+0000","last_became_active":"2024-09-11T22:13:40.300969+0000","last_became_peered":"2024-09-11T22:13:40.300969+0000","last_unstale":"2024-09-11T22:13:41.304434+0000","last_undegraded":"2024-09-11T22:13:41.304434+0000","last_fullsized":"2024-09-11T22:13:41.304434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:10.319903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304471+0000","last_change":"2024-09-11T22:13:39.315068+0000","last_active":"2024-09-11T22:13:41.304471+0000","last_peered":"2024-09-11T22:13:41.304471+0000","last_clean":"2024-09-11T22:13:41.304471+0000","last_became_active":"2024-09-11T22:13:39.314741+0000","last_became_peered":"2024-09-11T22:13:39.314741+0000","last_unstale":"2024-09-11T22:13:41.304471+0000","last_undegraded":"2024-09-11T22:13:41.304471+0000","last_fullsized":"2024-09-11T22:13:41.304471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:49.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299015+0000","last_change":"2024-09-11T22:13:39.299015+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299015+0000","last_undegraded":"2024-09-11T22:13:39.299015+0000","last_fullsized":"2024-09-11T22:13:39.299015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.306006+0000","last_change":"2024-09-11T22:13:39.301654+0000","last_active":"2024-09-11T22:13:39.306006+0000","last_peered":"2024-09-11T22:13:39.306006+0000","last_clean":"2024-09-11T22:13:39.306006+0000","last_became_active":"2024-09-11T22:13:39.301361+0000","last_became_peered":"2024-09-11T22:13:39.301361+0000","last_unstale":"2024-09-11T22:13:39.306006+0000","last_undegraded":"2024-09-11T22:13:39.306006+0000","last_fullsized":"2024-09-11T22:13:39.306006+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:36.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.301027+0000","last_change":"2024-09-11T22:13:39.301027+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.301027+0000","last_undegraded":"2024-09-11T22:13:39.301027+0000","last_fullsized":"2024-09-11T22:13:39.301027+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.306177+0000","last_change":"2024-09-11T22:13:39.301699+0000","last_active":"2024-09-11T22:13:39.306177+0000","last_peered":"2024-09-11T22:13:39.306177+0000","last_clean":"2024-09-11T22:13:39.306177+0000","last_became_active":"2024-09-11T22:13:39.301425+0000","last_became_peered":"2024-09-11T22:13:39.301425+0000","last_unstale":"2024-09-11T22:13:39.306177+0000","last_undegraded":"2024-09-11T22:13:39.306177+0000","last_fullsized":"2024-09-11T22:13:39.306177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:59.541599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302985+0000","last_change":"2024-09-11T22:13:39.302985+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302985+0000","last_undegraded":"2024-09-11T22:13:39.302985+0000","last_fullsized":"2024-09-11T22:13:39.302985+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.315464+0000","last_change":"2024-09-11T22:13:39.313695+0000","last_active":"2024-09-11T22:13:39.315464+0000","last_peered":"2024-09-11T22:13:39.315464+0000","last_clean":"2024-09-11T22:13:39.315464+0000","last_became_active":"2024-09-11T22:13:39.313451+0000","last_became_peered":"2024-09-11T22:13:39.313451+0000","last_unstale":"2024-09-11T22:13:39.315464+0000","last_undegraded":"2024-09-11T22:13:39.315464+0000","last_fullsized":"2024-09-11T22:13:39.315464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:04.530461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302832+0000","last_change":"2024-09-11T22:13:39.302832+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302832+0000","last_undegraded":"2024-09-11T22:13:39.302832+0000","last_fullsized":"2024-09-11T22:13:39.302832+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313179+0000","last_change":"2024-09-11T22:13:39.310453+0000","last_active":"2024-09-11T22:13:39.313179+0000","last_peered":"2024-09-11T22:13:39.313179+0000","last_clean":"2024-09-11T22:13:39.313179+0000","last_became_active":"2024-09-11T22:13:39.310186+0000","last_became_peered":"2024-09-11T22:13:39.310186+0000","last_unstale":"2024-09-11T22:13:39.313179+0000","last_undegraded":"2024-09-11T22:13:39.313179+0000","last_fullsized":"2024-09-11T22:13:39.313179+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:59.541599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297711+0000","last_change":"2024-09-11T22:13:39.297711+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297711+0000","last_undegraded":"2024-09-11T22:13:39.297711+0000","last_fullsized":"2024-09-11T22:13:39.297711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.309772+0000","last_change":"2024-09-11T22:13:39.308391+0000","last_active":"2024-09-11T22:13:39.309772+0000","last_peered":"2024-09-11T22:13:39.309772+0000","last_clean":"2024-09-11T22:13:39.309772+0000","last_became_active":"2024-09-11T22:13:39.307774+0000","last_became_peered":"2024-09-11T22:13:39.307774+0000","last_unstale":"2024-09-11T22:13:39.309772+0000","last_undegraded":"2024-09-11T22:13:39.309772+0000","last_fullsized":"2024-09-11T22:13:39.309772+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:00.780320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304123+0000","last_change":"2024-09-11T22:13:40.319478+0000","last_active":"2024-09-11T22:13:41.304123+0000","last_peered":"2024-09-11T22:13:41.304123+0000","last_clean":"2024-09-11T22:13:41.304123+0000","last_became_active":"2024-09-11T22:13:40.319188+0000","last_became_peered":"2024-09-11T22:13:40.319188+0000","last_unstale":"2024-09-11T22:13:41.304123+0000","last_undegraded":"2024-09-11T22:13:41.304123+0000","last_fullsized":"2024-09-11T22:13:41.304123+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:14:31.828880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.314263+0000","last_change":"2024-09-11T22:13:39.310780+0000","last_active":"2024-09-11T22:13:39.314263+0000","last_peered":"2024-09-11T22:13:39.314263+0000","last_clean":"2024-09-11T22:13:39.314263+0000","last_became_active":"2024-09-11T22:13:39.310504+0000","last_became_peered":"2024-09-11T22:13:39.310504+0000","last_unstale":"2024-09-11T22:13:39.314263+0000","last_undegraded":"2024-09-11T22:13:39.314263+0000","last_fullsized":"2024-09-11T22:13:39.314263+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:54.307397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299655+0000","last_change":"2024-09-11T22:13:39.299655+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299655+0000","last_undegraded":"2024-09-11T22:13:39.299655+0000","last_fullsized":"2024-09-11T22:13:39.299655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785081+0000","last_change":"2024-09-11T22:13:39.312641+0000","last_active":"2024-09-11T22:13:41.785081+0000","last_peered":"2024-09-11T22:13:41.785081+0000","last_clean":"2024-09-11T22:13:41.785081+0000","last_became_active":"2024-09-11T22:13:39.312308+0000","last_became_peered":"2024-09-11T22:13:39.312308+0000","last_unstale":"2024-09-11T22:13:41.785081+0000","last_undegraded":"2024-09-11T22:13:41.785081+0000","last_fullsized":"2024-09-11T22:13:41.785081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:56.314599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304128+0000","last_change":"2024-09-11T22:13:39.304128+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304128+0000","last_undegraded":"2024-09-11T22:13:39.304128+0000","last_fullsized":"2024-09-11T22:13:39.304128+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.315517+0000","last_change":"2024-09-11T22:13:39.313694+0000","last_active":"2024-09-11T22:13:39.315517+0000","last_peered":"2024-09-11T22:13:39.315517+0000","last_clean":"2024-09-11T22:13:39.315517+0000","last_became_active":"2024-09-11T22:13:39.312332+0000","last_became_peered":"2024-09-11T22:13:39.312332+0000","last_unstale":"2024-09-11T22:13:39.315517+0000","last_undegraded":"2024-09-11T22:13:39.315517+0000","last_fullsized":"2024-09-11T22:13:39.315517+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:24.994673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298863+0000","last_change":"2024-09-11T22:13:39.298863+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298863+0000","last_undegraded":"2024-09-11T22:13:39.298863+0000","last_fullsized":"2024-09-11T22:13:39.298863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785072+0000","last_change":"2024-09-11T22:13:39.310708+0000","last_active":"2024-09-11T22:13:41.785072+0000","last_peered":"2024-09-11T22:13:41.785072+0000","last_clean":"2024-09-11T22:13:41.785072+0000","last_became_active":"2024-09-11T22:13:39.310463+0000","last_became_peered":"2024-09-11T22:13:39.310463+0000","last_unstale":"2024-09-11T22:13:41.785072+0000","last_undegraded":"2024-09-11T22:13:41.785072+0000","last_fullsized":"2024-09-11T22:13:41.785072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:51.589071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784826+0000","last_change":"2024-09-11T22:13:40.318581+0000","last_active":"2024-09-11T22:13:41.784826+0000","last_peered":"2024-09-11T22:13:41.784826+0000","last_clean":"2024-09-11T22:13:41.784826+0000","last_became_active":"2024-09-11T22:13:40.318311+0000","last_became_peered":"2024-09-11T22:13:40.318311+0000","last_unstale":"2024-09-11T22:13:41.784826+0000","last_undegraded":"2024-09-11T22:13:41.784826+0000","last_fullsized":"2024-09-11T22:13:41.784826+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:33.291942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.305898+0000","last_change":"2024-09-11T22:13:39.303899+0000","last_active":"2024-09-11T22:13:39.305898+0000","last_peered":"2024-09-11T22:13:39.305898+0000","last_clean":"2024-09-11T22:13:39.305898+0000","last_became_active":"2024-09-11T22:13:39.303546+0000","last_became_peered":"2024-09-11T22:13:39.303546+0000","last_unstale":"2024-09-11T22:13:39.305898+0000","last_undegraded":"2024-09-11T22:13:39.305898+0000","last_fullsized":"2024-09-11T22:13:39.305898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:32.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302364+0000","last_change":"2024-09-11T22:13:39.302364+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302364+0000","last_undegraded":"2024-09-11T22:13:39.302364+0000","last_fullsized":"2024-09-11T22:13:39.302364+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785042+0000","last_change":"2024-09-11T22:13:39.308982+0000","last_active":"2024-09-11T22:13:41.785042+0000","last_peered":"2024-09-11T22:13:41.785042+0000","last_clean":"2024-09-11T22:13:41.785042+0000","last_became_active":"2024-09-11T22:13:39.308701+0000","last_became_peered":"2024-09-11T22:13:39.308701+0000","last_unstale":"2024-09-11T22:13:41.785042+0000","last_undegraded":"2024-09-11T22:13:41.785042+0000","last_fullsized":"2024-09-11T22:13:41.785042+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:24.944146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304322+0000","last_change":"2024-09-11T22:13:39.304322+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304322+0000","last_undegraded":"2024-09-11T22:13:39.304322+0000","last_fullsized":"2024-09-11T22:13:39.304322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.310345+0000","last_change":"2024-09-11T22:13:39.307907+0000","last_active":"2024-09-11T22:13:39.310345+0000","last_peered":"2024-09-11T22:13:39.310345+0000","last_clean":"2024-09-11T22:13:39.310345+0000","last_became_active":"2024-09-11T22:13:39.307599+0000","last_became_peered":"2024-09-11T22:13:39.307599+0000","last_unstale":"2024-09-11T22:13:39.310345+0000","last_undegraded":"2024-09-11T22:13:39.310345+0000","last_fullsized":"2024-09-11T22:13:39.310345+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:34.308981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.295581+0000","last_change":"2024-09-11T22:13:39.295581+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.295581+0000","last_undegraded":"2024-09-11T22:13:39.295581+0000","last_fullsized":"2024-09-11T22:13:39.295581+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313276+0000","last_change":"2024-09-11T22:13:39.312580+0000","last_active":"2024-09-11T22:13:39.313276+0000","last_peered":"2024-09-11T22:13:39.313276+0000","last_clean":"2024-09-11T22:13:39.313276+0000","last_became_active":"2024-09-11T22:13:39.312239+0000","last_became_peered":"2024-09-11T22:13:39.312239+0000","last_unstale":"2024-09-11T22:13:39.313276+0000","last_undegraded":"2024-09-11T22:13:39.313276+0000","last_fullsized":"2024-09-11T22:13:39.313276+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:24.275744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.296248+0000","last_change":"2024-09-11T22:13:39.296248+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.296248+0000","last_undegraded":"2024-09-11T22:13:39.296248+0000","last_fullsized":"2024-09-11T22:13:39.296248+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.312310+0000","last_change":"2024-09-11T22:13:39.310777+0000","last_active":"2024-09-11T22:13:39.312310+0000","last_peered":"2024-09-11T22:13:39.312310+0000","last_clean":"2024-09-11T22:13:39.312310+0000","last_became_active":"2024-09-11T22:13:39.310498+0000","last_became_peered":"2024-09-11T22:13:39.310498+0000","last_unstale":"2024-09-11T22:13:39.312310+0000","last_undegraded":"2024-09-11T22:13:39.312310+0000","last_fullsized":"2024-09-11T22:13:39.312310+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299434+0000","last_change":"2024-09-11T22:13:39.299434+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299434+0000","last_undegraded":"2024-09-11T22:13:39.299434+0000","last_fullsized":"2024-09-11T22:13:39.299434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.315210+0000","last_change":"2024-09-11T22:13:39.310021+0000","last_active":"2024-09-11T22:13:39.315210+0000","last_peered":"2024-09-11T22:13:39.315210+0000","last_clean":"2024-09-11T22:13:39.315210+0000","last_became_active":"2024-09-11T22:13:39.309718+0000","last_became_peered":"2024-09-11T22:13:39.309718+0000","last_unstale":"2024-09-11T22:13:39.315210+0000","last_undegraded":"2024-09-11T22:13:39.315210+0000","last_fullsized":"2024-09-11T22:13:39.315210+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:40.089668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":213,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785129+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:13:41.785129+0000","last_peered":"2024-09-11T22:13:41.785129+0000","last_clean":"2024-09-11T22:13:41.785129+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:13:41.785129+0000","last_undegraded":"2024-09-11T22:13:41.785129+0000","last_fullsized":"2024-09-11T22:13:41.785129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1724,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35832,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336008,"statfs":{"total":96636764160,"available":96600072192,"internally_reserved":0,"allocated":495616,"data_stored":198405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35820,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":483328,"data_stored":192138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35820,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":483328,"data_stored":192138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":483328,"data_stored":192138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44156,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327684,"statfs":{"total":96636764160,"available":96591548416,"internally_reserved":0,"allocated":495616,"data_stored":198405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36400,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335440,"statfs":{"total":96636764160,"available":96599490560,"internally_reserved":0,"allocated":1077248,"data_stored":782506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36436,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335404,"statfs":{"total":96636764160,"available":96599453696,"internally_reserved":0,"allocated":1105920,"data_stored":795638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":524288,"data_stored":206814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:13:44.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:13:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.777+0000 7fb52fd11640 1 Processor -- start 2024-09-11T22:13:44.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.777+0000 7fb52fd11640 1 -- start start 2024-09-11T22:13:44.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.778+0000 7fb52fd11640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb528161d30 0x7fb5280cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.778+0000 7fb52fd11640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5280d11d0 0x7fb5280d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.778+0000 7fb52fd11640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb528162110 con 0x7fb5280b78f0 2024-09-11T22:13:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.778+0000 7fb52fd11640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb5280d1b80 con 0x7fb528161d30 2024-09-11T22:13:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.778+0000 7fb52fd11640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb5280d3450 con 0x7fb5280d11d0 2024-09-11T22:13:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.778+0000 7fb52daad640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb528161d30 0x7fb5280cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.778+0000 7fb52daad640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb528161d30 0x7fb5280cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35450/0 (socket says 172.21.15.50:35450) 2024-09-11T22:13:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.778+0000 7fb52daad640 1 -- 172.21.15.50:0/4088302633 learned_addr learned my addr 172.21.15.50:0/4088302633 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.779+0000 7fb52e2ae640 1 --2- 172.21.15.50:0/4088302633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5280d11d0 0x7fb5280d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.779+0000 7fb52daad640 1 -- 172.21.15.50:0/4088302633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5280d11d0 msgr2=0x7fb5280d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.779+0000 7fb52daad640 1 --2- 172.21.15.50:0/4088302633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5280d11d0 0x7fb5280d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.779+0000 7fb52daad640 1 -- 172.21.15.50:0/4088302633 >> v1:172.21.15.77:6789/0 conn(0x7fb5280b78f0 legacy=0x7fb528162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.779+0000 7fb52daad640 1 -- 172.21.15.50:0/4088302633 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5280cfd70 con 0x7fb528161d30 2024-09-11T22:13:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.780+0000 7fb52daad640 1 --2- 172.21.15.50:0/4088302633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb528161d30 0x7fb5280cf790 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb524009870 tx=0x7fb52402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e2d33013a719b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.780+0000 7fb52caab640 1 -- 172.21.15.50:0/4088302633 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524037070 con 0x7fb528161d30 2024-09-11T22:13:44.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.780+0000 7fb52caab640 1 -- 172.21.15.50:0/4088302633 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb524032440 con 0x7fb528161d30 2024-09-11T22:13:44.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.780+0000 7fb52caab640 1 -- 172.21.15.50:0/4088302633 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524032810 con 0x7fb528161d30 2024-09-11T22:13:44.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.780+0000 7fb52fd11640 1 -- 172.21.15.50:0/4088302633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb528161d30 msgr2=0x7fb5280cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.780+0000 7fb52fd11640 1 --2- 172.21.15.50:0/4088302633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb528161d30 0x7fb5280cf790 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb524009870 tx=0x7fb52402a270 comp rx=0 tx=0).stop 2024-09-11T22:13:44.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.780+0000 7fb52fd11640 1 -- 172.21.15.50:0/4088302633 shutdown_connections 2024-09-11T22:13:44.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.780+0000 7fb52fd11640 1 --2- 172.21.15.50:0/4088302633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5280d11d0 0x7fb5280d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.780+0000 7fb52fd11640 1 --2- 172.21.15.50:0/4088302633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb528161d30 0x7fb5280cf790 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.780+0000 7fb52fd11640 1 -- 172.21.15.50:0/4088302633 >> 172.21.15.50:0/4088302633 conn(0x7fb5280727a0 msgr2=0x7fb5280679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:44.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.780+0000 7fb52fd11640 1 -- 172.21.15.50:0/4088302633 shutdown_connections 2024-09-11T22:13:44.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.780+0000 7fb52fd11640 1 -- 172.21.15.50:0/4088302633 wait complete. 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.781+0000 7fb52fd11640 1 Processor -- start 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.782+0000 7fb52fd11640 1 -- start start 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.782+0000 7fb52fd11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5280b78f0 0x7fb528157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.782+0000 7fb52fd11640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5280d11d0 0x7fb528158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.782+0000 7fb52fd11640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb528161d30 0x7fb52815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.782+0000 7fb52fd11640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb5280d30e0 con 0x7fb5280d11d0 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.782+0000 7fb52fd11640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb5280d2e00 con 0x7fb5280b78f0 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.782+0000 7fb52fd11640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb5280b7d60 con 0x7fb528161d30 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.782+0000 7fb52d2ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5280d11d0 0x7fb528158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.782+0000 7fb52d2ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5280d11d0 0x7fb528158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35452/0 (socket says 172.21.15.50:35452) 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.782+0000 7fb52d2ac640 1 -- 172.21.15.50:0/4186584715 learned_addr learned my addr 172.21.15.50:0/4186584715 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.782+0000 7fb52daad640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5280b78f0 0x7fb528157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.782+0000 7fb52e2ae640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb528161d30 0x7fb52815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.783+0000 7fb52d2ac640 1 -- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb528161d30 msgr2=0x7fb52815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.783+0000 7fb52d2ac640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb528161d30 0x7fb52815a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.783+0000 7fb52d2ac640 1 -- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5280b78f0 msgr2=0x7fb528157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.783+0000 7fb52d2ac640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5280b78f0 0x7fb528157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.783+0000 7fb52d2ac640 1 -- 172.21.15.50:0/4186584715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5280b57f0 con 0x7fb5280d11d0 2024-09-11T22:13:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.783+0000 7fb52d2ac640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5280d11d0 0x7fb528158150 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c400 tx=0x7fb51800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.783+0000 7fb51e7fc640 1 -- 172.21.15.50:0/4186584715 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5180052d0 con 0x7fb5280d11d0 2024-09-11T22:13:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.783+0000 7fb51e7fc640 1 -- 172.21.15.50:0/4186584715 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb518005490 con 0x7fb5280d11d0 2024-09-11T22:13:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.783+0000 7fb52fd11640 1 -- 172.21.15.50:0/4186584715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5280b5ad0 con 0x7fb5280d11d0 2024-09-11T22:13:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.783+0000 7fb51e7fc640 1 -- 172.21.15.50:0/4186584715 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518007260 con 0x7fb5280d11d0 2024-09-11T22:13:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.783+0000 7fb52fd11640 1 -- 172.21.15.50:0/4186584715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5280b6090 con 0x7fb5280d11d0 2024-09-11T22:13:44.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.784+0000 7fb52fd11640 1 -- 172.21.15.50:0/4186584715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5280d1640 con 0x7fb5280d11d0 2024-09-11T22:13:44.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.785+0000 7fb51e7fc640 1 -- 172.21.15.50:0/4186584715 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb518007400 con 0x7fb5280d11d0 2024-09-11T22:13:44.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.785+0000 7fb51e7fc640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb50c06be30 0x7fb50c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:44.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.785+0000 7fb51e7fc640 1 -- 172.21.15.50:0/4186584715 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb51808a340 con 0x7fb5280d11d0 2024-09-11T22:13:44.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.785+0000 7fb52daad640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb50c06be30 0x7fb50c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:44.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.786+0000 7fb52daad640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb50c06be30 0x7fb50c06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb524034000 tx=0x7fb52402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.790+0000 7fb51e7fc640 1 -- 172.21.15.50:0/4186584715 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5180586a0 con 0x7fb5280d11d0 2024-09-11T22:13:44.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.963+0000 7fb52fd11640 1 -- 172.21.15.50:0/4186584715 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5280ce3e0 con 0x7fb50c06be30 2024-09-11T22:13:44.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.970+0000 7fb51e7fc640 1 -- 172.21.15.50:0/4186584715 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247661 (secure 0 0 0) 0x7fb5280ce3e0 con 0x7fb50c06be30 2024-09-11T22:13:44.973 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:13:44.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.973+0000 7fb52fd11640 1 -- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb50c06be30 msgr2=0x7fb50c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.973+0000 7fb52fd11640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb50c06be30 0x7fb50c06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb524034000 tx=0x7fb52402e000 comp rx=0 tx=0).stop 2024-09-11T22:13:44.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.973+0000 7fb52fd11640 1 -- 172.21.15.50:0/4186584715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5280d11d0 msgr2=0x7fb528158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:44.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.973+0000 7fb52fd11640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5280d11d0 0x7fb528158150 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c400 tx=0x7fb51800c8c0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.973+0000 7fb52fd11640 1 -- 172.21.15.50:0/4186584715 shutdown_connections 2024-09-11T22:13:44.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.973+0000 7fb52fd11640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb50c06be30 0x7fb50c06e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.973+0000 7fb52fd11640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb528161d30 0x7fb52815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.973+0000 7fb52fd11640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5280d11d0 0x7fb528158150 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.973+0000 7fb52fd11640 1 --2- 172.21.15.50:0/4186584715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5280b78f0 0x7fb528157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:44.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.973+0000 7fb52fd11640 1 -- 172.21.15.50:0/4186584715 >> 172.21.15.50:0/4186584715 conn(0x7fb5280727a0 msgr2=0x7fb5280ba120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:44.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.973+0000 7fb52fd11640 1 -- 172.21.15.50:0/4186584715 shutdown_connections 2024-09-11T22:13:44.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:44.973+0000 7fb52fd11640 1 -- 172.21.15.50:0/4186584715 wait complete. 2024-09-11T22:13:44.985 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2024-09-11T22:13:43.397888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592092,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":173,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304472,"kb_used_data":5028,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754670248,"statfs":{"total":773094113280,"available":772782333952,"internally_reserved":0,"allocated":5148672,"data_stored":2758182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":306433585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1724,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.109942"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784907+0000","last_change":"2024-09-11T22:13:40.311514+0000","last_active":"2024-09-11T22:13:41.784907+0000","last_peered":"2024-09-11T22:13:41.784907+0000","last_clean":"2024-09-11T22:13:41.784907+0000","last_became_active":"2024-09-11T22:13:40.311230+0000","last_became_peered":"2024-09-11T22:13:40.311230+0000","last_unstale":"2024-09-11T22:13:41.784907+0000","last_undegraded":"2024-09-11T22:13:41.784907+0000","last_fullsized":"2024-09-11T22:13:41.784907+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:46.668580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297744+0000","last_change":"2024-09-11T22:13:39.297744+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297744+0000","last_undegraded":"2024-09-11T22:13:39.297744+0000","last_fullsized":"2024-09-11T22:13:39.297744+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.296494+0000","last_change":"2024-09-11T22:13:39.296494+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.296494+0000","last_undegraded":"2024-09-11T22:13:39.296494+0000","last_fullsized":"2024-09-11T22:13:39.296494+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300662+0000","last_change":"2024-09-11T22:13:39.300662+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300662+0000","last_undegraded":"2024-09-11T22:13:39.300662+0000","last_fullsized":"2024-09-11T22:13:39.300662+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297123+0000","last_change":"2024-09-11T22:13:39.297123+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297123+0000","last_undegraded":"2024-09-11T22:13:39.297123+0000","last_fullsized":"2024-09-11T22:13:39.297123+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.303442+0000","last_change":"2024-09-11T22:13:39.303442+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.303442+0000","last_undegraded":"2024-09-11T22:13:39.303442+0000","last_fullsized":"2024-09-11T22:13:39.303442+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785039+0000","last_change":"2024-09-11T22:13:40.311634+0000","last_active":"2024-09-11T22:13:41.785039+0000","last_peered":"2024-09-11T22:13:41.785039+0000","last_clean":"2024-09-11T22:13:41.785039+0000","last_became_active":"2024-09-11T22:13:40.311350+0000","last_became_peered":"2024-09-11T22:13:40.311350+0000","last_unstale":"2024-09-11T22:13:41.785039+0000","last_undegraded":"2024-09-11T22:13:41.785039+0000","last_fullsized":"2024-09-11T22:13:41.785039+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:54.495405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300619+0000","last_change":"2024-09-11T22:13:39.300619+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300619+0000","last_undegraded":"2024-09-11T22:13:39.300619+0000","last_fullsized":"2024-09-11T22:13:39.300619+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300820+0000","last_change":"2024-09-11T22:13:39.300820+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300820+0000","last_undegraded":"2024-09-11T22:13:39.300820+0000","last_fullsized":"2024-09-11T22:13:39.300820+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299878+0000","last_change":"2024-09-11T22:13:39.299878+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299878+0000","last_undegraded":"2024-09-11T22:13:39.299878+0000","last_fullsized":"2024-09-11T22:13:39.299878+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298724+0000","last_change":"2024-09-11T22:13:39.298724+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298724+0000","last_undegraded":"2024-09-11T22:13:39.298724+0000","last_fullsized":"2024-09-11T22:13:39.298724+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298357+0000","last_change":"2024-09-11T22:13:39.298357+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298357+0000","last_undegraded":"2024-09-11T22:13:39.298357+0000","last_fullsized":"2024-09-11T22:13:39.298357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304255+0000","last_change":"2024-09-11T22:13:40.319919+0000","last_active":"2024-09-11T22:13:41.304255+0000","last_peered":"2024-09-11T22:13:41.304255+0000","last_clean":"2024-09-11T22:13:41.304255+0000","last_became_active":"2024-09-11T22:13:40.319595+0000","last_became_peered":"2024-09-11T22:13:40.319595+0000","last_unstale":"2024-09-11T22:13:41.304255+0000","last_undegraded":"2024-09-11T22:13:41.304255+0000","last_fullsized":"2024-09-11T22:13:41.304255+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:01.306291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300326+0000","last_change":"2024-09-11T22:13:39.300326+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300326+0000","last_undegraded":"2024-09-11T22:13:39.300326+0000","last_fullsized":"2024-09-11T22:13:39.300326+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304400+0000","last_change":"2024-09-11T22:13:39.304400+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304400+0000","last_undegraded":"2024-09-11T22:13:39.304400+0000","last_fullsized":"2024-09-11T22:13:39.304400+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.301312+0000","last_change":"2024-09-11T22:13:39.301312+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.301312+0000","last_undegraded":"2024-09-11T22:13:39.301312+0000","last_fullsized":"2024-09-11T22:13:39.301312+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.296968+0000","last_change":"2024-09-11T22:13:39.296968+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.296968+0000","last_undegraded":"2024-09-11T22:13:39.296968+0000","last_fullsized":"2024-09-11T22:13:39.296968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297494+0000","last_change":"2024-09-11T22:13:39.297494+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297494+0000","last_undegraded":"2024-09-11T22:13:39.297494+0000","last_fullsized":"2024-09-11T22:13:39.297494+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302296+0000","last_change":"2024-09-11T22:13:39.302296+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302296+0000","last_undegraded":"2024-09-11T22:13:39.302296+0000","last_fullsized":"2024-09-11T22:13:39.302296+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304411+0000","last_change":"2024-09-11T22:13:40.325041+0000","last_active":"2024-09-11T22:13:41.304411+0000","last_peered":"2024-09-11T22:13:41.304411+0000","last_clean":"2024-09-11T22:13:41.304411+0000","last_became_active":"2024-09-11T22:13:40.324467+0000","last_became_peered":"2024-09-11T22:13:40.324467+0000","last_unstale":"2024-09-11T22:13:41.304411+0000","last_undegraded":"2024-09-11T22:13:41.304411+0000","last_fullsized":"2024-09-11T22:13:41.304411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:50.478469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304800+0000","last_change":"2024-09-11T22:13:39.304800+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304800+0000","last_undegraded":"2024-09-11T22:13:39.304800+0000","last_fullsized":"2024-09-11T22:13:39.304800+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299865+0000","last_change":"2024-09-11T22:13:39.299865+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299865+0000","last_undegraded":"2024-09-11T22:13:39.299865+0000","last_fullsized":"2024-09-11T22:13:39.299865+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.303267+0000","last_change":"2024-09-11T22:13:39.303267+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.303267+0000","last_undegraded":"2024-09-11T22:13:39.303267+0000","last_fullsized":"2024-09-11T22:13:39.303267+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300814+0000","last_change":"2024-09-11T22:13:39.300814+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300814+0000","last_undegraded":"2024-09-11T22:13:39.300814+0000","last_fullsized":"2024-09-11T22:13:39.300814+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.303234+0000","last_change":"2024-09-11T22:13:39.303234+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.303234+0000","last_undegraded":"2024-09-11T22:13:39.303234+0000","last_fullsized":"2024-09-11T22:13:39.303234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304434+0000","last_change":"2024-09-11T22:13:40.318761+0000","last_active":"2024-09-11T22:13:41.304434+0000","last_peered":"2024-09-11T22:13:41.304434+0000","last_clean":"2024-09-11T22:13:41.304434+0000","last_became_active":"2024-09-11T22:13:40.318451+0000","last_became_peered":"2024-09-11T22:13:40.318451+0000","last_unstale":"2024-09-11T22:13:41.304434+0000","last_undegraded":"2024-09-11T22:13:41.304434+0000","last_fullsized":"2024-09-11T22:13:41.304434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:28.473773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.295770+0000","last_change":"2024-09-11T22:13:39.295770+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.295770+0000","last_undegraded":"2024-09-11T22:13:39.295770+0000","last_fullsized":"2024-09-11T22:13:39.295770+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297918+0000","last_change":"2024-09-11T22:13:39.297918+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297918+0000","last_undegraded":"2024-09-11T22:13:39.297918+0000","last_fullsized":"2024-09-11T22:13:39.297918+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.301466+0000","last_change":"2024-09-11T22:13:39.301466+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.301466+0000","last_undegraded":"2024-09-11T22:13:39.301466+0000","last_fullsized":"2024-09-11T22:13:39.301466+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298188+0000","last_change":"2024-09-11T22:13:39.298188+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298188+0000","last_undegraded":"2024-09-11T22:13:39.298188+0000","last_fullsized":"2024-09-11T22:13:39.298188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.303924+0000","last_change":"2024-09-11T22:13:39.303924+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.303924+0000","last_undegraded":"2024-09-11T22:13:39.303924+0000","last_fullsized":"2024-09-11T22:13:39.303924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304147+0000","last_change":"2024-09-11T22:13:40.303372+0000","last_active":"2024-09-11T22:13:41.304147+0000","last_peered":"2024-09-11T22:13:41.304147+0000","last_clean":"2024-09-11T22:13:41.304147+0000","last_became_active":"2024-09-11T22:13:40.303042+0000","last_became_peered":"2024-09-11T22:13:40.303042+0000","last_unstale":"2024-09-11T22:13:41.304147+0000","last_undegraded":"2024-09-11T22:13:41.304147+0000","last_fullsized":"2024-09-11T22:13:41.304147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:50.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298295+0000","last_change":"2024-09-11T22:13:39.298295+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298295+0000","last_undegraded":"2024-09-11T22:13:39.298295+0000","last_fullsized":"2024-09-11T22:13:39.298295+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.314585+0000","last_change":"2024-09-11T22:13:39.312323+0000","last_active":"2024-09-11T22:13:39.314585+0000","last_peered":"2024-09-11T22:13:39.314585+0000","last_clean":"2024-09-11T22:13:39.314585+0000","last_became_active":"2024-09-11T22:13:39.312023+0000","last_became_peered":"2024-09-11T22:13:39.312023+0000","last_unstale":"2024-09-11T22:13:39.314585+0000","last_undegraded":"2024-09-11T22:13:39.314585+0000","last_fullsized":"2024-09-11T22:13:39.314585+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:00.434604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304897+0000","last_change":"2024-09-11T22:13:39.304897+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304897+0000","last_undegraded":"2024-09-11T22:13:39.304897+0000","last_fullsized":"2024-09-11T22:13:39.304897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.310731+0000","last_change":"2024-09-11T22:13:39.307957+0000","last_active":"2024-09-11T22:13:39.310731+0000","last_peered":"2024-09-11T22:13:39.310731+0000","last_clean":"2024-09-11T22:13:39.310731+0000","last_became_active":"2024-09-11T22:13:39.307664+0000","last_became_peered":"2024-09-11T22:13:39.307664+0000","last_unstale":"2024-09-11T22:13:39.310731+0000","last_undegraded":"2024-09-11T22:13:39.310731+0000","last_fullsized":"2024-09-11T22:13:39.310731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:32.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297411+0000","last_change":"2024-09-11T22:13:39.297411+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297411+0000","last_undegraded":"2024-09-11T22:13:39.297411+0000","last_fullsized":"2024-09-11T22:13:39.297411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.307852+0000","last_change":"2024-09-11T22:13:39.306671+0000","last_active":"2024-09-11T22:13:39.307852+0000","last_peered":"2024-09-11T22:13:39.307852+0000","last_clean":"2024-09-11T22:13:39.307852+0000","last_became_active":"2024-09-11T22:13:39.305428+0000","last_became_peered":"2024-09-11T22:13:39.305428+0000","last_unstale":"2024-09-11T22:13:39.307852+0000","last_undegraded":"2024-09-11T22:13:39.307852+0000","last_fullsized":"2024-09-11T22:13:39.307852+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:09.534964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298315+0000","last_change":"2024-09-11T22:13:39.298315+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298315+0000","last_undegraded":"2024-09-11T22:13:39.298315+0000","last_fullsized":"2024-09-11T22:13:39.298315+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785107+0000","last_change":"2024-09-11T22:13:39.306928+0000","last_active":"2024-09-11T22:13:41.785107+0000","last_peered":"2024-09-11T22:13:41.785107+0000","last_clean":"2024-09-11T22:13:41.785107+0000","last_became_active":"2024-09-11T22:13:39.306644+0000","last_became_peered":"2024-09-11T22:13:39.306644+0000","last_unstale":"2024-09-11T22:13:41.785107+0000","last_undegraded":"2024-09-11T22:13:41.785107+0000","last_fullsized":"2024-09-11T22:13:41.785107+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:38.578419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297439+0000","last_change":"2024-09-11T22:13:39.297439+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297439+0000","last_undegraded":"2024-09-11T22:13:39.297439+0000","last_fullsized":"2024-09-11T22:13:39.297439+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313899+0000","last_change":"2024-09-11T22:13:39.312090+0000","last_active":"2024-09-11T22:13:39.313899+0000","last_peered":"2024-09-11T22:13:39.313899+0000","last_clean":"2024-09-11T22:13:39.313899+0000","last_became_active":"2024-09-11T22:13:39.311481+0000","last_became_peered":"2024-09-11T22:13:39.311481+0000","last_unstale":"2024-09-11T22:13:39.313899+0000","last_undegraded":"2024-09-11T22:13:39.313899+0000","last_fullsized":"2024-09-11T22:13:39.313899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:37.846188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.301271+0000","last_change":"2024-09-11T22:13:39.301271+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.301271+0000","last_undegraded":"2024-09-11T22:13:39.301271+0000","last_fullsized":"2024-09-11T22:13:39.301271+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.306124+0000","last_change":"2024-09-11T22:13:39.303131+0000","last_active":"2024-09-11T22:13:39.306124+0000","last_peered":"2024-09-11T22:13:39.306124+0000","last_clean":"2024-09-11T22:13:39.306124+0000","last_became_active":"2024-09-11T22:13:39.302818+0000","last_became_peered":"2024-09-11T22:13:39.302818+0000","last_unstale":"2024-09-11T22:13:39.306124+0000","last_undegraded":"2024-09-11T22:13:39.306124+0000","last_fullsized":"2024-09-11T22:13:39.306124+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:10.642997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298718+0000","last_change":"2024-09-11T22:13:39.298718+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298718+0000","last_undegraded":"2024-09-11T22:13:39.298718+0000","last_fullsized":"2024-09-11T22:13:39.298718+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.304150+0000","last_change":"2024-09-11T22:13:39.300952+0000","last_active":"2024-09-11T22:13:39.304150+0000","last_peered":"2024-09-11T22:13:39.304150+0000","last_clean":"2024-09-11T22:13:39.304150+0000","last_became_active":"2024-09-11T22:13:39.300653+0000","last_became_peered":"2024-09-11T22:13:39.300653+0000","last_unstale":"2024-09-11T22:13:39.304150+0000","last_undegraded":"2024-09-11T22:13:39.304150+0000","last_fullsized":"2024-09-11T22:13:39.304150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:00.154645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.305012+0000","last_change":"2024-09-11T22:13:39.305012+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.305012+0000","last_undegraded":"2024-09-11T22:13:39.305012+0000","last_fullsized":"2024-09-11T22:13:39.305012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.310965+0000","last_change":"2024-09-11T22:13:39.303791+0000","last_active":"2024-09-11T22:13:39.310965+0000","last_peered":"2024-09-11T22:13:39.310965+0000","last_clean":"2024-09-11T22:13:39.310965+0000","last_became_active":"2024-09-11T22:13:39.303375+0000","last_became_peered":"2024-09-11T22:13:39.303375+0000","last_unstale":"2024-09-11T22:13:39.310965+0000","last_undegraded":"2024-09-11T22:13:39.310965+0000","last_fullsized":"2024-09-11T22:13:39.310965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:37.936462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.296932+0000","last_change":"2024-09-11T22:13:39.296932+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.296932+0000","last_undegraded":"2024-09-11T22:13:39.296932+0000","last_fullsized":"2024-09-11T22:13:39.296932+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.312743+0000","last_change":"2024-09-11T22:13:39.310133+0000","last_active":"2024-09-11T22:13:39.312743+0000","last_peered":"2024-09-11T22:13:39.312743+0000","last_clean":"2024-09-11T22:13:39.312743+0000","last_became_active":"2024-09-11T22:13:39.309863+0000","last_became_peered":"2024-09-11T22:13:39.309863+0000","last_unstale":"2024-09-11T22:13:39.312743+0000","last_undegraded":"2024-09-11T22:13:39.312743+0000","last_fullsized":"2024-09-11T22:13:39.312743+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:09.534964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785173+0000","last_change":"2024-09-11T22:13:40.310838+0000","last_active":"2024-09-11T22:13:41.785173+0000","last_peered":"2024-09-11T22:13:41.785173+0000","last_clean":"2024-09-11T22:13:41.785173+0000","last_became_active":"2024-09-11T22:13:40.310520+0000","last_became_peered":"2024-09-11T22:13:40.310520+0000","last_unstale":"2024-09-11T22:13:41.785173+0000","last_undegraded":"2024-09-11T22:13:41.785173+0000","last_fullsized":"2024-09-11T22:13:41.785173+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:02.177660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.312883+0000","last_change":"2024-09-11T22:13:39.310075+0000","last_active":"2024-09-11T22:13:39.312883+0000","last_peered":"2024-09-11T22:13:39.312883+0000","last_clean":"2024-09-11T22:13:39.312883+0000","last_became_active":"2024-09-11T22:13:39.309660+0000","last_became_peered":"2024-09-11T22:13:39.309660+0000","last_unstale":"2024-09-11T22:13:39.312883+0000","last_undegraded":"2024-09-11T22:13:39.312883+0000","last_fullsized":"2024-09-11T22:13:39.312883+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:25.430685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.307094+0000","last_change":"2024-09-11T22:13:39.307094+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.307094+0000","last_undegraded":"2024-09-11T22:13:39.307094+0000","last_fullsized":"2024-09-11T22:13:39.307094+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784958+0000","last_change":"2024-09-11T22:13:39.310563+0000","last_active":"2024-09-11T22:13:41.784958+0000","last_peered":"2024-09-11T22:13:41.784958+0000","last_clean":"2024-09-11T22:13:41.784958+0000","last_became_active":"2024-09-11T22:13:39.310308+0000","last_became_peered":"2024-09-11T22:13:39.310308+0000","last_unstale":"2024-09-11T22:13:41.784958+0000","last_undegraded":"2024-09-11T22:13:41.784958+0000","last_fullsized":"2024-09-11T22:13:41.784958+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:44.471766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784988+0000","last_change":"2024-09-11T22:13:40.314486+0000","last_active":"2024-09-11T22:13:41.784988+0000","last_peered":"2024-09-11T22:13:41.784988+0000","last_clean":"2024-09-11T22:13:41.784988+0000","last_became_active":"2024-09-11T22:13:40.313645+0000","last_became_peered":"2024-09-11T22:13:40.313645+0000","last_unstale":"2024-09-11T22:13:41.784988+0000","last_undegraded":"2024-09-11T22:13:41.784988+0000","last_fullsized":"2024-09-11T22:13:41.784988+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:30.358742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304403+0000","last_change":"2024-09-11T22:13:39.303367+0000","last_active":"2024-09-11T22:13:41.304403+0000","last_peered":"2024-09-11T22:13:41.304403+0000","last_clean":"2024-09-11T22:13:41.304403+0000","last_became_active":"2024-09-11T22:13:39.302860+0000","last_became_peered":"2024-09-11T22:13:39.302860+0000","last_unstale":"2024-09-11T22:13:41.304403+0000","last_undegraded":"2024-09-11T22:13:41.304403+0000","last_fullsized":"2024-09-11T22:13:41.304403+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:48.672367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302420+0000","last_change":"2024-09-11T22:13:39.302420+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302420+0000","last_undegraded":"2024-09-11T22:13:39.302420+0000","last_fullsized":"2024-09-11T22:13:39.302420+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313434+0000","last_change":"2024-09-11T22:13:39.311084+0000","last_active":"2024-09-11T22:13:39.313434+0000","last_peered":"2024-09-11T22:13:39.313434+0000","last_clean":"2024-09-11T22:13:39.313434+0000","last_became_active":"2024-09-11T22:13:39.310795+0000","last_became_peered":"2024-09-11T22:13:39.310795+0000","last_unstale":"2024-09-11T22:13:39.313434+0000","last_undegraded":"2024-09-11T22:13:39.313434+0000","last_fullsized":"2024-09-11T22:13:39.313434+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:00.780320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.300848+0000","last_change":"2024-09-11T22:13:39.300848+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.300848+0000","last_undegraded":"2024-09-11T22:13:39.300848+0000","last_fullsized":"2024-09-11T22:13:39.300848+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784893+0000","last_change":"2024-09-11T22:13:39.312568+0000","last_active":"2024-09-11T22:13:41.784893+0000","last_peered":"2024-09-11T22:13:41.784893+0000","last_clean":"2024-09-11T22:13:41.784893+0000","last_became_active":"2024-09-11T22:13:39.312266+0000","last_became_peered":"2024-09-11T22:13:39.312266+0000","last_unstale":"2024-09-11T22:13:41.784893+0000","last_undegraded":"2024-09-11T22:13:41.784893+0000","last_fullsized":"2024-09-11T22:13:41.784893+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:52.535028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.307436+0000","last_change":"2024-09-11T22:13:39.307436+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.307436+0000","last_undegraded":"2024-09-11T22:13:39.307436+0000","last_fullsized":"2024-09-11T22:13:39.307436+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313499+0000","last_change":"2024-09-11T22:13:39.311107+0000","last_active":"2024-09-11T22:13:39.313499+0000","last_peered":"2024-09-11T22:13:39.313499+0000","last_clean":"2024-09-11T22:13:39.313499+0000","last_became_active":"2024-09-11T22:13:39.310839+0000","last_became_peered":"2024-09-11T22:13:39.310839+0000","last_unstale":"2024-09-11T22:13:39.313499+0000","last_undegraded":"2024-09-11T22:13:39.313499+0000","last_fullsized":"2024-09-11T22:13:39.313499+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:40.089668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785227+0000","last_change":"2024-09-11T22:13:40.312864+0000","last_active":"2024-09-11T22:13:41.785227+0000","last_peered":"2024-09-11T22:13:41.785227+0000","last_clean":"2024-09-11T22:13:41.785227+0000","last_became_active":"2024-09-11T22:13:40.312064+0000","last_became_peered":"2024-09-11T22:13:40.312064+0000","last_unstale":"2024-09-11T22:13:41.785227+0000","last_undegraded":"2024-09-11T22:13:41.785227+0000","last_fullsized":"2024-09-11T22:13:41.785227+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:52.317665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.310987+0000","last_change":"2024-09-11T22:13:39.305593+0000","last_active":"2024-09-11T22:13:39.310987+0000","last_peered":"2024-09-11T22:13:39.310987+0000","last_clean":"2024-09-11T22:13:39.310987+0000","last_became_active":"2024-09-11T22:13:39.305310+0000","last_became_peered":"2024-09-11T22:13:39.305310+0000","last_unstale":"2024-09-11T22:13:39.310987+0000","last_undegraded":"2024-09-11T22:13:39.310987+0000","last_fullsized":"2024-09-11T22:13:39.310987+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:40:02.722992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304434+0000","last_change":"2024-09-11T22:13:40.301662+0000","last_active":"2024-09-11T22:13:41.304434+0000","last_peered":"2024-09-11T22:13:41.304434+0000","last_clean":"2024-09-11T22:13:41.304434+0000","last_became_active":"2024-09-11T22:13:40.300969+0000","last_became_peered":"2024-09-11T22:13:40.300969+0000","last_unstale":"2024-09-11T22:13:41.304434+0000","last_undegraded":"2024-09-11T22:13:41.304434+0000","last_fullsized":"2024-09-11T22:13:41.304434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:10.319903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304471+0000","last_change":"2024-09-11T22:13:39.315068+0000","last_active":"2024-09-11T22:13:41.304471+0000","last_peered":"2024-09-11T22:13:41.304471+0000","last_clean":"2024-09-11T22:13:41.304471+0000","last_became_active":"2024-09-11T22:13:39.314741+0000","last_became_peered":"2024-09-11T22:13:39.314741+0000","last_unstale":"2024-09-11T22:13:41.304471+0000","last_undegraded":"2024-09-11T22:13:41.304471+0000","last_fullsized":"2024-09-11T22:13:41.304471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:49.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299015+0000","last_change":"2024-09-11T22:13:39.299015+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299015+0000","last_undegraded":"2024-09-11T22:13:39.299015+0000","last_fullsized":"2024-09-11T22:13:39.299015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.306006+0000","last_change":"2024-09-11T22:13:39.301654+0000","last_active":"2024-09-11T22:13:39.306006+0000","last_peered":"2024-09-11T22:13:39.306006+0000","last_clean":"2024-09-11T22:13:39.306006+0000","last_became_active":"2024-09-11T22:13:39.301361+0000","last_became_peered":"2024-09-11T22:13:39.301361+0000","last_unstale":"2024-09-11T22:13:39.306006+0000","last_undegraded":"2024-09-11T22:13:39.306006+0000","last_fullsized":"2024-09-11T22:13:39.306006+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:36.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.301027+0000","last_change":"2024-09-11T22:13:39.301027+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.301027+0000","last_undegraded":"2024-09-11T22:13:39.301027+0000","last_fullsized":"2024-09-11T22:13:39.301027+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.306177+0000","last_change":"2024-09-11T22:13:39.301699+0000","last_active":"2024-09-11T22:13:39.306177+0000","last_peered":"2024-09-11T22:13:39.306177+0000","last_clean":"2024-09-11T22:13:39.306177+0000","last_became_active":"2024-09-11T22:13:39.301425+0000","last_became_peered":"2024-09-11T22:13:39.301425+0000","last_unstale":"2024-09-11T22:13:39.306177+0000","last_undegraded":"2024-09-11T22:13:39.306177+0000","last_fullsized":"2024-09-11T22:13:39.306177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:59.541599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302985+0000","last_change":"2024-09-11T22:13:39.302985+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302985+0000","last_undegraded":"2024-09-11T22:13:39.302985+0000","last_fullsized":"2024-09-11T22:13:39.302985+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.315464+0000","last_change":"2024-09-11T22:13:39.313695+0000","last_active":"2024-09-11T22:13:39.315464+0000","last_peered":"2024-09-11T22:13:39.315464+0000","last_clean":"2024-09-11T22:13:39.315464+0000","last_became_active":"2024-09-11T22:13:39.313451+0000","last_became_peered":"2024-09-11T22:13:39.313451+0000","last_unstale":"2024-09-11T22:13:39.315464+0000","last_undegraded":"2024-09-11T22:13:39.315464+0000","last_fullsized":"2024-09-11T22:13:39.315464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:04.530461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302832+0000","last_change":"2024-09-11T22:13:39.302832+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302832+0000","last_undegraded":"2024-09-11T22:13:39.302832+0000","last_fullsized":"2024-09-11T22:13:39.302832+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313179+0000","last_change":"2024-09-11T22:13:39.310453+0000","last_active":"2024-09-11T22:13:39.313179+0000","last_peered":"2024-09-11T22:13:39.313179+0000","last_clean":"2024-09-11T22:13:39.313179+0000","last_became_active":"2024-09-11T22:13:39.310186+0000","last_became_peered":"2024-09-11T22:13:39.310186+0000","last_unstale":"2024-09-11T22:13:39.313179+0000","last_undegraded":"2024-09-11T22:13:39.313179+0000","last_fullsized":"2024-09-11T22:13:39.313179+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:59.541599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.297711+0000","last_change":"2024-09-11T22:13:39.297711+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.297711+0000","last_undegraded":"2024-09-11T22:13:39.297711+0000","last_fullsized":"2024-09-11T22:13:39.297711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.309772+0000","last_change":"2024-09-11T22:13:39.308391+0000","last_active":"2024-09-11T22:13:39.309772+0000","last_peered":"2024-09-11T22:13:39.309772+0000","last_clean":"2024-09-11T22:13:39.309772+0000","last_became_active":"2024-09-11T22:13:39.307774+0000","last_became_peered":"2024-09-11T22:13:39.307774+0000","last_unstale":"2024-09-11T22:13:39.309772+0000","last_undegraded":"2024-09-11T22:13:39.309772+0000","last_fullsized":"2024-09-11T22:13:39.309772+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:00.780320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304123+0000","last_change":"2024-09-11T22:13:40.319478+0000","last_active":"2024-09-11T22:13:41.304123+0000","last_peered":"2024-09-11T22:13:41.304123+0000","last_clean":"2024-09-11T22:13:41.304123+0000","last_became_active":"2024-09-11T22:13:40.319188+0000","last_became_peered":"2024-09-11T22:13:40.319188+0000","last_unstale":"2024-09-11T22:13:41.304123+0000","last_undegraded":"2024-09-11T22:13:41.304123+0000","last_fullsized":"2024-09-11T22:13:41.304123+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:14:31.828880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.314263+0000","last_change":"2024-09-11T22:13:39.310780+0000","last_active":"2024-09-11T22:13:39.314263+0000","last_peered":"2024-09-11T22:13:39.314263+0000","last_clean":"2024-09-11T22:13:39.314263+0000","last_became_active":"2024-09-11T22:13:39.310504+0000","last_became_peered":"2024-09-11T22:13:39.310504+0000","last_unstale":"2024-09-11T22:13:39.314263+0000","last_undegraded":"2024-09-11T22:13:39.314263+0000","last_fullsized":"2024-09-11T22:13:39.314263+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:54.307397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299655+0000","last_change":"2024-09-11T22:13:39.299655+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299655+0000","last_undegraded":"2024-09-11T22:13:39.299655+0000","last_fullsized":"2024-09-11T22:13:39.299655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785081+0000","last_change":"2024-09-11T22:13:39.312641+0000","last_active":"2024-09-11T22:13:41.785081+0000","last_peered":"2024-09-11T22:13:41.785081+0000","last_clean":"2024-09-11T22:13:41.785081+0000","last_became_active":"2024-09-11T22:13:39.312308+0000","last_became_peered":"2024-09-11T22:13:39.312308+0000","last_unstale":"2024-09-11T22:13:41.785081+0000","last_undegraded":"2024-09-11T22:13:41.785081+0000","last_fullsized":"2024-09-11T22:13:41.785081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:56.314599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304128+0000","last_change":"2024-09-11T22:13:39.304128+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304128+0000","last_undegraded":"2024-09-11T22:13:39.304128+0000","last_fullsized":"2024-09-11T22:13:39.304128+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.315517+0000","last_change":"2024-09-11T22:13:39.313694+0000","last_active":"2024-09-11T22:13:39.315517+0000","last_peered":"2024-09-11T22:13:39.315517+0000","last_clean":"2024-09-11T22:13:39.315517+0000","last_became_active":"2024-09-11T22:13:39.312332+0000","last_became_peered":"2024-09-11T22:13:39.312332+0000","last_unstale":"2024-09-11T22:13:39.315517+0000","last_undegraded":"2024-09-11T22:13:39.315517+0000","last_fullsized":"2024-09-11T22:13:39.315517+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:24.994673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.298863+0000","last_change":"2024-09-11T22:13:39.298863+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.298863+0000","last_undegraded":"2024-09-11T22:13:39.298863+0000","last_fullsized":"2024-09-11T22:13:39.298863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785072+0000","last_change":"2024-09-11T22:13:39.310708+0000","last_active":"2024-09-11T22:13:41.785072+0000","last_peered":"2024-09-11T22:13:41.785072+0000","last_clean":"2024-09-11T22:13:41.785072+0000","last_became_active":"2024-09-11T22:13:39.310463+0000","last_became_peered":"2024-09-11T22:13:39.310463+0000","last_unstale":"2024-09-11T22:13:41.785072+0000","last_undegraded":"2024-09-11T22:13:41.785072+0000","last_fullsized":"2024-09-11T22:13:41.785072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:51.589071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784826+0000","last_change":"2024-09-11T22:13:40.318581+0000","last_active":"2024-09-11T22:13:41.784826+0000","last_peered":"2024-09-11T22:13:41.784826+0000","last_clean":"2024-09-11T22:13:41.784826+0000","last_became_active":"2024-09-11T22:13:40.318311+0000","last_became_peered":"2024-09-11T22:13:40.318311+0000","last_unstale":"2024-09-11T22:13:41.784826+0000","last_undegraded":"2024-09-11T22:13:41.784826+0000","last_fullsized":"2024-09-11T22:13:41.784826+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:33.291942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.305898+0000","last_change":"2024-09-11T22:13:39.303899+0000","last_active":"2024-09-11T22:13:39.305898+0000","last_peered":"2024-09-11T22:13:39.305898+0000","last_clean":"2024-09-11T22:13:39.305898+0000","last_became_active":"2024-09-11T22:13:39.303546+0000","last_became_peered":"2024-09-11T22:13:39.303546+0000","last_unstale":"2024-09-11T22:13:39.305898+0000","last_undegraded":"2024-09-11T22:13:39.305898+0000","last_fullsized":"2024-09-11T22:13:39.305898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:32.926373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.302364+0000","last_change":"2024-09-11T22:13:39.302364+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.302364+0000","last_undegraded":"2024-09-11T22:13:39.302364+0000","last_fullsized":"2024-09-11T22:13:39.302364+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785042+0000","last_change":"2024-09-11T22:13:39.308982+0000","last_active":"2024-09-11T22:13:41.785042+0000","last_peered":"2024-09-11T22:13:41.785042+0000","last_clean":"2024-09-11T22:13:41.785042+0000","last_became_active":"2024-09-11T22:13:39.308701+0000","last_became_peered":"2024-09-11T22:13:39.308701+0000","last_unstale":"2024-09-11T22:13:41.785042+0000","last_undegraded":"2024-09-11T22:13:41.785042+0000","last_fullsized":"2024-09-11T22:13:41.785042+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:24.944146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.304322+0000","last_change":"2024-09-11T22:13:39.304322+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.304322+0000","last_undegraded":"2024-09-11T22:13:39.304322+0000","last_fullsized":"2024-09-11T22:13:39.304322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.310345+0000","last_change":"2024-09-11T22:13:39.307907+0000","last_active":"2024-09-11T22:13:39.310345+0000","last_peered":"2024-09-11T22:13:39.310345+0000","last_clean":"2024-09-11T22:13:39.310345+0000","last_became_active":"2024-09-11T22:13:39.307599+0000","last_became_peered":"2024-09-11T22:13:39.307599+0000","last_unstale":"2024-09-11T22:13:39.310345+0000","last_undegraded":"2024-09-11T22:13:39.310345+0000","last_fullsized":"2024-09-11T22:13:39.310345+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:34.308981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.295581+0000","last_change":"2024-09-11T22:13:39.295581+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.295581+0000","last_undegraded":"2024-09-11T22:13:39.295581+0000","last_fullsized":"2024-09-11T22:13:39.295581+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.313276+0000","last_change":"2024-09-11T22:13:39.312580+0000","last_active":"2024-09-11T22:13:39.313276+0000","last_peered":"2024-09-11T22:13:39.313276+0000","last_clean":"2024-09-11T22:13:39.313276+0000","last_became_active":"2024-09-11T22:13:39.312239+0000","last_became_peered":"2024-09-11T22:13:39.312239+0000","last_unstale":"2024-09-11T22:13:39.313276+0000","last_undegraded":"2024-09-11T22:13:39.313276+0000","last_fullsized":"2024-09-11T22:13:39.313276+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:24.275744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.296248+0000","last_change":"2024-09-11T22:13:39.296248+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.296248+0000","last_undegraded":"2024-09-11T22:13:39.296248+0000","last_fullsized":"2024-09-11T22:13:39.296248+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.312310+0000","last_change":"2024-09-11T22:13:39.310777+0000","last_active":"2024-09-11T22:13:39.312310+0000","last_peered":"2024-09-11T22:13:39.312310+0000","last_clean":"2024-09-11T22:13:39.312310+0000","last_became_active":"2024-09-11T22:13:39.310498+0000","last_became_peered":"2024-09-11T22:13:39.310498+0000","last_unstale":"2024-09-11T22:13:39.312310+0000","last_undegraded":"2024-09-11T22:13:39.312310+0000","last_fullsized":"2024-09-11T22:13:39.312310+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.118478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-11T22:13:39.299434+0000","last_change":"2024-09-11T22:13:39.299434+0000","last_active":"2024-09-11T22:13:39.287000+0000","last_peered":"2024-09-11T22:13:39.287000+0000","last_clean":"2024-09-11T22:13:39.287000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:13:39.299434+0000","last_undegraded":"2024-09-11T22:13:39.299434+0000","last_fullsized":"2024-09-11T22:13:39.299434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T22:13:39.315210+0000","last_change":"2024-09-11T22:13:39.310021+0000","last_active":"2024-09-11T22:13:39.315210+0000","last_peered":"2024-09-11T22:13:39.315210+0000","last_clean":"2024-09-11T22:13:39.315210+0000","last_became_active":"2024-09-11T22:13:39.309718+0000","last_became_peered":"2024-09-11T22:13:39.309718+0000","last_unstale":"2024-09-11T22:13:39.315210+0000","last_undegraded":"2024-09-11T22:13:39.315210+0000","last_fullsized":"2024-09-11T22:13:39.315210+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:40.089668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":213,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785129+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:13:41.785129+0000","last_peered":"2024-09-11T22:13:41.785129+0000","last_clean":"2024-09-11T22:13:41.785129+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:13:41.785129+0000","last_undegraded":"2024-09-11T22:13:41.785129+0000","last_fullsized":"2024-09-11T22:13:41.785129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1724,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35832,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336008,"statfs":{"total":96636764160,"available":96600072192,"internally_reserved":0,"allocated":495616,"data_stored":198405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35820,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":483328,"data_stored":192138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35820,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":483328,"data_stored":192138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":483328,"data_stored":192138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44156,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327684,"statfs":{"total":96636764160,"available":96591548416,"internally_reserved":0,"allocated":495616,"data_stored":198405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36400,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335440,"statfs":{"total":96636764160,"available":96599490560,"internally_reserved":0,"allocated":1077248,"data_stored":782506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36436,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335404,"statfs":{"total":96636764160,"available":96599453696,"internally_reserved":0,"allocated":1105920,"data_stored":795638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":524288,"data_stored":206814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:13:44.989 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3e is not active+clean 2024-09-11T22:13:44.989 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.297744+0000', 'last_change': '2024-09-11T22:13:39.297744+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.297744+0000', 'last_undegraded': '2024-09-11T22:13:39.297744+0000', 'last_fullsized': '2024-09-11T22:13:39.297744+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:13:44.989 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3d is not active+clean 2024-09-11T22:13:44.989 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.296494+0000', 'last_change': '2024-09-11T22:13:39.296494+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.296494+0000', 'last_undegraded': '2024-09-11T22:13:39.296494+0000', 'last_fullsized': '2024-09-11T22:13:39.296494+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:13:44.989 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-09-11T22:13:44.989 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.300662+0000', 'last_change': '2024-09-11T22:13:39.300662+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.300662+0000', 'last_undegraded': '2024-09-11T22:13:39.300662+0000', 'last_fullsized': '2024-09-11T22:13:39.300662+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:44.989 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3b is not active+clean 2024-09-11T22:13:44.989 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.297123+0000', 'last_change': '2024-09-11T22:13:39.297123+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.297123+0000', 'last_undegraded': '2024-09-11T22:13:39.297123+0000', 'last_fullsized': '2024-09-11T22:13:39.297123+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:13:44.990 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3a is not active+clean 2024-09-11T22:13:44.990 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.303442+0000', 'last_change': '2024-09-11T22:13:39.303442+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.303442+0000', 'last_undegraded': '2024-09-11T22:13:39.303442+0000', 'last_fullsized': '2024-09-11T22:13:39.303442+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:13:44.990 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-09-11T22:13:44.990 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.300619+0000', 'last_change': '2024-09-11T22:13:39.300619+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.300619+0000', 'last_undegraded': '2024-09-11T22:13:39.300619+0000', 'last_fullsized': '2024-09-11T22:13:39.300619+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:44.990 INFO:tasks.ceph.ceph_manager.ceph:PG 7.37 is not active+clean 2024-09-11T22:13:44.990 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.300820+0000', 'last_change': '2024-09-11T22:13:39.300820+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.300820+0000', 'last_undegraded': '2024-09-11T22:13:39.300820+0000', 'last_fullsized': '2024-09-11T22:13:39.300820+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:44.990 INFO:tasks.ceph.ceph_manager.ceph:PG 7.36 is not active+clean 2024-09-11T22:13:44.990 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.299878+0000', 'last_change': '2024-09-11T22:13:39.299878+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.299878+0000', 'last_undegraded': '2024-09-11T22:13:39.299878+0000', 'last_fullsized': '2024-09-11T22:13:39.299878+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:44.991 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-09-11T22:13:44.991 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.298724+0000', 'last_change': '2024-09-11T22:13:39.298724+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.298724+0000', 'last_undegraded': '2024-09-11T22:13:39.298724+0000', 'last_fullsized': '2024-09-11T22:13:39.298724+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:44.991 INFO:tasks.ceph.ceph_manager.ceph:PG 7.34 is not active+clean 2024-09-11T22:13:44.991 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.298357+0000', 'last_change': '2024-09-11T22:13:39.298357+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.298357+0000', 'last_undegraded': '2024-09-11T22:13:39.298357+0000', 'last_fullsized': '2024-09-11T22:13:39.298357+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:13:44.992 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-09-11T22:13:44.992 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.300326+0000', 'last_change': '2024-09-11T22:13:39.300326+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.300326+0000', 'last_undegraded': '2024-09-11T22:13:39.300326+0000', 'last_fullsized': '2024-09-11T22:13:39.300326+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:44.992 INFO:tasks.ceph.ceph_manager.ceph:PG 7.31 is not active+clean 2024-09-11T22:13:44.992 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.304400+0000', 'last_change': '2024-09-11T22:13:39.304400+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.304400+0000', 'last_undegraded': '2024-09-11T22:13:39.304400+0000', 'last_fullsized': '2024-09-11T22:13:39.304400+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:13:44.992 INFO:tasks.ceph.ceph_manager.ceph:PG 7.30 is not active+clean 2024-09-11T22:13:44.992 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.301312+0000', 'last_change': '2024-09-11T22:13:39.301312+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.301312+0000', 'last_undegraded': '2024-09-11T22:13:39.301312+0000', 'last_fullsized': '2024-09-11T22:13:39.301312+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:13:44.992 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2f is not active+clean 2024-09-11T22:13:44.992 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.296968+0000', 'last_change': '2024-09-11T22:13:39.296968+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.296968+0000', 'last_undegraded': '2024-09-11T22:13:39.296968+0000', 'last_fullsized': '2024-09-11T22:13:39.296968+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:13:44.992 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2e is not active+clean 2024-09-11T22:13:44.992 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.297494+0000', 'last_change': '2024-09-11T22:13:39.297494+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.297494+0000', 'last_undegraded': '2024-09-11T22:13:39.297494+0000', 'last_fullsized': '2024-09-11T22:13:39.297494+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:13:44.992 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2d is not active+clean 2024-09-11T22:13:44.993 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.302296+0000', 'last_change': '2024-09-11T22:13:39.302296+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.302296+0000', 'last_undegraded': '2024-09-11T22:13:39.302296+0000', 'last_fullsized': '2024-09-11T22:13:39.302296+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:13:44.993 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2b is not active+clean 2024-09-11T22:13:44.993 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.304800+0000', 'last_change': '2024-09-11T22:13:39.304800+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.304800+0000', 'last_undegraded': '2024-09-11T22:13:39.304800+0000', 'last_fullsized': '2024-09-11T22:13:39.304800+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:13:44.993 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-09-11T22:13:44.993 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.299865+0000', 'last_change': '2024-09-11T22:13:39.299865+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.299865+0000', 'last_undegraded': '2024-09-11T22:13:39.299865+0000', 'last_fullsized': '2024-09-11T22:13:39.299865+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:44.993 INFO:tasks.ceph.ceph_manager.ceph:PG 7.29 is not active+clean 2024-09-11T22:13:44.993 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.303267+0000', 'last_change': '2024-09-11T22:13:39.303267+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.303267+0000', 'last_undegraded': '2024-09-11T22:13:39.303267+0000', 'last_fullsized': '2024-09-11T22:13:39.303267+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:13:44.993 INFO:tasks.ceph.ceph_manager.ceph:PG 7.28 is not active+clean 2024-09-11T22:13:44.993 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.300814+0000', 'last_change': '2024-09-11T22:13:39.300814+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.300814+0000', 'last_undegraded': '2024-09-11T22:13:39.300814+0000', 'last_fullsized': '2024-09-11T22:13:39.300814+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:13:44.993 INFO:tasks.ceph.ceph_manager.ceph:PG 7.27 is not active+clean 2024-09-11T22:13:44.993 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.303234+0000', 'last_change': '2024-09-11T22:13:39.303234+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.303234+0000', 'last_undegraded': '2024-09-11T22:13:39.303234+0000', 'last_fullsized': '2024-09-11T22:13:39.303234+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:13:44.994 INFO:tasks.ceph.ceph_manager.ceph:PG 7.25 is not active+clean 2024-09-11T22:13:44.994 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.295770+0000', 'last_change': '2024-09-11T22:13:39.295770+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.295770+0000', 'last_undegraded': '2024-09-11T22:13:39.295770+0000', 'last_fullsized': '2024-09-11T22:13:39.295770+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:13:44.994 INFO:tasks.ceph.ceph_manager.ceph:PG 7.24 is not active+clean 2024-09-11T22:13:44.994 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.297918+0000', 'last_change': '2024-09-11T22:13:39.297918+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.297918+0000', 'last_undegraded': '2024-09-11T22:13:39.297918+0000', 'last_fullsized': '2024-09-11T22:13:39.297918+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:13:44.994 INFO:tasks.ceph.ceph_manager.ceph:PG 7.23 is not active+clean 2024-09-11T22:13:44.994 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.301466+0000', 'last_change': '2024-09-11T22:13:39.301466+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.301466+0000', 'last_undegraded': '2024-09-11T22:13:39.301466+0000', 'last_fullsized': '2024-09-11T22:13:39.301466+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:13:44.994 INFO:tasks.ceph.ceph_manager.ceph:PG 7.22 is not active+clean 2024-09-11T22:13:44.994 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.298188+0000', 'last_change': '2024-09-11T22:13:39.298188+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.298188+0000', 'last_undegraded': '2024-09-11T22:13:39.298188+0000', 'last_fullsized': '2024-09-11T22:13:39.298188+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:13:44.994 INFO:tasks.ceph.ceph_manager.ceph:PG 7.21 is not active+clean 2024-09-11T22:13:44.994 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.303924+0000', 'last_change': '2024-09-11T22:13:39.303924+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.303924+0000', 'last_undegraded': '2024-09-11T22:13:39.303924+0000', 'last_fullsized': '2024-09-11T22:13:39.303924+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:13:44.994 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-09-11T22:13:44.995 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.298295+0000', 'last_change': '2024-09-11T22:13:39.298295+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.298295+0000', 'last_undegraded': '2024-09-11T22:13:39.298295+0000', 'last_fullsized': '2024-09-11T22:13:39.298295+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:13:44.995 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-09-11T22:13:44.995 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.304897+0000', 'last_change': '2024-09-11T22:13:39.304897+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.304897+0000', 'last_undegraded': '2024-09-11T22:13:39.304897+0000', 'last_fullsized': '2024-09-11T22:13:39.304897+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:13:44.995 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-09-11T22:13:44.995 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.297411+0000', 'last_change': '2024-09-11T22:13:39.297411+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.297411+0000', 'last_undegraded': '2024-09-11T22:13:39.297411+0000', 'last_fullsized': '2024-09-11T22:13:39.297411+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:13:44.995 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-09-11T22:13:44.995 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.298315+0000', 'last_change': '2024-09-11T22:13:39.298315+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.298315+0000', 'last_undegraded': '2024-09-11T22:13:39.298315+0000', 'last_fullsized': '2024-09-11T22:13:39.298315+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:13:44.995 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-09-11T22:13:44.995 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.297439+0000', 'last_change': '2024-09-11T22:13:39.297439+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.297439+0000', 'last_undegraded': '2024-09-11T22:13:39.297439+0000', 'last_fullsized': '2024-09-11T22:13:39.297439+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:13:44.995 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-09-11T22:13:44.995 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.301271+0000', 'last_change': '2024-09-11T22:13:39.301271+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.301271+0000', 'last_undegraded': '2024-09-11T22:13:39.301271+0000', 'last_fullsized': '2024-09-11T22:13:39.301271+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:44.996 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-09-11T22:13:44.996 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.298718+0000', 'last_change': '2024-09-11T22:13:39.298718+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.298718+0000', 'last_undegraded': '2024-09-11T22:13:39.298718+0000', 'last_fullsized': '2024-09-11T22:13:39.298718+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:44.996 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-09-11T22:13:44.996 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.305012+0000', 'last_change': '2024-09-11T22:13:39.305012+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.305012+0000', 'last_undegraded': '2024-09-11T22:13:39.305012+0000', 'last_fullsized': '2024-09-11T22:13:39.305012+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:13:44.996 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-09-11T22:13:44.996 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.296932+0000', 'last_change': '2024-09-11T22:13:39.296932+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.296932+0000', 'last_undegraded': '2024-09-11T22:13:39.296932+0000', 'last_fullsized': '2024-09-11T22:13:39.296932+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:13:44.996 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-09-11T22:13:44.996 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.307094+0000', 'last_change': '2024-09-11T22:13:39.307094+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.307094+0000', 'last_undegraded': '2024-09-11T22:13:39.307094+0000', 'last_fullsized': '2024-09-11T22:13:39.307094+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:13:44.996 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-09-11T22:13:44.996 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.302420+0000', 'last_change': '2024-09-11T22:13:39.302420+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.302420+0000', 'last_undegraded': '2024-09-11T22:13:39.302420+0000', 'last_fullsized': '2024-09-11T22:13:39.302420+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:13:44.996 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-09-11T22:13:44.997 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.300848+0000', 'last_change': '2024-09-11T22:13:39.300848+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.300848+0000', 'last_undegraded': '2024-09-11T22:13:39.300848+0000', 'last_fullsized': '2024-09-11T22:13:39.300848+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:44.997 INFO:tasks.ceph.ceph_manager.ceph:PG 7.10 is not active+clean 2024-09-11T22:13:44.997 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.307436+0000', 'last_change': '2024-09-11T22:13:39.307436+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.307436+0000', 'last_undegraded': '2024-09-11T22:13:39.307436+0000', 'last_fullsized': '2024-09-11T22:13:39.307436+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:13:44.997 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-09-11T22:13:44.997 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.299015+0000', 'last_change': '2024-09-11T22:13:39.299015+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.299015+0000', 'last_undegraded': '2024-09-11T22:13:39.299015+0000', 'last_fullsized': '2024-09-11T22:13:39.299015+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:44.997 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-09-11T22:13:44.997 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.301027+0000', 'last_change': '2024-09-11T22:13:39.301027+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.301027+0000', 'last_undegraded': '2024-09-11T22:13:39.301027+0000', 'last_fullsized': '2024-09-11T22:13:39.301027+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:13:44.997 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-09-11T22:13:44.998 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.302985+0000', 'last_change': '2024-09-11T22:13:39.302985+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.302985+0000', 'last_undegraded': '2024-09-11T22:13:39.302985+0000', 'last_fullsized': '2024-09-11T22:13:39.302985+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:13:44.998 INFO:tasks.ceph.ceph_manager.ceph:PG 7.a is not active+clean 2024-09-11T22:13:44.998 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.302832+0000', 'last_change': '2024-09-11T22:13:39.302832+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.302832+0000', 'last_undegraded': '2024-09-11T22:13:39.302832+0000', 'last_fullsized': '2024-09-11T22:13:39.302832+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:13:44.998 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-09-11T22:13:44.998 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.297711+0000', 'last_change': '2024-09-11T22:13:39.297711+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.297711+0000', 'last_undegraded': '2024-09-11T22:13:39.297711+0000', 'last_fullsized': '2024-09-11T22:13:39.297711+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:13:44.998 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-11T22:13:44.998 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.299655+0000', 'last_change': '2024-09-11T22:13:39.299655+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.299655+0000', 'last_undegraded': '2024-09-11T22:13:39.299655+0000', 'last_fullsized': '2024-09-11T22:13:39.299655+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:44.998 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-09-11T22:13:44.998 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.304128+0000', 'last_change': '2024-09-11T22:13:39.304128+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.304128+0000', 'last_undegraded': '2024-09-11T22:13:39.304128+0000', 'last_fullsized': '2024-09-11T22:13:39.304128+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:13:44.998 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-09-11T22:13:44.999 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.298863+0000', 'last_change': '2024-09-11T22:13:39.298863+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.298863+0000', 'last_undegraded': '2024-09-11T22:13:39.298863+0000', 'last_fullsized': '2024-09-11T22:13:39.298863+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:44.999 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2 is not active+clean 2024-09-11T22:13:44.999 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.302364+0000', 'last_change': '2024-09-11T22:13:39.302364+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.302364+0000', 'last_undegraded': '2024-09-11T22:13:39.302364+0000', 'last_fullsized': '2024-09-11T22:13:39.302364+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:13:44.999 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-09-11T22:13:44.999 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.304322+0000', 'last_change': '2024-09-11T22:13:39.304322+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.304322+0000', 'last_undegraded': '2024-09-11T22:13:39.304322+0000', 'last_fullsized': '2024-09-11T22:13:39.304322+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:13:44.999 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-09-11T22:13:44.999 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.295581+0000', 'last_change': '2024-09-11T22:13:39.295581+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.295581+0000', 'last_undegraded': '2024-09-11T22:13:39.295581+0000', 'last_fullsized': '2024-09-11T22:13:39.295581+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:13:44.999 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-09-11T22:13:44.999 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.296248+0000', 'last_change': '2024-09-11T22:13:39.296248+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.296248+0000', 'last_undegraded': '2024-09-11T22:13:39.296248+0000', 'last_fullsized': '2024-09-11T22:13:39.296248+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:13:44.999 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-11T22:13:45.000 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:13:39.299434+0000', 'last_change': '2024-09-11T22:13:39.299434+0000', 'last_active': '2024-09-11T22:13:39.287000+0000', 'last_peered': '2024-09-11T22:13:39.287000+0000', 'last_clean': '2024-09-11T22:13:39.287000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:13:39.299434+0000', 'last_undegraded': '2024-09-11T22:13:39.299434+0000', 'last_fullsized': '2024-09-11T22:13:39.299434+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'last_clean_scrub_stamp': '2024-09-11T22:13:39.287000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:13:45.000 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:13:45.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.126+0000 7fcbb52ba640 1 Processor -- start 2024-09-11T22:13:45.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.126+0000 7fcbb52ba640 1 -- start start 2024-09-11T22:13:45.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.127+0000 7fcbb52ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbb00d18a0 0x7fcbb00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.127+0000 7fcbb52ba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcbb00d3a30 0x7fcbb00b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.127+0000 7fcbb52ba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbb00cfa80 con 0x7fcbb015e870 2024-09-11T22:13:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.127+0000 7fcbb52ba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fcbb00d3ea0 con 0x7fcbb00d18a0 2024-09-11T22:13:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.127+0000 7fcbb52ba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcbb00d40d0 con 0x7fcbb00d3a30 2024-09-11T22:13:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.127+0000 7fcbae7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbb00d18a0 0x7fcbb00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.127+0000 7fcbae7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcbb00d18a0 0x7fcbb00d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35456/0 (socket says 172.21.15.50:35456) 2024-09-11T22:13:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.127+0000 7fcbae7fc640 1 -- 172.21.15.50:0/3586758076 learned_addr learned my addr 172.21.15.50:0/3586758076 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.127+0000 7fcbaeffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcbb015e870 0x7fcbb00d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60984/0 (socket says 172.21.15.50:60984) 2024-09-11T22:13:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.128+0000 7fcbaf7fe640 1 --2- 172.21.15.50:0/3586758076 >> v2:172.21.15.77:3300/0 conn(0x7fcbb00d3a30 0x7fcbb00b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.128+0000 7fcbae7fc640 1 -- 172.21.15.50:0/3586758076 >> v2:172.21.15.77:3300/0 conn(0x7fcbb00d3a30 msgr2=0x7fcbb00b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.128+0000 7fcbae7fc640 1 --2- 172.21.15.50:0/3586758076 >> v2:172.21.15.77:3300/0 conn(0x7fcbb00d3a30 0x7fcbb00b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.128+0000 7fcbadffb640 1 -- 172.21.15.50:0/3586758076 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610483646 0 0) 0x7fcba8001110 con 0x7fcbb015e870 2024-09-11T22:13:45.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.128+0000 7fcbae7fc640 1 -- 172.21.15.50:0/3586758076 >> v1:172.21.15.50:6789/0 conn(0x7fcbb015e870 legacy=0x7fcbb00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:45.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.128+0000 7fcbae7fc640 1 -- 172.21.15.50:0/3586758076 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb00d43b0 con 0x7fcbb00d18a0 2024-09-11T22:13:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.128+0000 7fcbae7fc640 1 --2- 172.21.15.50:0/3586758076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb00d18a0 0x7fcbb00d34f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00684c0 tx=0x7fcb9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f0cca352564b09 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.129+0000 7fcbadffb640 1 -- 172.21.15.50:0/3586758076 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98037070 con 0x7fcbb00d18a0 2024-09-11T22:13:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.129+0000 7fcbadffb640 1 -- 172.21.15.50:0/3586758076 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb98032440 con 0x7fcbb00d18a0 2024-09-11T22:13:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.129+0000 7fcbadffb640 1 -- 172.21.15.50:0/3586758076 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98032810 con 0x7fcbb00d18a0 2024-09-11T22:13:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.129+0000 7fcbb52ba640 1 -- 172.21.15.50:0/3586758076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb00d18a0 msgr2=0x7fcbb00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.129+0000 7fcbb52ba640 1 --2- 172.21.15.50:0/3586758076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb00d18a0 0x7fcbb00d34f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00684c0 tx=0x7fcb9802a270 comp rx=0 tx=0).stop 2024-09-11T22:13:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.129+0000 7fcbb52ba640 1 -- 172.21.15.50:0/3586758076 shutdown_connections 2024-09-11T22:13:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.129+0000 7fcbb52ba640 1 --2- 172.21.15.50:0/3586758076 >> v2:172.21.15.77:3300/0 conn(0x7fcbb00d3a30 0x7fcbb00b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.129+0000 7fcbb52ba640 1 --2- 172.21.15.50:0/3586758076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb00d18a0 0x7fcbb00d34f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.129+0000 7fcbb52ba640 1 -- 172.21.15.50:0/3586758076 >> 172.21.15.50:0/3586758076 conn(0x7fcbb00727a0 msgr2=0x7fcbb00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.129+0000 7fcbb52ba640 1 -- 172.21.15.50:0/3586758076 shutdown_connections 2024-09-11T22:13:45.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.129+0000 7fcbb52ba640 1 -- 172.21.15.50:0/3586758076 wait complete. 2024-09-11T22:13:45.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.131+0000 7fcbb52ba640 1 Processor -- start 2024-09-11T22:13:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.131+0000 7fcbb52ba640 1 -- start start 2024-09-11T22:13:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.131+0000 7fcbb52ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb00d18a0 0x7fcbb00b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.131+0000 7fcbb52ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcbb00d3a30 0x7fcbb0160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.131+0000 7fcbb52ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb015e870 0x7fcbb00ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.131+0000 7fcbb52ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb015ec50 con 0x7fcbb015e870 2024-09-11T22:13:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.131+0000 7fcbb52ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb00b7ee0 con 0x7fcbb00d18a0 2024-09-11T22:13:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.131+0000 7fcbb52ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb00b78b0 con 0x7fcbb00d3a30 2024-09-11T22:13:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.131+0000 7fcbaf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb015e870 0x7fcbb00ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcbaeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb00d18a0 0x7fcbb00b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcbaf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb015e870 0x7fcbb00ab180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35464/0 (socket says 172.21.15.50:35464) 2024-09-11T22:13:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcbae7fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcbb00d3a30 0x7fcbb0160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcbaf7fe640 1 -- 172.21.15.50:0/2973838601 learned_addr learned my addr 172.21.15.50:0/2973838601 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:45.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcbaf7fe640 1 -- 172.21.15.50:0/2973838601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcbb00d3a30 msgr2=0x7fcbb0160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcbaf7fe640 1 --2- 172.21.15.50:0/2973838601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcbb00d3a30 0x7fcbb0160240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcbaf7fe640 1 -- 172.21.15.50:0/2973838601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb00d18a0 msgr2=0x7fcbb00b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcbaf7fe640 1 --2- 172.21.15.50:0/2973838601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb00d18a0 0x7fcbb00b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcbaf7fe640 1 -- 172.21.15.50:0/2973838601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb0161ca0 con 0x7fcbb015e870 2024-09-11T22:13:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcbaf7fe640 1 --2- 172.21.15.50:0/2973838601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb015e870 0x7fcbb00ab180 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcba0007e70 tx=0x7fcba000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcba77fe640 1 -- 172.21.15.50:0/2973838601 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba0014620 con 0x7fcbb015e870 2024-09-11T22:13:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcba77fe640 1 -- 172.21.15.50:0/2973838601 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba0019070 con 0x7fcbb015e870 2024-09-11T22:13:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcbb52ba640 1 -- 172.21.15.50:0/2973838601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb0160c00 con 0x7fcbb015e870 2024-09-11T22:13:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcba77fe640 1 -- 172.21.15.50:0/2973838601 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba0014a20 con 0x7fcbb015e870 2024-09-11T22:13:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.132+0000 7fcbb52ba640 1 -- 172.21.15.50:0/2973838601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb01611c0 con 0x7fcbb015e870 2024-09-11T22:13:45.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.133+0000 7fcbb52ba640 1 -- 172.21.15.50:0/2973838601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb00b9a20 con 0x7fcbb015e870 2024-09-11T22:13:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.134+0000 7fcba77fe640 1 -- 172.21.15.50:0/2973838601 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcba0014bc0 con 0x7fcbb015e870 2024-09-11T22:13:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.134+0000 7fcba77fe640 1 --2- 172.21.15.50:0/2973838601 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb9006be30 0x7fcb9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.134+0000 7fcba77fe640 1 -- 172.21.15.50:0/2973838601 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fcba008b5c0 con 0x7fcbb015e870 2024-09-11T22:13:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.135+0000 7fcbaeffd640 1 --2- 172.21.15.50:0/2973838601 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb9006be30 0x7fcb9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:45.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.135+0000 7fcbaeffd640 1 --2- 172.21.15.50:0/2973838601 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb9006be30 0x7fcb9006e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcba8000f60 tx=0x7fcba8007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:45.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.138+0000 7fcba77fe640 1 -- 172.21.15.50:0/2973838601 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcbb00b9a20 con 0x7fcbb015e870 2024-09-11T22:13:45.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.382+0000 7fcbb52ba640 1 -- 172.21.15.50:0/2973838601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fcbb00d34f0 con 0x7fcbb015e870 2024-09-11T22:13:45.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.382+0000 7fcba77fe640 1 -- 172.21.15.50:0/2973838601 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1141 (secure 0 0 0) 0x7fcba00599b0 con 0x7fcbb015e870 2024-09-11T22:13:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:45.384 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":174,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":52},{"state_name":"active+clean","count":45}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":592092,"bytes_used":311779328,"bytes_avail":772782333952,"bytes_total":773094113280,"inactive_pgs_ratio":0.53608244657516479,"write_bytes_sec":1001,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":23,"btime":"2024-09-11T22:13:43:312858+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5250}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-09-11T22:13:29.395209+0000","services":{}},"progress_events":{}} 2024-09-11T22:13:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.384+0000 7fcbb52ba640 1 -- 172.21.15.50:0/2973838601 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb9006be30 msgr2=0x7fcb9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.384+0000 7fcbb52ba640 1 --2- 172.21.15.50:0/2973838601 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb9006be30 0x7fcb9006e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcba8000f60 tx=0x7fcba8007b50 comp rx=0 tx=0).stop 2024-09-11T22:13:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.384+0000 7fcbb52ba640 1 -- 172.21.15.50:0/2973838601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb015e870 msgr2=0x7fcbb00ab180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.384+0000 7fcbb52ba640 1 --2- 172.21.15.50:0/2973838601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb015e870 0x7fcbb00ab180 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcba0007e70 tx=0x7fcba000e4b0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.384+0000 7fcbb52ba640 1 -- 172.21.15.50:0/2973838601 shutdown_connections 2024-09-11T22:13:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.384+0000 7fcbb52ba640 1 --2- 172.21.15.50:0/2973838601 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb9006be30 0x7fcb9006e2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.384+0000 7fcbb52ba640 1 --2- 172.21.15.50:0/2973838601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcbb00d3a30 0x7fcbb0160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.384+0000 7fcbb52ba640 1 --2- 172.21.15.50:0/2973838601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb015e870 0x7fcbb00ab180 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.384+0000 7fcbb52ba640 1 --2- 172.21.15.50:0/2973838601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb00d18a0 0x7fcbb00b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.384+0000 7fcbb52ba640 1 -- 172.21.15.50:0/2973838601 >> 172.21.15.50:0/2973838601 conn(0x7fcbb00727a0 msgr2=0x7fcbb015da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:45.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.385+0000 7fcbb52ba640 1 -- 172.21.15.50:0/2973838601 shutdown_connections 2024-09-11T22:13:45.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.385+0000 7fcbb52ba640 1 -- 172.21.15.50:0/2973838601 wait complete. 2024-09-11T22:13:45.396 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:13:45.396 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:13:45.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.498+0000 7f164f3b9640 1 Processor -- start 2024-09-11T22:13:45.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.498+0000 7f164f3b9640 1 -- start start 2024-09-11T22:13:45.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.499+0000 7f164f3b9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f164815fd80 0x7f16480b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:45.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.499+0000 7f164f3b9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16480b09e0 0x7f16480b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:45.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.499+0000 7f164f3b9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16480af940 con 0x7f16480af4c0 2024-09-11T22:13:45.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.499+0000 7f164f3b9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f16480d1500 con 0x7f16480b09e0 2024-09-11T22:13:45.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.499+0000 7f164f3b9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f16480afc20 con 0x7f164815fd80 2024-09-11T22:13:45.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.499+0000 7f164d956640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16480b09e0 0x7f16480b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:45.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.500+0000 7f164d956640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16480b09e0 0x7f16480b0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35478/0 (socket says 172.21.15.50:35478) 2024-09-11T22:13:45.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.500+0000 7f164d956640 1 -- 172.21.15.50:0/790831660 learned_addr learned my addr 172.21.15.50:0/790831660 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:45.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.500+0000 7f164d155640 1 --2- 172.21.15.50:0/790831660 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f164815fd80 0x7f16480b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:45.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.500+0000 7f164d956640 1 -- 172.21.15.50:0/790831660 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f164815fd80 msgr2=0x7f16480b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:45.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.500+0000 7f164d956640 1 --2- 172.21.15.50:0/790831660 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f164815fd80 0x7f16480b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.500+0000 7f164d956640 1 -- 172.21.15.50:0/790831660 >> v1:172.21.15.77:6789/0 conn(0x7f16480af4c0 legacy=0x7f16480b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:45.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.500+0000 7f164d956640 1 -- 172.21.15.50:0/790831660 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16480aff00 con 0x7f16480b09e0 2024-09-11T22:13:45.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.501+0000 7f164d956640 1 --2- 172.21.15.50:0/790831660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480b09e0 0x7f16480b0e90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1640009870 tx=0x7f164002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5a78acb1e9e765 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:45.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.501+0000 7f1647fff640 1 -- 172.21.15.50:0/790831660 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1640037070 con 0x7f16480b09e0 2024-09-11T22:13:45.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.501+0000 7f1647fff640 1 -- 172.21.15.50:0/790831660 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1640032440 con 0x7f16480b09e0 2024-09-11T22:13:45.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.501+0000 7f1647fff640 1 -- 172.21.15.50:0/790831660 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1640032810 con 0x7f16480b09e0 2024-09-11T22:13:45.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.501+0000 7f164f3b9640 1 -- 172.21.15.50:0/790831660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480b09e0 msgr2=0x7f16480b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:45.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.501+0000 7f164f3b9640 1 --2- 172.21.15.50:0/790831660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480b09e0 0x7f16480b0e90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1640009870 tx=0x7f164002a180 comp rx=0 tx=0).stop 2024-09-11T22:13:45.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.501+0000 7f164f3b9640 1 -- 172.21.15.50:0/790831660 shutdown_connections 2024-09-11T22:13:45.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.501+0000 7f164f3b9640 1 --2- 172.21.15.50:0/790831660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480b09e0 0x7f16480b0e90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.501+0000 7f164f3b9640 1 --2- 172.21.15.50:0/790831660 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f164815fd80 0x7f16480b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.501+0000 7f164f3b9640 1 -- 172.21.15.50:0/790831660 >> 172.21.15.50:0/790831660 conn(0x7f164809ba50 msgr2=0x7f16480b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:45.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.501+0000 7f164f3b9640 1 -- 172.21.15.50:0/790831660 shutdown_connections 2024-09-11T22:13:45.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.501+0000 7f164f3b9640 1 -- 172.21.15.50:0/790831660 wait complete. 2024-09-11T22:13:45.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.503+0000 7f164f3b9640 1 Processor -- start 2024-09-11T22:13:45.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.503+0000 7f164f3b9640 1 -- start start 2024-09-11T22:13:45.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.503+0000 7f164f3b9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f16480af4c0 0x7f1648156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:45.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.503+0000 7f164f3b9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480b09e0 0x7f164815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:45.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.503+0000 7f164f3b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f164815fd80 0x7f1648070320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:45.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.503+0000 7f164f3b9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f16480b3ee0 con 0x7f16480b09e0 2024-09-11T22:13:45.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.503+0000 7f164f3b9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f16480b04c0 con 0x7f164815fd80 2024-09-11T22:13:45.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.503+0000 7f164f3b9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1648160160 con 0x7f16480af4c0 2024-09-11T22:13:45.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.503+0000 7f164c954640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480b09e0 0x7f164815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:45.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.503+0000 7f164c954640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480b09e0 0x7f164815b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35492/0 (socket says 172.21.15.50:35492) 2024-09-11T22:13:45.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.503+0000 7f164c954640 1 -- 172.21.15.50:0/3789817578 learned_addr learned my addr 172.21.15.50:0/3789817578 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:45.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.504+0000 7f164d956640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f164815fd80 0x7f1648070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:45.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.504+0000 7f164d155640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f16480af4c0 0x7f1648156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:45.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.504+0000 7f164c954640 1 -- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f16480af4c0 msgr2=0x7f1648156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:45.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.504+0000 7f164c954640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f16480af4c0 0x7f1648156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.504+0000 7f164c954640 1 -- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f164815fd80 msgr2=0x7f1648070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:45.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.504+0000 7f164c954640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f164815fd80 0x7f1648070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.504+0000 7f164c954640 1 -- 172.21.15.50:0/3789817578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1648156d70 con 0x7f16480b09e0 2024-09-11T22:13:45.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.504+0000 7f164c954640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480b09e0 0x7f164815b1c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f163c00b410 tx=0x7f163c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:45.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.504+0000 7f1645ffb640 1 -- 172.21.15.50:0/3789817578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c015020 con 0x7f16480b09e0 2024-09-11T22:13:45.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.504+0000 7f1645ffb640 1 -- 172.21.15.50:0/3789817578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163c011830 con 0x7f16480b09e0 2024-09-11T22:13:45.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.504+0000 7f164f3b9640 1 -- 172.21.15.50:0/3789817578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16481f2a30 con 0x7f16480b09e0 2024-09-11T22:13:45.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.504+0000 7f1645ffb640 1 -- 172.21.15.50:0/3789817578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c011c20 con 0x7f16480b09e0 2024-09-11T22:13:45.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.504+0000 7f164f3b9640 1 -- 172.21.15.50:0/3789817578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16481f2ff0 con 0x7f16480b09e0 2024-09-11T22:13:45.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.505+0000 7f164f3b9640 1 -- 172.21.15.50:0/3789817578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16480b0e90 con 0x7f16480b09e0 2024-09-11T22:13:45.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.506+0000 7f1645ffb640 1 -- 172.21.15.50:0/3789817578 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f163c018020 con 0x7f16480b09e0 2024-09-11T22:13:45.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.507+0000 7f1645ffb640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f163406be60 0x7f163406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:45.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.507+0000 7f1645ffb640 1 -- 172.21.15.50:0/3789817578 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f163c08ab60 con 0x7f16480b09e0 2024-09-11T22:13:45.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.507+0000 7f164d155640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f163406be60 0x7f163406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:45.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.508+0000 7f164d155640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f163406be60 0x7f163406e320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1638003aa0 tx=0x7f1638009830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:45.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.511+0000 7f1645ffb640 1 -- 172.21.15.50:0/3789817578 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f163c01f020 con 0x7f16480b09e0 2024-09-11T22:13:45.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.685+0000 7f164f3b9640 1 -- 172.21.15.50:0/3789817578 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16480cc250 con 0x7f163406be60 2024-09-11T22:13:45.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.692+0000 7f1645ffb640 1 -- 172.21.15.50:0/3789817578 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251960 (secure 0 0 0) 0x7f16480cc250 con 0x7f163406be60 2024-09-11T22:13:45.695 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:45.697 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:13:45.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.695+0000 7f164f3b9640 1 -- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f163406be60 msgr2=0x7f163406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.695+0000 7f164f3b9640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f163406be60 0x7f163406e320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1638003aa0 tx=0x7f1638009830 comp rx=0 tx=0).stop 2024-09-11T22:13:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.695+0000 7f164f3b9640 1 -- 172.21.15.50:0/3789817578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480b09e0 msgr2=0x7f164815b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.695+0000 7f164f3b9640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480b09e0 0x7f164815b1c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f163c00b410 tx=0x7f163c00b8d0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.695+0000 7f164f3b9640 1 -- 172.21.15.50:0/3789817578 shutdown_connections 2024-09-11T22:13:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.695+0000 7f164f3b9640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f163406be60 0x7f163406e320 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.695+0000 7f164f3b9640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f164815fd80 0x7f1648070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.695+0000 7f164f3b9640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16480b09e0 0x7f164815b1c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.695+0000 7f164f3b9640 1 --2- 172.21.15.50:0/3789817578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f16480af4c0 0x7f1648156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.695+0000 7f164f3b9640 1 -- 172.21.15.50:0/3789817578 >> 172.21.15.50:0/3789817578 conn(0x7f164809ba50 msgr2=0x7f16480c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.695+0000 7f164f3b9640 1 -- 172.21.15.50:0/3789817578 shutdown_connections 2024-09-11T22:13:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:45.695+0000 7f164f3b9640 1 -- 172.21.15.50:0/3789817578 wait complete. 2024-09-11T22:13:45.706 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-09-11T22:13:45.398295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304716,"kb_used_data":5264,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754670004,"statfs":{"total":773094113280,"available":772782084096,"internally_reserved":0,"allocated":5390336,"data_stored":2864796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":306433585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.105029"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784907+0000","last_change":"2024-09-11T22:13:40.311514+0000","last_active":"2024-09-11T22:13:41.784907+0000","last_peered":"2024-09-11T22:13:41.784907+0000","last_clean":"2024-09-11T22:13:41.784907+0000","last_became_active":"2024-09-11T22:13:40.311230+0000","last_became_peered":"2024-09-11T22:13:40.311230+0000","last_unstale":"2024-09-11T22:13:41.784907+0000","last_undegraded":"2024-09-11T22:13:41.784907+0000","last_fullsized":"2024-09-11T22:13:41.784907+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:46.668580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306166+0000","last_change":"2024-09-11T22:13:40.319958+0000","last_active":"2024-09-11T22:13:41.306166+0000","last_peered":"2024-09-11T22:13:41.306166+0000","last_clean":"2024-09-11T22:13:41.306166+0000","last_became_active":"2024-09-11T22:13:40.319689+0000","last_became_peered":"2024-09-11T22:13:40.319689+0000","last_unstale":"2024-09-11T22:13:41.306166+0000","last_undegraded":"2024-09-11T22:13:41.306166+0000","last_fullsized":"2024-09-11T22:13:41.306166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:39.939105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.305698+0000","last_change":"2024-09-11T22:13:40.324117+0000","last_active":"2024-09-11T22:13:41.305698+0000","last_peered":"2024-09-11T22:13:41.305698+0000","last_clean":"2024-09-11T22:13:41.305698+0000","last_became_active":"2024-09-11T22:13:40.323855+0000","last_became_peered":"2024-09-11T22:13:40.323855+0000","last_unstale":"2024-09-11T22:13:41.305698+0000","last_undegraded":"2024-09-11T22:13:41.305698+0000","last_fullsized":"2024-09-11T22:13:41.305698+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:41.094489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784870+0000","last_change":"2024-09-11T22:13:40.316136+0000","last_active":"2024-09-11T22:13:41.784870+0000","last_peered":"2024-09-11T22:13:41.784870+0000","last_clean":"2024-09-11T22:13:41.784870+0000","last_became_active":"2024-09-11T22:13:40.315340+0000","last_became_peered":"2024-09-11T22:13:40.315340+0000","last_unstale":"2024-09-11T22:13:41.784870+0000","last_undegraded":"2024-09-11T22:13:41.784870+0000","last_fullsized":"2024-09-11T22:13:41.784870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:38.851009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306101+0000","last_change":"2024-09-11T22:13:40.319433+0000","last_active":"2024-09-11T22:13:41.306101+0000","last_peered":"2024-09-11T22:13:41.306101+0000","last_clean":"2024-09-11T22:13:41.306101+0000","last_became_active":"2024-09-11T22:13:40.319167+0000","last_became_peered":"2024-09-11T22:13:40.319167+0000","last_unstale":"2024-09-11T22:13:41.306101+0000","last_undegraded":"2024-09-11T22:13:41.306101+0000","last_fullsized":"2024-09-11T22:13:41.306101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:59.253104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317108+0000","last_change":"2024-09-11T22:13:40.313556+0000","last_active":"2024-09-11T22:13:41.317108+0000","last_peered":"2024-09-11T22:13:41.317108+0000","last_clean":"2024-09-11T22:13:41.317108+0000","last_became_active":"2024-09-11T22:13:40.313213+0000","last_became_peered":"2024-09-11T22:13:40.313213+0000","last_unstale":"2024-09-11T22:13:41.317108+0000","last_undegraded":"2024-09-11T22:13:41.317108+0000","last_fullsized":"2024-09-11T22:13:41.317108+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:26.815073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785039+0000","last_change":"2024-09-11T22:13:40.311634+0000","last_active":"2024-09-11T22:13:41.785039+0000","last_peered":"2024-09-11T22:13:41.785039+0000","last_clean":"2024-09-11T22:13:41.785039+0000","last_became_active":"2024-09-11T22:13:40.311350+0000","last_became_peered":"2024-09-11T22:13:40.311350+0000","last_unstale":"2024-09-11T22:13:41.785039+0000","last_undegraded":"2024-09-11T22:13:41.785039+0000","last_fullsized":"2024-09-11T22:13:41.785039+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:54.495405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784351+0000","last_change":"2024-09-11T22:13:40.316126+0000","last_active":"2024-09-11T22:13:41.784351+0000","last_peered":"2024-09-11T22:13:41.784351+0000","last_clean":"2024-09-11T22:13:41.784351+0000","last_became_active":"2024-09-11T22:13:40.315791+0000","last_became_peered":"2024-09-11T22:13:40.315791+0000","last_unstale":"2024-09-11T22:13:41.784351+0000","last_undegraded":"2024-09-11T22:13:41.784351+0000","last_fullsized":"2024-09-11T22:13:41.784351+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:03.392094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784902+0000","last_change":"2024-09-11T22:13:40.317237+0000","last_active":"2024-09-11T22:13:41.784902+0000","last_peered":"2024-09-11T22:13:41.784902+0000","last_clean":"2024-09-11T22:13:41.784902+0000","last_became_active":"2024-09-11T22:13:40.316946+0000","last_became_peered":"2024-09-11T22:13:40.316946+0000","last_unstale":"2024-09-11T22:13:41.784902+0000","last_undegraded":"2024-09-11T22:13:41.784902+0000","last_fullsized":"2024-09-11T22:13:41.784902+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:05.535282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785355+0000","last_change":"2024-09-11T22:13:40.317286+0000","last_active":"2024-09-11T22:13:41.785355+0000","last_peered":"2024-09-11T22:13:41.785355+0000","last_clean":"2024-09-11T22:13:41.785355+0000","last_became_active":"2024-09-11T22:13:40.316577+0000","last_became_peered":"2024-09-11T22:13:40.316577+0000","last_unstale":"2024-09-11T22:13:41.785355+0000","last_undegraded":"2024-09-11T22:13:41.785355+0000","last_fullsized":"2024-09-11T22:13:41.785355+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:45.063162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785284+0000","last_change":"2024-09-11T22:13:40.316417+0000","last_active":"2024-09-11T22:13:41.785284+0000","last_peered":"2024-09-11T22:13:41.785284+0000","last_clean":"2024-09-11T22:13:41.785284+0000","last_became_active":"2024-09-11T22:13:40.316034+0000","last_became_peered":"2024-09-11T22:13:40.316034+0000","last_unstale":"2024-09-11T22:13:41.785284+0000","last_undegraded":"2024-09-11T22:13:41.785284+0000","last_fullsized":"2024-09-11T22:13:41.785284+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:12.192383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306557+0000","last_change":"2024-09-11T22:13:40.305607+0000","last_active":"2024-09-11T22:13:41.306557+0000","last_peered":"2024-09-11T22:13:41.306557+0000","last_clean":"2024-09-11T22:13:41.306557+0000","last_became_active":"2024-09-11T22:13:40.305230+0000","last_became_peered":"2024-09-11T22:13:40.305230+0000","last_unstale":"2024-09-11T22:13:41.306557+0000","last_undegraded":"2024-09-11T22:13:41.306557+0000","last_fullsized":"2024-09-11T22:13:41.306557+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:01.991894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304255+0000","last_change":"2024-09-11T22:13:40.319919+0000","last_active":"2024-09-11T22:13:41.304255+0000","last_peered":"2024-09-11T22:13:41.304255+0000","last_clean":"2024-09-11T22:13:41.304255+0000","last_became_active":"2024-09-11T22:13:40.319595+0000","last_became_peered":"2024-09-11T22:13:40.319595+0000","last_unstale":"2024-09-11T22:13:41.304255+0000","last_undegraded":"2024-09-11T22:13:41.304255+0000","last_fullsized":"2024-09-11T22:13:41.304255+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:01.306291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784645+0000","last_change":"2024-09-11T22:13:40.316672+0000","last_active":"2024-09-11T22:13:41.784645+0000","last_peered":"2024-09-11T22:13:41.784645+0000","last_clean":"2024-09-11T22:13:41.784645+0000","last_became_active":"2024-09-11T22:13:40.315612+0000","last_became_peered":"2024-09-11T22:13:40.315612+0000","last_unstale":"2024-09-11T22:13:41.784645+0000","last_undegraded":"2024-09-11T22:13:41.784645+0000","last_fullsized":"2024-09-11T22:13:41.784645+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:00.546420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317050+0000","last_change":"2024-09-11T22:13:40.313398+0000","last_active":"2024-09-11T22:13:41.317050+0000","last_peered":"2024-09-11T22:13:41.317050+0000","last_clean":"2024-09-11T22:13:41.317050+0000","last_became_active":"2024-09-11T22:13:40.312967+0000","last_became_peered":"2024-09-11T22:13:40.312967+0000","last_unstale":"2024-09-11T22:13:41.317050+0000","last_undegraded":"2024-09-11T22:13:41.317050+0000","last_fullsized":"2024-09-11T22:13:41.317050+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:35.757036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784476+0000","last_change":"2024-09-11T22:13:40.318859+0000","last_active":"2024-09-11T22:13:41.784476+0000","last_peered":"2024-09-11T22:13:41.784476+0000","last_clean":"2024-09-11T22:13:41.784476+0000","last_became_active":"2024-09-11T22:13:40.318550+0000","last_became_peered":"2024-09-11T22:13:40.318550+0000","last_unstale":"2024-09-11T22:13:41.784476+0000","last_undegraded":"2024-09-11T22:13:41.784476+0000","last_fullsized":"2024-09-11T22:13:41.784476+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:33.931194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306269+0000","last_change":"2024-09-11T22:13:40.313765+0000","last_active":"2024-09-11T22:13:41.306269+0000","last_peered":"2024-09-11T22:13:41.306269+0000","last_clean":"2024-09-11T22:13:41.306269+0000","last_became_active":"2024-09-11T22:13:40.313496+0000","last_became_peered":"2024-09-11T22:13:40.313496+0000","last_unstale":"2024-09-11T22:13:41.306269+0000","last_undegraded":"2024-09-11T22:13:41.306269+0000","last_fullsized":"2024-09-11T22:13:41.306269+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:21.560499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.305997+0000","last_change":"2024-09-11T22:13:40.320248+0000","last_active":"2024-09-11T22:13:41.305997+0000","last_peered":"2024-09-11T22:13:41.305997+0000","last_clean":"2024-09-11T22:13:41.305997+0000","last_became_active":"2024-09-11T22:13:40.319942+0000","last_became_peered":"2024-09-11T22:13:40.319942+0000","last_unstale":"2024-09-11T22:13:41.305997+0000","last_undegraded":"2024-09-11T22:13:41.305997+0000","last_fullsized":"2024-09-11T22:13:41.305997+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:25.999494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785447+0000","last_change":"2024-09-11T22:13:40.318560+0000","last_active":"2024-09-11T22:13:41.785447+0000","last_peered":"2024-09-11T22:13:41.785447+0000","last_clean":"2024-09-11T22:13:41.785447+0000","last_became_active":"2024-09-11T22:13:40.318183+0000","last_became_peered":"2024-09-11T22:13:40.318183+0000","last_unstale":"2024-09-11T22:13:41.785447+0000","last_undegraded":"2024-09-11T22:13:41.785447+0000","last_fullsized":"2024-09-11T22:13:41.785447+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:06.043743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304411+0000","last_change":"2024-09-11T22:13:40.325041+0000","last_active":"2024-09-11T22:13:41.304411+0000","last_peered":"2024-09-11T22:13:41.304411+0000","last_clean":"2024-09-11T22:13:41.304411+0000","last_became_active":"2024-09-11T22:13:40.324467+0000","last_became_peered":"2024-09-11T22:13:40.324467+0000","last_unstale":"2024-09-11T22:13:41.304411+0000","last_undegraded":"2024-09-11T22:13:41.304411+0000","last_fullsized":"2024-09-11T22:13:41.304411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:50.478469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317202+0000","last_change":"2024-09-11T22:13:40.320156+0000","last_active":"2024-09-11T22:13:41.317202+0000","last_peered":"2024-09-11T22:13:41.317202+0000","last_clean":"2024-09-11T22:13:41.317202+0000","last_became_active":"2024-09-11T22:13:40.319860+0000","last_became_peered":"2024-09-11T22:13:40.319860+0000","last_unstale":"2024-09-11T22:13:41.317202+0000","last_undegraded":"2024-09-11T22:13:41.317202+0000","last_fullsized":"2024-09-11T22:13:41.317202+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:32.001129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784804+0000","last_change":"2024-09-11T22:13:40.315838+0000","last_active":"2024-09-11T22:13:41.784804+0000","last_peered":"2024-09-11T22:13:41.784804+0000","last_clean":"2024-09-11T22:13:41.784804+0000","last_became_active":"2024-09-11T22:13:40.315462+0000","last_became_peered":"2024-09-11T22:13:40.315462+0000","last_unstale":"2024-09-11T22:13:41.784804+0000","last_undegraded":"2024-09-11T22:13:41.784804+0000","last_fullsized":"2024-09-11T22:13:41.784804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:01.785141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784633+0000","last_change":"2024-09-11T22:13:40.312473+0000","last_active":"2024-09-11T22:13:41.784633+0000","last_peered":"2024-09-11T22:13:41.784633+0000","last_clean":"2024-09-11T22:13:41.784633+0000","last_became_active":"2024-09-11T22:13:40.311672+0000","last_became_peered":"2024-09-11T22:13:40.311672+0000","last_unstale":"2024-09-11T22:13:41.784633+0000","last_undegraded":"2024-09-11T22:13:41.784633+0000","last_fullsized":"2024-09-11T22:13:41.784633+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:10.539785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785280+0000","last_change":"2024-09-11T22:13:40.311493+0000","last_active":"2024-09-11T22:13:41.785280+0000","last_peered":"2024-09-11T22:13:41.785280+0000","last_clean":"2024-09-11T22:13:41.785280+0000","last_became_active":"2024-09-11T22:13:40.311185+0000","last_became_peered":"2024-09-11T22:13:40.311185+0000","last_unstale":"2024-09-11T22:13:41.785280+0000","last_undegraded":"2024-09-11T22:13:41.785280+0000","last_fullsized":"2024-09-11T22:13:41.785280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:59.477599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785608+0000","last_change":"2024-09-11T22:13:40.305841+0000","last_active":"2024-09-11T22:13:41.785608+0000","last_peered":"2024-09-11T22:13:41.785608+0000","last_clean":"2024-09-11T22:13:41.785608+0000","last_became_active":"2024-09-11T22:13:40.305537+0000","last_became_peered":"2024-09-11T22:13:40.305537+0000","last_unstale":"2024-09-11T22:13:41.785608+0000","last_undegraded":"2024-09-11T22:13:41.785608+0000","last_fullsized":"2024-09-11T22:13:41.785608+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:20.667319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304434+0000","last_change":"2024-09-11T22:13:40.318761+0000","last_active":"2024-09-11T22:13:41.304434+0000","last_peered":"2024-09-11T22:13:41.304434+0000","last_clean":"2024-09-11T22:13:41.304434+0000","last_became_active":"2024-09-11T22:13:40.318451+0000","last_became_peered":"2024-09-11T22:13:40.318451+0000","last_unstale":"2024-09-11T22:13:41.304434+0000","last_undegraded":"2024-09-11T22:13:41.304434+0000","last_fullsized":"2024-09-11T22:13:41.304434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:28.473773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306555+0000","last_change":"2024-09-11T22:13:40.314618+0000","last_active":"2024-09-11T22:13:41.306555+0000","last_peered":"2024-09-11T22:13:41.306555+0000","last_clean":"2024-09-11T22:13:41.306555+0000","last_became_active":"2024-09-11T22:13:40.314210+0000","last_became_peered":"2024-09-11T22:13:40.314210+0000","last_unstale":"2024-09-11T22:13:41.306555+0000","last_undegraded":"2024-09-11T22:13:41.306555+0000","last_fullsized":"2024-09-11T22:13:41.306555+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:12.192383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306600+0000","last_change":"2024-09-11T22:13:40.305069+0000","last_active":"2024-09-11T22:13:41.306600+0000","last_peered":"2024-09-11T22:13:41.306600+0000","last_clean":"2024-09-11T22:13:41.306600+0000","last_became_active":"2024-09-11T22:13:40.304668+0000","last_became_peered":"2024-09-11T22:13:40.304668+0000","last_unstale":"2024-09-11T22:13:41.306600+0000","last_undegraded":"2024-09-11T22:13:41.306600+0000","last_fullsized":"2024-09-11T22:13:41.306600+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:53.897298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784866+0000","last_change":"2024-09-11T22:13:40.302879+0000","last_active":"2024-09-11T22:13:41.784866+0000","last_peered":"2024-09-11T22:13:41.784866+0000","last_clean":"2024-09-11T22:13:41.784866+0000","last_became_active":"2024-09-11T22:13:40.302166+0000","last_became_peered":"2024-09-11T22:13:40.302166+0000","last_unstale":"2024-09-11T22:13:41.784866+0000","last_undegraded":"2024-09-11T22:13:41.784866+0000","last_fullsized":"2024-09-11T22:13:41.784866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:44.442086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.305817+0000","last_change":"2024-09-11T22:13:40.313097+0000","last_active":"2024-09-11T22:13:41.305817+0000","last_peered":"2024-09-11T22:13:41.305817+0000","last_clean":"2024-09-11T22:13:41.305817+0000","last_became_active":"2024-09-11T22:13:40.312718+0000","last_became_peered":"2024-09-11T22:13:40.312718+0000","last_unstale":"2024-09-11T22:13:41.305817+0000","last_undegraded":"2024-09-11T22:13:41.305817+0000","last_fullsized":"2024-09-11T22:13:41.305817+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:01.439424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317050+0000","last_change":"2024-09-11T22:13:40.314146+0000","last_active":"2024-09-11T22:13:41.317050+0000","last_peered":"2024-09-11T22:13:41.317050+0000","last_clean":"2024-09-11T22:13:41.317050+0000","last_became_active":"2024-09-11T22:13:40.313747+0000","last_became_peered":"2024-09-11T22:13:40.313747+0000","last_unstale":"2024-09-11T22:13:41.317050+0000","last_undegraded":"2024-09-11T22:13:41.317050+0000","last_fullsized":"2024-09-11T22:13:41.317050+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:04.675236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304147+0000","last_change":"2024-09-11T22:13:40.303372+0000","last_active":"2024-09-11T22:13:41.304147+0000","last_peered":"2024-09-11T22:13:41.304147+0000","last_clean":"2024-09-11T22:13:41.304147+0000","last_became_active":"2024-09-11T22:13:40.303042+0000","last_became_peered":"2024-09-11T22:13:40.303042+0000","last_unstale":"2024-09-11T22:13:41.304147+0000","last_undegraded":"2024-09-11T22:13:41.304147+0000","last_fullsized":"2024-09-11T22:13:41.304147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:50.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784638+0000","last_change":"2024-09-11T22:13:40.321112+0000","last_active":"2024-09-11T22:13:41.784638+0000","last_peered":"2024-09-11T22:13:41.784638+0000","last_clean":"2024-09-11T22:13:41.784638+0000","last_became_active":"2024-09-11T22:13:40.320789+0000","last_became_peered":"2024-09-11T22:13:40.320789+0000","last_unstale":"2024-09-11T22:13:41.784638+0000","last_undegraded":"2024-09-11T22:13:41.784638+0000","last_fullsized":"2024-09-11T22:13:41.784638+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:03.392094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317405+0000","last_change":"2024-09-11T22:13:39.312323+0000","last_active":"2024-09-11T22:13:41.317405+0000","last_peered":"2024-09-11T22:13:41.317405+0000","last_clean":"2024-09-11T22:13:41.317405+0000","last_became_active":"2024-09-11T22:13:39.312023+0000","last_became_peered":"2024-09-11T22:13:39.312023+0000","last_unstale":"2024-09-11T22:13:41.317405+0000","last_undegraded":"2024-09-11T22:13:41.317405+0000","last_fullsized":"2024-09-11T22:13:41.317405+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:20.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785500+0000","last_change":"2024-09-11T22:13:40.310374+0000","last_active":"2024-09-11T22:13:41.785500+0000","last_peered":"2024-09-11T22:13:41.785500+0000","last_clean":"2024-09-11T22:13:41.785500+0000","last_became_active":"2024-09-11T22:13:40.310101+0000","last_became_peered":"2024-09-11T22:13:40.310101+0000","last_unstale":"2024-09-11T22:13:41.785500+0000","last_undegraded":"2024-09-11T22:13:41.785500+0000","last_fullsized":"2024-09-11T22:13:41.785500+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:30.345056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306121+0000","last_change":"2024-09-11T22:13:39.307957+0000","last_active":"2024-09-11T22:13:41.306121+0000","last_peered":"2024-09-11T22:13:41.306121+0000","last_clean":"2024-09-11T22:13:41.306121+0000","last_became_active":"2024-09-11T22:13:39.307664+0000","last_became_peered":"2024-09-11T22:13:39.307664+0000","last_unstale":"2024-09-11T22:13:41.306121+0000","last_undegraded":"2024-09-11T22:13:41.306121+0000","last_fullsized":"2024-09-11T22:13:41.306121+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:24.275744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306741+0000","last_change":"2024-09-11T22:13:40.315245+0000","last_active":"2024-09-11T22:13:41.306741+0000","last_peered":"2024-09-11T22:13:41.306741+0000","last_clean":"2024-09-11T22:13:41.306741+0000","last_became_active":"2024-09-11T22:13:40.314933+0000","last_became_peered":"2024-09-11T22:13:40.314933+0000","last_unstale":"2024-09-11T22:13:41.306741+0000","last_undegraded":"2024-09-11T22:13:41.306741+0000","last_fullsized":"2024-09-11T22:13:41.306741+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:11.191910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784870+0000","last_change":"2024-09-11T22:13:39.306671+0000","last_active":"2024-09-11T22:13:41.784870+0000","last_peered":"2024-09-11T22:13:41.784870+0000","last_clean":"2024-09-11T22:13:41.784870+0000","last_became_active":"2024-09-11T22:13:39.305428+0000","last_became_peered":"2024-09-11T22:13:39.305428+0000","last_unstale":"2024-09-11T22:13:41.784870+0000","last_undegraded":"2024-09-11T22:13:41.784870+0000","last_fullsized":"2024-09-11T22:13:41.784870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:05.008782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784776+0000","last_change":"2024-09-11T22:13:40.307090+0000","last_active":"2024-09-11T22:13:41.784776+0000","last_peered":"2024-09-11T22:13:41.784776+0000","last_clean":"2024-09-11T22:13:41.784776+0000","last_became_active":"2024-09-11T22:13:40.306796+0000","last_became_peered":"2024-09-11T22:13:40.306796+0000","last_unstale":"2024-09-11T22:13:41.784776+0000","last_undegraded":"2024-09-11T22:13:41.784776+0000","last_fullsized":"2024-09-11T22:13:41.784776+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:01.159466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785107+0000","last_change":"2024-09-11T22:13:39.306928+0000","last_active":"2024-09-11T22:13:41.785107+0000","last_peered":"2024-09-11T22:13:41.785107+0000","last_clean":"2024-09-11T22:13:41.785107+0000","last_became_active":"2024-09-11T22:13:39.306644+0000","last_became_peered":"2024-09-11T22:13:39.306644+0000","last_unstale":"2024-09-11T22:13:41.785107+0000","last_undegraded":"2024-09-11T22:13:41.785107+0000","last_fullsized":"2024-09-11T22:13:41.785107+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:38.578419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.305984+0000","last_change":"2024-09-11T22:13:40.311825+0000","last_active":"2024-09-11T22:13:41.305984+0000","last_peered":"2024-09-11T22:13:41.305984+0000","last_clean":"2024-09-11T22:13:41.305984+0000","last_became_active":"2024-09-11T22:13:40.311525+0000","last_became_peered":"2024-09-11T22:13:40.311525+0000","last_unstale":"2024-09-11T22:13:41.305984+0000","last_undegraded":"2024-09-11T22:13:41.305984+0000","last_fullsized":"2024-09-11T22:13:41.305984+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:05.535282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317390+0000","last_change":"2024-09-11T22:13:39.312090+0000","last_active":"2024-09-11T22:13:41.317390+0000","last_peered":"2024-09-11T22:13:41.317390+0000","last_clean":"2024-09-11T22:13:41.317390+0000","last_became_active":"2024-09-11T22:13:39.311481+0000","last_became_peered":"2024-09-11T22:13:39.311481+0000","last_unstale":"2024-09-11T22:13:41.317390+0000","last_undegraded":"2024-09-11T22:13:41.317390+0000","last_fullsized":"2024-09-11T22:13:41.317390+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:44.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784960+0000","last_change":"2024-09-11T22:13:40.324078+0000","last_active":"2024-09-11T22:13:41.784960+0000","last_peered":"2024-09-11T22:13:41.784960+0000","last_clean":"2024-09-11T22:13:41.784960+0000","last_became_active":"2024-09-11T22:13:40.320471+0000","last_became_peered":"2024-09-11T22:13:40.320471+0000","last_unstale":"2024-09-11T22:13:41.784960+0000","last_undegraded":"2024-09-11T22:13:41.784960+0000","last_fullsized":"2024-09-11T22:13:41.784960+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:25.999494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306080+0000","last_change":"2024-09-11T22:13:39.303131+0000","last_active":"2024-09-11T22:13:41.306080+0000","last_peered":"2024-09-11T22:13:41.306080+0000","last_clean":"2024-09-11T22:13:41.306080+0000","last_became_active":"2024-09-11T22:13:39.302818+0000","last_became_peered":"2024-09-11T22:13:39.302818+0000","last_unstale":"2024-09-11T22:13:41.306080+0000","last_undegraded":"2024-09-11T22:13:41.306080+0000","last_fullsized":"2024-09-11T22:13:41.306080+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:14.986852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784511+0000","last_change":"2024-09-11T22:13:40.323526+0000","last_active":"2024-09-11T22:13:41.784511+0000","last_peered":"2024-09-11T22:13:41.784511+0000","last_clean":"2024-09-11T22:13:41.784511+0000","last_became_active":"2024-09-11T22:13:40.320686+0000","last_became_peered":"2024-09-11T22:13:40.320686+0000","last_unstale":"2024-09-11T22:13:41.784511+0000","last_undegraded":"2024-09-11T22:13:41.784511+0000","last_fullsized":"2024-09-11T22:13:41.784511+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:41.094489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306364+0000","last_change":"2024-09-11T22:13:39.300952+0000","last_active":"2024-09-11T22:13:41.306364+0000","last_peered":"2024-09-11T22:13:41.306364+0000","last_clean":"2024-09-11T22:13:41.306364+0000","last_became_active":"2024-09-11T22:13:39.300653+0000","last_became_peered":"2024-09-11T22:13:39.300653+0000","last_unstale":"2024-09-11T22:13:41.306364+0000","last_undegraded":"2024-09-11T22:13:41.306364+0000","last_fullsized":"2024-09-11T22:13:41.306364+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:37.846188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784459+0000","last_change":"2024-09-11T22:13:40.312706+0000","last_active":"2024-09-11T22:13:41.784459+0000","last_peered":"2024-09-11T22:13:41.784459+0000","last_clean":"2024-09-11T22:13:41.784459+0000","last_became_active":"2024-09-11T22:13:40.312059+0000","last_became_peered":"2024-09-11T22:13:40.312059+0000","last_unstale":"2024-09-11T22:13:41.784459+0000","last_undegraded":"2024-09-11T22:13:41.784459+0000","last_fullsized":"2024-09-11T22:13:41.784459+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:35.313802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784963+0000","last_change":"2024-09-11T22:13:39.303791+0000","last_active":"2024-09-11T22:13:41.784963+0000","last_peered":"2024-09-11T22:13:41.784963+0000","last_clean":"2024-09-11T22:13:41.784963+0000","last_became_active":"2024-09-11T22:13:39.303375+0000","last_became_peered":"2024-09-11T22:13:39.303375+0000","last_unstale":"2024-09-11T22:13:41.784963+0000","last_undegraded":"2024-09-11T22:13:41.784963+0000","last_fullsized":"2024-09-11T22:13:41.784963+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:36.069658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306099+0000","last_change":"2024-09-11T22:13:40.320101+0000","last_active":"2024-09-11T22:13:41.306099+0000","last_peered":"2024-09-11T22:13:41.306099+0000","last_clean":"2024-09-11T22:13:41.306099+0000","last_became_active":"2024-09-11T22:13:40.319822+0000","last_became_peered":"2024-09-11T22:13:40.319822+0000","last_unstale":"2024-09-11T22:13:41.306099+0000","last_undegraded":"2024-09-11T22:13:41.306099+0000","last_fullsized":"2024-09-11T22:13:41.306099+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:47.275703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306364+0000","last_change":"2024-09-11T22:13:39.310133+0000","last_active":"2024-09-11T22:13:41.306364+0000","last_peered":"2024-09-11T22:13:41.306364+0000","last_clean":"2024-09-11T22:13:41.306364+0000","last_became_active":"2024-09-11T22:13:39.309863+0000","last_became_peered":"2024-09-11T22:13:39.309863+0000","last_unstale":"2024-09-11T22:13:41.306364+0000","last_undegraded":"2024-09-11T22:13:41.306364+0000","last_fullsized":"2024-09-11T22:13:41.306364+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:58.472779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785173+0000","last_change":"2024-09-11T22:13:40.310838+0000","last_active":"2024-09-11T22:13:41.785173+0000","last_peered":"2024-09-11T22:13:41.785173+0000","last_clean":"2024-09-11T22:13:41.785173+0000","last_became_active":"2024-09-11T22:13:40.310520+0000","last_became_peered":"2024-09-11T22:13:40.310520+0000","last_unstale":"2024-09-11T22:13:41.785173+0000","last_undegraded":"2024-09-11T22:13:41.785173+0000","last_fullsized":"2024-09-11T22:13:41.785173+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:02.177660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785418+0000","last_change":"2024-09-11T22:13:39.310075+0000","last_active":"2024-09-11T22:13:41.785418+0000","last_peered":"2024-09-11T22:13:41.785418+0000","last_clean":"2024-09-11T22:13:41.785418+0000","last_became_active":"2024-09-11T22:13:39.309660+0000","last_became_peered":"2024-09-11T22:13:39.309660+0000","last_unstale":"2024-09-11T22:13:41.785418+0000","last_undegraded":"2024-09-11T22:13:41.785418+0000","last_fullsized":"2024-09-11T22:13:41.785418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:03.080445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317481+0000","last_change":"2024-09-11T22:13:40.322234+0000","last_active":"2024-09-11T22:13:41.317481+0000","last_peered":"2024-09-11T22:13:41.317481+0000","last_clean":"2024-09-11T22:13:41.317481+0000","last_became_active":"2024-09-11T22:13:40.321780+0000","last_became_peered":"2024-09-11T22:13:40.321780+0000","last_unstale":"2024-09-11T22:13:41.317481+0000","last_undegraded":"2024-09-11T22:13:41.317481+0000","last_fullsized":"2024-09-11T22:13:41.317481+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:07.314954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784958+0000","last_change":"2024-09-11T22:13:39.310563+0000","last_active":"2024-09-11T22:13:41.784958+0000","last_peered":"2024-09-11T22:13:41.784958+0000","last_clean":"2024-09-11T22:13:41.784958+0000","last_became_active":"2024-09-11T22:13:39.310308+0000","last_became_peered":"2024-09-11T22:13:39.310308+0000","last_unstale":"2024-09-11T22:13:41.784958+0000","last_undegraded":"2024-09-11T22:13:41.784958+0000","last_fullsized":"2024-09-11T22:13:41.784958+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:44.471766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784988+0000","last_change":"2024-09-11T22:13:40.314486+0000","last_active":"2024-09-11T22:13:41.784988+0000","last_peered":"2024-09-11T22:13:41.784988+0000","last_clean":"2024-09-11T22:13:41.784988+0000","last_became_active":"2024-09-11T22:13:40.313645+0000","last_became_peered":"2024-09-11T22:13:40.313645+0000","last_unstale":"2024-09-11T22:13:41.784988+0000","last_undegraded":"2024-09-11T22:13:41.784988+0000","last_fullsized":"2024-09-11T22:13:41.784988+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:30.358742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304403+0000","last_change":"2024-09-11T22:13:39.303367+0000","last_active":"2024-09-11T22:13:41.304403+0000","last_peered":"2024-09-11T22:13:41.304403+0000","last_clean":"2024-09-11T22:13:41.304403+0000","last_became_active":"2024-09-11T22:13:39.302860+0000","last_became_peered":"2024-09-11T22:13:39.302860+0000","last_unstale":"2024-09-11T22:13:41.304403+0000","last_undegraded":"2024-09-11T22:13:41.304403+0000","last_fullsized":"2024-09-11T22:13:41.304403+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:48.672367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784772+0000","last_change":"2024-09-11T22:13:40.316388+0000","last_active":"2024-09-11T22:13:41.784772+0000","last_peered":"2024-09-11T22:13:41.784772+0000","last_clean":"2024-09-11T22:13:41.784772+0000","last_became_active":"2024-09-11T22:13:40.316118+0000","last_became_peered":"2024-09-11T22:13:40.316118+0000","last_unstale":"2024-09-11T22:13:41.784772+0000","last_undegraded":"2024-09-11T22:13:41.784772+0000","last_fullsized":"2024-09-11T22:13:41.784772+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:25.280565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317397+0000","last_change":"2024-09-11T22:13:39.311084+0000","last_active":"2024-09-11T22:13:41.317397+0000","last_peered":"2024-09-11T22:13:41.317397+0000","last_clean":"2024-09-11T22:13:41.317397+0000","last_became_active":"2024-09-11T22:13:39.310795+0000","last_became_peered":"2024-09-11T22:13:39.310795+0000","last_unstale":"2024-09-11T22:13:41.317397+0000","last_undegraded":"2024-09-11T22:13:41.317397+0000","last_fullsized":"2024-09-11T22:13:41.317397+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:40.162026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785166+0000","last_change":"2024-09-11T22:13:40.317464+0000","last_active":"2024-09-11T22:13:41.785166+0000","last_peered":"2024-09-11T22:13:41.785166+0000","last_clean":"2024-09-11T22:13:41.785166+0000","last_became_active":"2024-09-11T22:13:40.317154+0000","last_became_peered":"2024-09-11T22:13:40.317154+0000","last_unstale":"2024-09-11T22:13:41.785166+0000","last_undegraded":"2024-09-11T22:13:41.785166+0000","last_fullsized":"2024-09-11T22:13:41.785166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:21.560499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784893+0000","last_change":"2024-09-11T22:13:39.312568+0000","last_active":"2024-09-11T22:13:41.784893+0000","last_peered":"2024-09-11T22:13:41.784893+0000","last_clean":"2024-09-11T22:13:41.784893+0000","last_became_active":"2024-09-11T22:13:39.312266+0000","last_became_peered":"2024-09-11T22:13:39.312266+0000","last_unstale":"2024-09-11T22:13:41.784893+0000","last_undegraded":"2024-09-11T22:13:41.784893+0000","last_fullsized":"2024-09-11T22:13:41.784893+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:52.535028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317031+0000","last_change":"2024-09-11T22:13:40.327056+0000","last_active":"2024-09-11T22:13:41.317031+0000","last_peered":"2024-09-11T22:13:41.317031+0000","last_clean":"2024-09-11T22:13:41.317031+0000","last_became_active":"2024-09-11T22:13:40.326772+0000","last_became_peered":"2024-09-11T22:13:40.326772+0000","last_unstale":"2024-09-11T22:13:41.317031+0000","last_undegraded":"2024-09-11T22:13:41.317031+0000","last_fullsized":"2024-09-11T22:13:41.317031+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:08.176038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317153+0000","last_change":"2024-09-11T22:13:39.311107+0000","last_active":"2024-09-11T22:13:41.317153+0000","last_peered":"2024-09-11T22:13:41.317153+0000","last_clean":"2024-09-11T22:13:41.317153+0000","last_became_active":"2024-09-11T22:13:39.310839+0000","last_became_peered":"2024-09-11T22:13:39.310839+0000","last_unstale":"2024-09-11T22:13:41.317153+0000","last_undegraded":"2024-09-11T22:13:41.317153+0000","last_fullsized":"2024-09-11T22:13:41.317153+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:46.270882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785227+0000","last_change":"2024-09-11T22:13:40.312864+0000","last_active":"2024-09-11T22:13:41.785227+0000","last_peered":"2024-09-11T22:13:41.785227+0000","last_clean":"2024-09-11T22:13:41.785227+0000","last_became_active":"2024-09-11T22:13:40.312064+0000","last_became_peered":"2024-09-11T22:13:40.312064+0000","last_unstale":"2024-09-11T22:13:41.785227+0000","last_undegraded":"2024-09-11T22:13:41.785227+0000","last_fullsized":"2024-09-11T22:13:41.785227+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:52.317665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785096+0000","last_change":"2024-09-11T22:13:39.305593+0000","last_active":"2024-09-11T22:13:41.785096+0000","last_peered":"2024-09-11T22:13:41.785096+0000","last_clean":"2024-09-11T22:13:41.785096+0000","last_became_active":"2024-09-11T22:13:39.305310+0000","last_became_peered":"2024-09-11T22:13:39.305310+0000","last_unstale":"2024-09-11T22:13:41.785096+0000","last_undegraded":"2024-09-11T22:13:41.785096+0000","last_fullsized":"2024-09-11T22:13:41.785096+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:00.797325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304434+0000","last_change":"2024-09-11T22:13:40.301662+0000","last_active":"2024-09-11T22:13:41.304434+0000","last_peered":"2024-09-11T22:13:41.304434+0000","last_clean":"2024-09-11T22:13:41.304434+0000","last_became_active":"2024-09-11T22:13:40.300969+0000","last_became_peered":"2024-09-11T22:13:40.300969+0000","last_unstale":"2024-09-11T22:13:41.304434+0000","last_undegraded":"2024-09-11T22:13:41.304434+0000","last_fullsized":"2024-09-11T22:13:41.304434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:10.319903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304471+0000","last_change":"2024-09-11T22:13:39.315068+0000","last_active":"2024-09-11T22:13:41.304471+0000","last_peered":"2024-09-11T22:13:41.304471+0000","last_clean":"2024-09-11T22:13:41.304471+0000","last_became_active":"2024-09-11T22:13:39.314741+0000","last_became_peered":"2024-09-11T22:13:39.314741+0000","last_unstale":"2024-09-11T22:13:41.304471+0000","last_undegraded":"2024-09-11T22:13:41.304471+0000","last_fullsized":"2024-09-11T22:13:41.304471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:49.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785088+0000","last_change":"2024-09-11T22:13:40.317527+0000","last_active":"2024-09-11T22:13:41.785088+0000","last_peered":"2024-09-11T22:13:41.785088+0000","last_clean":"2024-09-11T22:13:41.785088+0000","last_became_active":"2024-09-11T22:13:40.315083+0000","last_became_peered":"2024-09-11T22:13:40.315083+0000","last_unstale":"2024-09-11T22:13:41.785088+0000","last_undegraded":"2024-09-11T22:13:41.785088+0000","last_fullsized":"2024-09-11T22:13:41.785088+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:47.275703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306201+0000","last_change":"2024-09-11T22:13:39.301654+0000","last_active":"2024-09-11T22:13:41.306201+0000","last_peered":"2024-09-11T22:13:41.306201+0000","last_clean":"2024-09-11T22:13:41.306201+0000","last_became_active":"2024-09-11T22:13:39.301361+0000","last_became_peered":"2024-09-11T22:13:39.301361+0000","last_unstale":"2024-09-11T22:13:41.306201+0000","last_undegraded":"2024-09-11T22:13:41.306201+0000","last_fullsized":"2024-09-11T22:13:41.306201+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:43.437265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785077+0000","last_change":"2024-09-11T22:13:40.313766+0000","last_active":"2024-09-11T22:13:41.785077+0000","last_peered":"2024-09-11T22:13:41.785077+0000","last_clean":"2024-09-11T22:13:41.785077+0000","last_became_active":"2024-09-11T22:13:40.313347+0000","last_became_peered":"2024-09-11T22:13:40.313347+0000","last_unstale":"2024-09-11T22:13:41.785077+0000","last_undegraded":"2024-09-11T22:13:41.785077+0000","last_fullsized":"2024-09-11T22:13:41.785077+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:06.013603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306394+0000","last_change":"2024-09-11T22:13:39.301699+0000","last_active":"2024-09-11T22:13:41.306394+0000","last_peered":"2024-09-11T22:13:41.306394+0000","last_clean":"2024-09-11T22:13:41.306394+0000","last_became_active":"2024-09-11T22:13:39.301425+0000","last_became_peered":"2024-09-11T22:13:39.301425+0000","last_unstale":"2024-09-11T22:13:41.306394+0000","last_undegraded":"2024-09-11T22:13:41.306394+0000","last_fullsized":"2024-09-11T22:13:41.306394+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:00.434604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785349+0000","last_change":"2024-09-11T22:13:40.309473+0000","last_active":"2024-09-11T22:13:41.785349+0000","last_peered":"2024-09-11T22:13:41.785349+0000","last_clean":"2024-09-11T22:13:41.785349+0000","last_became_active":"2024-09-11T22:13:40.308605+0000","last_became_peered":"2024-09-11T22:13:40.308605+0000","last_unstale":"2024-09-11T22:13:41.785349+0000","last_undegraded":"2024-09-11T22:13:41.785349+0000","last_fullsized":"2024-09-11T22:13:41.785349+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:15.991673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317464+0000","last_change":"2024-09-11T22:13:39.313695+0000","last_active":"2024-09-11T22:13:41.317464+0000","last_peered":"2024-09-11T22:13:41.317464+0000","last_clean":"2024-09-11T22:13:41.317464+0000","last_became_active":"2024-09-11T22:13:39.313451+0000","last_became_peered":"2024-09-11T22:13:39.313451+0000","last_unstale":"2024-09-11T22:13:41.317464+0000","last_undegraded":"2024-09-11T22:13:41.317464+0000","last_fullsized":"2024-09-11T22:13:41.317464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:11.187562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317109+0000","last_change":"2024-09-11T22:13:40.319757+0000","last_active":"2024-09-11T22:13:41.317109+0000","last_peered":"2024-09-11T22:13:41.317109+0000","last_clean":"2024-09-11T22:13:41.317109+0000","last_became_active":"2024-09-11T22:13:40.319426+0000","last_became_peered":"2024-09-11T22:13:40.319426+0000","last_unstale":"2024-09-11T22:13:41.317109+0000","last_undegraded":"2024-09-11T22:13:41.317109+0000","last_fullsized":"2024-09-11T22:13:41.317109+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:07.896035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317526+0000","last_change":"2024-09-11T22:13:39.310453+0000","last_active":"2024-09-11T22:13:41.317526+0000","last_peered":"2024-09-11T22:13:41.317526+0000","last_clean":"2024-09-11T22:13:41.317526+0000","last_became_active":"2024-09-11T22:13:39.310186+0000","last_became_peered":"2024-09-11T22:13:39.310186+0000","last_unstale":"2024-09-11T22:13:41.317526+0000","last_undegraded":"2024-09-11T22:13:41.317526+0000","last_fullsized":"2024-09-11T22:13:41.317526+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:00.058154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784415+0000","last_change":"2024-09-11T22:13:40.306399+0000","last_active":"2024-09-11T22:13:41.784415+0000","last_peered":"2024-09-11T22:13:41.784415+0000","last_clean":"2024-09-11T22:13:41.784415+0000","last_became_active":"2024-09-11T22:13:40.305998+0000","last_became_peered":"2024-09-11T22:13:40.305998+0000","last_unstale":"2024-09-11T22:13:41.784415+0000","last_undegraded":"2024-09-11T22:13:41.784415+0000","last_fullsized":"2024-09-11T22:13:41.784415+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:20.667319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306713+0000","last_change":"2024-09-11T22:13:39.308391+0000","last_active":"2024-09-11T22:13:41.306713+0000","last_peered":"2024-09-11T22:13:41.306713+0000","last_clean":"2024-09-11T22:13:41.306713+0000","last_became_active":"2024-09-11T22:13:39.307774+0000","last_became_peered":"2024-09-11T22:13:39.307774+0000","last_unstale":"2024-09-11T22:13:41.306713+0000","last_undegraded":"2024-09-11T22:13:41.306713+0000","last_fullsized":"2024-09-11T22:13:41.306713+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:04.530461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304123+0000","last_change":"2024-09-11T22:13:40.319478+0000","last_active":"2024-09-11T22:13:41.304123+0000","last_peered":"2024-09-11T22:13:41.304123+0000","last_clean":"2024-09-11T22:13:41.304123+0000","last_became_active":"2024-09-11T22:13:40.319188+0000","last_became_peered":"2024-09-11T22:13:40.319188+0000","last_unstale":"2024-09-11T22:13:41.304123+0000","last_undegraded":"2024-09-11T22:13:41.304123+0000","last_fullsized":"2024-09-11T22:13:41.304123+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:14:31.828880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784458+0000","last_change":"2024-09-11T22:13:39.310780+0000","last_active":"2024-09-11T22:13:41.784458+0000","last_peered":"2024-09-11T22:13:41.784458+0000","last_clean":"2024-09-11T22:13:41.784458+0000","last_became_active":"2024-09-11T22:13:39.310504+0000","last_became_peered":"2024-09-11T22:13:39.310504+0000","last_unstale":"2024-09-11T22:13:41.784458+0000","last_undegraded":"2024-09-11T22:13:41.784458+0000","last_fullsized":"2024-09-11T22:13:41.784458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:57.888547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784376+0000","last_change":"2024-09-11T22:13:40.316860+0000","last_active":"2024-09-11T22:13:41.784376+0000","last_peered":"2024-09-11T22:13:41.784376+0000","last_clean":"2024-09-11T22:13:41.784376+0000","last_became_active":"2024-09-11T22:13:40.314956+0000","last_became_peered":"2024-09-11T22:13:40.314956+0000","last_unstale":"2024-09-11T22:13:41.784376+0000","last_undegraded":"2024-09-11T22:13:41.784376+0000","last_fullsized":"2024-09-11T22:13:41.784376+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:01.159466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785081+0000","last_change":"2024-09-11T22:13:39.312641+0000","last_active":"2024-09-11T22:13:41.785081+0000","last_peered":"2024-09-11T22:13:41.785081+0000","last_clean":"2024-09-11T22:13:41.785081+0000","last_became_active":"2024-09-11T22:13:39.312308+0000","last_became_peered":"2024-09-11T22:13:39.312308+0000","last_unstale":"2024-09-11T22:13:41.785081+0000","last_undegraded":"2024-09-11T22:13:41.785081+0000","last_fullsized":"2024-09-11T22:13:41.785081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:56.314599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785501+0000","last_change":"2024-09-11T22:13:40.319375+0000","last_active":"2024-09-11T22:13:41.785501+0000","last_peered":"2024-09-11T22:13:41.785501+0000","last_clean":"2024-09-11T22:13:41.785501+0000","last_became_active":"2024-09-11T22:13:40.319109+0000","last_became_peered":"2024-09-11T22:13:40.319109+0000","last_unstale":"2024-09-11T22:13:41.785501+0000","last_undegraded":"2024-09-11T22:13:41.785501+0000","last_fullsized":"2024-09-11T22:13:41.785501+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:36:39.006996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317393+0000","last_change":"2024-09-11T22:13:39.313694+0000","last_active":"2024-09-11T22:13:41.317393+0000","last_peered":"2024-09-11T22:13:41.317393+0000","last_clean":"2024-09-11T22:13:41.317393+0000","last_became_active":"2024-09-11T22:13:39.312332+0000","last_became_peered":"2024-09-11T22:13:39.312332+0000","last_unstale":"2024-09-11T22:13:41.317393+0000","last_undegraded":"2024-09-11T22:13:41.317393+0000","last_fullsized":"2024-09-11T22:13:41.317393+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:06.573486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784934+0000","last_change":"2024-09-11T22:13:40.316292+0000","last_active":"2024-09-11T22:13:41.784934+0000","last_peered":"2024-09-11T22:13:41.784934+0000","last_clean":"2024-09-11T22:13:41.784934+0000","last_became_active":"2024-09-11T22:13:40.315198+0000","last_became_peered":"2024-09-11T22:13:40.315198+0000","last_unstale":"2024-09-11T22:13:41.784934+0000","last_undegraded":"2024-09-11T22:13:41.784934+0000","last_fullsized":"2024-09-11T22:13:41.784934+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:01.439424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785072+0000","last_change":"2024-09-11T22:13:39.310708+0000","last_active":"2024-09-11T22:13:41.785072+0000","last_peered":"2024-09-11T22:13:41.785072+0000","last_clean":"2024-09-11T22:13:41.785072+0000","last_became_active":"2024-09-11T22:13:39.310463+0000","last_became_peered":"2024-09-11T22:13:39.310463+0000","last_unstale":"2024-09-11T22:13:41.785072+0000","last_undegraded":"2024-09-11T22:13:41.785072+0000","last_fullsized":"2024-09-11T22:13:41.785072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:51.589071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784826+0000","last_change":"2024-09-11T22:13:40.318581+0000","last_active":"2024-09-11T22:13:41.784826+0000","last_peered":"2024-09-11T22:13:41.784826+0000","last_clean":"2024-09-11T22:13:41.784826+0000","last_became_active":"2024-09-11T22:13:40.318311+0000","last_became_peered":"2024-09-11T22:13:40.318311+0000","last_unstale":"2024-09-11T22:13:41.784826+0000","last_undegraded":"2024-09-11T22:13:41.784826+0000","last_fullsized":"2024-09-11T22:13:41.784826+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:33.291942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784373+0000","last_change":"2024-09-11T22:13:39.303899+0000","last_active":"2024-09-11T22:13:41.784373+0000","last_peered":"2024-09-11T22:13:41.784373+0000","last_clean":"2024-09-11T22:13:41.784373+0000","last_became_active":"2024-09-11T22:13:39.303546+0000","last_became_peered":"2024-09-11T22:13:39.303546+0000","last_unstale":"2024-09-11T22:13:41.784373+0000","last_undegraded":"2024-09-11T22:13:41.784373+0000","last_fullsized":"2024-09-11T22:13:41.784373+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:14.986852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317284+0000","last_change":"2024-09-11T22:13:40.314177+0000","last_active":"2024-09-11T22:13:41.317284+0000","last_peered":"2024-09-11T22:13:41.317284+0000","last_clean":"2024-09-11T22:13:41.317284+0000","last_became_active":"2024-09-11T22:13:40.313743+0000","last_became_peered":"2024-09-11T22:13:40.313743+0000","last_unstale":"2024-09-11T22:13:41.317284+0000","last_undegraded":"2024-09-11T22:13:41.317284+0000","last_fullsized":"2024-09-11T22:13:41.317284+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:48.687539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785042+0000","last_change":"2024-09-11T22:13:39.308982+0000","last_active":"2024-09-11T22:13:41.785042+0000","last_peered":"2024-09-11T22:13:41.785042+0000","last_clean":"2024-09-11T22:13:41.785042+0000","last_became_active":"2024-09-11T22:13:39.308701+0000","last_became_peered":"2024-09-11T22:13:39.308701+0000","last_unstale":"2024-09-11T22:13:41.785042+0000","last_undegraded":"2024-09-11T22:13:41.785042+0000","last_fullsized":"2024-09-11T22:13:41.785042+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:24.944146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317185+0000","last_change":"2024-09-11T22:13:40.327573+0000","last_active":"2024-09-11T22:13:41.317185+0000","last_peered":"2024-09-11T22:13:41.317185+0000","last_clean":"2024-09-11T22:13:41.317185+0000","last_became_active":"2024-09-11T22:13:40.327283+0000","last_became_peered":"2024-09-11T22:13:40.327283+0000","last_unstale":"2024-09-11T22:13:41.317185+0000","last_undegraded":"2024-09-11T22:13:41.317185+0000","last_fullsized":"2024-09-11T22:13:41.317185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:46.055535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306194+0000","last_change":"2024-09-11T22:13:39.307907+0000","last_active":"2024-09-11T22:13:41.306194+0000","last_peered":"2024-09-11T22:13:41.306194+0000","last_clean":"2024-09-11T22:13:41.306194+0000","last_became_active":"2024-09-11T22:13:39.307599+0000","last_became_peered":"2024-09-11T22:13:39.307599+0000","last_unstale":"2024-09-11T22:13:41.306194+0000","last_undegraded":"2024-09-11T22:13:41.306194+0000","last_fullsized":"2024-09-11T22:13:41.306194+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:05.008782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.305734+0000","last_change":"2024-09-11T22:13:40.304738+0000","last_active":"2024-09-11T22:13:41.305734+0000","last_peered":"2024-09-11T22:13:41.305734+0000","last_clean":"2024-09-11T22:13:41.305734+0000","last_became_active":"2024-09-11T22:13:40.304440+0000","last_became_peered":"2024-09-11T22:13:40.304440+0000","last_unstale":"2024-09-11T22:13:41.305734+0000","last_undegraded":"2024-09-11T22:13:41.305734+0000","last_fullsized":"2024-09-11T22:13:41.305734+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:05.965092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784417+0000","last_change":"2024-09-11T22:13:39.312580+0000","last_active":"2024-09-11T22:13:41.784417+0000","last_peered":"2024-09-11T22:13:41.784417+0000","last_clean":"2024-09-11T22:13:41.784417+0000","last_became_active":"2024-09-11T22:13:39.312239+0000","last_became_peered":"2024-09-11T22:13:39.312239+0000","last_unstale":"2024-09-11T22:13:41.784417+0000","last_undegraded":"2024-09-11T22:13:41.784417+0000","last_fullsized":"2024-09-11T22:13:41.784417+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:58.472779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.305685+0000","last_change":"2024-09-11T22:13:40.315416+0000","last_active":"2024-09-11T22:13:41.305685+0000","last_peered":"2024-09-11T22:13:41.305685+0000","last_clean":"2024-09-11T22:13:41.305685+0000","last_became_active":"2024-09-11T22:13:40.315154+0000","last_became_peered":"2024-09-11T22:13:40.315154+0000","last_unstale":"2024-09-11T22:13:41.305685+0000","last_undegraded":"2024-09-11T22:13:41.305685+0000","last_fullsized":"2024-09-11T22:13:41.305685+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:38.851009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785110+0000","last_change":"2024-09-11T22:13:39.310777+0000","last_active":"2024-09-11T22:13:41.785110+0000","last_peered":"2024-09-11T22:13:41.785110+0000","last_clean":"2024-09-11T22:13:41.785110+0000","last_became_active":"2024-09-11T22:13:39.310498+0000","last_became_peered":"2024-09-11T22:13:39.310498+0000","last_unstale":"2024-09-11T22:13:41.785110+0000","last_undegraded":"2024-09-11T22:13:41.785110+0000","last_fullsized":"2024-09-11T22:13:41.785110+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:27.152791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785399+0000","last_change":"2024-09-11T22:13:40.321086+0000","last_active":"2024-09-11T22:13:41.785399+0000","last_peered":"2024-09-11T22:13:41.785399+0000","last_clean":"2024-09-11T22:13:41.785399+0000","last_became_active":"2024-09-11T22:13:40.319924+0000","last_became_peered":"2024-09-11T22:13:40.319924+0000","last_unstale":"2024-09-11T22:13:41.785399+0000","last_undegraded":"2024-09-11T22:13:41.785399+0000","last_fullsized":"2024-09-11T22:13:41.785399+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:41.166847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306884+0000","last_change":"2024-09-11T22:13:39.310021+0000","last_active":"2024-09-11T22:13:41.306884+0000","last_peered":"2024-09-11T22:13:41.306884+0000","last_clean":"2024-09-11T22:13:41.306884+0000","last_became_active":"2024-09-11T22:13:39.309718+0000","last_became_peered":"2024-09-11T22:13:39.309718+0000","last_unstale":"2024-09-11T22:13:41.306884+0000","last_undegraded":"2024-09-11T22:13:41.306884+0000","last_fullsized":"2024-09-11T22:13:41.306884+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:24.994673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":213,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785129+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:13:41.785129+0000","last_peered":"2024-09-11T22:13:41.785129+0000","last_clean":"2024-09-11T22:13:41.785129+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:13:41.785129+0000","last_undegraded":"2024-09-11T22:13:41.785129+0000","last_fullsized":"2024-09-11T22:13:41.785129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335968,"statfs":{"total":96636764160,"available":96600031232,"internally_reserved":0,"allocated":528384,"data_stored":212152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35860,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335980,"statfs":{"total":96636764160,"available":96600043520,"internally_reserved":0,"allocated":524288,"data_stored":211550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35868,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335972,"statfs":{"total":96636764160,"available":96600035328,"internally_reserved":0,"allocated":532480,"data_stored":213092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":532480,"data_stored":212118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44180,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327660,"statfs":{"total":96636764160,"available":96591523840,"internally_reserved":0,"allocated":524288,"data_stored":211550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36444,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335396,"statfs":{"total":96636764160,"available":96599445504,"internally_reserved":0,"allocated":1118208,"data_stored":801882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36436,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335404,"statfs":{"total":96636764160,"available":96599453696,"internally_reserved":0,"allocated":1105920,"data_stored":795638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":524288,"data_stored":206814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:13:48.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:13:48.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.826+0000 7f55942f1640 1 Processor -- start 2024-09-11T22:13:48.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.826+0000 7f55942f1640 1 -- start start 2024-09-11T22:13:48.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.827+0000 7f55942f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c0cf610 0x7f558c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:48.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.827+0000 7f55942f1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f558c0b1600 0x7f558c0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:48.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.827+0000 7f55942f1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f558c0cfbd0 con 0x7f558c161fa0 2024-09-11T22:13:48.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.827+0000 7f55942f1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f558c0d1220 con 0x7f558c0b1600 2024-09-11T22:13:48.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.827+0000 7f55942f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f558c0d17e0 con 0x7f558c0cf610 2024-09-11T22:13:48.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.827+0000 7f559208d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f558c161fa0 0x7f558c0cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52746/0 (socket says 172.21.15.50:52746) 2024-09-11T22:13:48.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.827+0000 7f559208d640 1 -- 172.21.15.50:0/2737917487 learned_addr learned my addr 172.21.15.50:0/2737917487 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:48.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.827+0000 7f559188c640 1 --2- 172.21.15.50:0/2737917487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c0cf610 0x7f558c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559288e640 1 --2- 172.21.15.50:0/2737917487 >> v2:172.21.15.77:3300/0 conn(0x7f558c0b1600 0x7f558c0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2417992864 0 0) 0x7f558c0cfbd0 con 0x7f558c161fa0 2024-09-11T22:13:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5578003520 con 0x7f558c161fa0 2024-09-11T22:13:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1784307870 0 0) 0x7f5578003520 con 0x7f558c161fa0 2024-09-11T22:13:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c0cf610 msgr2=0x7f558c0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 --2- 172.21.15.50:0/2737917487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c0cf610 0x7f558c0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 >> v2:172.21.15.77:3300/0 conn(0x7f558c0b1600 msgr2=0x7f558c0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 --2- 172.21.15.50:0/2737917487 >> v2:172.21.15.77:3300/0 conn(0x7f558c0b1600 0x7f558c0cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558c0cfeb0 con 0x7f558c161fa0 2024-09-11T22:13:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f5588001670 con 0x7f558c161fa0 2024-09-11T22:13:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 >> v1:172.21.15.50:6789/0 conn(0x7f558c161fa0 legacy=0x7f558c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:48.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 --2- 172.21.15.50:0/2737917487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55780039b0 0x7f5578003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:48.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 --2- 172.21.15.50:0/2737917487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c0cf610 0x7f5578004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:48.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 --2- 172.21.15.50:0/2737917487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5578004d40 0x7f55780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:48.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f558c0d1220 con 0x7f5578004d40 2024-09-11T22:13:48.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f558c0d17e0 con 0x7f55780039b0 2024-09-11T22:13:48.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f557800b9c0 con 0x7f558c0cf610 2024-09-11T22:13:48.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559288e640 1 --2- 172.21.15.50:0/2737917487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5578004d40 0x7f55780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:48.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559208d640 1 --2- 172.21.15.50:0/2737917487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55780039b0 0x7f5578003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:48.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559188c640 1 --2- 172.21.15.50:0/2737917487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c0cf610 0x7f5578004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:48.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559288e640 1 -- 172.21.15.50:0/2737917487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c0cf610 msgr2=0x7f5578004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:48.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559288e640 1 --2- 172.21.15.50:0/2737917487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c0cf610 0x7f5578004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:48.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559288e640 1 -- 172.21.15.50:0/2737917487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55780039b0 msgr2=0x7f5578003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:48.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559288e640 1 --2- 172.21.15.50:0/2737917487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55780039b0 0x7f5578003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:48.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559288e640 1 -- 172.21.15.50:0/2737917487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5578003520 con 0x7f5578004d40 2024-09-11T22:13:48.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.828+0000 7f559188c640 1 --2- 172.21.15.50:0/2737917487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c0cf610 0x7f5578004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:48.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.829+0000 7f559288e640 1 --2- 172.21.15.50:0/2737917487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5578004d40 0x7f55780051c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5584009fc0 tx=0x7f5578005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e82a43c2bd0dd20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:48.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.829+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584009c10 con 0x7f5578004d40 2024-09-11T22:13:48.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.829+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5584036070 con 0x7f5578004d40 2024-09-11T22:13:48.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.829+0000 7f559108b640 1 -- 172.21.15.50:0/2737917487 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558402d070 con 0x7f5578004d40 2024-09-11T22:13:48.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.830+0000 7f55942f1640 1 -- 172.21.15.50:0/2737917487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5578004d40 msgr2=0x7f55780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:48.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.830+0000 7f55942f1640 1 --2- 172.21.15.50:0/2737917487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5578004d40 0x7f55780051c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5584009fc0 tx=0x7f5578005830 comp rx=0 tx=0).stop 2024-09-11T22:13:48.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.830+0000 7f559288e640 1 -- 172.21.15.50:0/2737917487 reap_dead start 2024-09-11T22:13:48.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.830+0000 7f55942f1640 1 -- 172.21.15.50:0/2737917487 shutdown_connections 2024-09-11T22:13:48.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.830+0000 7f55942f1640 1 -- 172.21.15.50:0/2737917487 >> 172.21.15.50:0/2737917487 conn(0x7f558c09ba50 msgr2=0x7f558c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:48.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.830+0000 7f55942f1640 1 -- 172.21.15.50:0/2737917487 shutdown_connections 2024-09-11T22:13:48.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.830+0000 7f55942f1640 1 -- 172.21.15.50:0/2737917487 wait complete. 2024-09-11T22:13:48.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.831+0000 7f55942f1640 1 Processor -- start 2024-09-11T22:13:48.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.831+0000 7f55942f1640 1 -- start start 2024-09-11T22:13:48.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.832+0000 7f55942f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5578004d40 0x7f558c14d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:48.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.832+0000 7f55942f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c160380 0x7f558c160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:48.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.832+0000 7f55942f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f558c0b5550 0x7f558c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:48.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.832+0000 7f55942f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f558c162500 con 0x7f558c0b5550 2024-09-11T22:13:48.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.832+0000 7f55942f1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f558c162380 con 0x7f5578004d40 2024-09-11T22:13:48.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.832+0000 7f55942f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f558c0d1c70 con 0x7f558c160380 2024-09-11T22:13:48.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.832+0000 7f559288e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f558c0b5550 0x7f558c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:48.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.832+0000 7f559288e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f558c0b5550 0x7f558c0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57356/0 (socket says 172.21.15.50:57356) 2024-09-11T22:13:48.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.832+0000 7f559288e640 1 -- 172.21.15.50:0/1280742407 learned_addr learned my addr 172.21.15.50:0/1280742407 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:48.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.832+0000 7f559188c640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c160380 0x7f558c160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:48.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.832+0000 7f559208d640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5578004d40 0x7f558c14d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.833+0000 7f559288e640 1 -- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c160380 msgr2=0x7f558c160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.833+0000 7f559288e640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c160380 0x7f558c160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.833+0000 7f559288e640 1 -- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5578004d40 msgr2=0x7f558c14d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.833+0000 7f559288e640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5578004d40 0x7f558c14d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.833+0000 7f559288e640 1 -- 172.21.15.50:0/1280742407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558c160e40 con 0x7f558c0b5550 2024-09-11T22:13:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.833+0000 7f559288e640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f558c0b5550 0x7f558c0b59d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f558402af10 tx=0x7f5584009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.833+0000 7f5582ffd640 1 -- 172.21.15.50:0/1280742407 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584009c10 con 0x7f558c0b5550 2024-09-11T22:13:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.833+0000 7f5582ffd640 1 -- 172.21.15.50:0/1280742407 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5584040030 con 0x7f558c0b5550 2024-09-11T22:13:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.833+0000 7f55942f1640 1 -- 172.21.15.50:0/1280742407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558c161120 con 0x7f558c0b5550 2024-09-11T22:13:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.833+0000 7f5582ffd640 1 -- 172.21.15.50:0/1280742407 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584003df0 con 0x7f558c0b5550 2024-09-11T22:13:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.833+0000 7f55942f1640 1 -- 172.21.15.50:0/1280742407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f558c0b78a0 con 0x7f558c0b5550 2024-09-11T22:13:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.834+0000 7f55942f1640 1 -- 172.21.15.50:0/1280742407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f558c0b4d20 con 0x7f558c0b5550 2024-09-11T22:13:48.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.834+0000 7f5582ffd640 1 -- 172.21.15.50:0/1280742407 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5584005d10 con 0x7f558c0b5550 2024-09-11T22:13:48.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.835+0000 7f5582ffd640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f557006be60 0x7f557006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:48.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.835+0000 7f5582ffd640 1 -- 172.21.15.50:0/1280742407 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f55840ac280 con 0x7f558c0b5550 2024-09-11T22:13:48.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.835+0000 7f559208d640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f557006be60 0x7f557006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:48.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.836+0000 7f559208d640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f557006be60 0x7f557006e320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f55880015d0 tx=0x7f5588009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:48.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:48.839+0000 7f5582ffd640 1 -- 172.21.15.50:0/1280742407 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f558404a020 con 0x7f558c0b5550 2024-09-11T22:13:49.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.012+0000 7f55942f1640 1 -- 172.21.15.50:0/1280742407 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f558c0ce940 con 0x7f557006be60 2024-09-11T22:13:49.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.019+0000 7f5582ffd640 1 -- 172.21.15.50:0/1280742407 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f558c0ce940 con 0x7f557006be60 2024-09-11T22:13:49.022 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:49.023 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:13:49.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.022+0000 7f55942f1640 1 -- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f557006be60 msgr2=0x7f557006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.022+0000 7f55942f1640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f557006be60 0x7f557006e320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f55880015d0 tx=0x7f5588009040 comp rx=0 tx=0).stop 2024-09-11T22:13:49.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.022+0000 7f55942f1640 1 -- 172.21.15.50:0/1280742407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f558c0b5550 msgr2=0x7f558c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.022+0000 7f55942f1640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f558c0b5550 0x7f558c0b59d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f558402af10 tx=0x7f5584009750 comp rx=0 tx=0).stop 2024-09-11T22:13:49.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.022+0000 7f55942f1640 1 -- 172.21.15.50:0/1280742407 shutdown_connections 2024-09-11T22:13:49.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.022+0000 7f55942f1640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f557006be60 0x7f557006e320 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.022+0000 7f55942f1640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f558c160380 0x7f558c160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.022+0000 7f55942f1640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f558c0b5550 0x7f558c0b59d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.022+0000 7f55942f1640 1 --2- 172.21.15.50:0/1280742407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5578004d40 0x7f558c14d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.022+0000 7f55942f1640 1 -- 172.21.15.50:0/1280742407 >> 172.21.15.50:0/1280742407 conn(0x7f558c09ba50 msgr2=0x7f558c06fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:49.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.022+0000 7f55942f1640 1 -- 172.21.15.50:0/1280742407 shutdown_connections 2024-09-11T22:13:49.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.022+0000 7f55942f1640 1 -- 172.21.15.50:0/1280742407 wait complete. 2024-09-11T22:13:49.034 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-09-11T22:13:47.399011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304724,"kb_used_data":5288,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754669996,"statfs":{"total":773094113280,"available":772782075904,"internally_reserved":0,"allocated":5414912,"data_stored":2877396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":306433585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002073"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784907+0000","last_change":"2024-09-11T22:13:40.311514+0000","last_active":"2024-09-11T22:13:41.784907+0000","last_peered":"2024-09-11T22:13:41.784907+0000","last_clean":"2024-09-11T22:13:41.784907+0000","last_became_active":"2024-09-11T22:13:40.311230+0000","last_became_peered":"2024-09-11T22:13:40.311230+0000","last_unstale":"2024-09-11T22:13:41.784907+0000","last_undegraded":"2024-09-11T22:13:41.784907+0000","last_fullsized":"2024-09-11T22:13:41.784907+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:46.668580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306166+0000","last_change":"2024-09-11T22:13:40.319958+0000","last_active":"2024-09-11T22:13:41.306166+0000","last_peered":"2024-09-11T22:13:41.306166+0000","last_clean":"2024-09-11T22:13:41.306166+0000","last_became_active":"2024-09-11T22:13:40.319689+0000","last_became_peered":"2024-09-11T22:13:40.319689+0000","last_unstale":"2024-09-11T22:13:41.306166+0000","last_undegraded":"2024-09-11T22:13:41.306166+0000","last_fullsized":"2024-09-11T22:13:41.306166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:39.939105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.305698+0000","last_change":"2024-09-11T22:13:40.324117+0000","last_active":"2024-09-11T22:13:41.305698+0000","last_peered":"2024-09-11T22:13:41.305698+0000","last_clean":"2024-09-11T22:13:41.305698+0000","last_became_active":"2024-09-11T22:13:40.323855+0000","last_became_peered":"2024-09-11T22:13:40.323855+0000","last_unstale":"2024-09-11T22:13:41.305698+0000","last_undegraded":"2024-09-11T22:13:41.305698+0000","last_fullsized":"2024-09-11T22:13:41.305698+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:41.094489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784870+0000","last_change":"2024-09-11T22:13:40.316136+0000","last_active":"2024-09-11T22:13:41.784870+0000","last_peered":"2024-09-11T22:13:41.784870+0000","last_clean":"2024-09-11T22:13:41.784870+0000","last_became_active":"2024-09-11T22:13:40.315340+0000","last_became_peered":"2024-09-11T22:13:40.315340+0000","last_unstale":"2024-09-11T22:13:41.784870+0000","last_undegraded":"2024-09-11T22:13:41.784870+0000","last_fullsized":"2024-09-11T22:13:41.784870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:38.851009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306101+0000","last_change":"2024-09-11T22:13:40.319433+0000","last_active":"2024-09-11T22:13:41.306101+0000","last_peered":"2024-09-11T22:13:41.306101+0000","last_clean":"2024-09-11T22:13:41.306101+0000","last_became_active":"2024-09-11T22:13:40.319167+0000","last_became_peered":"2024-09-11T22:13:40.319167+0000","last_unstale":"2024-09-11T22:13:41.306101+0000","last_undegraded":"2024-09-11T22:13:41.306101+0000","last_fullsized":"2024-09-11T22:13:41.306101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:59.253104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317108+0000","last_change":"2024-09-11T22:13:40.313556+0000","last_active":"2024-09-11T22:13:41.317108+0000","last_peered":"2024-09-11T22:13:41.317108+0000","last_clean":"2024-09-11T22:13:41.317108+0000","last_became_active":"2024-09-11T22:13:40.313213+0000","last_became_peered":"2024-09-11T22:13:40.313213+0000","last_unstale":"2024-09-11T22:13:41.317108+0000","last_undegraded":"2024-09-11T22:13:41.317108+0000","last_fullsized":"2024-09-11T22:13:41.317108+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:26.815073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785039+0000","last_change":"2024-09-11T22:13:40.311634+0000","last_active":"2024-09-11T22:13:41.785039+0000","last_peered":"2024-09-11T22:13:41.785039+0000","last_clean":"2024-09-11T22:13:41.785039+0000","last_became_active":"2024-09-11T22:13:40.311350+0000","last_became_peered":"2024-09-11T22:13:40.311350+0000","last_unstale":"2024-09-11T22:13:41.785039+0000","last_undegraded":"2024-09-11T22:13:41.785039+0000","last_fullsized":"2024-09-11T22:13:41.785039+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:54.495405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784351+0000","last_change":"2024-09-11T22:13:40.316126+0000","last_active":"2024-09-11T22:13:41.784351+0000","last_peered":"2024-09-11T22:13:41.784351+0000","last_clean":"2024-09-11T22:13:41.784351+0000","last_became_active":"2024-09-11T22:13:40.315791+0000","last_became_peered":"2024-09-11T22:13:40.315791+0000","last_unstale":"2024-09-11T22:13:41.784351+0000","last_undegraded":"2024-09-11T22:13:41.784351+0000","last_fullsized":"2024-09-11T22:13:41.784351+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:03.392094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784902+0000","last_change":"2024-09-11T22:13:40.317237+0000","last_active":"2024-09-11T22:13:41.784902+0000","last_peered":"2024-09-11T22:13:41.784902+0000","last_clean":"2024-09-11T22:13:41.784902+0000","last_became_active":"2024-09-11T22:13:40.316946+0000","last_became_peered":"2024-09-11T22:13:40.316946+0000","last_unstale":"2024-09-11T22:13:41.784902+0000","last_undegraded":"2024-09-11T22:13:41.784902+0000","last_fullsized":"2024-09-11T22:13:41.784902+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:05.535282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785355+0000","last_change":"2024-09-11T22:13:40.317286+0000","last_active":"2024-09-11T22:13:41.785355+0000","last_peered":"2024-09-11T22:13:41.785355+0000","last_clean":"2024-09-11T22:13:41.785355+0000","last_became_active":"2024-09-11T22:13:40.316577+0000","last_became_peered":"2024-09-11T22:13:40.316577+0000","last_unstale":"2024-09-11T22:13:41.785355+0000","last_undegraded":"2024-09-11T22:13:41.785355+0000","last_fullsized":"2024-09-11T22:13:41.785355+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:45.063162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785284+0000","last_change":"2024-09-11T22:13:40.316417+0000","last_active":"2024-09-11T22:13:41.785284+0000","last_peered":"2024-09-11T22:13:41.785284+0000","last_clean":"2024-09-11T22:13:41.785284+0000","last_became_active":"2024-09-11T22:13:40.316034+0000","last_became_peered":"2024-09-11T22:13:40.316034+0000","last_unstale":"2024-09-11T22:13:41.785284+0000","last_undegraded":"2024-09-11T22:13:41.785284+0000","last_fullsized":"2024-09-11T22:13:41.785284+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:12.192383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306557+0000","last_change":"2024-09-11T22:13:40.305607+0000","last_active":"2024-09-11T22:13:41.306557+0000","last_peered":"2024-09-11T22:13:41.306557+0000","last_clean":"2024-09-11T22:13:41.306557+0000","last_became_active":"2024-09-11T22:13:40.305230+0000","last_became_peered":"2024-09-11T22:13:40.305230+0000","last_unstale":"2024-09-11T22:13:41.306557+0000","last_undegraded":"2024-09-11T22:13:41.306557+0000","last_fullsized":"2024-09-11T22:13:41.306557+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:01.991894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304255+0000","last_change":"2024-09-11T22:13:40.319919+0000","last_active":"2024-09-11T22:13:41.304255+0000","last_peered":"2024-09-11T22:13:41.304255+0000","last_clean":"2024-09-11T22:13:41.304255+0000","last_became_active":"2024-09-11T22:13:40.319595+0000","last_became_peered":"2024-09-11T22:13:40.319595+0000","last_unstale":"2024-09-11T22:13:41.304255+0000","last_undegraded":"2024-09-11T22:13:41.304255+0000","last_fullsized":"2024-09-11T22:13:41.304255+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:01.306291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784645+0000","last_change":"2024-09-11T22:13:40.316672+0000","last_active":"2024-09-11T22:13:41.784645+0000","last_peered":"2024-09-11T22:13:41.784645+0000","last_clean":"2024-09-11T22:13:41.784645+0000","last_became_active":"2024-09-11T22:13:40.315612+0000","last_became_peered":"2024-09-11T22:13:40.315612+0000","last_unstale":"2024-09-11T22:13:41.784645+0000","last_undegraded":"2024-09-11T22:13:41.784645+0000","last_fullsized":"2024-09-11T22:13:41.784645+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:00.546420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317050+0000","last_change":"2024-09-11T22:13:40.313398+0000","last_active":"2024-09-11T22:13:41.317050+0000","last_peered":"2024-09-11T22:13:41.317050+0000","last_clean":"2024-09-11T22:13:41.317050+0000","last_became_active":"2024-09-11T22:13:40.312967+0000","last_became_peered":"2024-09-11T22:13:40.312967+0000","last_unstale":"2024-09-11T22:13:41.317050+0000","last_undegraded":"2024-09-11T22:13:41.317050+0000","last_fullsized":"2024-09-11T22:13:41.317050+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:35.757036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784476+0000","last_change":"2024-09-11T22:13:40.318859+0000","last_active":"2024-09-11T22:13:41.784476+0000","last_peered":"2024-09-11T22:13:41.784476+0000","last_clean":"2024-09-11T22:13:41.784476+0000","last_became_active":"2024-09-11T22:13:40.318550+0000","last_became_peered":"2024-09-11T22:13:40.318550+0000","last_unstale":"2024-09-11T22:13:41.784476+0000","last_undegraded":"2024-09-11T22:13:41.784476+0000","last_fullsized":"2024-09-11T22:13:41.784476+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:33.931194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306269+0000","last_change":"2024-09-11T22:13:40.313765+0000","last_active":"2024-09-11T22:13:41.306269+0000","last_peered":"2024-09-11T22:13:41.306269+0000","last_clean":"2024-09-11T22:13:41.306269+0000","last_became_active":"2024-09-11T22:13:40.313496+0000","last_became_peered":"2024-09-11T22:13:40.313496+0000","last_unstale":"2024-09-11T22:13:41.306269+0000","last_undegraded":"2024-09-11T22:13:41.306269+0000","last_fullsized":"2024-09-11T22:13:41.306269+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:21.560499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.305997+0000","last_change":"2024-09-11T22:13:40.320248+0000","last_active":"2024-09-11T22:13:41.305997+0000","last_peered":"2024-09-11T22:13:41.305997+0000","last_clean":"2024-09-11T22:13:41.305997+0000","last_became_active":"2024-09-11T22:13:40.319942+0000","last_became_peered":"2024-09-11T22:13:40.319942+0000","last_unstale":"2024-09-11T22:13:41.305997+0000","last_undegraded":"2024-09-11T22:13:41.305997+0000","last_fullsized":"2024-09-11T22:13:41.305997+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:25.999494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785447+0000","last_change":"2024-09-11T22:13:40.318560+0000","last_active":"2024-09-11T22:13:41.785447+0000","last_peered":"2024-09-11T22:13:41.785447+0000","last_clean":"2024-09-11T22:13:41.785447+0000","last_became_active":"2024-09-11T22:13:40.318183+0000","last_became_peered":"2024-09-11T22:13:40.318183+0000","last_unstale":"2024-09-11T22:13:41.785447+0000","last_undegraded":"2024-09-11T22:13:41.785447+0000","last_fullsized":"2024-09-11T22:13:41.785447+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:06.043743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304411+0000","last_change":"2024-09-11T22:13:40.325041+0000","last_active":"2024-09-11T22:13:41.304411+0000","last_peered":"2024-09-11T22:13:41.304411+0000","last_clean":"2024-09-11T22:13:41.304411+0000","last_became_active":"2024-09-11T22:13:40.324467+0000","last_became_peered":"2024-09-11T22:13:40.324467+0000","last_unstale":"2024-09-11T22:13:41.304411+0000","last_undegraded":"2024-09-11T22:13:41.304411+0000","last_fullsized":"2024-09-11T22:13:41.304411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:50.478469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317202+0000","last_change":"2024-09-11T22:13:40.320156+0000","last_active":"2024-09-11T22:13:41.317202+0000","last_peered":"2024-09-11T22:13:41.317202+0000","last_clean":"2024-09-11T22:13:41.317202+0000","last_became_active":"2024-09-11T22:13:40.319860+0000","last_became_peered":"2024-09-11T22:13:40.319860+0000","last_unstale":"2024-09-11T22:13:41.317202+0000","last_undegraded":"2024-09-11T22:13:41.317202+0000","last_fullsized":"2024-09-11T22:13:41.317202+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:32.001129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784804+0000","last_change":"2024-09-11T22:13:40.315838+0000","last_active":"2024-09-11T22:13:41.784804+0000","last_peered":"2024-09-11T22:13:41.784804+0000","last_clean":"2024-09-11T22:13:41.784804+0000","last_became_active":"2024-09-11T22:13:40.315462+0000","last_became_peered":"2024-09-11T22:13:40.315462+0000","last_unstale":"2024-09-11T22:13:41.784804+0000","last_undegraded":"2024-09-11T22:13:41.784804+0000","last_fullsized":"2024-09-11T22:13:41.784804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:01.785141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784633+0000","last_change":"2024-09-11T22:13:40.312473+0000","last_active":"2024-09-11T22:13:41.784633+0000","last_peered":"2024-09-11T22:13:41.784633+0000","last_clean":"2024-09-11T22:13:41.784633+0000","last_became_active":"2024-09-11T22:13:40.311672+0000","last_became_peered":"2024-09-11T22:13:40.311672+0000","last_unstale":"2024-09-11T22:13:41.784633+0000","last_undegraded":"2024-09-11T22:13:41.784633+0000","last_fullsized":"2024-09-11T22:13:41.784633+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:10.539785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785280+0000","last_change":"2024-09-11T22:13:40.311493+0000","last_active":"2024-09-11T22:13:41.785280+0000","last_peered":"2024-09-11T22:13:41.785280+0000","last_clean":"2024-09-11T22:13:41.785280+0000","last_became_active":"2024-09-11T22:13:40.311185+0000","last_became_peered":"2024-09-11T22:13:40.311185+0000","last_unstale":"2024-09-11T22:13:41.785280+0000","last_undegraded":"2024-09-11T22:13:41.785280+0000","last_fullsized":"2024-09-11T22:13:41.785280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:59.477599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785608+0000","last_change":"2024-09-11T22:13:40.305841+0000","last_active":"2024-09-11T22:13:41.785608+0000","last_peered":"2024-09-11T22:13:41.785608+0000","last_clean":"2024-09-11T22:13:41.785608+0000","last_became_active":"2024-09-11T22:13:40.305537+0000","last_became_peered":"2024-09-11T22:13:40.305537+0000","last_unstale":"2024-09-11T22:13:41.785608+0000","last_undegraded":"2024-09-11T22:13:41.785608+0000","last_fullsized":"2024-09-11T22:13:41.785608+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:20.667319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304434+0000","last_change":"2024-09-11T22:13:40.318761+0000","last_active":"2024-09-11T22:13:41.304434+0000","last_peered":"2024-09-11T22:13:41.304434+0000","last_clean":"2024-09-11T22:13:41.304434+0000","last_became_active":"2024-09-11T22:13:40.318451+0000","last_became_peered":"2024-09-11T22:13:40.318451+0000","last_unstale":"2024-09-11T22:13:41.304434+0000","last_undegraded":"2024-09-11T22:13:41.304434+0000","last_fullsized":"2024-09-11T22:13:41.304434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:28.473773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306555+0000","last_change":"2024-09-11T22:13:40.314618+0000","last_active":"2024-09-11T22:13:41.306555+0000","last_peered":"2024-09-11T22:13:41.306555+0000","last_clean":"2024-09-11T22:13:41.306555+0000","last_became_active":"2024-09-11T22:13:40.314210+0000","last_became_peered":"2024-09-11T22:13:40.314210+0000","last_unstale":"2024-09-11T22:13:41.306555+0000","last_undegraded":"2024-09-11T22:13:41.306555+0000","last_fullsized":"2024-09-11T22:13:41.306555+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:12.192383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306600+0000","last_change":"2024-09-11T22:13:40.305069+0000","last_active":"2024-09-11T22:13:41.306600+0000","last_peered":"2024-09-11T22:13:41.306600+0000","last_clean":"2024-09-11T22:13:41.306600+0000","last_became_active":"2024-09-11T22:13:40.304668+0000","last_became_peered":"2024-09-11T22:13:40.304668+0000","last_unstale":"2024-09-11T22:13:41.306600+0000","last_undegraded":"2024-09-11T22:13:41.306600+0000","last_fullsized":"2024-09-11T22:13:41.306600+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:53.897298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784866+0000","last_change":"2024-09-11T22:13:40.302879+0000","last_active":"2024-09-11T22:13:41.784866+0000","last_peered":"2024-09-11T22:13:41.784866+0000","last_clean":"2024-09-11T22:13:41.784866+0000","last_became_active":"2024-09-11T22:13:40.302166+0000","last_became_peered":"2024-09-11T22:13:40.302166+0000","last_unstale":"2024-09-11T22:13:41.784866+0000","last_undegraded":"2024-09-11T22:13:41.784866+0000","last_fullsized":"2024-09-11T22:13:41.784866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:44.442086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.305817+0000","last_change":"2024-09-11T22:13:40.313097+0000","last_active":"2024-09-11T22:13:41.305817+0000","last_peered":"2024-09-11T22:13:41.305817+0000","last_clean":"2024-09-11T22:13:41.305817+0000","last_became_active":"2024-09-11T22:13:40.312718+0000","last_became_peered":"2024-09-11T22:13:40.312718+0000","last_unstale":"2024-09-11T22:13:41.305817+0000","last_undegraded":"2024-09-11T22:13:41.305817+0000","last_fullsized":"2024-09-11T22:13:41.305817+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:01.439424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317050+0000","last_change":"2024-09-11T22:13:40.314146+0000","last_active":"2024-09-11T22:13:41.317050+0000","last_peered":"2024-09-11T22:13:41.317050+0000","last_clean":"2024-09-11T22:13:41.317050+0000","last_became_active":"2024-09-11T22:13:40.313747+0000","last_became_peered":"2024-09-11T22:13:40.313747+0000","last_unstale":"2024-09-11T22:13:41.317050+0000","last_undegraded":"2024-09-11T22:13:41.317050+0000","last_fullsized":"2024-09-11T22:13:41.317050+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:04.675236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304147+0000","last_change":"2024-09-11T22:13:40.303372+0000","last_active":"2024-09-11T22:13:41.304147+0000","last_peered":"2024-09-11T22:13:41.304147+0000","last_clean":"2024-09-11T22:13:41.304147+0000","last_became_active":"2024-09-11T22:13:40.303042+0000","last_became_peered":"2024-09-11T22:13:40.303042+0000","last_unstale":"2024-09-11T22:13:41.304147+0000","last_undegraded":"2024-09-11T22:13:41.304147+0000","last_fullsized":"2024-09-11T22:13:41.304147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:50.061486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784638+0000","last_change":"2024-09-11T22:13:40.321112+0000","last_active":"2024-09-11T22:13:41.784638+0000","last_peered":"2024-09-11T22:13:41.784638+0000","last_clean":"2024-09-11T22:13:41.784638+0000","last_became_active":"2024-09-11T22:13:40.320789+0000","last_became_peered":"2024-09-11T22:13:40.320789+0000","last_unstale":"2024-09-11T22:13:41.784638+0000","last_undegraded":"2024-09-11T22:13:41.784638+0000","last_fullsized":"2024-09-11T22:13:41.784638+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:03.392094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317405+0000","last_change":"2024-09-11T22:13:39.312323+0000","last_active":"2024-09-11T22:13:41.317405+0000","last_peered":"2024-09-11T22:13:41.317405+0000","last_clean":"2024-09-11T22:13:41.317405+0000","last_became_active":"2024-09-11T22:13:39.312023+0000","last_became_peered":"2024-09-11T22:13:39.312023+0000","last_unstale":"2024-09-11T22:13:41.317405+0000","last_undegraded":"2024-09-11T22:13:41.317405+0000","last_fullsized":"2024-09-11T22:13:41.317405+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:20.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785500+0000","last_change":"2024-09-11T22:13:40.310374+0000","last_active":"2024-09-11T22:13:41.785500+0000","last_peered":"2024-09-11T22:13:41.785500+0000","last_clean":"2024-09-11T22:13:41.785500+0000","last_became_active":"2024-09-11T22:13:40.310101+0000","last_became_peered":"2024-09-11T22:13:40.310101+0000","last_unstale":"2024-09-11T22:13:41.785500+0000","last_undegraded":"2024-09-11T22:13:41.785500+0000","last_fullsized":"2024-09-11T22:13:41.785500+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:30.345056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306121+0000","last_change":"2024-09-11T22:13:39.307957+0000","last_active":"2024-09-11T22:13:41.306121+0000","last_peered":"2024-09-11T22:13:41.306121+0000","last_clean":"2024-09-11T22:13:41.306121+0000","last_became_active":"2024-09-11T22:13:39.307664+0000","last_became_peered":"2024-09-11T22:13:39.307664+0000","last_unstale":"2024-09-11T22:13:41.306121+0000","last_undegraded":"2024-09-11T22:13:41.306121+0000","last_fullsized":"2024-09-11T22:13:41.306121+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:24.275744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306741+0000","last_change":"2024-09-11T22:13:40.315245+0000","last_active":"2024-09-11T22:13:41.306741+0000","last_peered":"2024-09-11T22:13:41.306741+0000","last_clean":"2024-09-11T22:13:41.306741+0000","last_became_active":"2024-09-11T22:13:40.314933+0000","last_became_peered":"2024-09-11T22:13:40.314933+0000","last_unstale":"2024-09-11T22:13:41.306741+0000","last_undegraded":"2024-09-11T22:13:41.306741+0000","last_fullsized":"2024-09-11T22:13:41.306741+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:11.191910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784870+0000","last_change":"2024-09-11T22:13:39.306671+0000","last_active":"2024-09-11T22:13:41.784870+0000","last_peered":"2024-09-11T22:13:41.784870+0000","last_clean":"2024-09-11T22:13:41.784870+0000","last_became_active":"2024-09-11T22:13:39.305428+0000","last_became_peered":"2024-09-11T22:13:39.305428+0000","last_unstale":"2024-09-11T22:13:41.784870+0000","last_undegraded":"2024-09-11T22:13:41.784870+0000","last_fullsized":"2024-09-11T22:13:41.784870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:05.008782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784776+0000","last_change":"2024-09-11T22:13:40.307090+0000","last_active":"2024-09-11T22:13:41.784776+0000","last_peered":"2024-09-11T22:13:41.784776+0000","last_clean":"2024-09-11T22:13:41.784776+0000","last_became_active":"2024-09-11T22:13:40.306796+0000","last_became_peered":"2024-09-11T22:13:40.306796+0000","last_unstale":"2024-09-11T22:13:41.784776+0000","last_undegraded":"2024-09-11T22:13:41.784776+0000","last_fullsized":"2024-09-11T22:13:41.784776+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:01.159466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785107+0000","last_change":"2024-09-11T22:13:39.306928+0000","last_active":"2024-09-11T22:13:41.785107+0000","last_peered":"2024-09-11T22:13:41.785107+0000","last_clean":"2024-09-11T22:13:41.785107+0000","last_became_active":"2024-09-11T22:13:39.306644+0000","last_became_peered":"2024-09-11T22:13:39.306644+0000","last_unstale":"2024-09-11T22:13:41.785107+0000","last_undegraded":"2024-09-11T22:13:41.785107+0000","last_fullsized":"2024-09-11T22:13:41.785107+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:38.578419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.305984+0000","last_change":"2024-09-11T22:13:40.311825+0000","last_active":"2024-09-11T22:13:41.305984+0000","last_peered":"2024-09-11T22:13:41.305984+0000","last_clean":"2024-09-11T22:13:41.305984+0000","last_became_active":"2024-09-11T22:13:40.311525+0000","last_became_peered":"2024-09-11T22:13:40.311525+0000","last_unstale":"2024-09-11T22:13:41.305984+0000","last_undegraded":"2024-09-11T22:13:41.305984+0000","last_fullsized":"2024-09-11T22:13:41.305984+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:05.535282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317390+0000","last_change":"2024-09-11T22:13:39.312090+0000","last_active":"2024-09-11T22:13:41.317390+0000","last_peered":"2024-09-11T22:13:41.317390+0000","last_clean":"2024-09-11T22:13:41.317390+0000","last_became_active":"2024-09-11T22:13:39.311481+0000","last_became_peered":"2024-09-11T22:13:39.311481+0000","last_unstale":"2024-09-11T22:13:41.317390+0000","last_undegraded":"2024-09-11T22:13:41.317390+0000","last_fullsized":"2024-09-11T22:13:41.317390+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:44.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784960+0000","last_change":"2024-09-11T22:13:40.324078+0000","last_active":"2024-09-11T22:13:41.784960+0000","last_peered":"2024-09-11T22:13:41.784960+0000","last_clean":"2024-09-11T22:13:41.784960+0000","last_became_active":"2024-09-11T22:13:40.320471+0000","last_became_peered":"2024-09-11T22:13:40.320471+0000","last_unstale":"2024-09-11T22:13:41.784960+0000","last_undegraded":"2024-09-11T22:13:41.784960+0000","last_fullsized":"2024-09-11T22:13:41.784960+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:25.999494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306080+0000","last_change":"2024-09-11T22:13:39.303131+0000","last_active":"2024-09-11T22:13:41.306080+0000","last_peered":"2024-09-11T22:13:41.306080+0000","last_clean":"2024-09-11T22:13:41.306080+0000","last_became_active":"2024-09-11T22:13:39.302818+0000","last_became_peered":"2024-09-11T22:13:39.302818+0000","last_unstale":"2024-09-11T22:13:41.306080+0000","last_undegraded":"2024-09-11T22:13:41.306080+0000","last_fullsized":"2024-09-11T22:13:41.306080+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:14.986852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784511+0000","last_change":"2024-09-11T22:13:40.323526+0000","last_active":"2024-09-11T22:13:41.784511+0000","last_peered":"2024-09-11T22:13:41.784511+0000","last_clean":"2024-09-11T22:13:41.784511+0000","last_became_active":"2024-09-11T22:13:40.320686+0000","last_became_peered":"2024-09-11T22:13:40.320686+0000","last_unstale":"2024-09-11T22:13:41.784511+0000","last_undegraded":"2024-09-11T22:13:41.784511+0000","last_fullsized":"2024-09-11T22:13:41.784511+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:41.094489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306364+0000","last_change":"2024-09-11T22:13:39.300952+0000","last_active":"2024-09-11T22:13:41.306364+0000","last_peered":"2024-09-11T22:13:41.306364+0000","last_clean":"2024-09-11T22:13:41.306364+0000","last_became_active":"2024-09-11T22:13:39.300653+0000","last_became_peered":"2024-09-11T22:13:39.300653+0000","last_unstale":"2024-09-11T22:13:41.306364+0000","last_undegraded":"2024-09-11T22:13:41.306364+0000","last_fullsized":"2024-09-11T22:13:41.306364+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:37.846188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784459+0000","last_change":"2024-09-11T22:13:40.312706+0000","last_active":"2024-09-11T22:13:41.784459+0000","last_peered":"2024-09-11T22:13:41.784459+0000","last_clean":"2024-09-11T22:13:41.784459+0000","last_became_active":"2024-09-11T22:13:40.312059+0000","last_became_peered":"2024-09-11T22:13:40.312059+0000","last_unstale":"2024-09-11T22:13:41.784459+0000","last_undegraded":"2024-09-11T22:13:41.784459+0000","last_fullsized":"2024-09-11T22:13:41.784459+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:35.313802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784963+0000","last_change":"2024-09-11T22:13:39.303791+0000","last_active":"2024-09-11T22:13:41.784963+0000","last_peered":"2024-09-11T22:13:41.784963+0000","last_clean":"2024-09-11T22:13:41.784963+0000","last_became_active":"2024-09-11T22:13:39.303375+0000","last_became_peered":"2024-09-11T22:13:39.303375+0000","last_unstale":"2024-09-11T22:13:41.784963+0000","last_undegraded":"2024-09-11T22:13:41.784963+0000","last_fullsized":"2024-09-11T22:13:41.784963+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:36.069658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306099+0000","last_change":"2024-09-11T22:13:40.320101+0000","last_active":"2024-09-11T22:13:41.306099+0000","last_peered":"2024-09-11T22:13:41.306099+0000","last_clean":"2024-09-11T22:13:41.306099+0000","last_became_active":"2024-09-11T22:13:40.319822+0000","last_became_peered":"2024-09-11T22:13:40.319822+0000","last_unstale":"2024-09-11T22:13:41.306099+0000","last_undegraded":"2024-09-11T22:13:41.306099+0000","last_fullsized":"2024-09-11T22:13:41.306099+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:47.275703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306364+0000","last_change":"2024-09-11T22:13:39.310133+0000","last_active":"2024-09-11T22:13:41.306364+0000","last_peered":"2024-09-11T22:13:41.306364+0000","last_clean":"2024-09-11T22:13:41.306364+0000","last_became_active":"2024-09-11T22:13:39.309863+0000","last_became_peered":"2024-09-11T22:13:39.309863+0000","last_unstale":"2024-09-11T22:13:41.306364+0000","last_undegraded":"2024-09-11T22:13:41.306364+0000","last_fullsized":"2024-09-11T22:13:41.306364+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:58.472779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785173+0000","last_change":"2024-09-11T22:13:40.310838+0000","last_active":"2024-09-11T22:13:41.785173+0000","last_peered":"2024-09-11T22:13:41.785173+0000","last_clean":"2024-09-11T22:13:41.785173+0000","last_became_active":"2024-09-11T22:13:40.310520+0000","last_became_peered":"2024-09-11T22:13:40.310520+0000","last_unstale":"2024-09-11T22:13:41.785173+0000","last_undegraded":"2024-09-11T22:13:41.785173+0000","last_fullsized":"2024-09-11T22:13:41.785173+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:02.177660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785418+0000","last_change":"2024-09-11T22:13:39.310075+0000","last_active":"2024-09-11T22:13:41.785418+0000","last_peered":"2024-09-11T22:13:41.785418+0000","last_clean":"2024-09-11T22:13:41.785418+0000","last_became_active":"2024-09-11T22:13:39.309660+0000","last_became_peered":"2024-09-11T22:13:39.309660+0000","last_unstale":"2024-09-11T22:13:41.785418+0000","last_undegraded":"2024-09-11T22:13:41.785418+0000","last_fullsized":"2024-09-11T22:13:41.785418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:03.080445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317481+0000","last_change":"2024-09-11T22:13:40.322234+0000","last_active":"2024-09-11T22:13:41.317481+0000","last_peered":"2024-09-11T22:13:41.317481+0000","last_clean":"2024-09-11T22:13:41.317481+0000","last_became_active":"2024-09-11T22:13:40.321780+0000","last_became_peered":"2024-09-11T22:13:40.321780+0000","last_unstale":"2024-09-11T22:13:41.317481+0000","last_undegraded":"2024-09-11T22:13:41.317481+0000","last_fullsized":"2024-09-11T22:13:41.317481+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:07.314954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784958+0000","last_change":"2024-09-11T22:13:39.310563+0000","last_active":"2024-09-11T22:13:41.784958+0000","last_peered":"2024-09-11T22:13:41.784958+0000","last_clean":"2024-09-11T22:13:41.784958+0000","last_became_active":"2024-09-11T22:13:39.310308+0000","last_became_peered":"2024-09-11T22:13:39.310308+0000","last_unstale":"2024-09-11T22:13:41.784958+0000","last_undegraded":"2024-09-11T22:13:41.784958+0000","last_fullsized":"2024-09-11T22:13:41.784958+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:44.471766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784988+0000","last_change":"2024-09-11T22:13:40.314486+0000","last_active":"2024-09-11T22:13:41.784988+0000","last_peered":"2024-09-11T22:13:41.784988+0000","last_clean":"2024-09-11T22:13:41.784988+0000","last_became_active":"2024-09-11T22:13:40.313645+0000","last_became_peered":"2024-09-11T22:13:40.313645+0000","last_unstale":"2024-09-11T22:13:41.784988+0000","last_undegraded":"2024-09-11T22:13:41.784988+0000","last_fullsized":"2024-09-11T22:13:41.784988+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:30.358742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304403+0000","last_change":"2024-09-11T22:13:39.303367+0000","last_active":"2024-09-11T22:13:41.304403+0000","last_peered":"2024-09-11T22:13:41.304403+0000","last_clean":"2024-09-11T22:13:41.304403+0000","last_became_active":"2024-09-11T22:13:39.302860+0000","last_became_peered":"2024-09-11T22:13:39.302860+0000","last_unstale":"2024-09-11T22:13:41.304403+0000","last_undegraded":"2024-09-11T22:13:41.304403+0000","last_fullsized":"2024-09-11T22:13:41.304403+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:48.672367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784772+0000","last_change":"2024-09-11T22:13:40.316388+0000","last_active":"2024-09-11T22:13:41.784772+0000","last_peered":"2024-09-11T22:13:41.784772+0000","last_clean":"2024-09-11T22:13:41.784772+0000","last_became_active":"2024-09-11T22:13:40.316118+0000","last_became_peered":"2024-09-11T22:13:40.316118+0000","last_unstale":"2024-09-11T22:13:41.784772+0000","last_undegraded":"2024-09-11T22:13:41.784772+0000","last_fullsized":"2024-09-11T22:13:41.784772+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:25.280565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317397+0000","last_change":"2024-09-11T22:13:39.311084+0000","last_active":"2024-09-11T22:13:41.317397+0000","last_peered":"2024-09-11T22:13:41.317397+0000","last_clean":"2024-09-11T22:13:41.317397+0000","last_became_active":"2024-09-11T22:13:39.310795+0000","last_became_peered":"2024-09-11T22:13:39.310795+0000","last_unstale":"2024-09-11T22:13:41.317397+0000","last_undegraded":"2024-09-11T22:13:41.317397+0000","last_fullsized":"2024-09-11T22:13:41.317397+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:40.162026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785166+0000","last_change":"2024-09-11T22:13:40.317464+0000","last_active":"2024-09-11T22:13:41.785166+0000","last_peered":"2024-09-11T22:13:41.785166+0000","last_clean":"2024-09-11T22:13:41.785166+0000","last_became_active":"2024-09-11T22:13:40.317154+0000","last_became_peered":"2024-09-11T22:13:40.317154+0000","last_unstale":"2024-09-11T22:13:41.785166+0000","last_undegraded":"2024-09-11T22:13:41.785166+0000","last_fullsized":"2024-09-11T22:13:41.785166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:21.560499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784893+0000","last_change":"2024-09-11T22:13:39.312568+0000","last_active":"2024-09-11T22:13:41.784893+0000","last_peered":"2024-09-11T22:13:41.784893+0000","last_clean":"2024-09-11T22:13:41.784893+0000","last_became_active":"2024-09-11T22:13:39.312266+0000","last_became_peered":"2024-09-11T22:13:39.312266+0000","last_unstale":"2024-09-11T22:13:41.784893+0000","last_undegraded":"2024-09-11T22:13:41.784893+0000","last_fullsized":"2024-09-11T22:13:41.784893+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:52.535028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317031+0000","last_change":"2024-09-11T22:13:40.327056+0000","last_active":"2024-09-11T22:13:41.317031+0000","last_peered":"2024-09-11T22:13:41.317031+0000","last_clean":"2024-09-11T22:13:41.317031+0000","last_became_active":"2024-09-11T22:13:40.326772+0000","last_became_peered":"2024-09-11T22:13:40.326772+0000","last_unstale":"2024-09-11T22:13:41.317031+0000","last_undegraded":"2024-09-11T22:13:41.317031+0000","last_fullsized":"2024-09-11T22:13:41.317031+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:08.176038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317153+0000","last_change":"2024-09-11T22:13:39.311107+0000","last_active":"2024-09-11T22:13:41.317153+0000","last_peered":"2024-09-11T22:13:41.317153+0000","last_clean":"2024-09-11T22:13:41.317153+0000","last_became_active":"2024-09-11T22:13:39.310839+0000","last_became_peered":"2024-09-11T22:13:39.310839+0000","last_unstale":"2024-09-11T22:13:41.317153+0000","last_undegraded":"2024-09-11T22:13:41.317153+0000","last_fullsized":"2024-09-11T22:13:41.317153+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:46.270882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785227+0000","last_change":"2024-09-11T22:13:40.312864+0000","last_active":"2024-09-11T22:13:41.785227+0000","last_peered":"2024-09-11T22:13:41.785227+0000","last_clean":"2024-09-11T22:13:41.785227+0000","last_became_active":"2024-09-11T22:13:40.312064+0000","last_became_peered":"2024-09-11T22:13:40.312064+0000","last_unstale":"2024-09-11T22:13:41.785227+0000","last_undegraded":"2024-09-11T22:13:41.785227+0000","last_fullsized":"2024-09-11T22:13:41.785227+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:52.317665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785096+0000","last_change":"2024-09-11T22:13:39.305593+0000","last_active":"2024-09-11T22:13:41.785096+0000","last_peered":"2024-09-11T22:13:41.785096+0000","last_clean":"2024-09-11T22:13:41.785096+0000","last_became_active":"2024-09-11T22:13:39.305310+0000","last_became_peered":"2024-09-11T22:13:39.305310+0000","last_unstale":"2024-09-11T22:13:41.785096+0000","last_undegraded":"2024-09-11T22:13:41.785096+0000","last_fullsized":"2024-09-11T22:13:41.785096+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:00.797325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304434+0000","last_change":"2024-09-11T22:13:40.301662+0000","last_active":"2024-09-11T22:13:41.304434+0000","last_peered":"2024-09-11T22:13:41.304434+0000","last_clean":"2024-09-11T22:13:41.304434+0000","last_became_active":"2024-09-11T22:13:40.300969+0000","last_became_peered":"2024-09-11T22:13:40.300969+0000","last_unstale":"2024-09-11T22:13:41.304434+0000","last_undegraded":"2024-09-11T22:13:41.304434+0000","last_fullsized":"2024-09-11T22:13:41.304434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:10.319903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304471+0000","last_change":"2024-09-11T22:13:39.315068+0000","last_active":"2024-09-11T22:13:41.304471+0000","last_peered":"2024-09-11T22:13:41.304471+0000","last_clean":"2024-09-11T22:13:41.304471+0000","last_became_active":"2024-09-11T22:13:39.314741+0000","last_became_peered":"2024-09-11T22:13:39.314741+0000","last_unstale":"2024-09-11T22:13:41.304471+0000","last_undegraded":"2024-09-11T22:13:41.304471+0000","last_fullsized":"2024-09-11T22:13:41.304471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:49.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785088+0000","last_change":"2024-09-11T22:13:40.317527+0000","last_active":"2024-09-11T22:13:41.785088+0000","last_peered":"2024-09-11T22:13:41.785088+0000","last_clean":"2024-09-11T22:13:41.785088+0000","last_became_active":"2024-09-11T22:13:40.315083+0000","last_became_peered":"2024-09-11T22:13:40.315083+0000","last_unstale":"2024-09-11T22:13:41.785088+0000","last_undegraded":"2024-09-11T22:13:41.785088+0000","last_fullsized":"2024-09-11T22:13:41.785088+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:47.275703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306201+0000","last_change":"2024-09-11T22:13:39.301654+0000","last_active":"2024-09-11T22:13:41.306201+0000","last_peered":"2024-09-11T22:13:41.306201+0000","last_clean":"2024-09-11T22:13:41.306201+0000","last_became_active":"2024-09-11T22:13:39.301361+0000","last_became_peered":"2024-09-11T22:13:39.301361+0000","last_unstale":"2024-09-11T22:13:41.306201+0000","last_undegraded":"2024-09-11T22:13:41.306201+0000","last_fullsized":"2024-09-11T22:13:41.306201+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:43.437265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785077+0000","last_change":"2024-09-11T22:13:40.313766+0000","last_active":"2024-09-11T22:13:41.785077+0000","last_peered":"2024-09-11T22:13:41.785077+0000","last_clean":"2024-09-11T22:13:41.785077+0000","last_became_active":"2024-09-11T22:13:40.313347+0000","last_became_peered":"2024-09-11T22:13:40.313347+0000","last_unstale":"2024-09-11T22:13:41.785077+0000","last_undegraded":"2024-09-11T22:13:41.785077+0000","last_fullsized":"2024-09-11T22:13:41.785077+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:06.013603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306394+0000","last_change":"2024-09-11T22:13:39.301699+0000","last_active":"2024-09-11T22:13:41.306394+0000","last_peered":"2024-09-11T22:13:41.306394+0000","last_clean":"2024-09-11T22:13:41.306394+0000","last_became_active":"2024-09-11T22:13:39.301425+0000","last_became_peered":"2024-09-11T22:13:39.301425+0000","last_unstale":"2024-09-11T22:13:41.306394+0000","last_undegraded":"2024-09-11T22:13:41.306394+0000","last_fullsized":"2024-09-11T22:13:41.306394+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:00.434604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785349+0000","last_change":"2024-09-11T22:13:40.309473+0000","last_active":"2024-09-11T22:13:41.785349+0000","last_peered":"2024-09-11T22:13:41.785349+0000","last_clean":"2024-09-11T22:13:41.785349+0000","last_became_active":"2024-09-11T22:13:40.308605+0000","last_became_peered":"2024-09-11T22:13:40.308605+0000","last_unstale":"2024-09-11T22:13:41.785349+0000","last_undegraded":"2024-09-11T22:13:41.785349+0000","last_fullsized":"2024-09-11T22:13:41.785349+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:15.991673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317464+0000","last_change":"2024-09-11T22:13:39.313695+0000","last_active":"2024-09-11T22:13:41.317464+0000","last_peered":"2024-09-11T22:13:41.317464+0000","last_clean":"2024-09-11T22:13:41.317464+0000","last_became_active":"2024-09-11T22:13:39.313451+0000","last_became_peered":"2024-09-11T22:13:39.313451+0000","last_unstale":"2024-09-11T22:13:41.317464+0000","last_undegraded":"2024-09-11T22:13:41.317464+0000","last_fullsized":"2024-09-11T22:13:41.317464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:11.187562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317109+0000","last_change":"2024-09-11T22:13:40.319757+0000","last_active":"2024-09-11T22:13:41.317109+0000","last_peered":"2024-09-11T22:13:41.317109+0000","last_clean":"2024-09-11T22:13:41.317109+0000","last_became_active":"2024-09-11T22:13:40.319426+0000","last_became_peered":"2024-09-11T22:13:40.319426+0000","last_unstale":"2024-09-11T22:13:41.317109+0000","last_undegraded":"2024-09-11T22:13:41.317109+0000","last_fullsized":"2024-09-11T22:13:41.317109+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:07.896035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317526+0000","last_change":"2024-09-11T22:13:39.310453+0000","last_active":"2024-09-11T22:13:41.317526+0000","last_peered":"2024-09-11T22:13:41.317526+0000","last_clean":"2024-09-11T22:13:41.317526+0000","last_became_active":"2024-09-11T22:13:39.310186+0000","last_became_peered":"2024-09-11T22:13:39.310186+0000","last_unstale":"2024-09-11T22:13:41.317526+0000","last_undegraded":"2024-09-11T22:13:41.317526+0000","last_fullsized":"2024-09-11T22:13:41.317526+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:00.058154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784415+0000","last_change":"2024-09-11T22:13:40.306399+0000","last_active":"2024-09-11T22:13:41.784415+0000","last_peered":"2024-09-11T22:13:41.784415+0000","last_clean":"2024-09-11T22:13:41.784415+0000","last_became_active":"2024-09-11T22:13:40.305998+0000","last_became_peered":"2024-09-11T22:13:40.305998+0000","last_unstale":"2024-09-11T22:13:41.784415+0000","last_undegraded":"2024-09-11T22:13:41.784415+0000","last_fullsized":"2024-09-11T22:13:41.784415+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:20.667319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306713+0000","last_change":"2024-09-11T22:13:39.308391+0000","last_active":"2024-09-11T22:13:41.306713+0000","last_peered":"2024-09-11T22:13:41.306713+0000","last_clean":"2024-09-11T22:13:41.306713+0000","last_became_active":"2024-09-11T22:13:39.307774+0000","last_became_peered":"2024-09-11T22:13:39.307774+0000","last_unstale":"2024-09-11T22:13:41.306713+0000","last_undegraded":"2024-09-11T22:13:41.306713+0000","last_fullsized":"2024-09-11T22:13:41.306713+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:04.530461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.304123+0000","last_change":"2024-09-11T22:13:40.319478+0000","last_active":"2024-09-11T22:13:41.304123+0000","last_peered":"2024-09-11T22:13:41.304123+0000","last_clean":"2024-09-11T22:13:41.304123+0000","last_became_active":"2024-09-11T22:13:40.319188+0000","last_became_peered":"2024-09-11T22:13:40.319188+0000","last_unstale":"2024-09-11T22:13:41.304123+0000","last_undegraded":"2024-09-11T22:13:41.304123+0000","last_fullsized":"2024-09-11T22:13:41.304123+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:14:31.828880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784458+0000","last_change":"2024-09-11T22:13:39.310780+0000","last_active":"2024-09-11T22:13:41.784458+0000","last_peered":"2024-09-11T22:13:41.784458+0000","last_clean":"2024-09-11T22:13:41.784458+0000","last_became_active":"2024-09-11T22:13:39.310504+0000","last_became_peered":"2024-09-11T22:13:39.310504+0000","last_unstale":"2024-09-11T22:13:41.784458+0000","last_undegraded":"2024-09-11T22:13:41.784458+0000","last_fullsized":"2024-09-11T22:13:41.784458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:57.888547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784376+0000","last_change":"2024-09-11T22:13:40.316860+0000","last_active":"2024-09-11T22:13:41.784376+0000","last_peered":"2024-09-11T22:13:41.784376+0000","last_clean":"2024-09-11T22:13:41.784376+0000","last_became_active":"2024-09-11T22:13:40.314956+0000","last_became_peered":"2024-09-11T22:13:40.314956+0000","last_unstale":"2024-09-11T22:13:41.784376+0000","last_undegraded":"2024-09-11T22:13:41.784376+0000","last_fullsized":"2024-09-11T22:13:41.784376+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:01.159466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785081+0000","last_change":"2024-09-11T22:13:39.312641+0000","last_active":"2024-09-11T22:13:41.785081+0000","last_peered":"2024-09-11T22:13:41.785081+0000","last_clean":"2024-09-11T22:13:41.785081+0000","last_became_active":"2024-09-11T22:13:39.312308+0000","last_became_peered":"2024-09-11T22:13:39.312308+0000","last_unstale":"2024-09-11T22:13:41.785081+0000","last_undegraded":"2024-09-11T22:13:41.785081+0000","last_fullsized":"2024-09-11T22:13:41.785081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:56.314599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785501+0000","last_change":"2024-09-11T22:13:40.319375+0000","last_active":"2024-09-11T22:13:41.785501+0000","last_peered":"2024-09-11T22:13:41.785501+0000","last_clean":"2024-09-11T22:13:41.785501+0000","last_became_active":"2024-09-11T22:13:40.319109+0000","last_became_peered":"2024-09-11T22:13:40.319109+0000","last_unstale":"2024-09-11T22:13:41.785501+0000","last_undegraded":"2024-09-11T22:13:41.785501+0000","last_fullsized":"2024-09-11T22:13:41.785501+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:36:39.006996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317393+0000","last_change":"2024-09-11T22:13:39.313694+0000","last_active":"2024-09-11T22:13:41.317393+0000","last_peered":"2024-09-11T22:13:41.317393+0000","last_clean":"2024-09-11T22:13:41.317393+0000","last_became_active":"2024-09-11T22:13:39.312332+0000","last_became_peered":"2024-09-11T22:13:39.312332+0000","last_unstale":"2024-09-11T22:13:41.317393+0000","last_undegraded":"2024-09-11T22:13:41.317393+0000","last_fullsized":"2024-09-11T22:13:41.317393+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:06.573486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784934+0000","last_change":"2024-09-11T22:13:40.316292+0000","last_active":"2024-09-11T22:13:41.784934+0000","last_peered":"2024-09-11T22:13:41.784934+0000","last_clean":"2024-09-11T22:13:41.784934+0000","last_became_active":"2024-09-11T22:13:40.315198+0000","last_became_peered":"2024-09-11T22:13:40.315198+0000","last_unstale":"2024-09-11T22:13:41.784934+0000","last_undegraded":"2024-09-11T22:13:41.784934+0000","last_fullsized":"2024-09-11T22:13:41.784934+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:01.439424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785072+0000","last_change":"2024-09-11T22:13:39.310708+0000","last_active":"2024-09-11T22:13:41.785072+0000","last_peered":"2024-09-11T22:13:41.785072+0000","last_clean":"2024-09-11T22:13:41.785072+0000","last_became_active":"2024-09-11T22:13:39.310463+0000","last_became_peered":"2024-09-11T22:13:39.310463+0000","last_unstale":"2024-09-11T22:13:41.785072+0000","last_undegraded":"2024-09-11T22:13:41.785072+0000","last_fullsized":"2024-09-11T22:13:41.785072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:51.589071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784826+0000","last_change":"2024-09-11T22:13:40.318581+0000","last_active":"2024-09-11T22:13:41.784826+0000","last_peered":"2024-09-11T22:13:41.784826+0000","last_clean":"2024-09-11T22:13:41.784826+0000","last_became_active":"2024-09-11T22:13:40.318311+0000","last_became_peered":"2024-09-11T22:13:40.318311+0000","last_unstale":"2024-09-11T22:13:41.784826+0000","last_undegraded":"2024-09-11T22:13:41.784826+0000","last_fullsized":"2024-09-11T22:13:41.784826+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:33.291942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784373+0000","last_change":"2024-09-11T22:13:39.303899+0000","last_active":"2024-09-11T22:13:41.784373+0000","last_peered":"2024-09-11T22:13:41.784373+0000","last_clean":"2024-09-11T22:13:41.784373+0000","last_became_active":"2024-09-11T22:13:39.303546+0000","last_became_peered":"2024-09-11T22:13:39.303546+0000","last_unstale":"2024-09-11T22:13:41.784373+0000","last_undegraded":"2024-09-11T22:13:41.784373+0000","last_fullsized":"2024-09-11T22:13:41.784373+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:14.986852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317284+0000","last_change":"2024-09-11T22:13:40.314177+0000","last_active":"2024-09-11T22:13:41.317284+0000","last_peered":"2024-09-11T22:13:41.317284+0000","last_clean":"2024-09-11T22:13:41.317284+0000","last_became_active":"2024-09-11T22:13:40.313743+0000","last_became_peered":"2024-09-11T22:13:40.313743+0000","last_unstale":"2024-09-11T22:13:41.317284+0000","last_undegraded":"2024-09-11T22:13:41.317284+0000","last_fullsized":"2024-09-11T22:13:41.317284+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:48.687539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785042+0000","last_change":"2024-09-11T22:13:39.308982+0000","last_active":"2024-09-11T22:13:41.785042+0000","last_peered":"2024-09-11T22:13:41.785042+0000","last_clean":"2024-09-11T22:13:41.785042+0000","last_became_active":"2024-09-11T22:13:39.308701+0000","last_became_peered":"2024-09-11T22:13:39.308701+0000","last_unstale":"2024-09-11T22:13:41.785042+0000","last_undegraded":"2024-09-11T22:13:41.785042+0000","last_fullsized":"2024-09-11T22:13:41.785042+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:24.944146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.317185+0000","last_change":"2024-09-11T22:13:40.327573+0000","last_active":"2024-09-11T22:13:41.317185+0000","last_peered":"2024-09-11T22:13:41.317185+0000","last_clean":"2024-09-11T22:13:41.317185+0000","last_became_active":"2024-09-11T22:13:40.327283+0000","last_became_peered":"2024-09-11T22:13:40.327283+0000","last_unstale":"2024-09-11T22:13:41.317185+0000","last_undegraded":"2024-09-11T22:13:41.317185+0000","last_fullsized":"2024-09-11T22:13:41.317185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:46.055535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306194+0000","last_change":"2024-09-11T22:13:39.307907+0000","last_active":"2024-09-11T22:13:41.306194+0000","last_peered":"2024-09-11T22:13:41.306194+0000","last_clean":"2024-09-11T22:13:41.306194+0000","last_became_active":"2024-09-11T22:13:39.307599+0000","last_became_peered":"2024-09-11T22:13:39.307599+0000","last_unstale":"2024-09-11T22:13:41.306194+0000","last_undegraded":"2024-09-11T22:13:41.306194+0000","last_fullsized":"2024-09-11T22:13:41.306194+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:05.008782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.305734+0000","last_change":"2024-09-11T22:13:40.304738+0000","last_active":"2024-09-11T22:13:41.305734+0000","last_peered":"2024-09-11T22:13:41.305734+0000","last_clean":"2024-09-11T22:13:41.305734+0000","last_became_active":"2024-09-11T22:13:40.304440+0000","last_became_peered":"2024-09-11T22:13:40.304440+0000","last_unstale":"2024-09-11T22:13:41.305734+0000","last_undegraded":"2024-09-11T22:13:41.305734+0000","last_fullsized":"2024-09-11T22:13:41.305734+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:05.965092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.784417+0000","last_change":"2024-09-11T22:13:39.312580+0000","last_active":"2024-09-11T22:13:41.784417+0000","last_peered":"2024-09-11T22:13:41.784417+0000","last_clean":"2024-09-11T22:13:41.784417+0000","last_became_active":"2024-09-11T22:13:39.312239+0000","last_became_peered":"2024-09-11T22:13:39.312239+0000","last_unstale":"2024-09-11T22:13:41.784417+0000","last_undegraded":"2024-09-11T22:13:41.784417+0000","last_fullsized":"2024-09-11T22:13:41.784417+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:58.472779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.305685+0000","last_change":"2024-09-11T22:13:40.315416+0000","last_active":"2024-09-11T22:13:41.305685+0000","last_peered":"2024-09-11T22:13:41.305685+0000","last_clean":"2024-09-11T22:13:41.305685+0000","last_became_active":"2024-09-11T22:13:40.315154+0000","last_became_peered":"2024-09-11T22:13:40.315154+0000","last_unstale":"2024-09-11T22:13:41.305685+0000","last_undegraded":"2024-09-11T22:13:41.305685+0000","last_fullsized":"2024-09-11T22:13:41.305685+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:38.851009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785110+0000","last_change":"2024-09-11T22:13:39.310777+0000","last_active":"2024-09-11T22:13:41.785110+0000","last_peered":"2024-09-11T22:13:41.785110+0000","last_clean":"2024-09-11T22:13:41.785110+0000","last_became_active":"2024-09-11T22:13:39.310498+0000","last_became_peered":"2024-09-11T22:13:39.310498+0000","last_unstale":"2024-09-11T22:13:41.785110+0000","last_undegraded":"2024-09-11T22:13:41.785110+0000","last_fullsized":"2024-09-11T22:13:41.785110+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:27.152791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785399+0000","last_change":"2024-09-11T22:13:40.321086+0000","last_active":"2024-09-11T22:13:41.785399+0000","last_peered":"2024-09-11T22:13:41.785399+0000","last_clean":"2024-09-11T22:13:41.785399+0000","last_became_active":"2024-09-11T22:13:40.319924+0000","last_became_peered":"2024-09-11T22:13:40.319924+0000","last_unstale":"2024-09-11T22:13:41.785399+0000","last_undegraded":"2024-09-11T22:13:41.785399+0000","last_fullsized":"2024-09-11T22:13:41.785399+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:39.287000+0000","last_clean_scrub_stamp":"2024-09-11T22:13:39.287000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:41.166847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.306884+0000","last_change":"2024-09-11T22:13:39.310021+0000","last_active":"2024-09-11T22:13:41.306884+0000","last_peered":"2024-09-11T22:13:41.306884+0000","last_clean":"2024-09-11T22:13:41.306884+0000","last_became_active":"2024-09-11T22:13:39.309718+0000","last_became_peered":"2024-09-11T22:13:39.309718+0000","last_unstale":"2024-09-11T22:13:41.306884+0000","last_undegraded":"2024-09-11T22:13:41.306884+0000","last_fullsized":"2024-09-11T22:13:41.306884+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:13:38.282179+0000","last_clean_scrub_stamp":"2024-09-11T22:13:38.282179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:24.994673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":213,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T22:13:41.785129+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:13:41.785129+0000","last_peered":"2024-09-11T22:13:41.785129+0000","last_clean":"2024-09-11T22:13:41.785129+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:13:41.785129+0000","last_undegraded":"2024-09-11T22:13:41.785129+0000","last_fullsized":"2024-09-11T22:13:41.785129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35872,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335968,"statfs":{"total":96636764160,"available":96600031232,"internally_reserved":0,"allocated":528384,"data_stored":212152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35860,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335980,"statfs":{"total":96636764160,"available":96600043520,"internally_reserved":0,"allocated":524288,"data_stored":211550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35868,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335972,"statfs":{"total":96636764160,"available":96600035328,"internally_reserved":0,"allocated":532480,"data_stored":213092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":532480,"data_stored":212118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44180,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327660,"statfs":{"total":96636764160,"available":96591523840,"internally_reserved":0,"allocated":524288,"data_stored":211550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36444,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335396,"statfs":{"total":96636764160,"available":96599445504,"internally_reserved":0,"allocated":1118208,"data_stored":801882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36440,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335400,"statfs":{"total":96636764160,"available":96599449600,"internally_reserved":0,"allocated":1118208,"data_stored":801938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40032,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331808,"statfs":{"total":96636764160,"available":96595771392,"internally_reserved":0,"allocated":536576,"data_stored":213114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:13:49.038 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:13:49.038 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T22:13:49.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.183+0000 7f6b1768d640 1 Processor -- start 2024-09-11T22:13:49.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.183+0000 7f6b1768d640 1 -- start start 2024-09-11T22:13:49.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.184+0000 7f6b1768d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b100cf790 0x7f6b100b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.184+0000 7f6b1768d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6b100d11d0 0x7f6b100d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.184+0000 7f6b1768d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b10162110 con 0x7f6b10161d30 2024-09-11T22:13:49.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.184+0000 7f6b1768d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6b100d3450 con 0x7f6b100d11d0 2024-09-11T22:13:49.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.184+0000 7f6b1768d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6b100b7e30 con 0x7f6b100cf790 2024-09-11T22:13:49.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.184+0000 7f6b14c28640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b100cf790 0x7f6b100b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.184+0000 7f6b15c2a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6b100d11d0 0x7f6b100d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.184+0000 7f6b14c28640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b100cf790 0x7f6b100b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47048/0 (socket says 172.21.15.50:47048) 2024-09-11T22:13:49.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.185+0000 7f6b14c28640 1 -- 172.21.15.50:0/875390412 learned_addr learned my addr 172.21.15.50:0/875390412 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:49.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.185+0000 7f6b15c2a640 1 -- 172.21.15.50:0/875390412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b100cf790 msgr2=0x7f6b100b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:49.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.185+0000 7f6b15c2a640 1 --2- 172.21.15.50:0/875390412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b100cf790 0x7f6b100b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.185+0000 7f6b15c2a640 1 -- 172.21.15.50:0/875390412 >> v1:172.21.15.77:6789/0 conn(0x7f6b10161d30 legacy=0x7f6b10162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.185+0000 7f6b15c2a640 1 -- 172.21.15.50:0/875390412 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b100cfd70 con 0x7f6b100d11d0 2024-09-11T22:13:49.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.185+0000 7f6b07fff640 1 -- 172.21.15.50:0/875390412 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1400220285 0 0) 0x7f6b10162110 con 0x7f6b10161d30 2024-09-11T22:13:49.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.186+0000 7f6b15c2a640 1 --2- 172.21.15.50:0/875390412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b100d11d0 0x7f6b100d1660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009d90 tx=0x7f6b0802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6af53b25e82940f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:49.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.186+0000 7f6b07fff640 1 -- 172.21.15.50:0/875390412 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08007740 con 0x7f6b100d11d0 2024-09-11T22:13:49.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.186+0000 7f6b07fff640 1 -- 172.21.15.50:0/875390412 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b080078e0 con 0x7f6b100d11d0 2024-09-11T22:13:49.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.186+0000 7f6b07fff640 1 -- 172.21.15.50:0/875390412 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08007cb0 con 0x7f6b100d11d0 2024-09-11T22:13:49.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.186+0000 7f6b1768d640 1 -- 172.21.15.50:0/875390412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b100d11d0 msgr2=0x7f6b100d1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.186+0000 7f6b1768d640 1 --2- 172.21.15.50:0/875390412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b100d11d0 0x7f6b100d1660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009d90 tx=0x7f6b0802a660 comp rx=0 tx=0).stop 2024-09-11T22:13:49.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.186+0000 7f6b1768d640 1 -- 172.21.15.50:0/875390412 shutdown_connections 2024-09-11T22:13:49.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.186+0000 7f6b1768d640 1 --2- 172.21.15.50:0/875390412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b100d11d0 0x7f6b100d1660 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.186+0000 7f6b1768d640 1 --2- 172.21.15.50:0/875390412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b100cf790 0x7f6b100b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.186+0000 7f6b1768d640 1 -- 172.21.15.50:0/875390412 >> 172.21.15.50:0/875390412 conn(0x7f6b100727a0 msgr2=0x7f6b100679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:49.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.186+0000 7f6b1768d640 1 -- 172.21.15.50:0/875390412 shutdown_connections 2024-09-11T22:13:49.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.186+0000 7f6b1768d640 1 -- 172.21.15.50:0/875390412 wait complete. 2024-09-11T22:13:49.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.188+0000 7f6b1768d640 1 Processor -- start 2024-09-11T22:13:49.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.188+0000 7f6b1768d640 1 -- start start 2024-09-11T22:13:49.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.188+0000 7f6b1768d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b100cf790 0x7f6b100ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.188+0000 7f6b1768d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b100d11d0 0x7f6b101f8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.188+0000 7f6b1768d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b10161d30 0x7f6b101f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.188+0000 7f6b1768d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6b100d30e0 con 0x7f6b100cf790 2024-09-11T22:13:49.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.188+0000 7f6b1768d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b100d2e00 con 0x7f6b10161d30 2024-09-11T22:13:49.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.188+0000 7f6b1768d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6b100d38e0 con 0x7f6b100d11d0 2024-09-11T22:13:49.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.188+0000 7f6b15429640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b100cf790 0x7f6b100ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.188+0000 7f6b15429640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b100cf790 0x7f6b100ab180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57372/0 (socket says 172.21.15.50:57372) 2024-09-11T22:13:49.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.188+0000 7f6b15429640 1 -- 172.21.15.50:0/4282177617 learned_addr learned my addr 172.21.15.50:0/4282177617 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:49.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.188+0000 7f6b14c28640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b100d11d0 0x7f6b101f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.189+0000 7f6b15c2a640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b10161d30 0x7f6b101f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.189+0000 7f6b15429640 1 -- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b100d11d0 msgr2=0x7f6b101f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.189+0000 7f6b15429640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b100d11d0 0x7f6b101f8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.189+0000 7f6b15429640 1 -- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b10161d30 msgr2=0x7f6b101f3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.189+0000 7f6b15429640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b10161d30 0x7f6b101f3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.189+0000 7f6b15429640 1 -- 172.21.15.50:0/4282177617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b100ab6c0 con 0x7f6b100cf790 2024-09-11T22:13:49.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.189+0000 7f6b15429640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b100cf790 0x7f6b100ab180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00c410 tx=0x7f6b0c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:49.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.189+0000 7f6b05ffb640 1 -- 172.21.15.50:0/4282177617 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c017070 con 0x7f6b100cf790 2024-09-11T22:13:49.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.189+0000 7f6b05ffb640 1 -- 172.21.15.50:0/4282177617 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0c0035f0 con 0x7f6b100cf790 2024-09-11T22:13:49.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.189+0000 7f6b1768d640 1 -- 172.21.15.50:0/4282177617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b100ca090 con 0x7f6b100cf790 2024-09-11T22:13:49.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.189+0000 7f6b05ffb640 1 -- 172.21.15.50:0/4282177617 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c0039e0 con 0x7f6b100cf790 2024-09-11T22:13:49.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.189+0000 7f6b1768d640 1 -- 172.21.15.50:0/4282177617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b100ca650 con 0x7f6b100cf790 2024-09-11T22:13:49.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.190+0000 7f6b1768d640 1 -- 172.21.15.50:0/4282177617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b100b78f0 con 0x7f6b100cf790 2024-09-11T22:13:49.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.191+0000 7f6b05ffb640 1 -- 172.21.15.50:0/4282177617 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b0c01a070 con 0x7f6b100cf790 2024-09-11T22:13:49.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.191+0000 7f6b05ffb640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6af406be30 0x7f6af406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.191+0000 7f6b05ffb640 1 -- 172.21.15.50:0/4282177617 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f6b0c08a280 con 0x7f6b100cf790 2024-09-11T22:13:49.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.191+0000 7f6b14c28640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6af406be30 0x7f6af406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.192+0000 7f6b14c28640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6af406be30 0x7f6af406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6b100b4250 tx=0x7f6b00009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:49.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.195+0000 7f6b05ffb640 1 -- 172.21.15.50:0/4282177617 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b0c058540 con 0x7f6b100cf790 2024-09-11T22:13:49.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.439+0000 7f6b1768d640 1 -- 172.21.15.50:0/4282177617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6b100d28e0 con 0x7f6b100cf790 2024-09-11T22:13:49.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.441+0000 7f6b05ffb640 1 -- 172.21.15.50:0/4282177617 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f6b0c05c840 con 0x7f6b100cf790 2024-09-11T22:13:49.442 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:13:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:13:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-09-11T22:13:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-09-11T22:13:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T22:13:49.442 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-11T22:13:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.443+0000 7f6b1768d640 1 -- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6af406be30 msgr2=0x7f6af406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.443+0000 7f6b1768d640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6af406be30 0x7f6af406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6b100b4250 tx=0x7f6b00009240 comp rx=0 tx=0).stop 2024-09-11T22:13:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.443+0000 7f6b1768d640 1 -- 172.21.15.50:0/4282177617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b100cf790 msgr2=0x7f6b100ab180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.443+0000 7f6b1768d640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b100cf790 0x7f6b100ab180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00c410 tx=0x7f6b0c00c8d0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.443+0000 7f6b1768d640 1 -- 172.21.15.50:0/4282177617 shutdown_connections 2024-09-11T22:13:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.443+0000 7f6b1768d640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6af406be30 0x7f6af406e2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.443+0000 7f6b1768d640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b100d11d0 0x7f6b101f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.443+0000 7f6b1768d640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b10161d30 0x7f6b101f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.443+0000 7f6b1768d640 1 --2- 172.21.15.50:0/4282177617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b100cf790 0x7f6b100ab180 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.443+0000 7f6b1768d640 1 -- 172.21.15.50:0/4282177617 >> 172.21.15.50:0/4282177617 conn(0x7f6b100727a0 msgr2=0x7f6b1015dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:49.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.443+0000 7f6b1768d640 1 -- 172.21.15.50:0/4282177617 shutdown_connections 2024-09-11T22:13:49.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.443+0000 7f6b1768d640 1 -- 172.21.15.50:0/4282177617 wait complete. 2024-09-11T22:13:49.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:13:49.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.557+0000 7f1eef113640 1 Processor -- start 2024-09-11T22:13:49.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.557+0000 7f1eef113640 1 -- start start 2024-09-11T22:13:49.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.557+0000 7f1eef113640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1ee815e870 0x7f1ee80d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.557+0000 7f1eef113640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ee80d16d0 0x7f1ee80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.557+0000 7f1eef113640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ee80d3a30 0x7f1ee80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.557+0000 7f1eef113640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee80d1b10 con 0x7f1ee80d3a30 2024-09-11T22:13:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.557+0000 7f1eef113640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee80d3e80 con 0x7f1ee815e870 2024-09-11T22:13:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.557+0000 7f1eef113640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee80cfa80 con 0x7f1ee80d16d0 2024-09-11T22:13:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.558+0000 7f1eed6b0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ee80d3a30 0x7f1ee80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.558+0000 7f1eed6b0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ee80d3a30 0x7f1ee80b6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57374/0 (socket says 172.21.15.50:57374) 2024-09-11T22:13:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.558+0000 7f1eed6b0640 1 -- 172.21.15.50:0/2385029123 learned_addr learned my addr 172.21.15.50:0/2385029123 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.558+0000 7f1eeceaf640 1 --2- 172.21.15.50:0/2385029123 >> v2:172.21.15.77:3300/0 conn(0x7f1ee815e870 0x7f1ee80d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.558+0000 7f1ee7fff640 1 --2- 172.21.15.50:0/2385029123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ee80d16d0 0x7f1ee80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.558+0000 7f1eed6b0640 1 -- 172.21.15.50:0/2385029123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ee80d16d0 msgr2=0x7f1ee80d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.558+0000 7f1eed6b0640 1 --2- 172.21.15.50:0/2385029123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ee80d16d0 0x7f1ee80d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.558+0000 7f1eed6b0640 1 -- 172.21.15.50:0/2385029123 >> v2:172.21.15.77:3300/0 conn(0x7f1ee815e870 msgr2=0x7f1ee80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.558+0000 7f1eed6b0640 1 --2- 172.21.15.50:0/2385029123 >> v2:172.21.15.77:3300/0 conn(0x7f1ee815e870 0x7f1ee80d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.558+0000 7f1eed6b0640 1 -- 172.21.15.50:0/2385029123 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee80d40d0 con 0x7f1ee80d3a30 2024-09-11T22:13:49.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.558+0000 7f1eeceaf640 1 --2- 172.21.15.50:0/2385029123 >> v2:172.21.15.77:3300/0 conn(0x7f1ee815e870 0x7f1ee80d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:49.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.558+0000 7f1ee7fff640 1 --2- 172.21.15.50:0/2385029123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ee80d16d0 0x7f1ee80d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:49.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.559+0000 7f1eed6b0640 1 --2- 172.21.15.50:0/2385029123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80d3a30 0x7f1ee80b6200 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80d57c0 tx=0x7f1ee002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33822cf880d0381 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:49.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.559+0000 7f1ee77fe640 1 -- 172.21.15.50:0/2385029123 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0036070 con 0x7f1ee80d3a30 2024-09-11T22:13:49.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.559+0000 7f1ee77fe640 1 -- 172.21.15.50:0/2385029123 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee0031600 con 0x7f1ee80d3a30 2024-09-11T22:13:49.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.559+0000 7f1ee77fe640 1 -- 172.21.15.50:0/2385029123 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00319d0 con 0x7f1ee80d3a30 2024-09-11T22:13:49.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.559+0000 7f1eef113640 1 -- 172.21.15.50:0/2385029123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80d3a30 msgr2=0x7f1ee80b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.559+0000 7f1eef113640 1 --2- 172.21.15.50:0/2385029123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80d3a30 0x7f1ee80b6200 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80d57c0 tx=0x7f1ee002a6a0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.559+0000 7f1eef113640 1 -- 172.21.15.50:0/2385029123 shutdown_connections 2024-09-11T22:13:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.559+0000 7f1eef113640 1 --2- 172.21.15.50:0/2385029123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80d3a30 0x7f1ee80b6200 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.559+0000 7f1eef113640 1 --2- 172.21.15.50:0/2385029123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ee80d16d0 0x7f1ee80d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.559+0000 7f1eef113640 1 --2- 172.21.15.50:0/2385029123 >> v2:172.21.15.77:3300/0 conn(0x7f1ee815e870 0x7f1ee80d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.559+0000 7f1eef113640 1 -- 172.21.15.50:0/2385029123 >> 172.21.15.50:0/2385029123 conn(0x7f1ee80727a0 msgr2=0x7f1ee80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.559+0000 7f1eef113640 1 -- 172.21.15.50:0/2385029123 shutdown_connections 2024-09-11T22:13:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.559+0000 7f1eef113640 1 -- 172.21.15.50:0/2385029123 wait complete. 2024-09-11T22:13:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.561+0000 7f1eef113640 1 Processor -- start 2024-09-11T22:13:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.561+0000 7f1eef113640 1 -- start start 2024-09-11T22:13:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1eef113640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ee80d16d0 0x7f1ee81f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1eef113640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80d3a30 0x7f1ee81f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1eef113640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ee815e870 0x7f1ee80cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1eef113640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee80b7ee0 con 0x7f1ee80d3a30 2024-09-11T22:13:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1eef113640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee80b7c00 con 0x7f1ee80d16d0 2024-09-11T22:13:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1eef113640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee815ec50 con 0x7f1ee815e870 2024-09-11T22:13:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1ee7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80d3a30 0x7f1ee81f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1ee7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80d3a30 0x7f1ee81f76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57390/0 (socket says 172.21.15.50:57390) 2024-09-11T22:13:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1ee7fff640 1 -- 172.21.15.50:0/2900129475 learned_addr learned my addr 172.21.15.50:0/2900129475 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1eed6b0640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ee815e870 0x7f1ee80cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1eeceaf640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ee80d16d0 0x7f1ee81f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1ee7fff640 1 -- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ee815e870 msgr2=0x7f1ee80cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1ee7fff640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ee815e870 0x7f1ee80cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1ee7fff640 1 -- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ee80d16d0 msgr2=0x7f1ee81f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1ee7fff640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ee80d16d0 0x7f1ee81f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1ee7fff640 1 -- 172.21.15.50:0/2900129475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee80ce810 con 0x7f1ee80d3a30 2024-09-11T22:13:49.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1ee7fff640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80d3a30 0x7f1ee81f76f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00e810 tx=0x7f1edc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:49.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1ee57fa640 1 -- 172.21.15.50:0/2900129475 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc00f040 con 0x7f1ee80d3a30 2024-09-11T22:13:49.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1ee57fa640 1 -- 172.21.15.50:0/2900129475 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc004030 con 0x7f1ee80d3a30 2024-09-11T22:13:49.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1eef113640 1 -- 172.21.15.50:0/2900129475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee80c8410 con 0x7f1ee80d3a30 2024-09-11T22:13:49.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1ee57fa640 1 -- 172.21.15.50:0/2900129475 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc004400 con 0x7f1ee80d3a30 2024-09-11T22:13:49.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.562+0000 7f1eef113640 1 -- 172.21.15.50:0/2900129475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee80c89d0 con 0x7f1ee80d3a30 2024-09-11T22:13:49.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.563+0000 7f1eef113640 1 -- 172.21.15.50:0/2900129475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee80b78b0 con 0x7f1ee80d3a30 2024-09-11T22:13:49.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.564+0000 7f1ee57fa640 1 -- 172.21.15.50:0/2900129475 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1edc00c6d0 con 0x7f1ee80d3a30 2024-09-11T22:13:49.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.565+0000 7f1ee57fa640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ed406be30 0x7f1ed406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:49.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.565+0000 7f1ee57fa640 1 -- 172.21.15.50:0/2900129475 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f1edc08aa80 con 0x7f1ee80d3a30 2024-09-11T22:13:49.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.565+0000 7f1eeceaf640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ed406be30 0x7f1ed406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:49.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.565+0000 7f1eeceaf640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ed406be30 0x7f1ed406e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8006fd0 tx=0x7f1ed8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:49.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.569+0000 7f1ee57fa640 1 -- 172.21.15.50:0/2900129475 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1edc017020 con 0x7f1ee80d3a30 2024-09-11T22:13:49.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.779+0000 7f1eef113640 1 -- 172.21.15.50:0/2900129475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ee80b9790 con 0x7f1ee80d3a30 2024-09-11T22:13:49.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.780+0000 7f1ee57fa640 1 -- 172.21.15.50:0/2900129475 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7f1edc058de0 con 0x7f1ee80d3a30 2024-09-11T22:13:49.781 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:13:49.781 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"btime":"2024-09-11T22:13:43:312858+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2882007728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2882007728},{"type":"v1","addr":"172.21.15.50:6835","nonce":2882007728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1935649711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935649711},{"type":"v1","addr":"172.21.15.77:6837","nonce":1935649711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3208356003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3208356003},{"type":"v1","addr":"172.21.15.77:6836","nonce":3208356003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:13:39.660035+0000","modified":"2024-09-11T22:13:42.344052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/3053142878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3053142878},{"type":"v1","addr":"172.21.15.50:6834","nonce":3053142878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-11T22:13:49.782 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-09-11T22:13:49.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.782+0000 7f1eef113640 1 -- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ed406be30 msgr2=0x7f1ed406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.782+0000 7f1eef113640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ed406be30 0x7f1ed406e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8006fd0 tx=0x7f1ed8008040 comp rx=0 tx=0).stop 2024-09-11T22:13:49.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.782+0000 7f1eef113640 1 -- 172.21.15.50:0/2900129475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80d3a30 msgr2=0x7f1ee81f76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:49.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.782+0000 7f1eef113640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80d3a30 0x7f1ee81f76f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00e810 tx=0x7f1edc00ecd0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.782+0000 7f1eef113640 1 -- 172.21.15.50:0/2900129475 shutdown_connections 2024-09-11T22:13:49.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.782+0000 7f1eef113640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ed406be30 0x7f1ed406e2f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.782+0000 7f1eef113640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ee815e870 0x7f1ee80cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.782+0000 7f1eef113640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee80d3a30 0x7f1ee81f76f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.782+0000 7f1eef113640 1 --2- 172.21.15.50:0/2900129475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ee80d16d0 0x7f1ee81f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:49.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.782+0000 7f1eef113640 1 -- 172.21.15.50:0/2900129475 >> 172.21.15.50:0/2900129475 conn(0x7f1ee80727a0 msgr2=0x7f1ee80b9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:49.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.782+0000 7f1eef113640 1 -- 172.21.15.50:0/2900129475 shutdown_connections 2024-09-11T22:13:49.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:49.782+0000 7f1eef113640 1 -- 172.21.15.50:0/2900129475 wait complete. 2024-09-11T22:13:50.196 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:13:39.660035+0000', 'modified': '2024-09-11T22:13:42.344052+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5250}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5250': {'gid': 5250, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6834/3053142878', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 3053142878}, {'type': 'v1', 'addr': '172.21.15.50:6834', 'nonce': 3053142878}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5250, 'qdb_cluster': [5250]} 2024-09-11T22:13:50.197 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:13:50.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T22:13:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.303+0000 7ffabee74640 1 Processor -- start 2024-09-11T22:13:50.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.303+0000 7ffabee74640 1 -- start start 2024-09-11T22:13:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.304+0000 7ffabee74640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815e870 0x7ffab80d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.304+0000 7ffabee74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffab80d3c00 0x7ffab80b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.304+0000 7ffabee74640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab80cfa80 con 0x7ffab80d16d0 2024-09-11T22:13:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.304+0000 7ffabee74640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ffab80d1b10 con 0x7ffab80d3c00 2024-09-11T22:13:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.304+0000 7ffabee74640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffab80d40d0 con 0x7ffab815e870 2024-09-11T22:13:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.305+0000 7ffabcc10640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815e870 0x7ffab80d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.305+0000 7ffabd411640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffab80d3c00 0x7ffab80b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.305+0000 7ffab7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ffab80d16d0 0x7ffab80d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:34604/0 (socket says 172.21.15.50:34604) 2024-09-11T22:13:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.305+0000 7ffab7fff640 1 -- 172.21.15.50:0/2471767897 learned_addr learned my addr 172.21.15.50:0/2471767897 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.305+0000 7ffab77fe640 1 -- 172.21.15.50:0/2471767897 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72575444 0 0) 0x7ffaac001110 con 0x7ffab80d16d0 2024-09-11T22:13:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.305+0000 7ffab77fe640 1 -- 172.21.15.50:0/2471767897 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffaa0003520 con 0x7ffab80d16d0 2024-09-11T22:13:50.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.305+0000 7ffabcc10640 1 -- 172.21.15.50:0/2471767897 >> v2:172.21.15.77:3300/0 conn(0x7ffab80d3c00 msgr2=0x7ffab80b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:50.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.305+0000 7ffabcc10640 1 --2- 172.21.15.50:0/2471767897 >> v2:172.21.15.77:3300/0 conn(0x7ffab80d3c00 0x7ffab80b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.305+0000 7ffabcc10640 1 -- 172.21.15.50:0/2471767897 >> v1:172.21.15.77:6789/0 conn(0x7ffab80d16d0 legacy=0x7ffab80d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.305+0000 7ffabcc10640 1 -- 172.21.15.50:0/2471767897 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab80d43b0 con 0x7ffab815e870 2024-09-11T22:13:50.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.305+0000 7ffabd411640 1 --2- 172.21.15.50:0/2471767897 >> v2:172.21.15.77:3300/0 conn(0x7ffab80d3c00 0x7ffab80b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:50.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.306+0000 7ffabcc10640 1 --2- 172.21.15.50:0/2471767897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815e870 0x7ffab80d1190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80097a0 tx=0x7ffaa802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f40317889df37363 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:50.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.306+0000 7ffab77fe640 1 -- 172.21.15.50:0/2471767897 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8037070 con 0x7ffab815e870 2024-09-11T22:13:50.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.306+0000 7ffab77fe640 1 -- 172.21.15.50:0/2471767897 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa8032440 con 0x7ffab815e870 2024-09-11T22:13:50.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.306+0000 7ffab77fe640 1 -- 172.21.15.50:0/2471767897 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80327f0 con 0x7ffab815e870 2024-09-11T22:13:50.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.306+0000 7ffabee74640 1 -- 172.21.15.50:0/2471767897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815e870 msgr2=0x7ffab80d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.306+0000 7ffabee74640 1 --2- 172.21.15.50:0/2471767897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815e870 0x7ffab80d1190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80097a0 tx=0x7ffaa802a180 comp rx=0 tx=0).stop 2024-09-11T22:13:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.307+0000 7ffabee74640 1 -- 172.21.15.50:0/2471767897 shutdown_connections 2024-09-11T22:13:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.307+0000 7ffabee74640 1 --2- 172.21.15.50:0/2471767897 >> v2:172.21.15.77:3300/0 conn(0x7ffab80d3c00 0x7ffab80b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.307+0000 7ffabee74640 1 --2- 172.21.15.50:0/2471767897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815e870 0x7ffab80d1190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.307+0000 7ffabee74640 1 -- 172.21.15.50:0/2471767897 >> 172.21.15.50:0/2471767897 conn(0x7ffab80727a0 msgr2=0x7ffab80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.307+0000 7ffabee74640 1 -- 172.21.15.50:0/2471767897 shutdown_connections 2024-09-11T22:13:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.307+0000 7ffabee74640 1 -- 172.21.15.50:0/2471767897 wait complete. 2024-09-11T22:13:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.308+0000 7ffabee74640 1 Processor -- start 2024-09-11T22:13:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.308+0000 7ffabee74640 1 -- start start 2024-09-11T22:13:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffabee74640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab80d16d0 0x7ffab81f8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffabee74640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab80d3c00 0x7ffab80cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffabee74640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815e870 0x7ffab81f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffabee74640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffab815ec50 con 0x7ffab80d3c00 2024-09-11T22:13:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffabee74640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffab80b7ee0 con 0x7ffab80d16d0 2024-09-11T22:13:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffabee74640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffab80b78b0 con 0x7ffab815e870 2024-09-11T22:13:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab80d3c00 0x7ffab80cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab80d3c00 0x7ffab80cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57400/0 (socket says 172.21.15.50:57400) 2024-09-11T22:13:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffab7fff640 1 -- 172.21.15.50:0/4063825386 learned_addr learned my addr 172.21.15.50:0/4063825386 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffabcc10640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab80d16d0 0x7ffab81f8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffabd411640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815e870 0x7ffab81f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffab7fff640 1 -- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815e870 msgr2=0x7ffab81f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffab7fff640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815e870 0x7ffab81f4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffab7fff640 1 -- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab80d16d0 msgr2=0x7ffab81f8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffab7fff640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab80d16d0 0x7ffab81f8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffab7fff640 1 -- 172.21.15.50:0/4063825386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab81f4ba0 con 0x7ffab80d3c00 2024-09-11T22:13:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffabd411640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815e870 0x7ffab81f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffabcc10640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab80d16d0 0x7ffab81f8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffab7fff640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab80d3c00 0x7ffab80cb850 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c700 tx=0x7ffaac00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.309+0000 7ffab57fa640 1 -- 172.21.15.50:0/4063825386 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac017070 con 0x7ffab80d3c00 2024-09-11T22:13:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.310+0000 7ffab57fa640 1 -- 172.21.15.50:0/4063825386 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaac005870 con 0x7ffab80d3c00 2024-09-11T22:13:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.310+0000 7ffab57fa640 1 -- 172.21.15.50:0/4063825386 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac005ca0 con 0x7ffab80d3c00 2024-09-11T22:13:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.310+0000 7ffabee74640 1 -- 172.21.15.50:0/4063825386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab80ceb90 con 0x7ffab80d3c00 2024-09-11T22:13:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.310+0000 7ffabee74640 1 -- 172.21.15.50:0/4063825386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab81f8c30 con 0x7ffab80d3c00 2024-09-11T22:13:50.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.311+0000 7ffab57fa640 1 -- 172.21.15.50:0/4063825386 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffaac01a070 con 0x7ffab80d3c00 2024-09-11T22:13:50.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.312+0000 7ffab57fa640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffaa406be30 0x7ffaa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.312+0000 7ffab57fa640 1 -- 172.21.15.50:0/4063825386 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ffaac08a3b0 con 0x7ffab80d3c00 2024-09-11T22:13:50.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.312+0000 7ffabcc10640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffaa406be30 0x7ffaa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.312+0000 7ffac1c17740 1 Processor -- start 2024-09-11T22:13:50.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.312+0000 7ffabcc10640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffaa406be30 0x7ffaa406e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8034000 tx=0x7ffaa802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:50.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.312+0000 7ffac1c17740 1 -- start start 2024-09-11T22:13:50.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.313+0000 7ffac1c17740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6f992c0 0x5563b6fdea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.313+0000 7ffac1c17740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f96a80 0x5563b6f996a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.313+0000 7ffac1c17740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 0x5563b6f938b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.313+0000 7ffac1c17740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5563b6efb520 con 0x5563b6f9aa50 2024-09-11T22:13:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.313+0000 7ffac1c17740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5563b6ea33e0 con 0x5563b6f96a80 2024-09-11T22:13:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.313+0000 7ffac1c17740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5563b6ef74e0 con 0x5563b6f992c0 2024-09-11T22:13:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.313+0000 7ffabd411640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 0x5563b6f938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.313+0000 7ffabd411640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 0x5563b6f938b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57416/0 (socket says 172.21.15.50:57416) 2024-09-11T22:13:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.313+0000 7ffabd411640 1 -- 172.21.15.50:0/3442549382 learned_addr learned my addr 172.21.15.50:0/3442549382 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.313+0000 7ffabcc10640 1 --2- 172.21.15.50:0/3442549382 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6f992c0 0x5563b6fdea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.313+0000 7ffab7fff640 1 --2- 172.21.15.50:0/3442549382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f96a80 0x5563b6f996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffabd411640 1 -- 172.21.15.50:0/3442549382 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6f992c0 msgr2=0x5563b6fdea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffabd411640 1 --2- 172.21.15.50:0/3442549382 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6f992c0 0x5563b6fdea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffabd411640 1 -- 172.21.15.50:0/3442549382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f96a80 msgr2=0x5563b6f996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffabd411640 1 --2- 172.21.15.50:0/3442549382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f96a80 0x5563b6f996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffabd411640 1 -- 172.21.15.50:0/3442549382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b6ebe2f0 con 0x5563b6f9aa50 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffabcc10640 1 --2- 172.21.15.50:0/3442549382 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6f992c0 0x5563b6fdea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffabd411640 1 --2- 172.21.15.50:0/3442549382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 0x5563b6f938b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ffab0007550 tx=0x7ffab0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d805f8557fd0f74a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffa9e7fc640 1 -- 172.21.15.50:0/3442549382 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab00147e0 con 0x5563b6f9aa50 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffa9e7fc640 1 -- 172.21.15.50:0/3442549382 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab001b070 con 0x5563b6f9aa50 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffa9e7fc640 1 -- 172.21.15.50:0/3442549382 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab0014ba0 con 0x5563b6f9aa50 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffac1c17740 1 -- 172.21.15.50:0/3442549382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 msgr2=0x5563b6f938b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffac1c17740 1 --2- 172.21.15.50:0/3442549382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 0x5563b6f938b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ffab0007550 tx=0x7ffab0009750 comp rx=0 tx=0).stop 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffac1c17740 1 -- 172.21.15.50:0/3442549382 shutdown_connections 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffac1c17740 1 --2- 172.21.15.50:0/3442549382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 0x5563b6f938b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffac1c17740 1 --2- 172.21.15.50:0/3442549382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f96a80 0x5563b6f996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffac1c17740 1 --2- 172.21.15.50:0/3442549382 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6f992c0 0x5563b6fdea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.314+0000 7ffac1c17740 1 -- 172.21.15.50:0/3442549382 >> 172.21.15.50:0/3442549382 conn(0x5563b6f95a80 msgr2=0x5563b6fddf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.315+0000 7ffac1c17740 1 -- 172.21.15.50:0/3442549382 shutdown_connections 2024-09-11T22:13:50.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.315+0000 7ffac1c17740 1 -- 172.21.15.50:0/3442549382 wait complete. 2024-09-11T22:13:50.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.315+0000 7ffac1c17740 1 -- start start 2024-09-11T22:13:50.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.315+0000 7ffac1c17740 1 Processor -- start 2024-09-11T22:13:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffac1c17740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 0x5563b6fb2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffac1c17740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f9aa50 0x5563b6fc0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffac1c17740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 0x5563b6fc3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffac1c17740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5563b6f94f20 con 0x5563b6f992c0 2024-09-11T22:13:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffac1c17740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5563b6e84450 con 0x5563b6f9aa50 2024-09-11T22:13:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffac1c17740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5563b6fdf290 con 0x5563b6fc1300 2024-09-11T22:13:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffac1c17740 10 client.0 _ll_register_callbacks cb 0x5563b6c0dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffabcc10640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 0x5563b6fb2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffabcc10640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 0x5563b6fb2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57428/0 (socket says 172.21.15.50:57428) 2024-09-11T22:13:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffabcc10640 1 -- 172.21.15.50:0/4109381648 learned_addr learned my addr 172.21.15.50:0/4109381648 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffab7fff640 1 --2- 172.21.15.50:0/4109381648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f9aa50 0x5563b6fc0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffabd411640 1 --2- 172.21.15.50:0/4109381648 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 0x5563b6fc3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffabcc10640 1 -- 172.21.15.50:0/4109381648 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 msgr2=0x5563b6fc3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffabcc10640 1 --2- 172.21.15.50:0/4109381648 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 0x5563b6fc3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffabcc10640 1 -- 172.21.15.50:0/4109381648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f9aa50 msgr2=0x5563b6fc0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.316+0000 7ffabcc10640 1 --2- 172.21.15.50:0/4109381648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f9aa50 0x5563b6fc0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffabcc10640 1 -- 172.21.15.50:0/4109381648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563b6c0e2d0 con 0x5563b6f992c0 2024-09-11T22:13:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffabcc10640 1 --2- 172.21.15.50:0/4109381648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 0x5563b6fb2cc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009890 tx=0x7ffaa8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3b114aa0ee7d7f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffa977fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffa977fe640 1 -- 172.21.15.50:0/4109381648 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa804d060 con 0x5563b6f992c0 2024-09-11T22:13:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffa977fe640 1 -- 172.21.15.50:0/4109381648 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ffaa803ca70 con 0x5563b6f992c0 2024-09-11T22:13:50.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffac1c17740 1 -- 172.21.15.50:0/4109381648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffab001b070 con 0x5563b6f992c0 2024-09-11T22:13:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffa977fe640 1 -- 172.21.15.50:0/4109381648 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ffaa8053050 con 0x5563b6f992c0 2024-09-11T22:13:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffac1c17740 10 client.5397 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffac1c17740 1 -- 172.21.15.50:0/4109381648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5563b6cd86b0 con 0x5563b6f992c0 2024-09-11T22:13:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffa977fe640 1 -- 172.21.15.50:0/4109381648 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab001b070 con 0x5563b6f992c0 2024-09-11T22:13:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffa977fe640 1 -- 172.21.15.50:0/4109381648 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7ffaa8056020 con 0x5563b6f992c0 2024-09-11T22:13:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffac1c17740 10 client.5397 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffac1c17740 10 client.5397 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:13:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffac1c17740 20 client.5397 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffac1c17740 1 --2- 172.21.15.50:0/4109381648 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5563b6fb0510 0x5563b6fc4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffac1c17740 4 client.5397 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.317+0000 7ffac1c17740 1 -- 172.21.15.50:0/4109381648 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563b6f08c50 con 0x5563b6fb0510 2024-09-11T22:13:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.318+0000 7ffab7fff640 1 --2- 172.21.15.50:0/4109381648 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5563b6fb0510 0x5563b6fc4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.318+0000 7ffa977fe640 10 client.5397 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.318+0000 7ffab7fff640 1 --2- 172.21.15.50:0/4109381648 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5563b6fb0510 0x5563b6fc4510 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1f318bad5f0a15f server_cookie=a1d0ef61b0e6c9db in_seq=0 out_seq=0 2024-09-11T22:13:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffa977fe640 1 -- 172.21.15.50:0/4109381648 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5563b6f08c50 con 0x5563b6fb0510 2024-09-11T22:13:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffa977fe640 10 client.5397 handle_command_reply: tid=0 2024-09-11T22:13:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffac1c17740 1 client.5397 shutdown 2024-09-11T22:13:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffac1c17740 1 -- 172.21.15.50:0/4109381648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 msgr2=0x5563b6fb2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffac1c17740 1 --2- 172.21.15.50:0/4109381648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 0x5563b6fb2cc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009890 tx=0x7ffaa8004730 comp rx=0 tx=0).stop 2024-09-11T22:13:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffac1c17740 1 -- 172.21.15.50:0/4109381648 shutdown_connections 2024-09-11T22:13:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffac1c17740 1 --2- 172.21.15.50:0/4109381648 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 0x5563b6fc3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffac1c17740 1 --2- 172.21.15.50:0/4109381648 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5563b6fb0510 0x5563b6fc4510 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffac1c17740 1 --2- 172.21.15.50:0/4109381648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f9aa50 0x5563b6fc0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffac1c17740 1 --2- 172.21.15.50:0/4109381648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 0x5563b6fb2cc0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffa977fe640 0 client.5397 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:50.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffac1c17740 1 -- 172.21.15.50:0/4109381648 >> 172.21.15.50:0/4109381648 conn(0x5563b6f96a80 msgr2=0x5563b6fe1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:50.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffac1c17740 1 -- 172.21.15.50:0/4109381648 shutdown_connections 2024-09-11T22:13:50.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffac1c17740 1 -- 172.21.15.50:0/4109381648 wait complete. 2024-09-11T22:13:50.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.319+0000 7ffac1c17740 20 client.5397 trim_cache size 0 max 16384 2024-09-11T22:13:50.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.338+0000 7ffac1c17740 1 Processor -- start 2024-09-11T22:13:50.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.338+0000 7ffac1c17740 1 -- start start 2024-09-11T22:13:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.338+0000 7ffac1c17740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f992c0 0x5563b6fb2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.338+0000 7ffac1c17740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 0x5563b6fc2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.338+0000 7ffac1c17740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 0x5563b6fdde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.338+0000 7ffac1c17740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8155a20 con 0x5563b6f9aa50 2024-09-11T22:13:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.338+0000 7ffac1c17740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffab81573f0 con 0x5563b6f992c0 2024-09-11T22:13:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.338+0000 7ffac1c17740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffab81553d0 con 0x5563b6fc1300 2024-09-11T22:13:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.339+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 0x5563b6fc2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.339+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 0x5563b6fc2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57438/0 (socket says 172.21.15.50:57438) 2024-09-11T22:13:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.339+0000 7ffab7fff640 1 -- 172.21.15.50:0/1772354311 learned_addr learned my addr 172.21.15.50:0/1772354311 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:50.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.339+0000 7ffab7fff640 1 -- 172.21.15.50:0/1772354311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 msgr2=0x5563b6fdde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.339+0000 7ffab7fff640 1 --2- 172.21.15.50:0/1772354311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 0x5563b6fdde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.339+0000 7ffab7fff640 1 -- 172.21.15.50:0/1772354311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f992c0 msgr2=0x5563b6fb2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.339+0000 7ffab7fff640 1 --2- 172.21.15.50:0/1772354311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f992c0 0x5563b6fb2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.339+0000 7ffab7fff640 1 -- 172.21.15.50:0/1772354311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b6ff0cc0 con 0x5563b6f9aa50 2024-09-11T22:13:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.339+0000 7ffab7fff640 1 --2- 172.21.15.50:0/1772354311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 0x5563b6fc2cd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00cfd0 tx=0x7ffaac014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207c65be8c068930 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.339+0000 7ffa9dffb640 1 -- 172.21.15.50:0/1772354311 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac056960 con 0x5563b6f9aa50 2024-09-11T22:13:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.339+0000 7ffa9dffb640 1 -- 172.21.15.50:0/1772354311 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaac08a0b0 con 0x5563b6f9aa50 2024-09-11T22:13:50.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.339+0000 7ffa9dffb640 1 -- 172.21.15.50:0/1772354311 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac060db0 con 0x5563b6f9aa50 2024-09-11T22:13:50.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.340+0000 7ffac1c17740 1 -- 172.21.15.50:0/1772354311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 msgr2=0x5563b6fc2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.340+0000 7ffac1c17740 1 --2- 172.21.15.50:0/1772354311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 0x5563b6fc2cd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00cfd0 tx=0x7ffaac014040 comp rx=0 tx=0).stop 2024-09-11T22:13:50.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.340+0000 7ffac1c17740 1 -- 172.21.15.50:0/1772354311 shutdown_connections 2024-09-11T22:13:50.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.340+0000 7ffac1c17740 1 --2- 172.21.15.50:0/1772354311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 0x5563b6fdde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.340+0000 7ffac1c17740 1 --2- 172.21.15.50:0/1772354311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f9aa50 0x5563b6fc2cd0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.340+0000 7ffac1c17740 1 --2- 172.21.15.50:0/1772354311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f992c0 0x5563b6fb2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.340+0000 7ffac1c17740 1 -- 172.21.15.50:0/1772354311 >> 172.21.15.50:0/1772354311 conn(0x5563b6f96a80 msgr2=0x5563b6fe1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.340+0000 7ffac1c17740 1 -- 172.21.15.50:0/1772354311 shutdown_connections 2024-09-11T22:13:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.340+0000 7ffac1c17740 1 -- 172.21.15.50:0/1772354311 wait complete. 2024-09-11T22:13:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.340+0000 7ffac1c17740 1 -- start start 2024-09-11T22:13:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.341+0000 7ffac1c17740 1 Processor -- start 2024-09-11T22:13:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.341+0000 7ffac1c17740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 0x5563b705c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.341+0000 7ffac1c17740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f9aa50 0x5563b6fb1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.341+0000 7ffac1c17740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 0x5563b6fbf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.341+0000 7ffac1c17740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5563b6fb0390 con 0x5563b6f992c0 2024-09-11T22:13:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.341+0000 7ffac1c17740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5563b6fb1290 con 0x5563b6f9aa50 2024-09-11T22:13:50.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.341+0000 7ffac1c17740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5563b6fb09b0 con 0x5563b6fc1300 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.341+0000 7ffac1c17740 10 client.0 _ll_register_callbacks cb 0x7ffaa8035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.341+0000 7ffabcc10640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 0x5563b705c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.341+0000 7ffabcc10640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 0x5563b705c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57446/0 (socket says 172.21.15.50:57446) 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.341+0000 7ffabcc10640 1 -- 172.21.15.50:0/3593339712 learned_addr learned my addr 172.21.15.50:0/3593339712 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffab7fff640 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f9aa50 0x5563b6fb1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffabd411640 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 0x5563b6fbf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffabcc10640 1 -- 172.21.15.50:0/3593339712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 msgr2=0x5563b6fbf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffabcc10640 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 0x5563b6fbf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffabcc10640 1 -- 172.21.15.50:0/3593339712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f9aa50 msgr2=0x5563b6fb1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffabcc10640 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f9aa50 0x5563b6fb1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffabcc10640 1 -- 172.21.15.50:0/3593339712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563b6fb1b70 con 0x5563b6f992c0 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffab7fff640 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f9aa50 0x5563b6fb1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffabcc10640 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 0x5563b705c710 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80097a0 tx=0x7ffaa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212884e151b9453 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:50.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffa977fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffa977fe640 1 -- 172.21.15.50:0/3593339712 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa805c060 con 0x5563b6f992c0 2024-09-11T22:13:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffa977fe640 1 -- 172.21.15.50:0/3593339712 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ffaa80489a0 con 0x5563b6f992c0 2024-09-11T22:13:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffac1c17740 1 -- 172.21.15.50:0/3593339712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaac08a0b0 con 0x5563b6f992c0 2024-09-11T22:13:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffa977fe640 1 -- 172.21.15.50:0/3593339712 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ffaa8037040 con 0x5563b6f992c0 2024-09-11T22:13:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffac1c17740 10 client.5403 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffac1c17740 1 -- 172.21.15.50:0/3593339712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5563b7000fc0 con 0x5563b6f992c0 2024-09-11T22:13:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.342+0000 7ffa977fe640 1 -- 172.21.15.50:0/3593339712 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaac08a0b0 con 0x5563b6f992c0 2024-09-11T22:13:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffa977fe640 1 -- 172.21.15.50:0/3593339712 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7ffaa8056050 con 0x5563b6f992c0 2024-09-11T22:13:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffac1c17740 10 client.5403 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffac1c17740 10 client.5403 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:13:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffac1c17740 20 client.5403 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffac1c17740 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5563b6fc4f50 0x5563b6fc5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffac1c17740 4 client.5403 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffac1c17740 1 -- 172.21.15.50:0/3593339712 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "status"}) -- 0x5563b6f02fa0 con 0x5563b6fc4f50 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffab7fff640 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5563b6fc4f50 0x5563b6fc5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffa977fe640 10 client.5403 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffab7fff640 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5563b6fc4f50 0x5563b6fc5330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=423f53588df5aba2 server_cookie=a5de792d4a53c556 in_seq=0 out_seq=0 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffa977fe640 1 -- 172.21.15.50:0/3593339712 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5563b6f02fa0 con 0x5563b6fc4f50 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffa977fe640 10 client.5403 handle_command_reply: tid=0 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffac1c17740 1 client.5403 shutdown 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffac1c17740 1 -- 172.21.15.50:0/3593339712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 msgr2=0x5563b705c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffac1c17740 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 0x5563b705c710 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80097a0 tx=0x7ffaa80046c0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffac1c17740 1 -- 172.21.15.50:0/3593339712 shutdown_connections 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.343+0000 7ffac1c17740 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5563b6fc1300 0x5563b6fbf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffac1c17740 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5563b6fc4f50 0x5563b6fc5330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffac1c17740 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5563b6f9aa50 0x5563b6fb1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffac1c17740 1 --2- 172.21.15.50:0/3593339712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563b6f992c0 0x5563b705c710 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffac1c17740 1 -- 172.21.15.50:0/3593339712 >> 172.21.15.50:0/3593339712 conn(0x5563b6f96a80 msgr2=0x5563b6fc2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffa977fe640 0 client.5403 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffac1c17740 1 -- 172.21.15.50:0/3593339712 shutdown_connections 2024-09-11T22:13:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffac1c17740 1 -- 172.21.15.50:0/3593339712 wait complete. 2024-09-11T22:13:50.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffac1c17740 20 client.5403 trim_cache size 0 max 16384 2024-09-11T22:13:50.350 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:50.350 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:13:50.350 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:13:50.350 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5250, 2024-09-11T22:13:50.350 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:13:50.351 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:13:50.351 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:13:50.351 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 10.041544014999999, 2024-09-11T22:13:50.351 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 23, 2024-09-11T22:13:50.351 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 45, 2024-09-11T22:13:50.351 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 45, 2024-09-11T22:13:50.351 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 15.060607501 2024-09-11T22:13:50.351 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffabee74640 1 -- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffaa406be30 msgr2=0x7ffaa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffabee74640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffaa406be30 0x7ffaa406e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8034000 tx=0x7ffaa802e000 comp rx=0 tx=0).stop 2024-09-11T22:13:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffabee74640 1 -- 172.21.15.50:0/4063825386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab80d3c00 msgr2=0x7ffab80cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffabee74640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab80d3c00 0x7ffab80cb850 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c700 tx=0x7ffaac00cbc0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffabee74640 1 -- 172.21.15.50:0/4063825386 shutdown_connections 2024-09-11T22:13:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffabee74640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffaa406be30 0x7ffaa406e2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffabee74640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815e870 0x7ffab81f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffabee74640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab80d3c00 0x7ffab80cb850 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffabee74640 1 --2- 172.21.15.50:0/4063825386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab80d16d0 0x7ffab81f8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffabee74640 1 -- 172.21.15.50:0/4063825386 >> 172.21.15.50:0/4063825386 conn(0x7ffab80727a0 msgr2=0x7ffab80b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:50.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffabee74640 1 -- 172.21.15.50:0/4063825386 shutdown_connections 2024-09-11T22:13:50.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.344+0000 7ffabee74640 1 -- 172.21.15.50:0/4063825386 wait complete. 2024-09-11T22:13:50.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:13:50.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.458+0000 7fecefe77640 1 Processor -- start 2024-09-11T22:13:50.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.458+0000 7fecefe77640 1 -- start start 2024-09-11T22:13:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7fecefe77640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fece815e870 0x7fece80d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7fecefe77640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fece80d16d0 0x7fece80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7fecefe77640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fece80cfa80 con 0x7fece80d3a30 2024-09-11T22:13:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7fecefe77640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fece80d1b40 con 0x7fece80d16d0 2024-09-11T22:13:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7fecefe77640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fece80d3e50 con 0x7fece815e870 2024-09-11T22:13:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7feced412640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fece80d16d0 0x7fece80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7fecee414640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fece80d3a30 0x7fece80b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52756/0 (socket says 172.21.15.50:52756) 2024-09-11T22:13:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7feced412640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fece80d16d0 0x7fece80d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57460/0 (socket says 172.21.15.50:57460) 2024-09-11T22:13:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7fecee414640 1 -- 172.21.15.50:0/2007785242 learned_addr learned my addr 172.21.15.50:0/2007785242 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7fecedc13640 1 --2- 172.21.15.50:0/2007785242 >> v2:172.21.15.77:3300/0 conn(0x7fece815e870 0x7fece80d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7feced412640 1 -- 172.21.15.50:0/2007785242 >> v2:172.21.15.77:3300/0 conn(0x7fece815e870 msgr2=0x7fece80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7feced412640 1 --2- 172.21.15.50:0/2007785242 >> v2:172.21.15.77:3300/0 conn(0x7fece815e870 0x7fece80d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7feced412640 1 -- 172.21.15.50:0/2007785242 >> v1:172.21.15.50:6789/0 conn(0x7fece80d3a30 legacy=0x7fece80b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.459+0000 7feced412640 1 -- 172.21.15.50:0/2007785242 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece80d40d0 con 0x7fece80d16d0 2024-09-11T22:13:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.460+0000 7feced412640 1 --2- 172.21.15.50:0/2007785242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80d16d0 0x7fece80d34f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fece80d57c0 tx=0x7fecd802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686032b165c12f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.460+0000 7fececc11640 1 -- 172.21.15.50:0/2007785242 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd8037070 con 0x7fece80d16d0 2024-09-11T22:13:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.460+0000 7fececc11640 1 -- 172.21.15.50:0/2007785242 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd8032440 con 0x7fece80d16d0 2024-09-11T22:13:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.460+0000 7fececc11640 1 -- 172.21.15.50:0/2007785242 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd8032810 con 0x7fece80d16d0 2024-09-11T22:13:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.461+0000 7fecefe77640 1 -- 172.21.15.50:0/2007785242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80d16d0 msgr2=0x7fece80d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.461+0000 7fecefe77640 1 --2- 172.21.15.50:0/2007785242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80d16d0 0x7fece80d34f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fece80d57c0 tx=0x7fecd802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.461+0000 7fecefe77640 1 -- 172.21.15.50:0/2007785242 shutdown_connections 2024-09-11T22:13:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.461+0000 7fecefe77640 1 --2- 172.21.15.50:0/2007785242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80d16d0 0x7fece80d34f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.461+0000 7fecefe77640 1 --2- 172.21.15.50:0/2007785242 >> v2:172.21.15.77:3300/0 conn(0x7fece815e870 0x7fece80d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.461+0000 7fecefe77640 1 -- 172.21.15.50:0/2007785242 >> 172.21.15.50:0/2007785242 conn(0x7fece80727a0 msgr2=0x7fece80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:50.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.461+0000 7fecefe77640 1 -- 172.21.15.50:0/2007785242 shutdown_connections 2024-09-11T22:13:50.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.461+0000 7fecefe77640 1 -- 172.21.15.50:0/2007785242 wait complete. 2024-09-11T22:13:50.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.462+0000 7fecefe77640 1 Processor -- start 2024-09-11T22:13:50.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.462+0000 7fecefe77640 1 -- start start 2024-09-11T22:13:50.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecefe77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80d16d0 0x7fece814db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecefe77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fece80d3a30 0x7fece80c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecefe77640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fece815e870 0x7fece80b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecefe77640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fece80b7ee0 con 0x7fece80d16d0 2024-09-11T22:13:50.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecefe77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fece80b7c00 con 0x7fece80d3a30 2024-09-11T22:13:50.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecefe77640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fece815ec50 con 0x7fece815e870 2024-09-11T22:13:50.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecedc13640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80d16d0 0x7fece814db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecedc13640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80d16d0 0x7fece814db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57466/0 (socket says 172.21.15.50:57466) 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecedc13640 1 -- 172.21.15.50:0/2413319665 learned_addr learned my addr 172.21.15.50:0/2413319665 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecee414640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fece815e870 0x7fece80b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7feced412640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fece80d3a30 0x7fece80c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecedc13640 1 -- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fece815e870 msgr2=0x7fece80b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecedc13640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fece815e870 0x7fece80b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecedc13640 1 -- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fece80d3a30 msgr2=0x7fece80c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecedc13640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fece80d3a30 0x7fece80c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecedc13640 1 -- 172.21.15.50:0/2413319665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece80ca280 con 0x7fece80d16d0 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.463+0000 7fecedc13640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80d16d0 0x7fece814db20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fece400e8a0 tx=0x7fece400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.464+0000 7fecde7fc640 1 -- 172.21.15.50:0/2413319665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4017070 con 0x7fece80d16d0 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.464+0000 7fecde7fc640 1 -- 172.21.15.50:0/2413319665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece400c940 con 0x7fece80d16d0 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.464+0000 7fecefe77640 1 -- 172.21.15.50:0/2413319665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece80ca560 con 0x7fece80d16d0 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.464+0000 7fecde7fc640 1 -- 172.21.15.50:0/2413319665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece400cd30 con 0x7fece80d16d0 2024-09-11T22:13:50.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.464+0000 7fecefe77640 1 -- 172.21.15.50:0/2413319665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece80cab20 con 0x7fece80d16d0 2024-09-11T22:13:50.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.465+0000 7fecefe77640 1 -- 172.21.15.50:0/2413319665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fece8068600 con 0x7fece80d16d0 2024-09-11T22:13:50.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.465+0000 7fecde7fc640 1 -- 172.21.15.50:0/2413319665 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fece401a070 con 0x7fece80d16d0 2024-09-11T22:13:50.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.465+0000 7fecde7fc640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feccc06be60 0x7feccc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:50.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.466+0000 7fecde7fc640 1 -- 172.21.15.50:0/2413319665 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fece408afc0 con 0x7fece80d16d0 2024-09-11T22:13:50.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.466+0000 7feced412640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feccc06be60 0x7feccc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:50.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.466+0000 7feced412640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feccc06be60 0x7feccc06e320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fecd8034000 tx=0x7fecd802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:50.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.470+0000 7fecde7fc640 1 -- 172.21.15.50:0/2413319665 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fece8068600 con 0x7fece80d16d0 2024-09-11T22:13:50.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.682+0000 7fecefe77640 1 -- 172.21.15.50:0/2413319665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fece80b78b0 con 0x7fece80d16d0 2024-09-11T22:13:50.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.683+0000 7fecde7fc640 1 -- 172.21.15.50:0/2413319665 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7fece4059320 con 0x7fece80d16d0 2024-09-11T22:13:50.683 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:13:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.685+0000 7fecefe77640 1 -- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feccc06be60 msgr2=0x7feccc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.685+0000 7fecefe77640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feccc06be60 0x7feccc06e320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fecd8034000 tx=0x7fecd802e000 comp rx=0 tx=0).stop 2024-09-11T22:13:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.685+0000 7fecefe77640 1 -- 172.21.15.50:0/2413319665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80d16d0 msgr2=0x7fece814db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.685+0000 7fecefe77640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80d16d0 0x7fece814db20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fece400e8a0 tx=0x7fece400ed60 comp rx=0 tx=0).stop 2024-09-11T22:13:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.685+0000 7fecefe77640 1 -- 172.21.15.50:0/2413319665 shutdown_connections 2024-09-11T22:13:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.685+0000 7fecefe77640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feccc06be60 0x7feccc06e320 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.685+0000 7fecefe77640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fece815e870 0x7fece80b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.685+0000 7fecefe77640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fece80d3a30 0x7fece80c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.685+0000 7fecefe77640 1 --2- 172.21.15.50:0/2413319665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80d16d0 0x7fece814db20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:50.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.685+0000 7fecefe77640 1 -- 172.21.15.50:0/2413319665 >> 172.21.15.50:0/2413319665 conn(0x7fece80727a0 msgr2=0x7fece815eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:50.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.685+0000 7fecefe77640 1 -- 172.21.15.50:0/2413319665 shutdown_connections 2024-09-11T22:13:50.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50.685+0000 7fecefe77640 1 -- 172.21.15.50:0/2413319665 wait complete. 2024-09-11T22:13:50.697 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:13:50.697 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:13:50.697 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:13:50.697 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:13:50.697 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:13:50.697 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:13:50.697 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:13:50.697 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:13:50.697 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:13:50.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:50.698 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:13:50.714 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:13:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:13:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:13:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:13:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:13:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:13:50.714 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:13:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:13:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:13:50.715 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:13:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:13:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:13:50.715 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:13:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:13:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:13:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:13:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42565sec preferred_lft 42565sec 2024-09-11T22:13:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:13:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:13:50.715 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:13:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:13:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:13:50.716 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:13:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:13:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:13:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:13:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:13:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:13:50.716 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:13:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:13:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:13:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:13:50.717 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:13:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:13:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:13:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:13:50.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:50.717 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:13:50.779 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:13:50.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:50.781 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:13:50.839 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:13:50.839 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:13:50.839 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:13:50.839 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:13:50.839 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:13:50.839 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:13:50.840 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:13:50.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:13:50.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:13:50.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:13:50.840 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:13:50.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:13:50.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:13:50.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:50.967 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:13:50.983 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:13:50.983 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:13:50.983 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:13:50.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:50.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:13:51.049 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:13:51.049 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:13:51.105 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:13:51.106 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:13:51.106 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:13:51.160 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:13:51.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:51.161 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:13:51.245 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:13:51.246 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:13:51.257 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:13:51.257 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:13:51.257 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:13:51.257 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:13:51.257 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:13:51.257 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:13:51.257 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:13:51.257 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:13:51.258 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:13:51.258 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:13:51.259 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:13:51.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:51.259 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:13:51.286 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:13:51.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:13:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:13:51.389 INFO:teuthology.orchestra.run.smithi050.stdout:client4952 2024-09-11T22:13:51.389 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:13:51.389 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:13:51.406 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-11T22:13:51.406 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-11T22:13:51.406 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-11T22:13:51.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:51.406 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-11T22:13:51.468 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2024-09-11T22:13:51.468 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> import json 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> import sys 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> try: 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> except OSError as e: 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> sys.exit(e.errno) 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> print(json.dumps( 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> indent=2)) 2024-09-11T22:13:51.469 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-11T22:13:51.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:51 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-09-11T22:13:51.585 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T22:13:51.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:51.586 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-09-11T22:13:51.644 INFO:teuthology.orchestra.run.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-09-11T22:13:51.809 INFO:teuthology.orchestra.run.smithi050.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-09-11T22:13:55.127 INFO:teuthology.orchestra.run.smithi050.stderr:Updating files: 45% (641/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 73% (1034/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-09-11T22:13:55.132 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-09-11T22:13:55.132 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-11T22:13:55.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-11T22:13:55.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.276+0000 7f31f38e4640 1 Processor -- start 2024-09-11T22:13:55.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.276+0000 7f31f38e4640 1 -- start start 2024-09-11T22:13:55.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.277+0000 7f31f38e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31ec15b400 0x7f31ec06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.277+0000 7f31f38e4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ec15b7e0 con 0x7f31ec06e0f0 2024-09-11T22:13:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.277+0000 7f31f38e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ec15f140 con 0x7f31ec072e60 2024-09-11T22:13:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.277+0000 7f31f38e4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f31ec15f420 con 0x7f31ec15b400 2024-09-11T22:13:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.277+0000 7f31f1680640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31ec15b400 0x7f31ec06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.277+0000 7f31f1e81640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f31ec06e0f0 0x7f31ec0711c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52766/0 (socket says 172.21.15.50:52766) 2024-09-11T22:13:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.277+0000 7f31f1680640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f31ec15b400 0x7f31ec06d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57476/0 (socket says 172.21.15.50:57476) 2024-09-11T22:13:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.277+0000 7f31f1e81640 1 -- 172.21.15.50:0/2949218544 learned_addr learned my addr 172.21.15.50:0/2949218544 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.278+0000 7f31f1680640 1 -- 172.21.15.50:0/2949218544 >> v1:172.21.15.77:6789/0 conn(0x7f31ec072e60 legacy=0x7f31ec06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.278+0000 7f31f1680640 1 -- 172.21.15.50:0/2949218544 >> v1:172.21.15.50:6789/0 conn(0x7f31ec06e0f0 legacy=0x7f31ec0711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.278+0000 7f31ebfff640 1 -- 172.21.15.50:0/2949218544 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 960053179 0 0) 0x7f31ec15f140 con 0x7f31ec072e60 2024-09-11T22:13:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.278+0000 7f31f1680640 1 -- 172.21.15.50:0/2949218544 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec15f700 con 0x7f31ec15b400 2024-09-11T22:13:55.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.279+0000 7f31f1680640 1 --2- 172.21.15.50:0/2949218544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ec15b400 0x7f31ec06d070 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f31e40097a0 tx=0x7f31e402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7391fc1b1f8c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.279+0000 7f31ebfff640 1 -- 172.21.15.50:0/2949218544 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4037070 con 0x7f31ec15b400 2024-09-11T22:13:55.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.279+0000 7f31ebfff640 1 -- 172.21.15.50:0/2949218544 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e402adc0 con 0x7f31ec15b400 2024-09-11T22:13:55.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.279+0000 7f31ebfff640 1 -- 172.21.15.50:0/2949218544 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4032660 con 0x7f31ec15b400 2024-09-11T22:13:55.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.279+0000 7f31f38e4640 1 -- 172.21.15.50:0/2949218544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ec15b400 msgr2=0x7f31ec06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.279+0000 7f31f38e4640 1 --2- 172.21.15.50:0/2949218544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ec15b400 0x7f31ec06d070 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f31e40097a0 tx=0x7f31e402a130 comp rx=0 tx=0).stop 2024-09-11T22:13:55.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.279+0000 7f31f38e4640 1 -- 172.21.15.50:0/2949218544 shutdown_connections 2024-09-11T22:13:55.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.279+0000 7f31f38e4640 1 --2- 172.21.15.50:0/2949218544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ec15b400 0x7f31ec06d070 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.279+0000 7f31f38e4640 1 -- 172.21.15.50:0/2949218544 >> 172.21.15.50:0/2949218544 conn(0x7f31ec0679c0 msgr2=0x7f31ec067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.279+0000 7f31f38e4640 1 -- 172.21.15.50:0/2949218544 shutdown_connections 2024-09-11T22:13:55.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.279+0000 7f31f38e4640 1 -- 172.21.15.50:0/2949218544 wait complete. 2024-09-11T22:13:55.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.281+0000 7f31f38e4640 1 Processor -- start 2024-09-11T22:13:55.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.281+0000 7f31f38e4640 1 -- start start 2024-09-11T22:13:55.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.281+0000 7f31f38e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31ec06e0f0 0x7f31ec144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.281+0000 7f31f38e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31ec072e60 0x7f31ec0cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.281+0000 7f31f38e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ec15b400 0x7f31ec0cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.281+0000 7f31f38e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec0718d0 con 0x7f31ec15b400 2024-09-11T22:13:55.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.281+0000 7f31f38e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec0cfc50 con 0x7f31ec072e60 2024-09-11T22:13:55.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.281+0000 7f31f38e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec071a50 con 0x7f31ec06e0f0 2024-09-11T22:13:55.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31f1e81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ec15b400 0x7f31ec0cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31f1e81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ec15b400 0x7f31ec0cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57490/0 (socket says 172.21.15.50:57490) 2024-09-11T22:13:55.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31f1e81640 1 -- 172.21.15.50:0/1302735647 learned_addr learned my addr 172.21.15.50:0/1302735647 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31f1680640 1 --2- 172.21.15.50:0/1302735647 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31ec06e0f0 0x7f31ec144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31f0e7f640 1 --2- 172.21.15.50:0/1302735647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31ec072e60 0x7f31ec0cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31f1e81640 1 -- 172.21.15.50:0/1302735647 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31ec06e0f0 msgr2=0x7f31ec144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31f1e81640 1 --2- 172.21.15.50:0/1302735647 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31ec06e0f0 0x7f31ec144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31f1e81640 1 -- 172.21.15.50:0/1302735647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31ec072e60 msgr2=0x7f31ec0cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31f1e81640 1 --2- 172.21.15.50:0/1302735647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31ec072e60 0x7f31ec0cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31f1e81640 1 -- 172.21.15.50:0/1302735647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec14b7a0 con 0x7f31ec15b400 2024-09-11T22:13:55.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31f1e81640 1 --2- 172.21.15.50:0/1302735647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31ec15b400 0x7f31ec0cd630 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00c890 tx=0x7f31dc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31e9ffb640 1 -- 172.21.15.50:0/1302735647 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc018070 con 0x7f31ec15b400 2024-09-11T22:13:55.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31e9ffb640 1 -- 172.21.15.50:0/1302735647 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc00a640 con 0x7f31ec15b400 2024-09-11T22:13:55.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31f38e4640 1 -- 172.21.15.50:0/1302735647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ec0cdcb0 con 0x7f31ec15b400 2024-09-11T22:13:55.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31e9ffb640 1 -- 172.21.15.50:0/1302735647 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc00aa50 con 0x7f31ec15b400 2024-09-11T22:13:55.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.282+0000 7f31f38e4640 1 -- 172.21.15.50:0/1302735647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ec0ce270 con 0x7f31ec15b400 2024-09-11T22:13:55.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.284+0000 7f31e9ffb640 1 -- 172.21.15.50:0/1302735647 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31dc01b070 con 0x7f31ec15b400 2024-09-11T22:13:55.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.284+0000 7f31e9ffb640 1 --2- 172.21.15.50:0/1302735647 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f31d806be30 0x7f31d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.284+0000 7f31e9ffb640 1 -- 172.21.15.50:0/1302735647 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f31dc08a520 con 0x7f31ec15b400 2024-09-11T22:13:55.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.285+0000 7f31f1680640 1 --2- 172.21.15.50:0/1302735647 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f31d806be30 0x7f31d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.285+0000 7f31f1680640 1 --2- 172.21.15.50:0/1302735647 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f31d806be30 0x7f31d806e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f31e4034000 tx=0x7f31e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.285+0000 7f31f6684740 1 Processor -- start 2024-09-11T22:13:55.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.286+0000 7f31f6684740 1 -- start start 2024-09-11T22:13:55.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.286+0000 7f31f6684740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 0x5578dbc0bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.286+0000 7f31f6684740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbc3be0 0x5578dbbc6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.286+0000 7f31f6684740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbbc0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.286+0000 7f31f6684740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5578dbb29890 con 0x5578dbbc7bb0 2024-09-11T22:13:55.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.286+0000 7f31f6684740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5578dbad16a0 con 0x5578dbbc6420 2024-09-11T22:13:55.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.286+0000 7f31f6684740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5578dbb25850 con 0x5578dbbc3be0 2024-09-11T22:13:55.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.286+0000 7f31f1e81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbbc0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.286+0000 7f31f1e81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbbc0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57498/0 (socket says 172.21.15.50:57498) 2024-09-11T22:13:55.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.286+0000 7f31f1e81640 1 -- 172.21.15.50:0/1473014643 learned_addr learned my addr 172.21.15.50:0/1473014643 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.287+0000 7f31f1680640 1 --2- 172.21.15.50:0/1473014643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 0x5578dbc0bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.287+0000 7f31f0e7f640 1 --2- 172.21.15.50:0/1473014643 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbc3be0 0x5578dbbc6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.287+0000 7f31f1e81640 1 -- 172.21.15.50:0/1473014643 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbc3be0 msgr2=0x5578dbbc6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.287+0000 7f31f1e81640 1 --2- 172.21.15.50:0/1473014643 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbc3be0 0x5578dbbc6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.287+0000 7f31f1e81640 1 -- 172.21.15.50:0/1473014643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 msgr2=0x5578dbc0bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.287+0000 7f31f1e81640 1 --2- 172.21.15.50:0/1473014643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 0x5578dbc0bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.287+0000 7f31f1e81640 1 -- 172.21.15.50:0/1473014643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578dbaf7300 con 0x5578dbbc7bb0 2024-09-11T22:13:55.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.287+0000 7f31f1e81640 1 --2- 172.21.15.50:0/1473014643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbbc0a10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0889c0 tx=0x7f31dc0582a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2920040c4553fcf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.287+0000 7f31d2ffd640 1 -- 172.21.15.50:0/1473014643 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc0613b0 con 0x5578dbbc7bb0 2024-09-11T22:13:55.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.287+0000 7f31d2ffd640 1 -- 172.21.15.50:0/1473014643 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc05f030 con 0x5578dbbc7bb0 2024-09-11T22:13:55.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.287+0000 7f31d2ffd640 1 -- 172.21.15.50:0/1473014643 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc054ef0 con 0x5578dbbc7bb0 2024-09-11T22:13:55.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.288+0000 7f31f6684740 1 -- 172.21.15.50:0/1473014643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 msgr2=0x5578dbbc0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.288+0000 7f31f6684740 1 --2- 172.21.15.50:0/1473014643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbbc0a10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0889c0 tx=0x7f31dc0582a0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.288+0000 7f31f6684740 1 -- 172.21.15.50:0/1473014643 shutdown_connections 2024-09-11T22:13:55.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.288+0000 7f31f6684740 1 --2- 172.21.15.50:0/1473014643 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbc3be0 0x5578dbbc6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.288+0000 7f31f6684740 1 --2- 172.21.15.50:0/1473014643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbbc0a10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.288+0000 7f31f6684740 1 --2- 172.21.15.50:0/1473014643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 0x5578dbc0bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.288+0000 7f31f6684740 1 -- 172.21.15.50:0/1473014643 >> 172.21.15.50:0/1473014643 conn(0x5578dbbc2be0 msgr2=0x5578dbc0b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.288+0000 7f31f6684740 1 -- 172.21.15.50:0/1473014643 shutdown_connections 2024-09-11T22:13:55.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.288+0000 7f31f6684740 1 -- 172.21.15.50:0/1473014643 wait complete. 2024-09-11T22:13:55.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.289+0000 7f31f6684740 1 -- start start 2024-09-11T22:13:55.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.289+0000 7f31f6684740 1 Processor -- start 2024-09-11T22:13:55.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f6684740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 0x5578dbbf0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f6684740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbbc1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f6684740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbec120 0x5578dbbec5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f6684740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5578dbbc2080 con 0x5578dbbc7bb0 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f6684740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5578dbab2520 con 0x5578dbbc6420 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f6684740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5578dbc0c3f0 con 0x5578dbbec120 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f6684740 10 client.0 _ll_register_callbacks cb 0x5578db83bd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f0e7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbbc1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f0e7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbbc1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57510/0 (socket says 172.21.15.50:57510) 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f0e7f640 1 -- 172.21.15.50:0/2360401627 learned_addr learned my addr 172.21.15.50:0/2360401627 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f1680640 1 --2- 172.21.15.50:0/2360401627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 0x5578dbbf0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f1e81640 1 --2- 172.21.15.50:0/2360401627 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbec120 0x5578dbbec5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f0e7f640 1 -- 172.21.15.50:0/2360401627 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbec120 msgr2=0x5578dbbec5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f0e7f640 1 --2- 172.21.15.50:0/2360401627 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbec120 0x5578dbbec5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f0e7f640 1 -- 172.21.15.50:0/2360401627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 msgr2=0x5578dbbf0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f0e7f640 1 --2- 172.21.15.50:0/2360401627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 0x5578dbbf0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f0e7f640 1 -- 172.21.15.50:0/2360401627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578db820590 con 0x5578dbbc7bb0 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31f0e7f640 1 --2- 172.21.15.50:0/2360401627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbbc1600 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f31e0012570 tx=0x7f31e0012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d011127d6168f6b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.290+0000 7f31cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31cbfff640 1 -- 172.21.15.50:0/2360401627 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e0019020 con 0x5578dbbc7bb0 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31cbfff640 1 -- 172.21.15.50:0/2360401627 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f31e00052e0 con 0x5578dbbc7bb0 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31f6684740 1 -- 172.21.15.50:0/2360401627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31dc05f030 con 0x5578dbbc7bb0 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31cbfff640 1 -- 172.21.15.50:0/2360401627 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f31e0023050 con 0x5578dbbc7bb0 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31f6684740 10 client.5424 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31f6684740 1 -- 172.21.15.50:0/2360401627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5578db83c590 con 0x5578dbbc7bb0 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31cbfff640 1 -- 172.21.15.50:0/2360401627 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc05f030 con 0x5578dbbc7bb0 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31cbfff640 1 -- 172.21.15.50:0/2360401627 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f31e0026020 con 0x5578dbbc7bb0 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31f6684740 10 client.5424 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31f6684740 10 client.5424 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31f6684740 20 client.5424 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31f6684740 1 --2- 172.21.15.50:0/2360401627 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5578dbbc02c0 0x5578dbbe5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31f6684740 4 client.5424 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:55.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31f6684740 1 -- 172.21.15.50:0/2360401627 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578dbb36fc0 con 0x5578dbbc02c0 2024-09-11T22:13:55.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.291+0000 7f31f1680640 1 --2- 172.21.15.50:0/2360401627 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5578dbbc02c0 0x5578dbbe5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.292+0000 7f31cbfff640 10 client.5424 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.292+0000 7f31f1680640 1 --2- 172.21.15.50:0/2360401627 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5578dbbc02c0 0x5578dbbe5620 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dd4a758f11c5192 server_cookie=3aa41b906d8ba8b8 in_seq=0 out_seq=0 2024-09-11T22:13:55.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31cbfff640 1 -- 172.21.15.50:0/2360401627 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5578dbb36fc0 con 0x5578dbbc02c0 2024-09-11T22:13:55.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31cbfff640 10 client.5424 handle_command_reply: tid=0 2024-09-11T22:13:55.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31f6684740 1 client.5424 shutdown 2024-09-11T22:13:55.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31f6684740 1 -- 172.21.15.50:0/2360401627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 msgr2=0x5578dbbc1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31f6684740 1 --2- 172.21.15.50:0/2360401627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbbc1600 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f31e0012570 tx=0x7f31e0012a30 comp rx=0 tx=0).stop 2024-09-11T22:13:55.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31f6684740 1 -- 172.21.15.50:0/2360401627 shutdown_connections 2024-09-11T22:13:55.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31f6684740 1 --2- 172.21.15.50:0/2360401627 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbec120 0x5578dbbec5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31f6684740 1 --2- 172.21.15.50:0/2360401627 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5578dbbc02c0 0x5578dbbe5620 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31f6684740 1 --2- 172.21.15.50:0/2360401627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbbc1600 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31f6684740 1 --2- 172.21.15.50:0/2360401627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 0x5578dbbf0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31f6684740 1 -- 172.21.15.50:0/2360401627 >> 172.21.15.50:0/2360401627 conn(0x5578dbbc3be0 msgr2=0x5578dbbeaff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31cbfff640 0 client.5424 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31f6684740 1 -- 172.21.15.50:0/2360401627 shutdown_connections 2024-09-11T22:13:55.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.293+0000 7f31f6684740 1 -- 172.21.15.50:0/2360401627 wait complete. 2024-09-11T22:13:55.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.294+0000 7f31f6684740 20 client.5424 trim_cache size 0 max 16384 2024-09-11T22:13:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.322+0000 7f31f6684740 1 Processor -- start 2024-09-11T22:13:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.322+0000 7f31f6684740 1 -- start start 2024-09-11T22:13:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.323+0000 7f31f6684740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbc6420 0x5578dbc0ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.323+0000 7f31f6684740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc7bb0 0x5578dbc7ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.323+0000 7f31f6684740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbec120 0x5578dbc081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.323+0000 7f31f6684740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5578dbbc62a0 con 0x5578dbbec120 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.323+0000 7f31f6684740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec200b80 con 0x5578dbbc7bb0 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.323+0000 7f31f6684740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec1ffb80 con 0x5578dbbc6420 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f1e81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbec120 0x5578dbc081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f1680640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbc6420 0x5578dbc0ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f0e7f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc7bb0 0x5578dbc7ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f1680640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbc6420 0x5578dbc0ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:47154/0 (socket says 172.21.15.50:47154) 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f0e7f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc7bb0 0x5578dbc7ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:35844/0 (socket says 172.21.15.50:35844) 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f1680640 1 -- 172.21.15.50:0/1791373022 learned_addr learned my addr 172.21.15.50:0/1791373022 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f1680640 1 -- 172.21.15.50:0/1791373022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc7bb0 msgr2=0x5578dbc7ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f1680640 1 --2- 172.21.15.50:0/1791373022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc7bb0 0x5578dbc7ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f1680640 1 -- 172.21.15.50:0/1791373022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbec120 msgr2=0x5578dbc081f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f1680640 1 --2- 172.21.15.50:0/1791373022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbec120 0x5578dbc081f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f1680640 1 -- 172.21.15.50:0/1791373022 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578db906970 con 0x5578dbbc6420 2024-09-11T22:13:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f1e81640 1 --2- 172.21.15.50:0/1791373022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbec120 0x5578dbc081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f0e7f640 1 --2- 172.21.15.50:0/1791373022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc7bb0 0x5578dbc7ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.324+0000 7f31f1680640 1 --2- 172.21.15.50:0/1791373022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbc6420 0x5578dbc0ced0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f31e403f040 tx=0x7f31e402c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5953c809b196531e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.325+0000 7f31d27fc640 1 -- 172.21.15.50:0/1791373022 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4058070 con 0x5578dbbc6420 2024-09-11T22:13:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.325+0000 7f31d27fc640 1 -- 172.21.15.50:0/1791373022 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e4003d60 con 0x5578dbbc6420 2024-09-11T22:13:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.325+0000 7f31d27fc640 1 -- 172.21.15.50:0/1791373022 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4037040 con 0x5578dbbc6420 2024-09-11T22:13:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.325+0000 7f31f6684740 1 -- 172.21.15.50:0/1791373022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbc6420 msgr2=0x5578dbc0ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.325+0000 7f31f6684740 1 --2- 172.21.15.50:0/1791373022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbc6420 0x5578dbc0ced0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f31e403f040 tx=0x7f31e402c000 comp rx=0 tx=0).stop 2024-09-11T22:13:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.325+0000 7f31f6684740 1 -- 172.21.15.50:0/1791373022 shutdown_connections 2024-09-11T22:13:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.325+0000 7f31f6684740 1 --2- 172.21.15.50:0/1791373022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbec120 0x5578dbc081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.325+0000 7f31f6684740 1 --2- 172.21.15.50:0/1791373022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc7bb0 0x5578dbc7ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.325+0000 7f31f6684740 1 --2- 172.21.15.50:0/1791373022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbc6420 0x5578dbc0ced0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.325+0000 7f31f6684740 1 -- 172.21.15.50:0/1791373022 >> 172.21.15.50:0/1791373022 conn(0x5578dbbc3be0 msgr2=0x5578dbbbbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.326+0000 7f31f6684740 1 -- 172.21.15.50:0/1791373022 shutdown_connections 2024-09-11T22:13:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.326+0000 7f31f6684740 1 -- 172.21.15.50:0/1791373022 wait complete. 2024-09-11T22:13:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.326+0000 7f31f6684740 1 -- start start 2024-09-11T22:13:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.326+0000 7f31f6684740 1 Processor -- start 2024-09-11T22:13:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f6684740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 0x5578dbbc02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f6684740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbc0b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f6684740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbec120 0x5578dbc6b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f6684740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec1ff530 con 0x5578dbbc7bb0 2024-09-11T22:13:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f6684740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec1fefe0 con 0x5578dbbc6420 2024-09-11T22:13:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f6684740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5578dbaf5020 con 0x5578dbbec120 2024-09-11T22:13:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f6684740 10 client.0 _ll_register_callbacks cb 0x7f31e0007ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f0e7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbc0b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f0e7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbc0b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57528/0 (socket says 172.21.15.50:57528) 2024-09-11T22:13:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f0e7f640 1 -- 172.21.15.50:0/1940782175 learned_addr learned my addr 172.21.15.50:0/1940782175 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f1680640 1 --2- 172.21.15.50:0/1940782175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 0x5578dbbc02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f1e81640 1 --2- 172.21.15.50:0/1940782175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbec120 0x5578dbc6b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f0e7f640 1 -- 172.21.15.50:0/1940782175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbec120 msgr2=0x5578dbc6b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f0e7f640 1 --2- 172.21.15.50:0/1940782175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbec120 0x5578dbc6b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f0e7f640 1 -- 172.21.15.50:0/1940782175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 msgr2=0x5578dbbc02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f0e7f640 1 --2- 172.21.15.50:0/1940782175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 0x5578dbbc02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f0e7f640 1 -- 172.21.15.50:0/1940782175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578dbc0bd50 con 0x5578dbbc7bb0 2024-09-11T22:13:55.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31f0e7f640 1 --2- 172.21.15.50:0/1940782175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbc0b810 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009010 tx=0x7f31e0001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25108a42ad88a80a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.328+0000 7f31cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31cbfff640 1 -- 172.21.15.50:0/1940782175 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e0019070 con 0x5578dbbc7bb0 2024-09-11T22:13:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31f6684740 1 -- 172.21.15.50:0/1940782175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31e4003d60 con 0x5578dbbc7bb0 2024-09-11T22:13:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31cbfff640 1 -- 172.21.15.50:0/1940782175 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f31e00067b0 con 0x5578dbbc7bb0 2024-09-11T22:13:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31cbfff640 1 -- 172.21.15.50:0/1940782175 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f31e0033050 con 0x5578dbbc7bb0 2024-09-11T22:13:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31f6684740 10 client.5430 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31f6684740 1 -- 172.21.15.50:0/1940782175 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5578dbbc5480 con 0x5578dbbc7bb0 2024-09-11T22:13:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31cbfff640 1 -- 172.21.15.50:0/1940782175 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e4003d60 con 0x5578dbbc7bb0 2024-09-11T22:13:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31cbfff640 1 -- 172.21.15.50:0/1940782175 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f31e0036020 con 0x5578dbbc7bb0 2024-09-11T22:13:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31f6684740 10 client.5430 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31f6684740 10 client.5430 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31f6684740 20 client.5430 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31f6684740 1 --2- 172.21.15.50:0/1940782175 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5578dbc09a50 0x5578dbbc4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31f6684740 4 client.5430 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31f6684740 1 -- 172.21.15.50:0/1940782175 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x5578dbb31310 con 0x5578dbc09a50 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.329+0000 7f31f1680640 1 --2- 172.21.15.50:0/1940782175 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5578dbc09a50 0x5578dbbc4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.330+0000 7f31cbfff640 10 client.5430 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.330+0000 7f31f1680640 1 --2- 172.21.15.50:0/1940782175 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5578dbc09a50 0x5578dbbc4b30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=467fa69b3328c8b7 server_cookie=68f2dacf1c2ce0bb in_seq=0 out_seq=0 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31cbfff640 1 -- 172.21.15.50:0/1940782175 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x5578dbb31310 con 0x5578dbc09a50 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31cbfff640 10 client.5430 handle_command_reply: tid=0 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31f6684740 1 client.5430 shutdown 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31f6684740 1 -- 172.21.15.50:0/1940782175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 msgr2=0x5578dbc0b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31f6684740 1 --2- 172.21.15.50:0/1940782175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbc0b810 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009010 tx=0x7f31e0001080 comp rx=0 tx=0).stop 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31f6684740 1 -- 172.21.15.50:0/1940782175 shutdown_connections 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31f6684740 1 --2- 172.21.15.50:0/1940782175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5578dbbec120 0x5578dbc6b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31f6684740 1 --2- 172.21.15.50:0/1940782175 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5578dbc09a50 0x5578dbbc4b30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31f6684740 1 --2- 172.21.15.50:0/1940782175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5578dbbc7bb0 0x5578dbc0b810 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31f6684740 1 --2- 172.21.15.50:0/1940782175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5578dbbc6420 0x5578dbbc02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31f6684740 1 -- 172.21.15.50:0/1940782175 >> 172.21.15.50:0/1940782175 conn(0x5578dbbc3be0 msgr2=0x5578dbbf0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31cbfff640 0 client.5430 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31f6684740 1 -- 172.21.15.50:0/1940782175 shutdown_connections 2024-09-11T22:13:55.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.331+0000 7f31f6684740 1 -- 172.21.15.50:0/1940782175 wait complete. 2024-09-11T22:13:55.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.332+0000 7f31f6684740 20 client.5430 trim_cache size 0 max 16384 2024-09-11T22:13:55.336 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:55.336 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:13:55.336 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": -2 2024-09-11T22:13:55.336 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:55.337 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T22:13:55.337 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENOENT: 2024-09-11T22:13:55.338 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-11T22:13:55.338 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-11T22:13:55.338 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-11T22:13:55.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.446+0000 7f727e5e4640 1 Processor -- start 2024-09-11T22:13:55.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.446+0000 7f727e5e4640 1 -- start start 2024-09-11T22:13:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f727e5e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f727815b400 0x7f727806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f727e5e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f727806e0f0 0x7f72780711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f727e5e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f727815b7e0 con 0x7f7278072e60 2024-09-11T22:13:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f727e5e4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f727815f140 con 0x7f727806e0f0 2024-09-11T22:13:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f727e5e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f727815f420 con 0x7f727815b400 2024-09-11T22:13:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f727cb81640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f727806e0f0 0x7f72780711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f727cb81640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f727806e0f0 0x7f72780711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57534/0 (socket says 172.21.15.50:57534) 2024-09-11T22:13:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f727cb81640 1 -- 172.21.15.50:0/3370776716 learned_addr learned my addr 172.21.15.50:0/3370776716 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f7277fff640 1 --2- 172.21.15.50:0/3370776716 >> v2:172.21.15.77:3300/0 conn(0x7f727815b400 0x7f727806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f727cb81640 1 -- 172.21.15.50:0/3370776716 >> v2:172.21.15.77:3300/0 conn(0x7f727815b400 msgr2=0x7f727806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f727cb81640 1 --2- 172.21.15.50:0/3370776716 >> v2:172.21.15.77:3300/0 conn(0x7f727815b400 0x7f727806d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f727cb81640 1 -- 172.21.15.50:0/3370776716 >> v1:172.21.15.77:6789/0 conn(0x7f7278072e60 legacy=0x7f727806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f727cb81640 1 -- 172.21.15.50:0/3370776716 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727815f700 con 0x7f727806e0f0 2024-09-11T22:13:55.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.447+0000 7f7277fff640 1 --2- 172.21.15.50:0/3370776716 >> v2:172.21.15.77:3300/0 conn(0x7f727815b400 0x7f727806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:55.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.448+0000 7f727cb81640 1 --2- 172.21.15.50:0/3370776716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727806e0f0 0x7f72780711c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f72780b56e0 tx=0x7f727002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b809a69424ae36 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.448+0000 7f7276ffd640 1 -- 172.21.15.50:0/3370776716 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270036070 con 0x7f727806e0f0 2024-09-11T22:13:55.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.448+0000 7f7276ffd640 1 -- 172.21.15.50:0/3370776716 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7270031600 con 0x7f727806e0f0 2024-09-11T22:13:55.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.448+0000 7f7276ffd640 1 -- 172.21.15.50:0/3370776716 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72700319d0 con 0x7f727806e0f0 2024-09-11T22:13:55.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.449+0000 7f727e5e4640 1 -- 172.21.15.50:0/3370776716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727806e0f0 msgr2=0x7f72780711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.449+0000 7f727e5e4640 1 --2- 172.21.15.50:0/3370776716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727806e0f0 0x7f72780711c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f72780b56e0 tx=0x7f727002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.449+0000 7f727e5e4640 1 -- 172.21.15.50:0/3370776716 shutdown_connections 2024-09-11T22:13:55.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.449+0000 7f727e5e4640 1 --2- 172.21.15.50:0/3370776716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727806e0f0 0x7f72780711c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.449+0000 7f727e5e4640 1 --2- 172.21.15.50:0/3370776716 >> v2:172.21.15.77:3300/0 conn(0x7f727815b400 0x7f727806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.449+0000 7f727e5e4640 1 -- 172.21.15.50:0/3370776716 >> 172.21.15.50:0/3370776716 conn(0x7f72780679c0 msgr2=0x7f7278067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.449+0000 7f727e5e4640 1 -- 172.21.15.50:0/3370776716 shutdown_connections 2024-09-11T22:13:55.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.449+0000 7f727e5e4640 1 -- 172.21.15.50:0/3370776716 wait complete. 2024-09-11T22:13:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.450+0000 7f727e5e4640 1 Processor -- start 2024-09-11T22:13:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.450+0000 7f727e5e4640 1 -- start start 2024-09-11T22:13:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727e5e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727806e0f0 0x7f72781f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727e5e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7278072e60 0x7f72780c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727e5e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727815b400 0x7f72781f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727e5e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7278071700 con 0x7f727815b400 2024-09-11T22:13:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727e5e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72780cfc50 con 0x7f7278072e60 2024-09-11T22:13:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727e5e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7278071880 con 0x7f727806e0f0 2024-09-11T22:13:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727cb81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727815b400 0x7f72781f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727cb81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727815b400 0x7f72781f4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57546/0 (socket says 172.21.15.50:57546) 2024-09-11T22:13:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727cb81640 1 -- 172.21.15.50:0/2639337873 learned_addr learned my addr 172.21.15.50:0/2639337873 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f7277fff640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727806e0f0 0x7f72781f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f72777fe640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7278072e60 0x7f72780c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727cb81640 1 -- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727806e0f0 msgr2=0x7f72781f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727cb81640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727806e0f0 0x7f72781f5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727cb81640 1 -- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7278072e60 msgr2=0x7f72780c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727cb81640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7278072e60 0x7f72780c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f727cb81640 1 -- 172.21.15.50:0/2639337873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72780c6300 con 0x7f727815b400 2024-09-11T22:13:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.451+0000 7f72777fe640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7278072e60 0x7f72780c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.452+0000 7f727cb81640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727815b400 0x7f72781f4a80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f727002ace0 tx=0x7f7270004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.452+0000 7f7274ff9640 1 -- 172.21.15.50:0/2639337873 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270036050 con 0x7f727815b400 2024-09-11T22:13:55.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.452+0000 7f7274ff9640 1 -- 172.21.15.50:0/2639337873 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7270042070 con 0x7f727815b400 2024-09-11T22:13:55.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.452+0000 7f727e5e4640 1 -- 172.21.15.50:0/2639337873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72780cd0f0 con 0x7f727815b400 2024-09-11T22:13:55.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.452+0000 7f7274ff9640 1 -- 172.21.15.50:0/2639337873 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270009510 con 0x7f727815b400 2024-09-11T22:13:55.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.452+0000 7f727e5e4640 1 -- 172.21.15.50:0/2639337873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72780cd6b0 con 0x7f727815b400 2024-09-11T22:13:55.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.453+0000 7f7274ff9640 1 -- 172.21.15.50:0/2639337873 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7270007c30 con 0x7f727815b400 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.454+0000 7f7274ff9640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f726406be30 0x7f726406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.454+0000 7f7274ff9640 1 -- 172.21.15.50:0/2639337873 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f72700abdf0 con 0x7f727815b400 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.454+0000 7f7277fff640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f726406be30 0x7f726406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.454+0000 7f7277fff640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f726406be30 0x7f726406e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f726800aac0 tx=0x7f7268008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.455+0000 7f7281457740 1 Processor -- start 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.455+0000 7f7281457740 1 -- start start 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.455+0000 7f7281457740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc2c60 0x5625b0cc3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.455+0000 7f7281457740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc0420 0x5625b0cc1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.455+0000 7f7281457740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 0x5625b0ca2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.455+0000 7f7281457740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5625b0bdfaa0 con 0x5625b0cc0880 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.455+0000 7f7281457740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5625b0b878e0 con 0x5625b0cc2c60 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.455+0000 7f7281457740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5625b0bdba60 con 0x5625b0cc0420 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f727cb81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 0x5625b0ca2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f727cb81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 0x5625b0ca2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57560/0 (socket says 172.21.15.50:57560) 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f727cb81640 1 -- 172.21.15.50:0/519943573 learned_addr learned my addr 172.21.15.50:0/519943573 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f7277fff640 1 --2- 172.21.15.50:0/519943573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc2c60 0x5625b0cc3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f72777fe640 1 --2- 172.21.15.50:0/519943573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc0420 0x5625b0cc1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f727cb81640 1 -- 172.21.15.50:0/519943573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc0420 msgr2=0x5625b0cc1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f727cb81640 1 --2- 172.21.15.50:0/519943573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc0420 0x5625b0cc1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f727cb81640 1 -- 172.21.15.50:0/519943573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc2c60 msgr2=0x5625b0cc3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f727cb81640 1 --2- 172.21.15.50:0/519943573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc2c60 0x5625b0cc3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f727cb81640 1 -- 172.21.15.50:0/519943573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625b09be9f0 con 0x5625b0cc0880 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f727cb81640 1 --2- 172.21.15.50:0/519943573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 0x5625b0ca2be0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f727002a730 tx=0x7f7270076500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7475a72fe0216e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f725dffb640 1 -- 172.21.15.50:0/519943573 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270092070 con 0x5625b0cc0880 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f725dffb640 1 -- 172.21.15.50:0/519943573 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7270037040 con 0x5625b0cc0880 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.456+0000 7f725dffb640 1 -- 172.21.15.50:0/519943573 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727007e4e0 con 0x5625b0cc0880 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.457+0000 7f7281457740 1 -- 172.21.15.50:0/519943573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 msgr2=0x5625b0ca2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.457+0000 7f7281457740 1 --2- 172.21.15.50:0/519943573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 0x5625b0ca2be0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f727002a730 tx=0x7f7270076500 comp rx=0 tx=0).stop 2024-09-11T22:13:55.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.457+0000 7f7281457740 1 -- 172.21.15.50:0/519943573 shutdown_connections 2024-09-11T22:13:55.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.457+0000 7f7281457740 1 --2- 172.21.15.50:0/519943573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc0420 0x5625b0cc1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.457+0000 7f7281457740 1 --2- 172.21.15.50:0/519943573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 0x5625b0ca2be0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.457+0000 7f7281457740 1 --2- 172.21.15.50:0/519943573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc2c60 0x5625b0cc3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.457+0000 7f7281457740 1 -- 172.21.15.50:0/519943573 >> 172.21.15.50:0/519943573 conn(0x5625b0c788c0 msgr2=0x5625b0cc0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.457+0000 7f7281457740 1 -- 172.21.15.50:0/519943573 shutdown_connections 2024-09-11T22:13:55.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.457+0000 7f7281457740 1 -- 172.21.15.50:0/519943573 wait complete. 2024-09-11T22:13:55.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.457+0000 7f7281457740 1 -- start start 2024-09-11T22:13:55.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.458+0000 7f7281457740 1 Processor -- start 2024-09-11T22:13:55.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.458+0000 7f7281457740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc0880 0x5625b0ca06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.458+0000 7f7281457740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc2c60 0x5625b0cb9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.458+0000 7f7281457740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cbb9c0 0x5625b0ca5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.458+0000 7f7281457740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5625b0bdfaa0 con 0x5625b0cbb9c0 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.458+0000 7f7281457740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5625b0b9ace0 con 0x5625b0cc0880 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.458+0000 7f7281457740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5625b0cbf380 con 0x5625b0cc2c60 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.458+0000 7f7281457740 10 client.0 _ll_register_callbacks cb 0x5625b08f1dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f727cb81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cbb9c0 0x5625b0ca5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f727cb81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cbb9c0 0x5625b0ca5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57568/0 (socket says 172.21.15.50:57568) 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f727cb81640 1 -- 172.21.15.50:0/3196939882 learned_addr learned my addr 172.21.15.50:0/3196939882 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f7277fff640 1 --2- 172.21.15.50:0/3196939882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc0880 0x5625b0ca06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f72777fe640 1 --2- 172.21.15.50:0/3196939882 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc2c60 0x5625b0cb9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f727cb81640 1 -- 172.21.15.50:0/3196939882 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc2c60 msgr2=0x5625b0cb9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f727cb81640 1 --2- 172.21.15.50:0/3196939882 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc2c60 0x5625b0cb9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f727cb81640 1 -- 172.21.15.50:0/3196939882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc0880 msgr2=0x5625b0ca06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f727cb81640 1 --2- 172.21.15.50:0/3196939882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc0880 0x5625b0ca06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f727cb81640 1 -- 172.21.15.50:0/3196939882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625b08b22e0 con 0x5625b0cbb9c0 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f727cb81640 1 --2- 172.21.15.50:0/3196939882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cbb9c0 0x5625b0ca5fe0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f72700827e0 tx=0x7f7270009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01c40837d310469 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f7256ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f7256ffd640 1 -- 172.21.15.50:0/3196939882 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72700a7070 con 0x5625b0cbb9c0 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f7256ffd640 1 -- 172.21.15.50:0/3196939882 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f7270079580 con 0x5625b0cbb9c0 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f7281457740 1 -- 172.21.15.50:0/3196939882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7270037040 con 0x5625b0cbb9c0 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f7256ffd640 1 -- 172.21.15.50:0/3196939882 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7270092040 con 0x5625b0cbb9c0 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f7281457740 10 client.5442 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f7281457740 1 -- 172.21.15.50:0/3196939882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5625b0a1f180 con 0x5625b0cbb9c0 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f7256ffd640 1 -- 172.21.15.50:0/3196939882 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7270037040 con 0x5625b0cbb9c0 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.459+0000 7f7256ffd640 1 -- 172.21.15.50:0/3196939882 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f7270075e80 con 0x5625b0cbb9c0 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.460+0000 7f7281457740 10 client.5442 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.460+0000 7f7281457740 10 client.5442 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:55.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.460+0000 7f7281457740 20 client.5442 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:55.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.460+0000 7f7281457740 1 --2- 172.21.15.50:0/3196939882 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5625b0ca4c10 0x5625b0ca5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.460+0000 7f7281457740 4 client.5442 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:55.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.460+0000 7f7281457740 1 -- 172.21.15.50:0/3196939882 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625b0bed1d0 con 0x5625b0ca4c10 2024-09-11T22:13:55.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.460+0000 7f7277fff640 1 --2- 172.21.15.50:0/3196939882 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5625b0ca4c10 0x5625b0ca5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.460+0000 7f7277fff640 1 --2- 172.21.15.50:0/3196939882 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5625b0ca4c10 0x5625b0ca5020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e566dde7f370bc6 server_cookie=abef7a9b3ef97f5b in_seq=0 out_seq=0 2024-09-11T22:13:55.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.460+0000 7f7256ffd640 10 client.5442 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7256ffd640 1 -- 172.21.15.50:0/3196939882 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625b0bed1d0 con 0x5625b0ca4c10 2024-09-11T22:13:55.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7256ffd640 10 client.5442 handle_command_reply: tid=0 2024-09-11T22:13:55.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7281457740 1 client.5442 shutdown 2024-09-11T22:13:55.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7281457740 1 -- 172.21.15.50:0/3196939882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cbb9c0 msgr2=0x5625b0ca5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7281457740 1 --2- 172.21.15.50:0/3196939882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cbb9c0 0x5625b0ca5fe0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f72700827e0 tx=0x7f7270009810 comp rx=0 tx=0).stop 2024-09-11T22:13:55.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7281457740 1 -- 172.21.15.50:0/3196939882 shutdown_connections 2024-09-11T22:13:55.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7281457740 1 --2- 172.21.15.50:0/3196939882 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc2c60 0x5625b0cb9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7281457740 1 --2- 172.21.15.50:0/3196939882 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5625b0ca4c10 0x5625b0ca5020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7281457740 1 --2- 172.21.15.50:0/3196939882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cbb9c0 0x5625b0ca5fe0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7281457740 1 --2- 172.21.15.50:0/3196939882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc0880 0x5625b0ca06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7256ffd640 0 client.5442 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7281457740 1 -- 172.21.15.50:0/3196939882 >> 172.21.15.50:0/3196939882 conn(0x5625b0cc0420 msgr2=0x5625b0ca31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7281457740 1 -- 172.21.15.50:0/3196939882 shutdown_connections 2024-09-11T22:13:55.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7281457740 1 -- 172.21.15.50:0/3196939882 wait complete. 2024-09-11T22:13:55.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.461+0000 7f7281457740 20 client.5442 trim_cache size 0 max 16384 2024-09-11T22:13:55.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.481+0000 7f7281457740 1 Processor -- start 2024-09-11T22:13:55.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.481+0000 7f7281457740 1 -- start start 2024-09-11T22:13:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f7281457740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cbb9c0 0x5625b0c75810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f7281457740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 0x5625b0ca2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f7281457740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc2c60 0x5625b0ca5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f7281457740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7278200ca0 con 0x5625b0cc0880 2024-09-11T22:13:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f7281457740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72781ffc80 con 0x5625b0cbb9c0 2024-09-11T22:13:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f7281457740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f727815e490 con 0x5625b0cc2c60 2024-09-11T22:13:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f72777fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 0x5625b0ca2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f72777fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 0x5625b0ca2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57580/0 (socket says 172.21.15.50:57580) 2024-09-11T22:13:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f72777fe640 1 -- 172.21.15.50:0/521154931 learned_addr learned my addr 172.21.15.50:0/521154931 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f7277fff640 1 --2- 172.21.15.50:0/521154931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cbb9c0 0x5625b0c75810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f727cb81640 1 --2- 172.21.15.50:0/521154931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc2c60 0x5625b0ca5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f72777fe640 1 -- 172.21.15.50:0/521154931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc2c60 msgr2=0x5625b0ca5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f72777fe640 1 --2- 172.21.15.50:0/521154931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc2c60 0x5625b0ca5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f72777fe640 1 -- 172.21.15.50:0/521154931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cbb9c0 msgr2=0x5625b0c75810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f72777fe640 1 --2- 172.21.15.50:0/521154931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cbb9c0 0x5625b0c75810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f72777fe640 1 -- 172.21.15.50:0/521154931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625b088b3a0 con 0x5625b0cc0880 2024-09-11T22:13:55.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f72777fe640 1 --2- 172.21.15.50:0/521154931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 0x5625b0ca2cc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f726c005330 tx=0x7f726c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75e7c25dadb24dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f725d7fa640 1 -- 172.21.15.50:0/521154931 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c001590 con 0x5625b0cc0880 2024-09-11T22:13:55.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f725d7fa640 1 -- 172.21.15.50:0/521154931 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f726c001730 con 0x5625b0cc0880 2024-09-11T22:13:55.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.482+0000 7f725d7fa640 1 -- 172.21.15.50:0/521154931 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c001920 con 0x5625b0cc0880 2024-09-11T22:13:55.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.483+0000 7f7281457740 1 -- 172.21.15.50:0/521154931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 msgr2=0x5625b0ca2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.483+0000 7f7281457740 1 --2- 172.21.15.50:0/521154931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 0x5625b0ca2cc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f726c005330 tx=0x7f726c0039c0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.483+0000 7f7281457740 1 -- 172.21.15.50:0/521154931 shutdown_connections 2024-09-11T22:13:55.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.483+0000 7f7281457740 1 --2- 172.21.15.50:0/521154931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cc2c60 0x5625b0ca5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.483+0000 7f7281457740 1 --2- 172.21.15.50:0/521154931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc0880 0x5625b0ca2cc0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.483+0000 7f7281457740 1 --2- 172.21.15.50:0/521154931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cbb9c0 0x5625b0c75810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.483+0000 7f7281457740 1 -- 172.21.15.50:0/521154931 >> 172.21.15.50:0/521154931 conn(0x5625b0cc0420 msgr2=0x5625b0c9ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.483+0000 7f7281457740 1 -- 172.21.15.50:0/521154931 shutdown_connections 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.483+0000 7f7281457740 1 -- 172.21.15.50:0/521154931 wait complete. 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.484+0000 7f7281457740 1 -- start start 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.484+0000 7f7281457740 1 Processor -- start 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f7281457740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cbb9c0 0x5625b0d2b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f7281457740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc0880 0x5625b0ccf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f7281457740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc2c60 0x5625b0ccf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f7281457740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f72781ff7d0 con 0x5625b0cc2c60 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f7281457740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5625b0ca4090 con 0x5625b0cc0880 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f7281457740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5625b0d30ae0 con 0x5625b0cbb9c0 2024-09-11T22:13:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f7281457740 10 client.0 _ll_register_callbacks cb 0x7f726800a710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f727cb81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc2c60 0x5625b0ccf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f727cb81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc2c60 0x5625b0ccf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57594/0 (socket says 172.21.15.50:57594) 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f727cb81640 1 -- 172.21.15.50:0/38984081 learned_addr learned my addr 172.21.15.50:0/38984081 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f7277fff640 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cbb9c0 0x5625b0d2b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f72777fe640 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc0880 0x5625b0ccf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f727cb81640 1 -- 172.21.15.50:0/38984081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cbb9c0 msgr2=0x5625b0d2b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f727cb81640 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cbb9c0 0x5625b0d2b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f727cb81640 1 -- 172.21.15.50:0/38984081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc0880 msgr2=0x5625b0ccf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f727cb81640 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc0880 0x5625b0ccf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f727cb81640 1 -- 172.21.15.50:0/38984081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625b0cbaf10 con 0x5625b0cc2c60 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f72777fe640 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc0880 0x5625b0ccf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f727cb81640 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc2c60 0x5625b0ccf930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7270076540 tx=0x7f7270009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b246b208358c525e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f7256ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.485+0000 7f7256ffd640 1 -- 172.21.15.50:0/38984081 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72700a7070 con 0x5625b0cc2c60 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7256ffd640 1 -- 172.21.15.50:0/38984081 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f7270079780 con 0x5625b0cc2c60 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7281457740 1 -- 172.21.15.50:0/38984081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f726c001730 con 0x5625b0cc2c60 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7256ffd640 1 -- 172.21.15.50:0/38984081 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f727007e4e0 con 0x5625b0cc2c60 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7281457740 10 client.5448 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7281457740 1 -- 172.21.15.50:0/38984081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5625b0cbaf10 con 0x5625b0cc2c60 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7256ffd640 1 -- 172.21.15.50:0/38984081 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f726c001730 con 0x5625b0cc2c60 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7256ffd640 1 -- 172.21.15.50:0/38984081 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f7270078ff0 con 0x5625b0cc2c60 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7281457740 10 client.5448 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7281457740 10 client.5448 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7281457740 20 client.5448 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7281457740 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5625b0cc0ca0 0x5625b0d2fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7281457740 4 client.5448 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7281457740 1 -- 172.21.15.50:0/38984081 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x5625b0be7520 con 0x5625b0cc0ca0 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7277fff640 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5625b0cc0ca0 0x5625b0d2fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7277fff640 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5625b0cc0ca0 0x5625b0d2fd00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2429b30e4aae9470 server_cookie=adf51948b4cc2815 in_seq=0 out_seq=0 2024-09-11T22:13:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.486+0000 7f7256ffd640 10 client.5448 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7256ffd640 1 -- 172.21.15.50:0/38984081 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x5625b0be7520 con 0x5625b0cc0ca0 2024-09-11T22:13:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7256ffd640 10 client.5448 handle_command_reply: tid=0 2024-09-11T22:13:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7281457740 1 client.5448 shutdown 2024-09-11T22:13:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7281457740 1 -- 172.21.15.50:0/38984081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc2c60 msgr2=0x5625b0ccf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7281457740 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc2c60 0x5625b0ccf930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7270076540 tx=0x7f7270009bb0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7281457740 1 -- 172.21.15.50:0/38984081 shutdown_connections 2024-09-11T22:13:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7281457740 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5625b0cc0ca0 0x5625b0d2fd00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7281457740 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625b0cc2c60 0x5625b0ccf930 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7256ffd640 0 client.5448 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7281457740 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625b0cc0880 0x5625b0ccf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7281457740 1 --2- 172.21.15.50:0/38984081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625b0cbb9c0 0x5625b0d2b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7281457740 1 -- 172.21.15.50:0/38984081 >> 172.21.15.50:0/38984081 conn(0x5625b0cc0420 msgr2=0x5625b0c757f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7281457740 1 -- 172.21.15.50:0/38984081 shutdown_connections 2024-09-11T22:13:55.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7281457740 1 -- 172.21.15.50:0/38984081 wait complete. 2024-09-11T22:13:55.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.487+0000 7f7281457740 20 client.5448 trim_cache size 0 max 16384 2024-09-11T22:13:55.493 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:55.493 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": -2 2024-09-11T22:13:55.493 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:55.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.488+0000 7f727e5e4640 1 -- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f726406be30 msgr2=0x7f726406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.488+0000 7f727e5e4640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f726406be30 0x7f726406e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f726800aac0 tx=0x7f7268008040 comp rx=0 tx=0).stop 2024-09-11T22:13:55.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.488+0000 7f727e5e4640 1 -- 172.21.15.50:0/2639337873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727815b400 msgr2=0x7f72781f4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.488+0000 7f727e5e4640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727815b400 0x7f72781f4a80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f727002ace0 tx=0x7f7270004a40 comp rx=0 tx=0).stop 2024-09-11T22:13:55.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.488+0000 7f727e5e4640 1 -- 172.21.15.50:0/2639337873 shutdown_connections 2024-09-11T22:13:55.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.488+0000 7f727e5e4640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f726406be30 0x7f726406e2f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.488+0000 7f727e5e4640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727815b400 0x7f72781f4a80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.488+0000 7f727e5e4640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7278072e60 0x7f72780c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.488+0000 7f727e5e4640 1 --2- 172.21.15.50:0/2639337873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727806e0f0 0x7f72781f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.488+0000 7f727e5e4640 1 -- 172.21.15.50:0/2639337873 >> 172.21.15.50:0/2639337873 conn(0x7f72780679c0 msgr2=0x7f727806d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.488+0000 7f727e5e4640 1 -- 172.21.15.50:0/2639337873 shutdown_connections 2024-09-11T22:13:55.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.488+0000 7f727e5e4640 1 -- 172.21.15.50:0/2639337873 wait complete. 2024-09-11T22:13:55.499 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-11T22:13:55.499 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-09-11T22:13:55.499 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-09-11T22:13:55.499 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites 2024-09-11T22:13:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.603+0000 7f26bf996640 1 Processor -- start 2024-09-11T22:13:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.603+0000 7f26bf996640 1 -- start start 2024-09-11T22:13:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.604+0000 7f26bf996640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f26b80d18e0 0x7f26b80d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.604+0000 7f26bf996640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b80d31b0 con 0x7f26b815e790 2024-09-11T22:13:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.604+0000 7f26bf996640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b80d3490 con 0x7f26b815eb70 2024-09-11T22:13:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.604+0000 7f26bf996640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f26b80d3dc0 con 0x7f26b80d18e0 2024-09-11T22:13:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.604+0000 7f26bd732640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f26b815e790 0x7f26b80d11d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52780/0 (socket says 172.21.15.50:52780) 2024-09-11T22:13:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.604+0000 7f26bd732640 1 -- 172.21.15.50:0/2332486346 learned_addr learned my addr 172.21.15.50:0/2332486346 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.604+0000 7f26bcf31640 1 --2- 172.21.15.50:0/2332486346 >> v2:172.21.15.77:3300/0 conn(0x7f26b80d18e0 0x7f26b80d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.604+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 616843240 0 0) 0x7f26b80d31b0 con 0x7f26b815e790 2024-09-11T22:13:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.604+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26a4003520 con 0x7f26b815e790 2024-09-11T22:13:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1689423703 0 0) 0x7f26b80d3490 con 0x7f26b815eb70 2024-09-11T22:13:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26b80d31b0 con 0x7f26b815eb70 2024-09-11T22:13:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2318995254 0 0) 0x7f26a4003520 con 0x7f26b815e790 2024-09-11T22:13:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 >> v2:172.21.15.77:3300/0 conn(0x7f26b80d18e0 msgr2=0x7f26b80d4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 --2- 172.21.15.50:0/2332486346 >> v2:172.21.15.77:3300/0 conn(0x7f26b80d18e0 0x7f26b80d4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 >> v1:172.21.15.77:6789/0 conn(0x7f26b815eb70 legacy=0x7f26b80b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b80d3770 con 0x7f26b815e790 2024-09-11T22:13:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f26b4001670 con 0x7f26b815e790 2024-09-11T22:13:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 >> v1:172.21.15.50:6789/0 conn(0x7f26b815e790 legacy=0x7f26b80d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 --2- 172.21.15.50:0/2332486346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a4003b40 0x7f26a4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 --2- 172.21.15.50:0/2332486346 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26a4004800 0x7f26a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 --2- 172.21.15.50:0/2332486346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a40051c0 0x7f26a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26b80d3dc0 con 0x7f26a4003b40 2024-09-11T22:13:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f26a400c040 con 0x7f26a40051c0 2024-09-11T22:13:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f26a400c240 con 0x7f26a4004800 2024-09-11T22:13:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26bd732640 1 --2- 172.21.15.50:0/2332486346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a4003b40 0x7f26a4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26bcf31640 1 --2- 172.21.15.50:0/2332486346 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26a4004800 0x7f26a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26bdf33640 1 --2- 172.21.15.50:0/2332486346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a40051c0 0x7f26a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26bd732640 1 -- 172.21.15.50:0/2332486346 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26a4004800 msgr2=0x7f26a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26bd732640 1 --2- 172.21.15.50:0/2332486346 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26a4004800 0x7f26a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26bd732640 1 -- 172.21.15.50:0/2332486346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a40051c0 msgr2=0x7f26a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26bd732640 1 --2- 172.21.15.50:0/2332486346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a40051c0 0x7f26a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26bd732640 1 -- 172.21.15.50:0/2332486346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a4003520 con 0x7f26a4003b40 2024-09-11T22:13:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.605+0000 7f26bdf33640 1 -- 172.21.15.50:0/2332486346 reap_dead start 2024-09-11T22:13:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.606+0000 7f26bd732640 1 --2- 172.21.15.50:0/2332486346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a4003b40 0x7f26a4003f40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f26b400c210 tx=0x7f26a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b25b4042416a7c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.606+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4007ce0 con 0x7f26a4003b40 2024-09-11T22:13:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.606+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b4005ad0 con 0x7f26a4003b40 2024-09-11T22:13:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.606+0000 7f26affff640 1 -- 172.21.15.50:0/2332486346 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4007070 con 0x7f26a4003b40 2024-09-11T22:13:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.607+0000 7f26bf996640 1 -- 172.21.15.50:0/2332486346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a4003b40 msgr2=0x7f26a4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.607+0000 7f26bf996640 1 --2- 172.21.15.50:0/2332486346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a4003b40 0x7f26a4003f40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f26b400c210 tx=0x7f26a4005830 comp rx=0 tx=0).stop 2024-09-11T22:13:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.607+0000 7f26bf996640 1 -- 172.21.15.50:0/2332486346 shutdown_connections 2024-09-11T22:13:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.607+0000 7f26bf996640 1 --2- 172.21.15.50:0/2332486346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a4003b40 0x7f26a4003f40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.607+0000 7f26bf996640 1 -- 172.21.15.50:0/2332486346 >> 172.21.15.50:0/2332486346 conn(0x7f26b80727a0 msgr2=0x7f26b80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.607+0000 7f26bf996640 1 -- 172.21.15.50:0/2332486346 shutdown_connections 2024-09-11T22:13:55.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.607+0000 7f26bf996640 1 -- 172.21.15.50:0/2332486346 wait complete. 2024-09-11T22:13:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.608+0000 7f26bf996640 1 Processor -- start 2024-09-11T22:13:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.608+0000 7f26bf996640 1 -- start start 2024-09-11T22:13:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bf996640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a4003b40 0x7f26b80ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bf996640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b8154b20 0x7f26b8155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bf996640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26b8155790 0x7f26b80cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bf996640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26b80d43d0 con 0x7f26b8154b20 2024-09-11T22:13:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bf996640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f26b80d4250 con 0x7f26a4003b40 2024-09-11T22:13:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bf996640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f26b80d4550 con 0x7f26b8155790 2024-09-11T22:13:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bcf31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b8154b20 0x7f26b8155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bcf31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b8154b20 0x7f26b8155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57618/0 (socket says 172.21.15.50:57618) 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bcf31640 1 -- 172.21.15.50:0/1445658534 learned_addr learned my addr 172.21.15.50:0/1445658534 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bdf33640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26b8155790 0x7f26b80cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bd732640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a4003b40 0x7f26b80ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bcf31640 1 -- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26b8155790 msgr2=0x7f26b80cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bcf31640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26b8155790 0x7f26b80cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bcf31640 1 -- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a4003b40 msgr2=0x7f26b80ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bcf31640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a4003b40 0x7f26b80ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bcf31640 1 -- 172.21.15.50:0/1445658534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b80c8fe0 con 0x7f26b8154b20 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26bcf31640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b8154b20 0x7f26b8155250 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f26a80118f0 tx=0x7f26a8011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26adffb640 1 -- 172.21.15.50:0/1445658534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8019070 con 0x7f26b8154b20 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.609+0000 7f26adffb640 1 -- 172.21.15.50:0/1445658534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a8004240 con 0x7f26b8154b20 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.610+0000 7f26bf996640 1 -- 172.21.15.50:0/1445658534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b80cd330 con 0x7f26b8154b20 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.610+0000 7f26adffb640 1 -- 172.21.15.50:0/1445658534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8009590 con 0x7f26b8154b20 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.610+0000 7f26bf996640 1 -- 172.21.15.50:0/1445658534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b8153d60 con 0x7f26b8154b20 2024-09-11T22:13:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.611+0000 7f26adffb640 1 -- 172.21.15.50:0/1445658534 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26a801c070 con 0x7f26b8154b20 2024-09-11T22:13:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.612+0000 7f26adffb640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f269c06be30 0x7f269c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.612+0000 7f26adffb640 1 -- 172.21.15.50:0/1445658534 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f26a808b1d0 con 0x7f26b8154b20 2024-09-11T22:13:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.612+0000 7f26bd732640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f269c06be30 0x7f269c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.613+0000 7f26c2808740 1 Processor -- start 2024-09-11T22:13:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.613+0000 7f26bd732640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f269c06be30 0x7f269c06e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f26b4001eb0 tx=0x7f26b4009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.613+0000 7f26c2808740 1 -- start start 2024-09-11T22:13:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26c2808740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad131e0 0x555f6ad58980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26c2808740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad109a0 0x555f6ad135c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26c2808740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad14970 0x555f6ad0d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26c2808740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555f6ac75780 con 0x555f6ad14970 2024-09-11T22:13:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26c2808740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555f6ac1d460 con 0x555f6ad131e0 2024-09-11T22:13:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26c2808740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x555f6ac71740 con 0x555f6ad109a0 2024-09-11T22:13:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26bdf33640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad14970 0x555f6ad0d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26bdf33640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad14970 0x555f6ad0d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57634/0 (socket says 172.21.15.50:57634) 2024-09-11T22:13:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26bdf33640 1 -- 172.21.15.50:0/4134396764 learned_addr learned my addr 172.21.15.50:0/4134396764 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26bcf31640 1 --2- 172.21.15.50:0/4134396764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad109a0 0x555f6ad135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26bd732640 1 --2- 172.21.15.50:0/4134396764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad131e0 0x555f6ad58980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26bdf33640 1 -- 172.21.15.50:0/4134396764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad109a0 msgr2=0x555f6ad135c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26bdf33640 1 --2- 172.21.15.50:0/4134396764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad109a0 0x555f6ad135c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26bdf33640 1 -- 172.21.15.50:0/4134396764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad131e0 msgr2=0x555f6ad58980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26bdf33640 1 --2- 172.21.15.50:0/4134396764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad131e0 0x555f6ad58980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26bdf33640 1 -- 172.21.15.50:0/4134396764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f6a9886b0 con 0x555f6ad14970 2024-09-11T22:13:55.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26bcf31640 1 --2- 172.21.15.50:0/4134396764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad109a0 0x555f6ad135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:55.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26bdf33640 1 --2- 172.21.15.50:0/4134396764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad14970 0x555f6ad0d7d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f26b0001eb0 tx=0x7f26b0012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470a3f824777310b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26a2ffd640 1 -- 172.21.15.50:0/4134396764 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0006b50 con 0x555f6ad14970 2024-09-11T22:13:55.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26a2ffd640 1 -- 172.21.15.50:0/4134396764 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b0006cf0 con 0x555f6ad14970 2024-09-11T22:13:55.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.614+0000 7f26a2ffd640 1 -- 172.21.15.50:0/4134396764 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0003970 con 0x555f6ad14970 2024-09-11T22:13:55.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.615+0000 7f26c2808740 1 -- 172.21.15.50:0/4134396764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad14970 msgr2=0x555f6ad0d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.615+0000 7f26c2808740 1 --2- 172.21.15.50:0/4134396764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad14970 0x555f6ad0d7d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f26b0001eb0 tx=0x7f26b0012690 comp rx=0 tx=0).stop 2024-09-11T22:13:55.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.615+0000 7f26c2808740 1 -- 172.21.15.50:0/4134396764 shutdown_connections 2024-09-11T22:13:55.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.615+0000 7f26c2808740 1 --2- 172.21.15.50:0/4134396764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad109a0 0x555f6ad135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.615+0000 7f26c2808740 1 --2- 172.21.15.50:0/4134396764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad14970 0x555f6ad0d7d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.615+0000 7f26c2808740 1 --2- 172.21.15.50:0/4134396764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad131e0 0x555f6ad58980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.615+0000 7f26c2808740 1 -- 172.21.15.50:0/4134396764 >> 172.21.15.50:0/4134396764 conn(0x555f6ad0f9a0 msgr2=0x555f6ad57e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.615+0000 7f26c2808740 1 -- 172.21.15.50:0/4134396764 shutdown_connections 2024-09-11T22:13:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.615+0000 7f26c2808740 1 -- 172.21.15.50:0/4134396764 wait complete. 2024-09-11T22:13:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.616+0000 7f26c2808740 1 -- start start 2024-09-11T22:13:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.616+0000 7f26c2808740 1 Processor -- start 2024-09-11T22:13:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26c2808740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad131e0 0x555f6ad2eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26c2808740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 0x555f6ad3abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26c2808740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad0df80 0x555f6ad0e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26c2808740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555f6ad0ee40 con 0x555f6ad0df80 2024-09-11T22:13:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26c2808740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555f6abfe6e0 con 0x555f6ad131e0 2024-09-11T22:13:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26c2808740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x555f6ad591b0 con 0x555f6ad14970 2024-09-11T22:13:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26c2808740 10 client.0 _ll_register_callbacks cb 0x555f6ac6ed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26bdf33640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad0df80 0x555f6ad0e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26bdf33640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad0df80 0x555f6ad0e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57638/0 (socket says 172.21.15.50:57638) 2024-09-11T22:13:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26bdf33640 1 -- 172.21.15.50:0/2276234447 learned_addr learned my addr 172.21.15.50:0/2276234447 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26bcf31640 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 0x555f6ad3abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26bd732640 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad131e0 0x555f6ad2eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26bdf33640 1 -- 172.21.15.50:0/2276234447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 msgr2=0x555f6ad3abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26bdf33640 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 0x555f6ad3abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26bdf33640 1 -- 172.21.15.50:0/2276234447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad131e0 msgr2=0x555f6ad2eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26bdf33640 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad131e0 0x555f6ad2eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26bdf33640 1 -- 172.21.15.50:0/2276234447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f6aa52a90 con 0x555f6ad0df80 2024-09-11T22:13:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26bd732640 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad131e0 0x555f6ad2eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26bdf33640 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad0df80 0x555f6ad0e400 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f26b0012b90 tx=0x7f26b0001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36be12eb16a07461 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f2697fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f2697fff640 1 -- 172.21.15.50:0/2276234447 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0006b50 con 0x555f6ad0df80 2024-09-11T22:13:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f2697fff640 1 -- 172.21.15.50:0/2276234447 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f26b001b040 con 0x555f6ad0df80 2024-09-11T22:13:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.617+0000 7f26c2808740 1 -- 172.21.15.50:0/2276234447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26b0006cf0 con 0x555f6ad0df80 2024-09-11T22:13:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f2697fff640 1 -- 172.21.15.50:0/2276234447 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f26b002d050 con 0x555f6ad0df80 2024-09-11T22:13:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f26c2808740 10 client.5460 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f26c2808740 1 -- 172.21.15.50:0/2276234447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x555f6ad0d550 con 0x555f6ad0df80 2024-09-11T22:13:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f2697fff640 1 -- 172.21.15.50:0/2276234447 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b0006cf0 con 0x555f6ad0df80 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f2697fff640 1 -- 172.21.15.50:0/2276234447 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f26b0030020 con 0x555f6ad0df80 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f26c2808740 10 client.5460 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f26c2808740 10 client.5460 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f26c2808740 20 client.5460 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f26c2808740 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x555f6ad32f50 0x555f6ad33360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f26c2808740 4 client.5460 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f26c2808740 1 -- 172.21.15.50:0/2276234447 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f6ac82eb0 con 0x555f6ad32f50 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f26bd732640 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x555f6ad32f50 0x555f6ad33360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f26bd732640 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x555f6ad32f50 0x555f6ad33360 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edc27a64bedc9491 server_cookie=6ae2ca21f2ff89b6 in_seq=0 out_seq=0 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.618+0000 7f2697fff640 10 client.5460 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f2697fff640 1 -- 172.21.15.50:0/2276234447 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f6ac82eb0 con 0x555f6ad32f50 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f2697fff640 10 client.5460 handle_command_reply: tid=0 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f26c2808740 1 client.5460 shutdown 2024-09-11T22:13:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f26c2808740 1 -- 172.21.15.50:0/2276234447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad0df80 msgr2=0x555f6ad0e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f26c2808740 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad0df80 0x555f6ad0e400 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f26b0012b90 tx=0x7f26b0001650 comp rx=0 tx=0).stop 2024-09-11T22:13:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f26c2808740 1 -- 172.21.15.50:0/2276234447 shutdown_connections 2024-09-11T22:13:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f26c2808740 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 0x555f6ad3abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f26c2808740 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x555f6ad32f50 0x555f6ad33360 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f26c2808740 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad0df80 0x555f6ad0e400 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f26c2808740 1 --2- 172.21.15.50:0/2276234447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad131e0 0x555f6ad2eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f26c2808740 1 -- 172.21.15.50:0/2276234447 >> 172.21.15.50:0/2276234447 conn(0x555f6ad109a0 msgr2=0x555f6ad59f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f2697fff640 0 client.5460 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f26c2808740 1 -- 172.21.15.50:0/2276234447 shutdown_connections 2024-09-11T22:13:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f26c2808740 1 -- 172.21.15.50:0/2276234447 wait complete. 2024-09-11T22:13:55.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.619+0000 7f26c2808740 20 client.5460 trim_cache size 0 max 16384 2024-09-11T22:13:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.634+0000 7f26c2808740 1 Processor -- start 2024-09-11T22:13:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.634+0000 7f26c2808740 1 -- start start 2024-09-11T22:13:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26c2808740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad0df80 0x555f6ad5aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26c2808740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 0x555f6ad0e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26c2808740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 0x555f6ad119d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26c2808740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26b82013c0 con 0x555f6ad131e0 2024-09-11T22:13:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26c2808740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f26b82003a0 con 0x555f6ad0df80 2024-09-11T22:13:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26c2808740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f26b81f8a60 con 0x555f6ad14970 2024-09-11T22:13:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26bcf31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 0x555f6ad0e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26bcf31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 0x555f6ad0e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57646/0 (socket says 172.21.15.50:57646) 2024-09-11T22:13:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26bcf31640 1 -- 172.21.15.50:0/2540980728 learned_addr learned my addr 172.21.15.50:0/2540980728 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26bcf31640 1 -- 172.21.15.50:0/2540980728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 msgr2=0x555f6ad119d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26bcf31640 1 --2- 172.21.15.50:0/2540980728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 0x555f6ad119d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26bcf31640 1 -- 172.21.15.50:0/2540980728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad0df80 msgr2=0x555f6ad5aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26bcf31640 1 --2- 172.21.15.50:0/2540980728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad0df80 0x555f6ad5aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26bcf31640 1 -- 172.21.15.50:0/2540980728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f6ad0d790 con 0x555f6ad131e0 2024-09-11T22:13:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26bcf31640 1 --2- 172.21.15.50:0/2540980728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 0x555f6ad0e360 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f26a80558b0 tx=0x7f26a8059010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6525dfca1e78be63 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26a27fc640 1 -- 172.21.15.50:0/2540980728 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8023040 con 0x555f6ad131e0 2024-09-11T22:13:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26a27fc640 1 -- 172.21.15.50:0/2540980728 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a8055ac0 con 0x555f6ad131e0 2024-09-11T22:13:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.635+0000 7f26a27fc640 1 -- 172.21.15.50:0/2540980728 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8071370 con 0x555f6ad131e0 2024-09-11T22:13:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.636+0000 7f26c2808740 1 -- 172.21.15.50:0/2540980728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 msgr2=0x555f6ad0e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.636+0000 7f26c2808740 1 --2- 172.21.15.50:0/2540980728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 0x555f6ad0e360 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f26a80558b0 tx=0x7f26a8059010 comp rx=0 tx=0).stop 2024-09-11T22:13:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.636+0000 7f26c2808740 1 -- 172.21.15.50:0/2540980728 shutdown_connections 2024-09-11T22:13:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.636+0000 7f26c2808740 1 --2- 172.21.15.50:0/2540980728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 0x555f6ad119d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.636+0000 7f26c2808740 1 --2- 172.21.15.50:0/2540980728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 0x555f6ad0e360 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.636+0000 7f26c2808740 1 --2- 172.21.15.50:0/2540980728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad0df80 0x555f6ad5aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.636+0000 7f26c2808740 1 -- 172.21.15.50:0/2540980728 >> 172.21.15.50:0/2540980728 conn(0x555f6ad109a0 msgr2=0x555f6ad3b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.636+0000 7f26c2808740 1 -- 172.21.15.50:0/2540980728 shutdown_connections 2024-09-11T22:13:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.636+0000 7f26c2808740 1 -- 172.21.15.50:0/2540980728 wait complete. 2024-09-11T22:13:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.636+0000 7f26c2808740 1 -- start start 2024-09-11T22:13:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.636+0000 7f26c2808740 1 Processor -- start 2024-09-11T22:13:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.637+0000 7f26c2808740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad0df80 0x555f6ad7bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.637+0000 7f26c2808740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 0x555f6ad54b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.637+0000 7f26c2808740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 0x555f6ad119d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.637+0000 7f26c2808740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555f6ad10d80 con 0x555f6ad131e0 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.637+0000 7f26c2808740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555f6ac82eb0 con 0x555f6ad0df80 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.637+0000 7f26c2808740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x555f6ad12a20 con 0x555f6ad14970 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.637+0000 7f26c2808740 10 client.0 _ll_register_callbacks cb 0x7f26b0018020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.637+0000 7f26bcf31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 0x555f6ad54b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.637+0000 7f26bcf31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 0x555f6ad54b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57650/0 (socket says 172.21.15.50:57650) 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.637+0000 7f26bcf31640 1 -- 172.21.15.50:0/677276105 learned_addr learned my addr 172.21.15.50:0/677276105 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26bd732640 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad0df80 0x555f6ad7bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26bdf33640 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 0x555f6ad119d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26bcf31640 1 -- 172.21.15.50:0/677276105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 msgr2=0x555f6ad119d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26bcf31640 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 0x555f6ad119d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26bcf31640 1 -- 172.21.15.50:0/677276105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad0df80 msgr2=0x555f6ad7bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26bcf31640 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad0df80 0x555f6ad7bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26bcf31640 1 -- 172.21.15.50:0/677276105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f6ad54080 con 0x555f6ad131e0 2024-09-11T22:13:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26bd732640 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad0df80 0x555f6ad7bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26bcf31640 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 0x555f6ad54b90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f26a8059150 tx=0x7f26a8016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0b2d6bbf79c196 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f2697fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f2697fff640 1 -- 172.21.15.50:0/677276105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8023050 con 0x555f6ad131e0 2024-09-11T22:13:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f2697fff640 1 -- 172.21.15.50:0/677276105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f26a8089200 con 0x555f6ad131e0 2024-09-11T22:13:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26c2808740 1 -- 172.21.15.50:0/677276105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26a8055ac0 con 0x555f6ad131e0 2024-09-11T22:13:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f2697fff640 1 -- 172.21.15.50:0/677276105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f26a8078050 con 0x555f6ad131e0 2024-09-11T22:13:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26c2808740 10 client.5466 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26c2808740 1 -- 172.21.15.50:0/677276105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x555f6adda450 con 0x555f6ad131e0 2024-09-11T22:13:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f2697fff640 1 -- 172.21.15.50:0/677276105 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a8055ac0 con 0x555f6ad131e0 2024-09-11T22:13:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f2697fff640 1 -- 172.21.15.50:0/677276105 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f26a80781f0 con 0x555f6ad131e0 2024-09-11T22:13:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26c2808740 10 client.5466 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.638+0000 7f26c2808740 10 client.5466 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:55.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.639+0000 7f26c2808740 20 client.5466 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:55.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.639+0000 7f26c2808740 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x555f6ad381b0 0x555f6ad11f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.639+0000 7f26c2808740 4 client.5466 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-11T22:13:55.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.639+0000 7f26c2808740 1 -- 172.21.15.50:0/677276105 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x555f6ac7d200 con 0x555f6ad381b0 2024-09-11T22:13:55.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.639+0000 7f26bd732640 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x555f6ad381b0 0x555f6ad11f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.639+0000 7f26bd732640 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x555f6ad381b0 0x555f6ad11f10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97399a28b08bf184 server_cookie=7ae8d71bad63486a in_seq=0 out_seq=0 2024-09-11T22:13:55.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.639+0000 7f2697fff640 10 client.5466 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f2697fff640 1 -- 172.21.15.50:0/677276105 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555f6ac7d200 con 0x555f6ad381b0 2024-09-11T22:13:55.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f2697fff640 10 client.5466 handle_command_reply: tid=0 2024-09-11T22:13:55.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f26c2808740 1 client.5466 shutdown 2024-09-11T22:13:55.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f26c2808740 1 -- 172.21.15.50:0/677276105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 msgr2=0x555f6ad54b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f26c2808740 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 0x555f6ad54b90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f26a8059150 tx=0x7f26a8016040 comp rx=0 tx=0).stop 2024-09-11T22:13:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f26c2808740 1 -- 172.21.15.50:0/677276105 shutdown_connections 2024-09-11T22:13:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f26c2808740 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555f6ad14970 0x555f6ad119d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f26c2808740 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x555f6ad381b0 0x555f6ad11f10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f26c2808740 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f6ad131e0 0x555f6ad54b90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f26c2808740 1 --2- 172.21.15.50:0/677276105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555f6ad0df80 0x555f6ad7bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f2697fff640 0 client.5466 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f26c2808740 1 -- 172.21.15.50:0/677276105 >> 172.21.15.50:0/677276105 conn(0x555f6ad109a0 msgr2=0x555f6ad39480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f26c2808740 1 -- 172.21.15.50:0/677276105 shutdown_connections 2024-09-11T22:13:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f26c2808740 1 -- 172.21.15.50:0/677276105 wait complete. 2024-09-11T22:13:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.642+0000 7f26c2808740 20 client.5466 trim_cache size 0 max 16384 2024-09-11T22:13:55.646 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:55.647 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:13:55.647 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:13:55.647 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.643+0000 7f26bf996640 1 -- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f269c06be30 msgr2=0x7f269c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.643+0000 7f26bf996640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f269c06be30 0x7f269c06e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f26b4001eb0 tx=0x7f26b4009030 comp rx=0 tx=0).stop 2024-09-11T22:13:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.643+0000 7f26bf996640 1 -- 172.21.15.50:0/1445658534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b8154b20 msgr2=0x7f26b8155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.643+0000 7f26bf996640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b8154b20 0x7f26b8155250 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f26a80118f0 tx=0x7f26a8011cf0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.643+0000 7f26bf996640 1 -- 172.21.15.50:0/1445658534 shutdown_connections 2024-09-11T22:13:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.643+0000 7f26bf996640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f269c06be30 0x7f269c06e2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.643+0000 7f26bf996640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26b8155790 0x7f26b80cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.643+0000 7f26bf996640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b8154b20 0x7f26b8155250 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.643+0000 7f26bf996640 1 --2- 172.21.15.50:0/1445658534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a4003b40 0x7f26b80ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.643+0000 7f26bf996640 1 -- 172.21.15.50:0/1445658534 >> 172.21.15.50:0/1445658534 conn(0x7f26b80727a0 msgr2=0x7f26b80b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.643+0000 7f26bf996640 1 -- 172.21.15.50:0/1445658534 shutdown_connections 2024-09-11T22:13:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.643+0000 7f26bf996640 1 -- 172.21.15.50:0/1445658534 wait complete. 2024-09-11T22:13:55.654 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' returned '{'message': '', 'return_code': 0}' 2024-09-11T22:13:55.654 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-11T22:13:55.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-11T22:13:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.759+0000 7fc3dd98d640 1 Processor -- start 2024-09-11T22:13:55.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.759+0000 7fc3dd98d640 1 -- start start 2024-09-11T22:13:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.760+0000 7fc3dd98d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3d815b400 0x7fc3d806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.760+0000 7fc3dd98d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3d8072e60 0x7fc3d806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.760+0000 7fc3dd98d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3d815b7e0 con 0x7fc3d806df20 2024-09-11T22:13:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.760+0000 7fc3dd98d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc3d806e370 con 0x7fc3d815b400 2024-09-11T22:13:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.760+0000 7fc3dd98d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc3d815f140 con 0x7fc3d8072e60 2024-09-11T22:13:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.760+0000 7fc3d6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3d815b400 0x7fc3d806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.760+0000 7fc3d77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc3d806df20 0x7fc3d80b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52794/0 (socket says 172.21.15.50:52794) 2024-09-11T22:13:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.760+0000 7fc3d77fe640 1 -- 172.21.15.50:0/2666402686 learned_addr learned my addr 172.21.15.50:0/2666402686 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.760+0000 7fc3d67fc640 1 --2- 172.21.15.50:0/2666402686 >> v2:172.21.15.77:3300/0 conn(0x7fc3d8072e60 0x7fc3d806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.761+0000 7fc3d6ffd640 1 -- 172.21.15.50:0/2666402686 >> v2:172.21.15.77:3300/0 conn(0x7fc3d8072e60 msgr2=0x7fc3d806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.761+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/2666402686 >> v2:172.21.15.77:3300/0 conn(0x7fc3d8072e60 0x7fc3d806d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.761+0000 7fc3d6ffd640 1 -- 172.21.15.50:0/2666402686 >> v1:172.21.15.50:6789/0 conn(0x7fc3d806df20 legacy=0x7fc3d80b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.761+0000 7fc3d5ffb640 1 -- 172.21.15.50:0/2666402686 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4250200302 0 0) 0x7fc3d815b7e0 con 0x7fc3d806df20 2024-09-11T22:13:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.761+0000 7fc3d6ffd640 1 -- 172.21.15.50:0/2666402686 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d815f420 con 0x7fc3d815b400 2024-09-11T22:13:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.761+0000 7fc3d67fc640 1 --2- 172.21.15.50:0/2666402686 >> v2:172.21.15.77:3300/0 conn(0x7fc3d8072e60 0x7fc3d806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:55.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.761+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/2666402686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3d815b400 0x7fc3d806d070 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80b56b0 tx=0x7fc3c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a120a08e45a300e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.762+0000 7fc3d5ffb640 1 -- 172.21.15.50:0/2666402686 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8037070 con 0x7fc3d815b400 2024-09-11T22:13:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.762+0000 7fc3d5ffb640 1 -- 172.21.15.50:0/2666402686 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c8032440 con 0x7fc3d815b400 2024-09-11T22:13:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.762+0000 7fc3d5ffb640 1 -- 172.21.15.50:0/2666402686 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8032810 con 0x7fc3d815b400 2024-09-11T22:13:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.762+0000 7fc3dd98d640 1 -- 172.21.15.50:0/2666402686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3d815b400 msgr2=0x7fc3d806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.762+0000 7fc3dd98d640 1 --2- 172.21.15.50:0/2666402686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3d815b400 0x7fc3d806d070 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80b56b0 tx=0x7fc3c802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.762+0000 7fc3dd98d640 1 -- 172.21.15.50:0/2666402686 shutdown_connections 2024-09-11T22:13:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.762+0000 7fc3dd98d640 1 --2- 172.21.15.50:0/2666402686 >> v2:172.21.15.77:3300/0 conn(0x7fc3d8072e60 0x7fc3d806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.762+0000 7fc3dd98d640 1 --2- 172.21.15.50:0/2666402686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3d815b400 0x7fc3d806d070 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.762+0000 7fc3dd98d640 1 -- 172.21.15.50:0/2666402686 >> 172.21.15.50:0/2666402686 conn(0x7fc3d80679c0 msgr2=0x7fc3d8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.762+0000 7fc3dd98d640 1 -- 172.21.15.50:0/2666402686 shutdown_connections 2024-09-11T22:13:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.762+0000 7fc3dd98d640 1 -- 172.21.15.50:0/2666402686 wait complete. 2024-09-11T22:13:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.763+0000 7fc3dd98d640 1 Processor -- start 2024-09-11T22:13:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.764+0000 7fc3dd98d640 1 -- start start 2024-09-11T22:13:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.764+0000 7fc3dd98d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3d806df20 0x7fc3d8151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.764+0000 7fc3dd98d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3d8072e60 0x7fc3d80cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.764+0000 7fc3dd98d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d815b400 0x7fc3d80b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.764+0000 7fc3dd98d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d80cfc50 con 0x7fc3d8072e60 2024-09-11T22:13:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.764+0000 7fc3dd98d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d815f9e0 con 0x7fc3d815b400 2024-09-11T22:13:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.764+0000 7fc3dd98d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d80721d0 con 0x7fc3d806df20 2024-09-11T22:13:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.764+0000 7fc3d67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3d8072e60 0x7fc3d80cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.764+0000 7fc3d67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3d8072e60 0x7fc3d80cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57670/0 (socket says 172.21.15.50:57670) 2024-09-11T22:13:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.764+0000 7fc3d67fc640 1 -- 172.21.15.50:0/2984821995 learned_addr learned my addr 172.21.15.50:0/2984821995 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3d806df20 0x7fc3d8151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3d77fe640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d815b400 0x7fc3d80b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3d67fc640 1 -- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3d806df20 msgr2=0x7fc3d8151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3d67fc640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3d806df20 0x7fc3d8151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3d67fc640 1 -- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d815b400 msgr2=0x7fc3d80b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3d67fc640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d815b400 0x7fc3d80b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3d67fc640 1 -- 172.21.15.50:0/2984821995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d815c8d0 con 0x7fc3d8072e60 2024-09-11T22:13:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3d77fe640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d815b400 0x7fc3d80b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3d67fc640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3d8072e60 0x7fc3d80cdac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00e7e0 tx=0x7fc3cc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3bffff640 1 -- 172.21.15.50:0/2984821995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00f040 con 0x7fc3d8072e60 2024-09-11T22:13:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3bffff640 1 -- 172.21.15.50:0/2984821995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3cc004030 con 0x7fc3d8072e60 2024-09-11T22:13:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3bffff640 1 -- 172.21.15.50:0/2984821995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc004400 con 0x7fc3d8072e60 2024-09-11T22:13:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3dd98d640 1 -- 172.21.15.50:0/2984821995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d80ce400 con 0x7fc3d8072e60 2024-09-11T22:13:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.765+0000 7fc3dd98d640 1 -- 172.21.15.50:0/2984821995 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d80ceca0 con 0x7fc3d8072e60 2024-09-11T22:13:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.767+0000 7fc3bffff640 1 -- 172.21.15.50:0/2984821995 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3cc00c670 con 0x7fc3d8072e60 2024-09-11T22:13:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.767+0000 7fc3bffff640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc3c406be30 0x7fc3c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.767+0000 7fc3bffff640 1 -- 172.21.15.50:0/2984821995 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fc3cc08ab90 con 0x7fc3d8072e60 2024-09-11T22:13:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.768+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc3c406be30 0x7fc3c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.768+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc3c406be30 0x7fc3c406e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8034000 tx=0x7fc3c802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.768+0000 7fc3e0806740 1 Processor -- start 2024-09-11T22:13:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.768+0000 7fc3e0806740 1 -- start start 2024-09-11T22:13:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.769+0000 7fc3e0806740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b702816c0 0x556b70281aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.769+0000 7fc3e0806740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 0x556b70235d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.769+0000 7fc3e0806740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b7023cc60 0x556b7027ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.769+0000 7fc3e0806740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556b7019eaf0 con 0x556b7023cc60 2024-09-11T22:13:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.769+0000 7fc3e0806740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556b70146690 con 0x556b70238cc0 2024-09-11T22:13:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.769+0000 7fc3e0806740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556b7019aab0 con 0x556b702816c0 2024-09-11T22:13:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.769+0000 7fc3d77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b7023cc60 0x556b7027ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.769+0000 7fc3d77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b7023cc60 0x556b7027ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57680/0 (socket says 172.21.15.50:57680) 2024-09-11T22:13:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.769+0000 7fc3d77fe640 1 -- 172.21.15.50:0/3109827903 learned_addr learned my addr 172.21.15.50:0/3109827903 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.769+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/3109827903 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b702816c0 0x556b70281aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.769+0000 7fc3d67fc640 1 --2- 172.21.15.50:0/3109827903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 0x556b70235d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.770+0000 7fc3d77fe640 1 -- 172.21.15.50:0/3109827903 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b702816c0 msgr2=0x556b70281aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.770+0000 7fc3d77fe640 1 --2- 172.21.15.50:0/3109827903 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b702816c0 0x556b70281aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.770+0000 7fc3d77fe640 1 -- 172.21.15.50:0/3109827903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 msgr2=0x556b70235d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.770+0000 7fc3d77fe640 1 --2- 172.21.15.50:0/3109827903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 0x556b70235d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.770+0000 7fc3d77fe640 1 -- 172.21.15.50:0/3109827903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b6ff7db00 con 0x556b7023cc60 2024-09-11T22:13:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.770+0000 7fc3d77fe640 1 --2- 172.21.15.50:0/3109827903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b7023cc60 0x556b7027ea40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00073b0 tx=0x7fc3d0007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b746bd702eb963 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.770+0000 7fc3bd7fa640 1 -- 172.21.15.50:0/3109827903 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0019070 con 0x556b7023cc60 2024-09-11T22:13:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.770+0000 7fc3bd7fa640 1 -- 172.21.15.50:0/3109827903 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d0001e20 con 0x556b7023cc60 2024-09-11T22:13:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.770+0000 7fc3bd7fa640 1 -- 172.21.15.50:0/3109827903 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00112e0 con 0x556b7023cc60 2024-09-11T22:13:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.771+0000 7fc3e0806740 1 -- 172.21.15.50:0/3109827903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b7023cc60 msgr2=0x556b7027ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.771+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3109827903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b7023cc60 0x556b7027ea40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00073b0 tx=0x7fc3d0007870 comp rx=0 tx=0).stop 2024-09-11T22:13:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.771+0000 7fc3e0806740 1 -- 172.21.15.50:0/3109827903 shutdown_connections 2024-09-11T22:13:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.771+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3109827903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b7023cc60 0x556b7027ea40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.771+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3109827903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 0x556b70235d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.771+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3109827903 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b702816c0 0x556b70281aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.771+0000 7fc3e0806740 1 -- 172.21.15.50:0/3109827903 >> 172.21.15.50:0/3109827903 conn(0x556b70202890 msgr2=0x556b70280380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.771+0000 7fc3e0806740 1 -- 172.21.15.50:0/3109827903 shutdown_connections 2024-09-11T22:13:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.771+0000 7fc3e0806740 1 -- 172.21.15.50:0/3109827903 wait complete. 2024-09-11T22:13:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.771+0000 7fc3e0806740 1 -- start start 2024-09-11T22:13:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.771+0000 7fc3e0806740 1 Processor -- start 2024-09-11T22:13:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.772+0000 7fc3e0806740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 0x556b70265240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.772+0000 7fc3e0806740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b7023cc60 0x556b7027a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.772+0000 7fc3e0806740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 0x556b702624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.772+0000 7fc3e0806740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556b701278a0 con 0x556b702816c0 2024-09-11T22:13:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.772+0000 7fc3e0806740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556b702820a0 con 0x556b70238cc0 2024-09-11T22:13:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.772+0000 7fc3e0806740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556b702798e0 con 0x556b7023cc60 2024-09-11T22:13:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.772+0000 7fc3e0806740 10 client.0 _ll_register_callbacks cb 0x556b6feb0ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.772+0000 7fc3d77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 0x556b702624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.772+0000 7fc3d77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 0x556b702624c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57688/0 (socket says 172.21.15.50:57688) 2024-09-11T22:13:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.772+0000 7fc3d77fe640 1 -- 172.21.15.50:0/2755951036 learned_addr learned my addr 172.21.15.50:0/2755951036 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.772+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/2755951036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 0x556b70265240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.772+0000 7fc3d67fc640 1 --2- 172.21.15.50:0/2755951036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b7023cc60 0x556b7027a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3d77fe640 1 -- 172.21.15.50:0/2755951036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b7023cc60 msgr2=0x556b7027a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3d77fe640 1 --2- 172.21.15.50:0/2755951036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b7023cc60 0x556b7027a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3d77fe640 1 -- 172.21.15.50:0/2755951036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 msgr2=0x556b70265240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3d77fe640 1 --2- 172.21.15.50:0/2755951036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 0x556b70265240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3d77fe640 1 -- 172.21.15.50:0/2755951036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b6fe713f0 con 0x556b702816c0 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3d77fe640 1 --2- 172.21.15.50:0/2755951036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 0x556b702624c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0006fd0 tx=0x7fc3d0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf6505a76544637 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3b67fc640 1 -- 172.21.15.50:0/2755951036 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0023060 con 0x556b702816c0 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3b67fc640 1 -- 172.21.15.50:0/2755951036 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fc3d0014660 con 0x556b702816c0 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3e0806740 1 -- 172.21.15.50:0/2755951036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3d0001e20 con 0x556b702816c0 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3b67fc640 1 -- 172.21.15.50:0/2755951036 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc3d0029050 con 0x556b702816c0 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3e0806740 10 client.5481 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3e0806740 1 -- 172.21.15.50:0/2755951036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x556b6ffde290 con 0x556b702816c0 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3b67fc640 1 -- 172.21.15.50:0/2755951036 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d0001e20 con 0x556b702816c0 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.773+0000 7fc3b67fc640 1 -- 172.21.15.50:0/2755951036 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fc3d0014880 con 0x556b702816c0 2024-09-11T22:13:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.774+0000 7fc3e0806740 10 client.5481 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.774+0000 7fc3e0806740 10 client.5481 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.774+0000 7fc3e0806740 20 client.5481 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.774+0000 7fc3e0806740 1 --2- 172.21.15.50:0/2755951036 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x556b7027aa00 0x556b7027c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.774+0000 7fc3e0806740 4 client.5481 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.774+0000 7fc3e0806740 1 -- 172.21.15.50:0/2755951036 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b701ac220 con 0x556b7027aa00 2024-09-11T22:13:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.774+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/2755951036 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x556b7027aa00 0x556b7027c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.774+0000 7fc3b67fc640 10 client.5481 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.774+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/2755951036 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x556b7027aa00 0x556b7027c760 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f82fc29a2e6720e0 server_cookie=3393570d4e23ca9b in_seq=0 out_seq=0 2024-09-11T22:13:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3b67fc640 1 -- 172.21.15.50:0/2755951036 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b701ac220 con 0x556b7027aa00 2024-09-11T22:13:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3b67fc640 10 client.5481 handle_command_reply: tid=0 2024-09-11T22:13:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3e0806740 1 client.5481 shutdown 2024-09-11T22:13:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3e0806740 1 -- 172.21.15.50:0/2755951036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 msgr2=0x556b702624c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3e0806740 1 --2- 172.21.15.50:0/2755951036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 0x556b702624c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0006fd0 tx=0x7fc3d0007d90 comp rx=0 tx=0).stop 2024-09-11T22:13:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3e0806740 1 -- 172.21.15.50:0/2755951036 shutdown_connections 2024-09-11T22:13:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3e0806740 1 --2- 172.21.15.50:0/2755951036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b7023cc60 0x556b7027a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3e0806740 1 --2- 172.21.15.50:0/2755951036 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x556b7027aa00 0x556b7027c760 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3e0806740 1 --2- 172.21.15.50:0/2755951036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 0x556b702624c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3e0806740 1 --2- 172.21.15.50:0/2755951036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 0x556b70265240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3b67fc640 0 client.5481 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3e0806740 1 -- 172.21.15.50:0/2755951036 >> 172.21.15.50:0/2755951036 conn(0x556b70202890 msgr2=0x556b7023b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3e0806740 1 -- 172.21.15.50:0/2755951036 shutdown_connections 2024-09-11T22:13:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3e0806740 1 -- 172.21.15.50:0/2755951036 wait complete. 2024-09-11T22:13:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.775+0000 7fc3e0806740 20 client.5481 trim_cache size 0 max 16384 2024-09-11T22:13:55.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.793+0000 7fc3e0806740 1 Processor -- start 2024-09-11T22:13:55.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.793+0000 7fc3e0806740 1 -- start start 2024-09-11T22:13:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.793+0000 7fc3e0806740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b70238cc0 0x556b70231790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.793+0000 7fc3e0806740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b7023cc60 0x556b70280170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.793+0000 7fc3e0806740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b702816c0 0x556b70283900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.793+0000 7fc3e0806740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d8200ac0 con 0x556b70238cc0 2024-09-11T22:13:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.793+0000 7fc3e0806740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d81ffac0 con 0x556b7023cc60 2024-09-11T22:13:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.793+0000 7fc3e0806740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d81fee20 con 0x556b702816c0 2024-09-11T22:13:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.794+0000 7fc3d6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b70238cc0 0x556b70231790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.794+0000 7fc3d6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b70238cc0 0x556b70231790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57694/0 (socket says 172.21.15.50:57694) 2024-09-11T22:13:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.794+0000 7fc3d6ffd640 1 -- 172.21.15.50:0/3642824398 learned_addr learned my addr 172.21.15.50:0/3642824398 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.794+0000 7fc3d6ffd640 1 -- 172.21.15.50:0/3642824398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b702816c0 msgr2=0x556b70283900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.794+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/3642824398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b702816c0 0x556b70283900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.794+0000 7fc3d6ffd640 1 -- 172.21.15.50:0/3642824398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b7023cc60 msgr2=0x556b70280170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.794+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/3642824398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b7023cc60 0x556b70280170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.794+0000 7fc3d6ffd640 1 -- 172.21.15.50:0/3642824398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7027a830 con 0x556b70238cc0 2024-09-11T22:13:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.794+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/3642824398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b70238cc0 0x556b70231790 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc3c803e040 tx=0x7fc3c802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72409ff218bcde1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.794+0000 7fc3bcff9640 1 -- 172.21.15.50:0/3642824398 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8037040 con 0x556b70238cc0 2024-09-11T22:13:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.794+0000 7fc3bcff9640 1 -- 172.21.15.50:0/3642824398 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c8056070 con 0x556b70238cc0 2024-09-11T22:13:55.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.794+0000 7fc3bcff9640 1 -- 172.21.15.50:0/3642824398 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c80514d0 con 0x556b70238cc0 2024-09-11T22:13:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.795+0000 7fc3e0806740 1 -- 172.21.15.50:0/3642824398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b70238cc0 msgr2=0x556b70231790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.795+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3642824398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b70238cc0 0x556b70231790 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc3c803e040 tx=0x7fc3c802c000 comp rx=0 tx=0).stop 2024-09-11T22:13:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.795+0000 7fc3e0806740 1 -- 172.21.15.50:0/3642824398 shutdown_connections 2024-09-11T22:13:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.795+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3642824398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b702816c0 0x556b70283900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.795+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3642824398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b7023cc60 0x556b70280170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.795+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3642824398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b70238cc0 0x556b70231790 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.795+0000 7fc3e0806740 1 -- 172.21.15.50:0/3642824398 >> 172.21.15.50:0/3642824398 conn(0x556b70202890 msgr2=0x556b7027f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.795+0000 7fc3e0806740 1 -- 172.21.15.50:0/3642824398 shutdown_connections 2024-09-11T22:13:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.795+0000 7fc3e0806740 1 -- 172.21.15.50:0/3642824398 wait complete. 2024-09-11T22:13:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.795+0000 7fc3e0806740 1 -- start start 2024-09-11T22:13:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.796+0000 7fc3e0806740 1 Processor -- start 2024-09-11T22:13:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.796+0000 7fc3e0806740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 0x556b702fda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.796+0000 7fc3e0806740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b7023cc60 0x556b7027cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.796+0000 7fc3e0806740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 0x556b7027d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.796+0000 7fc3e0806740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d81ff470 con 0x556b702816c0 2024-09-11T22:13:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.796+0000 7fc3e0806740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556b701d85c0 con 0x556b70238cc0 2024-09-11T22:13:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.796+0000 7fc3e0806740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556b702fe400 con 0x556b7023cc60 2024-09-11T22:13:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.796+0000 7fc3e0806740 10 client.0 _ll_register_callbacks cb 0x7fc3d0017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.796+0000 7fc3d77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 0x556b7027d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.796+0000 7fc3d77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 0x556b7027d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57702/0 (socket says 172.21.15.50:57702) 2024-09-11T22:13:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.796+0000 7fc3d77fe640 1 -- 172.21.15.50:0/3434991618 learned_addr learned my addr 172.21.15.50:0/3434991618 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.796+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/3434991618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 0x556b702fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.796+0000 7fc3d67fc640 1 --2- 172.21.15.50:0/3434991618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b7023cc60 0x556b7027cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3d77fe640 1 -- 172.21.15.50:0/3434991618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b7023cc60 msgr2=0x556b7027cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3d77fe640 1 --2- 172.21.15.50:0/3434991618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b7023cc60 0x556b7027cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3d77fe640 1 -- 172.21.15.50:0/3434991618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 msgr2=0x556b702fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3d77fe640 1 --2- 172.21.15.50:0/3434991618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 0x556b702fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3d77fe640 1 -- 172.21.15.50:0/3434991618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b6fe4a4b0 con 0x556b702816c0 2024-09-11T22:13:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3d77fe640 1 --2- 172.21.15.50:0/3434991618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 0x556b7027d100 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00012e0 tx=0x7fc3d0005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cef840e4e07ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3b67fc640 1 -- 172.21.15.50:0/3434991618 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0023030 con 0x556b702816c0 2024-09-11T22:13:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3b67fc640 1 -- 172.21.15.50:0/3434991618 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fc3d001e400 con 0x556b702816c0 2024-09-11T22:13:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3e0806740 1 -- 172.21.15.50:0/3434991618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3c8056070 con 0x556b702816c0 2024-09-11T22:13:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3b67fc640 1 -- 172.21.15.50:0/3434991618 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc3d003b050 con 0x556b702816c0 2024-09-11T22:13:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3e0806740 10 client.5487 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3e0806740 1 -- 172.21.15.50:0/3434991618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x556b702a44e0 con 0x556b702816c0 2024-09-11T22:13:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.797+0000 7fc3b67fc640 1 -- 172.21.15.50:0/3434991618 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c8056070 con 0x556b702816c0 2024-09-11T22:13:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.798+0000 7fc3b67fc640 1 -- 172.21.15.50:0/3434991618 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fc3d003e020 con 0x556b702816c0 2024-09-11T22:13:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.798+0000 7fc3e0806740 10 client.5487 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.798+0000 7fc3e0806740 10 client.5487 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.798+0000 7fc3e0806740 20 client.5487 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.798+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3434991618 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x556b702fdfa0 0x556b7028eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.798+0000 7fc3e0806740 4 client.5487 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-11T22:13:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.798+0000 7fc3e0806740 1 -- 172.21.15.50:0/3434991618 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x556b701a6570 con 0x556b702fdfa0 2024-09-11T22:13:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.798+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/3434991618 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x556b702fdfa0 0x556b7028eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.798+0000 7fc3b67fc640 10 client.5487 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.798+0000 7fc3d6ffd640 1 --2- 172.21.15.50:0/3434991618 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x556b702fdfa0 0x556b7028eba0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfe2a2b430c8dbd1 server_cookie=88b88cdcf57026ab in_seq=0 out_seq=0 2024-09-11T22:13:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3b67fc640 1 -- 172.21.15.50:0/3434991618 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556b701a6570 con 0x556b702fdfa0 2024-09-11T22:13:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3b67fc640 10 client.5487 handle_command_reply: tid=0 2024-09-11T22:13:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3e0806740 1 client.5487 shutdown 2024-09-11T22:13:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3e0806740 1 -- 172.21.15.50:0/3434991618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 msgr2=0x556b7027d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3434991618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 0x556b7027d100 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00012e0 tx=0x7fc3d0005e10 comp rx=0 tx=0).stop 2024-09-11T22:13:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3e0806740 1 -- 172.21.15.50:0/3434991618 shutdown_connections 2024-09-11T22:13:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3434991618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556b7023cc60 0x556b7027cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3434991618 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x556b702fdfa0 0x556b7028eba0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3434991618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556b702816c0 0x556b7027d100 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3e0806740 1 --2- 172.21.15.50:0/3434991618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556b70238cc0 0x556b702fda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3e0806740 1 -- 172.21.15.50:0/3434991618 >> 172.21.15.50:0/3434991618 conn(0x556b70202890 msgr2=0x556b70283900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3b67fc640 0 client.5487 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3e0806740 1 -- 172.21.15.50:0/3434991618 shutdown_connections 2024-09-11T22:13:55.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3e0806740 1 -- 172.21.15.50:0/3434991618 wait complete. 2024-09-11T22:13:55.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3e0806740 20 client.5487 trim_cache size 0 max 16384 2024-09-11T22:13:55.805 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:55.805 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:13:55.805 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "779e4ba0-193f-4242-9e22-b428b59a90a3", 2024-09-11T22:13:55.805 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:13:55.805 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:55.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3dd98d640 1 -- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc3c406be30 msgr2=0x7fc3c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3dd98d640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc3c406be30 0x7fc3c406e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8034000 tx=0x7fc3c802e000 comp rx=0 tx=0).stop 2024-09-11T22:13:55.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3dd98d640 1 -- 172.21.15.50:0/2984821995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3d8072e60 msgr2=0x7fc3d80cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3dd98d640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3d8072e60 0x7fc3d80cdac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00e7e0 tx=0x7fc3cc00eca0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3dd98d640 1 -- 172.21.15.50:0/2984821995 shutdown_connections 2024-09-11T22:13:55.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.799+0000 7fc3dd98d640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc3c406be30 0x7fc3c406e2f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.800+0000 7fc3dd98d640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3d815b400 0x7fc3d80b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.800+0000 7fc3dd98d640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3d8072e60 0x7fc3d80cdac0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.800+0000 7fc3dd98d640 1 --2- 172.21.15.50:0/2984821995 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3d806df20 0x7fc3d8151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.800+0000 7fc3dd98d640 1 -- 172.21.15.50:0/2984821995 >> 172.21.15.50:0/2984821995 conn(0x7fc3d80679c0 msgr2=0x7fc3d80cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.800+0000 7fc3dd98d640 1 -- 172.21.15.50:0/2984821995 shutdown_connections 2024-09-11T22:13:55.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.800+0000 7fc3dd98d640 1 -- 172.21.15.50:0/2984821995 wait complete. 2024-09-11T22:13:55.811 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '779e4ba0-193f-4242-9e22-b428b59a90a3', 'mode': 'asynchronous'}' 2024-09-11T22:13:55.811 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-11T22:13:55.811 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-11T22:13:55.811 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-11T22:13:55.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.915+0000 7fa30830a640 1 Processor -- start 2024-09-11T22:13:55.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.915+0000 7fa30830a640 1 -- start start 2024-09-11T22:13:55.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.916+0000 7fa30830a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa3000b03a0 0x7fa3001677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.916+0000 7fa30830a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3000d1280 con 0x7fa3000b3a40 2024-09-11T22:13:55.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.916+0000 7fa30830a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3000b2890 con 0x7fa30015ffb0 2024-09-11T22:13:55.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.916+0000 7fa30830a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa3000b2b70 con 0x7fa3000b03a0 2024-09-11T22:13:55.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.916+0000 7fa3058a5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa3000b3a40 0x7fa3000d0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52808/0 (socket says 172.21.15.50:52808) 2024-09-11T22:13:55.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.916+0000 7fa3058a5640 1 -- 172.21.15.50:0/3626354237 learned_addr learned my addr 172.21.15.50:0/3626354237 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:55.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.917+0000 7fa3068a7640 1 --2- 172.21.15.50:0/3626354237 >> v2:172.21.15.77:3300/0 conn(0x7fa3000b03a0 0x7fa3001677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.917+0000 7fa3050a4640 1 -- 172.21.15.50:0/3626354237 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3129047773 0 0) 0x7fa3000d1280 con 0x7fa3000b3a40 2024-09-11T22:13:55.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.917+0000 7fa3050a4640 1 -- 172.21.15.50:0/3626354237 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2ec003520 con 0x7fa3000b3a40 2024-09-11T22:13:55.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.917+0000 7fa3068a7640 1 -- 172.21.15.50:0/3626354237 >> v1:172.21.15.77:6789/0 conn(0x7fa30015ffb0 legacy=0x7fa3000d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.917+0000 7fa3068a7640 1 -- 172.21.15.50:0/3626354237 >> v1:172.21.15.50:6789/0 conn(0x7fa3000b3a40 legacy=0x7fa3000d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.917+0000 7fa3050a4640 1 -- 172.21.15.50:0/3626354237 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1478931226 0 0) 0x7fa3000b2890 con 0x7fa30015ffb0 2024-09-11T22:13:55.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.917+0000 7fa3068a7640 1 -- 172.21.15.50:0/3626354237 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3000b2e50 con 0x7fa3000b03a0 2024-09-11T22:13:55.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.918+0000 7fa3068a7640 1 --2- 172.21.15.50:0/3626354237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3000b03a0 0x7fa3001677a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009d90 tx=0x7fa2f802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=638aba05434c02cb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.918+0000 7fa3050a4640 1 -- 172.21.15.50:0/3626354237 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8035020 con 0x7fa3000b03a0 2024-09-11T22:13:55.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.918+0000 7fa3050a4640 1 -- 172.21.15.50:0/3626354237 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f8007540 con 0x7fa3000b03a0 2024-09-11T22:13:55.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.918+0000 7fa3050a4640 1 -- 172.21.15.50:0/3626354237 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0001670 con 0x7fa3000b03a0 2024-09-11T22:13:55.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.918+0000 7fa30830a640 1 -- 172.21.15.50:0/3626354237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3000b03a0 msgr2=0x7fa3001677a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.918+0000 7fa30830a640 1 --2- 172.21.15.50:0/3626354237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3000b03a0 0x7fa3001677a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009d90 tx=0x7fa2f802a5d0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.918+0000 7fa30830a640 1 -- 172.21.15.50:0/3626354237 shutdown_connections 2024-09-11T22:13:55.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.918+0000 7fa30830a640 1 --2- 172.21.15.50:0/3626354237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3000b03a0 0x7fa3001677a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.918+0000 7fa30830a640 1 -- 172.21.15.50:0/3626354237 >> 172.21.15.50:0/3626354237 conn(0x7fa3000b40b0 msgr2=0x7fa3000b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.919+0000 7fa30830a640 1 -- 172.21.15.50:0/3626354237 shutdown_connections 2024-09-11T22:13:55.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.919+0000 7fa30830a640 1 -- 172.21.15.50:0/3626354237 wait complete. 2024-09-11T22:13:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.920+0000 7fa30830a640 1 Processor -- start 2024-09-11T22:13:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.920+0000 7fa30830a640 1 -- start start 2024-09-11T22:13:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.920+0000 7fa30830a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3000b03a0 0x7fa3001f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.920+0000 7fa30830a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa3000b3a40 0x7fa30015c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.920+0000 7fa30830a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa30015ffb0 0x7fa300155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.920+0000 7fa30830a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa300167ce0 con 0x7fa3000b03a0 2024-09-11T22:13:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.920+0000 7fa30830a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa3000d15c0 con 0x7fa30015ffb0 2024-09-11T22:13:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.920+0000 7fa30830a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa300167e60 con 0x7fa3000b3a40 2024-09-11T22:13:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa3060a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3000b03a0 0x7fa3001f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa3060a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3000b03a0 0x7fa3001f30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57712/0 (socket says 172.21.15.50:57712) 2024-09-11T22:13:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa3060a6640 1 -- 172.21.15.50:0/2283278444 learned_addr learned my addr 172.21.15.50:0/2283278444 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa3068a7640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa30015ffb0 0x7fa300155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa3058a5640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa3000b3a40 0x7fa30015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa3060a6640 1 -- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa3000b3a40 msgr2=0x7fa30015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa3060a6640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa3000b3a40 0x7fa30015c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa3060a6640 1 -- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa30015ffb0 msgr2=0x7fa300155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa3060a6640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa30015ffb0 0x7fa300155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa3060a6640 1 -- 172.21.15.50:0/2283278444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3001f35f0 con 0x7fa3000b03a0 2024-09-11T22:13:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa3060a6640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3000b03a0 0x7fa3001f30b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00c4b0 tx=0x7fa2fc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa2f6ffd640 1 -- 172.21.15.50:0/2283278444 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc017070 con 0x7fa3000b03a0 2024-09-11T22:13:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa2f6ffd640 1 -- 172.21.15.50:0/2283278444 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2fc005480 con 0x7fa3000b03a0 2024-09-11T22:13:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa2f6ffd640 1 -- 172.21.15.50:0/2283278444 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc003830 con 0x7fa3000b03a0 2024-09-11T22:13:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa30830a640 1 -- 172.21.15.50:0/2283278444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa300156960 con 0x7fa3000b03a0 2024-09-11T22:13:55.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.921+0000 7fa30830a640 1 -- 172.21.15.50:0/2283278444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa300156f20 con 0x7fa3000b03a0 2024-09-11T22:13:55.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.923+0000 7fa2f6ffd640 1 -- 172.21.15.50:0/2283278444 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2fc01a070 con 0x7fa3000b03a0 2024-09-11T22:13:55.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.923+0000 7fa2f6ffd640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa2e406be30 0x7fa2e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.923+0000 7fa2f6ffd640 1 -- 172.21.15.50:0/2283278444 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fa2fc08a1e0 con 0x7fa3000b03a0 2024-09-11T22:13:55.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.923+0000 7fa3058a5640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa2e406be30 0x7fa2e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.924+0000 7fa3058a5640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa2e406be30 0x7fa2e406e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0001600 tx=0x7fa2f0001570 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.924+0000 7fa30b0a0740 1 Processor -- start 2024-09-11T22:13:55.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.925+0000 7fa30b0a0740 1 -- start start 2024-09-11T22:13:55.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.925+0000 7fa30b0a0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e114d130 0x5572e114d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.925+0000 7fa30b0a0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1168b20 0x5572e1169fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.925+0000 7fa30b0a0740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1167330 0x5572e11677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.925+0000 7fa30b0a0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5572e1085870 con 0x5572e114d130 2024-09-11T22:13:55.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.925+0000 7fa30b0a0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5572e102d810 con 0x5572e1168b20 2024-09-11T22:13:55.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.925+0000 7fa30b0a0740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5572e1081830 con 0x5572e1167330 2024-09-11T22:13:55.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.925+0000 7fa3060a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e114d130 0x5572e114d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.925+0000 7fa3060a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e114d130 0x5572e114d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57722/0 (socket says 172.21.15.50:57722) 2024-09-11T22:13:55.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.925+0000 7fa3060a6640 1 -- 172.21.15.50:0/2519971468 learned_addr learned my addr 172.21.15.50:0/2519971468 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.926+0000 7fa3058a5640 1 --2- 172.21.15.50:0/2519971468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1168b20 0x5572e1169fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.926+0000 7fa3068a7640 1 --2- 172.21.15.50:0/2519971468 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1167330 0x5572e11677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.926+0000 7fa3060a6640 1 -- 172.21.15.50:0/2519971468 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1167330 msgr2=0x5572e11677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.926+0000 7fa3060a6640 1 --2- 172.21.15.50:0/2519971468 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1167330 0x5572e11677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.926+0000 7fa3060a6640 1 -- 172.21.15.50:0/2519971468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1168b20 msgr2=0x5572e1169fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.926+0000 7fa3060a6640 1 --2- 172.21.15.50:0/2519971468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1168b20 0x5572e1169fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.926+0000 7fa3060a6640 1 -- 172.21.15.50:0/2519971468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572e104c830 con 0x5572e114d130 2024-09-11T22:13:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.926+0000 7fa3060a6640 1 --2- 172.21.15.50:0/2519971468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e114d130 0x5572e114d510 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc060b00 tx=0x7fa2fc058640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221bfa78ad42b69e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.926+0000 7fa2e3fff640 1 -- 172.21.15.50:0/2519971468 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc070070 con 0x5572e114d130 2024-09-11T22:13:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.926+0000 7fa2e3fff640 1 -- 172.21.15.50:0/2519971468 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2fc054b70 con 0x5572e114d130 2024-09-11T22:13:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.926+0000 7fa2e3fff640 1 -- 172.21.15.50:0/2519971468 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc060da0 con 0x5572e114d130 2024-09-11T22:13:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.927+0000 7fa30b0a0740 1 -- 172.21.15.50:0/2519971468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e114d130 msgr2=0x5572e114d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.927+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/2519971468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e114d130 0x5572e114d510 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc060b00 tx=0x7fa2fc058640 comp rx=0 tx=0).stop 2024-09-11T22:13:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.927+0000 7fa30b0a0740 1 -- 172.21.15.50:0/2519971468 shutdown_connections 2024-09-11T22:13:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.927+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/2519971468 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1167330 0x5572e11677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.927+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/2519971468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1168b20 0x5572e1169fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.927+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/2519971468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e114d130 0x5572e114d510 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.927+0000 7fa30b0a0740 1 -- 172.21.15.50:0/2519971468 >> 172.21.15.50:0/2519971468 conn(0x5572e111f680 msgr2=0x5572e1167f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.927+0000 7fa30b0a0740 1 -- 172.21.15.50:0/2519971468 shutdown_connections 2024-09-11T22:13:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.927+0000 7fa30b0a0740 1 -- 172.21.15.50:0/2519971468 wait complete. 2024-09-11T22:13:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.927+0000 7fa30b0a0740 1 -- start start 2024-09-11T22:13:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.927+0000 7fa30b0a0740 1 Processor -- start 2024-09-11T22:13:55.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.928+0000 7fa30b0a0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 0x5572e1164f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.928+0000 7fa30b0a0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1168b20 0x5572e1177d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.928+0000 7fa30b0a0740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1150100 0x5572e11677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.928+0000 7fa30b0a0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5572e114da50 con 0x5572e1167330 2024-09-11T22:13:55.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.928+0000 7fa30b0a0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5572e100e9a0 con 0x5572e1168b20 2024-09-11T22:13:55.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.928+0000 7fa30b0a0740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5572e11242d0 con 0x5572e1150100 2024-09-11T22:13:55.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.928+0000 7fa30b0a0740 10 client.0 _ll_register_callbacks cb 0x5572e0d982b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:55.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa3060a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 0x5572e1164f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa3060a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 0x5572e1164f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57736/0 (socket says 172.21.15.50:57736) 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa3060a6640 1 -- 172.21.15.50:0/1002443079 learned_addr learned my addr 172.21.15.50:0/1002443079 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa3068a7640 1 --2- 172.21.15.50:0/1002443079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1150100 0x5572e11677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa3058a5640 1 --2- 172.21.15.50:0/1002443079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1168b20 0x5572e1177d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa3060a6640 1 -- 172.21.15.50:0/1002443079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1150100 msgr2=0x5572e11677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa3060a6640 1 --2- 172.21.15.50:0/1002443079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1150100 0x5572e11677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa3060a6640 1 -- 172.21.15.50:0/1002443079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1168b20 msgr2=0x5572e1177d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa3060a6640 1 --2- 172.21.15.50:0/1002443079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1168b20 0x5572e1177d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa3060a6640 1 -- 172.21.15.50:0/1002443079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572e0d7cac0 con 0x5572e1167330 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa3060a6640 1 --2- 172.21.15.50:0/1002443079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 0x5572e1164f10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc058490 tx=0x7fa2fc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a978184df129ab92 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa2e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa2e17fa640 1 -- 172.21.15.50:0/1002443079 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc075060 con 0x5572e1167330 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa2e17fa640 1 -- 172.21.15.50:0/1002443079 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fa2fc088320 con 0x5572e1167330 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa30b0a0740 1 -- 172.21.15.50:0/1002443079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2fc054b70 con 0x5572e1167330 2024-09-11T22:13:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa2e17fa640 1 -- 172.21.15.50:0/1002443079 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa2fc070040 con 0x5572e1167330 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa30b0a0740 10 client.5499 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa30b0a0740 1 -- 172.21.15.50:0/1002443079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5572e0d98ac0 con 0x5572e1167330 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.929+0000 7fa2e17fa640 1 -- 172.21.15.50:0/1002443079 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2fc054b70 con 0x5572e1167330 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.930+0000 7fa2e17fa640 1 -- 172.21.15.50:0/1002443079 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fa2fc0772b0 con 0x5572e1167330 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.930+0000 7fa30b0a0740 10 client.5499 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.930+0000 7fa30b0a0740 10 client.5499 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.930+0000 7fa30b0a0740 20 client.5499 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.930+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/1002443079 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5572e117ba00 0x5572e117be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.930+0000 7fa30b0a0740 4 client.5499 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.930+0000 7fa30b0a0740 1 -- 172.21.15.50:0/1002443079 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572e1092fa0 con 0x5572e117ba00 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.930+0000 7fa3058a5640 1 --2- 172.21.15.50:0/1002443079 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5572e117ba00 0x5572e117be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.930+0000 7fa2e17fa640 10 client.5499 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.930+0000 7fa3058a5640 1 --2- 172.21.15.50:0/1002443079 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5572e117ba00 0x5572e117be00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd1c3e0a9dec5f5a server_cookie=aee05a695b20df91 in_seq=0 out_seq=0 2024-09-11T22:13:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa2e17fa640 1 -- 172.21.15.50:0/1002443079 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572e1092fa0 con 0x5572e117ba00 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa2e17fa640 10 client.5499 handle_command_reply: tid=0 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa30b0a0740 1 client.5499 shutdown 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa30b0a0740 1 -- 172.21.15.50:0/1002443079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 msgr2=0x5572e1164f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/1002443079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 0x5572e1164f10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc058490 tx=0x7fa2fc000ed0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa30b0a0740 1 -- 172.21.15.50:0/1002443079 shutdown_connections 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/1002443079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1150100 0x5572e11677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/1002443079 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5572e117ba00 0x5572e117be00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/1002443079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1168b20 0x5572e1177d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa2e17fa640 0 client.5499 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/1002443079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 0x5572e1164f10 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa30b0a0740 1 -- 172.21.15.50:0/1002443079 >> 172.21.15.50:0/1002443079 conn(0x5572e114d130 msgr2=0x5572e1169020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa30b0a0740 1 -- 172.21.15.50:0/1002443079 shutdown_connections 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa30b0a0740 1 -- 172.21.15.50:0/1002443079 wait complete. 2024-09-11T22:13:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.931+0000 7fa30b0a0740 20 client.5499 trim_cache size 0 max 16384 2024-09-11T22:13:55.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.946+0000 7fa30b0a0740 1 Processor -- start 2024-09-11T22:13:55.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.946+0000 7fa30b0a0740 1 -- start start 2024-09-11T22:13:55.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa30b0a0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1150100 0x5572e1182290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa30b0a0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 0x5572e118c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa30b0a0740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1168b20 0x5572e1122f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa30b0a0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3001fe8f0 con 0x5572e1167330 2024-09-11T22:13:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa30b0a0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa3001fd8d0 con 0x5572e1150100 2024-09-11T22:13:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa30b0a0740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa3000b8170 con 0x5572e1168b20 2024-09-11T22:13:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa3058a5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 0x5572e118c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa3058a5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 0x5572e118c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57748/0 (socket says 172.21.15.50:57748) 2024-09-11T22:13:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa3058a5640 1 -- 172.21.15.50:0/1084524888 learned_addr learned my addr 172.21.15.50:0/1084524888 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa3060a6640 1 --2- 172.21.15.50:0/1084524888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1150100 0x5572e1182290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa3068a7640 1 --2- 172.21.15.50:0/1084524888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1168b20 0x5572e1122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa3058a5640 1 -- 172.21.15.50:0/1084524888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1168b20 msgr2=0x5572e1122f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa3058a5640 1 --2- 172.21.15.50:0/1084524888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1168b20 0x5572e1122f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa3058a5640 1 -- 172.21.15.50:0/1084524888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1150100 msgr2=0x5572e1182290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa3058a5640 1 --2- 172.21.15.50:0/1084524888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1150100 0x5572e1182290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa3058a5640 1 -- 172.21.15.50:0/1084524888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572e0e64ed0 con 0x5572e1167330 2024-09-11T22:13:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa3068a7640 1 --2- 172.21.15.50:0/1084524888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1168b20 0x5572e1122f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.947+0000 7fa3058a5640 1 --2- 172.21.15.50:0/1084524888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 0x5572e118c1b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00011d0 tx=0x7fa2f0007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0076dc08f6a8ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.948+0000 7fa2e37fe640 1 -- 172.21.15.50:0/1084524888 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00133f0 con 0x5572e1167330 2024-09-11T22:13:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.948+0000 7fa2e37fe640 1 -- 172.21.15.50:0/1084524888 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f0013590 con 0x5572e1167330 2024-09-11T22:13:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.948+0000 7fa2e37fe640 1 -- 172.21.15.50:0/1084524888 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0013940 con 0x5572e1167330 2024-09-11T22:13:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.948+0000 7fa30b0a0740 1 -- 172.21.15.50:0/1084524888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 msgr2=0x5572e118c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.948+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/1084524888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 0x5572e118c1b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00011d0 tx=0x7fa2f0007000 comp rx=0 tx=0).stop 2024-09-11T22:13:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.948+0000 7fa30b0a0740 1 -- 172.21.15.50:0/1084524888 shutdown_connections 2024-09-11T22:13:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.948+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/1084524888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1168b20 0x5572e1122f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.948+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/1084524888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1167330 0x5572e118c1b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.948+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/1084524888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1150100 0x5572e1182290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.948+0000 7fa30b0a0740 1 -- 172.21.15.50:0/1084524888 >> 172.21.15.50:0/1084524888 conn(0x5572e114d130 msgr2=0x5572e1118800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.948+0000 7fa30b0a0740 1 -- 172.21.15.50:0/1084524888 shutdown_connections 2024-09-11T22:13:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.948+0000 7fa30b0a0740 1 -- 172.21.15.50:0/1084524888 wait complete. 2024-09-11T22:13:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.949+0000 7fa30b0a0740 1 -- start start 2024-09-11T22:13:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.949+0000 7fa30b0a0740 1 Processor -- start 2024-09-11T22:13:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa30b0a0740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1150100 0x5572e1150c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa30b0a0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1167330 0x5572e11230f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa30b0a0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1168b20 0x5572e11cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa30b0a0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3001fd280 con 0x5572e1168b20 2024-09-11T22:13:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa30b0a0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5572e114dde0 con 0x5572e1167330 2024-09-11T22:13:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa30b0a0740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5572e1160af0 con 0x5572e1150100 2024-09-11T22:13:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa30b0a0740 10 client.0 _ll_register_callbacks cb 0x7fa2fc084070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa3068a7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1168b20 0x5572e11cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa3068a7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1168b20 0x5572e11cf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57762/0 (socket says 172.21.15.50:57762) 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa3068a7640 1 -- 172.21.15.50:0/245057480 learned_addr learned my addr 172.21.15.50:0/245057480 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa3058a5640 1 --2- 172.21.15.50:0/245057480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1167330 0x5572e11230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa3060a6640 1 --2- 172.21.15.50:0/245057480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1150100 0x5572e1150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa3068a7640 1 -- 172.21.15.50:0/245057480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1150100 msgr2=0x5572e1150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa3068a7640 1 --2- 172.21.15.50:0/245057480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1150100 0x5572e1150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa3068a7640 1 -- 172.21.15.50:0/245057480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1167330 msgr2=0x5572e11230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa3068a7640 1 --2- 172.21.15.50:0/245057480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1167330 0x5572e11230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.950+0000 7fa3068a7640 1 -- 172.21.15.50:0/245057480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572e1136d50 con 0x5572e1168b20 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa3068a7640 1 --2- 172.21.15.50:0/245057480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1168b20 0x5572e11cf3f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8034040 tx=0x7fa2f8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effabb8aac75dde server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa2e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa2e17fa640 1 -- 172.21.15.50:0/245057480 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8035040 con 0x5572e1168b20 2024-09-11T22:13:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa2e17fa640 1 -- 172.21.15.50:0/245057480 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fa2f8003990 con 0x5572e1168b20 2024-09-11T22:13:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa30b0a0740 1 -- 172.21.15.50:0/245057480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2f0013590 con 0x5572e1168b20 2024-09-11T22:13:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa2e17fa640 1 -- 172.21.15.50:0/245057480 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa2f8052050 con 0x5572e1168b20 2024-09-11T22:13:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa30b0a0740 10 client.5505 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa30b0a0740 1 -- 172.21.15.50:0/245057480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5572e11e75b0 con 0x5572e1168b20 2024-09-11T22:13:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa2e17fa640 1 -- 172.21.15.50:0/245057480 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f0013590 con 0x5572e1168b20 2024-09-11T22:13:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa2e17fa640 1 -- 172.21.15.50:0/245057480 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fa2f8055020 con 0x5572e1168b20 2024-09-11T22:13:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa30b0a0740 10 client.5505 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa30b0a0740 10 client.5505 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa30b0a0740 20 client.5505 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/245057480 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5572e11cf930 0x5572e1137200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:55.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa30b0a0740 4 client.5505 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-11T22:13:55.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa30b0a0740 1 -- 172.21.15.50:0/245057480 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x5572e108d2f0 con 0x5572e11cf930 2024-09-11T22:13:55.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.951+0000 7fa3060a6640 1 --2- 172.21.15.50:0/245057480 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5572e11cf930 0x5572e1137200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:55.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.952+0000 7fa2e17fa640 10 client.5505 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.952+0000 7fa3060a6640 1 --2- 172.21.15.50:0/245057480 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5572e11cf930 0x5572e1137200 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9902ca5aa8949a4 server_cookie=30b2cebd937b7087 in_seq=0 out_seq=0 2024-09-11T22:13:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.954+0000 7fa2e17fa640 1 -- 172.21.15.50:0/245057480 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5572e108d2f0 con 0x5572e11cf930 2024-09-11T22:13:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.954+0000 7fa2e17fa640 10 client.5505 handle_command_reply: tid=0 2024-09-11T22:13:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.954+0000 7fa30b0a0740 1 client.5505 shutdown 2024-09-11T22:13:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.954+0000 7fa30b0a0740 1 -- 172.21.15.50:0/245057480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1168b20 msgr2=0x5572e11cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.954+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/245057480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1168b20 0x5572e11cf3f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8034040 tx=0x7fa2f8004ab0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.954+0000 7fa30b0a0740 1 -- 172.21.15.50:0/245057480 shutdown_connections 2024-09-11T22:13:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.954+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/245057480 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5572e11cf930 0x5572e1137200 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.954+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/245057480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572e1168b20 0x5572e11cf3f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.954+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/245057480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5572e1167330 0x5572e11230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30b0a0740 1 --2- 172.21.15.50:0/245057480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5572e1150100 0x5572e1150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.954+0000 7fa2e17fa640 0 client.5505 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30b0a0740 1 -- 172.21.15.50:0/245057480 >> 172.21.15.50:0/245057480 conn(0x5572e114d130 msgr2=0x5572e1120640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30b0a0740 1 -- 172.21.15.50:0/245057480 shutdown_connections 2024-09-11T22:13:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30b0a0740 1 -- 172.21.15.50:0/245057480 wait complete. 2024-09-11T22:13:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30b0a0740 20 client.5505 trim_cache size 0 max 16384 2024-09-11T22:13:55.959 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:13:55.959 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:13:55.959 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30830a640 1 -- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa2e406be30 msgr2=0x7fa2e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30830a640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa2e406be30 0x7fa2e406e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0001600 tx=0x7fa2f0001570 comp rx=0 tx=0).stop 2024-09-11T22:13:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30830a640 1 -- 172.21.15.50:0/2283278444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3000b03a0 msgr2=0x7fa3001f30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30830a640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3000b03a0 0x7fa3001f30b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00c4b0 tx=0x7fa2fc00c970 comp rx=0 tx=0).stop 2024-09-11T22:13:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30830a640 1 -- 172.21.15.50:0/2283278444 shutdown_connections 2024-09-11T22:13:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30830a640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa2e406be30 0x7fa2e406e2f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30830a640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa3000b3a40 0x7fa30015c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30830a640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa30015ffb0 0x7fa300155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30830a640 1 --2- 172.21.15.50:0/2283278444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3000b03a0 0x7fa3001f30b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30830a640 1 -- 172.21.15.50:0/2283278444 >> 172.21.15.50:0/2283278444 conn(0x7fa3000b40b0 msgr2=0x7fa30006fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30830a640 1 -- 172.21.15.50:0/2283278444 shutdown_connections 2024-09-11T22:13:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:55.955+0000 7fa30830a640 1 -- 172.21.15.50:0/2283278444 wait complete. 2024-09-11T22:13:55.967 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'message': '', 'return_code': 0}' 2024-09-11T22:13:55.967 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-11T22:13:55.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-11T22:13:56.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.072+0000 7f4b8e1f6640 1 Processor -- start 2024-09-11T22:13:56.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.072+0000 7f4b8e1f6640 1 -- start start 2024-09-11T22:13:56.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.073+0000 7f4b8e1f6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b8815f350 0x7f4b8815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.073+0000 7f4b8e1f6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4b880679c0 0x7f4b88067e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.073+0000 7f4b8e1f6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b8815f7f0 con 0x7f4b8815c3c0 2024-09-11T22:13:56.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.073+0000 7f4b8e1f6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4b8806e700 con 0x7f4b880679c0 2024-09-11T22:13:56.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.073+0000 7f4b8e1f6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4b8815fad0 con 0x7f4b8815f350 2024-09-11T22:13:56.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.073+0000 7f4b87fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4b880679c0 0x7f4b88067e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.073+0000 7f4b87fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4b880679c0 0x7f4b88067e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57778/0 (socket says 172.21.15.50:57778) 2024-09-11T22:13:56.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.073+0000 7f4b87fff640 1 -- 172.21.15.50:0/3311069355 learned_addr learned my addr 172.21.15.50:0/3311069355 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.073+0000 7f4b86ffd640 1 --2- 172.21.15.50:0/3311069355 >> v2:172.21.15.77:3300/0 conn(0x7f4b8815f350 0x7f4b8815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.073+0000 7f4b87fff640 1 -- 172.21.15.50:0/3311069355 >> v2:172.21.15.77:3300/0 conn(0x7f4b8815f350 msgr2=0x7f4b8815fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.073+0000 7f4b87fff640 1 --2- 172.21.15.50:0/3311069355 >> v2:172.21.15.77:3300/0 conn(0x7f4b8815f350 0x7f4b8815fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.073+0000 7f4b87fff640 1 -- 172.21.15.50:0/3311069355 >> v1:172.21.15.77:6789/0 conn(0x7f4b8815c3c0 legacy=0x7f4b8815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.073+0000 7f4b87fff640 1 -- 172.21.15.50:0/3311069355 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8806e950 con 0x7f4b880679c0 2024-09-11T22:13:56.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.074+0000 7f4b87fff640 1 --2- 172.21.15.50:0/3311069355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b880679c0 0x7f4b88067e50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4b8806e650 tx=0x7f4b8002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48f26c2f23aca5c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.074+0000 7f4b867fc640 1 -- 172.21.15.50:0/3311069355 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80036070 con 0x7f4b880679c0 2024-09-11T22:13:56.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.074+0000 7f4b867fc640 1 -- 172.21.15.50:0/3311069355 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b80031600 con 0x7f4b880679c0 2024-09-11T22:13:56.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.074+0000 7f4b867fc640 1 -- 172.21.15.50:0/3311069355 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b800319d0 con 0x7f4b880679c0 2024-09-11T22:13:56.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.075+0000 7f4b8e1f6640 1 -- 172.21.15.50:0/3311069355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b880679c0 msgr2=0x7f4b88067e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.075+0000 7f4b8e1f6640 1 --2- 172.21.15.50:0/3311069355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b880679c0 0x7f4b88067e50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4b8806e650 tx=0x7f4b8002a660 comp rx=0 tx=0).stop 2024-09-11T22:13:56.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.075+0000 7f4b8e1f6640 1 -- 172.21.15.50:0/3311069355 shutdown_connections 2024-09-11T22:13:56.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.075+0000 7f4b8e1f6640 1 --2- 172.21.15.50:0/3311069355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b880679c0 0x7f4b88067e50 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.075+0000 7f4b8e1f6640 1 --2- 172.21.15.50:0/3311069355 >> v2:172.21.15.77:3300/0 conn(0x7f4b8815f350 0x7f4b8815fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.075+0000 7f4b8e1f6640 1 -- 172.21.15.50:0/3311069355 >> 172.21.15.50:0/3311069355 conn(0x7f4b88075060 msgr2=0x7f4b8806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.075+0000 7f4b8e1f6640 1 -- 172.21.15.50:0/3311069355 shutdown_connections 2024-09-11T22:13:56.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.075+0000 7f4b8e1f6640 1 -- 172.21.15.50:0/3311069355 wait complete. 2024-09-11T22:13:56.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.076+0000 7f4b8e1f6640 1 Processor -- start 2024-09-11T22:13:56.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.076+0000 7f4b8e1f6640 1 -- start start 2024-09-11T22:13:56.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.077+0000 7f4b8e1f6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b880679c0 0x7f4b881e6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.077+0000 7f4b8e1f6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b8815c3c0 0x7f4b88154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.077+0000 7f4b8e1f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b8815f350 0x7f4b880ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.077+0000 7f4b8e1f6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8806f150 con 0x7f4b8815f350 2024-09-11T22:13:56.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.077+0000 7f4b8e1f6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4b880d0940 con 0x7f4b880679c0 2024-09-11T22:13:56.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.077+0000 7f4b8e1f6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4b8806f2d0 con 0x7f4b8815c3c0 2024-09-11T22:13:56.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.077+0000 7f4b87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b8815f350 0x7f4b880ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.077+0000 7f4b87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b8815f350 0x7f4b880ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57780/0 (socket says 172.21.15.50:57780) 2024-09-11T22:13:56.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.077+0000 7f4b87fff640 1 -- 172.21.15.50:0/772776023 learned_addr learned my addr 172.21.15.50:0/772776023 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.077+0000 7f4b86ffd640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b8815c3c0 0x7f4b88154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.077+0000 7f4b877fe640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b880679c0 0x7f4b881e6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.078+0000 7f4b87fff640 1 -- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b8815c3c0 msgr2=0x7f4b88154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.078+0000 7f4b87fff640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b8815c3c0 0x7f4b88154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.078+0000 7f4b87fff640 1 -- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b880679c0 msgr2=0x7f4b881e6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.078+0000 7f4b87fff640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b880679c0 0x7f4b881e6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.078+0000 7f4b87fff640 1 -- 172.21.15.50:0/772776023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b88157c30 con 0x7f4b8815f350 2024-09-11T22:13:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.078+0000 7f4b87fff640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b8815f350 0x7f4b880ce370 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009f40 tx=0x7f4b80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.078+0000 7f4b6ffff640 1 -- 172.21.15.50:0/772776023 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80036050 con 0x7f4b8815f350 2024-09-11T22:13:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.078+0000 7f4b8e1f6640 1 -- 172.21.15.50:0/772776023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b881553d0 con 0x7f4b8815f350 2024-09-11T22:13:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.078+0000 7f4b6ffff640 1 -- 172.21.15.50:0/772776023 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b80042070 con 0x7f4b8815f350 2024-09-11T22:13:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.078+0000 7f4b6ffff640 1 -- 172.21.15.50:0/772776023 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80009510 con 0x7f4b8815f350 2024-09-11T22:13:56.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.078+0000 7f4b8e1f6640 1 -- 172.21.15.50:0/772776023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b881581b0 con 0x7f4b8815f350 2024-09-11T22:13:56.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.080+0000 7f4b6ffff640 1 -- 172.21.15.50:0/772776023 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b80007bd0 con 0x7f4b8815f350 2024-09-11T22:13:56.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.080+0000 7f4b6ffff640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b7406be30 0x7f4b7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.081+0000 7f4b6ffff640 1 -- 172.21.15.50:0/772776023 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f4b800abce0 con 0x7f4b8815f350 2024-09-11T22:13:56.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.081+0000 7f4b877fe640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b7406be30 0x7f4b7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.081+0000 7f4b877fe640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b7406be30 0x7f4b7406e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4b8815a390 tx=0x7f4b78007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.081+0000 7f4b9106d740 1 Processor -- start 2024-09-11T22:13:56.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.081+0000 7f4b9106d740 1 -- start start 2024-09-11T22:13:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.082+0000 7f4b9106d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7fa40 0x56410bac51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.082+0000 7f4b9106d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7d200 0x56410ba7fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.082+0000 7f4b9106d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410ba7a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.082+0000 7f4b9106d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56410b9e3c60 con 0x56410ba811d0 2024-09-11T22:13:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.082+0000 7f4b9106d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56410b98ba50 con 0x56410ba7fa40 2024-09-11T22:13:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.082+0000 7f4b9106d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56410b9dfc20 con 0x56410ba7d200 2024-09-11T22:13:56.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.082+0000 7f4b87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410ba7a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.082+0000 7f4b87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410ba7a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57788/0 (socket says 172.21.15.50:57788) 2024-09-11T22:13:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.082+0000 7f4b87fff640 1 -- 172.21.15.50:0/63079510 learned_addr learned my addr 172.21.15.50:0/63079510 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.083+0000 7f4b877fe640 1 --2- 172.21.15.50:0/63079510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7fa40 0x56410bac51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.083+0000 7f4b86ffd640 1 --2- 172.21.15.50:0/63079510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7d200 0x56410ba7fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.083+0000 7f4b87fff640 1 -- 172.21.15.50:0/63079510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7d200 msgr2=0x56410ba7fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.083+0000 7f4b87fff640 1 --2- 172.21.15.50:0/63079510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7d200 0x56410ba7fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.083+0000 7f4b87fff640 1 -- 172.21.15.50:0/63079510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7fa40 msgr2=0x56410bac51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.083+0000 7f4b87fff640 1 --2- 172.21.15.50:0/63079510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7fa40 0x56410bac51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.083+0000 7f4b87fff640 1 -- 172.21.15.50:0/63079510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56410b7c2f00 con 0x56410ba811d0 2024-09-11T22:13:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.083+0000 7f4b86ffd640 1 --2- 172.21.15.50:0/63079510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7d200 0x56410ba7fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.083+0000 7f4b87fff640 1 --2- 172.21.15.50:0/63079510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410ba7a030 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4b800aa140 tx=0x7f4b80076350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eacbcd44291c13b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.083+0000 7f4b6d7fa640 1 -- 172.21.15.50:0/63079510 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80031600 con 0x56410ba811d0 2024-09-11T22:13:56.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.083+0000 7f4b6d7fa640 1 -- 172.21.15.50:0/63079510 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b80037040 con 0x56410ba811d0 2024-09-11T22:13:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.083+0000 7f4b6d7fa640 1 -- 172.21.15.50:0/63079510 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80079f80 con 0x56410ba811d0 2024-09-11T22:13:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.084+0000 7f4b9106d740 1 -- 172.21.15.50:0/63079510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 msgr2=0x56410ba7a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.084+0000 7f4b9106d740 1 --2- 172.21.15.50:0/63079510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410ba7a030 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4b800aa140 tx=0x7f4b80076350 comp rx=0 tx=0).stop 2024-09-11T22:13:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.084+0000 7f4b9106d740 1 -- 172.21.15.50:0/63079510 shutdown_connections 2024-09-11T22:13:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.084+0000 7f4b9106d740 1 --2- 172.21.15.50:0/63079510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7d200 0x56410ba7fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.084+0000 7f4b9106d740 1 --2- 172.21.15.50:0/63079510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410ba7a030 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.084+0000 7f4b9106d740 1 --2- 172.21.15.50:0/63079510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7fa40 0x56410bac51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.084+0000 7f4b9106d740 1 -- 172.21.15.50:0/63079510 >> 172.21.15.50:0/63079510 conn(0x56410ba7c200 msgr2=0x56410bac46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.084+0000 7f4b9106d740 1 -- 172.21.15.50:0/63079510 shutdown_connections 2024-09-11T22:13:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.084+0000 7f4b9106d740 1 -- 172.21.15.50:0/63079510 wait complete. 2024-09-11T22:13:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.084+0000 7f4b9106d740 1 -- start start 2024-09-11T22:13:56.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.085+0000 7f4b9106d740 1 Processor -- start 2024-09-11T22:13:56.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.085+0000 7f4b9106d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba7fa40 0x56410ba9f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.085+0000 7f4b9106d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba811d0 0x56410ba9e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.085+0000 7f4b9106d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7e2b0 0x56410ba7e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.085+0000 7f4b9106d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56410b9e3c60 con 0x56410ba7fa40 2024-09-11T22:13:56.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.085+0000 7f4b9106d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56410b989cb0 con 0x56410ba811d0 2024-09-11T22:13:56.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.085+0000 7f4b9106d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56410ba7b6a0 con 0x56410ba7e2b0 2024-09-11T22:13:56.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.085+0000 7f4b9106d740 10 client.0 _ll_register_callbacks cb 0x56410b6f62e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:56.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.085+0000 7f4b877fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba7fa40 0x56410ba9f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b877fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba7fa40 0x56410ba9f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57804/0 (socket says 172.21.15.50:57804) 2024-09-11T22:13:56.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b877fe640 1 -- 172.21.15.50:0/2326605010 learned_addr learned my addr 172.21.15.50:0/2326605010 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b86ffd640 1 --2- 172.21.15.50:0/2326605010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba811d0 0x56410ba9e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b87fff640 1 --2- 172.21.15.50:0/2326605010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7e2b0 0x56410ba7e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b877fe640 1 -- 172.21.15.50:0/2326605010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7e2b0 msgr2=0x56410ba7e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b877fe640 1 --2- 172.21.15.50:0/2326605010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7e2b0 0x56410ba7e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b877fe640 1 -- 172.21.15.50:0/2326605010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba811d0 msgr2=0x56410ba9e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b877fe640 1 --2- 172.21.15.50:0/2326605010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba811d0 0x56410ba9e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b877fe640 1 -- 172.21.15.50:0/2326605010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56410b6b67f0 con 0x56410ba7fa40 2024-09-11T22:13:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b877fe640 1 --2- 172.21.15.50:0/2326605010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba7fa40 0x56410ba9f880 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4b78014730 tx=0x7f4b780036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca953c8eed585ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b667fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b667fc640 1 -- 172.21.15.50:0/2326605010 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78025020 con 0x56410ba7fa40 2024-09-11T22:13:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b667fc640 1 -- 172.21.15.50:0/2326605010 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f4b78015880 con 0x56410ba7fa40 2024-09-11T22:13:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b9106d740 1 -- 172.21.15.50:0/2326605010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b80037040 con 0x56410ba7fa40 2024-09-11T22:13:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b667fc640 1 -- 172.21.15.50:0/2326605010 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f4b7801b070 con 0x56410ba7fa40 2024-09-11T22:13:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b9106d740 10 client.5517 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b9106d740 1 -- 172.21.15.50:0/2326605010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x56410b823690 con 0x56410ba7fa40 2024-09-11T22:13:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.086+0000 7f4b667fc640 1 -- 172.21.15.50:0/2326605010 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b80037040 con 0x56410ba7fa40 2024-09-11T22:13:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.087+0000 7f4b667fc640 1 -- 172.21.15.50:0/2326605010 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f4b78015a80 con 0x56410ba7fa40 2024-09-11T22:13:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.087+0000 7f4b9106d740 10 client.5517 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.087+0000 7f4b9106d740 10 client.5517 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.087+0000 7f4b9106d740 20 client.5517 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.087+0000 7f4b9106d740 1 --2- 172.21.15.50:0/2326605010 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56410baa9990 0x56410baa9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.087+0000 7f4b9106d740 4 client.5517 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.087+0000 7f4b9106d740 1 -- 172.21.15.50:0/2326605010 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56410b9f1390 con 0x56410baa9990 2024-09-11T22:13:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.087+0000 7f4b86ffd640 1 --2- 172.21.15.50:0/2326605010 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56410baa9990 0x56410baa9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.087+0000 7f4b86ffd640 1 --2- 172.21.15.50:0/2326605010 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56410baa9990 0x56410baa9d70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0f6825f0bfbb34b server_cookie=8972b9eb704f991b in_seq=0 out_seq=0 2024-09-11T22:13:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.087+0000 7f4b667fc640 10 client.5517 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b667fc640 1 -- 172.21.15.50:0/2326605010 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56410b9f1390 con 0x56410baa9990 2024-09-11T22:13:56.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b667fc640 10 client.5517 handle_command_reply: tid=0 2024-09-11T22:13:56.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b9106d740 1 client.5517 shutdown 2024-09-11T22:13:56.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b9106d740 1 -- 172.21.15.50:0/2326605010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba7fa40 msgr2=0x56410ba9f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b9106d740 1 --2- 172.21.15.50:0/2326605010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba7fa40 0x56410ba9f880 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4b78014730 tx=0x7f4b780036f0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b9106d740 1 -- 172.21.15.50:0/2326605010 shutdown_connections 2024-09-11T22:13:56.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b9106d740 1 --2- 172.21.15.50:0/2326605010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7e2b0 0x56410ba7e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b9106d740 1 --2- 172.21.15.50:0/2326605010 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56410baa9990 0x56410baa9d70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b9106d740 1 --2- 172.21.15.50:0/2326605010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba811d0 0x56410ba9e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b9106d740 1 --2- 172.21.15.50:0/2326605010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba7fa40 0x56410ba9f880 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b667fc640 0 client.5517 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b9106d740 1 -- 172.21.15.50:0/2326605010 >> 172.21.15.50:0/2326605010 conn(0x56410ba7d200 msgr2=0x56410bac2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b9106d740 1 -- 172.21.15.50:0/2326605010 shutdown_connections 2024-09-11T22:13:56.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b9106d740 1 -- 172.21.15.50:0/2326605010 wait complete. 2024-09-11T22:13:56.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.088+0000 7f4b9106d740 20 client.5517 trim_cache size 0 max 16384 2024-09-11T22:13:56.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.106+0000 7f4b9106d740 1 Processor -- start 2024-09-11T22:13:56.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.106+0000 7f4b9106d740 1 -- start start 2024-09-11T22:13:56.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.106+0000 7f4b9106d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7e2b0 0x56410bb39300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.106+0000 7f4b9106d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7fa40 0x56410bac36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.106+0000 7f4b9106d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410bac3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b9106d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56410ba9fc40 con 0x56410ba811d0 2024-09-11T22:13:56.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b9106d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4b88200ec0 con 0x56410ba7e2b0 2024-09-11T22:13:56.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b9106d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4b88200040 con 0x56410ba7fa40 2024-09-11T22:13:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410bac3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410bac3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57808/0 (socket says 172.21.15.50:57808) 2024-09-11T22:13:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b87fff640 1 -- 172.21.15.50:0/576107630 learned_addr learned my addr 172.21.15.50:0/576107630 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b86ffd640 1 --2- 172.21.15.50:0/576107630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7fa40 0x56410bac36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b87fff640 1 -- 172.21.15.50:0/576107630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7fa40 msgr2=0x56410bac36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b877fe640 1 --2- 172.21.15.50:0/576107630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7e2b0 0x56410bb39300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b87fff640 1 --2- 172.21.15.50:0/576107630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7fa40 0x56410bac36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b87fff640 1 -- 172.21.15.50:0/576107630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7e2b0 msgr2=0x56410bb39300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b87fff640 1 --2- 172.21.15.50:0/576107630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7e2b0 0x56410bb39300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b87fff640 1 -- 172.21.15.50:0/576107630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56410b68f8b0 con 0x56410ba811d0 2024-09-11T22:13:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b86ffd640 1 --2- 172.21.15.50:0/576107630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7fa40 0x56410bac36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b877fe640 1 --2- 172.21.15.50:0/576107630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7e2b0 0x56410bb39300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b87fff640 1 --2- 172.21.15.50:0/576107630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410bac3c30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4b800aa220 tx=0x7f4b8007c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10e91ac22c4e91e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b6cff9640 1 -- 172.21.15.50:0/576107630 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80031600 con 0x56410ba811d0 2024-09-11T22:13:56.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b6cff9640 1 -- 172.21.15.50:0/576107630 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8007e280 con 0x56410ba811d0 2024-09-11T22:13:56.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.107+0000 7f4b6cff9640 1 -- 172.21.15.50:0/576107630 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80082ab0 con 0x56410ba811d0 2024-09-11T22:13:56.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.108+0000 7f4b9106d740 1 -- 172.21.15.50:0/576107630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 msgr2=0x56410bac3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.108+0000 7f4b9106d740 1 --2- 172.21.15.50:0/576107630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410bac3c30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4b800aa220 tx=0x7f4b8007c000 comp rx=0 tx=0).stop 2024-09-11T22:13:56.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.108+0000 7f4b9106d740 1 -- 172.21.15.50:0/576107630 shutdown_connections 2024-09-11T22:13:56.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.108+0000 7f4b9106d740 1 --2- 172.21.15.50:0/576107630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7fa40 0x56410bac36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.108+0000 7f4b9106d740 1 --2- 172.21.15.50:0/576107630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410bac3c30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.108+0000 7f4b9106d740 1 --2- 172.21.15.50:0/576107630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7e2b0 0x56410bb39300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.108+0000 7f4b9106d740 1 -- 172.21.15.50:0/576107630 >> 172.21.15.50:0/576107630 conn(0x56410ba7d200 msgr2=0x56410bae8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.108+0000 7f4b9106d740 1 -- 172.21.15.50:0/576107630 shutdown_connections 2024-09-11T22:13:56.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.108+0000 7f4b9106d740 1 -- 172.21.15.50:0/576107630 wait complete. 2024-09-11T22:13:56.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.109+0000 7f4b9106d740 1 -- start start 2024-09-11T22:13:56.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.109+0000 7f4b9106d740 1 Processor -- start 2024-09-11T22:13:56.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.109+0000 7f4b9106d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7e2b0 0x56410bb388c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.109+0000 7f4b9106d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7fa40 0x56410bae8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.109+0000 7f4b9106d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410bb36830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.109+0000 7f4b9106d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4b881eab70 con 0x56410ba811d0 2024-09-11T22:13:56.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.109+0000 7f4b9106d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4b881ea520 con 0x56410ba7e2b0 2024-09-11T22:13:56.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.109+0000 7f4b9106d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56410bac68c0 con 0x56410ba7fa40 2024-09-11T22:13:56.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b9106d740 10 client.0 _ll_register_callbacks cb 0x7f4b78003ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:56.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410bb36830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b877fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7e2b0 0x56410bb388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410bb36830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57814/0 (socket says 172.21.15.50:57814) 2024-09-11T22:13:56.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b877fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7e2b0 0x56410bb388c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:36162/0 (socket says 172.21.15.50:36162) 2024-09-11T22:13:56.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b87fff640 1 -- 172.21.15.50:0/1876806968 learned_addr learned my addr 172.21.15.50:0/1876806968 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b86ffd640 1 --2- 172.21.15.50:0/1876806968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7fa40 0x56410bae8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b87fff640 1 -- 172.21.15.50:0/1876806968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7fa40 msgr2=0x56410bae8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b87fff640 1 --2- 172.21.15.50:0/1876806968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7fa40 0x56410bae8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b87fff640 1 -- 172.21.15.50:0/1876806968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7e2b0 msgr2=0x56410bb388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b87fff640 1 --2- 172.21.15.50:0/1876806968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7e2b0 0x56410bb388c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b87fff640 1 -- 172.21.15.50:0/1876806968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56410badeb90 con 0x56410ba811d0 2024-09-11T22:13:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b87fff640 1 --2- 172.21.15.50:0/1876806968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410bb36830 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009f10 tx=0x7f4b80009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8006c630796477a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b667fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b667fc640 1 -- 172.21.15.50:0/1876806968 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80079f80 con 0x56410ba811d0 2024-09-11T22:13:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b667fc640 1 -- 172.21.15.50:0/1876806968 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f4b800a8040 con 0x56410ba811d0 2024-09-11T22:13:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b9106d740 1 -- 172.21.15.50:0/1876806968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b8007e280 con 0x56410ba811d0 2024-09-11T22:13:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b667fc640 1 -- 172.21.15.50:0/1876806968 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f4b80089050 con 0x56410ba811d0 2024-09-11T22:13:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b9106d740 10 client.5523 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.110+0000 7f4b9106d740 1 -- 172.21.15.50:0/1876806968 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x56410badeb90 con 0x56410ba811d0 2024-09-11T22:13:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.111+0000 7f4b667fc640 1 -- 172.21.15.50:0/1876806968 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8007e280 con 0x56410ba811d0 2024-09-11T22:13:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.111+0000 7f4b667fc640 1 -- 172.21.15.50:0/1876806968 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f4b8009a030 con 0x56410ba811d0 2024-09-11T22:13:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.111+0000 7f4b9106d740 10 client.5523 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.111+0000 7f4b9106d740 10 client.5523 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.111+0000 7f4b9106d740 20 client.5523 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.111+0000 7f4b9106d740 1 --2- 172.21.15.50:0/1876806968 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56410bae8fc0 0x56410bb36d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.111+0000 7f4b9106d740 4 client.5523 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-11T22:13:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.111+0000 7f4b9106d740 1 -- 172.21.15.50:0/1876806968 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x56410b9eb6e0 con 0x56410bae8fc0 2024-09-11T22:13:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.111+0000 7f4b877fe640 1 --2- 172.21.15.50:0/1876806968 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56410bae8fc0 0x56410bb36d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.111+0000 7f4b877fe640 1 --2- 172.21.15.50:0/1876806968 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56410bae8fc0 0x56410bb36d70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44cbc05c2655fbc2 server_cookie=48e076a96d9c5ad9 in_seq=0 out_seq=0 2024-09-11T22:13:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.111+0000 7f4b667fc640 10 client.5523 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b667fc640 1 -- 172.21.15.50:0/1876806968 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56410b9eb6e0 con 0x56410bae8fc0 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b667fc640 10 client.5523 handle_command_reply: tid=0 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b9106d740 1 client.5523 shutdown 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b9106d740 1 -- 172.21.15.50:0/1876806968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 msgr2=0x56410bb36830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b9106d740 1 --2- 172.21.15.50:0/1876806968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410bb36830 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009f10 tx=0x7f4b80009810 comp rx=0 tx=0).stop 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b9106d740 1 -- 172.21.15.50:0/1876806968 shutdown_connections 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b9106d740 1 --2- 172.21.15.50:0/1876806968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56410ba7fa40 0x56410bae8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b9106d740 1 --2- 172.21.15.50:0/1876806968 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56410bae8fc0 0x56410bb36d70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b9106d740 1 --2- 172.21.15.50:0/1876806968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56410ba811d0 0x56410bb36830 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b9106d740 1 --2- 172.21.15.50:0/1876806968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56410ba7e2b0 0x56410bb388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b667fc640 0 client.5523 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b9106d740 1 -- 172.21.15.50:0/1876806968 >> 172.21.15.50:0/1876806968 conn(0x56410ba7d200 msgr2=0x56410bac36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b9106d740 1 -- 172.21.15.50:0/1876806968 shutdown_connections 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b9106d740 1 -- 172.21.15.50:0/1876806968 wait complete. 2024-09-11T22:13:56.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.112+0000 7f4b9106d740 20 client.5523 trim_cache size 0 max 16384 2024-09-11T22:13:56.119 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:56.119 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:13:56.119 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "7a3af87a-776a-43d1-8a4c-a899762ec38f", 2024-09-11T22:13:56.119 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:13:56.119 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.113+0000 7f4b8e1f6640 1 -- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b7406be30 msgr2=0x7f4b7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.113+0000 7f4b8e1f6640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b7406be30 0x7f4b7406e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4b8815a390 tx=0x7f4b78007e30 comp rx=0 tx=0).stop 2024-09-11T22:13:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.113+0000 7f4b8e1f6640 1 -- 172.21.15.50:0/772776023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b8815f350 msgr2=0x7f4b880ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.113+0000 7f4b8e1f6640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b8815f350 0x7f4b880ce370 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009f40 tx=0x7f4b80004a40 comp rx=0 tx=0).stop 2024-09-11T22:13:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.113+0000 7f4b8e1f6640 1 -- 172.21.15.50:0/772776023 shutdown_connections 2024-09-11T22:13:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.113+0000 7f4b8e1f6640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b7406be30 0x7f4b7406e2f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.113+0000 7f4b8e1f6640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b8815c3c0 0x7f4b88154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.113+0000 7f4b8e1f6640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4b8815f350 0x7f4b880ce370 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.113+0000 7f4b8e1f6640 1 --2- 172.21.15.50:0/772776023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b880679c0 0x7f4b881e6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.113+0000 7f4b8e1f6640 1 -- 172.21.15.50:0/772776023 >> 172.21.15.50:0/772776023 conn(0x7f4b88075060 msgr2=0x7f4b881603c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.113+0000 7f4b8e1f6640 1 -- 172.21.15.50:0/772776023 shutdown_connections 2024-09-11T22:13:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.113+0000 7f4b8e1f6640 1 -- 172.21.15.50:0/772776023 wait complete. 2024-09-11T22:13:56.125 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '7a3af87a-776a-43d1-8a4c-a899762ec38f', 'mode': 'asynchronous'}' 2024-09-11T22:13:56.125 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-09-11T22:13:56.125 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-11T22:13:56.125 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-11T22:13:56.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.229+0000 7f69ee677640 1 Processor -- start 2024-09-11T22:13:56.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.229+0000 7f69ee677640 1 -- start start 2024-09-11T22:13:56.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.230+0000 7f69ee677640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69e815e870 0x7f69e80d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.230+0000 7f69ee677640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f69e80d3c00 0x7f69e80b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.230+0000 7f69ee677640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e80cfa80 con 0x7f69e80d16d0 2024-09-11T22:13:56.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.230+0000 7f69ee677640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f69e80d1b10 con 0x7f69e80d3c00 2024-09-11T22:13:56.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.230+0000 7f69ee677640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f69e80d40d0 con 0x7f69e815e870 2024-09-11T22:13:56.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.230+0000 7f69ecc14640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f69e80d3c00 0x7f69e80b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.230+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69e815e870 0x7f69e80d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.230+0000 7f69ecc14640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f69e80d3c00 0x7f69e80b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:36178/0 (socket says 172.21.15.50:36178) 2024-09-11T22:13:56.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.230+0000 7f69ecc14640 1 -- 172.21.15.50:0/435515140 learned_addr learned my addr 172.21.15.50:0/435515140 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.230+0000 7f69e77fe640 1 --1- 172.21.15.50:0/435515140 >> v1:172.21.15.77:6789/0 conn(0x7f69e80d16d0 0x7f69e80d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:34656/0 (socket says 172.21.15.50:34656) 2024-09-11T22:13:56.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.230+0000 7f69e7fff640 1 -- 172.21.15.50:0/435515140 >> v2:172.21.15.77:3300/0 conn(0x7f69e80d3c00 msgr2=0x7f69e80b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.230+0000 7f69e7fff640 1 --2- 172.21.15.50:0/435515140 >> v2:172.21.15.77:3300/0 conn(0x7f69e80d3c00 0x7f69e80b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.230+0000 7f69e7fff640 1 -- 172.21.15.50:0/435515140 >> v1:172.21.15.77:6789/0 conn(0x7f69e80d16d0 legacy=0x7f69e80d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.231+0000 7f69e7fff640 1 -- 172.21.15.50:0/435515140 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e80d43b0 con 0x7f69e815e870 2024-09-11T22:13:56.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.231+0000 7f69e7fff640 1 --2- 172.21.15.50:0/435515140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69e815e870 0x7f69e80d1190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f69d80097a0 tx=0x7f69d802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45be81622547da77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.231+0000 7f69e6ffd640 1 -- 172.21.15.50:0/435515140 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8037070 con 0x7f69e815e870 2024-09-11T22:13:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.231+0000 7f69e6ffd640 1 -- 172.21.15.50:0/435515140 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d8032440 con 0x7f69e815e870 2024-09-11T22:13:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.231+0000 7f69e6ffd640 1 -- 172.21.15.50:0/435515140 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8032810 con 0x7f69e815e870 2024-09-11T22:13:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.232+0000 7f69ee677640 1 -- 172.21.15.50:0/435515140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69e815e870 msgr2=0x7f69e80d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.232+0000 7f69ee677640 1 --2- 172.21.15.50:0/435515140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69e815e870 0x7f69e80d1190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f69d80097a0 tx=0x7f69d802a180 comp rx=0 tx=0).stop 2024-09-11T22:13:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.232+0000 7f69ee677640 1 -- 172.21.15.50:0/435515140 shutdown_connections 2024-09-11T22:13:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.232+0000 7f69ee677640 1 --2- 172.21.15.50:0/435515140 >> v2:172.21.15.77:3300/0 conn(0x7f69e80d3c00 0x7f69e80b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.232+0000 7f69ee677640 1 --2- 172.21.15.50:0/435515140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69e815e870 0x7f69e80d1190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.232+0000 7f69ee677640 1 -- 172.21.15.50:0/435515140 >> 172.21.15.50:0/435515140 conn(0x7f69e80727a0 msgr2=0x7f69e80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.232+0000 7f69ee677640 1 -- 172.21.15.50:0/435515140 shutdown_connections 2024-09-11T22:13:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.232+0000 7f69ee677640 1 -- 172.21.15.50:0/435515140 wait complete. 2024-09-11T22:13:56.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.233+0000 7f69ee677640 1 Processor -- start 2024-09-11T22:13:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.233+0000 7f69ee677640 1 -- start start 2024-09-11T22:13:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.234+0000 7f69ee677640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69e80d16d0 0x7f69e8158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.234+0000 7f69ee677640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69e80d3c00 0x7f69e80ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.234+0000 7f69ee677640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e815e870 0x7f69e80ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.234+0000 7f69ee677640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69e815ec50 con 0x7f69e815e870 2024-09-11T22:13:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.234+0000 7f69ee677640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f69e80b7ee0 con 0x7f69e80d16d0 2024-09-11T22:13:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.234+0000 7f69ee677640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f69e80b78b0 con 0x7f69e80d3c00 2024-09-11T22:13:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.234+0000 7f69ecc14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e815e870 0x7f69e80ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.234+0000 7f69ecc14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e815e870 0x7f69e80ce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57828/0 (socket says 172.21.15.50:57828) 2024-09-11T22:13:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.234+0000 7f69ecc14640 1 -- 172.21.15.50:0/2414763294 learned_addr learned my addr 172.21.15.50:0/2414763294 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69e77fe640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69e80d3c00 0x7f69e80ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69e7fff640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69e80d16d0 0x7f69e8158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69ecc14640 1 -- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69e80d3c00 msgr2=0x7f69e80ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69ecc14640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69e80d3c00 0x7f69e80ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69ecc14640 1 -- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69e80d16d0 msgr2=0x7f69e8158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69ecc14640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69e80d16d0 0x7f69e8158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69ecc14640 1 -- 172.21.15.50:0/2414763294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e80ceba0 con 0x7f69e815e870 2024-09-11T22:13:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69e7fff640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69e80d16d0 0x7f69e8158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69ecc14640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e815e870 0x7f69e80ce660 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f69e000efc0 tx=0x7f69e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69e4ff9640 1 -- 172.21.15.50:0/2414763294 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e000cd20 con 0x7f69e815e870 2024-09-11T22:13:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69e4ff9640 1 -- 172.21.15.50:0/2414763294 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69e0003990 con 0x7f69e815e870 2024-09-11T22:13:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69ee677640 1 -- 172.21.15.50:0/2414763294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e80cb3b0 con 0x7f69e815e870 2024-09-11T22:13:56.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69e4ff9640 1 -- 172.21.15.50:0/2414763294 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e0003d80 con 0x7f69e815e870 2024-09-11T22:13:56.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.235+0000 7f69ee677640 1 -- 172.21.15.50:0/2414763294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e80cc6e0 con 0x7f69e815e870 2024-09-11T22:13:56.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.237+0000 7f69e4ff9640 1 -- 172.21.15.50:0/2414763294 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69e0005d10 con 0x7f69e815e870 2024-09-11T22:13:56.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.238+0000 7f69e4ff9640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69d406be30 0x7f69d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.238+0000 7f69e4ff9640 1 -- 172.21.15.50:0/2414763294 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f69e008b460 con 0x7f69e815e870 2024-09-11T22:13:56.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.238+0000 7f69e7fff640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69d406be30 0x7f69d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.238+0000 7f69f140d740 1 Processor -- start 2024-09-11T22:13:56.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.238+0000 7f69f140d740 1 -- start start 2024-09-11T22:13:56.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.238+0000 7f69e7fff640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69d406be30 0x7f69d406e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f69d8034000 tx=0x7f69d802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69f140d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda595bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69f140d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54dc10 0x560fda550830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69f140d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda54aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69f140d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560fda4b2610 con 0x560fda550450 2024-09-11T22:13:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69f140d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560fda45a2e0 con 0x560fda54dc10 2024-09-11T22:13:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69f140d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560fda4ae5d0 con 0x560fda551be0 2024-09-11T22:13:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda595bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda595bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57834/0 (socket says 172.21.15.50:57834) 2024-09-11T22:13:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69e7fff640 1 -- 172.21.15.50:0/1101873980 learned_addr learned my addr 172.21.15.50:0/1101873980 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69ecc14640 1 --2- 172.21.15.50:0/1101873980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda54aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69e77fe640 1 --2- 172.21.15.50:0/1101873980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54dc10 0x560fda550830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69e7fff640 1 -- 172.21.15.50:0/1101873980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 msgr2=0x560fda54aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69e7fff640 1 --2- 172.21.15.50:0/1101873980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda54aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69e7fff640 1 -- 172.21.15.50:0/1101873980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54dc10 msgr2=0x560fda550830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69e7fff640 1 --2- 172.21.15.50:0/1101873980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54dc10 0x560fda550830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69e7fff640 1 -- 172.21.15.50:0/1101873980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fda4751f0 con 0x560fda550450 2024-09-11T22:13:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.239+0000 7f69ecc14640 1 --2- 172.21.15.50:0/1101873980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda54aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.240+0000 7f69e7fff640 1 --2- 172.21.15.50:0/1101873980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda595bf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009890 tx=0x7f69d802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea1a68dd2f6992f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.240+0000 7f69cdffb640 1 -- 172.21.15.50:0/1101873980 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d804d070 con 0x560fda550450 2024-09-11T22:13:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.240+0000 7f69cdffb640 1 -- 172.21.15.50:0/1101873980 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d803e460 con 0x560fda550450 2024-09-11T22:13:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.240+0000 7f69cdffb640 1 -- 172.21.15.50:0/1101873980 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8037040 con 0x560fda550450 2024-09-11T22:13:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.240+0000 7f69f140d740 1 -- 172.21.15.50:0/1101873980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 msgr2=0x560fda595bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.240+0000 7f69f140d740 1 --2- 172.21.15.50:0/1101873980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda595bf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009890 tx=0x7f69d802c000 comp rx=0 tx=0).stop 2024-09-11T22:13:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.240+0000 7f69f140d740 1 -- 172.21.15.50:0/1101873980 shutdown_connections 2024-09-11T22:13:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.240+0000 7f69f140d740 1 --2- 172.21.15.50:0/1101873980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda54aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.240+0000 7f69f140d740 1 --2- 172.21.15.50:0/1101873980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54dc10 0x560fda550830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.240+0000 7f69f140d740 1 --2- 172.21.15.50:0/1101873980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda595bf0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.240+0000 7f69f140d740 1 -- 172.21.15.50:0/1101873980 >> 172.21.15.50:0/1101873980 conn(0x560fda54cc10 msgr2=0x560fda5950c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.241+0000 7f69f140d740 1 -- 172.21.15.50:0/1101873980 shutdown_connections 2024-09-11T22:13:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.241+0000 7f69f140d740 1 -- 172.21.15.50:0/1101873980 wait complete. 2024-09-11T22:13:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.241+0000 7f69f140d740 1 -- start start 2024-09-11T22:13:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.241+0000 7f69f140d740 1 Processor -- start 2024-09-11T22:13:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69f140d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda571090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69f140d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda54a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69f140d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54ec00 0x560fda54f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69f140d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560fda54c0b0 con 0x560fda550450 2024-09-11T22:13:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69f140d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560fda43b350 con 0x560fda54ec00 2024-09-11T22:13:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69f140d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560fda596420 con 0x560fda551be0 2024-09-11T22:13:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69f140d740 10 client.0 _ll_register_callbacks cb 0x560fda1c4a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda571090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda571090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57846/0 (socket says 172.21.15.50:57846) 2024-09-11T22:13:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69e7fff640 1 -- 172.21.15.50:0/2453696923 learned_addr learned my addr 172.21.15.50:0/2453696923 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69ecc14640 1 --2- 172.21.15.50:0/2453696923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54ec00 0x560fda54f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69e77fe640 1 --2- 172.21.15.50:0/2453696923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda54a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69e7fff640 1 -- 172.21.15.50:0/2453696923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 msgr2=0x560fda54a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69e7fff640 1 --2- 172.21.15.50:0/2453696923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda54a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69e7fff640 1 -- 172.21.15.50:0/2453696923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54ec00 msgr2=0x560fda54f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69e7fff640 1 --2- 172.21.15.50:0/2453696923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54ec00 0x560fda54f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.242+0000 7f69e7fff640 1 -- 172.21.15.50:0/2453696923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fda1c5240 con 0x560fda550450 2024-09-11T22:13:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69e7fff640 1 --2- 172.21.15.50:0/2453696923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda571090 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009560 tx=0x7f69d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73e5253bc273f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69c6ffd640 1 -- 172.21.15.50:0/2453696923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d804d030 con 0x560fda550450 2024-09-11T22:13:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69c6ffd640 1 -- 172.21.15.50:0/2453696923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f69d8045070 con 0x560fda550450 2024-09-11T22:13:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69f140d740 1 -- 172.21.15.50:0/2453696923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69d803e460 con 0x560fda550450 2024-09-11T22:13:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69c6ffd640 1 -- 172.21.15.50:0/2453696923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f69d8037070 con 0x560fda550450 2024-09-11T22:13:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69f140d740 10 client.5532 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69f140d740 1 -- 172.21.15.50:0/2453696923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x560fda28f620 con 0x560fda550450 2024-09-11T22:13:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69c6ffd640 1 -- 172.21.15.50:0/2453696923 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d803e460 con 0x560fda550450 2024-09-11T22:13:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69c6ffd640 1 -- 172.21.15.50:0/2453696923 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f69d805b080 con 0x560fda550450 2024-09-11T22:13:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69f140d740 10 client.5532 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69f140d740 10 client.5532 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:56.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69f140d740 20 client.5532 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69f140d740 1 --2- 172.21.15.50:0/2453696923 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x560fda578300 0x560fda578720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69f140d740 4 client.5532 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69f140d740 1 -- 172.21.15.50:0/2453696923 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fda4bfd40 con 0x560fda578300 2024-09-11T22:13:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.243+0000 7f69e77fe640 1 --2- 172.21.15.50:0/2453696923 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x560fda578300 0x560fda578720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.244+0000 7f69e77fe640 1 --2- 172.21.15.50:0/2453696923 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x560fda578300 0x560fda578720 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db8734bd2515a8f3 server_cookie=f1a93dabf57ea1bd in_seq=0 out_seq=0 2024-09-11T22:13:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.244+0000 7f69c6ffd640 10 client.5532 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.244+0000 7f69c6ffd640 1 -- 172.21.15.50:0/2453696923 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560fda4bfd40 con 0x560fda578300 2024-09-11T22:13:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.244+0000 7f69c6ffd640 10 client.5532 handle_command_reply: tid=0 2024-09-11T22:13:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.244+0000 7f69f140d740 1 client.5532 shutdown 2024-09-11T22:13:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.244+0000 7f69f140d740 1 -- 172.21.15.50:0/2453696923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 msgr2=0x560fda571090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.244+0000 7f69f140d740 1 --2- 172.21.15.50:0/2453696923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda571090 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009560 tx=0x7f69d8004730 comp rx=0 tx=0).stop 2024-09-11T22:13:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.245+0000 7f69f140d740 1 -- 172.21.15.50:0/2453696923 shutdown_connections 2024-09-11T22:13:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.245+0000 7f69f140d740 1 --2- 172.21.15.50:0/2453696923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda54a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.245+0000 7f69f140d740 1 --2- 172.21.15.50:0/2453696923 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x560fda578300 0x560fda578720 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.245+0000 7f69f140d740 1 --2- 172.21.15.50:0/2453696923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54ec00 0x560fda54f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.245+0000 7f69f140d740 1 --2- 172.21.15.50:0/2453696923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda571090 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.245+0000 7f69c6ffd640 0 client.5532 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.245+0000 7f69f140d740 1 -- 172.21.15.50:0/2453696923 >> 172.21.15.50:0/2453696923 conn(0x560fda54dc10 msgr2=0x560fda596c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.245+0000 7f69f140d740 1 -- 172.21.15.50:0/2453696923 shutdown_connections 2024-09-11T22:13:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.245+0000 7f69f140d740 1 -- 172.21.15.50:0/2453696923 wait complete. 2024-09-11T22:13:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.245+0000 7f69f140d740 20 client.5532 trim_cache size 0 max 16384 2024-09-11T22:13:56.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.259+0000 7f69f140d740 1 Processor -- start 2024-09-11T22:13:56.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.260+0000 7f69f140d740 1 -- start start 2024-09-11T22:13:56.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.260+0000 7f69f140d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda54ec00 0x560fda593070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.260+0000 7f69f140d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda550450 0x560fda5935b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.260+0000 7f69f140d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda551be0 0x560fda594ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.260+0000 7f69f140d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69e8200da0 con 0x560fda54ec00 2024-09-11T22:13:56.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.260+0000 7f69f140d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f69e81ffe60 con 0x560fda551be0 2024-09-11T22:13:56.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.260+0000 7f69f140d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f69e815a2c0 con 0x560fda550450 2024-09-11T22:13:56.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.260+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda54ec00 0x560fda593070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.260+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda54ec00 0x560fda593070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57858/0 (socket says 172.21.15.50:57858) 2024-09-11T22:13:56.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.260+0000 7f69e7fff640 1 -- 172.21.15.50:0/1681779019 learned_addr learned my addr 172.21.15.50:0/1681779019 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.261+0000 7f69e77fe640 1 --2- 172.21.15.50:0/1681779019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda550450 0x560fda5935b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.261+0000 7f69ecc14640 1 --2- 172.21.15.50:0/1681779019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda551be0 0x560fda594ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.261+0000 7f69e7fff640 1 -- 172.21.15.50:0/1681779019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda550450 msgr2=0x560fda5935b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.261+0000 7f69e7fff640 1 --2- 172.21.15.50:0/1681779019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda550450 0x560fda5935b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.261+0000 7f69e7fff640 1 -- 172.21.15.50:0/1681779019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda551be0 msgr2=0x560fda594ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.261+0000 7f69e7fff640 1 --2- 172.21.15.50:0/1681779019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda551be0 0x560fda594ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.261+0000 7f69e7fff640 1 -- 172.21.15.50:0/1681779019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fda54c9b0 con 0x560fda54ec00 2024-09-11T22:13:56.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.261+0000 7f69e7fff640 1 --2- 172.21.15.50:0/1681779019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda54ec00 0x560fda593070 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f69d8032f40 tx=0x7f69d8045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3e4eb1e24a924c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.261+0000 7f69cd7fa640 1 -- 172.21.15.50:0/1681779019 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d804d030 con 0x560fda54ec00 2024-09-11T22:13:56.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.261+0000 7f69cd7fa640 1 -- 172.21.15.50:0/1681779019 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d8052450 con 0x560fda54ec00 2024-09-11T22:13:56.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.261+0000 7f69cd7fa640 1 -- 172.21.15.50:0/1681779019 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8052800 con 0x560fda54ec00 2024-09-11T22:13:56.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.261+0000 7f69f140d740 1 -- 172.21.15.50:0/1681779019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda54ec00 msgr2=0x560fda593070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.261+0000 7f69f140d740 1 --2- 172.21.15.50:0/1681779019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda54ec00 0x560fda593070 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f69d8032f40 tx=0x7f69d8045000 comp rx=0 tx=0).stop 2024-09-11T22:13:56.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.262+0000 7f69f140d740 1 -- 172.21.15.50:0/1681779019 shutdown_connections 2024-09-11T22:13:56.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.262+0000 7f69f140d740 1 --2- 172.21.15.50:0/1681779019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda550450 0x560fda5935b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.262+0000 7f69f140d740 1 --2- 172.21.15.50:0/1681779019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda551be0 0x560fda594ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.262+0000 7f69f140d740 1 --2- 172.21.15.50:0/1681779019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda54ec00 0x560fda593070 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.262+0000 7f69f140d740 1 -- 172.21.15.50:0/1681779019 >> 172.21.15.50:0/1681779019 conn(0x560fda54dc10 msgr2=0x560fda54b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.262+0000 7f69f140d740 1 -- 172.21.15.50:0/1681779019 shutdown_connections 2024-09-11T22:13:56.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.262+0000 7f69f140d740 1 -- 172.21.15.50:0/1681779019 wait complete. 2024-09-11T22:13:56.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.262+0000 7f69f140d740 1 -- start start 2024-09-11T22:13:56.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.262+0000 7f69f140d740 1 Processor -- start 2024-09-11T22:13:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69f140d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54ec00 0x560fda594810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69f140d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda5fc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69f140d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda593070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69f140d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69e815a910 con 0x560fda550450 2024-09-11T22:13:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69f140d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560fda613a90 con 0x560fda54ec00 2024-09-11T22:13:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69f140d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560fda571f10 con 0x560fda551be0 2024-09-11T22:13:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69f140d740 10 client.0 _ll_register_callbacks cb 0x7f69d804b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69e77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda5fc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69e77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda5fc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57862/0 (socket says 172.21.15.50:57862) 2024-09-11T22:13:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69e77fe640 1 -- 172.21.15.50:0/479113602 learned_addr learned my addr 172.21.15.50:0/479113602 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69e7fff640 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54ec00 0x560fda594810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69ecc14640 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda593070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69e77fe640 1 -- 172.21.15.50:0/479113602 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 msgr2=0x560fda593070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69e77fe640 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda593070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69e77fe640 1 -- 172.21.15.50:0/479113602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54ec00 msgr2=0x560fda594810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69e77fe640 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54ec00 0x560fda594810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.263+0000 7f69e77fe640 1 -- 172.21.15.50:0/479113602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fda5721f0 con 0x560fda550450 2024-09-11T22:13:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69ecc14640 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda593070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69e77fe640 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda5fc850 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f69e80d1f70 tx=0x7f69dc007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572f2e0bd834d37f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69c6ffd640 1 -- 172.21.15.50:0/479113602 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc025060 con 0x560fda550450 2024-09-11T22:13:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69c6ffd640 1 -- 172.21.15.50:0/479113602 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f69dc020b00 con 0x560fda550450 2024-09-11T22:13:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69f140d740 1 -- 172.21.15.50:0/479113602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69d8052450 con 0x560fda550450 2024-09-11T22:13:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69c6ffd640 1 -- 172.21.15.50:0/479113602 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f69dc020d00 con 0x560fda550450 2024-09-11T22:13:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69f140d740 10 client.5538 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69f140d740 1 -- 172.21.15.50:0/479113602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x560fda6133e0 con 0x560fda550450 2024-09-11T22:13:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69c6ffd640 1 -- 172.21.15.50:0/479113602 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d8052450 con 0x560fda550450 2024-09-11T22:13:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69c6ffd640 1 -- 172.21.15.50:0/479113602 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f69dc019980 con 0x560fda550450 2024-09-11T22:13:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69f140d740 10 client.5538 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69f140d740 10 client.5538 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69f140d740 20 client.5538 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69f140d740 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x560fda5935b0 0x560fda590490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69f140d740 4 client.5538 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-11T22:13:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.264+0000 7f69f140d740 1 -- 172.21.15.50:0/479113602 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x560fda4ba090 con 0x560fda5935b0 2024-09-11T22:13:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.265+0000 7f69e7fff640 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x560fda5935b0 0x560fda590490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.265+0000 7f69c6ffd640 10 client.5538 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.265+0000 7f69e7fff640 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x560fda5935b0 0x560fda590490 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d774703cdd25581 server_cookie=ae64c201f869daa7 in_seq=0 out_seq=0 2024-09-11T22:13:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69c6ffd640 1 -- 172.21.15.50:0/479113602 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560fda4ba090 con 0x560fda5935b0 2024-09-11T22:13:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69c6ffd640 10 client.5538 handle_command_reply: tid=0 2024-09-11T22:13:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69f140d740 1 client.5538 shutdown 2024-09-11T22:13:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69f140d740 1 -- 172.21.15.50:0/479113602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 msgr2=0x560fda5fc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69f140d740 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda5fc850 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f69e80d1f70 tx=0x7f69dc007e20 comp rx=0 tx=0).stop 2024-09-11T22:13:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69f140d740 1 -- 172.21.15.50:0/479113602 shutdown_connections 2024-09-11T22:13:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69f140d740 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560fda551be0 0x560fda593070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69f140d740 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x560fda5935b0 0x560fda590490 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69f140d740 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560fda550450 0x560fda5fc850 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69f140d740 1 --2- 172.21.15.50:0/479113602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560fda54ec00 0x560fda594810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69c6ffd640 0 client.5538 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69f140d740 1 -- 172.21.15.50:0/479113602 >> 172.21.15.50:0/479113602 conn(0x560fda54dc10 msgr2=0x560fda596c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69f140d740 1 -- 172.21.15.50:0/479113602 shutdown_connections 2024-09-11T22:13:56.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69f140d740 1 -- 172.21.15.50:0/479113602 wait complete. 2024-09-11T22:13:56.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.267+0000 7f69f140d740 20 client.5538 trim_cache size 0 max 16384 2024-09-11T22:13:56.274 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:56.274 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:13:56.274 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:13:56.274 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:56.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.268+0000 7f69ee677640 1 -- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69d406be30 msgr2=0x7f69d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.268+0000 7f69ee677640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69d406be30 0x7f69d406e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f69d8034000 tx=0x7f69d802e000 comp rx=0 tx=0).stop 2024-09-11T22:13:56.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.268+0000 7f69ee677640 1 -- 172.21.15.50:0/2414763294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e815e870 msgr2=0x7f69e80ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.268+0000 7f69ee677640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e815e870 0x7f69e80ce660 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f69e000efc0 tx=0x7f69e000c490 comp rx=0 tx=0).stop 2024-09-11T22:13:56.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.268+0000 7f69ee677640 1 -- 172.21.15.50:0/2414763294 shutdown_connections 2024-09-11T22:13:56.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.268+0000 7f69ee677640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69d406be30 0x7f69d406e2f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.268+0000 7f69ee677640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69e80d3c00 0x7f69e80ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.268+0000 7f69ee677640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e815e870 0x7f69e80ce660 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.268+0000 7f69ee677640 1 --2- 172.21.15.50:0/2414763294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69e80d16d0 0x7f69e8158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.268+0000 7f69ee677640 1 -- 172.21.15.50:0/2414763294 >> 172.21.15.50:0/2414763294 conn(0x7f69e80727a0 msgr2=0x7f69e80d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.268+0000 7f69ee677640 1 -- 172.21.15.50:0/2414763294 shutdown_connections 2024-09-11T22:13:56.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.268+0000 7f69ee677640 1 -- 172.21.15.50:0/2414763294 wait complete. 2024-09-11T22:13:56.279 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-11T22:13:56.279 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-11T22:13:56.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-11T22:13:56.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.387+0000 7f5248f91640 1 Processor -- start 2024-09-11T22:13:56.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.387+0000 7f5248f91640 1 -- start start 2024-09-11T22:13:56.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.388+0000 7f5248f91640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f524415c3c0 0x7f524415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.388+0000 7f5248f91640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f524415ec40 0x7f524415f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.388+0000 7f5248f91640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f524415f7f0 con 0x7f52440679c0 2024-09-11T22:13:56.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.388+0000 7f5248f91640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f524415f5c0 con 0x7f524415ec40 2024-09-11T22:13:56.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.388+0000 7f5248f91640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f524406e700 con 0x7f524415c3c0 2024-09-11T22:13:56.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.388+0000 7f5241d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f524415ec40 0x7f524415f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.388+0000 7f524259c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f524415c3c0 0x7f524415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.388+0000 7f5241d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f524415ec40 0x7f524415f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:36228/0 (socket says 172.21.15.50:36228) 2024-09-11T22:13:56.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.388+0000 7f5241d9b640 1 -- 172.21.15.50:0/3051648689 learned_addr learned my addr 172.21.15.50:0/3051648689 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.389+0000 7f524259c640 1 -- 172.21.15.50:0/3051648689 >> v2:172.21.15.77:3300/0 conn(0x7f524415ec40 msgr2=0x7f524415f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.389+0000 7f524259c640 1 --2- 172.21.15.50:0/3051648689 >> v2:172.21.15.77:3300/0 conn(0x7f524415ec40 0x7f524415f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.389+0000 7f524259c640 1 -- 172.21.15.50:0/3051648689 >> v1:172.21.15.77:6789/0 conn(0x7f52440679c0 legacy=0x7f524406f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.389+0000 7f524259c640 1 -- 172.21.15.50:0/3051648689 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524415fad0 con 0x7f524415c3c0 2024-09-11T22:13:56.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.389+0000 7f5241d9b640 1 --2- 172.21.15.50:0/3051648689 >> v2:172.21.15.77:3300/0 conn(0x7f524415ec40 0x7f524415f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:56.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.389+0000 7f524259c640 1 --2- 172.21.15.50:0/3051648689 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f524415c3c0 0x7f524415fe60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f52340097a0 tx=0x7f523402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f0fd52554a69153 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.390+0000 7f524159a640 1 -- 172.21.15.50:0/3051648689 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234037070 con 0x7f524415c3c0 2024-09-11T22:13:56.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.390+0000 7f524159a640 1 -- 172.21.15.50:0/3051648689 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f523402ae50 con 0x7f524415c3c0 2024-09-11T22:13:56.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.390+0000 7f524159a640 1 -- 172.21.15.50:0/3051648689 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234032660 con 0x7f524415c3c0 2024-09-11T22:13:56.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.390+0000 7f5248f91640 1 -- 172.21.15.50:0/3051648689 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f524415c3c0 msgr2=0x7f524415fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.390+0000 7f5248f91640 1 --2- 172.21.15.50:0/3051648689 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f524415c3c0 0x7f524415fe60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f52340097a0 tx=0x7f523402a100 comp rx=0 tx=0).stop 2024-09-11T22:13:56.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.390+0000 7f5248f91640 1 -- 172.21.15.50:0/3051648689 shutdown_connections 2024-09-11T22:13:56.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.390+0000 7f5248f91640 1 --2- 172.21.15.50:0/3051648689 >> v2:172.21.15.77:3300/0 conn(0x7f524415ec40 0x7f524415f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.390+0000 7f5248f91640 1 --2- 172.21.15.50:0/3051648689 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f524415c3c0 0x7f524415fe60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.390+0000 7f5248f91640 1 -- 172.21.15.50:0/3051648689 >> 172.21.15.50:0/3051648689 conn(0x7f5244075060 msgr2=0x7f524406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.390+0000 7f5248f91640 1 -- 172.21.15.50:0/3051648689 shutdown_connections 2024-09-11T22:13:56.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.390+0000 7f5248f91640 1 -- 172.21.15.50:0/3051648689 wait complete. 2024-09-11T22:13:56.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.392+0000 7f5248f91640 1 Processor -- start 2024-09-11T22:13:56.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.392+0000 7f5248f91640 1 -- start start 2024-09-11T22:13:56.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.392+0000 7f5248f91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440679c0 0x7f5244154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.392+0000 7f5248f91640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f524415c3c0 0x7f5244160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.392+0000 7f5248f91640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524415ec40 0x7f52441608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.392+0000 7f5248f91640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f52440d0940 con 0x7f524415ec40 2024-09-11T22:13:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.392+0000 7f5248f91640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f524406ec30 con 0x7f52440679c0 2024-09-11T22:13:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.392+0000 7f5248f91640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5244067e00 con 0x7f524415c3c0 2024-09-11T22:13:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.392+0000 7f5242d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524415ec40 0x7f52441608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5242d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524415ec40 0x7f52441608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57878/0 (socket says 172.21.15.50:57878) 2024-09-11T22:13:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5242d9d640 1 -- 172.21.15.50:0/846955818 learned_addr learned my addr 172.21.15.50:0/846955818 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5241d9b640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f524415c3c0 0x7f5244160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f524259c640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440679c0 0x7f5244154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5242d9d640 1 -- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f524415c3c0 msgr2=0x7f5244160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5242d9d640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f524415c3c0 0x7f5244160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5242d9d640 1 -- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440679c0 msgr2=0x7f5244154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5242d9d640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440679c0 0x7f5244154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5242d9d640 1 -- 172.21.15.50:0/846955818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52440cbd50 con 0x7f524415ec40 2024-09-11T22:13:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5242d9d640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524415ec40 0x7f52441608a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f523c00c7a0 tx=0x7f523c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5232ffd640 1 -- 172.21.15.50:0/846955818 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c003b70 con 0x7f524415ec40 2024-09-11T22:13:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5232ffd640 1 -- 172.21.15.50:0/846955818 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f523c003d30 con 0x7f524415ec40 2024-09-11T22:13:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5232ffd640 1 -- 172.21.15.50:0/846955818 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c00aa90 con 0x7f524415ec40 2024-09-11T22:13:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5248f91640 1 -- 172.21.15.50:0/846955818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52441f4ff0 con 0x7f524415ec40 2024-09-11T22:13:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.393+0000 7f5248f91640 1 -- 172.21.15.50:0/846955818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52441f4230 con 0x7f524415ec40 2024-09-11T22:13:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.395+0000 7f5232ffd640 1 -- 172.21.15.50:0/846955818 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f523c00ac30 con 0x7f524415ec40 2024-09-11T22:13:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.395+0000 7f5232ffd640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f522406be30 0x7f522406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.395+0000 7f5232ffd640 1 -- 172.21.15.50:0/846955818 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f523c08acd0 con 0x7f524415ec40 2024-09-11T22:13:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.396+0000 7f524259c640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f522406be30 0x7f522406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.396+0000 7f524259c640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f522406be30 0x7f522406e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5234034000 tx=0x7f523402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.396+0000 7f524be09740 1 Processor -- start 2024-09-11T22:13:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.396+0000 7f524be09740 1 -- start start 2024-09-11T22:13:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f524be09740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c188f0 0x564525c5e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f524be09740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c160b0 0x564525c18cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f524be09740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c1a080 0x564525c13170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f524be09740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564525b7ba10 con 0x564525c1a080 2024-09-11T22:13:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f524be09740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564525b23700 con 0x564525c160b0 2024-09-11T22:13:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f524be09740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564525b779d0 con 0x564525c188f0 2024-09-11T22:13:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f5242d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c1a080 0x564525c13170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f524259c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c188f0 0x564525c5e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f5242d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c1a080 0x564525c13170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57888/0 (socket says 172.21.15.50:57888) 2024-09-11T22:13:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f5242d9d640 1 -- 172.21.15.50:0/2872616940 learned_addr learned my addr 172.21.15.50:0/2872616940 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f5241d9b640 1 --2- 172.21.15.50:0/2872616940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c160b0 0x564525c18cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f5242d9d640 1 -- 172.21.15.50:0/2872616940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c188f0 msgr2=0x564525c5e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f5242d9d640 1 --2- 172.21.15.50:0/2872616940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c188f0 0x564525c5e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f5242d9d640 1 -- 172.21.15.50:0/2872616940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c160b0 msgr2=0x564525c18cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.397+0000 7f5242d9d640 1 --2- 172.21.15.50:0/2872616940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c160b0 0x564525c18cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.398+0000 7f5242d9d640 1 -- 172.21.15.50:0/2872616940 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564525872280 con 0x564525c1a080 2024-09-11T22:13:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.398+0000 7f5242d9d640 1 --2- 172.21.15.50:0/2872616940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c1a080 0x564525c13170 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f523c089130 tx=0x7f523c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bf01eb7d35ddc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.398+0000 7f5223fff640 1 -- 172.21.15.50:0/2872616940 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c061b20 con 0x564525c1a080 2024-09-11T22:13:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.398+0000 7f5223fff640 1 -- 172.21.15.50:0/2872616940 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f523c0572f0 con 0x564525c1a080 2024-09-11T22:13:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.398+0000 7f5223fff640 1 -- 172.21.15.50:0/2872616940 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c058440 con 0x564525c1a080 2024-09-11T22:13:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.398+0000 7f524be09740 1 -- 172.21.15.50:0/2872616940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c1a080 msgr2=0x564525c13170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.398+0000 7f524be09740 1 --2- 172.21.15.50:0/2872616940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c1a080 0x564525c13170 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f523c089130 tx=0x7f523c011000 comp rx=0 tx=0).stop 2024-09-11T22:13:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.399+0000 7f524be09740 1 -- 172.21.15.50:0/2872616940 shutdown_connections 2024-09-11T22:13:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.399+0000 7f524be09740 1 --2- 172.21.15.50:0/2872616940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c1a080 0x564525c13170 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.399+0000 7f524be09740 1 --2- 172.21.15.50:0/2872616940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c160b0 0x564525c18cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.399+0000 7f524be09740 1 --2- 172.21.15.50:0/2872616940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c188f0 0x564525c5e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.399+0000 7f524be09740 1 -- 172.21.15.50:0/2872616940 >> 172.21.15.50:0/2872616940 conn(0x564525c15340 msgr2=0x564525c5d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.399+0000 7f524be09740 1 -- 172.21.15.50:0/2872616940 shutdown_connections 2024-09-11T22:13:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.399+0000 7f524be09740 1 -- 172.21.15.50:0/2872616940 wait complete. 2024-09-11T22:13:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.399+0000 7f524be09740 1 -- start start 2024-09-11T22:13:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.399+0000 7f524be09740 1 Processor -- start 2024-09-11T22:13:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.400+0000 7f524be09740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c188f0 0x564525c37530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.400+0000 7f524be09740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c1a080 0x564525c16ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.400+0000 7f524be09740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c37c60 0x564525c17530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.400+0000 7f524be09740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564525c147e0 con 0x564525c37c60 2024-09-11T22:13:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.400+0000 7f524be09740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564525b04500 con 0x564525c188f0 2024-09-11T22:13:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.400+0000 7f524be09740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564525c5e8c0 con 0x564525c1a080 2024-09-11T22:13:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.400+0000 7f524be09740 10 client.0 _ll_register_callbacks cb 0x56452588da70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.400+0000 7f5242d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c37c60 0x564525c17530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.400+0000 7f5242d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c37c60 0x564525c17530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57890/0 (socket says 172.21.15.50:57890) 2024-09-11T22:13:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.400+0000 7f5242d9d640 1 -- 172.21.15.50:0/2009093817 learned_addr learned my addr 172.21.15.50:0/2009093817 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f5241d9b640 1 --2- 172.21.15.50:0/2009093817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c1a080 0x564525c16ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f524259c640 1 --2- 172.21.15.50:0/2009093817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c188f0 0x564525c37530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f5242d9d640 1 -- 172.21.15.50:0/2009093817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c1a080 msgr2=0x564525c16ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f5242d9d640 1 --2- 172.21.15.50:0/2009093817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c1a080 0x564525c16ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f5242d9d640 1 -- 172.21.15.50:0/2009093817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c188f0 msgr2=0x564525c37530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f5242d9d640 1 --2- 172.21.15.50:0/2009093817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c188f0 0x564525c37530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f5242d9d640 1 -- 172.21.15.50:0/2009093817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56452595a690 con 0x564525c37c60 2024-09-11T22:13:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f5242d9d640 1 --2- 172.21.15.50:0/2009093817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c37c60 0x564525c17530 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f523c089210 tx=0x7f523c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e550ac3a917775c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f52217fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f52217fa640 1 -- 172.21.15.50:0/2009093817 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c058640 con 0x564525c37c60 2024-09-11T22:13:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f52217fa640 1 -- 172.21.15.50:0/2009093817 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f523c082b20 con 0x564525c37c60 2024-09-11T22:13:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f524be09740 1 -- 172.21.15.50:0/2009093817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f523c0572f0 con 0x564525c37c60 2024-09-11T22:13:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f52217fa640 1 -- 172.21.15.50:0/2009093817 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f523c082d40 con 0x564525c37c60 2024-09-11T22:13:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f524be09740 10 client.5547 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f524be09740 1 -- 172.21.15.50:0/2009093817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5645259bae20 con 0x564525c37c60 2024-09-11T22:13:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f52217fa640 1 -- 172.21.15.50:0/2009093817 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f523c0572f0 con 0x564525c37c60 2024-09-11T22:13:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f52217fa640 1 -- 172.21.15.50:0/2009093817 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f523c054d40 con 0x564525c37c60 2024-09-11T22:13:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f524be09740 10 client.5547 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f524be09740 10 client.5547 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f524be09740 20 client.5547 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:56.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f524be09740 1 --2- 172.21.15.50:0/2009093817 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x564525c120b0 0x564525c124c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f524be09740 4 client.5547 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:56.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.401+0000 7f524be09740 1 -- 172.21.15.50:0/2009093817 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564525b89140 con 0x564525c120b0 2024-09-11T22:13:56.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.402+0000 7f524259c640 1 --2- 172.21.15.50:0/2009093817 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x564525c120b0 0x564525c124c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.402+0000 7f52217fa640 10 client.5547 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.402+0000 7f524259c640 1 --2- 172.21.15.50:0/2009093817 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x564525c120b0 0x564525c124c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ff39c56656de41e server_cookie=fbd4502070639f58 in_seq=0 out_seq=0 2024-09-11T22:13:56.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.402+0000 7f52217fa640 1 -- 172.21.15.50:0/2009093817 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564525b89140 con 0x564525c120b0 2024-09-11T22:13:56.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.402+0000 7f52217fa640 10 client.5547 handle_command_reply: tid=0 2024-09-11T22:13:56.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.402+0000 7f524be09740 1 client.5547 shutdown 2024-09-11T22:13:56.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.403+0000 7f524be09740 1 -- 172.21.15.50:0/2009093817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c37c60 msgr2=0x564525c17530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.403+0000 7f524be09740 1 --2- 172.21.15.50:0/2009093817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c37c60 0x564525c17530 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f523c089210 tx=0x7f523c001250 comp rx=0 tx=0).stop 2024-09-11T22:13:56.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.403+0000 7f524be09740 1 -- 172.21.15.50:0/2009093817 shutdown_connections 2024-09-11T22:13:56.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.403+0000 7f524be09740 1 --2- 172.21.15.50:0/2009093817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c1a080 0x564525c16ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.403+0000 7f524be09740 1 --2- 172.21.15.50:0/2009093817 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x564525c120b0 0x564525c124c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.403+0000 7f524be09740 1 --2- 172.21.15.50:0/2009093817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c37c60 0x564525c17530 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.403+0000 7f524be09740 1 --2- 172.21.15.50:0/2009093817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c188f0 0x564525c37530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.403+0000 7f524be09740 1 -- 172.21.15.50:0/2009093817 >> 172.21.15.50:0/2009093817 conn(0x564525c160b0 msgr2=0x564525c5f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.403+0000 7f52217fa640 0 client.5547 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.403+0000 7f524be09740 1 -- 172.21.15.50:0/2009093817 shutdown_connections 2024-09-11T22:13:56.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.403+0000 7f524be09740 1 -- 172.21.15.50:0/2009093817 wait complete. 2024-09-11T22:13:56.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.403+0000 7f524be09740 20 client.5547 trim_cache size 0 max 16384 2024-09-11T22:13:56.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.420+0000 7f524be09740 1 Processor -- start 2024-09-11T22:13:56.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.420+0000 7f524be09740 1 -- start start 2024-09-11T22:13:56.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524be09740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 0x564525c612e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524be09740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c1a080 0x564525c17080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524be09740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c37c60 0x564525c805a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524be09740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5244200e60 con 0x564525c188f0 2024-09-11T22:13:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524be09740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52441ffe60 con 0x564525c37c60 2024-09-11T22:13:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524be09740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52440ccce0 con 0x564525c1a080 2024-09-11T22:13:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 0x564525c612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 0x564525c612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57896/0 (socket says 172.21.15.50:57896) 2024-09-11T22:13:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524259c640 1 -- 172.21.15.50:0/1342385311 learned_addr learned my addr 172.21.15.50:0/1342385311 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f5242d9d640 1 --2- 172.21.15.50:0/1342385311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c37c60 0x564525c805a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f5241d9b640 1 --2- 172.21.15.50:0/1342385311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c1a080 0x564525c17080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524259c640 1 -- 172.21.15.50:0/1342385311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c1a080 msgr2=0x564525c17080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524259c640 1 --2- 172.21.15.50:0/1342385311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c1a080 0x564525c17080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524259c640 1 -- 172.21.15.50:0/1342385311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c37c60 msgr2=0x564525c805a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524259c640 1 --2- 172.21.15.50:0/1342385311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c37c60 0x564525c805a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.421+0000 7f524259c640 1 -- 172.21.15.50:0/1342385311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452584df80 con 0x564525c188f0 2024-09-11T22:13:56.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.422+0000 7f524259c640 1 --2- 172.21.15.50:0/1342385311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 0x564525c612e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f523402a140 tx=0x7f523402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98a55354b9d543 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.422+0000 7f52237fe640 1 -- 172.21.15.50:0/1342385311 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234037040 con 0x564525c188f0 2024-09-11T22:13:56.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.422+0000 7f52237fe640 1 -- 172.21.15.50:0/1342385311 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5234032a70 con 0x564525c188f0 2024-09-11T22:13:56.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.422+0000 7f52237fe640 1 -- 172.21.15.50:0/1342385311 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234032e20 con 0x564525c188f0 2024-09-11T22:13:56.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.422+0000 7f524be09740 1 -- 172.21.15.50:0/1342385311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 msgr2=0x564525c612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.422+0000 7f524be09740 1 --2- 172.21.15.50:0/1342385311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 0x564525c612e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f523402a140 tx=0x7f523402c000 comp rx=0 tx=0).stop 2024-09-11T22:13:56.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.422+0000 7f524be09740 1 -- 172.21.15.50:0/1342385311 shutdown_connections 2024-09-11T22:13:56.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.422+0000 7f524be09740 1 --2- 172.21.15.50:0/1342385311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c1a080 0x564525c17080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.422+0000 7f524be09740 1 --2- 172.21.15.50:0/1342385311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c37c60 0x564525c805a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.422+0000 7f524be09740 1 --2- 172.21.15.50:0/1342385311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 0x564525c612e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.422+0000 7f524be09740 1 -- 172.21.15.50:0/1342385311 >> 172.21.15.50:0/1342385311 conn(0x564525c160b0 msgr2=0x564525c5d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.422+0000 7f524be09740 1 -- 172.21.15.50:0/1342385311 shutdown_connections 2024-09-11T22:13:56.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.422+0000 7f524be09740 1 -- 172.21.15.50:0/1342385311 wait complete. 2024-09-11T22:13:56.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.423+0000 7f524be09740 1 -- start start 2024-09-11T22:13:56.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.423+0000 7f524be09740 1 Processor -- start 2024-09-11T22:13:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524be09740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 0x564525cc4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524be09740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c1a080 0x564525cdba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524be09740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c37c60 0x564525c391f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524be09740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564525c387f0 con 0x564525c188f0 2024-09-11T22:13:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524be09740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52441ff8b0 con 0x564525c1a080 2024-09-11T22:13:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524be09740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564525c42150 con 0x564525c37c60 2024-09-11T22:13:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524be09740 10 client.0 _ll_register_callbacks cb 0x7f52380090e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:56.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 0x564525cc4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 0x564525cc4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57912/0 (socket says 172.21.15.50:57912) 2024-09-11T22:13:56.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524259c640 1 -- 172.21.15.50:0/1920715719 learned_addr learned my addr 172.21.15.50:0/1920715719 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f5241d9b640 1 --2- 172.21.15.50:0/1920715719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c1a080 0x564525cdba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f5242d9d640 1 --2- 172.21.15.50:0/1920715719 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c37c60 0x564525c391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524259c640 1 -- 172.21.15.50:0/1920715719 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c37c60 msgr2=0x564525c391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524259c640 1 --2- 172.21.15.50:0/1920715719 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c37c60 0x564525c391f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524259c640 1 -- 172.21.15.50:0/1920715719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c1a080 msgr2=0x564525cdba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524259c640 1 --2- 172.21.15.50:0/1920715719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c1a080 0x564525cdba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524259c640 1 -- 172.21.15.50:0/1920715719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564525c38d10 con 0x564525c188f0 2024-09-11T22:13:56.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f524259c640 1 --2- 172.21.15.50:0/1920715719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 0x564525cc4d60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f52340328f0 tx=0x7f5234004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3734dde382d44a30 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.424+0000 7f52217fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:56.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f52217fa640 1 -- 172.21.15.50:0/1920715719 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523403c440 con 0x564525c188f0 2024-09-11T22:13:56.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f52217fa640 1 -- 172.21.15.50:0/1920715719 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f5234057840 con 0x564525c188f0 2024-09-11T22:13:56.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f524be09740 1 -- 172.21.15.50:0/1920715719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5234032a70 con 0x564525c188f0 2024-09-11T22:13:56.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f52217fa640 1 -- 172.21.15.50:0/1920715719 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5234057a40 con 0x564525c188f0 2024-09-11T22:13:56.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f524be09740 10 client.5553 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:56.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f524be09740 1 -- 172.21.15.50:0/1920715719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x564525c70e70 con 0x564525c188f0 2024-09-11T22:13:56.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f52217fa640 1 -- 172.21.15.50:0/1920715719 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5234032a70 con 0x564525c188f0 2024-09-11T22:13:56.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f52217fa640 1 -- 172.21.15.50:0/1920715719 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f5234052030 con 0x564525c188f0 2024-09-11T22:13:56.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f524be09740 10 client.5553 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:56.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f524be09740 10 client.5553 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:56.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f524be09740 20 client.5553 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:56.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f524be09740 1 --2- 172.21.15.50:0/1920715719 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x564525c38080 0x564525c39730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f524be09740 4 client.5553 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-11T22:13:56.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f524be09740 1 -- 172.21.15.50:0/1920715719 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x564525b83490 con 0x564525c38080 2024-09-11T22:13:56.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.425+0000 7f5241d9b640 1 --2- 172.21.15.50:0/1920715719 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x564525c38080 0x564525c39730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f52217fa640 10 client.5553 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f5241d9b640 1 --2- 172.21.15.50:0/1920715719 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x564525c38080 0x564525c39730 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=436d73427f9fa47c server_cookie=e64411e7e4da61bf in_seq=0 out_seq=0 2024-09-11T22:13:56.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f52217fa640 1 -- 172.21.15.50:0/1920715719 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564525b83490 con 0x564525c38080 2024-09-11T22:13:56.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f52217fa640 10 client.5553 handle_command_reply: tid=0 2024-09-11T22:13:56.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f524be09740 1 client.5553 shutdown 2024-09-11T22:13:56.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f524be09740 1 -- 172.21.15.50:0/1920715719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 msgr2=0x564525cc4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f524be09740 1 --2- 172.21.15.50:0/1920715719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 0x564525cc4d60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f52340328f0 tx=0x7f5234004730 comp rx=0 tx=0).stop 2024-09-11T22:13:56.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f524be09740 1 -- 172.21.15.50:0/1920715719 shutdown_connections 2024-09-11T22:13:56.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f524be09740 1 --2- 172.21.15.50:0/1920715719 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564525c37c60 0x564525c391f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f524be09740 1 --2- 172.21.15.50:0/1920715719 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x564525c38080 0x564525c39730 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f524be09740 1 --2- 172.21.15.50:0/1920715719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564525c1a080 0x564525cdba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f524be09740 1 --2- 172.21.15.50:0/1920715719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564525c188f0 0x564525cc4d60 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f52217fa640 0 client.5553 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f524be09740 1 -- 172.21.15.50:0/1920715719 >> 172.21.15.50:0/1920715719 conn(0x564525c160b0 msgr2=0x564525c5d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f524be09740 1 -- 172.21.15.50:0/1920715719 shutdown_connections 2024-09-11T22:13:56.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.426+0000 7f524be09740 1 -- 172.21.15.50:0/1920715719 wait complete. 2024-09-11T22:13:56.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.427+0000 7f524be09740 20 client.5553 trim_cache size 0 max 16384 2024-09-11T22:13:56.434 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:56.434 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:13:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "b3bbbf8b-1d73-4bc5-91cf-99c4d1e9cd12", 2024-09-11T22:13:56.435 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:13:56.435 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:56.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.427+0000 7f5248f91640 1 -- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f522406be30 msgr2=0x7f522406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.427+0000 7f5248f91640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f522406be30 0x7f522406e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5234034000 tx=0x7f523402e000 comp rx=0 tx=0).stop 2024-09-11T22:13:56.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.427+0000 7f5248f91640 1 -- 172.21.15.50:0/846955818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524415ec40 msgr2=0x7f52441608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.427+0000 7f5248f91640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524415ec40 0x7f52441608a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f523c00c7a0 tx=0x7f523c00cc60 comp rx=0 tx=0).stop 2024-09-11T22:13:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.427+0000 7f5248f91640 1 -- 172.21.15.50:0/846955818 shutdown_connections 2024-09-11T22:13:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.427+0000 7f5248f91640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f522406be30 0x7f522406e2f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.427+0000 7f5248f91640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f524415c3c0 0x7f5244160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.427+0000 7f5248f91640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524415ec40 0x7f52441608a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.427+0000 7f5248f91640 1 --2- 172.21.15.50:0/846955818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440679c0 0x7f5244154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.427+0000 7f5248f91640 1 -- 172.21.15.50:0/846955818 >> 172.21.15.50:0/846955818 conn(0x7f5244075060 msgr2=0x7f52440b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.427+0000 7f5248f91640 1 -- 172.21.15.50:0/846955818 shutdown_connections 2024-09-11T22:13:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.427+0000 7f5248f91640 1 -- 172.21.15.50:0/846955818 wait complete. 2024-09-11T22:13:56.439 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'b3bbbf8b-1d73-4bc5-91cf-99c4d1e9cd12', 'mode': 'asynchronous'}' 2024-09-11T22:13:56.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:56.439 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-09-11T22:13:56.456 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-09-11T22:13:56.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-09-11T22:13:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.600+0000 7fd28a0ba640 1 Processor -- start 2024-09-11T22:13:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.600+0000 7fd28a0ba640 1 -- start start 2024-09-11T22:13:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.601+0000 7fd28a0ba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd2840cf790 0x7fd2840b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.601+0000 7fd28a0ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2840d11d0 0x7fd2840d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.601+0000 7fd28a0ba640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd284162110 con 0x7fd284161d30 2024-09-11T22:13:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.601+0000 7fd28a0ba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd2840d3450 con 0x7fd2840d11d0 2024-09-11T22:13:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.601+0000 7fd28a0ba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd2840b7e30 con 0x7fd2840cf790 2024-09-11T22:13:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.601+0000 7fd283fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2840d11d0 0x7fd2840d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.601+0000 7fd283fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2840d11d0 0x7fd2840d1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57920/0 (socket says 172.21.15.50:57920) 2024-09-11T22:13:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.601+0000 7fd283fff640 1 -- 172.21.15.50:0/2388290122 learned_addr learned my addr 172.21.15.50:0/2388290122 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.602+0000 7fd282ffd640 1 --2- 172.21.15.50:0/2388290122 >> v2:172.21.15.77:3300/0 conn(0x7fd2840cf790 0x7fd2840b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.602+0000 7fd283fff640 1 -- 172.21.15.50:0/2388290122 >> v2:172.21.15.77:3300/0 conn(0x7fd2840cf790 msgr2=0x7fd2840b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.602+0000 7fd283fff640 1 --2- 172.21.15.50:0/2388290122 >> v2:172.21.15.77:3300/0 conn(0x7fd2840cf790 0x7fd2840b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.602+0000 7fd283fff640 1 -- 172.21.15.50:0/2388290122 >> v1:172.21.15.77:6789/0 conn(0x7fd284161d30 legacy=0x7fd284162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.602+0000 7fd283fff640 1 -- 172.21.15.50:0/2388290122 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2840cfd70 con 0x7fd2840d11d0 2024-09-11T22:13:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.602+0000 7fd283fff640 1 --2- 172.21.15.50:0/2388290122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2840d11d0 0x7fd2840d1600 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd284068730 tx=0x7fd27c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8cfaab030a1058 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.603+0000 7fd2827fc640 1 -- 172.21.15.50:0/2388290122 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c036070 con 0x7fd2840d11d0 2024-09-11T22:13:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.603+0000 7fd2827fc640 1 -- 172.21.15.50:0/2388290122 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd27c031600 con 0x7fd2840d11d0 2024-09-11T22:13:56.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.603+0000 7fd2827fc640 1 -- 172.21.15.50:0/2388290122 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c0319d0 con 0x7fd2840d11d0 2024-09-11T22:13:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.603+0000 7fd28a0ba640 1 -- 172.21.15.50:0/2388290122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2840d11d0 msgr2=0x7fd2840d1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.603+0000 7fd28a0ba640 1 --2- 172.21.15.50:0/2388290122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2840d11d0 0x7fd2840d1600 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd284068730 tx=0x7fd27c02a6f0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.603+0000 7fd28a0ba640 1 -- 172.21.15.50:0/2388290122 shutdown_connections 2024-09-11T22:13:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.603+0000 7fd28a0ba640 1 --2- 172.21.15.50:0/2388290122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2840d11d0 0x7fd2840d1600 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.603+0000 7fd28a0ba640 1 --2- 172.21.15.50:0/2388290122 >> v2:172.21.15.77:3300/0 conn(0x7fd2840cf790 0x7fd2840b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.603+0000 7fd28a0ba640 1 -- 172.21.15.50:0/2388290122 >> 172.21.15.50:0/2388290122 conn(0x7fd2840727a0 msgr2=0x7fd2840679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.603+0000 7fd28a0ba640 1 -- 172.21.15.50:0/2388290122 shutdown_connections 2024-09-11T22:13:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.603+0000 7fd28a0ba640 1 -- 172.21.15.50:0/2388290122 wait complete. 2024-09-11T22:13:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.604+0000 7fd28a0ba640 1 Processor -- start 2024-09-11T22:13:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.605+0000 7fd28a0ba640 1 -- start start 2024-09-11T22:13:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.605+0000 7fd28a0ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2840cf790 0x7fd2841f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.605+0000 7fd28a0ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2840d11d0 0x7fd2840c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.605+0000 7fd28a0ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd284161d30 0x7fd2841494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.605+0000 7fd28a0ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd2840d2e00 con 0x7fd2840cf790 2024-09-11T22:13:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.605+0000 7fd28a0ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2840d1b40 con 0x7fd2840d11d0 2024-09-11T22:13:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.605+0000 7fd28a0ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd2840d30e0 con 0x7fd284161d30 2024-09-11T22:13:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.605+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2840cf790 0x7fd2841f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.605+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2840cf790 0x7fd2841f4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57922/0 (socket says 172.21.15.50:57922) 2024-09-11T22:13:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd2837fe640 1 -- 172.21.15.50:0/1851580273 learned_addr learned my addr 172.21.15.50:0/1851580273 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd282ffd640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2840d11d0 0x7fd2840c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd283fff640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd284161d30 0x7fd2841494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd2837fe640 1 -- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd284161d30 msgr2=0x7fd2841494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd2837fe640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd284161d30 0x7fd2841494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd2837fe640 1 -- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2840d11d0 msgr2=0x7fd2840c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd2837fe640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2840d11d0 0x7fd2840c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd2837fe640 1 -- 172.21.15.50:0/1851580273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd284159bf0 con 0x7fd2840cf790 2024-09-11T22:13:56.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd283fff640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd284161d30 0x7fd2841494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:56.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd2837fe640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2840cf790 0x7fd2841f4120 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd27400b420 tx=0x7fd27400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd26bfff640 1 -- 172.21.15.50:0/1851580273 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd274011830 con 0x7fd2840cf790 2024-09-11T22:13:56.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd26bfff640 1 -- 172.21.15.50:0/1851580273 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd274016070 con 0x7fd2840cf790 2024-09-11T22:13:56.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd28a0ba640 1 -- 172.21.15.50:0/1851580273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd284159ed0 con 0x7fd2840cf790 2024-09-11T22:13:56.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd26bfff640 1 -- 172.21.15.50:0/1851580273 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd274011c10 con 0x7fd2840cf790 2024-09-11T22:13:56.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.606+0000 7fd28a0ba640 1 -- 172.21.15.50:0/1851580273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28415a490 con 0x7fd2840cf790 2024-09-11T22:13:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.608+0000 7fd26bfff640 1 -- 172.21.15.50:0/1851580273 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd27401b460 con 0x7fd2840cf790 2024-09-11T22:13:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.608+0000 7fd26bfff640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd27006be30 0x7fd27006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.608+0000 7fd26bfff640 1 -- 172.21.15.50:0/1851580273 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd27408abe0 con 0x7fd2840cf790 2024-09-11T22:13:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.609+0000 7fd282ffd640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd27006be30 0x7fd27006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.609+0000 7fd282ffd640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd27006be30 0x7fd27006e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd2840cb400 tx=0x7fd278008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.609+0000 7fd28ce5c740 1 Processor -- start 2024-09-11T22:13:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.610+0000 7fd28ce5c740 1 -- start start 2024-09-11T22:13:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.610+0000 7fd28ce5c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573d7e0 0x56046573dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.610+0000 7fd28ce5c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560465738ee0 0x560465737dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.610+0000 7fd28ce5c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573afa0 0x560465738310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.610+0000 7fd28ce5c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5604656a0710 con 0x56046573d7e0 2024-09-11T22:13:56.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.610+0000 7fd28ce5c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560465648540 con 0x56046573afa0 2024-09-11T22:13:56.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.610+0000 7fd28ce5c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56046569c6d0 con 0x560465738ee0 2024-09-11T22:13:56.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.610+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573d7e0 0x56046573dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.610+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573d7e0 0x56046573dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57930/0 (socket says 172.21.15.50:57930) 2024-09-11T22:13:56.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.610+0000 7fd2837fe640 1 -- 172.21.15.50:0/3131877310 learned_addr learned my addr 172.21.15.50:0/3131877310 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.611+0000 7fd283fff640 1 --2- 172.21.15.50:0/3131877310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573afa0 0x560465738310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.611+0000 7fd282ffd640 1 --2- 172.21.15.50:0/3131877310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560465738ee0 0x560465737dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.611+0000 7fd2837fe640 1 -- 172.21.15.50:0/3131877310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560465738ee0 msgr2=0x560465737dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.611+0000 7fd2837fe640 1 --2- 172.21.15.50:0/3131877310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560465738ee0 0x560465737dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.611+0000 7fd2837fe640 1 -- 172.21.15.50:0/3131877310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573afa0 msgr2=0x560465738310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.611+0000 7fd2837fe640 1 --2- 172.21.15.50:0/3131877310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573afa0 0x560465738310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.611+0000 7fd2837fe640 1 -- 172.21.15.50:0/3131877310 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56046566e170 con 0x56046573d7e0 2024-09-11T22:13:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.611+0000 7fd283fff640 1 --2- 172.21.15.50:0/3131877310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573afa0 0x560465738310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.611+0000 7fd2837fe640 1 --2- 172.21.15.50:0/3131877310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573d7e0 0x56046573dbc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd274089070 tx=0x7fd274058e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc41462211c55fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.611+0000 7fd2697fa640 1 -- 172.21.15.50:0/3131877310 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2740570c0 con 0x56046573d7e0 2024-09-11T22:13:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.611+0000 7fd2697fa640 1 -- 172.21.15.50:0/3131877310 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd274087070 con 0x56046573d7e0 2024-09-11T22:13:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.611+0000 7fd2697fa640 1 -- 172.21.15.50:0/3131877310 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd274058210 con 0x56046573d7e0 2024-09-11T22:13:56.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.612+0000 7fd28ce5c740 1 -- 172.21.15.50:0/3131877310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573d7e0 msgr2=0x56046573dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.612+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/3131877310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573d7e0 0x56046573dbc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd274089070 tx=0x7fd274058e80 comp rx=0 tx=0).stop 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.612+0000 7fd28ce5c740 1 -- 172.21.15.50:0/3131877310 shutdown_connections 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.612+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/3131877310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560465738ee0 0x560465737dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.612+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/3131877310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573afa0 0x560465738310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.612+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/3131877310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573d7e0 0x56046573dbc0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.612+0000 7fd28ce5c740 1 -- 172.21.15.50:0/3131877310 >> 172.21.15.50:0/3131877310 conn(0x560465739fa0 msgr2=0x560465782660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.612+0000 7fd28ce5c740 1 -- 172.21.15.50:0/3131877310 shutdown_connections 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.612+0000 7fd28ce5c740 1 -- 172.21.15.50:0/3131877310 wait complete. 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.612+0000 7fd28ce5c740 1 -- start start 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.613+0000 7fd28ce5c740 1 Processor -- start 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.613+0000 7fd28ce5c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573afa0 0x56046577bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.613+0000 7fd28ce5c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573d7e0 0x560465738380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.613+0000 7fd28ce5c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046575bfe0 0x5604657388c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.613+0000 7fd28ce5c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560465768070 con 0x56046573afa0 2024-09-11T22:13:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.613+0000 7fd28ce5c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560465629660 con 0x56046575bfe0 2024-09-11T22:13:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.613+0000 7fd28ce5c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560465782d70 con 0x56046573d7e0 2024-09-11T22:13:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.613+0000 7fd28ce5c740 10 client.0 _ll_register_callbacks cb 0x5604653b2fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.613+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573afa0 0x56046577bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.613+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573afa0 0x56046577bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57940/0 (socket says 172.21.15.50:57940) 2024-09-11T22:13:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd2837fe640 1 -- 172.21.15.50:0/3507238599 learned_addr learned my addr 172.21.15.50:0/3507238599 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd282ffd640 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573d7e0 0x560465738380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd283fff640 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046575bfe0 0x5604657388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd2837fe640 1 -- 172.21.15.50:0/3507238599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573d7e0 msgr2=0x560465738380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd2837fe640 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573d7e0 0x560465738380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd2837fe640 1 -- 172.21.15.50:0/3507238599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046575bfe0 msgr2=0x5604657388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd2837fe640 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046575bfe0 0x5604657388c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd2837fe640 1 -- 172.21.15.50:0/3507238599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604653b37b0 con 0x56046573afa0 2024-09-11T22:13:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd283fff640 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046575bfe0 0x5604657388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd2837fe640 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573afa0 0x56046577bd50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd27400b3f0 tx=0x7fd27400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe384b704b06109 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd2627fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd2627fc640 1 -- 172.21.15.50:0/3507238599 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd274058210 con 0x56046573afa0 2024-09-11T22:13:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd2627fc640 1 -- 172.21.15.50:0/3507238599 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd2740583b0 con 0x56046573afa0 2024-09-11T22:13:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd28ce5c740 1 -- 172.21.15.50:0/3507238599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd274087070 con 0x56046573afa0 2024-09-11T22:13:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd2627fc640 1 -- 172.21.15.50:0/3507238599 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd274082050 con 0x56046573afa0 2024-09-11T22:13:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd28ce5c740 10 client.5565 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd28ce5c740 1 -- 172.21.15.50:0/3507238599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x56046547db90 con 0x56046573afa0 2024-09-11T22:13:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.614+0000 7fd2627fc640 1 -- 172.21.15.50:0/3507238599 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd274087070 con 0x56046573afa0 2024-09-11T22:13:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.615+0000 7fd2627fc640 1 -- 172.21.15.50:0/3507238599 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fd27407b020 con 0x56046573afa0 2024-09-11T22:13:56.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.615+0000 7fd28ce5c740 10 client.5565 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.615+0000 7fd28ce5c740 10 client.5565 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.615+0000 7fd28ce5c740 20 client.5565 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.615+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56046577aaf0 0x56046577af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.615+0000 7fd28ce5c740 4 client.5565 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.615+0000 7fd28ce5c740 1 -- 172.21.15.50:0/3507238599 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604656ade40 con 0x56046577aaf0 2024-09-11T22:13:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.615+0000 7fd282ffd640 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56046577aaf0 0x56046577af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.615+0000 7fd282ffd640 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56046577aaf0 0x56046577af20 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c549a623375149f9 server_cookie=8a26e796d7c38fe7 in_seq=0 out_seq=0 2024-09-11T22:13:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.615+0000 7fd2627fc640 10 client.5565 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd2627fc640 1 -- 172.21.15.50:0/3507238599 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604656ade40 con 0x56046577aaf0 2024-09-11T22:13:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd2627fc640 10 client.5565 handle_command_reply: tid=0 2024-09-11T22:13:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd28ce5c740 1 client.5565 shutdown 2024-09-11T22:13:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd28ce5c740 1 -- 172.21.15.50:0/3507238599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573afa0 msgr2=0x56046577bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573afa0 0x56046577bd50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd27400b3f0 tx=0x7fd27400bf90 comp rx=0 tx=0).stop 2024-09-11T22:13:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd28ce5c740 1 -- 172.21.15.50:0/3507238599 shutdown_connections 2024-09-11T22:13:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573d7e0 0x560465738380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56046577aaf0 0x56046577af20 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046575bfe0 0x5604657388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/3507238599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046573afa0 0x56046577bd50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd28ce5c740 1 -- 172.21.15.50:0/3507238599 >> 172.21.15.50:0/3507238599 conn(0x560465738ee0 msgr2=0x560465751f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd2627fc640 0 client.5565 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd28ce5c740 1 -- 172.21.15.50:0/3507238599 shutdown_connections 2024-09-11T22:13:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd28ce5c740 1 -- 172.21.15.50:0/3507238599 wait complete. 2024-09-11T22:13:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.616+0000 7fd28ce5c740 20 client.5565 trim_cache size 0 max 16384 2024-09-11T22:13:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.631+0000 7fd28ce5c740 1 Processor -- start 2024-09-11T22:13:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.631+0000 7fd28ce5c740 1 -- start start 2024-09-11T22:13:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.631+0000 7fd28ce5c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573afa0 0x560465751810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.631+0000 7fd28ce5c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573d7e0 0x5604657f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.631+0000 7fd28ce5c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 0x560465782270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.631+0000 7fd28ce5c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd284200f70 con 0x56046575bfe0 2024-09-11T22:13:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.631+0000 7fd28ce5c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd284200060 con 0x56046573d7e0 2024-09-11T22:13:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.631+0000 7fd28ce5c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd28414b700 con 0x56046573afa0 2024-09-11T22:13:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd283fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 0x560465782270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd283fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 0x560465782270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57942/0 (socket says 172.21.15.50:57942) 2024-09-11T22:13:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd283fff640 1 -- 172.21.15.50:0/1218502334 learned_addr learned my addr 172.21.15.50:0/1218502334 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd2837fe640 1 --2- 172.21.15.50:0/1218502334 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573afa0 0x560465751810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd282ffd640 1 --2- 172.21.15.50:0/1218502334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573d7e0 0x5604657f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd283fff640 1 -- 172.21.15.50:0/1218502334 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573afa0 msgr2=0x560465751810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd283fff640 1 --2- 172.21.15.50:0/1218502334 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573afa0 0x560465751810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd283fff640 1 -- 172.21.15.50:0/1218502334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573d7e0 msgr2=0x5604657f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd283fff640 1 --2- 172.21.15.50:0/1218502334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573d7e0 0x5604657f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd283fff640 1 -- 172.21.15.50:0/1218502334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560465751600 con 0x56046575bfe0 2024-09-11T22:13:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd283fff640 1 --2- 172.21.15.50:0/1218502334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 0x560465782270 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd27c034040 tx=0x7fd27c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b91a8334146581 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd268ff9640 1 -- 172.21.15.50:0/1218502334 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c036040 con 0x56046575bfe0 2024-09-11T22:13:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd268ff9640 1 -- 172.21.15.50:0/1218502334 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd27c0319a0 con 0x56046575bfe0 2024-09-11T22:13:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.632+0000 7fd268ff9640 1 -- 172.21.15.50:0/1218502334 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c009510 con 0x56046575bfe0 2024-09-11T22:13:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.633+0000 7fd28ce5c740 1 -- 172.21.15.50:0/1218502334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 msgr2=0x560465782270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.633+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/1218502334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 0x560465782270 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd27c034040 tx=0x7fd27c02e000 comp rx=0 tx=0).stop 2024-09-11T22:13:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.633+0000 7fd28ce5c740 1 -- 172.21.15.50:0/1218502334 shutdown_connections 2024-09-11T22:13:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.633+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/1218502334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 0x560465782270 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.633+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/1218502334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573d7e0 0x5604657f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.633+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/1218502334 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573afa0 0x560465751810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.633+0000 7fd28ce5c740 1 -- 172.21.15.50:0/1218502334 >> 172.21.15.50:0/1218502334 conn(0x560465738ee0 msgr2=0x56046573eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.633+0000 7fd28ce5c740 1 -- 172.21.15.50:0/1218502334 shutdown_connections 2024-09-11T22:13:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.633+0000 7fd28ce5c740 1 -- 172.21.15.50:0/1218502334 wait complete. 2024-09-11T22:13:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.633+0000 7fd28ce5c740 1 -- start start 2024-09-11T22:13:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.634+0000 7fd28ce5c740 1 Processor -- start 2024-09-11T22:13:56.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.634+0000 7fd28ce5c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573afa0 0x5604657a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.634+0000 7fd28ce5c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573d7e0 0x5604657f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.634+0000 7fd28ce5c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 0x56046574fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.634+0000 7fd28ce5c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd28414bd50 con 0x56046575bfe0 2024-09-11T22:13:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.634+0000 7fd28ce5c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560465784180 con 0x56046573afa0 2024-09-11T22:13:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.634+0000 7fd28ce5c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5604657a5f30 con 0x56046573d7e0 2024-09-11T22:13:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.634+0000 7fd28ce5c740 10 client.0 _ll_register_callbacks cb 0x7fd27800a710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.634+0000 7fd283fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 0x56046574fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.634+0000 7fd283fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 0x56046574fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57958/0 (socket says 172.21.15.50:57958) 2024-09-11T22:13:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.634+0000 7fd283fff640 1 -- 172.21.15.50:0/2456373533 learned_addr learned my addr 172.21.15.50:0/2456373533 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd282ffd640 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573d7e0 0x5604657f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd2837fe640 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573afa0 0x5604657a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd283fff640 1 -- 172.21.15.50:0/2456373533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573d7e0 msgr2=0x5604657f3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd283fff640 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573d7e0 0x5604657f3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd283fff640 1 -- 172.21.15.50:0/2456373533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573afa0 msgr2=0x5604657a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd283fff640 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573afa0 0x5604657a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd283fff640 1 -- 172.21.15.50:0/2456373533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56046577f4d0 con 0x56046575bfe0 2024-09-11T22:13:56.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd282ffd640 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573d7e0 0x5604657f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:56.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd2837fe640 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573afa0 0x5604657a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:56.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd283fff640 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 0x56046574fa90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd27c02ace0 tx=0x7fd27c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846c7905494addd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd2627fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:56.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd2627fc640 1 -- 172.21.15.50:0/2456373533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c036040 con 0x56046575bfe0 2024-09-11T22:13:56.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd2627fc640 1 -- 172.21.15.50:0/2456373533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd27c003ba0 con 0x56046575bfe0 2024-09-11T22:13:56.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd28ce5c740 1 -- 172.21.15.50:0/2456373533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd27c0319a0 con 0x56046575bfe0 2024-09-11T22:13:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd2627fc640 1 -- 172.21.15.50:0/2456373533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd27c059050 con 0x56046575bfe0 2024-09-11T22:13:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd28ce5c740 10 client.5571 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd28ce5c740 1 -- 172.21.15.50:0/2456373533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5604657f4560 con 0x56046575bfe0 2024-09-11T22:13:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd2627fc640 1 -- 172.21.15.50:0/2456373533 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd27c0319a0 con 0x56046575bfe0 2024-09-11T22:13:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.635+0000 7fd2627fc640 1 -- 172.21.15.50:0/2456373533 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fd27c05c020 con 0x56046575bfe0 2024-09-11T22:13:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.636+0000 7fd28ce5c740 10 client.5571 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.636+0000 7fd28ce5c740 10 client.5571 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.636+0000 7fd28ce5c740 20 client.5571 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.636+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56046577b7f0 0x560465782270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.636+0000 7fd28ce5c740 4 client.5571 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}] 2024-09-11T22:13:56.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.636+0000 7fd28ce5c740 1 -- 172.21.15.50:0/2456373533 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}) -- 0x5604656a8190 con 0x56046577b7f0 2024-09-11T22:13:56.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.636+0000 7fd2837fe640 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56046577b7f0 0x560465782270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.636+0000 7fd2627fc640 10 client.5571 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.636+0000 7fd2837fe640 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56046577b7f0 0x560465782270 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3136d31f4818f74 server_cookie=10cf6fe8023a63f5 in_seq=0 out_seq=0 2024-09-11T22:13:56.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd2627fc640 1 -- 172.21.15.50:0/2456373533 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5604656a8190 con 0x56046577b7f0 2024-09-11T22:13:56.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd2627fc640 10 client.5571 handle_command_reply: tid=0 2024-09-11T22:13:56.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd28ce5c740 1 client.5571 shutdown 2024-09-11T22:13:56.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd28ce5c740 1 -- 172.21.15.50:0/2456373533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 msgr2=0x56046574fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 0x56046574fa90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd27c02ace0 tx=0x7fd27c004ab0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd28ce5c740 1 -- 172.21.15.50:0/2456373533 shutdown_connections 2024-09-11T22:13:56.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56046573d7e0 0x5604657f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56046577b7f0 0x560465782270 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56046575bfe0 0x56046574fa90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd28ce5c740 1 --2- 172.21.15.50:0/2456373533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56046573afa0 0x5604657a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd2627fc640 0 client.5571 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd28ce5c740 1 -- 172.21.15.50:0/2456373533 >> 172.21.15.50:0/2456373533 conn(0x560465738ee0 msgr2=0x560465784330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd28ce5c740 1 -- 172.21.15.50:0/2456373533 shutdown_connections 2024-09-11T22:13:56.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd28ce5c740 1 -- 172.21.15.50:0/2456373533 wait complete. 2024-09-11T22:13:56.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.642+0000 7fd28ce5c740 20 client.5571 trim_cache size 0 max 16384 2024-09-11T22:13:56.645 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:56.645 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:13:56.646 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:13:56.646 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:56.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.643+0000 7fd28a0ba640 1 -- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd27006be30 msgr2=0x7fd27006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.643+0000 7fd28a0ba640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd27006be30 0x7fd27006e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd2840cb400 tx=0x7fd278008040 comp rx=0 tx=0).stop 2024-09-11T22:13:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.643+0000 7fd28a0ba640 1 -- 172.21.15.50:0/1851580273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2840cf790 msgr2=0x7fd2841f4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.643+0000 7fd28a0ba640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2840cf790 0x7fd2841f4120 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd27400b420 tx=0x7fd27400b8e0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.643+0000 7fd28a0ba640 1 -- 172.21.15.50:0/1851580273 shutdown_connections 2024-09-11T22:13:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.643+0000 7fd28a0ba640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd27006be30 0x7fd27006e2f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.643+0000 7fd28a0ba640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd284161d30 0x7fd2841494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.643+0000 7fd28a0ba640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2840d11d0 0x7fd2840c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.643+0000 7fd28a0ba640 1 --2- 172.21.15.50:0/1851580273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2840cf790 0x7fd2841f4120 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.643+0000 7fd28a0ba640 1 -- 172.21.15.50:0/1851580273 >> 172.21.15.50:0/1851580273 conn(0x7fd2840727a0 msgr2=0x7fd2840cc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.643+0000 7fd28a0ba640 1 -- 172.21.15.50:0/1851580273 shutdown_connections 2024-09-11T22:13:56.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.643+0000 7fd28a0ba640 1 -- 172.21.15.50:0/1851580273 wait complete. 2024-09-11T22:13:56.654 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' returned '{'message': '', 'return_code': 0}' 2024-09-11T22:13:56.655 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:13:56.655 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:13:56.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:13:56.671 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-11T22:13:56.737 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:13:56.737 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:13:56.737 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824368 s, 127 MB/s 2024-09-11T22:13:56.738 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-11T22:13:56.738 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-11T22:13:56.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.882+0000 7f484334b640 1 Processor -- start 2024-09-11T22:13:56.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.882+0000 7f484334b640 1 -- start start 2024-09-11T22:13:56.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.883+0000 7f484334b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f483c0af4c0 0x7f483c0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.883+0000 7f484334b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483c0b09e0 0x7f483c0b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.883+0000 7f484334b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483c0af940 con 0x7f483c15fd80 2024-09-11T22:13:56.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.883+0000 7f484334b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f483c0d1500 con 0x7f483c0af4c0 2024-09-11T22:13:56.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.883+0000 7f484334b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f483c0afc20 con 0x7f483c0b09e0 2024-09-11T22:13:56.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.883+0000 7f48408e6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f483c0af4c0 0x7f483c0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.883+0000 7f48418e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483c0b09e0 0x7f483c0b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.883+0000 7f48410e7640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f483c15fd80 0x7f483c0b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:34684/0 (socket says 172.21.15.50:34684) 2024-09-11T22:13:56.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.883+0000 7f48410e7640 1 -- 172.21.15.50:0/2120763564 learned_addr learned my addr 172.21.15.50:0/2120763564 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:56.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.883+0000 7f48408e6640 1 --2- 172.21.15.50:0/2120763564 >> v2:172.21.15.77:3300/0 conn(0x7f483c0af4c0 0x7f483c0b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:36340/0 (socket says 172.21.15.50:36340) 2024-09-11T22:13:56.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.883+0000 7f48408e6640 1 -- 172.21.15.50:0/2120763564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483c0b09e0 msgr2=0x7f483c0b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.883+0000 7f48408e6640 1 --2- 172.21.15.50:0/2120763564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483c0b09e0 0x7f483c0b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.884+0000 7f48408e6640 1 -- 172.21.15.50:0/2120763564 >> v1:172.21.15.77:6789/0 conn(0x7f483c15fd80 legacy=0x7f483c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.884+0000 7f48408e6640 1 -- 172.21.15.50:0/2120763564 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c0aff00 con 0x7f483c0af4c0 2024-09-11T22:13:56.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.884+0000 7f482ffff640 1 -- 172.21.15.50:0/2120763564 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161251573 0 0) 0x7f483c0af940 con 0x7f483c15fd80 2024-09-11T22:13:56.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.884+0000 7f48418e8640 1 --2- 172.21.15.50:0/2120763564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483c0b09e0 0x7f483c0b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:56.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.884+0000 7f48408e6640 1 --2- 172.21.15.50:0/2120763564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483c0af4c0 0x7f483c0b2600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f48300097a0 tx=0x7f483002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e58e15e21059622 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.884+0000 7f482ffff640 1 -- 172.21.15.50:0/2120763564 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830037070 con 0x7f483c0af4c0 2024-09-11T22:13:56.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.885+0000 7f482ffff640 1 -- 172.21.15.50:0/2120763564 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f483002ae50 con 0x7f483c0af4c0 2024-09-11T22:13:56.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.885+0000 7f482ffff640 1 -- 172.21.15.50:0/2120763564 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830032660 con 0x7f483c0af4c0 2024-09-11T22:13:56.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.885+0000 7f484334b640 1 -- 172.21.15.50:0/2120763564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483c0af4c0 msgr2=0x7f483c0b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.885+0000 7f484334b640 1 --2- 172.21.15.50:0/2120763564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483c0af4c0 0x7f483c0b2600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f48300097a0 tx=0x7f483002a100 comp rx=0 tx=0).stop 2024-09-11T22:13:56.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.885+0000 7f484334b640 1 -- 172.21.15.50:0/2120763564 shutdown_connections 2024-09-11T22:13:56.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.885+0000 7f484334b640 1 --2- 172.21.15.50:0/2120763564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483c0b09e0 0x7f483c0b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.885+0000 7f484334b640 1 --2- 172.21.15.50:0/2120763564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483c0af4c0 0x7f483c0b2600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.885+0000 7f484334b640 1 -- 172.21.15.50:0/2120763564 >> 172.21.15.50:0/2120763564 conn(0x7f483c09ba50 msgr2=0x7f483c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.885+0000 7f484334b640 1 -- 172.21.15.50:0/2120763564 shutdown_connections 2024-09-11T22:13:56.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.885+0000 7f484334b640 1 -- 172.21.15.50:0/2120763564 wait complete. 2024-09-11T22:13:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.886+0000 7f484334b640 1 Processor -- start 2024-09-11T22:13:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.886+0000 7f484334b640 1 -- start start 2024-09-11T22:13:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.887+0000 7f484334b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483c0af4c0 0x7f483c15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.887+0000 7f484334b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f483c0b09e0 0x7f483c09c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.887+0000 7f484334b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483c15fd80 0x7f483c09d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.887+0000 7f484334b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f483c0b3ee0 con 0x7f483c0b09e0 2024-09-11T22:13:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.887+0000 7f484334b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f483c0b04c0 con 0x7f483c0af4c0 2024-09-11T22:13:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.887+0000 7f484334b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f483c160160 con 0x7f483c15fd80 2024-09-11T22:13:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.887+0000 7f48408e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f483c0b09e0 0x7f483c09c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.887+0000 7f48408e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f483c0b09e0 0x7f483c09c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57968/0 (socket says 172.21.15.50:57968) 2024-09-11T22:13:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.887+0000 7f48408e6640 1 -- 172.21.15.50:0/1737080216 learned_addr learned my addr 172.21.15.50:0/1737080216 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.887+0000 7f48410e7640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483c0af4c0 0x7f483c15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.887+0000 7f48418e8640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483c15fd80 0x7f483c09d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.888+0000 7f48408e6640 1 -- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483c15fd80 msgr2=0x7f483c09d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.888+0000 7f48408e6640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483c15fd80 0x7f483c09d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.888+0000 7f48408e6640 1 -- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483c0af4c0 msgr2=0x7f483c15ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.888+0000 7f48408e6640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483c0af4c0 0x7f483c15ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.888+0000 7f48408e6640 1 -- 172.21.15.50:0/1737080216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c06c020 con 0x7f483c0b09e0 2024-09-11T22:13:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.888+0000 7f48408e6640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f483c0b09e0 0x7f483c09c540 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4830035040 tx=0x7f48300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.888+0000 7f482dffb640 1 -- 172.21.15.50:0/1737080216 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830037040 con 0x7f483c0b09e0 2024-09-11T22:13:56.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.888+0000 7f482dffb640 1 -- 172.21.15.50:0/1737080216 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4830004030 con 0x7f483c0b09e0 2024-09-11T22:13:56.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.888+0000 7f484334b640 1 -- 172.21.15.50:0/1737080216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483c06c300 con 0x7f483c0b09e0 2024-09-11T22:13:56.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.888+0000 7f482dffb640 1 -- 172.21.15.50:0/1737080216 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830006e10 con 0x7f483c0b09e0 2024-09-11T22:13:56.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.888+0000 7f484334b640 1 -- 172.21.15.50:0/1737080216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f483c06c8c0 con 0x7f483c0b09e0 2024-09-11T22:13:56.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.890+0000 7f482dffb640 1 -- 172.21.15.50:0/1737080216 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4830003610 con 0x7f483c0b09e0 2024-09-11T22:13:56.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.890+0000 7f482dffb640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482006be30 0x7f482006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.890+0000 7f482dffb640 1 -- 172.21.15.50:0/1737080216 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f48300abad0 con 0x7f483c0b09e0 2024-09-11T22:13:56.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.891+0000 7f48410e7640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482006be30 0x7f482006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.891+0000 7f48410e7640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482006be30 0x7f482006e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4838000f60 tx=0x7f4838007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.891+0000 7f48461c0740 1 Processor -- start 2024-09-11T22:13:56.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.891+0000 7f48461c0740 1 -- start start 2024-09-11T22:13:56.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48461c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a427e0 0x558a78a42bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48461c0740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a3dee0 0x558a78a3cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48461c0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a3ffa0 0x558a78a3d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48461c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558a789a5710 con 0x558a78a427e0 2024-09-11T22:13:56.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48461c0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558a7894d540 con 0x558a78a3ffa0 2024-09-11T22:13:56.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48461c0740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558a789a16d0 con 0x558a78a3dee0 2024-09-11T22:13:56.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48410e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a427e0 0x558a78a42bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48410e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a427e0 0x558a78a42bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57972/0 (socket says 172.21.15.50:57972) 2024-09-11T22:13:56.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48410e7640 1 -- 172.21.15.50:0/3797874997 learned_addr learned my addr 172.21.15.50:0/3797874997 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48418e8640 1 --2- 172.21.15.50:0/3797874997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a3ffa0 0x558a78a3d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48408e6640 1 --2- 172.21.15.50:0/3797874997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a3dee0 0x558a78a3cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48410e7640 1 -- 172.21.15.50:0/3797874997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a3dee0 msgr2=0x558a78a3cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48410e7640 1 --2- 172.21.15.50:0/3797874997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a3dee0 0x558a78a3cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48410e7640 1 -- 172.21.15.50:0/3797874997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a3ffa0 msgr2=0x558a78a3d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48410e7640 1 --2- 172.21.15.50:0/3797874997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a3ffa0 0x558a78a3d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48410e7640 1 -- 172.21.15.50:0/3797874997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a78973170 con 0x558a78a427e0 2024-09-11T22:13:56.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.892+0000 7f48410e7640 1 --2- 172.21.15.50:0/3797874997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a427e0 0x558a78a42bc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4838004fb0 tx=0x7f4838013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888e96dbf06c8736 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.893+0000 7f4826ffd640 1 -- 172.21.15.50:0/3797874997 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838026070 con 0x558a78a427e0 2024-09-11T22:13:56.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.893+0000 7f4826ffd640 1 -- 172.21.15.50:0/3797874997 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4838013b80 con 0x558a78a427e0 2024-09-11T22:13:56.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.893+0000 7f4826ffd640 1 -- 172.21.15.50:0/3797874997 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838012350 con 0x558a78a427e0 2024-09-11T22:13:56.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.893+0000 7f48461c0740 1 -- 172.21.15.50:0/3797874997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a427e0 msgr2=0x558a78a42bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.893+0000 7f48461c0740 1 --2- 172.21.15.50:0/3797874997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a427e0 0x558a78a42bc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4838004fb0 tx=0x7f4838013000 comp rx=0 tx=0).stop 2024-09-11T22:13:56.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.893+0000 7f48461c0740 1 -- 172.21.15.50:0/3797874997 shutdown_connections 2024-09-11T22:13:56.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.893+0000 7f48461c0740 1 --2- 172.21.15.50:0/3797874997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a3dee0 0x558a78a3cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.893+0000 7f48461c0740 1 --2- 172.21.15.50:0/3797874997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a3ffa0 0x558a78a3d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.893+0000 7f48461c0740 1 --2- 172.21.15.50:0/3797874997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a427e0 0x558a78a42bc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.893+0000 7f48461c0740 1 -- 172.21.15.50:0/3797874997 >> 172.21.15.50:0/3797874997 conn(0x558a78a3efa0 msgr2=0x558a78a87660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.893+0000 7f48461c0740 1 -- 172.21.15.50:0/3797874997 shutdown_connections 2024-09-11T22:13:56.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.893+0000 7f48461c0740 1 -- 172.21.15.50:0/3797874997 wait complete. 2024-09-11T22:13:56.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.894+0000 7f48461c0740 1 -- start start 2024-09-11T22:13:56.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.894+0000 7f48461c0740 1 Processor -- start 2024-09-11T22:13:56.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48461c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a3ffa0 0x558a78a80c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48461c0740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a427e0 0x558a78a44660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48461c0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a7f680 0x558a78a44ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48461c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558a78a6d070 con 0x558a78a3ffa0 2024-09-11T22:13:56.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48461c0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558a7892e660 con 0x558a78a7f680 2024-09-11T22:13:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48461c0740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558a78a87d70 con 0x558a78a427e0 2024-09-11T22:13:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48461c0740 10 client.0 _ll_register_callbacks cb 0x558a786b7fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48410e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a3ffa0 0x558a78a80c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48410e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a3ffa0 0x558a78a80c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57978/0 (socket says 172.21.15.50:57978) 2024-09-11T22:13:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48410e7640 1 -- 172.21.15.50:0/1020932194 learned_addr learned my addr 172.21.15.50:0/1020932194 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48418e8640 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a7f680 0x558a78a44ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48408e6640 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a427e0 0x558a78a44660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48410e7640 1 -- 172.21.15.50:0/1020932194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a427e0 msgr2=0x558a78a44660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48410e7640 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a427e0 0x558a78a44660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48410e7640 1 -- 172.21.15.50:0/1020932194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a7f680 msgr2=0x558a78a44ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48410e7640 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a7f680 0x558a78a44ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48410e7640 1 -- 172.21.15.50:0/1020932194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a786b87b0 con 0x558a78a3ffa0 2024-09-11T22:13:56.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48418e8640 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a7f680 0x558a78a44ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:56.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f48410e7640 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a3ffa0 0x558a78a80c20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4838024040 tx=0x7f4838000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7503b2b0b783fa70 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.895+0000 7f481bfff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:56.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f481bfff640 1 -- 172.21.15.50:0/1020932194 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838030020 con 0x558a78a3ffa0 2024-09-11T22:13:56.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f481bfff640 1 -- 172.21.15.50:0/1020932194 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f4838021bd0 con 0x558a78a3ffa0 2024-09-11T22:13:56.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f48461c0740 1 -- 172.21.15.50:0/1020932194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4838013b80 con 0x558a78a3ffa0 2024-09-11T22:13:56.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f481bfff640 1 -- 172.21.15.50:0/1020932194 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f483803a050 con 0x558a78a3ffa0 2024-09-11T22:13:56.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f48461c0740 10 client.5580 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:56.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f48461c0740 1 -- 172.21.15.50:0/1020932194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x558a78782b90 con 0x558a78a3ffa0 2024-09-11T22:13:56.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f481bfff640 1 -- 172.21.15.50:0/1020932194 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4838013b80 con 0x558a78a3ffa0 2024-09-11T22:13:56.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f481bfff640 1 -- 172.21.15.50:0/1020932194 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f483803d020 con 0x558a78a3ffa0 2024-09-11T22:13:56.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f48461c0740 10 client.5580 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:56.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f48461c0740 10 client.5580 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:56.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f48461c0740 20 client.5580 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:56.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f48461c0740 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558a78aa27c0 0x558a78aa4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f48461c0740 4 client.5580 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:56.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f48461c0740 1 -- 172.21.15.50:0/1020932194 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a789b2e40 con 0x558a78aa27c0 2024-09-11T22:13:56.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.896+0000 7f48408e6640 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558a78aa27c0 0x558a78aa4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f481bfff640 10 client.5580 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f48408e6640 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558a78aa27c0 0x558a78aa4c00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5fc2d2f2607eb0a server_cookie=daed45413309fa7d in_seq=0 out_seq=0 2024-09-11T22:13:56.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f481bfff640 1 -- 172.21.15.50:0/1020932194 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a789b2e40 con 0x558a78aa27c0 2024-09-11T22:13:56.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f481bfff640 10 client.5580 handle_command_reply: tid=0 2024-09-11T22:13:56.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f48461c0740 1 client.5580 shutdown 2024-09-11T22:13:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f48461c0740 1 -- 172.21.15.50:0/1020932194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a3ffa0 msgr2=0x558a78a80c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f48461c0740 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a3ffa0 0x558a78a80c20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4838024040 tx=0x7f4838000ed0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f48461c0740 1 -- 172.21.15.50:0/1020932194 shutdown_connections 2024-09-11T22:13:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f48461c0740 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a427e0 0x558a78a44660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f48461c0740 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558a78aa27c0 0x558a78aa4c00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f48461c0740 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a7f680 0x558a78a44ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f48461c0740 1 --2- 172.21.15.50:0/1020932194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a3ffa0 0x558a78a80c20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f481bfff640 0 client.5580 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f48461c0740 1 -- 172.21.15.50:0/1020932194 >> 172.21.15.50:0/1020932194 conn(0x558a78a3dee0 msgr2=0x558a78a88290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.897+0000 7f48461c0740 1 -- 172.21.15.50:0/1020932194 shutdown_connections 2024-09-11T22:13:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.898+0000 7f48461c0740 1 -- 172.21.15.50:0/1020932194 wait complete. 2024-09-11T22:13:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.898+0000 7f48461c0740 20 client.5580 trim_cache size 0 max 16384 2024-09-11T22:13:56.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.912+0000 7f48461c0740 1 Processor -- start 2024-09-11T22:13:56.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.912+0000 7f48461c0740 1 -- start start 2024-09-11T22:13:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48461c0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a3ffa0 0x558a78a6b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48461c0740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a427e0 0x558a78a6ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48461c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 0x558a78a3e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48461c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f483c200ae0 con 0x558a78a7f680 2024-09-11T22:13:56.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48461c0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f483c1ffb60 con 0x558a78a3ffa0 2024-09-11T22:13:56.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48461c0740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f483c1feec0 con 0x558a78a427e0 2024-09-11T22:13:56.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48418e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 0x558a78a3e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48418e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 0x558a78a3e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57986/0 (socket says 172.21.15.50:57986) 2024-09-11T22:13:56.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48418e8640 1 -- 172.21.15.50:0/3406347732 learned_addr learned my addr 172.21.15.50:0/3406347732 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48410e7640 1 --2- 172.21.15.50:0/3406347732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a3ffa0 0x558a78a6b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48408e6640 1 --2- 172.21.15.50:0/3406347732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a427e0 0x558a78a6ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48418e8640 1 -- 172.21.15.50:0/3406347732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a427e0 msgr2=0x558a78a6ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48418e8640 1 --2- 172.21.15.50:0/3406347732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a427e0 0x558a78a6ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48418e8640 1 -- 172.21.15.50:0/3406347732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a3ffa0 msgr2=0x558a78a6b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48418e8640 1 --2- 172.21.15.50:0/3406347732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a3ffa0 0x558a78a6b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48418e8640 1 -- 172.21.15.50:0/3406347732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a78a852a0 con 0x558a78a7f680 2024-09-11T22:13:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.913+0000 7f48408e6640 1 --2- 172.21.15.50:0/3406347732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a427e0 0x558a78a6ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.914+0000 7f48418e8640 1 --2- 172.21.15.50:0/3406347732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 0x558a78a3e350 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f48340166f0 tx=0x7f4834009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb0c7a535468932 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.914+0000 7f48267fc640 1 -- 172.21.15.50:0/3406347732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4834022680 con 0x558a78a7f680 2024-09-11T22:13:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.914+0000 7f48267fc640 1 -- 172.21.15.50:0/3406347732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4834022840 con 0x558a78a7f680 2024-09-11T22:13:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.914+0000 7f48267fc640 1 -- 172.21.15.50:0/3406347732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4834022c30 con 0x558a78a7f680 2024-09-11T22:13:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.914+0000 7f48461c0740 1 -- 172.21.15.50:0/3406347732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 msgr2=0x558a78a3e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.914+0000 7f48461c0740 1 --2- 172.21.15.50:0/3406347732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 0x558a78a3e350 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f48340166f0 tx=0x7f4834009750 comp rx=0 tx=0).stop 2024-09-11T22:13:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.914+0000 7f48461c0740 1 -- 172.21.15.50:0/3406347732 shutdown_connections 2024-09-11T22:13:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.914+0000 7f48461c0740 1 --2- 172.21.15.50:0/3406347732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a427e0 0x558a78a6ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.914+0000 7f48461c0740 1 --2- 172.21.15.50:0/3406347732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 0x558a78a3e350 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.914+0000 7f48461c0740 1 --2- 172.21.15.50:0/3406347732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a3ffa0 0x558a78a6b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.914+0000 7f48461c0740 1 -- 172.21.15.50:0/3406347732 >> 172.21.15.50:0/3406347732 conn(0x558a78a3dee0 msgr2=0x558a78a80c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.914+0000 7f48461c0740 1 -- 172.21.15.50:0/3406347732 shutdown_connections 2024-09-11T22:13:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.914+0000 7f48461c0740 1 -- 172.21.15.50:0/3406347732 wait complete. 2024-09-11T22:13:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.915+0000 7f48461c0740 1 -- start start 2024-09-11T22:13:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.915+0000 7f48461c0740 1 Processor -- start 2024-09-11T22:13:56.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48461c0740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a3ffa0 0x558a78b05700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48461c0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a427e0 0x558a78aa0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48461c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 0x558a78a574f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48461c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f483c1ff510 con 0x558a78a7f680 2024-09-11T22:13:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48461c0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558a78a7f360 con 0x558a78a427e0 2024-09-11T22:13:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48461c0740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558a78a58130 con 0x558a78a3ffa0 2024-09-11T22:13:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48461c0740 10 client.0 _ll_register_callbacks cb 0x7f4838024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48418e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 0x558a78a574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48418e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 0x558a78a574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58000/0 (socket says 172.21.15.50:58000) 2024-09-11T22:13:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48418e8640 1 -- 172.21.15.50:0/1528534255 learned_addr learned my addr 172.21.15.50:0/1528534255 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48408e6640 1 --2- 172.21.15.50:0/1528534255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a427e0 0x558a78aa0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48410e7640 1 --2- 172.21.15.50:0/1528534255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a3ffa0 0x558a78b05700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48418e8640 1 -- 172.21.15.50:0/1528534255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a3ffa0 msgr2=0x558a78b05700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48418e8640 1 --2- 172.21.15.50:0/1528534255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a3ffa0 0x558a78b05700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48418e8640 1 -- 172.21.15.50:0/1528534255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a427e0 msgr2=0x558a78aa0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48418e8640 1 --2- 172.21.15.50:0/1528534255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a427e0 0x558a78aa0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48418e8640 1 -- 172.21.15.50:0/1528534255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a78a88450 con 0x558a78a7f680 2024-09-11T22:13:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f48418e8640 1 --2- 172.21.15.50:0/1528534255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 0x558a78a574f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4834016c70 tx=0x7f4834004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7607e0962661489 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.916+0000 7f481bfff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f481bfff640 1 -- 172.21.15.50:0/1528534255 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4834003990 con 0x558a78a7f680 2024-09-11T22:13:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f481bfff640 1 -- 172.21.15.50:0/1528534255 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f4834003b30 con 0x558a78a7f680 2024-09-11T22:13:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f48461c0740 1 -- 172.21.15.50:0/1528534255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4834022840 con 0x558a78a7f680 2024-09-11T22:13:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f481bfff640 1 -- 172.21.15.50:0/1528534255 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f4834037050 con 0x558a78a7f680 2024-09-11T22:13:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f48461c0740 10 client.5586 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f48461c0740 1 -- 172.21.15.50:0/1528534255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x558a78a57e70 con 0x558a78a7f680 2024-09-11T22:13:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f481bfff640 1 -- 172.21.15.50:0/1528534255 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4834022840 con 0x558a78a7f680 2024-09-11T22:13:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f481bfff640 1 -- 172.21.15.50:0/1528534255 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f483403a020 con 0x558a78a7f680 2024-09-11T22:13:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f48461c0740 10 client.5586 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f48461c0740 10 client.5586 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f48461c0740 20 client.5586 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f48461c0740 1 --2- 172.21.15.50:0/1528534255 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558a78a6eba0 0x558a78a447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f48461c0740 4 client.5586 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-11T22:13:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f48461c0740 1 -- 172.21.15.50:0/1528534255 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x558a789ad190 con 0x558a78a6eba0 2024-09-11T22:13:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.917+0000 7f48410e7640 1 --2- 172.21.15.50:0/1528534255 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558a78a6eba0 0x558a78a447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.918+0000 7f481bfff640 10 client.5586 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.918+0000 7f48410e7640 1 --2- 172.21.15.50:0/1528534255 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558a78a6eba0 0x558a78a447d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fce48a790cf0092a server_cookie=187cb192e2e9e843 in_seq=0 out_seq=0 2024-09-11T22:13:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f481bfff640 1 -- 172.21.15.50:0/1528534255 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558a789ad190 con 0x558a78a6eba0 2024-09-11T22:13:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f481bfff640 10 client.5586 handle_command_reply: tid=0 2024-09-11T22:13:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f48461c0740 1 client.5586 shutdown 2024-09-11T22:13:56.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f48461c0740 1 -- 172.21.15.50:0/1528534255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 msgr2=0x558a78a574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f48461c0740 1 --2- 172.21.15.50:0/1528534255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 0x558a78a574f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4834016c70 tx=0x7f4834004ab0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f48461c0740 1 -- 172.21.15.50:0/1528534255 shutdown_connections 2024-09-11T22:13:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f48461c0740 1 --2- 172.21.15.50:0/1528534255 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558a78a6eba0 0x558a78a447d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f481bfff640 0 client.5586 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f48461c0740 1 --2- 172.21.15.50:0/1528534255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558a78a7f680 0x558a78a574f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f48461c0740 1 --2- 172.21.15.50:0/1528534255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a78a427e0 0x558a78aa0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f48461c0740 1 --2- 172.21.15.50:0/1528534255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558a78a3ffa0 0x558a78b05700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f48461c0740 1 -- 172.21.15.50:0/1528534255 >> 172.21.15.50:0/1528534255 conn(0x558a78a3dee0 msgr2=0x558a78a845b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f48461c0740 1 -- 172.21.15.50:0/1528534255 shutdown_connections 2024-09-11T22:13:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.922+0000 7f48461c0740 1 -- 172.21.15.50:0/1528534255 wait complete. 2024-09-11T22:13:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.923+0000 7f48461c0740 20 client.5586 trim_cache size 0 max 16384 2024-09-11T22:13:56.927 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:56.927 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:13:56.927 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:13:56.927 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:56.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.923+0000 7f484334b640 1 -- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482006be30 msgr2=0x7f482006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.923+0000 7f484334b640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482006be30 0x7f482006e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4838000f60 tx=0x7f4838007d50 comp rx=0 tx=0).stop 2024-09-11T22:13:56.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.923+0000 7f484334b640 1 -- 172.21.15.50:0/1737080216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f483c0b09e0 msgr2=0x7f483c09c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:56.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.923+0000 7f484334b640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f483c0b09e0 0x7f483c09c540 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4830035040 tx=0x7f48300046c0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.923+0000 7f484334b640 1 -- 172.21.15.50:0/1737080216 shutdown_connections 2024-09-11T22:13:56.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.923+0000 7f484334b640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482006be30 0x7f482006e2f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.923+0000 7f484334b640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483c15fd80 0x7f483c09d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.923+0000 7f484334b640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f483c0b09e0 0x7f483c09c540 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.923+0000 7f484334b640 1 --2- 172.21.15.50:0/1737080216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483c0af4c0 0x7f483c15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:56.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.923+0000 7f484334b640 1 -- 172.21.15.50:0/1737080216 >> 172.21.15.50:0/1737080216 conn(0x7f483c09ba50 msgr2=0x7f483c0b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:56.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.923+0000 7f484334b640 1 -- 172.21.15.50:0/1737080216 shutdown_connections 2024-09-11T22:13:56.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:56.923+0000 7f484334b640 1 -- 172.21.15.50:0/1737080216 wait complete. 2024-09-11T22:13:56.935 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'message': '', 'return_code': 0}' 2024-09-11T22:13:56.935 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2024-09-11T22:13:56.935 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-11T22:13:56.935 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2024-09-11T22:13:56.935 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:13:56.936 DEBUG:teuthology.orchestra.run.smithi050:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-09-11T22:13:56.936 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-11T22:13:57.002 INFO:teuthology.orchestra.run.smithi050.stdout:1099511630412 2024-09-11T22:13:57.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:13:57.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-11T22:13:57.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.155+0000 7f351d4d2640 1 Processor -- start 2024-09-11T22:13:57.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.155+0000 7f351d4d2640 1 -- start start 2024-09-11T22:13:57.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.155+0000 7f351d4d2640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f351806d780 0x7f3518072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.156+0000 7f351d4d2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f351815bb00 0x7f35180b3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.156+0000 7f351d4d2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35180b5020 con 0x7f351815aad0 2024-09-11T22:13:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.156+0000 7f351d4d2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f351815aeb0 con 0x7f351815bb00 2024-09-11T22:13:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.156+0000 7f351d4d2640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f35180714d0 con 0x7f351806d780 2024-09-11T22:13:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.156+0000 7f35177fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f351815bb00 0x7f35180b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.156+0000 7f35177fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f351815bb00 0x7f35180b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58016/0 (socket says 172.21.15.50:58016) 2024-09-11T22:13:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.156+0000 7f35177fe640 1 -- 172.21.15.50:0/820640236 learned_addr learned my addr 172.21.15.50:0/820640236 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.156+0000 7f35177fe640 1 -- 172.21.15.50:0/820640236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f351806d780 msgr2=0x7f3518072cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.156+0000 7f35167fc640 1 --2- 172.21.15.50:0/820640236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f351806d780 0x7f3518072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.156+0000 7f35177fe640 1 --2- 172.21.15.50:0/820640236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f351806d780 0x7f3518072cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.156+0000 7f35177fe640 1 -- 172.21.15.50:0/820640236 >> v1:172.21.15.77:6789/0 conn(0x7f351815aad0 legacy=0x7f351806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.156+0000 7f35177fe640 1 -- 172.21.15.50:0/820640236 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35180717b0 con 0x7f351815bb00 2024-09-11T22:13:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.157+0000 7f35177fe640 1 --2- 172.21.15.50:0/820640236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351815bb00 0x7f35180b3400 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3510009e50 tx=0x7f351002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c030e804969903 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.157+0000 7f3515ffb640 1 -- 172.21.15.50:0/820640236 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510036070 con 0x7f351815bb00 2024-09-11T22:13:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.157+0000 7f3515ffb640 1 -- 172.21.15.50:0/820640236 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3510031600 con 0x7f351815bb00 2024-09-11T22:13:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.157+0000 7f3515ffb640 1 -- 172.21.15.50:0/820640236 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35100319d0 con 0x7f351815bb00 2024-09-11T22:13:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.157+0000 7f351d4d2640 1 -- 172.21.15.50:0/820640236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351815bb00 msgr2=0x7f35180b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.157+0000 7f351d4d2640 1 --2- 172.21.15.50:0/820640236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351815bb00 0x7f35180b3400 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3510009e50 tx=0x7f351002a6c0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.158+0000 7f351d4d2640 1 -- 172.21.15.50:0/820640236 shutdown_connections 2024-09-11T22:13:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.158+0000 7f351d4d2640 1 --2- 172.21.15.50:0/820640236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351815bb00 0x7f35180b3400 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.158+0000 7f351d4d2640 1 --2- 172.21.15.50:0/820640236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f351806d780 0x7f3518072cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.158+0000 7f351d4d2640 1 -- 172.21.15.50:0/820640236 >> 172.21.15.50:0/820640236 conn(0x7f35180679c0 msgr2=0x7f3518067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.158+0000 7f351d4d2640 1 -- 172.21.15.50:0/820640236 shutdown_connections 2024-09-11T22:13:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.158+0000 7f351d4d2640 1 -- 172.21.15.50:0/820640236 wait complete. 2024-09-11T22:13:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.159+0000 7f351d4d2640 1 Processor -- start 2024-09-11T22:13:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.159+0000 7f351d4d2640 1 -- start start 2024-09-11T22:13:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f351d4d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351806d780 0x7f3518158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f351d4d2640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f351815aad0 0x7f35180b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f351d4d2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f351815bb00 0x7f351813e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f351d4d2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3518072290 con 0x7f351806d780 2024-09-11T22:13:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f351d4d2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3518071d70 con 0x7f351815bb00 2024-09-11T22:13:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f351d4d2640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f351815bf40 con 0x7f351815aad0 2024-09-11T22:13:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f3516ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351806d780 0x7f3518158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f3516ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351806d780 0x7f3518158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58022/0 (socket says 172.21.15.50:58022) 2024-09-11T22:13:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f3516ffd640 1 -- 172.21.15.50:0/752722223 learned_addr learned my addr 172.21.15.50:0/752722223 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f35167fc640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f351815aad0 0x7f35180b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f35177fe640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f351815bb00 0x7f351813e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f3516ffd640 1 -- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f351815aad0 msgr2=0x7f35180b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f3516ffd640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f351815aad0 0x7f35180b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f3516ffd640 1 -- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f351815bb00 msgr2=0x7f351813e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f3516ffd640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f351815bb00 0x7f351813e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f3516ffd640 1 -- 172.21.15.50:0/752722223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35181572f0 con 0x7f351806d780 2024-09-11T22:13:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.160+0000 7f3516ffd640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351806d780 0x7f3518158a20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f350800c430 tx=0x7f350800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.161+0000 7f34ff7fe640 1 -- 172.21.15.50:0/752722223 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3508011790 con 0x7f351806d780 2024-09-11T22:13:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.161+0000 7f34ff7fe640 1 -- 172.21.15.50:0/752722223 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3508017070 con 0x7f351806d780 2024-09-11T22:13:57.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.161+0000 7f351d4d2640 1 -- 172.21.15.50:0/752722223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35181575d0 con 0x7f351806d780 2024-09-11T22:13:57.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.161+0000 7f34ff7fe640 1 -- 172.21.15.50:0/752722223 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3508011bb0 con 0x7f351806d780 2024-09-11T22:13:57.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.161+0000 7f351d4d2640 1 -- 172.21.15.50:0/752722223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3518157b90 con 0x7f351806d780 2024-09-11T22:13:57.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.162+0000 7f34ff7fe640 1 -- 172.21.15.50:0/752722223 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f350801c460 con 0x7f351806d780 2024-09-11T22:13:57.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.163+0000 7f34ff7fe640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f350406be30 0x7f350406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.163+0000 7f34ff7fe640 1 -- 172.21.15.50:0/752722223 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f350808ab80 con 0x7f351806d780 2024-09-11T22:13:57.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.163+0000 7f35167fc640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f350406be30 0x7f350406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.163+0000 7f3520263740 1 Processor -- start 2024-09-11T22:13:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.163+0000 7f35167fc640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f350406be30 0x7f350406e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35180cc9c0 tx=0x7f350c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.164+0000 7f3520263740 1 -- start start 2024-09-11T22:13:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.164+0000 7f3520263740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf5e5d0 0x55fd9cf5e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.164+0000 7f3520263740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5bd90 0x55fd9cf5d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.164+0000 7f3520263740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf3e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.164+0000 7f3520263740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fd9ce7a5d0 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.164+0000 7f3520263740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fd9ce22470 con 0x55fd9cf5bd90 2024-09-11T22:13:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.164+0000 7f3520263740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fd9ce76590 con 0x55fd9cf5e5d0 2024-09-11T22:13:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.164+0000 7f35177fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf3e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.165+0000 7f35177fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf3e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58024/0 (socket says 172.21.15.50:58024) 2024-09-11T22:13:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.165+0000 7f3516ffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf5e5d0 0x55fd9cf5e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.165+0000 7f35177fe640 1 -- 172.21.15.50:0/2393629700 learned_addr learned my addr 172.21.15.50:0/2393629700 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.165+0000 7f35167fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5bd90 0x55fd9cf5d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.165+0000 7f35177fe640 1 -- 172.21.15.50:0/2393629700 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf5e5d0 msgr2=0x55fd9cf5e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.165+0000 7f35177fe640 1 --2- 172.21.15.50:0/2393629700 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf5e5d0 0x55fd9cf5e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.165+0000 7f35177fe640 1 -- 172.21.15.50:0/2393629700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5bd90 msgr2=0x55fd9cf5d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.165+0000 7f35177fe640 1 --2- 172.21.15.50:0/2393629700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5bd90 0x55fd9cf5d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.165+0000 7f35177fe640 1 -- 172.21.15.50:0/2393629700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9ce0a860 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.165+0000 7f35177fe640 1 --2- 172.21.15.50:0/2393629700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf3e550 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3510009e50 tx=0x7f351002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d27ef23bd23464 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.165+0000 7f34fcff9640 1 -- 172.21.15.50:0/2393629700 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510036040 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.165+0000 7f34fcff9640 1 -- 172.21.15.50:0/2393629700 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3510037040 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.165+0000 7f34fcff9640 1 -- 172.21.15.50:0/2393629700 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35100319e0 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.166+0000 7f3520263740 1 -- 172.21.15.50:0/2393629700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 msgr2=0x55fd9cf3e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.166+0000 7f3520263740 1 --2- 172.21.15.50:0/2393629700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf3e550 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3510009e50 tx=0x7f351002e000 comp rx=0 tx=0).stop 2024-09-11T22:13:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.166+0000 7f3520263740 1 -- 172.21.15.50:0/2393629700 shutdown_connections 2024-09-11T22:13:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.166+0000 7f3520263740 1 --2- 172.21.15.50:0/2393629700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf3e550 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.166+0000 7f3520263740 1 --2- 172.21.15.50:0/2393629700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5bd90 0x55fd9cf5d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.166+0000 7f3520263740 1 --2- 172.21.15.50:0/2393629700 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf5e5d0 0x55fd9cf5e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.166+0000 7f3520263740 1 -- 172.21.15.50:0/2393629700 >> 172.21.15.50:0/2393629700 conn(0x55fd9cf14230 msgr2=0x55fd9cf5c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.166+0000 7f3520263740 1 -- 172.21.15.50:0/2393629700 shutdown_connections 2024-09-11T22:13:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.166+0000 7f3520263740 1 -- 172.21.15.50:0/2393629700 wait complete. 2024-09-11T22:13:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.166+0000 7f3520263740 1 -- start start 2024-09-11T22:13:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.167+0000 7f3520263740 1 Processor -- start 2024-09-11T22:13:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.167+0000 7f3520263740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf59340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.167+0000 7f3520263740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5e5d0 0x55fd9cf6c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.167+0000 7f3520263740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf57110 0x55fd9cf70250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.167+0000 7f3520263740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fd9cf5acf0 con 0x55fd9cf5e5d0 2024-09-11T22:13:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.167+0000 7f3520263740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fd9ce03620 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.167+0000 7f3520263740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fd9cf5afd0 con 0x55fd9cf57110 2024-09-11T22:13:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.167+0000 7f3520263740 10 client.0 _ll_register_callbacks cb 0x55fd9ce275b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.167+0000 7f35167fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5e5d0 0x55fd9cf6c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.167+0000 7f35167fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5e5d0 0x55fd9cf6c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58038/0 (socket says 172.21.15.50:58038) 2024-09-11T22:13:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.167+0000 7f35167fc640 1 -- 172.21.15.50:0/2899147805 learned_addr learned my addr 172.21.15.50:0/2899147805 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.167+0000 7f3516ffd640 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf59340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f35177fe640 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf57110 0x55fd9cf70250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f3516ffd640 1 -- 172.21.15.50:0/2899147805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf57110 msgr2=0x55fd9cf70250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f3516ffd640 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf57110 0x55fd9cf70250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f3516ffd640 1 -- 172.21.15.50:0/2899147805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5e5d0 msgr2=0x55fd9cf6c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f3516ffd640 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5e5d0 0x55fd9cf6c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f3516ffd640 1 -- 172.21.15.50:0/2899147805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9cb8d3f0 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f35167fc640 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5e5d0 0x55fd9cf6c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:13:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f3516ffd640 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf59340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35080890d0 tx=0x7f3508058db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5bc22fa0e4b75fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f34f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-11T22:13:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f34f5ffb640 1 -- 172.21.15.50:0/2899147805 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3508086020 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f3520263740 1 -- 172.21.15.50:0/2899147805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3510037040 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f34f5ffb640 1 -- 172.21.15.50:0/2899147805 <== mon.1 v2:172.21.15.77:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f3508058380 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f34f5ffb640 1 -- 172.21.15.50:0/2899147805 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f3508058580 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f3520263740 10 client.5311 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.168+0000 7f3520263740 1 -- 172.21.15.50:0/2899147805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x55fd9cc577d0 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.169+0000 7f34f5ffb640 1 -- 172.21.15.50:0/2899147805 <== mon.1 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3510037040 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.169+0000 7f34f5ffb640 1 -- 172.21.15.50:0/2899147805 <== mon.1 v2:172.21.15.77:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f350807b030 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.169+0000 7f3520263740 10 client.5311 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.169+0000 7f3520263740 10 client.5311 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.169+0000 7f3520263740 20 client.5311 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.169+0000 7f3520263740 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fd9cf409c0 0x55fd9cf40e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.169+0000 7f3520263740 4 client.5311 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.169+0000 7f3520263740 1 -- 172.21.15.50:0/2899147805 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd9ced9030 con 0x55fd9cf409c0 2024-09-11T22:13:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.169+0000 7f35167fc640 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fd9cf409c0 0x55fd9cf40e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.169+0000 7f35167fc640 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fd9cf409c0 0x55fd9cf40e00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7641257f853c2dd server_cookie=8a89de9018c05f46 in_seq=0 out_seq=0 2024-09-11T22:13:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.169+0000 7f34f5ffb640 10 client.5311 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f34f5ffb640 1 -- 172.21.15.50:0/2899147805 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd9ced9030 con 0x55fd9cf409c0 2024-09-11T22:13:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f34f5ffb640 10 client.5311 handle_command_reply: tid=0 2024-09-11T22:13:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f3520263740 1 client.5311 shutdown 2024-09-11T22:13:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f3520263740 1 -- 172.21.15.50:0/2899147805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5c1f0 msgr2=0x55fd9cf59340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f3520263740 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf59340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35080890d0 tx=0x7f3508058db0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f3520263740 1 -- 172.21.15.50:0/2899147805 shutdown_connections 2024-09-11T22:13:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f3520263740 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf57110 0x55fd9cf70250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f3520263740 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fd9cf409c0 0x55fd9cf40e00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f3520263740 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5e5d0 0x55fd9cf6c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f3520263740 1 --2- 172.21.15.50:0/2899147805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf59340 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f34f5ffb640 0 client.5311 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f3520263740 1 -- 172.21.15.50:0/2899147805 >> 172.21.15.50:0/2899147805 conn(0x55fd9cf5bd90 msgr2=0x55fd9cf5efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f3520263740 1 -- 172.21.15.50:0/2899147805 shutdown_connections 2024-09-11T22:13:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f3520263740 1 -- 172.21.15.50:0/2899147805 wait complete. 2024-09-11T22:13:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.170+0000 7f3520263740 20 client.5311 trim_cache size 0 max 16384 2024-09-11T22:13:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.183+0000 7f3520263740 1 Processor -- start 2024-09-11T22:13:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.183+0000 7f3520263740 1 -- start start 2024-09-11T22:13:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f3520263740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf57110 0x55fd9cf80c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f3520263740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf11340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f3520263740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf5e5d0 0x55fd9cf11880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f3520263740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3518200dc0 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f3520263740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3518154de0 con 0x55fd9cf57110 2024-09-11T22:13:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f3520263740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f35180cfaf0 con 0x55fd9cf5e5d0 2024-09-11T22:13:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f35167fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf11340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f35167fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf11340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58046/0 (socket says 172.21.15.50:58046) 2024-09-11T22:13:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f35167fc640 1 -- 172.21.15.50:0/848531950 learned_addr learned my addr 172.21.15.50:0/848531950 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f35167fc640 1 -- 172.21.15.50:0/848531950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf5e5d0 msgr2=0x55fd9cf11880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f35167fc640 1 --2- 172.21.15.50:0/848531950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf5e5d0 0x55fd9cf11880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f3516ffd640 1 --2- 172.21.15.50:0/848531950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf57110 0x55fd9cf80c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f35167fc640 1 -- 172.21.15.50:0/848531950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf57110 msgr2=0x55fd9cf80c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f35167fc640 1 --2- 172.21.15.50:0/848531950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf57110 0x55fd9cf80c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f35167fc640 1 -- 172.21.15.50:0/848531950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9cf13fd0 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.184+0000 7f35167fc640 1 --2- 172.21.15.50:0/848531950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf11340 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f350c00afd0 tx=0x7f350c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7748cd14bbff0b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.185+0000 7f34f7fff640 1 -- 172.21.15.50:0/848531950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c029530 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.185+0000 7f34f7fff640 1 -- 172.21.15.50:0/848531950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350c02e070 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.185+0000 7f34f7fff640 1 -- 172.21.15.50:0/848531950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c0298d0 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.185+0000 7f3520263740 1 -- 172.21.15.50:0/848531950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 msgr2=0x55fd9cf11340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.185+0000 7f3520263740 1 --2- 172.21.15.50:0/848531950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf11340 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f350c00afd0 tx=0x7f350c016000 comp rx=0 tx=0).stop 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.185+0000 7f3520263740 1 -- 172.21.15.50:0/848531950 shutdown_connections 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.185+0000 7f3520263740 1 --2- 172.21.15.50:0/848531950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf5e5d0 0x55fd9cf11880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.185+0000 7f3520263740 1 --2- 172.21.15.50:0/848531950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf11340 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.185+0000 7f3520263740 1 --2- 172.21.15.50:0/848531950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf57110 0x55fd9cf80c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.185+0000 7f3520263740 1 -- 172.21.15.50:0/848531950 >> 172.21.15.50:0/848531950 conn(0x55fd9cf5bd90 msgr2=0x55fd9cf0d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.185+0000 7f3520263740 1 -- 172.21.15.50:0/848531950 shutdown_connections 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.185+0000 7f3520263740 1 -- 172.21.15.50:0/848531950 wait complete. 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.186+0000 7f3520263740 1 -- start start 2024-09-11T22:13:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.186+0000 7f3520263740 1 Processor -- start 2024-09-11T22:13:57.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f3520263740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf57110 0x55fd9cf17d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f3520263740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf182c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f3520263740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5e5d0 0x55fd9cf70c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f3520263740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fd9cf58790 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f3520263740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3518154790 con 0x55fd9cf5e5d0 2024-09-11T22:13:57.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f3520263740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fd9cf3da90 con 0x55fd9cf57110 2024-09-11T22:13:57.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f3520263740 10 client.0 _ll_register_callbacks cb 0x7f350805d250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:57.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f35167fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf182c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f35167fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf182c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58062/0 (socket says 172.21.15.50:58062) 2024-09-11T22:13:57.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f35167fc640 1 -- 172.21.15.50:0/2016267879 learned_addr learned my addr 172.21.15.50:0/2016267879 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f35177fe640 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5e5d0 0x55fd9cf70c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f3516ffd640 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf57110 0x55fd9cf17d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f35167fc640 1 -- 172.21.15.50:0/2016267879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf57110 msgr2=0x55fd9cf17d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f35167fc640 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf57110 0x55fd9cf17d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f35167fc640 1 -- 172.21.15.50:0/2016267879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5e5d0 msgr2=0x55fd9cf70c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f35167fc640 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5e5d0 0x55fd9cf70c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f35167fc640 1 -- 172.21.15.50:0/2016267879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9cf3bb00 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f3516ffd640 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf57110 0x55fd9cf17d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f35167fc640 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf182c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f350c008010 tx=0x7f350c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efef897b6e9bb873 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f34f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f34f5ffb640 1 -- 172.21.15.50:0/2016267879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c0219e0 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f34f5ffb640 1 -- 172.21.15.50:0/2016267879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f350c021b80 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.187+0000 7f3520263740 1 -- 172.21.15.50:0/2016267879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f350c02e070 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f34f5ffb640 1 -- 172.21.15.50:0/2016267879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f350c021d80 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f3520263740 10 client.5604 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f3520263740 1 -- 172.21.15.50:0/2016267879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x55fd9cf40380 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f34f5ffb640 1 -- 172.21.15.50:0/2016267879 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350c02e070 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f34f5ffb640 1 -- 172.21.15.50:0/2016267879 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f350c01e040 con 0x55fd9cf5c1f0 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f3520263740 10 client.5604 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f3520263740 10 client.5604 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f3520263740 20 client.5604 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f3520263740 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fd9cf19390 0x55fd9cf711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f3520263740 4 client.5604 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f3520263740 1 -- 172.21.15.50:0/2016267879 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd9ce87d00 con 0x55fd9cf19390 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f3516ffd640 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fd9cf19390 0x55fd9cf711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f34f5ffb640 10 client.5604 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:57.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f3516ffd640 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fd9cf19390 0x55fd9cf711a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99c5cbfbaa91541f server_cookie=2487782661a4d5c0 in_seq=0 out_seq=0 2024-09-11T22:13:57.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f34f5ffb640 1 -- 172.21.15.50:0/2016267879 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd9ce87d00 con 0x55fd9cf19390 2024-09-11T22:13:57.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f34f5ffb640 10 client.5604 handle_command_reply: tid=0 2024-09-11T22:13:57.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.188+0000 7f3520263740 1 client.5604 shutdown 2024-09-11T22:13:57.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f3520263740 1 -- 172.21.15.50:0/2016267879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 msgr2=0x55fd9cf182c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f3520263740 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf182c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f350c008010 tx=0x7f350c004730 comp rx=0 tx=0).stop 2024-09-11T22:13:57.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f3520263740 1 -- 172.21.15.50:0/2016267879 shutdown_connections 2024-09-11T22:13:57.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f3520263740 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fd9cf19390 0x55fd9cf711a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f3520263740 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd9cf5e5d0 0x55fd9cf70c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f3520263740 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd9cf5c1f0 0x55fd9cf182c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f34f5ffb640 0 client.5604 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:57.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f3520263740 1 --2- 172.21.15.50:0/2016267879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd9cf57110 0x55fd9cf17d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f3520263740 1 -- 172.21.15.50:0/2016267879 >> 172.21.15.50:0/2016267879 conn(0x55fd9cf5bd90 msgr2=0x55fd9cf577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f3520263740 1 -- 172.21.15.50:0/2016267879 shutdown_connections 2024-09-11T22:13:57.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f3520263740 1 -- 172.21.15.50:0/2016267879 wait complete. 2024-09-11T22:13:57.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f3520263740 20 client.5604 trim_cache size 0 max 16384 2024-09-11T22:13:57.198 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-11T22:13:57.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f351d4d2640 1 -- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f350406be30 msgr2=0x7f350406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f351d4d2640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f350406be30 0x7f350406e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35180cc9c0 tx=0x7f350c008040 comp rx=0 tx=0).stop 2024-09-11T22:13:57.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f351d4d2640 1 -- 172.21.15.50:0/752722223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351806d780 msgr2=0x7f3518158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f351d4d2640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351806d780 0x7f3518158a20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f350800c430 tx=0x7f350800c8f0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f351d4d2640 1 -- 172.21.15.50:0/752722223 shutdown_connections 2024-09-11T22:13:57.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f351d4d2640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f350406be30 0x7f350406e2f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f351d4d2640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f351815aad0 0x7f35180b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f351d4d2640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f351815bb00 0x7f351813e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f351d4d2640 1 --2- 172.21.15.50:0/752722223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351806d780 0x7f3518158a20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f351d4d2640 1 -- 172.21.15.50:0/752722223 >> 172.21.15.50:0/752722223 conn(0x7f35180679c0 msgr2=0x7f35180b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f351d4d2640 1 -- 172.21.15.50:0/752722223 shutdown_connections 2024-09-11T22:13:57.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.189+0000 7f351d4d2640 1 -- 172.21.15.50:0/752722223 wait complete. 2024-09-11T22:13:57.201 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4c.00000000 parent 2024-09-11T22:13:57.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.245+0000 7fcc37a2ff40 1 Processor -- start 2024-09-11T22:13:57.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.245+0000 7fcc37a2ff40 1 -- start start 2024-09-11T22:13:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc37a2ff40 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d3b7eee00 0x560d3b8bc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc37a2ff40 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560d3b7f1db0 0x560d3b8c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc37a2ff40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d3b8c08d0 0x560d3b7ef240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc37a2ff40 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560d3b740510 con 0x560d3b7eee00 2024-09-11T22:13:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc37a2ff40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560d3b799c50 con 0x560d3b8c08d0 2024-09-11T22:13:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc37a2ff40 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560d3b7ee970 con 0x560d3b7f1db0 2024-09-11T22:13:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc35525640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d3b7eee00 0x560d3b8bc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc35525640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d3b7eee00 0x560d3b8bc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58076/0 (socket says 172.21.15.50:58076) 2024-09-11T22:13:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc35525640 1 -- 172.21.15.50:0/2657583847 learned_addr learned my addr 172.21.15.50:0/2657583847 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc35525640 1 -- 172.21.15.50:0/2657583847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560d3b7f1db0 msgr2=0x560d3b8c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc35525640 1 --2- 172.21.15.50:0/2657583847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560d3b7f1db0 0x560d3b8c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc35525640 1 -- 172.21.15.50:0/2657583847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d3b8c08d0 msgr2=0x560d3b7ef240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc35525640 1 --2- 172.21.15.50:0/2657583847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d3b8c08d0 0x560d3b7ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.246+0000 7fcc35525640 1 -- 172.21.15.50:0/2657583847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d3b8c61c0 con 0x560d3b7eee00 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.247+0000 7fcc35525640 1 --2- 172.21.15.50:0/2657583847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d3b7eee00 0x560d3b8bc420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800a430 tx=0x7fcc2800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6220911f87aebe81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.247+0000 7fcc277fe640 1 -- 172.21.15.50:0/2657583847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800b8c0 con 0x560d3b7eee00 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.247+0000 7fcc277fe640 1 -- 172.21.15.50:0/2657583847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2800f030 con 0x560d3b7eee00 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.247+0000 7fcc277fe640 1 -- 172.21.15.50:0/2657583847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800bcc0 con 0x560d3b7eee00 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.247+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/2657583847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d3b7eee00 msgr2=0x560d3b8bc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.247+0000 7fcc37a2ff40 1 --2- 172.21.15.50:0/2657583847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d3b7eee00 0x560d3b8bc420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800a430 tx=0x7fcc2800a8f0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.247+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/2657583847 shutdown_connections 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.247+0000 7fcc37a2ff40 1 --2- 172.21.15.50:0/2657583847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560d3b7f1db0 0x560d3b8c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.247+0000 7fcc37a2ff40 1 --2- 172.21.15.50:0/2657583847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d3b8c08d0 0x560d3b7ef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.247+0000 7fcc37a2ff40 1 --2- 172.21.15.50:0/2657583847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d3b7eee00 0x560d3b8bc420 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.247+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/2657583847 >> 172.21.15.50:0/2657583847 conn(0x560d3b7eda80 msgr2=0x560d3b839c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.247+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/2657583847 shutdown_connections 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.247+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/2657583847 wait complete. 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.248+0000 7fcc37a2ff40 1 Processor -- start 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.248+0000 7fcc37a2ff40 1 -- start start 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.248+0000 7fcc37a2ff40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d3b7eee00 0x560d3b8b9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.248+0000 7fcc37a2ff40 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560d3b7f1db0 0x560d3b8ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.248+0000 7fcc37a2ff40 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d3b8c08d0 0x560d3b8b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc37a2ff40 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560d3b8bdf10 con 0x560d3b8c08d0 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc37a2ff40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560d3b8bca50 con 0x560d3b7eee00 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc37a2ff40 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560d3b8c97d0 con 0x560d3b7f1db0 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc35d26640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d3b8c08d0 0x560d3b8b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc35d26640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d3b8c08d0 0x560d3b8b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58088/0 (socket says 172.21.15.50:58088) 2024-09-11T22:13:57.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc35d26640 1 -- 172.21.15.50:0/894851429 learned_addr learned my addr 172.21.15.50:0/894851429 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc34d24640 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560d3b7f1db0 0x560d3b8ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc35525640 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d3b7eee00 0x560d3b8b9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc35d26640 1 -- 172.21.15.50:0/894851429 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560d3b7f1db0 msgr2=0x560d3b8ba3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc35d26640 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560d3b7f1db0 0x560d3b8ba3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc35d26640 1 -- 172.21.15.50:0/894851429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d3b7eee00 msgr2=0x560d3b8b9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc35d26640 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560d3b7eee00 0x560d3b8b9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc35d26640 1 -- 172.21.15.50:0/894851429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d3b8c8be0 con 0x560d3b8c08d0 2024-09-11T22:13:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc35d26640 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d3b8c08d0 0x560d3b8b2aa0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcc300021a0 tx=0x7fcc3000b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc267fc640 1 -- 172.21.15.50:0/894851429 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc300062d0 con 0x560d3b8c08d0 2024-09-11T22:13:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc267fc640 1 -- 172.21.15.50:0/894851429 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc30003450 con 0x560d3b8c08d0 2024-09-11T22:13:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/894851429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d3b8c8ec0 con 0x560d3b8c08d0 2024-09-11T22:13:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc267fc640 1 -- 172.21.15.50:0/894851429 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30003880 con 0x560d3b8c08d0 2024-09-11T22:13:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.249+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/894851429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d3b8b3930 con 0x560d3b8c08d0 2024-09-11T22:13:57.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.251+0000 7fcc267fc640 1 -- 172.21.15.50:0/894851429 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc30010070 con 0x560d3b8c08d0 2024-09-11T22:13:57.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.251+0000 7fcc267fc640 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcc1806a9b0 0x7fcc1806ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.251+0000 7fcc267fc640 1 -- 172.21.15.50:0/894851429 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fcc30089510 con 0x560d3b8c08d0 2024-09-11T22:13:57.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.251+0000 7fcc37a2ff40 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x560d3b81b040 0x560d3b81b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.251+0000 7fcc35525640 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcc1806a9b0 0x7fcc1806ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.251+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/894851429 --> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] -- osd_op(unknown.0.0:1 7.3a 7:5fa3b718:::10000000a4c.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47) -- 0x560d3b81b960 con 0x560d3b81b040 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.252+0000 7fcc34d24640 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x560d3b81b040 0x560d3b81b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.252+0000 7fcc35525640 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcc1806a9b0 0x7fcc1806ce70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800a930 tx=0x7fcc28008000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.252+0000 7fcc34d24640 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x560d3b81b040 0x560d3b81b420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.253+0000 7fcc34d24640 1 -- 172.21.15.50:0/894851429 <== osd.3 v2:172.21.15.50:6800/593319808 1 ==== osd_op_reply(1 10000000a4c.00000000 [rmxattr] v47'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcc2c0527f0 con 0x560d3b81b040 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.253+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/894851429 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x560d3b81b040 msgr2=0x560d3b81b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.253+0000 7fcc37a2ff40 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x560d3b81b040 0x560d3b81b420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.253+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/894851429 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcc1806a9b0 msgr2=0x7fcc1806ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.253+0000 7fcc37a2ff40 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcc1806a9b0 0x7fcc1806ce70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800a930 tx=0x7fcc28008000 comp rx=0 tx=0).stop 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.253+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/894851429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d3b8c08d0 msgr2=0x560d3b8b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.253+0000 7fcc37a2ff40 1 --2- 172.21.15.50:0/894851429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d3b8c08d0 0x560d3b8b2aa0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcc300021a0 tx=0x7fcc3000b570 comp rx=0 tx=0).stop 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.253+0000 7fcc35d26640 1 -- 172.21.15.50:0/894851429 reap_dead start 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.253+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/894851429 shutdown_connections 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.253+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/894851429 >> 172.21.15.50:0/894851429 conn(0x560d3b7eda80 msgr2=0x560d3b839ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.253+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/894851429 shutdown_connections 2024-09-11T22:13:57.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.253+0000 7fcc37a2ff40 1 -- 172.21.15.50:0/894851429 wait complete. 2024-09-11T22:13:57.259 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-11T22:13:57.259 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-11T22:13:57.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.365+0000 7faa71cd9640 1 Processor -- start 2024-09-11T22:13:57.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.365+0000 7faa71cd9640 1 -- start start 2024-09-11T22:13:57.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.366+0000 7faa71cd9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faa6c0d18a0 0x7faa6c0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.366+0000 7faa71cd9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6c0cfa80 con 0x7faa6c0d3a30 2024-09-11T22:13:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.366+0000 7faa71cd9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6c0d40d0 con 0x7faa6c15e870 2024-09-11T22:13:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.366+0000 7faa71cd9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7faa6c0d3ea0 con 0x7faa6c0d18a0 2024-09-11T22:13:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.366+0000 7faa6bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faa6c0d3a30 0x7faa6c0b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52828/0 (socket says 172.21.15.50:52828) 2024-09-11T22:13:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.366+0000 7faa6bfff640 1 -- 172.21.15.50:0/1546487984 learned_addr learned my addr 172.21.15.50:0/1546487984 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:13:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.366+0000 7faa6affd640 1 --2- 172.21.15.50:0/1546487984 >> v2:172.21.15.77:3300/0 conn(0x7faa6c0d18a0 0x7faa6c0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.366+0000 7faa6a7fc640 1 -- 172.21.15.50:0/1546487984 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1526976221 0 0) 0x7faa64001490 con 0x7faa6c0d3a30 2024-09-11T22:13:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.366+0000 7faa6a7fc640 1 -- 172.21.15.50:0/1546487984 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa54003520 con 0x7faa6c0d3a30 2024-09-11T22:13:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.366+0000 7faa6affd640 1 -- 172.21.15.50:0/1546487984 >> v1:172.21.15.77:6789/0 conn(0x7faa6c15e870 legacy=0x7faa6c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.366+0000 7faa6affd640 1 -- 172.21.15.50:0/1546487984 >> v1:172.21.15.50:6789/0 conn(0x7faa6c0d3a30 legacy=0x7faa6c0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.366+0000 7faa6a7fc640 1 -- 172.21.15.50:0/1546487984 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915823460 0 0) 0x7faa6c0d40d0 con 0x7faa6c15e870 2024-09-11T22:13:57.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.366+0000 7faa6affd640 1 -- 172.21.15.50:0/1546487984 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c0d43b0 con 0x7faa6c0d18a0 2024-09-11T22:13:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.367+0000 7faa6affd640 1 --2- 172.21.15.50:0/1546487984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0d18a0 0x7faa6c0d34f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faa600097a0 tx=0x7faa6002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a50e554c0bcd4277 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.367+0000 7faa6a7fc640 1 -- 172.21.15.50:0/1546487984 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60037070 con 0x7faa6c0d18a0 2024-09-11T22:13:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.367+0000 7faa6a7fc640 1 -- 172.21.15.50:0/1546487984 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa60032440 con 0x7faa6c0d18a0 2024-09-11T22:13:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.367+0000 7faa6a7fc640 1 -- 172.21.15.50:0/1546487984 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600327f0 con 0x7faa6c0d18a0 2024-09-11T22:13:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.368+0000 7faa71cd9640 1 -- 172.21.15.50:0/1546487984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0d18a0 msgr2=0x7faa6c0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.368+0000 7faa71cd9640 1 --2- 172.21.15.50:0/1546487984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0d18a0 0x7faa6c0d34f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faa600097a0 tx=0x7faa6002a230 comp rx=0 tx=0).stop 2024-09-11T22:13:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.368+0000 7faa71cd9640 1 -- 172.21.15.50:0/1546487984 shutdown_connections 2024-09-11T22:13:57.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.368+0000 7faa71cd9640 1 --2- 172.21.15.50:0/1546487984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0d18a0 0x7faa6c0d34f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.368+0000 7faa71cd9640 1 -- 172.21.15.50:0/1546487984 >> 172.21.15.50:0/1546487984 conn(0x7faa6c0727a0 msgr2=0x7faa6c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.368+0000 7faa71cd9640 1 -- 172.21.15.50:0/1546487984 shutdown_connections 2024-09-11T22:13:57.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.368+0000 7faa71cd9640 1 -- 172.21.15.50:0/1546487984 wait complete. 2024-09-11T22:13:57.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.369+0000 7faa71cd9640 1 Processor -- start 2024-09-11T22:13:57.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.369+0000 7faa71cd9640 1 -- start start 2024-09-11T22:13:57.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa71cd9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0d18a0 0x7faa6c14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa71cd9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa6c0d3a30 0x7faa6c1e8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa71cd9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c15e870 0x7faa6c0cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa71cd9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c15ec50 con 0x7faa6c15e870 2024-09-11T22:13:57.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa71cd9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c0b7ee0 con 0x7faa6c0d18a0 2024-09-11T22:13:57.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa71cd9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faa6c0b78b0 con 0x7faa6c0d3a30 2024-09-11T22:13:57.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c15e870 0x7faa6c0cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c15e870 0x7faa6c0cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58090/0 (socket says 172.21.15.50:58090) 2024-09-11T22:13:57.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa6bfff640 1 -- 172.21.15.50:0/3715558025 learned_addr learned my addr 172.21.15.50:0/3715558025 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa6affd640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa6c0d3a30 0x7faa6c1e8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa6b7fe640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0d18a0 0x7faa6c14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa6bfff640 1 -- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa6c0d3a30 msgr2=0x7faa6c1e8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa6bfff640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa6c0d3a30 0x7faa6c1e8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa6bfff640 1 -- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0d18a0 msgr2=0x7faa6c14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa6bfff640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0d18a0 0x7faa6c14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa6bfff640 1 -- 172.21.15.50:0/3715558025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c0cc310 con 0x7faa6c15e870 2024-09-11T22:13:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa6b7fe640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0d18a0 0x7faa6c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.370+0000 7faa6affd640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa6c0d3a30 0x7faa6c1e8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:57.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.371+0000 7faa6bfff640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c15e870 0x7faa6c0cb850 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faa6400cb80 tx=0x7faa6400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.371+0000 7faa53fff640 1 -- 172.21.15.50:0/3715558025 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64017070 con 0x7faa6c15e870 2024-09-11T22:13:57.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.371+0000 7faa53fff640 1 -- 172.21.15.50:0/3715558025 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6400ad40 con 0x7faa6c15e870 2024-09-11T22:13:57.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.371+0000 7faa71cd9640 1 -- 172.21.15.50:0/3715558025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6c0cc5f0 con 0x7faa6c15e870 2024-09-11T22:13:57.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.371+0000 7faa53fff640 1 -- 172.21.15.50:0/3715558025 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64012620 con 0x7faa6c15e870 2024-09-11T22:13:57.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.371+0000 7faa71cd9640 1 -- 172.21.15.50:0/3715558025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6c14cec0 con 0x7faa6c15e870 2024-09-11T22:13:57.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.372+0000 7faa53fff640 1 -- 172.21.15.50:0/3715558025 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa6401a070 con 0x7faa6c15e870 2024-09-11T22:13:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.373+0000 7faa53fff640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa5806be30 0x7faa5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.373+0000 7faa53fff640 1 -- 172.21.15.50:0/3715558025 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7faa6408ad80 con 0x7faa6c15e870 2024-09-11T22:13:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.373+0000 7faa6b7fe640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa5806be30 0x7faa5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.374+0000 7faa74a6e740 1 Processor -- start 2024-09-11T22:13:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.374+0000 7faa6b7fe640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa5806be30 0x7faa5806e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faa5c000f60 tx=0x7faa5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.374+0000 7faa74a6e740 1 -- start start 2024-09-11T22:13:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa74a6e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f15650 0x557d94f15a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa74a6e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f12e10 0x557d94f149a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa74a6e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f13270 0x557d94ef55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa74a6e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557d94e31c10 con 0x557d94f13270 2024-09-11T22:13:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa74a6e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557d94dd9900 con 0x557d94f15650 2024-09-11T22:13:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa74a6e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557d94e2dbd0 con 0x557d94f12e10 2024-09-11T22:13:57.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f13270 0x557d94ef55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f13270 0x557d94ef55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58106/0 (socket says 172.21.15.50:58106) 2024-09-11T22:13:57.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa6bfff640 1 -- 172.21.15.50:0/1113687576 learned_addr learned my addr 172.21.15.50:0/1113687576 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa6b7fe640 1 --2- 172.21.15.50:0/1113687576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f15650 0x557d94f15a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa6affd640 1 --2- 172.21.15.50:0/1113687576 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f12e10 0x557d94f149a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa6bfff640 1 -- 172.21.15.50:0/1113687576 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f12e10 msgr2=0x557d94f149a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa6bfff640 1 --2- 172.21.15.50:0/1113687576 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f12e10 0x557d94f149a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa6bfff640 1 -- 172.21.15.50:0/1113687576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f15650 msgr2=0x557d94f15a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa6bfff640 1 --2- 172.21.15.50:0/1113687576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f15650 0x557d94f15a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa6bfff640 1 -- 172.21.15.50:0/1113687576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d94c10c00 con 0x557d94f13270 2024-09-11T22:13:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa6bfff640 1 --2- 172.21.15.50:0/1113687576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f13270 0x557d94ef55d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faa64089210 tx=0x7faa640015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f287d8a19f23917 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa517fa640 1 -- 172.21.15.50:0/1113687576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64057260 con 0x557d94f13270 2024-09-11T22:13:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa517fa640 1 -- 172.21.15.50:0/1113687576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa640555d0 con 0x557d94f13270 2024-09-11T22:13:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.375+0000 7faa517fa640 1 -- 172.21.15.50:0/1113687576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64061940 con 0x557d94f13270 2024-09-11T22:13:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.376+0000 7faa74a6e740 1 -- 172.21.15.50:0/1113687576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f13270 msgr2=0x557d94ef55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.376+0000 7faa74a6e740 1 --2- 172.21.15.50:0/1113687576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f13270 0x557d94ef55d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faa64089210 tx=0x7faa640015f0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.376+0000 7faa74a6e740 1 -- 172.21.15.50:0/1113687576 shutdown_connections 2024-09-11T22:13:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.376+0000 7faa74a6e740 1 --2- 172.21.15.50:0/1113687576 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f12e10 0x557d94f149a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.376+0000 7faa74a6e740 1 --2- 172.21.15.50:0/1113687576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f13270 0x557d94ef55d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.376+0000 7faa74a6e740 1 --2- 172.21.15.50:0/1113687576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f15650 0x557d94f15a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.376+0000 7faa74a6e740 1 -- 172.21.15.50:0/1113687576 >> 172.21.15.50:0/1113687576 conn(0x557d94ecb2b0 msgr2=0x557d94f136c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.376+0000 7faa74a6e740 1 -- 172.21.15.50:0/1113687576 shutdown_connections 2024-09-11T22:13:57.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.376+0000 7faa74a6e740 1 -- 172.21.15.50:0/1113687576 wait complete. 2024-09-11T22:13:57.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.377+0000 7faa74a6e740 1 -- start start 2024-09-11T22:13:57.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.377+0000 7faa74a6e740 1 Processor -- start 2024-09-11T22:13:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa74a6e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f13270 0x557d94ef30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa74a6e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f15650 0x557d94f24280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa74a6e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 0x557d94f0a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa74a6e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557d94f11d70 con 0x557d94f0b100 2024-09-11T22:13:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa74a6e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557d94dba900 con 0x557d94f15650 2024-09-11T22:13:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa74a6e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557d94f12050 con 0x557d94f13270 2024-09-11T22:13:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa74a6e740 10 client.0 _ll_register_callbacks cb 0x557d94b43fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:57.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 0x557d94f0a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 0x557d94f0a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58110/0 (socket says 172.21.15.50:58110) 2024-09-11T22:13:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa6bfff640 1 -- 172.21.15.50:0/4033195225 learned_addr learned my addr 172.21.15.50:0/4033195225 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa6b7fe640 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f13270 0x557d94ef30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa6affd640 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f15650 0x557d94f24280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa6bfff640 1 -- 172.21.15.50:0/4033195225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f13270 msgr2=0x557d94ef30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa6bfff640 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f13270 0x557d94ef30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa6bfff640 1 -- 172.21.15.50:0/4033195225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f15650 msgr2=0x557d94f24280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa6bfff640 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f15650 0x557d94f24280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa6bfff640 1 -- 172.21.15.50:0/4033195225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d94b044f0 con 0x557d94f0b100 2024-09-11T22:13:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa6affd640 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f15650 0x557d94f24280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:13:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa6bfff640 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 0x557d94f0a560 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faa64015040 tx=0x7faa64089140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d88fdbe0373efa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa4a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:57.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa4a7fc640 1 -- 172.21.15.50:0/4033195225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64086070 con 0x557d94f0b100 2024-09-11T22:13:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa4a7fc640 1 -- 172.21.15.50:0/4033195225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7faa64082dd0 con 0x557d94f0b100 2024-09-11T22:13:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa74a6e740 1 -- 172.21.15.50:0/4033195225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa640555d0 con 0x557d94f0b100 2024-09-11T22:13:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.378+0000 7faa4a7fc640 1 -- 172.21.15.50:0/4033195225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7faa64071050 con 0x557d94f0b100 2024-09-11T22:13:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.379+0000 7faa74a6e740 10 client.5628 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.379+0000 7faa74a6e740 1 -- 172.21.15.50:0/4033195225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x557d94c71390 con 0x557d94f0b100 2024-09-11T22:13:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.379+0000 7faa4a7fc640 1 -- 172.21.15.50:0/4033195225 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa640555d0 con 0x557d94f0b100 2024-09-11T22:13:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.379+0000 7faa4a7fc640 1 -- 172.21.15.50:0/4033195225 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7faa64073020 con 0x557d94f0b100 2024-09-11T22:13:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.379+0000 7faa74a6e740 10 client.5628 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.379+0000 7faa74a6e740 10 client.5628 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.379+0000 7faa74a6e740 20 client.5628 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.379+0000 7faa74a6e740 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x557d94f0c1f0 0x557d94f0c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.379+0000 7faa74a6e740 4 client.5628 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.379+0000 7faa74a6e740 1 -- 172.21.15.50:0/4033195225 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d94e3f340 con 0x557d94f0c1f0 2024-09-11T22:13:57.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.379+0000 7faa6b7fe640 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x557d94f0c1f0 0x557d94f0c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.379+0000 7faa6b7fe640 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x557d94f0c1f0 0x557d94f0c5d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a67988fe503e4b5f server_cookie=4f5631980a4f89c in_seq=0 out_seq=0 2024-09-11T22:13:57.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.379+0000 7faa4a7fc640 10 client.5628 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:57.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa4a7fc640 1 -- 172.21.15.50:0/4033195225 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d94e3f340 con 0x557d94f0c1f0 2024-09-11T22:13:57.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa4a7fc640 10 client.5628 handle_command_reply: tid=0 2024-09-11T22:13:57.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa74a6e740 1 client.5628 shutdown 2024-09-11T22:13:57.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa74a6e740 1 -- 172.21.15.50:0/4033195225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 msgr2=0x557d94f0a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa74a6e740 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 0x557d94f0a560 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faa64015040 tx=0x7faa64089140 comp rx=0 tx=0).stop 2024-09-11T22:13:57.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa74a6e740 1 -- 172.21.15.50:0/4033195225 shutdown_connections 2024-09-11T22:13:57.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa74a6e740 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x557d94f0c1f0 0x557d94f0c5d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa74a6e740 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 0x557d94f0a560 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa4a7fc640 0 client.5628 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa74a6e740 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f15650 0x557d94f24280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa74a6e740 1 --2- 172.21.15.50:0/4033195225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f13270 0x557d94ef30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa74a6e740 1 -- 172.21.15.50:0/4033195225 >> 172.21.15.50:0/4033195225 conn(0x557d94f12e10 msgr2=0x557d94ef5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa74a6e740 1 -- 172.21.15.50:0/4033195225 shutdown_connections 2024-09-11T22:13:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa74a6e740 1 -- 172.21.15.50:0/4033195225 wait complete. 2024-09-11T22:13:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.380+0000 7faa74a6e740 20 client.5628 trim_cache size 0 max 16384 2024-09-11T22:13:57.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.398+0000 7faa74a6e740 1 Processor -- start 2024-09-11T22:13:57.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.398+0000 7faa74a6e740 1 -- start start 2024-09-11T22:13:57.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa74a6e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f0b100 0x557d94f37810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa74a6e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f13270 0x557d94f23b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa74a6e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f15650 0x557d94f24050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa74a6e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c200ac0 con 0x557d94f15650 2024-09-11T22:13:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa74a6e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c1e7cc0 con 0x557d94f13270 2024-09-11T22:13:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa74a6e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faa6c1e7020 con 0x557d94f0b100 2024-09-11T22:13:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f15650 0x557d94f24050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f15650 0x557d94f24050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58118/0 (socket says 172.21.15.50:58118) 2024-09-11T22:13:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa6bfff640 1 -- 172.21.15.50:0/2658223113 learned_addr learned my addr 172.21.15.50:0/2658223113 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa6b7fe640 1 --2- 172.21.15.50:0/2658223113 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f0b100 0x557d94f37810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa6affd640 1 --2- 172.21.15.50:0/2658223113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f13270 0x557d94f23b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa6bfff640 1 -- 172.21.15.50:0/2658223113 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f0b100 msgr2=0x557d94f37810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa6bfff640 1 --2- 172.21.15.50:0/2658223113 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f0b100 0x557d94f37810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa6bfff640 1 -- 172.21.15.50:0/2658223113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f13270 msgr2=0x557d94f23b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa6bfff640 1 --2- 172.21.15.50:0/2658223113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f13270 0x557d94f23b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa6bfff640 1 -- 172.21.15.50:0/2658223113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d94add5b0 con 0x557d94f15650 2024-09-11T22:13:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa6b7fe640 1 --2- 172.21.15.50:0/2658223113 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f0b100 0x557d94f37810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa6affd640 1 --2- 172.21.15.50:0/2658223113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f13270 0x557d94f23b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa6bfff640 1 --2- 172.21.15.50:0/2658223113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f15650 0x557d94f24050 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7faa640616a0 tx=0x7faa64014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a392017f00badf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa50ff9640 1 -- 172.21.15.50:0/2658223113 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64082dd0 con 0x557d94f15650 2024-09-11T22:13:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa50ff9640 1 -- 172.21.15.50:0/2658223113 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa640583b0 con 0x557d94f15650 2024-09-11T22:13:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.399+0000 7faa50ff9640 1 -- 172.21.15.50:0/2658223113 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64054cb0 con 0x557d94f15650 2024-09-11T22:13:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.400+0000 7faa74a6e740 1 -- 172.21.15.50:0/2658223113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f15650 msgr2=0x557d94f24050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.400+0000 7faa74a6e740 1 --2- 172.21.15.50:0/2658223113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f15650 0x557d94f24050 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7faa640616a0 tx=0x7faa64014040 comp rx=0 tx=0).stop 2024-09-11T22:13:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.400+0000 7faa74a6e740 1 -- 172.21.15.50:0/2658223113 shutdown_connections 2024-09-11T22:13:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.400+0000 7faa74a6e740 1 --2- 172.21.15.50:0/2658223113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f15650 0x557d94f24050 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.400+0000 7faa74a6e740 1 --2- 172.21.15.50:0/2658223113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f13270 0x557d94f23b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.400+0000 7faa74a6e740 1 --2- 172.21.15.50:0/2658223113 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f0b100 0x557d94f37810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.400+0000 7faa74a6e740 1 -- 172.21.15.50:0/2658223113 >> 172.21.15.50:0/2658223113 conn(0x557d94f12e10 msgr2=0x557d94ef2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.400+0000 7faa74a6e740 1 -- 172.21.15.50:0/2658223113 shutdown_connections 2024-09-11T22:13:57.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.400+0000 7faa74a6e740 1 -- 172.21.15.50:0/2658223113 wait complete. 2024-09-11T22:13:57.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.401+0000 7faa74a6e740 1 -- start start 2024-09-11T22:13:57.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.401+0000 7faa74a6e740 1 Processor -- start 2024-09-11T22:13:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa74a6e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 0x557d94ef77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa74a6e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f13270 0x557d94f23ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa74a6e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f15650 0x557d94eca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa74a6e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557d94ef9090 con 0x557d94f0b100 2024-09-11T22:13:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa74a6e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c1e7670 con 0x557d94f13270 2024-09-11T22:13:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa74a6e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557d94ec92b0 con 0x557d94f15650 2024-09-11T22:13:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa74a6e740 10 client.0 _ll_register_callbacks cb 0x7faa5c001530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa6b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 0x557d94ef77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa6b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 0x557d94ef77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58130/0 (socket says 172.21.15.50:58130) 2024-09-11T22:13:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa6b7fe640 1 -- 172.21.15.50:0/1593922351 learned_addr learned my addr 172.21.15.50:0/1593922351 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa6affd640 1 --2- 172.21.15.50:0/1593922351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f13270 0x557d94f23ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa6bfff640 1 --2- 172.21.15.50:0/1593922351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f15650 0x557d94eca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa6b7fe640 1 -- 172.21.15.50:0/1593922351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f15650 msgr2=0x557d94eca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa6b7fe640 1 --2- 172.21.15.50:0/1593922351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f15650 0x557d94eca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa6b7fe640 1 -- 172.21.15.50:0/1593922351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f13270 msgr2=0x557d94f23ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa6b7fe640 1 --2- 172.21.15.50:0/1593922351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f13270 0x557d94f23ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa6b7fe640 1 -- 172.21.15.50:0/1593922351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d94f0c880 con 0x557d94f0b100 2024-09-11T22:13:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa6b7fe640 1 --2- 172.21.15.50:0/1593922351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 0x557d94ef77a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7faa5c007ee0 tx=0x7faa5c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e348c731f1221b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa4a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa4a7fc640 1 -- 172.21.15.50:0/1593922351 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00ee30 con 0x557d94f0b100 2024-09-11T22:13:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa4a7fc640 1 -- 172.21.15.50:0/1593922351 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7faa5c010040 con 0x557d94f0b100 2024-09-11T22:13:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.402+0000 7faa74a6e740 1 -- 172.21.15.50:0/1593922351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa640583b0 con 0x557d94f0b100 2024-09-11T22:13:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.403+0000 7faa4a7fc640 1 -- 172.21.15.50:0/1593922351 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7faa5c032050 con 0x557d94f0b100 2024-09-11T22:13:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.403+0000 7faa74a6e740 10 client.5634 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:57.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.403+0000 7faa74a6e740 1 -- 172.21.15.50:0/1593922351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x557d94f24010 con 0x557d94f0b100 2024-09-11T22:13:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.403+0000 7faa4a7fc640 1 -- 172.21.15.50:0/1593922351 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa640583b0 con 0x557d94f0b100 2024-09-11T22:13:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.403+0000 7faa4a7fc640 1 -- 172.21.15.50:0/1593922351 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7faa5c035020 con 0x557d94f0b100 2024-09-11T22:13:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.403+0000 7faa74a6e740 10 client.5634 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.403+0000 7faa74a6e740 10 client.5634 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.403+0000 7faa74a6e740 20 client.5634 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.403+0000 7faa74a6e740 1 --2- 172.21.15.50:0/1593922351 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x557d94eca7d0 0x557d94ecabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.403+0000 7faa74a6e740 4 client.5634 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-11T22:13:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.403+0000 7faa74a6e740 1 -- 172.21.15.50:0/1593922351 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x557d94e39690 con 0x557d94eca7d0 2024-09-11T22:13:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.403+0000 7faa6affd640 1 --2- 172.21.15.50:0/1593922351 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x557d94eca7d0 0x557d94ecabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa4a7fc640 10 client.5634 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa6affd640 1 --2- 172.21.15.50:0/1593922351 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x557d94eca7d0 0x557d94ecabe0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6756c761c71e38ed server_cookie=111232e4bf4e385c in_seq=0 out_seq=0 2024-09-11T22:13:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa4a7fc640 1 -- 172.21.15.50:0/1593922351 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557d94e39690 con 0x557d94eca7d0 2024-09-11T22:13:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa4a7fc640 10 client.5634 handle_command_reply: tid=0 2024-09-11T22:13:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa74a6e740 1 client.5634 shutdown 2024-09-11T22:13:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa74a6e740 1 -- 172.21.15.50:0/1593922351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 msgr2=0x557d94ef77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa74a6e740 1 --2- 172.21.15.50:0/1593922351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 0x557d94ef77a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7faa5c007ee0 tx=0x7faa5c000ed0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa74a6e740 1 -- 172.21.15.50:0/1593922351 shutdown_connections 2024-09-11T22:13:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa74a6e740 1 --2- 172.21.15.50:0/1593922351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d94f15650 0x557d94eca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa74a6e740 1 --2- 172.21.15.50:0/1593922351 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x557d94eca7d0 0x557d94ecabe0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa74a6e740 1 --2- 172.21.15.50:0/1593922351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d94f13270 0x557d94f23ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa74a6e740 1 --2- 172.21.15.50:0/1593922351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d94f0b100 0x557d94ef77a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa4a7fc640 0 client.5634 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.404+0000 7faa74a6e740 1 -- 172.21.15.50:0/1593922351 >> 172.21.15.50:0/1593922351 conn(0x557d94f12e10 msgr2=0x557d94ef2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.412 INFO:tasks.ceph.mds.c.smithi050.stderr:2024-09-11T22:13:57.405+0000 7fc2ffaff640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4c [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v440 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={4952=0-4194304@1} caps={4952=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=4952 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55c9ea296b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000a4c:[<0x10000000001/new_file_0 v440>,<0x10000000000/ceph-qa-suite v40>,<0x1/scrub_test_path v11>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-11T22:13:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa74a6e740 1 -- 172.21.15.50:0/1593922351 shutdown_connections 2024-09-11T22:13:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa74a6e740 1 -- 172.21.15.50:0/1593922351 wait complete. 2024-09-11T22:13:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa74a6e740 20 client.5634 trim_cache size 0 max 16384 2024-09-11T22:13:57.413 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:13:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "a92718e0-e928-4139-b7c9-69d967fdf822", 2024-09-11T22:13:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:13:57.413 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:57.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa71cd9640 1 -- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa5806be30 msgr2=0x7faa5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa71cd9640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa5806be30 0x7faa5806e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faa5c000f60 tx=0x7faa5c009040 comp rx=0 tx=0).stop 2024-09-11T22:13:57.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa71cd9640 1 -- 172.21.15.50:0/3715558025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c15e870 msgr2=0x7faa6c0cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa71cd9640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c15e870 0x7faa6c0cb850 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faa6400cb80 tx=0x7faa6400a430 comp rx=0 tx=0).stop 2024-09-11T22:13:57.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa71cd9640 1 -- 172.21.15.50:0/3715558025 shutdown_connections 2024-09-11T22:13:57.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa71cd9640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa5806be30 0x7faa5806e2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa71cd9640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa6c0d3a30 0x7faa6c1e8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa71cd9640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c15e870 0x7faa6c0cb850 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa71cd9640 1 --2- 172.21.15.50:0/3715558025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa6c0d18a0 0x7faa6c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa71cd9640 1 -- 172.21.15.50:0/3715558025 >> 172.21.15.50:0/3715558025 conn(0x7faa6c0727a0 msgr2=0x7faa6c0d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa71cd9640 1 -- 172.21.15.50:0/3715558025 shutdown_connections 2024-09-11T22:13:57.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.405+0000 7faa71cd9640 1 -- 172.21.15.50:0/3715558025 wait complete. 2024-09-11T22:13:57.416 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': 'a92718e0-e928-4139-b7c9-69d967fdf822', 'mode': 'asynchronous'}' 2024-09-11T22:13:57.417 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-11T22:13:57.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-11T22:13:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.522+0000 7f9815531640 1 Processor -- start 2024-09-11T22:13:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.522+0000 7f9815531640 1 -- start start 2024-09-11T22:13:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f9815531640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f981015e8e0 0x7f98100b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f9815531640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9810162350 0x7f98101627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f9815531640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9810163080 con 0x7f98100d1580 2024-09-11T22:13:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f9815531640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f981015ecc0 con 0x7f9810162350 2024-09-11T22:13:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f9815531640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f98100d2ad0 con 0x7f981015e8e0 2024-09-11T22:13:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f980f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9810162350 0x7f98101627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f980f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9810162350 0x7f98101627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36570/0 (socket says 172.21.15.50:36570) 2024-09-11T22:13:57.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f980f7fe640 1 -- 172.21.15.50:0/3997433044 learned_addr learned my addr 172.21.15.50:0/3997433044 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f980e7fc640 1 --1- 172.21.15.50:0/3997433044 >> v1:172.21.15.50:6789/0 conn(0x7f98100d1580 0x7f98100d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36294/0 (socket says 172.21.15.50:36294) 2024-09-11T22:13:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f980f7fe640 1 -- 172.21.15.50:0/3997433044 >> v2:172.21.15.77:3300/0 conn(0x7f981015e8e0 msgr2=0x7f98100b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f980effd640 1 --2- 172.21.15.50:0/3997433044 >> v2:172.21.15.77:3300/0 conn(0x7f981015e8e0 0x7f98100b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f980f7fe640 1 --2- 172.21.15.50:0/3997433044 >> v2:172.21.15.77:3300/0 conn(0x7f981015e8e0 0x7f98100b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f980dffb640 1 -- 172.21.15.50:0/3997433044 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522083994 0 0) 0x7f9810163080 con 0x7f98100d1580 2024-09-11T22:13:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f980f7fe640 1 -- 172.21.15.50:0/3997433044 >> v1:172.21.15.50:6789/0 conn(0x7f98100d1580 legacy=0x7f98100d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.523+0000 7f980f7fe640 1 -- 172.21.15.50:0/3997433044 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98100d2d20 con 0x7f9810162350 2024-09-11T22:13:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.524+0000 7f980f7fe640 1 --2- 172.21.15.50:0/3997433044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9810162350 0x7f98101627a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f981008d630 tx=0x7f980802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c07c1f5f2814e4a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.524+0000 7f980dffb640 1 -- 172.21.15.50:0/3997433044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9808036070 con 0x7f9810162350 2024-09-11T22:13:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.524+0000 7f980dffb640 1 -- 172.21.15.50:0/3997433044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9808031600 con 0x7f9810162350 2024-09-11T22:13:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.524+0000 7f980dffb640 1 -- 172.21.15.50:0/3997433044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98080319f0 con 0x7f9810162350 2024-09-11T22:13:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.524+0000 7f9815531640 1 -- 172.21.15.50:0/3997433044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9810162350 msgr2=0x7f98101627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.524+0000 7f9815531640 1 --2- 172.21.15.50:0/3997433044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9810162350 0x7f98101627a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f981008d630 tx=0x7f980802a7c0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.525+0000 7f9815531640 1 -- 172.21.15.50:0/3997433044 shutdown_connections 2024-09-11T22:13:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.525+0000 7f9815531640 1 --2- 172.21.15.50:0/3997433044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9810162350 0x7f98101627a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.525+0000 7f9815531640 1 --2- 172.21.15.50:0/3997433044 >> v2:172.21.15.77:3300/0 conn(0x7f981015e8e0 0x7f98100b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.525+0000 7f9815531640 1 -- 172.21.15.50:0/3997433044 >> 172.21.15.50:0/3997433044 conn(0x7f9810067ba0 msgr2=0x7f9810067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.525+0000 7f9815531640 1 -- 172.21.15.50:0/3997433044 shutdown_connections 2024-09-11T22:13:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.525+0000 7f9815531640 1 -- 172.21.15.50:0/3997433044 wait complete. 2024-09-11T22:13:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.526+0000 7f9815531640 1 Processor -- start 2024-09-11T22:13:57.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.526+0000 7f9815531640 1 -- start start 2024-09-11T22:13:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f9815531640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98100d1580 0x7f98101568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f9815531640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981015e8e0 0x7f98100cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f9815531640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9810162350 0x7f98100ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f9815531640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9810162ce0 con 0x7f981015e8e0 2024-09-11T22:13:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f9815531640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f98100d3370 con 0x7f9810162350 2024-09-11T22:13:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f9815531640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9810162e60 con 0x7f98100d1580 2024-09-11T22:13:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f980e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981015e8e0 0x7f98100cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f980e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981015e8e0 0x7f98100cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36574/0 (socket says 172.21.15.50:36574) 2024-09-11T22:13:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f980e7fc640 1 -- 172.21.15.50:0/257375619 learned_addr learned my addr 172.21.15.50:0/257375619 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f980e7fc640 1 -- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98100d1580 msgr2=0x7f98101568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f980effd640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98100d1580 0x7f98101568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f980f7fe640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9810162350 0x7f98100ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f980e7fc640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98100d1580 0x7f98101568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f980e7fc640 1 -- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9810162350 msgr2=0x7f98100ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f980e7fc640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9810162350 0x7f98100ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f980e7fc640 1 -- 172.21.15.50:0/257375619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9810156e30 con 0x7f981015e8e0 2024-09-11T22:13:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f980f7fe640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9810162350 0x7f98100ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:13:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f980e7fc640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981015e8e0 0x7f98100cdb20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f980400c430 tx=0x7f980400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f97f77fe640 1 -- 172.21.15.50:0/257375619 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98040074e0 con 0x7f981015e8e0 2024-09-11T22:13:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f97f77fe640 1 -- 172.21.15.50:0/257375619 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98040047e0 con 0x7f981015e8e0 2024-09-11T22:13:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f9815531640 1 -- 172.21.15.50:0/257375619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981015a500 con 0x7f981015e8e0 2024-09-11T22:13:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f97f77fe640 1 -- 172.21.15.50:0/257375619 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804004bd0 con 0x7f981015e8e0 2024-09-11T22:13:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.527+0000 7f9815531640 1 -- 172.21.15.50:0/257375619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98101594a0 con 0x7f981015e8e0 2024-09-11T22:13:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.529+0000 7f97f77fe640 1 -- 172.21.15.50:0/257375619 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9804011070 con 0x7f981015e8e0 2024-09-11T22:13:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.529+0000 7f97f77fe640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97fc06be30 0x7f97fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.530+0000 7f97f77fe640 1 -- 172.21.15.50:0/257375619 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f980408ab40 con 0x7f981015e8e0 2024-09-11T22:13:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.530+0000 7f980effd640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97fc06be30 0x7f97fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.530+0000 7f980effd640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97fc06be30 0x7f97fc06e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9800006fd0 tx=0x7f9800008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.530+0000 7f98182cb740 1 Processor -- start 2024-09-11T22:13:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.531+0000 7f98182cb740 1 -- start start 2024-09-11T22:13:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.531+0000 7f98182cb740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee89920 0x5611feecf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.531+0000 7f98182cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee870e0 0x5611fee89d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.531+0000 7f98182cb740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611fee8b0b0 0x5611fee841a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.531+0000 7f98182cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5611fedec6f0 con 0x5611fee870e0 2024-09-11T22:13:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.531+0000 7f98182cb740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5611fed94330 con 0x5611fee8b0b0 2024-09-11T22:13:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.531+0000 7f98182cb740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5611fede86b0 con 0x5611fee89920 2024-09-11T22:13:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f980e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee870e0 0x5611fee89d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f980e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee870e0 0x5611fee89d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36586/0 (socket says 172.21.15.50:36586) 2024-09-11T22:13:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f980e7fc640 1 -- 172.21.15.50:0/1925654905 learned_addr learned my addr 172.21.15.50:0/1925654905 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f980effd640 1 --2- 172.21.15.50:0/1925654905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee89920 0x5611feecf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f980f7fe640 1 --2- 172.21.15.50:0/1925654905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611fee8b0b0 0x5611fee841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f980e7fc640 1 -- 172.21.15.50:0/1925654905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee89920 msgr2=0x5611feecf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f980e7fc640 1 --2- 172.21.15.50:0/1925654905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee89920 0x5611feecf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f980e7fc640 1 -- 172.21.15.50:0/1925654905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611fee8b0b0 msgr2=0x5611fee841a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f980e7fc640 1 --2- 172.21.15.50:0/1925654905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611fee8b0b0 0x5611fee841a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f980e7fc640 1 -- 172.21.15.50:0/1925654905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611fedba0d0 con 0x5611fee870e0 2024-09-11T22:13:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f980e7fc640 1 --2- 172.21.15.50:0/1925654905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee870e0 0x5611fee89d00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9804088f90 tx=0x7f9804058a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4acefa9f8d66fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f97f4ff9640 1 -- 172.21.15.50:0/1925654905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804087070 con 0x5611fee870e0 2024-09-11T22:13:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f97f4ff9640 1 -- 172.21.15.50:0/1925654905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9804061980 con 0x5611fee870e0 2024-09-11T22:13:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.532+0000 7f97f4ff9640 1 -- 172.21.15.50:0/1925654905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980401ad90 con 0x5611fee870e0 2024-09-11T22:13:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.533+0000 7f98182cb740 1 -- 172.21.15.50:0/1925654905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee870e0 msgr2=0x5611fee89d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.533+0000 7f98182cb740 1 --2- 172.21.15.50:0/1925654905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee870e0 0x5611fee89d00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9804088f90 tx=0x7f9804058a10 comp rx=0 tx=0).stop 2024-09-11T22:13:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.533+0000 7f98182cb740 1 -- 172.21.15.50:0/1925654905 shutdown_connections 2024-09-11T22:13:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.533+0000 7f98182cb740 1 --2- 172.21.15.50:0/1925654905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611fee8b0b0 0x5611fee841a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.533+0000 7f98182cb740 1 --2- 172.21.15.50:0/1925654905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee870e0 0x5611fee89d00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.533+0000 7f98182cb740 1 --2- 172.21.15.50:0/1925654905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee89920 0x5611feecf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.533+0000 7f98182cb740 1 -- 172.21.15.50:0/1925654905 >> 172.21.15.50:0/1925654905 conn(0x5611fee86370 msgr2=0x5611feece590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.533+0000 7f98182cb740 1 -- 172.21.15.50:0/1925654905 shutdown_connections 2024-09-11T22:13:57.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.533+0000 7f98182cb740 1 -- 172.21.15.50:0/1925654905 wait complete. 2024-09-11T22:13:57.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.533+0000 7f98182cb740 1 -- start start 2024-09-11T22:13:57.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.534+0000 7f98182cb740 1 Processor -- start 2024-09-11T22:13:57.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.534+0000 7f98182cb740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee89920 0x5611feede680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.534+0000 7f98182cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee8b0b0 0x5611feee2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.534+0000 7f98182cb740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611feeb3ef0 0x5611fee830c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.534+0000 7f98182cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5611fee85810 con 0x5611fee8b0b0 2024-09-11T22:13:57.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.534+0000 7f98182cb740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5611fed754f0 con 0x5611feeb3ef0 2024-09-11T22:13:57.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.534+0000 7f98182cb740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5611feecf8f0 con 0x5611fee89920 2024-09-11T22:13:57.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.534+0000 7f98182cb740 10 client.0 _ll_register_callbacks cb 0x5611fed96b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:57.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.534+0000 7f980e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee8b0b0 0x5611feee2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.534+0000 7f980e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee8b0b0 0x5611feee2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36602/0 (socket says 172.21.15.50:36602) 2024-09-11T22:13:57.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.534+0000 7f980e7fc640 1 -- 172.21.15.50:0/2948318704 learned_addr learned my addr 172.21.15.50:0/2948318704 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f980effd640 1 --2- 172.21.15.50:0/2948318704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee89920 0x5611feede680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f980f7fe640 1 --2- 172.21.15.50:0/2948318704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611feeb3ef0 0x5611fee830c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f980e7fc640 1 -- 172.21.15.50:0/2948318704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee89920 msgr2=0x5611feede680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f980e7fc640 1 --2- 172.21.15.50:0/2948318704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee89920 0x5611feede680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f980e7fc640 1 -- 172.21.15.50:0/2948318704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611feeb3ef0 msgr2=0x5611fee830c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f980e7fc640 1 --2- 172.21.15.50:0/2948318704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611feeb3ef0 0x5611fee830c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f980e7fc640 1 -- 172.21.15.50:0/2948318704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611febc97d0 con 0x5611fee8b0b0 2024-09-11T22:13:57.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f980e7fc640 1 --2- 172.21.15.50:0/2948318704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee8b0b0 0x5611feee2b90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f980405d310 tx=0x7f9804000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa7a645508dff7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f97edffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f97edffb640 1 -- 172.21.15.50:0/2948318704 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804087040 con 0x5611fee8b0b0 2024-09-11T22:13:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f97edffb640 1 -- 172.21.15.50:0/2948318704 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9804056e40 con 0x5611fee8b0b0 2024-09-11T22:13:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f98182cb740 1 -- 172.21.15.50:0/2948318704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9804061980 con 0x5611fee8b0b0 2024-09-11T22:13:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f97edffb640 1 -- 172.21.15.50:0/2948318704 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f980407e050 con 0x5611fee8b0b0 2024-09-11T22:13:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f98182cb740 10 client.5649 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f98182cb740 1 -- 172.21.15.50:0/2948318704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5611feaff3f0 con 0x5611fee8b0b0 2024-09-11T22:13:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f97edffb640 1 -- 172.21.15.50:0/2948318704 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9804061980 con 0x5611fee8b0b0 2024-09-11T22:13:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f97edffb640 1 -- 172.21.15.50:0/2948318704 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f9804081020 con 0x5611fee8b0b0 2024-09-11T22:13:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f98182cb740 10 client.5649 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f98182cb740 10 client.5649 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f98182cb740 20 client.5649 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f98182cb740 1 --2- 172.21.15.50:0/2948318704 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5611fee88c50 0x5611feea9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f98182cb740 4 client.5649 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:13:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.535+0000 7f98182cb740 1 -- 172.21.15.50:0/2948318704 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611fedf9e20 con 0x5611fee88c50 2024-09-11T22:13:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.536+0000 7f980effd640 1 --2- 172.21.15.50:0/2948318704 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5611fee88c50 0x5611feea9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.536+0000 7f97edffb640 10 client.5649 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.536+0000 7f980effd640 1 --2- 172.21.15.50:0/2948318704 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5611fee88c50 0x5611feea9170 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e06de2b51ac9dfaa server_cookie=7193fbc48e9e110c in_seq=0 out_seq=0 2024-09-11T22:13:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.536+0000 7f97edffb640 1 -- 172.21.15.50:0/2948318704 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611fedf9e20 con 0x5611fee88c50 2024-09-11T22:13:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.536+0000 7f97edffb640 10 client.5649 handle_command_reply: tid=0 2024-09-11T22:13:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.536+0000 7f98182cb740 1 client.5649 shutdown 2024-09-11T22:13:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.537+0000 7f98182cb740 1 -- 172.21.15.50:0/2948318704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee8b0b0 msgr2=0x5611feee2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.537+0000 7f98182cb740 1 --2- 172.21.15.50:0/2948318704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee8b0b0 0x5611feee2b90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f980405d310 tx=0x7f9804000ed0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.537+0000 7f98182cb740 1 -- 172.21.15.50:0/2948318704 shutdown_connections 2024-09-11T22:13:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.537+0000 7f98182cb740 1 --2- 172.21.15.50:0/2948318704 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5611fee88c50 0x5611feea9170 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.537+0000 7f98182cb740 1 --2- 172.21.15.50:0/2948318704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611feeb3ef0 0x5611fee830c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.537+0000 7f98182cb740 1 --2- 172.21.15.50:0/2948318704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee8b0b0 0x5611feee2b90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.537+0000 7f98182cb740 1 --2- 172.21.15.50:0/2948318704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee89920 0x5611feede680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.537+0000 7f97edffb640 0 client.5649 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:57.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.537+0000 7f98182cb740 1 -- 172.21.15.50:0/2948318704 >> 172.21.15.50:0/2948318704 conn(0x5611fee870e0 msgr2=0x5611fee87680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.537+0000 7f98182cb740 1 -- 172.21.15.50:0/2948318704 shutdown_connections 2024-09-11T22:13:57.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.537+0000 7f98182cb740 1 -- 172.21.15.50:0/2948318704 wait complete. 2024-09-11T22:13:57.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.537+0000 7f98182cb740 20 client.5649 trim_cache size 0 max 16384 2024-09-11T22:13:57.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.554+0000 7f98182cb740 1 Processor -- start 2024-09-11T22:13:57.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.554+0000 7f98182cb740 1 -- start start 2024-09-11T22:13:57.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f98182cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee89920 0x5611feef2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f98182cb740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee8b0b0 0x5611feeaf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f98182cb740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611feeb3ef0 0x5611feecc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f98182cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9810200cd0 con 0x5611fee89920 2024-09-11T22:13:57.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f98182cb740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f98101ffcf0 con 0x5611feeb3ef0 2024-09-11T22:13:57.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f98182cb740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f98101ff050 con 0x5611fee8b0b0 2024-09-11T22:13:57.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f980effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee89920 0x5611feef2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f980effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee89920 0x5611feef2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36614/0 (socket says 172.21.15.50:36614) 2024-09-11T22:13:57.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f980effd640 1 -- 172.21.15.50:0/2057083735 learned_addr learned my addr 172.21.15.50:0/2057083735 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f980effd640 1 -- 172.21.15.50:0/2057083735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee8b0b0 msgr2=0x5611feeaf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f980effd640 1 --2- 172.21.15.50:0/2057083735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee8b0b0 0x5611feeaf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f980effd640 1 -- 172.21.15.50:0/2057083735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611feeb3ef0 msgr2=0x5611feecc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f980effd640 1 --2- 172.21.15.50:0/2057083735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611feeb3ef0 0x5611feecc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.555+0000 7f980effd640 1 -- 172.21.15.50:0/2057083735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611feabf0f0 con 0x5611fee89920 2024-09-11T22:13:57.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.556+0000 7f980effd640 1 --2- 172.21.15.50:0/2057083735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee89920 0x5611feef2ee0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f980000dfa0 tx=0x7f9800016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2f6df756fee056 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.556+0000 7f97effff640 1 -- 172.21.15.50:0/2057083735 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800019040 con 0x5611fee89920 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.556+0000 7f97effff640 1 -- 172.21.15.50:0/2057083735 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980002d070 con 0x5611fee89920 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.556+0000 7f97effff640 1 -- 172.21.15.50:0/2057083735 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800021d50 con 0x5611fee89920 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.556+0000 7f98182cb740 1 -- 172.21.15.50:0/2057083735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee89920 msgr2=0x5611feef2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.556+0000 7f98182cb740 1 --2- 172.21.15.50:0/2057083735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee89920 0x5611feef2ee0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f980000dfa0 tx=0x7f9800016040 comp rx=0 tx=0).stop 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.556+0000 7f98182cb740 1 -- 172.21.15.50:0/2057083735 shutdown_connections 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.556+0000 7f98182cb740 1 --2- 172.21.15.50:0/2057083735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee8b0b0 0x5611feeaf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.556+0000 7f98182cb740 1 --2- 172.21.15.50:0/2057083735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611feeb3ef0 0x5611feecc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.556+0000 7f98182cb740 1 --2- 172.21.15.50:0/2057083735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611fee89920 0x5611feef2ee0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.556+0000 7f98182cb740 1 -- 172.21.15.50:0/2057083735 >> 172.21.15.50:0/2057083735 conn(0x5611fee870e0 msgr2=0x5611feeafc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.556+0000 7f98182cb740 1 -- 172.21.15.50:0/2057083735 shutdown_connections 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.556+0000 7f98182cb740 1 -- 172.21.15.50:0/2057083735 wait complete. 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.557+0000 7f98182cb740 1 -- start start 2024-09-11T22:13:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.557+0000 7f98182cb740 1 Processor -- start 2024-09-11T22:13:57.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f98182cb740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611fee89920 0x5611feef2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f98182cb740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee8b0b0 0x5611feef2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f98182cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611feeb3ef0 0x5611feead2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f98182cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98101ff6a0 con 0x5611feeb3ef0 2024-09-11T22:13:57.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f98182cb740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5611fef4d610 con 0x5611fee89920 2024-09-11T22:13:57.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f98182cb740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5611feea8170 con 0x5611fee8b0b0 2024-09-11T22:13:57.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f98182cb740 10 client.0 _ll_register_callbacks cb 0x7f9804085070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:13:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f980f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611feeb3ef0 0x5611feead2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f980f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611feeb3ef0 0x5611feead2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36622/0 (socket says 172.21.15.50:36622) 2024-09-11T22:13:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f980f7fe640 1 -- 172.21.15.50:0/2265979236 learned_addr learned my addr 172.21.15.50:0/2265979236 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:13:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f980effd640 1 --2- 172.21.15.50:0/2265979236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611fee89920 0x5611feef2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f980e7fc640 1 --2- 172.21.15.50:0/2265979236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee8b0b0 0x5611feef2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f980f7fe640 1 -- 172.21.15.50:0/2265979236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee8b0b0 msgr2=0x5611feef2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f980f7fe640 1 --2- 172.21.15.50:0/2265979236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee8b0b0 0x5611feef2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f980f7fe640 1 -- 172.21.15.50:0/2265979236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611fee89920 msgr2=0x5611feef2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:13:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f980f7fe640 1 --2- 172.21.15.50:0/2265979236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611fee89920 0x5611feef2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f980f7fe640 1 -- 172.21.15.50:0/2265979236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611feed00f0 con 0x5611feeb3ef0 2024-09-11T22:13:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f980f7fe640 1 --2- 172.21.15.50:0/2265979236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611feeb3ef0 0x5611feead2e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f980802adb0 tx=0x7f9808004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e298538872ca77e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:13:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.558+0000 7f97edffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f97edffb640 1 -- 172.21.15.50:0/2265979236 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9808042030 con 0x5611feeb3ef0 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f97edffb640 1 -- 172.21.15.50:0/2265979236 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9808004250 con 0x5611feeb3ef0 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f98182cb740 1 -- 172.21.15.50:0/2265979236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f980002d070 con 0x5611feeb3ef0 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f97edffb640 1 -- 172.21.15.50:0/2265979236 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f980804e050 con 0x5611feeb3ef0 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f98182cb740 10 client.5655 fetch_fsmap learned FSMap version 23 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f98182cb740 1 -- 172.21.15.50:0/2265979236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5611feea7c70 con 0x5611feeb3ef0 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f97edffb640 1 -- 172.21.15.50:0/2265979236 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980002d070 con 0x5611feeb3ef0 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f97edffb640 1 -- 172.21.15.50:0/2265979236 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f9808051020 con 0x5611feeb3ef0 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f98182cb740 10 client.5655 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f98182cb740 10 client.5655 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f98182cb740 20 client.5655 populate_metadata read hostname 'smithi050' 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f98182cb740 1 --2- 172.21.15.50:0/2265979236 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5611feead820 0x5611feeadc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f98182cb740 4 client.5655 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:13:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f98182cb740 1 -- 172.21.15.50:0/2265979236 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5611fedf4170 con 0x5611feead820 2024-09-11T22:13:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.559+0000 7f980effd640 1 --2- 172.21.15.50:0/2265979236 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5611feead820 0x5611feeadc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:13:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f980effd640 1 --2- 172.21.15.50:0/2265979236 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5611feead820 0x5611feeadc30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fe9c8cf7b56eeed server_cookie=e4ad176f2d0a4fc9 in_seq=0 out_seq=0 2024-09-11T22:13:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f97edffb640 10 client.5655 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f97edffb640 1 -- 172.21.15.50:0/2265979236 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+903 (crc 0 0 0) 0x5611fedf4170 con 0x5611feead820 2024-09-11T22:13:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f97edffb640 10 client.5655 handle_command_reply: tid=0 2024-09-11T22:13:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f98182cb740 1 client.5655 shutdown 2024-09-11T22:13:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f98182cb740 1 -- 172.21.15.50:0/2265979236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611feeb3ef0 msgr2=0x5611feead2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f98182cb740 1 --2- 172.21.15.50:0/2265979236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611feeb3ef0 0x5611feead2e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f980802adb0 tx=0x7f9808004a40 comp rx=0 tx=0).stop 2024-09-11T22:13:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f98182cb740 1 -- 172.21.15.50:0/2265979236 shutdown_connections 2024-09-11T22:13:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f98182cb740 1 --2- 172.21.15.50:0/2265979236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5611fee8b0b0 0x5611feef2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f98182cb740 1 --2- 172.21.15.50:0/2265979236 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5611feead820 0x5611feeadc30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f98182cb740 1 --2- 172.21.15.50:0/2265979236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5611feeb3ef0 0x5611feead2e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f98182cb740 1 --2- 172.21.15.50:0/2265979236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5611fee89920 0x5611feef2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f98182cb740 1 -- 172.21.15.50:0/2265979236 >> 172.21.15.50:0/2265979236 conn(0x5611fee870e0 msgr2=0x5611feeb1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f97edffb640 0 client.5655 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:13:57.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f98182cb740 1 -- 172.21.15.50:0/2265979236 shutdown_connections 2024-09-11T22:13:57.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f98182cb740 1 -- 172.21.15.50:0/2265979236 wait complete. 2024-09-11T22:13:57.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.560+0000 7f98182cb740 20 client.5655 trim_cache size 0 max 16384 2024-09-11T22:13:57.567 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:13:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:13:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-11T22:13:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: "779e4ba0-193f-4242-9e22-b428b59a90a3": { 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "779e4ba0-193f-4242-9e22-b428b59a90a3", 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "" 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "7a3af87a-776a-43d1-8a4c-a899762ec38f": { 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "7a3af87a-776a-43d1-8a4c-a899762ec38f", 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "" 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "a92718e0-e928-4139-b7c9-69d967fdf822": { 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "a92718e0-e928-4139-b7c9-69d967fdf822", 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "" 2024-09-11T22:13:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:13:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: "b3bbbf8b-1d73-4bc5-91cf-99c4d1e9cd12": { 2024-09-11T22:13:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-11T22:13:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "b3bbbf8b-1d73-4bc5-91cf-99c4d1e9cd12", 2024-09-11T22:13:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "" 2024-09-11T22:13:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:13:57.569 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:13:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.561+0000 7f9815531640 1 -- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97fc06be30 msgr2=0x7f97fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.561+0000 7f9815531640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97fc06be30 0x7f97fc06e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9800006fd0 tx=0x7f9800008040 comp rx=0 tx=0).stop 2024-09-11T22:13:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.561+0000 7f9815531640 1 -- 172.21.15.50:0/257375619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981015e8e0 msgr2=0x7f98100cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:13:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.561+0000 7f9815531640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981015e8e0 0x7f98100cdb20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f980400c430 tx=0x7f980400c8f0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.561+0000 7f9815531640 1 -- 172.21.15.50:0/257375619 shutdown_connections 2024-09-11T22:13:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.561+0000 7f9815531640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97fc06be30 0x7f97fc06e2f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.561+0000 7f9815531640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9810162350 0x7f98100ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.561+0000 7f9815531640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981015e8e0 0x7f98100cdb20 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.561+0000 7f9815531640 1 --2- 172.21.15.50:0/257375619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98100d1580 0x7f98101568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:13:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.561+0000 7f9815531640 1 -- 172.21.15.50:0/257375619 >> 172.21.15.50:0/257375619 conn(0x7f9810067ba0 msgr2=0x7f9810160670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:13:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.561+0000 7f9815531640 1 -- 172.21.15.50:0/257375619 shutdown_connections 2024-09-11T22:13:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:13:57.561+0000 7f9815531640 1 -- 172.21.15.50:0/257375619 wait complete. 2024-09-11T22:14:02.572 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-11T22:14:02.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-11T22:14:02.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.688+0000 7f1d003b9640 1 Processor -- start 2024-09-11T22:14:02.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.689+0000 7f1d003b9640 1 -- start start 2024-09-11T22:14:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1d003b9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1cf815c2c0 0x7f1cf80b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1d003b9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf80d05e0 0x7f1cf80ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1d003b9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cf80b4f00 con 0x7f1cf80b3e10 2024-09-11T22:14:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1d003b9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1cf80b4360 con 0x7f1cf815c2c0 2024-09-11T22:14:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1d003b9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf80b51c0 con 0x7f1cf80d05e0 2024-09-11T22:14:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1cfe155640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1cf815c2c0 0x7f1cf80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1cfe155640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1cf815c2c0 0x7f1cf80b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36630/0 (socket says 172.21.15.50:36630) 2024-09-11T22:14:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1cfd954640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1cf80b3e10 0x7f1cf80cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36298/0 (socket says 172.21.15.50:36298) 2024-09-11T22:14:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1cfe155640 1 -- 172.21.15.50:0/2844644158 learned_addr learned my addr 172.21.15.50:0/2844644158 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1cfe956640 1 --2- 172.21.15.50:0/2844644158 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf80d05e0 0x7f1cf80ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1cfe155640 1 -- 172.21.15.50:0/2844644158 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf80d05e0 msgr2=0x7f1cf80ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1cfe155640 1 --2- 172.21.15.50:0/2844644158 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf80d05e0 0x7f1cf80ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1cfe155640 1 -- 172.21.15.50:0/2844644158 >> v1:172.21.15.50:6789/0 conn(0x7f1cf80b3e10 legacy=0x7f1cf80cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1cfe155640 1 -- 172.21.15.50:0/2844644158 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf80b54a0 con 0x7f1cf815c2c0 2024-09-11T22:14:02.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.690+0000 7f1cfd153640 1 -- 172.21.15.50:0/2844644158 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2898361118 0 0) 0x7f1cf80b4f00 con 0x7f1cf80b3e10 2024-09-11T22:14:02.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.691+0000 7f1cfe155640 1 --2- 172.21.15.50:0/2844644158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cf815c2c0 0x7f1cf80b46a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009870 tx=0x7f1cf402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593e919bd09a4d3c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.691+0000 7f1cfd153640 1 -- 172.21.15.50:0/2844644158 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4037070 con 0x7f1cf815c2c0 2024-09-11T22:14:02.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.691+0000 7f1cfd153640 1 -- 172.21.15.50:0/2844644158 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf4032440 con 0x7f1cf815c2c0 2024-09-11T22:14:02.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.691+0000 7f1cfd153640 1 -- 172.21.15.50:0/2844644158 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4032810 con 0x7f1cf815c2c0 2024-09-11T22:14:02.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.692+0000 7f1d003b9640 1 -- 172.21.15.50:0/2844644158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cf815c2c0 msgr2=0x7f1cf80b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.692+0000 7f1d003b9640 1 --2- 172.21.15.50:0/2844644158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cf815c2c0 0x7f1cf80b46a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009870 tx=0x7f1cf402a270 comp rx=0 tx=0).stop 2024-09-11T22:14:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.692+0000 7f1d003b9640 1 -- 172.21.15.50:0/2844644158 shutdown_connections 2024-09-11T22:14:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.692+0000 7f1d003b9640 1 --2- 172.21.15.50:0/2844644158 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf80d05e0 0x7f1cf80ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.692+0000 7f1d003b9640 1 --2- 172.21.15.50:0/2844644158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cf815c2c0 0x7f1cf80b46a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.692+0000 7f1d003b9640 1 -- 172.21.15.50:0/2844644158 >> 172.21.15.50:0/2844644158 conn(0x7f1cf80679c0 msgr2=0x7f1cf8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.692+0000 7f1d003b9640 1 -- 172.21.15.50:0/2844644158 shutdown_connections 2024-09-11T22:14:02.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.692+0000 7f1d003b9640 1 -- 172.21.15.50:0/2844644158 wait complete. 2024-09-11T22:14:02.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.693+0000 7f1d003b9640 1 Processor -- start 2024-09-11T22:14:02.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.693+0000 7f1d003b9640 1 -- start start 2024-09-11T22:14:02.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1d003b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf80b3e10 0x7f1cf8071a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1d003b9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cf80d05e0 0x7f1cf8151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1d003b9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf815c2c0 0x7f1cf80cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1d003b9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf806d070 con 0x7f1cf80d05e0 2024-09-11T22:14:02.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1d003b9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf80ce200 con 0x7f1cf80b3e10 2024-09-11T22:14:02.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1d003b9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf806d1f0 con 0x7f1cf815c2c0 2024-09-11T22:14:02.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1cfd954640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cf80d05e0 0x7f1cf8151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1cfd954640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cf80d05e0 0x7f1cf8151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36642/0 (socket says 172.21.15.50:36642) 2024-09-11T22:14:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1cfd954640 1 -- 172.21.15.50:0/2055860188 learned_addr learned my addr 172.21.15.50:0/2055860188 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1cfe155640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf80b3e10 0x7f1cf8071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1cfe956640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf815c2c0 0x7f1cf80cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1cfd954640 1 -- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf815c2c0 msgr2=0x7f1cf80cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1cfd954640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf815c2c0 0x7f1cf80cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1cfd954640 1 -- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf80b3e10 msgr2=0x7f1cf8071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1cfd954640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf80b3e10 0x7f1cf8071a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1cfd954640 1 -- 172.21.15.50:0/2055860188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf80acec0 con 0x7f1cf80d05e0 2024-09-11T22:14:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.694+0000 7f1cfd954640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cf80d05e0 0x7f1cf8151f90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800c4d0 tx=0x7f1ce800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.695+0000 7f1ceeffd640 1 -- 172.21.15.50:0/2055860188 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8018070 con 0x7f1cf80d05e0 2024-09-11T22:14:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.695+0000 7f1ceeffd640 1 -- 172.21.15.50:0/2055860188 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce8007500 con 0x7f1cf80d05e0 2024-09-11T22:14:02.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.695+0000 7f1d003b9640 1 -- 172.21.15.50:0/2055860188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf8072020 con 0x7f1cf80d05e0 2024-09-11T22:14:02.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.695+0000 7f1ceeffd640 1 -- 172.21.15.50:0/2055860188 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8004a20 con 0x7f1cf80d05e0 2024-09-11T22:14:02.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.695+0000 7f1d003b9640 1 -- 172.21.15.50:0/2055860188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf80725e0 con 0x7f1cf80d05e0 2024-09-11T22:14:02.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.696+0000 7f1ceeffd640 1 -- 172.21.15.50:0/2055860188 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ce801b070 con 0x7f1cf80d05e0 2024-09-11T22:14:02.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.697+0000 7f1ceeffd640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1cdc06be60 0x7f1cdc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.697+0000 7f1ceeffd640 1 -- 172.21.15.50:0/2055860188 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f1ce808a0b0 con 0x7f1cf80d05e0 2024-09-11T22:14:02.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.697+0000 7f1cfe155640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1cdc06be60 0x7f1cdc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.698+0000 7f1cfe155640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1cdc06be60 0x7f1cdc06e320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4034000 tx=0x7f1cf402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.698+0000 7f1d03228740 1 Processor -- start 2024-09-11T22:14:02.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.698+0000 7f1d03228740 1 -- start start 2024-09-11T22:14:02.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1d03228740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 0x56366d13c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1d03228740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f40e0 0x56366d0f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1d03228740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 0x56366d0f11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1d03228740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56366d0596f0 con 0x56366d0f6920 2024-09-11T22:14:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1d03228740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56366d001330 con 0x56366d0f80b0 2024-09-11T22:14:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1d03228740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56366d0556b0 con 0x56366d0f40e0 2024-09-11T22:14:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1cfe155640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 0x56366d13c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1cfe155640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 0x56366d13c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36646/0 (socket says 172.21.15.50:36646) 2024-09-11T22:14:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1cfe155640 1 -- 172.21.15.50:0/1675910800 learned_addr learned my addr 172.21.15.50:0/1675910800 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1cfd954640 1 --2- 172.21.15.50:0/1675910800 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f40e0 0x56366d0f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1cfe956640 1 --2- 172.21.15.50:0/1675910800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 0x56366d0f11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1cfe155640 1 -- 172.21.15.50:0/1675910800 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f40e0 msgr2=0x56366d0f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1cfe155640 1 --2- 172.21.15.50:0/1675910800 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f40e0 0x56366d0f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1cfe155640 1 -- 172.21.15.50:0/1675910800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 msgr2=0x56366d0f11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1cfe155640 1 --2- 172.21.15.50:0/1675910800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 0x56366d0f11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.699+0000 7f1cfe155640 1 -- 172.21.15.50:0/1675910800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56366d0270d0 con 0x56366d0f6920 2024-09-11T22:14:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.700+0000 7f1cfe155640 1 --2- 172.21.15.50:0/1675910800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 0x56366d13c0c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009990 tx=0x7f1cf402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b5b5e9ba9ebe77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.700+0000 7f1cdbfff640 1 -- 172.21.15.50:0/1675910800 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf404e070 con 0x56366d0f6920 2024-09-11T22:14:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.700+0000 7f1cdbfff640 1 -- 172.21.15.50:0/1675910800 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf4003950 con 0x56366d0f6920 2024-09-11T22:14:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.700+0000 7f1cdbfff640 1 -- 172.21.15.50:0/1675910800 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4037040 con 0x56366d0f6920 2024-09-11T22:14:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.701+0000 7f1d03228740 1 -- 172.21.15.50:0/1675910800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 msgr2=0x56366d13c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.701+0000 7f1d03228740 1 --2- 172.21.15.50:0/1675910800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 0x56366d13c0c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009990 tx=0x7f1cf402c000 comp rx=0 tx=0).stop 2024-09-11T22:14:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.701+0000 7f1d03228740 1 -- 172.21.15.50:0/1675910800 shutdown_connections 2024-09-11T22:14:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.701+0000 7f1d03228740 1 --2- 172.21.15.50:0/1675910800 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f40e0 0x56366d0f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.701+0000 7f1d03228740 1 --2- 172.21.15.50:0/1675910800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 0x56366d0f11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.701+0000 7f1d03228740 1 --2- 172.21.15.50:0/1675910800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 0x56366d13c0c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.701+0000 7f1d03228740 1 -- 172.21.15.50:0/1675910800 >> 172.21.15.50:0/1675910800 conn(0x56366d0f3370 msgr2=0x56366d13b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.701+0000 7f1d03228740 1 -- 172.21.15.50:0/1675910800 shutdown_connections 2024-09-11T22:14:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.701+0000 7f1d03228740 1 -- 172.21.15.50:0/1675910800 wait complete. 2024-09-11T22:14:02.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.701+0000 7f1d03228740 1 -- start start 2024-09-11T22:14:02.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.701+0000 7f1d03228740 1 Processor -- start 2024-09-11T22:14:02.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.702+0000 7f1d03228740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f6920 0x56366d117580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.702+0000 7f1d03228740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f80b0 0x56366d14eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.702+0000 7f1d03228740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 0x56366d11e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.702+0000 7f1d03228740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56366d0f2810 con 0x56366d14f410 2024-09-11T22:14:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.702+0000 7f1d03228740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56366cfe24f0 con 0x56366d0f6920 2024-09-11T22:14:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.702+0000 7f1d03228740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56366d13c8f0 con 0x56366d0f80b0 2024-09-11T22:14:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.702+0000 7f1d03228740 10 client.0 _ll_register_callbacks cb 0x56366d003b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.702+0000 7f1cfe956640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 0x56366d11e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.702+0000 7f1cfe956640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 0x56366d11e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36662/0 (socket says 172.21.15.50:36662) 2024-09-11T22:14:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.702+0000 7f1cfe155640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f6920 0x56366d117580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1cfe956640 1 -- 172.21.15.50:0/3109733864 learned_addr learned my addr 172.21.15.50:0/3109733864 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1cfd954640 1 --2- 172.21.15.50:0/3109733864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f80b0 0x56366d14eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1cfe956640 1 -- 172.21.15.50:0/3109733864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f80b0 msgr2=0x56366d14eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1cfe956640 1 --2- 172.21.15.50:0/3109733864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f80b0 0x56366d14eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1cfe956640 1 -- 172.21.15.50:0/3109733864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f6920 msgr2=0x56366d117580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1cfe956640 1 --2- 172.21.15.50:0/3109733864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f6920 0x56366d117580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1cfe956640 1 -- 172.21.15.50:0/3109733864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56366ce367d0 con 0x56366d14f410 2024-09-11T22:14:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1cfe155640 1 --2- 172.21.15.50:0/3109733864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f6920 0x56366d117580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1cfe956640 1 --2- 172.21.15.50:0/3109733864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 0x56366d11e420 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0007d70 tx=0x7f1cf0013680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0888d8687e8125c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1cd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1cd97fa640 1 -- 172.21.15.50:0/3109733864 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf001c070 con 0x56366d14f410 2024-09-11T22:14:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1cd97fa640 1 -- 172.21.15.50:0/3109733864 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f1cf0016630 con 0x56366d14f410 2024-09-11T22:14:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1d03228740 1 -- 172.21.15.50:0/3109733864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cf4003950 con 0x56366d14f410 2024-09-11T22:14:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1cd97fa640 1 -- 172.21.15.50:0/3109733864 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f1cf0027050 con 0x56366d14f410 2024-09-11T22:14:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1d03228740 10 client.5670 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.703+0000 7f1d03228740 1 -- 172.21.15.50:0/3109733864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x56366cd6c3f0 con 0x56366d14f410 2024-09-11T22:14:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.704+0000 7f1cd97fa640 1 -- 172.21.15.50:0/3109733864 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf4003950 con 0x56366d14f410 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.704+0000 7f1cd97fa640 1 -- 172.21.15.50:0/3109733864 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f1cf002a020 con 0x56366d14f410 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.704+0000 7f1d03228740 10 client.5670 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.704+0000 7f1d03228740 10 client.5670 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.704+0000 7f1d03228740 20 client.5670 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.704+0000 7f1d03228740 1 --2- 172.21.15.50:0/3109733864 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56366d11e960 0x56366d1209c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.704+0000 7f1d03228740 4 client.5670 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.704+0000 7f1d03228740 1 -- 172.21.15.50:0/3109733864 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56366d066e20 con 0x56366d11e960 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.704+0000 7f1cfe155640 1 --2- 172.21.15.50:0/3109733864 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56366d11e960 0x56366d1209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.704+0000 7f1cfe155640 1 --2- 172.21.15.50:0/3109733864 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56366d11e960 0x56366d1209c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c20b918602e6fae server_cookie=4cb773a00d36b56 in_seq=0 out_seq=0 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.704+0000 7f1cd97fa640 10 client.5670 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1cd97fa640 1 -- 172.21.15.50:0/3109733864 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56366d066e20 con 0x56366d11e960 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1cd97fa640 10 client.5670 handle_command_reply: tid=0 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1d03228740 1 client.5670 shutdown 2024-09-11T22:14:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1d03228740 1 -- 172.21.15.50:0/3109733864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 msgr2=0x56366d11e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1d03228740 1 --2- 172.21.15.50:0/3109733864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 0x56366d11e420 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0007d70 tx=0x7f1cf0013680 comp rx=0 tx=0).stop 2024-09-11T22:14:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1d03228740 1 -- 172.21.15.50:0/3109733864 shutdown_connections 2024-09-11T22:14:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1d03228740 1 --2- 172.21.15.50:0/3109733864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f80b0 0x56366d14eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1d03228740 1 --2- 172.21.15.50:0/3109733864 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56366d11e960 0x56366d1209c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1d03228740 1 --2- 172.21.15.50:0/3109733864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 0x56366d11e420 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1d03228740 1 --2- 172.21.15.50:0/3109733864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f6920 0x56366d117580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1d03228740 1 -- 172.21.15.50:0/3109733864 >> 172.21.15.50:0/3109733864 conn(0x56366d0f40e0 msgr2=0x56366d13d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1cd97fa640 0 client.5670 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1d03228740 1 -- 172.21.15.50:0/3109733864 shutdown_connections 2024-09-11T22:14:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1d03228740 1 -- 172.21.15.50:0/3109733864 wait complete. 2024-09-11T22:14:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.705+0000 7f1d03228740 20 client.5670 trim_cache size 0 max 16384 2024-09-11T22:14:02.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.723+0000 7f1d03228740 1 Processor -- start 2024-09-11T22:14:02.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.723+0000 7f1d03228740 1 -- start start 2024-09-11T22:14:02.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1d03228740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 0x56366d119340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1d03228740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 0x56366d13a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1d03228740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d14f410 0x56366d139540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1d03228740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf8200a50 con 0x56366d0f6920 2024-09-11T22:14:02.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1d03228740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf81ffab0 con 0x56366d0f80b0 2024-09-11T22:14:02.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1d03228740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf80ca1e0 con 0x56366d14f410 2024-09-11T22:14:02.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cfe155640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 0x56366d119340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cfe155640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 0x56366d119340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36666/0 (socket says 172.21.15.50:36666) 2024-09-11T22:14:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cfe155640 1 -- 172.21.15.50:0/4159390425 learned_addr learned my addr 172.21.15.50:0/4159390425 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cfe956640 1 --2- 172.21.15.50:0/4159390425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d14f410 0x56366d139540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cfd954640 1 --2- 172.21.15.50:0/4159390425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 0x56366d13a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cfe155640 1 -- 172.21.15.50:0/4159390425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d14f410 msgr2=0x56366d139540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cfe155640 1 --2- 172.21.15.50:0/4159390425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d14f410 0x56366d139540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cfe155640 1 -- 172.21.15.50:0/4159390425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 msgr2=0x56366d13a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cfe155640 1 --2- 172.21.15.50:0/4159390425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 0x56366d13a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cfe155640 1 -- 172.21.15.50:0/4159390425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56366cd2c0f0 con 0x56366d0f6920 2024-09-11T22:14:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cfe155640 1 --2- 172.21.15.50:0/4159390425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 0x56366d119340 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1cf404d000 tx=0x7f1cf403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fc452f2654bf7e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cdb7fe640 1 -- 172.21.15.50:0/4159390425 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf405f070 con 0x56366d0f6920 2024-09-11T22:14:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cdb7fe640 1 -- 172.21.15.50:0/4159390425 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf4057070 con 0x56366d0f6920 2024-09-11T22:14:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.724+0000 7f1cdb7fe640 1 -- 172.21.15.50:0/4159390425 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4037040 con 0x56366d0f6920 2024-09-11T22:14:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.725+0000 7f1d03228740 1 -- 172.21.15.50:0/4159390425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 msgr2=0x56366d119340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.725+0000 7f1d03228740 1 --2- 172.21.15.50:0/4159390425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 0x56366d119340 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1cf404d000 tx=0x7f1cf403d000 comp rx=0 tx=0).stop 2024-09-11T22:14:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.725+0000 7f1d03228740 1 -- 172.21.15.50:0/4159390425 shutdown_connections 2024-09-11T22:14:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.725+0000 7f1d03228740 1 --2- 172.21.15.50:0/4159390425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d14f410 0x56366d139540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.725+0000 7f1d03228740 1 --2- 172.21.15.50:0/4159390425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 0x56366d13a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.725+0000 7f1d03228740 1 --2- 172.21.15.50:0/4159390425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d0f6920 0x56366d119340 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.725+0000 7f1d03228740 1 -- 172.21.15.50:0/4159390425 >> 172.21.15.50:0/4159390425 conn(0x56366d0f40e0 msgr2=0x56366d11ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.725+0000 7f1d03228740 1 -- 172.21.15.50:0/4159390425 shutdown_connections 2024-09-11T22:14:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.725+0000 7f1d03228740 1 -- 172.21.15.50:0/4159390425 wait complete. 2024-09-11T22:14:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.726+0000 7f1d03228740 1 -- start start 2024-09-11T22:14:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.726+0000 7f1d03228740 1 Processor -- start 2024-09-11T22:14:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1d03228740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f6920 0x56366d1b3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1d03228740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 0x56366d14c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1d03228740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 0x56366d15f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1d03228740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56366d13bc80 con 0x56366d14f410 2024-09-11T22:14:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1d03228740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf80ca830 con 0x56366d0f80b0 2024-09-11T22:14:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1d03228740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56366d11dd10 con 0x56366d0f6920 2024-09-11T22:14:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1d03228740 10 client.0 _ll_register_callbacks cb 0x7f1cf0009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cfe956640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 0x56366d15f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cfe956640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 0x56366d15f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36678/0 (socket says 172.21.15.50:36678) 2024-09-11T22:14:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cfe956640 1 -- 172.21.15.50:0/321687307 learned_addr learned my addr 172.21.15.50:0/321687307 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cfd954640 1 --2- 172.21.15.50:0/321687307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 0x56366d14c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cfe155640 1 --2- 172.21.15.50:0/321687307 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f6920 0x56366d1b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cfe956640 1 -- 172.21.15.50:0/321687307 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f6920 msgr2=0x56366d1b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cfe956640 1 --2- 172.21.15.50:0/321687307 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f6920 0x56366d1b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cfe956640 1 -- 172.21.15.50:0/321687307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 msgr2=0x56366d14c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cfe956640 1 --2- 172.21.15.50:0/321687307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 0x56366d14c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cfe956640 1 -- 172.21.15.50:0/321687307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56366d138970 con 0x56366d14f410 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cfe956640 1 --2- 172.21.15.50:0/321687307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 0x56366d15f5e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0007d70 tx=0x7f1cf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a48e674473e965 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cd97fa640 1 -- 172.21.15.50:0/321687307 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0030060 con 0x56366d14f410 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1cd97fa640 1 -- 172.21.15.50:0/321687307 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f1cf0016630 con 0x56366d14f410 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.727+0000 7f1d03228740 1 -- 172.21.15.50:0/321687307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cf4057070 con 0x56366d14f410 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1cd97fa640 1 -- 172.21.15.50:0/321687307 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f1cf0036050 con 0x56366d14f410 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1d03228740 10 client.5676 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1d03228740 1 -- 172.21.15.50:0/321687307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x56366d1ba080 con 0x56366d14f410 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1cd97fa640 1 -- 172.21.15.50:0/321687307 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf4057070 con 0x56366d14f410 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1cd97fa640 1 -- 172.21.15.50:0/321687307 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f1cf0039020 con 0x56366d14f410 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1d03228740 10 client.5676 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:02.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1d03228740 10 client.5676 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1d03228740 20 client.5676 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1d03228740 1 --2- 172.21.15.50:0/321687307 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56366d120250 0x56366d15fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1d03228740 4 client.5676 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:14:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1d03228740 1 -- 172.21.15.50:0/321687307 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56366d121de0 con 0x56366d120250 2024-09-11T22:14:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1cfe155640 1 --2- 172.21.15.50:0/321687307 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56366d120250 0x56366d15fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1cfe155640 1 --2- 172.21.15.50:0/321687307 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56366d120250 0x56366d15fb20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d79a7485dc49ae61 server_cookie=f3045958f8fe2a23 in_seq=0 out_seq=0 2024-09-11T22:14:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.728+0000 7f1cd97fa640 10 client.5676 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1cd97fa640 1 -- 172.21.15.50:0/321687307 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56366d121de0 con 0x56366d120250 2024-09-11T22:14:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1cd97fa640 10 client.5676 handle_command_reply: tid=0 2024-09-11T22:14:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d03228740 1 client.5676 shutdown 2024-09-11T22:14:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d03228740 1 -- 172.21.15.50:0/321687307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 msgr2=0x56366d15f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d03228740 1 --2- 172.21.15.50:0/321687307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 0x56366d15f5e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0007d70 tx=0x7f1cf0004a40 comp rx=0 tx=0).stop 2024-09-11T22:14:02.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d03228740 1 -- 172.21.15.50:0/321687307 shutdown_connections 2024-09-11T22:14:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d03228740 1 --2- 172.21.15.50:0/321687307 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56366d120250 0x56366d15fb20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d03228740 1 --2- 172.21.15.50:0/321687307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56366d14f410 0x56366d15f5e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d03228740 1 --2- 172.21.15.50:0/321687307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56366d0f80b0 0x56366d14c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1cd97fa640 0 client.5676 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d03228740 1 --2- 172.21.15.50:0/321687307 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56366d0f6920 0x56366d1b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d03228740 1 -- 172.21.15.50:0/321687307 >> 172.21.15.50:0/321687307 conn(0x56366d0f40e0 msgr2=0x56366d13b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d03228740 1 -- 172.21.15.50:0/321687307 shutdown_connections 2024-09-11T22:14:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d03228740 1 -- 172.21.15.50:0/321687307 wait complete. 2024-09-11T22:14:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d03228740 20 client.5676 trim_cache size 0 max 16384 2024-09-11T22:14:02.735 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-11T22:14:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-11T22:14:02.736 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:02.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d003b9640 1 -- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1cdc06be60 msgr2=0x7f1cdc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d003b9640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1cdc06be60 0x7f1cdc06e320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4034000 tx=0x7f1cf402e000 comp rx=0 tx=0).stop 2024-09-11T22:14:02.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d003b9640 1 -- 172.21.15.50:0/2055860188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cf80d05e0 msgr2=0x7f1cf8151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.729+0000 7f1d003b9640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cf80d05e0 0x7f1cf8151f90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800c4d0 tx=0x7f1ce800c990 comp rx=0 tx=0).stop 2024-09-11T22:14:02.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.730+0000 7f1d003b9640 1 -- 172.21.15.50:0/2055860188 shutdown_connections 2024-09-11T22:14:02.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.730+0000 7f1d003b9640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1cdc06be60 0x7f1cdc06e320 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.730+0000 7f1d003b9640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf815c2c0 0x7f1cf80cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.730+0000 7f1d003b9640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cf80d05e0 0x7f1cf8151f90 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.730+0000 7f1d003b9640 1 --2- 172.21.15.50:0/2055860188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf80b3e10 0x7f1cf8071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.730+0000 7f1d003b9640 1 -- 172.21.15.50:0/2055860188 >> 172.21.15.50:0/2055860188 conn(0x7f1cf80679c0 msgr2=0x7f1cf815ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.730+0000 7f1d003b9640 1 -- 172.21.15.50:0/2055860188 shutdown_connections 2024-09-11T22:14:02.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.730+0000 7f1d003b9640 1 -- 172.21.15.50:0/2055860188 wait complete. 2024-09-11T22:14:02.741 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:14:02.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-11T22:14:02.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.844+0000 7fc85ad2c640 1 Processor -- start 2024-09-11T22:14:02.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.844+0000 7fc85ad2c640 1 -- start start 2024-09-11T22:14:02.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.845+0000 7fc85ad2c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc85415b400 0x7fc85406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.845+0000 7fc85ad2c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc854072e60 0x7fc85406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.845+0000 7fc85ad2c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc85415b7e0 con 0x7fc85406df20 2024-09-11T22:14:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.845+0000 7fc85ad2c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc85406e370 con 0x7fc85415b400 2024-09-11T22:14:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.845+0000 7fc85ad2c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc85415f140 con 0x7fc854072e60 2024-09-11T22:14:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.845+0000 7fc858ac8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc85415b400 0x7fc85406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.845+0000 7fc8592c9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc85406df20 0x7fc8540b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36306/0 (socket says 172.21.15.50:36306) 2024-09-11T22:14:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.845+0000 7fc8592c9640 1 -- 172.21.15.50:0/743316310 learned_addr learned my addr 172.21.15.50:0/743316310 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.846+0000 7fc853fff640 1 --2- 172.21.15.50:0/743316310 >> v2:172.21.15.77:3300/0 conn(0x7fc854072e60 0x7fc85406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.846+0000 7fc858ac8640 1 -- 172.21.15.50:0/743316310 >> v2:172.21.15.77:3300/0 conn(0x7fc854072e60 msgr2=0x7fc85406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.846+0000 7fc858ac8640 1 --2- 172.21.15.50:0/743316310 >> v2:172.21.15.77:3300/0 conn(0x7fc854072e60 0x7fc85406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.846+0000 7fc858ac8640 1 -- 172.21.15.50:0/743316310 >> v1:172.21.15.50:6789/0 conn(0x7fc85406df20 legacy=0x7fc8540b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.846+0000 7fc8537fe640 1 -- 172.21.15.50:0/743316310 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759655315 0 0) 0x7fc85415b7e0 con 0x7fc85406df20 2024-09-11T22:14:02.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.846+0000 7fc858ac8640 1 -- 172.21.15.50:0/743316310 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85415f420 con 0x7fc85415b400 2024-09-11T22:14:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.846+0000 7fc858ac8640 1 --2- 172.21.15.50:0/743316310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc85415b400 0x7fc85406d070 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc8540b56b0 tx=0x7fc84c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e11c064c6cedc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.847+0000 7fc8537fe640 1 -- 172.21.15.50:0/743316310 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c007740 con 0x7fc85415b400 2024-09-11T22:14:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.847+0000 7fc8537fe640 1 -- 172.21.15.50:0/743316310 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c0078e0 con 0x7fc85415b400 2024-09-11T22:14:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.847+0000 7fc8537fe640 1 -- 172.21.15.50:0/743316310 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c007cb0 con 0x7fc85415b400 2024-09-11T22:14:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.847+0000 7fc85ad2c640 1 -- 172.21.15.50:0/743316310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc85415b400 msgr2=0x7fc85406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.847+0000 7fc85ad2c640 1 --2- 172.21.15.50:0/743316310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc85415b400 0x7fc85406d070 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc8540b56b0 tx=0x7fc84c02a680 comp rx=0 tx=0).stop 2024-09-11T22:14:02.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.847+0000 7fc85ad2c640 1 -- 172.21.15.50:0/743316310 shutdown_connections 2024-09-11T22:14:02.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.847+0000 7fc85ad2c640 1 --2- 172.21.15.50:0/743316310 >> v2:172.21.15.77:3300/0 conn(0x7fc854072e60 0x7fc85406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.847+0000 7fc85ad2c640 1 --2- 172.21.15.50:0/743316310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc85415b400 0x7fc85406d070 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.847+0000 7fc85ad2c640 1 -- 172.21.15.50:0/743316310 >> 172.21.15.50:0/743316310 conn(0x7fc8540679c0 msgr2=0x7fc854067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.847+0000 7fc85ad2c640 1 -- 172.21.15.50:0/743316310 shutdown_connections 2024-09-11T22:14:02.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.847+0000 7fc85ad2c640 1 -- 172.21.15.50:0/743316310 wait complete. 2024-09-11T22:14:02.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.848+0000 7fc85ad2c640 1 Processor -- start 2024-09-11T22:14:02.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.848+0000 7fc85ad2c640 1 -- start start 2024-09-11T22:14:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.849+0000 7fc85ad2c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc85406df20 0x7fc854168cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.849+0000 7fc85ad2c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854072e60 0x7fc8540b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.849+0000 7fc85ad2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc85415b400 0x7fc85414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.849+0000 7fc85ad2c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540cfc50 con 0x7fc854072e60 2024-09-11T22:14:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.849+0000 7fc85ad2c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc85415f9e0 con 0x7fc85415b400 2024-09-11T22:14:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.849+0000 7fc85ad2c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc8540721d0 con 0x7fc85406df20 2024-09-11T22:14:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.849+0000 7fc853fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854072e60 0x7fc8540b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.849+0000 7fc853fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854072e60 0x7fc8540b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36700/0 (socket says 172.21.15.50:36700) 2024-09-11T22:14:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.849+0000 7fc853fff640 1 -- 172.21.15.50:0/3004678712 learned_addr learned my addr 172.21.15.50:0/3004678712 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc8592c9640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc85415b400 0x7fc85414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc858ac8640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc85406df20 0x7fc854168cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc853fff640 1 -- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc85406df20 msgr2=0x7fc854168cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc853fff640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc85406df20 0x7fc854168cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc853fff640 1 -- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc85415b400 msgr2=0x7fc85414b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc853fff640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc85415b400 0x7fc85414b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc853fff640 1 -- 172.21.15.50:0/3004678712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8541676f0 con 0x7fc854072e60 2024-09-11T22:14:02.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc8592c9640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc85415b400 0x7fc85414b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:02.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc853fff640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854072e60 0x7fc8540b15c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc84800d830 tx=0x7fc84800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc8517fa640 1 -- 172.21.15.50:0/3004678712 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84800b6c0 con 0x7fc854072e60 2024-09-11T22:14:02.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc8517fa640 1 -- 172.21.15.50:0/3004678712 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc848019070 con 0x7fc854072e60 2024-09-11T22:14:02.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc8517fa640 1 -- 172.21.15.50:0/3004678712 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84800ba80 con 0x7fc854072e60 2024-09-11T22:14:02.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc85ad2c640 1 -- 172.21.15.50:0/3004678712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8541679d0 con 0x7fc854072e60 2024-09-11T22:14:02.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.850+0000 7fc85ad2c640 1 -- 172.21.15.50:0/3004678712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc854167f90 con 0x7fc854072e60 2024-09-11T22:14:02.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.852+0000 7fc8517fa640 1 -- 172.21.15.50:0/3004678712 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc84801e460 con 0x7fc854072e60 2024-09-11T22:14:02.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.852+0000 7fc8517fa640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc84006be30 0x7fc84006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.852+0000 7fc8517fa640 1 -- 172.21.15.50:0/3004678712 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc84808b540 con 0x7fc854072e60 2024-09-11T22:14:02.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.852+0000 7fc858ac8640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc84006be30 0x7fc84006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.853+0000 7fc858ac8640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc84006be30 0x7fc84006e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc84c034000 tx=0x7fc84c033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.853+0000 7fc85dabe740 1 Processor -- start 2024-09-11T22:14:02.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.853+0000 7fc85dabe740 1 -- start start 2024-09-11T22:14:02.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc85dabe740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a921ff05d0 0x55a921ff09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc85dabe740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921fedd90 0x55a921fef920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc85dabe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a921fd0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc85dabe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a921f0c5d0 con 0x55a921fee1f0 2024-09-11T22:14:02.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc85dabe740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a921eb4470 con 0x55a921fedd90 2024-09-11T22:14:02.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc85dabe740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a921f08590 con 0x55a921ff05d0 2024-09-11T22:14:02.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc8592c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a921fd0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc8592c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a921fd0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36716/0 (socket says 172.21.15.50:36716) 2024-09-11T22:14:02.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc8592c9640 1 -- 172.21.15.50:0/3158708650 learned_addr learned my addr 172.21.15.50:0/3158708650 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:02.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc853fff640 1 --2- 172.21.15.50:0/3158708650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921fedd90 0x55a921fef920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc858ac8640 1 --2- 172.21.15.50:0/3158708650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a921ff05d0 0x55a921ff09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc8592c9640 1 -- 172.21.15.50:0/3158708650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a921ff05d0 msgr2=0x55a921ff09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc8592c9640 1 --2- 172.21.15.50:0/3158708650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a921ff05d0 0x55a921ff09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc8592c9640 1 -- 172.21.15.50:0/3158708650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921fedd90 msgr2=0x55a921fef920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc8592c9640 1 --2- 172.21.15.50:0/3158708650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921fedd90 0x55a921fef920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc8592c9640 1 -- 172.21.15.50:0/3158708650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a921e9c860 con 0x55a921fee1f0 2024-09-11T22:14:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.854+0000 7fc8592c9640 1 --2- 172.21.15.50:0/3158708650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a921fd0550 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc844007430 tx=0x7fc844005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874b3a7b9aae7085 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.855+0000 7fc83a7fc640 1 -- 172.21.15.50:0/3158708650 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844019070 con 0x55a921fee1f0 2024-09-11T22:14:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.855+0000 7fc83a7fc640 1 -- 172.21.15.50:0/3158708650 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc844007640 con 0x55a921fee1f0 2024-09-11T22:14:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.855+0000 7fc83a7fc640 1 -- 172.21.15.50:0/3158708650 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844001a90 con 0x55a921fee1f0 2024-09-11T22:14:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.855+0000 7fc85dabe740 1 -- 172.21.15.50:0/3158708650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 msgr2=0x55a921fd0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.855+0000 7fc85dabe740 1 --2- 172.21.15.50:0/3158708650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a921fd0550 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc844007430 tx=0x7fc844005bc0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.855+0000 7fc85dabe740 1 -- 172.21.15.50:0/3158708650 shutdown_connections 2024-09-11T22:14:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.855+0000 7fc85dabe740 1 --2- 172.21.15.50:0/3158708650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a921fd0550 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.855+0000 7fc85dabe740 1 --2- 172.21.15.50:0/3158708650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921fedd90 0x55a921fef920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.855+0000 7fc85dabe740 1 --2- 172.21.15.50:0/3158708650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a921ff05d0 0x55a921ff09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.855+0000 7fc85dabe740 1 -- 172.21.15.50:0/3158708650 >> 172.21.15.50:0/3158708650 conn(0x55a921fa6230 msgr2=0x55a921fee640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.855+0000 7fc85dabe740 1 -- 172.21.15.50:0/3158708650 shutdown_connections 2024-09-11T22:14:02.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.855+0000 7fc85dabe740 1 -- 172.21.15.50:0/3158708650 wait complete. 2024-09-11T22:14:02.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.856+0000 7fc85dabe740 1 -- start start 2024-09-11T22:14:02.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.856+0000 7fc85dabe740 1 Processor -- start 2024-09-11T22:14:02.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc85dabe740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a921fee1f0 0x55a921fd3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc85dabe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921ff05d0 0x55a922002690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc85dabe740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a922002bd0 0x55a921fe7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc85dabe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a921feccf0 con 0x55a921ff05d0 2024-09-11T22:14:02.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc85dabe740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a921e95620 con 0x55a922002bd0 2024-09-11T22:14:02.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc85dabe740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a921fecfd0 con 0x55a921fee1f0 2024-09-11T22:14:02.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc85dabe740 10 client.0 _ll_register_callbacks cb 0x55a921eb95b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:02.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc853fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921ff05d0 0x55a922002690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc853fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921ff05d0 0x55a922002690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36720/0 (socket says 172.21.15.50:36720) 2024-09-11T22:14:02.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc853fff640 1 -- 172.21.15.50:0/2488173061 learned_addr learned my addr 172.21.15.50:0/2488173061 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc8592c9640 1 --2- 172.21.15.50:0/2488173061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a922002bd0 0x55a921fe7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc858ac8640 1 --2- 172.21.15.50:0/2488173061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a921fee1f0 0x55a921fd3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc853fff640 1 -- 172.21.15.50:0/2488173061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a921fee1f0 msgr2=0x55a921fd3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc853fff640 1 --2- 172.21.15.50:0/2488173061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a921fee1f0 0x55a921fd3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc853fff640 1 -- 172.21.15.50:0/2488173061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a922002bd0 msgr2=0x55a921fe7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc853fff640 1 --2- 172.21.15.50:0/2488173061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a922002bd0 0x55a921fe7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc853fff640 1 -- 172.21.15.50:0/2488173061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a921c1f3f0 con 0x55a921ff05d0 2024-09-11T22:14:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc853fff640 1 --2- 172.21.15.50:0/2488173061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921ff05d0 0x55a922002690 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc848089ac0 tx=0x7fc84805a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c724c9fde402ba2f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.857+0000 7fc8337fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc8337fe640 1 -- 172.21.15.50:0/2488173061 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc848071020 con 0x55a921ff05d0 2024-09-11T22:14:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc8337fe640 1 -- 172.21.15.50:0/2488173061 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc848055eb0 con 0x55a921ff05d0 2024-09-11T22:14:02.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc85dabe740 1 -- 172.21.15.50:0/2488173061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc844007640 con 0x55a921ff05d0 2024-09-11T22:14:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc8337fe640 1 -- 172.21.15.50:0/2488173061 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc848062420 con 0x55a921ff05d0 2024-09-11T22:14:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc85dabe740 10 client.5691 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc85dabe740 1 -- 172.21.15.50:0/2488173061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x55a921ce97d0 con 0x55a921ff05d0 2024-09-11T22:14:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc8337fe640 1 -- 172.21.15.50:0/2488173061 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc844007640 con 0x55a921ff05d0 2024-09-11T22:14:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc8337fe640 1 -- 172.21.15.50:0/2488173061 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fc848013070 con 0x55a921ff05d0 2024-09-11T22:14:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc85dabe740 10 client.5691 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc85dabe740 10 client.5691 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc85dabe740 20 client.5691 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc85dabe740 1 --2- 172.21.15.50:0/2488173061 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a921fe7f10 0x55a921fbdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc85dabe740 4 client.5691 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc85dabe740 1 -- 172.21.15.50:0/2488173061 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a921f6b030 con 0x55a921fe7f10 2024-09-11T22:14:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.858+0000 7fc858ac8640 1 --2- 172.21.15.50:0/2488173061 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a921fe7f10 0x55a921fbdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc8337fe640 10 client.5691 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc858ac8640 1 --2- 172.21.15.50:0/2488173061 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a921fe7f10 0x55a921fbdec0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=496578bda41f3129 server_cookie=34e8ba82e2b7ac70 in_seq=0 out_seq=0 2024-09-11T22:14:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc8337fe640 1 -- 172.21.15.50:0/2488173061 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a921f6b030 con 0x55a921fe7f10 2024-09-11T22:14:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc8337fe640 10 client.5691 handle_command_reply: tid=0 2024-09-11T22:14:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc85dabe740 1 client.5691 shutdown 2024-09-11T22:14:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc85dabe740 1 -- 172.21.15.50:0/2488173061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921ff05d0 msgr2=0x55a922002690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc85dabe740 1 --2- 172.21.15.50:0/2488173061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921ff05d0 0x55a922002690 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc848089ac0 tx=0x7fc84805a000 comp rx=0 tx=0).stop 2024-09-11T22:14:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc85dabe740 1 -- 172.21.15.50:0/2488173061 shutdown_connections 2024-09-11T22:14:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc85dabe740 1 --2- 172.21.15.50:0/2488173061 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a921fe7f10 0x55a921fbdec0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc85dabe740 1 --2- 172.21.15.50:0/2488173061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a922002bd0 0x55a921fe7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc85dabe740 1 --2- 172.21.15.50:0/2488173061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921ff05d0 0x55a922002690 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc8337fe640 0 client.5691 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:02.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc85dabe740 1 --2- 172.21.15.50:0/2488173061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a921fee1f0 0x55a921fd3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc85dabe740 1 -- 172.21.15.50:0/2488173061 >> 172.21.15.50:0/2488173061 conn(0x55a921fedd90 msgr2=0x55a921fa2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.859+0000 7fc85dabe740 1 -- 172.21.15.50:0/2488173061 shutdown_connections 2024-09-11T22:14:02.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.860+0000 7fc85dabe740 1 -- 172.21.15.50:0/2488173061 wait complete. 2024-09-11T22:14:02.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.860+0000 7fc85dabe740 20 client.5691 trim_cache size 0 max 16384 2024-09-11T22:14:02.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.873+0000 7fc85dabe740 1 Processor -- start 2024-09-11T22:14:02.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.873+0000 7fc85dabe740 1 -- start start 2024-09-11T22:14:02.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.873+0000 7fc85dabe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a921fe4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.873+0000 7fc85dabe740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921ff05d0 0x55a921fe8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.873+0000 7fc85dabe740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a922002bd0 0x55a921fcdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.873+0000 7fc85dabe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc854200980 con 0x55a921fee1f0 2024-09-11T22:14:02.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.873+0000 7fc85dabe740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc8541ffa30 con 0x55a921ff05d0 2024-09-11T22:14:02.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.873+0000 7fc85dabe740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc85415c690 con 0x55a922002bd0 2024-09-11T22:14:02.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.873+0000 7fc858ac8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a921fe4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.873+0000 7fc858ac8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a921fe4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36734/0 (socket says 172.21.15.50:36734) 2024-09-11T22:14:02.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.873+0000 7fc858ac8640 1 -- 172.21.15.50:0/214377347 learned_addr learned my addr 172.21.15.50:0/214377347 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:02.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc853fff640 1 --2- 172.21.15.50:0/214377347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921ff05d0 0x55a921fe8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc8592c9640 1 --2- 172.21.15.50:0/214377347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a922002bd0 0x55a921fcdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc858ac8640 1 -- 172.21.15.50:0/214377347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a922002bd0 msgr2=0x55a921fcdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc858ac8640 1 --2- 172.21.15.50:0/214377347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a922002bd0 0x55a921fcdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc858ac8640 1 -- 172.21.15.50:0/214377347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921ff05d0 msgr2=0x55a921fe8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc858ac8640 1 --2- 172.21.15.50:0/214377347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921ff05d0 0x55a921fe8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc858ac8640 1 -- 172.21.15.50:0/214377347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a922012c90 con 0x55a921fee1f0 2024-09-11T22:14:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc853fff640 1 --2- 172.21.15.50:0/214377347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921ff05d0 0x55a921fe8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc8592c9640 1 --2- 172.21.15.50:0/214377347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a922002bd0 0x55a921fcdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc858ac8640 1 --2- 172.21.15.50:0/214377347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a921fe4740 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc84c009e50 tx=0x7fc84c02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a889344af0f35a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc839ffb640 1 -- 172.21.15.50:0/214377347 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c041040 con 0x55a921fee1f0 2024-09-11T22:14:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc839ffb640 1 -- 172.21.15.50:0/214377347 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c03cb60 con 0x55a921fee1f0 2024-09-11T22:14:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc839ffb640 1 -- 172.21.15.50:0/214377347 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c031400 con 0x55a921fee1f0 2024-09-11T22:14:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc85dabe740 1 -- 172.21.15.50:0/214377347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 msgr2=0x55a921fe4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.874+0000 7fc85dabe740 1 --2- 172.21.15.50:0/214377347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a921fe4740 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc84c009e50 tx=0x7fc84c02f000 comp rx=0 tx=0).stop 2024-09-11T22:14:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.875+0000 7fc85dabe740 1 -- 172.21.15.50:0/214377347 shutdown_connections 2024-09-11T22:14:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.875+0000 7fc85dabe740 1 --2- 172.21.15.50:0/214377347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a922002bd0 0x55a921fcdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.875+0000 7fc85dabe740 1 --2- 172.21.15.50:0/214377347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921ff05d0 0x55a921fe8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.875+0000 7fc85dabe740 1 --2- 172.21.15.50:0/214377347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a921fe4740 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.875+0000 7fc85dabe740 1 -- 172.21.15.50:0/214377347 >> 172.21.15.50:0/214377347 conn(0x55a921fedd90 msgr2=0x55a921fa56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.875+0000 7fc85dabe740 1 -- 172.21.15.50:0/214377347 shutdown_connections 2024-09-11T22:14:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.875+0000 7fc85dabe740 1 -- 172.21.15.50:0/214377347 wait complete. 2024-09-11T22:14:02.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.875+0000 7fc85dabe740 1 -- start start 2024-09-11T22:14:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.875+0000 7fc85dabe740 1 Processor -- start 2024-09-11T22:14:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc85dabe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a92206c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc85dabe740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921ff05d0 0x55a921fc2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc85dabe740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a922002bd0 0x55a921fc3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc85dabe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc854150bc0 con 0x55a921fee1f0 2024-09-11T22:14:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc85dabe740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a922011f60 con 0x55a921ff05d0 2024-09-11T22:14:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc85dabe740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a92206ce90 con 0x55a922002bd0 2024-09-11T22:14:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc85dabe740 10 client.0 _ll_register_callbacks cb 0x7fc84800be30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc858ac8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a92206c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc858ac8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a92206c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36748/0 (socket says 172.21.15.50:36748) 2024-09-11T22:14:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc858ac8640 1 -- 172.21.15.50:0/3426623946 learned_addr learned my addr 172.21.15.50:0/3426623946 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc853fff640 1 --2- 172.21.15.50:0/3426623946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921ff05d0 0x55a921fc2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc8592c9640 1 --2- 172.21.15.50:0/3426623946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a922002bd0 0x55a921fc3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc858ac8640 1 -- 172.21.15.50:0/3426623946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a922002bd0 msgr2=0x55a921fc3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc858ac8640 1 --2- 172.21.15.50:0/3426623946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a922002bd0 0x55a921fc3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc858ac8640 1 -- 172.21.15.50:0/3426623946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921ff05d0 msgr2=0x55a921fc2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc858ac8640 1 --2- 172.21.15.50:0/3426623946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921ff05d0 0x55a921fc2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.876+0000 7fc858ac8640 1 -- 172.21.15.50:0/3426623946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a921fd07c0 con 0x55a921fee1f0 2024-09-11T22:14:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc858ac8640 1 --2- 172.21.15.50:0/3426623946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a92206c950 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc84c009e80 tx=0x7fc84c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3403015a9603dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc8337fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc8337fe640 1 -- 172.21.15.50:0/3426623946 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c041040 con 0x55a921fee1f0 2024-09-11T22:14:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc8337fe640 1 -- 172.21.15.50:0/3426623946 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc84c03cd10 con 0x55a921fee1f0 2024-09-11T22:14:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc85dabe740 1 -- 172.21.15.50:0/3426623946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc84c03cb60 con 0x55a921fee1f0 2024-09-11T22:14:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc8337fe640 1 -- 172.21.15.50:0/3426623946 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc84c059410 con 0x55a921fee1f0 2024-09-11T22:14:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc85dabe740 10 client.5697 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc85dabe740 1 -- 172.21.15.50:0/3426623946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x55a922000d50 con 0x55a921fee1f0 2024-09-11T22:14:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc8337fe640 1 -- 172.21.15.50:0/3426623946 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c03cb60 con 0x55a921fee1f0 2024-09-11T22:14:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc8337fe640 1 -- 172.21.15.50:0/3426623946 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fc84c0595b0 con 0x55a921fee1f0 2024-09-11T22:14:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc85dabe740 10 client.5697 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc85dabe740 10 client.5697 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc85dabe740 20 client.5697 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc85dabe740 1 --2- 172.21.15.50:0/3426623946 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a922009a60 0x55a921fd3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc85dabe740 4 client.5697 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:14:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc85dabe740 1 -- 172.21.15.50:0/3426623946 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a921f19d00 con 0x55a922009a60 2024-09-11T22:14:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.877+0000 7fc853fff640 1 --2- 172.21.15.50:0/3426623946 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a922009a60 0x55a921fd3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc8337fe640 10 client.5697 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc853fff640 1 --2- 172.21.15.50:0/3426623946 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a922009a60 0x55a921fd3790 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc29f6e11d7af90 server_cookie=bae3cc3b175e4898 in_seq=0 out_seq=0 2024-09-11T22:14:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc8337fe640 1 -- 172.21.15.50:0/3426623946 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+168 (crc 0 0 0) 0x55a921f19d00 con 0x55a922009a60 2024-09-11T22:14:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc8337fe640 10 client.5697 handle_command_reply: tid=0 2024-09-11T22:14:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc85dabe740 1 client.5697 shutdown 2024-09-11T22:14:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc85dabe740 1 -- 172.21.15.50:0/3426623946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 msgr2=0x55a92206c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc85dabe740 1 --2- 172.21.15.50:0/3426623946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a92206c950 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc84c009e80 tx=0x7fc84c004ab0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc85dabe740 1 -- 172.21.15.50:0/3426623946 shutdown_connections 2024-09-11T22:14:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc85dabe740 1 --2- 172.21.15.50:0/3426623946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a922002bd0 0x55a921fc3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc85dabe740 1 --2- 172.21.15.50:0/3426623946 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a922009a60 0x55a921fd3790 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc85dabe740 1 --2- 172.21.15.50:0/3426623946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a921ff05d0 0x55a921fc2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc85dabe740 1 --2- 172.21.15.50:0/3426623946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a921fee1f0 0x55a92206c950 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc85dabe740 1 -- 172.21.15.50:0/3426623946 >> 172.21.15.50:0/3426623946 conn(0x55a921fedd90 msgr2=0x55a921fa9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc8337fe640 0 client.5697 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc85dabe740 1 -- 172.21.15.50:0/3426623946 shutdown_connections 2024-09-11T22:14:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc85dabe740 1 -- 172.21.15.50:0/3426623946 wait complete. 2024-09-11T22:14:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.878+0000 7fc85dabe740 20 client.5697 trim_cache size 0 max 16384 2024-09-11T22:14:02.887 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:14:02.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:02.887 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-09-11T22:14:02.887 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2316877849, 2024-09-11T22:14:02.887 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511630412, 2024-09-11T22:14:02.887 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-09-11T22:14:02.887 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:02.888 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:14:02.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.879+0000 7fc85ad2c640 1 -- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc84006be30 msgr2=0x7fc84006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.879+0000 7fc85ad2c640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc84006be30 0x7fc84006e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc84c034000 tx=0x7fc84c033040 comp rx=0 tx=0).stop 2024-09-11T22:14:02.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.879+0000 7fc85ad2c640 1 -- 172.21.15.50:0/3004678712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854072e60 msgr2=0x7fc8540b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.879+0000 7fc85ad2c640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854072e60 0x7fc8540b15c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc84800d830 tx=0x7fc84800dcf0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.879+0000 7fc85ad2c640 1 -- 172.21.15.50:0/3004678712 shutdown_connections 2024-09-11T22:14:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.879+0000 7fc85ad2c640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc84006be30 0x7fc84006e2f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.879+0000 7fc85ad2c640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc85415b400 0x7fc85414b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.879+0000 7fc85ad2c640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc854072e60 0x7fc8540b15c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.879+0000 7fc85ad2c640 1 --2- 172.21.15.50:0/3004678712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc85406df20 0x7fc854168cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.879+0000 7fc85ad2c640 1 -- 172.21.15.50:0/3004678712 >> 172.21.15.50:0/3004678712 conn(0x7fc8540679c0 msgr2=0x7fc8540b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.879+0000 7fc85ad2c640 1 -- 172.21.15.50:0/3004678712 shutdown_connections 2024-09-11T22:14:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.879+0000 7fc85ad2c640 1 -- 172.21.15.50:0/3004678712 wait complete. 2024-09-11T22:14:02.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.992+0000 7f174b511640 1 Processor -- start 2024-09-11T22:14:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.992+0000 7f174b511640 1 -- start start 2024-09-11T22:14:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.993+0000 7f174b511640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1744161fa0 0x7f17440b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.993+0000 7f174b511640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17440b1600 0x7f17440cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.993+0000 7f174b511640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17440cfbd0 con 0x7f17440cf440 2024-09-11T22:14:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.993+0000 7f174b511640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f17440cdce0 con 0x7f17440b1600 2024-09-11T22:14:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.993+0000 7f174b511640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f17440d1220 con 0x7f1744161fa0 2024-09-11T22:14:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.993+0000 7f1748aac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17440b1600 0x7f17440cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.993+0000 7f1748aac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17440b1600 0x7f17440cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36756/0 (socket says 172.21.15.50:36756) 2024-09-11T22:14:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.993+0000 7f1748aac640 1 -- 172.21.15.50:0/3914778442 learned_addr learned my addr 172.21.15.50:0/3914778442 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.993+0000 7f17492ad640 1 --2- 172.21.15.50:0/3914778442 >> v2:172.21.15.77:3300/0 conn(0x7f1744161fa0 0x7f17440b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.993+0000 7f1748aac640 1 -- 172.21.15.50:0/3914778442 >> v2:172.21.15.77:3300/0 conn(0x7f1744161fa0 msgr2=0x7f17440b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.993+0000 7f1748aac640 1 --2- 172.21.15.50:0/3914778442 >> v2:172.21.15.77:3300/0 conn(0x7f1744161fa0 0x7f17440b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.993+0000 7f1748aac640 1 -- 172.21.15.50:0/3914778442 >> v1:172.21.15.77:6789/0 conn(0x7f17440cf440 legacy=0x7f174406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.993+0000 7f1748aac640 1 -- 172.21.15.50:0/3914778442 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17440cfeb0 con 0x7f17440b1600 2024-09-11T22:14:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.994+0000 7f1748aac640 1 --2- 172.21.15.50:0/3914778442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17440b1600 0x7f17440cef00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1744072960 tx=0x7f173402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e6f3de218e177c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.994+0000 7f173bfff640 1 -- 172.21.15.50:0/3914778442 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734037070 con 0x7f17440b1600 2024-09-11T22:14:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.994+0000 7f173bfff640 1 -- 172.21.15.50:0/3914778442 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1734032440 con 0x7f17440b1600 2024-09-11T22:14:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.994+0000 7f173bfff640 1 -- 172.21.15.50:0/3914778442 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734032810 con 0x7f17440b1600 2024-09-11T22:14:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.995+0000 7f174b511640 1 -- 172.21.15.50:0/3914778442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17440b1600 msgr2=0x7f17440cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.995+0000 7f174b511640 1 --2- 172.21.15.50:0/3914778442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17440b1600 0x7f17440cef00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1744072960 tx=0x7f173402a270 comp rx=0 tx=0).stop 2024-09-11T22:14:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.995+0000 7f174b511640 1 -- 172.21.15.50:0/3914778442 shutdown_connections 2024-09-11T22:14:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.995+0000 7f174b511640 1 --2- 172.21.15.50:0/3914778442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17440b1600 0x7f17440cef00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.995+0000 7f174b511640 1 --2- 172.21.15.50:0/3914778442 >> v2:172.21.15.77:3300/0 conn(0x7f1744161fa0 0x7f17440b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.995+0000 7f174b511640 1 -- 172.21.15.50:0/3914778442 >> 172.21.15.50:0/3914778442 conn(0x7f174409ba50 msgr2=0x7f17440b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.995+0000 7f174b511640 1 -- 172.21.15.50:0/3914778442 shutdown_connections 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.995+0000 7f174b511640 1 -- 172.21.15.50:0/3914778442 wait complete. 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.996+0000 7f174b511640 1 Processor -- start 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.996+0000 7f174b511640 1 -- start start 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f174b511640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17440b1600 0x7f17440b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f174b511640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17440cf440 0x7f174415daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f174b511640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1744161fa0 0x7f174415dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f174b511640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f17440cf870 con 0x7f17440cf440 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f174b511640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17440d17e0 con 0x7f17440b1600 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f174b511640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1744162380 con 0x7f1744161fa0 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f1748aac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17440cf440 0x7f174415daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f1748aac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17440cf440 0x7f174415daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36760/0 (socket says 172.21.15.50:36760) 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f1748aac640 1 -- 172.21.15.50:0/4176292244 learned_addr learned my addr 172.21.15.50:0/4176292244 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f17492ad640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17440b1600 0x7f17440b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f1749aae640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1744161fa0 0x7f174415dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f1748aac640 1 -- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1744161fa0 msgr2=0x7f174415dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f1748aac640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1744161fa0 0x7f174415dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f1748aac640 1 -- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17440b1600 msgr2=0x7f17440b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f1748aac640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17440b1600 0x7f17440b73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f1748aac640 1 -- 172.21.15.50:0/4176292244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17440cba00 con 0x7f17440cf440 2024-09-11T22:14:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f1749aae640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1744161fa0 0x7f174415dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f17492ad640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17440b1600 0x7f17440b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.997+0000 7f1748aac640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17440cf440 0x7f174415daa0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f173402a2b0 tx=0x7f17340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.998+0000 7f1739ffb640 1 -- 172.21.15.50:0/4176292244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734037040 con 0x7f17440cf440 2024-09-11T22:14:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.998+0000 7f1739ffb640 1 -- 172.21.15.50:0/4176292244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1734042070 con 0x7f17440cf440 2024-09-11T22:14:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.998+0000 7f174b511640 1 -- 172.21.15.50:0/4176292244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17440b56f0 con 0x7f17440cf440 2024-09-11T22:14:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.998+0000 7f1739ffb640 1 -- 172.21.15.50:0/4176292244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734030880 con 0x7f17440cf440 2024-09-11T22:14:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.998+0000 7f174b511640 1 -- 172.21.15.50:0/4176292244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17440b5cb0 con 0x7f17440cf440 2024-09-11T22:14:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.999+0000 7f174b511640 1 -- 172.21.15.50:0/4176292244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17440d1c70 con 0x7f17440cf440 2024-09-11T22:14:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:02.999+0000 7f1739ffb640 1 -- 172.21.15.50:0/4176292244 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1734030a20 con 0x7f17440cf440 2024-09-11T22:14:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.000+0000 7f1739ffb640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f172806be30 0x7f172806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.000+0000 7f1739ffb640 1 -- 172.21.15.50:0/4176292244 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f17340ab7b0 con 0x7f17440cf440 2024-09-11T22:14:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.000+0000 7f17492ad640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f172806be30 0x7f172806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.001+0000 7f17492ad640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f172806be30 0x7f172806e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1740009af0 tx=0x7f1740008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.004+0000 7f1739ffb640 1 -- 172.21.15.50:0/4176292244 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f173407a080 con 0x7f17440cf440 2024-09-11T22:14:03.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.215+0000 7f174b511640 1 -- 172.21.15.50:0/4176292244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17440afcb0 con 0x7f17440cf440 2024-09-11T22:14:03.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.216+0000 7f1739ffb640 1 -- 172.21.15.50:0/4176292244 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7f1734079980 con 0x7f17440cf440 2024-09-11T22:14:03.217 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:03.217 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"btime":"2024-09-11T22:13:43:312858+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2882007728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2882007728},{"type":"v1","addr":"172.21.15.50:6835","nonce":2882007728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1935649711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935649711},{"type":"v1","addr":"172.21.15.77:6837","nonce":1935649711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3208356003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3208356003},{"type":"v1","addr":"172.21.15.77:6836","nonce":3208356003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:13:39.660035+0000","modified":"2024-09-11T22:13:42.344052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/3053142878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3053142878},{"type":"v1","addr":"172.21.15.50:6834","nonce":3053142878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-11T22:14:03.217 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2024-09-11T22:14:03.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.218+0000 7f174b511640 1 -- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f172806be30 msgr2=0x7f172806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.218+0000 7f174b511640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f172806be30 0x7f172806e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1740009af0 tx=0x7f1740008040 comp rx=0 tx=0).stop 2024-09-11T22:14:03.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.218+0000 7f174b511640 1 -- 172.21.15.50:0/4176292244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17440cf440 msgr2=0x7f174415daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.218+0000 7f174b511640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17440cf440 0x7f174415daa0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f173402a2b0 tx=0x7f17340046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.218+0000 7f174b511640 1 -- 172.21.15.50:0/4176292244 shutdown_connections 2024-09-11T22:14:03.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.218+0000 7f174b511640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f172806be30 0x7f172806e2f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.218+0000 7f174b511640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1744161fa0 0x7f174415dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.218+0000 7f174b511640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17440cf440 0x7f174415daa0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.218+0000 7f174b511640 1 --2- 172.21.15.50:0/4176292244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17440b1600 0x7f17440b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.218+0000 7f174b511640 1 -- 172.21.15.50:0/4176292244 >> 172.21.15.50:0/4176292244 conn(0x7f174409ba50 msgr2=0x7f174406d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.218+0000 7f174b511640 1 -- 172.21.15.50:0/4176292244 shutdown_connections 2024-09-11T22:14:03.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.218+0000 7f174b511640 1 -- 172.21.15.50:0/4176292244 wait complete. 2024-09-11T22:14:03.230 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 2316877849 2024-09-11T22:14:03.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.335+0000 7fd578ee6640 1 Processor -- start 2024-09-11T22:14:03.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.335+0000 7fd578ee6640 1 -- start start 2024-09-11T22:14:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.336+0000 7fd578ee6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5740d18e0 0x7fd5740d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.336+0000 7fd578ee6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd57415eb70 0x7fd5740d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.336+0000 7fd578ee6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5740d31b0 con 0x7fd57415e790 2024-09-11T22:14:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.336+0000 7fd578ee6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd5740d3dc0 con 0x7fd5740d18e0 2024-09-11T22:14:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.336+0000 7fd578ee6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5740d3490 con 0x7fd57415eb70 2024-09-11T22:14:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.336+0000 7fd571d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5740d18e0 0x7fd5740d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.336+0000 7fd571d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5740d18e0 0x7fd5740d4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36768/0 (socket says 172.21.15.50:36768) 2024-09-11T22:14:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.336+0000 7fd57259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd57415e790 0x7fd5740d11d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36308/0 (socket says 172.21.15.50:36308) 2024-09-11T22:14:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.336+0000 7fd571d9b640 1 -- 172.21.15.50:0/3523355220 learned_addr learned my addr 172.21.15.50:0/3523355220 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.336+0000 7fd572d9d640 1 --2- 172.21.15.50:0/3523355220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd57415eb70 0x7fd5740d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.337+0000 7fd571d9b640 1 -- 172.21.15.50:0/3523355220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd57415eb70 msgr2=0x7fd5740d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.337+0000 7fd571d9b640 1 --2- 172.21.15.50:0/3523355220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd57415eb70 0x7fd5740d2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.337+0000 7fd571d9b640 1 -- 172.21.15.50:0/3523355220 >> v1:172.21.15.50:6789/0 conn(0x7fd57415e790 legacy=0x7fd5740d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.337+0000 7fd571d9b640 1 -- 172.21.15.50:0/3523355220 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5740d3770 con 0x7fd5740d18e0 2024-09-11T22:14:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.337+0000 7fd57159a640 1 -- 172.21.15.50:0/3523355220 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2371315318 0 0) 0x7fd5740d31b0 con 0x7fd57415e790 2024-09-11T22:14:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.337+0000 7fd571d9b640 1 --2- 172.21.15.50:0/3523355220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5740d18e0 0x7fd5740d4250 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd568009870 tx=0x7fd56802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3622f080072bbfd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.337+0000 7fd57159a640 1 -- 172.21.15.50:0/3523355220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568037070 con 0x7fd5740d18e0 2024-09-11T22:14:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.337+0000 7fd57159a640 1 -- 172.21.15.50:0/3523355220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd568032440 con 0x7fd5740d18e0 2024-09-11T22:14:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.337+0000 7fd57159a640 1 -- 172.21.15.50:0/3523355220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568032810 con 0x7fd5740d18e0 2024-09-11T22:14:03.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.338+0000 7fd578ee6640 1 -- 172.21.15.50:0/3523355220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5740d18e0 msgr2=0x7fd5740d4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.338+0000 7fd578ee6640 1 --2- 172.21.15.50:0/3523355220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5740d18e0 0x7fd5740d4250 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd568009870 tx=0x7fd56802a270 comp rx=0 tx=0).stop 2024-09-11T22:14:03.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.338+0000 7fd578ee6640 1 -- 172.21.15.50:0/3523355220 shutdown_connections 2024-09-11T22:14:03.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.338+0000 7fd578ee6640 1 --2- 172.21.15.50:0/3523355220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd57415eb70 0x7fd5740d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.338+0000 7fd578ee6640 1 --2- 172.21.15.50:0/3523355220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5740d18e0 0x7fd5740d4250 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.338+0000 7fd578ee6640 1 -- 172.21.15.50:0/3523355220 >> 172.21.15.50:0/3523355220 conn(0x7fd5740727a0 msgr2=0x7fd5740679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.338+0000 7fd578ee6640 1 -- 172.21.15.50:0/3523355220 shutdown_connections 2024-09-11T22:14:03.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.338+0000 7fd578ee6640 1 -- 172.21.15.50:0/3523355220 wait complete. 2024-09-11T22:14:03.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.339+0000 7fd578ee6640 1 Processor -- start 2024-09-11T22:14:03.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.339+0000 7fd578ee6640 1 -- start start 2024-09-11T22:14:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.340+0000 7fd578ee6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5740d18e0 0x7fd5741f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.340+0000 7fd578ee6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57415e790 0x7fd5740ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.340+0000 7fd578ee6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd57415eb70 0x7fd574154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.340+0000 7fd578ee6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd5740ba3b0 con 0x7fd57415e790 2024-09-11T22:14:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.340+0000 7fd578ee6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5740ba230 con 0x7fd5740d18e0 2024-09-11T22:14:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.340+0000 7fd578ee6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5740ba530 con 0x7fd57415eb70 2024-09-11T22:14:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.340+0000 7fd571d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57415e790 0x7fd5740ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.340+0000 7fd571d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57415e790 0x7fd5740ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36772/0 (socket says 172.21.15.50:36772) 2024-09-11T22:14:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.340+0000 7fd571d9b640 1 -- 172.21.15.50:0/2514294476 learned_addr learned my addr 172.21.15.50:0/2514294476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd572d9d640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd57415eb70 0x7fd574154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd57259c640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5740d18e0 0x7fd5741f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd571d9b640 1 -- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd57415eb70 msgr2=0x7fd574154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd571d9b640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd57415eb70 0x7fd574154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd571d9b640 1 -- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5740d18e0 msgr2=0x7fd5741f3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd571d9b640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5740d18e0 0x7fd5741f3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd571d9b640 1 -- 172.21.15.50:0/2514294476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5740c90e0 con 0x7fd57415e790 2024-09-11T22:14:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd57259c640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5740d18e0 0x7fd5741f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd571d9b640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57415e790 0x7fd5740ca970 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd568009870 tx=0x7fd5680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd562ffd640 1 -- 172.21.15.50:0/2514294476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568037040 con 0x7fd57415e790 2024-09-11T22:14:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd562ffd640 1 -- 172.21.15.50:0/2514294476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd568042070 con 0x7fd57415e790 2024-09-11T22:14:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd578ee6640 1 -- 172.21.15.50:0/2514294476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5740c93c0 con 0x7fd57415e790 2024-09-11T22:14:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd562ffd640 1 -- 172.21.15.50:0/2514294476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568030bb0 con 0x7fd57415e790 2024-09-11T22:14:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.341+0000 7fd578ee6640 1 -- 172.21.15.50:0/2514294476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5740c9980 con 0x7fd57415e790 2024-09-11T22:14:03.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.343+0000 7fd562ffd640 1 -- 172.21.15.50:0/2514294476 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd568047460 con 0x7fd57415e790 2024-09-11T22:14:03.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.343+0000 7fd562ffd640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd55406be30 0x7fd55406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.343+0000 7fd562ffd640 1 -- 172.21.15.50:0/2514294476 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd5680abb50 con 0x7fd57415e790 2024-09-11T22:14:03.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.344+0000 7fd57259c640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd55406be30 0x7fd55406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.344+0000 7fd57259c640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd55406be30 0x7fd55406e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd564000f60 tx=0x7fd564009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.344+0000 7fd57bc76740 1 Processor -- start 2024-09-11T22:14:03.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.345+0000 7fd57bc76740 1 -- start start 2024-09-11T22:14:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.345+0000 7fd57bc76740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 0x560588240280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.345+0000 7fd57bc76740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823d660 0x56058823f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.345+0000 7fd57bc76740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058823dac0 0x56058821fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.345+0000 7fd57bc76740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56058815c8d0 con 0x56058823fea0 2024-09-11T22:14:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.345+0000 7fd57bc76740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560588104510 con 0x56058823dac0 2024-09-11T22:14:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.345+0000 7fd57bc76740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560588158890 con 0x56058823d660 2024-09-11T22:14:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.345+0000 7fd57259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 0x560588240280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.345+0000 7fd57259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 0x560588240280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36778/0 (socket says 172.21.15.50:36778) 2024-09-11T22:14:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.345+0000 7fd57259c640 1 -- 172.21.15.50:0/4123199752 learned_addr learned my addr 172.21.15.50:0/4123199752 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.345+0000 7fd572d9d640 1 --2- 172.21.15.50:0/4123199752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058823dac0 0x56058821fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.345+0000 7fd571d9b640 1 --2- 172.21.15.50:0/4123199752 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823d660 0x56058823f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.346+0000 7fd57259c640 1 -- 172.21.15.50:0/4123199752 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823d660 msgr2=0x56058823f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.346+0000 7fd57259c640 1 --2- 172.21.15.50:0/4123199752 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823d660 0x56058823f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.346+0000 7fd57259c640 1 -- 172.21.15.50:0/4123199752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058823dac0 msgr2=0x56058821fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.346+0000 7fd57259c640 1 --2- 172.21.15.50:0/4123199752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058823dac0 0x56058821fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.346+0000 7fd57259c640 1 -- 172.21.15.50:0/4123199752 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605881191a0 con 0x56058823fea0 2024-09-11T22:14:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.346+0000 7fd57259c640 1 --2- 172.21.15.50:0/4123199752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 0x560588240280 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd564007360 tx=0x7fd564010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d569717ca590eee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.346+0000 7fd553fff640 1 -- 172.21.15.50:0/4123199752 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56400dbe0 con 0x56058823fea0 2024-09-11T22:14:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.346+0000 7fd553fff640 1 -- 172.21.15.50:0/4123199752 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd564001400 con 0x56058823fea0 2024-09-11T22:14:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.346+0000 7fd553fff640 1 -- 172.21.15.50:0/4123199752 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd564020450 con 0x56058823fea0 2024-09-11T22:14:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.347+0000 7fd57bc76740 1 -- 172.21.15.50:0/4123199752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 msgr2=0x560588240280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.347+0000 7fd57bc76740 1 --2- 172.21.15.50:0/4123199752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 0x560588240280 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd564007360 tx=0x7fd564010000 comp rx=0 tx=0).stop 2024-09-11T22:14:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.347+0000 7fd57bc76740 1 -- 172.21.15.50:0/4123199752 shutdown_connections 2024-09-11T22:14:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.347+0000 7fd57bc76740 1 --2- 172.21.15.50:0/4123199752 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823d660 0x56058823f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.347+0000 7fd57bc76740 1 --2- 172.21.15.50:0/4123199752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058823dac0 0x56058821fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.347+0000 7fd57bc76740 1 --2- 172.21.15.50:0/4123199752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 0x560588240280 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.347+0000 7fd57bc76740 1 -- 172.21.15.50:0/4123199752 >> 172.21.15.50:0/4123199752 conn(0x5605881f5d90 msgr2=0x56058823df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.347+0000 7fd57bc76740 1 -- 172.21.15.50:0/4123199752 shutdown_connections 2024-09-11T22:14:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.347+0000 7fd57bc76740 1 -- 172.21.15.50:0/4123199752 wait complete. 2024-09-11T22:14:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.347+0000 7fd57bc76740 1 -- start start 2024-09-11T22:14:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.348+0000 7fd57bc76740 1 Processor -- start 2024-09-11T22:14:03.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.348+0000 7fd57bc76740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058823dac0 0x5605882377e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.348+0000 7fd57bc76740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823fea0 0x560588234db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.348+0000 7fd57bc76740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560588221940 0x560588221dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.348+0000 7fd57bc76740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56058823c5c0 con 0x560588221940 2024-09-11T22:14:03.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.348+0000 7fd57bc76740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5605880e5640 con 0x56058823dac0 2024-09-11T22:14:03.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.348+0000 7fd57bc76740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56058823c8a0 con 0x56058823fea0 2024-09-11T22:14:03.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.348+0000 7fd57bc76740 10 client.0 _ll_register_callbacks cb 0x56058811d2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:03.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd572d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560588221940 0x560588221dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd57259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058823dac0 0x5605882377e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd572d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560588221940 0x560588221dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36786/0 (socket says 172.21.15.50:36786) 2024-09-11T22:14:03.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd572d9d640 1 -- 172.21.15.50:0/1231108448 learned_addr learned my addr 172.21.15.50:0/1231108448 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd571d9b640 1 --2- 172.21.15.50:0/1231108448 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823fea0 0x560588234db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd572d9d640 1 -- 172.21.15.50:0/1231108448 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823fea0 msgr2=0x560588234db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd572d9d640 1 --2- 172.21.15.50:0/1231108448 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823fea0 0x560588234db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd572d9d640 1 -- 172.21.15.50:0/1231108448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058823dac0 msgr2=0x5605882377e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd572d9d640 1 --2- 172.21.15.50:0/1231108448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058823dac0 0x5605882377e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd572d9d640 1 -- 172.21.15.50:0/1231108448 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560587f3b710 con 0x560588221940 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd572d9d640 1 --2- 172.21.15.50:0/1231108448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560588221940 0x560588221dc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0117d0 tx=0x7fd56c011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc9632f5ff96001 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd5517fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd5517fa640 1 -- 172.21.15.50:0/1231108448 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c011e80 con 0x560588221940 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd5517fa640 1 -- 172.21.15.50:0/1231108448 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd56c01cb20 con 0x560588221940 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd57bc76740 1 -- 172.21.15.50:0/1231108448 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd564001400 con 0x560588221940 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd5517fa640 1 -- 172.21.15.50:0/1231108448 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd56c01cd20 con 0x560588221940 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd57bc76740 10 client.5718 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd57bc76740 1 -- 172.21.15.50:0/1231108448 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x560587f9bea0 con 0x560588221940 2024-09-11T22:14:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.349+0000 7fd5517fa640 1 -- 172.21.15.50:0/1231108448 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd564001400 con 0x560588221940 2024-09-11T22:14:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.350+0000 7fd5517fa640 1 -- 172.21.15.50:0/1231108448 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fd56c023050 con 0x560588221940 2024-09-11T22:14:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.350+0000 7fd57bc76740 10 client.5718 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.350+0000 7fd57bc76740 10 client.5718 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:14:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.350+0000 7fd57bc76740 20 client.5718 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.350+0000 7fd57bc76740 1 --2- 172.21.15.50:0/1231108448 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x560588251970 0x560588251d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.350+0000 7fd57bc76740 4 client.5718 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.350+0000 7fd57bc76740 1 -- 172.21.15.50:0/1231108448 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56058816a000 con 0x560588251970 2024-09-11T22:14:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.350+0000 7fd57259c640 1 --2- 172.21.15.50:0/1231108448 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x560588251970 0x560588251d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.350+0000 7fd57259c640 1 --2- 172.21.15.50:0/1231108448 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x560588251970 0x560588251d50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46cc72b495ccd4e5 server_cookie=96ee530c9565cd79 in_seq=0 out_seq=0 2024-09-11T22:14:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.350+0000 7fd5517fa640 10 client.5718 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd5517fa640 1 -- 172.21.15.50:0/1231108448 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56058816a000 con 0x560588251970 2024-09-11T22:14:03.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd5517fa640 10 client.5718 handle_command_reply: tid=0 2024-09-11T22:14:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd57bc76740 1 client.5718 shutdown 2024-09-11T22:14:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd57bc76740 1 -- 172.21.15.50:0/1231108448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560588221940 msgr2=0x560588221dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd57bc76740 1 --2- 172.21.15.50:0/1231108448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560588221940 0x560588221dc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0117d0 tx=0x7fd56c011c90 comp rx=0 tx=0).stop 2024-09-11T22:14:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd57bc76740 1 -- 172.21.15.50:0/1231108448 shutdown_connections 2024-09-11T22:14:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd57bc76740 1 --2- 172.21.15.50:0/1231108448 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823fea0 0x560588234db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd57bc76740 1 --2- 172.21.15.50:0/1231108448 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x560588251970 0x560588251d50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd57bc76740 1 --2- 172.21.15.50:0/1231108448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560588221940 0x560588221dc0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd57bc76740 1 --2- 172.21.15.50:0/1231108448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56058823dac0 0x5605882377e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd5517fa640 0 client.5718 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd57bc76740 1 -- 172.21.15.50:0/1231108448 >> 172.21.15.50:0/1231108448 conn(0x56058823d660 msgr2=0x56058823df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd57bc76740 1 -- 172.21.15.50:0/1231108448 shutdown_connections 2024-09-11T22:14:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd57bc76740 1 -- 172.21.15.50:0/1231108448 wait complete. 2024-09-11T22:14:03.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.351+0000 7fd57bc76740 20 client.5718 trim_cache size 0 max 16384 2024-09-11T22:14:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.364+0000 7fd57bc76740 1 Processor -- start 2024-09-11T22:14:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.364+0000 7fd57bc76740 1 -- start start 2024-09-11T22:14:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd57bc76740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560588221940 0x5605882581e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd57bc76740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823dac0 0x5605882b3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd57bc76740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823fea0 0x56058823b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd57bc76740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd574157f20 con 0x56058823dac0 2024-09-11T22:14:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd57bc76740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd574153680 con 0x560588221940 2024-09-11T22:14:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd57bc76740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5741578d0 con 0x56058823fea0 2024-09-11T22:14:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd571d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823dac0 0x5605882b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd571d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823dac0 0x5605882b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36802/0 (socket says 172.21.15.50:36802) 2024-09-11T22:14:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd571d9b640 1 -- 172.21.15.50:0/421784622 learned_addr learned my addr 172.21.15.50:0/421784622 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd571d9b640 1 -- 172.21.15.50:0/421784622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823fea0 msgr2=0x56058823b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd571d9b640 1 --2- 172.21.15.50:0/421784622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823fea0 0x56058823b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd571d9b640 1 -- 172.21.15.50:0/421784622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560588221940 msgr2=0x5605882581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd571d9b640 1 --2- 172.21.15.50:0/421784622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560588221940 0x5605882581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.365+0000 7fd571d9b640 1 -- 172.21.15.50:0/421784622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560587e2f000 con 0x56058823dac0 2024-09-11T22:14:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.366+0000 7fd571d9b640 1 --2- 172.21.15.50:0/421784622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823dac0 0x5605882b3340 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd568079cc0 tx=0x7fd568079750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced4ea183d595795 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.366+0000 7fd5537fe640 1 -- 172.21.15.50:0/421784622 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568096070 con 0x56058823dac0 2024-09-11T22:14:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.366+0000 7fd5537fe640 1 -- 172.21.15.50:0/421784622 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd568079d30 con 0x56058823dac0 2024-09-11T22:14:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.366+0000 7fd5537fe640 1 -- 172.21.15.50:0/421784622 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5680a7030 con 0x56058823dac0 2024-09-11T22:14:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.366+0000 7fd57bc76740 1 -- 172.21.15.50:0/421784622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823dac0 msgr2=0x5605882b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.366+0000 7fd57bc76740 1 --2- 172.21.15.50:0/421784622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823dac0 0x5605882b3340 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd568079cc0 tx=0x7fd568079750 comp rx=0 tx=0).stop 2024-09-11T22:14:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.366+0000 7fd57bc76740 1 -- 172.21.15.50:0/421784622 shutdown_connections 2024-09-11T22:14:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.366+0000 7fd57bc76740 1 --2- 172.21.15.50:0/421784622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823fea0 0x56058823b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.366+0000 7fd57bc76740 1 --2- 172.21.15.50:0/421784622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823dac0 0x5605882b3340 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.366+0000 7fd57bc76740 1 --2- 172.21.15.50:0/421784622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560588221940 0x5605882581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.366+0000 7fd57bc76740 1 -- 172.21.15.50:0/421784622 >> 172.21.15.50:0/421784622 conn(0x56058823d660 msgr2=0x56058824d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.366+0000 7fd57bc76740 1 -- 172.21.15.50:0/421784622 shutdown_connections 2024-09-11T22:14:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.366+0000 7fd57bc76740 1 -- 172.21.15.50:0/421784622 wait complete. 2024-09-11T22:14:03.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.367+0000 7fd57bc76740 1 -- start start 2024-09-11T22:14:03.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.367+0000 7fd57bc76740 1 Processor -- start 2024-09-11T22:14:03.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd57bc76740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560588221940 0x5605881f90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd57bc76740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823dac0 0x56058829aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd57bc76740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 0x56058829b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd57bc76740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560588235340 con 0x56058823fea0 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd57bc76740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560588223b40 con 0x560588221940 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd57bc76740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56058824ee90 con 0x56058823dac0 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd57bc76740 10 client.0 _ll_register_callbacks cb 0x7fd56c007a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd572d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 0x56058829b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd572d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 0x56058829b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36816/0 (socket says 172.21.15.50:36816) 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd572d9d640 1 -- 172.21.15.50:0/1389780731 learned_addr learned my addr 172.21.15.50:0/1389780731 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd571d9b640 1 --2- 172.21.15.50:0/1389780731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823dac0 0x56058829aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd57259c640 1 --2- 172.21.15.50:0/1389780731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560588221940 0x5605881f90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd572d9d640 1 -- 172.21.15.50:0/1389780731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823dac0 msgr2=0x56058829aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd572d9d640 1 --2- 172.21.15.50:0/1389780731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823dac0 0x56058829aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd572d9d640 1 -- 172.21.15.50:0/1389780731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560588221940 msgr2=0x5605881f90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd572d9d640 1 --2- 172.21.15.50:0/1389780731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560588221940 0x5605881f90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.368+0000 7fd572d9d640 1 -- 172.21.15.50:0/1389780731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560588223910 con 0x56058823fea0 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd572d9d640 1 --2- 172.21.15.50:0/1389780731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 0x56058829b3f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd56c000f80 tx=0x7fd56c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd47ab61036d9018 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd5517fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd5517fa640 1 -- 172.21.15.50:0/1389780731 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c011e80 con 0x56058823fea0 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd5517fa640 1 -- 172.21.15.50:0/1389780731 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd56c009040 con 0x56058823fea0 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd57bc76740 1 -- 172.21.15.50:0/1389780731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd568079d30 con 0x56058823fea0 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd5517fa640 1 -- 172.21.15.50:0/1389780731 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd56c035050 con 0x56058823fea0 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd57bc76740 10 client.5724 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd57bc76740 1 -- 172.21.15.50:0/1389780731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5605882624b0 con 0x56058823fea0 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd5517fa640 1 -- 172.21.15.50:0/1389780731 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd568079d30 con 0x56058823fea0 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd5517fa640 1 -- 172.21.15.50:0/1389780731 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fd56c038020 con 0x56058823fea0 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd57bc76740 10 client.5724 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd57bc76740 10 client.5724 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:14:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd57bc76740 20 client.5724 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd57bc76740 1 --2- 172.21.15.50:0/1389780731 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5605882614a0 0x56058824c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd57bc76740 4 client.5724 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 2316877849}] 2024-09-11T22:14:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd57bc76740 1 -- 172.21.15.50:0/1389780731 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "damage rm", "damage_id": 2316877849}) -- 0x560588164350 con 0x5605882614a0 2024-09-11T22:14:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.369+0000 7fd57259c640 1 --2- 172.21.15.50:0/1389780731 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5605882614a0 0x56058824c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd57259c640 1 --2- 172.21.15.50:0/1389780731 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5605882614a0 0x56058824c5a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df308b3d5b4c2db4 server_cookie=624e7b6493d5c5a2 in_seq=0 out_seq=0 2024-09-11T22:14:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd5517fa640 10 client.5724 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd5517fa640 1 -- 172.21.15.50:0/1389780731 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x560588164350 con 0x5605882614a0 2024-09-11T22:14:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd5517fa640 10 client.5724 handle_command_reply: tid=0 2024-09-11T22:14:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd57bc76740 1 client.5724 shutdown 2024-09-11T22:14:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd57bc76740 1 -- 172.21.15.50:0/1389780731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 msgr2=0x56058829b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd57bc76740 1 --2- 172.21.15.50:0/1389780731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 0x56058829b3f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd56c000f80 tx=0x7fd56c004ab0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd57bc76740 1 -- 172.21.15.50:0/1389780731 shutdown_connections 2024-09-11T22:14:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd57bc76740 1 --2- 172.21.15.50:0/1389780731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56058823dac0 0x56058829aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd57bc76740 1 --2- 172.21.15.50:0/1389780731 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5605882614a0 0x56058824c5a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd57bc76740 1 --2- 172.21.15.50:0/1389780731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56058823fea0 0x56058829b3f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd57bc76740 1 --2- 172.21.15.50:0/1389780731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560588221940 0x5605881f90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd5517fa640 0 client.5724 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd57bc76740 1 -- 172.21.15.50:0/1389780731 >> 172.21.15.50:0/1389780731 conn(0x56058823d660 msgr2=0x56058823b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd57bc76740 1 -- 172.21.15.50:0/1389780731 shutdown_connections 2024-09-11T22:14:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd57bc76740 1 -- 172.21.15.50:0/1389780731 wait complete. 2024-09-11T22:14:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.370+0000 7fd57bc76740 20 client.5724 trim_cache size 0 max 16384 2024-09-11T22:14:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.371+0000 7fd578ee6640 1 -- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd55406be30 msgr2=0x7fd55406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.371+0000 7fd578ee6640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd55406be30 0x7fd55406e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd564000f60 tx=0x7fd564009040 comp rx=0 tx=0).stop 2024-09-11T22:14:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.371+0000 7fd578ee6640 1 -- 172.21.15.50:0/2514294476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57415e790 msgr2=0x7fd5740ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.371+0000 7fd578ee6640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57415e790 0x7fd5740ca970 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd568009870 tx=0x7fd5680046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.371+0000 7fd578ee6640 1 -- 172.21.15.50:0/2514294476 shutdown_connections 2024-09-11T22:14:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.371+0000 7fd578ee6640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd55406be30 0x7fd55406e2f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.371+0000 7fd578ee6640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd57415eb70 0x7fd574154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.371+0000 7fd578ee6640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57415e790 0x7fd5740ca970 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.371+0000 7fd578ee6640 1 --2- 172.21.15.50:0/2514294476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5740d18e0 0x7fd5741f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.371+0000 7fd578ee6640 1 -- 172.21.15.50:0/2514294476 >> 172.21.15.50:0/2514294476 conn(0x7fd5740727a0 msgr2=0x7fd5740b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.371+0000 7fd578ee6640 1 -- 172.21.15.50:0/2514294476 shutdown_connections 2024-09-11T22:14:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.371+0000 7fd578ee6640 1 -- 172.21.15.50:0/2514294476 wait complete. 2024-09-11T22:14:03.382 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-11T22:14:03.382 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-11T22:14:03.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.485+0000 7fccd9eba640 1 Processor -- start 2024-09-11T22:14:03.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.486+0000 7fccd9eba640 1 -- start start 2024-09-11T22:14:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.486+0000 7fccd9eba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fccd415e870 0x7fccd40d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.486+0000 7fccd9eba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fccd40d3c00 0x7fccd40b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.486+0000 7fccd9eba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccd40cfa80 con 0x7fccd40d16d0 2024-09-11T22:14:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.486+0000 7fccd9eba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fccd40d1b40 con 0x7fccd415e870 2024-09-11T22:14:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.486+0000 7fccd9eba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fccd40d40d0 con 0x7fccd40d3c00 2024-09-11T22:14:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.486+0000 7fccd37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fccd415e870 0x7fccd40d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.486+0000 7fccd37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fccd415e870 0x7fccd40d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36824/0 (socket says 172.21.15.50:36824) 2024-09-11T22:14:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.486+0000 7fccd37fe640 1 -- 172.21.15.50:0/2073669298 learned_addr learned my addr 172.21.15.50:0/2073669298 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.486+0000 7fccd2ffd640 1 --1- 172.21.15.50:0/2073669298 >> v1:172.21.15.50:6789/0 conn(0x7fccd40d16d0 0x7fccd40d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36324/0 (socket says 172.21.15.50:36324) 2024-09-11T22:14:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.487+0000 7fccd3fff640 1 --2- 172.21.15.50:0/2073669298 >> v2:172.21.15.77:3300/0 conn(0x7fccd40d3c00 0x7fccd40b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.487+0000 7fccd37fe640 1 -- 172.21.15.50:0/2073669298 >> v2:172.21.15.77:3300/0 conn(0x7fccd40d3c00 msgr2=0x7fccd40b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.487+0000 7fccd37fe640 1 --2- 172.21.15.50:0/2073669298 >> v2:172.21.15.77:3300/0 conn(0x7fccd40d3c00 0x7fccd40b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.487+0000 7fccd37fe640 1 -- 172.21.15.50:0/2073669298 >> v1:172.21.15.50:6789/0 conn(0x7fccd40d16d0 legacy=0x7fccd40d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.487+0000 7fccd37fe640 1 -- 172.21.15.50:0/2073669298 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd40d43b0 con 0x7fccd415e870 2024-09-11T22:14:03.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.487+0000 7fccd27fc640 1 -- 172.21.15.50:0/2073669298 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448965142 0 0) 0x7fccc8001110 con 0x7fccd40d16d0 2024-09-11T22:14:03.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.488+0000 7fccd37fe640 1 --2- 172.21.15.50:0/2073669298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd415e870 0x7fccd40d1190 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fccd4068490 tx=0x7fccc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9db83070d9d690 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.488+0000 7fccd27fc640 1 -- 172.21.15.50:0/2073669298 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4037070 con 0x7fccd415e870 2024-09-11T22:14:03.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.488+0000 7fccd27fc640 1 -- 172.21.15.50:0/2073669298 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc4032440 con 0x7fccd415e870 2024-09-11T22:14:03.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.488+0000 7fccd27fc640 1 -- 172.21.15.50:0/2073669298 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4032810 con 0x7fccd415e870 2024-09-11T22:14:03.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.488+0000 7fccd9eba640 1 -- 172.21.15.50:0/2073669298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd415e870 msgr2=0x7fccd40d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.488+0000 7fccd9eba640 1 --2- 172.21.15.50:0/2073669298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd415e870 0x7fccd40d1190 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fccd4068490 tx=0x7fccc402a270 comp rx=0 tx=0).stop 2024-09-11T22:14:03.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.488+0000 7fccd9eba640 1 -- 172.21.15.50:0/2073669298 shutdown_connections 2024-09-11T22:14:03.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.488+0000 7fccd9eba640 1 --2- 172.21.15.50:0/2073669298 >> v2:172.21.15.77:3300/0 conn(0x7fccd40d3c00 0x7fccd40b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.488+0000 7fccd9eba640 1 --2- 172.21.15.50:0/2073669298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd415e870 0x7fccd40d1190 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.488+0000 7fccd9eba640 1 -- 172.21.15.50:0/2073669298 >> 172.21.15.50:0/2073669298 conn(0x7fccd40727a0 msgr2=0x7fccd40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.488+0000 7fccd9eba640 1 -- 172.21.15.50:0/2073669298 shutdown_connections 2024-09-11T22:14:03.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.488+0000 7fccd9eba640 1 -- 172.21.15.50:0/2073669298 wait complete. 2024-09-11T22:14:03.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.489+0000 7fccd9eba640 1 Processor -- start 2024-09-11T22:14:03.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.490+0000 7fccd9eba640 1 -- start start 2024-09-11T22:14:03.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.490+0000 7fccd9eba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccd40d16d0 0x7fccd40cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.490+0000 7fccd9eba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd40d3c00 0x7fccd40c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.490+0000 7fccd9eba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccd415e870 0x7fccd40cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.490+0000 7fccd9eba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fccd415ec50 con 0x7fccd40d3c00 2024-09-11T22:14:03.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.490+0000 7fccd9eba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fccd40b7ee0 con 0x7fccd415e870 2024-09-11T22:14:03.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.490+0000 7fccd9eba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fccd40b78b0 con 0x7fccd40d16d0 2024-09-11T22:14:03.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.490+0000 7fccd2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd40d3c00 0x7fccd40c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.490+0000 7fccd2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd40d3c00 0x7fccd40c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36834/0 (socket says 172.21.15.50:36834) 2024-09-11T22:14:03.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.490+0000 7fccd2ffd640 1 -- 172.21.15.50:0/1296200893 learned_addr learned my addr 172.21.15.50:0/1296200893 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccd3fff640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccd415e870 0x7fccd40cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccd37fe640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccd40d16d0 0x7fccd40cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccd2ffd640 1 -- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccd40d16d0 msgr2=0x7fccd40cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccd2ffd640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccd40d16d0 0x7fccd40cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccd2ffd640 1 -- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccd415e870 msgr2=0x7fccd40cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccd2ffd640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccd415e870 0x7fccd40cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccd2ffd640 1 -- 172.21.15.50:0/1296200893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd40cc7b0 con 0x7fccd40d3c00 2024-09-11T22:14:03.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccd3fff640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccd415e870 0x7fccd40cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:03.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccd2ffd640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd40d3c00 0x7fccd40c8f40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fccc800c430 tx=0x7fccc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccbbfff640 1 -- 172.21.15.50:0/1296200893 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc80074e0 con 0x7fccd40d3c00 2024-09-11T22:14:03.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccbbfff640 1 -- 172.21.15.50:0/1296200893 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc80047e0 con 0x7fccd40d3c00 2024-09-11T22:14:03.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccd9eba640 1 -- 172.21.15.50:0/1296200893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd415b390 con 0x7fccd40d3c00 2024-09-11T22:14:03.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccbbfff640 1 -- 172.21.15.50:0/1296200893 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8004bd0 con 0x7fccd40d3c00 2024-09-11T22:14:03.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.491+0000 7fccd9eba640 1 -- 172.21.15.50:0/1296200893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd415b950 con 0x7fccd40d3c00 2024-09-11T22:14:03.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.493+0000 7fccbbfff640 1 -- 172.21.15.50:0/1296200893 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fccc8011070 con 0x7fccd40d3c00 2024-09-11T22:14:03.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.493+0000 7fccbbfff640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fccc006be30 0x7fccc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.493+0000 7fccbbfff640 1 -- 172.21.15.50:0/1296200893 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fccc808ab30 con 0x7fccd40d3c00 2024-09-11T22:14:03.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.494+0000 7fccd37fe640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fccc006be30 0x7fccc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.494+0000 7fccd37fe640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fccc006be30 0x7fccc006e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fccc4034000 tx=0x7fccc402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.494+0000 7fccdcc5a740 1 Processor -- start 2024-09-11T22:14:03.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.494+0000 7fccdcc5a740 1 -- start start 2024-09-11T22:14:03.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccdcc5a740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f01450 0x55dfd6f46bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccdcc5a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6efec10 0x55dfd6f01830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccdcc5a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f02be0 0x55dfd6efba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccdcc5a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dfd6e63610 con 0x55dfd6f02be0 2024-09-11T22:14:03.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccdcc5a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dfd6e0b2e0 con 0x55dfd6efec10 2024-09-11T22:14:03.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccdcc5a740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dfd6e5f5d0 con 0x55dfd6f01450 2024-09-11T22:14:03.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccd3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f02be0 0x55dfd6efba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccd3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f02be0 0x55dfd6efba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36838/0 (socket says 172.21.15.50:36838) 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccd3fff640 1 -- 172.21.15.50:0/3875799139 learned_addr learned my addr 172.21.15.50:0/3875799139 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccd2ffd640 1 --2- 172.21.15.50:0/3875799139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6efec10 0x55dfd6f01830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccd37fe640 1 --2- 172.21.15.50:0/3875799139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f01450 0x55dfd6f46bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccd3fff640 1 -- 172.21.15.50:0/3875799139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f01450 msgr2=0x55dfd6f46bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccd3fff640 1 --2- 172.21.15.50:0/3875799139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f01450 0x55dfd6f46bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccd3fff640 1 -- 172.21.15.50:0/3875799139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6efec10 msgr2=0x55dfd6f01830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccd3fff640 1 --2- 172.21.15.50:0/3875799139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6efec10 0x55dfd6f01830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.495+0000 7fccd3fff640 1 -- 172.21.15.50:0/3875799139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd6e261f0 con 0x55dfd6f02be0 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.496+0000 7fccd3fff640 1 --2- 172.21.15.50:0/3875799139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f02be0 0x55dfd6efba40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcccc007410 tx=0x7fcccc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e689e02c31950f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.496+0000 7fccb97fa640 1 -- 172.21.15.50:0/3875799139 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc01a070 con 0x55dfd6f02be0 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.496+0000 7fccb97fa640 1 -- 172.21.15.50:0/3875799139 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc003da0 con 0x55dfd6f02be0 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.496+0000 7fccb97fa640 1 -- 172.21.15.50:0/3875799139 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc004230 con 0x55dfd6f02be0 2024-09-11T22:14:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.497+0000 7fccdcc5a740 1 -- 172.21.15.50:0/3875799139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f02be0 msgr2=0x55dfd6efba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.497+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/3875799139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f02be0 0x55dfd6efba40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcccc007410 tx=0x7fcccc009f90 comp rx=0 tx=0).stop 2024-09-11T22:14:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.497+0000 7fccdcc5a740 1 -- 172.21.15.50:0/3875799139 shutdown_connections 2024-09-11T22:14:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.497+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/3875799139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f02be0 0x55dfd6efba40 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.497+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/3875799139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6efec10 0x55dfd6f01830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.497+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/3875799139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f01450 0x55dfd6f46bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.497+0000 7fccdcc5a740 1 -- 172.21.15.50:0/3875799139 >> 172.21.15.50:0/3875799139 conn(0x55dfd6efdc10 msgr2=0x55dfd6f460c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.497+0000 7fccdcc5a740 1 -- 172.21.15.50:0/3875799139 shutdown_connections 2024-09-11T22:14:03.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.497+0000 7fccdcc5a740 1 -- 172.21.15.50:0/3875799139 wait complete. 2024-09-11T22:14:03.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.497+0000 7fccdcc5a740 1 -- start start 2024-09-11T22:14:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.497+0000 7fccdcc5a740 1 Processor -- start 2024-09-11T22:14:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.498+0000 7fccdcc5a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 0x55dfd6f45010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.498+0000 7fccdcc5a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f02be0 0x55dfd6f28e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.498+0000 7fccdcc5a740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f43a00 0x55dfd6f29370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.498+0000 7fccdcc5a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dfd6efd0b0 con 0x55dfd6f01450 2024-09-11T22:14:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.498+0000 7fccdcc5a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dfd6dec350 con 0x55dfd6f02be0 2024-09-11T22:14:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.498+0000 7fccdcc5a740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dfd6f47420 con 0x55dfd6f43a00 2024-09-11T22:14:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.498+0000 7fccdcc5a740 10 client.0 _ll_register_callbacks cb 0x55dfd6b75a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.498+0000 7fccd37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 0x55dfd6f45010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.498+0000 7fccd37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 0x55dfd6f45010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36842/0 (socket says 172.21.15.50:36842) 2024-09-11T22:14:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.498+0000 7fccd37fe640 1 -- 172.21.15.50:0/209685075 learned_addr learned my addr 172.21.15.50:0/209685075 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.498+0000 7fccd2ffd640 1 --2- 172.21.15.50:0/209685075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f02be0 0x55dfd6f28e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccd3fff640 1 --2- 172.21.15.50:0/209685075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f43a00 0x55dfd6f29370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccd37fe640 1 -- 172.21.15.50:0/209685075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f43a00 msgr2=0x55dfd6f29370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccd37fe640 1 --2- 172.21.15.50:0/209685075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f43a00 0x55dfd6f29370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccd37fe640 1 -- 172.21.15.50:0/209685075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f02be0 msgr2=0x55dfd6f28e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccd37fe640 1 --2- 172.21.15.50:0/209685075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f02be0 0x55dfd6f28e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccd37fe640 1 -- 172.21.15.50:0/209685075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd6b76240 con 0x55dfd6f01450 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccd37fe640 1 --2- 172.21.15.50:0/209685075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 0x55dfd6f45010 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009930 tx=0x7fccc402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7a65252726e103 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccb27fc640 1 -- 172.21.15.50:0/209685075 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4037040 con 0x55dfd6f01450 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccb27fc640 1 -- 172.21.15.50:0/209685075 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fccc403cb20 con 0x55dfd6f01450 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccdcc5a740 1 -- 172.21.15.50:0/209685075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcccc003da0 con 0x55dfd6f01450 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccb27fc640 1 -- 172.21.15.50:0/209685075 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fccc4056050 con 0x55dfd6f01450 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccdcc5a740 10 client.5739 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:03.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccdcc5a740 1 -- 172.21.15.50:0/209685075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x55dfd6c40620 con 0x55dfd6f01450 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.499+0000 7fccb27fc640 1 -- 172.21.15.50:0/209685075 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc003da0 con 0x55dfd6f01450 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.500+0000 7fccb27fc640 1 -- 172.21.15.50:0/209685075 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fccc4059020 con 0x55dfd6f01450 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.500+0000 7fccdcc5a740 10 client.5739 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.500+0000 7fccdcc5a740 10 client.5739 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.500+0000 7fccdcc5a740 20 client.5739 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.500+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/209685075 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55dfd6f20ec0 0x55dfd6f21300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.500+0000 7fccdcc5a740 4 client.5739 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.500+0000 7fccdcc5a740 1 -- 172.21.15.50:0/209685075 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfd6e70d40 con 0x55dfd6f20ec0 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.500+0000 7fccd2ffd640 1 --2- 172.21.15.50:0/209685075 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55dfd6f20ec0 0x55dfd6f21300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.500+0000 7fccd2ffd640 1 --2- 172.21.15.50:0/209685075 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55dfd6f20ec0 0x55dfd6f21300 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3af6b32548fd7e2 server_cookie=75282bd4ec0c6afd in_seq=0 out_seq=0 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.500+0000 7fccb27fc640 10 client.5739 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccb27fc640 1 -- 172.21.15.50:0/209685075 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfd6e70d40 con 0x55dfd6f20ec0 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccb27fc640 10 client.5739 handle_command_reply: tid=0 2024-09-11T22:14:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccdcc5a740 1 client.5739 shutdown 2024-09-11T22:14:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccdcc5a740 1 -- 172.21.15.50:0/209685075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 msgr2=0x55dfd6f45010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/209685075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 0x55dfd6f45010 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009930 tx=0x7fccc402c070 comp rx=0 tx=0).stop 2024-09-11T22:14:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccdcc5a740 1 -- 172.21.15.50:0/209685075 shutdown_connections 2024-09-11T22:14:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/209685075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f43a00 0x55dfd6f29370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/209685075 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55dfd6f20ec0 0x55dfd6f21300 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/209685075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f02be0 0x55dfd6f28e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/209685075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 0x55dfd6f45010 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccb27fc640 0 client.5739 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccdcc5a740 1 -- 172.21.15.50:0/209685075 >> 172.21.15.50:0/209685075 conn(0x55dfd6efec10 msgr2=0x55dfd6f495d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccdcc5a740 1 -- 172.21.15.50:0/209685075 shutdown_connections 2024-09-11T22:14:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccdcc5a740 1 -- 172.21.15.50:0/209685075 wait complete. 2024-09-11T22:14:03.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.501+0000 7fccdcc5a740 20 client.5739 trim_cache size 0 max 16384 2024-09-11T22:14:03.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.516+0000 7fccdcc5a740 1 Processor -- start 2024-09-11T22:14:03.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.516+0000 7fccdcc5a740 1 -- start start 2024-09-11T22:14:03.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.517+0000 7fccdcc5a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 0x55dfd6ef7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.517+0000 7fccdcc5a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f02be0 0x55dfd6f29020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.517+0000 7fccdcc5a740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f43a00 0x55dfd6f274f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.517+0000 7fccdcc5a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dfd6f01f80 con 0x55dfd6f01450 2024-09-11T22:14:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.517+0000 7fccdcc5a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fccd4200e80 con 0x55dfd6f02be0 2024-09-11T22:14:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.517+0000 7fccdcc5a740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fccd41fff20 con 0x55dfd6f43a00 2024-09-11T22:14:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.517+0000 7fccd37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 0x55dfd6ef7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.517+0000 7fccd37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 0x55dfd6ef7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36858/0 (socket says 172.21.15.50:36858) 2024-09-11T22:14:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.517+0000 7fccd37fe640 1 -- 172.21.15.50:0/737029629 learned_addr learned my addr 172.21.15.50:0/737029629 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.517+0000 7fccd37fe640 1 -- 172.21.15.50:0/737029629 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f43a00 msgr2=0x55dfd6f274f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.517+0000 7fccd37fe640 1 --2- 172.21.15.50:0/737029629 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f43a00 0x55dfd6f274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.518+0000 7fccd37fe640 1 -- 172.21.15.50:0/737029629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f02be0 msgr2=0x55dfd6f29020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.518+0000 7fccd2ffd640 1 --2- 172.21.15.50:0/737029629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f02be0 0x55dfd6f29020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.518+0000 7fccd37fe640 1 --2- 172.21.15.50:0/737029629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f02be0 0x55dfd6f29020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.518+0000 7fccd37fe640 1 -- 172.21.15.50:0/737029629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd6efd9b0 con 0x55dfd6f01450 2024-09-11T22:14:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.518+0000 7fccd37fe640 1 --2- 172.21.15.50:0/737029629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 0x55dfd6ef7190 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fccc4035040 tx=0x7fccc403a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7742dc9d303a209b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.518+0000 7fccb8ff9640 1 -- 172.21.15.50:0/737029629 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4037070 con 0x55dfd6f01450 2024-09-11T22:14:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.518+0000 7fccb8ff9640 1 -- 172.21.15.50:0/737029629 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc404e070 con 0x55dfd6f01450 2024-09-11T22:14:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.518+0000 7fccb8ff9640 1 -- 172.21.15.50:0/737029629 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4032940 con 0x55dfd6f01450 2024-09-11T22:14:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.519+0000 7fccdcc5a740 1 -- 172.21.15.50:0/737029629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 msgr2=0x55dfd6ef7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.519+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/737029629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 0x55dfd6ef7190 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fccc4035040 tx=0x7fccc403a000 comp rx=0 tx=0).stop 2024-09-11T22:14:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.519+0000 7fccdcc5a740 1 -- 172.21.15.50:0/737029629 shutdown_connections 2024-09-11T22:14:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.519+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/737029629 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f43a00 0x55dfd6f274f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.519+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/737029629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f02be0 0x55dfd6f29020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.519+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/737029629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f01450 0x55dfd6ef7190 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.519+0000 7fccdcc5a740 1 -- 172.21.15.50:0/737029629 >> 172.21.15.50:0/737029629 conn(0x55dfd6efec10 msgr2=0x55dfd6f26990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.519+0000 7fccdcc5a740 1 -- 172.21.15.50:0/737029629 shutdown_connections 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.519+0000 7fccdcc5a740 1 -- 172.21.15.50:0/737029629 wait complete. 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.519+0000 7fccdcc5a740 1 -- start start 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.519+0000 7fccdcc5a740 1 Processor -- start 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccdcc5a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f01450 0x55dfd6f1f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccdcc5a740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f02be0 0x55dfd6fc46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccdcc5a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f43a00 0x55dfd6fc8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccdcc5a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fccd41ff8d0 con 0x55dfd6f43a00 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccdcc5a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fccd41ff280 con 0x55dfd6f01450 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccdcc5a740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dfd6f45890 con 0x55dfd6f02be0 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccdcc5a740 10 client.0 _ll_register_callbacks cb 0x7fccc40096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccd3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f43a00 0x55dfd6fc8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccd3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f43a00 0x55dfd6fc8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36872/0 (socket says 172.21.15.50:36872) 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccd3fff640 1 -- 172.21.15.50:0/3444296068 learned_addr learned my addr 172.21.15.50:0/3444296068 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccd37fe640 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f01450 0x55dfd6f1f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccd2ffd640 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f02be0 0x55dfd6fc46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccd3fff640 1 -- 172.21.15.50:0/3444296068 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f02be0 msgr2=0x55dfd6fc46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccd3fff640 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f02be0 0x55dfd6fc46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccd3fff640 1 -- 172.21.15.50:0/3444296068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f01450 msgr2=0x55dfd6f1f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccd3fff640 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f01450 0x55dfd6f1f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccd3fff640 1 -- 172.21.15.50:0/3444296068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd6f1f4d0 con 0x55dfd6f43a00 2024-09-11T22:14:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.520+0000 7fccd37fe640 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f01450 0x55dfd6f1f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccd3fff640 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f43a00 0x55dfd6fc8240 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0073e0 tx=0x7fcccc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d5e4f0a5fe03a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccb27fc640 1 -- 172.21.15.50:0/3444296068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc026070 con 0x55dfd6f43a00 2024-09-11T22:14:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccb27fc640 1 -- 172.21.15.50:0/3444296068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fcccc015cf0 con 0x55dfd6f43a00 2024-09-11T22:14:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccdcc5a740 1 -- 172.21.15.50:0/3444296068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccc404e070 con 0x55dfd6f43a00 2024-09-11T22:14:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccb27fc640 1 -- 172.21.15.50:0/3444296068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fcccc031050 con 0x55dfd6f43a00 2024-09-11T22:14:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccdcc5a740 10 client.5745 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccdcc5a740 1 -- 172.21.15.50:0/3444296068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x55dfd6fc8d10 con 0x55dfd6f43a00 2024-09-11T22:14:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccb27fc640 1 -- 172.21.15.50:0/3444296068 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc404e070 con 0x55dfd6f43a00 2024-09-11T22:14:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccb27fc640 1 -- 172.21.15.50:0/3444296068 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fcccc034020 con 0x55dfd6f43a00 2024-09-11T22:14:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccdcc5a740 10 client.5745 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccdcc5a740 10 client.5745 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccdcc5a740 20 client.5745 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55dfd6f49ce0 0x55dfd6fc8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccdcc5a740 4 client.5745 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-11T22:14:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccdcc5a740 1 -- 172.21.15.50:0/3444296068 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x55dfd6f2a8f0 con 0x55dfd6f49ce0 2024-09-11T22:14:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.521+0000 7fccd37fe640 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55dfd6f49ce0 0x55dfd6fc8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.522+0000 7fccb27fc640 10 client.5745 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.522+0000 7fccd37fe640 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55dfd6f49ce0 0x55dfd6fc8780 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d465cbb57cae2d52 server_cookie=4c14b22e952aa194 in_seq=0 out_seq=0 2024-09-11T22:14:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccb27fc640 1 -- 172.21.15.50:0/3444296068 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dfd6f2a8f0 con 0x55dfd6f49ce0 2024-09-11T22:14:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccb27fc640 10 client.5745 handle_command_reply: tid=0 2024-09-11T22:14:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccdcc5a740 1 client.5745 shutdown 2024-09-11T22:14:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccdcc5a740 1 -- 172.21.15.50:0/3444296068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f43a00 msgr2=0x55dfd6fc8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f43a00 0x55dfd6fc8240 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0073e0 tx=0x7fcccc004a40 comp rx=0 tx=0).stop 2024-09-11T22:14:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccdcc5a740 1 -- 172.21.15.50:0/3444296068 shutdown_connections 2024-09-11T22:14:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfd6f02be0 0x55dfd6fc46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55dfd6f49ce0 0x55dfd6fc8780 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dfd6f43a00 0x55dfd6fc8240 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccdcc5a740 1 --2- 172.21.15.50:0/3444296068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfd6f01450 0x55dfd6f1f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccb27fc640 0 client.5745 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccdcc5a740 1 -- 172.21.15.50:0/3444296068 >> 172.21.15.50:0/3444296068 conn(0x55dfd6efec10 msgr2=0x55dfd6f495d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccdcc5a740 1 -- 172.21.15.50:0/3444296068 shutdown_connections 2024-09-11T22:14:03.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccdcc5a740 1 -- 172.21.15.50:0/3444296068 wait complete. 2024-09-11T22:14:03.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.524+0000 7fccdcc5a740 20 client.5745 trim_cache size 0 max 16384 2024-09-11T22:14:03.529 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:03.529 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:14:03.529 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:14:03.529 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:03.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.525+0000 7fccd9eba640 1 -- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fccc006be30 msgr2=0x7fccc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.525+0000 7fccd9eba640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fccc006be30 0x7fccc006e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fccc4034000 tx=0x7fccc402e000 comp rx=0 tx=0).stop 2024-09-11T22:14:03.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.525+0000 7fccd9eba640 1 -- 172.21.15.50:0/1296200893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd40d3c00 msgr2=0x7fccd40c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.525+0000 7fccd9eba640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd40d3c00 0x7fccd40c8f40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fccc800c430 tx=0x7fccc800c8f0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.525+0000 7fccd9eba640 1 -- 172.21.15.50:0/1296200893 shutdown_connections 2024-09-11T22:14:03.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.525+0000 7fccd9eba640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fccc006be30 0x7fccc006e2f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.525+0000 7fccd9eba640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccd415e870 0x7fccd40cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.525+0000 7fccd9eba640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd40d3c00 0x7fccd40c8f40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.525+0000 7fccd9eba640 1 --2- 172.21.15.50:0/1296200893 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccd40d16d0 0x7fccd40cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.525+0000 7fccd9eba640 1 -- 172.21.15.50:0/1296200893 >> 172.21.15.50:0/1296200893 conn(0x7fccd40727a0 msgr2=0x7fccd40b4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.525+0000 7fccd9eba640 1 -- 172.21.15.50:0/1296200893 shutdown_connections 2024-09-11T22:14:03.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.525+0000 7fccd9eba640 1 -- 172.21.15.50:0/1296200893 wait complete. 2024-09-11T22:14:03.536 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-11T22:14:03.536 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-11T22:14:03.536 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-11T22:14:03.537 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-11T22:14:03.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:03.537 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-11T22:14:03.553 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2024-09-11T22:14:03.553 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> import json 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> import sys 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> try: 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> except OSError as e: 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> sys.exit(e.errno) 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> print(json.dumps( 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> indent=2)) 2024-09-11T22:14:03.554 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-11T22:14:03.661 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:03.662 INFO:teuthology.orchestra.run.smithi050.stdout: "st_mode": 16877, 2024-09-11T22:14:03.662 INFO:teuthology.orchestra.run.smithi050.stdout: "st_ino": 1099511627777, 2024-09-11T22:14:03.662 INFO:teuthology.orchestra.run.smithi050.stdout: "st_dev": 42, 2024-09-11T22:14:03.662 INFO:teuthology.orchestra.run.smithi050.stdout: "st_nlink": 16, 2024-09-11T22:14:03.662 INFO:teuthology.orchestra.run.smithi050.stdout: "st_uid": 1000, 2024-09-11T22:14:03.662 INFO:teuthology.orchestra.run.smithi050.stdout: "st_gid": 1333, 2024-09-11T22:14:03.662 INFO:teuthology.orchestra.run.smithi050.stdout: "st_size": 18, 2024-09-11T22:14:03.662 INFO:teuthology.orchestra.run.smithi050.stdout: "st_atime": 1726092831.643716, 2024-09-11T22:14:03.662 INFO:teuthology.orchestra.run.smithi050.stdout: "st_mtime": 1726092836.7265851, 2024-09-11T22:14:03.662 INFO:teuthology.orchestra.run.smithi050.stdout: "st_ctime": 1726092836.7265851 2024-09-11T22:14:03.662 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:14:03.671 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-09-11T22:14:03.671 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-11T22:14:03.671 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-11T22:14:03.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.815+0000 7f0d40a77640 1 Processor -- start 2024-09-11T22:14:03.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.815+0000 7f0d40a77640 1 -- start start 2024-09-11T22:14:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.816+0000 7f0d40a77640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d3c0d18a0 0x7f0d3c0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.816+0000 7f0d40a77640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d3c0d3a30 0x7f0d3c0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.816+0000 7f0d40a77640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3c0cfa80 con 0x7f0d3c15e870 2024-09-11T22:14:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.816+0000 7f0d40a77640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0d3c0d3ea0 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.816+0000 7f0d40a77640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c0d40d0 con 0x7f0d3c0d18a0 2024-09-11T22:14:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.816+0000 7f0d3ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d3c0d3a30 0x7f0d3c0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.817+0000 7f0d3ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d3c0d3a30 0x7f0d3c0b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36876/0 (socket says 172.21.15.50:36876) 2024-09-11T22:14:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.817+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/1536550463 learned_addr learned my addr 172.21.15.50:0/1536550463 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.817+0000 7f0d39d9b640 1 --2- 172.21.15.50:0/1536550463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d3c0d18a0 0x7f0d3c0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.817+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/1536550463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d3c0d18a0 msgr2=0x7f0d3c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.817+0000 7f0d3ad9d640 1 --2- 172.21.15.50:0/1536550463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d3c0d18a0 0x7f0d3c0d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.817+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/1536550463 >> v1:172.21.15.77:6789/0 conn(0x7f0d3c15e870 legacy=0x7f0d3c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.817+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/1536550463 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c0d43b0 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.817+0000 7f0d39d9b640 1 --2- 172.21.15.50:0/1536550463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d3c0d18a0 0x7f0d3c0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.818+0000 7f0d3ad9d640 1 --2- 172.21.15.50:0/1536550463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d3c0d3a30 0x7f0d3c0b8400 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009870 tx=0x7f0d2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f198bd5b05398 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.818+0000 7f0d3959a640 1 -- 172.21.15.50:0/1536550463 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c037070 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.818+0000 7f0d3959a640 1 -- 172.21.15.50:0/1536550463 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c032440 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.818+0000 7f0d3959a640 1 -- 172.21.15.50:0/1536550463 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c032810 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.818+0000 7f0d40a77640 1 -- 172.21.15.50:0/1536550463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d3c0d3a30 msgr2=0x7f0d3c0b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.818+0000 7f0d40a77640 1 --2- 172.21.15.50:0/1536550463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d3c0d3a30 0x7f0d3c0b8400 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009870 tx=0x7f0d2c02a270 comp rx=0 tx=0).stop 2024-09-11T22:14:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.818+0000 7f0d40a77640 1 -- 172.21.15.50:0/1536550463 shutdown_connections 2024-09-11T22:14:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.818+0000 7f0d40a77640 1 --2- 172.21.15.50:0/1536550463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d3c0d3a30 0x7f0d3c0b8400 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.818+0000 7f0d40a77640 1 --2- 172.21.15.50:0/1536550463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d3c0d18a0 0x7f0d3c0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.818+0000 7f0d40a77640 1 -- 172.21.15.50:0/1536550463 >> 172.21.15.50:0/1536550463 conn(0x7f0d3c0727a0 msgr2=0x7f0d3c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.818+0000 7f0d40a77640 1 -- 172.21.15.50:0/1536550463 shutdown_connections 2024-09-11T22:14:03.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.818+0000 7f0d40a77640 1 -- 172.21.15.50:0/1536550463 wait complete. 2024-09-11T22:14:03.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.820+0000 7f0d40a77640 1 Processor -- start 2024-09-11T22:14:03.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.820+0000 7f0d40a77640 1 -- start start 2024-09-11T22:14:03.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.820+0000 7f0d40a77640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d3c0d18a0 0x7f0d3c0ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d40a77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d3c0d3a30 0x7f0d3c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d40a77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d3c15e870 0x7f0d3c1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d40a77640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c15ec50 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d40a77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c0b7ee0 con 0x7f0d3c15e870 2024-09-11T22:14:03.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d40a77640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c0b78b0 con 0x7f0d3c0d18a0 2024-09-11T22:14:03.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d39d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d3c0d3a30 0x7f0d3c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d39d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d3c0d3a30 0x7f0d3c0ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36884/0 (socket says 172.21.15.50:36884) 2024-09-11T22:14:03.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d39d9b640 1 -- 172.21.15.50:0/183755820 learned_addr learned my addr 172.21.15.50:0/183755820 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d3ad9d640 1 --2- 172.21.15.50:0/183755820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d3c15e870 0x7f0d3c1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d3a59c640 1 --2- 172.21.15.50:0/183755820 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d3c0d18a0 0x7f0d3c0ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d39d9b640 1 -- 172.21.15.50:0/183755820 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d3c0d18a0 msgr2=0x7f0d3c0ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d39d9b640 1 --2- 172.21.15.50:0/183755820 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d3c0d18a0 0x7f0d3c0ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d39d9b640 1 -- 172.21.15.50:0/183755820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d3c15e870 msgr2=0x7f0d3c1507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d39d9b640 1 --2- 172.21.15.50:0/183755820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d3c15e870 0x7f0d3c1507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d39d9b640 1 -- 172.21.15.50:0/183755820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c1f7dc0 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d39d9b640 1 --2- 172.21.15.50:0/183755820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d3c0d3a30 0x7f0d3c0ca0d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400d7d0 tx=0x7f0d2400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d32ffd640 1 -- 172.21.15.50:0/183755820 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24004030 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d32ffd640 1 -- 172.21.15.50:0/183755820 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d240041d0 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d32ffd640 1 -- 172.21.15.50:0/183755820 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d240096a0 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d40a77640 1 -- 172.21.15.50:0/183755820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3c1f80a0 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.821+0000 7f0d40a77640 1 -- 172.21.15.50:0/183755820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d3c1f8660 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.823+0000 7f0d32ffd640 1 -- 172.21.15.50:0/183755820 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d24009840 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.824+0000 7f0d32ffd640 1 --2- 172.21.15.50:0/183755820 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0d1c06be30 0x7f0d1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.824+0000 7f0d32ffd640 1 -- 172.21.15.50:0/183755820 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f0d2408b0e0 con 0x7f0d3c0d3a30 2024-09-11T22:14:03.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.824+0000 7f0d3a59c640 1 --2- 172.21.15.50:0/183755820 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0d1c06be30 0x7f0d1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.824+0000 7f0d3a59c640 1 --2- 172.21.15.50:0/183755820 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0d1c06be30 0x7f0d1c06e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0d34001f10 tx=0x7f0d34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.824+0000 7f0d43812740 1 Processor -- start 2024-09-11T22:14:03.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.825+0000 7f0d43812740 1 -- start start 2024-09-11T22:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.825+0000 7f0d43812740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207d420 0x5627220c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.825+0000 7f0d43812740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207abe0 0x56272207d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.825+0000 7f0d43812740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207ebb0 0x562722077a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.825+0000 7f0d43812740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562721fe0890 con 0x56272207ebb0 2024-09-11T22:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.825+0000 7f0d43812740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562721f886a0 con 0x56272207d420 2024-09-11T22:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.825+0000 7f0d43812740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562721fdc850 con 0x56272207abe0 2024-09-11T22:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.825+0000 7f0d3ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207ebb0 0x562722077a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.825+0000 7f0d3ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207ebb0 0x562722077a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36892/0 (socket says 172.21.15.50:36892) 2024-09-11T22:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.826+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/2892408620 learned_addr learned my addr 172.21.15.50:0/2892408620 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.826+0000 7f0d3a59c640 1 --2- 172.21.15.50:0/2892408620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207d420 0x5627220c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.826+0000 7f0d39d9b640 1 --2- 172.21.15.50:0/2892408620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207abe0 0x56272207d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.826+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/2892408620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207abe0 msgr2=0x56272207d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.826+0000 7f0d3ad9d640 1 --2- 172.21.15.50:0/2892408620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207abe0 0x56272207d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.826+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/2892408620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207d420 msgr2=0x5627220c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.826+0000 7f0d3ad9d640 1 --2- 172.21.15.50:0/2892408620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207d420 0x5627220c2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.826+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/2892408620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562721fae300 con 0x56272207ebb0 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.826+0000 7f0d3ad9d640 1 --2- 172.21.15.50:0/2892408620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207ebb0 0x562722077a10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009990 tx=0x7f0d2c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfadff8eb227f90 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.826+0000 7f0d1bfff640 1 -- 172.21.15.50:0/2892408620 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c037040 con 0x56272207ebb0 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.826+0000 7f0d1bfff640 1 -- 172.21.15.50:0/2892408620 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c032780 con 0x56272207ebb0 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.826+0000 7f0d1bfff640 1 -- 172.21.15.50:0/2892408620 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c032b70 con 0x56272207ebb0 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.827+0000 7f0d43812740 1 -- 172.21.15.50:0/2892408620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207ebb0 msgr2=0x562722077a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.827+0000 7f0d43812740 1 --2- 172.21.15.50:0/2892408620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207ebb0 0x562722077a10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009990 tx=0x7f0d2c02c000 comp rx=0 tx=0).stop 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.827+0000 7f0d43812740 1 -- 172.21.15.50:0/2892408620 shutdown_connections 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.827+0000 7f0d43812740 1 --2- 172.21.15.50:0/2892408620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207abe0 0x56272207d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.827+0000 7f0d43812740 1 --2- 172.21.15.50:0/2892408620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207ebb0 0x562722077a10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.827+0000 7f0d43812740 1 --2- 172.21.15.50:0/2892408620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207d420 0x5627220c2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.827+0000 7f0d43812740 1 -- 172.21.15.50:0/2892408620 >> 172.21.15.50:0/2892408620 conn(0x562722079be0 msgr2=0x5627220c2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.827+0000 7f0d43812740 1 -- 172.21.15.50:0/2892408620 shutdown_connections 2024-09-11T22:14:03.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.827+0000 7f0d43812740 1 -- 172.21.15.50:0/2892408620 wait complete. 2024-09-11T22:14:03.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.828+0000 7f0d43812740 1 -- start start 2024-09-11T22:14:03.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.828+0000 7f0d43812740 1 Processor -- start 2024-09-11T22:14:03.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.828+0000 7f0d43812740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207d420 0x56272209d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.828+0000 7f0d43812740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207ebb0 0x56272209cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d43812740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272209e0f0 0x56272209e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d43812740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562722079080 con 0x56272207d420 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d43812740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562721f69520 con 0x56272209e0f0 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d43812740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5627220c33f0 con 0x56272207ebb0 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d43812740 10 client.0 _ll_register_callbacks cb 0x562721cf2d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d3a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207d420 0x56272209d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d3a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207d420 0x56272209d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36896/0 (socket says 172.21.15.50:36896) 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d3a59c640 1 -- 172.21.15.50:0/3753675416 learned_addr learned my addr 172.21.15.50:0/3753675416 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d39d9b640 1 --2- 172.21.15.50:0/3753675416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207ebb0 0x56272209cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d3ad9d640 1 --2- 172.21.15.50:0/3753675416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272209e0f0 0x56272209e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d3a59c640 1 -- 172.21.15.50:0/3753675416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207ebb0 msgr2=0x56272209cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d3a59c640 1 --2- 172.21.15.50:0/3753675416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207ebb0 0x56272209cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d3a59c640 1 -- 172.21.15.50:0/3753675416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272209e0f0 msgr2=0x56272209e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d3a59c640 1 --2- 172.21.15.50:0/3753675416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272209e0f0 0x56272209e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d3a59c640 1 -- 172.21.15.50:0/3753675416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562721cd7590 con 0x56272207d420 2024-09-11T22:14:03.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d3a59c640 1 --2- 172.21.15.50:0/3753675416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207d420 0x56272209d850 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0d340072c0 tx=0x7f0d34001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d70dde4c42cb30c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d197fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:03.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d197fa640 1 -- 172.21.15.50:0/3753675416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d340136c0 con 0x56272207d420 2024-09-11T22:14:03.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d197fa640 1 -- 172.21.15.50:0/3753675416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f0d34013860 con 0x56272207d420 2024-09-11T22:14:03.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d43812740 1 -- 172.21.15.50:0/3753675416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d2c032780 con 0x56272207d420 2024-09-11T22:14:03.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d197fa640 1 -- 172.21.15.50:0/3753675416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0d3402e050 con 0x56272207d420 2024-09-11T22:14:03.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d43812740 10 client.5757 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:03.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.829+0000 7f0d43812740 1 -- 172.21.15.50:0/3753675416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x562721cf3590 con 0x56272207d420 2024-09-11T22:14:03.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.830+0000 7f0d197fa640 1 -- 172.21.15.50:0/3753675416 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c032780 con 0x56272207d420 2024-09-11T22:14:03.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.830+0000 7f0d197fa640 1 -- 172.21.15.50:0/3753675416 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f0d34031020 con 0x56272207d420 2024-09-11T22:14:03.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.830+0000 7f0d43812740 10 client.5757 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:03.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.830+0000 7f0d43812740 10 client.5757 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:03.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.830+0000 7f0d43812740 20 client.5757 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.830+0000 7f0d43812740 1 --2- 172.21.15.50:0/3753675416 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5627220a6ba0 0x5627220a6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.830+0000 7f0d43812740 4 client.5757 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.830+0000 7f0d43812740 1 -- 172.21.15.50:0/3753675416 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562721fedfc0 con 0x5627220a6ba0 2024-09-11T22:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.830+0000 7f0d39d9b640 1 --2- 172.21.15.50:0/3753675416 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5627220a6ba0 0x5627220a6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.830+0000 7f0d39d9b640 1 --2- 172.21.15.50:0/3753675416 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5627220a6ba0 0x5627220a6fa0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e035fe6c70e02bf server_cookie=6f6bd311622eb218 in_seq=0 out_seq=0 2024-09-11T22:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.830+0000 7f0d197fa640 10 client.5757 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d197fa640 1 -- 172.21.15.50:0/3753675416 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562721fedfc0 con 0x5627220a6ba0 2024-09-11T22:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d197fa640 10 client.5757 handle_command_reply: tid=0 2024-09-11T22:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d43812740 1 client.5757 shutdown 2024-09-11T22:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d43812740 1 -- 172.21.15.50:0/3753675416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207d420 msgr2=0x56272209d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d43812740 1 --2- 172.21.15.50:0/3753675416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207d420 0x56272209d850 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0d340072c0 tx=0x7f0d34001250 comp rx=0 tx=0).stop 2024-09-11T22:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d43812740 1 -- 172.21.15.50:0/3753675416 shutdown_connections 2024-09-11T22:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d43812740 1 --2- 172.21.15.50:0/3753675416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207ebb0 0x56272209cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d43812740 1 --2- 172.21.15.50:0/3753675416 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5627220a6ba0 0x5627220a6fa0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d43812740 1 --2- 172.21.15.50:0/3753675416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272209e0f0 0x56272209e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d43812740 1 --2- 172.21.15.50:0/3753675416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272207d420 0x56272209d850 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d197fa640 0 client.5757 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d43812740 1 -- 172.21.15.50:0/3753675416 >> 172.21.15.50:0/3753675416 conn(0x56272207abe0 msgr2=0x5627220c3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d43812740 1 -- 172.21.15.50:0/3753675416 shutdown_connections 2024-09-11T22:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d43812740 1 -- 172.21.15.50:0/3753675416 wait complete. 2024-09-11T22:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.831+0000 7f0d43812740 20 client.5757 trim_cache size 0 max 16384 2024-09-11T22:14:03.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.846+0000 7f0d43812740 1 Processor -- start 2024-09-11T22:14:03.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.846+0000 7f0d43812740 1 -- start start 2024-09-11T22:14:03.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d43812740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207d420 0x5627220c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d43812740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207ebb0 0x56272209d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d43812740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 0x5627220c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d43812740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c200d70 con 0x56272209e0f0 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d43812740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c1f6c20 con 0x56272207ebb0 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d43812740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c0cc530 con 0x56272207d420 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d3ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 0x5627220c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d3ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 0x5627220c0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36902/0 (socket says 172.21.15.50:36902) 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/3573102384 learned_addr learned my addr 172.21.15.50:0/3573102384 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/3573102384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207d420 msgr2=0x5627220c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d3a59c640 1 --2- 172.21.15.50:0/3573102384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207d420 0x5627220c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d39d9b640 1 --2- 172.21.15.50:0/3573102384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207ebb0 0x56272209d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d3ad9d640 1 --2- 172.21.15.50:0/3573102384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207d420 0x5627220c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/3573102384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207ebb0 msgr2=0x56272209d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d3ad9d640 1 --2- 172.21.15.50:0/3573102384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207ebb0 0x56272209d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/3573102384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56272209e8e0 con 0x56272209e0f0 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d3ad9d640 1 --2- 172.21.15.50:0/3573102384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 0x5627220c0f10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c02a860 tx=0x7f0d2c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ed9850eba0d927 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d1b7fe640 1 -- 172.21.15.50:0/3573102384 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c037040 con 0x56272209e0f0 2024-09-11T22:14:03.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d1b7fe640 1 -- 172.21.15.50:0/3573102384 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c004250 con 0x56272209e0f0 2024-09-11T22:14:03.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.847+0000 7f0d1b7fe640 1 -- 172.21.15.50:0/3573102384 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c005990 con 0x56272209e0f0 2024-09-11T22:14:03.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.848+0000 7f0d43812740 1 -- 172.21.15.50:0/3573102384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 msgr2=0x5627220c0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.848+0000 7f0d43812740 1 --2- 172.21.15.50:0/3573102384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 0x5627220c0f10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c02a860 tx=0x7f0d2c008030 comp rx=0 tx=0).stop 2024-09-11T22:14:03.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.848+0000 7f0d43812740 1 -- 172.21.15.50:0/3573102384 shutdown_connections 2024-09-11T22:14:03.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.848+0000 7f0d43812740 1 --2- 172.21.15.50:0/3573102384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 0x5627220c0f10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.848+0000 7f0d43812740 1 --2- 172.21.15.50:0/3573102384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207ebb0 0x56272209d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.848+0000 7f0d43812740 1 --2- 172.21.15.50:0/3573102384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207d420 0x5627220c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.848+0000 7f0d43812740 1 -- 172.21.15.50:0/3573102384 >> 172.21.15.50:0/3573102384 conn(0x56272207abe0 msgr2=0x562722072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.848+0000 7f0d43812740 1 -- 172.21.15.50:0/3573102384 shutdown_connections 2024-09-11T22:14:03.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.848+0000 7f0d43812740 1 -- 172.21.15.50:0/3573102384 wait complete. 2024-09-11T22:14:03.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.849+0000 7f0d43812740 1 -- start start 2024-09-11T22:14:03.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.849+0000 7f0d43812740 1 Processor -- start 2024-09-11T22:14:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d43812740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207d420 0x5627220dfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d43812740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207ebb0 0x562722126300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d43812740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 0x5627220e3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d43812740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5627220a2ea0 con 0x56272209e0f0 2024-09-11T22:14:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d43812740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c1f65d0 con 0x56272207ebb0 2024-09-11T22:14:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d43812740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5627220e0430 con 0x56272207d420 2024-09-11T22:14:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d43812740 10 client.0 _ll_register_callbacks cb 0x7f0d34002060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d3ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 0x5627220e3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d3ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 0x5627220e3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36906/0 (socket says 172.21.15.50:36906) 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/2213835474 learned_addr learned my addr 172.21.15.50:0/2213835474 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d3a59c640 1 --2- 172.21.15.50:0/2213835474 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207d420 0x5627220dfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d39d9b640 1 --2- 172.21.15.50:0/2213835474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207ebb0 0x562722126300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/2213835474 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207d420 msgr2=0x5627220dfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d3ad9d640 1 --2- 172.21.15.50:0/2213835474 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207d420 0x5627220dfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/2213835474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207ebb0 msgr2=0x562722126300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d3ad9d640 1 --2- 172.21.15.50:0/2213835474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207ebb0 0x562722126300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d3ad9d640 1 -- 172.21.15.50:0/2213835474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562722079980 con 0x56272209e0f0 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d3ad9d640 1 --2- 172.21.15.50:0/2213835474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 0x5627220e3c30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009990 tx=0x7f0d2c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1842273cdfd40a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d197fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d197fa640 1 -- 172.21.15.50:0/2213835474 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c037040 con 0x56272209e0f0 2024-09-11T22:14:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d197fa640 1 -- 172.21.15.50:0/2213835474 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f0d2c005b90 con 0x56272209e0f0 2024-09-11T22:14:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.850+0000 7f0d43812740 1 -- 172.21.15.50:0/2213835474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d2c004250 con 0x56272209e0f0 2024-09-11T22:14:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d197fa640 1 -- 172.21.15.50:0/2213835474 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0d2c054050 con 0x56272209e0f0 2024-09-11T22:14:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d43812740 10 client.5763 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d43812740 1 -- 172.21.15.50:0/2213835474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x562721dbd970 con 0x56272209e0f0 2024-09-11T22:14:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d197fa640 1 -- 172.21.15.50:0/2213835474 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c004250 con 0x56272209e0f0 2024-09-11T22:14:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d197fa640 1 -- 172.21.15.50:0/2213835474 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f0d2c057020 con 0x56272209e0f0 2024-09-11T22:14:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d43812740 10 client.5763 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d43812740 10 client.5763 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d43812740 20 client.5763 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d43812740 1 --2- 172.21.15.50:0/2213835474 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5627220e4170 0x5627220a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d43812740 4 client.5763 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-11T22:14:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d43812740 1 -- 172.21.15.50:0/2213835474 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x562721fe8310 con 0x5627220e4170 2024-09-11T22:14:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d3a59c640 1 --2- 172.21.15.50:0/2213835474 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5627220e4170 0x5627220a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d197fa640 10 client.5763 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.851+0000 7f0d3a59c640 1 --2- 172.21.15.50:0/2213835474 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5627220e4170 0x5627220a21f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0f60e6d9084f6dc server_cookie=5bb41cde2cd7987b in_seq=0 out_seq=0 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d197fa640 1 -- 172.21.15.50:0/2213835474 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x562721fe8310 con 0x5627220e4170 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d197fa640 10 client.5763 handle_command_reply: tid=0 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d43812740 1 client.5763 shutdown 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d43812740 1 -- 172.21.15.50:0/2213835474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 msgr2=0x5627220e3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d43812740 1 --2- 172.21.15.50:0/2213835474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 0x5627220e3c30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009990 tx=0x7f0d2c004730 comp rx=0 tx=0).stop 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d43812740 1 -- 172.21.15.50:0/2213835474 shutdown_connections 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d43812740 1 --2- 172.21.15.50:0/2213835474 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5627220e4170 0x5627220a21f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d43812740 1 --2- 172.21.15.50:0/2213835474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56272209e0f0 0x5627220e3c30 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d43812740 1 --2- 172.21.15.50:0/2213835474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56272207ebb0 0x562722126300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d43812740 1 --2- 172.21.15.50:0/2213835474 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56272207d420 0x5627220dfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d197fa640 0 client.5763 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d43812740 1 -- 172.21.15.50:0/2213835474 >> 172.21.15.50:0/2213835474 conn(0x56272207abe0 msgr2=0x56272209d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d43812740 1 -- 172.21.15.50:0/2213835474 shutdown_connections 2024-09-11T22:14:03.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d43812740 1 -- 172.21.15.50:0/2213835474 wait complete. 2024-09-11T22:14:03.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.852+0000 7f0d43812740 20 client.5763 trim_cache size 0 max 16384 2024-09-11T22:14:03.859 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:14:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": -2 2024-09-11T22:14:03.859 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:03.860 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T22:14:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENOENT: 2024-09-11T22:14:03.860 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-11T22:14:03.860 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-11T22:14:03.860 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-11T22:14:03.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.965+0000 7fdcc64f1640 1 Processor -- start 2024-09-11T22:14:03.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.965+0000 7fdcc64f1640 1 -- start start 2024-09-11T22:14:03.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.966+0000 7fdcc64f1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdcc0072e60 0x7fdcc006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.966+0000 7fdcc64f1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc015b7e0 con 0x7fdcc006e0f0 2024-09-11T22:14:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.966+0000 7fdcc64f1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc015f140 con 0x7fdcc015b400 2024-09-11T22:14:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.966+0000 7fdcc64f1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fdcc015f420 con 0x7fdcc0072e60 2024-09-11T22:14:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.966+0000 7fdcc4a8e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdcc0072e60 0x7fdcc006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.966+0000 7fdcb7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdcc006e0f0 0x7fdcc00711c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36332/0 (socket says 172.21.15.50:36332) 2024-09-11T22:14:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.966+0000 7fdcc4a8e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdcc0072e60 0x7fdcc006d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36916/0 (socket says 172.21.15.50:36916) 2024-09-11T22:14:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.966+0000 7fdcb7fff640 1 -- 172.21.15.50:0/881969105 learned_addr learned my addr 172.21.15.50:0/881969105 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.967+0000 7fdcc4a8e640 1 -- 172.21.15.50:0/881969105 >> v1:172.21.15.77:6789/0 conn(0x7fdcc015b400 legacy=0x7fdcc006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.967+0000 7fdcc4a8e640 1 -- 172.21.15.50:0/881969105 >> v1:172.21.15.50:6789/0 conn(0x7fdcc006e0f0 legacy=0x7fdcc00711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.967+0000 7fdcc4a8e640 1 -- 172.21.15.50:0/881969105 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc015f700 con 0x7fdcc0072e60 2024-09-11T22:14:03.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.967+0000 7fdcc4a8e640 1 --2- 172.21.15.50:0/881969105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcc0072e60 0x7fdcc006d070 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009d90 tx=0x7fdcb802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd87daa3ce35793 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.968+0000 7fdcbf7fe640 1 -- 172.21.15.50:0/881969105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8007740 con 0x7fdcc0072e60 2024-09-11T22:14:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.968+0000 7fdcbf7fe640 1 -- 172.21.15.50:0/881969105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb80078e0 con 0x7fdcc0072e60 2024-09-11T22:14:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.968+0000 7fdcbf7fe640 1 -- 172.21.15.50:0/881969105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8007cb0 con 0x7fdcc0072e60 2024-09-11T22:14:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.968+0000 7fdcc64f1640 1 -- 172.21.15.50:0/881969105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcc0072e60 msgr2=0x7fdcc006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.968+0000 7fdcc64f1640 1 --2- 172.21.15.50:0/881969105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcc0072e60 0x7fdcc006d070 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009d90 tx=0x7fdcb802a6a0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.968+0000 7fdcc64f1640 1 -- 172.21.15.50:0/881969105 shutdown_connections 2024-09-11T22:14:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.968+0000 7fdcc64f1640 1 --2- 172.21.15.50:0/881969105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcc0072e60 0x7fdcc006d070 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.968+0000 7fdcc64f1640 1 -- 172.21.15.50:0/881969105 >> 172.21.15.50:0/881969105 conn(0x7fdcc00679c0 msgr2=0x7fdcc0067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.968+0000 7fdcc64f1640 1 -- 172.21.15.50:0/881969105 shutdown_connections 2024-09-11T22:14:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.968+0000 7fdcc64f1640 1 -- 172.21.15.50:0/881969105 wait complete. 2024-09-11T22:14:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.969+0000 7fdcc64f1640 1 Processor -- start 2024-09-11T22:14:03.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.969+0000 7fdcc64f1640 1 -- start start 2024-09-11T22:14:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.970+0000 7fdcc64f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcc006e0f0 0x7fdcc0153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.970+0000 7fdcc64f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdcc0072e60 0x7fdcc00aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.970+0000 7fdcc64f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcc015b400 0x7fdcc015dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.970+0000 7fdcc64f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc00718d0 con 0x7fdcc015b400 2024-09-11T22:14:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.970+0000 7fdcc64f1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc00cfc50 con 0x7fdcc006e0f0 2024-09-11T22:14:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.970+0000 7fdcc64f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc0071a50 con 0x7fdcc0072e60 2024-09-11T22:14:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.970+0000 7fdcc4a8e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcc015b400 0x7fdcc015dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.970+0000 7fdcc4a8e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcc015b400 0x7fdcc015dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36926/0 (socket says 172.21.15.50:36926) 2024-09-11T22:14:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.970+0000 7fdcc4a8e640 1 -- 172.21.15.50:0/4233900336 learned_addr learned my addr 172.21.15.50:0/4233900336 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcbffff640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcc006e0f0 0x7fdcc0153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcb7fff640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdcc0072e60 0x7fdcc00aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcc4a8e640 1 -- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdcc0072e60 msgr2=0x7fdcc00aa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcc4a8e640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdcc0072e60 0x7fdcc00aa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcc4a8e640 1 -- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcc006e0f0 msgr2=0x7fdcc0153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcc4a8e640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcc006e0f0 0x7fdcc0153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcc4a8e640 1 -- 172.21.15.50:0/4233900336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc0154380 con 0x7fdcc015b400 2024-09-11T22:14:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcb7fff640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdcc0072e60 0x7fdcc00aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcbffff640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcc006e0f0 0x7fdcc0153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcc4a8e640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcc015b400 0x7fdcc015dcf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009eb0 tx=0x7fdcb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcbd7fa640 1 -- 172.21.15.50:0/4233900336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8040070 con 0x7fdcc015b400 2024-09-11T22:14:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcbd7fa640 1 -- 172.21.15.50:0/4233900336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb8031c40 con 0x7fdcc015b400 2024-09-11T22:14:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcbd7fa640 1 -- 172.21.15.50:0/4233900336 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb803c420 con 0x7fdcc015b400 2024-09-11T22:14:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcc64f1640 1 -- 172.21.15.50:0/4233900336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc00aaf40 con 0x7fdcc015b400 2024-09-11T22:14:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.971+0000 7fdcc64f1640 1 -- 172.21.15.50:0/4233900336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc00ab780 con 0x7fdcc015b400 2024-09-11T22:14:03.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.973+0000 7fdcbd7fa640 1 -- 172.21.15.50:0/4233900336 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdcb8039040 con 0x7fdcc015b400 2024-09-11T22:14:03.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.974+0000 7fdcbd7fa640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdca006be30 0x7fdca006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.974+0000 7fdcbd7fa640 1 -- 172.21.15.50:0/4233900336 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fdcb80ac200 con 0x7fdcc015b400 2024-09-11T22:14:03.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.974+0000 7fdcbffff640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdca006be30 0x7fdca006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.974+0000 7fdcc928f740 1 Processor -- start 2024-09-11T22:14:03.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.974+0000 7fdcc928f740 1 -- start start 2024-09-11T22:14:03.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.974+0000 7fdcbffff640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdca006be30 0x7fdca006e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000a830 tx=0x7fdcb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcc928f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bec60 0x5602220bf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcc928f740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bc420 0x5602220bdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcc928f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x56022209ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcc928f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560221fdbaa0 con 0x5602220bec60 2024-09-11T22:14:03.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcc928f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560221f838e0 con 0x5602220bc880 2024-09-11T22:14:03.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcc928f740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560221fd7a60 con 0x5602220bc420 2024-09-11T22:14:03.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcbffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bec60 0x5602220bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcbffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bec60 0x5602220bf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36934/0 (socket says 172.21.15.50:36934) 2024-09-11T22:14:03.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcbffff640 1 -- 172.21.15.50:0/2312710022 learned_addr learned my addr 172.21.15.50:0/2312710022 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcc4a8e640 1 --2- 172.21.15.50:0/2312710022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x56022209ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcb7fff640 1 --2- 172.21.15.50:0/2312710022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bc420 0x5602220bdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcbffff640 1 -- 172.21.15.50:0/2312710022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bc420 msgr2=0x5602220bdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcbffff640 1 --2- 172.21.15.50:0/2312710022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bc420 0x5602220bdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcbffff640 1 -- 172.21.15.50:0/2312710022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 msgr2=0x56022209ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcbffff640 1 --2- 172.21.15.50:0/2312710022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x56022209ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcbffff640 1 -- 172.21.15.50:0/2312710022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560221dba9f0 con 0x5602220bec60 2024-09-11T22:14:03.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcc4a8e640 1 --2- 172.21.15.50:0/2312710022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x56022209ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:03.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.975+0000 7fdcb7fff640 1 --2- 172.21.15.50:0/2312710022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bc420 0x5602220bdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:03.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.976+0000 7fdcbffff640 1 --2- 172.21.15.50:0/2312710022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bec60 0x5602220bf040 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000ca60 tx=0x7fdcb000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a642c60c3ac8ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.976+0000 7fdcb5ffb640 1 -- 172.21.15.50:0/2312710022 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb000ae60 con 0x5602220bec60 2024-09-11T22:14:03.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.976+0000 7fdcb5ffb640 1 -- 172.21.15.50:0/2312710022 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb0013dd0 con 0x5602220bec60 2024-09-11T22:14:03.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.976+0000 7fdcb5ffb640 1 -- 172.21.15.50:0/2312710022 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0004260 con 0x5602220bec60 2024-09-11T22:14:03.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.976+0000 7fdcc928f740 1 -- 172.21.15.50:0/2312710022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bec60 msgr2=0x5602220bf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.976+0000 7fdcc928f740 1 --2- 172.21.15.50:0/2312710022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bec60 0x5602220bf040 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000ca60 tx=0x7fdcb000f000 comp rx=0 tx=0).stop 2024-09-11T22:14:03.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.976+0000 7fdcc928f740 1 -- 172.21.15.50:0/2312710022 shutdown_connections 2024-09-11T22:14:03.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.976+0000 7fdcc928f740 1 --2- 172.21.15.50:0/2312710022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bc420 0x5602220bdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.976+0000 7fdcc928f740 1 --2- 172.21.15.50:0/2312710022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x56022209ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.976+0000 7fdcc928f740 1 --2- 172.21.15.50:0/2312710022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bec60 0x5602220bf040 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.976+0000 7fdcc928f740 1 -- 172.21.15.50:0/2312710022 >> 172.21.15.50:0/2312710022 conn(0x5602220748c0 msgr2=0x5602220bccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.976+0000 7fdcc928f740 1 -- 172.21.15.50:0/2312710022 shutdown_connections 2024-09-11T22:14:03.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.976+0000 7fdcc928f740 1 -- 172.21.15.50:0/2312710022 wait complete. 2024-09-11T22:14:03.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.977+0000 7fdcc928f740 1 -- start start 2024-09-11T22:14:03.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.977+0000 7fdcc928f740 1 Processor -- start 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc928f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x5602220b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc928f740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bec60 0x5602220cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc928f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 0x5602220a1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc928f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5602220bb380 con 0x5602220b6110 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc928f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560221f96ce0 con 0x5602220bc880 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc928f740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5602220bb660 con 0x5602220bec60 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc928f740 10 client.0 _ll_register_callbacks cb 0x560221ceddd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc4a8e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 0x5602220a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc4a8e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 0x5602220a1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36938/0 (socket says 172.21.15.50:36938) 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc4a8e640 1 -- 172.21.15.50:0/4258272290 learned_addr learned my addr 172.21.15.50:0/4258272290 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcbffff640 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x5602220b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcb7fff640 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bec60 0x5602220cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc4a8e640 1 -- 172.21.15.50:0/4258272290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bec60 msgr2=0x5602220cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc4a8e640 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bec60 0x5602220cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc4a8e640 1 -- 172.21.15.50:0/4258272290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 msgr2=0x5602220b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:03.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc4a8e640 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x5602220b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc4a8e640 1 -- 172.21.15.50:0/4258272290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560221cae2e0 con 0x5602220b6110 2024-09-11T22:14:03.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcbffff640 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x5602220b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:03.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcb7fff640 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bec60 0x5602220cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:03.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdcc4a8e640 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 0x5602220a1210 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80aa6f0 tx=0x7fdcb8007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be197411f9cac19 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:03.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.978+0000 7fdc9effd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:03.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdc9effd640 1 -- 172.21.15.50:0/4258272290 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8049040 con 0x5602220b6110 2024-09-11T22:14:03.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdc9effd640 1 -- 172.21.15.50:0/4258272290 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fdcb8082dc0 con 0x5602220b6110 2024-09-11T22:14:03.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdcc928f740 1 -- 172.21.15.50:0/4258272290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcb0013dd0 con 0x5602220b6110 2024-09-11T22:14:03.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdc9effd640 1 -- 172.21.15.50:0/4258272290 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fdcb8083050 con 0x5602220b6110 2024-09-11T22:14:03.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdcc928f740 10 client.5778 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:03.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdcc928f740 1 -- 172.21.15.50:0/4258272290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x560221e1b180 con 0x5602220b6110 2024-09-11T22:14:03.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdc9effd640 1 -- 172.21.15.50:0/4258272290 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb0013dd0 con 0x5602220b6110 2024-09-11T22:14:03.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdc9effd640 1 -- 172.21.15.50:0/4258272290 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fdcb804c020 con 0x5602220b6110 2024-09-11T22:14:03.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdcc928f740 10 client.5778 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:03.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdcc928f740 10 client.5778 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:03.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdcc928f740 20 client.5778 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:03.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdcc928f740 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5602220a1750 0x56022209fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:03.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdcc928f740 4 client.5778 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:03.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdcc928f740 1 -- 172.21.15.50:0/4258272290 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560221fe91d0 con 0x5602220a1750 2024-09-11T22:14:03.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.979+0000 7fdcbffff640 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5602220a1750 0x56022209fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:03.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdc9effd640 10 client.5778 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdcbffff640 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5602220a1750 0x56022209fcb0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0ca88225e381612 server_cookie=98d97d4779fc357f in_seq=0 out_seq=0 2024-09-11T22:14:03.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdc9effd640 1 -- 172.21.15.50:0/4258272290 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560221fe91d0 con 0x5602220a1750 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdc9effd640 10 client.5778 handle_command_reply: tid=0 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdcc928f740 1 client.5778 shutdown 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdcc928f740 1 -- 172.21.15.50:0/4258272290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 msgr2=0x5602220a1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdcc928f740 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 0x5602220a1210 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80aa6f0 tx=0x7fdcb8007900 comp rx=0 tx=0).stop 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdcc928f740 1 -- 172.21.15.50:0/4258272290 shutdown_connections 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdcc928f740 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bec60 0x5602220cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdcc928f740 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5602220a1750 0x56022209fcb0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdcc928f740 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 0x5602220a1210 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdcc928f740 1 --2- 172.21.15.50:0/4258272290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x5602220b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdc9effd640 0 client.5778 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdcc928f740 1 -- 172.21.15.50:0/4258272290 >> 172.21.15.50:0/4258272290 conn(0x5602220bc420 msgr2=0x5602220c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdcc928f740 1 -- 172.21.15.50:0/4258272290 shutdown_connections 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.980+0000 7fdcc928f740 1 -- 172.21.15.50:0/4258272290 wait complete. 2024-09-11T22:14:03.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.981+0000 7fdcc928f740 20 client.5778 trim_cache size 0 max 16384 2024-09-11T22:14:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.998+0000 7fdcc928f740 1 Processor -- start 2024-09-11T22:14:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.998+0000 7fdcc928f740 1 -- start start 2024-09-11T22:14:04.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.998+0000 7fdcc928f740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220b6110 0x5602220a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.998+0000 7fdcc928f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bc880 0x5602220bddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.998+0000 7fdcc928f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bec60 0x5602220be310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.998+0000 7fdcc928f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc01fed70 con 0x5602220bc880 2024-09-11T22:14:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.998+0000 7fdcc928f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc00af450 con 0x5602220bec60 2024-09-11T22:14:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.998+0000 7fdcc928f740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc01f3560 con 0x5602220b6110 2024-09-11T22:14:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcb7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bc880 0x5602220bddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcb7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bc880 0x5602220bddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36948/0 (socket says 172.21.15.50:36948) 2024-09-11T22:14:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcb7fff640 1 -- 172.21.15.50:0/2889551210 learned_addr learned my addr 172.21.15.50:0/2889551210 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcbffff640 1 --2- 172.21.15.50:0/2889551210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220b6110 0x5602220a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcc4a8e640 1 --2- 172.21.15.50:0/2889551210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bec60 0x5602220be310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcb7fff640 1 -- 172.21.15.50:0/2889551210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220b6110 msgr2=0x5602220a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcb7fff640 1 --2- 172.21.15.50:0/2889551210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220b6110 0x5602220a01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcb7fff640 1 -- 172.21.15.50:0/2889551210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bec60 msgr2=0x5602220be310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcb7fff640 1 --2- 172.21.15.50:0/2889551210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bec60 0x5602220be310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcb7fff640 1 -- 172.21.15.50:0/2889551210 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560221c873a0 con 0x5602220bc880 2024-09-11T22:14:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcb7fff640 1 --2- 172.21.15.50:0/2889551210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bc880 0x5602220bddd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdca8005df0 tx=0x7fdca8007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353377c7b72cb1af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcb57fa640 1 -- 172.21.15.50:0/2889551210 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8019020 con 0x5602220bc880 2024-09-11T22:14:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcb57fa640 1 -- 172.21.15.50:0/2889551210 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca8011830 con 0x5602220bc880 2024-09-11T22:14:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:03.999+0000 7fdcb57fa640 1 -- 172.21.15.50:0/2889551210 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8011c20 con 0x5602220bc880 2024-09-11T22:14:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.000+0000 7fdcc928f740 1 -- 172.21.15.50:0/2889551210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bc880 msgr2=0x5602220bddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.000+0000 7fdcc928f740 1 --2- 172.21.15.50:0/2889551210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bc880 0x5602220bddd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdca8005df0 tx=0x7fdca8007420 comp rx=0 tx=0).stop 2024-09-11T22:14:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.000+0000 7fdcc928f740 1 -- 172.21.15.50:0/2889551210 shutdown_connections 2024-09-11T22:14:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.000+0000 7fdcc928f740 1 --2- 172.21.15.50:0/2889551210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bec60 0x5602220be310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.000+0000 7fdcc928f740 1 --2- 172.21.15.50:0/2889551210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220bc880 0x5602220bddd0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.000+0000 7fdcc928f740 1 --2- 172.21.15.50:0/2889551210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220b6110 0x5602220a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.000+0000 7fdcc928f740 1 -- 172.21.15.50:0/2889551210 >> 172.21.15.50:0/2889551210 conn(0x5602220bc420 msgr2=0x5602220b9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.000+0000 7fdcc928f740 1 -- 172.21.15.50:0/2889551210 shutdown_connections 2024-09-11T22:14:04.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.000+0000 7fdcc928f740 1 -- 172.21.15.50:0/2889551210 wait complete. 2024-09-11T22:14:04.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.000+0000 7fdcc928f740 1 -- start start 2024-09-11T22:14:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.001+0000 7fdcc928f740 1 Processor -- start 2024-09-11T22:14:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.001+0000 7fdcc928f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 0x56022213fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.001+0000 7fdcc928f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x5602221323e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.001+0000 7fdcc928f740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bec60 0x56022209ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.001+0000 7fdcc928f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560222073720 con 0x5602220b6110 2024-09-11T22:14:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.001+0000 7fdcc928f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc00aee00 con 0x5602220bc880 2024-09-11T22:14:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.001+0000 7fdcc928f740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560221fe91d0 con 0x5602220bec60 2024-09-11T22:14:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.001+0000 7fdcc928f740 10 client.0 _ll_register_callbacks cb 0x7fdcb803cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.001+0000 7fdcbffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 0x56022213fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcbffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 0x56022213fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36952/0 (socket says 172.21.15.50:36952) 2024-09-11T22:14:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcbffff640 1 -- 172.21.15.50:0/3215784145 learned_addr learned my addr 172.21.15.50:0/3215784145 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcb7fff640 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x5602221323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcc4a8e640 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bec60 0x56022209ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcbffff640 1 -- 172.21.15.50:0/3215784145 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bec60 msgr2=0x56022209ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcbffff640 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bec60 0x56022209ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcbffff640 1 -- 172.21.15.50:0/3215784145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 msgr2=0x5602221323e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcbffff640 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x5602221323e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcbffff640 1 -- 172.21.15.50:0/3215784145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602221400f0 con 0x5602220b6110 2024-09-11T22:14:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcb7fff640 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x5602221323e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcc4a8e640 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bec60 0x56022209ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcbffff640 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 0x56022213fbb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0008010 tx=0x7fdcb0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f80828d3df6427f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdc9effd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdc9effd640 1 -- 172.21.15.50:0/3215784145 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0035060 con 0x5602220b6110 2024-09-11T22:14:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdc9effd640 1 -- 172.21.15.50:0/3215784145 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fdcb0004240 con 0x5602220b6110 2024-09-11T22:14:04.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcc928f740 1 -- 172.21.15.50:0/3215784145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdca8011830 con 0x5602220b6110 2024-09-11T22:14:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdc9effd640 1 -- 172.21.15.50:0/3215784145 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fdcb003b050 con 0x5602220b6110 2024-09-11T22:14:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcc928f740 10 client.5784 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdcc928f740 1 -- 172.21.15.50:0/3215784145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5602220be400 con 0x5602220b6110 2024-09-11T22:14:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.002+0000 7fdc9effd640 1 -- 172.21.15.50:0/3215784145 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca8011830 con 0x5602220b6110 2024-09-11T22:14:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.003+0000 7fdc9effd640 1 -- 172.21.15.50:0/3215784145 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fdcb003e020 con 0x5602220b6110 2024-09-11T22:14:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.003+0000 7fdcc928f740 10 client.5784 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.003+0000 7fdcc928f740 10 client.5784 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.003+0000 7fdcc928f740 20 client.5784 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.003+0000 7fdcc928f740 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5602220a0520 0x56022213bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.003+0000 7fdcc928f740 4 client.5784 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-11T22:14:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.003+0000 7fdcc928f740 1 -- 172.21.15.50:0/3215784145 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x560221fe3520 con 0x5602220a0520 2024-09-11T22:14:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.003+0000 7fdcb7fff640 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5602220a0520 0x56022213bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.003+0000 7fdc9effd640 10 client.5784 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.003+0000 7fdcb7fff640 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5602220a0520 0x56022213bd90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd64e868e21cbf68 server_cookie=d4a50bddeccb72c8 in_seq=0 out_seq=0 2024-09-11T22:14:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.003+0000 7fdc9effd640 1 -- 172.21.15.50:0/3215784145 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x560221fe3520 con 0x5602220a0520 2024-09-11T22:14:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.003+0000 7fdc9effd640 10 client.5784 handle_command_reply: tid=0 2024-09-11T22:14:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.003+0000 7fdcc928f740 1 client.5784 shutdown 2024-09-11T22:14:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc928f740 1 -- 172.21.15.50:0/3215784145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 msgr2=0x56022213fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc928f740 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 0x56022213fbb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0008010 tx=0x7fdcb0013000 comp rx=0 tx=0).stop 2024-09-11T22:14:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc928f740 1 -- 172.21.15.50:0/3215784145 shutdown_connections 2024-09-11T22:14:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc928f740 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5602220bec60 0x56022209ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc928f740 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5602220a0520 0x56022213bd90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc928f740 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5602220bc880 0x5602221323e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc928f740 1 --2- 172.21.15.50:0/3215784145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602220b6110 0x56022213fbb0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdc9effd640 0 client.5784 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc928f740 1 -- 172.21.15.50:0/3215784145 >> 172.21.15.50:0/3215784145 conn(0x5602220bc420 msgr2=0x5602220738d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc928f740 1 -- 172.21.15.50:0/3215784145 shutdown_connections 2024-09-11T22:14:04.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc928f740 1 -- 172.21.15.50:0/3215784145 wait complete. 2024-09-11T22:14:04.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc928f740 20 client.5784 trim_cache size 0 max 16384 2024-09-11T22:14:04.011 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:04.011 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": -2 2024-09-11T22:14:04.011 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:04.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc64f1640 1 -- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdca006be30 msgr2=0x7fdca006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc64f1640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdca006be30 0x7fdca006e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000a830 tx=0x7fdcb0008040 comp rx=0 tx=0).stop 2024-09-11T22:14:04.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc64f1640 1 -- 172.21.15.50:0/4233900336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcc015b400 msgr2=0x7fdcc015dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc64f1640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcc015b400 0x7fdcc015dcf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009eb0 tx=0x7fdcb8004a40 comp rx=0 tx=0).stop 2024-09-11T22:14:04.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc64f1640 1 -- 172.21.15.50:0/4233900336 shutdown_connections 2024-09-11T22:14:04.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc64f1640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdca006be30 0x7fdca006e2f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc64f1640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdcc0072e60 0x7fdcc00aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc64f1640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcc015b400 0x7fdcc015dcf0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc64f1640 1 --2- 172.21.15.50:0/4233900336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcc006e0f0 0x7fdcc0153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc64f1640 1 -- 172.21.15.50:0/4233900336 >> 172.21.15.50:0/4233900336 conn(0x7fdcc00679c0 msgr2=0x7fdcc0069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc64f1640 1 -- 172.21.15.50:0/4233900336 shutdown_connections 2024-09-11T22:14:04.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.004+0000 7fdcc64f1640 1 -- 172.21.15.50:0/4233900336 wait complete. 2024-09-11T22:14:04.016 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-11T22:14:04.016 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-11T22:14:04.016 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-11T22:14:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.120+0000 7f65b04d0640 1 Processor -- start 2024-09-11T22:14:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.120+0000 7f65b04d0640 1 -- start start 2024-09-11T22:14:04.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.121+0000 7f65b04d0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f65a815b400 0x7f65a806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.121+0000 7f65b04d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a806e0f0 0x7f65a80711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.121+0000 7f65b04d0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65a815b7e0 con 0x7f65a8072e60 2024-09-11T22:14:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.121+0000 7f65b04d0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f65a815f140 con 0x7f65a815b400 2024-09-11T22:14:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.121+0000 7f65b04d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f65a815f420 con 0x7f65a806e0f0 2024-09-11T22:14:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.121+0000 7f65ae26c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f65a815b400 0x7f65a806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.121+0000 7f65ae26c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f65a815b400 0x7f65a806d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36958/0 (socket says 172.21.15.50:36958) 2024-09-11T22:14:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.121+0000 7f65ae26c640 1 -- 172.21.15.50:0/1106250610 learned_addr learned my addr 172.21.15.50:0/1106250610 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.122+0000 7f65aea6d640 1 --2- 172.21.15.50:0/1106250610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a806e0f0 0x7f65a80711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.122+0000 7f65ae26c640 1 -- 172.21.15.50:0/1106250610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a806e0f0 msgr2=0x7f65a80711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.122+0000 7f65ae26c640 1 --2- 172.21.15.50:0/1106250610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a806e0f0 0x7f65a80711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.122+0000 7f65ae26c640 1 -- 172.21.15.50:0/1106250610 >> v1:172.21.15.77:6789/0 conn(0x7f65a8072e60 legacy=0x7f65a806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.122+0000 7f65ae26c640 1 -- 172.21.15.50:0/1106250610 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a815f700 con 0x7f65a815b400 2024-09-11T22:14:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.122+0000 7f65aea6d640 1 --2- 172.21.15.50:0/1106250610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a806e0f0 0x7f65a80711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.123+0000 7f65ae26c640 1 --2- 172.21.15.50:0/1106250610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a815b400 0x7f65a806d070 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009870 tx=0x7f65a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddcd77ae41afd4f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.123+0000 7f65ad26a640 1 -- 172.21.15.50:0/1106250610 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0037070 con 0x7f65a815b400 2024-09-11T22:14:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.123+0000 7f65ad26a640 1 -- 172.21.15.50:0/1106250610 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a0032440 con 0x7f65a815b400 2024-09-11T22:14:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.123+0000 7f65ad26a640 1 -- 172.21.15.50:0/1106250610 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0032810 con 0x7f65a815b400 2024-09-11T22:14:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.123+0000 7f65b04d0640 1 -- 172.21.15.50:0/1106250610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a815b400 msgr2=0x7f65a806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.123+0000 7f65b04d0640 1 --2- 172.21.15.50:0/1106250610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a815b400 0x7f65a806d070 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009870 tx=0x7f65a002a270 comp rx=0 tx=0).stop 2024-09-11T22:14:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.123+0000 7f65b04d0640 1 -- 172.21.15.50:0/1106250610 shutdown_connections 2024-09-11T22:14:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.123+0000 7f65b04d0640 1 --2- 172.21.15.50:0/1106250610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a806e0f0 0x7f65a80711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.123+0000 7f65b04d0640 1 --2- 172.21.15.50:0/1106250610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a815b400 0x7f65a806d070 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.123+0000 7f65b04d0640 1 -- 172.21.15.50:0/1106250610 >> 172.21.15.50:0/1106250610 conn(0x7f65a80679c0 msgr2=0x7f65a8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.123+0000 7f65b04d0640 1 -- 172.21.15.50:0/1106250610 shutdown_connections 2024-09-11T22:14:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.123+0000 7f65b04d0640 1 -- 172.21.15.50:0/1106250610 wait complete. 2024-09-11T22:14:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.125+0000 7f65b04d0640 1 Processor -- start 2024-09-11T22:14:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.125+0000 7f65b04d0640 1 -- start start 2024-09-11T22:14:04.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.125+0000 7f65b04d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a806e0f0 0x7f65a81f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.125+0000 7f65b04d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a8072e60 0x7f65a8148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.125+0000 7f65b04d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a815b400 0x7f65a815b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.125+0000 7f65b04d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f65a8071700 con 0x7f65a806e0f0 2024-09-11T22:14:04.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.125+0000 7f65b04d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f65a80cfc50 con 0x7f65a8072e60 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.125+0000 7f65b04d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f65a8071880 con 0x7f65a815b400 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.125+0000 7f65ae26c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a806e0f0 0x7f65a81f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.125+0000 7f65ae26c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a806e0f0 0x7f65a81f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36968/0 (socket says 172.21.15.50:36968) 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.125+0000 7f65ae26c640 1 -- 172.21.15.50:0/661993613 learned_addr learned my addr 172.21.15.50:0/661993613 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.126+0000 7f65ada6b640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a8072e60 0x7f65a8148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.126+0000 7f65aea6d640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a815b400 0x7f65a815b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.126+0000 7f65ae26c640 1 -- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a815b400 msgr2=0x7f65a815b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.126+0000 7f65ae26c640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a815b400 0x7f65a815b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.126+0000 7f65ae26c640 1 -- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a8072e60 msgr2=0x7f65a8148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.126+0000 7f65ae26c640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a8072e60 0x7f65a8148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.126+0000 7f65ae26c640 1 -- 172.21.15.50:0/661993613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a815c470 con 0x7f65a806e0f0 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.126+0000 7f65ae26c640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a806e0f0 0x7f65a81f52c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f65a0000c00 tx=0x7f65a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.126+0000 7f65a6ffd640 1 -- 172.21.15.50:0/661993613 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0041020 con 0x7f65a806e0f0 2024-09-11T22:14:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.126+0000 7f65a6ffd640 1 -- 172.21.15.50:0/661993613 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a00306c0 con 0x7f65a806e0f0 2024-09-11T22:14:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.126+0000 7f65b04d0640 1 -- 172.21.15.50:0/661993613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a815c750 con 0x7f65a806e0f0 2024-09-11T22:14:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.126+0000 7f65a6ffd640 1 -- 172.21.15.50:0/661993613 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0037040 con 0x7f65a806e0f0 2024-09-11T22:14:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.126+0000 7f65b04d0640 1 -- 172.21.15.50:0/661993613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a81577c0 con 0x7f65a806e0f0 2024-09-11T22:14:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.128+0000 7f65a6ffd640 1 -- 172.21.15.50:0/661993613 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65a0044020 con 0x7f65a806e0f0 2024-09-11T22:14:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.128+0000 7f65a6ffd640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f659406be30 0x7f659406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.129+0000 7f65a6ffd640 1 -- 172.21.15.50:0/661993613 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f65a00ab510 con 0x7f65a806e0f0 2024-09-11T22:14:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.129+0000 7f65ada6b640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f659406be30 0x7f659406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.129+0000 7f65ada6b640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f659406be30 0x7f659406e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f65a815cbf0 tx=0x7f659c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.129+0000 7f65b3269740 1 Processor -- start 2024-09-11T22:14:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.130+0000 7f65b3269740 1 -- start start 2024-09-11T22:14:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.130+0000 7f65b3269740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 0x5638d768caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.130+0000 7f65b3269740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7643cc0 0x5638d7640d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.130+0000 7f65b3269740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7647c60 0x5638d7689a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.130+0000 7f65b3269740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5638d75a9af0 con 0x5638d768c6c0 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.130+0000 7f65b3269740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5638d7551690 con 0x5638d7643cc0 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.130+0000 7f65b3269740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5638d75a5ab0 con 0x5638d7647c60 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f65ae26c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 0x5638d768caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f65ae26c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 0x5638d768caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36972/0 (socket says 172.21.15.50:36972) 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f65ae26c640 1 -- 172.21.15.50:0/3823914141 learned_addr learned my addr 172.21.15.50:0/3823914141 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f65aea6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7647c60 0x5638d7689a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f65ada6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7643cc0 0x5638d7640d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f65ae26c640 1 -- 172.21.15.50:0/3823914141 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7647c60 msgr2=0x5638d7689a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f65ae26c640 1 --2- 172.21.15.50:0/3823914141 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7647c60 0x5638d7689a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f65ae26c640 1 -- 172.21.15.50:0/3823914141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7643cc0 msgr2=0x5638d7640d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f65ae26c640 1 --2- 172.21.15.50:0/3823914141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7643cc0 0x5638d7640d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f65ae26c640 1 -- 172.21.15.50:0/3823914141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d7388b00 con 0x5638d768c6c0 2024-09-11T22:14:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f65ae26c640 1 --2- 172.21.15.50:0/3823914141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 0x5638d768caa0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f65a0035040 tx=0x7f65a0075be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f606dad09ffeee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f658ffff640 1 -- 172.21.15.50:0/3823914141 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0077bc0 con 0x5638d768c6c0 2024-09-11T22:14:04.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f658ffff640 1 -- 172.21.15.50:0/3823914141 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a0075f30 con 0x5638d768c6c0 2024-09-11T22:14:04.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.131+0000 7f658ffff640 1 -- 172.21.15.50:0/3823914141 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a00ab2e0 con 0x5638d768c6c0 2024-09-11T22:14:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.132+0000 7f65b3269740 1 -- 172.21.15.50:0/3823914141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 msgr2=0x5638d768caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.132+0000 7f65b3269740 1 --2- 172.21.15.50:0/3823914141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 0x5638d768caa0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f65a0035040 tx=0x7f65a0075be0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.132+0000 7f65b3269740 1 -- 172.21.15.50:0/3823914141 shutdown_connections 2024-09-11T22:14:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.132+0000 7f65b3269740 1 --2- 172.21.15.50:0/3823914141 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7647c60 0x5638d7689a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.132+0000 7f65b3269740 1 --2- 172.21.15.50:0/3823914141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7643cc0 0x5638d7640d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.132+0000 7f65b3269740 1 --2- 172.21.15.50:0/3823914141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 0x5638d768caa0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.132+0000 7f65b3269740 1 -- 172.21.15.50:0/3823914141 >> 172.21.15.50:0/3823914141 conn(0x5638d760d890 msgr2=0x5638d768b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.132+0000 7f65b3269740 1 -- 172.21.15.50:0/3823914141 shutdown_connections 2024-09-11T22:14:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.132+0000 7f65b3269740 1 -- 172.21.15.50:0/3823914141 wait complete. 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.133+0000 7f65b3269740 1 -- start start 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.133+0000 7f65b3269740 1 Processor -- start 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65b3269740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 0x5638d7688010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65b3269740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7647c60 0x5638d7685620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65b3269740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d768c6c0 0x5638d766ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65b3269740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5638d75a9af0 con 0x5638d7643cc0 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65b3269740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5638d75328a0 con 0x5638d7647c60 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65b3269740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5638d766f2a0 con 0x5638d768c6c0 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65b3269740 10 client.0 _ll_register_callbacks cb 0x5638d72bbee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65ae26c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 0x5638d7688010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65ae26c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 0x5638d7688010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36988/0 (socket says 172.21.15.50:36988) 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65ae26c640 1 -- 172.21.15.50:0/1050516478 learned_addr learned my addr 172.21.15.50:0/1050516478 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65aea6d640 1 --2- 172.21.15.50:0/1050516478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d768c6c0 0x5638d766ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65ada6b640 1 --2- 172.21.15.50:0/1050516478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7647c60 0x5638d7685620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65ae26c640 1 -- 172.21.15.50:0/1050516478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d768c6c0 msgr2=0x5638d766ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65ae26c640 1 --2- 172.21.15.50:0/1050516478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d768c6c0 0x5638d766ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65ae26c640 1 -- 172.21.15.50:0/1050516478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7647c60 msgr2=0x5638d7685620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65ae26c640 1 --2- 172.21.15.50:0/1050516478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7647c60 0x5638d7685620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65ae26c640 1 -- 172.21.15.50:0/1050516478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d727c3f0 con 0x5638d7643cc0 2024-09-11T22:14:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65ae26c640 1 --2- 172.21.15.50:0/1050516478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 0x5638d7688010 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f65a00a9ae0 tx=0x7f65a002a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452f7d6b4ce94f7e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f658d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f658d7fa640 1 -- 172.21.15.50:0/1050516478 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0077bc0 con 0x5638d7643cc0 2024-09-11T22:14:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f658d7fa640 1 -- 172.21.15.50:0/1050516478 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f65a0081f60 con 0x5638d7643cc0 2024-09-11T22:14:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65b3269740 1 -- 172.21.15.50:0/1050516478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65a0075f30 con 0x5638d7643cc0 2024-09-11T22:14:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f658d7fa640 1 -- 172.21.15.50:0/1050516478 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f65a0082160 con 0x5638d7643cc0 2024-09-11T22:14:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.134+0000 7f65b3269740 10 client.5796 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.135+0000 7f65b3269740 1 -- 172.21.15.50:0/1050516478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5638d73e9290 con 0x5638d7643cc0 2024-09-11T22:14:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.135+0000 7f658d7fa640 1 -- 172.21.15.50:0/1050516478 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a0075f30 con 0x5638d7643cc0 2024-09-11T22:14:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.135+0000 7f658d7fa640 1 -- 172.21.15.50:0/1050516478 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f65a003a030 con 0x5638d7643cc0 2024-09-11T22:14:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.135+0000 7f65b3269740 10 client.5796 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.135+0000 7f65b3269740 10 client.5796 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.135+0000 7f65b3269740 20 client.5796 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.135+0000 7f65b3269740 1 --2- 172.21.15.50:0/1050516478 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5638d7683ba0 0x5638d769b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.135+0000 7f65b3269740 4 client.5796 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.135+0000 7f65b3269740 1 -- 172.21.15.50:0/1050516478 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638d75b7220 con 0x5638d7683ba0 2024-09-11T22:14:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.135+0000 7f65ada6b640 1 --2- 172.21.15.50:0/1050516478 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5638d7683ba0 0x5638d769b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.135+0000 7f65ada6b640 1 --2- 172.21.15.50:0/1050516478 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5638d7683ba0 0x5638d769b620 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84ab4059fb7243f server_cookie=63d583709dfc3eab in_seq=0 out_seq=0 2024-09-11T22:14:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.135+0000 7f658d7fa640 10 client.5796 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f658d7fa640 1 -- 172.21.15.50:0/1050516478 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638d75b7220 con 0x5638d7683ba0 2024-09-11T22:14:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f658d7fa640 10 client.5796 handle_command_reply: tid=0 2024-09-11T22:14:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f65b3269740 1 client.5796 shutdown 2024-09-11T22:14:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f65b3269740 1 -- 172.21.15.50:0/1050516478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 msgr2=0x5638d7688010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f65b3269740 1 --2- 172.21.15.50:0/1050516478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 0x5638d7688010 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f65a00a9ae0 tx=0x7f65a002a7f0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f65b3269740 1 -- 172.21.15.50:0/1050516478 shutdown_connections 2024-09-11T22:14:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f65b3269740 1 --2- 172.21.15.50:0/1050516478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d768c6c0 0x5638d766ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f65b3269740 1 --2- 172.21.15.50:0/1050516478 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5638d7683ba0 0x5638d769b620 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f65b3269740 1 --2- 172.21.15.50:0/1050516478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7647c60 0x5638d7685620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f65b3269740 1 --2- 172.21.15.50:0/1050516478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 0x5638d7688010 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f65b3269740 1 -- 172.21.15.50:0/1050516478 >> 172.21.15.50:0/1050516478 conn(0x5638d760d890 msgr2=0x5638d768f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f658d7fa640 0 client.5796 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f65b3269740 1 -- 172.21.15.50:0/1050516478 shutdown_connections 2024-09-11T22:14:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f65b3269740 1 -- 172.21.15.50:0/1050516478 wait complete. 2024-09-11T22:14:04.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.136+0000 7f65b3269740 20 client.5796 trim_cache size 0 max 16384 2024-09-11T22:14:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.154+0000 7f65b3269740 1 Processor -- start 2024-09-11T22:14:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.154+0000 7f65b3269740 1 -- start start 2024-09-11T22:14:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65b3269740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7643cc0 0x5638d7642910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65b3269740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7647c60 0x5638d7689810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65b3269740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 0x5638d769e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65b3269740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f65a8200e70 con 0x5638d768c6c0 2024-09-11T22:14:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65b3269740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f65a81fff90 con 0x5638d7647c60 2024-09-11T22:14:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65b3269740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f65a815a000 con 0x5638d7643cc0 2024-09-11T22:14:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65aea6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 0x5638d769e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65aea6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 0x5638d769e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37002/0 (socket says 172.21.15.50:37002) 2024-09-11T22:14:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65aea6d640 1 -- 172.21.15.50:0/2736599224 learned_addr learned my addr 172.21.15.50:0/2736599224 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65aea6d640 1 -- 172.21.15.50:0/2736599224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7643cc0 msgr2=0x5638d7642910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65ae26c640 1 --2- 172.21.15.50:0/2736599224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7643cc0 0x5638d7642910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65ada6b640 1 --2- 172.21.15.50:0/2736599224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7647c60 0x5638d7689810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65aea6d640 1 --2- 172.21.15.50:0/2736599224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7643cc0 0x5638d7642910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65aea6d640 1 -- 172.21.15.50:0/2736599224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7647c60 msgr2=0x5638d7689810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65aea6d640 1 --2- 172.21.15.50:0/2736599224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7647c60 0x5638d7689810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65aea6d640 1 -- 172.21.15.50:0/2736599224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d72554b0 con 0x5638d768c6c0 2024-09-11T22:14:04.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f65aea6d640 1 --2- 172.21.15.50:0/2736599224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 0x5638d769e0c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6598003cb0 tx=0x7f6598003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369fd1c012889cd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f658f7fe640 1 -- 172.21.15.50:0/2736599224 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6598020670 con 0x5638d768c6c0 2024-09-11T22:14:04.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f658f7fe640 1 -- 172.21.15.50:0/2736599224 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f659801b070 con 0x5638d768c6c0 2024-09-11T22:14:04.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.155+0000 7f658f7fe640 1 -- 172.21.15.50:0/2736599224 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6598020a70 con 0x5638d768c6c0 2024-09-11T22:14:04.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.156+0000 7f65b3269740 1 -- 172.21.15.50:0/2736599224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 msgr2=0x5638d769e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.156+0000 7f65b3269740 1 --2- 172.21.15.50:0/2736599224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 0x5638d769e0c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6598003cb0 tx=0x7f6598003da0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.156+0000 7f65b3269740 1 -- 172.21.15.50:0/2736599224 shutdown_connections 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.156+0000 7f65b3269740 1 --2- 172.21.15.50:0/2736599224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d768c6c0 0x5638d769e0c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.156+0000 7f65b3269740 1 --2- 172.21.15.50:0/2736599224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d7647c60 0x5638d7689810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.156+0000 7f65b3269740 1 --2- 172.21.15.50:0/2736599224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7643cc0 0x5638d7642910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.156+0000 7f65b3269740 1 -- 172.21.15.50:0/2736599224 >> 172.21.15.50:0/2736599224 conn(0x5638d760d890 msgr2=0x5638d7642200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.156+0000 7f65b3269740 1 -- 172.21.15.50:0/2736599224 shutdown_connections 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.156+0000 7f65b3269740 1 -- 172.21.15.50:0/2736599224 wait complete. 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.157+0000 7f65b3269740 1 -- start start 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.157+0000 7f65b3269740 1 Processor -- start 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65b3269740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 0x5638d766ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65b3269740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7647c60 0x5638d76eb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65b3269740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d768c6c0 0x5638d7641030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65b3269740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5638d7684dc0 con 0x5638d7643cc0 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65b3269740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f65a815a650 con 0x5638d768c6c0 2024-09-11T22:14:04.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65b3269740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5638d76ebe40 con 0x5638d7647c60 2024-09-11T22:14:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65b3269740 10 client.0 _ll_register_callbacks cb 0x7f659c001d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65ae26c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 0x5638d766ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65ae26c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 0x5638d766ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37016/0 (socket says 172.21.15.50:37016) 2024-09-11T22:14:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65ae26c640 1 -- 172.21.15.50:0/3466739655 learned_addr learned my addr 172.21.15.50:0/3466739655 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65aea6d640 1 --2- 172.21.15.50:0/3466739655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d768c6c0 0x5638d7641030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65ada6b640 1 --2- 172.21.15.50:0/3466739655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7647c60 0x5638d76eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65ae26c640 1 -- 172.21.15.50:0/3466739655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7647c60 msgr2=0x5638d76eb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65ae26c640 1 --2- 172.21.15.50:0/3466739655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7647c60 0x5638d76eb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65ae26c640 1 -- 172.21.15.50:0/3466739655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d768c6c0 msgr2=0x5638d7641030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65ae26c640 1 --2- 172.21.15.50:0/3466739655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d768c6c0 0x5638d7641030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65ae26c640 1 -- 172.21.15.50:0/3466739655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d7646710 con 0x5638d7643cc0 2024-09-11T22:14:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65ae26c640 1 --2- 172.21.15.50:0/3466739655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 0x5638d766ffc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f65a0077b70 tx=0x7f65a0007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99ce70bd1996d96 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f658d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f658d7fa640 1 -- 172.21.15.50:0/3466739655 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0077bc0 con 0x5638d7643cc0 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f658d7fa640 1 -- 172.21.15.50:0/3466739655 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f65a0030cc0 con 0x5638d7643cc0 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.158+0000 7f65b3269740 1 -- 172.21.15.50:0/3466739655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f659801b070 con 0x5638d7643cc0 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f658d7fa640 1 -- 172.21.15.50:0/3466739655 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f65a0075b60 con 0x5638d7643cc0 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f65b3269740 10 client.5802 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f65b3269740 1 -- 172.21.15.50:0/3466739655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5638d7646710 con 0x5638d7643cc0 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f658d7fa640 1 -- 172.21.15.50:0/3466739655 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f659801b070 con 0x5638d7643cc0 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f658d7fa640 1 -- 172.21.15.50:0/3466739655 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7f65a007ab40 con 0x5638d7643cc0 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f65b3269740 10 client.5802 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f65b3269740 10 client.5802 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f65b3269740 20 client.5802 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f65b3269740 1 --2- 172.21.15.50:0/3466739655 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5638d7646270 0x5638d7641570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f65b3269740 4 client.5802 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-11T22:14:04.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f65b3269740 1 -- 172.21.15.50:0/3466739655 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x5638d7647800 con 0x5638d7646270 2024-09-11T22:14:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f65ada6b640 1 --2- 172.21.15.50:0/3466739655 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5638d7646270 0x5638d7641570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f658d7fa640 10 client.5802 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.159+0000 7f65ada6b640 1 --2- 172.21.15.50:0/3466739655 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5638d7646270 0x5638d7641570 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f99e89b648500470 server_cookie=7d972a14a83cb224 in_seq=0 out_seq=0 2024-09-11T22:14:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f658d7fa640 1 -- 172.21.15.50:0/3466739655 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5638d7647800 con 0x5638d7646270 2024-09-11T22:14:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f658d7fa640 10 client.5802 handle_command_reply: tid=0 2024-09-11T22:14:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f65b3269740 1 client.5802 shutdown 2024-09-11T22:14:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f65b3269740 1 -- 172.21.15.50:0/3466739655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 msgr2=0x5638d766ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f65b3269740 1 --2- 172.21.15.50:0/3466739655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 0x5638d766ffc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f65a0077b70 tx=0x7f65a0007000 comp rx=0 tx=0).stop 2024-09-11T22:14:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f65b3269740 1 -- 172.21.15.50:0/3466739655 shutdown_connections 2024-09-11T22:14:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f65b3269740 1 --2- 172.21.15.50:0/3466739655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638d7647c60 0x5638d76eb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f65b3269740 1 --2- 172.21.15.50:0/3466739655 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5638d7646270 0x5638d7641570 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f65b3269740 1 --2- 172.21.15.50:0/3466739655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5638d768c6c0 0x5638d7641030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f65b3269740 1 --2- 172.21.15.50:0/3466739655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638d7643cc0 0x5638d766ffc0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f658d7fa640 0 client.5802 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f65b3269740 1 -- 172.21.15.50:0/3466739655 >> 172.21.15.50:0/3466739655 conn(0x5638d760d890 msgr2=0x5638d7642200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f65b3269740 1 -- 172.21.15.50:0/3466739655 shutdown_connections 2024-09-11T22:14:04.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f65b3269740 1 -- 172.21.15.50:0/3466739655 wait complete. 2024-09-11T22:14:04.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.160+0000 7f65b3269740 20 client.5802 trim_cache size 0 max 16384 2024-09-11T22:14:04.167 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:04.167 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:14:04.167 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "1ccb8fd5-3c08-43ca-95b6-cee93049bbe9", 2024-09-11T22:14:04.167 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:14:04.167 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:04.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.161+0000 7f65b04d0640 1 -- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f659406be30 msgr2=0x7f659406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.161+0000 7f65b04d0640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f659406be30 0x7f659406e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f65a815cbf0 tx=0x7f659c009040 comp rx=0 tx=0).stop 2024-09-11T22:14:04.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.161+0000 7f65b04d0640 1 -- 172.21.15.50:0/661993613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a806e0f0 msgr2=0x7f65a81f52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.161+0000 7f65b04d0640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a806e0f0 0x7f65a81f52c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f65a0000c00 tx=0x7f65a00046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.161+0000 7f65b04d0640 1 -- 172.21.15.50:0/661993613 shutdown_connections 2024-09-11T22:14:04.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.161+0000 7f65b04d0640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f659406be30 0x7f659406e2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.161+0000 7f65b04d0640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a815b400 0x7f65a815b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.161+0000 7f65b04d0640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a8072e60 0x7f65a8148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.161+0000 7f65b04d0640 1 --2- 172.21.15.50:0/661993613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65a806e0f0 0x7f65a81f52c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.161+0000 7f65b04d0640 1 -- 172.21.15.50:0/661993613 >> 172.21.15.50:0/661993613 conn(0x7f65a80679c0 msgr2=0x7f65a80b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.161+0000 7f65b04d0640 1 -- 172.21.15.50:0/661993613 shutdown_connections 2024-09-11T22:14:04.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.161+0000 7f65b04d0640 1 -- 172.21.15.50:0/661993613 wait complete. 2024-09-11T22:14:04.172 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '1ccb8fd5-3c08-43ca-95b6-cee93049bbe9', 'mode': 'asynchronous'}' 2024-09-11T22:14:04.172 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-11T22:14:04.173 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-11T22:14:04.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.277+0000 7fa8d836d640 1 Processor -- start 2024-09-11T22:14:04.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.277+0000 7fa8d836d640 1 -- start start 2024-09-11T22:14:04.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.278+0000 7fa8d836d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8d0161fa0 0x7fa8d00b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.278+0000 7fa8d836d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa8d00b1600 0x7fa8d00cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.278+0000 7fa8d836d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d00cf440 0x7fa8d006bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.278+0000 7fa8d836d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa8d00d1220 con 0x7fa8d0161fa0 2024-09-11T22:14:04.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.278+0000 7fa8d836d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa8d00d17e0 con 0x7fa8d00b1600 2024-09-11T22:14:04.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.278+0000 7fa8d836d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d00cfbd0 con 0x7fa8d00cf440 2024-09-11T22:14:04.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.278+0000 7fa8d6109640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8d0161fa0 0x7fa8d00b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.278+0000 7fa8d6109640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8d0161fa0 0x7fa8d00b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37022/0 (socket says 172.21.15.50:37022) 2024-09-11T22:14:04.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.278+0000 7fa8d6109640 1 -- 172.21.15.50:0/410571089 learned_addr learned my addr 172.21.15.50:0/410571089 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.279+0000 7fa8d690a640 1 --2- 172.21.15.50:0/410571089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d00cf440 0x7fa8d006bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.279+0000 7fa8d5908640 1 --2- 172.21.15.50:0/410571089 >> v2:172.21.15.77:3300/0 conn(0x7fa8d00b1600 0x7fa8d00cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.279+0000 7fa8d6109640 1 -- 172.21.15.50:0/410571089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d00cf440 msgr2=0x7fa8d006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.279+0000 7fa8d6109640 1 --2- 172.21.15.50:0/410571089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d00cf440 0x7fa8d006bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.279+0000 7fa8d6109640 1 -- 172.21.15.50:0/410571089 >> v2:172.21.15.77:3300/0 conn(0x7fa8d00b1600 msgr2=0x7fa8d00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.279+0000 7fa8d6109640 1 --2- 172.21.15.50:0/410571089 >> v2:172.21.15.77:3300/0 conn(0x7fa8d00b1600 0x7fa8d00cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.279+0000 7fa8d6109640 1 -- 172.21.15.50:0/410571089 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d00cfeb0 con 0x7fa8d0161fa0 2024-09-11T22:14:04.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.279+0000 7fa8d5908640 1 --2- 172.21.15.50:0/410571089 >> v2:172.21.15.77:3300/0 conn(0x7fa8d00b1600 0x7fa8d00cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:04.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.279+0000 7fa8d690a640 1 --2- 172.21.15.50:0/410571089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d00cf440 0x7fa8d006bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:04.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.279+0000 7fa8d6109640 1 --2- 172.21.15.50:0/410571089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d0161fa0 0x7fa8d00b4d20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa8d009c280 tx=0x7fa8c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de243435bd322df6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.280+0000 7fa8d5107640 1 -- 172.21.15.50:0/410571089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8037070 con 0x7fa8d0161fa0 2024-09-11T22:14:04.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.280+0000 7fa8d5107640 1 -- 172.21.15.50:0/410571089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c8032440 con 0x7fa8d0161fa0 2024-09-11T22:14:04.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.280+0000 7fa8d5107640 1 -- 172.21.15.50:0/410571089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8032810 con 0x7fa8d0161fa0 2024-09-11T22:14:04.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.280+0000 7fa8d836d640 1 -- 172.21.15.50:0/410571089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d0161fa0 msgr2=0x7fa8d00b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.280+0000 7fa8d836d640 1 --2- 172.21.15.50:0/410571089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d0161fa0 0x7fa8d00b4d20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa8d009c280 tx=0x7fa8c802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.280+0000 7fa8d836d640 1 -- 172.21.15.50:0/410571089 shutdown_connections 2024-09-11T22:14:04.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.280+0000 7fa8d836d640 1 --2- 172.21.15.50:0/410571089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d00cf440 0x7fa8d006bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.280+0000 7fa8d836d640 1 --2- 172.21.15.50:0/410571089 >> v2:172.21.15.77:3300/0 conn(0x7fa8d00b1600 0x7fa8d00cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.280+0000 7fa8d836d640 1 --2- 172.21.15.50:0/410571089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d0161fa0 0x7fa8d00b4d20 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.280+0000 7fa8d836d640 1 -- 172.21.15.50:0/410571089 >> 172.21.15.50:0/410571089 conn(0x7fa8d009ba50 msgr2=0x7fa8d00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.280+0000 7fa8d836d640 1 -- 172.21.15.50:0/410571089 shutdown_connections 2024-09-11T22:14:04.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.280+0000 7fa8d836d640 1 -- 172.21.15.50:0/410571089 wait complete. 2024-09-11T22:14:04.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.281+0000 7fa8d836d640 1 Processor -- start 2024-09-11T22:14:04.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.281+0000 7fa8d836d640 1 -- start start 2024-09-11T22:14:04.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.282+0000 7fa8d836d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d00b1600 0x7fa8d0159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.282+0000 7fa8d836d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d00cf440 0x7fa8d015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.282+0000 7fa8d836d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d0161fa0 0x7fa8d00b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.282+0000 7fa8d836d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d0162380 con 0x7fa8d00b1600 2024-09-11T22:14:04.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.282+0000 7fa8d836d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d00cf8b0 con 0x7fa8d0161fa0 2024-09-11T22:14:04.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.282+0000 7fa8d836d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d0162500 con 0x7fa8d00cf440 2024-09-11T22:14:04.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.282+0000 7fa8d6109640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d00b1600 0x7fa8d0159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.282+0000 7fa8d6109640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d00b1600 0x7fa8d0159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37024/0 (socket says 172.21.15.50:37024) 2024-09-11T22:14:04.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.282+0000 7fa8d6109640 1 -- 172.21.15.50:0/3647658627 learned_addr learned my addr 172.21.15.50:0/3647658627 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.282+0000 7fa8d6109640 1 -- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d00cf440 msgr2=0x7fa8d015dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.282+0000 7fa8d6109640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d00cf440 0x7fa8d015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.282+0000 7fa8d6109640 1 -- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d0161fa0 msgr2=0x7fa8d00b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.282+0000 7fa8d690a640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d0161fa0 0x7fa8d00b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.283+0000 7fa8d6109640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d0161fa0 0x7fa8d00b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.283+0000 7fa8d6109640 1 -- 172.21.15.50:0/3647658627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d015f420 con 0x7fa8d00b1600 2024-09-11T22:14:04.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.283+0000 7fa8d690a640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d0161fa0 0x7fa8d00b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:04.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.283+0000 7fa8d6109640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d00b1600 0x7fa8d0159f20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa8c802a220 tx=0x7fa8c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.283+0000 7fa8ceffd640 1 -- 172.21.15.50:0/3647658627 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8037040 con 0x7fa8d00b1600 2024-09-11T22:14:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.283+0000 7fa8ceffd640 1 -- 172.21.15.50:0/3647658627 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c8042070 con 0x7fa8d00b1600 2024-09-11T22:14:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.283+0000 7fa8d836d640 1 -- 172.21.15.50:0/3647658627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d015f700 con 0x7fa8d00b1600 2024-09-11T22:14:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.283+0000 7fa8ceffd640 1 -- 172.21.15.50:0/3647658627 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8030bb0 con 0x7fa8d00b1600 2024-09-11T22:14:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.283+0000 7fa8d836d640 1 -- 172.21.15.50:0/3647658627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d015fcc0 con 0x7fa8d00b1600 2024-09-11T22:14:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.285+0000 7fa8ceffd640 1 -- 172.21.15.50:0/3647658627 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8c8047460 con 0x7fa8d00b1600 2024-09-11T22:14:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.285+0000 7fa8ceffd640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa8bc06be60 0x7fa8bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.285+0000 7fa8ceffd640 1 -- 172.21.15.50:0/3647658627 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fa8c80aba60 con 0x7fa8d00b1600 2024-09-11T22:14:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.285+0000 7fa8d5908640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa8bc06be60 0x7fa8bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.286+0000 7fa8d5908640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa8bc06be60 0x7fa8bc06e320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4006fd0 tx=0x7fa8c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.286+0000 7fa8db1e9740 1 Processor -- start 2024-09-11T22:14:04.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.286+0000 7fa8db1e9740 1 -- start start 2024-09-11T22:14:04.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.287+0000 7fa8db1e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e58870a40 0x558e588b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.287+0000 7fa8db1e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e5886e200 0x558e58870e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.287+0000 7fa8db1e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e588721d0 0x558e5886b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.287+0000 7fa8db1e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558e587d4c60 con 0x558e588721d0 2024-09-11T22:14:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.287+0000 7fa8db1e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558e5877ca50 con 0x558e5886e200 2024-09-11T22:14:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.287+0000 7fa8db1e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558e587d0c20 con 0x558e58870a40 2024-09-11T22:14:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.287+0000 7fa8d690a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e588721d0 0x558e5886b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.287+0000 7fa8d690a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e588721d0 0x558e5886b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37032/0 (socket says 172.21.15.50:37032) 2024-09-11T22:14:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.287+0000 7fa8d690a640 1 -- 172.21.15.50:0/3830470704 learned_addr learned my addr 172.21.15.50:0/3830470704 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.287+0000 7fa8d6109640 1 --2- 172.21.15.50:0/3830470704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e58870a40 0x558e588b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.287+0000 7fa8d5908640 1 --2- 172.21.15.50:0/3830470704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e5886e200 0x558e58870e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.288+0000 7fa8d690a640 1 -- 172.21.15.50:0/3830470704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e58870a40 msgr2=0x558e588b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.288+0000 7fa8d690a640 1 --2- 172.21.15.50:0/3830470704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e58870a40 0x558e588b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.288+0000 7fa8d690a640 1 -- 172.21.15.50:0/3830470704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e5886e200 msgr2=0x558e58870e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.288+0000 7fa8d690a640 1 --2- 172.21.15.50:0/3830470704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e5886e200 0x558e58870e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.288+0000 7fa8d690a640 1 -- 172.21.15.50:0/3830470704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e585b3f00 con 0x558e588721d0 2024-09-11T22:14:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.288+0000 7fa8d690a640 1 --2- 172.21.15.50:0/3830470704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e588721d0 0x558e5886b030 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000d460 tx=0x7fa8c000d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd849a47a363e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.288+0000 7fa8b7fff640 1 -- 172.21.15.50:0/3830470704 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c001a070 con 0x558e588721d0 2024-09-11T22:14:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.288+0000 7fa8b7fff640 1 -- 172.21.15.50:0/3830470704 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c000b740 con 0x558e588721d0 2024-09-11T22:14:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.288+0000 7fa8b7fff640 1 -- 172.21.15.50:0/3830470704 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c000baf0 con 0x558e588721d0 2024-09-11T22:14:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.289+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3830470704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e588721d0 msgr2=0x558e5886b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.289+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3830470704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e588721d0 0x558e5886b030 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000d460 tx=0x7fa8c000d920 comp rx=0 tx=0).stop 2024-09-11T22:14:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.289+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3830470704 shutdown_connections 2024-09-11T22:14:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.289+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3830470704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e588721d0 0x558e5886b030 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.289+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3830470704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e5886e200 0x558e58870e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.289+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3830470704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e58870a40 0x558e588b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.289+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3830470704 >> 172.21.15.50:0/3830470704 conn(0x558e5886d200 msgr2=0x558e588b56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.289+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3830470704 shutdown_connections 2024-09-11T22:14:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.289+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3830470704 wait complete. 2024-09-11T22:14:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.289+0000 7fa8db1e9740 1 -- start start 2024-09-11T22:14:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.289+0000 7fa8db1e9740 1 Processor -- start 2024-09-11T22:14:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.290+0000 7fa8db1e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e58870a40 0x558e588b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.290+0000 7fa8db1e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e588721d0 0x558e588bbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.290+0000 7fa8db1e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e5889b0e0 0x558e588bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.290+0000 7fa8db1e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558e5886c6a0 con 0x558e5889b0e0 2024-09-11T22:14:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.290+0000 7fa8db1e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558e5877acb0 con 0x558e58870a40 2024-09-11T22:14:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.290+0000 7fa8db1e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558e588b6a10 con 0x558e588721d0 2024-09-11T22:14:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.290+0000 7fa8db1e9740 10 client.0 _ll_register_callbacks cb 0x558e584e72e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.290+0000 7fa8d690a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e5889b0e0 0x558e588bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.290+0000 7fa8d690a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e5889b0e0 0x558e588bc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37042/0 (socket says 172.21.15.50:37042) 2024-09-11T22:14:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.290+0000 7fa8d690a640 1 -- 172.21.15.50:0/879852341 learned_addr learned my addr 172.21.15.50:0/879852341 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8d6109640 1 --2- 172.21.15.50:0/879852341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e58870a40 0x558e588b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8d5908640 1 --2- 172.21.15.50:0/879852341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e588721d0 0x558e588bbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8d690a640 1 -- 172.21.15.50:0/879852341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e588721d0 msgr2=0x558e588bbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8d690a640 1 --2- 172.21.15.50:0/879852341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e588721d0 0x558e588bbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8d690a640 1 -- 172.21.15.50:0/879852341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e58870a40 msgr2=0x558e588b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8d690a640 1 --2- 172.21.15.50:0/879852341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e58870a40 0x558e588b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8d690a640 1 -- 172.21.15.50:0/879852341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e584a77f0 con 0x558e5889b0e0 2024-09-11T22:14:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8d690a640 1 --2- 172.21.15.50:0/879852341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e5889b0e0 0x558e588bc4e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000d960 tx=0x7fa8c0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba5decb3ef59bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8b57fa640 1 -- 172.21.15.50:0/879852341 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c001a040 con 0x558e5889b0e0 2024-09-11T22:14:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8b57fa640 1 -- 172.21.15.50:0/879852341 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fa8c0020410 con 0x558e5889b0e0 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8db1e9740 1 -- 172.21.15.50:0/879852341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8c000b740 con 0x558e5889b0e0 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8b57fa640 1 -- 172.21.15.50:0/879852341 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa8c002d050 con 0x558e5889b0e0 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8db1e9740 10 client.5814 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8db1e9740 1 -- 172.21.15.50:0/879852341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x558e58614690 con 0x558e5889b0e0 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.291+0000 7fa8b57fa640 1 -- 172.21.15.50:0/879852341 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c000b740 con 0x558e5889b0e0 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.292+0000 7fa8b57fa640 1 -- 172.21.15.50:0/879852341 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fa8c0030020 con 0x558e5889b0e0 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.292+0000 7fa8db1e9740 10 client.5814 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.292+0000 7fa8db1e9740 10 client.5814 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.292+0000 7fa8db1e9740 20 client.5814 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.292+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/879852341 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558e588bb260 0x558e588bb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.292+0000 7fa8db1e9740 4 client.5814 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.292+0000 7fa8db1e9740 1 -- 172.21.15.50:0/879852341 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e587e2390 con 0x558e588bb260 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.292+0000 7fa8d6109640 1 --2- 172.21.15.50:0/879852341 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558e588bb260 0x558e588bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.292+0000 7fa8d6109640 1 --2- 172.21.15.50:0/879852341 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558e588bb260 0x558e588bb670 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3439724bfe18a6d6 server_cookie=cb1c8f2dd3890c7b in_seq=0 out_seq=0 2024-09-11T22:14:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.292+0000 7fa8b57fa640 10 client.5814 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8b57fa640 1 -- 172.21.15.50:0/879852341 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e587e2390 con 0x558e588bb260 2024-09-11T22:14:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8b57fa640 10 client.5814 handle_command_reply: tid=0 2024-09-11T22:14:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8db1e9740 1 client.5814 shutdown 2024-09-11T22:14:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8db1e9740 1 -- 172.21.15.50:0/879852341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e5889b0e0 msgr2=0x558e588bc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/879852341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e5889b0e0 0x558e588bc4e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000d960 tx=0x7fa8c0004ab0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8db1e9740 1 -- 172.21.15.50:0/879852341 shutdown_connections 2024-09-11T22:14:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/879852341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e588721d0 0x558e588bbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/879852341 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558e588bb260 0x558e588bb670 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/879852341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e5889b0e0 0x558e588bc4e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/879852341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e58870a40 0x558e588b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8db1e9740 1 -- 172.21.15.50:0/879852341 >> 172.21.15.50:0/879852341 conn(0x558e5886e200 msgr2=0x558e588b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8b57fa640 0 client.5814 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8db1e9740 1 -- 172.21.15.50:0/879852341 shutdown_connections 2024-09-11T22:14:04.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8db1e9740 1 -- 172.21.15.50:0/879852341 wait complete. 2024-09-11T22:14:04.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.293+0000 7fa8db1e9740 20 client.5814 trim_cache size 0 max 16384 2024-09-11T22:14:04.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.312+0000 7fa8db1e9740 1 Processor -- start 2024-09-11T22:14:04.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.312+0000 7fa8db1e9740 1 -- start start 2024-09-11T22:14:04.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.312+0000 7fa8db1e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 0x558e58897740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.312+0000 7fa8db1e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e588721d0 0x558e58899430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.312+0000 7fa8db1e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e5889b0e0 0x558e58899970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8db1e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d0200be0 con 0x558e58870a40 2024-09-11T22:14:04.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8db1e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d01ffc40 con 0x558e588721d0 2024-09-11T22:14:04.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8db1e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d00cba60 con 0x558e5889b0e0 2024-09-11T22:14:04.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8d6109640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 0x558e58897740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8d6109640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 0x558e58897740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37050/0 (socket says 172.21.15.50:37050) 2024-09-11T22:14:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8d6109640 1 -- 172.21.15.50:0/3566363813 learned_addr learned my addr 172.21.15.50:0/3566363813 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8d5908640 1 --2- 172.21.15.50:0/3566363813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e588721d0 0x558e58899430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8d690a640 1 --2- 172.21.15.50:0/3566363813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e5889b0e0 0x558e58899970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8d6109640 1 -- 172.21.15.50:0/3566363813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e5889b0e0 msgr2=0x558e58899970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8d6109640 1 --2- 172.21.15.50:0/3566363813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e5889b0e0 0x558e58899970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8d6109640 1 -- 172.21.15.50:0/3566363813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e588721d0 msgr2=0x558e58899430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8d6109640 1 --2- 172.21.15.50:0/3566363813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e588721d0 0x558e58899430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8d6109640 1 -- 172.21.15.50:0/3566363813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e584808b0 con 0x558e58870a40 2024-09-11T22:14:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8d6109640 1 --2- 172.21.15.50:0/3566363813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 0x558e58897740 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80799d0 tx=0x7fa8c807c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d743b1cfdd94d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8b77fe640 1 -- 172.21.15.50:0/3566363813 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8091040 con 0x558e58870a40 2024-09-11T22:14:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8b77fe640 1 -- 172.21.15.50:0/3566363813 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c8079cd0 con 0x558e58870a40 2024-09-11T22:14:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.313+0000 7fa8b77fe640 1 -- 172.21.15.50:0/3566363813 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c807e080 con 0x558e58870a40 2024-09-11T22:14:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.314+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3566363813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 msgr2=0x558e58897740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.314+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3566363813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 0x558e58897740 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80799d0 tx=0x7fa8c807c040 comp rx=0 tx=0).stop 2024-09-11T22:14:04.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.314+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3566363813 shutdown_connections 2024-09-11T22:14:04.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.314+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3566363813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e5889b0e0 0x558e58899970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.314+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3566363813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e588721d0 0x558e58899430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.314+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3566363813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 0x558e58897740 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.314+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3566363813 >> 172.21.15.50:0/3566363813 conn(0x558e5886e200 msgr2=0x558e588b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.314+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3566363813 shutdown_connections 2024-09-11T22:14:04.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.314+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3566363813 wait complete. 2024-09-11T22:14:04.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.315+0000 7fa8db1e9740 1 -- start start 2024-09-11T22:14:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.315+0000 7fa8db1e9740 1 Processor -- start 2024-09-11T22:14:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8db1e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 0x558e58933ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8db1e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e588721d0 0x558e588b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8db1e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e5889b0e0 0x558e588b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8db1e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558e5886dea0 con 0x558e58870a40 2024-09-11T22:14:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8db1e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d00cc0b0 con 0x558e5889b0e0 2024-09-11T22:14:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8db1e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558e58899eb0 con 0x558e588721d0 2024-09-11T22:14:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8db1e9740 10 client.0 _ll_register_callbacks cb 0x7fa8c0018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8d6109640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 0x558e58933ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8d6109640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 0x558e58933ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37066/0 (socket says 172.21.15.50:37066) 2024-09-11T22:14:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8d6109640 1 -- 172.21.15.50:0/3596849758 learned_addr learned my addr 172.21.15.50:0/3596849758 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8d5908640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e588721d0 0x558e588b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8d690a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e5889b0e0 0x558e588b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8d6109640 1 -- 172.21.15.50:0/3596849758 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e588721d0 msgr2=0x558e588b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8d6109640 1 --2- 172.21.15.50:0/3596849758 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e588721d0 0x558e588b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8d6109640 1 -- 172.21.15.50:0/3596849758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e5889b0e0 msgr2=0x558e588b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8d6109640 1 --2- 172.21.15.50:0/3596849758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e5889b0e0 0x558e588b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.316+0000 7fa8d6109640 1 -- 172.21.15.50:0/3596849758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e588998e0 con 0x558e58870a40 2024-09-11T22:14:04.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8d6109640 1 --2- 172.21.15.50:0/3596849758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 0x558e58933ca0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8039fd0 tx=0x7fa8c8049040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20494ec4587fb512 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:04.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8b57fa640 1 -- 172.21.15.50:0/3596849758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8091050 con 0x558e58870a40 2024-09-11T22:14:04.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8b57fa640 1 -- 172.21.15.50:0/3596849758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fa8c8030d50 con 0x558e58870a40 2024-09-11T22:14:04.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3596849758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8c8079cd0 con 0x558e58870a40 2024-09-11T22:14:04.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8b57fa640 1 -- 172.21.15.50:0/3596849758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa8c80828b0 con 0x558e58870a40 2024-09-11T22:14:04.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8db1e9740 10 client.5820 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3596849758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x558e58899d30 con 0x558e58870a40 2024-09-11T22:14:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8b57fa640 1 -- 172.21.15.50:0/3596849758 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c8079cd0 con 0x558e58870a40 2024-09-11T22:14:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8b57fa640 1 -- 172.21.15.50:0/3596849758 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fa8c803a030 con 0x558e58870a40 2024-09-11T22:14:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8db1e9740 10 client.5820 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8db1e9740 10 client.5820 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8db1e9740 20 client.5820 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3596849758 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558e588b2790 0x558e588afd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8db1e9740 4 client.5820 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-11T22:14:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3596849758 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x558e587dc6e0 con 0x558e588b2790 2024-09-11T22:14:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.317+0000 7fa8d5908640 1 --2- 172.21.15.50:0/3596849758 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558e588b2790 0x558e588afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.318+0000 7fa8b57fa640 10 client.5820 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.318+0000 7fa8d5908640 1 --2- 172.21.15.50:0/3596849758 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558e588b2790 0x558e588afd20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a386b90335a0b8cb server_cookie=81fdb04ce48e6c7e in_seq=0 out_seq=0 2024-09-11T22:14:04.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8b57fa640 1 -- 172.21.15.50:0/3596849758 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558e587dc6e0 con 0x558e588b2790 2024-09-11T22:14:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8b57fa640 10 client.5820 handle_command_reply: tid=0 2024-09-11T22:14:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8db1e9740 1 client.5820 shutdown 2024-09-11T22:14:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3596849758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 msgr2=0x558e58933ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3596849758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 0x558e58933ca0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8039fd0 tx=0x7fa8c8049040 comp rx=0 tx=0).stop 2024-09-11T22:14:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3596849758 shutdown_connections 2024-09-11T22:14:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3596849758 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e588721d0 0x558e588b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3596849758 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558e588b2790 0x558e588afd20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3596849758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e5889b0e0 0x558e588b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8db1e9740 1 --2- 172.21.15.50:0/3596849758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e58870a40 0x558e58933ca0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8b57fa640 0 client.5820 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3596849758 >> 172.21.15.50:0/3596849758 conn(0x558e5886e200 msgr2=0x558e588b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3596849758 shutdown_connections 2024-09-11T22:14:04.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8db1e9740 1 -- 172.21.15.50:0/3596849758 wait complete. 2024-09-11T22:14:04.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.319+0000 7fa8db1e9740 20 client.5820 trim_cache size 0 max 16384 2024-09-11T22:14:04.328 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:04.328 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:14:04.328 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "74f4cb7a-5f32-4dad-9b90-b6a0089ff1cc", 2024-09-11T22:14:04.328 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:14:04.328 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:04.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.320+0000 7fa8d836d640 1 -- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa8bc06be60 msgr2=0x7fa8bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.320+0000 7fa8d836d640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa8bc06be60 0x7fa8bc06e320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4006fd0 tx=0x7fa8c4008040 comp rx=0 tx=0).stop 2024-09-11T22:14:04.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.320+0000 7fa8d836d640 1 -- 172.21.15.50:0/3647658627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d00b1600 msgr2=0x7fa8d0159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.320+0000 7fa8d836d640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d00b1600 0x7fa8d0159f20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa8c802a220 tx=0x7fa8c80046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.320+0000 7fa8d836d640 1 -- 172.21.15.50:0/3647658627 shutdown_connections 2024-09-11T22:14:04.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.320+0000 7fa8d836d640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa8bc06be60 0x7fa8bc06e320 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.320+0000 7fa8d836d640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d00cf440 0x7fa8d015dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.320+0000 7fa8d836d640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d0161fa0 0x7fa8d00b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.320+0000 7fa8d836d640 1 --2- 172.21.15.50:0/3647658627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d00b1600 0x7fa8d0159f20 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.320+0000 7fa8d836d640 1 -- 172.21.15.50:0/3647658627 >> 172.21.15.50:0/3647658627 conn(0x7fa8d009ba50 msgr2=0x7fa8d00b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.320+0000 7fa8d836d640 1 -- 172.21.15.50:0/3647658627 shutdown_connections 2024-09-11T22:14:04.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.320+0000 7fa8d836d640 1 -- 172.21.15.50:0/3647658627 wait complete. 2024-09-11T22:14:04.332 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '74f4cb7a-5f32-4dad-9b90-b6a0089ff1cc', 'mode': 'asynchronous'}' 2024-09-11T22:14:04.332 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-11T22:14:04.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-11T22:14:04.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.436+0000 7fbf0a4e6640 1 Processor -- start 2024-09-11T22:14:04.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.436+0000 7fbf0a4e6640 1 -- start start 2024-09-11T22:14:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.437+0000 7fbf0a4e6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf04072e60 0x7fbf0406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.437+0000 7fbf0a4e6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf0415b7e0 con 0x7fbf0406e0f0 2024-09-11T22:14:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.437+0000 7fbf0a4e6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf0415f140 con 0x7fbf0415b400 2024-09-11T22:14:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.437+0000 7fbf0a4e6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0415f420 con 0x7fbf04072e60 2024-09-11T22:14:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.437+0000 7fbf037fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbf0406e0f0 0x7fbf040711c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36346/0 (socket says 172.21.15.50:36346) 2024-09-11T22:14:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.437+0000 7fbf037fe640 1 -- 172.21.15.50:0/1319501012 learned_addr learned my addr 172.21.15.50:0/1319501012 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:04.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.437+0000 7fbf08a83640 1 --2- 172.21.15.50:0/1319501012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf04072e60 0x7fbf0406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.438+0000 7fbf02ffd640 1 -- 172.21.15.50:0/1319501012 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317169465 0 0) 0x7fbf0415b7e0 con 0x7fbf0406e0f0 2024-09-11T22:14:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.438+0000 7fbf02ffd640 1 -- 172.21.15.50:0/1319501012 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeec003520 con 0x7fbf0406e0f0 2024-09-11T22:14:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.438+0000 7fbf02ffd640 1 -- 172.21.15.50:0/1319501012 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892848477 0 0) 0x7fbf0415f140 con 0x7fbf0415b400 2024-09-11T22:14:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.438+0000 7fbf02ffd640 1 -- 172.21.15.50:0/1319501012 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf0415b7e0 con 0x7fbf0415b400 2024-09-11T22:14:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.438+0000 7fbf08a83640 1 -- 172.21.15.50:0/1319501012 >> v1:172.21.15.77:6789/0 conn(0x7fbf0415b400 legacy=0x7fbf0406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.438+0000 7fbf08a83640 1 -- 172.21.15.50:0/1319501012 >> v1:172.21.15.50:6789/0 conn(0x7fbf0406e0f0 legacy=0x7fbf040711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.438+0000 7fbf08a83640 1 -- 172.21.15.50:0/1319501012 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0415f700 con 0x7fbf04072e60 2024-09-11T22:14:04.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.439+0000 7fbf08a83640 1 --2- 172.21.15.50:0/1319501012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf04072e60 0x7fbf0406d070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009dc0 tx=0x7fbefc02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca03d14a5936febe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.439+0000 7fbf02ffd640 1 -- 172.21.15.50:0/1319501012 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc007740 con 0x7fbf04072e60 2024-09-11T22:14:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.439+0000 7fbf02ffd640 1 -- 172.21.15.50:0/1319501012 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbefc0078e0 con 0x7fbf04072e60 2024-09-11T22:14:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.439+0000 7fbf02ffd640 1 -- 172.21.15.50:0/1319501012 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc007c90 con 0x7fbf04072e60 2024-09-11T22:14:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.439+0000 7fbf0a4e6640 1 -- 172.21.15.50:0/1319501012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf04072e60 msgr2=0x7fbf0406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.439+0000 7fbf0a4e6640 1 --2- 172.21.15.50:0/1319501012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf04072e60 0x7fbf0406d070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009dc0 tx=0x7fbefc02a6d0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.439+0000 7fbf0a4e6640 1 -- 172.21.15.50:0/1319501012 shutdown_connections 2024-09-11T22:14:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.439+0000 7fbf0a4e6640 1 --2- 172.21.15.50:0/1319501012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf04072e60 0x7fbf0406d070 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.439+0000 7fbf0a4e6640 1 -- 172.21.15.50:0/1319501012 >> 172.21.15.50:0/1319501012 conn(0x7fbf040679c0 msgr2=0x7fbf04067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.439+0000 7fbf0a4e6640 1 -- 172.21.15.50:0/1319501012 shutdown_connections 2024-09-11T22:14:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.439+0000 7fbf0a4e6640 1 -- 172.21.15.50:0/1319501012 wait complete. 2024-09-11T22:14:04.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.441+0000 7fbf0a4e6640 1 Processor -- start 2024-09-11T22:14:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.441+0000 7fbf0a4e6640 1 -- start start 2024-09-11T22:14:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.441+0000 7fbf0a4e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0406e0f0 0x7fbf041f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.441+0000 7fbf0a4e6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf04072e60 0x7fbf0414e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.441+0000 7fbf0a4e6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf0415b400 0x7fbf040ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.441+0000 7fbf0a4e6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbf040718d0 con 0x7fbf0406e0f0 2024-09-11T22:14:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.441+0000 7fbf0a4e6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbf040cfc50 con 0x7fbf04072e60 2024-09-11T22:14:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.441+0000 7fbf0a4e6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbf04071a50 con 0x7fbf0415b400 2024-09-11T22:14:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf03fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0406e0f0 0x7fbf041f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf03fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0406e0f0 0x7fbf041f74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37070/0 (socket says 172.21.15.50:37070) 2024-09-11T22:14:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf03fff640 1 -- 172.21.15.50:0/2287847338 learned_addr learned my addr 172.21.15.50:0/2287847338 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf037fe640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf04072e60 0x7fbf0414e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf08a83640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf0415b400 0x7fbf040ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf03fff640 1 -- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf0415b400 msgr2=0x7fbf040ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf03fff640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf0415b400 0x7fbf040ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf03fff640 1 -- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf04072e60 msgr2=0x7fbf0414e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf03fff640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf04072e60 0x7fbf0414e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf03fff640 1 -- 172.21.15.50:0/2287847338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf041f7a90 con 0x7fbf0406e0f0 2024-09-11T22:14:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf03fff640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0406e0f0 0x7fbf041f74b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbef400c430 tx=0x7fbef400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf00ff9640 1 -- 172.21.15.50:0/2287847338 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4017070 con 0x7fbf0406e0f0 2024-09-11T22:14:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf00ff9640 1 -- 172.21.15.50:0/2287847338 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef40052f0 con 0x7fbf0406e0f0 2024-09-11T22:14:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf0a4e6640 1 -- 172.21.15.50:0/2287847338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf041f7d70 con 0x7fbf0406e0f0 2024-09-11T22:14:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf00ff9640 1 -- 172.21.15.50:0/2287847338 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4003830 con 0x7fbf0406e0f0 2024-09-11T22:14:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.442+0000 7fbf0a4e6640 1 -- 172.21.15.50:0/2287847338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf041f8330 con 0x7fbf0406e0f0 2024-09-11T22:14:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.444+0000 7fbf00ff9640 1 -- 172.21.15.50:0/2287847338 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbef401a070 con 0x7fbf0406e0f0 2024-09-11T22:14:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.444+0000 7fbf00ff9640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbef006be30 0x7fbef006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.444+0000 7fbf00ff9640 1 -- 172.21.15.50:0/2287847338 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fbef408a2b0 con 0x7fbf0406e0f0 2024-09-11T22:14:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.444+0000 7fbf037fe640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbef006be30 0x7fbef006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.445+0000 7fbf037fe640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbef006be30 0x7fbef006e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbf040cef20 tx=0x7fbef8007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.445+0000 7fbf0d280740 1 Processor -- start 2024-09-11T22:14:04.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.445+0000 7fbf0d280740 1 -- start start 2024-09-11T22:14:04.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf0d280740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 0x5621c7798090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf0d280740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c77500b0 0x5621c7752cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf0d280740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c7754080 0x5621c774d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf0d280740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5621c76b5a10 con 0x5621c77528f0 2024-09-11T22:14:04.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf0d280740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5621c765d700 con 0x5621c77500b0 2024-09-11T22:14:04.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf0d280740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5621c76b19d0 con 0x5621c7754080 2024-09-11T22:14:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf03fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 0x5621c7798090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf03fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 0x5621c7798090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37082/0 (socket says 172.21.15.50:37082) 2024-09-11T22:14:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf03fff640 1 -- 172.21.15.50:0/4220707744 learned_addr learned my addr 172.21.15.50:0/4220707744 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf037fe640 1 --2- 172.21.15.50:0/4220707744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c77500b0 0x5621c7752cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf08a83640 1 --2- 172.21.15.50:0/4220707744 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c7754080 0x5621c774d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf03fff640 1 -- 172.21.15.50:0/4220707744 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c7754080 msgr2=0x5621c774d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf03fff640 1 --2- 172.21.15.50:0/4220707744 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c7754080 0x5621c774d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf03fff640 1 -- 172.21.15.50:0/4220707744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c77500b0 msgr2=0x5621c7752cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf03fff640 1 --2- 172.21.15.50:0/4220707744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c77500b0 0x5621c7752cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf03fff640 1 -- 172.21.15.50:0/4220707744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621c73ac280 con 0x5621c77528f0 2024-09-11T22:14:04.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.446+0000 7fbf03fff640 1 --2- 172.21.15.50:0/4220707744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 0x5621c7798090 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbef4088700 tx=0x7fbef4001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0fd49e5461554d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.447+0000 7fbee9ffb640 1 -- 172.21.15.50:0/4220707744 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef408a070 con 0x5621c77528f0 2024-09-11T22:14:04.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.447+0000 7fbee9ffb640 1 -- 172.21.15.50:0/4220707744 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef40568c0 con 0x5621c77528f0 2024-09-11T22:14:04.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.447+0000 7fbee9ffb640 1 -- 172.21.15.50:0/4220707744 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4088b60 con 0x5621c77528f0 2024-09-11T22:14:04.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.447+0000 7fbf0d280740 1 -- 172.21.15.50:0/4220707744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 msgr2=0x5621c7798090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.447+0000 7fbf0d280740 1 --2- 172.21.15.50:0/4220707744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 0x5621c7798090 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbef4088700 tx=0x7fbef4001150 comp rx=0 tx=0).stop 2024-09-11T22:14:04.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.447+0000 7fbf0d280740 1 -- 172.21.15.50:0/4220707744 shutdown_connections 2024-09-11T22:14:04.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.447+0000 7fbf0d280740 1 --2- 172.21.15.50:0/4220707744 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c7754080 0x5621c774d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.447+0000 7fbf0d280740 1 --2- 172.21.15.50:0/4220707744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c77500b0 0x5621c7752cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.447+0000 7fbf0d280740 1 --2- 172.21.15.50:0/4220707744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 0x5621c7798090 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.447+0000 7fbf0d280740 1 -- 172.21.15.50:0/4220707744 >> 172.21.15.50:0/4220707744 conn(0x5621c774f340 msgr2=0x5621c7797560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.447+0000 7fbf0d280740 1 -- 172.21.15.50:0/4220707744 shutdown_connections 2024-09-11T22:14:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.447+0000 7fbf0d280740 1 -- 172.21.15.50:0/4220707744 wait complete. 2024-09-11T22:14:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.448+0000 7fbf0d280740 1 -- start start 2024-09-11T22:14:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.448+0000 7fbf0d280740 1 Processor -- start 2024-09-11T22:14:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf0d280740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c77528f0 0x5621c7760ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf0d280740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c7754080 0x5621c777d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf0d280740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c774d150 0x5621c774d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf0d280740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5621c774e7e0 con 0x5621c774d150 2024-09-11T22:14:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf0d280740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5621c763e500 con 0x5621c7754080 2024-09-11T22:14:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf0d280740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5621c77988c0 con 0x5621c77528f0 2024-09-11T22:14:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf0d280740 10 client.0 _ll_register_callbacks cb 0x5621c73c7a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf08a83640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c774d150 0x5621c774d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf08a83640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c774d150 0x5621c774d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37098/0 (socket says 172.21.15.50:37098) 2024-09-11T22:14:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf08a83640 1 -- 172.21.15.50:0/1517211517 learned_addr learned my addr 172.21.15.50:0/1517211517 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf037fe640 1 --2- 172.21.15.50:0/1517211517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c7754080 0x5621c777d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf03fff640 1 --2- 172.21.15.50:0/1517211517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c77528f0 0x5621c7760ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf08a83640 1 -- 172.21.15.50:0/1517211517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c77528f0 msgr2=0x5621c7760ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf08a83640 1 --2- 172.21.15.50:0/1517211517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c77528f0 0x5621c7760ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf08a83640 1 -- 172.21.15.50:0/1517211517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c7754080 msgr2=0x5621c777d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf08a83640 1 --2- 172.21.15.50:0/1517211517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c7754080 0x5621c777d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.449+0000 7fbf08a83640 1 -- 172.21.15.50:0/1517211517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621c7494690 con 0x5621c774d150 2024-09-11T22:14:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbf08a83640 1 --2- 172.21.15.50:0/1517211517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c774d150 0x5621c774d5d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009eb0 tx=0x7fbefc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf3b773ff562327 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbee2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbee2ffd640 1 -- 172.21.15.50:0/1517211517 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc009450 con 0x5621c774d150 2024-09-11T22:14:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbee2ffd640 1 -- 172.21.15.50:0/1517211517 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fbefc03c420 con 0x5621c774d150 2024-09-11T22:14:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbf0d280740 1 -- 172.21.15.50:0/1517211517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbef40568c0 con 0x5621c774d150 2024-09-11T22:14:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbee2ffd640 1 -- 172.21.15.50:0/1517211517 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fbefc050050 con 0x5621c774d150 2024-09-11T22:14:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbf0d280740 10 client.5832 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbf0d280740 1 -- 172.21.15.50:0/1517211517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5621c74f4e20 con 0x5621c774d150 2024-09-11T22:14:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbee2ffd640 1 -- 172.21.15.50:0/1517211517 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef40568c0 con 0x5621c774d150 2024-09-11T22:14:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbee2ffd640 1 -- 172.21.15.50:0/1517211517 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fbefc053020 con 0x5621c774d150 2024-09-11T22:14:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbf0d280740 10 client.5832 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbf0d280740 10 client.5832 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbf0d280740 20 client.5832 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:04.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbf0d280740 1 --2- 172.21.15.50:0/1517211517 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5621c7774b50 0x5621c7771d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbf0d280740 4 client.5832 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:04.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbf0d280740 1 -- 172.21.15.50:0/1517211517 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621c76c3140 con 0x5621c7774b50 2024-09-11T22:14:04.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.450+0000 7fbf03fff640 1 --2- 172.21.15.50:0/1517211517 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5621c7774b50 0x5621c7771d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbf03fff640 1 --2- 172.21.15.50:0/1517211517 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5621c7774b50 0x5621c7771d20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3af9c6a4dcda9a7d server_cookie=4de90045c07efb1a in_seq=0 out_seq=0 2024-09-11T22:14:04.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbee2ffd640 10 client.5832 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbee2ffd640 1 -- 172.21.15.50:0/1517211517 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5621c76c3140 con 0x5621c7774b50 2024-09-11T22:14:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbee2ffd640 10 client.5832 handle_command_reply: tid=0 2024-09-11T22:14:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbf0d280740 1 client.5832 shutdown 2024-09-11T22:14:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbf0d280740 1 -- 172.21.15.50:0/1517211517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c774d150 msgr2=0x5621c774d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbf0d280740 1 --2- 172.21.15.50:0/1517211517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c774d150 0x5621c774d5d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009eb0 tx=0x7fbefc004ab0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbf0d280740 1 -- 172.21.15.50:0/1517211517 shutdown_connections 2024-09-11T22:14:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbf0d280740 1 --2- 172.21.15.50:0/1517211517 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5621c7774b50 0x5621c7771d20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbf0d280740 1 --2- 172.21.15.50:0/1517211517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c774d150 0x5621c774d5d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbf0d280740 1 --2- 172.21.15.50:0/1517211517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c7754080 0x5621c777d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbf0d280740 1 --2- 172.21.15.50:0/1517211517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c77528f0 0x5621c7760ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbee2ffd640 0 client.5832 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.451+0000 7fbf0d280740 1 -- 172.21.15.50:0/1517211517 >> 172.21.15.50:0/1517211517 conn(0x5621c77500b0 msgr2=0x5621c7796b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.452+0000 7fbf0d280740 1 -- 172.21.15.50:0/1517211517 shutdown_connections 2024-09-11T22:14:04.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.452+0000 7fbf0d280740 1 -- 172.21.15.50:0/1517211517 wait complete. 2024-09-11T22:14:04.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.452+0000 7fbf0d280740 20 client.5832 trim_cache size 0 max 16384 2024-09-11T22:14:04.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.469+0000 7fbf0d280740 1 Processor -- start 2024-09-11T22:14:04.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.469+0000 7fbf0d280740 1 -- start start 2024-09-11T22:14:04.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf0d280740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c774d150 0x5621c7772420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf0d280740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c77528f0 0x5621c77957d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf0d280740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c7754080 0x5621c77bb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf0d280740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbf04200ce0 con 0x5621c7754080 2024-09-11T22:14:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf0d280740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041ffd80 con 0x5621c77528f0 2024-09-11T22:14:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf0d280740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0415c9b0 con 0x5621c774d150 2024-09-11T22:14:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf08a83640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c7754080 0x5621c77bb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf08a83640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c7754080 0x5621c77bb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37112/0 (socket says 172.21.15.50:37112) 2024-09-11T22:14:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf08a83640 1 -- 172.21.15.50:0/1828717362 learned_addr learned my addr 172.21.15.50:0/1828717362 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf037fe640 1 --2- 172.21.15.50:0/1828717362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c77528f0 0x5621c77957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf03fff640 1 --2- 172.21.15.50:0/1828717362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c774d150 0x5621c7772420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf08a83640 1 -- 172.21.15.50:0/1828717362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c774d150 msgr2=0x5621c7772420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf08a83640 1 --2- 172.21.15.50:0/1828717362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c774d150 0x5621c7772420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf08a83640 1 -- 172.21.15.50:0/1828717362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c77528f0 msgr2=0x5621c77957d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf08a83640 1 --2- 172.21.15.50:0/1828717362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c77528f0 0x5621c77957d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf08a83640 1 -- 172.21.15.50:0/1828717362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621c7387f80 con 0x5621c7754080 2024-09-11T22:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf037fe640 1 --2- 172.21.15.50:0/1828717362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c77528f0 0x5621c77957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf03fff640 1 --2- 172.21.15.50:0/1828717362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c774d150 0x5621c7772420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbf08a83640 1 --2- 172.21.15.50:0/1828717362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c7754080 0x5621c77bb660 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009bd0 tx=0x7fbefc042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38a269bb7b41483 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbee97fa640 1 -- 172.21.15.50:0/1828717362 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc040030 con 0x5621c7754080 2024-09-11T22:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbee97fa640 1 -- 172.21.15.50:0/1828717362 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbefc003b90 con 0x5621c7754080 2024-09-11T22:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.470+0000 7fbee97fa640 1 -- 172.21.15.50:0/1828717362 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc004020 con 0x5621c7754080 2024-09-11T22:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.471+0000 7fbf0d280740 1 -- 172.21.15.50:0/1828717362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c7754080 msgr2=0x5621c77bb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.471+0000 7fbf0d280740 1 --2- 172.21.15.50:0/1828717362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c7754080 0x5621c77bb660 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009bd0 tx=0x7fbefc042000 comp rx=0 tx=0).stop 2024-09-11T22:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.471+0000 7fbf0d280740 1 -- 172.21.15.50:0/1828717362 shutdown_connections 2024-09-11T22:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.471+0000 7fbf0d280740 1 --2- 172.21.15.50:0/1828717362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c7754080 0x5621c77bb660 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.471+0000 7fbf0d280740 1 --2- 172.21.15.50:0/1828717362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c77528f0 0x5621c77957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.471+0000 7fbf0d280740 1 --2- 172.21.15.50:0/1828717362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c774d150 0x5621c7772420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.471+0000 7fbf0d280740 1 -- 172.21.15.50:0/1828717362 >> 172.21.15.50:0/1828717362 conn(0x5621c77500b0 msgr2=0x5621c777ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.471+0000 7fbf0d280740 1 -- 172.21.15.50:0/1828717362 shutdown_connections 2024-09-11T22:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.471+0000 7fbf0d280740 1 -- 172.21.15.50:0/1828717362 wait complete. 2024-09-11T22:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.472+0000 7fbf0d280740 1 -- start start 2024-09-11T22:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.472+0000 7fbf0d280740 1 Processor -- start 2024-09-11T22:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.472+0000 7fbf0d280740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c774d150 0x5621c77a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.472+0000 7fbf0d280740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 0x5621c7779890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf0d280740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c7754080 0x5621c7815100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf0d280740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041ff800 con 0x5621c77528f0 2024-09-11T22:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf0d280740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5621c774dbf0 con 0x5621c7754080 2024-09-11T22:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf0d280740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5621c77aa600 con 0x5621c774d150 2024-09-11T22:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf0d280740 10 client.0 _ll_register_callbacks cb 0x7fbefc009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 0x5621c7779890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 0x5621c7779890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37118/0 (socket says 172.21.15.50:37118) 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf037fe640 1 -- 172.21.15.50:0/3687687512 learned_addr learned my addr 172.21.15.50:0/3687687512 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf03fff640 1 --2- 172.21.15.50:0/3687687512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c774d150 0x5621c77a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf08a83640 1 --2- 172.21.15.50:0/3687687512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c7754080 0x5621c7815100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf037fe640 1 -- 172.21.15.50:0/3687687512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c774d150 msgr2=0x5621c77a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf037fe640 1 --2- 172.21.15.50:0/3687687512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c774d150 0x5621c77a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf037fe640 1 -- 172.21.15.50:0/3687687512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c7754080 msgr2=0x5621c7815100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf037fe640 1 --2- 172.21.15.50:0/3687687512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c7754080 0x5621c7815100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf037fe640 1 -- 172.21.15.50:0/3687687512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621c7797560 con 0x5621c77528f0 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf037fe640 1 --2- 172.21.15.50:0/3687687512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 0x5621c7779890 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbf041f7410 tx=0x7fbef8001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7153a9a391ff7040 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbee2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbee2ffd640 1 -- 172.21.15.50:0/3687687512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8005a60 con 0x5621c77528f0 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbee2ffd640 1 -- 172.21.15.50:0/3687687512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fbef8010040 con 0x5621c77528f0 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf0d280740 1 -- 172.21.15.50:0/3687687512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbefc003b90 con 0x5621c77528f0 2024-09-11T22:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbee2ffd640 1 -- 172.21.15.50:0/3687687512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fbef8027020 con 0x5621c77528f0 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf0d280740 10 client.5838 fetch_fsmap learned FSMap version 23 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.473+0000 7fbf0d280740 1 -- 172.21.15.50:0/3687687512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x5621c77aa3a0 con 0x5621c77528f0 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.474+0000 7fbee2ffd640 1 -- 172.21.15.50:0/3687687512 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbefc003b90 con 0x5621c77528f0 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.474+0000 7fbee2ffd640 1 -- 172.21.15.50:0/3687687512 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fbef8020040 con 0x5621c77528f0 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.474+0000 7fbf0d280740 10 client.5838 fetch_fsmap finished waiting for FSMap version 23 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.474+0000 7fbf0d280740 10 client.5838 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.474+0000 7fbf0d280740 20 client.5838 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.474+0000 7fbf0d280740 1 --2- 172.21.15.50:0/3687687512 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5621c7793f20 0x5621c7794300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.474+0000 7fbf0d280740 4 client.5838 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.474+0000 7fbf0d280740 1 -- 172.21.15.50:0/3687687512 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x5621c7796900 con 0x5621c7793f20 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.474+0000 7fbf03fff640 1 --2- 172.21.15.50:0/3687687512 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5621c7793f20 0x5621c7794300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.474+0000 7fbee2ffd640 10 client.5838 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.474+0000 7fbf03fff640 1 --2- 172.21.15.50:0/3687687512 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5621c7793f20 0x5621c7794300 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a5647a063998b37 server_cookie=94ac5320a85c0cf0 in_seq=0 out_seq=0 2024-09-11T22:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbee2ffd640 1 -- 172.21.15.50:0/3687687512 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5621c7796900 con 0x5621c7793f20 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbee2ffd640 10 client.5838 handle_command_reply: tid=0 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbf0d280740 1 client.5838 shutdown 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbf0d280740 1 -- 172.21.15.50:0/3687687512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 msgr2=0x5621c7779890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbf0d280740 1 --2- 172.21.15.50:0/3687687512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 0x5621c7779890 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbf041f7410 tx=0x7fbef8001150 comp rx=0 tx=0).stop 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbf0d280740 1 -- 172.21.15.50:0/3687687512 shutdown_connections 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbf0d280740 1 --2- 172.21.15.50:0/3687687512 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5621c7793f20 0x5621c7794300 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbf0d280740 1 --2- 172.21.15.50:0/3687687512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5621c7754080 0x5621c7815100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbf0d280740 1 --2- 172.21.15.50:0/3687687512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621c77528f0 0x5621c7779890 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbf0d280740 1 --2- 172.21.15.50:0/3687687512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5621c774d150 0x5621c77a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbee2ffd640 0 client.5838 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbf0d280740 1 -- 172.21.15.50:0/3687687512 >> 172.21.15.50:0/3687687512 conn(0x5621c77500b0 msgr2=0x5621c77957d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbf0d280740 1 -- 172.21.15.50:0/3687687512 shutdown_connections 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbf0d280740 1 -- 172.21.15.50:0/3687687512 wait complete. 2024-09-11T22:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.475+0000 7fbf0d280740 20 client.5838 trim_cache size 0 max 16384 2024-09-11T22:14:04.484 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:04.484 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:14:04.484 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "442afacb-9e22-4dc8-95ba-f116cc15519f", 2024-09-11T22:14:04.484 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:14:04.484 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:04.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.476+0000 7fbf0a4e6640 1 -- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbef006be30 msgr2=0x7fbef006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.476+0000 7fbf0a4e6640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbef006be30 0x7fbef006e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbf040cef20 tx=0x7fbef8007d30 comp rx=0 tx=0).stop 2024-09-11T22:14:04.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.476+0000 7fbf0a4e6640 1 -- 172.21.15.50:0/2287847338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0406e0f0 msgr2=0x7fbf041f74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.476+0000 7fbf0a4e6640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0406e0f0 0x7fbf041f74b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbef400c430 tx=0x7fbef400c8f0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.476+0000 7fbf0a4e6640 1 -- 172.21.15.50:0/2287847338 shutdown_connections 2024-09-11T22:14:04.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.476+0000 7fbf0a4e6640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbef006be30 0x7fbef006e2f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.476+0000 7fbf0a4e6640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf0415b400 0x7fbf040ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.476+0000 7fbf0a4e6640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf04072e60 0x7fbf0414e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.476+0000 7fbf0a4e6640 1 --2- 172.21.15.50:0/2287847338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf0406e0f0 0x7fbf041f74b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.476+0000 7fbf0a4e6640 1 -- 172.21.15.50:0/2287847338 >> 172.21.15.50:0/2287847338 conn(0x7fbf040679c0 msgr2=0x7fbf040cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.476+0000 7fbf0a4e6640 1 -- 172.21.15.50:0/2287847338 shutdown_connections 2024-09-11T22:14:04.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.476+0000 7fbf0a4e6640 1 -- 172.21.15.50:0/2287847338 wait complete. 2024-09-11T22:14:04.487 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '442afacb-9e22-4dc8-95ba-f116cc15519f', 'mode': 'asynchronous'}' 2024-09-11T22:14:04.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:04.488 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-09-11T22:14:04.501 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:14:04.500+0000 7f2a0e0d5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-11T22:14:04.505 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-09-11T22:14:04.505 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-09-11T22:14:04.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.649+0000 7f4e98b6d640 1 Processor -- start 2024-09-11T22:14:04.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.649+0000 7f4e98b6d640 1 -- start start 2024-09-11T22:14:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.650+0000 7f4e98b6d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4e9415e870 0x7f4e940d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.650+0000 7f4e98b6d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e940cfa80 con 0x7f4e940d3c00 2024-09-11T22:14:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.650+0000 7f4e98b6d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e940d40d0 con 0x7f4e940d16d0 2024-09-11T22:14:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.650+0000 7f4e98b6d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4e940d1b40 con 0x7f4e9415e870 2024-09-11T22:14:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.650+0000 7f4e92d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4e940d3c00 0x7f4e940b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36352/0 (socket says 172.21.15.50:36352) 2024-09-11T22:14:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.650+0000 7f4e92d9d640 1 -- 172.21.15.50:0/2765793647 learned_addr learned my addr 172.21.15.50:0/2765793647 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.651+0000 7f4e9259c640 1 --2- 172.21.15.50:0/2765793647 >> v2:172.21.15.77:3300/0 conn(0x7f4e9415e870 0x7f4e940d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.651+0000 7f4e9159a640 1 -- 172.21.15.50:0/2765793647 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4035686764 0 0) 0x7f4e84001490 con 0x7f4e940d3c00 2024-09-11T22:14:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.651+0000 7f4e9159a640 1 -- 172.21.15.50:0/2765793647 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e80003520 con 0x7f4e940d3c00 2024-09-11T22:14:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.651+0000 7f4e9259c640 1 -- 172.21.15.50:0/2765793647 >> v1:172.21.15.77:6789/0 conn(0x7f4e940d16d0 legacy=0x7f4e940d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.651+0000 7f4e9159a640 1 -- 172.21.15.50:0/2765793647 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 462194746 0 0) 0x7f4e80003520 con 0x7f4e940d3c00 2024-09-11T22:14:04.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.651+0000 7f4e9259c640 1 -- 172.21.15.50:0/2765793647 >> v1:172.21.15.50:6789/0 conn(0x7f4e940d3c00 legacy=0x7f4e940b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.651+0000 7f4e9259c640 1 -- 172.21.15.50:0/2765793647 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e940d43b0 con 0x7f4e9415e870 2024-09-11T22:14:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.652+0000 7f4e9259c640 1 --2- 172.21.15.50:0/2765793647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e9415e870 0x7f4e940d1190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0097a0 tx=0x7f4e8c02a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af9abdbc71d50f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.652+0000 7f4e9159a640 1 -- 172.21.15.50:0/2765793647 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c037070 con 0x7f4e9415e870 2024-09-11T22:14:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.652+0000 7f4e9159a640 1 -- 172.21.15.50:0/2765793647 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8c02ab60 con 0x7f4e9415e870 2024-09-11T22:14:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.652+0000 7f4e9159a640 1 -- 172.21.15.50:0/2765793647 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84001bc0 con 0x7f4e9415e870 2024-09-11T22:14:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.652+0000 7f4e98b6d640 1 -- 172.21.15.50:0/2765793647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e9415e870 msgr2=0x7f4e940d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.653+0000 7f4e98b6d640 1 --2- 172.21.15.50:0/2765793647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e9415e870 0x7f4e940d1190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0097a0 tx=0x7f4e8c02a0d0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.653+0000 7f4e98b6d640 1 -- 172.21.15.50:0/2765793647 shutdown_connections 2024-09-11T22:14:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.653+0000 7f4e98b6d640 1 --2- 172.21.15.50:0/2765793647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e9415e870 0x7f4e940d1190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.653+0000 7f4e98b6d640 1 -- 172.21.15.50:0/2765793647 >> 172.21.15.50:0/2765793647 conn(0x7f4e940727a0 msgr2=0x7f4e940679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.653+0000 7f4e98b6d640 1 -- 172.21.15.50:0/2765793647 shutdown_connections 2024-09-11T22:14:04.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.653+0000 7f4e98b6d640 1 -- 172.21.15.50:0/2765793647 wait complete. 2024-09-11T22:14:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.654+0000 7f4e98b6d640 1 Processor -- start 2024-09-11T22:14:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.654+0000 7f4e98b6d640 1 -- start start 2024-09-11T22:14:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e98b6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e940d16d0 0x7f4e941545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e98b6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e940d3c00 0x7f4e940cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e98b6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e9415e870 0x7f4e940cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e98b6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9415ec50 con 0x7f4e940d3c00 2024-09-11T22:14:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e98b6d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e940b7ee0 con 0x7f4e9415e870 2024-09-11T22:14:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e98b6d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e940b78b0 con 0x7f4e940d16d0 2024-09-11T22:14:04.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e91d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e940d3c00 0x7f4e940cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e91d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e940d3c00 0x7f4e940cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37120/0 (socket says 172.21.15.50:37120) 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e91d9b640 1 -- 172.21.15.50:0/403590539 learned_addr learned my addr 172.21.15.50:0/403590539 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e9259c640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e940d16d0 0x7f4e941545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e92d9d640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e9415e870 0x7f4e940cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e91d9b640 1 -- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e940d16d0 msgr2=0x7f4e941545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e91d9b640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e940d16d0 0x7f4e941545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e91d9b640 1 -- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e9415e870 msgr2=0x7f4e940cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e91d9b640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e9415e870 0x7f4e940cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e91d9b640 1 -- 172.21.15.50:0/403590539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e940cce20 con 0x7f4e940d3c00 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e92d9d640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e9415e870 0x7f4e940cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e9259c640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e940d16d0 0x7f4e941545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e91d9b640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e940d3c00 0x7f4e940cc260 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00c780 tx=0x7f4e7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.655+0000 7f4e8affd640 1 -- 172.21.15.50:0/403590539 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c017070 con 0x7f4e940d3c00 2024-09-11T22:14:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.656+0000 7f4e98b6d640 1 -- 172.21.15.50:0/403590539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e940cd100 con 0x7f4e940d3c00 2024-09-11T22:14:04.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.656+0000 7f4e8affd640 1 -- 172.21.15.50:0/403590539 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c005270 con 0x7f4e940d3c00 2024-09-11T22:14:04.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.656+0000 7f4e8affd640 1 -- 172.21.15.50:0/403590539 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00a640 con 0x7f4e940d3c00 2024-09-11T22:14:04.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.656+0000 7f4e98b6d640 1 -- 172.21.15.50:0/403590539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e94154ae0 con 0x7f4e940d3c00 2024-09-11T22:14:04.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.657+0000 7f4e8affd640 1 -- 172.21.15.50:0/403590539 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e7c01a070 con 0x7f4e940d3c00 2024-09-11T22:14:04.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.658+0000 7f4e8affd640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e7406be30 0x7f4e7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.658+0000 7f4e8affd640 1 -- 172.21.15.50:0/403590539 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f4e7c08a450 con 0x7f4e940d3c00 2024-09-11T22:14:04.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.658+0000 7f4e9259c640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e7406be30 0x7f4e7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.658+0000 7f4e9259c640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e7406be30 0x7f4e7406e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c034000 tx=0x7f4e8c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.659+0000 7f4e9b9e9740 1 Processor -- start 2024-09-11T22:14:04.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.659+0000 7f4e9b9e9740 1 -- start start 2024-09-11T22:14:04.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.659+0000 7f4e9b9e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893a7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.659+0000 7f4e9b9e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a2ee0 0x55a5893a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.659+0000 7f4e9b9e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893a4fa0 0x55a5893a2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.659+0000 7f4e9b9e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a58930a710 con 0x55a5893a77e0 2024-09-11T22:14:04.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.659+0000 7f4e9b9e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a5892b2540 con 0x55a5893a2ee0 2024-09-11T22:14:04.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.659+0000 7f4e9b9e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a5893066d0 con 0x55a5893a4fa0 2024-09-11T22:14:04.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e9259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893a7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e9259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893a7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37132/0 (socket says 172.21.15.50:37132) 2024-09-11T22:14:04.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e9259c640 1 -- 172.21.15.50:0/1145110487 learned_addr learned my addr 172.21.15.50:0/1145110487 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e91d9b640 1 --2- 172.21.15.50:0/1145110487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a2ee0 0x55a5893a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e92d9d640 1 --2- 172.21.15.50:0/1145110487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893a4fa0 0x55a5893a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e9259c640 1 -- 172.21.15.50:0/1145110487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893a4fa0 msgr2=0x55a5893a2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e9259c640 1 --2- 172.21.15.50:0/1145110487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893a4fa0 0x55a5893a2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e9259c640 1 -- 172.21.15.50:0/1145110487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a2ee0 msgr2=0x55a5893a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e9259c640 1 --2- 172.21.15.50:0/1145110487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a2ee0 0x55a5893a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e9259c640 1 -- 172.21.15.50:0/1145110487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5892d8170 con 0x55a5893a77e0 2024-09-11T22:14:04.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e92d9d640 1 --2- 172.21.15.50:0/1145110487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893a4fa0 0x55a5893a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:04.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e9259c640 1 --2- 172.21.15.50:0/1145110487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893a7bc0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c02a110 tx=0x7f4e8c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d706c4889ead37e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e73fff640 1 -- 172.21.15.50:0/1145110487 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c04e070 con 0x55a5893a77e0 2024-09-11T22:14:04.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e73fff640 1 -- 172.21.15.50:0/1145110487 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8c03c9a0 con 0x55a5893a77e0 2024-09-11T22:14:04.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.660+0000 7f4e73fff640 1 -- 172.21.15.50:0/1145110487 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c037040 con 0x55a5893a77e0 2024-09-11T22:14:04.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.661+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/1145110487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 msgr2=0x55a5893a7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.661+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/1145110487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893a7bc0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c02a110 tx=0x7f4e8c02c000 comp rx=0 tx=0).stop 2024-09-11T22:14:04.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.661+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/1145110487 shutdown_connections 2024-09-11T22:14:04.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.661+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/1145110487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893a4fa0 0x55a5893a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.661+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/1145110487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a2ee0 0x55a5893a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.661+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/1145110487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893a7bc0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.661+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/1145110487 >> 172.21.15.50:0/1145110487 conn(0x55a5893a3fa0 msgr2=0x55a5893ec660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.661+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/1145110487 shutdown_connections 2024-09-11T22:14:04.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.661+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/1145110487 wait complete. 2024-09-11T22:14:04.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.662+0000 7f4e9b9e9740 1 -- start start 2024-09-11T22:14:04.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.662+0000 7f4e9b9e9740 1 Processor -- start 2024-09-11T22:14:04.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.662+0000 7f4e9b9e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893a4fa0 0x55a5893e53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.662+0000 7f4e9b9e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a77e0 0x55a5893d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e9b9e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893e4380 0x55a5893e47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e9b9e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a5893d2070 con 0x55a5893e4380 2024-09-11T22:14:04.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e9b9e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a589293660 con 0x55a5893a77e0 2024-09-11T22:14:04.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e9b9e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a5893ecd70 con 0x55a5893a4fa0 2024-09-11T22:14:04.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e9b9e9740 10 client.0 _ll_register_callbacks cb 0x55a58901cfa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:04.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e92d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893e4380 0x55a5893e47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e92d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893e4380 0x55a5893e47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37144/0 (socket says 172.21.15.50:37144) 2024-09-11T22:14:04.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e9259c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893a4fa0 0x55a5893e53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e92d9d640 1 -- 172.21.15.50:0/3651838463 learned_addr learned my addr 172.21.15.50:0/3651838463 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e91d9b640 1 --2- 172.21.15.50:0/3651838463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a77e0 0x55a5893d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e92d9d640 1 -- 172.21.15.50:0/3651838463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893a4fa0 msgr2=0x55a5893e53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e92d9d640 1 --2- 172.21.15.50:0/3651838463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893a4fa0 0x55a5893e53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e92d9d640 1 -- 172.21.15.50:0/3651838463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a77e0 msgr2=0x55a5893d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e92d9d640 1 --2- 172.21.15.50:0/3651838463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a77e0 0x55a5893d0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e92d9d640 1 -- 172.21.15.50:0/3651838463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a58901d7b0 con 0x55a5893e4380 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e92d9d640 1 --2- 172.21.15.50:0/3651838463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893e4380 0x55a5893e47e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4e840070d0 tx=0x7f4e840074d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e3d29c12a41198 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e717fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e717fa640 1 -- 172.21.15.50:0/3651838463 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8401a060 con 0x55a5893e4380 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e717fa640 1 -- 172.21.15.50:0/3651838463 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f4e84004d70 con 0x55a5893e4380 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3651838463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e8c03c9a0 con 0x55a5893e4380 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e717fa640 1 -- 172.21.15.50:0/3651838463 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4e84005050 con 0x55a5893e4380 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e9b9e9740 10 client.5850 fetch_fsmap learned FSMap version 24 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.663+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3651838463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55a5890e7b90 con 0x55a5893e4380 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.664+0000 7f4e717fa640 1 -- 172.21.15.50:0/3651838463 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8c03c9a0 con 0x55a5893e4380 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.664+0000 7f4e717fa640 1 -- 172.21.15.50:0/3651838463 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f4e840051f0 con 0x55a5893e4380 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.664+0000 7f4e9b9e9740 10 client.5850 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.664+0000 7f4e9b9e9740 10 client.5850 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:04.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.664+0000 7f4e9b9e9740 20 client.5850 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.664+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/3651838463 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a5893e96d0 0x55a589400550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.664+0000 7f4e9b9e9740 4 client.5850 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.664+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3651838463 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a589317e40 con 0x55a5893e96d0 2024-09-11T22:14:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.664+0000 7f4e9259c640 1 --2- 172.21.15.50:0/3651838463 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a5893e96d0 0x55a589400550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.664+0000 7f4e717fa640 10 client.5850 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.664+0000 7f4e9259c640 1 --2- 172.21.15.50:0/3651838463 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a5893e96d0 0x55a589400550 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=784e596bde69e0de server_cookie=6d013eff259a6ac4 in_seq=0 out_seq=0 2024-09-11T22:14:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e717fa640 1 -- 172.21.15.50:0/3651838463 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a589317e40 con 0x55a5893e96d0 2024-09-11T22:14:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e717fa640 10 client.5850 handle_command_reply: tid=0 2024-09-11T22:14:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e9b9e9740 1 client.5850 shutdown 2024-09-11T22:14:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3651838463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893e4380 msgr2=0x55a5893e47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/3651838463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893e4380 0x55a5893e47e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4e840070d0 tx=0x7f4e840074d0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3651838463 shutdown_connections 2024-09-11T22:14:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/3651838463 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a5893e96d0 0x55a589400550 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/3651838463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893e4380 0x55a5893e47e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/3651838463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a77e0 0x55a5893d0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e717fa640 0 client.5850 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/3651838463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893a4fa0 0x55a5893e53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3651838463 >> 172.21.15.50:0/3651838463 conn(0x55a5893a2ee0 msgr2=0x55a5893ed290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3651838463 shutdown_connections 2024-09-11T22:14:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3651838463 wait complete. 2024-09-11T22:14:04.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.665+0000 7f4e9b9e9740 20 client.5850 trim_cache size 0 max 16384 2024-09-11T22:14:04.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.680+0000 7f4e9b9e9740 1 Processor -- start 2024-09-11T22:14:04.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.680+0000 7f4e9b9e9740 1 -- start start 2024-09-11T22:14:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.680+0000 7f4e9b9e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a4fa0 0x55a5893e38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.680+0000 7f4e9b9e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893ec270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e9b9e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893e4380 0x55a5893ec7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e9b9e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e94200d00 con 0x55a5893a77e0 2024-09-11T22:14:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e9b9e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e940c9e30 con 0x55a5893a4fa0 2024-09-11T22:14:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e9b9e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e941f8940 con 0x55a5893e4380 2024-09-11T22:14:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e91d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893ec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e91d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893ec270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37156/0 (socket says 172.21.15.50:37156) 2024-09-11T22:14:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e91d9b640 1 -- 172.21.15.50:0/2460746205 learned_addr learned my addr 172.21.15.50:0/2460746205 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e9259c640 1 --2- 172.21.15.50:0/2460746205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a4fa0 0x55a5893e38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e92d9d640 1 --2- 172.21.15.50:0/2460746205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893e4380 0x55a5893ec7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e91d9b640 1 -- 172.21.15.50:0/2460746205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893e4380 msgr2=0x55a5893ec7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e91d9b640 1 --2- 172.21.15.50:0/2460746205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893e4380 0x55a5893ec7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e91d9b640 1 -- 172.21.15.50:0/2460746205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a4fa0 msgr2=0x55a5893e38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e91d9b640 1 --2- 172.21.15.50:0/2460746205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a4fa0 0x55a5893e38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e91d9b640 1 -- 172.21.15.50:0/2460746205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5892c2290 con 0x55a5893a77e0 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e91d9b640 1 --2- 172.21.15.50:0/2460746205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893ec270 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c058340 tx=0x7f4e7c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f6fdbcdd3e7ed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e737fe640 1 -- 172.21.15.50:0/2460746205 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c054cb0 con 0x55a5893a77e0 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e737fe640 1 -- 172.21.15.50:0/2460746205 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c08a0b0 con 0x55a5893a77e0 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.681+0000 7f4e737fe640 1 -- 172.21.15.50:0/2460746205 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c054e50 con 0x55a5893a77e0 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.682+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/2460746205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 msgr2=0x55a5893ec270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.682+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/2460746205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893ec270 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c058340 tx=0x7f4e7c014040 comp rx=0 tx=0).stop 2024-09-11T22:14:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.682+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/2460746205 shutdown_connections 2024-09-11T22:14:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.682+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/2460746205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893e4380 0x55a5893ec7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.682+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/2460746205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893ec270 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.682+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/2460746205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a4fa0 0x55a5893e38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.682+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/2460746205 >> 172.21.15.50:0/2460746205 conn(0x55a5893a2ee0 msgr2=0x55a5893cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.682+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/2460746205 shutdown_connections 2024-09-11T22:14:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.682+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/2460746205 wait complete. 2024-09-11T22:14:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.682+0000 7f4e9b9e9740 1 -- start start 2024-09-11T22:14:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.682+0000 7f4e9b9e9740 1 Processor -- start 2024-09-11T22:14:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.683+0000 7f4e9b9e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a4fa0 0x55a5893ba630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.683+0000 7f4e9b9e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893a5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.683+0000 7f4e9b9e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893e4380 0x55a5893a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.683+0000 7f4e9b9e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e940c97e0 con 0x55a5893a77e0 2024-09-11T22:14:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.683+0000 7f4e9b9e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a5893d1f80 con 0x55a5893a4fa0 2024-09-11T22:14:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.683+0000 7f4e9b9e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a589473f70 con 0x55a5893e4380 2024-09-11T22:14:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.683+0000 7f4e9b9e9740 10 client.0 _ll_register_callbacks cb 0x7f4e84005bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e91d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e9259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a4fa0 0x55a5893ba630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e91d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893a5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37166/0 (socket says 172.21.15.50:37166) 2024-09-11T22:14:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e91d9b640 1 -- 172.21.15.50:0/3870655275 learned_addr learned my addr 172.21.15.50:0/3870655275 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e92d9d640 1 --2- 172.21.15.50:0/3870655275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893e4380 0x55a5893a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e91d9b640 1 -- 172.21.15.50:0/3870655275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893e4380 msgr2=0x55a5893a5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e91d9b640 1 --2- 172.21.15.50:0/3870655275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893e4380 0x55a5893a5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e91d9b640 1 -- 172.21.15.50:0/3870655275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a4fa0 msgr2=0x55a5893ba630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e91d9b640 1 --2- 172.21.15.50:0/3870655275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a4fa0 0x55a5893ba630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e91d9b640 1 -- 172.21.15.50:0/3870655275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5893e7080 con 0x55a5893a77e0 2024-09-11T22:14:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e9259c640 1 --2- 172.21.15.50:0/3870655275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a4fa0 0x55a5893ba630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e91d9b640 1 --2- 172.21.15.50:0/3870655275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893a5540 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c058340 tx=0x7f4e7c08a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d86090d1f896ad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e717fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e717fa640 1 -- 172.21.15.50:0/3870655275 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c060f90 con 0x55a5893a77e0 2024-09-11T22:14:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e717fa640 1 -- 172.21.15.50:0/3870655275 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f4e7c05db80 con 0x55a5893a77e0 2024-09-11T22:14:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3870655275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e7c08a0b0 con 0x55a5893a77e0 2024-09-11T22:14:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e717fa640 1 -- 172.21.15.50:0/3870655275 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4e7c08a260 con 0x55a5893a77e0 2024-09-11T22:14:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e9b9e9740 10 client.5856 fetch_fsmap learned FSMap version 24 2024-09-11T22:14:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3870655275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55a5893ec970 con 0x55a5893a77e0 2024-09-11T22:14:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.684+0000 7f4e717fa640 1 -- 172.21.15.50:0/3870655275 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c08a0b0 con 0x55a5893a77e0 2024-09-11T22:14:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.685+0000 7f4e717fa640 1 -- 172.21.15.50:0/3870655275 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f4e7c057a90 con 0x55a5893a77e0 2024-09-11T22:14:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.685+0000 7f4e9b9e9740 10 client.5856 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:14:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.685+0000 7f4e9b9e9740 10 client.5856 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.685+0000 7f4e9b9e9740 20 client.5856 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.685+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/3870655275 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a5893a6120 0x55a589472d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.685+0000 7f4e9b9e9740 4 client.5856 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}] 2024-09-11T22:14:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.685+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3870655275 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}) -- 0x55a5893ef920 con 0x55a5893a6120 2024-09-11T22:14:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.685+0000 7f4e9259c640 1 --2- 172.21.15.50:0/3870655275 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a5893a6120 0x55a589472d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.685+0000 7f4e717fa640 10 client.5856 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.685+0000 7f4e9259c640 1 --2- 172.21.15.50:0/3870655275 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a5893a6120 0x55a589472d30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37c0f0ba58f5c1e6 server_cookie=2e08917bb0ecf2b7 in_seq=0 out_seq=0 2024-09-11T22:14:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e717fa640 1 -- 172.21.15.50:0/3870655275 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a5893ef920 con 0x55a5893a6120 2024-09-11T22:14:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e717fa640 10 client.5856 handle_command_reply: tid=0 2024-09-11T22:14:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e9b9e9740 1 client.5856 shutdown 2024-09-11T22:14:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3870655275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 msgr2=0x55a5893a5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/3870655275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893a5540 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c058340 tx=0x7f4e7c08a040 comp rx=0 tx=0).stop 2024-09-11T22:14:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3870655275 shutdown_connections 2024-09-11T22:14:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/3870655275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a5893e4380 0x55a5893a5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/3870655275 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55a5893a6120 0x55a589472d30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/3870655275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a5893a77e0 0x55a5893a5540 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e717fa640 0 client.5856 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e9b9e9740 1 --2- 172.21.15.50:0/3870655275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5893a4fa0 0x55a5893ba630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3870655275 >> 172.21.15.50:0/3870655275 conn(0x55a5893a2ee0 msgr2=0x55a5893cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3870655275 shutdown_connections 2024-09-11T22:14:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e9b9e9740 1 -- 172.21.15.50:0/3870655275 wait complete. 2024-09-11T22:14:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.690+0000 7f4e9b9e9740 20 client.5856 trim_cache size 0 max 16384 2024-09-11T22:14:04.694 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:04.694 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:14:04.694 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:14:04.694 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.691+0000 7f4e98b6d640 1 -- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e7406be30 msgr2=0x7f4e7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.691+0000 7f4e98b6d640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e7406be30 0x7f4e7406e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c034000 tx=0x7f4e8c02e000 comp rx=0 tx=0).stop 2024-09-11T22:14:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.691+0000 7f4e98b6d640 1 -- 172.21.15.50:0/403590539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e940d3c00 msgr2=0x7f4e940cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.691+0000 7f4e98b6d640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e940d3c00 0x7f4e940cc260 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00c780 tx=0x7f4e7c00cc40 comp rx=0 tx=0).stop 2024-09-11T22:14:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.691+0000 7f4e98b6d640 1 -- 172.21.15.50:0/403590539 shutdown_connections 2024-09-11T22:14:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.691+0000 7f4e98b6d640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e7406be30 0x7f4e7406e2f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.691+0000 7f4e98b6d640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e9415e870 0x7f4e940cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.691+0000 7f4e98b6d640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e940d3c00 0x7f4e940cc260 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.691+0000 7f4e98b6d640 1 --2- 172.21.15.50:0/403590539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e940d16d0 0x7f4e941545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.691+0000 7f4e98b6d640 1 -- 172.21.15.50:0/403590539 >> 172.21.15.50:0/403590539 conn(0x7f4e940727a0 msgr2=0x7f4e941603d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.691+0000 7f4e98b6d640 1 -- 172.21.15.50:0/403590539 shutdown_connections 2024-09-11T22:14:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.691+0000 7f4e98b6d640 1 -- 172.21.15.50:0/403590539 wait complete. 2024-09-11T22:14:04.702 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' returned '{'message': '', 'return_code': 0}' 2024-09-11T22:14:04.703 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:14:04.703 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:04.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:04.719 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-11T22:14:04.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:14:04.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:14:04.783 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730506 s, 144 MB/s 2024-09-11T22:14:04.784 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-11T22:14:04.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-11T22:14:04.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.927+0000 7f825d253640 1 Processor -- start 2024-09-11T22:14:04.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.927+0000 7f825d253640 1 -- start start 2024-09-11T22:14:04.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.928+0000 7f825d253640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f825815c240 0x7f82580b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.928+0000 7f825d253640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f825815c620 con 0x7f82580728e0 2024-09-11T22:14:04.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.928+0000 7f825d253640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f825815f2b0 con 0x7f82580735a0 2024-09-11T22:14:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.928+0000 7f825d253640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f825815f560 con 0x7f825815c240 2024-09-11T22:14:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.928+0000 7f8256d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f825815c240 0x7f82580b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.928+0000 7f8256d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f825815c240 0x7f82580b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37172/0 (socket says 172.21.15.50:37172) 2024-09-11T22:14:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.928+0000 7f8256d9d640 1 -- 172.21.15.50:0/157495897 learned_addr learned my addr 172.21.15.50:0/157495897 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.928+0000 7f825759e640 1 --1- 172.21.15.50:0/157495897 >> v1:172.21.15.50:6789/0 conn(0x7f82580728e0 0x7f8258072cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36354/0 (socket says 172.21.15.50:36354) 2024-09-11T22:14:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.929+0000 7f8256d9d640 1 -- 172.21.15.50:0/157495897 >> v1:172.21.15.77:6789/0 conn(0x7f82580735a0 legacy=0x7f825815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.929+0000 7f8256d9d640 1 -- 172.21.15.50:0/157495897 >> v1:172.21.15.50:6789/0 conn(0x7f82580728e0 legacy=0x7f8258072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.929+0000 7f8256d9d640 1 -- 172.21.15.50:0/157495897 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825815f840 con 0x7f825815c240 2024-09-11T22:14:04.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.929+0000 7f8255d9b640 1 -- 172.21.15.50:0/157495897 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755343408 0 0) 0x7f825815c620 con 0x7f82580728e0 2024-09-11T22:14:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.929+0000 7f8256d9d640 1 --2- 172.21.15.50:0/157495897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f825815c240 0x7f82580b4770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8250009870 tx=0x7f825002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2397806ad0824617 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.930+0000 7f8255d9b640 1 -- 172.21.15.50:0/157495897 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250037070 con 0x7f825815c240 2024-09-11T22:14:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.930+0000 7f8255d9b640 1 -- 172.21.15.50:0/157495897 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8250032440 con 0x7f825815c240 2024-09-11T22:14:04.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.930+0000 7f8255d9b640 1 -- 172.21.15.50:0/157495897 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250032810 con 0x7f825815c240 2024-09-11T22:14:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.930+0000 7f825d253640 1 -- 172.21.15.50:0/157495897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f825815c240 msgr2=0x7f82580b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.930+0000 7f825d253640 1 --2- 172.21.15.50:0/157495897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f825815c240 0x7f82580b4770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8250009870 tx=0x7f825002a2a0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.930+0000 7f825d253640 1 -- 172.21.15.50:0/157495897 shutdown_connections 2024-09-11T22:14:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.930+0000 7f825d253640 1 --2- 172.21.15.50:0/157495897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f825815c240 0x7f82580b4770 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.930+0000 7f825d253640 1 -- 172.21.15.50:0/157495897 >> 172.21.15.50:0/157495897 conn(0x7f82580b2bd0 msgr2=0x7f82580b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.930+0000 7f825d253640 1 -- 172.21.15.50:0/157495897 shutdown_connections 2024-09-11T22:14:04.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.930+0000 7f825d253640 1 -- 172.21.15.50:0/157495897 wait complete. 2024-09-11T22:14:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.932+0000 7f825d253640 1 Processor -- start 2024-09-11T22:14:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.932+0000 7f825d253640 1 -- start start 2024-09-11T22:14:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.932+0000 7f825d253640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82580728e0 0x7f82581549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.932+0000 7f825d253640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82580735a0 0x7f82580d0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.932+0000 7f825d253640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f825815c240 0x7f8258161660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.932+0000 7f825d253640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82580b4250 con 0x7f825815c240 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.932+0000 7f825d253640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82580b3f70 con 0x7f82580728e0 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.932+0000 7f825d253640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f82580b4cb0 con 0x7f82580735a0 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f825759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f825815c240 0x7f8258161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f825759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f825815c240 0x7f8258161660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37176/0 (socket says 172.21.15.50:37176) 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f8256d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82580728e0 0x7f82581549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f825759e640 1 -- 172.21.15.50:0/3094583091 learned_addr learned my addr 172.21.15.50:0/3094583091 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f825659c640 1 --2- 172.21.15.50:0/3094583091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82580735a0 0x7f82580d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f825759e640 1 -- 172.21.15.50:0/3094583091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82580735a0 msgr2=0x7f82580d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f825759e640 1 --2- 172.21.15.50:0/3094583091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82580735a0 0x7f82580d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f825759e640 1 -- 172.21.15.50:0/3094583091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82580728e0 msgr2=0x7f82581549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f825759e640 1 --2- 172.21.15.50:0/3094583091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82580728e0 0x7f82581549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f825759e640 1 -- 172.21.15.50:0/3094583091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82580ce430 con 0x7f825815c240 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f825759e640 1 --2- 172.21.15.50:0/3094583091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f825815c240 0x7f8258161660 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f824800c700 tx=0x7f824800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f824f7fe640 1 -- 172.21.15.50:0/3094583091 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8248018070 con 0x7f825815c240 2024-09-11T22:14:04.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f824f7fe640 1 -- 172.21.15.50:0/3094583091 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824800ce10 con 0x7f825815c240 2024-09-11T22:14:04.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f825d253640 1 -- 172.21.15.50:0/3094583091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82580ce710 con 0x7f825815c240 2024-09-11T22:14:04.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f824f7fe640 1 -- 172.21.15.50:0/3094583091 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824800a860 con 0x7f825815c240 2024-09-11T22:14:04.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.933+0000 7f825d253640 1 -- 172.21.15.50:0/3094583091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82580cecd0 con 0x7f825815c240 2024-09-11T22:14:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.935+0000 7f824f7fe640 1 -- 172.21.15.50:0/3094583091 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f824801b070 con 0x7f825815c240 2024-09-11T22:14:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.936+0000 7f824f7fe640 1 --2- 172.21.15.50:0/3094583091 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f823806be60 0x7f823806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.936+0000 7f824f7fe640 1 -- 172.21.15.50:0/3094583091 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f824808a3e0 con 0x7f825815c240 2024-09-11T22:14:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.936+0000 7f8256d9d640 1 --2- 172.21.15.50:0/3094583091 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f823806be60 0x7f823806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.936+0000 7f8256d9d640 1 --2- 172.21.15.50:0/3094583091 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f823806be60 0x7f823806e320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8250034000 tx=0x7f825002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.936+0000 7f825fff1740 1 Processor -- start 2024-09-11T22:14:04.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.937+0000 7f825fff1740 1 -- start start 2024-09-11T22:14:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.937+0000 7f825fff1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 0x55fe26041bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.937+0000 7f825fff1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe2603cee0 0x55fe2603bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.937+0000 7f825fff1740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe2603efa0 0x55fe2603c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.937+0000 7f825fff1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fe25fa4710 con 0x55fe260417e0 2024-09-11T22:14:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.937+0000 7f825fff1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fe25f4c540 con 0x55fe2603cee0 2024-09-11T22:14:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.937+0000 7f825fff1740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fe25fa06d0 con 0x55fe2603efa0 2024-09-11T22:14:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.937+0000 7f8256d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 0x55fe26041bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.937+0000 7f8256d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 0x55fe26041bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37178/0 (socket says 172.21.15.50:37178) 2024-09-11T22:14:04.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.937+0000 7f8256d9d640 1 -- 172.21.15.50:0/2637999067 learned_addr learned my addr 172.21.15.50:0/2637999067 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.938+0000 7f825659c640 1 --2- 172.21.15.50:0/2637999067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe2603cee0 0x55fe2603bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.938+0000 7f825759e640 1 --2- 172.21.15.50:0/2637999067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe2603efa0 0x55fe2603c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.938+0000 7f8256d9d640 1 -- 172.21.15.50:0/2637999067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe2603efa0 msgr2=0x55fe2603c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.938+0000 7f8256d9d640 1 --2- 172.21.15.50:0/2637999067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe2603efa0 0x55fe2603c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.938+0000 7f8256d9d640 1 -- 172.21.15.50:0/2637999067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe2603cee0 msgr2=0x55fe2603bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.938+0000 7f8256d9d640 1 --2- 172.21.15.50:0/2637999067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe2603cee0 0x55fe2603bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.938+0000 7f8256d9d640 1 -- 172.21.15.50:0/2637999067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe25f72170 con 0x55fe260417e0 2024-09-11T22:14:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.938+0000 7f825759e640 1 --2- 172.21.15.50:0/2637999067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe2603efa0 0x55fe2603c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.938+0000 7f8256d9d640 1 --2- 172.21.15.50:0/2637999067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 0x55fe26041bc0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f825002a2e0 tx=0x7f825002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0975b6f1f8d9120 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.938+0000 7f824cff9640 1 -- 172.21.15.50:0/2637999067 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250037040 con 0x55fe260417e0 2024-09-11T22:14:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.938+0000 7f824cff9640 1 -- 172.21.15.50:0/2637999067 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8250032d00 con 0x55fe260417e0 2024-09-11T22:14:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.938+0000 7f824cff9640 1 -- 172.21.15.50:0/2637999067 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250047630 con 0x55fe260417e0 2024-09-11T22:14:04.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.939+0000 7f825fff1740 1 -- 172.21.15.50:0/2637999067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 msgr2=0x55fe26041bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.939+0000 7f825fff1740 1 --2- 172.21.15.50:0/2637999067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 0x55fe26041bc0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f825002a2e0 tx=0x7f825002c000 comp rx=0 tx=0).stop 2024-09-11T22:14:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.939+0000 7f825fff1740 1 -- 172.21.15.50:0/2637999067 shutdown_connections 2024-09-11T22:14:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.939+0000 7f825fff1740 1 --2- 172.21.15.50:0/2637999067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe2603efa0 0x55fe2603c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.939+0000 7f825fff1740 1 --2- 172.21.15.50:0/2637999067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe2603cee0 0x55fe2603bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.939+0000 7f825fff1740 1 --2- 172.21.15.50:0/2637999067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 0x55fe26041bc0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.939+0000 7f825fff1740 1 -- 172.21.15.50:0/2637999067 >> 172.21.15.50:0/2637999067 conn(0x55fe2603dfa0 msgr2=0x55fe26086660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.939+0000 7f825fff1740 1 -- 172.21.15.50:0/2637999067 shutdown_connections 2024-09-11T22:14:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.939+0000 7f825fff1740 1 -- 172.21.15.50:0/2637999067 wait complete. 2024-09-11T22:14:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.939+0000 7f825fff1740 1 -- start start 2024-09-11T22:14:04.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.939+0000 7f825fff1740 1 Processor -- start 2024-09-11T22:14:04.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.940+0000 7f825fff1740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe2603efa0 0x55fe26053c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.940+0000 7f825fff1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 0x55fe2607c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.940+0000 7f825fff1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260803a0 0x55fe26080820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.940+0000 7f825fff1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fe2606c070 con 0x55fe260417e0 2024-09-11T22:14:04.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.940+0000 7f825fff1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fe25f2d660 con 0x55fe260803a0 2024-09-11T22:14:04.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.940+0000 7f825fff1740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fe26086d70 con 0x55fe2603efa0 2024-09-11T22:14:04.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.940+0000 7f825fff1740 10 client.0 _ll_register_callbacks cb 0x55fe25cb6fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:04.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.940+0000 7f825659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 0x55fe2607c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f825659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 0x55fe2607c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37194/0 (socket says 172.21.15.50:37194) 2024-09-11T22:14:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f825659c640 1 -- 172.21.15.50:0/3659131930 learned_addr learned my addr 172.21.15.50:0/3659131930 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f8256d9d640 1 --2- 172.21.15.50:0/3659131930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe2603efa0 0x55fe26053c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f825759e640 1 --2- 172.21.15.50:0/3659131930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260803a0 0x55fe26080820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f825659c640 1 -- 172.21.15.50:0/3659131930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe2603efa0 msgr2=0x55fe26053c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f825659c640 1 --2- 172.21.15.50:0/3659131930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe2603efa0 0x55fe26053c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f825659c640 1 -- 172.21.15.50:0/3659131930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260803a0 msgr2=0x55fe26080820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f825659c640 1 --2- 172.21.15.50:0/3659131930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260803a0 0x55fe26080820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f825659c640 1 -- 172.21.15.50:0/3659131930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe25cb77b0 con 0x55fe260417e0 2024-09-11T22:14:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f825659c640 1 --2- 172.21.15.50:0/3659131930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 0x55fe2607c830 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f82400125a0 tx=0x7f8240012a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb1e969cbe28af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f8235ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f8235ffb640 1 -- 172.21.15.50:0/3659131930 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240019070 con 0x55fe260417e0 2024-09-11T22:14:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f8235ffb640 1 -- 172.21.15.50:0/3659131930 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f8240007320 con 0x55fe260417e0 2024-09-11T22:14:04.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f825fff1740 1 -- 172.21.15.50:0/3659131930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8250032d00 con 0x55fe260417e0 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f8235ffb640 1 -- 172.21.15.50:0/3659131930 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8240023050 con 0x55fe260417e0 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f825fff1740 10 client.5871 fetch_fsmap learned FSMap version 24 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.941+0000 7f825fff1740 1 -- 172.21.15.50:0/3659131930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55fe25d81b90 con 0x55fe260417e0 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.942+0000 7f8235ffb640 1 -- 172.21.15.50:0/3659131930 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8250032d00 con 0x55fe260417e0 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.942+0000 7f8235ffb640 1 -- 172.21.15.50:0/3659131930 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f8240026020 con 0x55fe260417e0 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.942+0000 7f825fff1740 10 client.5871 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.942+0000 7f825fff1740 10 client.5871 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.942+0000 7f825fff1740 20 client.5871 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.942+0000 7f825fff1740 1 --2- 172.21.15.50:0/3659131930 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fe26082a90 0x55fe26082e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.942+0000 7f825fff1740 4 client.5871 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.942+0000 7f825fff1740 1 -- 172.21.15.50:0/3659131930 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe25fb1e40 con 0x55fe26082a90 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.942+0000 7f8256d9d640 1 --2- 172.21.15.50:0/3659131930 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fe26082a90 0x55fe26082e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.942+0000 7f8256d9d640 1 --2- 172.21.15.50:0/3659131930 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fe26082a90 0x55fe26082e90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43e98611a11d01d1 server_cookie=d9caf408cf8e957e in_seq=0 out_seq=0 2024-09-11T22:14:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.942+0000 7f8235ffb640 10 client.5871 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f8235ffb640 1 -- 172.21.15.50:0/3659131930 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe25fb1e40 con 0x55fe26082a90 2024-09-11T22:14:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f8235ffb640 10 client.5871 handle_command_reply: tid=0 2024-09-11T22:14:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f825fff1740 1 client.5871 shutdown 2024-09-11T22:14:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f825fff1740 1 -- 172.21.15.50:0/3659131930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 msgr2=0x55fe2607c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f825fff1740 1 --2- 172.21.15.50:0/3659131930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 0x55fe2607c830 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f82400125a0 tx=0x7f8240012a60 comp rx=0 tx=0).stop 2024-09-11T22:14:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f825fff1740 1 -- 172.21.15.50:0/3659131930 shutdown_connections 2024-09-11T22:14:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f825fff1740 1 --2- 172.21.15.50:0/3659131930 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fe26082a90 0x55fe26082e90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f825fff1740 1 --2- 172.21.15.50:0/3659131930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260803a0 0x55fe26080820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f825fff1740 1 --2- 172.21.15.50:0/3659131930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe260417e0 0x55fe2607c830 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f825fff1740 1 --2- 172.21.15.50:0/3659131930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe2603efa0 0x55fe26053c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f8235ffb640 0 client.5871 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f825fff1740 1 -- 172.21.15.50:0/3659131930 >> 172.21.15.50:0/3659131930 conn(0x55fe2603cee0 msgr2=0x55fe26087290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f825fff1740 1 -- 172.21.15.50:0/3659131930 shutdown_connections 2024-09-11T22:14:04.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f825fff1740 1 -- 172.21.15.50:0/3659131930 wait complete. 2024-09-11T22:14:04.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.943+0000 7f825fff1740 20 client.5871 trim_cache size 0 max 16384 2024-09-11T22:14:04.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.958+0000 7f825fff1740 1 Processor -- start 2024-09-11T22:14:04.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.958+0000 7f825fff1740 1 -- start start 2024-09-11T22:14:04.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f825fff1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 0x55fe2607cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f825fff1740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe260417e0 0x55fe260536e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f825fff1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260803a0 0x55fe26053c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f825fff1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82580acd20 con 0x55fe2603efa0 2024-09-11T22:14:04.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f825fff1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82580abd60 con 0x55fe260803a0 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f825fff1740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8258156a20 con 0x55fe260417e0 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f8256d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 0x55fe2607cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f8256d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 0x55fe2607cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37206/0 (socket says 172.21.15.50:37206) 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f8256d9d640 1 -- 172.21.15.50:0/3610457766 learned_addr learned my addr 172.21.15.50:0/3610457766 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f825759e640 1 --2- 172.21.15.50:0/3610457766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260803a0 0x55fe26053c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f825659c640 1 --2- 172.21.15.50:0/3610457766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe260417e0 0x55fe260536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f8256d9d640 1 -- 172.21.15.50:0/3610457766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe260417e0 msgr2=0x55fe260536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f8256d9d640 1 --2- 172.21.15.50:0/3610457766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe260417e0 0x55fe260536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f8256d9d640 1 -- 172.21.15.50:0/3610457766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260803a0 msgr2=0x55fe26053c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f8256d9d640 1 --2- 172.21.15.50:0/3610457766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260803a0 0x55fe26053c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f8256d9d640 1 -- 172.21.15.50:0/3610457766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe26083da0 con 0x55fe2603efa0 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f825659c640 1 --2- 172.21.15.50:0/3610457766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe260417e0 0x55fe260536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f8256d9d640 1 --2- 172.21.15.50:0/3610457766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 0x55fe2607cc80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8250032d90 tx=0x7f8250009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff1128ed8326301 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f8237fff640 1 -- 172.21.15.50:0/3610457766 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250040040 con 0x55fe2603efa0 2024-09-11T22:14:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f8237fff640 1 -- 172.21.15.50:0/3610457766 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8250066640 con 0x55fe2603efa0 2024-09-11T22:14:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.959+0000 7f8237fff640 1 -- 172.21.15.50:0/3610457766 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250037040 con 0x55fe2603efa0 2024-09-11T22:14:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.960+0000 7f825fff1740 1 -- 172.21.15.50:0/3610457766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 msgr2=0x55fe2607cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.960+0000 7f825fff1740 1 --2- 172.21.15.50:0/3610457766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 0x55fe2607cc80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8250032d90 tx=0x7f8250009240 comp rx=0 tx=0).stop 2024-09-11T22:14:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.960+0000 7f825fff1740 1 -- 172.21.15.50:0/3610457766 shutdown_connections 2024-09-11T22:14:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.960+0000 7f825fff1740 1 --2- 172.21.15.50:0/3610457766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe260417e0 0x55fe260536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.960+0000 7f825fff1740 1 --2- 172.21.15.50:0/3610457766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260803a0 0x55fe26053c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.960+0000 7f825fff1740 1 --2- 172.21.15.50:0/3610457766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 0x55fe2607cc80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.960+0000 7f825fff1740 1 -- 172.21.15.50:0/3610457766 >> 172.21.15.50:0/3610457766 conn(0x55fe2603cee0 msgr2=0x55fe2603d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.960+0000 7f825fff1740 1 -- 172.21.15.50:0/3610457766 shutdown_connections 2024-09-11T22:14:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.960+0000 7f825fff1740 1 -- 172.21.15.50:0/3610457766 wait complete. 2024-09-11T22:14:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.961+0000 7f825fff1740 1 -- start start 2024-09-11T22:14:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.961+0000 7f825fff1740 1 Processor -- start 2024-09-11T22:14:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.961+0000 7f825fff1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 0x55fe261046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.961+0000 7f825fff1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260417e0 0x55fe260536e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.961+0000 7f825fff1740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe260803a0 0x55fe26053c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.961+0000 7f825fff1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82580ab710 con 0x55fe2603efa0 2024-09-11T22:14:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.961+0000 7f825fff1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fe260542b0 con 0x55fe260417e0 2024-09-11T22:14:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.961+0000 7f825fff1740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fe26087870 con 0x55fe260803a0 2024-09-11T22:14:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.961+0000 7f825fff1740 10 client.0 _ll_register_callbacks cb 0x7f8240004ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.961+0000 7f8256d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 0x55fe261046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f8256d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 0x55fe261046d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37220/0 (socket says 172.21.15.50:37220) 2024-09-11T22:14:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f8256d9d640 1 -- 172.21.15.50:0/988496875 learned_addr learned my addr 172.21.15.50:0/988496875 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f825659c640 1 --2- 172.21.15.50:0/988496875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260417e0 0x55fe260536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f825759e640 1 --2- 172.21.15.50:0/988496875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe260803a0 0x55fe26053c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f8256d9d640 1 -- 172.21.15.50:0/988496875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe260803a0 msgr2=0x55fe26053c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f8256d9d640 1 --2- 172.21.15.50:0/988496875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe260803a0 0x55fe26053c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f8256d9d640 1 -- 172.21.15.50:0/988496875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260417e0 msgr2=0x55fe260536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f8256d9d640 1 --2- 172.21.15.50:0/988496875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260417e0 0x55fe260536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f8256d9d640 1 -- 172.21.15.50:0/988496875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe26099550 con 0x55fe2603efa0 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f8256d9d640 1 --2- 172.21.15.50:0/988496875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 0x55fe261046d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8250009990 tx=0x7f8250004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ae69d510944510 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f8235ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f8235ffb640 1 -- 172.21.15.50:0/988496875 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250040040 con 0x55fe2603efa0 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f8235ffb640 1 -- 172.21.15.50:0/988496875 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f82500667f0 con 0x55fe2603efa0 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f825fff1740 1 -- 172.21.15.50:0/988496875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8250066640 con 0x55fe2603efa0 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f8235ffb640 1 -- 172.21.15.50:0/988496875 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8250037040 con 0x55fe2603efa0 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f825fff1740 10 client.5877 fetch_fsmap learned FSMap version 24 2024-09-11T22:14:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f825fff1740 1 -- 172.21.15.50:0/988496875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55fe26099df0 con 0x55fe2603efa0 2024-09-11T22:14:04.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.962+0000 7f8235ffb640 1 -- 172.21.15.50:0/988496875 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8250066640 con 0x55fe2603efa0 2024-09-11T22:14:04.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.963+0000 7f8235ffb640 1 -- 172.21.15.50:0/988496875 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f825005b040 con 0x55fe2603efa0 2024-09-11T22:14:04.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.963+0000 7f825fff1740 10 client.5877 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:14:04.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.963+0000 7f825fff1740 10 client.5877 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:04.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.963+0000 7f825fff1740 20 client.5877 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:04.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.963+0000 7f825fff1740 1 --2- 172.21.15.50:0/988496875 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fe26087170 0x55fe2607afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:04.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.963+0000 7f825fff1740 4 client.5877 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-11T22:14:04.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.963+0000 7f825fff1740 1 -- 172.21.15.50:0/988496875 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x55fe26082130 con 0x55fe26087170 2024-09-11T22:14:04.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.963+0000 7f825659c640 1 --2- 172.21.15.50:0/988496875 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fe26087170 0x55fe2607afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:04.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.963+0000 7f8235ffb640 10 client.5877 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.963+0000 7f825659c640 1 --2- 172.21.15.50:0/988496875 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fe26087170 0x55fe2607afd0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90a70611c8655720 server_cookie=1395052beab95875 in_seq=0 out_seq=0 2024-09-11T22:14:04.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f8235ffb640 1 -- 172.21.15.50:0/988496875 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fe26082130 con 0x55fe26087170 2024-09-11T22:14:04.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f8235ffb640 10 client.5877 handle_command_reply: tid=0 2024-09-11T22:14:04.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f825fff1740 1 client.5877 shutdown 2024-09-11T22:14:04.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f825fff1740 1 -- 172.21.15.50:0/988496875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 msgr2=0x55fe261046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f825fff1740 1 --2- 172.21.15.50:0/988496875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 0x55fe261046d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8250009990 tx=0x7f8250004730 comp rx=0 tx=0).stop 2024-09-11T22:14:04.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f825fff1740 1 -- 172.21.15.50:0/988496875 shutdown_connections 2024-09-11T22:14:04.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f825fff1740 1 --2- 172.21.15.50:0/988496875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fe260803a0 0x55fe26053c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f825fff1740 1 --2- 172.21.15.50:0/988496875 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55fe26087170 0x55fe2607afd0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f825fff1740 1 --2- 172.21.15.50:0/988496875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe260417e0 0x55fe260536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f8235ffb640 0 client.5877 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:04.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f825fff1740 1 --2- 172.21.15.50:0/988496875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe2603efa0 0x55fe261046d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f825fff1740 1 -- 172.21.15.50:0/988496875 >> 172.21.15.50:0/988496875 conn(0x55fe2603cee0 msgr2=0x55fe26083670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f825fff1740 1 -- 172.21.15.50:0/988496875 shutdown_connections 2024-09-11T22:14:04.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f825fff1740 1 -- 172.21.15.50:0/988496875 wait complete. 2024-09-11T22:14:04.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.967+0000 7f825fff1740 20 client.5877 trim_cache size 0 max 16384 2024-09-11T22:14:04.971 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:04.971 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:14:04.971 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:14:04.971 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:04.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.968+0000 7f825d253640 1 -- 172.21.15.50:0/3094583091 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f823806be60 msgr2=0x7f823806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.968+0000 7f825d253640 1 --2- 172.21.15.50:0/3094583091 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f823806be60 0x7f823806e320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8250034000 tx=0x7f825002e000 comp rx=0 tx=0).stop 2024-09-11T22:14:04.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.968+0000 7f825d253640 1 -- 172.21.15.50:0/3094583091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f825815c240 msgr2=0x7f8258161660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:04.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.968+0000 7f825d253640 1 --2- 172.21.15.50:0/3094583091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f825815c240 0x7f8258161660 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f824800c700 tx=0x7f824800cbc0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.968+0000 7f825d253640 1 -- 172.21.15.50:0/3094583091 shutdown_connections 2024-09-11T22:14:04.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.968+0000 7f825d253640 1 --2- 172.21.15.50:0/3094583091 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f823806be60 0x7f823806e320 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.968+0000 7f825d253640 1 --2- 172.21.15.50:0/3094583091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82580735a0 0x7f82580d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.968+0000 7f825d253640 1 --2- 172.21.15.50:0/3094583091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f825815c240 0x7f8258161660 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.968+0000 7f825d253640 1 --2- 172.21.15.50:0/3094583091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82580728e0 0x7f82581549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:04.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.968+0000 7f825d253640 1 -- 172.21.15.50:0/3094583091 >> 172.21.15.50:0/3094583091 conn(0x7f82580b2bd0 msgr2=0x7f825806ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:04.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.968+0000 7f825d253640 1 -- 172.21.15.50:0/3094583091 shutdown_connections 2024-09-11T22:14:04.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:04.968+0000 7f825d253640 1 -- 172.21.15.50:0/3094583091 wait complete. 2024-09-11T22:14:04.979 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'message': '', 'return_code': 0}' 2024-09-11T22:14:04.980 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2024-09-11T22:14:04.980 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-11T22:14:04.980 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2024-09-11T22:14:04.980 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:14:04.980 DEBUG:teuthology.orchestra.run.smithi050:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-09-11T22:14:04.980 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-11T22:14:05.046 INFO:teuthology.orchestra.run.smithi050.stdout:1099511630414 2024-09-11T22:14:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:14:05.055 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-11T22:14:05.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.199+0000 7f483fd49640 1 Processor -- start 2024-09-11T22:14:05.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.200+0000 7f483fd49640 1 -- start start 2024-09-11T22:14:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.200+0000 7f483fd49640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f483815e870 0x7f48380d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.200+0000 7f483fd49640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48380d16d0 0x7f48380d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.200+0000 7f483fd49640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48380cfa80 con 0x7f48380d3a30 2024-09-11T22:14:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.200+0000 7f483fd49640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f48380d1b10 con 0x7f483815e870 2024-09-11T22:14:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.200+0000 7f483fd49640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f48380d3e80 con 0x7f48380d16d0 2024-09-11T22:14:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.200+0000 7f483dae5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f483815e870 0x7f48380d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.200+0000 7f483dae5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f483815e870 0x7f48380d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37234/0 (socket says 172.21.15.50:37234) 2024-09-11T22:14:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.200+0000 7f483dae5640 1 -- 172.21.15.50:0/1839047276 learned_addr learned my addr 172.21.15.50:0/1839047276 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.201+0000 7f483d2e4640 1 --2- 172.21.15.50:0/1839047276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48380d16d0 0x7f48380d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.201+0000 7f483dae5640 1 -- 172.21.15.50:0/1839047276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48380d16d0 msgr2=0x7f48380d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.201+0000 7f483dae5640 1 --2- 172.21.15.50:0/1839047276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48380d16d0 0x7f48380d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.201+0000 7f483dae5640 1 -- 172.21.15.50:0/1839047276 >> v1:172.21.15.77:6789/0 conn(0x7f48380d3a30 legacy=0x7f48380b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.201+0000 7f483dae5640 1 -- 172.21.15.50:0/1839047276 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48380d40d0 con 0x7f483815e870 2024-09-11T22:14:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.202+0000 7f483dae5640 1 --2- 172.21.15.50:0/1839047276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f483815e870 0x7f48380d1190 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4830009870 tx=0x7f483002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ed13d7bbb2b26a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.202+0000 7f483cae3640 1 -- 172.21.15.50:0/1839047276 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830037070 con 0x7f483815e870 2024-09-11T22:14:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.202+0000 7f483cae3640 1 -- 172.21.15.50:0/1839047276 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4830032440 con 0x7f483815e870 2024-09-11T22:14:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.202+0000 7f483cae3640 1 -- 172.21.15.50:0/1839047276 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830032810 con 0x7f483815e870 2024-09-11T22:14:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.202+0000 7f483fd49640 1 -- 172.21.15.50:0/1839047276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f483815e870 msgr2=0x7f48380d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.202+0000 7f483fd49640 1 --2- 172.21.15.50:0/1839047276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f483815e870 0x7f48380d1190 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4830009870 tx=0x7f483002a270 comp rx=0 tx=0).stop 2024-09-11T22:14:05.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.202+0000 7f483fd49640 1 -- 172.21.15.50:0/1839047276 shutdown_connections 2024-09-11T22:14:05.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.202+0000 7f483fd49640 1 --2- 172.21.15.50:0/1839047276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48380d16d0 0x7f48380d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.202+0000 7f483fd49640 1 --2- 172.21.15.50:0/1839047276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f483815e870 0x7f48380d1190 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.202+0000 7f483fd49640 1 -- 172.21.15.50:0/1839047276 >> 172.21.15.50:0/1839047276 conn(0x7f48380727a0 msgr2=0x7f48380679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.202+0000 7f483fd49640 1 -- 172.21.15.50:0/1839047276 shutdown_connections 2024-09-11T22:14:05.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.202+0000 7f483fd49640 1 -- 172.21.15.50:0/1839047276 wait complete. 2024-09-11T22:14:05.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.203+0000 7f483fd49640 1 Processor -- start 2024-09-11T22:14:05.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.204+0000 7f483fd49640 1 -- start start 2024-09-11T22:14:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.204+0000 7f483fd49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48380d16d0 0x7f48381f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.204+0000 7f483fd49640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48380d3a30 0x7f48380b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.204+0000 7f483fd49640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483815e870 0x7f483814d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.204+0000 7f483fd49640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f48380b7ee0 con 0x7f48380d16d0 2024-09-11T22:14:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.204+0000 7f483fd49640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f48380b7c00 con 0x7f48380d3a30 2024-09-11T22:14:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.204+0000 7f483fd49640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f483815ec50 con 0x7f483815e870 2024-09-11T22:14:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.204+0000 7f483dae5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48380d16d0 0x7f48381f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.204+0000 7f483dae5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48380d16d0 0x7f48381f7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37236/0 (socket says 172.21.15.50:37236) 2024-09-11T22:14:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.204+0000 7f483dae5640 1 -- 172.21.15.50:0/2056913474 learned_addr learned my addr 172.21.15.50:0/2056913474 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.204+0000 7f483d2e4640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48380d3a30 0x7f48380b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.204+0000 7f483e2e6640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483815e870 0x7f483814d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.205+0000 7f483dae5640 1 -- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483815e870 msgr2=0x7f483814d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.205+0000 7f483dae5640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483815e870 0x7f483814d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.205+0000 7f483dae5640 1 -- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48380d3a30 msgr2=0x7f48380b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.205+0000 7f483dae5640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48380d3a30 0x7f48380b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.205+0000 7f483dae5640 1 -- 172.21.15.50:0/2056913474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48381f8340 con 0x7f48380d16d0 2024-09-11T22:14:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.205+0000 7f483dae5640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48380d16d0 0x7f48381f7bf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4830000c00 tx=0x7f48300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.205+0000 7f48367fc640 1 -- 172.21.15.50:0/2056913474 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830041020 con 0x7f48380d16d0 2024-09-11T22:14:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.205+0000 7f48367fc640 1 -- 172.21.15.50:0/2056913474 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48300306c0 con 0x7f48380d16d0 2024-09-11T22:14:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.205+0000 7f48367fc640 1 -- 172.21.15.50:0/2056913474 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830037040 con 0x7f48380d16d0 2024-09-11T22:14:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.205+0000 7f483fd49640 1 -- 172.21.15.50:0/2056913474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48381f8620 con 0x7f48380d16d0 2024-09-11T22:14:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.205+0000 7f483fd49640 1 -- 172.21.15.50:0/2056913474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48380cb9d0 con 0x7f48380d16d0 2024-09-11T22:14:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.207+0000 7f48367fc640 1 -- 172.21.15.50:0/2056913474 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4830044020 con 0x7f48380d16d0 2024-09-11T22:14:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.207+0000 7f48367fc640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482406be30 0x7f482406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.207+0000 7f48367fc640 1 -- 172.21.15.50:0/2056913474 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f48300ab590 con 0x7f48380d16d0 2024-09-11T22:14:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.207+0000 7f483d2e4640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482406be30 0x7f482406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.208+0000 7f483d2e4640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482406be30 0x7f482406e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f48380d2100 tx=0x7f482c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.208+0000 7f4842bba740 1 Processor -- start 2024-09-11T22:14:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.208+0000 7f4842bba740 1 -- start start 2024-09-11T22:14:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f4842bba740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d72579b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f4842bba740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7254d90 0x5576d7256920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f4842bba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7237550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f4842bba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5576d71735d0 con 0x5576d72551f0 2024-09-11T22:14:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f4842bba740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5576d711b470 con 0x5576d72575d0 2024-09-11T22:14:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f4842bba740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5576d716f590 con 0x5576d7254d90 2024-09-11T22:14:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f483e2e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7237550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f483e2e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7237550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37246/0 (socket says 172.21.15.50:37246) 2024-09-11T22:14:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f483e2e6640 1 -- 172.21.15.50:0/1943424577 learned_addr learned my addr 172.21.15.50:0/1943424577 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f483d2e4640 1 --2- 172.21.15.50:0/1943424577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7254d90 0x5576d7256920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f483dae5640 1 --2- 172.21.15.50:0/1943424577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d72579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f483e2e6640 1 -- 172.21.15.50:0/1943424577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7254d90 msgr2=0x5576d7256920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f483e2e6640 1 --2- 172.21.15.50:0/1943424577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7254d90 0x5576d7256920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f483e2e6640 1 -- 172.21.15.50:0/1943424577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 msgr2=0x5576d72579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f483e2e6640 1 --2- 172.21.15.50:0/1943424577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d72579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f483e2e6640 1 -- 172.21.15.50:0/1943424577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d7103860 con 0x5576d72551f0 2024-09-11T22:14:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.209+0000 7f483dae5640 1 --2- 172.21.15.50:0/1943424577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d72579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.210+0000 7f483e2e6640 1 --2- 172.21.15.50:0/1943424577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7237550 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4828001ee0 tx=0x7f4828001600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8113e1ce7c784f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.210+0000 7f481f7fe640 1 -- 172.21.15.50:0/1943424577 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482800fe50 con 0x5576d72551f0 2024-09-11T22:14:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.210+0000 7f481f7fe640 1 -- 172.21.15.50:0/1943424577 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4828018070 con 0x5576d72551f0 2024-09-11T22:14:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.210+0000 7f481f7fe640 1 -- 172.21.15.50:0/1943424577 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828003b70 con 0x5576d72551f0 2024-09-11T22:14:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.210+0000 7f4842bba740 1 -- 172.21.15.50:0/1943424577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 msgr2=0x5576d7237550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.210+0000 7f4842bba740 1 --2- 172.21.15.50:0/1943424577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7237550 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4828001ee0 tx=0x7f4828001600 comp rx=0 tx=0).stop 2024-09-11T22:14:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.210+0000 7f4842bba740 1 -- 172.21.15.50:0/1943424577 shutdown_connections 2024-09-11T22:14:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.210+0000 7f4842bba740 1 --2- 172.21.15.50:0/1943424577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7254d90 0x5576d7256920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.210+0000 7f4842bba740 1 --2- 172.21.15.50:0/1943424577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7237550 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.210+0000 7f4842bba740 1 --2- 172.21.15.50:0/1943424577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d72579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.210+0000 7f4842bba740 1 -- 172.21.15.50:0/1943424577 >> 172.21.15.50:0/1943424577 conn(0x5576d720d230 msgr2=0x5576d7255640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.211+0000 7f4842bba740 1 -- 172.21.15.50:0/1943424577 shutdown_connections 2024-09-11T22:14:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.211+0000 7f4842bba740 1 -- 172.21.15.50:0/1943424577 wait complete. 2024-09-11T22:14:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.211+0000 7f4842bba740 1 -- start start 2024-09-11T22:14:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.211+0000 7f4842bba740 1 Processor -- start 2024-09-11T22:14:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f4842bba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7268d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f4842bba740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d7210ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f4842bba740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7211010 0x5576d7251e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f4842bba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5576d7253cf0 con 0x5576d72551f0 2024-09-11T22:14:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f4842bba740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5576d70fc620 con 0x5576d72575d0 2024-09-11T22:14:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f4842bba740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5576d7253fd0 con 0x5576d7211010 2024-09-11T22:14:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f4842bba740 10 client.0 _ll_register_callbacks cb 0x5576d71205b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f483dae5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7268d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f483dae5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7268d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37262/0 (socket says 172.21.15.50:37262) 2024-09-11T22:14:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f483dae5640 1 -- 172.21.15.50:0/187596992 learned_addr learned my addr 172.21.15.50:0/187596992 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f483d2e4640 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d7210ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f483e2e6640 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7211010 0x5576d7251e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f483dae5640 1 -- 172.21.15.50:0/187596992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7211010 msgr2=0x5576d7251e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f483dae5640 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7211010 0x5576d7251e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f483dae5640 1 -- 172.21.15.50:0/187596992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 msgr2=0x5576d7210ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f483dae5640 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d7210ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f483dae5640 1 -- 172.21.15.50:0/187596992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576d6e863f0 con 0x5576d72551f0 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.212+0000 7f483d2e4640 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d7210ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f483dae5640 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7268d50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4830081eb0 tx=0x7f48300799f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5264af6f571ddff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f481cff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f481cff9640 1 -- 172.21.15.50:0/187596992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830082150 con 0x5576d72551f0 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f481cff9640 1 -- 172.21.15.50:0/187596992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f483007ab30 con 0x5576d72551f0 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f4842bba740 1 -- 172.21.15.50:0/187596992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4828018070 con 0x5576d72551f0 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f481cff9640 1 -- 172.21.15.50:0/187596992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f483007ad30 con 0x5576d72551f0 2024-09-11T22:14:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f4842bba740 10 client.5889 fetch_fsmap learned FSMap version 24 2024-09-11T22:14:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f4842bba740 1 -- 172.21.15.50:0/187596992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x5576d6f507d0 con 0x5576d72551f0 2024-09-11T22:14:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f481cff9640 1 -- 172.21.15.50:0/187596992 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4828018070 con 0x5576d72551f0 2024-09-11T22:14:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f481cff9640 1 -- 172.21.15.50:0/187596992 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f483003a030 con 0x5576d72551f0 2024-09-11T22:14:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f4842bba740 10 client.5889 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:14:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f4842bba740 10 client.5889 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f4842bba740 20 client.5889 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f4842bba740 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5576d7252580 0x5576d7238620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f4842bba740 4 client.5889 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f4842bba740 1 -- 172.21.15.50:0/187596992 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576d71d2030 con 0x5576d7252580 2024-09-11T22:14:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.213+0000 7f483d2e4640 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5576d7252580 0x5576d7238620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f483d2e4640 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5576d7252580 0x5576d7238620 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ea90d2ebe9ef8d1 server_cookie=6a66a615c8aab819 in_seq=0 out_seq=0 2024-09-11T22:14:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f481cff9640 10 client.5889 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f481cff9640 1 -- 172.21.15.50:0/187596992 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576d71d2030 con 0x5576d7252580 2024-09-11T22:14:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f481cff9640 10 client.5889 handle_command_reply: tid=0 2024-09-11T22:14:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f4842bba740 1 client.5889 shutdown 2024-09-11T22:14:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f4842bba740 1 -- 172.21.15.50:0/187596992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 msgr2=0x5576d7268d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f4842bba740 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7268d50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4830081eb0 tx=0x7f48300799f0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f4842bba740 1 -- 172.21.15.50:0/187596992 shutdown_connections 2024-09-11T22:14:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f4842bba740 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7211010 0x5576d7251e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f4842bba740 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5576d7252580 0x5576d7238620 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f4842bba740 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d7210ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f481cff9640 0 client.5889 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f4842bba740 1 --2- 172.21.15.50:0/187596992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7268d50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.214+0000 7f4842bba740 1 -- 172.21.15.50:0/187596992 >> 172.21.15.50:0/187596992 conn(0x5576d7254d90 msgr2=0x5576d72363a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.215+0000 7f4842bba740 1 -- 172.21.15.50:0/187596992 shutdown_connections 2024-09-11T22:14:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.215+0000 7f4842bba740 1 -- 172.21.15.50:0/187596992 wait complete. 2024-09-11T22:14:05.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.215+0000 7f4842bba740 20 client.5889 trim_cache size 0 max 16384 2024-09-11T22:14:05.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.228+0000 7f4842bba740 1 Processor -- start 2024-09-11T22:14:05.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.228+0000 7f4842bba740 1 -- start start 2024-09-11T22:14:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f4842bba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d7211010 0x5576d720b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f4842bba740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d72551f0 0x5576d720cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f4842bba740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d723ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f4842bba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4838200e80 con 0x5576d7211010 2024-09-11T22:14:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f4842bba740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f48381fff60 con 0x5576d72575d0 2024-09-11T22:14:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f4842bba740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f48380cc800 con 0x5576d72551f0 2024-09-11T22:14:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f483dae5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d7211010 0x5576d720b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f483dae5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d7211010 0x5576d720b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37274/0 (socket says 172.21.15.50:37274) 2024-09-11T22:14:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f483dae5640 1 -- 172.21.15.50:0/2157157119 learned_addr learned my addr 172.21.15.50:0/2157157119 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f483dae5640 1 -- 172.21.15.50:0/2157157119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d72551f0 msgr2=0x5576d720cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f483dae5640 1 --2- 172.21.15.50:0/2157157119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d72551f0 0x5576d720cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f483e2e6640 1 --2- 172.21.15.50:0/2157157119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d723ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f483dae5640 1 -- 172.21.15.50:0/2157157119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 msgr2=0x5576d723ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f483dae5640 1 --2- 172.21.15.50:0/2157157119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d723ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f483dae5640 1 -- 172.21.15.50:0/2157157119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d70fa140 con 0x5576d7211010 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f483dae5640 1 --2- 172.21.15.50:0/2157157119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d7211010 0x5576d720b600 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f483002a2b0 tx=0x7f4830007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375e1b79a9441b5c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f481effd640 1 -- 172.21.15.50:0/2157157119 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830081f50 con 0x5576d7211010 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f481effd640 1 -- 172.21.15.50:0/2157157119 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48300820f0 con 0x5576d7211010 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.229+0000 7f481effd640 1 -- 172.21.15.50:0/2157157119 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830078f70 con 0x5576d7211010 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.230+0000 7f4842bba740 1 -- 172.21.15.50:0/2157157119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d7211010 msgr2=0x5576d720b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.230+0000 7f4842bba740 1 --2- 172.21.15.50:0/2157157119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d7211010 0x5576d720b600 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f483002a2b0 tx=0x7f4830007000 comp rx=0 tx=0).stop 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.230+0000 7f4842bba740 1 -- 172.21.15.50:0/2157157119 shutdown_connections 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.230+0000 7f4842bba740 1 --2- 172.21.15.50:0/2157157119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d72551f0 0x5576d720cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.230+0000 7f4842bba740 1 --2- 172.21.15.50:0/2157157119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d723ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.230+0000 7f4842bba740 1 --2- 172.21.15.50:0/2157157119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d7211010 0x5576d720b600 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.230+0000 7f4842bba740 1 -- 172.21.15.50:0/2157157119 >> 172.21.15.50:0/2157157119 conn(0x5576d7254d90 msgr2=0x5576d72384b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.230+0000 7f4842bba740 1 -- 172.21.15.50:0/2157157119 shutdown_connections 2024-09-11T22:14:05.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.230+0000 7f4842bba740 1 -- 172.21.15.50:0/2157157119 wait complete. 2024-09-11T22:14:05.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.230+0000 7f4842bba740 1 -- start start 2024-09-11T22:14:05.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.231+0000 7f4842bba740 1 Processor -- start 2024-09-11T22:14:05.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.231+0000 7f4842bba740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7211010 0x5576d72d80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.231+0000 7f4842bba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7252c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.231+0000 7f4842bba740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d72d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.231+0000 7f4842bba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5576d723a840 con 0x5576d72551f0 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.231+0000 7f4842bba740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f48380cce50 con 0x5576d72575d0 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.231+0000 7f4842bba740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5576d7140e00 con 0x5576d7211010 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.231+0000 7f4842bba740 10 client.0 _ll_register_callbacks cb 0x7f4830079210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f483d2e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7252c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f483d2e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7252c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37290/0 (socket says 172.21.15.50:37290) 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f483d2e4640 1 -- 172.21.15.50:0/1418388612 learned_addr learned my addr 172.21.15.50:0/1418388612 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f483dae5640 1 --2- 172.21.15.50:0/1418388612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7211010 0x5576d72d80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f483e2e6640 1 --2- 172.21.15.50:0/1418388612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d72d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f483d2e4640 1 -- 172.21.15.50:0/1418388612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7211010 msgr2=0x5576d72d80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f483d2e4640 1 --2- 172.21.15.50:0/1418388612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7211010 0x5576d72d80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f483d2e4640 1 -- 172.21.15.50:0/1418388612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 msgr2=0x5576d72d3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f483d2e4640 1 --2- 172.21.15.50:0/1418388612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d72d3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f483d2e4640 1 -- 172.21.15.50:0/1418388612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576d726c110 con 0x5576d72551f0 2024-09-11T22:14:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f483d2e4640 1 --2- 172.21.15.50:0/1418388612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7252c30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4838151560 tx=0x7f482c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb781b1f26bf26a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f481cff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f481cff9640 1 -- 172.21.15.50:0/1418388612 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c030060 con 0x5576d72551f0 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f481cff9640 1 -- 172.21.15.50:0/1418388612 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f482c005a50 con 0x5576d72551f0 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f4842bba740 1 -- 172.21.15.50:0/1418388612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48300820f0 con 0x5576d72551f0 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f481cff9640 1 -- 172.21.15.50:0/1418388612 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f482c036050 con 0x5576d72551f0 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f4842bba740 10 client.5895 fetch_fsmap learned FSMap version 24 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f4842bba740 1 -- 172.21.15.50:0/1418388612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x5576d7253170 con 0x5576d72551f0 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.232+0000 7f481cff9640 1 -- 172.21.15.50:0/1418388612 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48300820f0 con 0x5576d72551f0 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f481cff9640 1 -- 172.21.15.50:0/1418388612 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f482c039020 con 0x5576d72551f0 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 10 client.5895 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 10 client.5895 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 20 client.5895 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 1 --2- 172.21.15.50:0/1418388612 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5576d7257fd0 0x5576d72583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 4 client.5895 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:14:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 1 -- 172.21.15.50:0/1418388612 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576d724f4d0 con 0x5576d7257fd0 2024-09-11T22:14:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f483dae5640 1 --2- 172.21.15.50:0/1418388612 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5576d7257fd0 0x5576d72583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f481cff9640 10 client.5895 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f483dae5640 1 --2- 172.21.15.50:0/1418388612 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5576d7257fd0 0x5576d72583d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9edc32089976883 server_cookie=74289556d8286f8b in_seq=0 out_seq=0 2024-09-11T22:14:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f481cff9640 1 -- 172.21.15.50:0/1418388612 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576d724f4d0 con 0x5576d7257fd0 2024-09-11T22:14:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f481cff9640 10 client.5895 handle_command_reply: tid=0 2024-09-11T22:14:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 1 client.5895 shutdown 2024-09-11T22:14:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 1 -- 172.21.15.50:0/1418388612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 msgr2=0x5576d7252c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 1 --2- 172.21.15.50:0/1418388612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7252c30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4838151560 tx=0x7f482c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 1 -- 172.21.15.50:0/1418388612 shutdown_connections 2024-09-11T22:14:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 1 --2- 172.21.15.50:0/1418388612 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5576d7257fd0 0x5576d72583d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 1 --2- 172.21.15.50:0/1418388612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576d72575d0 0x5576d72d3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 1 --2- 172.21.15.50:0/1418388612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576d72551f0 0x5576d7252c30 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f481cff9640 0 client.5895 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:05.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 1 --2- 172.21.15.50:0/1418388612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5576d7211010 0x5576d72d80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.233+0000 7f4842bba740 1 -- 172.21.15.50:0/1418388612 >> 172.21.15.50:0/1418388612 conn(0x5576d7254d90 msgr2=0x5576d724bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f4842bba740 1 -- 172.21.15.50:0/1418388612 shutdown_connections 2024-09-11T22:14:05.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f4842bba740 1 -- 172.21.15.50:0/1418388612 wait complete. 2024-09-11T22:14:05.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f4842bba740 20 client.5895 trim_cache size 0 max 16384 2024-09-11T22:14:05.240 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-11T22:14:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f483fd49640 1 -- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482406be30 msgr2=0x7f482406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f483fd49640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482406be30 0x7f482406e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f48380d2100 tx=0x7f482c008040 comp rx=0 tx=0).stop 2024-09-11T22:14:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f483fd49640 1 -- 172.21.15.50:0/2056913474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48380d16d0 msgr2=0x7f48381f7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f483fd49640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48380d16d0 0x7f48381f7bf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4830000c00 tx=0x7f48300046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f483fd49640 1 -- 172.21.15.50:0/2056913474 shutdown_connections 2024-09-11T22:14:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f483fd49640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482406be30 0x7f482406e2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f483fd49640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483815e870 0x7f483814d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f483fd49640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48380d3a30 0x7f48380b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f483fd49640 1 --2- 172.21.15.50:0/2056913474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48380d16d0 0x7f48381f7bf0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f483fd49640 1 -- 172.21.15.50:0/2056913474 >> 172.21.15.50:0/2056913474 conn(0x7f48380727a0 msgr2=0x7f48380ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f483fd49640 1 -- 172.21.15.50:0/2056913474 shutdown_connections 2024-09-11T22:14:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.234+0000 7f483fd49640 1 -- 172.21.15.50:0/2056913474 wait complete. 2024-09-11T22:14:05.245 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4e.00000000 parent 2024-09-11T22:14:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.289+0000 7f972b41cf40 1 Processor -- start 2024-09-11T22:14:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.289+0000 7f972b41cf40 1 -- start start 2024-09-11T22:14:05.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f972b41cf40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588cd0a54c0 0x5588cd0a2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f972b41cf40 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588cd0d0fb0 0x5588cd168a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f972b41cf40 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588cd1738d0 0x5588cd168f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f972b41cf40 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5588cd0a1970 con 0x5588cd1738d0 2024-09-11T22:14:05.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f972b41cf40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5588ccff3510 con 0x5588cd0a54c0 2024-09-11T22:14:05.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f972b41cf40 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5588cd0d1460 con 0x5588cd0d0fb0 2024-09-11T22:14:05.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f9728aa4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588cd1738d0 0x5588cd168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f9728aa4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588cd1738d0 0x5588cd168f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37302/0 (socket says 172.21.15.50:37302) 2024-09-11T22:14:05.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f9728aa4640 1 -- 172.21.15.50:0/1853216783 learned_addr learned my addr 172.21.15.50:0/1853216783 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f97282a3640 1 --2- 172.21.15.50:0/1853216783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588cd0a54c0 0x5588cd0a2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f9727aa2640 1 --2- 172.21.15.50:0/1853216783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588cd0d0fb0 0x5588cd168a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f9728aa4640 1 -- 172.21.15.50:0/1853216783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588cd0d0fb0 msgr2=0x5588cd168a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f9728aa4640 1 --2- 172.21.15.50:0/1853216783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588cd0d0fb0 0x5588cd168a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f9728aa4640 1 -- 172.21.15.50:0/1853216783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588cd0a54c0 msgr2=0x5588cd0a2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f9728aa4640 1 --2- 172.21.15.50:0/1853216783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588cd0a54c0 0x5588cd0a2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f9728aa4640 1 -- 172.21.15.50:0/1853216783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588cd1702b0 con 0x5588cd1738d0 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.290+0000 7f9727aa2640 1 --2- 172.21.15.50:0/1853216783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588cd0d0fb0 0x5588cd168a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.291+0000 7f9728aa4640 1 --2- 172.21.15.50:0/1853216783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588cd1738d0 0x5588cd168f90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9720025d20 tx=0x7f9720051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c116697a487decb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.291+0000 7f9726aa0640 1 -- 172.21.15.50:0/1853216783 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9720055070 con 0x5588cd1738d0 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.291+0000 7f9726aa0640 1 -- 172.21.15.50:0/1853216783 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9720051730 con 0x5588cd1738d0 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.291+0000 7f9726aa0640 1 -- 172.21.15.50:0/1853216783 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9720051b20 con 0x5588cd1738d0 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.291+0000 7f972b41cf40 1 -- 172.21.15.50:0/1853216783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588cd1738d0 msgr2=0x5588cd168f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.291+0000 7f972b41cf40 1 --2- 172.21.15.50:0/1853216783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588cd1738d0 0x5588cd168f90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9720025d20 tx=0x7f9720051000 comp rx=0 tx=0).stop 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.291+0000 7f972b41cf40 1 -- 172.21.15.50:0/1853216783 shutdown_connections 2024-09-11T22:14:05.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.291+0000 7f972b41cf40 1 --2- 172.21.15.50:0/1853216783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588cd0d0fb0 0x5588cd168a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.291+0000 7f972b41cf40 1 --2- 172.21.15.50:0/1853216783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588cd1738d0 0x5588cd168f90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.291+0000 7f972b41cf40 1 --2- 172.21.15.50:0/1853216783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588cd0a54c0 0x5588cd0a2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.291+0000 7f972b41cf40 1 -- 172.21.15.50:0/1853216783 >> 172.21.15.50:0/1853216783 conn(0x5588cd0a0a80 msgr2=0x5588cd172770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.291+0000 7f972b41cf40 1 -- 172.21.15.50:0/1853216783 shutdown_connections 2024-09-11T22:14:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.291+0000 7f972b41cf40 1 -- 172.21.15.50:0/1853216783 wait complete. 2024-09-11T22:14:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.292+0000 7f972b41cf40 1 Processor -- start 2024-09-11T22:14:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.292+0000 7f972b41cf40 1 -- start start 2024-09-11T22:14:05.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f972b41cf40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588cd0a54c0 0x5588cd165530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f972b41cf40 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588cd0d0fb0 0x5588cd1680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f972b41cf40 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588cd1738d0 0x5588cd174490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f972b41cf40 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5588cd0ecca0 con 0x5588cd1738d0 2024-09-11T22:14:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f972b41cf40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5588cd0e6df0 con 0x5588cd0a54c0 2024-09-11T22:14:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f972b41cf40 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5588cd0ec4a0 con 0x5588cd0d0fb0 2024-09-11T22:14:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f9728aa4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588cd1738d0 0x5588cd174490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f9728aa4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588cd1738d0 0x5588cd174490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37310/0 (socket says 172.21.15.50:37310) 2024-09-11T22:14:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f9728aa4640 1 -- 172.21.15.50:0/1942930106 learned_addr learned my addr 172.21.15.50:0/1942930106 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f97282a3640 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588cd0a54c0 0x5588cd165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f9727aa2640 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588cd0d0fb0 0x5588cd1680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f9728aa4640 1 -- 172.21.15.50:0/1942930106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588cd0d0fb0 msgr2=0x5588cd1680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f9728aa4640 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588cd0d0fb0 0x5588cd1680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f9728aa4640 1 -- 172.21.15.50:0/1942930106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588cd0a54c0 msgr2=0x5588cd165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f9728aa4640 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588cd0a54c0 0x5588cd165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f9728aa4640 1 -- 172.21.15.50:0/1942930106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588cd1685f0 con 0x5588cd1738d0 2024-09-11T22:14:05.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f9728aa4640 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588cd1738d0 0x5588cd174490 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f972000a5a0 tx=0x7f9720002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f9725a9e640 1 -- 172.21.15.50:0/1942930106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9720055050 con 0x5588cd1738d0 2024-09-11T22:14:05.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f9725a9e640 1 -- 172.21.15.50:0/1942930106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9720051c40 con 0x5588cd1738d0 2024-09-11T22:14:05.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f972b41cf40 1 -- 172.21.15.50:0/1942930106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588cd17abd0 con 0x5588cd1738d0 2024-09-11T22:14:05.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f9725a9e640 1 -- 172.21.15.50:0/1942930106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9720051e30 con 0x5588cd1738d0 2024-09-11T22:14:05.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.293+0000 7f972b41cf40 1 -- 172.21.15.50:0/1942930106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588cd17b190 con 0x5588cd1738d0 2024-09-11T22:14:05.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.295+0000 7f9725a9e640 1 -- 172.21.15.50:0/1942930106 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9720058070 con 0x5588cd1738d0 2024-09-11T22:14:05.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.295+0000 7f9725a9e640 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f971406a810 0x7f971406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.295+0000 7f9725a9e640 1 -- 172.21.15.50:0/1942930106 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f97200ced10 con 0x5588cd1738d0 2024-09-11T22:14:05.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.295+0000 7f97282a3640 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f971406a810 0x7f971406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.295+0000 7f972b41cf40 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x5588cd176540 0x5588cd17c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.295+0000 7f972b41cf40 1 -- 172.21.15.50:0/1942930106 --> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] -- osd_op(unknown.0.0:1 7.2 7:43adcc81:::10000000a4e.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47) -- 0x5588cd17c6c0 con 0x5588cd176540 2024-09-11T22:14:05.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.296+0000 7f9727aa2640 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x5588cd176540 0x5588cd17c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.296+0000 7f97282a3640 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f971406a810 0x7f971406ccd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9718005fd0 tx=0x7f9718007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.296+0000 7f9727aa2640 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x5588cd176540 0x5588cd17c180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.297+0000 7f9727aa2640 1 -- 172.21.15.50:0/1942930106 <== osd.3 v2:172.21.15.50:6800/593319808 1 ==== osd_op_reply(1 10000000a4e.00000000 [rmxattr] v47'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f971c00e040 con 0x5588cd176540 2024-09-11T22:14:05.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.297+0000 7f972b41cf40 1 -- 172.21.15.50:0/1942930106 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x5588cd176540 msgr2=0x5588cd17c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.297+0000 7f972b41cf40 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x5588cd176540 0x5588cd17c180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.297+0000 7f972b41cf40 1 -- 172.21.15.50:0/1942930106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f971406a810 msgr2=0x7f971406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.297+0000 7f972b41cf40 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f971406a810 0x7f971406ccd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9718005fd0 tx=0x7f9718007040 comp rx=0 tx=0).stop 2024-09-11T22:14:05.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.297+0000 7f972b41cf40 1 -- 172.21.15.50:0/1942930106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588cd1738d0 msgr2=0x5588cd174490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.297+0000 7f972b41cf40 1 --2- 172.21.15.50:0/1942930106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588cd1738d0 0x5588cd174490 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f972000a5a0 tx=0x7f9720002fb0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.297+0000 7f9728aa4640 1 -- 172.21.15.50:0/1942930106 reap_dead start 2024-09-11T22:14:05.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.297+0000 7f972b41cf40 1 -- 172.21.15.50:0/1942930106 shutdown_connections 2024-09-11T22:14:05.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.297+0000 7f972b41cf40 1 -- 172.21.15.50:0/1942930106 >> 172.21.15.50:0/1942930106 conn(0x5588cd0a0a80 msgr2=0x5588cd172770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.297+0000 7f972b41cf40 1 -- 172.21.15.50:0/1942930106 shutdown_connections 2024-09-11T22:14:05.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.297+0000 7f972b41cf40 1 -- 172.21.15.50:0/1942930106 wait complete. 2024-09-11T22:14:05.303 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-11T22:14:05.303 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-11T22:14:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.447+0000 7fb134559640 1 Processor -- start 2024-09-11T22:14:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.447+0000 7fb134559640 1 -- start start 2024-09-11T22:14:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.448+0000 7fb134559640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb12c0b03a0 0x7fb12c1677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.448+0000 7fb134559640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb12c0d1280 con 0x7fb12c0b3a40 2024-09-11T22:14:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.448+0000 7fb134559640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb12c0b2890 con 0x7fb12c15ffb0 2024-09-11T22:14:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.448+0000 7fb134559640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb12c0b2b70 con 0x7fb12c0b03a0 2024-09-11T22:14:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.448+0000 7fb132af6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb12c0b03a0 0x7fb12c1677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.448+0000 7fb131af4640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb12c0b3a40 0x7fb12c0d0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36356/0 (socket says 172.21.15.50:36356) 2024-09-11T22:14:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.448+0000 7fb132af6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb12c0b03a0 0x7fb12c1677a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37324/0 (socket says 172.21.15.50:37324) 2024-09-11T22:14:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.448+0000 7fb131af4640 1 -- 172.21.15.50:0/2357646188 learned_addr learned my addr 172.21.15.50:0/2357646188 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.449+0000 7fb132af6640 1 -- 172.21.15.50:0/2357646188 >> v1:172.21.15.77:6789/0 conn(0x7fb12c15ffb0 legacy=0x7fb12c0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.449+0000 7fb132af6640 1 -- 172.21.15.50:0/2357646188 >> v1:172.21.15.50:6789/0 conn(0x7fb12c0b3a40 legacy=0x7fb12c0d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.449+0000 7fb132af6640 1 -- 172.21.15.50:0/2357646188 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12c0b2e50 con 0x7fb12c0b03a0 2024-09-11T22:14:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.449+0000 7fb1312f3640 1 -- 172.21.15.50:0/2357646188 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1867170541 0 0) 0x7fb12c0d1280 con 0x7fb12c0b3a40 2024-09-11T22:14:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.450+0000 7fb132af6640 1 --2- 172.21.15.50:0/2357646188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb12c0b03a0 0x7fb12c1677a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb11c009d90 tx=0x7fb11c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1963f00c7aba24cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.450+0000 7fb1312f3640 1 -- 172.21.15.50:0/2357646188 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c007740 con 0x7fb12c0b03a0 2024-09-11T22:14:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.450+0000 7fb1312f3640 1 -- 172.21.15.50:0/2357646188 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb11c0078e0 con 0x7fb12c0b03a0 2024-09-11T22:14:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.450+0000 7fb1312f3640 1 -- 172.21.15.50:0/2357646188 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c007cb0 con 0x7fb12c0b03a0 2024-09-11T22:14:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.450+0000 7fb134559640 1 -- 172.21.15.50:0/2357646188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb12c0b03a0 msgr2=0x7fb12c1677a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.450+0000 7fb134559640 1 --2- 172.21.15.50:0/2357646188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb12c0b03a0 0x7fb12c1677a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb11c009d90 tx=0x7fb11c02a660 comp rx=0 tx=0).stop 2024-09-11T22:14:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.450+0000 7fb134559640 1 -- 172.21.15.50:0/2357646188 shutdown_connections 2024-09-11T22:14:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.450+0000 7fb134559640 1 --2- 172.21.15.50:0/2357646188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb12c0b03a0 0x7fb12c1677a0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.450+0000 7fb134559640 1 -- 172.21.15.50:0/2357646188 >> 172.21.15.50:0/2357646188 conn(0x7fb12c0b40b0 msgr2=0x7fb12c0b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.450+0000 7fb134559640 1 -- 172.21.15.50:0/2357646188 shutdown_connections 2024-09-11T22:14:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.450+0000 7fb134559640 1 -- 172.21.15.50:0/2357646188 wait complete. 2024-09-11T22:14:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.451+0000 7fb134559640 1 Processor -- start 2024-09-11T22:14:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.452+0000 7fb134559640 1 -- start start 2024-09-11T22:14:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.452+0000 7fb134559640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb12c0b03a0 0x7fb12c06c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.452+0000 7fb134559640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb12c0b3a40 0x7fb12c156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.452+0000 7fb134559640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb12c15ffb0 0x7fb12c156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.452+0000 7fb134559640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c167ce0 con 0x7fb12c0b03a0 2024-09-11T22:14:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.452+0000 7fb134559640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c0d15c0 con 0x7fb12c0b3a40 2024-09-11T22:14:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.452+0000 7fb134559640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb12c167e60 con 0x7fb12c15ffb0 2024-09-11T22:14:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.452+0000 7fb1322f5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb12c0b03a0 0x7fb12c06c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.452+0000 7fb1322f5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb12c0b03a0 0x7fb12c06c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37332/0 (socket says 172.21.15.50:37332) 2024-09-11T22:14:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.452+0000 7fb1322f5640 1 -- 172.21.15.50:0/4282986994 learned_addr learned my addr 172.21.15.50:0/4282986994 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb131af4640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb12c0b3a40 0x7fb12c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb132af6640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb12c15ffb0 0x7fb12c156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb1322f5640 1 -- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb12c15ffb0 msgr2=0x7fb12c156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb1322f5640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb12c15ffb0 0x7fb12c156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb1322f5640 1 -- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb12c0b3a40 msgr2=0x7fb12c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb1322f5640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb12c0b3a40 0x7fb12c156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb1322f5640 1 -- 172.21.15.50:0/4282986994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12c06cbf0 con 0x7fb12c0b03a0 2024-09-11T22:14:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb132af6640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb12c15ffb0 0x7fb12c156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb1322f5640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb12c0b03a0 0x7fb12c06c560 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb12400c480 tx=0x7fb12400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb12affd640 1 -- 172.21.15.50:0/4282986994 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1240052d0 con 0x7fb12c0b03a0 2024-09-11T22:14:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb12affd640 1 -- 172.21.15.50:0/4282986994 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb124005470 con 0x7fb12c0b03a0 2024-09-11T22:14:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb134559640 1 -- 172.21.15.50:0/4282986994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12c06ced0 con 0x7fb12c0b03a0 2024-09-11T22:14:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb12affd640 1 -- 172.21.15.50:0/4282986994 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb124012870 con 0x7fb12c0b03a0 2024-09-11T22:14:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.453+0000 7fb134559640 1 -- 172.21.15.50:0/4282986994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb12c0c92b0 con 0x7fb12c0b03a0 2024-09-11T22:14:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.455+0000 7fb12affd640 1 -- 172.21.15.50:0/4282986994 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb124012a10 con 0x7fb12c0b03a0 2024-09-11T22:14:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.455+0000 7fb12affd640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb11806be30 0x7fb11806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.455+0000 7fb12affd640 1 -- 172.21.15.50:0/4282986994 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fb12408aa00 con 0x7fb12c0b03a0 2024-09-11T22:14:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.455+0000 7fb131af4640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb11806be30 0x7fb11806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.456+0000 7fb131af4640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb11806be30 0x7fb11806e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb12c15b080 tx=0x7fb120007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.456+0000 7fb1373d2740 1 Processor -- start 2024-09-11T22:14:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.456+0000 7fb1373d2740 1 -- start start 2024-09-11T22:14:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb1373d2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5592195a1650 0x5592195a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb1373d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921959ee10 0x5592195a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb1373d2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55921959f270 0x5592195815d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb1373d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5592194bdc10 con 0x55921959ee10 2024-09-11T22:14:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb1373d2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559219465900 con 0x55921959f270 2024-09-11T22:14:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb1373d2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5592194b9bd0 con 0x5592195a1650 2024-09-11T22:14:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb131af4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921959ee10 0x5592195a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb131af4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921959ee10 0x5592195a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37340/0 (socket says 172.21.15.50:37340) 2024-09-11T22:14:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb131af4640 1 -- 172.21.15.50:0/1847073642 learned_addr learned my addr 172.21.15.50:0/1847073642 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb1322f5640 1 --2- 172.21.15.50:0/1847073642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5592195a1650 0x5592195a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb132af6640 1 --2- 172.21.15.50:0/1847073642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55921959f270 0x5592195815d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb131af4640 1 -- 172.21.15.50:0/1847073642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5592195a1650 msgr2=0x5592195a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb131af4640 1 --2- 172.21.15.50:0/1847073642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5592195a1650 0x5592195a1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb131af4640 1 -- 172.21.15.50:0/1847073642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55921959f270 msgr2=0x5592195815d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb131af4640 1 --2- 172.21.15.50:0/1847073642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55921959f270 0x5592195815d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.457+0000 7fb131af4640 1 -- 172.21.15.50:0/1847073642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55921929cc00 con 0x55921959ee10 2024-09-11T22:14:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.458+0000 7fb131af4640 1 --2- 172.21.15.50:0/1847073642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921959ee10 0x5592195a09a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb120004fc0 tx=0x7fb120013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e54ee209a6ce84 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.458+0000 7fb113fff640 1 -- 172.21.15.50:0/1847073642 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120026070 con 0x55921959ee10 2024-09-11T22:14:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.458+0000 7fb113fff640 1 -- 172.21.15.50:0/1847073642 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb120013970 con 0x55921959ee10 2024-09-11T22:14:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.458+0000 7fb113fff640 1 -- 172.21.15.50:0/1847073642 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120013d40 con 0x55921959ee10 2024-09-11T22:14:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.458+0000 7fb1373d2740 1 -- 172.21.15.50:0/1847073642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921959ee10 msgr2=0x5592195a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.458+0000 7fb1373d2740 1 --2- 172.21.15.50:0/1847073642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921959ee10 0x5592195a09a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb120004fc0 tx=0x7fb120013000 comp rx=0 tx=0).stop 2024-09-11T22:14:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.458+0000 7fb1373d2740 1 -- 172.21.15.50:0/1847073642 shutdown_connections 2024-09-11T22:14:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.458+0000 7fb1373d2740 1 --2- 172.21.15.50:0/1847073642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55921959f270 0x5592195815d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.458+0000 7fb1373d2740 1 --2- 172.21.15.50:0/1847073642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921959ee10 0x5592195a09a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.458+0000 7fb1373d2740 1 --2- 172.21.15.50:0/1847073642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5592195a1650 0x5592195a1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.458+0000 7fb1373d2740 1 -- 172.21.15.50:0/1847073642 >> 172.21.15.50:0/1847073642 conn(0x5592195572b0 msgr2=0x55921959f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.459+0000 7fb1373d2740 1 -- 172.21.15.50:0/1847073642 shutdown_connections 2024-09-11T22:14:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.459+0000 7fb1373d2740 1 -- 172.21.15.50:0/1847073642 wait complete. 2024-09-11T22:14:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.459+0000 7fb1373d2740 1 -- start start 2024-09-11T22:14:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.459+0000 7fb1373d2740 1 Processor -- start 2024-09-11T22:14:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.460+0000 7fb1373d2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x559219582d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.460+0000 7fb1373d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 0x5592195b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.460+0000 7fb1373d2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195b3700 0x55921959c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.460+0000 7fb1373d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55921959dd70 con 0x5592195a1650 2024-09-11T22:14:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.460+0000 7fb1373d2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559219446900 con 0x5592195b3700 2024-09-11T22:14:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.460+0000 7fb1373d2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55921959e050 con 0x55921959f270 2024-09-11T22:14:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.460+0000 7fb1373d2740 10 client.0 _ll_register_callbacks cb 0x5592191cffe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.460+0000 7fb131af4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 0x5592195b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.460+0000 7fb131af4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 0x5592195b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37352/0 (socket says 172.21.15.50:37352) 2024-09-11T22:14:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.460+0000 7fb131af4640 1 -- 172.21.15.50:0/101540812 learned_addr learned my addr 172.21.15.50:0/101540812 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.460+0000 7fb132af6640 1 --2- 172.21.15.50:0/101540812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195b3700 0x55921959c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.460+0000 7fb1322f5640 1 --2- 172.21.15.50:0/101540812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x559219582d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb131af4640 1 -- 172.21.15.50:0/101540812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 msgr2=0x559219582d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb131af4640 1 --2- 172.21.15.50:0/101540812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x559219582d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb131af4640 1 -- 172.21.15.50:0/101540812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195b3700 msgr2=0x55921959c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb131af4640 1 --2- 172.21.15.50:0/101540812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195b3700 0x55921959c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb131af4640 1 -- 172.21.15.50:0/101540812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592191904f0 con 0x5592195a1650 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb131af4640 1 --2- 172.21.15.50:0/101540812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 0x5592195b31c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb120000f60 tx=0x7fb120000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d15007da7550b18 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb1117fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb1117fa640 1 -- 172.21.15.50:0/101540812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120031060 con 0x5592195a1650 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb1117fa640 1 -- 172.21.15.50:0/101540812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fb120021a70 con 0x5592195a1650 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb1373d2740 1 -- 172.21.15.50:0/101540812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb120013970 con 0x5592195a1650 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb1117fa640 1 -- 172.21.15.50:0/101540812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb120037050 con 0x5592195a1650 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb1373d2740 10 client.5919 fetch_fsmap learned FSMap version 24 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb1373d2740 1 -- 172.21.15.50:0/101540812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x5592192fd390 con 0x5592195a1650 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.461+0000 7fb1117fa640 1 -- 172.21.15.50:0/101540812 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb120013970 con 0x5592195a1650 2024-09-11T22:14:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.462+0000 7fb1117fa640 1 -- 172.21.15.50:0/101540812 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7fb12003a020 con 0x5592195a1650 2024-09-11T22:14:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.462+0000 7fb1373d2740 10 client.5919 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:14:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.462+0000 7fb1373d2740 10 client.5919 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.462+0000 7fb1373d2740 20 client.5919 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.462+0000 7fb1373d2740 1 --2- 172.21.15.50:0/101540812 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x559219597b10 0x559219597f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.462+0000 7fb1373d2740 4 client.5919 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.462+0000 7fb1373d2740 1 -- 172.21.15.50:0/101540812 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592194cb340 con 0x559219597b10 2024-09-11T22:14:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.462+0000 7fb1322f5640 1 --2- 172.21.15.50:0/101540812 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x559219597b10 0x559219597f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.462+0000 7fb1117fa640 10 client.5919 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.462+0000 7fb1322f5640 1 --2- 172.21.15.50:0/101540812 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x559219597b10 0x559219597f10 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a365e88ee178d97c server_cookie=257e59c0fe745e8c in_seq=0 out_seq=0 2024-09-11T22:14:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1117fa640 1 -- 172.21.15.50:0/101540812 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5592194cb340 con 0x559219597b10 2024-09-11T22:14:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1117fa640 10 client.5919 handle_command_reply: tid=0 2024-09-11T22:14:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1373d2740 1 client.5919 shutdown 2024-09-11T22:14:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1373d2740 1 -- 172.21.15.50:0/101540812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 msgr2=0x5592195b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1373d2740 1 --2- 172.21.15.50:0/101540812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 0x5592195b31c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb120000f60 tx=0x7fb120000ed0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1373d2740 1 -- 172.21.15.50:0/101540812 shutdown_connections 2024-09-11T22:14:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1373d2740 1 --2- 172.21.15.50:0/101540812 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x559219597b10 0x559219597f10 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1373d2740 1 --2- 172.21.15.50:0/101540812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195b3700 0x55921959c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1373d2740 1 --2- 172.21.15.50:0/101540812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 0x5592195b31c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1117fa640 0 client.5919 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1373d2740 1 --2- 172.21.15.50:0/101540812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x559219582d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1373d2740 1 -- 172.21.15.50:0/101540812 >> 172.21.15.50:0/101540812 conn(0x55921959ee10 msgr2=0x5592195813a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1373d2740 1 -- 172.21.15.50:0/101540812 shutdown_connections 2024-09-11T22:14:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1373d2740 1 -- 172.21.15.50:0/101540812 wait complete. 2024-09-11T22:14:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.463+0000 7fb1373d2740 20 client.5919 trim_cache size 0 max 16384 2024-09-11T22:14:05.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.481+0000 7fb1373d2740 1 Processor -- start 2024-09-11T22:14:05.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.481+0000 7fb1373d2740 1 -- start start 2024-09-11T22:14:05.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.481+0000 7fb1373d2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x5592195a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.481+0000 7fb1373d2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195a1650 0x559219582950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.481+0000 7fb1373d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195b3700 0x5592195a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.481+0000 7fb1373d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c200de0 con 0x5592195b3700 2024-09-11T22:14:05.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.481+0000 7fb1373d2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c0cb620 con 0x5592195a1650 2024-09-11T22:14:05.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.481+0000 7fb1373d2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb12c0c8cf0 con 0x55921959f270 2024-09-11T22:14:05.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb132af6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195b3700 0x5592195a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb132af6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195b3700 0x5592195a1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37366/0 (socket says 172.21.15.50:37366) 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb132af6640 1 -- 172.21.15.50:0/3126724708 learned_addr learned my addr 172.21.15.50:0/3126724708 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb1322f5640 1 --2- 172.21.15.50:0/3126724708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x5592195a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb132af6640 1 -- 172.21.15.50:0/3126724708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 msgr2=0x5592195a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb131af4640 1 --2- 172.21.15.50:0/3126724708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195a1650 0x559219582950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb132af6640 1 --2- 172.21.15.50:0/3126724708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x5592195a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb132af6640 1 -- 172.21.15.50:0/3126724708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195a1650 msgr2=0x559219582950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb132af6640 1 --2- 172.21.15.50:0/3126724708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195a1650 0x559219582950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb132af6640 1 -- 172.21.15.50:0/3126724708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592191695b0 con 0x5592195b3700 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb1322f5640 1 --2- 172.21.15.50:0/3126724708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x5592195a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb131af4640 1 --2- 172.21.15.50:0/3126724708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195a1650 0x559219582950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb132af6640 1 --2- 172.21.15.50:0/3126724708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195b3700 0x5592195a1c60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb11c009e80 tx=0x7fb11c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47edecdd8afd20e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb1137fe640 1 -- 172.21.15.50:0/3126724708 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c003d90 con 0x5592195b3700 2024-09-11T22:14:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb1137fe640 1 -- 172.21.15.50:0/3126724708 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb11c004040 con 0x5592195b3700 2024-09-11T22:14:05.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.482+0000 7fb1137fe640 1 -- 172.21.15.50:0/3126724708 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0043f0 con 0x5592195b3700 2024-09-11T22:14:05.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.483+0000 7fb1373d2740 1 -- 172.21.15.50:0/3126724708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195b3700 msgr2=0x5592195a1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.483+0000 7fb1373d2740 1 --2- 172.21.15.50:0/3126724708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195b3700 0x5592195a1c60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb11c009e80 tx=0x7fb11c02e000 comp rx=0 tx=0).stop 2024-09-11T22:14:05.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.483+0000 7fb1373d2740 1 -- 172.21.15.50:0/3126724708 shutdown_connections 2024-09-11T22:14:05.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.483+0000 7fb1373d2740 1 --2- 172.21.15.50:0/3126724708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195b3700 0x5592195a1c60 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.483+0000 7fb1373d2740 1 --2- 172.21.15.50:0/3126724708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195a1650 0x559219582950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.483+0000 7fb1373d2740 1 --2- 172.21.15.50:0/3126724708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x5592195a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.483+0000 7fb1373d2740 1 -- 172.21.15.50:0/3126724708 >> 172.21.15.50:0/3126724708 conn(0x55921959ee10 msgr2=0x559219550390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.483+0000 7fb1373d2740 1 -- 172.21.15.50:0/3126724708 shutdown_connections 2024-09-11T22:14:05.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.483+0000 7fb1373d2740 1 -- 172.21.15.50:0/3126724708 wait complete. 2024-09-11T22:14:05.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.483+0000 7fb1373d2740 1 -- start start 2024-09-11T22:14:05.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.483+0000 7fb1373d2740 1 Processor -- start 2024-09-11T22:14:05.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.484+0000 7fb1373d2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x559219619db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.484+0000 7fb1373d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 0x5592195a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.484+0000 7fb1373d2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195b3700 0x5592195a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.484+0000 7fb1373d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559219595f40 con 0x5592195a1650 2024-09-11T22:14:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.484+0000 7fb1373d2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c0cafd0 con 0x5592195b3700 2024-09-11T22:14:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.484+0000 7fb1373d2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559219580da0 con 0x55921959f270 2024-09-11T22:14:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.484+0000 7fb1373d2740 10 client.0 _ll_register_callbacks cb 0x7fb124058ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.484+0000 7fb131af4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 0x5592195a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.484+0000 7fb131af4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 0x5592195a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37370/0 (socket says 172.21.15.50:37370) 2024-09-11T22:14:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.484+0000 7fb131af4640 1 -- 172.21.15.50:0/2441034406 learned_addr learned my addr 172.21.15.50:0/2441034406 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb132af6640 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195b3700 0x5592195a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb1322f5640 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x559219619db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb131af4640 1 -- 172.21.15.50:0/2441034406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 msgr2=0x559219619db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb131af4640 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x559219619db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb131af4640 1 -- 172.21.15.50:0/2441034406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195b3700 msgr2=0x5592195a0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb131af4640 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195b3700 0x5592195a0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb131af4640 1 -- 172.21.15.50:0/2441034406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559219584710 con 0x5592195a1650 2024-09-11T22:14:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb132af6640 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195b3700 0x5592195a0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb1322f5640 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x559219619db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb131af4640 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 0x5592195a0a60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb120000f60 tx=0x7fb120009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9bfb976cd7fd83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb1117fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb1117fa640 1 -- 172.21.15.50:0/2441034406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120026030 con 0x5592195a1650 2024-09-11T22:14:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb1373d2740 1 -- 172.21.15.50:0/2441034406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb11c004040 con 0x5592195a1650 2024-09-11T22:14:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb1117fa640 1 -- 172.21.15.50:0/2441034406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fb120021c70 con 0x5592195a1650 2024-09-11T22:14:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb1117fa640 1 -- 172.21.15.50:0/2441034406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb120049050 con 0x5592195a1650 2024-09-11T22:14:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb1373d2740 10 client.5925 fetch_fsmap learned FSMap version 24 2024-09-11T22:14:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb1373d2740 1 -- 172.21.15.50:0/2441034406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x559219620200 con 0x5592195a1650 2024-09-11T22:14:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.485+0000 7fb1117fa640 1 -- 172.21.15.50:0/2441034406 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb11c004040 con 0x5592195a1650 2024-09-11T22:14:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.486+0000 7fb1117fa640 1 -- 172.21.15.50:0/2441034406 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7fb12004c020 con 0x5592195a1650 2024-09-11T22:14:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.486+0000 7fb1373d2740 10 client.5925 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:14:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.486+0000 7fb1373d2740 10 client.5925 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.486+0000 7fb1373d2740 20 client.5925 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.486+0000 7fb1373d2740 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5592195a2440 0x55921961cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.486+0000 7fb1373d2740 4 client.5925 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-11T22:14:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.486+0000 7fb1373d2740 1 -- 172.21.15.50:0/2441034406 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x5592194c5690 con 0x5592195a2440 2024-09-11T22:14:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.486+0000 7fb1322f5640 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5592195a2440 0x55921961cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.486+0000 7fb1117fa640 10 client.5925 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.486+0000 7fb1322f5640 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5592195a2440 0x55921961cc90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65d4f8f26af5be4c server_cookie=726afe05d2ec3d58 in_seq=0 out_seq=0 2024-09-11T22:14:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.486+0000 7fb1117fa640 1 -- 172.21.15.50:0/2441034406 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5592194c5690 con 0x5592195a2440 2024-09-11T22:14:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.486+0000 7fb1117fa640 10 client.5925 handle_command_reply: tid=0 2024-09-11T22:14:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.486+0000 7fb1373d2740 1 client.5925 shutdown 2024-09-11T22:14:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb1373d2740 1 -- 172.21.15.50:0/2441034406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 msgr2=0x5592195a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb1373d2740 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 0x5592195a0a60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb120000f60 tx=0x7fb120009030 comp rx=0 tx=0).stop 2024-09-11T22:14:05.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb1373d2740 1 -- 172.21.15.50:0/2441034406 shutdown_connections 2024-09-11T22:14:05.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb1373d2740 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5592195a2440 0x55921961cc90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb1373d2740 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5592195b3700 0x5592195a0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb1373d2740 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5592195a1650 0x5592195a0a60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb1117fa640 0 client.5925 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:05.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb1373d2740 1 --2- 172.21.15.50:0/2441034406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55921959f270 0x559219619db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb1373d2740 1 -- 172.21.15.50:0/2441034406 >> 172.21.15.50:0/2441034406 conn(0x55921959ee10 msgr2=0x5592195951a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.493 INFO:tasks.ceph.mds.c.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fc2ffaff640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4e [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v466 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={4952=0-4194304@1} caps={4952=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=4952 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55c9eadf2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000a4e:[<0x10000000001/new_file_1 v466>,<0x10000000000/ceph-qa-suite v51>,<0x1/scrub_test_path v17>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-11T22:14:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb1373d2740 1 -- 172.21.15.50:0/2441034406 shutdown_connections 2024-09-11T22:14:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb1373d2740 1 -- 172.21.15.50:0/2441034406 wait complete. 2024-09-11T22:14:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb1373d2740 20 client.5925 trim_cache size 0 max 16384 2024-09-11T22:14:05.494 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:05.494 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:14:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "364af705-bb42-4abf-8e7d-fb956193f299", 2024-09-11T22:14:05.495 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:14:05.495 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb134559640 1 -- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb11806be30 msgr2=0x7fb11806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb134559640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb11806be30 0x7fb11806e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb12c15b080 tx=0x7fb120007e40 comp rx=0 tx=0).stop 2024-09-11T22:14:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb134559640 1 -- 172.21.15.50:0/4282986994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb12c0b03a0 msgr2=0x7fb12c06c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb134559640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb12c0b03a0 0x7fb12c06c560 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb12400c480 tx=0x7fb12400c940 comp rx=0 tx=0).stop 2024-09-11T22:14:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb134559640 1 -- 172.21.15.50:0/4282986994 shutdown_connections 2024-09-11T22:14:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb134559640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb11806be30 0x7fb11806e2f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb134559640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb12c15ffb0 0x7fb12c156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb134559640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb12c0b3a40 0x7fb12c156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb134559640 1 --2- 172.21.15.50:0/4282986994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb12c0b03a0 0x7fb12c06c560 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.487+0000 7fb134559640 1 -- 172.21.15.50:0/4282986994 >> 172.21.15.50:0/4282986994 conn(0x7fb12c0b40b0 msgr2=0x7fb12c0cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.488+0000 7fb134559640 1 -- 172.21.15.50:0/4282986994 shutdown_connections 2024-09-11T22:14:05.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.488+0000 7fb134559640 1 -- 172.21.15.50:0/4282986994 wait complete. 2024-09-11T22:14:05.499 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': '364af705-bb42-4abf-8e7d-fb956193f299', 'mode': 'asynchronous'}' 2024-09-11T22:14:05.499 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-11T22:14:05.499 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-11T22:14:05.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.603+0000 7f04f1e2e640 1 Processor -- start 2024-09-11T22:14:05.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.603+0000 7f04f1e2e640 1 -- start start 2024-09-11T22:14:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.604+0000 7f04f1e2e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec0d1c90 0x7f04ec0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.604+0000 7f04f1e2e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04ec162350 0x7f04ec1627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.604+0000 7f04f1e2e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04ec163080 con 0x7f04ec15e8e0 2024-09-11T22:14:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.604+0000 7f04f1e2e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f04ec15ecc0 con 0x7f04ec162350 2024-09-11T22:14:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.604+0000 7f04f1e2e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f04ec0d2ad0 con 0x7f04ec0d1c90 2024-09-11T22:14:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.605+0000 7f04eaffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec0d1c90 0x7f04ec0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.605+0000 7f04ebfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04ec162350 0x7f04ec1627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.605+0000 7f04eb7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f04ec15e8e0 0x7f04ec0d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:52216/0 (socket says 172.21.15.50:52216) 2024-09-11T22:14:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.605+0000 7f04eb7fe640 1 -- 172.21.15.50:0/2352573873 learned_addr learned my addr 172.21.15.50:0/2352573873 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.605+0000 7f04ebfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04ec162350 0x7f04ec1627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54948/0 (socket says 172.21.15.50:54948) 2024-09-11T22:14:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.605+0000 7f04ea7fc640 1 -- 172.21.15.50:0/2352573873 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247766906 0 0) 0x7f04ec163080 con 0x7f04ec15e8e0 2024-09-11T22:14:05.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.605+0000 7f04ea7fc640 1 -- 172.21.15.50:0/2352573873 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04d4003520 con 0x7f04ec15e8e0 2024-09-11T22:14:05.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.605+0000 7f04eaffd640 1 -- 172.21.15.50:0/2352573873 >> v2:172.21.15.77:3300/0 conn(0x7f04ec162350 msgr2=0x7f04ec1627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.605+0000 7f04eaffd640 1 --2- 172.21.15.50:0/2352573873 >> v2:172.21.15.77:3300/0 conn(0x7f04ec162350 0x7f04ec1627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.605+0000 7f04eaffd640 1 -- 172.21.15.50:0/2352573873 >> v1:172.21.15.77:6789/0 conn(0x7f04ec15e8e0 legacy=0x7f04ec0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.605+0000 7f04eaffd640 1 -- 172.21.15.50:0/2352573873 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ec0d2d20 con 0x7f04ec0d1c90 2024-09-11T22:14:05.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.605+0000 7f04ebfff640 1 --2- 172.21.15.50:0/2352573873 >> v2:172.21.15.77:3300/0 conn(0x7f04ec162350 0x7f04ec1627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.606+0000 7f04eaffd640 1 --2- 172.21.15.50:0/2352573873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec0d1c90 0x7f04ec0b7880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f04e00097a0 tx=0x7f04e002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da2c04e0173b7907 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.606+0000 7f04ea7fc640 1 -- 172.21.15.50:0/2352573873 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0037070 con 0x7f04ec0d1c90 2024-09-11T22:14:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.606+0000 7f04ea7fc640 1 -- 172.21.15.50:0/2352573873 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e0032440 con 0x7f04ec0d1c90 2024-09-11T22:14:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.606+0000 7f04ea7fc640 1 -- 172.21.15.50:0/2352573873 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0032810 con 0x7f04ec0d1c90 2024-09-11T22:14:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.606+0000 7f04f1e2e640 1 -- 172.21.15.50:0/2352573873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec0d1c90 msgr2=0x7f04ec0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.606+0000 7f04f1e2e640 1 --2- 172.21.15.50:0/2352573873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec0d1c90 0x7f04ec0b7880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f04e00097a0 tx=0x7f04e002a210 comp rx=0 tx=0).stop 2024-09-11T22:14:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.607+0000 7f04f1e2e640 1 -- 172.21.15.50:0/2352573873 shutdown_connections 2024-09-11T22:14:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.607+0000 7f04f1e2e640 1 --2- 172.21.15.50:0/2352573873 >> v2:172.21.15.77:3300/0 conn(0x7f04ec162350 0x7f04ec1627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.607+0000 7f04f1e2e640 1 --2- 172.21.15.50:0/2352573873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec0d1c90 0x7f04ec0b7880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.607+0000 7f04f1e2e640 1 -- 172.21.15.50:0/2352573873 >> 172.21.15.50:0/2352573873 conn(0x7f04ec067ba0 msgr2=0x7f04ec067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.607+0000 7f04f1e2e640 1 -- 172.21.15.50:0/2352573873 shutdown_connections 2024-09-11T22:14:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.607+0000 7f04f1e2e640 1 -- 172.21.15.50:0/2352573873 wait complete. 2024-09-11T22:14:05.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.608+0000 7f04f1e2e640 1 Processor -- start 2024-09-11T22:14:05.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.608+0000 7f04f1e2e640 1 -- start start 2024-09-11T22:14:05.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04f1e2e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec0d1c90 0x7f04ec14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04f1e2e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04ec15e8e0 0x7f04ec15ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04f1e2e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec162350 0x7f04ec15f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04f1e2e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec162d20 con 0x7f04ec0d1c90 2024-09-11T22:14:05.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04f1e2e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec0d3370 con 0x7f04ec15e8e0 2024-09-11T22:14:05.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04f1e2e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f04ec0d3800 con 0x7f04ec162350 2024-09-11T22:14:05.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04eb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec0d1c90 0x7f04ec14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04eb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec0d1c90 0x7f04ec14fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37384/0 (socket says 172.21.15.50:37384) 2024-09-11T22:14:05.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04eb7fe640 1 -- 172.21.15.50:0/62204485 learned_addr learned my addr 172.21.15.50:0/62204485 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04eaffd640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04ec15e8e0 0x7f04ec15ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04ebfff640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec162350 0x7f04ec15f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04eb7fe640 1 -- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec162350 msgr2=0x7f04ec15f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04eb7fe640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec162350 0x7f04ec15f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04eb7fe640 1 -- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04ec15e8e0 msgr2=0x7f04ec15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04eb7fe640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04ec15e8e0 0x7f04ec15ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04eb7fe640 1 -- 172.21.15.50:0/62204485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ec1501f0 con 0x7f04ec0d1c90 2024-09-11T22:14:05.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04eb7fe640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec0d1c90 0x7f04ec14fcb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f04dc00c430 tx=0x7f04dc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.609+0000 7f04d3fff640 1 -- 172.21.15.50:0/62204485 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc017070 con 0x7f04ec0d1c90 2024-09-11T22:14:05.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.610+0000 7f04d3fff640 1 -- 172.21.15.50:0/62204485 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04dc005ce0 con 0x7f04ec0d1c90 2024-09-11T22:14:05.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.610+0000 7f04f1e2e640 1 -- 172.21.15.50:0/62204485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ec0cb960 con 0x7f04ec0d1c90 2024-09-11T22:14:05.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.610+0000 7f04d3fff640 1 -- 172.21.15.50:0/62204485 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc0072f0 con 0x7f04ec0d1c90 2024-09-11T22:14:05.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.610+0000 7f04f1e2e640 1 -- 172.21.15.50:0/62204485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ec0cbf20 con 0x7f04ec0d1c90 2024-09-11T22:14:05.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.611+0000 7f04d3fff640 1 -- 172.21.15.50:0/62204485 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04dc01a070 con 0x7f04ec0d1c90 2024-09-11T22:14:05.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.611+0000 7f04d3fff640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04d806be60 0x7f04d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.612+0000 7f04d3fff640 1 -- 172.21.15.50:0/62204485 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f04dc08a240 con 0x7f04ec0d1c90 2024-09-11T22:14:05.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.612+0000 7f04eaffd640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04d806be60 0x7f04d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.612+0000 7f04eaffd640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04d806be60 0x7f04d806e320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f04e0034000 tx=0x7f04e002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.613+0000 7f04f4bc9740 1 Processor -- start 2024-09-11T22:14:05.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.613+0000 7f04f4bc9740 1 -- start start 2024-09-11T22:14:05.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.613+0000 7f04f4bc9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebc920 0x558561f020c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.613+0000 7f04f4bc9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561eba0e0 0x558561ebcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.613+0000 7f04f4bc9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebe0b0 0x558561eb71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.613+0000 7f04f4bc9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558561e1f6f0 con 0x558561eba0e0 2024-09-11T22:14:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.613+0000 7f04f4bc9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558561dc7330 con 0x558561ebe0b0 2024-09-11T22:14:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.613+0000 7f04f4bc9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558561e1b6b0 con 0x558561ebc920 2024-09-11T22:14:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04eaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561eba0e0 0x558561ebcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04eaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561eba0e0 0x558561ebcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37390/0 (socket says 172.21.15.50:37390) 2024-09-11T22:14:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04eaffd640 1 -- 172.21.15.50:0/1742408476 learned_addr learned my addr 172.21.15.50:0/1742408476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04eb7fe640 1 --2- 172.21.15.50:0/1742408476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebc920 0x558561f020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04ebfff640 1 --2- 172.21.15.50:0/1742408476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebe0b0 0x558561eb71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04eaffd640 1 -- 172.21.15.50:0/1742408476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebc920 msgr2=0x558561f020c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04eaffd640 1 --2- 172.21.15.50:0/1742408476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebc920 0x558561f020c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04eaffd640 1 -- 172.21.15.50:0/1742408476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebe0b0 msgr2=0x558561eb71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04eaffd640 1 --2- 172.21.15.50:0/1742408476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebe0b0 0x558561eb71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04eaffd640 1 -- 172.21.15.50:0/1742408476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558561ded0d0 con 0x558561eba0e0 2024-09-11T22:14:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04eaffd640 1 --2- 172.21.15.50:0/1742408476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561eba0e0 0x558561ebcd00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f04e0032610 tx=0x7f04e002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1643d7a32728a20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04d17fa640 1 -- 172.21.15.50:0/1742408476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e004e070 con 0x558561eba0e0 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04d17fa640 1 -- 172.21.15.50:0/1742408476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e0032bb0 con 0x558561eba0e0 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.614+0000 7f04d17fa640 1 -- 172.21.15.50:0/1742408476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0037040 con 0x558561eba0e0 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.615+0000 7f04f4bc9740 1 -- 172.21.15.50:0/1742408476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561eba0e0 msgr2=0x558561ebcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.615+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/1742408476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561eba0e0 0x558561ebcd00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f04e0032610 tx=0x7f04e002c000 comp rx=0 tx=0).stop 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.615+0000 7f04f4bc9740 1 -- 172.21.15.50:0/1742408476 shutdown_connections 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.615+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/1742408476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebe0b0 0x558561eb71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.615+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/1742408476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561eba0e0 0x558561ebcd00 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.615+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/1742408476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebc920 0x558561f020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.615+0000 7f04f4bc9740 1 -- 172.21.15.50:0/1742408476 >> 172.21.15.50:0/1742408476 conn(0x558561eb9370 msgr2=0x558561f01590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.615+0000 7f04f4bc9740 1 -- 172.21.15.50:0/1742408476 shutdown_connections 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.615+0000 7f04f4bc9740 1 -- 172.21.15.50:0/1742408476 wait complete. 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.616+0000 7f04f4bc9740 1 -- start start 2024-09-11T22:14:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.616+0000 7f04f4bc9740 1 Processor -- start 2024-09-11T22:14:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.616+0000 7f04f4bc9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebc920 0x558561edb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.616+0000 7f04f4bc9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebe0b0 0x558561edd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.616+0000 7f04f4bc9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561edd6b0 0x558561ebaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.616+0000 7f04f4bc9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558561eb8810 con 0x558561ebe0b0 2024-09-11T22:14:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.616+0000 7f04f4bc9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558561da84f0 con 0x558561ebc920 2024-09-11T22:14:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.616+0000 7f04f4bc9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558561f028f0 con 0x558561edd6b0 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04f4bc9740 10 client.0 _ll_register_callbacks cb 0x558561dc9b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04eaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebe0b0 0x558561edd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04eaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebe0b0 0x558561edd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37398/0 (socket says 172.21.15.50:37398) 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04eaffd640 1 -- 172.21.15.50:0/3369953733 learned_addr learned my addr 172.21.15.50:0/3369953733 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04ebfff640 1 --2- 172.21.15.50:0/3369953733 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561edd6b0 0x558561ebaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04eb7fe640 1 --2- 172.21.15.50:0/3369953733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebc920 0x558561edb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04eaffd640 1 -- 172.21.15.50:0/3369953733 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561edd6b0 msgr2=0x558561ebaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04eaffd640 1 --2- 172.21.15.50:0/3369953733 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561edd6b0 0x558561ebaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04eaffd640 1 -- 172.21.15.50:0/3369953733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebc920 msgr2=0x558561edb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04eaffd640 1 --2- 172.21.15.50:0/3369953733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebc920 0x558561edb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04eaffd640 1 -- 172.21.15.50:0/3369953733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558561bfc7d0 con 0x558561ebe0b0 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04eaffd640 1 --2- 172.21.15.50:0/3369953733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebe0b0 0x558561edd170 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f04e002a250 tx=0x7f04e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3b7b4bf74af040 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04ca7fc640 1 -- 172.21.15.50:0/3369953733 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e004e070 con 0x558561ebe0b0 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04ca7fc640 1 -- 172.21.15.50:0/3369953733 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f04e0003610 con 0x558561ebe0b0 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04f4bc9740 1 -- 172.21.15.50:0/3369953733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04e0032bb0 con 0x558561ebe0b0 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04ca7fc640 1 -- 172.21.15.50:0/3369953733 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f04e005a050 con 0x558561ebe0b0 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04f4bc9740 10 client.5934 fetch_fsmap learned FSMap version 24 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04f4bc9740 1 -- 172.21.15.50:0/3369953733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x558561b323f0 con 0x558561ebe0b0 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.617+0000 7f04ca7fc640 1 -- 172.21.15.50:0/3369953733 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e0032bb0 con 0x558561ebe0b0 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.618+0000 7f04ca7fc640 1 -- 172.21.15.50:0/3369953733 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f04e005d020 con 0x558561ebe0b0 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.618+0000 7f04f4bc9740 10 client.5934 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.618+0000 7f04f4bc9740 10 client.5934 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.618+0000 7f04f4bc9740 20 client.5934 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.618+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/3369953733 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558561eb60c0 0x558561eb6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.618+0000 7f04f4bc9740 4 client.5934 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.618+0000 7f04f4bc9740 1 -- 172.21.15.50:0/3369953733 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558561e2ce20 con 0x558561eb60c0 2024-09-11T22:14:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.618+0000 7f04eb7fe640 1 --2- 172.21.15.50:0/3369953733 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558561eb60c0 0x558561eb6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.618+0000 7f04ca7fc640 10 client.5934 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.618+0000 7f04eb7fe640 1 --2- 172.21.15.50:0/3369953733 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558561eb60c0 0x558561eb6530 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c01478ad7faf002b server_cookie=fde6f92c9649e496 in_seq=0 out_seq=0 2024-09-11T22:14:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04ca7fc640 1 -- 172.21.15.50:0/3369953733 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558561e2ce20 con 0x558561eb60c0 2024-09-11T22:14:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04ca7fc640 10 client.5934 handle_command_reply: tid=0 2024-09-11T22:14:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04f4bc9740 1 client.5934 shutdown 2024-09-11T22:14:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04f4bc9740 1 -- 172.21.15.50:0/3369953733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebe0b0 msgr2=0x558561edd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/3369953733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebe0b0 0x558561edd170 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f04e002a250 tx=0x7f04e0004730 comp rx=0 tx=0).stop 2024-09-11T22:14:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04f4bc9740 1 -- 172.21.15.50:0/3369953733 shutdown_connections 2024-09-11T22:14:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/3369953733 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561edd6b0 0x558561ebaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/3369953733 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558561eb60c0 0x558561eb6530 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/3369953733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebe0b0 0x558561edd170 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/3369953733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebc920 0x558561edb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04ca7fc640 0 client.5934 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04f4bc9740 1 -- 172.21.15.50:0/3369953733 >> 172.21.15.50:0/3369953733 conn(0x558561eba0e0 msgr2=0x558561eff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04f4bc9740 1 -- 172.21.15.50:0/3369953733 shutdown_connections 2024-09-11T22:14:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04f4bc9740 1 -- 172.21.15.50:0/3369953733 wait complete. 2024-09-11T22:14:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.619+0000 7f04f4bc9740 20 client.5934 trim_cache size 0 max 16384 2024-09-11T22:14:05.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.636+0000 7f04f4bc9740 1 Processor -- start 2024-09-11T22:14:05.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.636+0000 7f04f4bc9740 1 -- start start 2024-09-11T22:14:05.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.637+0000 7f04f4bc9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebc920 0x558561effd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.637+0000 7f04f4bc9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebe0b0 0x558561ede240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.637+0000 7f04f4bc9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561edd6b0 0x558561f1a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.637+0000 7f04f4bc9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec200bc0 con 0x558561edd6b0 2024-09-11T22:14:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.637+0000 7f04f4bc9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec1ffc30 con 0x558561ebe0b0 2024-09-11T22:14:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.637+0000 7f04f4bc9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f04ec1ff040 con 0x558561ebc920 2024-09-11T22:14:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.637+0000 7f04ebfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561edd6b0 0x558561f1a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.637+0000 7f04ebfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561edd6b0 0x558561f1a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37406/0 (socket says 172.21.15.50:37406) 2024-09-11T22:14:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.637+0000 7f04ebfff640 1 -- 172.21.15.50:0/4019531364 learned_addr learned my addr 172.21.15.50:0/4019531364 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.637+0000 7f04ebfff640 1 -- 172.21.15.50:0/4019531364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebc920 msgr2=0x558561effd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.637+0000 7f04ebfff640 1 --2- 172.21.15.50:0/4019531364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebc920 0x558561effd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.637+0000 7f04ebfff640 1 -- 172.21.15.50:0/4019531364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebe0b0 msgr2=0x558561ede240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.638+0000 7f04ebfff640 1 --2- 172.21.15.50:0/4019531364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebe0b0 0x558561ede240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.638+0000 7f04ebfff640 1 -- 172.21.15.50:0/4019531364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558561af20f0 con 0x558561edd6b0 2024-09-11T22:14:05.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.638+0000 7f04ebfff640 1 --2- 172.21.15.50:0/4019531364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561edd6b0 0x558561f1a920 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f04e4017760 tx=0x7f04e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59514f6a6d5f062 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.638+0000 7f04d0ff9640 1 -- 172.21.15.50:0/4019531364 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4003da0 con 0x558561edd6b0 2024-09-11T22:14:05.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.638+0000 7f04d0ff9640 1 -- 172.21.15.50:0/4019531364 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e4015870 con 0x558561edd6b0 2024-09-11T22:14:05.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.638+0000 7f04d0ff9640 1 -- 172.21.15.50:0/4019531364 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4015c40 con 0x558561edd6b0 2024-09-11T22:14:05.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.638+0000 7f04f4bc9740 1 -- 172.21.15.50:0/4019531364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561edd6b0 msgr2=0x558561f1a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.638+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/4019531364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561edd6b0 0x558561f1a920 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f04e4017760 tx=0x7f04e4009750 comp rx=0 tx=0).stop 2024-09-11T22:14:05.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.638+0000 7f04f4bc9740 1 -- 172.21.15.50:0/4019531364 shutdown_connections 2024-09-11T22:14:05.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.638+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/4019531364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561edd6b0 0x558561f1a920 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.638+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/4019531364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561ebe0b0 0x558561ede240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.639+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/4019531364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebc920 0x558561effd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.639+0000 7f04f4bc9740 1 -- 172.21.15.50:0/4019531364 >> 172.21.15.50:0/4019531364 conn(0x558561eba0e0 msgr2=0x558561eb29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.639+0000 7f04f4bc9740 1 -- 172.21.15.50:0/4019531364 shutdown_connections 2024-09-11T22:14:05.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.639+0000 7f04f4bc9740 1 -- 172.21.15.50:0/4019531364 wait complete. 2024-09-11T22:14:05.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.639+0000 7f04f4bc9740 1 -- start start 2024-09-11T22:14:05.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.639+0000 7f04f4bc9740 1 Processor -- start 2024-09-11T22:14:05.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04f4bc9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebc920 0x558561f7f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04f4bc9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebe0b0 0x558561efdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04f4bc9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561edd6b0 0x558561efe4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04f4bc9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558561ee5060 con 0x558561ebc920 2024-09-11T22:14:05.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04f4bc9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec1ff5e0 con 0x558561edd6b0 2024-09-11T22:14:05.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04f4bc9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558561f0eed0 con 0x558561ebe0b0 2024-09-11T22:14:05.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04f4bc9740 10 client.0 _ll_register_callbacks cb 0x7f04e004c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:05.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04eb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebc920 0x558561f7f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04eb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebc920 0x558561f7f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37420/0 (socket says 172.21.15.50:37420) 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04eb7fe640 1 -- 172.21.15.50:0/2269037326 learned_addr learned my addr 172.21.15.50:0/2269037326 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04ebfff640 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561edd6b0 0x558561efe4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04eaffd640 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebe0b0 0x558561efdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04eb7fe640 1 -- 172.21.15.50:0/2269037326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebe0b0 msgr2=0x558561efdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04eb7fe640 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebe0b0 0x558561efdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04eb7fe640 1 -- 172.21.15.50:0/2269037326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561edd6b0 msgr2=0x558561efe4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04eb7fe640 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561edd6b0 0x558561efe4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04eb7fe640 1 -- 172.21.15.50:0/2269037326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558561f0dc10 con 0x558561ebc920 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04ebfff640 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561edd6b0 0x558561efe4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04eaffd640 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebe0b0 0x558561efdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04eb7fe640 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebc920 0x558561f7f8f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f04dc088730 tx=0x7f04dc054770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4304101df36d0c5d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.640+0000 7f04ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04ca7fc640 1 -- 172.21.15.50:0/2269037326 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc088410 con 0x558561ebc920 2024-09-11T22:14:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04ca7fc640 1 -- 172.21.15.50:0/2269037326 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f04dc071e00 con 0x558561ebc920 2024-09-11T22:14:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04f4bc9740 1 -- 172.21.15.50:0/2269037326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04e4015870 con 0x558561ebc920 2024-09-11T22:14:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04ca7fc640 1 -- 172.21.15.50:0/2269037326 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f04dc0567d0 con 0x558561ebc920 2024-09-11T22:14:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04f4bc9740 10 client.5940 fetch_fsmap learned FSMap version 24 2024-09-11T22:14:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04f4bc9740 1 -- 172.21.15.50:0/2269037326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x558561f81340 con 0x558561ebc920 2024-09-11T22:14:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04ca7fc640 1 -- 172.21.15.50:0/2269037326 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e4015870 con 0x558561ebc920 2024-09-11T22:14:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04ca7fc640 1 -- 172.21.15.50:0/2269037326 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7f04dc054b40 con 0x558561ebc920 2024-09-11T22:14:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04f4bc9740 10 client.5940 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T22:14:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04f4bc9740 10 client.5940 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04f4bc9740 20 client.5940 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558561f80260 0x558561f80640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04f4bc9740 4 client.5940 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:14:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04f4bc9740 1 -- 172.21.15.50:0/2269037326 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558561e27170 con 0x558561f80260 2024-09-11T22:14:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04eaffd640 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558561f80260 0x558561f80640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04ca7fc640 10 client.5940 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.641+0000 7f04eaffd640 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558561f80260 0x558561f80640 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cfb3137eace4ec1 server_cookie=6f5d77f30567bfb8 in_seq=0 out_seq=0 2024-09-11T22:14:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04ca7fc640 1 -- 172.21.15.50:0/2269037326 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+284 (crc 0 0 0) 0x558561e27170 con 0x558561f80260 2024-09-11T22:14:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04ca7fc640 10 client.5940 handle_command_reply: tid=0 2024-09-11T22:14:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04f4bc9740 1 client.5940 shutdown 2024-09-11T22:14:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04f4bc9740 1 -- 172.21.15.50:0/2269037326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebc920 msgr2=0x558561f7f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebc920 0x558561f7f8f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f04dc088730 tx=0x7f04dc054770 comp rx=0 tx=0).stop 2024-09-11T22:14:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04f4bc9740 1 -- 172.21.15.50:0/2269037326 shutdown_connections 2024-09-11T22:14:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558561ebe0b0 0x558561efdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x558561f80260 0x558561f80640 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558561edd6b0 0x558561efe4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04f4bc9740 1 --2- 172.21.15.50:0/2269037326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558561ebc920 0x558561f7f8f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04ca7fc640 0 client.5940 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04f4bc9740 1 -- 172.21.15.50:0/2269037326 >> 172.21.15.50:0/2269037326 conn(0x558561eba0e0 msgr2=0x558561f030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04f4bc9740 1 -- 172.21.15.50:0/2269037326 shutdown_connections 2024-09-11T22:14:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04f4bc9740 1 -- 172.21.15.50:0/2269037326 wait complete. 2024-09-11T22:14:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.642+0000 7f04f4bc9740 20 client.5940 trim_cache size 0 max 16384 2024-09-11T22:14:05.649 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:14:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-11T22:14:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "364af705-bb42-4abf-8e7d-fb956193f299": { 2024-09-11T22:14:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-11T22:14:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "364af705-bb42-4abf-8e7d-fb956193f299", 2024-09-11T22:14:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "" 2024-09-11T22:14:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:05.650 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.643+0000 7f04f1e2e640 1 -- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04d806be60 msgr2=0x7f04d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.643+0000 7f04f1e2e640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04d806be60 0x7f04d806e320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f04e0034000 tx=0x7f04e002e000 comp rx=0 tx=0).stop 2024-09-11T22:14:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.643+0000 7f04f1e2e640 1 -- 172.21.15.50:0/62204485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec0d1c90 msgr2=0x7f04ec14fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.643+0000 7f04f1e2e640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec0d1c90 0x7f04ec14fcb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f04dc00c430 tx=0x7f04dc00c830 comp rx=0 tx=0).stop 2024-09-11T22:14:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.643+0000 7f04f1e2e640 1 -- 172.21.15.50:0/62204485 shutdown_connections 2024-09-11T22:14:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.643+0000 7f04f1e2e640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04d806be60 0x7f04d806e320 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.643+0000 7f04f1e2e640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec162350 0x7f04ec15f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.643+0000 7f04f1e2e640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04ec15e8e0 0x7f04ec15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.643+0000 7f04f1e2e640 1 --2- 172.21.15.50:0/62204485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04ec0d1c90 0x7f04ec14fcb0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.643+0000 7f04f1e2e640 1 -- 172.21.15.50:0/62204485 >> 172.21.15.50:0/62204485 conn(0x7f04ec067ba0 msgr2=0x7f04ec15fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.643+0000 7f04f1e2e640 1 -- 172.21.15.50:0/62204485 shutdown_connections 2024-09-11T22:14:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:05.643+0000 7f04f1e2e640 1 -- 172.21.15.50:0/62204485 wait complete. 2024-09-11T22:14:10.654 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-11T22:14:10.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-11T22:14:10.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.772+0000 7f855ac53640 1 Processor -- start 2024-09-11T22:14:10.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.772+0000 7f855ac53640 1 -- start start 2024-09-11T22:14:10.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.772+0000 7f855ac53640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f855415e870 0x7f85540d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.772+0000 7f855ac53640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f85540d3c00 0x7f85540b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.772+0000 7f855ac53640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85540cfa80 con 0x7f85540d16d0 2024-09-11T22:14:10.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.772+0000 7f855ac53640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f85540d1b40 con 0x7f855415e870 2024-09-11T22:14:10.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.772+0000 7f855ac53640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f85540d40d0 con 0x7f85540d3c00 2024-09-11T22:14:10.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.773+0000 7f85589ef640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f855415e870 0x7f85540d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.773+0000 7f85589ef640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f855415e870 0x7f85540d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49894/0 (socket says 172.21.15.50:49894) 2024-09-11T22:14:10.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.773+0000 7f85589ef640 1 -- 172.21.15.50:0/2875315552 learned_addr learned my addr 172.21.15.50:0/2875315552 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:10.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.773+0000 7f8553fff640 1 --1- 172.21.15.50:0/2875315552 >> v1:172.21.15.50:6789/0 conn(0x7f85540d16d0 0x7f85540d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51066/0 (socket says 172.21.15.50:51066) 2024-09-11T22:14:10.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.773+0000 7f85591f0640 1 --2- 172.21.15.50:0/2875315552 >> v2:172.21.15.77:3300/0 conn(0x7f85540d3c00 0x7f85540b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.773+0000 7f85589ef640 1 -- 172.21.15.50:0/2875315552 >> v2:172.21.15.77:3300/0 conn(0x7f85540d3c00 msgr2=0x7f85540b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.773+0000 7f85589ef640 1 --2- 172.21.15.50:0/2875315552 >> v2:172.21.15.77:3300/0 conn(0x7f85540d3c00 0x7f85540b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.773+0000 7f85589ef640 1 -- 172.21.15.50:0/2875315552 >> v1:172.21.15.50:6789/0 conn(0x7f85540d16d0 legacy=0x7f85540d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.773+0000 7f85589ef640 1 -- 172.21.15.50:0/2875315552 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85540d43b0 con 0x7f855415e870 2024-09-11T22:14:10.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.774+0000 7f85589ef640 1 --2- 172.21.15.50:0/2875315552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415e870 0x7f85540d1190 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8554068490 tx=0x7f854402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bc1b7ed67400bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.774+0000 7f85537fe640 1 -- 172.21.15.50:0/2875315552 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544037070 con 0x7f855415e870 2024-09-11T22:14:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.774+0000 7f85537fe640 1 -- 172.21.15.50:0/2875315552 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8544032440 con 0x7f855415e870 2024-09-11T22:14:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.774+0000 7f85537fe640 1 -- 172.21.15.50:0/2875315552 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544032810 con 0x7f855415e870 2024-09-11T22:14:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.774+0000 7f855ac53640 1 -- 172.21.15.50:0/2875315552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415e870 msgr2=0x7f85540d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.774+0000 7f855ac53640 1 --2- 172.21.15.50:0/2875315552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415e870 0x7f85540d1190 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8554068490 tx=0x7f854402a270 comp rx=0 tx=0).stop 2024-09-11T22:14:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.775+0000 7f855ac53640 1 -- 172.21.15.50:0/2875315552 shutdown_connections 2024-09-11T22:14:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.775+0000 7f855ac53640 1 --2- 172.21.15.50:0/2875315552 >> v2:172.21.15.77:3300/0 conn(0x7f85540d3c00 0x7f85540b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.775+0000 7f855ac53640 1 --2- 172.21.15.50:0/2875315552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415e870 0x7f85540d1190 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.775+0000 7f855ac53640 1 -- 172.21.15.50:0/2875315552 >> 172.21.15.50:0/2875315552 conn(0x7f85540727a0 msgr2=0x7f85540679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.775+0000 7f855ac53640 1 -- 172.21.15.50:0/2875315552 shutdown_connections 2024-09-11T22:14:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.775+0000 7f855ac53640 1 -- 172.21.15.50:0/2875315552 wait complete. 2024-09-11T22:14:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.776+0000 7f855ac53640 1 Processor -- start 2024-09-11T22:14:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.776+0000 7f855ac53640 1 -- start start 2024-09-11T22:14:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f855ac53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85540d16d0 0x7f85541f8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f855ac53640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85540d3c00 0x7f85540cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f855ac53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415e870 0x7f8554161430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f855ac53640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f855415ec50 con 0x7f855415e870 2024-09-11T22:14:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f855ac53640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f85540b7ee0 con 0x7f85540d16d0 2024-09-11T22:14:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f855ac53640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f85540b78b0 con 0x7f85540d3c00 2024-09-11T22:14:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f85591f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415e870 0x7f8554161430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f85591f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415e870 0x7f8554161430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49908/0 (socket says 172.21.15.50:49908) 2024-09-11T22:14:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f85591f0640 1 -- 172.21.15.50:0/1079916495 learned_addr learned my addr 172.21.15.50:0/1079916495 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f85589ef640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85540d16d0 0x7f85541f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f8553fff640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85540d3c00 0x7f85540cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f85591f0640 1 -- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85540d3c00 msgr2=0x7f85540cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f85591f0640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85540d3c00 0x7f85540cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f85591f0640 1 -- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85540d16d0 msgr2=0x7f85541f8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f85591f0640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85540d16d0 0x7f85541f8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f85591f0640 1 -- 172.21.15.50:0/1079916495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85541f8810 con 0x7f855415e870 2024-09-11T22:14:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.777+0000 7f8553fff640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85540d3c00 0x7f85540cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.778+0000 7f85591f0640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415e870 0x7f8554161430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f854c007e60 tx=0x7f854c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.778+0000 7f85517fa640 1 -- 172.21.15.50:0/1079916495 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c014620 con 0x7f855415e870 2024-09-11T22:14:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.778+0000 7f85517fa640 1 -- 172.21.15.50:0/1079916495 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c019070 con 0x7f855415e870 2024-09-11T22:14:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.778+0000 7f855ac53640 1 -- 172.21.15.50:0/1079916495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85541f8af0 con 0x7f855415e870 2024-09-11T22:14:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.778+0000 7f85517fa640 1 -- 172.21.15.50:0/1079916495 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c014a00 con 0x7f855415e870 2024-09-11T22:14:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.778+0000 7f855ac53640 1 -- 172.21.15.50:0/1079916495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f855415cd30 con 0x7f855415e870 2024-09-11T22:14:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.779+0000 7f85517fa640 1 -- 172.21.15.50:0/1079916495 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f854c014ba0 con 0x7f855415e870 2024-09-11T22:14:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.780+0000 7f85517fa640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f854006be30 0x7f854006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.780+0000 7f85517fa640 1 -- 172.21.15.50:0/1079916495 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f854c08b7d0 con 0x7f855415e870 2024-09-11T22:14:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.780+0000 7f85589ef640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f854006be30 0x7f854006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.781+0000 7f85589ef640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f854006be30 0x7f854006e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8544034000 tx=0x7f854402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.781+0000 7f855d9e9740 1 Processor -- start 2024-09-11T22:14:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.781+0000 7f855d9e9740 1 -- start start 2024-09-11T22:14:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f855d9e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885fd1920 0x5598860170c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f855d9e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fcf0e0 0x559885fd1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f855d9e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885fcc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f855d9e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559885f346f0 con 0x559885fcf0e0 2024-09-11T22:14:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f855d9e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559885edc330 con 0x559885fd1920 2024-09-11T22:14:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f855d9e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559885f306b0 con 0x559885fd30b0 2024-09-11T22:14:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f8553fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fcf0e0 0x559885fd1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f8553fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fcf0e0 0x559885fd1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49924/0 (socket says 172.21.15.50:49924) 2024-09-11T22:14:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f8553fff640 1 -- 172.21.15.50:0/220168308 learned_addr learned my addr 172.21.15.50:0/220168308 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f85589ef640 1 --2- 172.21.15.50:0/220168308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885fd1920 0x5598860170c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f85591f0640 1 --2- 172.21.15.50:0/220168308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885fcc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f8553fff640 1 -- 172.21.15.50:0/220168308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 msgr2=0x559885fcc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f8553fff640 1 --2- 172.21.15.50:0/220168308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885fcc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f8553fff640 1 -- 172.21.15.50:0/220168308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885fd1920 msgr2=0x5598860170c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f8553fff640 1 --2- 172.21.15.50:0/220168308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885fd1920 0x5598860170c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f8553fff640 1 -- 172.21.15.50:0/220168308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559885f020d0 con 0x559885fcf0e0 2024-09-11T22:14:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f8553fff640 1 --2- 172.21.15.50:0/220168308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fcf0e0 0x559885fd1d00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f85480016b0 tx=0x7f8548001b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdde26438fd4d33 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f853a7fc640 1 -- 172.21.15.50:0/220168308 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85480074e0 con 0x559885fcf0e0 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f853a7fc640 1 -- 172.21.15.50:0/220168308 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8548007680 con 0x559885fcf0e0 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.782+0000 7f853a7fc640 1 -- 172.21.15.50:0/220168308 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548004a00 con 0x559885fcf0e0 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.783+0000 7f855d9e9740 1 -- 172.21.15.50:0/220168308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fcf0e0 msgr2=0x559885fd1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.783+0000 7f855d9e9740 1 --2- 172.21.15.50:0/220168308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fcf0e0 0x559885fd1d00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f85480016b0 tx=0x7f8548001b70 comp rx=0 tx=0).stop 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.783+0000 7f855d9e9740 1 -- 172.21.15.50:0/220168308 shutdown_connections 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.783+0000 7f855d9e9740 1 --2- 172.21.15.50:0/220168308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885fcc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.783+0000 7f855d9e9740 1 --2- 172.21.15.50:0/220168308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fcf0e0 0x559885fd1d00 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.783+0000 7f855d9e9740 1 --2- 172.21.15.50:0/220168308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885fd1920 0x5598860170c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.783+0000 7f855d9e9740 1 -- 172.21.15.50:0/220168308 >> 172.21.15.50:0/220168308 conn(0x559885fce370 msgr2=0x559886016590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.783+0000 7f855d9e9740 1 -- 172.21.15.50:0/220168308 shutdown_connections 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.783+0000 7f855d9e9740 1 -- 172.21.15.50:0/220168308 wait complete. 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.784+0000 7f855d9e9740 1 -- start start 2024-09-11T22:14:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.784+0000 7f855d9e9740 1 Processor -- start 2024-09-11T22:14:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f855d9e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885fd1920 0x559885fe7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f855d9e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885ffc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f855d9e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885ff55f0 0x559885ff5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f855d9e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559885fcd810 con 0x559885ff55f0 2024-09-11T22:14:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f855d9e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559885ebd4f0 con 0x559885fd1920 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f855d9e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5598860178f0 con 0x559885fd30b0 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f855d9e9740 10 client.0 _ll_register_callbacks cb 0x559885edeb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f85591f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885ff55f0 0x559885ff5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f85591f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885ff55f0 0x559885ff5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49932/0 (socket says 172.21.15.50:49932) 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f85591f0640 1 -- 172.21.15.50:0/1556927379 learned_addr learned my addr 172.21.15.50:0/1556927379 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f8553fff640 1 --2- 172.21.15.50:0/1556927379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885ffc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f85589ef640 1 --2- 172.21.15.50:0/1556927379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885fd1920 0x559885fe7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f85591f0640 1 -- 172.21.15.50:0/1556927379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 msgr2=0x559885ffc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f85591f0640 1 --2- 172.21.15.50:0/1556927379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885ffc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f85591f0640 1 -- 172.21.15.50:0/1556927379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885fd1920 msgr2=0x559885fe7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f85591f0640 1 --2- 172.21.15.50:0/1556927379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885fd1920 0x559885fe7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f85591f0640 1 -- 172.21.15.50:0/1556927379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559885d117d0 con 0x559885ff55f0 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f85591f0640 1 --2- 172.21.15.50:0/1556927379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885ff55f0 0x559885ff5a70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f854c089cb0 tx=0x7f854c0594a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f28de3aeb8b1e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.785+0000 7f85337fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f85337fe640 1 -- 172.21.15.50:0/1556927379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c062180 con 0x559885ff55f0 2024-09-11T22:14:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f85337fe640 1 -- 172.21.15.50:0/1556927379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f854c062320 con 0x559885ff55f0 2024-09-11T22:14:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f855d9e9740 1 -- 172.21.15.50:0/1556927379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8548007680 con 0x559885ff55f0 2024-09-11T22:14:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f85337fe640 1 -- 172.21.15.50:0/1556927379 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f854c058e80 con 0x559885ff55f0 2024-09-11T22:14:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f855d9e9740 10 client.5955 fetch_fsmap learned FSMap version 25 2024-09-11T22:14:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f855d9e9740 1 -- 172.21.15.50:0/1556927379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x559885c473f0 con 0x559885ff55f0 2024-09-11T22:14:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f85337fe640 1 -- 172.21.15.50:0/1556927379 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8548007680 con 0x559885ff55f0 2024-09-11T22:14:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f85337fe640 1 -- 172.21.15.50:0/1556927379 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f854c059020 con 0x559885ff55f0 2024-09-11T22:14:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f855d9e9740 10 client.5955 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:14:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f855d9e9740 10 client.5955 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f855d9e9740 20 client.5955 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f855d9e9740 1 --2- 172.21.15.50:0/1556927379 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55988602a3c0 0x55988602a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f855d9e9740 4 client.5955 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f855d9e9740 1 -- 172.21.15.50:0/1556927379 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559885f41e20 con 0x55988602a3c0 2024-09-11T22:14:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.786+0000 7f85589ef640 1 --2- 172.21.15.50:0/1556927379 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55988602a3c0 0x55988602a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.787+0000 7f85589ef640 1 --2- 172.21.15.50:0/1556927379 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55988602a3c0 0x55988602a7c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e52abb3b1c2d0d42 server_cookie=d778090f3558fa7d in_seq=0 out_seq=0 2024-09-11T22:14:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.787+0000 7f85337fe640 10 client.5955 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.787+0000 7f85337fe640 1 -- 172.21.15.50:0/1556927379 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559885f41e20 con 0x55988602a3c0 2024-09-11T22:14:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.787+0000 7f85337fe640 10 client.5955 handle_command_reply: tid=0 2024-09-11T22:14:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.787+0000 7f855d9e9740 1 client.5955 shutdown 2024-09-11T22:14:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.787+0000 7f855d9e9740 1 -- 172.21.15.50:0/1556927379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885ff55f0 msgr2=0x559885ff5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.787+0000 7f855d9e9740 1 --2- 172.21.15.50:0/1556927379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885ff55f0 0x559885ff5a70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f854c089cb0 tx=0x7f854c0594a0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.787+0000 7f855d9e9740 1 -- 172.21.15.50:0/1556927379 shutdown_connections 2024-09-11T22:14:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.787+0000 7f855d9e9740 1 --2- 172.21.15.50:0/1556927379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885ffc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.787+0000 7f855d9e9740 1 --2- 172.21.15.50:0/1556927379 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55988602a3c0 0x55988602a7c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.787+0000 7f855d9e9740 1 --2- 172.21.15.50:0/1556927379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885ff55f0 0x559885ff5a70 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.787+0000 7f855d9e9740 1 --2- 172.21.15.50:0/1556927379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885fd1920 0x559885fe7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.788+0000 7f855d9e9740 1 -- 172.21.15.50:0/1556927379 >> 172.21.15.50:0/1556927379 conn(0x559885fcf0e0 msgr2=0x559885fcf680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.787+0000 7f85337fe640 0 client.5955 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.788+0000 7f855d9e9740 1 -- 172.21.15.50:0/1556927379 shutdown_connections 2024-09-11T22:14:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.788+0000 7f855d9e9740 1 -- 172.21.15.50:0/1556927379 wait complete. 2024-09-11T22:14:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.788+0000 7f855d9e9740 20 client.5955 trim_cache size 0 max 16384 2024-09-11T22:14:10.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.805+0000 7f855d9e9740 1 Processor -- start 2024-09-11T22:14:10.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.805+0000 7f855d9e9740 1 -- start start 2024-09-11T22:14:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f855d9e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 0x559885fe7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f855d9e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885fe7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f855d9e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885ff55f0 0x559886016490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f855d9e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8554200d80 con 0x559885fd1920 2024-09-11T22:14:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f855d9e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f855415f780 con 0x559885ff55f0 2024-09-11T22:14:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f855d9e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f855415dd50 con 0x559885fd30b0 2024-09-11T22:14:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f85589ef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 0x559885fe7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f85589ef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 0x559885fe7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49948/0 (socket says 172.21.15.50:49948) 2024-09-11T22:14:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f85589ef640 1 -- 172.21.15.50:0/1094108088 learned_addr learned my addr 172.21.15.50:0/1094108088 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f85591f0640 1 --2- 172.21.15.50:0/1094108088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885ff55f0 0x559886016490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f8553fff640 1 --2- 172.21.15.50:0/1094108088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885fe7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f85589ef640 1 -- 172.21.15.50:0/1094108088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 msgr2=0x559885fe7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f85589ef640 1 --2- 172.21.15.50:0/1094108088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885fe7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f85589ef640 1 -- 172.21.15.50:0/1094108088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885ff55f0 msgr2=0x559886016490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f85589ef640 1 --2- 172.21.15.50:0/1094108088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885ff55f0 0x559886016490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f85589ef640 1 -- 172.21.15.50:0/1094108088 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559885c070f0 con 0x559885fd1920 2024-09-11T22:14:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.806+0000 7f85589ef640 1 --2- 172.21.15.50:0/1094108088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 0x559885fe7850 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8544000c00 tx=0x7f854402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9087d60949cd1b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.807+0000 7f8539ffb640 1 -- 172.21.15.50:0/1094108088 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544037040 con 0x559885fd1920 2024-09-11T22:14:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.807+0000 7f8539ffb640 1 -- 172.21.15.50:0/1094108088 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854403e5e0 con 0x559885fd1920 2024-09-11T22:14:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.807+0000 7f8539ffb640 1 -- 172.21.15.50:0/1094108088 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854403e990 con 0x559885fd1920 2024-09-11T22:14:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.807+0000 7f855d9e9740 1 -- 172.21.15.50:0/1094108088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 msgr2=0x559885fe7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.807+0000 7f855d9e9740 1 --2- 172.21.15.50:0/1094108088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 0x559885fe7850 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8544000c00 tx=0x7f854402c000 comp rx=0 tx=0).stop 2024-09-11T22:14:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.807+0000 7f855d9e9740 1 -- 172.21.15.50:0/1094108088 shutdown_connections 2024-09-11T22:14:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.807+0000 7f855d9e9740 1 --2- 172.21.15.50:0/1094108088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885fe7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.807+0000 7f855d9e9740 1 --2- 172.21.15.50:0/1094108088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885ff55f0 0x559886016490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.807+0000 7f855d9e9740 1 --2- 172.21.15.50:0/1094108088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 0x559885fe7850 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.807+0000 7f855d9e9740 1 -- 172.21.15.50:0/1094108088 >> 172.21.15.50:0/1094108088 conn(0x559885fcf0e0 msgr2=0x559885fe15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.807+0000 7f855d9e9740 1 -- 172.21.15.50:0/1094108088 shutdown_connections 2024-09-11T22:14:10.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.807+0000 7f855d9e9740 1 -- 172.21.15.50:0/1094108088 wait complete. 2024-09-11T22:14:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.808+0000 7f855d9e9740 1 -- start start 2024-09-11T22:14:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.808+0000 7f855d9e9740 1 Processor -- start 2024-09-11T22:14:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f855d9e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 0x559886094870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f855d9e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885fe79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f855d9e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885ff55f0 0x559886095880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f855d9e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559885ff96d0 con 0x559885fd1920 2024-09-11T22:14:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f855d9e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f855415f130 con 0x559885ff55f0 2024-09-11T22:14:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f855d9e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559886015fe0 con 0x559885fd30b0 2024-09-11T22:14:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f855d9e9740 10 client.0 _ll_register_callbacks cb 0x7f854c08b040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f85589ef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 0x559886094870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f85589ef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 0x559886094870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49950/0 (socket says 172.21.15.50:49950) 2024-09-11T22:14:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f85589ef640 1 -- 172.21.15.50:0/3851251103 learned_addr learned my addr 172.21.15.50:0/3851251103 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f8553fff640 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885fe79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f85591f0640 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885ff55f0 0x559886095880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f85589ef640 1 -- 172.21.15.50:0/3851251103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 msgr2=0x559885fe79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f85589ef640 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885fe79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f85589ef640 1 -- 172.21.15.50:0/3851251103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885ff55f0 msgr2=0x559886095880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f85589ef640 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885ff55f0 0x559886095880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f85589ef640 1 -- 172.21.15.50:0/3851251103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55988602b220 con 0x559885fd1920 2024-09-11T22:14:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f85591f0640 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885ff55f0 0x559886095880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f8553fff640 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885fe79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f85589ef640 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 0x559886094870 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8544000c00 tx=0x7f8544004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670bb801c88da6e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.809+0000 7f85337fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f85337fe640 1 -- 172.21.15.50:0/3851251103 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544037070 con 0x559885fd1920 2024-09-11T22:14:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f85337fe640 1 -- 172.21.15.50:0/3851251103 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f854403e950 con 0x559885fd1920 2024-09-11T22:14:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f855d9e9740 1 -- 172.21.15.50:0/3851251103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f854403e5e0 con 0x559885fd1920 2024-09-11T22:14:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f85337fe640 1 -- 172.21.15.50:0/3851251103 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8544065050 con 0x559885fd1920 2024-09-11T22:14:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f855d9e9740 10 client.5961 fetch_fsmap learned FSMap version 25 2024-09-11T22:14:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f855d9e9740 1 -- 172.21.15.50:0/3851251103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55988603af00 con 0x559885fd1920 2024-09-11T22:14:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f85337fe640 1 -- 172.21.15.50:0/3851251103 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854403e5e0 con 0x559885fd1920 2024-09-11T22:14:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f85337fe640 1 -- 172.21.15.50:0/3851251103 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f8544068020 con 0x559885fd1920 2024-09-11T22:14:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f855d9e9740 10 client.5961 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:14:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f855d9e9740 10 client.5961 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f855d9e9740 20 client.5961 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f855d9e9740 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5598860191b0 0x559885ff28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f855d9e9740 4 client.5961 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:14:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f855d9e9740 1 -- 172.21.15.50:0/3851251103 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559885f3c170 con 0x5598860191b0 2024-09-11T22:14:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.810+0000 7f8553fff640 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5598860191b0 0x559885ff28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f85337fe640 10 client.5961 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f8553fff640 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5598860191b0 0x559885ff28b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c1bc3ca5539a3b5 server_cookie=1b502fc3ed9f7853 in_seq=0 out_seq=0 2024-09-11T22:14:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f85337fe640 1 -- 172.21.15.50:0/3851251103 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559885f3c170 con 0x5598860191b0 2024-09-11T22:14:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f85337fe640 10 client.5961 handle_command_reply: tid=0 2024-09-11T22:14:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f855d9e9740 1 client.5961 shutdown 2024-09-11T22:14:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f855d9e9740 1 -- 172.21.15.50:0/3851251103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 msgr2=0x559886094870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f855d9e9740 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 0x559886094870 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8544000c00 tx=0x7f8544004730 comp rx=0 tx=0).stop 2024-09-11T22:14:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f855d9e9740 1 -- 172.21.15.50:0/3851251103 shutdown_connections 2024-09-11T22:14:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f855d9e9740 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559885fd30b0 0x559885fe79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f855d9e9740 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x5598860191b0 0x559885ff28b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f855d9e9740 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559885ff55f0 0x559886095880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f855d9e9740 1 --2- 172.21.15.50:0/3851251103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559885fd1920 0x559886094870 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f855d9e9740 1 -- 172.21.15.50:0/3851251103 >> 172.21.15.50:0/3851251103 conn(0x559885fcf0e0 msgr2=0x559886013900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f85337fe640 0 client.5961 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:10.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f855d9e9740 1 -- 172.21.15.50:0/3851251103 shutdown_connections 2024-09-11T22:14:10.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f855d9e9740 1 -- 172.21.15.50:0/3851251103 wait complete. 2024-09-11T22:14:10.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.811+0000 7f855d9e9740 20 client.5961 trim_cache size 0 max 16384 2024-09-11T22:14:10.824 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-11T22:14:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-11T22:14:10.824 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:10.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.812+0000 7f855ac53640 1 -- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f854006be30 msgr2=0x7f854006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.812+0000 7f855ac53640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f854006be30 0x7f854006e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8544034000 tx=0x7f854402e000 comp rx=0 tx=0).stop 2024-09-11T22:14:10.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.812+0000 7f855ac53640 1 -- 172.21.15.50:0/1079916495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415e870 msgr2=0x7f8554161430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.812+0000 7f855ac53640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415e870 0x7f8554161430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f854c007e60 tx=0x7f854c00e4b0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.812+0000 7f855ac53640 1 -- 172.21.15.50:0/1079916495 shutdown_connections 2024-09-11T22:14:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.812+0000 7f855ac53640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f854006be30 0x7f854006e2f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.812+0000 7f855ac53640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85540d3c00 0x7f85540cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.812+0000 7f855ac53640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415e870 0x7f8554161430 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.812+0000 7f855ac53640 1 --2- 172.21.15.50:0/1079916495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85540d16d0 0x7f85541f8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.812+0000 7f855ac53640 1 -- 172.21.15.50:0/1079916495 >> 172.21.15.50:0/1079916495 conn(0x7f85540727a0 msgr2=0x7f85540d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.812+0000 7f855ac53640 1 -- 172.21.15.50:0/1079916495 shutdown_connections 2024-09-11T22:14:10.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.812+0000 7f855ac53640 1 -- 172.21.15.50:0/1079916495 wait complete. 2024-09-11T22:14:10.826 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:14:10.826 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-11T22:14:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.930+0000 7fbb95f11640 1 Processor -- start 2024-09-11T22:14:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.930+0000 7fbb95f11640 1 -- start start 2024-09-11T22:14:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.931+0000 7fbb95f11640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb900d1c90 0x7fbb900b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.931+0000 7fbb95f11640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb90163080 con 0x7fbb9015e8e0 2024-09-11T22:14:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.931+0000 7fbb95f11640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb900d2d20 con 0x7fbb90162350 2024-09-11T22:14:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.931+0000 7fbb95f11640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fbb9015ecc0 con 0x7fbb900d1c90 2024-09-11T22:14:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.931+0000 7fbb8effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb900d1c90 0x7fbb900b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.931+0000 7fbb8f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbb9015e8e0 0x7fbb900d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51068/0 (socket says 172.21.15.50:51068) 2024-09-11T22:14:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.931+0000 7fbb8f7fe640 1 -- 172.21.15.50:0/1947767400 learned_addr learned my addr 172.21.15.50:0/1947767400 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.931+0000 7fbb8effd640 1 -- 172.21.15.50:0/1947767400 >> v1:172.21.15.77:6789/0 conn(0x7fbb90162350 legacy=0x7fbb901627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.931+0000 7fbb8effd640 1 -- 172.21.15.50:0/1947767400 >> v1:172.21.15.50:6789/0 conn(0x7fbb9015e8e0 legacy=0x7fbb900d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.931+0000 7fbb8effd640 1 -- 172.21.15.50:0/1947767400 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb900d3000 con 0x7fbb900d1c90 2024-09-11T22:14:10.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.931+0000 7fbb8e7fc640 1 -- 172.21.15.50:0/1947767400 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1336191669 0 0) 0x7fbb90163080 con 0x7fbb9015e8e0 2024-09-11T22:14:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.932+0000 7fbb8effd640 1 --2- 172.21.15.50:0/1947767400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb900d1c90 0x7fbb900b7880 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbb840097a0 tx=0x7fbb8402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd70528f3ceda6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.932+0000 7fbb8e7fc640 1 -- 172.21.15.50:0/1947767400 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84037070 con 0x7fbb900d1c90 2024-09-11T22:14:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.932+0000 7fbb8e7fc640 1 -- 172.21.15.50:0/1947767400 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb84032640 con 0x7fbb900d1c90 2024-09-11T22:14:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.932+0000 7fbb8e7fc640 1 -- 172.21.15.50:0/1947767400 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84032a10 con 0x7fbb900d1c90 2024-09-11T22:14:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.933+0000 7fbb95f11640 1 -- 172.21.15.50:0/1947767400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb900d1c90 msgr2=0x7fbb900b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.933+0000 7fbb95f11640 1 --2- 172.21.15.50:0/1947767400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb900d1c90 0x7fbb900b7880 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbb840097a0 tx=0x7fbb8402a2c0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.933+0000 7fbb95f11640 1 -- 172.21.15.50:0/1947767400 shutdown_connections 2024-09-11T22:14:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.933+0000 7fbb95f11640 1 --2- 172.21.15.50:0/1947767400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb900d1c90 0x7fbb900b7880 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.933+0000 7fbb95f11640 1 -- 172.21.15.50:0/1947767400 >> 172.21.15.50:0/1947767400 conn(0x7fbb90067ba0 msgr2=0x7fbb90067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.933+0000 7fbb95f11640 1 -- 172.21.15.50:0/1947767400 shutdown_connections 2024-09-11T22:14:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.933+0000 7fbb95f11640 1 -- 172.21.15.50:0/1947767400 wait complete. 2024-09-11T22:14:10.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.934+0000 7fbb95f11640 1 Processor -- start 2024-09-11T22:14:10.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.934+0000 7fbb95f11640 1 -- start start 2024-09-11T22:14:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.935+0000 7fbb95f11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb900d1c90 0x7fbb901595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.935+0000 7fbb95f11640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb9015e8e0 0x7fbb90154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.935+0000 7fbb95f11640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb90162350 0x7fbb901609a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.935+0000 7fbb95f11640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb900d3c10 con 0x7fbb9015e8e0 2024-09-11T22:14:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.935+0000 7fbb95f11640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb900d3a90 con 0x7fbb900d1c90 2024-09-11T22:14:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.935+0000 7fbb95f11640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbb900d3d90 con 0x7fbb90162350 2024-09-11T22:14:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.935+0000 7fbb8effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb9015e8e0 0x7fbb90154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.935+0000 7fbb8effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb9015e8e0 0x7fbb90154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49962/0 (socket says 172.21.15.50:49962) 2024-09-11T22:14:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.935+0000 7fbb8effd640 1 -- 172.21.15.50:0/474984435 learned_addr learned my addr 172.21.15.50:0/474984435 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.935+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb900d1c90 0x7fbb901595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.935+0000 7fbb8ffff640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb90162350 0x7fbb901609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.935+0000 7fbb8effd640 1 -- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb90162350 msgr2=0x7fbb901609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.935+0000 7fbb8effd640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb90162350 0x7fbb901609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.936+0000 7fbb8effd640 1 -- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb900d1c90 msgr2=0x7fbb901595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.936+0000 7fbb8effd640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb900d1c90 0x7fbb901595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.936+0000 7fbb8effd640 1 -- 172.21.15.50:0/474984435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9015ae40 con 0x7fbb9015e8e0 2024-09-11T22:14:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.936+0000 7fbb8effd640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb9015e8e0 0x7fbb90154d70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbb84035040 tx=0x7fbb840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.936+0000 7fbb77fff640 1 -- 172.21.15.50:0/474984435 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84041030 con 0x7fbb9015e8e0 2024-09-11T22:14:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.936+0000 7fbb77fff640 1 -- 172.21.15.50:0/474984435 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb84030750 con 0x7fbb9015e8e0 2024-09-11T22:14:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.936+0000 7fbb95f11640 1 -- 172.21.15.50:0/474984435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb900b9220 con 0x7fbb9015e8e0 2024-09-11T22:14:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.936+0000 7fbb77fff640 1 -- 172.21.15.50:0/474984435 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84037040 con 0x7fbb9015e8e0 2024-09-11T22:14:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.936+0000 7fbb95f11640 1 -- 172.21.15.50:0/474984435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb900b97a0 con 0x7fbb9015e8e0 2024-09-11T22:14:10.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.937+0000 7fbb77fff640 1 -- 172.21.15.50:0/474984435 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb84044070 con 0x7fbb9015e8e0 2024-09-11T22:14:10.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.938+0000 7fbb77fff640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb7c06be60 0x7fbb7c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.938+0000 7fbb77fff640 1 -- 172.21.15.50:0/474984435 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fbb840ab570 con 0x7fbb9015e8e0 2024-09-11T22:14:10.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.938+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb7c06be60 0x7fbb7c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.939+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb7c06be60 0x7fbb7c06e320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb80007f70 tx=0x7fbb80007f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.939+0000 7fbb98ca9740 1 Processor -- start 2024-09-11T22:14:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.939+0000 7fbb98ca9740 1 -- start start 2024-09-11T22:14:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb98ca9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 0x56076e1ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb98ca9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1fcd90 0x56076e1fe920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb98ca9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1fd1f0 0x56076e1df550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb98ca9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56076e11b5d0 con 0x56076e1ff5d0 2024-09-11T22:14:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb98ca9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56076e0c3470 con 0x56076e1fcd90 2024-09-11T22:14:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb98ca9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56076e117590 con 0x56076e1fd1f0 2024-09-11T22:14:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 0x56076e1ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 0x56076e1ff9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49976/0 (socket says 172.21.15.50:49976) 2024-09-11T22:14:10.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb8f7fe640 1 -- 172.21.15.50:0/3306830512 learned_addr learned my addr 172.21.15.50:0/3306830512 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:10.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb8effd640 1 --2- 172.21.15.50:0/3306830512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1fcd90 0x56076e1fe920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb8ffff640 1 --2- 172.21.15.50:0/3306830512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1fd1f0 0x56076e1df550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb8f7fe640 1 -- 172.21.15.50:0/3306830512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1fd1f0 msgr2=0x56076e1df550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/3306830512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1fd1f0 0x56076e1df550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb8f7fe640 1 -- 172.21.15.50:0/3306830512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1fcd90 msgr2=0x56076e1fe920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/3306830512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1fcd90 0x56076e1fe920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb8f7fe640 1 -- 172.21.15.50:0/3306830512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56076e0ab860 con 0x56076e1ff5d0 2024-09-11T22:14:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/3306830512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 0x56076e1ff9b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbb80001880 tx=0x7fbb80013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8366f31caa2c2e11 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb757fa640 1 -- 172.21.15.50:0/3306830512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80026070 con 0x56076e1ff5d0 2024-09-11T22:14:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb757fa640 1 -- 172.21.15.50:0/3306830512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb80013b80 con 0x56076e1ff5d0 2024-09-11T22:14:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.940+0000 7fbb757fa640 1 -- 172.21.15.50:0/3306830512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80001d40 con 0x56076e1ff5d0 2024-09-11T22:14:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.941+0000 7fbb98ca9740 1 -- 172.21.15.50:0/3306830512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 msgr2=0x56076e1ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.941+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/3306830512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 0x56076e1ff9b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbb80001880 tx=0x7fbb80013000 comp rx=0 tx=0).stop 2024-09-11T22:14:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.941+0000 7fbb98ca9740 1 -- 172.21.15.50:0/3306830512 shutdown_connections 2024-09-11T22:14:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.941+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/3306830512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1fd1f0 0x56076e1df550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.941+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/3306830512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1fcd90 0x56076e1fe920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.941+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/3306830512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 0x56076e1ff9b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.941+0000 7fbb98ca9740 1 -- 172.21.15.50:0/3306830512 >> 172.21.15.50:0/3306830512 conn(0x56076e1b5230 msgr2=0x56076e1fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.941+0000 7fbb98ca9740 1 -- 172.21.15.50:0/3306830512 shutdown_connections 2024-09-11T22:14:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.941+0000 7fbb98ca9740 1 -- 172.21.15.50:0/3306830512 wait complete. 2024-09-11T22:14:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.942+0000 7fbb98ca9740 1 -- start start 2024-09-11T22:14:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.942+0000 7fbb98ca9740 1 Processor -- start 2024-09-11T22:14:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb98ca9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1fd1f0 0x56076e1e1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb98ca9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1ff5d0 0x56076e1b8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb98ca9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1dbd60 0x56076e1f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb98ca9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56076e1fbcf0 con 0x56076e1dbd60 2024-09-11T22:14:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb98ca9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56076e0a4620 con 0x56076e1fd1f0 2024-09-11T22:14:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb98ca9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56076e1fbfd0 con 0x56076e1ff5d0 2024-09-11T22:14:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb98ca9740 10 client.0 _ll_register_callbacks cb 0x56076e0c85b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb8ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1dbd60 0x56076e1f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb8ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1dbd60 0x56076e1f4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49992/0 (socket says 172.21.15.50:49992) 2024-09-11T22:14:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb8ffff640 1 -- 172.21.15.50:0/1998222290 learned_addr learned my addr 172.21.15.50:0/1998222290 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb8effd640 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1ff5d0 0x56076e1b8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1fd1f0 0x56076e1e1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb8ffff640 1 -- 172.21.15.50:0/1998222290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1ff5d0 msgr2=0x56076e1b8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb8ffff640 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1ff5d0 0x56076e1b8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb8ffff640 1 -- 172.21.15.50:0/1998222290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1fd1f0 msgr2=0x56076e1e1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb8ffff640 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1fd1f0 0x56076e1e1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb8ffff640 1 -- 172.21.15.50:0/1998222290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56076de2e3f0 con 0x56076e1dbd60 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1fd1f0 0x56076e1e1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb8ffff640 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1dbd60 0x56076e1f4e90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbb88012570 tx=0x7fbb88012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ff7876ea7e7423 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb6e7fc640 1 -- 172.21.15.50:0/1998222290 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb88006d60 con 0x56076e1dbd60 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb6e7fc640 1 -- 172.21.15.50:0/1998222290 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fbb88003970 con 0x56076e1dbd60 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.943+0000 7fbb98ca9740 1 -- 172.21.15.50:0/1998222290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb80013b80 con 0x56076e1dbd60 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb6e7fc640 1 -- 172.21.15.50:0/1998222290 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbb88003b70 con 0x56076e1dbd60 2024-09-11T22:14:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb98ca9740 10 client.5976 fetch_fsmap learned FSMap version 25 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb98ca9740 1 -- 172.21.15.50:0/1998222290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x56076def87d0 con 0x56076e1dbd60 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb6e7fc640 1 -- 172.21.15.50:0/1998222290 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb80013b80 con 0x56076e1dbd60 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb6e7fc640 1 -- 172.21.15.50:0/1998222290 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fbb88005110 con 0x56076e1dbd60 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb98ca9740 10 client.5976 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb98ca9740 10 client.5976 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb98ca9740 20 client.5976 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56076e1f53d0 0x56076e1f6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb98ca9740 4 client.5976 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb98ca9740 1 -- 172.21.15.50:0/1998222290 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56076e17a030 con 0x56076e1f53d0 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56076e1f53d0 0x56076e1f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56076e1f53d0 0x56076e1f6090 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cc75b15953e5e99 server_cookie=b12b58e4e507a41e in_seq=0 out_seq=0 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.944+0000 7fbb6e7fc640 10 client.5976 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb6e7fc640 1 -- 172.21.15.50:0/1998222290 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56076e17a030 con 0x56076e1f53d0 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb6e7fc640 10 client.5976 handle_command_reply: tid=0 2024-09-11T22:14:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb98ca9740 1 client.5976 shutdown 2024-09-11T22:14:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb98ca9740 1 -- 172.21.15.50:0/1998222290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1dbd60 msgr2=0x56076e1f4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1dbd60 0x56076e1f4e90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbb88012570 tx=0x7fbb88012a30 comp rx=0 tx=0).stop 2024-09-11T22:14:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb98ca9740 1 -- 172.21.15.50:0/1998222290 shutdown_connections 2024-09-11T22:14:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1ff5d0 0x56076e1b8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56076e1f53d0 0x56076e1f6090 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1dbd60 0x56076e1f4e90 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/1998222290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1fd1f0 0x56076e1e1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb6e7fc640 0 client.5976 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb98ca9740 1 -- 172.21.15.50:0/1998222290 >> 172.21.15.50:0/1998222290 conn(0x56076e1fcd90 msgr2=0x56076e1fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb98ca9740 1 -- 172.21.15.50:0/1998222290 shutdown_connections 2024-09-11T22:14:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb98ca9740 1 -- 172.21.15.50:0/1998222290 wait complete. 2024-09-11T22:14:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.945+0000 7fbb98ca9740 20 client.5976 trim_cache size 0 max 16384 2024-09-11T22:14:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.959+0000 7fbb98ca9740 1 Processor -- start 2024-09-11T22:14:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.959+0000 7fbb98ca9740 1 -- start start 2024-09-11T22:14:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.959+0000 7fbb98ca9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1dbd60 0x56076e1b9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.959+0000 7fbb98ca9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1fd1f0 0x56076e271de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.959+0000 7fbb98ca9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 0x56076e1fd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.959+0000 7fbb98ca9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb90200c60 con 0x56076e1ff5d0 2024-09-11T22:14:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.959+0000 7fbb98ca9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb901ffc80 con 0x56076e1dbd60 2024-09-11T22:14:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.959+0000 7fbb98ca9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbb900b69c0 con 0x56076e1fd1f0 2024-09-11T22:14:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb8ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 0x56076e1fd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb8ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 0x56076e1fd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49996/0 (socket says 172.21.15.50:49996) 2024-09-11T22:14:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb8ffff640 1 -- 172.21.15.50:0/1972822987 learned_addr learned my addr 172.21.15.50:0/1972822987 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/1972822987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1dbd60 0x56076e1b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb8effd640 1 --2- 172.21.15.50:0/1972822987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1fd1f0 0x56076e271de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb8ffff640 1 -- 172.21.15.50:0/1972822987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1fd1f0 msgr2=0x56076e271de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb8ffff640 1 --2- 172.21.15.50:0/1972822987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1fd1f0 0x56076e271de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb8ffff640 1 -- 172.21.15.50:0/1972822987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1dbd60 msgr2=0x56076e1b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb8ffff640 1 --2- 172.21.15.50:0/1972822987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1dbd60 0x56076e1b9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb8ffff640 1 -- 172.21.15.50:0/1972822987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56076e1fbc50 con 0x56076e1ff5d0 2024-09-11T22:14:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb8ffff640 1 --2- 172.21.15.50:0/1972822987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 0x56076e1fd5f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbb880019a0 tx=0x7fbb8800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3f2fc615b87b9c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb74ff9640 1 -- 172.21.15.50:0/1972822987 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb880050f0 con 0x56076e1ff5d0 2024-09-11T22:14:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb74ff9640 1 -- 172.21.15.50:0/1972822987 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb880104c0 con 0x56076e1ff5d0 2024-09-11T22:14:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.960+0000 7fbb74ff9640 1 -- 172.21.15.50:0/1972822987 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb88005290 con 0x56076e1ff5d0 2024-09-11T22:14:10.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.961+0000 7fbb98ca9740 1 -- 172.21.15.50:0/1972822987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 msgr2=0x56076e1fd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.961+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/1972822987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 0x56076e1fd5f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbb880019a0 tx=0x7fbb8800c000 comp rx=0 tx=0).stop 2024-09-11T22:14:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.961+0000 7fbb98ca9740 1 -- 172.21.15.50:0/1972822987 shutdown_connections 2024-09-11T22:14:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.961+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/1972822987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1fd1f0 0x56076e271de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.961+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/1972822987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1ff5d0 0x56076e1fd5f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.961+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/1972822987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1dbd60 0x56076e1b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.961+0000 7fbb98ca9740 1 -- 172.21.15.50:0/1972822987 >> 172.21.15.50:0/1972822987 conn(0x56076e1fcd90 msgr2=0x56076e1b8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.961+0000 7fbb98ca9740 1 -- 172.21.15.50:0/1972822987 shutdown_connections 2024-09-11T22:14:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.961+0000 7fbb98ca9740 1 -- 172.21.15.50:0/1972822987 wait complete. 2024-09-11T22:14:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.961+0000 7fbb98ca9740 1 -- start start 2024-09-11T22:14:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.961+0000 7fbb98ca9740 1 Processor -- start 2024-09-11T22:14:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.962+0000 7fbb98ca9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1dbd60 0x56076e26fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.962+0000 7fbb98ca9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1fd1f0 0x56076e20faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.962+0000 7fbb98ca9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1ff5d0 0x56076e20ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.962+0000 7fbb98ca9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56076e221550 con 0x56076e1fd1f0 2024-09-11T22:14:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.962+0000 7fbb98ca9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb900b7010 con 0x56076e1dbd60 2024-09-11T22:14:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.962+0000 7fbb98ca9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56076e20d640 con 0x56076e1ff5d0 2024-09-11T22:14:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.962+0000 7fbb98ca9740 10 client.0 _ll_register_callbacks cb 0x7fbb88002170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.962+0000 7fbb8effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1fd1f0 0x56076e20faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.962+0000 7fbb8effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1fd1f0 0x56076e20faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50002/0 (socket says 172.21.15.50:50002) 2024-09-11T22:14:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.962+0000 7fbb8effd640 1 -- 172.21.15.50:0/3085215869 learned_addr learned my addr 172.21.15.50:0/3085215869 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.962+0000 7fbb8ffff640 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1ff5d0 0x56076e20ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.962+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1dbd60 0x56076e26fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb8effd640 1 -- 172.21.15.50:0/3085215869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1ff5d0 msgr2=0x56076e20ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb8effd640 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1ff5d0 0x56076e20ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb8effd640 1 -- 172.21.15.50:0/3085215869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1dbd60 msgr2=0x56076e26fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb8effd640 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1dbd60 0x56076e26fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb8effd640 1 -- 172.21.15.50:0/3085215869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56076e1b7eb0 con 0x56076e1fd1f0 2024-09-11T22:14:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb8ffff640 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1ff5d0 0x56076e20ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1dbd60 0x56076e26fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb8effd640 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1fd1f0 0x56076e20faa0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbb840a9af0 tx=0x7fbb84080040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc43752ef07d520 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb6e7fc640 1 -- 172.21.15.50:0/3085215869 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84097220 con 0x56076e1fd1f0 2024-09-11T22:14:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb6e7fc640 1 -- 172.21.15.50:0/3085215869 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fbb84076030 con 0x56076e1fd1f0 2024-09-11T22:14:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb98ca9740 1 -- 172.21.15.50:0/3085215869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb880104c0 con 0x56076e1fd1f0 2024-09-11T22:14:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb6e7fc640 1 -- 172.21.15.50:0/3085215869 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbb84082060 con 0x56076e1fd1f0 2024-09-11T22:14:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb98ca9740 10 client.5982 fetch_fsmap learned FSMap version 25 2024-09-11T22:14:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb98ca9740 1 -- 172.21.15.50:0/3085215869 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x56076e271560 con 0x56076e1fd1f0 2024-09-11T22:14:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb6e7fc640 1 -- 172.21.15.50:0/3085215869 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb880104c0 con 0x56076e1fd1f0 2024-09-11T22:14:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb6e7fc640 1 -- 172.21.15.50:0/3085215869 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fbb8404e060 con 0x56076e1fd1f0 2024-09-11T22:14:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb98ca9740 10 client.5982 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:14:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb98ca9740 10 client.5982 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb98ca9740 20 client.5982 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56076e1db680 0x56076e20bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb98ca9740 4 client.5982 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:14:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb98ca9740 1 -- 172.21.15.50:0/3085215869 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56076e128d00 con 0x56076e1db680 2024-09-11T22:14:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.963+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56076e1db680 0x56076e20bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb6e7fc640 10 client.5982 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb8f7fe640 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56076e1db680 0x56076e20bcd0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2fcbf96731bd7bb server_cookie=41e8a7661aeadfb0 in_seq=0 out_seq=0 2024-09-11T22:14:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb6e7fc640 1 -- 172.21.15.50:0/3085215869 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+166 (crc 0 0 0) 0x56076e128d00 con 0x56076e1db680 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb6e7fc640 10 client.5982 handle_command_reply: tid=0 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb98ca9740 1 client.5982 shutdown 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb98ca9740 1 -- 172.21.15.50:0/3085215869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1fd1f0 msgr2=0x56076e20faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1fd1f0 0x56076e20faa0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbb840a9af0 tx=0x7fbb84080040 comp rx=0 tx=0).stop 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb98ca9740 1 -- 172.21.15.50:0/3085215869 shutdown_connections 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56076e1ff5d0 0x56076e20ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x56076e1db680 0x56076e20bcd0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56076e1fd1f0 0x56076e20faa0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb98ca9740 1 --2- 172.21.15.50:0/3085215869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56076e1dbd60 0x56076e26fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb6e7fc640 0 client.5982 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb98ca9740 1 -- 172.21.15.50:0/3085215869 >> 172.21.15.50:0/3085215869 conn(0x56076e1fcd90 msgr2=0x56076e1b8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb98ca9740 1 -- 172.21.15.50:0/3085215869 shutdown_connections 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb98ca9740 1 -- 172.21.15.50:0/3085215869 wait complete. 2024-09-11T22:14:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.964+0000 7fbb98ca9740 20 client.5982 trim_cache size 0 max 16384 2024-09-11T22:14:10.973 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:14:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2024-09-11T22:14:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 25056153, 2024-09-11T22:14:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511630414, 2024-09-11T22:14:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-09-11T22:14:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:10.973 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:14:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.965+0000 7fbb95f11640 1 -- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb7c06be60 msgr2=0x7fbb7c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.965+0000 7fbb95f11640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb7c06be60 0x7fbb7c06e320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb80007f70 tx=0x7fbb80007f00 comp rx=0 tx=0).stop 2024-09-11T22:14:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.965+0000 7fbb95f11640 1 -- 172.21.15.50:0/474984435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb9015e8e0 msgr2=0x7fbb90154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.965+0000 7fbb95f11640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb9015e8e0 0x7fbb90154d70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbb84035040 tx=0x7fbb840046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.965+0000 7fbb95f11640 1 -- 172.21.15.50:0/474984435 shutdown_connections 2024-09-11T22:14:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.965+0000 7fbb95f11640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb7c06be60 0x7fbb7c06e320 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.965+0000 7fbb95f11640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb90162350 0x7fbb901609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.965+0000 7fbb95f11640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb9015e8e0 0x7fbb90154d70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.965+0000 7fbb95f11640 1 --2- 172.21.15.50:0/474984435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb900d1c90 0x7fbb901595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.965+0000 7fbb95f11640 1 -- 172.21.15.50:0/474984435 >> 172.21.15.50:0/474984435 conn(0x7fbb90067ba0 msgr2=0x7fbb9015ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.965+0000 7fbb95f11640 1 -- 172.21.15.50:0/474984435 shutdown_connections 2024-09-11T22:14:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:10.965+0000 7fbb95f11640 1 -- 172.21.15.50:0/474984435 wait complete. 2024-09-11T22:14:10.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.078+0000 7eff122d7640 1 Processor -- start 2024-09-11T22:14:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.078+0000 7eff122d7640 1 -- start start 2024-09-11T22:14:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.079+0000 7eff122d7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff0c15c510 0x7eff0c06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.079+0000 7eff122d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff0c06e730 0x7eff0c0679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.079+0000 7eff122d7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff0c06ec90 con 0x7eff0c067f00 2024-09-11T22:14:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.079+0000 7eff122d7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7eff0c06ef70 con 0x7eff0c06e730 2024-09-11T22:14:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.079+0000 7eff122d7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7eff0c06f250 con 0x7eff0c15c510 2024-09-11T22:14:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.079+0000 7eff0b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff0c06e730 0x7eff0c0679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.079+0000 7eff0b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff0c06e730 0x7eff0c0679c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:45152/0 (socket says 172.21.15.50:45152) 2024-09-11T22:14:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.079+0000 7eff0b7fe640 1 -- 172.21.15.50:0/1513777464 learned_addr learned my addr 172.21.15.50:0/1513777464 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.079+0000 7eff0bfff640 1 --2- 172.21.15.50:0/1513777464 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff0c15c510 0x7eff0c06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.080+0000 7eff0b7fe640 1 -- 172.21.15.50:0/1513777464 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff0c15c510 msgr2=0x7eff0c06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.080+0000 7eff0b7fe640 1 --2- 172.21.15.50:0/1513777464 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff0c15c510 0x7eff0c06e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.080+0000 7eff0b7fe640 1 -- 172.21.15.50:0/1513777464 >> v1:172.21.15.77:6789/0 conn(0x7eff0c067f00 legacy=0x7eff0c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.080+0000 7eff0b7fe640 1 -- 172.21.15.50:0/1513777464 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0c06f530 con 0x7eff0c06e730 2024-09-11T22:14:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.080+0000 7eff0b7fe640 1 --2- 172.21.15.50:0/1513777464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff0c06e730 0x7eff0c0679c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff00009870 tx=0x7eff0002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19c7df00bae7aae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.081+0000 7eff0affd640 1 -- 172.21.15.50:0/1513777464 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00037070 con 0x7eff0c06e730 2024-09-11T22:14:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.081+0000 7eff0affd640 1 -- 172.21.15.50:0/1513777464 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff00032440 con 0x7eff0c06e730 2024-09-11T22:14:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.081+0000 7eff0affd640 1 -- 172.21.15.50:0/1513777464 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00032810 con 0x7eff0c06e730 2024-09-11T22:14:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.081+0000 7eff122d7640 1 -- 172.21.15.50:0/1513777464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff0c06e730 msgr2=0x7eff0c0679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.081+0000 7eff122d7640 1 --2- 172.21.15.50:0/1513777464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff0c06e730 0x7eff0c0679c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff00009870 tx=0x7eff0002a270 comp rx=0 tx=0).stop 2024-09-11T22:14:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.081+0000 7eff122d7640 1 -- 172.21.15.50:0/1513777464 shutdown_connections 2024-09-11T22:14:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.081+0000 7eff122d7640 1 --2- 172.21.15.50:0/1513777464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff0c06e730 0x7eff0c0679c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.081+0000 7eff122d7640 1 --2- 172.21.15.50:0/1513777464 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff0c15c510 0x7eff0c06e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.081+0000 7eff122d7640 1 -- 172.21.15.50:0/1513777464 >> 172.21.15.50:0/1513777464 conn(0x7eff0c075060 msgr2=0x7eff0c06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.081+0000 7eff122d7640 1 -- 172.21.15.50:0/1513777464 shutdown_connections 2024-09-11T22:14:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.081+0000 7eff122d7640 1 -- 172.21.15.50:0/1513777464 wait complete. 2024-09-11T22:14:11.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.082+0000 7eff122d7640 1 Processor -- start 2024-09-11T22:14:11.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.083+0000 7eff122d7640 1 -- start start 2024-09-11T22:14:11.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.083+0000 7eff122d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff0c067f00 0x7eff0c150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.083+0000 7eff122d7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff0c06e730 0x7eff0c14e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.083+0000 7eff122d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff0c15c510 0x7eff0c152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.083+0000 7eff122d7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c06fd30 con 0x7eff0c15c510 2024-09-11T22:14:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.083+0000 7eff122d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c06c820 con 0x7eff0c067f00 2024-09-11T22:14:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.083+0000 7eff122d7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7eff0c15d900 con 0x7eff0c06e730 2024-09-11T22:14:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.083+0000 7eff10874640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff0c15c510 0x7eff0c152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.083+0000 7eff10874640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff0c15c510 0x7eff0c152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50006/0 (socket says 172.21.15.50:50006) 2024-09-11T22:14:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.083+0000 7eff10874640 1 -- 172.21.15.50:0/1945812751 learned_addr learned my addr 172.21.15.50:0/1945812751 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.084+0000 7eff0b7fe640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff0c06e730 0x7eff0c14e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.084+0000 7eff0bfff640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff0c067f00 0x7eff0c150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.084+0000 7eff10874640 1 -- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff0c06e730 msgr2=0x7eff0c14e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.084+0000 7eff10874640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff0c06e730 0x7eff0c14e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.084+0000 7eff10874640 1 -- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff0c067f00 msgr2=0x7eff0c150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.084+0000 7eff10874640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff0c067f00 0x7eff0c150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.084+0000 7eff10874640 1 -- 172.21.15.50:0/1945812751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0c1501f0 con 0x7eff0c15c510 2024-09-11T22:14:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.084+0000 7eff10874640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff0c15c510 0x7eff0c152800 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7eff0400c6b0 tx=0x7eff0400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.084+0000 7eff08ff9640 1 -- 172.21.15.50:0/1945812751 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff04003b70 con 0x7eff0c15c510 2024-09-11T22:14:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.084+0000 7eff08ff9640 1 -- 172.21.15.50:0/1945812751 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff04003d30 con 0x7eff0c15c510 2024-09-11T22:14:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.084+0000 7eff08ff9640 1 -- 172.21.15.50:0/1945812751 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff04005310 con 0x7eff0c15c510 2024-09-11T22:14:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.084+0000 7eff122d7640 1 -- 172.21.15.50:0/1945812751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0c1504d0 con 0x7eff0c15c510 2024-09-11T22:14:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.084+0000 7eff122d7640 1 -- 172.21.15.50:0/1945812751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff0c1514f0 con 0x7eff0c15c510 2024-09-11T22:14:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.085+0000 7eff122d7640 1 -- 172.21.15.50:0/1945812751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff0c0679c0 con 0x7eff0c15c510 2024-09-11T22:14:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.086+0000 7eff08ff9640 1 -- 172.21.15.50:0/1945812751 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff040054b0 con 0x7eff0c15c510 2024-09-11T22:14:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.086+0000 7eff08ff9640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efef806be30 0x7efef806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.087+0000 7eff08ff9640 1 -- 172.21.15.50:0/1945812751 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7eff0408abb0 con 0x7eff0c15c510 2024-09-11T22:14:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.087+0000 7eff0bfff640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efef806be30 0x7efef806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.087+0000 7eff0bfff640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efef806be30 0x7efef806e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7eff0c13eda0 tx=0x7efefc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.091+0000 7eff08ff9640 1 -- 172.21.15.50:0/1945812751 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff04058ed0 con 0x7eff0c15c510 2024-09-11T22:14:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.302+0000 7eff122d7640 1 -- 172.21.15.50:0/1945812751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff0c06ffd0 con 0x7eff0c15c510 2024-09-11T22:14:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.303+0000 7eff08ff9640 1 -- 172.21.15.50:0/1945812751 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5224 (secure 0 0 0) 0x7eff0405d1d0 con 0x7eff0c15c510 2024-09-11T22:14:11.304 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:11.304 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-11T22:14:08:512955+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2882007728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2882007728},{"type":"v1","addr":"172.21.15.50:6835","nonce":2882007728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1935649711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935649711},{"type":"v1","addr":"172.21.15.77:6837","nonce":1935649711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3208356003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3208356003},{"type":"v1","addr":"172.21.15.77:6836","nonce":3208356003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:13:39.660035+0000","modified":"2024-09-11T22:14:08.333962+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.50:6834/3053142878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3053142878},{"type":"v1","addr":"172.21.15.50:6834","nonce":3053142878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-11T22:14:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-11T22:14:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.305+0000 7eff122d7640 1 -- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efef806be30 msgr2=0x7efef806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.305+0000 7eff122d7640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efef806be30 0x7efef806e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7eff0c13eda0 tx=0x7efefc009190 comp rx=0 tx=0).stop 2024-09-11T22:14:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.305+0000 7eff122d7640 1 -- 172.21.15.50:0/1945812751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff0c15c510 msgr2=0x7eff0c152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.305+0000 7eff122d7640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff0c15c510 0x7eff0c152800 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7eff0400c6b0 tx=0x7eff0400cb70 comp rx=0 tx=0).stop 2024-09-11T22:14:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.305+0000 7eff122d7640 1 -- 172.21.15.50:0/1945812751 shutdown_connections 2024-09-11T22:14:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.305+0000 7eff122d7640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efef806be30 0x7efef806e2f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.305+0000 7eff122d7640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff0c06e730 0x7eff0c14e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.305+0000 7eff122d7640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff0c15c510 0x7eff0c152800 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.305+0000 7eff122d7640 1 --2- 172.21.15.50:0/1945812751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff0c067f00 0x7eff0c150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.305+0000 7eff122d7640 1 -- 172.21.15.50:0/1945812751 >> 172.21.15.50:0/1945812751 conn(0x7eff0c075060 msgr2=0x7eff0c0b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.305+0000 7eff122d7640 1 -- 172.21.15.50:0/1945812751 shutdown_connections 2024-09-11T22:14:11.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.305+0000 7eff122d7640 1 -- 172.21.15.50:0/1945812751 wait complete. 2024-09-11T22:14:11.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 25056153 2024-09-11T22:14:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.423+0000 7f81c9a5e640 1 Processor -- start 2024-09-11T22:14:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.423+0000 7f81c9a5e640 1 -- start start 2024-09-11T22:14:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.423+0000 7f81c9a5e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81c415e840 0x7f81c40b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.423+0000 7f81c9a5e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81c40cf580 0x7f81c406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.423+0000 7f81c9a5e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c40ce5f0 con 0x7f81c40cdd50 2024-09-11T22:14:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.423+0000 7f81c9a5e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f81c406c240 con 0x7f81c415e840 2024-09-11T22:14:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.423+0000 7f81c9a5e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f81c40d0470 con 0x7f81c40cf580 2024-09-11T22:14:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.424+0000 7f81c2ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81c415e840 0x7f81c40b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.424+0000 7f81c27fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f81c40cdd50 0x7f81c40cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51084/0 (socket says 172.21.15.50:51084) 2024-09-11T22:14:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.424+0000 7f81c27fc640 1 -- 172.21.15.50:0/3131716230 learned_addr learned my addr 172.21.15.50:0/3131716230 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.424+0000 7f81c37fe640 1 --2- 172.21.15.50:0/3131716230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81c40cf580 0x7f81c406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.424+0000 7f81c2ffd640 1 -- 172.21.15.50:0/3131716230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81c40cf580 msgr2=0x7f81c406c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.424+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/3131716230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81c40cf580 0x7f81c406c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.424+0000 7f81c2ffd640 1 -- 172.21.15.50:0/3131716230 >> v1:172.21.15.50:6789/0 conn(0x7f81c40cdd50 legacy=0x7f81c40cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.424+0000 7f81c2ffd640 1 -- 172.21.15.50:0/3131716230 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c40ce310 con 0x7f81c415e840 2024-09-11T22:14:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.425+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/3131716230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c415e840 0x7f81c40b4c70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097a0 tx=0x7f81b402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611340aae9a99c9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.425+0000 7f81c1ffb640 1 -- 172.21.15.50:0/3131716230 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4037070 con 0x7f81c415e840 2024-09-11T22:14:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.425+0000 7f81c1ffb640 1 -- 172.21.15.50:0/3131716230 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b402ad10 con 0x7f81c415e840 2024-09-11T22:14:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.425+0000 7f81c1ffb640 1 -- 172.21.15.50:0/3131716230 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4032660 con 0x7f81c415e840 2024-09-11T22:14:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.425+0000 7f81c9a5e640 1 -- 172.21.15.50:0/3131716230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c415e840 msgr2=0x7f81c40b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.425+0000 7f81c9a5e640 1 --2- 172.21.15.50:0/3131716230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c415e840 0x7f81c40b4c70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097a0 tx=0x7f81b402a080 comp rx=0 tx=0).stop 2024-09-11T22:14:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.425+0000 7f81c9a5e640 1 -- 172.21.15.50:0/3131716230 shutdown_connections 2024-09-11T22:14:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.425+0000 7f81c9a5e640 1 --2- 172.21.15.50:0/3131716230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81c40cf580 0x7f81c406c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.425+0000 7f81c9a5e640 1 --2- 172.21.15.50:0/3131716230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c415e840 0x7f81c40b4c70 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.425+0000 7f81c9a5e640 1 -- 172.21.15.50:0/3131716230 >> 172.21.15.50:0/3131716230 conn(0x7f81c40b4150 msgr2=0x7f81c40b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.426+0000 7f81c9a5e640 1 -- 172.21.15.50:0/3131716230 shutdown_connections 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.426+0000 7f81c9a5e640 1 -- 172.21.15.50:0/3131716230 wait complete. 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.427+0000 7f81c9a5e640 1 Processor -- start 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.427+0000 7f81c9a5e640 1 -- start start 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c9a5e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81c40cdd50 0x7f81c40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c9a5e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c40cf580 0x7f81c41f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c9a5e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c415e840 0x7f81c4155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c9a5e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f81c415ec20 con 0x7f81c415e840 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c9a5e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81c406bed0 con 0x7f81c40cf580 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c9a5e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f81c415eda0 con 0x7f81c40cdd50 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c415e840 0x7f81c4155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c415e840 0x7f81c4155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50028/0 (socket says 172.21.15.50:50028) 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c37fe640 1 -- 172.21.15.50:0/3609718666 learned_addr learned my addr 172.21.15.50:0/3609718666 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81c40cdd50 0x7f81c40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c27fc640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c40cf580 0x7f81c41f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c37fe640 1 -- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81c40cdd50 msgr2=0x7f81c40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c37fe640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81c40cdd50 0x7f81c40b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c37fe640 1 -- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c40cf580 msgr2=0x7f81c41f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c37fe640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c40cf580 0x7f81c41f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c37fe640 1 -- 172.21.15.50:0/3609718666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c40b5b10 con 0x7f81c415e840 2024-09-11T22:14:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81c40cdd50 0x7f81c40b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c27fc640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c40cf580 0x7f81c41f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c37fe640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c415e840 0x7f81c4155ae0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f81bc007e40 tx=0x7f81bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81abfff640 1 -- 172.21.15.50:0/3609718666 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc014620 con 0x7f81c415e840 2024-09-11T22:14:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81abfff640 1 -- 172.21.15.50:0/3609718666 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81bc019070 con 0x7f81c415e840 2024-09-11T22:14:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c9a5e640 1 -- 172.21.15.50:0/3609718666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c40b5df0 con 0x7f81c415e840 2024-09-11T22:14:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81abfff640 1 -- 172.21.15.50:0/3609718666 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc014a20 con 0x7f81c415e840 2024-09-11T22:14:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.428+0000 7f81c9a5e640 1 -- 172.21.15.50:0/3609718666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c40b63b0 con 0x7f81c415e840 2024-09-11T22:14:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.430+0000 7f81abfff640 1 -- 172.21.15.50:0/3609718666 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81bc014bc0 con 0x7f81c415e840 2024-09-11T22:14:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.431+0000 7f81abfff640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81b006be30 0x7f81b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.431+0000 7f81abfff640 1 -- 172.21.15.50:0/3609718666 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f81bc08b7c0 con 0x7f81c415e840 2024-09-11T22:14:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.431+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81b006be30 0x7f81b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.431+0000 7f81cc7f8740 1 Processor -- start 2024-09-11T22:14:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.432+0000 7f81cc7f8740 1 -- start start 2024-09-11T22:14:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.432+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81b006be30 0x7f81b006e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f81b4034000 tx=0x7f81b402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.432+0000 7f81cc7f8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d76620 0x55d776d76a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.432+0000 7f81cc7f8740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d73de0 0x55d776d75970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.432+0000 7f81cc7f8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.432+0000 7f81cc7f8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d776c92a80 con 0x55d776d74240 2024-09-11T22:14:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.432+0000 7f81cc7f8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d776c3a6c0 con 0x55d776d76620 2024-09-11T22:14:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.432+0000 7f81cc7f8740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d776c8ea40 con 0x55d776d73de0 2024-09-11T22:14:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.432+0000 7f81c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.433+0000 7f81c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50040/0 (socket says 172.21.15.50:50040) 2024-09-11T22:14:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.433+0000 7f81c37fe640 1 -- 172.21.15.50:0/288186812 learned_addr learned my addr 172.21.15.50:0/288186812 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.433+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/288186812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d76620 0x55d776d76a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.433+0000 7f81c27fc640 1 --2- 172.21.15.50:0/288186812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d73de0 0x55d776d75970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.433+0000 7f81c37fe640 1 -- 172.21.15.50:0/288186812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d73de0 msgr2=0x55d776d75970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.433+0000 7f81c37fe640 1 --2- 172.21.15.50:0/288186812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d73de0 0x55d776d75970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.433+0000 7f81c37fe640 1 -- 172.21.15.50:0/288186812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d76620 msgr2=0x55d776d76a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.433+0000 7f81c37fe640 1 --2- 172.21.15.50:0/288186812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d76620 0x55d776d76a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.433+0000 7f81c37fe640 1 -- 172.21.15.50:0/288186812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d776a71900 con 0x55d776d74240 2024-09-11T22:14:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.433+0000 7f81c37fe640 1 --2- 172.21.15.50:0/288186812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d565a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00c040 tx=0x7f81bc05a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20416680ca5c0707 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.433+0000 7f81a97fa640 1 -- 172.21.15.50:0/288186812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc062600 con 0x55d776d74240 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.433+0000 7f81a97fa640 1 -- 172.21.15.50:0/288186812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81bc057d20 con 0x55d776d74240 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.433+0000 7f81a97fa640 1 -- 172.21.15.50:0/288186812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc062170 con 0x55d776d74240 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.434+0000 7f81cc7f8740 1 -- 172.21.15.50:0/288186812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 msgr2=0x55d776d565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.434+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/288186812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d565a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00c040 tx=0x7f81bc05a1e0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.434+0000 7f81cc7f8740 1 -- 172.21.15.50:0/288186812 shutdown_connections 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.434+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/288186812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d73de0 0x55d776d75970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.434+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/288186812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d565a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.434+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/288186812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d76620 0x55d776d76a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.434+0000 7f81cc7f8740 1 -- 172.21.15.50:0/288186812 >> 172.21.15.50:0/288186812 conn(0x55d776d2c510 msgr2=0x55d776d74690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.434+0000 7f81cc7f8740 1 -- 172.21.15.50:0/288186812 shutdown_connections 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.434+0000 7f81cc7f8740 1 -- 172.21.15.50:0/288186812 wait complete. 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.434+0000 7f81cc7f8740 1 -- start start 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.434+0000 7f81cc7f8740 1 Processor -- start 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.435+0000 7f81cc7f8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d74240 0x55d776d541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.435+0000 7f81cc7f8740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d76620 0x55d776d6d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.435+0000 7f81cc7f8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d57670 0x55d776d84b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.435+0000 7f81cc7f8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d776d72d40 con 0x55d776d57670 2024-09-11T22:14:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.435+0000 7f81cc7f8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d776c1b7f0 con 0x55d776d74240 2024-09-11T22:14:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.435+0000 7f81cc7f8740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d776d73020 con 0x55d776d76620 2024-09-11T22:14:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.435+0000 7f81cc7f8740 10 client.0 _ll_register_callbacks cb 0x55d776c53450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.435+0000 7f81c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d57670 0x55d776d84b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.435+0000 7f81c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d57670 0x55d776d84b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50042/0 (socket says 172.21.15.50:50042) 2024-09-11T22:14:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.435+0000 7f81c37fe640 1 -- 172.21.15.50:0/810817341 learned_addr learned my addr 172.21.15.50:0/810817341 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.435+0000 7f81c27fc640 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d76620 0x55d776d6d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.435+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d74240 0x55d776d541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81c37fe640 1 -- 172.21.15.50:0/810817341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d76620 msgr2=0x55d776d6d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81c37fe640 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d76620 0x55d776d6d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81c37fe640 1 -- 172.21.15.50:0/810817341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d74240 msgr2=0x55d776d541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81c37fe640 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d74240 0x55d776d541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81c37fe640 1 -- 172.21.15.50:0/810817341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7769651f0 con 0x55d776d57670 2024-09-11T22:14:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d74240 0x55d776d541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81c37fe640 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d57670 0x55d776d84b70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f81bc059720 tx=0x7f81bc016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4386a64d6c2e430 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81a27fc640 1 -- 172.21.15.50:0/810817341 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc076060 con 0x55d776d57670 2024-09-11T22:14:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81a27fc640 1 -- 172.21.15.50:0/810817341 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f81bc062370 con 0x55d776d57670 2024-09-11T22:14:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81cc7f8740 1 -- 172.21.15.50:0/810817341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81bc057d20 con 0x55d776d57670 2024-09-11T22:14:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81a27fc640 1 -- 172.21.15.50:0/810817341 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81bc062600 con 0x55d776d57670 2024-09-11T22:14:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81cc7f8740 10 client.6000 fetch_fsmap learned FSMap version 25 2024-09-11T22:14:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81cc7f8740 1 -- 172.21.15.50:0/810817341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55d776ad2090 con 0x55d776d57670 2024-09-11T22:14:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81a27fc640 1 -- 172.21.15.50:0/810817341 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81bc057d20 con 0x55d776d57670 2024-09-11T22:14:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.436+0000 7f81a27fc640 1 -- 172.21.15.50:0/810817341 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f81bc060070 con 0x55d776d57670 2024-09-11T22:14:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.437+0000 7f81cc7f8740 10 client.6000 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:14:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.437+0000 7f81cc7f8740 10 client.6000 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:14:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.437+0000 7f81cc7f8740 20 client.6000 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.437+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55d776d5a430 0x55d776d6b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.437+0000 7f81cc7f8740 4 client.6000 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.437+0000 7f81cc7f8740 1 -- 172.21.15.50:0/810817341 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d776ca01b0 con 0x55d776d5a430 2024-09-11T22:14:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.437+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55d776d5a430 0x55d776d6b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.437+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55d776d5a430 0x55d776d6b530 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=416d421f526c43ab server_cookie=15d58d4c970955a9 in_seq=0 out_seq=0 2024-09-11T22:14:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.437+0000 7f81a27fc640 10 client.6000 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81a27fc640 1 -- 172.21.15.50:0/810817341 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d776ca01b0 con 0x55d776d5a430 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81a27fc640 10 client.6000 handle_command_reply: tid=0 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81cc7f8740 1 client.6000 shutdown 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81cc7f8740 1 -- 172.21.15.50:0/810817341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d57670 msgr2=0x55d776d84b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d57670 0x55d776d84b70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f81bc059720 tx=0x7f81bc016070 comp rx=0 tx=0).stop 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81cc7f8740 1 -- 172.21.15.50:0/810817341 shutdown_connections 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d76620 0x55d776d6d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55d776d5a430 0x55d776d6b530 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d57670 0x55d776d84b70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/810817341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d74240 0x55d776d541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81a27fc640 0 client.6000 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81cc7f8740 1 -- 172.21.15.50:0/810817341 >> 172.21.15.50:0/810817341 conn(0x55d776d73de0 msgr2=0x55d776d56b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81cc7f8740 1 -- 172.21.15.50:0/810817341 shutdown_connections 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81cc7f8740 1 -- 172.21.15.50:0/810817341 wait complete. 2024-09-11T22:14:11.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.438+0000 7f81cc7f8740 20 client.6000 trim_cache size 0 max 16384 2024-09-11T22:14:11.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.451+0000 7f81cc7f8740 1 Processor -- start 2024-09-11T22:14:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.451+0000 7f81cc7f8740 1 -- start start 2024-09-11T22:14:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.452+0000 7f81cc7f8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d57670 0x55d776d74830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.452+0000 7f81cc7f8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d29240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.452+0000 7f81cc7f8740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d76620 0x55d776d29780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.452+0000 7f81cc7f8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f81c41ffcf0 con 0x55d776d74240 2024-09-11T22:14:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.452+0000 7f81cc7f8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81c40cb460 con 0x55d776d57670 2024-09-11T22:14:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.452+0000 7f81cc7f8740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f81c40cbab0 con 0x55d776d76620 2024-09-11T22:14:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.452+0000 7f81c27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d29240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.452+0000 7f81c27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d29240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50056/0 (socket says 172.21.15.50:50056) 2024-09-11T22:14:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.452+0000 7f81c27fc640 1 -- 172.21.15.50:0/1452589050 learned_addr learned my addr 172.21.15.50:0/1452589050 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.452+0000 7f81c37fe640 1 --2- 172.21.15.50:0/1452589050 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d76620 0x55d776d29780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81c27fc640 1 -- 172.21.15.50:0/1452589050 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d76620 msgr2=0x55d776d29780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/1452589050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d57670 0x55d776d74830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81c27fc640 1 --2- 172.21.15.50:0/1452589050 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d76620 0x55d776d29780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81c27fc640 1 -- 172.21.15.50:0/1452589050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d57670 msgr2=0x55d776d74830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81c27fc640 1 --2- 172.21.15.50:0/1452589050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d57670 0x55d776d74830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81c27fc640 1 -- 172.21.15.50:0/1452589050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d776d53bb0 con 0x55d776d74240 2024-09-11T22:14:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81c37fe640 1 --2- 172.21.15.50:0/1452589050 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d76620 0x55d776d29780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/1452589050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d57670 0x55d776d74830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81c27fc640 1 --2- 172.21.15.50:0/1452589050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d29240 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f81b8000f60 tx=0x7f81b8007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1adb1b53e290901 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81a8ff9640 1 -- 172.21.15.50:0/1452589050 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b801a070 con 0x55d776d74240 2024-09-11T22:14:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81a8ff9640 1 -- 172.21.15.50:0/1452589050 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b8007670 con 0x55d776d74240 2024-09-11T22:14:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81a8ff9640 1 -- 172.21.15.50:0/1452589050 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8001bf0 con 0x55d776d74240 2024-09-11T22:14:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81cc7f8740 1 -- 172.21.15.50:0/1452589050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 msgr2=0x55d776d29240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.453+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/1452589050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d29240 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f81b8000f60 tx=0x7f81b8007420 comp rx=0 tx=0).stop 2024-09-11T22:14:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.454+0000 7f81cc7f8740 1 -- 172.21.15.50:0/1452589050 shutdown_connections 2024-09-11T22:14:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.454+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/1452589050 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d76620 0x55d776d29780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.454+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/1452589050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d29240 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.454+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/1452589050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d57670 0x55d776d74830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.454+0000 7f81cc7f8740 1 -- 172.21.15.50:0/1452589050 >> 172.21.15.50:0/1452589050 conn(0x55d776d73de0 msgr2=0x55d776d595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.454+0000 7f81cc7f8740 1 -- 172.21.15.50:0/1452589050 shutdown_connections 2024-09-11T22:14:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.454+0000 7f81cc7f8740 1 -- 172.21.15.50:0/1452589050 wait complete. 2024-09-11T22:14:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.454+0000 7f81cc7f8740 1 -- start start 2024-09-11T22:14:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.454+0000 7f81cc7f8740 1 Processor -- start 2024-09-11T22:14:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81cc7f8740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d57670 0x55d776ddb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81cc7f8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d58160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81cc7f8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d76620 0x55d776d586a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81cc7f8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d776d72d40 con 0x55d776d74240 2024-09-11T22:14:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81cc7f8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d776c1b7f0 con 0x55d776d76620 2024-09-11T22:14:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81cc7f8740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d776d57af0 con 0x55d776d57670 2024-09-11T22:14:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81cc7f8740 10 client.0 _ll_register_callbacks cb 0x7f81b4035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81c27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d58160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81c27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d58160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50068/0 (socket says 172.21.15.50:50068) 2024-09-11T22:14:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81c27fc640 1 -- 172.21.15.50:0/1735483333 learned_addr learned my addr 172.21.15.50:0/1735483333 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/1735483333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d57670 0x55d776ddb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81c37fe640 1 --2- 172.21.15.50:0/1735483333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d76620 0x55d776d586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81c27fc640 1 -- 172.21.15.50:0/1735483333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d57670 msgr2=0x55d776ddb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81c27fc640 1 --2- 172.21.15.50:0/1735483333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d57670 0x55d776ddb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81c27fc640 1 -- 172.21.15.50:0/1735483333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d76620 msgr2=0x55d776d586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81c27fc640 1 --2- 172.21.15.50:0/1735483333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d76620 0x55d776d586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.455+0000 7f81c27fc640 1 -- 172.21.15.50:0/1735483333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d77693e2b0 con 0x55d776d74240 2024-09-11T22:14:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81c27fc640 1 --2- 172.21.15.50:0/1735483333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d58160 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f81b8007840 tx=0x7f81b8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c590830a0ee846e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81a27fc640 1 -- 172.21.15.50:0/1735483333 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b801a050 con 0x55d776d74240 2024-09-11T22:14:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81a27fc640 1 -- 172.21.15.50:0/1735483333 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f81b801fb90 con 0x55d776d74240 2024-09-11T22:14:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81cc7f8740 1 -- 172.21.15.50:0/1735483333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b8007670 con 0x55d776d74240 2024-09-11T22:14:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81a27fc640 1 -- 172.21.15.50:0/1735483333 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81b8030050 con 0x55d776d74240 2024-09-11T22:14:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81cc7f8740 10 client.6006 fetch_fsmap learned FSMap version 25 2024-09-11T22:14:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81cc7f8740 1 -- 172.21.15.50:0/1735483333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55d776d56960 con 0x55d776d74240 2024-09-11T22:14:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81a27fc640 1 -- 172.21.15.50:0/1735483333 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b8007670 con 0x55d776d74240 2024-09-11T22:14:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81a27fc640 1 -- 172.21.15.50:0/1735483333 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f81b8016420 con 0x55d776d74240 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81cc7f8740 10 client.6006 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81cc7f8740 10 client.6006 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81cc7f8740 20 client.6006 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/1735483333 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55d776d6bdd0 0x55d776d8dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81cc7f8740 4 client.6006 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 25056153}] 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81cc7f8740 1 -- 172.21.15.50:0/1735483333 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "damage rm", "damage_id": 25056153}) -- 0x55d776c9a500 con 0x55d776d6bdd0 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.456+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/1735483333 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55d776d6bdd0 0x55d776d8dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81c2ffd640 1 --2- 172.21.15.50:0/1735483333 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55d776d6bdd0 0x55d776d8dfe0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40be87bab688f46b server_cookie=af7f0105b83edd4b in_seq=0 out_seq=0 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81a27fc640 10 client.6006 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81a27fc640 1 -- 172.21.15.50:0/1735483333 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55d776c9a500 con 0x55d776d6bdd0 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81a27fc640 10 client.6006 handle_command_reply: tid=0 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81cc7f8740 1 client.6006 shutdown 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81cc7f8740 1 -- 172.21.15.50:0/1735483333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 msgr2=0x55d776d58160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/1735483333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d58160 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f81b8007840 tx=0x7f81b8000bc0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81cc7f8740 1 -- 172.21.15.50:0/1735483333 shutdown_connections 2024-09-11T22:14:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/1735483333 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55d776d6bdd0 0x55d776d8dfe0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/1735483333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d776d76620 0x55d776d586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81a27fc640 0 client.6006 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/1735483333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d776d74240 0x55d776d58160 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81cc7f8740 1 --2- 172.21.15.50:0/1735483333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d776d57670 0x55d776ddb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81cc7f8740 1 -- 172.21.15.50:0/1735483333 >> 172.21.15.50:0/1735483333 conn(0x55d776d73de0 msgr2=0x55d776d6d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81cc7f8740 1 -- 172.21.15.50:0/1735483333 shutdown_connections 2024-09-11T22:14:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81cc7f8740 1 -- 172.21.15.50:0/1735483333 wait complete. 2024-09-11T22:14:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.457+0000 7f81cc7f8740 20 client.6006 trim_cache size 0 max 16384 2024-09-11T22:14:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.458+0000 7f81c9a5e640 1 -- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81b006be30 msgr2=0x7f81b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.458+0000 7f81c9a5e640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81b006be30 0x7f81b006e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f81b4034000 tx=0x7f81b402e000 comp rx=0 tx=0).stop 2024-09-11T22:14:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.458+0000 7f81c9a5e640 1 -- 172.21.15.50:0/3609718666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c415e840 msgr2=0x7f81c4155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.458+0000 7f81c9a5e640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c415e840 0x7f81c4155ae0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f81bc007e40 tx=0x7f81bc00e4b0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.458+0000 7f81c9a5e640 1 -- 172.21.15.50:0/3609718666 shutdown_connections 2024-09-11T22:14:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.458+0000 7f81c9a5e640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81b006be30 0x7f81b006e2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.458+0000 7f81c9a5e640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c415e840 0x7f81c4155ae0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.458+0000 7f81c9a5e640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c40cf580 0x7f81c41f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.458+0000 7f81c9a5e640 1 --2- 172.21.15.50:0/3609718666 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81c40cdd50 0x7f81c40b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.458+0000 7f81c9a5e640 1 -- 172.21.15.50:0/3609718666 >> 172.21.15.50:0/3609718666 conn(0x7f81c40b4150 msgr2=0x7f81c40af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.458+0000 7f81c9a5e640 1 -- 172.21.15.50:0/3609718666 shutdown_connections 2024-09-11T22:14:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.458+0000 7f81c9a5e640 1 -- 172.21.15.50:0/3609718666 wait complete. 2024-09-11T22:14:11.470 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-11T22:14:11.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-11T22:14:11.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.574+0000 7f524e1ed640 1 Processor -- start 2024-09-11T22:14:11.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.574+0000 7f524e1ed640 1 -- start start 2024-09-11T22:14:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.575+0000 7f524e1ed640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f524815e840 0x7f52480b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.575+0000 7f524e1ed640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52480cf580 0x7f524806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.575+0000 7f524e1ed640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52480ce5f0 con 0x7f52480cdd50 2024-09-11T22:14:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.575+0000 7f524e1ed640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f524806c240 con 0x7f524815e840 2024-09-11T22:14:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.575+0000 7f524e1ed640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52480d0470 con 0x7f52480cf580 2024-09-11T22:14:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.576+0000 7f5247fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52480cf580 0x7f524806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.576+0000 7f52477fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f524815e840 0x7f52480b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.576+0000 7f52477fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f524815e840 0x7f52480b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:45212/0 (socket says 172.21.15.50:45212) 2024-09-11T22:14:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.576+0000 7f5246ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f52480cdd50 0x7f52480cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:50764/0 (socket says 172.21.15.50:50764) 2024-09-11T22:14:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.576+0000 7f5247fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52480cf580 0x7f524806c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:56390/0 (socket says 172.21.15.50:56390) 2024-09-11T22:14:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.576+0000 7f52477fe640 1 -- 172.21.15.50:0/2227386322 learned_addr learned my addr 172.21.15.50:0/2227386322 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.576+0000 7f5247fff640 1 -- 172.21.15.50:0/2227386322 >> v2:172.21.15.77:3300/0 conn(0x7f524815e840 msgr2=0x7f52480b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.576+0000 7f5247fff640 1 --2- 172.21.15.50:0/2227386322 >> v2:172.21.15.77:3300/0 conn(0x7f524815e840 0x7f52480b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.576+0000 7f5247fff640 1 -- 172.21.15.50:0/2227386322 >> v1:172.21.15.77:6789/0 conn(0x7f52480cdd50 legacy=0x7f52480cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.576+0000 7f5247fff640 1 -- 172.21.15.50:0/2227386322 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52480ce310 con 0x7f52480cf580 2024-09-11T22:14:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.576+0000 7f52467fc640 1 -- 172.21.15.50:0/2227386322 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2955819018 0 0) 0x7f52480ce5f0 con 0x7f52480cdd50 2024-09-11T22:14:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.576+0000 7f52477fe640 1 --2- 172.21.15.50:0/2227386322 >> v2:172.21.15.77:3300/0 conn(0x7f524815e840 0x7f52480b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.577+0000 7f5247fff640 1 --2- 172.21.15.50:0/2227386322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52480cf580 0x7f524806c6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5240009d90 tx=0x7f524002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd77bacf4937a224 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.577+0000 7f52467fc640 1 -- 172.21.15.50:0/2227386322 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240007740 con 0x7f52480cf580 2024-09-11T22:14:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.577+0000 7f52467fc640 1 -- 172.21.15.50:0/2227386322 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52400078e0 con 0x7f52480cf580 2024-09-11T22:14:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.577+0000 7f52467fc640 1 -- 172.21.15.50:0/2227386322 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240007cb0 con 0x7f52480cf580 2024-09-11T22:14:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.577+0000 7f524e1ed640 1 -- 172.21.15.50:0/2227386322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52480cf580 msgr2=0x7f524806c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.577+0000 7f524e1ed640 1 --2- 172.21.15.50:0/2227386322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52480cf580 0x7f524806c6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5240009d90 tx=0x7f524002a660 comp rx=0 tx=0).stop 2024-09-11T22:14:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.577+0000 7f524e1ed640 1 -- 172.21.15.50:0/2227386322 shutdown_connections 2024-09-11T22:14:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.577+0000 7f524e1ed640 1 --2- 172.21.15.50:0/2227386322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52480cf580 0x7f524806c6d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.577+0000 7f524e1ed640 1 --2- 172.21.15.50:0/2227386322 >> v2:172.21.15.77:3300/0 conn(0x7f524815e840 0x7f52480b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.577+0000 7f524e1ed640 1 -- 172.21.15.50:0/2227386322 >> 172.21.15.50:0/2227386322 conn(0x7f52480b4150 msgr2=0x7f52480b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.578+0000 7f524e1ed640 1 -- 172.21.15.50:0/2227386322 shutdown_connections 2024-09-11T22:14:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.578+0000 7f524e1ed640 1 -- 172.21.15.50:0/2227386322 wait complete. 2024-09-11T22:14:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.579+0000 7f524e1ed640 1 Processor -- start 2024-09-11T22:14:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.579+0000 7f524e1ed640 1 -- start start 2024-09-11T22:14:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f524e1ed640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52480cdd50 0x7f52480b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f524e1ed640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52480cf580 0x7f52480b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f524e1ed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524815e840 0x7f52481519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f524e1ed640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f524815ec20 con 0x7f524815e840 2024-09-11T22:14:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f524e1ed640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f524806bed0 con 0x7f52480cf580 2024-09-11T22:14:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f524e1ed640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f524815eda0 con 0x7f52480cdd50 2024-09-11T22:14:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f5247fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524815e840 0x7f52481519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f5247fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524815e840 0x7f52481519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50080/0 (socket says 172.21.15.50:50080) 2024-09-11T22:14:11.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f5247fff640 1 -- 172.21.15.50:0/4099858783 learned_addr learned my addr 172.21.15.50:0/4099858783 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f5246ffd640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52480cf580 0x7f52480b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f52477fe640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52480cdd50 0x7f52480b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f5247fff640 1 -- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52480cdd50 msgr2=0x7f52480b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f5247fff640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52480cdd50 0x7f52480b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f5247fff640 1 -- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52480cf580 msgr2=0x7f52480b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f5247fff640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52480cf580 0x7f52480b7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f5247fff640 1 -- 172.21.15.50:0/4099858783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52480b7ec0 con 0x7f524815e840 2024-09-11T22:14:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.580+0000 7f5247fff640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524815e840 0x7f52481519a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5240009eb0 tx=0x7f5240004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.581+0000 7f522ffff640 1 -- 172.21.15.50:0/4099858783 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240040070 con 0x7f524815e840 2024-09-11T22:14:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.581+0000 7f522ffff640 1 -- 172.21.15.50:0/4099858783 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5240031c40 con 0x7f524815e840 2024-09-11T22:14:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.581+0000 7f524e1ed640 1 -- 172.21.15.50:0/4099858783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52480b5a30 con 0x7f524815e840 2024-09-11T22:14:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.581+0000 7f522ffff640 1 -- 172.21.15.50:0/4099858783 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240009450 con 0x7f524815e840 2024-09-11T22:14:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.581+0000 7f524e1ed640 1 -- 172.21.15.50:0/4099858783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52480b5ff0 con 0x7f524815e840 2024-09-11T22:14:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.582+0000 7f522ffff640 1 -- 172.21.15.50:0/4099858783 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5240039040 con 0x7f524815e840 2024-09-11T22:14:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.583+0000 7f522ffff640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f523406be30 0x7f523406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.583+0000 7f522ffff640 1 -- 172.21.15.50:0/4099858783 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f52400abbd0 con 0x7f524815e840 2024-09-11T22:14:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.583+0000 7f52477fe640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f523406be30 0x7f523406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.583+0000 7f52477fe640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f523406be30 0x7f523406e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5238006ca0 tx=0x7f5238009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.584+0000 7f525105d740 1 Processor -- start 2024-09-11T22:14:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.584+0000 7f525105d740 1 -- start start 2024-09-11T22:14:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f525105d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f88547a450 0x55f8854bfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f525105d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f885477c10 0x55f88547a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f525105d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 0x55f885474a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f525105d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f8853dc610 con 0x55f885477c10 2024-09-11T22:14:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f525105d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f8853842e0 con 0x55f88547bbe0 2024-09-11T22:14:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f525105d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f8853d85d0 con 0x55f88547a450 2024-09-11T22:14:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f5246ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f885477c10 0x55f88547a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f5246ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f885477c10 0x55f88547a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50092/0 (socket says 172.21.15.50:50092) 2024-09-11T22:14:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f5246ffd640 1 -- 172.21.15.50:0/4293910562 learned_addr learned my addr 172.21.15.50:0/4293910562 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f52477fe640 1 --2- 172.21.15.50:0/4293910562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f88547a450 0x55f8854bfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f5247fff640 1 --2- 172.21.15.50:0/4293910562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 0x55f885474a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f5246ffd640 1 -- 172.21.15.50:0/4293910562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f88547a450 msgr2=0x55f8854bfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f5246ffd640 1 --2- 172.21.15.50:0/4293910562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f88547a450 0x55f8854bfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f5246ffd640 1 -- 172.21.15.50:0/4293910562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 msgr2=0x55f885474a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f5246ffd640 1 --2- 172.21.15.50:0/4293910562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 0x55f885474a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f5246ffd640 1 -- 172.21.15.50:0/4293910562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f88539f1f0 con 0x55f885477c10 2024-09-11T22:14:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f5246ffd640 1 --2- 172.21.15.50:0/4293910562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f885477c10 0x55f88547a830 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f523c0076b0 tx=0x7f523c0077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a9678b72f5af4a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f522d7fa640 1 -- 172.21.15.50:0/4293910562 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c01a070 con 0x55f885477c10 2024-09-11T22:14:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f522d7fa640 1 -- 172.21.15.50:0/4293910562 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f523c0017f0 con 0x55f885477c10 2024-09-11T22:14:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.585+0000 7f522d7fa640 1 -- 172.21.15.50:0/4293910562 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c001be0 con 0x55f885477c10 2024-09-11T22:14:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.586+0000 7f525105d740 1 -- 172.21.15.50:0/4293910562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f885477c10 msgr2=0x55f88547a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.586+0000 7f525105d740 1 --2- 172.21.15.50:0/4293910562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f885477c10 0x55f88547a830 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f523c0076b0 tx=0x7f523c0077a0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.586+0000 7f525105d740 1 -- 172.21.15.50:0/4293910562 shutdown_connections 2024-09-11T22:14:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.586+0000 7f525105d740 1 --2- 172.21.15.50:0/4293910562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 0x55f885474a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.586+0000 7f525105d740 1 --2- 172.21.15.50:0/4293910562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f885477c10 0x55f88547a830 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.586+0000 7f525105d740 1 --2- 172.21.15.50:0/4293910562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f88547a450 0x55f8854bfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.586+0000 7f525105d740 1 -- 172.21.15.50:0/4293910562 >> 172.21.15.50:0/4293910562 conn(0x55f885476c10 msgr2=0x55f8854bf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.586+0000 7f525105d740 1 -- 172.21.15.50:0/4293910562 shutdown_connections 2024-09-11T22:14:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.586+0000 7f525105d740 1 -- 172.21.15.50:0/4293910562 wait complete. 2024-09-11T22:14:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.587+0000 7f525105d740 1 -- start start 2024-09-11T22:14:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.587+0000 7f525105d740 1 Processor -- start 2024-09-11T22:14:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f525105d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547a450 0x55f8854a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f525105d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f88547bbe0 0x55f88549a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f525105d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88549b0d0 0x55f8854c4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f525105d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f8854760b0 con 0x55f88549b0d0 2024-09-11T22:14:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f525105d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f885365350 con 0x55f88547a450 2024-09-11T22:14:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f525105d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f8854c0420 con 0x55f88547bbe0 2024-09-11T22:14:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f525105d740 10 client.0 _ll_register_callbacks cb 0x55f8850eea30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f5247fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88549b0d0 0x55f8854c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f5247fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88549b0d0 0x55f8854c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50096/0 (socket says 172.21.15.50:50096) 2024-09-11T22:14:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f5247fff640 1 -- 172.21.15.50:0/831997328 learned_addr learned my addr 172.21.15.50:0/831997328 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f5246ffd640 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f88547bbe0 0x55f88549a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f52477fe640 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547a450 0x55f8854a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f5247fff640 1 -- 172.21.15.50:0/831997328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f88547bbe0 msgr2=0x55f88549a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f5247fff640 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f88547bbe0 0x55f88549a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f5247fff640 1 -- 172.21.15.50:0/831997328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547a450 msgr2=0x55f8854a3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f5247fff640 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547a450 0x55f8854a3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f5247fff640 1 -- 172.21.15.50:0/831997328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8850ef240 con 0x55f88549b0d0 2024-09-11T22:14:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f52477fe640 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547a450 0x55f8854a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f5247fff640 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88549b0d0 0x55f8854c4270 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5240009bd0 tx=0x7f524007a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd4d06272290f5c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.588+0000 7f52267fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f52267fc640 1 -- 172.21.15.50:0/831997328 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240049040 con 0x55f88549b0d0 2024-09-11T22:14:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f52267fc640 1 -- 172.21.15.50:0/831997328 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f5240078280 con 0x55f88549b0d0 2024-09-11T22:14:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f525105d740 1 -- 172.21.15.50:0/831997328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f523c0017f0 con 0x55f88549b0d0 2024-09-11T22:14:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f52267fc640 1 -- 172.21.15.50:0/831997328 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5240098050 con 0x55f88549b0d0 2024-09-11T22:14:11.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f525105d740 10 client.6015 fetch_fsmap learned FSMap version 25 2024-09-11T22:14:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f525105d740 1 -- 172.21.15.50:0/831997328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55f8851b9620 con 0x55f88549b0d0 2024-09-11T22:14:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f52267fc640 1 -- 172.21.15.50:0/831997328 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f523c0017f0 con 0x55f88549b0d0 2024-09-11T22:14:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f52267fc640 1 -- 172.21.15.50:0/831997328 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f524004c060 con 0x55f88549b0d0 2024-09-11T22:14:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f525105d740 10 client.6015 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:14:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f525105d740 10 client.6015 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f525105d740 20 client.6015 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f525105d740 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55f88549b550 0x55f8854a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f525105d740 4 client.6015 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f525105d740 1 -- 172.21.15.50:0/831997328 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8853e9d40 con 0x55f88549b550 2024-09-11T22:14:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f52477fe640 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55f88549b550 0x55f8854a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f52477fe640 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55f88549b550 0x55f8854a4b60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6333c31fa9d1339b server_cookie=29bfd8643d306707 in_seq=0 out_seq=0 2024-09-11T22:14:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.589+0000 7f52267fc640 10 client.6015 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:11.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f52267fc640 1 -- 172.21.15.50:0/831997328 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8853e9d40 con 0x55f88549b550 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f52267fc640 10 client.6015 handle_command_reply: tid=0 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f525105d740 1 client.6015 shutdown 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f525105d740 1 -- 172.21.15.50:0/831997328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88549b0d0 msgr2=0x55f8854c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f525105d740 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88549b0d0 0x55f8854c4270 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5240009bd0 tx=0x7f524007a040 comp rx=0 tx=0).stop 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f525105d740 1 -- 172.21.15.50:0/831997328 shutdown_connections 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f525105d740 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f88547bbe0 0x55f88549a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f525105d740 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55f88549b550 0x55f8854a4b60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f525105d740 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88549b0d0 0x55f8854c4270 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f525105d740 1 --2- 172.21.15.50:0/831997328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547a450 0x55f8854a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f52267fc640 0 client.6015 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f525105d740 1 -- 172.21.15.50:0/831997328 >> 172.21.15.50:0/831997328 conn(0x55f885477c10 msgr2=0x55f8854781b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f525105d740 1 -- 172.21.15.50:0/831997328 shutdown_connections 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f525105d740 1 -- 172.21.15.50:0/831997328 wait complete. 2024-09-11T22:14:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.590+0000 7f525105d740 20 client.6015 trim_cache size 0 max 16384 2024-09-11T22:14:11.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.605+0000 7f525105d740 1 Processor -- start 2024-09-11T22:14:11.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.605+0000 7f525105d740 1 -- start start 2024-09-11T22:14:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.606+0000 7f525105d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f885477c10 0x55f8854c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.606+0000 7f525105d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 0x55f8854bc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.606+0000 7f525105d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 0x55f88549d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.606+0000 7f525105d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5248200c10 con 0x55f88547a450 2024-09-11T22:14:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.606+0000 7f525105d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52481ffc50 con 0x55f88547bbe0 2024-09-11T22:14:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.606+0000 7f525105d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52480ca630 con 0x55f885477c10 2024-09-11T22:14:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.606+0000 7f5246ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 0x55f8854bc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.606+0000 7f5246ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 0x55f8854bc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50110/0 (socket says 172.21.15.50:50110) 2024-09-11T22:14:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.606+0000 7f5246ffd640 1 -- 172.21.15.50:0/619331802 learned_addr learned my addr 172.21.15.50:0/619331802 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.606+0000 7f5247fff640 1 --2- 172.21.15.50:0/619331802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 0x55f88549d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.606+0000 7f52477fe640 1 --2- 172.21.15.50:0/619331802 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f885477c10 0x55f8854c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.607+0000 7f5246ffd640 1 -- 172.21.15.50:0/619331802 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f885477c10 msgr2=0x55f8854c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.607+0000 7f5246ffd640 1 --2- 172.21.15.50:0/619331802 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f885477c10 0x55f8854c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.607+0000 7f5246ffd640 1 -- 172.21.15.50:0/619331802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 msgr2=0x55f88549d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.607+0000 7f5246ffd640 1 --2- 172.21.15.50:0/619331802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 0x55f88549d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.607+0000 7f5246ffd640 1 -- 172.21.15.50:0/619331802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8854a4ed0 con 0x55f88547a450 2024-09-11T22:14:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.607+0000 7f52477fe640 1 --2- 172.21.15.50:0/619331802 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f885477c10 0x55f8854c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.607+0000 7f5246ffd640 1 --2- 172.21.15.50:0/619331802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 0x55f8854bc740 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f523c013000 tx=0x7f523c009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9478e2b0c8302c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.607+0000 7f522cff9640 1 -- 172.21.15.50:0/619331802 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c01a030 con 0x55f88547a450 2024-09-11T22:14:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.607+0000 7f522cff9640 1 -- 172.21.15.50:0/619331802 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f523c01b040 con 0x55f88547a450 2024-09-11T22:14:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.607+0000 7f522cff9640 1 -- 172.21.15.50:0/619331802 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c0072a0 con 0x55f88547a450 2024-09-11T22:14:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.607+0000 7f525105d740 1 -- 172.21.15.50:0/619331802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 msgr2=0x55f8854bc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.607+0000 7f525105d740 1 --2- 172.21.15.50:0/619331802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 0x55f8854bc740 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f523c013000 tx=0x7f523c009070 comp rx=0 tx=0).stop 2024-09-11T22:14:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.608+0000 7f525105d740 1 -- 172.21.15.50:0/619331802 shutdown_connections 2024-09-11T22:14:11.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.608+0000 7f525105d740 1 --2- 172.21.15.50:0/619331802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 0x55f88549d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.608+0000 7f525105d740 1 --2- 172.21.15.50:0/619331802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 0x55f8854bc740 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.608+0000 7f525105d740 1 --2- 172.21.15.50:0/619331802 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f885477c10 0x55f8854c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.608+0000 7f525105d740 1 -- 172.21.15.50:0/619331802 >> 172.21.15.50:0/619331802 conn(0x55f8854a34b0 msgr2=0x55f8854be1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.608+0000 7f525105d740 1 -- 172.21.15.50:0/619331802 shutdown_connections 2024-09-11T22:14:11.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.608+0000 7f525105d740 1 -- 172.21.15.50:0/619331802 wait complete. 2024-09-11T22:14:11.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.608+0000 7f525105d740 1 -- start start 2024-09-11T22:14:11.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.608+0000 7f525105d740 1 Processor -- start 2024-09-11T22:14:11.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f525105d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f885477c10 0x55f885540bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f525105d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 0x55f885494390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f525105d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 0x55f8854948d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f525105d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f8854a3140 con 0x55f88547a450 2024-09-11T22:14:11.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f525105d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52480cac80 con 0x55f88547bbe0 2024-09-11T22:14:11.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f525105d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f88547ab10 con 0x55f885477c10 2024-09-11T22:14:11.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f525105d740 10 client.0 _ll_register_callbacks cb 0x7f5240079d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:11.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f5246ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 0x55f885494390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f5246ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 0x55f885494390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50116/0 (socket says 172.21.15.50:50116) 2024-09-11T22:14:11.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f5246ffd640 1 -- 172.21.15.50:0/2137589393 learned_addr learned my addr 172.21.15.50:0/2137589393 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f5247fff640 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 0x55f8854948d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f52477fe640 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f885477c10 0x55f885540bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f5246ffd640 1 -- 172.21.15.50:0/2137589393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f885477c10 msgr2=0x55f885540bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f5246ffd640 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f885477c10 0x55f885540bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f5246ffd640 1 -- 172.21.15.50:0/2137589393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 msgr2=0x55f8854948d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f5246ffd640 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 0x55f8854948d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f5246ffd640 1 -- 172.21.15.50:0/2137589393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8854c3dc0 con 0x55f88547a450 2024-09-11T22:14:11.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f52477fe640 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f885477c10 0x55f885540bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:11.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.609+0000 7f5247fff640 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 0x55f8854948d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:11.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f5246ffd640 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 0x55f885494390 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f523c0077e0 tx=0x7f523c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44208511557f7664 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f52267fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f52267fc640 1 -- 172.21.15.50:0/2137589393 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c031060 con 0x55f88547a450 2024-09-11T22:14:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f52267fc640 1 -- 172.21.15.50:0/2137589393 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f523c014650 con 0x55f88547a450 2024-09-11T22:14:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f525105d740 1 -- 172.21.15.50:0/2137589393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f523c01b040 con 0x55f88547a450 2024-09-11T22:14:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f52267fc640 1 -- 172.21.15.50:0/2137589393 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f523c037050 con 0x55f88547a450 2024-09-11T22:14:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f525105d740 10 client.6021 fetch_fsmap learned FSMap version 25 2024-09-11T22:14:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f525105d740 1 -- 172.21.15.50:0/2137589393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55f885478b90 con 0x55f88547a450 2024-09-11T22:14:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f52267fc640 1 -- 172.21.15.50:0/2137589393 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f523c01b040 con 0x55f88547a450 2024-09-11T22:14:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f52267fc640 1 -- 172.21.15.50:0/2137589393 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f523c03a020 con 0x55f88547a450 2024-09-11T22:14:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f525105d740 10 client.6021 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:14:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f525105d740 10 client.6021 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-11T22:14:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f525105d740 20 client.6021 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f525105d740 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55f88549b0d0 0x55f8854e29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f525105d740 4 client.6021 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-11T22:14:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f525105d740 1 -- 172.21.15.50:0/2137589393 --> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x55f8853e4090 con 0x55f88549b0d0 2024-09-11T22:14:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.610+0000 7f52477fe640 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55f88549b0d0 0x55f8854e29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.611+0000 7f52477fe640 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55f88549b0d0 0x55f8854e29e0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e63e6c1b7f6110c2 server_cookie=2caf388a1495a706 in_seq=0 out_seq=0 2024-09-11T22:14:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.611+0000 7f52267fc640 10 client.6021 ms_handle_connect on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f52267fc640 1 -- 172.21.15.50:0/2137589393 <== mds.0 v2:172.21.15.50:6832/3053142878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f8853e4090 con 0x55f88549b0d0 2024-09-11T22:14:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f52267fc640 10 client.6021 handle_command_reply: tid=0 2024-09-11T22:14:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f525105d740 1 client.6021 shutdown 2024-09-11T22:14:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f525105d740 1 -- 172.21.15.50:0/2137589393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 msgr2=0x55f885494390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f525105d740 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 0x55f885494390 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f523c0077e0 tx=0x7f523c000ed0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f525105d740 1 -- 172.21.15.50:0/2137589393 shutdown_connections 2024-09-11T22:14:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f525105d740 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.50:6832/3053142878,v1:172.21.15.50:6834/3053142878] conn(0x55f88549b0d0 0x55f8854e29e0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f525105d740 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f88547bbe0 0x55f8854948d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f525105d740 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f88547a450 0x55f885494390 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f52267fc640 0 client.6021 ms_handle_reset on v2:172.21.15.50:6832/3053142878 2024-09-11T22:14:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f525105d740 1 --2- 172.21.15.50:0/2137589393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f885477c10 0x55f885540bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f525105d740 1 -- 172.21.15.50:0/2137589393 >> 172.21.15.50:0/2137589393 conn(0x55f8854a34b0 msgr2=0x55f88549d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f525105d740 1 -- 172.21.15.50:0/2137589393 shutdown_connections 2024-09-11T22:14:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f525105d740 1 -- 172.21.15.50:0/2137589393 wait complete. 2024-09-11T22:14:11.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f525105d740 20 client.6021 trim_cache size 0 max 16384 2024-09-11T22:14:11.622 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:11.622 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:14:11.622 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:14:11.622 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:11.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f524e1ed640 1 -- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f523406be30 msgr2=0x7f523406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f524e1ed640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f523406be30 0x7f523406e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5238006ca0 tx=0x7f5238009240 comp rx=0 tx=0).stop 2024-09-11T22:14:11.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f524e1ed640 1 -- 172.21.15.50:0/4099858783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524815e840 msgr2=0x7f52481519a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f524e1ed640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524815e840 0x7f52481519a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5240009eb0 tx=0x7f5240004a40 comp rx=0 tx=0).stop 2024-09-11T22:14:11.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f524e1ed640 1 -- 172.21.15.50:0/4099858783 shutdown_connections 2024-09-11T22:14:11.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f524e1ed640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f523406be30 0x7f523406e2f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f524e1ed640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f524815e840 0x7f52481519a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f524e1ed640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52480cf580 0x7f52480b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f524e1ed640 1 --2- 172.21.15.50:0/4099858783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52480cdd50 0x7f52480b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.613+0000 7f524e1ed640 1 -- 172.21.15.50:0/4099858783 >> 172.21.15.50:0/4099858783 conn(0x7f52480b4150 msgr2=0x7f5248070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.614+0000 7f524e1ed640 1 -- 172.21.15.50:0/4099858783 shutdown_connections 2024-09-11T22:14:11.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.614+0000 7f524e1ed640 1 -- 172.21.15.50:0/4099858783 wait complete. 2024-09-11T22:14:11.625 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-11T22:14:11.625 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:14:11.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:14:11.671 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:14:11.726 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:14:11.726 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:14:11.726 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:14:11.727 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:11.743 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:14:11.744 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:11.800 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:14:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.941+0000 7f39703cd640 1 Processor -- start 2024-09-11T22:14:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.941+0000 7f39703cd640 1 -- start start 2024-09-11T22:14:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f39703cd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f39680cf610 0x7f39680b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f39703cd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39680cfbd0 con 0x7f3968161fa0 2024-09-11T22:14:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f39703cd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39680cfeb0 con 0x7f39680b1600 2024-09-11T22:14:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f39703cd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f39680d1220 con 0x7f39680cf610 2024-09-11T22:14:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396e169640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3968161fa0 0x7f39680cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51100/0 (socket says 172.21.15.50:51100) 2024-09-11T22:14:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396e169640 1 -- 172.21.15.50:0/2639164414 learned_addr learned my addr 172.21.15.50:0/2639164414 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396d968640 1 --2- 172.21.15.50:0/2639164414 >> v2:172.21.15.77:3300/0 conn(0x7f39680cf610 0x7f39680b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4240961657 0 0) 0x7f39680cfbd0 con 0x7f3968161fa0 2024-09-11T22:14:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3954003520 con 0x7f3968161fa0 2024-09-11T22:14:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4261477955 0 0) 0x7f3954003520 con 0x7f3968161fa0 2024-09-11T22:14:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 >> v2:172.21.15.77:3300/0 conn(0x7f39680cf610 msgr2=0x7f39680b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396d167640 1 --2- 172.21.15.50:0/2639164414 >> v2:172.21.15.77:3300/0 conn(0x7f39680cf610 0x7f39680b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 >> v1:172.21.15.77:6789/0 conn(0x7f39680b1600 legacy=0x7f39680cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39680d1470 con 0x7f3968161fa0 2024-09-11T22:14:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f3964001670 con 0x7f3968161fa0 2024-09-11T22:14:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 >> v1:172.21.15.50:6789/0 conn(0x7f3968161fa0 legacy=0x7f39680cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396d167640 1 --2- 172.21.15.50:0/2639164414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39540039b0 0x7f3954003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.942+0000 7f396d167640 1 --2- 172.21.15.50:0/2639164414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3954004800 0x7f3954004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396d167640 1 --2- 172.21.15.50:0/2639164414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39540051c0 0x7f395400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39680d1220 con 0x7f3954004800 2024-09-11T22:14:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f395400c060 con 0x7f39540039b0 2024-09-11T22:14:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f395400c260 con 0x7f39540051c0 2024-09-11T22:14:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396d968640 1 --2- 172.21.15.50:0/2639164414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3954004800 0x7f3954004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396e169640 1 --2- 172.21.15.50:0/2639164414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39540039b0 0x7f3954003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396e96a640 1 --2- 172.21.15.50:0/2639164414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39540051c0 0x7f395400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396d968640 1 -- 172.21.15.50:0/2639164414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39540051c0 msgr2=0x7f395400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396d968640 1 --2- 172.21.15.50:0/2639164414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39540051c0 0x7f395400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396d968640 1 -- 172.21.15.50:0/2639164414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39540039b0 msgr2=0x7f3954003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396d968640 1 --2- 172.21.15.50:0/2639164414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39540039b0 0x7f3954003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396d968640 1 -- 172.21.15.50:0/2639164414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3954003520 con 0x7f3954004800 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396e96a640 1 --2- 172.21.15.50:0/2639164414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39540051c0 0x7f395400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.943+0000 7f396e96a640 1 -- 172.21.15.50:0/2639164414 reap_dead start 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.944+0000 7f396d968640 1 --2- 172.21.15.50:0/2639164414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3954004800 0x7f3954004c80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3958009ac0 tx=0x7f3954005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d09ee3779f65c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.944+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958036070 con 0x7f3954004800 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.944+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3958031400 con 0x7f3954004800 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.944+0000 7f396d167640 1 -- 172.21.15.50:0/2639164414 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958009690 con 0x7f3954004800 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.944+0000 7f39703cd640 1 -- 172.21.15.50:0/2639164414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3954004800 msgr2=0x7f3954004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.944+0000 7f39703cd640 1 --2- 172.21.15.50:0/2639164414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3954004800 0x7f3954004c80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3958009ac0 tx=0x7f3954005830 comp rx=0 tx=0).stop 2024-09-11T22:14:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.944+0000 7f39703cd640 1 -- 172.21.15.50:0/2639164414 shutdown_connections 2024-09-11T22:14:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.944+0000 7f39703cd640 1 --2- 172.21.15.50:0/2639164414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3954004800 0x7f3954004c80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.944+0000 7f39703cd640 1 -- 172.21.15.50:0/2639164414 >> 172.21.15.50:0/2639164414 conn(0x7f396809ba50 msgr2=0x7f39680b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.944+0000 7f39703cd640 1 -- 172.21.15.50:0/2639164414 shutdown_connections 2024-09-11T22:14:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.944+0000 7f39703cd640 1 -- 172.21.15.50:0/2639164414 wait complete. 2024-09-11T22:14:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.946+0000 7f39703cd640 1 Processor -- start 2024-09-11T22:14:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.946+0000 7f39703cd640 1 -- start start 2024-09-11T22:14:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.946+0000 7f39703cd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3954004800 0x7f3968152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.946+0000 7f39703cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396815d670 0x7f396815dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.946+0000 7f39703cd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3968160c00 0x7f3968161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.946+0000 7f39703cd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39680d1c70 con 0x7f396815d670 2024-09-11T22:14:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.946+0000 7f39703cd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f39680d17e0 con 0x7f3954004800 2024-09-11T22:14:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.946+0000 7f39703cd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f39680d1df0 con 0x7f3968160c00 2024-09-11T22:14:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.946+0000 7f396d968640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396815d670 0x7f396815dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f396d968640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396815d670 0x7f396815dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50136/0 (socket says 172.21.15.50:50136) 2024-09-11T22:14:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f396d968640 1 -- 172.21.15.50:0/2885605506 learned_addr learned my addr 172.21.15.50:0/2885605506 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f396e169640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3954004800 0x7f3968152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f396e96a640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3968160c00 0x7f3968161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f396d968640 1 -- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3968160c00 msgr2=0x7f3968161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f396d968640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3968160c00 0x7f3968161080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f396d968640 1 -- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3954004800 msgr2=0x7f3968152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f396d968640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3954004800 0x7f3968152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f396d968640 1 -- 172.21.15.50:0/2885605506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39680cada0 con 0x7f396815d670 2024-09-11T22:14:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f396d968640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396815d670 0x7f396815dad0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3958034040 tx=0x7f3958004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f395effd640 1 -- 172.21.15.50:0/2885605506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395803f020 con 0x7f396815d670 2024-09-11T22:14:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f395effd640 1 -- 172.21.15.50:0/2885605506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3958037040 con 0x7f396815d670 2024-09-11T22:14:11.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f39703cd640 1 -- 172.21.15.50:0/2885605506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39680cb080 con 0x7f396815d670 2024-09-11T22:14:11.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f395effd640 1 -- 172.21.15.50:0/2885605506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958036070 con 0x7f396815d670 2024-09-11T22:14:11.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.947+0000 7f39703cd640 1 -- 172.21.15.50:0/2885605506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39680cb640 con 0x7f396815d670 2024-09-11T22:14:11.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.948+0000 7f39703cd640 1 -- 172.21.15.50:0/2885605506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39680b4d20 con 0x7f396815d670 2024-09-11T22:14:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.949+0000 7f395effd640 1 -- 172.21.15.50:0/2885605506 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3958042020 con 0x7f396815d670 2024-09-11T22:14:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.949+0000 7f395effd640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f394c06be30 0x7f394c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.949+0000 7f395effd640 1 -- 172.21.15.50:0/2885605506 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f39580aabe0 con 0x7f396815d670 2024-09-11T22:14:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.949+0000 7f396e169640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f394c06be30 0x7f394c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.950+0000 7f396e169640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f394c06be30 0x7f394c06e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3964001cd0 tx=0x7f3964001c60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:11.953+0000 7f395effd640 1 -- 172.21.15.50:0/2885605506 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3958049070 con 0x7f396815d670 2024-09-11T22:14:12.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.140+0000 7f39703cd640 1 -- 172.21.15.50:0/2885605506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f39680a0830 con 0x7f396815d670 2024-09-11T22:14:12.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.140+0000 7f395effd640 1 -- 172.21.15.50:0/2885605506 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) ==== 80+0+0 (secure 0 0 0) 0x7f3958078f00 con 0x7f396815d670 2024-09-11T22:14:12.142 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:14:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.142+0000 7f39703cd640 1 -- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f394c06be30 msgr2=0x7f394c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.142+0000 7f39703cd640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f394c06be30 0x7f394c06e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3964001cd0 tx=0x7f3964001c60 comp rx=0 tx=0).stop 2024-09-11T22:14:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.142+0000 7f39703cd640 1 -- 172.21.15.50:0/2885605506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396815d670 msgr2=0x7f396815dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.142+0000 7f39703cd640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396815d670 0x7f396815dad0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3958034040 tx=0x7f3958004730 comp rx=0 tx=0).stop 2024-09-11T22:14:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.143+0000 7f39703cd640 1 -- 172.21.15.50:0/2885605506 shutdown_connections 2024-09-11T22:14:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.143+0000 7f39703cd640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f394c06be30 0x7f394c06e2f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.143+0000 7f39703cd640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3968160c00 0x7f3968161080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.143+0000 7f39703cd640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396815d670 0x7f396815dad0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.143+0000 7f39703cd640 1 --2- 172.21.15.50:0/2885605506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3954004800 0x7f3968152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.143+0000 7f39703cd640 1 -- 172.21.15.50:0/2885605506 >> 172.21.15.50:0/2885605506 conn(0x7f396809ba50 msgr2=0x7f39680aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.143+0000 7f39703cd640 1 -- 172.21.15.50:0/2885605506 shutdown_connections 2024-09-11T22:14:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:12.143+0000 7f39703cd640 1 -- 172.21.15.50:0/2885605506 wait complete. 2024-09-11T22:14:12.154 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:14:12.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:12.154 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:14:12.363 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:14:12.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:14:12.528 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:14:12.528+0000 7f2a0e0d5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-11T22:14:13.495 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:14:13.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:13.495 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:14:13.511 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:14:13.511 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:14:13.511 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:13.528 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:14:13.528 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:14:13.529 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:14:13.529 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:13.568 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:14:13.568 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:14:13.568 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:14:13.568 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:13.585 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:14:13.585 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:13.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.709+0000 7f15d63f8640 1 Processor -- start 2024-09-11T22:14:13.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.709+0000 7f15d63f8640 1 -- start start 2024-09-11T22:14:13.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.710+0000 7f15d63f8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f15d0161fa0 0x7f15d00b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:13.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.710+0000 7f15d63f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15d00cf610 0x7f15d00cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:13.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.710+0000 7f15d63f8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d00cfbd0 con 0x7f15d00b1600 2024-09-11T22:14:13.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.710+0000 7f15d63f8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f15d00d1220 con 0x7f15d0161fa0 2024-09-11T22:14:13.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.710+0000 7f15d63f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f15d00d17e0 con 0x7f15d00cf610 2024-09-11T22:14:13.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.710+0000 7f15d4995640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15d00cf610 0x7f15d00cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:13.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.710+0000 7f15cffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f15d0161fa0 0x7f15d00b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:13.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.710+0000 7f15d4995640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15d00cf610 0x7f15d00cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:56440/0 (socket says 172.21.15.50:56440) 2024-09-11T22:14:13.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.710+0000 7f15d4995640 1 -- 172.21.15.50:0/3654170509 learned_addr learned my addr 172.21.15.50:0/3654170509 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:13.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.711+0000 7f15d4995640 1 -- 172.21.15.50:0/3654170509 >> v2:172.21.15.77:3300/0 conn(0x7f15d0161fa0 msgr2=0x7f15d00b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:13.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.711+0000 7f15d4995640 1 --2- 172.21.15.50:0/3654170509 >> v2:172.21.15.77:3300/0 conn(0x7f15d0161fa0 0x7f15d00b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:13.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.711+0000 7f15d4995640 1 -- 172.21.15.50:0/3654170509 >> v1:172.21.15.77:6789/0 conn(0x7f15d00b1600 legacy=0x7f15d00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:13.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.711+0000 7f15d4995640 1 -- 172.21.15.50:0/3654170509 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d00cfeb0 con 0x7f15d00cf610 2024-09-11T22:14:13.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.711+0000 7f15cffff640 1 --2- 172.21.15.50:0/3654170509 >> v2:172.21.15.77:3300/0 conn(0x7f15d0161fa0 0x7f15d00b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:13.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.711+0000 7f15d4995640 1 --2- 172.21.15.50:0/3654170509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15d00cf610 0x7f15d00cccd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009e50 tx=0x7f15c802a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f26f743d1cb69b72 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:13.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.712+0000 7f15ceffd640 1 -- 172.21.15.50:0/3654170509 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8036070 con 0x7f15d00cf610 2024-09-11T22:14:13.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.712+0000 7f15ceffd640 1 -- 172.21.15.50:0/3654170509 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c8031600 con 0x7f15d00cf610 2024-09-11T22:14:13.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.712+0000 7f15ceffd640 1 -- 172.21.15.50:0/3654170509 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c80319d0 con 0x7f15d00cf610 2024-09-11T22:14:13.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.712+0000 7f15d63f8640 1 -- 172.21.15.50:0/3654170509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15d00cf610 msgr2=0x7f15d00cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:13.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.712+0000 7f15d63f8640 1 --2- 172.21.15.50:0/3654170509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15d00cf610 0x7f15d00cccd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009e50 tx=0x7f15c802a730 comp rx=0 tx=0).stop 2024-09-11T22:14:13.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.712+0000 7f15d63f8640 1 -- 172.21.15.50:0/3654170509 shutdown_connections 2024-09-11T22:14:13.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.712+0000 7f15d63f8640 1 --2- 172.21.15.50:0/3654170509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15d00cf610 0x7f15d00cccd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:13.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.712+0000 7f15d63f8640 1 --2- 172.21.15.50:0/3654170509 >> v2:172.21.15.77:3300/0 conn(0x7f15d0161fa0 0x7f15d00b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:13.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.712+0000 7f15d63f8640 1 -- 172.21.15.50:0/3654170509 >> 172.21.15.50:0/3654170509 conn(0x7f15d009ba50 msgr2=0x7f15d00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:13.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.712+0000 7f15d63f8640 1 -- 172.21.15.50:0/3654170509 shutdown_connections 2024-09-11T22:14:13.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.712+0000 7f15d63f8640 1 -- 172.21.15.50:0/3654170509 wait complete. 2024-09-11T22:14:13.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.713+0000 7f15d63f8640 1 Processor -- start 2024-09-11T22:14:13.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.714+0000 7f15d63f8640 1 -- start start 2024-09-11T22:14:13.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.714+0000 7f15d63f8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15d00b1600 0x7f15d015cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:13.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.714+0000 7f15d63f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15d00cf610 0x7f15d00b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:13.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.714+0000 7f15d63f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15d0161fa0 0x7f15d00ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:13.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.714+0000 7f15d63f8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0162500 con 0x7f15d00b1600 2024-09-11T22:14:13.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.714+0000 7f15d63f8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0162380 con 0x7f15d00cf610 2024-09-11T22:14:13.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.714+0000 7f15d63f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f15d00d1c70 con 0x7f15d0161fa0 2024-09-11T22:14:13.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15cffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15d00b1600 0x7f15d015cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:13.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15cffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15d00b1600 0x7f15d015cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50138/0 (socket says 172.21.15.50:50138) 2024-09-11T22:14:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15cffff640 1 -- 172.21.15.50:0/3252682963 learned_addr learned my addr 172.21.15.50:0/3252682963 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15d4995640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15d0161fa0 0x7f15d00ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15cf7fe640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15d00cf610 0x7f15d00b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15cffff640 1 -- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15d0161fa0 msgr2=0x7f15d00ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15cffff640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15d0161fa0 0x7f15d00ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15cffff640 1 -- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15d00cf610 msgr2=0x7f15d00b7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15cffff640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15d00cf610 0x7f15d00b7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15cffff640 1 -- 172.21.15.50:0/3252682963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d00b6c30 con 0x7f15d00b1600 2024-09-11T22:14:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15cffff640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15d00b1600 0x7f15d015cde0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f15c000e990 tx=0x7f15c000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15ccff9640 1 -- 172.21.15.50:0/3252682963 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0017070 con 0x7f15d00b1600 2024-09-11T22:14:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15ccff9640 1 -- 172.21.15.50:0/3252682963 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c000c9e0 con 0x7f15d00b1600 2024-09-11T22:14:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15d63f8640 1 -- 172.21.15.50:0/3252682963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d00b6f10 con 0x7f15d00b1600 2024-09-11T22:14:13.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15ccff9640 1 -- 172.21.15.50:0/3252682963 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c000cdb0 con 0x7f15d00b1600 2024-09-11T22:14:13.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.715+0000 7f15d63f8640 1 -- 172.21.15.50:0/3252682963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d00b74d0 con 0x7f15d00b1600 2024-09-11T22:14:13.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.716+0000 7f15d63f8640 1 -- 172.21.15.50:0/3252682963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d00b4d20 con 0x7f15d00b1600 2024-09-11T22:14:13.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.717+0000 7f15ccff9640 1 -- 172.21.15.50:0/3252682963 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15c001a070 con 0x7f15d00b1600 2024-09-11T22:14:13.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.717+0000 7f15ccff9640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f15bc06be30 0x7f15bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:13.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.717+0000 7f15ccff9640 1 -- 172.21.15.50:0/3252682963 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f15c008b0a0 con 0x7f15d00b1600 2024-09-11T22:14:13.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.718+0000 7f15cf7fe640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f15bc06be30 0x7f15bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:13.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.718+0000 7f15cf7fe640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f15bc06be30 0x7f15bc06e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f15d00b4400 tx=0x7f15c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:13.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.722+0000 7f15ccff9640 1 -- 172.21.15.50:0/3252682963 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15c0059320 con 0x7f15d00b1600 2024-09-11T22:14:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.930+0000 7f15d63f8640 1 -- 172.21.15.50:0/3252682963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15d0070f90 con 0x7f15d00b1600 2024-09-11T22:14:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.931+0000 7f15ccff9640 1 -- 172.21.15.50:0/3252682963 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5224 (secure 0 0 0) 0x7f15c005d620 con 0x7f15d00b1600 2024-09-11T22:14:13.932 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:13.932 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"btime":"2024-09-11T22:14:12:528828+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2882007728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2882007728},{"type":"v1","addr":"172.21.15.50:6835","nonce":2882007728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1935649711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935649711},{"type":"v1","addr":"172.21.15.77:6837","nonce":1935649711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3208356003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3208356003},{"type":"v1","addr":"172.21.15.77:6836","nonce":3208356003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:13:39.660035+0000","modified":"2024-09-11T22:14:12.334915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.50:6834/3053142878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3053142878},{"type":"v1","addr":"172.21.15.50:6834","nonce":3053142878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-11T22:14:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2024-09-11T22:14:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.933+0000 7f15d63f8640 1 -- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f15bc06be30 msgr2=0x7f15bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.933+0000 7f15d63f8640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f15bc06be30 0x7f15bc06e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f15d00b4400 tx=0x7f15c4009040 comp rx=0 tx=0).stop 2024-09-11T22:14:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.933+0000 7f15d63f8640 1 -- 172.21.15.50:0/3252682963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15d00b1600 msgr2=0x7f15d015cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.933+0000 7f15d63f8640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15d00b1600 0x7f15d015cde0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f15c000e990 tx=0x7f15c000ee50 comp rx=0 tx=0).stop 2024-09-11T22:14:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.933+0000 7f15d63f8640 1 -- 172.21.15.50:0/3252682963 shutdown_connections 2024-09-11T22:14:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.933+0000 7f15d63f8640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f15bc06be30 0x7f15bc06e2f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.933+0000 7f15d63f8640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15d0161fa0 0x7f15d00ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.933+0000 7f15d63f8640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15d00cf610 0x7f15d00b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.933+0000 7f15d63f8640 1 --2- 172.21.15.50:0/3252682963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15d00b1600 0x7f15d015cde0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:13.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.933+0000 7f15d63f8640 1 -- 172.21.15.50:0/3252682963 >> 172.21.15.50:0/3252682963 conn(0x7f15d009ba50 msgr2=0x7f15d006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:13.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.933+0000 7f15d63f8640 1 -- 172.21.15.50:0/3252682963 shutdown_connections 2024-09-11T22:14:13.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:13.933+0000 7f15d63f8640 1 -- 172.21.15.50:0/3252682963 wait complete. 2024-09-11T22:14:13.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:14.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.045+0000 7fc63768d640 1 Processor -- start 2024-09-11T22:14:14.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.045+0000 7fc63768d640 1 -- start start 2024-09-11T22:14:14.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.046+0000 7fc63768d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6300d1c90 0x7fc6300b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.046+0000 7fc63768d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc630162350 0x7fc6301627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.046+0000 7fc63768d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc630163080 con 0x7fc63015e8e0 2024-09-11T22:14:14.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.046+0000 7fc63768d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc63015ecc0 con 0x7fc6300d1c90 2024-09-11T22:14:14.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.046+0000 7fc63768d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc6300d2ad0 con 0x7fc630162350 2024-09-11T22:14:14.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.046+0000 7fc634c28640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6300d1c90 0x7fc6300b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.046+0000 7fc635429640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc63015e8e0 0x7fc6300d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51110/0 (socket says 172.21.15.50:51110) 2024-09-11T22:14:14.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.046+0000 7fc635429640 1 -- 172.21.15.50:0/2360221570 learned_addr learned my addr 172.21.15.50:0/2360221570 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:14.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.047+0000 7fc635c2a640 1 --2- 172.21.15.50:0/2360221570 >> v2:172.21.15.77:3300/0 conn(0x7fc630162350 0x7fc6301627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.047+0000 7fc634c28640 1 -- 172.21.15.50:0/2360221570 >> v2:172.21.15.77:3300/0 conn(0x7fc630162350 msgr2=0x7fc6301627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:14.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.047+0000 7fc634c28640 1 --2- 172.21.15.50:0/2360221570 >> v2:172.21.15.77:3300/0 conn(0x7fc630162350 0x7fc6301627a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.047+0000 7fc634c28640 1 -- 172.21.15.50:0/2360221570 >> v1:172.21.15.50:6789/0 conn(0x7fc63015e8e0 legacy=0x7fc6300d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.047+0000 7fc634c28640 1 -- 172.21.15.50:0/2360221570 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6300d2d20 con 0x7fc6300d1c90 2024-09-11T22:14:14.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.047+0000 7fc627fff640 1 -- 172.21.15.50:0/2360221570 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255530780 0 0) 0x7fc630163080 con 0x7fc63015e8e0 2024-09-11T22:14:14.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.047+0000 7fc634c28640 1 --2- 172.21.15.50:0/2360221570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6300d1c90 0x7fc6300b7880 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc6300d1220 tx=0x7fc62002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6c2c8fb2179e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:14.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.048+0000 7fc627fff640 1 -- 172.21.15.50:0/2360221570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620037070 con 0x7fc6300d1c90 2024-09-11T22:14:14.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.048+0000 7fc627fff640 1 -- 172.21.15.50:0/2360221570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc620032440 con 0x7fc6300d1c90 2024-09-11T22:14:14.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.048+0000 7fc627fff640 1 -- 172.21.15.50:0/2360221570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620032810 con 0x7fc6300d1c90 2024-09-11T22:14:14.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.048+0000 7fc63768d640 1 -- 172.21.15.50:0/2360221570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6300d1c90 msgr2=0x7fc6300b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.048+0000 7fc63768d640 1 --2- 172.21.15.50:0/2360221570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6300d1c90 0x7fc6300b7880 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc6300d1220 tx=0x7fc62002a230 comp rx=0 tx=0).stop 2024-09-11T22:14:14.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.048+0000 7fc63768d640 1 -- 172.21.15.50:0/2360221570 shutdown_connections 2024-09-11T22:14:14.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.048+0000 7fc63768d640 1 --2- 172.21.15.50:0/2360221570 >> v2:172.21.15.77:3300/0 conn(0x7fc630162350 0x7fc6301627a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.048+0000 7fc63768d640 1 --2- 172.21.15.50:0/2360221570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6300d1c90 0x7fc6300b7880 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.048+0000 7fc63768d640 1 -- 172.21.15.50:0/2360221570 >> 172.21.15.50:0/2360221570 conn(0x7fc630067ba0 msgr2=0x7fc630067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:14.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.048+0000 7fc63768d640 1 -- 172.21.15.50:0/2360221570 shutdown_connections 2024-09-11T22:14:14.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.048+0000 7fc63768d640 1 -- 172.21.15.50:0/2360221570 wait complete. 2024-09-11T22:14:14.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.049+0000 7fc63768d640 1 Processor -- start 2024-09-11T22:14:14.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.049+0000 7fc63768d640 1 -- start start 2024-09-11T22:14:14.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.050+0000 7fc63768d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6300d1c90 0x7fc630150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.050+0000 7fc63768d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc63015e8e0 0x7fc6300ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.050+0000 7fc63768d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc630162350 0x7fc6300b6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.050+0000 7fc63768d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc630162ce0 con 0x7fc63015e8e0 2024-09-11T22:14:14.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.050+0000 7fc63768d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6300d3370 con 0x7fc630162350 2024-09-11T22:14:14.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.050+0000 7fc63768d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc630162e60 con 0x7fc6300d1c90 2024-09-11T22:14:14.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.050+0000 7fc634c28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc63015e8e0 0x7fc6300ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.050+0000 7fc634c28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc63015e8e0 0x7fc6300ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50162/0 (socket says 172.21.15.50:50162) 2024-09-11T22:14:14.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.050+0000 7fc634c28640 1 -- 172.21.15.50:0/2781987659 learned_addr learned my addr 172.21.15.50:0/2781987659 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:14.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.050+0000 7fc634c28640 1 -- 172.21.15.50:0/2781987659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6300d1c90 msgr2=0x7fc630150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.051+0000 7fc634c28640 1 --2- 172.21.15.50:0/2781987659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6300d1c90 0x7fc630150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.051+0000 7fc635c2a640 1 --2- 172.21.15.50:0/2781987659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc630162350 0x7fc6300b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.051+0000 7fc634c28640 1 -- 172.21.15.50:0/2781987659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc630162350 msgr2=0x7fc6300b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.051+0000 7fc634c28640 1 --2- 172.21.15.50:0/2781987659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc630162350 0x7fc6300b6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.051+0000 7fc634c28640 1 -- 172.21.15.50:0/2781987659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6300b52a0 con 0x7fc63015e8e0 2024-09-11T22:14:14.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.051+0000 7fc634c28640 1 --2- 172.21.15.50:0/2781987659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc63015e8e0 0x7fc6300ce3c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc620000c00 tx=0x7fc6200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:14.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.051+0000 7fc625ffb640 1 -- 172.21.15.50:0/2781987659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620037040 con 0x7fc63015e8e0 2024-09-11T22:14:14.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.051+0000 7fc625ffb640 1 -- 172.21.15.50:0/2781987659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc620042070 con 0x7fc63015e8e0 2024-09-11T22:14:14.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.051+0000 7fc63768d640 1 -- 172.21.15.50:0/2781987659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6300b5580 con 0x7fc63015e8e0 2024-09-11T22:14:14.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.051+0000 7fc625ffb640 1 -- 172.21.15.50:0/2781987659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620030960 con 0x7fc63015e8e0 2024-09-11T22:14:14.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.051+0000 7fc63768d640 1 -- 172.21.15.50:0/2781987659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6300b5b40 con 0x7fc63015e8e0 2024-09-11T22:14:14.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.052+0000 7fc63768d640 1 -- 172.21.15.50:0/2781987659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6300b7880 con 0x7fc63015e8e0 2024-09-11T22:14:14.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.053+0000 7fc625ffb640 1 -- 172.21.15.50:0/2781987659 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc620030b00 con 0x7fc63015e8e0 2024-09-11T22:14:14.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.053+0000 7fc625ffb640 1 --2- 172.21.15.50:0/2781987659 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc61406be60 0x7fc61406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.054+0000 7fc625ffb640 1 -- 172.21.15.50:0/2781987659 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc6200ab7c0 con 0x7fc63015e8e0 2024-09-11T22:14:14.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.054+0000 7fc635429640 1 --2- 172.21.15.50:0/2781987659 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc61406be60 0x7fc61406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.054+0000 7fc635429640 1 --2- 172.21.15.50:0/2781987659 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc61406be60 0x7fc61406e320 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc62c007fd0 tx=0x7fc62c007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:14.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.058+0000 7fc625ffb640 1 -- 172.21.15.50:0/2781987659 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc62007a130 con 0x7fc63015e8e0 2024-09-11T22:14:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.268+0000 7fc63768d640 1 -- 172.21.15.50:0/2781987659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6300ba770 con 0x7fc63015e8e0 2024-09-11T22:14:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.269+0000 7fc625ffb640 1 -- 172.21.15.50:0/2781987659 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5224 (secure 0 0 0) 0x7fc620079a30 con 0x7fc63015e8e0 2024-09-11T22:14:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:14.270 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"btime":"2024-09-11T22:14:12:528828+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2882007728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2882007728},{"type":"v1","addr":"172.21.15.50:6835","nonce":2882007728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1935649711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935649711},{"type":"v1","addr":"172.21.15.77:6837","nonce":1935649711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3208356003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3208356003},{"type":"v1","addr":"172.21.15.77:6836","nonce":3208356003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:13:39.660035+0000","modified":"2024-09-11T22:14:12.334915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.50:6834/3053142878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3053142878},{"type":"v1","addr":"172.21.15.50:6834","nonce":3053142878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-11T22:14:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2024-09-11T22:14:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.271+0000 7fc63768d640 1 -- 172.21.15.50:0/2781987659 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc61406be60 msgr2=0x7fc61406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.271+0000 7fc63768d640 1 --2- 172.21.15.50:0/2781987659 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc61406be60 0x7fc61406e320 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc62c007fd0 tx=0x7fc62c007920 comp rx=0 tx=0).stop 2024-09-11T22:14:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.271+0000 7fc63768d640 1 -- 172.21.15.50:0/2781987659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc63015e8e0 msgr2=0x7fc6300ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.271+0000 7fc63768d640 1 --2- 172.21.15.50:0/2781987659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc63015e8e0 0x7fc6300ce3c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc620000c00 tx=0x7fc6200046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.271+0000 7fc63768d640 1 -- 172.21.15.50:0/2781987659 shutdown_connections 2024-09-11T22:14:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.271+0000 7fc63768d640 1 --2- 172.21.15.50:0/2781987659 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc61406be60 0x7fc61406e320 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.271+0000 7fc63768d640 1 --2- 172.21.15.50:0/2781987659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc630162350 0x7fc6300b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.271+0000 7fc63768d640 1 --2- 172.21.15.50:0/2781987659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc63015e8e0 0x7fc6300ce3c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.271+0000 7fc63768d640 1 --2- 172.21.15.50:0/2781987659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6300d1c90 0x7fc630150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.271+0000 7fc63768d640 1 -- 172.21.15.50:0/2781987659 >> 172.21.15.50:0/2781987659 conn(0x7fc630067ba0 msgr2=0x7fc63015f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:14.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.271+0000 7fc63768d640 1 -- 172.21.15.50:0/2781987659 shutdown_connections 2024-09-11T22:14:14.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.271+0000 7fc63768d640 1 -- 172.21.15.50:0/2781987659 wait complete. 2024-09-11T22:14:14.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:14:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.385+0000 7f03286f1640 1 Processor -- start 2024-09-11T22:14:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.385+0000 7f03286f1640 1 -- start start 2024-09-11T22:14:14.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.386+0000 7f03286f1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f03200cf610 0x7f03200b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.386+0000 7f03286f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03200b1600 0x7f03200cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.386+0000 7f03286f1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03200cfbd0 con 0x7f0320161fa0 2024-09-11T22:14:14.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.386+0000 7f03286f1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f03200d1220 con 0x7f03200cf610 2024-09-11T22:14:14.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.386+0000 7f03286f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f03200d17e0 con 0x7f03200b1600 2024-09-11T22:14:14.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.386+0000 7f0325c8c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f03200cf610 0x7f03200b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.386+0000 7f032648d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0320161fa0 0x7f03200cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51116/0 (socket says 172.21.15.50:51116) 2024-09-11T22:14:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.386+0000 7f032648d640 1 -- 172.21.15.50:0/1763322580 learned_addr learned my addr 172.21.15.50:0/1763322580 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.386+0000 7f0325c8c640 1 --2- 172.21.15.50:0/1763322580 >> v2:172.21.15.50:3300/0 conn(0x7f03200cf610 0x7f03200b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50172/0 (socket says 172.21.15.50:50172) 2024-09-11T22:14:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.387+0000 7f0326c8e640 1 --2- 172.21.15.50:0/1763322580 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03200b1600 0x7f03200cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.387+0000 7f0325c8c640 1 -- 172.21.15.50:0/1763322580 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03200b1600 msgr2=0x7f03200cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.387+0000 7f0325c8c640 1 --2- 172.21.15.50:0/1763322580 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03200b1600 0x7f03200cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.387+0000 7f0325c8c640 1 -- 172.21.15.50:0/1763322580 >> v1:172.21.15.50:6789/0 conn(0x7f0320161fa0 legacy=0x7f03200cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.387+0000 7f0325c8c640 1 -- 172.21.15.50:0/1763322580 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03200cfeb0 con 0x7f03200cf610 2024-09-11T22:14:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.387+0000 7f0325c8c640 1 --2- 172.21.15.50:0/1763322580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03200cf610 0x7f03200b4d20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f03140097a0 tx=0x7f031402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea0e5eab02b1e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.388+0000 7f032548b640 1 -- 172.21.15.50:0/1763322580 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0314037070 con 0x7f03200cf610 2024-09-11T22:14:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.388+0000 7f032548b640 1 -- 172.21.15.50:0/1763322580 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0314032440 con 0x7f03200cf610 2024-09-11T22:14:14.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.388+0000 7f032548b640 1 -- 172.21.15.50:0/1763322580 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0314032810 con 0x7f03200cf610 2024-09-11T22:14:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.388+0000 7f03286f1640 1 -- 172.21.15.50:0/1763322580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03200cf610 msgr2=0x7f03200b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.388+0000 7f03286f1640 1 --2- 172.21.15.50:0/1763322580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03200cf610 0x7f03200b4d20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f03140097a0 tx=0x7f031402a180 comp rx=0 tx=0).stop 2024-09-11T22:14:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.388+0000 7f03286f1640 1 -- 172.21.15.50:0/1763322580 shutdown_connections 2024-09-11T22:14:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.388+0000 7f03286f1640 1 --2- 172.21.15.50:0/1763322580 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03200b1600 0x7f03200cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.388+0000 7f03286f1640 1 --2- 172.21.15.50:0/1763322580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03200cf610 0x7f03200b4d20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.388+0000 7f03286f1640 1 -- 172.21.15.50:0/1763322580 >> 172.21.15.50:0/1763322580 conn(0x7f032009ba50 msgr2=0x7f03200b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.388+0000 7f03286f1640 1 -- 172.21.15.50:0/1763322580 shutdown_connections 2024-09-11T22:14:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.388+0000 7f03286f1640 1 -- 172.21.15.50:0/1763322580 wait complete. 2024-09-11T22:14:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.389+0000 7f03286f1640 1 Processor -- start 2024-09-11T22:14:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.389+0000 7f03286f1640 1 -- start start 2024-09-11T22:14:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.390+0000 7f03286f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03200b1600 0x7f032015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.390+0000 7f03286f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03200cf610 0x7f03201f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.390+0000 7f03286f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0320161fa0 0x7f03200c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.390+0000 7f03286f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0320162500 con 0x7f0320161fa0 2024-09-11T22:14:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.390+0000 7f03286f1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0320162380 con 0x7f03200cf610 2024-09-11T22:14:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.390+0000 7f03286f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f03200d1c70 con 0x7f03200b1600 2024-09-11T22:14:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.390+0000 7f0326c8e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0320161fa0 0x7f03200c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.390+0000 7f0326c8e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0320161fa0 0x7f03200c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50174/0 (socket says 172.21.15.50:50174) 2024-09-11T22:14:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.390+0000 7f0326c8e640 1 -- 172.21.15.50:0/1944417591 learned_addr learned my addr 172.21.15.50:0/1944417591 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.390+0000 7f032648d640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03200b1600 0x7f032015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.390+0000 7f0325c8c640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03200cf610 0x7f03201f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.391+0000 7f0326c8e640 1 -- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03200b1600 msgr2=0x7f032015cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.391+0000 7f0326c8e640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03200b1600 0x7f032015cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.391+0000 7f0326c8e640 1 -- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03200cf610 msgr2=0x7f03201f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.391+0000 7f0326c8e640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03200cf610 0x7f03201f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.391+0000 7f0326c8e640 1 -- 172.21.15.50:0/1944417591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03200b4840 con 0x7f0320161fa0 2024-09-11T22:14:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.391+0000 7f0326c8e640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0320161fa0 0x7f03200c9750 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0310007e40 tx=0x7f031000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.391+0000 7f031effd640 1 -- 172.21.15.50:0/1944417591 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310014620 con 0x7f0320161fa0 2024-09-11T22:14:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.391+0000 7f031effd640 1 -- 172.21.15.50:0/1944417591 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0310019070 con 0x7f0320161fa0 2024-09-11T22:14:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.391+0000 7f03286f1640 1 -- 172.21.15.50:0/1944417591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03200c9e50 con 0x7f0320161fa0 2024-09-11T22:14:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.391+0000 7f031effd640 1 -- 172.21.15.50:0/1944417591 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310014a20 con 0x7f0320161fa0 2024-09-11T22:14:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.391+0000 7f03286f1640 1 -- 172.21.15.50:0/1944417591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03200ca410 con 0x7f0320161fa0 2024-09-11T22:14:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.392+0000 7f03286f1640 1 -- 172.21.15.50:0/1944417591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03200b4d20 con 0x7f0320161fa0 2024-09-11T22:14:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.392+0000 7f031effd640 1 -- 172.21.15.50:0/1944417591 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0310014bc0 con 0x7f0320161fa0 2024-09-11T22:14:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.393+0000 7f031effd640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f030c06be60 0x7f030c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.393+0000 7f031effd640 1 -- 172.21.15.50:0/1944417591 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f031008b760 con 0x7f0320161fa0 2024-09-11T22:14:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.393+0000 7f032648d640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f030c06be60 0x7f030c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.393+0000 7f032648d640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f030c06be60 0x7f030c06e320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0318000f60 tx=0x7f0318009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:14.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.397+0000 7f031effd640 1 -- 172.21.15.50:0/1944417591 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f031005a0d0 con 0x7f0320161fa0 2024-09-11T22:14:14.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.572+0000 7f03286f1640 1 -- 172.21.15.50:0/1944417591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03200afee0 con 0x7f0320161fa0 2024-09-11T22:14:14.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.573+0000 7f031effd640 1 -- 172.21.15.50:0/1944417591 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16788 (secure 0 0 0) 0x7f03100599d0 con 0x7f0320161fa0 2024-09-11T22:14:14.574 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:14.574 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":47,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:13:56.473716+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:13:37.315617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T22:13:38.641830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:14:14.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.575+0000 7f03286f1640 1 -- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f030c06be60 msgr2=0x7f030c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.575+0000 7f03286f1640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f030c06be60 0x7f030c06e320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0318000f60 tx=0x7f0318009040 comp rx=0 tx=0).stop 2024-09-11T22:14:14.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.575+0000 7f03286f1640 1 -- 172.21.15.50:0/1944417591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0320161fa0 msgr2=0x7f03200c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.575+0000 7f03286f1640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0320161fa0 0x7f03200c9750 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0310007e40 tx=0x7f031000e4b0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.575+0000 7f03286f1640 1 -- 172.21.15.50:0/1944417591 shutdown_connections 2024-09-11T22:14:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.575+0000 7f03286f1640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f030c06be60 0x7f030c06e320 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.575+0000 7f03286f1640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0320161fa0 0x7f03200c9750 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.575+0000 7f03286f1640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03200cf610 0x7f03201f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.575+0000 7f03286f1640 1 --2- 172.21.15.50:0/1944417591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03200b1600 0x7f032015cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.575+0000 7f03286f1640 1 -- 172.21.15.50:0/1944417591 >> 172.21.15.50:0/1944417591 conn(0x7f032009ba50 msgr2=0x7f032006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.575+0000 7f03286f1640 1 -- 172.21.15.50:0/1944417591 shutdown_connections 2024-09-11T22:14:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.575+0000 7f03286f1640 1 -- 172.21.15.50:0/1944417591 wait complete. 2024-09-11T22:14:14.587 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:14:14.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.689+0000 7f7209482640 1 Processor -- start 2024-09-11T22:14:14.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.689+0000 7f7209482640 1 -- start start 2024-09-11T22:14:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.690+0000 7f7209482640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f72040d18a0 0x7f72040d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.690+0000 7f7209482640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72040cfa80 con 0x7f720415e870 2024-09-11T22:14:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.690+0000 7f7209482640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72040d40d0 con 0x7f72040d3a30 2024-09-11T22:14:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.690+0000 7f7209482640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f72040d3ea0 con 0x7f72040d18a0 2024-09-11T22:14:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.690+0000 7f7202ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f720415e870 0x7f72040d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51120/0 (socket says 172.21.15.50:51120) 2024-09-11T22:14:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.690+0000 7f7202ffd640 1 -- 172.21.15.50:0/1589748332 learned_addr learned my addr 172.21.15.50:0/1589748332 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2524449098 0 0) 0x7f71fc001110 con 0x7f720415e870 2024-09-11T22:14:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71f0003520 con 0x7f720415e870 2024-09-11T22:14:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f72027fc640 1 --2- 172.21.15.50:0/1589748332 >> v2:172.21.15.77:3300/0 conn(0x7f72040d18a0 0x7f72040d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1480102985 0 0) 0x7f71f0003520 con 0x7f720415e870 2024-09-11T22:14:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 >> v2:172.21.15.77:3300/0 conn(0x7f72040d18a0 msgr2=0x7f72040d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 --2- 172.21.15.50:0/1589748332 >> v2:172.21.15.77:3300/0 conn(0x7f72040d18a0 0x7f72040d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 >> v1:172.21.15.77:6789/0 conn(0x7f72040d3a30 legacy=0x7f72040b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72040d43b0 con 0x7f720415e870 2024-09-11T22:14:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f71fc001840 con 0x7f720415e870 2024-09-11T22:14:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 >> v1:172.21.15.50:6789/0 conn(0x7f720415e870 legacy=0x7f72040d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 --2- 172.21.15.50:0/1589748332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f00039b0 0x7f71f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 --2- 172.21.15.50:0/1589748332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f0004800 0x7f71f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 --2- 172.21.15.50:0/1589748332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71f00051c0 0x7f71f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f71f000c0e0 con 0x7f71f0004800 2024-09-11T22:14:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f71f000c290 con 0x7f71f00039b0 2024-09-11T22:14:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f71f000c490 con 0x7f71f00051c0 2024-09-11T22:14:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f72027fc640 1 --2- 172.21.15.50:0/1589748332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f0004800 0x7f71f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f7202ffd640 1 --2- 172.21.15.50:0/1589748332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f00039b0 0x7f71f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.691+0000 7f72037fe640 1 --2- 172.21.15.50:0/1589748332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71f00051c0 0x7f71f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.692+0000 7f72027fc640 1 -- 172.21.15.50:0/1589748332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71f00051c0 msgr2=0x7f71f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.692+0000 7f72027fc640 1 --2- 172.21.15.50:0/1589748332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71f00051c0 0x7f71f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.692+0000 7f72027fc640 1 -- 172.21.15.50:0/1589748332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f00039b0 msgr2=0x7f71f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.692+0000 7f72027fc640 1 --2- 172.21.15.50:0/1589748332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f00039b0 0x7f71f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.692+0000 7f72027fc640 1 -- 172.21.15.50:0/1589748332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f0003520 con 0x7f71f0004800 2024-09-11T22:14:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.692+0000 7f72037fe640 1 -- 172.21.15.50:0/1589748332 reap_dead start 2024-09-11T22:14:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.692+0000 7f72027fc640 1 --2- 172.21.15.50:0/1589748332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f0004800 0x7f71f0004c80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00ba30 tx=0x7f71f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90be0ef198984652 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.692+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec030070 con 0x7f71f0004800 2024-09-11T22:14:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.692+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71ec02ade0 con 0x7f71f0004800 2024-09-11T22:14:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.692+0000 7f7201ffb640 1 -- 172.21.15.50:0/1589748332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00b600 con 0x7f71f0004800 2024-09-11T22:14:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.693+0000 7f7209482640 1 -- 172.21.15.50:0/1589748332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f0004800 msgr2=0x7f71f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.693+0000 7f7209482640 1 --2- 172.21.15.50:0/1589748332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f0004800 0x7f71f0004c80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00ba30 tx=0x7f71f0005830 comp rx=0 tx=0).stop 2024-09-11T22:14:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.693+0000 7f7209482640 1 -- 172.21.15.50:0/1589748332 shutdown_connections 2024-09-11T22:14:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.693+0000 7f7209482640 1 --2- 172.21.15.50:0/1589748332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71f0004800 0x7f71f0004c80 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.693+0000 7f7209482640 1 -- 172.21.15.50:0/1589748332 >> 172.21.15.50:0/1589748332 conn(0x7f72040727a0 msgr2=0x7f72040679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.693+0000 7f7209482640 1 -- 172.21.15.50:0/1589748332 shutdown_connections 2024-09-11T22:14:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.693+0000 7f7209482640 1 -- 172.21.15.50:0/1589748332 wait complete. 2024-09-11T22:14:14.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.694+0000 7f7209482640 1 Processor -- start 2024-09-11T22:14:14.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.694+0000 7f7209482640 1 -- start start 2024-09-11T22:14:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f7209482640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f0004800 0x7f7204160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f7209482640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7204155ca0 0x7f720415edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f7209482640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f720415f310 0x7f7204158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f7209482640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f720415ec50 con 0x7f720415f310 2024-09-11T22:14:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f7209482640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72040b7ee0 con 0x7f71f0004800 2024-09-11T22:14:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f7209482640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f72040b78b0 con 0x7f7204155ca0 2024-09-11T22:14:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f72037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f720415f310 0x7f7204158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f72037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f720415f310 0x7f7204158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50192/0 (socket says 172.21.15.50:50192) 2024-09-11T22:14:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f72037fe640 1 -- 172.21.15.50:0/2359367298 learned_addr learned my addr 172.21.15.50:0/2359367298 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f72027fc640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7204155ca0 0x7f720415edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f7202ffd640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f0004800 0x7f7204160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f72037fe640 1 -- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7204155ca0 msgr2=0x7f720415edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f72037fe640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7204155ca0 0x7f720415edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f72037fe640 1 -- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f0004800 msgr2=0x7f7204160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.695+0000 7f72037fe640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f0004800 0x7f7204160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.696+0000 7f72037fe640 1 -- 172.21.15.50:0/2359367298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72041593a0 con 0x7f720415f310 2024-09-11T22:14:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.696+0000 7f72027fc640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7204155ca0 0x7f720415edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.696+0000 7f72037fe640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f720415f310 0x7f7204158140 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f72040d0bd0 tx=0x7f71f400fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.696+0000 7f71fb7fe640 1 -- 172.21.15.50:0/2359367298 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f400fe60 con 0x7f720415f310 2024-09-11T22:14:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.696+0000 7f71fb7fe640 1 -- 172.21.15.50:0/2359367298 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f4018070 con 0x7f720415f310 2024-09-11T22:14:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.696+0000 7f7209482640 1 -- 172.21.15.50:0/2359367298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7204159680 con 0x7f720415f310 2024-09-11T22:14:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.696+0000 7f71fb7fe640 1 -- 172.21.15.50:0/2359367298 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f4003da0 con 0x7f720415f310 2024-09-11T22:14:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.696+0000 7f7209482640 1 -- 172.21.15.50:0/2359367298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72041575f0 con 0x7f720415f310 2024-09-11T22:14:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.697+0000 7f7209482640 1 -- 172.21.15.50:0/2359367298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72040d34f0 con 0x7f720415f310 2024-09-11T22:14:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.697+0000 7f71fb7fe640 1 -- 172.21.15.50:0/2359367298 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71f4005070 con 0x7f720415f310 2024-09-11T22:14:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.698+0000 7f71fb7fe640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f71e406be60 0x7f71e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.698+0000 7f71fb7fe640 1 -- 172.21.15.50:0/2359367298 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f71f408abc0 con 0x7f720415f310 2024-09-11T22:14:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.698+0000 7f7202ffd640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f71e406be60 0x7f71e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.699+0000 7f7202ffd640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f71e406be60 0x7f71e406e320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0012f0 tx=0x7f71fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.703+0000 7f71fb7fe640 1 -- 172.21.15.50:0/2359367298 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71f40595c0 con 0x7f720415f310 2024-09-11T22:14:14.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.913+0000 7f7209482640 1 -- 172.21.15.50:0/2359367298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72040b6370 con 0x7f720415f310 2024-09-11T22:14:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.913+0000 7f71fb7fe640 1 -- 172.21.15.50:0/2359367298 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5224 (secure 0 0 0) 0x7f71f4058ec0 con 0x7f720415f310 2024-09-11T22:14:14.914 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:14.915 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"btime":"2024-09-11T22:14:12:528828+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2882007728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2882007728},{"type":"v1","addr":"172.21.15.50:6835","nonce":2882007728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1935649711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935649711},{"type":"v1","addr":"172.21.15.77:6837","nonce":1935649711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3208356003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3208356003},{"type":"v1","addr":"172.21.15.77:6836","nonce":3208356003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:13:39.660035+0000","modified":"2024-09-11T22:14:12.334915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.50:6834/3053142878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3053142878},{"type":"v1","addr":"172.21.15.50:6834","nonce":3053142878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-11T22:14:14.915 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2024-09-11T22:14:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.915+0000 7f7209482640 1 -- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f71e406be60 msgr2=0x7f71e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.915+0000 7f7209482640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f71e406be60 0x7f71e406e320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0012f0 tx=0x7f71fc009040 comp rx=0 tx=0).stop 2024-09-11T22:14:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.915+0000 7f7209482640 1 -- 172.21.15.50:0/2359367298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f720415f310 msgr2=0x7f7204158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.915+0000 7f7209482640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f720415f310 0x7f7204158140 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f72040d0bd0 tx=0x7f71f400fc70 comp rx=0 tx=0).stop 2024-09-11T22:14:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.915+0000 7f7209482640 1 -- 172.21.15.50:0/2359367298 shutdown_connections 2024-09-11T22:14:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.915+0000 7f7209482640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f71e406be60 0x7f71e406e320 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.915+0000 7f7209482640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7204155ca0 0x7f720415edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.915+0000 7f7209482640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f720415f310 0x7f7204158140 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.915+0000 7f7209482640 1 --2- 172.21.15.50:0/2359367298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f0004800 0x7f7204160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.915+0000 7f7209482640 1 -- 172.21.15.50:0/2359367298 >> 172.21.15.50:0/2359367298 conn(0x7f72040727a0 msgr2=0x7f72040b6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.916+0000 7f7209482640 1 -- 172.21.15.50:0/2359367298 shutdown_connections 2024-09-11T22:14:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:14.916+0000 7f7209482640 1 -- 172.21.15.50:0/2359367298 wait complete. 2024-09-11T22:14:14.927 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:15.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.028+0000 7fc348b9f640 1 Processor -- start 2024-09-11T22:14:15.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.028+0000 7fc348b9f640 1 -- start start 2024-09-11T22:14:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.029+0000 7fc348b9f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc34406f140 0x7fc344072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.029+0000 7fc348b9f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3440d1270 con 0x7fc344147fc0 2024-09-11T22:14:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.029+0000 7fc348b9f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3440d2160 con 0x7fc3440679c0 2024-09-11T22:14:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.029+0000 7fc348b9f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc34406f560 con 0x7fc34406f140 2024-09-11T22:14:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.029+0000 7fc342ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc34406f140 0x7fc344072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.029+0000 7fc342ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc34406f140 0x7fc344072460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50202/0 (socket says 172.21.15.50:50202) 2024-09-11T22:14:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.029+0000 7fc342ffd640 1 -- 172.21.15.50:0/851703142 learned_addr learned my addr 172.21.15.50:0/851703142 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.029+0000 7fc3437fe640 1 --1- 172.21.15.50:0/851703142 >> v1:172.21.15.50:6789/0 conn(0x7fc344147fc0 0x7fc3440d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51124/0 (socket says 172.21.15.50:51124) 2024-09-11T22:14:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.029+0000 7fc342ffd640 1 -- 172.21.15.50:0/851703142 >> v1:172.21.15.77:6789/0 conn(0x7fc3440679c0 legacy=0x7fc3440ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.029+0000 7fc342ffd640 1 -- 172.21.15.50:0/851703142 >> v1:172.21.15.50:6789/0 conn(0x7fc344147fc0 legacy=0x7fc3440d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.030+0000 7fc342ffd640 1 -- 172.21.15.50:0/851703142 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34406f790 con 0x7fc34406f140 2024-09-11T22:14:15.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.030+0000 7fc342ffd640 1 --2- 172.21.15.50:0/851703142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc34406f140 0x7fc344072460 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc338009870 tx=0x7fc33802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515c40dcb9dcef4a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:15.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.030+0000 7fc3427fc640 1 -- 172.21.15.50:0/851703142 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338037070 con 0x7fc34406f140 2024-09-11T22:14:15.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.030+0000 7fc3427fc640 1 -- 172.21.15.50:0/851703142 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc338032440 con 0x7fc34406f140 2024-09-11T22:14:15.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.030+0000 7fc3427fc640 1 -- 172.21.15.50:0/851703142 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338032810 con 0x7fc34406f140 2024-09-11T22:14:15.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.031+0000 7fc348b9f640 1 -- 172.21.15.50:0/851703142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc34406f140 msgr2=0x7fc344072460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.031+0000 7fc348b9f640 1 --2- 172.21.15.50:0/851703142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc34406f140 0x7fc344072460 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc338009870 tx=0x7fc33802a210 comp rx=0 tx=0).stop 2024-09-11T22:14:15.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.031+0000 7fc348b9f640 1 -- 172.21.15.50:0/851703142 shutdown_connections 2024-09-11T22:14:15.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.031+0000 7fc348b9f640 1 --2- 172.21.15.50:0/851703142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc34406f140 0x7fc344072460 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.031+0000 7fc348b9f640 1 -- 172.21.15.50:0/851703142 >> 172.21.15.50:0/851703142 conn(0x7fc344074e50 msgr2=0x7fc34406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:15.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.031+0000 7fc348b9f640 1 -- 172.21.15.50:0/851703142 shutdown_connections 2024-09-11T22:14:15.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.031+0000 7fc348b9f640 1 -- 172.21.15.50:0/851703142 wait complete. 2024-09-11T22:14:15.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.032+0000 7fc348b9f640 1 Processor -- start 2024-09-11T22:14:15.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.032+0000 7fc348b9f640 1 -- start start 2024-09-11T22:14:15.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc348b9f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3440679c0 0x7fc3441f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc348b9f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34406f140 0x7fc3440c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc348b9f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc344147fc0 0x7fc3440b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc348b9f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc3441483a0 con 0x7fc344147fc0 2024-09-11T22:14:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc348b9f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc34406fd50 con 0x7fc34406f140 2024-09-11T22:14:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc348b9f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc3440d1530 con 0x7fc3440679c0 2024-09-11T22:14:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc343fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc344147fc0 0x7fc3440b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc343fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc344147fc0 0x7fc3440b1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50206/0 (socket says 172.21.15.50:50206) 2024-09-11T22:14:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc343fff640 1 -- 172.21.15.50:0/1007983552 learned_addr learned my addr 172.21.15.50:0/1007983552 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc342ffd640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34406f140 0x7fc3440c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc343fff640 1 -- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3440679c0 msgr2=0x7fc3441f43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc3437fe640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3440679c0 0x7fc3441f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc343fff640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3440679c0 0x7fc3441f43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc343fff640 1 -- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34406f140 msgr2=0x7fc3440c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc343fff640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34406f140 0x7fc3440c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc343fff640 1 -- 172.21.15.50:0/1007983552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc344142600 con 0x7fc344147fc0 2024-09-11T22:14:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc342ffd640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34406f140 0x7fc3440c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.033+0000 7fc3437fe640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3440679c0 0x7fc3441f43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.034+0000 7fc343fff640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc344147fc0 0x7fc3440b1590 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00c780 tx=0x7fc33c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.034+0000 7fc32bfff640 1 -- 172.21.15.50:0/1007983552 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c017070 con 0x7fc344147fc0 2024-09-11T22:14:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.034+0000 7fc32bfff640 1 -- 172.21.15.50:0/1007983552 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c003da0 con 0x7fc344147fc0 2024-09-11T22:14:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.034+0000 7fc348b9f640 1 -- 172.21.15.50:0/1007983552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3441428e0 con 0x7fc344147fc0 2024-09-11T22:14:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.034+0000 7fc32bfff640 1 -- 172.21.15.50:0/1007983552 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c0052b0 con 0x7fc344147fc0 2024-09-11T22:14:15.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.034+0000 7fc348b9f640 1 -- 172.21.15.50:0/1007983552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc344143180 con 0x7fc344147fc0 2024-09-11T22:14:15.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.035+0000 7fc348b9f640 1 -- 172.21.15.50:0/1007983552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc344142ab0 con 0x7fc344147fc0 2024-09-11T22:14:15.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.035+0000 7fc32bfff640 1 -- 172.21.15.50:0/1007983552 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc33c01a070 con 0x7fc344147fc0 2024-09-11T22:14:15.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.036+0000 7fc32bfff640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc33006be30 0x7fc33006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.036+0000 7fc32bfff640 1 -- 172.21.15.50:0/1007983552 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc33c08a4f0 con 0x7fc344147fc0 2024-09-11T22:14:15.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.036+0000 7fc3437fe640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc33006be30 0x7fc33006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.037+0000 7fc3437fe640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc33006be30 0x7fc33006e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc334000f60 tx=0x7fc334009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:15.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.040+0000 7fc32bfff640 1 -- 172.21.15.50:0/1007983552 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc33c058ef0 con 0x7fc344147fc0 2024-09-11T22:14:15.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.252+0000 7fc348b9f640 1 -- 172.21.15.50:0/1007983552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc344072460 con 0x7fc344147fc0 2024-09-11T22:14:15.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.253+0000 7fc32bfff640 1 -- 172.21.15.50:0/1007983552 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5224 (secure 0 0 0) 0x7fc33c0587f0 con 0x7fc344147fc0 2024-09-11T22:14:15.254 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:15.254 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"btime":"2024-09-11T22:14:12:528828+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2882007728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2882007728},{"type":"v1","addr":"172.21.15.50:6835","nonce":2882007728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1935649711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935649711},{"type":"v1","addr":"172.21.15.77:6837","nonce":1935649711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3208356003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3208356003},{"type":"v1","addr":"172.21.15.77:6836","nonce":3208356003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:13:39.660035+0000","modified":"2024-09-11T22:14:12.334915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.50:6834/3053142878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3053142878},{"type":"v1","addr":"172.21.15.50:6834","nonce":3053142878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-11T22:14:15.254 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2024-09-11T22:14:15.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.255+0000 7fc348b9f640 1 -- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc33006be30 msgr2=0x7fc33006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.255+0000 7fc348b9f640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc33006be30 0x7fc33006e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc334000f60 tx=0x7fc334009040 comp rx=0 tx=0).stop 2024-09-11T22:14:15.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.255+0000 7fc348b9f640 1 -- 172.21.15.50:0/1007983552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc344147fc0 msgr2=0x7fc3440b1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.255+0000 7fc348b9f640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc344147fc0 0x7fc3440b1590 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00c780 tx=0x7fc33c00cc40 comp rx=0 tx=0).stop 2024-09-11T22:14:15.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.255+0000 7fc348b9f640 1 -- 172.21.15.50:0/1007983552 shutdown_connections 2024-09-11T22:14:15.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.255+0000 7fc348b9f640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc33006be30 0x7fc33006e2f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.255+0000 7fc348b9f640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc344147fc0 0x7fc3440b1590 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.255+0000 7fc348b9f640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34406f140 0x7fc3440c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.255+0000 7fc348b9f640 1 --2- 172.21.15.50:0/1007983552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3440679c0 0x7fc3441f43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.255+0000 7fc348b9f640 1 -- 172.21.15.50:0/1007983552 >> 172.21.15.50:0/1007983552 conn(0x7fc344074e50 msgr2=0x7fc3441452f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:15.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.255+0000 7fc348b9f640 1 -- 172.21.15.50:0/1007983552 shutdown_connections 2024-09-11T22:14:15.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.255+0000 7fc348b9f640 1 -- 172.21.15.50:0/1007983552 wait complete. 2024-09-11T22:14:15.267 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:14:15.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.368+0000 7feca00d0640 1 Processor -- start 2024-09-11T22:14:15.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.368+0000 7feca00d0640 1 -- start start 2024-09-11T22:14:15.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.369+0000 7feca00d0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fec9806e0f0 0x7fec9806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.369+0000 7feca00d0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec9815b7e0 con 0x7fec98072e60 2024-09-11T22:14:15.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.369+0000 7feca00d0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec9815f140 con 0x7fec9815b400 2024-09-11T22:14:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.369+0000 7feca00d0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fec9815f420 con 0x7fec9806e0f0 2024-09-11T22:14:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.369+0000 7fec9e66d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fec98072e60 0x7fec980711c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51134/0 (socket says 172.21.15.50:51134) 2024-09-11T22:14:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.369+0000 7fec9e66d640 1 -- 172.21.15.50:0/3529897144 learned_addr learned my addr 172.21.15.50:0/3529897144 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.369+0000 7fec9d66b640 1 --2- 172.21.15.50:0/3529897144 >> v2:172.21.15.77:3300/0 conn(0x7fec9806e0f0 0x7fec9806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.369+0000 7fec9ce6a640 1 -- 172.21.15.50:0/3529897144 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 939535804 0 0) 0x7fec9815b7e0 con 0x7fec98072e60 2024-09-11T22:14:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.370+0000 7fec9ce6a640 1 -- 172.21.15.50:0/3529897144 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec80003520 con 0x7fec98072e60 2024-09-11T22:14:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.370+0000 7fec9d66b640 1 -- 172.21.15.50:0/3529897144 >> v1:172.21.15.77:6789/0 conn(0x7fec9815b400 legacy=0x7fec9806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.370+0000 7fec9d66b640 1 -- 172.21.15.50:0/3529897144 >> v1:172.21.15.50:6789/0 conn(0x7fec98072e60 legacy=0x7fec980711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.370+0000 7fec9ce6a640 1 -- 172.21.15.50:0/3529897144 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 456459953 0 0) 0x7fec80003520 con 0x7fec98072e60 2024-09-11T22:14:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.370+0000 7fec9d66b640 1 -- 172.21.15.50:0/3529897144 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9815f700 con 0x7fec9806e0f0 2024-09-11T22:14:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.371+0000 7fec9d66b640 1 --2- 172.21.15.50:0/3529897144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9806e0f0 0x7fec9806d070 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0097a0 tx=0x7fec8c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a57c38e46707d4d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.371+0000 7fec9ce6a640 1 -- 172.21.15.50:0/3529897144 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c037070 con 0x7fec9806e0f0 2024-09-11T22:14:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.371+0000 7fec9ce6a640 1 -- 172.21.15.50:0/3529897144 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c02ac50 con 0x7fec9806e0f0 2024-09-11T22:14:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.371+0000 7fec9ce6a640 1 -- 172.21.15.50:0/3529897144 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90001670 con 0x7fec9806e0f0 2024-09-11T22:14:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.371+0000 7feca00d0640 1 -- 172.21.15.50:0/3529897144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9806e0f0 msgr2=0x7fec9806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.371+0000 7feca00d0640 1 --2- 172.21.15.50:0/3529897144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9806e0f0 0x7fec9806d070 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0097a0 tx=0x7fec8c02a1c0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.371+0000 7feca00d0640 1 -- 172.21.15.50:0/3529897144 shutdown_connections 2024-09-11T22:14:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.371+0000 7feca00d0640 1 --2- 172.21.15.50:0/3529897144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9806e0f0 0x7fec9806d070 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.371+0000 7feca00d0640 1 -- 172.21.15.50:0/3529897144 >> 172.21.15.50:0/3529897144 conn(0x7fec980679c0 msgr2=0x7fec98067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.371+0000 7feca00d0640 1 -- 172.21.15.50:0/3529897144 shutdown_connections 2024-09-11T22:14:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.371+0000 7feca00d0640 1 -- 172.21.15.50:0/3529897144 wait complete. 2024-09-11T22:14:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.373+0000 7feca00d0640 1 Processor -- start 2024-09-11T22:14:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.373+0000 7feca00d0640 1 -- start start 2024-09-11T22:14:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.373+0000 7feca00d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec9806e0f0 0x7fec9814bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.373+0000 7feca00d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec98072e60 0x7fec980b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.373+0000 7feca00d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9815b400 0x7fec980c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.373+0000 7feca00d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fec980718d0 con 0x7fec9806e0f0 2024-09-11T22:14:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.373+0000 7feca00d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fec980cfc50 con 0x7fec9815b400 2024-09-11T22:14:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.373+0000 7feca00d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fec98071a50 con 0x7fec98072e60 2024-09-11T22:14:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.373+0000 7fec9de6c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec9806e0f0 0x7fec9814bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.373+0000 7fec9de6c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec9806e0f0 0x7fec9814bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50208/0 (socket says 172.21.15.50:50208) 2024-09-11T22:14:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7fec9de6c640 1 -- 172.21.15.50:0/2490403224 learned_addr learned my addr 172.21.15.50:0/2490403224 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7fec9e66d640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9815b400 0x7fec980c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7fec9d66b640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec98072e60 0x7fec980b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7fec9de6c640 1 -- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec98072e60 msgr2=0x7fec980b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7fec9de6c640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec98072e60 0x7fec980b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7fec9de6c640 1 -- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9815b400 msgr2=0x7fec980c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7fec9de6c640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9815b400 0x7fec980c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7fec9de6c640 1 -- 172.21.15.50:0/2490403224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec980b01d0 con 0x7fec9806e0f0 2024-09-11T22:14:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7fec9de6c640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec9806e0f0 0x7fec9814bf30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c730 tx=0x7fec8800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7fec967fc640 1 -- 172.21.15.50:0/2490403224 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88016020 con 0x7fec9806e0f0 2024-09-11T22:14:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7fec967fc640 1 -- 172.21.15.50:0/2490403224 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec88006d50 con 0x7fec9806e0f0 2024-09-11T22:14:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7fec967fc640 1 -- 172.21.15.50:0/2490403224 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88003bb0 con 0x7fec9806e0f0 2024-09-11T22:14:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7feca00d0640 1 -- 172.21.15.50:0/2490403224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec980b0490 con 0x7fec9806e0f0 2024-09-11T22:14:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.374+0000 7feca00d0640 1 -- 172.21.15.50:0/2490403224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec980b1860 con 0x7fec9806e0f0 2024-09-11T22:14:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.375+0000 7feca00d0640 1 -- 172.21.15.50:0/2490403224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec9806d070 con 0x7fec9806e0f0 2024-09-11T22:14:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.376+0000 7fec967fc640 1 -- 172.21.15.50:0/2490403224 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec8800a850 con 0x7fec9806e0f0 2024-09-11T22:14:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.376+0000 7fec967fc640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec8406be30 0x7fec8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.376+0000 7fec967fc640 1 -- 172.21.15.50:0/2490403224 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fec8808a940 con 0x7fec9806e0f0 2024-09-11T22:14:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.376+0000 7fec9d66b640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec8406be30 0x7fec8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.377+0000 7fec9d66b640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec8406be30 0x7fec8406e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fec8c034000 tx=0x7fec8c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.380+0000 7fec967fc640 1 -- 172.21.15.50:0/2490403224 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec88020020 con 0x7fec9806e0f0 2024-09-11T22:14:15.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.558+0000 7feca00d0640 1 -- 172.21.15.50:0/2490403224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec980af000 con 0x7fec9806e0f0 2024-09-11T22:14:15.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.559+0000 7fec967fc640 1 -- 172.21.15.50:0/2490403224 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16788 (secure 0 0 0) 0x7fec88058cf0 con 0x7fec9806e0f0 2024-09-11T22:14:15.560 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:15.560 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":47,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:13:56.473716+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:13:37.315617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T22:13:38.641830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:14:15.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.561+0000 7feca00d0640 1 -- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec8406be30 msgr2=0x7fec8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.561+0000 7feca00d0640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec8406be30 0x7fec8406e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fec8c034000 tx=0x7fec8c02e000 comp rx=0 tx=0).stop 2024-09-11T22:14:15.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.561+0000 7feca00d0640 1 -- 172.21.15.50:0/2490403224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec9806e0f0 msgr2=0x7fec9814bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.561+0000 7feca00d0640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec9806e0f0 0x7fec9814bf30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c730 tx=0x7fec8800cbf0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.561+0000 7feca00d0640 1 -- 172.21.15.50:0/2490403224 shutdown_connections 2024-09-11T22:14:15.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.561+0000 7feca00d0640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec8406be30 0x7fec8406e2f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.561+0000 7feca00d0640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec98072e60 0x7fec980b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.561+0000 7feca00d0640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9815b400 0x7fec980c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.561+0000 7feca00d0640 1 --2- 172.21.15.50:0/2490403224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec9806e0f0 0x7fec9814bf30 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.561+0000 7feca00d0640 1 -- 172.21.15.50:0/2490403224 >> 172.21.15.50:0/2490403224 conn(0x7fec980679c0 msgr2=0x7fec98069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:15.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.561+0000 7feca00d0640 1 -- 172.21.15.50:0/2490403224 shutdown_connections 2024-09-11T22:14:15.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.561+0000 7feca00d0640 1 -- 172.21.15.50:0/2490403224 wait complete. 2024-09-11T22:14:15.573 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:14:15.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.675+0000 7f3e38c77640 1 Processor -- start 2024-09-11T22:14:15.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.675+0000 7f3e38c77640 1 -- start start 2024-09-11T22:14:15.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.676+0000 7f3e38c77640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e340cf790 0x7f3e340b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.676+0000 7f3e38c77640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3e340d11d0 0x7f3e340d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.676+0000 7f3e38c77640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e34162110 con 0x7f3e34161d30 2024-09-11T22:14:15.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.676+0000 7f3e38c77640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f3e340d3450 con 0x7f3e340cf790 2024-09-11T22:14:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.676+0000 7f3e38c77640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3e340b7e30 con 0x7f3e340d11d0 2024-09-11T22:14:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.676+0000 7f3e31d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e340cf790 0x7f3e340b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.676+0000 7f3e31d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e340cf790 0x7f3e340b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50218/0 (socket says 172.21.15.50:50218) 2024-09-11T22:14:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.676+0000 7f3e31d9b640 1 -- 172.21.15.50:0/2644341322 learned_addr learned my addr 172.21.15.50:0/2644341322 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.677+0000 7f3e32d9d640 1 --2- 172.21.15.50:0/2644341322 >> v2:172.21.15.77:3300/0 conn(0x7f3e340d11d0 0x7f3e340d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.677+0000 7f3e31d9b640 1 -- 172.21.15.50:0/2644341322 >> v2:172.21.15.77:3300/0 conn(0x7f3e340d11d0 msgr2=0x7f3e340d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.677+0000 7f3e31d9b640 1 --2- 172.21.15.50:0/2644341322 >> v2:172.21.15.77:3300/0 conn(0x7f3e340d11d0 0x7f3e340d1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.677+0000 7f3e31d9b640 1 -- 172.21.15.50:0/2644341322 >> v1:172.21.15.77:6789/0 conn(0x7f3e34161d30 legacy=0x7f3e34162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.677+0000 7f3e31d9b640 1 -- 172.21.15.50:0/2644341322 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e340cfd70 con 0x7f3e340cf790 2024-09-11T22:14:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.677+0000 7f3e31d9b640 1 --2- 172.21.15.50:0/2644341322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e340cf790 0x7f3e340b78f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3e340d28b0 tx=0x7f3e2802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac445795c4958f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.677+0000 7f3e3159a640 1 -- 172.21.15.50:0/2644341322 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28037070 con 0x7f3e340cf790 2024-09-11T22:14:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.677+0000 7f3e3159a640 1 -- 172.21.15.50:0/2644341322 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e28032440 con 0x7f3e340cf790 2024-09-11T22:14:15.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.677+0000 7f3e3159a640 1 -- 172.21.15.50:0/2644341322 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28032810 con 0x7f3e340cf790 2024-09-11T22:14:15.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.678+0000 7f3e38c77640 1 -- 172.21.15.50:0/2644341322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e340cf790 msgr2=0x7f3e340b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.678+0000 7f3e38c77640 1 --2- 172.21.15.50:0/2644341322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e340cf790 0x7f3e340b78f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3e340d28b0 tx=0x7f3e2802a230 comp rx=0 tx=0).stop 2024-09-11T22:14:15.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.678+0000 7f3e38c77640 1 -- 172.21.15.50:0/2644341322 shutdown_connections 2024-09-11T22:14:15.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.678+0000 7f3e38c77640 1 --2- 172.21.15.50:0/2644341322 >> v2:172.21.15.77:3300/0 conn(0x7f3e340d11d0 0x7f3e340d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.678+0000 7f3e38c77640 1 --2- 172.21.15.50:0/2644341322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e340cf790 0x7f3e340b78f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.678+0000 7f3e38c77640 1 -- 172.21.15.50:0/2644341322 >> 172.21.15.50:0/2644341322 conn(0x7f3e340727a0 msgr2=0x7f3e340679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:15.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.678+0000 7f3e38c77640 1 -- 172.21.15.50:0/2644341322 shutdown_connections 2024-09-11T22:14:15.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.678+0000 7f3e38c77640 1 -- 172.21.15.50:0/2644341322 wait complete. 2024-09-11T22:14:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.679+0000 7f3e38c77640 1 Processor -- start 2024-09-11T22:14:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.680+0000 7f3e38c77640 1 -- start start 2024-09-11T22:14:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.680+0000 7f3e38c77640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e340cf790 0x7f3e341f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.680+0000 7f3e38c77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e340d11d0 0x7f3e340ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.680+0000 7f3e38c77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e34161d30 0x7f3e340ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.680+0000 7f3e38c77640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e340d2e00 con 0x7f3e340d11d0 2024-09-11T22:14:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.680+0000 7f3e38c77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3e340d1b40 con 0x7f3e34161d30 2024-09-11T22:14:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.680+0000 7f3e38c77640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3e340d30e0 con 0x7f3e340cf790 2024-09-11T22:14:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.680+0000 7f3e31d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e340d11d0 0x7f3e340ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.680+0000 7f3e31d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e340d11d0 0x7f3e340ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50232/0 (socket says 172.21.15.50:50232) 2024-09-11T22:14:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.680+0000 7f3e31d9b640 1 -- 172.21.15.50:0/2201118340 learned_addr learned my addr 172.21.15.50:0/2201118340 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.680+0000 7f3e3259c640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e340cf790 0x7f3e341f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.680+0000 7f3e32d9d640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e34161d30 0x7f3e340ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.681+0000 7f3e31d9b640 1 -- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e340cf790 msgr2=0x7f3e341f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.681+0000 7f3e31d9b640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e340cf790 0x7f3e341f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.681+0000 7f3e31d9b640 1 -- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e34161d30 msgr2=0x7f3e340ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.681+0000 7f3e31d9b640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e34161d30 0x7f3e340ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.681+0000 7f3e31d9b640 1 -- 172.21.15.50:0/2201118340 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e340ab3d0 con 0x7f3e340d11d0 2024-09-11T22:14:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.681+0000 7f3e31d9b640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e340d11d0 0x7f3e340ca1d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3e2802a270 tx=0x7f3e280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.681+0000 7f3e22ffd640 1 -- 172.21.15.50:0/2201118340 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28037040 con 0x7f3e340d11d0 2024-09-11T22:14:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.681+0000 7f3e22ffd640 1 -- 172.21.15.50:0/2201118340 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e28042070 con 0x7f3e340d11d0 2024-09-11T22:14:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.681+0000 7f3e38c77640 1 -- 172.21.15.50:0/2201118340 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e341607f0 con 0x7f3e340d11d0 2024-09-11T22:14:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.681+0000 7f3e22ffd640 1 -- 172.21.15.50:0/2201118340 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28030bb0 con 0x7f3e340d11d0 2024-09-11T22:14:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.681+0000 7f3e38c77640 1 -- 172.21.15.50:0/2201118340 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e340ab920 con 0x7f3e340d11d0 2024-09-11T22:14:15.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.682+0000 7f3e38c77640 1 -- 172.21.15.50:0/2201118340 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e340b78f0 con 0x7f3e340d11d0 2024-09-11T22:14:15.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.683+0000 7f3e22ffd640 1 -- 172.21.15.50:0/2201118340 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e28047460 con 0x7f3e340d11d0 2024-09-11T22:14:15.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.683+0000 7f3e22ffd640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3e1406be60 0x7f3e1406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:15.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.683+0000 7f3e22ffd640 1 -- 172.21.15.50:0/2201118340 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f3e280ab8d0 con 0x7f3e340d11d0 2024-09-11T22:14:15.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.683+0000 7f3e3259c640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3e1406be60 0x7f3e1406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:15.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.684+0000 7f3e3259c640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3e1406be60 0x7f3e1406e320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3e24006fd0 tx=0x7f3e24009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:15.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.687+0000 7f3e22ffd640 1 -- 172.21.15.50:0/2201118340 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e28079c80 con 0x7f3e340d11d0 2024-09-11T22:14:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.897+0000 7f3e38c77640 1 -- 172.21.15.50:0/2201118340 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3e3406bfc0 con 0x7f3e340d11d0 2024-09-11T22:14:15.898 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:14:15.898+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:14:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.899+0000 7f3e22ffd640 1 -- 172.21.15.50:0/2201118340 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7f3e2807df80 con 0x7f3e340d11d0 2024-09-11T22:14:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:14:15.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.902+0000 7f3e38c77640 1 -- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3e1406be60 msgr2=0x7f3e1406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.902+0000 7f3e38c77640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3e1406be60 0x7f3e1406e320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3e24006fd0 tx=0x7f3e24009060 comp rx=0 tx=0).stop 2024-09-11T22:14:15.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.902+0000 7f3e38c77640 1 -- 172.21.15.50:0/2201118340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e340d11d0 msgr2=0x7f3e340ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:15.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.902+0000 7f3e38c77640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e340d11d0 0x7f3e340ca1d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3e2802a270 tx=0x7f3e280046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.902+0000 7f3e38c77640 1 -- 172.21.15.50:0/2201118340 shutdown_connections 2024-09-11T22:14:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.902+0000 7f3e38c77640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3e1406be60 0x7f3e1406e320 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.902+0000 7f3e38c77640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e34161d30 0x7f3e340ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.902+0000 7f3e38c77640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e340d11d0 0x7f3e340ca1d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.902+0000 7f3e38c77640 1 --2- 172.21.15.50:0/2201118340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e340cf790 0x7f3e341f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.902+0000 7f3e38c77640 1 -- 172.21.15.50:0/2201118340 >> 172.21.15.50:0/2201118340 conn(0x7f3e340727a0 msgr2=0x7f3e340cb890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.902+0000 7f3e38c77640 1 -- 172.21.15.50:0/2201118340 shutdown_connections 2024-09-11T22:14:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:15.902+0000 7f3e38c77640 1 -- 172.21.15.50:0/2201118340 wait complete. 2024-09-11T22:14:15.914 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:14:15.942 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:14:16.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.019+0000 7f465916d640 1 Processor -- start 2024-09-11T22:14:16.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.019+0000 7f465916d640 1 -- start start 2024-09-11T22:14:16.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f465916d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f465415e870 0x7f46540d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f465916d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540d16d0 0x7f46540d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f465916d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46540cfa80 con 0x7f46540d3a30 2024-09-11T22:14:16.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f465916d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f46540d1b10 con 0x7f465415e870 2024-09-11T22:14:16.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f465916d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f46540d3e80 con 0x7f46540d16d0 2024-09-11T22:14:16.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f4652d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f465415e870 0x7f46540d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f465259c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540d16d0 0x7f46540d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f465359e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f46540d3a30 0x7f46540b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:50830/0 (socket says 172.21.15.50:50830) 2024-09-11T22:14:16.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f465359e640 1 -- 172.21.15.50:0/1202540933 learned_addr learned my addr 172.21.15.50:0/1202540933 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:16.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f4652d9d640 1 -- 172.21.15.50:0/1202540933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540d16d0 msgr2=0x7f46540d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:16.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f4652d9d640 1 --2- 172.21.15.50:0/1202540933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540d16d0 0x7f46540d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f4652d9d640 1 -- 172.21.15.50:0/1202540933 >> v1:172.21.15.77:6789/0 conn(0x7f46540d3a30 legacy=0x7f46540b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f4652d9d640 1 -- 172.21.15.50:0/1202540933 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46540d40d0 con 0x7f465415e870 2024-09-11T22:14:16.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f4651d9b640 1 -- 172.21.15.50:0/1202540933 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520489031 0 0) 0x7f464c001490 con 0x7f46540d3a30 2024-09-11T22:14:16.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.020+0000 7f465259c640 1 --2- 172.21.15.50:0/1202540933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540d16d0 0x7f46540d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:16.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.021+0000 7f4652d9d640 1 --2- 172.21.15.50:0/1202540933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465415e870 0x7f46540d1190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f46440097a0 tx=0x7f464402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0f4308c9b70b0d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:16.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.021+0000 7f4651d9b640 1 -- 172.21.15.50:0/1202540933 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4644037070 con 0x7f465415e870 2024-09-11T22:14:16.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.021+0000 7f4651d9b640 1 -- 172.21.15.50:0/1202540933 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4644032440 con 0x7f465415e870 2024-09-11T22:14:16.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.021+0000 7f4651d9b640 1 -- 172.21.15.50:0/1202540933 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4644032810 con 0x7f465415e870 2024-09-11T22:14:16.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.022+0000 7f465916d640 1 -- 172.21.15.50:0/1202540933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465415e870 msgr2=0x7f46540d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.022+0000 7f465916d640 1 --2- 172.21.15.50:0/1202540933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465415e870 0x7f46540d1190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f46440097a0 tx=0x7f464402a180 comp rx=0 tx=0).stop 2024-09-11T22:14:16.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.022+0000 7f465916d640 1 -- 172.21.15.50:0/1202540933 shutdown_connections 2024-09-11T22:14:16.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.022+0000 7f465916d640 1 --2- 172.21.15.50:0/1202540933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540d16d0 0x7f46540d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.022+0000 7f465916d640 1 --2- 172.21.15.50:0/1202540933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465415e870 0x7f46540d1190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.022+0000 7f465916d640 1 -- 172.21.15.50:0/1202540933 >> 172.21.15.50:0/1202540933 conn(0x7f46540727a0 msgr2=0x7f46540679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:16.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.022+0000 7f465916d640 1 -- 172.21.15.50:0/1202540933 shutdown_connections 2024-09-11T22:14:16.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.022+0000 7f465916d640 1 -- 172.21.15.50:0/1202540933 wait complete. 2024-09-11T22:14:16.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.023+0000 7f465916d640 1 Processor -- start 2024-09-11T22:14:16.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.024+0000 7f465916d640 1 -- start start 2024-09-11T22:14:16.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.024+0000 7f465916d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540d16d0 0x7f4654157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.024+0000 7f465916d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46540d3a30 0x7f465415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.024+0000 7f465916d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465415e870 0x7f46540cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.024+0000 7f465916d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f46540b7ee0 con 0x7f46540d3a30 2024-09-11T22:14:16.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.024+0000 7f465916d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46540b7c00 con 0x7f465415e870 2024-09-11T22:14:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.024+0000 7f465916d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f465415ec50 con 0x7f46540d16d0 2024-09-11T22:14:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.024+0000 7f465259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46540d3a30 0x7f465415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.024+0000 7f465259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46540d3a30 0x7f465415b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50270/0 (socket says 172.21.15.50:50270) 2024-09-11T22:14:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.024+0000 7f465259c640 1 -- 172.21.15.50:0/3336558994 learned_addr learned my addr 172.21.15.50:0/3336558994 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f465359e640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465415e870 0x7f46540cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f4652d9d640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540d16d0 0x7f4654157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f465259c640 1 -- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540d16d0 msgr2=0x7f4654157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f465259c640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540d16d0 0x7f4654157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f465259c640 1 -- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465415e870 msgr2=0x7f46540cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f465259c640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465415e870 0x7f46540cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f465259c640 1 -- 172.21.15.50:0/3336558994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46540cbdd0 con 0x7f46540d3a30 2024-09-11T22:14:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f4652d9d640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540d16d0 0x7f4654157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:16.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f465359e640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465415e870 0x7f46540cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:16.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f465259c640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46540d3a30 0x7f465415b5f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f463c00ebe0 tx=0x7f463c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:16.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f464b7fe640 1 -- 172.21.15.50:0/3336558994 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c017070 con 0x7f46540d3a30 2024-09-11T22:14:16.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f464b7fe640 1 -- 172.21.15.50:0/3336558994 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f463c00cc30 con 0x7f46540d3a30 2024-09-11T22:14:16.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f465916d640 1 -- 172.21.15.50:0/3336558994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46540cc0b0 con 0x7f46540d3a30 2024-09-11T22:14:16.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f464b7fe640 1 -- 172.21.15.50:0/3336558994 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c013470 con 0x7f46540d3a30 2024-09-11T22:14:16.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.025+0000 7f465916d640 1 -- 172.21.15.50:0/3336558994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46540cc670 con 0x7f46540d3a30 2024-09-11T22:14:16.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.026+0000 7f465916d640 1 -- 172.21.15.50:0/3336558994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46540b78b0 con 0x7f46540d3a30 2024-09-11T22:14:16.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.027+0000 7f464b7fe640 1 -- 172.21.15.50:0/3336558994 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f463c01a070 con 0x7f46540d3a30 2024-09-11T22:14:16.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.027+0000 7f464b7fe640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f463406be60 0x7f463406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:16.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.027+0000 7f464b7fe640 1 -- 172.21.15.50:0/3336558994 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f463c08b140 con 0x7f46540d3a30 2024-09-11T22:14:16.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.027+0000 7f4652d9d640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f463406be60 0x7f463406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:16.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.028+0000 7f4652d9d640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f463406be60 0x7f463406e320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4644034000 tx=0x7f464402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:16.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.032+0000 7f464b7fe640 1 -- 172.21.15.50:0/3336558994 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f463c059af0 con 0x7f46540d3a30 2024-09-11T22:14:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.243+0000 7f465916d640 1 -- 172.21.15.50:0/3336558994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f465415fa70 con 0x7f46540d3a30 2024-09-11T22:14:16.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.901+0000 7f464b7fe640 1 -- 172.21.15.50:0/3336558994 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7f463c0593f0 con 0x7f46540d3a30 2024-09-11T22:14:16.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.904+0000 7f465916d640 1 -- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f463406be60 msgr2=0x7f463406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.904+0000 7f465916d640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f463406be60 0x7f463406e320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4644034000 tx=0x7f464402e000 comp rx=0 tx=0).stop 2024-09-11T22:14:16.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.904+0000 7f465916d640 1 -- 172.21.15.50:0/3336558994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46540d3a30 msgr2=0x7f465415b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:16.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.904+0000 7f465916d640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46540d3a30 0x7f465415b5f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f463c00ebe0 tx=0x7f463c00c520 comp rx=0 tx=0).stop 2024-09-11T22:14:16.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.904+0000 7f465916d640 1 -- 172.21.15.50:0/3336558994 shutdown_connections 2024-09-11T22:14:16.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.904+0000 7f465916d640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f463406be60 0x7f463406e320 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.904+0000 7f465916d640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465415e870 0x7f46540cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.904+0000 7f465916d640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46540d3a30 0x7f465415b5f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.904+0000 7f465916d640 1 --2- 172.21.15.50:0/3336558994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540d16d0 0x7f4654157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:16.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.904+0000 7f465916d640 1 -- 172.21.15.50:0/3336558994 >> 172.21.15.50:0/3336558994 conn(0x7f46540727a0 msgr2=0x7f46540b9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:16.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.904+0000 7f465916d640 1 -- 172.21.15.50:0/3336558994 shutdown_connections 2024-09-11T22:14:16.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:16.904+0000 7f465916d640 1 -- 172.21.15.50:0/3336558994 wait complete. 2024-09-11T22:14:16.919 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:14:17.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.071+0000 7f7fae0e6640 1 Processor -- start 2024-09-11T22:14:17.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.071+0000 7f7fae0e6640 1 -- start start 2024-09-11T22:14:17.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.072+0000 7f7fae0e6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fa806e160 0x7f7fa806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:17.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.072+0000 7f7fae0e6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7fa815d460 0x7f7fa815d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:17.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.072+0000 7f7fae0e6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa80b53a0 con 0x7f7fa80cff00 2024-09-11T22:14:17.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.072+0000 7f7fae0e6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7fa80b5680 con 0x7f7fa806e160 2024-09-11T22:14:17.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.072+0000 7f7fae0e6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7fa815cc60 con 0x7f7fa815d460 2024-09-11T22:14:17.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.072+0000 7f7fa6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fa806e160 0x7f7fa806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.072+0000 7f7fa6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fa806e160 0x7f7fa806e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50286/0 (socket says 172.21.15.50:50286) 2024-09-11T22:14:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.072+0000 7f7fa6ffd640 1 -- 172.21.15.50:0/812466371 learned_addr learned my addr 172.21.15.50:0/812466371 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.072+0000 7f7fa7fff640 1 --2- 172.21.15.50:0/812466371 >> v2:172.21.15.77:3300/0 conn(0x7f7fa815d460 0x7f7fa815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.073+0000 7f7fa6ffd640 1 -- 172.21.15.50:0/812466371 >> v2:172.21.15.77:3300/0 conn(0x7f7fa815d460 msgr2=0x7f7fa815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.073+0000 7f7fa6ffd640 1 --2- 172.21.15.50:0/812466371 >> v2:172.21.15.77:3300/0 conn(0x7f7fa815d460 0x7f7fa815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.073+0000 7f7fa6ffd640 1 -- 172.21.15.50:0/812466371 >> v1:172.21.15.77:6789/0 conn(0x7f7fa80cff00 legacy=0x7f7fa80b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.073+0000 7f7fa6ffd640 1 -- 172.21.15.50:0/812466371 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa815cf40 con 0x7f7fa806e160 2024-09-11T22:14:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.073+0000 7f7fa6ffd640 1 --2- 172.21.15.50:0/812466371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa806e160 0x7f7fa806e5f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8155fc0 tx=0x7f7f9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d03e8ac4333a1e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.073+0000 7f7fa67fc640 1 -- 172.21.15.50:0/812466371 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c037070 con 0x7f7fa806e160 2024-09-11T22:14:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.074+0000 7f7fa67fc640 1 -- 172.21.15.50:0/812466371 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9c032440 con 0x7f7fa806e160 2024-09-11T22:14:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.074+0000 7f7fa67fc640 1 -- 172.21.15.50:0/812466371 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c032810 con 0x7f7fa806e160 2024-09-11T22:14:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.074+0000 7f7fae0e6640 1 -- 172.21.15.50:0/812466371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa806e160 msgr2=0x7f7fa806e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.074+0000 7f7fae0e6640 1 --2- 172.21.15.50:0/812466371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa806e160 0x7f7fa806e5f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8155fc0 tx=0x7f7f9c02a270 comp rx=0 tx=0).stop 2024-09-11T22:14:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.074+0000 7f7fae0e6640 1 -- 172.21.15.50:0/812466371 shutdown_connections 2024-09-11T22:14:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.074+0000 7f7fae0e6640 1 --2- 172.21.15.50:0/812466371 >> v2:172.21.15.77:3300/0 conn(0x7f7fa815d460 0x7f7fa815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.074+0000 7f7fae0e6640 1 --2- 172.21.15.50:0/812466371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa806e160 0x7f7fa806e5f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.074+0000 7f7fae0e6640 1 -- 172.21.15.50:0/812466371 >> 172.21.15.50:0/812466371 conn(0x7f7fa8075270 msgr2=0x7f7fa80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.074+0000 7f7fae0e6640 1 -- 172.21.15.50:0/812466371 shutdown_connections 2024-09-11T22:14:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.074+0000 7f7fae0e6640 1 -- 172.21.15.50:0/812466371 wait complete. 2024-09-11T22:14:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.075+0000 7f7fae0e6640 1 Processor -- start 2024-09-11T22:14:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.075+0000 7f7fae0e6640 1 -- start start 2024-09-11T22:14:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.076+0000 7f7fae0e6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fa806e160 0x7f7fa81408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.076+0000 7f7fae0e6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fa80cff00 0x7f7fa81551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.076+0000 7f7fae0e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa815d460 0x7f7fa815a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.076+0000 7f7fae0e6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa815bbc0 con 0x7f7fa815d460 2024-09-11T22:14:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.076+0000 7f7fae0e6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa80b5060 con 0x7f7fa80cff00 2024-09-11T22:14:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.076+0000 7f7fae0e6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa815ddd0 con 0x7f7fa806e160 2024-09-11T22:14:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.076+0000 7f7fa7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa815d460 0x7f7fa815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.076+0000 7f7fa7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa815d460 0x7f7fa815a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50294/0 (socket says 172.21.15.50:50294) 2024-09-11T22:14:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.076+0000 7f7fa7fff640 1 -- 172.21.15.50:0/3121603478 learned_addr learned my addr 172.21.15.50:0/3121603478 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.076+0000 7f7fa6ffd640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fa80cff00 0x7f7fa81551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.076+0000 7f7fa77fe640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fa806e160 0x7f7fa81408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.077+0000 7f7fa7fff640 1 -- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fa806e160 msgr2=0x7f7fa81408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.077+0000 7f7fa7fff640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fa806e160 0x7f7fa81408c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.077+0000 7f7fa7fff640 1 -- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fa80cff00 msgr2=0x7f7fa81551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.077+0000 7f7fa7fff640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fa80cff00 0x7f7fa81551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.077+0000 7f7fa7fff640 1 -- 172.21.15.50:0/3121603478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa81413c0 con 0x7f7fa815d460 2024-09-11T22:14:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.077+0000 7f7fa77fe640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fa806e160 0x7f7fa81408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.077+0000 7f7fa7fff640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa815d460 0x7f7fa815a440 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000efc0 tx=0x7f7fa000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.077+0000 7f7f8ffff640 1 -- 172.21.15.50:0/3121603478 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0018020 con 0x7f7fa815d460 2024-09-11T22:14:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.077+0000 7f7f8ffff640 1 -- 172.21.15.50:0/3121603478 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa0014480 con 0x7f7fa815d460 2024-09-11T22:14:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.077+0000 7f7fae0e6640 1 -- 172.21.15.50:0/3121603478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa81416a0 con 0x7f7fa815d460 2024-09-11T22:14:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.077+0000 7f7f8ffff640 1 -- 172.21.15.50:0/3121603478 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0014870 con 0x7f7fa815d460 2024-09-11T22:14:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.077+0000 7f7fae0e6640 1 -- 172.21.15.50:0/3121603478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa8140e00 con 0x7f7fa815d460 2024-09-11T22:14:17.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.078+0000 7f7fae0e6640 1 -- 172.21.15.50:0/3121603478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa815d890 con 0x7f7fa815d460 2024-09-11T22:14:17.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.078+0000 7f7f8ffff640 1 -- 172.21.15.50:0/3121603478 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fa0005d10 con 0x7f7fa815d460 2024-09-11T22:14:17.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.079+0000 7f7f8ffff640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f9406be60 0x7f7f9406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:17.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.079+0000 7f7f8ffff640 1 -- 172.21.15.50:0/3121603478 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f7fa008b8a0 con 0x7f7fa815d460 2024-09-11T22:14:17.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.079+0000 7f7fa77fe640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f9406be60 0x7f7f9406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:17.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.080+0000 7f7fa77fe640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f9406be60 0x7f7f9406e320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7f98001700 tx=0x7f7f98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:17.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.083+0000 7f7f8ffff640 1 -- 172.21.15.50:0/3121603478 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fa0022070 con 0x7f7fa815d460 2024-09-11T22:14:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.260+0000 7f7fae0e6640 1 -- 172.21.15.50:0/3121603478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7fa8072aa0 con 0x7f7fa815d460 2024-09-11T22:14:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.905+0000 7f7f8ffff640 1 -- 172.21.15.50:0/3121603478 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) ==== 181+0+0 (secure 0 0 0) 0x7f7fa0010040 con 0x7f7fa815d460 2024-09-11T22:14:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:14:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.909+0000 7f7fae0e6640 1 -- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f9406be60 msgr2=0x7f7f9406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.909+0000 7f7fae0e6640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f9406be60 0x7f7f9406e320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7f98001700 tx=0x7f7f98009040 comp rx=0 tx=0).stop 2024-09-11T22:14:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.909+0000 7f7fae0e6640 1 -- 172.21.15.50:0/3121603478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa815d460 msgr2=0x7f7fa815a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.909+0000 7f7fae0e6640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa815d460 0x7f7fa815a440 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000efc0 tx=0x7f7fa000c490 comp rx=0 tx=0).stop 2024-09-11T22:14:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.909+0000 7f7fae0e6640 1 -- 172.21.15.50:0/3121603478 shutdown_connections 2024-09-11T22:14:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.909+0000 7f7fae0e6640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f9406be60 0x7f7f9406e320 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.909+0000 7f7fae0e6640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa815d460 0x7f7fa815a440 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.909+0000 7f7fae0e6640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fa80cff00 0x7f7fa81551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.909+0000 7f7fae0e6640 1 --2- 172.21.15.50:0/3121603478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fa806e160 0x7f7fa81408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.909+0000 7f7fae0e6640 1 -- 172.21.15.50:0/3121603478 >> 172.21.15.50:0/3121603478 conn(0x7f7fa8075270 msgr2=0x7f7fa80710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.909+0000 7f7fae0e6640 1 -- 172.21.15.50:0/3121603478 shutdown_connections 2024-09-11T22:14:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:17.909+0000 7f7fae0e6640 1 -- 172.21.15.50:0/3121603478 wait complete. 2024-09-11T22:14:17.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:14:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.035+0000 7f511656f640 1 Processor -- start 2024-09-11T22:14:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.035+0000 7f511656f640 1 -- start start 2024-09-11T22:14:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.036+0000 7f511656f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5110161fa0 0x7f51100b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.036+0000 7f511656f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51100b1600 0x7f51100cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.036+0000 7f511656f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51100cfbd0 con 0x7f51100cf440 2024-09-11T22:14:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.036+0000 7f511656f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f51100cdce0 con 0x7f5110161fa0 2024-09-11T22:14:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.036+0000 7f511656f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f51100d1220 con 0x7f51100b1600 2024-09-11T22:14:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.036+0000 7f510ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5110161fa0 0x7f51100b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.036+0000 7f510ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5110161fa0 0x7f51100b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43694/0 (socket says 172.21.15.50:43694) 2024-09-11T22:14:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.036+0000 7f510ffff640 1 -- 172.21.15.50:0/306248901 learned_addr learned my addr 172.21.15.50:0/306248901 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.036+0000 7f5107fff640 1 --2- 172.21.15.50:0/306248901 >> v2:172.21.15.77:3300/0 conn(0x7f51100b1600 0x7f51100cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.037+0000 7f510ffff640 1 -- 172.21.15.50:0/306248901 >> v2:172.21.15.77:3300/0 conn(0x7f51100b1600 msgr2=0x7f51100cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.037+0000 7f510ffff640 1 --2- 172.21.15.50:0/306248901 >> v2:172.21.15.77:3300/0 conn(0x7f51100b1600 0x7f51100cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.037+0000 7f510ffff640 1 -- 172.21.15.50:0/306248901 >> v1:172.21.15.77:6789/0 conn(0x7f51100cf440 legacy=0x7f511006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.037+0000 7f510ffff640 1 -- 172.21.15.50:0/306248901 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51100cfeb0 con 0x7f5110161fa0 2024-09-11T22:14:18.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.037+0000 7f510ffff640 1 --2- 172.21.15.50:0/306248901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5110161fa0 0x7f51100b4d20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f511009c280 tx=0x7f510002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870a3b554553fba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:18.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.037+0000 7f510f7fe640 1 -- 172.21.15.50:0/306248901 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100037070 con 0x7f5110161fa0 2024-09-11T22:14:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.038+0000 7f510f7fe640 1 -- 172.21.15.50:0/306248901 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5100032440 con 0x7f5110161fa0 2024-09-11T22:14:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.038+0000 7f510f7fe640 1 -- 172.21.15.50:0/306248901 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100032810 con 0x7f5110161fa0 2024-09-11T22:14:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.038+0000 7f511656f640 1 -- 172.21.15.50:0/306248901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5110161fa0 msgr2=0x7f51100b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.038+0000 7f511656f640 1 --2- 172.21.15.50:0/306248901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5110161fa0 0x7f51100b4d20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f511009c280 tx=0x7f510002a230 comp rx=0 tx=0).stop 2024-09-11T22:14:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.038+0000 7f511656f640 1 -- 172.21.15.50:0/306248901 shutdown_connections 2024-09-11T22:14:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.038+0000 7f511656f640 1 --2- 172.21.15.50:0/306248901 >> v2:172.21.15.77:3300/0 conn(0x7f51100b1600 0x7f51100cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.038+0000 7f511656f640 1 --2- 172.21.15.50:0/306248901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5110161fa0 0x7f51100b4d20 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.038+0000 7f511656f640 1 -- 172.21.15.50:0/306248901 >> 172.21.15.50:0/306248901 conn(0x7f511009ba50 msgr2=0x7f51100b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.038+0000 7f511656f640 1 -- 172.21.15.50:0/306248901 shutdown_connections 2024-09-11T22:14:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.038+0000 7f511656f640 1 -- 172.21.15.50:0/306248901 wait complete. 2024-09-11T22:14:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.039+0000 7f511656f640 1 Processor -- start 2024-09-11T22:14:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.039+0000 7f511656f640 1 -- start start 2024-09-11T22:14:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.040+0000 7f511656f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51100b1600 0x7f51100b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.040+0000 7f511656f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51100cf440 0x7f51100b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.040+0000 7f511656f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5110161fa0 0x7f51100ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.040+0000 7f511656f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f51100cf870 con 0x7f51100cf440 2024-09-11T22:14:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.040+0000 7f511656f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f51100d17e0 con 0x7f51100b1600 2024-09-11T22:14:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.040+0000 7f511656f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5110162380 con 0x7f5110161fa0 2024-09-11T22:14:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.040+0000 7f5107fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51100cf440 0x7f51100b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.040+0000 7f5107fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51100cf440 0x7f51100b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43708/0 (socket says 172.21.15.50:43708) 2024-09-11T22:14:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.040+0000 7f5107fff640 1 -- 172.21.15.50:0/2331830728 learned_addr learned my addr 172.21.15.50:0/2331830728 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.040+0000 7f510ffff640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51100b1600 0x7f51100b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.040+0000 7f5114b0c640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5110161fa0 0x7f51100ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.041+0000 7f5107fff640 1 -- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5110161fa0 msgr2=0x7f51100ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.041+0000 7f5107fff640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5110161fa0 0x7f51100ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.041+0000 7f5107fff640 1 -- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51100b1600 msgr2=0x7f51100b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.041+0000 7f5107fff640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51100b1600 0x7f51100b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.041+0000 7f5107fff640 1 -- 172.21.15.50:0/2331830728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51100b25b0 con 0x7f51100cf440 2024-09-11T22:14:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.041+0000 7f510ffff640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51100b1600 0x7f51100b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.041+0000 7f5107fff640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51100cf440 0x7f51100b3890 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f50f800d800 tx=0x7f50f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.041+0000 7f510d7fa640 1 -- 172.21.15.50:0/2331830728 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f800b6c0 con 0x7f51100cf440 2024-09-11T22:14:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.041+0000 7f510d7fa640 1 -- 172.21.15.50:0/2331830728 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f8019070 con 0x7f51100cf440 2024-09-11T22:14:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.041+0000 7f510d7fa640 1 -- 172.21.15.50:0/2331830728 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f800ba80 con 0x7f51100cf440 2024-09-11T22:14:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.041+0000 7f511656f640 1 -- 172.21.15.50:0/2331830728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51100b2890 con 0x7f51100cf440 2024-09-11T22:14:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.041+0000 7f511656f640 1 -- 172.21.15.50:0/2331830728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51100b2e50 con 0x7f51100cf440 2024-09-11T22:14:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.042+0000 7f511656f640 1 -- 172.21.15.50:0/2331830728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51100d1c50 con 0x7f51100cf440 2024-09-11T22:14:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.043+0000 7f510d7fa640 1 -- 172.21.15.50:0/2331830728 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f50f800bc20 con 0x7f51100cf440 2024-09-11T22:14:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.043+0000 7f510d7fa640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f50f006be30 0x7f50f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.043+0000 7f510d7fa640 1 -- 172.21.15.50:0/2331830728 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5415+0+0 (secure 0 0 0) 0x7f50f808b210 con 0x7f51100cf440 2024-09-11T22:14:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.043+0000 7f510ffff640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f50f006be30 0x7f50f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.044+0000 7f510ffff640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f50f006be30 0x7f50f006e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5100034000 tx=0x7f510002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.048+0000 7f510d7fa640 1 -- 172.21.15.50:0/2331830728 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f50f8059ce0 con 0x7f51100cf440 2024-09-11T22:14:18.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.230+0000 7f511656f640 1 -- 172.21.15.50:0/2331830728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f51100c9800 con 0x7f51100cf440 2024-09-11T22:14:18.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.907+0000 7f510d7fa640 1 -- 172.21.15.50:0/2331830728 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) ==== 169+0+0 (secure 0 0 0) 0x7f50f80595e0 con 0x7f51100cf440 2024-09-11T22:14:18.908 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:14:18.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.910+0000 7f511656f640 1 -- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f50f006be30 msgr2=0x7f50f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:18.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.910+0000 7f511656f640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f50f006be30 0x7f50f006e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5100034000 tx=0x7f510002e000 comp rx=0 tx=0).stop 2024-09-11T22:14:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.910+0000 7f511656f640 1 -- 172.21.15.50:0/2331830728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51100cf440 msgr2=0x7f51100b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.910+0000 7f511656f640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51100cf440 0x7f51100b3890 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f50f800d800 tx=0x7f50f800dcc0 comp rx=0 tx=0).stop 2024-09-11T22:14:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.911+0000 7f511656f640 1 -- 172.21.15.50:0/2331830728 shutdown_connections 2024-09-11T22:14:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.911+0000 7f511656f640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f50f006be30 0x7f50f006e2f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.911+0000 7f511656f640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5110161fa0 0x7f51100ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.911+0000 7f511656f640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51100cf440 0x7f51100b3890 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.911+0000 7f511656f640 1 --2- 172.21.15.50:0/2331830728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51100b1600 0x7f51100b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.911+0000 7f511656f640 1 -- 172.21.15.50:0/2331830728 >> 172.21.15.50:0/2331830728 conn(0x7f511009ba50 msgr2=0x7f51100703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.911+0000 7f511656f640 1 -- 172.21.15.50:0/2331830728 shutdown_connections 2024-09-11T22:14:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:18.911+0000 7f511656f640 1 -- 172.21.15.50:0/2331830728 wait complete. 2024-09-11T22:14:18.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T22:14:19.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.039+0000 7f5e3cce6640 1 Processor -- start 2024-09-11T22:14:19.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.039+0000 7f5e3cce6640 1 -- start start 2024-09-11T22:14:19.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.040+0000 7f5e3cce6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e3815c2c0 0x7f5e380b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:19.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.040+0000 7f5e3cce6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5e380b3e10 0x7f5e380cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:19.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.040+0000 7f5e3cce6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e380b4f00 con 0x7f5e380d0410 2024-09-11T22:14:19.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.040+0000 7f5e3cce6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5e380cf7a0 con 0x7f5e380b3e10 2024-09-11T22:14:19.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.040+0000 7f5e3cce6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5e380d0840 con 0x7f5e3815c2c0 2024-09-11T22:14:19.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.040+0000 7f5e35d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5e380b3e10 0x7f5e380cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:19.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.040+0000 7f5e36d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5e380d0410 0x7f5e3815fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42138/0 (socket says 172.21.15.50:42138) 2024-09-11T22:14:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.040+0000 7f5e36d9d640 1 -- 172.21.15.50:0/4080618253 learned_addr learned my addr 172.21.15.50:0/4080618253 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.040+0000 7f5e3559a640 1 -- 172.21.15.50:0/4080618253 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828572226 0 0) 0x7f5e380b4f00 con 0x7f5e380d0410 2024-09-11T22:14:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.040+0000 7f5e3559a640 1 -- 172.21.15.50:0/4080618253 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e20003520 con 0x7f5e380d0410 2024-09-11T22:14:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.040+0000 7f5e35d9b640 1 -- 172.21.15.50:0/4080618253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e3815c2c0 msgr2=0x7f5e380b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.040+0000 7f5e3659c640 1 --2- 172.21.15.50:0/4080618253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e3815c2c0 0x7f5e380b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.041+0000 7f5e35d9b640 1 --2- 172.21.15.50:0/4080618253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e3815c2c0 0x7f5e380b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.041+0000 7f5e35d9b640 1 -- 172.21.15.50:0/4080618253 >> v1:172.21.15.50:6789/0 conn(0x7f5e380d0410 legacy=0x7f5e3815fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.041+0000 7f5e35d9b640 1 -- 172.21.15.50:0/4080618253 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e380b4360 con 0x7f5e380b3e10 2024-09-11T22:14:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.041+0000 7f5e3659c640 1 --2- 172.21.15.50:0/4080618253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e3815c2c0 0x7f5e380b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.041+0000 7f5e35d9b640 1 --2- 172.21.15.50:0/4080618253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e380b3e10 0x7f5e380cfed0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0097a0 tx=0x7f5e2c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b371eebaac1b36aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.041+0000 7f5e3559a640 1 -- 172.21.15.50:0/4080618253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c037070 con 0x7f5e380b3e10 2024-09-11T22:14:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.042+0000 7f5e3559a640 1 -- 172.21.15.50:0/4080618253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2c02ae50 con 0x7f5e380b3e10 2024-09-11T22:14:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.042+0000 7f5e3559a640 1 -- 172.21.15.50:0/4080618253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c032640 con 0x7f5e380b3e10 2024-09-11T22:14:19.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.042+0000 7f5e3cce6640 1 -- 172.21.15.50:0/4080618253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e380b3e10 msgr2=0x7f5e380cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.042+0000 7f5e3cce6640 1 --2- 172.21.15.50:0/4080618253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e380b3e10 0x7f5e380cfed0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0097a0 tx=0x7f5e2c02a100 comp rx=0 tx=0).stop 2024-09-11T22:14:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.042+0000 7f5e3cce6640 1 -- 172.21.15.50:0/4080618253 shutdown_connections 2024-09-11T22:14:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.042+0000 7f5e3cce6640 1 --2- 172.21.15.50:0/4080618253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e380b3e10 0x7f5e380cfed0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.042+0000 7f5e3cce6640 1 --2- 172.21.15.50:0/4080618253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e3815c2c0 0x7f5e380b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.042+0000 7f5e3cce6640 1 -- 172.21.15.50:0/4080618253 >> 172.21.15.50:0/4080618253 conn(0x7f5e380679c0 msgr2=0x7f5e38067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.042+0000 7f5e3cce6640 1 -- 172.21.15.50:0/4080618253 shutdown_connections 2024-09-11T22:14:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.042+0000 7f5e3cce6640 1 -- 172.21.15.50:0/4080618253 wait complete. 2024-09-11T22:14:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.043+0000 7f5e3cce6640 1 Processor -- start 2024-09-11T22:14:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.044+0000 7f5e3cce6640 1 -- start start 2024-09-11T22:14:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.044+0000 7f5e3cce6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e380b3e10 0x7f5e38144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.044+0000 7f5e3cce6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e380d0410 0x7f5e38072350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.044+0000 7f5e3cce6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3815c2c0 0x7f5e381536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.044+0000 7f5e3cce6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5e380cfc10 con 0x7f5e3815c2c0 2024-09-11T22:14:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.044+0000 7f5e3cce6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5e380b54a0 con 0x7f5e380b3e10 2024-09-11T22:14:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.044+0000 7f5e3cce6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5e380ce200 con 0x7f5e380d0410 2024-09-11T22:14:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.044+0000 7f5e36d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3815c2c0 0x7f5e381536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.044+0000 7f5e36d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3815c2c0 0x7f5e381536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43716/0 (socket says 172.21.15.50:43716) 2024-09-11T22:14:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.044+0000 7f5e36d9d640 1 -- 172.21.15.50:0/1172918315 learned_addr learned my addr 172.21.15.50:0/1172918315 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e35d9b640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e380d0410 0x7f5e38072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e3659c640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e380b3e10 0x7f5e38144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e36d9d640 1 -- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e380d0410 msgr2=0x7f5e38072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e36d9d640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e380d0410 0x7f5e38072350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e36d9d640 1 -- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e380b3e10 msgr2=0x7f5e38144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e36d9d640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e380b3e10 0x7f5e38144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e36d9d640 1 -- 172.21.15.50:0/1172918315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e38072a80 con 0x7f5e3815c2c0 2024-09-11T22:14:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e3659c640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e380b3e10 0x7f5e38144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e36d9d640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3815c2c0 0x7f5e381536e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000caa0 tx=0x7f5e3000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e26ffd640 1 -- 172.21.15.50:0/1172918315 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30017070 con 0x7f5e3815c2c0 2024-09-11T22:14:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e26ffd640 1 -- 172.21.15.50:0/1172918315 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3000ac00 con 0x7f5e3815c2c0 2024-09-11T22:14:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e3cce6640 1 -- 172.21.15.50:0/1172918315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e38072d60 con 0x7f5e3815c2c0 2024-09-11T22:14:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e26ffd640 1 -- 172.21.15.50:0/1172918315 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30012400 con 0x7f5e3815c2c0 2024-09-11T22:14:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.045+0000 7f5e3cce6640 1 -- 172.21.15.50:0/1172918315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e381531c0 con 0x7f5e3815c2c0 2024-09-11T22:14:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.046+0000 7f5e3cce6640 1 -- 172.21.15.50:0/1172918315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e380b3c20 con 0x7f5e3815c2c0 2024-09-11T22:14:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.047+0000 7f5e26ffd640 1 -- 172.21.15.50:0/1172918315 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e3001a070 con 0x7f5e3815c2c0 2024-09-11T22:14:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.047+0000 7f5e26ffd640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5e1806be30 0x7f5e1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.047+0000 7f5e26ffd640 1 -- 172.21.15.50:0/1172918315 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f5e3008a830 con 0x7f5e3815c2c0 2024-09-11T22:14:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.047+0000 7f5e3659c640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5e1806be30 0x7f5e1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.048+0000 7f5e3659c640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5e1806be30 0x7f5e1806e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800aa30 tx=0x7f5e28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.051+0000 7f5e26ffd640 1 -- 172.21.15.50:0/1172918315 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e30058f20 con 0x7f5e3815c2c0 2024-09-11T22:14:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.229+0000 7f5e3cce6640 1 -- 172.21.15.50:0/1172918315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f5e3806d070 con 0x7f5e3815c2c0 2024-09-11T22:14:19.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.232+0000 7f5e26ffd640 1 -- 172.21.15.50:0/1172918315 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f5e3005d220 con 0x7f5e3815c2c0 2024-09-11T22:14:19.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.234+0000 7f5e3cce6640 1 -- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5e1806be30 msgr2=0x7f5e1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:19.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.234+0000 7f5e3cce6640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5e1806be30 0x7f5e1806e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800aa30 tx=0x7f5e28008040 comp rx=0 tx=0).stop 2024-09-11T22:14:19.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.234+0000 7f5e3cce6640 1 -- 172.21.15.50:0/1172918315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3815c2c0 msgr2=0x7f5e381536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:19.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.234+0000 7f5e3cce6640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3815c2c0 0x7f5e381536e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000caa0 tx=0x7f5e3000cf60 comp rx=0 tx=0).stop 2024-09-11T22:14:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.234+0000 7f5e3cce6640 1 -- 172.21.15.50:0/1172918315 shutdown_connections 2024-09-11T22:14:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.234+0000 7f5e3cce6640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5e1806be30 0x7f5e1806e2f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.234+0000 7f5e3cce6640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e380d0410 0x7f5e38072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.234+0000 7f5e3cce6640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e3815c2c0 0x7f5e381536e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.234+0000 7f5e3cce6640 1 --2- 172.21.15.50:0/1172918315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e380b3e10 0x7f5e38144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.234+0000 7f5e3cce6640 1 -- 172.21.15.50:0/1172918315 >> 172.21.15.50:0/1172918315 conn(0x7f5e380679c0 msgr2=0x7f5e3806d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.234+0000 7f5e3cce6640 1 -- 172.21.15.50:0/1172918315 shutdown_connections 2024-09-11T22:14:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.234+0000 7f5e3cce6640 1 -- 172.21.15.50:0/1172918315 wait complete. 2024-09-11T22:14:19.246 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-11T22:14:19.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.349+0000 7fa23fcd2640 1 Processor -- start 2024-09-11T22:14:19.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.349+0000 7fa23fcd2640 1 -- start start 2024-09-11T22:14:19.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.350+0000 7fa23fcd2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa2380d18a0 0x7fa2380d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:19.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.350+0000 7fa23fcd2640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2380d3a30 0x7fa2380b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:19.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.350+0000 7fa23fcd2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2380cfa80 con 0x7fa23815e870 2024-09-11T22:14:19.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.350+0000 7fa23fcd2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa2380d3ea0 con 0x7fa2380d18a0 2024-09-11T22:14:19.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.350+0000 7fa23fcd2640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa2380d40d0 con 0x7fa2380d3a30 2024-09-11T22:14:19.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.351+0000 7fa23e26f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2380d3a30 0x7fa2380b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:19.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.351+0000 7fa23d26d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa2380d18a0 0x7fa2380d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:19.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.351+0000 7fa23e26f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2380d3a30 0x7fa2380b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:48774/0 (socket says 172.21.15.50:48774) 2024-09-11T22:14:19.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.351+0000 7fa23da6e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa23815e870 0x7fa2380d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:48692/0 (socket says 172.21.15.50:48692) 2024-09-11T22:14:19.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.351+0000 7fa23e26f640 1 -- 172.21.15.50:0/2890251618 learned_addr learned my addr 172.21.15.50:0/2890251618 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:19.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.351+0000 7fa23e26f640 1 -- 172.21.15.50:0/2890251618 >> v2:172.21.15.77:3300/0 conn(0x7fa2380d18a0 msgr2=0x7fa2380d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:19.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.351+0000 7fa23e26f640 1 --2- 172.21.15.50:0/2890251618 >> v2:172.21.15.77:3300/0 conn(0x7fa2380d18a0 0x7fa2380d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.351+0000 7fa23e26f640 1 -- 172.21.15.50:0/2890251618 >> v1:172.21.15.77:6789/0 conn(0x7fa23815e870 legacy=0x7fa2380d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:19.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.351+0000 7fa23e26f640 1 -- 172.21.15.50:0/2890251618 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2380d43b0 con 0x7fa2380d3a30 2024-09-11T22:14:19.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.351+0000 7fa23ca6c640 1 -- 172.21.15.50:0/2890251618 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793299747 0 0) 0x7fa230001110 con 0x7fa23815e870 2024-09-11T22:14:19.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.351+0000 7fa23d26d640 1 --2- 172.21.15.50:0/2890251618 >> v2:172.21.15.77:3300/0 conn(0x7fa2380d18a0 0x7fa2380d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:19.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.352+0000 7fa23e26f640 1 --2- 172.21.15.50:0/2890251618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2380d3a30 0x7fa2380b8400 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa228009e50 tx=0x7fa22802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d4b7cac589f1189 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:19.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.352+0000 7fa23ca6c640 1 -- 172.21.15.50:0/2890251618 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228036070 con 0x7fa2380d3a30 2024-09-11T22:14:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.352+0000 7fa23ca6c640 1 -- 172.21.15.50:0/2890251618 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa228031600 con 0x7fa2380d3a30 2024-09-11T22:14:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.352+0000 7fa23ca6c640 1 -- 172.21.15.50:0/2890251618 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2280319d0 con 0x7fa2380d3a30 2024-09-11T22:14:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.352+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2890251618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2380d3a30 msgr2=0x7fa2380b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.352+0000 7fa23fcd2640 1 --2- 172.21.15.50:0/2890251618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2380d3a30 0x7fa2380b8400 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa228009e50 tx=0x7fa22802a710 comp rx=0 tx=0).stop 2024-09-11T22:14:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.353+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2890251618 shutdown_connections 2024-09-11T22:14:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.353+0000 7fa23fcd2640 1 --2- 172.21.15.50:0/2890251618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2380d3a30 0x7fa2380b8400 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.353+0000 7fa23fcd2640 1 --2- 172.21.15.50:0/2890251618 >> v2:172.21.15.77:3300/0 conn(0x7fa2380d18a0 0x7fa2380d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.353+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2890251618 >> 172.21.15.50:0/2890251618 conn(0x7fa2380727a0 msgr2=0x7fa2380679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.353+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2890251618 shutdown_connections 2024-09-11T22:14:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.353+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2890251618 wait complete. 2024-09-11T22:14:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.354+0000 7fa23fcd2640 1 Processor -- start 2024-09-11T22:14:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.354+0000 7fa23fcd2640 1 -- start start 2024-09-11T22:14:19.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23fcd2640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2380d18a0 0x7fa2381f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23fcd2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2380d3a30 0x7fa238158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23fcd2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa23815e870 0x7fa238159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23fcd2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa23815ec50 con 0x7fa2380d3a30 2024-09-11T22:14:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23fcd2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa2380b7ee0 con 0x7fa23815e870 2024-09-11T22:14:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23fcd2640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa2380b78b0 con 0x7fa2380d18a0 2024-09-11T22:14:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23d26d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2380d3a30 0x7fa238158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23d26d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2380d3a30 0x7fa238158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43730/0 (socket says 172.21.15.50:43730) 2024-09-11T22:14:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23d26d640 1 -- 172.21.15.50:0/2192977690 learned_addr learned my addr 172.21.15.50:0/2192977690 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23da6e640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2380d18a0 0x7fa2381f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23e26f640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa23815e870 0x7fa238159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23d26d640 1 -- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2380d18a0 msgr2=0x7fa2381f52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23d26d640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2380d18a0 0x7fa2381f52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23d26d640 1 -- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa23815e870 msgr2=0x7fa238159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23d26d640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa23815e870 0x7fa238159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23d26d640 1 -- 172.21.15.50:0/2192977690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa238161bd0 con 0x7fa2380d3a30 2024-09-11T22:14:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23da6e640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2380d18a0 0x7fa2381f52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa23d26d640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2380d3a30 0x7fa238158f50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00e960 tx=0x7fa22c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.355+0000 7fa2367fc640 1 -- 172.21.15.50:0/2192977690 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c017070 con 0x7fa2380d3a30 2024-09-11T22:14:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.356+0000 7fa2367fc640 1 -- 172.21.15.50:0/2192977690 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22c00ca00 con 0x7fa2380d3a30 2024-09-11T22:14:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.356+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2192977690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa238156a10 con 0x7fa2380d3a30 2024-09-11T22:14:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.356+0000 7fa2367fc640 1 -- 172.21.15.50:0/2192977690 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c00cdd0 con 0x7fa2380d3a30 2024-09-11T22:14:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.356+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2192977690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa238158750 con 0x7fa2380d3a30 2024-09-11T22:14:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.357+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2192977690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2381f74d0 con 0x7fa2380d3a30 2024-09-11T22:14:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.357+0000 7fa2367fc640 1 -- 172.21.15.50:0/2192977690 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa22c01a070 con 0x7fa2380d3a30 2024-09-11T22:14:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.358+0000 7fa2367fc640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa22406be60 0x7fa22406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:19.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.358+0000 7fa2367fc640 1 -- 172.21.15.50:0/2192977690 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fa22c08aa70 con 0x7fa2380d3a30 2024-09-11T22:14:19.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.358+0000 7fa23da6e640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa22406be60 0x7fa22406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:19.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.359+0000 7fa23da6e640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa22406be60 0x7fa22406e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa230000f60 tx=0x7fa230007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:19.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.362+0000 7fa2367fc640 1 -- 172.21.15.50:0/2192977690 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa2381f74d0 con 0x7fa2380d3a30 2024-09-11T22:14:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.604+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2192977690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7fa2380d34f0 con 0x7fa2380d3a30 2024-09-11T22:14:19.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.914+0000 7fa2367fc640 1 -- 172.21.15.50:0/2192977690 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v160) ==== 143+0+0 (secure 0 0 0) 0x7fa22c0596a0 con 0x7fa2380d3a30 2024-09-11T22:14:19.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.919+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa22406be60 msgr2=0x7fa22406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:19.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.919+0000 7fa23fcd2640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa22406be60 0x7fa22406e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa230000f60 tx=0x7fa230007a50 comp rx=0 tx=0).stop 2024-09-11T22:14:19.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.919+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2192977690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2380d3a30 msgr2=0x7fa238158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:19.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.919+0000 7fa23fcd2640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2380d3a30 0x7fa238158f50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00e960 tx=0x7fa22c00ee20 comp rx=0 tx=0).stop 2024-09-11T22:14:19.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.919+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2192977690 shutdown_connections 2024-09-11T22:14:19.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.919+0000 7fa23fcd2640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa22406be60 0x7fa22406e320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.919+0000 7fa23fcd2640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa23815e870 0x7fa238159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.919+0000 7fa23fcd2640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2380d3a30 0x7fa238158f50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.919+0000 7fa23fcd2640 1 --2- 172.21.15.50:0/2192977690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2380d18a0 0x7fa2381f52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:19.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.919+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2192977690 >> 172.21.15.50:0/2192977690 conn(0x7fa2380727a0 msgr2=0x7fa2380b9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:19.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.919+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2192977690 shutdown_connections 2024-09-11T22:14:19.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:19.919+0000 7fa23fcd2640 1 -- 172.21.15.50:0/2192977690 wait complete. 2024-09-11T22:14:19.932 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-11T22:14:19.933 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is merged during scrub. 2024-09-11T22:14:19.933 INFO:tasks.cephfs_test_runner:test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-11T22:14:19.933 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:14:20.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.034+0000 7f3f8b3b9640 1 Processor -- start 2024-09-11T22:14:20.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.035+0000 7f3f8b3b9640 1 -- start start 2024-09-11T22:14:20.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.035+0000 7f3f8b3b9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3f8415b400 0x7f3f8406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f8b3b9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f84072e60 0x7f3f8406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f8b3b9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f8415b7e0 con 0x7f3f8406df20 2024-09-11T22:14:20.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f8b3b9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3f8415f140 con 0x7f3f8415b400 2024-09-11T22:14:20.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f8b3b9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8415f420 con 0x7f3f84072e60 2024-09-11T22:14:20.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f89155640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3f8415b400 0x7f3f8406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f88954640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f84072e60 0x7f3f8406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f89155640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3f8415b400 0x7f3f8406d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:52500/0 (socket says 172.21.15.50:52500) 2024-09-11T22:14:20.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f88954640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f84072e60 0x7f3f8406d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:48790/0 (socket says 172.21.15.50:48790) 2024-09-11T22:14:20.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f89155640 1 -- 172.21.15.50:0/2541530634 learned_addr learned my addr 172.21.15.50:0/2541530634 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:20.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f89956640 1 --1- 172.21.15.50:0/2541530634 >> v1:172.21.15.77:6789/0 conn(0x7f3f8406df20 0x7f3f840b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:48704/0 (socket says 172.21.15.50:48704) 2024-09-11T22:14:20.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f89155640 1 -- 172.21.15.50:0/2541530634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f84072e60 msgr2=0x7f3f8406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:20.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f89155640 1 --2- 172.21.15.50:0/2541530634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f84072e60 0x7f3f8406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f89155640 1 -- 172.21.15.50:0/2541530634 >> v1:172.21.15.77:6789/0 conn(0x7f3f8406df20 legacy=0x7f3f840b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f89155640 1 -- 172.21.15.50:0/2541530634 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8415f700 con 0x7f3f8415b400 2024-09-11T22:14:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f83fff640 1 -- 172.21.15.50:0/2541530634 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496840725 0 0) 0x7f3f8415b7e0 con 0x7f3f8406df20 2024-09-11T22:14:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.036+0000 7f3f88954640 1 --2- 172.21.15.50:0/2541530634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f84072e60 0x7f3f8406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.037+0000 7f3f89155640 1 --2- 172.21.15.50:0/2541530634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8415b400 0x7f3f8406d070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009870 tx=0x7f3f7c02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6427d86557422ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.037+0000 7f3f83fff640 1 -- 172.21.15.50:0/2541530634 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c037070 con 0x7f3f8415b400 2024-09-11T22:14:20.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.037+0000 7f3f83fff640 1 -- 172.21.15.50:0/2541530634 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f7c032440 con 0x7f3f8415b400 2024-09-11T22:14:20.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.037+0000 7f3f83fff640 1 -- 172.21.15.50:0/2541530634 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c032810 con 0x7f3f8415b400 2024-09-11T22:14:20.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.038+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2541530634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8415b400 msgr2=0x7f3f8406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.038+0000 7f3f8b3b9640 1 --2- 172.21.15.50:0/2541530634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8415b400 0x7f3f8406d070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009870 tx=0x7f3f7c02a250 comp rx=0 tx=0).stop 2024-09-11T22:14:20.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.038+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2541530634 shutdown_connections 2024-09-11T22:14:20.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.038+0000 7f3f8b3b9640 1 --2- 172.21.15.50:0/2541530634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f84072e60 0x7f3f8406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.038+0000 7f3f8b3b9640 1 --2- 172.21.15.50:0/2541530634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8415b400 0x7f3f8406d070 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.038+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2541530634 >> 172.21.15.50:0/2541530634 conn(0x7f3f840679c0 msgr2=0x7f3f84067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:20.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.038+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2541530634 shutdown_connections 2024-09-11T22:14:20.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.038+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2541530634 wait complete. 2024-09-11T22:14:20.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.039+0000 7f3f8b3b9640 1 Processor -- start 2024-09-11T22:14:20.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.039+0000 7f3f8b3b9640 1 -- start start 2024-09-11T22:14:20.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f8b3b9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f8406df20 0x7f3f8415e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f8b3b9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f84072e60 0x7f3f8414b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f8b3b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8415b400 0x7f3f8414beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f8b3b9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f840721d0 con 0x7f3f84072e60 2024-09-11T22:14:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f8b3b9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f840cfc50 con 0x7f3f8415b400 2024-09-11T22:14:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f8b3b9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3f84072350 con 0x7f3f8406df20 2024-09-11T22:14:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f88954640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f84072e60 0x7f3f8414b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f88954640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f84072e60 0x7f3f8414b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43736/0 (socket says 172.21.15.50:43736) 2024-09-11T22:14:20.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f88954640 1 -- 172.21.15.50:0/2028464286 learned_addr learned my addr 172.21.15.50:0/2028464286 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:20.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f89956640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8415b400 0x7f3f8414beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f89155640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f8406df20 0x7f3f8415e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f88954640 1 -- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f8406df20 msgr2=0x7f3f8415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f88954640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f8406df20 0x7f3f8415e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f88954640 1 -- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8415b400 msgr2=0x7f3f8414beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f88954640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8415b400 0x7f3f8414beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.040+0000 7f3f88954640 1 -- 172.21.15.50:0/2028464286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f840aa650 con 0x7f3f84072e60 2024-09-11T22:14:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.041+0000 7f3f88954640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f84072e60 0x7f3f8414b970 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800e960 tx=0x7f3f7800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.041+0000 7f3f81ffb640 1 -- 172.21.15.50:0/2028464286 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78017070 con 0x7f3f84072e60 2024-09-11T22:14:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.041+0000 7f3f81ffb640 1 -- 172.21.15.50:0/2028464286 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f7800ca00 con 0x7f3f84072e60 2024-09-11T22:14:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.041+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2028464286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f840acbd0 con 0x7f3f84072e60 2024-09-11T22:14:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.041+0000 7f3f81ffb640 1 -- 172.21.15.50:0/2028464286 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800cdd0 con 0x7f3f84072e60 2024-09-11T22:14:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.041+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2028464286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f840aabd0 con 0x7f3f84072e60 2024-09-11T22:14:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.042+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2028464286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8406d9e0 con 0x7f3f84072e60 2024-09-11T22:14:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.042+0000 7f3f81ffb640 1 -- 172.21.15.50:0/2028464286 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f7801a070 con 0x7f3f84072e60 2024-09-11T22:14:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.043+0000 7f3f81ffb640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f7006be30 0x7f3f7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.043+0000 7f3f81ffb640 1 -- 172.21.15.50:0/2028464286 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f3f7808aa10 con 0x7f3f84072e60 2024-09-11T22:14:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.043+0000 7f3f89155640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f7006be30 0x7f3f7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.044+0000 7f3f89155640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f7006be30 0x7f3f7006e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c034000 tx=0x7f3f7c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.047+0000 7f3f81ffb640 1 -- 172.21.15.50:0/2028464286 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f78058ff0 con 0x7f3f84072e60 2024-09-11T22:14:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.223+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2028464286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f8415a770 con 0x7f3f84072e60 2024-09-11T22:14:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.223+0000 7f3f81ffb640 1 -- 172.21.15.50:0/2028464286 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+12996 (secure 0 0 0) 0x7f3f7805d2f0 con 0x7f3f84072e60 2024-09-11T22:14:20.225 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:20.226 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":50,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:14:18.906514+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6834/3053142878":"2024-09-12T22:14:15.899054+0000","172.21.15.50:6832/3053142878":"2024-09-12T22:14:15.899054+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:14:20.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.225+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f7006be30 msgr2=0x7f3f7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.225+0000 7f3f8b3b9640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f7006be30 0x7f3f7006e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c034000 tx=0x7f3f7c02e000 comp rx=0 tx=0).stop 2024-09-11T22:14:20.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.225+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2028464286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f84072e60 msgr2=0x7f3f8414b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.225+0000 7f3f8b3b9640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f84072e60 0x7f3f8414b970 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800e960 tx=0x7f3f7800ee20 comp rx=0 tx=0).stop 2024-09-11T22:14:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.225+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2028464286 shutdown_connections 2024-09-11T22:14:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.225+0000 7f3f8b3b9640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f7006be30 0x7f3f7006e2f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.225+0000 7f3f8b3b9640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8415b400 0x7f3f8414beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.225+0000 7f3f8b3b9640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f84072e60 0x7f3f8414b970 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.225+0000 7f3f8b3b9640 1 --2- 172.21.15.50:0/2028464286 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f8406df20 0x7f3f8415e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.225+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2028464286 >> 172.21.15.50:0/2028464286 conn(0x7f3f840679c0 msgr2=0x7f3f840b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.225+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2028464286 shutdown_connections 2024-09-11T22:14:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.225+0000 7f3f8b3b9640 1 -- 172.21.15.50:0/2028464286 wait complete. 2024-09-11T22:14:20.239 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:11:03.407373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:14:20.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:14:20.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.343+0000 7f7f9eee6640 1 Processor -- start 2024-09-11T22:14:20.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.343+0000 7f7f9eee6640 1 -- start start 2024-09-11T22:14:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f9eee6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7f98161d30 0x7f7f980cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f9eee6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f980b78f0 0x7f7f98162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f9eee6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f981632e0 con 0x7f7f980d11d0 2024-09-11T22:14:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f9eee6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7f980d3450 con 0x7f7f98161d30 2024-09-11T22:14:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f9eee6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f98162110 con 0x7f7f980b78f0 2024-09-11T22:14:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f9cc82640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7f98161d30 0x7f7f980cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f97fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f980b78f0 0x7f7f98162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f97fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f980b78f0 0x7f7f98162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:48806/0 (socket says 172.21.15.50:48806) 2024-09-11T22:14:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f97fff640 1 -- 172.21.15.50:0/1246961994 learned_addr learned my addr 172.21.15.50:0/1246961994 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f9cc82640 1 -- 172.21.15.50:0/1246961994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f980b78f0 msgr2=0x7f7f98162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f9cc82640 1 --2- 172.21.15.50:0/1246961994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f980b78f0 0x7f7f98162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f9cc82640 1 -- 172.21.15.50:0/1246961994 >> v1:172.21.15.77:6789/0 conn(0x7f7f980d11d0 legacy=0x7f7f980d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f977fe640 1 -- 172.21.15.50:0/1246961994 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1022068415 0 0) 0x7f7f981632e0 con 0x7f7f980d11d0 2024-09-11T22:14:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f9cc82640 1 -- 172.21.15.50:0/1246961994 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f980cfd70 con 0x7f7f98161d30 2024-09-11T22:14:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.344+0000 7f7f97fff640 1 --2- 172.21.15.50:0/1246961994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f980b78f0 0x7f7f98162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.345+0000 7f7f9cc82640 1 --2- 172.21.15.50:0/1246961994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f98161d30 0x7f7f980cf790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0097a0 tx=0x7f7f8c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=375e44b8be6b4492 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.345+0000 7f7f977fe640 1 -- 172.21.15.50:0/1246961994 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c037070 con 0x7f7f98161d30 2024-09-11T22:14:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.345+0000 7f7f977fe640 1 -- 172.21.15.50:0/1246961994 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f8c032440 con 0x7f7f98161d30 2024-09-11T22:14:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.345+0000 7f7f977fe640 1 -- 172.21.15.50:0/1246961994 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c032810 con 0x7f7f98161d30 2024-09-11T22:14:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.346+0000 7f7f9eee6640 1 -- 172.21.15.50:0/1246961994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f98161d30 msgr2=0x7f7f980cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.346+0000 7f7f9eee6640 1 --2- 172.21.15.50:0/1246961994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f98161d30 0x7f7f980cf790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0097a0 tx=0x7f7f8c02a180 comp rx=0 tx=0).stop 2024-09-11T22:14:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.346+0000 7f7f9eee6640 1 -- 172.21.15.50:0/1246961994 shutdown_connections 2024-09-11T22:14:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.346+0000 7f7f9eee6640 1 --2- 172.21.15.50:0/1246961994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f980b78f0 0x7f7f98162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.346+0000 7f7f9eee6640 1 --2- 172.21.15.50:0/1246961994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f98161d30 0x7f7f980cf790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.346+0000 7f7f9eee6640 1 -- 172.21.15.50:0/1246961994 >> 172.21.15.50:0/1246961994 conn(0x7f7f980727a0 msgr2=0x7f7f980679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.346+0000 7f7f9eee6640 1 -- 172.21.15.50:0/1246961994 shutdown_connections 2024-09-11T22:14:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.346+0000 7f7f9eee6640 1 -- 172.21.15.50:0/1246961994 wait complete. 2024-09-11T22:14:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.347+0000 7f7f9eee6640 1 Processor -- start 2024-09-11T22:14:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.347+0000 7f7f9eee6640 1 -- start start 2024-09-11T22:14:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9eee6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f980b78f0 0x7f7f980ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9eee6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f980d11d0 0x7f7f9814d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9eee6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f98161d30 0x7f7f980b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9eee6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f980d30e0 con 0x7f7f980b78f0 2024-09-11T22:14:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9eee6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f980d2e00 con 0x7f7f98161d30 2024-09-11T22:14:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9eee6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f980b7d30 con 0x7f7f980d11d0 2024-09-11T22:14:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9cc82640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f980b78f0 0x7f7f980ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9cc82640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f980b78f0 0x7f7f980ab180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43740/0 (socket says 172.21.15.50:43740) 2024-09-11T22:14:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9cc82640 1 -- 172.21.15.50:0/3570957315 learned_addr learned my addr 172.21.15.50:0/3570957315 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f97fff640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f980d11d0 0x7f7f9814d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9d483640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f98161d30 0x7f7f980b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9cc82640 1 -- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f980d11d0 msgr2=0x7f7f9814d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9cc82640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f980d11d0 0x7f7f9814d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9cc82640 1 -- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f98161d30 msgr2=0x7f7f980b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9cc82640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f98161d30 0x7f7f980b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9cc82640 1 -- 172.21.15.50:0/3570957315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f980b6ea0 con 0x7f7f980b78f0 2024-09-11T22:14:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f9d483640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f98161d30 0x7f7f980b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.348+0000 7f7f97fff640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f980d11d0 0x7f7f9814d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.349+0000 7f7f9cc82640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f980b78f0 0x7f7f980ab180 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0097a0 tx=0x7f7f8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.349+0000 7f7f957fa640 1 -- 172.21.15.50:0/3570957315 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c037050 con 0x7f7f980b78f0 2024-09-11T22:14:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.349+0000 7f7f957fa640 1 -- 172.21.15.50:0/3570957315 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f8c038040 con 0x7f7f980b78f0 2024-09-11T22:14:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.349+0000 7f7f9eee6640 1 -- 172.21.15.50:0/3570957315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9814dab0 con 0x7f7f980b78f0 2024-09-11T22:14:20.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.349+0000 7f7f957fa640 1 -- 172.21.15.50:0/3570957315 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c004490 con 0x7f7f980b78f0 2024-09-11T22:14:20.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.349+0000 7f7f9eee6640 1 -- 172.21.15.50:0/3570957315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f9814e160 con 0x7f7f980b78f0 2024-09-11T22:14:20.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.350+0000 7f7f9eee6640 1 -- 172.21.15.50:0/3570957315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f980cf790 con 0x7f7f980b78f0 2024-09-11T22:14:20.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.350+0000 7f7f957fa640 1 -- 172.21.15.50:0/3570957315 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f8c03c6d0 con 0x7f7f980b78f0 2024-09-11T22:14:20.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.351+0000 7f7f957fa640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f7c06be30 0x7f7f7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.351+0000 7f7f957fa640 1 -- 172.21.15.50:0/3570957315 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f7f8c0ab5b0 con 0x7f7f980b78f0 2024-09-11T22:14:20.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.351+0000 7f7f97fff640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f7c06be30 0x7f7f7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.352+0000 7f7f97fff640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f7c06be30 0x7f7f7c06e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009630 tx=0x7f7f84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:20.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.355+0000 7f7f957fa640 1 -- 172.21.15.50:0/3570957315 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f8c07a260 con 0x7f7f980b78f0 2024-09-11T22:14:20.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.530+0000 7f7f9eee6640 1 -- 172.21.15.50:0/3570957315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7f980cdda0 con 0x7f7f980b78f0 2024-09-11T22:14:20.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.530+0000 7f7f957fa640 1 -- 172.21.15.50:0/3570957315 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) ==== 93+0+10 (secure 0 0 0) 0x7f7f8c079b60 con 0x7f7f980b78f0 2024-09-11T22:14:20.532 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-11T22:14:20.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.532+0000 7f7f9eee6640 1 -- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f7c06be30 msgr2=0x7f7f7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.532+0000 7f7f9eee6640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f7c06be30 0x7f7f7c06e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009630 tx=0x7f7f84008040 comp rx=0 tx=0).stop 2024-09-11T22:14:20.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.532+0000 7f7f9eee6640 1 -- 172.21.15.50:0/3570957315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f980b78f0 msgr2=0x7f7f980ab180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.532+0000 7f7f9eee6640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f980b78f0 0x7f7f980ab180 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0097a0 tx=0x7f7f8c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.533+0000 7f7f9eee6640 1 -- 172.21.15.50:0/3570957315 shutdown_connections 2024-09-11T22:14:20.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.533+0000 7f7f9eee6640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f7c06be30 0x7f7f7c06e2f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.533+0000 7f7f9eee6640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f980d11d0 0x7f7f9814d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.533+0000 7f7f9eee6640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f98161d30 0x7f7f980b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.533+0000 7f7f9eee6640 1 --2- 172.21.15.50:0/3570957315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f980b78f0 0x7f7f980ab180 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.533+0000 7f7f9eee6640 1 -- 172.21.15.50:0/3570957315 >> 172.21.15.50:0/3570957315 conn(0x7f7f980727a0 msgr2=0x7f7f980d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:20.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.533+0000 7f7f9eee6640 1 -- 172.21.15.50:0/3570957315 shutdown_connections 2024-09-11T22:14:20.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.533+0000 7f7f9eee6640 1 -- 172.21.15.50:0/3570957315 wait complete. 2024-09-11T22:14:20.546 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-11T22:14:20.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.647+0000 7fb7f7731640 1 Processor -- start 2024-09-11T22:14:20.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.647+0000 7fb7f7731640 1 -- start start 2024-09-11T22:14:20.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.648+0000 7fb7f7731640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7f00b4d70 0x7fb7f006d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.648+0000 7fb7f7731640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f00cbc40 con 0x7fb7f015e7c0 2024-09-11T22:14:20.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.648+0000 7fb7f7731640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f00cbf20 con 0x7fb7f006d560 2024-09-11T22:14:20.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.648+0000 7fb7f7731640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f00cc200 con 0x7fb7f00b4d70 2024-09-11T22:14:20.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.648+0000 7fb7f54cd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb7f015e7c0 0x7fb7f015eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42142/0 (socket says 172.21.15.50:42142) 2024-09-11T22:14:20.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.648+0000 7fb7f54cd640 1 -- 172.21.15.50:0/395515581 learned_addr learned my addr 172.21.15.50:0/395515581 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7f4ccc640 1 --2- 172.21.15.50:0/395515581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7f00b4d70 0x7fb7f006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 442441777 0 0) 0x7fb7f00cbc40 con 0x7fb7f015e7c0 2024-09-11T22:14:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7dc003520 con 0x7fb7f015e7c0 2024-09-11T22:14:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3168637870 0 0) 0x7fb7dc003520 con 0x7fb7f015e7c0 2024-09-11T22:14:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7f00b4d70 msgr2=0x7fb7f006d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 --2- 172.21.15.50:0/395515581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7f00b4d70 0x7fb7f006d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 >> v1:172.21.15.77:6789/0 conn(0x7fb7f006d560 legacy=0x7fb7f00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f00cc4e0 con 0x7fb7f015e7c0 2024-09-11T22:14:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fb7e8001670 con 0x7fb7f015e7c0 2024-09-11T22:14:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 >> v1:172.21.15.50:6789/0 conn(0x7fb7f015e7c0 legacy=0x7fb7f015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 --2- 172.21.15.50:0/395515581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7dc0039e0 0x7fb7dc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 --2- 172.21.15.50:0/395515581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc004390 0x7fb7dc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 --2- 172.21.15.50:0/395515581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7f00b4d70 0x7fb7dc0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f00cc200 con 0x7fb7dc004390 2024-09-11T22:14:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc00b9c0 con 0x7fb7dc0039e0 2024-09-11T22:14:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc00bbc0 con 0x7fb7f00b4d70 2024-09-11T22:14:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7f4ccc640 1 --2- 172.21.15.50:0/395515581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc004390 0x7fb7dc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7f54cd640 1 --2- 172.21.15.50:0/395515581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7dc0039e0 0x7fb7dc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7f5cce640 1 --2- 172.21.15.50:0/395515581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7f00b4d70 0x7fb7dc0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7f4ccc640 1 -- 172.21.15.50:0/395515581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7f00b4d70 msgr2=0x7fb7dc0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7f4ccc640 1 --2- 172.21.15.50:0/395515581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7f00b4d70 0x7fb7dc0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7f4ccc640 1 -- 172.21.15.50:0/395515581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7dc0039e0 msgr2=0x7fb7dc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7f4ccc640 1 --2- 172.21.15.50:0/395515581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7dc0039e0 0x7fb7dc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7f4ccc640 1 -- 172.21.15.50:0/395515581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc003520 con 0x7fb7dc004390 2024-09-11T22:14:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.649+0000 7fb7f5cce640 1 --2- 172.21.15.50:0/395515581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7f00b4d70 0x7fb7dc0050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:20.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.650+0000 7fb7f4ccc640 1 --2- 172.21.15.50:0/395515581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc004390 0x7fb7dc004860 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0073090 tx=0x7fb7dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd47d65db9ae584 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:20.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.650+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0036070 con 0x7fb7dc004390 2024-09-11T22:14:20.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.650+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0031400 con 0x7fb7dc004390 2024-09-11T22:14:20.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.650+0000 7fb7e7fff640 1 -- 172.21.15.50:0/395515581 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0009690 con 0x7fb7dc004390 2024-09-11T22:14:20.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.651+0000 7fb7f7731640 1 -- 172.21.15.50:0/395515581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc004390 msgr2=0x7fb7dc004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.651+0000 7fb7f7731640 1 --2- 172.21.15.50:0/395515581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc004390 0x7fb7dc004860 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0073090 tx=0x7fb7dc005830 comp rx=0 tx=0).stop 2024-09-11T22:14:20.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.651+0000 7fb7f5cce640 1 -- 172.21.15.50:0/395515581 reap_dead start 2024-09-11T22:14:20.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.651+0000 7fb7f7731640 1 -- 172.21.15.50:0/395515581 shutdown_connections 2024-09-11T22:14:20.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.651+0000 7fb7f7731640 1 -- 172.21.15.50:0/395515581 >> 172.21.15.50:0/395515581 conn(0x7fb7f00b4250 msgr2=0x7fb7f00b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:20.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.651+0000 7fb7f7731640 1 -- 172.21.15.50:0/395515581 shutdown_connections 2024-09-11T22:14:20.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.651+0000 7fb7f7731640 1 -- 172.21.15.50:0/395515581 wait complete. 2024-09-11T22:14:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.652+0000 7fb7f7731640 1 Processor -- start 2024-09-11T22:14:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.652+0000 7fb7f7731640 1 -- start start 2024-09-11T22:14:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f7731640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc004390 0x7fb7f015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f7731640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7f00cf5b0 0x7fb7f015cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f7731640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7f014bbe0 0x7fb7f014c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f7731640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f006d020 con 0x7fb7dc004390 2024-09-11T22:14:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f7731640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f00cb8d0 con 0x7fb7f014bbe0 2024-09-11T22:14:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f7731640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f006d1a0 con 0x7fb7f00cf5b0 2024-09-11T22:14:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f54cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc004390 0x7fb7f015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f54cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc004390 0x7fb7f015bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43760/0 (socket says 172.21.15.50:43760) 2024-09-11T22:14:20.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f54cd640 1 -- 172.21.15.50:0/508167976 learned_addr learned my addr 172.21.15.50:0/508167976 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:20.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f54cd640 1 -- 172.21.15.50:0/508167976 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7f00cf5b0 msgr2=0x7fb7f015cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f54cd640 1 --2- 172.21.15.50:0/508167976 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7f00cf5b0 0x7fb7f015cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f54cd640 1 -- 172.21.15.50:0/508167976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7f014bbe0 msgr2=0x7fb7f014c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f54cd640 1 --2- 172.21.15.50:0/508167976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7f014bbe0 0x7fb7f014c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f54cd640 1 -- 172.21.15.50:0/508167976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f015ae20 con 0x7fb7dc004390 2024-09-11T22:14:20.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7f54cd640 1 --2- 172.21.15.50:0/508167976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc004390 0x7fb7f015bec0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80017e0 tx=0x7fb7e8007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:20.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7e5ffb640 1 -- 172.21.15.50:0/508167976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e800f750 con 0x7fb7dc004390 2024-09-11T22:14:20.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.653+0000 7fb7e5ffb640 1 -- 172.21.15.50:0/508167976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e8018070 con 0x7fb7dc004390 2024-09-11T22:14:20.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.654+0000 7fb7e5ffb640 1 -- 172.21.15.50:0/508167976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e800faf0 con 0x7fb7dc004390 2024-09-11T22:14:20.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.654+0000 7fb7f7731640 1 -- 172.21.15.50:0/508167976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f015b100 con 0x7fb7dc004390 2024-09-11T22:14:20.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.654+0000 7fb7f7731640 1 -- 172.21.15.50:0/508167976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f015b6c0 con 0x7fb7dc004390 2024-09-11T22:14:20.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.655+0000 7fb7f7731640 1 -- 172.21.15.50:0/508167976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f015eba0 con 0x7fb7dc004390 2024-09-11T22:14:20.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.655+0000 7fb7e5ffb640 1 -- 172.21.15.50:0/508167976 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7e800fc90 con 0x7fb7dc004390 2024-09-11T22:14:20.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.656+0000 7fb7e5ffb640 1 --2- 172.21.15.50:0/508167976 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb7d406be60 0x7fb7d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:20.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.656+0000 7fb7e5ffb640 1 -- 172.21.15.50:0/508167976 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fb7e808a9e0 con 0x7fb7dc004390 2024-09-11T22:14:20.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.656+0000 7fb7f4ccc640 1 --2- 172.21.15.50:0/508167976 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb7d406be60 0x7fb7d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:20.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.657+0000 7fb7f4ccc640 1 --2- 172.21.15.50:0/508167976 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb7d406be60 0x7fb7d406e320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0073090 tx=0x7fb7e002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:20.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.660+0000 7fb7e5ffb640 1 -- 172.21.15.50:0/508167976 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7e8059720 con 0x7fb7dc004390 2024-09-11T22:14:20.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.903+0000 7fb7f7731640 1 -- 172.21.15.50:0/508167976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7fb7f0070430 con 0x7fb7dc004390 2024-09-11T22:14:20.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.914+0000 7fb7e5ffb640 1 -- 172.21.15.50:0/508167976 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v161) ==== 154+0+0 (secure 0 0 0) 0x7fb7e8059020 con 0x7fb7dc004390 2024-09-11T22:14:20.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.916+0000 7fb7f7731640 1 -- 172.21.15.50:0/508167976 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb7d406be60 msgr2=0x7fb7d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.917+0000 7fb7f7731640 1 --2- 172.21.15.50:0/508167976 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb7d406be60 0x7fb7d406e320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0073090 tx=0x7fb7e002e000 comp rx=0 tx=0).stop 2024-09-11T22:14:20.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.917+0000 7fb7f7731640 1 -- 172.21.15.50:0/508167976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc004390 msgr2=0x7fb7f015bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:20.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.917+0000 7fb7f7731640 1 --2- 172.21.15.50:0/508167976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc004390 0x7fb7f015bec0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80017e0 tx=0x7fb7e8007430 comp rx=0 tx=0).stop 2024-09-11T22:14:20.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.917+0000 7fb7f7731640 1 -- 172.21.15.50:0/508167976 shutdown_connections 2024-09-11T22:14:20.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.917+0000 7fb7f7731640 1 --2- 172.21.15.50:0/508167976 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb7d406be60 0x7fb7d406e320 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.917+0000 7fb7f7731640 1 --2- 172.21.15.50:0/508167976 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7f00cf5b0 0x7fb7f015cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.917+0000 7fb7f7731640 1 --2- 172.21.15.50:0/508167976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7f014bbe0 0x7fb7f014c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.917+0000 7fb7f7731640 1 --2- 172.21.15.50:0/508167976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7dc004390 0x7fb7f015bec0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:20.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.917+0000 7fb7f7731640 1 -- 172.21.15.50:0/508167976 >> 172.21.15.50:0/508167976 conn(0x7fb7f00b4250 msgr2=0x7fb7f006f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:20.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.917+0000 7fb7f7731640 1 -- 172.21.15.50:0/508167976 shutdown_connections 2024-09-11T22:14:20.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:20.917+0000 7fb7f7731640 1 -- 172.21.15.50:0/508167976 wait complete. 2024-09-11T22:14:20.929 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T22:14:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.033+0000 7efc526d2640 1 Processor -- start 2024-09-11T22:14:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.033+0000 7efc526d2640 1 -- start start 2024-09-11T22:14:21.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc526d2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc4c161fa0 0x7efc4c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc526d2640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc4c0b1600 0x7efc4c0cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc526d2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc4c0cf440 0x7efc4c06bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc526d2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7efc4c0d1220 con 0x7efc4c161fa0 2024-09-11T22:14:21.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc526d2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efc4c0d17e0 con 0x7efc4c0cf440 2024-09-11T22:14:21.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc526d2640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efc4c0cfbd0 con 0x7efc4c0b1600 2024-09-11T22:14:21.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc4bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc4c161fa0 0x7efc4c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc4bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc4c161fa0 0x7efc4c0b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43776/0 (socket says 172.21.15.50:43776) 2024-09-11T22:14:21.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc4bfff640 1 -- 172.21.15.50:0/2564285378 learned_addr learned my addr 172.21.15.50:0/2564285378 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:21.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc50c6f640 1 --2- 172.21.15.50:0/2564285378 >> v2:172.21.15.77:3300/0 conn(0x7efc4c0cf440 0x7efc4c06bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc4b7fe640 1 --2- 172.21.15.50:0/2564285378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc4c0b1600 0x7efc4c0cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc4bfff640 1 -- 172.21.15.50:0/2564285378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc4c0b1600 msgr2=0x7efc4c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:21.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc4bfff640 1 --2- 172.21.15.50:0/2564285378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc4c0b1600 0x7efc4c0cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc4bfff640 1 -- 172.21.15.50:0/2564285378 >> v2:172.21.15.77:3300/0 conn(0x7efc4c0cf440 msgr2=0x7efc4c06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:21.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc4bfff640 1 --2- 172.21.15.50:0/2564285378 >> v2:172.21.15.77:3300/0 conn(0x7efc4c0cf440 0x7efc4c06bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.034+0000 7efc4bfff640 1 -- 172.21.15.50:0/2564285378 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4c0cfeb0 con 0x7efc4c161fa0 2024-09-11T22:14:21.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.035+0000 7efc4bfff640 1 --2- 172.21.15.50:0/2564285378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c161fa0 0x7efc4c0b4d20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efc4c073640 tx=0x7efc3c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4d7f454088d14e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:21.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.035+0000 7efc4affd640 1 -- 172.21.15.50:0/2564285378 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c037070 con 0x7efc4c161fa0 2024-09-11T22:14:21.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.035+0000 7efc4affd640 1 -- 172.21.15.50:0/2564285378 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3c032440 con 0x7efc4c161fa0 2024-09-11T22:14:21.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.035+0000 7efc4affd640 1 -- 172.21.15.50:0/2564285378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c032810 con 0x7efc4c161fa0 2024-09-11T22:14:21.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.036+0000 7efc526d2640 1 -- 172.21.15.50:0/2564285378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c161fa0 msgr2=0x7efc4c0b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.036+0000 7efc526d2640 1 --2- 172.21.15.50:0/2564285378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c161fa0 0x7efc4c0b4d20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efc4c073640 tx=0x7efc3c02a1e0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.036+0000 7efc526d2640 1 -- 172.21.15.50:0/2564285378 shutdown_connections 2024-09-11T22:14:21.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.036+0000 7efc526d2640 1 --2- 172.21.15.50:0/2564285378 >> v2:172.21.15.77:3300/0 conn(0x7efc4c0cf440 0x7efc4c06bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.036+0000 7efc526d2640 1 --2- 172.21.15.50:0/2564285378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc4c0b1600 0x7efc4c0cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.036+0000 7efc526d2640 1 --2- 172.21.15.50:0/2564285378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c161fa0 0x7efc4c0b4d20 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.036+0000 7efc526d2640 1 -- 172.21.15.50:0/2564285378 >> 172.21.15.50:0/2564285378 conn(0x7efc4c09ba50 msgr2=0x7efc4c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.036+0000 7efc526d2640 1 -- 172.21.15.50:0/2564285378 shutdown_connections 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.036+0000 7efc526d2640 1 -- 172.21.15.50:0/2564285378 wait complete. 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.037+0000 7efc526d2640 1 Processor -- start 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.037+0000 7efc526d2640 1 -- start start 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc526d2640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc4c0b1600 0x7efc4c1f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc526d2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c0cf440 0x7efc4c0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc526d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c161fa0 0x7efc4c0b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc526d2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efc4c162380 con 0x7efc4c161fa0 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc526d2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc4c0cf8f0 con 0x7efc4c0cf440 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc526d2640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efc4c162500 con 0x7efc4c0b1600 2024-09-11T22:14:21.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc50c6f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c161fa0 0x7efc4c0b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc50c6f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c161fa0 0x7efc4c0b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43786/0 (socket says 172.21.15.50:43786) 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc50c6f640 1 -- 172.21.15.50:0/2049698666 learned_addr learned my addr 172.21.15.50:0/2049698666 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc4b7fe640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c0cf440 0x7efc4c0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc4bfff640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc4c0b1600 0x7efc4c1f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc50c6f640 1 -- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc4c0b1600 msgr2=0x7efc4c1f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc50c6f640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc4c0b1600 0x7efc4c1f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc50c6f640 1 -- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c0cf440 msgr2=0x7efc4c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc50c6f640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c0cf440 0x7efc4c0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc50c6f640 1 -- 172.21.15.50:0/2049698666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4c160880 con 0x7efc4c161fa0 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.038+0000 7efc50c6f640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c161fa0 0x7efc4c0b3720 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efc44009dd0 tx=0x7efc4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.039+0000 7efc48ff9640 1 -- 172.21.15.50:0/2049698666 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc44018020 con 0x7efc4c161fa0 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.039+0000 7efc48ff9640 1 -- 172.21.15.50:0/2049698666 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc44014480 con 0x7efc4c161fa0 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.039+0000 7efc526d2640 1 -- 172.21.15.50:0/2049698666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4c160b60 con 0x7efc4c161fa0 2024-09-11T22:14:21.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.039+0000 7efc48ff9640 1 -- 172.21.15.50:0/2049698666 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc44014870 con 0x7efc4c161fa0 2024-09-11T22:14:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.039+0000 7efc526d2640 1 -- 172.21.15.50:0/2049698666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc4c161120 con 0x7efc4c161fa0 2024-09-11T22:14:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.040+0000 7efc526d2640 1 -- 172.21.15.50:0/2049698666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc4c06d2a0 con 0x7efc4c161fa0 2024-09-11T22:14:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.040+0000 7efc48ff9640 1 -- 172.21.15.50:0/2049698666 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc4401b020 con 0x7efc4c161fa0 2024-09-11T22:14:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.040+0000 7efc48ff9640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc3806be60 0x7efc3806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.041+0000 7efc48ff9640 1 -- 172.21.15.50:0/2049698666 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7efc4408b490 con 0x7efc4c161fa0 2024-09-11T22:14:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.041+0000 7efc4bfff640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc3806be60 0x7efc3806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.041+0000 7efc4bfff640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc3806be60 0x7efc3806e320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efc3c034000 tx=0x7efc3c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:21.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.045+0000 7efc48ff9640 1 -- 172.21.15.50:0/2049698666 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc44022030 con 0x7efc4c161fa0 2024-09-11T22:14:21.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.221+0000 7efc526d2640 1 -- 172.21.15.50:0/2049698666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efc4c071000 con 0x7efc4c161fa0 2024-09-11T22:14:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.224+0000 7efc48ff9640 1 -- 172.21.15.50:0/2049698666 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7efc44010040 con 0x7efc4c161fa0 2024-09-11T22:14:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.226+0000 7efc526d2640 1 -- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc3806be60 msgr2=0x7efc3806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.226+0000 7efc526d2640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc3806be60 0x7efc3806e320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efc3c034000 tx=0x7efc3c02e000 comp rx=0 tx=0).stop 2024-09-11T22:14:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.226+0000 7efc526d2640 1 -- 172.21.15.50:0/2049698666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c161fa0 msgr2=0x7efc4c0b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.226+0000 7efc526d2640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c161fa0 0x7efc4c0b3720 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efc44009dd0 tx=0x7efc4400c490 comp rx=0 tx=0).stop 2024-09-11T22:14:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.226+0000 7efc526d2640 1 -- 172.21.15.50:0/2049698666 shutdown_connections 2024-09-11T22:14:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.226+0000 7efc526d2640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc3806be60 0x7efc3806e320 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.227+0000 7efc526d2640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc4c161fa0 0x7efc4c0b3720 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.227+0000 7efc526d2640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c0cf440 0x7efc4c0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.227+0000 7efc526d2640 1 --2- 172.21.15.50:0/2049698666 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc4c0b1600 0x7efc4c1f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.227+0000 7efc526d2640 1 -- 172.21.15.50:0/2049698666 >> 172.21.15.50:0/2049698666 conn(0x7efc4c09ba50 msgr2=0x7efc4c0b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.227+0000 7efc526d2640 1 -- 172.21.15.50:0/2049698666 shutdown_connections 2024-09-11T22:14:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.227+0000 7efc526d2640 1 -- 172.21.15.50:0/2049698666 wait complete. 2024-09-11T22:14:21.239 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:14:21.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:14:21.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:14:21.348 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:14:21.348 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:14:21.349 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:21.365 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:14:21.365 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:14:21.365 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:21.384 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:14:21.384 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:14:21.384 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:21.421 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:14:21.421 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:14:21.421 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:21.442 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:14:21.442 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T22:14:21.443 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:21.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.561+0000 7f43b861e640 1 Processor -- start 2024-09-11T22:14:21.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.561+0000 7f43b861e640 1 -- start start 2024-09-11T22:14:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.562+0000 7f43b861e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43b015e8e0 0x7f43b00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.562+0000 7f43b861e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f43b00d1580 0x7f43b00d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.562+0000 7f43b861e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b00d1ee0 con 0x7f43b0162350 2024-09-11T22:14:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.562+0000 7f43b861e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f43b015ecc0 con 0x7f43b00d1580 2024-09-11T22:14:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.562+0000 7f43b861e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43b00d2ad0 con 0x7f43b015e8e0 2024-09-11T22:14:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.562+0000 7f43b6bbb640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f43b0162350 0x7f43b0162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42154/0 (socket says 172.21.15.50:42154) 2024-09-11T22:14:21.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.562+0000 7f43b6bbb640 1 -- 172.21.15.50:0/3563368045 learned_addr learned my addr 172.21.15.50:0/3563368045 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b63ba640 1 --2- 172.21.15.50:0/3563368045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43b015e8e0 0x7f43b00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3979938335 0 0) 0x7f43b00d1ee0 con 0x7f43b0162350 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b5bb9640 1 --2- 172.21.15.50:0/3563368045 >> v2:172.21.15.77:3300/0 conn(0x7f43b00d1580 0x7f43b00d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4398003520 con 0x7f43b0162350 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 99079409 0 0) 0x7f4398003520 con 0x7f43b0162350 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43b015e8e0 msgr2=0x7f43b00b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 --2- 172.21.15.50:0/3563368045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43b015e8e0 0x7f43b00b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 >> v2:172.21.15.77:3300/0 conn(0x7f43b00d1580 msgr2=0x7f43b00d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 --2- 172.21.15.50:0/3563368045 >> v2:172.21.15.77:3300/0 conn(0x7f43b00d1580 0x7f43b00d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b0163080 con 0x7f43b0162350 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f43a8001670 con 0x7f43b0162350 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 >> v1:172.21.15.50:6789/0 conn(0x7f43b0162350 legacy=0x7f43b0162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 --2- 172.21.15.50:0/3563368045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43980039b0 0x7f4398003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 --2- 172.21.15.50:0/3563368045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43b015e8e0 0x7f4398004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 --2- 172.21.15.50:0/3563368045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4398004d40 0x7f43980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43b00d2ad0 con 0x7f4398004d40 2024-09-11T22:14:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f439800b9c0 con 0x7f43980039b0 2024-09-11T22:14:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f439800bb40 con 0x7f43b015e8e0 2024-09-11T22:14:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b6bbb640 1 --2- 172.21.15.50:0/3563368045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4398004d40 0x7f43980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b63ba640 1 --2- 172.21.15.50:0/3563368045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43980039b0 0x7f4398003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b5bb9640 1 --2- 172.21.15.50:0/3563368045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43b015e8e0 0x7f4398004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b6bbb640 1 -- 172.21.15.50:0/3563368045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43b015e8e0 msgr2=0x7f4398004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b6bbb640 1 --2- 172.21.15.50:0/3563368045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43b015e8e0 0x7f4398004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b6bbb640 1 -- 172.21.15.50:0/3563368045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43980039b0 msgr2=0x7f4398003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b6bbb640 1 --2- 172.21.15.50:0/3563368045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43980039b0 0x7f4398003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.563+0000 7f43b6bbb640 1 -- 172.21.15.50:0/3563368045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4398003520 con 0x7f4398004d40 2024-09-11T22:14:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.564+0000 7f43b6bbb640 1 --2- 172.21.15.50:0/3563368045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4398004d40 0x7f43980051c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f43a8007fd0 tx=0x7f4398005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1699905f1d762f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.564+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a8007d50 con 0x7f4398004d40 2024-09-11T22:14:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.564+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a8005ad0 con 0x7f4398004d40 2024-09-11T22:14:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.564+0000 7f43b53b8640 1 -- 172.21.15.50:0/3563368045 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a8007070 con 0x7f4398004d40 2024-09-11T22:14:21.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.565+0000 7f43b861e640 1 -- 172.21.15.50:0/3563368045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4398004d40 msgr2=0x7f43980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.565+0000 7f43b861e640 1 --2- 172.21.15.50:0/3563368045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4398004d40 0x7f43980051c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f43a8007fd0 tx=0x7f4398005830 comp rx=0 tx=0).stop 2024-09-11T22:14:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.565+0000 7f43b6bbb640 1 -- 172.21.15.50:0/3563368045 reap_dead start 2024-09-11T22:14:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.565+0000 7f43b861e640 1 -- 172.21.15.50:0/3563368045 shutdown_connections 2024-09-11T22:14:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.565+0000 7f43b861e640 1 -- 172.21.15.50:0/3563368045 >> 172.21.15.50:0/3563368045 conn(0x7f43b0067ba0 msgr2=0x7f43b0067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.565+0000 7f43b861e640 1 -- 172.21.15.50:0/3563368045 shutdown_connections 2024-09-11T22:14:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.565+0000 7f43b861e640 1 -- 172.21.15.50:0/3563368045 wait complete. 2024-09-11T22:14:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.566+0000 7f43b861e640 1 Processor -- start 2024-09-11T22:14:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.566+0000 7f43b861e640 1 -- start start 2024-09-11T22:14:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b861e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4398004d40 0x7f43b00ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b861e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b00ab260 0x7f43b014dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b861e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43b00cd810 0x7f43b00cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b861e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43b00d3000 con 0x7f43b00ab260 2024-09-11T22:14:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b861e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43b00d3370 con 0x7f43b00cd810 2024-09-11T22:14:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b861e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43b00b7880 con 0x7f4398004d40 2024-09-11T22:14:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b5bb9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b00ab260 0x7f43b014dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b5bb9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b00ab260 0x7f43b014dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43816/0 (socket says 172.21.15.50:43816) 2024-09-11T22:14:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b5bb9640 1 -- 172.21.15.50:0/2546179962 learned_addr learned my addr 172.21.15.50:0/2546179962 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b63ba640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4398004d40 0x7f43b00ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b6bbb640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43b00cd810 0x7f43b00cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b5bb9640 1 -- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4398004d40 msgr2=0x7f43b00ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b5bb9640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4398004d40 0x7f43b00ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b5bb9640 1 -- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43b00cd810 msgr2=0x7f43b00cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b5bb9640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43b00cd810 0x7f43b00cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b5bb9640 1 -- 172.21.15.50:0/2546179962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b00ab6e0 con 0x7f43b00ab260 2024-09-11T22:14:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.567+0000 7f43b63ba640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4398004d40 0x7f43b00ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.568+0000 7f43b5bb9640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b00ab260 0x7f43b014dbb0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f43a40119b0 tx=0x7f43a4011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.568+0000 7f43aeffd640 1 -- 172.21.15.50:0/2546179962 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a400fa90 con 0x7f43b00ab260 2024-09-11T22:14:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.568+0000 7f43aeffd640 1 -- 172.21.15.50:0/2546179962 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a400fc30 con 0x7f43b00ab260 2024-09-11T22:14:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.568+0000 7f43b861e640 1 -- 172.21.15.50:0/2546179962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b00cca50 con 0x7f43b00ab260 2024-09-11T22:14:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.568+0000 7f43aeffd640 1 -- 172.21.15.50:0/2546179962 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4014440 con 0x7f43b00ab260 2024-09-11T22:14:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.568+0000 7f43b861e640 1 -- 172.21.15.50:0/2546179962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b00cd010 con 0x7f43b00ab260 2024-09-11T22:14:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.569+0000 7f43b861e640 1 -- 172.21.15.50:0/2546179962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b00b7c10 con 0x7f43b00ab260 2024-09-11T22:14:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.569+0000 7f43aeffd640 1 -- 172.21.15.50:0/2546179962 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43a4012040 con 0x7f43b00ab260 2024-09-11T22:14:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.570+0000 7f43aeffd640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f439c06be30 0x7f439c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.570+0000 7f43aeffd640 1 -- 172.21.15.50:0/2546179962 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f43a408b1c0 con 0x7f43b00ab260 2024-09-11T22:14:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.570+0000 7f43b63ba640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f439c06be30 0x7f439c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.571+0000 7f43b63ba640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f439c06be30 0x7f439c06e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f43a0007440 tx=0x7f43a000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.574+0000 7f43aeffd640 1 -- 172.21.15.50:0/2546179962 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43a4019030 con 0x7f43b00ab260 2024-09-11T22:14:21.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.783+0000 7f43b861e640 1 -- 172.21.15.50:0/2546179962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43b00d0090 con 0x7f43b00ab260 2024-09-11T22:14:21.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.784+0000 7f43aeffd640 1 -- 172.21.15.50:0/2546179962 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+3911 (secure 0 0 0) 0x7f43a4059e70 con 0x7f43b00ab260 2024-09-11T22:14:21.786 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:21.786 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":28,"btime":"2024-09-11T22:14:16:900565+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2882007728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2882007728},{"type":"v1","addr":"172.21.15.50:6835","nonce":2882007728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1935649711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935649711},{"type":"v1","addr":"172.21.15.77:6837","nonce":1935649711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3208356003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3208356003},{"type":"v1","addr":"172.21.15.77:6836","nonce":3208356003}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5405,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2034831359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2034831359},{"type":"v1","addr":"172.21.15.50:6834","nonce":2034831359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[]} 2024-09-11T22:14:21.786 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 28 2024-09-11T22:14:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.786+0000 7f43b861e640 1 -- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f439c06be30 msgr2=0x7f439c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.786+0000 7f43b861e640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f439c06be30 0x7f439c06e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f43a0007440 tx=0x7f43a000b040 comp rx=0 tx=0).stop 2024-09-11T22:14:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.786+0000 7f43b861e640 1 -- 172.21.15.50:0/2546179962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b00ab260 msgr2=0x7f43b014dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.786+0000 7f43b861e640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b00ab260 0x7f43b014dbb0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f43a40119b0 tx=0x7f43a4011e70 comp rx=0 tx=0).stop 2024-09-11T22:14:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.786+0000 7f43b861e640 1 -- 172.21.15.50:0/2546179962 shutdown_connections 2024-09-11T22:14:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.786+0000 7f43b861e640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f439c06be30 0x7f439c06e2f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.786+0000 7f43b861e640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43b00cd810 0x7f43b00cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.786+0000 7f43b861e640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43b00ab260 0x7f43b014dbb0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.786+0000 7f43b861e640 1 --2- 172.21.15.50:0/2546179962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4398004d40 0x7f43b00ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.786+0000 7f43b861e640 1 -- 172.21.15.50:0/2546179962 >> 172.21.15.50:0/2546179962 conn(0x7f43b0067ba0 msgr2=0x7f43b00d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.786+0000 7f43b861e640 1 -- 172.21.15.50:0/2546179962 shutdown_connections 2024-09-11T22:14:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.786+0000 7f43b861e640 1 -- 172.21.15.50:0/2546179962 wait complete. 2024-09-11T22:14:21.798 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:14:21.798 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T22:14:21.799 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:14:21.799 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:14:21.799 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:14:21.799 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T22:14:21.799 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:14:21.799 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:14:21.799 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:14:21.800 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T22:14:21.800 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:14:21.800 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:14:21.800 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:14:21.800 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T22:14:21.800 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:14:21.800 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:14:21.808 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:14:21.809 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:14:21.809 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:14:21.809 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:14:21.811 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:14:21.812 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:14:21.812 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:14:21.813 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:14:21.851 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:14:21.851 DEBUG:teuthology.parallel:result is None 2024-09-11T22:14:21.852 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:14:21.852 DEBUG:teuthology.parallel:result is None 2024-09-11T22:14:21.855 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:14:21.855 DEBUG:teuthology.parallel:result is None 2024-09-11T22:14:21.855 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:14:21.856 DEBUG:teuthology.parallel:result is None 2024-09-11T22:14:21.856 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T22:14:21.929 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:14:21.929 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:14:21.937 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:14:21.937 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:14:21.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.964+0000 7f3b38159640 1 Processor -- start 2024-09-11T22:14:21.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.964+0000 7f3b38159640 1 -- start start 2024-09-11T22:14:21.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.965+0000 7f3b38159640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3b3015c770 0x7f3b300b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.965+0000 7f3b38159640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3015cef0 con 0x7f3b300b5920 2024-09-11T22:14:21.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.965+0000 7f3b38159640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3015d1d0 con 0x7f3b300b66e0 2024-09-11T22:14:21.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.965+0000 7f3b38159640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3b3015d4b0 con 0x7f3b3015c770 2024-09-11T22:14:21.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.965+0000 7f3b356f4640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3b300b5920 0x7f3b300b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42180/0 (socket says 172.21.15.50:42180) 2024-09-11T22:14:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.965+0000 7f3b356f4640 1 -- 172.21.15.50:0/1191439953 learned_addr learned my addr 172.21.15.50:0/1191439953 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.965+0000 7f3b35ef5640 1 --2- 172.21.15.50:0/1191439953 >> v2:172.21.15.77:3300/0 conn(0x7f3b3015c770 0x7f3b300b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.965+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780439879 0 0) 0x7f3b3015cef0 con 0x7f3b300b5920 2024-09-11T22:14:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.965+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b1c003520 con 0x7f3b300b5920 2024-09-11T22:14:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.965+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 604966360 0 0) 0x7f3b1c003520 con 0x7f3b300b5920 2024-09-11T22:14:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.965+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 >> v2:172.21.15.77:3300/0 conn(0x7f3b3015c770 msgr2=0x7f3b300b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.965+0000 7f3b34ef3640 1 --2- 172.21.15.50:0/1191439953 >> v2:172.21.15.77:3300/0 conn(0x7f3b3015c770 0x7f3b300b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.965+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 >> v1:172.21.15.77:6789/0 conn(0x7f3b300b66e0 legacy=0x7f3b3015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3015d790 con 0x7f3b300b5920 2024-09-11T22:14:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f3b20001670 con 0x7f3b300b5920 2024-09-11T22:14:21.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b35ef5640 1 --2- 172.21.15.50:0/1191439953 >> v2:172.21.15.77:3300/0 conn(0x7f3b3015c770 0x7f3b300b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:21.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 >> v1:172.21.15.50:6789/0 conn(0x7f3b300b5920 legacy=0x7f3b300b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b34ef3640 1 --2- 172.21.15.50:0/1191439953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b1c0039b0 0x7f3b1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b34ef3640 1 --2- 172.21.15.50:0/1191439953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0043b0 0x7f3b1c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b34ef3640 1 --2- 172.21.15.50:0/1191439953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b1c005080 0x7f3b1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3015d4b0 con 0x7f3b1c0043b0 2024-09-11T22:14:21.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c00bfe0 con 0x7f3b1c005080 2024-09-11T22:14:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1c00c1e0 con 0x7f3b1c0039b0 2024-09-11T22:14:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b356f4640 1 --2- 172.21.15.50:0/1191439953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0043b0 0x7f3b1c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b35ef5640 1 --2- 172.21.15.50:0/1191439953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b1c0039b0 0x7f3b1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b366f6640 1 --2- 172.21.15.50:0/1191439953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b1c005080 0x7f3b1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b356f4640 1 -- 172.21.15.50:0/1191439953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b1c0039b0 msgr2=0x7f3b1c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b356f4640 1 --2- 172.21.15.50:0/1191439953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b1c0039b0 0x7f3b1c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b356f4640 1 -- 172.21.15.50:0/1191439953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b1c005080 msgr2=0x7f3b1c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b356f4640 1 --2- 172.21.15.50:0/1191439953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b1c005080 0x7f3b1c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b356f4640 1 -- 172.21.15.50:0/1191439953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c003520 con 0x7f3b1c0043b0 2024-09-11T22:14:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b366f6640 1 --2- 172.21.15.50:0/1191439953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b1c005080 0x7f3b1c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.966+0000 7f3b366f6640 1 -- 172.21.15.50:0/1191439953 reap_dead start 2024-09-11T22:14:21.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.967+0000 7f3b356f4640 1 --2- 172.21.15.50:0/1191439953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0043b0 0x7f3b1c004880 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000c240 tx=0x7f3b1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60944187cbb55 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:21.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.967+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20007d30 con 0x7f3b1c0043b0 2024-09-11T22:14:21.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.967+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b20005af0 con 0x7f3b1c0043b0 2024-09-11T22:14:21.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.967+0000 7f3b34ef3640 1 -- 172.21.15.50:0/1191439953 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20007070 con 0x7f3b1c0043b0 2024-09-11T22:14:21.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.968+0000 7f3b38159640 1 -- 172.21.15.50:0/1191439953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0043b0 msgr2=0x7f3b1c004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.968+0000 7f3b38159640 1 --2- 172.21.15.50:0/1191439953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0043b0 0x7f3b1c004880 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000c240 tx=0x7f3b1c005830 comp rx=0 tx=0).stop 2024-09-11T22:14:21.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.968+0000 7f3b38159640 1 -- 172.21.15.50:0/1191439953 shutdown_connections 2024-09-11T22:14:21.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.968+0000 7f3b38159640 1 --2- 172.21.15.50:0/1191439953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0043b0 0x7f3b1c004880 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.968+0000 7f3b38159640 1 -- 172.21.15.50:0/1191439953 >> 172.21.15.50:0/1191439953 conn(0x7f3b300b7940 msgr2=0x7f3b300b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:21.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.968+0000 7f3b38159640 1 -- 172.21.15.50:0/1191439953 shutdown_connections 2024-09-11T22:14:21.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.968+0000 7f3b38159640 1 -- 172.21.15.50:0/1191439953 wait complete. 2024-09-11T22:14:21.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.969+0000 7f3b38159640 1 Processor -- start 2024-09-11T22:14:21.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.969+0000 7f3b38159640 1 -- start start 2024-09-11T22:14:21.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b38159640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0043b0 0x7f3b30150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b38159640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b3009dbd0 0x7f3b3009eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b38159640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b301534f0 0x7f3b301539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b38159640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3015ccd0 con 0x7f3b1c0043b0 2024-09-11T22:14:21.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b38159640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3015cb50 con 0x7f3b301534f0 2024-09-11T22:14:21.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b38159640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3b300b53e0 con 0x7f3b3009dbd0 2024-09-11T22:14:21.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b35ef5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0043b0 0x7f3b30150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b35ef5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0043b0 0x7f3b30150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43856/0 (socket says 172.21.15.50:43856) 2024-09-11T22:14:21.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b35ef5640 1 -- 172.21.15.50:0/1444968221 learned_addr learned my addr 172.21.15.50:0/1444968221 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:21.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b356f4640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b3009dbd0 0x7f3b3009eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b366f6640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b301534f0 0x7f3b301539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b35ef5640 1 -- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b3009dbd0 msgr2=0x7f3b3009eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b35ef5640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b3009dbd0 0x7f3b3009eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b35ef5640 1 -- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b301534f0 msgr2=0x7f3b301539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b35ef5640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b301534f0 0x7f3b301539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b35ef5640 1 -- 172.21.15.50:0/1444968221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b301514b0 con 0x7f3b1c0043b0 2024-09-11T22:14:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b35ef5640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0043b0 0x7f3b30150f70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c011d00 tx=0x7f3b2c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b267fc640 1 -- 172.21.15.50:0/1444968221 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00fcc0 con 0x7f3b1c0043b0 2024-09-11T22:14:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b267fc640 1 -- 172.21.15.50:0/1444968221 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2c00fe60 con 0x7f3b1c0043b0 2024-09-11T22:14:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b38159640 1 -- 172.21.15.50:0/1444968221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3009f3f0 con 0x7f3b1c0043b0 2024-09-11T22:14:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.970+0000 7f3b267fc640 1 -- 172.21.15.50:0/1444968221 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c004270 con 0x7f3b1c0043b0 2024-09-11T22:14:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.971+0000 7f3b38159640 1 -- 172.21.15.50:0/1444968221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b3009f9b0 con 0x7f3b1c0043b0 2024-09-11T22:14:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.971+0000 7f3b38159640 1 -- 172.21.15.50:0/1444968221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b300b56e0 con 0x7f3b1c0043b0 2024-09-11T22:14:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.972+0000 7f3b267fc640 1 -- 172.21.15.50:0/1444968221 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b2c012040 con 0x7f3b1c0043b0 2024-09-11T22:14:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.973+0000 7f3b267fc640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3b1406be60 0x7f3b1406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.973+0000 7f3b267fc640 1 -- 172.21.15.50:0/1444968221 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f3b2c08af40 con 0x7f3b1c0043b0 2024-09-11T22:14:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.973+0000 7f3b356f4640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3b1406be60 0x7f3b1406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:21.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.973+0000 7f3b356f4640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3b1406be60 0x7f3b1406e320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b20033000 tx=0x7f3b2002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:21.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:21.977+0000 7f3b267fc640 1 -- 172.21.15.50:0/1444968221 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b2c019070 con 0x7f3b1c0043b0 2024-09-11T22:14:22.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:22.165+0000 7f3b38159640 1 -- 172.21.15.50:0/1444968221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f3b3015b280 con 0x7f3b1c0043b0 2024-09-11T22:14:23.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.236+0000 7f3b267fc640 1 -- 172.21.15.50:0/1444968221 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v55) ==== 97+0+0 (secure 0 0 0) 0x7f3b2c0595a0 con 0x7f3b1c0043b0 2024-09-11T22:14:23.238 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-11T22:14:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.239+0000 7f3b38159640 1 -- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3b1406be60 msgr2=0x7f3b1406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.239+0000 7f3b38159640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3b1406be60 0x7f3b1406e320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b20033000 tx=0x7f3b2002e000 comp rx=0 tx=0).stop 2024-09-11T22:14:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.239+0000 7f3b38159640 1 -- 172.21.15.50:0/1444968221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0043b0 msgr2=0x7f3b30150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.239+0000 7f3b38159640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0043b0 0x7f3b30150f70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c011d00 tx=0x7f3b2c00f610 comp rx=0 tx=0).stop 2024-09-11T22:14:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.239+0000 7f3b38159640 1 -- 172.21.15.50:0/1444968221 shutdown_connections 2024-09-11T22:14:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.239+0000 7f3b38159640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3b1406be60 0x7f3b1406e320 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.239+0000 7f3b38159640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b3009dbd0 0x7f3b3009eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.239+0000 7f3b38159640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b301534f0 0x7f3b301539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.239+0000 7f3b38159640 1 --2- 172.21.15.50:0/1444968221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b1c0043b0 0x7f3b30150f70 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.239+0000 7f3b38159640 1 -- 172.21.15.50:0/1444968221 >> 172.21.15.50:0/1444968221 conn(0x7f3b300b7940 msgr2=0x7f3b30157050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.239+0000 7f3b38159640 1 -- 172.21.15.50:0/1444968221 shutdown_connections 2024-09-11T22:14:23.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.239+0000 7f3b38159640 1 -- 172.21.15.50:0/1444968221 wait complete. 2024-09-11T22:14:23.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T22:14:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.363+0000 7f442bd13640 1 Processor -- start 2024-09-11T22:14:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.363+0000 7f442bd13640 1 -- start start 2024-09-11T22:14:23.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f442bd13640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44240d1c90 0x7f44240b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:23.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f442bd13640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4424163080 con 0x7f4424162350 2024-09-11T22:14:23.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f442bd13640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44240d2d20 con 0x7f442415e8e0 2024-09-11T22:14:23.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f442bd13640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f442415ecc0 con 0x7f44240d1c90 2024-09-11T22:14:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f442a2b0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4424162350 0x7f44241627e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42192/0 (socket says 172.21.15.50:42192) 2024-09-11T22:14:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f442a2b0640 1 -- 172.21.15.50:0/3103643765 learned_addr learned my addr 172.21.15.50:0/3103643765 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f44292ae640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44240d1c90 0x7f44240b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077369237 0 0) 0x7f4424163080 con 0x7f4424162350 2024-09-11T22:14:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4410003520 con 0x7f4424162350 2024-09-11T22:14:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891918485 0 0) 0x7f44240d2d20 con 0x7f442415e8e0 2024-09-11T22:14:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4424163080 con 0x7f442415e8e0 2024-09-11T22:14:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 779926702 0 0) 0x7f4410003520 con 0x7f4424162350 2024-09-11T22:14:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44240d1c90 msgr2=0x7f44240b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44240d1c90 0x7f44240b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 >> v1:172.21.15.77:6789/0 conn(0x7f442415e8e0 legacy=0x7f44240d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44240d3000 con 0x7f4424162350 2024-09-11T22:14:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f441c0019f0 con 0x7f4424162350 2024-09-11T22:14:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f44292ae640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44240d1c90 0x7f44240b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 >> v1:172.21.15.50:6789/0 conn(0x7f4424162350 legacy=0x7f44241627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4410003b70 0x7f4410003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4410004800 0x7f4410004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44240d1c90 0x7f44100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f441000b9f0 con 0x7f4410003b70 2024-09-11T22:14:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f441000bba0 con 0x7f4410004800 2024-09-11T22:14:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f441000bda0 con 0x7f44240d1c90 2024-09-11T22:14:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4429aaf640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4410003b70 0x7f4410003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f44292ae640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4410004800 0x7f4410004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f442a2b0640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44240d1c90 0x7f44100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4429aaf640 1 -- 172.21.15.50:0/3103643765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44240d1c90 msgr2=0x7f44100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4429aaf640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44240d1c90 0x7f44100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4429aaf640 1 -- 172.21.15.50:0/3103643765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4410004800 msgr2=0x7f4410004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4429aaf640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4410004800 0x7f4410004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f4429aaf640 1 -- 172.21.15.50:0/3103643765 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4410003520 con 0x7f4410003b70 2024-09-11T22:14:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.364+0000 7f442a2b0640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44240d1c90 0x7f44100051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.365+0000 7f4429aaf640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4410003b70 0x7f4410003f70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f44200018a0 tx=0x7f4410005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1041156a00fff73 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.365+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44200014f0 con 0x7f4410003b70 2024-09-11T22:14:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.365+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44200052d0 con 0x7f4410003b70 2024-09-11T22:14:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.365+0000 7f4428aad640 1 -- 172.21.15.50:0/3103643765 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442002ac40 con 0x7f4410003b70 2024-09-11T22:14:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.366+0000 7f442bd13640 1 -- 172.21.15.50:0/3103643765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4410003b70 msgr2=0x7f4410003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.366+0000 7f442bd13640 1 --2- 172.21.15.50:0/3103643765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4410003b70 0x7f4410003f70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f44200018a0 tx=0x7f4410005830 comp rx=0 tx=0).stop 2024-09-11T22:14:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.366+0000 7f442a2b0640 1 -- 172.21.15.50:0/3103643765 reap_dead start 2024-09-11T22:14:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.366+0000 7f442bd13640 1 -- 172.21.15.50:0/3103643765 shutdown_connections 2024-09-11T22:14:23.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.366+0000 7f442bd13640 1 -- 172.21.15.50:0/3103643765 >> 172.21.15.50:0/3103643765 conn(0x7f4424067ba0 msgr2=0x7f4424067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:23.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.366+0000 7f442bd13640 1 -- 172.21.15.50:0/3103643765 shutdown_connections 2024-09-11T22:14:23.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.366+0000 7f442bd13640 1 -- 172.21.15.50:0/3103643765 wait complete. 2024-09-11T22:14:23.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.368+0000 7f442bd13640 1 Processor -- start 2024-09-11T22:14:23.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.368+0000 7f442bd13640 1 -- start start 2024-09-11T22:14:23.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442bd13640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4410003b70 0x7f44240ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:23.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442bd13640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4424155ec0 0x7f44241f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:23.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442bd13640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442415f4a0 0x7f442415f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:23.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442bd13640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f44240b7c10 con 0x7f442415f4a0 2024-09-11T22:14:23.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442bd13640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f44240b7a90 con 0x7f4410003b70 2024-09-11T22:14:23.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442bd13640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f44240d2ad0 con 0x7f4424155ec0 2024-09-11T22:14:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442a2b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442415f4a0 0x7f442415f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442a2b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442415f4a0 0x7f442415f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43872/0 (socket says 172.21.15.50:43872) 2024-09-11T22:14:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442a2b0640 1 -- 172.21.15.50:0/4266166136 learned_addr learned my addr 172.21.15.50:0/4266166136 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f4429aaf640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4410003b70 0x7f44240ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f44292ae640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4424155ec0 0x7f44241f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442a2b0640 1 -- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4424155ec0 msgr2=0x7f44241f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442a2b0640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4424155ec0 0x7f44241f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442a2b0640 1 -- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4410003b70 msgr2=0x7f44240ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442a2b0640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4410003b70 0x7f44240ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442a2b0640 1 -- 172.21.15.50:0/4266166136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442415ecc0 con 0x7f442415f4a0 2024-09-11T22:14:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f4429aaf640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4410003b70 0x7f44240ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442a2b0640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442415f4a0 0x7f442415f950 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f441c000f80 tx=0x7f441c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f441a7fc640 1 -- 172.21.15.50:0/4266166136 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c00ebb0 con 0x7f442415f4a0 2024-09-11T22:14:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f441a7fc640 1 -- 172.21.15.50:0/4266166136 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f441c018070 con 0x7f442415f4a0 2024-09-11T22:14:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442bd13640 1 -- 172.21.15.50:0/4266166136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44241f4af0 con 0x7f442415f4a0 2024-09-11T22:14:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f441a7fc640 1 -- 172.21.15.50:0/4266166136 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c013420 con 0x7f442415f4a0 2024-09-11T22:14:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.369+0000 7f442bd13640 1 -- 172.21.15.50:0/4266166136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44241f50b0 con 0x7f442415f4a0 2024-09-11T22:14:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.370+0000 7f442bd13640 1 -- 172.21.15.50:0/4266166136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44240d1580 con 0x7f442415f4a0 2024-09-11T22:14:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.370+0000 7f441a7fc640 1 -- 172.21.15.50:0/4266166136 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f441c0135c0 con 0x7f442415f4a0 2024-09-11T22:14:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.371+0000 7f441a7fc640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f440806be60 0x7f440806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.371+0000 7f441a7fc640 1 -- 172.21.15.50:0/4266166136 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4857+0+0 (secure 0 0 0) 0x7f441c08acd0 con 0x7f442415f4a0 2024-09-11T22:14:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.371+0000 7f4429aaf640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f440806be60 0x7f440806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.371+0000 7f4429aaf640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f440806be60 0x7f440806e320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4420032000 tx=0x7f4420009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.375+0000 7f441a7fc640 1 -- 172.21.15.50:0/4266166136 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f441c059a90 con 0x7f442415f4a0 2024-09-11T22:14:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.618+0000 7f442bd13640 1 -- 172.21.15.50:0/4266166136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f44240ba750 con 0x7f442415f4a0 2024-09-11T22:14:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.618+0000 7f441a7fc640 1 -- 172.21.15.50:0/4266166136 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f441c059390 con 0x7f442415f4a0 2024-09-11T22:14:23.620 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:23.620 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:23.620 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-11T22:14:23.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.620 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-11T22:14:23.620 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w==", 2024-09-11T22:14:23.621 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.621 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:14:23.621 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:14:23.621 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:14:23.621 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.621 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.621 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-11T22:14:23.621 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg==", 2024-09-11T22:14:23.621 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.621 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ==", 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.622 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw==", 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg==", 2024-09-11T22:14:23.623 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.624 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:14:23.624 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:14:23.624 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.624 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.624 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-11T22:14:23.624 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ==", 2024-09-11T22:14:23.624 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.624 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:14:23.624 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:14:23.624 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.625 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.625 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-11T22:14:23.625 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg==", 2024-09-11T22:14:23.625 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.625 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:14:23.625 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:14:23.625 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.625 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.625 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg==", 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A==", 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:14:23.626 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw==", 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-11T22:14:23.627 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A==", 2024-09-11T22:14:23.628 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.628 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:14:23.628 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:14:23.628 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.628 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.628 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-11T22:14:23.628 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw==", 2024-09-11T22:14:23.628 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.628 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:14:23.628 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:14:23.628 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.629 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.629 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-11T22:14:23.629 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew==", 2024-09-11T22:14:23.629 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.629 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:14:23.629 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-11T22:14:23.629 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T22:14:23.629 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.629 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw==", 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg==", 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:14:23.630 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw==", 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.632 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-11T22:14:23.632 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBFFeJmAq9+OBAAANc9KfDvm3+wt/uED7WCvA==", 2024-09-11T22:14:23.632 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.632 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:14:23.632 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:14:23.632 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:14:23.632 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.632 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.632 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-11T22:14:23.632 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g==", 2024-09-11T22:14:23.633 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.633 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:14:23.633 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:14:23.633 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.633 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:14:23.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.633 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-11T22:14:23.633 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg==", 2024-09-11T22:14:23.633 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:14:23.633 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:14:23.633 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:14:23.633 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:14:23.634 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.634 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.634 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-11T22:14:23.634 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.620+0000 7f442bd13640 1 -- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f440806be60 msgr2=0x7f440806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.620+0000 7f442bd13640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f440806be60 0x7f440806e320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4420032000 tx=0x7f4420009030 comp rx=0 tx=0).stop 2024-09-11T22:14:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.620+0000 7f442bd13640 1 -- 172.21.15.50:0/4266166136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442415f4a0 msgr2=0x7f442415f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.620+0000 7f442bd13640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442415f4a0 0x7f442415f950 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f441c000f80 tx=0x7f441c00e530 comp rx=0 tx=0).stop 2024-09-11T22:14:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.620+0000 7f442bd13640 1 -- 172.21.15.50:0/4266166136 shutdown_connections 2024-09-11T22:14:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.620+0000 7f442bd13640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f440806be60 0x7f440806e320 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.620+0000 7f442bd13640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4424155ec0 0x7f44241f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.620+0000 7f442bd13640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f442415f4a0 0x7f442415f950 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.620+0000 7f442bd13640 1 --2- 172.21.15.50:0/4266166136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4410003b70 0x7f44240ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.620+0000 7f442bd13640 1 -- 172.21.15.50:0/4266166136 >> 172.21.15.50:0/4266166136 conn(0x7f4424067ba0 msgr2=0x7f44240b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:23.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.621+0000 7f442bd13640 1 -- 172.21.15.50:0/4266166136 shutdown_connections 2024-09-11T22:14:23.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.621+0000 7f442bd13640 1 -- 172.21.15.50:0/4266166136 wait complete. 2024-09-11T22:14:23.636 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:14:23.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.737+0000 7f43ef98d640 1 Processor -- start 2024-09-11T22:14:23.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.737+0000 7f43ef98d640 1 -- start start 2024-09-11T22:14:23.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.737+0000 7f43ef98d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43e80d18a0 0x7f43e80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:23.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.737+0000 7f43ef98d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e80cfa80 con 0x7f43e815e870 2024-09-11T22:14:23.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.737+0000 7f43ef98d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e80d40d0 con 0x7f43e80d3a30 2024-09-11T22:14:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.737+0000 7f43ef98d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f43e80d3ea0 con 0x7f43e80d18a0 2024-09-11T22:14:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.737+0000 7f43ed729640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f43e815e870 0x7f43e80d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42200/0 (socket says 172.21.15.50:42200) 2024-09-11T22:14:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.738+0000 7f43ecf28640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43e80d18a0 0x7f43e80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.738+0000 7f43ed729640 1 -- 172.21.15.50:0/2631411148 learned_addr learned my addr 172.21.15.50:0/2631411148 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.738+0000 7f43ecf28640 1 -- 172.21.15.50:0/2631411148 >> v1:172.21.15.77:6789/0 conn(0x7f43e80d3a30 legacy=0x7f43e80b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.738+0000 7f43ecf28640 1 -- 172.21.15.50:0/2631411148 >> v1:172.21.15.50:6789/0 conn(0x7f43e815e870 legacy=0x7f43e80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.738+0000 7f43ecf28640 1 -- 172.21.15.50:0/2631411148 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e80d43b0 con 0x7f43e80d18a0 2024-09-11T22:14:23.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.739+0000 7f43ecf28640 1 --2- 172.21.15.50:0/2631411148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e80d18a0 0x7f43e80d34f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f43d80097a0 tx=0x7f43d802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d811e6419e2a3a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:23.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.739+0000 7f43dffff640 1 -- 172.21.15.50:0/2631411148 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8037070 con 0x7f43e80d18a0 2024-09-11T22:14:23.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.739+0000 7f43dffff640 1 -- 172.21.15.50:0/2631411148 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d8032440 con 0x7f43e80d18a0 2024-09-11T22:14:23.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.739+0000 7f43dffff640 1 -- 172.21.15.50:0/2631411148 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8032810 con 0x7f43e80d18a0 2024-09-11T22:14:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.739+0000 7f43ef98d640 1 -- 172.21.15.50:0/2631411148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e80d18a0 msgr2=0x7f43e80d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.739+0000 7f43ef98d640 1 --2- 172.21.15.50:0/2631411148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e80d18a0 0x7f43e80d34f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f43d80097a0 tx=0x7f43d802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.739+0000 7f43ef98d640 1 -- 172.21.15.50:0/2631411148 shutdown_connections 2024-09-11T22:14:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.739+0000 7f43ef98d640 1 --2- 172.21.15.50:0/2631411148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e80d18a0 0x7f43e80d34f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.739+0000 7f43ef98d640 1 -- 172.21.15.50:0/2631411148 >> 172.21.15.50:0/2631411148 conn(0x7f43e80727a0 msgr2=0x7f43e80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.739+0000 7f43ef98d640 1 -- 172.21.15.50:0/2631411148 shutdown_connections 2024-09-11T22:14:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.739+0000 7f43ef98d640 1 -- 172.21.15.50:0/2631411148 wait complete. 2024-09-11T22:14:23.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.741+0000 7f43ef98d640 1 Processor -- start 2024-09-11T22:14:23.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.741+0000 7f43ef98d640 1 -- start start 2024-09-11T22:14:23.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.741+0000 7f43ef98d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e80d18a0 0x7f43e80ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:23.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.741+0000 7f43ef98d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80d3a30 0x7f43e80ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:23.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.741+0000 7f43ef98d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815e870 0x7f43e80ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:23.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.741+0000 7f43ef98d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43e815ec50 con 0x7f43e815e870 2024-09-11T22:14:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.741+0000 7f43ef98d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43e80b7ee0 con 0x7f43e80d18a0 2024-09-11T22:14:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.741+0000 7f43ef98d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43e80b78b0 con 0x7f43e80d3a30 2024-09-11T22:14:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43edf2a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815e870 0x7f43e80ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43edf2a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815e870 0x7f43e80ab6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43896/0 (socket says 172.21.15.50:43896) 2024-09-11T22:14:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43edf2a640 1 -- 172.21.15.50:0/2100373087 learned_addr learned my addr 172.21.15.50:0/2100373087 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43ed729640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e80d18a0 0x7f43e80ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43ecf28640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80d3a30 0x7f43e80ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43edf2a640 1 -- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80d3a30 msgr2=0x7f43e80ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43edf2a640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80d3a30 0x7f43e80ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43edf2a640 1 -- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e80d18a0 msgr2=0x7f43e80ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43edf2a640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e80d18a0 0x7f43e80ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43edf2a640 1 -- 172.21.15.50:0/2100373087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e81543b0 con 0x7f43e815e870 2024-09-11T22:14:23.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43edf2a640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815e870 0x7f43e80ab6c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f43e000c410 tx=0x7f43e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43ddffb640 1 -- 172.21.15.50:0/2100373087 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0011790 con 0x7f43e815e870 2024-09-11T22:14:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43ddffb640 1 -- 172.21.15.50:0/2100373087 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e0017070 con 0x7f43e815e870 2024-09-11T22:14:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43ddffb640 1 -- 172.21.15.50:0/2100373087 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0011bb0 con 0x7f43e815e870 2024-09-11T22:14:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43ef98d640 1 -- 172.21.15.50:0/2100373087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e80c98e0 con 0x7f43e815e870 2024-09-11T22:14:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.742+0000 7f43ef98d640 1 -- 172.21.15.50:0/2100373087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e80c9ea0 con 0x7f43e815e870 2024-09-11T22:14:23.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.743+0000 7f43ef98d640 1 -- 172.21.15.50:0/2100373087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e80d34f0 con 0x7f43e815e870 2024-09-11T22:14:23.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.744+0000 7f43ddffb640 1 -- 172.21.15.50:0/2100373087 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43e001c460 con 0x7f43e815e870 2024-09-11T22:14:23.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.744+0000 7f43ddffb640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43cc06be30 0x7f43cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:23.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.744+0000 7f43ddffb640 1 -- 172.21.15.50:0/2100373087 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4857+0+0 (secure 0 0 0) 0x7f43e008a510 con 0x7f43e815e870 2024-09-11T22:14:23.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.744+0000 7f43ed729640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43cc06be30 0x7f43cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:23.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.745+0000 7f43ed729640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43cc06be30 0x7f43cc06e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f43e40012e0 tx=0x7f43e4001a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:23.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.750+0000 7f43ddffb640 1 -- 172.21.15.50:0/2100373087 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43e0021020 con 0x7f43e815e870 2024-09-11T22:14:23.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.928+0000 7f43ef98d640 1 -- 172.21.15.50:0/2100373087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f43e80d1300 con 0x7f43e815e870 2024-09-11T22:14:23.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.928+0000 7f43ddffb640 1 -- 172.21.15.50:0/2100373087 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) ==== 84+0+65 (secure 0 0 0) 0x7f43e008a070 con 0x7f43e815e870 2024-09-11T22:14:23.929 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:23.930 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:14:23.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:14:23.930 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:14:23.930 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:14:23.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:14:23.930 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:14:23.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.931+0000 7f43ef98d640 1 -- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43cc06be30 msgr2=0x7f43cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.931+0000 7f43ef98d640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43cc06be30 0x7f43cc06e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f43e40012e0 tx=0x7f43e4001a30 comp rx=0 tx=0).stop 2024-09-11T22:14:23.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.931+0000 7f43ef98d640 1 -- 172.21.15.50:0/2100373087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815e870 msgr2=0x7f43e80ab6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:23.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.931+0000 7f43ef98d640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815e870 0x7f43e80ab6c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f43e000c410 tx=0x7f43e000c8d0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.931+0000 7f43ef98d640 1 -- 172.21.15.50:0/2100373087 shutdown_connections 2024-09-11T22:14:23.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.931+0000 7f43ef98d640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43cc06be30 0x7f43cc06e2f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.931+0000 7f43ef98d640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80d3a30 0x7f43e80ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.931+0000 7f43ef98d640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815e870 0x7f43e80ab6c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.931+0000 7f43ef98d640 1 --2- 172.21.15.50:0/2100373087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e80d18a0 0x7f43e80ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:23.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.931+0000 7f43ef98d640 1 -- 172.21.15.50:0/2100373087 >> 172.21.15.50:0/2100373087 conn(0x7f43e80727a0 msgr2=0x7f43e8160470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:23.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.931+0000 7f43ef98d640 1 -- 172.21.15.50:0/2100373087 shutdown_connections 2024-09-11T22:14:23.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:23.931+0000 7f43ef98d640 1 -- 172.21.15.50:0/2100373087 wait complete. 2024-09-11T22:14:23.942 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:14:23.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:14:24.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.047+0000 7fb85aeaf640 1 Processor -- start 2024-09-11T22:14:24.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.047+0000 7fb85aeaf640 1 -- start start 2024-09-11T22:14:24.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.048+0000 7fb85aeaf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb85415c680 0x7fb8540c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:24.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.048+0000 7fb85aeaf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb85415dd50 0x7fb85406e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:24.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.048+0000 7fb85aeaf640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8540c5e00 0x7fb85406e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.048+0000 7fb85aeaf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb8540b3fd0 con 0x7fb85415dd50 2024-09-11T22:14:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.048+0000 7fb85aeaf640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb85415ca60 con 0x7fb8540c5e00 2024-09-11T22:14:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.048+0000 7fb85aeaf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb8540c6380 con 0x7fb85415c680 2024-09-11T22:14:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.048+0000 7fb853fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb85415dd50 0x7fb85406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.048+0000 7fb853fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb85415dd50 0x7fb85406e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43910/0 (socket says 172.21.15.50:43910) 2024-09-11T22:14:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.048+0000 7fb853fff640 1 -- 172.21.15.50:0/872686171 learned_addr learned my addr 172.21.15.50:0/872686171 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.048+0000 7fb85944c640 1 --2- 172.21.15.50:0/872686171 >> v2:172.21.15.77:3300/0 conn(0x7fb8540c5e00 0x7fb85406e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.048+0000 7fb858c4b640 1 --2- 172.21.15.50:0/872686171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb85415c680 0x7fb8540c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.049+0000 7fb853fff640 1 -- 172.21.15.50:0/872686171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb85415c680 msgr2=0x7fb8540c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.049+0000 7fb853fff640 1 --2- 172.21.15.50:0/872686171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb85415c680 0x7fb8540c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.049+0000 7fb853fff640 1 -- 172.21.15.50:0/872686171 >> v2:172.21.15.77:3300/0 conn(0x7fb8540c5e00 msgr2=0x7fb85406e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.049+0000 7fb853fff640 1 --2- 172.21.15.50:0/872686171 >> v2:172.21.15.77:3300/0 conn(0x7fb8540c5e00 0x7fb85406e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.049+0000 7fb853fff640 1 -- 172.21.15.50:0/872686171 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8540b4220 con 0x7fb85415dd50 2024-09-11T22:14:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.049+0000 7fb853fff640 1 --2- 172.21.15.50:0/872686171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb85415dd50 0x7fb85406e160 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb8540d0480 tx=0x7fb84802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a7a98e423b5905 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.049+0000 7fb8537fe640 1 -- 172.21.15.50:0/872686171 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848037070 con 0x7fb85415dd50 2024-09-11T22:14:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.049+0000 7fb8537fe640 1 -- 172.21.15.50:0/872686171 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb848032440 con 0x7fb85415dd50 2024-09-11T22:14:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.049+0000 7fb8537fe640 1 -- 172.21.15.50:0/872686171 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848032810 con 0x7fb85415dd50 2024-09-11T22:14:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.050+0000 7fb85aeaf640 1 -- 172.21.15.50:0/872686171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb85415dd50 msgr2=0x7fb85406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.050+0000 7fb85aeaf640 1 --2- 172.21.15.50:0/872686171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb85415dd50 0x7fb85406e160 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb8540d0480 tx=0x7fb84802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:14:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.050+0000 7fb85aeaf640 1 -- 172.21.15.50:0/872686171 shutdown_connections 2024-09-11T22:14:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.050+0000 7fb85aeaf640 1 --2- 172.21.15.50:0/872686171 >> v2:172.21.15.77:3300/0 conn(0x7fb8540c5e00 0x7fb85406e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.050+0000 7fb85aeaf640 1 --2- 172.21.15.50:0/872686171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb85415dd50 0x7fb85406e160 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.050+0000 7fb85aeaf640 1 --2- 172.21.15.50:0/872686171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb85415c680 0x7fb8540c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:24.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.050+0000 7fb85aeaf640 1 -- 172.21.15.50:0/872686171 >> 172.21.15.50:0/872686171 conn(0x7fb854075270 msgr2=0x7fb8540679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:24.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.050+0000 7fb85aeaf640 1 -- 172.21.15.50:0/872686171 shutdown_connections 2024-09-11T22:14:24.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.050+0000 7fb85aeaf640 1 -- 172.21.15.50:0/872686171 wait complete. 2024-09-11T22:14:24.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.051+0000 7fb85aeaf640 1 Processor -- start 2024-09-11T22:14:24.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.051+0000 7fb85aeaf640 1 -- start start 2024-09-11T22:14:24.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.052+0000 7fb85aeaf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540c5e00 0x7fb854148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:24.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.052+0000 7fb85aeaf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85415c680 0x7fb8540cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:24.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.052+0000 7fb85aeaf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb85415dd50 0x7fb8540cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:24.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.052+0000 7fb85aeaf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb85415da90 con 0x7fb8540c5e00 2024-09-11T22:14:24.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.052+0000 7fb85aeaf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb8540b47e0 con 0x7fb85415c680 2024-09-11T22:14:24.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.052+0000 7fb85aeaf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb8540cf3a0 con 0x7fb85415dd50 2024-09-11T22:14:24.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.052+0000 7fb858c4b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540c5e00 0x7fb854148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.052+0000 7fb858c4b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540c5e00 0x7fb854148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43924/0 (socket says 172.21.15.50:43924) 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.052+0000 7fb858c4b640 1 -- 172.21.15.50:0/1793428775 learned_addr learned my addr 172.21.15.50:0/1793428775 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.052+0000 7fb853fff640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85415c680 0x7fb8540cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.052+0000 7fb85944c640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb85415dd50 0x7fb8540cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.053+0000 7fb858c4b640 1 -- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb85415dd50 msgr2=0x7fb8540cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.053+0000 7fb858c4b640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb85415dd50 0x7fb8540cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.053+0000 7fb858c4b640 1 -- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85415c680 msgr2=0x7fb8540cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.053+0000 7fb858c4b640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85415c680 0x7fb8540cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.053+0000 7fb858c4b640 1 -- 172.21.15.50:0/1793428775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb854151d10 con 0x7fb8540c5e00 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.053+0000 7fb85944c640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb85415dd50 0x7fb8540cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.053+0000 7fb858c4b640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540c5e00 0x7fb854148d60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb84c007f20 tx=0x7fb84c00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.053+0000 7fb8517fa640 1 -- 172.21.15.50:0/1793428775 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c014620 con 0x7fb8540c5e00 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.053+0000 7fb8517fa640 1 -- 172.21.15.50:0/1793428775 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c019070 con 0x7fb8540c5e00 2024-09-11T22:14:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.053+0000 7fb85aeaf640 1 -- 172.21.15.50:0/1793428775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb854150c70 con 0x7fb8540c5e00 2024-09-11T22:14:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.053+0000 7fb8517fa640 1 -- 172.21.15.50:0/1793428775 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c014a00 con 0x7fb8540c5e00 2024-09-11T22:14:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.053+0000 7fb85aeaf640 1 -- 172.21.15.50:0/1793428775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb854151230 con 0x7fb8540c5e00 2024-09-11T22:14:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.054+0000 7fb85aeaf640 1 -- 172.21.15.50:0/1793428775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8540c58c0 con 0x7fb8540c5e00 2024-09-11T22:14:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.054+0000 7fb8517fa640 1 -- 172.21.15.50:0/1793428775 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb84c014ba0 con 0x7fb8540c5e00 2024-09-11T22:14:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.055+0000 7fb8517fa640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb84006be30 0x7fb84006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.055+0000 7fb8517fa640 1 -- 172.21.15.50:0/1793428775 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4857+0+0 (secure 0 0 0) 0x7fb84c08b450 con 0x7fb8540c5e00 2024-09-11T22:14:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.055+0000 7fb853fff640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb84006be30 0x7fb84006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.056+0000 7fb853fff640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb84006be30 0x7fb84006e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb848034000 tx=0x7fb84802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.059+0000 7fb8517fa640 1 -- 172.21.15.50:0/1793428775 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb854151d10 con 0x7fb8540c5e00 2024-09-11T22:14:24.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.235+0000 7fb85aeaf640 1 -- 172.21.15.50:0/1793428775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb854071d00 con 0x7fb8540c5e00 2024-09-11T22:14:24.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.933+0000 7fb8517fa640 1 -- 172.21.15.50:0/1793428775 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v56) ==== 138+0+0 (secure 0 0 0) 0x7fb84c05a0b0 con 0x7fb8540c5e00 2024-09-11T22:14:24.934 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:14:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.937+0000 7fb85aeaf640 1 -- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb84006be30 msgr2=0x7fb84006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.937+0000 7fb85aeaf640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb84006be30 0x7fb84006e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb848034000 tx=0x7fb84802e000 comp rx=0 tx=0).stop 2024-09-11T22:14:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.937+0000 7fb85aeaf640 1 -- 172.21.15.50:0/1793428775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540c5e00 msgr2=0x7fb854148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.937+0000 7fb85aeaf640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540c5e00 0x7fb854148d60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb84c007f20 tx=0x7fb84c00e570 comp rx=0 tx=0).stop 2024-09-11T22:14:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.937+0000 7fb85aeaf640 1 -- 172.21.15.50:0/1793428775 shutdown_connections 2024-09-11T22:14:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.937+0000 7fb85aeaf640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb84006be30 0x7fb84006e2f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.937+0000 7fb85aeaf640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb85415dd50 0x7fb8540cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.937+0000 7fb85aeaf640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85415c680 0x7fb8540cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.937+0000 7fb85aeaf640 1 --2- 172.21.15.50:0/1793428775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8540c5e00 0x7fb854148d60 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:24.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.937+0000 7fb85aeaf640 1 -- 172.21.15.50:0/1793428775 >> 172.21.15.50:0/1793428775 conn(0x7fb854075270 msgr2=0x7fb85415cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:24.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.937+0000 7fb85aeaf640 1 -- 172.21.15.50:0/1793428775 shutdown_connections 2024-09-11T22:14:24.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:24.937+0000 7fb85aeaf640 1 -- 172.21.15.50:0/1793428775 wait complete. 2024-09-11T22:14:24.953 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:14:25.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.067+0000 7fd46b198640 1 Processor -- start 2024-09-11T22:14:25.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.067+0000 7fd46b198640 1 -- start start 2024-09-11T22:14:25.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.068+0000 7fd46b198640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd46415e870 0x7fd4640d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:25.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.068+0000 7fd46b198640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4640cfa80 con 0x7fd4640d16d0 2024-09-11T22:14:25.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.068+0000 7fd46b198640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4640d40d0 con 0x7fd4640d3c00 2024-09-11T22:14:25.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.068+0000 7fd46b198640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd4640d1b10 con 0x7fd46415e870 2024-09-11T22:14:25.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.068+0000 7fd463fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd4640d16d0 0x7fd4640d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42206/0 (socket says 172.21.15.50:42206) 2024-09-11T22:14:25.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.068+0000 7fd463fff640 1 -- 172.21.15.50:0/3464642708 learned_addr learned my addr 172.21.15.50:0/3464642708 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd468f34640 1 --2- 172.21.15.50:0/3464642708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd46415e870 0x7fd4640d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2522562031 0 0) 0x7fd458001110 con 0x7fd4640d16d0 2024-09-11T22:14:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd44c003520 con 0x7fd4640d16d0 2024-09-11T22:14:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3861086664 0 0) 0x7fd44c003520 con 0x7fd4640d16d0 2024-09-11T22:14:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd46415e870 msgr2=0x7fd4640d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 --2- 172.21.15.50:0/3464642708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd46415e870 0x7fd4640d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 >> v1:172.21.15.77:6789/0 conn(0x7fd4640d3c00 legacy=0x7fd4640b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4640d43b0 con 0x7fd4640d16d0 2024-09-11T22:14:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fd458001860 con 0x7fd4640d16d0 2024-09-11T22:14:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 >> v1:172.21.15.50:6789/0 conn(0x7fd4640d16d0 legacy=0x7fd4640d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 --2- 172.21.15.50:0/3464642708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd46415e870 0x7fd44c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 --2- 172.21.15.50:0/3464642708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd44c003f60 0x7fd44c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:25.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 --2- 172.21.15.50:0/3464642708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd44c004d40 0x7fd44c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd4640d1b10 con 0x7fd44c003f60 2024-09-11T22:14:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c00baa0 con 0x7fd44c004d40 2024-09-11T22:14:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd44c00bca0 con 0x7fd46415e870 2024-09-11T22:14:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd463fff640 1 --2- 172.21.15.50:0/3464642708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd44c003f60 0x7fd44c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd468f34640 1 --2- 172.21.15.50:0/3464642708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd46415e870 0x7fd44c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd469735640 1 --2- 172.21.15.50:0/3464642708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd44c004d40 0x7fd44c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd463fff640 1 -- 172.21.15.50:0/3464642708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd46415e870 msgr2=0x7fd44c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd463fff640 1 --2- 172.21.15.50:0/3464642708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd46415e870 0x7fd44c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd463fff640 1 -- 172.21.15.50:0/3464642708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd44c004d40 msgr2=0x7fd44c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.069+0000 7fd463fff640 1 --2- 172.21.15.50:0/3464642708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd44c004d40 0x7fd44c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.070+0000 7fd463fff640 1 -- 172.21.15.50:0/3464642708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c003520 con 0x7fd44c003f60 2024-09-11T22:14:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.070+0000 7fd463fff640 1 --2- 172.21.15.50:0/3464642708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd44c003f60 0x7fd44c004800 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd4640b41b0 tx=0x7fd44c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd46fd414a2d3a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.070+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45800c0e0 con 0x7fd44c003f60 2024-09-11T22:14:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.070+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd458034070 con 0x7fd44c003f60 2024-09-11T22:14:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.070+0000 7fd4637fe640 1 -- 172.21.15.50:0/3464642708 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458005d10 con 0x7fd44c003f60 2024-09-11T22:14:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.071+0000 7fd46b198640 1 -- 172.21.15.50:0/3464642708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd44c003f60 msgr2=0x7fd44c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.071+0000 7fd46b198640 1 --2- 172.21.15.50:0/3464642708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd44c003f60 0x7fd44c004800 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd4640b41b0 tx=0x7fd44c005830 comp rx=0 tx=0).stop 2024-09-11T22:14:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.071+0000 7fd469735640 1 -- 172.21.15.50:0/3464642708 reap_dead start 2024-09-11T22:14:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.071+0000 7fd46b198640 1 -- 172.21.15.50:0/3464642708 shutdown_connections 2024-09-11T22:14:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.071+0000 7fd46b198640 1 -- 172.21.15.50:0/3464642708 >> 172.21.15.50:0/3464642708 conn(0x7fd4640727a0 msgr2=0x7fd4640679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.071+0000 7fd46b198640 1 -- 172.21.15.50:0/3464642708 shutdown_connections 2024-09-11T22:14:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.071+0000 7fd46b198640 1 -- 172.21.15.50:0/3464642708 wait complete. 2024-09-11T22:14:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.072+0000 7fd46b198640 1 Processor -- start 2024-09-11T22:14:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.072+0000 7fd46b198640 1 -- start start 2024-09-11T22:14:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd46b198640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd44c003f60 0x7fd46415b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd46b198640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4641579e0 0x7fd464154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd46b198640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd464157e60 0x7fd464154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd46b198640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd46415ec50 con 0x7fd4641579e0 2024-09-11T22:14:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd46b198640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4640b7ee0 con 0x7fd464157e60 2024-09-11T22:14:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd46b198640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd4640b78b0 con 0x7fd44c003f60 2024-09-11T22:14:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd463fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4641579e0 0x7fd464154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd463fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4641579e0 0x7fd464154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43942/0 (socket says 172.21.15.50:43942) 2024-09-11T22:14:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd463fff640 1 -- 172.21.15.50:0/194428691 learned_addr learned my addr 172.21.15.50:0/194428691 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd468f34640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd44c003f60 0x7fd46415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:25.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd469735640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd464157e60 0x7fd464154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:25.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd463fff640 1 -- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd44c003f60 msgr2=0x7fd46415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:25.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd463fff640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd44c003f60 0x7fd46415b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:25.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd463fff640 1 -- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd464157e60 msgr2=0x7fd464154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:25.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.073+0000 7fd463fff640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd464157e60 0x7fd464154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:25.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.074+0000 7fd463fff640 1 -- 172.21.15.50:0/194428691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4640ccc00 con 0x7fd4641579e0 2024-09-11T22:14:25.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.074+0000 7fd463fff640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4641579e0 0x7fd464154330 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c580 tx=0x7fd4640d4580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:25.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.074+0000 7fd4617fa640 1 -- 172.21.15.50:0/194428691 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458007270 con 0x7fd4641579e0 2024-09-11T22:14:25.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.074+0000 7fd4617fa640 1 -- 172.21.15.50:0/194428691 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd458005e50 con 0x7fd4641579e0 2024-09-11T22:14:25.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.074+0000 7fd46b198640 1 -- 172.21.15.50:0/194428691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd464155de0 con 0x7fd4641579e0 2024-09-11T22:14:25.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.074+0000 7fd4617fa640 1 -- 172.21.15.50:0/194428691 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458007670 con 0x7fd4641579e0 2024-09-11T22:14:25.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.074+0000 7fd46b198640 1 -- 172.21.15.50:0/194428691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4641563a0 con 0x7fd4641579e0 2024-09-11T22:14:25.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.075+0000 7fd46b198640 1 -- 172.21.15.50:0/194428691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4640d1190 con 0x7fd4641579e0 2024-09-11T22:14:25.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.075+0000 7fd4617fa640 1 -- 172.21.15.50:0/194428691 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd45802e070 con 0x7fd4641579e0 2024-09-11T22:14:25.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.076+0000 7fd4617fa640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd45006be60 0x7fd45006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:25.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.076+0000 7fd4617fa640 1 -- 172.21.15.50:0/194428691 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5227+0+0 (secure 0 0 0) 0x7fd4580ab7e0 con 0x7fd4641579e0 2024-09-11T22:14:25.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.076+0000 7fd468f34640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd45006be60 0x7fd45006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:25.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.077+0000 7fd468f34640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd45006be60 0x7fd45006e320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd454009bc0 tx=0x7fd454009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:25.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.081+0000 7fd4617fa640 1 -- 172.21.15.50:0/194428691 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4640ccc00 con 0x7fd4641579e0 2024-09-11T22:14:25.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.259+0000 7fd46b198640 1 -- 172.21.15.50:0/194428691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd4640b8300 con 0x7fd4641579e0 2024-09-11T22:14:25.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.938+0000 7fd4617fa640 1 -- 172.21.15.50:0/194428691 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v57) ==== 170+0+0 (secure 0 0 0) 0x7fd458080030 con 0x7fd4641579e0 2024-09-11T22:14:25.939 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:14:25.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.942+0000 7fd46b198640 1 -- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd45006be60 msgr2=0x7fd45006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:25.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.942+0000 7fd46b198640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd45006be60 0x7fd45006e320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd454009bc0 tx=0x7fd454009190 comp rx=0 tx=0).stop 2024-09-11T22:14:25.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.942+0000 7fd46b198640 1 -- 172.21.15.50:0/194428691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4641579e0 msgr2=0x7fd464154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:25.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.942+0000 7fd46b198640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4641579e0 0x7fd464154330 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c580 tx=0x7fd4640d4580 comp rx=0 tx=0).stop 2024-09-11T22:14:25.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.942+0000 7fd46b198640 1 -- 172.21.15.50:0/194428691 shutdown_connections 2024-09-11T22:14:25.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.943+0000 7fd46b198640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd45006be60 0x7fd45006e320 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:25.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.943+0000 7fd46b198640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd464157e60 0x7fd464154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:25.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.943+0000 7fd46b198640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4641579e0 0x7fd464154330 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:25.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.943+0000 7fd46b198640 1 --2- 172.21.15.50:0/194428691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd44c003f60 0x7fd46415b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:25.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.943+0000 7fd46b198640 1 -- 172.21.15.50:0/194428691 >> 172.21.15.50:0/194428691 conn(0x7fd4640727a0 msgr2=0x7fd4640b6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:25.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.943+0000 7fd46b198640 1 -- 172.21.15.50:0/194428691 shutdown_connections 2024-09-11T22:14:25.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:25.943+0000 7fd46b198640 1 -- 172.21.15.50:0/194428691 wait complete. 2024-09-11T22:14:25.970 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:14:26.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.080+0000 7ffb26786640 1 Processor -- start 2024-09-11T22:14:26.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.080+0000 7ffb26786640 1 -- start start 2024-09-11T22:14:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.081+0000 7ffb26786640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffb2015c240 0x7ffb200b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.081+0000 7ffb26786640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb200735a0 0x7ffb2015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.081+0000 7ffb26786640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb2015c620 con 0x7ffb2015f0e0 2024-09-11T22:14:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.081+0000 7ffb26786640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ffb2015f560 con 0x7ffb2015c240 2024-09-11T22:14:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.081+0000 7ffb26786640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffb2015f840 con 0x7ffb200735a0 2024-09-11T22:14:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.081+0000 7ffb1ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffb2015c240 0x7ffb200b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.081+0000 7ffb24d23640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffb2015f0e0 0x7ffb200728e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42218/0 (socket says 172.21.15.50:42218) 2024-09-11T22:14:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.081+0000 7ffb24d23640 1 -- 172.21.15.50:0/3994304926 learned_addr learned my addr 172.21.15.50:0/3994304926 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.082+0000 7ffb1f7fe640 1 --2- 172.21.15.50:0/3994304926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb200735a0 0x7ffb2015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.082+0000 7ffb1ffff640 1 -- 172.21.15.50:0/3994304926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb200735a0 msgr2=0x7ffb2015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.082+0000 7ffb1ffff640 1 --2- 172.21.15.50:0/3994304926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb200735a0 0x7ffb2015eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.082+0000 7ffb1ffff640 1 -- 172.21.15.50:0/3994304926 >> v1:172.21.15.50:6789/0 conn(0x7ffb2015f0e0 legacy=0x7ffb200728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:26.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.082+0000 7ffb1effd640 1 -- 172.21.15.50:0/3994304926 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 292391753 0 0) 0x7ffb2015c620 con 0x7ffb2015f0e0 2024-09-11T22:14:26.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.082+0000 7ffb1ffff640 1 -- 172.21.15.50:0/3994304926 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2015fb20 con 0x7ffb2015c240 2024-09-11T22:14:26.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.082+0000 7ffb1f7fe640 1 --2- 172.21.15.50:0/3994304926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb200735a0 0x7ffb2015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.083+0000 7ffb1ffff640 1 --2- 172.21.15.50:0/3994304926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2015c240 0x7ffb200b4770 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ffb100097a0 tx=0x7ffb1002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bff1700e082ea21 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.083+0000 7ffb1effd640 1 -- 172.21.15.50:0/3994304926 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10037070 con 0x7ffb2015c240 2024-09-11T22:14:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.083+0000 7ffb1effd640 1 -- 172.21.15.50:0/3994304926 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb10032440 con 0x7ffb2015c240 2024-09-11T22:14:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.083+0000 7ffb1effd640 1 -- 172.21.15.50:0/3994304926 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10032810 con 0x7ffb2015c240 2024-09-11T22:14:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.083+0000 7ffb26786640 1 -- 172.21.15.50:0/3994304926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2015c240 msgr2=0x7ffb200b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.083+0000 7ffb26786640 1 --2- 172.21.15.50:0/3994304926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2015c240 0x7ffb200b4770 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ffb100097a0 tx=0x7ffb1002a180 comp rx=0 tx=0).stop 2024-09-11T22:14:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.083+0000 7ffb26786640 1 -- 172.21.15.50:0/3994304926 shutdown_connections 2024-09-11T22:14:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.083+0000 7ffb26786640 1 --2- 172.21.15.50:0/3994304926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb200735a0 0x7ffb2015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.083+0000 7ffb26786640 1 --2- 172.21.15.50:0/3994304926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2015c240 0x7ffb200b4770 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.083+0000 7ffb26786640 1 -- 172.21.15.50:0/3994304926 >> 172.21.15.50:0/3994304926 conn(0x7ffb200b2bd0 msgr2=0x7ffb200b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.083+0000 7ffb26786640 1 -- 172.21.15.50:0/3994304926 shutdown_connections 2024-09-11T22:14:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.083+0000 7ffb26786640 1 -- 172.21.15.50:0/3994304926 wait complete. 2024-09-11T22:14:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.085+0000 7ffb26786640 1 Processor -- start 2024-09-11T22:14:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.085+0000 7ffb26786640 1 -- start start 2024-09-11T22:14:26.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.085+0000 7ffb26786640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb200735a0 0x7ffb20154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:26.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.085+0000 7ffb26786640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb2015c240 0x7ffb201e94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:26.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.085+0000 7ffb26786640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2015f0e0 0x7ffb20153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:26.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.085+0000 7ffb26786640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb200b4cb0 con 0x7ffb2015f0e0 2024-09-11T22:14:26.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.085+0000 7ffb26786640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb200b4250 con 0x7ffb200735a0 2024-09-11T22:14:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb26786640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffb200b4e30 con 0x7ffb2015c240 2024-09-11T22:14:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb24d23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2015f0e0 0x7ffb20153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb24d23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2015f0e0 0x7ffb20153930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43962/0 (socket says 172.21.15.50:43962) 2024-09-11T22:14:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb24d23640 1 -- 172.21.15.50:0/1000197388 learned_addr learned my addr 172.21.15.50:0/1000197388 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb1ffff640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb200735a0 0x7ffb20154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb1f7fe640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb2015c240 0x7ffb201e94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb24d23640 1 -- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb2015c240 msgr2=0x7ffb201e94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb24d23640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb2015c240 0x7ffb201e94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb24d23640 1 -- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb200735a0 msgr2=0x7ffb20154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb24d23640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb200735a0 0x7ffb20154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb24d23640 1 -- 172.21.15.50:0/1000197388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb201e9a10 con 0x7ffb2015f0e0 2024-09-11T22:14:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb24d23640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2015f0e0 0x7ffb20153930 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ffb18001560 tx=0x7ffb1800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:26.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb1cff9640 1 -- 172.21.15.50:0/1000197388 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18018070 con 0x7ffb2015f0e0 2024-09-11T22:14:26.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb1cff9640 1 -- 172.21.15.50:0/1000197388 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb1800a640 con 0x7ffb2015f0e0 2024-09-11T22:14:26.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb26786640 1 -- 172.21.15.50:0/1000197388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb201e9c90 con 0x7ffb2015f0e0 2024-09-11T22:14:26.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb1cff9640 1 -- 172.21.15.50:0/1000197388 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1800aa10 con 0x7ffb2015f0e0 2024-09-11T22:14:26.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.086+0000 7ffb26786640 1 -- 172.21.15.50:0/1000197388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb201ea250 con 0x7ffb2015f0e0 2024-09-11T22:14:26.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.087+0000 7ffb26786640 1 -- 172.21.15.50:0/1000197388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb201ea490 con 0x7ffb2015f0e0 2024-09-11T22:14:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.088+0000 7ffb1cff9640 1 -- 172.21.15.50:0/1000197388 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb1801b070 con 0x7ffb2015f0e0 2024-09-11T22:14:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.088+0000 7ffb1cff9640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffb0c06be30 0x7ffb0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.088+0000 7ffb1cff9640 1 -- 172.21.15.50:0/1000197388 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5609+0+0 (secure 0 0 0) 0x7ffb1808a390 con 0x7ffb2015f0e0 2024-09-11T22:14:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.089+0000 7ffb1ffff640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffb0c06be30 0x7ffb0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.089+0000 7ffb1ffff640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffb0c06be30 0x7ffb0c06e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffb10034000 tx=0x7ffb1002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:26.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.093+0000 7ffb1cff9640 1 -- 172.21.15.50:0/1000197388 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb201ea490 con 0x7ffb2015f0e0 2024-09-11T22:14:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.304+0000 7ffb26786640 1 -- 172.21.15.50:0/1000197388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ffb2006f390 con 0x7ffb2015f0e0 2024-09-11T22:14:26.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.939+0000 7ffb1cff9640 1 -- 172.21.15.50:0/1000197388 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v30) ==== 172+0+0 (secure 0 0 0) 0x7ffb201e9a10 con 0x7ffb2015f0e0 2024-09-11T22:14:26.940 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 8 and data pool 9 2024-09-11T22:14:26.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.942+0000 7ffb26786640 1 -- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffb0c06be30 msgr2=0x7ffb0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:26.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.942+0000 7ffb26786640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffb0c06be30 0x7ffb0c06e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffb10034000 tx=0x7ffb1002e000 comp rx=0 tx=0).stop 2024-09-11T22:14:26.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.942+0000 7ffb26786640 1 -- 172.21.15.50:0/1000197388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2015f0e0 msgr2=0x7ffb20153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:26.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.942+0000 7ffb26786640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2015f0e0 0x7ffb20153930 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ffb18001560 tx=0x7ffb1800cc70 comp rx=0 tx=0).stop 2024-09-11T22:14:26.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.942+0000 7ffb26786640 1 -- 172.21.15.50:0/1000197388 shutdown_connections 2024-09-11T22:14:26.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.942+0000 7ffb26786640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffb0c06be30 0x7ffb0c06e2f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:26.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.943+0000 7ffb26786640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb2015c240 0x7ffb201e94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:26.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.943+0000 7ffb26786640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2015f0e0 0x7ffb20153930 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:26.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.943+0000 7ffb26786640 1 --2- 172.21.15.50:0/1000197388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb200735a0 0x7ffb20154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:26.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.943+0000 7ffb26786640 1 -- 172.21.15.50:0/1000197388 >> 172.21.15.50:0/1000197388 conn(0x7ffb200b2bd0 msgr2=0x7ffb2006e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:26.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.943+0000 7ffb26786640 1 -- 172.21.15.50:0/1000197388 shutdown_connections 2024-09-11T22:14:26.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:26.943+0000 7ffb26786640 1 -- 172.21.15.50:0/1000197388 wait complete. 2024-09-11T22:14:26.973 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:14:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.077+0000 7f3696e74640 1 Processor -- start 2024-09-11T22:14:27.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.077+0000 7f3696e74640 1 -- start start 2024-09-11T22:14:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.077+0000 7f3696e74640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f369006bb50 0x7f369015f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.077+0000 7f3696e74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f36900b6d90 0x7f36900b7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.077+0000 7f3696e74640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36900b5fd0 con 0x7f369015e9b0 2024-09-11T22:14:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.077+0000 7f3696e74640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f36900b6900 con 0x7f36900b6d90 2024-09-11T22:14:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.077+0000 7f3696e74640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f36900b62b0 con 0x7f369006bb50 2024-09-11T22:14:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.078+0000 7f368ffff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f369006bb50 0x7f369015f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.078+0000 7f3695411640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f36900b6d90 0x7f36900b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.078+0000 7f3694c10640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f369015e9b0 0x7f36900af3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:48772/0 (socket says 172.21.15.50:48772) 2024-09-11T22:14:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.078+0000 7f368ffff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f369006bb50 0x7f369015f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:49026/0 (socket says 172.21.15.50:49026) 2024-09-11T22:14:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.078+0000 7f3695411640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f36900b6d90 0x7f36900b7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:52732/0 (socket says 172.21.15.50:52732) 2024-09-11T22:14:27.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.078+0000 7f368ffff640 1 -- 172.21.15.50:0/2417481458 learned_addr learned my addr 172.21.15.50:0/2417481458 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:27.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.078+0000 7f368f7fe640 1 -- 172.21.15.50:0/2417481458 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449511949 0 0) 0x7f36900b5fd0 con 0x7f369015e9b0 2024-09-11T22:14:27.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.078+0000 7f368f7fe640 1 -- 172.21.15.50:0/2417481458 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f367c003520 con 0x7f369015e9b0 2024-09-11T22:14:27.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.078+0000 7f368ffff640 1 -- 172.21.15.50:0/2417481458 >> v2:172.21.15.77:3300/0 conn(0x7f36900b6d90 msgr2=0x7f36900b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:27.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.078+0000 7f368ffff640 1 --2- 172.21.15.50:0/2417481458 >> v2:172.21.15.77:3300/0 conn(0x7f36900b6d90 0x7f36900b7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.078+0000 7f368ffff640 1 -- 172.21.15.50:0/2417481458 >> v1:172.21.15.77:6789/0 conn(0x7f369015e9b0 legacy=0x7f36900af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.078+0000 7f368ffff640 1 -- 172.21.15.50:0/2417481458 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36900b6590 con 0x7f369006bb50 2024-09-11T22:14:27.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.078+0000 7f3695411640 1 --2- 172.21.15.50:0/2417481458 >> v2:172.21.15.77:3300/0 conn(0x7f36900b6d90 0x7f36900b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:27.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.079+0000 7f368ffff640 1 --2- 172.21.15.50:0/2417481458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f369006bb50 0x7f369015f820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3678009e50 tx=0x7f367802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1795e6ac065f0b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:27.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.079+0000 7f368f7fe640 1 -- 172.21.15.50:0/2417481458 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3678036070 con 0x7f369006bb50 2024-09-11T22:14:27.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.079+0000 7f368f7fe640 1 -- 172.21.15.50:0/2417481458 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3678031600 con 0x7f369006bb50 2024-09-11T22:14:27.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.079+0000 7f368f7fe640 1 -- 172.21.15.50:0/2417481458 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36780319d0 con 0x7f369006bb50 2024-09-11T22:14:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.080+0000 7f3696e74640 1 -- 172.21.15.50:0/2417481458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f369006bb50 msgr2=0x7f369015f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.080+0000 7f3696e74640 1 --2- 172.21.15.50:0/2417481458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f369006bb50 0x7f369015f820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3678009e50 tx=0x7f367802a710 comp rx=0 tx=0).stop 2024-09-11T22:14:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.080+0000 7f3696e74640 1 -- 172.21.15.50:0/2417481458 shutdown_connections 2024-09-11T22:14:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.080+0000 7f3696e74640 1 --2- 172.21.15.50:0/2417481458 >> v2:172.21.15.77:3300/0 conn(0x7f36900b6d90 0x7f36900b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.080+0000 7f3696e74640 1 --2- 172.21.15.50:0/2417481458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f369006bb50 0x7f369015f820 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.080+0000 7f3696e74640 1 -- 172.21.15.50:0/2417481458 >> 172.21.15.50:0/2417481458 conn(0x7f36900b7940 msgr2=0x7f36900b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.080+0000 7f3696e74640 1 -- 172.21.15.50:0/2417481458 shutdown_connections 2024-09-11T22:14:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.080+0000 7f3696e74640 1 -- 172.21.15.50:0/2417481458 wait complete. 2024-09-11T22:14:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.081+0000 7f3696e74640 1 Processor -- start 2024-09-11T22:14:27.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.081+0000 7f3696e74640 1 -- start start 2024-09-11T22:14:27.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3696e74640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369006bb50 0x7f36901577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3696e74640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f36900b6d90 0x7f3690162850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3696e74640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3690162d90 0x7f369015d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3696e74640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f369006d310 con 0x7f3690162d90 2024-09-11T22:14:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3696e74640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f369015feb0 con 0x7f369006bb50 2024-09-11T22:14:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3696e74640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f369006d490 con 0x7f36900b6d90 2024-09-11T22:14:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3695411640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3690162d90 0x7f369015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3695411640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3690162d90 0x7f369015d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43966/0 (socket says 172.21.15.50:43966) 2024-09-11T22:14:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3695411640 1 -- 172.21.15.50:0/246914812 learned_addr learned my addr 172.21.15.50:0/246914812 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3694c10640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369006bb50 0x7f36901577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f368ffff640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f36900b6d90 0x7f3690162850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3695411640 1 -- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f36900b6d90 msgr2=0x7f3690162850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3695411640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f36900b6d90 0x7f3690162850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3695411640 1 -- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369006bb50 msgr2=0x7f36901577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3695411640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369006bb50 0x7f36901577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3695411640 1 -- 172.21.15.50:0/246914812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36901617b0 con 0x7f3690162d90 2024-09-11T22:14:27.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.082+0000 7f3695411640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3690162d90 0x7f369015d8c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f368800e960 tx=0x7f368800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:27.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.083+0000 7f368d7fa640 1 -- 172.21.15.50:0/246914812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3688017070 con 0x7f3690162d90 2024-09-11T22:14:27.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.083+0000 7f368d7fa640 1 -- 172.21.15.50:0/246914812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3688004020 con 0x7f3690162d90 2024-09-11T22:14:27.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.083+0000 7f3696e74640 1 -- 172.21.15.50:0/246914812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3690161a90 con 0x7f3690162d90 2024-09-11T22:14:27.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.083+0000 7f368d7fa640 1 -- 172.21.15.50:0/246914812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36880043f0 con 0x7f3690162d90 2024-09-11T22:14:27.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.083+0000 7f3696e74640 1 -- 172.21.15.50:0/246914812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3690162050 con 0x7f3690162d90 2024-09-11T22:14:27.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.084+0000 7f3696e74640 1 -- 172.21.15.50:0/246914812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f369015f820 con 0x7f3690162d90 2024-09-11T22:14:27.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.084+0000 7f368d7fa640 1 -- 172.21.15.50:0/246914812 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f368800ca00 con 0x7f3690162d90 2024-09-11T22:14:27.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.085+0000 7f368d7fa640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f367006be30 0x7f367006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.085+0000 7f368d7fa640 1 -- 172.21.15.50:0/246914812 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f368808b010 con 0x7f3690162d90 2024-09-11T22:14:27.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.085+0000 7f3694c10640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f367006be30 0x7f367006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.085+0000 7f3694c10640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f367006be30 0x7f367006e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3680000f60 tx=0x7f3680007cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:27.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.089+0000 7f368d7fa640 1 -- 172.21.15.50:0/246914812 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3688059380 con 0x7f3690162d90 2024-09-11T22:14:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.269+0000 7f3696e74640 1 -- 172.21.15.50:0/246914812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36900b0ec0 con 0x7f3690162d90 2024-09-11T22:14:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.270+0000 7f368d7fa640 1 -- 172.21.15.50:0/246914812 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16702 (secure 0 0 0) 0x7f368805d680 con 0x7f3690162d90 2024-09-11T22:14:27.273 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:27.273 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":58,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:14:26.306154+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:14:24.266096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-11T22:14:25.290643+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:14:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.272+0000 7f3696e74640 1 -- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f367006be30 msgr2=0x7f367006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.272+0000 7f3696e74640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f367006be30 0x7f367006e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3680000f60 tx=0x7f3680007cf0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.272+0000 7f3696e74640 1 -- 172.21.15.50:0/246914812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3690162d90 msgr2=0x7f369015d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.272+0000 7f3696e74640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3690162d90 0x7f369015d8c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f368800e960 tx=0x7f368800ee20 comp rx=0 tx=0).stop 2024-09-11T22:14:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.272+0000 7f3696e74640 1 -- 172.21.15.50:0/246914812 shutdown_connections 2024-09-11T22:14:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.272+0000 7f3696e74640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f367006be30 0x7f367006e2f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.272+0000 7f3696e74640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f36900b6d90 0x7f3690162850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.272+0000 7f3696e74640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3690162d90 0x7f369015d8c0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.272+0000 7f3696e74640 1 --2- 172.21.15.50:0/246914812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369006bb50 0x7f36901577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.272+0000 7f3696e74640 1 -- 172.21.15.50:0/246914812 >> 172.21.15.50:0/246914812 conn(0x7f36900b7940 msgr2=0x7f369006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.272+0000 7f3696e74640 1 -- 172.21.15.50:0/246914812 shutdown_connections 2024-09-11T22:14:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.272+0000 7f3696e74640 1 -- 172.21.15.50:0/246914812 wait complete. 2024-09-11T22:14:27.284 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:14:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.386+0000 7f41a3ee6640 1 Processor -- start 2024-09-11T22:14:27.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.386+0000 7f41a3ee6640 1 -- start start 2024-09-11T22:14:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a3ee6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f419c15b430 0x7f419c15f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a3ee6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f419c06f390 0x7f419c0b3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a3ee6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f419c0b3880 0x7f419c072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a3ee6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f419c0b3cf0 con 0x7f419c15b430 2024-09-11T22:14:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a3ee6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f419c15c750 con 0x7f419c06f390 2024-09-11T22:14:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a3ee6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f419c15fe70 con 0x7f419c0b3880 2024-09-11T22:14:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a1c82640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f419c15b430 0x7f419c15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a1c82640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f419c15b430 0x7f419c15f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43976/0 (socket says 172.21.15.50:43976) 2024-09-11T22:14:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a1c82640 1 -- 172.21.15.50:0/4104151361 learned_addr learned my addr 172.21.15.50:0/4104151361 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a1481640 1 --2- 172.21.15.50:0/4104151361 >> v2:172.21.15.77:3300/0 conn(0x7f419c06f390 0x7f419c0b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a2483640 1 --2- 172.21.15.50:0/4104151361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f419c0b3880 0x7f419c072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a1c82640 1 -- 172.21.15.50:0/4104151361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f419c0b3880 msgr2=0x7f419c072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a1c82640 1 --2- 172.21.15.50:0/4104151361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f419c0b3880 0x7f419c072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a1c82640 1 -- 172.21.15.50:0/4104151361 >> v2:172.21.15.77:3300/0 conn(0x7f419c06f390 msgr2=0x7f419c0b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a1c82640 1 --2- 172.21.15.50:0/4104151361 >> v2:172.21.15.77:3300/0 conn(0x7f419c06f390 0x7f419c0b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.387+0000 7f41a1c82640 1 -- 172.21.15.50:0/4104151361 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419c15bb40 con 0x7f419c15b430 2024-09-11T22:14:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.388+0000 7f41a1c82640 1 --2- 172.21.15.50:0/4104151361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c15b430 0x7f419c15f930 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f419c06ee70 tx=0x7f419802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437435d6f725e0f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.388+0000 7f41a0c80640 1 -- 172.21.15.50:0/4104151361 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4198037070 con 0x7f419c15b430 2024-09-11T22:14:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.388+0000 7f41a0c80640 1 -- 172.21.15.50:0/4104151361 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4198032440 con 0x7f419c15b430 2024-09-11T22:14:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.388+0000 7f41a0c80640 1 -- 172.21.15.50:0/4104151361 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4198032810 con 0x7f419c15b430 2024-09-11T22:14:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.389+0000 7f41a3ee6640 1 -- 172.21.15.50:0/4104151361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c15b430 msgr2=0x7f419c15f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.389+0000 7f41a3ee6640 1 --2- 172.21.15.50:0/4104151361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c15b430 0x7f419c15f930 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f419c06ee70 tx=0x7f419802a140 comp rx=0 tx=0).stop 2024-09-11T22:14:27.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.389+0000 7f41a3ee6640 1 -- 172.21.15.50:0/4104151361 shutdown_connections 2024-09-11T22:14:27.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.389+0000 7f41a3ee6640 1 --2- 172.21.15.50:0/4104151361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f419c0b3880 0x7f419c072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.389+0000 7f41a3ee6640 1 --2- 172.21.15.50:0/4104151361 >> v2:172.21.15.77:3300/0 conn(0x7f419c06f390 0x7f419c0b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.389+0000 7f41a3ee6640 1 --2- 172.21.15.50:0/4104151361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c15b430 0x7f419c15f930 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.389+0000 7f41a3ee6640 1 -- 172.21.15.50:0/4104151361 >> 172.21.15.50:0/4104151361 conn(0x7f419c074c40 msgr2=0x7f419c075020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:27.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.389+0000 7f41a3ee6640 1 -- 172.21.15.50:0/4104151361 shutdown_connections 2024-09-11T22:14:27.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.389+0000 7f41a3ee6640 1 -- 172.21.15.50:0/4104151361 wait complete. 2024-09-11T22:14:27.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.390+0000 7f41a3ee6640 1 Processor -- start 2024-09-11T22:14:27.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.390+0000 7f41a3ee6640 1 -- start start 2024-09-11T22:14:27.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a3ee6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f419c06f390 0x7f419c14e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a3ee6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0b3880 0x7f419c14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a3ee6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f419c15b430 0x7f419c14f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a3ee6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f419c15c3e0 con 0x7f419c0b3880 2024-09-11T22:14:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a3ee6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f419c15c100 con 0x7f419c06f390 2024-09-11T22:14:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a3ee6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f419c15b810 con 0x7f419c15b430 2024-09-11T22:14:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a1481640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0b3880 0x7f419c14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a1481640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0b3880 0x7f419c14efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43982/0 (socket says 172.21.15.50:43982) 2024-09-11T22:14:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a1481640 1 -- 172.21.15.50:0/426862121 learned_addr learned my addr 172.21.15.50:0/426862121 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a1c82640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f419c06f390 0x7f419c14e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a2483640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f419c15b430 0x7f419c14f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a1481640 1 -- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f419c15b430 msgr2=0x7f419c14f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a1481640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f419c15b430 0x7f419c14f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a1481640 1 -- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f419c06f390 msgr2=0x7f419c14e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a1481640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f419c06f390 0x7f419c14e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a1481640 1 -- 172.21.15.50:0/426862121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419c14d8c0 con 0x7f419c0b3880 2024-09-11T22:14:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a2483640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f419c15b430 0x7f419c14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.391+0000 7f41a1481640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0b3880 0x7f419c14efe0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f418c00e890 tx=0x7f418c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.392+0000 7f41927fc640 1 -- 172.21.15.50:0/426862121 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c017070 con 0x7f419c0b3880 2024-09-11T22:14:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.392+0000 7f41927fc640 1 -- 172.21.15.50:0/426862121 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c00c940 con 0x7f419c0b3880 2024-09-11T22:14:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.392+0000 7f41a3ee6640 1 -- 172.21.15.50:0/426862121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419c14dba0 con 0x7f419c0b3880 2024-09-11T22:14:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.392+0000 7f41927fc640 1 -- 172.21.15.50:0/426862121 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c00cd10 con 0x7f419c0b3880 2024-09-11T22:14:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.392+0000 7f41a3ee6640 1 -- 172.21.15.50:0/426862121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419c14e160 con 0x7f419c0b3880 2024-09-11T22:14:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.393+0000 7f41a3ee6640 1 -- 172.21.15.50:0/426862121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f419c06cb60 con 0x7f419c0b3880 2024-09-11T22:14:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.393+0000 7f41927fc640 1 -- 172.21.15.50:0/426862121 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f418c01a070 con 0x7f419c0b3880 2024-09-11T22:14:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.394+0000 7f41927fc640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f418006be30 0x7f418006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.394+0000 7f41927fc640 1 -- 172.21.15.50:0/426862121 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f418c08b1f0 con 0x7f419c0b3880 2024-09-11T22:14:27.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.394+0000 7f41a1c82640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f418006be30 0x7f418006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.394+0000 7f41a1c82640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f418006be30 0x7f418006e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4198034000 tx=0x7f419802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.398+0000 7f41927fc640 1 -- 172.21.15.50:0/426862121 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f418c059420 con 0x7f419c0b3880 2024-09-11T22:14:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.575+0000 7f41a3ee6640 1 -- 172.21.15.50:0/426862121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f419c0b2270 con 0x7f419c0b3880 2024-09-11T22:14:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.576+0000 7f41927fc640 1 -- 172.21.15.50:0/426862121 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16702 (secure 0 0 0) 0x7f418c05d720 con 0x7f419c0b3880 2024-09-11T22:14:27.577 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:27.577 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":58,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:14:26.306154+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:14:24.266096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-11T22:14:25.290643+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:14:27.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.578+0000 7f41a3ee6640 1 -- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f418006be30 msgr2=0x7f418006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.578+0000 7f41a3ee6640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f418006be30 0x7f418006e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4198034000 tx=0x7f419802e000 comp rx=0 tx=0).stop 2024-09-11T22:14:27.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.578+0000 7f41a3ee6640 1 -- 172.21.15.50:0/426862121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0b3880 msgr2=0x7f419c14efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.578+0000 7f41a3ee6640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0b3880 0x7f419c14efe0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f418c00e890 tx=0x7f418c00ed50 comp rx=0 tx=0).stop 2024-09-11T22:14:27.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.578+0000 7f41a3ee6640 1 -- 172.21.15.50:0/426862121 shutdown_connections 2024-09-11T22:14:27.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.578+0000 7f41a3ee6640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f418006be30 0x7f418006e2f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.578+0000 7f41a3ee6640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f419c15b430 0x7f419c14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.578+0000 7f41a3ee6640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f419c0b3880 0x7f419c14efe0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.578+0000 7f41a3ee6640 1 --2- 172.21.15.50:0/426862121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f419c06f390 0x7f419c14e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.578+0000 7f41a3ee6640 1 -- 172.21.15.50:0/426862121 >> 172.21.15.50:0/426862121 conn(0x7f419c074c40 msgr2=0x7f419c068260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:27.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.578+0000 7f41a3ee6640 1 -- 172.21.15.50:0/426862121 shutdown_connections 2024-09-11T22:14:27.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.578+0000 7f41a3ee6640 1 -- 172.21.15.50:0/426862121 wait complete. 2024-09-11T22:14:27.590 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:14:27.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.695+0000 7f3f4ca65640 1 Processor -- start 2024-09-11T22:14:27.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.695+0000 7f3f4ca65640 1 -- start start 2024-09-11T22:14:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.696+0000 7f3f4ca65640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f480b3e10 0x7f3f480b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.696+0000 7f3f4ca65640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f480b4f00 con 0x7f3f4815c2c0 2024-09-11T22:14:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.696+0000 7f3f4ca65640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f480b4360 con 0x7f3f480d05e0 2024-09-11T22:14:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.696+0000 7f3f4ca65640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f3f480b51c0 con 0x7f3f480b3e10 2024-09-11T22:14:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.696+0000 7f3f46d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f480b3e10 0x7f3f480b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.696+0000 7f3f4659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3f4815c2c0 0x7f3f480cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48900/0 (socket says 172.21.15.50:48900) 2024-09-11T22:14:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.696+0000 7f3f4659c640 1 -- 172.21.15.50:0/2825322457 learned_addr learned my addr 172.21.15.50:0/2825322457 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.696+0000 7f3f46d9d640 1 -- 172.21.15.50:0/2825322457 >> v1:172.21.15.77:6789/0 conn(0x7f3f480d05e0 legacy=0x7f3f480ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.696+0000 7f3f46d9d640 1 -- 172.21.15.50:0/2825322457 >> v1:172.21.15.50:6789/0 conn(0x7f3f4815c2c0 legacy=0x7f3f480cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.696+0000 7f3f46d9d640 1 -- 172.21.15.50:0/2825322457 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f480b54a0 con 0x7f3f480b3e10 2024-09-11T22:14:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.697+0000 7f3f46d9d640 1 --2- 172.21.15.50:0/2825322457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f480b3e10 0x7f3f480b46a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009d90 tx=0x7f3f4002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c13783e143a08e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.697+0000 7f3f45d9b640 1 -- 172.21.15.50:0/2825322457 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f40007740 con 0x7f3f480b3e10 2024-09-11T22:14:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.697+0000 7f3f45d9b640 1 -- 172.21.15.50:0/2825322457 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f400078e0 con 0x7f3f480b3e10 2024-09-11T22:14:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.697+0000 7f3f45d9b640 1 -- 172.21.15.50:0/2825322457 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f40007cb0 con 0x7f3f480b3e10 2024-09-11T22:14:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.698+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2825322457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f480b3e10 msgr2=0x7f3f480b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.698+0000 7f3f4ca65640 1 --2- 172.21.15.50:0/2825322457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f480b3e10 0x7f3f480b46a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009d90 tx=0x7f3f4002a6a0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.698+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2825322457 shutdown_connections 2024-09-11T22:14:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.698+0000 7f3f4ca65640 1 --2- 172.21.15.50:0/2825322457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f480b3e10 0x7f3f480b46a0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.698+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2825322457 >> 172.21.15.50:0/2825322457 conn(0x7f3f480679c0 msgr2=0x7f3f48067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.698+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2825322457 shutdown_connections 2024-09-11T22:14:27.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.698+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2825322457 wait complete. 2024-09-11T22:14:27.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.699+0000 7f3f4ca65640 1 Processor -- start 2024-09-11T22:14:27.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.699+0000 7f3f4ca65640 1 -- start start 2024-09-11T22:14:27.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f4ca65640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f480b3e10 0x7f3f48155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f4ca65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f480d05e0 0x7f3f4814f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f4ca65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f4815c2c0 0x7f3f4814fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f4ca65640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4806d070 con 0x7f3f480d05e0 2024-09-11T22:14:27.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f4ca65640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f480ce200 con 0x7f3f4815c2c0 2024-09-11T22:14:27.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f4ca65640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3f4806d1f0 con 0x7f3f480b3e10 2024-09-11T22:14:27.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f3dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f480d05e0 0x7f3f4814f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f3dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f480d05e0 0x7f3f4814f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50304/0 (socket says 172.21.15.50:50304) 2024-09-11T22:14:27.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f3dd9b640 1 -- 172.21.15.50:0/2966760118 learned_addr learned my addr 172.21.15.50:0/2966760118 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:27.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f46d9d640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f4815c2c0 0x7f3f4814fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f3dd9b640 1 -- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f480b3e10 msgr2=0x7f3f48155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f3dd9b640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f480b3e10 0x7f3f48155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f3dd9b640 1 -- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f4815c2c0 msgr2=0x7f3f4814fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f3dd9b640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f4815c2c0 0x7f3f4814fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f3dd9b640 1 -- 172.21.15.50:0/2966760118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f48155d70 con 0x7f3f480d05e0 2024-09-11T22:14:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.700+0000 7f3f46d9d640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f4815c2c0 0x7f3f4814fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.701+0000 7f3f3dd9b640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f480d05e0 0x7f3f4814f830 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c430 tx=0x7f3f3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.701+0000 7f3f3f7fe640 1 -- 172.21.15.50:0/2966760118 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30011790 con 0x7f3f480d05e0 2024-09-11T22:14:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.701+0000 7f3f3f7fe640 1 -- 172.21.15.50:0/2966760118 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f30017070 con 0x7f3f480d05e0 2024-09-11T22:14:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.701+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2966760118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f48154860 con 0x7f3f480d05e0 2024-09-11T22:14:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.701+0000 7f3f3f7fe640 1 -- 172.21.15.50:0/2966760118 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30011bb0 con 0x7f3f480d05e0 2024-09-11T22:14:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.701+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2966760118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f48154e20 con 0x7f3f480d05e0 2024-09-11T22:14:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.702+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2966760118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4815c6a0 con 0x7f3f480d05e0 2024-09-11T22:14:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.702+0000 7f3f3f7fe640 1 -- 172.21.15.50:0/2966760118 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f3001c460 con 0x7f3f480d05e0 2024-09-11T22:14:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.703+0000 7f3f3f7fe640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f2806be30 0x7f3f2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:27.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.703+0000 7f3f3f7fe640 1 -- 172.21.15.50:0/2966760118 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f3f3008ad40 con 0x7f3f480d05e0 2024-09-11T22:14:27.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.703+0000 7f3f4659c640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f2806be30 0x7f3f2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:27.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.703+0000 7f3f4659c640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f2806be30 0x7f3f2806e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3f38000f60 tx=0x7f3f38007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:27.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.707+0000 7f3f3f7fe640 1 -- 172.21.15.50:0/2966760118 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f300596f0 con 0x7f3f480d05e0 2024-09-11T22:14:27.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.917+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2966760118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3f48068080 con 0x7f3f480d05e0 2024-09-11T22:14:27.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.952+0000 7f3f3f7fe640 1 -- 172.21.15.50:0/2966760118 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) ==== 118+0+0 (secure 0 0 0) 0x7f3f30058ff0 con 0x7f3f480d05e0 2024-09-11T22:14:27.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.954+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f2806be30 msgr2=0x7f3f2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.954+0000 7f3f4ca65640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f2806be30 0x7f3f2806e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3f38000f60 tx=0x7f3f38007a80 comp rx=0 tx=0).stop 2024-09-11T22:14:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.955+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2966760118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f480d05e0 msgr2=0x7f3f4814f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.955+0000 7f3f4ca65640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f480d05e0 0x7f3f4814f830 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c430 tx=0x7f3f3000c8f0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.955+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2966760118 shutdown_connections 2024-09-11T22:14:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.955+0000 7f3f4ca65640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f2806be30 0x7f3f2806e2f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.955+0000 7f3f4ca65640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f4815c2c0 0x7f3f4814fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.955+0000 7f3f4ca65640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f480d05e0 0x7f3f4814f830 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.955+0000 7f3f4ca65640 1 --2- 172.21.15.50:0/2966760118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f480b3e10 0x7f3f48155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.955+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2966760118 >> 172.21.15.50:0/2966760118 conn(0x7f3f480679c0 msgr2=0x7f3f480b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.955+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2966760118 shutdown_connections 2024-09-11T22:14:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:27.955+0000 7f3f4ca65640 1 -- 172.21.15.50:0/2966760118 wait complete. 2024-09-11T22:14:27.966 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:14:27.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:14:28.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.071+0000 7f622b978640 1 Processor -- start 2024-09-11T22:14:28.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.071+0000 7f622b978640 1 -- start start 2024-09-11T22:14:28.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f622b978640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6224162a60 0x7f62240b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:28.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f622b978640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6224163080 con 0x7f62240d1c90 2024-09-11T22:14:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f622b978640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62240d2d20 con 0x7f622415e8e0 2024-09-11T22:14:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f622b978640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f622415ecc0 con 0x7f6224162a60 2024-09-11T22:14:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6228f13640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f62240d1c90 0x7f6224162350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48904/0 (socket says 172.21.15.50:48904) 2024-09-11T22:14:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6228f13640 1 -- 172.21.15.50:0/3660845548 learned_addr learned my addr 172.21.15.50:0/3660845548 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6229f15640 1 --2- 172.21.15.50:0/3660845548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6224162a60 0x7f62240b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906708859 0 0) 0x7f6224163080 con 0x7f62240d1c90 2024-09-11T22:14:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6210003520 con 0x7f62240d1c90 2024-09-11T22:14:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523614595 0 0) 0x7f62240d2d20 con 0x7f622415e8e0 2024-09-11T22:14:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6224163080 con 0x7f622415e8e0 2024-09-11T22:14:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2839995759 0 0) 0x7f6210003520 con 0x7f62240d1c90 2024-09-11T22:14:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6224162a60 msgr2=0x7f62240b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6217fff640 1 --2- 172.21.15.50:0/3660845548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6224162a60 0x7f62240b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 >> v1:172.21.15.77:6789/0 conn(0x7f622415e8e0 legacy=0x7f62240d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62240d3000 con 0x7f62240d1c90 2024-09-11T22:14:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f6218001670 con 0x7f62240d1c90 2024-09-11T22:14:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 >> v1:172.21.15.50:6789/0 conn(0x7f62240d1c90 legacy=0x7f6224162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.072+0000 7f6217fff640 1 --2- 172.21.15.50:0/3660845548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6210003b70 0x7f6210003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.073+0000 7f6217fff640 1 --2- 172.21.15.50:0/3660845548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6224162a60 0x7f6210004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.073+0000 7f6217fff640 1 --2- 172.21.15.50:0/3660845548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6210004d40 0x7f62100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.073+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f621000ba70 con 0x7f6210003b70 2024-09-11T22:14:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.073+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f621000bbf0 con 0x7f6210004d40 2024-09-11T22:14:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.073+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f621000bda0 con 0x7f6224162a60 2024-09-11T22:14:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.073+0000 7f6229714640 1 --2- 172.21.15.50:0/3660845548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6210003b70 0x7f6210003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.073+0000 7f6228f13640 1 --2- 172.21.15.50:0/3660845548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6224162a60 0x7f6210004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.073+0000 7f6229f15640 1 --2- 172.21.15.50:0/3660845548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6210004d40 0x7f62100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.073+0000 7f6229714640 1 -- 172.21.15.50:0/3660845548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6224162a60 msgr2=0x7f6210004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.073+0000 7f6229714640 1 --2- 172.21.15.50:0/3660845548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6224162a60 0x7f6210004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.073+0000 7f6229714640 1 -- 172.21.15.50:0/3660845548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6210004d40 msgr2=0x7f62100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.073+0000 7f6229714640 1 --2- 172.21.15.50:0/3660845548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6210004d40 0x7f62100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.073+0000 7f6229714640 1 -- 172.21.15.50:0/3660845548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6210003520 con 0x7f6210003b70 2024-09-11T22:14:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.074+0000 7f6229714640 1 --2- 172.21.15.50:0/3660845548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6210003b70 0x7f6210003f70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f62200018d0 tx=0x7f6210005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3b407fcf24f552 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.074+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62200014f0 con 0x7f6210003b70 2024-09-11T22:14:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.074+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62200052d0 con 0x7f6210003b70 2024-09-11T22:14:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.074+0000 7f6217fff640 1 -- 172.21.15.50:0/3660845548 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622002aca0 con 0x7f6210003b70 2024-09-11T22:14:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.074+0000 7f622b978640 1 -- 172.21.15.50:0/3660845548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6210003b70 msgr2=0x7f6210003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.074+0000 7f622b978640 1 --2- 172.21.15.50:0/3660845548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6210003b70 0x7f6210003f70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f62200018d0 tx=0x7f6210005830 comp rx=0 tx=0).stop 2024-09-11T22:14:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.074+0000 7f6229f15640 1 -- 172.21.15.50:0/3660845548 reap_dead start 2024-09-11T22:14:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.074+0000 7f622b978640 1 -- 172.21.15.50:0/3660845548 shutdown_connections 2024-09-11T22:14:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.074+0000 7f622b978640 1 -- 172.21.15.50:0/3660845548 >> 172.21.15.50:0/3660845548 conn(0x7f6224067ba0 msgr2=0x7f6224067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.074+0000 7f622b978640 1 -- 172.21.15.50:0/3660845548 shutdown_connections 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.074+0000 7f622b978640 1 -- 172.21.15.50:0/3660845548 wait complete. 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.076+0000 7f622b978640 1 Processor -- start 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.076+0000 7f622b978640 1 -- start start 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.076+0000 7f622b978640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6210003b70 0x7f62240cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.076+0000 7f622b978640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62241eac40 0x7f622415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.076+0000 7f622b978640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62240ce200 0x7f6224160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.076+0000 7f622b978640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f62240b7b50 con 0x7f6210003b70 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.076+0000 7f622b978640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f62240d2ad0 con 0x7f62241eac40 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.076+0000 7f622b978640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f62241e9f10 con 0x7f62240ce200 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.076+0000 7f6229714640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6210003b70 0x7f62240cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.076+0000 7f6229714640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6210003b70 0x7f62240cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50312/0 (socket says 172.21.15.50:50312) 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.076+0000 7f6229714640 1 -- 172.21.15.50:0/3727020389 learned_addr learned my addr 172.21.15.50:0/3727020389 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f6229f15640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62240ce200 0x7f6224160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f6228f13640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62241eac40 0x7f622415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f6229714640 1 -- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62240ce200 msgr2=0x7f6224160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f6229714640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62240ce200 0x7f6224160cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f6229714640 1 -- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62241eac40 msgr2=0x7f622415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f6229714640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62241eac40 0x7f622415d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f6229714640 1 -- 172.21.15.50:0/3727020389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62240ce7c0 con 0x7f6210003b70 2024-09-11T22:14:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f6228f13640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62241eac40 0x7f622415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f6229714640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6210003b70 0x7f62240cd450 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f62200018d0 tx=0x7f62200012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f6215ffb640 1 -- 172.21.15.50:0/3727020389 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622003f020 con 0x7f6210003b70 2024-09-11T22:14:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f6215ffb640 1 -- 172.21.15.50:0/3727020389 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6220006e50 con 0x7f6210003b70 2024-09-11T22:14:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f622b978640 1 -- 172.21.15.50:0/3727020389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62241ea160 con 0x7f6210003b70 2024-09-11T22:14:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f6215ffb640 1 -- 172.21.15.50:0/3727020389 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220037040 con 0x7f6210003b70 2024-09-11T22:14:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.077+0000 7f622b978640 1 -- 172.21.15.50:0/3727020389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62241ea720 con 0x7f6210003b70 2024-09-11T22:14:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.078+0000 7f622b978640 1 -- 172.21.15.50:0/3727020389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6224162350 con 0x7f6210003b70 2024-09-11T22:14:28.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.079+0000 7f6215ffb640 1 -- 172.21.15.50:0/3727020389 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6220042020 con 0x7f6210003b70 2024-09-11T22:14:28.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.079+0000 7f6215ffb640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f620806be60 0x7f620806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:28.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.079+0000 7f6215ffb640 1 -- 172.21.15.50:0/3727020389 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f62200aab00 con 0x7f6210003b70 2024-09-11T22:14:28.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.080+0000 7f6228f13640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f620806be60 0x7f620806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:28.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.080+0000 7f6228f13640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f620806be60 0x7f620806e320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f62241eb080 tx=0x7f6218009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:28.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.084+0000 7f6215ffb640 1 -- 172.21.15.50:0/3727020389 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6220049030 con 0x7f6210003b70 2024-09-11T22:14:28.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.295+0000 7f622b978640 1 -- 172.21.15.50:0/3727020389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f62240ba770 con 0x7f6210003b70 2024-09-11T22:14:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.957+0000 7f6215ffb640 1 -- 172.21.15.50:0/3727020389 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f62200aae20 con 0x7f6210003b70 2024-09-11T22:14:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.960+0000 7f622b978640 1 -- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f620806be60 msgr2=0x7f620806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.960+0000 7f622b978640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f620806be60 0x7f620806e320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f62241eb080 tx=0x7f6218009040 comp rx=0 tx=0).stop 2024-09-11T22:14:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.960+0000 7f622b978640 1 -- 172.21.15.50:0/3727020389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6210003b70 msgr2=0x7f62240cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.960+0000 7f622b978640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6210003b70 0x7f62240cd450 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f62200018d0 tx=0x7f62200012d0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.960+0000 7f622b978640 1 -- 172.21.15.50:0/3727020389 shutdown_connections 2024-09-11T22:14:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.960+0000 7f622b978640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f620806be60 0x7f620806e320 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.960+0000 7f622b978640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62240ce200 0x7f6224160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.960+0000 7f622b978640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62241eac40 0x7f622415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.960+0000 7f622b978640 1 --2- 172.21.15.50:0/3727020389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6210003b70 0x7f62240cd450 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:28.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.960+0000 7f622b978640 1 -- 172.21.15.50:0/3727020389 >> 172.21.15.50:0/3727020389 conn(0x7f6224067ba0 msgr2=0x7f6224067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:28.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.960+0000 7f622b978640 1 -- 172.21.15.50:0/3727020389 shutdown_connections 2024-09-11T22:14:28.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:28.960+0000 7f622b978640 1 -- 172.21.15.50:0/3727020389 wait complete. 2024-09-11T22:14:28.973 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:14:28.974 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:29.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.080+0000 7f6957274640 1 Processor -- start 2024-09-11T22:14:29.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.080+0000 7f6957274640 1 -- start start 2024-09-11T22:14:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.081+0000 7f6957274640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f69500cf790 0x7f69500b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.081+0000 7f6957274640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6950162110 con 0x7f6950161d30 2024-09-11T22:14:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.081+0000 7f6957274640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69500cfd70 con 0x7f69500d11d0 2024-09-11T22:14:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.081+0000 7f6957274640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f69500d3450 con 0x7f69500cf790 2024-09-11T22:14:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.081+0000 7f6955010640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6950161d30 0x7f6950162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48914/0 (socket says 172.21.15.50:48914) 2024-09-11T22:14:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.081+0000 7f6955010640 1 -- 172.21.15.50:0/473319787 learned_addr learned my addr 172.21.15.50:0/473319787 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.082+0000 7f695480f640 1 --2- 172.21.15.50:0/473319787 >> v2:172.21.15.77:3300/0 conn(0x7f69500cf790 0x7f69500b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.082+0000 7f6947fff640 1 -- 172.21.15.50:0/473319787 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459274040 0 0) 0x7f6950162110 con 0x7f6950161d30 2024-09-11T22:14:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.082+0000 7f6947fff640 1 -- 172.21.15.50:0/473319787 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f693c003520 con 0x7f6950161d30 2024-09-11T22:14:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.082+0000 7f695480f640 1 -- 172.21.15.50:0/473319787 >> v1:172.21.15.77:6789/0 conn(0x7f69500d11d0 legacy=0x7f69500d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.082+0000 7f695480f640 1 -- 172.21.15.50:0/473319787 >> v1:172.21.15.50:6789/0 conn(0x7f6950161d30 legacy=0x7f6950162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.082+0000 7f695480f640 1 -- 172.21.15.50:0/473319787 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69500d2b20 con 0x7f69500cf790 2024-09-11T22:14:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.083+0000 7f695480f640 1 --2- 172.21.15.50:0/473319787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69500cf790 0x7f69500b78f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f69400097a0 tx=0x7f694002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17afaf5b3f84dce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.083+0000 7f6947fff640 1 -- 172.21.15.50:0/473319787 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940037070 con 0x7f69500cf790 2024-09-11T22:14:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.083+0000 7f6947fff640 1 -- 172.21.15.50:0/473319787 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6940032440 con 0x7f69500cf790 2024-09-11T22:14:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.083+0000 7f6947fff640 1 -- 172.21.15.50:0/473319787 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69400327f0 con 0x7f69500cf790 2024-09-11T22:14:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.083+0000 7f6957274640 1 -- 172.21.15.50:0/473319787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69500cf790 msgr2=0x7f69500b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.083+0000 7f6957274640 1 --2- 172.21.15.50:0/473319787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69500cf790 0x7f69500b78f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f69400097a0 tx=0x7f694002a230 comp rx=0 tx=0).stop 2024-09-11T22:14:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.084+0000 7f6957274640 1 -- 172.21.15.50:0/473319787 shutdown_connections 2024-09-11T22:14:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.084+0000 7f6957274640 1 --2- 172.21.15.50:0/473319787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69500cf790 0x7f69500b78f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.084+0000 7f6957274640 1 -- 172.21.15.50:0/473319787 >> 172.21.15.50:0/473319787 conn(0x7f69500727a0 msgr2=0x7f69500679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.084+0000 7f6957274640 1 -- 172.21.15.50:0/473319787 shutdown_connections 2024-09-11T22:14:29.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.084+0000 7f6957274640 1 -- 172.21.15.50:0/473319787 wait complete. 2024-09-11T22:14:29.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.085+0000 7f6957274640 1 Processor -- start 2024-09-11T22:14:29.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.085+0000 7f6957274640 1 -- start start 2024-09-11T22:14:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6957274640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69500cf790 0x7f695015b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6957274640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69500d11d0 0x7f69500c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6957274640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6950161d30 0x7f695015f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6957274640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69500d30e0 con 0x7f6950161d30 2024-09-11T22:14:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6957274640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f69500b7e30 con 0x7f69500d11d0 2024-09-11T22:14:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6957274640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f69500d1600 con 0x7f69500cf790 2024-09-11T22:14:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6955811640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6950161d30 0x7f695015f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6955811640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6950161d30 0x7f695015f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50314/0 (socket says 172.21.15.50:50314) 2024-09-11T22:14:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6955811640 1 -- 172.21.15.50:0/2865924977 learned_addr learned my addr 172.21.15.50:0/2865924977 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f695480f640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69500d11d0 0x7f69500c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6955010640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69500cf790 0x7f695015b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6955811640 1 -- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69500cf790 msgr2=0x7f695015b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6955811640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69500cf790 0x7f695015b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6955811640 1 -- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69500d11d0 msgr2=0x7f69500c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6955811640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69500d11d0 0x7f69500c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6955811640 1 -- 172.21.15.50:0/2865924977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69500b5cb0 con 0x7f6950161d30 2024-09-11T22:14:29.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6955811640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6950161d30 0x7f695015f8e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f694800c7a0 tx=0x7f694800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:29.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.086+0000 7f6945ffb640 1 -- 172.21.15.50:0/2865924977 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948003b70 con 0x7f6950161d30 2024-09-11T22:14:29.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.087+0000 7f6945ffb640 1 -- 172.21.15.50:0/2865924977 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6948003d30 con 0x7f6950161d30 2024-09-11T22:14:29.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.087+0000 7f6957274640 1 -- 172.21.15.50:0/2865924977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69500b5f90 con 0x7f6950161d30 2024-09-11T22:14:29.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.087+0000 7f6945ffb640 1 -- 172.21.15.50:0/2865924977 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694800aa90 con 0x7f6950161d30 2024-09-11T22:14:29.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.087+0000 7f6957274640 1 -- 172.21.15.50:0/2865924977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69500b6550 con 0x7f6950161d30 2024-09-11T22:14:29.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.088+0000 7f6957274640 1 -- 172.21.15.50:0/2865924977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69500d1900 con 0x7f6950161d30 2024-09-11T22:14:29.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.088+0000 7f6945ffb640 1 -- 172.21.15.50:0/2865924977 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f694800ac30 con 0x7f6950161d30 2024-09-11T22:14:29.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.088+0000 7f6945ffb640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f693406be30 0x7f693406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.089+0000 7f6945ffb640 1 -- 172.21.15.50:0/2865924977 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f694808ac90 con 0x7f6950161d30 2024-09-11T22:14:29.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.089+0000 7f6955010640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f693406be30 0x7f693406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.089+0000 7f6955010640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f693406be30 0x7f693406e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f694c0011e0 tx=0x7f694c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:29.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.093+0000 7f6945ffb640 1 -- 172.21.15.50:0/2865924977 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6948058ff0 con 0x7f6950161d30 2024-09-11T22:14:29.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.304+0000 7f6957274640 1 -- 172.21.15.50:0/2865924977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69500d06e0 con 0x7f6950161d30 2024-09-11T22:14:29.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.305+0000 7f6945ffb640 1 -- 172.21.15.50:0/2865924977 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5223 (secure 0 0 0) 0x7f694805d2f0 con 0x7f6950161d30 2024-09-11T22:14:29.306 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:29.306 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":32,"btime":"2024-09-11T22:14:28:953512+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5468,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/4145638619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4145638619},{"type":"v1","addr":"172.21.15.77:6836","nonce":4145638619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3969515798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3969515798},{"type":"v1","addr":"172.21.15.50:6834","nonce":3969515798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2387852280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2387852280},{"type":"v1","addr":"172.21.15.50:6835","nonce":2387852280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:14:26.306529+0000","modified":"2024-09-11T22:14:28.296653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6156":{"gid":6156,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1418437076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1418437076},{"type":"v1","addr":"172.21.15.77:6837","nonce":1418437076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6156,"qdb_cluster":[6156]},"id":4}]} 2024-09-11T22:14:29.306 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 32 2024-09-11T22:14:29.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.307+0000 7f6957274640 1 -- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f693406be30 msgr2=0x7f693406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.307+0000 7f6957274640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f693406be30 0x7f693406e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f694c0011e0 tx=0x7f694c007d30 comp rx=0 tx=0).stop 2024-09-11T22:14:29.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.307+0000 7f6957274640 1 -- 172.21.15.50:0/2865924977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6950161d30 msgr2=0x7f695015f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.307+0000 7f6957274640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6950161d30 0x7f695015f8e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f694800c7a0 tx=0x7f694800cc60 comp rx=0 tx=0).stop 2024-09-11T22:14:29.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.307+0000 7f6957274640 1 -- 172.21.15.50:0/2865924977 shutdown_connections 2024-09-11T22:14:29.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.307+0000 7f6957274640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f693406be30 0x7f693406e2f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.307+0000 7f6957274640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6950161d30 0x7f695015f8e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.307+0000 7f6957274640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69500d11d0 0x7f69500c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.307+0000 7f6957274640 1 --2- 172.21.15.50:0/2865924977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69500cf790 0x7f695015b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.307+0000 7f6957274640 1 -- 172.21.15.50:0/2865924977 >> 172.21.15.50:0/2865924977 conn(0x7f69500727a0 msgr2=0x7f69500cb890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:29.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.307+0000 7f6957274640 1 -- 172.21.15.50:0/2865924977 shutdown_connections 2024-09-11T22:14:29.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.307+0000 7f6957274640 1 -- 172.21.15.50:0/2865924977 wait complete. 2024-09-11T22:14:29.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:14:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.420+0000 7fc2d674b640 1 Processor -- start 2024-09-11T22:14:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.420+0000 7fc2d674b640 1 -- start start 2024-09-11T22:14:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.421+0000 7fc2d674b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc2d015e8e0 0x7fc2d00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.421+0000 7fc2d674b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2d0162350 0x7fc2d01627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.421+0000 7fc2d674b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2d0163080 con 0x7fc2d00d1580 2024-09-11T22:14:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.421+0000 7fc2d674b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d015ecc0 con 0x7fc2d0162350 2024-09-11T22:14:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.421+0000 7fc2d674b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d00d2ad0 con 0x7fc2d015e8e0 2024-09-11T22:14:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.421+0000 7fc2d4ce8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2d0162350 0x7fc2d01627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.421+0000 7fc2d4ce8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2d0162350 0x7fc2d01627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50322/0 (socket says 172.21.15.50:50322) 2024-09-11T22:14:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.421+0000 7fc2d4ce8640 1 -- 172.21.15.50:0/1003755773 learned_addr learned my addr 172.21.15.50:0/1003755773 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.422+0000 7fc2cffff640 1 --2- 172.21.15.50:0/1003755773 >> v2:172.21.15.77:3300/0 conn(0x7fc2d015e8e0 0x7fc2d00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.422+0000 7fc2d4ce8640 1 -- 172.21.15.50:0/1003755773 >> v2:172.21.15.77:3300/0 conn(0x7fc2d015e8e0 msgr2=0x7fc2d00b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.422+0000 7fc2d4ce8640 1 --2- 172.21.15.50:0/1003755773 >> v2:172.21.15.77:3300/0 conn(0x7fc2d015e8e0 0x7fc2d00b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.422+0000 7fc2d4ce8640 1 -- 172.21.15.50:0/1003755773 >> v1:172.21.15.77:6789/0 conn(0x7fc2d00d1580 legacy=0x7fc2d00d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:29.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.422+0000 7fc2d4ce8640 1 -- 172.21.15.50:0/1003755773 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d00d2d20 con 0x7fc2d0162350 2024-09-11T22:14:29.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.422+0000 7fc2d4ce8640 1 --2- 172.21.15.50:0/1003755773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d0162350 0x7fc2d01627a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc2d008d630 tx=0x7fc2c802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12aee12ee3c87967 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.422+0000 7fc2ceffd640 1 -- 172.21.15.50:0/1003755773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8036070 con 0x7fc2d0162350 2024-09-11T22:14:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.422+0000 7fc2ceffd640 1 -- 172.21.15.50:0/1003755773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c8031600 con 0x7fc2d0162350 2024-09-11T22:14:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.422+0000 7fc2ceffd640 1 -- 172.21.15.50:0/1003755773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80319d0 con 0x7fc2d0162350 2024-09-11T22:14:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.423+0000 7fc2d674b640 1 -- 172.21.15.50:0/1003755773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d0162350 msgr2=0x7fc2d01627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.423+0000 7fc2d674b640 1 --2- 172.21.15.50:0/1003755773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d0162350 0x7fc2d01627a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc2d008d630 tx=0x7fc2c802a780 comp rx=0 tx=0).stop 2024-09-11T22:14:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.423+0000 7fc2d674b640 1 -- 172.21.15.50:0/1003755773 shutdown_connections 2024-09-11T22:14:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.423+0000 7fc2d674b640 1 --2- 172.21.15.50:0/1003755773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d0162350 0x7fc2d01627a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.423+0000 7fc2d674b640 1 --2- 172.21.15.50:0/1003755773 >> v2:172.21.15.77:3300/0 conn(0x7fc2d015e8e0 0x7fc2d00b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.423+0000 7fc2d674b640 1 -- 172.21.15.50:0/1003755773 >> 172.21.15.50:0/1003755773 conn(0x7fc2d0067ba0 msgr2=0x7fc2d0067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.423+0000 7fc2d674b640 1 -- 172.21.15.50:0/1003755773 shutdown_connections 2024-09-11T22:14:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.423+0000 7fc2d674b640 1 -- 172.21.15.50:0/1003755773 wait complete. 2024-09-11T22:14:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.424+0000 7fc2d674b640 1 Processor -- start 2024-09-11T22:14:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.424+0000 7fc2d674b640 1 -- start start 2024-09-11T22:14:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.425+0000 7fc2d674b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d00d1580 0x7fc2d00cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.425+0000 7fc2d674b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2d015e8e0 0x7fc2d00b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.425+0000 7fc2d674b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2d0162350 0x7fc2d01574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.425+0000 7fc2d674b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d0162ce0 con 0x7fc2d00d1580 2024-09-11T22:14:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.425+0000 7fc2d674b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d00d3370 con 0x7fc2d015e8e0 2024-09-11T22:14:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.425+0000 7fc2d674b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d0162e60 con 0x7fc2d0162350 2024-09-11T22:14:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.425+0000 7fc2cffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d00d1580 0x7fc2d00cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.425+0000 7fc2cffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d00d1580 0x7fc2d00cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50326/0 (socket says 172.21.15.50:50326) 2024-09-11T22:14:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.425+0000 7fc2cffff640 1 -- 172.21.15.50:0/1469555543 learned_addr learned my addr 172.21.15.50:0/1469555543 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.425+0000 7fc2d4ce8640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2d0162350 0x7fc2d01574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.425+0000 7fc2cf7fe640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2d015e8e0 0x7fc2d00b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.425+0000 7fc2cffff640 1 -- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2d0162350 msgr2=0x7fc2d01574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.425+0000 7fc2cffff640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2d0162350 0x7fc2d01574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.426+0000 7fc2cffff640 1 -- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2d015e8e0 msgr2=0x7fc2d00b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.426+0000 7fc2cffff640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2d015e8e0 0x7fc2d00b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.426+0000 7fc2cffff640 1 -- 172.21.15.50:0/1469555543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d00cebe0 con 0x7fc2d00d1580 2024-09-11T22:14:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.426+0000 7fc2cffff640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d00d1580 0x7fc2d00cc260 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c7f0 tx=0x7fc2c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.426+0000 7fc2ccff9640 1 -- 172.21.15.50:0/1469555543 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0015070 con 0x7fc2d00d1580 2024-09-11T22:14:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.426+0000 7fc2ccff9640 1 -- 172.21.15.50:0/1469555543 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c0004240 con 0x7fc2d00d1580 2024-09-11T22:14:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.426+0000 7fc2d674b640 1 -- 172.21.15.50:0/1469555543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d00ce2b0 con 0x7fc2d00d1580 2024-09-11T22:14:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.426+0000 7fc2ccff9640 1 -- 172.21.15.50:0/1469555543 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0007620 con 0x7fc2d00d1580 2024-09-11T22:14:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.426+0000 7fc2d674b640 1 -- 172.21.15.50:0/1469555543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d00cc7a0 con 0x7fc2d00d1580 2024-09-11T22:14:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.427+0000 7fc2d674b640 1 -- 172.21.15.50:0/1469555543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d00b7880 con 0x7fc2d00d1580 2024-09-11T22:14:29.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.427+0000 7fc2ccff9640 1 -- 172.21.15.50:0/1469555543 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2c00079d0 con 0x7fc2d00d1580 2024-09-11T22:14:29.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.428+0000 7fc2ccff9640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.428+0000 7fc2ccff9640 1 -- 172.21.15.50:0/1469555543 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fc2c008b270 con 0x7fc2d00d1580 2024-09-11T22:14:29.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.428+0000 7fc2cf7fe640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.428+0000 7fc2cf7fe640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4006fd0 tx=0x7fc2c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:29.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.432+0000 7fc2ccff9640 1 -- 172.21.15.50:0/1469555543 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2c0059cb0 con 0x7fc2d00d1580 2024-09-11T22:14:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.609+0000 7fc2d674b640 1 -- 172.21.15.50:0/1469555543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2d00d27e0 con 0x7fc2d00d1580 2024-09-11T22:14:29.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.610+0000 7fc2ccff9640 1 -- 172.21.15.50:0/1469555543 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16689 (secure 0 0 0) 0x7fc2c00595b0 con 0x7fc2d00d1580 2024-09-11T22:14:29.611 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:29.611 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":59,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:14:27.949016+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:14:24.266096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-11T22:14:25.290643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:14:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.612+0000 7fc2d674b640 1 -- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc2bc06be30 msgr2=0x7fc2bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.612+0000 7fc2d674b640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4006fd0 tx=0x7fc2c4008040 comp rx=0 tx=0).stop 2024-09-11T22:14:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.612+0000 7fc2d674b640 1 -- 172.21.15.50:0/1469555543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d00d1580 msgr2=0x7fc2d00cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.612+0000 7fc2d674b640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d00d1580 0x7fc2d00cc260 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c7f0 tx=0x7fc2c000ccb0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.612+0000 7fc2d674b640 1 -- 172.21.15.50:0/1469555543 shutdown_connections 2024-09-11T22:14:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.612+0000 7fc2d674b640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.612+0000 7fc2d674b640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2d0162350 0x7fc2d01574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.612+0000 7fc2d674b640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2d015e8e0 0x7fc2d00b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.612+0000 7fc2d674b640 1 --2- 172.21.15.50:0/1469555543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2d00d1580 0x7fc2d00cc260 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.612+0000 7fc2d674b640 1 -- 172.21.15.50:0/1469555543 >> 172.21.15.50:0/1469555543 conn(0x7fc2d0067ba0 msgr2=0x7fc2d0067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.612+0000 7fc2d674b640 1 -- 172.21.15.50:0/1469555543 shutdown_connections 2024-09-11T22:14:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.612+0000 7fc2d674b640 1 -- 172.21.15.50:0/1469555543 wait complete. 2024-09-11T22:14:29.623 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:14:29.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:14:29.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.724+0000 7f1d43b6d640 1 Processor -- start 2024-09-11T22:14:29.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.725+0000 7f1d43b6d640 1 -- start start 2024-09-11T22:14:29.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.725+0000 7f1d43b6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d3c0d18a0 0x7f1d3c0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.725+0000 7f1d43b6d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1d3c0d3a30 0x7f1d3c0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.725+0000 7f1d43b6d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d3c0cfa80 con 0x7f1d3c15e870 2024-09-11T22:14:29.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.725+0000 7f1d43b6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1d3c0d3ea0 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.725+0000 7f1d43b6d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1d3c0d40d0 con 0x7f1d3c0d3a30 2024-09-11T22:14:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.725+0000 7f1d41108640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d3c0d18a0 0x7f1d3c0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.726+0000 7f1d41108640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1d3c0d18a0 0x7f1d3c0d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50336/0 (socket says 172.21.15.50:50336) 2024-09-11T22:14:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.726+0000 7f1d41108640 1 -- 172.21.15.50:0/2846900213 learned_addr learned my addr 172.21.15.50:0/2846900213 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.726+0000 7f1d4210a640 1 --2- 172.21.15.50:0/2846900213 >> v2:172.21.15.77:3300/0 conn(0x7f1d3c0d3a30 0x7f1d3c0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.726+0000 7f1d41108640 1 -- 172.21.15.50:0/2846900213 >> v2:172.21.15.77:3300/0 conn(0x7f1d3c0d3a30 msgr2=0x7f1d3c0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.726+0000 7f1d41108640 1 --2- 172.21.15.50:0/2846900213 >> v2:172.21.15.77:3300/0 conn(0x7f1d3c0d3a30 0x7f1d3c0b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.726+0000 7f1d41108640 1 -- 172.21.15.50:0/2846900213 >> v1:172.21.15.77:6789/0 conn(0x7f1d3c15e870 legacy=0x7f1d3c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.726+0000 7f1d41108640 1 -- 172.21.15.50:0/2846900213 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c0d43b0 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.726+0000 7f1d41108640 1 --2- 172.21.15.50:0/2846900213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0d18a0 0x7f1d3c0d34f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0684c0 tx=0x7f1d3002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a004b50caa1abbe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.727+0000 7f1d40907640 1 -- 172.21.15.50:0/2846900213 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d30037070 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.727+0000 7f1d40907640 1 -- 172.21.15.50:0/2846900213 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d30032440 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.727+0000 7f1d40907640 1 -- 172.21.15.50:0/2846900213 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d30032810 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.727+0000 7f1d43b6d640 1 -- 172.21.15.50:0/2846900213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0d18a0 msgr2=0x7f1d3c0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.727+0000 7f1d43b6d640 1 --2- 172.21.15.50:0/2846900213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0d18a0 0x7f1d3c0d34f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0684c0 tx=0x7f1d3002a230 comp rx=0 tx=0).stop 2024-09-11T22:14:29.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.727+0000 7f1d43b6d640 1 -- 172.21.15.50:0/2846900213 shutdown_connections 2024-09-11T22:14:29.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.727+0000 7f1d43b6d640 1 --2- 172.21.15.50:0/2846900213 >> v2:172.21.15.77:3300/0 conn(0x7f1d3c0d3a30 0x7f1d3c0b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.727+0000 7f1d43b6d640 1 --2- 172.21.15.50:0/2846900213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0d18a0 0x7f1d3c0d34f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.727+0000 7f1d43b6d640 1 -- 172.21.15.50:0/2846900213 >> 172.21.15.50:0/2846900213 conn(0x7f1d3c0727a0 msgr2=0x7f1d3c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:29.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.727+0000 7f1d43b6d640 1 -- 172.21.15.50:0/2846900213 shutdown_connections 2024-09-11T22:14:29.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.727+0000 7f1d43b6d640 1 -- 172.21.15.50:0/2846900213 wait complete. 2024-09-11T22:14:29.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.728+0000 7f1d43b6d640 1 Processor -- start 2024-09-11T22:14:29.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.729+0000 7f1d43b6d640 1 -- start start 2024-09-11T22:14:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.729+0000 7f1d43b6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0d18a0 0x7f1d3c150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.729+0000 7f1d43b6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d3c0d3a30 0x7f1d3c1e6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.729+0000 7f1d43b6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d3c15e870 0x7f1d3c0ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.729+0000 7f1d43b6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c15ec50 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.729+0000 7f1d43b6d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c0b7ee0 con 0x7f1d3c0d3a30 2024-09-11T22:14:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.729+0000 7f1d43b6d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3c0b78b0 con 0x7f1d3c15e870 2024-09-11T22:14:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.729+0000 7f1d41909640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0d18a0 0x7f1d3c150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.729+0000 7f1d41909640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0d18a0 0x7f1d3c150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50348/0 (socket says 172.21.15.50:50348) 2024-09-11T22:14:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.729+0000 7f1d41909640 1 -- 172.21.15.50:0/1012587291 learned_addr learned my addr 172.21.15.50:0/1012587291 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.730+0000 7f1d4210a640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d3c15e870 0x7f1d3c0ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.730+0000 7f1d41108640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d3c0d3a30 0x7f1d3c1e6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.730+0000 7f1d41909640 1 -- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d3c15e870 msgr2=0x7f1d3c0ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.730+0000 7f1d41909640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d3c15e870 0x7f1d3c0ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.730+0000 7f1d41909640 1 -- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d3c0d3a30 msgr2=0x7f1d3c1e6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.730+0000 7f1d41909640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d3c0d3a30 0x7f1d3c1e6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.730+0000 7f1d41909640 1 -- 172.21.15.50:0/1012587291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c0cd3d0 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.730+0000 7f1d41909640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0d18a0 0x7f1d3c150b70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c7d0 tx=0x7f1d2c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.730+0000 7f1d3a7fc640 1 -- 172.21.15.50:0/1012587291 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c017070 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.730+0000 7f1d3a7fc640 1 -- 172.21.15.50:0/1012587291 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d2c003da0 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.730+0000 7f1d43b6d640 1 -- 172.21.15.50:0/1012587291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3c0cd6b0 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.730+0000 7f1d3a7fc640 1 -- 172.21.15.50:0/1012587291 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c0052b0 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.730+0000 7f1d43b6d640 1 -- 172.21.15.50:0/1012587291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d3c0cdc70 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.731+0000 7f1d43b6d640 1 -- 172.21.15.50:0/1012587291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3c0d34f0 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.732+0000 7f1d3a7fc640 1 -- 172.21.15.50:0/1012587291 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d2c01a070 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.732+0000 7f1d3a7fc640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d2806be60 0x7f1d2806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:29.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.732+0000 7f1d3a7fc640 1 -- 172.21.15.50:0/1012587291 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f1d2c08a5d0 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.732+0000 7f1d41108640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d2806be60 0x7f1d2806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:29.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.733+0000 7f1d41108640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d2806be60 0x7f1d2806e320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1d30034000 tx=0x7f1d3002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:29.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.736+0000 7f1d3a7fc640 1 -- 172.21.15.50:0/1012587291 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d2c058ef0 con 0x7f1d3c0d18a0 2024-09-11T22:14:29.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.906+0000 7f1d43b6d640 1 -- 172.21.15.50:0/1012587291 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1d3c067bd0 con 0x7f1d2806be60 2024-09-11T22:14:29.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.913+0000 7f1d3a7fc640 1 -- 172.21.15.50:0/1012587291 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251451 (secure 0 0 0) 0x7f1d3007f650 con 0x7f1d2806be60 2024-09-11T22:14:29.917 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:29.918 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:14:29.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.916+0000 7f1d43b6d640 1 -- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d2806be60 msgr2=0x7f1d2806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.916+0000 7f1d43b6d640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d2806be60 0x7f1d2806e320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1d30034000 tx=0x7f1d3002e000 comp rx=0 tx=0).stop 2024-09-11T22:14:29.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.916+0000 7f1d43b6d640 1 -- 172.21.15.50:0/1012587291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0d18a0 msgr2=0x7f1d3c150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:29.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.916+0000 7f1d43b6d640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0d18a0 0x7f1d3c150b70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c7d0 tx=0x7f1d2c00cc90 comp rx=0 tx=0).stop 2024-09-11T22:14:29.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.916+0000 7f1d43b6d640 1 -- 172.21.15.50:0/1012587291 shutdown_connections 2024-09-11T22:14:29.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.916+0000 7f1d43b6d640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d2806be60 0x7f1d2806e320 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.916+0000 7f1d43b6d640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d3c15e870 0x7f1d3c0ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.916+0000 7f1d43b6d640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d3c0d3a30 0x7f1d3c1e6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.916+0000 7f1d43b6d640 1 --2- 172.21.15.50:0/1012587291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d3c0d18a0 0x7f1d3c150b70 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:29.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.916+0000 7f1d43b6d640 1 -- 172.21.15.50:0/1012587291 >> 172.21.15.50:0/1012587291 conn(0x7f1d3c0727a0 msgr2=0x7f1d3c1619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:29.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.916+0000 7f1d43b6d640 1 -- 172.21.15.50:0/1012587291 shutdown_connections 2024-09-11T22:14:29.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:29.916+0000 7f1d43b6d640 1 -- 172.21.15.50:0/1012587291 wait complete. 2024-09-11T22:14:29.928 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-11T22:14:29.410311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297720,"kb_used_data":6596,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754677000,"statfs":{"total":773094113280,"available":772789248000,"internally_reserved":0,"allocated":6754304,"data_stored":3477419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.475620"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.947823+0000","last_change":"2024-09-11T22:14:25.947823+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.947823+0000","last_undegraded":"2024-09-11T22:14:25.947823+0000","last_fullsized":"2024-09-11T22:14:25.947823+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238075+0000","last_change":"2024-09-11T22:14:26.959238+0000","last_active":"2024-09-11T22:14:29.238075+0000","last_peered":"2024-09-11T22:14:29.238075+0000","last_clean":"2024-09-11T22:14:29.238075+0000","last_became_active":"2024-09-11T22:14:26.958936+0000","last_became_peered":"2024-09-11T22:14:26.958936+0000","last_unstale":"2024-09-11T22:14:29.238075+0000","last_undegraded":"2024-09-11T22:14:29.238075+0000","last_fullsized":"2024-09-11T22:14:29.238075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:11.635531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.962988+0000","last_change":"2024-09-11T22:14:26.960744+0000","last_active":"2024-09-11T22:14:26.962988+0000","last_peered":"2024-09-11T22:14:26.962988+0000","last_clean":"2024-09-11T22:14:26.962988+0000","last_became_active":"2024-09-11T22:14:26.960440+0000","last_became_peered":"2024-09-11T22:14:26.960440+0000","last_unstale":"2024-09-11T22:14:26.962988+0000","last_undegraded":"2024-09-11T22:14:26.962988+0000","last_fullsized":"2024-09-11T22:14:26.962988+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:20.952546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956811+0000","last_change":"2024-09-11T22:14:26.959797+0000","last_active":"2024-09-11T22:14:27.956811+0000","last_peered":"2024-09-11T22:14:27.956811+0000","last_clean":"2024-09-11T22:14:27.956811+0000","last_became_active":"2024-09-11T22:14:26.959522+0000","last_became_peered":"2024-09-11T22:14:26.959522+0000","last_unstale":"2024-09-11T22:14:27.956811+0000","last_undegraded":"2024-09-11T22:14:27.956811+0000","last_fullsized":"2024-09-11T22:14:27.956811+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:41.931942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.948157+0000","last_change":"2024-09-11T22:14:25.948157+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.948157+0000","last_undegraded":"2024-09-11T22:14:25.948157+0000","last_fullsized":"2024-09-11T22:14:25.948157+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955059+0000","last_change":"2024-09-11T22:14:26.956023+0000","last_active":"2024-09-11T22:14:27.955059+0000","last_peered":"2024-09-11T22:14:27.955059+0000","last_clean":"2024-09-11T22:14:27.955059+0000","last_became_active":"2024-09-11T22:14:26.955721+0000","last_became_peered":"2024-09-11T22:14:26.955721+0000","last_unstale":"2024-09-11T22:14:27.955059+0000","last_undegraded":"2024-09-11T22:14:27.955059+0000","last_fullsized":"2024-09-11T22:14:27.955059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:54.886252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956720+0000","last_change":"2024-09-11T22:14:26.964660+0000","last_active":"2024-09-11T22:14:27.956720+0000","last_peered":"2024-09-11T22:14:27.956720+0000","last_clean":"2024-09-11T22:14:27.956720+0000","last_became_active":"2024-09-11T22:14:26.964404+0000","last_became_peered":"2024-09-11T22:14:26.964404+0000","last_unstale":"2024-09-11T22:14:27.956720+0000","last_undegraded":"2024-09-11T22:14:27.956720+0000","last_fullsized":"2024-09-11T22:14:27.956720+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:17.063912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237609+0000","last_change":"2024-09-11T22:14:26.960383+0000","last_active":"2024-09-11T22:14:29.237609+0000","last_peered":"2024-09-11T22:14:29.237609+0000","last_clean":"2024-09-11T22:14:29.237609+0000","last_became_active":"2024-09-11T22:14:26.959605+0000","last_became_peered":"2024-09-11T22:14:26.959605+0000","last_unstale":"2024-09-11T22:14:29.237609+0000","last_undegraded":"2024-09-11T22:14:29.237609+0000","last_fullsized":"2024-09-11T22:14:29.237609+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:52.664222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956335+0000","last_change":"2024-09-11T22:14:26.964503+0000","last_active":"2024-09-11T22:14:27.956335+0000","last_peered":"2024-09-11T22:14:27.956335+0000","last_clean":"2024-09-11T22:14:27.956335+0000","last_became_active":"2024-09-11T22:14:26.964196+0000","last_became_peered":"2024-09-11T22:14:26.964196+0000","last_unstale":"2024-09-11T22:14:27.956335+0000","last_undegraded":"2024-09-11T22:14:27.956335+0000","last_fullsized":"2024-09-11T22:14:27.956335+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:13.144193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650694+0000","last_change":"2024-09-11T22:14:26.959365+0000","last_active":"2024-09-11T22:14:28.650694+0000","last_peered":"2024-09-11T22:14:28.650694+0000","last_clean":"2024-09-11T22:14:28.650694+0000","last_became_active":"2024-09-11T22:14:26.958793+0000","last_became_peered":"2024-09-11T22:14:26.958793+0000","last_unstale":"2024-09-11T22:14:28.650694+0000","last_undegraded":"2024-09-11T22:14:28.650694+0000","last_fullsized":"2024-09-11T22:14:28.650694+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:53.962348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650807+0000","last_change":"2024-09-11T22:14:26.970469+0000","last_active":"2024-09-11T22:14:28.650807+0000","last_peered":"2024-09-11T22:14:28.650807+0000","last_clean":"2024-09-11T22:14:28.650807+0000","last_became_active":"2024-09-11T22:14:26.970170+0000","last_became_peered":"2024-09-11T22:14:26.970170+0000","last_unstale":"2024-09-11T22:14:28.650807+0000","last_undegraded":"2024-09-11T22:14:28.650807+0000","last_fullsized":"2024-09-11T22:14:28.650807+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:37.142401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956978+0000","last_change":"2024-09-11T22:14:26.961258+0000","last_active":"2024-09-11T22:14:27.956978+0000","last_peered":"2024-09-11T22:14:27.956978+0000","last_clean":"2024-09-11T22:14:27.956978+0000","last_became_active":"2024-09-11T22:14:26.960960+0000","last_became_peered":"2024-09-11T22:14:26.960960+0000","last_unstale":"2024-09-11T22:14:27.956978+0000","last_undegraded":"2024-09-11T22:14:27.956978+0000","last_fullsized":"2024-09-11T22:14:27.956978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:43.123466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045219+0000","last_change":"2024-09-11T22:14:26.955986+0000","last_active":"2024-09-11T22:14:28.045219+0000","last_peered":"2024-09-11T22:14:28.045219+0000","last_clean":"2024-09-11T22:14:28.045219+0000","last_became_active":"2024-09-11T22:14:26.955724+0000","last_became_peered":"2024-09-11T22:14:26.955724+0000","last_unstale":"2024-09-11T22:14:28.045219+0000","last_undegraded":"2024-09-11T22:14:28.045219+0000","last_fullsized":"2024-09-11T22:14:28.045219+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:24.565886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956239+0000","last_change":"2024-09-11T22:14:26.959090+0000","last_active":"2024-09-11T22:14:27.956239+0000","last_peered":"2024-09-11T22:14:27.956239+0000","last_clean":"2024-09-11T22:14:27.956239+0000","last_became_active":"2024-09-11T22:14:26.958825+0000","last_became_peered":"2024-09-11T22:14:26.958825+0000","last_unstale":"2024-09-11T22:14:27.956239+0000","last_undegraded":"2024-09-11T22:14:27.956239+0000","last_fullsized":"2024-09-11T22:14:27.956239+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:45.664163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956876+0000","last_change":"2024-09-11T22:14:26.957998+0000","last_active":"2024-09-11T22:14:27.956876+0000","last_peered":"2024-09-11T22:14:27.956876+0000","last_clean":"2024-09-11T22:14:27.956876+0000","last_became_active":"2024-09-11T22:14:26.957683+0000","last_became_peered":"2024-09-11T22:14:26.957683+0000","last_unstale":"2024-09-11T22:14:27.956876+0000","last_undegraded":"2024-09-11T22:14:27.956876+0000","last_fullsized":"2024-09-11T22:14:27.956876+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.544029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955000+0000","last_change":"2024-09-11T22:14:26.963903+0000","last_active":"2024-09-11T22:14:27.955000+0000","last_peered":"2024-09-11T22:14:27.955000+0000","last_clean":"2024-09-11T22:14:27.955000+0000","last_became_active":"2024-09-11T22:14:26.963640+0000","last_became_peered":"2024-09-11T22:14:26.963640+0000","last_unstale":"2024-09-11T22:14:27.955000+0000","last_undegraded":"2024-09-11T22:14:27.955000+0000","last_fullsized":"2024-09-11T22:14:27.955000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:14.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238138+0000","last_change":"2024-09-11T22:14:26.957389+0000","last_active":"2024-09-11T22:14:29.238138+0000","last_peered":"2024-09-11T22:14:29.238138+0000","last_clean":"2024-09-11T22:14:29.238138+0000","last_became_active":"2024-09-11T22:14:26.957118+0000","last_became_peered":"2024-09-11T22:14:26.957118+0000","last_unstale":"2024-09-11T22:14:29.238138+0000","last_undegraded":"2024-09-11T22:14:29.238138+0000","last_fullsized":"2024-09-11T22:14:29.238138+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:10.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.964922+0000","last_change":"2024-09-11T22:14:26.961999+0000","last_active":"2024-09-11T22:14:26.964922+0000","last_peered":"2024-09-11T22:14:26.964922+0000","last_clean":"2024-09-11T22:14:26.964922+0000","last_became_active":"2024-09-11T22:14:26.961653+0000","last_became_peered":"2024-09-11T22:14:26.961653+0000","last_unstale":"2024-09-11T22:14:26.964922+0000","last_undegraded":"2024-09-11T22:14:26.964922+0000","last_fullsized":"2024-09-11T22:14:26.964922+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:40.552647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.949112+0000","last_change":"2024-09-11T22:14:25.949112+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.949112+0000","last_undegraded":"2024-09-11T22:14:25.949112+0000","last_fullsized":"2024-09-11T22:14:25.949112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237827+0000","last_change":"2024-09-11T22:14:26.957825+0000","last_active":"2024-09-11T22:14:29.237827+0000","last_peered":"2024-09-11T22:14:29.237827+0000","last_clean":"2024-09-11T22:14:29.237827+0000","last_became_active":"2024-09-11T22:14:26.957559+0000","last_became_peered":"2024-09-11T22:14:26.957559+0000","last_unstale":"2024-09-11T22:14:29.237827+0000","last_undegraded":"2024-09-11T22:14:29.237827+0000","last_fullsized":"2024-09-11T22:14:29.237827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:23.772181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.964963+0000","last_change":"2024-09-11T22:14:26.962434+0000","last_active":"2024-09-11T22:14:26.964963+0000","last_peered":"2024-09-11T22:14:26.964963+0000","last_clean":"2024-09-11T22:14:26.964963+0000","last_became_active":"2024-09-11T22:14:26.962132+0000","last_became_peered":"2024-09-11T22:14:26.962132+0000","last_unstale":"2024-09-11T22:14:26.964963+0000","last_undegraded":"2024-09-11T22:14:26.964963+0000","last_fullsized":"2024-09-11T22:14:26.964963+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:14.957468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237709+0000","last_change":"2024-09-11T22:14:26.970102+0000","last_active":"2024-09-11T22:14:29.237709+0000","last_peered":"2024-09-11T22:14:29.237709+0000","last_clean":"2024-09-11T22:14:29.237709+0000","last_became_active":"2024-09-11T22:14:26.968725+0000","last_became_peered":"2024-09-11T22:14:26.968725+0000","last_unstale":"2024-09-11T22:14:29.237709+0000","last_undegraded":"2024-09-11T22:14:29.237709+0000","last_fullsized":"2024-09-11T22:14:29.237709+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:54.820323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973486+0000","last_change":"2024-09-11T22:14:26.972685+0000","last_active":"2024-09-11T22:14:26.973486+0000","last_peered":"2024-09-11T22:14:26.973486+0000","last_clean":"2024-09-11T22:14:26.973486+0000","last_became_active":"2024-09-11T22:14:26.972444+0000","last_became_peered":"2024-09-11T22:14:26.972444+0000","last_unstale":"2024-09-11T22:14:26.973486+0000","last_undegraded":"2024-09-11T22:14:26.973486+0000","last_fullsized":"2024-09-11T22:14:26.973486+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:17.455050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045202+0000","last_change":"2024-09-11T22:14:26.953324+0000","last_active":"2024-09-11T22:14:28.045202+0000","last_peered":"2024-09-11T22:14:28.045202+0000","last_clean":"2024-09-11T22:14:28.045202+0000","last_became_active":"2024-09-11T22:14:26.951702+0000","last_became_peered":"2024-09-11T22:14:26.951702+0000","last_unstale":"2024-09-11T22:14:28.045202+0000","last_undegraded":"2024-09-11T22:14:28.045202+0000","last_fullsized":"2024-09-11T22:14:28.045202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:45.699757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.947311+0000","last_change":"2024-09-11T22:14:25.947311+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.947311+0000","last_undegraded":"2024-09-11T22:14:25.947311+0000","last_fullsized":"2024-09-11T22:14:25.947311+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957209+0000","last_change":"2024-09-11T22:14:26.966619+0000","last_active":"2024-09-11T22:14:27.957209+0000","last_peered":"2024-09-11T22:14:27.957209+0000","last_clean":"2024-09-11T22:14:27.957209+0000","last_became_active":"2024-09-11T22:14:26.966166+0000","last_became_peered":"2024-09-11T22:14:26.966166+0000","last_unstale":"2024-09-11T22:14:27.957209+0000","last_undegraded":"2024-09-11T22:14:27.957209+0000","last_fullsized":"2024-09-11T22:14:27.957209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:48.700476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955344+0000","last_change":"2024-09-11T22:14:26.959657+0000","last_active":"2024-09-11T22:14:27.955344+0000","last_peered":"2024-09-11T22:14:27.955344+0000","last_clean":"2024-09-11T22:14:27.955344+0000","last_became_active":"2024-09-11T22:14:26.957995+0000","last_became_peered":"2024-09-11T22:14:26.957995+0000","last_unstale":"2024-09-11T22:14:27.955344+0000","last_undegraded":"2024-09-11T22:14:27.955344+0000","last_fullsized":"2024-09-11T22:14:27.955344+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:45.625414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.946343+0000","last_change":"2024-09-11T22:14:25.946343+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.946343+0000","last_undegraded":"2024-09-11T22:14:25.946343+0000","last_fullsized":"2024-09-11T22:14:25.946343+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238020+0000","last_change":"2024-09-11T22:14:26.965288+0000","last_active":"2024-09-11T22:14:29.238020+0000","last_peered":"2024-09-11T22:14:29.238020+0000","last_clean":"2024-09-11T22:14:29.238020+0000","last_became_active":"2024-09-11T22:14:26.963346+0000","last_became_peered":"2024-09-11T22:14:26.963346+0000","last_unstale":"2024-09-11T22:14:29.238020+0000","last_undegraded":"2024-09-11T22:14:29.238020+0000","last_fullsized":"2024-09-11T22:14:29.238020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:36.369029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.961779+0000","last_change":"2024-09-11T22:14:26.959933+0000","last_active":"2024-09-11T22:14:26.961779+0000","last_peered":"2024-09-11T22:14:26.961779+0000","last_clean":"2024-09-11T22:14:26.961779+0000","last_became_active":"2024-09-11T22:14:26.959673+0000","last_became_peered":"2024-09-11T22:14:26.959673+0000","last_unstale":"2024-09-11T22:14:26.961779+0000","last_undegraded":"2024-09-11T22:14:26.961779+0000","last_fullsized":"2024-09-11T22:14:26.961779+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:16.039732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.946662+0000","last_change":"2024-09-11T22:14:25.946662+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.946662+0000","last_undegraded":"2024-09-11T22:14:25.946662+0000","last_fullsized":"2024-09-11T22:14:25.946662+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955340+0000","last_change":"2024-09-11T22:14:26.957135+0000","last_active":"2024-09-11T22:14:27.955340+0000","last_peered":"2024-09-11T22:14:27.955340+0000","last_clean":"2024-09-11T22:14:27.955340+0000","last_became_active":"2024-09-11T22:14:26.956870+0000","last_became_peered":"2024-09-11T22:14:26.956870+0000","last_unstale":"2024-09-11T22:14:27.955340+0000","last_undegraded":"2024-09-11T22:14:27.955340+0000","last_fullsized":"2024-09-11T22:14:27.955340+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:17.912234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955540+0000","last_change":"2024-09-11T22:14:26.962072+0000","last_active":"2024-09-11T22:14:27.955540+0000","last_peered":"2024-09-11T22:14:27.955540+0000","last_clean":"2024-09-11T22:14:27.955540+0000","last_became_active":"2024-09-11T22:14:26.961817+0000","last_became_peered":"2024-09-11T22:14:26.961817+0000","last_unstale":"2024-09-11T22:14:27.955540+0000","last_undegraded":"2024-09-11T22:14:27.955540+0000","last_fullsized":"2024-09-11T22:14:27.955540+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:14.514452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955612+0000","last_change":"2024-09-11T22:14:25.952024+0000","last_active":"2024-09-11T22:14:27.955612+0000","last_peered":"2024-09-11T22:14:27.955612+0000","last_clean":"2024-09-11T22:14:27.955612+0000","last_became_active":"2024-09-11T22:14:25.951739+0000","last_became_peered":"2024-09-11T22:14:25.951739+0000","last_unstale":"2024-09-11T22:14:27.955612+0000","last_undegraded":"2024-09-11T22:14:27.955612+0000","last_fullsized":"2024-09-11T22:14:27.955612+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:36.134800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650758+0000","last_change":"2024-09-11T22:14:26.964714+0000","last_active":"2024-09-11T22:14:28.650758+0000","last_peered":"2024-09-11T22:14:28.650758+0000","last_clean":"2024-09-11T22:14:28.650758+0000","last_became_active":"2024-09-11T22:14:26.964485+0000","last_became_peered":"2024-09-11T22:14:26.964485+0000","last_unstale":"2024-09-11T22:14:28.650758+0000","last_undegraded":"2024-09-11T22:14:28.650758+0000","last_fullsized":"2024-09-11T22:14:28.650758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:41.146664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238072+0000","last_change":"2024-09-11T22:14:25.956149+0000","last_active":"2024-09-11T22:14:29.238072+0000","last_peered":"2024-09-11T22:14:29.238072+0000","last_clean":"2024-09-11T22:14:29.238072+0000","last_became_active":"2024-09-11T22:14:25.955403+0000","last_became_peered":"2024-09-11T22:14:25.955403+0000","last_unstale":"2024-09-11T22:14:29.238072+0000","last_undegraded":"2024-09-11T22:14:29.238072+0000","last_fullsized":"2024-09-11T22:14:29.238072+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:15.536125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955173+0000","last_change":"2024-09-11T22:14:26.964943+0000","last_active":"2024-09-11T22:14:27.955173+0000","last_peered":"2024-09-11T22:14:27.955173+0000","last_clean":"2024-09-11T22:14:27.955173+0000","last_became_active":"2024-09-11T22:14:26.964416+0000","last_became_peered":"2024-09-11T22:14:26.964416+0000","last_unstale":"2024-09-11T22:14:27.955173+0000","last_undegraded":"2024-09-11T22:14:27.955173+0000","last_fullsized":"2024-09-11T22:14:27.955173+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:36.926975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955571+0000","last_change":"2024-09-11T22:14:25.960586+0000","last_active":"2024-09-11T22:14:27.955571+0000","last_peered":"2024-09-11T22:14:27.955571+0000","last_clean":"2024-09-11T22:14:27.955571+0000","last_became_active":"2024-09-11T22:14:25.960280+0000","last_became_peered":"2024-09-11T22:14:25.960280+0000","last_unstale":"2024-09-11T22:14:27.955571+0000","last_undegraded":"2024-09-11T22:14:27.955571+0000","last_fullsized":"2024-09-11T22:14:27.955571+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:40.139062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955425+0000","last_change":"2024-09-11T22:14:26.961155+0000","last_active":"2024-09-11T22:14:27.955425+0000","last_peered":"2024-09-11T22:14:27.955425+0000","last_clean":"2024-09-11T22:14:27.955425+0000","last_became_active":"2024-09-11T22:14:26.960654+0000","last_became_peered":"2024-09-11T22:14:26.960654+0000","last_unstale":"2024-09-11T22:14:27.955425+0000","last_undegraded":"2024-09-11T22:14:27.955425+0000","last_fullsized":"2024-09-11T22:14:27.955425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957272+0000","last_change":"2024-09-11T22:14:25.954648+0000","last_active":"2024-09-11T22:14:27.957272+0000","last_peered":"2024-09-11T22:14:27.957272+0000","last_clean":"2024-09-11T22:14:27.957272+0000","last_became_active":"2024-09-11T22:14:25.954334+0000","last_became_peered":"2024-09-11T22:14:25.954334+0000","last_unstale":"2024-09-11T22:14:27.957272+0000","last_undegraded":"2024-09-11T22:14:27.957272+0000","last_fullsized":"2024-09-11T22:14:27.957272+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:12.136592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238149+0000","last_change":"2024-09-11T22:14:26.969858+0000","last_active":"2024-09-11T22:14:29.238149+0000","last_peered":"2024-09-11T22:14:29.238149+0000","last_clean":"2024-09-11T22:14:29.238149+0000","last_became_active":"2024-09-11T22:14:26.968413+0000","last_became_peered":"2024-09-11T22:14:26.968413+0000","last_unstale":"2024-09-11T22:14:29.238149+0000","last_undegraded":"2024-09-11T22:14:29.238149+0000","last_fullsized":"2024-09-11T22:14:29.238149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:26.978341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955958+0000","last_change":"2024-09-11T22:14:25.950287+0000","last_active":"2024-09-11T22:14:27.955958+0000","last_peered":"2024-09-11T22:14:27.955958+0000","last_clean":"2024-09-11T22:14:27.955958+0000","last_became_active":"2024-09-11T22:14:25.950020+0000","last_became_peered":"2024-09-11T22:14:25.950020+0000","last_unstale":"2024-09-11T22:14:27.955958+0000","last_undegraded":"2024-09-11T22:14:27.955958+0000","last_fullsized":"2024-09-11T22:14:27.955958+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:31.695327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238193+0000","last_change":"2024-09-11T22:14:26.957412+0000","last_active":"2024-09-11T22:14:29.238193+0000","last_peered":"2024-09-11T22:14:29.238193+0000","last_clean":"2024-09-11T22:14:29.238193+0000","last_became_active":"2024-09-11T22:14:26.957003+0000","last_became_peered":"2024-09-11T22:14:26.957003+0000","last_unstale":"2024-09-11T22:14:29.238193+0000","last_undegraded":"2024-09-11T22:14:29.238193+0000","last_fullsized":"2024-09-11T22:14:29.238193+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:00.215569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955193+0000","last_change":"2024-09-11T22:14:25.956470+0000","last_active":"2024-09-11T22:14:27.955193+0000","last_peered":"2024-09-11T22:14:27.955193+0000","last_clean":"2024-09-11T22:14:27.955193+0000","last_became_active":"2024-09-11T22:14:25.956032+0000","last_became_peered":"2024-09-11T22:14:25.956032+0000","last_unstale":"2024-09-11T22:14:27.955193+0000","last_undegraded":"2024-09-11T22:14:27.955193+0000","last_fullsized":"2024-09-11T22:14:27.955193+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:17.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045221+0000","last_change":"2024-09-11T22:14:26.957303+0000","last_active":"2024-09-11T22:14:28.045221+0000","last_peered":"2024-09-11T22:14:28.045221+0000","last_clean":"2024-09-11T22:14:28.045221+0000","last_became_active":"2024-09-11T22:14:26.957049+0000","last_became_peered":"2024-09-11T22:14:26.957049+0000","last_unstale":"2024-09-11T22:14:28.045221+0000","last_undegraded":"2024-09-11T22:14:28.045221+0000","last_fullsized":"2024-09-11T22:14:28.045221+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:54.823432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957147+0000","last_change":"2024-09-11T22:14:25.950524+0000","last_active":"2024-09-11T22:14:27.957147+0000","last_peered":"2024-09-11T22:14:27.957147+0000","last_clean":"2024-09-11T22:14:27.957147+0000","last_became_active":"2024-09-11T22:14:25.950266+0000","last_became_peered":"2024-09-11T22:14:25.950266+0000","last_unstale":"2024-09-11T22:14:27.957147+0000","last_undegraded":"2024-09-11T22:14:27.957147+0000","last_fullsized":"2024-09-11T22:14:27.957147+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:46.536428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237812+0000","last_change":"2024-09-11T22:14:26.959688+0000","last_active":"2024-09-11T22:14:29.237812+0000","last_peered":"2024-09-11T22:14:29.237812+0000","last_clean":"2024-09-11T22:14:29.237812+0000","last_became_active":"2024-09-11T22:14:26.958964+0000","last_became_peered":"2024-09-11T22:14:26.958964+0000","last_unstale":"2024-09-11T22:14:29.237812+0000","last_undegraded":"2024-09-11T22:14:29.237812+0000","last_fullsized":"2024-09-11T22:14:29.237812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:40.951930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956044+0000","last_change":"2024-09-11T22:14:25.957377+0000","last_active":"2024-09-11T22:14:27.956044+0000","last_peered":"2024-09-11T22:14:27.956044+0000","last_clean":"2024-09-11T22:14:27.956044+0000","last_became_active":"2024-09-11T22:14:25.957103+0000","last_became_peered":"2024-09-11T22:14:25.957103+0000","last_unstale":"2024-09-11T22:14:27.956044+0000","last_undegraded":"2024-09-11T22:14:27.956044+0000","last_fullsized":"2024-09-11T22:14:27.956044+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:17.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956917+0000","last_change":"2024-09-11T22:14:26.969252+0000","last_active":"2024-09-11T22:14:27.956917+0000","last_peered":"2024-09-11T22:14:27.956917+0000","last_clean":"2024-09-11T22:14:27.956917+0000","last_became_active":"2024-09-11T22:14:26.968962+0000","last_became_peered":"2024-09-11T22:14:26.968962+0000","last_unstale":"2024-09-11T22:14:27.956917+0000","last_undegraded":"2024-09-11T22:14:27.956917+0000","last_fullsized":"2024-09-11T22:14:27.956917+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:34.920148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.954203+0000","last_change":"2024-09-11T22:14:25.955890+0000","last_active":"2024-09-11T22:14:26.954203+0000","last_peered":"2024-09-11T22:14:26.954203+0000","last_clean":"2024-09-11T22:14:26.954203+0000","last_became_active":"2024-09-11T22:14:25.955601+0000","last_became_peered":"2024-09-11T22:14:25.955601+0000","last_unstale":"2024-09-11T22:14:26.954203+0000","last_undegraded":"2024-09-11T22:14:26.954203+0000","last_fullsized":"2024-09-11T22:14:26.954203+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:25.167921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.970806+0000","last_change":"2024-09-11T22:14:26.967750+0000","last_active":"2024-09-11T22:14:26.970806+0000","last_peered":"2024-09-11T22:14:26.970806+0000","last_clean":"2024-09-11T22:14:26.970806+0000","last_became_active":"2024-09-11T22:14:26.967492+0000","last_became_peered":"2024-09-11T22:14:26.967492+0000","last_unstale":"2024-09-11T22:14:26.970806+0000","last_undegraded":"2024-09-11T22:14:26.970806+0000","last_fullsized":"2024-09-11T22:14:26.970806+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:31.624389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238185+0000","last_change":"2024-09-11T22:14:25.951977+0000","last_active":"2024-09-11T22:14:29.238185+0000","last_peered":"2024-09-11T22:14:29.238185+0000","last_clean":"2024-09-11T22:14:29.238185+0000","last_became_active":"2024-09-11T22:14:25.951186+0000","last_became_peered":"2024-09-11T22:14:25.951186+0000","last_unstale":"2024-09-11T22:14:29.238185+0000","last_undegraded":"2024-09-11T22:14:29.238185+0000","last_fullsized":"2024-09-11T22:14:29.238185+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:42.115865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650581+0000","last_change":"2024-09-11T22:14:26.966320+0000","last_active":"2024-09-11T22:14:28.650581+0000","last_peered":"2024-09-11T22:14:28.650581+0000","last_clean":"2024-09-11T22:14:28.650581+0000","last_became_active":"2024-09-11T22:14:26.966062+0000","last_became_peered":"2024-09-11T22:14:26.966062+0000","last_unstale":"2024-09-11T22:14:28.650581+0000","last_undegraded":"2024-09-11T22:14:28.650581+0000","last_fullsized":"2024-09-11T22:14:28.650581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:18.648523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.969140+0000","last_change":"2024-09-11T22:14:25.958570+0000","last_active":"2024-09-11T22:14:26.969140+0000","last_peered":"2024-09-11T22:14:26.969140+0000","last_clean":"2024-09-11T22:14:26.969140+0000","last_became_active":"2024-09-11T22:14:25.958356+0000","last_became_peered":"2024-09-11T22:14:25.958356+0000","last_unstale":"2024-09-11T22:14:26.969140+0000","last_undegraded":"2024-09-11T22:14:26.969140+0000","last_fullsized":"2024-09-11T22:14:26.969140+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:29.549649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973134+0000","last_change":"2024-09-11T22:14:26.968253+0000","last_active":"2024-09-11T22:14:26.973134+0000","last_peered":"2024-09-11T22:14:26.973134+0000","last_clean":"2024-09-11T22:14:26.973134+0000","last_became_active":"2024-09-11T22:14:26.967949+0000","last_became_peered":"2024-09-11T22:14:26.967949+0000","last_unstale":"2024-09-11T22:14:26.973134+0000","last_undegraded":"2024-09-11T22:14:26.973134+0000","last_fullsized":"2024-09-11T22:14:26.973134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:30.165873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956950+0000","last_change":"2024-09-11T22:14:25.956145+0000","last_active":"2024-09-11T22:14:27.956950+0000","last_peered":"2024-09-11T22:14:27.956950+0000","last_clean":"2024-09-11T22:14:27.956950+0000","last_became_active":"2024-09-11T22:14:25.955833+0000","last_became_peered":"2024-09-11T22:14:25.955833+0000","last_unstale":"2024-09-11T22:14:27.956950+0000","last_undegraded":"2024-09-11T22:14:27.956950+0000","last_fullsized":"2024-09-11T22:14:27.956950+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:34.327331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956077+0000","last_change":"2024-09-11T22:14:26.959737+0000","last_active":"2024-09-11T22:14:27.956077+0000","last_peered":"2024-09-11T22:14:27.956077+0000","last_clean":"2024-09-11T22:14:27.956077+0000","last_became_active":"2024-09-11T22:14:26.959509+0000","last_became_peered":"2024-09-11T22:14:26.959509+0000","last_unstale":"2024-09-11T22:14:27.956077+0000","last_undegraded":"2024-09-11T22:14:27.956077+0000","last_fullsized":"2024-09-11T22:14:27.956077+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237856+0000","last_change":"2024-09-11T22:14:25.959102+0000","last_active":"2024-09-11T22:14:29.237856+0000","last_peered":"2024-09-11T22:14:29.237856+0000","last_clean":"2024-09-11T22:14:29.237856+0000","last_became_active":"2024-09-11T22:14:25.956666+0000","last_became_peered":"2024-09-11T22:14:25.956666+0000","last_unstale":"2024-09-11T22:14:29.237856+0000","last_undegraded":"2024-09-11T22:14:29.237856+0000","last_fullsized":"2024-09-11T22:14:29.237856+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:13.506850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.962976+0000","last_change":"2024-09-11T22:14:26.960877+0000","last_active":"2024-09-11T22:14:26.962976+0000","last_peered":"2024-09-11T22:14:26.962976+0000","last_clean":"2024-09-11T22:14:26.962976+0000","last_became_active":"2024-09-11T22:14:26.960545+0000","last_became_peered":"2024-09-11T22:14:26.960545+0000","last_unstale":"2024-09-11T22:14:26.962976+0000","last_undegraded":"2024-09-11T22:14:26.962976+0000","last_fullsized":"2024-09-11T22:14:26.962976+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:14.172517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045066+0000","last_change":"2024-09-11T22:14:25.954749+0000","last_active":"2024-09-11T22:14:28.045066+0000","last_peered":"2024-09-11T22:14:28.045066+0000","last_clean":"2024-09-11T22:14:28.045066+0000","last_became_active":"2024-09-11T22:14:25.954401+0000","last_became_peered":"2024-09-11T22:14:25.954401+0000","last_unstale":"2024-09-11T22:14:28.045066+0000","last_undegraded":"2024-09-11T22:14:28.045066+0000","last_fullsized":"2024-09-11T22:14:28.045066+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:44.892896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955926+0000","last_change":"2024-09-11T22:14:26.963837+0000","last_active":"2024-09-11T22:14:27.955926+0000","last_peered":"2024-09-11T22:14:27.955926+0000","last_clean":"2024-09-11T22:14:27.955926+0000","last_became_active":"2024-09-11T22:14:26.963576+0000","last_became_peered":"2024-09-11T22:14:26.963576+0000","last_unstale":"2024-09-11T22:14:27.955926+0000","last_undegraded":"2024-09-11T22:14:27.955926+0000","last_fullsized":"2024-09-11T22:14:27.955926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:11.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957202+0000","last_change":"2024-09-11T22:14:25.951651+0000","last_active":"2024-09-11T22:14:27.957202+0000","last_peered":"2024-09-11T22:14:27.957202+0000","last_clean":"2024-09-11T22:14:27.957202+0000","last_became_active":"2024-09-11T22:14:25.951299+0000","last_became_peered":"2024-09-11T22:14:25.951299+0000","last_unstale":"2024-09-11T22:14:27.957202+0000","last_undegraded":"2024-09-11T22:14:27.957202+0000","last_fullsized":"2024-09-11T22:14:27.957202+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:33.912546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973466+0000","last_change":"2024-09-11T22:14:26.972480+0000","last_active":"2024-09-11T22:14:26.973466+0000","last_peered":"2024-09-11T22:14:26.973466+0000","last_clean":"2024-09-11T22:14:26.973466+0000","last_became_active":"2024-09-11T22:14:26.972332+0000","last_became_peered":"2024-09-11T22:14:26.972332+0000","last_unstale":"2024-09-11T22:14:26.973466+0000","last_undegraded":"2024-09-11T22:14:26.973466+0000","last_fullsized":"2024-09-11T22:14:26.973466+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:53.958006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.966367+0000","last_change":"2024-09-11T22:14:25.956614+0000","last_active":"2024-09-11T22:14:26.966367+0000","last_peered":"2024-09-11T22:14:26.966367+0000","last_clean":"2024-09-11T22:14:26.966367+0000","last_became_active":"2024-09-11T22:14:25.956306+0000","last_became_peered":"2024-09-11T22:14:25.956306+0000","last_unstale":"2024-09-11T22:14:26.966367+0000","last_undegraded":"2024-09-11T22:14:26.966367+0000","last_fullsized":"2024-09-11T22:14:26.966367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:39.705969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.968425+0000","last_change":"2024-09-11T22:14:26.966426+0000","last_active":"2024-09-11T22:14:26.968425+0000","last_peered":"2024-09-11T22:14:26.968425+0000","last_clean":"2024-09-11T22:14:26.968425+0000","last_became_active":"2024-09-11T22:14:26.966157+0000","last_became_peered":"2024-09-11T22:14:26.966157+0000","last_unstale":"2024-09-11T22:14:26.968425+0000","last_undegraded":"2024-09-11T22:14:26.968425+0000","last_fullsized":"2024-09-11T22:14:26.968425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:21.554097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238251+0000","last_change":"2024-09-11T22:14:25.960512+0000","last_active":"2024-09-11T22:14:29.238251+0000","last_peered":"2024-09-11T22:14:29.238251+0000","last_clean":"2024-09-11T22:14:29.238251+0000","last_became_active":"2024-09-11T22:14:25.960249+0000","last_became_peered":"2024-09-11T22:14:25.960249+0000","last_unstale":"2024-09-11T22:14:29.238251+0000","last_undegraded":"2024-09-11T22:14:29.238251+0000","last_fullsized":"2024-09-11T22:14:29.238251+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:12.252400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956341+0000","last_change":"2024-09-11T22:14:26.960080+0000","last_active":"2024-09-11T22:14:27.956341+0000","last_peered":"2024-09-11T22:14:27.956341+0000","last_clean":"2024-09-11T22:14:27.956341+0000","last_became_active":"2024-09-11T22:14:26.959778+0000","last_became_peered":"2024-09-11T22:14:26.959778+0000","last_unstale":"2024-09-11T22:14:27.956341+0000","last_undegraded":"2024-09-11T22:14:27.956341+0000","last_fullsized":"2024-09-11T22:14:27.956341+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:14.514452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955559+0000","last_change":"2024-09-11T22:14:25.953232+0000","last_active":"2024-09-11T22:14:27.955559+0000","last_peered":"2024-09-11T22:14:27.955559+0000","last_clean":"2024-09-11T22:14:27.955559+0000","last_became_active":"2024-09-11T22:14:25.952951+0000","last_became_peered":"2024-09-11T22:14:25.952951+0000","last_unstale":"2024-09-11T22:14:27.955559+0000","last_undegraded":"2024-09-11T22:14:27.955559+0000","last_fullsized":"2024-09-11T22:14:27.955559+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:31.695327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237924+0000","last_change":"2024-09-11T22:14:26.965790+0000","last_active":"2024-09-11T22:14:29.237924+0000","last_peered":"2024-09-11T22:14:29.237924+0000","last_clean":"2024-09-11T22:14:29.237924+0000","last_became_active":"2024-09-11T22:14:26.965502+0000","last_became_peered":"2024-09-11T22:14:26.965502+0000","last_unstale":"2024-09-11T22:14:29.237924+0000","last_undegraded":"2024-09-11T22:14:29.237924+0000","last_fullsized":"2024-09-11T22:14:29.237924+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:51.944511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956610+0000","last_change":"2024-09-11T22:14:25.951206+0000","last_active":"2024-09-11T22:14:27.956610+0000","last_peered":"2024-09-11T22:14:27.956610+0000","last_clean":"2024-09-11T22:14:27.956610+0000","last_became_active":"2024-09-11T22:14:25.950899+0000","last_became_peered":"2024-09-11T22:14:25.950899+0000","last_unstale":"2024-09-11T22:14:27.956610+0000","last_undegraded":"2024-09-11T22:14:27.956610+0000","last_fullsized":"2024-09-11T22:14:27.956610+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:44.656561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973155+0000","last_change":"2024-09-11T22:14:26.968273+0000","last_active":"2024-09-11T22:14:26.973155+0000","last_peered":"2024-09-11T22:14:26.973155+0000","last_clean":"2024-09-11T22:14:26.973155+0000","last_became_active":"2024-09-11T22:14:26.967984+0000","last_became_peered":"2024-09-11T22:14:26.967984+0000","last_unstale":"2024-09-11T22:14:26.973155+0000","last_undegraded":"2024-09-11T22:14:26.973155+0000","last_fullsized":"2024-09-11T22:14:26.973155+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:44.444736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955266+0000","last_change":"2024-09-11T22:14:25.958361+0000","last_active":"2024-09-11T22:14:27.955266+0000","last_peered":"2024-09-11T22:14:27.955266+0000","last_clean":"2024-09-11T22:14:27.955266+0000","last_became_active":"2024-09-11T22:14:25.957879+0000","last_became_peered":"2024-09-11T22:14:25.957879+0000","last_unstale":"2024-09-11T22:14:27.955266+0000","last_undegraded":"2024-09-11T22:14:27.955266+0000","last_fullsized":"2024-09-11T22:14:27.955266+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:52.954746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956243+0000","last_change":"2024-09-11T22:14:26.959870+0000","last_active":"2024-09-11T22:14:27.956243+0000","last_peered":"2024-09-11T22:14:27.956243+0000","last_clean":"2024-09-11T22:14:27.956243+0000","last_became_active":"2024-09-11T22:14:26.957903+0000","last_became_peered":"2024-09-11T22:14:26.957903+0000","last_unstale":"2024-09-11T22:14:27.956243+0000","last_undegraded":"2024-09-11T22:14:27.956243+0000","last_fullsized":"2024-09-11T22:14:27.956243+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:16.543726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238146+0000","last_change":"2024-09-11T22:14:25.958591+0000","last_active":"2024-09-11T22:14:29.238146+0000","last_peered":"2024-09-11T22:14:29.238146+0000","last_clean":"2024-09-11T22:14:29.238146+0000","last_became_active":"2024-09-11T22:14:25.958303+0000","last_became_peered":"2024-09-11T22:14:25.958303+0000","last_unstale":"2024-09-11T22:14:29.238146+0000","last_undegraded":"2024-09-11T22:14:29.238146+0000","last_fullsized":"2024-09-11T22:14:29.238146+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:24.724328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955309+0000","last_change":"2024-09-11T22:14:26.957372+0000","last_active":"2024-09-11T22:14:27.955309+0000","last_peered":"2024-09-11T22:14:27.955309+0000","last_clean":"2024-09-11T22:14:27.955309+0000","last_became_active":"2024-09-11T22:14:26.956741+0000","last_became_peered":"2024-09-11T22:14:26.956741+0000","last_unstale":"2024-09-11T22:14:27.955309+0000","last_undegraded":"2024-09-11T22:14:27.955309+0000","last_fullsized":"2024-09-11T22:14:27.955309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.496550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650503+0000","last_change":"2024-09-11T22:14:25.954496+0000","last_active":"2024-09-11T22:14:28.650503+0000","last_peered":"2024-09-11T22:14:28.650503+0000","last_clean":"2024-09-11T22:14:28.650503+0000","last_became_active":"2024-09-11T22:14:25.954243+0000","last_became_peered":"2024-09-11T22:14:25.954243+0000","last_unstale":"2024-09-11T22:14:28.650503+0000","last_undegraded":"2024-09-11T22:14:28.650503+0000","last_fullsized":"2024-09-11T22:14:28.650503+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:39.537090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955070+0000","last_change":"2024-09-11T22:14:26.958126+0000","last_active":"2024-09-11T22:14:27.955070+0000","last_peered":"2024-09-11T22:14:27.955070+0000","last_clean":"2024-09-11T22:14:27.955070+0000","last_became_active":"2024-09-11T22:14:26.957849+0000","last_became_peered":"2024-09-11T22:14:26.957849+0000","last_unstale":"2024-09-11T22:14:27.955070+0000","last_undegraded":"2024-09-11T22:14:27.955070+0000","last_fullsized":"2024-09-11T22:14:27.955070+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:46.007324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955914+0000","last_change":"2024-09-11T22:14:25.957351+0000","last_active":"2024-09-11T22:14:27.955914+0000","last_peered":"2024-09-11T22:14:27.955914+0000","last_clean":"2024-09-11T22:14:27.955914+0000","last_became_active":"2024-09-11T22:14:25.957078+0000","last_became_peered":"2024-09-11T22:14:25.957078+0000","last_unstale":"2024-09-11T22:14:27.955914+0000","last_undegraded":"2024-09-11T22:14:27.955914+0000","last_fullsized":"2024-09-11T22:14:27.955914+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:10.280169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957199+0000","last_change":"2024-09-11T22:14:26.959295+0000","last_active":"2024-09-11T22:14:27.957199+0000","last_peered":"2024-09-11T22:14:27.957199+0000","last_clean":"2024-09-11T22:14:27.957199+0000","last_became_active":"2024-09-11T22:14:26.958326+0000","last_became_peered":"2024-09-11T22:14:26.958326+0000","last_unstale":"2024-09-11T22:14:27.957199+0000","last_undegraded":"2024-09-11T22:14:27.957199+0000","last_fullsized":"2024-09-11T22:14:27.957199+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:13.260002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650693+0000","last_change":"2024-09-11T22:14:25.957828+0000","last_active":"2024-09-11T22:14:28.650693+0000","last_peered":"2024-09-11T22:14:28.650693+0000","last_clean":"2024-09-11T22:14:28.650693+0000","last_became_active":"2024-09-11T22:14:25.957530+0000","last_became_peered":"2024-09-11T22:14:25.957530+0000","last_unstale":"2024-09-11T22:14:28.650693+0000","last_undegraded":"2024-09-11T22:14:28.650693+0000","last_fullsized":"2024-09-11T22:14:28.650693+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:33.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956558+0000","last_change":"2024-09-11T22:14:26.962695+0000","last_active":"2024-09-11T22:14:27.956558+0000","last_peered":"2024-09-11T22:14:27.956558+0000","last_clean":"2024-09-11T22:14:27.956558+0000","last_became_active":"2024-09-11T22:14:26.962168+0000","last_became_peered":"2024-09-11T22:14:26.962168+0000","last_unstale":"2024-09-11T22:14:27.956558+0000","last_undegraded":"2024-09-11T22:14:27.956558+0000","last_fullsized":"2024-09-11T22:14:27.956558+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:25.731929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.948031+0000","last_change":"2024-09-11T22:14:25.954069+0000","last_active":"2024-09-11T22:14:28.948031+0000","last_peered":"2024-09-11T22:14:28.948031+0000","last_clean":"2024-09-11T22:14:28.948031+0000","last_became_active":"2024-09-11T22:14:25.953797+0000","last_became_peered":"2024-09-11T22:14:25.953797+0000","last_unstale":"2024-09-11T22:14:28.948031+0000","last_undegraded":"2024-09-11T22:14:28.948031+0000","last_fullsized":"2024-09-11T22:14:28.948031+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:34.327331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650617+0000","last_change":"2024-09-11T22:14:26.965457+0000","last_active":"2024-09-11T22:14:28.650617+0000","last_peered":"2024-09-11T22:14:28.650617+0000","last_clean":"2024-09-11T22:14:28.650617+0000","last_became_active":"2024-09-11T22:14:26.965210+0000","last_became_peered":"2024-09-11T22:14:26.965210+0000","last_unstale":"2024-09-11T22:14:28.650617+0000","last_undegraded":"2024-09-11T22:14:28.650617+0000","last_fullsized":"2024-09-11T22:14:28.650617+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:35.334932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045209+0000","last_change":"2024-09-11T22:14:25.954345+0000","last_active":"2024-09-11T22:14:28.045209+0000","last_peered":"2024-09-11T22:14:28.045209+0000","last_clean":"2024-09-11T22:14:28.045209+0000","last_became_active":"2024-09-11T22:14:25.954043+0000","last_became_peered":"2024-09-11T22:14:25.954043+0000","last_unstale":"2024-09-11T22:14:28.045209+0000","last_undegraded":"2024-09-11T22:14:28.045209+0000","last_fullsized":"2024-09-11T22:14:28.045209+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:51.604884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955489+0000","last_change":"2024-09-11T22:14:26.960931+0000","last_active":"2024-09-11T22:14:27.955489+0000","last_peered":"2024-09-11T22:14:27.955489+0000","last_clean":"2024-09-11T22:14:27.955489+0000","last_became_active":"2024-09-11T22:14:26.960291+0000","last_became_peered":"2024-09-11T22:14:26.960291+0000","last_unstale":"2024-09-11T22:14:27.955489+0000","last_undegraded":"2024-09-11T22:14:27.955489+0000","last_fullsized":"2024-09-11T22:14:27.955489+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:16.543726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957332+0000","last_change":"2024-09-11T22:14:25.950162+0000","last_active":"2024-09-11T22:14:27.957332+0000","last_peered":"2024-09-11T22:14:27.957332+0000","last_clean":"2024-09-11T22:14:27.957332+0000","last_became_active":"2024-09-11T22:14:25.949856+0000","last_became_peered":"2024-09-11T22:14:25.949856+0000","last_unstale":"2024-09-11T22:14:27.957332+0000","last_undegraded":"2024-09-11T22:14:27.957332+0000","last_fullsized":"2024-09-11T22:14:27.957332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:16.056310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237864+0000","last_change":"2024-09-11T22:14:26.968109+0000","last_active":"2024-09-11T22:14:29.237864+0000","last_peered":"2024-09-11T22:14:29.237864+0000","last_clean":"2024-09-11T22:14:29.237864+0000","last_became_active":"2024-09-11T22:14:26.967838+0000","last_became_peered":"2024-09-11T22:14:26.967838+0000","last_unstale":"2024-09-11T22:14:29.237864+0000","last_undegraded":"2024-09-11T22:14:29.237864+0000","last_fullsized":"2024-09-11T22:14:29.237864+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:44.391169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650403+0000","last_change":"2024-09-11T22:14:25.953604+0000","last_active":"2024-09-11T22:14:28.650403+0000","last_peered":"2024-09-11T22:14:28.650403+0000","last_clean":"2024-09-11T22:14:28.650403+0000","last_became_active":"2024-09-11T22:14:25.953317+0000","last_became_peered":"2024-09-11T22:14:25.953317+0000","last_unstale":"2024-09-11T22:14:28.650403+0000","last_undegraded":"2024-09-11T22:14:28.650403+0000","last_fullsized":"2024-09-11T22:14:28.650403+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:56.831702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973444+0000","last_change":"2024-09-11T22:14:26.971798+0000","last_active":"2024-09-11T22:14:26.973444+0000","last_peered":"2024-09-11T22:14:26.973444+0000","last_clean":"2024-09-11T22:14:26.973444+0000","last_became_active":"2024-09-11T22:14:26.971548+0000","last_became_peered":"2024-09-11T22:14:26.971548+0000","last_unstale":"2024-09-11T22:14:26.973444+0000","last_undegraded":"2024-09-11T22:14:26.973444+0000","last_fullsized":"2024-09-11T22:14:26.973444+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:44.655053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956340+0000","last_change":"2024-09-11T22:14:25.955614+0000","last_active":"2024-09-11T22:14:27.956340+0000","last_peered":"2024-09-11T22:14:27.956340+0000","last_clean":"2024-09-11T22:14:27.956340+0000","last_became_active":"2024-09-11T22:14:25.955095+0000","last_became_peered":"2024-09-11T22:14:25.955095+0000","last_unstale":"2024-09-11T22:14:27.956340+0000","last_undegraded":"2024-09-11T22:14:27.956340+0000","last_fullsized":"2024-09-11T22:14:27.956340+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:12.454865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650348+0000","last_change":"2024-09-11T22:14:26.963669+0000","last_active":"2024-09-11T22:14:28.650348+0000","last_peered":"2024-09-11T22:14:28.650348+0000","last_clean":"2024-09-11T22:14:28.650348+0000","last_became_active":"2024-09-11T22:14:26.963377+0000","last_became_peered":"2024-09-11T22:14:26.963377+0000","last_unstale":"2024-09-11T22:14:28.650348+0000","last_undegraded":"2024-09-11T22:14:28.650348+0000","last_fullsized":"2024-09-11T22:14:28.650348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:32.702928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650495+0000","last_change":"2024-09-11T22:14:25.955422+0000","last_active":"2024-09-11T22:14:28.650495+0000","last_peered":"2024-09-11T22:14:28.650495+0000","last_clean":"2024-09-11T22:14:28.650495+0000","last_became_active":"2024-09-11T22:14:25.955133+0000","last_became_peered":"2024-09-11T22:14:25.955133+0000","last_unstale":"2024-09-11T22:14:28.650495+0000","last_undegraded":"2024-09-11T22:14:28.650495+0000","last_fullsized":"2024-09-11T22:14:28.650495+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.631686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237726+0000","last_change":"2024-09-11T22:14:26.959240+0000","last_active":"2024-09-11T22:14:29.237726+0000","last_peered":"2024-09-11T22:14:29.237726+0000","last_clean":"2024-09-11T22:14:29.237726+0000","last_became_active":"2024-09-11T22:14:26.958616+0000","last_became_peered":"2024-09-11T22:14:26.958616+0000","last_unstale":"2024-09-11T22:14:29.237726+0000","last_undegraded":"2024-09-11T22:14:29.237726+0000","last_fullsized":"2024-09-11T22:14:29.237726+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:24.318239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237850+0000","last_change":"2024-09-11T22:14:25.958671+0000","last_active":"2024-09-11T22:14:29.237850+0000","last_peered":"2024-09-11T22:14:29.237850+0000","last_clean":"2024-09-11T22:14:29.237850+0000","last_became_active":"2024-09-11T22:14:25.958219+0000","last_became_peered":"2024-09-11T22:14:25.958219+0000","last_unstale":"2024-09-11T22:14:29.237850+0000","last_undegraded":"2024-09-11T22:14:29.237850+0000","last_fullsized":"2024-09-11T22:14:29.237850+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:40.924340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237952+0000","last_change":"2024-09-11T22:14:26.960588+0000","last_active":"2024-09-11T22:14:29.237952+0000","last_peered":"2024-09-11T22:14:29.237952+0000","last_clean":"2024-09-11T22:14:29.237952+0000","last_became_active":"2024-09-11T22:14:26.959947+0000","last_became_peered":"2024-09-11T22:14:26.959947+0000","last_unstale":"2024-09-11T22:14:29.237952+0000","last_undegraded":"2024-09-11T22:14:29.237952+0000","last_fullsized":"2024-09-11T22:14:29.237952+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:07.334337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045119+0000","last_change":"2024-09-11T22:14:25.954833+0000","last_active":"2024-09-11T22:14:28.045119+0000","last_peered":"2024-09-11T22:14:28.045119+0000","last_clean":"2024-09-11T22:14:28.045119+0000","last_became_active":"2024-09-11T22:14:25.954546+0000","last_became_peered":"2024-09-11T22:14:25.954546+0000","last_unstale":"2024-09-11T22:14:28.045119+0000","last_undegraded":"2024-09-11T22:14:28.045119+0000","last_fullsized":"2024-09-11T22:14:28.045119+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:25.578897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":237,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.948896+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:14:26.948896+0000","last_peered":"2024-09-11T22:14:26.948896+0000","last_clean":"2024-09-11T22:14:26.948896+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:14:26.948896+0000","last_undegraded":"2024-09-11T22:14:26.948896+0000","last_fullsized":"2024-09-11T22:14:26.948896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36032,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335808,"statfs":{"total":96636764160,"available":96599867392,"internally_reserved":0,"allocated":700416,"data_stored":292137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36044,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335796,"statfs":{"total":96636764160,"available":96599855104,"internally_reserved":0,"allocated":708608,"data_stored":292789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36048,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335792,"statfs":{"total":96636764160,"available":96599851008,"internally_reserved":0,"allocated":712704,"data_stored":293749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44352,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327488,"statfs":{"total":96636764160,"available":96591347712,"internally_reserved":0,"allocated":696320,"data_stored":285893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":692224,"data_stored":285927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40788,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331052,"statfs":{"total":96636764160,"available":96594997248,"internally_reserved":0,"allocated":1310720,"data_stored":884699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36592,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335248,"statfs":{"total":96636764160,"available":96599293952,"internally_reserved":0,"allocated":1269760,"data_stored":869430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40160,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331680,"statfs":{"total":96636764160,"available":96595640320,"internally_reserved":0,"allocated":663552,"data_stored":272795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:14:29.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:14:30.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.070+0000 7f7ea0add640 1 Processor -- start 2024-09-11T22:14:30.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.070+0000 7f7ea0add640 1 -- start start 2024-09-11T22:14:30.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.071+0000 7f7ea0add640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e9c15e840 0x7f7e9c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.071+0000 7f7ea0add640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9c0cdd50 0x7f7e9c0cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.071+0000 7f7ea0add640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e9c0cf3b0 0x7f7e9c0d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.071+0000 7f7ea0add640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7e9c06c240 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.071+0000 7f7ea0add640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7e9c0d0470 con 0x7f7e9c15e840 2024-09-11T22:14:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.071+0000 7f7ea0add640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7e9c0ce5f0 con 0x7f7e9c0cdd50 2024-09-11T22:14:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.071+0000 7f7e9ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e9c0cf3b0 0x7f7e9c0d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.071+0000 7f7e9ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e9c0cf3b0 0x7f7e9c0d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50360/0 (socket says 172.21.15.50:50360) 2024-09-11T22:14:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.071+0000 7f7e9ad9d640 1 -- 172.21.15.50:0/3853990210 learned_addr learned my addr 172.21.15.50:0/3853990210 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.071+0000 7f7e99d9b640 1 --2- 172.21.15.50:0/3853990210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9c0cdd50 0x7f7e9c0cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.071+0000 7f7e9a59c640 1 --2- 172.21.15.50:0/3853990210 >> v2:172.21.15.77:3300/0 conn(0x7f7e9c15e840 0x7f7e9c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.072+0000 7f7e9ad9d640 1 -- 172.21.15.50:0/3853990210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9c0cdd50 msgr2=0x7f7e9c0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.072+0000 7f7e9ad9d640 1 --2- 172.21.15.50:0/3853990210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9c0cdd50 0x7f7e9c0cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.072+0000 7f7e9ad9d640 1 -- 172.21.15.50:0/3853990210 >> v2:172.21.15.77:3300/0 conn(0x7f7e9c15e840 msgr2=0x7f7e9c0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.072+0000 7f7e9ad9d640 1 --2- 172.21.15.50:0/3853990210 >> v2:172.21.15.77:3300/0 conn(0x7f7e9c15e840 0x7f7e9c0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.072+0000 7f7e9ad9d640 1 -- 172.21.15.50:0/3853990210 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9c0ce310 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.072+0000 7f7e9ad9d640 1 --2- 172.21.15.50:0/3853990210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9c0cf3b0 0x7f7e9c0d0710 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009e50 tx=0x7f7e8c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1a2e400340694 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.073+0000 7f7e9959a640 1 -- 172.21.15.50:0/3853990210 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c036070 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.073+0000 7f7e9959a640 1 -- 172.21.15.50:0/3853990210 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8c031600 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.073+0000 7f7e9959a640 1 -- 172.21.15.50:0/3853990210 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0319d0 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.073+0000 7f7ea0add640 1 -- 172.21.15.50:0/3853990210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9c0cf3b0 msgr2=0x7f7e9c0d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.073+0000 7f7ea0add640 1 --2- 172.21.15.50:0/3853990210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9c0cf3b0 0x7f7e9c0d0710 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009e50 tx=0x7f7e8c02a6c0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.073+0000 7f7ea0add640 1 -- 172.21.15.50:0/3853990210 shutdown_connections 2024-09-11T22:14:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.073+0000 7f7ea0add640 1 --2- 172.21.15.50:0/3853990210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9c0cf3b0 0x7f7e9c0d0710 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.073+0000 7f7ea0add640 1 --2- 172.21.15.50:0/3853990210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9c0cdd50 0x7f7e9c0cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.073+0000 7f7ea0add640 1 --2- 172.21.15.50:0/3853990210 >> v2:172.21.15.77:3300/0 conn(0x7f7e9c15e840 0x7f7e9c0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.073+0000 7f7ea0add640 1 -- 172.21.15.50:0/3853990210 >> 172.21.15.50:0/3853990210 conn(0x7f7e9c0b4150 msgr2=0x7f7e9c0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.073+0000 7f7ea0add640 1 -- 172.21.15.50:0/3853990210 shutdown_connections 2024-09-11T22:14:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.073+0000 7f7ea0add640 1 -- 172.21.15.50:0/3853990210 wait complete. 2024-09-11T22:14:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.075+0000 7f7ea0add640 1 Processor -- start 2024-09-11T22:14:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.075+0000 7f7ea0add640 1 -- start start 2024-09-11T22:14:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.075+0000 7f7ea0add640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9c0cdd50 0x7f7e9c14c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.075+0000 7f7ea0add640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9c0cf3b0 0x7f7e9c0b7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.075+0000 7f7ea0add640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9c15e840 0x7f7e9c15bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.075+0000 7f7ea0add640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9c15ec20 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.075+0000 7f7ea0add640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9c06bed0 con 0x7f7e9c15e840 2024-09-11T22:14:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.075+0000 7f7ea0add640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7e9c15eda0 con 0x7f7e9c0cdd50 2024-09-11T22:14:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.075+0000 7f7e99d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9c0cf3b0 0x7f7e9c0b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.075+0000 7f7e99d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9c0cf3b0 0x7f7e9c0b7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50374/0 (socket says 172.21.15.50:50374) 2024-09-11T22:14:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7e99d9b640 1 -- 172.21.15.50:0/2866474710 learned_addr learned my addr 172.21.15.50:0/2866474710 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7e9ad9d640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9c15e840 0x7f7e9c15bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7e9a59c640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9c0cdd50 0x7f7e9c14c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7e99d9b640 1 -- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9c0cdd50 msgr2=0x7f7e9c14c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7e99d9b640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9c0cdd50 0x7f7e9c14c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7e99d9b640 1 -- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9c15e840 msgr2=0x7f7e9c15bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7e99d9b640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9c15e840 0x7f7e9c15bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7e99d9b640 1 -- 172.21.15.50:0/2866474710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9c14cf00 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7e99d9b640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9c0cf3b0 0x7f7e9c0b7310 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400e860 tx=0x7f7e8400ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7e92ffd640 1 -- 172.21.15.50:0/2866474710 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84017070 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7e92ffd640 1 -- 172.21.15.50:0/2866474710 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8400c940 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7ea0add640 1 -- 172.21.15.50:0/2866474710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e9c0b7b60 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7e92ffd640 1 -- 172.21.15.50:0/2866474710 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8400cd10 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.076+0000 7f7ea0add640 1 -- 172.21.15.50:0/2866474710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e9c14d1e0 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.077+0000 7f7ea0add640 1 -- 172.21.15.50:0/2866474710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e9c0cee70 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.078+0000 7f7e92ffd640 1 -- 172.21.15.50:0/2866474710 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e8401a070 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.078+0000 7f7e92ffd640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.079+0000 7f7e92ffd640 1 -- 172.21.15.50:0/2866474710 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f7e8408afe0 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.079+0000 7f7e9a59c640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.079+0000 7f7e9a59c640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009a30 tx=0x7f7e94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.083+0000 7f7e92ffd640 1 -- 172.21.15.50:0/2866474710 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e9c14cf00 con 0x7f7e9c0cf3b0 2024-09-11T22:14:30.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.256+0000 7f7ea0add640 1 -- 172.21.15.50:0/2866474710 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e9c0b7850 con 0x7f7e7c06be30 2024-09-11T22:14:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.263+0000 7f7e92ffd640 1 -- 172.21.15.50:0/2866474710 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251451 (secure 0 0 0) 0x7f7e9c0b7850 con 0x7f7e7c06be30 2024-09-11T22:14:30.268 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:30.270 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:14:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.266+0000 7f7ea0add640 1 -- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7c06be30 msgr2=0x7f7e7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.266+0000 7f7ea0add640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009a30 tx=0x7f7e94008040 comp rx=0 tx=0).stop 2024-09-11T22:14:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.266+0000 7f7ea0add640 1 -- 172.21.15.50:0/2866474710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9c0cf3b0 msgr2=0x7f7e9c0b7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.266+0000 7f7ea0add640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9c0cf3b0 0x7f7e9c0b7310 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400e860 tx=0x7f7e8400ed20 comp rx=0 tx=0).stop 2024-09-11T22:14:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.266+0000 7f7ea0add640 1 -- 172.21.15.50:0/2866474710 shutdown_connections 2024-09-11T22:14:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.266+0000 7f7ea0add640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.266+0000 7f7ea0add640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9c15e840 0x7f7e9c15bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.266+0000 7f7ea0add640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e9c0cf3b0 0x7f7e9c0b7310 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.266+0000 7f7ea0add640 1 --2- 172.21.15.50:0/2866474710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9c0cdd50 0x7f7e9c14c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.266+0000 7f7ea0add640 1 -- 172.21.15.50:0/2866474710 >> 172.21.15.50:0/2866474710 conn(0x7f7e9c0b4150 msgr2=0x7f7e9c0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.266+0000 7f7ea0add640 1 -- 172.21.15.50:0/2866474710 shutdown_connections 2024-09-11T22:14:30.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.266+0000 7f7ea0add640 1 -- 172.21.15.50:0/2866474710 wait complete. 2024-09-11T22:14:30.277 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-11T22:14:29.410311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297720,"kb_used_data":6596,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754677000,"statfs":{"total":773094113280,"available":772789248000,"internally_reserved":0,"allocated":6754304,"data_stored":3477419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.475620"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.947823+0000","last_change":"2024-09-11T22:14:25.947823+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.947823+0000","last_undegraded":"2024-09-11T22:14:25.947823+0000","last_fullsized":"2024-09-11T22:14:25.947823+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238075+0000","last_change":"2024-09-11T22:14:26.959238+0000","last_active":"2024-09-11T22:14:29.238075+0000","last_peered":"2024-09-11T22:14:29.238075+0000","last_clean":"2024-09-11T22:14:29.238075+0000","last_became_active":"2024-09-11T22:14:26.958936+0000","last_became_peered":"2024-09-11T22:14:26.958936+0000","last_unstale":"2024-09-11T22:14:29.238075+0000","last_undegraded":"2024-09-11T22:14:29.238075+0000","last_fullsized":"2024-09-11T22:14:29.238075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:11.635531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.962988+0000","last_change":"2024-09-11T22:14:26.960744+0000","last_active":"2024-09-11T22:14:26.962988+0000","last_peered":"2024-09-11T22:14:26.962988+0000","last_clean":"2024-09-11T22:14:26.962988+0000","last_became_active":"2024-09-11T22:14:26.960440+0000","last_became_peered":"2024-09-11T22:14:26.960440+0000","last_unstale":"2024-09-11T22:14:26.962988+0000","last_undegraded":"2024-09-11T22:14:26.962988+0000","last_fullsized":"2024-09-11T22:14:26.962988+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:20.952546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956811+0000","last_change":"2024-09-11T22:14:26.959797+0000","last_active":"2024-09-11T22:14:27.956811+0000","last_peered":"2024-09-11T22:14:27.956811+0000","last_clean":"2024-09-11T22:14:27.956811+0000","last_became_active":"2024-09-11T22:14:26.959522+0000","last_became_peered":"2024-09-11T22:14:26.959522+0000","last_unstale":"2024-09-11T22:14:27.956811+0000","last_undegraded":"2024-09-11T22:14:27.956811+0000","last_fullsized":"2024-09-11T22:14:27.956811+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:41.931942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.948157+0000","last_change":"2024-09-11T22:14:25.948157+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.948157+0000","last_undegraded":"2024-09-11T22:14:25.948157+0000","last_fullsized":"2024-09-11T22:14:25.948157+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955059+0000","last_change":"2024-09-11T22:14:26.956023+0000","last_active":"2024-09-11T22:14:27.955059+0000","last_peered":"2024-09-11T22:14:27.955059+0000","last_clean":"2024-09-11T22:14:27.955059+0000","last_became_active":"2024-09-11T22:14:26.955721+0000","last_became_peered":"2024-09-11T22:14:26.955721+0000","last_unstale":"2024-09-11T22:14:27.955059+0000","last_undegraded":"2024-09-11T22:14:27.955059+0000","last_fullsized":"2024-09-11T22:14:27.955059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:54.886252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956720+0000","last_change":"2024-09-11T22:14:26.964660+0000","last_active":"2024-09-11T22:14:27.956720+0000","last_peered":"2024-09-11T22:14:27.956720+0000","last_clean":"2024-09-11T22:14:27.956720+0000","last_became_active":"2024-09-11T22:14:26.964404+0000","last_became_peered":"2024-09-11T22:14:26.964404+0000","last_unstale":"2024-09-11T22:14:27.956720+0000","last_undegraded":"2024-09-11T22:14:27.956720+0000","last_fullsized":"2024-09-11T22:14:27.956720+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:17.063912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237609+0000","last_change":"2024-09-11T22:14:26.960383+0000","last_active":"2024-09-11T22:14:29.237609+0000","last_peered":"2024-09-11T22:14:29.237609+0000","last_clean":"2024-09-11T22:14:29.237609+0000","last_became_active":"2024-09-11T22:14:26.959605+0000","last_became_peered":"2024-09-11T22:14:26.959605+0000","last_unstale":"2024-09-11T22:14:29.237609+0000","last_undegraded":"2024-09-11T22:14:29.237609+0000","last_fullsized":"2024-09-11T22:14:29.237609+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:52.664222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956335+0000","last_change":"2024-09-11T22:14:26.964503+0000","last_active":"2024-09-11T22:14:27.956335+0000","last_peered":"2024-09-11T22:14:27.956335+0000","last_clean":"2024-09-11T22:14:27.956335+0000","last_became_active":"2024-09-11T22:14:26.964196+0000","last_became_peered":"2024-09-11T22:14:26.964196+0000","last_unstale":"2024-09-11T22:14:27.956335+0000","last_undegraded":"2024-09-11T22:14:27.956335+0000","last_fullsized":"2024-09-11T22:14:27.956335+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:13.144193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650694+0000","last_change":"2024-09-11T22:14:26.959365+0000","last_active":"2024-09-11T22:14:28.650694+0000","last_peered":"2024-09-11T22:14:28.650694+0000","last_clean":"2024-09-11T22:14:28.650694+0000","last_became_active":"2024-09-11T22:14:26.958793+0000","last_became_peered":"2024-09-11T22:14:26.958793+0000","last_unstale":"2024-09-11T22:14:28.650694+0000","last_undegraded":"2024-09-11T22:14:28.650694+0000","last_fullsized":"2024-09-11T22:14:28.650694+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:53.962348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650807+0000","last_change":"2024-09-11T22:14:26.970469+0000","last_active":"2024-09-11T22:14:28.650807+0000","last_peered":"2024-09-11T22:14:28.650807+0000","last_clean":"2024-09-11T22:14:28.650807+0000","last_became_active":"2024-09-11T22:14:26.970170+0000","last_became_peered":"2024-09-11T22:14:26.970170+0000","last_unstale":"2024-09-11T22:14:28.650807+0000","last_undegraded":"2024-09-11T22:14:28.650807+0000","last_fullsized":"2024-09-11T22:14:28.650807+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:37.142401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956978+0000","last_change":"2024-09-11T22:14:26.961258+0000","last_active":"2024-09-11T22:14:27.956978+0000","last_peered":"2024-09-11T22:14:27.956978+0000","last_clean":"2024-09-11T22:14:27.956978+0000","last_became_active":"2024-09-11T22:14:26.960960+0000","last_became_peered":"2024-09-11T22:14:26.960960+0000","last_unstale":"2024-09-11T22:14:27.956978+0000","last_undegraded":"2024-09-11T22:14:27.956978+0000","last_fullsized":"2024-09-11T22:14:27.956978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:43.123466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045219+0000","last_change":"2024-09-11T22:14:26.955986+0000","last_active":"2024-09-11T22:14:28.045219+0000","last_peered":"2024-09-11T22:14:28.045219+0000","last_clean":"2024-09-11T22:14:28.045219+0000","last_became_active":"2024-09-11T22:14:26.955724+0000","last_became_peered":"2024-09-11T22:14:26.955724+0000","last_unstale":"2024-09-11T22:14:28.045219+0000","last_undegraded":"2024-09-11T22:14:28.045219+0000","last_fullsized":"2024-09-11T22:14:28.045219+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:24.565886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956239+0000","last_change":"2024-09-11T22:14:26.959090+0000","last_active":"2024-09-11T22:14:27.956239+0000","last_peered":"2024-09-11T22:14:27.956239+0000","last_clean":"2024-09-11T22:14:27.956239+0000","last_became_active":"2024-09-11T22:14:26.958825+0000","last_became_peered":"2024-09-11T22:14:26.958825+0000","last_unstale":"2024-09-11T22:14:27.956239+0000","last_undegraded":"2024-09-11T22:14:27.956239+0000","last_fullsized":"2024-09-11T22:14:27.956239+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:45.664163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956876+0000","last_change":"2024-09-11T22:14:26.957998+0000","last_active":"2024-09-11T22:14:27.956876+0000","last_peered":"2024-09-11T22:14:27.956876+0000","last_clean":"2024-09-11T22:14:27.956876+0000","last_became_active":"2024-09-11T22:14:26.957683+0000","last_became_peered":"2024-09-11T22:14:26.957683+0000","last_unstale":"2024-09-11T22:14:27.956876+0000","last_undegraded":"2024-09-11T22:14:27.956876+0000","last_fullsized":"2024-09-11T22:14:27.956876+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.544029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955000+0000","last_change":"2024-09-11T22:14:26.963903+0000","last_active":"2024-09-11T22:14:27.955000+0000","last_peered":"2024-09-11T22:14:27.955000+0000","last_clean":"2024-09-11T22:14:27.955000+0000","last_became_active":"2024-09-11T22:14:26.963640+0000","last_became_peered":"2024-09-11T22:14:26.963640+0000","last_unstale":"2024-09-11T22:14:27.955000+0000","last_undegraded":"2024-09-11T22:14:27.955000+0000","last_fullsized":"2024-09-11T22:14:27.955000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:14.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238138+0000","last_change":"2024-09-11T22:14:26.957389+0000","last_active":"2024-09-11T22:14:29.238138+0000","last_peered":"2024-09-11T22:14:29.238138+0000","last_clean":"2024-09-11T22:14:29.238138+0000","last_became_active":"2024-09-11T22:14:26.957118+0000","last_became_peered":"2024-09-11T22:14:26.957118+0000","last_unstale":"2024-09-11T22:14:29.238138+0000","last_undegraded":"2024-09-11T22:14:29.238138+0000","last_fullsized":"2024-09-11T22:14:29.238138+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:10.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.964922+0000","last_change":"2024-09-11T22:14:26.961999+0000","last_active":"2024-09-11T22:14:26.964922+0000","last_peered":"2024-09-11T22:14:26.964922+0000","last_clean":"2024-09-11T22:14:26.964922+0000","last_became_active":"2024-09-11T22:14:26.961653+0000","last_became_peered":"2024-09-11T22:14:26.961653+0000","last_unstale":"2024-09-11T22:14:26.964922+0000","last_undegraded":"2024-09-11T22:14:26.964922+0000","last_fullsized":"2024-09-11T22:14:26.964922+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:40.552647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.949112+0000","last_change":"2024-09-11T22:14:25.949112+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.949112+0000","last_undegraded":"2024-09-11T22:14:25.949112+0000","last_fullsized":"2024-09-11T22:14:25.949112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237827+0000","last_change":"2024-09-11T22:14:26.957825+0000","last_active":"2024-09-11T22:14:29.237827+0000","last_peered":"2024-09-11T22:14:29.237827+0000","last_clean":"2024-09-11T22:14:29.237827+0000","last_became_active":"2024-09-11T22:14:26.957559+0000","last_became_peered":"2024-09-11T22:14:26.957559+0000","last_unstale":"2024-09-11T22:14:29.237827+0000","last_undegraded":"2024-09-11T22:14:29.237827+0000","last_fullsized":"2024-09-11T22:14:29.237827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:23.772181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.964963+0000","last_change":"2024-09-11T22:14:26.962434+0000","last_active":"2024-09-11T22:14:26.964963+0000","last_peered":"2024-09-11T22:14:26.964963+0000","last_clean":"2024-09-11T22:14:26.964963+0000","last_became_active":"2024-09-11T22:14:26.962132+0000","last_became_peered":"2024-09-11T22:14:26.962132+0000","last_unstale":"2024-09-11T22:14:26.964963+0000","last_undegraded":"2024-09-11T22:14:26.964963+0000","last_fullsized":"2024-09-11T22:14:26.964963+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:14.957468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237709+0000","last_change":"2024-09-11T22:14:26.970102+0000","last_active":"2024-09-11T22:14:29.237709+0000","last_peered":"2024-09-11T22:14:29.237709+0000","last_clean":"2024-09-11T22:14:29.237709+0000","last_became_active":"2024-09-11T22:14:26.968725+0000","last_became_peered":"2024-09-11T22:14:26.968725+0000","last_unstale":"2024-09-11T22:14:29.237709+0000","last_undegraded":"2024-09-11T22:14:29.237709+0000","last_fullsized":"2024-09-11T22:14:29.237709+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:54.820323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973486+0000","last_change":"2024-09-11T22:14:26.972685+0000","last_active":"2024-09-11T22:14:26.973486+0000","last_peered":"2024-09-11T22:14:26.973486+0000","last_clean":"2024-09-11T22:14:26.973486+0000","last_became_active":"2024-09-11T22:14:26.972444+0000","last_became_peered":"2024-09-11T22:14:26.972444+0000","last_unstale":"2024-09-11T22:14:26.973486+0000","last_undegraded":"2024-09-11T22:14:26.973486+0000","last_fullsized":"2024-09-11T22:14:26.973486+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:17.455050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045202+0000","last_change":"2024-09-11T22:14:26.953324+0000","last_active":"2024-09-11T22:14:28.045202+0000","last_peered":"2024-09-11T22:14:28.045202+0000","last_clean":"2024-09-11T22:14:28.045202+0000","last_became_active":"2024-09-11T22:14:26.951702+0000","last_became_peered":"2024-09-11T22:14:26.951702+0000","last_unstale":"2024-09-11T22:14:28.045202+0000","last_undegraded":"2024-09-11T22:14:28.045202+0000","last_fullsized":"2024-09-11T22:14:28.045202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:45.699757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.947311+0000","last_change":"2024-09-11T22:14:25.947311+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.947311+0000","last_undegraded":"2024-09-11T22:14:25.947311+0000","last_fullsized":"2024-09-11T22:14:25.947311+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957209+0000","last_change":"2024-09-11T22:14:26.966619+0000","last_active":"2024-09-11T22:14:27.957209+0000","last_peered":"2024-09-11T22:14:27.957209+0000","last_clean":"2024-09-11T22:14:27.957209+0000","last_became_active":"2024-09-11T22:14:26.966166+0000","last_became_peered":"2024-09-11T22:14:26.966166+0000","last_unstale":"2024-09-11T22:14:27.957209+0000","last_undegraded":"2024-09-11T22:14:27.957209+0000","last_fullsized":"2024-09-11T22:14:27.957209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:48.700476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955344+0000","last_change":"2024-09-11T22:14:26.959657+0000","last_active":"2024-09-11T22:14:27.955344+0000","last_peered":"2024-09-11T22:14:27.955344+0000","last_clean":"2024-09-11T22:14:27.955344+0000","last_became_active":"2024-09-11T22:14:26.957995+0000","last_became_peered":"2024-09-11T22:14:26.957995+0000","last_unstale":"2024-09-11T22:14:27.955344+0000","last_undegraded":"2024-09-11T22:14:27.955344+0000","last_fullsized":"2024-09-11T22:14:27.955344+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:45.625414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.946343+0000","last_change":"2024-09-11T22:14:25.946343+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.946343+0000","last_undegraded":"2024-09-11T22:14:25.946343+0000","last_fullsized":"2024-09-11T22:14:25.946343+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238020+0000","last_change":"2024-09-11T22:14:26.965288+0000","last_active":"2024-09-11T22:14:29.238020+0000","last_peered":"2024-09-11T22:14:29.238020+0000","last_clean":"2024-09-11T22:14:29.238020+0000","last_became_active":"2024-09-11T22:14:26.963346+0000","last_became_peered":"2024-09-11T22:14:26.963346+0000","last_unstale":"2024-09-11T22:14:29.238020+0000","last_undegraded":"2024-09-11T22:14:29.238020+0000","last_fullsized":"2024-09-11T22:14:29.238020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:36.369029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.961779+0000","last_change":"2024-09-11T22:14:26.959933+0000","last_active":"2024-09-11T22:14:26.961779+0000","last_peered":"2024-09-11T22:14:26.961779+0000","last_clean":"2024-09-11T22:14:26.961779+0000","last_became_active":"2024-09-11T22:14:26.959673+0000","last_became_peered":"2024-09-11T22:14:26.959673+0000","last_unstale":"2024-09-11T22:14:26.961779+0000","last_undegraded":"2024-09-11T22:14:26.961779+0000","last_fullsized":"2024-09-11T22:14:26.961779+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:16.039732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.946662+0000","last_change":"2024-09-11T22:14:25.946662+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.946662+0000","last_undegraded":"2024-09-11T22:14:25.946662+0000","last_fullsized":"2024-09-11T22:14:25.946662+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955340+0000","last_change":"2024-09-11T22:14:26.957135+0000","last_active":"2024-09-11T22:14:27.955340+0000","last_peered":"2024-09-11T22:14:27.955340+0000","last_clean":"2024-09-11T22:14:27.955340+0000","last_became_active":"2024-09-11T22:14:26.956870+0000","last_became_peered":"2024-09-11T22:14:26.956870+0000","last_unstale":"2024-09-11T22:14:27.955340+0000","last_undegraded":"2024-09-11T22:14:27.955340+0000","last_fullsized":"2024-09-11T22:14:27.955340+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:17.912234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955540+0000","last_change":"2024-09-11T22:14:26.962072+0000","last_active":"2024-09-11T22:14:27.955540+0000","last_peered":"2024-09-11T22:14:27.955540+0000","last_clean":"2024-09-11T22:14:27.955540+0000","last_became_active":"2024-09-11T22:14:26.961817+0000","last_became_peered":"2024-09-11T22:14:26.961817+0000","last_unstale":"2024-09-11T22:14:27.955540+0000","last_undegraded":"2024-09-11T22:14:27.955540+0000","last_fullsized":"2024-09-11T22:14:27.955540+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:14.514452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955612+0000","last_change":"2024-09-11T22:14:25.952024+0000","last_active":"2024-09-11T22:14:27.955612+0000","last_peered":"2024-09-11T22:14:27.955612+0000","last_clean":"2024-09-11T22:14:27.955612+0000","last_became_active":"2024-09-11T22:14:25.951739+0000","last_became_peered":"2024-09-11T22:14:25.951739+0000","last_unstale":"2024-09-11T22:14:27.955612+0000","last_undegraded":"2024-09-11T22:14:27.955612+0000","last_fullsized":"2024-09-11T22:14:27.955612+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:36.134800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650758+0000","last_change":"2024-09-11T22:14:26.964714+0000","last_active":"2024-09-11T22:14:28.650758+0000","last_peered":"2024-09-11T22:14:28.650758+0000","last_clean":"2024-09-11T22:14:28.650758+0000","last_became_active":"2024-09-11T22:14:26.964485+0000","last_became_peered":"2024-09-11T22:14:26.964485+0000","last_unstale":"2024-09-11T22:14:28.650758+0000","last_undegraded":"2024-09-11T22:14:28.650758+0000","last_fullsized":"2024-09-11T22:14:28.650758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:41.146664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238072+0000","last_change":"2024-09-11T22:14:25.956149+0000","last_active":"2024-09-11T22:14:29.238072+0000","last_peered":"2024-09-11T22:14:29.238072+0000","last_clean":"2024-09-11T22:14:29.238072+0000","last_became_active":"2024-09-11T22:14:25.955403+0000","last_became_peered":"2024-09-11T22:14:25.955403+0000","last_unstale":"2024-09-11T22:14:29.238072+0000","last_undegraded":"2024-09-11T22:14:29.238072+0000","last_fullsized":"2024-09-11T22:14:29.238072+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:15.536125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955173+0000","last_change":"2024-09-11T22:14:26.964943+0000","last_active":"2024-09-11T22:14:27.955173+0000","last_peered":"2024-09-11T22:14:27.955173+0000","last_clean":"2024-09-11T22:14:27.955173+0000","last_became_active":"2024-09-11T22:14:26.964416+0000","last_became_peered":"2024-09-11T22:14:26.964416+0000","last_unstale":"2024-09-11T22:14:27.955173+0000","last_undegraded":"2024-09-11T22:14:27.955173+0000","last_fullsized":"2024-09-11T22:14:27.955173+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:36.926975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955571+0000","last_change":"2024-09-11T22:14:25.960586+0000","last_active":"2024-09-11T22:14:27.955571+0000","last_peered":"2024-09-11T22:14:27.955571+0000","last_clean":"2024-09-11T22:14:27.955571+0000","last_became_active":"2024-09-11T22:14:25.960280+0000","last_became_peered":"2024-09-11T22:14:25.960280+0000","last_unstale":"2024-09-11T22:14:27.955571+0000","last_undegraded":"2024-09-11T22:14:27.955571+0000","last_fullsized":"2024-09-11T22:14:27.955571+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:40.139062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955425+0000","last_change":"2024-09-11T22:14:26.961155+0000","last_active":"2024-09-11T22:14:27.955425+0000","last_peered":"2024-09-11T22:14:27.955425+0000","last_clean":"2024-09-11T22:14:27.955425+0000","last_became_active":"2024-09-11T22:14:26.960654+0000","last_became_peered":"2024-09-11T22:14:26.960654+0000","last_unstale":"2024-09-11T22:14:27.955425+0000","last_undegraded":"2024-09-11T22:14:27.955425+0000","last_fullsized":"2024-09-11T22:14:27.955425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957272+0000","last_change":"2024-09-11T22:14:25.954648+0000","last_active":"2024-09-11T22:14:27.957272+0000","last_peered":"2024-09-11T22:14:27.957272+0000","last_clean":"2024-09-11T22:14:27.957272+0000","last_became_active":"2024-09-11T22:14:25.954334+0000","last_became_peered":"2024-09-11T22:14:25.954334+0000","last_unstale":"2024-09-11T22:14:27.957272+0000","last_undegraded":"2024-09-11T22:14:27.957272+0000","last_fullsized":"2024-09-11T22:14:27.957272+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:12.136592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238149+0000","last_change":"2024-09-11T22:14:26.969858+0000","last_active":"2024-09-11T22:14:29.238149+0000","last_peered":"2024-09-11T22:14:29.238149+0000","last_clean":"2024-09-11T22:14:29.238149+0000","last_became_active":"2024-09-11T22:14:26.968413+0000","last_became_peered":"2024-09-11T22:14:26.968413+0000","last_unstale":"2024-09-11T22:14:29.238149+0000","last_undegraded":"2024-09-11T22:14:29.238149+0000","last_fullsized":"2024-09-11T22:14:29.238149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:26.978341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955958+0000","last_change":"2024-09-11T22:14:25.950287+0000","last_active":"2024-09-11T22:14:27.955958+0000","last_peered":"2024-09-11T22:14:27.955958+0000","last_clean":"2024-09-11T22:14:27.955958+0000","last_became_active":"2024-09-11T22:14:25.950020+0000","last_became_peered":"2024-09-11T22:14:25.950020+0000","last_unstale":"2024-09-11T22:14:27.955958+0000","last_undegraded":"2024-09-11T22:14:27.955958+0000","last_fullsized":"2024-09-11T22:14:27.955958+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:31.695327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238193+0000","last_change":"2024-09-11T22:14:26.957412+0000","last_active":"2024-09-11T22:14:29.238193+0000","last_peered":"2024-09-11T22:14:29.238193+0000","last_clean":"2024-09-11T22:14:29.238193+0000","last_became_active":"2024-09-11T22:14:26.957003+0000","last_became_peered":"2024-09-11T22:14:26.957003+0000","last_unstale":"2024-09-11T22:14:29.238193+0000","last_undegraded":"2024-09-11T22:14:29.238193+0000","last_fullsized":"2024-09-11T22:14:29.238193+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:00.215569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955193+0000","last_change":"2024-09-11T22:14:25.956470+0000","last_active":"2024-09-11T22:14:27.955193+0000","last_peered":"2024-09-11T22:14:27.955193+0000","last_clean":"2024-09-11T22:14:27.955193+0000","last_became_active":"2024-09-11T22:14:25.956032+0000","last_became_peered":"2024-09-11T22:14:25.956032+0000","last_unstale":"2024-09-11T22:14:27.955193+0000","last_undegraded":"2024-09-11T22:14:27.955193+0000","last_fullsized":"2024-09-11T22:14:27.955193+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:17.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045221+0000","last_change":"2024-09-11T22:14:26.957303+0000","last_active":"2024-09-11T22:14:28.045221+0000","last_peered":"2024-09-11T22:14:28.045221+0000","last_clean":"2024-09-11T22:14:28.045221+0000","last_became_active":"2024-09-11T22:14:26.957049+0000","last_became_peered":"2024-09-11T22:14:26.957049+0000","last_unstale":"2024-09-11T22:14:28.045221+0000","last_undegraded":"2024-09-11T22:14:28.045221+0000","last_fullsized":"2024-09-11T22:14:28.045221+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:54.823432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957147+0000","last_change":"2024-09-11T22:14:25.950524+0000","last_active":"2024-09-11T22:14:27.957147+0000","last_peered":"2024-09-11T22:14:27.957147+0000","last_clean":"2024-09-11T22:14:27.957147+0000","last_became_active":"2024-09-11T22:14:25.950266+0000","last_became_peered":"2024-09-11T22:14:25.950266+0000","last_unstale":"2024-09-11T22:14:27.957147+0000","last_undegraded":"2024-09-11T22:14:27.957147+0000","last_fullsized":"2024-09-11T22:14:27.957147+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:46.536428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237812+0000","last_change":"2024-09-11T22:14:26.959688+0000","last_active":"2024-09-11T22:14:29.237812+0000","last_peered":"2024-09-11T22:14:29.237812+0000","last_clean":"2024-09-11T22:14:29.237812+0000","last_became_active":"2024-09-11T22:14:26.958964+0000","last_became_peered":"2024-09-11T22:14:26.958964+0000","last_unstale":"2024-09-11T22:14:29.237812+0000","last_undegraded":"2024-09-11T22:14:29.237812+0000","last_fullsized":"2024-09-11T22:14:29.237812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:40.951930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956044+0000","last_change":"2024-09-11T22:14:25.957377+0000","last_active":"2024-09-11T22:14:27.956044+0000","last_peered":"2024-09-11T22:14:27.956044+0000","last_clean":"2024-09-11T22:14:27.956044+0000","last_became_active":"2024-09-11T22:14:25.957103+0000","last_became_peered":"2024-09-11T22:14:25.957103+0000","last_unstale":"2024-09-11T22:14:27.956044+0000","last_undegraded":"2024-09-11T22:14:27.956044+0000","last_fullsized":"2024-09-11T22:14:27.956044+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:17.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956917+0000","last_change":"2024-09-11T22:14:26.969252+0000","last_active":"2024-09-11T22:14:27.956917+0000","last_peered":"2024-09-11T22:14:27.956917+0000","last_clean":"2024-09-11T22:14:27.956917+0000","last_became_active":"2024-09-11T22:14:26.968962+0000","last_became_peered":"2024-09-11T22:14:26.968962+0000","last_unstale":"2024-09-11T22:14:27.956917+0000","last_undegraded":"2024-09-11T22:14:27.956917+0000","last_fullsized":"2024-09-11T22:14:27.956917+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:34.920148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.954203+0000","last_change":"2024-09-11T22:14:25.955890+0000","last_active":"2024-09-11T22:14:26.954203+0000","last_peered":"2024-09-11T22:14:26.954203+0000","last_clean":"2024-09-11T22:14:26.954203+0000","last_became_active":"2024-09-11T22:14:25.955601+0000","last_became_peered":"2024-09-11T22:14:25.955601+0000","last_unstale":"2024-09-11T22:14:26.954203+0000","last_undegraded":"2024-09-11T22:14:26.954203+0000","last_fullsized":"2024-09-11T22:14:26.954203+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:25.167921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.970806+0000","last_change":"2024-09-11T22:14:26.967750+0000","last_active":"2024-09-11T22:14:26.970806+0000","last_peered":"2024-09-11T22:14:26.970806+0000","last_clean":"2024-09-11T22:14:26.970806+0000","last_became_active":"2024-09-11T22:14:26.967492+0000","last_became_peered":"2024-09-11T22:14:26.967492+0000","last_unstale":"2024-09-11T22:14:26.970806+0000","last_undegraded":"2024-09-11T22:14:26.970806+0000","last_fullsized":"2024-09-11T22:14:26.970806+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:31.624389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238185+0000","last_change":"2024-09-11T22:14:25.951977+0000","last_active":"2024-09-11T22:14:29.238185+0000","last_peered":"2024-09-11T22:14:29.238185+0000","last_clean":"2024-09-11T22:14:29.238185+0000","last_became_active":"2024-09-11T22:14:25.951186+0000","last_became_peered":"2024-09-11T22:14:25.951186+0000","last_unstale":"2024-09-11T22:14:29.238185+0000","last_undegraded":"2024-09-11T22:14:29.238185+0000","last_fullsized":"2024-09-11T22:14:29.238185+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:42.115865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650581+0000","last_change":"2024-09-11T22:14:26.966320+0000","last_active":"2024-09-11T22:14:28.650581+0000","last_peered":"2024-09-11T22:14:28.650581+0000","last_clean":"2024-09-11T22:14:28.650581+0000","last_became_active":"2024-09-11T22:14:26.966062+0000","last_became_peered":"2024-09-11T22:14:26.966062+0000","last_unstale":"2024-09-11T22:14:28.650581+0000","last_undegraded":"2024-09-11T22:14:28.650581+0000","last_fullsized":"2024-09-11T22:14:28.650581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:18.648523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.969140+0000","last_change":"2024-09-11T22:14:25.958570+0000","last_active":"2024-09-11T22:14:26.969140+0000","last_peered":"2024-09-11T22:14:26.969140+0000","last_clean":"2024-09-11T22:14:26.969140+0000","last_became_active":"2024-09-11T22:14:25.958356+0000","last_became_peered":"2024-09-11T22:14:25.958356+0000","last_unstale":"2024-09-11T22:14:26.969140+0000","last_undegraded":"2024-09-11T22:14:26.969140+0000","last_fullsized":"2024-09-11T22:14:26.969140+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:29.549649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973134+0000","last_change":"2024-09-11T22:14:26.968253+0000","last_active":"2024-09-11T22:14:26.973134+0000","last_peered":"2024-09-11T22:14:26.973134+0000","last_clean":"2024-09-11T22:14:26.973134+0000","last_became_active":"2024-09-11T22:14:26.967949+0000","last_became_peered":"2024-09-11T22:14:26.967949+0000","last_unstale":"2024-09-11T22:14:26.973134+0000","last_undegraded":"2024-09-11T22:14:26.973134+0000","last_fullsized":"2024-09-11T22:14:26.973134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:30.165873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956950+0000","last_change":"2024-09-11T22:14:25.956145+0000","last_active":"2024-09-11T22:14:27.956950+0000","last_peered":"2024-09-11T22:14:27.956950+0000","last_clean":"2024-09-11T22:14:27.956950+0000","last_became_active":"2024-09-11T22:14:25.955833+0000","last_became_peered":"2024-09-11T22:14:25.955833+0000","last_unstale":"2024-09-11T22:14:27.956950+0000","last_undegraded":"2024-09-11T22:14:27.956950+0000","last_fullsized":"2024-09-11T22:14:27.956950+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:34.327331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956077+0000","last_change":"2024-09-11T22:14:26.959737+0000","last_active":"2024-09-11T22:14:27.956077+0000","last_peered":"2024-09-11T22:14:27.956077+0000","last_clean":"2024-09-11T22:14:27.956077+0000","last_became_active":"2024-09-11T22:14:26.959509+0000","last_became_peered":"2024-09-11T22:14:26.959509+0000","last_unstale":"2024-09-11T22:14:27.956077+0000","last_undegraded":"2024-09-11T22:14:27.956077+0000","last_fullsized":"2024-09-11T22:14:27.956077+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237856+0000","last_change":"2024-09-11T22:14:25.959102+0000","last_active":"2024-09-11T22:14:29.237856+0000","last_peered":"2024-09-11T22:14:29.237856+0000","last_clean":"2024-09-11T22:14:29.237856+0000","last_became_active":"2024-09-11T22:14:25.956666+0000","last_became_peered":"2024-09-11T22:14:25.956666+0000","last_unstale":"2024-09-11T22:14:29.237856+0000","last_undegraded":"2024-09-11T22:14:29.237856+0000","last_fullsized":"2024-09-11T22:14:29.237856+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:13.506850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.962976+0000","last_change":"2024-09-11T22:14:26.960877+0000","last_active":"2024-09-11T22:14:26.962976+0000","last_peered":"2024-09-11T22:14:26.962976+0000","last_clean":"2024-09-11T22:14:26.962976+0000","last_became_active":"2024-09-11T22:14:26.960545+0000","last_became_peered":"2024-09-11T22:14:26.960545+0000","last_unstale":"2024-09-11T22:14:26.962976+0000","last_undegraded":"2024-09-11T22:14:26.962976+0000","last_fullsized":"2024-09-11T22:14:26.962976+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:14.172517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045066+0000","last_change":"2024-09-11T22:14:25.954749+0000","last_active":"2024-09-11T22:14:28.045066+0000","last_peered":"2024-09-11T22:14:28.045066+0000","last_clean":"2024-09-11T22:14:28.045066+0000","last_became_active":"2024-09-11T22:14:25.954401+0000","last_became_peered":"2024-09-11T22:14:25.954401+0000","last_unstale":"2024-09-11T22:14:28.045066+0000","last_undegraded":"2024-09-11T22:14:28.045066+0000","last_fullsized":"2024-09-11T22:14:28.045066+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:44.892896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955926+0000","last_change":"2024-09-11T22:14:26.963837+0000","last_active":"2024-09-11T22:14:27.955926+0000","last_peered":"2024-09-11T22:14:27.955926+0000","last_clean":"2024-09-11T22:14:27.955926+0000","last_became_active":"2024-09-11T22:14:26.963576+0000","last_became_peered":"2024-09-11T22:14:26.963576+0000","last_unstale":"2024-09-11T22:14:27.955926+0000","last_undegraded":"2024-09-11T22:14:27.955926+0000","last_fullsized":"2024-09-11T22:14:27.955926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:11.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957202+0000","last_change":"2024-09-11T22:14:25.951651+0000","last_active":"2024-09-11T22:14:27.957202+0000","last_peered":"2024-09-11T22:14:27.957202+0000","last_clean":"2024-09-11T22:14:27.957202+0000","last_became_active":"2024-09-11T22:14:25.951299+0000","last_became_peered":"2024-09-11T22:14:25.951299+0000","last_unstale":"2024-09-11T22:14:27.957202+0000","last_undegraded":"2024-09-11T22:14:27.957202+0000","last_fullsized":"2024-09-11T22:14:27.957202+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:33.912546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973466+0000","last_change":"2024-09-11T22:14:26.972480+0000","last_active":"2024-09-11T22:14:26.973466+0000","last_peered":"2024-09-11T22:14:26.973466+0000","last_clean":"2024-09-11T22:14:26.973466+0000","last_became_active":"2024-09-11T22:14:26.972332+0000","last_became_peered":"2024-09-11T22:14:26.972332+0000","last_unstale":"2024-09-11T22:14:26.973466+0000","last_undegraded":"2024-09-11T22:14:26.973466+0000","last_fullsized":"2024-09-11T22:14:26.973466+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:53.958006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.966367+0000","last_change":"2024-09-11T22:14:25.956614+0000","last_active":"2024-09-11T22:14:26.966367+0000","last_peered":"2024-09-11T22:14:26.966367+0000","last_clean":"2024-09-11T22:14:26.966367+0000","last_became_active":"2024-09-11T22:14:25.956306+0000","last_became_peered":"2024-09-11T22:14:25.956306+0000","last_unstale":"2024-09-11T22:14:26.966367+0000","last_undegraded":"2024-09-11T22:14:26.966367+0000","last_fullsized":"2024-09-11T22:14:26.966367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:39.705969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.968425+0000","last_change":"2024-09-11T22:14:26.966426+0000","last_active":"2024-09-11T22:14:26.968425+0000","last_peered":"2024-09-11T22:14:26.968425+0000","last_clean":"2024-09-11T22:14:26.968425+0000","last_became_active":"2024-09-11T22:14:26.966157+0000","last_became_peered":"2024-09-11T22:14:26.966157+0000","last_unstale":"2024-09-11T22:14:26.968425+0000","last_undegraded":"2024-09-11T22:14:26.968425+0000","last_fullsized":"2024-09-11T22:14:26.968425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:21.554097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238251+0000","last_change":"2024-09-11T22:14:25.960512+0000","last_active":"2024-09-11T22:14:29.238251+0000","last_peered":"2024-09-11T22:14:29.238251+0000","last_clean":"2024-09-11T22:14:29.238251+0000","last_became_active":"2024-09-11T22:14:25.960249+0000","last_became_peered":"2024-09-11T22:14:25.960249+0000","last_unstale":"2024-09-11T22:14:29.238251+0000","last_undegraded":"2024-09-11T22:14:29.238251+0000","last_fullsized":"2024-09-11T22:14:29.238251+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:12.252400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956341+0000","last_change":"2024-09-11T22:14:26.960080+0000","last_active":"2024-09-11T22:14:27.956341+0000","last_peered":"2024-09-11T22:14:27.956341+0000","last_clean":"2024-09-11T22:14:27.956341+0000","last_became_active":"2024-09-11T22:14:26.959778+0000","last_became_peered":"2024-09-11T22:14:26.959778+0000","last_unstale":"2024-09-11T22:14:27.956341+0000","last_undegraded":"2024-09-11T22:14:27.956341+0000","last_fullsized":"2024-09-11T22:14:27.956341+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:14.514452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955559+0000","last_change":"2024-09-11T22:14:25.953232+0000","last_active":"2024-09-11T22:14:27.955559+0000","last_peered":"2024-09-11T22:14:27.955559+0000","last_clean":"2024-09-11T22:14:27.955559+0000","last_became_active":"2024-09-11T22:14:25.952951+0000","last_became_peered":"2024-09-11T22:14:25.952951+0000","last_unstale":"2024-09-11T22:14:27.955559+0000","last_undegraded":"2024-09-11T22:14:27.955559+0000","last_fullsized":"2024-09-11T22:14:27.955559+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:31.695327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237924+0000","last_change":"2024-09-11T22:14:26.965790+0000","last_active":"2024-09-11T22:14:29.237924+0000","last_peered":"2024-09-11T22:14:29.237924+0000","last_clean":"2024-09-11T22:14:29.237924+0000","last_became_active":"2024-09-11T22:14:26.965502+0000","last_became_peered":"2024-09-11T22:14:26.965502+0000","last_unstale":"2024-09-11T22:14:29.237924+0000","last_undegraded":"2024-09-11T22:14:29.237924+0000","last_fullsized":"2024-09-11T22:14:29.237924+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:51.944511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956610+0000","last_change":"2024-09-11T22:14:25.951206+0000","last_active":"2024-09-11T22:14:27.956610+0000","last_peered":"2024-09-11T22:14:27.956610+0000","last_clean":"2024-09-11T22:14:27.956610+0000","last_became_active":"2024-09-11T22:14:25.950899+0000","last_became_peered":"2024-09-11T22:14:25.950899+0000","last_unstale":"2024-09-11T22:14:27.956610+0000","last_undegraded":"2024-09-11T22:14:27.956610+0000","last_fullsized":"2024-09-11T22:14:27.956610+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:44.656561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973155+0000","last_change":"2024-09-11T22:14:26.968273+0000","last_active":"2024-09-11T22:14:26.973155+0000","last_peered":"2024-09-11T22:14:26.973155+0000","last_clean":"2024-09-11T22:14:26.973155+0000","last_became_active":"2024-09-11T22:14:26.967984+0000","last_became_peered":"2024-09-11T22:14:26.967984+0000","last_unstale":"2024-09-11T22:14:26.973155+0000","last_undegraded":"2024-09-11T22:14:26.973155+0000","last_fullsized":"2024-09-11T22:14:26.973155+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:44.444736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955266+0000","last_change":"2024-09-11T22:14:25.958361+0000","last_active":"2024-09-11T22:14:27.955266+0000","last_peered":"2024-09-11T22:14:27.955266+0000","last_clean":"2024-09-11T22:14:27.955266+0000","last_became_active":"2024-09-11T22:14:25.957879+0000","last_became_peered":"2024-09-11T22:14:25.957879+0000","last_unstale":"2024-09-11T22:14:27.955266+0000","last_undegraded":"2024-09-11T22:14:27.955266+0000","last_fullsized":"2024-09-11T22:14:27.955266+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:52.954746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956243+0000","last_change":"2024-09-11T22:14:26.959870+0000","last_active":"2024-09-11T22:14:27.956243+0000","last_peered":"2024-09-11T22:14:27.956243+0000","last_clean":"2024-09-11T22:14:27.956243+0000","last_became_active":"2024-09-11T22:14:26.957903+0000","last_became_peered":"2024-09-11T22:14:26.957903+0000","last_unstale":"2024-09-11T22:14:27.956243+0000","last_undegraded":"2024-09-11T22:14:27.956243+0000","last_fullsized":"2024-09-11T22:14:27.956243+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:16.543726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238146+0000","last_change":"2024-09-11T22:14:25.958591+0000","last_active":"2024-09-11T22:14:29.238146+0000","last_peered":"2024-09-11T22:14:29.238146+0000","last_clean":"2024-09-11T22:14:29.238146+0000","last_became_active":"2024-09-11T22:14:25.958303+0000","last_became_peered":"2024-09-11T22:14:25.958303+0000","last_unstale":"2024-09-11T22:14:29.238146+0000","last_undegraded":"2024-09-11T22:14:29.238146+0000","last_fullsized":"2024-09-11T22:14:29.238146+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:24.724328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955309+0000","last_change":"2024-09-11T22:14:26.957372+0000","last_active":"2024-09-11T22:14:27.955309+0000","last_peered":"2024-09-11T22:14:27.955309+0000","last_clean":"2024-09-11T22:14:27.955309+0000","last_became_active":"2024-09-11T22:14:26.956741+0000","last_became_peered":"2024-09-11T22:14:26.956741+0000","last_unstale":"2024-09-11T22:14:27.955309+0000","last_undegraded":"2024-09-11T22:14:27.955309+0000","last_fullsized":"2024-09-11T22:14:27.955309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.496550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650503+0000","last_change":"2024-09-11T22:14:25.954496+0000","last_active":"2024-09-11T22:14:28.650503+0000","last_peered":"2024-09-11T22:14:28.650503+0000","last_clean":"2024-09-11T22:14:28.650503+0000","last_became_active":"2024-09-11T22:14:25.954243+0000","last_became_peered":"2024-09-11T22:14:25.954243+0000","last_unstale":"2024-09-11T22:14:28.650503+0000","last_undegraded":"2024-09-11T22:14:28.650503+0000","last_fullsized":"2024-09-11T22:14:28.650503+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:39.537090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955070+0000","last_change":"2024-09-11T22:14:26.958126+0000","last_active":"2024-09-11T22:14:27.955070+0000","last_peered":"2024-09-11T22:14:27.955070+0000","last_clean":"2024-09-11T22:14:27.955070+0000","last_became_active":"2024-09-11T22:14:26.957849+0000","last_became_peered":"2024-09-11T22:14:26.957849+0000","last_unstale":"2024-09-11T22:14:27.955070+0000","last_undegraded":"2024-09-11T22:14:27.955070+0000","last_fullsized":"2024-09-11T22:14:27.955070+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:46.007324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955914+0000","last_change":"2024-09-11T22:14:25.957351+0000","last_active":"2024-09-11T22:14:27.955914+0000","last_peered":"2024-09-11T22:14:27.955914+0000","last_clean":"2024-09-11T22:14:27.955914+0000","last_became_active":"2024-09-11T22:14:25.957078+0000","last_became_peered":"2024-09-11T22:14:25.957078+0000","last_unstale":"2024-09-11T22:14:27.955914+0000","last_undegraded":"2024-09-11T22:14:27.955914+0000","last_fullsized":"2024-09-11T22:14:27.955914+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:10.280169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957199+0000","last_change":"2024-09-11T22:14:26.959295+0000","last_active":"2024-09-11T22:14:27.957199+0000","last_peered":"2024-09-11T22:14:27.957199+0000","last_clean":"2024-09-11T22:14:27.957199+0000","last_became_active":"2024-09-11T22:14:26.958326+0000","last_became_peered":"2024-09-11T22:14:26.958326+0000","last_unstale":"2024-09-11T22:14:27.957199+0000","last_undegraded":"2024-09-11T22:14:27.957199+0000","last_fullsized":"2024-09-11T22:14:27.957199+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:13.260002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650693+0000","last_change":"2024-09-11T22:14:25.957828+0000","last_active":"2024-09-11T22:14:28.650693+0000","last_peered":"2024-09-11T22:14:28.650693+0000","last_clean":"2024-09-11T22:14:28.650693+0000","last_became_active":"2024-09-11T22:14:25.957530+0000","last_became_peered":"2024-09-11T22:14:25.957530+0000","last_unstale":"2024-09-11T22:14:28.650693+0000","last_undegraded":"2024-09-11T22:14:28.650693+0000","last_fullsized":"2024-09-11T22:14:28.650693+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:33.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956558+0000","last_change":"2024-09-11T22:14:26.962695+0000","last_active":"2024-09-11T22:14:27.956558+0000","last_peered":"2024-09-11T22:14:27.956558+0000","last_clean":"2024-09-11T22:14:27.956558+0000","last_became_active":"2024-09-11T22:14:26.962168+0000","last_became_peered":"2024-09-11T22:14:26.962168+0000","last_unstale":"2024-09-11T22:14:27.956558+0000","last_undegraded":"2024-09-11T22:14:27.956558+0000","last_fullsized":"2024-09-11T22:14:27.956558+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:25.731929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.948031+0000","last_change":"2024-09-11T22:14:25.954069+0000","last_active":"2024-09-11T22:14:28.948031+0000","last_peered":"2024-09-11T22:14:28.948031+0000","last_clean":"2024-09-11T22:14:28.948031+0000","last_became_active":"2024-09-11T22:14:25.953797+0000","last_became_peered":"2024-09-11T22:14:25.953797+0000","last_unstale":"2024-09-11T22:14:28.948031+0000","last_undegraded":"2024-09-11T22:14:28.948031+0000","last_fullsized":"2024-09-11T22:14:28.948031+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:34.327331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650617+0000","last_change":"2024-09-11T22:14:26.965457+0000","last_active":"2024-09-11T22:14:28.650617+0000","last_peered":"2024-09-11T22:14:28.650617+0000","last_clean":"2024-09-11T22:14:28.650617+0000","last_became_active":"2024-09-11T22:14:26.965210+0000","last_became_peered":"2024-09-11T22:14:26.965210+0000","last_unstale":"2024-09-11T22:14:28.650617+0000","last_undegraded":"2024-09-11T22:14:28.650617+0000","last_fullsized":"2024-09-11T22:14:28.650617+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:35.334932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045209+0000","last_change":"2024-09-11T22:14:25.954345+0000","last_active":"2024-09-11T22:14:28.045209+0000","last_peered":"2024-09-11T22:14:28.045209+0000","last_clean":"2024-09-11T22:14:28.045209+0000","last_became_active":"2024-09-11T22:14:25.954043+0000","last_became_peered":"2024-09-11T22:14:25.954043+0000","last_unstale":"2024-09-11T22:14:28.045209+0000","last_undegraded":"2024-09-11T22:14:28.045209+0000","last_fullsized":"2024-09-11T22:14:28.045209+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:51.604884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955489+0000","last_change":"2024-09-11T22:14:26.960931+0000","last_active":"2024-09-11T22:14:27.955489+0000","last_peered":"2024-09-11T22:14:27.955489+0000","last_clean":"2024-09-11T22:14:27.955489+0000","last_became_active":"2024-09-11T22:14:26.960291+0000","last_became_peered":"2024-09-11T22:14:26.960291+0000","last_unstale":"2024-09-11T22:14:27.955489+0000","last_undegraded":"2024-09-11T22:14:27.955489+0000","last_fullsized":"2024-09-11T22:14:27.955489+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:16.543726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957332+0000","last_change":"2024-09-11T22:14:25.950162+0000","last_active":"2024-09-11T22:14:27.957332+0000","last_peered":"2024-09-11T22:14:27.957332+0000","last_clean":"2024-09-11T22:14:27.957332+0000","last_became_active":"2024-09-11T22:14:25.949856+0000","last_became_peered":"2024-09-11T22:14:25.949856+0000","last_unstale":"2024-09-11T22:14:27.957332+0000","last_undegraded":"2024-09-11T22:14:27.957332+0000","last_fullsized":"2024-09-11T22:14:27.957332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:16.056310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237864+0000","last_change":"2024-09-11T22:14:26.968109+0000","last_active":"2024-09-11T22:14:29.237864+0000","last_peered":"2024-09-11T22:14:29.237864+0000","last_clean":"2024-09-11T22:14:29.237864+0000","last_became_active":"2024-09-11T22:14:26.967838+0000","last_became_peered":"2024-09-11T22:14:26.967838+0000","last_unstale":"2024-09-11T22:14:29.237864+0000","last_undegraded":"2024-09-11T22:14:29.237864+0000","last_fullsized":"2024-09-11T22:14:29.237864+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:44.391169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650403+0000","last_change":"2024-09-11T22:14:25.953604+0000","last_active":"2024-09-11T22:14:28.650403+0000","last_peered":"2024-09-11T22:14:28.650403+0000","last_clean":"2024-09-11T22:14:28.650403+0000","last_became_active":"2024-09-11T22:14:25.953317+0000","last_became_peered":"2024-09-11T22:14:25.953317+0000","last_unstale":"2024-09-11T22:14:28.650403+0000","last_undegraded":"2024-09-11T22:14:28.650403+0000","last_fullsized":"2024-09-11T22:14:28.650403+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:56.831702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973444+0000","last_change":"2024-09-11T22:14:26.971798+0000","last_active":"2024-09-11T22:14:26.973444+0000","last_peered":"2024-09-11T22:14:26.973444+0000","last_clean":"2024-09-11T22:14:26.973444+0000","last_became_active":"2024-09-11T22:14:26.971548+0000","last_became_peered":"2024-09-11T22:14:26.971548+0000","last_unstale":"2024-09-11T22:14:26.973444+0000","last_undegraded":"2024-09-11T22:14:26.973444+0000","last_fullsized":"2024-09-11T22:14:26.973444+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:44.655053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956340+0000","last_change":"2024-09-11T22:14:25.955614+0000","last_active":"2024-09-11T22:14:27.956340+0000","last_peered":"2024-09-11T22:14:27.956340+0000","last_clean":"2024-09-11T22:14:27.956340+0000","last_became_active":"2024-09-11T22:14:25.955095+0000","last_became_peered":"2024-09-11T22:14:25.955095+0000","last_unstale":"2024-09-11T22:14:27.956340+0000","last_undegraded":"2024-09-11T22:14:27.956340+0000","last_fullsized":"2024-09-11T22:14:27.956340+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:12.454865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650348+0000","last_change":"2024-09-11T22:14:26.963669+0000","last_active":"2024-09-11T22:14:28.650348+0000","last_peered":"2024-09-11T22:14:28.650348+0000","last_clean":"2024-09-11T22:14:28.650348+0000","last_became_active":"2024-09-11T22:14:26.963377+0000","last_became_peered":"2024-09-11T22:14:26.963377+0000","last_unstale":"2024-09-11T22:14:28.650348+0000","last_undegraded":"2024-09-11T22:14:28.650348+0000","last_fullsized":"2024-09-11T22:14:28.650348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:32.702928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650495+0000","last_change":"2024-09-11T22:14:25.955422+0000","last_active":"2024-09-11T22:14:28.650495+0000","last_peered":"2024-09-11T22:14:28.650495+0000","last_clean":"2024-09-11T22:14:28.650495+0000","last_became_active":"2024-09-11T22:14:25.955133+0000","last_became_peered":"2024-09-11T22:14:25.955133+0000","last_unstale":"2024-09-11T22:14:28.650495+0000","last_undegraded":"2024-09-11T22:14:28.650495+0000","last_fullsized":"2024-09-11T22:14:28.650495+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.631686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237726+0000","last_change":"2024-09-11T22:14:26.959240+0000","last_active":"2024-09-11T22:14:29.237726+0000","last_peered":"2024-09-11T22:14:29.237726+0000","last_clean":"2024-09-11T22:14:29.237726+0000","last_became_active":"2024-09-11T22:14:26.958616+0000","last_became_peered":"2024-09-11T22:14:26.958616+0000","last_unstale":"2024-09-11T22:14:29.237726+0000","last_undegraded":"2024-09-11T22:14:29.237726+0000","last_fullsized":"2024-09-11T22:14:29.237726+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:24.318239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237850+0000","last_change":"2024-09-11T22:14:25.958671+0000","last_active":"2024-09-11T22:14:29.237850+0000","last_peered":"2024-09-11T22:14:29.237850+0000","last_clean":"2024-09-11T22:14:29.237850+0000","last_became_active":"2024-09-11T22:14:25.958219+0000","last_became_peered":"2024-09-11T22:14:25.958219+0000","last_unstale":"2024-09-11T22:14:29.237850+0000","last_undegraded":"2024-09-11T22:14:29.237850+0000","last_fullsized":"2024-09-11T22:14:29.237850+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:40.924340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237952+0000","last_change":"2024-09-11T22:14:26.960588+0000","last_active":"2024-09-11T22:14:29.237952+0000","last_peered":"2024-09-11T22:14:29.237952+0000","last_clean":"2024-09-11T22:14:29.237952+0000","last_became_active":"2024-09-11T22:14:26.959947+0000","last_became_peered":"2024-09-11T22:14:26.959947+0000","last_unstale":"2024-09-11T22:14:29.237952+0000","last_undegraded":"2024-09-11T22:14:29.237952+0000","last_fullsized":"2024-09-11T22:14:29.237952+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:07.334337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045119+0000","last_change":"2024-09-11T22:14:25.954833+0000","last_active":"2024-09-11T22:14:28.045119+0000","last_peered":"2024-09-11T22:14:28.045119+0000","last_clean":"2024-09-11T22:14:28.045119+0000","last_became_active":"2024-09-11T22:14:25.954546+0000","last_became_peered":"2024-09-11T22:14:25.954546+0000","last_unstale":"2024-09-11T22:14:28.045119+0000","last_undegraded":"2024-09-11T22:14:28.045119+0000","last_fullsized":"2024-09-11T22:14:28.045119+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:25.578897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":237,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.948896+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:14:26.948896+0000","last_peered":"2024-09-11T22:14:26.948896+0000","last_clean":"2024-09-11T22:14:26.948896+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:14:26.948896+0000","last_undegraded":"2024-09-11T22:14:26.948896+0000","last_fullsized":"2024-09-11T22:14:26.948896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36032,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335808,"statfs":{"total":96636764160,"available":96599867392,"internally_reserved":0,"allocated":700416,"data_stored":292137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36044,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335796,"statfs":{"total":96636764160,"available":96599855104,"internally_reserved":0,"allocated":708608,"data_stored":292789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36048,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335792,"statfs":{"total":96636764160,"available":96599851008,"internally_reserved":0,"allocated":712704,"data_stored":293749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44352,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327488,"statfs":{"total":96636764160,"available":96591347712,"internally_reserved":0,"allocated":696320,"data_stored":285893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":692224,"data_stored":285927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40788,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331052,"statfs":{"total":96636764160,"available":96594997248,"internally_reserved":0,"allocated":1310720,"data_stored":884699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36592,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335248,"statfs":{"total":96636764160,"available":96599293952,"internally_reserved":0,"allocated":1269760,"data_stored":869430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40160,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331680,"statfs":{"total":96636764160,"available":96595640320,"internally_reserved":0,"allocated":663552,"data_stored":272795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:14:30.331 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:14:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.435+0000 7f1dff731640 1 Processor -- start 2024-09-11T22:14:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.435+0000 7f1dff731640 1 -- start start 2024-09-11T22:14:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dff731640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1df80d1c90 0x7f1df80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dff731640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1df8162350 0x7f1df81627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dff731640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1df8163080 con 0x7f1df815e8e0 2024-09-11T22:14:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dff731640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1df815ecc0 con 0x7f1df8162350 2024-09-11T22:14:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dff731640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1df80d2ad0 con 0x7f1df80d1c90 2024-09-11T22:14:30.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dfdcce640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1df8162350 0x7f1df81627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dfd4cd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1df815e8e0 0x7f1df80d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48928/0 (socket says 172.21.15.50:48928) 2024-09-11T22:14:30.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dfd4cd640 1 -- 172.21.15.50:0/1283377531 learned_addr learned my addr 172.21.15.50:0/1283377531 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:30.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dfdcce640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1df8162350 0x7f1df81627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50382/0 (socket says 172.21.15.50:50382) 2024-09-11T22:14:30.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dfcccc640 1 --2- 172.21.15.50:0/1283377531 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1df80d1c90 0x7f1df80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dfdcce640 1 -- 172.21.15.50:0/1283377531 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1df80d1c90 msgr2=0x7f1df80b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dfdcce640 1 --2- 172.21.15.50:0/1283377531 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1df80d1c90 0x7f1df80b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dfdcce640 1 -- 172.21.15.50:0/1283377531 >> v1:172.21.15.50:6789/0 conn(0x7f1df815e8e0 legacy=0x7f1df80d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.436+0000 7f1dfdcce640 1 -- 172.21.15.50:0/1283377531 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df80d2d20 con 0x7f1df8162350 2024-09-11T22:14:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.437+0000 7f1dfdcce640 1 --2- 172.21.15.50:0/1283377531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1df8162350 0x7f1df81627e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009d90 tx=0x7f1df002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b772508887faaf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.437+0000 7f1deffff640 1 -- 172.21.15.50:0/1283377531 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0007740 con 0x7f1df8162350 2024-09-11T22:14:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.437+0000 7f1deffff640 1 -- 172.21.15.50:0/1283377531 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df00078e0 con 0x7f1df8162350 2024-09-11T22:14:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.437+0000 7f1deffff640 1 -- 172.21.15.50:0/1283377531 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0007cb0 con 0x7f1df8162350 2024-09-11T22:14:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.438+0000 7f1dff731640 1 -- 172.21.15.50:0/1283377531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1df8162350 msgr2=0x7f1df81627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.438+0000 7f1dff731640 1 --2- 172.21.15.50:0/1283377531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1df8162350 0x7f1df81627e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009d90 tx=0x7f1df002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.438+0000 7f1dff731640 1 -- 172.21.15.50:0/1283377531 shutdown_connections 2024-09-11T22:14:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.438+0000 7f1dff731640 1 --2- 172.21.15.50:0/1283377531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1df8162350 0x7f1df81627e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.438+0000 7f1dff731640 1 --2- 172.21.15.50:0/1283377531 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1df80d1c90 0x7f1df80b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.438+0000 7f1dff731640 1 -- 172.21.15.50:0/1283377531 >> 172.21.15.50:0/1283377531 conn(0x7f1df8067ba0 msgr2=0x7f1df8067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.438+0000 7f1dff731640 1 -- 172.21.15.50:0/1283377531 shutdown_connections 2024-09-11T22:14:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.438+0000 7f1dff731640 1 -- 172.21.15.50:0/1283377531 wait complete. 2024-09-11T22:14:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.439+0000 7f1dff731640 1 Processor -- start 2024-09-11T22:14:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.439+0000 7f1dff731640 1 -- start start 2024-09-11T22:14:30.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dff731640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1df80d1c90 0x7f1df8151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dff731640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1df815e8e0 0x7f1df81f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dff731640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1df8162350 0x7f1df81f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dff731640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1df8162d20 con 0x7f1df80d1c90 2024-09-11T22:14:30.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dff731640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1df80d3370 con 0x7f1df815e8e0 2024-09-11T22:14:30.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dff731640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1df80d3800 con 0x7f1df8162350 2024-09-11T22:14:30.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dfd4cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1df80d1c90 0x7f1df8151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dfd4cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1df80d1c90 0x7f1df8151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50392/0 (socket says 172.21.15.50:50392) 2024-09-11T22:14:30.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dfd4cd640 1 -- 172.21.15.50:0/2739092438 learned_addr learned my addr 172.21.15.50:0/2739092438 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:30.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dfd4cd640 1 -- 172.21.15.50:0/2739092438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1df8162350 msgr2=0x7f1df81f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dfd4cd640 1 --2- 172.21.15.50:0/2739092438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1df8162350 0x7f1df81f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dfd4cd640 1 -- 172.21.15.50:0/2739092438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1df815e8e0 msgr2=0x7f1df81f7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dfd4cd640 1 --2- 172.21.15.50:0/2739092438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1df815e8e0 0x7f1df81f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dfd4cd640 1 -- 172.21.15.50:0/2739092438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df80ccc70 con 0x7f1df80d1c90 2024-09-11T22:14:30.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dfd4cd640 1 --2- 172.21.15.50:0/2739092438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1df80d1c90 0x7f1df8151d10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1df400c400 tx=0x7f1df400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dedffb640 1 -- 172.21.15.50:0/2739092438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4017070 con 0x7f1df80d1c90 2024-09-11T22:14:30.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dedffb640 1 -- 172.21.15.50:0/2739092438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df4005ce0 con 0x7f1df80d1c90 2024-09-11T22:14:30.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dff731640 1 -- 172.21.15.50:0/2739092438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df80b4250 con 0x7f1df80d1c90 2024-09-11T22:14:30.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.440+0000 7f1dedffb640 1 -- 172.21.15.50:0/2739092438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df40072f0 con 0x7f1df80d1c90 2024-09-11T22:14:30.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.441+0000 7f1dff731640 1 -- 172.21.15.50:0/2739092438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df80b4810 con 0x7f1df80d1c90 2024-09-11T22:14:30.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.442+0000 7f1dff731640 1 -- 172.21.15.50:0/2739092438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1df80b7880 con 0x7f1df80d1c90 2024-09-11T22:14:30.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.442+0000 7f1dedffb640 1 -- 172.21.15.50:0/2739092438 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1df401a070 con 0x7f1df80d1c90 2024-09-11T22:14:30.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.443+0000 7f1dedffb640 1 --2- 172.21.15.50:0/2739092438 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ddc06be30 0x7f1ddc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.443+0000 7f1dedffb640 1 -- 172.21.15.50:0/2739092438 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f1df408a200 con 0x7f1df80d1c90 2024-09-11T22:14:30.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.443+0000 7f1dfcccc640 1 --2- 172.21.15.50:0/2739092438 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ddc06be30 0x7f1ddc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.443+0000 7f1dfcccc640 1 --2- 172.21.15.50:0/2739092438 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ddc06be30 0x7f1ddc06e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1df8161ae0 tx=0x7f1de8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.447+0000 7f1dedffb640 1 -- 172.21.15.50:0/2739092438 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1df4058c40 con 0x7f1df80d1c90 2024-09-11T22:14:30.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.617+0000 7f1dff731640 1 -- 172.21.15.50:0/2739092438 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1df80ba770 con 0x7f1ddc06be30 2024-09-11T22:14:30.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.624+0000 7f1dedffb640 1 -- 172.21.15.50:0/2739092438 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251451 (secure 0 0 0) 0x7f1df80ba770 con 0x7f1ddc06be30 2024-09-11T22:14:30.627 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:30.628 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:14:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.627+0000 7f1dff731640 1 -- 172.21.15.50:0/2739092438 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ddc06be30 msgr2=0x7f1ddc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.627+0000 7f1dff731640 1 --2- 172.21.15.50:0/2739092438 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ddc06be30 0x7f1ddc06e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1df8161ae0 tx=0x7f1de8008040 comp rx=0 tx=0).stop 2024-09-11T22:14:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.627+0000 7f1dff731640 1 -- 172.21.15.50:0/2739092438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1df80d1c90 msgr2=0x7f1df8151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.627+0000 7f1dff731640 1 --2- 172.21.15.50:0/2739092438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1df80d1c90 0x7f1df8151d10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1df400c400 tx=0x7f1df400c8c0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.627+0000 7f1dff731640 1 -- 172.21.15.50:0/2739092438 shutdown_connections 2024-09-11T22:14:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.627+0000 7f1dff731640 1 --2- 172.21.15.50:0/2739092438 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ddc06be30 0x7f1ddc06e2f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.627+0000 7f1dff731640 1 --2- 172.21.15.50:0/2739092438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1df8162350 0x7f1df81f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.627+0000 7f1dff731640 1 --2- 172.21.15.50:0/2739092438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1df815e8e0 0x7f1df81f7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.627+0000 7f1dff731640 1 --2- 172.21.15.50:0/2739092438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1df80d1c90 0x7f1df8151d10 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.627+0000 7f1dff731640 1 -- 172.21.15.50:0/2739092438 >> 172.21.15.50:0/2739092438 conn(0x7f1df8067ba0 msgr2=0x7f1df815f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.627+0000 7f1dff731640 1 -- 172.21.15.50:0/2739092438 shutdown_connections 2024-09-11T22:14:30.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.627+0000 7f1dff731640 1 -- 172.21.15.50:0/2739092438 wait complete. 2024-09-11T22:14:30.639 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-11T22:14:29.410311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297720,"kb_used_data":6596,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754677000,"statfs":{"total":773094113280,"available":772789248000,"internally_reserved":0,"allocated":6754304,"data_stored":3477419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.475620"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.947823+0000","last_change":"2024-09-11T22:14:25.947823+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.947823+0000","last_undegraded":"2024-09-11T22:14:25.947823+0000","last_fullsized":"2024-09-11T22:14:25.947823+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238075+0000","last_change":"2024-09-11T22:14:26.959238+0000","last_active":"2024-09-11T22:14:29.238075+0000","last_peered":"2024-09-11T22:14:29.238075+0000","last_clean":"2024-09-11T22:14:29.238075+0000","last_became_active":"2024-09-11T22:14:26.958936+0000","last_became_peered":"2024-09-11T22:14:26.958936+0000","last_unstale":"2024-09-11T22:14:29.238075+0000","last_undegraded":"2024-09-11T22:14:29.238075+0000","last_fullsized":"2024-09-11T22:14:29.238075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:11.635531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.962988+0000","last_change":"2024-09-11T22:14:26.960744+0000","last_active":"2024-09-11T22:14:26.962988+0000","last_peered":"2024-09-11T22:14:26.962988+0000","last_clean":"2024-09-11T22:14:26.962988+0000","last_became_active":"2024-09-11T22:14:26.960440+0000","last_became_peered":"2024-09-11T22:14:26.960440+0000","last_unstale":"2024-09-11T22:14:26.962988+0000","last_undegraded":"2024-09-11T22:14:26.962988+0000","last_fullsized":"2024-09-11T22:14:26.962988+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:20.952546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956811+0000","last_change":"2024-09-11T22:14:26.959797+0000","last_active":"2024-09-11T22:14:27.956811+0000","last_peered":"2024-09-11T22:14:27.956811+0000","last_clean":"2024-09-11T22:14:27.956811+0000","last_became_active":"2024-09-11T22:14:26.959522+0000","last_became_peered":"2024-09-11T22:14:26.959522+0000","last_unstale":"2024-09-11T22:14:27.956811+0000","last_undegraded":"2024-09-11T22:14:27.956811+0000","last_fullsized":"2024-09-11T22:14:27.956811+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:41.931942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.948157+0000","last_change":"2024-09-11T22:14:25.948157+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.948157+0000","last_undegraded":"2024-09-11T22:14:25.948157+0000","last_fullsized":"2024-09-11T22:14:25.948157+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955059+0000","last_change":"2024-09-11T22:14:26.956023+0000","last_active":"2024-09-11T22:14:27.955059+0000","last_peered":"2024-09-11T22:14:27.955059+0000","last_clean":"2024-09-11T22:14:27.955059+0000","last_became_active":"2024-09-11T22:14:26.955721+0000","last_became_peered":"2024-09-11T22:14:26.955721+0000","last_unstale":"2024-09-11T22:14:27.955059+0000","last_undegraded":"2024-09-11T22:14:27.955059+0000","last_fullsized":"2024-09-11T22:14:27.955059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:54.886252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956720+0000","last_change":"2024-09-11T22:14:26.964660+0000","last_active":"2024-09-11T22:14:27.956720+0000","last_peered":"2024-09-11T22:14:27.956720+0000","last_clean":"2024-09-11T22:14:27.956720+0000","last_became_active":"2024-09-11T22:14:26.964404+0000","last_became_peered":"2024-09-11T22:14:26.964404+0000","last_unstale":"2024-09-11T22:14:27.956720+0000","last_undegraded":"2024-09-11T22:14:27.956720+0000","last_fullsized":"2024-09-11T22:14:27.956720+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:17.063912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237609+0000","last_change":"2024-09-11T22:14:26.960383+0000","last_active":"2024-09-11T22:14:29.237609+0000","last_peered":"2024-09-11T22:14:29.237609+0000","last_clean":"2024-09-11T22:14:29.237609+0000","last_became_active":"2024-09-11T22:14:26.959605+0000","last_became_peered":"2024-09-11T22:14:26.959605+0000","last_unstale":"2024-09-11T22:14:29.237609+0000","last_undegraded":"2024-09-11T22:14:29.237609+0000","last_fullsized":"2024-09-11T22:14:29.237609+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:52.664222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956335+0000","last_change":"2024-09-11T22:14:26.964503+0000","last_active":"2024-09-11T22:14:27.956335+0000","last_peered":"2024-09-11T22:14:27.956335+0000","last_clean":"2024-09-11T22:14:27.956335+0000","last_became_active":"2024-09-11T22:14:26.964196+0000","last_became_peered":"2024-09-11T22:14:26.964196+0000","last_unstale":"2024-09-11T22:14:27.956335+0000","last_undegraded":"2024-09-11T22:14:27.956335+0000","last_fullsized":"2024-09-11T22:14:27.956335+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:13.144193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650694+0000","last_change":"2024-09-11T22:14:26.959365+0000","last_active":"2024-09-11T22:14:28.650694+0000","last_peered":"2024-09-11T22:14:28.650694+0000","last_clean":"2024-09-11T22:14:28.650694+0000","last_became_active":"2024-09-11T22:14:26.958793+0000","last_became_peered":"2024-09-11T22:14:26.958793+0000","last_unstale":"2024-09-11T22:14:28.650694+0000","last_undegraded":"2024-09-11T22:14:28.650694+0000","last_fullsized":"2024-09-11T22:14:28.650694+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:53.962348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650807+0000","last_change":"2024-09-11T22:14:26.970469+0000","last_active":"2024-09-11T22:14:28.650807+0000","last_peered":"2024-09-11T22:14:28.650807+0000","last_clean":"2024-09-11T22:14:28.650807+0000","last_became_active":"2024-09-11T22:14:26.970170+0000","last_became_peered":"2024-09-11T22:14:26.970170+0000","last_unstale":"2024-09-11T22:14:28.650807+0000","last_undegraded":"2024-09-11T22:14:28.650807+0000","last_fullsized":"2024-09-11T22:14:28.650807+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:37.142401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956978+0000","last_change":"2024-09-11T22:14:26.961258+0000","last_active":"2024-09-11T22:14:27.956978+0000","last_peered":"2024-09-11T22:14:27.956978+0000","last_clean":"2024-09-11T22:14:27.956978+0000","last_became_active":"2024-09-11T22:14:26.960960+0000","last_became_peered":"2024-09-11T22:14:26.960960+0000","last_unstale":"2024-09-11T22:14:27.956978+0000","last_undegraded":"2024-09-11T22:14:27.956978+0000","last_fullsized":"2024-09-11T22:14:27.956978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:43.123466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045219+0000","last_change":"2024-09-11T22:14:26.955986+0000","last_active":"2024-09-11T22:14:28.045219+0000","last_peered":"2024-09-11T22:14:28.045219+0000","last_clean":"2024-09-11T22:14:28.045219+0000","last_became_active":"2024-09-11T22:14:26.955724+0000","last_became_peered":"2024-09-11T22:14:26.955724+0000","last_unstale":"2024-09-11T22:14:28.045219+0000","last_undegraded":"2024-09-11T22:14:28.045219+0000","last_fullsized":"2024-09-11T22:14:28.045219+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:24.565886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956239+0000","last_change":"2024-09-11T22:14:26.959090+0000","last_active":"2024-09-11T22:14:27.956239+0000","last_peered":"2024-09-11T22:14:27.956239+0000","last_clean":"2024-09-11T22:14:27.956239+0000","last_became_active":"2024-09-11T22:14:26.958825+0000","last_became_peered":"2024-09-11T22:14:26.958825+0000","last_unstale":"2024-09-11T22:14:27.956239+0000","last_undegraded":"2024-09-11T22:14:27.956239+0000","last_fullsized":"2024-09-11T22:14:27.956239+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:45.664163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956876+0000","last_change":"2024-09-11T22:14:26.957998+0000","last_active":"2024-09-11T22:14:27.956876+0000","last_peered":"2024-09-11T22:14:27.956876+0000","last_clean":"2024-09-11T22:14:27.956876+0000","last_became_active":"2024-09-11T22:14:26.957683+0000","last_became_peered":"2024-09-11T22:14:26.957683+0000","last_unstale":"2024-09-11T22:14:27.956876+0000","last_undegraded":"2024-09-11T22:14:27.956876+0000","last_fullsized":"2024-09-11T22:14:27.956876+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.544029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955000+0000","last_change":"2024-09-11T22:14:26.963903+0000","last_active":"2024-09-11T22:14:27.955000+0000","last_peered":"2024-09-11T22:14:27.955000+0000","last_clean":"2024-09-11T22:14:27.955000+0000","last_became_active":"2024-09-11T22:14:26.963640+0000","last_became_peered":"2024-09-11T22:14:26.963640+0000","last_unstale":"2024-09-11T22:14:27.955000+0000","last_undegraded":"2024-09-11T22:14:27.955000+0000","last_fullsized":"2024-09-11T22:14:27.955000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:14.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238138+0000","last_change":"2024-09-11T22:14:26.957389+0000","last_active":"2024-09-11T22:14:29.238138+0000","last_peered":"2024-09-11T22:14:29.238138+0000","last_clean":"2024-09-11T22:14:29.238138+0000","last_became_active":"2024-09-11T22:14:26.957118+0000","last_became_peered":"2024-09-11T22:14:26.957118+0000","last_unstale":"2024-09-11T22:14:29.238138+0000","last_undegraded":"2024-09-11T22:14:29.238138+0000","last_fullsized":"2024-09-11T22:14:29.238138+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:10.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.964922+0000","last_change":"2024-09-11T22:14:26.961999+0000","last_active":"2024-09-11T22:14:26.964922+0000","last_peered":"2024-09-11T22:14:26.964922+0000","last_clean":"2024-09-11T22:14:26.964922+0000","last_became_active":"2024-09-11T22:14:26.961653+0000","last_became_peered":"2024-09-11T22:14:26.961653+0000","last_unstale":"2024-09-11T22:14:26.964922+0000","last_undegraded":"2024-09-11T22:14:26.964922+0000","last_fullsized":"2024-09-11T22:14:26.964922+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:40.552647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.949112+0000","last_change":"2024-09-11T22:14:25.949112+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.949112+0000","last_undegraded":"2024-09-11T22:14:25.949112+0000","last_fullsized":"2024-09-11T22:14:25.949112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237827+0000","last_change":"2024-09-11T22:14:26.957825+0000","last_active":"2024-09-11T22:14:29.237827+0000","last_peered":"2024-09-11T22:14:29.237827+0000","last_clean":"2024-09-11T22:14:29.237827+0000","last_became_active":"2024-09-11T22:14:26.957559+0000","last_became_peered":"2024-09-11T22:14:26.957559+0000","last_unstale":"2024-09-11T22:14:29.237827+0000","last_undegraded":"2024-09-11T22:14:29.237827+0000","last_fullsized":"2024-09-11T22:14:29.237827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:23.772181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.964963+0000","last_change":"2024-09-11T22:14:26.962434+0000","last_active":"2024-09-11T22:14:26.964963+0000","last_peered":"2024-09-11T22:14:26.964963+0000","last_clean":"2024-09-11T22:14:26.964963+0000","last_became_active":"2024-09-11T22:14:26.962132+0000","last_became_peered":"2024-09-11T22:14:26.962132+0000","last_unstale":"2024-09-11T22:14:26.964963+0000","last_undegraded":"2024-09-11T22:14:26.964963+0000","last_fullsized":"2024-09-11T22:14:26.964963+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:14.957468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237709+0000","last_change":"2024-09-11T22:14:26.970102+0000","last_active":"2024-09-11T22:14:29.237709+0000","last_peered":"2024-09-11T22:14:29.237709+0000","last_clean":"2024-09-11T22:14:29.237709+0000","last_became_active":"2024-09-11T22:14:26.968725+0000","last_became_peered":"2024-09-11T22:14:26.968725+0000","last_unstale":"2024-09-11T22:14:29.237709+0000","last_undegraded":"2024-09-11T22:14:29.237709+0000","last_fullsized":"2024-09-11T22:14:29.237709+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:54.820323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973486+0000","last_change":"2024-09-11T22:14:26.972685+0000","last_active":"2024-09-11T22:14:26.973486+0000","last_peered":"2024-09-11T22:14:26.973486+0000","last_clean":"2024-09-11T22:14:26.973486+0000","last_became_active":"2024-09-11T22:14:26.972444+0000","last_became_peered":"2024-09-11T22:14:26.972444+0000","last_unstale":"2024-09-11T22:14:26.973486+0000","last_undegraded":"2024-09-11T22:14:26.973486+0000","last_fullsized":"2024-09-11T22:14:26.973486+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:17.455050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045202+0000","last_change":"2024-09-11T22:14:26.953324+0000","last_active":"2024-09-11T22:14:28.045202+0000","last_peered":"2024-09-11T22:14:28.045202+0000","last_clean":"2024-09-11T22:14:28.045202+0000","last_became_active":"2024-09-11T22:14:26.951702+0000","last_became_peered":"2024-09-11T22:14:26.951702+0000","last_unstale":"2024-09-11T22:14:28.045202+0000","last_undegraded":"2024-09-11T22:14:28.045202+0000","last_fullsized":"2024-09-11T22:14:28.045202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:45.699757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.947311+0000","last_change":"2024-09-11T22:14:25.947311+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.947311+0000","last_undegraded":"2024-09-11T22:14:25.947311+0000","last_fullsized":"2024-09-11T22:14:25.947311+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957209+0000","last_change":"2024-09-11T22:14:26.966619+0000","last_active":"2024-09-11T22:14:27.957209+0000","last_peered":"2024-09-11T22:14:27.957209+0000","last_clean":"2024-09-11T22:14:27.957209+0000","last_became_active":"2024-09-11T22:14:26.966166+0000","last_became_peered":"2024-09-11T22:14:26.966166+0000","last_unstale":"2024-09-11T22:14:27.957209+0000","last_undegraded":"2024-09-11T22:14:27.957209+0000","last_fullsized":"2024-09-11T22:14:27.957209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:48.700476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955344+0000","last_change":"2024-09-11T22:14:26.959657+0000","last_active":"2024-09-11T22:14:27.955344+0000","last_peered":"2024-09-11T22:14:27.955344+0000","last_clean":"2024-09-11T22:14:27.955344+0000","last_became_active":"2024-09-11T22:14:26.957995+0000","last_became_peered":"2024-09-11T22:14:26.957995+0000","last_unstale":"2024-09-11T22:14:27.955344+0000","last_undegraded":"2024-09-11T22:14:27.955344+0000","last_fullsized":"2024-09-11T22:14:27.955344+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:45.625414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.946343+0000","last_change":"2024-09-11T22:14:25.946343+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.946343+0000","last_undegraded":"2024-09-11T22:14:25.946343+0000","last_fullsized":"2024-09-11T22:14:25.946343+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238020+0000","last_change":"2024-09-11T22:14:26.965288+0000","last_active":"2024-09-11T22:14:29.238020+0000","last_peered":"2024-09-11T22:14:29.238020+0000","last_clean":"2024-09-11T22:14:29.238020+0000","last_became_active":"2024-09-11T22:14:26.963346+0000","last_became_peered":"2024-09-11T22:14:26.963346+0000","last_unstale":"2024-09-11T22:14:29.238020+0000","last_undegraded":"2024-09-11T22:14:29.238020+0000","last_fullsized":"2024-09-11T22:14:29.238020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:36.369029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.961779+0000","last_change":"2024-09-11T22:14:26.959933+0000","last_active":"2024-09-11T22:14:26.961779+0000","last_peered":"2024-09-11T22:14:26.961779+0000","last_clean":"2024-09-11T22:14:26.961779+0000","last_became_active":"2024-09-11T22:14:26.959673+0000","last_became_peered":"2024-09-11T22:14:26.959673+0000","last_unstale":"2024-09-11T22:14:26.961779+0000","last_undegraded":"2024-09-11T22:14:26.961779+0000","last_fullsized":"2024-09-11T22:14:26.961779+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:16.039732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.946662+0000","last_change":"2024-09-11T22:14:25.946662+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.946662+0000","last_undegraded":"2024-09-11T22:14:25.946662+0000","last_fullsized":"2024-09-11T22:14:25.946662+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955340+0000","last_change":"2024-09-11T22:14:26.957135+0000","last_active":"2024-09-11T22:14:27.955340+0000","last_peered":"2024-09-11T22:14:27.955340+0000","last_clean":"2024-09-11T22:14:27.955340+0000","last_became_active":"2024-09-11T22:14:26.956870+0000","last_became_peered":"2024-09-11T22:14:26.956870+0000","last_unstale":"2024-09-11T22:14:27.955340+0000","last_undegraded":"2024-09-11T22:14:27.955340+0000","last_fullsized":"2024-09-11T22:14:27.955340+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:17.912234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955540+0000","last_change":"2024-09-11T22:14:26.962072+0000","last_active":"2024-09-11T22:14:27.955540+0000","last_peered":"2024-09-11T22:14:27.955540+0000","last_clean":"2024-09-11T22:14:27.955540+0000","last_became_active":"2024-09-11T22:14:26.961817+0000","last_became_peered":"2024-09-11T22:14:26.961817+0000","last_unstale":"2024-09-11T22:14:27.955540+0000","last_undegraded":"2024-09-11T22:14:27.955540+0000","last_fullsized":"2024-09-11T22:14:27.955540+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:14.514452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955612+0000","last_change":"2024-09-11T22:14:25.952024+0000","last_active":"2024-09-11T22:14:27.955612+0000","last_peered":"2024-09-11T22:14:27.955612+0000","last_clean":"2024-09-11T22:14:27.955612+0000","last_became_active":"2024-09-11T22:14:25.951739+0000","last_became_peered":"2024-09-11T22:14:25.951739+0000","last_unstale":"2024-09-11T22:14:27.955612+0000","last_undegraded":"2024-09-11T22:14:27.955612+0000","last_fullsized":"2024-09-11T22:14:27.955612+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:36.134800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650758+0000","last_change":"2024-09-11T22:14:26.964714+0000","last_active":"2024-09-11T22:14:28.650758+0000","last_peered":"2024-09-11T22:14:28.650758+0000","last_clean":"2024-09-11T22:14:28.650758+0000","last_became_active":"2024-09-11T22:14:26.964485+0000","last_became_peered":"2024-09-11T22:14:26.964485+0000","last_unstale":"2024-09-11T22:14:28.650758+0000","last_undegraded":"2024-09-11T22:14:28.650758+0000","last_fullsized":"2024-09-11T22:14:28.650758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:41.146664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238072+0000","last_change":"2024-09-11T22:14:25.956149+0000","last_active":"2024-09-11T22:14:29.238072+0000","last_peered":"2024-09-11T22:14:29.238072+0000","last_clean":"2024-09-11T22:14:29.238072+0000","last_became_active":"2024-09-11T22:14:25.955403+0000","last_became_peered":"2024-09-11T22:14:25.955403+0000","last_unstale":"2024-09-11T22:14:29.238072+0000","last_undegraded":"2024-09-11T22:14:29.238072+0000","last_fullsized":"2024-09-11T22:14:29.238072+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:15.536125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955173+0000","last_change":"2024-09-11T22:14:26.964943+0000","last_active":"2024-09-11T22:14:27.955173+0000","last_peered":"2024-09-11T22:14:27.955173+0000","last_clean":"2024-09-11T22:14:27.955173+0000","last_became_active":"2024-09-11T22:14:26.964416+0000","last_became_peered":"2024-09-11T22:14:26.964416+0000","last_unstale":"2024-09-11T22:14:27.955173+0000","last_undegraded":"2024-09-11T22:14:27.955173+0000","last_fullsized":"2024-09-11T22:14:27.955173+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:36.926975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955571+0000","last_change":"2024-09-11T22:14:25.960586+0000","last_active":"2024-09-11T22:14:27.955571+0000","last_peered":"2024-09-11T22:14:27.955571+0000","last_clean":"2024-09-11T22:14:27.955571+0000","last_became_active":"2024-09-11T22:14:25.960280+0000","last_became_peered":"2024-09-11T22:14:25.960280+0000","last_unstale":"2024-09-11T22:14:27.955571+0000","last_undegraded":"2024-09-11T22:14:27.955571+0000","last_fullsized":"2024-09-11T22:14:27.955571+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:40.139062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955425+0000","last_change":"2024-09-11T22:14:26.961155+0000","last_active":"2024-09-11T22:14:27.955425+0000","last_peered":"2024-09-11T22:14:27.955425+0000","last_clean":"2024-09-11T22:14:27.955425+0000","last_became_active":"2024-09-11T22:14:26.960654+0000","last_became_peered":"2024-09-11T22:14:26.960654+0000","last_unstale":"2024-09-11T22:14:27.955425+0000","last_undegraded":"2024-09-11T22:14:27.955425+0000","last_fullsized":"2024-09-11T22:14:27.955425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957272+0000","last_change":"2024-09-11T22:14:25.954648+0000","last_active":"2024-09-11T22:14:27.957272+0000","last_peered":"2024-09-11T22:14:27.957272+0000","last_clean":"2024-09-11T22:14:27.957272+0000","last_became_active":"2024-09-11T22:14:25.954334+0000","last_became_peered":"2024-09-11T22:14:25.954334+0000","last_unstale":"2024-09-11T22:14:27.957272+0000","last_undegraded":"2024-09-11T22:14:27.957272+0000","last_fullsized":"2024-09-11T22:14:27.957272+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:12.136592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238149+0000","last_change":"2024-09-11T22:14:26.969858+0000","last_active":"2024-09-11T22:14:29.238149+0000","last_peered":"2024-09-11T22:14:29.238149+0000","last_clean":"2024-09-11T22:14:29.238149+0000","last_became_active":"2024-09-11T22:14:26.968413+0000","last_became_peered":"2024-09-11T22:14:26.968413+0000","last_unstale":"2024-09-11T22:14:29.238149+0000","last_undegraded":"2024-09-11T22:14:29.238149+0000","last_fullsized":"2024-09-11T22:14:29.238149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:26.978341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955958+0000","last_change":"2024-09-11T22:14:25.950287+0000","last_active":"2024-09-11T22:14:27.955958+0000","last_peered":"2024-09-11T22:14:27.955958+0000","last_clean":"2024-09-11T22:14:27.955958+0000","last_became_active":"2024-09-11T22:14:25.950020+0000","last_became_peered":"2024-09-11T22:14:25.950020+0000","last_unstale":"2024-09-11T22:14:27.955958+0000","last_undegraded":"2024-09-11T22:14:27.955958+0000","last_fullsized":"2024-09-11T22:14:27.955958+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:31.695327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238193+0000","last_change":"2024-09-11T22:14:26.957412+0000","last_active":"2024-09-11T22:14:29.238193+0000","last_peered":"2024-09-11T22:14:29.238193+0000","last_clean":"2024-09-11T22:14:29.238193+0000","last_became_active":"2024-09-11T22:14:26.957003+0000","last_became_peered":"2024-09-11T22:14:26.957003+0000","last_unstale":"2024-09-11T22:14:29.238193+0000","last_undegraded":"2024-09-11T22:14:29.238193+0000","last_fullsized":"2024-09-11T22:14:29.238193+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:00.215569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955193+0000","last_change":"2024-09-11T22:14:25.956470+0000","last_active":"2024-09-11T22:14:27.955193+0000","last_peered":"2024-09-11T22:14:27.955193+0000","last_clean":"2024-09-11T22:14:27.955193+0000","last_became_active":"2024-09-11T22:14:25.956032+0000","last_became_peered":"2024-09-11T22:14:25.956032+0000","last_unstale":"2024-09-11T22:14:27.955193+0000","last_undegraded":"2024-09-11T22:14:27.955193+0000","last_fullsized":"2024-09-11T22:14:27.955193+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:17.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045221+0000","last_change":"2024-09-11T22:14:26.957303+0000","last_active":"2024-09-11T22:14:28.045221+0000","last_peered":"2024-09-11T22:14:28.045221+0000","last_clean":"2024-09-11T22:14:28.045221+0000","last_became_active":"2024-09-11T22:14:26.957049+0000","last_became_peered":"2024-09-11T22:14:26.957049+0000","last_unstale":"2024-09-11T22:14:28.045221+0000","last_undegraded":"2024-09-11T22:14:28.045221+0000","last_fullsized":"2024-09-11T22:14:28.045221+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:54.823432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957147+0000","last_change":"2024-09-11T22:14:25.950524+0000","last_active":"2024-09-11T22:14:27.957147+0000","last_peered":"2024-09-11T22:14:27.957147+0000","last_clean":"2024-09-11T22:14:27.957147+0000","last_became_active":"2024-09-11T22:14:25.950266+0000","last_became_peered":"2024-09-11T22:14:25.950266+0000","last_unstale":"2024-09-11T22:14:27.957147+0000","last_undegraded":"2024-09-11T22:14:27.957147+0000","last_fullsized":"2024-09-11T22:14:27.957147+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:46.536428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237812+0000","last_change":"2024-09-11T22:14:26.959688+0000","last_active":"2024-09-11T22:14:29.237812+0000","last_peered":"2024-09-11T22:14:29.237812+0000","last_clean":"2024-09-11T22:14:29.237812+0000","last_became_active":"2024-09-11T22:14:26.958964+0000","last_became_peered":"2024-09-11T22:14:26.958964+0000","last_unstale":"2024-09-11T22:14:29.237812+0000","last_undegraded":"2024-09-11T22:14:29.237812+0000","last_fullsized":"2024-09-11T22:14:29.237812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:40.951930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956044+0000","last_change":"2024-09-11T22:14:25.957377+0000","last_active":"2024-09-11T22:14:27.956044+0000","last_peered":"2024-09-11T22:14:27.956044+0000","last_clean":"2024-09-11T22:14:27.956044+0000","last_became_active":"2024-09-11T22:14:25.957103+0000","last_became_peered":"2024-09-11T22:14:25.957103+0000","last_unstale":"2024-09-11T22:14:27.956044+0000","last_undegraded":"2024-09-11T22:14:27.956044+0000","last_fullsized":"2024-09-11T22:14:27.956044+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:17.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956917+0000","last_change":"2024-09-11T22:14:26.969252+0000","last_active":"2024-09-11T22:14:27.956917+0000","last_peered":"2024-09-11T22:14:27.956917+0000","last_clean":"2024-09-11T22:14:27.956917+0000","last_became_active":"2024-09-11T22:14:26.968962+0000","last_became_peered":"2024-09-11T22:14:26.968962+0000","last_unstale":"2024-09-11T22:14:27.956917+0000","last_undegraded":"2024-09-11T22:14:27.956917+0000","last_fullsized":"2024-09-11T22:14:27.956917+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:34.920148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.954203+0000","last_change":"2024-09-11T22:14:25.955890+0000","last_active":"2024-09-11T22:14:26.954203+0000","last_peered":"2024-09-11T22:14:26.954203+0000","last_clean":"2024-09-11T22:14:26.954203+0000","last_became_active":"2024-09-11T22:14:25.955601+0000","last_became_peered":"2024-09-11T22:14:25.955601+0000","last_unstale":"2024-09-11T22:14:26.954203+0000","last_undegraded":"2024-09-11T22:14:26.954203+0000","last_fullsized":"2024-09-11T22:14:26.954203+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:25.167921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.970806+0000","last_change":"2024-09-11T22:14:26.967750+0000","last_active":"2024-09-11T22:14:26.970806+0000","last_peered":"2024-09-11T22:14:26.970806+0000","last_clean":"2024-09-11T22:14:26.970806+0000","last_became_active":"2024-09-11T22:14:26.967492+0000","last_became_peered":"2024-09-11T22:14:26.967492+0000","last_unstale":"2024-09-11T22:14:26.970806+0000","last_undegraded":"2024-09-11T22:14:26.970806+0000","last_fullsized":"2024-09-11T22:14:26.970806+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:31.624389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238185+0000","last_change":"2024-09-11T22:14:25.951977+0000","last_active":"2024-09-11T22:14:29.238185+0000","last_peered":"2024-09-11T22:14:29.238185+0000","last_clean":"2024-09-11T22:14:29.238185+0000","last_became_active":"2024-09-11T22:14:25.951186+0000","last_became_peered":"2024-09-11T22:14:25.951186+0000","last_unstale":"2024-09-11T22:14:29.238185+0000","last_undegraded":"2024-09-11T22:14:29.238185+0000","last_fullsized":"2024-09-11T22:14:29.238185+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:42.115865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650581+0000","last_change":"2024-09-11T22:14:26.966320+0000","last_active":"2024-09-11T22:14:28.650581+0000","last_peered":"2024-09-11T22:14:28.650581+0000","last_clean":"2024-09-11T22:14:28.650581+0000","last_became_active":"2024-09-11T22:14:26.966062+0000","last_became_peered":"2024-09-11T22:14:26.966062+0000","last_unstale":"2024-09-11T22:14:28.650581+0000","last_undegraded":"2024-09-11T22:14:28.650581+0000","last_fullsized":"2024-09-11T22:14:28.650581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:18.648523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.969140+0000","last_change":"2024-09-11T22:14:25.958570+0000","last_active":"2024-09-11T22:14:26.969140+0000","last_peered":"2024-09-11T22:14:26.969140+0000","last_clean":"2024-09-11T22:14:26.969140+0000","last_became_active":"2024-09-11T22:14:25.958356+0000","last_became_peered":"2024-09-11T22:14:25.958356+0000","last_unstale":"2024-09-11T22:14:26.969140+0000","last_undegraded":"2024-09-11T22:14:26.969140+0000","last_fullsized":"2024-09-11T22:14:26.969140+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:29.549649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973134+0000","last_change":"2024-09-11T22:14:26.968253+0000","last_active":"2024-09-11T22:14:26.973134+0000","last_peered":"2024-09-11T22:14:26.973134+0000","last_clean":"2024-09-11T22:14:26.973134+0000","last_became_active":"2024-09-11T22:14:26.967949+0000","last_became_peered":"2024-09-11T22:14:26.967949+0000","last_unstale":"2024-09-11T22:14:26.973134+0000","last_undegraded":"2024-09-11T22:14:26.973134+0000","last_fullsized":"2024-09-11T22:14:26.973134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:30.165873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956950+0000","last_change":"2024-09-11T22:14:25.956145+0000","last_active":"2024-09-11T22:14:27.956950+0000","last_peered":"2024-09-11T22:14:27.956950+0000","last_clean":"2024-09-11T22:14:27.956950+0000","last_became_active":"2024-09-11T22:14:25.955833+0000","last_became_peered":"2024-09-11T22:14:25.955833+0000","last_unstale":"2024-09-11T22:14:27.956950+0000","last_undegraded":"2024-09-11T22:14:27.956950+0000","last_fullsized":"2024-09-11T22:14:27.956950+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:34.327331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956077+0000","last_change":"2024-09-11T22:14:26.959737+0000","last_active":"2024-09-11T22:14:27.956077+0000","last_peered":"2024-09-11T22:14:27.956077+0000","last_clean":"2024-09-11T22:14:27.956077+0000","last_became_active":"2024-09-11T22:14:26.959509+0000","last_became_peered":"2024-09-11T22:14:26.959509+0000","last_unstale":"2024-09-11T22:14:27.956077+0000","last_undegraded":"2024-09-11T22:14:27.956077+0000","last_fullsized":"2024-09-11T22:14:27.956077+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237856+0000","last_change":"2024-09-11T22:14:25.959102+0000","last_active":"2024-09-11T22:14:29.237856+0000","last_peered":"2024-09-11T22:14:29.237856+0000","last_clean":"2024-09-11T22:14:29.237856+0000","last_became_active":"2024-09-11T22:14:25.956666+0000","last_became_peered":"2024-09-11T22:14:25.956666+0000","last_unstale":"2024-09-11T22:14:29.237856+0000","last_undegraded":"2024-09-11T22:14:29.237856+0000","last_fullsized":"2024-09-11T22:14:29.237856+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:13.506850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.962976+0000","last_change":"2024-09-11T22:14:26.960877+0000","last_active":"2024-09-11T22:14:26.962976+0000","last_peered":"2024-09-11T22:14:26.962976+0000","last_clean":"2024-09-11T22:14:26.962976+0000","last_became_active":"2024-09-11T22:14:26.960545+0000","last_became_peered":"2024-09-11T22:14:26.960545+0000","last_unstale":"2024-09-11T22:14:26.962976+0000","last_undegraded":"2024-09-11T22:14:26.962976+0000","last_fullsized":"2024-09-11T22:14:26.962976+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:14.172517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045066+0000","last_change":"2024-09-11T22:14:25.954749+0000","last_active":"2024-09-11T22:14:28.045066+0000","last_peered":"2024-09-11T22:14:28.045066+0000","last_clean":"2024-09-11T22:14:28.045066+0000","last_became_active":"2024-09-11T22:14:25.954401+0000","last_became_peered":"2024-09-11T22:14:25.954401+0000","last_unstale":"2024-09-11T22:14:28.045066+0000","last_undegraded":"2024-09-11T22:14:28.045066+0000","last_fullsized":"2024-09-11T22:14:28.045066+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:44.892896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955926+0000","last_change":"2024-09-11T22:14:26.963837+0000","last_active":"2024-09-11T22:14:27.955926+0000","last_peered":"2024-09-11T22:14:27.955926+0000","last_clean":"2024-09-11T22:14:27.955926+0000","last_became_active":"2024-09-11T22:14:26.963576+0000","last_became_peered":"2024-09-11T22:14:26.963576+0000","last_unstale":"2024-09-11T22:14:27.955926+0000","last_undegraded":"2024-09-11T22:14:27.955926+0000","last_fullsized":"2024-09-11T22:14:27.955926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:11.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957202+0000","last_change":"2024-09-11T22:14:25.951651+0000","last_active":"2024-09-11T22:14:27.957202+0000","last_peered":"2024-09-11T22:14:27.957202+0000","last_clean":"2024-09-11T22:14:27.957202+0000","last_became_active":"2024-09-11T22:14:25.951299+0000","last_became_peered":"2024-09-11T22:14:25.951299+0000","last_unstale":"2024-09-11T22:14:27.957202+0000","last_undegraded":"2024-09-11T22:14:27.957202+0000","last_fullsized":"2024-09-11T22:14:27.957202+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:33.912546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973466+0000","last_change":"2024-09-11T22:14:26.972480+0000","last_active":"2024-09-11T22:14:26.973466+0000","last_peered":"2024-09-11T22:14:26.973466+0000","last_clean":"2024-09-11T22:14:26.973466+0000","last_became_active":"2024-09-11T22:14:26.972332+0000","last_became_peered":"2024-09-11T22:14:26.972332+0000","last_unstale":"2024-09-11T22:14:26.973466+0000","last_undegraded":"2024-09-11T22:14:26.973466+0000","last_fullsized":"2024-09-11T22:14:26.973466+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:53.958006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.966367+0000","last_change":"2024-09-11T22:14:25.956614+0000","last_active":"2024-09-11T22:14:26.966367+0000","last_peered":"2024-09-11T22:14:26.966367+0000","last_clean":"2024-09-11T22:14:26.966367+0000","last_became_active":"2024-09-11T22:14:25.956306+0000","last_became_peered":"2024-09-11T22:14:25.956306+0000","last_unstale":"2024-09-11T22:14:26.966367+0000","last_undegraded":"2024-09-11T22:14:26.966367+0000","last_fullsized":"2024-09-11T22:14:26.966367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:39.705969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.968425+0000","last_change":"2024-09-11T22:14:26.966426+0000","last_active":"2024-09-11T22:14:26.968425+0000","last_peered":"2024-09-11T22:14:26.968425+0000","last_clean":"2024-09-11T22:14:26.968425+0000","last_became_active":"2024-09-11T22:14:26.966157+0000","last_became_peered":"2024-09-11T22:14:26.966157+0000","last_unstale":"2024-09-11T22:14:26.968425+0000","last_undegraded":"2024-09-11T22:14:26.968425+0000","last_fullsized":"2024-09-11T22:14:26.968425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:21.554097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238251+0000","last_change":"2024-09-11T22:14:25.960512+0000","last_active":"2024-09-11T22:14:29.238251+0000","last_peered":"2024-09-11T22:14:29.238251+0000","last_clean":"2024-09-11T22:14:29.238251+0000","last_became_active":"2024-09-11T22:14:25.960249+0000","last_became_peered":"2024-09-11T22:14:25.960249+0000","last_unstale":"2024-09-11T22:14:29.238251+0000","last_undegraded":"2024-09-11T22:14:29.238251+0000","last_fullsized":"2024-09-11T22:14:29.238251+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:12.252400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956341+0000","last_change":"2024-09-11T22:14:26.960080+0000","last_active":"2024-09-11T22:14:27.956341+0000","last_peered":"2024-09-11T22:14:27.956341+0000","last_clean":"2024-09-11T22:14:27.956341+0000","last_became_active":"2024-09-11T22:14:26.959778+0000","last_became_peered":"2024-09-11T22:14:26.959778+0000","last_unstale":"2024-09-11T22:14:27.956341+0000","last_undegraded":"2024-09-11T22:14:27.956341+0000","last_fullsized":"2024-09-11T22:14:27.956341+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:14.514452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955559+0000","last_change":"2024-09-11T22:14:25.953232+0000","last_active":"2024-09-11T22:14:27.955559+0000","last_peered":"2024-09-11T22:14:27.955559+0000","last_clean":"2024-09-11T22:14:27.955559+0000","last_became_active":"2024-09-11T22:14:25.952951+0000","last_became_peered":"2024-09-11T22:14:25.952951+0000","last_unstale":"2024-09-11T22:14:27.955559+0000","last_undegraded":"2024-09-11T22:14:27.955559+0000","last_fullsized":"2024-09-11T22:14:27.955559+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:31.695327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237924+0000","last_change":"2024-09-11T22:14:26.965790+0000","last_active":"2024-09-11T22:14:29.237924+0000","last_peered":"2024-09-11T22:14:29.237924+0000","last_clean":"2024-09-11T22:14:29.237924+0000","last_became_active":"2024-09-11T22:14:26.965502+0000","last_became_peered":"2024-09-11T22:14:26.965502+0000","last_unstale":"2024-09-11T22:14:29.237924+0000","last_undegraded":"2024-09-11T22:14:29.237924+0000","last_fullsized":"2024-09-11T22:14:29.237924+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:51.944511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956610+0000","last_change":"2024-09-11T22:14:25.951206+0000","last_active":"2024-09-11T22:14:27.956610+0000","last_peered":"2024-09-11T22:14:27.956610+0000","last_clean":"2024-09-11T22:14:27.956610+0000","last_became_active":"2024-09-11T22:14:25.950899+0000","last_became_peered":"2024-09-11T22:14:25.950899+0000","last_unstale":"2024-09-11T22:14:27.956610+0000","last_undegraded":"2024-09-11T22:14:27.956610+0000","last_fullsized":"2024-09-11T22:14:27.956610+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:44.656561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973155+0000","last_change":"2024-09-11T22:14:26.968273+0000","last_active":"2024-09-11T22:14:26.973155+0000","last_peered":"2024-09-11T22:14:26.973155+0000","last_clean":"2024-09-11T22:14:26.973155+0000","last_became_active":"2024-09-11T22:14:26.967984+0000","last_became_peered":"2024-09-11T22:14:26.967984+0000","last_unstale":"2024-09-11T22:14:26.973155+0000","last_undegraded":"2024-09-11T22:14:26.973155+0000","last_fullsized":"2024-09-11T22:14:26.973155+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:44.444736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955266+0000","last_change":"2024-09-11T22:14:25.958361+0000","last_active":"2024-09-11T22:14:27.955266+0000","last_peered":"2024-09-11T22:14:27.955266+0000","last_clean":"2024-09-11T22:14:27.955266+0000","last_became_active":"2024-09-11T22:14:25.957879+0000","last_became_peered":"2024-09-11T22:14:25.957879+0000","last_unstale":"2024-09-11T22:14:27.955266+0000","last_undegraded":"2024-09-11T22:14:27.955266+0000","last_fullsized":"2024-09-11T22:14:27.955266+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:52.954746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956243+0000","last_change":"2024-09-11T22:14:26.959870+0000","last_active":"2024-09-11T22:14:27.956243+0000","last_peered":"2024-09-11T22:14:27.956243+0000","last_clean":"2024-09-11T22:14:27.956243+0000","last_became_active":"2024-09-11T22:14:26.957903+0000","last_became_peered":"2024-09-11T22:14:26.957903+0000","last_unstale":"2024-09-11T22:14:27.956243+0000","last_undegraded":"2024-09-11T22:14:27.956243+0000","last_fullsized":"2024-09-11T22:14:27.956243+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:16.543726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238146+0000","last_change":"2024-09-11T22:14:25.958591+0000","last_active":"2024-09-11T22:14:29.238146+0000","last_peered":"2024-09-11T22:14:29.238146+0000","last_clean":"2024-09-11T22:14:29.238146+0000","last_became_active":"2024-09-11T22:14:25.958303+0000","last_became_peered":"2024-09-11T22:14:25.958303+0000","last_unstale":"2024-09-11T22:14:29.238146+0000","last_undegraded":"2024-09-11T22:14:29.238146+0000","last_fullsized":"2024-09-11T22:14:29.238146+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:24.724328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955309+0000","last_change":"2024-09-11T22:14:26.957372+0000","last_active":"2024-09-11T22:14:27.955309+0000","last_peered":"2024-09-11T22:14:27.955309+0000","last_clean":"2024-09-11T22:14:27.955309+0000","last_became_active":"2024-09-11T22:14:26.956741+0000","last_became_peered":"2024-09-11T22:14:26.956741+0000","last_unstale":"2024-09-11T22:14:27.955309+0000","last_undegraded":"2024-09-11T22:14:27.955309+0000","last_fullsized":"2024-09-11T22:14:27.955309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.496550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650503+0000","last_change":"2024-09-11T22:14:25.954496+0000","last_active":"2024-09-11T22:14:28.650503+0000","last_peered":"2024-09-11T22:14:28.650503+0000","last_clean":"2024-09-11T22:14:28.650503+0000","last_became_active":"2024-09-11T22:14:25.954243+0000","last_became_peered":"2024-09-11T22:14:25.954243+0000","last_unstale":"2024-09-11T22:14:28.650503+0000","last_undegraded":"2024-09-11T22:14:28.650503+0000","last_fullsized":"2024-09-11T22:14:28.650503+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:39.537090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955070+0000","last_change":"2024-09-11T22:14:26.958126+0000","last_active":"2024-09-11T22:14:27.955070+0000","last_peered":"2024-09-11T22:14:27.955070+0000","last_clean":"2024-09-11T22:14:27.955070+0000","last_became_active":"2024-09-11T22:14:26.957849+0000","last_became_peered":"2024-09-11T22:14:26.957849+0000","last_unstale":"2024-09-11T22:14:27.955070+0000","last_undegraded":"2024-09-11T22:14:27.955070+0000","last_fullsized":"2024-09-11T22:14:27.955070+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:46.007324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955914+0000","last_change":"2024-09-11T22:14:25.957351+0000","last_active":"2024-09-11T22:14:27.955914+0000","last_peered":"2024-09-11T22:14:27.955914+0000","last_clean":"2024-09-11T22:14:27.955914+0000","last_became_active":"2024-09-11T22:14:25.957078+0000","last_became_peered":"2024-09-11T22:14:25.957078+0000","last_unstale":"2024-09-11T22:14:27.955914+0000","last_undegraded":"2024-09-11T22:14:27.955914+0000","last_fullsized":"2024-09-11T22:14:27.955914+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:10.280169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957199+0000","last_change":"2024-09-11T22:14:26.959295+0000","last_active":"2024-09-11T22:14:27.957199+0000","last_peered":"2024-09-11T22:14:27.957199+0000","last_clean":"2024-09-11T22:14:27.957199+0000","last_became_active":"2024-09-11T22:14:26.958326+0000","last_became_peered":"2024-09-11T22:14:26.958326+0000","last_unstale":"2024-09-11T22:14:27.957199+0000","last_undegraded":"2024-09-11T22:14:27.957199+0000","last_fullsized":"2024-09-11T22:14:27.957199+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:13.260002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650693+0000","last_change":"2024-09-11T22:14:25.957828+0000","last_active":"2024-09-11T22:14:28.650693+0000","last_peered":"2024-09-11T22:14:28.650693+0000","last_clean":"2024-09-11T22:14:28.650693+0000","last_became_active":"2024-09-11T22:14:25.957530+0000","last_became_peered":"2024-09-11T22:14:25.957530+0000","last_unstale":"2024-09-11T22:14:28.650693+0000","last_undegraded":"2024-09-11T22:14:28.650693+0000","last_fullsized":"2024-09-11T22:14:28.650693+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:33.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956558+0000","last_change":"2024-09-11T22:14:26.962695+0000","last_active":"2024-09-11T22:14:27.956558+0000","last_peered":"2024-09-11T22:14:27.956558+0000","last_clean":"2024-09-11T22:14:27.956558+0000","last_became_active":"2024-09-11T22:14:26.962168+0000","last_became_peered":"2024-09-11T22:14:26.962168+0000","last_unstale":"2024-09-11T22:14:27.956558+0000","last_undegraded":"2024-09-11T22:14:27.956558+0000","last_fullsized":"2024-09-11T22:14:27.956558+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:25.731929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.948031+0000","last_change":"2024-09-11T22:14:25.954069+0000","last_active":"2024-09-11T22:14:28.948031+0000","last_peered":"2024-09-11T22:14:28.948031+0000","last_clean":"2024-09-11T22:14:28.948031+0000","last_became_active":"2024-09-11T22:14:25.953797+0000","last_became_peered":"2024-09-11T22:14:25.953797+0000","last_unstale":"2024-09-11T22:14:28.948031+0000","last_undegraded":"2024-09-11T22:14:28.948031+0000","last_fullsized":"2024-09-11T22:14:28.948031+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:34.327331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650617+0000","last_change":"2024-09-11T22:14:26.965457+0000","last_active":"2024-09-11T22:14:28.650617+0000","last_peered":"2024-09-11T22:14:28.650617+0000","last_clean":"2024-09-11T22:14:28.650617+0000","last_became_active":"2024-09-11T22:14:26.965210+0000","last_became_peered":"2024-09-11T22:14:26.965210+0000","last_unstale":"2024-09-11T22:14:28.650617+0000","last_undegraded":"2024-09-11T22:14:28.650617+0000","last_fullsized":"2024-09-11T22:14:28.650617+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:35.334932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045209+0000","last_change":"2024-09-11T22:14:25.954345+0000","last_active":"2024-09-11T22:14:28.045209+0000","last_peered":"2024-09-11T22:14:28.045209+0000","last_clean":"2024-09-11T22:14:28.045209+0000","last_became_active":"2024-09-11T22:14:25.954043+0000","last_became_peered":"2024-09-11T22:14:25.954043+0000","last_unstale":"2024-09-11T22:14:28.045209+0000","last_undegraded":"2024-09-11T22:14:28.045209+0000","last_fullsized":"2024-09-11T22:14:28.045209+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:51.604884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955489+0000","last_change":"2024-09-11T22:14:26.960931+0000","last_active":"2024-09-11T22:14:27.955489+0000","last_peered":"2024-09-11T22:14:27.955489+0000","last_clean":"2024-09-11T22:14:27.955489+0000","last_became_active":"2024-09-11T22:14:26.960291+0000","last_became_peered":"2024-09-11T22:14:26.960291+0000","last_unstale":"2024-09-11T22:14:27.955489+0000","last_undegraded":"2024-09-11T22:14:27.955489+0000","last_fullsized":"2024-09-11T22:14:27.955489+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:16.543726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957332+0000","last_change":"2024-09-11T22:14:25.950162+0000","last_active":"2024-09-11T22:14:27.957332+0000","last_peered":"2024-09-11T22:14:27.957332+0000","last_clean":"2024-09-11T22:14:27.957332+0000","last_became_active":"2024-09-11T22:14:25.949856+0000","last_became_peered":"2024-09-11T22:14:25.949856+0000","last_unstale":"2024-09-11T22:14:27.957332+0000","last_undegraded":"2024-09-11T22:14:27.957332+0000","last_fullsized":"2024-09-11T22:14:27.957332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:16.056310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237864+0000","last_change":"2024-09-11T22:14:26.968109+0000","last_active":"2024-09-11T22:14:29.237864+0000","last_peered":"2024-09-11T22:14:29.237864+0000","last_clean":"2024-09-11T22:14:29.237864+0000","last_became_active":"2024-09-11T22:14:26.967838+0000","last_became_peered":"2024-09-11T22:14:26.967838+0000","last_unstale":"2024-09-11T22:14:29.237864+0000","last_undegraded":"2024-09-11T22:14:29.237864+0000","last_fullsized":"2024-09-11T22:14:29.237864+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:44.391169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650403+0000","last_change":"2024-09-11T22:14:25.953604+0000","last_active":"2024-09-11T22:14:28.650403+0000","last_peered":"2024-09-11T22:14:28.650403+0000","last_clean":"2024-09-11T22:14:28.650403+0000","last_became_active":"2024-09-11T22:14:25.953317+0000","last_became_peered":"2024-09-11T22:14:25.953317+0000","last_unstale":"2024-09-11T22:14:28.650403+0000","last_undegraded":"2024-09-11T22:14:28.650403+0000","last_fullsized":"2024-09-11T22:14:28.650403+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:56.831702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973444+0000","last_change":"2024-09-11T22:14:26.971798+0000","last_active":"2024-09-11T22:14:26.973444+0000","last_peered":"2024-09-11T22:14:26.973444+0000","last_clean":"2024-09-11T22:14:26.973444+0000","last_became_active":"2024-09-11T22:14:26.971548+0000","last_became_peered":"2024-09-11T22:14:26.971548+0000","last_unstale":"2024-09-11T22:14:26.973444+0000","last_undegraded":"2024-09-11T22:14:26.973444+0000","last_fullsized":"2024-09-11T22:14:26.973444+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:44.655053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956340+0000","last_change":"2024-09-11T22:14:25.955614+0000","last_active":"2024-09-11T22:14:27.956340+0000","last_peered":"2024-09-11T22:14:27.956340+0000","last_clean":"2024-09-11T22:14:27.956340+0000","last_became_active":"2024-09-11T22:14:25.955095+0000","last_became_peered":"2024-09-11T22:14:25.955095+0000","last_unstale":"2024-09-11T22:14:27.956340+0000","last_undegraded":"2024-09-11T22:14:27.956340+0000","last_fullsized":"2024-09-11T22:14:27.956340+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:12.454865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650348+0000","last_change":"2024-09-11T22:14:26.963669+0000","last_active":"2024-09-11T22:14:28.650348+0000","last_peered":"2024-09-11T22:14:28.650348+0000","last_clean":"2024-09-11T22:14:28.650348+0000","last_became_active":"2024-09-11T22:14:26.963377+0000","last_became_peered":"2024-09-11T22:14:26.963377+0000","last_unstale":"2024-09-11T22:14:28.650348+0000","last_undegraded":"2024-09-11T22:14:28.650348+0000","last_fullsized":"2024-09-11T22:14:28.650348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:32.702928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650495+0000","last_change":"2024-09-11T22:14:25.955422+0000","last_active":"2024-09-11T22:14:28.650495+0000","last_peered":"2024-09-11T22:14:28.650495+0000","last_clean":"2024-09-11T22:14:28.650495+0000","last_became_active":"2024-09-11T22:14:25.955133+0000","last_became_peered":"2024-09-11T22:14:25.955133+0000","last_unstale":"2024-09-11T22:14:28.650495+0000","last_undegraded":"2024-09-11T22:14:28.650495+0000","last_fullsized":"2024-09-11T22:14:28.650495+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.631686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237726+0000","last_change":"2024-09-11T22:14:26.959240+0000","last_active":"2024-09-11T22:14:29.237726+0000","last_peered":"2024-09-11T22:14:29.237726+0000","last_clean":"2024-09-11T22:14:29.237726+0000","last_became_active":"2024-09-11T22:14:26.958616+0000","last_became_peered":"2024-09-11T22:14:26.958616+0000","last_unstale":"2024-09-11T22:14:29.237726+0000","last_undegraded":"2024-09-11T22:14:29.237726+0000","last_fullsized":"2024-09-11T22:14:29.237726+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:24.318239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237850+0000","last_change":"2024-09-11T22:14:25.958671+0000","last_active":"2024-09-11T22:14:29.237850+0000","last_peered":"2024-09-11T22:14:29.237850+0000","last_clean":"2024-09-11T22:14:29.237850+0000","last_became_active":"2024-09-11T22:14:25.958219+0000","last_became_peered":"2024-09-11T22:14:25.958219+0000","last_unstale":"2024-09-11T22:14:29.237850+0000","last_undegraded":"2024-09-11T22:14:29.237850+0000","last_fullsized":"2024-09-11T22:14:29.237850+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:40.924340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237952+0000","last_change":"2024-09-11T22:14:26.960588+0000","last_active":"2024-09-11T22:14:29.237952+0000","last_peered":"2024-09-11T22:14:29.237952+0000","last_clean":"2024-09-11T22:14:29.237952+0000","last_became_active":"2024-09-11T22:14:26.959947+0000","last_became_peered":"2024-09-11T22:14:26.959947+0000","last_unstale":"2024-09-11T22:14:29.237952+0000","last_undegraded":"2024-09-11T22:14:29.237952+0000","last_fullsized":"2024-09-11T22:14:29.237952+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:07.334337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045119+0000","last_change":"2024-09-11T22:14:25.954833+0000","last_active":"2024-09-11T22:14:28.045119+0000","last_peered":"2024-09-11T22:14:28.045119+0000","last_clean":"2024-09-11T22:14:28.045119+0000","last_became_active":"2024-09-11T22:14:25.954546+0000","last_became_peered":"2024-09-11T22:14:25.954546+0000","last_unstale":"2024-09-11T22:14:28.045119+0000","last_undegraded":"2024-09-11T22:14:28.045119+0000","last_fullsized":"2024-09-11T22:14:28.045119+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:25.578897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":237,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.948896+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:14:26.948896+0000","last_peered":"2024-09-11T22:14:26.948896+0000","last_clean":"2024-09-11T22:14:26.948896+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:14:26.948896+0000","last_undegraded":"2024-09-11T22:14:26.948896+0000","last_fullsized":"2024-09-11T22:14:26.948896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36032,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335808,"statfs":{"total":96636764160,"available":96599867392,"internally_reserved":0,"allocated":700416,"data_stored":292137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36044,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335796,"statfs":{"total":96636764160,"available":96599855104,"internally_reserved":0,"allocated":708608,"data_stored":292789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36048,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335792,"statfs":{"total":96636764160,"available":96599851008,"internally_reserved":0,"allocated":712704,"data_stored":293749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44352,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327488,"statfs":{"total":96636764160,"available":96591347712,"internally_reserved":0,"allocated":696320,"data_stored":285893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":692224,"data_stored":285927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40788,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331052,"statfs":{"total":96636764160,"available":96594997248,"internally_reserved":0,"allocated":1310720,"data_stored":884699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36592,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335248,"statfs":{"total":96636764160,"available":96599293952,"internally_reserved":0,"allocated":1269760,"data_stored":869430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40160,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331680,"statfs":{"total":96636764160,"available":96595640320,"internally_reserved":0,"allocated":663552,"data_stored":272795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:14:30.646 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3f is not active+clean 2024-09-11T22:14:30.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:14:25.947823+0000', 'last_change': '2024-09-11T22:14:25.947823+0000', 'last_active': '2024-09-11T22:14:25.934394+0000', 'last_peered': '2024-09-11T22:14:25.934394+0000', 'last_clean': '2024-09-11T22:14:25.934394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:14:25.947823+0000', 'last_undegraded': '2024-09-11T22:14:25.947823+0000', 'last_fullsized': '2024-09-11T22:14:25.947823+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'last_clean_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:14:30.646 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-09-11T22:14:30.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:14:25.948157+0000', 'last_change': '2024-09-11T22:14:25.948157+0000', 'last_active': '2024-09-11T22:14:25.934394+0000', 'last_peered': '2024-09-11T22:14:25.934394+0000', 'last_clean': '2024-09-11T22:14:25.934394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:14:25.948157+0000', 'last_undegraded': '2024-09-11T22:14:25.948157+0000', 'last_fullsized': '2024-09-11T22:14:25.948157+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'last_clean_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:14:30.646 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2d is not active+clean 2024-09-11T22:14:30.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:14:25.949112+0000', 'last_change': '2024-09-11T22:14:25.949112+0000', 'last_active': '2024-09-11T22:14:25.934394+0000', 'last_peered': '2024-09-11T22:14:25.934394+0000', 'last_clean': '2024-09-11T22:14:25.934394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:14:25.949112+0000', 'last_undegraded': '2024-09-11T22:14:25.949112+0000', 'last_fullsized': '2024-09-11T22:14:25.949112+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'last_clean_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:14:30.646 INFO:tasks.ceph.ceph_manager.ceph:PG 9.27 is not active+clean 2024-09-11T22:14:30.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:14:25.947311+0000', 'last_change': '2024-09-11T22:14:25.947311+0000', 'last_active': '2024-09-11T22:14:25.934394+0000', 'last_peered': '2024-09-11T22:14:25.934394+0000', 'last_clean': '2024-09-11T22:14:25.934394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:14:25.947311+0000', 'last_undegraded': '2024-09-11T22:14:25.947311+0000', 'last_fullsized': '2024-09-11T22:14:25.947311+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'last_clean_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:14:30.646 INFO:tasks.ceph.ceph_manager.ceph:PG 9.24 is not active+clean 2024-09-11T22:14:30.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:14:25.946343+0000', 'last_change': '2024-09-11T22:14:25.946343+0000', 'last_active': '2024-09-11T22:14:25.934394+0000', 'last_peered': '2024-09-11T22:14:25.934394+0000', 'last_clean': '2024-09-11T22:14:25.934394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:14:25.946343+0000', 'last_undegraded': '2024-09-11T22:14:25.946343+0000', 'last_fullsized': '2024-09-11T22:14:25.946343+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'last_clean_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:14:30.647 INFO:tasks.ceph.ceph_manager.ceph:PG 9.21 is not active+clean 2024-09-11T22:14:30.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:14:25.946662+0000', 'last_change': '2024-09-11T22:14:25.946662+0000', 'last_active': '2024-09-11T22:14:25.934394+0000', 'last_peered': '2024-09-11T22:14:25.934394+0000', 'last_clean': '2024-09-11T22:14:25.934394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:14:25.946662+0000', 'last_undegraded': '2024-09-11T22:14:25.946662+0000', 'last_fullsized': '2024-09-11T22:14:25.946662+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'last_clean_scrub_stamp': '2024-09-11T22:14:25.934394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:14:30.647 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:14:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.780+0000 7fa8aeed0640 1 Processor -- start 2024-09-11T22:14:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.780+0000 7fa8aeed0640 1 -- start start 2024-09-11T22:14:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.781+0000 7fa8aeed0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa8a815e840 0x7fa8a80b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.781+0000 7fa8aeed0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8a80cdd50 0x7fa8a80cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.781+0000 7fa8aeed0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8a80ce5f0 con 0x7fa8a80cf3b0 2024-09-11T22:14:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.781+0000 7fa8aeed0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa8a806c240 con 0x7fa8a80cdd50 2024-09-11T22:14:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.781+0000 7fa8aeed0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa8a80d0470 con 0x7fa8a815e840 2024-09-11T22:14:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.781+0000 7fa8a7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8a80cdd50 0x7fa8a80cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.781+0000 7fa8a7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8a80cdd50 0x7fa8a80cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50396/0 (socket says 172.21.15.50:50396) 2024-09-11T22:14:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.781+0000 7fa8a7fff640 1 -- 172.21.15.50:0/2689822821 learned_addr learned my addr 172.21.15.50:0/2689822821 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.781+0000 7fa8acc6c640 1 --2- 172.21.15.50:0/2689822821 >> v2:172.21.15.77:3300/0 conn(0x7fa8a815e840 0x7fa8a80b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.781+0000 7fa8a7fff640 1 -- 172.21.15.50:0/2689822821 >> v2:172.21.15.77:3300/0 conn(0x7fa8a815e840 msgr2=0x7fa8a80b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.781+0000 7fa8a7fff640 1 --2- 172.21.15.50:0/2689822821 >> v2:172.21.15.77:3300/0 conn(0x7fa8a815e840 0x7fa8a80b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.781+0000 7fa8a7fff640 1 -- 172.21.15.50:0/2689822821 >> v1:172.21.15.77:6789/0 conn(0x7fa8a80cf3b0 legacy=0x7fa8a80d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:30.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.781+0000 7fa8a7fff640 1 -- 172.21.15.50:0/2689822821 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a80ce310 con 0x7fa8a80cdd50 2024-09-11T22:14:30.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.782+0000 7fa8a7fff640 1 --2- 172.21.15.50:0/2689822821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a80cdd50 0x7fa8a80cee70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80694b0 tx=0x7fa89c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbccea30a553e39 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.782+0000 7fa8a77fe640 1 -- 172.21.15.50:0/2689822821 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c037070 con 0x7fa8a80cdd50 2024-09-11T22:14:30.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.782+0000 7fa8a77fe640 1 -- 172.21.15.50:0/2689822821 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa89c032440 con 0x7fa8a80cdd50 2024-09-11T22:14:30.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.782+0000 7fa8a77fe640 1 -- 172.21.15.50:0/2689822821 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c032810 con 0x7fa8a80cdd50 2024-09-11T22:14:30.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.783+0000 7fa8aeed0640 1 -- 172.21.15.50:0/2689822821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a80cdd50 msgr2=0x7fa8a80cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.783+0000 7fa8aeed0640 1 --2- 172.21.15.50:0/2689822821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a80cdd50 0x7fa8a80cee70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80694b0 tx=0x7fa89c02a230 comp rx=0 tx=0).stop 2024-09-11T22:14:30.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.783+0000 7fa8aeed0640 1 -- 172.21.15.50:0/2689822821 shutdown_connections 2024-09-11T22:14:30.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.783+0000 7fa8aeed0640 1 --2- 172.21.15.50:0/2689822821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a80cdd50 0x7fa8a80cee70 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.783+0000 7fa8aeed0640 1 --2- 172.21.15.50:0/2689822821 >> v2:172.21.15.77:3300/0 conn(0x7fa8a815e840 0x7fa8a80b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.783+0000 7fa8aeed0640 1 -- 172.21.15.50:0/2689822821 >> 172.21.15.50:0/2689822821 conn(0x7fa8a80b4150 msgr2=0x7fa8a80b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:30.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.783+0000 7fa8aeed0640 1 -- 172.21.15.50:0/2689822821 shutdown_connections 2024-09-11T22:14:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.783+0000 7fa8aeed0640 1 -- 172.21.15.50:0/2689822821 wait complete. 2024-09-11T22:14:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.784+0000 7fa8aeed0640 1 Processor -- start 2024-09-11T22:14:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.784+0000 7fa8aeed0640 1 -- start start 2024-09-11T22:14:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.785+0000 7fa8aeed0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a80cdd50 0x7fa8a80c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.785+0000 7fa8aeed0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a80cf3b0 0x7fa8a8151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.785+0000 7fa8aeed0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a815e840 0x7fa8a80b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.785+0000 7fa8aeed0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a815ec20 con 0x7fa8a815e840 2024-09-11T22:14:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.785+0000 7fa8aeed0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a806bed0 con 0x7fa8a80cdd50 2024-09-11T22:14:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.785+0000 7fa8aeed0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a815eda0 con 0x7fa8a80cf3b0 2024-09-11T22:14:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.785+0000 7fa8ad46d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a815e840 0x7fa8a80b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.785+0000 7fa8ad46d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a815e840 0x7fa8a80b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50400/0 (socket says 172.21.15.50:50400) 2024-09-11T22:14:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.785+0000 7fa8ad46d640 1 -- 172.21.15.50:0/3764979008 learned_addr learned my addr 172.21.15.50:0/3764979008 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.785+0000 7fa8acc6c640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a80cdd50 0x7fa8a80c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.785+0000 7fa8a7fff640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a80cf3b0 0x7fa8a8151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.786+0000 7fa8ad46d640 1 -- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a80cf3b0 msgr2=0x7fa8a8151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.786+0000 7fa8ad46d640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a80cf3b0 0x7fa8a8151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.786+0000 7fa8ad46d640 1 -- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a80cdd50 msgr2=0x7fa8a80c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.786+0000 7fa8ad46d640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a80cdd50 0x7fa8a80c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.786+0000 7fa8ad46d640 1 -- 172.21.15.50:0/3764979008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a80cc6d0 con 0x7fa8a815e840 2024-09-11T22:14:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.786+0000 7fa8ad46d640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a815e840 0x7fa8a80b1ea0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c7b0 tx=0x7fa8a000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.786+0000 7fa8a57fa640 1 -- 172.21.15.50:0/3764979008 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0004b60 con 0x7fa8a815e840 2024-09-11T22:14:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.786+0000 7fa8a57fa640 1 -- 172.21.15.50:0/3764979008 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a0004d00 con 0x7fa8a815e840 2024-09-11T22:14:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.786+0000 7fa8aeed0640 1 -- 172.21.15.50:0/3764979008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a80cc9b0 con 0x7fa8a815e840 2024-09-11T22:14:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.786+0000 7fa8a57fa640 1 -- 172.21.15.50:0/3764979008 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a000aa30 con 0x7fa8a815e840 2024-09-11T22:14:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.786+0000 7fa8aeed0640 1 -- 172.21.15.50:0/3764979008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a8151a50 con 0x7fa8a815e840 2024-09-11T22:14:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.787+0000 7fa8aeed0640 1 -- 172.21.15.50:0/3764979008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a80ccb80 con 0x7fa8a815e840 2024-09-11T22:14:30.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.788+0000 7fa8a57fa640 1 -- 172.21.15.50:0/3764979008 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8a000abd0 con 0x7fa8a815e840 2024-09-11T22:14:30.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.788+0000 7fa8a57fa640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa89406be30 0x7fa89406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:30.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.788+0000 7fa8a57fa640 1 -- 172.21.15.50:0/3764979008 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fa8a008af10 con 0x7fa8a815e840 2024-09-11T22:14:30.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.788+0000 7fa8acc6c640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa89406be30 0x7fa89406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:30.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.789+0000 7fa8acc6c640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa89406be30 0x7fa89406e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa8980079a0 tx=0x7fa898008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:30.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:30.793+0000 7fa8a57fa640 1 -- 172.21.15.50:0/3764979008 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8a0020070 con 0x7fa8a815e840 2024-09-11T22:14:31.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.036+0000 7fa8aeed0640 1 -- 172.21.15.50:0/3764979008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa8a80b0160 con 0x7fa8a815e840 2024-09-11T22:14:31.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.037+0000 7fa8a57fa640 1 -- 172.21.15.50:0/3764979008 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1691 (secure 0 0 0) 0x7fa8a0059270 con 0x7fa8a815e840 2024-09-11T22:14:31.038 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:31.038 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":219,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":59,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":91},{"state_name":"creating+peering","count":6}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":304865280,"bytes_avail":772789248000,"bytes_total":773094113280,"inactive_pgs_ratio":0.061855670064687729,"write_bytes_sec":3203,"read_op_per_sec":0,"write_op_per_sec":10},"fsmap":{"epoch":32,"btime":"2024-09-11T22:14:28:953512+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":6156}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-09-11T22:14:11.405403+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:14:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.039+0000 7fa8aeed0640 1 -- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa89406be30 msgr2=0x7fa89406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.039+0000 7fa8aeed0640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa89406be30 0x7fa89406e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa8980079a0 tx=0x7fa898008040 comp rx=0 tx=0).stop 2024-09-11T22:14:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.039+0000 7fa8aeed0640 1 -- 172.21.15.50:0/3764979008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a815e840 msgr2=0x7fa8a80b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.039+0000 7fa8aeed0640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a815e840 0x7fa8a80b1ea0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c7b0 tx=0x7fa8a000cc70 comp rx=0 tx=0).stop 2024-09-11T22:14:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.039+0000 7fa8aeed0640 1 -- 172.21.15.50:0/3764979008 shutdown_connections 2024-09-11T22:14:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.039+0000 7fa8aeed0640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa89406be30 0x7fa89406e2f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.039+0000 7fa8aeed0640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a80cf3b0 0x7fa8a8151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.039+0000 7fa8aeed0640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a815e840 0x7fa8a80b1ea0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.039+0000 7fa8aeed0640 1 --2- 172.21.15.50:0/3764979008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a80cdd50 0x7fa8a80c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.039+0000 7fa8aeed0640 1 -- 172.21.15.50:0/3764979008 >> 172.21.15.50:0/3764979008 conn(0x7fa8a80b4150 msgr2=0x7fa8a806fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.039+0000 7fa8aeed0640 1 -- 172.21.15.50:0/3764979008 shutdown_connections 2024-09-11T22:14:31.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.039+0000 7fa8aeed0640 1 -- 172.21.15.50:0/3764979008 wait complete. 2024-09-11T22:14:31.050 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:14:31.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:14:31.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.152+0000 7f5231647640 1 Processor -- start 2024-09-11T22:14:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.152+0000 7f5231647640 1 -- start start 2024-09-11T22:14:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.153+0000 7f5231647640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f522c161d30 0x7f522c0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.153+0000 7f5231647640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0b78f0 0x7f522c162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.153+0000 7f5231647640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f522c1632e0 con 0x7f522c0d11d0 2024-09-11T22:14:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.153+0000 7f5231647640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f522c0d3450 con 0x7f522c161d30 2024-09-11T22:14:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.153+0000 7f5231647640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f522c162110 con 0x7f522c0b78f0 2024-09-11T22:14:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.153+0000 7f52227fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0b78f0 0x7f522c162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.153+0000 7f522affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f522c161d30 0x7f522c0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.153+0000 7f522b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f522c0d11d0 0x7f522c0d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:41028/0 (socket says 172.21.15.50:41028) 2024-09-11T22:14:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.153+0000 7f52227fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0b78f0 0x7f522c162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:51232/0 (socket says 172.21.15.50:51232) 2024-09-11T22:14:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.153+0000 7f522affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f522c161d30 0x7f522c0cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:45312/0 (socket says 172.21.15.50:45312) 2024-09-11T22:14:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.153+0000 7f522b7fe640 1 -- 172.21.15.50:0/2789619360 learned_addr learned my addr 172.21.15.50:0/2789619360 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.154+0000 7f522affd640 1 -- 172.21.15.50:0/2789619360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0b78f0 msgr2=0x7f522c162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.154+0000 7f522affd640 1 --2- 172.21.15.50:0/2789619360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0b78f0 0x7f522c162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.154+0000 7f522affd640 1 -- 172.21.15.50:0/2789619360 >> v1:172.21.15.77:6789/0 conn(0x7f522c0d11d0 legacy=0x7f522c0d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.154+0000 7f522affd640 1 -- 172.21.15.50:0/2789619360 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c0cfd70 con 0x7f522c161d30 2024-09-11T22:14:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.154+0000 7f52227fc640 1 --2- 172.21.15.50:0/2789619360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0b78f0 0x7f522c162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.154+0000 7f522affd640 1 --2- 172.21.15.50:0/2789619360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c161d30 0x7f522c0cf790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f521c0097a0 tx=0x7f521c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=713eed3e6f994bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.155+0000 7f522a7fc640 1 -- 172.21.15.50:0/2789619360 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c037070 con 0x7f522c161d30 2024-09-11T22:14:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.155+0000 7f522a7fc640 1 -- 172.21.15.50:0/2789619360 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521c032440 con 0x7f522c161d30 2024-09-11T22:14:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.155+0000 7f522a7fc640 1 -- 172.21.15.50:0/2789619360 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c032810 con 0x7f522c161d30 2024-09-11T22:14:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.155+0000 7f5231647640 1 -- 172.21.15.50:0/2789619360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c161d30 msgr2=0x7f522c0cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.155+0000 7f5231647640 1 --2- 172.21.15.50:0/2789619360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c161d30 0x7f522c0cf790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f521c0097a0 tx=0x7f521c02a180 comp rx=0 tx=0).stop 2024-09-11T22:14:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.155+0000 7f5231647640 1 -- 172.21.15.50:0/2789619360 shutdown_connections 2024-09-11T22:14:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.155+0000 7f5231647640 1 --2- 172.21.15.50:0/2789619360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0b78f0 0x7f522c162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.155+0000 7f5231647640 1 --2- 172.21.15.50:0/2789619360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c161d30 0x7f522c0cf790 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.155+0000 7f5231647640 1 -- 172.21.15.50:0/2789619360 >> 172.21.15.50:0/2789619360 conn(0x7f522c0727a0 msgr2=0x7f522c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.155+0000 7f5231647640 1 -- 172.21.15.50:0/2789619360 shutdown_connections 2024-09-11T22:14:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.155+0000 7f5231647640 1 -- 172.21.15.50:0/2789619360 wait complete. 2024-09-11T22:14:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.156+0000 7f5231647640 1 Processor -- start 2024-09-11T22:14:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.157+0000 7f5231647640 1 -- start start 2024-09-11T22:14:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.157+0000 7f5231647640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0b78f0 0x7f522c159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.157+0000 7f5231647640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c0d11d0 0x7f522c0b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.157+0000 7f5231647640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c161d30 0x7f522c0b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.157+0000 7f5231647640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f522c0d30e0 con 0x7f522c0d11d0 2024-09-11T22:14:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.157+0000 7f5231647640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f522c0d2e00 con 0x7f522c161d30 2024-09-11T22:14:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.157+0000 7f5231647640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f522c0b7d30 con 0x7f522c0b78f0 2024-09-11T22:14:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.157+0000 7f52227fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c0d11d0 0x7f522c0b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.157+0000 7f52227fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c0d11d0 0x7f522c0b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50402/0 (socket says 172.21.15.50:50402) 2024-09-11T22:14:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.157+0000 7f52227fc640 1 -- 172.21.15.50:0/559208710 learned_addr learned my addr 172.21.15.50:0/559208710 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f522b7fe640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c161d30 0x7f522c0b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f522affd640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0b78f0 0x7f522c159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f52227fc640 1 -- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0b78f0 msgr2=0x7f522c159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f52227fc640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0b78f0 0x7f522c159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f52227fc640 1 -- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c161d30 msgr2=0x7f522c0b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f52227fc640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c161d30 0x7f522c0b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f52227fc640 1 -- 172.21.15.50:0/559208710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c15a0c0 con 0x7f522c0d11d0 2024-09-11T22:14:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f522affd640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0b78f0 0x7f522c159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f522b7fe640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c161d30 0x7f522c0b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f52227fc640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c0d11d0 0x7f522c0b40b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f521400ebb0 tx=0x7f521400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f5223fff640 1 -- 172.21.15.50:0/559208710 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214017070 con 0x7f522c0d11d0 2024-09-11T22:14:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f5223fff640 1 -- 172.21.15.50:0/559208710 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521400cc30 con 0x7f522c0d11d0 2024-09-11T22:14:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f5223fff640 1 -- 172.21.15.50:0/559208710 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214013470 con 0x7f522c0d11d0 2024-09-11T22:14:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f5231647640 1 -- 172.21.15.50:0/559208710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522c0b49b0 con 0x7f522c0d11d0 2024-09-11T22:14:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.158+0000 7f5231647640 1 -- 172.21.15.50:0/559208710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f522c0b4f70 con 0x7f522c0d11d0 2024-09-11T22:14:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.159+0000 7f5231647640 1 -- 172.21.15.50:0/559208710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f522c162da0 con 0x7f522c0d11d0 2024-09-11T22:14:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.160+0000 7f5223fff640 1 -- 172.21.15.50:0/559208710 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f521401a070 con 0x7f522c0d11d0 2024-09-11T22:14:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.160+0000 7f5223fff640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f520c06be60 0x7f520c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.160+0000 7f5223fff640 1 -- 172.21.15.50:0/559208710 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f521408add0 con 0x7f522c0d11d0 2024-09-11T22:14:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.161+0000 7f522affd640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f520c06be60 0x7f520c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.161+0000 7f522affd640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f520c06be60 0x7f520c06e320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f521c034000 tx=0x7f521c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.165+0000 7f5223fff640 1 -- 172.21.15.50:0/559208710 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5214059780 con 0x7f522c0d11d0 2024-09-11T22:14:31.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.339+0000 7f5231647640 1 -- 172.21.15.50:0/559208710 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f522c0b89a0 con 0x7f520c06be60 2024-09-11T22:14:31.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.345+0000 7f5223fff640 1 -- 172.21.15.50:0/559208710 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251451 (secure 0 0 0) 0x7f522c0b89a0 con 0x7f520c06be60 2024-09-11T22:14:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:31.349 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:14:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.349+0000 7f5231647640 1 -- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f520c06be60 msgr2=0x7f520c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.349+0000 7f5231647640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f520c06be60 0x7f520c06e320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f521c034000 tx=0x7f521c02e000 comp rx=0 tx=0).stop 2024-09-11T22:14:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.349+0000 7f5231647640 1 -- 172.21.15.50:0/559208710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c0d11d0 msgr2=0x7f522c0b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.349+0000 7f5231647640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c0d11d0 0x7f522c0b40b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f521400ebb0 tx=0x7f521400c520 comp rx=0 tx=0).stop 2024-09-11T22:14:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.349+0000 7f5231647640 1 -- 172.21.15.50:0/559208710 shutdown_connections 2024-09-11T22:14:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.349+0000 7f5231647640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f520c06be60 0x7f520c06e320 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.349+0000 7f5231647640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c161d30 0x7f522c0b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.349+0000 7f5231647640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c0d11d0 0x7f522c0b40b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.349+0000 7f5231647640 1 --2- 172.21.15.50:0/559208710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0b78f0 0x7f522c159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.349+0000 7f5231647640 1 -- 172.21.15.50:0/559208710 >> 172.21.15.50:0/559208710 conn(0x7f522c0727a0 msgr2=0x7f522c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:31.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.349+0000 7f5231647640 1 -- 172.21.15.50:0/559208710 shutdown_connections 2024-09-11T22:14:31.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:31.349+0000 7f5231647640 1 -- 172.21.15.50:0/559208710 wait complete. 2024-09-11T22:14:31.360 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-11T22:14:29.410311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297720,"kb_used_data":6596,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754677000,"statfs":{"total":773094113280,"available":772789248000,"internally_reserved":0,"allocated":6754304,"data_stored":3477419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.475620"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.947823+0000","last_change":"2024-09-11T22:14:25.947823+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.947823+0000","last_undegraded":"2024-09-11T22:14:25.947823+0000","last_fullsized":"2024-09-11T22:14:25.947823+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238075+0000","last_change":"2024-09-11T22:14:26.959238+0000","last_active":"2024-09-11T22:14:29.238075+0000","last_peered":"2024-09-11T22:14:29.238075+0000","last_clean":"2024-09-11T22:14:29.238075+0000","last_became_active":"2024-09-11T22:14:26.958936+0000","last_became_peered":"2024-09-11T22:14:26.958936+0000","last_unstale":"2024-09-11T22:14:29.238075+0000","last_undegraded":"2024-09-11T22:14:29.238075+0000","last_fullsized":"2024-09-11T22:14:29.238075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:11.635531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.962988+0000","last_change":"2024-09-11T22:14:26.960744+0000","last_active":"2024-09-11T22:14:26.962988+0000","last_peered":"2024-09-11T22:14:26.962988+0000","last_clean":"2024-09-11T22:14:26.962988+0000","last_became_active":"2024-09-11T22:14:26.960440+0000","last_became_peered":"2024-09-11T22:14:26.960440+0000","last_unstale":"2024-09-11T22:14:26.962988+0000","last_undegraded":"2024-09-11T22:14:26.962988+0000","last_fullsized":"2024-09-11T22:14:26.962988+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:20.952546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956811+0000","last_change":"2024-09-11T22:14:26.959797+0000","last_active":"2024-09-11T22:14:27.956811+0000","last_peered":"2024-09-11T22:14:27.956811+0000","last_clean":"2024-09-11T22:14:27.956811+0000","last_became_active":"2024-09-11T22:14:26.959522+0000","last_became_peered":"2024-09-11T22:14:26.959522+0000","last_unstale":"2024-09-11T22:14:27.956811+0000","last_undegraded":"2024-09-11T22:14:27.956811+0000","last_fullsized":"2024-09-11T22:14:27.956811+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:41.931942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.948157+0000","last_change":"2024-09-11T22:14:25.948157+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.948157+0000","last_undegraded":"2024-09-11T22:14:25.948157+0000","last_fullsized":"2024-09-11T22:14:25.948157+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955059+0000","last_change":"2024-09-11T22:14:26.956023+0000","last_active":"2024-09-11T22:14:27.955059+0000","last_peered":"2024-09-11T22:14:27.955059+0000","last_clean":"2024-09-11T22:14:27.955059+0000","last_became_active":"2024-09-11T22:14:26.955721+0000","last_became_peered":"2024-09-11T22:14:26.955721+0000","last_unstale":"2024-09-11T22:14:27.955059+0000","last_undegraded":"2024-09-11T22:14:27.955059+0000","last_fullsized":"2024-09-11T22:14:27.955059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:54.886252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956720+0000","last_change":"2024-09-11T22:14:26.964660+0000","last_active":"2024-09-11T22:14:27.956720+0000","last_peered":"2024-09-11T22:14:27.956720+0000","last_clean":"2024-09-11T22:14:27.956720+0000","last_became_active":"2024-09-11T22:14:26.964404+0000","last_became_peered":"2024-09-11T22:14:26.964404+0000","last_unstale":"2024-09-11T22:14:27.956720+0000","last_undegraded":"2024-09-11T22:14:27.956720+0000","last_fullsized":"2024-09-11T22:14:27.956720+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:17.063912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237609+0000","last_change":"2024-09-11T22:14:26.960383+0000","last_active":"2024-09-11T22:14:29.237609+0000","last_peered":"2024-09-11T22:14:29.237609+0000","last_clean":"2024-09-11T22:14:29.237609+0000","last_became_active":"2024-09-11T22:14:26.959605+0000","last_became_peered":"2024-09-11T22:14:26.959605+0000","last_unstale":"2024-09-11T22:14:29.237609+0000","last_undegraded":"2024-09-11T22:14:29.237609+0000","last_fullsized":"2024-09-11T22:14:29.237609+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:52.664222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956335+0000","last_change":"2024-09-11T22:14:26.964503+0000","last_active":"2024-09-11T22:14:27.956335+0000","last_peered":"2024-09-11T22:14:27.956335+0000","last_clean":"2024-09-11T22:14:27.956335+0000","last_became_active":"2024-09-11T22:14:26.964196+0000","last_became_peered":"2024-09-11T22:14:26.964196+0000","last_unstale":"2024-09-11T22:14:27.956335+0000","last_undegraded":"2024-09-11T22:14:27.956335+0000","last_fullsized":"2024-09-11T22:14:27.956335+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:13.144193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650694+0000","last_change":"2024-09-11T22:14:26.959365+0000","last_active":"2024-09-11T22:14:28.650694+0000","last_peered":"2024-09-11T22:14:28.650694+0000","last_clean":"2024-09-11T22:14:28.650694+0000","last_became_active":"2024-09-11T22:14:26.958793+0000","last_became_peered":"2024-09-11T22:14:26.958793+0000","last_unstale":"2024-09-11T22:14:28.650694+0000","last_undegraded":"2024-09-11T22:14:28.650694+0000","last_fullsized":"2024-09-11T22:14:28.650694+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:53.962348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650807+0000","last_change":"2024-09-11T22:14:26.970469+0000","last_active":"2024-09-11T22:14:28.650807+0000","last_peered":"2024-09-11T22:14:28.650807+0000","last_clean":"2024-09-11T22:14:28.650807+0000","last_became_active":"2024-09-11T22:14:26.970170+0000","last_became_peered":"2024-09-11T22:14:26.970170+0000","last_unstale":"2024-09-11T22:14:28.650807+0000","last_undegraded":"2024-09-11T22:14:28.650807+0000","last_fullsized":"2024-09-11T22:14:28.650807+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:37.142401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956978+0000","last_change":"2024-09-11T22:14:26.961258+0000","last_active":"2024-09-11T22:14:27.956978+0000","last_peered":"2024-09-11T22:14:27.956978+0000","last_clean":"2024-09-11T22:14:27.956978+0000","last_became_active":"2024-09-11T22:14:26.960960+0000","last_became_peered":"2024-09-11T22:14:26.960960+0000","last_unstale":"2024-09-11T22:14:27.956978+0000","last_undegraded":"2024-09-11T22:14:27.956978+0000","last_fullsized":"2024-09-11T22:14:27.956978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:43.123466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045219+0000","last_change":"2024-09-11T22:14:26.955986+0000","last_active":"2024-09-11T22:14:28.045219+0000","last_peered":"2024-09-11T22:14:28.045219+0000","last_clean":"2024-09-11T22:14:28.045219+0000","last_became_active":"2024-09-11T22:14:26.955724+0000","last_became_peered":"2024-09-11T22:14:26.955724+0000","last_unstale":"2024-09-11T22:14:28.045219+0000","last_undegraded":"2024-09-11T22:14:28.045219+0000","last_fullsized":"2024-09-11T22:14:28.045219+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:24.565886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956239+0000","last_change":"2024-09-11T22:14:26.959090+0000","last_active":"2024-09-11T22:14:27.956239+0000","last_peered":"2024-09-11T22:14:27.956239+0000","last_clean":"2024-09-11T22:14:27.956239+0000","last_became_active":"2024-09-11T22:14:26.958825+0000","last_became_peered":"2024-09-11T22:14:26.958825+0000","last_unstale":"2024-09-11T22:14:27.956239+0000","last_undegraded":"2024-09-11T22:14:27.956239+0000","last_fullsized":"2024-09-11T22:14:27.956239+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:45.664163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956876+0000","last_change":"2024-09-11T22:14:26.957998+0000","last_active":"2024-09-11T22:14:27.956876+0000","last_peered":"2024-09-11T22:14:27.956876+0000","last_clean":"2024-09-11T22:14:27.956876+0000","last_became_active":"2024-09-11T22:14:26.957683+0000","last_became_peered":"2024-09-11T22:14:26.957683+0000","last_unstale":"2024-09-11T22:14:27.956876+0000","last_undegraded":"2024-09-11T22:14:27.956876+0000","last_fullsized":"2024-09-11T22:14:27.956876+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.544029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955000+0000","last_change":"2024-09-11T22:14:26.963903+0000","last_active":"2024-09-11T22:14:27.955000+0000","last_peered":"2024-09-11T22:14:27.955000+0000","last_clean":"2024-09-11T22:14:27.955000+0000","last_became_active":"2024-09-11T22:14:26.963640+0000","last_became_peered":"2024-09-11T22:14:26.963640+0000","last_unstale":"2024-09-11T22:14:27.955000+0000","last_undegraded":"2024-09-11T22:14:27.955000+0000","last_fullsized":"2024-09-11T22:14:27.955000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:14.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238138+0000","last_change":"2024-09-11T22:14:26.957389+0000","last_active":"2024-09-11T22:14:29.238138+0000","last_peered":"2024-09-11T22:14:29.238138+0000","last_clean":"2024-09-11T22:14:29.238138+0000","last_became_active":"2024-09-11T22:14:26.957118+0000","last_became_peered":"2024-09-11T22:14:26.957118+0000","last_unstale":"2024-09-11T22:14:29.238138+0000","last_undegraded":"2024-09-11T22:14:29.238138+0000","last_fullsized":"2024-09-11T22:14:29.238138+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:10.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.964922+0000","last_change":"2024-09-11T22:14:26.961999+0000","last_active":"2024-09-11T22:14:26.964922+0000","last_peered":"2024-09-11T22:14:26.964922+0000","last_clean":"2024-09-11T22:14:26.964922+0000","last_became_active":"2024-09-11T22:14:26.961653+0000","last_became_peered":"2024-09-11T22:14:26.961653+0000","last_unstale":"2024-09-11T22:14:26.964922+0000","last_undegraded":"2024-09-11T22:14:26.964922+0000","last_fullsized":"2024-09-11T22:14:26.964922+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:40.552647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.949112+0000","last_change":"2024-09-11T22:14:25.949112+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.949112+0000","last_undegraded":"2024-09-11T22:14:25.949112+0000","last_fullsized":"2024-09-11T22:14:25.949112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237827+0000","last_change":"2024-09-11T22:14:26.957825+0000","last_active":"2024-09-11T22:14:29.237827+0000","last_peered":"2024-09-11T22:14:29.237827+0000","last_clean":"2024-09-11T22:14:29.237827+0000","last_became_active":"2024-09-11T22:14:26.957559+0000","last_became_peered":"2024-09-11T22:14:26.957559+0000","last_unstale":"2024-09-11T22:14:29.237827+0000","last_undegraded":"2024-09-11T22:14:29.237827+0000","last_fullsized":"2024-09-11T22:14:29.237827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:23.772181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.964963+0000","last_change":"2024-09-11T22:14:26.962434+0000","last_active":"2024-09-11T22:14:26.964963+0000","last_peered":"2024-09-11T22:14:26.964963+0000","last_clean":"2024-09-11T22:14:26.964963+0000","last_became_active":"2024-09-11T22:14:26.962132+0000","last_became_peered":"2024-09-11T22:14:26.962132+0000","last_unstale":"2024-09-11T22:14:26.964963+0000","last_undegraded":"2024-09-11T22:14:26.964963+0000","last_fullsized":"2024-09-11T22:14:26.964963+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:14.957468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237709+0000","last_change":"2024-09-11T22:14:26.970102+0000","last_active":"2024-09-11T22:14:29.237709+0000","last_peered":"2024-09-11T22:14:29.237709+0000","last_clean":"2024-09-11T22:14:29.237709+0000","last_became_active":"2024-09-11T22:14:26.968725+0000","last_became_peered":"2024-09-11T22:14:26.968725+0000","last_unstale":"2024-09-11T22:14:29.237709+0000","last_undegraded":"2024-09-11T22:14:29.237709+0000","last_fullsized":"2024-09-11T22:14:29.237709+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:54.820323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973486+0000","last_change":"2024-09-11T22:14:26.972685+0000","last_active":"2024-09-11T22:14:26.973486+0000","last_peered":"2024-09-11T22:14:26.973486+0000","last_clean":"2024-09-11T22:14:26.973486+0000","last_became_active":"2024-09-11T22:14:26.972444+0000","last_became_peered":"2024-09-11T22:14:26.972444+0000","last_unstale":"2024-09-11T22:14:26.973486+0000","last_undegraded":"2024-09-11T22:14:26.973486+0000","last_fullsized":"2024-09-11T22:14:26.973486+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:17.455050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045202+0000","last_change":"2024-09-11T22:14:26.953324+0000","last_active":"2024-09-11T22:14:28.045202+0000","last_peered":"2024-09-11T22:14:28.045202+0000","last_clean":"2024-09-11T22:14:28.045202+0000","last_became_active":"2024-09-11T22:14:26.951702+0000","last_became_peered":"2024-09-11T22:14:26.951702+0000","last_unstale":"2024-09-11T22:14:28.045202+0000","last_undegraded":"2024-09-11T22:14:28.045202+0000","last_fullsized":"2024-09-11T22:14:28.045202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:45.699757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.947311+0000","last_change":"2024-09-11T22:14:25.947311+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.947311+0000","last_undegraded":"2024-09-11T22:14:25.947311+0000","last_fullsized":"2024-09-11T22:14:25.947311+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957209+0000","last_change":"2024-09-11T22:14:26.966619+0000","last_active":"2024-09-11T22:14:27.957209+0000","last_peered":"2024-09-11T22:14:27.957209+0000","last_clean":"2024-09-11T22:14:27.957209+0000","last_became_active":"2024-09-11T22:14:26.966166+0000","last_became_peered":"2024-09-11T22:14:26.966166+0000","last_unstale":"2024-09-11T22:14:27.957209+0000","last_undegraded":"2024-09-11T22:14:27.957209+0000","last_fullsized":"2024-09-11T22:14:27.957209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:48.700476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955344+0000","last_change":"2024-09-11T22:14:26.959657+0000","last_active":"2024-09-11T22:14:27.955344+0000","last_peered":"2024-09-11T22:14:27.955344+0000","last_clean":"2024-09-11T22:14:27.955344+0000","last_became_active":"2024-09-11T22:14:26.957995+0000","last_became_peered":"2024-09-11T22:14:26.957995+0000","last_unstale":"2024-09-11T22:14:27.955344+0000","last_undegraded":"2024-09-11T22:14:27.955344+0000","last_fullsized":"2024-09-11T22:14:27.955344+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:45.625414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.946343+0000","last_change":"2024-09-11T22:14:25.946343+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.946343+0000","last_undegraded":"2024-09-11T22:14:25.946343+0000","last_fullsized":"2024-09-11T22:14:25.946343+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238020+0000","last_change":"2024-09-11T22:14:26.965288+0000","last_active":"2024-09-11T22:14:29.238020+0000","last_peered":"2024-09-11T22:14:29.238020+0000","last_clean":"2024-09-11T22:14:29.238020+0000","last_became_active":"2024-09-11T22:14:26.963346+0000","last_became_peered":"2024-09-11T22:14:26.963346+0000","last_unstale":"2024-09-11T22:14:29.238020+0000","last_undegraded":"2024-09-11T22:14:29.238020+0000","last_fullsized":"2024-09-11T22:14:29.238020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:36.369029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.961779+0000","last_change":"2024-09-11T22:14:26.959933+0000","last_active":"2024-09-11T22:14:26.961779+0000","last_peered":"2024-09-11T22:14:26.961779+0000","last_clean":"2024-09-11T22:14:26.961779+0000","last_became_active":"2024-09-11T22:14:26.959673+0000","last_became_peered":"2024-09-11T22:14:26.959673+0000","last_unstale":"2024-09-11T22:14:26.961779+0000","last_undegraded":"2024-09-11T22:14:26.961779+0000","last_fullsized":"2024-09-11T22:14:26.961779+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:16.039732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T22:14:25.946662+0000","last_change":"2024-09-11T22:14:25.946662+0000","last_active":"2024-09-11T22:14:25.934394+0000","last_peered":"2024-09-11T22:14:25.934394+0000","last_clean":"2024-09-11T22:14:25.934394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:14:25.946662+0000","last_undegraded":"2024-09-11T22:14:25.946662+0000","last_fullsized":"2024-09-11T22:14:25.946662+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955340+0000","last_change":"2024-09-11T22:14:26.957135+0000","last_active":"2024-09-11T22:14:27.955340+0000","last_peered":"2024-09-11T22:14:27.955340+0000","last_clean":"2024-09-11T22:14:27.955340+0000","last_became_active":"2024-09-11T22:14:26.956870+0000","last_became_peered":"2024-09-11T22:14:26.956870+0000","last_unstale":"2024-09-11T22:14:27.955340+0000","last_undegraded":"2024-09-11T22:14:27.955340+0000","last_fullsized":"2024-09-11T22:14:27.955340+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:17.912234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955540+0000","last_change":"2024-09-11T22:14:26.962072+0000","last_active":"2024-09-11T22:14:27.955540+0000","last_peered":"2024-09-11T22:14:27.955540+0000","last_clean":"2024-09-11T22:14:27.955540+0000","last_became_active":"2024-09-11T22:14:26.961817+0000","last_became_peered":"2024-09-11T22:14:26.961817+0000","last_unstale":"2024-09-11T22:14:27.955540+0000","last_undegraded":"2024-09-11T22:14:27.955540+0000","last_fullsized":"2024-09-11T22:14:27.955540+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:14.514452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955612+0000","last_change":"2024-09-11T22:14:25.952024+0000","last_active":"2024-09-11T22:14:27.955612+0000","last_peered":"2024-09-11T22:14:27.955612+0000","last_clean":"2024-09-11T22:14:27.955612+0000","last_became_active":"2024-09-11T22:14:25.951739+0000","last_became_peered":"2024-09-11T22:14:25.951739+0000","last_unstale":"2024-09-11T22:14:27.955612+0000","last_undegraded":"2024-09-11T22:14:27.955612+0000","last_fullsized":"2024-09-11T22:14:27.955612+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:36.134800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650758+0000","last_change":"2024-09-11T22:14:26.964714+0000","last_active":"2024-09-11T22:14:28.650758+0000","last_peered":"2024-09-11T22:14:28.650758+0000","last_clean":"2024-09-11T22:14:28.650758+0000","last_became_active":"2024-09-11T22:14:26.964485+0000","last_became_peered":"2024-09-11T22:14:26.964485+0000","last_unstale":"2024-09-11T22:14:28.650758+0000","last_undegraded":"2024-09-11T22:14:28.650758+0000","last_fullsized":"2024-09-11T22:14:28.650758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:41.146664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238072+0000","last_change":"2024-09-11T22:14:25.956149+0000","last_active":"2024-09-11T22:14:29.238072+0000","last_peered":"2024-09-11T22:14:29.238072+0000","last_clean":"2024-09-11T22:14:29.238072+0000","last_became_active":"2024-09-11T22:14:25.955403+0000","last_became_peered":"2024-09-11T22:14:25.955403+0000","last_unstale":"2024-09-11T22:14:29.238072+0000","last_undegraded":"2024-09-11T22:14:29.238072+0000","last_fullsized":"2024-09-11T22:14:29.238072+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:15.536125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955173+0000","last_change":"2024-09-11T22:14:26.964943+0000","last_active":"2024-09-11T22:14:27.955173+0000","last_peered":"2024-09-11T22:14:27.955173+0000","last_clean":"2024-09-11T22:14:27.955173+0000","last_became_active":"2024-09-11T22:14:26.964416+0000","last_became_peered":"2024-09-11T22:14:26.964416+0000","last_unstale":"2024-09-11T22:14:27.955173+0000","last_undegraded":"2024-09-11T22:14:27.955173+0000","last_fullsized":"2024-09-11T22:14:27.955173+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:36.926975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955571+0000","last_change":"2024-09-11T22:14:25.960586+0000","last_active":"2024-09-11T22:14:27.955571+0000","last_peered":"2024-09-11T22:14:27.955571+0000","last_clean":"2024-09-11T22:14:27.955571+0000","last_became_active":"2024-09-11T22:14:25.960280+0000","last_became_peered":"2024-09-11T22:14:25.960280+0000","last_unstale":"2024-09-11T22:14:27.955571+0000","last_undegraded":"2024-09-11T22:14:27.955571+0000","last_fullsized":"2024-09-11T22:14:27.955571+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:40.139062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955425+0000","last_change":"2024-09-11T22:14:26.961155+0000","last_active":"2024-09-11T22:14:27.955425+0000","last_peered":"2024-09-11T22:14:27.955425+0000","last_clean":"2024-09-11T22:14:27.955425+0000","last_became_active":"2024-09-11T22:14:26.960654+0000","last_became_peered":"2024-09-11T22:14:26.960654+0000","last_unstale":"2024-09-11T22:14:27.955425+0000","last_undegraded":"2024-09-11T22:14:27.955425+0000","last_fullsized":"2024-09-11T22:14:27.955425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957272+0000","last_change":"2024-09-11T22:14:25.954648+0000","last_active":"2024-09-11T22:14:27.957272+0000","last_peered":"2024-09-11T22:14:27.957272+0000","last_clean":"2024-09-11T22:14:27.957272+0000","last_became_active":"2024-09-11T22:14:25.954334+0000","last_became_peered":"2024-09-11T22:14:25.954334+0000","last_unstale":"2024-09-11T22:14:27.957272+0000","last_undegraded":"2024-09-11T22:14:27.957272+0000","last_fullsized":"2024-09-11T22:14:27.957272+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:12.136592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238149+0000","last_change":"2024-09-11T22:14:26.969858+0000","last_active":"2024-09-11T22:14:29.238149+0000","last_peered":"2024-09-11T22:14:29.238149+0000","last_clean":"2024-09-11T22:14:29.238149+0000","last_became_active":"2024-09-11T22:14:26.968413+0000","last_became_peered":"2024-09-11T22:14:26.968413+0000","last_unstale":"2024-09-11T22:14:29.238149+0000","last_undegraded":"2024-09-11T22:14:29.238149+0000","last_fullsized":"2024-09-11T22:14:29.238149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:26.978341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955958+0000","last_change":"2024-09-11T22:14:25.950287+0000","last_active":"2024-09-11T22:14:27.955958+0000","last_peered":"2024-09-11T22:14:27.955958+0000","last_clean":"2024-09-11T22:14:27.955958+0000","last_became_active":"2024-09-11T22:14:25.950020+0000","last_became_peered":"2024-09-11T22:14:25.950020+0000","last_unstale":"2024-09-11T22:14:27.955958+0000","last_undegraded":"2024-09-11T22:14:27.955958+0000","last_fullsized":"2024-09-11T22:14:27.955958+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:31.695327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238193+0000","last_change":"2024-09-11T22:14:26.957412+0000","last_active":"2024-09-11T22:14:29.238193+0000","last_peered":"2024-09-11T22:14:29.238193+0000","last_clean":"2024-09-11T22:14:29.238193+0000","last_became_active":"2024-09-11T22:14:26.957003+0000","last_became_peered":"2024-09-11T22:14:26.957003+0000","last_unstale":"2024-09-11T22:14:29.238193+0000","last_undegraded":"2024-09-11T22:14:29.238193+0000","last_fullsized":"2024-09-11T22:14:29.238193+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:00.215569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955193+0000","last_change":"2024-09-11T22:14:25.956470+0000","last_active":"2024-09-11T22:14:27.955193+0000","last_peered":"2024-09-11T22:14:27.955193+0000","last_clean":"2024-09-11T22:14:27.955193+0000","last_became_active":"2024-09-11T22:14:25.956032+0000","last_became_peered":"2024-09-11T22:14:25.956032+0000","last_unstale":"2024-09-11T22:14:27.955193+0000","last_undegraded":"2024-09-11T22:14:27.955193+0000","last_fullsized":"2024-09-11T22:14:27.955193+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:17.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045221+0000","last_change":"2024-09-11T22:14:26.957303+0000","last_active":"2024-09-11T22:14:28.045221+0000","last_peered":"2024-09-11T22:14:28.045221+0000","last_clean":"2024-09-11T22:14:28.045221+0000","last_became_active":"2024-09-11T22:14:26.957049+0000","last_became_peered":"2024-09-11T22:14:26.957049+0000","last_unstale":"2024-09-11T22:14:28.045221+0000","last_undegraded":"2024-09-11T22:14:28.045221+0000","last_fullsized":"2024-09-11T22:14:28.045221+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:54.823432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957147+0000","last_change":"2024-09-11T22:14:25.950524+0000","last_active":"2024-09-11T22:14:27.957147+0000","last_peered":"2024-09-11T22:14:27.957147+0000","last_clean":"2024-09-11T22:14:27.957147+0000","last_became_active":"2024-09-11T22:14:25.950266+0000","last_became_peered":"2024-09-11T22:14:25.950266+0000","last_unstale":"2024-09-11T22:14:27.957147+0000","last_undegraded":"2024-09-11T22:14:27.957147+0000","last_fullsized":"2024-09-11T22:14:27.957147+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:46.536428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237812+0000","last_change":"2024-09-11T22:14:26.959688+0000","last_active":"2024-09-11T22:14:29.237812+0000","last_peered":"2024-09-11T22:14:29.237812+0000","last_clean":"2024-09-11T22:14:29.237812+0000","last_became_active":"2024-09-11T22:14:26.958964+0000","last_became_peered":"2024-09-11T22:14:26.958964+0000","last_unstale":"2024-09-11T22:14:29.237812+0000","last_undegraded":"2024-09-11T22:14:29.237812+0000","last_fullsized":"2024-09-11T22:14:29.237812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:40.951930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956044+0000","last_change":"2024-09-11T22:14:25.957377+0000","last_active":"2024-09-11T22:14:27.956044+0000","last_peered":"2024-09-11T22:14:27.956044+0000","last_clean":"2024-09-11T22:14:27.956044+0000","last_became_active":"2024-09-11T22:14:25.957103+0000","last_became_peered":"2024-09-11T22:14:25.957103+0000","last_unstale":"2024-09-11T22:14:27.956044+0000","last_undegraded":"2024-09-11T22:14:27.956044+0000","last_fullsized":"2024-09-11T22:14:27.956044+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:17.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956917+0000","last_change":"2024-09-11T22:14:26.969252+0000","last_active":"2024-09-11T22:14:27.956917+0000","last_peered":"2024-09-11T22:14:27.956917+0000","last_clean":"2024-09-11T22:14:27.956917+0000","last_became_active":"2024-09-11T22:14:26.968962+0000","last_became_peered":"2024-09-11T22:14:26.968962+0000","last_unstale":"2024-09-11T22:14:27.956917+0000","last_undegraded":"2024-09-11T22:14:27.956917+0000","last_fullsized":"2024-09-11T22:14:27.956917+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:34.920148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.954203+0000","last_change":"2024-09-11T22:14:25.955890+0000","last_active":"2024-09-11T22:14:26.954203+0000","last_peered":"2024-09-11T22:14:26.954203+0000","last_clean":"2024-09-11T22:14:26.954203+0000","last_became_active":"2024-09-11T22:14:25.955601+0000","last_became_peered":"2024-09-11T22:14:25.955601+0000","last_unstale":"2024-09-11T22:14:26.954203+0000","last_undegraded":"2024-09-11T22:14:26.954203+0000","last_fullsized":"2024-09-11T22:14:26.954203+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:25.167921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.970806+0000","last_change":"2024-09-11T22:14:26.967750+0000","last_active":"2024-09-11T22:14:26.970806+0000","last_peered":"2024-09-11T22:14:26.970806+0000","last_clean":"2024-09-11T22:14:26.970806+0000","last_became_active":"2024-09-11T22:14:26.967492+0000","last_became_peered":"2024-09-11T22:14:26.967492+0000","last_unstale":"2024-09-11T22:14:26.970806+0000","last_undegraded":"2024-09-11T22:14:26.970806+0000","last_fullsized":"2024-09-11T22:14:26.970806+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:31.624389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238185+0000","last_change":"2024-09-11T22:14:25.951977+0000","last_active":"2024-09-11T22:14:29.238185+0000","last_peered":"2024-09-11T22:14:29.238185+0000","last_clean":"2024-09-11T22:14:29.238185+0000","last_became_active":"2024-09-11T22:14:25.951186+0000","last_became_peered":"2024-09-11T22:14:25.951186+0000","last_unstale":"2024-09-11T22:14:29.238185+0000","last_undegraded":"2024-09-11T22:14:29.238185+0000","last_fullsized":"2024-09-11T22:14:29.238185+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:42.115865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650581+0000","last_change":"2024-09-11T22:14:26.966320+0000","last_active":"2024-09-11T22:14:28.650581+0000","last_peered":"2024-09-11T22:14:28.650581+0000","last_clean":"2024-09-11T22:14:28.650581+0000","last_became_active":"2024-09-11T22:14:26.966062+0000","last_became_peered":"2024-09-11T22:14:26.966062+0000","last_unstale":"2024-09-11T22:14:28.650581+0000","last_undegraded":"2024-09-11T22:14:28.650581+0000","last_fullsized":"2024-09-11T22:14:28.650581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:18.648523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.969140+0000","last_change":"2024-09-11T22:14:25.958570+0000","last_active":"2024-09-11T22:14:26.969140+0000","last_peered":"2024-09-11T22:14:26.969140+0000","last_clean":"2024-09-11T22:14:26.969140+0000","last_became_active":"2024-09-11T22:14:25.958356+0000","last_became_peered":"2024-09-11T22:14:25.958356+0000","last_unstale":"2024-09-11T22:14:26.969140+0000","last_undegraded":"2024-09-11T22:14:26.969140+0000","last_fullsized":"2024-09-11T22:14:26.969140+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:29.549649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973134+0000","last_change":"2024-09-11T22:14:26.968253+0000","last_active":"2024-09-11T22:14:26.973134+0000","last_peered":"2024-09-11T22:14:26.973134+0000","last_clean":"2024-09-11T22:14:26.973134+0000","last_became_active":"2024-09-11T22:14:26.967949+0000","last_became_peered":"2024-09-11T22:14:26.967949+0000","last_unstale":"2024-09-11T22:14:26.973134+0000","last_undegraded":"2024-09-11T22:14:26.973134+0000","last_fullsized":"2024-09-11T22:14:26.973134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:30.165873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956950+0000","last_change":"2024-09-11T22:14:25.956145+0000","last_active":"2024-09-11T22:14:27.956950+0000","last_peered":"2024-09-11T22:14:27.956950+0000","last_clean":"2024-09-11T22:14:27.956950+0000","last_became_active":"2024-09-11T22:14:25.955833+0000","last_became_peered":"2024-09-11T22:14:25.955833+0000","last_unstale":"2024-09-11T22:14:27.956950+0000","last_undegraded":"2024-09-11T22:14:27.956950+0000","last_fullsized":"2024-09-11T22:14:27.956950+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:34.327331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956077+0000","last_change":"2024-09-11T22:14:26.959737+0000","last_active":"2024-09-11T22:14:27.956077+0000","last_peered":"2024-09-11T22:14:27.956077+0000","last_clean":"2024-09-11T22:14:27.956077+0000","last_became_active":"2024-09-11T22:14:26.959509+0000","last_became_peered":"2024-09-11T22:14:26.959509+0000","last_unstale":"2024-09-11T22:14:27.956077+0000","last_undegraded":"2024-09-11T22:14:27.956077+0000","last_fullsized":"2024-09-11T22:14:27.956077+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237856+0000","last_change":"2024-09-11T22:14:25.959102+0000","last_active":"2024-09-11T22:14:29.237856+0000","last_peered":"2024-09-11T22:14:29.237856+0000","last_clean":"2024-09-11T22:14:29.237856+0000","last_became_active":"2024-09-11T22:14:25.956666+0000","last_became_peered":"2024-09-11T22:14:25.956666+0000","last_unstale":"2024-09-11T22:14:29.237856+0000","last_undegraded":"2024-09-11T22:14:29.237856+0000","last_fullsized":"2024-09-11T22:14:29.237856+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:13.506850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.962976+0000","last_change":"2024-09-11T22:14:26.960877+0000","last_active":"2024-09-11T22:14:26.962976+0000","last_peered":"2024-09-11T22:14:26.962976+0000","last_clean":"2024-09-11T22:14:26.962976+0000","last_became_active":"2024-09-11T22:14:26.960545+0000","last_became_peered":"2024-09-11T22:14:26.960545+0000","last_unstale":"2024-09-11T22:14:26.962976+0000","last_undegraded":"2024-09-11T22:14:26.962976+0000","last_fullsized":"2024-09-11T22:14:26.962976+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:14.172517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045066+0000","last_change":"2024-09-11T22:14:25.954749+0000","last_active":"2024-09-11T22:14:28.045066+0000","last_peered":"2024-09-11T22:14:28.045066+0000","last_clean":"2024-09-11T22:14:28.045066+0000","last_became_active":"2024-09-11T22:14:25.954401+0000","last_became_peered":"2024-09-11T22:14:25.954401+0000","last_unstale":"2024-09-11T22:14:28.045066+0000","last_undegraded":"2024-09-11T22:14:28.045066+0000","last_fullsized":"2024-09-11T22:14:28.045066+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:44.892896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955926+0000","last_change":"2024-09-11T22:14:26.963837+0000","last_active":"2024-09-11T22:14:27.955926+0000","last_peered":"2024-09-11T22:14:27.955926+0000","last_clean":"2024-09-11T22:14:27.955926+0000","last_became_active":"2024-09-11T22:14:26.963576+0000","last_became_peered":"2024-09-11T22:14:26.963576+0000","last_unstale":"2024-09-11T22:14:27.955926+0000","last_undegraded":"2024-09-11T22:14:27.955926+0000","last_fullsized":"2024-09-11T22:14:27.955926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:11.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957202+0000","last_change":"2024-09-11T22:14:25.951651+0000","last_active":"2024-09-11T22:14:27.957202+0000","last_peered":"2024-09-11T22:14:27.957202+0000","last_clean":"2024-09-11T22:14:27.957202+0000","last_became_active":"2024-09-11T22:14:25.951299+0000","last_became_peered":"2024-09-11T22:14:25.951299+0000","last_unstale":"2024-09-11T22:14:27.957202+0000","last_undegraded":"2024-09-11T22:14:27.957202+0000","last_fullsized":"2024-09-11T22:14:27.957202+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:33.912546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973466+0000","last_change":"2024-09-11T22:14:26.972480+0000","last_active":"2024-09-11T22:14:26.973466+0000","last_peered":"2024-09-11T22:14:26.973466+0000","last_clean":"2024-09-11T22:14:26.973466+0000","last_became_active":"2024-09-11T22:14:26.972332+0000","last_became_peered":"2024-09-11T22:14:26.972332+0000","last_unstale":"2024-09-11T22:14:26.973466+0000","last_undegraded":"2024-09-11T22:14:26.973466+0000","last_fullsized":"2024-09-11T22:14:26.973466+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:53.958006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.966367+0000","last_change":"2024-09-11T22:14:25.956614+0000","last_active":"2024-09-11T22:14:26.966367+0000","last_peered":"2024-09-11T22:14:26.966367+0000","last_clean":"2024-09-11T22:14:26.966367+0000","last_became_active":"2024-09-11T22:14:25.956306+0000","last_became_peered":"2024-09-11T22:14:25.956306+0000","last_unstale":"2024-09-11T22:14:26.966367+0000","last_undegraded":"2024-09-11T22:14:26.966367+0000","last_fullsized":"2024-09-11T22:14:26.966367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:39.705969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.968425+0000","last_change":"2024-09-11T22:14:26.966426+0000","last_active":"2024-09-11T22:14:26.968425+0000","last_peered":"2024-09-11T22:14:26.968425+0000","last_clean":"2024-09-11T22:14:26.968425+0000","last_became_active":"2024-09-11T22:14:26.966157+0000","last_became_peered":"2024-09-11T22:14:26.966157+0000","last_unstale":"2024-09-11T22:14:26.968425+0000","last_undegraded":"2024-09-11T22:14:26.968425+0000","last_fullsized":"2024-09-11T22:14:26.968425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:21.554097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238251+0000","last_change":"2024-09-11T22:14:25.960512+0000","last_active":"2024-09-11T22:14:29.238251+0000","last_peered":"2024-09-11T22:14:29.238251+0000","last_clean":"2024-09-11T22:14:29.238251+0000","last_became_active":"2024-09-11T22:14:25.960249+0000","last_became_peered":"2024-09-11T22:14:25.960249+0000","last_unstale":"2024-09-11T22:14:29.238251+0000","last_undegraded":"2024-09-11T22:14:29.238251+0000","last_fullsized":"2024-09-11T22:14:29.238251+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:12.252400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956341+0000","last_change":"2024-09-11T22:14:26.960080+0000","last_active":"2024-09-11T22:14:27.956341+0000","last_peered":"2024-09-11T22:14:27.956341+0000","last_clean":"2024-09-11T22:14:27.956341+0000","last_became_active":"2024-09-11T22:14:26.959778+0000","last_became_peered":"2024-09-11T22:14:26.959778+0000","last_unstale":"2024-09-11T22:14:27.956341+0000","last_undegraded":"2024-09-11T22:14:27.956341+0000","last_fullsized":"2024-09-11T22:14:27.956341+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:14.514452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955559+0000","last_change":"2024-09-11T22:14:25.953232+0000","last_active":"2024-09-11T22:14:27.955559+0000","last_peered":"2024-09-11T22:14:27.955559+0000","last_clean":"2024-09-11T22:14:27.955559+0000","last_became_active":"2024-09-11T22:14:25.952951+0000","last_became_peered":"2024-09-11T22:14:25.952951+0000","last_unstale":"2024-09-11T22:14:27.955559+0000","last_undegraded":"2024-09-11T22:14:27.955559+0000","last_fullsized":"2024-09-11T22:14:27.955559+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:31.695327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237924+0000","last_change":"2024-09-11T22:14:26.965790+0000","last_active":"2024-09-11T22:14:29.237924+0000","last_peered":"2024-09-11T22:14:29.237924+0000","last_clean":"2024-09-11T22:14:29.237924+0000","last_became_active":"2024-09-11T22:14:26.965502+0000","last_became_peered":"2024-09-11T22:14:26.965502+0000","last_unstale":"2024-09-11T22:14:29.237924+0000","last_undegraded":"2024-09-11T22:14:29.237924+0000","last_fullsized":"2024-09-11T22:14:29.237924+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:51.944511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956610+0000","last_change":"2024-09-11T22:14:25.951206+0000","last_active":"2024-09-11T22:14:27.956610+0000","last_peered":"2024-09-11T22:14:27.956610+0000","last_clean":"2024-09-11T22:14:27.956610+0000","last_became_active":"2024-09-11T22:14:25.950899+0000","last_became_peered":"2024-09-11T22:14:25.950899+0000","last_unstale":"2024-09-11T22:14:27.956610+0000","last_undegraded":"2024-09-11T22:14:27.956610+0000","last_fullsized":"2024-09-11T22:14:27.956610+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:44.656561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973155+0000","last_change":"2024-09-11T22:14:26.968273+0000","last_active":"2024-09-11T22:14:26.973155+0000","last_peered":"2024-09-11T22:14:26.973155+0000","last_clean":"2024-09-11T22:14:26.973155+0000","last_became_active":"2024-09-11T22:14:26.967984+0000","last_became_peered":"2024-09-11T22:14:26.967984+0000","last_unstale":"2024-09-11T22:14:26.973155+0000","last_undegraded":"2024-09-11T22:14:26.973155+0000","last_fullsized":"2024-09-11T22:14:26.973155+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:44.444736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955266+0000","last_change":"2024-09-11T22:14:25.958361+0000","last_active":"2024-09-11T22:14:27.955266+0000","last_peered":"2024-09-11T22:14:27.955266+0000","last_clean":"2024-09-11T22:14:27.955266+0000","last_became_active":"2024-09-11T22:14:25.957879+0000","last_became_peered":"2024-09-11T22:14:25.957879+0000","last_unstale":"2024-09-11T22:14:27.955266+0000","last_undegraded":"2024-09-11T22:14:27.955266+0000","last_fullsized":"2024-09-11T22:14:27.955266+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:52.954746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956243+0000","last_change":"2024-09-11T22:14:26.959870+0000","last_active":"2024-09-11T22:14:27.956243+0000","last_peered":"2024-09-11T22:14:27.956243+0000","last_clean":"2024-09-11T22:14:27.956243+0000","last_became_active":"2024-09-11T22:14:26.957903+0000","last_became_peered":"2024-09-11T22:14:26.957903+0000","last_unstale":"2024-09-11T22:14:27.956243+0000","last_undegraded":"2024-09-11T22:14:27.956243+0000","last_fullsized":"2024-09-11T22:14:27.956243+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:16.543726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238146+0000","last_change":"2024-09-11T22:14:25.958591+0000","last_active":"2024-09-11T22:14:29.238146+0000","last_peered":"2024-09-11T22:14:29.238146+0000","last_clean":"2024-09-11T22:14:29.238146+0000","last_became_active":"2024-09-11T22:14:25.958303+0000","last_became_peered":"2024-09-11T22:14:25.958303+0000","last_unstale":"2024-09-11T22:14:29.238146+0000","last_undegraded":"2024-09-11T22:14:29.238146+0000","last_fullsized":"2024-09-11T22:14:29.238146+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:24.724328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955309+0000","last_change":"2024-09-11T22:14:26.957372+0000","last_active":"2024-09-11T22:14:27.955309+0000","last_peered":"2024-09-11T22:14:27.955309+0000","last_clean":"2024-09-11T22:14:27.955309+0000","last_became_active":"2024-09-11T22:14:26.956741+0000","last_became_peered":"2024-09-11T22:14:26.956741+0000","last_unstale":"2024-09-11T22:14:27.955309+0000","last_undegraded":"2024-09-11T22:14:27.955309+0000","last_fullsized":"2024-09-11T22:14:27.955309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.496550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650503+0000","last_change":"2024-09-11T22:14:25.954496+0000","last_active":"2024-09-11T22:14:28.650503+0000","last_peered":"2024-09-11T22:14:28.650503+0000","last_clean":"2024-09-11T22:14:28.650503+0000","last_became_active":"2024-09-11T22:14:25.954243+0000","last_became_peered":"2024-09-11T22:14:25.954243+0000","last_unstale":"2024-09-11T22:14:28.650503+0000","last_undegraded":"2024-09-11T22:14:28.650503+0000","last_fullsized":"2024-09-11T22:14:28.650503+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:39.537090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955070+0000","last_change":"2024-09-11T22:14:26.958126+0000","last_active":"2024-09-11T22:14:27.955070+0000","last_peered":"2024-09-11T22:14:27.955070+0000","last_clean":"2024-09-11T22:14:27.955070+0000","last_became_active":"2024-09-11T22:14:26.957849+0000","last_became_peered":"2024-09-11T22:14:26.957849+0000","last_unstale":"2024-09-11T22:14:27.955070+0000","last_undegraded":"2024-09-11T22:14:27.955070+0000","last_fullsized":"2024-09-11T22:14:27.955070+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:46.007324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955914+0000","last_change":"2024-09-11T22:14:25.957351+0000","last_active":"2024-09-11T22:14:27.955914+0000","last_peered":"2024-09-11T22:14:27.955914+0000","last_clean":"2024-09-11T22:14:27.955914+0000","last_became_active":"2024-09-11T22:14:25.957078+0000","last_became_peered":"2024-09-11T22:14:25.957078+0000","last_unstale":"2024-09-11T22:14:27.955914+0000","last_undegraded":"2024-09-11T22:14:27.955914+0000","last_fullsized":"2024-09-11T22:14:27.955914+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:10.280169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957199+0000","last_change":"2024-09-11T22:14:26.959295+0000","last_active":"2024-09-11T22:14:27.957199+0000","last_peered":"2024-09-11T22:14:27.957199+0000","last_clean":"2024-09-11T22:14:27.957199+0000","last_became_active":"2024-09-11T22:14:26.958326+0000","last_became_peered":"2024-09-11T22:14:26.958326+0000","last_unstale":"2024-09-11T22:14:27.957199+0000","last_undegraded":"2024-09-11T22:14:27.957199+0000","last_fullsized":"2024-09-11T22:14:27.957199+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:13.260002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650693+0000","last_change":"2024-09-11T22:14:25.957828+0000","last_active":"2024-09-11T22:14:28.650693+0000","last_peered":"2024-09-11T22:14:28.650693+0000","last_clean":"2024-09-11T22:14:28.650693+0000","last_became_active":"2024-09-11T22:14:25.957530+0000","last_became_peered":"2024-09-11T22:14:25.957530+0000","last_unstale":"2024-09-11T22:14:28.650693+0000","last_undegraded":"2024-09-11T22:14:28.650693+0000","last_fullsized":"2024-09-11T22:14:28.650693+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:33.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956558+0000","last_change":"2024-09-11T22:14:26.962695+0000","last_active":"2024-09-11T22:14:27.956558+0000","last_peered":"2024-09-11T22:14:27.956558+0000","last_clean":"2024-09-11T22:14:27.956558+0000","last_became_active":"2024-09-11T22:14:26.962168+0000","last_became_peered":"2024-09-11T22:14:26.962168+0000","last_unstale":"2024-09-11T22:14:27.956558+0000","last_undegraded":"2024-09-11T22:14:27.956558+0000","last_fullsized":"2024-09-11T22:14:27.956558+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:25.731929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.948031+0000","last_change":"2024-09-11T22:14:25.954069+0000","last_active":"2024-09-11T22:14:28.948031+0000","last_peered":"2024-09-11T22:14:28.948031+0000","last_clean":"2024-09-11T22:14:28.948031+0000","last_became_active":"2024-09-11T22:14:25.953797+0000","last_became_peered":"2024-09-11T22:14:25.953797+0000","last_unstale":"2024-09-11T22:14:28.948031+0000","last_undegraded":"2024-09-11T22:14:28.948031+0000","last_fullsized":"2024-09-11T22:14:28.948031+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:34.327331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650617+0000","last_change":"2024-09-11T22:14:26.965457+0000","last_active":"2024-09-11T22:14:28.650617+0000","last_peered":"2024-09-11T22:14:28.650617+0000","last_clean":"2024-09-11T22:14:28.650617+0000","last_became_active":"2024-09-11T22:14:26.965210+0000","last_became_peered":"2024-09-11T22:14:26.965210+0000","last_unstale":"2024-09-11T22:14:28.650617+0000","last_undegraded":"2024-09-11T22:14:28.650617+0000","last_fullsized":"2024-09-11T22:14:28.650617+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:35.334932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045209+0000","last_change":"2024-09-11T22:14:25.954345+0000","last_active":"2024-09-11T22:14:28.045209+0000","last_peered":"2024-09-11T22:14:28.045209+0000","last_clean":"2024-09-11T22:14:28.045209+0000","last_became_active":"2024-09-11T22:14:25.954043+0000","last_became_peered":"2024-09-11T22:14:25.954043+0000","last_unstale":"2024-09-11T22:14:28.045209+0000","last_undegraded":"2024-09-11T22:14:28.045209+0000","last_fullsized":"2024-09-11T22:14:28.045209+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:51.604884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955489+0000","last_change":"2024-09-11T22:14:26.960931+0000","last_active":"2024-09-11T22:14:27.955489+0000","last_peered":"2024-09-11T22:14:27.955489+0000","last_clean":"2024-09-11T22:14:27.955489+0000","last_became_active":"2024-09-11T22:14:26.960291+0000","last_became_peered":"2024-09-11T22:14:26.960291+0000","last_unstale":"2024-09-11T22:14:27.955489+0000","last_undegraded":"2024-09-11T22:14:27.955489+0000","last_fullsized":"2024-09-11T22:14:27.955489+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:16.543726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957332+0000","last_change":"2024-09-11T22:14:25.950162+0000","last_active":"2024-09-11T22:14:27.957332+0000","last_peered":"2024-09-11T22:14:27.957332+0000","last_clean":"2024-09-11T22:14:27.957332+0000","last_became_active":"2024-09-11T22:14:25.949856+0000","last_became_peered":"2024-09-11T22:14:25.949856+0000","last_unstale":"2024-09-11T22:14:27.957332+0000","last_undegraded":"2024-09-11T22:14:27.957332+0000","last_fullsized":"2024-09-11T22:14:27.957332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:16.056310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237864+0000","last_change":"2024-09-11T22:14:26.968109+0000","last_active":"2024-09-11T22:14:29.237864+0000","last_peered":"2024-09-11T22:14:29.237864+0000","last_clean":"2024-09-11T22:14:29.237864+0000","last_became_active":"2024-09-11T22:14:26.967838+0000","last_became_peered":"2024-09-11T22:14:26.967838+0000","last_unstale":"2024-09-11T22:14:29.237864+0000","last_undegraded":"2024-09-11T22:14:29.237864+0000","last_fullsized":"2024-09-11T22:14:29.237864+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:44.391169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650403+0000","last_change":"2024-09-11T22:14:25.953604+0000","last_active":"2024-09-11T22:14:28.650403+0000","last_peered":"2024-09-11T22:14:28.650403+0000","last_clean":"2024-09-11T22:14:28.650403+0000","last_became_active":"2024-09-11T22:14:25.953317+0000","last_became_peered":"2024-09-11T22:14:25.953317+0000","last_unstale":"2024-09-11T22:14:28.650403+0000","last_undegraded":"2024-09-11T22:14:28.650403+0000","last_fullsized":"2024-09-11T22:14:28.650403+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:56.831702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.973444+0000","last_change":"2024-09-11T22:14:26.971798+0000","last_active":"2024-09-11T22:14:26.973444+0000","last_peered":"2024-09-11T22:14:26.973444+0000","last_clean":"2024-09-11T22:14:26.973444+0000","last_became_active":"2024-09-11T22:14:26.971548+0000","last_became_peered":"2024-09-11T22:14:26.971548+0000","last_unstale":"2024-09-11T22:14:26.973444+0000","last_undegraded":"2024-09-11T22:14:26.973444+0000","last_fullsized":"2024-09-11T22:14:26.973444+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:44.655053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956340+0000","last_change":"2024-09-11T22:14:25.955614+0000","last_active":"2024-09-11T22:14:27.956340+0000","last_peered":"2024-09-11T22:14:27.956340+0000","last_clean":"2024-09-11T22:14:27.956340+0000","last_became_active":"2024-09-11T22:14:25.955095+0000","last_became_peered":"2024-09-11T22:14:25.955095+0000","last_unstale":"2024-09-11T22:14:27.956340+0000","last_undegraded":"2024-09-11T22:14:27.956340+0000","last_fullsized":"2024-09-11T22:14:27.956340+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:12.454865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650348+0000","last_change":"2024-09-11T22:14:26.963669+0000","last_active":"2024-09-11T22:14:28.650348+0000","last_peered":"2024-09-11T22:14:28.650348+0000","last_clean":"2024-09-11T22:14:28.650348+0000","last_became_active":"2024-09-11T22:14:26.963377+0000","last_became_peered":"2024-09-11T22:14:26.963377+0000","last_unstale":"2024-09-11T22:14:28.650348+0000","last_undegraded":"2024-09-11T22:14:28.650348+0000","last_fullsized":"2024-09-11T22:14:28.650348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:32.702928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650495+0000","last_change":"2024-09-11T22:14:25.955422+0000","last_active":"2024-09-11T22:14:28.650495+0000","last_peered":"2024-09-11T22:14:28.650495+0000","last_clean":"2024-09-11T22:14:28.650495+0000","last_became_active":"2024-09-11T22:14:25.955133+0000","last_became_peered":"2024-09-11T22:14:25.955133+0000","last_unstale":"2024-09-11T22:14:28.650495+0000","last_undegraded":"2024-09-11T22:14:28.650495+0000","last_fullsized":"2024-09-11T22:14:28.650495+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.631686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237726+0000","last_change":"2024-09-11T22:14:26.959240+0000","last_active":"2024-09-11T22:14:29.237726+0000","last_peered":"2024-09-11T22:14:29.237726+0000","last_clean":"2024-09-11T22:14:29.237726+0000","last_became_active":"2024-09-11T22:14:26.958616+0000","last_became_peered":"2024-09-11T22:14:26.958616+0000","last_unstale":"2024-09-11T22:14:29.237726+0000","last_undegraded":"2024-09-11T22:14:29.237726+0000","last_fullsized":"2024-09-11T22:14:29.237726+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:24.318239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237850+0000","last_change":"2024-09-11T22:14:25.958671+0000","last_active":"2024-09-11T22:14:29.237850+0000","last_peered":"2024-09-11T22:14:29.237850+0000","last_clean":"2024-09-11T22:14:29.237850+0000","last_became_active":"2024-09-11T22:14:25.958219+0000","last_became_peered":"2024-09-11T22:14:25.958219+0000","last_unstale":"2024-09-11T22:14:29.237850+0000","last_undegraded":"2024-09-11T22:14:29.237850+0000","last_fullsized":"2024-09-11T22:14:29.237850+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:40.924340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237952+0000","last_change":"2024-09-11T22:14:26.960588+0000","last_active":"2024-09-11T22:14:29.237952+0000","last_peered":"2024-09-11T22:14:29.237952+0000","last_clean":"2024-09-11T22:14:29.237952+0000","last_became_active":"2024-09-11T22:14:26.959947+0000","last_became_peered":"2024-09-11T22:14:26.959947+0000","last_unstale":"2024-09-11T22:14:29.237952+0000","last_undegraded":"2024-09-11T22:14:29.237952+0000","last_fullsized":"2024-09-11T22:14:29.237952+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:07.334337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045119+0000","last_change":"2024-09-11T22:14:25.954833+0000","last_active":"2024-09-11T22:14:28.045119+0000","last_peered":"2024-09-11T22:14:28.045119+0000","last_clean":"2024-09-11T22:14:28.045119+0000","last_became_active":"2024-09-11T22:14:25.954546+0000","last_became_peered":"2024-09-11T22:14:25.954546+0000","last_unstale":"2024-09-11T22:14:28.045119+0000","last_undegraded":"2024-09-11T22:14:28.045119+0000","last_fullsized":"2024-09-11T22:14:28.045119+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:25.578897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":237,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T22:14:26.948896+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:14:26.948896+0000","last_peered":"2024-09-11T22:14:26.948896+0000","last_clean":"2024-09-11T22:14:26.948896+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:14:26.948896+0000","last_undegraded":"2024-09-11T22:14:26.948896+0000","last_fullsized":"2024-09-11T22:14:26.948896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36032,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335808,"statfs":{"total":96636764160,"available":96599867392,"internally_reserved":0,"allocated":700416,"data_stored":292137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36044,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335796,"statfs":{"total":96636764160,"available":96599855104,"internally_reserved":0,"allocated":708608,"data_stored":292789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36048,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335792,"statfs":{"total":96636764160,"available":96599851008,"internally_reserved":0,"allocated":712704,"data_stored":293749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44352,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327488,"statfs":{"total":96636764160,"available":96591347712,"internally_reserved":0,"allocated":696320,"data_stored":285893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":692224,"data_stored":285927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40788,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331052,"statfs":{"total":96636764160,"available":96594997248,"internally_reserved":0,"allocated":1310720,"data_stored":884699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36592,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335248,"statfs":{"total":96636764160,"available":96599293952,"internally_reserved":0,"allocated":1269760,"data_stored":869430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40160,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331680,"statfs":{"total":96636764160,"available":96595640320,"internally_reserved":0,"allocated":663552,"data_stored":272795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:14:32.932 INFO:tasks.ceph.mds.b.smithi077.stderr:2024-09-11T22:14:32.932+0000 7f0a7a8cf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:14:34.368 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.483+0000 7f88b488d640 1 Processor -- start 2024-09-11T22:14:34.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.483+0000 7f88b488d640 1 -- start start 2024-09-11T22:14:34.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.484+0000 7f88b488d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b00d05e0 0x7f88b00b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.484+0000 7f88b488d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88b00b4f00 con 0x7f88b00b3e10 2024-09-11T22:14:34.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.484+0000 7f88b488d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88b00b4360 con 0x7f88b015c2c0 2024-09-11T22:14:34.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.484+0000 7f88b488d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f88b00b51c0 con 0x7f88b00d05e0 2024-09-11T22:14:34.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.484+0000 7f88aed9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f88b00b3e10 0x7f88b00ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48932/0 (socket says 172.21.15.50:48932) 2024-09-11T22:14:34.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.484+0000 7f88aed9d640 1 -- 172.21.15.50:0/3984799746 learned_addr learned my addr 172.21.15.50:0/3984799746 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:34.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88add9b640 1 --2- 172.21.15.50:0/3984799746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b00d05e0 0x7f88b00b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768571884 0 0) 0x7f88b00b4f00 con 0x7f88b00b3e10 2024-09-11T22:14:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f889c003520 con 0x7f88b00b3e10 2024-09-11T22:14:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790326044 0 0) 0x7f88b00b4360 con 0x7f88b015c2c0 2024-09-11T22:14:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88b00b4f00 con 0x7f88b015c2c0 2024-09-11T22:14:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 274441941 0 0) 0x7f889c003520 con 0x7f88b00b3e10 2024-09-11T22:14:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b00d05e0 msgr2=0x7f88b00b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 --2- 172.21.15.50:0/3984799746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b00d05e0 0x7f88b00b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 >> v1:172.21.15.77:6789/0 conn(0x7f88b015c2c0 legacy=0x7f88b00cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b00b54a0 con 0x7f88b00b3e10 2024-09-11T22:14:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f88a00019f0 con 0x7f88b00b3e10 2024-09-11T22:14:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88add9b640 1 --2- 172.21.15.50:0/3984799746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b00d05e0 0x7f88b00b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 >> v1:172.21.15.50:6789/0 conn(0x7f88b00b3e10 legacy=0x7f88b00ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 --2- 172.21.15.50:0/3984799746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b00d05e0 0x7f889c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 --2- 172.21.15.50:0/3984799746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f889c0040b0 0x7f889c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 --2- 172.21.15.50:0/3984799746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889c004d40 0x7f889c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88b00b51c0 con 0x7f889c0040b0 2024-09-11T22:14:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f889c00ba70 con 0x7f889c004d40 2024-09-11T22:14:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f889c00bc70 con 0x7f88b00d05e0 2024-09-11T22:14:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88add9b640 1 --2- 172.21.15.50:0/3984799746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f889c0040b0 0x7f889c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88ae59c640 1 --2- 172.21.15.50:0/3984799746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b00d05e0 0x7f889c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.485+0000 7f88aed9d640 1 --2- 172.21.15.50:0/3984799746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889c004d40 0x7f889c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.486+0000 7f88add9b640 1 -- 172.21.15.50:0/3984799746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b00d05e0 msgr2=0x7f889c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.486+0000 7f88add9b640 1 --2- 172.21.15.50:0/3984799746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b00d05e0 0x7f889c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.486+0000 7f88add9b640 1 -- 172.21.15.50:0/3984799746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889c004d40 msgr2=0x7f889c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.486+0000 7f88add9b640 1 --2- 172.21.15.50:0/3984799746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889c004d40 0x7f889c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.486+0000 7f88add9b640 1 -- 172.21.15.50:0/3984799746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c003520 con 0x7f889c0040b0 2024-09-11T22:14:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.486+0000 7f88add9b640 1 --2- 172.21.15.50:0/3984799746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f889c0040b0 0x7f889c004800 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8898009c70 tx=0x7f889c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c8c773961c7714 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:34.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.486+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898036070 con 0x7f889c0040b0 2024-09-11T22:14:34.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.486+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8898031400 con 0x7f889c0040b0 2024-09-11T22:14:34.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.487+0000 7f88ad59a640 1 -- 172.21.15.50:0/3984799746 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898009840 con 0x7f889c0040b0 2024-09-11T22:14:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.487+0000 7f88b488d640 1 -- 172.21.15.50:0/3984799746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f889c0040b0 msgr2=0x7f889c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.487+0000 7f88b488d640 1 --2- 172.21.15.50:0/3984799746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f889c0040b0 0x7f889c004800 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8898009c70 tx=0x7f889c005830 comp rx=0 tx=0).stop 2024-09-11T22:14:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.487+0000 7f88aed9d640 1 -- 172.21.15.50:0/3984799746 reap_dead start 2024-09-11T22:14:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.487+0000 7f88b488d640 1 -- 172.21.15.50:0/3984799746 shutdown_connections 2024-09-11T22:14:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.487+0000 7f88b488d640 1 -- 172.21.15.50:0/3984799746 >> 172.21.15.50:0/3984799746 conn(0x7f88b00679c0 msgr2=0x7f88b0067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.487+0000 7f88b488d640 1 -- 172.21.15.50:0/3984799746 shutdown_connections 2024-09-11T22:14:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.487+0000 7f88b488d640 1 -- 172.21.15.50:0/3984799746 wait complete. 2024-09-11T22:14:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.489+0000 7f88b488d640 1 Processor -- start 2024-09-11T22:14:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.489+0000 7f88b488d640 1 -- start start 2024-09-11T22:14:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.489+0000 7f88b488d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889c0040b0 0x7f88b013eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.489+0000 7f88b488d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b014fae0 0x7f88b015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.489+0000 7f88b488d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b014ff60 0x7f88b014bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.489+0000 7f88b488d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88b006d070 con 0x7f88b014fae0 2024-09-11T22:14:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.489+0000 7f88b488d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88b00ce200 con 0x7f889c0040b0 2024-09-11T22:14:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.489+0000 7f88b488d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f88b006d1f0 con 0x7f88b014ff60 2024-09-11T22:14:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88add9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b014fae0 0x7f88b015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88add9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b014fae0 0x7f88b015f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50422/0 (socket says 172.21.15.50:50422) 2024-09-11T22:14:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88add9b640 1 -- 172.21.15.50:0/4014358643 learned_addr learned my addr 172.21.15.50:0/4014358643 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88ae59c640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889c0040b0 0x7f88b013eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88aed9d640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b014ff60 0x7f88b014bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88add9b640 1 -- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b014ff60 msgr2=0x7f88b014bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88add9b640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b014ff60 0x7f88b014bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88add9b640 1 -- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889c0040b0 msgr2=0x7f88b013eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88add9b640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889c0040b0 0x7f88b013eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88add9b640 1 -- 172.21.15.50:0/4014358643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b014ea40 con 0x7f88b014fae0 2024-09-11T22:14:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88add9b640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b014fae0 0x7f88b015f5c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8898009d90 tx=0x7f8898004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88a6ffd640 1 -- 172.21.15.50:0/4014358643 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898040070 con 0x7f88b014fae0 2024-09-11T22:14:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88a6ffd640 1 -- 172.21.15.50:0/4014358643 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88980093e0 con 0x7f88b014fae0 2024-09-11T22:14:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88a6ffd640 1 -- 172.21.15.50:0/4014358643 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898036040 con 0x7f88b014fae0 2024-09-11T22:14:34.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88b488d640 1 -- 172.21.15.50:0/4014358643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b014ed20 con 0x7f88b014fae0 2024-09-11T22:14:34.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.490+0000 7f88b488d640 1 -- 172.21.15.50:0/4014358643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b014f2e0 con 0x7f88b014fae0 2024-09-11T22:14:34.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.491+0000 7f88b488d640 1 -- 172.21.15.50:0/4014358643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88b015c6a0 con 0x7f88b014fae0 2024-09-11T22:14:34.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.492+0000 7f88a6ffd640 1 -- 172.21.15.50:0/4014358643 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8898043070 con 0x7f88b014fae0 2024-09-11T22:14:34.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.492+0000 7f88a6ffd640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f889006be30 0x7f889006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.492+0000 7f88a6ffd640 1 -- 172.21.15.50:0/4014358643 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f88980ab420 con 0x7f88b014fae0 2024-09-11T22:14:34.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.493+0000 7f88ae59c640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f889006be30 0x7f889006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.493+0000 7f88ae59c640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f889006be30 0x7f889006e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f88b014c740 tx=0x7f88a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:34.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.497+0000 7f88a6ffd640 1 -- 172.21.15.50:0/4014358643 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8898031e20 con 0x7f88b014fae0 2024-09-11T22:14:34.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.668+0000 7f88b488d640 1 -- 172.21.15.50:0/4014358643 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88b006a020 con 0x7f889006be30 2024-09-11T22:14:34.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.674+0000 7f88a6ffd640 1 -- 172.21.15.50:0/4014358643 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251942 (secure 0 0 0) 0x7f88b006a020 con 0x7f889006be30 2024-09-11T22:14:34.678 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:34.679 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:14:34.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.677+0000 7f88b488d640 1 -- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f889006be30 msgr2=0x7f889006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.677+0000 7f88b488d640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f889006be30 0x7f889006e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f88b014c740 tx=0x7f88a8009040 comp rx=0 tx=0).stop 2024-09-11T22:14:34.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.677+0000 7f88b488d640 1 -- 172.21.15.50:0/4014358643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b014fae0 msgr2=0x7f88b015f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.677+0000 7f88b488d640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b014fae0 0x7f88b015f5c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8898009d90 tx=0x7f8898004730 comp rx=0 tx=0).stop 2024-09-11T22:14:34.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.677+0000 7f88b488d640 1 -- 172.21.15.50:0/4014358643 shutdown_connections 2024-09-11T22:14:34.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.677+0000 7f88b488d640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f889006be30 0x7f889006e2f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.677+0000 7f88b488d640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b014ff60 0x7f88b014bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.677+0000 7f88b488d640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b014fae0 0x7f88b015f5c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.677+0000 7f88b488d640 1 --2- 172.21.15.50:0/4014358643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889c0040b0 0x7f88b013eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.677+0000 7f88b488d640 1 -- 172.21.15.50:0/4014358643 >> 172.21.15.50:0/4014358643 conn(0x7f88b00679c0 msgr2=0x7f88b00b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:34.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.677+0000 7f88b488d640 1 -- 172.21.15.50:0/4014358643 shutdown_connections 2024-09-11T22:14:34.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.677+0000 7f88b488d640 1 -- 172.21.15.50:0/4014358643 wait complete. 2024-09-11T22:14:34.689 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-11T22:14:33.411305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301948,"kb_used_data":6672,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754672772,"statfs":{"total":773094113280,"available":772784918528,"internally_reserved":0,"allocated":6832128,"data_stored":3510052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":302173745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.471074"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:30.338199+0000","last_change":"2024-09-11T22:14:26.968763+0000","last_active":"2024-09-11T22:14:30.338199+0000","last_peered":"2024-09-11T22:14:30.338199+0000","last_clean":"2024-09-11T22:14:30.338199+0000","last_became_active":"2024-09-11T22:14:26.968452+0000","last_became_peered":"2024-09-11T22:14:26.968452+0000","last_unstale":"2024-09-11T22:14:30.338199+0000","last_undegraded":"2024-09-11T22:14:30.338199+0000","last_fullsized":"2024-09-11T22:14:30.338199+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:05.138240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238075+0000","last_change":"2024-09-11T22:14:26.959238+0000","last_active":"2024-09-11T22:14:29.238075+0000","last_peered":"2024-09-11T22:14:29.238075+0000","last_clean":"2024-09-11T22:14:29.238075+0000","last_became_active":"2024-09-11T22:14:26.958936+0000","last_became_peered":"2024-09-11T22:14:26.958936+0000","last_unstale":"2024-09-11T22:14:29.238075+0000","last_undegraded":"2024-09-11T22:14:29.238075+0000","last_fullsized":"2024-09-11T22:14:29.238075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:11.635531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.137815+0000","last_change":"2024-09-11T22:14:26.960744+0000","last_active":"2024-09-11T22:14:29.137815+0000","last_peered":"2024-09-11T22:14:29.137815+0000","last_clean":"2024-09-11T22:14:29.137815+0000","last_became_active":"2024-09-11T22:14:26.960440+0000","last_became_peered":"2024-09-11T22:14:26.960440+0000","last_unstale":"2024-09-11T22:14:29.137815+0000","last_undegraded":"2024-09-11T22:14:29.137815+0000","last_fullsized":"2024-09-11T22:14:29.137815+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.429599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956811+0000","last_change":"2024-09-11T22:14:26.959797+0000","last_active":"2024-09-11T22:14:27.956811+0000","last_peered":"2024-09-11T22:14:27.956811+0000","last_clean":"2024-09-11T22:14:27.956811+0000","last_became_active":"2024-09-11T22:14:26.959522+0000","last_became_peered":"2024-09-11T22:14:26.959522+0000","last_unstale":"2024-09-11T22:14:27.956811+0000","last_undegraded":"2024-09-11T22:14:27.956811+0000","last_fullsized":"2024-09-11T22:14:27.956811+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:41.931942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:30.338051+0000","last_change":"2024-09-11T22:14:26.956836+0000","last_active":"2024-09-11T22:14:30.338051+0000","last_peered":"2024-09-11T22:14:30.338051+0000","last_clean":"2024-09-11T22:14:30.338051+0000","last_became_active":"2024-09-11T22:14:26.956543+0000","last_became_peered":"2024-09-11T22:14:26.956543+0000","last_unstale":"2024-09-11T22:14:30.338051+0000","last_undegraded":"2024-09-11T22:14:30.338051+0000","last_fullsized":"2024-09-11T22:14:30.338051+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:32.123980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955059+0000","last_change":"2024-09-11T22:14:26.956023+0000","last_active":"2024-09-11T22:14:27.955059+0000","last_peered":"2024-09-11T22:14:27.955059+0000","last_clean":"2024-09-11T22:14:27.955059+0000","last_became_active":"2024-09-11T22:14:26.955721+0000","last_became_peered":"2024-09-11T22:14:26.955721+0000","last_unstale":"2024-09-11T22:14:27.955059+0000","last_undegraded":"2024-09-11T22:14:27.955059+0000","last_fullsized":"2024-09-11T22:14:27.955059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:54.886252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956720+0000","last_change":"2024-09-11T22:14:26.964660+0000","last_active":"2024-09-11T22:14:27.956720+0000","last_peered":"2024-09-11T22:14:27.956720+0000","last_clean":"2024-09-11T22:14:27.956720+0000","last_became_active":"2024-09-11T22:14:26.964404+0000","last_became_peered":"2024-09-11T22:14:26.964404+0000","last_unstale":"2024-09-11T22:14:27.956720+0000","last_undegraded":"2024-09-11T22:14:27.956720+0000","last_fullsized":"2024-09-11T22:14:27.956720+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:17.063912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237609+0000","last_change":"2024-09-11T22:14:26.960383+0000","last_active":"2024-09-11T22:14:29.237609+0000","last_peered":"2024-09-11T22:14:29.237609+0000","last_clean":"2024-09-11T22:14:29.237609+0000","last_became_active":"2024-09-11T22:14:26.959605+0000","last_became_peered":"2024-09-11T22:14:26.959605+0000","last_unstale":"2024-09-11T22:14:29.237609+0000","last_undegraded":"2024-09-11T22:14:29.237609+0000","last_fullsized":"2024-09-11T22:14:29.237609+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:52.664222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956335+0000","last_change":"2024-09-11T22:14:26.964503+0000","last_active":"2024-09-11T22:14:27.956335+0000","last_peered":"2024-09-11T22:14:27.956335+0000","last_clean":"2024-09-11T22:14:27.956335+0000","last_became_active":"2024-09-11T22:14:26.964196+0000","last_became_peered":"2024-09-11T22:14:26.964196+0000","last_unstale":"2024-09-11T22:14:27.956335+0000","last_undegraded":"2024-09-11T22:14:27.956335+0000","last_fullsized":"2024-09-11T22:14:27.956335+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:13.144193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650694+0000","last_change":"2024-09-11T22:14:26.959365+0000","last_active":"2024-09-11T22:14:28.650694+0000","last_peered":"2024-09-11T22:14:28.650694+0000","last_clean":"2024-09-11T22:14:28.650694+0000","last_became_active":"2024-09-11T22:14:26.958793+0000","last_became_peered":"2024-09-11T22:14:26.958793+0000","last_unstale":"2024-09-11T22:14:28.650694+0000","last_undegraded":"2024-09-11T22:14:28.650694+0000","last_fullsized":"2024-09-11T22:14:28.650694+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:53.962348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650807+0000","last_change":"2024-09-11T22:14:26.970469+0000","last_active":"2024-09-11T22:14:28.650807+0000","last_peered":"2024-09-11T22:14:28.650807+0000","last_clean":"2024-09-11T22:14:28.650807+0000","last_became_active":"2024-09-11T22:14:26.970170+0000","last_became_peered":"2024-09-11T22:14:26.970170+0000","last_unstale":"2024-09-11T22:14:28.650807+0000","last_undegraded":"2024-09-11T22:14:28.650807+0000","last_fullsized":"2024-09-11T22:14:28.650807+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:37.142401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956978+0000","last_change":"2024-09-11T22:14:26.961258+0000","last_active":"2024-09-11T22:14:27.956978+0000","last_peered":"2024-09-11T22:14:27.956978+0000","last_clean":"2024-09-11T22:14:27.956978+0000","last_became_active":"2024-09-11T22:14:26.960960+0000","last_became_peered":"2024-09-11T22:14:26.960960+0000","last_unstale":"2024-09-11T22:14:27.956978+0000","last_undegraded":"2024-09-11T22:14:27.956978+0000","last_fullsized":"2024-09-11T22:14:27.956978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:43.123466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045219+0000","last_change":"2024-09-11T22:14:26.955986+0000","last_active":"2024-09-11T22:14:28.045219+0000","last_peered":"2024-09-11T22:14:28.045219+0000","last_clean":"2024-09-11T22:14:28.045219+0000","last_became_active":"2024-09-11T22:14:26.955724+0000","last_became_peered":"2024-09-11T22:14:26.955724+0000","last_unstale":"2024-09-11T22:14:28.045219+0000","last_undegraded":"2024-09-11T22:14:28.045219+0000","last_fullsized":"2024-09-11T22:14:28.045219+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:24.565886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956239+0000","last_change":"2024-09-11T22:14:26.959090+0000","last_active":"2024-09-11T22:14:27.956239+0000","last_peered":"2024-09-11T22:14:27.956239+0000","last_clean":"2024-09-11T22:14:27.956239+0000","last_became_active":"2024-09-11T22:14:26.958825+0000","last_became_peered":"2024-09-11T22:14:26.958825+0000","last_unstale":"2024-09-11T22:14:27.956239+0000","last_undegraded":"2024-09-11T22:14:27.956239+0000","last_fullsized":"2024-09-11T22:14:27.956239+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:45.664163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956876+0000","last_change":"2024-09-11T22:14:26.957998+0000","last_active":"2024-09-11T22:14:27.956876+0000","last_peered":"2024-09-11T22:14:27.956876+0000","last_clean":"2024-09-11T22:14:27.956876+0000","last_became_active":"2024-09-11T22:14:26.957683+0000","last_became_peered":"2024-09-11T22:14:26.957683+0000","last_unstale":"2024-09-11T22:14:27.956876+0000","last_undegraded":"2024-09-11T22:14:27.956876+0000","last_fullsized":"2024-09-11T22:14:27.956876+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.544029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955000+0000","last_change":"2024-09-11T22:14:26.963903+0000","last_active":"2024-09-11T22:14:27.955000+0000","last_peered":"2024-09-11T22:14:27.955000+0000","last_clean":"2024-09-11T22:14:27.955000+0000","last_became_active":"2024-09-11T22:14:26.963640+0000","last_became_peered":"2024-09-11T22:14:26.963640+0000","last_unstale":"2024-09-11T22:14:27.955000+0000","last_undegraded":"2024-09-11T22:14:27.955000+0000","last_fullsized":"2024-09-11T22:14:27.955000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:14.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238138+0000","last_change":"2024-09-11T22:14:26.957389+0000","last_active":"2024-09-11T22:14:29.238138+0000","last_peered":"2024-09-11T22:14:29.238138+0000","last_clean":"2024-09-11T22:14:29.238138+0000","last_became_active":"2024-09-11T22:14:26.957118+0000","last_became_peered":"2024-09-11T22:14:26.957118+0000","last_unstale":"2024-09-11T22:14:29.238138+0000","last_undegraded":"2024-09-11T22:14:29.238138+0000","last_fullsized":"2024-09-11T22:14:29.238138+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:10.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.137983+0000","last_change":"2024-09-11T22:14:26.961999+0000","last_active":"2024-09-11T22:14:29.137983+0000","last_peered":"2024-09-11T22:14:29.137983+0000","last_clean":"2024-09-11T22:14:29.137983+0000","last_became_active":"2024-09-11T22:14:26.961653+0000","last_became_peered":"2024-09-11T22:14:26.961653+0000","last_unstale":"2024-09-11T22:14:29.137983+0000","last_undegraded":"2024-09-11T22:14:29.137983+0000","last_fullsized":"2024-09-11T22:14:29.137983+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:31.911246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:30.338054+0000","last_change":"2024-09-11T22:14:26.954689+0000","last_active":"2024-09-11T22:14:30.338054+0000","last_peered":"2024-09-11T22:14:30.338054+0000","last_clean":"2024-09-11T22:14:30.338054+0000","last_became_active":"2024-09-11T22:14:26.954417+0000","last_became_peered":"2024-09-11T22:14:26.954417+0000","last_unstale":"2024-09-11T22:14:30.338054+0000","last_undegraded":"2024-09-11T22:14:30.338054+0000","last_fullsized":"2024-09-11T22:14:30.338054+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:12.596361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237827+0000","last_change":"2024-09-11T22:14:26.957825+0000","last_active":"2024-09-11T22:14:29.237827+0000","last_peered":"2024-09-11T22:14:29.237827+0000","last_clean":"2024-09-11T22:14:29.237827+0000","last_became_active":"2024-09-11T22:14:26.957559+0000","last_became_peered":"2024-09-11T22:14:26.957559+0000","last_unstale":"2024-09-11T22:14:29.237827+0000","last_undegraded":"2024-09-11T22:14:29.237827+0000","last_fullsized":"2024-09-11T22:14:29.237827+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:23.772181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.137915+0000","last_change":"2024-09-11T22:14:26.962434+0000","last_active":"2024-09-11T22:14:29.137915+0000","last_peered":"2024-09-11T22:14:29.137915+0000","last_clean":"2024-09-11T22:14:29.137915+0000","last_became_active":"2024-09-11T22:14:26.962132+0000","last_became_peered":"2024-09-11T22:14:26.962132+0000","last_unstale":"2024-09-11T22:14:29.137915+0000","last_undegraded":"2024-09-11T22:14:29.137915+0000","last_fullsized":"2024-09-11T22:14:29.137915+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:30.043438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237709+0000","last_change":"2024-09-11T22:14:26.970102+0000","last_active":"2024-09-11T22:14:29.237709+0000","last_peered":"2024-09-11T22:14:29.237709+0000","last_clean":"2024-09-11T22:14:29.237709+0000","last_became_active":"2024-09-11T22:14:26.968725+0000","last_became_peered":"2024-09-11T22:14:26.968725+0000","last_unstale":"2024-09-11T22:14:29.237709+0000","last_undegraded":"2024-09-11T22:14:29.237709+0000","last_fullsized":"2024-09-11T22:14:29.237709+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:54.820323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.137548+0000","last_change":"2024-09-11T22:14:26.972685+0000","last_active":"2024-09-11T22:14:29.137548+0000","last_peered":"2024-09-11T22:14:29.137548+0000","last_clean":"2024-09-11T22:14:29.137548+0000","last_became_active":"2024-09-11T22:14:26.972444+0000","last_became_peered":"2024-09-11T22:14:26.972444+0000","last_unstale":"2024-09-11T22:14:29.137548+0000","last_undegraded":"2024-09-11T22:14:29.137548+0000","last_fullsized":"2024-09-11T22:14:29.137548+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:54.259421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045202+0000","last_change":"2024-09-11T22:14:26.953324+0000","last_active":"2024-09-11T22:14:28.045202+0000","last_peered":"2024-09-11T22:14:28.045202+0000","last_clean":"2024-09-11T22:14:28.045202+0000","last_became_active":"2024-09-11T22:14:26.951702+0000","last_became_peered":"2024-09-11T22:14:26.951702+0000","last_unstale":"2024-09-11T22:14:28.045202+0000","last_undegraded":"2024-09-11T22:14:28.045202+0000","last_fullsized":"2024-09-11T22:14:28.045202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:45.699757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:30.338312+0000","last_change":"2024-09-11T22:14:26.959173+0000","last_active":"2024-09-11T22:14:30.338312+0000","last_peered":"2024-09-11T22:14:30.338312+0000","last_clean":"2024-09-11T22:14:30.338312+0000","last_became_active":"2024-09-11T22:14:26.958857+0000","last_became_peered":"2024-09-11T22:14:26.958857+0000","last_unstale":"2024-09-11T22:14:30.338312+0000","last_undegraded":"2024-09-11T22:14:30.338312+0000","last_fullsized":"2024-09-11T22:14:30.338312+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:42.898486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957209+0000","last_change":"2024-09-11T22:14:26.966619+0000","last_active":"2024-09-11T22:14:27.957209+0000","last_peered":"2024-09-11T22:14:27.957209+0000","last_clean":"2024-09-11T22:14:27.957209+0000","last_became_active":"2024-09-11T22:14:26.966166+0000","last_became_peered":"2024-09-11T22:14:26.966166+0000","last_unstale":"2024-09-11T22:14:27.957209+0000","last_undegraded":"2024-09-11T22:14:27.957209+0000","last_fullsized":"2024-09-11T22:14:27.957209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:48.700476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955344+0000","last_change":"2024-09-11T22:14:26.959657+0000","last_active":"2024-09-11T22:14:27.955344+0000","last_peered":"2024-09-11T22:14:27.955344+0000","last_clean":"2024-09-11T22:14:27.955344+0000","last_became_active":"2024-09-11T22:14:26.957995+0000","last_became_peered":"2024-09-11T22:14:26.957995+0000","last_unstale":"2024-09-11T22:14:27.955344+0000","last_undegraded":"2024-09-11T22:14:27.955344+0000","last_fullsized":"2024-09-11T22:14:27.955344+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:45.625414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:30.338125+0000","last_change":"2024-09-11T22:14:26.962578+0000","last_active":"2024-09-11T22:14:30.338125+0000","last_peered":"2024-09-11T22:14:30.338125+0000","last_clean":"2024-09-11T22:14:30.338125+0000","last_became_active":"2024-09-11T22:14:26.962313+0000","last_became_peered":"2024-09-11T22:14:26.962313+0000","last_unstale":"2024-09-11T22:14:30.338125+0000","last_undegraded":"2024-09-11T22:14:30.338125+0000","last_fullsized":"2024-09-11T22:14:30.338125+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:39.241285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238020+0000","last_change":"2024-09-11T22:14:26.965288+0000","last_active":"2024-09-11T22:14:29.238020+0000","last_peered":"2024-09-11T22:14:29.238020+0000","last_clean":"2024-09-11T22:14:29.238020+0000","last_became_active":"2024-09-11T22:14:26.963346+0000","last_became_peered":"2024-09-11T22:14:26.963346+0000","last_unstale":"2024-09-11T22:14:29.238020+0000","last_undegraded":"2024-09-11T22:14:29.238020+0000","last_fullsized":"2024-09-11T22:14:29.238020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:36.369029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.137611+0000","last_change":"2024-09-11T22:14:26.959933+0000","last_active":"2024-09-11T22:14:29.137611+0000","last_peered":"2024-09-11T22:14:29.137611+0000","last_clean":"2024-09-11T22:14:29.137611+0000","last_became_active":"2024-09-11T22:14:26.959673+0000","last_became_peered":"2024-09-11T22:14:26.959673+0000","last_unstale":"2024-09-11T22:14:29.137611+0000","last_undegraded":"2024-09-11T22:14:29.137611+0000","last_fullsized":"2024-09-11T22:14:29.137611+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:44.394171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:30.337915+0000","last_change":"2024-09-11T22:14:26.958462+0000","last_active":"2024-09-11T22:14:30.337915+0000","last_peered":"2024-09-11T22:14:30.337915+0000","last_clean":"2024-09-11T22:14:30.337915+0000","last_became_active":"2024-09-11T22:14:26.958143+0000","last_became_peered":"2024-09-11T22:14:26.958143+0000","last_unstale":"2024-09-11T22:14:30.337915+0000","last_undegraded":"2024-09-11T22:14:30.337915+0000","last_fullsized":"2024-09-11T22:14:30.337915+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:26.230634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955340+0000","last_change":"2024-09-11T22:14:26.957135+0000","last_active":"2024-09-11T22:14:27.955340+0000","last_peered":"2024-09-11T22:14:27.955340+0000","last_clean":"2024-09-11T22:14:27.955340+0000","last_became_active":"2024-09-11T22:14:26.956870+0000","last_became_peered":"2024-09-11T22:14:26.956870+0000","last_unstale":"2024-09-11T22:14:27.955340+0000","last_undegraded":"2024-09-11T22:14:27.955340+0000","last_fullsized":"2024-09-11T22:14:27.955340+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:17.912234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955540+0000","last_change":"2024-09-11T22:14:26.962072+0000","last_active":"2024-09-11T22:14:27.955540+0000","last_peered":"2024-09-11T22:14:27.955540+0000","last_clean":"2024-09-11T22:14:27.955540+0000","last_became_active":"2024-09-11T22:14:26.961817+0000","last_became_peered":"2024-09-11T22:14:26.961817+0000","last_unstale":"2024-09-11T22:14:27.955540+0000","last_undegraded":"2024-09-11T22:14:27.955540+0000","last_fullsized":"2024-09-11T22:14:27.955540+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:14.514452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955612+0000","last_change":"2024-09-11T22:14:25.952024+0000","last_active":"2024-09-11T22:14:27.955612+0000","last_peered":"2024-09-11T22:14:27.955612+0000","last_clean":"2024-09-11T22:14:27.955612+0000","last_became_active":"2024-09-11T22:14:25.951739+0000","last_became_peered":"2024-09-11T22:14:25.951739+0000","last_unstale":"2024-09-11T22:14:27.955612+0000","last_undegraded":"2024-09-11T22:14:27.955612+0000","last_fullsized":"2024-09-11T22:14:27.955612+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:36.134800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650758+0000","last_change":"2024-09-11T22:14:26.964714+0000","last_active":"2024-09-11T22:14:28.650758+0000","last_peered":"2024-09-11T22:14:28.650758+0000","last_clean":"2024-09-11T22:14:28.650758+0000","last_became_active":"2024-09-11T22:14:26.964485+0000","last_became_peered":"2024-09-11T22:14:26.964485+0000","last_unstale":"2024-09-11T22:14:28.650758+0000","last_undegraded":"2024-09-11T22:14:28.650758+0000","last_fullsized":"2024-09-11T22:14:28.650758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:41.146664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238072+0000","last_change":"2024-09-11T22:14:25.956149+0000","last_active":"2024-09-11T22:14:29.238072+0000","last_peered":"2024-09-11T22:14:29.238072+0000","last_clean":"2024-09-11T22:14:29.238072+0000","last_became_active":"2024-09-11T22:14:25.955403+0000","last_became_peered":"2024-09-11T22:14:25.955403+0000","last_unstale":"2024-09-11T22:14:29.238072+0000","last_undegraded":"2024-09-11T22:14:29.238072+0000","last_fullsized":"2024-09-11T22:14:29.238072+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:15.536125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955173+0000","last_change":"2024-09-11T22:14:26.964943+0000","last_active":"2024-09-11T22:14:27.955173+0000","last_peered":"2024-09-11T22:14:27.955173+0000","last_clean":"2024-09-11T22:14:27.955173+0000","last_became_active":"2024-09-11T22:14:26.964416+0000","last_became_peered":"2024-09-11T22:14:26.964416+0000","last_unstale":"2024-09-11T22:14:27.955173+0000","last_undegraded":"2024-09-11T22:14:27.955173+0000","last_fullsized":"2024-09-11T22:14:27.955173+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:36.926975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955571+0000","last_change":"2024-09-11T22:14:25.960586+0000","last_active":"2024-09-11T22:14:27.955571+0000","last_peered":"2024-09-11T22:14:27.955571+0000","last_clean":"2024-09-11T22:14:27.955571+0000","last_became_active":"2024-09-11T22:14:25.960280+0000","last_became_peered":"2024-09-11T22:14:25.960280+0000","last_unstale":"2024-09-11T22:14:27.955571+0000","last_undegraded":"2024-09-11T22:14:27.955571+0000","last_fullsized":"2024-09-11T22:14:27.955571+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:40.139062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955425+0000","last_change":"2024-09-11T22:14:26.961155+0000","last_active":"2024-09-11T22:14:27.955425+0000","last_peered":"2024-09-11T22:14:27.955425+0000","last_clean":"2024-09-11T22:14:27.955425+0000","last_became_active":"2024-09-11T22:14:26.960654+0000","last_became_peered":"2024-09-11T22:14:26.960654+0000","last_unstale":"2024-09-11T22:14:27.955425+0000","last_undegraded":"2024-09-11T22:14:27.955425+0000","last_fullsized":"2024-09-11T22:14:27.955425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957272+0000","last_change":"2024-09-11T22:14:25.954648+0000","last_active":"2024-09-11T22:14:27.957272+0000","last_peered":"2024-09-11T22:14:27.957272+0000","last_clean":"2024-09-11T22:14:27.957272+0000","last_became_active":"2024-09-11T22:14:25.954334+0000","last_became_peered":"2024-09-11T22:14:25.954334+0000","last_unstale":"2024-09-11T22:14:27.957272+0000","last_undegraded":"2024-09-11T22:14:27.957272+0000","last_fullsized":"2024-09-11T22:14:27.957272+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:12.136592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238149+0000","last_change":"2024-09-11T22:14:26.969858+0000","last_active":"2024-09-11T22:14:29.238149+0000","last_peered":"2024-09-11T22:14:29.238149+0000","last_clean":"2024-09-11T22:14:29.238149+0000","last_became_active":"2024-09-11T22:14:26.968413+0000","last_became_peered":"2024-09-11T22:14:26.968413+0000","last_unstale":"2024-09-11T22:14:29.238149+0000","last_undegraded":"2024-09-11T22:14:29.238149+0000","last_fullsized":"2024-09-11T22:14:29.238149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:26.978341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955958+0000","last_change":"2024-09-11T22:14:25.950287+0000","last_active":"2024-09-11T22:14:27.955958+0000","last_peered":"2024-09-11T22:14:27.955958+0000","last_clean":"2024-09-11T22:14:27.955958+0000","last_became_active":"2024-09-11T22:14:25.950020+0000","last_became_peered":"2024-09-11T22:14:25.950020+0000","last_unstale":"2024-09-11T22:14:27.955958+0000","last_undegraded":"2024-09-11T22:14:27.955958+0000","last_fullsized":"2024-09-11T22:14:27.955958+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:31.695327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238193+0000","last_change":"2024-09-11T22:14:26.957412+0000","last_active":"2024-09-11T22:14:29.238193+0000","last_peered":"2024-09-11T22:14:29.238193+0000","last_clean":"2024-09-11T22:14:29.238193+0000","last_became_active":"2024-09-11T22:14:26.957003+0000","last_became_peered":"2024-09-11T22:14:26.957003+0000","last_unstale":"2024-09-11T22:14:29.238193+0000","last_undegraded":"2024-09-11T22:14:29.238193+0000","last_fullsized":"2024-09-11T22:14:29.238193+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:00.215569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955193+0000","last_change":"2024-09-11T22:14:25.956470+0000","last_active":"2024-09-11T22:14:27.955193+0000","last_peered":"2024-09-11T22:14:27.955193+0000","last_clean":"2024-09-11T22:14:27.955193+0000","last_became_active":"2024-09-11T22:14:25.956032+0000","last_became_peered":"2024-09-11T22:14:25.956032+0000","last_unstale":"2024-09-11T22:14:27.955193+0000","last_undegraded":"2024-09-11T22:14:27.955193+0000","last_fullsized":"2024-09-11T22:14:27.955193+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:17.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045221+0000","last_change":"2024-09-11T22:14:26.957303+0000","last_active":"2024-09-11T22:14:28.045221+0000","last_peered":"2024-09-11T22:14:28.045221+0000","last_clean":"2024-09-11T22:14:28.045221+0000","last_became_active":"2024-09-11T22:14:26.957049+0000","last_became_peered":"2024-09-11T22:14:26.957049+0000","last_unstale":"2024-09-11T22:14:28.045221+0000","last_undegraded":"2024-09-11T22:14:28.045221+0000","last_fullsized":"2024-09-11T22:14:28.045221+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:54.823432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957147+0000","last_change":"2024-09-11T22:14:25.950524+0000","last_active":"2024-09-11T22:14:27.957147+0000","last_peered":"2024-09-11T22:14:27.957147+0000","last_clean":"2024-09-11T22:14:27.957147+0000","last_became_active":"2024-09-11T22:14:25.950266+0000","last_became_peered":"2024-09-11T22:14:25.950266+0000","last_unstale":"2024-09-11T22:14:27.957147+0000","last_undegraded":"2024-09-11T22:14:27.957147+0000","last_fullsized":"2024-09-11T22:14:27.957147+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:46.536428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237812+0000","last_change":"2024-09-11T22:14:26.959688+0000","last_active":"2024-09-11T22:14:29.237812+0000","last_peered":"2024-09-11T22:14:29.237812+0000","last_clean":"2024-09-11T22:14:29.237812+0000","last_became_active":"2024-09-11T22:14:26.958964+0000","last_became_peered":"2024-09-11T22:14:26.958964+0000","last_unstale":"2024-09-11T22:14:29.237812+0000","last_undegraded":"2024-09-11T22:14:29.237812+0000","last_fullsized":"2024-09-11T22:14:29.237812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:40.951930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956044+0000","last_change":"2024-09-11T22:14:25.957377+0000","last_active":"2024-09-11T22:14:27.956044+0000","last_peered":"2024-09-11T22:14:27.956044+0000","last_clean":"2024-09-11T22:14:27.956044+0000","last_became_active":"2024-09-11T22:14:25.957103+0000","last_became_peered":"2024-09-11T22:14:25.957103+0000","last_unstale":"2024-09-11T22:14:27.956044+0000","last_undegraded":"2024-09-11T22:14:27.956044+0000","last_fullsized":"2024-09-11T22:14:27.956044+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:17.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956917+0000","last_change":"2024-09-11T22:14:26.969252+0000","last_active":"2024-09-11T22:14:27.956917+0000","last_peered":"2024-09-11T22:14:27.956917+0000","last_clean":"2024-09-11T22:14:27.956917+0000","last_became_active":"2024-09-11T22:14:26.968962+0000","last_became_peered":"2024-09-11T22:14:26.968962+0000","last_unstale":"2024-09-11T22:14:27.956917+0000","last_undegraded":"2024-09-11T22:14:27.956917+0000","last_fullsized":"2024-09-11T22:14:27.956917+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:34.920148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.138007+0000","last_change":"2024-09-11T22:14:25.955890+0000","last_active":"2024-09-11T22:14:29.138007+0000","last_peered":"2024-09-11T22:14:29.138007+0000","last_clean":"2024-09-11T22:14:29.138007+0000","last_became_active":"2024-09-11T22:14:25.955601+0000","last_became_peered":"2024-09-11T22:14:25.955601+0000","last_unstale":"2024-09-11T22:14:29.138007+0000","last_undegraded":"2024-09-11T22:14:29.138007+0000","last_fullsized":"2024-09-11T22:14:29.138007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:25.167921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.138092+0000","last_change":"2024-09-11T22:14:26.967750+0000","last_active":"2024-09-11T22:14:29.138092+0000","last_peered":"2024-09-11T22:14:29.138092+0000","last_clean":"2024-09-11T22:14:29.138092+0000","last_became_active":"2024-09-11T22:14:26.967492+0000","last_became_peered":"2024-09-11T22:14:26.967492+0000","last_unstale":"2024-09-11T22:14:29.138092+0000","last_undegraded":"2024-09-11T22:14:29.138092+0000","last_fullsized":"2024-09-11T22:14:29.138092+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:29.965488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238185+0000","last_change":"2024-09-11T22:14:25.951977+0000","last_active":"2024-09-11T22:14:29.238185+0000","last_peered":"2024-09-11T22:14:29.238185+0000","last_clean":"2024-09-11T22:14:29.238185+0000","last_became_active":"2024-09-11T22:14:25.951186+0000","last_became_peered":"2024-09-11T22:14:25.951186+0000","last_unstale":"2024-09-11T22:14:29.238185+0000","last_undegraded":"2024-09-11T22:14:29.238185+0000","last_fullsized":"2024-09-11T22:14:29.238185+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:42.115865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650581+0000","last_change":"2024-09-11T22:14:26.966320+0000","last_active":"2024-09-11T22:14:28.650581+0000","last_peered":"2024-09-11T22:14:28.650581+0000","last_clean":"2024-09-11T22:14:28.650581+0000","last_became_active":"2024-09-11T22:14:26.966062+0000","last_became_peered":"2024-09-11T22:14:26.966062+0000","last_unstale":"2024-09-11T22:14:28.650581+0000","last_undegraded":"2024-09-11T22:14:28.650581+0000","last_fullsized":"2024-09-11T22:14:28.650581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:18.648523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.138131+0000","last_change":"2024-09-11T22:14:25.958570+0000","last_active":"2024-09-11T22:14:29.138131+0000","last_peered":"2024-09-11T22:14:29.138131+0000","last_clean":"2024-09-11T22:14:29.138131+0000","last_became_active":"2024-09-11T22:14:25.958356+0000","last_became_peered":"2024-09-11T22:14:25.958356+0000","last_unstale":"2024-09-11T22:14:29.138131+0000","last_undegraded":"2024-09-11T22:14:29.138131+0000","last_fullsized":"2024-09-11T22:14:29.138131+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:29.549649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.137811+0000","last_change":"2024-09-11T22:14:26.968253+0000","last_active":"2024-09-11T22:14:29.137811+0000","last_peered":"2024-09-11T22:14:29.137811+0000","last_clean":"2024-09-11T22:14:29.137811+0000","last_became_active":"2024-09-11T22:14:26.967949+0000","last_became_peered":"2024-09-11T22:14:26.967949+0000","last_unstale":"2024-09-11T22:14:29.137811+0000","last_undegraded":"2024-09-11T22:14:29.137811+0000","last_fullsized":"2024-09-11T22:14:29.137811+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:22.151306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956950+0000","last_change":"2024-09-11T22:14:25.956145+0000","last_active":"2024-09-11T22:14:27.956950+0000","last_peered":"2024-09-11T22:14:27.956950+0000","last_clean":"2024-09-11T22:14:27.956950+0000","last_became_active":"2024-09-11T22:14:25.955833+0000","last_became_peered":"2024-09-11T22:14:25.955833+0000","last_unstale":"2024-09-11T22:14:27.956950+0000","last_undegraded":"2024-09-11T22:14:27.956950+0000","last_fullsized":"2024-09-11T22:14:27.956950+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:34.327331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956077+0000","last_change":"2024-09-11T22:14:26.959737+0000","last_active":"2024-09-11T22:14:27.956077+0000","last_peered":"2024-09-11T22:14:27.956077+0000","last_clean":"2024-09-11T22:14:27.956077+0000","last_became_active":"2024-09-11T22:14:26.959509+0000","last_became_peered":"2024-09-11T22:14:26.959509+0000","last_unstale":"2024-09-11T22:14:27.956077+0000","last_undegraded":"2024-09-11T22:14:27.956077+0000","last_fullsized":"2024-09-11T22:14:27.956077+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.261913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237856+0000","last_change":"2024-09-11T22:14:25.959102+0000","last_active":"2024-09-11T22:14:29.237856+0000","last_peered":"2024-09-11T22:14:29.237856+0000","last_clean":"2024-09-11T22:14:29.237856+0000","last_became_active":"2024-09-11T22:14:25.956666+0000","last_became_peered":"2024-09-11T22:14:25.956666+0000","last_unstale":"2024-09-11T22:14:29.237856+0000","last_undegraded":"2024-09-11T22:14:29.237856+0000","last_fullsized":"2024-09-11T22:14:29.237856+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:13.506850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.137746+0000","last_change":"2024-09-11T22:14:26.960877+0000","last_active":"2024-09-11T22:14:29.137746+0000","last_peered":"2024-09-11T22:14:29.137746+0000","last_clean":"2024-09-11T22:14:29.137746+0000","last_became_active":"2024-09-11T22:14:26.960545+0000","last_became_peered":"2024-09-11T22:14:26.960545+0000","last_unstale":"2024-09-11T22:14:29.137746+0000","last_undegraded":"2024-09-11T22:14:29.137746+0000","last_fullsized":"2024-09-11T22:14:29.137746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:47.096258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045066+0000","last_change":"2024-09-11T22:14:25.954749+0000","last_active":"2024-09-11T22:14:28.045066+0000","last_peered":"2024-09-11T22:14:28.045066+0000","last_clean":"2024-09-11T22:14:28.045066+0000","last_became_active":"2024-09-11T22:14:25.954401+0000","last_became_peered":"2024-09-11T22:14:25.954401+0000","last_unstale":"2024-09-11T22:14:28.045066+0000","last_undegraded":"2024-09-11T22:14:28.045066+0000","last_fullsized":"2024-09-11T22:14:28.045066+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:44.892896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955926+0000","last_change":"2024-09-11T22:14:26.963837+0000","last_active":"2024-09-11T22:14:27.955926+0000","last_peered":"2024-09-11T22:14:27.955926+0000","last_clean":"2024-09-11T22:14:27.955926+0000","last_became_active":"2024-09-11T22:14:26.963576+0000","last_became_peered":"2024-09-11T22:14:26.963576+0000","last_unstale":"2024-09-11T22:14:27.955926+0000","last_undegraded":"2024-09-11T22:14:27.955926+0000","last_fullsized":"2024-09-11T22:14:27.955926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:11.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957202+0000","last_change":"2024-09-11T22:14:25.951651+0000","last_active":"2024-09-11T22:14:27.957202+0000","last_peered":"2024-09-11T22:14:27.957202+0000","last_clean":"2024-09-11T22:14:27.957202+0000","last_became_active":"2024-09-11T22:14:25.951299+0000","last_became_peered":"2024-09-11T22:14:25.951299+0000","last_unstale":"2024-09-11T22:14:27.957202+0000","last_undegraded":"2024-09-11T22:14:27.957202+0000","last_fullsized":"2024-09-11T22:14:27.957202+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:33.912546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.137839+0000","last_change":"2024-09-11T22:14:26.972480+0000","last_active":"2024-09-11T22:14:29.137839+0000","last_peered":"2024-09-11T22:14:29.137839+0000","last_clean":"2024-09-11T22:14:29.137839+0000","last_became_active":"2024-09-11T22:14:26.972332+0000","last_became_peered":"2024-09-11T22:14:26.972332+0000","last_unstale":"2024-09-11T22:14:29.137839+0000","last_undegraded":"2024-09-11T22:14:29.137839+0000","last_fullsized":"2024-09-11T22:14:29.137839+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:48.868986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":22,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.137461+0000","last_change":"2024-09-11T22:14:25.956614+0000","last_active":"2024-09-11T22:14:29.137461+0000","last_peered":"2024-09-11T22:14:29.137461+0000","last_clean":"2024-09-11T22:14:29.137461+0000","last_became_active":"2024-09-11T22:14:25.956306+0000","last_became_peered":"2024-09-11T22:14:25.956306+0000","last_unstale":"2024-09-11T22:14:29.137461+0000","last_undegraded":"2024-09-11T22:14:29.137461+0000","last_fullsized":"2024-09-11T22:14:29.137461+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:39.705969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.137989+0000","last_change":"2024-09-11T22:14:26.966426+0000","last_active":"2024-09-11T22:14:29.137989+0000","last_peered":"2024-09-11T22:14:29.137989+0000","last_clean":"2024-09-11T22:14:29.137989+0000","last_became_active":"2024-09-11T22:14:26.966157+0000","last_became_peered":"2024-09-11T22:14:26.966157+0000","last_unstale":"2024-09-11T22:14:29.137989+0000","last_undegraded":"2024-09-11T22:14:29.137989+0000","last_fullsized":"2024-09-11T22:14:29.137989+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:53.154202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238251+0000","last_change":"2024-09-11T22:14:25.960512+0000","last_active":"2024-09-11T22:14:29.238251+0000","last_peered":"2024-09-11T22:14:29.238251+0000","last_clean":"2024-09-11T22:14:29.238251+0000","last_became_active":"2024-09-11T22:14:25.960249+0000","last_became_peered":"2024-09-11T22:14:25.960249+0000","last_unstale":"2024-09-11T22:14:29.238251+0000","last_undegraded":"2024-09-11T22:14:29.238251+0000","last_fullsized":"2024-09-11T22:14:29.238251+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:12.252400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956341+0000","last_change":"2024-09-11T22:14:26.960080+0000","last_active":"2024-09-11T22:14:27.956341+0000","last_peered":"2024-09-11T22:14:27.956341+0000","last_clean":"2024-09-11T22:14:27.956341+0000","last_became_active":"2024-09-11T22:14:26.959778+0000","last_became_peered":"2024-09-11T22:14:26.959778+0000","last_unstale":"2024-09-11T22:14:27.956341+0000","last_undegraded":"2024-09-11T22:14:27.956341+0000","last_fullsized":"2024-09-11T22:14:27.956341+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:14.514452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955559+0000","last_change":"2024-09-11T22:14:25.953232+0000","last_active":"2024-09-11T22:14:27.955559+0000","last_peered":"2024-09-11T22:14:27.955559+0000","last_clean":"2024-09-11T22:14:27.955559+0000","last_became_active":"2024-09-11T22:14:25.952951+0000","last_became_peered":"2024-09-11T22:14:25.952951+0000","last_unstale":"2024-09-11T22:14:27.955559+0000","last_undegraded":"2024-09-11T22:14:27.955559+0000","last_fullsized":"2024-09-11T22:14:27.955559+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:31.695327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237924+0000","last_change":"2024-09-11T22:14:26.965790+0000","last_active":"2024-09-11T22:14:29.237924+0000","last_peered":"2024-09-11T22:14:29.237924+0000","last_clean":"2024-09-11T22:14:29.237924+0000","last_became_active":"2024-09-11T22:14:26.965502+0000","last_became_peered":"2024-09-11T22:14:26.965502+0000","last_unstale":"2024-09-11T22:14:29.237924+0000","last_undegraded":"2024-09-11T22:14:29.237924+0000","last_fullsized":"2024-09-11T22:14:29.237924+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:51.944511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956610+0000","last_change":"2024-09-11T22:14:25.951206+0000","last_active":"2024-09-11T22:14:27.956610+0000","last_peered":"2024-09-11T22:14:27.956610+0000","last_clean":"2024-09-11T22:14:27.956610+0000","last_became_active":"2024-09-11T22:14:25.950899+0000","last_became_peered":"2024-09-11T22:14:25.950899+0000","last_unstale":"2024-09-11T22:14:27.956610+0000","last_undegraded":"2024-09-11T22:14:27.956610+0000","last_fullsized":"2024-09-11T22:14:27.956610+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:44.656561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.138010+0000","last_change":"2024-09-11T22:14:26.968273+0000","last_active":"2024-09-11T22:14:29.138010+0000","last_peered":"2024-09-11T22:14:29.138010+0000","last_clean":"2024-09-11T22:14:29.138010+0000","last_became_active":"2024-09-11T22:14:26.967984+0000","last_became_peered":"2024-09-11T22:14:26.967984+0000","last_unstale":"2024-09-11T22:14:29.138010+0000","last_undegraded":"2024-09-11T22:14:29.138010+0000","last_fullsized":"2024-09-11T22:14:29.138010+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:50.045051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955266+0000","last_change":"2024-09-11T22:14:25.958361+0000","last_active":"2024-09-11T22:14:27.955266+0000","last_peered":"2024-09-11T22:14:27.955266+0000","last_clean":"2024-09-11T22:14:27.955266+0000","last_became_active":"2024-09-11T22:14:25.957879+0000","last_became_peered":"2024-09-11T22:14:25.957879+0000","last_unstale":"2024-09-11T22:14:27.955266+0000","last_undegraded":"2024-09-11T22:14:27.955266+0000","last_fullsized":"2024-09-11T22:14:27.955266+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:52.954746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956243+0000","last_change":"2024-09-11T22:14:26.959870+0000","last_active":"2024-09-11T22:14:27.956243+0000","last_peered":"2024-09-11T22:14:27.956243+0000","last_clean":"2024-09-11T22:14:27.956243+0000","last_became_active":"2024-09-11T22:14:26.957903+0000","last_became_peered":"2024-09-11T22:14:26.957903+0000","last_unstale":"2024-09-11T22:14:27.956243+0000","last_undegraded":"2024-09-11T22:14:27.956243+0000","last_fullsized":"2024-09-11T22:14:27.956243+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:16.543726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.238146+0000","last_change":"2024-09-11T22:14:25.958591+0000","last_active":"2024-09-11T22:14:29.238146+0000","last_peered":"2024-09-11T22:14:29.238146+0000","last_clean":"2024-09-11T22:14:29.238146+0000","last_became_active":"2024-09-11T22:14:25.958303+0000","last_became_peered":"2024-09-11T22:14:25.958303+0000","last_unstale":"2024-09-11T22:14:29.238146+0000","last_undegraded":"2024-09-11T22:14:29.238146+0000","last_fullsized":"2024-09-11T22:14:29.238146+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:24.724328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955309+0000","last_change":"2024-09-11T22:14:26.957372+0000","last_active":"2024-09-11T22:14:27.955309+0000","last_peered":"2024-09-11T22:14:27.955309+0000","last_clean":"2024-09-11T22:14:27.955309+0000","last_became_active":"2024-09-11T22:14:26.956741+0000","last_became_peered":"2024-09-11T22:14:26.956741+0000","last_unstale":"2024-09-11T22:14:27.955309+0000","last_undegraded":"2024-09-11T22:14:27.955309+0000","last_fullsized":"2024-09-11T22:14:27.955309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.496550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650503+0000","last_change":"2024-09-11T22:14:25.954496+0000","last_active":"2024-09-11T22:14:28.650503+0000","last_peered":"2024-09-11T22:14:28.650503+0000","last_clean":"2024-09-11T22:14:28.650503+0000","last_became_active":"2024-09-11T22:14:25.954243+0000","last_became_peered":"2024-09-11T22:14:25.954243+0000","last_unstale":"2024-09-11T22:14:28.650503+0000","last_undegraded":"2024-09-11T22:14:28.650503+0000","last_fullsized":"2024-09-11T22:14:28.650503+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:39.537090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955070+0000","last_change":"2024-09-11T22:14:26.958126+0000","last_active":"2024-09-11T22:14:27.955070+0000","last_peered":"2024-09-11T22:14:27.955070+0000","last_clean":"2024-09-11T22:14:27.955070+0000","last_became_active":"2024-09-11T22:14:26.957849+0000","last_became_peered":"2024-09-11T22:14:26.957849+0000","last_unstale":"2024-09-11T22:14:27.955070+0000","last_undegraded":"2024-09-11T22:14:27.955070+0000","last_fullsized":"2024-09-11T22:14:27.955070+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:46.007324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955914+0000","last_change":"2024-09-11T22:14:25.957351+0000","last_active":"2024-09-11T22:14:27.955914+0000","last_peered":"2024-09-11T22:14:27.955914+0000","last_clean":"2024-09-11T22:14:27.955914+0000","last_became_active":"2024-09-11T22:14:25.957078+0000","last_became_peered":"2024-09-11T22:14:25.957078+0000","last_unstale":"2024-09-11T22:14:27.955914+0000","last_undegraded":"2024-09-11T22:14:27.955914+0000","last_fullsized":"2024-09-11T22:14:27.955914+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:10.280169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957199+0000","last_change":"2024-09-11T22:14:26.959295+0000","last_active":"2024-09-11T22:14:27.957199+0000","last_peered":"2024-09-11T22:14:27.957199+0000","last_clean":"2024-09-11T22:14:27.957199+0000","last_became_active":"2024-09-11T22:14:26.958326+0000","last_became_peered":"2024-09-11T22:14:26.958326+0000","last_unstale":"2024-09-11T22:14:27.957199+0000","last_undegraded":"2024-09-11T22:14:27.957199+0000","last_fullsized":"2024-09-11T22:14:27.957199+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:13.260002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650693+0000","last_change":"2024-09-11T22:14:25.957828+0000","last_active":"2024-09-11T22:14:28.650693+0000","last_peered":"2024-09-11T22:14:28.650693+0000","last_clean":"2024-09-11T22:14:28.650693+0000","last_became_active":"2024-09-11T22:14:25.957530+0000","last_became_peered":"2024-09-11T22:14:25.957530+0000","last_unstale":"2024-09-11T22:14:28.650693+0000","last_undegraded":"2024-09-11T22:14:28.650693+0000","last_fullsized":"2024-09-11T22:14:28.650693+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:33.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956558+0000","last_change":"2024-09-11T22:14:26.962695+0000","last_active":"2024-09-11T22:14:27.956558+0000","last_peered":"2024-09-11T22:14:27.956558+0000","last_clean":"2024-09-11T22:14:27.956558+0000","last_became_active":"2024-09-11T22:14:26.962168+0000","last_became_peered":"2024-09-11T22:14:26.962168+0000","last_unstale":"2024-09-11T22:14:27.956558+0000","last_undegraded":"2024-09-11T22:14:27.956558+0000","last_fullsized":"2024-09-11T22:14:27.956558+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:25.731929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.948031+0000","last_change":"2024-09-11T22:14:25.954069+0000","last_active":"2024-09-11T22:14:28.948031+0000","last_peered":"2024-09-11T22:14:28.948031+0000","last_clean":"2024-09-11T22:14:28.948031+0000","last_became_active":"2024-09-11T22:14:25.953797+0000","last_became_peered":"2024-09-11T22:14:25.953797+0000","last_unstale":"2024-09-11T22:14:28.948031+0000","last_undegraded":"2024-09-11T22:14:28.948031+0000","last_fullsized":"2024-09-11T22:14:28.948031+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:34.327331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650617+0000","last_change":"2024-09-11T22:14:26.965457+0000","last_active":"2024-09-11T22:14:28.650617+0000","last_peered":"2024-09-11T22:14:28.650617+0000","last_clean":"2024-09-11T22:14:28.650617+0000","last_became_active":"2024-09-11T22:14:26.965210+0000","last_became_peered":"2024-09-11T22:14:26.965210+0000","last_unstale":"2024-09-11T22:14:28.650617+0000","last_undegraded":"2024-09-11T22:14:28.650617+0000","last_fullsized":"2024-09-11T22:14:28.650617+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:35.334932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045209+0000","last_change":"2024-09-11T22:14:25.954345+0000","last_active":"2024-09-11T22:14:28.045209+0000","last_peered":"2024-09-11T22:14:28.045209+0000","last_clean":"2024-09-11T22:14:28.045209+0000","last_became_active":"2024-09-11T22:14:25.954043+0000","last_became_peered":"2024-09-11T22:14:25.954043+0000","last_unstale":"2024-09-11T22:14:28.045209+0000","last_undegraded":"2024-09-11T22:14:28.045209+0000","last_fullsized":"2024-09-11T22:14:28.045209+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:51.604884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.955489+0000","last_change":"2024-09-11T22:14:26.960931+0000","last_active":"2024-09-11T22:14:27.955489+0000","last_peered":"2024-09-11T22:14:27.955489+0000","last_clean":"2024-09-11T22:14:27.955489+0000","last_became_active":"2024-09-11T22:14:26.960291+0000","last_became_peered":"2024-09-11T22:14:26.960291+0000","last_unstale":"2024-09-11T22:14:27.955489+0000","last_undegraded":"2024-09-11T22:14:27.955489+0000","last_fullsized":"2024-09-11T22:14:27.955489+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:16.543726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.957332+0000","last_change":"2024-09-11T22:14:25.950162+0000","last_active":"2024-09-11T22:14:27.957332+0000","last_peered":"2024-09-11T22:14:27.957332+0000","last_clean":"2024-09-11T22:14:27.957332+0000","last_became_active":"2024-09-11T22:14:25.949856+0000","last_became_peered":"2024-09-11T22:14:25.949856+0000","last_unstale":"2024-09-11T22:14:27.957332+0000","last_undegraded":"2024-09-11T22:14:27.957332+0000","last_fullsized":"2024-09-11T22:14:27.957332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:16.056310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237864+0000","last_change":"2024-09-11T22:14:26.968109+0000","last_active":"2024-09-11T22:14:29.237864+0000","last_peered":"2024-09-11T22:14:29.237864+0000","last_clean":"2024-09-11T22:14:29.237864+0000","last_became_active":"2024-09-11T22:14:26.967838+0000","last_became_peered":"2024-09-11T22:14:26.967838+0000","last_unstale":"2024-09-11T22:14:29.237864+0000","last_undegraded":"2024-09-11T22:14:29.237864+0000","last_fullsized":"2024-09-11T22:14:29.237864+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:44.391169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650403+0000","last_change":"2024-09-11T22:14:25.953604+0000","last_active":"2024-09-11T22:14:28.650403+0000","last_peered":"2024-09-11T22:14:28.650403+0000","last_clean":"2024-09-11T22:14:28.650403+0000","last_became_active":"2024-09-11T22:14:25.953317+0000","last_became_peered":"2024-09-11T22:14:25.953317+0000","last_unstale":"2024-09-11T22:14:28.650403+0000","last_undegraded":"2024-09-11T22:14:28.650403+0000","last_fullsized":"2024-09-11T22:14:28.650403+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:56.831702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.137995+0000","last_change":"2024-09-11T22:14:26.971798+0000","last_active":"2024-09-11T22:14:29.137995+0000","last_peered":"2024-09-11T22:14:29.137995+0000","last_clean":"2024-09-11T22:14:29.137995+0000","last_became_active":"2024-09-11T22:14:26.971548+0000","last_became_peered":"2024-09-11T22:14:26.971548+0000","last_unstale":"2024-09-11T22:14:29.137995+0000","last_undegraded":"2024-09-11T22:14:29.137995+0000","last_fullsized":"2024-09-11T22:14:29.137995+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:52.878059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:27.956340+0000","last_change":"2024-09-11T22:14:25.955614+0000","last_active":"2024-09-11T22:14:27.956340+0000","last_peered":"2024-09-11T22:14:27.956340+0000","last_clean":"2024-09-11T22:14:27.956340+0000","last_became_active":"2024-09-11T22:14:25.955095+0000","last_became_peered":"2024-09-11T22:14:25.955095+0000","last_unstale":"2024-09-11T22:14:27.956340+0000","last_undegraded":"2024-09-11T22:14:27.956340+0000","last_fullsized":"2024-09-11T22:14:27.956340+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:12.454865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650348+0000","last_change":"2024-09-11T22:14:26.963669+0000","last_active":"2024-09-11T22:14:28.650348+0000","last_peered":"2024-09-11T22:14:28.650348+0000","last_clean":"2024-09-11T22:14:28.650348+0000","last_became_active":"2024-09-11T22:14:26.963377+0000","last_became_peered":"2024-09-11T22:14:26.963377+0000","last_unstale":"2024-09-11T22:14:28.650348+0000","last_undegraded":"2024-09-11T22:14:28.650348+0000","last_fullsized":"2024-09-11T22:14:28.650348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:32.702928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.650495+0000","last_change":"2024-09-11T22:14:25.955422+0000","last_active":"2024-09-11T22:14:28.650495+0000","last_peered":"2024-09-11T22:14:28.650495+0000","last_clean":"2024-09-11T22:14:28.650495+0000","last_became_active":"2024-09-11T22:14:25.955133+0000","last_became_peered":"2024-09-11T22:14:25.955133+0000","last_unstale":"2024-09-11T22:14:28.650495+0000","last_undegraded":"2024-09-11T22:14:28.650495+0000","last_fullsized":"2024-09-11T22:14:28.650495+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:47.631686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237726+0000","last_change":"2024-09-11T22:14:26.959240+0000","last_active":"2024-09-11T22:14:29.237726+0000","last_peered":"2024-09-11T22:14:29.237726+0000","last_clean":"2024-09-11T22:14:29.237726+0000","last_became_active":"2024-09-11T22:14:26.958616+0000","last_became_peered":"2024-09-11T22:14:26.958616+0000","last_unstale":"2024-09-11T22:14:29.237726+0000","last_undegraded":"2024-09-11T22:14:29.237726+0000","last_fullsized":"2024-09-11T22:14:29.237726+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:24.318239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237850+0000","last_change":"2024-09-11T22:14:25.958671+0000","last_active":"2024-09-11T22:14:29.237850+0000","last_peered":"2024-09-11T22:14:29.237850+0000","last_clean":"2024-09-11T22:14:29.237850+0000","last_became_active":"2024-09-11T22:14:25.958219+0000","last_became_peered":"2024-09-11T22:14:25.958219+0000","last_unstale":"2024-09-11T22:14:29.237850+0000","last_undegraded":"2024-09-11T22:14:29.237850+0000","last_fullsized":"2024-09-11T22:14:29.237850+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:40.924340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.237952+0000","last_change":"2024-09-11T22:14:26.960588+0000","last_active":"2024-09-11T22:14:29.237952+0000","last_peered":"2024-09-11T22:14:29.237952+0000","last_clean":"2024-09-11T22:14:29.237952+0000","last_became_active":"2024-09-11T22:14:26.959947+0000","last_became_peered":"2024-09-11T22:14:26.959947+0000","last_unstale":"2024-09-11T22:14:29.237952+0000","last_undegraded":"2024-09-11T22:14:29.237952+0000","last_fullsized":"2024-09-11T22:14:29.237952+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:25.934394+0000","last_clean_scrub_stamp":"2024-09-11T22:14:25.934394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:07.334337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:28.045119+0000","last_change":"2024-09-11T22:14:25.954833+0000","last_active":"2024-09-11T22:14:28.045119+0000","last_peered":"2024-09-11T22:14:28.045119+0000","last_clean":"2024-09-11T22:14:28.045119+0000","last_became_active":"2024-09-11T22:14:25.954546+0000","last_became_peered":"2024-09-11T22:14:25.954546+0000","last_unstale":"2024-09-11T22:14:28.045119+0000","last_undegraded":"2024-09-11T22:14:28.045119+0000","last_fullsized":"2024-09-11T22:14:28.045119+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:14:24.926792+0000","last_clean_scrub_stamp":"2024-09-11T22:14:24.926792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:25.578897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":239,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T22:14:29.137486+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:14:29.137486+0000","last_peered":"2024-09-11T22:14:29.137486+0000","last_clean":"2024-09-11T22:14:29.137486+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:14:29.137486+0000","last_undegraded":"2024-09-11T22:14:29.137486+0000","last_fullsized":"2024-09-11T22:14:29.137486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36032,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335808,"statfs":{"total":96636764160,"available":96599867392,"internally_reserved":0,"allocated":700416,"data_stored":292137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36044,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335796,"statfs":{"total":96636764160,"available":96599855104,"internally_reserved":0,"allocated":708608,"data_stored":292789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36048,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335792,"statfs":{"total":96636764160,"available":96599851008,"internally_reserved":0,"allocated":712704,"data_stored":293749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44352,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327488,"statfs":{"total":96636764160,"available":96591347712,"internally_reserved":0,"allocated":696320,"data_stored":285893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":692224,"data_stored":285927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40788,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331052,"statfs":{"total":96636764160,"available":96594997248,"internally_reserved":0,"allocated":1310720,"data_stored":884699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36620,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335220,"statfs":{"total":96636764160,"available":96599265280,"internally_reserved":0,"allocated":1302528,"data_stored":882665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44360,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327480,"statfs":{"total":96636764160,"available":96591339520,"internally_reserved":0,"allocated":708608,"data_stored":292193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:14:34.693 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:14:34.694 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T22:14:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.838+0000 7fac288a6640 1 Processor -- start 2024-09-11T22:14:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.838+0000 7fac288a6640 1 -- start start 2024-09-11T22:14:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.839+0000 7fac288a6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac240cf580 0x7fac240b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.839+0000 7fac288a6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac240ce5f0 con 0x7fac240cdd50 2024-09-11T22:14:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.839+0000 7fac288a6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac240ce310 con 0x7fac2415e840 2024-09-11T22:14:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.839+0000 7fac288a6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fac2406c240 con 0x7fac240cf580 2024-09-11T22:14:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.839+0000 7fac21d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac240cf580 0x7fac240b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.839+0000 7fac21d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac240cf580 0x7fac240b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50436/0 (socket says 172.21.15.50:50436) 2024-09-11T22:14:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.839+0000 7fac22d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fac240cdd50 0x7fac2406c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48948/0 (socket says 172.21.15.50:48948) 2024-09-11T22:14:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.839+0000 7fac21d9b640 1 -- 172.21.15.50:0/3825899231 learned_addr learned my addr 172.21.15.50:0/3825899231 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.839+0000 7fac21d9b640 1 -- 172.21.15.50:0/3825899231 >> v1:172.21.15.77:6789/0 conn(0x7fac2415e840 legacy=0x7fac240cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.839+0000 7fac21d9b640 1 -- 172.21.15.50:0/3825899231 >> v1:172.21.15.50:6789/0 conn(0x7fac240cdd50 legacy=0x7fac2406c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.839+0000 7fac21d9b640 1 -- 172.21.15.50:0/3825899231 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2406bbf0 con 0x7fac240cf580 2024-09-11T22:14:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.840+0000 7fac21d9b640 1 --2- 172.21.15.50:0/3825899231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240cf580 0x7fac240b4c70 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fac18009870 tx=0x7fac1802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3198361139e0610 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.840+0000 7fac2159a640 1 -- 172.21.15.50:0/3825899231 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18037070 con 0x7fac240cf580 2024-09-11T22:14:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.840+0000 7fac2159a640 1 -- 172.21.15.50:0/3825899231 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac18032440 con 0x7fac240cf580 2024-09-11T22:14:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.840+0000 7fac2159a640 1 -- 172.21.15.50:0/3825899231 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18032810 con 0x7fac240cf580 2024-09-11T22:14:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.841+0000 7fac288a6640 1 -- 172.21.15.50:0/3825899231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240cf580 msgr2=0x7fac240b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.841+0000 7fac288a6640 1 --2- 172.21.15.50:0/3825899231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240cf580 0x7fac240b4c70 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fac18009870 tx=0x7fac1802a2a0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.841+0000 7fac288a6640 1 -- 172.21.15.50:0/3825899231 shutdown_connections 2024-09-11T22:14:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.841+0000 7fac288a6640 1 --2- 172.21.15.50:0/3825899231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac240cf580 0x7fac240b4c70 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.841+0000 7fac288a6640 1 -- 172.21.15.50:0/3825899231 >> 172.21.15.50:0/3825899231 conn(0x7fac240b4150 msgr2=0x7fac240b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.841+0000 7fac288a6640 1 -- 172.21.15.50:0/3825899231 shutdown_connections 2024-09-11T22:14:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.841+0000 7fac288a6640 1 -- 172.21.15.50:0/3825899231 wait complete. 2024-09-11T22:14:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.842+0000 7fac288a6640 1 Processor -- start 2024-09-11T22:14:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.842+0000 7fac288a6640 1 -- start start 2024-09-11T22:14:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.843+0000 7fac288a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac240cdd50 0x7fac2414f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.843+0000 7fac288a6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac240cf580 0x7fac240b6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.843+0000 7fac288a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac2415e840 0x7fac240b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.843+0000 7fac288a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fac2415ec20 con 0x7fac2415e840 2024-09-11T22:14:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.843+0000 7fac288a6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fac240d0470 con 0x7fac240cdd50 2024-09-11T22:14:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.843+0000 7fac288a6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fac2415eda0 con 0x7fac240cf580 2024-09-11T22:14:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.843+0000 7fac22d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac2415e840 0x7fac240b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.843+0000 7fac22d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac2415e840 0x7fac240b6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50438/0 (socket says 172.21.15.50:50438) 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.843+0000 7fac22d9d640 1 -- 172.21.15.50:0/2224362926 learned_addr learned my addr 172.21.15.50:0/2224362926 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.843+0000 7fac21d9b640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac240cf580 0x7fac240b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.843+0000 7fac2259c640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac240cdd50 0x7fac2414f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.844+0000 7fac22d9d640 1 -- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac240cf580 msgr2=0x7fac240b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.844+0000 7fac22d9d640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac240cf580 0x7fac240b6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.844+0000 7fac22d9d640 1 -- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac240cdd50 msgr2=0x7fac2414f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.844+0000 7fac22d9d640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac240cdd50 0x7fac2414f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.844+0000 7fac22d9d640 1 -- 172.21.15.50:0/2224362926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac240b3750 con 0x7fac2415e840 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.844+0000 7fac22d9d640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac2415e840 0x7fac240b6e60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c760 tx=0x7fac1c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.844+0000 7fac12ffd640 1 -- 172.21.15.50:0/2224362926 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c018070 con 0x7fac2415e840 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.844+0000 7fac12ffd640 1 -- 172.21.15.50:0/2224362926 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1c004d60 con 0x7fac2415e840 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.844+0000 7fac12ffd640 1 -- 172.21.15.50:0/2224362926 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c00a880 con 0x7fac2415e840 2024-09-11T22:14:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.844+0000 7fac288a6640 1 -- 172.21.15.50:0/2224362926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac240b7680 con 0x7fac2415e840 2024-09-11T22:14:34.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.844+0000 7fac288a6640 1 -- 172.21.15.50:0/2224362926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac240b7920 con 0x7fac2415e840 2024-09-11T22:14:34.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.845+0000 7fac288a6640 1 -- 172.21.15.50:0/2224362926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac240b4c70 con 0x7fac2415e840 2024-09-11T22:14:34.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.846+0000 7fac12ffd640 1 -- 172.21.15.50:0/2224362926 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac1c01b070 con 0x7fac2415e840 2024-09-11T22:14:34.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.846+0000 7fac12ffd640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fac0406be30 0x7fac0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:34.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.846+0000 7fac12ffd640 1 -- 172.21.15.50:0/2224362926 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fac1c08a1d0 con 0x7fac2415e840 2024-09-11T22:14:34.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.847+0000 7fac2259c640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fac0406be30 0x7fac0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:34.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.847+0000 7fac2259c640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fac0406be30 0x7fac0406e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fac14004f60 tx=0x7fac14007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:34.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:34.850+0000 7fac12ffd640 1 -- 172.21.15.50:0/2224362926 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac1c058530 con 0x7fac2415e840 2024-09-11T22:14:35.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.093+0000 7fac288a6640 1 -- 172.21.15.50:0/2224362926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fac240afd30 con 0x7fac2415e840 2024-09-11T22:14:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.096+0000 7fac12ffd640 1 -- 172.21.15.50:0/2224362926 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fac1c05c830 con 0x7fac2415e840 2024-09-11T22:14:35.097 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:14:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:14:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-09-11T22:14:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-09-11T22:14:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T22:14:35.097 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-11T22:14:35.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.098+0000 7fac288a6640 1 -- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fac0406be30 msgr2=0x7fac0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.098+0000 7fac288a6640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fac0406be30 0x7fac0406e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fac14004f60 tx=0x7fac14007e30 comp rx=0 tx=0).stop 2024-09-11T22:14:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.098+0000 7fac288a6640 1 -- 172.21.15.50:0/2224362926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac2415e840 msgr2=0x7fac240b6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.098+0000 7fac288a6640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac2415e840 0x7fac240b6e60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c760 tx=0x7fac1c00cb60 comp rx=0 tx=0).stop 2024-09-11T22:14:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.098+0000 7fac288a6640 1 -- 172.21.15.50:0/2224362926 shutdown_connections 2024-09-11T22:14:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.098+0000 7fac288a6640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fac0406be30 0x7fac0406e2f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.098+0000 7fac288a6640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac240cf580 0x7fac240b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.098+0000 7fac288a6640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac2415e840 0x7fac240b6e60 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.098+0000 7fac288a6640 1 --2- 172.21.15.50:0/2224362926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac240cdd50 0x7fac2414f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.098+0000 7fac288a6640 1 -- 172.21.15.50:0/2224362926 >> 172.21.15.50:0/2224362926 conn(0x7fac240b4150 msgr2=0x7fac2406fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.098+0000 7fac288a6640 1 -- 172.21.15.50:0/2224362926 shutdown_connections 2024-09-11T22:14:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.098+0000 7fac288a6640 1 -- 172.21.15.50:0/2224362926 wait complete. 2024-09-11T22:14:35.110 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:35.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.211+0000 7f4bb1ed7640 1 Processor -- start 2024-09-11T22:14:35.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.211+0000 7f4bb1ed7640 1 -- start start 2024-09-11T22:14:35.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4bb1ed7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4bac0679c0 0x7f4bac067e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4bb1ed7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4bac15c8f0 0x7f4bac15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4bb1ed7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bac06ec90 con 0x7f4bac15c510 2024-09-11T22:14:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4bb1ed7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4bac068370 con 0x7f4bac0679c0 2024-09-11T22:14:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4bb1ed7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4bac06ef70 con 0x7f4bac15c8f0 2024-09-11T22:14:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4baaffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4bac0679c0 0x7f4bac067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4bab7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4bac15c510 0x7f4bac06e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48954/0 (socket says 172.21.15.50:48954) 2024-09-11T22:14:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4bab7fe640 1 -- 172.21.15.50:0/2586256443 learned_addr learned my addr 172.21.15.50:0/2586256443 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4babfff640 1 --2- 172.21.15.50:0/2586256443 >> v2:172.21.15.77:3300/0 conn(0x7f4bac15c8f0 0x7f4bac15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4baaffd640 1 -- 172.21.15.50:0/2586256443 >> v2:172.21.15.77:3300/0 conn(0x7f4bac15c8f0 msgr2=0x7f4bac15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4baaffd640 1 --2- 172.21.15.50:0/2586256443 >> v2:172.21.15.77:3300/0 conn(0x7f4bac15c8f0 0x7f4bac15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4baaffd640 1 -- 172.21.15.50:0/2586256443 >> v1:172.21.15.50:6789/0 conn(0x7f4bac15c510 legacy=0x7f4bac06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4baaffd640 1 -- 172.21.15.50:0/2586256443 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bac06f250 con 0x7f4bac0679c0 2024-09-11T22:14:35.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4baa7fc640 1 -- 172.21.15.50:0/2586256443 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2436159660 0 0) 0x7f4bac06ec90 con 0x7f4bac15c510 2024-09-11T22:14:35.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.212+0000 7f4babfff640 1 --2- 172.21.15.50:0/2586256443 >> v2:172.21.15.77:3300/0 conn(0x7f4bac15c8f0 0x7f4bac15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:35.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.213+0000 7f4baaffd640 1 --2- 172.21.15.50:0/2586256443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bac0679c0 0x7f4bac067e30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0b6e70 tx=0x7f4ba002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a730feae6692de5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:35.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.213+0000 7f4baa7fc640 1 -- 172.21.15.50:0/2586256443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0037070 con 0x7f4bac0679c0 2024-09-11T22:14:35.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.213+0000 7f4baa7fc640 1 -- 172.21.15.50:0/2586256443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba0032440 con 0x7f4bac0679c0 2024-09-11T22:14:35.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.213+0000 7f4baa7fc640 1 -- 172.21.15.50:0/2586256443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0032810 con 0x7f4bac0679c0 2024-09-11T22:14:35.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.214+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/2586256443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bac0679c0 msgr2=0x7f4bac067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.214+0000 7f4bb1ed7640 1 --2- 172.21.15.50:0/2586256443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bac0679c0 0x7f4bac067e30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0b6e70 tx=0x7f4ba002a1a0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.214+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/2586256443 shutdown_connections 2024-09-11T22:14:35.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.214+0000 7f4bb1ed7640 1 --2- 172.21.15.50:0/2586256443 >> v2:172.21.15.77:3300/0 conn(0x7f4bac15c8f0 0x7f4bac15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.214+0000 7f4bb1ed7640 1 --2- 172.21.15.50:0/2586256443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bac0679c0 0x7f4bac067e30 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.214+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/2586256443 >> 172.21.15.50:0/2586256443 conn(0x7f4bac075060 msgr2=0x7f4bac06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:35.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.214+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/2586256443 shutdown_connections 2024-09-11T22:14:35.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.214+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/2586256443 wait complete. 2024-09-11T22:14:35.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.215+0000 7f4bb1ed7640 1 Processor -- start 2024-09-11T22:14:35.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.215+0000 7f4bb1ed7640 1 -- start start 2024-09-11T22:14:35.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bb1ed7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bac0679c0 0x7f4bac1f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bb1ed7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac15c510 0x7f4bac1430a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bb1ed7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bac15c8f0 0x7f4bac0d0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bb1ed7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac06c820 con 0x7f4bac0679c0 2024-09-11T22:14:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bb1ed7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac06f810 con 0x7f4bac15c510 2024-09-11T22:14:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bb1ed7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4bac06fd30 con 0x7f4bac15c8f0 2024-09-11T22:14:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bac0679c0 0x7f4bac1f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bac0679c0 0x7f4bac1f29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50466/0 (socket says 172.21.15.50:50466) 2024-09-11T22:14:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bab7fe640 1 -- 172.21.15.50:0/4118426897 learned_addr learned my addr 172.21.15.50:0/4118426897 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4baaffd640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac15c510 0x7f4bac1430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4babfff640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bac15c8f0 0x7f4bac0d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bab7fe640 1 -- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bac15c8f0 msgr2=0x7f4bac0d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bab7fe640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bac15c8f0 0x7f4bac0d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bab7fe640 1 -- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac15c510 msgr2=0x7f4bac1430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bab7fe640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac15c510 0x7f4bac1430a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bab7fe640 1 -- 172.21.15.50:0/4118426897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bac149c70 con 0x7f4bac0679c0 2024-09-11T22:14:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4baaffd640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac15c510 0x7f4bac1430a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bab7fe640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bac0679c0 0x7f4bac1f29f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00c500 tx=0x7f4b9c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4b93fff640 1 -- 172.21.15.50:0/4118426897 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c018070 con 0x7f4bac0679c0 2024-09-11T22:14:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4b93fff640 1 -- 172.21.15.50:0/4118426897 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9c007580 con 0x7f4bac0679c0 2024-09-11T22:14:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/4118426897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bac1efe00 con 0x7f4bac0679c0 2024-09-11T22:14:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.216+0000 7f4b93fff640 1 -- 172.21.15.50:0/4118426897 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c004a20 con 0x7f4bac0679c0 2024-09-11T22:14:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.217+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/4118426897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bac1f03c0 con 0x7f4bac0679c0 2024-09-11T22:14:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.218+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/4118426897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bac067e30 con 0x7f4bac0679c0 2024-09-11T22:14:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.218+0000 7f4b93fff640 1 -- 172.21.15.50:0/4118426897 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b9c004bc0 con 0x7f4bac0679c0 2024-09-11T22:14:35.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.218+0000 7f4b93fff640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b9806be30 0x7f4b9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.218+0000 7f4b93fff640 1 -- 172.21.15.50:0/4118426897 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f4b9c08a080 con 0x7f4bac0679c0 2024-09-11T22:14:35.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.219+0000 7f4baaffd640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b9806be30 0x7f4b9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.219+0000 7f4baaffd640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b9806be30 0x7f4b9806e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0034000 tx=0x7f4ba002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:35.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.223+0000 7f4b93fff640 1 -- 172.21.15.50:0/4118426897 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b9c058a40 con 0x7f4bac0679c0 2024-09-11T22:14:35.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.431+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/4118426897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bac159a70 con 0x7f4bac0679c0 2024-09-11T22:14:35.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.432+0000 7f4b93fff640 1 -- 172.21.15.50:0/4118426897 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5223 (secure 0 0 0) 0x7f4b9c058340 con 0x7f4bac0679c0 2024-09-11T22:14:35.433 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:35.433 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":32,"btime":"2024-09-11T22:14:28:953512+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5468,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/4145638619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4145638619},{"type":"v1","addr":"172.21.15.77:6836","nonce":4145638619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3969515798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3969515798},{"type":"v1","addr":"172.21.15.50:6834","nonce":3969515798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2387852280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2387852280},{"type":"v1","addr":"172.21.15.50:6835","nonce":2387852280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:14:26.306529+0000","modified":"2024-09-11T22:14:28.296653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6156":{"gid":6156,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1418437076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1418437076},{"type":"v1","addr":"172.21.15.77:6837","nonce":1418437076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6156,"qdb_cluster":[6156]},"id":4}]} 2024-09-11T22:14:35.433 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 32 2024-09-11T22:14:35.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.434+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b9806be30 msgr2=0x7f4b9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.434+0000 7f4bb1ed7640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b9806be30 0x7f4b9806e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0034000 tx=0x7f4ba002e000 comp rx=0 tx=0).stop 2024-09-11T22:14:35.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.434+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/4118426897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bac0679c0 msgr2=0x7f4bac1f29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.434+0000 7f4bb1ed7640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bac0679c0 0x7f4bac1f29f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00c500 tx=0x7f4b9c00c9c0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.434+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/4118426897 shutdown_connections 2024-09-11T22:14:35.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.434+0000 7f4bb1ed7640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b9806be30 0x7f4b9806e2f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.434+0000 7f4bb1ed7640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bac15c8f0 0x7f4bac0d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.434+0000 7f4bb1ed7640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac15c510 0x7f4bac1430a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.434+0000 7f4bb1ed7640 1 --2- 172.21.15.50:0/4118426897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bac0679c0 0x7f4bac1f29f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.434+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/4118426897 >> 172.21.15.50:0/4118426897 conn(0x7f4bac075060 msgr2=0x7f4bac0b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:35.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.434+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/4118426897 shutdown_connections 2024-09-11T22:14:35.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.434+0000 7f4bb1ed7640 1 -- 172.21.15.50:0/4118426897 wait complete. 2024-09-11T22:14:35.848 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:14:26.306529+0000', 'modified': '2024-09-11T22:14:28.296653+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6156}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6156': {'gid': 6156, 'name': 'b', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6837/1418437076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6835', 'nonce': 1418437076}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 1418437076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6156, 'qdb_cluster': [6156]} 2024-09-11T22:14:35.848 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:14:35.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T22:14:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.954+0000 7fdddc5d8640 1 Processor -- start 2024-09-11T22:14:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.954+0000 7fdddc5d8640 1 -- start start 2024-09-11T22:14:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.955+0000 7fdddc5d8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddd40d18a0 0x7fddd40d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.955+0000 7fdddc5d8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fddd40d3a30 0x7fddd40b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.955+0000 7fdddc5d8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd40cfa80 con 0x7fddd415e870 2024-09-11T22:14:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.955+0000 7fdddc5d8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fddd40d3ea0 con 0x7fddd40d3a30 2024-09-11T22:14:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.955+0000 7fdddc5d8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fddd40d40d0 con 0x7fddd40d18a0 2024-09-11T22:14:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.956+0000 7fddda374640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fddd415e870 0x7fddd40d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48958/0 (socket says 172.21.15.50:48958) 2024-09-11T22:14:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.956+0000 7fddda374640 1 -- 172.21.15.50:0/3353753884 learned_addr learned my addr 172.21.15.50:0/3353753884 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.956+0000 7fdddab75640 1 --2- 172.21.15.50:0/3353753884 >> v2:172.21.15.77:3300/0 conn(0x7fddd40d3a30 0x7fddd40b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.956+0000 7fddd9b73640 1 --2- 172.21.15.50:0/3353753884 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddd40d18a0 0x7fddd40d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.956+0000 7fddd9372640 1 -- 172.21.15.50:0/3353753884 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 26290814 0 0) 0x7fddd0001110 con 0x7fddd415e870 2024-09-11T22:14:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.956+0000 7fddd9372640 1 -- 172.21.15.50:0/3353753884 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddc0003520 con 0x7fddd415e870 2024-09-11T22:14:35.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.956+0000 7fdddab75640 1 -- 172.21.15.50:0/3353753884 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddd40d18a0 msgr2=0x7fddd40d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:35.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.956+0000 7fddd9372640 1 -- 172.21.15.50:0/3353753884 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2811823703 0 0) 0x7fddc0003520 con 0x7fddd415e870 2024-09-11T22:14:35.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.956+0000 7fdddab75640 1 --2- 172.21.15.50:0/3353753884 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddd40d18a0 0x7fddd40d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.956+0000 7fdddab75640 1 -- 172.21.15.50:0/3353753884 >> v1:172.21.15.50:6789/0 conn(0x7fddd415e870 legacy=0x7fddd40d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.956+0000 7fdddab75640 1 -- 172.21.15.50:0/3353753884 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd40d43b0 con 0x7fddd40d3a30 2024-09-11T22:14:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.957+0000 7fdddab75640 1 --2- 172.21.15.50:0/3353753884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddd40d3a30 0x7fddd40b8400 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009d90 tx=0x7fddcc02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c1fd7a9ec90b3a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.957+0000 7fddd9372640 1 -- 172.21.15.50:0/3353753884 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0001840 con 0x7fddd40d3a30 2024-09-11T22:14:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.957+0000 7fddd9372640 1 -- 172.21.15.50:0/3353753884 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddcc007540 con 0x7fddd40d3a30 2024-09-11T22:14:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.957+0000 7fddd9372640 1 -- 172.21.15.50:0/3353753884 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc007910 con 0x7fddd40d3a30 2024-09-11T22:14:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.958+0000 7fdddc5d8640 1 -- 172.21.15.50:0/3353753884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddd40d3a30 msgr2=0x7fddd40b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.958+0000 7fdddc5d8640 1 --2- 172.21.15.50:0/3353753884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddd40d3a30 0x7fddd40b8400 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009d90 tx=0x7fddcc02a5f0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.958+0000 7fdddc5d8640 1 -- 172.21.15.50:0/3353753884 shutdown_connections 2024-09-11T22:14:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.958+0000 7fdddc5d8640 1 --2- 172.21.15.50:0/3353753884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddd40d3a30 0x7fddd40b8400 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.958+0000 7fdddc5d8640 1 --2- 172.21.15.50:0/3353753884 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddd40d18a0 0x7fddd40d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.958+0000 7fdddc5d8640 1 -- 172.21.15.50:0/3353753884 >> 172.21.15.50:0/3353753884 conn(0x7fddd40727a0 msgr2=0x7fddd40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.958+0000 7fdddc5d8640 1 -- 172.21.15.50:0/3353753884 shutdown_connections 2024-09-11T22:14:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.958+0000 7fdddc5d8640 1 -- 172.21.15.50:0/3353753884 wait complete. 2024-09-11T22:14:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.959+0000 7fdddc5d8640 1 Processor -- start 2024-09-11T22:14:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.959+0000 7fdddc5d8640 1 -- start start 2024-09-11T22:14:35.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fdddc5d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd40d18a0 0x7fddd40c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fdddc5d8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddd40d3a30 0x7fddd40b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fdddc5d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddd415e870 0x7fddd4159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fdddc5d8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fddd415ec50 con 0x7fddd40d18a0 2024-09-11T22:14:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fdddc5d8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fddd40b7ee0 con 0x7fddd415e870 2024-09-11T22:14:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fdddc5d8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fddd40b78b0 con 0x7fddd40d3a30 2024-09-11T22:14:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fddda374640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd40d18a0 0x7fddd40c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fddda374640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd40d18a0 0x7fddd40c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50482/0 (socket says 172.21.15.50:50482) 2024-09-11T22:14:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fddda374640 1 -- 172.21.15.50:0/3278371888 learned_addr learned my addr 172.21.15.50:0/3278371888 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fdddab75640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddd415e870 0x7fddd4159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fddd9b73640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddd40d3a30 0x7fddd40b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fddda374640 1 -- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddd40d3a30 msgr2=0x7fddd40b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fddda374640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddd40d3a30 0x7fddd40b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fddda374640 1 -- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddd415e870 msgr2=0x7fddd4159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fddda374640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddd415e870 0x7fddd4159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fddda374640 1 -- 172.21.15.50:0/3278371888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd40c8bc0 con 0x7fddd40d18a0 2024-09-11T22:14:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fddd9b73640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddd40d3a30 0x7fddd40b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fddda374640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd40d18a0 0x7fddd40c8290 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fddd0001eb0 tx=0x7fddd000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.960+0000 7fddcaffd640 1 -- 172.21.15.50:0/3278371888 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0017070 con 0x7fddd40d18a0 2024-09-11T22:14:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.961+0000 7fddcaffd640 1 -- 172.21.15.50:0/3278371888 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd0005ad0 con 0x7fddd40d18a0 2024-09-11T22:14:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.961+0000 7fddcaffd640 1 -- 172.21.15.50:0/3278371888 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0007070 con 0x7fddd40d18a0 2024-09-11T22:14:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.961+0000 7fdddc5d8640 1 -- 172.21.15.50:0/3278371888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd40c8ea0 con 0x7fddd40d18a0 2024-09-11T22:14:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.961+0000 7fdddc5d8640 1 -- 172.21.15.50:0/3278371888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd40c9460 con 0x7fddd40d18a0 2024-09-11T22:14:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.962+0000 7fddcaffd640 1 -- 172.21.15.50:0/3278371888 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fddd001a070 con 0x7fddd40d18a0 2024-09-11T22:14:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.963+0000 7fddcaffd640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddb806be30 0x7fddb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.963+0000 7fddcaffd640 1 -- 172.21.15.50:0/3278371888 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fddd008a340 con 0x7fddd40d18a0 2024-09-11T22:14:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.963+0000 7fddd9b73640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddb806be30 0x7fddb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.963+0000 7fddd9b73640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddb806be30 0x7fddb806e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fddd41f7de0 tx=0x7fddc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.963+0000 7fdddf449740 1 Processor -- start 2024-09-11T22:14:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.964+0000 7fdddf449740 1 -- start start 2024-09-11T22:14:35.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.964+0000 7fdddf449740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 0x563a992e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.964+0000 7fdddf449740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 0x563a9929f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.964+0000 7fdddf449740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992a0a50 0x563a992998b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.964+0000 7fdddf449740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563a99201520 con 0x563a9929f2c0 2024-09-11T22:14:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.964+0000 7fdddf449740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563a991a93e0 con 0x563a9929ca80 2024-09-11T22:14:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.964+0000 7fdddf449740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563a991fd4e0 con 0x563a992a0a50 2024-09-11T22:14:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fddda374640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 0x563a992e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fddda374640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 0x563a992e4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50484/0 (socket says 172.21.15.50:50484) 2024-09-11T22:14:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fddda374640 1 -- 172.21.15.50:0/4147815889 learned_addr learned my addr 172.21.15.50:0/4147815889 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fddd9b73640 1 --2- 172.21.15.50:0/4147815889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 0x563a9929f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fdddab75640 1 --2- 172.21.15.50:0/4147815889 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992a0a50 0x563a992998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fddda374640 1 -- 172.21.15.50:0/4147815889 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992a0a50 msgr2=0x563a992998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fddda374640 1 --2- 172.21.15.50:0/4147815889 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992a0a50 0x563a992998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fddda374640 1 -- 172.21.15.50:0/4147815889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 msgr2=0x563a9929f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fddda374640 1 --2- 172.21.15.50:0/4147815889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 0x563a9929f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fddda374640 1 -- 172.21.15.50:0/4147815889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a991c42f0 con 0x563a9929f2c0 2024-09-11T22:14:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fdddab75640 1 --2- 172.21.15.50:0/4147815889 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992a0a50 0x563a992998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fddda374640 1 --2- 172.21.15.50:0/4147815889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 0x563a992e4a60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fddd0088870 tx=0x7fddd0058740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff5d518e91dc370 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fddb7fff640 1 -- 172.21.15.50:0/4147815889 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0056980 con 0x563a9929f2c0 2024-09-11T22:14:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fddb7fff640 1 -- 172.21.15.50:0/4147815889 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd008a0c0 con 0x563a9929f2c0 2024-09-11T22:14:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.965+0000 7fddb7fff640 1 -- 172.21.15.50:0/4147815889 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0060dd0 con 0x563a9929f2c0 2024-09-11T22:14:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.966+0000 7fdddf449740 1 -- 172.21.15.50:0/4147815889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 msgr2=0x563a992e4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.966+0000 7fdddf449740 1 --2- 172.21.15.50:0/4147815889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 0x563a992e4a60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fddd0088870 tx=0x7fddd0058740 comp rx=0 tx=0).stop 2024-09-11T22:14:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.966+0000 7fdddf449740 1 -- 172.21.15.50:0/4147815889 shutdown_connections 2024-09-11T22:14:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.966+0000 7fdddf449740 1 --2- 172.21.15.50:0/4147815889 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992a0a50 0x563a992998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.966+0000 7fdddf449740 1 --2- 172.21.15.50:0/4147815889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 0x563a9929f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.966+0000 7fdddf449740 1 --2- 172.21.15.50:0/4147815889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 0x563a992e4a60 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.966+0000 7fdddf449740 1 -- 172.21.15.50:0/4147815889 >> 172.21.15.50:0/4147815889 conn(0x563a9929ba80 msgr2=0x563a992e3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.966+0000 7fdddf449740 1 -- 172.21.15.50:0/4147815889 shutdown_connections 2024-09-11T22:14:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.966+0000 7fdddf449740 1 -- 172.21.15.50:0/4147815889 wait complete. 2024-09-11T22:14:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.966+0000 7fdddf449740 1 -- start start 2024-09-11T22:14:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.967+0000 7fdddf449740 1 Processor -- start 2024-09-11T22:14:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.967+0000 7fdddf449740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929f2c0 0x563a992c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.967+0000 7fdddf449740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 0x563a992bdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fdddf449740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992be6f0 0x563a992bff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fdddf449740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563a9929af20 con 0x563a992a0a50 2024-09-11T22:14:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fdddf449740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563a9918a450 con 0x563a9929f2c0 2024-09-11T22:14:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fdddf449740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563a992e5290 con 0x563a992be6f0 2024-09-11T22:14:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fdddf449740 10 client.0 _ll_register_callbacks cb 0x563a98f13ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddd9b73640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 0x563a992bdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddd9b73640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 0x563a992bdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50496/0 (socket says 172.21.15.50:50496) 2024-09-11T22:14:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddd9b73640 1 -- 172.21.15.50:0/4084223205 learned_addr learned my addr 172.21.15.50:0/4084223205 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddda374640 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929f2c0 0x563a992c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fdddab75640 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992be6f0 0x563a992bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddd9b73640 1 -- 172.21.15.50:0/4084223205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992be6f0 msgr2=0x563a992bff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddd9b73640 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992be6f0 0x563a992bff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddd9b73640 1 -- 172.21.15.50:0/4084223205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929f2c0 msgr2=0x563a992c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddd9b73640 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929f2c0 0x563a992c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddd9b73640 1 -- 172.21.15.50:0/4084223205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a98f142d0 con 0x563a992a0a50 2024-09-11T22:14:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddda374640 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929f2c0 0x563a992c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddd9b73640 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 0x563a992bdee0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fddc4010e20 tx=0x7fddc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6c026bba770da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:35.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddb57fa640 1 -- 172.21.15.50:0/4084223205 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc400f040 con 0x563a992a0a50 2024-09-11T22:14:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddb57fa640 1 -- 172.21.15.50:0/4084223205 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fddc4016630 con 0x563a992a0a50 2024-09-11T22:14:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fdddf449740 1 -- 172.21.15.50:0/4084223205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddd008a0c0 con 0x563a992a0a50 2024-09-11T22:14:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.968+0000 7fddb57fa640 1 -- 172.21.15.50:0/4084223205 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fddc4016830 con 0x563a992a0a50 2024-09-11T22:14:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.969+0000 7fdddf449740 10 client.6303 fetch_fsmap learned FSMap version 32 2024-09-11T22:14:35.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.969+0000 7fdddf449740 1 -- 172.21.15.50:0/4084223205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) -- 0x563a98fde6b0 con 0x563a992a0a50 2024-09-11T22:14:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.969+0000 7fddb57fa640 1 -- 172.21.15.50:0/4084223205 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd008a0c0 con 0x563a992a0a50 2024-09-11T22:14:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.969+0000 7fddb57fa640 1 -- 172.21.15.50:0/4084223205 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 3502+0+0 (secure 0 0 0) 0x7fddc4033080 con 0x563a992a0a50 2024-09-11T22:14:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.969+0000 7fdddf449740 10 client.6303 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T22:14:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.969+0000 7fdddf449740 10 client.6303 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:14:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.969+0000 7fdddf449740 20 client.6303 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:35.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.969+0000 7fdddf449740 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x563a992f7db0 0x563a992f8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.969+0000 7fdddf449740 4 client.6303 mds_command: new command op to 6156 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.969+0000 7fdddf449740 1 -- 172.21.15.50:0/4084223205 --> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a9920ec50 con 0x563a992f7db0 2024-09-11T22:14:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.969+0000 7fddda374640 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x563a992f7db0 0x563a992f8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.970+0000 7fddda374640 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x563a992f7db0 0x563a992f8190 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f549bae1a201034 server_cookie=f8925fb5c14d9db8 in_seq=0 out_seq=0 2024-09-11T22:14:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.970+0000 7fddb57fa640 10 client.6303 ms_handle_connect on v2:172.21.15.77:6835/1418437076 2024-09-11T22:14:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.970+0000 7fddb57fa640 1 -- 172.21.15.50:0/4084223205 <== mds.0 v2:172.21.15.77:6835/1418437076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a9920ec50 con 0x563a992f7db0 2024-09-11T22:14:35.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.970+0000 7fddb57fa640 10 client.6303 handle_command_reply: tid=0 2024-09-11T22:14:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.970+0000 7fdddf449740 1 client.6303 shutdown 2024-09-11T22:14:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.971+0000 7fdddf449740 1 -- 172.21.15.50:0/4084223205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 msgr2=0x563a992bdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.971+0000 7fdddf449740 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 0x563a992bdee0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fddc4010e20 tx=0x7fddc40046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.971+0000 7fdddf449740 1 -- 172.21.15.50:0/4084223205 shutdown_connections 2024-09-11T22:14:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.971+0000 7fdddf449740 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992be6f0 0x563a992bff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.971+0000 7fdddf449740 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x563a992f7db0 0x563a992f8190 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.971+0000 7fdddf449740 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 0x563a992bdee0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.971+0000 7fdddf449740 1 --2- 172.21.15.50:0/4084223205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929f2c0 0x563a992c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.971+0000 7fdddf449740 1 -- 172.21.15.50:0/4084223205 >> 172.21.15.50:0/4084223205 conn(0x563a9929ca80 msgr2=0x563a992e3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:35.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.971+0000 7fddb57fa640 0 client.6303 ms_handle_reset on v2:172.21.15.77:6835/1418437076 2024-09-11T22:14:35.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.971+0000 7fdddf449740 1 -- 172.21.15.50:0/4084223205 shutdown_connections 2024-09-11T22:14:35.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.971+0000 7fdddf449740 1 -- 172.21.15.50:0/4084223205 wait complete. 2024-09-11T22:14:35.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.971+0000 7fdddf449740 20 client.6303 trim_cache size 0 max 16384 2024-09-11T22:14:35.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.989+0000 7fdddf449740 1 Processor -- start 2024-09-11T22:14:35.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.989+0000 7fdddf449740 1 -- start start 2024-09-11T22:14:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fdddf449740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 0x563a992fe370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fdddf449740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 0x563a992bd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fdddf449740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992a0a50 0x563a992bddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fdddf449740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fddd42000d0 con 0x563a9929f2c0 2024-09-11T22:14:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fdddf449740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fddd40cee70 con 0x563a9929ca80 2024-09-11T22:14:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fdddf449740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fddd40ca950 con 0x563a992a0a50 2024-09-11T22:14:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fddd9b73640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 0x563a992bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fddd9b73640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 0x563a992bd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50498/0 (socket says 172.21.15.50:50498) 2024-09-11T22:14:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fddd9b73640 1 -- 172.21.15.50:0/3522705949 learned_addr learned my addr 172.21.15.50:0/3522705949 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fddda374640 1 --2- 172.21.15.50:0/3522705949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 0x563a992fe370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fdddab75640 1 --2- 172.21.15.50:0/3522705949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992a0a50 0x563a992bddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:35.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fddd9b73640 1 -- 172.21.15.50:0/3522705949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992a0a50 msgr2=0x563a992bddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:35.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fddd9b73640 1 --2- 172.21.15.50:0/3522705949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992a0a50 0x563a992bddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fddd9b73640 1 -- 172.21.15.50:0/3522705949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 msgr2=0x563a992fe370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:35.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fddd9b73640 1 --2- 172.21.15.50:0/3522705949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 0x563a992fe370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fddd9b73640 1 -- 172.21.15.50:0/3522705949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a9929b820 con 0x563a9929f2c0 2024-09-11T22:14:35.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fddda374640 1 --2- 172.21.15.50:0/3522705949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 0x563a992fe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:35.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.990+0000 7fdddab75640 1 --2- 172.21.15.50:0/3522705949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992a0a50 0x563a992bddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:35.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.991+0000 7fddd9b73640 1 --2- 172.21.15.50:0/3522705949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 0x563a992bd890 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fddc4004550 tx=0x7fddc4022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206805e319158128 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:35.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.991+0000 7fddb77fe640 1 -- 172.21.15.50:0/3522705949 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40169d0 con 0x563a9929f2c0 2024-09-11T22:14:35.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.991+0000 7fddb77fe640 1 -- 172.21.15.50:0/3522705949 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc4036070 con 0x563a9929f2c0 2024-09-11T22:14:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.991+0000 7fddb77fe640 1 -- 172.21.15.50:0/3522705949 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40235f0 con 0x563a9929f2c0 2024-09-11T22:14:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.991+0000 7fdddf449740 1 -- 172.21.15.50:0/3522705949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 msgr2=0x563a992bd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.991+0000 7fdddf449740 1 --2- 172.21.15.50:0/3522705949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 0x563a992bd890 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fddc4004550 tx=0x7fddc4022000 comp rx=0 tx=0).stop 2024-09-11T22:14:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.991+0000 7fdddf449740 1 -- 172.21.15.50:0/3522705949 shutdown_connections 2024-09-11T22:14:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.992+0000 7fdddf449740 1 --2- 172.21.15.50:0/3522705949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a992a0a50 0x563a992bddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.992+0000 7fdddf449740 1 --2- 172.21.15.50:0/3522705949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a9929f2c0 0x563a992bd890 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.992+0000 7fdddf449740 1 --2- 172.21.15.50:0/3522705949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 0x563a992fe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.992+0000 7fdddf449740 1 -- 172.21.15.50:0/3522705949 >> 172.21.15.50:0/3522705949 conn(0x563a992c00c0 msgr2=0x563a992e5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.992+0000 7fdddf449740 1 -- 172.21.15.50:0/3522705949 shutdown_connections 2024-09-11T22:14:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.992+0000 7fdddf449740 1 -- 172.21.15.50:0/3522705949 wait complete. 2024-09-11T22:14:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.992+0000 7fdddf449740 1 -- start start 2024-09-11T22:14:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.992+0000 7fdddf449740 1 Processor -- start 2024-09-11T22:14:35.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.993+0000 7fdddf449740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 0x563a99361b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:36.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.993+0000 7fdddf449740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a9929f2c0 0x563a99299950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:36.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.993+0000 7fdddf449740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 0x563a99299e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:36.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.993+0000 7fdddf449740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563a992c8d40 con 0x563a992a0a50 2024-09-11T22:14:36.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.993+0000 7fdddf449740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563a992be420 con 0x563a9929ca80 2024-09-11T22:14:36.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.993+0000 7fdddf449740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563a99298f60 con 0x563a9929f2c0 2024-09-11T22:14:36.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.993+0000 7fdddf449740 10 client.0 _ll_register_callbacks cb 0x7fddc4010a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:36.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.993+0000 7fdddab75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 0x563a99299e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:36.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.993+0000 7fdddab75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 0x563a99299e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50500/0 (socket says 172.21.15.50:50500) 2024-09-11T22:14:36.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.993+0000 7fdddab75640 1 -- 172.21.15.50:0/2702448099 learned_addr learned my addr 172.21.15.50:0/2702448099 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:36.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.993+0000 7fddd9b73640 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a9929f2c0 0x563a99299950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:36.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.993+0000 7fddda374640 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 0x563a99361b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddab75640 1 -- 172.21.15.50:0/2702448099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a9929f2c0 msgr2=0x563a99299950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddab75640 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a9929f2c0 0x563a99299950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddab75640 1 -- 172.21.15.50:0/2702448099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 msgr2=0x563a99361b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddab75640 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 0x563a99361b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddab75640 1 -- 172.21.15.50:0/2702448099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a993620d0 con 0x563a992a0a50 2024-09-11T22:14:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fddd9b73640 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a9929f2c0 0x563a99299950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddab75640 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 0x563a99299e90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009e80 tx=0x7fddcc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0af26eaf38ee77a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fddb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fddb57fa640 1 -- 172.21.15.50:0/2702448099 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc009450 con 0x563a992a0a50 2024-09-11T22:14:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fddb57fa640 1 -- 172.21.15.50:0/2702448099 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fddcc03c420 con 0x563a992a0a50 2024-09-11T22:14:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddf449740 1 -- 172.21.15.50:0/2702448099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddc4036070 con 0x563a992a0a50 2024-09-11T22:14:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fddb57fa640 1 -- 172.21.15.50:0/2702448099 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fddcc003990 con 0x563a992a0a50 2024-09-11T22:14:36.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddf449740 10 client.6309 fetch_fsmap learned FSMap version 32 2024-09-11T22:14:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddf449740 1 -- 172.21.15.50:0/2702448099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) -- 0x563a992e46c0 con 0x563a992a0a50 2024-09-11T22:14:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fddb57fa640 1 -- 172.21.15.50:0/2702448099 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc4036070 con 0x563a992a0a50 2024-09-11T22:14:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fddb57fa640 1 -- 172.21.15.50:0/2702448099 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 3502+0+0 (secure 0 0 0) 0x7fddcc045070 con 0x563a992a0a50 2024-09-11T22:14:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddf449740 10 client.6309 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T22:14:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddf449740 10 client.6309 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:14:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddf449740 20 client.6309 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddf449740 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x563a992be6f0 0x563a992c5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddf449740 4 client.6309 mds_command: new command op to 6156 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:14:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fdddf449740 1 -- 172.21.15.50:0/2702448099 --> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] -- command(tid 0: {"prefix": "status"}) -- 0x563a99208fa0 con 0x563a992be6f0 2024-09-11T22:14:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.994+0000 7fddda374640 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x563a992be6f0 0x563a992c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fddda374640 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x563a992be6f0 0x563a992c5840 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1a0b6fc561b8201 server_cookie=74018abe5276ecf in_seq=0 out_seq=0 2024-09-11T22:14:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fddb57fa640 10 client.6309 ms_handle_connect on v2:172.21.15.77:6835/1418437076 2024-09-11T22:14:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fddb57fa640 1 -- 172.21.15.50:0/2702448099 <== mds.0 v2:172.21.15.77:6835/1418437076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x563a99208fa0 con 0x563a992be6f0 2024-09-11T22:14:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fddb57fa640 10 client.6309 handle_command_reply: tid=0 2024-09-11T22:14:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fdddf449740 1 client.6309 shutdown 2024-09-11T22:14:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fdddf449740 1 -- 172.21.15.50:0/2702448099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 msgr2=0x563a99299e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fdddf449740 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 0x563a99299e90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009e80 tx=0x7fddcc004ab0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fdddf449740 1 -- 172.21.15.50:0/2702448099 shutdown_connections 2024-09-11T22:14:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fdddf449740 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563a9929f2c0 0x563a99299950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fdddf449740 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x563a992be6f0 0x563a992c5840 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fdddf449740 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a992a0a50 0x563a99299e90 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fdddf449740 1 --2- 172.21.15.50:0/2702448099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a9929ca80 0x563a99361b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fddb57fa640 0 client.6309 ms_handle_reset on v2:172.21.15.77:6835/1418437076 2024-09-11T22:14:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fdddf449740 1 -- 172.21.15.50:0/2702448099 >> 172.21.15.50:0/2702448099 conn(0x563a992c00c0 msgr2=0x563a992e7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fdddf449740 1 -- 172.21.15.50:0/2702448099 shutdown_connections 2024-09-11T22:14:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fdddf449740 1 -- 172.21.15.50:0/2702448099 wait complete. 2024-09-11T22:14:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.995+0000 7fdddf449740 20 client.6309 trim_cache size 0 max 16384 2024-09-11T22:14:36.004 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:36.004 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:14:36.004 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:14:36.005 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6156, 2024-09-11T22:14:36.005 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:14:36.005 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:14:36.005 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:14:36.005 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 9.0548819609999995, 2024-09-11T22:14:36.005 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 32, 2024-09-11T22:14:36.005 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 59, 2024-09-11T22:14:36.005 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 59, 2024-09-11T22:14:36.005 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 14.057320127000001 2024-09-11T22:14:36.005 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.996+0000 7fdddc5d8640 1 -- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddb806be30 msgr2=0x7fddb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.996+0000 7fdddc5d8640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddb806be30 0x7fddb806e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fddd41f7de0 tx=0x7fddc4008040 comp rx=0 tx=0).stop 2024-09-11T22:14:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.996+0000 7fdddc5d8640 1 -- 172.21.15.50:0/3278371888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd40d18a0 msgr2=0x7fddd40c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.996+0000 7fdddc5d8640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd40d18a0 0x7fddd40c8290 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fddd0001eb0 tx=0x7fddd000cb90 comp rx=0 tx=0).stop 2024-09-11T22:14:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.996+0000 7fdddc5d8640 1 -- 172.21.15.50:0/3278371888 shutdown_connections 2024-09-11T22:14:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.996+0000 7fdddc5d8640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddb806be30 0x7fddb806e2f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.996+0000 7fdddc5d8640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddd40d3a30 0x7fddd40b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.996+0000 7fdddc5d8640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddd415e870 0x7fddd4159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.996+0000 7fdddc5d8640 1 --2- 172.21.15.50:0/3278371888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd40d18a0 0x7fddd40c8290 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.996+0000 7fdddc5d8640 1 -- 172.21.15.50:0/3278371888 >> 172.21.15.50:0/3278371888 conn(0x7fddd40727a0 msgr2=0x7fddd415ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.996+0000 7fdddc5d8640 1 -- 172.21.15.50:0/3278371888 shutdown_connections 2024-09-11T22:14:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:35.996+0000 7fdddc5d8640 1 -- 172.21.15.50:0/3278371888 wait complete. 2024-09-11T22:14:36.008 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:14:36.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.109+0000 7f2960ee6640 1 Processor -- start 2024-09-11T22:14:36.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.109+0000 7f2960ee6640 1 -- start start 2024-09-11T22:14:36.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.110+0000 7f2960ee6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f295c15ffb0 0x7f295c0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:36.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.110+0000 7f2960ee6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f295c0b3a40 0x7f295c0d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.110+0000 7f2960ee6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c0b2890 con 0x7f295c0d0ee0 2024-09-11T22:14:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.110+0000 7f2960ee6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f295c0b2b70 con 0x7f295c0b3a40 2024-09-11T22:14:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.110+0000 7f2960ee6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f295c0b2e50 con 0x7f295c15ffb0 2024-09-11T22:14:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.110+0000 7f2959d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f295c0b3a40 0x7f295c0d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.111+0000 7f2959d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f295c0b3a40 0x7f295c0d09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50506/0 (socket says 172.21.15.50:50506) 2024-09-11T22:14:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.111+0000 7f2959d9b640 1 -- 172.21.15.50:0/211768753 learned_addr learned my addr 172.21.15.50:0/211768753 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.111+0000 7f295a59c640 1 --2- 172.21.15.50:0/211768753 >> v2:172.21.15.77:3300/0 conn(0x7f295c15ffb0 0x7f295c0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.111+0000 7f2959d9b640 1 -- 172.21.15.50:0/211768753 >> v2:172.21.15.77:3300/0 conn(0x7f295c15ffb0 msgr2=0x7f295c0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.111+0000 7f2959d9b640 1 --2- 172.21.15.50:0/211768753 >> v2:172.21.15.77:3300/0 conn(0x7f295c15ffb0 0x7f295c0d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.111+0000 7f2959d9b640 1 -- 172.21.15.50:0/211768753 >> v1:172.21.15.77:6789/0 conn(0x7f295c0d0ee0 legacy=0x7f295c160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:36.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.111+0000 7f2959d9b640 1 -- 172.21.15.50:0/211768753 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c0b3130 con 0x7f295c0b3a40 2024-09-11T22:14:36.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.112+0000 7f2959d9b640 1 --2- 172.21.15.50:0/211768753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295c0b3a40 0x7f295c0d09a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f295c072e10 tx=0x7f294402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6273a1a1a15d7bb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.112+0000 7f295959a640 1 -- 172.21.15.50:0/211768753 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944037070 con 0x7f295c0b3a40 2024-09-11T22:14:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.112+0000 7f295959a640 1 -- 172.21.15.50:0/211768753 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2944032440 con 0x7f295c0b3a40 2024-09-11T22:14:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.112+0000 7f295959a640 1 -- 172.21.15.50:0/211768753 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944032810 con 0x7f295c0b3a40 2024-09-11T22:14:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.112+0000 7f2960ee6640 1 -- 172.21.15.50:0/211768753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295c0b3a40 msgr2=0x7f295c0d09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.112+0000 7f2960ee6640 1 --2- 172.21.15.50:0/211768753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295c0b3a40 0x7f295c0d09a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f295c072e10 tx=0x7f294402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.112+0000 7f2960ee6640 1 -- 172.21.15.50:0/211768753 shutdown_connections 2024-09-11T22:14:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.112+0000 7f2960ee6640 1 --2- 172.21.15.50:0/211768753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295c0b3a40 0x7f295c0d09a0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.112+0000 7f2960ee6640 1 --2- 172.21.15.50:0/211768753 >> v2:172.21.15.77:3300/0 conn(0x7f295c15ffb0 0x7f295c0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.112+0000 7f2960ee6640 1 -- 172.21.15.50:0/211768753 >> 172.21.15.50:0/211768753 conn(0x7f295c0b40b0 msgr2=0x7f295c0b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.112+0000 7f2960ee6640 1 -- 172.21.15.50:0/211768753 shutdown_connections 2024-09-11T22:14:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.112+0000 7f2960ee6640 1 -- 172.21.15.50:0/211768753 wait complete. 2024-09-11T22:14:36.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.114+0000 7f2960ee6640 1 Processor -- start 2024-09-11T22:14:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.114+0000 7f2960ee6640 1 -- start start 2024-09-11T22:14:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2960ee6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c0b3a40 0x7f295c06bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2960ee6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295c0d0ee0 0x7f295c0c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2960ee6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f295c15ffb0 0x7f295c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2960ee6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f295c0b0520 con 0x7f295c0d0ee0 2024-09-11T22:14:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2960ee6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f295c0b03a0 con 0x7f295c15ffb0 2024-09-11T22:14:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2960ee6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f295c160b80 con 0x7f295c0b3a40 2024-09-11T22:14:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2959d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295c0d0ee0 0x7f295c0c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2959d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295c0d0ee0 0x7f295c0c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50520/0 (socket says 172.21.15.50:50520) 2024-09-11T22:14:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2959d9b640 1 -- 172.21.15.50:0/2712123456 learned_addr learned my addr 172.21.15.50:0/2712123456 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f295a59c640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c0b3a40 0x7f295c06bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f295ad9d640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f295c15ffb0 0x7f295c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2959d9b640 1 -- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c0b3a40 msgr2=0x7f295c06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2959d9b640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c0b3a40 0x7f295c06bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2959d9b640 1 -- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f295c15ffb0 msgr2=0x7f295c06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2959d9b640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f295c15ffb0 0x7f295c06d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2959d9b640 1 -- 172.21.15.50:0/2712123456 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c0b6c50 con 0x7f295c0d0ee0 2024-09-11T22:14:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f295ad9d640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f295c15ffb0 0x7f295c06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2959d9b640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295c0d0ee0 0x7f295c0c8c30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2944000c00 tx=0x7f29440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.115+0000 7f2952ffd640 1 -- 172.21.15.50:0/2712123456 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944037040 con 0x7f295c0d0ee0 2024-09-11T22:14:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.116+0000 7f2952ffd640 1 -- 172.21.15.50:0/2712123456 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2944042070 con 0x7f295c0d0ee0 2024-09-11T22:14:36.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.116+0000 7f2960ee6640 1 -- 172.21.15.50:0/2712123456 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295c06c130 con 0x7f295c0d0ee0 2024-09-11T22:14:36.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.116+0000 7f2952ffd640 1 -- 172.21.15.50:0/2712123456 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944030880 con 0x7f295c0d0ee0 2024-09-11T22:14:36.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.116+0000 7f2960ee6640 1 -- 172.21.15.50:0/2712123456 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f295c06c6f0 con 0x7f295c0d0ee0 2024-09-11T22:14:36.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.117+0000 7f2960ee6640 1 -- 172.21.15.50:0/2712123456 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f295c160eb0 con 0x7f295c0d0ee0 2024-09-11T22:14:36.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.117+0000 7f2952ffd640 1 -- 172.21.15.50:0/2712123456 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2944030a20 con 0x7f295c0d0ee0 2024-09-11T22:14:36.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.118+0000 7f2952ffd640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f293c06be30 0x7f293c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:36.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.118+0000 7f2952ffd640 1 -- 172.21.15.50:0/2712123456 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f29440ab680 con 0x7f295c0d0ee0 2024-09-11T22:14:36.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.118+0000 7f295a59c640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f293c06be30 0x7f293c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:36.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.118+0000 7f295a59c640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f293c06be30 0x7f293c06e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f294c011340 tx=0x7f294c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:36.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.122+0000 7f2952ffd640 1 -- 172.21.15.50:0/2712123456 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f294407a030 con 0x7f295c0d0ee0 2024-09-11T22:14:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.333+0000 7f2960ee6640 1 -- 172.21.15.50:0/2712123456 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f295c0b4e80 con 0x7f295c0d0ee0 2024-09-11T22:14:36.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.333+0000 7f2952ffd640 1 -- 172.21.15.50:0/2712123456 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) ==== 53+0+73 (secure 0 0 0) 0x7f2944079930 con 0x7f295c0d0ee0 2024-09-11T22:14:36.335 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:14:36.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.335+0000 7f2960ee6640 1 -- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f293c06be30 msgr2=0x7f293c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:36.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.335+0000 7f2960ee6640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f293c06be30 0x7f293c06e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f294c011340 tx=0x7f294c00b040 comp rx=0 tx=0).stop 2024-09-11T22:14:36.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.335+0000 7f2960ee6640 1 -- 172.21.15.50:0/2712123456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295c0d0ee0 msgr2=0x7f295c0c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:36.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.335+0000 7f2960ee6640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295c0d0ee0 0x7f295c0c8c30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2944000c00 tx=0x7f29440046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.335+0000 7f2960ee6640 1 -- 172.21.15.50:0/2712123456 shutdown_connections 2024-09-11T22:14:36.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.335+0000 7f2960ee6640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f293c06be30 0x7f293c06e2f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.335+0000 7f2960ee6640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f295c15ffb0 0x7f295c06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.335+0000 7f2960ee6640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295c0d0ee0 0x7f295c0c8c30 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.335+0000 7f2960ee6640 1 --2- 172.21.15.50:0/2712123456 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c0b3a40 0x7f295c06bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:36.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.336+0000 7f2960ee6640 1 -- 172.21.15.50:0/2712123456 >> 172.21.15.50:0/2712123456 conn(0x7f295c0b40b0 msgr2=0x7f295c0b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:36.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.336+0000 7f2960ee6640 1 -- 172.21.15.50:0/2712123456 shutdown_connections 2024-09-11T22:14:36.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36.336+0000 7f2960ee6640 1 -- 172.21.15.50:0/2712123456 wait complete. 2024-09-11T22:14:36.347 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:14:36.347 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:14:36.347 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:14:36.347 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:14:36.347 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:14:36.347 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:14:36.347 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:14:36.347 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:14:36.348 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:14:36.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:36.348 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:14:36.364 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:14:36.406 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:14:36.406 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:14:36.406 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:14:36.406 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:14:36.406 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:14:36.406 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:14:36.406 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:14:36.406 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:14:36.407 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:14:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:14:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:14:36.407 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:14:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:14:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:14:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:14:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42519sec preferred_lft 42519sec 2024-09-11T22:14:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:14:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:14:36.407 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:14:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:14:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:14:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:14:36.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:36.409 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:14:36.433 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:14:36.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:36.435 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:14:36.492 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:14:36.492 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:14:36.492 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:14:36.492 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:14:36.492 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:14:36.493 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:14:36.493 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:14:36.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:14:36.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:14:36.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:14:36.493 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:14:36.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:14:36.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:14:36.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:36.621 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:14:36.636 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:14:36.636 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:14:36.637 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:14:36.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:36.637 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:14:36.702 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:14:36.702 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:14:36.758 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:14:36.759 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:14:36.759 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:14:36.814 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:14:36.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:36.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:14:36.899 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:14:36.899 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:14:36.907 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:14:36.907 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:14:36.907 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:14:36.907 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:14:36.907 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:14:36.908 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:14:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:14:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:14:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:14:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:14:36.909 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:14:36.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:36.910 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:14:36.936 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:14:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:14:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:14:37.035 INFO:teuthology.orchestra.run.smithi050.stdout:client5878 2024-09-11T22:14:37.035 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:14:37.035 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:37.051 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-11T22:14:37.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.196+0000 7f4bdd077640 1 Processor -- start 2024-09-11T22:14:37.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.196+0000 7f4bdd077640 1 -- start start 2024-09-11T22:14:37.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.197+0000 7f4bdd077640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd8161d30 0x7f4bd80cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.197+0000 7f4bdd077640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4bd80b78f0 0x7f4bd8162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.197+0000 7f4bdd077640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4bd80d11d0 0x7f4bd80d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.197+0000 7f4bdd077640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd80d3450 con 0x7f4bd80d11d0 2024-09-11T22:14:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.197+0000 7f4bdd077640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd81632e0 con 0x7f4bd80b78f0 2024-09-11T22:14:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.197+0000 7f4bdd077640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd8162110 con 0x7f4bd8161d30 2024-09-11T22:14:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.197+0000 7f4bd759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4bd80d11d0 0x7f4bd80d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.197+0000 7f4bd759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4bd80d11d0 0x7f4bd80d1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50522/0 (socket says 172.21.15.50:50522) 2024-09-11T22:14:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.197+0000 7f4bd759e640 1 -- 172.21.15.50:0/339592253 learned_addr learned my addr 172.21.15.50:0/339592253 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.198+0000 7f4bd659c640 1 --2- 172.21.15.50:0/339592253 >> v2:172.21.15.77:3300/0 conn(0x7f4bd80b78f0 0x7f4bd8162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.198+0000 7f4bd6d9d640 1 --2- 172.21.15.50:0/339592253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd8161d30 0x7f4bd80cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.198+0000 7f4bd759e640 1 -- 172.21.15.50:0/339592253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd8161d30 msgr2=0x7f4bd80cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:37.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.198+0000 7f4bd759e640 1 --2- 172.21.15.50:0/339592253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd8161d30 0x7f4bd80cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.198+0000 7f4bd759e640 1 -- 172.21.15.50:0/339592253 >> v2:172.21.15.77:3300/0 conn(0x7f4bd80b78f0 msgr2=0x7f4bd8162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.198+0000 7f4bd759e640 1 --2- 172.21.15.50:0/339592253 >> v2:172.21.15.77:3300/0 conn(0x7f4bd80b78f0 0x7f4bd8162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.198+0000 7f4bd759e640 1 -- 172.21.15.50:0/339592253 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd80cfd70 con 0x7f4bd80d11d0 2024-09-11T22:14:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.198+0000 7f4bd659c640 1 --2- 172.21.15.50:0/339592253 >> v2:172.21.15.77:3300/0 conn(0x7f4bd80b78f0 0x7f4bd8162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:37.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.198+0000 7f4bd759e640 1 --2- 172.21.15.50:0/339592253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd80d11d0 0x7f4bd80d1660 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4bd808da10 tx=0x7f4bd002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cedbf06859661b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:37.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.199+0000 7f4bd5d9b640 1 -- 172.21.15.50:0/339592253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0037070 con 0x7f4bd80d11d0 2024-09-11T22:14:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.199+0000 7f4bd5d9b640 1 -- 172.21.15.50:0/339592253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd0032440 con 0x7f4bd80d11d0 2024-09-11T22:14:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.199+0000 7f4bd5d9b640 1 -- 172.21.15.50:0/339592253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0032810 con 0x7f4bd80d11d0 2024-09-11T22:14:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.199+0000 7f4bdd077640 1 -- 172.21.15.50:0/339592253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd80d11d0 msgr2=0x7f4bd80d1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.199+0000 7f4bdd077640 1 --2- 172.21.15.50:0/339592253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd80d11d0 0x7f4bd80d1660 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4bd808da10 tx=0x7f4bd002a1e0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.199+0000 7f4bdd077640 1 -- 172.21.15.50:0/339592253 shutdown_connections 2024-09-11T22:14:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.199+0000 7f4bdd077640 1 --2- 172.21.15.50:0/339592253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd80d11d0 0x7f4bd80d1660 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.199+0000 7f4bdd077640 1 --2- 172.21.15.50:0/339592253 >> v2:172.21.15.77:3300/0 conn(0x7f4bd80b78f0 0x7f4bd8162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.199+0000 7f4bdd077640 1 --2- 172.21.15.50:0/339592253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd8161d30 0x7f4bd80cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.199+0000 7f4bdd077640 1 -- 172.21.15.50:0/339592253 >> 172.21.15.50:0/339592253 conn(0x7f4bd80727a0 msgr2=0x7f4bd80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.199+0000 7f4bdd077640 1 -- 172.21.15.50:0/339592253 shutdown_connections 2024-09-11T22:14:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.199+0000 7f4bdd077640 1 -- 172.21.15.50:0/339592253 wait complete. 2024-09-11T22:14:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.201+0000 7f4bdd077640 1 Processor -- start 2024-09-11T22:14:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.201+0000 7f4bdd077640 1 -- start start 2024-09-11T22:14:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bdd077640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd80b78f0 0x7f4bd81585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bdd077640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd80d11d0 0x7f4bd80c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bdd077640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd8161d30 0x7f4bd80ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bdd077640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd80d30e0 con 0x7f4bd8161d30 2024-09-11T22:14:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bdd077640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd80d2e00 con 0x7f4bd80b78f0 2024-09-11T22:14:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bdd077640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd80b7d30 con 0x7f4bd80d11d0 2024-09-11T22:14:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bd759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd8161d30 0x7f4bd80ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bd759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd8161d30 0x7f4bd80ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50524/0 (socket says 172.21.15.50:50524) 2024-09-11T22:14:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bd759e640 1 -- 172.21.15.50:0/4219753044 learned_addr learned my addr 172.21.15.50:0/4219753044 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bd6d9d640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd80b78f0 0x7f4bd81585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bd659c640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd80d11d0 0x7f4bd80c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bd759e640 1 -- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd80d11d0 msgr2=0x7f4bd80c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bd759e640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd80d11d0 0x7f4bd80c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bd759e640 1 -- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd80b78f0 msgr2=0x7f4bd81585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bd759e640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd80b78f0 0x7f4bd81585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bd759e640 1 -- 172.21.15.50:0/4219753044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd80c84a0 con 0x7f4bd8161d30 2024-09-11T22:14:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bd759e640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd8161d30 0x7f4bd80ca290 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00090b0 tx=0x7f4bd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.202+0000 7f4bbf7fe640 1 -- 172.21.15.50:0/4219753044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0037040 con 0x7f4bd8161d30 2024-09-11T22:14:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.203+0000 7f4bbf7fe640 1 -- 172.21.15.50:0/4219753044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd0042070 con 0x7f4bd8161d30 2024-09-11T22:14:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.203+0000 7f4bbf7fe640 1 -- 172.21.15.50:0/4219753044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0030920 con 0x7f4bd8161d30 2024-09-11T22:14:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.203+0000 7f4bdd077640 1 -- 172.21.15.50:0/4219753044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd80c8780 con 0x7f4bd8161d30 2024-09-11T22:14:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.203+0000 7f4bdd077640 1 -- 172.21.15.50:0/4219753044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd80c8d40 con 0x7f4bd8161d30 2024-09-11T22:14:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.204+0000 7f4bdd077640 1 -- 172.21.15.50:0/4219753044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd8162da0 con 0x7f4bd8161d30 2024-09-11T22:14:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.204+0000 7f4bbf7fe640 1 -- 172.21.15.50:0/4219753044 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bd0030ac0 con 0x7f4bd8161d30 2024-09-11T22:14:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.205+0000 7f4bbf7fe640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4bc406be60 0x7f4bc406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.205+0000 7f4bbf7fe640 1 -- 172.21.15.50:0/4219753044 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f4bd00ab5e0 con 0x7f4bd8161d30 2024-09-11T22:14:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.205+0000 7f4bd6d9d640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4bc406be60 0x7f4bc406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.205+0000 7f4bd6d9d640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4bc406be60 0x7f4bc406e320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8003b80 tx=0x7f4bc80098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:37.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.209+0000 7f4bbf7fe640 1 -- 172.21.15.50:0/4219753044 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4bd0079940 con 0x7f4bd8161d30 2024-09-11T22:14:37.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.384+0000 7f4bdd077640 1 -- 172.21.15.50:0/4219753044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f4bd80d2900 con 0x7f4bd8161d30 2024-09-11T22:14:37.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.387+0000 7f4bbf7fe640 1 -- 172.21.15.50:0/4219753044 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7f4bd007dc40 con 0x7f4bd8161d30 2024-09-11T22:14:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.390+0000 7f4bdd077640 1 -- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4bc406be60 msgr2=0x7f4bc406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.390+0000 7f4bdd077640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4bc406be60 0x7f4bc406e320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8003b80 tx=0x7f4bc80098d0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.390+0000 7f4bdd077640 1 -- 172.21.15.50:0/4219753044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd8161d30 msgr2=0x7f4bd80ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.390+0000 7f4bdd077640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd8161d30 0x7f4bd80ca290 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00090b0 tx=0x7f4bd00046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.390+0000 7f4bdd077640 1 -- 172.21.15.50:0/4219753044 shutdown_connections 2024-09-11T22:14:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.390+0000 7f4bdd077640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4bc406be60 0x7f4bc406e320 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.390+0000 7f4bdd077640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd80d11d0 0x7f4bd80c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.390+0000 7f4bdd077640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bd8161d30 0x7f4bd80ca290 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.390+0000 7f4bdd077640 1 --2- 172.21.15.50:0/4219753044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd80b78f0 0x7f4bd81585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.390+0000 7f4bdd077640 1 -- 172.21.15.50:0/4219753044 >> 172.21.15.50:0/4219753044 conn(0x7f4bd80727a0 msgr2=0x7f4bd80b9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.390+0000 7f4bdd077640 1 -- 172.21.15.50:0/4219753044 shutdown_connections 2024-09-11T22:14:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.390+0000 7f4bdd077640 1 -- 172.21.15.50:0/4219753044 wait complete. 2024-09-11T22:14:37.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-11T22:14:37.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.506+0000 7ff7b8931640 1 Processor -- start 2024-09-11T22:14:37.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.506+0000 7ff7b8931640 1 -- start start 2024-09-11T22:14:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.507+0000 7ff7b8931640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff7b40d18a0 0x7ff7b40d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.507+0000 7ff7b8931640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b40cfa80 con 0x7ff7b40d3a30 2024-09-11T22:14:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.507+0000 7ff7b8931640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b40d40d0 con 0x7ff7b415e870 2024-09-11T22:14:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.507+0000 7ff7b8931640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b40d3ea0 con 0x7ff7b40d18a0 2024-09-11T22:14:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.507+0000 7ff7b1d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff7b40d18a0 0x7ff7b40d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.507+0000 7ff7b2d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff7b40d3a30 0x7ff7b40b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38734/0 (socket says 172.21.15.50:38734) 2024-09-11T22:14:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.507+0000 7ff7b2d9d640 1 -- 172.21.15.50:0/1941035896 learned_addr learned my addr 172.21.15.50:0/1941035896 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.508+0000 7ff7b1d9b640 1 -- 172.21.15.50:0/1941035896 >> v1:172.21.15.77:6789/0 conn(0x7ff7b415e870 legacy=0x7ff7b40d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.508+0000 7ff7b1d9b640 1 -- 172.21.15.50:0/1941035896 >> v1:172.21.15.50:6789/0 conn(0x7ff7b40d3a30 legacy=0x7ff7b40b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.508+0000 7ff7b1d9b640 1 -- 172.21.15.50:0/1941035896 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b40d43b0 con 0x7ff7b40d18a0 2024-09-11T22:14:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.508+0000 7ff7b159a640 1 -- 172.21.15.50:0/1941035896 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1155862672 0 0) 0x7ff7a4001110 con 0x7ff7b40d3a30 2024-09-11T22:14:37.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.509+0000 7ff7b1d9b640 1 --2- 172.21.15.50:0/1941035896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b40d18a0 0x7ff7b40d34f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0097a0 tx=0x7ff79c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc6fd1cc30dd34a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:37.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.509+0000 7ff7b159a640 1 -- 172.21.15.50:0/1941035896 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c037070 con 0x7ff7b40d18a0 2024-09-11T22:14:37.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.509+0000 7ff7b159a640 1 -- 172.21.15.50:0/1941035896 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79c032440 con 0x7ff7b40d18a0 2024-09-11T22:14:37.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.509+0000 7ff7b159a640 1 -- 172.21.15.50:0/1941035896 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c032810 con 0x7ff7b40d18a0 2024-09-11T22:14:37.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.509+0000 7ff7b8931640 1 -- 172.21.15.50:0/1941035896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b40d18a0 msgr2=0x7ff7b40d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.509+0000 7ff7b8931640 1 --2- 172.21.15.50:0/1941035896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b40d18a0 0x7ff7b40d34f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0097a0 tx=0x7ff79c02a1e0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.509+0000 7ff7b8931640 1 -- 172.21.15.50:0/1941035896 shutdown_connections 2024-09-11T22:14:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.509+0000 7ff7b8931640 1 --2- 172.21.15.50:0/1941035896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b40d18a0 0x7ff7b40d34f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.509+0000 7ff7b8931640 1 -- 172.21.15.50:0/1941035896 >> 172.21.15.50:0/1941035896 conn(0x7ff7b40727a0 msgr2=0x7ff7b40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.509+0000 7ff7b8931640 1 -- 172.21.15.50:0/1941035896 shutdown_connections 2024-09-11T22:14:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.509+0000 7ff7b8931640 1 -- 172.21.15.50:0/1941035896 wait complete. 2024-09-11T22:14:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.511+0000 7ff7b8931640 1 Processor -- start 2024-09-11T22:14:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.511+0000 7ff7b8931640 1 -- start start 2024-09-11T22:14:37.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.511+0000 7ff7b8931640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b40d18a0 0x7ff7b415dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.511+0000 7ff7b8931640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7b40d3a30 0x7ff7b41517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.511+0000 7ff7b8931640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7b415e870 0x7ff7b40cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.511+0000 7ff7b8931640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b415ec50 con 0x7ff7b40d18a0 2024-09-11T22:14:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.511+0000 7ff7b8931640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b40b7ee0 con 0x7ff7b415e870 2024-09-11T22:14:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.511+0000 7ff7b8931640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b40b78b0 con 0x7ff7b40d3a30 2024-09-11T22:14:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7b259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b40d18a0 0x7ff7b415dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7b259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b40d18a0 0x7ff7b415dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36510/0 (socket says 172.21.15.50:36510) 2024-09-11T22:14:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7b259c640 1 -- 172.21.15.50:0/1693842991 learned_addr learned my addr 172.21.15.50:0/1693842991 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7b2d9d640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7b415e870 0x7ff7b40cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7b1d9b640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7b40d3a30 0x7ff7b41517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7b259c640 1 -- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7b40d3a30 msgr2=0x7ff7b41517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7b259c640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7b40d3a30 0x7ff7b41517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7b259c640 1 -- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7b415e870 msgr2=0x7ff7b40cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7b259c640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7b415e870 0x7ff7b40cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7b259c640 1 -- 172.21.15.50:0/1693842991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b40cb460 con 0x7ff7b40d18a0 2024-09-11T22:14:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7b259c640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b40d18a0 0x7ff7b415dee0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00c7c0 tx=0x7ff7ac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7aaffd640 1 -- 172.21.15.50:0/1693842991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac016020 con 0x7ff7b40d18a0 2024-09-11T22:14:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7aaffd640 1 -- 172.21.15.50:0/1693842991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7ac00aa50 con 0x7ff7b40d18a0 2024-09-11T22:14:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7b8931640 1 -- 172.21.15.50:0/1693842991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b40cc980 con 0x7ff7b40d18a0 2024-09-11T22:14:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7aaffd640 1 -- 172.21.15.50:0/1693842991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00ae40 con 0x7ff7b40d18a0 2024-09-11T22:14:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.512+0000 7ff7b8931640 1 -- 172.21.15.50:0/1693842991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b4152090 con 0x7ff7b40d18a0 2024-09-11T22:14:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.513+0000 7ff7b8931640 1 -- 172.21.15.50:0/1693842991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b40d34f0 con 0x7ff7b40d18a0 2024-09-11T22:14:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.514+0000 7ff7aaffd640 1 -- 172.21.15.50:0/1693842991 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7ac019020 con 0x7ff7b40d18a0 2024-09-11T22:14:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.514+0000 7ff7aaffd640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff79406be30 0x7ff79406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.514+0000 7ff7aaffd640 1 -- 172.21.15.50:0/1693842991 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7ff7ac08b060 con 0x7ff7b40d18a0 2024-09-11T22:14:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.514+0000 7ff7b1d9b640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff79406be30 0x7ff79406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.515+0000 7ff7b1d9b640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff79406be30 0x7ff79406e2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff79c034000 tx=0x7ff79c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:37.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.519+0000 7ff7aaffd640 1 -- 172.21.15.50:0/1693842991 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff7ac020020 con 0x7ff7b40d18a0 2024-09-11T22:14:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.696+0000 7ff7b8931640 1 -- 172.21.15.50:0/1693842991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7ff7b40cbb00 con 0x7ff7b40d18a0 2024-09-11T22:14:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.699+0000 7ff7aaffd640 1 -- 172.21.15.50:0/1693842991 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7ff7ac059450 con 0x7ff7b40d18a0 2024-09-11T22:14:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.701+0000 7ff7b8931640 1 -- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff79406be30 msgr2=0x7ff79406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.701+0000 7ff7b8931640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff79406be30 0x7ff79406e2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff79c034000 tx=0x7ff79c02e000 comp rx=0 tx=0).stop 2024-09-11T22:14:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.701+0000 7ff7b8931640 1 -- 172.21.15.50:0/1693842991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b40d18a0 msgr2=0x7ff7b415dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.701+0000 7ff7b8931640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b40d18a0 0x7ff7b415dee0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00c7c0 tx=0x7ff7ac00cc80 comp rx=0 tx=0).stop 2024-09-11T22:14:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.702+0000 7ff7b8931640 1 -- 172.21.15.50:0/1693842991 shutdown_connections 2024-09-11T22:14:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.702+0000 7ff7b8931640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff79406be30 0x7ff79406e2f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.702+0000 7ff7b8931640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7b40d3a30 0x7ff7b41517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.702+0000 7ff7b8931640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7b415e870 0x7ff7b40cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.702+0000 7ff7b8931640 1 --2- 172.21.15.50:0/1693842991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b40d18a0 0x7ff7b415dee0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.702+0000 7ff7b8931640 1 -- 172.21.15.50:0/1693842991 >> 172.21.15.50:0/1693842991 conn(0x7ff7b40727a0 msgr2=0x7ff7b4161100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.702+0000 7ff7b8931640 1 -- 172.21.15.50:0/1693842991 shutdown_connections 2024-09-11T22:14:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.702+0000 7ff7b8931640 1 -- 172.21.15.50:0/1693842991 wait complete. 2024-09-11T22:14:37.714 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-11T22:14:37.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.818+0000 7f6a9f12c640 1 Processor -- start 2024-09-11T22:14:37.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.818+0000 7f6a9f12c640 1 -- start start 2024-09-11T22:14:37.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.819+0000 7f6a9f12c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a9815e840 0x7f6a980b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.819+0000 7f6a9f12c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a980cf580 0x7f6a9806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.819+0000 7f6a9f12c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a980ce5f0 con 0x7f6a980cdd50 2024-09-11T22:14:37.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.819+0000 7f6a9f12c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6a9806c240 con 0x7f6a980cf580 2024-09-11T22:14:37.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.819+0000 7f6a9f12c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6a980d0470 con 0x7f6a9815e840 2024-09-11T22:14:37.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.819+0000 7f6a9d6c9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a980cf580 0x7f6a9806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.819+0000 7f6a9d6c9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a980cf580 0x7f6a9806c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36522/0 (socket says 172.21.15.50:36522) 2024-09-11T22:14:37.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.819+0000 7f6a9d6c9640 1 -- 172.21.15.50:0/3584056313 learned_addr learned my addr 172.21.15.50:0/3584056313 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:37.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.820+0000 7f6a9cec8640 1 --2- 172.21.15.50:0/3584056313 >> v2:172.21.15.77:3300/0 conn(0x7f6a9815e840 0x7f6a980b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.820+0000 7f6a9d6c9640 1 -- 172.21.15.50:0/3584056313 >> v2:172.21.15.77:3300/0 conn(0x7f6a9815e840 msgr2=0x7f6a980b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:37.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.820+0000 7f6a9d6c9640 1 --2- 172.21.15.50:0/3584056313 >> v2:172.21.15.77:3300/0 conn(0x7f6a9815e840 0x7f6a980b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.820+0000 7f6a9d6c9640 1 -- 172.21.15.50:0/3584056313 >> v1:172.21.15.77:6789/0 conn(0x7f6a980cdd50 legacy=0x7f6a980cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:37.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.820+0000 7f6a9d6c9640 1 -- 172.21.15.50:0/3584056313 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a980ce310 con 0x7f6a980cf580 2024-09-11T22:14:37.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.820+0000 7f6a9cec8640 1 --2- 172.21.15.50:0/3584056313 >> v2:172.21.15.77:3300/0 conn(0x7f6a9815e840 0x7f6a980b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:37.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.820+0000 7f6a9d6c9640 1 --2- 172.21.15.50:0/3584056313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a980cf580 0x7f6a9806c6d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6a980694b0 tx=0x7f6a9002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc1afc402ef6ef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:37.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.820+0000 7f6a977fe640 1 -- 172.21.15.50:0/3584056313 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90036070 con 0x7f6a980cf580 2024-09-11T22:14:37.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.820+0000 7f6a977fe640 1 -- 172.21.15.50:0/3584056313 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a90031600 con 0x7f6a980cf580 2024-09-11T22:14:37.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.820+0000 7f6a977fe640 1 -- 172.21.15.50:0/3584056313 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a900319d0 con 0x7f6a980cf580 2024-09-11T22:14:37.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.821+0000 7f6a9f12c640 1 -- 172.21.15.50:0/3584056313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a980cf580 msgr2=0x7f6a9806c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.821+0000 7f6a9f12c640 1 --2- 172.21.15.50:0/3584056313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a980cf580 0x7f6a9806c6d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6a980694b0 tx=0x7f6a9002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.821+0000 7f6a9f12c640 1 -- 172.21.15.50:0/3584056313 shutdown_connections 2024-09-11T22:14:37.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.821+0000 7f6a9f12c640 1 --2- 172.21.15.50:0/3584056313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a980cf580 0x7f6a9806c6d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.821+0000 7f6a9f12c640 1 --2- 172.21.15.50:0/3584056313 >> v2:172.21.15.77:3300/0 conn(0x7f6a9815e840 0x7f6a980b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.821+0000 7f6a9f12c640 1 -- 172.21.15.50:0/3584056313 >> 172.21.15.50:0/3584056313 conn(0x7f6a980b4150 msgr2=0x7f6a980b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:37.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.821+0000 7f6a9f12c640 1 -- 172.21.15.50:0/3584056313 shutdown_connections 2024-09-11T22:14:37.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.821+0000 7f6a9f12c640 1 -- 172.21.15.50:0/3584056313 wait complete. 2024-09-11T22:14:37.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.822+0000 7f6a9f12c640 1 Processor -- start 2024-09-11T22:14:37.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.822+0000 7f6a9f12c640 1 -- start start 2024-09-11T22:14:37.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.823+0000 7f6a9f12c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a980cdd50 0x7f6a980c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.823+0000 7f6a9f12c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a980cf580 0x7f6a980cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.823+0000 7f6a9f12c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9815e840 0x7f6a980cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.823+0000 7f6a9f12c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9815ec20 con 0x7f6a980cdd50 2024-09-11T22:14:37.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.823+0000 7f6a9f12c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9806bed0 con 0x7f6a9815e840 2024-09-11T22:14:37.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.823+0000 7f6a9f12c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9815eda0 con 0x7f6a980cf580 2024-09-11T22:14:37.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.823+0000 7f6a9cec8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a980cdd50 0x7f6a980c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.823+0000 7f6a9cec8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a980cdd50 0x7f6a980c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36528/0 (socket says 172.21.15.50:36528) 2024-09-11T22:14:37.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.823+0000 7f6a9cec8640 1 -- 172.21.15.50:0/873765688 learned_addr learned my addr 172.21.15.50:0/873765688 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:37.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.823+0000 7f6a9d6c9640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9815e840 0x7f6a980cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.823+0000 7f6a97fff640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a980cf580 0x7f6a980cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.824+0000 7f6a9cec8640 1 -- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a980cf580 msgr2=0x7f6a980cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.824+0000 7f6a9cec8640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a980cf580 0x7f6a980cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.824+0000 7f6a9cec8640 1 -- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9815e840 msgr2=0x7f6a980cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:37.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.824+0000 7f6a9cec8640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9815e840 0x7f6a980cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:37.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.824+0000 7f6a9cec8640 1 -- 172.21.15.50:0/873765688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a980c7030 con 0x7f6a980cdd50 2024-09-11T22:14:37.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.824+0000 7f6a9cec8640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a980cdd50 0x7f6a980c9ed0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800c820 tx=0x7f6a8800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:37.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.824+0000 7f6a957fa640 1 -- 172.21.15.50:0/873765688 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88015070 con 0x7f6a980cdd50 2024-09-11T22:14:37.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.824+0000 7f6a957fa640 1 -- 172.21.15.50:0/873765688 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a88007a30 con 0x7f6a980cdd50 2024-09-11T22:14:37.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.824+0000 7f6a957fa640 1 -- 172.21.15.50:0/873765688 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88007de0 con 0x7f6a980cdd50 2024-09-11T22:14:37.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.824+0000 7f6a9f12c640 1 -- 172.21.15.50:0/873765688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a980c7310 con 0x7f6a980cdd50 2024-09-11T22:14:37.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.824+0000 7f6a9f12c640 1 -- 172.21.15.50:0/873765688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a980c78d0 con 0x7f6a980cdd50 2024-09-11T22:14:37.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.825+0000 7f6a9f12c640 1 -- 172.21.15.50:0/873765688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a980b4c70 con 0x7f6a980cdd50 2024-09-11T22:14:37.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.826+0000 7f6a957fa640 1 -- 172.21.15.50:0/873765688 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a88018070 con 0x7f6a980cdd50 2024-09-11T22:14:37.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.826+0000 7f6a957fa640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a8406be30 0x7f6a8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:37.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.826+0000 7f6a957fa640 1 -- 172.21.15.50:0/873765688 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f6a8808ac80 con 0x7f6a980cdd50 2024-09-11T22:14:37.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.827+0000 7f6a97fff640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a8406be30 0x7f6a8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:37.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.827+0000 7f6a97fff640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a8406be30 0x7f6a8406e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6a980d34b0 tx=0x7f6a8c007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:37.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:37.830+0000 7f6a957fa640 1 -- 172.21.15.50:0/873765688 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a88058fe0 con 0x7f6a980cdd50 2024-09-11T22:14:38.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.006+0000 7f6a9f12c640 1 -- 172.21.15.50:0/873765688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f6a981eaf20 con 0x7f6a980cdd50 2024-09-11T22:14:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.009+0000 7f6a957fa640 1 -- 172.21.15.50:0/873765688 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v17)=0 v17) ==== 116+0+0 (secure 0 0 0) 0x7f6a8805d2e0 con 0x7f6a980cdd50 2024-09-11T22:14:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.011+0000 7f6a9f12c640 1 -- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a8406be30 msgr2=0x7f6a8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.011+0000 7f6a9f12c640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a8406be30 0x7f6a8406e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6a980d34b0 tx=0x7f6a8c007e30 comp rx=0 tx=0).stop 2024-09-11T22:14:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.011+0000 7f6a9f12c640 1 -- 172.21.15.50:0/873765688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a980cdd50 msgr2=0x7f6a980c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.011+0000 7f6a9f12c640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a980cdd50 0x7f6a980c9ed0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800c820 tx=0x7f6a8800cce0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.012+0000 7f6a9f12c640 1 -- 172.21.15.50:0/873765688 shutdown_connections 2024-09-11T22:14:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.012+0000 7f6a9f12c640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a8406be30 0x7f6a8406e2f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.012+0000 7f6a9f12c640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a980cf580 0x7f6a980cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.012+0000 7f6a9f12c640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a9815e840 0x7f6a980cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.012+0000 7f6a9f12c640 1 --2- 172.21.15.50:0/873765688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a980cdd50 0x7f6a980c9ed0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.012+0000 7f6a9f12c640 1 -- 172.21.15.50:0/873765688 >> 172.21.15.50:0/873765688 conn(0x7f6a980b4150 msgr2=0x7f6a9806c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.012+0000 7f6a9f12c640 1 -- 172.21.15.50:0/873765688 shutdown_connections 2024-09-11T22:14:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.012+0000 7f6a9f12c640 1 -- 172.21.15.50:0/873765688 wait complete. 2024-09-11T22:14:38.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:38.024 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-11T22:14:38.044 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2024-09-11T22:14:38.044 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-11T22:14:38.044 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2024-09-11T22:14:38.044 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:14:38.044 DEBUG:teuthology.orchestra.run.smithi050:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-11T22:14:38.044 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-11T22:14:38.149 INFO:teuthology.orchestra.run.smithi050.stdout:1099511627776 2024-09-11T22:14:38.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:14:38.158 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:38.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.300+0000 7fa6dfa15640 1 Processor -- start 2024-09-11T22:14:38.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.301+0000 7fa6dfa15640 1 -- start start 2024-09-11T22:14:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.301+0000 7fa6dfa15640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6d80d18a0 0x7fa6d80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.301+0000 7fa6dfa15640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d80cfa80 con 0x7fa6d80d3a30 2024-09-11T22:14:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.301+0000 7fa6dfa15640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d80d40d0 con 0x7fa6d815e870 2024-09-11T22:14:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.301+0000 7fa6dfa15640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d80d3ea0 con 0x7fa6d80d18a0 2024-09-11T22:14:38.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6ddfb2640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa6d80d3a30 0x7fa6d80b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38748/0 (socket says 172.21.15.50:38748) 2024-09-11T22:14:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6ddfb2640 1 -- 172.21.15.50:0/2231235306 learned_addr learned my addr 172.21.15.50:0/2231235306 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6dcfb0640 1 --2- 172.21.15.50:0/2231235306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6d80d18a0 0x7fa6d80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 467531658 0 0) 0x7fa6d0001110 con 0x7fa6d80d3a30 2024-09-11T22:14:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6c0003520 con 0x7fa6d80d3a30 2024-09-11T22:14:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131271624 0 0) 0x7fa6d80d40d0 con 0x7fa6d815e870 2024-09-11T22:14:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6d0001110 con 0x7fa6d815e870 2024-09-11T22:14:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1399765890 0 0) 0x7fa6c0003520 con 0x7fa6d80d3a30 2024-09-11T22:14:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6d80d18a0 msgr2=0x7fa6d80d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 --2- 172.21.15.50:0/2231235306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6d80d18a0 0x7fa6d80d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 >> v1:172.21.15.77:6789/0 conn(0x7fa6d815e870 legacy=0x7fa6d80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d80d43b0 con 0x7fa6d80d3a30 2024-09-11T22:14:38.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fa6d0001840 con 0x7fa6d80d3a30 2024-09-11T22:14:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 >> v1:172.21.15.50:6789/0 conn(0x7fa6d80d3a30 legacy=0x7fa6d80b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 --2- 172.21.15.50:0/2231235306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6c0003b70 0x7fa6c0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 --2- 172.21.15.50:0/2231235306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6d80d18a0 0x7fa6c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 --2- 172.21.15.50:0/2231235306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c0004d40 0x7fa6c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c000ba70 con 0x7fa6c0004d40 2024-09-11T22:14:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c000bbf0 con 0x7fa6c0003b70 2024-09-11T22:14:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c000bdf0 con 0x7fa6d80d18a0 2024-09-11T22:14:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6ddfb2640 1 --2- 172.21.15.50:0/2231235306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c0004d40 0x7fa6c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.302+0000 7fa6dcfb0640 1 --2- 172.21.15.50:0/2231235306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6d80d18a0 0x7fa6c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.303+0000 7fa6dd7b1640 1 --2- 172.21.15.50:0/2231235306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6c0003b70 0x7fa6c0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:38.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.303+0000 7fa6ddfb2640 1 -- 172.21.15.50:0/2231235306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6d80d18a0 msgr2=0x7fa6c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:38.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.303+0000 7fa6ddfb2640 1 --2- 172.21.15.50:0/2231235306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6d80d18a0 0x7fa6c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.303+0000 7fa6ddfb2640 1 -- 172.21.15.50:0/2231235306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6c0003b70 msgr2=0x7fa6c0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:38.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.303+0000 7fa6ddfb2640 1 --2- 172.21.15.50:0/2231235306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6c0003b70 0x7fa6c0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.303+0000 7fa6ddfb2640 1 -- 172.21.15.50:0/2231235306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c0003520 con 0x7fa6c0004d40 2024-09-11T22:14:38.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.303+0000 7fa6ddfb2640 1 --2- 172.21.15.50:0/2231235306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c0004d40 0x7fa6c00051c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c4c0 tx=0x7fa6c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179d5281d4b2b974 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:38.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.303+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0035070 con 0x7fa6c0004d40 2024-09-11T22:14:38.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.304+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d002c040 con 0x7fa6c0004d40 2024-09-11T22:14:38.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.304+0000 7fa6d7fff640 1 -- 172.21.15.50:0/2231235306 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000c0e0 con 0x7fa6c0004d40 2024-09-11T22:14:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.304+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2231235306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c0004d40 msgr2=0x7fa6c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.304+0000 7fa6dfa15640 1 --2- 172.21.15.50:0/2231235306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c0004d40 0x7fa6c00051c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c4c0 tx=0x7fa6c0005830 comp rx=0 tx=0).stop 2024-09-11T22:14:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.304+0000 7fa6ddfb2640 1 -- 172.21.15.50:0/2231235306 reap_dead start 2024-09-11T22:14:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.304+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2231235306 shutdown_connections 2024-09-11T22:14:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.304+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2231235306 >> 172.21.15.50:0/2231235306 conn(0x7fa6d80727a0 msgr2=0x7fa6d80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.304+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2231235306 shutdown_connections 2024-09-11T22:14:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.304+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2231235306 wait complete. 2024-09-11T22:14:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.305+0000 7fa6dfa15640 1 Processor -- start 2024-09-11T22:14:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.305+0000 7fa6dfa15640 1 -- start start 2024-09-11T22:14:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.306+0000 7fa6dfa15640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6c0004d40 0x7fa6d814eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.306+0000 7fa6dfa15640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d8158620 0x7fa6d8158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.306+0000 7fa6dfa15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6d80cd800 0x7fa6d80cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.306+0000 7fa6dfa15640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d815ec50 con 0x7fa6d8158620 2024-09-11T22:14:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.306+0000 7fa6dfa15640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d80b7ee0 con 0x7fa6d80cd800 2024-09-11T22:14:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.306+0000 7fa6dfa15640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d80b78b0 con 0x7fa6c0004d40 2024-09-11T22:14:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.306+0000 7fa6dcfb0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d8158620 0x7fa6d8158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.306+0000 7fa6dcfb0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d8158620 0x7fa6d8158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36558/0 (socket says 172.21.15.50:36558) 2024-09-11T22:14:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.306+0000 7fa6dcfb0640 1 -- 172.21.15.50:0/2997488443 learned_addr learned my addr 172.21.15.50:0/2997488443 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6dd7b1640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6c0004d40 0x7fa6d814eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6ddfb2640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6d80cd800 0x7fa6d80cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6dcfb0640 1 -- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6c0004d40 msgr2=0x7fa6d814eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6dcfb0640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6c0004d40 0x7fa6d814eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6dcfb0640 1 -- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6d80cd800 msgr2=0x7fa6d80cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6dcfb0640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6d80cd800 0x7fa6d80cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6dcfb0640 1 -- 172.21.15.50:0/2997488443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d81590e0 con 0x7fa6d8158620 2024-09-11T22:14:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6ddfb2640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6d80cd800 0x7fa6d80cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6dcfb0640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d8158620 0x7fa6d8158aa0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0119a0 tx=0x7fa6cc011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6d5ffb640 1 -- 172.21.15.50:0/2997488443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00fa90 con 0x7fa6d8158620 2024-09-11T22:14:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6d5ffb640 1 -- 172.21.15.50:0/2997488443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6cc00fc30 con 0x7fa6d8158620 2024-09-11T22:14:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6d5ffb640 1 -- 172.21.15.50:0/2997488443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc014440 con 0x7fa6d8158620 2024-09-11T22:14:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2997488443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d81593c0 con 0x7fa6d8158620 2024-09-11T22:14:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.307+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2997488443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d8159980 con 0x7fa6d8158620 2024-09-11T22:14:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.308+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2997488443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d80d34f0 con 0x7fa6d8158620 2024-09-11T22:14:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.309+0000 7fa6d5ffb640 1 -- 172.21.15.50:0/2997488443 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa6cc012040 con 0x7fa6d8158620 2024-09-11T22:14:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.309+0000 7fa6d5ffb640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa6c406be60 0x7fa6c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.309+0000 7fa6d5ffb640 1 -- 172.21.15.50:0/2997488443 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fa6cc08b480 con 0x7fa6d8158620 2024-09-11T22:14:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.309+0000 7fa6dd7b1640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa6c406be60 0x7fa6c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.310+0000 7fa6dd7b1640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa6c406be60 0x7fa6c406e320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8003ed0 tx=0x7fa6c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:38.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.313+0000 7fa6d5ffb640 1 -- 172.21.15.50:0/2997488443 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6cc019030 con 0x7fa6d8158620 2024-09-11T22:14:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.524+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2997488443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6d815d6a0 con 0x7fa6d8158620 2024-09-11T22:14:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.525+0000 7fa6d5ffb640 1 -- 172.21.15.50:0/2997488443 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5223 (secure 0 0 0) 0x7fa6cc059e30 con 0x7fa6d8158620 2024-09-11T22:14:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:38.526 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":32,"btime":"2024-09-11T22:14:28:953512+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5468,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/4145638619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4145638619},{"type":"v1","addr":"172.21.15.77:6836","nonce":4145638619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3969515798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3969515798},{"type":"v1","addr":"172.21.15.50:6834","nonce":3969515798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2387852280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2387852280},{"type":"v1","addr":"172.21.15.50:6835","nonce":2387852280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:14:26.306529+0000","modified":"2024-09-11T22:14:28.296653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6156":{"gid":6156,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1418437076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1418437076},{"type":"v1","addr":"172.21.15.77:6837","nonce":1418437076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6156,"qdb_cluster":[6156]},"id":4}]} 2024-09-11T22:14:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 32 2024-09-11T22:14:38.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.527+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa6c406be60 msgr2=0x7fa6c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:38.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.527+0000 7fa6dfa15640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa6c406be60 0x7fa6c406e320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8003ed0 tx=0x7fa6c8009040 comp rx=0 tx=0).stop 2024-09-11T22:14:38.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.527+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2997488443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d8158620 msgr2=0x7fa6d8158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:38.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.527+0000 7fa6dfa15640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d8158620 0x7fa6d8158aa0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0119a0 tx=0x7fa6cc011e60 comp rx=0 tx=0).stop 2024-09-11T22:14:38.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.527+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2997488443 shutdown_connections 2024-09-11T22:14:38.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.527+0000 7fa6dfa15640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa6c406be60 0x7fa6c406e320 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.527+0000 7fa6dfa15640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6d80cd800 0x7fa6d80cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.527+0000 7fa6dfa15640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6d8158620 0x7fa6d8158aa0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.527+0000 7fa6dfa15640 1 --2- 172.21.15.50:0/2997488443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6c0004d40 0x7fa6d814eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:38.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.527+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2997488443 >> 172.21.15.50:0/2997488443 conn(0x7fa6d80727a0 msgr2=0x7fa6d8161970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.527+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2997488443 shutdown_connections 2024-09-11T22:14:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38.527+0000 7fa6dfa15640 1 -- 172.21.15.50:0/2997488443 wait complete. 2024-09-11T22:14:38.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump inode 1099511627776 2024-09-11T22:14:38.664 INFO:teuthology.orchestra.run.smithi077.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-11T22:14:38.039523+0000","btime":"2024-09-11T22:14:38.039523+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-11T22:14:38.039523+0000","atime":"2024-09-11T22:14:38.039523+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":5878,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":5878,"want_loner":5878,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-11T22:14:38.665 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-11T22:14:38.039523+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-11T22:14:38.039523+0000", "change_attr": 0, "client_caps": [ { "client_id": 5878, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-11T22:14:38.039523+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 5878, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-11T22:14:38.039523+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 5878, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-11T22:14:38.665 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:14:38.666 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:38.682 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2024-09-11T22:14:38.683 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-11T22:14:38.683 DEBUG:teuthology.orchestra.run.smithi050:> import uuid 2024-09-11T22:14:38.683 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:14:38.683 DEBUG:teuthology.orchestra.run.smithi050:> n = 40 2024-09-11T22:14:38.683 DEBUG:teuthology.orchestra.run.smithi050:> create_hard_links = False 2024-09-11T22:14:38.683 DEBUG:teuthology.orchestra.run.smithi050:> if 0 > 0: 2024-09-11T22:14:38.683 DEBUG:teuthology.orchestra.run.smithi050:> create_hard_links = True 2024-09-11T22:14:38.683 DEBUG:teuthology.orchestra.run.smithi050:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-11T22:14:38.683 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:14:38.683 DEBUG:teuthology.orchestra.run.smithi050:> dpath = os.path.dirname(path) 2024-09-11T22:14:38.683 DEBUG:teuthology.orchestra.run.smithi050:> fnameprefix = os.path.basename(path) 2024-09-11T22:14:38.683 DEBUG:teuthology.orchestra.run.smithi050:> os.makedirs(dpath, exist_ok=True) 2024-09-11T22:14:38.683 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> try: 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> for i in range(n): 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> with open(fpath, '"'"'w'"'"') as f: 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> f.write(f"{i}") 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> f.flush() 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(f.fileno()) 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> os.unlink(fpath) 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(dirfd) 2024-09-11T22:14:38.684 DEBUG:teuthology.orchestra.run.smithi050:> if create_hard_links: 2024-09-11T22:14:38.685 DEBUG:teuthology.orchestra.run.smithi050:> for j in range(0): 2024-09-11T22:14:38.685 DEBUG:teuthology.orchestra.run.smithi050:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-11T22:14:38.685 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:14:38.685 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(dirfd) 2024-09-11T22:14:38.685 DEBUG:teuthology.orchestra.run.smithi050:> finally: 2024-09-11T22:14:38.685 DEBUG:teuthology.orchestra.run.smithi050:> os.close(dirfd) 2024-09-11T22:14:38.685 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-11T22:14:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:14:38.856 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:14:38.856 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:38.913 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:14:38.913 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:38.969 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:14:39.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.111+0000 7ff11dd6d640 1 Processor -- start 2024-09-11T22:14:39.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.111+0000 7ff11dd6d640 1 -- start start 2024-09-11T22:14:39.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff11dd6d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff11815fd80 0x7ff1180b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff11dd6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1180af4c0 0x7ff1180b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff11dd6d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1180af940 con 0x7ff1180b2970 2024-09-11T22:14:39.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff11dd6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff1180afc20 con 0x7ff1180af4c0 2024-09-11T22:14:39.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff11dd6d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff1180aff00 con 0x7ff11815fd80 2024-09-11T22:14:39.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff116ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1180af4c0 0x7ff1180b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff117fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff1180b2970 0x7ff1180d04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38764/0 (socket says 172.21.15.50:38764) 2024-09-11T22:14:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff117fff640 1 -- 172.21.15.50:0/1079308945 learned_addr learned my addr 172.21.15.50:0/1079308945 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff1177fe640 1 --2- 172.21.15.50:0/1079308945 >> v2:172.21.15.77:3300/0 conn(0x7ff11815fd80 0x7ff1180b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff116ffd640 1 -- 172.21.15.50:0/1079308945 >> v2:172.21.15.77:3300/0 conn(0x7ff11815fd80 msgr2=0x7ff1180b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff116ffd640 1 --2- 172.21.15.50:0/1079308945 >> v2:172.21.15.77:3300/0 conn(0x7ff11815fd80 0x7ff1180b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff116ffd640 1 -- 172.21.15.50:0/1079308945 >> v1:172.21.15.50:6789/0 conn(0x7ff1180b2970 legacy=0x7ff1180d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff116ffd640 1 -- 172.21.15.50:0/1079308945 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1180b01e0 con 0x7ff1180af4c0 2024-09-11T22:14:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff1167fc640 1 -- 172.21.15.50:0/1079308945 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3730415041 0 0) 0x7ff1180af940 con 0x7ff1180b2970 2024-09-11T22:14:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.112+0000 7ff1177fe640 1 --2- 172.21.15.50:0/1079308945 >> v2:172.21.15.77:3300/0 conn(0x7ff11815fd80 0x7ff1180b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:39.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.113+0000 7ff116ffd640 1 --2- 172.21.15.50:0/1079308945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1180af4c0 0x7ff1180b2430 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff11806f0a0 tx=0x7ff10c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0956d5a222a000c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.113+0000 7ff1167fc640 1 -- 172.21.15.50:0/1079308945 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c037070 con 0x7ff1180af4c0 2024-09-11T22:14:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.113+0000 7ff1167fc640 1 -- 172.21.15.50:0/1079308945 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff10c032440 con 0x7ff1180af4c0 2024-09-11T22:14:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.113+0000 7ff1167fc640 1 -- 172.21.15.50:0/1079308945 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c02ae60 con 0x7ff1180af4c0 2024-09-11T22:14:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.113+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1079308945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1180af4c0 msgr2=0x7ff1180b2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.113+0000 7ff11dd6d640 1 --2- 172.21.15.50:0/1079308945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1180af4c0 0x7ff1180b2430 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff11806f0a0 tx=0x7ff10c02a110 comp rx=0 tx=0).stop 2024-09-11T22:14:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.114+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1079308945 shutdown_connections 2024-09-11T22:14:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.114+0000 7ff11dd6d640 1 --2- 172.21.15.50:0/1079308945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1180af4c0 0x7ff1180b2430 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.114+0000 7ff11dd6d640 1 --2- 172.21.15.50:0/1079308945 >> v2:172.21.15.77:3300/0 conn(0x7ff11815fd80 0x7ff1180b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.114+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1079308945 >> 172.21.15.50:0/1079308945 conn(0x7ff11809ba50 msgr2=0x7ff1180b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.114+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1079308945 shutdown_connections 2024-09-11T22:14:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.114+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1079308945 wait complete. 2024-09-11T22:14:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.115+0000 7ff11dd6d640 1 Processor -- start 2024-09-11T22:14:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.115+0000 7ff11dd6d640 1 -- start start 2024-09-11T22:14:39.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff11dd6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1180af4c0 0x7ff118154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff11dd6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1180b2970 0x7ff118156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff11dd6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff11815fd80 0x7ff118157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff11dd6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff118160160 con 0x7ff1180b2970 2024-09-11T22:14:39.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff11dd6d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1180b3ee0 con 0x7ff1180af4c0 2024-09-11T22:14:39.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff11dd6d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1181602e0 con 0x7ff11815fd80 2024-09-11T22:14:39.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff116ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1180b2970 0x7ff118156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff116ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1180b2970 0x7ff118156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36572/0 (socket says 172.21.15.50:36572) 2024-09-11T22:14:39.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff116ffd640 1 -- 172.21.15.50:0/1815631160 learned_addr learned my addr 172.21.15.50:0/1815631160 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:39.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff1177fe640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1180af4c0 0x7ff118154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff117fff640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff11815fd80 0x7ff118157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff116ffd640 1 -- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff11815fd80 msgr2=0x7ff118157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff116ffd640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff11815fd80 0x7ff118157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff116ffd640 1 -- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1180af4c0 msgr2=0x7ff118154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff116ffd640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1180af4c0 0x7ff118154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff116ffd640 1 -- 172.21.15.50:0/1815631160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff118157790 con 0x7ff1180b2970 2024-09-11T22:14:39.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff1177fe640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1180af4c0 0x7ff118154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:39.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff116ffd640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1180b2970 0x7ff118156b20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009890 tx=0x7ff10c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.116+0000 7ff0fffff640 1 -- 172.21.15.50:0/1815631160 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c037040 con 0x7ff1180b2970 2024-09-11T22:14:39.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.117+0000 7ff0fffff640 1 -- 172.21.15.50:0/1815631160 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff10c042070 con 0x7ff1180b2970 2024-09-11T22:14:39.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.117+0000 7ff0fffff640 1 -- 172.21.15.50:0/1815631160 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c030bd0 con 0x7ff1180b2970 2024-09-11T22:14:39.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.117+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1815631160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff118157a70 con 0x7ff1180b2970 2024-09-11T22:14:39.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.117+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1815631160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11806c080 con 0x7ff1180b2970 2024-09-11T22:14:39.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.118+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1815631160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1180b1ef0 con 0x7ff1180b2970 2024-09-11T22:14:39.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.118+0000 7ff0fffff640 1 -- 172.21.15.50:0/1815631160 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff10c047460 con 0x7ff1180b2970 2024-09-11T22:14:39.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.119+0000 7ff0fffff640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff10406be30 0x7ff10406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.119+0000 7ff0fffff640 1 -- 172.21.15.50:0/1815631160 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7ff10c0aba30 con 0x7ff1180b2970 2024-09-11T22:14:39.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.119+0000 7ff1177fe640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff10406be30 0x7ff10406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.119+0000 7ff1177fe640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff10406be30 0x7ff10406e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff1180b1640 tx=0x7ff108008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.123+0000 7ff0fffff640 1 -- 172.21.15.50:0/1815631160 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff10c032e20 con 0x7ff1180b2970 2024-09-11T22:14:39.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.310+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1815631160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff1180b8360 con 0x7ff1180b2970 2024-09-11T22:14:39.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.311+0000 7ff0fffff640 1 -- 172.21.15.50:0/1815631160 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) ==== 80+0+0 (secure 0 0 0) 0x7ff10c07a3e0 con 0x7ff1180b2970 2024-09-11T22:14:39.311 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:14:39.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.312+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff10406be30 msgr2=0x7ff10406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.312+0000 7ff11dd6d640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff10406be30 0x7ff10406e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff1180b1640 tx=0x7ff108008040 comp rx=0 tx=0).stop 2024-09-11T22:14:39.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.312+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1815631160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1180b2970 msgr2=0x7ff118156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.312+0000 7ff11dd6d640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1180b2970 0x7ff118156b20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009890 tx=0x7ff10c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.312+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1815631160 shutdown_connections 2024-09-11T22:14:39.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.312+0000 7ff11dd6d640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff10406be30 0x7ff10406e2f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.312+0000 7ff11dd6d640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff11815fd80 0x7ff118157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.312+0000 7ff11dd6d640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1180b2970 0x7ff118156b20 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.312+0000 7ff11dd6d640 1 --2- 172.21.15.50:0/1815631160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1180af4c0 0x7ff118154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.312+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1815631160 >> 172.21.15.50:0/1815631160 conn(0x7ff11809ba50 msgr2=0x7ff1180b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:39.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.313+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1815631160 shutdown_connections 2024-09-11T22:14:39.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.313+0000 7ff11dd6d640 1 -- 172.21.15.50:0/1815631160 wait complete. 2024-09-11T22:14:39.324 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:14:39.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:39.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:14:39.419 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:14:39.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:39.420 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:14:39.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-11T22:14:39.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.579+0000 7fbcfe2f1640 1 Processor -- start 2024-09-11T22:14:39.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.579+0000 7fbcfe2f1640 1 -- start start 2024-09-11T22:14:39.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.580+0000 7fbcfe2f1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbcf815e8e0 0x7fbcf80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.580+0000 7fbcfe2f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf80d1580 0x7fbcf80d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.580+0000 7fbcfe2f1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf80d1ee0 con 0x7fbcf8162350 2024-09-11T22:14:39.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.580+0000 7fbcfe2f1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf815ecc0 con 0x7fbcf815e8e0 2024-09-11T22:14:39.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.580+0000 7fbcfe2f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf80d2ad0 con 0x7fbcf80d1580 2024-09-11T22:14:39.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.580+0000 7fbcf77fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf80d1580 0x7fbcf80d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.580+0000 7fbcf7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbcf815e8e0 0x7fbcf80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.580+0000 7fbcfc88e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbcf8162350 0x7fbcf8162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:39652/0 (socket says 172.21.15.50:39652) 2024-09-11T22:14:39.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.580+0000 7fbcf77fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf80d1580 0x7fbcf80d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:51290/0 (socket says 172.21.15.50:51290) 2024-09-11T22:14:39.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.580+0000 7fbcfc88e640 1 -- 172.21.15.50:0/2051149258 learned_addr learned my addr 172.21.15.50:0/2051149258 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:39.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.580+0000 7fbcf7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbcf815e8e0 0x7fbcf80b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:41020/0 (socket says 172.21.15.50:41020) 2024-09-11T22:14:39.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.581+0000 7fbcf77fe640 1 -- 172.21.15.50:0/2051149258 >> v2:172.21.15.77:3300/0 conn(0x7fbcf815e8e0 msgr2=0x7fbcf80b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.581+0000 7fbcf77fe640 1 --2- 172.21.15.50:0/2051149258 >> v2:172.21.15.77:3300/0 conn(0x7fbcf815e8e0 0x7fbcf80b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.581+0000 7fbcf77fe640 1 -- 172.21.15.50:0/2051149258 >> v1:172.21.15.77:6789/0 conn(0x7fbcf8162350 legacy=0x7fbcf8162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.581+0000 7fbcf77fe640 1 -- 172.21.15.50:0/2051149258 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf8163080 con 0x7fbcf80d1580 2024-09-11T22:14:39.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.581+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/2051149258 >> v2:172.21.15.77:3300/0 conn(0x7fbcf815e8e0 0x7fbcf80b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:39.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.581+0000 7fbcf77fe640 1 --2- 172.21.15.50:0/2051149258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf80d1580 0x7fbcf80d19a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbce00097a0 tx=0x7fbce002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e352f1aa27a79474 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.581+0000 7fbcf6ffd640 1 -- 172.21.15.50:0/2051149258 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0037070 con 0x7fbcf80d1580 2024-09-11T22:14:39.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.582+0000 7fbcf6ffd640 1 -- 172.21.15.50:0/2051149258 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce0032440 con 0x7fbcf80d1580 2024-09-11T22:14:39.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.582+0000 7fbcf6ffd640 1 -- 172.21.15.50:0/2051149258 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0032810 con 0x7fbcf80d1580 2024-09-11T22:14:39.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.582+0000 7fbcfe2f1640 1 -- 172.21.15.50:0/2051149258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf80d1580 msgr2=0x7fbcf80d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.582+0000 7fbcfe2f1640 1 --2- 172.21.15.50:0/2051149258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf80d1580 0x7fbcf80d19a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbce00097a0 tx=0x7fbce002a210 comp rx=0 tx=0).stop 2024-09-11T22:14:39.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.582+0000 7fbcfe2f1640 1 -- 172.21.15.50:0/2051149258 shutdown_connections 2024-09-11T22:14:39.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.582+0000 7fbcfe2f1640 1 --2- 172.21.15.50:0/2051149258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf80d1580 0x7fbcf80d19a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.582+0000 7fbcfe2f1640 1 --2- 172.21.15.50:0/2051149258 >> v2:172.21.15.77:3300/0 conn(0x7fbcf815e8e0 0x7fbcf80b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.582+0000 7fbcfe2f1640 1 -- 172.21.15.50:0/2051149258 >> 172.21.15.50:0/2051149258 conn(0x7fbcf8067ba0 msgr2=0x7fbcf8067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:39.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.582+0000 7fbcfe2f1640 1 -- 172.21.15.50:0/2051149258 shutdown_connections 2024-09-11T22:14:39.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.582+0000 7fbcfe2f1640 1 -- 172.21.15.50:0/2051149258 wait complete. 2024-09-11T22:14:39.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.583+0000 7fbcfe2f1640 1 Processor -- start 2024-09-11T22:14:39.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.583+0000 7fbcfe2f1640 1 -- start start 2024-09-11T22:14:39.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.584+0000 7fbcfe2f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf80d1580 0x7fbcf8156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.584+0000 7fbcfe2f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf815e8e0 0x7fbcf80b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.584+0000 7fbcfe2f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8162350 0x7fbcf81e7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.584+0000 7fbcfe2f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf80d3000 con 0x7fbcf8162350 2024-09-11T22:14:39.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.584+0000 7fbcfe2f1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf80d3370 con 0x7fbcf815e8e0 2024-09-11T22:14:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.584+0000 7fbcfe2f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf80d3800 con 0x7fbcf80d1580 2024-09-11T22:14:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.584+0000 7fbcfc88e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8162350 0x7fbcf81e7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.584+0000 7fbcfc88e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8162350 0x7fbcf81e7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36588/0 (socket says 172.21.15.50:36588) 2024-09-11T22:14:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.584+0000 7fbcfc88e640 1 -- 172.21.15.50:0/1812994025 learned_addr learned my addr 172.21.15.50:0/1812994025 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.584+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf80d1580 0x7fbcf8156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.584+0000 7fbcf77fe640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf815e8e0 0x7fbcf80b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.585+0000 7fbcfc88e640 1 -- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf80d1580 msgr2=0x7fbcf8156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.585+0000 7fbcfc88e640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf80d1580 0x7fbcf8156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.585+0000 7fbcfc88e640 1 -- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf815e8e0 msgr2=0x7fbcf80b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.585+0000 7fbcfc88e640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf815e8e0 0x7fbcf80b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.585+0000 7fbcfc88e640 1 -- 172.21.15.50:0/1812994025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf80b43f0 con 0x7fbcf8162350 2024-09-11T22:14:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.585+0000 7fbcfc88e640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8162350 0x7fbcf81e7f60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000ca80 tx=0x7fbcf000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.585+0000 7fbcf4ff9640 1 -- 172.21.15.50:0/1812994025 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0017070 con 0x7fbcf8162350 2024-09-11T22:14:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.585+0000 7fbcf4ff9640 1 -- 172.21.15.50:0/1812994025 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf000ac30 con 0x7fbcf8162350 2024-09-11T22:14:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.585+0000 7fbcfe2f1640 1 -- 172.21.15.50:0/1812994025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf80b46d0 con 0x7fbcf8162350 2024-09-11T22:14:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.585+0000 7fbcf4ff9640 1 -- 172.21.15.50:0/1812994025 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0012600 con 0x7fbcf8162350 2024-09-11T22:14:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.585+0000 7fbcfe2f1640 1 -- 172.21.15.50:0/1812994025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf80b4c90 con 0x7fbcf8162350 2024-09-11T22:14:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.587+0000 7fbcf4ff9640 1 -- 172.21.15.50:0/1812994025 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcf001a070 con 0x7fbcf8162350 2024-09-11T22:14:39.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.587+0000 7fbcf4ff9640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbcd806be30 0x7fbcd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.587+0000 7fbcf4ff9640 1 -- 172.21.15.50:0/1812994025 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fbcf008aa80 con 0x7fbcf8162350 2024-09-11T22:14:39.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.587+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbcd806be30 0x7fbcd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.588+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbcd806be30 0x7fbcd806e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbcf81f7b60 tx=0x7fbce8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.588+0000 7fbd0108b740 1 Processor -- start 2024-09-11T22:14:39.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.588+0000 7fbd0108b740 1 -- start start 2024-09-11T22:14:39.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbd0108b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 0x5564083720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbd0108b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832a0e0 0x55640832cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbd0108b740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55640832e0b0 0x5564083271a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbd0108b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55640828f6f0 con 0x55640832c920 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbd0108b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556408237330 con 0x55640832a0e0 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbd0108b740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55640828b6b0 con 0x55640832e0b0 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbcf7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 0x5564083720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbcf7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 0x5564083720c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36596/0 (socket says 172.21.15.50:36596) 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbcf7fff640 1 -- 172.21.15.50:0/2563053641 learned_addr learned my addr 172.21.15.50:0/2563053641 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbcfc88e640 1 --2- 172.21.15.50:0/2563053641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55640832e0b0 0x5564083271a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbcf77fe640 1 --2- 172.21.15.50:0/2563053641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832a0e0 0x55640832cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbcf7fff640 1 -- 172.21.15.50:0/2563053641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55640832e0b0 msgr2=0x5564083271a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/2563053641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55640832e0b0 0x5564083271a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbcf7fff640 1 -- 172.21.15.50:0/2563053641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832a0e0 msgr2=0x55640832cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/2563053641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832a0e0 0x55640832cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbcf7fff640 1 -- 172.21.15.50:0/2563053641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55640825d0d0 con 0x55640832c920 2024-09-11T22:14:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/2563053641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 0x5564083720c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbce8011e80 tx=0x7fbce8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5e5a49457c22b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.589+0000 7fbcedffb640 1 -- 172.21.15.50:0/2563053641 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8014c90 con 0x55640832c920 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.590+0000 7fbcedffb640 1 -- 172.21.15.50:0/2563053641 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce801b070 con 0x55640832c920 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.590+0000 7fbcedffb640 1 -- 172.21.15.50:0/2563053641 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8004230 con 0x55640832c920 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.590+0000 7fbd0108b740 1 -- 172.21.15.50:0/2563053641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 msgr2=0x5564083720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.590+0000 7fbd0108b740 1 --2- 172.21.15.50:0/2563053641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 0x5564083720c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbce8011e80 tx=0x7fbce8014000 comp rx=0 tx=0).stop 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.590+0000 7fbd0108b740 1 -- 172.21.15.50:0/2563053641 shutdown_connections 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.590+0000 7fbd0108b740 1 --2- 172.21.15.50:0/2563053641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55640832e0b0 0x5564083271a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.590+0000 7fbd0108b740 1 --2- 172.21.15.50:0/2563053641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832a0e0 0x55640832cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.590+0000 7fbd0108b740 1 --2- 172.21.15.50:0/2563053641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 0x5564083720c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.590+0000 7fbd0108b740 1 -- 172.21.15.50:0/2563053641 >> 172.21.15.50:0/2563053641 conn(0x556408329370 msgr2=0x556408371590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.590+0000 7fbd0108b740 1 -- 172.21.15.50:0/2563053641 shutdown_connections 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.590+0000 7fbd0108b740 1 -- 172.21.15.50:0/2563053641 wait complete. 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.591+0000 7fbd0108b740 1 -- start start 2024-09-11T22:14:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.591+0000 7fbd0108b740 1 Processor -- start 2024-09-11T22:14:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbd0108b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832c920 0x556408381780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbd0108b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 0x556408327050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbd0108b740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5564083546c0 0x556408327590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbd0108b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556408328810 con 0x55640832e0b0 2024-09-11T22:14:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbd0108b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5564082184f0 con 0x55640832c920 2024-09-11T22:14:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbd0108b740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5564083728f0 con 0x5564083546c0 2024-09-11T22:14:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbd0108b740 10 client.0 _ll_register_callbacks cb 0x556408239b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbcf77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 0x556408327050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbcf77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 0x556408327050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36604/0 (socket says 172.21.15.50:36604) 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbcf77fe640 1 -- 172.21.15.50:0/1279295964 learned_addr learned my addr 172.21.15.50:0/1279295964 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/1279295964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832c920 0x556408381780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbcfc88e640 1 --2- 172.21.15.50:0/1279295964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5564083546c0 0x556408327590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbcf77fe640 1 -- 172.21.15.50:0/1279295964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5564083546c0 msgr2=0x556408327590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbcf77fe640 1 --2- 172.21.15.50:0/1279295964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5564083546c0 0x556408327590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbcf77fe640 1 -- 172.21.15.50:0/1279295964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832c920 msgr2=0x556408381780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbcf77fe640 1 --2- 172.21.15.50:0/1279295964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832c920 0x556408381780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbcf77fe640 1 -- 172.21.15.50:0/1279295964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55640806c7d0 con 0x55640832e0b0 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbcf77fe640 1 --2- 172.21.15.50:0/1279295964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 0x556408327050 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbce00098c0 tx=0x7fbce002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe06b748dde5e5c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.592+0000 7fbcd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbcd6ffd640 1 -- 172.21.15.50:0/1279295964 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce004b060 con 0x55640832e0b0 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbcd6ffd640 1 -- 172.21.15.50:0/1279295964 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fbce0032d10 con 0x55640832e0b0 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbd0108b740 1 -- 172.21.15.50:0/1279295964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbce801b070 con 0x55640832e0b0 2024-09-11T22:14:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbcd6ffd640 1 -- 172.21.15.50:0/1279295964 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbce0051050 con 0x55640832e0b0 2024-09-11T22:14:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbd0108b740 10 client.6360 fetch_fsmap learned FSMap version 32 2024-09-11T22:14:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbd0108b740 1 -- 172.21.15.50:0/1279295964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) -- 0x556407fa23f0 con 0x55640832e0b0 2024-09-11T22:14:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbcd6ffd640 1 -- 172.21.15.50:0/1279295964 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce801b070 con 0x55640832e0b0 2024-09-11T22:14:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbcd6ffd640 1 -- 172.21.15.50:0/1279295964 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 3502+0+0 (secure 0 0 0) 0x7fbce0054020 con 0x55640832e0b0 2024-09-11T22:14:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbd0108b740 10 client.6360 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T22:14:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbd0108b740 10 client.6360 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-09-11T22:14:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbd0108b740 20 client.6360 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbd0108b740 1 --2- 172.21.15.50:0/1279295964 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x556408385780 0x556408385bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbd0108b740 4 client.6360 mds_command: new command op to 6156 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbd0108b740 1 -- 172.21.15.50:0/1279295964 --> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55640829ce20 con 0x556408385780 2024-09-11T22:14:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.593+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/1279295964 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x556408385780 0x556408385bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.594+0000 7fbcd6ffd640 10 client.6360 ms_handle_connect on v2:172.21.15.77:6835/1418437076 2024-09-11T22:14:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.594+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/1279295964 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x556408385780 0x556408385bf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6df2f4891b993d2 server_cookie=72b7948c1a165262 in_seq=0 out_seq=0 2024-09-11T22:14:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.594+0000 7fbcd6ffd640 1 -- 172.21.15.50:0/1279295964 <== mds.0 v2:172.21.15.77:6835/1418437076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55640829ce20 con 0x556408385780 2024-09-11T22:14:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.594+0000 7fbcd6ffd640 10 client.6360 handle_command_reply: tid=0 2024-09-11T22:14:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.594+0000 7fbd0108b740 1 client.6360 shutdown 2024-09-11T22:14:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.594+0000 7fbd0108b740 1 -- 172.21.15.50:0/1279295964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 msgr2=0x556408327050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.594+0000 7fbd0108b740 1 --2- 172.21.15.50:0/1279295964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 0x556408327050 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbce00098c0 tx=0x7fbce002c070 comp rx=0 tx=0).stop 2024-09-11T22:14:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.594+0000 7fbd0108b740 1 -- 172.21.15.50:0/1279295964 shutdown_connections 2024-09-11T22:14:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.595+0000 7fbd0108b740 1 --2- 172.21.15.50:0/1279295964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5564083546c0 0x556408327590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.595+0000 7fbd0108b740 1 --2- 172.21.15.50:0/1279295964 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x556408385780 0x556408385bf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.595+0000 7fbd0108b740 1 --2- 172.21.15.50:0/1279295964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 0x556408327050 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.595+0000 7fbd0108b740 1 --2- 172.21.15.50:0/1279295964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832c920 0x556408381780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.595+0000 7fbcd6ffd640 0 client.6360 ms_handle_reset on v2:172.21.15.77:6835/1418437076 2024-09-11T22:14:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.595+0000 7fbd0108b740 1 -- 172.21.15.50:0/1279295964 >> 172.21.15.50:0/1279295964 conn(0x55640832a0e0 msgr2=0x55640836f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.595+0000 7fbd0108b740 1 -- 172.21.15.50:0/1279295964 shutdown_connections 2024-09-11T22:14:39.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.595+0000 7fbd0108b740 1 -- 172.21.15.50:0/1279295964 wait complete. 2024-09-11T22:14:39.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.595+0000 7fbd0108b740 20 client.6360 trim_cache size 0 max 16384 2024-09-11T22:14:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.609+0000 7fbd0108b740 1 Processor -- start 2024-09-11T22:14:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.609+0000 7fbd0108b740 1 -- start start 2024-09-11T22:14:39.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbd0108b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 0x55640836fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbd0108b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832e0b0 0x556408394d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbd0108b740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5564083546c0 0x556408356480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbd0108b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8200db0 con 0x55640832c920 2024-09-11T22:14:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbd0108b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf81ffe50 con 0x55640832e0b0 2024-09-11T22:14:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbd0108b740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf80cdb50 con 0x5564083546c0 2024-09-11T22:14:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbcf7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 0x55640836fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbcf7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 0x55640836fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36606/0 (socket says 172.21.15.50:36606) 2024-09-11T22:14:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbcf7fff640 1 -- 172.21.15.50:0/3328202344 learned_addr learned my addr 172.21.15.50:0/3328202344 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbcf77fe640 1 --2- 172.21.15.50:0/3328202344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832e0b0 0x556408394d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbcfc88e640 1 --2- 172.21.15.50:0/3328202344 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5564083546c0 0x556408356480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbcf7fff640 1 -- 172.21.15.50:0/3328202344 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5564083546c0 msgr2=0x556408356480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/3328202344 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5564083546c0 0x556408356480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbcf7fff640 1 -- 172.21.15.50:0/3328202344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832e0b0 msgr2=0x556408394d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/3328202344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832e0b0 0x556408394d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbcf7fff640 1 -- 172.21.15.50:0/3328202344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55640834d550 con 0x55640832c920 2024-09-11T22:14:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbcf77fe640 1 --2- 172.21.15.50:0/3328202344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832e0b0 0x556408394d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.610+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/3328202344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 0x55640836fc50 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbce8004000 tx=0x7fbce8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6876baf2f4309b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.611+0000 7fbced7fa640 1 -- 172.21.15.50:0/3328202344 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8004240 con 0x55640832c920 2024-09-11T22:14:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.611+0000 7fbced7fa640 1 -- 172.21.15.50:0/3328202344 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce80043e0 con 0x55640832c920 2024-09-11T22:14:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.611+0000 7fbced7fa640 1 -- 172.21.15.50:0/3328202344 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8003850 con 0x55640832c920 2024-09-11T22:14:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.611+0000 7fbd0108b740 1 -- 172.21.15.50:0/3328202344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 msgr2=0x55640836fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.611+0000 7fbd0108b740 1 --2- 172.21.15.50:0/3328202344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 0x55640836fc50 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbce8004000 tx=0x7fbce8016000 comp rx=0 tx=0).stop 2024-09-11T22:14:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.611+0000 7fbd0108b740 1 -- 172.21.15.50:0/3328202344 shutdown_connections 2024-09-11T22:14:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.611+0000 7fbd0108b740 1 --2- 172.21.15.50:0/3328202344 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5564083546c0 0x556408356480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.611+0000 7fbd0108b740 1 --2- 172.21.15.50:0/3328202344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55640832e0b0 0x556408394d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.611+0000 7fbd0108b740 1 --2- 172.21.15.50:0/3328202344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832c920 0x55640836fc50 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.611+0000 7fbd0108b740 1 -- 172.21.15.50:0/3328202344 >> 172.21.15.50:0/3328202344 conn(0x55640832a0e0 msgr2=0x556408370500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.611+0000 7fbd0108b740 1 -- 172.21.15.50:0/3328202344 shutdown_connections 2024-09-11T22:14:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.611+0000 7fbd0108b740 1 -- 172.21.15.50:0/3328202344 wait complete. 2024-09-11T22:14:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.612+0000 7fbd0108b740 1 -- start start 2024-09-11T22:14:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.612+0000 7fbd0108b740 1 Processor -- start 2024-09-11T22:14:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbd0108b740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55640832c920 0x5564083ef690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbd0108b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 0x55640836f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbd0108b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5564083546c0 0x55640836fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbd0108b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf80ce1a0 con 0x55640832e0b0 2024-09-11T22:14:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbd0108b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556408353670 con 0x5564083546c0 2024-09-11T22:14:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbd0108b740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55640834ad00 con 0x55640832c920 2024-09-11T22:14:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbd0108b740 10 client.0 _ll_register_callbacks cb 0x7fbce0009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbcf77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 0x55640836f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbcf77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 0x55640836f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36616/0 (socket says 172.21.15.50:36616) 2024-09-11T22:14:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbcf77fe640 1 -- 172.21.15.50:0/1959217176 learned_addr learned my addr 172.21.15.50:0/1959217176 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:39.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55640832c920 0x5564083ef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbcfc88e640 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5564083546c0 0x55640836fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbcf77fe640 1 -- 172.21.15.50:0/1959217176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55640832c920 msgr2=0x5564083ef690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbcf77fe640 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55640832c920 0x5564083ef690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbcf77fe640 1 -- 172.21.15.50:0/1959217176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5564083546c0 msgr2=0x55640836fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbcf77fe640 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5564083546c0 0x55640836fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbcf77fe640 1 -- 172.21.15.50:0/1959217176 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556407f620f0 con 0x55640832e0b0 2024-09-11T22:14:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbcfc88e640 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5564083546c0 0x55640836fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbcf77fe640 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 0x55640836f540 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fbce002a250 tx=0x7fbce0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ad3a6ec6fa0c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.613+0000 7fbcd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbcd6ffd640 1 -- 172.21.15.50:0/1959217176 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce005a060 con 0x55640832e0b0 2024-09-11T22:14:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbcd6ffd640 1 -- 172.21.15.50:0/1959217176 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fbce0004450 con 0x55640832e0b0 2024-09-11T22:14:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbd0108b740 1 -- 172.21.15.50:0/1959217176 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbce80043e0 con 0x55640832e0b0 2024-09-11T22:14:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbcd6ffd640 1 -- 172.21.15.50:0/1959217176 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbce0060050 con 0x55640832e0b0 2024-09-11T22:14:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbd0108b740 10 client.6366 fetch_fsmap learned FSMap version 32 2024-09-11T22:14:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbd0108b740 1 -- 172.21.15.50:0/1959217176 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) -- 0x556408383e00 con 0x55640832e0b0 2024-09-11T22:14:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbcd6ffd640 1 -- 172.21.15.50:0/1959217176 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce80043e0 con 0x55640832e0b0 2024-09-11T22:14:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbcd6ffd640 1 -- 172.21.15.50:0/1959217176 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 3502+0+0 (secure 0 0 0) 0x7fbce0063020 con 0x55640832e0b0 2024-09-11T22:14:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbd0108b740 10 client.6366 fetch_fsmap finished waiting for FSMap version 32 2024-09-11T22:14:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbd0108b740 10 client.6366 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-09-11T22:14:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbd0108b740 20 client.6366 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbd0108b740 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x5564083472b0 0x55640832ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbd0108b740 4 client.6366 mds_command: new command op to 6156 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:14:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbd0108b740 1 -- 172.21.15.50:0/1959217176 --> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556408297170 con 0x5564083472b0 2024-09-11T22:14:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.614+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x5564083472b0 0x55640832ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.615+0000 7fbcd6ffd640 10 client.6366 ms_handle_connect on v2:172.21.15.77:6835/1418437076 2024-09-11T22:14:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.615+0000 7fbcf7fff640 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x5564083472b0 0x55640832ac40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=794a7f70aec16e53 server_cookie=a27a795ea38524ab in_seq=0 out_seq=0 2024-09-11T22:14:39.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbcd6ffd640 1 -- 172.21.15.50:0/1959217176 <== mds.0 v2:172.21.15.77:6835/1418437076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556408297170 con 0x5564083472b0 2024-09-11T22:14:39.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbcd6ffd640 10 client.6366 handle_command_reply: tid=0 2024-09-11T22:14:39.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbd0108b740 1 client.6366 shutdown 2024-09-11T22:14:39.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbd0108b740 1 -- 172.21.15.50:0/1959217176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 msgr2=0x55640836f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbd0108b740 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 0x55640836f540 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fbce002a250 tx=0x7fbce0004730 comp rx=0 tx=0).stop 2024-09-11T22:14:39.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbd0108b740 1 -- 172.21.15.50:0/1959217176 shutdown_connections 2024-09-11T22:14:39.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbd0108b740 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.77:6835/1418437076,v1:172.21.15.77:6837/1418437076] conn(0x5564083472b0 0x55640832ac40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbd0108b740 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5564083546c0 0x55640836fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbd0108b740 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55640832e0b0 0x55640836f540 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbd0108b740 1 --2- 172.21.15.50:0/1959217176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55640832c920 0x5564083ef690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbcd6ffd640 0 client.6366 ms_handle_reset on v2:172.21.15.77:6835/1418437076 2024-09-11T22:14:39.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbd0108b740 1 -- 172.21.15.50:0/1959217176 >> 172.21.15.50:0/1959217176 conn(0x55640832a0e0 msgr2=0x556408356480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:39.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbd0108b740 1 -- 172.21.15.50:0/1959217176 shutdown_connections 2024-09-11T22:14:39.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbd0108b740 1 -- 172.21.15.50:0/1959217176 wait complete. 2024-09-11T22:14:39.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.627+0000 7fbd0108b740 20 client.6366 trim_cache size 0 max 16384 2024-09-11T22:14:39.630 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:39.630 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:14:39.630 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:14:39.630 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:39.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.628+0000 7fbcfe2f1640 1 -- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbcd806be30 msgr2=0x7fbcd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.628+0000 7fbcfe2f1640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbcd806be30 0x7fbcd806e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbcf81f7b60 tx=0x7fbce8009190 comp rx=0 tx=0).stop 2024-09-11T22:14:39.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.628+0000 7fbcfe2f1640 1 -- 172.21.15.50:0/1812994025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8162350 msgr2=0x7fbcf81e7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.628+0000 7fbcfe2f1640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8162350 0x7fbcf81e7f60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000ca80 tx=0x7fbcf000cf40 comp rx=0 tx=0).stop 2024-09-11T22:14:39.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.628+0000 7fbcfe2f1640 1 -- 172.21.15.50:0/1812994025 shutdown_connections 2024-09-11T22:14:39.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.628+0000 7fbcfe2f1640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbcd806be30 0x7fbcd806e2f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.628+0000 7fbcfe2f1640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf8162350 0x7fbcf81e7f60 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.628+0000 7fbcfe2f1640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf815e8e0 0x7fbcf80b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.628+0000 7fbcfe2f1640 1 --2- 172.21.15.50:0/1812994025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf80d1580 0x7fbcf8156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.628+0000 7fbcfe2f1640 1 -- 172.21.15.50:0/1812994025 >> 172.21.15.50:0/1812994025 conn(0x7fbcf8067ba0 msgr2=0x7fbcf815dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:39.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.628+0000 7fbcfe2f1640 1 -- 172.21.15.50:0/1812994025 shutdown_connections 2024-09-11T22:14:39.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.628+0000 7fbcfe2f1640 1 -- 172.21.15.50:0/1812994025 wait complete. 2024-09-11T22:14:39.640 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:14:39.640 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:14:39.640 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:14:39.640 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:14:39.641 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:14:39.641 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:14:39.641 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:14:39.641 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:14:39.650 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:14:39.650 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-11T22:14:39.651 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:14:39.651 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-11T22:14:39.652 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:14:39.653 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-11T22:14:39.653 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:14:39.653 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-11T22:14:39.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.798+0000 7fdf10ef1640 1 Processor -- start 2024-09-11T22:14:39.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.798+0000 7f7597503640 1 Processor -- start 2024-09-11T22:14:39.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.798+0000 7fdf10ef1640 1 -- start start 2024-09-11T22:14:39.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.798+0000 7f7597503640 1 -- start start 2024-09-11T22:14:39.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.799+0000 7f6189186640 1 Processor -- start 2024-09-11T22:14:39.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.799+0000 7f9d45265640 1 Processor -- start 2024-09-11T22:14:39.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.799+0000 7f9d45265640 1 -- start start 2024-09-11T22:14:39.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.799+0000 7f6189186640 1 -- start start 2024-09-11T22:14:39.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.799+0000 7fdf10ef1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdf0c06d780 0x7fdf0c072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.799+0000 7fdf10ef1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf0c15bb00 0x7fdf0c0b3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.799+0000 7fdf10ef1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf0c0b5020 con 0x7fdf0c15aad0 2024-09-11T22:14:39.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7fdf10ef1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0c15aeb0 con 0x7fdf0c06d780 2024-09-11T22:14:39.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7fdf10ef1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0c0714d0 con 0x7fdf0c15bb00 2024-09-11T22:14:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f9d45265640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d4015fb40 0x7f9d400d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f9d45265640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d40070430 0x7f9d400d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f7597503640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f759015e870 0x7f75900d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7fdf09d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdf0c06d780 0x7fdf0c072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7fdf0a59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdf0c15aad0 0x7fdf0c06d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:39656/0 (socket says 172.21.15.50:39656) 2024-09-11T22:14:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7fdf0a59c640 1 -- 172.21.15.50:0/2450820196 learned_addr learned my addr 172.21.15.50:0/2450820196 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f7597503640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75900d3c00 0x7f75900b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7fdf0ad9d640 1 --2- 172.21.15.50:0/2450820196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf0c15bb00 0x7fdf0c0b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f7597503640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75900cfa80 con 0x7f75900d16d0 2024-09-11T22:14:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f7597503640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f75900d1b10 con 0x7f75900d3c00 2024-09-11T22:14:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f7597503640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f75900d40d0 con 0x7f759015e870 2024-09-11T22:14:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f759529f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f759015e870 0x7f75900d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f759529f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f759015e870 0x7f75900d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:51342/0 (socket says 172.21.15.50:51342) 2024-09-11T22:14:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f7595aa0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75900d3c00 0x7f75900b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f759529f640 1 -- 172.21.15.50:0/3840666261 learned_addr learned my addr 172.21.15.50:0/3840666261 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f6189186640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840b0eb0 0x7f61840af430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7fdf09d9b640 1 -- 172.21.15.50:0/2450820196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf0c15bb00 msgr2=0x7fdf0c0b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7fdf09d9b640 1 --2- 172.21.15.50:0/2450820196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf0c15bb00 0x7fdf0c0b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7fdf09d9b640 1 -- 172.21.15.50:0/2450820196 >> v1:172.21.15.77:6789/0 conn(0x7fdf0c15aad0 legacy=0x7fdf0c06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f6189186640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61840afe10 con 0x7f61840af970 2024-09-11T22:14:39.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7fdf0959a640 1 -- 172.21.15.50:0/2450820196 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1920467963 0 0) 0x7fdf0c0b5020 con 0x7fdf0c15aad0 2024-09-11T22:14:39.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f9d3effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d4015fb40 0x7f9d400d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7fdf09d9b640 1 -- 172.21.15.50:0/2450820196 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0c0717b0 con 0x7fdf0c06d780 2024-09-11T22:14:39.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f6189186640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61840b00f0 con 0x7f61840c5570 2024-09-11T22:14:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f6182d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f61840c5570 0x7f61840c5950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:39664/0 (socket says 172.21.15.50:39664) 2024-09-11T22:14:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f618259c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840b0eb0 0x7f61840af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f6189186640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f61840b0a20 con 0x7f61840b0eb0 2024-09-11T22:14:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f618359e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f61840af970 0x7f618406bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38780/0 (socket says 172.21.15.50:38780) 2024-09-11T22:14:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f6182d9d640 1 -- 172.21.15.50:0/471403853 learned_addr learned my addr 172.21.15.50:0/471403853 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14219407 0 0) 0x7f7580001110 con 0x7f75900d16d0 2024-09-11T22:14:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f757c003520 con 0x7f75900d16d0 2024-09-11T22:14:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 <== mon.1 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2927970450 0 0) 0x7f757c003520 con 0x7f75900d16d0 2024-09-11T22:14:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f759015e870 msgr2=0x7f75900d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f6181d9b640 1 -- 172.21.15.50:0/471403853 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439723401 0 0) 0x7f61840b00f0 con 0x7f61840c5570 2024-09-11T22:14:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f6181d9b640 1 -- 172.21.15.50:0/471403853 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f616c003520 con 0x7f61840c5570 2024-09-11T22:14:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f9d3effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d4015fb40 0x7f9d400d05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36624/0 (socket says 172.21.15.50:36624) 2024-09-11T22:14:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f9d45265640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9d400d1190 0x7f9d4006f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f9d45265640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9d400b0630 con 0x7f9d4015fb40 2024-09-11T22:14:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f9d45265640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9d40070910 con 0x7f9d400d1190 2024-09-11T22:14:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f9d45265640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9d400affe0 con 0x7f9d40070430 2024-09-11T22:14:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f618259c640 1 -- 172.21.15.50:0/471403853 >> v1:172.21.15.77:6789/0 conn(0x7f61840c5570 legacy=0x7f61840c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f618259c640 1 -- 172.21.15.50:0/471403853 >> v1:172.21.15.50:6789/0 conn(0x7f61840af970 legacy=0x7f618406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f9d3e7fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d40070430 0x7f9d400d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f9d3effd640 1 -- 172.21.15.50:0/3076811216 learned_addr learned my addr 172.21.15.50:0/3076811216 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.800+0000 7f9d3f7fe640 1 --2- 172.21.15.50:0/3076811216 >> v2:172.21.15.77:3300/0 conn(0x7f9d400d1190 0x7f9d4006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 --2- 172.21.15.50:0/3840666261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f759015e870 0x7f75900d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 >> v2:172.21.15.50:3300/0 conn(0x7f75900d3c00 msgr2=0x7f75900b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 --2- 172.21.15.50:0/3840666261 >> v2:172.21.15.50:3300/0 conn(0x7f75900d3c00 0x7f75900b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f9d3effd640 1 -- 172.21.15.50:0/3076811216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d40070430 msgr2=0x7f9d400d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f9d3effd640 1 --2- 172.21.15.50:0/3076811216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d40070430 0x7f9d400d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f9d3effd640 1 -- 172.21.15.50:0/3076811216 >> v2:172.21.15.77:3300/0 conn(0x7f9d400d1190 msgr2=0x7f9d4006f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f9d3effd640 1 --2- 172.21.15.50:0/3076811216 >> v2:172.21.15.77:3300/0 conn(0x7f9d400d1190 0x7f9d4006f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f9d3effd640 1 -- 172.21.15.50:0/3076811216 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d400b02c0 con 0x7f9d4015fb40 2024-09-11T22:14:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75900d43b0 con 0x7f75900d16d0 2024-09-11T22:14:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 <== mon.1 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f7580001860 con 0x7f75900d16d0 2024-09-11T22:14:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 >> v1:172.21.15.77:6789/0 conn(0x7f75900d16d0 legacy=0x7f75900d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 --2- 172.21.15.50:0/3840666261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f757c0039b0 0x7f757c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 --2- 172.21.15.50:0/3840666261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c0043a0 0x7f757c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 --2- 172.21.15.50:0/3840666261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f757c004ef0 0x7f757c0141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f75900d1b10 con 0x7f757c0043a0 2024-09-11T22:14:39.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f75900d40d0 con 0x7f757c004ef0 2024-09-11T22:14:39.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f757c014710 con 0x7f757c0039b0 2024-09-11T22:14:39.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f618259c640 1 -- 172.21.15.50:0/471403853 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61840b03d0 con 0x7f61840b0eb0 2024-09-11T22:14:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f759529f640 1 --2- 172.21.15.50:0/3840666261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f759015e870 0x7f75900d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7594a9e640 1 --2- 172.21.15.50:0/3840666261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c0043a0 0x7f757c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f7595aa0640 1 --2- 172.21.15.50:0/3840666261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f757c004ef0 0x7f757c0141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.801+0000 7f759529f640 1 --2- 172.21.15.50:0/3840666261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f757c0039b0 0x7f757c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7f7594a9e640 1 -- 172.21.15.50:0/3840666261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f757c0039b0 msgr2=0x7f757c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7f7594a9e640 1 --2- 172.21.15.50:0/3840666261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f757c0039b0 0x7f757c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7f7594a9e640 1 -- 172.21.15.50:0/3840666261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f757c004ef0 msgr2=0x7f757c0141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7f7594a9e640 1 --2- 172.21.15.50:0/3840666261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f757c004ef0 0x7f757c0141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7f7594a9e640 1 -- 172.21.15.50:0/3840666261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757c003520 con 0x7f757c0043a0 2024-09-11T22:14:39.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7fdf09d9b640 1 --2- 172.21.15.50:0/2450820196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0c06d780 0x7fdf0c072cb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdf000097a0 tx=0x7fdf0002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0eeed79e899dc8a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7f9d3effd640 1 --2- 172.21.15.50:0/3076811216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4015fb40 0x7f9d400d05f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9d400c6040 tx=0x7f9d30032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dec7d50aa7f19f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7fdf0959a640 1 -- 172.21.15.50:0/2450820196 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf00037070 con 0x7fdf0c06d780 2024-09-11T22:14:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7fdf0959a640 1 -- 172.21.15.50:0/2450820196 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf00032440 con 0x7fdf0c06d780 2024-09-11T22:14:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7fdf0959a640 1 -- 172.21.15.50:0/2450820196 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf00032810 con 0x7fdf0c06d780 2024-09-11T22:14:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7f618259c640 1 --2- 172.21.15.50:0/471403853 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840b0eb0 0x7f61840af430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61780097d0 tx=0x7f617802a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c807395f04759021 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7f9d3dffb640 1 -- 172.21.15.50:0/3076811216 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d30040070 con 0x7f9d4015fb40 2024-09-11T22:14:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7f9d3dffb640 1 -- 172.21.15.50:0/3076811216 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d30033780 con 0x7f9d4015fb40 2024-09-11T22:14:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7f9d3dffb640 1 -- 172.21.15.50:0/3076811216 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d30033b50 con 0x7f9d4015fb40 2024-09-11T22:14:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7f6181d9b640 1 -- 172.21.15.50:0/471403853 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178037070 con 0x7f61840b0eb0 2024-09-11T22:14:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7f6181d9b640 1 -- 172.21.15.50:0/471403853 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617802ad40 con 0x7f61840b0eb0 2024-09-11T22:14:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.802+0000 7f6181d9b640 1 -- 172.21.15.50:0/471403853 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178032660 con 0x7f61840b0eb0 2024-09-11T22:14:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f7594a9e640 1 --2- 172.21.15.50:0/3840666261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c0043a0 0x7f757c004880 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f75900b41b0 tx=0x7f757c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2b3e92bb860f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7fdf10ef1640 1 -- 172.21.15.50:0/2450820196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0c06d780 msgr2=0x7fdf0c072cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758000c0e0 con 0x7f757c0043a0 2024-09-11T22:14:39.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7fdf10ef1640 1 --2- 172.21.15.50:0/2450820196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0c06d780 0x7fdf0c072cb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdf000097a0 tx=0x7fdf0002a180 comp rx=0 tx=0).stop 2024-09-11T22:14:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7580007250 con 0x7f757c0043a0 2024-09-11T22:14:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f7587fff640 1 -- 172.21.15.50:0/3840666261 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7580007620 con 0x7f757c0043a0 2024-09-11T22:14:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7fdf10ef1640 1 -- 172.21.15.50:0/2450820196 shutdown_connections 2024-09-11T22:14:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7fdf10ef1640 1 --2- 172.21.15.50:0/2450820196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf0c15bb00 0x7fdf0c0b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7fdf10ef1640 1 --2- 172.21.15.50:0/2450820196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0c06d780 0x7fdf0c072cb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7fdf10ef1640 1 -- 172.21.15.50:0/2450820196 >> 172.21.15.50:0/2450820196 conn(0x7fdf0c0679c0 msgr2=0x7fdf0c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:39.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7fdf10ef1640 1 -- 172.21.15.50:0/2450820196 shutdown_connections 2024-09-11T22:14:39.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7fdf10ef1640 1 -- 172.21.15.50:0/2450820196 wait complete. 2024-09-11T22:14:39.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f9d45265640 1 -- 172.21.15.50:0/3076811216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4015fb40 msgr2=0x7f9d400d05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f9d45265640 1 --2- 172.21.15.50:0/3076811216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4015fb40 0x7f9d400d05f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9d400c6040 tx=0x7f9d30032c40 comp rx=0 tx=0).stop 2024-09-11T22:14:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f6189186640 1 -- 172.21.15.50:0/471403853 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840b0eb0 msgr2=0x7f61840af430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f6189186640 1 --2- 172.21.15.50:0/471403853 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840b0eb0 0x7f61840af430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61780097d0 tx=0x7f617802a0b0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f9d45265640 1 -- 172.21.15.50:0/3076811216 shutdown_connections 2024-09-11T22:14:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f9d45265640 1 --2- 172.21.15.50:0/3076811216 >> v2:172.21.15.77:3300/0 conn(0x7f9d400d1190 0x7f9d4006f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f9d45265640 1 --2- 172.21.15.50:0/3076811216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d40070430 0x7f9d400d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f9d45265640 1 --2- 172.21.15.50:0/3076811216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4015fb40 0x7f9d400d05f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f9d45265640 1 -- 172.21.15.50:0/3076811216 >> 172.21.15.50:0/3076811216 conn(0x7f9d400b4150 msgr2=0x7f9d400b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f6189186640 1 -- 172.21.15.50:0/471403853 shutdown_connections 2024-09-11T22:14:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f6189186640 1 --2- 172.21.15.50:0/471403853 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840b0eb0 0x7f61840af430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.803+0000 7f6189186640 1 -- 172.21.15.50:0/471403853 >> 172.21.15.50:0/471403853 conn(0x7f61840b4150 msgr2=0x7f61840b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.804+0000 7f9d45265640 1 -- 172.21.15.50:0/3076811216 shutdown_connections 2024-09-11T22:14:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.804+0000 7f6189186640 1 -- 172.21.15.50:0/471403853 shutdown_connections 2024-09-11T22:14:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.804+0000 7f6189186640 1 -- 172.21.15.50:0/471403853 wait complete. 2024-09-11T22:14:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.804+0000 7f9d45265640 1 -- 172.21.15.50:0/3076811216 wait complete. 2024-09-11T22:14:39.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.804+0000 7f7597503640 1 -- 172.21.15.50:0/3840666261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c0043a0 msgr2=0x7f757c004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.804+0000 7f7597503640 1 --2- 172.21.15.50:0/3840666261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c0043a0 0x7f757c004880 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f75900b41b0 tx=0x7f757c005830 comp rx=0 tx=0).stop 2024-09-11T22:14:39.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.804+0000 7f7595aa0640 1 -- 172.21.15.50:0/3840666261 reap_dead start 2024-09-11T22:14:39.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.804+0000 7f7597503640 1 -- 172.21.15.50:0/3840666261 shutdown_connections 2024-09-11T22:14:39.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.804+0000 7f7597503640 1 -- 172.21.15.50:0/3840666261 >> 172.21.15.50:0/3840666261 conn(0x7f75900727a0 msgr2=0x7f75900679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:39.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.804+0000 7f7597503640 1 -- 172.21.15.50:0/3840666261 shutdown_connections 2024-09-11T22:14:39.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.804+0000 7f7597503640 1 -- 172.21.15.50:0/3840666261 wait complete. 2024-09-11T22:14:39.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.805+0000 7fdf10ef1640 1 Processor -- start 2024-09-11T22:14:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.805+0000 7fdf10ef1640 1 -- start start 2024-09-11T22:14:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.805+0000 7f7597503640 1 Processor -- start 2024-09-11T22:14:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.805+0000 7f7597503640 1 -- start start 2024-09-11T22:14:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf10ef1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0c06d780 0x7fdf0c1f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf10ef1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf0c15aad0 0x7fdf0c1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf10ef1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0c15bb00 0x7fdf0c0cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf10ef1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c15bfb0 con 0x7fdf0c06d780 2024-09-11T22:14:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf10ef1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c071d70 con 0x7fdf0c15bb00 2024-09-11T22:14:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf10ef1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0c072290 con 0x7fdf0c15aad0 2024-09-11T22:14:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf0a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0c06d780 0x7fdf0c1f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf09d9b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf0c15aad0 0x7fdf0c1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf0a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0c06d780 0x7fdf0c1f7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36640/0 (socket says 172.21.15.50:36640) 2024-09-11T22:14:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf0a59c640 1 -- 172.21.15.50:0/324992946 learned_addr learned my addr 172.21.15.50:0/324992946 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:39.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf0ad9d640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0c15bb00 0x7fdf0c0cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7f9d45265640 1 Processor -- start 2024-09-11T22:14:39.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7f6189186640 1 Processor -- start 2024-09-11T22:14:39.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7f9d45265640 1 -- start start 2024-09-11T22:14:39.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf09d9b640 1 -- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0c15bb00 msgr2=0x7fdf0c0cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf09d9b640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0c15bb00 0x7fdf0c0cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf09d9b640 1 -- 172.21.15.50:0/324992946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0c06d780 msgr2=0x7fdf0c1f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf09d9b640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0c06d780 0x7fdf0c1f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf09d9b640 1 -- 172.21.15.50:0/324992946 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0c159020 con 0x7fdf0c15aad0 2024-09-11T22:14:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7f7597503640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f757c0043a0 0x7f7590151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7f6189186640 1 -- start start 2024-09-11T22:14:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7fdf0ad9d640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0c15bb00 0x7fdf0c0cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7f7597503640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7590156170 0x7f7590154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.806+0000 7f7597503640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7590154b90 0x7f759015c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f759529f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f757c0043a0 0x7f7590151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f759529f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f757c0043a0 0x7f7590151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:41100/0 (socket says 172.21.15.50:41100) 2024-09-11T22:14:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f759529f640 1 -- 172.21.15.50:0/1510940980 learned_addr learned my addr 172.21.15.50:0/1510940980 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f7597503640 1 -- 172.21.15.50:0/1510940980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f759015ec50 con 0x7f7590154b90 2024-09-11T22:14:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f7597503640 1 -- 172.21.15.50:0/1510940980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f75900b7ee0 con 0x7f757c0043a0 2024-09-11T22:14:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7fdf09d9b640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf0c15aad0 0x7fdf0c1561a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdf00031000 tx=0x7fdf000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f7594a9e640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7590156170 0x7f7590154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f7597503640 1 -- 172.21.15.50:0/1510940980 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f75900b78b0 con 0x7f7590156170 2024-09-11T22:14:39.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f7595aa0640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7590154b90 0x7f759015c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7fdefaffd640 1 -- 172.21.15.50:0/324992946 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf00041030 con 0x7fdf0c15aad0 2024-09-11T22:14:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7fdf10ef1640 1 -- 172.21.15.50:0/324992946 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0c158260 con 0x7fdf0c15aad0 2024-09-11T22:14:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7fdf10ef1640 1 -- 172.21.15.50:0/324992946 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf0c158820 con 0x7fdf0c15aad0 2024-09-11T22:14:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7fdefaffd640 1 -- 172.21.15.50:0/324992946 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf00030500 con 0x7fdf0c15aad0 2024-09-11T22:14:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7fdefaffd640 1 -- 172.21.15.50:0/324992946 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf00037040 con 0x7fdf0c15aad0 2024-09-11T22:14:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f759529f640 1 -- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7590156170 msgr2=0x7f7590154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f759529f640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7590156170 0x7f7590154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f759529f640 1 -- 172.21.15.50:0/1510940980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7590154b90 msgr2=0x7f759015c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f759529f640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7590154b90 0x7f759015c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f759529f640 1 -- 172.21.15.50:0/1510940980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7590151ab0 con 0x7f757c0043a0 2024-09-11T22:14:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.807+0000 7f759529f640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f757c0043a0 0x7f7590151570 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f758c011a00 tx=0x7f758c011ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f9d45265640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d40070430 0x7f9d400cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f7585ffb640 1 -- 172.21.15.50:0/1510940980 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c019070 con 0x7f757c0043a0 2024-09-11T22:14:39.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f7585ffb640 1 -- 172.21.15.50:0/1510940980 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758c004240 con 0x7f757c0043a0 2024-09-11T22:14:39.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f7597503640 1 -- 172.21.15.50:0/1510940980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75901550d0 con 0x7f757c0043a0 2024-09-11T22:14:39.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f7585ffb640 1 -- 172.21.15.50:0/1510940980 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c00f8e0 con 0x7f757c0043a0 2024-09-11T22:14:39.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f6189186640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840af970 0x7f61840cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f6189186640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61840b0eb0 0x7f61840b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f9d45265640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d400d1190 0x7f9d400c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f9d45265640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4015fb40 0x7f9d40149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f6189186640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61840c5570 0x7f618415b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f9d3effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d40070430 0x7f9d400cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f6182d9d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840af970 0x7f61840cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f618259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61840b0eb0 0x7f61840b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f6182d9d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840af970 0x7f61840cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:51404/0 (socket says 172.21.15.50:51404) 2024-09-11T22:14:39.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f9d45265640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9d40070ed0 con 0x7f9d4015fb40 2024-09-11T22:14:39.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f618259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61840b0eb0 0x7f61840b6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36660/0 (socket says 172.21.15.50:36660) 2024-09-11T22:14:39.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f9d45265640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9d40160130 con 0x7f9d40070430 2024-09-11T22:14:39.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f6182d9d640 1 -- 172.21.15.50:0/3546720794 learned_addr learned my addr 172.21.15.50:0/3546720794 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:39.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f9d3effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d40070430 0x7f9d400cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:41108/0 (socket says 172.21.15.50:41108) 2024-09-11T22:14:39.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f9d3effd640 1 -- 172.21.15.50:0/3267530807 learned_addr learned my addr 172.21.15.50:0/3267530807 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:39.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f9d3f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4015fb40 0x7f9d40149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f9d45265640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9d40071050 con 0x7f9d400d1190 2024-09-11T22:14:39.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f618359e640 1 --2- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61840c5570 0x7f618415b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f6189186640 1 -- 172.21.15.50:0/3546720794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61840b4f40 con 0x7f61840b0eb0 2024-09-11T22:14:39.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f6189186640 1 -- 172.21.15.50:0/3546720794 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f61840b4dc0 con 0x7f61840c5570 2024-09-11T22:14:39.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7f6189186640 1 -- 172.21.15.50:0/3546720794 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6184162db0 con 0x7f61840af970 2024-09-11T22:14:39.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.808+0000 7fdf10ef1640 1 -- 172.21.15.50:0/324992946 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef0005290 con 0x7fdf0c15aad0 2024-09-11T22:14:39.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f9d3effd640 1 -- 172.21.15.50:0/3267530807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d400d1190 msgr2=0x7f9d400c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f9d3effd640 1 --2- 172.21.15.50:0/3267530807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d400d1190 0x7f9d400c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f9d3effd640 1 -- 172.21.15.50:0/3267530807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4015fb40 msgr2=0x7f9d40149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f9d3effd640 1 --2- 172.21.15.50:0/3267530807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4015fb40 0x7f9d40149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f9d3effd640 1 -- 172.21.15.50:0/3267530807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d400c61c0 con 0x7f9d40070430 2024-09-11T22:14:39.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f9d3f7fe640 1 --2- 172.21.15.50:0/3267530807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4015fb40 0x7f9d40149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:39.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f6182d9d640 1 -- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61840c5570 msgr2=0x7f618415b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f6182d9d640 1 --2- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61840c5570 0x7f618415b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f6182d9d640 1 -- 172.21.15.50:0/3546720794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61840b0eb0 msgr2=0x7f61840b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:39.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f6182d9d640 1 --2- 172.21.15.50:0/3546720794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61840b0eb0 0x7f61840b6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:39.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f6182d9d640 1 -- 172.21.15.50:0/3546720794 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61840cb380 con 0x7f61840af970 2024-09-11T22:14:39.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f6182d9d640 1 --2- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840af970 0x7f61840cac30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f617400c430 tx=0x7f617400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f9d3effd640 1 --2- 172.21.15.50:0/3267530807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d40070430 0x7f9d400cc190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9d30033160 tx=0x7f9d300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f616b7fe640 1 -- 172.21.15.50:0/3546720794 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61740074e0 con 0x7f61840af970 2024-09-11T22:14:39.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f616b7fe640 1 -- 172.21.15.50:0/3546720794 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61740047e0 con 0x7f61840af970 2024-09-11T22:14:39.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f6189186640 1 -- 172.21.15.50:0/3546720794 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61840cb660 con 0x7f61840af970 2024-09-11T22:14:39.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f616b7fe640 1 -- 172.21.15.50:0/3546720794 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174004bd0 con 0x7f61840af970 2024-09-11T22:14:39.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f7597503640 1 -- 172.21.15.50:0/1510940980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7590155690 con 0x7f757c0043a0 2024-09-11T22:14:39.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7fdefaffd640 1 -- 172.21.15.50:0/324992946 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf00044070 con 0x7fdf0c15aad0 2024-09-11T22:14:39.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f6189186640 1 -- 172.21.15.50:0/3546720794 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f61840cbc20 con 0x7f61840af970 2024-09-11T22:14:39.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.810+0000 7fdefaffd640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdeec06be30 0x7fdeec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.809+0000 7f9d277fe640 1 -- 172.21.15.50:0/3267530807 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d30040040 con 0x7f9d40070430 2024-09-11T22:14:39.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.810+0000 7f9d277fe640 1 -- 172.21.15.50:0/3267530807 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3003ba70 con 0x7f9d40070430 2024-09-11T22:14:39.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.810+0000 7fdefaffd640 1 -- 172.21.15.50:0/324992946 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fdf000ab3e0 con 0x7fdf0c15aad0 2024-09-11T22:14:39.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.810+0000 7f9d277fe640 1 -- 172.21.15.50:0/3267530807 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3003be40 con 0x7f9d40070430 2024-09-11T22:14:39.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.810+0000 7f9d45265640 1 -- 172.21.15.50:0/3267530807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d400c64a0 con 0x7f9d40070430 2024-09-11T22:14:39.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.811+0000 7fdf0a59c640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdeec06be30 0x7fdeec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.811+0000 7f9d45265640 1 -- 172.21.15.50:0/3267530807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d400c7b80 con 0x7f9d40070430 2024-09-11T22:14:39.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.810+0000 7f7585ffb640 1 -- 172.21.15.50:0/1510940980 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f758c01c070 con 0x7f757c0043a0 2024-09-11T22:14:39.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.811+0000 7f6189186640 1 -- 172.21.15.50:0/3546720794 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618409c330 con 0x7f61840af970 2024-09-11T22:14:39.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.811+0000 7fdf0a59c640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdeec06be30 0x7fdeec06e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdefc000f60 tx=0x7fdefc007e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.811+0000 7f7585ffb640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f757406be60 0x7f757406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.811+0000 7f7585ffb640 1 -- 172.21.15.50:0/1510940980 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f758c08a650 con 0x7f757c0043a0 2024-09-11T22:14:39.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.811+0000 7f616b7fe640 1 -- 172.21.15.50:0/3546720794 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6174011070 con 0x7f61840af970 2024-09-11T22:14:39.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.811+0000 7f7594a9e640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f757406be60 0x7f757406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.812+0000 7f9d45265640 1 -- 172.21.15.50:0/3267530807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d400d05f0 con 0x7f9d40070430 2024-09-11T22:14:39.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.812+0000 7f7594a9e640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f757406be60 0x7f757406e320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7580034000 tx=0x7f7580009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.812+0000 7f7597503640 1 -- 172.21.15.50:0/1510940980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75900d1190 con 0x7f757c0043a0 2024-09-11T22:14:39.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.812+0000 7f616b7fe640 1 --2- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f617006be60 0x7f617006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.812+0000 7f618259c640 1 --2- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f617006be60 0x7f617006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.813+0000 7f9d277fe640 1 -- 172.21.15.50:0/3267530807 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d30033640 con 0x7f9d40070430 2024-09-11T22:14:39.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.813+0000 7f618259c640 1 --2- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f617006be60 0x7f617006e320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6178034000 tx=0x7f617802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.813+0000 7f9d277fe640 1 --2- 172.21.15.50:0/3267530807 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9d2c06be30 0x7f9d2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:39.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.813+0000 7f9d277fe640 1 -- 172.21.15.50:0/3267530807 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f9d300b39c0 con 0x7f9d40070430 2024-09-11T22:14:39.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.813+0000 7f9d3e7fc640 1 --2- 172.21.15.50:0/3267530807 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9d2c06be30 0x7f9d2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:39.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.814+0000 7f9d3e7fc640 1 --2- 172.21.15.50:0/3267530807 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9d2c06be30 0x7f9d2c06e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9d400cff50 tx=0x7f9d34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:39.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.815+0000 7f616b7fe640 1 -- 172.21.15.50:0/3546720794 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f61740887f0 con 0x7f61840af970 2024-09-11T22:14:39.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.815+0000 7fdefaffd640 1 -- 172.21.15.50:0/324992946 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf000796a0 con 0x7fdf0c15aad0 2024-09-11T22:14:39.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.817+0000 7f7585ffb640 1 -- 172.21.15.50:0/1510940980 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f758c0589b0 con 0x7f757c0043a0 2024-09-11T22:14:39.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.820+0000 7f616b7fe640 1 -- 172.21.15.50:0/3546720794 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61740585a0 con 0x7f61840af970 2024-09-11T22:14:39.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:39.821+0000 7f9d277fe640 1 -- 172.21.15.50:0/3267530807 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d300b5e20 con 0x7f9d40070430 2024-09-11T22:14:40.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.063+0000 7fdf10ef1640 1 -- 172.21.15.50:0/324992946 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7fdef0005580 con 0x7fdf0c15aad0 2024-09-11T22:14:40.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.069+0000 7f7597503640 1 -- 172.21.15.50:0/1510940980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f75900b4980 con 0x7f757c0043a0 2024-09-11T22:14:40.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.085+0000 7f6189186640 1 -- 172.21.15.50:0/3546720794 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f618406c320 con 0x7f61840af970 2024-09-11T22:14:40.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.089+0000 7f9d45265640 1 -- 172.21.15.50:0/3267530807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f9d4006f3a0 con 0x7f9d40070430 2024-09-11T22:14:40.403 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:14:40.403+0000 7f2a090cb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:14:40.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.408+0000 7fdefaffd640 1 -- 172.21.15.50:0/324992946 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6147 v33) ==== 95+0+0 (secure 0 0 0) 0x7fdf0007d9a0 con 0x7fdf0c15aad0 2024-09-11T22:14:40.409 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 6147 2024-09-11T22:14:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.410+0000 7fdf10ef1640 1 -- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdeec06be30 msgr2=0x7fdeec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.410+0000 7fdf10ef1640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdeec06be30 0x7fdeec06e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdefc000f60 tx=0x7fdefc007e10 comp rx=0 tx=0).stop 2024-09-11T22:14:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.410+0000 7fdf10ef1640 1 -- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf0c15aad0 msgr2=0x7fdf0c1561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.410+0000 7fdf10ef1640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf0c15aad0 0x7fdf0c1561a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdf00031000 tx=0x7fdf000046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.411+0000 7fdf10ef1640 1 -- 172.21.15.50:0/324992946 shutdown_connections 2024-09-11T22:14:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.411+0000 7fdf10ef1640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdeec06be30 0x7fdeec06e2f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.411+0000 7fdf10ef1640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf0c15aad0 0x7fdf0c1561a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.411+0000 7fdf10ef1640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0c15bb00 0x7fdf0c0cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.411+0000 7fdf10ef1640 1 --2- 172.21.15.50:0/324992946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf0c06d780 0x7fdf0c1f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.411+0000 7fdf10ef1640 1 -- 172.21.15.50:0/324992946 >> 172.21.15.50:0/324992946 conn(0x7fdf0c0679c0 msgr2=0x7fdf0c0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.411+0000 7fdf10ef1640 1 -- 172.21.15.50:0/324992946 shutdown_connections 2024-09-11T22:14:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.411+0000 7fdf10ef1640 1 -- 172.21.15.50:0/324992946 wait complete. 2024-09-11T22:14:40.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.418+0000 7f7585ffb640 1 -- 172.21.15.50:0/1510940980 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6156 v34) ==== 95+0+0 (secure 0 0 0) 0x7f758c05ccb0 con 0x7f757c0043a0 2024-09-11T22:14:40.419 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 6156 2024-09-11T22:14:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.420+0000 7f7597503640 1 -- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f757406be60 msgr2=0x7f757406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.420+0000 7f7597503640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f757406be60 0x7f757406e320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7580034000 tx=0x7f7580009030 comp rx=0 tx=0).stop 2024-09-11T22:14:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.421+0000 7f7597503640 1 -- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f757c0043a0 msgr2=0x7f7590151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.421+0000 7f7597503640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f757c0043a0 0x7f7590151570 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f758c011a00 tx=0x7f758c011ec0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.421+0000 7f7597503640 1 -- 172.21.15.50:0/1510940980 shutdown_connections 2024-09-11T22:14:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.421+0000 7f7597503640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f757406be60 0x7f757406e320 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.421+0000 7f7597503640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7590156170 0x7f7590154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.421+0000 7f7597503640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7590154b90 0x7f759015c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.421+0000 7f7597503640 1 --2- 172.21.15.50:0/1510940980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f757c0043a0 0x7f7590151570 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.421+0000 7f7597503640 1 -- 172.21.15.50:0/1510940980 >> 172.21.15.50:0/1510940980 conn(0x7f75900727a0 msgr2=0x7f759015a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.421+0000 7f7597503640 1 -- 172.21.15.50:0/1510940980 shutdown_connections 2024-09-11T22:14:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.421+0000 7f7597503640 1 -- 172.21.15.50:0/1510940980 wait complete. 2024-09-11T22:14:40.424 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:14:40.425 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:14:40.427 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:14:40.427 DEBUG:teuthology.parallel:result is None 2024-09-11T22:14:40.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.426+0000 7f616b7fe640 1 -- 172.21.15.50:0/3546720794 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5468 v35) ==== 95+0+0 (secure 0 0 0) 0x7f617405c8a0 con 0x7f61840af970 2024-09-11T22:14:40.428 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 5468 2024-09-11T22:14:40.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.428+0000 7f6189186640 1 -- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f617006be60 msgr2=0x7f617006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:40.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.428+0000 7f6189186640 1 --2- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f617006be60 0x7f617006e320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6178034000 tx=0x7f617802e000 comp rx=0 tx=0).stop 2024-09-11T22:14:40.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.428+0000 7f6189186640 1 -- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840af970 msgr2=0x7f61840cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:40.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.428+0000 7f6189186640 1 --2- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840af970 0x7f61840cac30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f617400c430 tx=0x7f617400c8f0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.428+0000 7f6189186640 1 -- 172.21.15.50:0/3546720794 shutdown_connections 2024-09-11T22:14:40.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.428+0000 7f6189186640 1 --2- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f617006be60 0x7f617006e320 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.429+0000 7f6189186640 1 --2- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61840c5570 0x7f618415b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.429+0000 7f6189186640 1 --2- 172.21.15.50:0/3546720794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61840b0eb0 0x7f61840b6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.429+0000 7f6189186640 1 --2- 172.21.15.50:0/3546720794 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840af970 0x7f61840cac30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:40.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.429+0000 7f6189186640 1 -- 172.21.15.50:0/3546720794 >> 172.21.15.50:0/3546720794 conn(0x7f61840b4150 msgr2=0x7f61840c5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:40.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.429+0000 7f6189186640 1 -- 172.21.15.50:0/3546720794 shutdown_connections 2024-09-11T22:14:40.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:40.429+0000 7f6189186640 1 -- 172.21.15.50:0/3546720794 wait complete. 2024-09-11T22:14:40.435 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:14:40.435 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:14:40.438 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:14:40.438 DEBUG:teuthology.parallel:result is None 2024-09-11T22:14:40.441 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:14:40.441 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:14:40.443 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:14:40.443 DEBUG:teuthology.parallel:result is None 2024-09-11T22:14:40.503 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:14:40.520 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:14:40.524 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:14:41.406 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:14:41.405+0000 7f2a090cb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:14:41.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.412+0000 7f9d277fe640 1 -- 172.21.15.50:0/3267530807 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6144 v36) ==== 95+0+0 (secure 0 0 0) 0x7f9d30082400 con 0x7f9d40070430 2024-09-11T22:14:41.412 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 6144 2024-09-11T22:14:41.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.415+0000 7f9d45265640 1 -- 172.21.15.50:0/3267530807 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9d2c06be30 msgr2=0x7f9d2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.415+0000 7f9d45265640 1 --2- 172.21.15.50:0/3267530807 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9d2c06be30 0x7f9d2c06e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9d400cff50 tx=0x7f9d34008040 comp rx=0 tx=0).stop 2024-09-11T22:14:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.415+0000 7f9d45265640 1 -- 172.21.15.50:0/3267530807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d40070430 msgr2=0x7f9d400cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.415+0000 7f9d45265640 1 --2- 172.21.15.50:0/3267530807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d40070430 0x7f9d400cc190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9d30033160 tx=0x7f9d300046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.415+0000 7f9d45265640 1 -- 172.21.15.50:0/3267530807 shutdown_connections 2024-09-11T22:14:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.415+0000 7f9d45265640 1 --2- 172.21.15.50:0/3267530807 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9d2c06be30 0x7f9d2c06e2f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.415+0000 7f9d45265640 1 --2- 172.21.15.50:0/3267530807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d400d1190 0x7f9d400c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.415+0000 7f9d45265640 1 --2- 172.21.15.50:0/3267530807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d4015fb40 0x7f9d40149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.415+0000 7f9d45265640 1 --2- 172.21.15.50:0/3267530807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d40070430 0x7f9d400cc190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.415+0000 7f9d45265640 1 -- 172.21.15.50:0/3267530807 >> 172.21.15.50:0/3267530807 conn(0x7f9d400b4150 msgr2=0x7f9d400ccee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.415+0000 7f9d45265640 1 -- 172.21.15.50:0/3267530807 shutdown_connections 2024-09-11T22:14:41.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.415+0000 7f9d45265640 1 -- 172.21.15.50:0/3267530807 wait complete. 2024-09-11T22:14:41.433 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:14:41.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:14:41.436 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:14:41.436 DEBUG:teuthology.parallel:result is None 2024-09-11T22:14:41.437 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:41.519 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:14:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.545+0000 7f7fc359e640 1 Processor -- start 2024-09-11T22:14:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.545+0000 7f7fc359e640 1 -- start start 2024-09-11T22:14:41.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fc40d1640 0x7f7fc4162020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:41.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc359e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc40d0a10 0x7f7fc40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:41.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc359e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc40d22a0 con 0x7f7fc40d0630 2024-09-11T22:14:41.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc359e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc40d0f90 con 0x7f7fc40d1640 2024-09-11T22:14:41.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc359e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc40d1270 con 0x7f7fc40d0a10 2024-09-11T22:14:41.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc1d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fc40d1640 0x7f7fc4162020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:41.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7fc40d0630 0x7f7fc4161910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38784/0 (socket says 172.21.15.50:38784) 2024-09-11T22:14:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc259c640 1 -- 172.21.15.50:0/891556857 learned_addr learned my addr 172.21.15.50:0/891556857 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc2d9d640 1 --2- 172.21.15.50:0/891556857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc40d0a10 0x7f7fc40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc1d9b640 1 -- 172.21.15.50:0/891556857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc40d0a10 msgr2=0x7f7fc40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc1d9b640 1 --2- 172.21.15.50:0/891556857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc40d0a10 0x7f7fc40b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc1d9b640 1 -- 172.21.15.50:0/891556857 >> v1:172.21.15.50:6789/0 conn(0x7f7fc40d0630 legacy=0x7f7fc4161910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc1d9b640 1 -- 172.21.15.50:0/891556857 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc40cf7f0 con 0x7f7fc40d1640 2024-09-11T22:14:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.546+0000 7f7fc159a640 1 -- 172.21.15.50:0/891556857 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192431464 0 0) 0x7f7fc40d22a0 con 0x7f7fc40d0630 2024-09-11T22:14:41.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.547+0000 7f7fc1d9b640 1 --2- 172.21.15.50:0/891556857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc40d1640 0x7f7fc4162020 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80097a0 tx=0x7f7fb802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717021fc2bcf8372 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:41.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.547+0000 7f7fc159a640 1 -- 172.21.15.50:0/891556857 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8037070 con 0x7f7fc40d1640 2024-09-11T22:14:41.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.547+0000 7f7fc159a640 1 -- 172.21.15.50:0/891556857 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb802ae50 con 0x7f7fc40d1640 2024-09-11T22:14:41.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.547+0000 7f7fc159a640 1 -- 172.21.15.50:0/891556857 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8032660 con 0x7f7fc40d1640 2024-09-11T22:14:41.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.548+0000 7f7fc359e640 1 -- 172.21.15.50:0/891556857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc40d1640 msgr2=0x7f7fc4162020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:41.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.548+0000 7f7fc359e640 1 --2- 172.21.15.50:0/891556857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc40d1640 0x7f7fc4162020 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80097a0 tx=0x7f7fb802a100 comp rx=0 tx=0).stop 2024-09-11T22:14:41.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.548+0000 7f7fc359e640 1 -- 172.21.15.50:0/891556857 shutdown_connections 2024-09-11T22:14:41.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.548+0000 7f7fc359e640 1 --2- 172.21.15.50:0/891556857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc40d0a10 0x7f7fc40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.548+0000 7f7fc359e640 1 --2- 172.21.15.50:0/891556857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc40d1640 0x7f7fc4162020 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.548+0000 7f7fc359e640 1 -- 172.21.15.50:0/891556857 >> 172.21.15.50:0/891556857 conn(0x7f7fc409ba50 msgr2=0x7f7fc40b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:41.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.548+0000 7f7fc359e640 1 -- 172.21.15.50:0/891556857 shutdown_connections 2024-09-11T22:14:41.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.548+0000 7f7fc359e640 1 -- 172.21.15.50:0/891556857 wait complete. 2024-09-11T22:14:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.549+0000 7f7fc359e640 1 Processor -- start 2024-09-11T22:14:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.549+0000 7f7fc359e640 1 -- start start 2024-09-11T22:14:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc359e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc40d0630 0x7f7fc41f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc40d0a10 0x7f7fc409d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fc40d1640 0x7f7fc40b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc359e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc406f700 con 0x7f7fc40d0a10 2024-09-11T22:14:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc359e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc40d2080 con 0x7f7fc40d1640 2024-09-11T22:14:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc359e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc406f880 con 0x7f7fc40d0630 2024-09-11T22:14:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc40d0a10 0x7f7fc409d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc40d0a10 0x7f7fc409d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36706/0 (socket says 172.21.15.50:36706) 2024-09-11T22:14:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc1d9b640 1 -- 172.21.15.50:0/4127163359 learned_addr learned my addr 172.21.15.50:0/4127163359 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc259c640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc40d0630 0x7f7fc41f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc2d9d640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fc40d1640 0x7f7fc40b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc1d9b640 1 -- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc40d0630 msgr2=0x7f7fc41f3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc1d9b640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc40d0630 0x7f7fc41f3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc1d9b640 1 -- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fc40d1640 msgr2=0x7f7fc40b7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc1d9b640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fc40d1640 0x7f7fc40b7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc1d9b640 1 -- 172.21.15.50:0/4127163359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc409db50 con 0x7f7fc40d0a10 2024-09-11T22:14:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc259c640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc40d0630 0x7f7fc41f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:41.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.550+0000 7f7fc2d9d640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fc40d1640 0x7f7fc40b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:41.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.551+0000 7f7fc1d9b640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc40d0a10 0x7f7fc409d0d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8035040 tx=0x7f7fb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:41.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.551+0000 7f7fb2ffd640 1 -- 172.21.15.50:0/4127163359 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8041070 con 0x7f7fc40d0a10 2024-09-11T22:14:41.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.551+0000 7f7fb2ffd640 1 -- 172.21.15.50:0/4127163359 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb803c670 con 0x7f7fc40d0a10 2024-09-11T22:14:41.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.551+0000 7f7fc359e640 1 -- 172.21.15.50:0/4127163359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc41f7860 con 0x7f7fc40d0a10 2024-09-11T22:14:41.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.551+0000 7f7fb2ffd640 1 -- 172.21.15.50:0/4127163359 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8037040 con 0x7f7fc40d0a10 2024-09-11T22:14:41.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.551+0000 7f7fc359e640 1 -- 172.21.15.50:0/4127163359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc41f8100 con 0x7f7fc40d0a10 2024-09-11T22:14:41.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.552+0000 7f7fc359e640 1 -- 172.21.15.50:0/4127163359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc41f7c50 con 0x7f7fc40d0a10 2024-09-11T22:14:41.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.553+0000 7f7fb2ffd640 1 -- 172.21.15.50:0/4127163359 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fb803a070 con 0x7f7fc40d0a10 2024-09-11T22:14:41.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.553+0000 7f7fb2ffd640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7fa406be30 0x7f7fa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:41.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.553+0000 7f7fb2ffd640 1 -- 172.21.15.50:0/4127163359 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f7fb80ab290 con 0x7f7fc40d0a10 2024-09-11T22:14:41.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.553+0000 7f7fc259c640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7fa406be30 0x7f7fa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:41.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.554+0000 7f7fc259c640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7fa406be30 0x7f7fa406e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4000f60 tx=0x7f7fb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:41.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.558+0000 7f7fb2ffd640 1 -- 172.21.15.50:0/4127163359 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fb8079cb0 con 0x7f7fc40d0a10 2024-09-11T22:14:41.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.770+0000 7f7fc359e640 1 -- 172.21.15.50:0/4127163359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fc40b4bf0 con 0x7f7fc40d0a10 2024-09-11T22:14:41.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.771+0000 7f7fb2ffd640 1 -- 172.21.15.50:0/4127163359 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+4392 (secure 0 0 0) 0x7f7fb80795b0 con 0x7f7fc40d0a10 2024-09-11T22:14:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:41.772 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":37,"btime":"2024-09-11T22:14:41:411418+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2332065748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2332065748},{"type":"v1","addr":"172.21.15.77:6837","nonce":2332065748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2776548564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2776548564},{"type":"v1","addr":"172.21.15.77:6835","nonce":2776548564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:14:26.306529+0000","modified":"2024-09-11T22:14:41.411403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6393":{"gid":6393,"name":"a","rank":0,"incarnation":37,"state":"up:replay","state_seq":1,"addr":"172.21.15.50:6833/3974105971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3974105971},{"type":"v1","addr":"172.21.15.50:6833","nonce":3974105971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-11T22:14:41.772 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 37 2024-09-11T22:14:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.773+0000 7f7fc359e640 1 -- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7fa406be30 msgr2=0x7f7fa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.773+0000 7f7fc359e640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7fa406be30 0x7f7fa406e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4000f60 tx=0x7f7fb4009040 comp rx=0 tx=0).stop 2024-09-11T22:14:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.773+0000 7f7fc359e640 1 -- 172.21.15.50:0/4127163359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc40d0a10 msgr2=0x7f7fc409d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.773+0000 7f7fc359e640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc40d0a10 0x7f7fc409d0d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8035040 tx=0x7f7fb80046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.773+0000 7f7fc359e640 1 -- 172.21.15.50:0/4127163359 shutdown_connections 2024-09-11T22:14:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.773+0000 7f7fc359e640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7fa406be30 0x7f7fa406e2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.773+0000 7f7fc359e640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fc40d1640 0x7f7fc40b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.773+0000 7f7fc359e640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc40d0a10 0x7f7fc409d0d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.773+0000 7f7fc359e640 1 --2- 172.21.15.50:0/4127163359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc40d0630 0x7f7fc41f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:41.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.773+0000 7f7fc359e640 1 -- 172.21.15.50:0/4127163359 >> 172.21.15.50:0/4127163359 conn(0x7f7fc409ba50 msgr2=0x7f7fc406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:41.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.773+0000 7f7fc359e640 1 -- 172.21.15.50:0/4127163359 shutdown_connections 2024-09-11T22:14:41.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:41.773+0000 7f7fc359e640 1 -- 172.21.15.50:0/4127163359 wait complete. 2024-09-11T22:14:42.187 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:14:26.306529+0000', 'modified': '2024-09-11T22:14:41.411403+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 63, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6393}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6393': {'gid': 6393, 'name': 'a', 'rank': 0, 'incarnation': 37, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.50:6833/3974105971', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 3974105971}, {'type': 'v1', 'addr': '172.21.15.50:6833', 'nonce': 3974105971}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-11T22:14:42.187 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6393:up:replay 2024-09-11T22:14:42.445 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:14:42.448 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:14:43.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:43.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.303+0000 7f2e9b2d0640 1 Processor -- start 2024-09-11T22:14:43.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.303+0000 7f2e9b2d0640 1 -- start start 2024-09-11T22:14:43.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.304+0000 7f2e9b2d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e940d18e0 0x7f2e940d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.304+0000 7f2e9b2d0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e9415eb70 0x7f2e940d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.304+0000 7f2e9b2d0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e940d31b0 con 0x7f2e9415e790 2024-09-11T22:14:43.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.304+0000 7f2e9b2d0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2e940d3dc0 con 0x7f2e9415eb70 2024-09-11T22:14:43.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.304+0000 7f2e9b2d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2e940d3490 con 0x7f2e940d18e0 2024-09-11T22:14:43.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.304+0000 7f2e9986d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e9415eb70 0x7f2e940d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.304+0000 7f2e9906c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2e9415e790 0x7f2e940d11d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38788/0 (socket says 172.21.15.50:38788) 2024-09-11T22:14:43.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.304+0000 7f2e9906c640 1 -- 172.21.15.50:0/3002828971 learned_addr learned my addr 172.21.15.50:0/3002828971 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:43.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.304+0000 7f2e9886b640 1 --2- 172.21.15.50:0/3002828971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e940d18e0 0x7f2e940d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.305+0000 7f2e9986d640 1 -- 172.21.15.50:0/3002828971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e940d18e0 msgr2=0x7f2e940d4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:43.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.305+0000 7f2e9986d640 1 --2- 172.21.15.50:0/3002828971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e940d18e0 0x7f2e940d4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.305+0000 7f2e9986d640 1 -- 172.21.15.50:0/3002828971 >> v1:172.21.15.50:6789/0 conn(0x7f2e9415e790 legacy=0x7f2e940d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.305+0000 7f2e9986d640 1 -- 172.21.15.50:0/3002828971 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e940d3770 con 0x7f2e9415eb70 2024-09-11T22:14:43.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.305+0000 7f2e8bfff640 1 -- 172.21.15.50:0/3002828971 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111311916 0 0) 0x7f2e940d31b0 con 0x7f2e9415e790 2024-09-11T22:14:43.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.305+0000 7f2e9986d640 1 --2- 172.21.15.50:0/3002828971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e9415eb70 0x7f2e940d2b20 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009d90 tx=0x7f2e8c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17162c8705328f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:43.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.305+0000 7f2e8bfff640 1 -- 172.21.15.50:0/3002828971 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c007740 con 0x7f2e9415eb70 2024-09-11T22:14:43.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.305+0000 7f2e8bfff640 1 -- 172.21.15.50:0/3002828971 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0078e0 con 0x7f2e9415eb70 2024-09-11T22:14:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.305+0000 7f2e8bfff640 1 -- 172.21.15.50:0/3002828971 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c007cb0 con 0x7f2e9415eb70 2024-09-11T22:14:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.306+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/3002828971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e9415eb70 msgr2=0x7f2e940d2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.306+0000 7f2e9b2d0640 1 --2- 172.21.15.50:0/3002828971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e9415eb70 0x7f2e940d2b20 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009d90 tx=0x7f2e8c02a660 comp rx=0 tx=0).stop 2024-09-11T22:14:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.306+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/3002828971 shutdown_connections 2024-09-11T22:14:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.306+0000 7f2e9b2d0640 1 --2- 172.21.15.50:0/3002828971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e9415eb70 0x7f2e940d2b20 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.306+0000 7f2e9b2d0640 1 --2- 172.21.15.50:0/3002828971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e940d18e0 0x7f2e940d4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.306+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/3002828971 >> 172.21.15.50:0/3002828971 conn(0x7f2e940727a0 msgr2=0x7f2e940679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.306+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/3002828971 shutdown_connections 2024-09-11T22:14:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.306+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/3002828971 wait complete. 2024-09-11T22:14:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.307+0000 7f2e9b2d0640 1 Processor -- start 2024-09-11T22:14:43.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.307+0000 7f2e9b2d0640 1 -- start start 2024-09-11T22:14:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.308+0000 7f2e9b2d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940d18e0 0x7f2e94157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.308+0000 7f2e9b2d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e9415e790 0x7f2e941e81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.308+0000 7f2e9b2d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9415eb70 0x7f2e940c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.308+0000 7f2e9b2d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940ba3b0 con 0x7f2e940d18e0 2024-09-11T22:14:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.308+0000 7f2e9b2d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940ba230 con 0x7f2e9415eb70 2024-09-11T22:14:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.308+0000 7f2e9b2d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2e940ba530 con 0x7f2e9415e790 2024-09-11T22:14:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.308+0000 7f2e9906c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940d18e0 0x7f2e94157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.308+0000 7f2e9906c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940d18e0 0x7f2e94157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36728/0 (socket says 172.21.15.50:36728) 2024-09-11T22:14:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.308+0000 7f2e9906c640 1 -- 172.21.15.50:0/2652920406 learned_addr learned my addr 172.21.15.50:0/2652920406 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:43.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.308+0000 7f2e9986d640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9415eb70 0x7f2e940c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.308+0000 7f2e9886b640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e9415e790 0x7f2e941e81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.309+0000 7f2e9906c640 1 -- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e9415e790 msgr2=0x7f2e941e81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.309+0000 7f2e9906c640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e9415e790 0x7f2e941e81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.309+0000 7f2e9906c640 1 -- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9415eb70 msgr2=0x7f2e940c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.309+0000 7f2e9906c640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9415eb70 0x7f2e940c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.309+0000 7f2e9906c640 1 -- 172.21.15.50:0/2652920406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e941e8ac0 con 0x7f2e940d18e0 2024-09-11T22:14:43.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.309+0000 7f2e9986d640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9415eb70 0x7f2e940c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:43.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.309+0000 7f2e9886b640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e9415e790 0x7f2e941e81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:43.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.309+0000 7f2e9906c640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940d18e0 0x7f2e94157ab0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c4d0 tx=0x7f2e9000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:43.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.309+0000 7f2e89ffb640 1 -- 172.21.15.50:0/2652920406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90018070 con 0x7f2e940d18e0 2024-09-11T22:14:43.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.309+0000 7f2e89ffb640 1 -- 172.21.15.50:0/2652920406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e90007500 con 0x7f2e940d18e0 2024-09-11T22:14:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.309+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/2652920406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e940c8290 con 0x7f2e940d18e0 2024-09-11T22:14:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.309+0000 7f2e89ffb640 1 -- 172.21.15.50:0/2652920406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90004a20 con 0x7f2e940d18e0 2024-09-11T22:14:43.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.309+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/2652920406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e940c8850 con 0x7f2e940d18e0 2024-09-11T22:14:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.310+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/2652920406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e940c8a20 con 0x7f2e940d18e0 2024-09-11T22:14:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.311+0000 7f2e89ffb640 1 -- 172.21.15.50:0/2652920406 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e9001b070 con 0x7f2e940d18e0 2024-09-11T22:14:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.311+0000 7f2e89ffb640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e7806be30 0x7f2e7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.311+0000 7f2e89ffb640 1 -- 172.21.15.50:0/2652920406 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f2e9008a330 con 0x7f2e940d18e0 2024-09-11T22:14:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.312+0000 7f2e9886b640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e7806be30 0x7f2e7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:43.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.312+0000 7f2e9886b640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e7806be30 0x7f2e7806e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2e94161580 tx=0x7f2e84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:43.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.316+0000 7f2e89ffb640 1 -- 172.21.15.50:0/2652920406 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e90058b90 con 0x7f2e940d18e0 2024-09-11T22:14:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.534+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/2652920406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e94068390 con 0x7f2e940d18e0 2024-09-11T22:14:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.535+0000 7f2e89ffb640 1 -- 172.21.15.50:0/2652920406 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5217 (secure 0 0 0) 0x7f2e90058490 con 0x7f2e940d18e0 2024-09-11T22:14:43.536 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:43.536 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"btime":"2024-09-11T22:14:43:418478+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2332065748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2332065748},{"type":"v1","addr":"172.21.15.77:6837","nonce":2332065748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2776548564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2776548564},{"type":"v1","addr":"172.21.15.77:6835","nonce":2776548564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2898617410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2898617410},{"type":"v1","addr":"172.21.15.50:6835","nonce":2898617410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:14:26.306529+0000","modified":"2024-09-11T22:14:42.420152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6393":{"gid":6393,"name":"a","rank":0,"incarnation":37,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.50:6833/3974105971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3974105971},{"type":"v1","addr":"172.21.15.50:6833","nonce":3974105971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-11T22:14:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 39 2024-09-11T22:14:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.537+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e7806be30 msgr2=0x7f2e7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.537+0000 7f2e9b2d0640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e7806be30 0x7f2e7806e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2e94161580 tx=0x7f2e84008040 comp rx=0 tx=0).stop 2024-09-11T22:14:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.537+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/2652920406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940d18e0 msgr2=0x7f2e94157ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:43.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.537+0000 7f2e9b2d0640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940d18e0 0x7f2e94157ab0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c4d0 tx=0x7f2e9000c990 comp rx=0 tx=0).stop 2024-09-11T22:14:43.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.537+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/2652920406 shutdown_connections 2024-09-11T22:14:43.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.537+0000 7f2e9b2d0640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e7806be30 0x7f2e7806e2f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.537+0000 7f2e9b2d0640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e9415e790 0x7f2e941e81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.537+0000 7f2e9b2d0640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9415eb70 0x7f2e940c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.537+0000 7f2e9b2d0640 1 --2- 172.21.15.50:0/2652920406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940d18e0 0x7f2e94157ab0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:43.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.537+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/2652920406 >> 172.21.15.50:0/2652920406 conn(0x7f2e940727a0 msgr2=0x7f2e940b8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:43.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.537+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/2652920406 shutdown_connections 2024-09-11T22:14:43.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:43.537+0000 7f2e9b2d0640 1 -- 172.21.15.50:0/2652920406 wait complete. 2024-09-11T22:14:43.951 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:14:26.306529+0000', 'modified': '2024-09-11T22:14:42.420152+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 63, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6393}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6393': {'gid': 6393, 'name': 'a', 'rank': 0, 'incarnation': 37, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.50:6833/3974105971', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 3974105971}, {'type': 'v1', 'addr': '172.21.15.50:6833', 'nonce': 3974105971}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-11T22:14:43.952 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6393:up:rejoin 2024-09-11T22:14:44.953 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.068+0000 7f85749c4640 1 Processor -- start 2024-09-11T22:14:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.068+0000 7f85749c4640 1 -- start start 2024-09-11T22:14:45.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.069+0000 7f85749c4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f857015c2c0 0x7f85700b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.069+0000 7f85749c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85700b3e10 0x7f85700cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.069+0000 7f85749c4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85700d0810 con 0x7f85700d0410 2024-09-11T22:14:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.069+0000 7f85749c4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f85700cf7a0 con 0x7f85700b3e10 2024-09-11T22:14:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.069+0000 7f85749c4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f85700b4f00 con 0x7f857015c2c0 2024-09-11T22:14:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.069+0000 7f856dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85700b3e10 0x7f85700cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.069+0000 7f856ed9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f85700d0410 0x7f857015fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38800/0 (socket says 172.21.15.50:38800) 2024-09-11T22:14:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.069+0000 7f856ed9d640 1 -- 172.21.15.50:0/3055335511 learned_addr learned my addr 172.21.15.50:0/3055335511 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.069+0000 7f856e59c640 1 --2- 172.21.15.50:0/3055335511 >> v2:172.21.15.77:3300/0 conn(0x7f857015c2c0 0x7f85700b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.070+0000 7f856dd9b640 1 -- 172.21.15.50:0/3055335511 >> v2:172.21.15.77:3300/0 conn(0x7f857015c2c0 msgr2=0x7f85700b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.070+0000 7f856dd9b640 1 --2- 172.21.15.50:0/3055335511 >> v2:172.21.15.77:3300/0 conn(0x7f857015c2c0 0x7f85700b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.070+0000 7f856dd9b640 1 -- 172.21.15.50:0/3055335511 >> v1:172.21.15.50:6789/0 conn(0x7f85700d0410 legacy=0x7f857015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.070+0000 7f856dd9b640 1 -- 172.21.15.50:0/3055335511 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85700b4360 con 0x7f85700b3e10 2024-09-11T22:14:45.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.070+0000 7f856dd9b640 1 --2- 172.21.15.50:0/3055335511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85700b3e10 0x7f85700cfed0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f857006cdb0 tx=0x7f855802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee73bdda27d0b3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.070+0000 7f856d59a640 1 -- 172.21.15.50:0/3055335511 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558037070 con 0x7f85700b3e10 2024-09-11T22:14:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.071+0000 7f856d59a640 1 -- 172.21.15.50:0/3055335511 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8558032440 con 0x7f85700b3e10 2024-09-11T22:14:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.071+0000 7f856d59a640 1 -- 172.21.15.50:0/3055335511 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558032810 con 0x7f85700b3e10 2024-09-11T22:14:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.071+0000 7f85749c4640 1 -- 172.21.15.50:0/3055335511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85700b3e10 msgr2=0x7f85700cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.071+0000 7f85749c4640 1 --2- 172.21.15.50:0/3055335511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85700b3e10 0x7f85700cfed0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f857006cdb0 tx=0x7f855802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.071+0000 7f85749c4640 1 -- 172.21.15.50:0/3055335511 shutdown_connections 2024-09-11T22:14:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.071+0000 7f85749c4640 1 --2- 172.21.15.50:0/3055335511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85700b3e10 0x7f85700cfed0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.071+0000 7f85749c4640 1 --2- 172.21.15.50:0/3055335511 >> v2:172.21.15.77:3300/0 conn(0x7f857015c2c0 0x7f85700b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.071+0000 7f85749c4640 1 -- 172.21.15.50:0/3055335511 >> 172.21.15.50:0/3055335511 conn(0x7f85700679c0 msgr2=0x7f8570067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.071+0000 7f85749c4640 1 -- 172.21.15.50:0/3055335511 shutdown_connections 2024-09-11T22:14:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.071+0000 7f85749c4640 1 -- 172.21.15.50:0/3055335511 wait complete. 2024-09-11T22:14:45.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.073+0000 7f85749c4640 1 Processor -- start 2024-09-11T22:14:45.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.073+0000 7f85749c4640 1 -- start start 2024-09-11T22:14:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.073+0000 7f85749c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85700b3e10 0x7f8570147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.073+0000 7f85749c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85700d0410 0x7f8570156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.073+0000 7f85749c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857015c2c0 0x7f857015fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.073+0000 7f85749c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f85700cfc10 con 0x7f857015c2c0 2024-09-11T22:14:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.073+0000 7f85749c4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f85700b54a0 con 0x7f85700d0410 2024-09-11T22:14:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.073+0000 7f85749c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f85700ce200 con 0x7f85700b3e10 2024-09-11T22:14:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.073+0000 7f856ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857015c2c0 0x7f857015fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f856ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857015c2c0 0x7f857015fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36744/0 (socket says 172.21.15.50:36744) 2024-09-11T22:14:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f856ed9d640 1 -- 172.21.15.50:0/4061799841 learned_addr learned my addr 172.21.15.50:0/4061799841 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f856dd9b640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85700d0410 0x7f8570156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f856e59c640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85700b3e10 0x7f8570147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f856ed9d640 1 -- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85700b3e10 msgr2=0x7f8570147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f856ed9d640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85700b3e10 0x7f8570147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f856ed9d640 1 -- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85700d0410 msgr2=0x7f8570156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f856ed9d640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85700d0410 0x7f8570156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f856ed9d640 1 -- 172.21.15.50:0/4061799841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8570157cd0 con 0x7f857015c2c0 2024-09-11T22:14:45.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f856ed9d640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857015c2c0 0x7f857015fd30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f856000cbc0 tx=0x7f856000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f8566ffd640 1 -- 172.21.15.50:0/4061799841 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560017070 con 0x7f857015c2c0 2024-09-11T22:14:45.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f8566ffd640 1 -- 172.21.15.50:0/4061799841 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856000ad40 con 0x7f857015c2c0 2024-09-11T22:14:45.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f85749c4640 1 -- 172.21.15.50:0/4061799841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8570156c30 con 0x7f857015c2c0 2024-09-11T22:14:45.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f8566ffd640 1 -- 172.21.15.50:0/4061799841 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560012600 con 0x7f857015c2c0 2024-09-11T22:14:45.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.074+0000 7f85749c4640 1 -- 172.21.15.50:0/4061799841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85701571f0 con 0x7f857015c2c0 2024-09-11T22:14:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.076+0000 7f85749c4640 1 -- 172.21.15.50:0/4061799841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85700cd5a0 con 0x7f857015c2c0 2024-09-11T22:14:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.076+0000 7f8566ffd640 1 -- 172.21.15.50:0/4061799841 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f856001a070 con 0x7f857015c2c0 2024-09-11T22:14:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.076+0000 7f8566ffd640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f855006be60 0x7f855006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.076+0000 7f8566ffd640 1 -- 172.21.15.50:0/4061799841 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f856008abc0 con 0x7f857015c2c0 2024-09-11T22:14:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.077+0000 7f856e59c640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f855006be60 0x7f855006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.077+0000 7f856e59c640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f855006be60 0x7f855006e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f85680079a0 tx=0x7f8568008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.081+0000 7f8566ffd640 1 -- 172.21.15.50:0/4061799841 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85700cd5a0 con 0x7f857015c2c0 2024-09-11T22:14:45.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.291+0000 7f85749c4640 1 -- 172.21.15.50:0/4061799841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f857006d070 con 0x7f857015c2c0 2024-09-11T22:14:45.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.292+0000 7f8566ffd640 1 -- 172.21.15.50:0/4061799841 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5224 (secure 0 0 0) 0x7f8560058dd0 con 0x7f857015c2c0 2024-09-11T22:14:45.293 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:45.293 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"btime":"2024-09-11T22:14:44:423012+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2332065748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2332065748},{"type":"v1","addr":"172.21.15.77:6837","nonce":2332065748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2776548564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2776548564},{"type":"v1","addr":"172.21.15.77:6835","nonce":2776548564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2898617410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2898617410},{"type":"v1","addr":"172.21.15.50:6835","nonce":2898617410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:14:26.306529+0000","modified":"2024-09-11T22:14:44.423002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6393":{"gid":6393,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6833/3974105971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3974105971},{"type":"v1","addr":"172.21.15.50:6833","nonce":3974105971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6393,"qdb_cluster":[6393]},"id":4}]} 2024-09-11T22:14:45.293 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 40 2024-09-11T22:14:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.294+0000 7f85749c4640 1 -- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f855006be60 msgr2=0x7f855006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.294+0000 7f85749c4640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f855006be60 0x7f855006e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f85680079a0 tx=0x7f8568008040 comp rx=0 tx=0).stop 2024-09-11T22:14:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.294+0000 7f85749c4640 1 -- 172.21.15.50:0/4061799841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857015c2c0 msgr2=0x7f857015fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.294+0000 7f85749c4640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857015c2c0 0x7f857015fd30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f856000cbc0 tx=0x7f856000a430 comp rx=0 tx=0).stop 2024-09-11T22:14:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.294+0000 7f85749c4640 1 -- 172.21.15.50:0/4061799841 shutdown_connections 2024-09-11T22:14:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.294+0000 7f85749c4640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f855006be60 0x7f855006e320 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.294+0000 7f85749c4640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f857015c2c0 0x7f857015fd30 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.294+0000 7f85749c4640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85700d0410 0x7f8570156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.294+0000 7f85749c4640 1 --2- 172.21.15.50:0/4061799841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85700b3e10 0x7f8570147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.294+0000 7f85749c4640 1 -- 172.21.15.50:0/4061799841 >> 172.21.15.50:0/4061799841 conn(0x7f85700679c0 msgr2=0x7f85700ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.294+0000 7f85749c4640 1 -- 172.21.15.50:0/4061799841 shutdown_connections 2024-09-11T22:14:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.294+0000 7f85749c4640 1 -- 172.21.15.50:0/4061799841 wait complete. 2024-09-11T22:14:45.712 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:14:26.306529+0000', 'modified': '2024-09-11T22:14:44.423002+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 63, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6393}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6393': {'gid': 6393, 'name': 'a', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6833/3974105971', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 3974105971}, {'type': 'v1', 'addr': '172.21.15.50:6833', 'nonce': 3974105971}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6393, 'qdb_cluster': [6393]} 2024-09-11T22:14:45.712 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:14:45.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T22:14:45.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.821+0000 7fc9b87a1640 1 Processor -- start 2024-09-11T22:14:45.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.821+0000 7fc9b87a1640 1 -- start start 2024-09-11T22:14:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.822+0000 7fc9b87a1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc9b015e870 0x7fc9b00d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.822+0000 7fc9b87a1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9b00d16d0 0x7fc9b00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.822+0000 7fc9b87a1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9b00cfa80 con 0x7fc9b00d3a30 2024-09-11T22:14:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.822+0000 7fc9b87a1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc9b00d1b40 con 0x7fc9b00d16d0 2024-09-11T22:14:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.822+0000 7fc9b87a1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc9b00d3e50 con 0x7fc9b015e870 2024-09-11T22:14:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.823+0000 7fc9b5d3c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9b00d16d0 0x7fc9b00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.823+0000 7fc9b5d3c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9b00d16d0 0x7fc9b00d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36750/0 (socket says 172.21.15.50:36750) 2024-09-11T22:14:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.823+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/2337122220 learned_addr learned my addr 172.21.15.50:0/2337122220 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.823+0000 7fc9b653d640 1 --2- 172.21.15.50:0/2337122220 >> v2:172.21.15.77:3300/0 conn(0x7fc9b015e870 0x7fc9b00d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.823+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/2337122220 >> v2:172.21.15.77:3300/0 conn(0x7fc9b015e870 msgr2=0x7fc9b00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.823+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/2337122220 >> v2:172.21.15.77:3300/0 conn(0x7fc9b015e870 0x7fc9b00d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.823+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/2337122220 >> v1:172.21.15.77:6789/0 conn(0x7fc9b00d3a30 legacy=0x7fc9b00b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.823+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/2337122220 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b00d40d0 con 0x7fc9b00d16d0 2024-09-11T22:14:45.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.824+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/2337122220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9b00d16d0 0x7fc9b00d34f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00d57c0 tx=0x7fc9a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34b1dbb43f15665 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.824+0000 7fc9b553b640 1 -- 172.21.15.50:0/2337122220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4037070 con 0x7fc9b00d16d0 2024-09-11T22:14:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.824+0000 7fc9b553b640 1 -- 172.21.15.50:0/2337122220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a4032440 con 0x7fc9b00d16d0 2024-09-11T22:14:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.824+0000 7fc9b553b640 1 -- 172.21.15.50:0/2337122220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4032810 con 0x7fc9b00d16d0 2024-09-11T22:14:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.824+0000 7fc9b87a1640 1 -- 172.21.15.50:0/2337122220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9b00d16d0 msgr2=0x7fc9b00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.824+0000 7fc9b87a1640 1 --2- 172.21.15.50:0/2337122220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9b00d16d0 0x7fc9b00d34f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00d57c0 tx=0x7fc9a402a270 comp rx=0 tx=0).stop 2024-09-11T22:14:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.824+0000 7fc9b87a1640 1 -- 172.21.15.50:0/2337122220 shutdown_connections 2024-09-11T22:14:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.824+0000 7fc9b87a1640 1 --2- 172.21.15.50:0/2337122220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9b00d16d0 0x7fc9b00d34f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.824+0000 7fc9b87a1640 1 --2- 172.21.15.50:0/2337122220 >> v2:172.21.15.77:3300/0 conn(0x7fc9b015e870 0x7fc9b00d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.824+0000 7fc9b87a1640 1 -- 172.21.15.50:0/2337122220 >> 172.21.15.50:0/2337122220 conn(0x7fc9b00727a0 msgr2=0x7fc9b00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.824+0000 7fc9b87a1640 1 -- 172.21.15.50:0/2337122220 shutdown_connections 2024-09-11T22:14:45.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.824+0000 7fc9b87a1640 1 -- 172.21.15.50:0/2337122220 wait complete. 2024-09-11T22:14:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.826+0000 7fc9b87a1640 1 Processor -- start 2024-09-11T22:14:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.826+0000 7fc9b87a1640 1 -- start start 2024-09-11T22:14:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.826+0000 7fc9b87a1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b00d16d0 0x7fc9b014faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.826+0000 7fc9b87a1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9b00d3a30 0x7fc9b00cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.826+0000 7fc9b87a1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9b015e870 0x7fc9b00cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.826+0000 7fc9b87a1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b00b7ee0 con 0x7fc9b00d3a30 2024-09-11T22:14:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.826+0000 7fc9b87a1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b00b7c00 con 0x7fc9b00d16d0 2024-09-11T22:14:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.826+0000 7fc9b87a1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b015ec50 con 0x7fc9b015e870 2024-09-11T22:14:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.826+0000 7fc9b5d3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9b00d3a30 0x7fc9b00cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9b5d3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9b00d3a30 0x7fc9b00cad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36752/0 (socket says 172.21.15.50:36752) 2024-09-11T22:14:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/1542304508 learned_addr learned my addr 172.21.15.50:0/1542304508 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9b653d640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b00d16d0 0x7fc9b014faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9b6d3e640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9b015e870 0x7fc9b00cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9b015e870 msgr2=0x7fc9b00cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9b015e870 0x7fc9b00cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b00d16d0 msgr2=0x7fc9b014faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b00d16d0 0x7fc9b014faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/1542304508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b00cd000 con 0x7fc9b00d3a30 2024-09-11T22:14:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9b00d3a30 0x7fc9b00cad00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc9a402a2b0 tx=0x7fc9a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9aeffd640 1 -- 172.21.15.50:0/1542304508 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4041020 con 0x7fc9b00d3a30 2024-09-11T22:14:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9aeffd640 1 -- 172.21.15.50:0/1542304508 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a40306c0 con 0x7fc9b00d3a30 2024-09-11T22:14:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9b87a1640 1 -- 172.21.15.50:0/1542304508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b00cc760 con 0x7fc9b00d3a30 2024-09-11T22:14:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9aeffd640 1 -- 172.21.15.50:0/1542304508 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4037040 con 0x7fc9b00d3a30 2024-09-11T22:14:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.827+0000 7fc9b87a1640 1 -- 172.21.15.50:0/1542304508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b00ccd20 con 0x7fc9b00d3a30 2024-09-11T22:14:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.829+0000 7fc9aeffd640 1 -- 172.21.15.50:0/1542304508 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc9a4044020 con 0x7fc9b00d3a30 2024-09-11T22:14:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.829+0000 7fc9aeffd640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc99c06be30 0x7fc99c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.829+0000 7fc9aeffd640 1 -- 172.21.15.50:0/1542304508 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7fc9a40ab5f0 con 0x7fc9b00d3a30 2024-09-11T22:14:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.829+0000 7fc9b653d640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc99c06be30 0x7fc99c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.830+0000 7fc9b653d640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc99c06be30 0x7fc99c06e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8003aa0 tx=0x7fc9a8009830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.830+0000 7fc9bb614740 1 Processor -- start 2024-09-11T22:14:45.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.830+0000 7fc9bb614740 1 -- start start 2024-09-11T22:14:45.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.831+0000 7fc9bb614740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 0x559f27582a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.831+0000 7fc9bb614740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2753aa80 0x559f2753d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.831+0000 7fc9bb614740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753ea50 0x559f275378b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.831+0000 7fc9bb614740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559f2749f520 con 0x559f2753d2c0 2024-09-11T22:14:45.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.831+0000 7fc9bb614740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559f274473e0 con 0x559f2753aa80 2024-09-11T22:14:45.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.831+0000 7fc9bb614740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559f2749b4e0 con 0x559f2753ea50 2024-09-11T22:14:45.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.831+0000 7fc9b653d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 0x559f27582a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.831+0000 7fc9b653d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 0x559f27582a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36754/0 (socket says 172.21.15.50:36754) 2024-09-11T22:14:45.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.831+0000 7fc9b653d640 1 -- 172.21.15.50:0/344580474 learned_addr learned my addr 172.21.15.50:0/344580474 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:45.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.831+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/344580474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2753aa80 0x559f2753d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.831+0000 7fc9b6d3e640 1 --2- 172.21.15.50:0/344580474 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753ea50 0x559f275378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.832+0000 7fc9b653d640 1 -- 172.21.15.50:0/344580474 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753ea50 msgr2=0x559f275378b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:45.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.832+0000 7fc9b653d640 1 --2- 172.21.15.50:0/344580474 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753ea50 0x559f275378b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.832+0000 7fc9b653d640 1 -- 172.21.15.50:0/344580474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2753aa80 msgr2=0x559f2753d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:45.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.832+0000 7fc9b653d640 1 --2- 172.21.15.50:0/344580474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2753aa80 0x559f2753d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.832+0000 7fc9b653d640 1 -- 172.21.15.50:0/344580474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f274622f0 con 0x559f2753d2c0 2024-09-11T22:14:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.832+0000 7fc9b653d640 1 --2- 172.21.15.50:0/344580474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 0x559f27582a60 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8004860 tx=0x7fc9a8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663368dfd988602e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.832+0000 7fc997fff640 1 -- 172.21.15.50:0/344580474 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8027070 con 0x559f2753d2c0 2024-09-11T22:14:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.832+0000 7fc997fff640 1 -- 172.21.15.50:0/344580474 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a8017e40 con 0x559f2753d2c0 2024-09-11T22:14:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.832+0000 7fc997fff640 1 -- 172.21.15.50:0/344580474 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a80157f0 con 0x559f2753d2c0 2024-09-11T22:14:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.833+0000 7fc9bb614740 1 -- 172.21.15.50:0/344580474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 msgr2=0x559f27582a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.833+0000 7fc9bb614740 1 --2- 172.21.15.50:0/344580474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 0x559f27582a60 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8004860 tx=0x7fc9a8013000 comp rx=0 tx=0).stop 2024-09-11T22:14:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.833+0000 7fc9bb614740 1 -- 172.21.15.50:0/344580474 shutdown_connections 2024-09-11T22:14:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.833+0000 7fc9bb614740 1 --2- 172.21.15.50:0/344580474 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753ea50 0x559f275378b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.833+0000 7fc9bb614740 1 --2- 172.21.15.50:0/344580474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2753aa80 0x559f2753d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.833+0000 7fc9bb614740 1 --2- 172.21.15.50:0/344580474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 0x559f27582a60 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.833+0000 7fc9bb614740 1 -- 172.21.15.50:0/344580474 >> 172.21.15.50:0/344580474 conn(0x559f27539a80 msgr2=0x559f27581f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.833+0000 7fc9bb614740 1 -- 172.21.15.50:0/344580474 shutdown_connections 2024-09-11T22:14:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.833+0000 7fc9bb614740 1 -- 172.21.15.50:0/344580474 wait complete. 2024-09-11T22:14:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.833+0000 7fc9bb614740 1 -- start start 2024-09-11T22:14:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.833+0000 7fc9bb614740 1 Processor -- start 2024-09-11T22:14:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.834+0000 7fc9bb614740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 0x559f27596220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.834+0000 7fc9bb614740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753ea50 0x559f2755bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.834+0000 7fc9bb614740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2755c860 0x559f275920b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.834+0000 7fc9bb614740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559f27538f20 con 0x559f2753d2c0 2024-09-11T22:14:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.834+0000 7fc9bb614740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559f27428450 con 0x559f2755c860 2024-09-11T22:14:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.834+0000 7fc9bb614740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559f27583290 con 0x559f2753ea50 2024-09-11T22:14:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.834+0000 7fc9b653d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 0x559f27596220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.834+0000 7fc9bb614740 10 client.0 _ll_register_callbacks cb 0x559f271b1ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.834+0000 7fc9b653d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 0x559f27596220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36764/0 (socket says 172.21.15.50:36764) 2024-09-11T22:14:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.834+0000 7fc9b653d640 1 -- 172.21.15.50:0/1074628220 learned_addr learned my addr 172.21.15.50:0/1074628220 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753ea50 0x559f2755bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9b6d3e640 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2755c860 0x559f275920b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9b653d640 1 -- 172.21.15.50:0/1074628220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753ea50 msgr2=0x559f2755bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9b653d640 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753ea50 0x559f2755bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9b653d640 1 -- 172.21.15.50:0/1074628220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2755c860 msgr2=0x559f275920b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9b653d640 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2755c860 0x559f275920b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9b653d640 1 -- 172.21.15.50:0/1074628220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f271b22d0 con 0x559f2753d2c0 2024-09-11T22:14:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753ea50 0x559f2755bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9b6d3e640 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2755c860 0x559f275920b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9b653d640 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 0x559f27596220 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8004410 tx=0x7fc9a8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e968d4c31d310aec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9957fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9957fa640 1 -- 172.21.15.50:0/1074628220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8027070 con 0x559f2753d2c0 2024-09-11T22:14:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9957fa640 1 -- 172.21.15.50:0/1074628220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7fc9a801a810 con 0x559f2753d2c0 2024-09-11T22:14:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9bb614740 1 -- 172.21.15.50:0/1074628220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f274acc50 con 0x559f2753d2c0 2024-09-11T22:14:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9957fa640 1 -- 172.21.15.50:0/1074628220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc9a8015e30 con 0x559f2753d2c0 2024-09-11T22:14:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9bb614740 10 client.6450 fetch_fsmap learned FSMap version 40 2024-09-11T22:14:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9bb614740 1 -- 172.21.15.50:0/1074628220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x559f2727c6b0 con 0x559f2753d2c0 2024-09-11T22:14:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9957fa640 1 -- 172.21.15.50:0/1074628220 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559f274acc50 con 0x559f2753d2c0 2024-09-11T22:14:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9957fa640 1 -- 172.21.15.50:0/1074628220 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7fc9a8016070 con 0x559f2753d2c0 2024-09-11T22:14:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9bb614740 10 client.6450 fetch_fsmap finished waiting for FSMap version 40 2024-09-11T22:14:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.835+0000 7fc9bb614740 10 client.6450 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:14:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.836+0000 7fc9bb614740 20 client.6450 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.836+0000 7fc9bb614740 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x559f27537ba0 0x559f27537f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.836+0000 7fc9bb614740 4 client.6450 mds_command: new command op to 6393 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.836+0000 7fc9bb614740 1 -- 172.21.15.50:0/1074628220 --> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f274a6fa0 con 0x559f27537ba0 2024-09-11T22:14:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.836+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x559f27537ba0 0x559f27537f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.836+0000 7fc9957fa640 10 client.6450 ms_handle_connect on v2:172.21.15.50:6832/3974105971 2024-09-11T22:14:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.836+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x559f27537ba0 0x559f27537f80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b27f6ee6cea1c02 server_cookie=d2ba5d1c4787e862 in_seq=0 out_seq=0 2024-09-11T22:14:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9957fa640 1 -- 172.21.15.50:0/1074628220 <== mds.0 v2:172.21.15.50:6832/3974105971 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f274a6fa0 con 0x559f27537ba0 2024-09-11T22:14:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9957fa640 10 client.6450 handle_command_reply: tid=0 2024-09-11T22:14:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9bb614740 1 client.6450 shutdown 2024-09-11T22:14:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9bb614740 1 -- 172.21.15.50:0/1074628220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 msgr2=0x559f27596220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9bb614740 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 0x559f27596220 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8004410 tx=0x7fc9a8004ab0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9bb614740 1 -- 172.21.15.50:0/1074628220 shutdown_connections 2024-09-11T22:14:45.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9bb614740 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x559f27537ba0 0x559f27537f80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9bb614740 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753ea50 0x559f2755bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9bb614740 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2755c860 0x559f275920b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9bb614740 1 --2- 172.21.15.50:0/1074628220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753d2c0 0x559f27596220 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9957fa640 0 client.6450 ms_handle_reset on v2:172.21.15.50:6832/3974105971 2024-09-11T22:14:45.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9bb614740 1 -- 172.21.15.50:0/1074628220 >> 172.21.15.50:0/1074628220 conn(0x559f2753aa80 msgr2=0x559f27581470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:45.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9bb614740 1 -- 172.21.15.50:0/1074628220 shutdown_connections 2024-09-11T22:14:45.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9bb614740 1 -- 172.21.15.50:0/1074628220 wait complete. 2024-09-11T22:14:45.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.837+0000 7fc9bb614740 20 client.6450 trim_cache size 0 max 16384 2024-09-11T22:14:45.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.855+0000 7fc9bb614740 1 Processor -- start 2024-09-11T22:14:45.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.855+0000 7fc9bb614740 1 -- start start 2024-09-11T22:14:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9bb614740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753d2c0 0x559f27581470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9bb614740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 0x559f2755bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9bb614740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2755c860 0x559f27582090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9bb614740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b00c9960 con 0x559f2753ea50 2024-09-11T22:14:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9bb614740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b01f8b60 con 0x559f2755c860 2024-09-11T22:14:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9bb614740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b00c9310 con 0x559f2753d2c0 2024-09-11T22:14:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9b5d3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 0x559f2755bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9b5d3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 0x559f2755bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36780/0 (socket says 172.21.15.50:36780) 2024-09-11T22:14:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/3046649951 learned_addr learned my addr 172.21.15.50:0/3046649951 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/3046649951 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753d2c0 msgr2=0x559f27581470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/3046649951 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753d2c0 0x559f27581470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/3046649951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2755c860 msgr2=0x559f27582090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/3046649951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2755c860 0x559f27582090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/3046649951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f27532470 con 0x559f2753ea50 2024-09-11T22:14:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/3046649951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 0x559f2755bef0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4079590 tx=0x7fc9a40a9930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdeffe6f369e22d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.856+0000 7fc9977fe640 1 -- 172.21.15.50:0/3046649951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40823c0 con 0x559f2753ea50 2024-09-11T22:14:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.857+0000 7fc9977fe640 1 -- 172.21.15.50:0/3046649951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a40a9ae0 con 0x559f2753ea50 2024-09-11T22:14:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.857+0000 7fc9977fe640 1 -- 172.21.15.50:0/3046649951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4075f00 con 0x559f2753ea50 2024-09-11T22:14:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.857+0000 7fc9bb614740 1 -- 172.21.15.50:0/3046649951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 msgr2=0x559f2755bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.857+0000 7fc9bb614740 1 --2- 172.21.15.50:0/3046649951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 0x559f2755bef0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4079590 tx=0x7fc9a40a9930 comp rx=0 tx=0).stop 2024-09-11T22:14:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.857+0000 7fc9bb614740 1 -- 172.21.15.50:0/3046649951 shutdown_connections 2024-09-11T22:14:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.857+0000 7fc9bb614740 1 --2- 172.21.15.50:0/3046649951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2755c860 0x559f27582090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.857+0000 7fc9bb614740 1 --2- 172.21.15.50:0/3046649951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 0x559f2755bef0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.857+0000 7fc9bb614740 1 --2- 172.21.15.50:0/3046649951 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2753d2c0 0x559f27581470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.857+0000 7fc9bb614740 1 -- 172.21.15.50:0/3046649951 >> 172.21.15.50:0/3046649951 conn(0x559f2753aa80 msgr2=0x559f2755e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.857+0000 7fc9bb614740 1 -- 172.21.15.50:0/3046649951 shutdown_connections 2024-09-11T22:14:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.857+0000 7fc9bb614740 1 -- 172.21.15.50:0/3046649951 wait complete. 2024-09-11T22:14:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.858+0000 7fc9bb614740 1 -- start start 2024-09-11T22:14:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.858+0000 7fc9bb614740 1 Processor -- start 2024-09-11T22:14:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9bb614740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2753d2c0 0x559f27581c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9bb614740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 0x559f27582190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9bb614740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2755c860 0x559f275367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9bb614740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559f2755d690 con 0x559f2753ea50 2024-09-11T22:14:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9bb614740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559f27595d00 con 0x559f2753d2c0 2024-09-11T22:14:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9bb614740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559f2753bf00 con 0x559f2755c860 2024-09-11T22:14:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9bb614740 10 client.0 _ll_register_callbacks cb 0x7fc9a8025070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9b5d3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 0x559f27582190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9b653d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2753d2c0 0x559f27581c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9b5d3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 0x559f27582190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36796/0 (socket says 172.21.15.50:36796) 2024-09-11T22:14:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/1709385425 learned_addr learned my addr 172.21.15.50:0/1709385425 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9b6d3e640 1 --2- 172.21.15.50:0/1709385425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2755c860 0x559f275367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/1709385425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2755c860 msgr2=0x559f275367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/1709385425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2755c860 0x559f275367d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/1709385425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2753d2c0 msgr2=0x559f27581c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/1709385425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2753d2c0 0x559f27581c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9b5d3c640 1 -- 172.21.15.50:0/1709385425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f2755fb10 con 0x559f2753ea50 2024-09-11T22:14:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9b653d640 1 --2- 172.21.15.50:0/1709385425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2753d2c0 0x559f27581c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9b5d3c640 1 --2- 172.21.15.50:0/1709385425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 0x559f27582190 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4079590 tx=0x7fc9a40ab040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60ed579b78af1cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.859+0000 7fc9957fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9957fa640 1 -- 172.21.15.50:0/1709385425 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4081f30 con 0x559f2753ea50 2024-09-11T22:14:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9957fa640 1 -- 172.21.15.50:0/1709385425 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7fc9a4091790 con 0x559f2753ea50 2024-09-11T22:14:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9bb614740 1 -- 172.21.15.50:0/1709385425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9a40a9ae0 con 0x559f2753ea50 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9957fa640 1 -- 172.21.15.50:0/1709385425 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc9a40820d0 con 0x559f2753ea50 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9bb614740 10 client.6456 fetch_fsmap learned FSMap version 40 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9bb614740 1 -- 172.21.15.50:0/1709385425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x559f27601590 con 0x559f2753ea50 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9957fa640 1 -- 172.21.15.50:0/1709385425 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a40a9ae0 con 0x559f2753ea50 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9957fa640 1 -- 172.21.15.50:0/1709385425 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7fc9a403a030 con 0x559f2753ea50 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9bb614740 10 client.6456 fetch_fsmap finished waiting for FSMap version 40 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9bb614740 10 client.6456 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9bb614740 20 client.6456 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9bb614740 1 --2- 172.21.15.50:0/1709385425 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x559f27537070 0x559f275fff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9bb614740 4 client.6456 mds_command: new command op to 6393 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9bb614740 1 -- 172.21.15.50:0/1709385425 --> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] -- command(tid 0: {"prefix": "status"}) -- 0x559f27423b80 con 0x559f27537070 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9b653d640 1 --2- 172.21.15.50:0/1709385425 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x559f27537070 0x559f275fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9957fa640 10 client.6456 ms_handle_connect on v2:172.21.15.50:6832/3974105971 2024-09-11T22:14:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.860+0000 7fc9b653d640 1 --2- 172.21.15.50:0/1709385425 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x559f27537070 0x559f275fff30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fce768060522f949 server_cookie=d8b81c39dbad458e in_seq=0 out_seq=0 2024-09-11T22:14:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9957fa640 1 -- 172.21.15.50:0/1709385425 <== mds.0 v2:172.21.15.50:6832/3974105971 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x559f27423b80 con 0x559f27537070 2024-09-11T22:14:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9957fa640 10 client.6456 handle_command_reply: tid=0 2024-09-11T22:14:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9bb614740 1 client.6456 shutdown 2024-09-11T22:14:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9bb614740 1 -- 172.21.15.50:0/1709385425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 msgr2=0x559f27582190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9bb614740 1 --2- 172.21.15.50:0/1709385425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 0x559f27582190 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4079590 tx=0x7fc9a40ab040 comp rx=0 tx=0).stop 2024-09-11T22:14:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9bb614740 1 -- 172.21.15.50:0/1709385425 shutdown_connections 2024-09-11T22:14:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9bb614740 1 --2- 172.21.15.50:0/1709385425 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x559f27537070 0x559f275fff30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9bb614740 1 --2- 172.21.15.50:0/1709385425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2755c860 0x559f275367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9bb614740 1 --2- 172.21.15.50:0/1709385425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2753ea50 0x559f27582190 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9bb614740 1 --2- 172.21.15.50:0/1709385425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2753d2c0 0x559f27581c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9957fa640 0 client.6456 ms_handle_reset on v2:172.21.15.50:6832/3974105971 2024-09-11T22:14:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9bb614740 1 -- 172.21.15.50:0/1709385425 >> 172.21.15.50:0/1709385425 conn(0x559f2753aa80 msgr2=0x559f27595210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9bb614740 1 -- 172.21.15.50:0/1709385425 shutdown_connections 2024-09-11T22:14:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9bb614740 1 -- 172.21.15.50:0/1709385425 wait complete. 2024-09-11T22:14:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9bb614740 20 client.6456 trim_cache size 0 max 16384 2024-09-11T22:14:45.868 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:45.868 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:14:45.868 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:14:45.868 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6393, 2024-09-11T22:14:45.868 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:14:45.868 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:14:45.868 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:14:45.869 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 4.4457110159999997, 2024-09-11T22:14:45.869 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 40, 2024-09-11T22:14:45.869 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 63, 2024-09-11T22:14:45.869 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 63, 2024-09-11T22:14:45.869 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 5.3565890109999996 2024-09-11T22:14:45.869 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9b87a1640 1 -- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc99c06be30 msgr2=0x7fc99c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.861+0000 7fc9b87a1640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc99c06be30 0x7fc99c06e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8003aa0 tx=0x7fc9a8009830 comp rx=0 tx=0).stop 2024-09-11T22:14:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.862+0000 7fc9b87a1640 1 -- 172.21.15.50:0/1542304508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9b00d3a30 msgr2=0x7fc9b00cad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.862+0000 7fc9b87a1640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9b00d3a30 0x7fc9b00cad00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc9a402a2b0 tx=0x7fc9a40046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.862+0000 7fc9b87a1640 1 -- 172.21.15.50:0/1542304508 shutdown_connections 2024-09-11T22:14:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.862+0000 7fc9b87a1640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc99c06be30 0x7fc99c06e2f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.862+0000 7fc9b87a1640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9b015e870 0x7fc9b00cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.862+0000 7fc9b87a1640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9b00d3a30 0x7fc9b00cad00 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.862+0000 7fc9b87a1640 1 --2- 172.21.15.50:0/1542304508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b00d16d0 0x7fc9b014faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.862+0000 7fc9b87a1640 1 -- 172.21.15.50:0/1542304508 >> 172.21.15.50:0/1542304508 conn(0x7fc9b00727a0 msgr2=0x7fc9b01606d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.862+0000 7fc9b87a1640 1 -- 172.21.15.50:0/1542304508 shutdown_connections 2024-09-11T22:14:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.862+0000 7fc9b87a1640 1 -- 172.21.15.50:0/1542304508 wait complete. 2024-09-11T22:14:45.873 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 100 2024-09-11T22:14:45.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.978+0000 7f38b92ba640 1 Processor -- start 2024-09-11T22:14:45.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.978+0000 7f38b92ba640 1 -- start start 2024-09-11T22:14:45.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.979+0000 7f38b92ba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f38b40cf580 0x7f38b40b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.979+0000 7f38b92ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38b40cdd50 0x7f38b406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.979+0000 7f38b92ba640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b40ce5f0 con 0x7f38b415e840 2024-09-11T22:14:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.979+0000 7f38b92ba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f38b406c240 con 0x7f38b40cf580 2024-09-11T22:14:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.979+0000 7f38b92ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f38b40d0470 con 0x7f38b40cdd50 2024-09-11T22:14:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.979+0000 7f38b37fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38b40cdd50 0x7f38b406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.979+0000 7f38b27fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f38b40cf580 0x7f38b40b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.979+0000 7f38b27fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f38b40cf580 0x7f38b40b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:41254/0 (socket says 172.21.15.50:41254) 2024-09-11T22:14:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.979+0000 7f38b37fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38b40cdd50 0x7f38b406c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:51536/0 (socket says 172.21.15.50:51536) 2024-09-11T22:14:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.979+0000 7f38b27fc640 1 -- 172.21.15.50:0/508324504 learned_addr learned my addr 172.21.15.50:0/508324504 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.980+0000 7f38b27fc640 1 -- 172.21.15.50:0/508324504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38b40cdd50 msgr2=0x7f38b406c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.980+0000 7f38b27fc640 1 --2- 172.21.15.50:0/508324504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38b40cdd50 0x7f38b406c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.980+0000 7f38b1ffb640 1 -- 172.21.15.50:0/508324504 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1369554589 0 0) 0x7f38b40ce5f0 con 0x7f38b415e840 2024-09-11T22:14:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.980+0000 7f38b27fc640 1 -- 172.21.15.50:0/508324504 >> v1:172.21.15.77:6789/0 conn(0x7f38b415e840 legacy=0x7f38b40cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.980+0000 7f38b27fc640 1 -- 172.21.15.50:0/508324504 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b40ce310 con 0x7f38b40cf580 2024-09-11T22:14:45.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.980+0000 7f38b37fe640 1 --2- 172.21.15.50:0/508324504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38b40cdd50 0x7f38b406c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:45.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.981+0000 7f38b27fc640 1 --2- 172.21.15.50:0/508324504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38b40cf580 0x7f38b40b4c70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009870 tx=0x7f38a802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65adfb2a6bd30a54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.981+0000 7f38b1ffb640 1 -- 172.21.15.50:0/508324504 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8037070 con 0x7f38b40cf580 2024-09-11T22:14:45.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.981+0000 7f38b1ffb640 1 -- 172.21.15.50:0/508324504 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a8032440 con 0x7f38b40cf580 2024-09-11T22:14:45.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.981+0000 7f38b1ffb640 1 -- 172.21.15.50:0/508324504 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8032810 con 0x7f38b40cf580 2024-09-11T22:14:45.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.981+0000 7f38b92ba640 1 -- 172.21.15.50:0/508324504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38b40cf580 msgr2=0x7f38b40b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.981+0000 7f38b92ba640 1 --2- 172.21.15.50:0/508324504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38b40cf580 0x7f38b40b4c70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009870 tx=0x7f38a802a250 comp rx=0 tx=0).stop 2024-09-11T22:14:45.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.981+0000 7f38b92ba640 1 -- 172.21.15.50:0/508324504 shutdown_connections 2024-09-11T22:14:45.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.981+0000 7f38b92ba640 1 --2- 172.21.15.50:0/508324504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38b40cdd50 0x7f38b406c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.981+0000 7f38b92ba640 1 --2- 172.21.15.50:0/508324504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38b40cf580 0x7f38b40b4c70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.981+0000 7f38b92ba640 1 -- 172.21.15.50:0/508324504 >> 172.21.15.50:0/508324504 conn(0x7f38b40b4150 msgr2=0x7f38b40b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:45.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.981+0000 7f38b92ba640 1 -- 172.21.15.50:0/508324504 shutdown_connections 2024-09-11T22:14:45.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.981+0000 7f38b92ba640 1 -- 172.21.15.50:0/508324504 wait complete. 2024-09-11T22:14:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.983+0000 7f38b92ba640 1 Processor -- start 2024-09-11T22:14:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.983+0000 7f38b92ba640 1 -- start start 2024-09-11T22:14:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.983+0000 7f38b92ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b40cdd50 0x7f38b4152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.983+0000 7f38b92ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38b40cf580 0x7f38b40b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.983+0000 7f38b92ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38b415e840 0x7f38b40b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.983+0000 7f38b92ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f38b415ec20 con 0x7f38b40cdd50 2024-09-11T22:14:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.983+0000 7f38b92ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f38b406bed0 con 0x7f38b40cf580 2024-09-11T22:14:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.983+0000 7f38b92ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f38b415eda0 con 0x7f38b415e840 2024-09-11T22:14:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b40cdd50 0x7f38b4152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b40cdd50 0x7f38b4152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36812/0 (socket says 172.21.15.50:36812) 2024-09-11T22:14:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b2ffd640 1 -- 172.21.15.50:0/2246430994 learned_addr learned my addr 172.21.15.50:0/2246430994 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b37fe640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38b415e840 0x7f38b40b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b27fc640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38b40cf580 0x7f38b40b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b2ffd640 1 -- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38b415e840 msgr2=0x7f38b40b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b2ffd640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38b415e840 0x7f38b40b7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b2ffd640 1 -- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38b40cf580 msgr2=0x7f38b40b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b2ffd640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38b40cf580 0x7f38b40b78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b2ffd640 1 -- 172.21.15.50:0/2246430994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b40b6360 con 0x7f38b40cdd50 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b37fe640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38b415e840 0x7f38b40b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b27fc640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38b40cf580 0x7f38b40b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b2ffd640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b40cdd50 0x7f38b4152a90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f38a400c4b0 tx=0x7f38a400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f389b7fe640 1 -- 172.21.15.50:0/2246430994 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4017070 con 0x7f38b40cdd50 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f389b7fe640 1 -- 172.21.15.50:0/2246430994 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a4005480 con 0x7f38b40cdd50 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b92ba640 1 -- 172.21.15.50:0/2246430994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b40b6640 con 0x7f38b40cdd50 2024-09-11T22:14:45.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f389b7fe640 1 -- 172.21.15.50:0/2246430994 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4003830 con 0x7f38b40cdd50 2024-09-11T22:14:45.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.984+0000 7f38b92ba640 1 -- 172.21.15.50:0/2246430994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b40b6c00 con 0x7f38b40cdd50 2024-09-11T22:14:45.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.985+0000 7f38b92ba640 1 -- 172.21.15.50:0/2246430994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b40b4c70 con 0x7f38b40cdd50 2024-09-11T22:14:45.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.986+0000 7f389b7fe640 1 -- 172.21.15.50:0/2246430994 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38a401a070 con 0x7f38b40cdd50 2024-09-11T22:14:45.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.986+0000 7f389b7fe640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f38a006be30 0x7f38a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:45.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.986+0000 7f389b7fe640 1 -- 172.21.15.50:0/2246430994 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f38a408a4e0 con 0x7f38b40cdd50 2024-09-11T22:14:45.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.987+0000 7f38b27fc640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f38a006be30 0x7f38a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:45.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.987+0000 7f38b27fc640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f38a006be30 0x7f38a006e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f38a8034000 tx=0x7f38a802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:45.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:45.991+0000 7f389b7fe640 1 -- 172.21.15.50:0/2246430994 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38a4058c30 con 0x7f38b40cdd50 2024-09-11T22:14:46.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.170+0000 7f38b92ba640 1 -- 172.21.15.50:0/2246430994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f38b406e1d0 con 0x7f38b40cdd50 2024-09-11T22:14:46.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.174+0000 7f389b7fe640 1 -- 172.21.15.50:0/2246430994 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v18)=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f38a4058530 con 0x7f38b40cdd50 2024-09-11T22:14:46.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.177+0000 7f38b92ba640 1 -- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f38a006be30 msgr2=0x7f38a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.177+0000 7f38b92ba640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f38a006be30 0x7f38a006e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f38a8034000 tx=0x7f38a802e000 comp rx=0 tx=0).stop 2024-09-11T22:14:46.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.177+0000 7f38b92ba640 1 -- 172.21.15.50:0/2246430994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b40cdd50 msgr2=0x7f38b4152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.177+0000 7f38b92ba640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b40cdd50 0x7f38b4152a90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f38a400c4b0 tx=0x7f38a400c970 comp rx=0 tx=0).stop 2024-09-11T22:14:46.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.177+0000 7f38b92ba640 1 -- 172.21.15.50:0/2246430994 shutdown_connections 2024-09-11T22:14:46.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.177+0000 7f38b92ba640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f38a006be30 0x7f38a006e2f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.177+0000 7f38b92ba640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38b415e840 0x7f38b40b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.177+0000 7f38b92ba640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38b40cf580 0x7f38b40b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.177+0000 7f38b92ba640 1 --2- 172.21.15.50:0/2246430994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b40cdd50 0x7f38b4152a90 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.177+0000 7f38b92ba640 1 -- 172.21.15.50:0/2246430994 >> 172.21.15.50:0/2246430994 conn(0x7f38b40b4150 msgr2=0x7f38b40b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:46.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.177+0000 7f38b92ba640 1 -- 172.21.15.50:0/2246430994 shutdown_connections 2024-09-11T22:14:46.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.177+0000 7f38b92ba640 1 -- 172.21.15.50:0/2246430994 wait complete. 2024-09-11T22:14:46.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 30 2024-09-11T22:14:46.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.293+0000 7fc45900e640 1 Processor -- start 2024-09-11T22:14:46.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.294+0000 7fc45900e640 1 -- start start 2024-09-11T22:14:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.294+0000 7fc45900e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc45415e870 0x7fc4540d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.294+0000 7fc45900e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc4540d3c00 0x7fc4540b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.294+0000 7fc45900e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4540cfa80 con 0x7fc4540d16d0 2024-09-11T22:14:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.294+0000 7fc45900e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc4540d1b40 con 0x7fc4540d3c00 2024-09-11T22:14:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.294+0000 7fc45900e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc4540d40d0 con 0x7fc45415e870 2024-09-11T22:14:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.294+0000 7fc45359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc4540d3c00 0x7fc4540b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.294+0000 7fc45259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc4540d16d0 0x7fc4540d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38812/0 (socket says 172.21.15.50:38812) 2024-09-11T22:14:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.294+0000 7fc45259c640 1 -- 172.21.15.50:0/3620275925 learned_addr learned my addr 172.21.15.50:0/3620275925 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.295+0000 7fc452d9d640 1 --2- 172.21.15.50:0/3620275925 >> v2:172.21.15.77:3300/0 conn(0x7fc45415e870 0x7fc4540d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.295+0000 7fc45359e640 1 -- 172.21.15.50:0/3620275925 >> v2:172.21.15.77:3300/0 conn(0x7fc45415e870 msgr2=0x7fc4540d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.295+0000 7fc45359e640 1 --2- 172.21.15.50:0/3620275925 >> v2:172.21.15.77:3300/0 conn(0x7fc45415e870 0x7fc4540d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.295+0000 7fc45359e640 1 -- 172.21.15.50:0/3620275925 >> v1:172.21.15.50:6789/0 conn(0x7fc4540d16d0 legacy=0x7fc4540d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.295+0000 7fc451d9b640 1 -- 172.21.15.50:0/3620275925 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 820042140 0 0) 0x7fc448001110 con 0x7fc4540d16d0 2024-09-11T22:14:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.295+0000 7fc45359e640 1 -- 172.21.15.50:0/3620275925 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4540d43b0 con 0x7fc4540d3c00 2024-09-11T22:14:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.295+0000 7fc452d9d640 1 --2- 172.21.15.50:0/3620275925 >> v2:172.21.15.77:3300/0 conn(0x7fc45415e870 0x7fc4540d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:46.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.296+0000 7fc45359e640 1 --2- 172.21.15.50:0/3620275925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4540d3c00 0x7fc4540b8400 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc4540d57c0 tx=0x7fc44c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a56f1345a9055d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:46.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.296+0000 7fc451d9b640 1 -- 172.21.15.50:0/3620275925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c007740 con 0x7fc4540d3c00 2024-09-11T22:14:46.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.296+0000 7fc451d9b640 1 -- 172.21.15.50:0/3620275925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc44c0078e0 con 0x7fc4540d3c00 2024-09-11T22:14:46.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.296+0000 7fc451d9b640 1 -- 172.21.15.50:0/3620275925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c007cb0 con 0x7fc4540d3c00 2024-09-11T22:14:46.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.296+0000 7fc45900e640 1 -- 172.21.15.50:0/3620275925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4540d3c00 msgr2=0x7fc4540b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.296+0000 7fc45900e640 1 --2- 172.21.15.50:0/3620275925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4540d3c00 0x7fc4540b8400 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc4540d57c0 tx=0x7fc44c02a680 comp rx=0 tx=0).stop 2024-09-11T22:14:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.296+0000 7fc45900e640 1 -- 172.21.15.50:0/3620275925 shutdown_connections 2024-09-11T22:14:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.296+0000 7fc45900e640 1 --2- 172.21.15.50:0/3620275925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4540d3c00 0x7fc4540b8400 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.296+0000 7fc45900e640 1 --2- 172.21.15.50:0/3620275925 >> v2:172.21.15.77:3300/0 conn(0x7fc45415e870 0x7fc4540d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.296+0000 7fc45900e640 1 -- 172.21.15.50:0/3620275925 >> 172.21.15.50:0/3620275925 conn(0x7fc4540727a0 msgr2=0x7fc4540679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.296+0000 7fc45900e640 1 -- 172.21.15.50:0/3620275925 shutdown_connections 2024-09-11T22:14:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.296+0000 7fc45900e640 1 -- 172.21.15.50:0/3620275925 wait complete. 2024-09-11T22:14:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.298+0000 7fc45900e640 1 Processor -- start 2024-09-11T22:14:46.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.298+0000 7fc45900e640 1 -- start start 2024-09-11T22:14:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.298+0000 7fc45900e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4540d16d0 0x7fc4541f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.298+0000 7fc45900e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4540d3c00 0x7fc45415a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:46.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45900e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45415e870 0x7fc45415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45900e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc45415ec50 con 0x7fc45415e870 2024-09-11T22:14:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45900e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc4540b7ee0 con 0x7fc4540d16d0 2024-09-11T22:14:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45900e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc4540b78b0 con 0x7fc4540d3c00 2024-09-11T22:14:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45415e870 0x7fc45415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45415e870 0x7fc45415b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36826/0 (socket says 172.21.15.50:36826) 2024-09-11T22:14:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45359e640 1 -- 172.21.15.50:0/1454454354 learned_addr learned my addr 172.21.15.50:0/1454454354 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45259c640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4540d3c00 0x7fc45415a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:46.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc452d9d640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4540d16d0 0x7fc4541f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45359e640 1 -- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4540d3c00 msgr2=0x7fc45415a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45359e640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4540d3c00 0x7fc45415a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45359e640 1 -- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4540d16d0 msgr2=0x7fc4541f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45359e640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4540d16d0 0x7fc4541f4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45359e640 1 -- 172.21.15.50:0/1454454354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45415bf80 con 0x7fc45415e870 2024-09-11T22:14:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45359e640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45415e870 0x7fc45415b2d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc44c02ac70 tx=0x7fc44c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc43b7fe640 1 -- 172.21.15.50:0/1454454354 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c040070 con 0x7fc45415e870 2024-09-11T22:14:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc43b7fe640 1 -- 172.21.15.50:0/1454454354 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc44c031c90 con 0x7fc45415e870 2024-09-11T22:14:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc43b7fe640 1 -- 172.21.15.50:0/1454454354 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c045680 con 0x7fc45415e870 2024-09-11T22:14:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45900e640 1 -- 172.21.15.50:0/1454454354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc45415bc40 con 0x7fc45415e870 2024-09-11T22:14:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.299+0000 7fc45900e640 1 -- 172.21.15.50:0/1454454354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc45415c520 con 0x7fc45415e870 2024-09-11T22:14:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.301+0000 7fc45900e640 1 -- 172.21.15.50:0/1454454354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4540d1190 con 0x7fc45415e870 2024-09-11T22:14:46.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.301+0000 7fc43b7fe640 1 -- 172.21.15.50:0/1454454354 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc44c039040 con 0x7fc45415e870 2024-09-11T22:14:46.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.302+0000 7fc43b7fe640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc44006be30 0x7fc44006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:46.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.302+0000 7fc43b7fe640 1 -- 172.21.15.50:0/1454454354 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7fc44c0ac7b0 con 0x7fc45415e870 2024-09-11T22:14:46.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.302+0000 7fc452d9d640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc44006be30 0x7fc44006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:46.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.303+0000 7fc452d9d640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc44006be30 0x7fc44006e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc44400ab60 tx=0x7fc444008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:46.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.306+0000 7fc43b7fe640 1 -- 172.21.15.50:0/1454454354 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc44c07ab20 con 0x7fc45415e870 2024-09-11T22:14:46.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.481+0000 7fc45900e640 1 -- 172.21.15.50:0/1454454354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fc45406bf50 con 0x7fc45415e870 2024-09-11T22:14:46.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.484+0000 7fc43b7fe640 1 -- 172.21.15.50:0/1454454354 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v19)=0 v19) ==== 117+0+0 (secure 0 0 0) 0x7fc44c07ee20 con 0x7fc45415e870 2024-09-11T22:14:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.487+0000 7fc45900e640 1 -- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc44006be30 msgr2=0x7fc44006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.487+0000 7fc45900e640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc44006be30 0x7fc44006e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc44400ab60 tx=0x7fc444008040 comp rx=0 tx=0).stop 2024-09-11T22:14:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.487+0000 7fc45900e640 1 -- 172.21.15.50:0/1454454354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45415e870 msgr2=0x7fc45415b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.487+0000 7fc45900e640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45415e870 0x7fc45415b2d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc44c02ac70 tx=0x7fc44c004a40 comp rx=0 tx=0).stop 2024-09-11T22:14:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.487+0000 7fc45900e640 1 -- 172.21.15.50:0/1454454354 shutdown_connections 2024-09-11T22:14:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.487+0000 7fc45900e640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc44006be30 0x7fc44006e2f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.487+0000 7fc45900e640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4540d3c00 0x7fc45415a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.487+0000 7fc45900e640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc45415e870 0x7fc45415b2d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.487+0000 7fc45900e640 1 --2- 172.21.15.50:0/1454454354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4540d16d0 0x7fc4541f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.487+0000 7fc45900e640 1 -- 172.21.15.50:0/1454454354 >> 172.21.15.50:0/1454454354 conn(0x7fc4540727a0 msgr2=0x7fc4540679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:46.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.487+0000 7fc45900e640 1 -- 172.21.15.50:0/1454454354 shutdown_connections 2024-09-11T22:14:46.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.487+0000 7fc45900e640 1 -- 172.21.15.50:0/1454454354 wait complete. 2024-09-11T22:14:46.499 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:46.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.600+0000 7fed0e4a6640 1 Processor -- start 2024-09-11T22:14:46.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.600+0000 7fed0e4a6640 1 -- start start 2024-09-11T22:14:46.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.601+0000 7fed0e4a6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed0815e8e0 0x7fed080b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:46.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.601+0000 7fed0e4a6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed08162350 0x7fed08162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.601+0000 7fed0e4a6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed08163080 con 0x7fed080d1580 2024-09-11T22:14:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.601+0000 7fed0e4a6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fed0815ecc0 con 0x7fed08162350 2024-09-11T22:14:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.601+0000 7fed0e4a6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fed080d2ad0 con 0x7fed0815e8e0 2024-09-11T22:14:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.601+0000 7fed07fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed0815e8e0 0x7fed080b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.601+0000 7fed0ca43640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed08162350 0x7fed08162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.601+0000 7fed077fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fed080d1580 0x7fed080d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:39696/0 (socket says 172.21.15.50:39696) 2024-09-11T22:14:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.601+0000 7fed0ca43640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed08162350 0x7fed08162800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:41304/0 (socket says 172.21.15.50:41304) 2024-09-11T22:14:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.601+0000 7fed077fe640 1 -- 172.21.15.50:0/457796779 learned_addr learned my addr 172.21.15.50:0/457796779 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.602+0000 7fed06ffd640 1 -- 172.21.15.50:0/457796779 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868092430 0 0) 0x7fed08163080 con 0x7fed080d1580 2024-09-11T22:14:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.602+0000 7fed06ffd640 1 -- 172.21.15.50:0/457796779 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecf0003520 con 0x7fed080d1580 2024-09-11T22:14:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.602+0000 7fed0ca43640 1 -- 172.21.15.50:0/457796779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed0815e8e0 msgr2=0x7fed080b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.602+0000 7fed0ca43640 1 --2- 172.21.15.50:0/457796779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed0815e8e0 0x7fed080b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.602+0000 7fed0ca43640 1 -- 172.21.15.50:0/457796779 >> v1:172.21.15.77:6789/0 conn(0x7fed080d1580 legacy=0x7fed080d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.602+0000 7fed0ca43640 1 -- 172.21.15.50:0/457796779 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed080d2d20 con 0x7fed08162350 2024-09-11T22:14:46.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.602+0000 7fed07fff640 1 --2- 172.21.15.50:0/457796779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed0815e8e0 0x7fed080b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.603+0000 7fed0ca43640 1 --2- 172.21.15.50:0/457796779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed08162350 0x7fed08162800 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fed00009d90 tx=0x7fed0002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=748c722d8f08098 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.603+0000 7fed06ffd640 1 -- 172.21.15.50:0/457796779 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed00007740 con 0x7fed08162350 2024-09-11T22:14:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.603+0000 7fed06ffd640 1 -- 172.21.15.50:0/457796779 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed000078e0 con 0x7fed08162350 2024-09-11T22:14:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.603+0000 7fed06ffd640 1 -- 172.21.15.50:0/457796779 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed00007c90 con 0x7fed08162350 2024-09-11T22:14:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.603+0000 7fed0e4a6640 1 -- 172.21.15.50:0/457796779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed08162350 msgr2=0x7fed08162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.603+0000 7fed0e4a6640 1 --2- 172.21.15.50:0/457796779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed08162350 0x7fed08162800 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fed00009d90 tx=0x7fed0002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.603+0000 7fed0e4a6640 1 -- 172.21.15.50:0/457796779 shutdown_connections 2024-09-11T22:14:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.603+0000 7fed0e4a6640 1 --2- 172.21.15.50:0/457796779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed08162350 0x7fed08162800 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.603+0000 7fed0e4a6640 1 --2- 172.21.15.50:0/457796779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed0815e8e0 0x7fed080b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.603+0000 7fed0e4a6640 1 -- 172.21.15.50:0/457796779 >> 172.21.15.50:0/457796779 conn(0x7fed08067ba0 msgr2=0x7fed08067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.603+0000 7fed0e4a6640 1 -- 172.21.15.50:0/457796779 shutdown_connections 2024-09-11T22:14:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.603+0000 7fed0e4a6640 1 -- 172.21.15.50:0/457796779 wait complete. 2024-09-11T22:14:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.604+0000 7fed0e4a6640 1 Processor -- start 2024-09-11T22:14:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.605+0000 7fed0e4a6640 1 -- start start 2024-09-11T22:14:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.605+0000 7fed0e4a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080d1580 0x7fed081529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.605+0000 7fed0e4a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0815e8e0 0x7fed0815ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.605+0000 7fed0e4a6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed08162350 0x7fed0815f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.605+0000 7fed0e4a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fed08162d40 con 0x7fed0815e8e0 2024-09-11T22:14:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.605+0000 7fed0e4a6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed080d3370 con 0x7fed080d1580 2024-09-11T22:14:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.605+0000 7fed0e4a6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fed080d3800 con 0x7fed08162350 2024-09-11T22:14:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0815e8e0 0x7fed0815ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0815e8e0 0x7fed0815ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36840/0 (socket says 172.21.15.50:36840) 2024-09-11T22:14:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed077fe640 1 -- 172.21.15.50:0/348990766 learned_addr learned my addr 172.21.15.50:0/348990766 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed0ca43640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed08162350 0x7fed0815f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed07fff640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080d1580 0x7fed081529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed077fe640 1 -- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed08162350 msgr2=0x7fed0815f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed077fe640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed08162350 0x7fed0815f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed077fe640 1 -- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080d1580 msgr2=0x7fed081529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed077fe640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080d1580 0x7fed081529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed077fe640 1 -- 172.21.15.50:0/348990766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed080b42f0 con 0x7fed0815e8e0 2024-09-11T22:14:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed077fe640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0815e8e0 0x7fed0815ee50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00c4d0 tx=0x7fecfc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed04ff9640 1 -- 172.21.15.50:0/348990766 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc017070 con 0x7fed0815e8e0 2024-09-11T22:14:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed04ff9640 1 -- 172.21.15.50:0/348990766 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecfc005ce0 con 0x7fed0815e8e0 2024-09-11T22:14:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed0e4a6640 1 -- 172.21.15.50:0/348990766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed080b45d0 con 0x7fed0815e8e0 2024-09-11T22:14:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed04ff9640 1 -- 172.21.15.50:0/348990766 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc007270 con 0x7fed0815e8e0 2024-09-11T22:14:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.606+0000 7fed0e4a6640 1 -- 172.21.15.50:0/348990766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed080b4b90 con 0x7fed0815e8e0 2024-09-11T22:14:46.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.607+0000 7fed0e4a6640 1 -- 172.21.15.50:0/348990766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed080b7880 con 0x7fed0815e8e0 2024-09-11T22:14:46.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.608+0000 7fed04ff9640 1 -- 172.21.15.50:0/348990766 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fecfc01a070 con 0x7fed0815e8e0 2024-09-11T22:14:46.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.608+0000 7fed04ff9640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fecf406be30 0x7fecf406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:46.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.608+0000 7fed04ff9640 1 -- 172.21.15.50:0/348990766 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7fecfc08a1f0 con 0x7fed0815e8e0 2024-09-11T22:14:46.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.608+0000 7fed07fff640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fecf406be30 0x7fecf406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:46.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.609+0000 7fed07fff640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fecf406be30 0x7fecf406e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fed080b52d0 tx=0x7fecf8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.613+0000 7fed04ff9640 1 -- 172.21.15.50:0/348990766 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fecfc0584b0 con 0x7fed0815e8e0 2024-09-11T22:14:46.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.822+0000 7fed0e4a6640 1 -- 172.21.15.50:0/348990766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed080b91f0 con 0x7fed0815e8e0 2024-09-11T22:14:46.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.823+0000 7fed04ff9640 1 -- 172.21.15.50:0/348990766 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5224 (secure 0 0 0) 0x7fecfc05c7b0 con 0x7fed0815e8e0 2024-09-11T22:14:46.824 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:46.824 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"btime":"2024-09-11T22:14:44:423012+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2332065748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2332065748},{"type":"v1","addr":"172.21.15.77:6837","nonce":2332065748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2776548564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2776548564},{"type":"v1","addr":"172.21.15.77:6835","nonce":2776548564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2898617410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2898617410},{"type":"v1","addr":"172.21.15.50:6835","nonce":2898617410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:14:26.306529+0000","modified":"2024-09-11T22:14:44.423002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6393":{"gid":6393,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6833/3974105971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3974105971},{"type":"v1","addr":"172.21.15.50:6833","nonce":3974105971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6393,"qdb_cluster":[6393]},"id":4}]} 2024-09-11T22:14:46.824 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 40 2024-09-11T22:14:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.825+0000 7fed0e4a6640 1 -- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fecf406be30 msgr2=0x7fecf406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.825+0000 7fed0e4a6640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fecf406be30 0x7fecf406e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fed080b52d0 tx=0x7fecf8009190 comp rx=0 tx=0).stop 2024-09-11T22:14:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.825+0000 7fed0e4a6640 1 -- 172.21.15.50:0/348990766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0815e8e0 msgr2=0x7fed0815ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.825+0000 7fed0e4a6640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0815e8e0 0x7fed0815ee50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00c4d0 tx=0x7fecfc00c990 comp rx=0 tx=0).stop 2024-09-11T22:14:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.825+0000 7fed0e4a6640 1 -- 172.21.15.50:0/348990766 shutdown_connections 2024-09-11T22:14:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.825+0000 7fed0e4a6640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fecf406be30 0x7fecf406e2f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.825+0000 7fed0e4a6640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed08162350 0x7fed0815f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.825+0000 7fed0e4a6640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed0815e8e0 0x7fed0815ee50 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.825+0000 7fed0e4a6640 1 --2- 172.21.15.50:0/348990766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080d1580 0x7fed081529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.825+0000 7fed0e4a6640 1 -- 172.21.15.50:0/348990766 >> 172.21.15.50:0/348990766 conn(0x7fed08067ba0 msgr2=0x7fed08067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.825+0000 7fed0e4a6640 1 -- 172.21.15.50:0/348990766 shutdown_connections 2024-09-11T22:14:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:46.825+0000 7fed0e4a6640 1 -- 172.21.15.50:0/348990766 wait complete. 2024-09-11T22:14:46.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-11T22:14:46.954 INFO:teuthology.orchestra.run.smithi050.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-11T22:14:38.844502+0000","btime":"2024-09-11T22:14:38.039523+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-11T22:14:38.844502+0000","atime":"2024-09-11T22:14:38.039523+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-11T22:14:38.844502+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-11T22:14:38.845502+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-11T22:14:38.845502+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-11T22:14:46.954 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-11T22:14:38.845502+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-11T22:14:38.039523+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-11T22:14:38.039523+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-11T22:14:38.844502+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-11T22:14:38.844502+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-11T22:14:38.844502+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-11T22:14:38.845502+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-11T22:14:46.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:14:46.955 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start /testdir recursive 2024-09-11T22:14:47.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.060+0000 7f253480e640 1 Processor -- start 2024-09-11T22:14:47.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.060+0000 7f253480e640 1 -- start start 2024-09-11T22:14:47.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.061+0000 7f253480e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f253006f300 0x7f25300b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.061+0000 7f253480e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2530162280 con 0x7f253006ffb0 2024-09-11T22:14:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.061+0000 7f253480e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253006c700 con 0x7f2530161ea0 2024-09-11T22:14:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.061+0000 7f253480e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f253006c9e0 con 0x7f253006f300 2024-09-11T22:14:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.061+0000 7f252dd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f253006ffb0 0x7f25300d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38818/0 (socket says 172.21.15.50:38818) 2024-09-11T22:14:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.061+0000 7f252dd9b640 1 -- 172.21.15.50:0/3617254618 learned_addr learned my addr 172.21.15.50:0/3617254618 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.061+0000 7f252ed9d640 1 --2- 172.21.15.50:0/3617254618 >> v2:172.21.15.77:3300/0 conn(0x7f253006f300 0x7f25300b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.061+0000 7f252d59a640 1 -- 172.21.15.50:0/3617254618 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3623630042 0 0) 0x7f2530162280 con 0x7f253006ffb0 2024-09-11T22:14:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.061+0000 7f252d59a640 1 -- 172.21.15.50:0/3617254618 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2518003520 con 0x7f253006ffb0 2024-09-11T22:14:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.062+0000 7f252ed9d640 1 -- 172.21.15.50:0/3617254618 >> v1:172.21.15.77:6789/0 conn(0x7f2530161ea0 legacy=0x7f253006f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.062+0000 7f252ed9d640 1 -- 172.21.15.50:0/3617254618 >> v1:172.21.15.50:6789/0 conn(0x7f253006ffb0 legacy=0x7f25300d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.062+0000 7f252ed9d640 1 -- 172.21.15.50:0/3617254618 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253006ccc0 con 0x7f253006f300 2024-09-11T22:14:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.062+0000 7f252ed9d640 1 --2- 172.21.15.50:0/3617254618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253006f300 0x7f25300b4c70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2530162450 tx=0x7f252802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e20ccccde486a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.063+0000 7f252d59a640 1 -- 172.21.15.50:0/3617254618 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2528007740 con 0x7f253006f300 2024-09-11T22:14:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.063+0000 7f252d59a640 1 -- 172.21.15.50:0/3617254618 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25280078e0 con 0x7f253006f300 2024-09-11T22:14:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.063+0000 7f252d59a640 1 -- 172.21.15.50:0/3617254618 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2528007cb0 con 0x7f253006f300 2024-09-11T22:14:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.063+0000 7f253480e640 1 -- 172.21.15.50:0/3617254618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253006f300 msgr2=0x7f25300b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.063+0000 7f253480e640 1 --2- 172.21.15.50:0/3617254618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253006f300 0x7f25300b4c70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2530162450 tx=0x7f252802a660 comp rx=0 tx=0).stop 2024-09-11T22:14:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.063+0000 7f253480e640 1 -- 172.21.15.50:0/3617254618 shutdown_connections 2024-09-11T22:14:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.063+0000 7f253480e640 1 --2- 172.21.15.50:0/3617254618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253006f300 0x7f25300b4c70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.063+0000 7f253480e640 1 -- 172.21.15.50:0/3617254618 >> 172.21.15.50:0/3617254618 conn(0x7f25300b4150 msgr2=0x7f25300b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.063+0000 7f253480e640 1 -- 172.21.15.50:0/3617254618 shutdown_connections 2024-09-11T22:14:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.063+0000 7f253480e640 1 -- 172.21.15.50:0/3617254618 wait complete. 2024-09-11T22:14:47.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.065+0000 7f253480e640 1 Processor -- start 2024-09-11T22:14:47.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.065+0000 7f253480e640 1 -- start start 2024-09-11T22:14:47.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.065+0000 7f253480e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f253006f300 0x7f25300b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.065+0000 7f253480e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253006ffb0 0x7f25300b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.065+0000 7f253480e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2530161ea0 0x7f25300affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.065+0000 7f253480e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f253006d7a0 con 0x7f253006f300 2024-09-11T22:14:47.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.065+0000 7f253480e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f253006d280 con 0x7f253006ffb0 2024-09-11T22:14:47.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.065+0000 7f253480e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f253006d920 con 0x7f2530161ea0 2024-09-11T22:14:47.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.065+0000 7f252e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f253006f300 0x7f25300b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.065+0000 7f252e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f253006f300 0x7f25300b75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36844/0 (socket says 172.21.15.50:36844) 2024-09-11T22:14:47.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.065+0000 7f252e59c640 1 -- 172.21.15.50:0/3401938798 learned_addr learned my addr 172.21.15.50:0/3401938798 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:47.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f252dd9b640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253006ffb0 0x7f25300b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f252ed9d640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2530161ea0 0x7f25300affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f252e59c640 1 -- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2530161ea0 msgr2=0x7f25300affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f252e59c640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2530161ea0 0x7f25300affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f252e59c640 1 -- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253006ffb0 msgr2=0x7f25300b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f252e59c640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253006ffb0 0x7f25300b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f252e59c640 1 -- 172.21.15.50:0/3401938798 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25300b7b20 con 0x7f253006f300 2024-09-11T22:14:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f252dd9b640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253006ffb0 0x7f25300b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f252ed9d640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2530161ea0 0x7f25300affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f252e59c640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f253006f300 0x7f25300b75e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f252000c3c0 tx=0x7f252000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f251effd640 1 -- 172.21.15.50:0/3401938798 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25200052d0 con 0x7f253006f300 2024-09-11T22:14:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f251effd640 1 -- 172.21.15.50:0/3401938798 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2520005490 con 0x7f253006f300 2024-09-11T22:14:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f251effd640 1 -- 172.21.15.50:0/3401938798 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520007260 con 0x7f253006f300 2024-09-11T22:14:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f253480e640 1 -- 172.21.15.50:0/3401938798 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25300b7dc0 con 0x7f253006f300 2024-09-11T22:14:47.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.066+0000 7f253480e640 1 -- 172.21.15.50:0/3401938798 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25300b54f0 con 0x7f253006f300 2024-09-11T22:14:47.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.068+0000 7f251effd640 1 -- 172.21.15.50:0/3401938798 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2520007400 con 0x7f253006f300 2024-09-11T22:14:47.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.068+0000 7f251effd640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f251006be30 0x7f251006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.068+0000 7f251effd640 1 -- 172.21.15.50:0/3401938798 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f252008a360 con 0x7f253006f300 2024-09-11T22:14:47.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.068+0000 7f252dd9b640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f251006be30 0x7f251006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.069+0000 7f252dd9b640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f251006be30 0x7f251006e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f25300afd40 tx=0x7f2524009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.069+0000 7f2537683740 1 Processor -- start 2024-09-11T22:14:47.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.069+0000 7f2537683740 1 -- start start 2024-09-11T22:14:47.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f2537683740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5a500 0x5590f7d5a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f2537683740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d57cc0 0x5590f7d59850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f2537683740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 0x5590f7d3a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f2537683740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5590f7c76ac0 con 0x5590f7d5a500 2024-09-11T22:14:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f2537683740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5590f7c1e7b0 con 0x5590f7d57cc0 2024-09-11T22:14:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f2537683740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5590f7c72a80 con 0x5590f7d58120 2024-09-11T22:14:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f252e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5a500 0x5590f7d5a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f252e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5a500 0x5590f7d5a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36860/0 (socket says 172.21.15.50:36860) 2024-09-11T22:14:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f252e59c640 1 -- 172.21.15.50:0/3044954993 learned_addr learned my addr 172.21.15.50:0/3044954993 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f252dd9b640 1 --2- 172.21.15.50:0/3044954993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d57cc0 0x5590f7d59850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f252ed9d640 1 --2- 172.21.15.50:0/3044954993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 0x5590f7d3a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f252e59c640 1 -- 172.21.15.50:0/3044954993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 msgr2=0x5590f7d3a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f252e59c640 1 --2- 172.21.15.50:0/3044954993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 0x5590f7d3a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f252e59c640 1 -- 172.21.15.50:0/3044954993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d57cc0 msgr2=0x5590f7d59850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f252e59c640 1 --2- 172.21.15.50:0/3044954993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d57cc0 0x5590f7d59850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.070+0000 7f252e59c640 1 -- 172.21.15.50:0/3044954993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590f7a55a20 con 0x5590f7d5a500 2024-09-11T22:14:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.071+0000 7f252e59c640 1 --2- 172.21.15.50:0/3044954993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5a500 0x5590f7d5a8e0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2520054a50 tx=0x7f252000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244d04066752e444 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.071+0000 7f250ffff640 1 -- 172.21.15.50:0/3044954993 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25200568f0 con 0x5590f7d5a500 2024-09-11T22:14:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.071+0000 7f250ffff640 1 -- 172.21.15.50:0/3044954993 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252008a0c0 con 0x5590f7d5a500 2024-09-11T22:14:47.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.071+0000 7f250ffff640 1 -- 172.21.15.50:0/3044954993 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252005db30 con 0x5590f7d5a500 2024-09-11T22:14:47.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.071+0000 7f2537683740 1 -- 172.21.15.50:0/3044954993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5a500 msgr2=0x5590f7d5a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.071+0000 7f2537683740 1 --2- 172.21.15.50:0/3044954993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5a500 0x5590f7d5a8e0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2520054a50 tx=0x7f252000a000 comp rx=0 tx=0).stop 2024-09-11T22:14:47.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.071+0000 7f2537683740 1 -- 172.21.15.50:0/3044954993 shutdown_connections 2024-09-11T22:14:47.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.071+0000 7f2537683740 1 --2- 172.21.15.50:0/3044954993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 0x5590f7d3a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.071+0000 7f2537683740 1 --2- 172.21.15.50:0/3044954993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d57cc0 0x5590f7d59850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.071+0000 7f2537683740 1 --2- 172.21.15.50:0/3044954993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5a500 0x5590f7d5a8e0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.071+0000 7f2537683740 1 -- 172.21.15.50:0/3044954993 >> 172.21.15.50:0/3044954993 conn(0x5590f7d10160 msgr2=0x5590f7d58570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.071+0000 7f2537683740 1 -- 172.21.15.50:0/3044954993 shutdown_connections 2024-09-11T22:14:47.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.071+0000 7f2537683740 1 -- 172.21.15.50:0/3044954993 wait complete. 2024-09-11T22:14:47.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.072+0000 7f2537683740 1 -- start start 2024-09-11T22:14:47.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.072+0000 7f2537683740 1 Processor -- start 2024-09-11T22:14:47.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f2537683740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 0x5590f7d141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f2537683740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d5a500 0x5590f7d3d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f2537683740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d5f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f2537683740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5590f7d56c20 con 0x5590f7d5eff0 2024-09-11T22:14:47.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f2537683740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5590f7bff7b0 con 0x5590f7d5a500 2024-09-11T22:14:47.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f2537683740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5590f7d56f00 con 0x5590f7d58120 2024-09-11T22:14:47.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f2537683740 10 client.0 _ll_register_callbacks cb 0x5590f7988e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:47.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f252ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d5f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f252ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d5f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36866/0 (socket says 172.21.15.50:36866) 2024-09-11T22:14:47.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f252ed9d640 1 -- 172.21.15.50:0/3291488682 learned_addr learned my addr 172.21.15.50:0/3291488682 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:47.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f252dd9b640 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d5a500 0x5590f7d3d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f252e59c640 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 0x5590f7d141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f252ed9d640 1 -- 172.21.15.50:0/3291488682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 msgr2=0x5590f7d141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f252ed9d640 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 0x5590f7d141e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f252ed9d640 1 -- 172.21.15.50:0/3291488682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d5a500 msgr2=0x5590f7d3d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f252ed9d640 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d5a500 0x5590f7d3d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f252ed9d640 1 -- 172.21.15.50:0/3291488682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590f7949310 con 0x5590f7d5eff0 2024-09-11T22:14:47.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f252dd9b640 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d5a500 0x5590f7d3d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:47.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.073+0000 7f252e59c640 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 0x5590f7d141e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:47.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f252ed9d640 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d5f470 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2528009e80 tx=0x7f2528004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d8b5574d73fc01 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f250d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:47.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f250d7fa640 1 -- 172.21.15.50:0/3291488682 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2528007e90 con 0x5590f7d5eff0 2024-09-11T22:14:47.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f250d7fa640 1 -- 172.21.15.50:0/3291488682 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f252803c420 con 0x5590f7d5eff0 2024-09-11T22:14:47.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f2537683740 1 -- 172.21.15.50:0/3291488682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f252008a0c0 con 0x5590f7d5eff0 2024-09-11T22:14:47.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f250d7fa640 1 -- 172.21.15.50:0/3291488682 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f252804f050 con 0x5590f7d5eff0 2024-09-11T22:14:47.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f2537683740 10 client.6483 fetch_fsmap learned FSMap version 40 2024-09-11T22:14:47.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f2537683740 1 -- 172.21.15.50:0/3291488682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x5590f7ab61b0 con 0x5590f7d5eff0 2024-09-11T22:14:47.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f250d7fa640 1 -- 172.21.15.50:0/3291488682 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252008a0c0 con 0x5590f7d5eff0 2024-09-11T22:14:47.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f250d7fa640 1 -- 172.21.15.50:0/3291488682 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7f2528052020 con 0x5590f7d5eff0 2024-09-11T22:14:47.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f2537683740 10 client.6483 fetch_fsmap finished waiting for FSMap version 40 2024-09-11T22:14:47.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f2537683740 10 client.6483 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-11T22:14:47.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f2537683740 20 client.6483 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:47.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f2537683740 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x5590f7d69950 0x5590f7d69100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f2537683740 4 client.6483 mds_command: new command op to 6393 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:14:47.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f2537683740 1 -- 172.21.15.50:0/3291488682 --> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590f7c841f0 con 0x5590f7d69950 2024-09-11T22:14:47.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.074+0000 7f252e59c640 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x5590f7d69950 0x5590f7d69100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.075+0000 7f250d7fa640 10 client.6483 ms_handle_connect on v2:172.21.15.50:6832/3974105971 2024-09-11T22:14:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.075+0000 7f252e59c640 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x5590f7d69950 0x5590f7d69100 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e06bf80e1f289662 server_cookie=9bd45671b39fbe57 in_seq=0 out_seq=0 2024-09-11T22:14:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.075+0000 7f250d7fa640 1 -- 172.21.15.50:0/3291488682 <== mds.0 v2:172.21.15.50:6832/3974105971 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590f7c841f0 con 0x5590f7d69950 2024-09-11T22:14:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.075+0000 7f250d7fa640 10 client.6483 handle_command_reply: tid=0 2024-09-11T22:14:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.075+0000 7f2537683740 1 client.6483 shutdown 2024-09-11T22:14:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.075+0000 7f2537683740 1 -- 172.21.15.50:0/3291488682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 msgr2=0x5590f7d5f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.076+0000 7f2537683740 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d5f470 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2528009e80 tx=0x7f2528004ab0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.076+0000 7f2537683740 1 -- 172.21.15.50:0/3291488682 shutdown_connections 2024-09-11T22:14:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.076+0000 7f2537683740 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x5590f7d69950 0x5590f7d69100 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.076+0000 7f2537683740 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d5f470 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.076+0000 7f2537683740 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d5a500 0x5590f7d3d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.076+0000 7f2537683740 1 --2- 172.21.15.50:0/3291488682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 0x5590f7d141e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.076+0000 7f250d7fa640 0 client.6483 ms_handle_reset on v2:172.21.15.50:6832/3974105971 2024-09-11T22:14:47.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.076+0000 7f2537683740 1 -- 172.21.15.50:0/3291488682 >> 172.21.15.50:0/3291488682 conn(0x5590f7d57cc0 msgr2=0x5590f7d58a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.076+0000 7f2537683740 1 -- 172.21.15.50:0/3291488682 shutdown_connections 2024-09-11T22:14:47.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.076+0000 7f2537683740 1 -- 172.21.15.50:0/3291488682 wait complete. 2024-09-11T22:14:47.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.076+0000 7f2537683740 20 client.6483 trim_cache size 0 max 16384 2024-09-11T22:14:47.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.093+0000 7f2537683740 1 Processor -- start 2024-09-11T22:14:47.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.093+0000 7f2537683740 1 -- start start 2024-09-11T22:14:47.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f2537683740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 0x5590f7d3d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f2537683740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d5a500 0x5590f7d3d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f2537683740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d7c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f2537683740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2530200ee0 con 0x5590f7d5eff0 2024-09-11T22:14:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f2537683740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f25301fff80 con 0x5590f7d5a500 2024-09-11T22:14:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f2537683740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f25301f86a0 con 0x5590f7d58120 2024-09-11T22:14:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f252ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d7c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f252ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d7c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36880/0 (socket says 172.21.15.50:36880) 2024-09-11T22:14:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f252ed9d640 1 -- 172.21.15.50:0/1711757709 learned_addr learned my addr 172.21.15.50:0/1711757709 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f252ed9d640 1 -- 172.21.15.50:0/1711757709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 msgr2=0x5590f7d3d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f252ed9d640 1 --2- 172.21.15.50:0/1711757709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 0x5590f7d3d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f252ed9d640 1 -- 172.21.15.50:0/1711757709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d5a500 msgr2=0x5590f7d3d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f252ed9d640 1 --2- 172.21.15.50:0/1711757709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d5a500 0x5590f7d3d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.094+0000 7f252ed9d640 1 -- 172.21.15.50:0/1711757709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590f79223d0 con 0x5590f7d5eff0 2024-09-11T22:14:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.095+0000 7f252ed9d640 1 --2- 172.21.15.50:0/1711757709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d7c100 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2528009b90 tx=0x7f2528041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce13dd71bc39342 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.095+0000 7f250f7fe640 1 -- 172.21.15.50:0/1711757709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252803c420 con 0x5590f7d5eff0 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.095+0000 7f250f7fe640 1 -- 172.21.15.50:0/1711757709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252803ca50 con 0x5590f7d5eff0 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.095+0000 7f250f7fe640 1 -- 172.21.15.50:0/1711757709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252803ce00 con 0x5590f7d5eff0 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.095+0000 7f2537683740 1 -- 172.21.15.50:0/1711757709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 msgr2=0x5590f7d7c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.095+0000 7f2537683740 1 --2- 172.21.15.50:0/1711757709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d7c100 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2528009b90 tx=0x7f2528041000 comp rx=0 tx=0).stop 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.095+0000 7f2537683740 1 -- 172.21.15.50:0/1711757709 shutdown_connections 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.095+0000 7f2537683740 1 --2- 172.21.15.50:0/1711757709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d7c100 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.095+0000 7f2537683740 1 --2- 172.21.15.50:0/1711757709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d5a500 0x5590f7d3d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.095+0000 7f2537683740 1 --2- 172.21.15.50:0/1711757709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d58120 0x5590f7d3d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.095+0000 7f2537683740 1 -- 172.21.15.50:0/1711757709 >> 172.21.15.50:0/1711757709 conn(0x5590f7d57cc0 msgr2=0x5590f7d4ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.095+0000 7f2537683740 1 -- 172.21.15.50:0/1711757709 shutdown_connections 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.095+0000 7f2537683740 1 -- 172.21.15.50:0/1711757709 wait complete. 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.096+0000 7f2537683740 1 -- start start 2024-09-11T22:14:47.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.096+0000 7f2537683740 1 Processor -- start 2024-09-11T22:14:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f2537683740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d58120 0x5590f7dd02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f2537683740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d5a500 0x5590f7d3b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f2537683740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d3d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f2537683740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f25300c6aa0 con 0x5590f7d5eff0 2024-09-11T22:14:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f2537683740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5590f7d3bd00 con 0x5590f7d58120 2024-09-11T22:14:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f2537683740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5590f7d58d80 con 0x5590f7d5a500 2024-09-11T22:14:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f2537683740 10 client.0 _ll_register_callbacks cb 0x7f2528009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:14:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f252ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d3d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f252ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d3d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36886/0 (socket says 172.21.15.50:36886) 2024-09-11T22:14:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f252ed9d640 1 -- 172.21.15.50:0/4213279092 learned_addr learned my addr 172.21.15.50:0/4213279092 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f252dd9b640 1 --2- 172.21.15.50:0/4213279092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d5a500 0x5590f7d3b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f252e59c640 1 --2- 172.21.15.50:0/4213279092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d58120 0x5590f7dd02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f252ed9d640 1 -- 172.21.15.50:0/4213279092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d5a500 msgr2=0x5590f7d3b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f252ed9d640 1 --2- 172.21.15.50:0/4213279092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d5a500 0x5590f7d3b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f252ed9d640 1 -- 172.21.15.50:0/4213279092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d58120 msgr2=0x5590f7dd02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f252ed9d640 1 --2- 172.21.15.50:0/4213279092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d58120 0x5590f7dd02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.097+0000 7f252ed9d640 1 -- 172.21.15.50:0/4213279092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590f7dd0810 con 0x5590f7d5eff0 2024-09-11T22:14:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f252ed9d640 1 --2- 172.21.15.50:0/4213279092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d3d7d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f252802ae50 tx=0x7f2528009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28207d52b9861dce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f250d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:14:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f250d7fa640 1 -- 172.21.15.50:0/4213279092 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2528003990 con 0x5590f7d5eff0 2024-09-11T22:14:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f2537683740 1 -- 172.21.15.50:0/4213279092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f252803ca50 con 0x5590f7d5eff0 2024-09-11T22:14:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f250d7fa640 1 -- 172.21.15.50:0/4213279092 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f2528003b30 con 0x5590f7d5eff0 2024-09-11T22:14:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f250d7fa640 1 -- 172.21.15.50:0/4213279092 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2528066050 con 0x5590f7d5eff0 2024-09-11T22:14:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f2537683740 10 client.6489 fetch_fsmap learned FSMap version 40 2024-09-11T22:14:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f2537683740 1 -- 172.21.15.50:0/4213279092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x5590f7d6b410 con 0x5590f7d5eff0 2024-09-11T22:14:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f250d7fa640 1 -- 172.21.15.50:0/4213279092 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252803ca50 con 0x5590f7d5eff0 2024-09-11T22:14:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f250d7fa640 1 -- 172.21.15.50:0/4213279092 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7f2528069020 con 0x5590f7d5eff0 2024-09-11T22:14:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f2537683740 10 client.6489 fetch_fsmap finished waiting for FSMap version 40 2024-09-11T22:14:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f2537683740 10 client.6489 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-11T22:14:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f2537683740 20 client.6489 populate_metadata read hostname 'smithi050' 2024-09-11T22:14:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f2537683740 1 --2- 172.21.15.50:0/4213279092 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x5590f7d11910 0x5590f7d5db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f2537683740 4 client.6489 mds_command: new command op to 6393 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-11T22:14:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f2537683740 1 -- 172.21.15.50:0/4213279092 --> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x5590f7c7e540 con 0x5590f7d11910 2024-09-11T22:14:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.098+0000 7f252e59c640 1 --2- 172.21.15.50:0/4213279092 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x5590f7d11910 0x5590f7d5db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.099+0000 7f250d7fa640 10 client.6489 ms_handle_connect on v2:172.21.15.50:6832/3974105971 2024-09-11T22:14:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.099+0000 7f252e59c640 1 --2- 172.21.15.50:0/4213279092 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x5590f7d11910 0x5590f7d5db50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29330d25887caae6 server_cookie=14d19872c5994140 in_seq=0 out_seq=0 2024-09-11T22:14:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.099+0000 7f250d7fa640 1 -- 172.21.15.50:0/4213279092 <== mds.0 v2:172.21.15.50:6832/3974105971 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5590f7c7e540 con 0x5590f7d11910 2024-09-11T22:14:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.099+0000 7f250d7fa640 10 client.6489 handle_command_reply: tid=0 2024-09-11T22:14:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.099+0000 7f2537683740 1 client.6489 shutdown 2024-09-11T22:14:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.099+0000 7f2537683740 1 -- 172.21.15.50:0/4213279092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 msgr2=0x5590f7d3d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.099+0000 7f2537683740 1 --2- 172.21.15.50:0/4213279092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d3d7d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f252802ae50 tx=0x7f2528009750 comp rx=0 tx=0).stop 2024-09-11T22:14:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f2537683740 1 -- 172.21.15.50:0/4213279092 shutdown_connections 2024-09-11T22:14:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f2537683740 1 --2- 172.21.15.50:0/4213279092 >> [v2:172.21.15.50:6832/3974105971,v1:172.21.15.50:6833/3974105971] conn(0x5590f7d11910 0x5590f7d5db50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f2537683740 1 --2- 172.21.15.50:0/4213279092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590f7d5a500 0x5590f7d3b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f2537683740 1 --2- 172.21.15.50:0/4213279092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590f7d5eff0 0x5590f7d3d7d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f250d7fa640 0 client.6489 ms_handle_reset on v2:172.21.15.50:6832/3974105971 2024-09-11T22:14:47.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f2537683740 1 --2- 172.21.15.50:0/4213279092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590f7d58120 0x5590f7dd02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f2537683740 1 -- 172.21.15.50:0/4213279092 >> 172.21.15.50:0/4213279092 conn(0x5590f7d57cc0 msgr2=0x5590f7d4ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f2537683740 1 -- 172.21.15.50:0/4213279092 shutdown_connections 2024-09-11T22:14:47.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f2537683740 1 -- 172.21.15.50:0/4213279092 wait complete. 2024-09-11T22:14:47.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f2537683740 20 client.6489 trim_cache size 0 max 16384 2024-09-11T22:14:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:14:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:14:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "85218d38-b489-44c8-b50c-38fc8d04bb1c", 2024-09-11T22:14:47.107 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:14:47.107 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:14:47.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f253480e640 1 -- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f251006be30 msgr2=0x7f251006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f253480e640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f251006be30 0x7f251006e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f25300afd40 tx=0x7f2524009040 comp rx=0 tx=0).stop 2024-09-11T22:14:47.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f253480e640 1 -- 172.21.15.50:0/3401938798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f253006f300 msgr2=0x7f25300b75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f253480e640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f253006f300 0x7f25300b75e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f252000c3c0 tx=0x7f252000c880 comp rx=0 tx=0).stop 2024-09-11T22:14:47.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f253480e640 1 -- 172.21.15.50:0/3401938798 shutdown_connections 2024-09-11T22:14:47.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f253480e640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f251006be30 0x7f251006e2f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f253480e640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2530161ea0 0x7f25300affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f253480e640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253006ffb0 0x7f25300b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f253480e640 1 --2- 172.21.15.50:0/3401938798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f253006f300 0x7f25300b75e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f253480e640 1 -- 172.21.15.50:0/3401938798 >> 172.21.15.50:0/3401938798 conn(0x7f25300b4150 msgr2=0x7f25300b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f253480e640 1 -- 172.21.15.50:0/3401938798 shutdown_connections 2024-09-11T22:14:47.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.100+0000 7f253480e640 1 -- 172.21.15.50:0/3401938798 wait complete. 2024-09-11T22:14:47.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:47.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.215+0000 7f7e4f952640 1 Processor -- start 2024-09-11T22:14:47.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.216+0000 7f7e4f952640 1 -- start start 2024-09-11T22:14:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.216+0000 7f7e4f952640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e4815e9b0 0x7f7e4815f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.216+0000 7f7e4f952640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e480b6d90 0x7f7e480b7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.216+0000 7f7e4f952640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e480b5fd0 con 0x7f7e4806bb50 2024-09-11T22:14:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.216+0000 7f7e4f952640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7e480b6900 con 0x7f7e4815e9b0 2024-09-11T22:14:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.216+0000 7f7e4f952640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7e480b62b0 con 0x7f7e480b6d90 2024-09-11T22:14:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.216+0000 7f7e4d6ee640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e4815e9b0 0x7f7e4815f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.217+0000 7f7e4d6ee640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e4815e9b0 0x7f7e4815f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36888/0 (socket says 172.21.15.50:36888) 2024-09-11T22:14:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.217+0000 7f7e4d6ee640 1 -- 172.21.15.50:0/3180020121 learned_addr learned my addr 172.21.15.50:0/3180020121 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.217+0000 7f7e4d6ee640 1 -- 172.21.15.50:0/3180020121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e480b6d90 msgr2=0x7f7e480b7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.217+0000 7f7e4deef640 1 --2- 172.21.15.50:0/3180020121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e480b6d90 0x7f7e480b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.217+0000 7f7e4d6ee640 1 --2- 172.21.15.50:0/3180020121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e480b6d90 0x7f7e480b7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.217+0000 7f7e4d6ee640 1 -- 172.21.15.50:0/3180020121 >> v1:172.21.15.77:6789/0 conn(0x7f7e4806bb50 legacy=0x7f7e480af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:47.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.217+0000 7f7e4d6ee640 1 -- 172.21.15.50:0/3180020121 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e480b6590 con 0x7f7e4815e9b0 2024-09-11T22:14:47.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.217+0000 7f7e4deef640 1 --2- 172.21.15.50:0/3180020121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e480b6d90 0x7f7e480b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.218+0000 7f7e4d6ee640 1 --2- 172.21.15.50:0/3180020121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4815e9b0 0x7f7e4815f820 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009870 tx=0x7f7e4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268f687287e77373 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.218+0000 7f7e47fff640 1 -- 172.21.15.50:0/3180020121 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40037070 con 0x7f7e4815e9b0 2024-09-11T22:14:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.218+0000 7f7e47fff640 1 -- 172.21.15.50:0/3180020121 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e40032440 con 0x7f7e4815e9b0 2024-09-11T22:14:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.218+0000 7f7e47fff640 1 -- 172.21.15.50:0/3180020121 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40032810 con 0x7f7e4815e9b0 2024-09-11T22:14:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.218+0000 7f7e4f952640 1 -- 172.21.15.50:0/3180020121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4815e9b0 msgr2=0x7f7e4815f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.218+0000 7f7e4f952640 1 --2- 172.21.15.50:0/3180020121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4815e9b0 0x7f7e4815f820 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009870 tx=0x7f7e4002a270 comp rx=0 tx=0).stop 2024-09-11T22:14:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.218+0000 7f7e4f952640 1 -- 172.21.15.50:0/3180020121 shutdown_connections 2024-09-11T22:14:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.218+0000 7f7e4f952640 1 --2- 172.21.15.50:0/3180020121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e480b6d90 0x7f7e480b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.218+0000 7f7e4f952640 1 --2- 172.21.15.50:0/3180020121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4815e9b0 0x7f7e4815f820 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.218+0000 7f7e4f952640 1 -- 172.21.15.50:0/3180020121 >> 172.21.15.50:0/3180020121 conn(0x7f7e480b7940 msgr2=0x7f7e480b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.218+0000 7f7e4f952640 1 -- 172.21.15.50:0/3180020121 shutdown_connections 2024-09-11T22:14:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.218+0000 7f7e4f952640 1 -- 172.21.15.50:0/3180020121 wait complete. 2024-09-11T22:14:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.220+0000 7f7e4f952640 1 Processor -- start 2024-09-11T22:14:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.220+0000 7f7e4f952640 1 -- start start 2024-09-11T22:14:47.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.220+0000 7f7e4f952640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4806bb50 0x7f7e48155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.220+0000 7f7e4f952640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e480b6d90 0x7f7e480b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.220+0000 7f7e4f952640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e48153d90 0x7f7e48154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.220+0000 7f7e4f952640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4806d310 con 0x7f7e4806bb50 2024-09-11T22:14:47.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.220+0000 7f7e4f952640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4815feb0 con 0x7f7e480b6d90 2024-09-11T22:14:47.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.220+0000 7f7e4f952640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4806d490 con 0x7f7e48153d90 2024-09-11T22:14:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.220+0000 7f7e4d6ee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4806bb50 0x7f7e48155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.220+0000 7f7e4d6ee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4806bb50 0x7f7e48155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36894/0 (socket says 172.21.15.50:36894) 2024-09-11T22:14:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.220+0000 7f7e4d6ee640 1 -- 172.21.15.50:0/1206975570 learned_addr learned my addr 172.21.15.50:0/1206975570 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.221+0000 7f7e4deef640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e48153d90 0x7f7e48154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.221+0000 7f7e4ceed640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e480b6d90 0x7f7e480b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.221+0000 7f7e4d6ee640 1 -- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e48153d90 msgr2=0x7f7e48154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.221+0000 7f7e4d6ee640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e48153d90 0x7f7e48154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.221+0000 7f7e4d6ee640 1 -- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e480b6d90 msgr2=0x7f7e480b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.221+0000 7f7e4d6ee640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e480b6d90 0x7f7e480b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.221+0000 7f7e4d6ee640 1 -- 172.21.15.50:0/1206975570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4815d820 con 0x7f7e4806bb50 2024-09-11T22:14:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.221+0000 7f7e4d6ee640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4806bb50 0x7f7e48155e20 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7e40000c00 tx=0x7f7e400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.221+0000 7f7e45ffb640 1 -- 172.21.15.50:0/1206975570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40037040 con 0x7f7e4806bb50 2024-09-11T22:14:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.221+0000 7f7e45ffb640 1 -- 172.21.15.50:0/1206975570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e40042070 con 0x7f7e4806bb50 2024-09-11T22:14:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.221+0000 7f7e4f952640 1 -- 172.21.15.50:0/1206975570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e4815db00 con 0x7f7e4806bb50 2024-09-11T22:14:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.221+0000 7f7e45ffb640 1 -- 172.21.15.50:0/1206975570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40030bd0 con 0x7f7e4806bb50 2024-09-11T22:14:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.221+0000 7f7e4f952640 1 -- 172.21.15.50:0/1206975570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e4815e0c0 con 0x7f7e4806bb50 2024-09-11T22:14:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.222+0000 7f7e4f952640 1 -- 172.21.15.50:0/1206975570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4815f820 con 0x7f7e4806bb50 2024-09-11T22:14:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.223+0000 7f7e45ffb640 1 -- 172.21.15.50:0/1206975570 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e40047460 con 0x7f7e4806bb50 2024-09-11T22:14:47.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.223+0000 7f7e45ffb640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e3406be30 0x7f7e3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:47.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.224+0000 7f7e45ffb640 1 -- 172.21.15.50:0/1206975570 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f7e400ab990 con 0x7f7e4806bb50 2024-09-11T22:14:47.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.224+0000 7f7e4ceed640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e3406be30 0x7f7e3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:47.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.224+0000 7f7e4ceed640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e3406be30 0x7f7e3406e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7e4815d5e0 tx=0x7f7e3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:47.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.228+0000 7f7e45ffb640 1 -- 172.21.15.50:0/1206975570 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e40079cb0 con 0x7f7e4806bb50 2024-09-11T22:14:47.416 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-09-11T22:14:47.415+0000 7f5013b42640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:14:47.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.439+0000 7f7e4f952640 1 -- 172.21.15.50:0/1206975570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e480b1310 con 0x7f7e4806bb50 2024-09-11T22:14:47.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.439+0000 7f7e45ffb640 1 -- 172.21.15.50:0/1206975570 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5224 (secure 0 0 0) 0x7f7e4007dfb0 con 0x7f7e4806bb50 2024-09-11T22:14:47.440 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:47.440 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"btime":"2024-09-11T22:14:44:423012+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2332065748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2332065748},{"type":"v1","addr":"172.21.15.77:6837","nonce":2332065748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2776548564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2776548564},{"type":"v1","addr":"172.21.15.77:6835","nonce":2776548564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2898617410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2898617410},{"type":"v1","addr":"172.21.15.50:6835","nonce":2898617410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:14:26.306529+0000","modified":"2024-09-11T22:14:44.423002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6393":{"gid":6393,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6833/3974105971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3974105971},{"type":"v1","addr":"172.21.15.50:6833","nonce":3974105971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6393,"qdb_cluster":[6393]},"id":4}]} 2024-09-11T22:14:47.441 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 40 2024-09-11T22:14:47.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.442+0000 7f7e4f952640 1 -- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e3406be30 msgr2=0x7f7e3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.442+0000 7f7e4f952640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e3406be30 0x7f7e3406e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7e4815d5e0 tx=0x7f7e3c009040 comp rx=0 tx=0).stop 2024-09-11T22:14:47.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.442+0000 7f7e4f952640 1 -- 172.21.15.50:0/1206975570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4806bb50 msgr2=0x7f7e48155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:47.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.442+0000 7f7e4f952640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4806bb50 0x7f7e48155e20 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7e40000c00 tx=0x7f7e400046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.442+0000 7f7e4f952640 1 -- 172.21.15.50:0/1206975570 shutdown_connections 2024-09-11T22:14:47.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.442+0000 7f7e4f952640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e3406be30 0x7f7e3406e2f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.442+0000 7f7e4f952640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e48153d90 0x7f7e48154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.442+0000 7f7e4f952640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e480b6d90 0x7f7e480b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.442+0000 7f7e4f952640 1 --2- 172.21.15.50:0/1206975570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e4806bb50 0x7f7e48155e20 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:47.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.442+0000 7f7e4f952640 1 -- 172.21.15.50:0/1206975570 >> 172.21.15.50:0/1206975570 conn(0x7f7e480b7940 msgr2=0x7f7e4806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:47.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.442+0000 7f7e4f952640 1 -- 172.21.15.50:0/1206975570 shutdown_connections 2024-09-11T22:14:47.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:47.442+0000 7f7e4f952640 1 -- 172.21.15.50:0/1206975570 wait complete. 2024-09-11T22:14:47.453 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-11T22:14:47.571 INFO:teuthology.orchestra.run.smithi050.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-11T22:14:38.844502+0000","btime":"2024-09-11T22:14:38.039523+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-11T22:14:38.844502+0000","atime":"2024-09-11T22:14:38.039523+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-11T22:14:38.844502+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-11T22:14:38.845502+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-11T22:14:38.845502+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":2,"authpin":0,"scrubqueue":0},"nref":2,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-11T22:14:47.571 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-11T22:14:38.845502+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-11T22:14:38.039523+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-11T22:14:38.039523+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-11T22:14:38.844502+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-11T22:14:38.844502+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-11T22:14:38.844502+0000", "nestlock": {}, "nlink": 1, "nref": 2, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-11T22:14:38.845502+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-11T22:14:47.571 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-11T22:14:52.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.688+0000 7f900eaa5640 1 Processor -- start 2024-09-11T22:14:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.688+0000 7f900eaa5640 1 -- start start 2024-09-11T22:14:52.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f900eaa5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f900815c2c0 0x7f90080b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f900eaa5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90080b4f00 con 0x7f90080d05e0 2024-09-11T22:14:52.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f900eaa5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90080b4360 con 0x7f90080b3e10 2024-09-11T22:14:52.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f900eaa5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f90080b51c0 con 0x7f900815c2c0 2024-09-11T22:14:52.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f900d042640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f90080d05e0 0x7f90080ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48412/0 (socket says 172.21.15.50:48412) 2024-09-11T22:14:52.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f900d042640 1 -- 172.21.15.50:0/918541723 learned_addr learned my addr 172.21.15.50:0/918541723 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:52.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f900c841640 1 --2- 172.21.15.50:0/918541723 >> v2:172.21.15.77:3300/0 conn(0x7f900815c2c0 0x7f90080b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f90077fe640 1 -- 172.21.15.50:0/918541723 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146072075 0 0) 0x7f90080b4f00 con 0x7f90080d05e0 2024-09-11T22:14:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f90077fe640 1 -- 172.21.15.50:0/918541723 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ff4003520 con 0x7f90080d05e0 2024-09-11T22:14:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f90077fe640 1 -- 172.21.15.50:0/918541723 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737019027 0 0) 0x7f90080b4360 con 0x7f90080b3e10 2024-09-11T22:14:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f90077fe640 1 -- 172.21.15.50:0/918541723 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90080b4f00 con 0x7f90080b3e10 2024-09-11T22:14:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f900c841640 1 -- 172.21.15.50:0/918541723 >> v1:172.21.15.77:6789/0 conn(0x7f90080b3e10 legacy=0x7f90080cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f90077fe640 1 -- 172.21.15.50:0/918541723 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2068788894 0 0) 0x7f8ff4003520 con 0x7f90080d05e0 2024-09-11T22:14:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f900c841640 1 -- 172.21.15.50:0/918541723 >> v1:172.21.15.50:6789/0 conn(0x7f90080d05e0 legacy=0x7f90080ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.689+0000 7f900c841640 1 -- 172.21.15.50:0/918541723 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90080b54a0 con 0x7f900815c2c0 2024-09-11T22:14:52.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.690+0000 7f900c841640 1 --2- 172.21.15.50:0/918541723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f900815c2c0 0x7f90080b46a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00097a0 tx=0x7f8ff002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ba557f1f9cd9625 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:52.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.690+0000 7f90077fe640 1 -- 172.21.15.50:0/918541723 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0037070 con 0x7f900815c2c0 2024-09-11T22:14:52.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.690+0000 7f90077fe640 1 -- 172.21.15.50:0/918541723 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff002ac50 con 0x7f900815c2c0 2024-09-11T22:14:52.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.690+0000 7f90077fe640 1 -- 172.21.15.50:0/918541723 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000001670 con 0x7f900815c2c0 2024-09-11T22:14:52.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.691+0000 7f900eaa5640 1 -- 172.21.15.50:0/918541723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f900815c2c0 msgr2=0x7f90080b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.691+0000 7f900eaa5640 1 --2- 172.21.15.50:0/918541723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f900815c2c0 0x7f90080b46a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00097a0 tx=0x7f8ff002a1c0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.691+0000 7f900eaa5640 1 -- 172.21.15.50:0/918541723 shutdown_connections 2024-09-11T22:14:52.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.691+0000 7f900eaa5640 1 --2- 172.21.15.50:0/918541723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f900815c2c0 0x7f90080b46a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.691+0000 7f900eaa5640 1 -- 172.21.15.50:0/918541723 >> 172.21.15.50:0/918541723 conn(0x7f90080679c0 msgr2=0x7f9008067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:52.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.691+0000 7f900eaa5640 1 -- 172.21.15.50:0/918541723 shutdown_connections 2024-09-11T22:14:52.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.691+0000 7f900eaa5640 1 -- 172.21.15.50:0/918541723 wait complete. 2024-09-11T22:14:52.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.692+0000 7f900eaa5640 1 Processor -- start 2024-09-11T22:14:52.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.692+0000 7f900eaa5640 1 -- start start 2024-09-11T22:14:52.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.693+0000 7f900eaa5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90080b3e10 0x7f9008072c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.693+0000 7f900eaa5640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90080d05e0 0x7f9008145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.693+0000 7f900eaa5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900815c2c0 0x7f90080ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.693+0000 7f900eaa5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f900806d070 con 0x7f900815c2c0 2024-09-11T22:14:52.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.693+0000 7f900eaa5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f90080ce200 con 0x7f90080b3e10 2024-09-11T22:14:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.693+0000 7f900eaa5640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f900806d1f0 con 0x7f90080d05e0 2024-09-11T22:14:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.693+0000 7f900d042640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900815c2c0 0x7f90080ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f900d042640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900815c2c0 0x7f90080ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59840/0 (socket says 172.21.15.50:59840) 2024-09-11T22:14:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f900d042640 1 -- 172.21.15.50:0/2024526 learned_addr learned my addr 172.21.15.50:0/2024526 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f900c841640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90080b3e10 0x7f9008072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f9007fff640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90080d05e0 0x7f9008145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f900d042640 1 -- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90080d05e0 msgr2=0x7f9008145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f900d042640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90080d05e0 0x7f9008145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f900d042640 1 -- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90080b3e10 msgr2=0x7f9008072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f900d042640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90080b3e10 0x7f9008072c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f900d042640 1 -- 172.21.15.50:0/2024526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9008071ba0 con 0x7f900815c2c0 2024-09-11T22:14:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f900d042640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900815c2c0 0x7f90080ae8c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f900000c5a0 tx=0x7f900000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:52.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f90057fa640 1 -- 172.21.15.50:0/2024526 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000017070 con 0x7f900815c2c0 2024-09-11T22:14:52.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f90057fa640 1 -- 172.21.15.50:0/2024526 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9000005ce0 con 0x7f900815c2c0 2024-09-11T22:14:52.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f900eaa5640 1 -- 172.21.15.50:0/2024526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9008071e80 con 0x7f900815c2c0 2024-09-11T22:14:52.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f90057fa640 1 -- 172.21.15.50:0/2024526 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000007270 con 0x7f900815c2c0 2024-09-11T22:14:52.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.694+0000 7f900eaa5640 1 -- 172.21.15.50:0/2024526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9008072440 con 0x7f900815c2c0 2024-09-11T22:14:52.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.695+0000 7f900eaa5640 1 -- 172.21.15.50:0/2024526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f900815c6a0 con 0x7f900815c2c0 2024-09-11T22:14:52.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.696+0000 7f90057fa640 1 -- 172.21.15.50:0/2024526 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f900001a070 con 0x7f900815c2c0 2024-09-11T22:14:52.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.697+0000 7f90057fa640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8fe806be30 0x7f8fe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:52.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.697+0000 7f90057fa640 1 -- 172.21.15.50:0/2024526 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f900008a200 con 0x7f900815c2c0 2024-09-11T22:14:52.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.697+0000 7f900c841640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8fe806be30 0x7f8fe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:52.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.697+0000 7f900c841640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8fe806be30 0x7f8fe806e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0034000 tx=0x7f8ff002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:52.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.701+0000 7f90057fa640 1 -- 172.21.15.50:0/2024526 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90000584b0 con 0x7f900815c2c0 2024-09-11T22:14:52.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.910+0000 7f900eaa5640 1 -- 172.21.15.50:0/2024526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f900806a000 con 0x7f900815c2c0 2024-09-11T22:14:52.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.911+0000 7f90057fa640 1 -- 172.21.15.50:0/2024526 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5224 (secure 0 0 0) 0x7f900005c7b0 con 0x7f900815c2c0 2024-09-11T22:14:52.912 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:52.912 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"btime":"2024-09-11T22:14:44:423012+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2332065748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2332065748},{"type":"v1","addr":"172.21.15.77:6837","nonce":2332065748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2776548564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2776548564},{"type":"v1","addr":"172.21.15.77:6835","nonce":2776548564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2898617410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2898617410},{"type":"v1","addr":"172.21.15.50:6835","nonce":2898617410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:14:26.306529+0000","modified":"2024-09-11T22:14:44.423002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6393":{"gid":6393,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6833/3974105971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3974105971},{"type":"v1","addr":"172.21.15.50:6833","nonce":3974105971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6393,"qdb_cluster":[6393]},"id":4}]} 2024-09-11T22:14:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 40 2024-09-11T22:14:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.913+0000 7f900eaa5640 1 -- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8fe806be30 msgr2=0x7f8fe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.913+0000 7f900eaa5640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8fe806be30 0x7f8fe806e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0034000 tx=0x7f8ff002e000 comp rx=0 tx=0).stop 2024-09-11T22:14:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.913+0000 7f900eaa5640 1 -- 172.21.15.50:0/2024526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900815c2c0 msgr2=0x7f90080ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.913+0000 7f900eaa5640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900815c2c0 0x7f90080ae8c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f900000c5a0 tx=0x7f900000c9a0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.913+0000 7f900eaa5640 1 -- 172.21.15.50:0/2024526 shutdown_connections 2024-09-11T22:14:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.913+0000 7f900eaa5640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8fe806be30 0x7f8fe806e2f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.913+0000 7f900eaa5640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90080d05e0 0x7f9008145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.913+0000 7f900eaa5640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900815c2c0 0x7f90080ae8c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.913+0000 7f900eaa5640 1 --2- 172.21.15.50:0/2024526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90080b3e10 0x7f9008072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:52.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.913+0000 7f900eaa5640 1 -- 172.21.15.50:0/2024526 >> 172.21.15.50:0/2024526 conn(0x7f90080679c0 msgr2=0x7f90080b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:52.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.913+0000 7f900eaa5640 1 -- 172.21.15.50:0/2024526 shutdown_connections 2024-09-11T22:14:52.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:52.913+0000 7f900eaa5640 1 -- 172.21.15.50:0/2024526 wait complete. 2024-09-11T22:14:52.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-11T22:14:53.041 INFO:teuthology.orchestra.run.smithi050.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-11T22:14:38.844502+0000","btime":"2024-09-11T22:14:38.039523+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-11T22:14:38.844502+0000","atime":"2024-09-11T22:14:38.039523+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-11T22:14:38.844502+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-11T22:14:38.845502+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-11T22:14:38.845502+0000"},"version":247,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-11T22:14:47.102176+0000","last_scrub_version":244,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-11T22:14:53.042 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-11T22:14:38.845502+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-11T22:14:38.039523+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-11T22:14:38.039523+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-11T22:14:38.844502+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-11T22:14:38.844502+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-11T22:14:47.102176+0000", "last_scrub_version": 244, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-11T22:14:38.844502+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-11T22:14:38.845502+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 247, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-11T22:14:53.042 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-11T22:14:53.042 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:14:53.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:14:53.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:14:53.122 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:14:53.122 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:14:53.123 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:14:53.123 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:53.139 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:14:53.139 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:14:53.139 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:14:53.139 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:53.181 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:14:53.181 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:14:53.181 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:14:53.181 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:53.197 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:14:53.197 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:14:53.197 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:14:53.197 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:14:53.239 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:14:53.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:53.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.341+0000 7f9c7941e640 1 Processor -- start 2024-09-11T22:14:53.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.341+0000 7f9c7941e640 1 -- start start 2024-09-11T22:14:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.341+0000 7f9c7941e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c7415e8e0 0x7f9c740b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.341+0000 7f9c7941e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c74162350 0x7f9c74162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.341+0000 7f9c7941e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c74163080 con 0x7f9c740d1580 2024-09-11T22:14:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.341+0000 7f9c7941e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9c7415ecc0 con 0x7f9c74162350 2024-09-11T22:14:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.341+0000 7f9c7941e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9c740d2ad0 con 0x7f9c7415e8e0 2024-09-11T22:14:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.342+0000 7f9c737fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c74162350 0x7f9c74162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.342+0000 7f9c72ffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c7415e8e0 0x7f9c740b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.342+0000 7f9c727fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9c740d1580 0x7f9c740d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:51280/0 (socket says 172.21.15.50:51280) 2024-09-11T22:14:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.342+0000 7f9c737fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c74162350 0x7f9c74162800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:59376/0 (socket says 172.21.15.50:59376) 2024-09-11T22:14:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.342+0000 7f9c727fc640 1 -- 172.21.15.50:0/3394337219 learned_addr learned my addr 172.21.15.50:0/3394337219 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.342+0000 7f9c737fe640 1 -- 172.21.15.50:0/3394337219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c7415e8e0 msgr2=0x7f9c740b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.342+0000 7f9c737fe640 1 --2- 172.21.15.50:0/3394337219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c7415e8e0 0x7f9c740b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.342+0000 7f9c737fe640 1 -- 172.21.15.50:0/3394337219 >> v1:172.21.15.77:6789/0 conn(0x7f9c740d1580 legacy=0x7f9c740d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.342+0000 7f9c737fe640 1 -- 172.21.15.50:0/3394337219 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c740d2d20 con 0x7f9c74162350 2024-09-11T22:14:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.342+0000 7f9c72ffd640 1 --2- 172.21.15.50:0/3394337219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c7415e8e0 0x7f9c740b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:53.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.343+0000 7f9c737fe640 1 --2- 172.21.15.50:0/3394337219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c74162350 0x7f9c74162800 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9c64009d90 tx=0x7f9c6402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=215dafef161ccd9c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:53.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.343+0000 7f9c71ffb640 1 -- 172.21.15.50:0/3394337219 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c64007740 con 0x7f9c74162350 2024-09-11T22:14:53.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.343+0000 7f9c71ffb640 1 -- 172.21.15.50:0/3394337219 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c640078e0 con 0x7f9c74162350 2024-09-11T22:14:53.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.343+0000 7f9c71ffb640 1 -- 172.21.15.50:0/3394337219 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c64007cb0 con 0x7f9c74162350 2024-09-11T22:14:53.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.344+0000 7f9c7941e640 1 -- 172.21.15.50:0/3394337219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c74162350 msgr2=0x7f9c74162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:53.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.344+0000 7f9c7941e640 1 --2- 172.21.15.50:0/3394337219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c74162350 0x7f9c74162800 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9c64009d90 tx=0x7f9c6402a6f0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.344+0000 7f9c7941e640 1 -- 172.21.15.50:0/3394337219 shutdown_connections 2024-09-11T22:14:53.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.344+0000 7f9c7941e640 1 --2- 172.21.15.50:0/3394337219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c74162350 0x7f9c74162800 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.344+0000 7f9c7941e640 1 --2- 172.21.15.50:0/3394337219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c7415e8e0 0x7f9c740b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.344+0000 7f9c7941e640 1 -- 172.21.15.50:0/3394337219 >> 172.21.15.50:0/3394337219 conn(0x7f9c74067ba0 msgr2=0x7f9c74067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:53.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.344+0000 7f9c7941e640 1 -- 172.21.15.50:0/3394337219 shutdown_connections 2024-09-11T22:14:53.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.344+0000 7f9c7941e640 1 -- 172.21.15.50:0/3394337219 wait complete. 2024-09-11T22:14:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.345+0000 7f9c7941e640 1 Processor -- start 2024-09-11T22:14:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.345+0000 7f9c7941e640 1 -- start start 2024-09-11T22:14:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c7941e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c740d1580 0x7f9c740ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c7941e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7415e8e0 0x7f9c741f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c7941e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c74162350 0x7f9c74152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c7941e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c74162d40 con 0x7f9c7415e8e0 2024-09-11T22:14:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c7941e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9c740d3370 con 0x7f9c74162350 2024-09-11T22:14:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c7941e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9c740d3800 con 0x7f9c740d1580 2024-09-11T22:14:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c727fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7415e8e0 0x7f9c741f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c727fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7415e8e0 0x7f9c741f82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59852/0 (socket says 172.21.15.50:59852) 2024-09-11T22:14:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c727fc640 1 -- 172.21.15.50:0/955705050 learned_addr learned my addr 172.21.15.50:0/955705050 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c737fe640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c74162350 0x7f9c74152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c72ffd640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c740d1580 0x7f9c740ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c727fc640 1 -- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c740d1580 msgr2=0x7f9c740ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c727fc640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c740d1580 0x7f9c740ab260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c727fc640 1 -- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c74162350 msgr2=0x7f9c74152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c727fc640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c74162350 0x7f9c74152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c727fc640 1 -- 172.21.15.50:0/955705050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c740ab8d0 con 0x7f9c7415e8e0 2024-09-11T22:14:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c737fe640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c74162350 0x7f9c74152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c727fc640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7415e8e0 0x7f9c741f82b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c440 tx=0x7f9c5c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.346+0000 7f9c6b7fe640 1 -- 172.21.15.50:0/955705050 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c017070 con 0x7f9c7415e8e0 2024-09-11T22:14:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.347+0000 7f9c6b7fe640 1 -- 172.21.15.50:0/955705050 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5c005ce0 con 0x7f9c7415e8e0 2024-09-11T22:14:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.347+0000 7f9c7941e640 1 -- 172.21.15.50:0/955705050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c740abbb0 con 0x7f9c7415e8e0 2024-09-11T22:14:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.347+0000 7f9c6b7fe640 1 -- 172.21.15.50:0/955705050 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0072f0 con 0x7f9c7415e8e0 2024-09-11T22:14:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.347+0000 7f9c7941e640 1 -- 172.21.15.50:0/955705050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c740ac170 con 0x7f9c7415e8e0 2024-09-11T22:14:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.348+0000 7f9c7941e640 1 -- 172.21.15.50:0/955705050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c740b7880 con 0x7f9c7415e8e0 2024-09-11T22:14:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.348+0000 7f9c6b7fe640 1 -- 172.21.15.50:0/955705050 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c5c01a070 con 0x7f9c7415e8e0 2024-09-11T22:14:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.348+0000 7f9c6b7fe640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c5406be30 0x7f9c5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.349+0000 7f9c6b7fe640 1 -- 172.21.15.50:0/955705050 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f9c5c08a230 con 0x7f9c7415e8e0 2024-09-11T22:14:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.349+0000 7f9c72ffd640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c5406be30 0x7f9c5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.349+0000 7f9c72ffd640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c5406be30 0x7f9c5406e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009560 tx=0x7f9c6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.353+0000 7f9c6b7fe640 1 -- 172.21.15.50:0/955705050 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c5c058bc0 con 0x7f9c7415e8e0 2024-09-11T22:14:53.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.566+0000 7f9c7941e640 1 -- 172.21.15.50:0/955705050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c740ba750 con 0x7f9c7415e8e0 2024-09-11T22:14:53.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.566+0000 7f9c6b7fe640 1 -- 172.21.15.50:0/955705050 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5224 (secure 0 0 0) 0x7f9c5c0584c0 con 0x7f9c7415e8e0 2024-09-11T22:14:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:53.568 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"btime":"2024-09-11T22:14:44:423012+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2332065748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2332065748},{"type":"v1","addr":"172.21.15.77:6837","nonce":2332065748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2776548564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2776548564},{"type":"v1","addr":"172.21.15.77:6835","nonce":2776548564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2898617410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2898617410},{"type":"v1","addr":"172.21.15.50:6835","nonce":2898617410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:14:26.306529+0000","modified":"2024-09-11T22:14:44.423002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6393":{"gid":6393,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6833/3974105971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3974105971},{"type":"v1","addr":"172.21.15.50:6833","nonce":3974105971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6393,"qdb_cluster":[6393]},"id":4}]} 2024-09-11T22:14:53.568 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 40 2024-09-11T22:14:53.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.569+0000 7f9c7941e640 1 -- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c5406be30 msgr2=0x7f9c5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:53.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.569+0000 7f9c7941e640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c5406be30 0x7f9c5406e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009560 tx=0x7f9c6c008040 comp rx=0 tx=0).stop 2024-09-11T22:14:53.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.569+0000 7f9c7941e640 1 -- 172.21.15.50:0/955705050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7415e8e0 msgr2=0x7f9c741f82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:53.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.569+0000 7f9c7941e640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7415e8e0 0x7f9c741f82b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c440 tx=0x7f9c5c001e70 comp rx=0 tx=0).stop 2024-09-11T22:14:53.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.569+0000 7f9c7941e640 1 -- 172.21.15.50:0/955705050 shutdown_connections 2024-09-11T22:14:53.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.569+0000 7f9c7941e640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c5406be30 0x7f9c5406e2f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.569+0000 7f9c7941e640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c74162350 0x7f9c74152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.569+0000 7f9c7941e640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c7415e8e0 0x7f9c741f82b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.569+0000 7f9c7941e640 1 --2- 172.21.15.50:0/955705050 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c740d1580 0x7f9c740ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.569+0000 7f9c7941e640 1 -- 172.21.15.50:0/955705050 >> 172.21.15.50:0/955705050 conn(0x7f9c74067ba0 msgr2=0x7f9c740d1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:53.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.569+0000 7f9c7941e640 1 -- 172.21.15.50:0/955705050 shutdown_connections 2024-09-11T22:14:53.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.569+0000 7f9c7941e640 1 -- 172.21.15.50:0/955705050 wait complete. 2024-09-11T22:14:53.581 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:53.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.682+0000 7f98f4023640 1 Processor -- start 2024-09-11T22:14:53.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.682+0000 7f98f4023640 1 -- start start 2024-09-11T22:14:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f4023640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ec15e840 0x7f98ec0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f4023640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98ec0cf580 0x7f98ec06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f4023640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98ec0ce5f0 con 0x7f98ec0cdd50 2024-09-11T22:14:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f4023640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f98ec06c240 con 0x7f98ec0cf580 2024-09-11T22:14:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f4023640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f98ec0d0470 con 0x7f98ec15e840 2024-09-11T22:14:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f25c0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98ec0cf580 0x7f98ec06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f25c0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98ec0cf580 0x7f98ec06c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59862/0 (socket says 172.21.15.50:59862) 2024-09-11T22:14:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f15be640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f98ec0cdd50 0x7f98ec0cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48414/0 (socket says 172.21.15.50:48414) 2024-09-11T22:14:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f25c0640 1 -- 172.21.15.50:0/233602838 learned_addr learned my addr 172.21.15.50:0/233602838 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f1dbf640 1 --2- 172.21.15.50:0/233602838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ec15e840 0x7f98ec0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f25c0640 1 -- 172.21.15.50:0/233602838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ec15e840 msgr2=0x7f98ec0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f25c0640 1 --2- 172.21.15.50:0/233602838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ec15e840 0x7f98ec0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f25c0640 1 -- 172.21.15.50:0/233602838 >> v1:172.21.15.50:6789/0 conn(0x7f98ec0cdd50 legacy=0x7f98ec0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f25c0640 1 -- 172.21.15.50:0/233602838 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ec0ce310 con 0x7f98ec0cf580 2024-09-11T22:14:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f0dbd640 1 -- 172.21.15.50:0/233602838 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 232858714 0 0) 0x7f98ec0ce5f0 con 0x7f98ec0cdd50 2024-09-11T22:14:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.683+0000 7f98f1dbf640 1 --2- 172.21.15.50:0/233602838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ec15e840 0x7f98ec0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.684+0000 7f98f25c0640 1 --2- 172.21.15.50:0/233602838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98ec0cf580 0x7f98ec06c6d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009e50 tx=0x7f98e402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753c71ed51c737a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.684+0000 7f98f0dbd640 1 -- 172.21.15.50:0/233602838 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4036070 con 0x7f98ec0cf580 2024-09-11T22:14:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.684+0000 7f98f0dbd640 1 -- 172.21.15.50:0/233602838 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e4031600 con 0x7f98ec0cf580 2024-09-11T22:14:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.684+0000 7f98f0dbd640 1 -- 172.21.15.50:0/233602838 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e40319d0 con 0x7f98ec0cf580 2024-09-11T22:14:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.685+0000 7f98f4023640 1 -- 172.21.15.50:0/233602838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98ec0cf580 msgr2=0x7f98ec06c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.685+0000 7f98f4023640 1 --2- 172.21.15.50:0/233602838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98ec0cf580 0x7f98ec06c6d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009e50 tx=0x7f98e402a710 comp rx=0 tx=0).stop 2024-09-11T22:14:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.685+0000 7f98f4023640 1 -- 172.21.15.50:0/233602838 shutdown_connections 2024-09-11T22:14:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.685+0000 7f98f4023640 1 --2- 172.21.15.50:0/233602838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98ec0cf580 0x7f98ec06c6d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.685+0000 7f98f4023640 1 --2- 172.21.15.50:0/233602838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ec15e840 0x7f98ec0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.685+0000 7f98f4023640 1 -- 172.21.15.50:0/233602838 >> 172.21.15.50:0/233602838 conn(0x7f98ec0b4150 msgr2=0x7f98ec0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.685+0000 7f98f4023640 1 -- 172.21.15.50:0/233602838 shutdown_connections 2024-09-11T22:14:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.685+0000 7f98f4023640 1 -- 172.21.15.50:0/233602838 wait complete. 2024-09-11T22:14:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.686+0000 7f98f4023640 1 Processor -- start 2024-09-11T22:14:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.686+0000 7f98f4023640 1 -- start start 2024-09-11T22:14:53.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f4023640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98ec0cdd50 0x7f98ec0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f4023640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ec0cf580 0x7f98ec0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f4023640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98ec15e840 0x7f98ec158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f4023640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec15ec20 con 0x7f98ec0cdd50 2024-09-11T22:14:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f4023640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec06bed0 con 0x7f98ec15e840 2024-09-11T22:14:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f4023640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f98ec15eda0 con 0x7f98ec0cf580 2024-09-11T22:14:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f1dbf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98ec0cdd50 0x7f98ec0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f1dbf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98ec0cdd50 0x7f98ec0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59866/0 (socket says 172.21.15.50:59866) 2024-09-11T22:14:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f1dbf640 1 -- 172.21.15.50:0/2124003747 learned_addr learned my addr 172.21.15.50:0/2124003747 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f15be640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ec0cf580 0x7f98ec0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f25c0640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98ec15e840 0x7f98ec158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f1dbf640 1 -- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ec0cf580 msgr2=0x7f98ec0c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:53.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f1dbf640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ec0cf580 0x7f98ec0c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f1dbf640 1 -- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98ec15e840 msgr2=0x7f98ec158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f1dbf640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98ec15e840 0x7f98ec158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f1dbf640 1 -- 172.21.15.50:0/2124003747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ec0ca1b0 con 0x7f98ec0cdd50 2024-09-11T22:14:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f15be640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ec0cf580 0x7f98ec0c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f25c0640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98ec15e840 0x7f98ec158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f1dbf640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98ec0cdd50 0x7f98ec0c9650 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f98e800c7f0 tx=0x7f98e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98e27fc640 1 -- 172.21.15.50:0/2124003747 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8015070 con 0x7f98ec0cdd50 2024-09-11T22:14:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98e27fc640 1 -- 172.21.15.50:0/2124003747 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e8007820 con 0x7f98ec0cdd50 2024-09-11T22:14:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f4023640 1 -- 172.21.15.50:0/2124003747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98ec0ca490 con 0x7f98ec0cdd50 2024-09-11T22:14:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98e27fc640 1 -- 172.21.15.50:0/2124003747 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8007bd0 con 0x7f98ec0cdd50 2024-09-11T22:14:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.687+0000 7f98f4023640 1 -- 172.21.15.50:0/2124003747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98ec0b7620 con 0x7f98ec0cdd50 2024-09-11T22:14:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.688+0000 7f98f4023640 1 -- 172.21.15.50:0/2124003747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98ec159330 con 0x7f98ec0cdd50 2024-09-11T22:14:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.689+0000 7f98e27fc640 1 -- 172.21.15.50:0/2124003747 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98e8018070 con 0x7f98ec0cdd50 2024-09-11T22:14:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.689+0000 7f98e27fc640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98d006be30 0x7f98d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.689+0000 7f98e27fc640 1 -- 172.21.15.50:0/2124003747 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f98e808ae50 con 0x7f98ec0cdd50 2024-09-11T22:14:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.690+0000 7f98f15be640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98d006be30 0x7f98d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.690+0000 7f98f15be640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98d006be30 0x7f98d006e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f98ec06fc00 tx=0x7f98dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:53.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.694+0000 7f98e27fc640 1 -- 172.21.15.50:0/2124003747 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98ec159330 con 0x7f98ec0cdd50 2024-09-11T22:14:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.904+0000 7f98f4023640 1 -- 172.21.15.50:0/2124003747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98ec0b4c70 con 0x7f98ec0cdd50 2024-09-11T22:14:53.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.905+0000 7f98e27fc640 1 -- 172.21.15.50:0/2124003747 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5224 (secure 0 0 0) 0x7f98e8059750 con 0x7f98ec0cdd50 2024-09-11T22:14:53.906 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:53.906 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"btime":"2024-09-11T22:14:44:423012+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2332065748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2332065748},{"type":"v1","addr":"172.21.15.77:6837","nonce":2332065748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2776548564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2776548564},{"type":"v1","addr":"172.21.15.77:6835","nonce":2776548564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2898617410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2898617410},{"type":"v1","addr":"172.21.15.50:6835","nonce":2898617410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:14:26.306529+0000","modified":"2024-09-11T22:14:44.423002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6393":{"gid":6393,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6833/3974105971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3974105971},{"type":"v1","addr":"172.21.15.50:6833","nonce":3974105971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6393,"qdb_cluster":[6393]},"id":4}]} 2024-09-11T22:14:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 40 2024-09-11T22:14:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.906+0000 7f98f4023640 1 -- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98d006be30 msgr2=0x7f98d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.906+0000 7f98f4023640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98d006be30 0x7f98d006e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f98ec06fc00 tx=0x7f98dc009040 comp rx=0 tx=0).stop 2024-09-11T22:14:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.906+0000 7f98f4023640 1 -- 172.21.15.50:0/2124003747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98ec0cdd50 msgr2=0x7f98ec0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.906+0000 7f98f4023640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98ec0cdd50 0x7f98ec0c9650 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f98e800c7f0 tx=0x7f98e800ccb0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.906+0000 7f98f4023640 1 -- 172.21.15.50:0/2124003747 shutdown_connections 2024-09-11T22:14:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.906+0000 7f98f4023640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98d006be30 0x7f98d006e2f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.906+0000 7f98f4023640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98ec0cf580 0x7f98ec0c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.906+0000 7f98f4023640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98ec15e840 0x7f98ec158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.906+0000 7f98f4023640 1 --2- 172.21.15.50:0/2124003747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98ec0cdd50 0x7f98ec0c9650 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.906+0000 7f98f4023640 1 -- 172.21.15.50:0/2124003747 >> 172.21.15.50:0/2124003747 conn(0x7f98ec0b4150 msgr2=0x7f98ec070650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.907+0000 7f98f4023640 1 -- 172.21.15.50:0/2124003747 shutdown_connections 2024-09-11T22:14:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:53.907+0000 7f98f4023640 1 -- 172.21.15.50:0/2124003747 wait complete. 2024-09-11T22:14:53.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:14:54.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.022+0000 7f4d4b1d8640 1 Processor -- start 2024-09-11T22:14:54.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.022+0000 7f4d4b1d8640 1 -- start start 2024-09-11T22:14:54.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.023+0000 7f4d4b1d8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4415e870 0x7f4d440d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.023+0000 7f4d4b1d8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d440cfa80 con 0x7f4d440d3c00 2024-09-11T22:14:54.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.023+0000 7f4d4b1d8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d440d40d0 con 0x7f4d440d16d0 2024-09-11T22:14:54.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.023+0000 7f4d4b1d8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d440d1b10 con 0x7f4d4415e870 2024-09-11T22:14:54.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.023+0000 7f4d49775640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4d440d3c00 0x7f4d440b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48424/0 (socket says 172.21.15.50:48424) 2024-09-11T22:14:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.023+0000 7f4d49775640 1 -- 172.21.15.50:0/2708612162 learned_addr learned my addr 172.21.15.50:0/2708612162 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3966661821 0 0) 0x7f4d34001110 con 0x7f4d440d3c00 2024-09-11T22:14:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d2c003520 con 0x7f4d440d3c00 2024-09-11T22:14:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d48f74640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4415e870 0x7f4d440d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1754125141 0 0) 0x7f4d2c003520 con 0x7f4d440d3c00 2024-09-11T22:14:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4415e870 msgr2=0x7f4d440d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4415e870 0x7f4d440d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 >> v1:172.21.15.77:6789/0 conn(0x7f4d440d16d0 legacy=0x7f4d440d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d440d43b0 con 0x7f4d440d3c00 2024-09-11T22:14:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f4d34001860 con 0x7f4d440d3c00 2024-09-11T22:14:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 >> v1:172.21.15.50:6789/0 conn(0x7f4d440d3c00 legacy=0x7f4d440b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c0039e0 0x7f4d2c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c004800 0x7f4d2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4415e870 0x7f4d2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d440d1b10 con 0x7f4d2c0039e0 2024-09-11T22:14:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c00ba70 con 0x7f4d2c004800 2024-09-11T22:14:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d2c00bc70 con 0x7f4d4415e870 2024-09-11T22:14:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d48f74640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c0039e0 0x7f4d2c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d49775640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4415e870 0x7f4d2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d43fff640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c004800 0x7f4d2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d48f74640 1 -- 172.21.15.50:0/2708612162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4415e870 msgr2=0x7f4d2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d48f74640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4415e870 0x7f4d2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d48f74640 1 -- 172.21.15.50:0/2708612162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c004800 msgr2=0x7f4d2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d48f74640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c004800 0x7f4d2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d48f74640 1 -- 172.21.15.50:0/2708612162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2c003520 con 0x7f4d2c0039e0 2024-09-11T22:14:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.024+0000 7f4d49775640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4415e870 0x7f4d2c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.025+0000 7f4d43fff640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c004800 0x7f4d2c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.025+0000 7f4d48f74640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c0039e0 0x7f4d2c003e00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009f90 tx=0x7f4d2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ea4934673070af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.025+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c009c10 con 0x7f4d2c0039e0 2024-09-11T22:14:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.025+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3c036070 con 0x7f4d2c0039e0 2024-09-11T22:14:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.025+0000 7f4d437fe640 1 -- 172.21.15.50:0/2708612162 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c031830 con 0x7f4d2c0039e0 2024-09-11T22:14:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.026+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/2708612162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c0039e0 msgr2=0x7f4d2c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.026+0000 7f4d4b1d8640 1 --2- 172.21.15.50:0/2708612162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c0039e0 0x7f4d2c003e00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009f90 tx=0x7f4d2c005830 comp rx=0 tx=0).stop 2024-09-11T22:14:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.026+0000 7f4d49775640 1 -- 172.21.15.50:0/2708612162 reap_dead start 2024-09-11T22:14:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.026+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/2708612162 shutdown_connections 2024-09-11T22:14:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.026+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/2708612162 >> 172.21.15.50:0/2708612162 conn(0x7f4d440727a0 msgr2=0x7f4d440679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.026+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/2708612162 shutdown_connections 2024-09-11T22:14:54.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.026+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/2708612162 wait complete. 2024-09-11T22:14:54.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.027+0000 7f4d4b1d8640 1 Processor -- start 2024-09-11T22:14:54.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.027+0000 7f4d4b1d8640 1 -- start start 2024-09-11T22:14:54.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.028+0000 7f4d4b1d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c0039e0 0x7f4d44154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.028+0000 7f4d4b1d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d440ce260 0x7f4d44157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.028+0000 7f4d4b1d8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d44159430 0x7f4d441554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.028+0000 7f4d4b1d8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4415ec50 con 0x7f4d440ce260 2024-09-11T22:14:54.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.028+0000 7f4d4b1d8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d440b7ee0 con 0x7f4d2c0039e0 2024-09-11T22:14:54.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.028+0000 7f4d4b1d8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d440b78b0 con 0x7f4d44159430 2024-09-11T22:14:54.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.028+0000 7f4d43fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d440ce260 0x7f4d44157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.028+0000 7f4d43fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d440ce260 0x7f4d44157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59888/0 (socket says 172.21.15.50:59888) 2024-09-11T22:14:54.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.028+0000 7f4d43fff640 1 -- 172.21.15.50:0/86698851 learned_addr learned my addr 172.21.15.50:0/86698851 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:54.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.028+0000 7f4d49775640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d44159430 0x7f4d441554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.028+0000 7f4d48f74640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c0039e0 0x7f4d44154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.028+0000 7f4d43fff640 1 -- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d44159430 msgr2=0x7f4d441554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.028+0000 7f4d43fff640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d44159430 0x7f4d441554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.029+0000 7f4d43fff640 1 -- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c0039e0 msgr2=0x7f4d44154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.029+0000 7f4d43fff640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c0039e0 0x7f4d44154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.029+0000 7f4d43fff640 1 -- 172.21.15.50:0/86698851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d44157ed0 con 0x7f4d440ce260 2024-09-11T22:14:54.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.029+0000 7f4d48f74640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c0039e0 0x7f4d44154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:54.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.029+0000 7f4d43fff640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d440ce260 0x7f4d44157990 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800e570 tx=0x7f4d3800ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.029+0000 7f4d417fa640 1 -- 172.21.15.50:0/86698851 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d380052e0 con 0x7f4d440ce260 2024-09-11T22:14:54.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.029+0000 7f4d417fa640 1 -- 172.21.15.50:0/86698851 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d38018070 con 0x7f4d440ce260 2024-09-11T22:14:54.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.029+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/86698851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d440ce8f0 con 0x7f4d440ce260 2024-09-11T22:14:54.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.029+0000 7f4d417fa640 1 -- 172.21.15.50:0/86698851 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38003810 con 0x7f4d440ce260 2024-09-11T22:14:54.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.029+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/86698851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d440cbd80 con 0x7f4d440ce260 2024-09-11T22:14:54.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.030+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/86698851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d440d1190 con 0x7f4d440ce260 2024-09-11T22:14:54.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.031+0000 7f4d417fa640 1 -- 172.21.15.50:0/86698851 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d380039b0 con 0x7f4d440ce260 2024-09-11T22:14:54.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.031+0000 7f4d417fa640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d3006be60 0x7f4d3006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.031+0000 7f4d417fa640 1 -- 172.21.15.50:0/86698851 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f4d3808ac00 con 0x7f4d440ce260 2024-09-11T22:14:54.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.031+0000 7f4d48f74640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d3006be60 0x7f4d3006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.032+0000 7f4d48f74640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d3006be60 0x7f4d3006e320 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c035000 tx=0x7f4d3c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.035+0000 7f4d417fa640 1 -- 172.21.15.50:0/86698851 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d38091080 con 0x7f4d440ce260 2024-09-11T22:14:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.215+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/86698851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d4415cfe0 con 0x7f4d440ce260 2024-09-11T22:14:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.216+0000 7f4d417fa640 1 -- 172.21.15.50:0/86698851 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16948 (secure 0 0 0) 0x7f4d38059500 con 0x7f4d440ce260 2024-09-11T22:14:54.217 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:54.217 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":63,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:14:41.406574+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:14:24.266096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-11T22:14:25.290643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6832/3969515798":"2024-09-12T22:14:41.406550+0000","172.21.15.50:6834/3969515798":"2024-09-12T22:14:41.406550+0000","172.21.15.77:6837/1418437076":"2024-09-12T22:14:40.403866+0000","172.21.15.77:6835/1418437076":"2024-09-12T22:14:40.403866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:14:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.218+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d3006be60 msgr2=0x7f4d3006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.218+0000 7f4d4b1d8640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d3006be60 0x7f4d3006e320 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c035000 tx=0x7f4d3c02f000 comp rx=0 tx=0).stop 2024-09-11T22:14:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.218+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/86698851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d440ce260 msgr2=0x7f4d44157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.218+0000 7f4d4b1d8640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d440ce260 0x7f4d44157990 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800e570 tx=0x7f4d3800ea30 comp rx=0 tx=0).stop 2024-09-11T22:14:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.218+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/86698851 shutdown_connections 2024-09-11T22:14:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.218+0000 7f4d4b1d8640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d3006be60 0x7f4d3006e320 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.218+0000 7f4d4b1d8640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d44159430 0x7f4d441554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.218+0000 7f4d4b1d8640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d440ce260 0x7f4d44157990 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.218+0000 7f4d4b1d8640 1 --2- 172.21.15.50:0/86698851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d2c0039e0 0x7f4d44154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.219+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/86698851 >> 172.21.15.50:0/86698851 conn(0x7f4d440727a0 msgr2=0x7f4d4415edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:54.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.219+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/86698851 shutdown_connections 2024-09-11T22:14:54.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.219+0000 7f4d4b1d8640 1 -- 172.21.15.50:0/86698851 wait complete. 2024-09-11T22:14:54.231 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:14:54.231 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:54.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.332+0000 7f5e30253640 1 Processor -- start 2024-09-11T22:14:54.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.332+0000 7f5e30253640 1 -- start start 2024-09-11T22:14:54.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.333+0000 7f5e30253640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5e28162a60 0x7f5e280b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.333+0000 7f5e30253640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e28163080 con 0x7f5e280d1c90 2024-09-11T22:14:54.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.333+0000 7f5e30253640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e280d2d20 con 0x7f5e2815e8e0 2024-09-11T22:14:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.333+0000 7f5e30253640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5e2815ecc0 con 0x7f5e28162a60 2024-09-11T22:14:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.333+0000 7f5e2d7ee640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5e280d1c90 0x7f5e28162350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48430/0 (socket says 172.21.15.50:48430) 2024-09-11T22:14:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.333+0000 7f5e2d7ee640 1 -- 172.21.15.50:0/505080665 learned_addr learned my addr 172.21.15.50:0/505080665 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.333+0000 7f5e2e7f0640 1 --2- 172.21.15.50:0/505080665 >> v2:172.21.15.77:3300/0 conn(0x7f5e28162a60 0x7f5e280b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.333+0000 7f5e2cfed640 1 -- 172.21.15.50:0/505080665 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2667614484 0 0) 0x7f5e28163080 con 0x7f5e280d1c90 2024-09-11T22:14:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.334+0000 7f5e2cfed640 1 -- 172.21.15.50:0/505080665 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e14003520 con 0x7f5e280d1c90 2024-09-11T22:14:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.334+0000 7f5e2cfed640 1 -- 172.21.15.50:0/505080665 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2652321445 0 0) 0x7f5e14003520 con 0x7f5e280d1c90 2024-09-11T22:14:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.334+0000 7f5e2e7f0640 1 -- 172.21.15.50:0/505080665 >> v1:172.21.15.77:6789/0 conn(0x7f5e2815e8e0 legacy=0x7f5e280d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.334+0000 7f5e2e7f0640 1 -- 172.21.15.50:0/505080665 >> v1:172.21.15.50:6789/0 conn(0x7f5e280d1c90 legacy=0x7f5e28162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.334+0000 7f5e2e7f0640 1 -- 172.21.15.50:0/505080665 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e280d3000 con 0x7f5e28162a60 2024-09-11T22:14:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.335+0000 7f5e2e7f0640 1 --2- 172.21.15.50:0/505080665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e28162a60 0x7f5e280b7880 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009d90 tx=0x7f5e2002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa0046e8e8618ced server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.335+0000 7f5e2cfed640 1 -- 172.21.15.50:0/505080665 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18001670 con 0x7f5e28162a60 2024-09-11T22:14:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.335+0000 7f5e2cfed640 1 -- 172.21.15.50:0/505080665 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e20007540 con 0x7f5e28162a60 2024-09-11T22:14:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.335+0000 7f5e2cfed640 1 -- 172.21.15.50:0/505080665 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e200078f0 con 0x7f5e28162a60 2024-09-11T22:14:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.335+0000 7f5e30253640 1 -- 172.21.15.50:0/505080665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e28162a60 msgr2=0x7f5e280b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.335+0000 7f5e30253640 1 --2- 172.21.15.50:0/505080665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e28162a60 0x7f5e280b7880 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009d90 tx=0x7f5e2002a710 comp rx=0 tx=0).stop 2024-09-11T22:14:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.335+0000 7f5e30253640 1 -- 172.21.15.50:0/505080665 shutdown_connections 2024-09-11T22:14:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.335+0000 7f5e30253640 1 --2- 172.21.15.50:0/505080665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e28162a60 0x7f5e280b7880 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.335+0000 7f5e30253640 1 -- 172.21.15.50:0/505080665 >> 172.21.15.50:0/505080665 conn(0x7f5e28067ba0 msgr2=0x7f5e28067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.335+0000 7f5e30253640 1 -- 172.21.15.50:0/505080665 shutdown_connections 2024-09-11T22:14:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.335+0000 7f5e30253640 1 -- 172.21.15.50:0/505080665 wait complete. 2024-09-11T22:14:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.337+0000 7f5e30253640 1 Processor -- start 2024-09-11T22:14:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.337+0000 7f5e30253640 1 -- start start 2024-09-11T22:14:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.337+0000 7f5e30253640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e280d1c90 0x7f5e281560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.337+0000 7f5e30253640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e2815e8e0 0x7f5e280cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.337+0000 7f5e30253640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e28162a60 0x7f5e280b8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.337+0000 7f5e30253640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5e280d3c10 con 0x7f5e28162a60 2024-09-11T22:14:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.337+0000 7f5e30253640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5e280d3a90 con 0x7f5e280d1c90 2024-09-11T22:14:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.337+0000 7f5e30253640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5e280d3d90 con 0x7f5e2815e8e0 2024-09-11T22:14:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e2e7f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e28162a60 0x7f5e280b8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e2e7f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e28162a60 0x7f5e280b8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59896/0 (socket says 172.21.15.50:59896) 2024-09-11T22:14:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e2e7f0640 1 -- 172.21.15.50:0/216028262 learned_addr learned my addr 172.21.15.50:0/216028262 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e2d7ee640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e2815e8e0 0x7f5e280cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e2dfef640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e280d1c90 0x7f5e281560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e2e7f0640 1 -- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e2815e8e0 msgr2=0x7f5e280cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e2e7f0640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e2815e8e0 0x7f5e280cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e2e7f0640 1 -- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e280d1c90 msgr2=0x7f5e281560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e2e7f0640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e280d1c90 0x7f5e281560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e2e7f0640 1 -- 172.21.15.50:0/216028262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e280b6db0 con 0x7f5e28162a60 2024-09-11T22:14:54.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e2d7ee640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e2815e8e0 0x7f5e280cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:54.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e2dfef640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e280d1c90 0x7f5e281560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:54.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e2e7f0640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e28162a60 0x7f5e280b8eb0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5e2002ad00 tx=0x7f5e20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/216028262 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20040070 con 0x7f5e28162a60 2024-09-11T22:14:54.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/216028262 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e20031c40 con 0x7f5e28162a60 2024-09-11T22:14:54.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e30253640 1 -- 172.21.15.50:0/216028262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e280cb9f0 con 0x7f5e28162a60 2024-09-11T22:14:54.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/216028262 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20009450 con 0x7f5e28162a60 2024-09-11T22:14:54.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.338+0000 7f5e30253640 1 -- 172.21.15.50:0/216028262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e280cbfb0 con 0x7f5e28162a60 2024-09-11T22:14:54.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.339+0000 7f5e30253640 1 -- 172.21.15.50:0/216028262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e28159740 con 0x7f5e28162a60 2024-09-11T22:14:54.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.340+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/216028262 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e20039040 con 0x7f5e28162a60 2024-09-11T22:14:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.340+0000 7f5e1e7fc640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5e0c06be30 0x7f5e0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.340+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/216028262 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f5e200ac2f0 con 0x7f5e28162a60 2024-09-11T22:14:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.340+0000 7f5e2dfef640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5e0c06be30 0x7f5e0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.341+0000 7f5e2dfef640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5e0c06be30 0x7f5e0c06e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5e24007fd0 tx=0x7f5e24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.345+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/216028262 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e2007abf0 con 0x7f5e28162a60 2024-09-11T22:14:54.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.555+0000 7f5e30253640 1 -- 172.21.15.50:0/216028262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e280b7880 con 0x7f5e28162a60 2024-09-11T22:14:54.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.555+0000 7f5e1e7fc640 1 -- 172.21.15.50:0/216028262 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5224 (secure 0 0 0) 0x7f5e2007a4f0 con 0x7f5e28162a60 2024-09-11T22:14:54.556 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:54.556 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"btime":"2024-09-11T22:14:44:423012+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2332065748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2332065748},{"type":"v1","addr":"172.21.15.77:6837","nonce":2332065748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2776548564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2776548564},{"type":"v1","addr":"172.21.15.77:6835","nonce":2776548564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2898617410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2898617410},{"type":"v1","addr":"172.21.15.50:6835","nonce":2898617410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:14:26.306529+0000","modified":"2024-09-11T22:14:44.423002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6393":{"gid":6393,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6833/3974105971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3974105971},{"type":"v1","addr":"172.21.15.50:6833","nonce":3974105971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6393,"qdb_cluster":[6393]},"id":4}]} 2024-09-11T22:14:54.557 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 40 2024-09-11T22:14:54.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.557+0000 7f5e30253640 1 -- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5e0c06be30 msgr2=0x7f5e0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.557+0000 7f5e30253640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5e0c06be30 0x7f5e0c06e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5e24007fd0 tx=0x7f5e24009040 comp rx=0 tx=0).stop 2024-09-11T22:14:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.557+0000 7f5e30253640 1 -- 172.21.15.50:0/216028262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e28162a60 msgr2=0x7f5e280b8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.557+0000 7f5e30253640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e28162a60 0x7f5e280b8eb0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5e2002ad00 tx=0x7f5e20004a40 comp rx=0 tx=0).stop 2024-09-11T22:14:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.557+0000 7f5e30253640 1 -- 172.21.15.50:0/216028262 shutdown_connections 2024-09-11T22:14:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.557+0000 7f5e30253640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5e0c06be30 0x7f5e0c06e2f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.557+0000 7f5e30253640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e2815e8e0 0x7f5e280cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.557+0000 7f5e30253640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e28162a60 0x7f5e280b8eb0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.557+0000 7f5e30253640 1 --2- 172.21.15.50:0/216028262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e280d1c90 0x7f5e281560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.557+0000 7f5e30253640 1 -- 172.21.15.50:0/216028262 >> 172.21.15.50:0/216028262 conn(0x7f5e28067ba0 msgr2=0x7f5e280cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.558+0000 7f5e30253640 1 -- 172.21.15.50:0/216028262 shutdown_connections 2024-09-11T22:14:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.558+0000 7f5e30253640 1 -- 172.21.15.50:0/216028262 wait complete. 2024-09-11T22:14:54.569 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:14:54.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.671+0000 7f738ef4b640 1 Processor -- start 2024-09-11T22:14:54.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.671+0000 7f738ef4b640 1 -- start start 2024-09-11T22:14:54.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.672+0000 7f738ef4b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f738815c240 0x7f73880b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.672+0000 7f738ef4b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f738815c620 con 0x7f73880735a0 2024-09-11T22:14:54.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.672+0000 7f738ef4b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f738815f2b0 con 0x7f73880728e0 2024-09-11T22:14:54.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.672+0000 7f738ef4b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f738815f560 con 0x7f738815c240 2024-09-11T22:14:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.672+0000 7f738cce7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f738815c240 0x7f73880b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.672+0000 7f7387fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f73880735a0 0x7f738815eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48440/0 (socket says 172.21.15.50:48440) 2024-09-11T22:14:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.672+0000 7f738cce7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f738815c240 0x7f73880b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59908/0 (socket says 172.21.15.50:59908) 2024-09-11T22:14:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.672+0000 7f7387fff640 1 -- 172.21.15.50:0/1453146272 learned_addr learned my addr 172.21.15.50:0/1453146272 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.672+0000 7f738cce7640 1 -- 172.21.15.50:0/1453146272 >> v1:172.21.15.77:6789/0 conn(0x7f73880728e0 legacy=0x7f7388072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.672+0000 7f73877fe640 1 -- 172.21.15.50:0/1453146272 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366544123 0 0) 0x7f738815c620 con 0x7f73880735a0 2024-09-11T22:14:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.672+0000 7f738cce7640 1 -- 172.21.15.50:0/1453146272 >> v1:172.21.15.50:6789/0 conn(0x7f73880735a0 legacy=0x7f738815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.672+0000 7f738cce7640 1 -- 172.21.15.50:0/1453146272 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738815f840 con 0x7f738815c240 2024-09-11T22:14:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.673+0000 7f738cce7640 1 --2- 172.21.15.50:0/1453146272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f738815c240 0x7f73880b4770 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f737c0097a0 tx=0x7f737c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2426ed265ed38ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.673+0000 7f73877fe640 1 -- 172.21.15.50:0/1453146272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c037070 con 0x7f738815c240 2024-09-11T22:14:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.673+0000 7f73877fe640 1 -- 172.21.15.50:0/1453146272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737c032440 con 0x7f738815c240 2024-09-11T22:14:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.673+0000 7f73877fe640 1 -- 172.21.15.50:0/1453146272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c032810 con 0x7f738815c240 2024-09-11T22:14:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.673+0000 7f738ef4b640 1 -- 172.21.15.50:0/1453146272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f738815c240 msgr2=0x7f73880b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.673+0000 7f738ef4b640 1 --2- 172.21.15.50:0/1453146272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f738815c240 0x7f73880b4770 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f737c0097a0 tx=0x7f737c02a1e0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.674+0000 7f738ef4b640 1 -- 172.21.15.50:0/1453146272 shutdown_connections 2024-09-11T22:14:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.674+0000 7f738ef4b640 1 --2- 172.21.15.50:0/1453146272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f738815c240 0x7f73880b4770 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.674+0000 7f738ef4b640 1 -- 172.21.15.50:0/1453146272 >> 172.21.15.50:0/1453146272 conn(0x7f73880b2bd0 msgr2=0x7f73880b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.674+0000 7f738ef4b640 1 -- 172.21.15.50:0/1453146272 shutdown_connections 2024-09-11T22:14:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.674+0000 7f738ef4b640 1 -- 172.21.15.50:0/1453146272 wait complete. 2024-09-11T22:14:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.675+0000 7f738ef4b640 1 Processor -- start 2024-09-11T22:14:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.675+0000 7f738ef4b640 1 -- start start 2024-09-11T22:14:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738ef4b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73880728e0 0x7f73881e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738ef4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880735a0 0x7f7388156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738ef4b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f738815c240 0x7f7388159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738ef4b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73880b4250 con 0x7f73880728e0 2024-09-11T22:14:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738ef4b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73880b3f70 con 0x7f73880735a0 2024-09-11T22:14:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738ef4b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f73880b4cb0 con 0x7f738815c240 2024-09-11T22:14:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738cce7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73880728e0 0x7f73881e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738cce7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73880728e0 0x7f73881e9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59920/0 (socket says 172.21.15.50:59920) 2024-09-11T22:14:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738cce7640 1 -- 172.21.15.50:0/2490784622 learned_addr learned my addr 172.21.15.50:0/2490784622 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738cce7640 1 -- 172.21.15.50:0/2490784622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f738815c240 msgr2=0x7f7388159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738cce7640 1 --2- 172.21.15.50:0/2490784622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f738815c240 0x7f7388159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738cce7640 1 -- 172.21.15.50:0/2490784622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880735a0 msgr2=0x7f7388156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738cce7640 1 --2- 172.21.15.50:0/2490784622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880735a0 0x7f7388156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738cce7640 1 -- 172.21.15.50:0/2490784622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73881e8c80 con 0x7f73880728e0 2024-09-11T22:14:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738cce7640 1 --2- 172.21.15.50:0/2490784622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73880728e0 0x7f73881e9a40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f737c0097a0 tx=0x7f737c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f73857fa640 1 -- 172.21.15.50:0/2490784622 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c037040 con 0x7f73880728e0 2024-09-11T22:14:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f73857fa640 1 -- 172.21.15.50:0/2490784622 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737c004230 con 0x7f73880728e0 2024-09-11T22:14:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f738ef4b640 1 -- 172.21.15.50:0/2490784622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73881e8f60 con 0x7f73880728e0 2024-09-11T22:14:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.676+0000 7f73857fa640 1 -- 172.21.15.50:0/2490784622 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c032e20 con 0x7f73880728e0 2024-09-11T22:14:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.677+0000 7f738ef4b640 1 -- 172.21.15.50:0/2490784622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73881e9520 con 0x7f73880728e0 2024-09-11T22:14:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.678+0000 7f738ef4b640 1 -- 172.21.15.50:0/2490784622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73880b4770 con 0x7f73880728e0 2024-09-11T22:14:54.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.678+0000 7f73857fa640 1 -- 172.21.15.50:0/2490784622 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f737c030770 con 0x7f73880728e0 2024-09-11T22:14:54.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.679+0000 7f73857fa640 1 --2- 172.21.15.50:0/2490784622 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f736c06be30 0x7f736c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:54.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.679+0000 7f73857fa640 1 -- 172.21.15.50:0/2490784622 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f737c0ac2d0 con 0x7f73880728e0 2024-09-11T22:14:54.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.679+0000 7f7387fff640 1 --2- 172.21.15.50:0/2490784622 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f736c06be30 0x7f736c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:54.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.680+0000 7f7387fff640 1 --2- 172.21.15.50:0/2490784622 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f736c06be30 0x7f736c06e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7374007fd0 tx=0x7f7374007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:54.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.683+0000 7f73857fa640 1 -- 172.21.15.50:0/2490784622 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f737c07ac50 con 0x7f73880728e0 2024-09-11T22:14:54.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.893+0000 7f738ef4b640 1 -- 172.21.15.50:0/2490784622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f738806ed70 con 0x7f73880728e0 2024-09-11T22:14:54.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.894+0000 7f73857fa640 1 -- 172.21.15.50:0/2490784622 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5224 (secure 0 0 0) 0x7f737c07a550 con 0x7f73880728e0 2024-09-11T22:14:54.895 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:54.895 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"btime":"2024-09-11T22:14:44:423012+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2332065748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2332065748},{"type":"v1","addr":"172.21.15.77:6837","nonce":2332065748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2776548564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2776548564},{"type":"v1","addr":"172.21.15.77:6835","nonce":2776548564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2898617410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2898617410},{"type":"v1","addr":"172.21.15.50:6835","nonce":2898617410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:14:26.306529+0000","modified":"2024-09-11T22:14:44.423002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6393":{"gid":6393,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6833/3974105971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3974105971},{"type":"v1","addr":"172.21.15.50:6833","nonce":3974105971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6393,"qdb_cluster":[6393]},"id":4}]} 2024-09-11T22:14:54.895 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 40 2024-09-11T22:14:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.896+0000 7f738ef4b640 1 -- 172.21.15.50:0/2490784622 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f736c06be30 msgr2=0x7f736c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.896+0000 7f738ef4b640 1 --2- 172.21.15.50:0/2490784622 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f736c06be30 0x7f736c06e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7374007fd0 tx=0x7f7374007920 comp rx=0 tx=0).stop 2024-09-11T22:14:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.896+0000 7f738ef4b640 1 -- 172.21.15.50:0/2490784622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73880728e0 msgr2=0x7f73881e9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.896+0000 7f738ef4b640 1 --2- 172.21.15.50:0/2490784622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73880728e0 0x7f73881e9a40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f737c0097a0 tx=0x7f737c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.896+0000 7f738ef4b640 1 -- 172.21.15.50:0/2490784622 shutdown_connections 2024-09-11T22:14:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.896+0000 7f738ef4b640 1 --2- 172.21.15.50:0/2490784622 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f736c06be30 0x7f736c06e2f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.896+0000 7f738ef4b640 1 --2- 172.21.15.50:0/2490784622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f738815c240 0x7f7388159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.896+0000 7f738ef4b640 1 --2- 172.21.15.50:0/2490784622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73880735a0 0x7f7388156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.896+0000 7f738ef4b640 1 --2- 172.21.15.50:0/2490784622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73880728e0 0x7f73881e9a40 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.896+0000 7f738ef4b640 1 -- 172.21.15.50:0/2490784622 >> 172.21.15.50:0/2490784622 conn(0x7f73880b2bd0 msgr2=0x7f738806f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.896+0000 7f738ef4b640 1 -- 172.21.15.50:0/2490784622 shutdown_connections 2024-09-11T22:14:54.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:54.896+0000 7f738ef4b640 1 -- 172.21.15.50:0/2490784622 wait complete. 2024-09-11T22:14:54.908 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:14:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.009+0000 7f4e82986640 1 Processor -- start 2024-09-11T22:14:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.009+0000 7f4e82986640 1 -- start start 2024-09-11T22:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.010+0000 7f4e82986640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e7c15e870 0x7f4e7c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.010+0000 7f4e82986640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4e7c0d3c00 0x7f4e7c0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.010+0000 7f4e82986640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7c0cfa80 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.010+0000 7f4e82986640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7c0d1b10 con 0x7f4e7c0d3c00 2024-09-11T22:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.010+0000 7f4e82986640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7c0d40d0 con 0x7f4e7c15e870 2024-09-11T22:14:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.011+0000 7f4e80f23640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4e7c0d3c00 0x7f4e7c0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.011+0000 7f4e7bfff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e7c15e870 0x7f4e7c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.011+0000 7f4e7b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4e7c0d16d0 0x7f4e7c0d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:51322/0 (socket says 172.21.15.50:51322) 2024-09-11T22:14:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.011+0000 7f4e7b7fe640 1 -- 172.21.15.50:0/842208393 learned_addr learned my addr 172.21.15.50:0/842208393 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.011+0000 7f4e80f23640 1 -- 172.21.15.50:0/842208393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e7c15e870 msgr2=0x7f4e7c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.011+0000 7f4e80f23640 1 --2- 172.21.15.50:0/842208393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e7c15e870 0x7f4e7c0d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.011+0000 7f4e80f23640 1 -- 172.21.15.50:0/842208393 >> v1:172.21.15.77:6789/0 conn(0x7f4e7c0d16d0 legacy=0x7f4e7c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.011+0000 7f4e80f23640 1 -- 172.21.15.50:0/842208393 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c0d43b0 con 0x7f4e7c0d3c00 2024-09-11T22:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.011+0000 7f4e7bfff640 1 --2- 172.21.15.50:0/842208393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e7c15e870 0x7f4e7c0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.012+0000 7f4e80f23640 1 --2- 172.21.15.50:0/842208393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e7c0d3c00 0x7f4e7c0b8400 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009d90 tx=0x7f4e7402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c7a6437fcaa511c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.012+0000 7f4e7affd640 1 -- 172.21.15.50:0/842208393 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74007740 con 0x7f4e7c0d3c00 2024-09-11T22:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.012+0000 7f4e7affd640 1 -- 172.21.15.50:0/842208393 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e740078e0 con 0x7f4e7c0d3c00 2024-09-11T22:14:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.012+0000 7f4e7affd640 1 -- 172.21.15.50:0/842208393 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74007cb0 con 0x7f4e7c0d3c00 2024-09-11T22:14:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.012+0000 7f4e82986640 1 -- 172.21.15.50:0/842208393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e7c0d3c00 msgr2=0x7f4e7c0b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.012+0000 7f4e82986640 1 --2- 172.21.15.50:0/842208393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e7c0d3c00 0x7f4e7c0b8400 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009d90 tx=0x7f4e7402a660 comp rx=0 tx=0).stop 2024-09-11T22:14:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.013+0000 7f4e82986640 1 -- 172.21.15.50:0/842208393 shutdown_connections 2024-09-11T22:14:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.013+0000 7f4e82986640 1 --2- 172.21.15.50:0/842208393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e7c0d3c00 0x7f4e7c0b8400 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.013+0000 7f4e82986640 1 --2- 172.21.15.50:0/842208393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e7c15e870 0x7f4e7c0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.013+0000 7f4e82986640 1 -- 172.21.15.50:0/842208393 >> 172.21.15.50:0/842208393 conn(0x7f4e7c0727a0 msgr2=0x7f4e7c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.013+0000 7f4e82986640 1 -- 172.21.15.50:0/842208393 shutdown_connections 2024-09-11T22:14:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.013+0000 7f4e82986640 1 -- 172.21.15.50:0/842208393 wait complete. 2024-09-11T22:14:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.014+0000 7f4e82986640 1 Processor -- start 2024-09-11T22:14:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.014+0000 7f4e82986640 1 -- start start 2024-09-11T22:14:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e82986640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e7c0d16d0 0x7f4e7c1f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e82986640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e7c0d3c00 0x7f4e7c0cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e82986640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e7c15e870 0x7f4e7c0b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e82986640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c15ec50 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e82986640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c0b7ee0 con 0x7f4e7c15e870 2024-09-11T22:14:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e82986640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7c0b78b0 con 0x7f4e7c0d3c00 2024-09-11T22:14:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e7bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e7c0d16d0 0x7f4e7c1f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e7bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e7c0d16d0 0x7f4e7c1f5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59926/0 (socket says 172.21.15.50:59926) 2024-09-11T22:14:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e7bfff640 1 -- 172.21.15.50:0/3418950628 learned_addr learned my addr 172.21.15.50:0/3418950628 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e7b7fe640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e7c0d3c00 0x7f4e7c0cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e80f23640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e7c15e870 0x7f4e7c0b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e7bfff640 1 -- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e7c0d3c00 msgr2=0x7f4e7c0cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e7bfff640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e7c0d3c00 0x7f4e7c0cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e7bfff640 1 -- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e7c15e870 msgr2=0x7f4e7c0b89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e7bfff640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e7c15e870 0x7f4e7c0b89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e7bfff640 1 -- 172.21.15.50:0/3418950628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c1f57a0 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e7bfff640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e7c0d16d0 0x7f4e7c1f5aa0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00ebe0 tx=0x7f4e6c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e78ff9640 1 -- 172.21.15.50:0/3418950628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c017070 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e78ff9640 1 -- 172.21.15.50:0/3418950628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6c00cc30 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.015+0000 7f4e78ff9640 1 -- 172.21.15.50:0/3418950628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c013470 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.016+0000 7f4e82986640 1 -- 172.21.15.50:0/3418950628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7c0cdf00 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.016+0000 7f4e82986640 1 -- 172.21.15.50:0/3418950628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7c1f5fe0 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.016+0000 7f4e82986640 1 -- 172.21.15.50:0/3418950628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e7c0b8400 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.017+0000 7f4e78ff9640 1 -- 172.21.15.50:0/3418950628 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e6c01a070 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.017+0000 7f4e78ff9640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e6806be60 0x7f4e6806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.018+0000 7f4e78ff9640 1 -- 172.21.15.50:0/3418950628 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f4e6c08b180 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.018+0000 7f4e7b7fe640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e6806be60 0x7f4e6806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.018+0000 7f4e7b7fe640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e6806be60 0x7f4e6806e320 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4e70000f60 tx=0x7f4e70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.022+0000 7f4e78ff9640 1 -- 172.21.15.50:0/3418950628 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e6c059b10 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.198+0000 7f4e82986640 1 -- 172.21.15.50:0/3418950628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e7c15c370 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.199+0000 7f4e78ff9640 1 -- 172.21.15.50:0/3418950628 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16948 (secure 0 0 0) 0x7f4e6c059410 con 0x7f4e7c0d16d0 2024-09-11T22:14:55.200 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:14:55.200 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":63,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:14:41.406574+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:14:24.266096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-11T22:14:25.290643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6832/3969515798":"2024-09-12T22:14:41.406550+0000","172.21.15.50:6834/3969515798":"2024-09-12T22:14:41.406550+0000","172.21.15.77:6837/1418437076":"2024-09-12T22:14:40.403866+0000","172.21.15.77:6835/1418437076":"2024-09-12T22:14:40.403866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:14:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.201+0000 7f4e82986640 1 -- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e6806be60 msgr2=0x7f4e6806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.201+0000 7f4e82986640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e6806be60 0x7f4e6806e320 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4e70000f60 tx=0x7f4e70009040 comp rx=0 tx=0).stop 2024-09-11T22:14:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.201+0000 7f4e82986640 1 -- 172.21.15.50:0/3418950628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e7c0d16d0 msgr2=0x7f4e7c1f5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.201+0000 7f4e82986640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e7c0d16d0 0x7f4e7c1f5aa0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00ebe0 tx=0x7f4e6c00c520 comp rx=0 tx=0).stop 2024-09-11T22:14:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.201+0000 7f4e82986640 1 -- 172.21.15.50:0/3418950628 shutdown_connections 2024-09-11T22:14:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.201+0000 7f4e82986640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e6806be60 0x7f4e6806e320 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.201+0000 7f4e82986640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e7c0d3c00 0x7f4e7c0cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.201+0000 7f4e82986640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e7c15e870 0x7f4e7c0b89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.201+0000 7f4e82986640 1 --2- 172.21.15.50:0/3418950628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e7c0d16d0 0x7f4e7c1f5aa0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.201+0000 7f4e82986640 1 -- 172.21.15.50:0/3418950628 >> 172.21.15.50:0/3418950628 conn(0x7f4e7c0727a0 msgr2=0x7f4e7c0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.201+0000 7f4e82986640 1 -- 172.21.15.50:0/3418950628 shutdown_connections 2024-09-11T22:14:55.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.201+0000 7f4e82986640 1 -- 172.21.15.50:0/3418950628 wait complete. 2024-09-11T22:14:55.213 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:14:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.315+0000 7f977f7d8640 1 Processor -- start 2024-09-11T22:14:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.315+0000 7f977f7d8640 1 -- start start 2024-09-11T22:14:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.316+0000 7f977f7d8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f977815e8e0 0x7f97780b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.316+0000 7f977f7d8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9778162350 0x7f97781627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.316+0000 7f977f7d8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9778163080 con 0x7f97780d1580 2024-09-11T22:14:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.316+0000 7f977f7d8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f977815ecc0 con 0x7f9778162350 2024-09-11T22:14:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.316+0000 7f977f7d8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f97780d2ad0 con 0x7f977815e8e0 2024-09-11T22:14:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.316+0000 7f977dd75640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9778162350 0x7f97781627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.316+0000 7f977cd73640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f97780d1580 0x7f97780d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48452/0 (socket says 172.21.15.50:48452) 2024-09-11T22:14:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.316+0000 7f977cd73640 1 -- 172.21.15.50:0/4293540292 learned_addr learned my addr 172.21.15.50:0/4293540292 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.316+0000 7f977d574640 1 --2- 172.21.15.50:0/4293540292 >> v2:172.21.15.77:3300/0 conn(0x7f977815e8e0 0x7f97780b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.316+0000 7f977dd75640 1 -- 172.21.15.50:0/4293540292 >> v2:172.21.15.77:3300/0 conn(0x7f977815e8e0 msgr2=0x7f97780b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.316+0000 7f977dd75640 1 --2- 172.21.15.50:0/4293540292 >> v2:172.21.15.77:3300/0 conn(0x7f977815e8e0 0x7f97780b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.316+0000 7f977dd75640 1 -- 172.21.15.50:0/4293540292 >> v1:172.21.15.50:6789/0 conn(0x7f97780d1580 legacy=0x7f97780d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.317+0000 7f977dd75640 1 -- 172.21.15.50:0/4293540292 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97780d2d20 con 0x7f9778162350 2024-09-11T22:14:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.317+0000 7f976ffff640 1 -- 172.21.15.50:0/4293540292 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029134677 0 0) 0x7f9778163080 con 0x7f97780d1580 2024-09-11T22:14:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.317+0000 7f977dd75640 1 --2- 172.21.15.50:0/4293540292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9778162350 0x7f97781627a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f977808d630 tx=0x7f977002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd77a4823de3bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.317+0000 7f976ffff640 1 -- 172.21.15.50:0/4293540292 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770007740 con 0x7f9778162350 2024-09-11T22:14:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.317+0000 7f976ffff640 1 -- 172.21.15.50:0/4293540292 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97700078e0 con 0x7f9778162350 2024-09-11T22:14:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.317+0000 7f976ffff640 1 -- 172.21.15.50:0/4293540292 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770007cb0 con 0x7f9778162350 2024-09-11T22:14:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.318+0000 7f977f7d8640 1 -- 172.21.15.50:0/4293540292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9778162350 msgr2=0x7f97781627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.318+0000 7f977f7d8640 1 --2- 172.21.15.50:0/4293540292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9778162350 0x7f97781627a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f977808d630 tx=0x7f977002a710 comp rx=0 tx=0).stop 2024-09-11T22:14:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.318+0000 7f977f7d8640 1 -- 172.21.15.50:0/4293540292 shutdown_connections 2024-09-11T22:14:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.318+0000 7f977f7d8640 1 --2- 172.21.15.50:0/4293540292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9778162350 0x7f97781627a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.318+0000 7f977f7d8640 1 --2- 172.21.15.50:0/4293540292 >> v2:172.21.15.77:3300/0 conn(0x7f977815e8e0 0x7f97780b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.318+0000 7f977f7d8640 1 -- 172.21.15.50:0/4293540292 >> 172.21.15.50:0/4293540292 conn(0x7f9778067ba0 msgr2=0x7f9778067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.318+0000 7f977f7d8640 1 -- 172.21.15.50:0/4293540292 shutdown_connections 2024-09-11T22:14:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.318+0000 7f977f7d8640 1 -- 172.21.15.50:0/4293540292 wait complete. 2024-09-11T22:14:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.319+0000 7f977f7d8640 1 Processor -- start 2024-09-11T22:14:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.319+0000 7f977f7d8640 1 -- start start 2024-09-11T22:14:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977f7d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97780d1580 0x7f9778158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977f7d8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f977815e8e0 0x7f97780b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977f7d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9778162350 0x7f9778156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977f7d8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9778162ce0 con 0x7f9778162350 2024-09-11T22:14:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977f7d8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f97780d3370 con 0x7f97780d1580 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977f7d8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9778162e60 con 0x7f977815e8e0 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977dd75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9778162350 0x7f9778156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977dd75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9778162350 0x7f9778156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59936/0 (socket says 172.21.15.50:59936) 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977dd75640 1 -- 172.21.15.50:0/3016741625 learned_addr learned my addr 172.21.15.50:0/3016741625 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977d574640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97780d1580 0x7f9778158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977cd73640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f977815e8e0 0x7f97780b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977dd75640 1 -- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f977815e8e0 msgr2=0x7f97780b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977dd75640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f977815e8e0 0x7f97780b69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977dd75640 1 -- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97780d1580 msgr2=0x7f9778158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977dd75640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97780d1580 0x7f9778158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.320+0000 7f977dd75640 1 -- 172.21.15.50:0/3016741625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97780b44a0 con 0x7f9778162350 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.321+0000 7f977dd75640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9778162350 0x7f9778156b60 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9770009e80 tx=0x7f9770004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.321+0000 7f976dffb640 1 -- 172.21.15.50:0/3016741625 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770040070 con 0x7f9778162350 2024-09-11T22:14:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.321+0000 7f976dffb640 1 -- 172.21.15.50:0/3016741625 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9770031c40 con 0x7f9778162350 2024-09-11T22:14:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.321+0000 7f977f7d8640 1 -- 172.21.15.50:0/3016741625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97780b4780 con 0x7f9778162350 2024-09-11T22:14:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.321+0000 7f976dffb640 1 -- 172.21.15.50:0/3016741625 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770009450 con 0x7f9778162350 2024-09-11T22:14:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.321+0000 7f977f7d8640 1 -- 172.21.15.50:0/3016741625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97780b4d40 con 0x7f9778162350 2024-09-11T22:14:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.322+0000 7f977f7d8640 1 -- 172.21.15.50:0/3016741625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97780b7880 con 0x7f9778162350 2024-09-11T22:14:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.322+0000 7f976dffb640 1 -- 172.21.15.50:0/3016741625 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9770039040 con 0x7f9778162350 2024-09-11T22:14:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.323+0000 7f976dffb640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f975c06be30 0x7f975c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.323+0000 7f976dffb640 1 -- 172.21.15.50:0/3016741625 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5881+0+0 (secure 0 0 0) 0x7f97700ac0b0 con 0x7f9778162350 2024-09-11T22:14:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.323+0000 7f977d574640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f975c06be30 0x7f975c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.324+0000 7f977d574640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f975c06be30 0x7f975c06e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9774006fd0 tx=0x7f9774008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.327+0000 7f976dffb640 1 -- 172.21.15.50:0/3016741625 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f977007aa40 con 0x7f9778162350 2024-09-11T22:14:55.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.539+0000 7f977f7d8640 1 -- 172.21.15.50:0/3016741625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9778068240 con 0x7f9778162350 2024-09-11T22:14:55.540 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:14:55.540+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:14:55.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.541+0000 7f976dffb640 1 -- 172.21.15.50:0/3016741625 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) ==== 161+0+0 (secure 0 0 0) 0x7f977007a340 con 0x7f9778162350 2024-09-11T22:14:55.542 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:14:55.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.544+0000 7f977f7d8640 1 -- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f975c06be30 msgr2=0x7f975c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.544+0000 7f977f7d8640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f975c06be30 0x7f975c06e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9774006fd0 tx=0x7f9774008040 comp rx=0 tx=0).stop 2024-09-11T22:14:55.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.544+0000 7f977f7d8640 1 -- 172.21.15.50:0/3016741625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9778162350 msgr2=0x7f9778156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.544+0000 7f977f7d8640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9778162350 0x7f9778156b60 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9770009e80 tx=0x7f9770004a40 comp rx=0 tx=0).stop 2024-09-11T22:14:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.544+0000 7f977f7d8640 1 -- 172.21.15.50:0/3016741625 shutdown_connections 2024-09-11T22:14:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.544+0000 7f977f7d8640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f975c06be30 0x7f975c06e2f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.544+0000 7f977f7d8640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f977815e8e0 0x7f97780b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.544+0000 7f977f7d8640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9778162350 0x7f9778156b60 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.544+0000 7f977f7d8640 1 --2- 172.21.15.50:0/3016741625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97780d1580 0x7f9778158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.544+0000 7f977f7d8640 1 -- 172.21.15.50:0/3016741625 >> 172.21.15.50:0/3016741625 conn(0x7f9778067ba0 msgr2=0x7f977815eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.544+0000 7f977f7d8640 1 -- 172.21.15.50:0/3016741625 shutdown_connections 2024-09-11T22:14:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.544+0000 7f977f7d8640 1 -- 172.21.15.50:0/3016741625 wait complete. 2024-09-11T22:14:55.548 INFO:tasks.ceph.mds.a.smithi050.stderr: -615> 2024-09-11T22:14:47.415+0000 7f5013b42640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:14:55.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:14:55.575 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.665+0000 7efdf28b7640 1 Processor -- start 2024-09-11T22:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.665+0000 7efdf28b7640 1 -- start start 2024-09-11T22:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.666+0000 7efdf28b7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdec15b400 0x7efdec06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.666+0000 7efdf28b7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efdec06e0f0 0x7efdec0711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.666+0000 7efdf28b7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdec15b7e0 con 0x7efdec072e60 2024-09-11T22:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.666+0000 7efdf28b7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7efdec15f140 con 0x7efdec06e0f0 2024-09-11T22:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.666+0000 7efdf28b7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efdec15f420 con 0x7efdec15b400 2024-09-11T22:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.666+0000 7efdf0e54640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efdec06e0f0 0x7efdec0711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.666+0000 7efdf0e54640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efdec06e0f0 0x7efdec0711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59960/0 (socket says 172.21.15.50:59960) 2024-09-11T22:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.666+0000 7efdf0e54640 1 -- 172.21.15.50:0/1878439562 learned_addr learned my addr 172.21.15.50:0/1878439562 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.666+0000 7efdebfff640 1 --2- 172.21.15.50:0/1878439562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdec15b400 0x7efdec06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.666+0000 7efdf0e54640 1 -- 172.21.15.50:0/1878439562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdec15b400 msgr2=0x7efdec06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.666+0000 7efdf0e54640 1 --2- 172.21.15.50:0/1878439562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdec15b400 0x7efdec06d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.666+0000 7efdf0e54640 1 -- 172.21.15.50:0/1878439562 >> v1:172.21.15.77:6789/0 conn(0x7efdec072e60 legacy=0x7efdec06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.666+0000 7efdf0e54640 1 -- 172.21.15.50:0/1878439562 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdec15f700 con 0x7efdec06e0f0 2024-09-11T22:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.667+0000 7efdf0e54640 1 --2- 172.21.15.50:0/1878439562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdec06e0f0 0x7efdec0711c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7efde4009e50 tx=0x7efde402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa60d5abed8f39d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.667+0000 7efdeaffd640 1 -- 172.21.15.50:0/1878439562 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde4036070 con 0x7efdec06e0f0 2024-09-11T22:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.667+0000 7efdeaffd640 1 -- 172.21.15.50:0/1878439562 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde4031600 con 0x7efdec06e0f0 2024-09-11T22:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.667+0000 7efdeaffd640 1 -- 172.21.15.50:0/1878439562 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde40319d0 con 0x7efdec06e0f0 2024-09-11T22:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.668+0000 7efdf28b7640 1 -- 172.21.15.50:0/1878439562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdec06e0f0 msgr2=0x7efdec0711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.668+0000 7efdf28b7640 1 --2- 172.21.15.50:0/1878439562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdec06e0f0 0x7efdec0711c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7efde4009e50 tx=0x7efde402a710 comp rx=0 tx=0).stop 2024-09-11T22:14:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.668+0000 7efdf28b7640 1 -- 172.21.15.50:0/1878439562 shutdown_connections 2024-09-11T22:14:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.668+0000 7efdf28b7640 1 --2- 172.21.15.50:0/1878439562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdec06e0f0 0x7efdec0711c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.668+0000 7efdf28b7640 1 --2- 172.21.15.50:0/1878439562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdec15b400 0x7efdec06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.668+0000 7efdf28b7640 1 -- 172.21.15.50:0/1878439562 >> 172.21.15.50:0/1878439562 conn(0x7efdec0679c0 msgr2=0x7efdec067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.668+0000 7efdf28b7640 1 -- 172.21.15.50:0/1878439562 shutdown_connections 2024-09-11T22:14:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.668+0000 7efdf28b7640 1 -- 172.21.15.50:0/1878439562 wait complete. 2024-09-11T22:14:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.669+0000 7efdf28b7640 1 Processor -- start 2024-09-11T22:14:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.669+0000 7efdf28b7640 1 -- start start 2024-09-11T22:14:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdf28b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdec06e0f0 0x7efdec0b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdf28b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdec072e60 0x7efdec15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdf28b7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdec15b400 0x7efdec1ef270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdf28b7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efdec071700 con 0x7efdec06e0f0 2024-09-11T22:14:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdf28b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efdec0cfc50 con 0x7efdec072e60 2024-09-11T22:14:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdf28b7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efdec071880 con 0x7efdec15b400 2024-09-11T22:14:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdebfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdec06e0f0 0x7efdec0b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdebfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdec06e0f0 0x7efdec0b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59966/0 (socket says 172.21.15.50:59966) 2024-09-11T22:14:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdebfff640 1 -- 172.21.15.50:0/1912189421 learned_addr learned my addr 172.21.15.50:0/1912189421 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdeb7fe640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdec072e60 0x7efdec15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdf0e54640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdec15b400 0x7efdec1ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdebfff640 1 -- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdec15b400 msgr2=0x7efdec1ef270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdebfff640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdec15b400 0x7efdec1ef270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdebfff640 1 -- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdec072e60 msgr2=0x7efdec15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdebfff640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdec072e60 0x7efdec15dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.670+0000 7efdebfff640 1 -- 172.21.15.50:0/1912189421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdec1f5960 con 0x7efdec06e0f0 2024-09-11T22:14:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.671+0000 7efdebfff640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdec06e0f0 0x7efdec0b1e50 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efddc00d5d0 tx=0x7efddc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.671+0000 7efde8ff9640 1 -- 172.21.15.50:0/1912189421 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc0125f0 con 0x7efdec06e0f0 2024-09-11T22:14:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.671+0000 7efde8ff9640 1 -- 172.21.15.50:0/1912189421 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efddc019070 con 0x7efdec06e0f0 2024-09-11T22:14:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.671+0000 7efdf28b7640 1 -- 172.21.15.50:0/1912189421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdec1f5c40 con 0x7efdec06e0f0 2024-09-11T22:14:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.671+0000 7efde8ff9640 1 -- 172.21.15.50:0/1912189421 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc0129f0 con 0x7efdec06e0f0 2024-09-11T22:14:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.671+0000 7efdf28b7640 1 -- 172.21.15.50:0/1912189421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdec1f6200 con 0x7efdec06e0f0 2024-09-11T22:14:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.672+0000 7efdf28b7640 1 -- 172.21.15.50:0/1912189421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdec0711c0 con 0x7efdec06e0f0 2024-09-11T22:14:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.672+0000 7efde8ff9640 1 -- 172.21.15.50:0/1912189421 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efddc012b90 con 0x7efdec06e0f0 2024-09-11T22:14:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.673+0000 7efde8ff9640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efdd806be30 0x7efdd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.673+0000 7efde8ff9640 1 -- 172.21.15.50:0/1912189421 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5967+0+0 (secure 0 0 0) 0x7efddc08b290 con 0x7efdec06e0f0 2024-09-11T22:14:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.673+0000 7efdeb7fe640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efdd806be30 0x7efdd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.673+0000 7efdeb7fe640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efdd806be30 0x7efdd806e2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efdec159f90 tx=0x7efde0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.677+0000 7efde8ff9640 1 -- 172.21.15.50:0/1912189421 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efddc0594e0 con 0x7efdec06e0f0 2024-09-11T22:14:55.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:55.889+0000 7efdf28b7640 1 -- 172.21.15.50:0/1912189421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7efdec06c030 con 0x7efdec06e0f0 2024-09-11T22:14:56.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.543+0000 7efde8ff9640 1 -- 172.21.15.50:0/1912189421 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) ==== 104+0+0 (secure 0 0 0) 0x7efddc05d7e0 con 0x7efdec06e0f0 2024-09-11T22:14:56.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.545+0000 7efdf28b7640 1 -- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efdd806be30 msgr2=0x7efdd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.545+0000 7efdf28b7640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efdd806be30 0x7efdd806e2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efdec159f90 tx=0x7efde0009040 comp rx=0 tx=0).stop 2024-09-11T22:14:56.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.545+0000 7efdf28b7640 1 -- 172.21.15.50:0/1912189421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdec06e0f0 msgr2=0x7efdec0b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.545+0000 7efdf28b7640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdec06e0f0 0x7efdec0b1e50 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efddc00d5d0 tx=0x7efddc00da90 comp rx=0 tx=0).stop 2024-09-11T22:14:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.545+0000 7efdf28b7640 1 -- 172.21.15.50:0/1912189421 shutdown_connections 2024-09-11T22:14:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.545+0000 7efdf28b7640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efdd806be30 0x7efdd806e2f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.545+0000 7efdf28b7640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdec15b400 0x7efdec1ef270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.545+0000 7efdf28b7640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdec072e60 0x7efdec15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.545+0000 7efdf28b7640 1 --2- 172.21.15.50:0/1912189421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdec06e0f0 0x7efdec0b1e50 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.545+0000 7efdf28b7640 1 -- 172.21.15.50:0/1912189421 >> 172.21.15.50:0/1912189421 conn(0x7efdec0679c0 msgr2=0x7efdec159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.546+0000 7efdf28b7640 1 -- 172.21.15.50:0/1912189421 shutdown_connections 2024-09-11T22:14:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.546+0000 7efdf28b7640 1 -- 172.21.15.50:0/1912189421 wait complete. 2024-09-11T22:14:56.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:14:56.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.713+0000 7f30e13a6640 1 Processor -- start 2024-09-11T22:14:56.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.713+0000 7f30e13a6640 1 -- start start 2024-09-11T22:14:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.714+0000 7f30e13a6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30dc0cff00 0x7f30dc0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.714+0000 7f30e13a6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30dc0b4e90 0x7f30dc06e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.714+0000 7f30e13a6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30dc0b53a0 con 0x7f30dc06e6a0 2024-09-11T22:14:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.714+0000 7f30e13a6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f30dc06eaf0 con 0x7f30dc0b4e90 2024-09-11T22:14:56.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.714+0000 7f30e13a6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f30dc0b5680 con 0x7f30dc0cff00 2024-09-11T22:14:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.714+0000 7f30da7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30dc0b4e90 0x7f30dc06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.714+0000 7f30db7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f30dc06e6a0 0x7f30dc15ef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48474/0 (socket says 172.21.15.50:48474) 2024-09-11T22:14:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.714+0000 7f30db7fe640 1 -- 172.21.15.50:0/3875788941 learned_addr learned my addr 172.21.15.50:0/3875788941 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.714+0000 7f30daffd640 1 --2- 172.21.15.50:0/3875788941 >> v2:172.21.15.77:3300/0 conn(0x7f30dc0cff00 0x7f30dc0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.715+0000 7f30da7fc640 1 -- 172.21.15.50:0/3875788941 >> v2:172.21.15.77:3300/0 conn(0x7f30dc0cff00 msgr2=0x7f30dc0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.715+0000 7f30da7fc640 1 --2- 172.21.15.50:0/3875788941 >> v2:172.21.15.77:3300/0 conn(0x7f30dc0cff00 0x7f30dc0b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.715+0000 7f30da7fc640 1 -- 172.21.15.50:0/3875788941 >> v1:172.21.15.50:6789/0 conn(0x7f30dc06e6a0 legacy=0x7f30dc15ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.715+0000 7f30d9ffb640 1 -- 172.21.15.50:0/3875788941 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990958387 0 0) 0x7f30dc0b53a0 con 0x7f30dc06e6a0 2024-09-11T22:14:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.715+0000 7f30da7fc640 1 -- 172.21.15.50:0/3875788941 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc15cc60 con 0x7f30dc0b4e90 2024-09-11T22:14:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.715+0000 7f30da7fc640 1 --2- 172.21.15.50:0/3875788941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc0b4e90 0x7f30dc06e160 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f30dc06ca70 tx=0x7f30c402c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796036e551e91396 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.715+0000 7f30d9ffb640 1 -- 172.21.15.50:0/3875788941 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4032770 con 0x7f30dc0b4e90 2024-09-11T22:14:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.715+0000 7f30d9ffb640 1 -- 172.21.15.50:0/3875788941 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c4038070 con 0x7f30dc0b4e90 2024-09-11T22:14:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.715+0000 7f30d9ffb640 1 -- 172.21.15.50:0/3875788941 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4032b30 con 0x7f30dc0b4e90 2024-09-11T22:14:56.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.716+0000 7f30e13a6640 1 -- 172.21.15.50:0/3875788941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc0b4e90 msgr2=0x7f30dc06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.716+0000 7f30e13a6640 1 --2- 172.21.15.50:0/3875788941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc0b4e90 0x7f30dc06e160 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f30dc06ca70 tx=0x7f30c402c870 comp rx=0 tx=0).stop 2024-09-11T22:14:56.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.716+0000 7f30e13a6640 1 -- 172.21.15.50:0/3875788941 shutdown_connections 2024-09-11T22:14:56.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.716+0000 7f30e13a6640 1 --2- 172.21.15.50:0/3875788941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc0b4e90 0x7f30dc06e160 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.716+0000 7f30e13a6640 1 --2- 172.21.15.50:0/3875788941 >> v2:172.21.15.77:3300/0 conn(0x7f30dc0cff00 0x7f30dc0b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.716+0000 7f30e13a6640 1 -- 172.21.15.50:0/3875788941 >> 172.21.15.50:0/3875788941 conn(0x7f30dc075270 msgr2=0x7f30dc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:56.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.716+0000 7f30e13a6640 1 -- 172.21.15.50:0/3875788941 shutdown_connections 2024-09-11T22:14:56.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.716+0000 7f30e13a6640 1 -- 172.21.15.50:0/3875788941 wait complete. 2024-09-11T22:14:56.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.717+0000 7f30e13a6640 1 Processor -- start 2024-09-11T22:14:56.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.717+0000 7f30e13a6640 1 -- start start 2024-09-11T22:14:56.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.718+0000 7f30e13a6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30dc06e6a0 0x7f30dc0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.718+0000 7f30e13a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc0b4e90 0x7f30dc153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.718+0000 7f30e13a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30dc0cff00 0x7f30dc145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.718+0000 7f30e13a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc15bbc0 con 0x7f30dc0b4e90 2024-09-11T22:14:56.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.718+0000 7f30e13a6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc0d02e0 con 0x7f30dc0cff00 2024-09-11T22:14:56.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.718+0000 7f30e13a6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f30dc15e470 con 0x7f30dc06e6a0 2024-09-11T22:14:56.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.718+0000 7f30da7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc0b4e90 0x7f30dc153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.718+0000 7f30da7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc0b4e90 0x7f30dc153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59986/0 (socket says 172.21.15.50:59986) 2024-09-11T22:14:56.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.718+0000 7f30da7fc640 1 -- 172.21.15.50:0/2700322533 learned_addr learned my addr 172.21.15.50:0/2700322533 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:56.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.718+0000 7f30db7fe640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30dc0cff00 0x7f30dc145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.718+0000 7f30daffd640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30dc06e6a0 0x7f30dc0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.719+0000 7f30da7fc640 1 -- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30dc06e6a0 msgr2=0x7f30dc0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.719+0000 7f30da7fc640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30dc06e6a0 0x7f30dc0cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.719+0000 7f30da7fc640 1 -- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30dc0cff00 msgr2=0x7f30dc145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:56.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.719+0000 7f30da7fc640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30dc0cff00 0x7f30dc145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:56.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.719+0000 7f30da7fc640 1 -- 172.21.15.50:0/2700322533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc154c00 con 0x7f30dc0b4e90 2024-09-11T22:14:56.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.719+0000 7f30db7fe640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30dc0cff00 0x7f30dc145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:56.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.719+0000 7f30da7fc640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc0b4e90 0x7f30dc153300 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f30c4000c00 tx=0x7f30c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:56.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.719+0000 7f30d37fe640 1 -- 172.21.15.50:0/2700322533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4004230 con 0x7f30dc0b4e90 2024-09-11T22:14:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.719+0000 7f30d37fe640 1 -- 172.21.15.50:0/2700322533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c40043d0 con 0x7f30dc0b4e90 2024-09-11T22:14:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.719+0000 7f30e13a6640 1 -- 172.21.15.50:0/2700322533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30dc153b60 con 0x7f30dc0b4e90 2024-09-11T22:14:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.719+0000 7f30d37fe640 1 -- 172.21.15.50:0/2700322533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c403d8f0 con 0x7f30dc0b4e90 2024-09-11T22:14:56.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.719+0000 7f30e13a6640 1 -- 172.21.15.50:0/2700322533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30dc154400 con 0x7f30dc0b4e90 2024-09-11T22:14:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.720+0000 7f30e13a6640 1 -- 172.21.15.50:0/2700322533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30dc06e160 con 0x7f30dc0b4e90 2024-09-11T22:14:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.721+0000 7f30d37fe640 1 -- 172.21.15.50:0/2700322533 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30c4032070 con 0x7f30dc0b4e90 2024-09-11T22:14:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.721+0000 7f30d37fe640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f30bc06be30 0x7f30bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.721+0000 7f30d37fe640 1 -- 172.21.15.50:0/2700322533 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5967+0+0 (secure 0 0 0) 0x7f30c40abaa0 con 0x7f30dc0b4e90 2024-09-11T22:14:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.721+0000 7f30daffd640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f30bc06be30 0x7f30bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:56.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.722+0000 7f30daffd640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f30bc06be30 0x7f30bc06e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0073f0 tx=0x7f30cc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.726+0000 7f30d37fe640 1 -- 172.21.15.50:0/2700322533 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f30c4049e90 con 0x7f30dc0b4e90 2024-09-11T22:14:56.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:56.901+0000 7f30e13a6640 1 -- 172.21.15.50:0/2700322533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f30dc151480 con 0x7f30dc0b4e90 2024-09-11T22:14:57.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.544+0000 7f30d37fe640 1 -- 172.21.15.50:0/2700322533 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v65) ==== 181+0+0 (secure 0 0 0) 0x7f30c4079c70 con 0x7f30dc0b4e90 2024-09-11T22:14:57.545 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:14:57.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.548+0000 7f30e13a6640 1 -- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f30bc06be30 msgr2=0x7f30bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.548+0000 7f30e13a6640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f30bc06be30 0x7f30bc06e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0073f0 tx=0x7f30cc00b040 comp rx=0 tx=0).stop 2024-09-11T22:14:57.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.548+0000 7f30e13a6640 1 -- 172.21.15.50:0/2700322533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc0b4e90 msgr2=0x7f30dc153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.548+0000 7f30e13a6640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc0b4e90 0x7f30dc153300 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f30c4000c00 tx=0x7f30c4004730 comp rx=0 tx=0).stop 2024-09-11T22:14:57.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.549+0000 7f30e13a6640 1 -- 172.21.15.50:0/2700322533 shutdown_connections 2024-09-11T22:14:57.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.549+0000 7f30e13a6640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f30bc06be30 0x7f30bc06e2f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.549+0000 7f30e13a6640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30dc0cff00 0x7f30dc145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.549+0000 7f30e13a6640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30dc0b4e90 0x7f30dc153300 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.549+0000 7f30e13a6640 1 --2- 172.21.15.50:0/2700322533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30dc06e6a0 0x7f30dc0cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.549+0000 7f30e13a6640 1 -- 172.21.15.50:0/2700322533 >> 172.21.15.50:0/2700322533 conn(0x7f30dc075270 msgr2=0x7f30dc1519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:57.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.549+0000 7f30e13a6640 1 -- 172.21.15.50:0/2700322533 shutdown_connections 2024-09-11T22:14:57.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.549+0000 7f30e13a6640 1 -- 172.21.15.50:0/2700322533 wait complete. 2024-09-11T22:14:57.565 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:14:57.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.678+0000 7fb637ca4640 1 Processor -- start 2024-09-11T22:14:57.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.678+0000 7fb637ca4640 1 -- start start 2024-09-11T22:14:57.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.679+0000 7fb637ca4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6300cf790 0x7fb6300b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.679+0000 7fb637ca4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6300d11d0 0x7fb6300d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.679+0000 7fb637ca4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb630162110 con 0x7fb630161d30 2024-09-11T22:14:57.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.679+0000 7fb637ca4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb6300d1b80 con 0x7fb6300cf790 2024-09-11T22:14:57.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.679+0000 7fb637ca4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb6300d3450 con 0x7fb6300d11d0 2024-09-11T22:14:57.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.679+0000 7fb63523f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6300cf790 0x7fb6300b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.679+0000 7fb63523f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6300cf790 0x7fb6300b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48482/0 (socket says 172.21.15.50:48482) 2024-09-11T22:14:57.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.679+0000 7fb63523f640 1 -- 172.21.15.50:0/6391445 learned_addr learned my addr 172.21.15.50:0/6391445 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:57.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.679+0000 7fb636241640 1 --2- 172.21.15.50:0/6391445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6300d11d0 0x7fb6300d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.679+0000 7fb63523f640 1 -- 172.21.15.50:0/6391445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6300d11d0 msgr2=0x7fb6300d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:57.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.679+0000 7fb63523f640 1 --2- 172.21.15.50:0/6391445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6300d11d0 0x7fb6300d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.679+0000 7fb63523f640 1 -- 172.21.15.50:0/6391445 >> v1:172.21.15.77:6789/0 conn(0x7fb630161d30 legacy=0x7fb630162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.679+0000 7fb63523f640 1 -- 172.21.15.50:0/6391445 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6300cfd70 con 0x7fb6300cf790 2024-09-11T22:14:57.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.680+0000 7fb63523f640 1 --2- 172.21.15.50:0/6391445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6300cf790 0x7fb6300b78f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb620009870 tx=0x7fb62002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a18aca5ab7c3d00 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:57.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.680+0000 7fb634a3e640 1 -- 172.21.15.50:0/6391445 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620037070 con 0x7fb6300cf790 2024-09-11T22:14:57.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.680+0000 7fb634a3e640 1 -- 172.21.15.50:0/6391445 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb620032440 con 0x7fb6300cf790 2024-09-11T22:14:57.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.680+0000 7fb634a3e640 1 -- 172.21.15.50:0/6391445 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620032810 con 0x7fb6300cf790 2024-09-11T22:14:57.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.681+0000 7fb637ca4640 1 -- 172.21.15.50:0/6391445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6300cf790 msgr2=0x7fb6300b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.681+0000 7fb637ca4640 1 --2- 172.21.15.50:0/6391445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6300cf790 0x7fb6300b78f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb620009870 tx=0x7fb62002a270 comp rx=0 tx=0).stop 2024-09-11T22:14:57.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.681+0000 7fb637ca4640 1 -- 172.21.15.50:0/6391445 shutdown_connections 2024-09-11T22:14:57.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.681+0000 7fb637ca4640 1 --2- 172.21.15.50:0/6391445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6300d11d0 0x7fb6300d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.681+0000 7fb637ca4640 1 --2- 172.21.15.50:0/6391445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6300cf790 0x7fb6300b78f0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.681+0000 7fb637ca4640 1 -- 172.21.15.50:0/6391445 >> 172.21.15.50:0/6391445 conn(0x7fb6300727a0 msgr2=0x7fb6300679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:57.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.681+0000 7fb637ca4640 1 -- 172.21.15.50:0/6391445 shutdown_connections 2024-09-11T22:14:57.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.681+0000 7fb637ca4640 1 -- 172.21.15.50:0/6391445 wait complete. 2024-09-11T22:14:57.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.682+0000 7fb637ca4640 1 Processor -- start 2024-09-11T22:14:57.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.682+0000 7fb637ca4640 1 -- start start 2024-09-11T22:14:57.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb637ca4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6300cf790 0x7fb6301f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb637ca4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6300d11d0 0x7fb6300cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb637ca4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb630161d30 0x7fb630155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb637ca4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6300d2e00 con 0x7fb6300d11d0 2024-09-11T22:14:57.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb637ca4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb6300b7e30 con 0x7fb6300cf790 2024-09-11T22:14:57.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb637ca4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb6300d30e0 con 0x7fb630161d30 2024-09-11T22:14:57.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb63523f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6300d11d0 0x7fb6300cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb63523f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6300d11d0 0x7fb6300cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48484/0 (socket says 172.21.15.50:48484) 2024-09-11T22:14:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb63523f640 1 -- 172.21.15.50:0/76552738 learned_addr learned my addr 172.21.15.50:0/76552738 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb635a40640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6300cf790 0x7fb6301f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb636241640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb630161d30 0x7fb630155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb63523f640 1 -- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb630161d30 msgr2=0x7fb630155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb63523f640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb630161d30 0x7fb630155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb63523f640 1 -- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6300cf790 msgr2=0x7fb6301f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb63523f640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6300cf790 0x7fb6301f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb63523f640 1 -- 172.21.15.50:0/76552738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6301f8120 con 0x7fb6300d11d0 2024-09-11T22:14:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb635a40640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6300cf790 0x7fb6301f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.683+0000 7fb636241640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb630161d30 0x7fb630155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.684+0000 7fb63523f640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6300d11d0 0x7fb6300cd2c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb620000c00 tx=0x7fb6200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.684+0000 7fb6267fc640 1 -- 172.21.15.50:0/76552738 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620041020 con 0x7fb6300d11d0 2024-09-11T22:14:57.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.684+0000 7fb6267fc640 1 -- 172.21.15.50:0/76552738 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6200306c0 con 0x7fb6300d11d0 2024-09-11T22:14:57.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.684+0000 7fb637ca4640 1 -- 172.21.15.50:0/76552738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6301f8400 con 0x7fb6300d11d0 2024-09-11T22:14:57.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.684+0000 7fb6267fc640 1 -- 172.21.15.50:0/76552738 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620037040 con 0x7fb6300d11d0 2024-09-11T22:14:57.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.684+0000 7fb637ca4640 1 -- 172.21.15.50:0/76552738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6301f89c0 con 0x7fb6300d11d0 2024-09-11T22:14:57.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.685+0000 7fb637ca4640 1 -- 172.21.15.50:0/76552738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6300b78f0 con 0x7fb6300d11d0 2024-09-11T22:14:57.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.685+0000 7fb6267fc640 1 -- 172.21.15.50:0/76552738 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb620044020 con 0x7fb6300d11d0 2024-09-11T22:14:57.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.686+0000 7fb6267fc640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb61406be30 0x7fb61406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:57.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.686+0000 7fb6267fc640 1 -- 172.21.15.50:0/76552738 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5529+0+0 (secure 0 0 0) 0x7fb6200ab5f0 con 0x7fb6300d11d0 2024-09-11T22:14:57.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.686+0000 7fb635a40640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb61406be30 0x7fb61406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:57.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.687+0000 7fb635a40640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb61406be30 0x7fb61406e2f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb6300cdc10 tx=0x7fb62c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:57.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.690+0000 7fb6267fc640 1 -- 172.21.15.50:0/76552738 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb62004b030 con 0x7fb6300d11d0 2024-09-11T22:14:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:57.866+0000 7fb637ca4640 1 -- 172.21.15.50:0/76552738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb6300d5380 con 0x7fb6300d11d0 2024-09-11T22:14:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.551+0000 7fb6267fc640 1 -- 172.21.15.50:0/76552738 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v66) ==== 169+0+0 (secure 0 0 0) 0x7fb62007a050 con 0x7fb6300d11d0 2024-09-11T22:14:58.554 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:14:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.555+0000 7fb637ca4640 1 -- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb61406be30 msgr2=0x7fb61406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.555+0000 7fb637ca4640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb61406be30 0x7fb61406e2f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb6300cdc10 tx=0x7fb62c009040 comp rx=0 tx=0).stop 2024-09-11T22:14:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.555+0000 7fb637ca4640 1 -- 172.21.15.50:0/76552738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6300d11d0 msgr2=0x7fb6300cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.555+0000 7fb637ca4640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6300d11d0 0x7fb6300cd2c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb620000c00 tx=0x7fb6200046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.556+0000 7fb637ca4640 1 -- 172.21.15.50:0/76552738 shutdown_connections 2024-09-11T22:14:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.556+0000 7fb637ca4640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb61406be30 0x7fb61406e2f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.556+0000 7fb637ca4640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb630161d30 0x7fb630155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.556+0000 7fb637ca4640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6300d11d0 0x7fb6300cd2c0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.556+0000 7fb637ca4640 1 --2- 172.21.15.50:0/76552738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6300cf790 0x7fb6301f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.556+0000 7fb637ca4640 1 -- 172.21.15.50:0/76552738 >> 172.21.15.50:0/76552738 conn(0x7fb6300727a0 msgr2=0x7fb630069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:58.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.556+0000 7fb637ca4640 1 -- 172.21.15.50:0/76552738 shutdown_connections 2024-09-11T22:14:58.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.556+0000 7fb637ca4640 1 -- 172.21.15.50:0/76552738 wait complete. 2024-09-11T22:14:58.573 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-09-11T22:14:58.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.688+0000 7fdfad5bd640 1 Processor -- start 2024-09-11T22:14:58.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.688+0000 7fdfad5bd640 1 -- start start 2024-09-11T22:14:58.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.689+0000 7fdfad5bd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdfa815e9b0 0x7fdfa815f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.689+0000 7fdfad5bd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfa80b6d90 0x7fdfa80b7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.689+0000 7fdfad5bd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfa80b5fd0 con 0x7fdfa806bb50 2024-09-11T22:14:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.689+0000 7fdfad5bd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa80b6900 con 0x7fdfa815e9b0 2024-09-11T22:14:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.689+0000 7fdfad5bd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa80b62b0 con 0x7fdfa80b6d90 2024-09-11T22:14:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.689+0000 7fdfa6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdfa815e9b0 0x7fdfa815f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.689+0000 7fdfa67fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdfa806bb50 0x7fdfa80af3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34506/0 (socket says 172.21.15.50:34506) 2024-09-11T22:14:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.689+0000 7fdfa67fc640 1 -- 172.21.15.50:0/2639655544 learned_addr learned my addr 172.21.15.50:0/2639655544 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.690+0000 7fdfa77fe640 1 --2- 172.21.15.50:0/2639655544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfa80b6d90 0x7fdfa80b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.690+0000 7fdfa6ffd640 1 -- 172.21.15.50:0/2639655544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfa80b6d90 msgr2=0x7fdfa80b7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.690+0000 7fdfa6ffd640 1 --2- 172.21.15.50:0/2639655544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfa80b6d90 0x7fdfa80b7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.690+0000 7fdfa6ffd640 1 -- 172.21.15.50:0/2639655544 >> v1:172.21.15.50:6789/0 conn(0x7fdfa806bb50 legacy=0x7fdfa80af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:58.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.690+0000 7fdfa6ffd640 1 -- 172.21.15.50:0/2639655544 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa80b6590 con 0x7fdfa815e9b0 2024-09-11T22:14:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.690+0000 7fdfa5ffb640 1 -- 172.21.15.50:0/2639655544 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776921387 0 0) 0x7fdfa80b5fd0 con 0x7fdfa806bb50 2024-09-11T22:14:58.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.690+0000 7fdfa77fe640 1 --2- 172.21.15.50:0/2639655544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfa80b6d90 0x7fdfa80b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.690+0000 7fdfa6ffd640 1 --2- 172.21.15.50:0/2639655544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa815e9b0 0x7fdfa815f820 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00097a0 tx=0x7fdfa002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfff9cbd0d1bbd89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.691+0000 7fdfa5ffb640 1 -- 172.21.15.50:0/2639655544 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0037070 con 0x7fdfa815e9b0 2024-09-11T22:14:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.691+0000 7fdfa5ffb640 1 -- 172.21.15.50:0/2639655544 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa0032440 con 0x7fdfa815e9b0 2024-09-11T22:14:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.691+0000 7fdfa5ffb640 1 -- 172.21.15.50:0/2639655544 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0032810 con 0x7fdfa815e9b0 2024-09-11T22:14:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.691+0000 7fdfad5bd640 1 -- 172.21.15.50:0/2639655544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa815e9b0 msgr2=0x7fdfa815f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.691+0000 7fdfad5bd640 1 --2- 172.21.15.50:0/2639655544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa815e9b0 0x7fdfa815f820 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00097a0 tx=0x7fdfa002a180 comp rx=0 tx=0).stop 2024-09-11T22:14:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.691+0000 7fdfad5bd640 1 -- 172.21.15.50:0/2639655544 shutdown_connections 2024-09-11T22:14:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.691+0000 7fdfad5bd640 1 --2- 172.21.15.50:0/2639655544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfa80b6d90 0x7fdfa80b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.691+0000 7fdfad5bd640 1 --2- 172.21.15.50:0/2639655544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa815e9b0 0x7fdfa815f820 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.691+0000 7fdfad5bd640 1 -- 172.21.15.50:0/2639655544 >> 172.21.15.50:0/2639655544 conn(0x7fdfa80b7940 msgr2=0x7fdfa80b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:58.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.691+0000 7fdfad5bd640 1 -- 172.21.15.50:0/2639655544 shutdown_connections 2024-09-11T22:14:58.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.691+0000 7fdfad5bd640 1 -- 172.21.15.50:0/2639655544 wait complete. 2024-09-11T22:14:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.693+0000 7fdfad5bd640 1 Processor -- start 2024-09-11T22:14:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.693+0000 7fdfad5bd640 1 -- start start 2024-09-11T22:14:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.693+0000 7fdfad5bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfa806bb50 0x7fdfa80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.693+0000 7fdfad5bd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa80b6d90 0x7fdfa80cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.693+0000 7fdfad5bd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfa80cceb0 0x7fdfa8162640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.693+0000 7fdfad5bd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa806d310 con 0x7fdfa80b6d90 2024-09-11T22:14:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.693+0000 7fdfad5bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa815feb0 con 0x7fdfa806bb50 2024-09-11T22:14:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.693+0000 7fdfad5bd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa806d490 con 0x7fdfa80cceb0 2024-09-11T22:14:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfa67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa80b6d90 0x7fdfa80cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfa67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa80b6d90 0x7fdfa80cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48510/0 (socket says 172.21.15.50:48510) 2024-09-11T22:14:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfa67fc640 1 -- 172.21.15.50:0/637405508 learned_addr learned my addr 172.21.15.50:0/637405508 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:58.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfa77fe640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfa80cceb0 0x7fdfa8162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfa6ffd640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfa806bb50 0x7fdfa80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfa67fc640 1 -- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfa80cceb0 msgr2=0x7fdfa8162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfa67fc640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfa80cceb0 0x7fdfa8162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfa67fc640 1 -- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfa806bb50 msgr2=0x7fdfa80ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfa67fc640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfa806bb50 0x7fdfa80ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfa67fc640 1 -- 172.21.15.50:0/637405508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa80cc1b0 con 0x7fdfa80b6d90 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfa77fe640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfa80cceb0 0x7fdfa8162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfa6ffd640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfa806bb50 0x7fdfa80ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfa67fc640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa80b6d90 0x7fdfa80cc970 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000c4d0 tx=0x7fdf9000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdf9f7fe640 1 -- 172.21.15.50:0/637405508 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf90018070 con 0x7fdfa80b6d90 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdf9f7fe640 1 -- 172.21.15.50:0/637405508 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf90007500 con 0x7fdfa80b6d90 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfad5bd640 1 -- 172.21.15.50:0/637405508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa8161d40 con 0x7fdfa80b6d90 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdf9f7fe640 1 -- 172.21.15.50:0/637405508 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf90004a20 con 0x7fdfa80b6d90 2024-09-11T22:14:58.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.694+0000 7fdfad5bd640 1 -- 172.21.15.50:0/637405508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa8162300 con 0x7fdfa80b6d90 2024-09-11T22:14:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.695+0000 7fdfad5bd640 1 -- 172.21.15.50:0/637405508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa80693f0 con 0x7fdfa80b6d90 2024-09-11T22:14:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.696+0000 7fdf9f7fe640 1 -- 172.21.15.50:0/637405508 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf9001b070 con 0x7fdfa80b6d90 2024-09-11T22:14:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.696+0000 7fdf9f7fe640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf8806be30 0x7fdf8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.696+0000 7fdf9f7fe640 1 -- 172.21.15.50:0/637405508 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5115+0+0 (secure 0 0 0) 0x7fdf90089f70 con 0x7fdfa80b6d90 2024-09-11T22:14:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.696+0000 7fdfa6ffd640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf8806be30 0x7fdf8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.697+0000 7fdfa6ffd640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf8806be30 0x7fdf8806e2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0034000 tx=0x7fdfa002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.701+0000 7fdf9f7fe640 1 -- 172.21.15.50:0/637405508 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdfa80693f0 con 0x7fdfa80b6d90 2024-09-11T22:14:58.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.875+0000 7fdfad5bd640 1 -- 172.21.15.50:0/637405508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7fdfa80b74f0 con 0x7fdfa80b6d90 2024-09-11T22:14:58.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.878+0000 7fdf9f7fe640 1 -- 172.21.15.50:0/637405508 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v20) ==== 101+0+0 (secure 0 0 0) 0x7fdf90058b60 con 0x7fdfa80b6d90 2024-09-11T22:14:58.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.880+0000 7fdfad5bd640 1 -- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf8806be30 msgr2=0x7fdf8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:58.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.880+0000 7fdfad5bd640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf8806be30 0x7fdf8806e2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0034000 tx=0x7fdfa002e000 comp rx=0 tx=0).stop 2024-09-11T22:14:58.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.880+0000 7fdfad5bd640 1 -- 172.21.15.50:0/637405508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa80b6d90 msgr2=0x7fdfa80cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:58.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.880+0000 7fdfad5bd640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa80b6d90 0x7fdfa80cc970 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000c4d0 tx=0x7fdf9000c990 comp rx=0 tx=0).stop 2024-09-11T22:14:58.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.880+0000 7fdfad5bd640 1 -- 172.21.15.50:0/637405508 shutdown_connections 2024-09-11T22:14:58.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.880+0000 7fdfad5bd640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf8806be30 0x7fdf8806e2f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.880+0000 7fdfad5bd640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfa80cceb0 0x7fdfa8162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.880+0000 7fdfad5bd640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa80b6d90 0x7fdfa80cc970 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.880+0000 7fdfad5bd640 1 --2- 172.21.15.50:0/637405508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfa806bb50 0x7fdfa80ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:58.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.880+0000 7fdfad5bd640 1 -- 172.21.15.50:0/637405508 >> 172.21.15.50:0/637405508 conn(0x7fdfa80b7940 msgr2=0x7fdfa806fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:58.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.881+0000 7fdfad5bd640 1 -- 172.21.15.50:0/637405508 shutdown_connections 2024-09-11T22:14:58.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.881+0000 7fdfad5bd640 1 -- 172.21.15.50:0/637405508 wait complete. 2024-09-11T22:14:58.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T22:14:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.996+0000 7f11c3f4b640 1 Processor -- start 2024-09-11T22:14:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.996+0000 7f11c3f4b640 1 -- start start 2024-09-11T22:14:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.997+0000 7f11c3f4b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f11bc0735a0 0x7f11bc15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.997+0000 7f11c3f4b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11bc15f0e0 0x7f11bc0728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.997+0000 7f11c3f4b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11bc0b4e80 con 0x7f11bc15c240 2024-09-11T22:14:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.997+0000 7f11c3f4b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f11bc15c620 con 0x7f11bc0735a0 2024-09-11T22:14:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.997+0000 7f11c3f4b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc15f560 con 0x7f11bc15f0e0 2024-09-11T22:14:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.997+0000 7f11c14e6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f11bc0735a0 0x7f11bc15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:58.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.997+0000 7f11c24e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11bc15f0e0 0x7f11bc0728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.998+0000 7f11c1ce7640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f11bc15c240 0x7f11bc0b4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:60286/0 (socket says 172.21.15.50:60286) 2024-09-11T22:14:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.998+0000 7f11c1ce7640 1 -- 172.21.15.50:0/2383615089 learned_addr learned my addr 172.21.15.50:0/2383615089 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.998+0000 7f11c14e6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f11bc0735a0 0x7f11bc15eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:39560/0 (socket says 172.21.15.50:39560) 2024-09-11T22:14:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.998+0000 7f11c24e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11bc15f0e0 0x7f11bc0728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:58702/0 (socket says 172.21.15.50:58702) 2024-09-11T22:14:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.998+0000 7f11c14e6640 1 -- 172.21.15.50:0/2383615089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11bc15f0e0 msgr2=0x7f11bc0728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.998+0000 7f11c14e6640 1 --2- 172.21.15.50:0/2383615089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11bc15f0e0 0x7f11bc0728e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.998+0000 7f11c14e6640 1 -- 172.21.15.50:0/2383615089 >> v1:172.21.15.77:6789/0 conn(0x7f11bc15c240 legacy=0x7f11bc0b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.998+0000 7f11c0ce5640 1 -- 172.21.15.50:0/2383615089 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 26796752 0 0) 0x7f11bc0b4e80 con 0x7f11bc15c240 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.998+0000 7f11c14e6640 1 -- 172.21.15.50:0/2383615089 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc15f840 con 0x7f11bc0735a0 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.998+0000 7f11c24e8640 1 --2- 172.21.15.50:0/2383615089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11bc15f0e0 0x7f11bc0728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.999+0000 7f11c14e6640 1 --2- 172.21.15.50:0/2383615089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0735a0 0x7f11bc15eba0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097a0 tx=0x7f11b002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cd75fd2ac4c223c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.999+0000 7f11c0ce5640 1 -- 172.21.15.50:0/2383615089 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0037070 con 0x7f11bc0735a0 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.999+0000 7f11c0ce5640 1 -- 172.21.15.50:0/2383615089 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b0032440 con 0x7f11bc0735a0 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.999+0000 7f11c0ce5640 1 -- 172.21.15.50:0/2383615089 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0032810 con 0x7f11bc0735a0 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.999+0000 7f11c3f4b640 1 -- 172.21.15.50:0/2383615089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0735a0 msgr2=0x7f11bc15eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.999+0000 7f11c3f4b640 1 --2- 172.21.15.50:0/2383615089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0735a0 0x7f11bc15eba0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097a0 tx=0x7f11b002a180 comp rx=0 tx=0).stop 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.999+0000 7f11c3f4b640 1 -- 172.21.15.50:0/2383615089 shutdown_connections 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.999+0000 7f11c3f4b640 1 --2- 172.21.15.50:0/2383615089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11bc15f0e0 0x7f11bc0728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.999+0000 7f11c3f4b640 1 --2- 172.21.15.50:0/2383615089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0735a0 0x7f11bc15eba0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:58.999+0000 7f11c3f4b640 1 -- 172.21.15.50:0/2383615089 >> 172.21.15.50:0/2383615089 conn(0x7f11bc0b2bd0 msgr2=0x7f11bc0b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.000+0000 7f11c3f4b640 1 -- 172.21.15.50:0/2383615089 shutdown_connections 2024-09-11T22:14:59.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.000+0000 7f11c3f4b640 1 -- 172.21.15.50:0/2383615089 wait complete. 2024-09-11T22:14:59.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.001+0000 7f11c3f4b640 1 Processor -- start 2024-09-11T22:14:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.001+0000 7f11c3f4b640 1 -- start start 2024-09-11T22:14:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c3f4b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11bc0735a0 0x7f11bc161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c3f4b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11bc15c240 0x7f11bc157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c3f4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc15f0e0 0x7f11bc0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c3f4b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc0b4250 con 0x7f11bc15c240 2024-09-11T22:14:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c3f4b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc0b3f70 con 0x7f11bc15f0e0 2024-09-11T22:14:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c3f4b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc072e20 con 0x7f11bc0735a0 2024-09-11T22:14:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c14e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11bc15c240 0x7f11bc157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c14e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11bc15c240 0x7f11bc157740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48520/0 (socket says 172.21.15.50:48520) 2024-09-11T22:14:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c14e6640 1 -- 172.21.15.50:0/4249243015 learned_addr learned my addr 172.21.15.50:0/4249243015 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c24e8640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc15f0e0 0x7f11bc0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c1ce7640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11bc0735a0 0x7f11bc161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c14e6640 1 -- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11bc0735a0 msgr2=0x7f11bc161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c14e6640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11bc0735a0 0x7f11bc161bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c14e6640 1 -- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc15f0e0 msgr2=0x7f11bc0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c14e6640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc15f0e0 0x7f11bc0cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c14e6640 1 -- 172.21.15.50:0/4249243015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc157c80 con 0x7f11bc15c240 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11c14e6640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11bc15c240 0x7f11bc157740 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097a0 tx=0x7f11b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.002+0000 7f11ba7fc640 1 -- 172.21.15.50:0/4249243015 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0037050 con 0x7f11bc15c240 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.003+0000 7f11c3f4b640 1 -- 172.21.15.50:0/4249243015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11bc0cf690 con 0x7f11bc15c240 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.003+0000 7f11ba7fc640 1 -- 172.21.15.50:0/4249243015 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b0038040 con 0x7f11bc15c240 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.003+0000 7f11ba7fc640 1 -- 172.21.15.50:0/4249243015 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0004490 con 0x7f11bc15c240 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.003+0000 7f11c3f4b640 1 -- 172.21.15.50:0/4249243015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11bc1613b0 con 0x7f11bc15c240 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.003+0000 7f11c3f4b640 1 -- 172.21.15.50:0/4249243015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11bc15eba0 con 0x7f11bc15c240 2024-09-11T22:14:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.004+0000 7f11ba7fc640 1 -- 172.21.15.50:0/4249243015 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11b003c6d0 con 0x7f11bc15c240 2024-09-11T22:14:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.004+0000 7f11ba7fc640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f11a806be30 0x7f11a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.005+0000 7f11ba7fc640 1 -- 172.21.15.50:0/4249243015 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5115+0+0 (secure 0 0 0) 0x7f11b00ab4a0 con 0x7f11bc15c240 2024-09-11T22:14:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.005+0000 7f11c1ce7640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f11a806be30 0x7f11a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.005+0000 7f11c1ce7640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f11a806be30 0x7f11a806e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0012e0 tx=0x7f11ac001700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:59.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.009+0000 7f11ba7fc640 1 -- 172.21.15.50:0/4249243015 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11b0079a60 con 0x7f11bc15c240 2024-09-11T22:14:59.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.185+0000 7f11c3f4b640 1 -- 172.21.15.50:0/4249243015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f11bc0b2500 con 0x7f11bc15c240 2024-09-11T22:14:59.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.188+0000 7f11ba7fc640 1 -- 172.21.15.50:0/4249243015 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f11b007dd60 con 0x7f11bc15c240 2024-09-11T22:14:59.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.190+0000 7f11c3f4b640 1 -- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f11a806be30 msgr2=0x7f11a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.190+0000 7f11c3f4b640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f11a806be30 0x7f11a806e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0012e0 tx=0x7f11ac001700 comp rx=0 tx=0).stop 2024-09-11T22:14:59.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.190+0000 7f11c3f4b640 1 -- 172.21.15.50:0/4249243015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11bc15c240 msgr2=0x7f11bc157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.190+0000 7f11c3f4b640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11bc15c240 0x7f11bc157740 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097a0 tx=0x7f11b00046c0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.190+0000 7f11c3f4b640 1 -- 172.21.15.50:0/4249243015 shutdown_connections 2024-09-11T22:14:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.190+0000 7f11c3f4b640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f11a806be30 0x7f11a806e2f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.190+0000 7f11c3f4b640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc15f0e0 0x7f11bc0cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.190+0000 7f11c3f4b640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11bc15c240 0x7f11bc157740 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.190+0000 7f11c3f4b640 1 --2- 172.21.15.50:0/4249243015 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11bc0735a0 0x7f11bc161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.190+0000 7f11c3f4b640 1 -- 172.21.15.50:0/4249243015 >> 172.21.15.50:0/4249243015 conn(0x7f11bc0b2bd0 msgr2=0x7f11bc0b4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.190+0000 7f11c3f4b640 1 -- 172.21.15.50:0/4249243015 shutdown_connections 2024-09-11T22:14:59.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.190+0000 7f11c3f4b640 1 -- 172.21.15.50:0/4249243015 wait complete. 2024-09-11T22:14:59.204 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_size 2024-09-11T22:14:59.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.306+0000 7f5de7b49640 1 Processor -- start 2024-09-11T22:14:59.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.306+0000 7f5de7b49640 1 -- start start 2024-09-11T22:14:59.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.307+0000 7f5de7b49640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de0162a60 0x7f5de00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.307+0000 7f5de7b49640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de0163080 con 0x7f5de015e8e0 2024-09-11T22:14:59.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.307+0000 7f5de7b49640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de00d2d20 con 0x7f5de00d1c90 2024-09-11T22:14:59.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.307+0000 7f5de7b49640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5de015ecc0 con 0x7f5de0162a60 2024-09-11T22:14:59.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.307+0000 7f5de58e5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5de015e8e0 0x7f5de00d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34522/0 (socket says 172.21.15.50:34522) 2024-09-11T22:14:59.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.307+0000 7f5de58e5640 1 -- 172.21.15.50:0/3839393483 learned_addr learned my addr 172.21.15.50:0/3839393483 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de60e6640 1 --2- 172.21.15.50:0/3839393483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de0162a60 0x7f5de00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926717658 0 0) 0x7f5de0163080 con 0x7f5de015e8e0 2024-09-11T22:14:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dc8003520 con 0x7f5de015e8e0 2024-09-11T22:14:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 98535788 0 0) 0x7f5dc8003520 con 0x7f5de015e8e0 2024-09-11T22:14:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de0162a60 msgr2=0x7f5de00b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 --2- 172.21.15.50:0/3839393483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de0162a60 0x7f5de00b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 >> v1:172.21.15.77:6789/0 conn(0x7f5de00d1c90 legacy=0x7f5de0162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de00d3000 con 0x7f5de015e8e0 2024-09-11T22:14:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f5dd00019f0 con 0x7f5de015e8e0 2024-09-11T22:14:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 >> v1:172.21.15.50:6789/0 conn(0x7f5de015e8e0 legacy=0x7f5de00d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 --2- 172.21.15.50:0/3839393483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de0162a60 0x7f5dc80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 --2- 172.21.15.50:0/3839393483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dc8003f20 0x7f5dc8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 --2- 172.21.15.50:0/3839393483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dc8004d40 0x7f5dc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc800b9f0 con 0x7f5dc8003f20 2024-09-11T22:14:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc800bba0 con 0x7f5dc8004d40 2024-09-11T22:14:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc800bda0 con 0x7f5de0162a60 2024-09-11T22:14:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de50e4640 1 --2- 172.21.15.50:0/3839393483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dc8003f20 0x7f5dc8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de58e5640 1 --2- 172.21.15.50:0/3839393483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de0162a60 0x7f5dc80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de60e6640 1 --2- 172.21.15.50:0/3839393483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dc8004d40 0x7f5dc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de50e4640 1 -- 172.21.15.50:0/3839393483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de0162a60 msgr2=0x7f5dc80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de50e4640 1 --2- 172.21.15.50:0/3839393483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de0162a60 0x7f5dc80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de50e4640 1 -- 172.21.15.50:0/3839393483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dc8004d40 msgr2=0x7f5dc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de50e4640 1 --2- 172.21.15.50:0/3839393483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dc8004d40 0x7f5dc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.308+0000 7f5de50e4640 1 -- 172.21.15.50:0/3839393483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc8003520 con 0x7f5dc8003f20 2024-09-11T22:14:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.309+0000 7f5de50e4640 1 --2- 172.21.15.50:0/3839393483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dc8003f20 0x7f5dc8004800 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4001860 tx=0x7f5dc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffaf69d8ac04142 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.309+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4037070 con 0x7f5dc8003f20 2024-09-11T22:14:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.309+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd402ab60 con 0x7f5dc8003f20 2024-09-11T22:14:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.309+0000 7f5de48e3640 1 -- 172.21.15.50:0/3839393483 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4001430 con 0x7f5dc8003f20 2024-09-11T22:14:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.310+0000 7f5de7b49640 1 -- 172.21.15.50:0/3839393483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dc8003f20 msgr2=0x7f5dc8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.310+0000 7f5de7b49640 1 --2- 172.21.15.50:0/3839393483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dc8003f20 0x7f5dc8004800 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4001860 tx=0x7f5dc8005830 comp rx=0 tx=0).stop 2024-09-11T22:14:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.310+0000 7f5de60e6640 1 -- 172.21.15.50:0/3839393483 reap_dead start 2024-09-11T22:14:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.310+0000 7f5de7b49640 1 -- 172.21.15.50:0/3839393483 shutdown_connections 2024-09-11T22:14:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.310+0000 7f5de7b49640 1 -- 172.21.15.50:0/3839393483 >> 172.21.15.50:0/3839393483 conn(0x7f5de0067ba0 msgr2=0x7f5de0067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.310+0000 7f5de7b49640 1 -- 172.21.15.50:0/3839393483 shutdown_connections 2024-09-11T22:14:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.310+0000 7f5de7b49640 1 -- 172.21.15.50:0/3839393483 wait complete. 2024-09-11T22:14:59.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.311+0000 7f5de7b49640 1 Processor -- start 2024-09-11T22:14:59.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.311+0000 7f5de7b49640 1 -- start start 2024-09-11T22:14:59.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de7b49640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dc8003f20 0x7f5de0156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de7b49640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de01614f0 0x7f5de015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de7b49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de0161970 0x7f5de015c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de7b49640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5de00b7c50 con 0x7f5de0161970 2024-09-11T22:14:59.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de7b49640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5de00b7ad0 con 0x7f5dc8003f20 2024-09-11T22:14:59.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de7b49640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5de00d2ad0 con 0x7f5de01614f0 2024-09-11T22:14:59.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de60e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de0161970 0x7f5de015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de60e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de0161970 0x7f5de015c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48528/0 (socket says 172.21.15.50:48528) 2024-09-11T22:14:59.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de60e6640 1 -- 172.21.15.50:0/3149260233 learned_addr learned my addr 172.21.15.50:0/3149260233 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:59.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de58e5640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dc8003f20 0x7f5de0156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de50e4640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de01614f0 0x7f5de015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de60e6640 1 -- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de01614f0 msgr2=0x7f5de015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de60e6640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de01614f0 0x7f5de015bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de60e6640 1 -- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dc8003f20 msgr2=0x7f5de0156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de60e6640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dc8003f20 0x7f5de0156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.312+0000 7f5de60e6640 1 -- 172.21.15.50:0/3149260233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de0160c30 con 0x7f5de0161970 2024-09-11T22:14:59.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.313+0000 7f5de60e6640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de0161970 0x7f5de015c230 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8011860 tx=0x7f5dd8011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:59.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.313+0000 7f5dde7fc640 1 -- 172.21.15.50:0/3149260233 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8019020 con 0x7f5de0161970 2024-09-11T22:14:59.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.313+0000 7f5dde7fc640 1 -- 172.21.15.50:0/3149260233 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd8004240 con 0x7f5de0161970 2024-09-11T22:14:59.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.313+0000 7f5de7b49640 1 -- 172.21.15.50:0/3149260233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de01600b0 con 0x7f5de0161970 2024-09-11T22:14:59.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.313+0000 7f5dde7fc640 1 -- 172.21.15.50:0/3149260233 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800f740 con 0x7f5de0161970 2024-09-11T22:14:59.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.313+0000 7f5de7b49640 1 -- 172.21.15.50:0/3149260233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de0160670 con 0x7f5de0161970 2024-09-11T22:14:59.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.314+0000 7f5de7b49640 1 -- 172.21.15.50:0/3149260233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de0162350 con 0x7f5de0161970 2024-09-11T22:14:59.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.314+0000 7f5dde7fc640 1 -- 172.21.15.50:0/3149260233 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5dd801c020 con 0x7f5de0161970 2024-09-11T22:14:59.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.315+0000 7f5dde7fc640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5dcc06be30 0x7f5dcc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.315+0000 7f5dde7fc640 1 -- 172.21.15.50:0/3149260233 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5115+0+0 (secure 0 0 0) 0x7f5dd808adc0 con 0x7f5de0161970 2024-09-11T22:14:59.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.315+0000 7f5de58e5640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5dcc06be30 0x7f5dcc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.316+0000 7f5de58e5640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5dcc06be30 0x7f5dcc06e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0001560 tx=0x7f5dd0006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:59.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.319+0000 7f5dde7fc640 1 -- 172.21.15.50:0/3149260233 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5dd8023020 con 0x7f5de0161970 2024-09-11T22:14:59.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.496+0000 7f5de7b49640 1 -- 172.21.15.50:0/3149260233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"} v 0) -- 0x7f5de00ba770 con 0x7f5de0161970 2024-09-11T22:14:59.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.499+0000 7f5dde7fc640 1 -- 172.21.15.50:0/3149260233 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"}]=0 v22) ==== 101+0+0 (secure 0 0 0) 0x7f5dd8059380 con 0x7f5de0161970 2024-09-11T22:14:59.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.501+0000 7f5de7b49640 1 -- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5dcc06be30 msgr2=0x7f5dcc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.501+0000 7f5de7b49640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5dcc06be30 0x7f5dcc06e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0001560 tx=0x7f5dd0006040 comp rx=0 tx=0).stop 2024-09-11T22:14:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.501+0000 7f5de7b49640 1 -- 172.21.15.50:0/3149260233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de0161970 msgr2=0x7f5de015c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.501+0000 7f5de7b49640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de0161970 0x7f5de015c230 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8011860 tx=0x7f5dd8011d20 comp rx=0 tx=0).stop 2024-09-11T22:14:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.501+0000 7f5de7b49640 1 -- 172.21.15.50:0/3149260233 shutdown_connections 2024-09-11T22:14:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.501+0000 7f5de7b49640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5dcc06be30 0x7f5dcc06e2f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.501+0000 7f5de7b49640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de01614f0 0x7f5de015bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.501+0000 7f5de7b49640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de0161970 0x7f5de015c230 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.501+0000 7f5de7b49640 1 --2- 172.21.15.50:0/3149260233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dc8003f20 0x7f5de0156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.501+0000 7f5de7b49640 1 -- 172.21.15.50:0/3149260233 >> 172.21.15.50:0/3149260233 conn(0x7f5de0067ba0 msgr2=0x7f5de0067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.501+0000 7f5de7b49640 1 -- 172.21.15.50:0/3149260233 shutdown_connections 2024-09-11T22:14:59.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.501+0000 7f5de7b49640 1 -- 172.21.15.50:0/3149260233 wait complete. 2024-09-11T22:14:59.514 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_bits 2024-09-11T22:14:59.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.618+0000 7f39cec65640 1 Processor -- start 2024-09-11T22:14:59.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.618+0000 7f39cec65640 1 -- start start 2024-09-11T22:14:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.618+0000 7f39cec65640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f39c815e870 0x7f39c80d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.618+0000 7f39cec65640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39c80d16d0 0x7f39c80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.618+0000 7f39cec65640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39c80d3a30 0x7f39c80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.618+0000 7f39cec65640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f39c80d1b40 con 0x7f39c80d16d0 2024-09-11T22:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39cec65640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f39c80cfa80 con 0x7f39c815e870 2024-09-11T22:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39cec65640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f39c80d3e50 con 0x7f39c80d3a30 2024-09-11T22:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39c7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39c80d16d0 0x7f39c80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39c7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39c80d16d0 0x7f39c80d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48536/0 (socket says 172.21.15.50:48536) 2024-09-11T22:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39c7fff640 1 -- 172.21.15.50:0/3174334734 learned_addr learned my addr 172.21.15.50:0/3174334734 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39cca01640 1 --2- 172.21.15.50:0/3174334734 >> v2:172.21.15.77:3300/0 conn(0x7f39c815e870 0x7f39c80d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39cd202640 1 --2- 172.21.15.50:0/3174334734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39c80d3a30 0x7f39c80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39c7fff640 1 -- 172.21.15.50:0/3174334734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39c80d3a30 msgr2=0x7f39c80b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39c7fff640 1 --2- 172.21.15.50:0/3174334734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39c80d3a30 0x7f39c80b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39c7fff640 1 -- 172.21.15.50:0/3174334734 >> v2:172.21.15.77:3300/0 conn(0x7f39c815e870 msgr2=0x7f39c80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39c7fff640 1 --2- 172.21.15.50:0/3174334734 >> v2:172.21.15.77:3300/0 conn(0x7f39c815e870 0x7f39c80d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39c7fff640 1 -- 172.21.15.50:0/3174334734 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c80d40d0 con 0x7f39c80d16d0 2024-09-11T22:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39cca01640 1 --2- 172.21.15.50:0/3174334734 >> v2:172.21.15.77:3300/0 conn(0x7f39c815e870 0x7f39c80d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.619+0000 7f39cd202640 1 --2- 172.21.15.50:0/3174334734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39c80d3a30 0x7f39c80b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.620+0000 7f39c7fff640 1 --2- 172.21.15.50:0/3174334734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c80d16d0 0x7f39c80d34f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f39c80d4000 tx=0x7f39b002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fe41a103160a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.620+0000 7f39c77fe640 1 -- 172.21.15.50:0/3174334734 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0037070 con 0x7f39c80d16d0 2024-09-11T22:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.620+0000 7f39c77fe640 1 -- 172.21.15.50:0/3174334734 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b0032440 con 0x7f39c80d16d0 2024-09-11T22:14:59.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.620+0000 7f39c77fe640 1 -- 172.21.15.50:0/3174334734 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0032810 con 0x7f39c80d16d0 2024-09-11T22:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.620+0000 7f39cec65640 1 -- 172.21.15.50:0/3174334734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c80d16d0 msgr2=0x7f39c80d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.621+0000 7f39cec65640 1 --2- 172.21.15.50:0/3174334734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c80d16d0 0x7f39c80d34f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f39c80d4000 tx=0x7f39b002a1c0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.621+0000 7f39cec65640 1 -- 172.21.15.50:0/3174334734 shutdown_connections 2024-09-11T22:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.621+0000 7f39cec65640 1 --2- 172.21.15.50:0/3174334734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39c80d3a30 0x7f39c80b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.621+0000 7f39cec65640 1 --2- 172.21.15.50:0/3174334734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c80d16d0 0x7f39c80d34f0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.621+0000 7f39cec65640 1 --2- 172.21.15.50:0/3174334734 >> v2:172.21.15.77:3300/0 conn(0x7f39c815e870 0x7f39c80d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.621+0000 7f39cec65640 1 -- 172.21.15.50:0/3174334734 >> 172.21.15.50:0/3174334734 conn(0x7f39c80727a0 msgr2=0x7f39c80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.621+0000 7f39cec65640 1 -- 172.21.15.50:0/3174334734 shutdown_connections 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.621+0000 7f39cec65640 1 -- 172.21.15.50:0/3174334734 wait complete. 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.622+0000 7f39cec65640 1 Processor -- start 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.622+0000 7f39cec65640 1 -- start start 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cec65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c80d16d0 0x7f39c8150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cec65640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39c80d3a30 0x7f39c81e7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cec65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39c815e870 0x7f39c80ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cec65640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39c80b7ee0 con 0x7f39c80d16d0 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cec65640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f39c80b7c00 con 0x7f39c815e870 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cec65640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f39c815ec50 con 0x7f39c80d3a30 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cca01640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c80d16d0 0x7f39c8150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cca01640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c80d16d0 0x7f39c8150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48538/0 (socket says 172.21.15.50:48538) 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cca01640 1 -- 172.21.15.50:0/750051491 learned_addr learned my addr 172.21.15.50:0/750051491 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cd202640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39c815e870 0x7f39c80ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39c7fff640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39c80d3a30 0x7f39c81e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cca01640 1 -- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39c80d3a30 msgr2=0x7f39c81e7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cca01640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39c80d3a30 0x7f39c81e7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cca01640 1 -- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39c815e870 msgr2=0x7f39c80ab3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cca01640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39c815e870 0x7f39c80ab3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cca01640 1 -- 172.21.15.50:0/750051491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c81e7d80 con 0x7f39c80d16d0 2024-09-11T22:14:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39cca01640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c80d16d0 0x7f39c8150040 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c820 tx=0x7f39b800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.623+0000 7f39c57fa640 1 -- 172.21.15.50:0/750051491 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8015070 con 0x7f39c80d16d0 2024-09-11T22:14:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.624+0000 7f39c57fa640 1 -- 172.21.15.50:0/750051491 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b8007a30 con 0x7f39c80d16d0 2024-09-11T22:14:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.624+0000 7f39cec65640 1 -- 172.21.15.50:0/750051491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c814ccf0 con 0x7f39c80d16d0 2024-09-11T22:14:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.624+0000 7f39c57fa640 1 -- 172.21.15.50:0/750051491 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8007de0 con 0x7f39c80d16d0 2024-09-11T22:14:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.624+0000 7f39cec65640 1 -- 172.21.15.50:0/750051491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c814d2b0 con 0x7f39c80d16d0 2024-09-11T22:14:59.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.625+0000 7f39cec65640 1 -- 172.21.15.50:0/750051491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c80b78b0 con 0x7f39c80d16d0 2024-09-11T22:14:59.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.625+0000 7f39c57fa640 1 -- 172.21.15.50:0/750051491 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39b8018070 con 0x7f39c80d16d0 2024-09-11T22:14:59.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.626+0000 7f39c57fa640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f39a806be30 0x7f39a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.626+0000 7f39c57fa640 1 -- 172.21.15.50:0/750051491 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5115+0+0 (secure 0 0 0) 0x7f39b808ab80 con 0x7f39c80d16d0 2024-09-11T22:14:59.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.626+0000 7f39c7fff640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f39a806be30 0x7f39a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.626+0000 7f39c7fff640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f39a806be30 0x7f39a806e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f39b0034000 tx=0x7f39b002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:59.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.630+0000 7f39c57fa640 1 -- 172.21.15.50:0/750051491 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39b80596e0 con 0x7f39c80d16d0 2024-09-11T22:14:59.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.805+0000 7f39cec65640 1 -- 172.21.15.50:0/750051491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"} v 0) -- 0x7f39c80b3bd0 con 0x7f39c80d16d0 2024-09-11T22:14:59.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.808+0000 7f39c57fa640 1 -- 172.21.15.50:0/750051491 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"}]=0 v23) ==== 101+0+0 (secure 0 0 0) 0x7f39b8058fe0 con 0x7f39c80d16d0 2024-09-11T22:14:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.810+0000 7f39cec65640 1 -- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f39a806be30 msgr2=0x7f39a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.810+0000 7f39cec65640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f39a806be30 0x7f39a806e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f39b0034000 tx=0x7f39b002e000 comp rx=0 tx=0).stop 2024-09-11T22:14:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.810+0000 7f39cec65640 1 -- 172.21.15.50:0/750051491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c80d16d0 msgr2=0x7f39c8150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.810+0000 7f39cec65640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c80d16d0 0x7f39c8150040 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c820 tx=0x7f39b800cce0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.810+0000 7f39cec65640 1 -- 172.21.15.50:0/750051491 shutdown_connections 2024-09-11T22:14:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.810+0000 7f39cec65640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f39a806be30 0x7f39a806e2f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.810+0000 7f39cec65640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39c80d3a30 0x7f39c81e7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.810+0000 7f39cec65640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39c815e870 0x7f39c80ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.810+0000 7f39cec65640 1 --2- 172.21.15.50:0/750051491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c80d16d0 0x7f39c8150040 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.810+0000 7f39cec65640 1 -- 172.21.15.50:0/750051491 >> 172.21.15.50:0/750051491 conn(0x7f39c80727a0 msgr2=0x7f39c8160340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.810+0000 7f39cec65640 1 -- 172.21.15.50:0/750051491 shutdown_connections 2024-09-11T22:14:59.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.810+0000 7f39cec65640 1 -- 172.21.15.50:0/750051491 wait complete. 2024-09-11T22:14:59.824 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-11T22:14:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.924+0000 7f32ea6d7640 1 Processor -- start 2024-09-11T22:14:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.925+0000 7f32ea6d7640 1 -- start start 2024-09-11T22:14:59.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.925+0000 7f32ea6d7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32e40d1c90 0x7f32e40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.925+0000 7f32ea6d7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e4163080 con 0x7f32e415e8e0 2024-09-11T22:14:59.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.925+0000 7f32ea6d7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e40d2d20 con 0x7f32e4162350 2024-09-11T22:14:59.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.925+0000 7f32ea6d7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f32e415ecc0 con 0x7f32e40d1c90 2024-09-11T22:14:59.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f32e415e8e0 0x7f32e40d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34528/0 (socket says 172.21.15.50:34528) 2024-09-11T22:14:59.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e3fff640 1 -- 172.21.15.50:0/4036365336 learned_addr learned my addr 172.21.15.50:0/4036365336 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:14:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32dbfff640 1 --2- 172.21.15.50:0/4036365336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32e40d1c90 0x7f32e40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879625453 0 0) 0x7f32e4163080 con 0x7f32e415e8e0 2024-09-11T22:14:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32d0003520 con 0x7f32e415e8e0 2024-09-11T22:14:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 650773159 0 0) 0x7f32d0003520 con 0x7f32e415e8e0 2024-09-11T22:14:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32e40d1c90 msgr2=0x7f32e40b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 --2- 172.21.15.50:0/4036365336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32e40d1c90 0x7f32e40b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 >> v1:172.21.15.77:6789/0 conn(0x7f32e4162350 legacy=0x7f32e41627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e40d3000 con 0x7f32e415e8e0 2024-09-11T22:14:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f32d4001670 con 0x7f32e415e8e0 2024-09-11T22:14:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 >> v1:172.21.15.50:6789/0 conn(0x7f32e415e8e0 legacy=0x7f32e40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 --2- 172.21.15.50:0/4036365336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32e40d1c90 0x7f32d00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 --2- 172.21.15.50:0/4036365336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32d0003f60 0x7f32d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 --2- 172.21.15.50:0/4036365336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32d0004d40 0x7f32d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f32d000bb00 con 0x7f32d0004d40 2024-09-11T22:14:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f32d000bcb0 con 0x7f32d0003f60 2024-09-11T22:14:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f32d000beb0 con 0x7f32e40d1c90 2024-09-11T22:14:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e8c74640 1 --2- 172.21.15.50:0/4036365336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32d0004d40 0x7f32d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32e3fff640 1 --2- 172.21.15.50:0/4036365336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32e40d1c90 0x7f32d00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.926+0000 7f32dbfff640 1 --2- 172.21.15.50:0/4036365336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32d0003f60 0x7f32d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.927+0000 7f32e8c74640 1 -- 172.21.15.50:0/4036365336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32e40d1c90 msgr2=0x7f32d00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.927+0000 7f32e8c74640 1 --2- 172.21.15.50:0/4036365336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32e40d1c90 0x7f32d00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.927+0000 7f32e8c74640 1 -- 172.21.15.50:0/4036365336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32d0003f60 msgr2=0x7f32d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:14:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.927+0000 7f32e8c74640 1 --2- 172.21.15.50:0/4036365336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32d0003f60 0x7f32d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.927+0000 7f32e8c74640 1 -- 172.21.15.50:0/4036365336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d0003520 con 0x7f32d0004d40 2024-09-11T22:14:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.927+0000 7f32e8c74640 1 --2- 172.21.15.50:0/4036365336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32d0004d40 0x7f32d00051c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f32dc001e50 tx=0x7f32d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2d16c8ebb5794 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.928+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc001a70 con 0x7f32d0004d40 2024-09-11T22:14:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.928+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc003970 con 0x7f32d0004d40 2024-09-11T22:14:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.928+0000 7f32e37fe640 1 -- 172.21.15.50:0/4036365336 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc003d60 con 0x7f32d0004d40 2024-09-11T22:14:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.928+0000 7f32ea6d7640 1 -- 172.21.15.50:0/4036365336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32d0004d40 msgr2=0x7f32d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.928+0000 7f32ea6d7640 1 --2- 172.21.15.50:0/4036365336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32d0004d40 0x7f32d00051c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f32dc001e50 tx=0x7f32d0005830 comp rx=0 tx=0).stop 2024-09-11T22:14:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.928+0000 7f32e8c74640 1 -- 172.21.15.50:0/4036365336 reap_dead start 2024-09-11T22:14:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.928+0000 7f32ea6d7640 1 -- 172.21.15.50:0/4036365336 shutdown_connections 2024-09-11T22:14:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.928+0000 7f32ea6d7640 1 -- 172.21.15.50:0/4036365336 >> 172.21.15.50:0/4036365336 conn(0x7f32e4067ba0 msgr2=0x7f32e4067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:14:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.928+0000 7f32ea6d7640 1 -- 172.21.15.50:0/4036365336 shutdown_connections 2024-09-11T22:14:59.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.928+0000 7f32ea6d7640 1 -- 172.21.15.50:0/4036365336 wait complete. 2024-09-11T22:14:59.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.929+0000 7f32ea6d7640 1 Processor -- start 2024-09-11T22:14:59.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.929+0000 7f32ea6d7640 1 -- start start 2024-09-11T22:14:59.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.930+0000 7f32ea6d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e4158600 0x7f32e41589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.930+0000 7f32ea6d7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32e41471a0 0x7f32e4147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.930+0000 7f32ea6d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32e41f7ad0 0x7f32e41f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.930+0000 7f32ea6d7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f32e40b7c10 con 0x7f32e4158600 2024-09-11T22:14:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.930+0000 7f32ea6d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f32e40b7a90 con 0x7f32e41f7ad0 2024-09-11T22:14:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.930+0000 7f32ea6d7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f32e40d2ad0 con 0x7f32e41471a0 2024-09-11T22:14:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.930+0000 7f32e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e4158600 0x7f32e41589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.930+0000 7f32e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e4158600 0x7f32e41589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48550/0 (socket says 172.21.15.50:48550) 2024-09-11T22:14:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.930+0000 7f32e3fff640 1 -- 172.21.15.50:0/1870595093 learned_addr learned my addr 172.21.15.50:0/1870595093 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:14:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.930+0000 7f32e8c74640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32e41f7ad0 0x7f32e41f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.930+0000 7f32dbfff640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32e41471a0 0x7f32e4147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.931+0000 7f32e3fff640 1 -- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32e41471a0 msgr2=0x7f32e4147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.931+0000 7f32e3fff640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32e41471a0 0x7f32e4147600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.931+0000 7f32e3fff640 1 -- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32e41f7ad0 msgr2=0x7f32e41f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:14:59.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.931+0000 7f32e3fff640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32e41f7ad0 0x7f32e41f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:14:59.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.931+0000 7f32e3fff640 1 -- 172.21.15.50:0/1870595093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e4158f20 con 0x7f32e4158600 2024-09-11T22:14:59.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.931+0000 7f32e3fff640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e4158600 0x7f32e41589e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f32d40072c0 tx=0x7f32d4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.931+0000 7f32e17fa640 1 -- 172.21.15.50:0/1870595093 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d400f8e0 con 0x7f32e4158600 2024-09-11T22:14:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.931+0000 7f32e17fa640 1 -- 172.21.15.50:0/1870595093 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d4018070 con 0x7f32e4158600 2024-09-11T22:14:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.931+0000 7f32ea6d7640 1 -- 172.21.15.50:0/1870595093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e415ab60 con 0x7f32e4158600 2024-09-11T22:14:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.931+0000 7f32e17fa640 1 -- 172.21.15.50:0/1870595093 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d400fce0 con 0x7f32e4158600 2024-09-11T22:14:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.931+0000 7f32ea6d7640 1 -- 172.21.15.50:0/1870595093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e415b120 con 0x7f32e4158600 2024-09-11T22:14:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.932+0000 7f32ea6d7640 1 -- 172.21.15.50:0/1870595093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e40d1580 con 0x7f32e4158600 2024-09-11T22:14:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.932+0000 7f32e17fa640 1 -- 172.21.15.50:0/1870595093 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32d401d460 con 0x7f32e4158600 2024-09-11T22:14:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.933+0000 7f32e17fa640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f32c406be60 0x7f32c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:14:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.933+0000 7f32e17fa640 1 -- 172.21.15.50:0/1870595093 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5115+0+0 (secure 0 0 0) 0x7f32d408acc0 con 0x7f32e4158600 2024-09-11T22:14:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.933+0000 7f32dbfff640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f32c406be60 0x7f32c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:14:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.934+0000 7f32dbfff640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f32c406be60 0x7f32c406e320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f32e4158540 tx=0x7f32cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:14:59.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:14:59.937+0000 7f32e17fa640 1 -- 172.21.15.50:0/1870595093 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32d40598c0 con 0x7f32e4158600 2024-09-11T22:15:00.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.176+0000 7f32ea6d7640 1 -- 172.21.15.50:0/1870595093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7f32e40ba770 con 0x7f32e4158600 2024-09-11T22:15:00.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.554+0000 7f32e17fa640 1 -- 172.21.15.50:0/1870595093 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v197) ==== 151+0+0 (secure 0 0 0) 0x7f32d40591c0 con 0x7f32e4158600 2024-09-11T22:15:00.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.557+0000 7f32ea6d7640 1 -- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f32c406be60 msgr2=0x7f32c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:00.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.557+0000 7f32ea6d7640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f32c406be60 0x7f32c406e320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f32e4158540 tx=0x7f32cc008040 comp rx=0 tx=0).stop 2024-09-11T22:15:00.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.557+0000 7f32ea6d7640 1 -- 172.21.15.50:0/1870595093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e4158600 msgr2=0x7f32e41589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:00.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.557+0000 7f32ea6d7640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e4158600 0x7f32e41589e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f32d40072c0 tx=0x7f32d4007780 comp rx=0 tx=0).stop 2024-09-11T22:15:00.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.557+0000 7f32ea6d7640 1 -- 172.21.15.50:0/1870595093 shutdown_connections 2024-09-11T22:15:00.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.557+0000 7f32ea6d7640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f32c406be60 0x7f32c406e320 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.557+0000 7f32ea6d7640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32e41471a0 0x7f32e4147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.557+0000 7f32ea6d7640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32e41f7ad0 0x7f32e41f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.557+0000 7f32ea6d7640 1 --2- 172.21.15.50:0/1870595093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32e4158600 0x7f32e41589e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.557+0000 7f32ea6d7640 1 -- 172.21.15.50:0/1870595093 >> 172.21.15.50:0/1870595093 conn(0x7f32e4067ba0 msgr2=0x7f32e40b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:00.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.558+0000 7f32ea6d7640 1 -- 172.21.15.50:0/1870595093 shutdown_connections 2024-09-11T22:15:00.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.558+0000 7f32ea6d7640 1 -- 172.21.15.50:0/1870595093 wait complete. 2024-09-11T22:15:00.572 INFO:tasks.cephfs_test_runner:That a directory is merged during scrub. ... ok 2024-09-11T22:15:00.572 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-11T22:15:00.576 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:15:00.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.679+0000 7f81c0e1e640 1 Processor -- start 2024-09-11T22:15:00.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.679+0000 7f81c0e1e640 1 -- start start 2024-09-11T22:15:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81c0e1e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81bc161fa0 0x7f81bc0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81c0e1e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f81bc0b1600 0x7f81bc0cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81c0e1e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81bc0cfbd0 con 0x7f81bc0cf440 2024-09-11T22:15:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81c0e1e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f81bc0cdce0 con 0x7f81bc161fa0 2024-09-11T22:15:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81c0e1e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f81bc0d1220 con 0x7f81bc0b1600 2024-09-11T22:15:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81ba59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81bc161fa0 0x7f81bc0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81bad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f81bc0cf440 0x7f81bc06bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34544/0 (socket says 172.21.15.50:34544) 2024-09-11T22:15:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81bad9d640 1 -- 172.21.15.50:0/4080768057 learned_addr learned my addr 172.21.15.50:0/4080768057 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:00.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81b9d9b640 1 --2- 172.21.15.50:0/4080768057 >> v2:172.21.15.77:3300/0 conn(0x7f81bc0b1600 0x7f81bc0cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:00.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81ba59c640 1 -- 172.21.15.50:0/4080768057 >> v2:172.21.15.77:3300/0 conn(0x7f81bc0b1600 msgr2=0x7f81bc0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:00.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81ba59c640 1 --2- 172.21.15.50:0/4080768057 >> v2:172.21.15.77:3300/0 conn(0x7f81bc0b1600 0x7f81bc0cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81ba59c640 1 -- 172.21.15.50:0/4080768057 >> v1:172.21.15.50:6789/0 conn(0x7f81bc0cf440 legacy=0x7f81bc06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:00.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81ba59c640 1 -- 172.21.15.50:0/4080768057 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc0cfeb0 con 0x7f81bc161fa0 2024-09-11T22:15:00.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.680+0000 7f81b959a640 1 -- 172.21.15.50:0/4080768057 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043507333 0 0) 0x7f81bc0cfbd0 con 0x7f81bc0cf440 2024-09-11T22:15:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.681+0000 7f81ba59c640 1 --2- 172.21.15.50:0/4080768057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81bc161fa0 0x7f81bc0b4d20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f81bc09c280 tx=0x7f81ac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d03d2f8585b67 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.681+0000 7f81b959a640 1 -- 172.21.15.50:0/4080768057 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac037070 con 0x7f81bc161fa0 2024-09-11T22:15:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.681+0000 7f81b959a640 1 -- 172.21.15.50:0/4080768057 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ac032440 con 0x7f81bc161fa0 2024-09-11T22:15:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.681+0000 7f81b959a640 1 -- 172.21.15.50:0/4080768057 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac032810 con 0x7f81bc161fa0 2024-09-11T22:15:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.682+0000 7f81c0e1e640 1 -- 172.21.15.50:0/4080768057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81bc161fa0 msgr2=0x7f81bc0b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:00.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.682+0000 7f81c0e1e640 1 --2- 172.21.15.50:0/4080768057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81bc161fa0 0x7f81bc0b4d20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f81bc09c280 tx=0x7f81ac02a1a0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.682+0000 7f81c0e1e640 1 -- 172.21.15.50:0/4080768057 shutdown_connections 2024-09-11T22:15:00.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.682+0000 7f81c0e1e640 1 --2- 172.21.15.50:0/4080768057 >> v2:172.21.15.77:3300/0 conn(0x7f81bc0b1600 0x7f81bc0cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.682+0000 7f81c0e1e640 1 --2- 172.21.15.50:0/4080768057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81bc161fa0 0x7f81bc0b4d20 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.682+0000 7f81c0e1e640 1 -- 172.21.15.50:0/4080768057 >> 172.21.15.50:0/4080768057 conn(0x7f81bc09ba50 msgr2=0x7f81bc0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:00.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.682+0000 7f81c0e1e640 1 -- 172.21.15.50:0/4080768057 shutdown_connections 2024-09-11T22:15:00.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.682+0000 7f81c0e1e640 1 -- 172.21.15.50:0/4080768057 wait complete. 2024-09-11T22:15:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.683+0000 7f81c0e1e640 1 Processor -- start 2024-09-11T22:15:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.683+0000 7f81c0e1e640 1 -- start start 2024-09-11T22:15:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81c0e1e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc0b1600 0x7f81bc1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81c0e1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81bc0cf440 0x7f81bc0b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81c0e1e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81bc161fa0 0x7f81bc15fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:00.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81c0e1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc0cf870 con 0x7f81bc0cf440 2024-09-11T22:15:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81c0e1e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc0d17e0 con 0x7f81bc0b1600 2024-09-11T22:15:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81c0e1e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f81bc162380 con 0x7f81bc161fa0 2024-09-11T22:15:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81b9d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81bc0cf440 0x7f81bc0b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81b9d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81bc0cf440 0x7f81bc0b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48574/0 (socket says 172.21.15.50:48574) 2024-09-11T22:15:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81b9d9b640 1 -- 172.21.15.50:0/2531034731 learned_addr learned my addr 172.21.15.50:0/2531034731 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81ba59c640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc0b1600 0x7f81bc1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81bad9d640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81bc161fa0 0x7f81bc15fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81b9d9b640 1 -- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81bc161fa0 msgr2=0x7f81bc15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81b9d9b640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81bc161fa0 0x7f81bc15fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81b9d9b640 1 -- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc0b1600 msgr2=0x7f81bc1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81b9d9b640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc0b1600 0x7f81bc1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81b9d9b640 1 -- 172.21.15.50:0/2531034731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc0b2af0 con 0x7f81bc0cf440 2024-09-11T22:15:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81b9d9b640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81bc0cf440 0x7f81bc0b4750 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f81b000d800 tx=0x7f81b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.684+0000 7f81aaffd640 1 -- 172.21.15.50:0/2531034731 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b000b6c0 con 0x7f81bc0cf440 2024-09-11T22:15:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.685+0000 7f81aaffd640 1 -- 172.21.15.50:0/2531034731 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b0019070 con 0x7f81bc0cf440 2024-09-11T22:15:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.685+0000 7f81c0e1e640 1 -- 172.21.15.50:0/2531034731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81bc0b2dd0 con 0x7f81bc0cf440 2024-09-11T22:15:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.685+0000 7f81aaffd640 1 -- 172.21.15.50:0/2531034731 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b000ba80 con 0x7f81bc0cf440 2024-09-11T22:15:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.685+0000 7f81c0e1e640 1 -- 172.21.15.50:0/2531034731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81bc0ca300 con 0x7f81bc0cf440 2024-09-11T22:15:00.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.686+0000 7f81c0e1e640 1 -- 172.21.15.50:0/2531034731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81bc0b2830 con 0x7f81bc0cf440 2024-09-11T22:15:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.686+0000 7f81aaffd640 1 -- 172.21.15.50:0/2531034731 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81b000bc20 con 0x7f81bc0cf440 2024-09-11T22:15:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.686+0000 7f81aaffd640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f819c06be30 0x7f819c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.687+0000 7f81aaffd640 1 -- 172.21.15.50:0/2531034731 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5115+0+0 (secure 0 0 0) 0x7f81b008b0a0 con 0x7f81bc0cf440 2024-09-11T22:15:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.687+0000 7f81ba59c640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f819c06be30 0x7f819c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:00.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.687+0000 7f81ba59c640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f819c06be30 0x7f819c06e2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f81ac034000 tx=0x7f81ac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:00.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.691+0000 7f81aaffd640 1 -- 172.21.15.50:0/2531034731 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81b0059ca0 con 0x7f81bc0cf440 2024-09-11T22:15:00.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.865+0000 7f81c0e1e640 1 -- 172.21.15.50:0/2531034731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81bc0d1c30 con 0x7f81bc0cf440 2024-09-11T22:15:00.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.866+0000 7f81aaffd640 1 -- 172.21.15.50:0/2531034731 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+13256 (secure 0 0 0) 0x7f81b00595a0 con 0x7f81bc0cf440 2024-09-11T22:15:00.869 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:00.869 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":66,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:14:58.545978+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6833/3974105971":"2024-09-12T22:14:55.540991+0000","172.21.15.50:6832/3974105971":"2024-09-12T22:14:55.540991+0000","172.21.15.50:6832/3969515798":"2024-09-12T22:14:41.406550+0000","172.21.15.50:6834/3969515798":"2024-09-12T22:14:41.406550+0000","172.21.15.77:6837/1418437076":"2024-09-12T22:14:40.403866+0000","172.21.15.77:6835/1418437076":"2024-09-12T22:14:40.403866+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:15:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.869+0000 7f81c0e1e640 1 -- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f819c06be30 msgr2=0x7f819c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.869+0000 7f81c0e1e640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f819c06be30 0x7f819c06e2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f81ac034000 tx=0x7f81ac02e000 comp rx=0 tx=0).stop 2024-09-11T22:15:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.869+0000 7f81c0e1e640 1 -- 172.21.15.50:0/2531034731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81bc0cf440 msgr2=0x7f81bc0b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.869+0000 7f81c0e1e640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81bc0cf440 0x7f81bc0b4750 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f81b000d800 tx=0x7f81b000dcc0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.869+0000 7f81c0e1e640 1 -- 172.21.15.50:0/2531034731 shutdown_connections 2024-09-11T22:15:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.869+0000 7f81c0e1e640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f819c06be30 0x7f819c06e2f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.869+0000 7f81c0e1e640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81bc161fa0 0x7f81bc15fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.869+0000 7f81c0e1e640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81bc0cf440 0x7f81bc0b4750 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.869+0000 7f81c0e1e640 1 --2- 172.21.15.50:0/2531034731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc0b1600 0x7f81bc1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.869+0000 7f81c0e1e640 1 -- 172.21.15.50:0/2531034731 >> 172.21.15.50:0/2531034731 conn(0x7f81bc09ba50 msgr2=0x7f81bc0cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.869+0000 7f81c0e1e640 1 -- 172.21.15.50:0/2531034731 shutdown_connections 2024-09-11T22:15:00.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.869+0000 7f81c0e1e640 1 -- 172.21.15.50:0/2531034731 wait complete. 2024-09-11T22:15:00.882 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:11:03.407373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:15:00.882 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:15:00.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.985+0000 7f60aa077640 1 Processor -- start 2024-09-11T22:15:00.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.986+0000 7f60aa077640 1 -- start start 2024-09-11T22:15:00.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.986+0000 7f60aa077640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60a415e870 0x7f60a40d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:00.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.986+0000 7f60aa077640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f60a40d3c00 0x7f60a40b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:00.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.986+0000 7f60aa077640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a40cfa80 con 0x7f60a40d16d0 2024-09-11T22:15:00.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.986+0000 7f60aa077640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f60a40d1b10 con 0x7f60a40d3c00 2024-09-11T22:15:00.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.986+0000 7f60aa077640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f60a40d40d0 con 0x7f60a415e870 2024-09-11T22:15:00.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.986+0000 7f60a3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f60a40d3c00 0x7f60a40b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:00.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.987+0000 7f60a3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f60a40d3c00 0x7f60a40b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48586/0 (socket says 172.21.15.50:48586) 2024-09-11T22:15:00.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.987+0000 7f60a3fff640 1 -- 172.21.15.50:0/3079380947 learned_addr learned my addr 172.21.15.50:0/3079380947 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:00.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.987+0000 7f60a37fe640 1 --2- 172.21.15.50:0/3079380947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60a415e870 0x7f60a40d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:00.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.987+0000 7f60a3fff640 1 -- 172.21.15.50:0/3079380947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60a415e870 msgr2=0x7f60a40d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:00.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.987+0000 7f60a3fff640 1 --2- 172.21.15.50:0/3079380947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60a415e870 0x7f60a40d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.987+0000 7f60a3fff640 1 -- 172.21.15.50:0/3079380947 >> v1:172.21.15.77:6789/0 conn(0x7f60a40d16d0 legacy=0x7f60a40d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:00.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.987+0000 7f60a3fff640 1 -- 172.21.15.50:0/3079380947 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a40d43b0 con 0x7f60a40d3c00 2024-09-11T22:15:00.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.987+0000 7f60a37fe640 1 --2- 172.21.15.50:0/3079380947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60a415e870 0x7f60a40d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:00.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.988+0000 7f60a3fff640 1 --2- 172.21.15.50:0/3079380947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a40d3c00 0x7f60a40b8400 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f609c009e50 tx=0x7f609c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b8b26bb8b3ebbf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:00.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.988+0000 7f60a27fc640 1 -- 172.21.15.50:0/3079380947 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c036070 con 0x7f60a40d3c00 2024-09-11T22:15:00.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.988+0000 7f60a27fc640 1 -- 172.21.15.50:0/3079380947 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609c031600 con 0x7f60a40d3c00 2024-09-11T22:15:00.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.988+0000 7f60a27fc640 1 -- 172.21.15.50:0/3079380947 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c0319d0 con 0x7f60a40d3c00 2024-09-11T22:15:00.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.988+0000 7f60aa077640 1 -- 172.21.15.50:0/3079380947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a40d3c00 msgr2=0x7f60a40b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:00.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.988+0000 7f60aa077640 1 --2- 172.21.15.50:0/3079380947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a40d3c00 0x7f60a40b8400 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f609c009e50 tx=0x7f609c02a710 comp rx=0 tx=0).stop 2024-09-11T22:15:00.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.988+0000 7f60aa077640 1 -- 172.21.15.50:0/3079380947 shutdown_connections 2024-09-11T22:15:00.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.988+0000 7f60aa077640 1 --2- 172.21.15.50:0/3079380947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a40d3c00 0x7f60a40b8400 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.988+0000 7f60aa077640 1 --2- 172.21.15.50:0/3079380947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60a415e870 0x7f60a40d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:00.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.988+0000 7f60aa077640 1 -- 172.21.15.50:0/3079380947 >> 172.21.15.50:0/3079380947 conn(0x7f60a40727a0 msgr2=0x7f60a40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:00.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.988+0000 7f60aa077640 1 -- 172.21.15.50:0/3079380947 shutdown_connections 2024-09-11T22:15:00.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.988+0000 7f60aa077640 1 -- 172.21.15.50:0/3079380947 wait complete. 2024-09-11T22:15:00.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.990+0000 7f60aa077640 1 Processor -- start 2024-09-11T22:15:00.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.990+0000 7f60aa077640 1 -- start start 2024-09-11T22:15:01.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60aa077640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a40d16d0 0x7f60a4154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60aa077640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60a40d3c00 0x7f60a4158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60aa077640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60a415e870 0x7f60a4157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60aa077640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f60a415ec50 con 0x7f60a40d16d0 2024-09-11T22:15:01.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60aa077640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f60a40b7ee0 con 0x7f60a40d3c00 2024-09-11T22:15:01.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60aa077640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f60a40b78b0 con 0x7f60a415e870 2024-09-11T22:15:01.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60a37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a40d16d0 0x7f60a4154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60a37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a40d16d0 0x7f60a4154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48596/0 (socket says 172.21.15.50:48596) 2024-09-11T22:15:01.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60a37fe640 1 -- 172.21.15.50:0/2807884250 learned_addr learned my addr 172.21.15.50:0/2807884250 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:01.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60a3fff640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60a415e870 0x7f60a4157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60a2ffd640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60a40d3c00 0x7f60a4158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60a37fe640 1 -- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60a415e870 msgr2=0x7f60a4157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60a37fe640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60a415e870 0x7f60a4157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60a37fe640 1 -- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60a40d3c00 msgr2=0x7f60a4158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60a37fe640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60a40d3c00 0x7f60a4158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60a37fe640 1 -- 172.21.15.50:0/2807884250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a41598f0 con 0x7f60a40d16d0 2024-09-11T22:15:01.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f60a37fe640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a40d16d0 0x7f60a4154d40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f609400e7e0 tx=0x7f609400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:01.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f608bfff640 1 -- 172.21.15.50:0/2807884250 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609400f040 con 0x7f60a40d16d0 2024-09-11T22:15:01.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.991+0000 7f608bfff640 1 -- 172.21.15.50:0/2807884250 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6094004030 con 0x7f60a40d16d0 2024-09-11T22:15:01.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.992+0000 7f60aa077640 1 -- 172.21.15.50:0/2807884250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a4159bd0 con 0x7f60a40d16d0 2024-09-11T22:15:01.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.992+0000 7f608bfff640 1 -- 172.21.15.50:0/2807884250 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094004400 con 0x7f60a40d16d0 2024-09-11T22:15:01.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.992+0000 7f60aa077640 1 -- 172.21.15.50:0/2807884250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a415a190 con 0x7f60a40d16d0 2024-09-11T22:15:01.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.993+0000 7f60aa077640 1 -- 172.21.15.50:0/2807884250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a40b8400 con 0x7f60a40d16d0 2024-09-11T22:15:01.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.993+0000 7f608bfff640 1 -- 172.21.15.50:0/2807884250 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f609400c6d0 con 0x7f60a40d16d0 2024-09-11T22:15:01.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.994+0000 7f608bfff640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f609006be30 0x7f609006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.994+0000 7f608bfff640 1 -- 172.21.15.50:0/2807884250 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5115+0+0 (secure 0 0 0) 0x7f609408a8c0 con 0x7f60a40d16d0 2024-09-11T22:15:01.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.994+0000 7f60a2ffd640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f609006be30 0x7f609006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.994+0000 7f60a2ffd640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f609006be30 0x7f609006e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f60a40cf7b0 tx=0x7f6098009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:01.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:00.998+0000 7f608bfff640 1 -- 172.21.15.50:0/2807884250 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6094017020 con 0x7f60a40d16d0 2024-09-11T22:15:01.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.172+0000 7f60aa077640 1 -- 172.21.15.50:0/2807884250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f60a415c6e0 con 0x7f60a40d16d0 2024-09-11T22:15:01.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.173+0000 7f608bfff640 1 -- 172.21.15.50:0/2807884250 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) ==== 93+0+10 (secure 0 0 0) 0x7f6094058f00 con 0x7f60a40d16d0 2024-09-11T22:15:01.175 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-11T22:15:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.175+0000 7f60aa077640 1 -- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f609006be30 msgr2=0x7f609006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.175+0000 7f60aa077640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f609006be30 0x7f609006e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f60a40cf7b0 tx=0x7f6098009040 comp rx=0 tx=0).stop 2024-09-11T22:15:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.175+0000 7f60aa077640 1 -- 172.21.15.50:0/2807884250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a40d16d0 msgr2=0x7f60a4154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.175+0000 7f60aa077640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a40d16d0 0x7f60a4154d40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f609400e7e0 tx=0x7f609400eca0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.175+0000 7f60aa077640 1 -- 172.21.15.50:0/2807884250 shutdown_connections 2024-09-11T22:15:01.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.175+0000 7f60aa077640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f609006be30 0x7f609006e2f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.175+0000 7f60aa077640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60a415e870 0x7f60a4157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.175+0000 7f60aa077640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60a40d3c00 0x7f60a4158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.175+0000 7f60aa077640 1 --2- 172.21.15.50:0/2807884250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60a40d16d0 0x7f60a4154d40 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.175+0000 7f60aa077640 1 -- 172.21.15.50:0/2807884250 >> 172.21.15.50:0/2807884250 conn(0x7f60a40727a0 msgr2=0x7f60a40b67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:01.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.175+0000 7f60aa077640 1 -- 172.21.15.50:0/2807884250 shutdown_connections 2024-09-11T22:15:01.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.175+0000 7f60aa077640 1 -- 172.21.15.50:0/2807884250 wait complete. 2024-09-11T22:15:01.188 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-11T22:15:01.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.289+0000 7f7696a7b640 1 Processor -- start 2024-09-11T22:15:01.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.289+0000 7f7696a7b640 1 -- start start 2024-09-11T22:15:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.290+0000 7f7696a7b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76900cf580 0x7f76900b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.290+0000 7f7696a7b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76900cdd50 0x7f769006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.290+0000 7f7696a7b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76900ce5f0 con 0x7f769015e840 2024-09-11T22:15:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.290+0000 7f7696a7b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f769006c240 con 0x7f76900cdd50 2024-09-11T22:15:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.290+0000 7f7696a7b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f76900d0470 con 0x7f76900cf580 2024-09-11T22:15:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.290+0000 7f7695018640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76900cdd50 0x7f769006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.290+0000 7f7695018640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76900cdd50 0x7f769006c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48610/0 (socket says 172.21.15.50:48610) 2024-09-11T22:15:01.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.290+0000 7f7695018640 1 -- 172.21.15.50:0/3267968267 learned_addr learned my addr 172.21.15.50:0/3267968267 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.290+0000 7f768ffff640 1 --2- 172.21.15.50:0/3267968267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76900cf580 0x7f76900b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.290+0000 7f7695018640 1 -- 172.21.15.50:0/3267968267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76900cf580 msgr2=0x7f76900b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.290+0000 7f7695018640 1 --2- 172.21.15.50:0/3267968267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76900cf580 0x7f76900b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.290+0000 7f7695018640 1 -- 172.21.15.50:0/3267968267 >> v1:172.21.15.77:6789/0 conn(0x7f769015e840 legacy=0x7f76900cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:01.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.290+0000 7f7695018640 1 -- 172.21.15.50:0/3267968267 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76900ce310 con 0x7f76900cdd50 2024-09-11T22:15:01.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.291+0000 7f7695018640 1 --2- 172.21.15.50:0/3267968267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76900cdd50 0x7f769006c6d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7688009e50 tx=0x7f768802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bc4d960625fa7b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:01.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.291+0000 7f768f7fe640 1 -- 172.21.15.50:0/3267968267 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7688036070 con 0x7f76900cdd50 2024-09-11T22:15:01.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.291+0000 7f768f7fe640 1 -- 172.21.15.50:0/3267968267 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7688031600 con 0x7f76900cdd50 2024-09-11T22:15:01.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.291+0000 7f768f7fe640 1 -- 172.21.15.50:0/3267968267 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880319d0 con 0x7f76900cdd50 2024-09-11T22:15:01.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.291+0000 7f7696a7b640 1 -- 172.21.15.50:0/3267968267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76900cdd50 msgr2=0x7f769006c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.291+0000 7f7696a7b640 1 --2- 172.21.15.50:0/3267968267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76900cdd50 0x7f769006c6d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7688009e50 tx=0x7f768802a6c0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.292+0000 7f7696a7b640 1 -- 172.21.15.50:0/3267968267 shutdown_connections 2024-09-11T22:15:01.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.292+0000 7f7696a7b640 1 --2- 172.21.15.50:0/3267968267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76900cdd50 0x7f769006c6d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.292+0000 7f7696a7b640 1 --2- 172.21.15.50:0/3267968267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76900cf580 0x7f76900b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.292+0000 7f7696a7b640 1 -- 172.21.15.50:0/3267968267 >> 172.21.15.50:0/3267968267 conn(0x7f76900b4150 msgr2=0x7f76900b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:01.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.292+0000 7f7696a7b640 1 -- 172.21.15.50:0/3267968267 shutdown_connections 2024-09-11T22:15:01.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.292+0000 7f7696a7b640 1 -- 172.21.15.50:0/3267968267 wait complete. 2024-09-11T22:15:01.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.293+0000 7f7696a7b640 1 Processor -- start 2024-09-11T22:15:01.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.293+0000 7f7696a7b640 1 -- start start 2024-09-11T22:15:01.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f7696a7b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76900cdd50 0x7f7690160a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f7696a7b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76900cf580 0x7f76900b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f7696a7b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f769015e840 0x7f76900b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f7696a7b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f769015ec20 con 0x7f76900cf580 2024-09-11T22:15:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f7696a7b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f769006bed0 con 0x7f769015e840 2024-09-11T22:15:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f7696a7b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f769015eda0 con 0x7f76900cdd50 2024-09-11T22:15:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f768ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76900cf580 0x7f76900b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f768ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76900cf580 0x7f76900b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48618/0 (socket says 172.21.15.50:48618) 2024-09-11T22:15:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f768ffff640 1 -- 172.21.15.50:0/92048475 learned_addr learned my addr 172.21.15.50:0/92048475 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f7694817640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76900cdd50 0x7f7690160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f768ffff640 1 -- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76900cdd50 msgr2=0x7f7690160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f768ffff640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76900cdd50 0x7f7690160a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f768ffff640 1 -- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f769015e840 msgr2=0x7f76900b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f7695018640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f769015e840 0x7f76900b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f768ffff640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f769015e840 0x7f76900b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f768ffff640 1 -- 172.21.15.50:0/92048475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7690161950 con 0x7f76900cf580 2024-09-11T22:15:01.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f768ffff640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76900cf580 0x7f76900b0b90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c820 tx=0x7f767c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:01.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f768d7fa640 1 -- 172.21.15.50:0/92048475 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c004030 con 0x7f76900cf580 2024-09-11T22:15:01.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f768d7fa640 1 -- 172.21.15.50:0/92048475 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767c0041d0 con 0x7f76900cf580 2024-09-11T22:15:01.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f768d7fa640 1 -- 172.21.15.50:0/92048475 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c007830 con 0x7f76900cf580 2024-09-11T22:15:01.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.294+0000 7f7696a7b640 1 -- 172.21.15.50:0/92048475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769015bfa0 con 0x7f76900cf580 2024-09-11T22:15:01.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.295+0000 7f7696a7b640 1 -- 172.21.15.50:0/92048475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76900b5730 con 0x7f76900cf580 2024-09-11T22:15:01.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.295+0000 7f7696a7b640 1 -- 172.21.15.50:0/92048475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76900b4c70 con 0x7f76900cf580 2024-09-11T22:15:01.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.296+0000 7f768d7fa640 1 -- 172.21.15.50:0/92048475 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f767c0079d0 con 0x7f76900cf580 2024-09-11T22:15:01.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.297+0000 7f768d7fa640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f767406be30 0x7f767406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.297+0000 7f768d7fa640 1 -- 172.21.15.50:0/92048475 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5115+0+0 (secure 0 0 0) 0x7f767c08aae0 con 0x7f76900cf580 2024-09-11T22:15:01.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.297+0000 7f7694817640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f767406be30 0x7f767406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.297+0000 7f7694817640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f767406be30 0x7f767406e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f768400a750 tx=0x7f7684008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:01.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.301+0000 7f768d7fa640 1 -- 172.21.15.50:0/92048475 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f767c015020 con 0x7f76900cf580 2024-09-11T22:15:01.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.544+0000 7f7696a7b640 1 -- 172.21.15.50:0/92048475 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f76900d1330 con 0x7f76900cf580 2024-09-11T22:15:01.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.560+0000 7f768d7fa640 1 -- 172.21.15.50:0/92048475 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v198) ==== 146+0+0 (secure 0 0 0) 0x7f767c059770 con 0x7f76900cf580 2024-09-11T22:15:01.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.562+0000 7f7696a7b640 1 -- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f767406be30 msgr2=0x7f767406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.562+0000 7f7696a7b640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f767406be30 0x7f767406e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f768400a750 tx=0x7f7684008040 comp rx=0 tx=0).stop 2024-09-11T22:15:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.562+0000 7f7696a7b640 1 -- 172.21.15.50:0/92048475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76900cf580 msgr2=0x7f76900b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.562+0000 7f7696a7b640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76900cf580 0x7f76900b0b90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c820 tx=0x7f767c00cce0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.562+0000 7f7696a7b640 1 -- 172.21.15.50:0/92048475 shutdown_connections 2024-09-11T22:15:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.562+0000 7f7696a7b640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f767406be30 0x7f767406e2f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.562+0000 7f7696a7b640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f769015e840 0x7f76900b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.562+0000 7f7696a7b640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76900cf580 0x7f76900b0b90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.562+0000 7f7696a7b640 1 --2- 172.21.15.50:0/92048475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76900cdd50 0x7f7690160a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.562+0000 7f7696a7b640 1 -- 172.21.15.50:0/92048475 >> 172.21.15.50:0/92048475 conn(0x7f76900b4150 msgr2=0x7f76900d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.562+0000 7f7696a7b640 1 -- 172.21.15.50:0/92048475 shutdown_connections 2024-09-11T22:15:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.562+0000 7f7696a7b640 1 -- 172.21.15.50:0/92048475 wait complete. 2024-09-11T22:15:01.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T22:15:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.677+0000 7fd8dbd31640 1 Processor -- start 2024-09-11T22:15:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.678+0000 7fd8dbd31640 1 -- start start 2024-09-11T22:15:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.678+0000 7fd8dbd31640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8d415e8d0 0x7fd8d40d11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.678+0000 7fd8dbd31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8d40d3bf0 0x7fd8d40b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.678+0000 7fd8dbd31640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8d40d4220 con 0x7fd8d40d1710 2024-09-11T22:15:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.678+0000 7fd8dbd31640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd8d415ecb0 con 0x7fd8d415e8d0 2024-09-11T22:15:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.678+0000 7fd8dbd31640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d40d1b80 con 0x7fd8d40d3bf0 2024-09-11T22:15:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.678+0000 7fd8d9acd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8d415e8d0 0x7fd8d40d11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.679+0000 7fd8d92cc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd8d40d1710 0x7fd8d40d34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34560/0 (socket says 172.21.15.50:34560) 2024-09-11T22:15:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.679+0000 7fd8d92cc640 1 -- 172.21.15.50:0/989718640 learned_addr learned my addr 172.21.15.50:0/989718640 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.679+0000 7fd8d9acd640 1 -- 172.21.15.50:0/989718640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8d40d3bf0 msgr2=0x7fd8d40b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.679+0000 7fd8d9acd640 1 --2- 172.21.15.50:0/989718640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8d40d3bf0 0x7fd8d40b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.679+0000 7fd8d9acd640 1 -- 172.21.15.50:0/989718640 >> v1:172.21.15.50:6789/0 conn(0x7fd8d40d1710 legacy=0x7fd8d40d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.679+0000 7fd8d8acb640 1 -- 172.21.15.50:0/989718640 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2769007800 0 0) 0x7fd8d40d4220 con 0x7fd8d40d1710 2024-09-11T22:15:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.679+0000 7fd8d9acd640 1 -- 172.21.15.50:0/989718640 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d40d4500 con 0x7fd8d415e8d0 2024-09-11T22:15:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.680+0000 7fd8d9acd640 1 --2- 172.21.15.50:0/989718640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d415e8d0 0x7fd8d40d11d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009d90 tx=0x7fd8c402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0c966c36a02209 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.680+0000 7fd8d8acb640 1 -- 172.21.15.50:0/989718640 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4007740 con 0x7fd8d415e8d0 2024-09-11T22:15:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.680+0000 7fd8d8acb640 1 -- 172.21.15.50:0/989718640 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c40078e0 con 0x7fd8d415e8d0 2024-09-11T22:15:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.680+0000 7fd8d8acb640 1 -- 172.21.15.50:0/989718640 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4007cb0 con 0x7fd8d415e8d0 2024-09-11T22:15:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.680+0000 7fd8dbd31640 1 -- 172.21.15.50:0/989718640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d415e8d0 msgr2=0x7fd8d40d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.680+0000 7fd8dbd31640 1 --2- 172.21.15.50:0/989718640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d415e8d0 0x7fd8d40d11d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009d90 tx=0x7fd8c402a660 comp rx=0 tx=0).stop 2024-09-11T22:15:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.680+0000 7fd8dbd31640 1 -- 172.21.15.50:0/989718640 shutdown_connections 2024-09-11T22:15:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.680+0000 7fd8dbd31640 1 --2- 172.21.15.50:0/989718640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8d40d3bf0 0x7fd8d40b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.680+0000 7fd8dbd31640 1 --2- 172.21.15.50:0/989718640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d415e8d0 0x7fd8d40d11d0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.680+0000 7fd8dbd31640 1 -- 172.21.15.50:0/989718640 >> 172.21.15.50:0/989718640 conn(0x7fd8d40727a0 msgr2=0x7fd8d40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.680+0000 7fd8dbd31640 1 -- 172.21.15.50:0/989718640 shutdown_connections 2024-09-11T22:15:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.680+0000 7fd8dbd31640 1 -- 172.21.15.50:0/989718640 wait complete. 2024-09-11T22:15:01.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.682+0000 7fd8dbd31640 1 Processor -- start 2024-09-11T22:15:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.682+0000 7fd8dbd31640 1 -- start start 2024-09-11T22:15:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.682+0000 7fd8dbd31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40d1710 0x7fd8d4160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.682+0000 7fd8dbd31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d40d3bf0 0x7fd8d4160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.682+0000 7fd8dbd31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8d415e8d0 0x7fd8d41f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.682+0000 7fd8dbd31640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d40b7960 con 0x7fd8d40d1710 2024-09-11T22:15:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.682+0000 7fd8dbd31640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d40b77e0 con 0x7fd8d40d3bf0 2024-09-11T22:15:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.682+0000 7fd8dbd31640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d40b8900 con 0x7fd8d415e8d0 2024-09-11T22:15:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.682+0000 7fd8d9acd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40d1710 0x7fd8d4160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.682+0000 7fd8d9acd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40d1710 0x7fd8d4160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48634/0 (socket says 172.21.15.50:48634) 2024-09-11T22:15:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.682+0000 7fd8d9acd640 1 -- 172.21.15.50:0/2322725816 learned_addr learned my addr 172.21.15.50:0/2322725816 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.683+0000 7fd8da2ce640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8d415e8d0 0x7fd8d41f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.683+0000 7fd8d92cc640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d40d3bf0 0x7fd8d4160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.683+0000 7fd8d9acd640 1 -- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8d415e8d0 msgr2=0x7fd8d41f4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.683+0000 7fd8d9acd640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8d415e8d0 0x7fd8d41f4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.683+0000 7fd8d9acd640 1 -- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d40d3bf0 msgr2=0x7fd8d4160880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.683+0000 7fd8d9acd640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d40d3bf0 0x7fd8d4160880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.683+0000 7fd8d9acd640 1 -- 172.21.15.50:0/2322725816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d41610b0 con 0x7fd8d40d1710 2024-09-11T22:15:01.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.683+0000 7fd8d9acd640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40d1710 0x7fd8d4160340 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009d90 tx=0x7fd8c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:01.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.683+0000 7fd8d27fc640 1 -- 172.21.15.50:0/2322725816 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4040070 con 0x7fd8d40d1710 2024-09-11T22:15:01.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.683+0000 7fd8d27fc640 1 -- 172.21.15.50:0/2322725816 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c4031c40 con 0x7fd8d40d1710 2024-09-11T22:15:01.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.683+0000 7fd8dbd31640 1 -- 172.21.15.50:0/2322725816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d4161390 con 0x7fd8d40d1710 2024-09-11T22:15:01.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.683+0000 7fd8d27fc640 1 -- 172.21.15.50:0/2322725816 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c403c420 con 0x7fd8d40d1710 2024-09-11T22:15:01.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.683+0000 7fd8dbd31640 1 -- 172.21.15.50:0/2322725816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d4161950 con 0x7fd8d40d1710 2024-09-11T22:15:01.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.684+0000 7fd8dbd31640 1 -- 172.21.15.50:0/2322725816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d40b83c0 con 0x7fd8d40d1710 2024-09-11T22:15:01.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.685+0000 7fd8d27fc640 1 -- 172.21.15.50:0/2322725816 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8c4039040 con 0x7fd8d40d1710 2024-09-11T22:15:01.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.685+0000 7fd8d27fc640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd8c006be30 0x7fd8c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:01.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.685+0000 7fd8d27fc640 1 -- 172.21.15.50:0/2322725816 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5115+0+0 (secure 0 0 0) 0x7fd8c40ac1f0 con 0x7fd8d40d1710 2024-09-11T22:15:01.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.685+0000 7fd8d92cc640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd8c006be30 0x7fd8c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:01.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.686+0000 7fd8d92cc640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd8c006be30 0x7fd8c006e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40abf30 tx=0x7fd8c8007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:01.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.689+0000 7fd8d27fc640 1 -- 172.21.15.50:0/2322725816 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8c407ae80 con 0x7fd8d40d1710 2024-09-11T22:15:01.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.865+0000 7fd8dbd31640 1 -- 172.21.15.50:0/2322725816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd8d40b9f20 con 0x7fd8d40d1710 2024-09-11T22:15:01.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.868+0000 7fd8d27fc640 1 -- 172.21.15.50:0/2322725816 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7fd8c407a780 con 0x7fd8d40d1710 2024-09-11T22:15:01.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.870+0000 7fd8dbd31640 1 -- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd8c006be30 msgr2=0x7fd8c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.870+0000 7fd8dbd31640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd8c006be30 0x7fd8c006e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40abf30 tx=0x7fd8c8007b50 comp rx=0 tx=0).stop 2024-09-11T22:15:01.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.870+0000 7fd8dbd31640 1 -- 172.21.15.50:0/2322725816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40d1710 msgr2=0x7fd8d4160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:01.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.870+0000 7fd8dbd31640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40d1710 0x7fd8d4160340 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009d90 tx=0x7fd8c4004a40 comp rx=0 tx=0).stop 2024-09-11T22:15:01.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.870+0000 7fd8dbd31640 1 -- 172.21.15.50:0/2322725816 shutdown_connections 2024-09-11T22:15:01.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.870+0000 7fd8dbd31640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd8c006be30 0x7fd8c006e2f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.870+0000 7fd8dbd31640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8d415e8d0 0x7fd8d41f4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.870+0000 7fd8dbd31640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8d40d3bf0 0x7fd8d4160880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.870+0000 7fd8dbd31640 1 --2- 172.21.15.50:0/2322725816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8d40d1710 0x7fd8d4160340 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:01.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.870+0000 7fd8dbd31640 1 -- 172.21.15.50:0/2322725816 >> 172.21.15.50:0/2322725816 conn(0x7fd8d40727a0 msgr2=0x7fd8d40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:01.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.870+0000 7fd8dbd31640 1 -- 172.21.15.50:0/2322725816 shutdown_connections 2024-09-11T22:15:01.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:01.870+0000 7fd8dbd31640 1 -- 172.21.15.50:0/2322725816 wait complete. 2024-09-11T22:15:01.883 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:15:01.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:15:01.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:15:01.977 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:15:01.978 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:15:01.978 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:01.994 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:15:01.994 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:15:01.994 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:02.012 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:15:02.013 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:15:02.013 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:02.050 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:15:02.051 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:15:02.051 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:02.070 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:15:02.070 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T22:15:02.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.191+0000 7f6a092e4640 1 Processor -- start 2024-09-11T22:15:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.191+0000 7f6a092e4640 1 -- start start 2024-09-11T22:15:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.191+0000 7f6a092e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a040d3c00 0x7f6a04169420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.191+0000 7f6a092e4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a040cfa80 con 0x7f6a0415e870 2024-09-11T22:15:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.191+0000 7f6a092e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a040d40d0 con 0x7f6a040d18a0 2024-09-11T22:15:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.191+0000 7f6a092e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a040d43b0 con 0x7f6a040d3c00 2024-09-11T22:15:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.192+0000 7f6a02ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6a0415e870 0x7f6a040d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34562/0 (socket says 172.21.15.50:34562) 2024-09-11T22:15:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.192+0000 7f6a02ffd640 1 -- 172.21.15.50:0/2153221251 learned_addr learned my addr 172.21.15.50:0/2153221251 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.192+0000 7f6a037fe640 1 --2- 172.21.15.50:0/2153221251 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a040d3c00 0x7f6a04169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.192+0000 7f6a01ffb640 1 -- 172.21.15.50:0/2153221251 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529785790 0 0) 0x7f69f4001110 con 0x7f6a0415e870 2024-09-11T22:15:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.192+0000 7f6a01ffb640 1 -- 172.21.15.50:0/2153221251 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69ec003520 con 0x7f6a0415e870 2024-09-11T22:15:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.192+0000 7f6a01ffb640 1 -- 172.21.15.50:0/2153221251 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 169236944 0 0) 0x7f6a040d40d0 con 0x7f6a040d18a0 2024-09-11T22:15:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.192+0000 7f6a01ffb640 1 -- 172.21.15.50:0/2153221251 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69f4001110 con 0x7f6a040d18a0 2024-09-11T22:15:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.192+0000 7f6a037fe640 1 -- 172.21.15.50:0/2153221251 >> v1:172.21.15.77:6789/0 conn(0x7f6a040d18a0 legacy=0x7f6a040d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.192+0000 7f6a037fe640 1 -- 172.21.15.50:0/2153221251 >> v1:172.21.15.50:6789/0 conn(0x7f6a0415e870 legacy=0x7f6a040d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.192+0000 7f6a037fe640 1 -- 172.21.15.50:0/2153221251 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a040b7c00 con 0x7f6a040d3c00 2024-09-11T22:15:02.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.193+0000 7f6a037fe640 1 --2- 172.21.15.50:0/2153221251 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a040d3c00 0x7f6a04169420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009dc0 tx=0x7f69fc02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2debca98eed58da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:02.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.193+0000 7f6a01ffb640 1 -- 172.21.15.50:0/2153221251 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc007740 con 0x7f6a040d3c00 2024-09-11T22:15:02.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.193+0000 7f6a01ffb640 1 -- 172.21.15.50:0/2153221251 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69fc0078e0 con 0x7f6a040d3c00 2024-09-11T22:15:02.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.193+0000 7f6a01ffb640 1 -- 172.21.15.50:0/2153221251 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc007c90 con 0x7f6a040d3c00 2024-09-11T22:15:02.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.194+0000 7f6a092e4640 1 -- 172.21.15.50:0/2153221251 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a040d3c00 msgr2=0x7f6a04169420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:02.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.194+0000 7f6a092e4640 1 --2- 172.21.15.50:0/2153221251 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a040d3c00 0x7f6a04169420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009dc0 tx=0x7f69fc02a6d0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.194+0000 7f6a092e4640 1 -- 172.21.15.50:0/2153221251 shutdown_connections 2024-09-11T22:15:02.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.194+0000 7f6a092e4640 1 --2- 172.21.15.50:0/2153221251 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a040d3c00 0x7f6a04169420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.194+0000 7f6a092e4640 1 -- 172.21.15.50:0/2153221251 >> 172.21.15.50:0/2153221251 conn(0x7f6a040727a0 msgr2=0x7f6a040679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:02.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.194+0000 7f6a092e4640 1 -- 172.21.15.50:0/2153221251 shutdown_connections 2024-09-11T22:15:02.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.194+0000 7f6a092e4640 1 -- 172.21.15.50:0/2153221251 wait complete. 2024-09-11T22:15:02.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.195+0000 7f6a092e4640 1 Processor -- start 2024-09-11T22:15:02.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.195+0000 7f6a092e4640 1 -- start start 2024-09-11T22:15:02.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a092e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a040d18a0 0x7f6a040cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:02.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a092e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a040d3c00 0x7f6a040b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:02.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a092e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0415e870 0x7f6a040b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:02.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a092e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a040b78b0 con 0x7f6a0415e870 2024-09-11T22:15:02.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a092e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0415ec50 con 0x7f6a040d18a0 2024-09-11T22:15:02.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a092e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a040b9410 con 0x7f6a040d3c00 2024-09-11T22:15:02.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0415e870 0x7f6a040b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:02.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0415e870 0x7f6a040b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48650/0 (socket says 172.21.15.50:48650) 2024-09-11T22:15:02.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a037fe640 1 -- 172.21.15.50:0/1305319742 learned_addr learned my addr 172.21.15.50:0/1305319742 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a027fc640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a040d3c00 0x7f6a040b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a02ffd640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a040d18a0 0x7f6a040cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a037fe640 1 -- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a040d3c00 msgr2=0x7f6a040b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a037fe640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a040d3c00 0x7f6a040b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a037fe640 1 -- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a040d18a0 msgr2=0x7f6a040cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a037fe640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a040d18a0 0x7f6a040cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a037fe640 1 -- 172.21.15.50:0/1305319742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a040c83c0 con 0x7f6a0415e870 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a02ffd640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a040d18a0 0x7f6a040cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.196+0000 7f6a037fe640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0415e870 0x7f6a040b6120 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f69fc02acc0 tx=0x7f69fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.197+0000 7f69eb7fe640 1 -- 172.21.15.50:0/1305319742 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc040070 con 0x7f6a0415e870 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.197+0000 7f69eb7fe640 1 -- 172.21.15.50:0/1305319742 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69fc031c40 con 0x7f6a0415e870 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.197+0000 7f6a092e4640 1 -- 172.21.15.50:0/1305319742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a040ca2a0 con 0x7f6a0415e870 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.197+0000 7f69eb7fe640 1 -- 172.21.15.50:0/1305319742 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc009450 con 0x7f6a0415e870 2024-09-11T22:15:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.197+0000 7f6a092e4640 1 -- 172.21.15.50:0/1305319742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a040ca860 con 0x7f6a0415e870 2024-09-11T22:15:02.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.198+0000 7f6a092e4640 1 -- 172.21.15.50:0/1305319742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a040d34f0 con 0x7f6a0415e870 2024-09-11T22:15:02.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.198+0000 7f69eb7fe640 1 -- 172.21.15.50:0/1305319742 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69fc039040 con 0x7f6a0415e870 2024-09-11T22:15:02.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.199+0000 7f69eb7fe640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69f006be30 0x7f69f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:02.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.199+0000 7f69eb7fe640 1 -- 172.21.15.50:0/1305319742 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5115+0+0 (secure 0 0 0) 0x7f69fc0ac2a0 con 0x7f6a0415e870 2024-09-11T22:15:02.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.199+0000 7f6a02ffd640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69f006be30 0x7f69f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:02.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.201+0000 7f6a02ffd640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69f006be30 0x7f69f006e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f69f4000f60 tx=0x7f69f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:02.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.204+0000 7f69eb7fe640 1 -- 172.21.15.50:0/1305319742 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a040c83c0 con 0x7f6a0415e870 2024-09-11T22:15:02.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.415+0000 7f6a092e4640 1 -- 172.21.15.50:0/1305319742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a040ba0e0 con 0x7f6a0415e870 2024-09-11T22:15:02.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.415+0000 7f69eb7fe640 1 -- 172.21.15.50:0/1305319742 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+3911 (secure 0 0 0) 0x7f69fc07aeb0 con 0x7f6a0415e870 2024-09-11T22:15:02.417 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:02.418 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"btime":"2024-09-11T22:14:56:542459+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2332065748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2332065748},{"type":"v1","addr":"172.21.15.77:6837","nonce":2332065748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2776548564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2776548564},{"type":"v1","addr":"172.21.15.77:6835","nonce":2776548564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2898617410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2898617410},{"type":"v1","addr":"172.21.15.50:6835","nonce":2898617410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/4290252891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4290252891},{"type":"v1","addr":"172.21.15.50:6833","nonce":4290252891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[]} 2024-09-11T22:15:02.418 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 42 2024-09-11T22:15:02.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.417+0000 7f6a092e4640 1 -- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69f006be30 msgr2=0x7f69f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:02.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.417+0000 7f6a092e4640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69f006be30 0x7f69f006e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f69f4000f60 tx=0x7f69f4009040 comp rx=0 tx=0).stop 2024-09-11T22:15:02.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.417+0000 7f6a092e4640 1 -- 172.21.15.50:0/1305319742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0415e870 msgr2=0x7f6a040b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:02.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.417+0000 7f6a092e4640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0415e870 0x7f6a040b6120 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f69fc02acc0 tx=0x7f69fc004a40 comp rx=0 tx=0).stop 2024-09-11T22:15:02.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.417+0000 7f6a092e4640 1 -- 172.21.15.50:0/1305319742 shutdown_connections 2024-09-11T22:15:02.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.417+0000 7f6a092e4640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69f006be30 0x7f69f006e2f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.417+0000 7f6a092e4640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a040d3c00 0x7f6a040b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.417+0000 7f6a092e4640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0415e870 0x7f6a040b6120 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.417+0000 7f6a092e4640 1 --2- 172.21.15.50:0/1305319742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a040d18a0 0x7f6a040cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.418+0000 7f6a092e4640 1 -- 172.21.15.50:0/1305319742 >> 172.21.15.50:0/1305319742 conn(0x7f6a040727a0 msgr2=0x7f6a040d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:02.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.418+0000 7f6a092e4640 1 -- 172.21.15.50:0/1305319742 shutdown_connections 2024-09-11T22:15:02.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.418+0000 7f6a092e4640 1 -- 172.21.15.50:0/1305319742 wait complete. 2024-09-11T22:15:02.430 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:15:02.431 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T22:15:02.431 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:15:02.431 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:15:02.431 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:15:02.431 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T22:15:02.431 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:15:02.431 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:15:02.432 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:15:02.432 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T22:15:02.432 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:15:02.432 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:15:02.432 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:15:02.432 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T22:15:02.433 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:15:02.433 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:15:02.441 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:15:02.441 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:15:02.442 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:15:02.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:15:02.447 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:15:02.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:15:02.448 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:15:02.448 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:15:02.485 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:15:02.485 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:02.486 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:15:02.486 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:02.489 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:15:02.490 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:02.490 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:15:02.491 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:02.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T22:15:02.562 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:15:02.562 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:15:02.574 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:15:02.574 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:15:02.575 INFO:tasks.ceph.mds.d.smithi077.stderr:2024-09-11T22:15:02.575+0000 7faf248ef640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6836/0: (98) Address already in use 2024-09-11T22:15:02.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.600+0000 7f9b3d16f640 1 Processor -- start 2024-09-11T22:15:02.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.600+0000 7f9b3d16f640 1 -- start start 2024-09-11T22:15:02.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.600+0000 7f9b3d16f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9b3815c770 0x7f9b380b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:02.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.600+0000 7f9b3d16f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3815cef0 con 0x7f9b380b5920 2024-09-11T22:15:02.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b3d16f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3815d1d0 con 0x7f9b380b66e0 2024-09-11T22:15:02.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b3d16f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9b3815d4b0 con 0x7f9b3815c770 2024-09-11T22:15:02.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b3659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9b380b5920 0x7f9b380b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34576/0 (socket says 172.21.15.50:34576) 2024-09-11T22:15:02.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b3659c640 1 -- 172.21.15.50:0/1151244193 learned_addr learned my addr 172.21.15.50:0/1151244193 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:02.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b36d9d640 1 --2- 172.21.15.50:0/1151244193 >> v2:172.21.15.77:3300/0 conn(0x7f9b3815c770 0x7f9b380b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:02.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868999075 0 0) 0x7f9b3815cef0 con 0x7f9b380b5920 2024-09-11T22:15:02.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b20003520 con 0x7f9b380b5920 2024-09-11T22:15:02.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1975212775 0 0) 0x7f9b20003520 con 0x7f9b380b5920 2024-09-11T22:15:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 >> v2:172.21.15.77:3300/0 conn(0x7f9b3815c770 msgr2=0x7f9b380b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 --2- 172.21.15.50:0/1151244193 >> v2:172.21.15.77:3300/0 conn(0x7f9b3815c770 0x7f9b380b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 >> v1:172.21.15.77:6789/0 conn(0x7f9b380b66e0 legacy=0x7f9b3815e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3815d790 con 0x7f9b380b5920 2024-09-11T22:15:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f9b2c001670 con 0x7f9b380b5920 2024-09-11T22:15:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b36d9d640 1 --2- 172.21.15.50:0/1151244193 >> v2:172.21.15.77:3300/0 conn(0x7f9b3815c770 0x7f9b380b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 >> v1:172.21.15.50:6789/0 conn(0x7f9b380b5920 legacy=0x7f9b380b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 --2- 172.21.15.50:0/1151244193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b200039b0 0x7f9b20003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 --2- 172.21.15.50:0/1151244193 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b200043b0 0x7f9b20004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 --2- 172.21.15.50:0/1151244193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b20005080 0x7f9b2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3815d4b0 con 0x7f9b20005080 2024-09-11T22:15:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2000bfe0 con 0x7f9b200039b0 2024-09-11T22:15:02.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9b2000c1e0 con 0x7f9b200043b0 2024-09-11T22:15:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b3759e640 1 --2- 172.21.15.50:0/1151244193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b20005080 0x7f9b2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b36d9d640 1 --2- 172.21.15.50:0/1151244193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b200039b0 0x7f9b20003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.601+0000 7f9b3659c640 1 --2- 172.21.15.50:0/1151244193 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b200043b0 0x7f9b20004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.602+0000 7f9b3759e640 1 -- 172.21.15.50:0/1151244193 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b200043b0 msgr2=0x7f9b20004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.602+0000 7f9b3759e640 1 --2- 172.21.15.50:0/1151244193 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b200043b0 0x7f9b20004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.602+0000 7f9b3759e640 1 -- 172.21.15.50:0/1151244193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b200039b0 msgr2=0x7f9b20003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.602+0000 7f9b3759e640 1 --2- 172.21.15.50:0/1151244193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b200039b0 0x7f9b20003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.602+0000 7f9b3759e640 1 -- 172.21.15.50:0/1151244193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b20003520 con 0x7f9b20005080 2024-09-11T22:15:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.602+0000 7f9b3759e640 1 -- 172.21.15.50:0/1151244193 reap_dead start 2024-09-11T22:15:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.602+0000 7f9b3759e640 1 --2- 172.21.15.50:0/1151244193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b20005080 0x7f9b2000b9c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9b30001f30 tx=0x7f9b20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1551d4d10c133e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.603+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30001b30 con 0x7f9b20005080 2024-09-11T22:15:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.603+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b30003b90 con 0x7f9b20005080 2024-09-11T22:15:02.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.603+0000 7f9b35d9b640 1 -- 172.21.15.50:0/1151244193 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30005110 con 0x7f9b20005080 2024-09-11T22:15:02.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.603+0000 7f9b3d16f640 1 -- 172.21.15.50:0/1151244193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b20005080 msgr2=0x7f9b2000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:02.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.603+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/1151244193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b20005080 0x7f9b2000b9c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9b30001f30 tx=0x7f9b20005830 comp rx=0 tx=0).stop 2024-09-11T22:15:02.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.603+0000 7f9b3d16f640 1 -- 172.21.15.50:0/1151244193 shutdown_connections 2024-09-11T22:15:02.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.603+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/1151244193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b20005080 0x7f9b2000b9c0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.603+0000 7f9b3d16f640 1 -- 172.21.15.50:0/1151244193 >> 172.21.15.50:0/1151244193 conn(0x7f9b380b7940 msgr2=0x7f9b380b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:02.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.603+0000 7f9b3d16f640 1 -- 172.21.15.50:0/1151244193 shutdown_connections 2024-09-11T22:15:02.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.603+0000 7f9b3d16f640 1 -- 172.21.15.50:0/1151244193 wait complete. 2024-09-11T22:15:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3d16f640 1 Processor -- start 2024-09-11T22:15:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3d16f640 1 -- start start 2024-09-11T22:15:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3d16f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b20005080 0x7f9b38138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3d16f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b3809d9d0 0x7f9b381589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3d16f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b3809de50 0x7f9b38158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3d16f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3815ccd0 con 0x7f9b3809de50 2024-09-11T22:15:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3d16f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3815cb50 con 0x7f9b20005080 2024-09-11T22:15:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3d16f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9b380b53e0 con 0x7f9b3809d9d0 2024-09-11T22:15:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b3809de50 0x7f9b38158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b3809de50 0x7f9b38158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48700/0 (socket says 172.21.15.50:48700) 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3759e640 1 -- 172.21.15.50:0/3910294553 learned_addr learned my addr 172.21.15.50:0/3910294553 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b36d9d640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b20005080 0x7f9b38138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3659c640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b3809d9d0 0x7f9b381589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3759e640 1 -- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b3809d9d0 msgr2=0x7f9b381589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3759e640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b3809d9d0 0x7f9b381589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3759e640 1 -- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b20005080 msgr2=0x7f9b38138ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3759e640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b20005080 0x7f9b38138ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3759e640 1 -- 172.21.15.50:0/3910294553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b38159660 con 0x7f9b3809de50 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3759e640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b3809de50 0x7f9b38158f00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9b30002050 tx=0x7f9b300015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b1f7fe640 1 -- 172.21.15.50:0/3910294553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30006b50 con 0x7f9b3809de50 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b1f7fe640 1 -- 172.21.15.50:0/3910294553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b30006cf0 con 0x7f9b3809de50 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b1f7fe640 1 -- 172.21.15.50:0/3910294553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3003e650 con 0x7f9b3809de50 2024-09-11T22:15:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3910294553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b38159940 con 0x7f9b3809de50 2024-09-11T22:15:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.606+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3910294553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b38159f00 con 0x7f9b3809de50 2024-09-11T22:15:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.607+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3910294553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b380b56e0 con 0x7f9b3809de50 2024-09-11T22:15:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.608+0000 7f9b1f7fe640 1 -- 172.21.15.50:0/3910294553 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b30030070 con 0x7f9b3809de50 2024-09-11T22:15:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.608+0000 7f9b1f7fe640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b2406be60 0x7f9b2406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.608+0000 7f9b1f7fe640 1 -- 172.21.15.50:0/3910294553 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5115+0+0 (secure 0 0 0) 0x7f9b300aa930 con 0x7f9b3809de50 2024-09-11T22:15:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.608+0000 7f9b36d9d640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b2406be60 0x7f9b2406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.609+0000 7f9b36d9d640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b2406be60 0x7f9b2406e320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9b280093d0 tx=0x7f9b28009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.613+0000 7f9b1f7fe640 1 -- 172.21.15.50:0/3910294553 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b300795c0 con 0x7f9b3809de50 2024-09-11T22:15:02.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:02.804+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3910294553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9b380d1cf0 con 0x7f9b3809de50 2024-09-11T22:15:03.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.574+0000 7f9b1f7fe640 1 -- 172.21.15.50:0/3910294553 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v68) ==== 97+0+0 (secure 0 0 0) 0x7f9b30078ec0 con 0x7f9b3809de50 2024-09-11T22:15:03.575 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-11T22:15:03.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.577+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b2406be60 msgr2=0x7f9b2406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:03.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.577+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b2406be60 0x7f9b2406e320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9b280093d0 tx=0x7f9b28009190 comp rx=0 tx=0).stop 2024-09-11T22:15:03.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.577+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3910294553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b3809de50 msgr2=0x7f9b38158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.577+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b3809de50 0x7f9b38158f00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9b30002050 tx=0x7f9b300015b0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.578+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3910294553 shutdown_connections 2024-09-11T22:15:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.578+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b2406be60 0x7f9b2406e320 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.578+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b3809d9d0 0x7f9b381589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.578+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b3809de50 0x7f9b38158f00 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.578+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/3910294553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b20005080 0x7f9b38138ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.578+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3910294553 >> 172.21.15.50:0/3910294553 conn(0x7f9b380b7940 msgr2=0x7f9b38070120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.578+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3910294553 shutdown_connections 2024-09-11T22:15:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.578+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3910294553 wait complete. 2024-09-11T22:15:03.593 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T22:15:03.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.701+0000 7fe4035fd640 1 Processor -- start 2024-09-11T22:15:03.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.701+0000 7fe4035fd640 1 -- start start 2024-09-11T22:15:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.702+0000 7fe4035fd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3fc0d1c90 0x7fe3fc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.702+0000 7fe4035fd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3fc163080 con 0x7fe3fc15e8e0 2024-09-11T22:15:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.702+0000 7fe4035fd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3fc0d2d20 con 0x7fe3fc162350 2024-09-11T22:15:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.702+0000 7fe4035fd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe3fc15ecc0 con 0x7fe3fc0d1c90 2024-09-11T22:15:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.702+0000 7fe401399640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe3fc15e8e0 0x7fe3fc0d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34584/0 (socket says 172.21.15.50:34584) 2024-09-11T22:15:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.702+0000 7fe401399640 1 -- 172.21.15.50:0/3488909458 learned_addr learned my addr 172.21.15.50:0/3488909458 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.702+0000 7fe400b98640 1 --2- 172.21.15.50:0/3488909458 >> v2:172.21.15.77:3300/0 conn(0x7fe3fc0d1c90 0x7fe3fc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.702+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928517708 0 0) 0x7fe3fc163080 con 0x7fe3fc15e8e0 2024-09-11T22:15:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.702+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3e8003520 con 0x7fe3fc15e8e0 2024-09-11T22:15:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4168123594 0 0) 0x7fe3e8003520 con 0x7fe3fc15e8e0 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 >> v2:172.21.15.77:3300/0 conn(0x7fe3fc0d1c90 msgr2=0x7fe3fc0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe3effff640 1 --2- 172.21.15.50:0/3488909458 >> v2:172.21.15.77:3300/0 conn(0x7fe3fc0d1c90 0x7fe3fc0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 >> v1:172.21.15.77:6789/0 conn(0x7fe3fc162350 legacy=0x7fe3fc1627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3fc0d3000 con 0x7fe3fc15e8e0 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fe3f8001670 con 0x7fe3fc15e8e0 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 >> v1:172.21.15.50:6789/0 conn(0x7fe3fc15e8e0 legacy=0x7fe3fc0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe3effff640 1 --2- 172.21.15.50:0/3488909458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e80039b0 0x7fe3e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe3effff640 1 --2- 172.21.15.50:0/3488909458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3e8004800 0x7fe3e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe3effff640 1 --2- 172.21.15.50:0/3488909458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3e80051c0 0x7fe3e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e800c040 con 0x7fe3e80051c0 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e800c1f0 con 0x7fe3e80039b0 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e800c3f0 con 0x7fe3e8004800 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe401b9a640 1 --2- 172.21.15.50:0/3488909458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3e80051c0 0x7fe3e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:03.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe401399640 1 --2- 172.21.15.50:0/3488909458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e80039b0 0x7fe3e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:03.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe400b98640 1 --2- 172.21.15.50:0/3488909458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3e8004800 0x7fe3e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:03.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe401b9a640 1 -- 172.21.15.50:0/3488909458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3e8004800 msgr2=0x7fe3e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:03.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe401b9a640 1 --2- 172.21.15.50:0/3488909458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3e8004800 0x7fe3e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe401b9a640 1 -- 172.21.15.50:0/3488909458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e80039b0 msgr2=0x7fe3e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:03.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe401b9a640 1 --2- 172.21.15.50:0/3488909458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e80039b0 0x7fe3e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.703+0000 7fe401b9a640 1 -- 172.21.15.50:0/3488909458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e8003520 con 0x7fe3e80051c0 2024-09-11T22:15:03.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.704+0000 7fe401b9a640 1 -- 172.21.15.50:0/3488909458 reap_dead start 2024-09-11T22:15:03.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.704+0000 7fe401b9a640 1 --2- 172.21.15.50:0/3488909458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3e80051c0 0x7fe3e800b9c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4001e50 tx=0x7fe3e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36ed19e934f788f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:03.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.704+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4001a70 con 0x7fe3e80051c0 2024-09-11T22:15:03.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.704+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f4003970 con 0x7fe3e80051c0 2024-09-11T22:15:03.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.704+0000 7fe3effff640 1 -- 172.21.15.50:0/3488909458 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4003d60 con 0x7fe3e80051c0 2024-09-11T22:15:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.705+0000 7fe4035fd640 1 -- 172.21.15.50:0/3488909458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3e80051c0 msgr2=0x7fe3e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.705+0000 7fe4035fd640 1 --2- 172.21.15.50:0/3488909458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3e80051c0 0x7fe3e800b9c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4001e50 tx=0x7fe3e8005830 comp rx=0 tx=0).stop 2024-09-11T22:15:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.705+0000 7fe4035fd640 1 -- 172.21.15.50:0/3488909458 shutdown_connections 2024-09-11T22:15:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.705+0000 7fe4035fd640 1 --2- 172.21.15.50:0/3488909458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3e80051c0 0x7fe3e800b9c0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.705+0000 7fe4035fd640 1 -- 172.21.15.50:0/3488909458 >> 172.21.15.50:0/3488909458 conn(0x7fe3fc067ba0 msgr2=0x7fe3fc067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.705+0000 7fe4035fd640 1 -- 172.21.15.50:0/3488909458 shutdown_connections 2024-09-11T22:15:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.705+0000 7fe4035fd640 1 -- 172.21.15.50:0/3488909458 wait complete. 2024-09-11T22:15:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.706+0000 7fe4035fd640 1 Processor -- start 2024-09-11T22:15:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.706+0000 7fe4035fd640 1 -- start start 2024-09-11T22:15:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe4035fd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3e80051c0 0x7fe3fc1ea6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe4035fd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3fc1e9150 0x7fe3fc157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe4035fd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3fc1448a0 0x7fe3fc144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe4035fd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc0b7c10 con 0x7fe3e80051c0 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe4035fd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc0b7a90 con 0x7fe3fc1e9150 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe4035fd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe3fc0d2ad0 con 0x7fe3fc1448a0 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe401399640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3e80051c0 0x7fe3fc1ea6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe401399640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3e80051c0 0x7fe3fc1ea6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48716/0 (socket says 172.21.15.50:48716) 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe401399640 1 -- 172.21.15.50:0/1835181073 learned_addr learned my addr 172.21.15.50:0/1835181073 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe401b9a640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3fc1448a0 0x7fe3fc144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe400b98640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3fc1e9150 0x7fe3fc157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe401399640 1 -- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3fc1448a0 msgr2=0x7fe3fc144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe401399640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3fc1448a0 0x7fe3fc144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe401399640 1 -- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3fc1e9150 msgr2=0x7fe3fc157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe401399640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3fc1e9150 0x7fe3fc157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe401399640 1 -- 172.21.15.50:0/1835181073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3fc1e9610 con 0x7fe3e80051c0 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.707+0000 7fe401399640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3e80051c0 0x7fe3fc1ea6b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80072f0 tx=0x7fe3f80076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.708+0000 7fe3edffb640 1 -- 172.21.15.50:0/1835181073 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f801a070 con 0x7fe3e80051c0 2024-09-11T22:15:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.708+0000 7fe3edffb640 1 -- 172.21.15.50:0/1835181073 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f800f9a0 con 0x7fe3e80051c0 2024-09-11T22:15:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.708+0000 7fe4035fd640 1 -- 172.21.15.50:0/1835181073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3fc1e98f0 con 0x7fe3e80051c0 2024-09-11T22:15:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.708+0000 7fe3edffb640 1 -- 172.21.15.50:0/1835181073 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f800fd70 con 0x7fe3e80051c0 2024-09-11T22:15:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.708+0000 7fe4035fd640 1 -- 172.21.15.50:0/1835181073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3fc1e9eb0 con 0x7fe3e80051c0 2024-09-11T22:15:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.709+0000 7fe4035fd640 1 -- 172.21.15.50:0/1835181073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3fc0d1580 con 0x7fe3e80051c0 2024-09-11T22:15:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.709+0000 7fe3edffb640 1 -- 172.21.15.50:0/1835181073 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3f801d070 con 0x7fe3e80051c0 2024-09-11T22:15:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.710+0000 7fe3edffb640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe3e006be30 0x7fe3e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.710+0000 7fe3edffb640 1 -- 172.21.15.50:0/1835181073 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 4857+0+0 (secure 0 0 0) 0x7fe3f808a600 con 0x7fe3e80051c0 2024-09-11T22:15:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.710+0000 7fe400b98640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe3e006be30 0x7fe3e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.711+0000 7fe400b98640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe3e006be30 0x7fe3e006e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0cd430 tx=0x7fe3f0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.715+0000 7fe3edffb640 1 -- 172.21.15.50:0/1835181073 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe3f8058cb0 con 0x7fe3e80051c0 2024-09-11T22:15:03.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.956+0000 7fe4035fd640 1 -- 172.21.15.50:0/1835181073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe3fc157c90 con 0x7fe3e80051c0 2024-09-11T22:15:03.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.956+0000 7fe3edffb640 1 -- 172.21.15.50:0/1835181073 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fe3f805cfb0 con 0x7fe3e80051c0 2024-09-11T22:15:03.957 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:03.957 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:15:03.957 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-11T22:15:03.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.957 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-11T22:15:03.957 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w==", 2024-09-11T22:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-11T22:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg==", 2024-09-11T22:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-11T22:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ==", 2024-09-11T22:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-11T22:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw==", 2024-09-11T22:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg==", 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ==", 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:03.962 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:03.962 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.962 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-11T22:15:03.962 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg==", 2024-09-11T22:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-11T22:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg==", 2024-09-11T22:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-11T22:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A==", 2024-09-11T22:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-11T22:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw==", 2024-09-11T22:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-11T22:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A==", 2024-09-11T22:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-11T22:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw==", 2024-09-11T22:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew==", 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-11T22:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw==", 2024-09-11T22:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-11T22:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg==", 2024-09-11T22:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-11T22:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw==", 2024-09-11T22:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBFFeJmAq9+OBAAANc9KfDvm3+wt/uED7WCvA==", 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-11T22:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g==", 2024-09-11T22:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-11T22:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg==", 2024-09-11T22:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-11T22:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:15:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.958+0000 7fe4035fd640 1 -- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe3e006be30 msgr2=0x7fe3e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:03.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.958+0000 7fe4035fd640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe3e006be30 0x7fe3e006e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0cd430 tx=0x7fe3f0009190 comp rx=0 tx=0).stop 2024-09-11T22:15:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.958+0000 7fe4035fd640 1 -- 172.21.15.50:0/1835181073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3e80051c0 msgr2=0x7fe3fc1ea6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.958+0000 7fe4035fd640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3e80051c0 0x7fe3fc1ea6b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80072f0 tx=0x7fe3f80076f0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.958+0000 7fe4035fd640 1 -- 172.21.15.50:0/1835181073 shutdown_connections 2024-09-11T22:15:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.958+0000 7fe4035fd640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe3e006be30 0x7fe3e006e2f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.958+0000 7fe4035fd640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3fc1448a0 0x7fe3fc144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.958+0000 7fe4035fd640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3fc1e9150 0x7fe3fc157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.958+0000 7fe4035fd640 1 --2- 172.21.15.50:0/1835181073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3e80051c0 0x7fe3fc1ea6b0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.958+0000 7fe4035fd640 1 -- 172.21.15.50:0/1835181073 >> 172.21.15.50:0/1835181073 conn(0x7fe3fc067ba0 msgr2=0x7fe3fc0b58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.958+0000 7fe4035fd640 1 -- 172.21.15.50:0/1835181073 shutdown_connections 2024-09-11T22:15:03.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:03.958+0000 7fe4035fd640 1 -- 172.21.15.50:0/1835181073 wait complete. 2024-09-11T22:15:03.976 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:15:04.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.077+0000 7f791e359640 1 Processor -- start 2024-09-11T22:15:04.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.077+0000 7f791e359640 1 -- start start 2024-09-11T22:15:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.078+0000 7f791e359640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79180d18a0 0x7f79180d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.078+0000 7f791e359640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79180cfa80 con 0x7f791815e870 2024-09-11T22:15:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.078+0000 7f791e359640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79180d40d0 con 0x7f79180d3a30 2024-09-11T22:15:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.078+0000 7f791e359640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f79180d3ea0 con 0x7f79180d18a0 2024-09-11T22:15:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.078+0000 7f79177fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79180d18a0 0x7f79180d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.078+0000 7f79177fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79180d18a0 0x7f79180d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48730/0 (socket says 172.21.15.50:48730) 2024-09-11T22:15:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.078+0000 7f79177fe640 1 -- 172.21.15.50:0/879075141 learned_addr learned my addr 172.21.15.50:0/879075141 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.078+0000 7f7917fff640 1 --1- 172.21.15.50:0/879075141 >> v1:172.21.15.50:6789/0 conn(0x7f791815e870 0x7f79180d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34586/0 (socket says 172.21.15.50:34586) 2024-09-11T22:15:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.078+0000 7f79177fe640 1 -- 172.21.15.50:0/879075141 >> v1:172.21.15.77:6789/0 conn(0x7f79180d3a30 legacy=0x7f79180b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.078+0000 7f79177fe640 1 -- 172.21.15.50:0/879075141 >> v1:172.21.15.50:6789/0 conn(0x7f791815e870 legacy=0x7f79180d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.078+0000 7f79177fe640 1 -- 172.21.15.50:0/879075141 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79180d43b0 con 0x7f79180d18a0 2024-09-11T22:15:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.078+0000 7f7916ffd640 1 -- 172.21.15.50:0/879075141 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 352741848 0 0) 0x7f7908001110 con 0x7f791815e870 2024-09-11T22:15:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.079+0000 7f79177fe640 1 --2- 172.21.15.50:0/879075141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79180d18a0 0x7f79180d34f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f790c009870 tx=0x7f790c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76bb6e563ba5ea8a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.079+0000 7f7916ffd640 1 -- 172.21.15.50:0/879075141 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c037070 con 0x7f79180d18a0 2024-09-11T22:15:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.079+0000 7f7916ffd640 1 -- 172.21.15.50:0/879075141 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790c032440 con 0x7f79180d18a0 2024-09-11T22:15:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.079+0000 7f7916ffd640 1 -- 172.21.15.50:0/879075141 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c032810 con 0x7f79180d18a0 2024-09-11T22:15:04.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.080+0000 7f791e359640 1 -- 172.21.15.50:0/879075141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79180d18a0 msgr2=0x7f79180d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.080+0000 7f791e359640 1 --2- 172.21.15.50:0/879075141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79180d18a0 0x7f79180d34f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f790c009870 tx=0x7f790c02a2a0 comp rx=0 tx=0).stop 2024-09-11T22:15:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.080+0000 7f791e359640 1 -- 172.21.15.50:0/879075141 shutdown_connections 2024-09-11T22:15:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.080+0000 7f791e359640 1 --2- 172.21.15.50:0/879075141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79180d18a0 0x7f79180d34f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.080+0000 7f791e359640 1 -- 172.21.15.50:0/879075141 >> 172.21.15.50:0/879075141 conn(0x7f79180727a0 msgr2=0x7f79180679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.080+0000 7f791e359640 1 -- 172.21.15.50:0/879075141 shutdown_connections 2024-09-11T22:15:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.080+0000 7f791e359640 1 -- 172.21.15.50:0/879075141 wait complete. 2024-09-11T22:15:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.081+0000 7f791e359640 1 Processor -- start 2024-09-11T22:15:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.081+0000 7f791e359640 1 -- start start 2024-09-11T22:15:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f791e359640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79180d18a0 0x7f79180b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f791e359640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79180d3a30 0x7f791815d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f791e359640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791815e870 0x7f791815dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f791e359640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f791815ec50 con 0x7f79180d18a0 2024-09-11T22:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f791e359640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f79180b7ee0 con 0x7f791815e870 2024-09-11T22:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f791e359640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f79180b78b0 con 0x7f79180d3a30 2024-09-11T22:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f7917fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79180d18a0 0x7f79180b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f7917fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79180d18a0 0x7f79180b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48736/0 (socket says 172.21.15.50:48736) 2024-09-11T22:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f7917fff640 1 -- 172.21.15.50:0/3897402436 learned_addr learned my addr 172.21.15.50:0/3897402436 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f791c8f6640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791815e870 0x7f791815dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f79177fe640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79180d3a30 0x7f791815d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f7917fff640 1 -- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79180d3a30 msgr2=0x7f791815d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f7917fff640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79180d3a30 0x7f791815d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f7917fff640 1 -- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791815e870 msgr2=0x7f791815dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f7917fff640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791815e870 0x7f791815dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f7917fff640 1 -- 172.21.15.50:0/3897402436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7918153640 con 0x7f79180d18a0 2024-09-11T22:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f791c8f6640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791815e870 0x7f791815dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.082+0000 7f79177fe640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79180d3a30 0x7f791815d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.083+0000 7f7917fff640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79180d18a0 0x7f79180b2d60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f790800c7b0 tx=0x7f790800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.083+0000 7f7914ff9640 1 -- 172.21.15.50:0/3897402436 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908018070 con 0x7f79180d18a0 2024-09-11T22:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.083+0000 7f7914ff9640 1 -- 172.21.15.50:0/3897402436 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79080072d0 con 0x7f79180d18a0 2024-09-11T22:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.083+0000 7f7914ff9640 1 -- 172.21.15.50:0/3897402436 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79080047e0 con 0x7f79180d18a0 2024-09-11T22:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.083+0000 7f791e359640 1 -- 172.21.15.50:0/3897402436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7918153920 con 0x7f79180d18a0 2024-09-11T22:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.083+0000 7f791e359640 1 -- 172.21.15.50:0/3897402436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7918153ee0 con 0x7f79180d18a0 2024-09-11T22:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.084+0000 7f791e359640 1 -- 172.21.15.50:0/3897402436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79180d34f0 con 0x7f79180d18a0 2024-09-11T22:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.084+0000 7f7914ff9640 1 -- 172.21.15.50:0/3897402436 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7908004980 con 0x7f79180d18a0 2024-09-11T22:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.085+0000 7f7914ff9640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f790406be30 0x7f790406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.085+0000 7f7914ff9640 1 -- 172.21.15.50:0/3897402436 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 4857+0+0 (secure 0 0 0) 0x7f7908089f40 con 0x7f79180d18a0 2024-09-11T22:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.085+0000 7f79177fe640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f790406be30 0x7f790406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.086+0000 7f79177fe640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f790406be30 0x7f790406e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f790c034000 tx=0x7f790c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.089+0000 7f7914ff9640 1 -- 172.21.15.50:0/3897402436 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79180cfa80 con 0x7f79180d18a0 2024-09-11T22:15:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.265+0000 7f791e359640 1 -- 172.21.15.50:0/3897402436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7918161d10 con 0x7f79180d18a0 2024-09-11T22:15:04.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.265+0000 7f7914ff9640 1 -- 172.21.15.50:0/3897402436 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f7908004c70 con 0x7f79180d18a0 2024-09-11T22:15:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:04.266 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:15:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:15:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:15:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:04.267 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:15:04.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.267+0000 7f791e359640 1 -- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f790406be30 msgr2=0x7f790406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:04.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.267+0000 7f791e359640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f790406be30 0x7f790406e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f790c034000 tx=0x7f790c02e000 comp rx=0 tx=0).stop 2024-09-11T22:15:04.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.267+0000 7f791e359640 1 -- 172.21.15.50:0/3897402436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79180d18a0 msgr2=0x7f79180b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:04.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.267+0000 7f791e359640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79180d18a0 0x7f79180b2d60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f790800c7b0 tx=0x7f790800cc70 comp rx=0 tx=0).stop 2024-09-11T22:15:04.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.267+0000 7f791e359640 1 -- 172.21.15.50:0/3897402436 shutdown_connections 2024-09-11T22:15:04.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.267+0000 7f791e359640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f790406be30 0x7f790406e2f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:04.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.267+0000 7f791e359640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79180d3a30 0x7f791815d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:04.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.267+0000 7f791e359640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791815e870 0x7f791815dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:04.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.267+0000 7f791e359640 1 --2- 172.21.15.50:0/3897402436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79180d18a0 0x7f79180b2d60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:04.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.267+0000 7f791e359640 1 -- 172.21.15.50:0/3897402436 >> 172.21.15.50:0/3897402436 conn(0x7f79180727a0 msgr2=0x7f79180d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:04.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.267+0000 7f791e359640 1 -- 172.21.15.50:0/3897402436 shutdown_connections 2024-09-11T22:15:04.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.267+0000 7f791e359640 1 -- 172.21.15.50:0/3897402436 wait complete. 2024-09-11T22:15:04.279 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:15:04.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:15:04.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.385+0000 7fd97556f640 1 Processor -- start 2024-09-11T22:15:04.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.386+0000 7fd97556f640 1 -- start start 2024-09-11T22:15:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd97556f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd9700b2d50 0x7fd9700d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd97556f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9700b5550 0x7fd9700b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd97556f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9700d0050 con 0x7fd9700d0c60 2024-09-11T22:15:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd97556f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd9700b3670 con 0x7fd9700b2d50 2024-09-11T22:15:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd97556f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd9700b3950 con 0x7fd9700b5550 2024-09-11T22:15:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd96f7fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9700b5550 0x7fd9700b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd96effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd9700b2d50 0x7fd9700d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:04.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd96f7fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9700b5550 0x7fd9700b59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:58940/0 (socket says 172.21.15.50:58940) 2024-09-11T22:15:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd96e7fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd9700d0c60 0x7fd9700d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:60370/0 (socket says 172.21.15.50:60370) 2024-09-11T22:15:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd96f7fe640 1 -- 172.21.15.50:0/347333163 learned_addr learned my addr 172.21.15.50:0/347333163 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd96effd640 1 -- 172.21.15.50:0/347333163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9700b5550 msgr2=0x7fd9700b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd96effd640 1 --2- 172.21.15.50:0/347333163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9700b5550 0x7fd9700b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd96effd640 1 -- 172.21.15.50:0/347333163 >> v1:172.21.15.77:6789/0 conn(0x7fd9700d0c60 legacy=0x7fd9700d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd96dffb640 1 -- 172.21.15.50:0/347333163 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483701752 0 0) 0x7fd958001110 con 0x7fd9700d0c60 2024-09-11T22:15:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.387+0000 7fd96effd640 1 -- 172.21.15.50:0/347333163 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9700b3c30 con 0x7fd9700b2d50 2024-09-11T22:15:04.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.388+0000 7fd96effd640 1 --2- 172.21.15.50:0/347333163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9700b2d50 0x7fd9700d0250 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd960009d90 tx=0x7fd96002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f70a29dd9c7963a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:04.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.388+0000 7fd96dffb640 1 -- 172.21.15.50:0/347333163 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960007740 con 0x7fd9700b2d50 2024-09-11T22:15:04.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.388+0000 7fd96dffb640 1 -- 172.21.15.50:0/347333163 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9600078e0 con 0x7fd9700b2d50 2024-09-11T22:15:04.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.388+0000 7fd96dffb640 1 -- 172.21.15.50:0/347333163 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960007cb0 con 0x7fd9700b2d50 2024-09-11T22:15:04.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.389+0000 7fd97556f640 1 -- 172.21.15.50:0/347333163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9700b2d50 msgr2=0x7fd9700d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:04.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.389+0000 7fd97556f640 1 --2- 172.21.15.50:0/347333163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9700b2d50 0x7fd9700d0250 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd960009d90 tx=0x7fd96002a660 comp rx=0 tx=0).stop 2024-09-11T22:15:04.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.389+0000 7fd97556f640 1 -- 172.21.15.50:0/347333163 shutdown_connections 2024-09-11T22:15:04.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.389+0000 7fd97556f640 1 --2- 172.21.15.50:0/347333163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9700b5550 0x7fd9700b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:04.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.389+0000 7fd97556f640 1 --2- 172.21.15.50:0/347333163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9700b2d50 0x7fd9700d0250 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:04.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.389+0000 7fd97556f640 1 -- 172.21.15.50:0/347333163 >> 172.21.15.50:0/347333163 conn(0x7fd9700b4250 msgr2=0x7fd9700b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:04.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.389+0000 7fd97556f640 1 -- 172.21.15.50:0/347333163 shutdown_connections 2024-09-11T22:15:04.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.389+0000 7fd97556f640 1 -- 172.21.15.50:0/347333163 wait complete. 2024-09-11T22:15:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.390+0000 7fd97556f640 1 Processor -- start 2024-09-11T22:15:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.390+0000 7fd97556f640 1 -- start start 2024-09-11T22:15:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.391+0000 7fd97556f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9700b2d50 0x7fd9700b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.391+0000 7fd97556f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9700b5550 0x7fd9700c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.391+0000 7fd97556f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9700d0c60 0x7fd9700c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.391+0000 7fd97556f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd9700ce430 con 0x7fd9700b2d50 2024-09-11T22:15:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.391+0000 7fd97556f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9700cfb30 con 0x7fd9700d0c60 2024-09-11T22:15:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.391+0000 7fd97556f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd9701eeb40 con 0x7fd9700b5550 2024-09-11T22:15:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.391+0000 7fd96effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9700b2d50 0x7fd9700b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.391+0000 7fd96effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9700b2d50 0x7fd9700b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48748/0 (socket says 172.21.15.50:48748) 2024-09-11T22:15:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.391+0000 7fd96effd640 1 -- 172.21.15.50:0/8596513 learned_addr learned my addr 172.21.15.50:0/8596513 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.391+0000 7fd96e7fc640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9700b5550 0x7fd9700c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.391+0000 7fd96f7fe640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9700d0c60 0x7fd9700c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.392+0000 7fd96effd640 1 -- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9700b5550 msgr2=0x7fd9700c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.392+0000 7fd96effd640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9700b5550 0x7fd9700c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.392+0000 7fd96effd640 1 -- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9700d0c60 msgr2=0x7fd9700c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.392+0000 7fd96effd640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9700d0c60 0x7fd9700c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.392+0000 7fd96effd640 1 -- 172.21.15.50:0/8596513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9700b11a0 con 0x7fd9700b2d50 2024-09-11T22:15:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.392+0000 7fd96effd640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9700b2d50 0x7fd9700b0aa0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd960009d90 tx=0x7fd960004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.392+0000 7fd9677fe640 1 -- 172.21.15.50:0/8596513 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960040070 con 0x7fd9700b2d50 2024-09-11T22:15:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.392+0000 7fd9677fe640 1 -- 172.21.15.50:0/8596513 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd960031c40 con 0x7fd9700b2d50 2024-09-11T22:15:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.392+0000 7fd97556f640 1 -- 172.21.15.50:0/8596513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9700b1480 con 0x7fd9700b2d50 2024-09-11T22:15:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.392+0000 7fd9677fe640 1 -- 172.21.15.50:0/8596513 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960009450 con 0x7fd9700b2d50 2024-09-11T22:15:04.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.392+0000 7fd97556f640 1 -- 172.21.15.50:0/8596513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97006c080 con 0x7fd9700b2d50 2024-09-11T22:15:04.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.393+0000 7fd97556f640 1 -- 172.21.15.50:0/8596513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9700b3130 con 0x7fd9700b2d50 2024-09-11T22:15:04.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.393+0000 7fd9677fe640 1 -- 172.21.15.50:0/8596513 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd960039040 con 0x7fd9700b2d50 2024-09-11T22:15:04.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.394+0000 7fd9677fe640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd95006be30 0x7fd95006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:04.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.394+0000 7fd9677fe640 1 -- 172.21.15.50:0/8596513 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 4857+0+0 (secure 0 0 0) 0x7fd9600abbc0 con 0x7fd9700b2d50 2024-09-11T22:15:04.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.394+0000 7fd96e7fc640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd95006be30 0x7fd95006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:04.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.395+0000 7fd96e7fc640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd95006be30 0x7fd95006e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd970070ff0 tx=0x7fd958007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:04.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.398+0000 7fd9677fe640 1 -- 172.21.15.50:0/8596513 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd96007a300 con 0x7fd9700b2d50 2024-09-11T22:15:04.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:04.575+0000 7fd97556f640 1 -- 172.21.15.50:0/8596513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd97006fea0 con 0x7fd9700b2d50 2024-09-11T22:15:05.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.577+0000 7fd9677fe640 1 -- 172.21.15.50:0/8596513 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7fd96007e600 con 0x7fd9700b2d50 2024-09-11T22:15:05.578 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:15:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.580+0000 7fd97556f640 1 -- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd95006be30 msgr2=0x7fd95006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.580+0000 7fd97556f640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd95006be30 0x7fd95006e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd970070ff0 tx=0x7fd958007de0 comp rx=0 tx=0).stop 2024-09-11T22:15:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.580+0000 7fd97556f640 1 -- 172.21.15.50:0/8596513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9700b2d50 msgr2=0x7fd9700b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.580+0000 7fd97556f640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9700b2d50 0x7fd9700b0aa0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd960009d90 tx=0x7fd960004a40 comp rx=0 tx=0).stop 2024-09-11T22:15:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.580+0000 7fd97556f640 1 -- 172.21.15.50:0/8596513 shutdown_connections 2024-09-11T22:15:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.580+0000 7fd97556f640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd95006be30 0x7fd95006e2f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.580+0000 7fd97556f640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9700b5550 0x7fd9700c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.580+0000 7fd97556f640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9700d0c60 0x7fd9700c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.580+0000 7fd97556f640 1 --2- 172.21.15.50:0/8596513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9700b2d50 0x7fd9700b0aa0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.580+0000 7fd97556f640 1 -- 172.21.15.50:0/8596513 >> 172.21.15.50:0/8596513 conn(0x7fd9700b4250 msgr2=0x7fd9700b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.581+0000 7fd97556f640 1 -- 172.21.15.50:0/8596513 shutdown_connections 2024-09-11T22:15:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.582+0000 7fd97556f640 1 -- 172.21.15.50:0/8596513 wait complete. 2024-09-11T22:15:05.599 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:15:05.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.714+0000 7fda4e427640 1 Processor -- start 2024-09-11T22:15:05.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.714+0000 7fda4e427640 1 -- start start 2024-09-11T22:15:05.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.715+0000 7fda4e427640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda48156960 0x7fda4806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:05.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.715+0000 7fda4e427640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda480d0580 0x7fda480728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:05.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.715+0000 7fda4e427640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda480ce470 con 0x7fda4815d4c0 2024-09-11T22:15:05.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.715+0000 7fda4e427640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fda480b03a0 con 0x7fda480d0580 2024-09-11T22:15:05.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.715+0000 7fda4e427640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fda480cea30 con 0x7fda48156960 2024-09-11T22:15:05.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.715+0000 7fda4c9c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda480d0580 0x7fda480728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.715+0000 7fda4c9c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda480d0580 0x7fda480728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48762/0 (socket says 172.21.15.50:48762) 2024-09-11T22:15:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.715+0000 7fda4c9c4640 1 -- 172.21.15.50:0/3123188935 learned_addr learned my addr 172.21.15.50:0/3123188935 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.715+0000 7fda47fff640 1 --2- 172.21.15.50:0/3123188935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda48156960 0x7fda4806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.716+0000 7fda4c9c4640 1 -- 172.21.15.50:0/3123188935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda48156960 msgr2=0x7fda4806fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.716+0000 7fda4c9c4640 1 --2- 172.21.15.50:0/3123188935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda48156960 0x7fda4806fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.716+0000 7fda4c9c4640 1 -- 172.21.15.50:0/3123188935 >> v1:172.21.15.77:6789/0 conn(0x7fda4815d4c0 legacy=0x7fda480cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.716+0000 7fda4c9c4640 1 -- 172.21.15.50:0/3123188935 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda480ce750 con 0x7fda480d0580 2024-09-11T22:15:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.716+0000 7fda47fff640 1 --2- 172.21.15.50:0/3123188935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda48156960 0x7fda4806fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.716+0000 7fda4c9c4640 1 --2- 172.21.15.50:0/3123188935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda480d0580 0x7fda480728e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fda40009e50 tx=0x7fda4002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d388a49491baf9e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.716+0000 7fda46ffd640 1 -- 172.21.15.50:0/3123188935 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40036070 con 0x7fda480d0580 2024-09-11T22:15:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.716+0000 7fda46ffd640 1 -- 172.21.15.50:0/3123188935 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda40031600 con 0x7fda480d0580 2024-09-11T22:15:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.716+0000 7fda46ffd640 1 -- 172.21.15.50:0/3123188935 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda400319d0 con 0x7fda480d0580 2024-09-11T22:15:05.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.717+0000 7fda4e427640 1 -- 172.21.15.50:0/3123188935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda480d0580 msgr2=0x7fda480728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:05.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.717+0000 7fda4e427640 1 --2- 172.21.15.50:0/3123188935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda480d0580 0x7fda480728e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fda40009e50 tx=0x7fda4002a710 comp rx=0 tx=0).stop 2024-09-11T22:15:05.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.717+0000 7fda4e427640 1 -- 172.21.15.50:0/3123188935 shutdown_connections 2024-09-11T22:15:05.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.717+0000 7fda4e427640 1 --2- 172.21.15.50:0/3123188935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda480d0580 0x7fda480728e0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:05.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.717+0000 7fda4e427640 1 --2- 172.21.15.50:0/3123188935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda48156960 0x7fda4806fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:05.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.717+0000 7fda4e427640 1 -- 172.21.15.50:0/3123188935 >> 172.21.15.50:0/3123188935 conn(0x7fda480b2bd0 msgr2=0x7fda480b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:05.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.717+0000 7fda4e427640 1 -- 172.21.15.50:0/3123188935 shutdown_connections 2024-09-11T22:15:05.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.717+0000 7fda4e427640 1 -- 172.21.15.50:0/3123188935 wait complete. 2024-09-11T22:15:05.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.718+0000 7fda4e427640 1 Processor -- start 2024-09-11T22:15:05.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.718+0000 7fda4e427640 1 -- start start 2024-09-11T22:15:05.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.719+0000 7fda4e427640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda480d0580 0x7fda4814eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:05.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.719+0000 7fda4e427640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda48156960 0x7fda48153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:05.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.719+0000 7fda4e427640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4815d4c0 0x7fda48153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:05.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.719+0000 7fda4e427640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fda480b0830 con 0x7fda4815d4c0 2024-09-11T22:15:05.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.719+0000 7fda4e427640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fda48156d40 con 0x7fda48156960 2024-09-11T22:15:05.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.719+0000 7fda4e427640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fda4814f0b0 con 0x7fda480d0580 2024-09-11T22:15:05.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.719+0000 7fda4c9c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4815d4c0 0x7fda48153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:05.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.719+0000 7fda4c9c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4815d4c0 0x7fda48153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48770/0 (socket says 172.21.15.50:48770) 2024-09-11T22:15:05.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.719+0000 7fda4c9c4640 1 -- 172.21.15.50:0/2518048828 learned_addr learned my addr 172.21.15.50:0/2518048828 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:05.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.719+0000 7fda47fff640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda480d0580 0x7fda4814eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:05.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.719+0000 7fda477fe640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda48156960 0x7fda48153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:05.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.720+0000 7fda4c9c4640 1 -- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda480d0580 msgr2=0x7fda4814eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:05.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.720+0000 7fda4c9c4640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda480d0580 0x7fda4814eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:05.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.720+0000 7fda4c9c4640 1 -- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda48156960 msgr2=0x7fda48153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:05.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.720+0000 7fda4c9c4640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda48156960 0x7fda48153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:05.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.720+0000 7fda4c9c4640 1 -- 172.21.15.50:0/2518048828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda48072fd0 con 0x7fda4815d4c0 2024-09-11T22:15:05.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.720+0000 7fda4c9c4640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4815d4c0 0x7fda48153dd0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fda40009f70 tx=0x7fda40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:05.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.720+0000 7fda44ff9640 1 -- 172.21.15.50:0/2518048828 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4003f020 con 0x7fda4815d4c0 2024-09-11T22:15:05.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.720+0000 7fda44ff9640 1 -- 172.21.15.50:0/2518048828 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda40037040 con 0x7fda4815d4c0 2024-09-11T22:15:05.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.720+0000 7fda44ff9640 1 -- 172.21.15.50:0/2518048828 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40036070 con 0x7fda4815d4c0 2024-09-11T22:15:05.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.720+0000 7fda4e427640 1 -- 172.21.15.50:0/2518048828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda480732b0 con 0x7fda4815d4c0 2024-09-11T22:15:05.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.720+0000 7fda4e427640 1 -- 172.21.15.50:0/2518048828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda481573e0 con 0x7fda4815d4c0 2024-09-11T22:15:05.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.721+0000 7fda4e427640 1 -- 172.21.15.50:0/2518048828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda4806fd50 con 0x7fda4815d4c0 2024-09-11T22:15:05.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.722+0000 7fda44ff9640 1 -- 172.21.15.50:0/2518048828 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda40042020 con 0x7fda4815d4c0 2024-09-11T22:15:05.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.722+0000 7fda44ff9640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fda3406be30 0x7fda3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:05.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.722+0000 7fda44ff9640 1 -- 172.21.15.50:0/2518048828 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5227+0+0 (secure 0 0 0) 0x7fda400aafb0 con 0x7fda4815d4c0 2024-09-11T22:15:05.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.722+0000 7fda47fff640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fda3406be30 0x7fda3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:05.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.723+0000 7fda47fff640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fda3406be30 0x7fda3406e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fda480af920 tx=0x7fda38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:05.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.727+0000 7fda44ff9640 1 -- 172.21.15.50:0/2518048828 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda40049030 con 0x7fda4815d4c0 2024-09-11T22:15:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:05.906+0000 7fda4e427640 1 -- 172.21.15.50:0/2518048828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fda48068f20 con 0x7fda4815d4c0 2024-09-11T22:15:06.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.579+0000 7fda44ff9640 1 -- 172.21.15.50:0/2518048828 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v72) ==== 170+0+0 (secure 0 0 0) 0x7fda400794f0 con 0x7fda4815d4c0 2024-09-11T22:15:06.580 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:15:06.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.582+0000 7fda4e427640 1 -- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fda3406be30 msgr2=0x7fda3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:06.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.582+0000 7fda4e427640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fda3406be30 0x7fda3406e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fda480af920 tx=0x7fda38008040 comp rx=0 tx=0).stop 2024-09-11T22:15:06.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.582+0000 7fda4e427640 1 -- 172.21.15.50:0/2518048828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4815d4c0 msgr2=0x7fda48153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:06.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.582+0000 7fda4e427640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4815d4c0 0x7fda48153dd0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fda40009f70 tx=0x7fda40004a40 comp rx=0 tx=0).stop 2024-09-11T22:15:06.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.582+0000 7fda4e427640 1 -- 172.21.15.50:0/2518048828 shutdown_connections 2024-09-11T22:15:06.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.582+0000 7fda4e427640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fda3406be30 0x7fda3406e2f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:06.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.582+0000 7fda4e427640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda4815d4c0 0x7fda48153dd0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:06.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.582+0000 7fda4e427640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda48156960 0x7fda48153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:06.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.582+0000 7fda4e427640 1 --2- 172.21.15.50:0/2518048828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda480d0580 0x7fda4814eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:06.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.582+0000 7fda4e427640 1 -- 172.21.15.50:0/2518048828 >> 172.21.15.50:0/2518048828 conn(0x7fda480b2bd0 msgr2=0x7fda480b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:06.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.583+0000 7fda4e427640 1 -- 172.21.15.50:0/2518048828 shutdown_connections 2024-09-11T22:15:06.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.585+0000 7fda4e427640 1 -- 172.21.15.50:0/2518048828 wait complete. 2024-09-11T22:15:06.609 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:15:06.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.719+0000 7f101a111640 1 Processor -- start 2024-09-11T22:15:06.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.719+0000 7f101a111640 1 -- start start 2024-09-11T22:15:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.720+0000 7f101a111640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f10140d1c90 0x7f10140b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.720+0000 7f101a111640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1014163080 con 0x7f1014162350 2024-09-11T22:15:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.720+0000 7f101a111640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10140d2d20 con 0x7f101415e8e0 2024-09-11T22:15:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.720+0000 7f101a111640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f101415ecc0 con 0x7f10140d1c90 2024-09-11T22:15:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.720+0000 7f1013fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1014162350 0x7f10141627a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34598/0 (socket says 172.21.15.50:34598) 2024-09-11T22:15:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.720+0000 7f1013fff640 1 -- 172.21.15.50:0/52980449 learned_addr learned my addr 172.21.15.50:0/52980449 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.720+0000 7f1012ffd640 1 --2- 172.21.15.50:0/52980449 >> v2:172.21.15.77:3300/0 conn(0x7f10140d1c90 0x7f10140b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504918211 0 0) 0x7f1014163080 con 0x7f1014162350 2024-09-11T22:15:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ffc003520 con 0x7f1014162350 2024-09-11T22:15:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 327320618 0 0) 0x7f0ffc003520 con 0x7f1014162350 2024-09-11T22:15:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 >> v2:172.21.15.77:3300/0 conn(0x7f10140d1c90 msgr2=0x7f10140b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 --2- 172.21.15.50:0/52980449 >> v2:172.21.15.77:3300/0 conn(0x7f10140d1c90 0x7f10140b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 >> v1:172.21.15.77:6789/0 conn(0x7f101415e8e0 legacy=0x7f10140d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10140d3000 con 0x7f1014162350 2024-09-11T22:15:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f1012ffd640 1 --2- 172.21.15.50:0/52980449 >> v2:172.21.15.77:3300/0 conn(0x7f10140d1c90 0x7f10140b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f100c0019f0 con 0x7f1014162350 2024-09-11T22:15:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 >> v1:172.21.15.50:6789/0 conn(0x7f1014162350 legacy=0x7f10141627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 --2- 172.21.15.50:0/52980449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ffc0039b0 0x7f0ffc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 --2- 172.21.15.50:0/52980449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc004800 0x7f0ffc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 --2- 172.21.15.50:0/52980449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ffc0051c0 0x7f0ffc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc00c040 con 0x7f0ffc004800 2024-09-11T22:15:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc00c1f0 con 0x7f0ffc0051c0 2024-09-11T22:15:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0ffc00c3f0 con 0x7f0ffc0039b0 2024-09-11T22:15:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f1012ffd640 1 --2- 172.21.15.50:0/52980449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc004800 0x7f0ffc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f10137fe640 1 --2- 172.21.15.50:0/52980449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ffc0039b0 0x7f0ffc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:06.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f1013fff640 1 --2- 172.21.15.50:0/52980449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ffc0051c0 0x7f0ffc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:06.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f1012ffd640 1 -- 172.21.15.50:0/52980449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ffc0039b0 msgr2=0x7f0ffc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:06.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f1012ffd640 1 --2- 172.21.15.50:0/52980449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ffc0039b0 0x7f0ffc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:06.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f1012ffd640 1 -- 172.21.15.50:0/52980449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ffc0051c0 msgr2=0x7f0ffc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:06.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f1012ffd640 1 --2- 172.21.15.50:0/52980449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ffc0051c0 0x7f0ffc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:06.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f1012ffd640 1 -- 172.21.15.50:0/52980449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ffc003520 con 0x7f0ffc004800 2024-09-11T22:15:06.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.721+0000 7f1013fff640 1 -- 172.21.15.50:0/52980449 reap_dead start 2024-09-11T22:15:06.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.722+0000 7f1012ffd640 1 --2- 172.21.15.50:0/52980449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc004800 0x7f0ffc004c80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1008009c90 tx=0x7f0ffc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a8a25ef9d6e8df server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:06.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.722+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008036070 con 0x7f0ffc004800 2024-09-11T22:15:06.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.722+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1008031400 con 0x7f0ffc004800 2024-09-11T22:15:06.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.722+0000 7f10127fc640 1 -- 172.21.15.50:0/52980449 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008009860 con 0x7f0ffc004800 2024-09-11T22:15:06.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.723+0000 7f101a111640 1 -- 172.21.15.50:0/52980449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc004800 msgr2=0x7f0ffc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:06.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.723+0000 7f101a111640 1 --2- 172.21.15.50:0/52980449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc004800 0x7f0ffc004c80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1008009c90 tx=0x7f0ffc005830 comp rx=0 tx=0).stop 2024-09-11T22:15:06.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.723+0000 7f101a111640 1 -- 172.21.15.50:0/52980449 shutdown_connections 2024-09-11T22:15:06.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.723+0000 7f101a111640 1 --2- 172.21.15.50:0/52980449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ffc004800 0x7f0ffc004c80 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:06.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.723+0000 7f101a111640 1 -- 172.21.15.50:0/52980449 >> 172.21.15.50:0/52980449 conn(0x7f1014067ba0 msgr2=0x7f1014067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:06.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.723+0000 7f101a111640 1 -- 172.21.15.50:0/52980449 shutdown_connections 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.723+0000 7f101a111640 1 -- 172.21.15.50:0/52980449 wait complete. 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.724+0000 7f101a111640 1 Processor -- start 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.724+0000 7f101a111640 1 -- start start 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.725+0000 7f101a111640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ffc004800 0x7f1014158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.725+0000 7f101a111640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10140cbad0 0x7f10141f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.725+0000 7f101a111640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10141e96d0 0x7f10141e9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.725+0000 7f101a111640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f10140b7c10 con 0x7f10141e96d0 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.725+0000 7f101a111640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f10140b7a90 con 0x7f10140cbad0 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.725+0000 7f101a111640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f10140d2ad0 con 0x7f0ffc004800 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.725+0000 7f1013fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10141e96d0 0x7f10141e9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.725+0000 7f1013fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10141e96d0 0x7f10141e9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48796/0 (socket says 172.21.15.50:48796) 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.725+0000 7f1013fff640 1 -- 172.21.15.50:0/936806739 learned_addr learned my addr 172.21.15.50:0/936806739 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.725+0000 7f1012ffd640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10140cbad0 0x7f10141f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:06.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.725+0000 7f10137fe640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ffc004800 0x7f1014158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:06.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.726+0000 7f1013fff640 1 -- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ffc004800 msgr2=0x7f1014158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:06.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.726+0000 7f1013fff640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ffc004800 0x7f1014158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:06.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.726+0000 7f1013fff640 1 -- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10140cbad0 msgr2=0x7f10141f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:06.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.726+0000 7f1013fff640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10140cbad0 0x7f10141f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:06.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.726+0000 7f1013fff640 1 -- 172.21.15.50:0/936806739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10140cc040 con 0x7f10141e96d0 2024-09-11T22:15:06.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.726+0000 7f1013fff640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10141e96d0 0x7f10141e9b50 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f10140cedf0 tx=0x7f100c007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:06.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.726+0000 7f0ffbfff640 1 -- 172.21.15.50:0/936806739 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c00ab00 con 0x7f10141e96d0 2024-09-11T22:15:06.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.726+0000 7f0ffbfff640 1 -- 172.21.15.50:0/936806739 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100c018070 con 0x7f10141e96d0 2024-09-11T22:15:06.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.726+0000 7f101a111640 1 -- 172.21.15.50:0/936806739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10140cc320 con 0x7f10141e96d0 2024-09-11T22:15:06.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.726+0000 7f0ffbfff640 1 -- 172.21.15.50:0/936806739 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c0133f0 con 0x7f10141e96d0 2024-09-11T22:15:06.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.726+0000 7f101a111640 1 -- 172.21.15.50:0/936806739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10140cc8e0 con 0x7f10141e96d0 2024-09-11T22:15:06.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.727+0000 7f101a111640 1 -- 172.21.15.50:0/936806739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10140cec10 con 0x7f10141e96d0 2024-09-11T22:15:06.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.728+0000 7f0ffbfff640 1 -- 172.21.15.50:0/936806739 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f100c013590 con 0x7f10141e96d0 2024-09-11T22:15:06.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.728+0000 7f0ffbfff640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f100006be60 0x7f100006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:06.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.728+0000 7f0ffbfff640 1 -- 172.21.15.50:0/936806739 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5609+0+0 (secure 0 0 0) 0x7f100c08bc40 con 0x7f10141e96d0 2024-09-11T22:15:06.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.729+0000 7f10137fe640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f100006be60 0x7f100006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:06.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.729+0000 7f10137fe640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f100006be60 0x7f100006e320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1004000c00 tx=0x7f1004009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:06.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.732+0000 7f0ffbfff640 1 -- 172.21.15.50:0/936806739 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10140cec10 con 0x7f10141e96d0 2024-09-11T22:15:06.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:06.943+0000 7f101a111640 1 -- 172.21.15.50:0/936806739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f10140d1580 con 0x7f10141e96d0 2024-09-11T22:15:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.609+0000 7f0ffbfff640 1 -- 172.21.15.50:0/936806739 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v45) ==== 174+0+0 (secure 0 0 0) 0x7f100c059fe0 con 0x7f10141e96d0 2024-09-11T22:15:07.614 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 10 and data pool 11 2024-09-11T22:15:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.616+0000 7f101a111640 1 -- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f100006be60 msgr2=0x7f100006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.616+0000 7f101a111640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f100006be60 0x7f100006e320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1004000c00 tx=0x7f1004009040 comp rx=0 tx=0).stop 2024-09-11T22:15:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.616+0000 7f101a111640 1 -- 172.21.15.50:0/936806739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10141e96d0 msgr2=0x7f10141e9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.616+0000 7f101a111640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10141e96d0 0x7f10141e9b50 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f10140cedf0 tx=0x7f100c007b00 comp rx=0 tx=0).stop 2024-09-11T22:15:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.617+0000 7f101a111640 1 -- 172.21.15.50:0/936806739 shutdown_connections 2024-09-11T22:15:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.617+0000 7f101a111640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f100006be60 0x7f100006e320 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.617+0000 7f101a111640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10141e96d0 0x7f10141e9b50 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.618+0000 7f101a111640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10140cbad0 0x7f10141f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.618+0000 7f101a111640 1 --2- 172.21.15.50:0/936806739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ffc004800 0x7f1014158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.618+0000 7f101a111640 1 -- 172.21.15.50:0/936806739 >> 172.21.15.50:0/936806739 conn(0x7f1014067ba0 msgr2=0x7f10140b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.619+0000 7f101a111640 1 -- 172.21.15.50:0/936806739 shutdown_connections 2024-09-11T22:15:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.621+0000 7f101a111640 1 -- 172.21.15.50:0/936806739 wait complete. 2024-09-11T22:15:07.641 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:15:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.744+0000 7f00b11d8640 1 Processor -- start 2024-09-11T22:15:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.744+0000 7f00b11d8640 1 -- start start 2024-09-11T22:15:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.745+0000 7f00b11d8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f00ac15c3c0 0x7f00ac15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.745+0000 7f00b11d8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00ac15f7f0 con 0x7f00ac0680d0 2024-09-11T22:15:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.745+0000 7f00b11d8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00ac15fad0 con 0x7f00ac15ec40 2024-09-11T22:15:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.745+0000 7f00b11d8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f00ac06e700 con 0x7f00ac15c3c0 2024-09-11T22:15:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.745+0000 7f00ab59e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f00ac0680d0 0x7f00ac06f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56346/0 (socket says 172.21.15.50:56346) 2024-09-11T22:15:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.745+0000 7f00ab59e640 1 -- 172.21.15.50:0/2541606328 learned_addr learned my addr 172.21.15.50:0/2541606328 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.745+0000 7f00aad9d640 1 --2- 172.21.15.50:0/2541606328 >> v2:172.21.15.77:3300/0 conn(0x7f00ac15c3c0 0x7f00ac15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.745+0000 7f00a9d9b640 1 -- 172.21.15.50:0/2541606328 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908761715 0 0) 0x7f00ac15f7f0 con 0x7f00ac0680d0 2024-09-11T22:15:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.745+0000 7f00a9d9b640 1 -- 172.21.15.50:0/2541606328 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0098003520 con 0x7f00ac0680d0 2024-09-11T22:15:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.746+0000 7f00a9d9b640 1 -- 172.21.15.50:0/2541606328 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669336171 0 0) 0x7f00ac15fad0 con 0x7f00ac15ec40 2024-09-11T22:15:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.746+0000 7f00a9d9b640 1 -- 172.21.15.50:0/2541606328 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00ac15f7f0 con 0x7f00ac15ec40 2024-09-11T22:15:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.746+0000 7f00aad9d640 1 -- 172.21.15.50:0/2541606328 >> v1:172.21.15.77:6789/0 conn(0x7f00ac15ec40 legacy=0x7f00ac0679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.746+0000 7f00aad9d640 1 -- 172.21.15.50:0/2541606328 >> v1:172.21.15.50:6789/0 conn(0x7f00ac0680d0 legacy=0x7f00ac06f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.746+0000 7f00a9d9b640 1 -- 172.21.15.50:0/2541606328 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2896998495 0 0) 0x7f0098003520 con 0x7f00ac0680d0 2024-09-11T22:15:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.746+0000 7f00aad9d640 1 -- 172.21.15.50:0/2541606328 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ac06e950 con 0x7f00ac15c3c0 2024-09-11T22:15:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.746+0000 7f00aad9d640 1 --2- 172.21.15.50:0/2541606328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00ac15c3c0 0x7f00ac15fe60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f009c009d90 tx=0x7f009c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=379853ba04e11e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.747+0000 7f00a9d9b640 1 -- 172.21.15.50:0/2541606328 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4001670 con 0x7f00ac15c3c0 2024-09-11T22:15:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.747+0000 7f00a9d9b640 1 -- 172.21.15.50:0/2541606328 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009c007540 con 0x7f00ac15c3c0 2024-09-11T22:15:07.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.747+0000 7f00a9d9b640 1 -- 172.21.15.50:0/2541606328 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c0078f0 con 0x7f00ac15c3c0 2024-09-11T22:15:07.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.747+0000 7f00b11d8640 1 -- 172.21.15.50:0/2541606328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00ac15c3c0 msgr2=0x7f00ac15fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:07.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.747+0000 7f00b11d8640 1 --2- 172.21.15.50:0/2541606328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00ac15c3c0 0x7f00ac15fe60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f009c009d90 tx=0x7f009c02a5f0 comp rx=0 tx=0).stop 2024-09-11T22:15:07.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.747+0000 7f00b11d8640 1 -- 172.21.15.50:0/2541606328 shutdown_connections 2024-09-11T22:15:07.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.747+0000 7f00b11d8640 1 --2- 172.21.15.50:0/2541606328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00ac15c3c0 0x7f00ac15fe60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:07.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.747+0000 7f00b11d8640 1 -- 172.21.15.50:0/2541606328 >> 172.21.15.50:0/2541606328 conn(0x7f00ac075060 msgr2=0x7f00ac06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:07.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.747+0000 7f00b11d8640 1 -- 172.21.15.50:0/2541606328 shutdown_connections 2024-09-11T22:15:07.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.747+0000 7f00b11d8640 1 -- 172.21.15.50:0/2541606328 wait complete. 2024-09-11T22:15:07.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.749+0000 7f00b11d8640 1 Processor -- start 2024-09-11T22:15:07.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.749+0000 7f00b11d8640 1 -- start start 2024-09-11T22:15:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.749+0000 7f00b11d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00ac0680d0 0x7f00ac1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.749+0000 7f00b11d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00ac15c3c0 0x7f00ac15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.749+0000 7f00b11d8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00ac15ec40 0x7f00ac15a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.749+0000 7f00b11d8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac15f0b0 con 0x7f00ac15c3c0 2024-09-11T22:15:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.749+0000 7f00b11d8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac0d0940 con 0x7f00ac0680d0 2024-09-11T22:15:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.749+0000 7f00b11d8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f00ac15f230 con 0x7f00ac15ec40 2024-09-11T22:15:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00aa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00ac15c3c0 0x7f00ac15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00aa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00ac15c3c0 0x7f00ac15a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49944/0 (socket says 172.21.15.50:49944) 2024-09-11T22:15:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00aa59c640 1 -- 172.21.15.50:0/2422223043 learned_addr learned my addr 172.21.15.50:0/2422223043 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00aad9d640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00ac0680d0 0x7f00ac1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00ab59e640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00ac15ec40 0x7f00ac15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00aa59c640 1 -- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00ac15ec40 msgr2=0x7f00ac15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00aa59c640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00ac15ec40 0x7f00ac15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00aa59c640 1 -- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00ac0680d0 msgr2=0x7f00ac1534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00aa59c640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00ac0680d0 0x7f00ac1534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00aa59c640 1 -- 172.21.15.50:0/2422223043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ac157b70 con 0x7f00ac15c3c0 2024-09-11T22:15:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00aad9d640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00ac0680d0 0x7f00ac1534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00aa59c640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00ac15c3c0 0x7f00ac15a3f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f009400c430 tx=0x7f009400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00a37fe640 1 -- 172.21.15.50:0/2422223043 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094017070 con 0x7f00ac15c3c0 2024-09-11T22:15:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00a37fe640 1 -- 172.21.15.50:0/2422223043 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00940052f0 con 0x7f00ac15c3c0 2024-09-11T22:15:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00b11d8640 1 -- 172.21.15.50:0/2422223043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ac1529c0 con 0x7f00ac15c3c0 2024-09-11T22:15:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00a37fe640 1 -- 172.21.15.50:0/2422223043 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094003830 con 0x7f00ac15c3c0 2024-09-11T22:15:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.750+0000 7f00b11d8640 1 -- 172.21.15.50:0/2422223043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ac152f80 con 0x7f00ac15c3c0 2024-09-11T22:15:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.751+0000 7f00b11d8640 1 -- 172.21.15.50:0/2422223043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00ac06cae0 con 0x7f00ac15c3c0 2024-09-11T22:15:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.752+0000 7f00a37fe640 1 -- 172.21.15.50:0/2422223043 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f009401a070 con 0x7f00ac15c3c0 2024-09-11T22:15:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.752+0000 7f00a37fe640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f008c06be30 0x7f008c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.752+0000 7f00a37fe640 1 -- 172.21.15.50:0/2422223043 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f009408a160 con 0x7f00ac15c3c0 2024-09-11T22:15:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.753+0000 7f00aad9d640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f008c06be30 0x7f008c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.753+0000 7f00aad9d640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f008c06be30 0x7f008c06e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f009c034000 tx=0x7f009c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.757+0000 7f00a37fe640 1 -- 172.21.15.50:0/2422223043 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0094058550 con 0x7f00ac15c3c0 2024-09-11T22:15:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.932+0000 7f00b11d8640 1 -- 172.21.15.50:0/2422223043 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00ac152530 con 0x7f00ac15c3c0 2024-09-11T22:15:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.933+0000 7f00a37fe640 1 -- 172.21.15.50:0/2422223043 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+16705 (secure 0 0 0) 0x7f009405c850 con 0x7f00ac15c3c0 2024-09-11T22:15:07.934 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:07.934 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":73,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:15:06.944881+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:15:04.606994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T22:15:05.937484+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:15:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.935+0000 7f00b11d8640 1 -- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f008c06be30 msgr2=0x7f008c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.935+0000 7f00b11d8640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f008c06be30 0x7f008c06e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f009c034000 tx=0x7f009c02f000 comp rx=0 tx=0).stop 2024-09-11T22:15:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.935+0000 7f00b11d8640 1 -- 172.21.15.50:0/2422223043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00ac15c3c0 msgr2=0x7f00ac15a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.935+0000 7f00b11d8640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00ac15c3c0 0x7f00ac15a3f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f009400c430 tx=0x7f009400c8f0 comp rx=0 tx=0).stop 2024-09-11T22:15:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.935+0000 7f00b11d8640 1 -- 172.21.15.50:0/2422223043 shutdown_connections 2024-09-11T22:15:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.935+0000 7f00b11d8640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f008c06be30 0x7f008c06e2f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.935+0000 7f00b11d8640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00ac15ec40 0x7f00ac15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.935+0000 7f00b11d8640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00ac15c3c0 0x7f00ac15a3f0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.935+0000 7f00b11d8640 1 --2- 172.21.15.50:0/2422223043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00ac0680d0 0x7f00ac1534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.935+0000 7f00b11d8640 1 -- 172.21.15.50:0/2422223043 >> 172.21.15.50:0/2422223043 conn(0x7f00ac075060 msgr2=0x7f00ac160100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.935+0000 7f00b11d8640 1 -- 172.21.15.50:0/2422223043 shutdown_connections 2024-09-11T22:15:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:07.935+0000 7f00b11d8640 1 -- 172.21.15.50:0/2422223043 wait complete. 2024-09-11T22:15:07.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:15:08.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.048+0000 7faad8731640 1 Processor -- start 2024-09-11T22:15:08.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.048+0000 7faad8731640 1 -- start start 2024-09-11T22:15:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.049+0000 7faad8731640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad006e0f0 0x7faad006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.049+0000 7faad8731640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faad015b7e0 con 0x7faad0072e60 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.049+0000 7faad8731640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faad015f140 con 0x7faad015b400 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.049+0000 7faad8731640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faad015f420 con 0x7faad006e0f0 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.049+0000 7faad6cce640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faad0072e60 0x7faad00711c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56350/0 (socket says 172.21.15.50:56350) 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.049+0000 7faad6cce640 1 -- 172.21.15.50:0/1742273500 learned_addr learned my addr 172.21.15.50:0/1742273500 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.049+0000 7faad5ccc640 1 --2- 172.21.15.50:0/1742273500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad006e0f0 0x7faad006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 889449004 0 0) 0x7faad015b7e0 con 0x7faad0072e60 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faab8003520 con 0x7faad0072e60 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3987130433 0 0) 0x7faab8003520 con 0x7faad0072e60 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad006e0f0 msgr2=0x7faad006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 --2- 172.21.15.50:0/1742273500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad006e0f0 0x7faad006d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 >> v1:172.21.15.77:6789/0 conn(0x7faad015b400 legacy=0x7faad006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad015f700 con 0x7faad0072e60 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7faac00019f0 con 0x7faad0072e60 2024-09-11T22:15:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 >> v1:172.21.15.50:6789/0 conn(0x7faad0072e60 legacy=0x7faad00711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 --2- 172.21.15.50:0/1742273500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad006e0f0 0x7faab80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 --2- 172.21.15.50:0/1742273500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8003f20 0x7faab8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 --2- 172.21.15.50:0/1742273500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faab8004d40 0x7faab80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faad015f420 con 0x7faab8004d40 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faab800ba20 con 0x7faab8003f20 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faab800bc20 con 0x7faad006e0f0 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad6cce640 1 --2- 172.21.15.50:0/1742273500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faab8004d40 0x7faab80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad64cd640 1 --2- 172.21.15.50:0/1742273500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad006e0f0 0x7faab80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad5ccc640 1 --2- 172.21.15.50:0/1742273500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8003f20 0x7faab8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad64cd640 1 -- 172.21.15.50:0/1742273500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8003f20 msgr2=0x7faab8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad64cd640 1 --2- 172.21.15.50:0/1742273500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8003f20 0x7faab8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad64cd640 1 -- 172.21.15.50:0/1742273500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faab8004d40 msgr2=0x7faab80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad64cd640 1 --2- 172.21.15.50:0/1742273500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faab8004d40 0x7faab80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad64cd640 1 -- 172.21.15.50:0/1742273500 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab8003520 con 0x7faad006e0f0 2024-09-11T22:15:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.050+0000 7faad6cce640 1 --2- 172.21.15.50:0/1742273500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faab8004d40 0x7faab80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.051+0000 7faad64cd640 1 --2- 172.21.15.50:0/1742273500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad006e0f0 0x7faab80039e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faac8001910 tx=0x7faab8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd4494dc4e02ac92 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.051+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8037070 con 0x7faad006e0f0 2024-09-11T22:15:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.051+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac802aba0 con 0x7faad006e0f0 2024-09-11T22:15:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.051+0000 7faad54cb640 1 -- 172.21.15.50:0/1742273500 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac80014e0 con 0x7faad006e0f0 2024-09-11T22:15:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.052+0000 7faad8731640 1 -- 172.21.15.50:0/1742273500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad006e0f0 msgr2=0x7faab80039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.052+0000 7faad8731640 1 --2- 172.21.15.50:0/1742273500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad006e0f0 0x7faab80039e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faac8001910 tx=0x7faab8005830 comp rx=0 tx=0).stop 2024-09-11T22:15:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.052+0000 7faad6cce640 1 -- 172.21.15.50:0/1742273500 reap_dead start 2024-09-11T22:15:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.052+0000 7faad8731640 1 -- 172.21.15.50:0/1742273500 shutdown_connections 2024-09-11T22:15:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.052+0000 7faad8731640 1 -- 172.21.15.50:0/1742273500 >> 172.21.15.50:0/1742273500 conn(0x7faad00679c0 msgr2=0x7faad0067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.052+0000 7faad8731640 1 -- 172.21.15.50:0/1742273500 shutdown_connections 2024-09-11T22:15:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.052+0000 7faad8731640 1 -- 172.21.15.50:0/1742273500 wait complete. 2024-09-11T22:15:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.053+0000 7faad8731640 1 Processor -- start 2024-09-11T22:15:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.053+0000 7faad8731640 1 -- start start 2024-09-11T22:15:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad8731640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006e0f0 0x7faad01e6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad8731640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad00cd620 0x7faad00cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad8731640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faad014bda0 0x7faad00ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad8731640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faad006d070 con 0x7faad006e0f0 2024-09-11T22:15:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad8731640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faad00cfc50 con 0x7faad014bda0 2024-09-11T22:15:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad8731640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faad006d1f0 con 0x7faad00cd620 2024-09-11T22:15:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad64cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006e0f0 0x7faad01e6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad64cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006e0f0 0x7faad01e6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49972/0 (socket says 172.21.15.50:49972) 2024-09-11T22:15:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad64cd640 1 -- 172.21.15.50:0/3358155264 learned_addr learned my addr 172.21.15.50:0/3358155264 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad5ccc640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad00cd620 0x7faad00cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad6cce640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faad014bda0 0x7faad00ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad64cd640 1 -- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad00cd620 msgr2=0x7faad00cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad64cd640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad00cd620 0x7faad00cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad64cd640 1 -- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faad014bda0 msgr2=0x7faad00ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad64cd640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faad014bda0 0x7faad00ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.054+0000 7faad64cd640 1 -- 172.21.15.50:0/3358155264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad00cf100 con 0x7faad006e0f0 2024-09-11T22:15:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.055+0000 7faad64cd640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006e0f0 0x7faad01e6270 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7faac8001970 tx=0x7faac80012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.055+0000 7faaceffd640 1 -- 172.21.15.50:0/3358155264 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8037040 con 0x7faad006e0f0 2024-09-11T22:15:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.055+0000 7faaceffd640 1 -- 172.21.15.50:0/3358155264 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac80052e0 con 0x7faad006e0f0 2024-09-11T22:15:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.055+0000 7faad8731640 1 -- 172.21.15.50:0/3358155264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad00cdb20 con 0x7faad006e0f0 2024-09-11T22:15:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.055+0000 7faaceffd640 1 -- 172.21.15.50:0/3358155264 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8007240 con 0x7faad006e0f0 2024-09-11T22:15:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.055+0000 7faad8731640 1 -- 172.21.15.50:0/3358155264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad00ce0e0 con 0x7faad006e0f0 2024-09-11T22:15:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.056+0000 7faad8731640 1 -- 172.21.15.50:0/3358155264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad006d9e0 con 0x7faad006e0f0 2024-09-11T22:15:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.056+0000 7faaceffd640 1 -- 172.21.15.50:0/3358155264 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faac803a070 con 0x7faad006e0f0 2024-09-11T22:15:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.057+0000 7faaceffd640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faabc06be60 0x7faabc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.057+0000 7faaceffd640 1 -- 172.21.15.50:0/3358155264 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7faac80aad00 con 0x7faad006e0f0 2024-09-11T22:15:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.057+0000 7faad5ccc640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faabc06be60 0x7faabc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.057+0000 7faad5ccc640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faabc06be60 0x7faabc06e320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faad015a930 tx=0x7faac4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.061+0000 7faaceffd640 1 -- 172.21.15.50:0/3358155264 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faad00cf100 con 0x7faad006e0f0 2024-09-11T22:15:08.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.236+0000 7faad8731640 1 -- 172.21.15.50:0/3358155264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faad00b2640 con 0x7faad006e0f0 2024-09-11T22:15:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.237+0000 7faaceffd640 1 -- 172.21.15.50:0/3358155264 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+16705 (secure 0 0 0) 0x7faac8079770 con 0x7faad006e0f0 2024-09-11T22:15:08.238 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:08.238 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":73,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:15:06.944881+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:15:04.606994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T22:15:05.937484+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:15:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.239+0000 7faad8731640 1 -- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faabc06be60 msgr2=0x7faabc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.239+0000 7faad8731640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faabc06be60 0x7faabc06e320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faad015a930 tx=0x7faac4009190 comp rx=0 tx=0).stop 2024-09-11T22:15:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.239+0000 7faad8731640 1 -- 172.21.15.50:0/3358155264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006e0f0 msgr2=0x7faad01e6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.239+0000 7faad8731640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006e0f0 0x7faad01e6270 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7faac8001970 tx=0x7faac80012b0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.239+0000 7faad8731640 1 -- 172.21.15.50:0/3358155264 shutdown_connections 2024-09-11T22:15:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.239+0000 7faad8731640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faabc06be60 0x7faabc06e320 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.239+0000 7faad8731640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faad00cd620 0x7faad00cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.239+0000 7faad8731640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faad014bda0 0x7faad00ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.239+0000 7faad8731640 1 --2- 172.21.15.50:0/3358155264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006e0f0 0x7faad01e6270 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.239+0000 7faad8731640 1 -- 172.21.15.50:0/3358155264 >> 172.21.15.50:0/3358155264 conn(0x7faad00679c0 msgr2=0x7faad015da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.239+0000 7faad8731640 1 -- 172.21.15.50:0/3358155264 shutdown_connections 2024-09-11T22:15:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.239+0000 7faad8731640 1 -- 172.21.15.50:0/3358155264 wait complete. 2024-09-11T22:15:08.251 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:15:08.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.355+0000 7f6a1a065640 1 Processor -- start 2024-09-11T22:15:08.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.355+0000 7f6a1a065640 1 -- start start 2024-09-11T22:15:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.356+0000 7f6a1a065640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a1415c510 0x7f6a1406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.356+0000 7f6a1a065640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a1406e730 0x7f6a140679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.356+0000 7f6a1a065640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a1406ec90 con 0x7f6a14067f00 2024-09-11T22:15:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.356+0000 7f6a1a065640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6a1406ef70 con 0x7f6a1406e730 2024-09-11T22:15:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.356+0000 7f6a1a065640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1406f250 con 0x7f6a1415c510 2024-09-11T22:15:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.356+0000 7f6a13fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6a14067f00 0x7f6a14072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56356/0 (socket says 172.21.15.50:56356) 2024-09-11T22:15:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.356+0000 7f6a13fff640 1 -- 172.21.15.50:0/412240620 learned_addr learned my addr 172.21.15.50:0/412240620 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.356+0000 7f6a12ffd640 1 --2- 172.21.15.50:0/412240620 >> v2:172.21.15.77:3300/0 conn(0x7f6a1406e730 0x7f6a140679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.356+0000 7f6a137fe640 1 --2- 172.21.15.50:0/412240620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a1415c510 0x7f6a1406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.356+0000 7f6a127fc640 1 -- 172.21.15.50:0/412240620 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3555715452 0 0) 0x7f6a1406ec90 con 0x7f6a14067f00 2024-09-11T22:15:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.357+0000 7f6a127fc640 1 -- 172.21.15.50:0/412240620 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69fc003520 con 0x7f6a14067f00 2024-09-11T22:15:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.357+0000 7f6a137fe640 1 -- 172.21.15.50:0/412240620 >> v2:172.21.15.77:3300/0 conn(0x7f6a1406e730 msgr2=0x7f6a140679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.357+0000 7f6a137fe640 1 --2- 172.21.15.50:0/412240620 >> v2:172.21.15.77:3300/0 conn(0x7f6a1406e730 0x7f6a140679c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.357+0000 7f6a137fe640 1 -- 172.21.15.50:0/412240620 >> v1:172.21.15.50:6789/0 conn(0x7f6a14067f00 legacy=0x7f6a14072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.357+0000 7f6a137fe640 1 -- 172.21.15.50:0/412240620 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1406f530 con 0x7f6a1415c510 2024-09-11T22:15:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.357+0000 7f6a12ffd640 1 --2- 172.21.15.50:0/412240620 >> v2:172.21.15.77:3300/0 conn(0x7f6a1406e730 0x7f6a140679c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.357+0000 7f6a137fe640 1 --2- 172.21.15.50:0/412240620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a1415c510 0x7f6a1406e1f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097a0 tx=0x7f6a0402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e4a61c5318968d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:08.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.358+0000 7f6a127fc640 1 -- 172.21.15.50:0/412240620 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04037070 con 0x7f6a1415c510 2024-09-11T22:15:08.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.358+0000 7f6a127fc640 1 -- 172.21.15.50:0/412240620 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a04032440 con 0x7f6a1415c510 2024-09-11T22:15:08.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.358+0000 7f6a127fc640 1 -- 172.21.15.50:0/412240620 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04032810 con 0x7f6a1415c510 2024-09-11T22:15:08.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.358+0000 7f6a1a065640 1 -- 172.21.15.50:0/412240620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a1415c510 msgr2=0x7f6a1406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.358+0000 7f6a1a065640 1 --2- 172.21.15.50:0/412240620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a1415c510 0x7f6a1406e1f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097a0 tx=0x7f6a0402a180 comp rx=0 tx=0).stop 2024-09-11T22:15:08.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.358+0000 7f6a1a065640 1 -- 172.21.15.50:0/412240620 shutdown_connections 2024-09-11T22:15:08.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.358+0000 7f6a1a065640 1 --2- 172.21.15.50:0/412240620 >> v2:172.21.15.77:3300/0 conn(0x7f6a1406e730 0x7f6a140679c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.358+0000 7f6a1a065640 1 --2- 172.21.15.50:0/412240620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a1415c510 0x7f6a1406e1f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.358+0000 7f6a1a065640 1 -- 172.21.15.50:0/412240620 >> 172.21.15.50:0/412240620 conn(0x7f6a14075060 msgr2=0x7f6a1406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:08.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.358+0000 7f6a1a065640 1 -- 172.21.15.50:0/412240620 shutdown_connections 2024-09-11T22:15:08.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.358+0000 7f6a1a065640 1 -- 172.21.15.50:0/412240620 wait complete. 2024-09-11T22:15:08.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.359+0000 7f6a1a065640 1 Processor -- start 2024-09-11T22:15:08.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.360+0000 7f6a1a065640 1 -- start start 2024-09-11T22:15:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.360+0000 7f6a1a065640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a14067f00 0x7f6a140c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.360+0000 7f6a1a065640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a1406e730 0x7f6a140cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.360+0000 7f6a1a065640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a1415c510 0x7f6a14158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.360+0000 7f6a1a065640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1406fd30 con 0x7f6a14067f00 2024-09-11T22:15:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.360+0000 7f6a1a065640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1406c820 con 0x7f6a1406e730 2024-09-11T22:15:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.360+0000 7f6a1a065640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1415d900 con 0x7f6a1415c510 2024-09-11T22:15:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.360+0000 7f6a137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a14067f00 0x7f6a140c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.360+0000 7f6a137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a14067f00 0x7f6a140c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49980/0 (socket says 172.21.15.50:49980) 2024-09-11T22:15:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.360+0000 7f6a137fe640 1 -- 172.21.15.50:0/1447642504 learned_addr learned my addr 172.21.15.50:0/1447642504 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.361+0000 7f6a12ffd640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a1406e730 0x7f6a140cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.361+0000 7f6a137fe640 1 -- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a1415c510 msgr2=0x7f6a14158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.361+0000 7f6a13fff640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a1415c510 0x7f6a14158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.361+0000 7f6a137fe640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a1415c510 0x7f6a14158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.361+0000 7f6a137fe640 1 -- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a1406e730 msgr2=0x7f6a140cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.361+0000 7f6a137fe640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a1406e730 0x7f6a140cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.361+0000 7f6a137fe640 1 -- 172.21.15.50:0/1447642504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a140ce210 con 0x7f6a14067f00 2024-09-11T22:15:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.361+0000 7f6a137fe640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a14067f00 0x7f6a140c9ee0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6a04000c00 tx=0x7f6a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.361+0000 7f69fbfff640 1 -- 172.21.15.50:0/1447642504 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04041020 con 0x7f6a14067f00 2024-09-11T22:15:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.361+0000 7f69fbfff640 1 -- 172.21.15.50:0/1447642504 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0403d640 con 0x7f6a14067f00 2024-09-11T22:15:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.361+0000 7f69fbfff640 1 -- 172.21.15.50:0/1447642504 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04037040 con 0x7f6a14067f00 2024-09-11T22:15:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.361+0000 7f6a1a065640 1 -- 172.21.15.50:0/1447642504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a140ce4f0 con 0x7f6a14067f00 2024-09-11T22:15:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.361+0000 7f6a1a065640 1 -- 172.21.15.50:0/1447642504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a140ceab0 con 0x7f6a14067f00 2024-09-11T22:15:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.362+0000 7f6a1a065640 1 -- 172.21.15.50:0/1447642504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a140679c0 con 0x7f6a14067f00 2024-09-11T22:15:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.363+0000 7f69fbfff640 1 -- 172.21.15.50:0/1447642504 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a04044020 con 0x7f6a14067f00 2024-09-11T22:15:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.363+0000 7f69fbfff640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a0006be30 0x7f6a0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.363+0000 7f69fbfff640 1 -- 172.21.15.50:0/1447642504 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f6a040ab5d0 con 0x7f6a14067f00 2024-09-11T22:15:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.363+0000 7f6a12ffd640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a0006be30 0x7f6a0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.364+0000 7f6a12ffd640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a0006be30 0x7f6a0006e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6a1414a9c0 tx=0x7f6a08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.368+0000 7f69fbfff640 1 -- 172.21.15.50:0/1447642504 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a0404b030 con 0x7f6a14067f00 2024-09-11T22:15:08.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.579+0000 7f6a1a065640 1 -- 172.21.15.50:0/1447642504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6a140b3ee0 con 0x7f6a14067f00 2024-09-11T22:15:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.615+0000 7f69fbfff640 1 -- 172.21.15.50:0/1447642504 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) ==== 118+0+0 (secure 0 0 0) 0x7f6a04079f90 con 0x7f6a14067f00 2024-09-11T22:15:08.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.617+0000 7f6a1a065640 1 -- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a0006be30 msgr2=0x7f6a0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.617+0000 7f6a1a065640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a0006be30 0x7f6a0006e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6a1414a9c0 tx=0x7f6a08008040 comp rx=0 tx=0).stop 2024-09-11T22:15:08.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.617+0000 7f6a1a065640 1 -- 172.21.15.50:0/1447642504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a14067f00 msgr2=0x7f6a140c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.617+0000 7f6a1a065640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a14067f00 0x7f6a140c9ee0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6a04000c00 tx=0x7f6a040046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.617+0000 7f6a1a065640 1 -- 172.21.15.50:0/1447642504 shutdown_connections 2024-09-11T22:15:08.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.617+0000 7f6a1a065640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a0006be30 0x7f6a0006e2f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.617+0000 7f6a1a065640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a1415c510 0x7f6a14158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.617+0000 7f6a1a065640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a1406e730 0x7f6a140cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.617+0000 7f6a1a065640 1 --2- 172.21.15.50:0/1447642504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a14067f00 0x7f6a140c9ee0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.617+0000 7f6a1a065640 1 -- 172.21.15.50:0/1447642504 >> 172.21.15.50:0/1447642504 conn(0x7f6a14075060 msgr2=0x7f6a1415dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:08.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.618+0000 7f6a1a065640 1 -- 172.21.15.50:0/1447642504 shutdown_connections 2024-09-11T22:15:08.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.618+0000 7f6a1a065640 1 -- 172.21.15.50:0/1447642504 wait complete. 2024-09-11T22:15:08.629 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:15:08.629 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:15:08.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.733+0000 7ff9510af640 1 Processor -- start 2024-09-11T22:15:08.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.733+0000 7ff9510af640 1 -- start start 2024-09-11T22:15:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff9510af640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff94c15e8e0 0x7ff94c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff9510af640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff94c0d1580 0x7ff94c0d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff9510af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff94c162350 0x7ff94c1627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff9510af640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff94c15ecc0 con 0x7ff94c15e8e0 2024-09-11T22:15:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff9510af640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff94c0d2ad0 con 0x7ff94c0d1580 2024-09-11T22:15:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff9510af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff94c0d3370 con 0x7ff94c162350 2024-09-11T22:15:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff94ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff94c15e8e0 0x7ff94c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff94ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff94c15e8e0 0x7ff94c0b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49994/0 (socket says 172.21.15.50:49994) 2024-09-11T22:15:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff94ad9d640 1 -- 172.21.15.50:0/3466628076 learned_addr learned my addr 172.21.15.50:0/3466628076 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:08.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff94ad9d640 1 -- 172.21.15.50:0/3466628076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff94c162350 msgr2=0x7ff94c1627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:08.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff94ad9d640 1 --2- 172.21.15.50:0/3466628076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff94c162350 0x7ff94c1627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff94ad9d640 1 -- 172.21.15.50:0/3466628076 >> v2:172.21.15.77:3300/0 conn(0x7ff94c0d1580 msgr2=0x7ff94c0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:08.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff943fff640 1 --2- 172.21.15.50:0/3466628076 >> v2:172.21.15.77:3300/0 conn(0x7ff94c0d1580 0x7ff94c0d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff94ad9d640 1 --2- 172.21.15.50:0/3466628076 >> v2:172.21.15.77:3300/0 conn(0x7ff94c0d1580 0x7ff94c0d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.734+0000 7ff94ad9d640 1 -- 172.21.15.50:0/3466628076 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94c0d1ee0 con 0x7ff94c15e8e0 2024-09-11T22:15:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.735+0000 7ff94ad9d640 1 --2- 172.21.15.50:0/3466628076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c15e8e0 0x7ff94c0b7880 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff94c1622b0 tx=0x7ff93c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e4231e91ed279c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.735+0000 7ff94a59c640 1 -- 172.21.15.50:0/3466628076 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c037070 con 0x7ff94c15e8e0 2024-09-11T22:15:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.735+0000 7ff94a59c640 1 -- 172.21.15.50:0/3466628076 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff93c032440 con 0x7ff94c15e8e0 2024-09-11T22:15:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.735+0000 7ff94a59c640 1 -- 172.21.15.50:0/3466628076 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c032810 con 0x7ff94c15e8e0 2024-09-11T22:15:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.736+0000 7ff9510af640 1 -- 172.21.15.50:0/3466628076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c15e8e0 msgr2=0x7ff94c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.736+0000 7ff9510af640 1 --2- 172.21.15.50:0/3466628076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c15e8e0 0x7ff94c0b7880 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff94c1622b0 tx=0x7ff93c02a270 comp rx=0 tx=0).stop 2024-09-11T22:15:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.736+0000 7ff9510af640 1 -- 172.21.15.50:0/3466628076 shutdown_connections 2024-09-11T22:15:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.736+0000 7ff9510af640 1 --2- 172.21.15.50:0/3466628076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff94c162350 0x7ff94c1627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.736+0000 7ff9510af640 1 --2- 172.21.15.50:0/3466628076 >> v2:172.21.15.77:3300/0 conn(0x7ff94c0d1580 0x7ff94c0d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.736+0000 7ff9510af640 1 --2- 172.21.15.50:0/3466628076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c15e8e0 0x7ff94c0b7880 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.736+0000 7ff9510af640 1 -- 172.21.15.50:0/3466628076 >> 172.21.15.50:0/3466628076 conn(0x7ff94c067ba0 msgr2=0x7ff94c067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.736+0000 7ff9510af640 1 -- 172.21.15.50:0/3466628076 shutdown_connections 2024-09-11T22:15:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.736+0000 7ff9510af640 1 -- 172.21.15.50:0/3466628076 wait complete. 2024-09-11T22:15:08.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.737+0000 7ff9510af640 1 Processor -- start 2024-09-11T22:15:08.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.737+0000 7ff9510af640 1 -- start start 2024-09-11T22:15:08.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff9510af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff94c0d1580 0x7ff94c15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff9510af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c15e8e0 0x7ff94c1f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff9510af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff94c162350 0x7ff94c0abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff9510af640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c0d3000 con 0x7ff94c15e8e0 2024-09-11T22:15:08.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff9510af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c0d2d20 con 0x7ff94c162350 2024-09-11T22:15:08.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff9510af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff94c162d20 con 0x7ff94c0d1580 2024-09-11T22:15:08.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff943fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c15e8e0 0x7ff94c1f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff943fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c15e8e0 0x7ff94c1f4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50004/0 (socket says 172.21.15.50:50004) 2024-09-11T22:15:08.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff943fff640 1 -- 172.21.15.50:0/2591246066 learned_addr learned my addr 172.21.15.50:0/2591246066 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:08.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff943fff640 1 -- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff94c0d1580 msgr2=0x7ff94c15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff94b59e640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff94c162350 0x7ff94c0abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff94ad9d640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff94c0d1580 0x7ff94c15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff943fff640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff94c0d1580 0x7ff94c15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff943fff640 1 -- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff94c162350 msgr2=0x7ff94c0abc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:08.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff943fff640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff94c162350 0x7ff94c0abc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:08.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff943fff640 1 -- 172.21.15.50:0/2591246066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94c0ac7e0 con 0x7ff94c15e8e0 2024-09-11T22:15:08.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff94ad9d640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff94c0d1580 0x7ff94c15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:08.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.738+0000 7ff94b59e640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff94c162350 0x7ff94c0abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:08.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.739+0000 7ff943fff640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c15e8e0 0x7ff94c1f4670 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c820 tx=0x7ff93400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:08.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.739+0000 7ff9437fe640 1 -- 172.21.15.50:0/2591246066 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934015070 con 0x7ff94c15e8e0 2024-09-11T22:15:08.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.739+0000 7ff9437fe640 1 -- 172.21.15.50:0/2591246066 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff934004240 con 0x7ff94c15e8e0 2024-09-11T22:15:08.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.739+0000 7ff9510af640 1 -- 172.21.15.50:0/2591246066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94c0ce6a0 con 0x7ff94c15e8e0 2024-09-11T22:15:08.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.739+0000 7ff9437fe640 1 -- 172.21.15.50:0/2591246066 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93400ce10 con 0x7ff94c15e8e0 2024-09-11T22:15:08.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.739+0000 7ff9510af640 1 -- 172.21.15.50:0/2591246066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94c0cbf90 con 0x7ff94c15e8e0 2024-09-11T22:15:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.740+0000 7ff9510af640 1 -- 172.21.15.50:0/2591246066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff94c0cbae0 con 0x7ff94c15e8e0 2024-09-11T22:15:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.740+0000 7ff9437fe640 1 -- 172.21.15.50:0/2591246066 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9340077d0 con 0x7ff94c15e8e0 2024-09-11T22:15:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.741+0000 7ff9437fe640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff92c06be30 0x7ff92c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.741+0000 7ff9437fe640 1 -- 172.21.15.50:0/2591246066 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7ff93408ad90 con 0x7ff94c15e8e0 2024-09-11T22:15:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.741+0000 7ff94ad9d640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff92c06be30 0x7ff92c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.742+0000 7ff94ad9d640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff92c06be30 0x7ff92c06e2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff93c034000 tx=0x7ff93c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.745+0000 7ff9437fe640 1 -- 172.21.15.50:0/2591246066 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff9340596a0 con 0x7ff94c15e8e0 2024-09-11T22:15:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:08.957+0000 7ff9510af640 1 -- 172.21.15.50:0/2591246066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff94c0ba770 con 0x7ff94c15e8e0 2024-09-11T22:15:09.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.619+0000 7ff9437fe640 1 -- 172.21.15.50:0/2591246066 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) ==== 122+0+0 (secure 0 0 0) 0x7ff934058fa0 con 0x7ff94c15e8e0 2024-09-11T22:15:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.622+0000 7ff9510af640 1 -- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff92c06be30 msgr2=0x7ff92c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.622+0000 7ff9510af640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff92c06be30 0x7ff92c06e2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff93c034000 tx=0x7ff93c02e000 comp rx=0 tx=0).stop 2024-09-11T22:15:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.622+0000 7ff9510af640 1 -- 172.21.15.50:0/2591246066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c15e8e0 msgr2=0x7ff94c1f4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.622+0000 7ff9510af640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c15e8e0 0x7ff94c1f4670 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c820 tx=0x7ff93400cce0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.622+0000 7ff9510af640 1 -- 172.21.15.50:0/2591246066 shutdown_connections 2024-09-11T22:15:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.622+0000 7ff9510af640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff92c06be30 0x7ff92c06e2f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.622+0000 7ff9510af640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff94c162350 0x7ff94c0abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.622+0000 7ff9510af640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff94c15e8e0 0x7ff94c1f4670 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.622+0000 7ff9510af640 1 --2- 172.21.15.50:0/2591246066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff94c0d1580 0x7ff94c15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.622+0000 7ff9510af640 1 -- 172.21.15.50:0/2591246066 >> 172.21.15.50:0/2591246066 conn(0x7ff94c067ba0 msgr2=0x7ff94c067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:09.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.622+0000 7ff9510af640 1 -- 172.21.15.50:0/2591246066 shutdown_connections 2024-09-11T22:15:09.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.622+0000 7ff9510af640 1 -- 172.21.15.50:0/2591246066 wait complete. 2024-09-11T22:15:09.635 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:15:09.635 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:09.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.740+0000 7f37e8f9f640 1 Processor -- start 2024-09-11T22:15:09.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.740+0000 7f37e8f9f640 1 -- start start 2024-09-11T22:15:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.741+0000 7f37e8f9f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37e4162a60 0x7f37e40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.741+0000 7f37e8f9f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e4163080 con 0x7f37e415e8e0 2024-09-11T22:15:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.741+0000 7f37e8f9f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e40d2d20 con 0x7f37e40d1c90 2024-09-11T22:15:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.741+0000 7f37e8f9f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f37e415ecc0 con 0x7f37e4162a60 2024-09-11T22:15:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.741+0000 7f37e259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f37e415e8e0 0x7f37e40d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56360/0 (socket says 172.21.15.50:56360) 2024-09-11T22:15:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.741+0000 7f37e259c640 1 -- 172.21.15.50:0/538901610 learned_addr learned my addr 172.21.15.50:0/538901610 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.741+0000 7f37e2d9d640 1 --2- 172.21.15.50:0/538901610 >> v2:172.21.15.50:3300/0 conn(0x7f37e4162a60 0x7f37e40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.741+0000 7f37e2d9d640 1 -- 172.21.15.50:0/538901610 >> v1:172.21.15.77:6789/0 conn(0x7f37e40d1c90 legacy=0x7f37e4162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.741+0000 7f37e2d9d640 1 -- 172.21.15.50:0/538901610 >> v1:172.21.15.50:6789/0 conn(0x7f37e415e8e0 legacy=0x7f37e40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.741+0000 7f37e2d9d640 1 -- 172.21.15.50:0/538901610 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e40d3000 con 0x7f37e4162a60 2024-09-11T22:15:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.742+0000 7f37e2d9d640 1 --2- 172.21.15.50:0/538901610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4162a60 0x7f37e40b7880 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f37dc009d90 tx=0x7f37dc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68baf927f3c2468 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.742+0000 7f37e159a640 1 -- 172.21.15.50:0/538901610 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc007740 con 0x7f37e4162a60 2024-09-11T22:15:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.742+0000 7f37e159a640 1 -- 172.21.15.50:0/538901610 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37dc0078e0 con 0x7f37e4162a60 2024-09-11T22:15:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.742+0000 7f37e159a640 1 -- 172.21.15.50:0/538901610 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc007cb0 con 0x7f37e4162a60 2024-09-11T22:15:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.743+0000 7f37e8f9f640 1 -- 172.21.15.50:0/538901610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4162a60 msgr2=0x7f37e40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.743+0000 7f37e8f9f640 1 --2- 172.21.15.50:0/538901610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4162a60 0x7f37e40b7880 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f37dc009d90 tx=0x7f37dc02a730 comp rx=0 tx=0).stop 2024-09-11T22:15:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.743+0000 7f37e8f9f640 1 -- 172.21.15.50:0/538901610 shutdown_connections 2024-09-11T22:15:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.743+0000 7f37e8f9f640 1 --2- 172.21.15.50:0/538901610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4162a60 0x7f37e40b7880 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.743+0000 7f37e8f9f640 1 -- 172.21.15.50:0/538901610 >> 172.21.15.50:0/538901610 conn(0x7f37e4067ba0 msgr2=0x7f37e4067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.743+0000 7f37e8f9f640 1 -- 172.21.15.50:0/538901610 shutdown_connections 2024-09-11T22:15:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.743+0000 7f37e8f9f640 1 -- 172.21.15.50:0/538901610 wait complete. 2024-09-11T22:15:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.744+0000 7f37e8f9f640 1 Processor -- start 2024-09-11T22:15:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.744+0000 7f37e8f9f640 1 -- start start 2024-09-11T22:15:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e8f9f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e40d1c90 0x7f37e40acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e8f9f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37e415e8e0 0x7f37e40cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e8f9f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37e4162a60 0x7f37e415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e8f9f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f37e40d3c10 con 0x7f37e40d1c90 2024-09-11T22:15:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e8f9f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f37e40d3a90 con 0x7f37e4162a60 2024-09-11T22:15:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e8f9f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f37e40d3d90 con 0x7f37e415e8e0 2024-09-11T22:15:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e40d1c90 0x7f37e40acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e40d1c90 0x7f37e40acb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50018/0 (socket says 172.21.15.50:50018) 2024-09-11T22:15:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e259c640 1 -- 172.21.15.50:0/261649853 learned_addr learned my addr 172.21.15.50:0/261649853 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e259c640 1 -- 172.21.15.50:0/261649853 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37e415e8e0 msgr2=0x7f37e40cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e259c640 1 --2- 172.21.15.50:0/261649853 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37e415e8e0 0x7f37e40cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e259c640 1 -- 172.21.15.50:0/261649853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37e4162a60 msgr2=0x7f37e415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e2d9d640 1 --2- 172.21.15.50:0/261649853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37e4162a60 0x7f37e415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e259c640 1 --2- 172.21.15.50:0/261649853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37e4162a60 0x7f37e415b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.745+0000 7f37e259c640 1 -- 172.21.15.50:0/261649853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e40abe10 con 0x7f37e40d1c90 2024-09-11T22:15:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.746+0000 7f37e259c640 1 --2- 172.21.15.50:0/261649853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e40d1c90 0x7f37e40acb90 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f37d400c430 tx=0x7f37d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.746+0000 7f37daffd640 1 -- 172.21.15.50:0/261649853 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4017070 con 0x7f37e40d1c90 2024-09-11T22:15:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.746+0000 7f37daffd640 1 -- 172.21.15.50:0/261649853 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d4005ce0 con 0x7f37e40d1c90 2024-09-11T22:15:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.746+0000 7f37e8f9f640 1 -- 172.21.15.50:0/261649853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e40ac0b0 con 0x7f37e40d1c90 2024-09-11T22:15:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.746+0000 7f37daffd640 1 -- 172.21.15.50:0/261649853 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d40072f0 con 0x7f37e40d1c90 2024-09-11T22:15:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.746+0000 7f37e8f9f640 1 -- 172.21.15.50:0/261649853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e40cd790 con 0x7f37e40d1c90 2024-09-11T22:15:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.747+0000 7f37e8f9f640 1 -- 172.21.15.50:0/261649853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e40b7880 con 0x7f37e40d1c90 2024-09-11T22:15:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.747+0000 7f37daffd640 1 -- 172.21.15.50:0/261649853 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37d401a070 con 0x7f37e40d1c90 2024-09-11T22:15:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.748+0000 7f37daffd640 1 --2- 172.21.15.50:0/261649853 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f37c406be30 0x7f37c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.748+0000 7f37daffd640 1 -- 172.21.15.50:0/261649853 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f37d408a1d0 con 0x7f37e40d1c90 2024-09-11T22:15:09.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.748+0000 7f37e1d9b640 1 --2- 172.21.15.50:0/261649853 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f37c406be30 0x7f37c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:09.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.749+0000 7f37e1d9b640 1 --2- 172.21.15.50:0/261649853 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f37c406be30 0x7f37c406e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f37e415e320 tx=0x7f37cc0079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:09.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.752+0000 7f37daffd640 1 -- 172.21.15.50:0/261649853 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37d4058c10 con 0x7f37e40d1c90 2024-09-11T22:15:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.962+0000 7f37e8f9f640 1 -- 172.21.15.50:0/261649853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37e415e070 con 0x7f37e40d1c90 2024-09-11T22:15:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.963+0000 7f37daffd640 1 -- 172.21.15.50:0/261649853 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f37d4058510 con 0x7f37e40d1c90 2024-09-11T22:15:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:09.964 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":47,"btime":"2024-09-11T22:15:09:616633+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6151,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1710208890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1710208890},{"type":"v1","addr":"172.21.15.50:6835","nonce":1710208890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/784761109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":784761109},{"type":"v1","addr":"172.21.15.77:6836","nonce":784761109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6160,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1115358060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1115358060},{"type":"v1","addr":"172.21.15.77:6837","nonce":1115358060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:06.945196+0000","modified":"2024-09-11T22:15:08.958948+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6648},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6648":{"gid":6648,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/4265727513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4265727513},{"type":"v1","addr":"172.21.15.50:6834","nonce":4265727513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6648,"qdb_cluster":[6648]},"id":5}]} 2024-09-11T22:15:09.964 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 47 2024-09-11T22:15:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.965+0000 7f37e8f9f640 1 -- 172.21.15.50:0/261649853 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f37c406be30 msgr2=0x7f37c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.965+0000 7f37e8f9f640 1 --2- 172.21.15.50:0/261649853 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f37c406be30 0x7f37c406e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f37e415e320 tx=0x7f37cc0079b0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.965+0000 7f37e8f9f640 1 -- 172.21.15.50:0/261649853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e40d1c90 msgr2=0x7f37e40acb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.965+0000 7f37e8f9f640 1 --2- 172.21.15.50:0/261649853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e40d1c90 0x7f37e40acb90 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f37d400c430 tx=0x7f37d400c8f0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.965+0000 7f37e8f9f640 1 -- 172.21.15.50:0/261649853 shutdown_connections 2024-09-11T22:15:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.965+0000 7f37e8f9f640 1 --2- 172.21.15.50:0/261649853 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f37c406be30 0x7f37c406e2f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.965+0000 7f37e8f9f640 1 --2- 172.21.15.50:0/261649853 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37e415e8e0 0x7f37e40cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.965+0000 7f37e8f9f640 1 --2- 172.21.15.50:0/261649853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37e4162a60 0x7f37e415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.965+0000 7f37e8f9f640 1 --2- 172.21.15.50:0/261649853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e40d1c90 0x7f37e40acb90 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.965+0000 7f37e8f9f640 1 -- 172.21.15.50:0/261649853 >> 172.21.15.50:0/261649853 conn(0x7f37e4067ba0 msgr2=0x7f37e415f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.965+0000 7f37e8f9f640 1 -- 172.21.15.50:0/261649853 shutdown_connections 2024-09-11T22:15:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:09.965+0000 7f37e8f9f640 1 -- 172.21.15.50:0/261649853 wait complete. 2024-09-11T22:15:09.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:15:10.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.078+0000 7efe790d7640 1 Processor -- start 2024-09-11T22:15:10.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.078+0000 7efe790d7640 1 -- start start 2024-09-11T22:15:10.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.078+0000 7efe790d7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efe7415e870 0x7efe740d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.078+0000 7efe790d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efe740d3c00 0x7efe740b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.078+0000 7efe790d7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe740cfa80 con 0x7efe740d16d0 2024-09-11T22:15:10.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.078+0000 7efe790d7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7efe740d1b40 con 0x7efe7415e870 2024-09-11T22:15:10.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.078+0000 7efe790d7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efe740d40d0 con 0x7efe740d3c00 2024-09-11T22:15:10.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.079+0000 7efe72d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efe7415e870 0x7efe740d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.079+0000 7efe72d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efe7415e870 0x7efe740d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50030/0 (socket says 172.21.15.50:50030) 2024-09-11T22:15:10.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.079+0000 7efe72d9d640 1 -- 172.21.15.50:0/948610579 learned_addr learned my addr 172.21.15.50:0/948610579 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:10.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.079+0000 7efe7359e640 1 --2- 172.21.15.50:0/948610579 >> v2:172.21.15.77:3300/0 conn(0x7efe740d3c00 0x7efe740b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.079+0000 7efe72d9d640 1 -- 172.21.15.50:0/948610579 >> v2:172.21.15.77:3300/0 conn(0x7efe740d3c00 msgr2=0x7efe740b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:10.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.079+0000 7efe72d9d640 1 --2- 172.21.15.50:0/948610579 >> v2:172.21.15.77:3300/0 conn(0x7efe740d3c00 0x7efe740b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.079+0000 7efe72d9d640 1 -- 172.21.15.50:0/948610579 >> v1:172.21.15.77:6789/0 conn(0x7efe740d16d0 legacy=0x7efe740d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:10.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.079+0000 7efe72d9d640 1 -- 172.21.15.50:0/948610579 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe740d43b0 con 0x7efe7415e870 2024-09-11T22:15:10.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.079+0000 7efe7359e640 1 --2- 172.21.15.50:0/948610579 >> v2:172.21.15.77:3300/0 conn(0x7efe740d3c00 0x7efe740b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:10.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.080+0000 7efe72d9d640 1 --2- 172.21.15.50:0/948610579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe7415e870 0x7efe740d1190 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7efe74068490 tx=0x7efe6402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdbfbf3ff881221 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:10.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.080+0000 7efe71d9b640 1 -- 172.21.15.50:0/948610579 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe64037070 con 0x7efe7415e870 2024-09-11T22:15:10.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.080+0000 7efe71d9b640 1 -- 172.21.15.50:0/948610579 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe64032440 con 0x7efe7415e870 2024-09-11T22:15:10.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.080+0000 7efe71d9b640 1 -- 172.21.15.50:0/948610579 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe64032810 con 0x7efe7415e870 2024-09-11T22:15:10.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.080+0000 7efe790d7640 1 -- 172.21.15.50:0/948610579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe7415e870 msgr2=0x7efe740d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.080+0000 7efe790d7640 1 --2- 172.21.15.50:0/948610579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe7415e870 0x7efe740d1190 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7efe74068490 tx=0x7efe6402a230 comp rx=0 tx=0).stop 2024-09-11T22:15:10.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.080+0000 7efe790d7640 1 -- 172.21.15.50:0/948610579 shutdown_connections 2024-09-11T22:15:10.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.080+0000 7efe790d7640 1 --2- 172.21.15.50:0/948610579 >> v2:172.21.15.77:3300/0 conn(0x7efe740d3c00 0x7efe740b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.080+0000 7efe790d7640 1 --2- 172.21.15.50:0/948610579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe7415e870 0x7efe740d1190 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.080+0000 7efe790d7640 1 -- 172.21.15.50:0/948610579 >> 172.21.15.50:0/948610579 conn(0x7efe740727a0 msgr2=0x7efe740679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:10.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.080+0000 7efe790d7640 1 -- 172.21.15.50:0/948610579 shutdown_connections 2024-09-11T22:15:10.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.080+0000 7efe790d7640 1 -- 172.21.15.50:0/948610579 wait complete. 2024-09-11T22:15:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.082+0000 7efe790d7640 1 Processor -- start 2024-09-11T22:15:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.082+0000 7efe790d7640 1 -- start start 2024-09-11T22:15:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe790d7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe740d16d0 0x7efe740cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe790d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe740d3c00 0x7efe74160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe790d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe7415e870 0x7efe741611f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe790d7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efe7415ec50 con 0x7efe7415e870 2024-09-11T22:15:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe790d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efe740b7ee0 con 0x7efe740d3c00 2024-09-11T22:15:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe790d7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efe740b78b0 con 0x7efe740d16d0 2024-09-11T22:15:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe7359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe7415e870 0x7efe741611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe7359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe7415e870 0x7efe741611f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50038/0 (socket says 172.21.15.50:50038) 2024-09-11T22:15:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe7359e640 1 -- 172.21.15.50:0/4066635595 learned_addr learned my addr 172.21.15.50:0/4066635595 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe72d9d640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe740d16d0 0x7efe740cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe7259c640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe740d3c00 0x7efe74160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe7359e640 1 -- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe740d16d0 msgr2=0x7efe740cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe7359e640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe740d16d0 0x7efe740cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe7359e640 1 -- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe740d3c00 msgr2=0x7efe74160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe7359e640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe740d3c00 0x7efe74160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe7359e640 1 -- 172.21.15.50:0/4066635595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe740cb9f0 con 0x7efe7415e870 2024-09-11T22:15:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe7259c640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe740d3c00 0x7efe74160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe72d9d640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe740d16d0 0x7efe740cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe7359e640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe7415e870 0x7efe741611f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00ce80 tx=0x7efe6c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe5b7fe640 1 -- 172.21.15.50:0/4066635595 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c01a070 con 0x7efe7415e870 2024-09-11T22:15:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe5b7fe640 1 -- 172.21.15.50:0/4066635595 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe6c00d880 con 0x7efe7415e870 2024-09-11T22:15:10.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.083+0000 7efe790d7640 1 -- 172.21.15.50:0/4066635595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe740cbcd0 con 0x7efe7415e870 2024-09-11T22:15:10.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.084+0000 7efe5b7fe640 1 -- 172.21.15.50:0/4066635595 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00dc70 con 0x7efe7415e870 2024-09-11T22:15:10.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.084+0000 7efe790d7640 1 -- 172.21.15.50:0/4066635595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe740cc290 con 0x7efe7415e870 2024-09-11T22:15:10.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.085+0000 7efe790d7640 1 -- 172.21.15.50:0/4066635595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe740d1190 con 0x7efe7415e870 2024-09-11T22:15:10.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.085+0000 7efe5b7fe640 1 -- 172.21.15.50:0/4066635595 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe6c01d070 con 0x7efe7415e870 2024-09-11T22:15:10.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.086+0000 7efe5b7fe640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efe6006be30 0x7efe6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.086+0000 7efe5b7fe640 1 -- 172.21.15.50:0/4066635595 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7efe6c08b580 con 0x7efe7415e870 2024-09-11T22:15:10.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.086+0000 7efe72d9d640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efe6006be30 0x7efe6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.086+0000 7efe72d9d640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efe6006be30 0x7efe6006e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efe64034000 tx=0x7efe6402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:10.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.090+0000 7efe5b7fe640 1 -- 172.21.15.50:0/4066635595 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe6c059970 con 0x7efe7415e870 2024-09-11T22:15:10.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.266+0000 7efe790d7640 1 -- 172.21.15.50:0/4066635595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe740c8030 con 0x7efe7415e870 2024-09-11T22:15:10.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.267+0000 7efe5b7fe640 1 -- 172.21.15.50:0/4066635595 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16692 (secure 0 0 0) 0x7efe6c05dc70 con 0x7efe7415e870 2024-09-11T22:15:10.268 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:10.268 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":74,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:15:08.610006+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:15:04.606994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T22:15:05.937484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:15:10.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.269+0000 7efe790d7640 1 -- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efe6006be30 msgr2=0x7efe6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.269+0000 7efe790d7640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efe6006be30 0x7efe6006e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efe64034000 tx=0x7efe6402e000 comp rx=0 tx=0).stop 2024-09-11T22:15:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.269+0000 7efe790d7640 1 -- 172.21.15.50:0/4066635595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe7415e870 msgr2=0x7efe741611f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.269+0000 7efe790d7640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe7415e870 0x7efe741611f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00ce80 tx=0x7efe6c00a710 comp rx=0 tx=0).stop 2024-09-11T22:15:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.269+0000 7efe790d7640 1 -- 172.21.15.50:0/4066635595 shutdown_connections 2024-09-11T22:15:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.269+0000 7efe790d7640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efe6006be30 0x7efe6006e2f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.269+0000 7efe790d7640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe7415e870 0x7efe741611f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.269+0000 7efe790d7640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe740d3c00 0x7efe74160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.269+0000 7efe790d7640 1 --2- 172.21.15.50:0/4066635595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe740d16d0 0x7efe740cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.269+0000 7efe790d7640 1 -- 172.21.15.50:0/4066635595 >> 172.21.15.50:0/4066635595 conn(0x7efe740727a0 msgr2=0x7efe740b9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.269+0000 7efe790d7640 1 -- 172.21.15.50:0/4066635595 shutdown_connections 2024-09-11T22:15:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.269+0000 7efe790d7640 1 -- 172.21.15.50:0/4066635595 wait complete. 2024-09-11T22:15:10.281 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:15:10.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:15:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.383+0000 7f24be16d640 1 Processor -- start 2024-09-11T22:15:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.383+0000 7f24be16d640 1 -- start start 2024-09-11T22:15:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.384+0000 7f24be16d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24b815e8e0 0x7f24b80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.384+0000 7f24be16d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24b80d1580 0x7f24b80d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.384+0000 7f24be16d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24b80d1ee0 con 0x7f24b8162350 2024-09-11T22:15:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.384+0000 7f24be16d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f24b815ecc0 con 0x7f24b815e8e0 2024-09-11T22:15:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.384+0000 7f24be16d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f24b80d2ad0 con 0x7f24b80d1580 2024-09-11T22:15:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.384+0000 7f24b77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24b815e8e0 0x7f24b80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.384+0000 7f24b77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24b815e8e0 0x7f24b80b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50044/0 (socket says 172.21.15.50:50044) 2024-09-11T22:15:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.384+0000 7f24b77fe640 1 -- 172.21.15.50:0/3751723732 learned_addr learned my addr 172.21.15.50:0/3751723732 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.384+0000 7f24b6ffd640 1 --2- 172.21.15.50:0/3751723732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24b80d1580 0x7f24b80d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.384+0000 7f24b77fe640 1 -- 172.21.15.50:0/3751723732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24b80d1580 msgr2=0x7f24b80d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.384+0000 7f24b77fe640 1 --2- 172.21.15.50:0/3751723732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24b80d1580 0x7f24b80d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.384+0000 7f24b77fe640 1 -- 172.21.15.50:0/3751723732 >> v1:172.21.15.77:6789/0 conn(0x7f24b8162350 legacy=0x7f24b8162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.384+0000 7f24b77fe640 1 -- 172.21.15.50:0/3751723732 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b8163080 con 0x7f24b815e8e0 2024-09-11T22:15:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.385+0000 7f24b77fe640 1 --2- 172.21.15.50:0/3751723732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24b815e8e0 0x7f24b80b7880 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009870 tx=0x7f24a802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86aa593698e702ee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.385+0000 7f24b67fc640 1 -- 172.21.15.50:0/3751723732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8037070 con 0x7f24b815e8e0 2024-09-11T22:15:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.385+0000 7f24b67fc640 1 -- 172.21.15.50:0/3751723732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a8032440 con 0x7f24b815e8e0 2024-09-11T22:15:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.385+0000 7f24b67fc640 1 -- 172.21.15.50:0/3751723732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8032810 con 0x7f24b815e8e0 2024-09-11T22:15:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.386+0000 7f24be16d640 1 -- 172.21.15.50:0/3751723732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24b815e8e0 msgr2=0x7f24b80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.386+0000 7f24be16d640 1 --2- 172.21.15.50:0/3751723732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24b815e8e0 0x7f24b80b7880 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009870 tx=0x7f24a802a2a0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.386+0000 7f24be16d640 1 -- 172.21.15.50:0/3751723732 shutdown_connections 2024-09-11T22:15:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.386+0000 7f24be16d640 1 --2- 172.21.15.50:0/3751723732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24b80d1580 0x7f24b80d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.386+0000 7f24be16d640 1 --2- 172.21.15.50:0/3751723732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24b815e8e0 0x7f24b80b7880 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.386+0000 7f24be16d640 1 -- 172.21.15.50:0/3751723732 >> 172.21.15.50:0/3751723732 conn(0x7f24b8067ba0 msgr2=0x7f24b8067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.386+0000 7f24be16d640 1 -- 172.21.15.50:0/3751723732 shutdown_connections 2024-09-11T22:15:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.386+0000 7f24be16d640 1 -- 172.21.15.50:0/3751723732 wait complete. 2024-09-11T22:15:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.387+0000 7f24be16d640 1 Processor -- start 2024-09-11T22:15:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.387+0000 7f24be16d640 1 -- start start 2024-09-11T22:15:10.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24be16d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24b80d1580 0x7f24b80cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24be16d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24b815e8e0 0x7f24b80cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24be16d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8162350 0x7f24b80cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24be16d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24b80d3000 con 0x7f24b80d1580 2024-09-11T22:15:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24be16d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24b80d3370 con 0x7f24b8162350 2024-09-11T22:15:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24be16d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f24b80d3800 con 0x7f24b815e8e0 2024-09-11T22:15:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24b77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24b80d1580 0x7f24b80cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24b77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24b80d1580 0x7f24b80cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50046/0 (socket says 172.21.15.50:50046) 2024-09-11T22:15:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24b77fe640 1 -- 172.21.15.50:0/2753484650 learned_addr learned my addr 172.21.15.50:0/2753484650 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24b6ffd640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24b815e8e0 0x7f24b80cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24b7fff640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8162350 0x7f24b80cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24b77fe640 1 -- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24b815e8e0 msgr2=0x7f24b80cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24b77fe640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24b815e8e0 0x7f24b80cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24b77fe640 1 -- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8162350 msgr2=0x7f24b80cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24b77fe640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8162350 0x7f24b80cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24b77fe640 1 -- 172.21.15.50:0/2753484650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b81f4b10 con 0x7f24b80d1580 2024-09-11T22:15:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24b6ffd640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24b815e8e0 0x7f24b80cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f24b77fe640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24b80d1580 0x7f24b80cd4f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009870 tx=0x7f24a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f249ffff640 1 -- 172.21.15.50:0/2753484650 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8041070 con 0x7f24b80d1580 2024-09-11T22:15:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.388+0000 7f249ffff640 1 -- 172.21.15.50:0/2753484650 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a803c870 con 0x7f24b80d1580 2024-09-11T22:15:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.389+0000 7f24be16d640 1 -- 172.21.15.50:0/2753484650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b80cc430 con 0x7f24b80d1580 2024-09-11T22:15:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.389+0000 7f249ffff640 1 -- 172.21.15.50:0/2753484650 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8037040 con 0x7f24b80d1580 2024-09-11T22:15:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.389+0000 7f24be16d640 1 -- 172.21.15.50:0/2753484650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b81e8100 con 0x7f24b80d1580 2024-09-11T22:15:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.389+0000 7f24be16d640 1 -- 172.21.15.50:0/2753484650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b80cc820 con 0x7f24b80d1580 2024-09-11T22:15:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.390+0000 7f249ffff640 1 -- 172.21.15.50:0/2753484650 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24a8044070 con 0x7f24b80d1580 2024-09-11T22:15:10.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.391+0000 7f249ffff640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f24a406be30 0x7f24a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.391+0000 7f249ffff640 1 -- 172.21.15.50:0/2753484650 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f24a80ab970 con 0x7f24b80d1580 2024-09-11T22:15:10.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.391+0000 7f24b6ffd640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f24a406be30 0x7f24a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.391+0000 7f24b6ffd640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f24a406be30 0x7f24a406e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f24ac006fd0 tx=0x7f24ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:10.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.395+0000 7f249ffff640 1 -- 172.21.15.50:0/2753484650 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24a8079cd0 con 0x7f24b80d1580 2024-09-11T22:15:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.567+0000 7f24be16d640 1 -- 172.21.15.50:0/2753484650 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24b80d19a0 con 0x7f24a406be30 2024-09-11T22:15:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.573+0000 7f249ffff640 1 -- 172.21.15.50:0/2753484650 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249534 (secure 0 0 0) 0x7f24b80d19a0 con 0x7f24a406be30 2024-09-11T22:15:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:15:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.576+0000 7f24be16d640 1 -- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f24a406be30 msgr2=0x7f24a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.576+0000 7f24be16d640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f24a406be30 0x7f24a406e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f24ac006fd0 tx=0x7f24ac008040 comp rx=0 tx=0).stop 2024-09-11T22:15:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.576+0000 7f24be16d640 1 -- 172.21.15.50:0/2753484650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24b80d1580 msgr2=0x7f24b80cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.576+0000 7f24be16d640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24b80d1580 0x7f24b80cd4f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009870 tx=0x7f24a80046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.577+0000 7f24be16d640 1 -- 172.21.15.50:0/2753484650 shutdown_connections 2024-09-11T22:15:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.577+0000 7f24be16d640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f24a406be30 0x7f24a406e2f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.577+0000 7f24be16d640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24b815e8e0 0x7f24b80cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.577+0000 7f24be16d640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24b8162350 0x7f24b80cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.577+0000 7f24be16d640 1 --2- 172.21.15.50:0/2753484650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24b80d1580 0x7f24b80cd4f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.577+0000 7f24be16d640 1 -- 172.21.15.50:0/2753484650 >> 172.21.15.50:0/2753484650 conn(0x7f24b8067ba0 msgr2=0x7f24b80b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.577+0000 7f24be16d640 1 -- 172.21.15.50:0/2753484650 shutdown_connections 2024-09-11T22:15:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.577+0000 7f24be16d640 1 -- 172.21.15.50:0/2753484650 wait complete. 2024-09-11T22:15:10.588 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-11T22:15:09.419827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":286752,"kb_used_data":8108,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754687968,"statfs":{"total":773094113280,"available":772800479232,"internally_reserved":0,"allocated":8302592,"data_stored":4187139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000766"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.591960+0000","last_change":"2024-09-11T22:15:06.591960+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.591960+0000","last_undegraded":"2024-09-11T22:15:06.591960+0000","last_fullsized":"2024-09-11T22:15:06.591960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950901+0000","last_change":"2024-09-11T22:15:07.620683+0000","last_active":"2024-09-11T22:15:08.950901+0000","last_peered":"2024-09-11T22:15:08.950901+0000","last_clean":"2024-09-11T22:15:08.950901+0000","last_became_active":"2024-09-11T22:15:07.620387+0000","last_became_peered":"2024-09-11T22:15:07.620387+0000","last_unstale":"2024-09-11T22:15:08.950901+0000","last_undegraded":"2024-09-11T22:15:08.950901+0000","last_fullsized":"2024-09-11T22:15:08.950901+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:45.541045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989555+0000","last_change":"2024-09-11T22:15:07.614508+0000","last_active":"2024-09-11T22:15:08.989555+0000","last_peered":"2024-09-11T22:15:08.989555+0000","last_clean":"2024-09-11T22:15:08.989555+0000","last_became_active":"2024-09-11T22:15:07.614209+0000","last_became_peered":"2024-09-11T22:15:07.614209+0000","last_unstale":"2024-09-11T22:15:08.989555+0000","last_undegraded":"2024-09-11T22:15:08.989555+0000","last_fullsized":"2024-09-11T22:15:08.989555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:29.618768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990158+0000","last_change":"2024-09-11T22:15:07.620641+0000","last_active":"2024-09-11T22:15:08.990158+0000","last_peered":"2024-09-11T22:15:08.990158+0000","last_clean":"2024-09-11T22:15:08.990158+0000","last_became_active":"2024-09-11T22:15:07.620131+0000","last_became_peered":"2024-09-11T22:15:07.620131+0000","last_unstale":"2024-09-11T22:15:08.990158+0000","last_undegraded":"2024-09-11T22:15:08.990158+0000","last_fullsized":"2024-09-11T22:15:08.990158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:03.304172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950671+0000","last_change":"2024-09-11T22:15:07.620053+0000","last_active":"2024-09-11T22:15:08.950671+0000","last_peered":"2024-09-11T22:15:08.950671+0000","last_clean":"2024-09-11T22:15:08.950671+0000","last_became_active":"2024-09-11T22:15:07.619773+0000","last_became_peered":"2024-09-11T22:15:07.619773+0000","last_unstale":"2024-09-11T22:15:08.950671+0000","last_undegraded":"2024-09-11T22:15:08.950671+0000","last_fullsized":"2024-09-11T22:15:08.950671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:11.698238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615362+0000","last_change":"2024-09-11T22:15:07.611744+0000","last_active":"2024-09-11T22:15:08.615362+0000","last_peered":"2024-09-11T22:15:08.615362+0000","last_clean":"2024-09-11T22:15:08.615362+0000","last_became_active":"2024-09-11T22:15:07.611448+0000","last_became_peered":"2024-09-11T22:15:07.611448+0000","last_unstale":"2024-09-11T22:15:08.615362+0000","last_undegraded":"2024-09-11T22:15:08.615362+0000","last_fullsized":"2024-09-11T22:15:08.615362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:07.621973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950531+0000","last_change":"2024-09-11T22:15:07.626253+0000","last_active":"2024-09-11T22:15:08.950531+0000","last_peered":"2024-09-11T22:15:08.950531+0000","last_clean":"2024-09-11T22:15:08.950531+0000","last_became_active":"2024-09-11T22:15:07.625925+0000","last_became_peered":"2024-09-11T22:15:07.625925+0000","last_unstale":"2024-09-11T22:15:08.950531+0000","last_undegraded":"2024-09-11T22:15:08.950531+0000","last_fullsized":"2024-09-11T22:15:08.950531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:24.963984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615200+0000","last_change":"2024-09-11T22:15:07.623030+0000","last_active":"2024-09-11T22:15:08.615200+0000","last_peered":"2024-09-11T22:15:08.615200+0000","last_clean":"2024-09-11T22:15:08.615200+0000","last_became_active":"2024-09-11T22:15:07.622629+0000","last_became_peered":"2024-09-11T22:15:07.622629+0000","last_unstale":"2024-09-11T22:15:08.615200+0000","last_undegraded":"2024-09-11T22:15:08.615200+0000","last_fullsized":"2024-09-11T22:15:08.615200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:21.595561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.591032+0000","last_change":"2024-09-11T22:15:06.591032+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.591032+0000","last_undegraded":"2024-09-11T22:15:06.591032+0000","last_fullsized":"2024-09-11T22:15:06.591032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990214+0000","last_change":"2024-09-11T22:15:07.621753+0000","last_active":"2024-09-11T22:15:08.990214+0000","last_peered":"2024-09-11T22:15:08.990214+0000","last_clean":"2024-09-11T22:15:08.990214+0000","last_became_active":"2024-09-11T22:15:07.621469+0000","last_became_peered":"2024-09-11T22:15:07.621469+0000","last_unstale":"2024-09-11T22:15:08.990214+0000","last_undegraded":"2024-09-11T22:15:08.990214+0000","last_fullsized":"2024-09-11T22:15:08.990214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:57.372042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612759+0000","last_change":"2024-09-11T22:15:07.620776+0000","last_active":"2024-09-11T22:15:08.612759+0000","last_peered":"2024-09-11T22:15:08.612759+0000","last_clean":"2024-09-11T22:15:08.612759+0000","last_became_active":"2024-09-11T22:15:07.620512+0000","last_became_peered":"2024-09-11T22:15:07.620512+0000","last_unstale":"2024-09-11T22:15:08.612759+0000","last_undegraded":"2024-09-11T22:15:08.612759+0000","last_fullsized":"2024-09-11T22:15:08.612759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:17.012661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612736+0000","last_change":"2024-09-11T22:15:07.613812+0000","last_active":"2024-09-11T22:15:08.612736+0000","last_peered":"2024-09-11T22:15:08.612736+0000","last_clean":"2024-09-11T22:15:08.612736+0000","last_became_active":"2024-09-11T22:15:07.613488+0000","last_became_peered":"2024-09-11T22:15:07.613488+0000","last_unstale":"2024-09-11T22:15:08.612736+0000","last_undegraded":"2024-09-11T22:15:08.612736+0000","last_fullsized":"2024-09-11T22:15:08.612736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:47.977968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614827+0000","last_change":"2024-09-11T22:15:07.621039+0000","last_active":"2024-09-11T22:15:08.614827+0000","last_peered":"2024-09-11T22:15:08.614827+0000","last_clean":"2024-09-11T22:15:08.614827+0000","last_became_active":"2024-09-11T22:15:07.620669+0000","last_became_peered":"2024-09-11T22:15:07.620669+0000","last_unstale":"2024-09-11T22:15:08.614827+0000","last_undegraded":"2024-09-11T22:15:08.614827+0000","last_fullsized":"2024-09-11T22:15:08.614827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:33.307854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990303+0000","last_change":"2024-09-11T22:15:07.624157+0000","last_active":"2024-09-11T22:15:08.990303+0000","last_peered":"2024-09-11T22:15:08.990303+0000","last_clean":"2024-09-11T22:15:08.990303+0000","last_became_active":"2024-09-11T22:15:07.622120+0000","last_became_peered":"2024-09-11T22:15:07.622120+0000","last_unstale":"2024-09-11T22:15:08.990303+0000","last_undegraded":"2024-09-11T22:15:08.990303+0000","last_fullsized":"2024-09-11T22:15:08.990303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:31.693477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950600+0000","last_change":"2024-09-11T22:15:07.625050+0000","last_active":"2024-09-11T22:15:08.950600+0000","last_peered":"2024-09-11T22:15:08.950600+0000","last_clean":"2024-09-11T22:15:08.950600+0000","last_became_active":"2024-09-11T22:15:07.624770+0000","last_became_peered":"2024-09-11T22:15:07.624770+0000","last_unstale":"2024-09-11T22:15:08.950600+0000","last_undegraded":"2024-09-11T22:15:08.950600+0000","last_fullsized":"2024-09-11T22:15:08.950600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:39.268401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612645+0000","last_change":"2024-09-11T22:15:07.615306+0000","last_active":"2024-09-11T22:15:08.612645+0000","last_peered":"2024-09-11T22:15:08.612645+0000","last_clean":"2024-09-11T22:15:08.612645+0000","last_became_active":"2024-09-11T22:15:07.615030+0000","last_became_peered":"2024-09-11T22:15:07.615030+0000","last_unstale":"2024-09-11T22:15:08.612645+0000","last_undegraded":"2024-09-11T22:15:08.612645+0000","last_fullsized":"2024-09-11T22:15:08.612645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:32.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615516+0000","last_change":"2024-09-11T22:15:07.617207+0000","last_active":"2024-09-11T22:15:08.615516+0000","last_peered":"2024-09-11T22:15:08.615516+0000","last_clean":"2024-09-11T22:15:08.615516+0000","last_became_active":"2024-09-11T22:15:07.616622+0000","last_became_peered":"2024-09-11T22:15:07.616622+0000","last_unstale":"2024-09-11T22:15:08.615516+0000","last_undegraded":"2024-09-11T22:15:08.615516+0000","last_fullsized":"2024-09-11T22:15:08.615516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:32.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615208+0000","last_change":"2024-09-11T22:15:07.618290+0000","last_active":"2024-09-11T22:15:08.615208+0000","last_peered":"2024-09-11T22:15:08.615208+0000","last_clean":"2024-09-11T22:15:08.615208+0000","last_became_active":"2024-09-11T22:15:07.618024+0000","last_became_peered":"2024-09-11T22:15:07.618024+0000","last_unstale":"2024-09-11T22:15:08.615208+0000","last_undegraded":"2024-09-11T22:15:08.615208+0000","last_fullsized":"2024-09-11T22:15:08.615208+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:04.415812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.588379+0000","last_change":"2024-09-11T22:15:06.588379+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.588379+0000","last_undegraded":"2024-09-11T22:15:06.588379+0000","last_fullsized":"2024-09-11T22:15:06.588379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.588685+0000","last_change":"2024-09-11T22:15:06.588685+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.588685+0000","last_undegraded":"2024-09-11T22:15:06.588685+0000","last_fullsized":"2024-09-11T22:15:06.588685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615107+0000","last_change":"2024-09-11T22:15:07.624381+0000","last_active":"2024-09-11T22:15:08.615107+0000","last_peered":"2024-09-11T22:15:08.615107+0000","last_clean":"2024-09-11T22:15:08.615107+0000","last_became_active":"2024-09-11T22:15:07.624110+0000","last_became_peered":"2024-09-11T22:15:07.624110+0000","last_unstale":"2024-09-11T22:15:08.615107+0000","last_undegraded":"2024-09-11T22:15:08.615107+0000","last_fullsized":"2024-09-11T22:15:08.615107+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:04.961870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616093+0000","last_change":"2024-09-11T22:15:07.621337+0000","last_active":"2024-09-11T22:15:08.616093+0000","last_peered":"2024-09-11T22:15:08.616093+0000","last_clean":"2024-09-11T22:15:08.616093+0000","last_became_active":"2024-09-11T22:15:07.621070+0000","last_became_peered":"2024-09-11T22:15:07.621070+0000","last_unstale":"2024-09-11T22:15:08.616093+0000","last_undegraded":"2024-09-11T22:15:08.616093+0000","last_fullsized":"2024-09-11T22:15:08.616093+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:07.951475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989709+0000","last_change":"2024-09-11T22:15:07.626797+0000","last_active":"2024-09-11T22:15:08.989709+0000","last_peered":"2024-09-11T22:15:08.989709+0000","last_clean":"2024-09-11T22:15:08.989709+0000","last_became_active":"2024-09-11T22:15:07.626342+0000","last_became_peered":"2024-09-11T22:15:07.626342+0000","last_unstale":"2024-09-11T22:15:08.989709+0000","last_undegraded":"2024-09-11T22:15:08.989709+0000","last_fullsized":"2024-09-11T22:15:08.989709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:41.007210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615043+0000","last_change":"2024-09-11T22:15:07.624015+0000","last_active":"2024-09-11T22:15:08.615043+0000","last_peered":"2024-09-11T22:15:08.615043+0000","last_clean":"2024-09-11T22:15:08.615043+0000","last_became_active":"2024-09-11T22:15:07.623402+0000","last_became_peered":"2024-09-11T22:15:07.623402+0000","last_unstale":"2024-09-11T22:15:08.615043+0000","last_undegraded":"2024-09-11T22:15:08.615043+0000","last_fullsized":"2024-09-11T22:15:08.615043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.463954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989929+0000","last_change":"2024-09-11T22:15:07.617599+0000","last_active":"2024-09-11T22:15:08.989929+0000","last_peered":"2024-09-11T22:15:08.989929+0000","last_clean":"2024-09-11T22:15:08.989929+0000","last_became_active":"2024-09-11T22:15:07.616917+0000","last_became_peered":"2024-09-11T22:15:07.616917+0000","last_unstale":"2024-09-11T22:15:08.989929+0000","last_undegraded":"2024-09-11T22:15:08.989929+0000","last_fullsized":"2024-09-11T22:15:08.989929+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.339321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615511+0000","last_change":"2024-09-11T22:15:07.620592+0000","last_active":"2024-09-11T22:15:08.615511+0000","last_peered":"2024-09-11T22:15:08.615511+0000","last_clean":"2024-09-11T22:15:08.615511+0000","last_became_active":"2024-09-11T22:15:07.620310+0000","last_became_peered":"2024-09-11T22:15:07.620310+0000","last_unstale":"2024-09-11T22:15:08.615511+0000","last_undegraded":"2024-09-11T22:15:08.615511+0000","last_fullsized":"2024-09-11T22:15:08.615511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:40.859201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615602+0000","last_change":"2024-09-11T22:15:07.613050+0000","last_active":"2024-09-11T22:15:08.615602+0000","last_peered":"2024-09-11T22:15:08.615602+0000","last_clean":"2024-09-11T22:15:08.615602+0000","last_became_active":"2024-09-11T22:15:07.612729+0000","last_became_peered":"2024-09-11T22:15:07.612729+0000","last_unstale":"2024-09-11T22:15:08.615602+0000","last_undegraded":"2024-09-11T22:15:08.615602+0000","last_fullsized":"2024-09-11T22:15:08.615602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:23.619541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950591+0000","last_change":"2024-09-11T22:15:07.619623+0000","last_active":"2024-09-11T22:15:08.950591+0000","last_peered":"2024-09-11T22:15:08.950591+0000","last_clean":"2024-09-11T22:15:08.950591+0000","last_became_active":"2024-09-11T22:15:07.619354+0000","last_became_peered":"2024-09-11T22:15:07.619354+0000","last_unstale":"2024-09-11T22:15:08.950591+0000","last_undegraded":"2024-09-11T22:15:08.950591+0000","last_fullsized":"2024-09-11T22:15:08.950591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:51.968449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.587849+0000","last_change":"2024-09-11T22:15:06.587849+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.587849+0000","last_undegraded":"2024-09-11T22:15:06.587849+0000","last_fullsized":"2024-09-11T22:15:06.587849+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T22:15:06.601900+0000","last_change":"2024-09-11T22:15:06.599470+0000","last_active":"2024-09-11T22:15:06.601900+0000","last_peered":"2024-09-11T22:15:06.601900+0000","last_clean":"2024-09-11T22:15:06.601900+0000","last_became_active":"2024-09-11T22:15:06.599035+0000","last_became_peered":"2024-09-11T22:15:06.599035+0000","last_unstale":"2024-09-11T22:15:06.601900+0000","last_undegraded":"2024-09-11T22:15:06.601900+0000","last_fullsized":"2024-09-11T22:15:06.601900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:55.490923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612844+0000","last_change":"2024-09-11T22:15:06.599328+0000","last_active":"2024-09-11T22:15:08.612844+0000","last_peered":"2024-09-11T22:15:08.612844+0000","last_clean":"2024-09-11T22:15:08.612844+0000","last_became_active":"2024-09-11T22:15:06.599044+0000","last_became_peered":"2024-09-11T22:15:06.599044+0000","last_unstale":"2024-09-11T22:15:08.612844+0000","last_undegraded":"2024-09-11T22:15:08.612844+0000","last_fullsized":"2024-09-11T22:15:08.612844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:10.693728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950653+0000","last_change":"2024-09-11T22:15:07.624298+0000","last_active":"2024-09-11T22:15:08.950653+0000","last_peered":"2024-09-11T22:15:08.950653+0000","last_clean":"2024-09-11T22:15:08.950653+0000","last_became_active":"2024-09-11T22:15:07.623399+0000","last_became_peered":"2024-09-11T22:15:07.623399+0000","last_unstale":"2024-09-11T22:15:08.950653+0000","last_undegraded":"2024-09-11T22:15:08.950653+0000","last_fullsized":"2024-09-11T22:15:08.950653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:54.411507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615106+0000","last_change":"2024-09-11T22:15:06.599925+0000","last_active":"2024-09-11T22:15:08.615106+0000","last_peered":"2024-09-11T22:15:08.615106+0000","last_clean":"2024-09-11T22:15:08.615106+0000","last_became_active":"2024-09-11T22:15:06.599482+0000","last_became_peered":"2024-09-11T22:15:06.599482+0000","last_unstale":"2024-09-11T22:15:08.615106+0000","last_undegraded":"2024-09-11T22:15:08.615106+0000","last_fullsized":"2024-09-11T22:15:08.615106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:56.367532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.590610+0000","last_change":"2024-09-11T22:15:06.590610+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.590610+0000","last_undegraded":"2024-09-11T22:15:06.590610+0000","last_fullsized":"2024-09-11T22:15:06.590610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950832+0000","last_change":"2024-09-11T22:15:06.598354+0000","last_active":"2024-09-11T22:15:08.950832+0000","last_peered":"2024-09-11T22:15:08.950832+0000","last_clean":"2024-09-11T22:15:08.950832+0000","last_became_active":"2024-09-11T22:15:06.597886+0000","last_became_peered":"2024-09-11T22:15:06.597886+0000","last_unstale":"2024-09-11T22:15:08.950832+0000","last_undegraded":"2024-09-11T22:15:08.950832+0000","last_fullsized":"2024-09-11T22:15:08.950832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:16.566097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615590+0000","last_change":"2024-09-11T22:15:07.615641+0000","last_active":"2024-09-11T22:15:08.615590+0000","last_peered":"2024-09-11T22:15:08.615590+0000","last_clean":"2024-09-11T22:15:08.615590+0000","last_became_active":"2024-09-11T22:15:07.615317+0000","last_became_peered":"2024-09-11T22:15:07.615317+0000","last_unstale":"2024-09-11T22:15:08.615590+0000","last_undegraded":"2024-09-11T22:15:08.615590+0000","last_fullsized":"2024-09-11T22:15:08.615590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:51.103023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989901+0000","last_change":"2024-09-11T22:15:06.595409+0000","last_active":"2024-09-11T22:15:08.989901+0000","last_peered":"2024-09-11T22:15:08.989901+0000","last_clean":"2024-09-11T22:15:08.989901+0000","last_became_active":"2024-09-11T22:15:06.594997+0000","last_became_peered":"2024-09-11T22:15:06.594997+0000","last_unstale":"2024-09-11T22:15:08.989901+0000","last_undegraded":"2024-09-11T22:15:08.989901+0000","last_fullsized":"2024-09-11T22:15:08.989901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:47.151600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615672+0000","last_change":"2024-09-11T22:15:07.622620+0000","last_active":"2024-09-11T22:15:08.615672+0000","last_peered":"2024-09-11T22:15:08.615672+0000","last_clean":"2024-09-11T22:15:08.615672+0000","last_became_active":"2024-09-11T22:15:07.622043+0000","last_became_peered":"2024-09-11T22:15:07.622043+0000","last_unstale":"2024-09-11T22:15:08.615672+0000","last_undegraded":"2024-09-11T22:15:08.615672+0000","last_fullsized":"2024-09-11T22:15:08.615672+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:47.977968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950438+0000","last_change":"2024-09-11T22:15:06.601969+0000","last_active":"2024-09-11T22:15:08.950438+0000","last_peered":"2024-09-11T22:15:08.950438+0000","last_clean":"2024-09-11T22:15:08.950438+0000","last_became_active":"2024-09-11T22:15:06.601704+0000","last_became_peered":"2024-09-11T22:15:06.601704+0000","last_unstale":"2024-09-11T22:15:08.950438+0000","last_undegraded":"2024-09-11T22:15:08.950438+0000","last_fullsized":"2024-09-11T22:15:08.950438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:25.646446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989766+0000","last_change":"2024-09-11T22:15:06.589489+0000","last_active":"2024-09-11T22:15:08.989766+0000","last_peered":"2024-09-11T22:15:08.989766+0000","last_clean":"2024-09-11T22:15:08.989766+0000","last_became_active":"2024-09-11T22:15:06.589159+0000","last_became_peered":"2024-09-11T22:15:06.589159+0000","last_unstale":"2024-09-11T22:15:08.989766+0000","last_undegraded":"2024-09-11T22:15:08.989766+0000","last_fullsized":"2024-09-11T22:15:08.989766+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:56.182848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612591+0000","last_change":"2024-09-11T22:15:07.630577+0000","last_active":"2024-09-11T22:15:08.612591+0000","last_peered":"2024-09-11T22:15:08.612591+0000","last_clean":"2024-09-11T22:15:08.612591+0000","last_became_active":"2024-09-11T22:15:07.630271+0000","last_became_peered":"2024-09-11T22:15:07.630271+0000","last_unstale":"2024-09-11T22:15:08.612591+0000","last_undegraded":"2024-09-11T22:15:08.612591+0000","last_fullsized":"2024-09-11T22:15:08.612591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:25.034800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-09-11T22:15:05.584080+0000","last_change":"2024-09-11T22:15:05.584080+0000","last_active":"2024-09-11T22:15:05.573516+0000","last_peered":"2024-09-11T22:15:05.573516+0000","last_clean":"2024-09-11T22:15:05.573516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:05.584080+0000","last_undegraded":"2024-09-11T22:15:05.584080+0000","last_fullsized":"2024-09-11T22:15:05.584080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616017+0000","last_change":"2024-09-11T22:15:07.621117+0000","last_active":"2024-09-11T22:15:08.616017+0000","last_peered":"2024-09-11T22:15:08.616017+0000","last_clean":"2024-09-11T22:15:08.616017+0000","last_became_active":"2024-09-11T22:15:07.619879+0000","last_became_peered":"2024-09-11T22:15:07.619879+0000","last_unstale":"2024-09-11T22:15:08.616017+0000","last_undegraded":"2024-09-11T22:15:08.616017+0000","last_fullsized":"2024-09-11T22:15:08.616017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:46.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615132+0000","last_change":"2024-09-11T22:15:06.592064+0000","last_active":"2024-09-11T22:15:08.615132+0000","last_peered":"2024-09-11T22:15:08.615132+0000","last_clean":"2024-09-11T22:15:08.615132+0000","last_became_active":"2024-09-11T22:15:06.591789+0000","last_became_peered":"2024-09-11T22:15:06.591789+0000","last_unstale":"2024-09-11T22:15:08.615132+0000","last_undegraded":"2024-09-11T22:15:08.615132+0000","last_fullsized":"2024-09-11T22:15:08.615132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:13.507670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.591546+0000","last_change":"2024-09-11T22:15:06.591546+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.591546+0000","last_undegraded":"2024-09-11T22:15:06.591546+0000","last_fullsized":"2024-09-11T22:15:06.591546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950979+0000","last_change":"2024-09-11T22:15:06.596633+0000","last_active":"2024-09-11T22:15:08.950979+0000","last_peered":"2024-09-11T22:15:08.950979+0000","last_clean":"2024-09-11T22:15:08.950979+0000","last_became_active":"2024-09-11T22:15:06.596323+0000","last_became_peered":"2024-09-11T22:15:06.596323+0000","last_unstale":"2024-09-11T22:15:08.950979+0000","last_undegraded":"2024-09-11T22:15:08.950979+0000","last_fullsized":"2024-09-11T22:15:08.950979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:56.182848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950744+0000","last_change":"2024-09-11T22:15:07.621209+0000","last_active":"2024-09-11T22:15:08.950744+0000","last_peered":"2024-09-11T22:15:08.950744+0000","last_clean":"2024-09-11T22:15:08.950744+0000","last_became_active":"2024-09-11T22:15:07.620885+0000","last_became_peered":"2024-09-11T22:15:07.620885+0000","last_unstale":"2024-09-11T22:15:08.950744+0000","last_undegraded":"2024-09-11T22:15:08.950744+0000","last_fullsized":"2024-09-11T22:15:08.950744+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:26.478181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"73'3","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989810+0000","last_change":"2024-09-11T22:15:06.593945+0000","last_active":"2024-09-11T22:15:08.989810+0000","last_peered":"2024-09-11T22:15:08.989810+0000","last_clean":"2024-09-11T22:15:08.989810+0000","last_became_active":"2024-09-11T22:15:06.593612+0000","last_became_peered":"2024-09-11T22:15:06.593612+0000","last_unstale":"2024-09-11T22:15:08.989810+0000","last_undegraded":"2024-09-11T22:15:08.989810+0000","last_fullsized":"2024-09-11T22:15:08.989810+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:32.595037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"73'6","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990328+0000","last_change":"2024-09-11T22:15:06.596829+0000","last_active":"2024-09-11T22:15:08.990328+0000","last_peered":"2024-09-11T22:15:08.990328+0000","last_clean":"2024-09-11T22:15:08.990328+0000","last_became_active":"2024-09-11T22:15:06.596541+0000","last_became_peered":"2024-09-11T22:15:06.596541+0000","last_unstale":"2024-09-11T22:15:08.990328+0000","last_undegraded":"2024-09-11T22:15:08.990328+0000","last_fullsized":"2024-09-11T22:15:08.990328+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:54.153574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.589375+0000","last_change":"2024-09-11T22:15:06.589375+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.589375+0000","last_undegraded":"2024-09-11T22:15:06.589375+0000","last_fullsized":"2024-09-11T22:15:06.589375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990061+0000","last_change":"2024-09-11T22:15:06.594726+0000","last_active":"2024-09-11T22:15:08.990061+0000","last_peered":"2024-09-11T22:15:08.990061+0000","last_clean":"2024-09-11T22:15:08.990061+0000","last_became_active":"2024-09-11T22:15:06.594397+0000","last_became_peered":"2024-09-11T22:15:06.594397+0000","last_unstale":"2024-09-11T22:15:08.990061+0000","last_undegraded":"2024-09-11T22:15:08.990061+0000","last_fullsized":"2024-09-11T22:15:08.990061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:08.901035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615695+0000","last_change":"2024-09-11T22:15:07.616399+0000","last_active":"2024-09-11T22:15:08.615695+0000","last_peered":"2024-09-11T22:15:08.615695+0000","last_clean":"2024-09-11T22:15:08.615695+0000","last_became_active":"2024-09-11T22:15:07.616049+0000","last_became_peered":"2024-09-11T22:15:07.616049+0000","last_unstale":"2024-09-11T22:15:08.615695+0000","last_undegraded":"2024-09-11T22:15:08.615695+0000","last_fullsized":"2024-09-11T22:15:08.615695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:58.048294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950685+0000","last_change":"2024-09-11T22:15:06.596968+0000","last_active":"2024-09-11T22:15:08.950685+0000","last_peered":"2024-09-11T22:15:08.950685+0000","last_clean":"2024-09-11T22:15:08.950685+0000","last_became_active":"2024-09-11T22:15:06.595698+0000","last_became_peered":"2024-09-11T22:15:06.595698+0000","last_unstale":"2024-09-11T22:15:08.950685+0000","last_undegraded":"2024-09-11T22:15:08.950685+0000","last_fullsized":"2024-09-11T22:15:08.950685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:25.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612514+0000","last_change":"2024-09-11T22:15:07.621366+0000","last_active":"2024-09-11T22:15:08.612514+0000","last_peered":"2024-09-11T22:15:08.612514+0000","last_clean":"2024-09-11T22:15:08.612514+0000","last_became_active":"2024-09-11T22:15:07.621103+0000","last_became_peered":"2024-09-11T22:15:07.621103+0000","last_unstale":"2024-09-11T22:15:08.612514+0000","last_undegraded":"2024-09-11T22:15:08.612514+0000","last_fullsized":"2024-09-11T22:15:08.612514+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:04.415812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615462+0000","last_change":"2024-09-11T22:15:06.603089+0000","last_active":"2024-09-11T22:15:08.615462+0000","last_peered":"2024-09-11T22:15:08.615462+0000","last_clean":"2024-09-11T22:15:08.615462+0000","last_became_active":"2024-09-11T22:15:06.602803+0000","last_became_peered":"2024-09-11T22:15:06.602803+0000","last_unstale":"2024-09-11T22:15:08.615462+0000","last_undegraded":"2024-09-11T22:15:08.615462+0000","last_fullsized":"2024-09-11T22:15:08.615462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:34.459445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"73'8","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614740+0000","last_change":"2024-09-11T22:15:06.594832+0000","last_active":"2024-09-11T22:15:08.614740+0000","last_peered":"2024-09-11T22:15:08.614740+0000","last_clean":"2024-09-11T22:15:08.614740+0000","last_became_active":"2024-09-11T22:15:06.594529+0000","last_became_peered":"2024-09-11T22:15:06.594529+0000","last_unstale":"2024-09-11T22:15:08.614740+0000","last_undegraded":"2024-09-11T22:15:08.614740+0000","last_fullsized":"2024-09-11T22:15:08.614740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:02.299662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615277+0000","last_change":"2024-09-11T22:15:07.615717+0000","last_active":"2024-09-11T22:15:08.615277+0000","last_peered":"2024-09-11T22:15:08.615277+0000","last_clean":"2024-09-11T22:15:08.615277+0000","last_became_active":"2024-09-11T22:15:07.615451+0000","last_became_peered":"2024-09-11T22:15:07.615451+0000","last_unstale":"2024-09-11T22:15:08.615277+0000","last_undegraded":"2024-09-11T22:15:08.615277+0000","last_fullsized":"2024-09-11T22:15:08.615277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:25.034800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950863+0000","last_change":"2024-09-11T22:15:06.594898+0000","last_active":"2024-09-11T22:15:08.950863+0000","last_peered":"2024-09-11T22:15:08.950863+0000","last_clean":"2024-09-11T22:15:08.950863+0000","last_became_active":"2024-09-11T22:15:06.594562+0000","last_became_peered":"2024-09-11T22:15:06.594562+0000","last_unstale":"2024-09-11T22:15:08.950863+0000","last_undegraded":"2024-09-11T22:15:08.950863+0000","last_fullsized":"2024-09-11T22:15:08.950863+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:24.994361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.587962+0000","last_change":"2024-09-11T22:15:06.587962+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.587962+0000","last_undegraded":"2024-09-11T22:15:06.587962+0000","last_fullsized":"2024-09-11T22:15:06.587962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615315+0000","last_change":"2024-09-11T22:15:06.597291+0000","last_active":"2024-09-11T22:15:08.615315+0000","last_peered":"2024-09-11T22:15:08.615315+0000","last_clean":"2024-09-11T22:15:08.615315+0000","last_became_active":"2024-09-11T22:15:06.596980+0000","last_became_peered":"2024-09-11T22:15:06.596980+0000","last_unstale":"2024-09-11T22:15:08.615315+0000","last_undegraded":"2024-09-11T22:15:08.615315+0000","last_fullsized":"2024-09-11T22:15:08.615315+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:30.688967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990306+0000","last_change":"2024-09-11T22:15:07.621646+0000","last_active":"2024-09-11T22:15:08.990306+0000","last_peered":"2024-09-11T22:15:08.990306+0000","last_clean":"2024-09-11T22:15:08.990306+0000","last_became_active":"2024-09-11T22:15:07.621117+0000","last_became_peered":"2024-09-11T22:15:07.621117+0000","last_unstale":"2024-09-11T22:15:08.990306+0000","last_undegraded":"2024-09-11T22:15:08.990306+0000","last_fullsized":"2024-09-11T22:15:08.990306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:14.512180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950675+0000","last_change":"2024-09-11T22:15:06.598749+0000","last_active":"2024-09-11T22:15:08.950675+0000","last_peered":"2024-09-11T22:15:08.950675+0000","last_clean":"2024-09-11T22:15:08.950675+0000","last_became_active":"2024-09-11T22:15:06.597719+0000","last_became_peered":"2024-09-11T22:15:06.597719+0000","last_unstale":"2024-09-11T22:15:08.950675+0000","last_undegraded":"2024-09-11T22:15:08.950675+0000","last_fullsized":"2024-09-11T22:15:08.950675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:57.551356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T22:15:06.599018+0000","last_change":"2024-09-11T22:15:06.597301+0000","last_active":"2024-09-11T22:15:06.599018+0000","last_peered":"2024-09-11T22:15:06.599018+0000","last_clean":"2024-09-11T22:15:06.599018+0000","last_became_active":"2024-09-11T22:15:06.597000+0000","last_became_peered":"2024-09-11T22:15:06.597000+0000","last_unstale":"2024-09-11T22:15:06.599018+0000","last_undegraded":"2024-09-11T22:15:06.599018+0000","last_fullsized":"2024-09-11T22:15:06.599018+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:29.864901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989834+0000","last_change":"2024-09-11T22:15:07.626542+0000","last_active":"2024-09-11T22:15:08.989834+0000","last_peered":"2024-09-11T22:15:08.989834+0000","last_clean":"2024-09-11T22:15:08.989834+0000","last_became_active":"2024-09-11T22:15:07.626252+0000","last_became_peered":"2024-09-11T22:15:07.626252+0000","last_unstale":"2024-09-11T22:15:08.989834+0000","last_undegraded":"2024-09-11T22:15:08.989834+0000","last_fullsized":"2024-09-11T22:15:08.989834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:30.662715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950812+0000","last_change":"2024-09-11T22:15:06.602028+0000","last_active":"2024-09-11T22:15:08.950812+0000","last_peered":"2024-09-11T22:15:08.950812+0000","last_clean":"2024-09-11T22:15:08.950812+0000","last_became_active":"2024-09-11T22:15:06.601723+0000","last_became_peered":"2024-09-11T22:15:06.601723+0000","last_unstale":"2024-09-11T22:15:08.950812+0000","last_undegraded":"2024-09-11T22:15:08.950812+0000","last_fullsized":"2024-09-11T22:15:08.950812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:08.901035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989476+0000","last_change":"2024-09-11T22:15:07.624503+0000","last_active":"2024-09-11T22:15:08.989476+0000","last_peered":"2024-09-11T22:15:08.989476+0000","last_clean":"2024-09-11T22:15:08.989476+0000","last_became_active":"2024-09-11T22:15:07.624218+0000","last_became_peered":"2024-09-11T22:15:07.624218+0000","last_unstale":"2024-09-11T22:15:08.989476+0000","last_undegraded":"2024-09-11T22:15:08.989476+0000","last_fullsized":"2024-09-11T22:15:08.989476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:41.357009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615706+0000","last_change":"2024-09-11T22:15:06.595704+0000","last_active":"2024-09-11T22:15:08.615706+0000","last_peered":"2024-09-11T22:15:08.615706+0000","last_clean":"2024-09-11T22:15:08.615706+0000","last_became_active":"2024-09-11T22:15:06.595424+0000","last_became_peered":"2024-09-11T22:15:06.595424+0000","last_unstale":"2024-09-11T22:15:08.615706+0000","last_undegraded":"2024-09-11T22:15:08.615706+0000","last_fullsized":"2024-09-11T22:15:08.615706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:32.303344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989526+0000","last_change":"2024-09-11T22:15:07.627761+0000","last_active":"2024-09-11T22:15:08.989526+0000","last_peered":"2024-09-11T22:15:08.989526+0000","last_clean":"2024-09-11T22:15:08.989526+0000","last_became_active":"2024-09-11T22:15:07.627501+0000","last_became_peered":"2024-09-11T22:15:07.627501+0000","last_unstale":"2024-09-11T22:15:08.989526+0000","last_undegraded":"2024-09-11T22:15:08.989526+0000","last_fullsized":"2024-09-11T22:15:08.989526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:56.279768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612424+0000","last_change":"2024-09-11T22:15:06.599176+0000","last_active":"2024-09-11T22:15:08.612424+0000","last_peered":"2024-09-11T22:15:08.612424+0000","last_clean":"2024-09-11T22:15:08.612424+0000","last_became_active":"2024-09-11T22:15:06.598884+0000","last_became_peered":"2024-09-11T22:15:06.598884+0000","last_unstale":"2024-09-11T22:15:08.612424+0000","last_undegraded":"2024-09-11T22:15:08.612424+0000","last_fullsized":"2024-09-11T22:15:08.612424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:53.406997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612778+0000","last_change":"2024-09-11T22:15:07.617307+0000","last_active":"2024-09-11T22:15:08.612778+0000","last_peered":"2024-09-11T22:15:08.612778+0000","last_clean":"2024-09-11T22:15:08.612778+0000","last_became_active":"2024-09-11T22:15:07.617023+0000","last_became_peered":"2024-09-11T22:15:07.617023+0000","last_unstale":"2024-09-11T22:15:08.612778+0000","last_undegraded":"2024-09-11T22:15:08.612778+0000","last_fullsized":"2024-09-11T22:15:08.612778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:52.279163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950937+0000","last_change":"2024-09-11T22:15:06.596640+0000","last_active":"2024-09-11T22:15:08.950937+0000","last_peered":"2024-09-11T22:15:08.950937+0000","last_clean":"2024-09-11T22:15:08.950937+0000","last_became_active":"2024-09-11T22:15:06.595275+0000","last_became_peered":"2024-09-11T22:15:06.595275+0000","last_unstale":"2024-09-11T22:15:08.950937+0000","last_undegraded":"2024-09-11T22:15:08.950937+0000","last_fullsized":"2024-09-11T22:15:08.950937+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:34.525374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615860+0000","last_change":"2024-09-11T22:15:07.607459+0000","last_active":"2024-09-11T22:15:08.615860+0000","last_peered":"2024-09-11T22:15:08.615860+0000","last_clean":"2024-09-11T22:15:08.615860+0000","last_became_active":"2024-09-11T22:15:07.607170+0000","last_became_peered":"2024-09-11T22:15:07.607170+0000","last_unstale":"2024-09-11T22:15:08.615860+0000","last_undegraded":"2024-09-11T22:15:08.615860+0000","last_fullsized":"2024-09-11T22:15:08.615860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:38.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616087+0000","last_change":"2024-09-11T22:15:06.603161+0000","last_active":"2024-09-11T22:15:08.616087+0000","last_peered":"2024-09-11T22:15:08.616087+0000","last_clean":"2024-09-11T22:15:08.616087+0000","last_became_active":"2024-09-11T22:15:06.602873+0000","last_became_peered":"2024-09-11T22:15:06.602873+0000","last_unstale":"2024-09-11T22:15:08.616087+0000","last_undegraded":"2024-09-11T22:15:08.616087+0000","last_fullsized":"2024-09-11T22:15:08.616087+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:03.957361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.588958+0000","last_change":"2024-09-11T22:15:06.588958+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.588958+0000","last_undegraded":"2024-09-11T22:15:06.588958+0000","last_fullsized":"2024-09-11T22:15:06.588958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-09-11T22:15:05.584086+0000","last_change":"2024-09-11T22:15:05.584086+0000","last_active":"2024-09-11T22:15:05.573516+0000","last_peered":"2024-09-11T22:15:05.573516+0000","last_clean":"2024-09-11T22:15:05.573516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:05.584086+0000","last_undegraded":"2024-09-11T22:15:05.584086+0000","last_fullsized":"2024-09-11T22:15:05.584086+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.590216+0000","last_change":"2024-09-11T22:15:06.590216+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.590216+0000","last_undegraded":"2024-09-11T22:15:06.590216+0000","last_fullsized":"2024-09-11T22:15:06.590216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612643+0000","last_change":"2024-09-11T22:15:06.595834+0000","last_active":"2024-09-11T22:15:08.612643+0000","last_peered":"2024-09-11T22:15:08.612643+0000","last_clean":"2024-09-11T22:15:08.612643+0000","last_became_active":"2024-09-11T22:15:06.595547+0000","last_became_peered":"2024-09-11T22:15:06.595547+0000","last_unstale":"2024-09-11T22:15:08.612643+0000","last_undegraded":"2024-09-11T22:15:08.612643+0000","last_fullsized":"2024-09-11T22:15:08.612643+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:38.263891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-09-11T22:15:05.584664+0000","last_change":"2024-09-11T22:15:05.584664+0000","last_active":"2024-09-11T22:15:05.573516+0000","last_peered":"2024-09-11T22:15:05.573516+0000","last_clean":"2024-09-11T22:15:05.573516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:05.584664+0000","last_undegraded":"2024-09-11T22:15:05.584664+0000","last_fullsized":"2024-09-11T22:15:05.584664+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950580+0000","last_change":"2024-09-11T22:15:07.625363+0000","last_active":"2024-09-11T22:15:08.950580+0000","last_peered":"2024-09-11T22:15:08.950580+0000","last_clean":"2024-09-11T22:15:08.950580+0000","last_became_active":"2024-09-11T22:15:07.624697+0000","last_became_peered":"2024-09-11T22:15:07.624697+0000","last_unstale":"2024-09-11T22:15:08.950580+0000","last_undegraded":"2024-09-11T22:15:08.950580+0000","last_fullsized":"2024-09-11T22:15:08.950580+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:09.058151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989011+0000","last_change":"2024-09-11T22:15:06.589248+0000","last_active":"2024-09-11T22:15:08.989011+0000","last_peered":"2024-09-11T22:15:08.989011+0000","last_clean":"2024-09-11T22:15:08.989011+0000","last_became_active":"2024-09-11T22:15:06.588990+0000","last_became_peered":"2024-09-11T22:15:06.588990+0000","last_unstale":"2024-09-11T22:15:08.989011+0000","last_undegraded":"2024-09-11T22:15:08.989011+0000","last_fullsized":"2024-09-11T22:15:08.989011+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:25.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989285+0000","last_change":"2024-09-11T22:15:07.621584+0000","last_active":"2024-09-11T22:15:08.989285+0000","last_peered":"2024-09-11T22:15:08.989285+0000","last_clean":"2024-09-11T22:15:08.989285+0000","last_became_active":"2024-09-11T22:15:07.621309+0000","last_became_peered":"2024-09-11T22:15:07.621309+0000","last_unstale":"2024-09-11T22:15:08.989285+0000","last_undegraded":"2024-09-11T22:15:08.989285+0000","last_fullsized":"2024-09-11T22:15:08.989285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:16.481227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614930+0000","last_change":"2024-09-11T22:15:06.594165+0000","last_active":"2024-09-11T22:15:08.614930+0000","last_peered":"2024-09-11T22:15:08.614930+0000","last_clean":"2024-09-11T22:15:08.614930+0000","last_became_active":"2024-09-11T22:15:06.593911+0000","last_became_peered":"2024-09-11T22:15:06.593911+0000","last_unstale":"2024-09-11T22:15:08.614930+0000","last_undegraded":"2024-09-11T22:15:08.614930+0000","last_fullsized":"2024-09-11T22:15:08.614930+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:15.476717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950375+0000","last_change":"2024-09-11T22:15:07.618801+0000","last_active":"2024-09-11T22:15:08.950375+0000","last_peered":"2024-09-11T22:15:08.950375+0000","last_clean":"2024-09-11T22:15:08.950375+0000","last_became_active":"2024-09-11T22:15:07.618516+0000","last_became_peered":"2024-09-11T22:15:07.618516+0000","last_unstale":"2024-09-11T22:15:08.950375+0000","last_undegraded":"2024-09-11T22:15:08.950375+0000","last_fullsized":"2024-09-11T22:15:08.950375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:14.512180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950830+0000","last_change":"2024-09-11T22:15:06.598668+0000","last_active":"2024-09-11T22:15:08.950830+0000","last_peered":"2024-09-11T22:15:08.950830+0000","last_clean":"2024-09-11T22:15:08.950830+0000","last_became_active":"2024-09-11T22:15:06.598188+0000","last_became_peered":"2024-09-11T22:15:06.598188+0000","last_unstale":"2024-09-11T22:15:08.950830+0000","last_undegraded":"2024-09-11T22:15:08.950830+0000","last_fullsized":"2024-09-11T22:15:08.950830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:53.861223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989684+0000","last_change":"2024-09-11T22:15:07.628459+0000","last_active":"2024-09-11T22:15:08.989684+0000","last_peered":"2024-09-11T22:15:08.989684+0000","last_clean":"2024-09-11T22:15:08.989684+0000","last_became_active":"2024-09-11T22:15:07.628201+0000","last_became_peered":"2024-09-11T22:15:07.628201+0000","last_unstale":"2024-09-11T22:15:08.989684+0000","last_undegraded":"2024-09-11T22:15:08.989684+0000","last_fullsized":"2024-09-11T22:15:08.989684+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:27.058146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950623+0000","last_change":"2024-09-11T22:15:06.599378+0000","last_active":"2024-09-11T22:15:08.950623+0000","last_peered":"2024-09-11T22:15:08.950623+0000","last_clean":"2024-09-11T22:15:08.950623+0000","last_became_active":"2024-09-11T22:15:06.599051+0000","last_became_peered":"2024-09-11T22:15:06.599051+0000","last_unstale":"2024-09-11T22:15:08.950623+0000","last_undegraded":"2024-09-11T22:15:08.950623+0000","last_fullsized":"2024-09-11T22:15:08.950623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:49.135671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":262,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T22:15:06.592036+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:15:06.592036+0000","last_peered":"2024-09-11T22:15:06.592036+0000","last_clean":"2024-09-11T22:15:06.592036+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:15:06.592036+0000","last_undegraded":"2024-09-11T22:15:06.592036+0000","last_fullsized":"2024-09-11T22:15:06.592036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36236,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335604,"statfs":{"total":96636764160,"available":96599658496,"internally_reserved":0,"allocated":901120,"data_stored":380409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":897024,"data_stored":380407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":897024,"data_stored":380387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":888832,"data_stored":374129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":913408,"data_stored":382545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40964,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330876,"statfs":{"total":96636764160,"available":96594817024,"internally_reserved":0,"allocated":1486848,"data_stored":970685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36784,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335056,"statfs":{"total":96636764160,"available":96599097344,"internally_reserved":0,"allocated":1462272,"data_stored":957610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44504,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327336,"statfs":{"total":96636764160,"available":96591192064,"internally_reserved":0,"allocated":856064,"data_stored":360967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:15:10.593 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:15:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.731+0000 7f033e50c640 1 Processor -- start 2024-09-11T22:15:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.731+0000 7f033e50c640 1 -- start start 2024-09-11T22:15:10.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.732+0000 7f033e50c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f033815e870 0x7f03380d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.732+0000 7f033e50c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f03380d3c00 0x7f03380b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.732+0000 7f033e50c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03380cfa80 con 0x7f03380d16d0 2024-09-11T22:15:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.732+0000 7f033e50c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f03380d1b40 con 0x7f03380d3c00 2024-09-11T22:15:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.732+0000 7f033e50c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f03380d40d0 con 0x7f033815e870 2024-09-11T22:15:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.732+0000 7f033caa9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f03380d3c00 0x7f03380b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.733+0000 7f033caa9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f03380d3c00 0x7f03380b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50052/0 (socket says 172.21.15.50:50052) 2024-09-11T22:15:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.733+0000 7f03377fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f03380d16d0 0x7f03380d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56364/0 (socket says 172.21.15.50:56364) 2024-09-11T22:15:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.733+0000 7f033caa9640 1 -- 172.21.15.50:0/1215954984 learned_addr learned my addr 172.21.15.50:0/1215954984 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.733+0000 7f0337fff640 1 --2- 172.21.15.50:0/1215954984 >> v2:172.21.15.77:3300/0 conn(0x7f033815e870 0x7f03380d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.733+0000 7f033caa9640 1 -- 172.21.15.50:0/1215954984 >> v2:172.21.15.77:3300/0 conn(0x7f033815e870 msgr2=0x7f03380d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.733+0000 7f033caa9640 1 --2- 172.21.15.50:0/1215954984 >> v2:172.21.15.77:3300/0 conn(0x7f033815e870 0x7f03380d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.733+0000 7f033caa9640 1 -- 172.21.15.50:0/1215954984 >> v1:172.21.15.50:6789/0 conn(0x7f03380d16d0 legacy=0x7f03380d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.733+0000 7f033caa9640 1 -- 172.21.15.50:0/1215954984 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03380d43b0 con 0x7f03380d3c00 2024-09-11T22:15:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.733+0000 7f0336ffd640 1 -- 172.21.15.50:0/1215954984 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3850819757 0 0) 0x7f032c001110 con 0x7f03380d16d0 2024-09-11T22:15:10.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.734+0000 7f033caa9640 1 --2- 172.21.15.50:0/1215954984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03380d3c00 0x7f03380b8400 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f03380d57c0 tx=0x7f033002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f2fd214dc921ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:10.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.734+0000 7f0336ffd640 1 -- 172.21.15.50:0/1215954984 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330036070 con 0x7f03380d3c00 2024-09-11T22:15:10.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.734+0000 7f0336ffd640 1 -- 172.21.15.50:0/1215954984 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0330031600 con 0x7f03380d3c00 2024-09-11T22:15:10.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.734+0000 7f0336ffd640 1 -- 172.21.15.50:0/1215954984 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03300319d0 con 0x7f03380d3c00 2024-09-11T22:15:10.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.734+0000 7f033e50c640 1 -- 172.21.15.50:0/1215954984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03380d3c00 msgr2=0x7f03380b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.734+0000 7f033e50c640 1 --2- 172.21.15.50:0/1215954984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03380d3c00 0x7f03380b8400 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f03380d57c0 tx=0x7f033002a730 comp rx=0 tx=0).stop 2024-09-11T22:15:10.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.734+0000 7f033e50c640 1 -- 172.21.15.50:0/1215954984 shutdown_connections 2024-09-11T22:15:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.734+0000 7f033e50c640 1 --2- 172.21.15.50:0/1215954984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03380d3c00 0x7f03380b8400 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.734+0000 7f033e50c640 1 --2- 172.21.15.50:0/1215954984 >> v2:172.21.15.77:3300/0 conn(0x7f033815e870 0x7f03380d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.734+0000 7f033e50c640 1 -- 172.21.15.50:0/1215954984 >> 172.21.15.50:0/1215954984 conn(0x7f03380727a0 msgr2=0x7f03380679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.734+0000 7f033e50c640 1 -- 172.21.15.50:0/1215954984 shutdown_connections 2024-09-11T22:15:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.734+0000 7f033e50c640 1 -- 172.21.15.50:0/1215954984 wait complete. 2024-09-11T22:15:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.735+0000 7f033e50c640 1 Processor -- start 2024-09-11T22:15:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.736+0000 7f033e50c640 1 -- start start 2024-09-11T22:15:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.736+0000 7f033e50c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03380d16d0 0x7f03380cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.736+0000 7f033e50c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03380d3c00 0x7f0338158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.736+0000 7f033e50c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f033815e870 0x7f03380cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.736+0000 7f033e50c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f033815ec50 con 0x7f03380d3c00 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.736+0000 7f033e50c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f03380b7ee0 con 0x7f03380d16d0 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.736+0000 7f033e50c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f03380b78b0 con 0x7f033815e870 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f03377fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03380d3c00 0x7f0338158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f03377fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03380d3c00 0x7f0338158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50060/0 (socket says 172.21.15.50:50060) 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f03377fe640 1 -- 172.21.15.50:0/2825156593 learned_addr learned my addr 172.21.15.50:0/2825156593 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f0337fff640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03380d16d0 0x7f03380cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f033caa9640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f033815e870 0x7f03380cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f03377fe640 1 -- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f033815e870 msgr2=0x7f03380cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f03377fe640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f033815e870 0x7f03380cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f03377fe640 1 -- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03380d16d0 msgr2=0x7f03380cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f03377fe640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03380d16d0 0x7f03380cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f03377fe640 1 -- 172.21.15.50:0/2825156593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0338159470 con 0x7f03380d3c00 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f03377fe640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03380d3c00 0x7f0338158bd0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f032c00c430 tx=0x7f032c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f0334ff9640 1 -- 172.21.15.50:0/2825156593 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c0074e0 con 0x7f03380d3c00 2024-09-11T22:15:10.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f0334ff9640 1 -- 172.21.15.50:0/2825156593 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032c0047e0 con 0x7f03380d3c00 2024-09-11T22:15:10.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f033e50c640 1 -- 172.21.15.50:0/2825156593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03380cba30 con 0x7f03380d3c00 2024-09-11T22:15:10.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f0334ff9640 1 -- 172.21.15.50:0/2825156593 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c004bd0 con 0x7f03380d3c00 2024-09-11T22:15:10.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.737+0000 7f033e50c640 1 -- 172.21.15.50:0/2825156593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03380cbff0 con 0x7f03380d3c00 2024-09-11T22:15:10.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.738+0000 7f033e50c640 1 -- 172.21.15.50:0/2825156593 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03380d1190 con 0x7f03380d3c00 2024-09-11T22:15:10.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.739+0000 7f0334ff9640 1 -- 172.21.15.50:0/2825156593 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f032c011070 con 0x7f03380d3c00 2024-09-11T22:15:10.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.739+0000 7f0334ff9640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f032406be30 0x7f032406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:10.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.739+0000 7f0334ff9640 1 -- 172.21.15.50:0/2825156593 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f032c08a940 con 0x7f03380d3c00 2024-09-11T22:15:10.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.739+0000 7f0337fff640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f032406be30 0x7f032406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:10.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.740+0000 7f0337fff640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f032406be30 0x7f032406e2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0328006fd0 tx=0x7f0328008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:10.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.744+0000 7f0334ff9640 1 -- 172.21.15.50:0/2825156593 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03380cfa80 con 0x7f03380d3c00 2024-09-11T22:15:10.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.917+0000 7f033e50c640 1 -- 172.21.15.50:0/2825156593 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0338067b60 con 0x7f032406be30 2024-09-11T22:15:10.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.924+0000 7f0334ff9640 1 -- 172.21.15.50:0/2825156593 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249534 (secure 0 0 0) 0x7f0338067b60 con 0x7f032406be30 2024-09-11T22:15:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:15:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.926+0000 7f033e50c640 1 -- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f032406be30 msgr2=0x7f032406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.926+0000 7f033e50c640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f032406be30 0x7f032406e2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0328006fd0 tx=0x7f0328008040 comp rx=0 tx=0).stop 2024-09-11T22:15:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.926+0000 7f033e50c640 1 -- 172.21.15.50:0/2825156593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03380d3c00 msgr2=0x7f0338158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.926+0000 7f033e50c640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03380d3c00 0x7f0338158bd0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f032c00c430 tx=0x7f032c00c8f0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.926+0000 7f033e50c640 1 -- 172.21.15.50:0/2825156593 shutdown_connections 2024-09-11T22:15:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.926+0000 7f033e50c640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f032406be30 0x7f032406e2f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.926+0000 7f033e50c640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f033815e870 0x7f03380cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.926+0000 7f033e50c640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03380d3c00 0x7f0338158bd0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.926+0000 7f033e50c640 1 --2- 172.21.15.50:0/2825156593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03380d16d0 0x7f03380cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.926+0000 7f033e50c640 1 -- 172.21.15.50:0/2825156593 >> 172.21.15.50:0/2825156593 conn(0x7f03380727a0 msgr2=0x7f03380b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.927+0000 7f033e50c640 1 -- 172.21.15.50:0/2825156593 shutdown_connections 2024-09-11T22:15:10.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:10.927+0000 7f033e50c640 1 -- 172.21.15.50:0/2825156593 wait complete. 2024-09-11T22:15:10.938 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-11T22:15:09.419827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":286752,"kb_used_data":8108,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754687968,"statfs":{"total":773094113280,"available":772800479232,"internally_reserved":0,"allocated":8302592,"data_stored":4187139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000766"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.591960+0000","last_change":"2024-09-11T22:15:06.591960+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.591960+0000","last_undegraded":"2024-09-11T22:15:06.591960+0000","last_fullsized":"2024-09-11T22:15:06.591960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950901+0000","last_change":"2024-09-11T22:15:07.620683+0000","last_active":"2024-09-11T22:15:08.950901+0000","last_peered":"2024-09-11T22:15:08.950901+0000","last_clean":"2024-09-11T22:15:08.950901+0000","last_became_active":"2024-09-11T22:15:07.620387+0000","last_became_peered":"2024-09-11T22:15:07.620387+0000","last_unstale":"2024-09-11T22:15:08.950901+0000","last_undegraded":"2024-09-11T22:15:08.950901+0000","last_fullsized":"2024-09-11T22:15:08.950901+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:45.541045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989555+0000","last_change":"2024-09-11T22:15:07.614508+0000","last_active":"2024-09-11T22:15:08.989555+0000","last_peered":"2024-09-11T22:15:08.989555+0000","last_clean":"2024-09-11T22:15:08.989555+0000","last_became_active":"2024-09-11T22:15:07.614209+0000","last_became_peered":"2024-09-11T22:15:07.614209+0000","last_unstale":"2024-09-11T22:15:08.989555+0000","last_undegraded":"2024-09-11T22:15:08.989555+0000","last_fullsized":"2024-09-11T22:15:08.989555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:29.618768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990158+0000","last_change":"2024-09-11T22:15:07.620641+0000","last_active":"2024-09-11T22:15:08.990158+0000","last_peered":"2024-09-11T22:15:08.990158+0000","last_clean":"2024-09-11T22:15:08.990158+0000","last_became_active":"2024-09-11T22:15:07.620131+0000","last_became_peered":"2024-09-11T22:15:07.620131+0000","last_unstale":"2024-09-11T22:15:08.990158+0000","last_undegraded":"2024-09-11T22:15:08.990158+0000","last_fullsized":"2024-09-11T22:15:08.990158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:03.304172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950671+0000","last_change":"2024-09-11T22:15:07.620053+0000","last_active":"2024-09-11T22:15:08.950671+0000","last_peered":"2024-09-11T22:15:08.950671+0000","last_clean":"2024-09-11T22:15:08.950671+0000","last_became_active":"2024-09-11T22:15:07.619773+0000","last_became_peered":"2024-09-11T22:15:07.619773+0000","last_unstale":"2024-09-11T22:15:08.950671+0000","last_undegraded":"2024-09-11T22:15:08.950671+0000","last_fullsized":"2024-09-11T22:15:08.950671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:11.698238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615362+0000","last_change":"2024-09-11T22:15:07.611744+0000","last_active":"2024-09-11T22:15:08.615362+0000","last_peered":"2024-09-11T22:15:08.615362+0000","last_clean":"2024-09-11T22:15:08.615362+0000","last_became_active":"2024-09-11T22:15:07.611448+0000","last_became_peered":"2024-09-11T22:15:07.611448+0000","last_unstale":"2024-09-11T22:15:08.615362+0000","last_undegraded":"2024-09-11T22:15:08.615362+0000","last_fullsized":"2024-09-11T22:15:08.615362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:07.621973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950531+0000","last_change":"2024-09-11T22:15:07.626253+0000","last_active":"2024-09-11T22:15:08.950531+0000","last_peered":"2024-09-11T22:15:08.950531+0000","last_clean":"2024-09-11T22:15:08.950531+0000","last_became_active":"2024-09-11T22:15:07.625925+0000","last_became_peered":"2024-09-11T22:15:07.625925+0000","last_unstale":"2024-09-11T22:15:08.950531+0000","last_undegraded":"2024-09-11T22:15:08.950531+0000","last_fullsized":"2024-09-11T22:15:08.950531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:24.963984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615200+0000","last_change":"2024-09-11T22:15:07.623030+0000","last_active":"2024-09-11T22:15:08.615200+0000","last_peered":"2024-09-11T22:15:08.615200+0000","last_clean":"2024-09-11T22:15:08.615200+0000","last_became_active":"2024-09-11T22:15:07.622629+0000","last_became_peered":"2024-09-11T22:15:07.622629+0000","last_unstale":"2024-09-11T22:15:08.615200+0000","last_undegraded":"2024-09-11T22:15:08.615200+0000","last_fullsized":"2024-09-11T22:15:08.615200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:21.595561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.591032+0000","last_change":"2024-09-11T22:15:06.591032+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.591032+0000","last_undegraded":"2024-09-11T22:15:06.591032+0000","last_fullsized":"2024-09-11T22:15:06.591032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990214+0000","last_change":"2024-09-11T22:15:07.621753+0000","last_active":"2024-09-11T22:15:08.990214+0000","last_peered":"2024-09-11T22:15:08.990214+0000","last_clean":"2024-09-11T22:15:08.990214+0000","last_became_active":"2024-09-11T22:15:07.621469+0000","last_became_peered":"2024-09-11T22:15:07.621469+0000","last_unstale":"2024-09-11T22:15:08.990214+0000","last_undegraded":"2024-09-11T22:15:08.990214+0000","last_fullsized":"2024-09-11T22:15:08.990214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:57.372042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612759+0000","last_change":"2024-09-11T22:15:07.620776+0000","last_active":"2024-09-11T22:15:08.612759+0000","last_peered":"2024-09-11T22:15:08.612759+0000","last_clean":"2024-09-11T22:15:08.612759+0000","last_became_active":"2024-09-11T22:15:07.620512+0000","last_became_peered":"2024-09-11T22:15:07.620512+0000","last_unstale":"2024-09-11T22:15:08.612759+0000","last_undegraded":"2024-09-11T22:15:08.612759+0000","last_fullsized":"2024-09-11T22:15:08.612759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:17.012661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612736+0000","last_change":"2024-09-11T22:15:07.613812+0000","last_active":"2024-09-11T22:15:08.612736+0000","last_peered":"2024-09-11T22:15:08.612736+0000","last_clean":"2024-09-11T22:15:08.612736+0000","last_became_active":"2024-09-11T22:15:07.613488+0000","last_became_peered":"2024-09-11T22:15:07.613488+0000","last_unstale":"2024-09-11T22:15:08.612736+0000","last_undegraded":"2024-09-11T22:15:08.612736+0000","last_fullsized":"2024-09-11T22:15:08.612736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:47.977968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614827+0000","last_change":"2024-09-11T22:15:07.621039+0000","last_active":"2024-09-11T22:15:08.614827+0000","last_peered":"2024-09-11T22:15:08.614827+0000","last_clean":"2024-09-11T22:15:08.614827+0000","last_became_active":"2024-09-11T22:15:07.620669+0000","last_became_peered":"2024-09-11T22:15:07.620669+0000","last_unstale":"2024-09-11T22:15:08.614827+0000","last_undegraded":"2024-09-11T22:15:08.614827+0000","last_fullsized":"2024-09-11T22:15:08.614827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:33.307854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990303+0000","last_change":"2024-09-11T22:15:07.624157+0000","last_active":"2024-09-11T22:15:08.990303+0000","last_peered":"2024-09-11T22:15:08.990303+0000","last_clean":"2024-09-11T22:15:08.990303+0000","last_became_active":"2024-09-11T22:15:07.622120+0000","last_became_peered":"2024-09-11T22:15:07.622120+0000","last_unstale":"2024-09-11T22:15:08.990303+0000","last_undegraded":"2024-09-11T22:15:08.990303+0000","last_fullsized":"2024-09-11T22:15:08.990303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:31.693477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950600+0000","last_change":"2024-09-11T22:15:07.625050+0000","last_active":"2024-09-11T22:15:08.950600+0000","last_peered":"2024-09-11T22:15:08.950600+0000","last_clean":"2024-09-11T22:15:08.950600+0000","last_became_active":"2024-09-11T22:15:07.624770+0000","last_became_peered":"2024-09-11T22:15:07.624770+0000","last_unstale":"2024-09-11T22:15:08.950600+0000","last_undegraded":"2024-09-11T22:15:08.950600+0000","last_fullsized":"2024-09-11T22:15:08.950600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:39.268401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612645+0000","last_change":"2024-09-11T22:15:07.615306+0000","last_active":"2024-09-11T22:15:08.612645+0000","last_peered":"2024-09-11T22:15:08.612645+0000","last_clean":"2024-09-11T22:15:08.612645+0000","last_became_active":"2024-09-11T22:15:07.615030+0000","last_became_peered":"2024-09-11T22:15:07.615030+0000","last_unstale":"2024-09-11T22:15:08.612645+0000","last_undegraded":"2024-09-11T22:15:08.612645+0000","last_fullsized":"2024-09-11T22:15:08.612645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:32.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615516+0000","last_change":"2024-09-11T22:15:07.617207+0000","last_active":"2024-09-11T22:15:08.615516+0000","last_peered":"2024-09-11T22:15:08.615516+0000","last_clean":"2024-09-11T22:15:08.615516+0000","last_became_active":"2024-09-11T22:15:07.616622+0000","last_became_peered":"2024-09-11T22:15:07.616622+0000","last_unstale":"2024-09-11T22:15:08.615516+0000","last_undegraded":"2024-09-11T22:15:08.615516+0000","last_fullsized":"2024-09-11T22:15:08.615516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:32.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615208+0000","last_change":"2024-09-11T22:15:07.618290+0000","last_active":"2024-09-11T22:15:08.615208+0000","last_peered":"2024-09-11T22:15:08.615208+0000","last_clean":"2024-09-11T22:15:08.615208+0000","last_became_active":"2024-09-11T22:15:07.618024+0000","last_became_peered":"2024-09-11T22:15:07.618024+0000","last_unstale":"2024-09-11T22:15:08.615208+0000","last_undegraded":"2024-09-11T22:15:08.615208+0000","last_fullsized":"2024-09-11T22:15:08.615208+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:04.415812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.588379+0000","last_change":"2024-09-11T22:15:06.588379+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.588379+0000","last_undegraded":"2024-09-11T22:15:06.588379+0000","last_fullsized":"2024-09-11T22:15:06.588379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.588685+0000","last_change":"2024-09-11T22:15:06.588685+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.588685+0000","last_undegraded":"2024-09-11T22:15:06.588685+0000","last_fullsized":"2024-09-11T22:15:06.588685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615107+0000","last_change":"2024-09-11T22:15:07.624381+0000","last_active":"2024-09-11T22:15:08.615107+0000","last_peered":"2024-09-11T22:15:08.615107+0000","last_clean":"2024-09-11T22:15:08.615107+0000","last_became_active":"2024-09-11T22:15:07.624110+0000","last_became_peered":"2024-09-11T22:15:07.624110+0000","last_unstale":"2024-09-11T22:15:08.615107+0000","last_undegraded":"2024-09-11T22:15:08.615107+0000","last_fullsized":"2024-09-11T22:15:08.615107+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:04.961870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616093+0000","last_change":"2024-09-11T22:15:07.621337+0000","last_active":"2024-09-11T22:15:08.616093+0000","last_peered":"2024-09-11T22:15:08.616093+0000","last_clean":"2024-09-11T22:15:08.616093+0000","last_became_active":"2024-09-11T22:15:07.621070+0000","last_became_peered":"2024-09-11T22:15:07.621070+0000","last_unstale":"2024-09-11T22:15:08.616093+0000","last_undegraded":"2024-09-11T22:15:08.616093+0000","last_fullsized":"2024-09-11T22:15:08.616093+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:07.951475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989709+0000","last_change":"2024-09-11T22:15:07.626797+0000","last_active":"2024-09-11T22:15:08.989709+0000","last_peered":"2024-09-11T22:15:08.989709+0000","last_clean":"2024-09-11T22:15:08.989709+0000","last_became_active":"2024-09-11T22:15:07.626342+0000","last_became_peered":"2024-09-11T22:15:07.626342+0000","last_unstale":"2024-09-11T22:15:08.989709+0000","last_undegraded":"2024-09-11T22:15:08.989709+0000","last_fullsized":"2024-09-11T22:15:08.989709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:41.007210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615043+0000","last_change":"2024-09-11T22:15:07.624015+0000","last_active":"2024-09-11T22:15:08.615043+0000","last_peered":"2024-09-11T22:15:08.615043+0000","last_clean":"2024-09-11T22:15:08.615043+0000","last_became_active":"2024-09-11T22:15:07.623402+0000","last_became_peered":"2024-09-11T22:15:07.623402+0000","last_unstale":"2024-09-11T22:15:08.615043+0000","last_undegraded":"2024-09-11T22:15:08.615043+0000","last_fullsized":"2024-09-11T22:15:08.615043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.463954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989929+0000","last_change":"2024-09-11T22:15:07.617599+0000","last_active":"2024-09-11T22:15:08.989929+0000","last_peered":"2024-09-11T22:15:08.989929+0000","last_clean":"2024-09-11T22:15:08.989929+0000","last_became_active":"2024-09-11T22:15:07.616917+0000","last_became_peered":"2024-09-11T22:15:07.616917+0000","last_unstale":"2024-09-11T22:15:08.989929+0000","last_undegraded":"2024-09-11T22:15:08.989929+0000","last_fullsized":"2024-09-11T22:15:08.989929+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.339321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615511+0000","last_change":"2024-09-11T22:15:07.620592+0000","last_active":"2024-09-11T22:15:08.615511+0000","last_peered":"2024-09-11T22:15:08.615511+0000","last_clean":"2024-09-11T22:15:08.615511+0000","last_became_active":"2024-09-11T22:15:07.620310+0000","last_became_peered":"2024-09-11T22:15:07.620310+0000","last_unstale":"2024-09-11T22:15:08.615511+0000","last_undegraded":"2024-09-11T22:15:08.615511+0000","last_fullsized":"2024-09-11T22:15:08.615511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:40.859201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615602+0000","last_change":"2024-09-11T22:15:07.613050+0000","last_active":"2024-09-11T22:15:08.615602+0000","last_peered":"2024-09-11T22:15:08.615602+0000","last_clean":"2024-09-11T22:15:08.615602+0000","last_became_active":"2024-09-11T22:15:07.612729+0000","last_became_peered":"2024-09-11T22:15:07.612729+0000","last_unstale":"2024-09-11T22:15:08.615602+0000","last_undegraded":"2024-09-11T22:15:08.615602+0000","last_fullsized":"2024-09-11T22:15:08.615602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:23.619541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950591+0000","last_change":"2024-09-11T22:15:07.619623+0000","last_active":"2024-09-11T22:15:08.950591+0000","last_peered":"2024-09-11T22:15:08.950591+0000","last_clean":"2024-09-11T22:15:08.950591+0000","last_became_active":"2024-09-11T22:15:07.619354+0000","last_became_peered":"2024-09-11T22:15:07.619354+0000","last_unstale":"2024-09-11T22:15:08.950591+0000","last_undegraded":"2024-09-11T22:15:08.950591+0000","last_fullsized":"2024-09-11T22:15:08.950591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:51.968449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.587849+0000","last_change":"2024-09-11T22:15:06.587849+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.587849+0000","last_undegraded":"2024-09-11T22:15:06.587849+0000","last_fullsized":"2024-09-11T22:15:06.587849+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T22:15:06.601900+0000","last_change":"2024-09-11T22:15:06.599470+0000","last_active":"2024-09-11T22:15:06.601900+0000","last_peered":"2024-09-11T22:15:06.601900+0000","last_clean":"2024-09-11T22:15:06.601900+0000","last_became_active":"2024-09-11T22:15:06.599035+0000","last_became_peered":"2024-09-11T22:15:06.599035+0000","last_unstale":"2024-09-11T22:15:06.601900+0000","last_undegraded":"2024-09-11T22:15:06.601900+0000","last_fullsized":"2024-09-11T22:15:06.601900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:55.490923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612844+0000","last_change":"2024-09-11T22:15:06.599328+0000","last_active":"2024-09-11T22:15:08.612844+0000","last_peered":"2024-09-11T22:15:08.612844+0000","last_clean":"2024-09-11T22:15:08.612844+0000","last_became_active":"2024-09-11T22:15:06.599044+0000","last_became_peered":"2024-09-11T22:15:06.599044+0000","last_unstale":"2024-09-11T22:15:08.612844+0000","last_undegraded":"2024-09-11T22:15:08.612844+0000","last_fullsized":"2024-09-11T22:15:08.612844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:10.693728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950653+0000","last_change":"2024-09-11T22:15:07.624298+0000","last_active":"2024-09-11T22:15:08.950653+0000","last_peered":"2024-09-11T22:15:08.950653+0000","last_clean":"2024-09-11T22:15:08.950653+0000","last_became_active":"2024-09-11T22:15:07.623399+0000","last_became_peered":"2024-09-11T22:15:07.623399+0000","last_unstale":"2024-09-11T22:15:08.950653+0000","last_undegraded":"2024-09-11T22:15:08.950653+0000","last_fullsized":"2024-09-11T22:15:08.950653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:54.411507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615106+0000","last_change":"2024-09-11T22:15:06.599925+0000","last_active":"2024-09-11T22:15:08.615106+0000","last_peered":"2024-09-11T22:15:08.615106+0000","last_clean":"2024-09-11T22:15:08.615106+0000","last_became_active":"2024-09-11T22:15:06.599482+0000","last_became_peered":"2024-09-11T22:15:06.599482+0000","last_unstale":"2024-09-11T22:15:08.615106+0000","last_undegraded":"2024-09-11T22:15:08.615106+0000","last_fullsized":"2024-09-11T22:15:08.615106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:56.367532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.590610+0000","last_change":"2024-09-11T22:15:06.590610+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.590610+0000","last_undegraded":"2024-09-11T22:15:06.590610+0000","last_fullsized":"2024-09-11T22:15:06.590610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950832+0000","last_change":"2024-09-11T22:15:06.598354+0000","last_active":"2024-09-11T22:15:08.950832+0000","last_peered":"2024-09-11T22:15:08.950832+0000","last_clean":"2024-09-11T22:15:08.950832+0000","last_became_active":"2024-09-11T22:15:06.597886+0000","last_became_peered":"2024-09-11T22:15:06.597886+0000","last_unstale":"2024-09-11T22:15:08.950832+0000","last_undegraded":"2024-09-11T22:15:08.950832+0000","last_fullsized":"2024-09-11T22:15:08.950832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:16.566097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615590+0000","last_change":"2024-09-11T22:15:07.615641+0000","last_active":"2024-09-11T22:15:08.615590+0000","last_peered":"2024-09-11T22:15:08.615590+0000","last_clean":"2024-09-11T22:15:08.615590+0000","last_became_active":"2024-09-11T22:15:07.615317+0000","last_became_peered":"2024-09-11T22:15:07.615317+0000","last_unstale":"2024-09-11T22:15:08.615590+0000","last_undegraded":"2024-09-11T22:15:08.615590+0000","last_fullsized":"2024-09-11T22:15:08.615590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:51.103023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989901+0000","last_change":"2024-09-11T22:15:06.595409+0000","last_active":"2024-09-11T22:15:08.989901+0000","last_peered":"2024-09-11T22:15:08.989901+0000","last_clean":"2024-09-11T22:15:08.989901+0000","last_became_active":"2024-09-11T22:15:06.594997+0000","last_became_peered":"2024-09-11T22:15:06.594997+0000","last_unstale":"2024-09-11T22:15:08.989901+0000","last_undegraded":"2024-09-11T22:15:08.989901+0000","last_fullsized":"2024-09-11T22:15:08.989901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:47.151600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615672+0000","last_change":"2024-09-11T22:15:07.622620+0000","last_active":"2024-09-11T22:15:08.615672+0000","last_peered":"2024-09-11T22:15:08.615672+0000","last_clean":"2024-09-11T22:15:08.615672+0000","last_became_active":"2024-09-11T22:15:07.622043+0000","last_became_peered":"2024-09-11T22:15:07.622043+0000","last_unstale":"2024-09-11T22:15:08.615672+0000","last_undegraded":"2024-09-11T22:15:08.615672+0000","last_fullsized":"2024-09-11T22:15:08.615672+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:47.977968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950438+0000","last_change":"2024-09-11T22:15:06.601969+0000","last_active":"2024-09-11T22:15:08.950438+0000","last_peered":"2024-09-11T22:15:08.950438+0000","last_clean":"2024-09-11T22:15:08.950438+0000","last_became_active":"2024-09-11T22:15:06.601704+0000","last_became_peered":"2024-09-11T22:15:06.601704+0000","last_unstale":"2024-09-11T22:15:08.950438+0000","last_undegraded":"2024-09-11T22:15:08.950438+0000","last_fullsized":"2024-09-11T22:15:08.950438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:25.646446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989766+0000","last_change":"2024-09-11T22:15:06.589489+0000","last_active":"2024-09-11T22:15:08.989766+0000","last_peered":"2024-09-11T22:15:08.989766+0000","last_clean":"2024-09-11T22:15:08.989766+0000","last_became_active":"2024-09-11T22:15:06.589159+0000","last_became_peered":"2024-09-11T22:15:06.589159+0000","last_unstale":"2024-09-11T22:15:08.989766+0000","last_undegraded":"2024-09-11T22:15:08.989766+0000","last_fullsized":"2024-09-11T22:15:08.989766+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:56.182848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612591+0000","last_change":"2024-09-11T22:15:07.630577+0000","last_active":"2024-09-11T22:15:08.612591+0000","last_peered":"2024-09-11T22:15:08.612591+0000","last_clean":"2024-09-11T22:15:08.612591+0000","last_became_active":"2024-09-11T22:15:07.630271+0000","last_became_peered":"2024-09-11T22:15:07.630271+0000","last_unstale":"2024-09-11T22:15:08.612591+0000","last_undegraded":"2024-09-11T22:15:08.612591+0000","last_fullsized":"2024-09-11T22:15:08.612591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:25.034800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-09-11T22:15:05.584080+0000","last_change":"2024-09-11T22:15:05.584080+0000","last_active":"2024-09-11T22:15:05.573516+0000","last_peered":"2024-09-11T22:15:05.573516+0000","last_clean":"2024-09-11T22:15:05.573516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:05.584080+0000","last_undegraded":"2024-09-11T22:15:05.584080+0000","last_fullsized":"2024-09-11T22:15:05.584080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616017+0000","last_change":"2024-09-11T22:15:07.621117+0000","last_active":"2024-09-11T22:15:08.616017+0000","last_peered":"2024-09-11T22:15:08.616017+0000","last_clean":"2024-09-11T22:15:08.616017+0000","last_became_active":"2024-09-11T22:15:07.619879+0000","last_became_peered":"2024-09-11T22:15:07.619879+0000","last_unstale":"2024-09-11T22:15:08.616017+0000","last_undegraded":"2024-09-11T22:15:08.616017+0000","last_fullsized":"2024-09-11T22:15:08.616017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:46.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615132+0000","last_change":"2024-09-11T22:15:06.592064+0000","last_active":"2024-09-11T22:15:08.615132+0000","last_peered":"2024-09-11T22:15:08.615132+0000","last_clean":"2024-09-11T22:15:08.615132+0000","last_became_active":"2024-09-11T22:15:06.591789+0000","last_became_peered":"2024-09-11T22:15:06.591789+0000","last_unstale":"2024-09-11T22:15:08.615132+0000","last_undegraded":"2024-09-11T22:15:08.615132+0000","last_fullsized":"2024-09-11T22:15:08.615132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:13.507670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.591546+0000","last_change":"2024-09-11T22:15:06.591546+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.591546+0000","last_undegraded":"2024-09-11T22:15:06.591546+0000","last_fullsized":"2024-09-11T22:15:06.591546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950979+0000","last_change":"2024-09-11T22:15:06.596633+0000","last_active":"2024-09-11T22:15:08.950979+0000","last_peered":"2024-09-11T22:15:08.950979+0000","last_clean":"2024-09-11T22:15:08.950979+0000","last_became_active":"2024-09-11T22:15:06.596323+0000","last_became_peered":"2024-09-11T22:15:06.596323+0000","last_unstale":"2024-09-11T22:15:08.950979+0000","last_undegraded":"2024-09-11T22:15:08.950979+0000","last_fullsized":"2024-09-11T22:15:08.950979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:56.182848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950744+0000","last_change":"2024-09-11T22:15:07.621209+0000","last_active":"2024-09-11T22:15:08.950744+0000","last_peered":"2024-09-11T22:15:08.950744+0000","last_clean":"2024-09-11T22:15:08.950744+0000","last_became_active":"2024-09-11T22:15:07.620885+0000","last_became_peered":"2024-09-11T22:15:07.620885+0000","last_unstale":"2024-09-11T22:15:08.950744+0000","last_undegraded":"2024-09-11T22:15:08.950744+0000","last_fullsized":"2024-09-11T22:15:08.950744+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:26.478181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"73'3","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989810+0000","last_change":"2024-09-11T22:15:06.593945+0000","last_active":"2024-09-11T22:15:08.989810+0000","last_peered":"2024-09-11T22:15:08.989810+0000","last_clean":"2024-09-11T22:15:08.989810+0000","last_became_active":"2024-09-11T22:15:06.593612+0000","last_became_peered":"2024-09-11T22:15:06.593612+0000","last_unstale":"2024-09-11T22:15:08.989810+0000","last_undegraded":"2024-09-11T22:15:08.989810+0000","last_fullsized":"2024-09-11T22:15:08.989810+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:32.595037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"73'6","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990328+0000","last_change":"2024-09-11T22:15:06.596829+0000","last_active":"2024-09-11T22:15:08.990328+0000","last_peered":"2024-09-11T22:15:08.990328+0000","last_clean":"2024-09-11T22:15:08.990328+0000","last_became_active":"2024-09-11T22:15:06.596541+0000","last_became_peered":"2024-09-11T22:15:06.596541+0000","last_unstale":"2024-09-11T22:15:08.990328+0000","last_undegraded":"2024-09-11T22:15:08.990328+0000","last_fullsized":"2024-09-11T22:15:08.990328+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:54.153574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.589375+0000","last_change":"2024-09-11T22:15:06.589375+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.589375+0000","last_undegraded":"2024-09-11T22:15:06.589375+0000","last_fullsized":"2024-09-11T22:15:06.589375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990061+0000","last_change":"2024-09-11T22:15:06.594726+0000","last_active":"2024-09-11T22:15:08.990061+0000","last_peered":"2024-09-11T22:15:08.990061+0000","last_clean":"2024-09-11T22:15:08.990061+0000","last_became_active":"2024-09-11T22:15:06.594397+0000","last_became_peered":"2024-09-11T22:15:06.594397+0000","last_unstale":"2024-09-11T22:15:08.990061+0000","last_undegraded":"2024-09-11T22:15:08.990061+0000","last_fullsized":"2024-09-11T22:15:08.990061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:08.901035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615695+0000","last_change":"2024-09-11T22:15:07.616399+0000","last_active":"2024-09-11T22:15:08.615695+0000","last_peered":"2024-09-11T22:15:08.615695+0000","last_clean":"2024-09-11T22:15:08.615695+0000","last_became_active":"2024-09-11T22:15:07.616049+0000","last_became_peered":"2024-09-11T22:15:07.616049+0000","last_unstale":"2024-09-11T22:15:08.615695+0000","last_undegraded":"2024-09-11T22:15:08.615695+0000","last_fullsized":"2024-09-11T22:15:08.615695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:58.048294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950685+0000","last_change":"2024-09-11T22:15:06.596968+0000","last_active":"2024-09-11T22:15:08.950685+0000","last_peered":"2024-09-11T22:15:08.950685+0000","last_clean":"2024-09-11T22:15:08.950685+0000","last_became_active":"2024-09-11T22:15:06.595698+0000","last_became_peered":"2024-09-11T22:15:06.595698+0000","last_unstale":"2024-09-11T22:15:08.950685+0000","last_undegraded":"2024-09-11T22:15:08.950685+0000","last_fullsized":"2024-09-11T22:15:08.950685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:25.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612514+0000","last_change":"2024-09-11T22:15:07.621366+0000","last_active":"2024-09-11T22:15:08.612514+0000","last_peered":"2024-09-11T22:15:08.612514+0000","last_clean":"2024-09-11T22:15:08.612514+0000","last_became_active":"2024-09-11T22:15:07.621103+0000","last_became_peered":"2024-09-11T22:15:07.621103+0000","last_unstale":"2024-09-11T22:15:08.612514+0000","last_undegraded":"2024-09-11T22:15:08.612514+0000","last_fullsized":"2024-09-11T22:15:08.612514+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:04.415812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615462+0000","last_change":"2024-09-11T22:15:06.603089+0000","last_active":"2024-09-11T22:15:08.615462+0000","last_peered":"2024-09-11T22:15:08.615462+0000","last_clean":"2024-09-11T22:15:08.615462+0000","last_became_active":"2024-09-11T22:15:06.602803+0000","last_became_peered":"2024-09-11T22:15:06.602803+0000","last_unstale":"2024-09-11T22:15:08.615462+0000","last_undegraded":"2024-09-11T22:15:08.615462+0000","last_fullsized":"2024-09-11T22:15:08.615462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:34.459445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"73'8","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614740+0000","last_change":"2024-09-11T22:15:06.594832+0000","last_active":"2024-09-11T22:15:08.614740+0000","last_peered":"2024-09-11T22:15:08.614740+0000","last_clean":"2024-09-11T22:15:08.614740+0000","last_became_active":"2024-09-11T22:15:06.594529+0000","last_became_peered":"2024-09-11T22:15:06.594529+0000","last_unstale":"2024-09-11T22:15:08.614740+0000","last_undegraded":"2024-09-11T22:15:08.614740+0000","last_fullsized":"2024-09-11T22:15:08.614740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:02.299662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615277+0000","last_change":"2024-09-11T22:15:07.615717+0000","last_active":"2024-09-11T22:15:08.615277+0000","last_peered":"2024-09-11T22:15:08.615277+0000","last_clean":"2024-09-11T22:15:08.615277+0000","last_became_active":"2024-09-11T22:15:07.615451+0000","last_became_peered":"2024-09-11T22:15:07.615451+0000","last_unstale":"2024-09-11T22:15:08.615277+0000","last_undegraded":"2024-09-11T22:15:08.615277+0000","last_fullsized":"2024-09-11T22:15:08.615277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:25.034800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950863+0000","last_change":"2024-09-11T22:15:06.594898+0000","last_active":"2024-09-11T22:15:08.950863+0000","last_peered":"2024-09-11T22:15:08.950863+0000","last_clean":"2024-09-11T22:15:08.950863+0000","last_became_active":"2024-09-11T22:15:06.594562+0000","last_became_peered":"2024-09-11T22:15:06.594562+0000","last_unstale":"2024-09-11T22:15:08.950863+0000","last_undegraded":"2024-09-11T22:15:08.950863+0000","last_fullsized":"2024-09-11T22:15:08.950863+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:24.994361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.587962+0000","last_change":"2024-09-11T22:15:06.587962+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.587962+0000","last_undegraded":"2024-09-11T22:15:06.587962+0000","last_fullsized":"2024-09-11T22:15:06.587962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615315+0000","last_change":"2024-09-11T22:15:06.597291+0000","last_active":"2024-09-11T22:15:08.615315+0000","last_peered":"2024-09-11T22:15:08.615315+0000","last_clean":"2024-09-11T22:15:08.615315+0000","last_became_active":"2024-09-11T22:15:06.596980+0000","last_became_peered":"2024-09-11T22:15:06.596980+0000","last_unstale":"2024-09-11T22:15:08.615315+0000","last_undegraded":"2024-09-11T22:15:08.615315+0000","last_fullsized":"2024-09-11T22:15:08.615315+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:30.688967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990306+0000","last_change":"2024-09-11T22:15:07.621646+0000","last_active":"2024-09-11T22:15:08.990306+0000","last_peered":"2024-09-11T22:15:08.990306+0000","last_clean":"2024-09-11T22:15:08.990306+0000","last_became_active":"2024-09-11T22:15:07.621117+0000","last_became_peered":"2024-09-11T22:15:07.621117+0000","last_unstale":"2024-09-11T22:15:08.990306+0000","last_undegraded":"2024-09-11T22:15:08.990306+0000","last_fullsized":"2024-09-11T22:15:08.990306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:14.512180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950675+0000","last_change":"2024-09-11T22:15:06.598749+0000","last_active":"2024-09-11T22:15:08.950675+0000","last_peered":"2024-09-11T22:15:08.950675+0000","last_clean":"2024-09-11T22:15:08.950675+0000","last_became_active":"2024-09-11T22:15:06.597719+0000","last_became_peered":"2024-09-11T22:15:06.597719+0000","last_unstale":"2024-09-11T22:15:08.950675+0000","last_undegraded":"2024-09-11T22:15:08.950675+0000","last_fullsized":"2024-09-11T22:15:08.950675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:57.551356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T22:15:06.599018+0000","last_change":"2024-09-11T22:15:06.597301+0000","last_active":"2024-09-11T22:15:06.599018+0000","last_peered":"2024-09-11T22:15:06.599018+0000","last_clean":"2024-09-11T22:15:06.599018+0000","last_became_active":"2024-09-11T22:15:06.597000+0000","last_became_peered":"2024-09-11T22:15:06.597000+0000","last_unstale":"2024-09-11T22:15:06.599018+0000","last_undegraded":"2024-09-11T22:15:06.599018+0000","last_fullsized":"2024-09-11T22:15:06.599018+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:29.864901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989834+0000","last_change":"2024-09-11T22:15:07.626542+0000","last_active":"2024-09-11T22:15:08.989834+0000","last_peered":"2024-09-11T22:15:08.989834+0000","last_clean":"2024-09-11T22:15:08.989834+0000","last_became_active":"2024-09-11T22:15:07.626252+0000","last_became_peered":"2024-09-11T22:15:07.626252+0000","last_unstale":"2024-09-11T22:15:08.989834+0000","last_undegraded":"2024-09-11T22:15:08.989834+0000","last_fullsized":"2024-09-11T22:15:08.989834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:30.662715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950812+0000","last_change":"2024-09-11T22:15:06.602028+0000","last_active":"2024-09-11T22:15:08.950812+0000","last_peered":"2024-09-11T22:15:08.950812+0000","last_clean":"2024-09-11T22:15:08.950812+0000","last_became_active":"2024-09-11T22:15:06.601723+0000","last_became_peered":"2024-09-11T22:15:06.601723+0000","last_unstale":"2024-09-11T22:15:08.950812+0000","last_undegraded":"2024-09-11T22:15:08.950812+0000","last_fullsized":"2024-09-11T22:15:08.950812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:08.901035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989476+0000","last_change":"2024-09-11T22:15:07.624503+0000","last_active":"2024-09-11T22:15:08.989476+0000","last_peered":"2024-09-11T22:15:08.989476+0000","last_clean":"2024-09-11T22:15:08.989476+0000","last_became_active":"2024-09-11T22:15:07.624218+0000","last_became_peered":"2024-09-11T22:15:07.624218+0000","last_unstale":"2024-09-11T22:15:08.989476+0000","last_undegraded":"2024-09-11T22:15:08.989476+0000","last_fullsized":"2024-09-11T22:15:08.989476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:41.357009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615706+0000","last_change":"2024-09-11T22:15:06.595704+0000","last_active":"2024-09-11T22:15:08.615706+0000","last_peered":"2024-09-11T22:15:08.615706+0000","last_clean":"2024-09-11T22:15:08.615706+0000","last_became_active":"2024-09-11T22:15:06.595424+0000","last_became_peered":"2024-09-11T22:15:06.595424+0000","last_unstale":"2024-09-11T22:15:08.615706+0000","last_undegraded":"2024-09-11T22:15:08.615706+0000","last_fullsized":"2024-09-11T22:15:08.615706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:32.303344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989526+0000","last_change":"2024-09-11T22:15:07.627761+0000","last_active":"2024-09-11T22:15:08.989526+0000","last_peered":"2024-09-11T22:15:08.989526+0000","last_clean":"2024-09-11T22:15:08.989526+0000","last_became_active":"2024-09-11T22:15:07.627501+0000","last_became_peered":"2024-09-11T22:15:07.627501+0000","last_unstale":"2024-09-11T22:15:08.989526+0000","last_undegraded":"2024-09-11T22:15:08.989526+0000","last_fullsized":"2024-09-11T22:15:08.989526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:56.279768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612424+0000","last_change":"2024-09-11T22:15:06.599176+0000","last_active":"2024-09-11T22:15:08.612424+0000","last_peered":"2024-09-11T22:15:08.612424+0000","last_clean":"2024-09-11T22:15:08.612424+0000","last_became_active":"2024-09-11T22:15:06.598884+0000","last_became_peered":"2024-09-11T22:15:06.598884+0000","last_unstale":"2024-09-11T22:15:08.612424+0000","last_undegraded":"2024-09-11T22:15:08.612424+0000","last_fullsized":"2024-09-11T22:15:08.612424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:53.406997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612778+0000","last_change":"2024-09-11T22:15:07.617307+0000","last_active":"2024-09-11T22:15:08.612778+0000","last_peered":"2024-09-11T22:15:08.612778+0000","last_clean":"2024-09-11T22:15:08.612778+0000","last_became_active":"2024-09-11T22:15:07.617023+0000","last_became_peered":"2024-09-11T22:15:07.617023+0000","last_unstale":"2024-09-11T22:15:08.612778+0000","last_undegraded":"2024-09-11T22:15:08.612778+0000","last_fullsized":"2024-09-11T22:15:08.612778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:52.279163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950937+0000","last_change":"2024-09-11T22:15:06.596640+0000","last_active":"2024-09-11T22:15:08.950937+0000","last_peered":"2024-09-11T22:15:08.950937+0000","last_clean":"2024-09-11T22:15:08.950937+0000","last_became_active":"2024-09-11T22:15:06.595275+0000","last_became_peered":"2024-09-11T22:15:06.595275+0000","last_unstale":"2024-09-11T22:15:08.950937+0000","last_undegraded":"2024-09-11T22:15:08.950937+0000","last_fullsized":"2024-09-11T22:15:08.950937+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:34.525374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615860+0000","last_change":"2024-09-11T22:15:07.607459+0000","last_active":"2024-09-11T22:15:08.615860+0000","last_peered":"2024-09-11T22:15:08.615860+0000","last_clean":"2024-09-11T22:15:08.615860+0000","last_became_active":"2024-09-11T22:15:07.607170+0000","last_became_peered":"2024-09-11T22:15:07.607170+0000","last_unstale":"2024-09-11T22:15:08.615860+0000","last_undegraded":"2024-09-11T22:15:08.615860+0000","last_fullsized":"2024-09-11T22:15:08.615860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:38.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616087+0000","last_change":"2024-09-11T22:15:06.603161+0000","last_active":"2024-09-11T22:15:08.616087+0000","last_peered":"2024-09-11T22:15:08.616087+0000","last_clean":"2024-09-11T22:15:08.616087+0000","last_became_active":"2024-09-11T22:15:06.602873+0000","last_became_peered":"2024-09-11T22:15:06.602873+0000","last_unstale":"2024-09-11T22:15:08.616087+0000","last_undegraded":"2024-09-11T22:15:08.616087+0000","last_fullsized":"2024-09-11T22:15:08.616087+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:03.957361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.588958+0000","last_change":"2024-09-11T22:15:06.588958+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.588958+0000","last_undegraded":"2024-09-11T22:15:06.588958+0000","last_fullsized":"2024-09-11T22:15:06.588958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-09-11T22:15:05.584086+0000","last_change":"2024-09-11T22:15:05.584086+0000","last_active":"2024-09-11T22:15:05.573516+0000","last_peered":"2024-09-11T22:15:05.573516+0000","last_clean":"2024-09-11T22:15:05.573516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:05.584086+0000","last_undegraded":"2024-09-11T22:15:05.584086+0000","last_fullsized":"2024-09-11T22:15:05.584086+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.590216+0000","last_change":"2024-09-11T22:15:06.590216+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.590216+0000","last_undegraded":"2024-09-11T22:15:06.590216+0000","last_fullsized":"2024-09-11T22:15:06.590216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612643+0000","last_change":"2024-09-11T22:15:06.595834+0000","last_active":"2024-09-11T22:15:08.612643+0000","last_peered":"2024-09-11T22:15:08.612643+0000","last_clean":"2024-09-11T22:15:08.612643+0000","last_became_active":"2024-09-11T22:15:06.595547+0000","last_became_peered":"2024-09-11T22:15:06.595547+0000","last_unstale":"2024-09-11T22:15:08.612643+0000","last_undegraded":"2024-09-11T22:15:08.612643+0000","last_fullsized":"2024-09-11T22:15:08.612643+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:38.263891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-09-11T22:15:05.584664+0000","last_change":"2024-09-11T22:15:05.584664+0000","last_active":"2024-09-11T22:15:05.573516+0000","last_peered":"2024-09-11T22:15:05.573516+0000","last_clean":"2024-09-11T22:15:05.573516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:05.584664+0000","last_undegraded":"2024-09-11T22:15:05.584664+0000","last_fullsized":"2024-09-11T22:15:05.584664+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950580+0000","last_change":"2024-09-11T22:15:07.625363+0000","last_active":"2024-09-11T22:15:08.950580+0000","last_peered":"2024-09-11T22:15:08.950580+0000","last_clean":"2024-09-11T22:15:08.950580+0000","last_became_active":"2024-09-11T22:15:07.624697+0000","last_became_peered":"2024-09-11T22:15:07.624697+0000","last_unstale":"2024-09-11T22:15:08.950580+0000","last_undegraded":"2024-09-11T22:15:08.950580+0000","last_fullsized":"2024-09-11T22:15:08.950580+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:09.058151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989011+0000","last_change":"2024-09-11T22:15:06.589248+0000","last_active":"2024-09-11T22:15:08.989011+0000","last_peered":"2024-09-11T22:15:08.989011+0000","last_clean":"2024-09-11T22:15:08.989011+0000","last_became_active":"2024-09-11T22:15:06.588990+0000","last_became_peered":"2024-09-11T22:15:06.588990+0000","last_unstale":"2024-09-11T22:15:08.989011+0000","last_undegraded":"2024-09-11T22:15:08.989011+0000","last_fullsized":"2024-09-11T22:15:08.989011+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:25.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989285+0000","last_change":"2024-09-11T22:15:07.621584+0000","last_active":"2024-09-11T22:15:08.989285+0000","last_peered":"2024-09-11T22:15:08.989285+0000","last_clean":"2024-09-11T22:15:08.989285+0000","last_became_active":"2024-09-11T22:15:07.621309+0000","last_became_peered":"2024-09-11T22:15:07.621309+0000","last_unstale":"2024-09-11T22:15:08.989285+0000","last_undegraded":"2024-09-11T22:15:08.989285+0000","last_fullsized":"2024-09-11T22:15:08.989285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:16.481227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614930+0000","last_change":"2024-09-11T22:15:06.594165+0000","last_active":"2024-09-11T22:15:08.614930+0000","last_peered":"2024-09-11T22:15:08.614930+0000","last_clean":"2024-09-11T22:15:08.614930+0000","last_became_active":"2024-09-11T22:15:06.593911+0000","last_became_peered":"2024-09-11T22:15:06.593911+0000","last_unstale":"2024-09-11T22:15:08.614930+0000","last_undegraded":"2024-09-11T22:15:08.614930+0000","last_fullsized":"2024-09-11T22:15:08.614930+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:15.476717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950375+0000","last_change":"2024-09-11T22:15:07.618801+0000","last_active":"2024-09-11T22:15:08.950375+0000","last_peered":"2024-09-11T22:15:08.950375+0000","last_clean":"2024-09-11T22:15:08.950375+0000","last_became_active":"2024-09-11T22:15:07.618516+0000","last_became_peered":"2024-09-11T22:15:07.618516+0000","last_unstale":"2024-09-11T22:15:08.950375+0000","last_undegraded":"2024-09-11T22:15:08.950375+0000","last_fullsized":"2024-09-11T22:15:08.950375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:14.512180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950830+0000","last_change":"2024-09-11T22:15:06.598668+0000","last_active":"2024-09-11T22:15:08.950830+0000","last_peered":"2024-09-11T22:15:08.950830+0000","last_clean":"2024-09-11T22:15:08.950830+0000","last_became_active":"2024-09-11T22:15:06.598188+0000","last_became_peered":"2024-09-11T22:15:06.598188+0000","last_unstale":"2024-09-11T22:15:08.950830+0000","last_undegraded":"2024-09-11T22:15:08.950830+0000","last_fullsized":"2024-09-11T22:15:08.950830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:53.861223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989684+0000","last_change":"2024-09-11T22:15:07.628459+0000","last_active":"2024-09-11T22:15:08.989684+0000","last_peered":"2024-09-11T22:15:08.989684+0000","last_clean":"2024-09-11T22:15:08.989684+0000","last_became_active":"2024-09-11T22:15:07.628201+0000","last_became_peered":"2024-09-11T22:15:07.628201+0000","last_unstale":"2024-09-11T22:15:08.989684+0000","last_undegraded":"2024-09-11T22:15:08.989684+0000","last_fullsized":"2024-09-11T22:15:08.989684+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:27.058146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950623+0000","last_change":"2024-09-11T22:15:06.599378+0000","last_active":"2024-09-11T22:15:08.950623+0000","last_peered":"2024-09-11T22:15:08.950623+0000","last_clean":"2024-09-11T22:15:08.950623+0000","last_became_active":"2024-09-11T22:15:06.599051+0000","last_became_peered":"2024-09-11T22:15:06.599051+0000","last_unstale":"2024-09-11T22:15:08.950623+0000","last_undegraded":"2024-09-11T22:15:08.950623+0000","last_fullsized":"2024-09-11T22:15:08.950623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:49.135671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":262,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T22:15:06.592036+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:15:06.592036+0000","last_peered":"2024-09-11T22:15:06.592036+0000","last_clean":"2024-09-11T22:15:06.592036+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:15:06.592036+0000","last_undegraded":"2024-09-11T22:15:06.592036+0000","last_fullsized":"2024-09-11T22:15:06.592036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36236,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335604,"statfs":{"total":96636764160,"available":96599658496,"internally_reserved":0,"allocated":901120,"data_stored":380409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":897024,"data_stored":380407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":897024,"data_stored":380387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":888832,"data_stored":374129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":913408,"data_stored":382545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40964,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330876,"statfs":{"total":96636764160,"available":96594817024,"internally_reserved":0,"allocated":1486848,"data_stored":970685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36784,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335056,"statfs":{"total":96636764160,"available":96599097344,"internally_reserved":0,"allocated":1462272,"data_stored":957610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44504,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327336,"statfs":{"total":96636764160,"available":96591192064,"internally_reserved":0,"allocated":856064,"data_stored":360967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:15:10.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:15:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.080+0000 7f6ac698d640 1 Processor -- start 2024-09-11T22:15:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.080+0000 7f6ac698d640 1 -- start start 2024-09-11T22:15:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6ac698d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ac015fb60 0x7f6ac00b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6ac698d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6ac00d0150 0x7f6ac00d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6ac698d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac015ff40 con 0x7f6ac00d0e00 2024-09-11T22:15:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6ac698d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac00cf510 con 0x7f6ac015fb60 2024-09-11T22:15:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6ac698d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac00cfdb0 con 0x7f6ac00d0150 2024-09-11T22:15:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6abffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ac015fb60 0x7f6ac00b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6ac4f2a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6ac00d0e00 0x7f6ac00cd090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56380/0 (socket says 172.21.15.50:56380) 2024-09-11T22:15:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6ac4f2a640 1 -- 172.21.15.50:0/2905550801 learned_addr learned my addr 172.21.15.50:0/2905550801 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6abffff640 1 -- 172.21.15.50:0/2905550801 >> v2:172.21.15.77:3300/0 conn(0x7f6ac00d0150 msgr2=0x7f6ac00d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:11.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6abf7fe640 1 --2- 172.21.15.50:0/2905550801 >> v2:172.21.15.77:3300/0 conn(0x7f6ac00d0150 0x7f6ac00d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6abffff640 1 --2- 172.21.15.50:0/2905550801 >> v2:172.21.15.77:3300/0 conn(0x7f6ac00d0150 0x7f6ac00d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6abeffd640 1 -- 172.21.15.50:0/2905550801 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154574511 0 0) 0x7f6ac015ff40 con 0x7f6ac00d0e00 2024-09-11T22:15:11.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6abffff640 1 -- 172.21.15.50:0/2905550801 >> v1:172.21.15.50:6789/0 conn(0x7f6ac00d0e00 legacy=0x7f6ac00cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6abffff640 1 -- 172.21.15.50:0/2905550801 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac00d1250 con 0x7f6ac015fb60 2024-09-11T22:15:11.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.081+0000 7f6abf7fe640 1 --2- 172.21.15.50:0/2905550801 >> v2:172.21.15.77:3300/0 conn(0x7f6ac00d0150 0x7f6ac00d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:11.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.082+0000 7f6abffff640 1 --2- 172.21.15.50:0/2905550801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ac015fb60 0x7f6ac00b4c70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0074010 tx=0x7f6ab002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253226bcea525170 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:11.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.082+0000 7f6abeffd640 1 -- 172.21.15.50:0/2905550801 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0037070 con 0x7f6ac015fb60 2024-09-11T22:15:11.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.082+0000 7f6abeffd640 1 -- 172.21.15.50:0/2905550801 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab0032440 con 0x7f6ac015fb60 2024-09-11T22:15:11.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.082+0000 7f6abeffd640 1 -- 172.21.15.50:0/2905550801 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab002ae60 con 0x7f6ac015fb60 2024-09-11T22:15:11.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.083+0000 7f6ac698d640 1 -- 172.21.15.50:0/2905550801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ac015fb60 msgr2=0x7f6ac00b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.083+0000 7f6ac698d640 1 --2- 172.21.15.50:0/2905550801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ac015fb60 0x7f6ac00b4c70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0074010 tx=0x7f6ab002a110 comp rx=0 tx=0).stop 2024-09-11T22:15:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.083+0000 7f6ac698d640 1 -- 172.21.15.50:0/2905550801 shutdown_connections 2024-09-11T22:15:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.083+0000 7f6ac698d640 1 --2- 172.21.15.50:0/2905550801 >> v2:172.21.15.77:3300/0 conn(0x7f6ac00d0150 0x7f6ac00d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.083+0000 7f6ac698d640 1 --2- 172.21.15.50:0/2905550801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ac015fb60 0x7f6ac00b4c70 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.083+0000 7f6ac698d640 1 -- 172.21.15.50:0/2905550801 >> 172.21.15.50:0/2905550801 conn(0x7f6ac00b4150 msgr2=0x7f6ac00b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.083+0000 7f6ac698d640 1 -- 172.21.15.50:0/2905550801 shutdown_connections 2024-09-11T22:15:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.083+0000 7f6ac698d640 1 -- 172.21.15.50:0/2905550801 wait complete. 2024-09-11T22:15:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.084+0000 7f6ac698d640 1 Processor -- start 2024-09-11T22:15:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.084+0000 7f6ac698d640 1 -- start start 2024-09-11T22:15:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac698d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ac00d0e00 0x7f6ac00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac698d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ac015fb60 0x7f6ac0155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac698d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ac01563d0 0x7f6ac0146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac698d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac00cfa40 con 0x7f6ac01563d0 2024-09-11T22:15:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac698d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac00cf760 con 0x7f6ac015fb60 2024-09-11T22:15:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac698d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac00b1930 con 0x7f6ac00d0e00 2024-09-11T22:15:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac4f2a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ac01563d0 0x7f6ac0146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac4f2a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ac01563d0 0x7f6ac0146650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50090/0 (socket says 172.21.15.50:50090) 2024-09-11T22:15:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac4f2a640 1 -- 172.21.15.50:0/1738521245 learned_addr learned my addr 172.21.15.50:0/1738521245 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6abf7fe640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ac015fb60 0x7f6ac0155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6abffff640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ac00d0e00 0x7f6ac00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac4f2a640 1 -- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ac00d0e00 msgr2=0x7f6ac00b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac4f2a640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ac00d0e00 0x7f6ac00b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac4f2a640 1 -- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ac015fb60 msgr2=0x7f6ac0155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac4f2a640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ac015fb60 0x7f6ac0155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6ac4f2a640 1 -- 172.21.15.50:0/1738521245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac00b64a0 con 0x7f6ac01563d0 2024-09-11T22:15:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6abf7fe640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ac015fb60 0x7f6ac0155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.085+0000 7f6abffff640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ac00d0e00 0x7f6ac00b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.086+0000 7f6ac4f2a640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ac01563d0 0x7f6ac0146650 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800c7a0 tx=0x7f6ab800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.086+0000 7f6abcff9640 1 -- 172.21.15.50:0/1738521245 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8018070 con 0x7f6ac01563d0 2024-09-11T22:15:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.086+0000 7f6abcff9640 1 -- 172.21.15.50:0/1738521245 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab800a640 con 0x7f6ac01563d0 2024-09-11T22:15:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.086+0000 7f6abcff9640 1 -- 172.21.15.50:0/1738521245 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800aab0 con 0x7f6ac01563d0 2024-09-11T22:15:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.086+0000 7f6ac698d640 1 -- 172.21.15.50:0/1738521245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac00b6780 con 0x7f6ac01563d0 2024-09-11T22:15:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.086+0000 7f6ac698d640 1 -- 172.21.15.50:0/1738521245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac00b6d40 con 0x7f6ac01563d0 2024-09-11T22:15:11.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.087+0000 7f6ac698d640 1 -- 172.21.15.50:0/1738521245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac00d08c0 con 0x7f6ac01563d0 2024-09-11T22:15:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.087+0000 7f6abcff9640 1 -- 172.21.15.50:0/1738521245 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ab801b070 con 0x7f6ac01563d0 2024-09-11T22:15:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.088+0000 7f6abcff9640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6aac06be30 0x7f6aac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.088+0000 7f6abcff9640 1 -- 172.21.15.50:0/1738521245 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f6ab808a4a0 con 0x7f6ac01563d0 2024-09-11T22:15:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.088+0000 7f6abffff640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6aac06be30 0x7f6aac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.089+0000 7f6abffff640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6aac06be30 0x7f6aac06e2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0034000 tx=0x7f6ab002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.092+0000 7f6abcff9640 1 -- 172.21.15.50:0/1738521245 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ab8058e50 con 0x7f6ac01563d0 2024-09-11T22:15:11.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.262+0000 7f6ac698d640 1 -- 172.21.15.50:0/1738521245 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ac00b11e0 con 0x7f6aac06be30 2024-09-11T22:15:11.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.268+0000 7f6abcff9640 1 -- 172.21.15.50:0/1738521245 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249534 (secure 0 0 0) 0x7f6ac00b11e0 con 0x7f6aac06be30 2024-09-11T22:15:11.272 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:11.273 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:15:11.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.271+0000 7f6ac698d640 1 -- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6aac06be30 msgr2=0x7f6aac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.271+0000 7f6ac698d640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6aac06be30 0x7f6aac06e2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0034000 tx=0x7f6ab002e000 comp rx=0 tx=0).stop 2024-09-11T22:15:11.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.271+0000 7f6ac698d640 1 -- 172.21.15.50:0/1738521245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ac01563d0 msgr2=0x7f6ac0146650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.271+0000 7f6ac698d640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ac01563d0 0x7f6ac0146650 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800c7a0 tx=0x7f6ab800cc60 comp rx=0 tx=0).stop 2024-09-11T22:15:11.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.271+0000 7f6ac698d640 1 -- 172.21.15.50:0/1738521245 shutdown_connections 2024-09-11T22:15:11.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.271+0000 7f6ac698d640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6aac06be30 0x7f6aac06e2f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.271+0000 7f6ac698d640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ac01563d0 0x7f6ac0146650 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.271+0000 7f6ac698d640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ac015fb60 0x7f6ac0155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.271+0000 7f6ac698d640 1 --2- 172.21.15.50:0/1738521245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ac00d0e00 0x7f6ac00b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.271+0000 7f6ac698d640 1 -- 172.21.15.50:0/1738521245 >> 172.21.15.50:0/1738521245 conn(0x7f6ac00b4150 msgr2=0x7f6ac00afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:11.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.271+0000 7f6ac698d640 1 -- 172.21.15.50:0/1738521245 shutdown_connections 2024-09-11T22:15:11.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.271+0000 7f6ac698d640 1 -- 172.21.15.50:0/1738521245 wait complete. 2024-09-11T22:15:11.283 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-11T22:15:09.419827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":286752,"kb_used_data":8108,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754687968,"statfs":{"total":773094113280,"available":772800479232,"internally_reserved":0,"allocated":8302592,"data_stored":4187139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000766"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.591960+0000","last_change":"2024-09-11T22:15:06.591960+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.591960+0000","last_undegraded":"2024-09-11T22:15:06.591960+0000","last_fullsized":"2024-09-11T22:15:06.591960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950901+0000","last_change":"2024-09-11T22:15:07.620683+0000","last_active":"2024-09-11T22:15:08.950901+0000","last_peered":"2024-09-11T22:15:08.950901+0000","last_clean":"2024-09-11T22:15:08.950901+0000","last_became_active":"2024-09-11T22:15:07.620387+0000","last_became_peered":"2024-09-11T22:15:07.620387+0000","last_unstale":"2024-09-11T22:15:08.950901+0000","last_undegraded":"2024-09-11T22:15:08.950901+0000","last_fullsized":"2024-09-11T22:15:08.950901+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:45.541045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989555+0000","last_change":"2024-09-11T22:15:07.614508+0000","last_active":"2024-09-11T22:15:08.989555+0000","last_peered":"2024-09-11T22:15:08.989555+0000","last_clean":"2024-09-11T22:15:08.989555+0000","last_became_active":"2024-09-11T22:15:07.614209+0000","last_became_peered":"2024-09-11T22:15:07.614209+0000","last_unstale":"2024-09-11T22:15:08.989555+0000","last_undegraded":"2024-09-11T22:15:08.989555+0000","last_fullsized":"2024-09-11T22:15:08.989555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:29.618768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990158+0000","last_change":"2024-09-11T22:15:07.620641+0000","last_active":"2024-09-11T22:15:08.990158+0000","last_peered":"2024-09-11T22:15:08.990158+0000","last_clean":"2024-09-11T22:15:08.990158+0000","last_became_active":"2024-09-11T22:15:07.620131+0000","last_became_peered":"2024-09-11T22:15:07.620131+0000","last_unstale":"2024-09-11T22:15:08.990158+0000","last_undegraded":"2024-09-11T22:15:08.990158+0000","last_fullsized":"2024-09-11T22:15:08.990158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:03.304172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950671+0000","last_change":"2024-09-11T22:15:07.620053+0000","last_active":"2024-09-11T22:15:08.950671+0000","last_peered":"2024-09-11T22:15:08.950671+0000","last_clean":"2024-09-11T22:15:08.950671+0000","last_became_active":"2024-09-11T22:15:07.619773+0000","last_became_peered":"2024-09-11T22:15:07.619773+0000","last_unstale":"2024-09-11T22:15:08.950671+0000","last_undegraded":"2024-09-11T22:15:08.950671+0000","last_fullsized":"2024-09-11T22:15:08.950671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:11.698238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615362+0000","last_change":"2024-09-11T22:15:07.611744+0000","last_active":"2024-09-11T22:15:08.615362+0000","last_peered":"2024-09-11T22:15:08.615362+0000","last_clean":"2024-09-11T22:15:08.615362+0000","last_became_active":"2024-09-11T22:15:07.611448+0000","last_became_peered":"2024-09-11T22:15:07.611448+0000","last_unstale":"2024-09-11T22:15:08.615362+0000","last_undegraded":"2024-09-11T22:15:08.615362+0000","last_fullsized":"2024-09-11T22:15:08.615362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:07.621973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950531+0000","last_change":"2024-09-11T22:15:07.626253+0000","last_active":"2024-09-11T22:15:08.950531+0000","last_peered":"2024-09-11T22:15:08.950531+0000","last_clean":"2024-09-11T22:15:08.950531+0000","last_became_active":"2024-09-11T22:15:07.625925+0000","last_became_peered":"2024-09-11T22:15:07.625925+0000","last_unstale":"2024-09-11T22:15:08.950531+0000","last_undegraded":"2024-09-11T22:15:08.950531+0000","last_fullsized":"2024-09-11T22:15:08.950531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:24.963984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615200+0000","last_change":"2024-09-11T22:15:07.623030+0000","last_active":"2024-09-11T22:15:08.615200+0000","last_peered":"2024-09-11T22:15:08.615200+0000","last_clean":"2024-09-11T22:15:08.615200+0000","last_became_active":"2024-09-11T22:15:07.622629+0000","last_became_peered":"2024-09-11T22:15:07.622629+0000","last_unstale":"2024-09-11T22:15:08.615200+0000","last_undegraded":"2024-09-11T22:15:08.615200+0000","last_fullsized":"2024-09-11T22:15:08.615200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:21.595561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.591032+0000","last_change":"2024-09-11T22:15:06.591032+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.591032+0000","last_undegraded":"2024-09-11T22:15:06.591032+0000","last_fullsized":"2024-09-11T22:15:06.591032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990214+0000","last_change":"2024-09-11T22:15:07.621753+0000","last_active":"2024-09-11T22:15:08.990214+0000","last_peered":"2024-09-11T22:15:08.990214+0000","last_clean":"2024-09-11T22:15:08.990214+0000","last_became_active":"2024-09-11T22:15:07.621469+0000","last_became_peered":"2024-09-11T22:15:07.621469+0000","last_unstale":"2024-09-11T22:15:08.990214+0000","last_undegraded":"2024-09-11T22:15:08.990214+0000","last_fullsized":"2024-09-11T22:15:08.990214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:57.372042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612759+0000","last_change":"2024-09-11T22:15:07.620776+0000","last_active":"2024-09-11T22:15:08.612759+0000","last_peered":"2024-09-11T22:15:08.612759+0000","last_clean":"2024-09-11T22:15:08.612759+0000","last_became_active":"2024-09-11T22:15:07.620512+0000","last_became_peered":"2024-09-11T22:15:07.620512+0000","last_unstale":"2024-09-11T22:15:08.612759+0000","last_undegraded":"2024-09-11T22:15:08.612759+0000","last_fullsized":"2024-09-11T22:15:08.612759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:17.012661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612736+0000","last_change":"2024-09-11T22:15:07.613812+0000","last_active":"2024-09-11T22:15:08.612736+0000","last_peered":"2024-09-11T22:15:08.612736+0000","last_clean":"2024-09-11T22:15:08.612736+0000","last_became_active":"2024-09-11T22:15:07.613488+0000","last_became_peered":"2024-09-11T22:15:07.613488+0000","last_unstale":"2024-09-11T22:15:08.612736+0000","last_undegraded":"2024-09-11T22:15:08.612736+0000","last_fullsized":"2024-09-11T22:15:08.612736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:47.977968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614827+0000","last_change":"2024-09-11T22:15:07.621039+0000","last_active":"2024-09-11T22:15:08.614827+0000","last_peered":"2024-09-11T22:15:08.614827+0000","last_clean":"2024-09-11T22:15:08.614827+0000","last_became_active":"2024-09-11T22:15:07.620669+0000","last_became_peered":"2024-09-11T22:15:07.620669+0000","last_unstale":"2024-09-11T22:15:08.614827+0000","last_undegraded":"2024-09-11T22:15:08.614827+0000","last_fullsized":"2024-09-11T22:15:08.614827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:33.307854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990303+0000","last_change":"2024-09-11T22:15:07.624157+0000","last_active":"2024-09-11T22:15:08.990303+0000","last_peered":"2024-09-11T22:15:08.990303+0000","last_clean":"2024-09-11T22:15:08.990303+0000","last_became_active":"2024-09-11T22:15:07.622120+0000","last_became_peered":"2024-09-11T22:15:07.622120+0000","last_unstale":"2024-09-11T22:15:08.990303+0000","last_undegraded":"2024-09-11T22:15:08.990303+0000","last_fullsized":"2024-09-11T22:15:08.990303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:31.693477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950600+0000","last_change":"2024-09-11T22:15:07.625050+0000","last_active":"2024-09-11T22:15:08.950600+0000","last_peered":"2024-09-11T22:15:08.950600+0000","last_clean":"2024-09-11T22:15:08.950600+0000","last_became_active":"2024-09-11T22:15:07.624770+0000","last_became_peered":"2024-09-11T22:15:07.624770+0000","last_unstale":"2024-09-11T22:15:08.950600+0000","last_undegraded":"2024-09-11T22:15:08.950600+0000","last_fullsized":"2024-09-11T22:15:08.950600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:39.268401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612645+0000","last_change":"2024-09-11T22:15:07.615306+0000","last_active":"2024-09-11T22:15:08.612645+0000","last_peered":"2024-09-11T22:15:08.612645+0000","last_clean":"2024-09-11T22:15:08.612645+0000","last_became_active":"2024-09-11T22:15:07.615030+0000","last_became_peered":"2024-09-11T22:15:07.615030+0000","last_unstale":"2024-09-11T22:15:08.612645+0000","last_undegraded":"2024-09-11T22:15:08.612645+0000","last_fullsized":"2024-09-11T22:15:08.612645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:32.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615516+0000","last_change":"2024-09-11T22:15:07.617207+0000","last_active":"2024-09-11T22:15:08.615516+0000","last_peered":"2024-09-11T22:15:08.615516+0000","last_clean":"2024-09-11T22:15:08.615516+0000","last_became_active":"2024-09-11T22:15:07.616622+0000","last_became_peered":"2024-09-11T22:15:07.616622+0000","last_unstale":"2024-09-11T22:15:08.615516+0000","last_undegraded":"2024-09-11T22:15:08.615516+0000","last_fullsized":"2024-09-11T22:15:08.615516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:32.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615208+0000","last_change":"2024-09-11T22:15:07.618290+0000","last_active":"2024-09-11T22:15:08.615208+0000","last_peered":"2024-09-11T22:15:08.615208+0000","last_clean":"2024-09-11T22:15:08.615208+0000","last_became_active":"2024-09-11T22:15:07.618024+0000","last_became_peered":"2024-09-11T22:15:07.618024+0000","last_unstale":"2024-09-11T22:15:08.615208+0000","last_undegraded":"2024-09-11T22:15:08.615208+0000","last_fullsized":"2024-09-11T22:15:08.615208+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:04.415812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.588379+0000","last_change":"2024-09-11T22:15:06.588379+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.588379+0000","last_undegraded":"2024-09-11T22:15:06.588379+0000","last_fullsized":"2024-09-11T22:15:06.588379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.588685+0000","last_change":"2024-09-11T22:15:06.588685+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.588685+0000","last_undegraded":"2024-09-11T22:15:06.588685+0000","last_fullsized":"2024-09-11T22:15:06.588685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615107+0000","last_change":"2024-09-11T22:15:07.624381+0000","last_active":"2024-09-11T22:15:08.615107+0000","last_peered":"2024-09-11T22:15:08.615107+0000","last_clean":"2024-09-11T22:15:08.615107+0000","last_became_active":"2024-09-11T22:15:07.624110+0000","last_became_peered":"2024-09-11T22:15:07.624110+0000","last_unstale":"2024-09-11T22:15:08.615107+0000","last_undegraded":"2024-09-11T22:15:08.615107+0000","last_fullsized":"2024-09-11T22:15:08.615107+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:04.961870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616093+0000","last_change":"2024-09-11T22:15:07.621337+0000","last_active":"2024-09-11T22:15:08.616093+0000","last_peered":"2024-09-11T22:15:08.616093+0000","last_clean":"2024-09-11T22:15:08.616093+0000","last_became_active":"2024-09-11T22:15:07.621070+0000","last_became_peered":"2024-09-11T22:15:07.621070+0000","last_unstale":"2024-09-11T22:15:08.616093+0000","last_undegraded":"2024-09-11T22:15:08.616093+0000","last_fullsized":"2024-09-11T22:15:08.616093+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:07.951475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989709+0000","last_change":"2024-09-11T22:15:07.626797+0000","last_active":"2024-09-11T22:15:08.989709+0000","last_peered":"2024-09-11T22:15:08.989709+0000","last_clean":"2024-09-11T22:15:08.989709+0000","last_became_active":"2024-09-11T22:15:07.626342+0000","last_became_peered":"2024-09-11T22:15:07.626342+0000","last_unstale":"2024-09-11T22:15:08.989709+0000","last_undegraded":"2024-09-11T22:15:08.989709+0000","last_fullsized":"2024-09-11T22:15:08.989709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:41.007210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615043+0000","last_change":"2024-09-11T22:15:07.624015+0000","last_active":"2024-09-11T22:15:08.615043+0000","last_peered":"2024-09-11T22:15:08.615043+0000","last_clean":"2024-09-11T22:15:08.615043+0000","last_became_active":"2024-09-11T22:15:07.623402+0000","last_became_peered":"2024-09-11T22:15:07.623402+0000","last_unstale":"2024-09-11T22:15:08.615043+0000","last_undegraded":"2024-09-11T22:15:08.615043+0000","last_fullsized":"2024-09-11T22:15:08.615043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.463954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989929+0000","last_change":"2024-09-11T22:15:07.617599+0000","last_active":"2024-09-11T22:15:08.989929+0000","last_peered":"2024-09-11T22:15:08.989929+0000","last_clean":"2024-09-11T22:15:08.989929+0000","last_became_active":"2024-09-11T22:15:07.616917+0000","last_became_peered":"2024-09-11T22:15:07.616917+0000","last_unstale":"2024-09-11T22:15:08.989929+0000","last_undegraded":"2024-09-11T22:15:08.989929+0000","last_fullsized":"2024-09-11T22:15:08.989929+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.339321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615511+0000","last_change":"2024-09-11T22:15:07.620592+0000","last_active":"2024-09-11T22:15:08.615511+0000","last_peered":"2024-09-11T22:15:08.615511+0000","last_clean":"2024-09-11T22:15:08.615511+0000","last_became_active":"2024-09-11T22:15:07.620310+0000","last_became_peered":"2024-09-11T22:15:07.620310+0000","last_unstale":"2024-09-11T22:15:08.615511+0000","last_undegraded":"2024-09-11T22:15:08.615511+0000","last_fullsized":"2024-09-11T22:15:08.615511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:40.859201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615602+0000","last_change":"2024-09-11T22:15:07.613050+0000","last_active":"2024-09-11T22:15:08.615602+0000","last_peered":"2024-09-11T22:15:08.615602+0000","last_clean":"2024-09-11T22:15:08.615602+0000","last_became_active":"2024-09-11T22:15:07.612729+0000","last_became_peered":"2024-09-11T22:15:07.612729+0000","last_unstale":"2024-09-11T22:15:08.615602+0000","last_undegraded":"2024-09-11T22:15:08.615602+0000","last_fullsized":"2024-09-11T22:15:08.615602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:23.619541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950591+0000","last_change":"2024-09-11T22:15:07.619623+0000","last_active":"2024-09-11T22:15:08.950591+0000","last_peered":"2024-09-11T22:15:08.950591+0000","last_clean":"2024-09-11T22:15:08.950591+0000","last_became_active":"2024-09-11T22:15:07.619354+0000","last_became_peered":"2024-09-11T22:15:07.619354+0000","last_unstale":"2024-09-11T22:15:08.950591+0000","last_undegraded":"2024-09-11T22:15:08.950591+0000","last_fullsized":"2024-09-11T22:15:08.950591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:51.968449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.587849+0000","last_change":"2024-09-11T22:15:06.587849+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.587849+0000","last_undegraded":"2024-09-11T22:15:06.587849+0000","last_fullsized":"2024-09-11T22:15:06.587849+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T22:15:06.601900+0000","last_change":"2024-09-11T22:15:06.599470+0000","last_active":"2024-09-11T22:15:06.601900+0000","last_peered":"2024-09-11T22:15:06.601900+0000","last_clean":"2024-09-11T22:15:06.601900+0000","last_became_active":"2024-09-11T22:15:06.599035+0000","last_became_peered":"2024-09-11T22:15:06.599035+0000","last_unstale":"2024-09-11T22:15:06.601900+0000","last_undegraded":"2024-09-11T22:15:06.601900+0000","last_fullsized":"2024-09-11T22:15:06.601900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:55.490923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612844+0000","last_change":"2024-09-11T22:15:06.599328+0000","last_active":"2024-09-11T22:15:08.612844+0000","last_peered":"2024-09-11T22:15:08.612844+0000","last_clean":"2024-09-11T22:15:08.612844+0000","last_became_active":"2024-09-11T22:15:06.599044+0000","last_became_peered":"2024-09-11T22:15:06.599044+0000","last_unstale":"2024-09-11T22:15:08.612844+0000","last_undegraded":"2024-09-11T22:15:08.612844+0000","last_fullsized":"2024-09-11T22:15:08.612844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:10.693728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950653+0000","last_change":"2024-09-11T22:15:07.624298+0000","last_active":"2024-09-11T22:15:08.950653+0000","last_peered":"2024-09-11T22:15:08.950653+0000","last_clean":"2024-09-11T22:15:08.950653+0000","last_became_active":"2024-09-11T22:15:07.623399+0000","last_became_peered":"2024-09-11T22:15:07.623399+0000","last_unstale":"2024-09-11T22:15:08.950653+0000","last_undegraded":"2024-09-11T22:15:08.950653+0000","last_fullsized":"2024-09-11T22:15:08.950653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:54.411507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615106+0000","last_change":"2024-09-11T22:15:06.599925+0000","last_active":"2024-09-11T22:15:08.615106+0000","last_peered":"2024-09-11T22:15:08.615106+0000","last_clean":"2024-09-11T22:15:08.615106+0000","last_became_active":"2024-09-11T22:15:06.599482+0000","last_became_peered":"2024-09-11T22:15:06.599482+0000","last_unstale":"2024-09-11T22:15:08.615106+0000","last_undegraded":"2024-09-11T22:15:08.615106+0000","last_fullsized":"2024-09-11T22:15:08.615106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:56.367532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.590610+0000","last_change":"2024-09-11T22:15:06.590610+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.590610+0000","last_undegraded":"2024-09-11T22:15:06.590610+0000","last_fullsized":"2024-09-11T22:15:06.590610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950832+0000","last_change":"2024-09-11T22:15:06.598354+0000","last_active":"2024-09-11T22:15:08.950832+0000","last_peered":"2024-09-11T22:15:08.950832+0000","last_clean":"2024-09-11T22:15:08.950832+0000","last_became_active":"2024-09-11T22:15:06.597886+0000","last_became_peered":"2024-09-11T22:15:06.597886+0000","last_unstale":"2024-09-11T22:15:08.950832+0000","last_undegraded":"2024-09-11T22:15:08.950832+0000","last_fullsized":"2024-09-11T22:15:08.950832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:16.566097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615590+0000","last_change":"2024-09-11T22:15:07.615641+0000","last_active":"2024-09-11T22:15:08.615590+0000","last_peered":"2024-09-11T22:15:08.615590+0000","last_clean":"2024-09-11T22:15:08.615590+0000","last_became_active":"2024-09-11T22:15:07.615317+0000","last_became_peered":"2024-09-11T22:15:07.615317+0000","last_unstale":"2024-09-11T22:15:08.615590+0000","last_undegraded":"2024-09-11T22:15:08.615590+0000","last_fullsized":"2024-09-11T22:15:08.615590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:51.103023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989901+0000","last_change":"2024-09-11T22:15:06.595409+0000","last_active":"2024-09-11T22:15:08.989901+0000","last_peered":"2024-09-11T22:15:08.989901+0000","last_clean":"2024-09-11T22:15:08.989901+0000","last_became_active":"2024-09-11T22:15:06.594997+0000","last_became_peered":"2024-09-11T22:15:06.594997+0000","last_unstale":"2024-09-11T22:15:08.989901+0000","last_undegraded":"2024-09-11T22:15:08.989901+0000","last_fullsized":"2024-09-11T22:15:08.989901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:47.151600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615672+0000","last_change":"2024-09-11T22:15:07.622620+0000","last_active":"2024-09-11T22:15:08.615672+0000","last_peered":"2024-09-11T22:15:08.615672+0000","last_clean":"2024-09-11T22:15:08.615672+0000","last_became_active":"2024-09-11T22:15:07.622043+0000","last_became_peered":"2024-09-11T22:15:07.622043+0000","last_unstale":"2024-09-11T22:15:08.615672+0000","last_undegraded":"2024-09-11T22:15:08.615672+0000","last_fullsized":"2024-09-11T22:15:08.615672+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:47.977968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950438+0000","last_change":"2024-09-11T22:15:06.601969+0000","last_active":"2024-09-11T22:15:08.950438+0000","last_peered":"2024-09-11T22:15:08.950438+0000","last_clean":"2024-09-11T22:15:08.950438+0000","last_became_active":"2024-09-11T22:15:06.601704+0000","last_became_peered":"2024-09-11T22:15:06.601704+0000","last_unstale":"2024-09-11T22:15:08.950438+0000","last_undegraded":"2024-09-11T22:15:08.950438+0000","last_fullsized":"2024-09-11T22:15:08.950438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:25.646446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989766+0000","last_change":"2024-09-11T22:15:06.589489+0000","last_active":"2024-09-11T22:15:08.989766+0000","last_peered":"2024-09-11T22:15:08.989766+0000","last_clean":"2024-09-11T22:15:08.989766+0000","last_became_active":"2024-09-11T22:15:06.589159+0000","last_became_peered":"2024-09-11T22:15:06.589159+0000","last_unstale":"2024-09-11T22:15:08.989766+0000","last_undegraded":"2024-09-11T22:15:08.989766+0000","last_fullsized":"2024-09-11T22:15:08.989766+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:56.182848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612591+0000","last_change":"2024-09-11T22:15:07.630577+0000","last_active":"2024-09-11T22:15:08.612591+0000","last_peered":"2024-09-11T22:15:08.612591+0000","last_clean":"2024-09-11T22:15:08.612591+0000","last_became_active":"2024-09-11T22:15:07.630271+0000","last_became_peered":"2024-09-11T22:15:07.630271+0000","last_unstale":"2024-09-11T22:15:08.612591+0000","last_undegraded":"2024-09-11T22:15:08.612591+0000","last_fullsized":"2024-09-11T22:15:08.612591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:25.034800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-09-11T22:15:05.584080+0000","last_change":"2024-09-11T22:15:05.584080+0000","last_active":"2024-09-11T22:15:05.573516+0000","last_peered":"2024-09-11T22:15:05.573516+0000","last_clean":"2024-09-11T22:15:05.573516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:05.584080+0000","last_undegraded":"2024-09-11T22:15:05.584080+0000","last_fullsized":"2024-09-11T22:15:05.584080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616017+0000","last_change":"2024-09-11T22:15:07.621117+0000","last_active":"2024-09-11T22:15:08.616017+0000","last_peered":"2024-09-11T22:15:08.616017+0000","last_clean":"2024-09-11T22:15:08.616017+0000","last_became_active":"2024-09-11T22:15:07.619879+0000","last_became_peered":"2024-09-11T22:15:07.619879+0000","last_unstale":"2024-09-11T22:15:08.616017+0000","last_undegraded":"2024-09-11T22:15:08.616017+0000","last_fullsized":"2024-09-11T22:15:08.616017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:46.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615132+0000","last_change":"2024-09-11T22:15:06.592064+0000","last_active":"2024-09-11T22:15:08.615132+0000","last_peered":"2024-09-11T22:15:08.615132+0000","last_clean":"2024-09-11T22:15:08.615132+0000","last_became_active":"2024-09-11T22:15:06.591789+0000","last_became_peered":"2024-09-11T22:15:06.591789+0000","last_unstale":"2024-09-11T22:15:08.615132+0000","last_undegraded":"2024-09-11T22:15:08.615132+0000","last_fullsized":"2024-09-11T22:15:08.615132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:13.507670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.591546+0000","last_change":"2024-09-11T22:15:06.591546+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.591546+0000","last_undegraded":"2024-09-11T22:15:06.591546+0000","last_fullsized":"2024-09-11T22:15:06.591546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950979+0000","last_change":"2024-09-11T22:15:06.596633+0000","last_active":"2024-09-11T22:15:08.950979+0000","last_peered":"2024-09-11T22:15:08.950979+0000","last_clean":"2024-09-11T22:15:08.950979+0000","last_became_active":"2024-09-11T22:15:06.596323+0000","last_became_peered":"2024-09-11T22:15:06.596323+0000","last_unstale":"2024-09-11T22:15:08.950979+0000","last_undegraded":"2024-09-11T22:15:08.950979+0000","last_fullsized":"2024-09-11T22:15:08.950979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:56.182848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950744+0000","last_change":"2024-09-11T22:15:07.621209+0000","last_active":"2024-09-11T22:15:08.950744+0000","last_peered":"2024-09-11T22:15:08.950744+0000","last_clean":"2024-09-11T22:15:08.950744+0000","last_became_active":"2024-09-11T22:15:07.620885+0000","last_became_peered":"2024-09-11T22:15:07.620885+0000","last_unstale":"2024-09-11T22:15:08.950744+0000","last_undegraded":"2024-09-11T22:15:08.950744+0000","last_fullsized":"2024-09-11T22:15:08.950744+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:26.478181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"73'3","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989810+0000","last_change":"2024-09-11T22:15:06.593945+0000","last_active":"2024-09-11T22:15:08.989810+0000","last_peered":"2024-09-11T22:15:08.989810+0000","last_clean":"2024-09-11T22:15:08.989810+0000","last_became_active":"2024-09-11T22:15:06.593612+0000","last_became_peered":"2024-09-11T22:15:06.593612+0000","last_unstale":"2024-09-11T22:15:08.989810+0000","last_undegraded":"2024-09-11T22:15:08.989810+0000","last_fullsized":"2024-09-11T22:15:08.989810+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:32.595037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"73'6","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990328+0000","last_change":"2024-09-11T22:15:06.596829+0000","last_active":"2024-09-11T22:15:08.990328+0000","last_peered":"2024-09-11T22:15:08.990328+0000","last_clean":"2024-09-11T22:15:08.990328+0000","last_became_active":"2024-09-11T22:15:06.596541+0000","last_became_peered":"2024-09-11T22:15:06.596541+0000","last_unstale":"2024-09-11T22:15:08.990328+0000","last_undegraded":"2024-09-11T22:15:08.990328+0000","last_fullsized":"2024-09-11T22:15:08.990328+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:54.153574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.589375+0000","last_change":"2024-09-11T22:15:06.589375+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.589375+0000","last_undegraded":"2024-09-11T22:15:06.589375+0000","last_fullsized":"2024-09-11T22:15:06.589375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990061+0000","last_change":"2024-09-11T22:15:06.594726+0000","last_active":"2024-09-11T22:15:08.990061+0000","last_peered":"2024-09-11T22:15:08.990061+0000","last_clean":"2024-09-11T22:15:08.990061+0000","last_became_active":"2024-09-11T22:15:06.594397+0000","last_became_peered":"2024-09-11T22:15:06.594397+0000","last_unstale":"2024-09-11T22:15:08.990061+0000","last_undegraded":"2024-09-11T22:15:08.990061+0000","last_fullsized":"2024-09-11T22:15:08.990061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:08.901035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615695+0000","last_change":"2024-09-11T22:15:07.616399+0000","last_active":"2024-09-11T22:15:08.615695+0000","last_peered":"2024-09-11T22:15:08.615695+0000","last_clean":"2024-09-11T22:15:08.615695+0000","last_became_active":"2024-09-11T22:15:07.616049+0000","last_became_peered":"2024-09-11T22:15:07.616049+0000","last_unstale":"2024-09-11T22:15:08.615695+0000","last_undegraded":"2024-09-11T22:15:08.615695+0000","last_fullsized":"2024-09-11T22:15:08.615695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:58.048294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950685+0000","last_change":"2024-09-11T22:15:06.596968+0000","last_active":"2024-09-11T22:15:08.950685+0000","last_peered":"2024-09-11T22:15:08.950685+0000","last_clean":"2024-09-11T22:15:08.950685+0000","last_became_active":"2024-09-11T22:15:06.595698+0000","last_became_peered":"2024-09-11T22:15:06.595698+0000","last_unstale":"2024-09-11T22:15:08.950685+0000","last_undegraded":"2024-09-11T22:15:08.950685+0000","last_fullsized":"2024-09-11T22:15:08.950685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:25.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612514+0000","last_change":"2024-09-11T22:15:07.621366+0000","last_active":"2024-09-11T22:15:08.612514+0000","last_peered":"2024-09-11T22:15:08.612514+0000","last_clean":"2024-09-11T22:15:08.612514+0000","last_became_active":"2024-09-11T22:15:07.621103+0000","last_became_peered":"2024-09-11T22:15:07.621103+0000","last_unstale":"2024-09-11T22:15:08.612514+0000","last_undegraded":"2024-09-11T22:15:08.612514+0000","last_fullsized":"2024-09-11T22:15:08.612514+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:04.415812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615462+0000","last_change":"2024-09-11T22:15:06.603089+0000","last_active":"2024-09-11T22:15:08.615462+0000","last_peered":"2024-09-11T22:15:08.615462+0000","last_clean":"2024-09-11T22:15:08.615462+0000","last_became_active":"2024-09-11T22:15:06.602803+0000","last_became_peered":"2024-09-11T22:15:06.602803+0000","last_unstale":"2024-09-11T22:15:08.615462+0000","last_undegraded":"2024-09-11T22:15:08.615462+0000","last_fullsized":"2024-09-11T22:15:08.615462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:34.459445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"73'8","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614740+0000","last_change":"2024-09-11T22:15:06.594832+0000","last_active":"2024-09-11T22:15:08.614740+0000","last_peered":"2024-09-11T22:15:08.614740+0000","last_clean":"2024-09-11T22:15:08.614740+0000","last_became_active":"2024-09-11T22:15:06.594529+0000","last_became_peered":"2024-09-11T22:15:06.594529+0000","last_unstale":"2024-09-11T22:15:08.614740+0000","last_undegraded":"2024-09-11T22:15:08.614740+0000","last_fullsized":"2024-09-11T22:15:08.614740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:02.299662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615277+0000","last_change":"2024-09-11T22:15:07.615717+0000","last_active":"2024-09-11T22:15:08.615277+0000","last_peered":"2024-09-11T22:15:08.615277+0000","last_clean":"2024-09-11T22:15:08.615277+0000","last_became_active":"2024-09-11T22:15:07.615451+0000","last_became_peered":"2024-09-11T22:15:07.615451+0000","last_unstale":"2024-09-11T22:15:08.615277+0000","last_undegraded":"2024-09-11T22:15:08.615277+0000","last_fullsized":"2024-09-11T22:15:08.615277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:25.034800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950863+0000","last_change":"2024-09-11T22:15:06.594898+0000","last_active":"2024-09-11T22:15:08.950863+0000","last_peered":"2024-09-11T22:15:08.950863+0000","last_clean":"2024-09-11T22:15:08.950863+0000","last_became_active":"2024-09-11T22:15:06.594562+0000","last_became_peered":"2024-09-11T22:15:06.594562+0000","last_unstale":"2024-09-11T22:15:08.950863+0000","last_undegraded":"2024-09-11T22:15:08.950863+0000","last_fullsized":"2024-09-11T22:15:08.950863+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:24.994361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.587962+0000","last_change":"2024-09-11T22:15:06.587962+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.587962+0000","last_undegraded":"2024-09-11T22:15:06.587962+0000","last_fullsized":"2024-09-11T22:15:06.587962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615315+0000","last_change":"2024-09-11T22:15:06.597291+0000","last_active":"2024-09-11T22:15:08.615315+0000","last_peered":"2024-09-11T22:15:08.615315+0000","last_clean":"2024-09-11T22:15:08.615315+0000","last_became_active":"2024-09-11T22:15:06.596980+0000","last_became_peered":"2024-09-11T22:15:06.596980+0000","last_unstale":"2024-09-11T22:15:08.615315+0000","last_undegraded":"2024-09-11T22:15:08.615315+0000","last_fullsized":"2024-09-11T22:15:08.615315+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:30.688967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990306+0000","last_change":"2024-09-11T22:15:07.621646+0000","last_active":"2024-09-11T22:15:08.990306+0000","last_peered":"2024-09-11T22:15:08.990306+0000","last_clean":"2024-09-11T22:15:08.990306+0000","last_became_active":"2024-09-11T22:15:07.621117+0000","last_became_peered":"2024-09-11T22:15:07.621117+0000","last_unstale":"2024-09-11T22:15:08.990306+0000","last_undegraded":"2024-09-11T22:15:08.990306+0000","last_fullsized":"2024-09-11T22:15:08.990306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:14.512180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950675+0000","last_change":"2024-09-11T22:15:06.598749+0000","last_active":"2024-09-11T22:15:08.950675+0000","last_peered":"2024-09-11T22:15:08.950675+0000","last_clean":"2024-09-11T22:15:08.950675+0000","last_became_active":"2024-09-11T22:15:06.597719+0000","last_became_peered":"2024-09-11T22:15:06.597719+0000","last_unstale":"2024-09-11T22:15:08.950675+0000","last_undegraded":"2024-09-11T22:15:08.950675+0000","last_fullsized":"2024-09-11T22:15:08.950675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:57.551356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T22:15:06.599018+0000","last_change":"2024-09-11T22:15:06.597301+0000","last_active":"2024-09-11T22:15:06.599018+0000","last_peered":"2024-09-11T22:15:06.599018+0000","last_clean":"2024-09-11T22:15:06.599018+0000","last_became_active":"2024-09-11T22:15:06.597000+0000","last_became_peered":"2024-09-11T22:15:06.597000+0000","last_unstale":"2024-09-11T22:15:06.599018+0000","last_undegraded":"2024-09-11T22:15:06.599018+0000","last_fullsized":"2024-09-11T22:15:06.599018+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:29.864901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989834+0000","last_change":"2024-09-11T22:15:07.626542+0000","last_active":"2024-09-11T22:15:08.989834+0000","last_peered":"2024-09-11T22:15:08.989834+0000","last_clean":"2024-09-11T22:15:08.989834+0000","last_became_active":"2024-09-11T22:15:07.626252+0000","last_became_peered":"2024-09-11T22:15:07.626252+0000","last_unstale":"2024-09-11T22:15:08.989834+0000","last_undegraded":"2024-09-11T22:15:08.989834+0000","last_fullsized":"2024-09-11T22:15:08.989834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:30.662715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950812+0000","last_change":"2024-09-11T22:15:06.602028+0000","last_active":"2024-09-11T22:15:08.950812+0000","last_peered":"2024-09-11T22:15:08.950812+0000","last_clean":"2024-09-11T22:15:08.950812+0000","last_became_active":"2024-09-11T22:15:06.601723+0000","last_became_peered":"2024-09-11T22:15:06.601723+0000","last_unstale":"2024-09-11T22:15:08.950812+0000","last_undegraded":"2024-09-11T22:15:08.950812+0000","last_fullsized":"2024-09-11T22:15:08.950812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:08.901035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989476+0000","last_change":"2024-09-11T22:15:07.624503+0000","last_active":"2024-09-11T22:15:08.989476+0000","last_peered":"2024-09-11T22:15:08.989476+0000","last_clean":"2024-09-11T22:15:08.989476+0000","last_became_active":"2024-09-11T22:15:07.624218+0000","last_became_peered":"2024-09-11T22:15:07.624218+0000","last_unstale":"2024-09-11T22:15:08.989476+0000","last_undegraded":"2024-09-11T22:15:08.989476+0000","last_fullsized":"2024-09-11T22:15:08.989476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:41.357009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615706+0000","last_change":"2024-09-11T22:15:06.595704+0000","last_active":"2024-09-11T22:15:08.615706+0000","last_peered":"2024-09-11T22:15:08.615706+0000","last_clean":"2024-09-11T22:15:08.615706+0000","last_became_active":"2024-09-11T22:15:06.595424+0000","last_became_peered":"2024-09-11T22:15:06.595424+0000","last_unstale":"2024-09-11T22:15:08.615706+0000","last_undegraded":"2024-09-11T22:15:08.615706+0000","last_fullsized":"2024-09-11T22:15:08.615706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:32.303344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989526+0000","last_change":"2024-09-11T22:15:07.627761+0000","last_active":"2024-09-11T22:15:08.989526+0000","last_peered":"2024-09-11T22:15:08.989526+0000","last_clean":"2024-09-11T22:15:08.989526+0000","last_became_active":"2024-09-11T22:15:07.627501+0000","last_became_peered":"2024-09-11T22:15:07.627501+0000","last_unstale":"2024-09-11T22:15:08.989526+0000","last_undegraded":"2024-09-11T22:15:08.989526+0000","last_fullsized":"2024-09-11T22:15:08.989526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:56.279768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612424+0000","last_change":"2024-09-11T22:15:06.599176+0000","last_active":"2024-09-11T22:15:08.612424+0000","last_peered":"2024-09-11T22:15:08.612424+0000","last_clean":"2024-09-11T22:15:08.612424+0000","last_became_active":"2024-09-11T22:15:06.598884+0000","last_became_peered":"2024-09-11T22:15:06.598884+0000","last_unstale":"2024-09-11T22:15:08.612424+0000","last_undegraded":"2024-09-11T22:15:08.612424+0000","last_fullsized":"2024-09-11T22:15:08.612424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:53.406997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612778+0000","last_change":"2024-09-11T22:15:07.617307+0000","last_active":"2024-09-11T22:15:08.612778+0000","last_peered":"2024-09-11T22:15:08.612778+0000","last_clean":"2024-09-11T22:15:08.612778+0000","last_became_active":"2024-09-11T22:15:07.617023+0000","last_became_peered":"2024-09-11T22:15:07.617023+0000","last_unstale":"2024-09-11T22:15:08.612778+0000","last_undegraded":"2024-09-11T22:15:08.612778+0000","last_fullsized":"2024-09-11T22:15:08.612778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:52.279163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950937+0000","last_change":"2024-09-11T22:15:06.596640+0000","last_active":"2024-09-11T22:15:08.950937+0000","last_peered":"2024-09-11T22:15:08.950937+0000","last_clean":"2024-09-11T22:15:08.950937+0000","last_became_active":"2024-09-11T22:15:06.595275+0000","last_became_peered":"2024-09-11T22:15:06.595275+0000","last_unstale":"2024-09-11T22:15:08.950937+0000","last_undegraded":"2024-09-11T22:15:08.950937+0000","last_fullsized":"2024-09-11T22:15:08.950937+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:34.525374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615860+0000","last_change":"2024-09-11T22:15:07.607459+0000","last_active":"2024-09-11T22:15:08.615860+0000","last_peered":"2024-09-11T22:15:08.615860+0000","last_clean":"2024-09-11T22:15:08.615860+0000","last_became_active":"2024-09-11T22:15:07.607170+0000","last_became_peered":"2024-09-11T22:15:07.607170+0000","last_unstale":"2024-09-11T22:15:08.615860+0000","last_undegraded":"2024-09-11T22:15:08.615860+0000","last_fullsized":"2024-09-11T22:15:08.615860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:38.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616087+0000","last_change":"2024-09-11T22:15:06.603161+0000","last_active":"2024-09-11T22:15:08.616087+0000","last_peered":"2024-09-11T22:15:08.616087+0000","last_clean":"2024-09-11T22:15:08.616087+0000","last_became_active":"2024-09-11T22:15:06.602873+0000","last_became_peered":"2024-09-11T22:15:06.602873+0000","last_unstale":"2024-09-11T22:15:08.616087+0000","last_undegraded":"2024-09-11T22:15:08.616087+0000","last_fullsized":"2024-09-11T22:15:08.616087+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:03.957361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.588958+0000","last_change":"2024-09-11T22:15:06.588958+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.588958+0000","last_undegraded":"2024-09-11T22:15:06.588958+0000","last_fullsized":"2024-09-11T22:15:06.588958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-09-11T22:15:05.584086+0000","last_change":"2024-09-11T22:15:05.584086+0000","last_active":"2024-09-11T22:15:05.573516+0000","last_peered":"2024-09-11T22:15:05.573516+0000","last_clean":"2024-09-11T22:15:05.573516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:05.584086+0000","last_undegraded":"2024-09-11T22:15:05.584086+0000","last_fullsized":"2024-09-11T22:15:05.584086+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.590216+0000","last_change":"2024-09-11T22:15:06.590216+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.590216+0000","last_undegraded":"2024-09-11T22:15:06.590216+0000","last_fullsized":"2024-09-11T22:15:06.590216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612643+0000","last_change":"2024-09-11T22:15:06.595834+0000","last_active":"2024-09-11T22:15:08.612643+0000","last_peered":"2024-09-11T22:15:08.612643+0000","last_clean":"2024-09-11T22:15:08.612643+0000","last_became_active":"2024-09-11T22:15:06.595547+0000","last_became_peered":"2024-09-11T22:15:06.595547+0000","last_unstale":"2024-09-11T22:15:08.612643+0000","last_undegraded":"2024-09-11T22:15:08.612643+0000","last_fullsized":"2024-09-11T22:15:08.612643+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:38.263891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:06.578025+0000","last_change":"2024-09-11T22:15:06.578025+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.578025+0000","last_undegraded":"2024-09-11T22:15:06.578025+0000","last_fullsized":"2024-09-11T22:15:06.578025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2024-09-11T22:15:05.584664+0000","last_change":"2024-09-11T22:15:05.584664+0000","last_active":"2024-09-11T22:15:05.573516+0000","last_peered":"2024-09-11T22:15:05.573516+0000","last_clean":"2024-09-11T22:15:05.573516+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:05.584664+0000","last_undegraded":"2024-09-11T22:15:05.584664+0000","last_fullsized":"2024-09-11T22:15:05.584664+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950580+0000","last_change":"2024-09-11T22:15:07.625363+0000","last_active":"2024-09-11T22:15:08.950580+0000","last_peered":"2024-09-11T22:15:08.950580+0000","last_clean":"2024-09-11T22:15:08.950580+0000","last_became_active":"2024-09-11T22:15:07.624697+0000","last_became_peered":"2024-09-11T22:15:07.624697+0000","last_unstale":"2024-09-11T22:15:08.950580+0000","last_undegraded":"2024-09-11T22:15:08.950580+0000","last_fullsized":"2024-09-11T22:15:08.950580+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:09.058151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989011+0000","last_change":"2024-09-11T22:15:06.589248+0000","last_active":"2024-09-11T22:15:08.989011+0000","last_peered":"2024-09-11T22:15:08.989011+0000","last_clean":"2024-09-11T22:15:08.989011+0000","last_became_active":"2024-09-11T22:15:06.588990+0000","last_became_peered":"2024-09-11T22:15:06.588990+0000","last_unstale":"2024-09-11T22:15:08.989011+0000","last_undegraded":"2024-09-11T22:15:08.989011+0000","last_fullsized":"2024-09-11T22:15:08.989011+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:25.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989285+0000","last_change":"2024-09-11T22:15:07.621584+0000","last_active":"2024-09-11T22:15:08.989285+0000","last_peered":"2024-09-11T22:15:08.989285+0000","last_clean":"2024-09-11T22:15:08.989285+0000","last_became_active":"2024-09-11T22:15:07.621309+0000","last_became_peered":"2024-09-11T22:15:07.621309+0000","last_unstale":"2024-09-11T22:15:08.989285+0000","last_undegraded":"2024-09-11T22:15:08.989285+0000","last_fullsized":"2024-09-11T22:15:08.989285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:16.481227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614930+0000","last_change":"2024-09-11T22:15:06.594165+0000","last_active":"2024-09-11T22:15:08.614930+0000","last_peered":"2024-09-11T22:15:08.614930+0000","last_clean":"2024-09-11T22:15:08.614930+0000","last_became_active":"2024-09-11T22:15:06.593911+0000","last_became_peered":"2024-09-11T22:15:06.593911+0000","last_unstale":"2024-09-11T22:15:08.614930+0000","last_undegraded":"2024-09-11T22:15:08.614930+0000","last_fullsized":"2024-09-11T22:15:08.614930+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:15.476717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950375+0000","last_change":"2024-09-11T22:15:07.618801+0000","last_active":"2024-09-11T22:15:08.950375+0000","last_peered":"2024-09-11T22:15:08.950375+0000","last_clean":"2024-09-11T22:15:08.950375+0000","last_became_active":"2024-09-11T22:15:07.618516+0000","last_became_peered":"2024-09-11T22:15:07.618516+0000","last_unstale":"2024-09-11T22:15:08.950375+0000","last_undegraded":"2024-09-11T22:15:08.950375+0000","last_fullsized":"2024-09-11T22:15:08.950375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:14.512180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950830+0000","last_change":"2024-09-11T22:15:06.598668+0000","last_active":"2024-09-11T22:15:08.950830+0000","last_peered":"2024-09-11T22:15:08.950830+0000","last_clean":"2024-09-11T22:15:08.950830+0000","last_became_active":"2024-09-11T22:15:06.598188+0000","last_became_peered":"2024-09-11T22:15:06.598188+0000","last_unstale":"2024-09-11T22:15:08.950830+0000","last_undegraded":"2024-09-11T22:15:08.950830+0000","last_fullsized":"2024-09-11T22:15:08.950830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:53.861223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989684+0000","last_change":"2024-09-11T22:15:07.628459+0000","last_active":"2024-09-11T22:15:08.989684+0000","last_peered":"2024-09-11T22:15:08.989684+0000","last_clean":"2024-09-11T22:15:08.989684+0000","last_became_active":"2024-09-11T22:15:07.628201+0000","last_became_peered":"2024-09-11T22:15:07.628201+0000","last_unstale":"2024-09-11T22:15:08.989684+0000","last_undegraded":"2024-09-11T22:15:08.989684+0000","last_fullsized":"2024-09-11T22:15:08.989684+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:27.058146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950623+0000","last_change":"2024-09-11T22:15:06.599378+0000","last_active":"2024-09-11T22:15:08.950623+0000","last_peered":"2024-09-11T22:15:08.950623+0000","last_clean":"2024-09-11T22:15:08.950623+0000","last_became_active":"2024-09-11T22:15:06.599051+0000","last_became_peered":"2024-09-11T22:15:06.599051+0000","last_unstale":"2024-09-11T22:15:08.950623+0000","last_undegraded":"2024-09-11T22:15:08.950623+0000","last_fullsized":"2024-09-11T22:15:08.950623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:49.135671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":262,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T22:15:06.592036+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:15:06.592036+0000","last_peered":"2024-09-11T22:15:06.592036+0000","last_clean":"2024-09-11T22:15:06.592036+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:15:06.592036+0000","last_undegraded":"2024-09-11T22:15:06.592036+0000","last_fullsized":"2024-09-11T22:15:06.592036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36236,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335604,"statfs":{"total":96636764160,"available":96599658496,"internally_reserved":0,"allocated":901120,"data_stored":380409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":897024,"data_stored":380407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":897024,"data_stored":380387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":888832,"data_stored":374129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":913408,"data_stored":382545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40964,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330876,"statfs":{"total":96636764160,"available":96594817024,"internally_reserved":0,"allocated":1486848,"data_stored":970685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36784,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335056,"statfs":{"total":96636764160,"available":96599097344,"internally_reserved":0,"allocated":1462272,"data_stored":957610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44504,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327336,"statfs":{"total":96636764160,"available":96591192064,"internally_reserved":0,"allocated":856064,"data_stored":360967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:15:11.287 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3f is not active+clean 2024-09-11T22:15:11.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:06.591960+0000', 'last_change': '2024-09-11T22:15:06.591960+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.591960+0000', 'last_undegraded': '2024-09-11T22:15:06.591960+0000', 'last_fullsized': '2024-09-11T22:15:06.591960+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:15:11.287 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3b is not active+clean 2024-09-11T22:15:11.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:06.578025+0000', 'last_change': '2024-09-11T22:15:06.578025+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.578025+0000', 'last_undegraded': '2024-09-11T22:15:06.578025+0000', 'last_fullsized': '2024-09-11T22:15:06.578025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:11.287 INFO:tasks.ceph.ceph_manager.ceph:PG 11.37 is not active+clean 2024-09-11T22:15:11.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:06.578025+0000', 'last_change': '2024-09-11T22:15:06.578025+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.578025+0000', 'last_undegraded': '2024-09-11T22:15:06.578025+0000', 'last_fullsized': '2024-09-11T22:15:06.578025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:11.288 INFO:tasks.ceph.ceph_manager.ceph:PG 11.35 is not active+clean 2024-09-11T22:15:11.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:06.591032+0000', 'last_change': '2024-09-11T22:15:06.591032+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.591032+0000', 'last_undegraded': '2024-09-11T22:15:06.591032+0000', 'last_fullsized': '2024-09-11T22:15:06.591032+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:15:11.288 INFO:tasks.ceph.ceph_manager.ceph:PG 11.32 is not active+clean 2024-09-11T22:15:11.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:06.578025+0000', 'last_change': '2024-09-11T22:15:06.578025+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.578025+0000', 'last_undegraded': '2024-09-11T22:15:06.578025+0000', 'last_fullsized': '2024-09-11T22:15:06.578025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:11.288 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2f is not active+clean 2024-09-11T22:15:11.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:06.578025+0000', 'last_change': '2024-09-11T22:15:06.578025+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.578025+0000', 'last_undegraded': '2024-09-11T22:15:06.578025+0000', 'last_fullsized': '2024-09-11T22:15:06.578025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:11.288 INFO:tasks.ceph.ceph_manager.ceph:PG 11.29 is not active+clean 2024-09-11T22:15:11.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:06.588379+0000', 'last_change': '2024-09-11T22:15:06.588379+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.588379+0000', 'last_undegraded': '2024-09-11T22:15:06.588379+0000', 'last_fullsized': '2024-09-11T22:15:06.588379+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:15:11.288 INFO:tasks.ceph.ceph_manager.ceph:PG 11.28 is not active+clean 2024-09-11T22:15:11.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:06.588685+0000', 'last_change': '2024-09-11T22:15:06.588685+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.588685+0000', 'last_undegraded': '2024-09-11T22:15:06.588685+0000', 'last_fullsized': '2024-09-11T22:15:06.588685+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:15:11.289 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1e is not active+clean 2024-09-11T22:15:11.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:06.587849+0000', 'last_change': '2024-09-11T22:15:06.587849+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.587849+0000', 'last_undegraded': '2024-09-11T22:15:06.587849+0000', 'last_fullsized': '2024-09-11T22:15:06.587849+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:15:11.289 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1f is not active+clean 2024-09-11T22:15:11.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:06.578025+0000', 'last_change': '2024-09-11T22:15:06.578025+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.578025+0000', 'last_undegraded': '2024-09-11T22:15:06.578025+0000', 'last_fullsized': '2024-09-11T22:15:06.578025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:11.289 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1d is not active+clean 2024-09-11T22:15:11.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:06.590610+0000', 'last_change': '2024-09-11T22:15:06.590610+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.590610+0000', 'last_undegraded': '2024-09-11T22:15:06.590610+0000', 'last_fullsized': '2024-09-11T22:15:06.590610+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:15:11.289 INFO:tasks.ceph.ceph_manager.ceph:PG 11.18 is not active+clean 2024-09-11T22:15:11.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:06.578025+0000', 'last_change': '2024-09-11T22:15:06.578025+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.578025+0000', 'last_undegraded': '2024-09-11T22:15:06.578025+0000', 'last_fullsized': '2024-09-11T22:15:06.578025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:11.289 INFO:tasks.ceph.ceph_manager.ceph:PG 10.18 is not active+clean 2024-09-11T22:15:11.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:05.584080+0000', 'last_change': '2024-09-11T22:15:05.584080+0000', 'last_active': '2024-09-11T22:15:05.573516+0000', 'last_peered': '2024-09-11T22:15:05.573516+0000', 'last_clean': '2024-09-11T22:15:05.573516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:05.584080+0000', 'last_undegraded': '2024-09-11T22:15:05.584080+0000', 'last_fullsized': '2024-09-11T22:15:05.584080+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:05.573516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:05.573516+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:05.573516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:15:11.290 INFO:tasks.ceph.ceph_manager.ceph:PG 11.17 is not active+clean 2024-09-11T22:15:11.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:06.591546+0000', 'last_change': '2024-09-11T22:15:06.591546+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.591546+0000', 'last_undegraded': '2024-09-11T22:15:06.591546+0000', 'last_fullsized': '2024-09-11T22:15:06.591546+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:15:11.290 INFO:tasks.ceph.ceph_manager.ceph:PG 11.15 is not active+clean 2024-09-11T22:15:11.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:06.578025+0000', 'last_change': '2024-09-11T22:15:06.578025+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.578025+0000', 'last_undegraded': '2024-09-11T22:15:06.578025+0000', 'last_fullsized': '2024-09-11T22:15:06.578025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:11.290 INFO:tasks.ceph.ceph_manager.ceph:PG 11.12 is not active+clean 2024-09-11T22:15:11.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:06.589375+0000', 'last_change': '2024-09-11T22:15:06.589375+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.589375+0000', 'last_undegraded': '2024-09-11T22:15:06.589375+0000', 'last_fullsized': '2024-09-11T22:15:06.589375+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:15:11.290 INFO:tasks.ceph.ceph_manager.ceph:PG 11.11 is not active+clean 2024-09-11T22:15:11.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:06.578025+0000', 'last_change': '2024-09-11T22:15:06.578025+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.578025+0000', 'last_undegraded': '2024-09-11T22:15:06.578025+0000', 'last_fullsized': '2024-09-11T22:15:06.578025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:11.290 INFO:tasks.ceph.ceph_manager.ceph:PG 11.f is not active+clean 2024-09-11T22:15:11.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:06.587962+0000', 'last_change': '2024-09-11T22:15:06.587962+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.587962+0000', 'last_undegraded': '2024-09-11T22:15:06.587962+0000', 'last_fullsized': '2024-09-11T22:15:06.587962+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:15:11.290 INFO:tasks.ceph.ceph_manager.ceph:PG 11.d is not active+clean 2024-09-11T22:15:11.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:06.578025+0000', 'last_change': '2024-09-11T22:15:06.578025+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.578025+0000', 'last_undegraded': '2024-09-11T22:15:06.578025+0000', 'last_fullsized': '2024-09-11T22:15:06.578025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:11.291 INFO:tasks.ceph.ceph_manager.ceph:PG 11.4 is not active+clean 2024-09-11T22:15:11.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:06.588958+0000', 'last_change': '2024-09-11T22:15:06.588958+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.588958+0000', 'last_undegraded': '2024-09-11T22:15:06.588958+0000', 'last_fullsized': '2024-09-11T22:15:06.588958+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:15:11.291 INFO:tasks.ceph.ceph_manager.ceph:PG 10.5 is not active+clean 2024-09-11T22:15:11.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:05.584086+0000', 'last_change': '2024-09-11T22:15:05.584086+0000', 'last_active': '2024-09-11T22:15:05.573516+0000', 'last_peered': '2024-09-11T22:15:05.573516+0000', 'last_clean': '2024-09-11T22:15:05.573516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:05.584086+0000', 'last_undegraded': '2024-09-11T22:15:05.584086+0000', 'last_fullsized': '2024-09-11T22:15:05.584086+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:05.573516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:05.573516+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:05.573516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:15:11.291 INFO:tasks.ceph.ceph_manager.ceph:PG 11.5 is not active+clean 2024-09-11T22:15:11.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:06.590216+0000', 'last_change': '2024-09-11T22:15:06.590216+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.590216+0000', 'last_undegraded': '2024-09-11T22:15:06.590216+0000', 'last_fullsized': '2024-09-11T22:15:06.590216+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:15:11.291 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2 is not active+clean 2024-09-11T22:15:11.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:06.578025+0000', 'last_change': '2024-09-11T22:15:06.578025+0000', 'last_active': '2024-09-11T22:15:06.578025+0000', 'last_peered': '2024-09-11T22:15:06.578025+0000', 'last_clean': '2024-09-11T22:15:06.578025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:06.578025+0000', 'last_undegraded': '2024-09-11T22:15:06.578025+0000', 'last_fullsized': '2024-09-11T22:15:06.578025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:06.578025+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:11.291 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3 is not active+clean 2024-09-11T22:15:11.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:05.584664+0000', 'last_change': '2024-09-11T22:15:05.584664+0000', 'last_active': '2024-09-11T22:15:05.573516+0000', 'last_peered': '2024-09-11T22:15:05.573516+0000', 'last_clean': '2024-09-11T22:15:05.573516+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:05.584664+0000', 'last_undegraded': '2024-09-11T22:15:05.584664+0000', 'last_fullsized': '2024-09-11T22:15:05.584664+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:05.573516+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:05.573516+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:05.573516+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:15:11.292 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:15:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.424+0000 7f2b121a2640 1 Processor -- start 2024-09-11T22:15:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.425+0000 7f2b121a2640 1 -- start start 2024-09-11T22:15:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.425+0000 7f2b121a2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b0c0ce1c0 0x7f2b0c0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.425+0000 7f2b121a2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b0c0cec10 con 0x7f2b0c147fe0 2024-09-11T22:15:11.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.425+0000 7f2b121a2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b0c06e900 con 0x7f2b0c0b6900 2024-09-11T22:15:11.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.425+0000 7f2b121a2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2b0c0ceef0 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.426+0000 7f2b1099f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b0c0ce1c0 0x7f2b0c0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.426+0000 7f2b1099f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b0c0ce1c0 0x7f2b0c0ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50098/0 (socket says 172.21.15.50:50098) 2024-09-11T22:15:11.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.426+0000 7f2b111a0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2b0c147fe0 0x7f2b0c15eb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56382/0 (socket says 172.21.15.50:56382) 2024-09-11T22:15:11.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.426+0000 7f2b1099f640 1 -- 172.21.15.50:0/322977179 learned_addr learned my addr 172.21.15.50:0/322977179 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:11.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.426+0000 7f2b1099f640 1 -- 172.21.15.50:0/322977179 >> v1:172.21.15.77:6789/0 conn(0x7f2b0c0b6900 legacy=0x7f2b0c06f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:11.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.426+0000 7f2b1099f640 1 -- 172.21.15.50:0/322977179 >> v1:172.21.15.50:6789/0 conn(0x7f2b0c147fe0 legacy=0x7f2b0c15eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.426+0000 7f2b1099f640 1 -- 172.21.15.50:0/322977179 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0c06ebe0 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.427+0000 7f2b1099f640 1 --2- 172.21.15.50:0/322977179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0c0ce1c0 0x7f2b0c0ce600 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009870 tx=0x7f2b0002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baed2727639954d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:11.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.427+0000 7f2b0bfff640 1 -- 172.21.15.50:0/322977179 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b00037070 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.427+0000 7f2b0bfff640 1 -- 172.21.15.50:0/322977179 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b00032440 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.427+0000 7f2b0bfff640 1 -- 172.21.15.50:0/322977179 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b00032810 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.427+0000 7f2b121a2640 1 -- 172.21.15.50:0/322977179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0c0ce1c0 msgr2=0x7f2b0c0ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.427+0000 7f2b121a2640 1 --2- 172.21.15.50:0/322977179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0c0ce1c0 0x7f2b0c0ce600 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009870 tx=0x7f2b0002a2a0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.427+0000 7f2b121a2640 1 -- 172.21.15.50:0/322977179 shutdown_connections 2024-09-11T22:15:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.427+0000 7f2b121a2640 1 --2- 172.21.15.50:0/322977179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0c0ce1c0 0x7f2b0c0ce600 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.427+0000 7f2b121a2640 1 -- 172.21.15.50:0/322977179 >> 172.21.15.50:0/322977179 conn(0x7f2b0c06bd30 msgr2=0x7f2b0c06c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.427+0000 7f2b121a2640 1 -- 172.21.15.50:0/322977179 shutdown_connections 2024-09-11T22:15:11.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.427+0000 7f2b121a2640 1 -- 172.21.15.50:0/322977179 wait complete. 2024-09-11T22:15:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.429+0000 7f2b121a2640 1 Processor -- start 2024-09-11T22:15:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.429+0000 7f2b121a2640 1 -- start start 2024-09-11T22:15:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.429+0000 7f2b121a2640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b0c0b6900 0x7f2b0c15e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.429+0000 7f2b121a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0c0ce1c0 0x7f2b0c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.429+0000 7f2b121a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b0c147fe0 0x7f2b0c1457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.429+0000 7f2b121a2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c06e6b0 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.429+0000 7f2b121a2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c1483c0 con 0x7f2b0c147fe0 2024-09-11T22:15:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.429+0000 7f2b121a2640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2b0c0d11b0 con 0x7f2b0c0b6900 2024-09-11T22:15:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.429+0000 7f2b1099f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0c0ce1c0 0x7f2b0c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.429+0000 7f2b1099f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0c0ce1c0 0x7f2b0c0b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50104/0 (socket says 172.21.15.50:50104) 2024-09-11T22:15:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.429+0000 7f2b1099f640 1 -- 172.21.15.50:0/724713898 learned_addr learned my addr 172.21.15.50:0/724713898 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b119a1640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b0c147fe0 0x7f2b0c1457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b111a0640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b0c0b6900 0x7f2b0c15e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b1099f640 1 -- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b0c0b6900 msgr2=0x7f2b0c15e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b1099f640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b0c0b6900 0x7f2b0c15e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b1099f640 1 -- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b0c147fe0 msgr2=0x7f2b0c1457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b1099f640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b0c147fe0 0x7f2b0c1457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b1099f640 1 -- 172.21.15.50:0/724713898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0c15e7a0 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b111a0640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b0c0b6900 0x7f2b0c15e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b1099f640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0c0ce1c0 0x7f2b0c0b0950 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009870 tx=0x7f2b000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b09ffb640 1 -- 172.21.15.50:0/724713898 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b00041020 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b09ffb640 1 -- 172.21.15.50:0/724713898 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b00030970 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b121a2640 1 -- 172.21.15.50:0/724713898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0c0b1280 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b09ffb640 1 -- 172.21.15.50:0/724713898 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b00037040 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.430+0000 7f2b121a2640 1 -- 172.21.15.50:0/724713898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b0c0b1840 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.431+0000 7f2b121a2640 1 -- 172.21.15.50:0/724713898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b0c0ce600 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.432+0000 7f2b09ffb640 1 -- 172.21.15.50:0/724713898 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b00044020 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.432+0000 7f2b09ffb640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2af806be30 0x7f2af806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.432+0000 7f2b09ffb640 1 -- 172.21.15.50:0/724713898 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f2b000ab7d0 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.432+0000 7f2b111a0640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2af806be30 0x7f2af806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.433+0000 7f2b111a0640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2af806be30 0x7f2af806e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2afc007fd0 tx=0x7f2afc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.437+0000 7f2b09ffb640 1 -- 172.21.15.50:0/724713898 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b0004b030 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.683+0000 7f2b121a2640 1 -- 172.21.15.50:0/724713898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2b0c06c630 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.683+0000 7f2b09ffb640 1 -- 172.21.15.50:0/724713898 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1142 (secure 0 0 0) 0x7f2b0007a210 con 0x7f2b0c0ce1c0 2024-09-11T22:15:11.684 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:11.684 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":260,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":74,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":86},{"state_name":"creating+peering","count":11}],"num_pgs":97,"num_pools":3,"num_objects":21,"data_bytes":592196,"bytes_used":293683200,"bytes_avail":772800430080,"bytes_total":773094113280,"inactive_pgs_ratio":0.11340206116437912,"write_bytes_sec":2278,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":47,"btime":"2024-09-11T22:15:09:616633+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6648}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-11T22:14:41.413370+0000","services":{}},"progress_events":{}} 2024-09-11T22:15:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.685+0000 7f2b121a2640 1 -- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2af806be30 msgr2=0x7f2af806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.685+0000 7f2b121a2640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2af806be30 0x7f2af806e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2afc007fd0 tx=0x7f2afc009040 comp rx=0 tx=0).stop 2024-09-11T22:15:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.685+0000 7f2b121a2640 1 -- 172.21.15.50:0/724713898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0c0ce1c0 msgr2=0x7f2b0c0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.685+0000 7f2b121a2640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0c0ce1c0 0x7f2b0c0b0950 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009870 tx=0x7f2b000046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.685+0000 7f2b121a2640 1 -- 172.21.15.50:0/724713898 shutdown_connections 2024-09-11T22:15:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.685+0000 7f2b121a2640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2af806be30 0x7f2af806e2f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.685+0000 7f2b121a2640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b0c147fe0 0x7f2b0c1457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.686+0000 7f2b121a2640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0c0ce1c0 0x7f2b0c0b0950 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.686+0000 7f2b121a2640 1 --2- 172.21.15.50:0/724713898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b0c0b6900 0x7f2b0c15e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.686+0000 7f2b121a2640 1 -- 172.21.15.50:0/724713898 >> 172.21.15.50:0/724713898 conn(0x7f2b0c06bd30 msgr2=0x7f2b0c0b4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.686+0000 7f2b121a2640 1 -- 172.21.15.50:0/724713898 shutdown_connections 2024-09-11T22:15:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.686+0000 7f2b121a2640 1 -- 172.21.15.50:0/724713898 wait complete. 2024-09-11T22:15:11.698 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:15:11.698 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:15:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.800+0000 7f8798c77640 1 Processor -- start 2024-09-11T22:15:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.800+0000 7f8798c77640 1 -- start start 2024-09-11T22:15:11.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.801+0000 7f8798c77640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f87940b1600 0x7f87940b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.801+0000 7f8798c77640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87940cfbd0 con 0x7f87940cf610 2024-09-11T22:15:11.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.801+0000 7f8798c77640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87940cfeb0 con 0x7f8794161fa0 2024-09-11T22:15:11.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.801+0000 7f8798c77640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f87940d1220 con 0x7f87940b1600 2024-09-11T22:15:11.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.801+0000 7f8791d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f87940cf610 0x7f87940cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56394/0 (socket says 172.21.15.50:56394) 2024-09-11T22:15:11.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.801+0000 7f8791d9b640 1 -- 172.21.15.50:0/2769480745 learned_addr learned my addr 172.21.15.50:0/2769480745 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:11.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.801+0000 7f8792d9d640 1 --2- 172.21.15.50:0/2769480745 >> v2:172.21.15.77:3300/0 conn(0x7f87940b1600 0x7f87940b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587348401 0 0) 0x7f87940cfbd0 con 0x7f87940cf610 2024-09-11T22:15:11.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8780003520 con 0x7f87940cf610 2024-09-11T22:15:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1253560206 0 0) 0x7f8780003520 con 0x7f87940cf610 2024-09-11T22:15:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 >> v2:172.21.15.77:3300/0 conn(0x7f87940b1600 msgr2=0x7f87940b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 --2- 172.21.15.50:0/2769480745 >> v2:172.21.15.77:3300/0 conn(0x7f87940b1600 0x7f87940b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 >> v1:172.21.15.77:6789/0 conn(0x7f8794161fa0 legacy=0x7f87940cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87940d1470 con 0x7f87940cf610 2024-09-11T22:15:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f877c001670 con 0x7f87940cf610 2024-09-11T22:15:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f8792d9d640 1 --2- 172.21.15.50:0/2769480745 >> v2:172.21.15.77:3300/0 conn(0x7f87940b1600 0x7f87940b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 >> v1:172.21.15.50:6789/0 conn(0x7f87940cf610 legacy=0x7f87940cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 --2- 172.21.15.50:0/2769480745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87800039b0 0x7f8780003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 --2- 172.21.15.50:0/2769480745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8780004800 0x7f8780004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 --2- 172.21.15.50:0/2769480745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87800051c0 0x7f878000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f87940d1220 con 0x7f87800051c0 2024-09-11T22:15:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f878000c060 con 0x7f87800039b0 2024-09-11T22:15:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f878000c260 con 0x7f8780004800 2024-09-11T22:15:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f8792d9d640 1 --2- 172.21.15.50:0/2769480745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87800051c0 0x7f878000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f879259c640 1 --2- 172.21.15.50:0/2769480745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87800039b0 0x7f8780003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f8791d9b640 1 --2- 172.21.15.50:0/2769480745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8780004800 0x7f8780004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f8792d9d640 1 -- 172.21.15.50:0/2769480745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8780004800 msgr2=0x7f8780004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f8792d9d640 1 --2- 172.21.15.50:0/2769480745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8780004800 0x7f8780004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f8792d9d640 1 -- 172.21.15.50:0/2769480745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87800039b0 msgr2=0x7f8780003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f8792d9d640 1 --2- 172.21.15.50:0/2769480745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87800039b0 0x7f8780003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.802+0000 7f8792d9d640 1 -- 172.21.15.50:0/2769480745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8780003520 con 0x7f87800051c0 2024-09-11T22:15:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.803+0000 7f8792d9d640 1 -- 172.21.15.50:0/2769480745 reap_dead start 2024-09-11T22:15:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.803+0000 7f8792d9d640 1 --2- 172.21.15.50:0/2769480745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87800051c0 0x7f878000b9c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f878400e350 tx=0x7f8780005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9b8d8f3469d58d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:11.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.803+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784009de0 con 0x7f87800051c0 2024-09-11T22:15:11.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.803+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8784003bd0 con 0x7f87800051c0 2024-09-11T22:15:11.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.803+0000 7f879159a640 1 -- 172.21.15.50:0/2769480745 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784004020 con 0x7f87800051c0 2024-09-11T22:15:11.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.804+0000 7f8798c77640 1 -- 172.21.15.50:0/2769480745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87800051c0 msgr2=0x7f878000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.804+0000 7f8798c77640 1 --2- 172.21.15.50:0/2769480745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87800051c0 0x7f878000b9c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f878400e350 tx=0x7f8780005830 comp rx=0 tx=0).stop 2024-09-11T22:15:11.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.804+0000 7f8798c77640 1 -- 172.21.15.50:0/2769480745 shutdown_connections 2024-09-11T22:15:11.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.804+0000 7f8798c77640 1 --2- 172.21.15.50:0/2769480745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87800051c0 0x7f878000b9c0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.804+0000 7f8798c77640 1 -- 172.21.15.50:0/2769480745 >> 172.21.15.50:0/2769480745 conn(0x7f879409ba50 msgr2=0x7f87940b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:11.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.804+0000 7f8798c77640 1 -- 172.21.15.50:0/2769480745 shutdown_connections 2024-09-11T22:15:11.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.804+0000 7f8798c77640 1 -- 172.21.15.50:0/2769480745 wait complete. 2024-09-11T22:15:11.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.805+0000 7f8798c77640 1 Processor -- start 2024-09-11T22:15:11.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.805+0000 7f8798c77640 1 -- start start 2024-09-11T22:15:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.806+0000 7f8798c77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87800051c0 0x7f879415db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.806+0000 7f8798c77640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8794160e90 0x7f87940cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.806+0000 7f8798c77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8794161310 0x7f87940cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.806+0000 7f8798c77640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f87940d1c70 con 0x7f8794161310 2024-09-11T22:15:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.806+0000 7f8798c77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f87940d17e0 con 0x7f87800051c0 2024-09-11T22:15:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.806+0000 7f8798c77640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f87940d1df0 con 0x7f8794160e90 2024-09-11T22:15:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.806+0000 7f8792d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8794161310 0x7f87940cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.806+0000 7f8792d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8794161310 0x7f87940cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50128/0 (socket says 172.21.15.50:50128) 2024-09-11T22:15:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.806+0000 7f8792d9d640 1 -- 172.21.15.50:0/750391784 learned_addr learned my addr 172.21.15.50:0/750391784 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:11.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.806+0000 7f8791d9b640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8794160e90 0x7f87940cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.806+0000 7f879259c640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87800051c0 0x7f879415db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.807+0000 7f8792d9d640 1 -- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8794160e90 msgr2=0x7f87940cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.807+0000 7f8792d9d640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8794160e90 0x7f87940cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.807+0000 7f8792d9d640 1 -- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87800051c0 msgr2=0x7f879415db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:11.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.807+0000 7f8792d9d640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87800051c0 0x7f879415db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:11.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.807+0000 7f8792d9d640 1 -- 172.21.15.50:0/750391784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879415d370 con 0x7f8794161310 2024-09-11T22:15:11.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.807+0000 7f8792d9d640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8794161310 0x7f87940cdf20 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f878400e440 tx=0x7f8784009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:11.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.807+0000 7f878affd640 1 -- 172.21.15.50:0/750391784 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784046070 con 0x7f8794161310 2024-09-11T22:15:11.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.807+0000 7f878affd640 1 -- 172.21.15.50:0/750391784 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8784036610 con 0x7f8794161310 2024-09-11T22:15:11.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.807+0000 7f878affd640 1 -- 172.21.15.50:0/750391784 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784009de0 con 0x7f8794161310 2024-09-11T22:15:11.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.807+0000 7f8798c77640 1 -- 172.21.15.50:0/750391784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879415c2d0 con 0x7f8794161310 2024-09-11T22:15:11.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.807+0000 7f8798c77640 1 -- 172.21.15.50:0/750391784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879415c890 con 0x7f8794161310 2024-09-11T22:15:11.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.808+0000 7f8798c77640 1 -- 172.21.15.50:0/750391784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87940b4d20 con 0x7f8794161310 2024-09-11T22:15:11.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.809+0000 7f878affd640 1 -- 172.21.15.50:0/750391784 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8784049070 con 0x7f8794161310 2024-09-11T22:15:11.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.809+0000 7f878affd640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f877406be80 0x7f877406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:11.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.809+0000 7f878affd640 1 -- 172.21.15.50:0/750391784 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f87840ab800 con 0x7f8794161310 2024-09-11T22:15:11.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.809+0000 7f879259c640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f877406be80 0x7f877406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:11.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.810+0000 7f879259c640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f877406be80 0x7f877406e340 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f878c001760 tx=0x7f878c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:11.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.813+0000 7f878affd640 1 -- 172.21.15.50:0/750391784 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8784032030 con 0x7f8794161310 2024-09-11T22:15:11.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.985+0000 7f8798c77640 1 -- 172.21.15.50:0/750391784 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87940cf150 con 0x7f877406be80 2024-09-11T22:15:11.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.992+0000 7f878affd640 1 -- 172.21.15.50:0/750391784 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251165 (secure 0 0 0) 0x7f87940cf150 con 0x7f877406be80 2024-09-11T22:15:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:11.999 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:15:12.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.995+0000 7f8798c77640 1 -- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f877406be80 msgr2=0x7f877406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.995+0000 7f8798c77640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f877406be80 0x7f877406e340 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f878c001760 tx=0x7f878c009040 comp rx=0 tx=0).stop 2024-09-11T22:15:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.995+0000 7f8798c77640 1 -- 172.21.15.50:0/750391784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8794161310 msgr2=0x7f87940cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.995+0000 7f8798c77640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8794161310 0x7f87940cdf20 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f878400e440 tx=0x7f8784009750 comp rx=0 tx=0).stop 2024-09-11T22:15:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.995+0000 7f8798c77640 1 -- 172.21.15.50:0/750391784 shutdown_connections 2024-09-11T22:15:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.995+0000 7f8798c77640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f877406be80 0x7f877406e340 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.995+0000 7f8798c77640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8794160e90 0x7f87940cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.995+0000 7f8798c77640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8794161310 0x7f87940cdf20 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.995+0000 7f8798c77640 1 --2- 172.21.15.50:0/750391784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87800051c0 0x7f879415db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.995+0000 7f8798c77640 1 -- 172.21.15.50:0/750391784 >> 172.21.15.50:0/750391784 conn(0x7f879409ba50 msgr2=0x7f879406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.995+0000 7f8798c77640 1 -- 172.21.15.50:0/750391784 shutdown_connections 2024-09-11T22:15:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:11.995+0000 7f8798c77640 1 -- 172.21.15.50:0/750391784 wait complete. 2024-09-11T22:15:12.007 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-11T22:15:11.420367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":286800,"kb_used_data":8156,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754687920,"statfs":{"total":773094113280,"available":772800430080,"internally_reserved":0,"allocated":8351744,"data_stored":4208101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.841486"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.591960+0000","last_change":"2024-09-11T22:15:06.591960+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.591960+0000","last_undegraded":"2024-09-11T22:15:06.591960+0000","last_fullsized":"2024-09-11T22:15:06.591960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950901+0000","last_change":"2024-09-11T22:15:07.620683+0000","last_active":"2024-09-11T22:15:08.950901+0000","last_peered":"2024-09-11T22:15:08.950901+0000","last_clean":"2024-09-11T22:15:08.950901+0000","last_became_active":"2024-09-11T22:15:07.620387+0000","last_became_peered":"2024-09-11T22:15:07.620387+0000","last_unstale":"2024-09-11T22:15:08.950901+0000","last_undegraded":"2024-09-11T22:15:08.950901+0000","last_fullsized":"2024-09-11T22:15:08.950901+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:45.541045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989555+0000","last_change":"2024-09-11T22:15:07.614508+0000","last_active":"2024-09-11T22:15:08.989555+0000","last_peered":"2024-09-11T22:15:08.989555+0000","last_clean":"2024-09-11T22:15:08.989555+0000","last_became_active":"2024-09-11T22:15:07.614209+0000","last_became_peered":"2024-09-11T22:15:07.614209+0000","last_unstale":"2024-09-11T22:15:08.989555+0000","last_undegraded":"2024-09-11T22:15:08.989555+0000","last_fullsized":"2024-09-11T22:15:08.989555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:29.618768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990158+0000","last_change":"2024-09-11T22:15:07.620641+0000","last_active":"2024-09-11T22:15:08.990158+0000","last_peered":"2024-09-11T22:15:08.990158+0000","last_clean":"2024-09-11T22:15:08.990158+0000","last_became_active":"2024-09-11T22:15:07.620131+0000","last_became_peered":"2024-09-11T22:15:07.620131+0000","last_unstale":"2024-09-11T22:15:08.990158+0000","last_undegraded":"2024-09-11T22:15:08.990158+0000","last_fullsized":"2024-09-11T22:15:08.990158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:03.304172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989007+0000","last_change":"2024-09-11T22:15:07.625761+0000","last_active":"2024-09-11T22:15:08.989007+0000","last_peered":"2024-09-11T22:15:08.989007+0000","last_clean":"2024-09-11T22:15:08.989007+0000","last_became_active":"2024-09-11T22:15:07.625508+0000","last_became_peered":"2024-09-11T22:15:07.625508+0000","last_unstale":"2024-09-11T22:15:08.989007+0000","last_undegraded":"2024-09-11T22:15:08.989007+0000","last_fullsized":"2024-09-11T22:15:08.989007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:06.819154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950671+0000","last_change":"2024-09-11T22:15:07.620053+0000","last_active":"2024-09-11T22:15:08.950671+0000","last_peered":"2024-09-11T22:15:08.950671+0000","last_clean":"2024-09-11T22:15:08.950671+0000","last_became_active":"2024-09-11T22:15:07.619773+0000","last_became_peered":"2024-09-11T22:15:07.619773+0000","last_unstale":"2024-09-11T22:15:08.950671+0000","last_undegraded":"2024-09-11T22:15:08.950671+0000","last_fullsized":"2024-09-11T22:15:08.950671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:11.698238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615362+0000","last_change":"2024-09-11T22:15:07.611744+0000","last_active":"2024-09-11T22:15:08.615362+0000","last_peered":"2024-09-11T22:15:08.615362+0000","last_clean":"2024-09-11T22:15:08.615362+0000","last_became_active":"2024-09-11T22:15:07.611448+0000","last_became_peered":"2024-09-11T22:15:07.611448+0000","last_unstale":"2024-09-11T22:15:08.615362+0000","last_undegraded":"2024-09-11T22:15:08.615362+0000","last_fullsized":"2024-09-11T22:15:08.615362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:07.621973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950531+0000","last_change":"2024-09-11T22:15:07.626253+0000","last_active":"2024-09-11T22:15:08.950531+0000","last_peered":"2024-09-11T22:15:08.950531+0000","last_clean":"2024-09-11T22:15:08.950531+0000","last_became_active":"2024-09-11T22:15:07.625925+0000","last_became_peered":"2024-09-11T22:15:07.625925+0000","last_unstale":"2024-09-11T22:15:08.950531+0000","last_undegraded":"2024-09-11T22:15:08.950531+0000","last_fullsized":"2024-09-11T22:15:08.950531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:24.963984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989453+0000","last_change":"2024-09-11T22:15:07.621375+0000","last_active":"2024-09-11T22:15:08.989453+0000","last_peered":"2024-09-11T22:15:08.989453+0000","last_clean":"2024-09-11T22:15:08.989453+0000","last_became_active":"2024-09-11T22:15:07.621108+0000","last_became_peered":"2024-09-11T22:15:07.621108+0000","last_unstale":"2024-09-11T22:15:08.989453+0000","last_undegraded":"2024-09-11T22:15:08.989453+0000","last_fullsized":"2024-09-11T22:15:08.989453+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:02.197728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615200+0000","last_change":"2024-09-11T22:15:07.623030+0000","last_active":"2024-09-11T22:15:08.615200+0000","last_peered":"2024-09-11T22:15:08.615200+0000","last_clean":"2024-09-11T22:15:08.615200+0000","last_became_active":"2024-09-11T22:15:07.622629+0000","last_became_peered":"2024-09-11T22:15:07.622629+0000","last_unstale":"2024-09-11T22:15:08.615200+0000","last_undegraded":"2024-09-11T22:15:08.615200+0000","last_fullsized":"2024-09-11T22:15:08.615200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:21.595561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.591032+0000","last_change":"2024-09-11T22:15:06.591032+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.591032+0000","last_undegraded":"2024-09-11T22:15:06.591032+0000","last_fullsized":"2024-09-11T22:15:06.591032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990214+0000","last_change":"2024-09-11T22:15:07.621753+0000","last_active":"2024-09-11T22:15:08.990214+0000","last_peered":"2024-09-11T22:15:08.990214+0000","last_clean":"2024-09-11T22:15:08.990214+0000","last_became_active":"2024-09-11T22:15:07.621469+0000","last_became_peered":"2024-09-11T22:15:07.621469+0000","last_unstale":"2024-09-11T22:15:08.990214+0000","last_undegraded":"2024-09-11T22:15:08.990214+0000","last_fullsized":"2024-09-11T22:15:08.990214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:57.372042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612759+0000","last_change":"2024-09-11T22:15:07.620776+0000","last_active":"2024-09-11T22:15:08.612759+0000","last_peered":"2024-09-11T22:15:08.612759+0000","last_clean":"2024-09-11T22:15:08.612759+0000","last_became_active":"2024-09-11T22:15:07.620512+0000","last_became_peered":"2024-09-11T22:15:07.620512+0000","last_unstale":"2024-09-11T22:15:08.612759+0000","last_undegraded":"2024-09-11T22:15:08.612759+0000","last_fullsized":"2024-09-11T22:15:08.612759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:17.012661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989130+0000","last_change":"2024-09-11T22:15:07.615352+0000","last_active":"2024-09-11T22:15:08.989130+0000","last_peered":"2024-09-11T22:15:08.989130+0000","last_clean":"2024-09-11T22:15:08.989130+0000","last_became_active":"2024-09-11T22:15:07.615077+0000","last_became_peered":"2024-09-11T22:15:07.615077+0000","last_unstale":"2024-09-11T22:15:08.989130+0000","last_undegraded":"2024-09-11T22:15:08.989130+0000","last_fullsized":"2024-09-11T22:15:08.989130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:54.816149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612736+0000","last_change":"2024-09-11T22:15:07.613812+0000","last_active":"2024-09-11T22:15:08.612736+0000","last_peered":"2024-09-11T22:15:08.612736+0000","last_clean":"2024-09-11T22:15:08.612736+0000","last_became_active":"2024-09-11T22:15:07.613488+0000","last_became_peered":"2024-09-11T22:15:07.613488+0000","last_unstale":"2024-09-11T22:15:08.612736+0000","last_undegraded":"2024-09-11T22:15:08.612736+0000","last_fullsized":"2024-09-11T22:15:08.612736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:47.977968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614827+0000","last_change":"2024-09-11T22:15:07.621039+0000","last_active":"2024-09-11T22:15:08.614827+0000","last_peered":"2024-09-11T22:15:08.614827+0000","last_clean":"2024-09-11T22:15:08.614827+0000","last_became_active":"2024-09-11T22:15:07.620669+0000","last_became_peered":"2024-09-11T22:15:07.620669+0000","last_unstale":"2024-09-11T22:15:08.614827+0000","last_undegraded":"2024-09-11T22:15:08.614827+0000","last_fullsized":"2024-09-11T22:15:08.614827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:33.307854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989545+0000","last_change":"2024-09-11T22:15:07.620480+0000","last_active":"2024-09-11T22:15:08.989545+0000","last_peered":"2024-09-11T22:15:08.989545+0000","last_clean":"2024-09-11T22:15:08.989545+0000","last_became_active":"2024-09-11T22:15:07.620188+0000","last_became_peered":"2024-09-11T22:15:07.620188+0000","last_unstale":"2024-09-11T22:15:08.989545+0000","last_undegraded":"2024-09-11T22:15:08.989545+0000","last_fullsized":"2024-09-11T22:15:08.989545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:12.268020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990303+0000","last_change":"2024-09-11T22:15:07.624157+0000","last_active":"2024-09-11T22:15:08.990303+0000","last_peered":"2024-09-11T22:15:08.990303+0000","last_clean":"2024-09-11T22:15:08.990303+0000","last_became_active":"2024-09-11T22:15:07.622120+0000","last_became_peered":"2024-09-11T22:15:07.622120+0000","last_unstale":"2024-09-11T22:15:08.990303+0000","last_undegraded":"2024-09-11T22:15:08.990303+0000","last_fullsized":"2024-09-11T22:15:08.990303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:31.693477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950600+0000","last_change":"2024-09-11T22:15:07.625050+0000","last_active":"2024-09-11T22:15:08.950600+0000","last_peered":"2024-09-11T22:15:08.950600+0000","last_clean":"2024-09-11T22:15:08.950600+0000","last_became_active":"2024-09-11T22:15:07.624770+0000","last_became_peered":"2024-09-11T22:15:07.624770+0000","last_unstale":"2024-09-11T22:15:08.950600+0000","last_undegraded":"2024-09-11T22:15:08.950600+0000","last_fullsized":"2024-09-11T22:15:08.950600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:39.268401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612645+0000","last_change":"2024-09-11T22:15:07.615306+0000","last_active":"2024-09-11T22:15:08.612645+0000","last_peered":"2024-09-11T22:15:08.612645+0000","last_clean":"2024-09-11T22:15:08.612645+0000","last_became_active":"2024-09-11T22:15:07.615030+0000","last_became_peered":"2024-09-11T22:15:07.615030+0000","last_unstale":"2024-09-11T22:15:08.612645+0000","last_undegraded":"2024-09-11T22:15:08.612645+0000","last_fullsized":"2024-09-11T22:15:08.612645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:32.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615516+0000","last_change":"2024-09-11T22:15:07.617207+0000","last_active":"2024-09-11T22:15:08.615516+0000","last_peered":"2024-09-11T22:15:08.615516+0000","last_clean":"2024-09-11T22:15:08.615516+0000","last_became_active":"2024-09-11T22:15:07.616622+0000","last_became_peered":"2024-09-11T22:15:07.616622+0000","last_unstale":"2024-09-11T22:15:08.615516+0000","last_undegraded":"2024-09-11T22:15:08.615516+0000","last_fullsized":"2024-09-11T22:15:08.615516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:32.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615208+0000","last_change":"2024-09-11T22:15:07.618290+0000","last_active":"2024-09-11T22:15:08.615208+0000","last_peered":"2024-09-11T22:15:08.615208+0000","last_clean":"2024-09-11T22:15:08.615208+0000","last_became_active":"2024-09-11T22:15:07.618024+0000","last_became_peered":"2024-09-11T22:15:07.618024+0000","last_unstale":"2024-09-11T22:15:08.615208+0000","last_undegraded":"2024-09-11T22:15:08.615208+0000","last_fullsized":"2024-09-11T22:15:08.615208+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:04.415812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.588379+0000","last_change":"2024-09-11T22:15:06.588379+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.588379+0000","last_undegraded":"2024-09-11T22:15:06.588379+0000","last_fullsized":"2024-09-11T22:15:06.588379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.588685+0000","last_change":"2024-09-11T22:15:06.588685+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.588685+0000","last_undegraded":"2024-09-11T22:15:06.588685+0000","last_fullsized":"2024-09-11T22:15:06.588685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615107+0000","last_change":"2024-09-11T22:15:07.624381+0000","last_active":"2024-09-11T22:15:08.615107+0000","last_peered":"2024-09-11T22:15:08.615107+0000","last_clean":"2024-09-11T22:15:08.615107+0000","last_became_active":"2024-09-11T22:15:07.624110+0000","last_became_peered":"2024-09-11T22:15:07.624110+0000","last_unstale":"2024-09-11T22:15:08.615107+0000","last_undegraded":"2024-09-11T22:15:08.615107+0000","last_fullsized":"2024-09-11T22:15:08.615107+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:04.961870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616093+0000","last_change":"2024-09-11T22:15:07.621337+0000","last_active":"2024-09-11T22:15:08.616093+0000","last_peered":"2024-09-11T22:15:08.616093+0000","last_clean":"2024-09-11T22:15:08.616093+0000","last_became_active":"2024-09-11T22:15:07.621070+0000","last_became_peered":"2024-09-11T22:15:07.621070+0000","last_unstale":"2024-09-11T22:15:08.616093+0000","last_undegraded":"2024-09-11T22:15:08.616093+0000","last_fullsized":"2024-09-11T22:15:08.616093+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:07.951475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989709+0000","last_change":"2024-09-11T22:15:07.626797+0000","last_active":"2024-09-11T22:15:08.989709+0000","last_peered":"2024-09-11T22:15:08.989709+0000","last_clean":"2024-09-11T22:15:08.989709+0000","last_became_active":"2024-09-11T22:15:07.626342+0000","last_became_peered":"2024-09-11T22:15:07.626342+0000","last_unstale":"2024-09-11T22:15:08.989709+0000","last_undegraded":"2024-09-11T22:15:08.989709+0000","last_fullsized":"2024-09-11T22:15:08.989709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:41.007210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615043+0000","last_change":"2024-09-11T22:15:07.624015+0000","last_active":"2024-09-11T22:15:08.615043+0000","last_peered":"2024-09-11T22:15:08.615043+0000","last_clean":"2024-09-11T22:15:08.615043+0000","last_became_active":"2024-09-11T22:15:07.623402+0000","last_became_peered":"2024-09-11T22:15:07.623402+0000","last_unstale":"2024-09-11T22:15:08.615043+0000","last_undegraded":"2024-09-11T22:15:08.615043+0000","last_fullsized":"2024-09-11T22:15:08.615043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.463954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989929+0000","last_change":"2024-09-11T22:15:07.617599+0000","last_active":"2024-09-11T22:15:08.989929+0000","last_peered":"2024-09-11T22:15:08.989929+0000","last_clean":"2024-09-11T22:15:08.989929+0000","last_became_active":"2024-09-11T22:15:07.616917+0000","last_became_peered":"2024-09-11T22:15:07.616917+0000","last_unstale":"2024-09-11T22:15:08.989929+0000","last_undegraded":"2024-09-11T22:15:08.989929+0000","last_fullsized":"2024-09-11T22:15:08.989929+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.339321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615511+0000","last_change":"2024-09-11T22:15:07.620592+0000","last_active":"2024-09-11T22:15:08.615511+0000","last_peered":"2024-09-11T22:15:08.615511+0000","last_clean":"2024-09-11T22:15:08.615511+0000","last_became_active":"2024-09-11T22:15:07.620310+0000","last_became_peered":"2024-09-11T22:15:07.620310+0000","last_unstale":"2024-09-11T22:15:08.615511+0000","last_undegraded":"2024-09-11T22:15:08.615511+0000","last_fullsized":"2024-09-11T22:15:08.615511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:40.859201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615602+0000","last_change":"2024-09-11T22:15:07.613050+0000","last_active":"2024-09-11T22:15:08.615602+0000","last_peered":"2024-09-11T22:15:08.615602+0000","last_clean":"2024-09-11T22:15:08.615602+0000","last_became_active":"2024-09-11T22:15:07.612729+0000","last_became_peered":"2024-09-11T22:15:07.612729+0000","last_unstale":"2024-09-11T22:15:08.615602+0000","last_undegraded":"2024-09-11T22:15:08.615602+0000","last_fullsized":"2024-09-11T22:15:08.615602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:23.619541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950591+0000","last_change":"2024-09-11T22:15:07.619623+0000","last_active":"2024-09-11T22:15:08.950591+0000","last_peered":"2024-09-11T22:15:08.950591+0000","last_clean":"2024-09-11T22:15:08.950591+0000","last_became_active":"2024-09-11T22:15:07.619354+0000","last_became_peered":"2024-09-11T22:15:07.619354+0000","last_unstale":"2024-09-11T22:15:08.950591+0000","last_undegraded":"2024-09-11T22:15:08.950591+0000","last_fullsized":"2024-09-11T22:15:08.950591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:51.968449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.587849+0000","last_change":"2024-09-11T22:15:06.587849+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.587849+0000","last_undegraded":"2024-09-11T22:15:06.587849+0000","last_fullsized":"2024-09-11T22:15:06.587849+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T22:15:06.601900+0000","last_change":"2024-09-11T22:15:06.599470+0000","last_active":"2024-09-11T22:15:06.601900+0000","last_peered":"2024-09-11T22:15:06.601900+0000","last_clean":"2024-09-11T22:15:06.601900+0000","last_became_active":"2024-09-11T22:15:06.599035+0000","last_became_peered":"2024-09-11T22:15:06.599035+0000","last_unstale":"2024-09-11T22:15:06.601900+0000","last_undegraded":"2024-09-11T22:15:06.601900+0000","last_fullsized":"2024-09-11T22:15:06.601900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:55.490923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989589+0000","last_change":"2024-09-11T22:15:07.619722+0000","last_active":"2024-09-11T22:15:08.989589+0000","last_peered":"2024-09-11T22:15:08.989589+0000","last_clean":"2024-09-11T22:15:08.989589+0000","last_became_active":"2024-09-11T22:15:07.619354+0000","last_became_peered":"2024-09-11T22:15:07.619354+0000","last_unstale":"2024-09-11T22:15:08.989589+0000","last_undegraded":"2024-09-11T22:15:08.989589+0000","last_fullsized":"2024-09-11T22:15:08.989589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:10.809505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612844+0000","last_change":"2024-09-11T22:15:06.599328+0000","last_active":"2024-09-11T22:15:08.612844+0000","last_peered":"2024-09-11T22:15:08.612844+0000","last_clean":"2024-09-11T22:15:08.612844+0000","last_became_active":"2024-09-11T22:15:06.599044+0000","last_became_peered":"2024-09-11T22:15:06.599044+0000","last_unstale":"2024-09-11T22:15:08.612844+0000","last_undegraded":"2024-09-11T22:15:08.612844+0000","last_fullsized":"2024-09-11T22:15:08.612844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:10.693728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950653+0000","last_change":"2024-09-11T22:15:07.624298+0000","last_active":"2024-09-11T22:15:08.950653+0000","last_peered":"2024-09-11T22:15:08.950653+0000","last_clean":"2024-09-11T22:15:08.950653+0000","last_became_active":"2024-09-11T22:15:07.623399+0000","last_became_peered":"2024-09-11T22:15:07.623399+0000","last_unstale":"2024-09-11T22:15:08.950653+0000","last_undegraded":"2024-09-11T22:15:08.950653+0000","last_fullsized":"2024-09-11T22:15:08.950653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:54.411507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615106+0000","last_change":"2024-09-11T22:15:06.599925+0000","last_active":"2024-09-11T22:15:08.615106+0000","last_peered":"2024-09-11T22:15:08.615106+0000","last_clean":"2024-09-11T22:15:08.615106+0000","last_became_active":"2024-09-11T22:15:06.599482+0000","last_became_peered":"2024-09-11T22:15:06.599482+0000","last_unstale":"2024-09-11T22:15:08.615106+0000","last_undegraded":"2024-09-11T22:15:08.615106+0000","last_fullsized":"2024-09-11T22:15:08.615106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:56.367532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.590610+0000","last_change":"2024-09-11T22:15:06.590610+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.590610+0000","last_undegraded":"2024-09-11T22:15:06.590610+0000","last_fullsized":"2024-09-11T22:15:06.590610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950832+0000","last_change":"2024-09-11T22:15:06.598354+0000","last_active":"2024-09-11T22:15:08.950832+0000","last_peered":"2024-09-11T22:15:08.950832+0000","last_clean":"2024-09-11T22:15:08.950832+0000","last_became_active":"2024-09-11T22:15:06.597886+0000","last_became_peered":"2024-09-11T22:15:06.597886+0000","last_unstale":"2024-09-11T22:15:08.950832+0000","last_undegraded":"2024-09-11T22:15:08.950832+0000","last_fullsized":"2024-09-11T22:15:08.950832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:16.566097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615590+0000","last_change":"2024-09-11T22:15:07.615641+0000","last_active":"2024-09-11T22:15:08.615590+0000","last_peered":"2024-09-11T22:15:08.615590+0000","last_clean":"2024-09-11T22:15:08.615590+0000","last_became_active":"2024-09-11T22:15:07.615317+0000","last_became_peered":"2024-09-11T22:15:07.615317+0000","last_unstale":"2024-09-11T22:15:08.615590+0000","last_undegraded":"2024-09-11T22:15:08.615590+0000","last_fullsized":"2024-09-11T22:15:08.615590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:51.103023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989901+0000","last_change":"2024-09-11T22:15:06.595409+0000","last_active":"2024-09-11T22:15:08.989901+0000","last_peered":"2024-09-11T22:15:08.989901+0000","last_clean":"2024-09-11T22:15:08.989901+0000","last_became_active":"2024-09-11T22:15:06.594997+0000","last_became_peered":"2024-09-11T22:15:06.594997+0000","last_unstale":"2024-09-11T22:15:08.989901+0000","last_undegraded":"2024-09-11T22:15:08.989901+0000","last_fullsized":"2024-09-11T22:15:08.989901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:47.151600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615672+0000","last_change":"2024-09-11T22:15:07.622620+0000","last_active":"2024-09-11T22:15:08.615672+0000","last_peered":"2024-09-11T22:15:08.615672+0000","last_clean":"2024-09-11T22:15:08.615672+0000","last_became_active":"2024-09-11T22:15:07.622043+0000","last_became_peered":"2024-09-11T22:15:07.622043+0000","last_unstale":"2024-09-11T22:15:08.615672+0000","last_undegraded":"2024-09-11T22:15:08.615672+0000","last_fullsized":"2024-09-11T22:15:08.615672+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:47.977968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950438+0000","last_change":"2024-09-11T22:15:06.601969+0000","last_active":"2024-09-11T22:15:08.950438+0000","last_peered":"2024-09-11T22:15:08.950438+0000","last_clean":"2024-09-11T22:15:08.950438+0000","last_became_active":"2024-09-11T22:15:06.601704+0000","last_became_peered":"2024-09-11T22:15:06.601704+0000","last_unstale":"2024-09-11T22:15:08.950438+0000","last_undegraded":"2024-09-11T22:15:08.950438+0000","last_fullsized":"2024-09-11T22:15:08.950438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:25.646446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.988828+0000","last_change":"2024-09-11T22:15:07.623214+0000","last_active":"2024-09-11T22:15:08.988828+0000","last_peered":"2024-09-11T22:15:08.988828+0000","last_clean":"2024-09-11T22:15:08.988828+0000","last_became_active":"2024-09-11T22:15:07.622879+0000","last_became_peered":"2024-09-11T22:15:07.622879+0000","last_unstale":"2024-09-11T22:15:08.988828+0000","last_undegraded":"2024-09-11T22:15:08.988828+0000","last_fullsized":"2024-09-11T22:15:08.988828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:11.200882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989766+0000","last_change":"2024-09-11T22:15:06.589489+0000","last_active":"2024-09-11T22:15:08.989766+0000","last_peered":"2024-09-11T22:15:08.989766+0000","last_clean":"2024-09-11T22:15:08.989766+0000","last_became_active":"2024-09-11T22:15:06.589159+0000","last_became_peered":"2024-09-11T22:15:06.589159+0000","last_unstale":"2024-09-11T22:15:08.989766+0000","last_undegraded":"2024-09-11T22:15:08.989766+0000","last_fullsized":"2024-09-11T22:15:08.989766+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:56.182848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612591+0000","last_change":"2024-09-11T22:15:07.630577+0000","last_active":"2024-09-11T22:15:08.612591+0000","last_peered":"2024-09-11T22:15:08.612591+0000","last_clean":"2024-09-11T22:15:08.612591+0000","last_became_active":"2024-09-11T22:15:07.630271+0000","last_became_peered":"2024-09-11T22:15:07.630271+0000","last_unstale":"2024-09-11T22:15:08.612591+0000","last_undegraded":"2024-09-11T22:15:08.612591+0000","last_fullsized":"2024-09-11T22:15:08.612591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:25.034800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.988770+0000","last_change":"2024-09-11T22:15:06.599045+0000","last_active":"2024-09-11T22:15:08.988770+0000","last_peered":"2024-09-11T22:15:08.988770+0000","last_clean":"2024-09-11T22:15:08.988770+0000","last_became_active":"2024-09-11T22:15:06.598683+0000","last_became_peered":"2024-09-11T22:15:06.598683+0000","last_unstale":"2024-09-11T22:15:08.988770+0000","last_undegraded":"2024-09-11T22:15:08.988770+0000","last_fullsized":"2024-09-11T22:15:08.988770+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:53.608944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616017+0000","last_change":"2024-09-11T22:15:07.621117+0000","last_active":"2024-09-11T22:15:08.616017+0000","last_peered":"2024-09-11T22:15:08.616017+0000","last_clean":"2024-09-11T22:15:08.616017+0000","last_became_active":"2024-09-11T22:15:07.619879+0000","last_became_peered":"2024-09-11T22:15:07.619879+0000","last_unstale":"2024-09-11T22:15:08.616017+0000","last_undegraded":"2024-09-11T22:15:08.616017+0000","last_fullsized":"2024-09-11T22:15:08.616017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:46.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615132+0000","last_change":"2024-09-11T22:15:06.592064+0000","last_active":"2024-09-11T22:15:08.615132+0000","last_peered":"2024-09-11T22:15:08.615132+0000","last_clean":"2024-09-11T22:15:08.615132+0000","last_became_active":"2024-09-11T22:15:06.591789+0000","last_became_peered":"2024-09-11T22:15:06.591789+0000","last_unstale":"2024-09-11T22:15:08.615132+0000","last_undegraded":"2024-09-11T22:15:08.615132+0000","last_fullsized":"2024-09-11T22:15:08.615132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:13.507670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.591546+0000","last_change":"2024-09-11T22:15:06.591546+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.591546+0000","last_undegraded":"2024-09-11T22:15:06.591546+0000","last_fullsized":"2024-09-11T22:15:06.591546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950979+0000","last_change":"2024-09-11T22:15:06.596633+0000","last_active":"2024-09-11T22:15:08.950979+0000","last_peered":"2024-09-11T22:15:08.950979+0000","last_clean":"2024-09-11T22:15:08.950979+0000","last_became_active":"2024-09-11T22:15:06.596323+0000","last_became_peered":"2024-09-11T22:15:06.596323+0000","last_unstale":"2024-09-11T22:15:08.950979+0000","last_undegraded":"2024-09-11T22:15:08.950979+0000","last_fullsized":"2024-09-11T22:15:08.950979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:56.182848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950744+0000","last_change":"2024-09-11T22:15:07.621209+0000","last_active":"2024-09-11T22:15:08.950744+0000","last_peered":"2024-09-11T22:15:08.950744+0000","last_clean":"2024-09-11T22:15:08.950744+0000","last_became_active":"2024-09-11T22:15:07.620885+0000","last_became_peered":"2024-09-11T22:15:07.620885+0000","last_unstale":"2024-09-11T22:15:08.950744+0000","last_undegraded":"2024-09-11T22:15:08.950744+0000","last_fullsized":"2024-09-11T22:15:08.950744+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:26.478181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"73'3","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989810+0000","last_change":"2024-09-11T22:15:06.593945+0000","last_active":"2024-09-11T22:15:08.989810+0000","last_peered":"2024-09-11T22:15:08.989810+0000","last_clean":"2024-09-11T22:15:08.989810+0000","last_became_active":"2024-09-11T22:15:06.593612+0000","last_became_peered":"2024-09-11T22:15:06.593612+0000","last_unstale":"2024-09-11T22:15:08.989810+0000","last_undegraded":"2024-09-11T22:15:08.989810+0000","last_fullsized":"2024-09-11T22:15:08.989810+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:32.595037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989006+0000","last_change":"2024-09-11T22:15:07.627440+0000","last_active":"2024-09-11T22:15:08.989006+0000","last_peered":"2024-09-11T22:15:08.989006+0000","last_clean":"2024-09-11T22:15:08.989006+0000","last_became_active":"2024-09-11T22:15:07.626810+0000","last_became_peered":"2024-09-11T22:15:07.626810+0000","last_unstale":"2024-09-11T22:15:08.989006+0000","last_undegraded":"2024-09-11T22:15:08.989006+0000","last_fullsized":"2024-09-11T22:15:08.989006+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:56.683364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"73'6","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990328+0000","last_change":"2024-09-11T22:15:06.596829+0000","last_active":"2024-09-11T22:15:08.990328+0000","last_peered":"2024-09-11T22:15:08.990328+0000","last_clean":"2024-09-11T22:15:08.990328+0000","last_became_active":"2024-09-11T22:15:06.596541+0000","last_became_peered":"2024-09-11T22:15:06.596541+0000","last_unstale":"2024-09-11T22:15:08.990328+0000","last_undegraded":"2024-09-11T22:15:08.990328+0000","last_fullsized":"2024-09-11T22:15:08.990328+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:54.153574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.589375+0000","last_change":"2024-09-11T22:15:06.589375+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.589375+0000","last_undegraded":"2024-09-11T22:15:06.589375+0000","last_fullsized":"2024-09-11T22:15:06.589375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990061+0000","last_change":"2024-09-11T22:15:06.594726+0000","last_active":"2024-09-11T22:15:08.990061+0000","last_peered":"2024-09-11T22:15:08.990061+0000","last_clean":"2024-09-11T22:15:08.990061+0000","last_became_active":"2024-09-11T22:15:06.594397+0000","last_became_peered":"2024-09-11T22:15:06.594397+0000","last_unstale":"2024-09-11T22:15:08.990061+0000","last_undegraded":"2024-09-11T22:15:08.990061+0000","last_fullsized":"2024-09-11T22:15:08.990061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:08.901035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615695+0000","last_change":"2024-09-11T22:15:07.616399+0000","last_active":"2024-09-11T22:15:08.615695+0000","last_peered":"2024-09-11T22:15:08.615695+0000","last_clean":"2024-09-11T22:15:08.615695+0000","last_became_active":"2024-09-11T22:15:07.616049+0000","last_became_peered":"2024-09-11T22:15:07.616049+0000","last_unstale":"2024-09-11T22:15:08.615695+0000","last_undegraded":"2024-09-11T22:15:08.615695+0000","last_fullsized":"2024-09-11T22:15:08.615695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:58.048294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950685+0000","last_change":"2024-09-11T22:15:06.596968+0000","last_active":"2024-09-11T22:15:08.950685+0000","last_peered":"2024-09-11T22:15:08.950685+0000","last_clean":"2024-09-11T22:15:08.950685+0000","last_became_active":"2024-09-11T22:15:06.595698+0000","last_became_peered":"2024-09-11T22:15:06.595698+0000","last_unstale":"2024-09-11T22:15:08.950685+0000","last_undegraded":"2024-09-11T22:15:08.950685+0000","last_fullsized":"2024-09-11T22:15:08.950685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:25.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612514+0000","last_change":"2024-09-11T22:15:07.621366+0000","last_active":"2024-09-11T22:15:08.612514+0000","last_peered":"2024-09-11T22:15:08.612514+0000","last_clean":"2024-09-11T22:15:08.612514+0000","last_became_active":"2024-09-11T22:15:07.621103+0000","last_became_peered":"2024-09-11T22:15:07.621103+0000","last_unstale":"2024-09-11T22:15:08.612514+0000","last_undegraded":"2024-09-11T22:15:08.612514+0000","last_fullsized":"2024-09-11T22:15:08.612514+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:04.415812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615462+0000","last_change":"2024-09-11T22:15:06.603089+0000","last_active":"2024-09-11T22:15:08.615462+0000","last_peered":"2024-09-11T22:15:08.615462+0000","last_clean":"2024-09-11T22:15:08.615462+0000","last_became_active":"2024-09-11T22:15:06.602803+0000","last_became_peered":"2024-09-11T22:15:06.602803+0000","last_unstale":"2024-09-11T22:15:08.615462+0000","last_undegraded":"2024-09-11T22:15:08.615462+0000","last_fullsized":"2024-09-11T22:15:08.615462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:34.459445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989098+0000","last_change":"2024-09-11T22:15:07.619952+0000","last_active":"2024-09-11T22:15:08.989098+0000","last_peered":"2024-09-11T22:15:08.989098+0000","last_clean":"2024-09-11T22:15:08.989098+0000","last_became_active":"2024-09-11T22:15:07.617853+0000","last_became_peered":"2024-09-11T22:15:07.617853+0000","last_unstale":"2024-09-11T22:15:08.989098+0000","last_undegraded":"2024-09-11T22:15:08.989098+0000","last_fullsized":"2024-09-11T22:15:08.989098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:01.596178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"73'8","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614740+0000","last_change":"2024-09-11T22:15:06.594832+0000","last_active":"2024-09-11T22:15:08.614740+0000","last_peered":"2024-09-11T22:15:08.614740+0000","last_clean":"2024-09-11T22:15:08.614740+0000","last_became_active":"2024-09-11T22:15:06.594529+0000","last_became_peered":"2024-09-11T22:15:06.594529+0000","last_unstale":"2024-09-11T22:15:08.614740+0000","last_undegraded":"2024-09-11T22:15:08.614740+0000","last_fullsized":"2024-09-11T22:15:08.614740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:02.299662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615277+0000","last_change":"2024-09-11T22:15:07.615717+0000","last_active":"2024-09-11T22:15:08.615277+0000","last_peered":"2024-09-11T22:15:08.615277+0000","last_clean":"2024-09-11T22:15:08.615277+0000","last_became_active":"2024-09-11T22:15:07.615451+0000","last_became_peered":"2024-09-11T22:15:07.615451+0000","last_unstale":"2024-09-11T22:15:08.615277+0000","last_undegraded":"2024-09-11T22:15:08.615277+0000","last_fullsized":"2024-09-11T22:15:08.615277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:25.034800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950863+0000","last_change":"2024-09-11T22:15:06.594898+0000","last_active":"2024-09-11T22:15:08.950863+0000","last_peered":"2024-09-11T22:15:08.950863+0000","last_clean":"2024-09-11T22:15:08.950863+0000","last_became_active":"2024-09-11T22:15:06.594562+0000","last_became_peered":"2024-09-11T22:15:06.594562+0000","last_unstale":"2024-09-11T22:15:08.950863+0000","last_undegraded":"2024-09-11T22:15:08.950863+0000","last_fullsized":"2024-09-11T22:15:08.950863+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:24.994361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.587962+0000","last_change":"2024-09-11T22:15:06.587962+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.587962+0000","last_undegraded":"2024-09-11T22:15:06.587962+0000","last_fullsized":"2024-09-11T22:15:06.587962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615315+0000","last_change":"2024-09-11T22:15:06.597291+0000","last_active":"2024-09-11T22:15:08.615315+0000","last_peered":"2024-09-11T22:15:08.615315+0000","last_clean":"2024-09-11T22:15:08.615315+0000","last_became_active":"2024-09-11T22:15:06.596980+0000","last_became_peered":"2024-09-11T22:15:06.596980+0000","last_unstale":"2024-09-11T22:15:08.615315+0000","last_undegraded":"2024-09-11T22:15:08.615315+0000","last_fullsized":"2024-09-11T22:15:08.615315+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:30.688967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990306+0000","last_change":"2024-09-11T22:15:07.621646+0000","last_active":"2024-09-11T22:15:08.990306+0000","last_peered":"2024-09-11T22:15:08.990306+0000","last_clean":"2024-09-11T22:15:08.990306+0000","last_became_active":"2024-09-11T22:15:07.621117+0000","last_became_peered":"2024-09-11T22:15:07.621117+0000","last_unstale":"2024-09-11T22:15:08.990306+0000","last_undegraded":"2024-09-11T22:15:08.990306+0000","last_fullsized":"2024-09-11T22:15:08.990306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:14.512180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950675+0000","last_change":"2024-09-11T22:15:06.598749+0000","last_active":"2024-09-11T22:15:08.950675+0000","last_peered":"2024-09-11T22:15:08.950675+0000","last_clean":"2024-09-11T22:15:08.950675+0000","last_became_active":"2024-09-11T22:15:06.597719+0000","last_became_peered":"2024-09-11T22:15:06.597719+0000","last_unstale":"2024-09-11T22:15:08.950675+0000","last_undegraded":"2024-09-11T22:15:08.950675+0000","last_fullsized":"2024-09-11T22:15:08.950675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:57.551356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989157+0000","last_change":"2024-09-11T22:15:07.623371+0000","last_active":"2024-09-11T22:15:08.989157+0000","last_peered":"2024-09-11T22:15:08.989157+0000","last_clean":"2024-09-11T22:15:08.989157+0000","last_became_active":"2024-09-11T22:15:07.622991+0000","last_became_peered":"2024-09-11T22:15:07.622991+0000","last_unstale":"2024-09-11T22:15:08.989157+0000","last_undegraded":"2024-09-11T22:15:08.989157+0000","last_fullsized":"2024-09-11T22:15:08.989157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:21.196278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T22:15:06.599018+0000","last_change":"2024-09-11T22:15:06.597301+0000","last_active":"2024-09-11T22:15:06.599018+0000","last_peered":"2024-09-11T22:15:06.599018+0000","last_clean":"2024-09-11T22:15:06.599018+0000","last_became_active":"2024-09-11T22:15:06.597000+0000","last_became_peered":"2024-09-11T22:15:06.597000+0000","last_unstale":"2024-09-11T22:15:06.599018+0000","last_undegraded":"2024-09-11T22:15:06.599018+0000","last_fullsized":"2024-09-11T22:15:06.599018+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:29.864901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989834+0000","last_change":"2024-09-11T22:15:07.626542+0000","last_active":"2024-09-11T22:15:08.989834+0000","last_peered":"2024-09-11T22:15:08.989834+0000","last_clean":"2024-09-11T22:15:08.989834+0000","last_became_active":"2024-09-11T22:15:07.626252+0000","last_became_peered":"2024-09-11T22:15:07.626252+0000","last_unstale":"2024-09-11T22:15:08.989834+0000","last_undegraded":"2024-09-11T22:15:08.989834+0000","last_fullsized":"2024-09-11T22:15:08.989834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:30.662715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950812+0000","last_change":"2024-09-11T22:15:06.602028+0000","last_active":"2024-09-11T22:15:08.950812+0000","last_peered":"2024-09-11T22:15:08.950812+0000","last_clean":"2024-09-11T22:15:08.950812+0000","last_became_active":"2024-09-11T22:15:06.601723+0000","last_became_peered":"2024-09-11T22:15:06.601723+0000","last_unstale":"2024-09-11T22:15:08.950812+0000","last_undegraded":"2024-09-11T22:15:08.950812+0000","last_fullsized":"2024-09-11T22:15:08.950812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:08.901035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989476+0000","last_change":"2024-09-11T22:15:07.624503+0000","last_active":"2024-09-11T22:15:08.989476+0000","last_peered":"2024-09-11T22:15:08.989476+0000","last_clean":"2024-09-11T22:15:08.989476+0000","last_became_active":"2024-09-11T22:15:07.624218+0000","last_became_peered":"2024-09-11T22:15:07.624218+0000","last_unstale":"2024-09-11T22:15:08.989476+0000","last_undegraded":"2024-09-11T22:15:08.989476+0000","last_fullsized":"2024-09-11T22:15:08.989476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:41.357009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615706+0000","last_change":"2024-09-11T22:15:06.595704+0000","last_active":"2024-09-11T22:15:08.615706+0000","last_peered":"2024-09-11T22:15:08.615706+0000","last_clean":"2024-09-11T22:15:08.615706+0000","last_became_active":"2024-09-11T22:15:06.595424+0000","last_became_peered":"2024-09-11T22:15:06.595424+0000","last_unstale":"2024-09-11T22:15:08.615706+0000","last_undegraded":"2024-09-11T22:15:08.615706+0000","last_fullsized":"2024-09-11T22:15:08.615706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:32.303344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989526+0000","last_change":"2024-09-11T22:15:07.627761+0000","last_active":"2024-09-11T22:15:08.989526+0000","last_peered":"2024-09-11T22:15:08.989526+0000","last_clean":"2024-09-11T22:15:08.989526+0000","last_became_active":"2024-09-11T22:15:07.627501+0000","last_became_peered":"2024-09-11T22:15:07.627501+0000","last_unstale":"2024-09-11T22:15:08.989526+0000","last_undegraded":"2024-09-11T22:15:08.989526+0000","last_fullsized":"2024-09-11T22:15:08.989526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:56.279768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612424+0000","last_change":"2024-09-11T22:15:06.599176+0000","last_active":"2024-09-11T22:15:08.612424+0000","last_peered":"2024-09-11T22:15:08.612424+0000","last_clean":"2024-09-11T22:15:08.612424+0000","last_became_active":"2024-09-11T22:15:06.598884+0000","last_became_peered":"2024-09-11T22:15:06.598884+0000","last_unstale":"2024-09-11T22:15:08.612424+0000","last_undegraded":"2024-09-11T22:15:08.612424+0000","last_fullsized":"2024-09-11T22:15:08.612424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:53.406997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612778+0000","last_change":"2024-09-11T22:15:07.617307+0000","last_active":"2024-09-11T22:15:08.612778+0000","last_peered":"2024-09-11T22:15:08.612778+0000","last_clean":"2024-09-11T22:15:08.612778+0000","last_became_active":"2024-09-11T22:15:07.617023+0000","last_became_peered":"2024-09-11T22:15:07.617023+0000","last_unstale":"2024-09-11T22:15:08.612778+0000","last_undegraded":"2024-09-11T22:15:08.612778+0000","last_fullsized":"2024-09-11T22:15:08.612778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:52.279163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950937+0000","last_change":"2024-09-11T22:15:06.596640+0000","last_active":"2024-09-11T22:15:08.950937+0000","last_peered":"2024-09-11T22:15:08.950937+0000","last_clean":"2024-09-11T22:15:08.950937+0000","last_became_active":"2024-09-11T22:15:06.595275+0000","last_became_peered":"2024-09-11T22:15:06.595275+0000","last_unstale":"2024-09-11T22:15:08.950937+0000","last_undegraded":"2024-09-11T22:15:08.950937+0000","last_fullsized":"2024-09-11T22:15:08.950937+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:34.525374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615860+0000","last_change":"2024-09-11T22:15:07.607459+0000","last_active":"2024-09-11T22:15:08.615860+0000","last_peered":"2024-09-11T22:15:08.615860+0000","last_clean":"2024-09-11T22:15:08.615860+0000","last_became_active":"2024-09-11T22:15:07.607170+0000","last_became_peered":"2024-09-11T22:15:07.607170+0000","last_unstale":"2024-09-11T22:15:08.615860+0000","last_undegraded":"2024-09-11T22:15:08.615860+0000","last_fullsized":"2024-09-11T22:15:08.615860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:38.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616087+0000","last_change":"2024-09-11T22:15:06.603161+0000","last_active":"2024-09-11T22:15:08.616087+0000","last_peered":"2024-09-11T22:15:08.616087+0000","last_clean":"2024-09-11T22:15:08.616087+0000","last_became_active":"2024-09-11T22:15:06.602873+0000","last_became_peered":"2024-09-11T22:15:06.602873+0000","last_unstale":"2024-09-11T22:15:08.616087+0000","last_undegraded":"2024-09-11T22:15:08.616087+0000","last_fullsized":"2024-09-11T22:15:08.616087+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:03.957361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.588958+0000","last_change":"2024-09-11T22:15:06.588958+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.588958+0000","last_undegraded":"2024-09-11T22:15:06.588958+0000","last_fullsized":"2024-09-11T22:15:06.588958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989202+0000","last_change":"2024-09-11T22:15:06.600505+0000","last_active":"2024-09-11T22:15:08.989202+0000","last_peered":"2024-09-11T22:15:08.989202+0000","last_clean":"2024-09-11T22:15:08.989202+0000","last_became_active":"2024-09-11T22:15:06.600096+0000","last_became_peered":"2024-09-11T22:15:06.600096+0000","last_unstale":"2024-09-11T22:15:08.989202+0000","last_undegraded":"2024-09-11T22:15:08.989202+0000","last_fullsized":"2024-09-11T22:15:08.989202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:48.520695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-11T22:15:06.590216+0000","last_change":"2024-09-11T22:15:06.590216+0000","last_active":"2024-09-11T22:15:06.578025+0000","last_peered":"2024-09-11T22:15:06.578025+0000","last_clean":"2024-09-11T22:15:06.578025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:06.590216+0000","last_undegraded":"2024-09-11T22:15:06.590216+0000","last_fullsized":"2024-09-11T22:15:06.590216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612643+0000","last_change":"2024-09-11T22:15:06.595834+0000","last_active":"2024-09-11T22:15:08.612643+0000","last_peered":"2024-09-11T22:15:08.612643+0000","last_clean":"2024-09-11T22:15:08.612643+0000","last_became_active":"2024-09-11T22:15:06.595547+0000","last_became_peered":"2024-09-11T22:15:06.595547+0000","last_unstale":"2024-09-11T22:15:08.612643+0000","last_undegraded":"2024-09-11T22:15:08.612643+0000","last_fullsized":"2024-09-11T22:15:08.612643+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:38.263891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989282+0000","last_change":"2024-09-11T22:15:07.619452+0000","last_active":"2024-09-11T22:15:08.989282+0000","last_peered":"2024-09-11T22:15:08.989282+0000","last_clean":"2024-09-11T22:15:08.989282+0000","last_became_active":"2024-09-11T22:15:07.618679+0000","last_became_peered":"2024-09-11T22:15:07.618679+0000","last_unstale":"2024-09-11T22:15:08.989282+0000","last_undegraded":"2024-09-11T22:15:08.989282+0000","last_fullsized":"2024-09-11T22:15:08.989282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:55.601100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989051+0000","last_change":"2024-09-11T22:15:06.595551+0000","last_active":"2024-09-11T22:15:08.989051+0000","last_peered":"2024-09-11T22:15:08.989051+0000","last_clean":"2024-09-11T22:15:08.989051+0000","last_became_active":"2024-09-11T22:15:06.595301+0000","last_became_peered":"2024-09-11T22:15:06.595301+0000","last_unstale":"2024-09-11T22:15:08.989051+0000","last_undegraded":"2024-09-11T22:15:08.989051+0000","last_fullsized":"2024-09-11T22:15:08.989051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:33.465401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950580+0000","last_change":"2024-09-11T22:15:07.625363+0000","last_active":"2024-09-11T22:15:08.950580+0000","last_peered":"2024-09-11T22:15:08.950580+0000","last_clean":"2024-09-11T22:15:08.950580+0000","last_became_active":"2024-09-11T22:15:07.624697+0000","last_became_peered":"2024-09-11T22:15:07.624697+0000","last_unstale":"2024-09-11T22:15:08.950580+0000","last_undegraded":"2024-09-11T22:15:08.950580+0000","last_fullsized":"2024-09-11T22:15:08.950580+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:09.058151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989011+0000","last_change":"2024-09-11T22:15:06.589248+0000","last_active":"2024-09-11T22:15:08.989011+0000","last_peered":"2024-09-11T22:15:08.989011+0000","last_clean":"2024-09-11T22:15:08.989011+0000","last_became_active":"2024-09-11T22:15:06.588990+0000","last_became_peered":"2024-09-11T22:15:06.588990+0000","last_unstale":"2024-09-11T22:15:08.989011+0000","last_undegraded":"2024-09-11T22:15:08.989011+0000","last_fullsized":"2024-09-11T22:15:08.989011+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:25.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989285+0000","last_change":"2024-09-11T22:15:07.621584+0000","last_active":"2024-09-11T22:15:08.989285+0000","last_peered":"2024-09-11T22:15:08.989285+0000","last_clean":"2024-09-11T22:15:08.989285+0000","last_became_active":"2024-09-11T22:15:07.621309+0000","last_became_peered":"2024-09-11T22:15:07.621309+0000","last_unstale":"2024-09-11T22:15:08.989285+0000","last_undegraded":"2024-09-11T22:15:08.989285+0000","last_fullsized":"2024-09-11T22:15:08.989285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:16.481227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614930+0000","last_change":"2024-09-11T22:15:06.594165+0000","last_active":"2024-09-11T22:15:08.614930+0000","last_peered":"2024-09-11T22:15:08.614930+0000","last_clean":"2024-09-11T22:15:08.614930+0000","last_became_active":"2024-09-11T22:15:06.593911+0000","last_became_peered":"2024-09-11T22:15:06.593911+0000","last_unstale":"2024-09-11T22:15:08.614930+0000","last_undegraded":"2024-09-11T22:15:08.614930+0000","last_fullsized":"2024-09-11T22:15:08.614930+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:15.476717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950375+0000","last_change":"2024-09-11T22:15:07.618801+0000","last_active":"2024-09-11T22:15:08.950375+0000","last_peered":"2024-09-11T22:15:08.950375+0000","last_clean":"2024-09-11T22:15:08.950375+0000","last_became_active":"2024-09-11T22:15:07.618516+0000","last_became_peered":"2024-09-11T22:15:07.618516+0000","last_unstale":"2024-09-11T22:15:08.950375+0000","last_undegraded":"2024-09-11T22:15:08.950375+0000","last_fullsized":"2024-09-11T22:15:08.950375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:14.512180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950830+0000","last_change":"2024-09-11T22:15:06.598668+0000","last_active":"2024-09-11T22:15:08.950830+0000","last_peered":"2024-09-11T22:15:08.950830+0000","last_clean":"2024-09-11T22:15:08.950830+0000","last_became_active":"2024-09-11T22:15:06.598188+0000","last_became_peered":"2024-09-11T22:15:06.598188+0000","last_unstale":"2024-09-11T22:15:08.950830+0000","last_undegraded":"2024-09-11T22:15:08.950830+0000","last_fullsized":"2024-09-11T22:15:08.950830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:53.861223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989684+0000","last_change":"2024-09-11T22:15:07.628459+0000","last_active":"2024-09-11T22:15:08.989684+0000","last_peered":"2024-09-11T22:15:08.989684+0000","last_clean":"2024-09-11T22:15:08.989684+0000","last_became_active":"2024-09-11T22:15:07.628201+0000","last_became_peered":"2024-09-11T22:15:07.628201+0000","last_unstale":"2024-09-11T22:15:08.989684+0000","last_undegraded":"2024-09-11T22:15:08.989684+0000","last_fullsized":"2024-09-11T22:15:08.989684+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:27.058146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950623+0000","last_change":"2024-09-11T22:15:06.599378+0000","last_active":"2024-09-11T22:15:08.950623+0000","last_peered":"2024-09-11T22:15:08.950623+0000","last_clean":"2024-09-11T22:15:08.950623+0000","last_became_active":"2024-09-11T22:15:06.599051+0000","last_became_peered":"2024-09-11T22:15:06.599051+0000","last_unstale":"2024-09-11T22:15:08.950623+0000","last_undegraded":"2024-09-11T22:15:08.950623+0000","last_fullsized":"2024-09-11T22:15:08.950623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:49.135671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":262,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-11T22:15:06.592036+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:15:06.592036+0000","last_peered":"2024-09-11T22:15:06.592036+0000","last_clean":"2024-09-11T22:15:06.592036+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:15:06.592036+0000","last_undegraded":"2024-09-11T22:15:06.592036+0000","last_fullsized":"2024-09-11T22:15:06.592036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36236,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335604,"statfs":{"total":96636764160,"available":96599658496,"internally_reserved":0,"allocated":901120,"data_stored":380409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":897024,"data_stored":380407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":897024,"data_stored":380387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":888832,"data_stored":374129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":913408,"data_stored":382545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40964,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330876,"statfs":{"total":96636764160,"available":96594817024,"internally_reserved":0,"allocated":1486848,"data_stored":970685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36784,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335056,"statfs":{"total":96636764160,"available":96599097344,"internally_reserved":0,"allocated":1462272,"data_stored":957610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44552,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327288,"statfs":{"total":96636764160,"available":96591142912,"internally_reserved":0,"allocated":905216,"data_stored":381929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:15:12.508 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:15:12.511 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:15:13.580 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-09-11T22:15:13.579+0000 7fb95776c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:15:15.013 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:15:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.128+0000 7f0cba74b640 1 Processor -- start 2024-09-11T22:15:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.128+0000 7f0cba74b640 1 -- start start 2024-09-11T22:15:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cba74b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cb415c240 0x7f0cb40b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cba74b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cb40728e0 0x7f0cb4072d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cba74b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cb415c620 con 0x7f0cb40735a0 2024-09-11T22:15:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cba74b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0cb4073290 con 0x7f0cb40728e0 2024-09-11T22:15:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cba74b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb415f2b0 con 0x7f0cb415c240 2024-09-11T22:15:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cb8ce8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cb40728e0 0x7f0cb4072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cb8ce8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cb40728e0 0x7f0cb4072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50144/0 (socket says 172.21.15.50:50144) 2024-09-11T22:15:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cb8ce8640 1 -- 172.21.15.50:0/1990935340 learned_addr learned my addr 172.21.15.50:0/1990935340 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cb3fff640 1 --2- 172.21.15.50:0/1990935340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cb415c240 0x7f0cb40b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cb8ce8640 1 -- 172.21.15.50:0/1990935340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cb415c240 msgr2=0x7f0cb40b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cb8ce8640 1 --2- 172.21.15.50:0/1990935340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cb415c240 0x7f0cb40b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cb8ce8640 1 -- 172.21.15.50:0/1990935340 >> v1:172.21.15.77:6789/0 conn(0x7f0cb40735a0 legacy=0x7f0cb415eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cb8ce8640 1 -- 172.21.15.50:0/1990935340 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb415f560 con 0x7f0cb40728e0 2024-09-11T22:15:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.129+0000 7f0cb3fff640 1 --2- 172.21.15.50:0/1990935340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cb415c240 0x7f0cb40b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.130+0000 7f0cb8ce8640 1 --2- 172.21.15.50:0/1990935340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb40728e0 0x7f0cb4072d50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009e50 tx=0x7f0cac02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fec05b4414e0b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.130+0000 7f0cb2ffd640 1 -- 172.21.15.50:0/1990935340 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac036070 con 0x7f0cb40728e0 2024-09-11T22:15:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.130+0000 7f0cb2ffd640 1 -- 172.21.15.50:0/1990935340 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cac031600 con 0x7f0cb40728e0 2024-09-11T22:15:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.130+0000 7f0cb2ffd640 1 -- 172.21.15.50:0/1990935340 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac0319d0 con 0x7f0cb40728e0 2024-09-11T22:15:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.131+0000 7f0cba74b640 1 -- 172.21.15.50:0/1990935340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb40728e0 msgr2=0x7f0cb4072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.131+0000 7f0cba74b640 1 --2- 172.21.15.50:0/1990935340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb40728e0 0x7f0cb4072d50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009e50 tx=0x7f0cac02a6c0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.131+0000 7f0cba74b640 1 -- 172.21.15.50:0/1990935340 shutdown_connections 2024-09-11T22:15:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.131+0000 7f0cba74b640 1 --2- 172.21.15.50:0/1990935340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb40728e0 0x7f0cb4072d50 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.131+0000 7f0cba74b640 1 --2- 172.21.15.50:0/1990935340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cb415c240 0x7f0cb40b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.131+0000 7f0cba74b640 1 -- 172.21.15.50:0/1990935340 >> 172.21.15.50:0/1990935340 conn(0x7f0cb40b2bd0 msgr2=0x7f0cb40b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.131+0000 7f0cba74b640 1 -- 172.21.15.50:0/1990935340 shutdown_connections 2024-09-11T22:15:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.131+0000 7f0cba74b640 1 -- 172.21.15.50:0/1990935340 wait complete. 2024-09-11T22:15:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.132+0000 7f0cba74b640 1 Processor -- start 2024-09-11T22:15:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.132+0000 7f0cba74b640 1 -- start start 2024-09-11T22:15:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.133+0000 7f0cba74b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb40728e0 0x7f0cb40d0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.133+0000 7f0cba74b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cb40735a0 0x7f0cb40ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.133+0000 7f0cba74b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cb415c240 0x7f0cb415d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.133+0000 7f0cba74b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb40b3f70 con 0x7f0cb40728e0 2024-09-11T22:15:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.133+0000 7f0cba74b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb415fb20 con 0x7f0cb40735a0 2024-09-11T22:15:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.133+0000 7f0cba74b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb40b4250 con 0x7f0cb415c240 2024-09-11T22:15:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.133+0000 7f0cb3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb40728e0 0x7f0cb40d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.133+0000 7f0cb3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb40728e0 0x7f0cb40d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50160/0 (socket says 172.21.15.50:50160) 2024-09-11T22:15:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.133+0000 7f0cb3fff640 1 -- 172.21.15.50:0/1634107872 learned_addr learned my addr 172.21.15.50:0/1634107872 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.133+0000 7f0cb8ce8640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cb415c240 0x7f0cb415d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.133+0000 7f0cb37fe640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cb40735a0 0x7f0cb40ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.133+0000 7f0cb3fff640 1 -- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cb415c240 msgr2=0x7f0cb415d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.134+0000 7f0cb3fff640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cb415c240 0x7f0cb415d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.134+0000 7f0cb3fff640 1 -- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cb40735a0 msgr2=0x7f0cb40ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.134+0000 7f0cb3fff640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cb40735a0 0x7f0cb40ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.134+0000 7f0cb3fff640 1 -- 172.21.15.50:0/1634107872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb4156ed0 con 0x7f0cb40728e0 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.134+0000 7f0cb8ce8640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cb415c240 0x7f0cb415d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.134+0000 7f0cb37fe640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cb40735a0 0x7f0cb40ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.134+0000 7f0cb3fff640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb40728e0 0x7f0cb40d0630 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400c7f0 tx=0x7f0ca400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.134+0000 7f0cb0ff9640 1 -- 172.21.15.50:0/1634107872 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4015070 con 0x7f0cb40728e0 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.134+0000 7f0cb0ff9640 1 -- 172.21.15.50:0/1634107872 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca4007820 con 0x7f0cb40728e0 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.134+0000 7f0cba74b640 1 -- 172.21.15.50:0/1634107872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb40d0b70 con 0x7f0cb40728e0 2024-09-11T22:15:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.134+0000 7f0cb0ff9640 1 -- 172.21.15.50:0/1634107872 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4007bd0 con 0x7f0cb40728e0 2024-09-11T22:15:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.134+0000 7f0cba74b640 1 -- 172.21.15.50:0/1634107872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb40cdef0 con 0x7f0cb40728e0 2024-09-11T22:15:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.135+0000 7f0cba74b640 1 -- 172.21.15.50:0/1634107872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb4072d50 con 0x7f0cb40728e0 2024-09-11T22:15:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.136+0000 7f0cb0ff9640 1 -- 172.21.15.50:0/1634107872 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ca4018070 con 0x7f0cb40728e0 2024-09-11T22:15:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.136+0000 7f0cb0ff9640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ca006be30 0x7f0ca006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.136+0000 7f0cb0ff9640 1 -- 172.21.15.50:0/1634107872 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f0ca408afd0 con 0x7f0cb40728e0 2024-09-11T22:15:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.136+0000 7f0cb37fe640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ca006be30 0x7f0ca006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.137+0000 7f0cb37fe640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ca006be30 0x7f0ca006e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0cb41f7b80 tx=0x7f0ca8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.140+0000 7f0cb0ff9640 1 -- 172.21.15.50:0/1634107872 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0cb4156ed0 con 0x7f0cb40728e0 2024-09-11T22:15:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.316+0000 7f0cba74b640 1 -- 172.21.15.50:0/1634107872 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0cb415c940 con 0x7f0ca006be30 2024-09-11T22:15:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.322+0000 7f0cb0ff9640 1 -- 172.21.15.50:0/1634107872 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252066 (secure 0 0 0) 0x7f0ca80568c0 con 0x7f0ca006be30 2024-09-11T22:15:15.326 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:15:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.325+0000 7f0cba74b640 1 -- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ca006be30 msgr2=0x7f0ca006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.325+0000 7f0cba74b640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ca006be30 0x7f0ca006e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0cb41f7b80 tx=0x7f0ca8009040 comp rx=0 tx=0).stop 2024-09-11T22:15:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.325+0000 7f0cba74b640 1 -- 172.21.15.50:0/1634107872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb40728e0 msgr2=0x7f0cb40d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.325+0000 7f0cba74b640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb40728e0 0x7f0cb40d0630 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400c7f0 tx=0x7f0ca400ccb0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.326+0000 7f0cba74b640 1 -- 172.21.15.50:0/1634107872 shutdown_connections 2024-09-11T22:15:15.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.326+0000 7f0cba74b640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ca006be30 0x7f0ca006e2f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.326+0000 7f0cba74b640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cb415c240 0x7f0cb415d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.326+0000 7f0cba74b640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cb40735a0 0x7f0cb40ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.326+0000 7f0cba74b640 1 --2- 172.21.15.50:0/1634107872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cb40728e0 0x7f0cb40d0630 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.326+0000 7f0cba74b640 1 -- 172.21.15.50:0/1634107872 >> 172.21.15.50:0/1634107872 conn(0x7f0cb40b2bd0 msgr2=0x7f0cb40b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:15.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.326+0000 7f0cba74b640 1 -- 172.21.15.50:0/1634107872 shutdown_connections 2024-09-11T22:15:15.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.326+0000 7f0cba74b640 1 -- 172.21.15.50:0/1634107872 wait complete. 2024-09-11T22:15:15.337 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-11T22:15:13.420857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":286828,"kb_used_data":8188,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754687892,"statfs":{"total":773094113280,"available":772800401408,"internally_reserved":0,"allocated":8384512,"data_stored":4221792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.839219"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989707+0000","last_change":"2024-09-11T22:15:07.622906+0000","last_active":"2024-09-11T22:15:08.989707+0000","last_peered":"2024-09-11T22:15:08.989707+0000","last_clean":"2024-09-11T22:15:08.989707+0000","last_became_active":"2024-09-11T22:15:07.622594+0000","last_became_peered":"2024-09-11T22:15:07.622594+0000","last_unstale":"2024-09-11T22:15:08.989707+0000","last_undegraded":"2024-09-11T22:15:08.989707+0000","last_fullsized":"2024-09-11T22:15:08.989707+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:16:46.892710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950901+0000","last_change":"2024-09-11T22:15:07.620683+0000","last_active":"2024-09-11T22:15:08.950901+0000","last_peered":"2024-09-11T22:15:08.950901+0000","last_clean":"2024-09-11T22:15:08.950901+0000","last_became_active":"2024-09-11T22:15:07.620387+0000","last_became_peered":"2024-09-11T22:15:07.620387+0000","last_unstale":"2024-09-11T22:15:08.950901+0000","last_undegraded":"2024-09-11T22:15:08.950901+0000","last_fullsized":"2024-09-11T22:15:08.950901+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:45.541045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989555+0000","last_change":"2024-09-11T22:15:07.614508+0000","last_active":"2024-09-11T22:15:08.989555+0000","last_peered":"2024-09-11T22:15:08.989555+0000","last_clean":"2024-09-11T22:15:08.989555+0000","last_became_active":"2024-09-11T22:15:07.614209+0000","last_became_peered":"2024-09-11T22:15:07.614209+0000","last_unstale":"2024-09-11T22:15:08.989555+0000","last_undegraded":"2024-09-11T22:15:08.989555+0000","last_fullsized":"2024-09-11T22:15:08.989555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:29.618768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990158+0000","last_change":"2024-09-11T22:15:07.620641+0000","last_active":"2024-09-11T22:15:08.990158+0000","last_peered":"2024-09-11T22:15:08.990158+0000","last_clean":"2024-09-11T22:15:08.990158+0000","last_became_active":"2024-09-11T22:15:07.620131+0000","last_became_peered":"2024-09-11T22:15:07.620131+0000","last_unstale":"2024-09-11T22:15:08.990158+0000","last_undegraded":"2024-09-11T22:15:08.990158+0000","last_fullsized":"2024-09-11T22:15:08.990158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:03.304172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989007+0000","last_change":"2024-09-11T22:15:07.625761+0000","last_active":"2024-09-11T22:15:08.989007+0000","last_peered":"2024-09-11T22:15:08.989007+0000","last_clean":"2024-09-11T22:15:08.989007+0000","last_became_active":"2024-09-11T22:15:07.625508+0000","last_became_peered":"2024-09-11T22:15:07.625508+0000","last_unstale":"2024-09-11T22:15:08.989007+0000","last_undegraded":"2024-09-11T22:15:08.989007+0000","last_fullsized":"2024-09-11T22:15:08.989007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:06.819154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950671+0000","last_change":"2024-09-11T22:15:07.620053+0000","last_active":"2024-09-11T22:15:08.950671+0000","last_peered":"2024-09-11T22:15:08.950671+0000","last_clean":"2024-09-11T22:15:08.950671+0000","last_became_active":"2024-09-11T22:15:07.619773+0000","last_became_peered":"2024-09-11T22:15:07.619773+0000","last_unstale":"2024-09-11T22:15:08.950671+0000","last_undegraded":"2024-09-11T22:15:08.950671+0000","last_fullsized":"2024-09-11T22:15:08.950671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:11.698238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615362+0000","last_change":"2024-09-11T22:15:07.611744+0000","last_active":"2024-09-11T22:15:08.615362+0000","last_peered":"2024-09-11T22:15:08.615362+0000","last_clean":"2024-09-11T22:15:08.615362+0000","last_became_active":"2024-09-11T22:15:07.611448+0000","last_became_peered":"2024-09-11T22:15:07.611448+0000","last_unstale":"2024-09-11T22:15:08.615362+0000","last_undegraded":"2024-09-11T22:15:08.615362+0000","last_fullsized":"2024-09-11T22:15:08.615362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:07.621973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950531+0000","last_change":"2024-09-11T22:15:07.626253+0000","last_active":"2024-09-11T22:15:08.950531+0000","last_peered":"2024-09-11T22:15:08.950531+0000","last_clean":"2024-09-11T22:15:08.950531+0000","last_became_active":"2024-09-11T22:15:07.625925+0000","last_became_peered":"2024-09-11T22:15:07.625925+0000","last_unstale":"2024-09-11T22:15:08.950531+0000","last_undegraded":"2024-09-11T22:15:08.950531+0000","last_fullsized":"2024-09-11T22:15:08.950531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:24.963984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989453+0000","last_change":"2024-09-11T22:15:07.621375+0000","last_active":"2024-09-11T22:15:08.989453+0000","last_peered":"2024-09-11T22:15:08.989453+0000","last_clean":"2024-09-11T22:15:08.989453+0000","last_became_active":"2024-09-11T22:15:07.621108+0000","last_became_peered":"2024-09-11T22:15:07.621108+0000","last_unstale":"2024-09-11T22:15:08.989453+0000","last_undegraded":"2024-09-11T22:15:08.989453+0000","last_fullsized":"2024-09-11T22:15:08.989453+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:02.197728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615200+0000","last_change":"2024-09-11T22:15:07.623030+0000","last_active":"2024-09-11T22:15:08.615200+0000","last_peered":"2024-09-11T22:15:08.615200+0000","last_clean":"2024-09-11T22:15:08.615200+0000","last_became_active":"2024-09-11T22:15:07.622629+0000","last_became_peered":"2024-09-11T22:15:07.622629+0000","last_unstale":"2024-09-11T22:15:08.615200+0000","last_undegraded":"2024-09-11T22:15:08.615200+0000","last_fullsized":"2024-09-11T22:15:08.615200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:21.595561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989611+0000","last_change":"2024-09-11T22:15:07.624646+0000","last_active":"2024-09-11T22:15:08.989611+0000","last_peered":"2024-09-11T22:15:08.989611+0000","last_clean":"2024-09-11T22:15:08.989611+0000","last_became_active":"2024-09-11T22:15:07.622750+0000","last_became_peered":"2024-09-11T22:15:07.622750+0000","last_unstale":"2024-09-11T22:15:08.989611+0000","last_undegraded":"2024-09-11T22:15:08.989611+0000","last_fullsized":"2024-09-11T22:15:08.989611+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:07.340066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990214+0000","last_change":"2024-09-11T22:15:07.621753+0000","last_active":"2024-09-11T22:15:08.990214+0000","last_peered":"2024-09-11T22:15:08.990214+0000","last_clean":"2024-09-11T22:15:08.990214+0000","last_became_active":"2024-09-11T22:15:07.621469+0000","last_became_peered":"2024-09-11T22:15:07.621469+0000","last_unstale":"2024-09-11T22:15:08.990214+0000","last_undegraded":"2024-09-11T22:15:08.990214+0000","last_fullsized":"2024-09-11T22:15:08.990214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:57.372042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612759+0000","last_change":"2024-09-11T22:15:07.620776+0000","last_active":"2024-09-11T22:15:08.612759+0000","last_peered":"2024-09-11T22:15:08.612759+0000","last_clean":"2024-09-11T22:15:08.612759+0000","last_became_active":"2024-09-11T22:15:07.620512+0000","last_became_peered":"2024-09-11T22:15:07.620512+0000","last_unstale":"2024-09-11T22:15:08.612759+0000","last_undegraded":"2024-09-11T22:15:08.612759+0000","last_fullsized":"2024-09-11T22:15:08.612759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:17.012661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989130+0000","last_change":"2024-09-11T22:15:07.615352+0000","last_active":"2024-09-11T22:15:08.989130+0000","last_peered":"2024-09-11T22:15:08.989130+0000","last_clean":"2024-09-11T22:15:08.989130+0000","last_became_active":"2024-09-11T22:15:07.615077+0000","last_became_peered":"2024-09-11T22:15:07.615077+0000","last_unstale":"2024-09-11T22:15:08.989130+0000","last_undegraded":"2024-09-11T22:15:08.989130+0000","last_fullsized":"2024-09-11T22:15:08.989130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:54.816149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612736+0000","last_change":"2024-09-11T22:15:07.613812+0000","last_active":"2024-09-11T22:15:08.612736+0000","last_peered":"2024-09-11T22:15:08.612736+0000","last_clean":"2024-09-11T22:15:08.612736+0000","last_became_active":"2024-09-11T22:15:07.613488+0000","last_became_peered":"2024-09-11T22:15:07.613488+0000","last_unstale":"2024-09-11T22:15:08.612736+0000","last_undegraded":"2024-09-11T22:15:08.612736+0000","last_fullsized":"2024-09-11T22:15:08.612736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:47.977968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614827+0000","last_change":"2024-09-11T22:15:07.621039+0000","last_active":"2024-09-11T22:15:08.614827+0000","last_peered":"2024-09-11T22:15:08.614827+0000","last_clean":"2024-09-11T22:15:08.614827+0000","last_became_active":"2024-09-11T22:15:07.620669+0000","last_became_peered":"2024-09-11T22:15:07.620669+0000","last_unstale":"2024-09-11T22:15:08.614827+0000","last_undegraded":"2024-09-11T22:15:08.614827+0000","last_fullsized":"2024-09-11T22:15:08.614827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:33.307854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989545+0000","last_change":"2024-09-11T22:15:07.620480+0000","last_active":"2024-09-11T22:15:08.989545+0000","last_peered":"2024-09-11T22:15:08.989545+0000","last_clean":"2024-09-11T22:15:08.989545+0000","last_became_active":"2024-09-11T22:15:07.620188+0000","last_became_peered":"2024-09-11T22:15:07.620188+0000","last_unstale":"2024-09-11T22:15:08.989545+0000","last_undegraded":"2024-09-11T22:15:08.989545+0000","last_fullsized":"2024-09-11T22:15:08.989545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:12.268020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990303+0000","last_change":"2024-09-11T22:15:07.624157+0000","last_active":"2024-09-11T22:15:08.990303+0000","last_peered":"2024-09-11T22:15:08.990303+0000","last_clean":"2024-09-11T22:15:08.990303+0000","last_became_active":"2024-09-11T22:15:07.622120+0000","last_became_peered":"2024-09-11T22:15:07.622120+0000","last_unstale":"2024-09-11T22:15:08.990303+0000","last_undegraded":"2024-09-11T22:15:08.990303+0000","last_fullsized":"2024-09-11T22:15:08.990303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:31.693477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950600+0000","last_change":"2024-09-11T22:15:07.625050+0000","last_active":"2024-09-11T22:15:08.950600+0000","last_peered":"2024-09-11T22:15:08.950600+0000","last_clean":"2024-09-11T22:15:08.950600+0000","last_became_active":"2024-09-11T22:15:07.624770+0000","last_became_peered":"2024-09-11T22:15:07.624770+0000","last_unstale":"2024-09-11T22:15:08.950600+0000","last_undegraded":"2024-09-11T22:15:08.950600+0000","last_fullsized":"2024-09-11T22:15:08.950600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:39.268401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612645+0000","last_change":"2024-09-11T22:15:07.615306+0000","last_active":"2024-09-11T22:15:08.612645+0000","last_peered":"2024-09-11T22:15:08.612645+0000","last_clean":"2024-09-11T22:15:08.612645+0000","last_became_active":"2024-09-11T22:15:07.615030+0000","last_became_peered":"2024-09-11T22:15:07.615030+0000","last_unstale":"2024-09-11T22:15:08.612645+0000","last_undegraded":"2024-09-11T22:15:08.612645+0000","last_fullsized":"2024-09-11T22:15:08.612645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:32.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615516+0000","last_change":"2024-09-11T22:15:07.617207+0000","last_active":"2024-09-11T22:15:08.615516+0000","last_peered":"2024-09-11T22:15:08.615516+0000","last_clean":"2024-09-11T22:15:08.615516+0000","last_became_active":"2024-09-11T22:15:07.616622+0000","last_became_peered":"2024-09-11T22:15:07.616622+0000","last_unstale":"2024-09-11T22:15:08.615516+0000","last_undegraded":"2024-09-11T22:15:08.615516+0000","last_fullsized":"2024-09-11T22:15:08.615516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:32.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615208+0000","last_change":"2024-09-11T22:15:07.618290+0000","last_active":"2024-09-11T22:15:08.615208+0000","last_peered":"2024-09-11T22:15:08.615208+0000","last_clean":"2024-09-11T22:15:08.615208+0000","last_became_active":"2024-09-11T22:15:07.618024+0000","last_became_peered":"2024-09-11T22:15:07.618024+0000","last_unstale":"2024-09-11T22:15:08.615208+0000","last_undegraded":"2024-09-11T22:15:08.615208+0000","last_fullsized":"2024-09-11T22:15:08.615208+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:04.415812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989277+0000","last_change":"2024-09-11T22:15:07.622213+0000","last_active":"2024-09-11T22:15:08.989277+0000","last_peered":"2024-09-11T22:15:08.989277+0000","last_clean":"2024-09-11T22:15:08.989277+0000","last_became_active":"2024-09-11T22:15:07.621927+0000","last_became_peered":"2024-09-11T22:15:07.621927+0000","last_unstale":"2024-09-11T22:15:08.989277+0000","last_undegraded":"2024-09-11T22:15:08.989277+0000","last_fullsized":"2024-09-11T22:15:08.989277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:20.031935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989188+0000","last_change":"2024-09-11T22:15:07.629990+0000","last_active":"2024-09-11T22:15:08.989188+0000","last_peered":"2024-09-11T22:15:08.989188+0000","last_clean":"2024-09-11T22:15:08.989188+0000","last_became_active":"2024-09-11T22:15:07.629692+0000","last_became_peered":"2024-09-11T22:15:07.629692+0000","last_unstale":"2024-09-11T22:15:08.989188+0000","last_undegraded":"2024-09-11T22:15:08.989188+0000","last_fullsized":"2024-09-11T22:15:08.989188+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:46.167711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615107+0000","last_change":"2024-09-11T22:15:07.624381+0000","last_active":"2024-09-11T22:15:08.615107+0000","last_peered":"2024-09-11T22:15:08.615107+0000","last_clean":"2024-09-11T22:15:08.615107+0000","last_became_active":"2024-09-11T22:15:07.624110+0000","last_became_peered":"2024-09-11T22:15:07.624110+0000","last_unstale":"2024-09-11T22:15:08.615107+0000","last_undegraded":"2024-09-11T22:15:08.615107+0000","last_fullsized":"2024-09-11T22:15:08.615107+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:04.961870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616093+0000","last_change":"2024-09-11T22:15:07.621337+0000","last_active":"2024-09-11T22:15:08.616093+0000","last_peered":"2024-09-11T22:15:08.616093+0000","last_clean":"2024-09-11T22:15:08.616093+0000","last_became_active":"2024-09-11T22:15:07.621070+0000","last_became_peered":"2024-09-11T22:15:07.621070+0000","last_unstale":"2024-09-11T22:15:08.616093+0000","last_undegraded":"2024-09-11T22:15:08.616093+0000","last_fullsized":"2024-09-11T22:15:08.616093+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:07.951475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989709+0000","last_change":"2024-09-11T22:15:07.626797+0000","last_active":"2024-09-11T22:15:08.989709+0000","last_peered":"2024-09-11T22:15:08.989709+0000","last_clean":"2024-09-11T22:15:08.989709+0000","last_became_active":"2024-09-11T22:15:07.626342+0000","last_became_peered":"2024-09-11T22:15:07.626342+0000","last_unstale":"2024-09-11T22:15:08.989709+0000","last_undegraded":"2024-09-11T22:15:08.989709+0000","last_fullsized":"2024-09-11T22:15:08.989709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:41.007210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615043+0000","last_change":"2024-09-11T22:15:07.624015+0000","last_active":"2024-09-11T22:15:08.615043+0000","last_peered":"2024-09-11T22:15:08.615043+0000","last_clean":"2024-09-11T22:15:08.615043+0000","last_became_active":"2024-09-11T22:15:07.623402+0000","last_became_peered":"2024-09-11T22:15:07.623402+0000","last_unstale":"2024-09-11T22:15:08.615043+0000","last_undegraded":"2024-09-11T22:15:08.615043+0000","last_fullsized":"2024-09-11T22:15:08.615043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.463954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989929+0000","last_change":"2024-09-11T22:15:07.617599+0000","last_active":"2024-09-11T22:15:08.989929+0000","last_peered":"2024-09-11T22:15:08.989929+0000","last_clean":"2024-09-11T22:15:08.989929+0000","last_became_active":"2024-09-11T22:15:07.616917+0000","last_became_peered":"2024-09-11T22:15:07.616917+0000","last_unstale":"2024-09-11T22:15:08.989929+0000","last_undegraded":"2024-09-11T22:15:08.989929+0000","last_fullsized":"2024-09-11T22:15:08.989929+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:01.339321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615511+0000","last_change":"2024-09-11T22:15:07.620592+0000","last_active":"2024-09-11T22:15:08.615511+0000","last_peered":"2024-09-11T22:15:08.615511+0000","last_clean":"2024-09-11T22:15:08.615511+0000","last_became_active":"2024-09-11T22:15:07.620310+0000","last_became_peered":"2024-09-11T22:15:07.620310+0000","last_unstale":"2024-09-11T22:15:08.615511+0000","last_undegraded":"2024-09-11T22:15:08.615511+0000","last_fullsized":"2024-09-11T22:15:08.615511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:40.859201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615602+0000","last_change":"2024-09-11T22:15:07.613050+0000","last_active":"2024-09-11T22:15:08.615602+0000","last_peered":"2024-09-11T22:15:08.615602+0000","last_clean":"2024-09-11T22:15:08.615602+0000","last_became_active":"2024-09-11T22:15:07.612729+0000","last_became_peered":"2024-09-11T22:15:07.612729+0000","last_unstale":"2024-09-11T22:15:08.615602+0000","last_undegraded":"2024-09-11T22:15:08.615602+0000","last_fullsized":"2024-09-11T22:15:08.615602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:23.619541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950591+0000","last_change":"2024-09-11T22:15:07.619623+0000","last_active":"2024-09-11T22:15:08.950591+0000","last_peered":"2024-09-11T22:15:08.950591+0000","last_clean":"2024-09-11T22:15:08.950591+0000","last_became_active":"2024-09-11T22:15:07.619354+0000","last_became_peered":"2024-09-11T22:15:07.619354+0000","last_unstale":"2024-09-11T22:15:08.950591+0000","last_undegraded":"2024-09-11T22:15:08.950591+0000","last_fullsized":"2024-09-11T22:15:08.950591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:51.968449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989635+0000","last_change":"2024-09-11T22:15:07.630714+0000","last_active":"2024-09-11T22:15:08.989635+0000","last_peered":"2024-09-11T22:15:08.989635+0000","last_clean":"2024-09-11T22:15:08.989635+0000","last_became_active":"2024-09-11T22:15:07.630383+0000","last_became_peered":"2024-09-11T22:15:07.630383+0000","last_unstale":"2024-09-11T22:15:08.989635+0000","last_undegraded":"2024-09-11T22:15:08.989635+0000","last_fullsized":"2024-09-11T22:15:08.989635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:16.425252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"73'4","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989815+0000","last_change":"2024-09-11T22:15:06.599470+0000","last_active":"2024-09-11T22:15:08.989815+0000","last_peered":"2024-09-11T22:15:08.989815+0000","last_clean":"2024-09-11T22:15:08.989815+0000","last_became_active":"2024-09-11T22:15:06.599035+0000","last_became_peered":"2024-09-11T22:15:06.599035+0000","last_unstale":"2024-09-11T22:15:08.989815+0000","last_undegraded":"2024-09-11T22:15:08.989815+0000","last_fullsized":"2024-09-11T22:15:08.989815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:47.011580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989589+0000","last_change":"2024-09-11T22:15:07.619722+0000","last_active":"2024-09-11T22:15:08.989589+0000","last_peered":"2024-09-11T22:15:08.989589+0000","last_clean":"2024-09-11T22:15:08.989589+0000","last_became_active":"2024-09-11T22:15:07.619354+0000","last_became_peered":"2024-09-11T22:15:07.619354+0000","last_unstale":"2024-09-11T22:15:08.989589+0000","last_undegraded":"2024-09-11T22:15:08.989589+0000","last_fullsized":"2024-09-11T22:15:08.989589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:10.809505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612844+0000","last_change":"2024-09-11T22:15:06.599328+0000","last_active":"2024-09-11T22:15:08.612844+0000","last_peered":"2024-09-11T22:15:08.612844+0000","last_clean":"2024-09-11T22:15:08.612844+0000","last_became_active":"2024-09-11T22:15:06.599044+0000","last_became_peered":"2024-09-11T22:15:06.599044+0000","last_unstale":"2024-09-11T22:15:08.612844+0000","last_undegraded":"2024-09-11T22:15:08.612844+0000","last_fullsized":"2024-09-11T22:15:08.612844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:10.693728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950653+0000","last_change":"2024-09-11T22:15:07.624298+0000","last_active":"2024-09-11T22:15:08.950653+0000","last_peered":"2024-09-11T22:15:08.950653+0000","last_clean":"2024-09-11T22:15:08.950653+0000","last_became_active":"2024-09-11T22:15:07.623399+0000","last_became_peered":"2024-09-11T22:15:07.623399+0000","last_unstale":"2024-09-11T22:15:08.950653+0000","last_undegraded":"2024-09-11T22:15:08.950653+0000","last_fullsized":"2024-09-11T22:15:08.950653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:54.411507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615106+0000","last_change":"2024-09-11T22:15:06.599925+0000","last_active":"2024-09-11T22:15:08.615106+0000","last_peered":"2024-09-11T22:15:08.615106+0000","last_clean":"2024-09-11T22:15:08.615106+0000","last_became_active":"2024-09-11T22:15:06.599482+0000","last_became_peered":"2024-09-11T22:15:06.599482+0000","last_unstale":"2024-09-11T22:15:08.615106+0000","last_undegraded":"2024-09-11T22:15:08.615106+0000","last_fullsized":"2024-09-11T22:15:08.615106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:56.367532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989683+0000","last_change":"2024-09-11T22:15:07.624071+0000","last_active":"2024-09-11T22:15:08.989683+0000","last_peered":"2024-09-11T22:15:08.989683+0000","last_clean":"2024-09-11T22:15:08.989683+0000","last_became_active":"2024-09-11T22:15:07.622458+0000","last_became_peered":"2024-09-11T22:15:07.622458+0000","last_unstale":"2024-09-11T22:15:08.989683+0000","last_undegraded":"2024-09-11T22:15:08.989683+0000","last_fullsized":"2024-09-11T22:15:08.989683+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:54.889305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950832+0000","last_change":"2024-09-11T22:15:06.598354+0000","last_active":"2024-09-11T22:15:08.950832+0000","last_peered":"2024-09-11T22:15:08.950832+0000","last_clean":"2024-09-11T22:15:08.950832+0000","last_became_active":"2024-09-11T22:15:06.597886+0000","last_became_peered":"2024-09-11T22:15:06.597886+0000","last_unstale":"2024-09-11T22:15:08.950832+0000","last_undegraded":"2024-09-11T22:15:08.950832+0000","last_fullsized":"2024-09-11T22:15:08.950832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:16.566097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615590+0000","last_change":"2024-09-11T22:15:07.615641+0000","last_active":"2024-09-11T22:15:08.615590+0000","last_peered":"2024-09-11T22:15:08.615590+0000","last_clean":"2024-09-11T22:15:08.615590+0000","last_became_active":"2024-09-11T22:15:07.615317+0000","last_became_peered":"2024-09-11T22:15:07.615317+0000","last_unstale":"2024-09-11T22:15:08.615590+0000","last_undegraded":"2024-09-11T22:15:08.615590+0000","last_fullsized":"2024-09-11T22:15:08.615590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:51.103023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989901+0000","last_change":"2024-09-11T22:15:06.595409+0000","last_active":"2024-09-11T22:15:08.989901+0000","last_peered":"2024-09-11T22:15:08.989901+0000","last_clean":"2024-09-11T22:15:08.989901+0000","last_became_active":"2024-09-11T22:15:06.594997+0000","last_became_peered":"2024-09-11T22:15:06.594997+0000","last_unstale":"2024-09-11T22:15:08.989901+0000","last_undegraded":"2024-09-11T22:15:08.989901+0000","last_fullsized":"2024-09-11T22:15:08.989901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:47.151600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615672+0000","last_change":"2024-09-11T22:15:07.622620+0000","last_active":"2024-09-11T22:15:08.615672+0000","last_peered":"2024-09-11T22:15:08.615672+0000","last_clean":"2024-09-11T22:15:08.615672+0000","last_became_active":"2024-09-11T22:15:07.622043+0000","last_became_peered":"2024-09-11T22:15:07.622043+0000","last_unstale":"2024-09-11T22:15:08.615672+0000","last_undegraded":"2024-09-11T22:15:08.615672+0000","last_fullsized":"2024-09-11T22:15:08.615672+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:47.977968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950438+0000","last_change":"2024-09-11T22:15:06.601969+0000","last_active":"2024-09-11T22:15:08.950438+0000","last_peered":"2024-09-11T22:15:08.950438+0000","last_clean":"2024-09-11T22:15:08.950438+0000","last_became_active":"2024-09-11T22:15:06.601704+0000","last_became_peered":"2024-09-11T22:15:06.601704+0000","last_unstale":"2024-09-11T22:15:08.950438+0000","last_undegraded":"2024-09-11T22:15:08.950438+0000","last_fullsized":"2024-09-11T22:15:08.950438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:25.646446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.988828+0000","last_change":"2024-09-11T22:15:07.623214+0000","last_active":"2024-09-11T22:15:08.988828+0000","last_peered":"2024-09-11T22:15:08.988828+0000","last_clean":"2024-09-11T22:15:08.988828+0000","last_became_active":"2024-09-11T22:15:07.622879+0000","last_became_peered":"2024-09-11T22:15:07.622879+0000","last_unstale":"2024-09-11T22:15:08.988828+0000","last_undegraded":"2024-09-11T22:15:08.988828+0000","last_fullsized":"2024-09-11T22:15:08.988828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:11.200882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989766+0000","last_change":"2024-09-11T22:15:06.589489+0000","last_active":"2024-09-11T22:15:08.989766+0000","last_peered":"2024-09-11T22:15:08.989766+0000","last_clean":"2024-09-11T22:15:08.989766+0000","last_became_active":"2024-09-11T22:15:06.589159+0000","last_became_peered":"2024-09-11T22:15:06.589159+0000","last_unstale":"2024-09-11T22:15:08.989766+0000","last_undegraded":"2024-09-11T22:15:08.989766+0000","last_fullsized":"2024-09-11T22:15:08.989766+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:56.182848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612591+0000","last_change":"2024-09-11T22:15:07.630577+0000","last_active":"2024-09-11T22:15:08.612591+0000","last_peered":"2024-09-11T22:15:08.612591+0000","last_clean":"2024-09-11T22:15:08.612591+0000","last_became_active":"2024-09-11T22:15:07.630271+0000","last_became_peered":"2024-09-11T22:15:07.630271+0000","last_unstale":"2024-09-11T22:15:08.612591+0000","last_undegraded":"2024-09-11T22:15:08.612591+0000","last_fullsized":"2024-09-11T22:15:08.612591+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:25.034800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.988770+0000","last_change":"2024-09-11T22:15:06.599045+0000","last_active":"2024-09-11T22:15:08.988770+0000","last_peered":"2024-09-11T22:15:08.988770+0000","last_clean":"2024-09-11T22:15:08.988770+0000","last_became_active":"2024-09-11T22:15:06.598683+0000","last_became_peered":"2024-09-11T22:15:06.598683+0000","last_unstale":"2024-09-11T22:15:08.988770+0000","last_undegraded":"2024-09-11T22:15:08.988770+0000","last_fullsized":"2024-09-11T22:15:08.988770+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:53.608944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616017+0000","last_change":"2024-09-11T22:15:07.621117+0000","last_active":"2024-09-11T22:15:08.616017+0000","last_peered":"2024-09-11T22:15:08.616017+0000","last_clean":"2024-09-11T22:15:08.616017+0000","last_became_active":"2024-09-11T22:15:07.619879+0000","last_became_peered":"2024-09-11T22:15:07.619879+0000","last_unstale":"2024-09-11T22:15:08.616017+0000","last_undegraded":"2024-09-11T22:15:08.616017+0000","last_fullsized":"2024-09-11T22:15:08.616017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:46.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615132+0000","last_change":"2024-09-11T22:15:06.592064+0000","last_active":"2024-09-11T22:15:08.615132+0000","last_peered":"2024-09-11T22:15:08.615132+0000","last_clean":"2024-09-11T22:15:08.615132+0000","last_became_active":"2024-09-11T22:15:06.591789+0000","last_became_peered":"2024-09-11T22:15:06.591789+0000","last_unstale":"2024-09-11T22:15:08.615132+0000","last_undegraded":"2024-09-11T22:15:08.615132+0000","last_fullsized":"2024-09-11T22:15:08.615132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:13.507670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989695+0000","last_change":"2024-09-11T22:15:07.632740+0000","last_active":"2024-09-11T22:15:08.989695+0000","last_peered":"2024-09-11T22:15:08.989695+0000","last_clean":"2024-09-11T22:15:08.989695+0000","last_became_active":"2024-09-11T22:15:07.631568+0000","last_became_peered":"2024-09-11T22:15:07.631568+0000","last_unstale":"2024-09-11T22:15:08.989695+0000","last_undegraded":"2024-09-11T22:15:08.989695+0000","last_fullsized":"2024-09-11T22:15:08.989695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:53.582212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950979+0000","last_change":"2024-09-11T22:15:06.596633+0000","last_active":"2024-09-11T22:15:08.950979+0000","last_peered":"2024-09-11T22:15:08.950979+0000","last_clean":"2024-09-11T22:15:08.950979+0000","last_became_active":"2024-09-11T22:15:06.596323+0000","last_became_peered":"2024-09-11T22:15:06.596323+0000","last_unstale":"2024-09-11T22:15:08.950979+0000","last_undegraded":"2024-09-11T22:15:08.950979+0000","last_fullsized":"2024-09-11T22:15:08.950979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:56.182848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950744+0000","last_change":"2024-09-11T22:15:07.621209+0000","last_active":"2024-09-11T22:15:08.950744+0000","last_peered":"2024-09-11T22:15:08.950744+0000","last_clean":"2024-09-11T22:15:08.950744+0000","last_became_active":"2024-09-11T22:15:07.620885+0000","last_became_peered":"2024-09-11T22:15:07.620885+0000","last_unstale":"2024-09-11T22:15:08.950744+0000","last_undegraded":"2024-09-11T22:15:08.950744+0000","last_fullsized":"2024-09-11T22:15:08.950744+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:26.478181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"73'3","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989810+0000","last_change":"2024-09-11T22:15:06.593945+0000","last_active":"2024-09-11T22:15:08.989810+0000","last_peered":"2024-09-11T22:15:08.989810+0000","last_clean":"2024-09-11T22:15:08.989810+0000","last_became_active":"2024-09-11T22:15:06.593612+0000","last_became_peered":"2024-09-11T22:15:06.593612+0000","last_unstale":"2024-09-11T22:15:08.989810+0000","last_undegraded":"2024-09-11T22:15:08.989810+0000","last_fullsized":"2024-09-11T22:15:08.989810+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:32.595037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989006+0000","last_change":"2024-09-11T22:15:07.627440+0000","last_active":"2024-09-11T22:15:08.989006+0000","last_peered":"2024-09-11T22:15:08.989006+0000","last_clean":"2024-09-11T22:15:08.989006+0000","last_became_active":"2024-09-11T22:15:07.626810+0000","last_became_peered":"2024-09-11T22:15:07.626810+0000","last_unstale":"2024-09-11T22:15:08.989006+0000","last_undegraded":"2024-09-11T22:15:08.989006+0000","last_fullsized":"2024-09-11T22:15:08.989006+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:56.683364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"73'6","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990328+0000","last_change":"2024-09-11T22:15:06.596829+0000","last_active":"2024-09-11T22:15:08.990328+0000","last_peered":"2024-09-11T22:15:08.990328+0000","last_clean":"2024-09-11T22:15:08.990328+0000","last_became_active":"2024-09-11T22:15:06.596541+0000","last_became_peered":"2024-09-11T22:15:06.596541+0000","last_unstale":"2024-09-11T22:15:08.990328+0000","last_undegraded":"2024-09-11T22:15:08.990328+0000","last_fullsized":"2024-09-11T22:15:08.990328+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:54.153574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989326+0000","last_change":"2024-09-11T22:15:07.626955+0000","last_active":"2024-09-11T22:15:08.989326+0000","last_peered":"2024-09-11T22:15:08.989326+0000","last_clean":"2024-09-11T22:15:08.989326+0000","last_became_active":"2024-09-11T22:15:07.626613+0000","last_became_peered":"2024-09-11T22:15:07.626613+0000","last_unstale":"2024-09-11T22:15:08.989326+0000","last_undegraded":"2024-09-11T22:15:08.989326+0000","last_fullsized":"2024-09-11T22:15:08.989326+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:36.063113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990061+0000","last_change":"2024-09-11T22:15:06.594726+0000","last_active":"2024-09-11T22:15:08.990061+0000","last_peered":"2024-09-11T22:15:08.990061+0000","last_clean":"2024-09-11T22:15:08.990061+0000","last_became_active":"2024-09-11T22:15:06.594397+0000","last_became_peered":"2024-09-11T22:15:06.594397+0000","last_unstale":"2024-09-11T22:15:08.990061+0000","last_undegraded":"2024-09-11T22:15:08.990061+0000","last_fullsized":"2024-09-11T22:15:08.990061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:08.901035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615695+0000","last_change":"2024-09-11T22:15:07.616399+0000","last_active":"2024-09-11T22:15:08.615695+0000","last_peered":"2024-09-11T22:15:08.615695+0000","last_clean":"2024-09-11T22:15:08.615695+0000","last_became_active":"2024-09-11T22:15:07.616049+0000","last_became_peered":"2024-09-11T22:15:07.616049+0000","last_unstale":"2024-09-11T22:15:08.615695+0000","last_undegraded":"2024-09-11T22:15:08.615695+0000","last_fullsized":"2024-09-11T22:15:08.615695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:58.048294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950685+0000","last_change":"2024-09-11T22:15:06.596968+0000","last_active":"2024-09-11T22:15:08.950685+0000","last_peered":"2024-09-11T22:15:08.950685+0000","last_clean":"2024-09-11T22:15:08.950685+0000","last_became_active":"2024-09-11T22:15:06.595698+0000","last_became_peered":"2024-09-11T22:15:06.595698+0000","last_unstale":"2024-09-11T22:15:08.950685+0000","last_undegraded":"2024-09-11T22:15:08.950685+0000","last_fullsized":"2024-09-11T22:15:08.950685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:25.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612514+0000","last_change":"2024-09-11T22:15:07.621366+0000","last_active":"2024-09-11T22:15:08.612514+0000","last_peered":"2024-09-11T22:15:08.612514+0000","last_clean":"2024-09-11T22:15:08.612514+0000","last_became_active":"2024-09-11T22:15:07.621103+0000","last_became_peered":"2024-09-11T22:15:07.621103+0000","last_unstale":"2024-09-11T22:15:08.612514+0000","last_undegraded":"2024-09-11T22:15:08.612514+0000","last_fullsized":"2024-09-11T22:15:08.612514+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:04.415812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615462+0000","last_change":"2024-09-11T22:15:06.603089+0000","last_active":"2024-09-11T22:15:08.615462+0000","last_peered":"2024-09-11T22:15:08.615462+0000","last_clean":"2024-09-11T22:15:08.615462+0000","last_became_active":"2024-09-11T22:15:06.602803+0000","last_became_peered":"2024-09-11T22:15:06.602803+0000","last_unstale":"2024-09-11T22:15:08.615462+0000","last_undegraded":"2024-09-11T22:15:08.615462+0000","last_fullsized":"2024-09-11T22:15:08.615462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:34.459445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989098+0000","last_change":"2024-09-11T22:15:07.619952+0000","last_active":"2024-09-11T22:15:08.989098+0000","last_peered":"2024-09-11T22:15:08.989098+0000","last_clean":"2024-09-11T22:15:08.989098+0000","last_became_active":"2024-09-11T22:15:07.617853+0000","last_became_peered":"2024-09-11T22:15:07.617853+0000","last_unstale":"2024-09-11T22:15:08.989098+0000","last_undegraded":"2024-09-11T22:15:08.989098+0000","last_fullsized":"2024-09-11T22:15:08.989098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:01.596178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"73'8","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614740+0000","last_change":"2024-09-11T22:15:06.594832+0000","last_active":"2024-09-11T22:15:08.614740+0000","last_peered":"2024-09-11T22:15:08.614740+0000","last_clean":"2024-09-11T22:15:08.614740+0000","last_became_active":"2024-09-11T22:15:06.594529+0000","last_became_peered":"2024-09-11T22:15:06.594529+0000","last_unstale":"2024-09-11T22:15:08.614740+0000","last_undegraded":"2024-09-11T22:15:08.614740+0000","last_fullsized":"2024-09-11T22:15:08.614740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:02.299662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615277+0000","last_change":"2024-09-11T22:15:07.615717+0000","last_active":"2024-09-11T22:15:08.615277+0000","last_peered":"2024-09-11T22:15:08.615277+0000","last_clean":"2024-09-11T22:15:08.615277+0000","last_became_active":"2024-09-11T22:15:07.615451+0000","last_became_peered":"2024-09-11T22:15:07.615451+0000","last_unstale":"2024-09-11T22:15:08.615277+0000","last_undegraded":"2024-09-11T22:15:08.615277+0000","last_fullsized":"2024-09-11T22:15:08.615277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:25.034800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950863+0000","last_change":"2024-09-11T22:15:06.594898+0000","last_active":"2024-09-11T22:15:08.950863+0000","last_peered":"2024-09-11T22:15:08.950863+0000","last_clean":"2024-09-11T22:15:08.950863+0000","last_became_active":"2024-09-11T22:15:06.594562+0000","last_became_peered":"2024-09-11T22:15:06.594562+0000","last_unstale":"2024-09-11T22:15:08.950863+0000","last_undegraded":"2024-09-11T22:15:08.950863+0000","last_fullsized":"2024-09-11T22:15:08.950863+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:24.994361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989845+0000","last_change":"2024-09-11T22:15:07.626067+0000","last_active":"2024-09-11T22:15:08.989845+0000","last_peered":"2024-09-11T22:15:08.989845+0000","last_clean":"2024-09-11T22:15:08.989845+0000","last_became_active":"2024-09-11T22:15:07.625809+0000","last_became_peered":"2024-09-11T22:15:07.625809+0000","last_unstale":"2024-09-11T22:15:08.989845+0000","last_undegraded":"2024-09-11T22:15:08.989845+0000","last_fullsized":"2024-09-11T22:15:08.989845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:30.676667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615315+0000","last_change":"2024-09-11T22:15:06.597291+0000","last_active":"2024-09-11T22:15:08.615315+0000","last_peered":"2024-09-11T22:15:08.615315+0000","last_clean":"2024-09-11T22:15:08.615315+0000","last_became_active":"2024-09-11T22:15:06.596980+0000","last_became_peered":"2024-09-11T22:15:06.596980+0000","last_unstale":"2024-09-11T22:15:08.615315+0000","last_undegraded":"2024-09-11T22:15:08.615315+0000","last_fullsized":"2024-09-11T22:15:08.615315+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:30.688967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.990306+0000","last_change":"2024-09-11T22:15:07.621646+0000","last_active":"2024-09-11T22:15:08.990306+0000","last_peered":"2024-09-11T22:15:08.990306+0000","last_clean":"2024-09-11T22:15:08.990306+0000","last_became_active":"2024-09-11T22:15:07.621117+0000","last_became_peered":"2024-09-11T22:15:07.621117+0000","last_unstale":"2024-09-11T22:15:08.990306+0000","last_undegraded":"2024-09-11T22:15:08.990306+0000","last_fullsized":"2024-09-11T22:15:08.990306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:14.512180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"73'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950675+0000","last_change":"2024-09-11T22:15:06.598749+0000","last_active":"2024-09-11T22:15:08.950675+0000","last_peered":"2024-09-11T22:15:08.950675+0000","last_clean":"2024-09-11T22:15:08.950675+0000","last_became_active":"2024-09-11T22:15:06.597719+0000","last_became_peered":"2024-09-11T22:15:06.597719+0000","last_unstale":"2024-09-11T22:15:08.950675+0000","last_undegraded":"2024-09-11T22:15:08.950675+0000","last_fullsized":"2024-09-11T22:15:08.950675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:57.551356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989157+0000","last_change":"2024-09-11T22:15:07.623371+0000","last_active":"2024-09-11T22:15:08.989157+0000","last_peered":"2024-09-11T22:15:08.989157+0000","last_clean":"2024-09-11T22:15:08.989157+0000","last_became_active":"2024-09-11T22:15:07.622991+0000","last_became_peered":"2024-09-11T22:15:07.622991+0000","last_unstale":"2024-09-11T22:15:08.989157+0000","last_undegraded":"2024-09-11T22:15:08.989157+0000","last_fullsized":"2024-09-11T22:15:08.989157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:21.196278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989481+0000","last_change":"2024-09-11T22:15:06.597301+0000","last_active":"2024-09-11T22:15:08.989481+0000","last_peered":"2024-09-11T22:15:08.989481+0000","last_clean":"2024-09-11T22:15:08.989481+0000","last_became_active":"2024-09-11T22:15:06.597000+0000","last_became_peered":"2024-09-11T22:15:06.597000+0000","last_unstale":"2024-09-11T22:15:08.989481+0000","last_undegraded":"2024-09-11T22:15:08.989481+0000","last_fullsized":"2024-09-11T22:15:08.989481+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:57.888513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989834+0000","last_change":"2024-09-11T22:15:07.626542+0000","last_active":"2024-09-11T22:15:08.989834+0000","last_peered":"2024-09-11T22:15:08.989834+0000","last_clean":"2024-09-11T22:15:08.989834+0000","last_became_active":"2024-09-11T22:15:07.626252+0000","last_became_peered":"2024-09-11T22:15:07.626252+0000","last_unstale":"2024-09-11T22:15:08.989834+0000","last_undegraded":"2024-09-11T22:15:08.989834+0000","last_fullsized":"2024-09-11T22:15:08.989834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:30.662715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950812+0000","last_change":"2024-09-11T22:15:06.602028+0000","last_active":"2024-09-11T22:15:08.950812+0000","last_peered":"2024-09-11T22:15:08.950812+0000","last_clean":"2024-09-11T22:15:08.950812+0000","last_became_active":"2024-09-11T22:15:06.601723+0000","last_became_peered":"2024-09-11T22:15:06.601723+0000","last_unstale":"2024-09-11T22:15:08.950812+0000","last_undegraded":"2024-09-11T22:15:08.950812+0000","last_fullsized":"2024-09-11T22:15:08.950812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:08.901035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989476+0000","last_change":"2024-09-11T22:15:07.624503+0000","last_active":"2024-09-11T22:15:08.989476+0000","last_peered":"2024-09-11T22:15:08.989476+0000","last_clean":"2024-09-11T22:15:08.989476+0000","last_became_active":"2024-09-11T22:15:07.624218+0000","last_became_peered":"2024-09-11T22:15:07.624218+0000","last_unstale":"2024-09-11T22:15:08.989476+0000","last_undegraded":"2024-09-11T22:15:08.989476+0000","last_fullsized":"2024-09-11T22:15:08.989476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:41.357009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615706+0000","last_change":"2024-09-11T22:15:06.595704+0000","last_active":"2024-09-11T22:15:08.615706+0000","last_peered":"2024-09-11T22:15:08.615706+0000","last_clean":"2024-09-11T22:15:08.615706+0000","last_became_active":"2024-09-11T22:15:06.595424+0000","last_became_peered":"2024-09-11T22:15:06.595424+0000","last_unstale":"2024-09-11T22:15:08.615706+0000","last_undegraded":"2024-09-11T22:15:08.615706+0000","last_fullsized":"2024-09-11T22:15:08.615706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:32.303344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989526+0000","last_change":"2024-09-11T22:15:07.627761+0000","last_active":"2024-09-11T22:15:08.989526+0000","last_peered":"2024-09-11T22:15:08.989526+0000","last_clean":"2024-09-11T22:15:08.989526+0000","last_became_active":"2024-09-11T22:15:07.627501+0000","last_became_peered":"2024-09-11T22:15:07.627501+0000","last_unstale":"2024-09-11T22:15:08.989526+0000","last_undegraded":"2024-09-11T22:15:08.989526+0000","last_fullsized":"2024-09-11T22:15:08.989526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:56.279768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612424+0000","last_change":"2024-09-11T22:15:06.599176+0000","last_active":"2024-09-11T22:15:08.612424+0000","last_peered":"2024-09-11T22:15:08.612424+0000","last_clean":"2024-09-11T22:15:08.612424+0000","last_became_active":"2024-09-11T22:15:06.598884+0000","last_became_peered":"2024-09-11T22:15:06.598884+0000","last_unstale":"2024-09-11T22:15:08.612424+0000","last_undegraded":"2024-09-11T22:15:08.612424+0000","last_fullsized":"2024-09-11T22:15:08.612424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:53.406997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612778+0000","last_change":"2024-09-11T22:15:07.617307+0000","last_active":"2024-09-11T22:15:08.612778+0000","last_peered":"2024-09-11T22:15:08.612778+0000","last_clean":"2024-09-11T22:15:08.612778+0000","last_became_active":"2024-09-11T22:15:07.617023+0000","last_became_peered":"2024-09-11T22:15:07.617023+0000","last_unstale":"2024-09-11T22:15:08.612778+0000","last_undegraded":"2024-09-11T22:15:08.612778+0000","last_fullsized":"2024-09-11T22:15:08.612778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:52.279163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950937+0000","last_change":"2024-09-11T22:15:06.596640+0000","last_active":"2024-09-11T22:15:08.950937+0000","last_peered":"2024-09-11T22:15:08.950937+0000","last_clean":"2024-09-11T22:15:08.950937+0000","last_became_active":"2024-09-11T22:15:06.595275+0000","last_became_peered":"2024-09-11T22:15:06.595275+0000","last_unstale":"2024-09-11T22:15:08.950937+0000","last_undegraded":"2024-09-11T22:15:08.950937+0000","last_fullsized":"2024-09-11T22:15:08.950937+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:34.525374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.615860+0000","last_change":"2024-09-11T22:15:07.607459+0000","last_active":"2024-09-11T22:15:08.615860+0000","last_peered":"2024-09-11T22:15:08.615860+0000","last_clean":"2024-09-11T22:15:08.615860+0000","last_became_active":"2024-09-11T22:15:07.607170+0000","last_became_peered":"2024-09-11T22:15:07.607170+0000","last_unstale":"2024-09-11T22:15:08.615860+0000","last_undegraded":"2024-09-11T22:15:08.615860+0000","last_fullsized":"2024-09-11T22:15:08.615860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:38.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.616087+0000","last_change":"2024-09-11T22:15:06.603161+0000","last_active":"2024-09-11T22:15:08.616087+0000","last_peered":"2024-09-11T22:15:08.616087+0000","last_clean":"2024-09-11T22:15:08.616087+0000","last_became_active":"2024-09-11T22:15:06.602873+0000","last_became_peered":"2024-09-11T22:15:06.602873+0000","last_unstale":"2024-09-11T22:15:08.616087+0000","last_undegraded":"2024-09-11T22:15:08.616087+0000","last_fullsized":"2024-09-11T22:15:08.616087+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:03.957361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989478+0000","last_change":"2024-09-11T22:15:07.629980+0000","last_active":"2024-09-11T22:15:08.989478+0000","last_peered":"2024-09-11T22:15:08.989478+0000","last_clean":"2024-09-11T22:15:08.989478+0000","last_became_active":"2024-09-11T22:15:07.629736+0000","last_became_peered":"2024-09-11T22:15:07.629736+0000","last_unstale":"2024-09-11T22:15:08.989478+0000","last_undegraded":"2024-09-11T22:15:08.989478+0000","last_fullsized":"2024-09-11T22:15:08.989478+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:17.563533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989202+0000","last_change":"2024-09-11T22:15:06.600505+0000","last_active":"2024-09-11T22:15:08.989202+0000","last_peered":"2024-09-11T22:15:08.989202+0000","last_clean":"2024-09-11T22:15:08.989202+0000","last_became_active":"2024-09-11T22:15:06.600096+0000","last_became_peered":"2024-09-11T22:15:06.600096+0000","last_unstale":"2024-09-11T22:15:08.989202+0000","last_undegraded":"2024-09-11T22:15:08.989202+0000","last_fullsized":"2024-09-11T22:15:08.989202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:48.520695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989793+0000","last_change":"2024-09-11T22:15:07.624316+0000","last_active":"2024-09-11T22:15:08.989793+0000","last_peered":"2024-09-11T22:15:08.989793+0000","last_clean":"2024-09-11T22:15:08.989793+0000","last_became_active":"2024-09-11T22:15:07.623800+0000","last_became_peered":"2024-09-11T22:15:07.623800+0000","last_unstale":"2024-09-11T22:15:08.989793+0000","last_undegraded":"2024-09-11T22:15:08.989793+0000","last_fullsized":"2024-09-11T22:15:08.989793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:24.619044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.612643+0000","last_change":"2024-09-11T22:15:06.595834+0000","last_active":"2024-09-11T22:15:08.612643+0000","last_peered":"2024-09-11T22:15:08.612643+0000","last_clean":"2024-09-11T22:15:08.612643+0000","last_became_active":"2024-09-11T22:15:06.595547+0000","last_became_peered":"2024-09-11T22:15:06.595547+0000","last_unstale":"2024-09-11T22:15:08.612643+0000","last_undegraded":"2024-09-11T22:15:08.612643+0000","last_fullsized":"2024-09-11T22:15:08.612643+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:38.263891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989282+0000","last_change":"2024-09-11T22:15:07.619452+0000","last_active":"2024-09-11T22:15:08.989282+0000","last_peered":"2024-09-11T22:15:08.989282+0000","last_clean":"2024-09-11T22:15:08.989282+0000","last_became_active":"2024-09-11T22:15:07.618679+0000","last_became_peered":"2024-09-11T22:15:07.618679+0000","last_unstale":"2024-09-11T22:15:08.989282+0000","last_undegraded":"2024-09-11T22:15:08.989282+0000","last_fullsized":"2024-09-11T22:15:08.989282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:55.601100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989051+0000","last_change":"2024-09-11T22:15:06.595551+0000","last_active":"2024-09-11T22:15:08.989051+0000","last_peered":"2024-09-11T22:15:08.989051+0000","last_clean":"2024-09-11T22:15:08.989051+0000","last_became_active":"2024-09-11T22:15:06.595301+0000","last_became_peered":"2024-09-11T22:15:06.595301+0000","last_unstale":"2024-09-11T22:15:08.989051+0000","last_undegraded":"2024-09-11T22:15:08.989051+0000","last_fullsized":"2024-09-11T22:15:08.989051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:33.465401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950580+0000","last_change":"2024-09-11T22:15:07.625363+0000","last_active":"2024-09-11T22:15:08.950580+0000","last_peered":"2024-09-11T22:15:08.950580+0000","last_clean":"2024-09-11T22:15:08.950580+0000","last_became_active":"2024-09-11T22:15:07.624697+0000","last_became_peered":"2024-09-11T22:15:07.624697+0000","last_unstale":"2024-09-11T22:15:08.950580+0000","last_undegraded":"2024-09-11T22:15:08.950580+0000","last_fullsized":"2024-09-11T22:15:08.950580+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:09.058151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989011+0000","last_change":"2024-09-11T22:15:06.589248+0000","last_active":"2024-09-11T22:15:08.989011+0000","last_peered":"2024-09-11T22:15:08.989011+0000","last_clean":"2024-09-11T22:15:08.989011+0000","last_became_active":"2024-09-11T22:15:06.588990+0000","last_became_peered":"2024-09-11T22:15:06.588990+0000","last_unstale":"2024-09-11T22:15:08.989011+0000","last_undegraded":"2024-09-11T22:15:08.989011+0000","last_fullsized":"2024-09-11T22:15:08.989011+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:25.264536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989285+0000","last_change":"2024-09-11T22:15:07.621584+0000","last_active":"2024-09-11T22:15:08.989285+0000","last_peered":"2024-09-11T22:15:08.989285+0000","last_clean":"2024-09-11T22:15:08.989285+0000","last_became_active":"2024-09-11T22:15:07.621309+0000","last_became_peered":"2024-09-11T22:15:07.621309+0000","last_unstale":"2024-09-11T22:15:08.989285+0000","last_undegraded":"2024-09-11T22:15:08.989285+0000","last_fullsized":"2024-09-11T22:15:08.989285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:16.481227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.614930+0000","last_change":"2024-09-11T22:15:06.594165+0000","last_active":"2024-09-11T22:15:08.614930+0000","last_peered":"2024-09-11T22:15:08.614930+0000","last_clean":"2024-09-11T22:15:08.614930+0000","last_became_active":"2024-09-11T22:15:06.593911+0000","last_became_peered":"2024-09-11T22:15:06.593911+0000","last_unstale":"2024-09-11T22:15:08.614930+0000","last_undegraded":"2024-09-11T22:15:08.614930+0000","last_fullsized":"2024-09-11T22:15:08.614930+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:15.476717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950375+0000","last_change":"2024-09-11T22:15:07.618801+0000","last_active":"2024-09-11T22:15:08.950375+0000","last_peered":"2024-09-11T22:15:08.950375+0000","last_clean":"2024-09-11T22:15:08.950375+0000","last_became_active":"2024-09-11T22:15:07.618516+0000","last_became_peered":"2024-09-11T22:15:07.618516+0000","last_unstale":"2024-09-11T22:15:08.950375+0000","last_undegraded":"2024-09-11T22:15:08.950375+0000","last_fullsized":"2024-09-11T22:15:08.950375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:14.512180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950830+0000","last_change":"2024-09-11T22:15:06.598668+0000","last_active":"2024-09-11T22:15:08.950830+0000","last_peered":"2024-09-11T22:15:08.950830+0000","last_clean":"2024-09-11T22:15:08.950830+0000","last_became_active":"2024-09-11T22:15:06.598188+0000","last_became_peered":"2024-09-11T22:15:06.598188+0000","last_unstale":"2024-09-11T22:15:08.950830+0000","last_undegraded":"2024-09-11T22:15:08.950830+0000","last_fullsized":"2024-09-11T22:15:08.950830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:53.861223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989684+0000","last_change":"2024-09-11T22:15:07.628459+0000","last_active":"2024-09-11T22:15:08.989684+0000","last_peered":"2024-09-11T22:15:08.989684+0000","last_clean":"2024-09-11T22:15:08.989684+0000","last_became_active":"2024-09-11T22:15:07.628201+0000","last_became_peered":"2024-09-11T22:15:07.628201+0000","last_unstale":"2024-09-11T22:15:08.989684+0000","last_undegraded":"2024-09-11T22:15:08.989684+0000","last_fullsized":"2024-09-11T22:15:08.989684+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:06.578025+0000","last_clean_scrub_stamp":"2024-09-11T22:15:06.578025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:27.058146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"73'2","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.950623+0000","last_change":"2024-09-11T22:15:06.599378+0000","last_active":"2024-09-11T22:15:08.950623+0000","last_peered":"2024-09-11T22:15:08.950623+0000","last_clean":"2024-09-11T22:15:08.950623+0000","last_became_active":"2024-09-11T22:15:06.599051+0000","last_became_peered":"2024-09-11T22:15:06.599051+0000","last_unstale":"2024-09-11T22:15:08.950623+0000","last_undegraded":"2024-09-11T22:15:08.950623+0000","last_fullsized":"2024-09-11T22:15:08.950623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:05.573516+0000","last_clean_scrub_stamp":"2024-09-11T22:15:05.573516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:49.135671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-11T22:15:08.989193+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:15:08.989193+0000","last_peered":"2024-09-11T22:15:08.989193+0000","last_clean":"2024-09-11T22:15:08.989193+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:15:08.989193+0000","last_undegraded":"2024-09-11T22:15:08.989193+0000","last_fullsized":"2024-09-11T22:15:08.989193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36236,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335604,"statfs":{"total":96636764160,"available":96599658496,"internally_reserved":0,"allocated":901120,"data_stored":380409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":897024,"data_stored":380407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":897024,"data_stored":380387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":888832,"data_stored":374129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":913408,"data_stored":382545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40964,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330876,"statfs":{"total":96636764160,"available":96594817024,"internally_reserved":0,"allocated":1486848,"data_stored":970685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36812,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335028,"statfs":{"total":96636764160,"available":96599068672,"internally_reserved":0,"allocated":1495040,"data_stored":971301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44552,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327288,"statfs":{"total":96636764160,"available":96591142912,"internally_reserved":0,"allocated":905216,"data_stored":381929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:15:15.341 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:15:15.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T22:15:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.487+0000 7f9fb8465640 1 Processor -- start 2024-09-11T22:15:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.488+0000 7f9fb8465640 1 -- start start 2024-09-11T22:15:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.489+0000 7f9fb8465640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb00d18a0 0x7f9fb00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.489+0000 7f9fb8465640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fb00d3a30 0x7f9fb00b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.489+0000 7f9fb8465640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fb00cfa80 con 0x7f9fb015e870 2024-09-11T22:15:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.489+0000 7f9fb8465640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9fb00d3ea0 con 0x7f9fb00d3a30 2024-09-11T22:15:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.489+0000 7f9fb8465640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb00d40d0 con 0x7f9fb00d18a0 2024-09-11T22:15:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.489+0000 7f9fb6a02640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fb00d3a30 0x7f9fb00b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.489+0000 7f9fb6a02640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fb00d3a30 0x7f9fb00b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50168/0 (socket says 172.21.15.50:50168) 2024-09-11T22:15:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.489+0000 7f9fb6a02640 1 -- 172.21.15.50:0/3475524350 learned_addr learned my addr 172.21.15.50:0/3475524350 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.489+0000 7f9fb5a00640 1 --2- 172.21.15.50:0/3475524350 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb00d18a0 0x7f9fb00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.489+0000 7f9fb6a02640 1 -- 172.21.15.50:0/3475524350 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb00d18a0 msgr2=0x7f9fb00d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.489+0000 7f9fb6a02640 1 --2- 172.21.15.50:0/3475524350 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb00d18a0 0x7f9fb00d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.489+0000 7f9fb6a02640 1 -- 172.21.15.50:0/3475524350 >> v1:172.21.15.77:6789/0 conn(0x7f9fb015e870 legacy=0x7f9fb00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.489+0000 7f9fb6a02640 1 -- 172.21.15.50:0/3475524350 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb00d43b0 con 0x7f9fb00d3a30 2024-09-11T22:15:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.490+0000 7f9fb6a02640 1 --2- 172.21.15.50:0/3475524350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb00d3a30 0x7f9fb00b8400 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009e50 tx=0x7f9fa002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1e069974124897 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.490+0000 7f9fb51ff640 1 -- 172.21.15.50:0/3475524350 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0036070 con 0x7f9fb00d3a30 2024-09-11T22:15:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.490+0000 7f9fb51ff640 1 -- 172.21.15.50:0/3475524350 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa0031600 con 0x7f9fb00d3a30 2024-09-11T22:15:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.490+0000 7f9fb51ff640 1 -- 172.21.15.50:0/3475524350 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa00319d0 con 0x7f9fb00d3a30 2024-09-11T22:15:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.491+0000 7f9fb8465640 1 -- 172.21.15.50:0/3475524350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb00d3a30 msgr2=0x7f9fb00b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.491+0000 7f9fb8465640 1 --2- 172.21.15.50:0/3475524350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb00d3a30 0x7f9fb00b8400 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009e50 tx=0x7f9fa002a710 comp rx=0 tx=0).stop 2024-09-11T22:15:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.491+0000 7f9fb8465640 1 -- 172.21.15.50:0/3475524350 shutdown_connections 2024-09-11T22:15:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.491+0000 7f9fb8465640 1 --2- 172.21.15.50:0/3475524350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb00d3a30 0x7f9fb00b8400 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.491+0000 7f9fb8465640 1 --2- 172.21.15.50:0/3475524350 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb00d18a0 0x7f9fb00d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.491+0000 7f9fb8465640 1 -- 172.21.15.50:0/3475524350 >> 172.21.15.50:0/3475524350 conn(0x7f9fb00727a0 msgr2=0x7f9fb00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.491+0000 7f9fb8465640 1 -- 172.21.15.50:0/3475524350 shutdown_connections 2024-09-11T22:15:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.491+0000 7f9fb8465640 1 -- 172.21.15.50:0/3475524350 wait complete. 2024-09-11T22:15:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.492+0000 7f9fb8465640 1 Processor -- start 2024-09-11T22:15:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.492+0000 7f9fb8465640 1 -- start start 2024-09-11T22:15:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.493+0000 7f9fb8465640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb00d18a0 0x7f9fb00cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.493+0000 7f9fb8465640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fb00d3a30 0x7f9fb0158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.493+0000 7f9fb8465640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb015e870 0x7f9fb0159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.493+0000 7f9fb8465640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb015ec50 con 0x7f9fb015e870 2024-09-11T22:15:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.493+0000 7f9fb8465640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb00b7ee0 con 0x7f9fb00d3a30 2024-09-11T22:15:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.493+0000 7f9fb8465640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb00b78b0 con 0x7f9fb00d18a0 2024-09-11T22:15:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.493+0000 7f9fb6a02640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb015e870 0x7f9fb0159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.493+0000 7f9fb6a02640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb015e870 0x7f9fb0159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50178/0 (socket says 172.21.15.50:50178) 2024-09-11T22:15:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.493+0000 7f9fb6a02640 1 -- 172.21.15.50:0/501632541 learned_addr learned my addr 172.21.15.50:0/501632541 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.493+0000 7f9fb5a00640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fb00d3a30 0x7f9fb0158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.493+0000 7f9fb6201640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb00d18a0 0x7f9fb00cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.494+0000 7f9fb6a02640 1 -- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb00d18a0 msgr2=0x7f9fb00cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.494+0000 7f9fb6a02640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb00d18a0 0x7f9fb00cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.494+0000 7f9fb6a02640 1 -- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fb00d3a30 msgr2=0x7f9fb0158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.494+0000 7f9fb6a02640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fb00d3a30 0x7f9fb0158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.494+0000 7f9fb6a02640 1 -- 172.21.15.50:0/501632541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb00c8990 con 0x7f9fb015e870 2024-09-11T22:15:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.494+0000 7f9fb6201640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb00d18a0 0x7f9fb00cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.494+0000 7f9fb6a02640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb015e870 0x7f9fb0159b30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0034040 tx=0x7f9fa0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:15.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.494+0000 7f9faeffd640 1 -- 172.21.15.50:0/501632541 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0036050 con 0x7f9fb015e870 2024-09-11T22:15:15.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.494+0000 7f9faeffd640 1 -- 172.21.15.50:0/501632541 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa0042070 con 0x7f9fb015e870 2024-09-11T22:15:15.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.494+0000 7f9fb8465640 1 -- 172.21.15.50:0/501632541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb00c8c70 con 0x7f9fb015e870 2024-09-11T22:15:15.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.494+0000 7f9faeffd640 1 -- 172.21.15.50:0/501632541 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0009510 con 0x7f9fb015e870 2024-09-11T22:15:15.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.494+0000 7f9fb8465640 1 -- 172.21.15.50:0/501632541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb00c9230 con 0x7f9fb015e870 2024-09-11T22:15:15.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.495+0000 7f9fb8465640 1 -- 172.21.15.50:0/501632541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb00c9430 con 0x7f9fb015e870 2024-09-11T22:15:15.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.495+0000 7f9faeffd640 1 -- 172.21.15.50:0/501632541 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9fa0007bf0 con 0x7f9fb015e870 2024-09-11T22:15:15.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.496+0000 7f9faeffd640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f9c06be30 0x7f9f9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.496+0000 7f9faeffd640 1 -- 172.21.15.50:0/501632541 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f9fa00abc80 con 0x7f9fb015e870 2024-09-11T22:15:15.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.496+0000 7f9fb6201640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f9c06be30 0x7f9f9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.497+0000 7f9fb6201640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f9c06be30 0x7f9f9c06e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8001680 tx=0x7f9fa8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:15.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.500+0000 7f9faeffd640 1 -- 172.21.15.50:0/501632541 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9fb00c9430 con 0x7f9fb015e870 2024-09-11T22:15:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.745+0000 7f9fb8465640 1 -- 172.21.15.50:0/501632541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9fb00d34f0 con 0x7f9fb015e870 2024-09-11T22:15:15.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.747+0000 7f9faeffd640 1 -- 172.21.15.50:0/501632541 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f9fa007a630 con 0x7f9fb015e870 2024-09-11T22:15:15.748 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:15:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:15:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-09-11T22:15:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-09-11T22:15:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T22:15:15.749 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-11T22:15:15.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.749+0000 7f9fb8465640 1 -- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f9c06be30 msgr2=0x7f9f9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.749+0000 7f9fb8465640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f9c06be30 0x7f9f9c06e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8001680 tx=0x7f9fa8009040 comp rx=0 tx=0).stop 2024-09-11T22:15:15.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.749+0000 7f9fb8465640 1 -- 172.21.15.50:0/501632541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb015e870 msgr2=0x7f9fb0159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.749+0000 7f9fb8465640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb015e870 0x7f9fb0159b30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0034040 tx=0x7f9fa0004a40 comp rx=0 tx=0).stop 2024-09-11T22:15:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.749+0000 7f9fb8465640 1 -- 172.21.15.50:0/501632541 shutdown_connections 2024-09-11T22:15:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.749+0000 7f9fb8465640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f9c06be30 0x7f9f9c06e2f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.749+0000 7f9fb8465640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb015e870 0x7f9fb0159b30 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.749+0000 7f9fb8465640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fb00d3a30 0x7f9fb0158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.749+0000 7f9fb8465640 1 --2- 172.21.15.50:0/501632541 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb00d18a0 0x7f9fb00cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.749+0000 7f9fb8465640 1 -- 172.21.15.50:0/501632541 >> 172.21.15.50:0/501632541 conn(0x7f9fb00727a0 msgr2=0x7f9fb00b6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.750+0000 7f9fb8465640 1 -- 172.21.15.50:0/501632541 shutdown_connections 2024-09-11T22:15:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.750+0000 7f9fb8465640 1 -- 172.21.15.50:0/501632541 wait complete. 2024-09-11T22:15:15.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:15.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.863+0000 7f9fd3b18640 1 Processor -- start 2024-09-11T22:15:15.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.863+0000 7f9fd3b18640 1 -- start start 2024-09-11T22:15:15.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd3b18640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9fcc15e840 0x7f9fcc0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd3b18640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fcc0cdd50 0x7f9fcc0cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd3b18640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fcc0ce5f0 con 0x7f9fcc0cf3b0 2024-09-11T22:15:15.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd3b18640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9fcc06c240 con 0x7f9fcc0cdd50 2024-09-11T22:15:15.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd3b18640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9fcc0d0470 con 0x7f9fcc15e840 2024-09-11T22:15:15.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd10b3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fcc0cdd50 0x7f9fcc0cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd10b3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fcc0cdd50 0x7f9fcc0cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50180/0 (socket says 172.21.15.50:50180) 2024-09-11T22:15:15.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd20b5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9fcc0cf3b0 0x7f9fcc0d0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56400/0 (socket says 172.21.15.50:56400) 2024-09-11T22:15:15.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd10b3640 1 -- 172.21.15.50:0/3918269657 learned_addr learned my addr 172.21.15.50:0/3918269657 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:15.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd10b3640 1 -- 172.21.15.50:0/3918269657 >> v2:172.21.15.77:3300/0 conn(0x7f9fcc15e840 msgr2=0x7f9fcc0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:15.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd10b3640 1 --2- 172.21.15.50:0/3918269657 >> v2:172.21.15.77:3300/0 conn(0x7f9fcc15e840 0x7f9fcc0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd10b3640 1 -- 172.21.15.50:0/3918269657 >> v1:172.21.15.50:6789/0 conn(0x7f9fcc0cf3b0 legacy=0x7f9fcc0d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd08b2640 1 -- 172.21.15.50:0/3918269657 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1312611408 0 0) 0x7f9fcc0ce5f0 con 0x7f9fcc0cf3b0 2024-09-11T22:15:15.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.864+0000 7f9fd10b3640 1 -- 172.21.15.50:0/3918269657 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fcc0ce310 con 0x7f9fcc0cdd50 2024-09-11T22:15:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.865+0000 7f9fd10b3640 1 --2- 172.21.15.50:0/3918269657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fcc0cdd50 0x7f9fcc0cee70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0694b0 tx=0x7f9fc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c3754f9987f07b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.865+0000 7f9fd08b2640 1 -- 172.21.15.50:0/3918269657 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0037070 con 0x7f9fcc0cdd50 2024-09-11T22:15:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.865+0000 7f9fd08b2640 1 -- 172.21.15.50:0/3918269657 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc0032440 con 0x7f9fcc0cdd50 2024-09-11T22:15:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.865+0000 7f9fd08b2640 1 -- 172.21.15.50:0/3918269657 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0032810 con 0x7f9fcc0cdd50 2024-09-11T22:15:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.865+0000 7f9fd3b18640 1 -- 172.21.15.50:0/3918269657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fcc0cdd50 msgr2=0x7f9fcc0cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.865+0000 7f9fd3b18640 1 --2- 172.21.15.50:0/3918269657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fcc0cdd50 0x7f9fcc0cee70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0694b0 tx=0x7f9fc002a270 comp rx=0 tx=0).stop 2024-09-11T22:15:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.866+0000 7f9fd3b18640 1 -- 172.21.15.50:0/3918269657 shutdown_connections 2024-09-11T22:15:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.866+0000 7f9fd3b18640 1 --2- 172.21.15.50:0/3918269657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fcc0cdd50 0x7f9fcc0cee70 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.866+0000 7f9fd3b18640 1 --2- 172.21.15.50:0/3918269657 >> v2:172.21.15.77:3300/0 conn(0x7f9fcc15e840 0x7f9fcc0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.866+0000 7f9fd3b18640 1 -- 172.21.15.50:0/3918269657 >> 172.21.15.50:0/3918269657 conn(0x7f9fcc0b4150 msgr2=0x7f9fcc0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.866+0000 7f9fd3b18640 1 -- 172.21.15.50:0/3918269657 shutdown_connections 2024-09-11T22:15:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.866+0000 7f9fd3b18640 1 -- 172.21.15.50:0/3918269657 wait complete. 2024-09-11T22:15:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.867+0000 7f9fd3b18640 1 Processor -- start 2024-09-11T22:15:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.867+0000 7f9fd3b18640 1 -- start start 2024-09-11T22:15:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd3b18640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fcc0cdd50 0x7f9fcc15ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd3b18640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fcc0cf3b0 0x7f9fcc1f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd3b18640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fcc15e840 0x7f9fcc1499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd3b18640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc15ec20 con 0x7f9fcc15e840 2024-09-11T22:15:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd3b18640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc06bed0 con 0x7f9fcc0cdd50 2024-09-11T22:15:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd3b18640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9fcc15eda0 con 0x7f9fcc0cf3b0 2024-09-11T22:15:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd20b5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fcc15e840 0x7f9fcc1499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd20b5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fcc15e840 0x7f9fcc1499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50190/0 (socket says 172.21.15.50:50190) 2024-09-11T22:15:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd20b5640 1 -- 172.21.15.50:0/1292969933 learned_addr learned my addr 172.21.15.50:0/1292969933 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd18b4640 1 --2- 172.21.15.50:0/1292969933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fcc0cdd50 0x7f9fcc15ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd20b5640 1 -- 172.21.15.50:0/1292969933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fcc0cf3b0 msgr2=0x7f9fcc1f4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd20b5640 1 --2- 172.21.15.50:0/1292969933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fcc0cf3b0 0x7f9fcc1f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd20b5640 1 -- 172.21.15.50:0/1292969933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fcc0cdd50 msgr2=0x7f9fcc15ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd20b5640 1 --2- 172.21.15.50:0/1292969933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fcc0cdd50 0x7f9fcc15ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd20b5640 1 -- 172.21.15.50:0/1292969933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fcc15c250 con 0x7f9fcc15e840 2024-09-11T22:15:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd20b5640 1 --2- 172.21.15.50:0/1292969933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fcc15e840 0x7f9fcc1499b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400c450 tx=0x7f9fc400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fca7fc640 1 -- 172.21.15.50:0/1292969933 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4018070 con 0x7f9fcc15e840 2024-09-11T22:15:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fca7fc640 1 -- 172.21.15.50:0/1292969933 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc4007500 con 0x7f9fcc15e840 2024-09-11T22:15:15.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd3b18640 1 -- 172.21.15.50:0/1292969933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fcc0c9d10 con 0x7f9fcc15e840 2024-09-11T22:15:15.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fca7fc640 1 -- 172.21.15.50:0/1292969933 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4004a20 con 0x7f9fcc15e840 2024-09-11T22:15:15.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.868+0000 7f9fd3b18640 1 -- 172.21.15.50:0/1292969933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fcc15c4f0 con 0x7f9fcc15e840 2024-09-11T22:15:15.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.869+0000 7f9fd3b18640 1 -- 172.21.15.50:0/1292969933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fcc075770 con 0x7f9fcc15e840 2024-09-11T22:15:15.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.870+0000 7f9fca7fc640 1 -- 172.21.15.50:0/1292969933 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9fc401b070 con 0x7f9fcc15e840 2024-09-11T22:15:15.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.870+0000 7f9fca7fc640 1 --2- 172.21.15.50:0/1292969933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9fb806be30 0x7f9fb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:15.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.870+0000 7f9fca7fc640 1 -- 172.21.15.50:0/1292969933 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f9fc408a060 con 0x7f9fcc15e840 2024-09-11T22:15:15.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.871+0000 7f9fd18b4640 1 --2- 172.21.15.50:0/1292969933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9fb806be30 0x7f9fb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:15.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.871+0000 7f9fd18b4640 1 --2- 172.21.15.50:0/1292969933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9fb806be30 0x7f9fb806e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc007dc0 tx=0x7f9fbc0072f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:15.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:15.874+0000 7f9fca7fc640 1 -- 172.21.15.50:0/1292969933 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9fc4058aa0 con 0x7f9fcc15e840 2024-09-11T22:15:16.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.089+0000 7f9fd3b18640 1 -- 172.21.15.50:0/1292969933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fcc0ce5f0 con 0x7f9fcc15e840 2024-09-11T22:15:16.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.089+0000 7f9fca7fc640 1 -- 172.21.15.50:0/1292969933 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f9fc40583a0 con 0x7f9fcc15e840 2024-09-11T22:15:16.091 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:16.091 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":47,"btime":"2024-09-11T22:15:09:616633+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6151,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1710208890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1710208890},{"type":"v1","addr":"172.21.15.50:6835","nonce":1710208890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/784761109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":784761109},{"type":"v1","addr":"172.21.15.77:6836","nonce":784761109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6160,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1115358060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1115358060},{"type":"v1","addr":"172.21.15.77:6837","nonce":1115358060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:06.945196+0000","modified":"2024-09-11T22:15:08.958948+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6648},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6648":{"gid":6648,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/4265727513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4265727513},{"type":"v1","addr":"172.21.15.50:6834","nonce":4265727513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6648,"qdb_cluster":[6648]},"id":5}]} 2024-09-11T22:15:16.091 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 47 2024-09-11T22:15:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.092+0000 7f9fd3b18640 1 -- 172.21.15.50:0/1292969933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9fb806be30 msgr2=0x7f9fb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.092+0000 7f9fd3b18640 1 --2- 172.21.15.50:0/1292969933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9fb806be30 0x7f9fb806e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc007dc0 tx=0x7f9fbc0072f0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.092+0000 7f9fd3b18640 1 -- 172.21.15.50:0/1292969933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fcc15e840 msgr2=0x7f9fcc1499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.092+0000 7f9fd3b18640 1 --2- 172.21.15.50:0/1292969933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fcc15e840 0x7f9fcc1499b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400c450 tx=0x7f9fc400c910 comp rx=0 tx=0).stop 2024-09-11T22:15:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.092+0000 7f9fd3b18640 1 -- 172.21.15.50:0/1292969933 shutdown_connections 2024-09-11T22:15:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.092+0000 7f9fd3b18640 1 --2- 172.21.15.50:0/1292969933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9fb806be30 0x7f9fb806e2f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.092+0000 7f9fd3b18640 1 --2- 172.21.15.50:0/1292969933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fcc0cf3b0 0x7f9fcc1f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.092+0000 7f9fd3b18640 1 --2- 172.21.15.50:0/1292969933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fcc15e840 0x7f9fcc1499b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.092+0000 7f9fd3b18640 1 --2- 172.21.15.50:0/1292969933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fcc0cdd50 0x7f9fcc15ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.092+0000 7f9fd3b18640 1 -- 172.21.15.50:0/1292969933 >> 172.21.15.50:0/1292969933 conn(0x7f9fcc0b4150 msgr2=0x7f9fcc070a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:16.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.092+0000 7f9fd3b18640 1 -- 172.21.15.50:0/1292969933 shutdown_connections 2024-09-11T22:15:16.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.092+0000 7f9fd3b18640 1 -- 172.21.15.50:0/1292969933 wait complete. 2024-09-11T22:15:16.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:15:06.945196+0000', 'modified': '2024-09-11T22:15:08.958948+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6648}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6648': {'gid': 6648, 'name': 'a', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6834/4265727513', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 4265727513}, {'type': 'v1', 'addr': '172.21.15.50:6834', 'nonce': 4265727513}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6648, 'qdb_cluster': [6648]} 2024-09-11T22:15:16.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:15:16.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T22:15:16.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.613+0000 7fe75de37640 1 Processor -- start 2024-09-11T22:15:16.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.613+0000 7fe75de37640 1 -- start start 2024-09-11T22:15:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.614+0000 7fe75de37640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe75815c240 0x7fe7580b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.614+0000 7fe75de37640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7580728e0 0x7fe758072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.614+0000 7fe75de37640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe758073230 con 0x7fe7580735a0 2024-09-11T22:15:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.614+0000 7fe75de37640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe75815c620 con 0x7fe7580728e0 2024-09-11T22:15:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.614+0000 7fe75de37640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe75815f2b0 con 0x7fe75815c240 2024-09-11T22:15:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.614+0000 7fe757fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7580728e0 0x7fe758072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.614+0000 7fe757fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7580728e0 0x7fe758072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50196/0 (socket says 172.21.15.50:50196) 2024-09-11T22:15:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.614+0000 7fe757fff640 1 -- 172.21.15.50:0/4013717027 learned_addr learned my addr 172.21.15.50:0/4013717027 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.614+0000 7fe7577fe640 1 --2- 172.21.15.50:0/4013717027 >> v2:172.21.15.77:3300/0 conn(0x7fe75815c240 0x7fe7580b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.614+0000 7fe757fff640 1 -- 172.21.15.50:0/4013717027 >> v2:172.21.15.77:3300/0 conn(0x7fe75815c240 msgr2=0x7fe7580b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.614+0000 7fe757fff640 1 --2- 172.21.15.50:0/4013717027 >> v2:172.21.15.77:3300/0 conn(0x7fe75815c240 0x7fe7580b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.614+0000 7fe757fff640 1 -- 172.21.15.50:0/4013717027 >> v1:172.21.15.77:6789/0 conn(0x7fe7580735a0 legacy=0x7fe75815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.614+0000 7fe757fff640 1 -- 172.21.15.50:0/4013717027 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75815f560 con 0x7fe7580728e0 2024-09-11T22:15:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.615+0000 7fe757fff640 1 --2- 172.21.15.50:0/4013717027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580728e0 0x7fe758072cf0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe758069480 tx=0x7fe75002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0378d63bd6b7acb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.615+0000 7fe7567fc640 1 -- 172.21.15.50:0/4013717027 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750036070 con 0x7fe7580728e0 2024-09-11T22:15:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.615+0000 7fe7567fc640 1 -- 172.21.15.50:0/4013717027 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe750031600 con 0x7fe7580728e0 2024-09-11T22:15:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.615+0000 7fe7567fc640 1 -- 172.21.15.50:0/4013717027 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7500319d0 con 0x7fe7580728e0 2024-09-11T22:15:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.616+0000 7fe75de37640 1 -- 172.21.15.50:0/4013717027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580728e0 msgr2=0x7fe758072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.616+0000 7fe75de37640 1 --2- 172.21.15.50:0/4013717027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580728e0 0x7fe758072cf0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe758069480 tx=0x7fe75002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.616+0000 7fe75de37640 1 -- 172.21.15.50:0/4013717027 shutdown_connections 2024-09-11T22:15:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.616+0000 7fe75de37640 1 --2- 172.21.15.50:0/4013717027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580728e0 0x7fe758072cf0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.616+0000 7fe75de37640 1 --2- 172.21.15.50:0/4013717027 >> v2:172.21.15.77:3300/0 conn(0x7fe75815c240 0x7fe7580b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.616+0000 7fe75de37640 1 -- 172.21.15.50:0/4013717027 >> 172.21.15.50:0/4013717027 conn(0x7fe7580b2bd0 msgr2=0x7fe7580b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.616+0000 7fe75de37640 1 -- 172.21.15.50:0/4013717027 shutdown_connections 2024-09-11T22:15:16.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.616+0000 7fe75de37640 1 -- 172.21.15.50:0/4013717027 wait complete. 2024-09-11T22:15:16.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.617+0000 7fe75de37640 1 Processor -- start 2024-09-11T22:15:16.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.617+0000 7fe75de37640 1 -- start start 2024-09-11T22:15:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe75de37640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7580728e0 0x7fe75815e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe75de37640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580735a0 0x7fe7580cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe75de37640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe75815c240 0x7fe758160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe75de37640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe7580b3f70 con 0x7fe7580735a0 2024-09-11T22:15:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe75de37640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe75815fb20 con 0x7fe7580728e0 2024-09-11T22:15:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe75de37640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe7580b4250 con 0x7fe75815c240 2024-09-11T22:15:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe756ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580735a0 0x7fe7580cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe756ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580735a0 0x7fe7580cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50210/0 (socket says 172.21.15.50:50210) 2024-09-11T22:15:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe756ffd640 1 -- 172.21.15.50:0/2259036933 learned_addr learned my addr 172.21.15.50:0/2259036933 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe756ffd640 1 -- 172.21.15.50:0/2259036933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe75815c240 msgr2=0x7fe758160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe756ffd640 1 --2- 172.21.15.50:0/2259036933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe75815c240 0x7fe758160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe756ffd640 1 -- 172.21.15.50:0/2259036933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7580728e0 msgr2=0x7fe75815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe756ffd640 1 --2- 172.21.15.50:0/2259036933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7580728e0 0x7fe75815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.618+0000 7fe756ffd640 1 -- 172.21.15.50:0/2259036933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7580cf330 con 0x7fe7580735a0 2024-09-11T22:15:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.619+0000 7fe756ffd640 1 --2- 172.21.15.50:0/2259036933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580735a0 0x7fe7580cf690 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00c440 tx=0x7fe74c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.619+0000 7fe73ffff640 1 -- 172.21.15.50:0/2259036933 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c017070 con 0x7fe7580735a0 2024-09-11T22:15:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.619+0000 7fe73ffff640 1 -- 172.21.15.50:0/2259036933 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74c0035f0 con 0x7fe7580735a0 2024-09-11T22:15:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.619+0000 7fe75de37640 1 -- 172.21.15.50:0/2259036933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7580cdb20 con 0x7fe7580735a0 2024-09-11T22:15:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.619+0000 7fe73ffff640 1 -- 172.21.15.50:0/2259036933 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0039e0 con 0x7fe7580735a0 2024-09-11T22:15:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.619+0000 7fe75de37640 1 -- 172.21.15.50:0/2259036933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7580ce0e0 con 0x7fe7580735a0 2024-09-11T22:15:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.620+0000 7fe73ffff640 1 -- 172.21.15.50:0/2259036933 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe74c01a070 con 0x7fe7580735a0 2024-09-11T22:15:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.621+0000 7fe73ffff640 1 --2- 172.21.15.50:0/2259036933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe74406be60 0x7fe74406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.621+0000 7fe73ffff640 1 -- 172.21.15.50:0/2259036933 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7fe74c08a1f0 con 0x7fe7580735a0 2024-09-11T22:15:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.621+0000 7fe7577fe640 1 --2- 172.21.15.50:0/2259036933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe74406be60 0x7fe74406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.622+0000 7fe7577fe640 1 --2- 172.21.15.50:0/2259036933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe74406be60 0x7fe74406e320 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe74800a810 tx=0x7fe748008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.622+0000 7fe760bce740 1 Processor -- start 2024-09-11T22:15:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.622+0000 7fe760bce740 1 -- start start 2024-09-11T22:15:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe760bce740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764b2c0 0x55fad7690a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe760bce740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7648a80 0x55fad764b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe760bce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad76458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe760bce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fad75ad520 con 0x55fad764ca50 2024-09-11T22:15:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe760bce740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fad75553e0 con 0x55fad7648a80 2024-09-11T22:15:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe760bce740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fad75a94e0 con 0x55fad764b2c0 2024-09-11T22:15:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe757fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad76458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe757fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad76458b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50220/0 (socket says 172.21.15.50:50220) 2024-09-11T22:15:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe757fff640 1 -- 172.21.15.50:0/1086514124 learned_addr learned my addr 172.21.15.50:0/1086514124 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe756ffd640 1 --2- 172.21.15.50:0/1086514124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7648a80 0x55fad764b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe7577fe640 1 --2- 172.21.15.50:0/1086514124 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764b2c0 0x55fad7690a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe757fff640 1 -- 172.21.15.50:0/1086514124 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764b2c0 msgr2=0x55fad7690a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe757fff640 1 --2- 172.21.15.50:0/1086514124 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764b2c0 0x55fad7690a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe757fff640 1 -- 172.21.15.50:0/1086514124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7648a80 msgr2=0x55fad764b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe757fff640 1 --2- 172.21.15.50:0/1086514124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7648a80 0x55fad764b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe757fff640 1 -- 172.21.15.50:0/1086514124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fad75702f0 con 0x55fad764ca50 2024-09-11T22:15:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.623+0000 7fe757fff640 1 --2- 172.21.15.50:0/1086514124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad76458b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe750009f10 tx=0x7fe75002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177a182743a78ba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:16.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.624+0000 7fe73d7fa640 1 -- 172.21.15.50:0/1086514124 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750036050 con 0x55fad764ca50 2024-09-11T22:15:16.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.624+0000 7fe73d7fa640 1 -- 172.21.15.50:0/1086514124 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe750042070 con 0x55fad764ca50 2024-09-11T22:15:16.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.624+0000 7fe73d7fa640 1 -- 172.21.15.50:0/1086514124 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75003d8b0 con 0x55fad764ca50 2024-09-11T22:15:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.625+0000 7fe760bce740 1 -- 172.21.15.50:0/1086514124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 msgr2=0x55fad76458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.625+0000 7fe760bce740 1 --2- 172.21.15.50:0/1086514124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad76458b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe750009f10 tx=0x7fe75002c000 comp rx=0 tx=0).stop 2024-09-11T22:15:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.625+0000 7fe760bce740 1 -- 172.21.15.50:0/1086514124 shutdown_connections 2024-09-11T22:15:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.625+0000 7fe760bce740 1 --2- 172.21.15.50:0/1086514124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad76458b0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.625+0000 7fe760bce740 1 --2- 172.21.15.50:0/1086514124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7648a80 0x55fad764b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.625+0000 7fe760bce740 1 --2- 172.21.15.50:0/1086514124 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764b2c0 0x55fad7690a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.625+0000 7fe760bce740 1 -- 172.21.15.50:0/1086514124 >> 172.21.15.50:0/1086514124 conn(0x55fad7647a80 msgr2=0x55fad768ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.625+0000 7fe760bce740 1 -- 172.21.15.50:0/1086514124 shutdown_connections 2024-09-11T22:15:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.625+0000 7fe760bce740 1 -- 172.21.15.50:0/1086514124 wait complete. 2024-09-11T22:15:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.626+0000 7fe760bce740 1 -- start start 2024-09-11T22:15:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.626+0000 7fe760bce740 1 Processor -- start 2024-09-11T22:15:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe760bce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764b2c0 0x55fad7672ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe760bce740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764ca50 0x55fad7664a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe760bce740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7676370 0x55fad7675160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe760bce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fad7646f20 con 0x55fad764b2c0 2024-09-11T22:15:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe760bce740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fad7536450 con 0x55fad7676370 2024-09-11T22:15:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe760bce740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fad7691290 con 0x55fad764ca50 2024-09-11T22:15:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe760bce740 10 client.0 _ll_register_callbacks cb 0x55fad72bfac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe7577fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764b2c0 0x55fad7672ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe7577fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764b2c0 0x55fad7672ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50228/0 (socket says 172.21.15.50:50228) 2024-09-11T22:15:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe7577fe640 1 -- 172.21.15.50:0/2102105094 learned_addr learned my addr 172.21.15.50:0/2102105094 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe756ffd640 1 --2- 172.21.15.50:0/2102105094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764ca50 0x55fad7664a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe757fff640 1 --2- 172.21.15.50:0/2102105094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7676370 0x55fad7675160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe7577fe640 1 -- 172.21.15.50:0/2102105094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764ca50 msgr2=0x55fad7664a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe7577fe640 1 --2- 172.21.15.50:0/2102105094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764ca50 0x55fad7664a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe7577fe640 1 -- 172.21.15.50:0/2102105094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7676370 msgr2=0x55fad7675160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe7577fe640 1 --2- 172.21.15.50:0/2102105094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7676370 0x55fad7675160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.627+0000 7fe7577fe640 1 -- 172.21.15.50:0/2102105094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fad72c02d0 con 0x55fad764b2c0 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe7577fe640 1 --2- 172.21.15.50:0/2102105094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764b2c0 0x55fad7672ca0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fe74800cf20 tx=0x7fe7480137f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adc948863c588a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe7367fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe7367fc640 1 -- 172.21.15.50:0/2102105094 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748023020 con 0x55fad764b2c0 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe7367fc640 1 -- 172.21.15.50:0/2102105094 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7fe74801f3f0 con 0x55fad764b2c0 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe760bce740 1 -- 172.21.15.50:0/2102105094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe750042070 con 0x55fad764b2c0 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe7367fc640 1 -- 172.21.15.50:0/2102105094 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fe74802d050 con 0x55fad764b2c0 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe760bce740 10 client.6813 fetch_fsmap learned FSMap version 47 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe760bce740 1 -- 172.21.15.50:0/2102105094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x55fad738a6b0 con 0x55fad764b2c0 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe7367fc640 1 -- 172.21.15.50:0/2102105094 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe750042070 con 0x55fad764b2c0 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe7367fc640 1 -- 172.21.15.50:0/2102105094 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7fe748030020 con 0x55fad764b2c0 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe760bce740 10 client.6813 fetch_fsmap finished waiting for FSMap version 47 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe760bce740 10 client.6813 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe760bce740 20 client.6813 populate_metadata read hostname 'smithi050' 2024-09-11T22:15:16.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe760bce740 1 --2- 172.21.15.50:0/2102105094 >> [v2:172.21.15.50:6832/4265727513,v1:172.21.15.50:6834/4265727513] conn(0x55fad7677cc0 0x55fad76ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe760bce740 4 client.6813 mds_command: new command op to 6648 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.628+0000 7fe760bce740 1 -- 172.21.15.50:0/2102105094 --> [v2:172.21.15.50:6832/4265727513,v1:172.21.15.50:6834/4265727513] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fad75bac50 con 0x55fad7677cc0 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.629+0000 7fe756ffd640 1 --2- 172.21.15.50:0/2102105094 >> [v2:172.21.15.50:6832/4265727513,v1:172.21.15.50:6834/4265727513] conn(0x55fad7677cc0 0x55fad76ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.629+0000 7fe7367fc640 10 client.6813 ms_handle_connect on v2:172.21.15.50:6832/4265727513 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.629+0000 7fe756ffd640 1 --2- 172.21.15.50:0/2102105094 >> [v2:172.21.15.50:6832/4265727513,v1:172.21.15.50:6834/4265727513] conn(0x55fad7677cc0 0x55fad76ad8d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53853a3dd151ec31 server_cookie=a97cdbd26296fd64 in_seq=0 out_seq=0 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe7367fc640 1 -- 172.21.15.50:0/2102105094 <== mds.0 v2:172.21.15.50:6832/4265727513 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fad75bac50 con 0x55fad7677cc0 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe7367fc640 10 client.6813 handle_command_reply: tid=0 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe760bce740 1 client.6813 shutdown 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe760bce740 1 -- 172.21.15.50:0/2102105094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764b2c0 msgr2=0x55fad7672ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe760bce740 1 --2- 172.21.15.50:0/2102105094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764b2c0 0x55fad7672ca0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fe74800cf20 tx=0x7fe7480137f0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe760bce740 1 -- 172.21.15.50:0/2102105094 shutdown_connections 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe760bce740 1 --2- 172.21.15.50:0/2102105094 >> [v2:172.21.15.50:6832/4265727513,v1:172.21.15.50:6834/4265727513] conn(0x55fad7677cc0 0x55fad76ad8d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe760bce740 1 --2- 172.21.15.50:0/2102105094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764ca50 0x55fad7664a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe760bce740 1 --2- 172.21.15.50:0/2102105094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7676370 0x55fad7675160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe7367fc640 0 client.6813 ms_handle_reset on v2:172.21.15.50:6832/4265727513 2024-09-11T22:15:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe760bce740 1 --2- 172.21.15.50:0/2102105094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764b2c0 0x55fad7672ca0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe760bce740 1 -- 172.21.15.50:0/2102105094 >> 172.21.15.50:0/2102105094 conn(0x55fad7648a80 msgr2=0x55fad7649020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe760bce740 1 -- 172.21.15.50:0/2102105094 shutdown_connections 2024-09-11T22:15:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe760bce740 1 -- 172.21.15.50:0/2102105094 wait complete. 2024-09-11T22:15:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.630+0000 7fe760bce740 20 client.6813 trim_cache size 0 max 16384 2024-09-11T22:15:16.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.648+0000 7fe760bce740 1 Processor -- start 2024-09-11T22:15:16.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.648+0000 7fe760bce740 1 -- start start 2024-09-11T22:15:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe760bce740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764b2c0 0x55fad7676bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe760bce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad7671450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe760bce740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7676370 0x55fad768dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe760bce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe7581ffea0 con 0x55fad764ca50 2024-09-11T22:15:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe760bce740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe75814b940 con 0x55fad7676370 2024-09-11T22:15:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe760bce740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe75814bf90 con 0x55fad764b2c0 2024-09-11T22:15:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe756ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad7671450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe756ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad7671450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50242/0 (socket says 172.21.15.50:50242) 2024-09-11T22:15:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe756ffd640 1 -- 172.21.15.50:0/2804739649 learned_addr learned my addr 172.21.15.50:0/2804739649 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe756ffd640 1 -- 172.21.15.50:0/2804739649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764b2c0 msgr2=0x55fad7676bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe756ffd640 1 --2- 172.21.15.50:0/2804739649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764b2c0 0x55fad7676bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe756ffd640 1 -- 172.21.15.50:0/2804739649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7676370 msgr2=0x55fad768dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe756ffd640 1 --2- 172.21.15.50:0/2804739649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7676370 0x55fad768dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe756ffd640 1 -- 172.21.15.50:0/2804739649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fad7647820 con 0x55fad764ca50 2024-09-11T22:15:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe756ffd640 1 --2- 172.21.15.50:0/2804739649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad7671450 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00ce00 tx=0x7fe74c088550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212f0181a55c5945 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe73cff9640 1 -- 172.21.15.50:0/2804739649 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c056700 con 0x55fad764ca50 2024-09-11T22:15:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.649+0000 7fe73cff9640 1 -- 172.21.15.50:0/2804739649 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74c054a70 con 0x55fad764ca50 2024-09-11T22:15:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.650+0000 7fe73cff9640 1 -- 172.21.15.50:0/2804739649 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0703d0 con 0x55fad764ca50 2024-09-11T22:15:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.650+0000 7fe760bce740 1 -- 172.21.15.50:0/2804739649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 msgr2=0x55fad7671450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.650+0000 7fe760bce740 1 --2- 172.21.15.50:0/2804739649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad7671450 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00ce00 tx=0x7fe74c088550 comp rx=0 tx=0).stop 2024-09-11T22:15:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.650+0000 7fe760bce740 1 -- 172.21.15.50:0/2804739649 shutdown_connections 2024-09-11T22:15:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.650+0000 7fe760bce740 1 --2- 172.21.15.50:0/2804739649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad7676370 0x55fad768dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.650+0000 7fe760bce740 1 --2- 172.21.15.50:0/2804739649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad7671450 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.650+0000 7fe760bce740 1 --2- 172.21.15.50:0/2804739649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad764b2c0 0x55fad7676bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.650+0000 7fe760bce740 1 -- 172.21.15.50:0/2804739649 >> 172.21.15.50:0/2804739649 conn(0x55fad7648a80 msgr2=0x55fad7692310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.650+0000 7fe760bce740 1 -- 172.21.15.50:0/2804739649 shutdown_connections 2024-09-11T22:15:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.650+0000 7fe760bce740 1 -- 172.21.15.50:0/2804739649 wait complete. 2024-09-11T22:15:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.651+0000 7fe760bce740 1 -- start start 2024-09-11T22:15:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.651+0000 7fe760bce740 1 Processor -- start 2024-09-11T22:15:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe760bce740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad764b2c0 0x55fad768fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe760bce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad76f7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe760bce740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad7676370 0x55fad7691cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe760bce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fad7677b40 con 0x55fad764ca50 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe760bce740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fad7664fd0 con 0x55fad764b2c0 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe760bce740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fad7678130 con 0x55fad7676370 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe760bce740 10 client.0 _ll_register_callbacks cb 0x7fe74800a540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe756ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad76f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe756ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad76f7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50256/0 (socket says 172.21.15.50:50256) 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe756ffd640 1 -- 172.21.15.50:0/3531791901 learned_addr learned my addr 172.21.15.50:0/3531791901 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe7577fe640 1 --2- 172.21.15.50:0/3531791901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad764b2c0 0x55fad768fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe757fff640 1 --2- 172.21.15.50:0/3531791901 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad7676370 0x55fad7691cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe756ffd640 1 -- 172.21.15.50:0/3531791901 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad7676370 msgr2=0x55fad7691cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe756ffd640 1 --2- 172.21.15.50:0/3531791901 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad7676370 0x55fad7691cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe756ffd640 1 -- 172.21.15.50:0/3531791901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad764b2c0 msgr2=0x55fad768fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:16.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe756ffd640 1 --2- 172.21.15.50:0/3531791901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad764b2c0 0x55fad768fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe756ffd640 1 -- 172.21.15.50:0/3531791901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fad76f7c80 con 0x55fad764ca50 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe756ffd640 1 --2- 172.21.15.50:0/3531791901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad76f7740 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe74c058100 tx=0x7fe74c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf48ba7ee2ac7a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe7367fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe7367fc640 1 -- 172.21.15.50:0/3531791901 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c075060 con 0x55fad764ca50 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe7367fc640 1 -- 172.21.15.50:0/3531791901 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7fe74c0701d0 con 0x55fad764ca50 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.652+0000 7fe760bce740 1 -- 172.21.15.50:0/3531791901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe74c054a70 con 0x55fad764ca50 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe7367fc640 1 -- 172.21.15.50:0/3531791901 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fe74c07c050 con 0x55fad764ca50 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe760bce740 10 client.6819 fetch_fsmap learned FSMap version 47 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe760bce740 1 -- 172.21.15.50:0/3531791901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x55fad768e9f0 con 0x55fad764ca50 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe7367fc640 1 -- 172.21.15.50:0/3531791901 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74c054a70 con 0x55fad764ca50 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe7367fc640 1 -- 172.21.15.50:0/3531791901 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7fe74c077300 con 0x55fad764ca50 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe760bce740 10 client.6819 fetch_fsmap finished waiting for FSMap version 47 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe760bce740 10 client.6819 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:15:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe760bce740 20 client.6819 populate_metadata read hostname 'smithi050' 2024-09-11T22:15:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe760bce740 1 --2- 172.21.15.50:0/3531791901 >> [v2:172.21.15.50:6832/4265727513,v1:172.21.15.50:6834/4265727513] conn(0x55fad768c240 0x55fad768c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe760bce740 4 client.6819 mds_command: new command op to 6648 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:15:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe760bce740 1 -- 172.21.15.50:0/3531791901 --> [v2:172.21.15.50:6832/4265727513,v1:172.21.15.50:6834/4265727513] -- command(tid 0: {"prefix": "status"}) -- 0x55fad76a0940 con 0x55fad768c240 2024-09-11T22:15:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe7577fe640 1 --2- 172.21.15.50:0/3531791901 >> [v2:172.21.15.50:6832/4265727513,v1:172.21.15.50:6834/4265727513] conn(0x55fad768c240 0x55fad768c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe7367fc640 10 client.6819 ms_handle_connect on v2:172.21.15.50:6832/4265727513 2024-09-11T22:15:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.653+0000 7fe7577fe640 1 --2- 172.21.15.50:0/3531791901 >> [v2:172.21.15.50:6832/4265727513,v1:172.21.15.50:6834/4265727513] conn(0x55fad768c240 0x55fad768c620 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4ed89d7ba35d528 server_cookie=a4f0d110e89a96a5 in_seq=0 out_seq=0 2024-09-11T22:15:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe7367fc640 1 -- 172.21.15.50:0/3531791901 <== mds.0 v2:172.21.15.50:6832/4265727513 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55fad76a0940 con 0x55fad768c240 2024-09-11T22:15:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe7367fc640 10 client.6819 handle_command_reply: tid=0 2024-09-11T22:15:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe760bce740 1 client.6819 shutdown 2024-09-11T22:15:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe760bce740 1 -- 172.21.15.50:0/3531791901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 msgr2=0x55fad76f7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe760bce740 1 --2- 172.21.15.50:0/3531791901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad76f7740 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe74c058100 tx=0x7fe74c01e040 comp rx=0 tx=0).stop 2024-09-11T22:15:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe760bce740 1 -- 172.21.15.50:0/3531791901 shutdown_connections 2024-09-11T22:15:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe760bce740 1 --2- 172.21.15.50:0/3531791901 >> [v2:172.21.15.50:6832/4265727513,v1:172.21.15.50:6834/4265727513] conn(0x55fad768c240 0x55fad768c620 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe760bce740 1 --2- 172.21.15.50:0/3531791901 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fad7676370 0x55fad7691cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe760bce740 1 --2- 172.21.15.50:0/3531791901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad764ca50 0x55fad76f7740 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe760bce740 1 --2- 172.21.15.50:0/3531791901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fad764b2c0 0x55fad768fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe7367fc640 0 client.6819 ms_handle_reset on v2:172.21.15.50:6832/4265727513 2024-09-11T22:15:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe760bce740 1 -- 172.21.15.50:0/3531791901 >> 172.21.15.50:0/3531791901 conn(0x55fad7648a80 msgr2=0x55fad7674de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe760bce740 1 -- 172.21.15.50:0/3531791901 shutdown_connections 2024-09-11T22:15:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe760bce740 1 -- 172.21.15.50:0/3531791901 wait complete. 2024-09-11T22:15:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe760bce740 20 client.6819 trim_cache size 0 max 16384 2024-09-11T22:15:16.660 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:15:16.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:15:16.660 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:15:16.660 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6648, 2024-09-11T22:15:16.661 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:15:16.661 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:15:16.661 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:15:16.661 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 9.0435396309999998, 2024-09-11T22:15:16.661 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 47, 2024-09-11T22:15:16.661 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 74, 2024-09-11T22:15:16.661 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 74, 2024-09-11T22:15:16.661 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 14.090375947 2024-09-11T22:15:16.661 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:15:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe75de37640 1 -- 172.21.15.50:0/2259036933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe74406be60 msgr2=0x7fe74406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe75de37640 1 --2- 172.21.15.50:0/2259036933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe74406be60 0x7fe74406e320 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe74800a810 tx=0x7fe748008040 comp rx=0 tx=0).stop 2024-09-11T22:15:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe75de37640 1 -- 172.21.15.50:0/2259036933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580735a0 msgr2=0x7fe7580cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe75de37640 1 --2- 172.21.15.50:0/2259036933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580735a0 0x7fe7580cf690 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00c440 tx=0x7fe74c00c900 comp rx=0 tx=0).stop 2024-09-11T22:15:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe75de37640 1 -- 172.21.15.50:0/2259036933 shutdown_connections 2024-09-11T22:15:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe75de37640 1 --2- 172.21.15.50:0/2259036933 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe74406be60 0x7fe74406e320 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe75de37640 1 --2- 172.21.15.50:0/2259036933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe75815c240 0x7fe758160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe75de37640 1 --2- 172.21.15.50:0/2259036933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7580735a0 0x7fe7580cf690 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe75de37640 1 --2- 172.21.15.50:0/2259036933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7580728e0 0x7fe75815e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.654+0000 7fe75de37640 1 -- 172.21.15.50:0/2259036933 >> 172.21.15.50:0/2259036933 conn(0x7fe7580b2bd0 msgr2=0x7fe75815eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.655+0000 7fe75de37640 1 -- 172.21.15.50:0/2259036933 shutdown_connections 2024-09-11T22:15:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.655+0000 7fe75de37640 1 -- 172.21.15.50:0/2259036933 wait complete. 2024-09-11T22:15:16.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:15:16.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.768+0000 7fb8366b7640 1 Processor -- start 2024-09-11T22:15:16.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.768+0000 7fb8366b7640 1 -- start start 2024-09-11T22:15:16.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.769+0000 7fb8366b7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb83015e840 0x7fb8300b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.769+0000 7fb8366b7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8300cdd50 0x7fb8300cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.769+0000 7fb8366b7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb8300cf3b0 0x7fb8300d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.769+0000 7fb8366b7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb83006c240 con 0x7fb8300cf3b0 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.769+0000 7fb8366b7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb8300d0470 con 0x7fb8300cdd50 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.769+0000 7fb8366b7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb8300ce5f0 con 0x7fb83015e840 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.769+0000 7fb834c54640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb8300cf3b0 0x7fb8300d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.769+0000 7fb834c54640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb8300cf3b0 0x7fb8300d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50258/0 (socket says 172.21.15.50:50258) 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.769+0000 7fb834c54640 1 -- 172.21.15.50:0/3011120844 learned_addr learned my addr 172.21.15.50:0/3011120844 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.769+0000 7fb82ffff640 1 --2- 172.21.15.50:0/3011120844 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb83015e840 0x7fb8300b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.770+0000 7fb82f7fe640 1 --2- 172.21.15.50:0/3011120844 >> v2:172.21.15.77:3300/0 conn(0x7fb8300cdd50 0x7fb8300cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.770+0000 7fb834c54640 1 -- 172.21.15.50:0/3011120844 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb83015e840 msgr2=0x7fb8300b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.770+0000 7fb834c54640 1 --2- 172.21.15.50:0/3011120844 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb83015e840 0x7fb8300b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.770+0000 7fb834c54640 1 -- 172.21.15.50:0/3011120844 >> v2:172.21.15.77:3300/0 conn(0x7fb8300cdd50 msgr2=0x7fb8300cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.770+0000 7fb834c54640 1 --2- 172.21.15.50:0/3011120844 >> v2:172.21.15.77:3300/0 conn(0x7fb8300cdd50 0x7fb8300cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.770+0000 7fb834c54640 1 -- 172.21.15.50:0/3011120844 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8300ce310 con 0x7fb8300cf3b0 2024-09-11T22:15:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.770+0000 7fb834c54640 1 --2- 172.21.15.50:0/3011120844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8300cf3b0 0x7fb8300d0710 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb828009e50 tx=0x7fb82802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76221477968a296 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.771+0000 7fb82effd640 1 -- 172.21.15.50:0/3011120844 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb828036070 con 0x7fb8300cf3b0 2024-09-11T22:15:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.771+0000 7fb82effd640 1 -- 172.21.15.50:0/3011120844 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb828031600 con 0x7fb8300cf3b0 2024-09-11T22:15:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.771+0000 7fb82effd640 1 -- 172.21.15.50:0/3011120844 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8280319d0 con 0x7fb8300cf3b0 2024-09-11T22:15:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.771+0000 7fb8366b7640 1 -- 172.21.15.50:0/3011120844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8300cf3b0 msgr2=0x7fb8300d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.771+0000 7fb8366b7640 1 --2- 172.21.15.50:0/3011120844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8300cf3b0 0x7fb8300d0710 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb828009e50 tx=0x7fb82802a6c0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.771+0000 7fb8366b7640 1 -- 172.21.15.50:0/3011120844 shutdown_connections 2024-09-11T22:15:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.771+0000 7fb8366b7640 1 --2- 172.21.15.50:0/3011120844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8300cf3b0 0x7fb8300d0710 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.771+0000 7fb8366b7640 1 --2- 172.21.15.50:0/3011120844 >> v2:172.21.15.77:3300/0 conn(0x7fb8300cdd50 0x7fb8300cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.771+0000 7fb8366b7640 1 --2- 172.21.15.50:0/3011120844 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb83015e840 0x7fb8300b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.771+0000 7fb8366b7640 1 -- 172.21.15.50:0/3011120844 >> 172.21.15.50:0/3011120844 conn(0x7fb8300b4150 msgr2=0x7fb8300b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:16.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.771+0000 7fb8366b7640 1 -- 172.21.15.50:0/3011120844 shutdown_connections 2024-09-11T22:15:16.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.771+0000 7fb8366b7640 1 -- 172.21.15.50:0/3011120844 wait complete. 2024-09-11T22:15:16.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.772+0000 7fb8366b7640 1 Processor -- start 2024-09-11T22:15:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.773+0000 7fb8366b7640 1 -- start start 2024-09-11T22:15:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.773+0000 7fb8366b7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8300cdd50 0x7fb83015cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.773+0000 7fb8366b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8300cf3b0 0x7fb830070520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.773+0000 7fb8366b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83015e840 0x7fb830070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.773+0000 7fb8366b7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb83015ec20 con 0x7fb8300cf3b0 2024-09-11T22:15:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.773+0000 7fb8366b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb83006bed0 con 0x7fb83015e840 2024-09-11T22:15:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.773+0000 7fb8366b7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb83015eda0 con 0x7fb8300cdd50 2024-09-11T22:15:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb82f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8300cf3b0 0x7fb830070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb82f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8300cf3b0 0x7fb830070520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50264/0 (socket says 172.21.15.50:50264) 2024-09-11T22:15:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb82f7fe640 1 -- 172.21.15.50:0/2072683478 learned_addr learned my addr 172.21.15.50:0/2072683478 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:16.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb82ffff640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8300cdd50 0x7fb83015cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb834c54640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83015e840 0x7fb830070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb82f7fe640 1 -- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8300cdd50 msgr2=0x7fb83015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb82f7fe640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8300cdd50 0x7fb83015cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb82f7fe640 1 -- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83015e840 msgr2=0x7fb830070a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb82f7fe640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83015e840 0x7fb830070a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb82f7fe640 1 -- 172.21.15.50:0/2072683478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8300cc400 con 0x7fb8300cf3b0 2024-09-11T22:15:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb82f7fe640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8300cf3b0 0x7fb830070520 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb82400d5f0 tx=0x7fb82400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb82cff9640 1 -- 172.21.15.50:0/2072683478 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824004240 con 0x7fb8300cf3b0 2024-09-11T22:15:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb82cff9640 1 -- 172.21.15.50:0/2072683478 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8240043e0 con 0x7fb8300cf3b0 2024-09-11T22:15:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb8366b7640 1 -- 172.21.15.50:0/2072683478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8300cc6e0 con 0x7fb8300cf3b0 2024-09-11T22:15:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb82cff9640 1 -- 172.21.15.50:0/2072683478 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824003610 con 0x7fb8300cf3b0 2024-09-11T22:15:16.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.774+0000 7fb8366b7640 1 -- 172.21.15.50:0/2072683478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8300c6cd0 con 0x7fb8300cf3b0 2024-09-11T22:15:16.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.775+0000 7fb8366b7640 1 -- 172.21.15.50:0/2072683478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8300d1bb0 con 0x7fb8300cf3b0 2024-09-11T22:15:16.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.776+0000 7fb82cff9640 1 -- 172.21.15.50:0/2072683478 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb82401b020 con 0x7fb8300cf3b0 2024-09-11T22:15:16.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.776+0000 7fb82cff9640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb81c06be30 0x7fb81c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:16.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.776+0000 7fb82cff9640 1 -- 172.21.15.50:0/2072683478 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7fb82408a940 con 0x7fb8300cf3b0 2024-09-11T22:15:16.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.777+0000 7fb82ffff640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb81c06be30 0x7fb81c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:16.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.777+0000 7fb82ffff640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb81c06be30 0x7fb81c06e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb820006fd0 tx=0x7fb820008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.781+0000 7fb82cff9640 1 -- 172.21.15.50:0/2072683478 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8300d1bb0 con 0x7fb8300cf3b0 2024-09-11T22:15:16.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.993+0000 7fb8366b7640 1 -- 172.21.15.50:0/2072683478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb83006f730 con 0x7fb8300cf3b0 2024-09-11T22:15:16.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.994+0000 7fb82cff9640 1 -- 172.21.15.50:0/2072683478 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) ==== 53+0+73 (secure 0 0 0) 0x7fb824058d30 con 0x7fb8300cf3b0 2024-09-11T22:15:16.995 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:15:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.996+0000 7fb8366b7640 1 -- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb81c06be30 msgr2=0x7fb81c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.996+0000 7fb8366b7640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb81c06be30 0x7fb81c06e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb820006fd0 tx=0x7fb820008040 comp rx=0 tx=0).stop 2024-09-11T22:15:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.996+0000 7fb8366b7640 1 -- 172.21.15.50:0/2072683478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8300cf3b0 msgr2=0x7fb830070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.996+0000 7fb8366b7640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8300cf3b0 0x7fb830070520 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb82400d5f0 tx=0x7fb82400dab0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.996+0000 7fb8366b7640 1 -- 172.21.15.50:0/2072683478 shutdown_connections 2024-09-11T22:15:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.996+0000 7fb8366b7640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb81c06be30 0x7fb81c06e2f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.996+0000 7fb8366b7640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83015e840 0x7fb830070a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.996+0000 7fb8366b7640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8300cf3b0 0x7fb830070520 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.996+0000 7fb8366b7640 1 --2- 172.21.15.50:0/2072683478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8300cdd50 0x7fb83015cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.996+0000 7fb8366b7640 1 -- 172.21.15.50:0/2072683478 >> 172.21.15.50:0/2072683478 conn(0x7fb8300b4150 msgr2=0x7fb8300afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.996+0000 7fb8366b7640 1 -- 172.21.15.50:0/2072683478 shutdown_connections 2024-09-11T22:15:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:16.996+0000 7fb8366b7640 1 -- 172.21.15.50:0/2072683478 wait complete. 2024-09-11T22:15:17.008 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:15:17.008 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:15:17.008 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:15:17.008 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:15:17.008 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:17.008 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:15:17.008 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:15:17.008 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:15:17.008 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:15:17.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:17.009 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:15:17.025 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:15:17.025 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:15:17.025 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:15:17.025 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:17.025 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:15:17.025 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:17.025 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:15:17.025 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:17.026 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:15:17.026 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:15:17.026 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:17.026 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:15:17.026 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:15:17.026 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:17.026 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:15:17.026 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:15:17.026 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42478sec preferred_lft 42478sec 2024-09-11T22:15:17.026 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:15:17.026 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:17.026 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:15:17.026 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:15:17.027 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:15:17.028 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:17.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:17.028 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:15:17.090 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:15:17.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:17.092 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:15:17.148 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:15:17.148 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:15:17.148 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:15:17.148 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:15:17.148 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:15:17.149 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:15:17.149 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:15:17.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:15:17.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:15:17.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:15:17.149 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:15:17.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:15:17.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:15:17.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:17.277 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:15:17.293 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:15:17.293 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:15:17.294 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:15:17.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:17.294 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:15:17.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:15:17.360 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:17.415 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:15:17.415 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:15:17.415 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:17.471 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:15:17.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:17.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:15:17.556 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:15:17.556 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:15:17.563 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:15:17.563 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:15:17.564 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:15:17.564 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:15:17.564 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:15:17.564 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:15:17.564 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:15:17.564 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:15:17.565 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:15:17.565 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:15:17.566 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:15:17.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:17.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:17.592 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:15:17.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:15:17.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:15:17.697 INFO:teuthology.orchestra.run.smithi050.stdout:client6828 2024-09-11T22:15:17.698 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:15:17.698 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:17.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:17.714 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-09-11T22:15:17.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:17.776 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-09-11T22:15:17.834 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2024-09-11T22:15:17.834 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-11T22:15:17.834 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2024-09-11T22:15:17.834 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:15:17.834 DEBUG:teuthology.orchestra.run.smithi050:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-09-11T22:15:17.834 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-11T22:15:17.941 INFO:teuthology.orchestra.run.smithi050.stdout:1099511627776 2024-09-11T22:15:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:15:17.950 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:15:17.950 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:18.006 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:15:18.006 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:18.062 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:15:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.204+0000 7f5a70e80640 1 Processor -- start 2024-09-11T22:15:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.204+0000 7f5a70e80640 1 -- start start 2024-09-11T22:15:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.205+0000 7f5a70e80640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5a6c15e870 0x7f5a6c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.205+0000 7f5a70e80640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c0d16d0 0x7f5a6c0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.205+0000 7f5a70e80640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a6c0cfa80 con 0x7f5a6c0d3a30 2024-09-11T22:15:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.205+0000 7f5a70e80640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5a6c0d1b10 con 0x7f5a6c15e870 2024-09-11T22:15:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.205+0000 7f5a70e80640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5a6c0d3e80 con 0x7f5a6c0d16d0 2024-09-11T22:15:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6ad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5a6c0d3a30 0x7f5a6c0b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41154/0 (socket says 172.21.15.50:41154) 2024-09-11T22:15:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6ad9d640 1 -- 172.21.15.50:0/3573708625 learned_addr learned my addr 172.21.15.50:0/3573708625 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6a59c640 1 --2- 172.21.15.50:0/3573708625 >> v2:172.21.15.77:3300/0 conn(0x7f5a6c15e870 0x7f5a6c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a69d9b640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c0d16d0 0x7f5a6c0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1258824202 0 0) 0x7f5a64001490 con 0x7f5a6c0d3a30 2024-09-11T22:15:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a54003520 con 0x7f5a6c0d3a30 2024-09-11T22:15:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2411950904 0 0) 0x7f5a54003520 con 0x7f5a6c0d3a30 2024-09-11T22:15:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c0d16d0 msgr2=0x7f5a6c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c0d16d0 0x7f5a6c0d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 >> v2:172.21.15.77:3300/0 conn(0x7f5a6c15e870 msgr2=0x7f5a6c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 --2- 172.21.15.50:0/3573708625 >> v2:172.21.15.77:3300/0 conn(0x7f5a6c15e870 0x7f5a6c0d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6c0d40d0 con 0x7f5a6c0d3a30 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f5a64001bc0 con 0x7f5a6c0d3a30 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 >> v1:172.21.15.50:6789/0 conn(0x7f5a6c0d3a30 legacy=0x7f5a6c0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a540039b0 0x7f5a54003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a54004800 0x7f5a54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c0d16d0 0x7f5a540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6c0d1b10 con 0x7f5a540039b0 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6c0d3e80 con 0x7f5a54004800 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5a5400b9c0 con 0x7f5a6c0d16d0 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6a59c640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a540039b0 0x7f5a54003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a6ad9d640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c0d16d0 0x7f5a540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.206+0000 7f5a69d9b640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a54004800 0x7f5a54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.207+0000 7f5a6a59c640 1 -- 172.21.15.50:0/3573708625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c0d16d0 msgr2=0x7f5a540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.207+0000 7f5a6a59c640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c0d16d0 0x7f5a540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.207+0000 7f5a6a59c640 1 -- 172.21.15.50:0/3573708625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a54004800 msgr2=0x7f5a54004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.207+0000 7f5a6a59c640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a54004800 0x7f5a54004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.207+0000 7f5a6a59c640 1 -- 172.21.15.50:0/3573708625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a54003520 con 0x7f5a540039b0 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.207+0000 7f5a6ad9d640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c0d16d0 0x7f5a540051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.207+0000 7f5a69d9b640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a54004800 0x7f5a54004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.207+0000 7f5a6a59c640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a540039b0 0x7f5a54003dd0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009ac0 tx=0x7f5a54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652bdd36b0e28546 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.207+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c036070 con 0x7f5a540039b0 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.207+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5c031400 con 0x7f5a540039b0 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.207+0000 7f5a6959a640 1 -- 172.21.15.50:0/3573708625 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c009690 con 0x7f5a540039b0 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.208+0000 7f5a70e80640 1 -- 172.21.15.50:0/3573708625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a540039b0 msgr2=0x7f5a54003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.208+0000 7f5a70e80640 1 --2- 172.21.15.50:0/3573708625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a540039b0 0x7f5a54003dd0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009ac0 tx=0x7f5a54005830 comp rx=0 tx=0).stop 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.208+0000 7f5a6ad9d640 1 -- 172.21.15.50:0/3573708625 reap_dead start 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.208+0000 7f5a70e80640 1 -- 172.21.15.50:0/3573708625 shutdown_connections 2024-09-11T22:15:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.208+0000 7f5a70e80640 1 -- 172.21.15.50:0/3573708625 >> 172.21.15.50:0/3573708625 conn(0x7f5a6c0727a0 msgr2=0x7f5a6c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.208+0000 7f5a70e80640 1 -- 172.21.15.50:0/3573708625 shutdown_connections 2024-09-11T22:15:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.208+0000 7f5a70e80640 1 -- 172.21.15.50:0/3573708625 wait complete. 2024-09-11T22:15:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.209+0000 7f5a70e80640 1 Processor -- start 2024-09-11T22:15:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.210+0000 7f5a70e80640 1 -- start start 2024-09-11T22:15:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.210+0000 7f5a70e80640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a540039b0 0x7f5a6c0cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.210+0000 7f5a70e80640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c1f43a0 0x7f5a6c0b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.210+0000 7f5a70e80640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a6c0b58e0 0x7f5a6c157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.210+0000 7f5a70e80640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6c0b7ee0 con 0x7f5a540039b0 2024-09-11T22:15:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.210+0000 7f5a70e80640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6c0b7c00 con 0x7f5a6c0b58e0 2024-09-11T22:15:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.210+0000 7f5a70e80640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5a6c15ec50 con 0x7f5a6c1f43a0 2024-09-11T22:15:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.210+0000 7f5a6a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a540039b0 0x7f5a6c0cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.210+0000 7f5a6a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a540039b0 0x7f5a6c0cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37562/0 (socket says 172.21.15.50:37562) 2024-09-11T22:15:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.210+0000 7f5a6a59c640 1 -- 172.21.15.50:0/3774155721 learned_addr learned my addr 172.21.15.50:0/3774155721 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.211+0000 7f5a6ad9d640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a6c0b58e0 0x7f5a6c157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.211+0000 7f5a69d9b640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c1f43a0 0x7f5a6c0b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.211+0000 7f5a6a59c640 1 -- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c1f43a0 msgr2=0x7f5a6c0b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.211+0000 7f5a6a59c640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c1f43a0 0x7f5a6c0b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.211+0000 7f5a6a59c640 1 -- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a6c0b58e0 msgr2=0x7f5a6c157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.211+0000 7f5a6a59c640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a6c0b58e0 0x7f5a6c157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.211+0000 7f5a6a59c640 1 -- 172.21.15.50:0/3774155721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6c0b4620 con 0x7f5a540039b0 2024-09-11T22:15:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.211+0000 7f5a6a59c640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a540039b0 0x7f5a6c0cb850 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c034040 tx=0x7f5a5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.211+0000 7f5a5affd640 1 -- 172.21.15.50:0/3774155721 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c041020 con 0x7f5a540039b0 2024-09-11T22:15:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.211+0000 7f5a5affd640 1 -- 172.21.15.50:0/3774155721 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5c03c470 con 0x7f5a540039b0 2024-09-11T22:15:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.211+0000 7f5a70e80640 1 -- 172.21.15.50:0/3774155721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a6c0ce6a0 con 0x7f5a540039b0 2024-09-11T22:15:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.211+0000 7f5a5affd640 1 -- 172.21.15.50:0/3774155721 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c036040 con 0x7f5a540039b0 2024-09-11T22:15:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.211+0000 7f5a70e80640 1 -- 172.21.15.50:0/3774155721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a6c0b4ba0 con 0x7f5a540039b0 2024-09-11T22:15:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.212+0000 7f5a70e80640 1 -- 172.21.15.50:0/3774155721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a6c0ba5c0 con 0x7f5a540039b0 2024-09-11T22:15:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.213+0000 7f5a5affd640 1 -- 172.21.15.50:0/3774155721 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a5c044020 con 0x7f5a540039b0 2024-09-11T22:15:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.213+0000 7f5a5affd640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5a4c06be30 0x7f5a4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.213+0000 7f5a5affd640 1 -- 172.21.15.50:0/3774155721 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f5a5c0ab5c0 con 0x7f5a540039b0 2024-09-11T22:15:18.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.213+0000 7f5a69d9b640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5a4c06be30 0x7f5a4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.214+0000 7f5a69d9b640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5a4c06be30 0x7f5a4c06e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c1f7f80 tx=0x7f5a60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:18.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.217+0000 7f5a5affd640 1 -- 172.21.15.50:0/3774155721 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a6c0ba5c0 con 0x7f5a540039b0 2024-09-11T22:15:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.404+0000 7f5a70e80640 1 -- 172.21.15.50:0/3774155721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5a6c0b78b0 con 0x7f5a540039b0 2024-09-11T22:15:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.404+0000 7f5a5affd640 1 -- 172.21.15.50:0/3774155721 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) ==== 80+0+0 (secure 0 0 0) 0x7f5a5c04b030 con 0x7f5a540039b0 2024-09-11T22:15:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:15:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.407+0000 7f5a70e80640 1 -- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5a4c06be30 msgr2=0x7f5a4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.407+0000 7f5a70e80640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5a4c06be30 0x7f5a4c06e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c1f7f80 tx=0x7f5a60008040 comp rx=0 tx=0).stop 2024-09-11T22:15:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.407+0000 7f5a70e80640 1 -- 172.21.15.50:0/3774155721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a540039b0 msgr2=0x7f5a6c0cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.407+0000 7f5a70e80640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a540039b0 0x7f5a6c0cb850 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c034040 tx=0x7f5a5c004730 comp rx=0 tx=0).stop 2024-09-11T22:15:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.407+0000 7f5a70e80640 1 -- 172.21.15.50:0/3774155721 shutdown_connections 2024-09-11T22:15:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.407+0000 7f5a70e80640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5a4c06be30 0x7f5a4c06e2f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.407+0000 7f5a70e80640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a6c1f43a0 0x7f5a6c0b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.407+0000 7f5a70e80640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a6c0b58e0 0x7f5a6c157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.407+0000 7f5a70e80640 1 --2- 172.21.15.50:0/3774155721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a540039b0 0x7f5a6c0cb850 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.407+0000 7f5a70e80640 1 -- 172.21.15.50:0/3774155721 >> 172.21.15.50:0/3774155721 conn(0x7f5a6c0727a0 msgr2=0x7f5a6c15f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.407+0000 7f5a70e80640 1 -- 172.21.15.50:0/3774155721 shutdown_connections 2024-09-11T22:15:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.407+0000 7f5a70e80640 1 -- 172.21.15.50:0/3774155721 wait complete. 2024-09-11T22:15:18.418 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:15:18.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:18.419 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:18.460 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:15:18.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:18.461 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:15:18.516 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.658+0000 7f47774dd640 1 Processor -- start 2024-09-11T22:15:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.659+0000 7f47774dd640 1 -- start start 2024-09-11T22:15:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.659+0000 7f47774dd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47700d18a0 0x7f47700d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.659+0000 7f47774dd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47700d3a30 0x7f47700b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.659+0000 7f47774dd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47700cfa80 con 0x7f477015e870 2024-09-11T22:15:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.659+0000 7f47774dd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f47700d3ea0 con 0x7f47700d3a30 2024-09-11T22:15:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.659+0000 7f47774dd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f47700d40d0 con 0x7f47700d18a0 2024-09-11T22:15:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.659+0000 7f4775a7a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47700d3a30 0x7f47700b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.660+0000 7f4775a7a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47700d3a30 0x7f47700b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37574/0 (socket says 172.21.15.50:37574) 2024-09-11T22:15:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.660+0000 7f4775a7a640 1 -- 172.21.15.50:0/2032984751 learned_addr learned my addr 172.21.15.50:0/2032984751 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.660+0000 7f4774a78640 1 --2- 172.21.15.50:0/2032984751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47700d18a0 0x7f47700d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.660+0000 7f4775a7a640 1 -- 172.21.15.50:0/2032984751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47700d18a0 msgr2=0x7f47700d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.660+0000 7f4775a7a640 1 --2- 172.21.15.50:0/2032984751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47700d18a0 0x7f47700d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.660+0000 7f4775a7a640 1 -- 172.21.15.50:0/2032984751 >> v1:172.21.15.77:6789/0 conn(0x7f477015e870 legacy=0x7f47700d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.660+0000 7f4775a7a640 1 -- 172.21.15.50:0/2032984751 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47700d43b0 con 0x7f47700d3a30 2024-09-11T22:15:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.661+0000 7f4775a7a640 1 --2- 172.21.15.50:0/2032984751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47700d3a30 0x7f47700b8400 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4760009e50 tx=0x7f476002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72516934345fc289 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.661+0000 7f476ffff640 1 -- 172.21.15.50:0/2032984751 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4760036070 con 0x7f47700d3a30 2024-09-11T22:15:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.661+0000 7f476ffff640 1 -- 172.21.15.50:0/2032984751 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4760031600 con 0x7f47700d3a30 2024-09-11T22:15:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.661+0000 7f476ffff640 1 -- 172.21.15.50:0/2032984751 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47600319d0 con 0x7f47700d3a30 2024-09-11T22:15:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.661+0000 7f47774dd640 1 -- 172.21.15.50:0/2032984751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47700d3a30 msgr2=0x7f47700b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.661+0000 7f47774dd640 1 --2- 172.21.15.50:0/2032984751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47700d3a30 0x7f47700b8400 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4760009e50 tx=0x7f476002a710 comp rx=0 tx=0).stop 2024-09-11T22:15:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.661+0000 7f47774dd640 1 -- 172.21.15.50:0/2032984751 shutdown_connections 2024-09-11T22:15:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.661+0000 7f47774dd640 1 --2- 172.21.15.50:0/2032984751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47700d3a30 0x7f47700b8400 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.661+0000 7f47774dd640 1 --2- 172.21.15.50:0/2032984751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47700d18a0 0x7f47700d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.661+0000 7f47774dd640 1 -- 172.21.15.50:0/2032984751 >> 172.21.15.50:0/2032984751 conn(0x7f47700727a0 msgr2=0x7f47700679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.661+0000 7f47774dd640 1 -- 172.21.15.50:0/2032984751 shutdown_connections 2024-09-11T22:15:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.661+0000 7f47774dd640 1 -- 172.21.15.50:0/2032984751 wait complete. 2024-09-11T22:15:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.663+0000 7f47774dd640 1 Processor -- start 2024-09-11T22:15:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.663+0000 7f47774dd640 1 -- start start 2024-09-11T22:15:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.663+0000 7f47774dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47700d18a0 0x7f4770157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.663+0000 7f47774dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47700d3a30 0x7f477015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.663+0000 7f47774dd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f477015e870 0x7f477015d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.663+0000 7f47774dd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f477015ec50 con 0x7f47700d3a30 2024-09-11T22:15:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.663+0000 7f47774dd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f47700b7ee0 con 0x7f47700d18a0 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.663+0000 7f47774dd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f47700b78b0 con 0x7f477015e870 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.663+0000 7f4774a78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47700d3a30 0x7f477015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.663+0000 7f4774a78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47700d3a30 0x7f477015cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37586/0 (socket says 172.21.15.50:37586) 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.663+0000 7f4774a78640 1 -- 172.21.15.50:0/514459332 learned_addr learned my addr 172.21.15.50:0/514459332 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.664+0000 7f4775a7a640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f477015e870 0x7f477015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.663+0000 7f4775279640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47700d18a0 0x7f4770157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.664+0000 7f4774a78640 1 -- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f477015e870 msgr2=0x7f477015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.664+0000 7f4774a78640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f477015e870 0x7f477015d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.664+0000 7f4774a78640 1 -- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47700d18a0 msgr2=0x7f4770157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.664+0000 7f4774a78640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47700d18a0 0x7f4770157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.664+0000 7f4774a78640 1 -- 172.21.15.50:0/514459332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47701e7a10 con 0x7f47700d3a30 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.664+0000 7f4774a78640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47700d3a30 0x7f477015cd30 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f476400e870 tx=0x7f476400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.664+0000 7f476dffb640 1 -- 172.21.15.50:0/514459332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4764017070 con 0x7f47700d3a30 2024-09-11T22:15:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.664+0000 7f476dffb640 1 -- 172.21.15.50:0/514459332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476400c940 con 0x7f47700d3a30 2024-09-11T22:15:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.664+0000 7f47774dd640 1 -- 172.21.15.50:0/514459332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47701e7cf0 con 0x7f47700d3a30 2024-09-11T22:15:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.664+0000 7f476dffb640 1 -- 172.21.15.50:0/514459332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476400cd30 con 0x7f47700d3a30 2024-09-11T22:15:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.664+0000 7f47774dd640 1 -- 172.21.15.50:0/514459332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47701e82b0 con 0x7f47700d3a30 2024-09-11T22:15:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.665+0000 7f47774dd640 1 -- 172.21.15.50:0/514459332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47701e86f0 con 0x7f47700d3a30 2024-09-11T22:15:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.666+0000 7f476dffb640 1 -- 172.21.15.50:0/514459332 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f476401a070 con 0x7f47700d3a30 2024-09-11T22:15:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.666+0000 7f476dffb640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f475c06be30 0x7f475c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.666+0000 7f476dffb640 1 -- 172.21.15.50:0/514459332 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f476408af80 con 0x7f47700d3a30 2024-09-11T22:15:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.666+0000 7f4775279640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f475c06be30 0x7f475c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.667+0000 7f4775279640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f475c06be30 0x7f475c06e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f47700ca6a0 tx=0x7f4768009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.670+0000 7f476dffb640 1 -- 172.21.15.50:0/514459332 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4764059370 con 0x7f47700d3a30 2024-09-11T22:15:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.881+0000 7f47774dd640 1 -- 172.21.15.50:0/514459332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47700d34f0 con 0x7f47700d3a30 2024-09-11T22:15:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.882+0000 7f476dffb640 1 -- 172.21.15.50:0/514459332 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f476405d670 con 0x7f47700d3a30 2024-09-11T22:15:18.883 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:18.883 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":47,"btime":"2024-09-11T22:15:09:616633+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6151,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1710208890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1710208890},{"type":"v1","addr":"172.21.15.50:6835","nonce":1710208890}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/784761109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":784761109},{"type":"v1","addr":"172.21.15.77:6836","nonce":784761109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6160,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1115358060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1115358060},{"type":"v1","addr":"172.21.15.77:6837","nonce":1115358060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:06.945196+0000","modified":"2024-09-11T22:15:08.958948+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6648},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6648":{"gid":6648,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/4265727513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4265727513},{"type":"v1","addr":"172.21.15.50:6834","nonce":4265727513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6648,"qdb_cluster":[6648]},"id":5}]} 2024-09-11T22:15:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 47 2024-09-11T22:15:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.884+0000 7f47774dd640 1 -- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f475c06be30 msgr2=0x7f475c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.884+0000 7f47774dd640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f475c06be30 0x7f475c06e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f47700ca6a0 tx=0x7f4768009040 comp rx=0 tx=0).stop 2024-09-11T22:15:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.884+0000 7f47774dd640 1 -- 172.21.15.50:0/514459332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47700d3a30 msgr2=0x7f477015cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.884+0000 7f47774dd640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47700d3a30 0x7f477015cd30 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f476400e870 tx=0x7f476400ed30 comp rx=0 tx=0).stop 2024-09-11T22:15:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.884+0000 7f47774dd640 1 -- 172.21.15.50:0/514459332 shutdown_connections 2024-09-11T22:15:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.884+0000 7f47774dd640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f475c06be30 0x7f475c06e2f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.884+0000 7f47774dd640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f477015e870 0x7f477015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.884+0000 7f47774dd640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47700d3a30 0x7f477015cd30 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.884+0000 7f47774dd640 1 --2- 172.21.15.50:0/514459332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47700d18a0 0x7f4770157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.884+0000 7f47774dd640 1 -- 172.21.15.50:0/514459332 >> 172.21.15.50:0/514459332 conn(0x7f47700727a0 msgr2=0x7f47700b9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.884+0000 7f47774dd640 1 -- 172.21.15.50:0/514459332 shutdown_connections 2024-09-11T22:15:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:18.884+0000 7f47774dd640 1 -- 172.21.15.50:0/514459332 wait complete. 2024-09-11T22:15:18.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-11T22:15:19.022 INFO:teuthology.orchestra.run.smithi050.stdout:{"message":"","return_code":0} 2024-09-11T22:15:19.023 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-11T22:15:19.023 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:15:19.023 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:15:19.024 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:15:19.024 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:15:19.024 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:15:19.024 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:15:19.024 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:15:19.025 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:15:19.033 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:15:19.034 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:19.035 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:15:19.035 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:19.036 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:15:19.037 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:19.037 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:15:19.037 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:19.038 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-09-11T22:15:19.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.118+0000 7f52fe873f40 1 Processor -- start 2024-09-11T22:15:19.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.118+0000 7f52fe873f40 1 -- start start 2024-09-11T22:15:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fe873f40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8002c80 0x565389bbe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fe873f40 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565389bbb610 0x565389bb25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fe873f40 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565389bbf7e0 0x565389bc01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fe873f40 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x565389a38510 con 0x565389bbf7e0 2024-09-11T22:15:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fe873f40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x565389a91c50 con 0x7f52e8002c80 2024-09-11T22:15:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fe873f40 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x565389bbd2b0 con 0x565389bbb610 2024-09-11T22:15:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fcb6a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565389bbf7e0 0x565389bc01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fcb6a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565389bbf7e0 0x565389bc01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37604/0 (socket says 172.21.15.50:37604) 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fcb6a640 1 -- 172.21.15.50:0/517527496 learned_addr learned my addr 172.21.15.50:0/517527496 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fbb68640 1 --2- 172.21.15.50:0/517527496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565389bbb610 0x565389bb25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fc369640 1 --2- 172.21.15.50:0/517527496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8002c80 0x565389bbe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fcb6a640 1 -- 172.21.15.50:0/517527496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565389bbb610 msgr2=0x565389bb25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fcb6a640 1 --2- 172.21.15.50:0/517527496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565389bbb610 0x565389bb25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fcb6a640 1 -- 172.21.15.50:0/517527496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8002c80 msgr2=0x565389bbe0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fcb6a640 1 --2- 172.21.15.50:0/517527496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8002c80 0x565389bbe0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fcb6a640 1 -- 172.21.15.50:0/517527496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565389b17e60 con 0x565389bbf7e0 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fc369640 1 --2- 172.21.15.50:0/517527496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8002c80 0x565389bbe0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fcb6a640 1 --2- 172.21.15.50:0/517527496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565389bbf7e0 0x565389bc01c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x565389ae50c0 tx=0x7f52ec006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c111c321e9a71f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fab66640 1 -- 172.21.15.50:0/517527496 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec018070 con 0x565389bbf7e0 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fab66640 1 -- 172.21.15.50:0/517527496 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ec006e00 con 0x565389bbf7e0 2024-09-11T22:15:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.119+0000 7f52fab66640 1 -- 172.21.15.50:0/517527496 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0106e0 con 0x565389bbf7e0 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.120+0000 7f52fe873f40 1 -- 172.21.15.50:0/517527496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565389bbf7e0 msgr2=0x565389bc01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.120+0000 7f52fe873f40 1 --2- 172.21.15.50:0/517527496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565389bbf7e0 0x565389bc01c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x565389ae50c0 tx=0x7f52ec006430 comp rx=0 tx=0).stop 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.120+0000 7f52fe873f40 1 -- 172.21.15.50:0/517527496 shutdown_connections 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.120+0000 7f52fe873f40 1 --2- 172.21.15.50:0/517527496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565389bbb610 0x565389bb25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.120+0000 7f52fe873f40 1 --2- 172.21.15.50:0/517527496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565389bbf7e0 0x565389bc01c0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.120+0000 7f52fe873f40 1 --2- 172.21.15.50:0/517527496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8002c80 0x565389bbe0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.120+0000 7f52fe873f40 1 -- 172.21.15.50:0/517527496 >> 172.21.15.50:0/517527496 conn(0x565389ae5a80 msgr2=0x565389bbe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.120+0000 7f52fe873f40 1 -- 172.21.15.50:0/517527496 shutdown_connections 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.120+0000 7f52fe873f40 1 -- 172.21.15.50:0/517527496 wait complete. 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.121+0000 7f52fe873f40 1 Processor -- start 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.121+0000 7f52fe873f40 1 -- start start 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.121+0000 7f52fe873f40 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565389bbb610 0x565389b11210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.121+0000 7f52fe873f40 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565389bbf7e0 0x565389bacaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.121+0000 7f52fe873f40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8002c80 0x565389bbe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.121+0000 7f52fe873f40 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x565389ae8540 con 0x565389bbb610 2024-09-11T22:15:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.121+0000 7f52fe873f40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x565389bb2b10 con 0x7f52e8002c80 2024-09-11T22:15:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.121+0000 7f52fe873f40 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x565389bbf2c0 con 0x565389bbf7e0 2024-09-11T22:15:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.121+0000 7f52fc369640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565389bbb610 0x565389b11210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.121+0000 7f52fc369640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565389bbb610 0x565389b11210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37616/0 (socket says 172.21.15.50:37616) 2024-09-11T22:15:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.121+0000 7f52fc369640 1 -- 172.21.15.50:0/2347313034 learned_addr learned my addr 172.21.15.50:0/2347313034 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.122+0000 7f52fbb68640 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565389bbf7e0 0x565389bacaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.122+0000 7f52fcb6a640 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8002c80 0x565389bbe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.122+0000 7f52fc369640 1 -- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565389bbf7e0 msgr2=0x565389bacaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.122+0000 7f52fc369640 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565389bbf7e0 0x565389bacaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.122+0000 7f52fc369640 1 -- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8002c80 msgr2=0x565389bbe0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.122+0000 7f52fc369640 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e8002c80 0x565389bbe0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.122+0000 7f52fc369640 1 -- 172.21.15.50:0/2347313034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565389b10450 con 0x565389bbb610 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.122+0000 7f52fc369640 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565389bbb610 0x565389b11210 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009fa0 tx=0x7f52f40084c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.122+0000 7f52f9b64640 1 -- 172.21.15.50:0/2347313034 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f401a070 con 0x565389bbb610 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.122+0000 7f52f9b64640 1 -- 172.21.15.50:0/2347313034 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f4016610 con 0x565389bbb610 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.122+0000 7f52f9b64640 1 -- 172.21.15.50:0/2347313034 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f40169c0 con 0x565389bbb610 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.122+0000 7f52fe873f40 1 -- 172.21.15.50:0/2347313034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565389b10730 con 0x565389bbb610 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.122+0000 7f52fe873f40 1 -- 172.21.15.50:0/2347313034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565389b10cf0 con 0x565389bbb610 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.124+0000 7f52f9b64640 1 -- 172.21.15.50:0/2347313034 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52f401d070 con 0x565389bbb610 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.124+0000 7f52f9b64640 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52dc06a810 0x7f52dc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.124+0000 7f52f9b64640 1 -- 172.21.15.50:0/2347313034 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f52f408a260 con 0x565389bbb610 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.124+0000 7f52fe873f40 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x565389bbe5f0 0x565389c55010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.124+0000 7f52fbb68640 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52dc06a810 0x7f52dc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.124+0000 7f52fe873f40 1 -- 172.21.15.50:0/2347313034 --> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) -- 0x565389bad720 con 0x565389bbe5f0 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.124+0000 7f52fcb6a640 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x565389bbe5f0 0x565389c55010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.125+0000 7f52fbb68640 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52dc06a810 0x7f52dc06ccd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f52e400b610 tx=0x7f52e4052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.125+0000 7f52fcb6a640 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x565389bbe5f0 0x565389c55010 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.126+0000 7f52fcb6a640 1 -- 172.21.15.50:0/2347313034 <== osd.4 v2:172.21.15.77:6800/1015337735 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v74'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f52ec01b040 con 0x565389bbe5f0 2024-09-11T22:15:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.126+0000 7f52fe873f40 1 -- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x565389bbe5f0 msgr2=0x565389c55010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.126+0000 7f52fe873f40 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x565389bbe5f0 0x565389c55010 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.126+0000 7f52fe873f40 1 -- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52dc06a810 msgr2=0x7f52dc06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.126+0000 7f52fe873f40 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52dc06a810 0x7f52dc06ccd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f52e400b610 tx=0x7f52e4052000 comp rx=0 tx=0).stop 2024-09-11T22:15:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.126+0000 7f52fe873f40 1 -- 172.21.15.50:0/2347313034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565389bbb610 msgr2=0x565389b11210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.126+0000 7f52fe873f40 1 --2- 172.21.15.50:0/2347313034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565389bbb610 0x565389b11210 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009fa0 tx=0x7f52f40084c0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.126+0000 7f52fcb6a640 1 -- 172.21.15.50:0/2347313034 reap_dead start 2024-09-11T22:15:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.126+0000 7f52fe873f40 1 -- 172.21.15.50:0/2347313034 shutdown_connections 2024-09-11T22:15:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.126+0000 7f52fe873f40 1 -- 172.21.15.50:0/2347313034 >> 172.21.15.50:0/2347313034 conn(0x565389ae5a80 msgr2=0x565389b176b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.126+0000 7f52fe873f40 1 -- 172.21.15.50:0/2347313034 shutdown_connections 2024-09-11T22:15:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.126+0000 7f52fe873f40 1 -- 172.21.15.50:0/2347313034 wait complete. 2024-09-11T22:15:19.133 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-09-11T22:15:19.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-11T22:15:19.134 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-09-11T22:15:19.134 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-11T22:15:19.134 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-09-11T22:15:19.135 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-11T22:15:19.135 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-09-11T22:15:19.135 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-11T22:15:19.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-11T22:15:19.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-11T22:15:19.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-11T22:15:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.243+0000 7f8ac4cf1640 1 Processor -- start 2024-09-11T22:15:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.243+0000 7f98a3af1640 1 Processor -- start 2024-09-11T22:15:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.243+0000 7f12a2f9f640 1 Processor -- start 2024-09-11T22:15:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.243+0000 7f8ac4cf1640 1 -- start start 2024-09-11T22:15:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.243+0000 7f98a3af1640 1 -- start start 2024-09-11T22:15:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.243+0000 7f76d8e0a640 1 Processor -- start 2024-09-11T22:15:19.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.243+0000 7f12a2f9f640 1 -- start start 2024-09-11T22:15:19.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.243+0000 7f76d8e0a640 1 -- start start 2024-09-11T22:15:19.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.244+0000 7f12a2f9f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f129c0679c0 0x7f129c067da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.244+0000 7f8ac4cf1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ac00d18a0 0x7f8ac00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.244+0000 7f8ac4cf1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ac00d3a30 0x7f8ac00b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.244+0000 7f8ac4cf1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac00cfa80 con 0x7f8ac015e870 2024-09-11T22:15:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.244+0000 7f8ac4cf1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac00d3ea0 con 0x7f8ac00d3a30 2024-09-11T22:15:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f12a1f9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f129c0679c0 0x7f129c067da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.244+0000 7f8ac4cf1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac00d40d0 con 0x7f8ac00d18a0 2024-09-11T22:15:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f8abdd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ac00d18a0 0x7f8ac00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f12a1f9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f129c0679c0 0x7f129c067da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37620/0 (socket says 172.21.15.50:37620) 2024-09-11T22:15:19.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f8abdd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ac00d18a0 0x7f8ac00d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:41756/0 (socket says 172.21.15.50:41756) 2024-09-11T22:15:19.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f98a3af1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f989c15e870 0x7f989c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f8abdd9b640 1 -- 172.21.15.50:0/2816213991 learned_addr learned my addr 172.21.15.50:0/2816213991 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:19.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f8abed9d640 1 --2- 172.21.15.50:0/2816213991 >> v2:172.21.15.50:3300/0 conn(0x7f8ac00d3a30 0x7f8ac00b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f98a3af1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f989c0d16d0 0x7f989c0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f12a179c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f129c0b5040 0x7f129c072080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:50488/0 (socket says 172.21.15.50:50488) 2024-09-11T22:15:19.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f12a279e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f129c0b54a0 0x7f129c072790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41180/0 (socket says 172.21.15.50:41180) 2024-09-11T22:15:19.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f8abdd9b640 1 -- 172.21.15.50:0/2816213991 >> v2:172.21.15.50:3300/0 conn(0x7f8ac00d3a30 msgr2=0x7f8ac00b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:19.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f98a188d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f989c15e870 0x7f989c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f98a188d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f989c15e870 0x7f989c0d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:41768/0 (socket says 172.21.15.50:41768) 2024-09-11T22:15:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f12a1f9d640 1 -- 172.21.15.50:0/1147747644 learned_addr learned my addr 172.21.15.50:0/1147747644 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f98a188d640 1 -- 172.21.15.50:0/3868157173 learned_addr learned my addr 172.21.15.50:0/3868157173 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f76d8e0a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f76d415b1e0 0x7f76d415b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f8abdd9b640 1 --2- 172.21.15.50:0/2816213991 >> v2:172.21.15.50:3300/0 conn(0x7f8ac00d3a30 0x7f8ac00b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f76d8e0a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76d415f670 0x7f76d406ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f76d8e0a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d40d0cb0 con 0x7f76d40d0460 2024-09-11T22:15:19.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f76d8e0a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f76d40d0f90 con 0x7f76d415f670 2024-09-11T22:15:19.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f76d8e0a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f76d40d1270 con 0x7f76d415b1e0 2024-09-11T22:15:19.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f98a3af1640 1 -- 172.21.15.50:0/3868157173 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989c0cfa80 con 0x7f989c0d3a30 2024-09-11T22:15:19.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f98a3af1640 1 -- 172.21.15.50:0/3868157173 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f989c0d1b40 con 0x7f989c0d16d0 2024-09-11T22:15:19.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f98a3af1640 1 -- 172.21.15.50:0/3868157173 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f989c0d3e50 con 0x7f989c15e870 2024-09-11T22:15:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f76d1d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f76d40d0460 0x7f76d415ef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41200/0 (socket says 172.21.15.50:41200) 2024-09-11T22:15:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f76d1d9b640 1 -- 172.21.15.50:0/3643123327 learned_addr learned my addr 172.21.15.50:0/3643123327 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f76d2d9d640 1 --2- 172.21.15.50:0/3643123327 >> v2:172.21.15.50:3300/0 conn(0x7f76d415f670 0x7f76d406ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f76d259c640 1 --2- 172.21.15.50:0/3643123327 >> v2:172.21.15.77:3300/0 conn(0x7f76d415b1e0 0x7f76d415b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f8abdd9b640 1 -- 172.21.15.50:0/2816213991 >> v1:172.21.15.50:6789/0 conn(0x7f8ac015e870 legacy=0x7f8ac00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.245+0000 7f8abdd9b640 1 -- 172.21.15.50:0/2816213991 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac00d43b0 con 0x7f8ac00d18a0 2024-09-11T22:15:19.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f98a108c640 1 --2- 172.21.15.50:0/3868157173 >> v2:172.21.15.50:3300/0 conn(0x7f989c0d16d0 0x7f989c0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f76d2d9d640 1 -- 172.21.15.50:0/3643123327 >> v2:172.21.15.77:3300/0 conn(0x7f76d415b1e0 msgr2=0x7f76d415b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f98a188d640 1 -- 172.21.15.50:0/3868157173 >> v2:172.21.15.50:3300/0 conn(0x7f989c0d16d0 msgr2=0x7f989c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:19.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f98a188d640 1 --2- 172.21.15.50:0/3868157173 >> v2:172.21.15.50:3300/0 conn(0x7f989c0d16d0 0x7f989c0d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f98a188d640 1 -- 172.21.15.50:0/3868157173 >> v1:172.21.15.50:6789/0 conn(0x7f989c0d3a30 legacy=0x7f989c0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f98a188d640 1 -- 172.21.15.50:0/3868157173 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c0d40d0 con 0x7f989c15e870 2024-09-11T22:15:19.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f98a108c640 1 --2- 172.21.15.50:0/3868157173 >> v2:172.21.15.50:3300/0 conn(0x7f989c0d16d0 0x7f989c0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:19.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f12a2f9f640 1 -- 172.21.15.50:0/1147747644 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129c072ea0 con 0x7f129c0b54a0 2024-09-11T22:15:19.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f76d2d9d640 1 --2- 172.21.15.50:0/3643123327 >> v2:172.21.15.77:3300/0 conn(0x7f76d415b1e0 0x7f76d415b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f12a2f9f640 1 -- 172.21.15.50:0/1147747644 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129c0b5b00 con 0x7f129c0b5040 2024-09-11T22:15:19.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f76d2d9d640 1 -- 172.21.15.50:0/3643123327 >> v1:172.21.15.50:6789/0 conn(0x7f76d40d0460 legacy=0x7f76d415ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f12a2f9f640 1 -- 172.21.15.50:0/1147747644 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f129c15eb30 con 0x7f129c0679c0 2024-09-11T22:15:19.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f76d2d9d640 1 -- 172.21.15.50:0/3643123327 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d406e200 con 0x7f76d415f670 2024-09-11T22:15:19.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f12a0f9b640 1 -- 172.21.15.50:0/1147747644 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1652085438 0 0) 0x7f129c072ea0 con 0x7f129c0b54a0 2024-09-11T22:15:19.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f12a0f9b640 1 -- 172.21.15.50:0/1147747644 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1288003520 con 0x7f129c0b54a0 2024-09-11T22:15:19.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f12a0f9b640 1 -- 172.21.15.50:0/1147747644 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563008586 0 0) 0x7f129c0b5b00 con 0x7f129c0b5040 2024-09-11T22:15:19.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f8abdd9b640 1 --2- 172.21.15.50:0/2816213991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac00d18a0 0x7f8ac00d34f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8ac006c860 tx=0x7f8ab402a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=133579846aa44328 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f12a0f9b640 1 -- 172.21.15.50:0/1147747644 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f129c072ea0 con 0x7f129c0b5040 2024-09-11T22:15:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f8abd59a640 1 -- 172.21.15.50:0/2816213991 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4037070 con 0x7f8ac00d18a0 2024-09-11T22:15:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f12a1f9d640 1 -- 172.21.15.50:0/1147747644 >> v1:172.21.15.77:6789/0 conn(0x7f129c0b5040 legacy=0x7f129c072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f12a1f9d640 1 -- 172.21.15.50:0/1147747644 >> v1:172.21.15.50:6789/0 conn(0x7f129c0b54a0 legacy=0x7f129c072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f12a1f9d640 1 -- 172.21.15.50:0/1147747644 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c0682e0 con 0x7f129c0679c0 2024-09-11T22:15:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.246+0000 7f8abd59a640 1 -- 172.21.15.50:0/2816213991 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab4032440 con 0x7f8ac00d18a0 2024-09-11T22:15:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f8abd59a640 1 -- 172.21.15.50:0/2816213991 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4032850 con 0x7f8ac00d18a0 2024-09-11T22:15:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f98a188d640 1 --2- 172.21.15.50:0/3868157173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c15e870 0x7f989c0d1190 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f989c0d57c0 tx=0x7f989802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2b37ae7dfc8b17f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f76d2d9d640 1 --2- 172.21.15.50:0/3643123327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76d415f670 0x7f76d406ea00 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f76d406c4a0 tx=0x7f76cc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e183983806f261a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f98a088b640 1 -- 172.21.15.50:0/3868157173 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898037070 con 0x7f989c15e870 2024-09-11T22:15:19.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f98a088b640 1 -- 172.21.15.50:0/3868157173 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9898032440 con 0x7f989c15e870 2024-09-11T22:15:19.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f98a088b640 1 -- 172.21.15.50:0/3868157173 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898032810 con 0x7f989c15e870 2024-09-11T22:15:19.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f76d159a640 1 -- 172.21.15.50:0/3643123327 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc007740 con 0x7f76d415f670 2024-09-11T22:15:19.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f76d159a640 1 -- 172.21.15.50:0/3643123327 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76cc0078e0 con 0x7f76d415f670 2024-09-11T22:15:19.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f76d159a640 1 -- 172.21.15.50:0/3643123327 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc007cb0 con 0x7f76d415f670 2024-09-11T22:15:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2816213991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac00d18a0 msgr2=0x7f8ac00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f8ac4cf1640 1 --2- 172.21.15.50:0/2816213991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac00d18a0 0x7f8ac00d34f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8ac006c860 tx=0x7f8ab402a2a0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2816213991 shutdown_connections 2024-09-11T22:15:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f8ac4cf1640 1 --2- 172.21.15.50:0/2816213991 >> v2:172.21.15.50:3300/0 conn(0x7f8ac00d3a30 0x7f8ac00b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f8ac4cf1640 1 --2- 172.21.15.50:0/2816213991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac00d18a0 0x7f8ac00d34f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2816213991 >> 172.21.15.50:0/2816213991 conn(0x7f8ac00727a0 msgr2=0x7f8ac00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:19.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f12a1f9d640 1 --2- 172.21.15.50:0/1147747644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c0679c0 0x7f129c067da0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f1298009870 tx=0x7f129802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f430d7219454562 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.247+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2816213991 shutdown_connections 2024-09-11T22:15:19.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2816213991 wait complete. 2024-09-11T22:15:19.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f12a0f9b640 1 -- 172.21.15.50:0/1147747644 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298037070 con 0x7f129c0679c0 2024-09-11T22:15:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f12a0f9b640 1 -- 172.21.15.50:0/1147747644 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129802ae50 con 0x7f129c0679c0 2024-09-11T22:15:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f12a0f9b640 1 -- 172.21.15.50:0/1147747644 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298032860 con 0x7f129c0679c0 2024-09-11T22:15:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f98a3af1640 1 -- 172.21.15.50:0/3868157173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c15e870 msgr2=0x7f989c0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f98a3af1640 1 --2- 172.21.15.50:0/3868157173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c15e870 0x7f989c0d1190 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f989c0d57c0 tx=0x7f989802a270 comp rx=0 tx=0).stop 2024-09-11T22:15:19.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f98a3af1640 1 -- 172.21.15.50:0/3868157173 shutdown_connections 2024-09-11T22:15:19.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f98a3af1640 1 --2- 172.21.15.50:0/3868157173 >> v2:172.21.15.50:3300/0 conn(0x7f989c0d16d0 0x7f989c0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f98a3af1640 1 --2- 172.21.15.50:0/3868157173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c15e870 0x7f989c0d1190 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f98a3af1640 1 -- 172.21.15.50:0/3868157173 >> 172.21.15.50:0/3868157173 conn(0x7f989c0727a0 msgr2=0x7f989c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:19.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f98a3af1640 1 -- 172.21.15.50:0/3868157173 shutdown_connections 2024-09-11T22:15:19.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f98a3af1640 1 -- 172.21.15.50:0/3868157173 wait complete. 2024-09-11T22:15:19.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f76d8e0a640 1 -- 172.21.15.50:0/3643123327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76d415f670 msgr2=0x7f76d406ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f76d8e0a640 1 --2- 172.21.15.50:0/3643123327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76d415f670 0x7f76d406ea00 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f76d406c4a0 tx=0x7f76cc02a680 comp rx=0 tx=0).stop 2024-09-11T22:15:19.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f76d8e0a640 1 -- 172.21.15.50:0/3643123327 shutdown_connections 2024-09-11T22:15:19.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f76d8e0a640 1 --2- 172.21.15.50:0/3643123327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76d415f670 0x7f76d406ea00 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f76d8e0a640 1 --2- 172.21.15.50:0/3643123327 >> v2:172.21.15.77:3300/0 conn(0x7f76d415b1e0 0x7f76d415b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f76d8e0a640 1 -- 172.21.15.50:0/3643123327 >> 172.21.15.50:0/3643123327 conn(0x7f76d4075030 msgr2=0x7f76d406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:19.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f76d8e0a640 1 -- 172.21.15.50:0/3643123327 shutdown_connections 2024-09-11T22:15:19.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f12a2f9f640 1 -- 172.21.15.50:0/1147747644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c0679c0 msgr2=0x7f129c067da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f76d8e0a640 1 -- 172.21.15.50:0/3643123327 wait complete. 2024-09-11T22:15:19.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.248+0000 7f12a2f9f640 1 --2- 172.21.15.50:0/1147747644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c0679c0 0x7f129c067da0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f1298009870 tx=0x7f129802a300 comp rx=0 tx=0).stop 2024-09-11T22:15:19.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.249+0000 7f12a2f9f640 1 -- 172.21.15.50:0/1147747644 shutdown_connections 2024-09-11T22:15:19.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.249+0000 7f12a2f9f640 1 --2- 172.21.15.50:0/1147747644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c0679c0 0x7f129c067da0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.249+0000 7f12a2f9f640 1 -- 172.21.15.50:0/1147747644 >> 172.21.15.50:0/1147747644 conn(0x7f129c0b3260 msgr2=0x7f129c0b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:19.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.249+0000 7f12a2f9f640 1 -- 172.21.15.50:0/1147747644 shutdown_connections 2024-09-11T22:15:19.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.249+0000 7f12a2f9f640 1 -- 172.21.15.50:0/1147747644 wait complete. 2024-09-11T22:15:19.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.249+0000 7f8ac4cf1640 1 Processor -- start 2024-09-11T22:15:19.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.249+0000 7f8ac4cf1640 1 -- start start 2024-09-11T22:15:19.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.249+0000 7f98a3af1640 1 Processor -- start 2024-09-11T22:15:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.249+0000 7f98a3af1640 1 -- start start 2024-09-11T22:15:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f8ac4cf1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac00d18a0 0x7f8ac0149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f76d8e0a640 1 Processor -- start 2024-09-11T22:15:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f8ac4cf1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac00d3a30 0x7f8ac014a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f8ac4cf1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ac015e870 0x7f8ac015af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f76d8e0a640 1 -- start start 2024-09-11T22:15:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f98a3af1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c0d16d0 0x7f989c157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f8ac4cf1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac015ec50 con 0x7f8ac00d3a30 2024-09-11T22:15:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f8ac4cf1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac00b7ee0 con 0x7f8ac00d18a0 2024-09-11T22:15:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f8ac4cf1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac00b78b0 con 0x7f8ac015e870 2024-09-11T22:15:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f98a3af1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f989c0d3a30 0x7f989c0c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f98a3af1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c15e870 0x7f989c1601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f98a3af1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f989c0b7ee0 con 0x7f989c15e870 2024-09-11T22:15:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f98a3af1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f989c0b7c00 con 0x7f989c0d16d0 2024-09-11T22:15:19.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f98a3af1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f989c15ec50 con 0x7f989c0d3a30 2024-09-11T22:15:19.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f8abdd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac00d3a30 0x7f8ac014a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f8abe59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac00d18a0 0x7f8ac0149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f98a208e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c15e870 0x7f989c1601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f8abdd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac00d3a30 0x7f8ac014a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37650/0 (socket says 172.21.15.50:37650) 2024-09-11T22:15:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f8abdd9b640 1 -- 172.21.15.50:0/2040174428 learned_addr learned my addr 172.21.15.50:0/2040174428 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f8abed9d640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ac015e870 0x7f8ac015af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f98a188d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c0d16d0 0x7f989c157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f98a108c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f989c0d3a30 0x7f989c0c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f98a188d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c0d16d0 0x7f989c157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:41804/0 (socket says 172.21.15.50:41804) 2024-09-11T22:15:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f98a108c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f989c0d3a30 0x7f989c0c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:37264/0 (socket says 172.21.15.50:37264) 2024-09-11T22:15:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f98a188d640 1 -- 172.21.15.50:0/1442280203 learned_addr learned my addr 172.21.15.50:0/1442280203 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f98a208e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c15e870 0x7f989c1601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37658/0 (socket says 172.21.15.50:37658) 2024-09-11T22:15:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.250+0000 7f12a2f9f640 1 Processor -- start 2024-09-11T22:15:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f12a2f9f640 1 -- start start 2024-09-11T22:15:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f8abe59c640 1 -- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ac015e870 msgr2=0x7f8ac015af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f8abe59c640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ac015e870 0x7f8ac015af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f8abe59c640 1 -- 172.21.15.50:0/2040174428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac00d3a30 msgr2=0x7f8ac014a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f8abe59c640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac00d3a30 0x7f8ac014a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f8abe59c640 1 -- 172.21.15.50:0/2040174428 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac00c8290 con 0x7f8ac00d18a0 2024-09-11T22:15:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f8abdd9b640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac00d3a30 0x7f8ac014a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f98a108c640 1 -- 172.21.15.50:0/1442280203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c0d16d0 msgr2=0x7f989c157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f98a108c640 1 --2- 172.21.15.50:0/1442280203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c0d16d0 0x7f989c157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f98a108c640 1 -- 172.21.15.50:0/1442280203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c15e870 msgr2=0x7f989c1601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f98a108c640 1 --2- 172.21.15.50:0/1442280203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c15e870 0x7f989c1601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f98a108c640 1 -- 172.21.15.50:0/1442280203 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c0c9590 con 0x7f989c0d3a30 2024-09-11T22:15:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f98a208e640 1 --2- 172.21.15.50:0/1442280203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c15e870 0x7f989c1601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f8abe59c640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac00d18a0 0x7f8ac0149c70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000c340 tx=0x7f8ab000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f98a108c640 1 --2- 172.21.15.50:0/1442280203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f989c0d3a30 0x7f989c0c8ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f988c00c7f0 tx=0x7f988c00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f76d8e0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d40d0460 0x7f76d4146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f76d8e0a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76d415b1e0 0x7f76d4157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f76d8e0a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76d415f670 0x7f76d4159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f76d8e0a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f76d40d0a50 con 0x7f76d415f670 2024-09-11T22:15:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f98927fc640 1 -- 172.21.15.50:0/1442280203 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c015070 con 0x7f989c0d3a30 2024-09-11T22:15:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f98927fc640 1 -- 172.21.15.50:0/1442280203 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f988c004220 con 0x7f989c0d3a30 2024-09-11T22:15:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f98927fc640 1 -- 172.21.15.50:0/1442280203 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c007620 con 0x7f989c0d3a30 2024-09-11T22:15:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f76d8e0a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f76d40d08d0 con 0x7f76d40d0460 2024-09-11T22:15:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f98a3af1640 1 -- 172.21.15.50:0/1442280203 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989c0c9870 con 0x7f989c0d3a30 2024-09-11T22:15:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f76d8e0a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f76d415fae0 con 0x7f76d415b1e0 2024-09-11T22:15:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f8aaeffd640 1 -- 172.21.15.50:0/2040174428 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00052d0 con 0x7f8ac00d18a0 2024-09-11T22:15:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f8aaeffd640 1 -- 172.21.15.50:0/2040174428 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab0005490 con 0x7f8ac00d18a0 2024-09-11T22:15:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f76d2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76d415f670 0x7f76d4159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f76d2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76d415f670 0x7f76d4159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37668/0 (socket says 172.21.15.50:37668) 2024-09-11T22:15:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f76d2d9d640 1 -- 172.21.15.50:0/1325386515 learned_addr learned my addr 172.21.15.50:0/1325386515 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a2f9f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f129c0b5040 0x7f129c1f3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.251+0000 7f8aaeffd640 1 -- 172.21.15.50:0/2040174428 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0007260 con 0x7f8ac00d18a0 2024-09-11T22:15:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2040174428 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac00c8570 con 0x7f8ac00d18a0 2024-09-11T22:15:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2040174428 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac00c8b30 con 0x7f8ac00d18a0 2024-09-11T22:15:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f98a3af1640 1 -- 172.21.15.50:0/1442280203 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f989c0c9e30 con 0x7f989c0d3a30 2024-09-11T22:15:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f76d259c640 1 --2- 172.21.15.50:0/1325386515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d40d0460 0x7f76d4146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a2f9f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c0b54a0 0x7f129c0d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a2f9f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f129c15c220 0x7f129c0cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a2f9f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f129c15f350 con 0x7f129c0b54a0 2024-09-11T22:15:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a2f9f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f129c15f070 con 0x7f129c15c220 2024-09-11T22:15:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a2f9f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f129c162ed0 con 0x7f129c0b5040 2024-09-11T22:15:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a279e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f129c15c220 0x7f129c0cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f76d2d9d640 1 -- 172.21.15.50:0/1325386515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76d415b1e0 msgr2=0x7f76d4157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f76d2d9d640 1 --2- 172.21.15.50:0/1325386515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76d415b1e0 0x7f76d4157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f76d2d9d640 1 -- 172.21.15.50:0/1325386515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d40d0460 msgr2=0x7f76d4146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f76d2d9d640 1 --2- 172.21.15.50:0/1325386515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d40d0460 0x7f76d4146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f76d2d9d640 1 -- 172.21.15.50:0/1325386515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d41582f0 con 0x7f76d415f670 2024-09-11T22:15:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a279e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f129c15c220 0x7f129c0cf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:41830/0 (socket says 172.21.15.50:41830) 2024-09-11T22:15:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a279e640 1 -- 172.21.15.50:0/2215240518 learned_addr learned my addr 172.21.15.50:0/2215240518 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a279e640 1 -- 172.21.15.50:0/2215240518 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f129c0b5040 msgr2=0x7f129c1f3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a279e640 1 --2- 172.21.15.50:0/2215240518 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f129c0b5040 0x7f129c1f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a279e640 1 -- 172.21.15.50:0/2215240518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c0b54a0 msgr2=0x7f129c0d06b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:15:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a279e640 1 --2- 172.21.15.50:0/2215240518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c0b54a0 0x7f129c0d06b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f12a279e640 1 -- 172.21.15.50:0/2215240518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c159350 con 0x7f129c15c220 2024-09-11T22:15:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.253+0000 7f12a279e640 1 --2- 172.21.15.50:0/2215240518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f129c15c220 0x7f129c0cf8e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f129400c730 tx=0x7f129400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.252+0000 7f76d2d9d640 1 --2- 172.21.15.50:0/1325386515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76d415f670 0x7f76d4159320 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f76cc02ac70 tx=0x7f76cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.253+0000 7f12927fc640 1 -- 172.21.15.50:0/2215240518 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1294017070 con 0x7f129c15c220 2024-09-11T22:15:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.253+0000 7f76c2ffd640 1 -- 172.21.15.50:0/1325386515 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc03f070 con 0x7f76d415f670 2024-09-11T22:15:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.253+0000 7f76c2ffd640 1 -- 172.21.15.50:0/1325386515 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76cc044460 con 0x7f76d415f670 2024-09-11T22:15:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.253+0000 7f76d8e0a640 1 -- 172.21.15.50:0/1325386515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d41564f0 con 0x7f76d415f670 2024-09-11T22:15:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.253+0000 7f98a3af1640 1 -- 172.21.15.50:0/1442280203 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f989c06bce0 con 0x7f989c0d3a30 2024-09-11T22:15:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.253+0000 7f76c2ffd640 1 -- 172.21.15.50:0/1325386515 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc009450 con 0x7f76d415f670 2024-09-11T22:15:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.253+0000 7f76d8e0a640 1 -- 172.21.15.50:0/1325386515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d41530d0 con 0x7f76d415f670 2024-09-11T22:15:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.253+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2040174428 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac00d34d0 con 0x7f8ac00d18a0 2024-09-11T22:15:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.254+0000 7f8aaeffd640 1 -- 172.21.15.50:0/2040174428 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ab0007400 con 0x7f8ac00d18a0 2024-09-11T22:15:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.253+0000 7f12927fc640 1 -- 172.21.15.50:0/2215240518 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129400ce40 con 0x7f129c15c220 2024-09-11T22:15:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.253+0000 7f12927fc640 1 -- 172.21.15.50:0/2215240518 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129400a800 con 0x7f129c15c220 2024-09-11T22:15:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.253+0000 7f12a2f9f640 1 -- 172.21.15.50:0/2215240518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f129c159630 con 0x7f129c15c220 2024-09-11T22:15:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.253+0000 7f12a2f9f640 1 -- 172.21.15.50:0/2215240518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f129c15bd00 con 0x7f129c15c220 2024-09-11T22:15:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.254+0000 7f12a2f9f640 1 -- 172.21.15.50:0/2215240518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f129c155860 con 0x7f129c15c220 2024-09-11T22:15:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.254+0000 7f8aaeffd640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8aa006be80 0x7f8aa006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.255+0000 7f8aaeffd640 1 -- 172.21.15.50:0/2040174428 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f8ab008a110 con 0x7f8ac00d18a0 2024-09-11T22:15:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.255+0000 7f76d8e0a640 1 -- 172.21.15.50:0/1325386515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b8005290 con 0x7f76d415f670 2024-09-11T22:15:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.255+0000 7f98927fc640 1 -- 172.21.15.50:0/1442280203 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f988c0079d0 con 0x7f989c0d3a30 2024-09-11T22:15:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.255+0000 7f8abdd9b640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8aa006be80 0x7f8aa006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.255+0000 7f76c2ffd640 1 -- 172.21.15.50:0/1325386515 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76cc007790 con 0x7f76d415f670 2024-09-11T22:15:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.255+0000 7f98927fc640 1 --2- 172.21.15.50:0/1442280203 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f988006be30 0x7f988006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.255+0000 7f8abdd9b640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8aa006be80 0x7f8aa006e340 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4035040 tx=0x7f8ab402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.256+0000 7f98927fc640 1 -- 172.21.15.50:0/1442280203 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f988c08adf0 con 0x7f989c0d3a30 2024-09-11T22:15:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.256+0000 7f98a188d640 1 --2- 172.21.15.50:0/1442280203 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f988006be30 0x7f988006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.256+0000 7f12927fc640 1 -- 172.21.15.50:0/2215240518 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f129401a070 con 0x7f129c15c220 2024-09-11T22:15:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.256+0000 7f76c2ffd640 1 --2- 172.21.15.50:0/1325386515 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f76b406be80 0x7f76b406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.256+0000 7f76c2ffd640 1 -- 172.21.15.50:0/1325386515 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f76cc0ac470 con 0x7f76d415f670 2024-09-11T22:15:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.256+0000 7f76d259c640 1 --2- 172.21.15.50:0/1325386515 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f76b406be80 0x7f76b406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.256+0000 7f12927fc640 1 --2- 172.21.15.50:0/2215240518 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f128006bf00 0x7f128006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.256+0000 7f98a188d640 1 --2- 172.21.15.50:0/1442280203 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f988006be30 0x7f988006e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9898009280 tx=0x7f989802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.256+0000 7f12927fc640 1 -- 172.21.15.50:0/2215240518 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5709+0+0 (secure 0 0 0) 0x7f129408a7e0 con 0x7f129c15c220 2024-09-11T22:15:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.256+0000 7f12a1f9d640 1 --2- 172.21.15.50:0/2215240518 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f128006bf00 0x7f128006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.257+0000 7f76d259c640 1 --2- 172.21.15.50:0/1325386515 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f76b406be80 0x7f76b406e340 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f76c4006fd0 tx=0x7f76c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.257+0000 7f12a1f9d640 1 --2- 172.21.15.50:0/2215240518 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f128006bf00 0x7f128006e3c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1298034000 tx=0x7f129802c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.259+0000 7f8aaeffd640 1 -- 172.21.15.50:0/2040174428 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ac00cfa80 con 0x7f8ac00d18a0 2024-09-11T22:15:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.260+0000 7f76c2ffd640 1 -- 172.21.15.50:0/1325386515 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76cc07af10 con 0x7f76d415f670 2024-09-11T22:15:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.261+0000 7f98927fc640 1 -- 172.21.15.50:0/1442280203 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f988c0591e0 con 0x7f989c0d3a30 2024-09-11T22:15:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.264+0000 7f12927fc640 1 -- 172.21.15.50:0/2215240518 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1294058b20 con 0x7f129c15c220 2024-09-11T22:15:19.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.506+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2040174428 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f8ac014a9e0 con 0x7f8ac00d18a0 2024-09-11T22:15:19.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.506+0000 7f98a3af1640 1 -- 172.21.15.50:0/1442280203 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f989c15cca0 con 0x7f989c0d3a30 2024-09-11T22:15:19.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.507+0000 7f76d8e0a640 1 -- 172.21.15.50:0/1325386515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f76b8005850 con 0x7f76d415f670 2024-09-11T22:15:19.508 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:15:19.507+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:15:19.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.510+0000 7f12a2f9f640 1 -- 172.21.15.50:0/2215240518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f129c147dc0 con 0x7f129c15c220 2024-09-11T22:15:19.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.513+0000 7f8aaeffd640 1 -- 172.21.15.50:0/2040174428 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6648 v48) ==== 95+0+0 (secure 0 0 0) 0x7f8ab0058550 con 0x7f8ac00d18a0 2024-09-11T22:15:19.513 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 6648 2024-09-11T22:15:19.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.514+0000 7f76c2ffd640 1 -- 172.21.15.50:0/1325386515 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6151 v49) ==== 95+0+0 (secure 0 0 0) 0x7f76cc07a810 con 0x7f76d415f670 2024-09-11T22:15:19.514 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 6151 2024-09-11T22:15:19.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.515+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8aa006be80 msgr2=0x7f8aa006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.515+0000 7f8ac4cf1640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8aa006be80 0x7f8aa006e340 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4035040 tx=0x7f8ab402e000 comp rx=0 tx=0).stop 2024-09-11T22:15:19.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.515+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac00d18a0 msgr2=0x7f8ac0149c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.515+0000 7f8ac4cf1640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac00d18a0 0x7f8ac0149c70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000c340 tx=0x7f8ab000c800 comp rx=0 tx=0).stop 2024-09-11T22:15:19.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.515+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2040174428 shutdown_connections 2024-09-11T22:15:19.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.515+0000 7f8ac4cf1640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8aa006be80 0x7f8aa006e340 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.515+0000 7f8ac4cf1640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ac015e870 0x7f8ac015af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.515+0000 7f8ac4cf1640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac00d3a30 0x7f8ac014a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.515+0000 7f8ac4cf1640 1 --2- 172.21.15.50:0/2040174428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac00d18a0 0x7f8ac0149c70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.515+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2040174428 >> 172.21.15.50:0/2040174428 conn(0x7f8ac00727a0 msgr2=0x7f8ac00b63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:19.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.515+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2040174428 shutdown_connections 2024-09-11T22:15:19.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.515+0000 7f8ac4cf1640 1 -- 172.21.15.50:0/2040174428 wait complete. 2024-09-11T22:15:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.516+0000 7f76d8e0a640 1 -- 172.21.15.50:0/1325386515 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f76b406be80 msgr2=0x7f76b406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.517+0000 7f76d8e0a640 1 --2- 172.21.15.50:0/1325386515 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f76b406be80 0x7f76b406e340 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f76c4006fd0 tx=0x7f76c4008040 comp rx=0 tx=0).stop 2024-09-11T22:15:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.517+0000 7f76d8e0a640 1 -- 172.21.15.50:0/1325386515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76d415f670 msgr2=0x7f76d4159320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.517+0000 7f76d8e0a640 1 --2- 172.21.15.50:0/1325386515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76d415f670 0x7f76d4159320 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f76cc02ac70 tx=0x7f76cc004a40 comp rx=0 tx=0).stop 2024-09-11T22:15:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.517+0000 7f76d8e0a640 1 -- 172.21.15.50:0/1325386515 shutdown_connections 2024-09-11T22:15:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.517+0000 7f76d8e0a640 1 --2- 172.21.15.50:0/1325386515 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f76b406be80 0x7f76b406e340 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.517+0000 7f76d8e0a640 1 --2- 172.21.15.50:0/1325386515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76d415b1e0 0x7f76d4157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.517+0000 7f76d8e0a640 1 --2- 172.21.15.50:0/1325386515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76d415f670 0x7f76d4159320 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.517+0000 7f76d8e0a640 1 --2- 172.21.15.50:0/1325386515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d40d0460 0x7f76d4146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.517+0000 7f76d8e0a640 1 -- 172.21.15.50:0/1325386515 >> 172.21.15.50:0/1325386515 conn(0x7f76d4075030 msgr2=0x7f76d4067fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:19.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.517+0000 7f76d8e0a640 1 -- 172.21.15.50:0/1325386515 shutdown_connections 2024-09-11T22:15:19.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.517+0000 7f76d8e0a640 1 -- 172.21.15.50:0/1325386515 wait complete. 2024-09-11T22:15:19.519 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:15:19.518+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:15:19.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.522+0000 7f12927fc640 1 -- 172.21.15.50:0/2215240518 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6160 v50) ==== 95+0+0 (secure 0 0 0) 0x7f129405ce20 con 0x7f129c15c220 2024-09-11T22:15:19.523 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 6160 2024-09-11T22:15:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.526+0000 7f12a2f9f640 1 -- 172.21.15.50:0/2215240518 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f128006bf00 msgr2=0x7f128006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.526+0000 7f12a2f9f640 1 --2- 172.21.15.50:0/2215240518 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f128006bf00 0x7f128006e3c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1298034000 tx=0x7f129802c000 comp rx=0 tx=0).stop 2024-09-11T22:15:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.526+0000 7f12a2f9f640 1 -- 172.21.15.50:0/2215240518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f129c15c220 msgr2=0x7f129c0cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.526+0000 7f12a2f9f640 1 --2- 172.21.15.50:0/2215240518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f129c15c220 0x7f129c0cf8e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f129400c730 tx=0x7f129400cbf0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.526+0000 7f12a2f9f640 1 -- 172.21.15.50:0/2215240518 shutdown_connections 2024-09-11T22:15:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.526+0000 7f12a2f9f640 1 --2- 172.21.15.50:0/2215240518 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f128006bf00 0x7f128006e3c0 secure :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1298034000 tx=0x7f129802c000 comp rx=0 tx=0).stop 2024-09-11T22:15:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.526+0000 7f12a2f9f640 1 --2- 172.21.15.50:0/2215240518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f129c15c220 0x7f129c0cf8e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.526+0000 7f12a2f9f640 1 --2- 172.21.15.50:0/2215240518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129c0b54a0 0x7f129c0d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.526+0000 7f12a2f9f640 1 --2- 172.21.15.50:0/2215240518 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f129c0b5040 0x7f129c1f3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.526+0000 7f12a2f9f640 1 -- 172.21.15.50:0/2215240518 >> 172.21.15.50:0/2215240518 conn(0x7f129c0b3260 msgr2=0x7f129c160350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.526+0000 7f12a2f9f640 1 -- 172.21.15.50:0/2215240518 shutdown_connections 2024-09-11T22:15:19.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.526+0000 7f12a2f9f640 1 -- 172.21.15.50:0/2215240518 wait complete. 2024-09-11T22:15:19.531 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:15:19.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:15:19.532 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:15:19.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:15:19.538 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:15:19.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:15:19.539 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:15:19.540 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:19.542 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:15:19.542 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:19.582 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:15:19.582 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:19.615 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:15:19.622 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:15:19.635 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:15:19.634+0000 7f2a090cb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:15:19.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.639+0000 7f98927fc640 1 -- 172.21.15.50:0/1442280203 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6157 v52) ==== 95+0+0 (secure 0 0 0) 0x7f988c05d4e0 con 0x7f989c0d3a30 2024-09-11T22:15:19.640 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 6157 2024-09-11T22:15:19.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.643+0000 7f98a3af1640 1 -- 172.21.15.50:0/1442280203 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f988006be30 msgr2=0x7f988006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.643+0000 7f98a3af1640 1 --2- 172.21.15.50:0/1442280203 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f988006be30 0x7f988006e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9898009280 tx=0x7f989802e000 comp rx=0 tx=0).stop 2024-09-11T22:15:19.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.643+0000 7f98a3af1640 1 -- 172.21.15.50:0/1442280203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f989c0d3a30 msgr2=0x7f989c0c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.643+0000 7f98a3af1640 1 --2- 172.21.15.50:0/1442280203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f989c0d3a30 0x7f989c0c8ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f988c00c7f0 tx=0x7f988c00ccb0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.643+0000 7f98a3af1640 1 -- 172.21.15.50:0/1442280203 shutdown_connections 2024-09-11T22:15:19.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.643+0000 7f98a3af1640 1 --2- 172.21.15.50:0/1442280203 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f988006be30 0x7f988006e2f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.643+0000 7f98a3af1640 1 --2- 172.21.15.50:0/1442280203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f989c0d3a30 0x7f989c0c8ad0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.643+0000 7f98a3af1640 1 --2- 172.21.15.50:0/1442280203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c15e870 0x7f989c1601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.643+0000 7f98a3af1640 1 --2- 172.21.15.50:0/1442280203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c0d16d0 0x7f989c157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.643+0000 7f98a3af1640 1 -- 172.21.15.50:0/1442280203 >> 172.21.15.50:0/1442280203 conn(0x7f989c0727a0 msgr2=0x7f989c15d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:19.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.643+0000 7f98a3af1640 1 -- 172.21.15.50:0/1442280203 shutdown_connections 2024-09-11T22:15:19.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.643+0000 7f98a3af1640 1 -- 172.21.15.50:0/1442280203 wait complete. 2024-09-11T22:15:19.660 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:15:19.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:15:19.662 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:15:19.662 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:19.662 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:19.664 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:15:19.734 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:15:19.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.765+0000 7f8bec731640 1 Processor -- start 2024-09-11T22:15:19.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.765+0000 7f8bec731640 1 -- start start 2024-09-11T22:15:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.766+0000 7f8bec731640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8be40cf580 0x7f8be40b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.766+0000 7f8bec731640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8be40cdd50 0x7f8be406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.766+0000 7f8bec731640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8be40ce5f0 con 0x7f8be415e840 2024-09-11T22:15:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.766+0000 7f8bec731640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8be406c240 con 0x7f8be40cdd50 2024-09-11T22:15:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.766+0000 7f8bec731640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8be40d0470 con 0x7f8be40cf580 2024-09-11T22:15:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.766+0000 7f8beacce640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8be40cdd50 0x7f8be406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.766+0000 7f8beacce640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8be40cdd50 0x7f8be406c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37700/0 (socket says 172.21.15.50:37700) 2024-09-11T22:15:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.766+0000 7f8beacce640 1 -- 172.21.15.50:0/479002387 learned_addr learned my addr 172.21.15.50:0/479002387 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.766+0000 7f8be9ccc640 1 --2- 172.21.15.50:0/479002387 >> v2:172.21.15.77:3300/0 conn(0x7f8be40cf580 0x7f8be40b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.766+0000 7f8beacce640 1 -- 172.21.15.50:0/479002387 >> v2:172.21.15.77:3300/0 conn(0x7f8be40cf580 msgr2=0x7f8be40b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.766+0000 7f8beacce640 1 --2- 172.21.15.50:0/479002387 >> v2:172.21.15.77:3300/0 conn(0x7f8be40cf580 0x7f8be40b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.766+0000 7f8beacce640 1 -- 172.21.15.50:0/479002387 >> v1:172.21.15.77:6789/0 conn(0x7f8be415e840 legacy=0x7f8be40cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.766+0000 7f8beacce640 1 -- 172.21.15.50:0/479002387 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be40ce310 con 0x7f8be40cdd50 2024-09-11T22:15:19.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.767+0000 7f8beacce640 1 --2- 172.21.15.50:0/479002387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be40cdd50 0x7f8be406c6d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f8be40731c0 tx=0x7f8bdc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd99a7228ef45adb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.767+0000 7f8be94cb640 1 -- 172.21.15.50:0/479002387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc036070 con 0x7f8be40cdd50 2024-09-11T22:15:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.767+0000 7f8be94cb640 1 -- 172.21.15.50:0/479002387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bdc031600 con 0x7f8be40cdd50 2024-09-11T22:15:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.767+0000 7f8be94cb640 1 -- 172.21.15.50:0/479002387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0319d0 con 0x7f8be40cdd50 2024-09-11T22:15:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.768+0000 7f8bec731640 1 -- 172.21.15.50:0/479002387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be40cdd50 msgr2=0x7f8be406c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.768+0000 7f8bec731640 1 --2- 172.21.15.50:0/479002387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be40cdd50 0x7f8be406c6d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f8be40731c0 tx=0x7f8bdc02a730 comp rx=0 tx=0).stop 2024-09-11T22:15:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.768+0000 7f8bec731640 1 -- 172.21.15.50:0/479002387 shutdown_connections 2024-09-11T22:15:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.768+0000 7f8bec731640 1 --2- 172.21.15.50:0/479002387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be40cdd50 0x7f8be406c6d0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.768+0000 7f8bec731640 1 --2- 172.21.15.50:0/479002387 >> v2:172.21.15.77:3300/0 conn(0x7f8be40cf580 0x7f8be40b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.768+0000 7f8bec731640 1 -- 172.21.15.50:0/479002387 >> 172.21.15.50:0/479002387 conn(0x7f8be40b4150 msgr2=0x7f8be40b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.768+0000 7f8bec731640 1 -- 172.21.15.50:0/479002387 shutdown_connections 2024-09-11T22:15:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.768+0000 7f8bec731640 1 -- 172.21.15.50:0/479002387 wait complete. 2024-09-11T22:15:19.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.769+0000 7f8bec731640 1 Processor -- start 2024-09-11T22:15:19.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.769+0000 7f8bec731640 1 -- start start 2024-09-11T22:15:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8bec731640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8be40cdd50 0x7f8be40c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8bec731640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8be40cf580 0x7f8be40b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8bec731640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be415e840 0x7f8be415bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8bec731640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8be415ec20 con 0x7f8be415e840 2024-09-11T22:15:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8bec731640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8be406bed0 con 0x7f8be40cf580 2024-09-11T22:15:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8bec731640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8be415eda0 con 0x7f8be40cdd50 2024-09-11T22:15:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8beacce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be415e840 0x7f8be415bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8beacce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be415e840 0x7f8be415bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37702/0 (socket says 172.21.15.50:37702) 2024-09-11T22:15:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8beacce640 1 -- 172.21.15.50:0/3242379642 learned_addr learned my addr 172.21.15.50:0/3242379642 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8be9ccc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8be40cf580 0x7f8be40b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8bea4cd640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8be40cdd50 0x7f8be40c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8beacce640 1 -- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8be40cdd50 msgr2=0x7f8be40c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8beacce640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8be40cdd50 0x7f8be40c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8beacce640 1 -- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8be40cf580 msgr2=0x7f8be40b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8beacce640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8be40cf580 0x7f8be40b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8beacce640 1 -- 172.21.15.50:0/3242379642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be40b7340 con 0x7f8be415e840 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8be9ccc640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8be40cf580 0x7f8be40b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8beacce640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be415e840 0x7f8be415bcb0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009f40 tx=0x7f8bdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.770+0000 7f8bdaffd640 1 -- 172.21.15.50:0/3242379642 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc036050 con 0x7f8be415e840 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.771+0000 7f8bdaffd640 1 -- 172.21.15.50:0/3242379642 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bdc042070 con 0x7f8be415e840 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.771+0000 7f8bec731640 1 -- 172.21.15.50:0/3242379642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be40b7620 con 0x7f8be415e840 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.771+0000 7f8bdaffd640 1 -- 172.21.15.50:0/3242379642 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc009510 con 0x7f8be415e840 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.771+0000 7f8bec731640 1 -- 172.21.15.50:0/3242379642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be40b7be0 con 0x7f8be415e840 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.771+0000 7f8bec731640 1 -- 172.21.15.50:0/3242379642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be40b4c70 con 0x7f8be415e840 2024-09-11T22:15:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.772+0000 7f8bdaffd640 1 -- 172.21.15.50:0/3242379642 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bdc007bf0 con 0x7f8be415e840 2024-09-11T22:15:19.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.772+0000 7f8bdaffd640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8bc806be30 0x7f8bc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:19.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.773+0000 7f8bdaffd640 1 -- 172.21.15.50:0/3242379642 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7f8bdc0abbc0 con 0x7f8be415e840 2024-09-11T22:15:19.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.773+0000 7f8bea4cd640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8bc806be30 0x7f8bc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:19.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.773+0000 7f8bea4cd640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8bc806be30 0x7f8bc806e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8be0001780 tx=0x7f8be0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:19.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.777+0000 7f8bdaffd640 1 -- 172.21.15.50:0/3242379642 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bdc079eb0 con 0x7f8be415e840 2024-09-11T22:15:19.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.985+0000 7f8bec731640 1 -- 172.21.15.50:0/3242379642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8be40b3ef0 con 0x7f8be415e840 2024-09-11T22:15:19.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.986+0000 7f8bdaffd640 1 -- 172.21.15.50:0/3242379642 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+3566 (secure 0 0 0) 0x7f8bdc07e1b0 con 0x7f8be415e840 2024-09-11T22:15:19.987 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:19.987 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"btime":"2024-09-11T22:15:19:639207+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4081050909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4081050909},{"type":"v1","addr":"172.21.15.77:6835","nonce":4081050909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:06.945196+0000","modified":"2024-09-11T22:15:19.639195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"a","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.50:6833/325962537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":325962537},{"type":"v1","addr":"172.21.15.50:6833","nonce":325962537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-11T22:15:19.987 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 53 2024-09-11T22:15:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.987+0000 7f8bec731640 1 -- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8bc806be30 msgr2=0x7f8bc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.987+0000 7f8bec731640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8bc806be30 0x7f8bc806e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8be0001780 tx=0x7f8be0009040 comp rx=0 tx=0).stop 2024-09-11T22:15:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.987+0000 7f8bec731640 1 -- 172.21.15.50:0/3242379642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be415e840 msgr2=0x7f8be415bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.987+0000 7f8bec731640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be415e840 0x7f8be415bcb0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009f40 tx=0x7f8bdc004a40 comp rx=0 tx=0).stop 2024-09-11T22:15:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.988+0000 7f8bec731640 1 -- 172.21.15.50:0/3242379642 shutdown_connections 2024-09-11T22:15:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.988+0000 7f8bec731640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8bc806be30 0x7f8bc806e2f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.988+0000 7f8bec731640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8be415e840 0x7f8be415bcb0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.988+0000 7f8bec731640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8be40cf580 0x7f8be40b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.988+0000 7f8bec731640 1 --2- 172.21.15.50:0/3242379642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8be40cdd50 0x7f8be40c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:19.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.988+0000 7f8bec731640 1 -- 172.21.15.50:0/3242379642 >> 172.21.15.50:0/3242379642 conn(0x7f8be40b4150 msgr2=0x7f8be40cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:19.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.988+0000 7f8bec731640 1 -- 172.21.15.50:0/3242379642 shutdown_connections 2024-09-11T22:15:19.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:19.988+0000 7f8bec731640 1 -- 172.21.15.50:0/3242379642 wait complete. 2024-09-11T22:15:20.402 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:15:06.945196+0000', 'modified': '2024-09-11T22:15:19.639195+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 78, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6885}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6885': {'gid': 6885, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.50:6833/325962537', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 325962537}, {'type': 'v1', 'addr': '172.21.15.50:6833', 'nonce': 325962537}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-11T22:15:20.402 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6885:up:replay 2024-09-11T22:15:21.403 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:21.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.519+0000 7f4e745d6640 1 Processor -- start 2024-09-11T22:15:21.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.519+0000 7f4e745d6640 1 -- start start 2024-09-11T22:15:21.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.520+0000 7f4e745d6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e6c15c3c0 0x7f4e6c15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:21.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.520+0000 7f4e745d6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4e6c15ec40 0x7f4e6c15f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:21.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.520+0000 7f4e745d6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6c15f7f0 con 0x7f4e6c0679c0 2024-09-11T22:15:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.520+0000 7f4e745d6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4e6c15f5c0 con 0x7f4e6c15ec40 2024-09-11T22:15:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.520+0000 7f4e745d6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6c06e700 con 0x7f4e6c15c3c0 2024-09-11T22:15:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.520+0000 7f4e71b71640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4e6c15ec40 0x7f4e6c15f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.520+0000 7f4e72b73640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4e6c0679c0 0x7f4e6c06f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41212/0 (socket says 172.21.15.50:41212) 2024-09-11T22:15:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.520+0000 7f4e72b73640 1 -- 172.21.15.50:0/4061636666 learned_addr learned my addr 172.21.15.50:0/4061636666 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.520+0000 7f4e72372640 1 --2- 172.21.15.50:0/4061636666 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e6c15c3c0 0x7f4e6c15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.521+0000 7f4e71b71640 1 -- 172.21.15.50:0/4061636666 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e6c15c3c0 msgr2=0x7f4e6c15fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.521+0000 7f4e71b71640 1 --2- 172.21.15.50:0/4061636666 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e6c15c3c0 0x7f4e6c15fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.521+0000 7f4e71b71640 1 -- 172.21.15.50:0/4061636666 >> v1:172.21.15.50:6789/0 conn(0x7f4e6c0679c0 legacy=0x7f4e6c06f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.521+0000 7f4e71b71640 1 -- 172.21.15.50:0/4061636666 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c15fad0 con 0x7f4e6c15ec40 2024-09-11T22:15:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.521+0000 7f4e71370640 1 -- 172.21.15.50:0/4061636666 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353480488 0 0) 0x7f4e6c15f7f0 con 0x7f4e6c0679c0 2024-09-11T22:15:21.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.521+0000 7f4e71b71640 1 --2- 172.21.15.50:0/4061636666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c15ec40 0x7f4e6c15f080 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0097a0 tx=0x7f4e5c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb87bafb49edded0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:21.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.521+0000 7f4e71370640 1 -- 172.21.15.50:0/4061636666 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c037070 con 0x7f4e6c15ec40 2024-09-11T22:15:21.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.522+0000 7f4e71370640 1 -- 172.21.15.50:0/4061636666 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5c02ae50 con 0x7f4e6c15ec40 2024-09-11T22:15:21.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.522+0000 7f4e71370640 1 -- 172.21.15.50:0/4061636666 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c032660 con 0x7f4e6c15ec40 2024-09-11T22:15:21.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.522+0000 7f4e745d6640 1 -- 172.21.15.50:0/4061636666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c15ec40 msgr2=0x7f4e6c15f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:21.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.522+0000 7f4e745d6640 1 --2- 172.21.15.50:0/4061636666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c15ec40 0x7f4e6c15f080 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0097a0 tx=0x7f4e5c02a100 comp rx=0 tx=0).stop 2024-09-11T22:15:21.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.522+0000 7f4e745d6640 1 -- 172.21.15.50:0/4061636666 shutdown_connections 2024-09-11T22:15:21.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.522+0000 7f4e745d6640 1 --2- 172.21.15.50:0/4061636666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c15ec40 0x7f4e6c15f080 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:21.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.522+0000 7f4e745d6640 1 --2- 172.21.15.50:0/4061636666 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e6c15c3c0 0x7f4e6c15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:21.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.522+0000 7f4e745d6640 1 -- 172.21.15.50:0/4061636666 >> 172.21.15.50:0/4061636666 conn(0x7f4e6c075060 msgr2=0x7f4e6c06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:21.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.522+0000 7f4e745d6640 1 -- 172.21.15.50:0/4061636666 shutdown_connections 2024-09-11T22:15:21.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.522+0000 7f4e745d6640 1 -- 172.21.15.50:0/4061636666 wait complete. 2024-09-11T22:15:21.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.523+0000 7f4e745d6640 1 Processor -- start 2024-09-11T22:15:21.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.523+0000 7f4e745d6640 1 -- start start 2024-09-11T22:15:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.524+0000 7f4e745d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0679c0 0x7f4e6c153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.524+0000 7f4e745d6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e6c15c3c0 0x7f4e6c1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.524+0000 7f4e745d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e6c15ec40 0x7f4e6c148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.524+0000 7f4e745d6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c0d0940 con 0x7f4e6c0679c0 2024-09-11T22:15:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.524+0000 7f4e745d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c06ec30 con 0x7f4e6c15ec40 2024-09-11T22:15:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.524+0000 7f4e745d6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6c067e00 con 0x7f4e6c15c3c0 2024-09-11T22:15:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.524+0000 7f4e72372640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0679c0 0x7f4e6c153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.524+0000 7f4e72372640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0679c0 0x7f4e6c153b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37722/0 (socket says 172.21.15.50:37722) 2024-09-11T22:15:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.524+0000 7f4e72372640 1 -- 172.21.15.50:0/682922842 learned_addr learned my addr 172.21.15.50:0/682922842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.525+0000 7f4e72b73640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e6c15ec40 0x7f4e6c148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:21.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.525+0000 7f4e71b71640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e6c15c3c0 0x7f4e6c1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.525+0000 7f4e72372640 1 -- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e6c15c3c0 msgr2=0x7f4e6c1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.525+0000 7f4e72372640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e6c15c3c0 0x7f4e6c1590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.525+0000 7f4e72372640 1 -- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e6c15ec40 msgr2=0x7f4e6c148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.525+0000 7f4e72372640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e6c15ec40 0x7f4e6c148a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.525+0000 7f4e72372640 1 -- 172.21.15.50:0/682922842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c152d60 con 0x7f4e6c0679c0 2024-09-11T22:15:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.525+0000 7f4e72372640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0679c0 0x7f4e6c153b20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800e9b0 tx=0x7f4e6800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.525+0000 7f4e62ffd640 1 -- 172.21.15.50:0/682922842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68017070 con 0x7f4e6c0679c0 2024-09-11T22:15:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.525+0000 7f4e62ffd640 1 -- 172.21.15.50:0/682922842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6800c9a0 con 0x7f4e6c0679c0 2024-09-11T22:15:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.525+0000 7f4e745d6640 1 -- 172.21.15.50:0/682922842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6c153040 con 0x7f4e6c0679c0 2024-09-11T22:15:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.525+0000 7f4e62ffd640 1 -- 172.21.15.50:0/682922842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6800cd90 con 0x7f4e6c0679c0 2024-09-11T22:15:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.525+0000 7f4e745d6640 1 -- 172.21.15.50:0/682922842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e6c153600 con 0x7f4e6c0679c0 2024-09-11T22:15:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.526+0000 7f4e745d6640 1 -- 172.21.15.50:0/682922842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e6c06cae0 con 0x7f4e6c0679c0 2024-09-11T22:15:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.527+0000 7f4e62ffd640 1 -- 172.21.15.50:0/682922842 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e6801a070 con 0x7f4e6c0679c0 2024-09-11T22:15:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.527+0000 7f4e62ffd640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e5006be30 0x7f4e5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.527+0000 7f4e62ffd640 1 -- 172.21.15.50:0/682922842 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7f4e6808b2e0 con 0x7f4e6c0679c0 2024-09-11T22:15:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.527+0000 7f4e71b71640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e5006be30 0x7f4e5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:21.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.528+0000 7f4e71b71640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e5006be30 0x7f4e5006e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c034000 tx=0x7f4e5c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:21.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.532+0000 7f4e62ffd640 1 -- 172.21.15.50:0/682922842 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e68059b90 con 0x7f4e6c0679c0 2024-09-11T22:15:21.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.743+0000 7f4e745d6640 1 -- 172.21.15.50:0/682922842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e6c15b350 con 0x7f4e6c0679c0 2024-09-11T22:15:21.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.744+0000 7f4e62ffd640 1 -- 172.21.15.50:0/682922842 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5213 (secure 0 0 0) 0x7f4e68059490 con 0x7f4e6c0679c0 2024-09-11T22:15:21.745 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:21.745 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":55,"btime":"2024-09-11T22:15:21:642513+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4081050909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4081050909},{"type":"v1","addr":"172.21.15.77:6835","nonce":4081050909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6340,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/502868531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":502868531},{"type":"v1","addr":"172.21.15.77:6837","nonce":502868531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1024879489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1024879489},{"type":"v1","addr":"172.21.15.50:6835","nonce":1024879489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:06.945196+0000","modified":"2024-09-11T22:15:20.644473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"a","rank":0,"incarnation":53,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.50:6833/325962537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":325962537},{"type":"v1","addr":"172.21.15.50:6833","nonce":325962537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-11T22:15:21.745 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 55 2024-09-11T22:15:21.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.745+0000 7f4e745d6640 1 -- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e5006be30 msgr2=0x7f4e5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.745+0000 7f4e745d6640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e5006be30 0x7f4e5006e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c034000 tx=0x7f4e5c02e000 comp rx=0 tx=0).stop 2024-09-11T22:15:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.745+0000 7f4e745d6640 1 -- 172.21.15.50:0/682922842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0679c0 msgr2=0x7f4e6c153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.745+0000 7f4e745d6640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0679c0 0x7f4e6c153b20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800e9b0 tx=0x7f4e6800ee70 comp rx=0 tx=0).stop 2024-09-11T22:15:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.745+0000 7f4e745d6640 1 -- 172.21.15.50:0/682922842 shutdown_connections 2024-09-11T22:15:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.745+0000 7f4e745d6640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4e5006be30 0x7f4e5006e2f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.745+0000 7f4e745d6640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e6c15c3c0 0x7f4e6c1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.745+0000 7f4e745d6640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e6c15ec40 0x7f4e6c148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.745+0000 7f4e745d6640 1 --2- 172.21.15.50:0/682922842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e6c0679c0 0x7f4e6c153b20 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.745+0000 7f4e745d6640 1 -- 172.21.15.50:0/682922842 >> 172.21.15.50:0/682922842 conn(0x7f4e6c075060 msgr2=0x7f4e6c0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.745+0000 7f4e745d6640 1 -- 172.21.15.50:0/682922842 shutdown_connections 2024-09-11T22:15:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:21.746+0000 7f4e745d6640 1 -- 172.21.15.50:0/682922842 wait complete. 2024-09-11T22:15:22.159 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:15:06.945196+0000', 'modified': '2024-09-11T22:15:20.644473+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 78, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6885}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6885': {'gid': 6885, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.50:6833/325962537', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 325962537}, {'type': 'v1', 'addr': '172.21.15.50:6833', 'nonce': 325962537}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-11T22:15:22.160 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6885:up:rejoin 2024-09-11T22:15:23.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.275+0000 7fe719eba640 1 Processor -- start 2024-09-11T22:15:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.275+0000 7fe719eba640 1 -- start start 2024-09-11T22:15:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.276+0000 7fe719eba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7140d1c90 0x7fe7140b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.276+0000 7fe719eba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe714163080 con 0x7fe71415e8e0 2024-09-11T22:15:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.276+0000 7fe719eba640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7140d2d20 con 0x7fe714162350 2024-09-11T22:15:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.276+0000 7fe719eba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe71415ecc0 con 0x7fe7140d1c90 2024-09-11T22:15:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.276+0000 7fe7137fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe71415e8e0 0x7fe7140d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41216/0 (socket says 172.21.15.50:41216) 2024-09-11T22:15:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.276+0000 7fe7137fe640 1 -- 172.21.15.50:0/3657313905 learned_addr learned my addr 172.21.15.50:0/3657313905 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.276+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 129796022 0 0) 0x7fe714163080 con 0x7fe71415e8e0 2024-09-11T22:15:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.276+0000 7fe712ffd640 1 --2- 172.21.15.50:0/3657313905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7140d1c90 0x7fe7140b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.276+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6fc003520 con 0x7fe71415e8e0 2024-09-11T22:15:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.276+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 911953687 0 0) 0x7fe6fc003520 con 0x7fe71415e8e0 2024-09-11T22:15:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7140d1c90 msgr2=0x7fe7140b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe7127fc640 1 --2- 172.21.15.50:0/3657313905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7140d1c90 0x7fe7140b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 >> v1:172.21.15.77:6789/0 conn(0x7fe714162350 legacy=0x7fe7141627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7140d3000 con 0x7fe71415e8e0 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fe704001670 con 0x7fe71415e8e0 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 >> v1:172.21.15.50:6789/0 conn(0x7fe71415e8e0 legacy=0x7fe7140d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe7127fc640 1 --2- 172.21.15.50:0/3657313905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc0039e0 0x7fe6fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe7127fc640 1 --2- 172.21.15.50:0/3657313905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc004390 0x7fe6fc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe7127fc640 1 --2- 172.21.15.50:0/3657313905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7140d1c90 0x7fe6fc0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc00b9c0 con 0x7fe6fc004390 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc00bb70 con 0x7fe6fc0039e0 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe6fc00bd70 con 0x7fe7140d1c90 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe712ffd640 1 --2- 172.21.15.50:0/3657313905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc004390 0x7fe6fc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe7137fe640 1 --2- 172.21.15.50:0/3657313905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc0039e0 0x7fe6fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe713fff640 1 --2- 172.21.15.50:0/3657313905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7140d1c90 0x7fe6fc0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe712ffd640 1 -- 172.21.15.50:0/3657313905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7140d1c90 msgr2=0x7fe6fc0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe712ffd640 1 --2- 172.21.15.50:0/3657313905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7140d1c90 0x7fe6fc0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe712ffd640 1 -- 172.21.15.50:0/3657313905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc0039e0 msgr2=0x7fe6fc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe712ffd640 1 --2- 172.21.15.50:0/3657313905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc0039e0 0x7fe6fc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe712ffd640 1 -- 172.21.15.50:0/3657313905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc003520 con 0x7fe6fc004390 2024-09-11T22:15:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.277+0000 7fe713fff640 1 --2- 172.21.15.50:0/3657313905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7140d1c90 0x7fe6fc0050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.278+0000 7fe712ffd640 1 --2- 172.21.15.50:0/3657313905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc004390 0x7fe6fc004860 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fe7141622b0 tx=0x7fe6fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b056386f17d26fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.278+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708036070 con 0x7fe6fc004390 2024-09-11T22:15:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.278+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe708031400 con 0x7fe6fc004390 2024-09-11T22:15:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.278+0000 7fe7127fc640 1 -- 172.21.15.50:0/3657313905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708009690 con 0x7fe6fc004390 2024-09-11T22:15:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.278+0000 7fe719eba640 1 -- 172.21.15.50:0/3657313905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc004390 msgr2=0x7fe6fc004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.278+0000 7fe719eba640 1 --2- 172.21.15.50:0/3657313905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6fc004390 0x7fe6fc004860 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fe7141622b0 tx=0x7fe6fc005830 comp rx=0 tx=0).stop 2024-09-11T22:15:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.279+0000 7fe713fff640 1 -- 172.21.15.50:0/3657313905 reap_dead start 2024-09-11T22:15:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.279+0000 7fe719eba640 1 -- 172.21.15.50:0/3657313905 shutdown_connections 2024-09-11T22:15:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.279+0000 7fe719eba640 1 -- 172.21.15.50:0/3657313905 >> 172.21.15.50:0/3657313905 conn(0x7fe714067ba0 msgr2=0x7fe714067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.279+0000 7fe719eba640 1 -- 172.21.15.50:0/3657313905 shutdown_connections 2024-09-11T22:15:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.279+0000 7fe719eba640 1 -- 172.21.15.50:0/3657313905 wait complete. 2024-09-11T22:15:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.280+0000 7fe719eba640 1 Processor -- start 2024-09-11T22:15:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.280+0000 7fe719eba640 1 -- start start 2024-09-11T22:15:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe719eba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6fc004390 0x7fe7140cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe719eba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe714161870 0x7fe714156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe719eba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7140d4880 0x7fe7140d4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe719eba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe7140b7c10 con 0x7fe7140d4880 2024-09-11T22:15:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe719eba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe7140b7a90 con 0x7fe714161870 2024-09-11T22:15:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe719eba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe7140d2ad0 con 0x7fe6fc004390 2024-09-11T22:15:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe713fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7140d4880 0x7fe7140d4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe713fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7140d4880 0x7fe7140d4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37732/0 (socket says 172.21.15.50:37732) 2024-09-11T22:15:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe713fff640 1 -- 172.21.15.50:0/620803550 learned_addr learned my addr 172.21.15.50:0/620803550 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe712ffd640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe714161870 0x7fe714156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe7137fe640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6fc004390 0x7fe7140cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe713fff640 1 -- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6fc004390 msgr2=0x7fe7140cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe713fff640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6fc004390 0x7fe7140cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe713fff640 1 -- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe714161870 msgr2=0x7fe714156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe713fff640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe714161870 0x7fe714156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe713fff640 1 -- 172.21.15.50:0/620803550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe714161510 con 0x7fe7140d4880 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.281+0000 7fe7137fe640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6fc004390 0x7fe7140cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.282+0000 7fe713fff640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7140d4880 0x7fe7140d4d30 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe714162730 tx=0x7fe70c00ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.282+0000 7fe6fbfff640 1 -- 172.21.15.50:0/620803550 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c019070 con 0x7fe7140d4880 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.282+0000 7fe6fbfff640 1 -- 172.21.15.50:0/620803550 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe70c006b50 con 0x7fe7140d4880 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.282+0000 7fe719eba640 1 -- 172.21.15.50:0/620803550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7140cbea0 con 0x7fe7140d4880 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.282+0000 7fe6fbfff640 1 -- 172.21.15.50:0/620803550 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c003970 con 0x7fe7140d4880 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.282+0000 7fe719eba640 1 -- 172.21.15.50:0/620803550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7140cc460 con 0x7fe7140d4880 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.283+0000 7fe719eba640 1 -- 172.21.15.50:0/620803550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7140d1580 con 0x7fe7140d4880 2024-09-11T22:15:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.283+0000 7fe6fbfff640 1 -- 172.21.15.50:0/620803550 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe70c01c070 con 0x7fe7140d4880 2024-09-11T22:15:23.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.284+0000 7fe6fbfff640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe70006be30 0x7fe70006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:23.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.284+0000 7fe6fbfff640 1 -- 172.21.15.50:0/620803550 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7fe70c08a210 con 0x7fe7140d4880 2024-09-11T22:15:23.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.284+0000 7fe7137fe640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe70006be30 0x7fe70006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:23.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.285+0000 7fe7137fe640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe70006be30 0x7fe70006e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe704000c00 tx=0x7fe704009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:23.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.288+0000 7fe6fbfff640 1 -- 172.21.15.50:0/620803550 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe70c058470 con 0x7fe7140d4880 2024-09-11T22:15:23.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.500+0000 7fe719eba640 1 -- 172.21.15.50:0/620803550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe714161c50 con 0x7fe7140d4880 2024-09-11T22:15:23.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.500+0000 7fe6fbfff640 1 -- 172.21.15.50:0/620803550 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5220 (secure 0 0 0) 0x7fe70c05c770 con 0x7fe7140d4880 2024-09-11T22:15:23.501 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:23.501 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"btime":"2024-09-11T22:15:22:649424+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4081050909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4081050909},{"type":"v1","addr":"172.21.15.77:6835","nonce":4081050909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6340,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/502868531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":502868531},{"type":"v1","addr":"172.21.15.77:6837","nonce":502868531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1024879489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1024879489},{"type":"v1","addr":"172.21.15.50:6835","nonce":1024879489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:06.945196+0000","modified":"2024-09-11T22:15:22.649418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6833/325962537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":325962537},{"type":"v1","addr":"172.21.15.50:6833","nonce":325962537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6885,"qdb_cluster":[6885]},"id":5}]} 2024-09-11T22:15:23.501 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 56 2024-09-11T22:15:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.502+0000 7fe719eba640 1 -- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe70006be30 msgr2=0x7fe70006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.502+0000 7fe719eba640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe70006be30 0x7fe70006e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe704000c00 tx=0x7fe704009040 comp rx=0 tx=0).stop 2024-09-11T22:15:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.502+0000 7fe719eba640 1 -- 172.21.15.50:0/620803550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7140d4880 msgr2=0x7fe7140d4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.502+0000 7fe719eba640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7140d4880 0x7fe7140d4d30 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe714162730 tx=0x7fe70c00ebe0 comp rx=0 tx=0).stop 2024-09-11T22:15:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.502+0000 7fe719eba640 1 -- 172.21.15.50:0/620803550 shutdown_connections 2024-09-11T22:15:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.502+0000 7fe719eba640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe70006be30 0x7fe70006e2f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.502+0000 7fe719eba640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7140d4880 0x7fe7140d4d30 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.502+0000 7fe719eba640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe714161870 0x7fe714156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.502+0000 7fe719eba640 1 --2- 172.21.15.50:0/620803550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6fc004390 0x7fe7140cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.502+0000 7fe719eba640 1 -- 172.21.15.50:0/620803550 >> 172.21.15.50:0/620803550 conn(0x7fe714067ba0 msgr2=0x7fe7140b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.502+0000 7fe719eba640 1 -- 172.21.15.50:0/620803550 shutdown_connections 2024-09-11T22:15:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:23.502+0000 7fe719eba640 1 -- 172.21.15.50:0/620803550 wait complete. 2024-09-11T22:15:23.916 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:15:06.945196+0000', 'modified': '2024-09-11T22:15:22.649418+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 78, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6885}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6885': {'gid': 6885, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6833/325962537', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 325962537}, {'type': 'v1', 'addr': '172.21.15.50:6833', 'nonce': 325962537}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6885, 'qdb_cluster': [6885]} 2024-09-11T22:15:23.917 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:15:23.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T22:15:24.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.025+0000 7f5be8496640 1 Processor -- start 2024-09-11T22:15:24.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.025+0000 7f5be8496640 1 -- start start 2024-09-11T22:15:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.026+0000 7f5be8496640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5be015f350 0x7f5be015fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.026+0000 7f5be8496640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be00679c0 0x7f5be0067e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.026+0000 7f5be8496640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be015f7f0 con 0x7f5be015c3c0 2024-09-11T22:15:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.026+0000 7f5be8496640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5be006e700 con 0x7f5be015f350 2024-09-11T22:15:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.026+0000 7f5be8496640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5be015fad0 con 0x7f5be00679c0 2024-09-11T22:15:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.026+0000 7f5be5a31640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5be015f350 0x7f5be015fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.026+0000 7f5be5a31640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5be015f350 0x7f5be015fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37734/0 (socket says 172.21.15.50:37734) 2024-09-11T22:15:24.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.026+0000 7f5be5a31640 1 -- 172.21.15.50:0/3457531079 learned_addr learned my addr 172.21.15.50:0/3457531079 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:24.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.026+0000 7f5be6a33640 1 --2- 172.21.15.50:0/3457531079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be00679c0 0x7f5be0067e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.026+0000 7f5be5a31640 1 -- 172.21.15.50:0/3457531079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be00679c0 msgr2=0x7f5be0067e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:24.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.026+0000 7f5be5a31640 1 --2- 172.21.15.50:0/3457531079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be00679c0 0x7f5be0067e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.026+0000 7f5be5a31640 1 -- 172.21.15.50:0/3457531079 >> v1:172.21.15.77:6789/0 conn(0x7f5be015c3c0 legacy=0x7f5be015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.026+0000 7f5be5a31640 1 -- 172.21.15.50:0/3457531079 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be006e950 con 0x7f5be015f350 2024-09-11T22:15:24.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.027+0000 7f5be5a31640 1 --2- 172.21.15.50:0/3457531079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5be015f350 0x7f5be015fe60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009870 tx=0x7f5bd002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9831fbb9924517c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:24.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.027+0000 7f5be5230640 1 -- 172.21.15.50:0/3457531079 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0037070 con 0x7f5be015f350 2024-09-11T22:15:24.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.027+0000 7f5be5230640 1 -- 172.21.15.50:0/3457531079 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd0032440 con 0x7f5be015f350 2024-09-11T22:15:24.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.027+0000 7f5be5230640 1 -- 172.21.15.50:0/3457531079 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0032810 con 0x7f5be015f350 2024-09-11T22:15:24.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.028+0000 7f5be8496640 1 -- 172.21.15.50:0/3457531079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5be015f350 msgr2=0x7f5be015fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.028+0000 7f5be8496640 1 --2- 172.21.15.50:0/3457531079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5be015f350 0x7f5be015fe60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009870 tx=0x7f5bd002a1c0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.028+0000 7f5be8496640 1 -- 172.21.15.50:0/3457531079 shutdown_connections 2024-09-11T22:15:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.028+0000 7f5be8496640 1 --2- 172.21.15.50:0/3457531079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be00679c0 0x7f5be0067e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.028+0000 7f5be8496640 1 --2- 172.21.15.50:0/3457531079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5be015f350 0x7f5be015fe60 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.028+0000 7f5be8496640 1 -- 172.21.15.50:0/3457531079 >> 172.21.15.50:0/3457531079 conn(0x7f5be0075060 msgr2=0x7f5be006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.028+0000 7f5be8496640 1 -- 172.21.15.50:0/3457531079 shutdown_connections 2024-09-11T22:15:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.028+0000 7f5be8496640 1 -- 172.21.15.50:0/3457531079 wait complete. 2024-09-11T22:15:24.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.029+0000 7f5be8496640 1 Processor -- start 2024-09-11T22:15:24.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.029+0000 7f5be8496640 1 -- start start 2024-09-11T22:15:24.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be8496640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5be00679c0 0x7f5be0155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be8496640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5be015c3c0 0x7f5be0149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be8496640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be015f350 0x7f5be0153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be8496640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5be006f150 con 0x7f5be00679c0 2024-09-11T22:15:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be8496640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5be00d0940 con 0x7f5be015c3c0 2024-09-11T22:15:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be8496640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5be006f2d0 con 0x7f5be015f350 2024-09-11T22:15:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be6232640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5be00679c0 0x7f5be0155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be6232640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5be00679c0 0x7f5be0155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37746/0 (socket says 172.21.15.50:37746) 2024-09-11T22:15:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be6232640 1 -- 172.21.15.50:0/502592891 learned_addr learned my addr 172.21.15.50:0/502592891 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be5a31640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5be015c3c0 0x7f5be0149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be6a33640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be015f350 0x7f5be0153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be6232640 1 -- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be015f350 msgr2=0x7f5be0153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be6232640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be015f350 0x7f5be0153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be6232640 1 -- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5be015c3c0 msgr2=0x7f5be0149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be6232640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5be015c3c0 0x7f5be0149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.030+0000 7f5be6232640 1 -- 172.21.15.50:0/502592891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be014a490 con 0x7f5be00679c0 2024-09-11T22:15:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.031+0000 7f5be6232640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5be00679c0 0x7f5be0155590 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c400 tx=0x7f5bdc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:24.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.031+0000 7f5bd6ffd640 1 -- 172.21.15.50:0/502592891 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0052d0 con 0x7f5be00679c0 2024-09-11T22:15:24.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.031+0000 7f5bd6ffd640 1 -- 172.21.15.50:0/502592891 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc005490 con 0x7f5be00679c0 2024-09-11T22:15:24.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.031+0000 7f5be8496640 1 -- 172.21.15.50:0/502592891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be01544f0 con 0x7f5be00679c0 2024-09-11T22:15:24.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.031+0000 7f5bd6ffd640 1 -- 172.21.15.50:0/502592891 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc007260 con 0x7f5be00679c0 2024-09-11T22:15:24.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.031+0000 7f5be8496640 1 -- 172.21.15.50:0/502592891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be0154ab0 con 0x7f5be00679c0 2024-09-11T22:15:24.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.032+0000 7f5bd6ffd640 1 -- 172.21.15.50:0/502592891 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5bdc007400 con 0x7f5be00679c0 2024-09-11T22:15:24.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.033+0000 7f5bd6ffd640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5bc406be30 0x7f5bc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.033+0000 7f5bd6ffd640 1 -- 172.21.15.50:0/502592891 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7f5bdc08a4e0 con 0x7f5be00679c0 2024-09-11T22:15:24.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.033+0000 7f5be5a31640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5bc406be30 0x7f5bc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.034+0000 7f5beb22f740 1 Processor -- start 2024-09-11T22:15:24.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.034+0000 7f5be5a31640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5bc406be30 0x7f5bc406e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0034000 tx=0x7f5bd002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:24.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.034+0000 7f5beb22f740 1 -- start start 2024-09-11T22:15:24.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5beb22f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 0x556df289da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5beb22f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2855a80 0x556df28586a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5beb22f740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df2859a50 0x556df28528b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5beb22f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556df27ba520 con 0x556df2855a80 2024-09-11T22:15:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5beb22f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556df27623e0 con 0x556df28582c0 2024-09-11T22:15:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5beb22f740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556df27b64e0 con 0x556df2859a50 2024-09-11T22:15:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5be5a31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2855a80 0x556df28586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5be5a31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2855a80 0x556df28586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37758/0 (socket says 172.21.15.50:37758) 2024-09-11T22:15:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5be5a31640 1 -- 172.21.15.50:0/3018333792 learned_addr learned my addr 172.21.15.50:0/3018333792 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5be6232640 1 --2- 172.21.15.50:0/3018333792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 0x556df289da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5be6a33640 1 --2- 172.21.15.50:0/3018333792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df2859a50 0x556df28528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5be5a31640 1 -- 172.21.15.50:0/3018333792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df2859a50 msgr2=0x556df28528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5be5a31640 1 --2- 172.21.15.50:0/3018333792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df2859a50 0x556df28528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5be5a31640 1 -- 172.21.15.50:0/3018333792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 msgr2=0x556df289da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5be5a31640 1 --2- 172.21.15.50:0/3018333792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 0x556df289da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5be5a31640 1 -- 172.21.15.50:0/3018333792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556df277d2f0 con 0x556df2855a80 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.035+0000 7f5be5a31640 1 --2- 172.21.15.50:0/3018333792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2855a80 0x556df28586a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009990 tx=0x7f5bd002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314981cedcad28b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.036+0000 7f5bc3fff640 1 -- 172.21.15.50:0/3018333792 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0037040 con 0x556df2855a80 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.036+0000 7f5bc3fff640 1 -- 172.21.15.50:0/3018333792 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd004e070 con 0x556df2855a80 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.036+0000 7f5bc3fff640 1 -- 172.21.15.50:0/3018333792 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0032e20 con 0x556df2855a80 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.036+0000 7f5beb22f740 1 -- 172.21.15.50:0/3018333792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2855a80 msgr2=0x556df28586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.036+0000 7f5beb22f740 1 --2- 172.21.15.50:0/3018333792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2855a80 0x556df28586a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009990 tx=0x7f5bd002c000 comp rx=0 tx=0).stop 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.036+0000 7f5beb22f740 1 -- 172.21.15.50:0/3018333792 shutdown_connections 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.036+0000 7f5beb22f740 1 --2- 172.21.15.50:0/3018333792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df2859a50 0x556df28528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.036+0000 7f5beb22f740 1 --2- 172.21.15.50:0/3018333792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2855a80 0x556df28586a0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.036+0000 7f5beb22f740 1 --2- 172.21.15.50:0/3018333792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 0x556df289da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.036+0000 7f5beb22f740 1 -- 172.21.15.50:0/3018333792 >> 172.21.15.50:0/3018333792 conn(0x556df2854a80 msgr2=0x556df289cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.036+0000 7f5beb22f740 1 -- 172.21.15.50:0/3018333792 shutdown_connections 2024-09-11T22:15:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.036+0000 7f5beb22f740 1 -- 172.21.15.50:0/3018333792 wait complete. 2024-09-11T22:15:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.037+0000 7f5beb22f740 1 -- start start 2024-09-11T22:15:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.037+0000 7f5beb22f740 1 Processor -- start 2024-09-11T22:15:24.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5beb22f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 0x556df2896c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5beb22f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2859a50 0x556df2853220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5beb22f740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df28789e0 0x556df2852430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5beb22f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556df2853f20 con 0x556df2859a50 2024-09-11T22:15:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5beb22f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556df2743450 con 0x556df28582c0 2024-09-11T22:15:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5beb22f740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556df289e290 con 0x556df28789e0 2024-09-11T22:15:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5beb22f740 10 client.0 _ll_register_callbacks cb 0x556df24ccac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5be5a31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2859a50 0x556df2853220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5be5a31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2859a50 0x556df2853220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37768/0 (socket says 172.21.15.50:37768) 2024-09-11T22:15:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5be5a31640 1 -- 172.21.15.50:0/229950732 learned_addr learned my addr 172.21.15.50:0/229950732 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5be6a33640 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df28789e0 0x556df2852430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5be6232640 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 0x556df2896c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5be5a31640 1 -- 172.21.15.50:0/229950732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df28789e0 msgr2=0x556df2852430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5be5a31640 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df28789e0 0x556df2852430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5be5a31640 1 -- 172.21.15.50:0/229950732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 msgr2=0x556df2896c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5be5a31640 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 0x556df2896c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.038+0000 7f5be5a31640 1 -- 172.21.15.50:0/229950732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556df24cd2d0 con 0x556df2859a50 2024-09-11T22:15:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5be6232640 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 0x556df2896c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5be5a31640 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2859a50 0x556df2853220 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00090b0 tx=0x7f5bd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa342945043f097 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5bc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:15:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5bc17fa640 1 -- 172.21.15.50:0/229950732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0058070 con 0x556df2859a50 2024-09-11T22:15:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5bc17fa640 1 -- 172.21.15.50:0/229950732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7f5bd0049890 con 0x556df2859a50 2024-09-11T22:15:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5beb22f740 1 -- 172.21.15.50:0/229950732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bd004e070 con 0x556df2859a50 2024-09-11T22:15:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5bc17fa640 1 -- 172.21.15.50:0/229950732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f5bd0063050 con 0x556df2859a50 2024-09-11T22:15:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5beb22f740 10 client.6936 fetch_fsmap learned FSMap version 56 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5beb22f740 1 -- 172.21.15.50:0/229950732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x556df25976b0 con 0x556df2859a50 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5bc17fa640 1 -- 172.21.15.50:0/229950732 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd004e070 con 0x556df2859a50 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5bc17fa640 1 -- 172.21.15.50:0/229950732 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7f5bd0066020 con 0x556df2859a50 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5beb22f740 10 client.6936 fetch_fsmap finished waiting for FSMap version 56 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5beb22f740 10 client.6936 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5beb22f740 20 client.6936 populate_metadata read hostname 'smithi050' 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5beb22f740 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x556df2852970 0x556df287c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5beb22f740 4 client.6936 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.039+0000 7f5beb22f740 1 -- 172.21.15.50:0/229950732 --> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556df27c7c50 con 0x556df2852970 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.040+0000 7f5be6232640 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x556df2852970 0x556df287c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.040+0000 7f5bc17fa640 10 client.6936 ms_handle_connect on v2:172.21.15.50:6832/325962537 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.040+0000 7f5be6232640 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x556df2852970 0x556df287c000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b29cbd97d66fff3 server_cookie=7f32af91347fff47 in_seq=0 out_seq=0 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.040+0000 7f5bc17fa640 1 -- 172.21.15.50:0/229950732 <== mds.0 v2:172.21.15.50:6832/325962537 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556df27c7c50 con 0x556df2852970 2024-09-11T22:15:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5bc17fa640 10 client.6936 handle_command_reply: tid=0 2024-09-11T22:15:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5beb22f740 1 client.6936 shutdown 2024-09-11T22:15:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5beb22f740 1 -- 172.21.15.50:0/229950732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2859a50 msgr2=0x556df2853220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5beb22f740 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2859a50 0x556df2853220 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00090b0 tx=0x7f5bd0004730 comp rx=0 tx=0).stop 2024-09-11T22:15:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5beb22f740 1 -- 172.21.15.50:0/229950732 shutdown_connections 2024-09-11T22:15:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5beb22f740 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x556df2852970 0x556df287c000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5beb22f740 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df28789e0 0x556df2852430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5beb22f740 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df2859a50 0x556df2853220 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5beb22f740 1 --2- 172.21.15.50:0/229950732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 0x556df2896c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5beb22f740 1 -- 172.21.15.50:0/229950732 >> 172.21.15.50:0/229950732 conn(0x556df2855a80 msgr2=0x556df2856020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5bc17fa640 0 client.6936 ms_handle_reset on v2:172.21.15.50:6832/325962537 2024-09-11T22:15:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5beb22f740 1 -- 172.21.15.50:0/229950732 shutdown_connections 2024-09-11T22:15:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5beb22f740 1 -- 172.21.15.50:0/229950732 wait complete. 2024-09-11T22:15:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.041+0000 7f5beb22f740 20 client.6936 trim_cache size 0 max 16384 2024-09-11T22:15:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.059+0000 7f5beb22f740 1 Processor -- start 2024-09-11T22:15:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.059+0000 7f5beb22f740 1 -- start start 2024-09-11T22:15:24.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5beb22f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28582c0 0x556df2852580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5beb22f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df2859a50 0x556df28ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5beb22f740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df28789e0 0x556df289b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5beb22f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01fff20 con 0x556df28582c0 2024-09-11T22:15:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5beb22f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5be00ccd20 con 0x556df2859a50 2024-09-11T22:15:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5beb22f740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5be01582b0 con 0x556df28789e0 2024-09-11T22:15:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5be6232640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28582c0 0x556df2852580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5be6232640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28582c0 0x556df2852580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37776/0 (socket says 172.21.15.50:37776) 2024-09-11T22:15:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5be6232640 1 -- 172.21.15.50:0/790502665 learned_addr learned my addr 172.21.15.50:0/790502665 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5be5a31640 1 --2- 172.21.15.50:0/790502665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df2859a50 0x556df28ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5be6a33640 1 --2- 172.21.15.50:0/790502665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df28789e0 0x556df289b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5be6232640 1 -- 172.21.15.50:0/790502665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df28789e0 msgr2=0x556df289b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5be6232640 1 --2- 172.21.15.50:0/790502665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df28789e0 0x556df289b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5be6232640 1 -- 172.21.15.50:0/790502665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df2859a50 msgr2=0x556df28ac3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5be6232640 1 --2- 172.21.15.50:0/790502665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df2859a50 0x556df28ac3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5be6232640 1 -- 172.21.15.50:0/790502665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556df2858a10 con 0x556df28582c0 2024-09-11T22:15:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.060+0000 7f5be6232640 1 --2- 172.21.15.50:0/790502665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28582c0 0x556df2852580 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc007810 tx=0x7f5bdc05b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826058ecfd5d4cc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.061+0000 7f5bc37fe640 1 -- 172.21.15.50:0/790502665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc056740 con 0x556df28582c0 2024-09-11T22:15:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.061+0000 7f5bc37fe640 1 -- 172.21.15.50:0/790502665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc0569a0 con 0x556df28582c0 2024-09-11T22:15:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.061+0000 7f5bc37fe640 1 -- 172.21.15.50:0/790502665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc060d40 con 0x556df28582c0 2024-09-11T22:15:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.061+0000 7f5beb22f740 1 -- 172.21.15.50:0/790502665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28582c0 msgr2=0x556df2852580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.061+0000 7f5beb22f740 1 --2- 172.21.15.50:0/790502665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28582c0 0x556df2852580 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc007810 tx=0x7f5bdc05b040 comp rx=0 tx=0).stop 2024-09-11T22:15:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.061+0000 7f5beb22f740 1 -- 172.21.15.50:0/790502665 shutdown_connections 2024-09-11T22:15:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.061+0000 7f5beb22f740 1 --2- 172.21.15.50:0/790502665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df28789e0 0x556df289b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.061+0000 7f5beb22f740 1 --2- 172.21.15.50:0/790502665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df2859a50 0x556df28ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.061+0000 7f5beb22f740 1 --2- 172.21.15.50:0/790502665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28582c0 0x556df2852580 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.061+0000 7f5beb22f740 1 -- 172.21.15.50:0/790502665 >> 172.21.15.50:0/790502665 conn(0x556df2855a80 msgr2=0x556df289ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:24.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.061+0000 7f5beb22f740 1 -- 172.21.15.50:0/790502665 shutdown_connections 2024-09-11T22:15:24.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.061+0000 7f5beb22f740 1 -- 172.21.15.50:0/790502665 wait complete. 2024-09-11T22:15:24.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.062+0000 7f5beb22f740 1 -- start start 2024-09-11T22:15:24.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.062+0000 7f5beb22f740 1 Processor -- start 2024-09-11T22:15:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5beb22f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 0x556df28bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5beb22f740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df2859a50 0x556df2857510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5beb22f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28789e0 0x556df289b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5beb22f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556df2897300 con 0x556df28789e0 2024-09-11T22:15:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5beb22f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556df2878e90 con 0x556df28582c0 2024-09-11T22:15:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5beb22f740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556df2881610 con 0x556df2859a50 2024-09-11T22:15:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5beb22f740 10 client.0 _ll_register_callbacks cb 0x7f5bd80096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5be6a33640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28789e0 0x556df289b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5be6a33640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28789e0 0x556df289b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37788/0 (socket says 172.21.15.50:37788) 2024-09-11T22:15:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5be6a33640 1 -- 172.21.15.50:0/2373679834 learned_addr learned my addr 172.21.15.50:0/2373679834 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5be6232640 1 --2- 172.21.15.50:0/2373679834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 0x556df28bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5be5a31640 1 --2- 172.21.15.50:0/2373679834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df2859a50 0x556df2857510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5be6a33640 1 -- 172.21.15.50:0/2373679834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df2859a50 msgr2=0x556df2857510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5be6a33640 1 --2- 172.21.15.50:0/2373679834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df2859a50 0x556df2857510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5be6a33640 1 -- 172.21.15.50:0/2373679834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 msgr2=0x556df28bf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5be6a33640 1 --2- 172.21.15.50:0/2373679834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 0x556df28bf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5be6a33640 1 -- 172.21.15.50:0/2373679834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556df2876c20 con 0x556df28789e0 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5be6a33640 1 --2- 172.21.15.50:0/2373679834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28789e0 0x556df289b050 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8004660 tx=0x7f5bd8016710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84df29321a98d24a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5bc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5bc17fa640 1 -- 172.21.15.50:0/2373679834 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd801c070 con 0x556df28789e0 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5bc17fa640 1 -- 172.21.15.50:0/2373679834 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7f5bd8021460 con 0x556df28789e0 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.063+0000 7f5beb22f740 1 -- 172.21.15.50:0/2373679834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bdc0569a0 con 0x556df28789e0 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5bc17fa640 1 -- 172.21.15.50:0/2373679834 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f5bd8029050 con 0x556df28789e0 2024-09-11T22:15:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5beb22f740 10 client.6942 fetch_fsmap learned FSMap version 56 2024-09-11T22:15:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5beb22f740 1 -- 172.21.15.50:0/2373679834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x556df2877240 con 0x556df28789e0 2024-09-11T22:15:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5bc17fa640 1 -- 172.21.15.50:0/2373679834 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc0569a0 con 0x556df28789e0 2024-09-11T22:15:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5bc17fa640 1 -- 172.21.15.50:0/2373679834 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7f5bd802c020 con 0x556df28789e0 2024-09-11T22:15:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5beb22f740 10 client.6942 fetch_fsmap finished waiting for FSMap version 56 2024-09-11T22:15:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5beb22f740 10 client.6942 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:15:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5beb22f740 20 client.6942 populate_metadata read hostname 'smithi050' 2024-09-11T22:15:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5beb22f740 1 --2- 172.21.15.50:0/2373679834 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x556df291a710 0x556df291d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5beb22f740 4 client.6942 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:15:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5beb22f740 1 -- 172.21.15.50:0/2373679834 --> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] -- command(tid 0: {"prefix": "status"}) -- 0x556df27c1fa0 con 0x556df291a710 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5be6232640 1 --2- 172.21.15.50:0/2373679834 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x556df291a710 0x556df291d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5bc17fa640 10 client.6942 ms_handle_connect on v2:172.21.15.50:6832/325962537 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.064+0000 7f5be6232640 1 --2- 172.21.15.50:0/2373679834 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x556df291a710 0x556df291d2e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=273157b39424dfe3 server_cookie=42d6ce5c3db205c0 in_seq=0 out_seq=0 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5bc17fa640 1 -- 172.21.15.50:0/2373679834 <== mds.0 v2:172.21.15.50:6832/325962537 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556df27c1fa0 con 0x556df291a710 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5bc17fa640 10 client.6942 handle_command_reply: tid=0 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5beb22f740 1 client.6942 shutdown 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5beb22f740 1 -- 172.21.15.50:0/2373679834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28789e0 msgr2=0x556df289b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5beb22f740 1 --2- 172.21.15.50:0/2373679834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28789e0 0x556df289b050 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8004660 tx=0x7f5bd8016710 comp rx=0 tx=0).stop 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5beb22f740 1 -- 172.21.15.50:0/2373679834 shutdown_connections 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5beb22f740 1 --2- 172.21.15.50:0/2373679834 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x556df291a710 0x556df291d2e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5beb22f740 1 --2- 172.21.15.50:0/2373679834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556df2859a50 0x556df2857510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5bc17fa640 0 client.6942 ms_handle_reset on v2:172.21.15.50:6832/325962537 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5beb22f740 1 --2- 172.21.15.50:0/2373679834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556df28789e0 0x556df289b050 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5beb22f740 1 --2- 172.21.15.50:0/2373679834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556df28582c0 0x556df28bf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5beb22f740 1 -- 172.21.15.50:0/2373679834 >> 172.21.15.50:0/2373679834 conn(0x556df2855a80 msgr2=0x556df2851980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:24.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5beb22f740 1 -- 172.21.15.50:0/2373679834 shutdown_connections 2024-09-11T22:15:24.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5beb22f740 1 -- 172.21.15.50:0/2373679834 wait complete. 2024-09-11T22:15:24.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5beb22f740 20 client.6942 trim_cache size 0 max 16384 2024-09-11T22:15:24.073 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:15:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:15:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:15:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6885, 2024-09-11T22:15:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:15:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:15:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:15:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 4.4220813659999996, 2024-09-11T22:15:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 56, 2024-09-11T22:15:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-09-11T22:15:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-09-11T22:15:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 4.4484010940000003 2024-09-11T22:15:24.074 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:15:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5be8496640 1 -- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5bc406be30 msgr2=0x7f5bc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5be8496640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5bc406be30 0x7f5bc406e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0034000 tx=0x7f5bd002e000 comp rx=0 tx=0).stop 2024-09-11T22:15:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5be8496640 1 -- 172.21.15.50:0/502592891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5be00679c0 msgr2=0x7f5be0155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5be8496640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5be00679c0 0x7f5be0155590 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c400 tx=0x7f5bdc00c8c0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5be8496640 1 -- 172.21.15.50:0/502592891 shutdown_connections 2024-09-11T22:15:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5be8496640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5bc406be30 0x7f5bc406e2f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5be8496640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be015f350 0x7f5be0153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5be8496640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5be015c3c0 0x7f5be0149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5be8496640 1 --2- 172.21.15.50:0/502592891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5be00679c0 0x7f5be0155590 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.065+0000 7f5be8496640 1 -- 172.21.15.50:0/502592891 >> 172.21.15.50:0/502592891 conn(0x7f5be0075060 msgr2=0x7f5be006f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.066+0000 7f5be8496640 1 -- 172.21.15.50:0/502592891 shutdown_connections 2024-09-11T22:15:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.066+0000 7f5be8496640 1 -- 172.21.15.50:0/502592891 wait complete. 2024-09-11T22:15:24.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:15:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.178+0000 7fa929d31640 1 Processor -- start 2024-09-11T22:15:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.178+0000 7fa929d31640 1 -- start start 2024-09-11T22:15:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.179+0000 7fa929d31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa92415e790 0x7fa9240d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.179+0000 7fa929d31640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa92415eb70 0x7fa9240d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.179+0000 7fa929d31640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9240d31b0 con 0x7fa9240ba230 2024-09-11T22:15:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.179+0000 7fa929d31640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa9240d3dc0 con 0x7fa92415eb70 2024-09-11T22:15:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.179+0000 7fa929d31640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa9240d3490 con 0x7fa92415e790 2024-09-11T22:15:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.179+0000 7fa923fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa9240ba230 0x7fa9240d11d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41230/0 (socket says 172.21.15.50:41230) 2024-09-11T22:15:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.179+0000 7fa923fff640 1 -- 172.21.15.50:0/778644368 learned_addr learned my addr 172.21.15.50:0/778644368 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.179+0000 7fa922ffd640 1 --2- 172.21.15.50:0/778644368 >> v2:172.21.15.77:3300/0 conn(0x7fa92415eb70 0x7fa9240d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.179+0000 7fa9237fe640 1 --2- 172.21.15.50:0/778644368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa92415e790 0x7fa9240d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3073714595 0 0) 0x7fa9240d31b0 con 0x7fa9240ba230 2024-09-11T22:15:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa90c003520 con 0x7fa9240ba230 2024-09-11T22:15:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 969491476 0 0) 0x7fa90c003520 con 0x7fa9240ba230 2024-09-11T22:15:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa92415e790 msgr2=0x7fa9240d4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 --2- 172.21.15.50:0/778644368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa92415e790 0x7fa9240d4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 >> v2:172.21.15.77:3300/0 conn(0x7fa92415eb70 msgr2=0x7fa9240d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 --2- 172.21.15.50:0/778644368 >> v2:172.21.15.77:3300/0 conn(0x7fa92415eb70 0x7fa9240d2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9240d3770 con 0x7fa9240ba230 2024-09-11T22:15:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fa91c0019f0 con 0x7fa9240ba230 2024-09-11T22:15:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 >> v1:172.21.15.50:6789/0 conn(0x7fa9240ba230 legacy=0x7fa9240d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 --2- 172.21.15.50:0/778644368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa90c0039b0 0x7fa90c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 --2- 172.21.15.50:0/778644368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa92415e790 0x7fa90c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 --2- 172.21.15.50:0/778644368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c004d40 0x7fa90c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa9240d3dc0 con 0x7fa90c0039b0 2024-09-11T22:15:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa9240d3490 con 0x7fa90c004d40 2024-09-11T22:15:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa90c00b9c0 con 0x7fa92415e790 2024-09-11T22:15:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9237fe640 1 --2- 172.21.15.50:0/778644368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa90c0039b0 0x7fa90c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa923fff640 1 --2- 172.21.15.50:0/778644368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c004d40 0x7fa90c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa922ffd640 1 --2- 172.21.15.50:0/778644368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa92415e790 0x7fa90c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9237fe640 1 -- 172.21.15.50:0/778644368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa92415e790 msgr2=0x7fa90c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9237fe640 1 --2- 172.21.15.50:0/778644368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa92415e790 0x7fa90c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9237fe640 1 -- 172.21.15.50:0/778644368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c004d40 msgr2=0x7fa90c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9237fe640 1 --2- 172.21.15.50:0/778644368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c004d40 0x7fa90c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.180+0000 7fa9237fe640 1 -- 172.21.15.50:0/778644368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90c003520 con 0x7fa90c0039b0 2024-09-11T22:15:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.181+0000 7fa9237fe640 1 --2- 172.21.15.50:0/778644368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa90c0039b0 0x7fa90c003dd0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa914009ac0 tx=0x7fa90c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4accf56980d54052 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.181+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914036070 con 0x7fa90c0039b0 2024-09-11T22:15:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.181+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa914031400 con 0x7fa90c0039b0 2024-09-11T22:15:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.181+0000 7fa9227fc640 1 -- 172.21.15.50:0/778644368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914009690 con 0x7fa90c0039b0 2024-09-11T22:15:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.182+0000 7fa929d31640 1 -- 172.21.15.50:0/778644368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa90c0039b0 msgr2=0x7fa90c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.182+0000 7fa929d31640 1 --2- 172.21.15.50:0/778644368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa90c0039b0 0x7fa90c003dd0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa914009ac0 tx=0x7fa90c005830 comp rx=0 tx=0).stop 2024-09-11T22:15:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.182+0000 7fa923fff640 1 -- 172.21.15.50:0/778644368 reap_dead start 2024-09-11T22:15:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.182+0000 7fa929d31640 1 -- 172.21.15.50:0/778644368 shutdown_connections 2024-09-11T22:15:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.182+0000 7fa929d31640 1 -- 172.21.15.50:0/778644368 >> 172.21.15.50:0/778644368 conn(0x7fa9240727a0 msgr2=0x7fa9240679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.182+0000 7fa929d31640 1 -- 172.21.15.50:0/778644368 shutdown_connections 2024-09-11T22:15:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.182+0000 7fa929d31640 1 -- 172.21.15.50:0/778644368 wait complete. 2024-09-11T22:15:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.183+0000 7fa929d31640 1 Processor -- start 2024-09-11T22:15:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.183+0000 7fa929d31640 1 -- start start 2024-09-11T22:15:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa929d31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa90c0039b0 0x7fa924155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa929d31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9240caf00 0x7fa9240c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa929d31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9240ce3a0 0x7fa9240c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa929d31640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa9240d18e0 con 0x7fa90c0039b0 2024-09-11T22:15:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa929d31640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa9240ba6c0 con 0x7fa9240caf00 2024-09-11T22:15:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa929d31640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa9240d1a60 con 0x7fa9240ce3a0 2024-09-11T22:15:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa9237fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa90c0039b0 0x7fa924155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa9237fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa90c0039b0 0x7fa924155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37816/0 (socket says 172.21.15.50:37816) 2024-09-11T22:15:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa9237fe640 1 -- 172.21.15.50:0/3774288682 learned_addr learned my addr 172.21.15.50:0/3774288682 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa923fff640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9240ce3a0 0x7fa9240c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa922ffd640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9240caf00 0x7fa9240c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa9237fe640 1 -- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9240ce3a0 msgr2=0x7fa9240c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa9237fe640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9240ce3a0 0x7fa9240c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa9237fe640 1 -- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9240caf00 msgr2=0x7fa9240c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa9237fe640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9240caf00 0x7fa9240c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa9237fe640 1 -- 172.21.15.50:0/3774288682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa924160230 con 0x7fa90c0039b0 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.184+0000 7fa923fff640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9240ce3a0 0x7fa9240c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.185+0000 7fa9237fe640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa90c0039b0 0x7fa924155d00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa914034040 tx=0x7fa914004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.185+0000 7fa90bfff640 1 -- 172.21.15.50:0/3774288682 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914040020 con 0x7fa90c0039b0 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.185+0000 7fa90bfff640 1 -- 172.21.15.50:0/3774288682 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa914003940 con 0x7fa90c0039b0 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.185+0000 7fa929d31640 1 -- 172.21.15.50:0/3774288682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9240cd3f0 con 0x7fa90c0039b0 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.185+0000 7fa90bfff640 1 -- 172.21.15.50:0/3774288682 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914036040 con 0x7fa90c0039b0 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.185+0000 7fa929d31640 1 -- 172.21.15.50:0/3774288682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9240cd6b0 con 0x7fa90c0039b0 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.186+0000 7fa929d31640 1 -- 172.21.15.50:0/3774288682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa924068390 con 0x7fa90c0039b0 2024-09-11T22:15:24.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.186+0000 7fa90bfff640 1 -- 172.21.15.50:0/3774288682 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa914043020 con 0x7fa90c0039b0 2024-09-11T22:15:24.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.187+0000 7fa90bfff640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa91006be30 0x7fa91006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:24.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.187+0000 7fa90bfff640 1 -- 172.21.15.50:0/3774288682 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7fa9140ab1a0 con 0x7fa90c0039b0 2024-09-11T22:15:24.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.187+0000 7fa922ffd640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa91006be30 0x7fa91006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:24.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.187+0000 7fa922ffd640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa91006be30 0x7fa91006e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa9240b8d40 tx=0x7fa918008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:24.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.191+0000 7fa90bfff640 1 -- 172.21.15.50:0/3774288682 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa91404a070 con 0x7fa90c0039b0 2024-09-11T22:15:24.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.401+0000 7fa929d31640 1 -- 172.21.15.50:0/3774288682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa92415b230 con 0x7fa90c0039b0 2024-09-11T22:15:24.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.402+0000 7fa90bfff640 1 -- 172.21.15.50:0/3774288682 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) ==== 53+0+73 (secure 0 0 0) 0x7fa914079a40 con 0x7fa90c0039b0 2024-09-11T22:15:24.403 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:15:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.404+0000 7fa929d31640 1 -- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa91006be30 msgr2=0x7fa91006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.404+0000 7fa929d31640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa91006be30 0x7fa91006e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa9240b8d40 tx=0x7fa918008040 comp rx=0 tx=0).stop 2024-09-11T22:15:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.404+0000 7fa929d31640 1 -- 172.21.15.50:0/3774288682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa90c0039b0 msgr2=0x7fa924155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.404+0000 7fa929d31640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa90c0039b0 0x7fa924155d00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa914034040 tx=0x7fa914004730 comp rx=0 tx=0).stop 2024-09-11T22:15:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.404+0000 7fa929d31640 1 -- 172.21.15.50:0/3774288682 shutdown_connections 2024-09-11T22:15:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.404+0000 7fa929d31640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa91006be30 0x7fa91006e2f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.404+0000 7fa929d31640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9240ce3a0 0x7fa9240c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.404+0000 7fa929d31640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9240caf00 0x7fa9240c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.404+0000 7fa929d31640 1 --2- 172.21.15.50:0/3774288682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa90c0039b0 0x7fa924155d00 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.404+0000 7fa929d31640 1 -- 172.21.15.50:0/3774288682 >> 172.21.15.50:0/3774288682 conn(0x7fa9240727a0 msgr2=0x7fa9240ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.404+0000 7fa929d31640 1 -- 172.21.15.50:0/3774288682 shutdown_connections 2024-09-11T22:15:24.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24.404+0000 7fa929d31640 1 -- 172.21.15.50:0/3774288682 wait complete. 2024-09-11T22:15:24.416 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:15:24.416 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:15:24.416 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:15:24.416 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:15:24.416 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:24.416 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:15:24.417 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:15:24.417 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:15:24.417 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:15:24.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:24.417 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:15:24.433 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:15:24.433 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:15:24.434 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:15:24.434 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:24.434 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:15:24.434 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:24.434 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:15:24.434 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:24.434 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:15:24.434 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:15:24.434 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:24.434 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:15:24.434 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:15:24.434 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:24.434 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42471sec preferred_lft 42471sec 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:15:24.435 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:15:24.436 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:15:24.436 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:24.436 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:15:24.436 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:15:24.436 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:15:24.436 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:24.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:24.436 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:15:24.498 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:15:24.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:24.500 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:15:24.556 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:15:24.556 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:15:24.556 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:15:24.556 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:15:24.556 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:15:24.557 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:15:24.557 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:15:24.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:15:24.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:15:24.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:15:24.557 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:15:24.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:15:24.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:15:24.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:24.686 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:15:24.702 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:15:24.702 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:15:24.702 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:15:24.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:24.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:15:24.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:15:24.769 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:24.825 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:15:24.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:15:24.826 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:24.881 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:15:24.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:24.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:15:24.965 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:15:24.965 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:15:24.973 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:15:24.973 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:15:24.973 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:15:24.973 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:15:24.973 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:15:24.974 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:15:24.974 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:15:24.974 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:15:24.974 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:15:24.974 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:15:24.975 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:15:24.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:24.976 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:25.002 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:15:25.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:15:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:15:25.100 INFO:teuthology.orchestra.run.smithi050.stdout:client6382 2024-09-11T22:15:25.100 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:15:25.100 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:25.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:25.118 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-11T22:15:25.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:15:25.176 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-09-11T22:15:25.176 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-09-11T22:15:25.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start /scrub_repair_path repair 2024-09-11T22:15:25.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.323+0000 7f826e96d640 1 Processor -- start 2024-09-11T22:15:25.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.323+0000 7f826e96d640 1 -- start start 2024-09-11T22:15:25.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.324+0000 7f826e96d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f82680d09b0 0x7f826806f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.324+0000 7f826e96d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82680afdf0 con 0x7f82680d0d90 2024-09-11T22:15:25.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.324+0000 7f826e96d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8268070bd0 con 0x7f82680710d0 2024-09-11T22:15:25.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.324+0000 7f826e96d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f82680b06e0 con 0x7f82680d09b0 2024-09-11T22:15:25.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.324+0000 7f826cf0a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f82680d0d90 0x7f82680b0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41232/0 (socket says 172.21.15.50:41232) 2024-09-11T22:15:25.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.324+0000 7f826cf0a640 1 -- 172.21.15.50:0/3417569469 learned_addr learned my addr 172.21.15.50:0/3417569469 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:25.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.324+0000 7f8267fff640 1 --2- 172.21.15.50:0/3417569469 >> v2:172.21.15.77:3300/0 conn(0x7f82680d09b0 0x7f826806f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448380867 0 0) 0x7f82680afdf0 con 0x7f82680d0d90 2024-09-11T22:15:25.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8250003520 con 0x7f82680d0d90 2024-09-11T22:15:25.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1005294248 0 0) 0x7f8250003520 con 0x7f82680d0d90 2024-09-11T22:15:25.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 >> v2:172.21.15.77:3300/0 conn(0x7f82680d09b0 msgr2=0x7f826806f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:25.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 --2- 172.21.15.50:0/3417569469 >> v2:172.21.15.77:3300/0 conn(0x7f82680d09b0 0x7f826806f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 >> v1:172.21.15.77:6789/0 conn(0x7f82680710d0 legacy=0x7f826806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:25.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82680b0090 con 0x7f82680d0d90 2024-09-11T22:15:25.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f8260001a10 con 0x7f82680d0d90 2024-09-11T22:15:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 >> v1:172.21.15.50:6789/0 conn(0x7f82680d0d90 legacy=0x7f82680b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 --2- 172.21.15.50:0/3417569469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8250003a00 0x7f8250003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 --2- 172.21.15.50:0/3417569469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8250004800 0x7f8250004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 --2- 172.21.15.50:0/3417569469 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82500051c0 0x7f825000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82680b06e0 con 0x7f8250003a00 2024-09-11T22:15:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f825000c0c0 con 0x7f8250004800 2024-09-11T22:15:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f825000c2c0 con 0x7f82500051c0 2024-09-11T22:15:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8267fff640 1 --2- 172.21.15.50:0/3417569469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8250003a00 0x7f8250003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f82677fe640 1 --2- 172.21.15.50:0/3417569469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8250004800 0x7f8250004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f826cf0a640 1 --2- 172.21.15.50:0/3417569469 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82500051c0 0x7f825000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8267fff640 1 -- 172.21.15.50:0/3417569469 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82500051c0 msgr2=0x7f825000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8267fff640 1 --2- 172.21.15.50:0/3417569469 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82500051c0 0x7f825000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8267fff640 1 -- 172.21.15.50:0/3417569469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8250004800 msgr2=0x7f8250004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8267fff640 1 --2- 172.21.15.50:0/3417569469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8250004800 0x7f8250004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f8267fff640 1 -- 172.21.15.50:0/3417569469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8250003520 con 0x7f8250003a00 2024-09-11T22:15:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.325+0000 7f826cf0a640 1 -- 172.21.15.50:0/3417569469 reap_dead start 2024-09-11T22:15:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.326+0000 7f8267fff640 1 --2- 172.21.15.50:0/3417569469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8250003a00 0x7f8250003e20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8258009ac0 tx=0x7f8250005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cce7b877ce77176 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.326+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258036070 con 0x7f8250003a00 2024-09-11T22:15:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.326+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8258031400 con 0x7f8250003a00 2024-09-11T22:15:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.326+0000 7f8266ffd640 1 -- 172.21.15.50:0/3417569469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258009690 con 0x7f8250003a00 2024-09-11T22:15:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.327+0000 7f826e96d640 1 -- 172.21.15.50:0/3417569469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8250003a00 msgr2=0x7f8250003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.327+0000 7f826e96d640 1 --2- 172.21.15.50:0/3417569469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8250003a00 0x7f8250003e20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8258009ac0 tx=0x7f8250005830 comp rx=0 tx=0).stop 2024-09-11T22:15:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.327+0000 7f826e96d640 1 -- 172.21.15.50:0/3417569469 shutdown_connections 2024-09-11T22:15:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.327+0000 7f826e96d640 1 --2- 172.21.15.50:0/3417569469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8250003a00 0x7f8250003e20 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.327+0000 7f826e96d640 1 -- 172.21.15.50:0/3417569469 >> 172.21.15.50:0/3417569469 conn(0x7f82680b4150 msgr2=0x7f82680b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.327+0000 7f826e96d640 1 -- 172.21.15.50:0/3417569469 shutdown_connections 2024-09-11T22:15:25.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.327+0000 7f826e96d640 1 -- 172.21.15.50:0/3417569469 wait complete. 2024-09-11T22:15:25.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.328+0000 7f826e96d640 1 Processor -- start 2024-09-11T22:15:25.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.328+0000 7f826e96d640 1 -- start start 2024-09-11T22:15:25.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f826e96d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8250003a00 0x7f826815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f826e96d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82680c64a0 0x7f82680c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f826e96d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82680c6d40 0x7f82680c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f826e96d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82680b5090 con 0x7f82680c6d40 2024-09-11T22:15:25.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f826e96d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82680b4f10 con 0x7f8250003a00 2024-09-11T22:15:25.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f826e96d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8268070630 con 0x7f82680c64a0 2024-09-11T22:15:25.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f826cf0a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82680c6d40 0x7f82680c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f826cf0a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82680c6d40 0x7f82680c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37842/0 (socket says 172.21.15.50:37842) 2024-09-11T22:15:25.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f826cf0a640 1 -- 172.21.15.50:0/459608075 learned_addr learned my addr 172.21.15.50:0/459608075 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:25.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f82677fe640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82680c64a0 0x7f82680c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f8267fff640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8250003a00 0x7f826815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f826cf0a640 1 -- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82680c64a0 msgr2=0x7f82680c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f826cf0a640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82680c64a0 0x7f82680c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f826cf0a640 1 -- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8250003a00 msgr2=0x7f826815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.329+0000 7f826cf0a640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8250003a00 0x7f826815bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.330+0000 7f826cf0a640 1 -- 172.21.15.50:0/459608075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82680c69f0 con 0x7f82680c6d40 2024-09-11T22:15:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.330+0000 7f826cf0a640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82680c6d40 0x7f82680c71c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8260000f80 tx=0x7f8260007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.330+0000 7f8264ff9640 1 -- 172.21.15.50:0/459608075 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826000abb0 con 0x7f82680c6d40 2024-09-11T22:15:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.330+0000 7f8264ff9640 1 -- 172.21.15.50:0/459608075 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8260019070 con 0x7f82680c6d40 2024-09-11T22:15:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.330+0000 7f826e96d640 1 -- 172.21.15.50:0/459608075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826806c560 con 0x7f82680c6d40 2024-09-11T22:15:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.330+0000 7f8264ff9640 1 -- 172.21.15.50:0/459608075 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82600133f0 con 0x7f82680c6d40 2024-09-11T22:15:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.330+0000 7f826e96d640 1 -- 172.21.15.50:0/459608075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f826806cb20 con 0x7f82680c6d40 2024-09-11T22:15:25.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.332+0000 7f8264ff9640 1 -- 172.21.15.50:0/459608075 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8260013590 con 0x7f82680c6d40 2024-09-11T22:15:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.332+0000 7f8264ff9640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f825406be30 0x7f825406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.332+0000 7f8264ff9640 1 -- 172.21.15.50:0/459608075 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7f826008b450 con 0x7f82680c6d40 2024-09-11T22:15:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.332+0000 7f8267fff640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f825406be30 0x7f825406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.333+0000 7f8267fff640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f825406be30 0x7f825406e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8258033000 tx=0x7f8258008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.333+0000 7f82717e9740 1 Processor -- start 2024-09-11T22:15:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.333+0000 7f82717e9740 1 -- start start 2024-09-11T22:15:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f82717e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c7e780 0x55f6a7c7eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f82717e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c7bf40 0x55f6a7c7dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f82717e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c5e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f82717e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f6a7b9abe0 con 0x55f6a7c7e780 2024-09-11T22:15:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f82717e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f6a7b42820 con 0x55f6a7c7c3a0 2024-09-11T22:15:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f82717e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f6a7b96ba0 con 0x55f6a7c7bf40 2024-09-11T22:15:25.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f8267fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c7e780 0x55f6a7c7eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f8267fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c7e780 0x55f6a7c7eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37858/0 (socket says 172.21.15.50:37858) 2024-09-11T22:15:25.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f8267fff640 1 -- 172.21.15.50:0/1722558702 learned_addr learned my addr 172.21.15.50:0/1722558702 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:25.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f826cf0a640 1 --2- 172.21.15.50:0/1722558702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c5e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f82677fe640 1 --2- 172.21.15.50:0/1722558702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c7bf40 0x55f6a7c7dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f8267fff640 1 -- 172.21.15.50:0/1722558702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c7bf40 msgr2=0x55f6a7c7dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:25.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f8267fff640 1 --2- 172.21.15.50:0/1722558702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c7bf40 0x55f6a7c7dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f8267fff640 1 -- 172.21.15.50:0/1722558702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 msgr2=0x55f6a7c5e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:25.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f8267fff640 1 --2- 172.21.15.50:0/1722558702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c5e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f8267fff640 1 -- 172.21.15.50:0/1722558702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6a7979af0 con 0x55f6a7c7e780 2024-09-11T22:15:25.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.334+0000 7f8267fff640 1 --2- 172.21.15.50:0/1722558702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c7e780 0x55f6a7c7eb60 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8258034040 tx=0x7f825802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0ebdbe135c75e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:25.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.335+0000 7f824dffb640 1 -- 172.21.15.50:0/1722558702 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825804d070 con 0x55f6a7c7e780 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.335+0000 7f824dffb640 1 -- 172.21.15.50:0/1722558702 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8258003790 con 0x55f6a7c7e780 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.335+0000 7f824dffb640 1 -- 172.21.15.50:0/1722558702 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258036040 con 0x55f6a7c7e780 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.335+0000 7f82717e9740 1 -- 172.21.15.50:0/1722558702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c7e780 msgr2=0x55f6a7c7eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.335+0000 7f82717e9740 1 --2- 172.21.15.50:0/1722558702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c7e780 0x55f6a7c7eb60 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8258034040 tx=0x7f825802e000 comp rx=0 tx=0).stop 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.335+0000 7f82717e9740 1 -- 172.21.15.50:0/1722558702 shutdown_connections 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.335+0000 7f82717e9740 1 --2- 172.21.15.50:0/1722558702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c7bf40 0x55f6a7c7dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.335+0000 7f82717e9740 1 --2- 172.21.15.50:0/1722558702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c5e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.335+0000 7f82717e9740 1 --2- 172.21.15.50:0/1722558702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c7e780 0x55f6a7c7eb60 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.335+0000 7f82717e9740 1 -- 172.21.15.50:0/1722558702 >> 172.21.15.50:0/1722558702 conn(0x55f6a7c34670 msgr2=0x55f6a7c7c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.335+0000 7f82717e9740 1 -- 172.21.15.50:0/1722558702 shutdown_connections 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.335+0000 7f82717e9740 1 -- 172.21.15.50:0/1722558702 wait complete. 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.336+0000 7f82717e9740 1 -- start start 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.336+0000 7f82717e9740 1 Processor -- start 2024-09-11T22:15:25.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f82717e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c5f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f82717e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c7e780 0x55f6a7c8d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f82717e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7c75900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f82717e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f6a7c7aea0 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f82717e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f6a7b23950 con 0x55f6a7c7c3a0 2024-09-11T22:15:25.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f82717e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f6a7c7b180 con 0x55f6a7c7e780 2024-09-11T22:15:25.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f82717e9740 10 client.0 _ll_register_callbacks cb 0x55f6a7b5b5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:25.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f826cf0a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7c75900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f826cf0a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7c75900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37866/0 (socket says 172.21.15.50:37866) 2024-09-11T22:15:25.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f826cf0a640 1 -- 172.21.15.50:0/2610183472 learned_addr learned my addr 172.21.15.50:0/2610183472 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:25.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f8267fff640 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c5f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f82677fe640 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c7e780 0x55f6a7c8d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f826cf0a640 1 -- 172.21.15.50:0/2610183472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c7e780 msgr2=0x55f6a7c8d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:25.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f826cf0a640 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c7e780 0x55f6a7c8d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f826cf0a640 1 -- 172.21.15.50:0/2610183472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 msgr2=0x55f6a7c5f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f826cf0a640 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c5f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f826cf0a640 1 -- 172.21.15.50:0/2610183472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6a786d3e0 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f8267fff640 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c5f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f826cf0a640 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7c75900 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8260059590 tx=0x7f8260059600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26546bb04782db7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f8246ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.337+0000 7f8246ffd640 1 -- 172.21.15.50:0/2610183472 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260059a60 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f8246ffd640 1 -- 172.21.15.50:0/2610183472 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7f8260061d50 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f82717e9740 1 -- 172.21.15.50:0/2610183472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8258003790 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f8246ffd640 1 -- 172.21.15.50:0/2610183472 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f8260061f50 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f82717e9740 10 client.6960 fetch_fsmap learned FSMap version 56 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f82717e9740 1 -- 172.21.15.50:0/2610183472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55f6a79da280 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f8246ffd640 1 -- 172.21.15.50:0/2610183472 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8258003790 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f8246ffd640 1 -- 172.21.15.50:0/2610183472 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7f826005eb40 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f82717e9740 10 client.6960 fetch_fsmap finished waiting for FSMap version 56 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f82717e9740 10 client.6960 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f82717e9740 20 client.6960 populate_metadata read hostname 'smithi050' 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f82717e9740 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x55f6a7c61f30 0x55f6a7c73690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f82717e9740 4 client.6960 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f82717e9740 1 -- 172.21.15.50:0/2610183472 --> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6a7ba8310 con 0x55f6a7c61f30 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f8267fff640 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x55f6a7c61f30 0x55f6a7c73690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f8267fff640 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x55f6a7c61f30 0x55f6a7c73690 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=264820bef99bdec7 server_cookie=662da91f66bf7103 in_seq=0 out_seq=0 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.338+0000 7f8246ffd640 10 client.6960 ms_handle_connect on v2:172.21.15.50:6832/325962537 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f8246ffd640 1 -- 172.21.15.50:0/2610183472 <== mds.0 v2:172.21.15.50:6832/325962537 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6a7ba8310 con 0x55f6a7c61f30 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f8246ffd640 10 client.6960 handle_command_reply: tid=0 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f82717e9740 1 client.6960 shutdown 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f82717e9740 1 -- 172.21.15.50:0/2610183472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 msgr2=0x55f6a7c75900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:25.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f82717e9740 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7c75900 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8260059590 tx=0x7f8260059600 comp rx=0 tx=0).stop 2024-09-11T22:15:25.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f82717e9740 1 -- 172.21.15.50:0/2610183472 shutdown_connections 2024-09-11T22:15:25.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f82717e9740 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x55f6a7c61f30 0x55f6a7c73690 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f82717e9740 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c7e780 0x55f6a7c8d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f82717e9740 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7c75900 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f8246ffd640 0 client.6960 ms_handle_reset on v2:172.21.15.50:6832/325962537 2024-09-11T22:15:25.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f82717e9740 1 --2- 172.21.15.50:0/2610183472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c5f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f82717e9740 1 -- 172.21.15.50:0/2610183472 >> 172.21.15.50:0/2610183472 conn(0x55f6a7c7bf40 msgr2=0x55f6a7c7f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:25.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f82717e9740 1 -- 172.21.15.50:0/2610183472 shutdown_connections 2024-09-11T22:15:25.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f82717e9740 1 -- 172.21.15.50:0/2610183472 wait complete. 2024-09-11T22:15:25.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.339+0000 7f82717e9740 20 client.6960 trim_cache size 0 max 16384 2024-09-11T22:15:25.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.357+0000 7f82717e9740 1 Processor -- start 2024-09-11T22:15:25.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.357+0000 7f82717e9740 1 -- start start 2024-09-11T22:15:25.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.357+0000 7f82717e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7c33c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.357+0000 7f82717e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c61f30 0x55f6a7c8c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.357+0000 7f82717e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c7d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.357+0000 7f82717e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82682014e0 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.357+0000 7f82717e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8268200560 con 0x55f6a7c7c3a0 2024-09-11T22:15:25.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.357+0000 7f82717e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f82680ceef0 con 0x55f6a7c61f30 2024-09-11T22:15:25.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f8267fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7c33c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f8267fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7c33c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37874/0 (socket says 172.21.15.50:37874) 2024-09-11T22:15:25.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f8267fff640 1 -- 172.21.15.50:0/1654069181 learned_addr learned my addr 172.21.15.50:0/1654069181 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:25.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f826cf0a640 1 --2- 172.21.15.50:0/1654069181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c7d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f82677fe640 1 --2- 172.21.15.50:0/1654069181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c61f30 0x55f6a7c8c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f8267fff640 1 -- 172.21.15.50:0/1654069181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c61f30 msgr2=0x55f6a7c8c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f8267fff640 1 --2- 172.21.15.50:0/1654069181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c61f30 0x55f6a7c8c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f8267fff640 1 -- 172.21.15.50:0/1654069181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 msgr2=0x55f6a7c7d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f8267fff640 1 --2- 172.21.15.50:0/1654069181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c7d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f8267fff640 1 -- 172.21.15.50:0/1654069181 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6a78464a0 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f826cf0a640 1 --2- 172.21.15.50:0/1654069181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c7d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f82677fe640 1 --2- 172.21.15.50:0/1654069181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c61f30 0x55f6a7c8c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f8267fff640 1 --2- 172.21.15.50:0/1654069181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7c33c00 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f825802abb0 tx=0x7f825803a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611ee9f764aab243 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f824d7fa640 1 -- 172.21.15.50:0/1654069181 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825804d040 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f824d7fa640 1 -- 172.21.15.50:0/1654069181 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8258003790 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.358+0000 7f824d7fa640 1 -- 172.21.15.50:0/1654069181 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258036040 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.359+0000 7f82717e9740 1 -- 172.21.15.50:0/1654069181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 msgr2=0x55f6a7c33c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.359+0000 7f82717e9740 1 --2- 172.21.15.50:0/1654069181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7c33c00 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f825802abb0 tx=0x7f825803a000 comp rx=0 tx=0).stop 2024-09-11T22:15:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.359+0000 7f82717e9740 1 -- 172.21.15.50:0/1654069181 shutdown_connections 2024-09-11T22:15:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.359+0000 7f82717e9740 1 --2- 172.21.15.50:0/1654069181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c61f30 0x55f6a7c8c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.359+0000 7f82717e9740 1 --2- 172.21.15.50:0/1654069181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7c7d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.359+0000 7f82717e9740 1 --2- 172.21.15.50:0/1654069181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7c33c00 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.359+0000 7f82717e9740 1 -- 172.21.15.50:0/1654069181 >> 172.21.15.50:0/1654069181 conn(0x55f6a7c7bf40 msgr2=0x55f6a7c5f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.359+0000 7f82717e9740 1 -- 172.21.15.50:0/1654069181 shutdown_connections 2024-09-11T22:15:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.359+0000 7f82717e9740 1 -- 172.21.15.50:0/1654069181 wait complete. 2024-09-11T22:15:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.359+0000 7f82717e9740 1 -- start start 2024-09-11T22:15:25.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.360+0000 7f82717e9740 1 Processor -- start 2024-09-11T22:15:25.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.360+0000 7f82717e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7cf8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.360+0000 7f82717e9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c61f30 0x55f6a7ca06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.360+0000 7f82717e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7ca0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.360+0000 7f82717e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f6a7b5aaa0 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.360+0000 7f82717e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82680cf540 con 0x55f6a7c7c3a0 2024-09-11T22:15:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.360+0000 7f82717e9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f6a7c339f0 con 0x55f6a7c61f30 2024-09-11T22:15:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.360+0000 7f82717e9740 10 client.0 _ll_register_callbacks cb 0x7f82600594c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.360+0000 7f8267fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7cf8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.360+0000 7f8267fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7cf8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37878/0 (socket says 172.21.15.50:37878) 2024-09-11T22:15:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.360+0000 7f8267fff640 1 -- 172.21.15.50:0/280721623 learned_addr learned my addr 172.21.15.50:0/280721623 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f82677fe640 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c61f30 0x55f6a7ca06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f826cf0a640 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7ca0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f8267fff640 1 -- 172.21.15.50:0/280721623 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c61f30 msgr2=0x55f6a7ca06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:25.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f8267fff640 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c61f30 0x55f6a7ca06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f8267fff640 1 -- 172.21.15.50:0/280721623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 msgr2=0x55f6a7ca0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:25.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f8267fff640 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7ca0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f8267fff640 1 -- 172.21.15.50:0/280721623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6a7c7de30 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f82677fe640 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c61f30 0x55f6a7ca06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:25.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f826cf0a640 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7ca0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:25.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f8267fff640 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7cf8340 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8258053000 tx=0x7f82580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce823887549511fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:25.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f8246ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:15:25.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f8246ffd640 1 -- 172.21.15.50:0/280721623 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825805a020 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f8246ffd640 1 -- 172.21.15.50:0/280721623 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7f8258003940 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f82717e9740 1 -- 172.21.15.50:0/280721623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8258003790 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f8246ffd640 1 -- 172.21.15.50:0/280721623 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f8258064050 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f82717e9740 10 client.6966 fetch_fsmap learned FSMap version 56 2024-09-11T22:15:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f82717e9740 1 -- 172.21.15.50:0/280721623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55f6a7c76bf0 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f8246ffd640 1 -- 172.21.15.50:0/280721623 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8258003790 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.361+0000 7f8246ffd640 1 -- 172.21.15.50:0/280721623 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7f8258067020 con 0x55f6a7c5c1d0 2024-09-11T22:15:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.362+0000 7f82717e9740 10 client.6966 fetch_fsmap finished waiting for FSMap version 56 2024-09-11T22:15:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.362+0000 7f82717e9740 10 client.6966 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-11T22:15:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.362+0000 7f82717e9740 20 client.6966 populate_metadata read hostname 'smithi050' 2024-09-11T22:15:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.362+0000 7f82717e9740 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x55f6a7c7e780 0x55f6a7c37990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.362+0000 7f82717e9740 4 client.6966 mds_command: new command op to 6885 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-09-11T22:15:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.362+0000 7f82717e9740 1 -- 172.21.15.50:0/280721623 --> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) -- 0x55f6a7c73470 con 0x55f6a7c7e780 2024-09-11T22:15:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.362+0000 7f82677fe640 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x55f6a7c7e780 0x55f6a7c37990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.362+0000 7f82677fe640 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x55f6a7c7e780 0x55f6a7c37990 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b4faa0209077e6d server_cookie=4e7e3d7ec9f71ad3 in_seq=0 out_seq=0 2024-09-11T22:15:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.362+0000 7f8246ffd640 10 client.6966 ms_handle_connect on v2:172.21.15.50:6832/325962537 2024-09-11T22:15:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.362+0000 7f8246ffd640 1 -- 172.21.15.50:0/280721623 <== mds.0 v2:172.21.15.50:6832/325962537 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f6a7c73470 con 0x55f6a7c7e780 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.362+0000 7f8246ffd640 10 client.6966 handle_command_reply: tid=0 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.362+0000 7f82717e9740 1 client.6966 shutdown 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f82717e9740 1 -- 172.21.15.50:0/280721623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 msgr2=0x55f6a7cf8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f82717e9740 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7cf8340 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8258053000 tx=0x7f82580046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f82717e9740 1 -- 172.21.15.50:0/280721623 shutdown_connections 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f82717e9740 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.50:6832/325962537,v1:172.21.15.50:6833/325962537] conn(0x55f6a7c7e780 0x55f6a7c37990 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f82717e9740 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f6a7c61f30 0x55f6a7ca06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f82717e9740 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f6a7c7c3a0 0x55f6a7ca0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f8246ffd640 0 client.6966 ms_handle_reset on v2:172.21.15.50:6832/325962537 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f82717e9740 1 --2- 172.21.15.50:0/280721623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a7c5c1d0 0x55f6a7cf8340 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f82717e9740 1 -- 172.21.15.50:0/280721623 >> 172.21.15.50:0/280721623 conn(0x55f6a7c7bf40 msgr2=0x55f6a7c5f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f82717e9740 1 -- 172.21.15.50:0/280721623 shutdown_connections 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f82717e9740 1 -- 172.21.15.50:0/280721623 wait complete. 2024-09-11T22:15:25.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f82717e9740 20 client.6966 trim_cache size 0 max 16384 2024-09-11T22:15:25.370 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:15:25.370 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:15:25.370 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "a196ddba-a77b-4fd5-80a9-9cfbf5728734", 2024-09-11T22:15:25.370 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:15:25.370 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:15:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f826e96d640 1 -- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f825406be30 msgr2=0x7f825406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f826e96d640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f825406be30 0x7f825406e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8258033000 tx=0x7f8258008030 comp rx=0 tx=0).stop 2024-09-11T22:15:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f826e96d640 1 -- 172.21.15.50:0/459608075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82680c6d40 msgr2=0x7f82680c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f826e96d640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82680c6d40 0x7f82680c71c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8260000f80 tx=0x7f8260007bd0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f826e96d640 1 -- 172.21.15.50:0/459608075 shutdown_connections 2024-09-11T22:15:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f826e96d640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f825406be30 0x7f825406e2f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f826e96d640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82680c64a0 0x7f82680c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f826e96d640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82680c6d40 0x7f82680c71c0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f826e96d640 1 --2- 172.21.15.50:0/459608075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8250003a00 0x7f826815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:25.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.363+0000 7f826e96d640 1 -- 172.21.15.50:0/459608075 >> 172.21.15.50:0/459608075 conn(0x7f82680b4150 msgr2=0x7f82680b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:25.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.364+0000 7f826e96d640 1 -- 172.21.15.50:0/459608075 shutdown_connections 2024-09-11T22:15:25.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:25.364+0000 7f826e96d640 1 -- 172.21.15.50:0/459608075 wait complete. 2024-09-11T22:15:25.375 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': 'a196ddba-a77b-4fd5-80a9-9cfbf5728734', 'mode': 'asynchronous'}' 2024-09-11T22:15:25.643 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-09-11T22:15:25.643+0000 7f04ee3ae640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:15:25.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-11T22:15:25.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-11T22:15:25.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-11T22:15:35.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:35.376 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-11T22:15:35.400 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:15:35.400 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:15:35.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:15:35.536 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:15:35.536 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:15:35.536 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:15:35.536 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:35.555 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:15:35.555 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:35.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:15:35.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.764+0000 7f54f5ba6640 1 Processor -- start 2024-09-11T22:15:35.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.764+0000 7f54f5ba6640 1 -- start start 2024-09-11T22:15:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.764+0000 7f54f5ba6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54f015c240 0x7f54f00b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.765+0000 7f54f5ba6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f54f00735a0 0x7f54f015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.765+0000 7f54f5ba6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54f015c620 con 0x7f54f015f0e0 2024-09-11T22:15:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.765+0000 7f54f5ba6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f54f015f560 con 0x7f54f015c240 2024-09-11T22:15:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.765+0000 7f54f5ba6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f54f015f840 con 0x7f54f00735a0 2024-09-11T22:15:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.765+0000 7f54ef7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54f015c240 0x7f54f00b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.765+0000 7f54ef7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54f015c240 0x7f54f00b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54992/0 (socket says 172.21.15.50:54992) 2024-09-11T22:15:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.765+0000 7f54ef7fe640 1 -- 172.21.15.50:0/2300481882 learned_addr learned my addr 172.21.15.50:0/2300481882 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:35.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.765+0000 7f54eeffd640 1 --2- 172.21.15.50:0/2300481882 >> v2:172.21.15.77:3300/0 conn(0x7f54f00735a0 0x7f54f015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:35.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.765+0000 7f54ef7fe640 1 -- 172.21.15.50:0/2300481882 >> v2:172.21.15.77:3300/0 conn(0x7f54f00735a0 msgr2=0x7f54f015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:35.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.765+0000 7f54ef7fe640 1 --2- 172.21.15.50:0/2300481882 >> v2:172.21.15.77:3300/0 conn(0x7f54f00735a0 0x7f54f015eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:35.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.765+0000 7f54ef7fe640 1 -- 172.21.15.50:0/2300481882 >> v1:172.21.15.50:6789/0 conn(0x7f54f015f0e0 legacy=0x7f54f00728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:35.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.765+0000 7f54ef7fe640 1 -- 172.21.15.50:0/2300481882 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f015fb20 con 0x7f54f015c240 2024-09-11T22:15:35.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.765+0000 7f54eeffd640 1 --2- 172.21.15.50:0/2300481882 >> v2:172.21.15.77:3300/0 conn(0x7f54f00735a0 0x7f54f015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:35.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.766+0000 7f54ef7fe640 1 --2- 172.21.15.50:0/2300481882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f015c240 0x7f54f00b4770 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f54f00703e0 tx=0x7f54e002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2c78b570a08703 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:35.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.766+0000 7f54ee7fc640 1 -- 172.21.15.50:0/2300481882 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0036070 con 0x7f54f015c240 2024-09-11T22:15:35.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.766+0000 7f54ee7fc640 1 -- 172.21.15.50:0/2300481882 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e0031600 con 0x7f54f015c240 2024-09-11T22:15:35.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.766+0000 7f54ee7fc640 1 -- 172.21.15.50:0/2300481882 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e00319d0 con 0x7f54f015c240 2024-09-11T22:15:35.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.766+0000 7f54f5ba6640 1 -- 172.21.15.50:0/2300481882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f015c240 msgr2=0x7f54f00b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:35.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.766+0000 7f54f5ba6640 1 --2- 172.21.15.50:0/2300481882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f015c240 0x7f54f00b4770 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f54f00703e0 tx=0x7f54e002a730 comp rx=0 tx=0).stop 2024-09-11T22:15:35.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.767+0000 7f54f5ba6640 1 -- 172.21.15.50:0/2300481882 shutdown_connections 2024-09-11T22:15:35.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.767+0000 7f54f5ba6640 1 --2- 172.21.15.50:0/2300481882 >> v2:172.21.15.77:3300/0 conn(0x7f54f00735a0 0x7f54f015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:35.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.767+0000 7f54f5ba6640 1 --2- 172.21.15.50:0/2300481882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f015c240 0x7f54f00b4770 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:35.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.767+0000 7f54f5ba6640 1 -- 172.21.15.50:0/2300481882 >> 172.21.15.50:0/2300481882 conn(0x7f54f00b2bd0 msgr2=0x7f54f00b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:35.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.767+0000 7f54f5ba6640 1 -- 172.21.15.50:0/2300481882 shutdown_connections 2024-09-11T22:15:35.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.767+0000 7f54f5ba6640 1 -- 172.21.15.50:0/2300481882 wait complete. 2024-09-11T22:15:35.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.768+0000 7f54f5ba6640 1 Processor -- start 2024-09-11T22:15:35.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.768+0000 7f54f5ba6640 1 -- start start 2024-09-11T22:15:35.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54f5ba6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54f00735a0 0x7f54f0157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:35.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54f5ba6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54f015c240 0x7f54f01e8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:35.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54f5ba6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f015f0e0 0x7f54f01e9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:35.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54f5ba6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f54f00b4cb0 con 0x7f54f015f0e0 2024-09-11T22:15:35.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54f5ba6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f54f00b4250 con 0x7f54f00735a0 2024-09-11T22:15:35.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54f5ba6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f54f00b4e30 con 0x7f54f015c240 2024-09-11T22:15:35.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54effff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f015f0e0 0x7f54f01e9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:35.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54effff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f015f0e0 0x7f54f01e9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55004/0 (socket says 172.21.15.50:55004) 2024-09-11T22:15:35.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54effff640 1 -- 172.21.15.50:0/779985734 learned_addr learned my addr 172.21.15.50:0/779985734 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:35.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54ef7fe640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54f00735a0 0x7f54f0157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:35.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54eeffd640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54f015c240 0x7f54f01e8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:35.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54effff640 1 -- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54f015c240 msgr2=0x7f54f01e8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:35.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54effff640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54f015c240 0x7f54f01e8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:35.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54effff640 1 -- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54f00735a0 msgr2=0x7f54f0157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:35.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54effff640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54f00735a0 0x7f54f0157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:35.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.769+0000 7f54effff640 1 -- 172.21.15.50:0/779985734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f01e8990 con 0x7f54f015f0e0 2024-09-11T22:15:35.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.770+0000 7f54effff640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f015f0e0 0x7f54f01e9a30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f54e800c3c0 tx=0x7f54e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:35.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.770+0000 7f54d7fff640 1 -- 172.21.15.50:0/779985734 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8017070 con 0x7f54f015f0e0 2024-09-11T22:15:35.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.770+0000 7f54d7fff640 1 -- 172.21.15.50:0/779985734 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e80052d0 con 0x7f54f015f0e0 2024-09-11T22:15:35.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.770+0000 7f54f5ba6640 1 -- 172.21.15.50:0/779985734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f01e8c70 con 0x7f54f015f0e0 2024-09-11T22:15:35.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.770+0000 7f54d7fff640 1 -- 172.21.15.50:0/779985734 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8003810 con 0x7f54f015f0e0 2024-09-11T22:15:35.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.770+0000 7f54f5ba6640 1 -- 172.21.15.50:0/779985734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f01e9230 con 0x7f54f015f0e0 2024-09-11T22:15:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.771+0000 7f54f5ba6640 1 -- 172.21.15.50:0/779985734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f01630e0 con 0x7f54f015f0e0 2024-09-11T22:15:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.771+0000 7f54d7fff640 1 -- 172.21.15.50:0/779985734 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54e801a070 con 0x7f54f015f0e0 2024-09-11T22:15:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.772+0000 7f54d7fff640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f54dc06be30 0x7f54dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.772+0000 7f54d7fff640 1 -- 172.21.15.50:0/779985734 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7f54e808a1b0 con 0x7f54f015f0e0 2024-09-11T22:15:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.772+0000 7f54ef7fe640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f54dc06be30 0x7f54dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.772+0000 7f54ef7fe640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f54dc06be30 0x7f54dc06e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f54e0033000 tx=0x7f54e0009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:35.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.776+0000 7f54d7fff640 1 -- 172.21.15.50:0/779985734 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54e8058410 con 0x7f54f015f0e0 2024-09-11T22:15:35.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.963+0000 7f54f5ba6640 1 -- 172.21.15.50:0/779985734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f54f015eba0 con 0x7f54f015f0e0 2024-09-11T22:15:35.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.963+0000 7f54d7fff640 1 -- 172.21.15.50:0/779985734 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v78) ==== 80+0+364 (secure 0 0 0) 0x7f54e805c710 con 0x7f54f015f0e0 2024-09-11T22:15:35.964 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.77:6836/784761109 2024-09-12T22:15:19.635063+0000 2024-09-11T22:15:35.964 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.77:6834/784761109 2024-09-12T22:15:19.635063+0000 2024-09-11T22:15:35.964 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.77:6837/1115358060 2024-09-12T22:15:19.519162+0000 2024-09-11T22:15:35.965 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.77:6835/1115358060 2024-09-12T22:15:19.519162+0000 2024-09-11T22:15:35.965 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6834/4265727513 2024-09-12T22:15:19.508243+0000 2024-09-11T22:15:35.965 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6832/4265727513 2024-09-12T22:15:19.508243+0000 2024-09-11T22:15:35.965 INFO:teuthology.orchestra.run.smithi050.stderr:listed 6 entries 2024-09-11T22:15:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.965+0000 7f54f5ba6640 1 -- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f54dc06be30 msgr2=0x7f54dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.965+0000 7f54f5ba6640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f54dc06be30 0x7f54dc06e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f54e0033000 tx=0x7f54e0009000 comp rx=0 tx=0).stop 2024-09-11T22:15:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.965+0000 7f54f5ba6640 1 -- 172.21.15.50:0/779985734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f015f0e0 msgr2=0x7f54f01e9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.965+0000 7f54f5ba6640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f015f0e0 0x7f54f01e9a30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f54e800c3c0 tx=0x7f54e800c880 comp rx=0 tx=0).stop 2024-09-11T22:15:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.965+0000 7f54f5ba6640 1 -- 172.21.15.50:0/779985734 shutdown_connections 2024-09-11T22:15:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.965+0000 7f54f5ba6640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f54dc06be30 0x7f54dc06e2f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.965+0000 7f54f5ba6640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54f015c240 0x7f54f01e8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:35.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.965+0000 7f54f5ba6640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54f015f0e0 0x7f54f01e9a30 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.965+0000 7f54f5ba6640 1 --2- 172.21.15.50:0/779985734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54f00735a0 0x7f54f0157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.965+0000 7f54f5ba6640 1 -- 172.21.15.50:0/779985734 >> 172.21.15.50:0/779985734 conn(0x7f54f00b2bd0 msgr2=0x7f54f00718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.965+0000 7f54f5ba6640 1 -- 172.21.15.50:0/779985734 shutdown_connections 2024-09-11T22:15:35.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:35.965+0000 7f54f5ba6640 1 -- 172.21.15.50:0/779985734 wait complete. 2024-09-11T22:15:35.977 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:15:35.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:35.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:36.007 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:15:36.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:36.008 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:15:36.064 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:15:36.064 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:15:36.064 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:36.083 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:15:36.083 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:15:36.083 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:15:36.084 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:36.120 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:15:36.121 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:15:36.121 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:15:36.121 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:36.142 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:15:36.142 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.261+0000 7fc32f723640 1 Processor -- start 2024-09-11T22:15:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.262+0000 7fc32f723640 1 -- start start 2024-09-11T22:15:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.262+0000 7fc32f723640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc32815e870 0x7fc3280d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.262+0000 7fc32f723640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3280d16d0 0x7fc3280d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.262+0000 7fc32f723640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3280d3a30 0x7fc3280b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.262+0000 7fc32f723640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc3280d1b10 con 0x7fc32815e870 2024-09-11T22:15:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.262+0000 7fc32f723640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc3280d3e80 con 0x7fc3280d3a30 2024-09-11T22:15:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.262+0000 7fc32f723640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc3280cfa80 con 0x7fc3280d16d0 2024-09-11T22:15:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.263+0000 7fc32d4bf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc32815e870 0x7fc3280d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.263+0000 7fc32d4bf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc32815e870 0x7fc3280d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55020/0 (socket says 172.21.15.50:55020) 2024-09-11T22:15:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.263+0000 7fc32d4bf640 1 -- 172.21.15.50:0/3789578536 learned_addr learned my addr 172.21.15.50:0/3789578536 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.263+0000 7fc32dcc0640 1 --2- 172.21.15.50:0/3789578536 >> v2:172.21.15.77:3300/0 conn(0x7fc3280d3a30 0x7fc3280b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.263+0000 7fc32ccbe640 1 --2- 172.21.15.50:0/3789578536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3280d16d0 0x7fc3280d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.263+0000 7fc32d4bf640 1 -- 172.21.15.50:0/3789578536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3280d16d0 msgr2=0x7fc3280d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.263+0000 7fc32d4bf640 1 --2- 172.21.15.50:0/3789578536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3280d16d0 0x7fc3280d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.263+0000 7fc32d4bf640 1 -- 172.21.15.50:0/3789578536 >> v2:172.21.15.77:3300/0 conn(0x7fc3280d3a30 msgr2=0x7fc3280b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.263+0000 7fc32d4bf640 1 --2- 172.21.15.50:0/3789578536 >> v2:172.21.15.77:3300/0 conn(0x7fc3280d3a30 0x7fc3280b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.263+0000 7fc32d4bf640 1 -- 172.21.15.50:0/3789578536 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3280d40d0 con 0x7fc32815e870 2024-09-11T22:15:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.263+0000 7fc32ccbe640 1 --2- 172.21.15.50:0/3789578536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3280d16d0 0x7fc3280d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.264+0000 7fc32d4bf640 1 --2- 172.21.15.50:0/3789578536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc32815e870 0x7fc3280d1190 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc3280ced60 tx=0x7fc32402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4a82bb2271867d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.264+0000 7fc31ffff640 1 -- 172.21.15.50:0/3789578536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324037070 con 0x7fc32815e870 2024-09-11T22:15:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.264+0000 7fc31ffff640 1 -- 172.21.15.50:0/3789578536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc324032440 con 0x7fc32815e870 2024-09-11T22:15:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.264+0000 7fc31ffff640 1 -- 172.21.15.50:0/3789578536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324032810 con 0x7fc32815e870 2024-09-11T22:15:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.264+0000 7fc32f723640 1 -- 172.21.15.50:0/3789578536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc32815e870 msgr2=0x7fc3280d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.264+0000 7fc32f723640 1 --2- 172.21.15.50:0/3789578536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc32815e870 0x7fc3280d1190 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc3280ced60 tx=0x7fc32402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.264+0000 7fc32f723640 1 -- 172.21.15.50:0/3789578536 shutdown_connections 2024-09-11T22:15:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.264+0000 7fc32f723640 1 --2- 172.21.15.50:0/3789578536 >> v2:172.21.15.77:3300/0 conn(0x7fc3280d3a30 0x7fc3280b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.264+0000 7fc32f723640 1 --2- 172.21.15.50:0/3789578536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3280d16d0 0x7fc3280d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.264+0000 7fc32f723640 1 --2- 172.21.15.50:0/3789578536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc32815e870 0x7fc3280d1190 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.264+0000 7fc32f723640 1 -- 172.21.15.50:0/3789578536 >> 172.21.15.50:0/3789578536 conn(0x7fc3280727a0 msgr2=0x7fc3280679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.265+0000 7fc32f723640 1 -- 172.21.15.50:0/3789578536 shutdown_connections 2024-09-11T22:15:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.265+0000 7fc32f723640 1 -- 172.21.15.50:0/3789578536 wait complete. 2024-09-11T22:15:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.266+0000 7fc32f723640 1 Processor -- start 2024-09-11T22:15:36.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.266+0000 7fc32f723640 1 -- start start 2024-09-11T22:15:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.266+0000 7fc32f723640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3280d16d0 0x7fc3280cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.266+0000 7fc32f723640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3280d3a30 0x7fc328154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.266+0000 7fc32f723640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc32815e870 0x7fc3280b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.266+0000 7fc32f723640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc3280b7ee0 con 0x7fc3280d16d0 2024-09-11T22:15:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32f723640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3280b7c00 con 0x7fc3280d3a30 2024-09-11T22:15:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32f723640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc32815ec50 con 0x7fc32815e870 2024-09-11T22:15:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32d4bf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3280d16d0 0x7fc3280cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32d4bf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3280d16d0 0x7fc3280cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55028/0 (socket says 172.21.15.50:55028) 2024-09-11T22:15:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32d4bf640 1 -- 172.21.15.50:0/1829230874 learned_addr learned my addr 172.21.15.50:0/1829230874 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:36.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32ccbe640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3280d3a30 0x7fc328154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32dcc0640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc32815e870 0x7fc3280b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32d4bf640 1 -- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc32815e870 msgr2=0x7fc3280b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32d4bf640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc32815e870 0x7fc3280b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32d4bf640 1 -- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3280d3a30 msgr2=0x7fc328154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32d4bf640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3280d3a30 0x7fc328154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32d4bf640 1 -- 172.21.15.50:0/1829230874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3280ce440 con 0x7fc3280d16d0 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32d4bf640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3280d16d0 0x7fc3280cf4e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fc32402a220 tx=0x7fc3240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc31dffb640 1 -- 172.21.15.50:0/1829230874 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324041020 con 0x7fc3280d16d0 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc31dffb640 1 -- 172.21.15.50:0/1829230874 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3240306c0 con 0x7fc3280d16d0 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc32f723640 1 -- 172.21.15.50:0/1829230874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3280ce720 con 0x7fc3280d16d0 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.267+0000 7fc31dffb640 1 -- 172.21.15.50:0/1829230874 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324037040 con 0x7fc3280d16d0 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.268+0000 7fc32f723640 1 -- 172.21.15.50:0/1829230874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3280cece0 con 0x7fc3280d16d0 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.268+0000 7fc32f723640 1 -- 172.21.15.50:0/1829230874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3280b78b0 con 0x7fc3280d16d0 2024-09-11T22:15:36.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.269+0000 7fc31dffb640 1 -- 172.21.15.50:0/1829230874 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc324044020 con 0x7fc3280d16d0 2024-09-11T22:15:36.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.270+0000 7fc31dffb640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc30c06be30 0x7fc30c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.270+0000 7fc31dffb640 1 -- 172.21.15.50:0/1829230874 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7fc3240ab7a0 con 0x7fc3280d16d0 2024-09-11T22:15:36.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.270+0000 7fc32ccbe640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc30c06be30 0x7fc30c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.270+0000 7fc32ccbe640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc30c06be30 0x7fc30c06e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc3280b6490 tx=0x7fc318008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.274+0000 7fc31dffb640 1 -- 172.21.15.50:0/1829230874 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc32404b030 con 0x7fc3280d16d0 2024-09-11T22:15:36.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.488+0000 7fc32f723640 1 -- 172.21.15.50:0/1829230874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3280ba1a0 con 0x7fc3280d16d0 2024-09-11T22:15:36.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.489+0000 7fc31dffb640 1 -- 172.21.15.50:0/1829230874 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5220 (secure 0 0 0) 0x7fc32407a050 con 0x7fc3280d16d0 2024-09-11T22:15:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:36.490 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"btime":"2024-09-11T22:15:22:649424+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4081050909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4081050909},{"type":"v1","addr":"172.21.15.77:6835","nonce":4081050909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6340,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/502868531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":502868531},{"type":"v1","addr":"172.21.15.77:6837","nonce":502868531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1024879489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1024879489},{"type":"v1","addr":"172.21.15.50:6835","nonce":1024879489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:06.945196+0000","modified":"2024-09-11T22:15:22.649418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6833/325962537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":325962537},{"type":"v1","addr":"172.21.15.50:6833","nonce":325962537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6885,"qdb_cluster":[6885]},"id":5}]} 2024-09-11T22:15:36.490 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 56 2024-09-11T22:15:36.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.491+0000 7fc32f723640 1 -- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc30c06be30 msgr2=0x7fc30c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.491+0000 7fc32f723640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc30c06be30 0x7fc30c06e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc3280b6490 tx=0x7fc318008040 comp rx=0 tx=0).stop 2024-09-11T22:15:36.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.491+0000 7fc32f723640 1 -- 172.21.15.50:0/1829230874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3280d16d0 msgr2=0x7fc3280cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.491+0000 7fc32f723640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3280d16d0 0x7fc3280cf4e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fc32402a220 tx=0x7fc3240046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.491+0000 7fc32f723640 1 -- 172.21.15.50:0/1829230874 shutdown_connections 2024-09-11T22:15:36.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.491+0000 7fc32f723640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc30c06be30 0x7fc30c06e2f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.491+0000 7fc32f723640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc32815e870 0x7fc3280b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.491+0000 7fc32f723640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3280d3a30 0x7fc328154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.491+0000 7fc32f723640 1 --2- 172.21.15.50:0/1829230874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3280d16d0 0x7fc3280cf4e0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.491+0000 7fc32f723640 1 -- 172.21.15.50:0/1829230874 >> 172.21.15.50:0/1829230874 conn(0x7fc3280727a0 msgr2=0x7fc3280679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:36.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.491+0000 7fc32f723640 1 -- 172.21.15.50:0/1829230874 shutdown_connections 2024-09-11T22:15:36.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.491+0000 7fc32f723640 1 -- 172.21.15.50:0/1829230874 wait complete. 2024-09-11T22:15:36.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:36.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.604+0000 7f8155aba640 1 Processor -- start 2024-09-11T22:15:36.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.604+0000 7f8155aba640 1 -- start start 2024-09-11T22:15:36.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.605+0000 7f8155aba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f815015f350 0x7f815015fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.605+0000 7f8155aba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f81500679c0 0x7f8150067e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.605+0000 7f8155aba640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f815015f7f0 con 0x7f815015c3c0 2024-09-11T22:15:36.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.605+0000 7f8155aba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f815006e700 con 0x7f815015f350 2024-09-11T22:15:36.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.605+0000 7f8155aba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f815015fad0 con 0x7f81500679c0 2024-09-11T22:15:36.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.605+0000 7f814effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f815015f350 0x7f815015fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.605+0000 7f814effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f815015f350 0x7f815015fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55044/0 (socket says 172.21.15.50:55044) 2024-09-11T22:15:36.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.605+0000 7f814effd640 1 -- 172.21.15.50:0/308594040 learned_addr learned my addr 172.21.15.50:0/308594040 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:36.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.605+0000 7f814ffff640 1 --2- 172.21.15.50:0/308594040 >> v2:172.21.15.77:3300/0 conn(0x7f81500679c0 0x7f8150067e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.605+0000 7f814effd640 1 -- 172.21.15.50:0/308594040 >> v2:172.21.15.77:3300/0 conn(0x7f81500679c0 msgr2=0x7f8150067e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:36.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.605+0000 7f814effd640 1 --2- 172.21.15.50:0/308594040 >> v2:172.21.15.77:3300/0 conn(0x7f81500679c0 0x7f8150067e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.605+0000 7f814effd640 1 -- 172.21.15.50:0/308594040 >> v1:172.21.15.77:6789/0 conn(0x7f815015c3c0 legacy=0x7f815015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:36.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.605+0000 7f814effd640 1 -- 172.21.15.50:0/308594040 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815006e950 con 0x7f815015f350 2024-09-11T22:15:36.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.606+0000 7f814effd640 1 --2- 172.21.15.50:0/308594040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f815015f350 0x7f815015fe60 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f81500cfbd0 tx=0x7f814402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e748e442a7e3c219 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.606+0000 7f814e7fc640 1 -- 172.21.15.50:0/308594040 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144037070 con 0x7f815015f350 2024-09-11T22:15:36.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.606+0000 7f814e7fc640 1 -- 172.21.15.50:0/308594040 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8144032440 con 0x7f815015f350 2024-09-11T22:15:36.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.606+0000 7f814e7fc640 1 -- 172.21.15.50:0/308594040 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144032810 con 0x7f815015f350 2024-09-11T22:15:36.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.607+0000 7f8155aba640 1 -- 172.21.15.50:0/308594040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f815015f350 msgr2=0x7f815015fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.607+0000 7f8155aba640 1 --2- 172.21.15.50:0/308594040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f815015f350 0x7f815015fe60 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f81500cfbd0 tx=0x7f814402a1a0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.607+0000 7f8155aba640 1 -- 172.21.15.50:0/308594040 shutdown_connections 2024-09-11T22:15:36.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.607+0000 7f8155aba640 1 --2- 172.21.15.50:0/308594040 >> v2:172.21.15.77:3300/0 conn(0x7f81500679c0 0x7f8150067e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.607+0000 7f8155aba640 1 --2- 172.21.15.50:0/308594040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f815015f350 0x7f815015fe60 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.607+0000 7f8155aba640 1 -- 172.21.15.50:0/308594040 >> 172.21.15.50:0/308594040 conn(0x7f8150075060 msgr2=0x7f815006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:36.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.607+0000 7f8155aba640 1 -- 172.21.15.50:0/308594040 shutdown_connections 2024-09-11T22:15:36.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.607+0000 7f8155aba640 1 -- 172.21.15.50:0/308594040 wait complete. 2024-09-11T22:15:36.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.608+0000 7f8155aba640 1 Processor -- start 2024-09-11T22:15:36.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.608+0000 7f8155aba640 1 -- start start 2024-09-11T22:15:36.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.609+0000 7f8155aba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81500679c0 0x7f8150148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.609+0000 7f8155aba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f815015c3c0 0x7f815015d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.609+0000 7f8155aba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f815015f350 0x7f815015ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.609+0000 7f8155aba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f815006f150 con 0x7f815015c3c0 2024-09-11T22:15:36.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.609+0000 7f8155aba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81500d0940 con 0x7f81500679c0 2024-09-11T22:15:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.609+0000 7f8155aba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f815006f2d0 con 0x7f815015f350 2024-09-11T22:15:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.609+0000 7f814effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f815015c3c0 0x7f815015d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.609+0000 7f814effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f815015c3c0 0x7f815015d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55046/0 (socket says 172.21.15.50:55046) 2024-09-11T22:15:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.609+0000 7f814effd640 1 -- 172.21.15.50:0/426914990 learned_addr learned my addr 172.21.15.50:0/426914990 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.609+0000 7f814ffff640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f815015f350 0x7f815015ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.609+0000 7f814f7fe640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81500679c0 0x7f8150148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.610+0000 7f814effd640 1 -- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f815015f350 msgr2=0x7f815015ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.610+0000 7f814effd640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f815015f350 0x7f815015ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.610+0000 7f814effd640 1 -- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81500679c0 msgr2=0x7f8150148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.610+0000 7f814effd640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81500679c0 0x7f8150148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.610+0000 7f814effd640 1 -- 172.21.15.50:0/426914990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81501546d0 con 0x7f815015c3c0 2024-09-11T22:15:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.610+0000 7f814f7fe640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81500679c0 0x7f8150148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.610+0000 7f814ffff640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f815015f350 0x7f815015ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.610+0000 7f814effd640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f815015c3c0 0x7f815015d890 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f814402a1e0 tx=0x7f81440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.610+0000 7f8137fff640 1 -- 172.21.15.50:0/426914990 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144037040 con 0x7f815015c3c0 2024-09-11T22:15:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.610+0000 7f8137fff640 1 -- 172.21.15.50:0/426914990 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8144042070 con 0x7f815015c3c0 2024-09-11T22:15:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.610+0000 7f8155aba640 1 -- 172.21.15.50:0/426914990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8150153630 con 0x7f815015c3c0 2024-09-11T22:15:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.610+0000 7f8137fff640 1 -- 172.21.15.50:0/426914990 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144030bb0 con 0x7f815015c3c0 2024-09-11T22:15:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.610+0000 7f8155aba640 1 -- 172.21.15.50:0/426914990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8150153bf0 con 0x7f815015c3c0 2024-09-11T22:15:36.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.611+0000 7f8155aba640 1 -- 172.21.15.50:0/426914990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f815015fe60 con 0x7f815015c3c0 2024-09-11T22:15:36.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.611+0000 7f8137fff640 1 -- 172.21.15.50:0/426914990 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8144047460 con 0x7f815015c3c0 2024-09-11T22:15:36.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.612+0000 7f8137fff640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f813c06be30 0x7f813c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.612+0000 7f8137fff640 1 -- 172.21.15.50:0/426914990 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7f81440abbb0 con 0x7f815015c3c0 2024-09-11T22:15:36.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.612+0000 7f814f7fe640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f813c06be30 0x7f813c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.613+0000 7f814f7fe640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f813c06be30 0x7f813c06e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8140003eb0 tx=0x7f8140009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.616+0000 7f8137fff640 1 -- 172.21.15.50:0/426914990 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8144045360 con 0x7f815015c3c0 2024-09-11T22:15:36.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.830+0000 7f8155aba640 1 -- 172.21.15.50:0/426914990 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81500b5e40 con 0x7f815015c3c0 2024-09-11T22:15:36.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.831+0000 7f8137fff640 1 -- 172.21.15.50:0/426914990 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5220 (secure 0 0 0) 0x7f814407a4f0 con 0x7f815015c3c0 2024-09-11T22:15:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:36.832 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"btime":"2024-09-11T22:15:22:649424+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4081050909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4081050909},{"type":"v1","addr":"172.21.15.77:6835","nonce":4081050909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6340,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/502868531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":502868531},{"type":"v1","addr":"172.21.15.77:6837","nonce":502868531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1024879489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1024879489},{"type":"v1","addr":"172.21.15.50:6835","nonce":1024879489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:06.945196+0000","modified":"2024-09-11T22:15:22.649418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6833/325962537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":325962537},{"type":"v1","addr":"172.21.15.50:6833","nonce":325962537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6885,"qdb_cluster":[6885]},"id":5}]} 2024-09-11T22:15:36.832 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 56 2024-09-11T22:15:36.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.833+0000 7f8155aba640 1 -- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f813c06be30 msgr2=0x7f813c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.833+0000 7f8155aba640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f813c06be30 0x7f813c06e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8140003eb0 tx=0x7f8140009040 comp rx=0 tx=0).stop 2024-09-11T22:15:36.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.833+0000 7f8155aba640 1 -- 172.21.15.50:0/426914990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f815015c3c0 msgr2=0x7f815015d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.833+0000 7f8155aba640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f815015c3c0 0x7f815015d890 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f814402a1e0 tx=0x7f81440046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.833+0000 7f8155aba640 1 -- 172.21.15.50:0/426914990 shutdown_connections 2024-09-11T22:15:36.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.833+0000 7f8155aba640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f813c06be30 0x7f813c06e2f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.833+0000 7f8155aba640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f815015f350 0x7f815015ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.833+0000 7f8155aba640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f815015c3c0 0x7f815015d890 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.833+0000 7f8155aba640 1 --2- 172.21.15.50:0/426914990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81500679c0 0x7f8150148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.833+0000 7f8155aba640 1 -- 172.21.15.50:0/426914990 >> 172.21.15.50:0/426914990 conn(0x7f8150075060 msgr2=0x7f815006f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:36.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.833+0000 7f8155aba640 1 -- 172.21.15.50:0/426914990 shutdown_connections 2024-09-11T22:15:36.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.833+0000 7f8155aba640 1 -- 172.21.15.50:0/426914990 wait complete. 2024-09-11T22:15:36.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:15:36.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.947+0000 7f6201549640 1 Processor -- start 2024-09-11T22:15:36.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.947+0000 7f6201549640 1 -- start start 2024-09-11T22:15:36.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.947+0000 7f6201549640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61fc15c2c0 0x7f61fc0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.947+0000 7f6201549640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61fc0d05e0 0x7f61fc0ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.947+0000 7f6201549640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61fc0b4f00 con 0x7f61fc0b3e10 2024-09-11T22:15:36.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.947+0000 7f6201549640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f61fc0b4360 con 0x7f61fc0d05e0 2024-09-11T22:15:36.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.947+0000 7f6201549640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f61fc0b51c0 con 0x7f61fc15c2c0 2024-09-11T22:15:36.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.948+0000 7f61faffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61fc15c2c0 0x7f61fc0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.948+0000 7f61fb7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61fc0d05e0 0x7f61fc0ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.948+0000 7f61fa7fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f61fc0b3e10 0x7f61fc0cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:39382/0 (socket says 172.21.15.50:39382) 2024-09-11T22:15:36.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.948+0000 7f61fa7fc640 1 -- 172.21.15.50:0/3820198355 learned_addr learned my addr 172.21.15.50:0/3820198355 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:36.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.948+0000 7f61faffd640 1 -- 172.21.15.50:0/3820198355 >> v2:172.21.15.77:3300/0 conn(0x7f61fc0d05e0 msgr2=0x7f61fc0ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:36.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.948+0000 7f61faffd640 1 --2- 172.21.15.50:0/3820198355 >> v2:172.21.15.77:3300/0 conn(0x7f61fc0d05e0 0x7f61fc0ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.948+0000 7f61faffd640 1 -- 172.21.15.50:0/3820198355 >> v1:172.21.15.77:6789/0 conn(0x7f61fc0b3e10 legacy=0x7f61fc0cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.948+0000 7f61faffd640 1 -- 172.21.15.50:0/3820198355 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc0b54a0 con 0x7f61fc15c2c0 2024-09-11T22:15:36.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.948+0000 7f61f9ffb640 1 -- 172.21.15.50:0/3820198355 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4155005195 0 0) 0x7f61fc0b4f00 con 0x7f61fc0b3e10 2024-09-11T22:15:36.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.949+0000 7f61faffd640 1 --2- 172.21.15.50:0/3820198355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61fc15c2c0 0x7f61fc0b46a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0097a0 tx=0x7f61ec02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22f9442da9f1a4d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.950+0000 7f61f9ffb640 1 -- 172.21.15.50:0/3820198355 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec037070 con 0x7f61fc15c2c0 2024-09-11T22:15:36.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.950+0000 7f61f9ffb640 1 -- 172.21.15.50:0/3820198355 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ec02ae50 con 0x7f61fc15c2c0 2024-09-11T22:15:36.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.950+0000 7f61f9ffb640 1 -- 172.21.15.50:0/3820198355 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec032660 con 0x7f61fc15c2c0 2024-09-11T22:15:36.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.950+0000 7f6201549640 1 -- 172.21.15.50:0/3820198355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61fc15c2c0 msgr2=0x7f61fc0b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.950+0000 7f6201549640 1 --2- 172.21.15.50:0/3820198355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61fc15c2c0 0x7f61fc0b46a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0097a0 tx=0x7f61ec02a100 comp rx=0 tx=0).stop 2024-09-11T22:15:36.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.950+0000 7f6201549640 1 -- 172.21.15.50:0/3820198355 shutdown_connections 2024-09-11T22:15:36.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.950+0000 7f6201549640 1 --2- 172.21.15.50:0/3820198355 >> v2:172.21.15.77:3300/0 conn(0x7f61fc0d05e0 0x7f61fc0ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.950+0000 7f6201549640 1 --2- 172.21.15.50:0/3820198355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61fc15c2c0 0x7f61fc0b46a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.950+0000 7f6201549640 1 -- 172.21.15.50:0/3820198355 >> 172.21.15.50:0/3820198355 conn(0x7f61fc0679c0 msgr2=0x7f61fc067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:36.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.950+0000 7f6201549640 1 -- 172.21.15.50:0/3820198355 shutdown_connections 2024-09-11T22:15:36.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.950+0000 7f6201549640 1 -- 172.21.15.50:0/3820198355 wait complete. 2024-09-11T22:15:36.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.952+0000 7f6201549640 1 Processor -- start 2024-09-11T22:15:36.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.952+0000 7f6201549640 1 -- start start 2024-09-11T22:15:36.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f6201549640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61fc0b3e10 0x7f61fc150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f6201549640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61fc0d05e0 0x7f61fc1f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f6201549640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61fc15c2c0 0x7f61fc0c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f6201549640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc06d070 con 0x7f61fc15c2c0 2024-09-11T22:15:36.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f6201549640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc0ce200 con 0x7f61fc0d05e0 2024-09-11T22:15:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f6201549640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f61fc06d1f0 con 0x7f61fc0b3e10 2024-09-11T22:15:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f61fb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61fc15c2c0 0x7f61fc0c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f61fb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61fc15c2c0 0x7f61fc0c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55050/0 (socket says 172.21.15.50:55050) 2024-09-11T22:15:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f61fb7fe640 1 -- 172.21.15.50:0/3938202299 learned_addr learned my addr 172.21.15.50:0/3938202299 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f61fa7fc640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61fc0d05e0 0x7f61fc1f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f61faffd640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61fc0b3e10 0x7f61fc150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f61fb7fe640 1 -- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61fc0b3e10 msgr2=0x7f61fc150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f61fb7fe640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61fc0b3e10 0x7f61fc150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f61fb7fe640 1 -- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61fc0d05e0 msgr2=0x7f61fc1f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f61fb7fe640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61fc0d05e0 0x7f61fc1f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f61fb7fe640 1 -- 172.21.15.50:0/3938202299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc0ada20 con 0x7f61fc15c2c0 2024-09-11T22:15:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.953+0000 7f61fb7fe640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61fc15c2c0 0x7f61fc0c5e90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f61f400efc0 tx=0x7f61f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.954+0000 7f61e37fe640 1 -- 172.21.15.50:0/3938202299 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4018020 con 0x7f61fc15c2c0 2024-09-11T22:15:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.954+0000 7f61e37fe640 1 -- 172.21.15.50:0/3938202299 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f4014480 con 0x7f61fc15c2c0 2024-09-11T22:15:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.954+0000 7f6201549640 1 -- 172.21.15.50:0/3938202299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61fc0add00 con 0x7f61fc15c2c0 2024-09-11T22:15:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.954+0000 7f61e37fe640 1 -- 172.21.15.50:0/3938202299 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4014870 con 0x7f61fc15c2c0 2024-09-11T22:15:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.954+0000 7f6201549640 1 -- 172.21.15.50:0/3938202299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61fc0ae2c0 con 0x7f61fc15c2c0 2024-09-11T22:15:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.955+0000 7f6201549640 1 -- 172.21.15.50:0/3938202299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61fc15c6a0 con 0x7f61fc15c2c0 2024-09-11T22:15:36.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.955+0000 7f61e37fe640 1 -- 172.21.15.50:0/3938202299 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61f4005d10 con 0x7f61fc15c2c0 2024-09-11T22:15:36.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.955+0000 7f61e37fe640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f61e806be30 0x7f61e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:36.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.956+0000 7f61e37fe640 1 -- 172.21.15.50:0/3938202299 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7f61f408b980 con 0x7f61fc15c2c0 2024-09-11T22:15:36.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.956+0000 7f61faffd640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f61e806be30 0x7f61e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:36.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.956+0000 7f61faffd640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f61e806be30 0x7f61e806e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f61ec034000 tx=0x7f61ec02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:36.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:36.960+0000 7f61e37fe640 1 -- 172.21.15.50:0/3938202299 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61f4022070 con 0x7f61fc15c2c0 2024-09-11T22:15:37.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.138+0000 7f6201549640 1 -- 172.21.15.50:0/3938202299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61fc15fa40 con 0x7f61fc15c2c0 2024-09-11T22:15:37.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.139+0000 7f61e37fe640 1 -- 172.21.15.50:0/3938202299 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+17079 (secure 0 0 0) 0x7f61f4010040 con 0x7f61fc15c2c0 2024-09-11T22:15:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:37.141 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:15:19.635081+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:15:04.606994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T22:15:05.937484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6836/784761109":"2024-09-12T22:15:19.635063+0000","172.21.15.77:6834/784761109":"2024-09-12T22:15:19.635063+0000","172.21.15.77:6837/1115358060":"2024-09-12T22:15:19.519162+0000","172.21.15.77:6835/1115358060":"2024-09-12T22:15:19.519162+0000","172.21.15.50:6834/4265727513":"2024-09-12T22:15:19.508243+0000","172.21.15.50:6832/4265727513":"2024-09-12T22:15:19.508243+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:15:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.141+0000 7f6201549640 1 -- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f61e806be30 msgr2=0x7f61e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.141+0000 7f6201549640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f61e806be30 0x7f61e806e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f61ec034000 tx=0x7f61ec02e000 comp rx=0 tx=0).stop 2024-09-11T22:15:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.142+0000 7f6201549640 1 -- 172.21.15.50:0/3938202299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61fc15c2c0 msgr2=0x7f61fc0c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.142+0000 7f6201549640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61fc15c2c0 0x7f61fc0c5e90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f61f400efc0 tx=0x7f61f400c490 comp rx=0 tx=0).stop 2024-09-11T22:15:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.142+0000 7f6201549640 1 -- 172.21.15.50:0/3938202299 shutdown_connections 2024-09-11T22:15:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.142+0000 7f6201549640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f61e806be30 0x7f61e806e2f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.142+0000 7f6201549640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61fc15c2c0 0x7f61fc0c5e90 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.142+0000 7f6201549640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61fc0d05e0 0x7f61fc1f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.142+0000 7f6201549640 1 --2- 172.21.15.50:0/3938202299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61fc0b3e10 0x7f61fc150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.142+0000 7f6201549640 1 -- 172.21.15.50:0/3938202299 >> 172.21.15.50:0/3938202299 conn(0x7f61fc0679c0 msgr2=0x7f61fc15ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.142+0000 7f6201549640 1 -- 172.21.15.50:0/3938202299 shutdown_connections 2024-09-11T22:15:37.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.142+0000 7f6201549640 1 -- 172.21.15.50:0/3938202299 wait complete. 2024-09-11T22:15:37.154 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:15:37.154 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:37.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.255+0000 7f026f9cf640 1 Processor -- start 2024-09-11T22:15:37.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.256+0000 7f026f9cf640 1 -- start start 2024-09-11T22:15:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.256+0000 7f026f9cf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02680b1340 0x7f0268162d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.256+0000 7f026f9cf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0268163410 con 0x7f02680b0f60 2024-09-11T22:15:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.256+0000 7f026f9cf640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f026806cc20 con 0x7f02680b4bd0 2024-09-11T22:15:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.256+0000 7f026f9cf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f026806d550 con 0x7f02680b1340 2024-09-11T22:15:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.257+0000 7f026d76b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f02680b0f60 0x7f0268162600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49428/0 (socket says 172.21.15.50:49428) 2024-09-11T22:15:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.257+0000 7f026d76b640 1 -- 172.21.15.50:0/2591058665 learned_addr learned my addr 172.21.15.50:0/2591058665 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.257+0000 7f026df6c640 1 --2- 172.21.15.50:0/2591058665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02680b1340 0x7f0268162d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.257+0000 7f0267fff640 1 -- 172.21.15.50:0/2591058665 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 396127809 0 0) 0x7f0268163410 con 0x7f02680b0f60 2024-09-11T22:15:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.257+0000 7f0267fff640 1 -- 172.21.15.50:0/2591058665 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0250003520 con 0x7f02680b0f60 2024-09-11T22:15:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.257+0000 7f026df6c640 1 -- 172.21.15.50:0/2591058665 >> v1:172.21.15.77:6789/0 conn(0x7f02680b4bd0 legacy=0x7f02680af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.257+0000 7f0267fff640 1 -- 172.21.15.50:0/2591058665 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 524343086 0 0) 0x7f026806cc20 con 0x7f02680b4bd0 2024-09-11T22:15:37.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.257+0000 7f026df6c640 1 -- 172.21.15.50:0/2591058665 >> v1:172.21.15.50:6789/0 conn(0x7f02680b0f60 legacy=0x7f0268162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.257+0000 7f026df6c640 1 -- 172.21.15.50:0/2591058665 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026806cf00 con 0x7f02680b1340 2024-09-11T22:15:37.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.258+0000 7f026df6c640 1 --2- 172.21.15.50:0/2591058665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02680b1340 0x7f0268162d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f02600097d0 tx=0x7f026002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=614890a7c10132f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:37.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.258+0000 7f0267fff640 1 -- 172.21.15.50:0/2591058665 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260037070 con 0x7f02680b1340 2024-09-11T22:15:37.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.258+0000 7f0267fff640 1 -- 172.21.15.50:0/2591058665 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0260032440 con 0x7f02680b1340 2024-09-11T22:15:37.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.258+0000 7f0267fff640 1 -- 172.21.15.50:0/2591058665 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02600327f0 con 0x7f02680b1340 2024-09-11T22:15:37.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.258+0000 7f026f9cf640 1 -- 172.21.15.50:0/2591058665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02680b1340 msgr2=0x7f0268162d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.258+0000 7f026f9cf640 1 --2- 172.21.15.50:0/2591058665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02680b1340 0x7f0268162d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f02600097d0 tx=0x7f026002a210 comp rx=0 tx=0).stop 2024-09-11T22:15:37.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.258+0000 7f026f9cf640 1 -- 172.21.15.50:0/2591058665 shutdown_connections 2024-09-11T22:15:37.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.258+0000 7f026f9cf640 1 --2- 172.21.15.50:0/2591058665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02680b1340 0x7f0268162d10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.258+0000 7f026f9cf640 1 -- 172.21.15.50:0/2591058665 >> 172.21.15.50:0/2591058665 conn(0x7f02680b40b0 msgr2=0x7f02680b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:37.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.259+0000 7f026f9cf640 1 -- 172.21.15.50:0/2591058665 shutdown_connections 2024-09-11T22:15:37.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.259+0000 7f026f9cf640 1 -- 172.21.15.50:0/2591058665 wait complete. 2024-09-11T22:15:37.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.260+0000 7f026f9cf640 1 Processor -- start 2024-09-11T22:15:37.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.260+0000 7f026f9cf640 1 -- start start 2024-09-11T22:15:37.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.260+0000 7f026f9cf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02680b0f60 0x7f026815a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.260+0000 7f026f9cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02680b1340 0x7f026815b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.260+0000 7f026f9cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02680b4bd0 0x7f0268160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.260+0000 7f026f9cf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f026806db60 con 0x7f02680b4bd0 2024-09-11T22:15:37.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.260+0000 7f026f9cf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f026806d9e0 con 0x7f02680b1340 2024-09-11T22:15:37.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.260+0000 7f026f9cf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f02680afaa0 con 0x7f02680b0f60 2024-09-11T22:15:37.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f026df6c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02680b4bd0 0x7f0268160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f026df6c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02680b4bd0 0x7f0268160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55054/0 (socket says 172.21.15.50:55054) 2024-09-11T22:15:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f026df6c640 1 -- 172.21.15.50:0/1750377742 learned_addr learned my addr 172.21.15.50:0/1750377742 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f026cf6a640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02680b1340 0x7f026815b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f026d76b640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02680b0f60 0x7f026815a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f026df6c640 1 -- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02680b0f60 msgr2=0x7f026815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f026df6c640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02680b0f60 0x7f026815a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f026df6c640 1 -- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02680b1340 msgr2=0x7f026815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f026df6c640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02680b1340 0x7f026815b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f026df6c640 1 -- 172.21.15.50:0/1750377742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02680b5450 con 0x7f02680b4bd0 2024-09-11T22:15:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f026df6c640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02680b4bd0 0x7f0268160bb0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f026002a250 tx=0x7f02600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f0265ffb640 1 -- 172.21.15.50:0/1750377742 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260037040 con 0x7f02680b4bd0 2024-09-11T22:15:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f0265ffb640 1 -- 172.21.15.50:0/1750377742 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0260042070 con 0x7f02680b4bd0 2024-09-11T22:15:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f026f9cf640 1 -- 172.21.15.50:0/1750377742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02680b5730 con 0x7f02680b4bd0 2024-09-11T22:15:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.261+0000 7f0265ffb640 1 -- 172.21.15.50:0/1750377742 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260030940 con 0x7f02680b4bd0 2024-09-11T22:15:37.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.262+0000 7f026f9cf640 1 -- 172.21.15.50:0/1750377742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02680b5cf0 con 0x7f02680b4bd0 2024-09-11T22:15:37.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.263+0000 7f026f9cf640 1 -- 172.21.15.50:0/1750377742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02680c9270 con 0x7f02680b4bd0 2024-09-11T22:15:37.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.263+0000 7f0265ffb640 1 -- 172.21.15.50:0/1750377742 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0260030ae0 con 0x7f02680b4bd0 2024-09-11T22:15:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.264+0000 7f0265ffb640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f025406be30 0x7f025406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.264+0000 7f0265ffb640 1 -- 172.21.15.50:0/1750377742 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7f02600ab780 con 0x7f02680b4bd0 2024-09-11T22:15:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.264+0000 7f026d76b640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f025406be30 0x7f025406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.265+0000 7f026d76b640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f025406be30 0x7f025406e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0258005c00 tx=0x7f0258009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:37.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.268+0000 7f0265ffb640 1 -- 172.21.15.50:0/1750377742 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02600799e0 con 0x7f02680b4bd0 2024-09-11T22:15:37.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.479+0000 7f026f9cf640 1 -- 172.21.15.50:0/1750377742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02680cfef0 con 0x7f02680b4bd0 2024-09-11T22:15:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.480+0000 7f0265ffb640 1 -- 172.21.15.50:0/1750377742 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5220 (secure 0 0 0) 0x7f026007dce0 con 0x7f02680b4bd0 2024-09-11T22:15:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:37.482 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"btime":"2024-09-11T22:15:22:649424+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4081050909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4081050909},{"type":"v1","addr":"172.21.15.77:6835","nonce":4081050909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6340,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/502868531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":502868531},{"type":"v1","addr":"172.21.15.77:6837","nonce":502868531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1024879489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1024879489},{"type":"v1","addr":"172.21.15.50:6835","nonce":1024879489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:06.945196+0000","modified":"2024-09-11T22:15:22.649418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6833/325962537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":325962537},{"type":"v1","addr":"172.21.15.50:6833","nonce":325962537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6885,"qdb_cluster":[6885]},"id":5}]} 2024-09-11T22:15:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 56 2024-09-11T22:15:37.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.482+0000 7f026f9cf640 1 -- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f025406be30 msgr2=0x7f025406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.482+0000 7f026f9cf640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f025406be30 0x7f025406e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0258005c00 tx=0x7f0258009040 comp rx=0 tx=0).stop 2024-09-11T22:15:37.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.482+0000 7f026f9cf640 1 -- 172.21.15.50:0/1750377742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02680b4bd0 msgr2=0x7f0268160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.482+0000 7f026f9cf640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02680b4bd0 0x7f0268160bb0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f026002a250 tx=0x7f02600046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.482+0000 7f026f9cf640 1 -- 172.21.15.50:0/1750377742 shutdown_connections 2024-09-11T22:15:37.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.482+0000 7f026f9cf640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f025406be30 0x7f025406e2f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.482+0000 7f026f9cf640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02680b4bd0 0x7f0268160bb0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.482+0000 7f026f9cf640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02680b1340 0x7f026815b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.482+0000 7f026f9cf640 1 --2- 172.21.15.50:0/1750377742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02680b0f60 0x7f026815a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.482+0000 7f026f9cf640 1 -- 172.21.15.50:0/1750377742 >> 172.21.15.50:0/1750377742 conn(0x7f02680b40b0 msgr2=0x7f02680b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:37.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.482+0000 7f026f9cf640 1 -- 172.21.15.50:0/1750377742 shutdown_connections 2024-09-11T22:15:37.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.482+0000 7f026f9cf640 1 -- 172.21.15.50:0/1750377742 wait complete. 2024-09-11T22:15:37.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:37.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.595+0000 7fd2cfd8f640 1 Processor -- start 2024-09-11T22:15:37.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.595+0000 7fd2cfd8f640 1 -- start start 2024-09-11T22:15:37.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.596+0000 7fd2cfd8f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd2c815b400 0x7fd2c806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.596+0000 7fd2cfd8f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c8072e60 0x7fd2c806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.596+0000 7fd2cfd8f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2c815b7e0 con 0x7fd2c806df20 2024-09-11T22:15:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.596+0000 7fd2cfd8f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd2c815f140 con 0x7fd2c815b400 2024-09-11T22:15:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.596+0000 7fd2cfd8f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c815f420 con 0x7fd2c8072e60 2024-09-11T22:15:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.596+0000 7fd2ce32c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd2c806df20 0x7fd2c80b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36944/0 (socket says 172.21.15.50:36944) 2024-09-11T22:15:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.596+0000 7fd2ce32c640 1 -- 172.21.15.50:0/3531306840 learned_addr learned my addr 172.21.15.50:0/3531306840 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.596+0000 7fd2cdb2b640 1 --2- 172.21.15.50:0/3531306840 >> v2:172.21.15.77:3300/0 conn(0x7fd2c815b400 0x7fd2c806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.596+0000 7fd2cd32a640 1 --2- 172.21.15.50:0/3531306840 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c8072e60 0x7fd2c806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.597+0000 7fd2ccb29640 1 -- 172.21.15.50:0/3531306840 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1166540539 0 0) 0x7fd2c815b7e0 con 0x7fd2c806df20 2024-09-11T22:15:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.597+0000 7fd2ccb29640 1 -- 172.21.15.50:0/3531306840 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2b0005730 con 0x7fd2c806df20 2024-09-11T22:15:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.597+0000 7fd2cdb2b640 1 -- 172.21.15.50:0/3531306840 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c8072e60 msgr2=0x7fd2c806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.597+0000 7fd2cdb2b640 1 --2- 172.21.15.50:0/3531306840 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c8072e60 0x7fd2c806d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.597+0000 7fd2cdb2b640 1 -- 172.21.15.50:0/3531306840 >> v1:172.21.15.50:6789/0 conn(0x7fd2c806df20 legacy=0x7fd2c80b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.597+0000 7fd2cdb2b640 1 -- 172.21.15.50:0/3531306840 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c815f700 con 0x7fd2c815b400 2024-09-11T22:15:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.598+0000 7fd2cdb2b640 1 --2- 172.21.15.50:0/3531306840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c815b400 0x7fd2c806d070 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009d90 tx=0x7fd2b802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d4409db66b6ddae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.598+0000 7fd2ccb29640 1 -- 172.21.15.50:0/3531306840 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8007740 con 0x7fd2c815b400 2024-09-11T22:15:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.598+0000 7fd2ccb29640 1 -- 172.21.15.50:0/3531306840 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b80078e0 con 0x7fd2c815b400 2024-09-11T22:15:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.598+0000 7fd2ccb29640 1 -- 172.21.15.50:0/3531306840 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8007c90 con 0x7fd2c815b400 2024-09-11T22:15:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.598+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/3531306840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c815b400 msgr2=0x7fd2c806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.598+0000 7fd2cfd8f640 1 --2- 172.21.15.50:0/3531306840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c815b400 0x7fd2c806d070 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009d90 tx=0x7fd2b802a660 comp rx=0 tx=0).stop 2024-09-11T22:15:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.598+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/3531306840 shutdown_connections 2024-09-11T22:15:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.598+0000 7fd2cfd8f640 1 --2- 172.21.15.50:0/3531306840 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c8072e60 0x7fd2c806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.598+0000 7fd2cfd8f640 1 --2- 172.21.15.50:0/3531306840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c815b400 0x7fd2c806d070 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.598+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/3531306840 >> 172.21.15.50:0/3531306840 conn(0x7fd2c80679c0 msgr2=0x7fd2c8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.598+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/3531306840 shutdown_connections 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.598+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/3531306840 wait complete. 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.599+0000 7fd2cfd8f640 1 Processor -- start 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.600+0000 7fd2cfd8f640 1 -- start start 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.600+0000 7fd2cfd8f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c806df20 0x7fd2c8147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.600+0000 7fd2cfd8f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c8072e60 0x7fd2c81f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.600+0000 7fd2cfd8f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c815b400 0x7fd2c80b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.600+0000 7fd2cfd8f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c80721d0 con 0x7fd2c8072e60 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.600+0000 7fd2cfd8f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c80cfc50 con 0x7fd2c806df20 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.600+0000 7fd2cfd8f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c8072350 con 0x7fd2c815b400 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.600+0000 7fd2cd32a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c8072e60 0x7fd2c81f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.600+0000 7fd2cd32a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c8072e60 0x7fd2c81f0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39046/0 (socket says 172.21.15.50:39046) 2024-09-11T22:15:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.600+0000 7fd2cd32a640 1 -- 172.21.15.50:0/682299636 learned_addr learned my addr 172.21.15.50:0/682299636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2cdb2b640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c806df20 0x7fd2c8147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2ce32c640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c815b400 0x7fd2c80b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2cd32a640 1 -- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c815b400 msgr2=0x7fd2c80b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2cd32a640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c815b400 0x7fd2c80b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2cd32a640 1 -- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c806df20 msgr2=0x7fd2c8147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2cd32a640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c806df20 0x7fd2c8147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2cd32a640 1 -- 172.21.15.50:0/682299636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c815d360 con 0x7fd2c8072e60 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2ce32c640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c815b400 0x7fd2c80b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2cd32a640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c8072e60 0x7fd2c81f0130 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00e870 tx=0x7fd2bc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2c67fc640 1 -- 172.21.15.50:0/682299636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc017070 con 0x7fd2c8072e60 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2c67fc640 1 -- 172.21.15.50:0/682299636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2bc00c940 con 0x7fd2c8072e60 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/682299636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c8157710 con 0x7fd2c8072e60 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2c67fc640 1 -- 172.21.15.50:0/682299636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc00cd30 con 0x7fd2c8072e60 2024-09-11T22:15:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.601+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/682299636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c815dfc0 con 0x7fd2c8072e60 2024-09-11T22:15:37.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.602+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/682299636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c806d650 con 0x7fd2c8072e60 2024-09-11T22:15:37.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.603+0000 7fd2c67fc640 1 -- 172.21.15.50:0/682299636 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2bc01a070 con 0x7fd2c8072e60 2024-09-11T22:15:37.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.603+0000 7fd2c67fc640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2b406be60 0x7fd2b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:37.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.603+0000 7fd2c67fc640 1 -- 172.21.15.50:0/682299636 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7fd2bc08ae00 con 0x7fd2c8072e60 2024-09-11T22:15:37.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.603+0000 7fd2cdb2b640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2b406be60 0x7fd2b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:37.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.604+0000 7fd2cdb2b640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2b406be60 0x7fd2b406e320 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8034000 tx=0x7fd2b802f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:37.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.607+0000 7fd2c67fc640 1 -- 172.21.15.50:0/682299636 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2c806d650 con 0x7fd2c8072e60 2024-09-11T22:15:37.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.818+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/682299636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2c806d9e0 con 0x7fd2c8072e60 2024-09-11T22:15:38.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.818+0000 7fd2c67fc640 1 -- 172.21.15.50:0/682299636 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5220 (secure 0 0 0) 0x7fd2bc058f80 con 0x7fd2c8072e60 2024-09-11T22:15:38.051 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:38.051 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"btime":"2024-09-11T22:15:22:649424+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4081050909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4081050909},{"type":"v1","addr":"172.21.15.77:6835","nonce":4081050909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6340,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/502868531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":502868531},{"type":"v1","addr":"172.21.15.77:6837","nonce":502868531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1024879489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1024879489},{"type":"v1","addr":"172.21.15.50:6835","nonce":1024879489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:06.945196+0000","modified":"2024-09-11T22:15:22.649418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6885":{"gid":6885,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6833/325962537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":325962537},{"type":"v1","addr":"172.21.15.50:6833","nonce":325962537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6885,"qdb_cluster":[6885]},"id":5}]} 2024-09-11T22:15:38.052 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 56 2024-09-11T22:15:38.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.820+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2b406be60 msgr2=0x7fd2b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.820+0000 7fd2cfd8f640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2b406be60 0x7fd2b406e320 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8034000 tx=0x7fd2b802f000 comp rx=0 tx=0).stop 2024-09-11T22:15:38.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.820+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/682299636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c8072e60 msgr2=0x7fd2c81f0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.820+0000 7fd2cfd8f640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c8072e60 0x7fd2c81f0130 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00e870 tx=0x7fd2bc00ed30 comp rx=0 tx=0).stop 2024-09-11T22:15:38.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.821+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/682299636 shutdown_connections 2024-09-11T22:15:38.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.821+0000 7fd2cfd8f640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2b406be60 0x7fd2b406e320 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.821+0000 7fd2cfd8f640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c815b400 0x7fd2c80b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.821+0000 7fd2cfd8f640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c8072e60 0x7fd2c81f0130 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.821+0000 7fd2cfd8f640 1 --2- 172.21.15.50:0/682299636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c806df20 0x7fd2c8147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.821+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/682299636 >> 172.21.15.50:0/682299636 conn(0x7fd2c80679c0 msgr2=0x7fd2c8155ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:38.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.821+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/682299636 shutdown_connections 2024-09-11T22:15:38.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:37.821+0000 7fd2cfd8f640 1 -- 172.21.15.50:0/682299636 wait complete. 2024-09-11T22:15:38.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:15:38.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.156+0000 7f122a423640 1 Processor -- start 2024-09-11T22:15:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.156+0000 7f122a423640 1 -- start start 2024-09-11T22:15:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.156+0000 7f122a423640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f122406e0f0 0x7f122406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.156+0000 7f122a423640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1224072e60 0x7f12240711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.156+0000 7f122a423640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122415b7e0 con 0x7f122415b400 2024-09-11T22:15:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.156+0000 7f122a423640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f122415f140 con 0x7f122406e0f0 2024-09-11T22:15:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.156+0000 7f122a423640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f122415f420 con 0x7f1224072e60 2024-09-11T22:15:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.157+0000 7f12237fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f122406e0f0 0x7f122406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.157+0000 7f1223fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f122415b400 0x7f122406d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36950/0 (socket says 172.21.15.50:36950) 2024-09-11T22:15:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.157+0000 7f1223fff640 1 -- 172.21.15.50:0/3969001732 learned_addr learned my addr 172.21.15.50:0/3969001732 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.157+0000 7f12289c0640 1 --2- 172.21.15.50:0/3969001732 >> v2:172.21.15.77:3300/0 conn(0x7f1224072e60 0x7f12240711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.157+0000 7f12237fe640 1 -- 172.21.15.50:0/3969001732 >> v2:172.21.15.77:3300/0 conn(0x7f1224072e60 msgr2=0x7f12240711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.157+0000 7f12237fe640 1 --2- 172.21.15.50:0/3969001732 >> v2:172.21.15.77:3300/0 conn(0x7f1224072e60 0x7f12240711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.157+0000 7f12237fe640 1 -- 172.21.15.50:0/3969001732 >> v1:172.21.15.50:6789/0 conn(0x7f122415b400 legacy=0x7f122406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.157+0000 7f12237fe640 1 -- 172.21.15.50:0/3969001732 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122415f700 con 0x7f122406e0f0 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.158+0000 7f12237fe640 1 --2- 172.21.15.50:0/3969001732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122406e0f0 0x7f122406d070 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f12240b3490 tx=0x7f121802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fe0b1af31fc3fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.158+0000 7f1222ffd640 1 -- 172.21.15.50:0/3969001732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218037070 con 0x7f122406e0f0 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.158+0000 7f1222ffd640 1 -- 172.21.15.50:0/3969001732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1218032440 con 0x7f122406e0f0 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.158+0000 7f1222ffd640 1 -- 172.21.15.50:0/3969001732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218032810 con 0x7f122406e0f0 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.158+0000 7f122a423640 1 -- 172.21.15.50:0/3969001732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122406e0f0 msgr2=0x7f122406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.158+0000 7f122a423640 1 --2- 172.21.15.50:0/3969001732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122406e0f0 0x7f122406d070 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f12240b3490 tx=0x7f121802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.159+0000 7f122a423640 1 -- 172.21.15.50:0/3969001732 shutdown_connections 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.159+0000 7f122a423640 1 --2- 172.21.15.50:0/3969001732 >> v2:172.21.15.77:3300/0 conn(0x7f1224072e60 0x7f12240711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.159+0000 7f122a423640 1 --2- 172.21.15.50:0/3969001732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122406e0f0 0x7f122406d070 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.159+0000 7f122a423640 1 -- 172.21.15.50:0/3969001732 >> 172.21.15.50:0/3969001732 conn(0x7f12240679c0 msgr2=0x7f1224067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.159+0000 7f122a423640 1 -- 172.21.15.50:0/3969001732 shutdown_connections 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.159+0000 7f122a423640 1 -- 172.21.15.50:0/3969001732 wait complete. 2024-09-11T22:15:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.160+0000 7f122a423640 1 Processor -- start 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.160+0000 7f122a423640 1 -- start start 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f122a423640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f122406e0f0 0x7f1224156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f122a423640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1224072e60 0x7f122415db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f122a423640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 0x7f122415e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f122a423640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1224071700 con 0x7f122415b400 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f122a423640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f12240cfc50 con 0x7f1224072e60 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f122a423640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1224071880 con 0x7f122406e0f0 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f12289c0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 0x7f122415e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f12289c0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 0x7f122415e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39062/0 (socket says 172.21.15.50:39062) 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f12289c0640 1 -- 172.21.15.50:0/1026676783 learned_addr learned my addr 172.21.15.50:0/1026676783 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f12237fe640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1224072e60 0x7f122415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f1223fff640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f122406e0f0 0x7f1224156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f12289c0640 1 -- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f122406e0f0 msgr2=0x7f1224156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f12289c0640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f122406e0f0 0x7f1224156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f12289c0640 1 -- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1224072e60 msgr2=0x7f122415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f12289c0640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1224072e60 0x7f122415db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f12289c0640 1 -- 172.21.15.50:0/1026676783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12240abf50 con 0x7f122415b400 2024-09-11T22:15:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f1223fff640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f122406e0f0 0x7f1224156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f12237fe640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1224072e60 0x7f122415db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f12289c0640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 0x7f122415e0c0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f121c007e30 tx=0x7f121c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.161+0000 7f1220ff9640 1 -- 172.21.15.50:0/1026676783 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c014620 con 0x7f122415b400 2024-09-11T22:15:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.162+0000 7f1220ff9640 1 -- 172.21.15.50:0/1026676783 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f121c019070 con 0x7f122415b400 2024-09-11T22:15:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.162+0000 7f122a423640 1 -- 172.21.15.50:0/1026676783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12240ac230 con 0x7f122415b400 2024-09-11T22:15:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.162+0000 7f1220ff9640 1 -- 172.21.15.50:0/1026676783 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c014a00 con 0x7f122415b400 2024-09-11T22:15:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.162+0000 7f122a423640 1 -- 172.21.15.50:0/1026676783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12240ac7f0 con 0x7f122415b400 2024-09-11T22:15:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.163+0000 7f122a423640 1 -- 172.21.15.50:0/1026676783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12240ac9f0 con 0x7f122415b400 2024-09-11T22:15:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.163+0000 7f1220ff9640 1 -- 172.21.15.50:0/1026676783 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f121c014ba0 con 0x7f122415b400 2024-09-11T22:15:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.164+0000 7f1220ff9640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f121006be30 0x7f121006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.164+0000 7f1220ff9640 1 -- 172.21.15.50:0/1026676783 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7f121c08b830 con 0x7f122415b400 2024-09-11T22:15:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.164+0000 7f1223fff640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f121006be30 0x7f121006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.164+0000 7f1223fff640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f121006be30 0x7f121006e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f122415e7f0 tx=0x7f1214009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.168+0000 7f1220ff9640 1 -- 172.21.15.50:0/1026676783 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12240ac9f0 con 0x7f122415b400 2024-09-11T22:15:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.345+0000 7f122a423640 1 -- 172.21.15.50:0/1026676783 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f122406d070 con 0x7f122415b400 2024-09-11T22:15:38.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.346+0000 7f1220ff9640 1 -- 172.21.15.50:0/1026676783 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+17079 (secure 0 0 0) 0x7f121c05a0f0 con 0x7f122415b400 2024-09-11T22:15:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:38.348 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:15:19.635081+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:15:04.606994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T22:15:05.937484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6836/784761109":"2024-09-12T22:15:19.635063+0000","172.21.15.77:6834/784761109":"2024-09-12T22:15:19.635063+0000","172.21.15.77:6837/1115358060":"2024-09-12T22:15:19.519162+0000","172.21.15.77:6835/1115358060":"2024-09-12T22:15:19.519162+0000","172.21.15.50:6834/4265727513":"2024-09-12T22:15:19.508243+0000","172.21.15.50:6832/4265727513":"2024-09-12T22:15:19.508243+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:15:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.348+0000 7f122a423640 1 -- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f121006be30 msgr2=0x7f121006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.348+0000 7f122a423640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f121006be30 0x7f121006e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f122415e7f0 tx=0x7f1214009040 comp rx=0 tx=0).stop 2024-09-11T22:15:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.348+0000 7f122a423640 1 -- 172.21.15.50:0/1026676783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 msgr2=0x7f122415e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.348+0000 7f122a423640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 0x7f122415e0c0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f121c007e30 tx=0x7f121c00e4b0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.348+0000 7f122a423640 1 -- 172.21.15.50:0/1026676783 shutdown_connections 2024-09-11T22:15:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.348+0000 7f122a423640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f121006be30 0x7f121006e2f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.348+0000 7f122a423640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 0x7f122415e0c0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.348+0000 7f122a423640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1224072e60 0x7f122415db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.348+0000 7f122a423640 1 --2- 172.21.15.50:0/1026676783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f122406e0f0 0x7f1224156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.348+0000 7f122a423640 1 -- 172.21.15.50:0/1026676783 >> 172.21.15.50:0/1026676783 conn(0x7f12240679c0 msgr2=0x7f12240cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.348+0000 7f122a423640 1 -- 172.21.15.50:0/1026676783 shutdown_connections 2024-09-11T22:15:38.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.348+0000 7f122a423640 1 -- 172.21.15.50:0/1026676783 wait complete. 2024-09-11T22:15:38.364 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:15:38.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.465+0000 7fa12a69b640 1 Processor -- start 2024-09-11T22:15:38.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.465+0000 7fa12a69b640 1 -- start start 2024-09-11T22:15:38.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.466+0000 7fa12a69b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa12406e0f0 0x7fa12406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.466+0000 7fa12a69b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa124072e60 0x7fa1240711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.466+0000 7fa12a69b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa12415b7e0 con 0x7fa12415b400 2024-09-11T22:15:38.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.466+0000 7fa12a69b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa12415f140 con 0x7fa12406e0f0 2024-09-11T22:15:38.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.466+0000 7fa12a69b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa12415f420 con 0x7fa124072e60 2024-09-11T22:15:38.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.466+0000 7fa1237fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa12406e0f0 0x7fa12406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.466+0000 7fa1237fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa12406e0f0 0x7fa12406d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39074/0 (socket says 172.21.15.50:39074) 2024-09-11T22:15:38.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.466+0000 7fa1237fe640 1 -- 172.21.15.50:0/1259584122 learned_addr learned my addr 172.21.15.50:0/1259584122 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:38.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.466+0000 7fa128c38640 1 --2- 172.21.15.50:0/1259584122 >> v2:172.21.15.77:3300/0 conn(0x7fa124072e60 0x7fa1240711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.467+0000 7fa1237fe640 1 -- 172.21.15.50:0/1259584122 >> v2:172.21.15.77:3300/0 conn(0x7fa124072e60 msgr2=0x7fa1240711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:38.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.467+0000 7fa1237fe640 1 --2- 172.21.15.50:0/1259584122 >> v2:172.21.15.77:3300/0 conn(0x7fa124072e60 0x7fa1240711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.467+0000 7fa1237fe640 1 -- 172.21.15.50:0/1259584122 >> v1:172.21.15.77:6789/0 conn(0x7fa12415b400 legacy=0x7fa12406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.467+0000 7fa1237fe640 1 -- 172.21.15.50:0/1259584122 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12415f700 con 0x7fa12406e0f0 2024-09-11T22:15:38.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.467+0000 7fa1237fe640 1 --2- 172.21.15.50:0/1259584122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12406e0f0 0x7fa12406d070 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fa1240b3490 tx=0x7fa11802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7ed158f5cbdf51 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.467+0000 7fa122ffd640 1 -- 172.21.15.50:0/1259584122 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa118037070 con 0x7fa12406e0f0 2024-09-11T22:15:38.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.468+0000 7fa122ffd640 1 -- 172.21.15.50:0/1259584122 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa118032440 con 0x7fa12406e0f0 2024-09-11T22:15:38.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.468+0000 7fa122ffd640 1 -- 172.21.15.50:0/1259584122 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa118032810 con 0x7fa12406e0f0 2024-09-11T22:15:38.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.468+0000 7fa12a69b640 1 -- 172.21.15.50:0/1259584122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12406e0f0 msgr2=0x7fa12406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.468+0000 7fa12a69b640 1 --2- 172.21.15.50:0/1259584122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12406e0f0 0x7fa12406d070 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fa1240b3490 tx=0x7fa11802a270 comp rx=0 tx=0).stop 2024-09-11T22:15:38.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.468+0000 7fa12a69b640 1 -- 172.21.15.50:0/1259584122 shutdown_connections 2024-09-11T22:15:38.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.468+0000 7fa12a69b640 1 --2- 172.21.15.50:0/1259584122 >> v2:172.21.15.77:3300/0 conn(0x7fa124072e60 0x7fa1240711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.468+0000 7fa12a69b640 1 --2- 172.21.15.50:0/1259584122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12406e0f0 0x7fa12406d070 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.468+0000 7fa12a69b640 1 -- 172.21.15.50:0/1259584122 >> 172.21.15.50:0/1259584122 conn(0x7fa1240679c0 msgr2=0x7fa124067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:38.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.468+0000 7fa12a69b640 1 -- 172.21.15.50:0/1259584122 shutdown_connections 2024-09-11T22:15:38.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.468+0000 7fa12a69b640 1 -- 172.21.15.50:0/1259584122 wait complete. 2024-09-11T22:15:38.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.469+0000 7fa12a69b640 1 Processor -- start 2024-09-11T22:15:38.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.470+0000 7fa12a69b640 1 -- start start 2024-09-11T22:15:38.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.470+0000 7fa12a69b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa12406e0f0 0x7fa124157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.470+0000 7fa12a69b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa124072e60 0x7fa1241efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.470+0000 7fa12a69b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12415b400 0x7fa1240ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.470+0000 7fa12a69b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa124071700 con 0x7fa12415b400 2024-09-11T22:15:38.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.470+0000 7fa12a69b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa1240cfc50 con 0x7fa12406e0f0 2024-09-11T22:15:38.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.470+0000 7fa12a69b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa124071880 con 0x7fa124072e60 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.470+0000 7fa128c38640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12415b400 0x7fa1240ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.470+0000 7fa128c38640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12415b400 0x7fa1240ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39080/0 (socket says 172.21.15.50:39080) 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.470+0000 7fa128c38640 1 -- 172.21.15.50:0/51323778 learned_addr learned my addr 172.21.15.50:0/51323778 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.470+0000 7fa1237fe640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa124072e60 0x7fa1241efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.470+0000 7fa123fff640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa12406e0f0 0x7fa124157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.471+0000 7fa128c38640 1 -- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa124072e60 msgr2=0x7fa1241efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.471+0000 7fa128c38640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa124072e60 0x7fa1241efcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.471+0000 7fa128c38640 1 -- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa12406e0f0 msgr2=0x7fa124157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.471+0000 7fa128c38640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa12406e0f0 0x7fa124157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.471+0000 7fa128c38640 1 -- 172.21.15.50:0/51323778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1241f0c90 con 0x7fa12415b400 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.471+0000 7fa128c38640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12415b400 0x7fa1240ade70 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa11c007e30 tx=0x7fa11c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.471+0000 7fa120ff9640 1 -- 172.21.15.50:0/51323778 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c014620 con 0x7fa12415b400 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.471+0000 7fa120ff9640 1 -- 172.21.15.50:0/51323778 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa11c019070 con 0x7fa12415b400 2024-09-11T22:15:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.471+0000 7fa12a69b640 1 -- 172.21.15.50:0/51323778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1241f06d0 con 0x7fa12415b400 2024-09-11T22:15:38.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.471+0000 7fa120ff9640 1 -- 172.21.15.50:0/51323778 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c014a00 con 0x7fa12415b400 2024-09-11T22:15:38.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.471+0000 7fa12a69b640 1 -- 172.21.15.50:0/51323778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1240aa5e0 con 0x7fa12415b400 2024-09-11T22:15:38.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.472+0000 7fa12a69b640 1 -- 172.21.15.50:0/51323778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa12406d070 con 0x7fa12415b400 2024-09-11T22:15:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.473+0000 7fa120ff9640 1 -- 172.21.15.50:0/51323778 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa11c014ba0 con 0x7fa12415b400 2024-09-11T22:15:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.473+0000 7fa120ff9640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa11006be60 0x7fa11006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.473+0000 7fa120ff9640 1 -- 172.21.15.50:0/51323778 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5967+0+0 (secure 0 0 0) 0x7fa11c08b670 con 0x7fa12415b400 2024-09-11T22:15:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.473+0000 7fa123fff640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa11006be60 0x7fa11006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.474+0000 7fa123fff640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa11006be60 0x7fa11006e320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa1240abcc0 tx=0x7fa114009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.477+0000 7fa120ff9640 1 -- 172.21.15.50:0/51323778 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa11c059960 con 0x7fa12415b400 2024-09-11T22:15:38.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.692+0000 7fa12a69b640 1 -- 172.21.15.50:0/51323778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa12406c030 con 0x7fa12415b400 2024-09-11T22:15:38.694 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:15:38.692+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:15:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.694+0000 7fa120ff9640 1 -- 172.21.15.50:0/51323778 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) ==== 161+0+0 (secure 0 0 0) 0x7fa11c05dc60 con 0x7fa12415b400 2024-09-11T22:15:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:15:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.697+0000 7fa12a69b640 1 -- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa11006be60 msgr2=0x7fa11006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.697+0000 7fa12a69b640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa11006be60 0x7fa11006e320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa1240abcc0 tx=0x7fa114009040 comp rx=0 tx=0).stop 2024-09-11T22:15:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.697+0000 7fa12a69b640 1 -- 172.21.15.50:0/51323778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12415b400 msgr2=0x7fa1240ade70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.697+0000 7fa12a69b640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12415b400 0x7fa1240ade70 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa11c007e30 tx=0x7fa11c00e4b0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.697+0000 7fa12a69b640 1 -- 172.21.15.50:0/51323778 shutdown_connections 2024-09-11T22:15:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.697+0000 7fa12a69b640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa11006be60 0x7fa11006e320 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.697+0000 7fa12a69b640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa124072e60 0x7fa1241efcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.697+0000 7fa12a69b640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12415b400 0x7fa1240ade70 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.697+0000 7fa12a69b640 1 --2- 172.21.15.50:0/51323778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa12406e0f0 0x7fa124157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.697+0000 7fa12a69b640 1 -- 172.21.15.50:0/51323778 >> 172.21.15.50:0/51323778 conn(0x7fa1240679c0 msgr2=0x7fa1240cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.697+0000 7fa12a69b640 1 -- 172.21.15.50:0/51323778 shutdown_connections 2024-09-11T22:15:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.697+0000 7fa12a69b640 1 -- 172.21.15.50:0/51323778 wait complete. 2024-09-11T22:15:38.702 INFO:tasks.ceph.mds.a.smithi050.stderr: -1607> 2024-09-11T22:15:25.643+0000 7f04ee3ae640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:15:38.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:15:38.732 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:15:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.816+0000 7fd5e3a65640 1 Processor -- start 2024-09-11T22:15:38.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.816+0000 7fd5e3a65640 1 -- start start 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.817+0000 7fd5e3a65640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5dc15aad0 0x7fd5dc072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.817+0000 7fd5e3a65640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5dc06d780 0x7fd5dc0b3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.817+0000 7fd5e3a65640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc0b5020 con 0x7fd5dc15bb00 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.817+0000 7fd5e3a65640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd5dc15aeb0 con 0x7fd5dc15aad0 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.817+0000 7fd5e3a65640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd5dc0714d0 con 0x7fd5dc06d780 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.817+0000 7fd5e1801640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5dc15aad0 0x7fd5dc072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.817+0000 7fd5e1801640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5dc15aad0 0x7fd5dc072cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39100/0 (socket says 172.21.15.50:39100) 2024-09-11T22:15:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.817+0000 7fd5e1801640 1 -- 172.21.15.50:0/460277591 learned_addr learned my addr 172.21.15.50:0/460277591 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.817+0000 7fd5e2002640 1 --2- 172.21.15.50:0/460277591 >> v2:172.21.15.77:3300/0 conn(0x7fd5dc06d780 0x7fd5dc0b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.817+0000 7fd5e1801640 1 -- 172.21.15.50:0/460277591 >> v2:172.21.15.77:3300/0 conn(0x7fd5dc06d780 msgr2=0x7fd5dc0b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.817+0000 7fd5e1801640 1 --2- 172.21.15.50:0/460277591 >> v2:172.21.15.77:3300/0 conn(0x7fd5dc06d780 0x7fd5dc0b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.817+0000 7fd5e1801640 1 -- 172.21.15.50:0/460277591 >> v1:172.21.15.77:6789/0 conn(0x7fd5dc15bb00 legacy=0x7fd5dc06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.817+0000 7fd5e1801640 1 -- 172.21.15.50:0/460277591 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc0717b0 con 0x7fd5dc15aad0 2024-09-11T22:15:38.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.818+0000 7fd5e1801640 1 --2- 172.21.15.50:0/460277591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5dc15aad0 0x7fd5dc072cb0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc06dce0 tx=0x7fd5cc02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c4faff1f636392 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.818+0000 7fd5dbfff640 1 -- 172.21.15.50:0/460277591 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc037070 con 0x7fd5dc15aad0 2024-09-11T22:15:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.818+0000 7fd5dbfff640 1 -- 172.21.15.50:0/460277591 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5cc008500 con 0x7fd5dc15aad0 2024-09-11T22:15:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.818+0000 7fd5dbfff640 1 -- 172.21.15.50:0/460277591 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0088d0 con 0x7fd5dc15aad0 2024-09-11T22:15:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.819+0000 7fd5e3a65640 1 -- 172.21.15.50:0/460277591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5dc15aad0 msgr2=0x7fd5dc072cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.819+0000 7fd5e3a65640 1 --2- 172.21.15.50:0/460277591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5dc15aad0 0x7fd5dc072cb0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc06dce0 tx=0x7fd5cc02b7f0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.819+0000 7fd5e3a65640 1 -- 172.21.15.50:0/460277591 shutdown_connections 2024-09-11T22:15:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.819+0000 7fd5e3a65640 1 --2- 172.21.15.50:0/460277591 >> v2:172.21.15.77:3300/0 conn(0x7fd5dc06d780 0x7fd5dc0b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.819+0000 7fd5e3a65640 1 --2- 172.21.15.50:0/460277591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5dc15aad0 0x7fd5dc072cb0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.819+0000 7fd5e3a65640 1 -- 172.21.15.50:0/460277591 >> 172.21.15.50:0/460277591 conn(0x7fd5dc0679c0 msgr2=0x7fd5dc067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.819+0000 7fd5e3a65640 1 -- 172.21.15.50:0/460277591 shutdown_connections 2024-09-11T22:15:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.819+0000 7fd5e3a65640 1 -- 172.21.15.50:0/460277591 wait complete. 2024-09-11T22:15:38.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.820+0000 7fd5e3a65640 1 Processor -- start 2024-09-11T22:15:38.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.820+0000 7fd5e3a65640 1 -- start start 2024-09-11T22:15:38.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.821+0000 7fd5e3a65640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5dc06d780 0x7fd5dc155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.821+0000 7fd5e3a65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5dc15aad0 0x7fd5dc0abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.821+0000 7fd5e3a65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5dc15bb00 0x7fd5dc0b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.821+0000 7fd5e3a65640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc15bf50 con 0x7fd5dc15bb00 2024-09-11T22:15:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.821+0000 7fd5e3a65640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc071d70 con 0x7fd5dc15aad0 2024-09-11T22:15:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.821+0000 7fd5e3a65640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5dc072290 con 0x7fd5dc06d780 2024-09-11T22:15:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.821+0000 7fd5e2002640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5dc15bb00 0x7fd5dc0b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.821+0000 7fd5e2002640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5dc15bb00 0x7fd5dc0b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39102/0 (socket says 172.21.15.50:39102) 2024-09-11T22:15:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.821+0000 7fd5e2002640 1 -- 172.21.15.50:0/3583467566 learned_addr learned my addr 172.21.15.50:0/3583467566 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.821+0000 7fd5e1000640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5dc15aad0 0x7fd5dc0abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.821+0000 7fd5e1801640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5dc06d780 0x7fd5dc155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.822+0000 7fd5e2002640 1 -- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5dc06d780 msgr2=0x7fd5dc155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.822+0000 7fd5e2002640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5dc06d780 0x7fd5dc155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.822+0000 7fd5e2002640 1 -- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5dc15aad0 msgr2=0x7fd5dc0abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.822+0000 7fd5e2002640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5dc15aad0 0x7fd5dc0abdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.822+0000 7fd5e2002640 1 -- 172.21.15.50:0/3583467566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc0aa5e0 con 0x7fd5dc15bb00 2024-09-11T22:15:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.822+0000 7fd5e2002640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5dc15bb00 0x7fd5dc0b11f0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400d830 tx=0x7fd5d400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.822+0000 7fd5d9ffb640 1 -- 172.21.15.50:0/3583467566 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d400b6c0 con 0x7fd5dc15bb00 2024-09-11T22:15:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.822+0000 7fd5d9ffb640 1 -- 172.21.15.50:0/3583467566 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d4019070 con 0x7fd5dc15bb00 2024-09-11T22:15:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.822+0000 7fd5e3a65640 1 -- 172.21.15.50:0/3583467566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5dc0aa8c0 con 0x7fd5dc15bb00 2024-09-11T22:15:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.822+0000 7fd5d9ffb640 1 -- 172.21.15.50:0/3583467566 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d400bac0 con 0x7fd5dc15bb00 2024-09-11T22:15:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.822+0000 7fd5e3a65640 1 -- 172.21.15.50:0/3583467566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5dc0aae80 con 0x7fd5dc15bb00 2024-09-11T22:15:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.823+0000 7fd5e3a65640 1 -- 172.21.15.50:0/3583467566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5dc072cb0 con 0x7fd5dc15bb00 2024-09-11T22:15:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.824+0000 7fd5d9ffb640 1 -- 172.21.15.50:0/3583467566 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5d401e460 con 0x7fd5dc15bb00 2024-09-11T22:15:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.824+0000 7fd5d9ffb640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5c806be30 0x7fd5c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.824+0000 7fd5d9ffb640 1 -- 172.21.15.50:0/3583467566 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6053+0+0 (secure 0 0 0) 0x7fd5d408b460 con 0x7fd5dc15bb00 2024-09-11T22:15:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.824+0000 7fd5e1801640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5c806be30 0x7fd5c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.825+0000 7fd5e1801640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5c806be30 0x7fd5c806e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0ccd60 tx=0x7fd5cc00a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:38.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:38.828+0000 7fd5d9ffb640 1 -- 172.21.15.50:0/3583467566 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5d40596f0 con 0x7fd5dc15bb00 2024-09-11T22:15:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.042+0000 7fd5e3a65640 1 -- 172.21.15.50:0/3583467566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd5dc0d0790 con 0x7fd5dc15bb00 2024-09-11T22:15:39.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.698+0000 7fd5d9ffb640 1 -- 172.21.15.50:0/3583467566 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) ==== 104+0+0 (secure 0 0 0) 0x7fd5d405d9f0 con 0x7fd5dc15bb00 2024-09-11T22:15:39.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.700+0000 7fd5e3a65640 1 -- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5c806be30 msgr2=0x7fd5c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:39.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.700+0000 7fd5e3a65640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5c806be30 0x7fd5c806e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0ccd60 tx=0x7fd5cc00a000 comp rx=0 tx=0).stop 2024-09-11T22:15:39.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.700+0000 7fd5e3a65640 1 -- 172.21.15.50:0/3583467566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5dc15bb00 msgr2=0x7fd5dc0b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:39.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.700+0000 7fd5e3a65640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5dc15bb00 0x7fd5dc0b11f0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400d830 tx=0x7fd5d400dcf0 comp rx=0 tx=0).stop 2024-09-11T22:15:39.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.701+0000 7fd5e3a65640 1 -- 172.21.15.50:0/3583467566 shutdown_connections 2024-09-11T22:15:39.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.701+0000 7fd5e3a65640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5c806be30 0x7fd5c806e2f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:39.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.701+0000 7fd5e3a65640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5dc15bb00 0x7fd5dc0b11f0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:39.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.701+0000 7fd5e3a65640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5dc15aad0 0x7fd5dc0abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:39.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.701+0000 7fd5e3a65640 1 --2- 172.21.15.50:0/3583467566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5dc06d780 0x7fd5dc155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:39.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.701+0000 7fd5e3a65640 1 -- 172.21.15.50:0/3583467566 >> 172.21.15.50:0/3583467566 conn(0x7fd5dc0679c0 msgr2=0x7fd5dc0cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:39.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.701+0000 7fd5e3a65640 1 -- 172.21.15.50:0/3583467566 shutdown_connections 2024-09-11T22:15:39.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.701+0000 7fd5e3a65640 1 -- 172.21.15.50:0/3583467566 wait complete. 2024-09-11T22:15:39.716 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:15:39.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.868+0000 7fcd3afe8640 1 Processor -- start 2024-09-11T22:15:39.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.868+0000 7fcd3afe8640 1 -- start start 2024-09-11T22:15:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.868+0000 7fcd3afe8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd3406e870 0x7fcd34162700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.868+0000 7fcd3afe8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd3415acf0 0x7fcd34164c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.868+0000 7fcd3afe8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd340b3bb0 con 0x7fcd3415a910 2024-09-11T22:15:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.868+0000 7fcd3afe8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fcd340b3e90 con 0x7fcd3406e870 2024-09-11T22:15:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.868+0000 7fcd3afe8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcd340b4170 con 0x7fcd3415acf0 2024-09-11T22:15:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.869+0000 7fcd33fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd3406e870 0x7fcd34162700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.869+0000 7fcd33fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcd3406e870 0x7fcd34162700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39116/0 (socket says 172.21.15.50:39116) 2024-09-11T22:15:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.869+0000 7fcd33fff640 1 -- 172.21.15.50:0/1608480679 learned_addr learned my addr 172.21.15.50:0/1608480679 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.869+0000 7fcd39585640 1 --2- 172.21.15.50:0/1608480679 >> v2:172.21.15.77:3300/0 conn(0x7fcd3415acf0 0x7fcd34164c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.869+0000 7fcd33fff640 1 -- 172.21.15.50:0/1608480679 >> v2:172.21.15.77:3300/0 conn(0x7fcd3415acf0 msgr2=0x7fcd34164c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.869+0000 7fcd33fff640 1 --2- 172.21.15.50:0/1608480679 >> v2:172.21.15.77:3300/0 conn(0x7fcd3415acf0 0x7fcd34164c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.869+0000 7fcd33fff640 1 -- 172.21.15.50:0/1608480679 >> v1:172.21.15.77:6789/0 conn(0x7fcd3415a910 legacy=0x7fcd3406e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:39.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.869+0000 7fcd33fff640 1 -- 172.21.15.50:0/1608480679 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd340b4450 con 0x7fcd3406e870 2024-09-11T22:15:39.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.870+0000 7fcd33fff640 1 --2- 172.21.15.50:0/1608480679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3406e870 0x7fcd34162700 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009870 tx=0x7fcd2002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47aeb3d11e853d8a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:39.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.870+0000 7fcd337fe640 1 -- 172.21.15.50:0/1608480679 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20037070 con 0x7fcd3406e870 2024-09-11T22:15:39.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.870+0000 7fcd337fe640 1 -- 172.21.15.50:0/1608480679 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd20032440 con 0x7fcd3406e870 2024-09-11T22:15:39.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.870+0000 7fcd337fe640 1 -- 172.21.15.50:0/1608480679 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20032810 con 0x7fcd3406e870 2024-09-11T22:15:39.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.870+0000 7fcd3afe8640 1 -- 172.21.15.50:0/1608480679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3406e870 msgr2=0x7fcd34162700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:39.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.870+0000 7fcd3afe8640 1 --2- 172.21.15.50:0/1608480679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3406e870 0x7fcd34162700 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009870 tx=0x7fcd2002a180 comp rx=0 tx=0).stop 2024-09-11T22:15:39.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.871+0000 7fcd3afe8640 1 -- 172.21.15.50:0/1608480679 shutdown_connections 2024-09-11T22:15:39.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.871+0000 7fcd3afe8640 1 --2- 172.21.15.50:0/1608480679 >> v2:172.21.15.77:3300/0 conn(0x7fcd3415acf0 0x7fcd34164c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:39.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.871+0000 7fcd3afe8640 1 --2- 172.21.15.50:0/1608480679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3406e870 0x7fcd34162700 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.871+0000 7fcd3afe8640 1 -- 172.21.15.50:0/1608480679 >> 172.21.15.50:0/1608480679 conn(0x7fcd34075270 msgr2=0x7fcd340679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.871+0000 7fcd3afe8640 1 -- 172.21.15.50:0/1608480679 shutdown_connections 2024-09-11T22:15:39.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.871+0000 7fcd3afe8640 1 -- 172.21.15.50:0/1608480679 wait complete. 2024-09-11T22:15:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.872+0000 7fcd3afe8640 1 Processor -- start 2024-09-11T22:15:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.872+0000 7fcd3afe8640 1 -- start start 2024-09-11T22:15:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd3afe8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd3406e870 0x7fcd3414ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd3afe8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3415a910 0x7fcd3415dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd3afe8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd3415acf0 0x7fcd3414c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd3afe8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcd340b32a0 con 0x7fcd3415a910 2024-09-11T22:15:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd3afe8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd340b3120 con 0x7fcd3406e870 2024-09-11T22:15:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd3afe8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcd340b3740 con 0x7fcd3415acf0 2024-09-11T22:15:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd33fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3415a910 0x7fcd3415dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:39.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd33fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3415a910 0x7fcd3415dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39132/0 (socket says 172.21.15.50:39132) 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd33fff640 1 -- 172.21.15.50:0/2505359404 learned_addr learned my addr 172.21.15.50:0/2505359404 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd38d84640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd3406e870 0x7fcd3414ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd39585640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd3415acf0 0x7fcd3414c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd33fff640 1 -- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd3415acf0 msgr2=0x7fcd3414c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd33fff640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd3415acf0 0x7fcd3414c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd33fff640 1 -- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd3406e870 msgr2=0x7fcd3414ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd33fff640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd3406e870 0x7fcd3414ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd33fff640 1 -- 172.21.15.50:0/2505359404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd341f2700 con 0x7fcd3415a910 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd38d84640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd3406e870 0x7fcd3414ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd33fff640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3415a910 0x7fcd3415dd30 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fcd2002a1c0 tx=0x7fcd200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd317fa640 1 -- 172.21.15.50:0/2505359404 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20041020 con 0x7fcd3415a910 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd317fa640 1 -- 172.21.15.50:0/2505359404 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd20030640 con 0x7fcd3415a910 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd3afe8640 1 -- 172.21.15.50:0/2505359404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3414ce70 con 0x7fcd3415a910 2024-09-11T22:15:39.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.873+0000 7fcd317fa640 1 -- 172.21.15.50:0/2505359404 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20037040 con 0x7fcd3415a910 2024-09-11T22:15:39.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.874+0000 7fcd3afe8640 1 -- 172.21.15.50:0/2505359404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd3414f780 con 0x7fcd3415a910 2024-09-11T22:15:39.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.874+0000 7fcd3afe8640 1 -- 172.21.15.50:0/2505359404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd341f28d0 con 0x7fcd3415a910 2024-09-11T22:15:39.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.875+0000 7fcd317fa640 1 -- 172.21.15.50:0/2505359404 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd20044020 con 0x7fcd3415a910 2024-09-11T22:15:39.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.876+0000 7fcd317fa640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcd1806be30 0x7fcd1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:39.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.876+0000 7fcd317fa640 1 -- 172.21.15.50:0/2505359404 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6053+0+0 (secure 0 0 0) 0x7fcd200ab7d0 con 0x7fcd3415a910 2024-09-11T22:15:39.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.876+0000 7fcd38d84640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcd1806be30 0x7fcd1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:39.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.876+0000 7fcd38d84640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcd1806be30 0x7fcd1806e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcd341f5bd0 tx=0x7fcd28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:39.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:39.880+0000 7fcd317fa640 1 -- 172.21.15.50:0/2505359404 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd2004b030 con 0x7fcd3415a910 2024-09-11T22:15:40.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.056+0000 7fcd3afe8640 1 -- 172.21.15.50:0/2505359404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcd340b57d0 con 0x7fcd3415a910 2024-09-11T22:15:40.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.699+0000 7fcd317fa640 1 -- 172.21.15.50:0/2505359404 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v80) ==== 181+0+0 (secure 0 0 0) 0x7fcd2007a030 con 0x7fcd3415a910 2024-09-11T22:15:40.701 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:15:40.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.702+0000 7fcd3afe8640 1 -- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcd1806be30 msgr2=0x7fcd1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:40.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.702+0000 7fcd3afe8640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcd1806be30 0x7fcd1806e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcd341f5bd0 tx=0x7fcd28009040 comp rx=0 tx=0).stop 2024-09-11T22:15:40.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.702+0000 7fcd3afe8640 1 -- 172.21.15.50:0/2505359404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3415a910 msgr2=0x7fcd3415dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:40.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.702+0000 7fcd3afe8640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3415a910 0x7fcd3415dd30 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fcd2002a1c0 tx=0x7fcd200046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.702+0000 7fcd3afe8640 1 -- 172.21.15.50:0/2505359404 shutdown_connections 2024-09-11T22:15:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.702+0000 7fcd3afe8640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcd1806be30 0x7fcd1806e2f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.702+0000 7fcd3afe8640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd3415acf0 0x7fcd3414c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.702+0000 7fcd3afe8640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd3415a910 0x7fcd3415dd30 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.702+0000 7fcd3afe8640 1 --2- 172.21.15.50:0/2505359404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd3406e870 0x7fcd3414ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.702+0000 7fcd3afe8640 1 -- 172.21.15.50:0/2505359404 >> 172.21.15.50:0/2505359404 conn(0x7fcd34075270 msgr2=0x7fcd34071730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.703+0000 7fcd3afe8640 1 -- 172.21.15.50:0/2505359404 shutdown_connections 2024-09-11T22:15:40.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.703+0000 7fcd3afe8640 1 -- 172.21.15.50:0/2505359404 wait complete. 2024-09-11T22:15:40.718 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:15:40.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.826+0000 7f44fdbf6640 1 Processor -- start 2024-09-11T22:15:40.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.826+0000 7f44fdbf6640 1 -- start start 2024-09-11T22:15:40.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44fdbf6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f44f80d18e0 0x7f44f80b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:40.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44fdbf6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f8162110 con 0x7f44f8161d30 2024-09-11T22:15:40.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44fdbf6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f80cfd70 con 0x7f44f80cf790 2024-09-11T22:15:40.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44fdbf6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f44f80d3450 con 0x7f44f80d18e0 2024-09-11T22:15:40.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44f77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f44f8161d30 0x7f44f8162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36964/0 (socket says 172.21.15.50:36964) 2024-09-11T22:15:40.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44f77fe640 1 -- 172.21.15.50:0/1888089108 learned_addr learned my addr 172.21.15.50:0/1888089108 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:40.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44f7fff640 1 --2- 172.21.15.50:0/1888089108 >> v2:172.21.15.77:3300/0 conn(0x7f44f80d18e0 0x7f44f80b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:40.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908516058 0 0) 0x7f44f8162110 con 0x7f44f8161d30 2024-09-11T22:15:40.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44e0003520 con 0x7f44f8161d30 2024-09-11T22:15:40.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1287433841 0 0) 0x7f44e0003520 con 0x7f44f8161d30 2024-09-11T22:15:40.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 >> v2:172.21.15.77:3300/0 conn(0x7f44f80d18e0 msgr2=0x7f44f80b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:40.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44f67fc640 1 --2- 172.21.15.50:0/1888089108 >> v2:172.21.15.77:3300/0 conn(0x7f44f80d18e0 0x7f44f80b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:40.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 >> v1:172.21.15.77:6789/0 conn(0x7f44f80cf790 legacy=0x7f44f80d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:40.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f80d2b20 con 0x7f44f8161d30 2024-09-11T22:15:40.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f44e8001670 con 0x7f44f8161d30 2024-09-11T22:15:40.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.827+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 >> v1:172.21.15.50:6789/0 conn(0x7f44f8161d30 legacy=0x7f44f8162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:40.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f67fc640 1 --2- 172.21.15.50:0/1888089108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00039b0 0x7f44e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f67fc640 1 --2- 172.21.15.50:0/1888089108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44e0004800 0x7f44e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f67fc640 1 --2- 172.21.15.50:0/1888089108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e00051c0 0x7f44e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f44f80d3450 con 0x7f44e00039b0 2024-09-11T22:15:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f44e000c060 con 0x7f44e00051c0 2024-09-11T22:15:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f44e000c260 con 0x7f44e0004800 2024-09-11T22:15:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f77fe640 1 --2- 172.21.15.50:0/1888089108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00039b0 0x7f44e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f7fff640 1 --2- 172.21.15.50:0/1888089108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e00051c0 0x7f44e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f6ffd640 1 --2- 172.21.15.50:0/1888089108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44e0004800 0x7f44e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f77fe640 1 -- 172.21.15.50:0/1888089108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44e0004800 msgr2=0x7f44e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f77fe640 1 --2- 172.21.15.50:0/1888089108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44e0004800 0x7f44e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f77fe640 1 -- 172.21.15.50:0/1888089108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e00051c0 msgr2=0x7f44e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f77fe640 1 --2- 172.21.15.50:0/1888089108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e00051c0 0x7f44e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f77fe640 1 -- 172.21.15.50:0/1888089108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e0003520 con 0x7f44e00039b0 2024-09-11T22:15:40.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.828+0000 7f44f7fff640 1 -- 172.21.15.50:0/1888089108 reap_dead start 2024-09-11T22:15:40.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.829+0000 7f44f77fe640 1 --2- 172.21.15.50:0/1888089108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00039b0 0x7f44e0003dd0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c210 tx=0x7f44e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7fd4e7a6e6a1f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:40.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.829+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8007d30 con 0x7f44e00039b0 2024-09-11T22:15:40.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.829+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e8005ad0 con 0x7f44e00039b0 2024-09-11T22:15:40.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.829+0000 7f44f67fc640 1 -- 172.21.15.50:0/1888089108 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8007070 con 0x7f44e00039b0 2024-09-11T22:15:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.829+0000 7f44fdbf6640 1 -- 172.21.15.50:0/1888089108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00039b0 msgr2=0x7f44e0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.829+0000 7f44fdbf6640 1 --2- 172.21.15.50:0/1888089108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00039b0 0x7f44e0003dd0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c210 tx=0x7f44e0005830 comp rx=0 tx=0).stop 2024-09-11T22:15:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.829+0000 7f44fdbf6640 1 -- 172.21.15.50:0/1888089108 shutdown_connections 2024-09-11T22:15:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.829+0000 7f44fdbf6640 1 --2- 172.21.15.50:0/1888089108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00039b0 0x7f44e0003dd0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.829+0000 7f44fdbf6640 1 -- 172.21.15.50:0/1888089108 >> 172.21.15.50:0/1888089108 conn(0x7f44f80727a0 msgr2=0x7f44f80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.829+0000 7f44fdbf6640 1 -- 172.21.15.50:0/1888089108 shutdown_connections 2024-09-11T22:15:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.829+0000 7f44fdbf6640 1 -- 172.21.15.50:0/1888089108 wait complete. 2024-09-11T22:15:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.831+0000 7f44fdbf6640 1 Processor -- start 2024-09-11T22:15:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.831+0000 7f44fdbf6640 1 -- start start 2024-09-11T22:15:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.831+0000 7f44fdbf6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00039b0 0x7f44f81f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.831+0000 7f44fdbf6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44f80b33a0 0x7f44f80b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.831+0000 7f44fdbf6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f80ab180 0x7f44f80ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.831+0000 7f44fdbf6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f44f80b78f0 con 0x7f44e00039b0 2024-09-11T22:15:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.831+0000 7f44fdbf6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f44f80d30e0 con 0x7f44f80ab180 2024-09-11T22:15:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.831+0000 7f44fdbf6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f44f80b7a70 con 0x7f44f80b33a0 2024-09-11T22:15:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44f77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00039b0 0x7f44f81f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44f77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00039b0 0x7f44f81f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39154/0 (socket says 172.21.15.50:39154) 2024-09-11T22:15:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44f77fe640 1 -- 172.21.15.50:0/439801180 learned_addr learned my addr 172.21.15.50:0/439801180 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44f7fff640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f80ab180 0x7f44f80ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44f6ffd640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44f80b33a0 0x7f44f80b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44f77fe640 1 -- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44f80b33a0 msgr2=0x7f44f80b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44f77fe640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44f80b33a0 0x7f44f80b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44f77fe640 1 -- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f80ab180 msgr2=0x7f44f80ab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44f77fe640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f80ab180 0x7f44f80ab600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44f77fe640 1 -- 172.21.15.50:0/439801180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f815da80 con 0x7f44e00039b0 2024-09-11T22:15:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44f77fe640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00039b0 0x7f44f81f42a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c330 tx=0x7f44e8001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44dffff640 1 -- 172.21.15.50:0/439801180 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8037040 con 0x7f44e00039b0 2024-09-11T22:15:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44dffff640 1 -- 172.21.15.50:0/439801180 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e8041070 con 0x7f44e00039b0 2024-09-11T22:15:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44fdbf6640 1 -- 172.21.15.50:0/439801180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f80b5f40 con 0x7f44e00039b0 2024-09-11T22:15:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44dffff640 1 -- 172.21.15.50:0/439801180 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8001670 con 0x7f44e00039b0 2024-09-11T22:15:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.832+0000 7f44fdbf6640 1 -- 172.21.15.50:0/439801180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f80b6500 con 0x7f44e00039b0 2024-09-11T22:15:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.833+0000 7f44fdbf6640 1 -- 172.21.15.50:0/439801180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f80b7da0 con 0x7f44e00039b0 2024-09-11T22:15:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.834+0000 7f44dffff640 1 -- 172.21.15.50:0/439801180 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44e8004a20 con 0x7f44e00039b0 2024-09-11T22:15:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.834+0000 7f44dffff640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f44e406be30 0x7f44e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.834+0000 7f44dffff640 1 -- 172.21.15.50:0/439801180 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5615+0+0 (secure 0 0 0) 0x7f44e80aa790 con 0x7f44e00039b0 2024-09-11T22:15:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.835+0000 7f44f6ffd640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f44e406be30 0x7f44e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.835+0000 7f44f6ffd640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f44e406be30 0x7f44e406e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f44f80c8200 tx=0x7f44ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:40.839+0000 7f44dffff640 1 -- 172.21.15.50:0/439801180 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44e8078ab0 con 0x7f44e00039b0 2024-09-11T22:15:41.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.019+0000 7f44fdbf6640 1 -- 172.21.15.50:0/439801180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f44f80b38f0 con 0x7f44e00039b0 2024-09-11T22:15:41.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.705+0000 7f44dffff640 1 -- 172.21.15.50:0/439801180 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v81) ==== 169+0+0 (secure 0 0 0) 0x7f44e807cdb0 con 0x7f44e00039b0 2024-09-11T22:15:41.706 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:15:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.709+0000 7f44fdbf6640 1 -- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f44e406be30 msgr2=0x7f44e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.709+0000 7f44fdbf6640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f44e406be30 0x7f44e406e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f44f80c8200 tx=0x7f44ec009040 comp rx=0 tx=0).stop 2024-09-11T22:15:41.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.709+0000 7f44fdbf6640 1 -- 172.21.15.50:0/439801180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00039b0 msgr2=0x7f44f81f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:41.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.709+0000 7f44fdbf6640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00039b0 0x7f44f81f42a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c330 tx=0x7f44e8001a40 comp rx=0 tx=0).stop 2024-09-11T22:15:41.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.709+0000 7f44fdbf6640 1 -- 172.21.15.50:0/439801180 shutdown_connections 2024-09-11T22:15:41.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.709+0000 7f44fdbf6640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f44e406be30 0x7f44e406e2f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:41.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.709+0000 7f44fdbf6640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44f80b33a0 0x7f44f80b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:41.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.709+0000 7f44fdbf6640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f80ab180 0x7f44f80ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:41.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.709+0000 7f44fdbf6640 1 --2- 172.21.15.50:0/439801180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00039b0 0x7f44f81f42a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:41.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.709+0000 7f44fdbf6640 1 -- 172.21.15.50:0/439801180 >> 172.21.15.50:0/439801180 conn(0x7f44f80727a0 msgr2=0x7f44f80d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:41.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.710+0000 7f44fdbf6640 1 -- 172.21.15.50:0/439801180 shutdown_connections 2024-09-11T22:15:41.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.710+0000 7f44fdbf6640 1 -- 172.21.15.50:0/439801180 wait complete. 2024-09-11T22:15:41.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T22:15:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.842+0000 7fdb557a6640 1 Processor -- start 2024-09-11T22:15:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.843+0000 7fdb557a6640 1 -- start start 2024-09-11T22:15:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.843+0000 7fdb557a6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdb5015c770 0x7fdb500b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.843+0000 7fdb557a6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb500b5920 0x7fdb500b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.843+0000 7fdb557a6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb5015f060 con 0x7fdb500b6510 2024-09-11T22:15:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.843+0000 7fdb557a6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fdb5015cef0 con 0x7fdb5015c770 2024-09-11T22:15:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.843+0000 7fdb557a6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5015d1d0 con 0x7fdb500b5920 2024-09-11T22:15:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.844+0000 7fdb4f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdb500b6510 0x7fdb500d24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:49756/0 (socket says 172.21.15.50:49756) 2024-09-11T22:15:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.844+0000 7fdb4f7fe640 1 -- 172.21.15.50:0/1538095407 learned_addr learned my addr 172.21.15.50:0/1538095407 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.844+0000 7fdb4e7fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb500b5920 0x7fdb500b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.844+0000 7fdb4effd640 1 --2- 172.21.15.50:0/1538095407 >> v2:172.21.15.77:3300/0 conn(0x7fdb5015c770 0x7fdb500b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.844+0000 7fdb4dffb640 1 -- 172.21.15.50:0/1538095407 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472507473 0 0) 0x7fdb5015f060 con 0x7fdb500b6510 2024-09-11T22:15:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.844+0000 7fdb4dffb640 1 -- 172.21.15.50:0/1538095407 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb38003520 con 0x7fdb500b6510 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.844+0000 7fdb4effd640 1 -- 172.21.15.50:0/1538095407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb500b5920 msgr2=0x7fdb500b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.844+0000 7fdb4effd640 1 --2- 172.21.15.50:0/1538095407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb500b5920 0x7fdb500b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.844+0000 7fdb4effd640 1 -- 172.21.15.50:0/1538095407 >> v1:172.21.15.77:6789/0 conn(0x7fdb500b6510 legacy=0x7fdb500d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.844+0000 7fdb4effd640 1 -- 172.21.15.50:0/1538095407 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5015d4b0 con 0x7fdb5015c770 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.844+0000 7fdb4e7fc640 1 --2- 172.21.15.50:0/1538095407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb500b5920 0x7fdb500b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.845+0000 7fdb4effd640 1 --2- 172.21.15.50:0/1538095407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb5015c770 0x7fdb500b53e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009d90 tx=0x7fdb4002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1eb3a6da4e506bce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.845+0000 7fdb4dffb640 1 -- 172.21.15.50:0/1538095407 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40007740 con 0x7fdb5015c770 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.845+0000 7fdb4dffb640 1 -- 172.21.15.50:0/1538095407 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb400078e0 con 0x7fdb5015c770 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.845+0000 7fdb4dffb640 1 -- 172.21.15.50:0/1538095407 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40007c90 con 0x7fdb5015c770 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.846+0000 7fdb557a6640 1 -- 172.21.15.50:0/1538095407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb5015c770 msgr2=0x7fdb500b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.846+0000 7fdb557a6640 1 --2- 172.21.15.50:0/1538095407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb5015c770 0x7fdb500b53e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009d90 tx=0x7fdb4002a660 comp rx=0 tx=0).stop 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.846+0000 7fdb557a6640 1 -- 172.21.15.50:0/1538095407 shutdown_connections 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.846+0000 7fdb557a6640 1 --2- 172.21.15.50:0/1538095407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb500b5920 0x7fdb500b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.846+0000 7fdb557a6640 1 --2- 172.21.15.50:0/1538095407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb5015c770 0x7fdb500b53e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.846+0000 7fdb557a6640 1 -- 172.21.15.50:0/1538095407 >> 172.21.15.50:0/1538095407 conn(0x7fdb500b7940 msgr2=0x7fdb500b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.846+0000 7fdb557a6640 1 -- 172.21.15.50:0/1538095407 shutdown_connections 2024-09-11T22:15:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.846+0000 7fdb557a6640 1 -- 172.21.15.50:0/1538095407 wait complete. 2024-09-11T22:15:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.847+0000 7fdb557a6640 1 Processor -- start 2024-09-11T22:15:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.847+0000 7fdb557a6640 1 -- start start 2024-09-11T22:15:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb557a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb500b5920 0x7fdb5009c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb557a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb500b6510 0x7fdb500d0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb557a6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb5015c770 0x7fdb50147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb557a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5015cb50 con 0x7fdb500b6510 2024-09-11T22:15:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb557a6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5015dcb0 con 0x7fdb500b5920 2024-09-11T22:15:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb557a6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5015ccd0 con 0x7fdb5015c770 2024-09-11T22:15:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb4e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb500b6510 0x7fdb500d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb4e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb500b6510 0x7fdb500d0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39164/0 (socket says 172.21.15.50:39164) 2024-09-11T22:15:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb4e7fc640 1 -- 172.21.15.50:0/3806388709 learned_addr learned my addr 172.21.15.50:0/3806388709 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb4f7fe640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb5015c770 0x7fdb50147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb4effd640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb500b5920 0x7fdb5009c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb4e7fc640 1 -- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb5015c770 msgr2=0x7fdb50147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb4e7fc640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb5015c770 0x7fdb50147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb4e7fc640 1 -- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb500b5920 msgr2=0x7fdb5009c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb4e7fc640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb500b5920 0x7fdb5009c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb4e7fc640 1 -- 172.21.15.50:0/3806388709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb500cf680 con 0x7fdb500b6510 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.848+0000 7fdb4f7fe640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb5015c770 0x7fdb50147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.849+0000 7fdb4e7fc640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb500b6510 0x7fdb500d0720 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400ebe0 tx=0x7fdb4400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.849+0000 7fdb377fe640 1 -- 172.21.15.50:0/3806388709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb44017070 con 0x7fdb500b6510 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.849+0000 7fdb377fe640 1 -- 172.21.15.50:0/3806388709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4400cc30 con 0x7fdb500b6510 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.849+0000 7fdb377fe640 1 -- 172.21.15.50:0/3806388709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb44013470 con 0x7fdb500b6510 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.849+0000 7fdb557a6640 1 -- 172.21.15.50:0/3806388709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb500cf960 con 0x7fdb500b6510 2024-09-11T22:15:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.849+0000 7fdb557a6640 1 -- 172.21.15.50:0/3806388709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb500cff20 con 0x7fdb500b6510 2024-09-11T22:15:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.850+0000 7fdb557a6640 1 -- 172.21.15.50:0/3806388709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb500b7d20 con 0x7fdb500b6510 2024-09-11T22:15:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.850+0000 7fdb377fe640 1 -- 172.21.15.50:0/3806388709 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb4401a070 con 0x7fdb500b6510 2024-09-11T22:15:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.851+0000 7fdb377fe640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.851+0000 7fdb377fe640 1 -- 172.21.15.50:0/3806388709 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5201+0+0 (secure 0 0 0) 0x7fdb4408af50 con 0x7fdb500b6510 2024-09-11T22:15:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.851+0000 7fdb4effd640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.852+0000 7fdb4effd640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdb40034000 tx=0x7fdb4002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:41.855+0000 7fdb377fe640 1 -- 172.21.15.50:0/3806388709 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb44059410 con 0x7fdb500b6510 2024-09-11T22:15:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.029+0000 7fdb557a6640 1 -- 172.21.15.50:0/3806388709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fdb5015eee0 con 0x7fdb500b6510 2024-09-11T22:15:42.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.033+0000 7fdb377fe640 1 -- 172.21.15.50:0/3806388709 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7fdb4405d710 con 0x7fdb500b6510 2024-09-11T22:15:42.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.035+0000 7fdb557a6640 1 -- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdb3c06be30 msgr2=0x7fdb3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:42.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.035+0000 7fdb557a6640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdb40034000 tx=0x7fdb4002f000 comp rx=0 tx=0).stop 2024-09-11T22:15:42.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.035+0000 7fdb557a6640 1 -- 172.21.15.50:0/3806388709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb500b6510 msgr2=0x7fdb500d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:42.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.035+0000 7fdb557a6640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb500b6510 0x7fdb500d0720 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400ebe0 tx=0x7fdb4400c520 comp rx=0 tx=0).stop 2024-09-11T22:15:42.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.035+0000 7fdb557a6640 1 -- 172.21.15.50:0/3806388709 shutdown_connections 2024-09-11T22:15:42.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.035+0000 7fdb557a6640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.035+0000 7fdb557a6640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb5015c770 0x7fdb50147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.035+0000 7fdb557a6640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb500b6510 0x7fdb500d0720 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.035+0000 7fdb557a6640 1 --2- 172.21.15.50:0/3806388709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb500b5920 0x7fdb5009c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.035+0000 7fdb557a6640 1 -- 172.21.15.50:0/3806388709 >> 172.21.15.50:0/3806388709 conn(0x7fdb500b7940 msgr2=0x7fdb500b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:42.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.035+0000 7fdb557a6640 1 -- 172.21.15.50:0/3806388709 shutdown_connections 2024-09-11T22:15:42.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.035+0000 7fdb557a6640 1 -- 172.21.15.50:0/3806388709 wait complete. 2024-09-11T22:15:42.046 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-11T22:15:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.147+0000 7f9f5aa47640 1 Processor -- start 2024-09-11T22:15:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.147+0000 7f9f5aa47640 1 -- start start 2024-09-11T22:15:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.148+0000 7f9f5aa47640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f54162a60 0x7f9f540b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.148+0000 7f9f5aa47640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f54163080 con 0x7f9f5415e8e0 2024-09-11T22:15:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.148+0000 7f9f5aa47640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f540d2d20 con 0x7f9f540d1c90 2024-09-11T22:15:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.148+0000 7f9f5aa47640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5415ecc0 con 0x7f9f54162a60 2024-09-11T22:15:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.148+0000 7f9f53fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9f5415e8e0 0x7f9f540d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36966/0 (socket says 172.21.15.50:36966) 2024-09-11T22:15:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.148+0000 7f9f53fff640 1 -- 172.21.15.50:0/3174616695 learned_addr learned my addr 172.21.15.50:0/3174616695 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.148+0000 7f9f58fe4640 1 --2- 172.21.15.50:0/3174616695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f54162a60 0x7f9f540b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.149+0000 7f9f52ffd640 1 -- 172.21.15.50:0/3174616695 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3165847715 0 0) 0x7f9f54163080 con 0x7f9f5415e8e0 2024-09-11T22:15:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.149+0000 7f9f52ffd640 1 -- 172.21.15.50:0/3174616695 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f3c003520 con 0x7f9f5415e8e0 2024-09-11T22:15:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.149+0000 7f9f52ffd640 1 -- 172.21.15.50:0/3174616695 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417822446 0 0) 0x7f9f540d2d20 con 0x7f9f540d1c90 2024-09-11T22:15:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.149+0000 7f9f52ffd640 1 -- 172.21.15.50:0/3174616695 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f54163080 con 0x7f9f540d1c90 2024-09-11T22:15:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.149+0000 7f9f58fe4640 1 -- 172.21.15.50:0/3174616695 >> v1:172.21.15.77:6789/0 conn(0x7f9f540d1c90 legacy=0x7f9f54162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.149+0000 7f9f58fe4640 1 -- 172.21.15.50:0/3174616695 >> v1:172.21.15.50:6789/0 conn(0x7f9f5415e8e0 legacy=0x7f9f540d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:42.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.149+0000 7f9f58fe4640 1 -- 172.21.15.50:0/3174616695 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f540d3000 con 0x7f9f54162a60 2024-09-11T22:15:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.150+0000 7f9f58fe4640 1 --2- 172.21.15.50:0/3174616695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f54162a60 0x7f9f540b7880 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009dc0 tx=0x7f9f4c02a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6947e3c638579be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.150+0000 7f9f52ffd640 1 -- 172.21.15.50:0/3174616695 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c007740 con 0x7f9f54162a60 2024-09-11T22:15:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.150+0000 7f9f52ffd640 1 -- 172.21.15.50:0/3174616695 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f4c0078e0 con 0x7f9f54162a60 2024-09-11T22:15:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.150+0000 7f9f52ffd640 1 -- 172.21.15.50:0/3174616695 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c007c90 con 0x7f9f54162a60 2024-09-11T22:15:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.150+0000 7f9f5aa47640 1 -- 172.21.15.50:0/3174616695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f54162a60 msgr2=0x7f9f540b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.150+0000 7f9f5aa47640 1 --2- 172.21.15.50:0/3174616695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f54162a60 0x7f9f540b7880 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009dc0 tx=0x7f9f4c02a760 comp rx=0 tx=0).stop 2024-09-11T22:15:42.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.150+0000 7f9f5aa47640 1 -- 172.21.15.50:0/3174616695 shutdown_connections 2024-09-11T22:15:42.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.150+0000 7f9f5aa47640 1 --2- 172.21.15.50:0/3174616695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f54162a60 0x7f9f540b7880 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.150+0000 7f9f5aa47640 1 -- 172.21.15.50:0/3174616695 >> 172.21.15.50:0/3174616695 conn(0x7f9f54067ba0 msgr2=0x7f9f54067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:42.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.150+0000 7f9f5aa47640 1 -- 172.21.15.50:0/3174616695 shutdown_connections 2024-09-11T22:15:42.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.150+0000 7f9f5aa47640 1 -- 172.21.15.50:0/3174616695 wait complete. 2024-09-11T22:15:42.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.152+0000 7f9f5aa47640 1 Processor -- start 2024-09-11T22:15:42.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.152+0000 7f9f5aa47640 1 -- start start 2024-09-11T22:15:42.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.152+0000 7f9f5aa47640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540d1c90 0x7f9f540ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.152+0000 7f9f5aa47640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f5415e8e0 0x7f9f540ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f5aa47640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f54162a60 0x7f9f540ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f5aa47640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9f540d3bd0 con 0x7f9f5415e8e0 2024-09-11T22:15:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f5aa47640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9f540d3a50 con 0x7f9f540d1c90 2024-09-11T22:15:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f5aa47640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9f540d3d50 con 0x7f9f54162a60 2024-09-11T22:15:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f537fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f5415e8e0 0x7f9f540ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f537fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f5415e8e0 0x7f9f540ab260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39166/0 (socket says 172.21.15.50:39166) 2024-09-11T22:15:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f537fe640 1 -- 172.21.15.50:0/4249783567 learned_addr learned my addr 172.21.15.50:0/4249783567 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f53fff640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540d1c90 0x7f9f540ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f58fe4640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f54162a60 0x7f9f540ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f537fe640 1 -- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f54162a60 msgr2=0x7f9f540ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f537fe640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f54162a60 0x7f9f540ab7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f537fe640 1 -- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540d1c90 msgr2=0x7f9f540ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:42.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f537fe640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540d1c90 0x7f9f540ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f537fe640 1 -- 172.21.15.50:0/4249783567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f540b9720 con 0x7f9f5415e8e0 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f53fff640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540d1c90 0x7f9f540ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f537fe640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f5415e8e0 0x7f9f540ab260 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f9f4800c500 tx=0x7f9f4800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f50ff9640 1 -- 172.21.15.50:0/4249783567 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f480052d0 con 0x7f9f5415e8e0 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f50ff9640 1 -- 172.21.15.50:0/4249783567 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f48005490 con 0x7f9f5415e8e0 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f5aa47640 1 -- 172.21.15.50:0/4249783567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f5414b770 con 0x7f9f5415e8e0 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f50ff9640 1 -- 172.21.15.50:0/4249783567 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f48012870 con 0x7f9f5415e8e0 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.153+0000 7f9f5aa47640 1 -- 172.21.15.50:0/4249783567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f5414bd30 con 0x7f9f5415e8e0 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.154+0000 7f9f5aa47640 1 -- 172.21.15.50:0/4249783567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f540b7880 con 0x7f9f5415e8e0 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.155+0000 7f9f50ff9640 1 -- 172.21.15.50:0/4249783567 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f48012a10 con 0x7f9f5415e8e0 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.155+0000 7f9f50ff9640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f4006be30 0x7f9f4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.155+0000 7f9f50ff9640 1 -- 172.21.15.50:0/4249783567 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5201+0+0 (secure 0 0 0) 0x7f9f4808a990 con 0x7f9f5415e8e0 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.155+0000 7f9f53fff640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f4006be30 0x7f9f4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.156+0000 7f9f53fff640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f4006be30 0x7f9f4006e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9f440011e0 tx=0x7f9f44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:42.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.159+0000 7f9f50ff9640 1 -- 172.21.15.50:0/4249783567 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f48059540 con 0x7f9f5415e8e0 2024-09-11T22:15:42.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.401+0000 7f9f5aa47640 1 -- 172.21.15.50:0/4249783567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f9f540ba770 con 0x7f9f5415e8e0 2024-09-11T22:15:42.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:15:42.586 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:15:42.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.707+0000 7f9f50ff9640 1 -- 172.21.15.50:0/4249783567 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v233) ==== 143+0+0 (secure 0 0 0) 0x7f9f48058e40 con 0x7f9f5415e8e0 2024-09-11T22:15:42.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.709+0000 7f9f5aa47640 1 -- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f4006be30 msgr2=0x7f9f4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:42.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.709+0000 7f9f5aa47640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f4006be30 0x7f9f4006e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9f440011e0 tx=0x7f9f44009040 comp rx=0 tx=0).stop 2024-09-11T22:15:42.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.709+0000 7f9f5aa47640 1 -- 172.21.15.50:0/4249783567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f5415e8e0 msgr2=0x7f9f540ab260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:42.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.709+0000 7f9f5aa47640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f5415e8e0 0x7f9f540ab260 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f9f4800c500 tx=0x7f9f4800c9c0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.709+0000 7f9f5aa47640 1 -- 172.21.15.50:0/4249783567 shutdown_connections 2024-09-11T22:15:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.709+0000 7f9f5aa47640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9f4006be30 0x7f9f4006e2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.709+0000 7f9f5aa47640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f54162a60 0x7f9f540ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.709+0000 7f9f5aa47640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f5415e8e0 0x7f9f540ab260 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.709+0000 7f9f5aa47640 1 --2- 172.21.15.50:0/4249783567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540d1c90 0x7f9f540ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.709+0000 7f9f5aa47640 1 -- 172.21.15.50:0/4249783567 >> 172.21.15.50:0/4249783567 conn(0x7f9f54067ba0 msgr2=0x7f9f540d4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.709+0000 7f9f5aa47640 1 -- 172.21.15.50:0/4249783567 shutdown_connections 2024-09-11T22:15:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.709+0000 7f9f5aa47640 1 -- 172.21.15.50:0/4249783567 wait complete. 2024-09-11T22:15:42.721 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-11T22:15:42.722 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is split during scrub. 2024-09-11T22:15:42.722 INFO:tasks.cephfs_test_runner:test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-11T22:15:42.722 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:15:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.824+0000 7f991459f640 1 Processor -- start 2024-09-11T22:15:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.824+0000 7f991459f640 1 -- start start 2024-09-11T22:15:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.825+0000 7f991459f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c0cf610 0x7f990c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.825+0000 7f991459f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f990c0b1600 0x7f990c0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.825+0000 7f991459f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f990c0cfbd0 con 0x7f990c161fa0 2024-09-11T22:15:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.825+0000 7f991459f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f990c0d1220 con 0x7f990c0b1600 2024-09-11T22:15:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.825+0000 7f991459f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f990c0d17e0 con 0x7f990c0cf610 2024-09-11T22:15:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.825+0000 7f991233b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f990c161fa0 0x7f990c0cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36980/0 (socket says 172.21.15.50:36980) 2024-09-11T22:15:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.825+0000 7f991233b640 1 -- 172.21.15.50:0/3587090476 learned_addr learned my addr 172.21.15.50:0/3587090476 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389281376 0 0) 0x7f990c0cfbd0 con 0x7f990c161fa0 2024-09-11T22:15:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9912b3c640 1 --2- 172.21.15.50:0/3587090476 >> v2:172.21.15.77:3300/0 conn(0x7f990c0b1600 0x7f990c0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911b3a640 1 --2- 172.21.15.50:0/3587090476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c0cf610 0x7f990c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98f4003520 con 0x7f990c161fa0 2024-09-11T22:15:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2061369724 0 0) 0x7f98f4003520 con 0x7f990c161fa0 2024-09-11T22:15:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c0cf610 msgr2=0x7f990c0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 --2- 172.21.15.50:0/3587090476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c0cf610 0x7f990c0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 >> v2:172.21.15.77:3300/0 conn(0x7f990c0b1600 msgr2=0x7f990c0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 --2- 172.21.15.50:0/3587090476 >> v2:172.21.15.77:3300/0 conn(0x7f990c0b1600 0x7f990c0cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c0cfeb0 con 0x7f990c161fa0 2024-09-11T22:15:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f98fc0019f0 con 0x7f990c161fa0 2024-09-11T22:15:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 >> v1:172.21.15.50:6789/0 conn(0x7f990c161fa0 legacy=0x7f990c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 --2- 172.21.15.50:0/3587090476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98f40039b0 0x7f98f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 --2- 172.21.15.50:0/3587090476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98f4004800 0x7f98f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 --2- 172.21.15.50:0/3587090476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c0cf610 0x7f98f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f990c0d1220 con 0x7f98f4004800 2024-09-11T22:15:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f990c0d17e0 con 0x7f98f40039b0 2024-09-11T22:15:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f98f400b9c0 con 0x7f990c0cf610 2024-09-11T22:15:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911b3a640 1 --2- 172.21.15.50:0/3587090476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98f4004800 0x7f98f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f991233b640 1 --2- 172.21.15.50:0/3587090476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98f40039b0 0x7f98f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9912b3c640 1 --2- 172.21.15.50:0/3587090476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c0cf610 0x7f98f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911b3a640 1 -- 172.21.15.50:0/3587090476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c0cf610 msgr2=0x7f98f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911b3a640 1 --2- 172.21.15.50:0/3587090476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c0cf610 0x7f98f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911b3a640 1 -- 172.21.15.50:0/3587090476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98f40039b0 msgr2=0x7f98f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911b3a640 1 --2- 172.21.15.50:0/3587090476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98f40039b0 0x7f98f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9911b3a640 1 -- 172.21.15.50:0/3587090476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f4003520 con 0x7f98f4004800 2024-09-11T22:15:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.826+0000 7f9912b3c640 1 --2- 172.21.15.50:0/3587090476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c0cf610 0x7f98f40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.827+0000 7f9911b3a640 1 --2- 172.21.15.50:0/3587090476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98f4004800 0x7f98f4004c80 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f9900009a90 tx=0x7f98f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394ea957516577e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.827+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900036070 con 0x7f98f4004800 2024-09-11T22:15:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.827+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9900031400 con 0x7f98f4004800 2024-09-11T22:15:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.827+0000 7f9911339640 1 -- 172.21.15.50:0/3587090476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900009690 con 0x7f98f4004800 2024-09-11T22:15:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.828+0000 7f991459f640 1 -- 172.21.15.50:0/3587090476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98f4004800 msgr2=0x7f98f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.828+0000 7f991459f640 1 --2- 172.21.15.50:0/3587090476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98f4004800 0x7f98f4004c80 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f9900009a90 tx=0x7f98f4005830 comp rx=0 tx=0).stop 2024-09-11T22:15:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.828+0000 7f9912b3c640 1 -- 172.21.15.50:0/3587090476 reap_dead start 2024-09-11T22:15:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.828+0000 7f991459f640 1 -- 172.21.15.50:0/3587090476 shutdown_connections 2024-09-11T22:15:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.828+0000 7f991459f640 1 -- 172.21.15.50:0/3587090476 >> 172.21.15.50:0/3587090476 conn(0x7f990c09ba50 msgr2=0x7f990c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.828+0000 7f991459f640 1 -- 172.21.15.50:0/3587090476 shutdown_connections 2024-09-11T22:15:42.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.828+0000 7f991459f640 1 -- 172.21.15.50:0/3587090476 wait complete. 2024-09-11T22:15:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.829+0000 7f991459f640 1 Processor -- start 2024-09-11T22:15:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.829+0000 7f991459f640 1 -- start start 2024-09-11T22:15:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f991459f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98f4004800 0x7f990c0afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f991459f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f990c15ff00 0x7f990c160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f991459f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c152c10 0x7f990c153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f991459f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f990c162500 con 0x7f990c15ff00 2024-09-11T22:15:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f991459f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f990c162380 con 0x7f98f4004800 2024-09-11T22:15:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f991459f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f990c0d1c70 con 0x7f990c152c10 2024-09-11T22:15:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f9911b3a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f990c15ff00 0x7f990c160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f9911b3a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f990c15ff00 0x7f990c160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39184/0 (socket says 172.21.15.50:39184) 2024-09-11T22:15:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f9911b3a640 1 -- 172.21.15.50:0/2253611590 learned_addr learned my addr 172.21.15.50:0/2253611590 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f991233b640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98f4004800 0x7f990c0afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f9912b3c640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c152c10 0x7f990c153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f9911b3a640 1 -- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c152c10 msgr2=0x7f990c153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f9911b3a640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c152c10 0x7f990c153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f9911b3a640 1 -- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98f4004800 msgr2=0x7f990c0afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f9911b3a640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98f4004800 0x7f990c0afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f9911b3a640 1 -- 172.21.15.50:0/2253611590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c0b79b0 con 0x7f990c15ff00 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f9911b3a640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f990c15ff00 0x7f990c160380 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f9900000c00 tx=0x7f9900004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f990affd640 1 -- 172.21.15.50:0/2253611590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900040020 con 0x7f990c15ff00 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f990affd640 1 -- 172.21.15.50:0/2253611590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990003b660 con 0x7f990c15ff00 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.830+0000 7f991459f640 1 -- 172.21.15.50:0/2253611590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990c0b7c90 con 0x7f990c15ff00 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.831+0000 7f990affd640 1 -- 172.21.15.50:0/2253611590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900036040 con 0x7f990c15ff00 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.831+0000 7f991459f640 1 -- 172.21.15.50:0/2253611590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f990c0b8250 con 0x7f990c15ff00 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.831+0000 7f991459f640 1 -- 172.21.15.50:0/2253611590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f990c1608c0 con 0x7f990c15ff00 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.832+0000 7f990affd640 1 -- 172.21.15.50:0/2253611590 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9900043020 con 0x7f990c15ff00 2024-09-11T22:15:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.832+0000 7f990affd640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98f806be30 0x7f98f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:42.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.832+0000 7f990affd640 1 -- 172.21.15.50:0/2253611590 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5201+0+0 (secure 0 0 0) 0x7f99000ab160 con 0x7f990c15ff00 2024-09-11T22:15:42.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.833+0000 7f991233b640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98f806be30 0x7f98f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:42.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.833+0000 7f991233b640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98f806be30 0x7f98f806e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f98fc004d00 tx=0x7f98fc006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:42.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:42.837+0000 7f990affd640 1 -- 172.21.15.50:0/2253611590 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f990c1608c0 con 0x7f990c15ff00 2024-09-11T22:15:43.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.011+0000 7f991459f640 1 -- 172.21.15.50:0/2253611590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f990c0cca30 con 0x7f990c15ff00 2024-09-11T22:15:43.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.011+0000 7f990affd640 1 -- 172.21.15.50:0/2253611590 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+13383 (secure 0 0 0) 0x7f990004a030 con 0x7f990c15ff00 2024-09-11T22:15:43.012 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:43.012 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":81,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:15:41.701542+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6833/325962537":"2024-09-12T22:15:38.694492+0000","172.21.15.50:6832/325962537":"2024-09-12T22:15:38.694492+0000","172.21.15.77:6836/784761109":"2024-09-12T22:15:19.635063+0000","172.21.15.77:6834/784761109":"2024-09-12T22:15:19.635063+0000","172.21.15.77:6837/1115358060":"2024-09-12T22:15:19.519162+0000","172.21.15.77:6835/1115358060":"2024-09-12T22:15:19.519162+0000","172.21.15.50:6834/4265727513":"2024-09-12T22:15:19.508243+0000","172.21.15.50:6832/4265727513":"2024-09-12T22:15:19.508243+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:15:43.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.013+0000 7f991459f640 1 -- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98f806be30 msgr2=0x7f98f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.013+0000 7f991459f640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98f806be30 0x7f98f806e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f98fc004d00 tx=0x7f98fc006040 comp rx=0 tx=0).stop 2024-09-11T22:15:43.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.013+0000 7f991459f640 1 -- 172.21.15.50:0/2253611590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f990c15ff00 msgr2=0x7f990c160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.013+0000 7f991459f640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f990c15ff00 0x7f990c160380 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f9900000c00 tx=0x7f9900004730 comp rx=0 tx=0).stop 2024-09-11T22:15:43.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.013+0000 7f991459f640 1 -- 172.21.15.50:0/2253611590 shutdown_connections 2024-09-11T22:15:43.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.013+0000 7f991459f640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98f806be30 0x7f98f806e2f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.013+0000 7f991459f640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990c152c10 0x7f990c153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.013+0000 7f991459f640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f990c15ff00 0x7f990c160380 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.013+0000 7f991459f640 1 --2- 172.21.15.50:0/2253611590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98f4004800 0x7f990c0afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.013+0000 7f991459f640 1 -- 172.21.15.50:0/2253611590 >> 172.21.15.50:0/2253611590 conn(0x7f990c09ba50 msgr2=0x7f990c06c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:43.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.013+0000 7f991459f640 1 -- 172.21.15.50:0/2253611590 shutdown_connections 2024-09-11T22:15:43.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.013+0000 7f991459f640 1 -- 172.21.15.50:0/2253611590 wait complete. 2024-09-11T22:15:43.025 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:11:03.407373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:15:43.026 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:15:43.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.130+0000 7fb5681fd640 1 Processor -- start 2024-09-11T22:15:43.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.130+0000 7fb5681fd640 1 -- start start 2024-09-11T22:15:43.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.131+0000 7fb5681fd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5600d1c90 0x7fb5600b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.131+0000 7fb5681fd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb560162350 0x7fb5601627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.131+0000 7fb5681fd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb560163080 con 0x7fb56015e8e0 2024-09-11T22:15:43.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.131+0000 7fb5681fd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb56015ecc0 con 0x7fb5600d1c90 2024-09-11T22:15:43.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.131+0000 7fb5681fd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb5600d2ad0 con 0x7fb560162350 2024-09-11T22:15:43.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.131+0000 7fb565798640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5600d1c90 0x7fb5600b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.131+0000 7fb565798640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5600d1c90 0x7fb5600b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39200/0 (socket says 172.21.15.50:39200) 2024-09-11T22:15:43.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.131+0000 7fb565798640 1 -- 172.21.15.50:0/1444385590 learned_addr learned my addr 172.21.15.50:0/1444385590 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:43.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.131+0000 7fb56679a640 1 --2- 172.21.15.50:0/1444385590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb560162350 0x7fb5601627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.132+0000 7fb565798640 1 -- 172.21.15.50:0/1444385590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb560162350 msgr2=0x7fb5601627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:43.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.132+0000 7fb565798640 1 --2- 172.21.15.50:0/1444385590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb560162350 0x7fb5601627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.132+0000 7fb565798640 1 -- 172.21.15.50:0/1444385590 >> v1:172.21.15.77:6789/0 conn(0x7fb56015e8e0 legacy=0x7fb5600d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.132+0000 7fb565798640 1 -- 172.21.15.50:0/1444385590 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5600d2d20 con 0x7fb5600d1c90 2024-09-11T22:15:43.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.132+0000 7fb565798640 1 --2- 172.21.15.50:0/1444385590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5600d1c90 0x7fb5600b7880 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb554009870 tx=0x7fb55402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176ab088dd2d7c46 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:43.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.133+0000 7fb564f97640 1 -- 172.21.15.50:0/1444385590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554037070 con 0x7fb5600d1c90 2024-09-11T22:15:43.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.133+0000 7fb564f97640 1 -- 172.21.15.50:0/1444385590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb55402ae50 con 0x7fb5600d1c90 2024-09-11T22:15:43.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.133+0000 7fb564f97640 1 -- 172.21.15.50:0/1444385590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554032860 con 0x7fb5600d1c90 2024-09-11T22:15:43.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.133+0000 7fb5681fd640 1 -- 172.21.15.50:0/1444385590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5600d1c90 msgr2=0x7fb5600b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.133+0000 7fb5681fd640 1 --2- 172.21.15.50:0/1444385590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5600d1c90 0x7fb5600b7880 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb554009870 tx=0x7fb55402a300 comp rx=0 tx=0).stop 2024-09-11T22:15:43.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.133+0000 7fb5681fd640 1 -- 172.21.15.50:0/1444385590 shutdown_connections 2024-09-11T22:15:43.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.133+0000 7fb5681fd640 1 --2- 172.21.15.50:0/1444385590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb560162350 0x7fb5601627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.133+0000 7fb5681fd640 1 --2- 172.21.15.50:0/1444385590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5600d1c90 0x7fb5600b7880 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.133+0000 7fb5681fd640 1 -- 172.21.15.50:0/1444385590 >> 172.21.15.50:0/1444385590 conn(0x7fb560067ba0 msgr2=0x7fb560067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:43.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.133+0000 7fb5681fd640 1 -- 172.21.15.50:0/1444385590 shutdown_connections 2024-09-11T22:15:43.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.133+0000 7fb5681fd640 1 -- 172.21.15.50:0/1444385590 wait complete. 2024-09-11T22:15:43.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.134+0000 7fb5681fd640 1 Processor -- start 2024-09-11T22:15:43.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.135+0000 7fb5681fd640 1 -- start start 2024-09-11T22:15:43.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.135+0000 7fb5681fd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5600d1c90 0x7fb5600ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.135+0000 7fb5681fd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56015e8e0 0x7fb5600b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.135+0000 7fb5681fd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb560162350 0x7fb5600b9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.135+0000 7fb5681fd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb560162d20 con 0x7fb560162350 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.135+0000 7fb5681fd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb5600d3370 con 0x7fb56015e8e0 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.135+0000 7fb5681fd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb5600d3800 con 0x7fb5600d1c90 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.135+0000 7fb56679a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb560162350 0x7fb5600b9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.135+0000 7fb56679a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb560162350 0x7fb5600b9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39202/0 (socket says 172.21.15.50:39202) 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.135+0000 7fb56679a640 1 -- 172.21.15.50:0/1657284717 learned_addr learned my addr 172.21.15.50:0/1657284717 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.135+0000 7fb565798640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56015e8e0 0x7fb5600b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.135+0000 7fb565f99640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5600d1c90 0x7fb5600ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.136+0000 7fb56679a640 1 -- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5600d1c90 msgr2=0x7fb5600ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.136+0000 7fb56679a640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5600d1c90 0x7fb5600ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.136+0000 7fb56679a640 1 -- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56015e8e0 msgr2=0x7fb5600b8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.136+0000 7fb56679a640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56015e8e0 0x7fb5600b8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.136+0000 7fb56679a640 1 -- 172.21.15.50:0/1657284717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5600cab50 con 0x7fb560162350 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.136+0000 7fb56679a640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb560162350 0x7fb5600b9520 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb550009d30 tx=0x7fb55000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:43.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.136+0000 7fb55e7fc640 1 -- 172.21.15.50:0/1657284717 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550018020 con 0x7fb560162350 2024-09-11T22:15:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.136+0000 7fb55e7fc640 1 -- 172.21.15.50:0/1657284717 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb550014480 con 0x7fb560162350 2024-09-11T22:15:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.136+0000 7fb5681fd640 1 -- 172.21.15.50:0/1657284717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5601594e0 con 0x7fb560162350 2024-09-11T22:15:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.136+0000 7fb55e7fc640 1 -- 172.21.15.50:0/1657284717 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550014870 con 0x7fb560162350 2024-09-11T22:15:43.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.136+0000 7fb5681fd640 1 -- 172.21.15.50:0/1657284717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb560159aa0 con 0x7fb560162350 2024-09-11T22:15:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.137+0000 7fb5681fd640 1 -- 172.21.15.50:0/1657284717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5600b7880 con 0x7fb560162350 2024-09-11T22:15:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.138+0000 7fb55e7fc640 1 -- 172.21.15.50:0/1657284717 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb550005d10 con 0x7fb560162350 2024-09-11T22:15:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.138+0000 7fb55e7fc640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb54c06be30 0x7fb54c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.138+0000 7fb55e7fc640 1 -- 172.21.15.50:0/1657284717 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5201+0+0 (secure 0 0 0) 0x7fb55008b530 con 0x7fb560162350 2024-09-11T22:15:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.138+0000 7fb565f99640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb54c06be30 0x7fb54c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.139+0000 7fb565f99640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb54c06be30 0x7fb54c06e2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb558001780 tx=0x7fb558009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:43.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.142+0000 7fb55e7fc640 1 -- 172.21.15.50:0/1657284717 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb550022070 con 0x7fb560162350 2024-09-11T22:15:43.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.319+0000 7fb5681fd640 1 -- 172.21.15.50:0/1657284717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb5600ba770 con 0x7fb560162350 2024-09-11T22:15:43.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.319+0000 7fb55e7fc640 1 -- 172.21.15.50:0/1657284717 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fb5600cab50 con 0x7fb560162350 2024-09-11T22:15:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-11T22:15:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.322+0000 7fb5681fd640 1 -- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb54c06be30 msgr2=0x7fb54c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.322+0000 7fb5681fd640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb54c06be30 0x7fb54c06e2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb558001780 tx=0x7fb558009040 comp rx=0 tx=0).stop 2024-09-11T22:15:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.322+0000 7fb5681fd640 1 -- 172.21.15.50:0/1657284717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb560162350 msgr2=0x7fb5600b9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.322+0000 7fb5681fd640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb560162350 0x7fb5600b9520 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb550009d30 tx=0x7fb55000c490 comp rx=0 tx=0).stop 2024-09-11T22:15:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.322+0000 7fb5681fd640 1 -- 172.21.15.50:0/1657284717 shutdown_connections 2024-09-11T22:15:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.322+0000 7fb5681fd640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb54c06be30 0x7fb54c06e2f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.322+0000 7fb5681fd640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb560162350 0x7fb5600b9520 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.322+0000 7fb5681fd640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56015e8e0 0x7fb5600b8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.322+0000 7fb5681fd640 1 --2- 172.21.15.50:0/1657284717 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5600d1c90 0x7fb5600ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.322+0000 7fb5681fd640 1 -- 172.21.15.50:0/1657284717 >> 172.21.15.50:0/1657284717 conn(0x7fb560067ba0 msgr2=0x7fb560161720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:43.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.322+0000 7fb5681fd640 1 -- 172.21.15.50:0/1657284717 shutdown_connections 2024-09-11T22:15:43.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.322+0000 7fb5681fd640 1 -- 172.21.15.50:0/1657284717 wait complete. 2024-09-11T22:15:43.333 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-11T22:15:43.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.436+0000 7f02c98a5640 1 Processor -- start 2024-09-11T22:15:43.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.437+0000 7f02c98a5640 1 -- start start 2024-09-11T22:15:43.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.437+0000 7f02c98a5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02c40c7290 0x7f02c4160980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.437+0000 7f02c98a5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c415d3d0 con 0x7f02c40679c0 2024-09-11T22:15:43.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.437+0000 7f02c98a5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c415d6b0 con 0x7f02c406fcb0 2024-09-11T22:15:43.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.437+0000 7f02c98a5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f02c4160ec0 con 0x7f02c40c7290 2024-09-11T22:15:43.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.437+0000 7f02c27fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02c40c7290 0x7f02c4160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.437+0000 7f02c37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f02c40679c0 0x7f02c406e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36990/0 (socket says 172.21.15.50:36990) 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.438+0000 7f02c37fe640 1 -- 172.21.15.50:0/2111721276 learned_addr learned my addr 172.21.15.50:0/2111721276 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.438+0000 7f02c27fc640 1 -- 172.21.15.50:0/2111721276 >> v1:172.21.15.77:6789/0 conn(0x7f02c406fcb0 legacy=0x7f02c415c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.438+0000 7f02c27fc640 1 -- 172.21.15.50:0/2111721276 >> v1:172.21.15.50:6789/0 conn(0x7f02c40679c0 legacy=0x7f02c406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.438+0000 7f02c27fc640 1 -- 172.21.15.50:0/2111721276 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c4160180 con 0x7f02c40c7290 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.438+0000 7f02c1ffb640 1 -- 172.21.15.50:0/2111721276 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2549516750 0 0) 0x7f02c415d3d0 con 0x7f02c40679c0 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.439+0000 7f02c27fc640 1 --2- 172.21.15.50:0/2111721276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40c7290 0x7f02c4160980 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0097a0 tx=0x7f02ac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81386abf3925fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.439+0000 7f02c1ffb640 1 -- 172.21.15.50:0/2111721276 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac037070 con 0x7f02c40c7290 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.439+0000 7f02c1ffb640 1 -- 172.21.15.50:0/2111721276 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ac032440 con 0x7f02c40c7290 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.439+0000 7f02c1ffb640 1 -- 172.21.15.50:0/2111721276 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac032810 con 0x7f02c40c7290 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.439+0000 7f02c98a5640 1 -- 172.21.15.50:0/2111721276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40c7290 msgr2=0x7f02c4160980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.439+0000 7f02c98a5640 1 --2- 172.21.15.50:0/2111721276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40c7290 0x7f02c4160980 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0097a0 tx=0x7f02ac02a230 comp rx=0 tx=0).stop 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.439+0000 7f02c98a5640 1 -- 172.21.15.50:0/2111721276 shutdown_connections 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.439+0000 7f02c98a5640 1 --2- 172.21.15.50:0/2111721276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40c7290 0x7f02c4160980 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.439+0000 7f02c98a5640 1 -- 172.21.15.50:0/2111721276 >> 172.21.15.50:0/2111721276 conn(0x7f02c4075060 msgr2=0x7f02c406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.439+0000 7f02c98a5640 1 -- 172.21.15.50:0/2111721276 shutdown_connections 2024-09-11T22:15:43.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.439+0000 7f02c98a5640 1 -- 172.21.15.50:0/2111721276 wait complete. 2024-09-11T22:15:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.440+0000 7f02c98a5640 1 Processor -- start 2024-09-11T22:15:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.441+0000 7f02c98a5640 1 -- start start 2024-09-11T22:15:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.441+0000 7f02c98a5640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02c40679c0 0x7f02c4156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.441+0000 7f02c98a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c406fcb0 0x7f02c4157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.441+0000 7f02c98a5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40c7290 0x7f02c40b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.441+0000 7f02c98a5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f02c4153950 con 0x7f02c40c7290 2024-09-11T22:15:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.441+0000 7f02c98a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f02c41604f0 con 0x7f02c406fcb0 2024-09-11T22:15:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.441+0000 7f02c98a5640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f02c4067e50 con 0x7f02c40679c0 2024-09-11T22:15:43.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40c7290 0x7f02c40b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40c7290 0x7f02c40b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39216/0 (socket says 172.21.15.50:39216) 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02c37fe640 1 -- 172.21.15.50:0/1871039640 learned_addr learned my addr 172.21.15.50:0/1871039640 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02c2ffd640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02c40679c0 0x7f02c4156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02c27fc640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c406fcb0 0x7f02c4157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02c37fe640 1 -- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02c40679c0 msgr2=0x7f02c4156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02c37fe640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02c40679c0 0x7f02c4156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02c37fe640 1 -- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c406fcb0 msgr2=0x7f02c4157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02c37fe640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c406fcb0 0x7f02c4157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02c37fe640 1 -- 172.21.15.50:0/1871039640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c4159bf0 con 0x7f02c40c7290 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02c37fe640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40c7290 0x7f02c40b58d0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f02b400c450 tx=0x7f02b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02bbfff640 1 -- 172.21.15.50:0/1871039640 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4018070 con 0x7f02c40c7290 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02bbfff640 1 -- 172.21.15.50:0/1871039640 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b4007500 con 0x7f02c40c7290 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02c98a5640 1 -- 172.21.15.50:0/1871039640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c4159ed0 con 0x7f02c40c7290 2024-09-11T22:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02bbfff640 1 -- 172.21.15.50:0/1871039640 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4004a20 con 0x7f02c40c7290 2024-09-11T22:15:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.442+0000 7f02c98a5640 1 -- 172.21.15.50:0/1871039640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c4159830 con 0x7f02c40c7290 2024-09-11T22:15:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.443+0000 7f02c98a5640 1 -- 172.21.15.50:0/1871039640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c413b970 con 0x7f02c40c7290 2024-09-11T22:15:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.444+0000 7f02bbfff640 1 -- 172.21.15.50:0/1871039640 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02b401b070 con 0x7f02c40c7290 2024-09-11T22:15:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.444+0000 7f02bbfff640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02a406be60 0x7f02a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.444+0000 7f02bbfff640 1 -- 172.21.15.50:0/1871039640 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5201+0+0 (secure 0 0 0) 0x7f02b4089df0 con 0x7f02c40c7290 2024-09-11T22:15:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.444+0000 7f02c2ffd640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02a406be60 0x7f02a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.445+0000 7f02c2ffd640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02a406be60 0x7f02a406e320 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0012e0 tx=0x7f02bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.448+0000 7f02bbfff640 1 -- 172.21.15.50:0/1871039640 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02b40583d0 con 0x7f02c40c7290 2024-09-11T22:15:43.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.693+0000 7f02c98a5640 1 -- 172.21.15.50:0/1871039640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f02c4068220 con 0x7f02c40c7290 2024-09-11T22:15:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.712+0000 7f02bbfff640 1 -- 172.21.15.50:0/1871039640 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v234) ==== 154+0+0 (secure 0 0 0) 0x7f02b405c6d0 con 0x7f02c40c7290 2024-09-11T22:15:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.714+0000 7f02c98a5640 1 -- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02a406be60 msgr2=0x7f02a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.714+0000 7f02c98a5640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02a406be60 0x7f02a406e320 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0012e0 tx=0x7f02bc009040 comp rx=0 tx=0).stop 2024-09-11T22:15:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.714+0000 7f02c98a5640 1 -- 172.21.15.50:0/1871039640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40c7290 msgr2=0x7f02c40b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.714+0000 7f02c98a5640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40c7290 0x7f02c40b58d0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f02b400c450 tx=0x7f02b400c910 comp rx=0 tx=0).stop 2024-09-11T22:15:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.714+0000 7f02c98a5640 1 -- 172.21.15.50:0/1871039640 shutdown_connections 2024-09-11T22:15:43.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.714+0000 7f02c98a5640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02a406be60 0x7f02a406e320 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.714+0000 7f02c98a5640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02c40c7290 0x7f02c40b58d0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.714+0000 7f02c98a5640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c406fcb0 0x7f02c4157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.714+0000 7f02c98a5640 1 --2- 172.21.15.50:0/1871039640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02c40679c0 0x7f02c4156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.714+0000 7f02c98a5640 1 -- 172.21.15.50:0/1871039640 >> 172.21.15.50:0/1871039640 conn(0x7f02c4075060 msgr2=0x7f02c415e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:43.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.714+0000 7f02c98a5640 1 -- 172.21.15.50:0/1871039640 shutdown_connections 2024-09-11T22:15:43.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.714+0000 7f02c98a5640 1 -- 172.21.15.50:0/1871039640 wait complete. 2024-09-11T22:15:43.726 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T22:15:43.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.831+0000 7efd1780a640 1 Processor -- start 2024-09-11T22:15:43.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.831+0000 7efd1780a640 1 -- start start 2024-09-11T22:15:43.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd1780a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efd100d05e0 0x7efd100b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd1780a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd100b3e10 0x7efd100ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd1780a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd100b4f00 con 0x7efd1015c2c0 2024-09-11T22:15:43.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd1780a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7efd100b4360 con 0x7efd100b3e10 2024-09-11T22:15:43.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd1780a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efd100b51c0 con 0x7efd100d05e0 2024-09-11T22:15:43.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd15da7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd100b3e10 0x7efd100ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd15da7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efd100b3e10 0x7efd100ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39218/0 (socket says 172.21.15.50:39218) 2024-09-11T22:15:43.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd15da7640 1 -- 172.21.15.50:0/544476399 learned_addr learned my addr 172.21.15.50:0/544476399 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:43.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd14da5640 1 --2- 172.21.15.50:0/544476399 >> v2:172.21.15.77:3300/0 conn(0x7efd100d05e0 0x7efd100b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd15da7640 1 -- 172.21.15.50:0/544476399 >> v2:172.21.15.77:3300/0 conn(0x7efd100d05e0 msgr2=0x7efd100b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:43.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd15da7640 1 --2- 172.21.15.50:0/544476399 >> v2:172.21.15.77:3300/0 conn(0x7efd100d05e0 0x7efd100b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd15da7640 1 -- 172.21.15.50:0/544476399 >> v1:172.21.15.77:6789/0 conn(0x7efd1015c2c0 legacy=0x7efd100cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd15da7640 1 -- 172.21.15.50:0/544476399 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd100b54a0 con 0x7efd100b3e10 2024-09-11T22:15:43.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.832+0000 7efd14da5640 1 --2- 172.21.15.50:0/544476399 >> v2:172.21.15.77:3300/0 conn(0x7efd100d05e0 0x7efd100b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.833+0000 7efd15da7640 1 --2- 172.21.15.50:0/544476399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100b3e10 0x7efd100ce790 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7efd1015ff20 tx=0x7efd0802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec3c9a714c9623 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.833+0000 7efd07fff640 1 -- 172.21.15.50:0/544476399 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08036070 con 0x7efd100b3e10 2024-09-11T22:15:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.833+0000 7efd07fff640 1 -- 172.21.15.50:0/544476399 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd08031600 con 0x7efd100b3e10 2024-09-11T22:15:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.833+0000 7efd07fff640 1 -- 172.21.15.50:0/544476399 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd080319d0 con 0x7efd100b3e10 2024-09-11T22:15:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.834+0000 7efd1780a640 1 -- 172.21.15.50:0/544476399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100b3e10 msgr2=0x7efd100ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.834+0000 7efd1780a640 1 --2- 172.21.15.50:0/544476399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100b3e10 0x7efd100ce790 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7efd1015ff20 tx=0x7efd0802a730 comp rx=0 tx=0).stop 2024-09-11T22:15:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.834+0000 7efd1780a640 1 -- 172.21.15.50:0/544476399 shutdown_connections 2024-09-11T22:15:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.834+0000 7efd1780a640 1 --2- 172.21.15.50:0/544476399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100b3e10 0x7efd100ce790 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.834+0000 7efd1780a640 1 --2- 172.21.15.50:0/544476399 >> v2:172.21.15.77:3300/0 conn(0x7efd100d05e0 0x7efd100b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.834+0000 7efd1780a640 1 -- 172.21.15.50:0/544476399 >> 172.21.15.50:0/544476399 conn(0x7efd100679c0 msgr2=0x7efd10067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.834+0000 7efd1780a640 1 -- 172.21.15.50:0/544476399 shutdown_connections 2024-09-11T22:15:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.834+0000 7efd1780a640 1 -- 172.21.15.50:0/544476399 wait complete. 2024-09-11T22:15:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.835+0000 7efd1780a640 1 Processor -- start 2024-09-11T22:15:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.835+0000 7efd1780a640 1 -- start start 2024-09-11T22:15:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd1780a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd100b3e10 0x7efd1014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd1780a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100d05e0 0x7efd100ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd1780a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1015c2c0 0x7efd100aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd1780a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efd1006d070 con 0x7efd100d05e0 2024-09-11T22:15:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd1780a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd100ce200 con 0x7efd1015c2c0 2024-09-11T22:15:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd1780a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efd1006d1f0 con 0x7efd100b3e10 2024-09-11T22:15:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd14da5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100d05e0 0x7efd100ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd14da5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100d05e0 0x7efd100ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39234/0 (socket says 172.21.15.50:39234) 2024-09-11T22:15:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd14da5640 1 -- 172.21.15.50:0/773855479 learned_addr learned my addr 172.21.15.50:0/773855479 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd15da7640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1015c2c0 0x7efd100aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd155a6640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd100b3e10 0x7efd1014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd14da5640 1 -- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd100b3e10 msgr2=0x7efd1014ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd14da5640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd100b3e10 0x7efd1014ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd14da5640 1 -- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1015c2c0 msgr2=0x7efd100aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd14da5640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1015c2c0 0x7efd100aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd14da5640 1 -- 172.21.15.50:0/773855479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd101e73a0 con 0x7efd100d05e0 2024-09-11T22:15:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.836+0000 7efd14da5640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100d05e0 0x7efd100ae8f0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7efd0000e760 tx=0x7efd0000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.837+0000 7efd05ffb640 1 -- 172.21.15.50:0/773855479 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0000f040 con 0x7efd100d05e0 2024-09-11T22:15:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.837+0000 7efd05ffb640 1 -- 172.21.15.50:0/773855479 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd00004230 con 0x7efd100d05e0 2024-09-11T22:15:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.837+0000 7efd1780a640 1 -- 172.21.15.50:0/773855479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd101e6e00 con 0x7efd100d05e0 2024-09-11T22:15:43.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.837+0000 7efd05ffb640 1 -- 172.21.15.50:0/773855479 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0000ee70 con 0x7efd100d05e0 2024-09-11T22:15:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.837+0000 7efd1780a640 1 -- 172.21.15.50:0/773855479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd101e7940 con 0x7efd100d05e0 2024-09-11T22:15:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.838+0000 7efd1780a640 1 -- 172.21.15.50:0/773855479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd101529f0 con 0x7efd100d05e0 2024-09-11T22:15:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.838+0000 7efd05ffb640 1 -- 172.21.15.50:0/773855479 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd0000c6d0 con 0x7efd100d05e0 2024-09-11T22:15:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.838+0000 7efd05ffb640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efcf406be30 0x7efcf406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.839+0000 7efd05ffb640 1 -- 172.21.15.50:0/773855479 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5201+0+0 (secure 0 0 0) 0x7efd0008a8a0 con 0x7efd100d05e0 2024-09-11T22:15:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.839+0000 7efd155a6640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efcf406be30 0x7efcf406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.839+0000 7efd155a6640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efcf406be30 0x7efcf406e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7efd10072170 tx=0x7efd0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:43.843+0000 7efd05ffb640 1 -- 172.21.15.50:0/773855479 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd00017020 con 0x7efd100d05e0 2024-09-11T22:15:44.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.019+0000 7efd1780a640 1 -- 172.21.15.50:0/773855479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efd100d0b10 con 0x7efd100d05e0 2024-09-11T22:15:44.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.022+0000 7efd05ffb640 1 -- 172.21.15.50:0/773855479 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7efd00058df0 con 0x7efd100d05e0 2024-09-11T22:15:44.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.024+0000 7efd1780a640 1 -- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efcf406be30 msgr2=0x7efcf406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.024+0000 7efd1780a640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efcf406be30 0x7efcf406e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7efd10072170 tx=0x7efd0c009040 comp rx=0 tx=0).stop 2024-09-11T22:15:44.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.024+0000 7efd1780a640 1 -- 172.21.15.50:0/773855479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100d05e0 msgr2=0x7efd100ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.024+0000 7efd1780a640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100d05e0 0x7efd100ae8f0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7efd0000e760 tx=0x7efd0000ec20 comp rx=0 tx=0).stop 2024-09-11T22:15:44.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.024+0000 7efd1780a640 1 -- 172.21.15.50:0/773855479 shutdown_connections 2024-09-11T22:15:44.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.024+0000 7efd1780a640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efcf406be30 0x7efcf406e2f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.024+0000 7efd1780a640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1015c2c0 0x7efd100aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.024+0000 7efd1780a640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd100d05e0 0x7efd100ae8f0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.024+0000 7efd1780a640 1 --2- 172.21.15.50:0/773855479 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd100b3e10 0x7efd1014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.024+0000 7efd1780a640 1 -- 172.21.15.50:0/773855479 >> 172.21.15.50:0/773855479 conn(0x7efd100679c0 msgr2=0x7efd100ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:44.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.024+0000 7efd1780a640 1 -- 172.21.15.50:0/773855479 shutdown_connections 2024-09-11T22:15:44.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.024+0000 7efd1780a640 1 -- 172.21.15.50:0/773855479 wait complete. 2024-09-11T22:15:44.036 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:15:44.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:15:44.075 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:15:44.127 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:15:44.127 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:15:44.128 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:44.144 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:15:44.144 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:15:44.144 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:44.162 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:15:44.162 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:15:44.162 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:44.200 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:15:44.201 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:15:44.201 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:44.220 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:15:44.220 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T22:15:44.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:44.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.341+0000 7f77df6ac640 1 Processor -- start 2024-09-11T22:15:44.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.342+0000 7f77df6ac640 1 -- start start 2024-09-11T22:15:44.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.342+0000 7f77df6ac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77d80cf580 0x7f77d80b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:44.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.342+0000 7f77df6ac640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d80ce5f0 con 0x7f77d80cdd50 2024-09-11T22:15:44.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.342+0000 7f77df6ac640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d80ce310 con 0x7f77d815e840 2024-09-11T22:15:44.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.342+0000 7f77df6ac640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f77d806c240 con 0x7f77d80cf580 2024-09-11T22:15:44.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.343+0000 7f77dcc47640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77d80cf580 0x7f77d80b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:44.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.343+0000 7f77ddc49640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f77d80cdd50 0x7f77d806c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37006/0 (socket says 172.21.15.50:37006) 2024-09-11T22:15:44.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.343+0000 7f77ddc49640 1 -- 172.21.15.50:0/1092542195 learned_addr learned my addr 172.21.15.50:0/1092542195 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:44.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.343+0000 7f77dcc47640 1 -- 172.21.15.50:0/1092542195 >> v1:172.21.15.77:6789/0 conn(0x7f77d815e840 legacy=0x7f77d80cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.343+0000 7f77dcc47640 1 -- 172.21.15.50:0/1092542195 >> v1:172.21.15.50:6789/0 conn(0x7f77d80cdd50 legacy=0x7f77d806c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.343+0000 7f77dcc47640 1 -- 172.21.15.50:0/1092542195 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d806bbf0 con 0x7f77d80cf580 2024-09-11T22:15:44.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.344+0000 7f77dcc47640 1 --2- 172.21.15.50:0/1092542195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d80cf580 0x7f77d80b4c70 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0097a0 tx=0x7f77cc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24507c3c2ed745e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:44.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.344+0000 7f77d7fff640 1 -- 172.21.15.50:0/1092542195 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc037070 con 0x7f77d80cf580 2024-09-11T22:15:44.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.344+0000 7f77d7fff640 1 -- 172.21.15.50:0/1092542195 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77cc032440 con 0x7f77d80cf580 2024-09-11T22:15:44.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.344+0000 7f77d7fff640 1 -- 172.21.15.50:0/1092542195 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc032810 con 0x7f77d80cf580 2024-09-11T22:15:44.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.344+0000 7f77df6ac640 1 -- 172.21.15.50:0/1092542195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d80cf580 msgr2=0x7f77d80b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.344+0000 7f77df6ac640 1 --2- 172.21.15.50:0/1092542195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d80cf580 0x7f77d80b4c70 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0097a0 tx=0x7f77cc02a230 comp rx=0 tx=0).stop 2024-09-11T22:15:44.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.344+0000 7f77df6ac640 1 -- 172.21.15.50:0/1092542195 shutdown_connections 2024-09-11T22:15:44.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.344+0000 7f77df6ac640 1 --2- 172.21.15.50:0/1092542195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d80cf580 0x7f77d80b4c70 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.344+0000 7f77df6ac640 1 -- 172.21.15.50:0/1092542195 >> 172.21.15.50:0/1092542195 conn(0x7f77d80b4150 msgr2=0x7f77d80b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:44.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.344+0000 7f77df6ac640 1 -- 172.21.15.50:0/1092542195 shutdown_connections 2024-09-11T22:15:44.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.344+0000 7f77df6ac640 1 -- 172.21.15.50:0/1092542195 wait complete. 2024-09-11T22:15:44.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.346+0000 7f77df6ac640 1 Processor -- start 2024-09-11T22:15:44.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.346+0000 7f77df6ac640 1 -- start start 2024-09-11T22:15:44.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.346+0000 7f77df6ac640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77d80cdd50 0x7f77d80b8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:44.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.346+0000 7f77df6ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77d80cf580 0x7f77d8155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:44.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.346+0000 7f77df6ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d815e840 0x7f77d80b7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:44.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.346+0000 7f77df6ac640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77d815ec20 con 0x7f77d815e840 2024-09-11T22:15:44.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.346+0000 7f77df6ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f77d80d0470 con 0x7f77d80cf580 2024-09-11T22:15:44.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.346+0000 7f77df6ac640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f77d815eda0 con 0x7f77d80cdd50 2024-09-11T22:15:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.346+0000 7f77ddc49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d815e840 0x7f77d80b7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77ddc49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d815e840 0x7f77d80b7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39244/0 (socket says 172.21.15.50:39244) 2024-09-11T22:15:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77ddc49640 1 -- 172.21.15.50:0/3621021028 learned_addr learned my addr 172.21.15.50:0/3621021028 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77dd448640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77d80cdd50 0x7f77d80b8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77dcc47640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77d80cf580 0x7f77d8155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77ddc49640 1 -- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77d80cdd50 msgr2=0x7f77d80b8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77ddc49640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77d80cdd50 0x7f77d80b8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77ddc49640 1 -- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77d80cf580 msgr2=0x7f77d8155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77ddc49640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77d80cf580 0x7f77d8155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77ddc49640 1 -- 172.21.15.50:0/3621021028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d80c8070 con 0x7f77d815e840 2024-09-11T22:15:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77ddc49640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d815e840 0x7f77d80b7390 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f77d000c370 tx=0x7f77d000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77d5ffb640 1 -- 172.21.15.50:0/3621021028 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d0017070 con 0x7f77d815e840 2024-09-11T22:15:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77d5ffb640 1 -- 172.21.15.50:0/3621021028 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d0005ce0 con 0x7f77d815e840 2024-09-11T22:15:44.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77df6ac640 1 -- 172.21.15.50:0/3621021028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d80c8350 con 0x7f77d815e840 2024-09-11T22:15:44.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77d5ffb640 1 -- 172.21.15.50:0/3621021028 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d00072d0 con 0x7f77d815e840 2024-09-11T22:15:44.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.347+0000 7f77df6ac640 1 -- 172.21.15.50:0/3621021028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d80c8910 con 0x7f77d815e840 2024-09-11T22:15:44.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.348+0000 7f77df6ac640 1 -- 172.21.15.50:0/3621021028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d80b4c70 con 0x7f77d815e840 2024-09-11T22:15:44.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.349+0000 7f77d5ffb640 1 -- 172.21.15.50:0/3621021028 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77d001a070 con 0x7f77d815e840 2024-09-11T22:15:44.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.349+0000 7f77d5ffb640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f77c406be30 0x7f77c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:44.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.349+0000 7f77d5ffb640 1 -- 172.21.15.50:0/3621021028 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5201+0+0 (secure 0 0 0) 0x7f77d0089f70 con 0x7f77d815e840 2024-09-11T22:15:44.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.350+0000 7f77dd448640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f77c406be30 0x7f77c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:44.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.350+0000 7f77dd448640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f77c406be30 0x7f77c406e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f77c8001f10 tx=0x7f77c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:44.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.354+0000 7f77d5ffb640 1 -- 172.21.15.50:0/3621021028 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f77d0058420 con 0x7f77d815e840 2024-09-11T22:15:44.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.565+0000 7f77df6ac640 1 -- 172.21.15.50:0/3621021028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77d806d780 con 0x7f77d815e840 2024-09-11T22:15:44.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.566+0000 7f77d5ffb640 1 -- 172.21.15.50:0/3621021028 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+3908 (secure 0 0 0) 0x7f77d005c720 con 0x7f77d815e840 2024-09-11T22:15:44.567 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:44.568 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":58,"btime":"2024-09-11T22:15:39:696120+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4081050909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4081050909},{"type":"v1","addr":"172.21.15.77:6835","nonce":4081050909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6340,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/502868531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":502868531},{"type":"v1","addr":"172.21.15.77:6837","nonce":502868531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1024879489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1024879489},{"type":"v1","addr":"172.21.15.50:6835","nonce":1024879489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":7023,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1504540947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1504540947},{"type":"v1","addr":"172.21.15.50:6833","nonce":1504540947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[]} 2024-09-11T22:15:44.568 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 58 2024-09-11T22:15:44.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.568+0000 7f77df6ac640 1 -- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f77c406be30 msgr2=0x7f77c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.568+0000 7f77df6ac640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f77c406be30 0x7f77c406e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f77c8001f10 tx=0x7f77c8009040 comp rx=0 tx=0).stop 2024-09-11T22:15:44.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.568+0000 7f77df6ac640 1 -- 172.21.15.50:0/3621021028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d815e840 msgr2=0x7f77d80b7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.568+0000 7f77df6ac640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d815e840 0x7f77d80b7390 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f77d000c370 tx=0x7f77d000c830 comp rx=0 tx=0).stop 2024-09-11T22:15:44.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.568+0000 7f77df6ac640 1 -- 172.21.15.50:0/3621021028 shutdown_connections 2024-09-11T22:15:44.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.568+0000 7f77df6ac640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f77c406be30 0x7f77c406e2f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.568+0000 7f77df6ac640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d815e840 0x7f77d80b7390 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.568+0000 7f77df6ac640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77d80cf580 0x7f77d8155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.568+0000 7f77df6ac640 1 --2- 172.21.15.50:0/3621021028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77d80cdd50 0x7f77d80b8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.568+0000 7f77df6ac640 1 -- 172.21.15.50:0/3621021028 >> 172.21.15.50:0/3621021028 conn(0x7f77d80b4150 msgr2=0x7f77d806ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:44.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.568+0000 7f77df6ac640 1 -- 172.21.15.50:0/3621021028 shutdown_connections 2024-09-11T22:15:44.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.568+0000 7f77df6ac640 1 -- 172.21.15.50:0/3621021028 wait complete. 2024-09-11T22:15:44.581 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:15:44.581 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T22:15:44.581 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:15:44.581 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:15:44.581 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:15:44.582 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T22:15:44.582 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:15:44.582 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:15:44.582 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:15:44.582 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T22:15:44.582 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:15:44.582 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:15:44.583 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:15:44.583 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T22:15:44.583 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:15:44.583 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:15:44.590 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:15:44.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:15:44.591 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:15:44.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:15:44.597 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:15:44.597 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:15:44.598 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:15:44.598 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:15:44.633 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:15:44.634 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:44.634 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:15:44.634 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:44.640 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:15:44.640 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:44.641 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:15:44.641 DEBUG:teuthology.parallel:result is None 2024-09-11T22:15:44.641 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T22:15:44.710 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:15:44.710 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:15:44.726 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:15:44.727 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:15:44.727 INFO:tasks.ceph.mds.d.smithi077.stderr:2024-09-11T22:15:44.727+0000 7fb29e5b4640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-11T22:15:44.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.747+0000 7f8e6e8ba640 1 Processor -- start 2024-09-11T22:15:44.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.747+0000 7f8e6e8ba640 1 -- start start 2024-09-11T22:15:44.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.748+0000 7f8e6e8ba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8e680d18a0 0x7f8e680d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:44.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.748+0000 7f8e6e8ba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e680cfa80 con 0x7f8e6815e870 2024-09-11T22:15:44.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.748+0000 7f8e6e8ba640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e680d40d0 con 0x7f8e680d3a30 2024-09-11T22:15:44.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.748+0000 7f8e6e8ba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8e680d3ea0 con 0x7f8e680d18a0 2024-09-11T22:15:44.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.748+0000 7f8e67fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8e6815e870 0x7f8e680d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37036/0 (socket says 172.21.15.50:37036) 2024-09-11T22:15:44.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.748+0000 7f8e67fff640 1 -- 172.21.15.50:0/1748306270 learned_addr learned my addr 172.21.15.50:0/1748306270 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:44.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.748+0000 7f8e677fe640 1 --2- 172.21.15.50:0/1748306270 >> v2:172.21.15.77:3300/0 conn(0x7f8e680d18a0 0x7f8e680d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:44.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.749+0000 7f8e66ffd640 1 -- 172.21.15.50:0/1748306270 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 265024028 0 0) 0x7f8e50001110 con 0x7f8e6815e870 2024-09-11T22:15:44.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.749+0000 7f8e66ffd640 1 -- 172.21.15.50:0/1748306270 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e54003520 con 0x7f8e6815e870 2024-09-11T22:15:44.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.749+0000 7f8e66ffd640 1 -- 172.21.15.50:0/1748306270 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3954089307 0 0) 0x7f8e680d40d0 con 0x7f8e680d3a30 2024-09-11T22:15:44.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.749+0000 7f8e66ffd640 1 -- 172.21.15.50:0/1748306270 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e50001110 con 0x7f8e680d3a30 2024-09-11T22:15:44.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.749+0000 7f8e677fe640 1 -- 172.21.15.50:0/1748306270 >> v1:172.21.15.77:6789/0 conn(0x7f8e680d3a30 legacy=0x7f8e680b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.749+0000 7f8e677fe640 1 -- 172.21.15.50:0/1748306270 >> v1:172.21.15.50:6789/0 conn(0x7f8e6815e870 legacy=0x7f8e680d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.749+0000 7f8e677fe640 1 -- 172.21.15.50:0/1748306270 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e680d43b0 con 0x7f8e680d18a0 2024-09-11T22:15:44.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.749+0000 7f8e677fe640 1 --2- 172.21.15.50:0/1748306270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e680d18a0 0x7f8e680d34f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8e580097a0 tx=0x7f8e5802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18ffe55bac56bbe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:44.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.750+0000 7f8e66ffd640 1 -- 172.21.15.50:0/1748306270 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58037070 con 0x7f8e680d18a0 2024-09-11T22:15:44.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.750+0000 7f8e66ffd640 1 -- 172.21.15.50:0/1748306270 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e58032440 con 0x7f8e680d18a0 2024-09-11T22:15:44.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.750+0000 7f8e66ffd640 1 -- 172.21.15.50:0/1748306270 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e580327f0 con 0x7f8e680d18a0 2024-09-11T22:15:44.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.750+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1748306270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e680d18a0 msgr2=0x7f8e680d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.750+0000 7f8e6e8ba640 1 --2- 172.21.15.50:0/1748306270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e680d18a0 0x7f8e680d34f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8e580097a0 tx=0x7f8e5802a230 comp rx=0 tx=0).stop 2024-09-11T22:15:44.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.750+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1748306270 shutdown_connections 2024-09-11T22:15:44.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.750+0000 7f8e6e8ba640 1 --2- 172.21.15.50:0/1748306270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e680d18a0 0x7f8e680d34f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.750+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1748306270 >> 172.21.15.50:0/1748306270 conn(0x7f8e680727a0 msgr2=0x7f8e680679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:44.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.750+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1748306270 shutdown_connections 2024-09-11T22:15:44.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.750+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1748306270 wait complete. 2024-09-11T22:15:44.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.751+0000 7f8e6e8ba640 1 Processor -- start 2024-09-11T22:15:44.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.752+0000 7f8e6e8ba640 1 -- start start 2024-09-11T22:15:44.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.752+0000 7f8e6e8ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e680d18a0 0x7f8e6814ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:44.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.752+0000 7f8e6e8ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e680d3a30 0x7f8e6815b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:44.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.752+0000 7f8e6e8ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e6815e870 0x7f8e6815f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:44.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.752+0000 7f8e6e8ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6815ec50 con 0x7f8e6815e870 2024-09-11T22:15:44.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.752+0000 7f8e6e8ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8e680b7ee0 con 0x7f8e680d18a0 2024-09-11T22:15:44.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.752+0000 7f8e6e8ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8e680b78b0 con 0x7f8e680d3a30 2024-09-11T22:15:44.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e6ce57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e6815e870 0x7f8e6815f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:44.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e6ce57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e6815e870 0x7f8e6815f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39290/0 (socket says 172.21.15.50:39290) 2024-09-11T22:15:44.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e67fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e680d18a0 0x7f8e6814ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:44.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e6ce57640 1 -- 172.21.15.50:0/1847850080 learned_addr learned my addr 172.21.15.50:0/1847850080 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:44.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e677fe640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e680d3a30 0x7f8e6815b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:44.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e6ce57640 1 -- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e680d3a30 msgr2=0x7f8e6815b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e6ce57640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e680d3a30 0x7f8e6815b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e6ce57640 1 -- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e680d18a0 msgr2=0x7f8e6814ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:44.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e6ce57640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e680d18a0 0x7f8e6814ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:44.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e6ce57640 1 -- 172.21.15.50:0/1847850080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e680c87e0 con 0x7f8e6815e870 2024-09-11T22:15:44.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e67fff640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e680d18a0 0x7f8e6814ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:15:44.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e6ce57640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e6815e870 0x7f8e6815f680 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000c7a0 tx=0x7f8e6000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:44.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e64ff9640 1 -- 172.21.15.50:0/1847850080 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60003b70 con 0x7f8e6815e870 2024-09-11T22:15:44.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e64ff9640 1 -- 172.21.15.50:0/1847850080 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e60003d30 con 0x7f8e6815e870 2024-09-11T22:15:44.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1847850080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e680c8ac0 con 0x7f8e6815e870 2024-09-11T22:15:44.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e64ff9640 1 -- 172.21.15.50:0/1847850080 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000aa30 con 0x7f8e6815e870 2024-09-11T22:15:44.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.753+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1847850080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e680c9080 con 0x7f8e6815e870 2024-09-11T22:15:44.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.754+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1847850080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e680d37f0 con 0x7f8e6815e870 2024-09-11T22:15:44.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.755+0000 7f8e64ff9640 1 -- 172.21.15.50:0/1847850080 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e6000abd0 con 0x7f8e6815e870 2024-09-11T22:15:44.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.755+0000 7f8e64ff9640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8e4806be30 0x7f8e4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:44.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.755+0000 7f8e64ff9640 1 -- 172.21.15.50:0/1847850080 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5201+0+0 (secure 0 0 0) 0x7f8e6008ab20 con 0x7f8e6815e870 2024-09-11T22:15:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.755+0000 7f8e67fff640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8e4806be30 0x7f8e4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.756+0000 7f8e67fff640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8e4806be30 0x7f8e4806e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8e50000f60 tx=0x7f8e50007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.760+0000 7f8e64ff9640 1 -- 172.21.15.50:0/1847850080 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e680d37f0 con 0x7f8e6815e870 2024-09-11T22:15:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:44.949+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1847850080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8e680d34d0 con 0x7f8e6815e870 2024-09-11T22:15:45.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.729+0000 7f8e64ff9640 1 -- 172.21.15.50:0/1847850080 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v83) ==== 97+0+0 (secure 0 0 0) 0x7f8e60058fd0 con 0x7f8e6815e870 2024-09-11T22:15:45.730 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-11T22:15:45.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.733+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8e4806be30 msgr2=0x7f8e4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.733+0000 7f8e6e8ba640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8e4806be30 0x7f8e4806e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8e50000f60 tx=0x7f8e50007d30 comp rx=0 tx=0).stop 2024-09-11T22:15:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.733+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1847850080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e6815e870 msgr2=0x7f8e6815f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.733+0000 7f8e6e8ba640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e6815e870 0x7f8e6815f680 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000c7a0 tx=0x7f8e6000cc60 comp rx=0 tx=0).stop 2024-09-11T22:15:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.733+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1847850080 shutdown_connections 2024-09-11T22:15:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.733+0000 7f8e6e8ba640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8e4806be30 0x7f8e4806e2f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.733+0000 7f8e6e8ba640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e680d3a30 0x7f8e6815b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.733+0000 7f8e6e8ba640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e6815e870 0x7f8e6815f680 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.733+0000 7f8e6e8ba640 1 --2- 172.21.15.50:0/1847850080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e680d18a0 0x7f8e6814ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.733+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1847850080 >> 172.21.15.50:0/1847850080 conn(0x7f8e680727a0 msgr2=0x7f8e681611e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.733+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1847850080 shutdown_connections 2024-09-11T22:15:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.733+0000 7f8e6e8ba640 1 -- 172.21.15.50:0/1847850080 wait complete. 2024-09-11T22:15:45.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T22:15:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.856+0000 7fd1702ac640 1 Processor -- start 2024-09-11T22:15:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.857+0000 7fd1702ac640 1 -- start start 2024-09-11T22:15:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.858+0000 7fd1702ac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1680d3c00 0x7fd168169420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.858+0000 7fd1702ac640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1680cfa80 con 0x7fd1680d18a0 2024-09-11T22:15:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.858+0000 7fd1702ac640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1680d40d0 con 0x7fd16815e870 2024-09-11T22:15:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.858+0000 7fd1702ac640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd1680d43b0 con 0x7fd1680d3c00 2024-09-11T22:15:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.858+0000 7fd16e849640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1680d3c00 0x7fd168169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.858+0000 7fd16d847640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd1680d18a0 0x7fd1680d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37040/0 (socket says 172.21.15.50:37040) 2024-09-11T22:15:45.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.858+0000 7fd16d847640 1 -- 172.21.15.50:0/2351639864 learned_addr learned my addr 172.21.15.50:0/2351639864 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.858+0000 7fd16e849640 1 -- 172.21.15.50:0/2351639864 >> v1:172.21.15.77:6789/0 conn(0x7fd16815e870 legacy=0x7fd1680d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:45.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.858+0000 7fd16e849640 1 -- 172.21.15.50:0/2351639864 >> v1:172.21.15.50:6789/0 conn(0x7fd1680d18a0 legacy=0x7fd1680d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.858+0000 7fd16e849640 1 -- 172.21.15.50:0/2351639864 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1680b7c00 con 0x7fd1680d3c00 2024-09-11T22:15:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.859+0000 7fd16e849640 1 --2- 172.21.15.50:0/2351639864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1680d3c00 0x7fd168169420 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fd160009d90 tx=0x7fd16002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103e2de70376cc16 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.859+0000 7fd16d046640 1 -- 172.21.15.50:0/2351639864 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd160007740 con 0x7fd1680d3c00 2024-09-11T22:15:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.859+0000 7fd16d046640 1 -- 172.21.15.50:0/2351639864 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1600078e0 con 0x7fd1680d3c00 2024-09-11T22:15:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.859+0000 7fd16d046640 1 -- 172.21.15.50:0/2351639864 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd160007cb0 con 0x7fd1680d3c00 2024-09-11T22:15:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.859+0000 7fd1702ac640 1 -- 172.21.15.50:0/2351639864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1680d3c00 msgr2=0x7fd168169420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.859+0000 7fd1702ac640 1 --2- 172.21.15.50:0/2351639864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1680d3c00 0x7fd168169420 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fd160009d90 tx=0x7fd16002a6a0 comp rx=0 tx=0).stop 2024-09-11T22:15:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.860+0000 7fd1702ac640 1 -- 172.21.15.50:0/2351639864 shutdown_connections 2024-09-11T22:15:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.860+0000 7fd1702ac640 1 --2- 172.21.15.50:0/2351639864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1680d3c00 0x7fd168169420 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.860+0000 7fd1702ac640 1 -- 172.21.15.50:0/2351639864 >> 172.21.15.50:0/2351639864 conn(0x7fd1680727a0 msgr2=0x7fd1680679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.860+0000 7fd1702ac640 1 -- 172.21.15.50:0/2351639864 shutdown_connections 2024-09-11T22:15:45.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.860+0000 7fd1702ac640 1 -- 172.21.15.50:0/2351639864 wait complete. 2024-09-11T22:15:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.861+0000 7fd1702ac640 1 Processor -- start 2024-09-11T22:15:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.861+0000 7fd1702ac640 1 -- start start 2024-09-11T22:15:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.861+0000 7fd1702ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1680d18a0 0x7fd168154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.861+0000 7fd1702ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1680d3c00 0x7fd16815f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.861+0000 7fd1702ac640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd16815e870 0x7fd16815fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.861+0000 7fd1702ac640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1680b78b0 con 0x7fd1680d18a0 2024-09-11T22:15:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.861+0000 7fd1702ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd16815ec50 con 0x7fd1680d3c00 2024-09-11T22:15:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.861+0000 7fd1702ac640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1680b9410 con 0x7fd16815e870 2024-09-11T22:15:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd16e048640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1680d18a0 0x7fd168154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd16e048640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1680d18a0 0x7fd168154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39298/0 (socket says 172.21.15.50:39298) 2024-09-11T22:15:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd16e048640 1 -- 172.21.15.50:0/1793507199 learned_addr learned my addr 172.21.15.50:0/1793507199 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd16e849640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd16815e870 0x7fd16815fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd16d847640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1680d3c00 0x7fd16815f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd16e048640 1 -- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd16815e870 msgr2=0x7fd16815fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd16e048640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd16815e870 0x7fd16815fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd16e048640 1 -- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1680d3c00 msgr2=0x7fd16815f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd16e048640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1680d3c00 0x7fd16815f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd16e048640 1 -- 172.21.15.50:0/1793507199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd168156390 con 0x7fd1680d18a0 2024-09-11T22:15:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd16e048640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1680d18a0 0x7fd168154480 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fd16400b3f0 tx=0x7fd16400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd15effd640 1 -- 172.21.15.50:0/1793507199 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd164015020 con 0x7fd1680d18a0 2024-09-11T22:15:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd15effd640 1 -- 172.21.15.50:0/1793507199 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd164011830 con 0x7fd1680d18a0 2024-09-11T22:15:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd1702ac640 1 -- 172.21.15.50:0/1793507199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1681f8380 con 0x7fd1680d18a0 2024-09-11T22:15:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd15effd640 1 -- 172.21.15.50:0/1793507199 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd164011c20 con 0x7fd1680d18a0 2024-09-11T22:15:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.862+0000 7fd1702ac640 1 -- 172.21.15.50:0/1793507199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1681f8940 con 0x7fd1680d18a0 2024-09-11T22:15:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.863+0000 7fd1702ac640 1 -- 172.21.15.50:0/1793507199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1680d34f0 con 0x7fd1680d18a0 2024-09-11T22:15:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.864+0000 7fd15effd640 1 -- 172.21.15.50:0/1793507199 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd164018020 con 0x7fd1680d18a0 2024-09-11T22:15:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.864+0000 7fd15effd640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd14c06be30 0x7fd14c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.864+0000 7fd15effd640 1 -- 172.21.15.50:0/1793507199 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 4857+0+0 (secure 0 0 0) 0x7fd16408aa80 con 0x7fd1680d18a0 2024-09-11T22:15:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.865+0000 7fd16d847640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd14c06be30 0x7fd14c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.865+0000 7fd16d847640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd14c06be30 0x7fd14c06e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd1680b32d0 tx=0x7fd158009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:45.869+0000 7fd15effd640 1 -- 172.21.15.50:0/1793507199 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd16401f020 con 0x7fd1680d18a0 2024-09-11T22:15:46.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.111+0000 7fd1702ac640 1 -- 172.21.15.50:0/1793507199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd168161ee0 con 0x7fd1680d18a0 2024-09-11T22:15:46.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.111+0000 7fd15effd640 1 -- 172.21.15.50:0/1793507199 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7fd168156390 con 0x7fd1680d18a0 2024-09-11T22:15:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:46.112 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:15:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-11T22:15:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-11T22:15:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w==", 2024-09-11T22:15:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:15:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:15:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-11T22:15:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg==", 2024-09-11T22:15:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:15:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:15:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-11T22:15:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ==", 2024-09-11T22:15:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:15:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:15:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-11T22:15:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw==", 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg==", 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-11T22:15:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ==", 2024-09-11T22:15:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-11T22:15:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg==", 2024-09-11T22:15:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-11T22:15:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg==", 2024-09-11T22:15:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-11T22:15:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A==", 2024-09-11T22:15:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-11T22:15:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw==", 2024-09-11T22:15:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-11T22:15:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A==", 2024-09-11T22:15:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-11T22:15:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw==", 2024-09-11T22:15:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:15:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:15:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-11T22:15:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew==", 2024-09-11T22:15:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-11T22:15:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T22:15:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw==", 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg==", 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:15:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:15:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:15:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-11T22:15:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw==", 2024-09-11T22:15:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:15:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:15:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:15:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:15:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-11T22:15:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBFFeJmAq9+OBAAANc9KfDvm3+wt/uED7WCvA==", 2024-09-11T22:15:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:15:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:15:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:15:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-11T22:15:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g==", 2024-09-11T22:15:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:15:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:15:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:15:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-11T22:15:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg==", 2024-09-11T22:15:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:15:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:15:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:15:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:15:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-11T22:15:46.127 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:15:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.113+0000 7fd1702ac640 1 -- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd14c06be30 msgr2=0x7fd14c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.113+0000 7fd1702ac640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd14c06be30 0x7fd14c06e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd1680b32d0 tx=0x7fd158009040 comp rx=0 tx=0).stop 2024-09-11T22:15:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.113+0000 7fd1702ac640 1 -- 172.21.15.50:0/1793507199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1680d18a0 msgr2=0x7fd168154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.113+0000 7fd1702ac640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1680d18a0 0x7fd168154480 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fd16400b3f0 tx=0x7fd16400b8b0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.113+0000 7fd1702ac640 1 -- 172.21.15.50:0/1793507199 shutdown_connections 2024-09-11T22:15:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.113+0000 7fd1702ac640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd14c06be30 0x7fd14c06e2f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.113+0000 7fd1702ac640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd16815e870 0x7fd16815fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.113+0000 7fd1702ac640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1680d3c00 0x7fd16815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.113+0000 7fd1702ac640 1 --2- 172.21.15.50:0/1793507199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1680d18a0 0x7fd168154480 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.113+0000 7fd1702ac640 1 -- 172.21.15.50:0/1793507199 >> 172.21.15.50:0/1793507199 conn(0x7fd1680727a0 msgr2=0x7fd1680679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.113+0000 7fd1702ac640 1 -- 172.21.15.50:0/1793507199 shutdown_connections 2024-09-11T22:15:46.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.113+0000 7fd1702ac640 1 -- 172.21.15.50:0/1793507199 wait complete. 2024-09-11T22:15:46.130 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:15:46.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.232+0000 7fb16e978640 1 Processor -- start 2024-09-11T22:15:46.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.232+0000 7fb16e978640 1 -- start start 2024-09-11T22:15:46.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.233+0000 7fb16e978640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb168161fa0 0x7fb1680b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:46.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.233+0000 7fb16e978640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1680cfbd0 con 0x7fb1680b1600 2024-09-11T22:15:46.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.233+0000 7fb16e978640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1680cfeb0 con 0x7fb1680cf610 2024-09-11T22:15:46.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.233+0000 7fb16e978640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb1680d1220 con 0x7fb168161fa0 2024-09-11T22:15:46.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.233+0000 7fb15ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb1680b1600 0x7fb1680cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37042/0 (socket says 172.21.15.50:37042) 2024-09-11T22:15:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.233+0000 7fb15ffff640 1 -- 172.21.15.50:0/242562194 learned_addr learned my addr 172.21.15.50:0/242562194 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.233+0000 7fb167fff640 1 --2- 172.21.15.50:0/242562194 >> v2:172.21.15.77:3300/0 conn(0x7fb168161fa0 0x7fb1680b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.233+0000 7fb1677fe640 1 -- 172.21.15.50:0/242562194 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186222461 0 0) 0x7fb1680cfbd0 con 0x7fb1680b1600 2024-09-11T22:15:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.233+0000 7fb1677fe640 1 -- 172.21.15.50:0/242562194 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb154003520 con 0x7fb1680b1600 2024-09-11T22:15:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.233+0000 7fb1677fe640 1 -- 172.21.15.50:0/242562194 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4023865695 0 0) 0x7fb1680cfeb0 con 0x7fb1680cf610 2024-09-11T22:15:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.234+0000 7fb1677fe640 1 -- 172.21.15.50:0/242562194 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1680cfbd0 con 0x7fb1680cf610 2024-09-11T22:15:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.234+0000 7fb1677fe640 1 -- 172.21.15.50:0/242562194 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3207327277 0 0) 0x7fb154003520 con 0x7fb1680b1600 2024-09-11T22:15:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.234+0000 7fb167fff640 1 -- 172.21.15.50:0/242562194 >> v1:172.21.15.77:6789/0 conn(0x7fb1680cf610 legacy=0x7fb1680cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.234+0000 7fb167fff640 1 -- 172.21.15.50:0/242562194 >> v1:172.21.15.50:6789/0 conn(0x7fb1680b1600 legacy=0x7fb1680cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.234+0000 7fb167fff640 1 -- 172.21.15.50:0/242562194 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1680d1470 con 0x7fb168161fa0 2024-09-11T22:15:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.234+0000 7fb167fff640 1 --2- 172.21.15.50:0/242562194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb168161fa0 0x7fb1680b4d20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb1580097a0 tx=0x7fb15802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db252fd4603d0234 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.235+0000 7fb1677fe640 1 -- 172.21.15.50:0/242562194 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb158037070 con 0x7fb168161fa0 2024-09-11T22:15:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.235+0000 7fb1677fe640 1 -- 172.21.15.50:0/242562194 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15802ac50 con 0x7fb168161fa0 2024-09-11T22:15:46.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.235+0000 7fb1677fe640 1 -- 172.21.15.50:0/242562194 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150001670 con 0x7fb168161fa0 2024-09-11T22:15:46.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.235+0000 7fb16e978640 1 -- 172.21.15.50:0/242562194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb168161fa0 msgr2=0x7fb1680b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:46.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.235+0000 7fb16e978640 1 --2- 172.21.15.50:0/242562194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb168161fa0 0x7fb1680b4d20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb1580097a0 tx=0x7fb15802a1c0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.235+0000 7fb16e978640 1 -- 172.21.15.50:0/242562194 shutdown_connections 2024-09-11T22:15:46.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.235+0000 7fb16e978640 1 --2- 172.21.15.50:0/242562194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb168161fa0 0x7fb1680b4d20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.235+0000 7fb16e978640 1 -- 172.21.15.50:0/242562194 >> 172.21.15.50:0/242562194 conn(0x7fb16809ba50 msgr2=0x7fb1680b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.235+0000 7fb16e978640 1 -- 172.21.15.50:0/242562194 shutdown_connections 2024-09-11T22:15:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.235+0000 7fb16e978640 1 -- 172.21.15.50:0/242562194 wait complete. 2024-09-11T22:15:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.236+0000 7fb16e978640 1 Processor -- start 2024-09-11T22:15:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.236+0000 7fb16e978640 1 -- start start 2024-09-11T22:15:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.237+0000 7fb16e978640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1680b1600 0x7fb1680cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.237+0000 7fb16e978640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1680cf610 0x7fb1680b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.237+0000 7fb16e978640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb168161fa0 0x7fb1681f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.237+0000 7fb16e978640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb1680d1c70 con 0x7fb1680b1600 2024-09-11T22:15:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.237+0000 7fb16e978640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1680d17e0 con 0x7fb168161fa0 2024-09-11T22:15:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.237+0000 7fb16e978640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb1680d1df0 con 0x7fb1680cf610 2024-09-11T22:15:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.237+0000 7fb167fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1680b1600 0x7fb1680cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.237+0000 7fb167fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1680b1600 0x7fb1680cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39312/0 (socket says 172.21.15.50:39312) 2024-09-11T22:15:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.237+0000 7fb167fff640 1 -- 172.21.15.50:0/464011570 learned_addr learned my addr 172.21.15.50:0/464011570 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.237+0000 7fb16cf15640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb168161fa0 0x7fb1681f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.237+0000 7fb15ffff640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1680cf610 0x7fb1680b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.238+0000 7fb167fff640 1 -- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1680cf610 msgr2=0x7fb1680b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.238+0000 7fb167fff640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1680cf610 0x7fb1680b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.238+0000 7fb167fff640 1 -- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb168161fa0 msgr2=0x7fb1681f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.238+0000 7fb167fff640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb168161fa0 0x7fb1681f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.238+0000 7fb167fff640 1 -- 172.21.15.50:0/464011570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1680b7e00 con 0x7fb1680b1600 2024-09-11T22:15:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.238+0000 7fb16cf15640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb168161fa0 0x7fb1681f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.238+0000 7fb15ffff640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1680cf610 0x7fb1680b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.238+0000 7fb167fff640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1680b1600 0x7fb1680cbed0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb158035040 tx=0x7fb1580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.238+0000 7fb1657fa640 1 -- 172.21.15.50:0/464011570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb158040020 con 0x7fb1680b1600 2024-09-11T22:15:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.238+0000 7fb1657fa640 1 -- 172.21.15.50:0/464011570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb158038040 con 0x7fb1680b1600 2024-09-11T22:15:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.238+0000 7fb16e978640 1 -- 172.21.15.50:0/464011570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1680b80e0 con 0x7fb1680b1600 2024-09-11T22:15:46.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.238+0000 7fb1657fa640 1 -- 172.21.15.50:0/464011570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb158037070 con 0x7fb1680b1600 2024-09-11T22:15:46.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.238+0000 7fb16e978640 1 -- 172.21.15.50:0/464011570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb168150800 con 0x7fb1680b1600 2024-09-11T22:15:46.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.239+0000 7fb16e978640 1 -- 172.21.15.50:0/464011570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1680b4d20 con 0x7fb1680b1600 2024-09-11T22:15:46.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.239+0000 7fb1657fa640 1 -- 172.21.15.50:0/464011570 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb158043020 con 0x7fb1680b1600 2024-09-11T22:15:46.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.240+0000 7fb1657fa640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb14806be30 0x7fb14806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:46.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.240+0000 7fb1657fa640 1 -- 172.21.15.50:0/464011570 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 4857+0+0 (secure 0 0 0) 0x7fb1580aaa20 con 0x7fb1680b1600 2024-09-11T22:15:46.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.240+0000 7fb15ffff640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb14806be30 0x7fb14806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:46.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.241+0000 7fb15ffff640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb14806be30 0x7fb14806e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb1500011e0 tx=0x7fb150009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:46.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.244+0000 7fb1657fa640 1 -- 172.21.15.50:0/464011570 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb15804a030 con 0x7fb1680b1600 2024-09-11T22:15:46.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.420+0000 7fb16e978640 1 -- 172.21.15.50:0/464011570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb1680cef00 con 0x7fb1680b1600 2024-09-11T22:15:46.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.421+0000 7fb1657fa640 1 -- 172.21.15.50:0/464011570 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v85) ==== 84+0+65 (secure 0 0 0) 0x7fb15804c300 con 0x7fb1680b1600 2024-09-11T22:15:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:46.422 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:15:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:15:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:15:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:15:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:15:46.422 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:15:46.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.423+0000 7fb16e978640 1 -- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb14806be30 msgr2=0x7fb14806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:46.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.423+0000 7fb16e978640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb14806be30 0x7fb14806e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb1500011e0 tx=0x7fb150009040 comp rx=0 tx=0).stop 2024-09-11T22:15:46.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.423+0000 7fb16e978640 1 -- 172.21.15.50:0/464011570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1680b1600 msgr2=0x7fb1680cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:46.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.423+0000 7fb16e978640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1680b1600 0x7fb1680cbed0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb158035040 tx=0x7fb1580046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.423+0000 7fb16e978640 1 -- 172.21.15.50:0/464011570 shutdown_connections 2024-09-11T22:15:46.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.423+0000 7fb16e978640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb14806be30 0x7fb14806e2f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.423+0000 7fb16e978640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1680cf610 0x7fb1680b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.423+0000 7fb16e978640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb168161fa0 0x7fb1681f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.423+0000 7fb16e978640 1 --2- 172.21.15.50:0/464011570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1680b1600 0x7fb1680cbed0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.423+0000 7fb16e978640 1 -- 172.21.15.50:0/464011570 >> 172.21.15.50:0/464011570 conn(0x7fb16809ba50 msgr2=0x7fb1680b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:46.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.423+0000 7fb16e978640 1 -- 172.21.15.50:0/464011570 shutdown_connections 2024-09-11T22:15:46.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.423+0000 7fb16e978640 1 -- 172.21.15.50:0/464011570 wait complete. 2024-09-11T22:15:46.435 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:15:46.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:15:46.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.541+0000 7fe3561e8640 1 Processor -- start 2024-09-11T22:15:46.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.541+0000 7fe3561e8640 1 -- start start 2024-09-11T22:15:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.541+0000 7fe3561e8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe350161d60 0x7fe3500d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.541+0000 7fe3561e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3500b6e40 0x7fe3500b8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.541+0000 7fe3561e8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3500b7990 con 0x7fe3500d39f0 2024-09-11T22:15:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.541+0000 7fe3561e8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe3500d4530 con 0x7fe350161d60 2024-09-11T22:15:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.541+0000 7fe3561e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe3500d3f70 con 0x7fe3500b6e40 2024-09-11T22:15:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.542+0000 7fe34f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe350161d60 0x7fe3500d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.542+0000 7fe346ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe3500d39f0 0x7fe3500b6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37044/0 (socket says 172.21.15.50:37044) 2024-09-11T22:15:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.542+0000 7fe346ffd640 1 -- 172.21.15.50:0/4242500846 learned_addr learned my addr 172.21.15.50:0/4242500846 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:46.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.542+0000 7fe34ffff640 1 --2- 172.21.15.50:0/4242500846 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3500b6e40 0x7fe3500b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.542+0000 7fe34f7fe640 1 -- 172.21.15.50:0/4242500846 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3500b6e40 msgr2=0x7fe3500b8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.542+0000 7fe34f7fe640 1 --2- 172.21.15.50:0/4242500846 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3500b6e40 0x7fe3500b8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.542+0000 7fe34f7fe640 1 -- 172.21.15.50:0/4242500846 >> v1:172.21.15.50:6789/0 conn(0x7fe3500d39f0 legacy=0x7fe3500b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.542+0000 7fe34f7fe640 1 -- 172.21.15.50:0/4242500846 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3500d4250 con 0x7fe350161d60 2024-09-11T22:15:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.542+0000 7fe34effd640 1 -- 172.21.15.50:0/4242500846 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 506033855 0 0) 0x7fe3500b7990 con 0x7fe3500d39f0 2024-09-11T22:15:46.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.542+0000 7fe34ffff640 1 --2- 172.21.15.50:0/4242500846 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3500b6e40 0x7fe3500b8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.543+0000 7fe34f7fe640 1 --2- 172.21.15.50:0/4242500846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe350161d60 0x7fe3500d34b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fe3400097a0 tx=0x7fe34002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cca252a4374e390 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.543+0000 7fe34effd640 1 -- 172.21.15.50:0/4242500846 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340037070 con 0x7fe350161d60 2024-09-11T22:15:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.543+0000 7fe34effd640 1 -- 172.21.15.50:0/4242500846 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe340032440 con 0x7fe350161d60 2024-09-11T22:15:46.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.543+0000 7fe34effd640 1 -- 172.21.15.50:0/4242500846 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340032810 con 0x7fe350161d60 2024-09-11T22:15:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.543+0000 7fe3561e8640 1 -- 172.21.15.50:0/4242500846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe350161d60 msgr2=0x7fe3500d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.543+0000 7fe3561e8640 1 --2- 172.21.15.50:0/4242500846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe350161d60 0x7fe3500d34b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fe3400097a0 tx=0x7fe34002a180 comp rx=0 tx=0).stop 2024-09-11T22:15:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.543+0000 7fe3561e8640 1 -- 172.21.15.50:0/4242500846 shutdown_connections 2024-09-11T22:15:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.543+0000 7fe3561e8640 1 --2- 172.21.15.50:0/4242500846 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3500b6e40 0x7fe3500b8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.543+0000 7fe3561e8640 1 --2- 172.21.15.50:0/4242500846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe350161d60 0x7fe3500d34b0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.543+0000 7fe3561e8640 1 -- 172.21.15.50:0/4242500846 >> 172.21.15.50:0/4242500846 conn(0x7fe350067db0 msgr2=0x7fe3500681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.543+0000 7fe3561e8640 1 -- 172.21.15.50:0/4242500846 shutdown_connections 2024-09-11T22:15:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.543+0000 7fe3561e8640 1 -- 172.21.15.50:0/4242500846 wait complete. 2024-09-11T22:15:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.545+0000 7fe3561e8640 1 Processor -- start 2024-09-11T22:15:46.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.545+0000 7fe3561e8640 1 -- start start 2024-09-11T22:15:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.545+0000 7fe3561e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3500b6e40 0x7fe3501f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe3561e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3500d39f0 0x7fe350151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe3561e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe350161d60 0x7fe3500b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe3561e8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3500b8690 con 0x7fe350161d60 2024-09-11T22:15:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe3561e8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe3500cf930 con 0x7fe3500b6e40 2024-09-11T22:15:46.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe3561e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe3500b8810 con 0x7fe3500d39f0 2024-09-11T22:15:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe350161d60 0x7fe3500b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe350161d60 0x7fe3500b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39338/0 (socket says 172.21.15.50:39338) 2024-09-11T22:15:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34ffff640 1 -- 172.21.15.50:0/2835647395 learned_addr learned my addr 172.21.15.50:0/2835647395 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34f7fe640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3500b6e40 0x7fe3501f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe346ffd640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3500d39f0 0x7fe350151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34ffff640 1 -- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3500d39f0 msgr2=0x7fe350151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34ffff640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3500d39f0 0x7fe350151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34ffff640 1 -- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3500b6e40 msgr2=0x7fe3501f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34ffff640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3500b6e40 0x7fe3501f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34ffff640 1 -- 172.21.15.50:0/2835647395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3501f5480 con 0x7fe350161d60 2024-09-11T22:15:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34f7fe640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3500b6e40 0x7fe3501f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34ffff640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe350161d60 0x7fe3500b4030 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fe34800cf20 tx=0x7fe34800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:46.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34cff9640 1 -- 172.21.15.50:0/2835647395 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34801a070 con 0x7fe350161d60 2024-09-11T22:15:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34cff9640 1 -- 172.21.15.50:0/2835647395 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34800d840 con 0x7fe350161d60 2024-09-11T22:15:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe34cff9640 1 -- 172.21.15.50:0/2835647395 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34800dc30 con 0x7fe350161d60 2024-09-11T22:15:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe3561e8640 1 -- 172.21.15.50:0/2835647395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe35015aee0 con 0x7fe350161d60 2024-09-11T22:15:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.546+0000 7fe3561e8640 1 -- 172.21.15.50:0/2835647395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3500cd8b0 con 0x7fe350161d60 2024-09-11T22:15:46.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.547+0000 7fe3561e8640 1 -- 172.21.15.50:0/2835647395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3500b8150 con 0x7fe350161d60 2024-09-11T22:15:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.548+0000 7fe34cff9640 1 -- 172.21.15.50:0/2835647395 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe34801d070 con 0x7fe350161d60 2024-09-11T22:15:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.548+0000 7fe34cff9640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe33006be30 0x7fe33006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.548+0000 7fe34cff9640 1 -- 172.21.15.50:0/2835647395 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 4857+0+0 (secure 0 0 0) 0x7fe34808b460 con 0x7fe350161d60 2024-09-11T22:15:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.549+0000 7fe34f7fe640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe33006be30 0x7fe33006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:46.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.549+0000 7fe34f7fe640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe33006be30 0x7fe33006e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe340034000 tx=0x7fe34002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:46.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.552+0000 7fe34cff9640 1 -- 172.21.15.50:0/2835647395 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe34805a0c0 con 0x7fe350161d60 2024-09-11T22:15:46.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:46.728+0000 7fe3561e8640 1 -- 172.21.15.50:0/2835647395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe3500684a0 con 0x7fe350161d60 2024-09-11T22:15:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.732+0000 7fe34cff9640 1 -- 172.21.15.50:0/2835647395 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v86) ==== 138+0+0 (secure 0 0 0) 0x7fe3480599c0 con 0x7fe350161d60 2024-09-11T22:15:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:15:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.737+0000 7fe3561e8640 1 -- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe33006be30 msgr2=0x7fe33006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.737+0000 7fe3561e8640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe33006be30 0x7fe33006e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe340034000 tx=0x7fe34002e000 comp rx=0 tx=0).stop 2024-09-11T22:15:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.737+0000 7fe3561e8640 1 -- 172.21.15.50:0/2835647395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe350161d60 msgr2=0x7fe3500b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.737+0000 7fe3561e8640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe350161d60 0x7fe3500b4030 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fe34800cf20 tx=0x7fe34800a7d0 comp rx=0 tx=0).stop 2024-09-11T22:15:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.737+0000 7fe3561e8640 1 -- 172.21.15.50:0/2835647395 shutdown_connections 2024-09-11T22:15:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.737+0000 7fe3561e8640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe33006be30 0x7fe33006e2f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.737+0000 7fe3561e8640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3500d39f0 0x7fe350151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.737+0000 7fe3561e8640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe350161d60 0x7fe3500b4030 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.737+0000 7fe3561e8640 1 --2- 172.21.15.50:0/2835647395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3500b6e40 0x7fe3501f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.737+0000 7fe3561e8640 1 -- 172.21.15.50:0/2835647395 >> 172.21.15.50:0/2835647395 conn(0x7fe350067db0 msgr2=0x7fe3500b9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:47.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.737+0000 7fe3561e8640 1 -- 172.21.15.50:0/2835647395 shutdown_connections 2024-09-11T22:15:47.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.737+0000 7fe3561e8640 1 -- 172.21.15.50:0/2835647395 wait complete. 2024-09-11T22:15:47.755 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:15:47.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.870+0000 7fde66a23640 1 Processor -- start 2024-09-11T22:15:47.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.870+0000 7fde66a23640 1 -- start start 2024-09-11T22:15:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde66a23640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde60161fa0 0x7fde600b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde66a23640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde600b1600 0x7fde600cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde66a23640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fde600cf440 0x7fde6006bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde66a23640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fde600d1220 con 0x7fde600b1600 2024-09-11T22:15:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde66a23640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fde600d17e0 con 0x7fde600cf440 2024-09-11T22:15:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde66a23640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fde600cfbd0 con 0x7fde60161fa0 2024-09-11T22:15:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde57fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde600b1600 0x7fde600cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde57fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde600b1600 0x7fde600cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49712/0 (socket says 172.21.15.50:49712) 2024-09-11T22:15:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde57fff640 1 -- 172.21.15.50:0/4016562294 learned_addr learned my addr 172.21.15.50:0/4016562294 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde64fc0640 1 --2- 172.21.15.50:0/4016562294 >> v2:172.21.15.77:3300/0 conn(0x7fde600cf440 0x7fde6006bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde5ffff640 1 --2- 172.21.15.50:0/4016562294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde60161fa0 0x7fde600b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde57fff640 1 -- 172.21.15.50:0/4016562294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde60161fa0 msgr2=0x7fde600b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde57fff640 1 --2- 172.21.15.50:0/4016562294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde60161fa0 0x7fde600b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde57fff640 1 -- 172.21.15.50:0/4016562294 >> v2:172.21.15.77:3300/0 conn(0x7fde600cf440 msgr2=0x7fde6006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde57fff640 1 --2- 172.21.15.50:0/4016562294 >> v2:172.21.15.77:3300/0 conn(0x7fde600cf440 0x7fde6006bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde57fff640 1 -- 172.21.15.50:0/4016562294 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde600cfeb0 con 0x7fde600b1600 2024-09-11T22:15:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde5ffff640 1 --2- 172.21.15.50:0/4016562294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde60161fa0 0x7fde600b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.871+0000 7fde64fc0640 1 --2- 172.21.15.50:0/4016562294 >> v2:172.21.15.77:3300/0 conn(0x7fde600cf440 0x7fde6006bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.872+0000 7fde57fff640 1 --2- 172.21.15.50:0/4016562294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde600b1600 0x7fde600cef00 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fde60073640 tx=0x7fde4802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bd6382caad9060 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.872+0000 7fde5f7fe640 1 -- 172.21.15.50:0/4016562294 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48037070 con 0x7fde600b1600 2024-09-11T22:15:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.872+0000 7fde5f7fe640 1 -- 172.21.15.50:0/4016562294 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde48032440 con 0x7fde600b1600 2024-09-11T22:15:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.872+0000 7fde5f7fe640 1 -- 172.21.15.50:0/4016562294 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48032810 con 0x7fde600b1600 2024-09-11T22:15:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.873+0000 7fde66a23640 1 -- 172.21.15.50:0/4016562294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde600b1600 msgr2=0x7fde600cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.873+0000 7fde66a23640 1 --2- 172.21.15.50:0/4016562294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde600b1600 0x7fde600cef00 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fde60073640 tx=0x7fde4802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:15:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.873+0000 7fde66a23640 1 -- 172.21.15.50:0/4016562294 shutdown_connections 2024-09-11T22:15:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.873+0000 7fde66a23640 1 --2- 172.21.15.50:0/4016562294 >> v2:172.21.15.77:3300/0 conn(0x7fde600cf440 0x7fde6006bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.873+0000 7fde66a23640 1 --2- 172.21.15.50:0/4016562294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde600b1600 0x7fde600cef00 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.873+0000 7fde66a23640 1 --2- 172.21.15.50:0/4016562294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde60161fa0 0x7fde600b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.873+0000 7fde66a23640 1 -- 172.21.15.50:0/4016562294 >> 172.21.15.50:0/4016562294 conn(0x7fde6009ba50 msgr2=0x7fde600b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.873+0000 7fde66a23640 1 -- 172.21.15.50:0/4016562294 shutdown_connections 2024-09-11T22:15:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.873+0000 7fde66a23640 1 -- 172.21.15.50:0/4016562294 wait complete. 2024-09-11T22:15:47.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.874+0000 7fde66a23640 1 Processor -- start 2024-09-11T22:15:47.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.874+0000 7fde66a23640 1 -- start start 2024-09-11T22:15:47.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.875+0000 7fde66a23640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde600b1600 0x7fde60160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:47.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.875+0000 7fde66a23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde600cf440 0x7fde601f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:47.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.875+0000 7fde66a23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde60161fa0 0x7fde600b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.875+0000 7fde66a23640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fde60162380 con 0x7fde600cf440 2024-09-11T22:15:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.875+0000 7fde66a23640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fde600cf8f0 con 0x7fde60161fa0 2024-09-11T22:15:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.875+0000 7fde66a23640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fde60162500 con 0x7fde600b1600 2024-09-11T22:15:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.875+0000 7fde57fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde600cf440 0x7fde601f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.875+0000 7fde57fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde600cf440 0x7fde601f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49728/0 (socket says 172.21.15.50:49728) 2024-09-11T22:15:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.875+0000 7fde57fff640 1 -- 172.21.15.50:0/1494256197 learned_addr learned my addr 172.21.15.50:0/1494256197 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.875+0000 7fde5ffff640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde600b1600 0x7fde60160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.875+0000 7fde64fc0640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde60161fa0 0x7fde600b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.876+0000 7fde57fff640 1 -- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde600b1600 msgr2=0x7fde60160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.876+0000 7fde57fff640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde600b1600 0x7fde60160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.876+0000 7fde57fff640 1 -- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde60161fa0 msgr2=0x7fde600b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.876+0000 7fde57fff640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde60161fa0 0x7fde600b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:47.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.876+0000 7fde57fff640 1 -- 172.21.15.50:0/1494256197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6015fdc0 con 0x7fde600cf440 2024-09-11T22:15:47.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.876+0000 7fde64fc0640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde60161fa0 0x7fde600b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:47.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.876+0000 7fde57fff640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde600cf440 0x7fde601f3c50 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fde48000c00 tx=0x7fde480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:47.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.876+0000 7fde5d7fa640 1 -- 172.21.15.50:0/1494256197 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48041070 con 0x7fde600cf440 2024-09-11T22:15:47.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.876+0000 7fde5d7fa640 1 -- 172.21.15.50:0/1494256197 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4803c870 con 0x7fde600cf440 2024-09-11T22:15:47.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.876+0000 7fde66a23640 1 -- 172.21.15.50:0/1494256197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde60160060 con 0x7fde600cf440 2024-09-11T22:15:47.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.876+0000 7fde5d7fa640 1 -- 172.21.15.50:0/1494256197 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48037040 con 0x7fde600cf440 2024-09-11T22:15:47.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.876+0000 7fde66a23640 1 -- 172.21.15.50:0/1494256197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde60160620 con 0x7fde600cf440 2024-09-11T22:15:47.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.877+0000 7fde66a23640 1 -- 172.21.15.50:0/1494256197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde600d1c70 con 0x7fde600cf440 2024-09-11T22:15:47.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.878+0000 7fde5d7fa640 1 -- 172.21.15.50:0/1494256197 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde48044070 con 0x7fde600cf440 2024-09-11T22:15:47.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.878+0000 7fde5d7fa640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fde4006be60 0x7fde4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:47.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.878+0000 7fde5d7fa640 1 -- 172.21.15.50:0/1494256197 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5227+0+0 (secure 0 0 0) 0x7fde480ab6e0 con 0x7fde600cf440 2024-09-11T22:15:47.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.878+0000 7fde5ffff640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fde4006be60 0x7fde4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:47.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.879+0000 7fde5ffff640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fde4006be60 0x7fde4006e320 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fde5000aa40 tx=0x7fde50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:47.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:47.883+0000 7fde5d7fa640 1 -- 172.21.15.50:0/1494256197 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde48079cb0 con 0x7fde600cf440 2024-09-11T22:15:48.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.060+0000 7fde66a23640 1 -- 172.21.15.50:0/1494256197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fde600a0830 con 0x7fde600cf440 2024-09-11T22:15:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.738+0000 7fde5d7fa640 1 -- 172.21.15.50:0/1494256197 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v87) ==== 170+0+0 (secure 0 0 0) 0x7fde4807dfb0 con 0x7fde600cf440 2024-09-11T22:15:48.739 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:15:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.742+0000 7fde66a23640 1 -- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fde4006be60 msgr2=0x7fde4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.742+0000 7fde66a23640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fde4006be60 0x7fde4006e320 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fde5000aa40 tx=0x7fde50008040 comp rx=0 tx=0).stop 2024-09-11T22:15:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.743+0000 7fde66a23640 1 -- 172.21.15.50:0/1494256197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde600cf440 msgr2=0x7fde601f3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.743+0000 7fde66a23640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde600cf440 0x7fde601f3c50 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fde48000c00 tx=0x7fde480046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.743+0000 7fde66a23640 1 -- 172.21.15.50:0/1494256197 shutdown_connections 2024-09-11T22:15:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.743+0000 7fde66a23640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fde4006be60 0x7fde4006e320 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.743+0000 7fde66a23640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde60161fa0 0x7fde600b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.743+0000 7fde66a23640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde600cf440 0x7fde601f3c50 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.743+0000 7fde66a23640 1 --2- 172.21.15.50:0/1494256197 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde600b1600 0x7fde60160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.743+0000 7fde66a23640 1 -- 172.21.15.50:0/1494256197 >> 172.21.15.50:0/1494256197 conn(0x7fde6009ba50 msgr2=0x7fde600b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.745+0000 7fde66a23640 1 -- 172.21.15.50:0/1494256197 shutdown_connections 2024-09-11T22:15:48.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.746+0000 7fde66a23640 1 -- 172.21.15.50:0/1494256197 wait complete. 2024-09-11T22:15:48.772 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:15:48.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.881+0000 7fd883123640 1 Processor -- start 2024-09-11T22:15:48.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.881+0000 7fd883123640 1 -- start start 2024-09-11T22:15:48.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.882+0000 7fd883123640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd87c15f350 0x7fd87c15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:48.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.882+0000 7fd883123640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd87c15f7f0 con 0x7fd87c15c3c0 2024-09-11T22:15:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.882+0000 7fd883123640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd87c15fad0 con 0x7fd87c0679c0 2024-09-11T22:15:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.882+0000 7fd883123640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd87c06e700 con 0x7fd87c15f350 2024-09-11T22:15:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.882+0000 7fd880ebf640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd87c15c3c0 0x7fd87c15ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44034/0 (socket says 172.21.15.50:44034) 2024-09-11T22:15:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.882+0000 7fd880ebf640 1 -- 172.21.15.50:0/1041129943 learned_addr learned my addr 172.21.15.50:0/1041129943 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.882+0000 7fd87bfff640 1 --2- 172.21.15.50:0/1041129943 >> v2:172.21.15.77:3300/0 conn(0x7fd87c15f350 0x7fd87c15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.882+0000 7fd87b7fe640 1 -- 172.21.15.50:0/1041129943 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 752038872 0 0) 0x7fd87c15f7f0 con 0x7fd87c15c3c0 2024-09-11T22:15:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.882+0000 7fd87b7fe640 1 -- 172.21.15.50:0/1041129943 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd868003520 con 0x7fd87c15c3c0 2024-09-11T22:15:48.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.882+0000 7fd87b7fe640 1 -- 172.21.15.50:0/1041129943 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1470322630 0 0) 0x7fd868003520 con 0x7fd87c15c3c0 2024-09-11T22:15:48.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.882+0000 7fd87bfff640 1 -- 172.21.15.50:0/1041129943 >> v1:172.21.15.77:6789/0 conn(0x7fd87c0679c0 legacy=0x7fd87c06f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:48.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.882+0000 7fd87bfff640 1 -- 172.21.15.50:0/1041129943 >> v1:172.21.15.50:6789/0 conn(0x7fd87c15c3c0 legacy=0x7fd87c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:48.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.882+0000 7fd87bfff640 1 -- 172.21.15.50:0/1041129943 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87c06e950 con 0x7fd87c15f350 2024-09-11T22:15:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.883+0000 7fd87bfff640 1 --2- 172.21.15.50:0/1041129943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c15f350 0x7fd87c15fe60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd864009d90 tx=0x7fd86402a510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5262e6ae6ca3550c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.883+0000 7fd87b7fe640 1 -- 172.21.15.50:0/1041129943 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd864035020 con 0x7fd87c15f350 2024-09-11T22:15:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.883+0000 7fd87b7fe640 1 -- 172.21.15.50:0/1041129943 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd864007540 con 0x7fd87c15f350 2024-09-11T22:15:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.883+0000 7fd87b7fe640 1 -- 172.21.15.50:0/1041129943 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c001670 con 0x7fd87c15f350 2024-09-11T22:15:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.884+0000 7fd883123640 1 -- 172.21.15.50:0/1041129943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c15f350 msgr2=0x7fd87c15fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.884+0000 7fd883123640 1 --2- 172.21.15.50:0/1041129943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c15f350 0x7fd87c15fe60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd864009d90 tx=0x7fd86402a510 comp rx=0 tx=0).stop 2024-09-11T22:15:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.884+0000 7fd883123640 1 -- 172.21.15.50:0/1041129943 shutdown_connections 2024-09-11T22:15:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.884+0000 7fd883123640 1 --2- 172.21.15.50:0/1041129943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c15f350 0x7fd87c15fe60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.884+0000 7fd883123640 1 -- 172.21.15.50:0/1041129943 >> 172.21.15.50:0/1041129943 conn(0x7fd87c075060 msgr2=0x7fd87c06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.884+0000 7fd883123640 1 -- 172.21.15.50:0/1041129943 shutdown_connections 2024-09-11T22:15:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.884+0000 7fd883123640 1 -- 172.21.15.50:0/1041129943 wait complete. 2024-09-11T22:15:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.885+0000 7fd883123640 1 Processor -- start 2024-09-11T22:15:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.885+0000 7fd883123640 1 -- start start 2024-09-11T22:15:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.886+0000 7fd883123640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd87c0679c0 0x7fd87c146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.886+0000 7fd883123640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd87c15c3c0 0x7fd87c1f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.886+0000 7fd883123640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c15f350 0x7fd87c159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.886+0000 7fd883123640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c067e50 con 0x7fd87c15c3c0 2024-09-11T22:15:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.886+0000 7fd883123640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c0d0940 con 0x7fd87c15f350 2024-09-11T22:15:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.886+0000 7fd883123640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd87c067fd0 con 0x7fd87c0679c0 2024-09-11T22:15:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.886+0000 7fd87bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd87c15c3c0 0x7fd87c1f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.886+0000 7fd87bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd87c15c3c0 0x7fd87c1f52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49730/0 (socket says 172.21.15.50:49730) 2024-09-11T22:15:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.886+0000 7fd87bfff640 1 -- 172.21.15.50:0/3562159119 learned_addr learned my addr 172.21.15.50:0/3562159119 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.886+0000 7fd880ebf640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd87c0679c0 0x7fd87c146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.886+0000 7fd8816c0640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c15f350 0x7fd87c159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.887+0000 7fd87bfff640 1 -- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd87c0679c0 msgr2=0x7fd87c146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.887+0000 7fd87bfff640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd87c0679c0 0x7fd87c146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.887+0000 7fd87bfff640 1 -- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c15f350 msgr2=0x7fd87c159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.887+0000 7fd87bfff640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c15f350 0x7fd87c159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.887+0000 7fd87bfff640 1 -- 172.21.15.50:0/3562159119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87c1f4fc0 con 0x7fd87c15c3c0 2024-09-11T22:15:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.887+0000 7fd8816c0640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c15f350 0x7fd87c159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.887+0000 7fd87bfff640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd87c15c3c0 0x7fd87c1f52f0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd864009d90 tx=0x7fd864004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.887+0000 7fd8797fa640 1 -- 172.21.15.50:0/3562159119 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd864040070 con 0x7fd87c15c3c0 2024-09-11T22:15:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.887+0000 7fd8797fa640 1 -- 172.21.15.50:0/3562159119 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd864031c60 con 0x7fd87c15c3c0 2024-09-11T22:15:48.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.887+0000 7fd883123640 1 -- 172.21.15.50:0/3562159119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd87c14fb10 con 0x7fd87c15c3c0 2024-09-11T22:15:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.887+0000 7fd8797fa640 1 -- 172.21.15.50:0/3562159119 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd864035040 con 0x7fd87c15c3c0 2024-09-11T22:15:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.887+0000 7fd883123640 1 -- 172.21.15.50:0/3562159119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd87c1500d0 con 0x7fd87c15c3c0 2024-09-11T22:15:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.888+0000 7fd883123640 1 -- 172.21.15.50:0/3562159119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd87c075820 con 0x7fd87c15c3c0 2024-09-11T22:15:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.889+0000 7fd8797fa640 1 -- 172.21.15.50:0/3562159119 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd864043070 con 0x7fd87c15c3c0 2024-09-11T22:15:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.889+0000 7fd8797fa640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd85c06be60 0x7fd85c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.889+0000 7fd8797fa640 1 -- 172.21.15.50:0/3562159119 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5609+0+0 (secure 0 0 0) 0x7fd8640abb40 con 0x7fd87c15c3c0 2024-09-11T22:15:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.889+0000 7fd880ebf640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd85c06be60 0x7fd85c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:48.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.890+0000 7fd880ebf640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd85c06be60 0x7fd85c06e320 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd86c001eb0 tx=0x7fd86c001c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:48.894+0000 7fd8797fa640 1 -- 172.21.15.50:0/3562159119 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd87c075820 con 0x7fd87c15c3c0 2024-09-11T22:15:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.107+0000 7fd883123640 1 -- 172.21.15.50:0/3562159119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd87c15fe60 con 0x7fd87c15c3c0 2024-09-11T22:15:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.740+0000 7fd8797fa640 1 -- 172.21.15.50:0/3562159119 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v61) ==== 174+0+0 (secure 0 0 0) 0x7fd86407a4c0 con 0x7fd87c15c3c0 2024-09-11T22:15:49.741 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 12 and data pool 13 2024-09-11T22:15:49.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.743+0000 7fd883123640 1 -- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd85c06be60 msgr2=0x7fd85c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.743+0000 7fd883123640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd85c06be60 0x7fd85c06e320 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd86c001eb0 tx=0x7fd86c001c40 comp rx=0 tx=0).stop 2024-09-11T22:15:49.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.744+0000 7fd883123640 1 -- 172.21.15.50:0/3562159119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd87c15c3c0 msgr2=0x7fd87c1f52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.744+0000 7fd883123640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd87c15c3c0 0x7fd87c1f52f0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd864009d90 tx=0x7fd864004a40 comp rx=0 tx=0).stop 2024-09-11T22:15:49.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.744+0000 7fd883123640 1 -- 172.21.15.50:0/3562159119 shutdown_connections 2024-09-11T22:15:49.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.744+0000 7fd883123640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd85c06be60 0x7fd85c06e320 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.744+0000 7fd883123640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c15f350 0x7fd87c159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.744+0000 7fd883123640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd87c15c3c0 0x7fd87c1f52f0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.744+0000 7fd883123640 1 --2- 172.21.15.50:0/3562159119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd87c0679c0 0x7fd87c146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.744+0000 7fd883123640 1 -- 172.21.15.50:0/3562159119 >> 172.21.15.50:0/3562159119 conn(0x7fd87c075060 msgr2=0x7fd87c0b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:49.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.746+0000 7fd883123640 1 -- 172.21.15.50:0/3562159119 shutdown_connections 2024-09-11T22:15:49.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.753+0000 7fd883123640 1 -- 172.21.15.50:0/3562159119 wait complete. 2024-09-11T22:15:49.780 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:15:49.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.885+0000 7f70b9f49640 1 Processor -- start 2024-09-11T22:15:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.885+0000 7f70b9f49640 1 -- start start 2024-09-11T22:15:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b9f49640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70b415c2c0 0x7f70b40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b9f49640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f70b40d05e0 0x7f70b40ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b9f49640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70b40b4f00 con 0x7f70b40b3e10 2024-09-11T22:15:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b9f49640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f70b40b4360 con 0x7f70b415c2c0 2024-09-11T22:15:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b9f49640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f70b40b51c0 con 0x7f70b40d05e0 2024-09-11T22:15:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70b415c2c0 0x7f70b40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f70b40b3e10 0x7f70b40cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44044/0 (socket says 172.21.15.50:44044) 2024-09-11T22:15:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b2ffd640 1 -- 172.21.15.50:0/1860396935 learned_addr learned my addr 172.21.15.50:0/1860396935 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b3fff640 1 --2- 172.21.15.50:0/1860396935 >> v2:172.21.15.77:3300/0 conn(0x7f70b40d05e0 0x7f70b40ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b37fe640 1 -- 172.21.15.50:0/1860396935 >> v2:172.21.15.77:3300/0 conn(0x7f70b40d05e0 msgr2=0x7f70b40ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b37fe640 1 --2- 172.21.15.50:0/1860396935 >> v2:172.21.15.77:3300/0 conn(0x7f70b40d05e0 0x7f70b40ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b37fe640 1 -- 172.21.15.50:0/1860396935 >> v1:172.21.15.50:6789/0 conn(0x7f70b40b3e10 legacy=0x7f70b40cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b27fc640 1 -- 172.21.15.50:0/1860396935 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125269869 0 0) 0x7f70b40b4f00 con 0x7f70b40b3e10 2024-09-11T22:15:49.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.886+0000 7f70b37fe640 1 -- 172.21.15.50:0/1860396935 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b40b54a0 con 0x7f70b415c2c0 2024-09-11T22:15:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.887+0000 7f70b37fe640 1 --2- 172.21.15.50:0/1860396935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b415c2c0 0x7f70b40b46a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f70b40b4260 tx=0x7f70a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcbf5008756d10e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.887+0000 7f70b27fc640 1 -- 172.21.15.50:0/1860396935 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4037070 con 0x7f70b415c2c0 2024-09-11T22:15:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.887+0000 7f70b27fc640 1 -- 172.21.15.50:0/1860396935 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a4032440 con 0x7f70b415c2c0 2024-09-11T22:15:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.887+0000 7f70b27fc640 1 -- 172.21.15.50:0/1860396935 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4032810 con 0x7f70b415c2c0 2024-09-11T22:15:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.888+0000 7f70b9f49640 1 -- 172.21.15.50:0/1860396935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b415c2c0 msgr2=0x7f70b40b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.888+0000 7f70b9f49640 1 --2- 172.21.15.50:0/1860396935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b415c2c0 0x7f70b40b46a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f70b40b4260 tx=0x7f70a402a1a0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.888+0000 7f70b9f49640 1 -- 172.21.15.50:0/1860396935 shutdown_connections 2024-09-11T22:15:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.888+0000 7f70b9f49640 1 --2- 172.21.15.50:0/1860396935 >> v2:172.21.15.77:3300/0 conn(0x7f70b40d05e0 0x7f70b40ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.888+0000 7f70b9f49640 1 --2- 172.21.15.50:0/1860396935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b415c2c0 0x7f70b40b46a0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.888+0000 7f70b9f49640 1 -- 172.21.15.50:0/1860396935 >> 172.21.15.50:0/1860396935 conn(0x7f70b40679c0 msgr2=0x7f70b4067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.888+0000 7f70b9f49640 1 -- 172.21.15.50:0/1860396935 shutdown_connections 2024-09-11T22:15:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.888+0000 7f70b9f49640 1 -- 172.21.15.50:0/1860396935 wait complete. 2024-09-11T22:15:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.889+0000 7f70b9f49640 1 Processor -- start 2024-09-11T22:15:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.889+0000 7f70b9f49640 1 -- start start 2024-09-11T22:15:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b9f49640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b40b3e10 0x7f70b415d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b9f49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b40d05e0 0x7f70b40b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b9f49640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b415c2c0 0x7f70b4145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b9f49640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f70b406d070 con 0x7f70b40d05e0 2024-09-11T22:15:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b9f49640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70b40ce200 con 0x7f70b40b3e10 2024-09-11T22:15:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b9f49640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f70b406d1f0 con 0x7f70b415c2c0 2024-09-11T22:15:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b40d05e0 0x7f70b40b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b40d05e0 0x7f70b40b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49744/0 (socket says 172.21.15.50:49744) 2024-09-11T22:15:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b2ffd640 1 -- 172.21.15.50:0/1938861585 learned_addr learned my addr 172.21.15.50:0/1938861585 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:49.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b37fe640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b40b3e10 0x7f70b415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b3fff640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b415c2c0 0x7f70b4145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b2ffd640 1 -- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b415c2c0 msgr2=0x7f70b4145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b2ffd640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b415c2c0 0x7f70b4145ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b2ffd640 1 -- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b40b3e10 msgr2=0x7f70b415d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b2ffd640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b40b3e10 0x7f70b415d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b2ffd640 1 -- 172.21.15.50:0/1938861585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b415e200 con 0x7f70b40d05e0 2024-09-11T22:15:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.890+0000 7f70b2ffd640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b40d05e0 0x7f70b40b06f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f70a800c4d0 tx=0x7f70a800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.891+0000 7f709bfff640 1 -- 172.21.15.50:0/1938861585 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8018070 con 0x7f70b40d05e0 2024-09-11T22:15:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.891+0000 7f709bfff640 1 -- 172.21.15.50:0/1938861585 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a8007500 con 0x7f70b40d05e0 2024-09-11T22:15:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.891+0000 7f70b9f49640 1 -- 172.21.15.50:0/1938861585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b415e4e0 con 0x7f70b40d05e0 2024-09-11T22:15:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.891+0000 7f709bfff640 1 -- 172.21.15.50:0/1938861585 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8004a20 con 0x7f70b40d05e0 2024-09-11T22:15:49.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.891+0000 7f70b9f49640 1 -- 172.21.15.50:0/1938861585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b415de40 con 0x7f70b40d05e0 2024-09-11T22:15:49.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.892+0000 7f70b9f49640 1 -- 172.21.15.50:0/1938861585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b415c6a0 con 0x7f70b40d05e0 2024-09-11T22:15:49.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.892+0000 7f709bfff640 1 -- 172.21.15.50:0/1938861585 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70a801b070 con 0x7f70b40d05e0 2024-09-11T22:15:49.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.893+0000 7f709bfff640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f70a006be30 0x7f70a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:49.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.893+0000 7f709bfff640 1 -- 172.21.15.50:0/1938861585 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f70a808a150 con 0x7f70b40d05e0 2024-09-11T22:15:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.893+0000 7f70b37fe640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f70a006be30 0x7f70a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:49.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.894+0000 7f70b37fe640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f70a006be30 0x7f70a006e2f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f70a4034000 tx=0x7f70a402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:49.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:49.897+0000 7f709bfff640 1 -- 172.21.15.50:0/1938861585 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70a8058b90 con 0x7f70b40d05e0 2024-09-11T22:15:50.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.074+0000 7f70b9f49640 1 -- 172.21.15.50:0/1938861585 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70b40b39d0 con 0x7f70b40d05e0 2024-09-11T22:15:50.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.075+0000 7f709bfff640 1 -- 172.21.15.50:0/1938861585 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+16697 (secure 0 0 0) 0x7f70a8058490 con 0x7f70b40d05e0 2024-09-11T22:15:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:50.077 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":88,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:15:49.108566+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:15:46.760927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T22:15:48.092105+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:15:50.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.077+0000 7f70b9f49640 1 -- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f70a006be30 msgr2=0x7f70a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.077+0000 7f70b9f49640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f70a006be30 0x7f70a006e2f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f70a4034000 tx=0x7f70a402e000 comp rx=0 tx=0).stop 2024-09-11T22:15:50.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.077+0000 7f70b9f49640 1 -- 172.21.15.50:0/1938861585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b40d05e0 msgr2=0x7f70b40b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.077+0000 7f70b9f49640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b40d05e0 0x7f70b40b06f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f70a800c4d0 tx=0x7f70a800c990 comp rx=0 tx=0).stop 2024-09-11T22:15:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.077+0000 7f70b9f49640 1 -- 172.21.15.50:0/1938861585 shutdown_connections 2024-09-11T22:15:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.077+0000 7f70b9f49640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f70a006be30 0x7f70a006e2f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.077+0000 7f70b9f49640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b415c2c0 0x7f70b4145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.077+0000 7f70b9f49640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b40d05e0 0x7f70b40b06f0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.077+0000 7f70b9f49640 1 --2- 172.21.15.50:0/1938861585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b40b3e10 0x7f70b415d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.077+0000 7f70b9f49640 1 -- 172.21.15.50:0/1938861585 >> 172.21.15.50:0/1938861585 conn(0x7f70b40679c0 msgr2=0x7f70b40b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.078+0000 7f70b9f49640 1 -- 172.21.15.50:0/1938861585 shutdown_connections 2024-09-11T22:15:50.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.078+0000 7f70b9f49640 1 -- 172.21.15.50:0/1938861585 wait complete. 2024-09-11T22:15:50.090 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:15:50.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.191+0000 7f21d080a640 1 Processor -- start 2024-09-11T22:15:50.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.192+0000 7f21d080a640 1 -- start start 2024-09-11T22:15:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.192+0000 7f21d080a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21cc15e870 0x7f21cc0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.192+0000 7f21d080a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21cc0d3c00 0x7f21cc0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.192+0000 7f21d080a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21cc0cfa80 con 0x7f21cc0d16d0 2024-09-11T22:15:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.192+0000 7f21d080a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f21cc0d1b10 con 0x7f21cc0d3c00 2024-09-11T22:15:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.192+0000 7f21d080a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f21cc0d40d0 con 0x7f21cc15e870 2024-09-11T22:15:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.193+0000 7f21cad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21cc0d3c00 0x7f21cc0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.193+0000 7f21cad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21cc0d3c00 0x7f21cc0b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49758/0 (socket says 172.21.15.50:49758) 2024-09-11T22:15:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.193+0000 7f21cad9d640 1 -- 172.21.15.50:0/2145382789 learned_addr learned my addr 172.21.15.50:0/2145382789 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.193+0000 7f21ca59c640 1 --2- 172.21.15.50:0/2145382789 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21cc15e870 0x7f21cc0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.193+0000 7f21cad9d640 1 -- 172.21.15.50:0/2145382789 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21cc15e870 msgr2=0x7f21cc0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.193+0000 7f21cad9d640 1 --2- 172.21.15.50:0/2145382789 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21cc15e870 0x7f21cc0d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.193+0000 7f21cad9d640 1 -- 172.21.15.50:0/2145382789 >> v1:172.21.15.77:6789/0 conn(0x7f21cc0d16d0 legacy=0x7f21cc0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.193+0000 7f21cad9d640 1 -- 172.21.15.50:0/2145382789 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21cc0d43b0 con 0x7f21cc0d3c00 2024-09-11T22:15:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.194+0000 7f21cad9d640 1 --2- 172.21.15.50:0/2145382789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0d3c00 0x7f21cc0b8400 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009870 tx=0x7f21bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231a6c38ab082ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.194+0000 7f21c959a640 1 -- 172.21.15.50:0/2145382789 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc037070 con 0x7f21cc0d3c00 2024-09-11T22:15:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.194+0000 7f21c959a640 1 -- 172.21.15.50:0/2145382789 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21bc032440 con 0x7f21cc0d3c00 2024-09-11T22:15:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.194+0000 7f21c959a640 1 -- 172.21.15.50:0/2145382789 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc032810 con 0x7f21cc0d3c00 2024-09-11T22:15:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.194+0000 7f21d080a640 1 -- 172.21.15.50:0/2145382789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0d3c00 msgr2=0x7f21cc0b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.195+0000 7f21d080a640 1 --2- 172.21.15.50:0/2145382789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0d3c00 0x7f21cc0b8400 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009870 tx=0x7f21bc02a270 comp rx=0 tx=0).stop 2024-09-11T22:15:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.195+0000 7f21d080a640 1 -- 172.21.15.50:0/2145382789 shutdown_connections 2024-09-11T22:15:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.195+0000 7f21d080a640 1 --2- 172.21.15.50:0/2145382789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0d3c00 0x7f21cc0b8400 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.195+0000 7f21d080a640 1 --2- 172.21.15.50:0/2145382789 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21cc15e870 0x7f21cc0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.195+0000 7f21d080a640 1 -- 172.21.15.50:0/2145382789 >> 172.21.15.50:0/2145382789 conn(0x7f21cc0727a0 msgr2=0x7f21cc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.195+0000 7f21d080a640 1 -- 172.21.15.50:0/2145382789 shutdown_connections 2024-09-11T22:15:50.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.195+0000 7f21d080a640 1 -- 172.21.15.50:0/2145382789 wait complete. 2024-09-11T22:15:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.196+0000 7f21d080a640 1 Processor -- start 2024-09-11T22:15:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.196+0000 7f21d080a640 1 -- start start 2024-09-11T22:15:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21d080a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21cc0d16d0 0x7f21cc159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21d080a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21cc0d3c00 0x7f21cc1f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21d080a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc15e870 0x7f21cc154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21d080a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc15ec50 con 0x7f21cc15e870 2024-09-11T22:15:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21d080a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc0b7ee0 con 0x7f21cc0d16d0 2024-09-11T22:15:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21d080a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f21cc0b78b0 con 0x7f21cc0d3c00 2024-09-11T22:15:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21cad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc15e870 0x7f21cc154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21cad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc15e870 0x7f21cc154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49762/0 (socket says 172.21.15.50:49762) 2024-09-11T22:15:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21cad9d640 1 -- 172.21.15.50:0/2533910779 learned_addr learned my addr 172.21.15.50:0/2533910779 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21ca59c640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21cc0d16d0 0x7f21cc159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21c9d9b640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21cc0d3c00 0x7f21cc1f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21cad9d640 1 -- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21cc0d3c00 msgr2=0x7f21cc1f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21cad9d640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21cc0d3c00 0x7f21cc1f80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21cad9d640 1 -- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21cc0d16d0 msgr2=0x7f21cc159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21cad9d640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21cc0d16d0 0x7f21cc159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21cad9d640 1 -- 172.21.15.50:0/2533910779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21cc159b90 con 0x7f21cc15e870 2024-09-11T22:15:50.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.197+0000 7f21cad9d640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc15e870 0x7f21cc154880 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009870 tx=0x7f21bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:50.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.198+0000 7f21c2ffd640 1 -- 172.21.15.50:0/2533910779 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc037040 con 0x7f21cc15e870 2024-09-11T22:15:50.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.198+0000 7f21c2ffd640 1 -- 172.21.15.50:0/2533910779 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21bc042070 con 0x7f21cc15e870 2024-09-11T22:15:50.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.198+0000 7f21d080a640 1 -- 172.21.15.50:0/2533910779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21cc159e70 con 0x7f21cc15e870 2024-09-11T22:15:50.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.198+0000 7f21c2ffd640 1 -- 172.21.15.50:0/2533910779 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc030920 con 0x7f21cc15e870 2024-09-11T22:15:50.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.198+0000 7f21d080a640 1 -- 172.21.15.50:0/2533910779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21cc1598a0 con 0x7f21cc15e870 2024-09-11T22:15:50.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.199+0000 7f21d080a640 1 -- 172.21.15.50:0/2533910779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21cc0b8400 con 0x7f21cc15e870 2024-09-11T22:15:50.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.199+0000 7f21c2ffd640 1 -- 172.21.15.50:0/2533910779 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21bc030ac0 con 0x7f21cc15e870 2024-09-11T22:15:50.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.199+0000 7f21c2ffd640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f21ac06be30 0x7f21ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.200+0000 7f21c2ffd640 1 -- 172.21.15.50:0/2533910779 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f21bc0ab580 con 0x7f21cc15e870 2024-09-11T22:15:50.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.200+0000 7f21ca59c640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f21ac06be30 0x7f21ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.200+0000 7f21ca59c640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f21ac06be30 0x7f21ac06e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f21c4003b80 tx=0x7f21c40098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:50.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.204+0000 7f21c2ffd640 1 -- 172.21.15.50:0/2533910779 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21bc079970 con 0x7f21cc15e870 2024-09-11T22:15:50.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.381+0000 7f21d080a640 1 -- 172.21.15.50:0/2533910779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21cc0ba1f0 con 0x7f21cc15e870 2024-09-11T22:15:50.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.382+0000 7f21c2ffd640 1 -- 172.21.15.50:0/2533910779 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+16697 (secure 0 0 0) 0x7f21bc07dc70 con 0x7f21cc15e870 2024-09-11T22:15:50.383 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:50.383 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":88,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:15:49.108566+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:15:46.760927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T22:15:48.092105+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:15:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.384+0000 7f21d080a640 1 -- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f21ac06be30 msgr2=0x7f21ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.384+0000 7f21d080a640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f21ac06be30 0x7f21ac06e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f21c4003b80 tx=0x7f21c40098d0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.384+0000 7f21d080a640 1 -- 172.21.15.50:0/2533910779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc15e870 msgr2=0x7f21cc154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.384+0000 7f21d080a640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc15e870 0x7f21cc154880 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009870 tx=0x7f21bc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.384+0000 7f21d080a640 1 -- 172.21.15.50:0/2533910779 shutdown_connections 2024-09-11T22:15:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.384+0000 7f21d080a640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f21ac06be30 0x7f21ac06e2f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.384+0000 7f21d080a640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21cc0d3c00 0x7f21cc1f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.384+0000 7f21d080a640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc15e870 0x7f21cc154880 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.384+0000 7f21d080a640 1 --2- 172.21.15.50:0/2533910779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21cc0d16d0 0x7f21cc159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.384+0000 7f21d080a640 1 -- 172.21.15.50:0/2533910779 >> 172.21.15.50:0/2533910779 conn(0x7f21cc0727a0 msgr2=0x7f21cc0b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.384+0000 7f21d080a640 1 -- 172.21.15.50:0/2533910779 shutdown_connections 2024-09-11T22:15:50.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.384+0000 7f21d080a640 1 -- 172.21.15.50:0/2533910779 wait complete. 2024-09-11T22:15:50.396 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:15:50.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.501+0000 7f348b95f640 1 Processor -- start 2024-09-11T22:15:50.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.501+0000 7f348b95f640 1 -- start start 2024-09-11T22:15:50.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.502+0000 7f348b95f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34840cf580 0x7f34840b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.502+0000 7f348b95f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34840ce5f0 con 0x7f348415e840 2024-09-11T22:15:50.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.502+0000 7f348b95f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34840ce310 con 0x7f34840cdd50 2024-09-11T22:15:50.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.502+0000 7f348b95f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f348406c240 con 0x7f34840cf580 2024-09-11T22:15:50.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.502+0000 7f34896fb640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f348415e840 0x7f34840cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44050/0 (socket says 172.21.15.50:44050) 2024-09-11T22:15:50.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.502+0000 7f34896fb640 1 -- 172.21.15.50:0/2555591080 learned_addr learned my addr 172.21.15.50:0/2555591080 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2093355430 0 0) 0x7f34840ce5f0 con 0x7f348415e840 2024-09-11T22:15:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f346c003520 con 0x7f348415e840 2024-09-11T22:15:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3488efa640 1 --2- 172.21.15.50:0/2555591080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34840cf580 0x7f34840b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3190286127 0 0) 0x7f346c003520 con 0x7f348415e840 2024-09-11T22:15:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34840cf580 msgr2=0x7f34840b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 --2- 172.21.15.50:0/2555591080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34840cf580 0x7f34840b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 >> v1:172.21.15.77:6789/0 conn(0x7f34840cdd50 legacy=0x7f348406c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348406bbf0 con 0x7f348415e840 2024-09-11T22:15:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f34740019f0 con 0x7f348415e840 2024-09-11T22:15:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 >> v1:172.21.15.50:6789/0 conn(0x7f348415e840 legacy=0x7f34840cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 --2- 172.21.15.50:0/2555591080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f346c0039e0 0x7f346c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 --2- 172.21.15.50:0/2555591080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34840cf580 0x7f346c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 --2- 172.21.15.50:0/2555591080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f346c004d40 0x7f346c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f348406c240 con 0x7f346c0039e0 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f346c00baa0 con 0x7f346c004d40 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f346c00bca0 con 0x7f34840cf580 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f34896fb640 1 --2- 172.21.15.50:0/2555591080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f346c0039e0 0x7f346c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3488efa640 1 --2- 172.21.15.50:0/2555591080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34840cf580 0x7f346c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f3489efc640 1 --2- 172.21.15.50:0/2555591080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f346c004d40 0x7f346c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f34896fb640 1 -- 172.21.15.50:0/2555591080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34840cf580 msgr2=0x7f346c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f34896fb640 1 --2- 172.21.15.50:0/2555591080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34840cf580 0x7f346c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f34896fb640 1 -- 172.21.15.50:0/2555591080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f346c004d40 msgr2=0x7f346c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.503+0000 7f34896fb640 1 --2- 172.21.15.50:0/2555591080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f346c004d40 0x7f346c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.504+0000 7f34896fb640 1 -- 172.21.15.50:0/2555591080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c003520 con 0x7f346c0039e0 2024-09-11T22:15:50.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.504+0000 7f34896fb640 1 --2- 172.21.15.50:0/2555591080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f346c0039e0 0x7f346c003e00 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f347400a810 tx=0x7f346c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c5ae659f651f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:50.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.504+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347400a460 con 0x7f346c0039e0 2024-09-11T22:15:50.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.504+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f347402f070 con 0x7f346c0039e0 2024-09-11T22:15:50.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.504+0000 7f3483fff640 1 -- 172.21.15.50:0/2555591080 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347402bc90 con 0x7f346c0039e0 2024-09-11T22:15:50.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.505+0000 7f348b95f640 1 -- 172.21.15.50:0/2555591080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f346c0039e0 msgr2=0x7f346c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.505+0000 7f348b95f640 1 --2- 172.21.15.50:0/2555591080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f346c0039e0 0x7f346c003e00 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f347400a810 tx=0x7f346c005830 comp rx=0 tx=0).stop 2024-09-11T22:15:50.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.505+0000 7f3489efc640 1 -- 172.21.15.50:0/2555591080 reap_dead start 2024-09-11T22:15:50.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.505+0000 7f348b95f640 1 -- 172.21.15.50:0/2555591080 shutdown_connections 2024-09-11T22:15:50.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.505+0000 7f348b95f640 1 -- 172.21.15.50:0/2555591080 >> 172.21.15.50:0/2555591080 conn(0x7f34840b4150 msgr2=0x7f34840b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:50.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.505+0000 7f348b95f640 1 -- 172.21.15.50:0/2555591080 shutdown_connections 2024-09-11T22:15:50.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.505+0000 7f348b95f640 1 -- 172.21.15.50:0/2555591080 wait complete. 2024-09-11T22:15:50.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.506+0000 7f348b95f640 1 Processor -- start 2024-09-11T22:15:50.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.506+0000 7f348b95f640 1 -- start start 2024-09-11T22:15:50.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f348b95f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f346c0039e0 0x7f34840c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f348b95f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34840c71c0 0x7f34840b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f348b95f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34840b6ad0 0x7f34841f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f348b95f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f348415ec20 con 0x7f34840c71c0 2024-09-11T22:15:50.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f348b95f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f34840d0470 con 0x7f34840b6ad0 2024-09-11T22:15:50.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f348b95f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f348415eda0 con 0x7f346c0039e0 2024-09-11T22:15:50.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f3488efa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34840c71c0 0x7f34840b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f3488efa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34840c71c0 0x7f34840b6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49774/0 (socket says 172.21.15.50:49774) 2024-09-11T22:15:50.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f3488efa640 1 -- 172.21.15.50:0/104110506 learned_addr learned my addr 172.21.15.50:0/104110506 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:50.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f34896fb640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f346c0039e0 0x7f34840c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f3489efc640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34840b6ad0 0x7f34841f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f3488efa640 1 -- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f346c0039e0 msgr2=0x7f34840c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f3488efa640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f346c0039e0 0x7f34840c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f3488efa640 1 -- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34840b6ad0 msgr2=0x7f34841f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f3488efa640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34840b6ad0 0x7f34841f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f3488efa640 1 -- 172.21.15.50:0/104110506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34840b54f0 con 0x7f34840c71c0 2024-09-11T22:15:50.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.507+0000 7f3489efc640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34840b6ad0 0x7f34841f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:50.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.508+0000 7f3488efa640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34840c71c0 0x7f34840b6590 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3478011960 tx=0x7f3478011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:50.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.508+0000 7f3481ffb640 1 -- 172.21.15.50:0/104110506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478019070 con 0x7f34840c71c0 2024-09-11T22:15:50.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.508+0000 7f3481ffb640 1 -- 172.21.15.50:0/104110506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3478004300 con 0x7f34840c71c0 2024-09-11T22:15:50.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.508+0000 7f3481ffb640 1 -- 172.21.15.50:0/104110506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347800fa20 con 0x7f34840c71c0 2024-09-11T22:15:50.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.508+0000 7f348b95f640 1 -- 172.21.15.50:0/104110506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34840b57d0 con 0x7f34840c71c0 2024-09-11T22:15:50.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.508+0000 7f348b95f640 1 -- 172.21.15.50:0/104110506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34840b5d90 con 0x7f34840c71c0 2024-09-11T22:15:50.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.509+0000 7f348b95f640 1 -- 172.21.15.50:0/104110506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34840cce20 con 0x7f34840c71c0 2024-09-11T22:15:50.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.509+0000 7f3481ffb640 1 -- 172.21.15.50:0/104110506 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f347801c070 con 0x7f34840c71c0 2024-09-11T22:15:50.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.510+0000 7f3481ffb640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f347006be30 0x7f347006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.510+0000 7f3481ffb640 1 -- 172.21.15.50:0/104110506 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f347808b180 con 0x7f34840c71c0 2024-09-11T22:15:50.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.510+0000 7f34896fb640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f347006be30 0x7f347006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.511+0000 7f34896fb640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f347006be30 0x7f347006e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3474033000 tx=0x7f3474007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:50.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.514+0000 7f3481ffb640 1 -- 172.21.15.50:0/104110506 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34840cce20 con 0x7f34840c71c0 2024-09-11T22:15:50.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.724+0000 7f348b95f640 1 -- 172.21.15.50:0/104110506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f34840b4c70 con 0x7f34840c71c0 2024-09-11T22:15:50.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.755+0000 7f3481ffb640 1 -- 172.21.15.50:0/104110506 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v62) ==== 118+0+0 (secure 0 0 0) 0x7f34780594c0 con 0x7f34840c71c0 2024-09-11T22:15:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.757+0000 7f348b95f640 1 -- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f347006be30 msgr2=0x7f347006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.757+0000 7f348b95f640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f347006be30 0x7f347006e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3474033000 tx=0x7f3474007000 comp rx=0 tx=0).stop 2024-09-11T22:15:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.757+0000 7f348b95f640 1 -- 172.21.15.50:0/104110506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34840c71c0 msgr2=0x7f34840b6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.757+0000 7f348b95f640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34840c71c0 0x7f34840b6590 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3478011960 tx=0x7f3478011e20 comp rx=0 tx=0).stop 2024-09-11T22:15:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.757+0000 7f348b95f640 1 -- 172.21.15.50:0/104110506 shutdown_connections 2024-09-11T22:15:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.757+0000 7f348b95f640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f347006be30 0x7f347006e2f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.757+0000 7f348b95f640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34840b6ad0 0x7f34841f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.757+0000 7f348b95f640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34840c71c0 0x7f34840b6590 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.757+0000 7f348b95f640 1 --2- 172.21.15.50:0/104110506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f346c0039e0 0x7f34840c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.757+0000 7f348b95f640 1 -- 172.21.15.50:0/104110506 >> 172.21.15.50:0/104110506 conn(0x7f34840b4150 msgr2=0x7f34840704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.757+0000 7f348b95f640 1 -- 172.21.15.50:0/104110506 shutdown_connections 2024-09-11T22:15:50.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.757+0000 7f348b95f640 1 -- 172.21.15.50:0/104110506 wait complete. 2024-09-11T22:15:50.769 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:15:50.770 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:15:50.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.874+0000 7fb444d86640 1 Processor -- start 2024-09-11T22:15:50.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.874+0000 7fb444d86640 1 -- start start 2024-09-11T22:15:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.875+0000 7fb444d86640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4400d18e0 0x7fb4400b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.875+0000 7fb444d86640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb440162110 con 0x7fb4400cf790 2024-09-11T22:15:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.875+0000 7fb444d86640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4400cfd70 con 0x7fb440161d30 2024-09-11T22:15:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.875+0000 7fb444d86640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb4400d3450 con 0x7fb4400d18e0 2024-09-11T22:15:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.875+0000 7fb43dd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb4400cf790 0x7fb4400d11d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44062/0 (socket says 172.21.15.50:44062) 2024-09-11T22:15:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.875+0000 7fb43dd9b640 1 -- 172.21.15.50:0/2327150492 learned_addr learned my addr 172.21.15.50:0/2327150492 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:50.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43ed9d640 1 --2- 172.21.15.50:0/2327150492 >> v2:172.21.15.77:3300/0 conn(0x7fb4400d18e0 0x7fb4400b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2852514802 0 0) 0x7fb440162110 con 0x7fb4400cf790 2024-09-11T22:15:50.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb42c003520 con 0x7fb4400cf790 2024-09-11T22:15:50.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3641880613 0 0) 0x7fb42c003520 con 0x7fb4400cf790 2024-09-11T22:15:50.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 >> v2:172.21.15.77:3300/0 conn(0x7fb4400d18e0 msgr2=0x7fb4400b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:50.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 --2- 172.21.15.50:0/2327150492 >> v2:172.21.15.77:3300/0 conn(0x7fb4400d18e0 0x7fb4400b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 >> v1:172.21.15.77:6789/0 conn(0x7fb440161d30 legacy=0x7fb440162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4400d2b20 con 0x7fb4400cf790 2024-09-11T22:15:50.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fb428001670 con 0x7fb4400cf790 2024-09-11T22:15:50.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 >> v1:172.21.15.50:6789/0 conn(0x7fb4400cf790 legacy=0x7fb4400d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 --2- 172.21.15.50:0/2327150492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb42c0039b0 0x7fb42c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 --2- 172.21.15.50:0/2327150492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c004800 0x7fb42c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 --2- 172.21.15.50:0/2327150492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb42c0051c0 0x7fb42c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4400d3450 con 0x7fb42c0039b0 2024-09-11T22:15:50.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c00c060 con 0x7fb42c004800 2024-09-11T22:15:50.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb42c00c260 con 0x7fb42c0051c0 2024-09-11T22:15:50.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43e59c640 1 --2- 172.21.15.50:0/2327150492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb42c0039b0 0x7fb42c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43dd9b640 1 --2- 172.21.15.50:0/2327150492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c004800 0x7fb42c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43ed9d640 1 --2- 172.21.15.50:0/2327150492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb42c0051c0 0x7fb42c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43e59c640 1 -- 172.21.15.50:0/2327150492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb42c0051c0 msgr2=0x7fb42c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:50.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43e59c640 1 --2- 172.21.15.50:0/2327150492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb42c0051c0 0x7fb42c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43e59c640 1 -- 172.21.15.50:0/2327150492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c004800 msgr2=0x7fb42c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:50.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43e59c640 1 --2- 172.21.15.50:0/2327150492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c004800 0x7fb42c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43e59c640 1 -- 172.21.15.50:0/2327150492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c003520 con 0x7fb42c0039b0 2024-09-11T22:15:50.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.876+0000 7fb43ed9d640 1 -- 172.21.15.50:0/2327150492 reap_dead start 2024-09-11T22:15:50.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.877+0000 7fb43e59c640 1 --2- 172.21.15.50:0/2327150492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb42c0039b0 0x7fb42c003dd0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fb430001750 tx=0x7fb42c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febd220eeb1d5cc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:50.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.877+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430001370 con 0x7fb42c0039b0 2024-09-11T22:15:50.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.877+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4300052d0 con 0x7fb42c0039b0 2024-09-11T22:15:50.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.877+0000 7fb43d59a640 1 -- 172.21.15.50:0/2327150492 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43002abe0 con 0x7fb42c0039b0 2024-09-11T22:15:50.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.878+0000 7fb444d86640 1 -- 172.21.15.50:0/2327150492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb42c0039b0 msgr2=0x7fb42c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.878+0000 7fb444d86640 1 --2- 172.21.15.50:0/2327150492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb42c0039b0 0x7fb42c003dd0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fb430001750 tx=0x7fb42c005830 comp rx=0 tx=0).stop 2024-09-11T22:15:50.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.878+0000 7fb444d86640 1 -- 172.21.15.50:0/2327150492 shutdown_connections 2024-09-11T22:15:50.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.878+0000 7fb444d86640 1 --2- 172.21.15.50:0/2327150492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb42c0039b0 0x7fb42c003dd0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.878+0000 7fb444d86640 1 -- 172.21.15.50:0/2327150492 >> 172.21.15.50:0/2327150492 conn(0x7fb4400727a0 msgr2=0x7fb4400679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:50.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.878+0000 7fb444d86640 1 -- 172.21.15.50:0/2327150492 shutdown_connections 2024-09-11T22:15:50.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.878+0000 7fb444d86640 1 -- 172.21.15.50:0/2327150492 wait complete. 2024-09-11T22:15:50.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.879+0000 7fb444d86640 1 Processor -- start 2024-09-11T22:15:50.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.879+0000 7fb444d86640 1 -- start start 2024-09-11T22:15:50.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb444d86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c0039b0 0x7fb4400b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb444d86640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4401f5db0 0x7fb4400b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb444d86640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4400b5150 0x7fb44015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb444d86640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4400b78f0 con 0x7fb4401f5db0 2024-09-11T22:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb444d86640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb4400d30e0 con 0x7fb42c0039b0 2024-09-11T22:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb444d86640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb4400b7a70 con 0x7fb4400b5150 2024-09-11T22:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb43dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4401f5db0 0x7fb4400b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb43dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4401f5db0 0x7fb4400b4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49778/0 (socket says 172.21.15.50:49778) 2024-09-11T22:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb43dd9b640 1 -- 172.21.15.50:0/3753665853 learned_addr learned my addr 172.21.15.50:0/3753665853 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb43e59c640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c0039b0 0x7fb4400b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb43ed9d640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4400b5150 0x7fb44015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb43dd9b640 1 -- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4400b5150 msgr2=0x7fb44015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb43dd9b640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4400b5150 0x7fb44015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb43dd9b640 1 -- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c0039b0 msgr2=0x7fb4400b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb43dd9b640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c0039b0 0x7fb4400b6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.880+0000 7fb43dd9b640 1 -- 172.21.15.50:0/3753665853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4400b58d0 con 0x7fb4401f5db0 2024-09-11T22:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.881+0000 7fb43dd9b640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4401f5db0 0x7fb4400b4c10 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fb4280011e0 tx=0x7fb428007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.881+0000 7fb436ffd640 1 -- 172.21.15.50:0/3753665853 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42800f8e0 con 0x7fb4401f5db0 2024-09-11T22:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.881+0000 7fb436ffd640 1 -- 172.21.15.50:0/3753665853 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb428018070 con 0x7fb4401f5db0 2024-09-11T22:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.881+0000 7fb444d86640 1 -- 172.21.15.50:0/3753665853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4400b55f0 con 0x7fb4401f5db0 2024-09-11T22:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.881+0000 7fb436ffd640 1 -- 172.21.15.50:0/3753665853 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42800fcc0 con 0x7fb4401f5db0 2024-09-11T22:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.881+0000 7fb444d86640 1 -- 172.21.15.50:0/3753665853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4400c8610 con 0x7fb4401f5db0 2024-09-11T22:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.882+0000 7fb444d86640 1 -- 172.21.15.50:0/3753665853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4400b7da0 con 0x7fb4401f5db0 2024-09-11T22:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.882+0000 7fb436ffd640 1 -- 172.21.15.50:0/3753665853 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb42801d460 con 0x7fb4401f5db0 2024-09-11T22:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.883+0000 7fb436ffd640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb42006be30 0x7fb42006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.883+0000 7fb436ffd640 1 -- 172.21.15.50:0/3753665853 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5709+0+0 (secure 0 0 0) 0x7fb42808ada0 con 0x7fb4401f5db0 2024-09-11T22:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.883+0000 7fb43e59c640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb42006be30 0x7fb42006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.884+0000 7fb43e59c640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb42006be30 0x7fb42006e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb430032000 tx=0x7fb43002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:50.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:50.887+0000 7fb436ffd640 1 -- 172.21.15.50:0/3753665853 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb42800fe60 con 0x7fb4401f5db0 2024-09-11T22:15:51.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.105+0000 7fb444d86640 1 -- 172.21.15.50:0/3753665853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb4400d2900 con 0x7fb4401f5db0 2024-09-11T22:15:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.763+0000 7fb436ffd640 1 -- 172.21.15.50:0/3753665853 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v63) ==== 122+0+0 (secure 0 0 0) 0x7fb428059750 con 0x7fb4401f5db0 2024-09-11T22:15:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.765+0000 7fb444d86640 1 -- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb42006be30 msgr2=0x7fb42006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.765+0000 7fb444d86640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb42006be30 0x7fb42006e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb430032000 tx=0x7fb43002e000 comp rx=0 tx=0).stop 2024-09-11T22:15:51.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.765+0000 7fb444d86640 1 -- 172.21.15.50:0/3753665853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4401f5db0 msgr2=0x7fb4400b4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:51.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.765+0000 7fb444d86640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4401f5db0 0x7fb4400b4c10 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fb4280011e0 tx=0x7fb428007720 comp rx=0 tx=0).stop 2024-09-11T22:15:51.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.765+0000 7fb444d86640 1 -- 172.21.15.50:0/3753665853 shutdown_connections 2024-09-11T22:15:51.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.765+0000 7fb444d86640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb42006be30 0x7fb42006e2f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:51.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.765+0000 7fb444d86640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4400b5150 0x7fb44015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:51.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.765+0000 7fb444d86640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4401f5db0 0x7fb4400b4c10 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:51.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.765+0000 7fb444d86640 1 --2- 172.21.15.50:0/3753665853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c0039b0 0x7fb4400b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:51.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.765+0000 7fb444d86640 1 -- 172.21.15.50:0/3753665853 >> 172.21.15.50:0/3753665853 conn(0x7fb4400727a0 msgr2=0x7fb4400cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:51.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.766+0000 7fb444d86640 1 -- 172.21.15.50:0/3753665853 shutdown_connections 2024-09-11T22:15:51.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.766+0000 7fb444d86640 1 -- 172.21.15.50:0/3753665853 wait complete. 2024-09-11T22:15:51.768 INFO:tasks.ceph.mds.b.smithi077.stderr:2024-09-11T22:15:51.767+0000 7f7e6c926640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:15:51.779 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:15:51.779 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:51.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.885+0000 7f20bb503640 1 Processor -- start 2024-09-11T22:15:51.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.885+0000 7f20bb503640 1 -- start start 2024-09-11T22:15:51.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.886+0000 7f20bb503640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20b415e840 0x7f20b40b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:51.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.886+0000 7f20bb503640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f20b40cdd50 0x7f20b40cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:51.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.886+0000 7f20bb503640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f20b40cf3b0 0x7f20b40d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:51.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.886+0000 7f20bb503640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f20b406c240 con 0x7f20b40cdd50 2024-09-11T22:15:51.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.886+0000 7f20bb503640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f20b40d0470 con 0x7f20b40cf3b0 2024-09-11T22:15:51.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.886+0000 7f20bb503640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f20b40ce5f0 con 0x7f20b415e840 2024-09-11T22:15:51.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.886+0000 7f20b8a9e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f20b40cdd50 0x7f20b40cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:51.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.886+0000 7f20b8a9e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f20b40cdd50 0x7f20b40cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49784/0 (socket says 172.21.15.50:49784) 2024-09-11T22:15:51.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.886+0000 7f20b8a9e640 1 -- 172.21.15.50:0/558872079 learned_addr learned my addr 172.21.15.50:0/558872079 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:51.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.887+0000 7f20b9aa0640 1 --2- 172.21.15.50:0/558872079 >> v2:172.21.15.77:3300/0 conn(0x7f20b40cf3b0 0x7f20b40d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:51.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.887+0000 7f20b929f640 1 --2- 172.21.15.50:0/558872079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20b415e840 0x7f20b40b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:51.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.887+0000 7f20b8a9e640 1 -- 172.21.15.50:0/558872079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20b415e840 msgr2=0x7f20b40b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:51.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.887+0000 7f20b8a9e640 1 --2- 172.21.15.50:0/558872079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20b415e840 0x7f20b40b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:51.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.887+0000 7f20b8a9e640 1 -- 172.21.15.50:0/558872079 >> v2:172.21.15.77:3300/0 conn(0x7f20b40cf3b0 msgr2=0x7f20b40d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.887+0000 7f20b8a9e640 1 --2- 172.21.15.50:0/558872079 >> v2:172.21.15.77:3300/0 conn(0x7f20b40cf3b0 0x7f20b40d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.887+0000 7f20b8a9e640 1 -- 172.21.15.50:0/558872079 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b40ce310 con 0x7f20b40cdd50 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.887+0000 7f20b8a9e640 1 --2- 172.21.15.50:0/558872079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b40cdd50 0x7f20b40cee70 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009870 tx=0x7f20a402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a2e67ff10be3f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.888+0000 7f20abfff640 1 -- 172.21.15.50:0/558872079 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4037070 con 0x7f20b40cdd50 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.888+0000 7f20abfff640 1 -- 172.21.15.50:0/558872079 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a4032440 con 0x7f20b40cdd50 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.888+0000 7f20abfff640 1 -- 172.21.15.50:0/558872079 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4032810 con 0x7f20b40cdd50 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.888+0000 7f20bb503640 1 -- 172.21.15.50:0/558872079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b40cdd50 msgr2=0x7f20b40cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.888+0000 7f20bb503640 1 --2- 172.21.15.50:0/558872079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b40cdd50 0x7f20b40cee70 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009870 tx=0x7f20a402a210 comp rx=0 tx=0).stop 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.888+0000 7f20bb503640 1 -- 172.21.15.50:0/558872079 shutdown_connections 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.888+0000 7f20bb503640 1 --2- 172.21.15.50:0/558872079 >> v2:172.21.15.77:3300/0 conn(0x7f20b40cf3b0 0x7f20b40d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.888+0000 7f20bb503640 1 --2- 172.21.15.50:0/558872079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b40cdd50 0x7f20b40cee70 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.888+0000 7f20bb503640 1 --2- 172.21.15.50:0/558872079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20b415e840 0x7f20b40b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.888+0000 7f20bb503640 1 -- 172.21.15.50:0/558872079 >> 172.21.15.50:0/558872079 conn(0x7f20b40b4150 msgr2=0x7f20b40b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:51.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.888+0000 7f20bb503640 1 -- 172.21.15.50:0/558872079 shutdown_connections 2024-09-11T22:15:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.888+0000 7f20bb503640 1 -- 172.21.15.50:0/558872079 wait complete. 2024-09-11T22:15:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.889+0000 7f20bb503640 1 Processor -- start 2024-09-11T22:15:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.889+0000 7f20bb503640 1 -- start start 2024-09-11T22:15:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.890+0000 7f20bb503640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20b40cdd50 0x7f20b415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.890+0000 7f20bb503640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b40cf3b0 0x7f20b40b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.890+0000 7f20bb503640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20b415e840 0x7f20b40d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.890+0000 7f20bb503640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20b415ec20 con 0x7f20b40cf3b0 2024-09-11T22:15:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.890+0000 7f20bb503640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f20b406bed0 con 0x7f20b415e840 2024-09-11T22:15:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.890+0000 7f20bb503640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f20b415eda0 con 0x7f20b40cdd50 2024-09-11T22:15:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.890+0000 7f20b8a9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b40cf3b0 0x7f20b40b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.890+0000 7f20b8a9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b40cf3b0 0x7f20b40b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49788/0 (socket says 172.21.15.50:49788) 2024-09-11T22:15:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.890+0000 7f20b8a9e640 1 -- 172.21.15.50:0/1589413965 learned_addr learned my addr 172.21.15.50:0/1589413965 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:51.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.890+0000 7f20b929f640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20b40cdd50 0x7f20b415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.890+0000 7f20b9aa0640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20b415e840 0x7f20b40d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.891+0000 7f20b8a9e640 1 -- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20b40cdd50 msgr2=0x7f20b415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.891+0000 7f20b8a9e640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20b40cdd50 0x7f20b415cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.891+0000 7f20b8a9e640 1 -- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20b415e840 msgr2=0x7f20b40d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.891+0000 7f20b8a9e640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20b415e840 0x7f20b40d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.891+0000 7f20b8a9e640 1 -- 172.21.15.50:0/1589413965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b40cc5f0 con 0x7f20b40cf3b0 2024-09-11T22:15:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.891+0000 7f20b9aa0640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20b415e840 0x7f20b40d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.891+0000 7f20b8a9e640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b40cf3b0 0x7f20b40b0600 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f20a402a250 tx=0x7f20a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.891+0000 7f20a9ffb640 1 -- 172.21.15.50:0/1589413965 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4041020 con 0x7f20b40cf3b0 2024-09-11T22:15:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.891+0000 7f20a9ffb640 1 -- 172.21.15.50:0/1589413965 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a40306c0 con 0x7f20b40cf3b0 2024-09-11T22:15:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.891+0000 7f20a9ffb640 1 -- 172.21.15.50:0/1589413965 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4037040 con 0x7f20b40cf3b0 2024-09-11T22:15:51.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.891+0000 7f20bb503640 1 -- 172.21.15.50:0/1589413965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b40cc8d0 con 0x7f20b40cf3b0 2024-09-11T22:15:51.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.891+0000 7f20bb503640 1 -- 172.21.15.50:0/1589413965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b40cb900 con 0x7f20b40cf3b0 2024-09-11T22:15:51.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.892+0000 7f20bb503640 1 -- 172.21.15.50:0/1589413965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b40cee70 con 0x7f20b40cf3b0 2024-09-11T22:15:51.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.893+0000 7f20a9ffb640 1 -- 172.21.15.50:0/1589413965 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20a4044020 con 0x7f20b40cf3b0 2024-09-11T22:15:51.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.893+0000 7f20a9ffb640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f209806be30 0x7f209806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:51.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.893+0000 7f20a9ffb640 1 -- 172.21.15.50:0/1589413965 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5709+0+0 (secure 0 0 0) 0x7f20a40ab1d0 con 0x7f20b40cf3b0 2024-09-11T22:15:51.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.893+0000 7f20b929f640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f209806be30 0x7f209806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:51.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.894+0000 7f20b929f640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f209806be30 0x7f209806e2f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f20b00079a0 tx=0x7f20b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:51.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:51.898+0000 7f20a9ffb640 1 -- 172.21.15.50:0/1589413965 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20a404b070 con 0x7f20b40cf3b0 2024-09-11T22:15:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.108+0000 7f20bb503640 1 -- 172.21.15.50:0/1589413965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20b406f750 con 0x7f20b40cf3b0 2024-09-11T22:15:52.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.109+0000 7f20a9ffb640 1 -- 172.21.15.50:0/1589413965 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5225 (secure 0 0 0) 0x7f20a4079c10 con 0x7f20b40cf3b0 2024-09-11T22:15:52.110 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:52.110 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":63,"btime":"2024-09-11T22:15:51:760001+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2316208539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2316208539},{"type":"v1","addr":"172.21.15.77:6837","nonce":2316208539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7101,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2875804357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2875804357},{"type":"v1","addr":"172.21.15.50:6834","nonce":2875804357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7104,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2615352620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2615352620},{"type":"v1","addr":"172.21.15.50:6835","nonce":2615352620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:15:51.106407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7110},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7110":{"gid":7110,"name":"b","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/1549905387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1549905387},{"type":"v1","addr":"172.21.15.77:6836","nonce":1549905387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7110,"qdb_cluster":[7110]},"id":6}]} 2024-09-11T22:15:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 63 2024-09-11T22:15:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.111+0000 7f20bb503640 1 -- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f209806be30 msgr2=0x7f209806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.111+0000 7f20bb503640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f209806be30 0x7f209806e2f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f20b00079a0 tx=0x7f20b0008040 comp rx=0 tx=0).stop 2024-09-11T22:15:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.111+0000 7f20bb503640 1 -- 172.21.15.50:0/1589413965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b40cf3b0 msgr2=0x7f20b40b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.111+0000 7f20bb503640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b40cf3b0 0x7f20b40b0600 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f20a402a250 tx=0x7f20a40046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.111+0000 7f20bb503640 1 -- 172.21.15.50:0/1589413965 shutdown_connections 2024-09-11T22:15:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.111+0000 7f20bb503640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f209806be30 0x7f209806e2f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.111+0000 7f20bb503640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20b415e840 0x7f20b40d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.111+0000 7f20bb503640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20b40cf3b0 0x7f20b40b0600 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.111+0000 7f20bb503640 1 --2- 172.21.15.50:0/1589413965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20b40cdd50 0x7f20b415cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.111+0000 7f20bb503640 1 -- 172.21.15.50:0/1589413965 >> 172.21.15.50:0/1589413965 conn(0x7f20b40b4150 msgr2=0x7f20b40afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.111+0000 7f20bb503640 1 -- 172.21.15.50:0/1589413965 shutdown_connections 2024-09-11T22:15:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.111+0000 7f20bb503640 1 -- 172.21.15.50:0/1589413965 wait complete. 2024-09-11T22:15:52.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:15:52.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.224+0000 7ff1419b7640 1 Processor -- start 2024-09-11T22:15:52.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.224+0000 7ff1419b7640 1 -- start start 2024-09-11T22:15:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff1419b7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff13c0cf790 0x7ff13c0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff1419b7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff13c0d11d0 0x7ff13c0d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff1419b7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff13c162110 con 0x7ff13c161d30 2024-09-11T22:15:52.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff1419b7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff13c0d3450 con 0x7ff13c0cf790 2024-09-11T22:15:52.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff1419b7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff13c0b7e30 con 0x7ff13c0d11d0 2024-09-11T22:15:52.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff13a7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff13c0cf790 0x7ff13c0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff13affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff13c161d30 0x7ff13c162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44076/0 (socket says 172.21.15.50:44076) 2024-09-11T22:15:52.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff13affd640 1 -- 172.21.15.50:0/637517444 learned_addr learned my addr 172.21.15.50:0/637517444 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:52.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff13a7fc640 1 -- 172.21.15.50:0/637517444 >> v2:172.21.15.77:3300/0 conn(0x7ff13c0d11d0 msgr2=0x7ff13c0d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:52.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff13b7fe640 1 --2- 172.21.15.50:0/637517444 >> v2:172.21.15.77:3300/0 conn(0x7ff13c0d11d0 0x7ff13c0d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff139ffb640 1 -- 172.21.15.50:0/637517444 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604688668 0 0) 0x7ff13c162110 con 0x7ff13c161d30 2024-09-11T22:15:52.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff13a7fc640 1 --2- 172.21.15.50:0/637517444 >> v2:172.21.15.77:3300/0 conn(0x7ff13c0d11d0 0x7ff13c0d1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff13a7fc640 1 -- 172.21.15.50:0/637517444 >> v1:172.21.15.50:6789/0 conn(0x7ff13c161d30 legacy=0x7ff13c162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff13a7fc640 1 -- 172.21.15.50:0/637517444 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13c0cfd70 con 0x7ff13c0cf790 2024-09-11T22:15:52.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.225+0000 7ff13b7fe640 1 --2- 172.21.15.50:0/637517444 >> v2:172.21.15.77:3300/0 conn(0x7ff13c0d11d0 0x7ff13c0d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:52.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.226+0000 7ff13a7fc640 1 --2- 172.21.15.50:0/637517444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff13c0cf790 0x7ff13c0b78f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0d28b0 tx=0x7ff13002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eddbcf5a3cc4b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:52.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.226+0000 7ff139ffb640 1 -- 172.21.15.50:0/637517444 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130037070 con 0x7ff13c0cf790 2024-09-11T22:15:52.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.226+0000 7ff139ffb640 1 -- 172.21.15.50:0/637517444 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff130032440 con 0x7ff13c0cf790 2024-09-11T22:15:52.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.226+0000 7ff139ffb640 1 -- 172.21.15.50:0/637517444 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130032810 con 0x7ff13c0cf790 2024-09-11T22:15:52.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.227+0000 7ff1419b7640 1 -- 172.21.15.50:0/637517444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff13c0cf790 msgr2=0x7ff13c0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.227+0000 7ff1419b7640 1 --2- 172.21.15.50:0/637517444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff13c0cf790 0x7ff13c0b78f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0d28b0 tx=0x7ff13002a1a0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.227+0000 7ff1419b7640 1 -- 172.21.15.50:0/637517444 shutdown_connections 2024-09-11T22:15:52.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.227+0000 7ff1419b7640 1 --2- 172.21.15.50:0/637517444 >> v2:172.21.15.77:3300/0 conn(0x7ff13c0d11d0 0x7ff13c0d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.227+0000 7ff1419b7640 1 --2- 172.21.15.50:0/637517444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff13c0cf790 0x7ff13c0b78f0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.227+0000 7ff1419b7640 1 -- 172.21.15.50:0/637517444 >> 172.21.15.50:0/637517444 conn(0x7ff13c0727a0 msgr2=0x7ff13c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:52.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.227+0000 7ff1419b7640 1 -- 172.21.15.50:0/637517444 shutdown_connections 2024-09-11T22:15:52.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.227+0000 7ff1419b7640 1 -- 172.21.15.50:0/637517444 wait complete. 2024-09-11T22:15:52.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.228+0000 7ff1419b7640 1 Processor -- start 2024-09-11T22:15:52.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.228+0000 7ff1419b7640 1 -- start start 2024-09-11T22:15:52.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff1419b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff13c0cf790 0x7ff13c0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff1419b7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff13c0d11d0 0x7ff13c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff1419b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13c161d30 0x7ff13c0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff1419b7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c0d2e00 con 0x7ff13c0cf790 2024-09-11T22:15:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff1419b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c0d1b40 con 0x7ff13c161d30 2024-09-11T22:15:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff1419b7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff13c0d30e0 con 0x7ff13c0d11d0 2024-09-11T22:15:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff13affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff13c0cf790 0x7ff13c0ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff13affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff13c0cf790 0x7ff13c0ab6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49816/0 (socket says 172.21.15.50:49816) 2024-09-11T22:15:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff13affd640 1 -- 172.21.15.50:0/2362445787 learned_addr learned my addr 172.21.15.50:0/2362445787 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff13affd640 1 -- 172.21.15.50:0/2362445787 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff13c0d11d0 msgr2=0x7ff13c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff13affd640 1 --2- 172.21.15.50:0/2362445787 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff13c0d11d0 0x7ff13c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff13affd640 1 -- 172.21.15.50:0/2362445787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13c161d30 msgr2=0x7ff13c0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff13b7fe640 1 --2- 172.21.15.50:0/2362445787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13c161d30 0x7ff13c0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff13affd640 1 --2- 172.21.15.50:0/2362445787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13c161d30 0x7ff13c0cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.229+0000 7ff13affd640 1 -- 172.21.15.50:0/2362445787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13c14da80 con 0x7ff13c0cf790 2024-09-11T22:15:52.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.230+0000 7ff13affd640 1 --2- 172.21.15.50:0/2362445787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff13c0cf790 0x7ff13c0ab6d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00c460 tx=0x7ff12c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:52.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.230+0000 7ff123fff640 1 -- 172.21.15.50:0/2362445787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c0074e0 con 0x7ff13c0cf790 2024-09-11T22:15:52.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.230+0000 7ff123fff640 1 -- 172.21.15.50:0/2362445787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12c0047e0 con 0x7ff13c0cf790 2024-09-11T22:15:52.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.230+0000 7ff1419b7640 1 -- 172.21.15.50:0/2362445787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff13c0b6820 con 0x7ff13c0cf790 2024-09-11T22:15:52.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.230+0000 7ff123fff640 1 -- 172.21.15.50:0/2362445787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c004bd0 con 0x7ff13c0cf790 2024-09-11T22:15:52.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.230+0000 7ff1419b7640 1 -- 172.21.15.50:0/2362445787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff13c0b6b00 con 0x7ff13c0cf790 2024-09-11T22:15:52.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.231+0000 7ff1419b7640 1 -- 172.21.15.50:0/2362445787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff13c0b78f0 con 0x7ff13c0cf790 2024-09-11T22:15:52.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.231+0000 7ff123fff640 1 -- 172.21.15.50:0/2362445787 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff12c011070 con 0x7ff13c0cf790 2024-09-11T22:15:52.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.232+0000 7ff123fff640 1 --2- 172.21.15.50:0/2362445787 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff12806be30 0x7ff12806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.232+0000 7ff123fff640 1 -- 172.21.15.50:0/2362445787 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5709+0+0 (secure 0 0 0) 0x7ff12c08aa80 con 0x7ff13c0cf790 2024-09-11T22:15:52.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.232+0000 7ff13a7fc640 1 --2- 172.21.15.50:0/2362445787 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff12806be30 0x7ff12806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.232+0000 7ff13a7fc640 1 --2- 172.21.15.50:0/2362445787 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff12806be30 0x7ff12806e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff130034000 tx=0x7ff13002c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:52.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.236+0000 7ff123fff640 1 -- 172.21.15.50:0/2362445787 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff12c08ce20 con 0x7ff13c0cf790 2024-09-11T22:15:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.413+0000 7ff1419b7640 1 -- 172.21.15.50:0/2362445787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff13c0d2900 con 0x7ff13c0cf790 2024-09-11T22:15:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.414+0000 7ff123fff640 1 -- 172.21.15.50:0/2362445787 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+16684 (secure 0 0 0) 0x7ff12c059420 con 0x7ff13c0cf790 2024-09-11T22:15:52.415 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":89,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:15:50.754927+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:15:46.760927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T22:15:48.092105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:15:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.416+0000 7ff1419b7640 1 -- 172.21.15.50:0/2362445787 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff12806be30 msgr2=0x7ff12806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.416+0000 7ff1419b7640 1 --2- 172.21.15.50:0/2362445787 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff12806be30 0x7ff12806e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff130034000 tx=0x7ff13002c000 comp rx=0 tx=0).stop 2024-09-11T22:15:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.416+0000 7ff1419b7640 1 -- 172.21.15.50:0/2362445787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff13c0cf790 msgr2=0x7ff13c0ab6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.416+0000 7ff1419b7640 1 --2- 172.21.15.50:0/2362445787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff13c0cf790 0x7ff13c0ab6d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00c460 tx=0x7ff12c00c920 comp rx=0 tx=0).stop 2024-09-11T22:15:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.416+0000 7ff1419b7640 1 -- 172.21.15.50:0/2362445787 shutdown_connections 2024-09-11T22:15:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.416+0000 7ff1419b7640 1 --2- 172.21.15.50:0/2362445787 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff12806be30 0x7ff12806e2f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.416+0000 7ff1419b7640 1 --2- 172.21.15.50:0/2362445787 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff13c0d11d0 0x7ff13c0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.416+0000 7ff1419b7640 1 --2- 172.21.15.50:0/2362445787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13c161d30 0x7ff13c0cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.416+0000 7ff1419b7640 1 --2- 172.21.15.50:0/2362445787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff13c0cf790 0x7ff13c0ab6d0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.416+0000 7ff1419b7640 1 -- 172.21.15.50:0/2362445787 >> 172.21.15.50:0/2362445787 conn(0x7ff13c0727a0 msgr2=0x7ff13c15de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:52.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.416+0000 7ff1419b7640 1 -- 172.21.15.50:0/2362445787 shutdown_connections 2024-09-11T22:15:52.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.416+0000 7ff1419b7640 1 -- 172.21.15.50:0/2362445787 wait complete. 2024-09-11T22:15:52.428 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:15:52.428 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:15:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.530+0000 7f49fef7f640 1 Processor -- start 2024-09-11T22:15:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.530+0000 7f49fef7f640 1 -- start start 2024-09-11T22:15:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.531+0000 7f49fef7f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49f806e0f0 0x7f49f806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.531+0000 7f49fef7f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f8072e60 0x7f49f80711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.531+0000 7f49fef7f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f815b7e0 con 0x7f49f815b400 2024-09-11T22:15:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.531+0000 7f49fef7f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f49f815f140 con 0x7f49f806e0f0 2024-09-11T22:15:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.531+0000 7f49fef7f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f49f815f420 con 0x7f49f8072e60 2024-09-11T22:15:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.531+0000 7f49f7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49f806e0f0 0x7f49f806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.531+0000 7f49f7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49f806e0f0 0x7f49f806d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49830/0 (socket says 172.21.15.50:49830) 2024-09-11T22:15:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.531+0000 7f49f7fff640 1 -- 172.21.15.50:0/3676291658 learned_addr learned my addr 172.21.15.50:0/3676291658 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.532+0000 7f49fd51c640 1 --2- 172.21.15.50:0/3676291658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f8072e60 0x7f49f80711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.532+0000 7f49f7fff640 1 -- 172.21.15.50:0/3676291658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f8072e60 msgr2=0x7f49f80711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.532+0000 7f49f7fff640 1 --2- 172.21.15.50:0/3676291658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f8072e60 0x7f49f80711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.532+0000 7f49f7fff640 1 -- 172.21.15.50:0/3676291658 >> v1:172.21.15.77:6789/0 conn(0x7f49f815b400 legacy=0x7f49f806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.532+0000 7f49f7fff640 1 -- 172.21.15.50:0/3676291658 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f815f700 con 0x7f49f806e0f0 2024-09-11T22:15:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.533+0000 7f49f7fff640 1 --2- 172.21.15.50:0/3676291658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806e0f0 0x7f49f806d070 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f49e800bb10 tx=0x7f49e802c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92e6b24684204e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.533+0000 7f49f77fe640 1 -- 172.21.15.50:0/3676291658 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8036020 con 0x7f49f806e0f0 2024-09-11T22:15:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.533+0000 7f49f77fe640 1 -- 172.21.15.50:0/3676291658 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e8032820 con 0x7f49f806e0f0 2024-09-11T22:15:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.533+0000 7f49f77fe640 1 -- 172.21.15.50:0/3676291658 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8032bf0 con 0x7f49f806e0f0 2024-09-11T22:15:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.533+0000 7f49fef7f640 1 -- 172.21.15.50:0/3676291658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806e0f0 msgr2=0x7f49f806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.533+0000 7f49fef7f640 1 --2- 172.21.15.50:0/3676291658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806e0f0 0x7f49f806d070 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f49e800bb10 tx=0x7f49e802c920 comp rx=0 tx=0).stop 2024-09-11T22:15:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.533+0000 7f49fef7f640 1 -- 172.21.15.50:0/3676291658 shutdown_connections 2024-09-11T22:15:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.533+0000 7f49fef7f640 1 --2- 172.21.15.50:0/3676291658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f8072e60 0x7f49f80711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.533+0000 7f49fef7f640 1 --2- 172.21.15.50:0/3676291658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f806e0f0 0x7f49f806d070 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.533+0000 7f49fef7f640 1 -- 172.21.15.50:0/3676291658 >> 172.21.15.50:0/3676291658 conn(0x7f49f80679c0 msgr2=0x7f49f8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.533+0000 7f49fef7f640 1 -- 172.21.15.50:0/3676291658 shutdown_connections 2024-09-11T22:15:52.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.533+0000 7f49fef7f640 1 -- 172.21.15.50:0/3676291658 wait complete. 2024-09-11T22:15:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.535+0000 7f49fef7f640 1 Processor -- start 2024-09-11T22:15:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.535+0000 7f49fef7f640 1 -- start start 2024-09-11T22:15:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.535+0000 7f49fef7f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f806e0f0 0x7f49f8152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.535+0000 7f49fef7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f8072e60 0x7f49f814fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.535+0000 7f49fef7f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49f815b400 0x7f49f80ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.535+0000 7f49fef7f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f49f8071700 con 0x7f49f8072e60 2024-09-11T22:15:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.535+0000 7f49fef7f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80cfc50 con 0x7f49f815b400 2024-09-11T22:15:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.535+0000 7f49fef7f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f49f8071880 con 0x7f49f806e0f0 2024-09-11T22:15:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49f7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f8072e60 0x7f49f814fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49f7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f8072e60 0x7f49f814fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49838/0 (socket says 172.21.15.50:49838) 2024-09-11T22:15:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49f7fff640 1 -- 172.21.15.50:0/3085430747 learned_addr learned my addr 172.21.15.50:0/3085430747 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49fcd1b640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f806e0f0 0x7f49f8152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49fd51c640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49f815b400 0x7f49f80ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49f7fff640 1 -- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f806e0f0 msgr2=0x7f49f8152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49f7fff640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f806e0f0 0x7f49f8152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49f7fff640 1 -- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49f815b400 msgr2=0x7f49f80ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49f7fff640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49f815b400 0x7f49f80ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49f7fff640 1 -- 172.21.15.50:0/3085430747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f8140930 con 0x7f49f8072e60 2024-09-11T22:15:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49f7fff640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f8072e60 0x7f49f814fcb0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f49e800b2c0 tx=0x7f49e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49f57fa640 1 -- 172.21.15.50:0/3085430747 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8036040 con 0x7f49f8072e60 2024-09-11T22:15:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49f57fa640 1 -- 172.21.15.50:0/3085430747 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e803cd70 con 0x7f49f8072e60 2024-09-11T22:15:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49f57fa640 1 -- 172.21.15.50:0/3085430747 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8046610 con 0x7f49f8072e60 2024-09-11T22:15:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49fef7f640 1 -- 172.21.15.50:0/3085430747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f8151950 con 0x7f49f8072e60 2024-09-11T22:15:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.536+0000 7f49fef7f640 1 -- 172.21.15.50:0/3085430747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f8151f10 con 0x7f49f8072e60 2024-09-11T22:15:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.537+0000 7f49fef7f640 1 -- 172.21.15.50:0/3085430747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f80711c0 con 0x7f49f8072e60 2024-09-11T22:15:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.538+0000 7f49f57fa640 1 -- 172.21.15.50:0/3085430747 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f49e8039020 con 0x7f49f8072e60 2024-09-11T22:15:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.538+0000 7f49f57fa640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f49d806be30 0x7f49d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.538+0000 7f49f57fa640 1 -- 172.21.15.50:0/3085430747 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5709+0+0 (secure 0 0 0) 0x7f49e80adfb0 con 0x7f49f8072e60 2024-09-11T22:15:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.539+0000 7f49fcd1b640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f49d806be30 0x7f49d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.539+0000 7f49fcd1b640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f49d806be30 0x7f49d806e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f49f0001e70 tx=0x7f49f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.543+0000 7f49f57fa640 1 -- 172.21.15.50:0/3085430747 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49e8041070 con 0x7f49f8072e60 2024-09-11T22:15:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.718+0000 7f49fef7f640 1 -- 172.21.15.50:0/3085430747 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49f8158590 con 0x7f49d806be30 2024-09-11T22:15:52.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.724+0000 7f49f57fa640 1 -- 172.21.15.50:0/3085430747 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246616 (secure 0 0 0) 0x7f49f8158590 con 0x7f49d806be30 2024-09-11T22:15:52.730 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:52.732 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:15:52.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.727+0000 7f49fef7f640 1 -- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f49d806be30 msgr2=0x7f49d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.727+0000 7f49fef7f640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f49d806be30 0x7f49d806e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f49f0001e70 tx=0x7f49f0009040 comp rx=0 tx=0).stop 2024-09-11T22:15:52.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.727+0000 7f49fef7f640 1 -- 172.21.15.50:0/3085430747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f8072e60 msgr2=0x7f49f814fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.727+0000 7f49fef7f640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f8072e60 0x7f49f814fcb0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f49e800b2c0 tx=0x7f49e80046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.727+0000 7f49fef7f640 1 -- 172.21.15.50:0/3085430747 shutdown_connections 2024-09-11T22:15:52.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.727+0000 7f49fef7f640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f49d806be30 0x7f49d806e2f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.727+0000 7f49fef7f640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49f815b400 0x7f49f80ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.727+0000 7f49fef7f640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49f8072e60 0x7f49f814fcb0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.727+0000 7f49fef7f640 1 --2- 172.21.15.50:0/3085430747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f806e0f0 0x7f49f8152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.727+0000 7f49fef7f640 1 -- 172.21.15.50:0/3085430747 >> 172.21.15.50:0/3085430747 conn(0x7f49f80679c0 msgr2=0x7f49f8156cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:52.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.727+0000 7f49fef7f640 1 -- 172.21.15.50:0/3085430747 shutdown_connections 2024-09-11T22:15:52.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.727+0000 7f49fef7f640 1 -- 172.21.15.50:0/3085430747 wait complete. 2024-09-11T22:15:52.739 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-11T22:15:51.430310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275584,"kb_used_data":9404,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754699136,"statfs":{"total":773094113280,"available":772811915264,"internally_reserved":0,"allocated":9629696,"data_stored":4807834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":272354865},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000862"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747768+0000","last_change":"2024-09-11T22:15:48.747768+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747768+0000","last_undegraded":"2024-09-11T22:15:48.747768+0000","last_fullsized":"2024-09-11T22:15:48.747768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747921+0000","last_change":"2024-09-11T22:15:48.747921+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747921+0000","last_undegraded":"2024-09-11T22:15:48.747921+0000","last_fullsized":"2024-09-11T22:15:48.747921+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.763531+0000","last_change":"2024-09-11T22:15:49.754010+0000","last_active":"2024-09-11T22:15:49.763531+0000","last_peered":"2024-09-11T22:15:49.763531+0000","last_clean":"2024-09-11T22:15:49.763531+0000","last_became_active":"2024-09-11T22:15:49.753139+0000","last_became_peered":"2024-09-11T22:15:49.753139+0000","last_unstale":"2024-09-11T22:15:49.763531+0000","last_undegraded":"2024-09-11T22:15:49.763531+0000","last_fullsized":"2024-09-11T22:15:49.763531+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:14.317044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750436+0000","last_change":"2024-09-11T22:15:48.750436+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750436+0000","last_undegraded":"2024-09-11T22:15:48.750436+0000","last_fullsized":"2024-09-11T22:15:48.750436+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.743047+0000","last_change":"2024-09-11T22:15:48.743047+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.743047+0000","last_undegraded":"2024-09-11T22:15:48.743047+0000","last_fullsized":"2024-09-11T22:15:48.743047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.766286+0000","last_change":"2024-09-11T22:15:49.762290+0000","last_active":"2024-09-11T22:15:49.766286+0000","last_peered":"2024-09-11T22:15:49.766286+0000","last_clean":"2024-09-11T22:15:49.766286+0000","last_became_active":"2024-09-11T22:15:49.762021+0000","last_became_peered":"2024-09-11T22:15:49.762021+0000","last_unstale":"2024-09-11T22:15:49.766286+0000","last_undegraded":"2024-09-11T22:15:49.766286+0000","last_fullsized":"2024-09-11T22:15:49.766286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:24.752761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742623+0000","last_change":"2024-09-11T22:15:48.742623+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742623+0000","last_undegraded":"2024-09-11T22:15:48.742623+0000","last_fullsized":"2024-09-11T22:15:48.742623+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742644+0000","last_change":"2024-09-11T22:15:48.742644+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742644+0000","last_undegraded":"2024-09-11T22:15:48.742644+0000","last_fullsized":"2024-09-11T22:15:48.742644+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746572+0000","last_change":"2024-09-11T22:15:48.746572+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746572+0000","last_undegraded":"2024-09-11T22:15:48.746572+0000","last_fullsized":"2024-09-11T22:15:48.746572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747412+0000","last_change":"2024-09-11T22:15:48.747412+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747412+0000","last_undegraded":"2024-09-11T22:15:48.747412+0000","last_fullsized":"2024-09-11T22:15:48.747412+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748236+0000","last_change":"2024-09-11T22:15:48.748236+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748236+0000","last_undegraded":"2024-09-11T22:15:48.748236+0000","last_fullsized":"2024-09-11T22:15:48.748236+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.763418+0000","last_change":"2024-09-11T22:15:49.758506+0000","last_active":"2024-09-11T22:15:49.763418+0000","last_peered":"2024-09-11T22:15:49.763418+0000","last_clean":"2024-09-11T22:15:49.763418+0000","last_became_active":"2024-09-11T22:15:49.757038+0000","last_became_peered":"2024-09-11T22:15:49.757038+0000","last_unstale":"2024-09-11T22:15:49.763418+0000","last_undegraded":"2024-09-11T22:15:49.763418+0000","last_fullsized":"2024-09-11T22:15:49.763418+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:29.096221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746473+0000","last_change":"2024-09-11T22:15:48.746473+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746473+0000","last_undegraded":"2024-09-11T22:15:48.746473+0000","last_fullsized":"2024-09-11T22:15:48.746473+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746585+0000","last_change":"2024-09-11T22:15:48.746585+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746585+0000","last_undegraded":"2024-09-11T22:15:48.746585+0000","last_fullsized":"2024-09-11T22:15:48.746585+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747253+0000","last_change":"2024-09-11T22:15:48.747253+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747253+0000","last_undegraded":"2024-09-11T22:15:48.747253+0000","last_fullsized":"2024-09-11T22:15:48.747253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.758932+0000","last_change":"2024-09-11T22:15:49.757671+0000","last_active":"2024-09-11T22:15:49.758932+0000","last_peered":"2024-09-11T22:15:49.758932+0000","last_clean":"2024-09-11T22:15:49.758932+0000","last_became_active":"2024-09-11T22:15:49.757377+0000","last_became_peered":"2024-09-11T22:15:49.757377+0000","last_unstale":"2024-09-11T22:15:49.758932+0000","last_undegraded":"2024-09-11T22:15:49.758932+0000","last_fullsized":"2024-09-11T22:15:49.758932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:14:20.129904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748503+0000","last_change":"2024-09-11T22:15:48.748503+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748503+0000","last_undegraded":"2024-09-11T22:15:48.748503+0000","last_fullsized":"2024-09-11T22:15:48.748503+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768399+0000","last_change":"2024-09-11T22:15:49.766261+0000","last_active":"2024-09-11T22:15:49.768399+0000","last_peered":"2024-09-11T22:15:49.768399+0000","last_clean":"2024-09-11T22:15:49.768399+0000","last_became_active":"2024-09-11T22:15:49.765950+0000","last_became_peered":"2024-09-11T22:15:49.765950+0000","last_unstale":"2024-09-11T22:15:49.768399+0000","last_undegraded":"2024-09-11T22:15:49.768399+0000","last_fullsized":"2024-09-11T22:15:49.768399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:19.770913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768497+0000","last_change":"2024-09-11T22:15:49.767809+0000","last_active":"2024-09-11T22:15:49.768497+0000","last_peered":"2024-09-11T22:15:49.768497+0000","last_clean":"2024-09-11T22:15:49.768497+0000","last_became_active":"2024-09-11T22:15:49.767536+0000","last_became_peered":"2024-09-11T22:15:49.767536+0000","last_unstale":"2024-09-11T22:15:49.768497+0000","last_undegraded":"2024-09-11T22:15:49.768497+0000","last_fullsized":"2024-09-11T22:15:49.768497+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:24.521444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747538+0000","last_change":"2024-09-11T22:15:48.747538+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747538+0000","last_undegraded":"2024-09-11T22:15:48.747538+0000","last_fullsized":"2024-09-11T22:15:48.747538+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745834+0000","last_change":"2024-09-11T22:15:48.745834+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745834+0000","last_undegraded":"2024-09-11T22:15:48.745834+0000","last_fullsized":"2024-09-11T22:15:48.745834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768087+0000","last_change":"2024-09-11T22:15:49.765353+0000","last_active":"2024-09-11T22:15:49.768087+0000","last_peered":"2024-09-11T22:15:49.768087+0000","last_clean":"2024-09-11T22:15:49.768087+0000","last_became_active":"2024-09-11T22:15:49.765075+0000","last_became_peered":"2024-09-11T22:15:49.765075+0000","last_unstale":"2024-09-11T22:15:49.768087+0000","last_undegraded":"2024-09-11T22:15:49.768087+0000","last_fullsized":"2024-09-11T22:15:49.768087+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:19.201559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747439+0000","last_change":"2024-09-11T22:15:48.747439+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747439+0000","last_undegraded":"2024-09-11T22:15:48.747439+0000","last_fullsized":"2024-09-11T22:15:48.747439+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750559+0000","last_change":"2024-09-11T22:15:48.750559+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750559+0000","last_undegraded":"2024-09-11T22:15:48.750559+0000","last_fullsized":"2024-09-11T22:15:48.750559+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747831+0000","last_change":"2024-09-11T22:15:48.747831+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747831+0000","last_undegraded":"2024-09-11T22:15:48.747831+0000","last_fullsized":"2024-09-11T22:15:48.747831+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746859+0000","last_change":"2024-09-11T22:15:48.746859+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746859+0000","last_undegraded":"2024-09-11T22:15:48.746859+0000","last_fullsized":"2024-09-11T22:15:48.746859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746836+0000","last_change":"2024-09-11T22:15:48.746836+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746836+0000","last_undegraded":"2024-09-11T22:15:48.746836+0000","last_fullsized":"2024-09-11T22:15:48.746836+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749188+0000","last_change":"2024-09-11T22:15:48.749188+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749188+0000","last_undegraded":"2024-09-11T22:15:48.749188+0000","last_fullsized":"2024-09-11T22:15:48.749188+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746510+0000","last_change":"2024-09-11T22:15:48.746510+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746510+0000","last_undegraded":"2024-09-11T22:15:48.746510+0000","last_fullsized":"2024-09-11T22:15:48.746510+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750702+0000","last_change":"2024-09-11T22:15:48.750702+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750702+0000","last_undegraded":"2024-09-11T22:15:48.750702+0000","last_fullsized":"2024-09-11T22:15:48.750702+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760074+0000","last_change":"2024-09-11T22:15:48.757358+0000","last_active":"2024-09-11T22:15:48.760074+0000","last_peered":"2024-09-11T22:15:48.760074+0000","last_clean":"2024-09-11T22:15:48.760074+0000","last_became_active":"2024-09-11T22:15:48.756802+0000","last_became_peered":"2024-09-11T22:15:48.756802+0000","last_unstale":"2024-09-11T22:15:48.760074+0000","last_undegraded":"2024-09-11T22:15:48.760074+0000","last_fullsized":"2024-09-11T22:15:48.760074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:04.770101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747395+0000","last_change":"2024-09-11T22:15:48.747395+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747395+0000","last_undegraded":"2024-09-11T22:15:48.747395+0000","last_fullsized":"2024-09-11T22:15:48.747395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759974+0000","last_change":"2024-09-11T22:15:48.755723+0000","last_active":"2024-09-11T22:15:48.759974+0000","last_peered":"2024-09-11T22:15:48.759974+0000","last_clean":"2024-09-11T22:15:48.759974+0000","last_became_active":"2024-09-11T22:15:48.755202+0000","last_became_peered":"2024-09-11T22:15:48.755202+0000","last_unstale":"2024-09-11T22:15:48.759974+0000","last_undegraded":"2024-09-11T22:15:48.759974+0000","last_fullsized":"2024-09-11T22:15:48.759974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:24.239471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747430+0000","last_change":"2024-09-11T22:15:48.747430+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747430+0000","last_undegraded":"2024-09-11T22:15:48.747430+0000","last_fullsized":"2024-09-11T22:15:48.747430+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758066+0000","last_change":"2024-09-11T22:15:48.756677+0000","last_active":"2024-09-11T22:15:48.758066+0000","last_peered":"2024-09-11T22:15:48.758066+0000","last_clean":"2024-09-11T22:15:48.758066+0000","last_became_active":"2024-09-11T22:15:48.756204+0000","last_became_peered":"2024-09-11T22:15:48.756204+0000","last_unstale":"2024-09-11T22:15:48.758066+0000","last_undegraded":"2024-09-11T22:15:48.758066+0000","last_fullsized":"2024-09-11T22:15:48.758066+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:09.406534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.761845+0000","last_change":"2024-09-11T22:15:48.760604+0000","last_active":"2024-09-11T22:15:48.761845+0000","last_peered":"2024-09-11T22:15:48.761845+0000","last_clean":"2024-09-11T22:15:48.761845+0000","last_became_active":"2024-09-11T22:15:48.760301+0000","last_became_peered":"2024-09-11T22:15:48.760301+0000","last_unstale":"2024-09-11T22:15:48.761845+0000","last_undegraded":"2024-09-11T22:15:48.761845+0000","last_fullsized":"2024-09-11T22:15:48.761845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:14.750107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746353+0000","last_change":"2024-09-11T22:15:48.746353+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746353+0000","last_undegraded":"2024-09-11T22:15:48.746353+0000","last_fullsized":"2024-09-11T22:15:48.746353+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760021+0000","last_change":"2024-09-11T22:15:48.756889+0000","last_active":"2024-09-11T22:15:48.760021+0000","last_peered":"2024-09-11T22:15:48.760021+0000","last_clean":"2024-09-11T22:15:48.760021+0000","last_became_active":"2024-09-11T22:15:48.756634+0000","last_became_peered":"2024-09-11T22:15:48.756634+0000","last_unstale":"2024-09-11T22:15:48.760021+0000","last_undegraded":"2024-09-11T22:15:48.760021+0000","last_fullsized":"2024-09-11T22:15:48.760021+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:09.629914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750043+0000","last_change":"2024-09-11T22:15:48.750043+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750043+0000","last_undegraded":"2024-09-11T22:15:48.750043+0000","last_fullsized":"2024-09-11T22:15:48.750043+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760107+0000","last_change":"2024-09-11T22:15:48.757211+0000","last_active":"2024-09-11T22:15:48.760107+0000","last_peered":"2024-09-11T22:15:48.760107+0000","last_clean":"2024-09-11T22:15:48.760107+0000","last_became_active":"2024-09-11T22:15:48.756934+0000","last_became_peered":"2024-09-11T22:15:48.756934+0000","last_unstale":"2024-09-11T22:15:48.760107+0000","last_undegraded":"2024-09-11T22:15:48.760107+0000","last_fullsized":"2024-09-11T22:15:48.760107+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:09.406534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758925+0000","last_change":"2024-09-11T22:15:48.758321+0000","last_active":"2024-09-11T22:15:48.758925+0000","last_peered":"2024-09-11T22:15:48.758925+0000","last_clean":"2024-09-11T22:15:48.758925+0000","last_became_active":"2024-09-11T22:15:48.758058+0000","last_became_peered":"2024-09-11T22:15:48.758058+0000","last_unstale":"2024-09-11T22:15:48.758925+0000","last_undegraded":"2024-09-11T22:15:48.758925+0000","last_fullsized":"2024-09-11T22:15:48.758925+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:04.531093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745995+0000","last_change":"2024-09-11T22:15:48.745995+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745995+0000","last_undegraded":"2024-09-11T22:15:48.745995+0000","last_fullsized":"2024-09-11T22:15:48.745995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.757688+0000","last_change":"2024-09-11T22:15:48.755608+0000","last_active":"2024-09-11T22:15:48.757688+0000","last_peered":"2024-09-11T22:15:48.757688+0000","last_clean":"2024-09-11T22:15:48.757688+0000","last_became_active":"2024-09-11T22:15:48.755303+0000","last_became_peered":"2024-09-11T22:15:48.755303+0000","last_unstale":"2024-09-11T22:15:48.757688+0000","last_undegraded":"2024-09-11T22:15:48.757688+0000","last_fullsized":"2024-09-11T22:15:48.757688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:06.185360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.744931+0000","last_change":"2024-09-11T22:15:48.744931+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.744931+0000","last_undegraded":"2024-09-11T22:15:48.744931+0000","last_fullsized":"2024-09-11T22:15:48.744931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755140+0000","last_change":"2024-09-11T22:15:48.753492+0000","last_active":"2024-09-11T22:15:48.755140+0000","last_peered":"2024-09-11T22:15:48.755140+0000","last_clean":"2024-09-11T22:15:48.755140+0000","last_became_active":"2024-09-11T22:15:48.753269+0000","last_became_peered":"2024-09-11T22:15:48.753269+0000","last_unstale":"2024-09-11T22:15:48.755140+0000","last_undegraded":"2024-09-11T22:15:48.755140+0000","last_fullsized":"2024-09-11T22:15:48.755140+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:33.429722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742179+0000","last_change":"2024-09-11T22:15:48.742179+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742179+0000","last_undegraded":"2024-09-11T22:15:48.742179+0000","last_fullsized":"2024-09-11T22:15:48.742179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759990+0000","last_change":"2024-09-11T22:15:48.756378+0000","last_active":"2024-09-11T22:15:48.759990+0000","last_peered":"2024-09-11T22:15:48.759990+0000","last_clean":"2024-09-11T22:15:48.759990+0000","last_became_active":"2024-09-11T22:15:48.756100+0000","last_became_peered":"2024-09-11T22:15:48.756100+0000","last_unstale":"2024-09-11T22:15:48.759990+0000","last_undegraded":"2024-09-11T22:15:48.759990+0000","last_fullsized":"2024-09-11T22:15:48.759990+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:32.253582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749135+0000","last_change":"2024-09-11T22:15:48.749135+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749135+0000","last_undegraded":"2024-09-11T22:15:48.749135+0000","last_fullsized":"2024-09-11T22:15:48.749135+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755160+0000","last_change":"2024-09-11T22:15:48.753488+0000","last_active":"2024-09-11T22:15:48.755160+0000","last_peered":"2024-09-11T22:15:48.755160+0000","last_clean":"2024-09-11T22:15:48.755160+0000","last_became_active":"2024-09-11T22:15:48.753210+0000","last_became_peered":"2024-09-11T22:15:48.753210+0000","last_unstale":"2024-09-11T22:15:48.755160+0000","last_undegraded":"2024-09-11T22:15:48.755160+0000","last_fullsized":"2024-09-11T22:15:48.755160+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:32.456027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749612+0000","last_change":"2024-09-11T22:15:48.749612+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749612+0000","last_undegraded":"2024-09-11T22:15:48.749612+0000","last_fullsized":"2024-09-11T22:15:48.749612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.748267+0000","last_change":"2024-09-11T22:15:48.745068+0000","last_active":"2024-09-11T22:15:48.748267+0000","last_peered":"2024-09-11T22:15:48.748267+0000","last_clean":"2024-09-11T22:15:48.748267+0000","last_became_active":"2024-09-11T22:15:48.744801+0000","last_became_peered":"2024-09-11T22:15:48.744801+0000","last_unstale":"2024-09-11T22:15:48.748267+0000","last_undegraded":"2024-09-11T22:15:48.748267+0000","last_fullsized":"2024-09-11T22:15:48.748267+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:58.192598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749608+0000","last_change":"2024-09-11T22:15:48.749608+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749608+0000","last_undegraded":"2024-09-11T22:15:48.749608+0000","last_fullsized":"2024-09-11T22:15:48.749608+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.761659+0000","last_change":"2024-09-11T22:15:48.760851+0000","last_active":"2024-09-11T22:15:48.761659+0000","last_peered":"2024-09-11T22:15:48.761659+0000","last_clean":"2024-09-11T22:15:48.761659+0000","last_became_active":"2024-09-11T22:15:48.760540+0000","last_became_peered":"2024-09-11T22:15:48.760540+0000","last_unstale":"2024-09-11T22:15:48.761659+0000","last_undegraded":"2024-09-11T22:15:48.761659+0000","last_fullsized":"2024-09-11T22:15:48.761659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:13.738702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.756262+0000","last_change":"2024-09-11T22:15:48.753807+0000","last_active":"2024-09-11T22:15:48.756262+0000","last_peered":"2024-09-11T22:15:48.756262+0000","last_clean":"2024-09-11T22:15:48.756262+0000","last_became_active":"2024-09-11T22:15:48.753523+0000","last_became_peered":"2024-09-11T22:15:48.753523+0000","last_unstale":"2024-09-11T22:15:48.756262+0000","last_undegraded":"2024-09-11T22:15:48.756262+0000","last_fullsized":"2024-09-11T22:15:48.756262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:49.929465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746178+0000","last_change":"2024-09-11T22:15:48.746178+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746178+0000","last_undegraded":"2024-09-11T22:15:48.746178+0000","last_fullsized":"2024-09-11T22:15:48.746178+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755209+0000","last_change":"2024-09-11T22:15:48.752805+0000","last_active":"2024-09-11T22:15:48.755209+0000","last_peered":"2024-09-11T22:15:48.755209+0000","last_clean":"2024-09-11T22:15:48.755209+0000","last_became_active":"2024-09-11T22:15:48.752539+0000","last_became_peered":"2024-09-11T22:15:48.752539+0000","last_unstale":"2024-09-11T22:15:48.755209+0000","last_undegraded":"2024-09-11T22:15:48.755209+0000","last_fullsized":"2024-09-11T22:15:48.755209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:41.877937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745290+0000","last_change":"2024-09-11T22:15:48.745290+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745290+0000","last_undegraded":"2024-09-11T22:15:48.745290+0000","last_fullsized":"2024-09-11T22:15:48.745290+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755164+0000","last_change":"2024-09-11T22:15:48.753365+0000","last_active":"2024-09-11T22:15:48.755164+0000","last_peered":"2024-09-11T22:15:48.755164+0000","last_clean":"2024-09-11T22:15:48.755164+0000","last_became_active":"2024-09-11T22:15:48.753060+0000","last_became_peered":"2024-09-11T22:15:48.753060+0000","last_unstale":"2024-09-11T22:15:48.755164+0000","last_undegraded":"2024-09-11T22:15:48.755164+0000","last_fullsized":"2024-09-11T22:15:48.755164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:36.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.751840+0000","last_change":"2024-09-11T22:15:48.750585+0000","last_active":"2024-09-11T22:15:48.751840+0000","last_peered":"2024-09-11T22:15:48.751840+0000","last_clean":"2024-09-11T22:15:48.751840+0000","last_became_active":"2024-09-11T22:15:48.750301+0000","last_became_peered":"2024-09-11T22:15:48.750301+0000","last_unstale":"2024-09-11T22:15:48.751840+0000","last_undegraded":"2024-09-11T22:15:48.751840+0000","last_fullsized":"2024-09-11T22:15:48.751840+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:58.163220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746993+0000","last_change":"2024-09-11T22:15:48.746993+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746993+0000","last_undegraded":"2024-09-11T22:15:48.746993+0000","last_fullsized":"2024-09-11T22:15:48.746993+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.762156+0000","last_change":"2024-09-11T22:15:48.761035+0000","last_active":"2024-09-11T22:15:48.762156+0000","last_peered":"2024-09-11T22:15:48.762156+0000","last_clean":"2024-09-11T22:15:48.762156+0000","last_became_active":"2024-09-11T22:15:48.760673+0000","last_became_peered":"2024-09-11T22:15:48.760673+0000","last_unstale":"2024-09-11T22:15:48.762156+0000","last_undegraded":"2024-09-11T22:15:48.762156+0000","last_fullsized":"2024-09-11T22:15:48.762156+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:29.306669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749059+0000","last_change":"2024-09-11T22:15:48.749059+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749059+0000","last_undegraded":"2024-09-11T22:15:48.749059+0000","last_fullsized":"2024-09-11T22:15:48.749059+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755116+0000","last_change":"2024-09-11T22:15:48.753389+0000","last_active":"2024-09-11T22:15:48.755116+0000","last_peered":"2024-09-11T22:15:48.755116+0000","last_clean":"2024-09-11T22:15:48.755116+0000","last_became_active":"2024-09-11T22:15:48.753078+0000","last_became_peered":"2024-09-11T22:15:48.753078+0000","last_unstale":"2024-09-11T22:15:48.755116+0000","last_undegraded":"2024-09-11T22:15:48.755116+0000","last_fullsized":"2024-09-11T22:15:48.755116+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.697611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.763395+0000","last_change":"2024-09-11T22:15:49.758184+0000","last_active":"2024-09-11T22:15:49.763395+0000","last_peered":"2024-09-11T22:15:49.763395+0000","last_clean":"2024-09-11T22:15:49.763395+0000","last_became_active":"2024-09-11T22:15:49.756641+0000","last_became_peered":"2024-09-11T22:15:49.756641+0000","last_unstale":"2024-09-11T22:15:49.763395+0000","last_undegraded":"2024-09-11T22:15:49.763395+0000","last_fullsized":"2024-09-11T22:15:49.763395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:36.042212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.757296+0000","last_change":"2024-09-11T22:15:48.756390+0000","last_active":"2024-09-11T22:15:48.757296+0000","last_peered":"2024-09-11T22:15:48.757296+0000","last_clean":"2024-09-11T22:15:48.757296+0000","last_became_active":"2024-09-11T22:15:48.756076+0000","last_became_peered":"2024-09-11T22:15:48.756076+0000","last_unstale":"2024-09-11T22:15:48.757296+0000","last_undegraded":"2024-09-11T22:15:48.757296+0000","last_fullsized":"2024-09-11T22:15:48.757296+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:47.594034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742120+0000","last_change":"2024-09-11T22:15:48.742120+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742120+0000","last_undegraded":"2024-09-11T22:15:48.742120+0000","last_fullsized":"2024-09-11T22:15:48.742120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.744129+0000","last_change":"2024-09-11T22:15:48.756655+0000","last_active":"2024-09-11T22:15:49.744129+0000","last_peered":"2024-09-11T22:15:49.744129+0000","last_clean":"2024-09-11T22:15:49.744129+0000","last_became_active":"2024-09-11T22:15:48.756399+0000","last_became_peered":"2024-09-11T22:15:48.756399+0000","last_unstale":"2024-09-11T22:15:49.744129+0000","last_undegraded":"2024-09-11T22:15:49.744129+0000","last_fullsized":"2024-09-11T22:15:49.744129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:51.759680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768065+0000","last_change":"2024-09-11T22:15:49.764525+0000","last_active":"2024-09-11T22:15:49.768065+0000","last_peered":"2024-09-11T22:15:49.768065+0000","last_clean":"2024-09-11T22:15:49.768065+0000","last_became_active":"2024-09-11T22:15:49.764235+0000","last_became_peered":"2024-09-11T22:15:49.764235+0000","last_unstale":"2024-09-11T22:15:49.768065+0000","last_undegraded":"2024-09-11T22:15:49.768065+0000","last_fullsized":"2024-09-11T22:15:49.768065+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.283321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.744055+0000","last_change":"2024-09-11T22:15:48.753604+0000","last_active":"2024-09-11T22:15:49.744055+0000","last_peered":"2024-09-11T22:15:49.744055+0000","last_clean":"2024-09-11T22:15:49.744055+0000","last_became_active":"2024-09-11T22:15:48.753332+0000","last_became_peered":"2024-09-11T22:15:48.753332+0000","last_unstale":"2024-09-11T22:15:49.744055+0000","last_undegraded":"2024-09-11T22:15:49.744055+0000","last_fullsized":"2024-09-11T22:15:49.744055+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:53.705437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742099+0000","last_change":"2024-09-11T22:15:48.742099+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742099+0000","last_undegraded":"2024-09-11T22:15:48.742099+0000","last_fullsized":"2024-09-11T22:15:48.742099+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758032+0000","last_change":"2024-09-11T22:15:48.757138+0000","last_active":"2024-09-11T22:15:48.758032+0000","last_peered":"2024-09-11T22:15:48.758032+0000","last_clean":"2024-09-11T22:15:48.758032+0000","last_became_active":"2024-09-11T22:15:48.756810+0000","last_became_peered":"2024-09-11T22:15:48.756810+0000","last_unstale":"2024-09-11T22:15:48.758032+0000","last_undegraded":"2024-09-11T22:15:48.758032+0000","last_fullsized":"2024-09-11T22:15:48.758032+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:32.543800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750306+0000","last_change":"2024-09-11T22:15:48.750306+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750306+0000","last_undegraded":"2024-09-11T22:15:48.750306+0000","last_fullsized":"2024-09-11T22:15:48.750306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755495+0000","last_change":"2024-09-11T22:15:48.752014+0000","last_active":"2024-09-11T22:15:48.755495+0000","last_peered":"2024-09-11T22:15:48.755495+0000","last_clean":"2024-09-11T22:15:48.755495+0000","last_became_active":"2024-09-11T22:15:48.751698+0000","last_became_peered":"2024-09-11T22:15:48.751698+0000","last_unstale":"2024-09-11T22:15:48.755495+0000","last_undegraded":"2024-09-11T22:15:48.755495+0000","last_fullsized":"2024-09-11T22:15:48.755495+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:45.566372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.761832+0000","last_change":"2024-09-11T22:15:48.761323+0000","last_active":"2024-09-11T22:15:48.761832+0000","last_peered":"2024-09-11T22:15:48.761832+0000","last_clean":"2024-09-11T22:15:48.761832+0000","last_became_active":"2024-09-11T22:15:48.761013+0000","last_became_peered":"2024-09-11T22:15:48.761013+0000","last_unstale":"2024-09-11T22:15:48.761832+0000","last_undegraded":"2024-09-11T22:15:48.761832+0000","last_fullsized":"2024-09-11T22:15:48.761832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:29.128528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747047+0000","last_change":"2024-09-11T22:15:48.747047+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747047+0000","last_undegraded":"2024-09-11T22:15:48.747047+0000","last_fullsized":"2024-09-11T22:15:48.747047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.762304+0000","last_change":"2024-09-11T22:15:48.758059+0000","last_active":"2024-09-11T22:15:48.762304+0000","last_peered":"2024-09-11T22:15:48.762304+0000","last_clean":"2024-09-11T22:15:48.762304+0000","last_became_active":"2024-09-11T22:15:48.757769+0000","last_became_peered":"2024-09-11T22:15:48.757769+0000","last_unstale":"2024-09-11T22:15:48.762304+0000","last_undegraded":"2024-09-11T22:15:48.762304+0000","last_fullsized":"2024-09-11T22:15:48.762304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:39.198853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748634+0000","last_change":"2024-09-11T22:15:48.748634+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748634+0000","last_undegraded":"2024-09-11T22:15:48.748634+0000","last_fullsized":"2024-09-11T22:15:48.748634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760013+0000","last_change":"2024-09-11T22:15:48.756280+0000","last_active":"2024-09-11T22:15:48.760013+0000","last_peered":"2024-09-11T22:15:48.760013+0000","last_clean":"2024-09-11T22:15:48.760013+0000","last_became_active":"2024-09-11T22:15:48.755689+0000","last_became_peered":"2024-09-11T22:15:48.755689+0000","last_unstale":"2024-09-11T22:15:48.760013+0000","last_undegraded":"2024-09-11T22:15:48.760013+0000","last_fullsized":"2024-09-11T22:15:48.760013+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:22.009761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742122+0000","last_change":"2024-09-11T22:15:48.742122+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742122+0000","last_undegraded":"2024-09-11T22:15:48.742122+0000","last_fullsized":"2024-09-11T22:15:48.742122+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758989+0000","last_change":"2024-09-11T22:15:48.754680+0000","last_active":"2024-09-11T22:15:48.758989+0000","last_peered":"2024-09-11T22:15:48.758989+0000","last_clean":"2024-09-11T22:15:48.758989+0000","last_became_active":"2024-09-11T22:15:48.754396+0000","last_became_peered":"2024-09-11T22:15:48.754396+0000","last_unstale":"2024-09-11T22:15:48.758989+0000","last_undegraded":"2024-09-11T22:15:48.758989+0000","last_fullsized":"2024-09-11T22:15:48.758989+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:09.629914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748238+0000","last_change":"2024-09-11T22:15:48.748238+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748238+0000","last_undegraded":"2024-09-11T22:15:48.748238+0000","last_fullsized":"2024-09-11T22:15:48.748238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759982+0000","last_change":"2024-09-11T22:15:48.755977+0000","last_active":"2024-09-11T22:15:48.759982+0000","last_peered":"2024-09-11T22:15:48.759982+0000","last_clean":"2024-09-11T22:15:48.759982+0000","last_became_active":"2024-09-11T22:15:48.755357+0000","last_became_peered":"2024-09-11T22:15:48.755357+0000","last_unstale":"2024-09-11T22:15:48.759982+0000","last_undegraded":"2024-09-11T22:15:48.759982+0000","last_fullsized":"2024-09-11T22:15:48.759982+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:36.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759993+0000","last_change":"2024-09-11T22:15:48.755949+0000","last_active":"2024-09-11T22:15:48.759993+0000","last_peered":"2024-09-11T22:15:48.759993+0000","last_clean":"2024-09-11T22:15:48.759993+0000","last_became_active":"2024-09-11T22:15:48.755704+0000","last_became_peered":"2024-09-11T22:15:48.755704+0000","last_unstale":"2024-09-11T22:15:48.759993+0000","last_undegraded":"2024-09-11T22:15:48.759993+0000","last_fullsized":"2024-09-11T22:15:48.759993+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:48.772533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745331+0000","last_change":"2024-09-11T22:15:48.745331+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745331+0000","last_undegraded":"2024-09-11T22:15:48.745331+0000","last_fullsized":"2024-09-11T22:15:48.745331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760025+0000","last_change":"2024-09-11T22:15:48.756565+0000","last_active":"2024-09-11T22:15:48.760025+0000","last_peered":"2024-09-11T22:15:48.760025+0000","last_clean":"2024-09-11T22:15:48.760025+0000","last_became_active":"2024-09-11T22:15:48.755417+0000","last_became_peered":"2024-09-11T22:15:48.755417+0000","last_unstale":"2024-09-11T22:15:48.760025+0000","last_undegraded":"2024-09-11T22:15:48.760025+0000","last_fullsized":"2024-09-11T22:15:48.760025+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.697611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746647+0000","last_change":"2024-09-11T22:15:48.746647+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746647+0000","last_undegraded":"2024-09-11T22:15:48.746647+0000","last_fullsized":"2024-09-11T22:15:48.746647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:47.728585+0000","last_change":"2024-09-11T22:15:47.728585+0000","last_active":"2024-09-11T22:15:47.728585+0000","last_peered":"2024-09-11T22:15:47.728585+0000","last_clean":"2024-09-11T22:15:47.728585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:47.728585+0000","last_undegraded":"2024-09-11T22:15:47.728585+0000","last_fullsized":"2024-09-11T22:15:47.728585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":287,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:15:47.161800+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:15:47.161800+0000","last_peered":"2024-09-11T22:15:47.161800+0000","last_clean":"2024-09-11T22:15:47.161800+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:15:47.161800+0000","last_undegraded":"2024-09-11T22:15:47.161800+0000","last_fullsized":"2024-09-11T22:15:47.161800+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":7},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":62,"acting":62,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36384,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335456,"statfs":{"total":96636764160,"available":96599506944,"internally_reserved":0,"allocated":1060864,"data_stored":456180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1060864,"data_stored":456180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335468,"statfs":{"total":96636764160,"available":96599519232,"internally_reserved":0,"allocated":1048576,"data_stored":449905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1048576,"data_stored":449905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1060864,"data_stored":456180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41136,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330704,"statfs":{"total":96636764160,"available":96594640896,"internally_reserved":0,"allocated":1654784,"data_stored":1046548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41088,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330752,"statfs":{"total":96636764160,"available":96594690048,"internally_reserved":0,"allocated":1617920,"data_stored":1029399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1077248,"data_stored":463537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:15:52.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:15:52.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.882+0000 7fb6b5378640 1 Processor -- start 2024-09-11T22:15:52.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.882+0000 7fb6b5378640 1 -- start start 2024-09-11T22:15:52.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.883+0000 7fb6b5378640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6b01463b0 0x7fb6b00cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.883+0000 7fb6b5378640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6b00ce0e0 0x7fb6b00b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.883+0000 7fb6b5378640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b0072630 con 0x7fb6b015db60 2024-09-11T22:15:52.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.883+0000 7fb6b5378640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb6b00d0670 con 0x7fb6b01463b0 2024-09-11T22:15:52.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.883+0000 7fb6b5378640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b0146790 con 0x7fb6b00ce0e0 2024-09-11T22:15:52.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.883+0000 7fb6aeffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6b01463b0 0x7fb6b00cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.883+0000 7fb6aeffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6b01463b0 0x7fb6b00cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49842/0 (socket says 172.21.15.50:49842) 2024-09-11T22:15:52.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.883+0000 7fb6aeffd640 1 -- 172.21.15.50:0/423230515 learned_addr learned my addr 172.21.15.50:0/423230515 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:52.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.883+0000 7fb6aeffd640 1 -- 172.21.15.50:0/423230515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6b00ce0e0 msgr2=0x7fb6b00b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:52.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.883+0000 7fb6aeffd640 1 --2- 172.21.15.50:0/423230515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6b00ce0e0 0x7fb6b00b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.883+0000 7fb6aeffd640 1 -- 172.21.15.50:0/423230515 >> v1:172.21.15.77:6789/0 conn(0x7fb6b015db60 legacy=0x7fb6b00cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:52.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.883+0000 7fb6aeffd640 1 -- 172.21.15.50:0/423230515 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b00728d0 con 0x7fb6b01463b0 2024-09-11T22:15:52.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.884+0000 7fb6aeffd640 1 --2- 172.21.15.50:0/423230515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b01463b0 0x7fb6b00cfc40 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009870 tx=0x7fb6a002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ed3dc3eb3090ad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:52.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.884+0000 7fb6ae7fc640 1 -- 172.21.15.50:0/423230515 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0037070 con 0x7fb6b01463b0 2024-09-11T22:15:52.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.884+0000 7fb6ae7fc640 1 -- 172.21.15.50:0/423230515 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a0032440 con 0x7fb6b01463b0 2024-09-11T22:15:52.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.884+0000 7fb6ae7fc640 1 -- 172.21.15.50:0/423230515 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0032810 con 0x7fb6b01463b0 2024-09-11T22:15:52.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.885+0000 7fb6b5378640 1 -- 172.21.15.50:0/423230515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b01463b0 msgr2=0x7fb6b00cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.885+0000 7fb6b5378640 1 --2- 172.21.15.50:0/423230515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b01463b0 0x7fb6b00cfc40 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009870 tx=0x7fb6a002a210 comp rx=0 tx=0).stop 2024-09-11T22:15:52.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.885+0000 7fb6b5378640 1 -- 172.21.15.50:0/423230515 shutdown_connections 2024-09-11T22:15:52.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.885+0000 7fb6b5378640 1 --2- 172.21.15.50:0/423230515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6b00ce0e0 0x7fb6b00b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.885+0000 7fb6b5378640 1 --2- 172.21.15.50:0/423230515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b01463b0 0x7fb6b00cfc40 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.885+0000 7fb6b5378640 1 -- 172.21.15.50:0/423230515 >> 172.21.15.50:0/423230515 conn(0x7fb6b0068240 msgr2=0x7fb6b00b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:52.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.885+0000 7fb6b5378640 1 -- 172.21.15.50:0/423230515 shutdown_connections 2024-09-11T22:15:52.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.885+0000 7fb6b5378640 1 -- 172.21.15.50:0/423230515 wait complete. 2024-09-11T22:15:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.886+0000 7fb6b5378640 1 Processor -- start 2024-09-11T22:15:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.886+0000 7fb6b5378640 1 -- start start 2024-09-11T22:15:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6b5378640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b00ce0e0 0x7fb6b013fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6b5378640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6b01463b0 0x7fb6b015b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6b5378640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6b015db60 0x7fb6b015be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6b5378640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b00d0180 con 0x7fb6b00ce0e0 2024-09-11T22:15:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6b5378640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b0072f20 con 0x7fb6b01463b0 2024-09-11T22:15:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6b5378640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b00d0300 con 0x7fb6b015db60 2024-09-11T22:15:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6aeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b00ce0e0 0x7fb6b013fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6aeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b00ce0e0 0x7fb6b013fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49846/0 (socket says 172.21.15.50:49846) 2024-09-11T22:15:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6aeffd640 1 -- 172.21.15.50:0/2395975244 learned_addr learned my addr 172.21.15.50:0/2395975244 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6aeffd640 1 -- 172.21.15.50:0/2395975244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6b015db60 msgr2=0x7fb6b015be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6af7fe640 1 --2- 172.21.15.50:0/2395975244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6b015db60 0x7fb6b015be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6aeffd640 1 --2- 172.21.15.50:0/2395975244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6b015db60 0x7fb6b015be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6aeffd640 1 -- 172.21.15.50:0/2395975244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6b01463b0 msgr2=0x7fb6b015b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6aeffd640 1 --2- 172.21.15.50:0/2395975244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6b01463b0 0x7fb6b015b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6aeffd640 1 -- 172.21.15.50:0/2395975244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b013d240 con 0x7fb6b00ce0e0 2024-09-11T22:15:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.887+0000 7fb6aeffd640 1 --2- 172.21.15.50:0/2395975244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b00ce0e0 0x7fb6b013fff0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009870 tx=0x7fb6a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.888+0000 7fb6a77fe640 1 -- 172.21.15.50:0/2395975244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0041070 con 0x7fb6b00ce0e0 2024-09-11T22:15:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.888+0000 7fb6a77fe640 1 -- 172.21.15.50:0/2395975244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a003c870 con 0x7fb6b00ce0e0 2024-09-11T22:15:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.888+0000 7fb6b5378640 1 -- 172.21.15.50:0/2395975244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b013d520 con 0x7fb6b00ce0e0 2024-09-11T22:15:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.888+0000 7fb6a77fe640 1 -- 172.21.15.50:0/2395975244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0037040 con 0x7fb6b00ce0e0 2024-09-11T22:15:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.888+0000 7fb6b5378640 1 -- 172.21.15.50:0/2395975244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b013dae0 con 0x7fb6b00ce0e0 2024-09-11T22:15:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.889+0000 7fb6b5378640 1 -- 172.21.15.50:0/2395975244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b00733b0 con 0x7fb6b00ce0e0 2024-09-11T22:15:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.889+0000 7fb6a77fe640 1 -- 172.21.15.50:0/2395975244 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb6a0044070 con 0x7fb6b00ce0e0 2024-09-11T22:15:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.889+0000 7fb6a77fe640 1 --2- 172.21.15.50:0/2395975244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb69006be60 0x7fb69006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.889+0000 7fb6a77fe640 1 -- 172.21.15.50:0/2395975244 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5709+0+0 (secure 0 0 0) 0x7fb6a00abb60 con 0x7fb6b00ce0e0 2024-09-11T22:15:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.890+0000 7fb6a7fff640 1 --2- 172.21.15.50:0/2395975244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb69006be60 0x7fb69006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.890+0000 7fb6a7fff640 1 --2- 172.21.15.50:0/2395975244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb69006be60 0x7fb69006e320 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb6b01422a0 tx=0x7fb698007990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:52.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:52.894+0000 7fb6a77fe640 1 -- 172.21.15.50:0/2395975244 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6a007a630 con 0x7fb6b00ce0e0 2024-09-11T22:15:53.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.066+0000 7fb6b5378640 1 -- 172.21.15.50:0/2395975244 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6b00b3cd0 con 0x7fb69006be60 2024-09-11T22:15:53.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.073+0000 7fb6a77fe640 1 -- 172.21.15.50:0/2395975244 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246616 (secure 0 0 0) 0x7fb6b00b3cd0 con 0x7fb69006be60 2024-09-11T22:15:53.076 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:15:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.075+0000 7fb6b5378640 1 -- 172.21.15.50:0/2395975244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb69006be60 msgr2=0x7fb69006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.075+0000 7fb6b5378640 1 --2- 172.21.15.50:0/2395975244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb69006be60 0x7fb69006e320 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb6b01422a0 tx=0x7fb698007990 comp rx=0 tx=0).stop 2024-09-11T22:15:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.075+0000 7fb6b5378640 1 -- 172.21.15.50:0/2395975244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b00ce0e0 msgr2=0x7fb6b013fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.075+0000 7fb6b5378640 1 --2- 172.21.15.50:0/2395975244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b00ce0e0 0x7fb6b013fff0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009870 tx=0x7fb6a00046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.076+0000 7fb6b5378640 1 -- 172.21.15.50:0/2395975244 shutdown_connections 2024-09-11T22:15:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.076+0000 7fb6b5378640 1 --2- 172.21.15.50:0/2395975244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb69006be60 0x7fb69006e320 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.076+0000 7fb6b5378640 1 --2- 172.21.15.50:0/2395975244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6b015db60 0x7fb6b015be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.076+0000 7fb6b5378640 1 --2- 172.21.15.50:0/2395975244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6b01463b0 0x7fb6b015b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.076+0000 7fb6b5378640 1 --2- 172.21.15.50:0/2395975244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b00ce0e0 0x7fb6b013fff0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.076+0000 7fb6b5378640 1 -- 172.21.15.50:0/2395975244 >> 172.21.15.50:0/2395975244 conn(0x7fb6b0068240 msgr2=0x7fb6b015ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.076+0000 7fb6b5378640 1 -- 172.21.15.50:0/2395975244 shutdown_connections 2024-09-11T22:15:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.076+0000 7fb6b5378640 1 -- 172.21.15.50:0/2395975244 wait complete. 2024-09-11T22:15:53.087 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-11T22:15:51.430310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275584,"kb_used_data":9404,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754699136,"statfs":{"total":773094113280,"available":772811915264,"internally_reserved":0,"allocated":9629696,"data_stored":4807834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":272354865},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000862"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747768+0000","last_change":"2024-09-11T22:15:48.747768+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747768+0000","last_undegraded":"2024-09-11T22:15:48.747768+0000","last_fullsized":"2024-09-11T22:15:48.747768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747921+0000","last_change":"2024-09-11T22:15:48.747921+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747921+0000","last_undegraded":"2024-09-11T22:15:48.747921+0000","last_fullsized":"2024-09-11T22:15:48.747921+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.763531+0000","last_change":"2024-09-11T22:15:49.754010+0000","last_active":"2024-09-11T22:15:49.763531+0000","last_peered":"2024-09-11T22:15:49.763531+0000","last_clean":"2024-09-11T22:15:49.763531+0000","last_became_active":"2024-09-11T22:15:49.753139+0000","last_became_peered":"2024-09-11T22:15:49.753139+0000","last_unstale":"2024-09-11T22:15:49.763531+0000","last_undegraded":"2024-09-11T22:15:49.763531+0000","last_fullsized":"2024-09-11T22:15:49.763531+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:14.317044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750436+0000","last_change":"2024-09-11T22:15:48.750436+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750436+0000","last_undegraded":"2024-09-11T22:15:48.750436+0000","last_fullsized":"2024-09-11T22:15:48.750436+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.743047+0000","last_change":"2024-09-11T22:15:48.743047+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.743047+0000","last_undegraded":"2024-09-11T22:15:48.743047+0000","last_fullsized":"2024-09-11T22:15:48.743047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.766286+0000","last_change":"2024-09-11T22:15:49.762290+0000","last_active":"2024-09-11T22:15:49.766286+0000","last_peered":"2024-09-11T22:15:49.766286+0000","last_clean":"2024-09-11T22:15:49.766286+0000","last_became_active":"2024-09-11T22:15:49.762021+0000","last_became_peered":"2024-09-11T22:15:49.762021+0000","last_unstale":"2024-09-11T22:15:49.766286+0000","last_undegraded":"2024-09-11T22:15:49.766286+0000","last_fullsized":"2024-09-11T22:15:49.766286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:24.752761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742623+0000","last_change":"2024-09-11T22:15:48.742623+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742623+0000","last_undegraded":"2024-09-11T22:15:48.742623+0000","last_fullsized":"2024-09-11T22:15:48.742623+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742644+0000","last_change":"2024-09-11T22:15:48.742644+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742644+0000","last_undegraded":"2024-09-11T22:15:48.742644+0000","last_fullsized":"2024-09-11T22:15:48.742644+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746572+0000","last_change":"2024-09-11T22:15:48.746572+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746572+0000","last_undegraded":"2024-09-11T22:15:48.746572+0000","last_fullsized":"2024-09-11T22:15:48.746572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747412+0000","last_change":"2024-09-11T22:15:48.747412+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747412+0000","last_undegraded":"2024-09-11T22:15:48.747412+0000","last_fullsized":"2024-09-11T22:15:48.747412+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748236+0000","last_change":"2024-09-11T22:15:48.748236+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748236+0000","last_undegraded":"2024-09-11T22:15:48.748236+0000","last_fullsized":"2024-09-11T22:15:48.748236+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.763418+0000","last_change":"2024-09-11T22:15:49.758506+0000","last_active":"2024-09-11T22:15:49.763418+0000","last_peered":"2024-09-11T22:15:49.763418+0000","last_clean":"2024-09-11T22:15:49.763418+0000","last_became_active":"2024-09-11T22:15:49.757038+0000","last_became_peered":"2024-09-11T22:15:49.757038+0000","last_unstale":"2024-09-11T22:15:49.763418+0000","last_undegraded":"2024-09-11T22:15:49.763418+0000","last_fullsized":"2024-09-11T22:15:49.763418+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:29.096221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746473+0000","last_change":"2024-09-11T22:15:48.746473+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746473+0000","last_undegraded":"2024-09-11T22:15:48.746473+0000","last_fullsized":"2024-09-11T22:15:48.746473+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746585+0000","last_change":"2024-09-11T22:15:48.746585+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746585+0000","last_undegraded":"2024-09-11T22:15:48.746585+0000","last_fullsized":"2024-09-11T22:15:48.746585+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747253+0000","last_change":"2024-09-11T22:15:48.747253+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747253+0000","last_undegraded":"2024-09-11T22:15:48.747253+0000","last_fullsized":"2024-09-11T22:15:48.747253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.758932+0000","last_change":"2024-09-11T22:15:49.757671+0000","last_active":"2024-09-11T22:15:49.758932+0000","last_peered":"2024-09-11T22:15:49.758932+0000","last_clean":"2024-09-11T22:15:49.758932+0000","last_became_active":"2024-09-11T22:15:49.757377+0000","last_became_peered":"2024-09-11T22:15:49.757377+0000","last_unstale":"2024-09-11T22:15:49.758932+0000","last_undegraded":"2024-09-11T22:15:49.758932+0000","last_fullsized":"2024-09-11T22:15:49.758932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:14:20.129904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748503+0000","last_change":"2024-09-11T22:15:48.748503+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748503+0000","last_undegraded":"2024-09-11T22:15:48.748503+0000","last_fullsized":"2024-09-11T22:15:48.748503+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768399+0000","last_change":"2024-09-11T22:15:49.766261+0000","last_active":"2024-09-11T22:15:49.768399+0000","last_peered":"2024-09-11T22:15:49.768399+0000","last_clean":"2024-09-11T22:15:49.768399+0000","last_became_active":"2024-09-11T22:15:49.765950+0000","last_became_peered":"2024-09-11T22:15:49.765950+0000","last_unstale":"2024-09-11T22:15:49.768399+0000","last_undegraded":"2024-09-11T22:15:49.768399+0000","last_fullsized":"2024-09-11T22:15:49.768399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:19.770913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768497+0000","last_change":"2024-09-11T22:15:49.767809+0000","last_active":"2024-09-11T22:15:49.768497+0000","last_peered":"2024-09-11T22:15:49.768497+0000","last_clean":"2024-09-11T22:15:49.768497+0000","last_became_active":"2024-09-11T22:15:49.767536+0000","last_became_peered":"2024-09-11T22:15:49.767536+0000","last_unstale":"2024-09-11T22:15:49.768497+0000","last_undegraded":"2024-09-11T22:15:49.768497+0000","last_fullsized":"2024-09-11T22:15:49.768497+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:24.521444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747538+0000","last_change":"2024-09-11T22:15:48.747538+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747538+0000","last_undegraded":"2024-09-11T22:15:48.747538+0000","last_fullsized":"2024-09-11T22:15:48.747538+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745834+0000","last_change":"2024-09-11T22:15:48.745834+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745834+0000","last_undegraded":"2024-09-11T22:15:48.745834+0000","last_fullsized":"2024-09-11T22:15:48.745834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768087+0000","last_change":"2024-09-11T22:15:49.765353+0000","last_active":"2024-09-11T22:15:49.768087+0000","last_peered":"2024-09-11T22:15:49.768087+0000","last_clean":"2024-09-11T22:15:49.768087+0000","last_became_active":"2024-09-11T22:15:49.765075+0000","last_became_peered":"2024-09-11T22:15:49.765075+0000","last_unstale":"2024-09-11T22:15:49.768087+0000","last_undegraded":"2024-09-11T22:15:49.768087+0000","last_fullsized":"2024-09-11T22:15:49.768087+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:19.201559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747439+0000","last_change":"2024-09-11T22:15:48.747439+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747439+0000","last_undegraded":"2024-09-11T22:15:48.747439+0000","last_fullsized":"2024-09-11T22:15:48.747439+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750559+0000","last_change":"2024-09-11T22:15:48.750559+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750559+0000","last_undegraded":"2024-09-11T22:15:48.750559+0000","last_fullsized":"2024-09-11T22:15:48.750559+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747831+0000","last_change":"2024-09-11T22:15:48.747831+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747831+0000","last_undegraded":"2024-09-11T22:15:48.747831+0000","last_fullsized":"2024-09-11T22:15:48.747831+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746859+0000","last_change":"2024-09-11T22:15:48.746859+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746859+0000","last_undegraded":"2024-09-11T22:15:48.746859+0000","last_fullsized":"2024-09-11T22:15:48.746859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746836+0000","last_change":"2024-09-11T22:15:48.746836+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746836+0000","last_undegraded":"2024-09-11T22:15:48.746836+0000","last_fullsized":"2024-09-11T22:15:48.746836+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749188+0000","last_change":"2024-09-11T22:15:48.749188+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749188+0000","last_undegraded":"2024-09-11T22:15:48.749188+0000","last_fullsized":"2024-09-11T22:15:48.749188+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746510+0000","last_change":"2024-09-11T22:15:48.746510+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746510+0000","last_undegraded":"2024-09-11T22:15:48.746510+0000","last_fullsized":"2024-09-11T22:15:48.746510+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750702+0000","last_change":"2024-09-11T22:15:48.750702+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750702+0000","last_undegraded":"2024-09-11T22:15:48.750702+0000","last_fullsized":"2024-09-11T22:15:48.750702+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760074+0000","last_change":"2024-09-11T22:15:48.757358+0000","last_active":"2024-09-11T22:15:48.760074+0000","last_peered":"2024-09-11T22:15:48.760074+0000","last_clean":"2024-09-11T22:15:48.760074+0000","last_became_active":"2024-09-11T22:15:48.756802+0000","last_became_peered":"2024-09-11T22:15:48.756802+0000","last_unstale":"2024-09-11T22:15:48.760074+0000","last_undegraded":"2024-09-11T22:15:48.760074+0000","last_fullsized":"2024-09-11T22:15:48.760074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:04.770101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747395+0000","last_change":"2024-09-11T22:15:48.747395+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747395+0000","last_undegraded":"2024-09-11T22:15:48.747395+0000","last_fullsized":"2024-09-11T22:15:48.747395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759974+0000","last_change":"2024-09-11T22:15:48.755723+0000","last_active":"2024-09-11T22:15:48.759974+0000","last_peered":"2024-09-11T22:15:48.759974+0000","last_clean":"2024-09-11T22:15:48.759974+0000","last_became_active":"2024-09-11T22:15:48.755202+0000","last_became_peered":"2024-09-11T22:15:48.755202+0000","last_unstale":"2024-09-11T22:15:48.759974+0000","last_undegraded":"2024-09-11T22:15:48.759974+0000","last_fullsized":"2024-09-11T22:15:48.759974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:24.239471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747430+0000","last_change":"2024-09-11T22:15:48.747430+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747430+0000","last_undegraded":"2024-09-11T22:15:48.747430+0000","last_fullsized":"2024-09-11T22:15:48.747430+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758066+0000","last_change":"2024-09-11T22:15:48.756677+0000","last_active":"2024-09-11T22:15:48.758066+0000","last_peered":"2024-09-11T22:15:48.758066+0000","last_clean":"2024-09-11T22:15:48.758066+0000","last_became_active":"2024-09-11T22:15:48.756204+0000","last_became_peered":"2024-09-11T22:15:48.756204+0000","last_unstale":"2024-09-11T22:15:48.758066+0000","last_undegraded":"2024-09-11T22:15:48.758066+0000","last_fullsized":"2024-09-11T22:15:48.758066+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:09.406534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.761845+0000","last_change":"2024-09-11T22:15:48.760604+0000","last_active":"2024-09-11T22:15:48.761845+0000","last_peered":"2024-09-11T22:15:48.761845+0000","last_clean":"2024-09-11T22:15:48.761845+0000","last_became_active":"2024-09-11T22:15:48.760301+0000","last_became_peered":"2024-09-11T22:15:48.760301+0000","last_unstale":"2024-09-11T22:15:48.761845+0000","last_undegraded":"2024-09-11T22:15:48.761845+0000","last_fullsized":"2024-09-11T22:15:48.761845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:14.750107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746353+0000","last_change":"2024-09-11T22:15:48.746353+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746353+0000","last_undegraded":"2024-09-11T22:15:48.746353+0000","last_fullsized":"2024-09-11T22:15:48.746353+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760021+0000","last_change":"2024-09-11T22:15:48.756889+0000","last_active":"2024-09-11T22:15:48.760021+0000","last_peered":"2024-09-11T22:15:48.760021+0000","last_clean":"2024-09-11T22:15:48.760021+0000","last_became_active":"2024-09-11T22:15:48.756634+0000","last_became_peered":"2024-09-11T22:15:48.756634+0000","last_unstale":"2024-09-11T22:15:48.760021+0000","last_undegraded":"2024-09-11T22:15:48.760021+0000","last_fullsized":"2024-09-11T22:15:48.760021+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:09.629914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750043+0000","last_change":"2024-09-11T22:15:48.750043+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750043+0000","last_undegraded":"2024-09-11T22:15:48.750043+0000","last_fullsized":"2024-09-11T22:15:48.750043+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760107+0000","last_change":"2024-09-11T22:15:48.757211+0000","last_active":"2024-09-11T22:15:48.760107+0000","last_peered":"2024-09-11T22:15:48.760107+0000","last_clean":"2024-09-11T22:15:48.760107+0000","last_became_active":"2024-09-11T22:15:48.756934+0000","last_became_peered":"2024-09-11T22:15:48.756934+0000","last_unstale":"2024-09-11T22:15:48.760107+0000","last_undegraded":"2024-09-11T22:15:48.760107+0000","last_fullsized":"2024-09-11T22:15:48.760107+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:09.406534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758925+0000","last_change":"2024-09-11T22:15:48.758321+0000","last_active":"2024-09-11T22:15:48.758925+0000","last_peered":"2024-09-11T22:15:48.758925+0000","last_clean":"2024-09-11T22:15:48.758925+0000","last_became_active":"2024-09-11T22:15:48.758058+0000","last_became_peered":"2024-09-11T22:15:48.758058+0000","last_unstale":"2024-09-11T22:15:48.758925+0000","last_undegraded":"2024-09-11T22:15:48.758925+0000","last_fullsized":"2024-09-11T22:15:48.758925+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:04.531093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745995+0000","last_change":"2024-09-11T22:15:48.745995+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745995+0000","last_undegraded":"2024-09-11T22:15:48.745995+0000","last_fullsized":"2024-09-11T22:15:48.745995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.757688+0000","last_change":"2024-09-11T22:15:48.755608+0000","last_active":"2024-09-11T22:15:48.757688+0000","last_peered":"2024-09-11T22:15:48.757688+0000","last_clean":"2024-09-11T22:15:48.757688+0000","last_became_active":"2024-09-11T22:15:48.755303+0000","last_became_peered":"2024-09-11T22:15:48.755303+0000","last_unstale":"2024-09-11T22:15:48.757688+0000","last_undegraded":"2024-09-11T22:15:48.757688+0000","last_fullsized":"2024-09-11T22:15:48.757688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:06.185360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.744931+0000","last_change":"2024-09-11T22:15:48.744931+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.744931+0000","last_undegraded":"2024-09-11T22:15:48.744931+0000","last_fullsized":"2024-09-11T22:15:48.744931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755140+0000","last_change":"2024-09-11T22:15:48.753492+0000","last_active":"2024-09-11T22:15:48.755140+0000","last_peered":"2024-09-11T22:15:48.755140+0000","last_clean":"2024-09-11T22:15:48.755140+0000","last_became_active":"2024-09-11T22:15:48.753269+0000","last_became_peered":"2024-09-11T22:15:48.753269+0000","last_unstale":"2024-09-11T22:15:48.755140+0000","last_undegraded":"2024-09-11T22:15:48.755140+0000","last_fullsized":"2024-09-11T22:15:48.755140+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:33.429722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742179+0000","last_change":"2024-09-11T22:15:48.742179+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742179+0000","last_undegraded":"2024-09-11T22:15:48.742179+0000","last_fullsized":"2024-09-11T22:15:48.742179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759990+0000","last_change":"2024-09-11T22:15:48.756378+0000","last_active":"2024-09-11T22:15:48.759990+0000","last_peered":"2024-09-11T22:15:48.759990+0000","last_clean":"2024-09-11T22:15:48.759990+0000","last_became_active":"2024-09-11T22:15:48.756100+0000","last_became_peered":"2024-09-11T22:15:48.756100+0000","last_unstale":"2024-09-11T22:15:48.759990+0000","last_undegraded":"2024-09-11T22:15:48.759990+0000","last_fullsized":"2024-09-11T22:15:48.759990+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:32.253582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749135+0000","last_change":"2024-09-11T22:15:48.749135+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749135+0000","last_undegraded":"2024-09-11T22:15:48.749135+0000","last_fullsized":"2024-09-11T22:15:48.749135+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755160+0000","last_change":"2024-09-11T22:15:48.753488+0000","last_active":"2024-09-11T22:15:48.755160+0000","last_peered":"2024-09-11T22:15:48.755160+0000","last_clean":"2024-09-11T22:15:48.755160+0000","last_became_active":"2024-09-11T22:15:48.753210+0000","last_became_peered":"2024-09-11T22:15:48.753210+0000","last_unstale":"2024-09-11T22:15:48.755160+0000","last_undegraded":"2024-09-11T22:15:48.755160+0000","last_fullsized":"2024-09-11T22:15:48.755160+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:32.456027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749612+0000","last_change":"2024-09-11T22:15:48.749612+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749612+0000","last_undegraded":"2024-09-11T22:15:48.749612+0000","last_fullsized":"2024-09-11T22:15:48.749612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.748267+0000","last_change":"2024-09-11T22:15:48.745068+0000","last_active":"2024-09-11T22:15:48.748267+0000","last_peered":"2024-09-11T22:15:48.748267+0000","last_clean":"2024-09-11T22:15:48.748267+0000","last_became_active":"2024-09-11T22:15:48.744801+0000","last_became_peered":"2024-09-11T22:15:48.744801+0000","last_unstale":"2024-09-11T22:15:48.748267+0000","last_undegraded":"2024-09-11T22:15:48.748267+0000","last_fullsized":"2024-09-11T22:15:48.748267+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:58.192598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749608+0000","last_change":"2024-09-11T22:15:48.749608+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749608+0000","last_undegraded":"2024-09-11T22:15:48.749608+0000","last_fullsized":"2024-09-11T22:15:48.749608+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.761659+0000","last_change":"2024-09-11T22:15:48.760851+0000","last_active":"2024-09-11T22:15:48.761659+0000","last_peered":"2024-09-11T22:15:48.761659+0000","last_clean":"2024-09-11T22:15:48.761659+0000","last_became_active":"2024-09-11T22:15:48.760540+0000","last_became_peered":"2024-09-11T22:15:48.760540+0000","last_unstale":"2024-09-11T22:15:48.761659+0000","last_undegraded":"2024-09-11T22:15:48.761659+0000","last_fullsized":"2024-09-11T22:15:48.761659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:13.738702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.756262+0000","last_change":"2024-09-11T22:15:48.753807+0000","last_active":"2024-09-11T22:15:48.756262+0000","last_peered":"2024-09-11T22:15:48.756262+0000","last_clean":"2024-09-11T22:15:48.756262+0000","last_became_active":"2024-09-11T22:15:48.753523+0000","last_became_peered":"2024-09-11T22:15:48.753523+0000","last_unstale":"2024-09-11T22:15:48.756262+0000","last_undegraded":"2024-09-11T22:15:48.756262+0000","last_fullsized":"2024-09-11T22:15:48.756262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:49.929465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746178+0000","last_change":"2024-09-11T22:15:48.746178+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746178+0000","last_undegraded":"2024-09-11T22:15:48.746178+0000","last_fullsized":"2024-09-11T22:15:48.746178+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755209+0000","last_change":"2024-09-11T22:15:48.752805+0000","last_active":"2024-09-11T22:15:48.755209+0000","last_peered":"2024-09-11T22:15:48.755209+0000","last_clean":"2024-09-11T22:15:48.755209+0000","last_became_active":"2024-09-11T22:15:48.752539+0000","last_became_peered":"2024-09-11T22:15:48.752539+0000","last_unstale":"2024-09-11T22:15:48.755209+0000","last_undegraded":"2024-09-11T22:15:48.755209+0000","last_fullsized":"2024-09-11T22:15:48.755209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:41.877937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745290+0000","last_change":"2024-09-11T22:15:48.745290+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745290+0000","last_undegraded":"2024-09-11T22:15:48.745290+0000","last_fullsized":"2024-09-11T22:15:48.745290+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755164+0000","last_change":"2024-09-11T22:15:48.753365+0000","last_active":"2024-09-11T22:15:48.755164+0000","last_peered":"2024-09-11T22:15:48.755164+0000","last_clean":"2024-09-11T22:15:48.755164+0000","last_became_active":"2024-09-11T22:15:48.753060+0000","last_became_peered":"2024-09-11T22:15:48.753060+0000","last_unstale":"2024-09-11T22:15:48.755164+0000","last_undegraded":"2024-09-11T22:15:48.755164+0000","last_fullsized":"2024-09-11T22:15:48.755164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:36.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.751840+0000","last_change":"2024-09-11T22:15:48.750585+0000","last_active":"2024-09-11T22:15:48.751840+0000","last_peered":"2024-09-11T22:15:48.751840+0000","last_clean":"2024-09-11T22:15:48.751840+0000","last_became_active":"2024-09-11T22:15:48.750301+0000","last_became_peered":"2024-09-11T22:15:48.750301+0000","last_unstale":"2024-09-11T22:15:48.751840+0000","last_undegraded":"2024-09-11T22:15:48.751840+0000","last_fullsized":"2024-09-11T22:15:48.751840+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:58.163220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746993+0000","last_change":"2024-09-11T22:15:48.746993+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746993+0000","last_undegraded":"2024-09-11T22:15:48.746993+0000","last_fullsized":"2024-09-11T22:15:48.746993+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.762156+0000","last_change":"2024-09-11T22:15:48.761035+0000","last_active":"2024-09-11T22:15:48.762156+0000","last_peered":"2024-09-11T22:15:48.762156+0000","last_clean":"2024-09-11T22:15:48.762156+0000","last_became_active":"2024-09-11T22:15:48.760673+0000","last_became_peered":"2024-09-11T22:15:48.760673+0000","last_unstale":"2024-09-11T22:15:48.762156+0000","last_undegraded":"2024-09-11T22:15:48.762156+0000","last_fullsized":"2024-09-11T22:15:48.762156+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:29.306669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749059+0000","last_change":"2024-09-11T22:15:48.749059+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749059+0000","last_undegraded":"2024-09-11T22:15:48.749059+0000","last_fullsized":"2024-09-11T22:15:48.749059+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755116+0000","last_change":"2024-09-11T22:15:48.753389+0000","last_active":"2024-09-11T22:15:48.755116+0000","last_peered":"2024-09-11T22:15:48.755116+0000","last_clean":"2024-09-11T22:15:48.755116+0000","last_became_active":"2024-09-11T22:15:48.753078+0000","last_became_peered":"2024-09-11T22:15:48.753078+0000","last_unstale":"2024-09-11T22:15:48.755116+0000","last_undegraded":"2024-09-11T22:15:48.755116+0000","last_fullsized":"2024-09-11T22:15:48.755116+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.697611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.763395+0000","last_change":"2024-09-11T22:15:49.758184+0000","last_active":"2024-09-11T22:15:49.763395+0000","last_peered":"2024-09-11T22:15:49.763395+0000","last_clean":"2024-09-11T22:15:49.763395+0000","last_became_active":"2024-09-11T22:15:49.756641+0000","last_became_peered":"2024-09-11T22:15:49.756641+0000","last_unstale":"2024-09-11T22:15:49.763395+0000","last_undegraded":"2024-09-11T22:15:49.763395+0000","last_fullsized":"2024-09-11T22:15:49.763395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:36.042212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.757296+0000","last_change":"2024-09-11T22:15:48.756390+0000","last_active":"2024-09-11T22:15:48.757296+0000","last_peered":"2024-09-11T22:15:48.757296+0000","last_clean":"2024-09-11T22:15:48.757296+0000","last_became_active":"2024-09-11T22:15:48.756076+0000","last_became_peered":"2024-09-11T22:15:48.756076+0000","last_unstale":"2024-09-11T22:15:48.757296+0000","last_undegraded":"2024-09-11T22:15:48.757296+0000","last_fullsized":"2024-09-11T22:15:48.757296+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:47.594034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742120+0000","last_change":"2024-09-11T22:15:48.742120+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742120+0000","last_undegraded":"2024-09-11T22:15:48.742120+0000","last_fullsized":"2024-09-11T22:15:48.742120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.744129+0000","last_change":"2024-09-11T22:15:48.756655+0000","last_active":"2024-09-11T22:15:49.744129+0000","last_peered":"2024-09-11T22:15:49.744129+0000","last_clean":"2024-09-11T22:15:49.744129+0000","last_became_active":"2024-09-11T22:15:48.756399+0000","last_became_peered":"2024-09-11T22:15:48.756399+0000","last_unstale":"2024-09-11T22:15:49.744129+0000","last_undegraded":"2024-09-11T22:15:49.744129+0000","last_fullsized":"2024-09-11T22:15:49.744129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:51.759680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768065+0000","last_change":"2024-09-11T22:15:49.764525+0000","last_active":"2024-09-11T22:15:49.768065+0000","last_peered":"2024-09-11T22:15:49.768065+0000","last_clean":"2024-09-11T22:15:49.768065+0000","last_became_active":"2024-09-11T22:15:49.764235+0000","last_became_peered":"2024-09-11T22:15:49.764235+0000","last_unstale":"2024-09-11T22:15:49.768065+0000","last_undegraded":"2024-09-11T22:15:49.768065+0000","last_fullsized":"2024-09-11T22:15:49.768065+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.283321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.744055+0000","last_change":"2024-09-11T22:15:48.753604+0000","last_active":"2024-09-11T22:15:49.744055+0000","last_peered":"2024-09-11T22:15:49.744055+0000","last_clean":"2024-09-11T22:15:49.744055+0000","last_became_active":"2024-09-11T22:15:48.753332+0000","last_became_peered":"2024-09-11T22:15:48.753332+0000","last_unstale":"2024-09-11T22:15:49.744055+0000","last_undegraded":"2024-09-11T22:15:49.744055+0000","last_fullsized":"2024-09-11T22:15:49.744055+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:53.705437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742099+0000","last_change":"2024-09-11T22:15:48.742099+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742099+0000","last_undegraded":"2024-09-11T22:15:48.742099+0000","last_fullsized":"2024-09-11T22:15:48.742099+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758032+0000","last_change":"2024-09-11T22:15:48.757138+0000","last_active":"2024-09-11T22:15:48.758032+0000","last_peered":"2024-09-11T22:15:48.758032+0000","last_clean":"2024-09-11T22:15:48.758032+0000","last_became_active":"2024-09-11T22:15:48.756810+0000","last_became_peered":"2024-09-11T22:15:48.756810+0000","last_unstale":"2024-09-11T22:15:48.758032+0000","last_undegraded":"2024-09-11T22:15:48.758032+0000","last_fullsized":"2024-09-11T22:15:48.758032+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:32.543800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750306+0000","last_change":"2024-09-11T22:15:48.750306+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750306+0000","last_undegraded":"2024-09-11T22:15:48.750306+0000","last_fullsized":"2024-09-11T22:15:48.750306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755495+0000","last_change":"2024-09-11T22:15:48.752014+0000","last_active":"2024-09-11T22:15:48.755495+0000","last_peered":"2024-09-11T22:15:48.755495+0000","last_clean":"2024-09-11T22:15:48.755495+0000","last_became_active":"2024-09-11T22:15:48.751698+0000","last_became_peered":"2024-09-11T22:15:48.751698+0000","last_unstale":"2024-09-11T22:15:48.755495+0000","last_undegraded":"2024-09-11T22:15:48.755495+0000","last_fullsized":"2024-09-11T22:15:48.755495+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:45.566372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.761832+0000","last_change":"2024-09-11T22:15:48.761323+0000","last_active":"2024-09-11T22:15:48.761832+0000","last_peered":"2024-09-11T22:15:48.761832+0000","last_clean":"2024-09-11T22:15:48.761832+0000","last_became_active":"2024-09-11T22:15:48.761013+0000","last_became_peered":"2024-09-11T22:15:48.761013+0000","last_unstale":"2024-09-11T22:15:48.761832+0000","last_undegraded":"2024-09-11T22:15:48.761832+0000","last_fullsized":"2024-09-11T22:15:48.761832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:29.128528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747047+0000","last_change":"2024-09-11T22:15:48.747047+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747047+0000","last_undegraded":"2024-09-11T22:15:48.747047+0000","last_fullsized":"2024-09-11T22:15:48.747047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.762304+0000","last_change":"2024-09-11T22:15:48.758059+0000","last_active":"2024-09-11T22:15:48.762304+0000","last_peered":"2024-09-11T22:15:48.762304+0000","last_clean":"2024-09-11T22:15:48.762304+0000","last_became_active":"2024-09-11T22:15:48.757769+0000","last_became_peered":"2024-09-11T22:15:48.757769+0000","last_unstale":"2024-09-11T22:15:48.762304+0000","last_undegraded":"2024-09-11T22:15:48.762304+0000","last_fullsized":"2024-09-11T22:15:48.762304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:39.198853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748634+0000","last_change":"2024-09-11T22:15:48.748634+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748634+0000","last_undegraded":"2024-09-11T22:15:48.748634+0000","last_fullsized":"2024-09-11T22:15:48.748634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760013+0000","last_change":"2024-09-11T22:15:48.756280+0000","last_active":"2024-09-11T22:15:48.760013+0000","last_peered":"2024-09-11T22:15:48.760013+0000","last_clean":"2024-09-11T22:15:48.760013+0000","last_became_active":"2024-09-11T22:15:48.755689+0000","last_became_peered":"2024-09-11T22:15:48.755689+0000","last_unstale":"2024-09-11T22:15:48.760013+0000","last_undegraded":"2024-09-11T22:15:48.760013+0000","last_fullsized":"2024-09-11T22:15:48.760013+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:22.009761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742122+0000","last_change":"2024-09-11T22:15:48.742122+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742122+0000","last_undegraded":"2024-09-11T22:15:48.742122+0000","last_fullsized":"2024-09-11T22:15:48.742122+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758989+0000","last_change":"2024-09-11T22:15:48.754680+0000","last_active":"2024-09-11T22:15:48.758989+0000","last_peered":"2024-09-11T22:15:48.758989+0000","last_clean":"2024-09-11T22:15:48.758989+0000","last_became_active":"2024-09-11T22:15:48.754396+0000","last_became_peered":"2024-09-11T22:15:48.754396+0000","last_unstale":"2024-09-11T22:15:48.758989+0000","last_undegraded":"2024-09-11T22:15:48.758989+0000","last_fullsized":"2024-09-11T22:15:48.758989+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:09.629914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748238+0000","last_change":"2024-09-11T22:15:48.748238+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748238+0000","last_undegraded":"2024-09-11T22:15:48.748238+0000","last_fullsized":"2024-09-11T22:15:48.748238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759982+0000","last_change":"2024-09-11T22:15:48.755977+0000","last_active":"2024-09-11T22:15:48.759982+0000","last_peered":"2024-09-11T22:15:48.759982+0000","last_clean":"2024-09-11T22:15:48.759982+0000","last_became_active":"2024-09-11T22:15:48.755357+0000","last_became_peered":"2024-09-11T22:15:48.755357+0000","last_unstale":"2024-09-11T22:15:48.759982+0000","last_undegraded":"2024-09-11T22:15:48.759982+0000","last_fullsized":"2024-09-11T22:15:48.759982+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:36.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759993+0000","last_change":"2024-09-11T22:15:48.755949+0000","last_active":"2024-09-11T22:15:48.759993+0000","last_peered":"2024-09-11T22:15:48.759993+0000","last_clean":"2024-09-11T22:15:48.759993+0000","last_became_active":"2024-09-11T22:15:48.755704+0000","last_became_peered":"2024-09-11T22:15:48.755704+0000","last_unstale":"2024-09-11T22:15:48.759993+0000","last_undegraded":"2024-09-11T22:15:48.759993+0000","last_fullsized":"2024-09-11T22:15:48.759993+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:48.772533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745331+0000","last_change":"2024-09-11T22:15:48.745331+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745331+0000","last_undegraded":"2024-09-11T22:15:48.745331+0000","last_fullsized":"2024-09-11T22:15:48.745331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760025+0000","last_change":"2024-09-11T22:15:48.756565+0000","last_active":"2024-09-11T22:15:48.760025+0000","last_peered":"2024-09-11T22:15:48.760025+0000","last_clean":"2024-09-11T22:15:48.760025+0000","last_became_active":"2024-09-11T22:15:48.755417+0000","last_became_peered":"2024-09-11T22:15:48.755417+0000","last_unstale":"2024-09-11T22:15:48.760025+0000","last_undegraded":"2024-09-11T22:15:48.760025+0000","last_fullsized":"2024-09-11T22:15:48.760025+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.697611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746647+0000","last_change":"2024-09-11T22:15:48.746647+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746647+0000","last_undegraded":"2024-09-11T22:15:48.746647+0000","last_fullsized":"2024-09-11T22:15:48.746647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:47.728585+0000","last_change":"2024-09-11T22:15:47.728585+0000","last_active":"2024-09-11T22:15:47.728585+0000","last_peered":"2024-09-11T22:15:47.728585+0000","last_clean":"2024-09-11T22:15:47.728585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:47.728585+0000","last_undegraded":"2024-09-11T22:15:47.728585+0000","last_fullsized":"2024-09-11T22:15:47.728585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":287,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:15:47.161800+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:15:47.161800+0000","last_peered":"2024-09-11T22:15:47.161800+0000","last_clean":"2024-09-11T22:15:47.161800+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:15:47.161800+0000","last_undegraded":"2024-09-11T22:15:47.161800+0000","last_fullsized":"2024-09-11T22:15:47.161800+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":7},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":62,"acting":62,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36384,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335456,"statfs":{"total":96636764160,"available":96599506944,"internally_reserved":0,"allocated":1060864,"data_stored":456180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1060864,"data_stored":456180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335468,"statfs":{"total":96636764160,"available":96599519232,"internally_reserved":0,"allocated":1048576,"data_stored":449905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1048576,"data_stored":449905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1060864,"data_stored":456180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41136,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330704,"statfs":{"total":96636764160,"available":96594640896,"internally_reserved":0,"allocated":1654784,"data_stored":1046548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41088,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330752,"statfs":{"total":96636764160,"available":96594690048,"internally_reserved":0,"allocated":1617920,"data_stored":1029399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1077248,"data_stored":463537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:15:53.091 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:15:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.229+0000 7f91160b7640 1 Processor -- start 2024-09-11T22:15:53.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.229+0000 7f91160b7640 1 -- start start 2024-09-11T22:15:53.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.229+0000 7f91160b7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f911015e870 0x7f91100d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f91160b7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91100d16d0 0x7f91100d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f91160b7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91100d3a30 0x7f91100b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f91160b7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f91100d1b40 con 0x7f91100d16d0 2024-09-11T22:15:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f91160b7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f91100cfa80 con 0x7f911015e870 2024-09-11T22:15:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f91160b7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f91100d3e50 con 0x7f91100d3a30 2024-09-11T22:15:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f910effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91100d16d0 0x7f91100d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f910effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91100d16d0 0x7f91100d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49850/0 (socket says 172.21.15.50:49850) 2024-09-11T22:15:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f910effd640 1 -- 172.21.15.50:0/3454550648 learned_addr learned my addr 172.21.15.50:0/3454550648 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f910ffff640 1 --2- 172.21.15.50:0/3454550648 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91100d3a30 0x7f91100b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f910f7fe640 1 --2- 172.21.15.50:0/3454550648 >> v2:172.21.15.77:3300/0 conn(0x7f911015e870 0x7f91100d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f910effd640 1 -- 172.21.15.50:0/3454550648 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91100d3a30 msgr2=0x7f91100b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:53.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f910effd640 1 --2- 172.21.15.50:0/3454550648 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91100d3a30 0x7f91100b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f910effd640 1 -- 172.21.15.50:0/3454550648 >> v2:172.21.15.77:3300/0 conn(0x7f911015e870 msgr2=0x7f91100d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:53.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f910effd640 1 --2- 172.21.15.50:0/3454550648 >> v2:172.21.15.77:3300/0 conn(0x7f911015e870 0x7f91100d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f910effd640 1 -- 172.21.15.50:0/3454550648 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91100d40d0 con 0x7f91100d16d0 2024-09-11T22:15:53.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.230+0000 7f910ffff640 1 --2- 172.21.15.50:0/3454550648 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91100d3a30 0x7f91100b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:53.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.231+0000 7f910effd640 1 --2- 172.21.15.50:0/3454550648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91100d16d0 0x7f91100d34f0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f91100d4000 tx=0x7f910402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b77b8e8743b2d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:53.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.231+0000 7f910e7fc640 1 -- 172.21.15.50:0/3454550648 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104037070 con 0x7f91100d16d0 2024-09-11T22:15:53.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.231+0000 7f910e7fc640 1 -- 172.21.15.50:0/3454550648 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9104032440 con 0x7f91100d16d0 2024-09-11T22:15:53.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.231+0000 7f910e7fc640 1 -- 172.21.15.50:0/3454550648 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104032810 con 0x7f91100d16d0 2024-09-11T22:15:53.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.231+0000 7f91160b7640 1 -- 172.21.15.50:0/3454550648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91100d16d0 msgr2=0x7f91100d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.231+0000 7f91160b7640 1 --2- 172.21.15.50:0/3454550648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91100d16d0 0x7f91100d34f0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f91100d4000 tx=0x7f910402a1c0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.232+0000 7f91160b7640 1 -- 172.21.15.50:0/3454550648 shutdown_connections 2024-09-11T22:15:53.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.232+0000 7f91160b7640 1 --2- 172.21.15.50:0/3454550648 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91100d3a30 0x7f91100b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.232+0000 7f91160b7640 1 --2- 172.21.15.50:0/3454550648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91100d16d0 0x7f91100d34f0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.232+0000 7f91160b7640 1 --2- 172.21.15.50:0/3454550648 >> v2:172.21.15.77:3300/0 conn(0x7f911015e870 0x7f91100d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.232+0000 7f91160b7640 1 -- 172.21.15.50:0/3454550648 >> 172.21.15.50:0/3454550648 conn(0x7f91100727a0 msgr2=0x7f91100679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.232+0000 7f91160b7640 1 -- 172.21.15.50:0/3454550648 shutdown_connections 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.232+0000 7f91160b7640 1 -- 172.21.15.50:0/3454550648 wait complete. 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.233+0000 7f91160b7640 1 Processor -- start 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.233+0000 7f91160b7640 1 -- start start 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f91160b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91100d16d0 0x7f91101f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f91160b7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91100d3a30 0x7f91100cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f91160b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f911015e870 0x7f91100cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f91160b7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f91100b7ee0 con 0x7f911015e870 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f91160b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f91100b7c00 con 0x7f91100d16d0 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f91160b7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f911015ec50 con 0x7f91100d3a30 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f910ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f911015e870 0x7f91100cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f910f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91100d16d0 0x7f91101f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f910ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f911015e870 0x7f91100cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49860/0 (socket says 172.21.15.50:49860) 2024-09-11T22:15:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f910ffff640 1 -- 172.21.15.50:0/2382509150 learned_addr learned my addr 172.21.15.50:0/2382509150 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f910effd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91100d3a30 0x7f91100cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f910f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91100d16d0 0x7f91101f41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:47292/0 (socket says 172.21.15.50:47292) 2024-09-11T22:15:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f910ffff640 1 -- 172.21.15.50:0/2382509150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91100d3a30 msgr2=0x7f91100cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f910ffff640 1 --2- 172.21.15.50:0/2382509150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91100d3a30 0x7f91100cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f910ffff640 1 -- 172.21.15.50:0/2382509150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91100d16d0 msgr2=0x7f91101f41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f910ffff640 1 --2- 172.21.15.50:0/2382509150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91100d16d0 0x7f91101f41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f910ffff640 1 -- 172.21.15.50:0/2382509150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91101f4730 con 0x7f911015e870 2024-09-11T22:15:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f910ffff640 1 --2- 172.21.15.50:0/2382509150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f911015e870 0x7f91100cdf60 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f9108007e10 tx=0x7f910800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.234+0000 7f90f7fff640 1 -- 172.21.15.50:0/2382509150 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910801a070 con 0x7f911015e870 2024-09-11T22:15:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.235+0000 7f90f7fff640 1 -- 172.21.15.50:0/2382509150 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9108003b90 con 0x7f911015e870 2024-09-11T22:15:53.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.235+0000 7f91160b7640 1 -- 172.21.15.50:0/2382509150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91101e7b40 con 0x7f911015e870 2024-09-11T22:15:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.235+0000 7f90f7fff640 1 -- 172.21.15.50:0/2382509150 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9108004030 con 0x7f911015e870 2024-09-11T22:15:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.235+0000 7f91160b7640 1 -- 172.21.15.50:0/2382509150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9110150800 con 0x7f911015e870 2024-09-11T22:15:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.236+0000 7f91160b7640 1 -- 172.21.15.50:0/2382509150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91100b78b0 con 0x7f911015e870 2024-09-11T22:15:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.236+0000 7f90f7fff640 1 -- 172.21.15.50:0/2382509150 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f910801d070 con 0x7f911015e870 2024-09-11T22:15:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.237+0000 7f90f7fff640 1 --2- 172.21.15.50:0/2382509150 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90fc06be30 0x7f90fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.237+0000 7f90f7fff640 1 -- 172.21.15.50:0/2382509150 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5709+0+0 (secure 0 0 0) 0x7f910808afe0 con 0x7f911015e870 2024-09-11T22:15:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.237+0000 7f910f7fe640 1 --2- 172.21.15.50:0/2382509150 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90fc06be30 0x7f90fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.237+0000 7f910f7fe640 1 --2- 172.21.15.50:0/2382509150 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90fc06be30 0x7f90fc06e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f91000079a0 tx=0x7f9100008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.241+0000 7f90f7fff640 1 -- 172.21.15.50:0/2382509150 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91101f4730 con 0x7f911015e870 2024-09-11T22:15:53.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.413+0000 7f91160b7640 1 -- 172.21.15.50:0/2382509150 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f91100ba530 con 0x7f90fc06be30 2024-09-11T22:15:53.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.419+0000 7f90f7fff640 1 -- 172.21.15.50:0/2382509150 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246616 (secure 0 0 0) 0x7f91100ba530 con 0x7f90fc06be30 2024-09-11T22:15:53.422 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:53.423 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:15:53.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.422+0000 7f91160b7640 1 -- 172.21.15.50:0/2382509150 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90fc06be30 msgr2=0x7f90fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.422+0000 7f91160b7640 1 --2- 172.21.15.50:0/2382509150 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90fc06be30 0x7f90fc06e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f91000079a0 tx=0x7f9100008040 comp rx=0 tx=0).stop 2024-09-11T22:15:53.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.422+0000 7f91160b7640 1 -- 172.21.15.50:0/2382509150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f911015e870 msgr2=0x7f91100cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.422+0000 7f91160b7640 1 --2- 172.21.15.50:0/2382509150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f911015e870 0x7f91100cdf60 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f9108007e10 tx=0x7f910800d4a0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.422+0000 7f91160b7640 1 -- 172.21.15.50:0/2382509150 shutdown_connections 2024-09-11T22:15:53.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.422+0000 7f91160b7640 1 --2- 172.21.15.50:0/2382509150 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90fc06be30 0x7f90fc06e2f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.422+0000 7f91160b7640 1 --2- 172.21.15.50:0/2382509150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91100d3a30 0x7f91100cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.422+0000 7f91160b7640 1 --2- 172.21.15.50:0/2382509150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f911015e870 0x7f91100cdf60 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.422+0000 7f91160b7640 1 --2- 172.21.15.50:0/2382509150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91100d16d0 0x7f91101f41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.422+0000 7f91160b7640 1 -- 172.21.15.50:0/2382509150 >> 172.21.15.50:0/2382509150 conn(0x7f91100727a0 msgr2=0x7f9110160350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:53.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.422+0000 7f91160b7640 1 -- 172.21.15.50:0/2382509150 shutdown_connections 2024-09-11T22:15:53.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.422+0000 7f91160b7640 1 -- 172.21.15.50:0/2382509150 wait complete. 2024-09-11T22:15:53.434 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-11T22:15:51.430310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275584,"kb_used_data":9404,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754699136,"statfs":{"total":773094113280,"available":772811915264,"internally_reserved":0,"allocated":9629696,"data_stored":4807834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":272354865},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000862"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747768+0000","last_change":"2024-09-11T22:15:48.747768+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747768+0000","last_undegraded":"2024-09-11T22:15:48.747768+0000","last_fullsized":"2024-09-11T22:15:48.747768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747921+0000","last_change":"2024-09-11T22:15:48.747921+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747921+0000","last_undegraded":"2024-09-11T22:15:48.747921+0000","last_fullsized":"2024-09-11T22:15:48.747921+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.763531+0000","last_change":"2024-09-11T22:15:49.754010+0000","last_active":"2024-09-11T22:15:49.763531+0000","last_peered":"2024-09-11T22:15:49.763531+0000","last_clean":"2024-09-11T22:15:49.763531+0000","last_became_active":"2024-09-11T22:15:49.753139+0000","last_became_peered":"2024-09-11T22:15:49.753139+0000","last_unstale":"2024-09-11T22:15:49.763531+0000","last_undegraded":"2024-09-11T22:15:49.763531+0000","last_fullsized":"2024-09-11T22:15:49.763531+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:14.317044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750436+0000","last_change":"2024-09-11T22:15:48.750436+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750436+0000","last_undegraded":"2024-09-11T22:15:48.750436+0000","last_fullsized":"2024-09-11T22:15:48.750436+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.743047+0000","last_change":"2024-09-11T22:15:48.743047+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.743047+0000","last_undegraded":"2024-09-11T22:15:48.743047+0000","last_fullsized":"2024-09-11T22:15:48.743047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.766286+0000","last_change":"2024-09-11T22:15:49.762290+0000","last_active":"2024-09-11T22:15:49.766286+0000","last_peered":"2024-09-11T22:15:49.766286+0000","last_clean":"2024-09-11T22:15:49.766286+0000","last_became_active":"2024-09-11T22:15:49.762021+0000","last_became_peered":"2024-09-11T22:15:49.762021+0000","last_unstale":"2024-09-11T22:15:49.766286+0000","last_undegraded":"2024-09-11T22:15:49.766286+0000","last_fullsized":"2024-09-11T22:15:49.766286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:24.752761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742623+0000","last_change":"2024-09-11T22:15:48.742623+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742623+0000","last_undegraded":"2024-09-11T22:15:48.742623+0000","last_fullsized":"2024-09-11T22:15:48.742623+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742644+0000","last_change":"2024-09-11T22:15:48.742644+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742644+0000","last_undegraded":"2024-09-11T22:15:48.742644+0000","last_fullsized":"2024-09-11T22:15:48.742644+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746572+0000","last_change":"2024-09-11T22:15:48.746572+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746572+0000","last_undegraded":"2024-09-11T22:15:48.746572+0000","last_fullsized":"2024-09-11T22:15:48.746572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747412+0000","last_change":"2024-09-11T22:15:48.747412+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747412+0000","last_undegraded":"2024-09-11T22:15:48.747412+0000","last_fullsized":"2024-09-11T22:15:48.747412+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748236+0000","last_change":"2024-09-11T22:15:48.748236+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748236+0000","last_undegraded":"2024-09-11T22:15:48.748236+0000","last_fullsized":"2024-09-11T22:15:48.748236+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.763418+0000","last_change":"2024-09-11T22:15:49.758506+0000","last_active":"2024-09-11T22:15:49.763418+0000","last_peered":"2024-09-11T22:15:49.763418+0000","last_clean":"2024-09-11T22:15:49.763418+0000","last_became_active":"2024-09-11T22:15:49.757038+0000","last_became_peered":"2024-09-11T22:15:49.757038+0000","last_unstale":"2024-09-11T22:15:49.763418+0000","last_undegraded":"2024-09-11T22:15:49.763418+0000","last_fullsized":"2024-09-11T22:15:49.763418+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:29.096221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746473+0000","last_change":"2024-09-11T22:15:48.746473+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746473+0000","last_undegraded":"2024-09-11T22:15:48.746473+0000","last_fullsized":"2024-09-11T22:15:48.746473+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746585+0000","last_change":"2024-09-11T22:15:48.746585+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746585+0000","last_undegraded":"2024-09-11T22:15:48.746585+0000","last_fullsized":"2024-09-11T22:15:48.746585+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747253+0000","last_change":"2024-09-11T22:15:48.747253+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747253+0000","last_undegraded":"2024-09-11T22:15:48.747253+0000","last_fullsized":"2024-09-11T22:15:48.747253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.758932+0000","last_change":"2024-09-11T22:15:49.757671+0000","last_active":"2024-09-11T22:15:49.758932+0000","last_peered":"2024-09-11T22:15:49.758932+0000","last_clean":"2024-09-11T22:15:49.758932+0000","last_became_active":"2024-09-11T22:15:49.757377+0000","last_became_peered":"2024-09-11T22:15:49.757377+0000","last_unstale":"2024-09-11T22:15:49.758932+0000","last_undegraded":"2024-09-11T22:15:49.758932+0000","last_fullsized":"2024-09-11T22:15:49.758932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:14:20.129904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748503+0000","last_change":"2024-09-11T22:15:48.748503+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748503+0000","last_undegraded":"2024-09-11T22:15:48.748503+0000","last_fullsized":"2024-09-11T22:15:48.748503+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768399+0000","last_change":"2024-09-11T22:15:49.766261+0000","last_active":"2024-09-11T22:15:49.768399+0000","last_peered":"2024-09-11T22:15:49.768399+0000","last_clean":"2024-09-11T22:15:49.768399+0000","last_became_active":"2024-09-11T22:15:49.765950+0000","last_became_peered":"2024-09-11T22:15:49.765950+0000","last_unstale":"2024-09-11T22:15:49.768399+0000","last_undegraded":"2024-09-11T22:15:49.768399+0000","last_fullsized":"2024-09-11T22:15:49.768399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:19.770913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768497+0000","last_change":"2024-09-11T22:15:49.767809+0000","last_active":"2024-09-11T22:15:49.768497+0000","last_peered":"2024-09-11T22:15:49.768497+0000","last_clean":"2024-09-11T22:15:49.768497+0000","last_became_active":"2024-09-11T22:15:49.767536+0000","last_became_peered":"2024-09-11T22:15:49.767536+0000","last_unstale":"2024-09-11T22:15:49.768497+0000","last_undegraded":"2024-09-11T22:15:49.768497+0000","last_fullsized":"2024-09-11T22:15:49.768497+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:24.521444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747538+0000","last_change":"2024-09-11T22:15:48.747538+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747538+0000","last_undegraded":"2024-09-11T22:15:48.747538+0000","last_fullsized":"2024-09-11T22:15:48.747538+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745834+0000","last_change":"2024-09-11T22:15:48.745834+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745834+0000","last_undegraded":"2024-09-11T22:15:48.745834+0000","last_fullsized":"2024-09-11T22:15:48.745834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768087+0000","last_change":"2024-09-11T22:15:49.765353+0000","last_active":"2024-09-11T22:15:49.768087+0000","last_peered":"2024-09-11T22:15:49.768087+0000","last_clean":"2024-09-11T22:15:49.768087+0000","last_became_active":"2024-09-11T22:15:49.765075+0000","last_became_peered":"2024-09-11T22:15:49.765075+0000","last_unstale":"2024-09-11T22:15:49.768087+0000","last_undegraded":"2024-09-11T22:15:49.768087+0000","last_fullsized":"2024-09-11T22:15:49.768087+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:19.201559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747439+0000","last_change":"2024-09-11T22:15:48.747439+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747439+0000","last_undegraded":"2024-09-11T22:15:48.747439+0000","last_fullsized":"2024-09-11T22:15:48.747439+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750559+0000","last_change":"2024-09-11T22:15:48.750559+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750559+0000","last_undegraded":"2024-09-11T22:15:48.750559+0000","last_fullsized":"2024-09-11T22:15:48.750559+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747831+0000","last_change":"2024-09-11T22:15:48.747831+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747831+0000","last_undegraded":"2024-09-11T22:15:48.747831+0000","last_fullsized":"2024-09-11T22:15:48.747831+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746859+0000","last_change":"2024-09-11T22:15:48.746859+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746859+0000","last_undegraded":"2024-09-11T22:15:48.746859+0000","last_fullsized":"2024-09-11T22:15:48.746859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746836+0000","last_change":"2024-09-11T22:15:48.746836+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746836+0000","last_undegraded":"2024-09-11T22:15:48.746836+0000","last_fullsized":"2024-09-11T22:15:48.746836+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749188+0000","last_change":"2024-09-11T22:15:48.749188+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749188+0000","last_undegraded":"2024-09-11T22:15:48.749188+0000","last_fullsized":"2024-09-11T22:15:48.749188+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746510+0000","last_change":"2024-09-11T22:15:48.746510+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746510+0000","last_undegraded":"2024-09-11T22:15:48.746510+0000","last_fullsized":"2024-09-11T22:15:48.746510+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750702+0000","last_change":"2024-09-11T22:15:48.750702+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750702+0000","last_undegraded":"2024-09-11T22:15:48.750702+0000","last_fullsized":"2024-09-11T22:15:48.750702+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760074+0000","last_change":"2024-09-11T22:15:48.757358+0000","last_active":"2024-09-11T22:15:48.760074+0000","last_peered":"2024-09-11T22:15:48.760074+0000","last_clean":"2024-09-11T22:15:48.760074+0000","last_became_active":"2024-09-11T22:15:48.756802+0000","last_became_peered":"2024-09-11T22:15:48.756802+0000","last_unstale":"2024-09-11T22:15:48.760074+0000","last_undegraded":"2024-09-11T22:15:48.760074+0000","last_fullsized":"2024-09-11T22:15:48.760074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:04.770101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747395+0000","last_change":"2024-09-11T22:15:48.747395+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747395+0000","last_undegraded":"2024-09-11T22:15:48.747395+0000","last_fullsized":"2024-09-11T22:15:48.747395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759974+0000","last_change":"2024-09-11T22:15:48.755723+0000","last_active":"2024-09-11T22:15:48.759974+0000","last_peered":"2024-09-11T22:15:48.759974+0000","last_clean":"2024-09-11T22:15:48.759974+0000","last_became_active":"2024-09-11T22:15:48.755202+0000","last_became_peered":"2024-09-11T22:15:48.755202+0000","last_unstale":"2024-09-11T22:15:48.759974+0000","last_undegraded":"2024-09-11T22:15:48.759974+0000","last_fullsized":"2024-09-11T22:15:48.759974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:24.239471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747430+0000","last_change":"2024-09-11T22:15:48.747430+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747430+0000","last_undegraded":"2024-09-11T22:15:48.747430+0000","last_fullsized":"2024-09-11T22:15:48.747430+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758066+0000","last_change":"2024-09-11T22:15:48.756677+0000","last_active":"2024-09-11T22:15:48.758066+0000","last_peered":"2024-09-11T22:15:48.758066+0000","last_clean":"2024-09-11T22:15:48.758066+0000","last_became_active":"2024-09-11T22:15:48.756204+0000","last_became_peered":"2024-09-11T22:15:48.756204+0000","last_unstale":"2024-09-11T22:15:48.758066+0000","last_undegraded":"2024-09-11T22:15:48.758066+0000","last_fullsized":"2024-09-11T22:15:48.758066+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:09.406534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.761845+0000","last_change":"2024-09-11T22:15:48.760604+0000","last_active":"2024-09-11T22:15:48.761845+0000","last_peered":"2024-09-11T22:15:48.761845+0000","last_clean":"2024-09-11T22:15:48.761845+0000","last_became_active":"2024-09-11T22:15:48.760301+0000","last_became_peered":"2024-09-11T22:15:48.760301+0000","last_unstale":"2024-09-11T22:15:48.761845+0000","last_undegraded":"2024-09-11T22:15:48.761845+0000","last_fullsized":"2024-09-11T22:15:48.761845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:14.750107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746353+0000","last_change":"2024-09-11T22:15:48.746353+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746353+0000","last_undegraded":"2024-09-11T22:15:48.746353+0000","last_fullsized":"2024-09-11T22:15:48.746353+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760021+0000","last_change":"2024-09-11T22:15:48.756889+0000","last_active":"2024-09-11T22:15:48.760021+0000","last_peered":"2024-09-11T22:15:48.760021+0000","last_clean":"2024-09-11T22:15:48.760021+0000","last_became_active":"2024-09-11T22:15:48.756634+0000","last_became_peered":"2024-09-11T22:15:48.756634+0000","last_unstale":"2024-09-11T22:15:48.760021+0000","last_undegraded":"2024-09-11T22:15:48.760021+0000","last_fullsized":"2024-09-11T22:15:48.760021+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:09.629914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750043+0000","last_change":"2024-09-11T22:15:48.750043+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750043+0000","last_undegraded":"2024-09-11T22:15:48.750043+0000","last_fullsized":"2024-09-11T22:15:48.750043+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760107+0000","last_change":"2024-09-11T22:15:48.757211+0000","last_active":"2024-09-11T22:15:48.760107+0000","last_peered":"2024-09-11T22:15:48.760107+0000","last_clean":"2024-09-11T22:15:48.760107+0000","last_became_active":"2024-09-11T22:15:48.756934+0000","last_became_peered":"2024-09-11T22:15:48.756934+0000","last_unstale":"2024-09-11T22:15:48.760107+0000","last_undegraded":"2024-09-11T22:15:48.760107+0000","last_fullsized":"2024-09-11T22:15:48.760107+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:09.406534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758925+0000","last_change":"2024-09-11T22:15:48.758321+0000","last_active":"2024-09-11T22:15:48.758925+0000","last_peered":"2024-09-11T22:15:48.758925+0000","last_clean":"2024-09-11T22:15:48.758925+0000","last_became_active":"2024-09-11T22:15:48.758058+0000","last_became_peered":"2024-09-11T22:15:48.758058+0000","last_unstale":"2024-09-11T22:15:48.758925+0000","last_undegraded":"2024-09-11T22:15:48.758925+0000","last_fullsized":"2024-09-11T22:15:48.758925+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:04.531093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745995+0000","last_change":"2024-09-11T22:15:48.745995+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745995+0000","last_undegraded":"2024-09-11T22:15:48.745995+0000","last_fullsized":"2024-09-11T22:15:48.745995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.757688+0000","last_change":"2024-09-11T22:15:48.755608+0000","last_active":"2024-09-11T22:15:48.757688+0000","last_peered":"2024-09-11T22:15:48.757688+0000","last_clean":"2024-09-11T22:15:48.757688+0000","last_became_active":"2024-09-11T22:15:48.755303+0000","last_became_peered":"2024-09-11T22:15:48.755303+0000","last_unstale":"2024-09-11T22:15:48.757688+0000","last_undegraded":"2024-09-11T22:15:48.757688+0000","last_fullsized":"2024-09-11T22:15:48.757688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:06.185360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.744931+0000","last_change":"2024-09-11T22:15:48.744931+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.744931+0000","last_undegraded":"2024-09-11T22:15:48.744931+0000","last_fullsized":"2024-09-11T22:15:48.744931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755140+0000","last_change":"2024-09-11T22:15:48.753492+0000","last_active":"2024-09-11T22:15:48.755140+0000","last_peered":"2024-09-11T22:15:48.755140+0000","last_clean":"2024-09-11T22:15:48.755140+0000","last_became_active":"2024-09-11T22:15:48.753269+0000","last_became_peered":"2024-09-11T22:15:48.753269+0000","last_unstale":"2024-09-11T22:15:48.755140+0000","last_undegraded":"2024-09-11T22:15:48.755140+0000","last_fullsized":"2024-09-11T22:15:48.755140+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:33.429722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742179+0000","last_change":"2024-09-11T22:15:48.742179+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742179+0000","last_undegraded":"2024-09-11T22:15:48.742179+0000","last_fullsized":"2024-09-11T22:15:48.742179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759990+0000","last_change":"2024-09-11T22:15:48.756378+0000","last_active":"2024-09-11T22:15:48.759990+0000","last_peered":"2024-09-11T22:15:48.759990+0000","last_clean":"2024-09-11T22:15:48.759990+0000","last_became_active":"2024-09-11T22:15:48.756100+0000","last_became_peered":"2024-09-11T22:15:48.756100+0000","last_unstale":"2024-09-11T22:15:48.759990+0000","last_undegraded":"2024-09-11T22:15:48.759990+0000","last_fullsized":"2024-09-11T22:15:48.759990+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:32.253582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749135+0000","last_change":"2024-09-11T22:15:48.749135+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749135+0000","last_undegraded":"2024-09-11T22:15:48.749135+0000","last_fullsized":"2024-09-11T22:15:48.749135+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755160+0000","last_change":"2024-09-11T22:15:48.753488+0000","last_active":"2024-09-11T22:15:48.755160+0000","last_peered":"2024-09-11T22:15:48.755160+0000","last_clean":"2024-09-11T22:15:48.755160+0000","last_became_active":"2024-09-11T22:15:48.753210+0000","last_became_peered":"2024-09-11T22:15:48.753210+0000","last_unstale":"2024-09-11T22:15:48.755160+0000","last_undegraded":"2024-09-11T22:15:48.755160+0000","last_fullsized":"2024-09-11T22:15:48.755160+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:32.456027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749612+0000","last_change":"2024-09-11T22:15:48.749612+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749612+0000","last_undegraded":"2024-09-11T22:15:48.749612+0000","last_fullsized":"2024-09-11T22:15:48.749612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.748267+0000","last_change":"2024-09-11T22:15:48.745068+0000","last_active":"2024-09-11T22:15:48.748267+0000","last_peered":"2024-09-11T22:15:48.748267+0000","last_clean":"2024-09-11T22:15:48.748267+0000","last_became_active":"2024-09-11T22:15:48.744801+0000","last_became_peered":"2024-09-11T22:15:48.744801+0000","last_unstale":"2024-09-11T22:15:48.748267+0000","last_undegraded":"2024-09-11T22:15:48.748267+0000","last_fullsized":"2024-09-11T22:15:48.748267+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:58.192598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749608+0000","last_change":"2024-09-11T22:15:48.749608+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749608+0000","last_undegraded":"2024-09-11T22:15:48.749608+0000","last_fullsized":"2024-09-11T22:15:48.749608+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.761659+0000","last_change":"2024-09-11T22:15:48.760851+0000","last_active":"2024-09-11T22:15:48.761659+0000","last_peered":"2024-09-11T22:15:48.761659+0000","last_clean":"2024-09-11T22:15:48.761659+0000","last_became_active":"2024-09-11T22:15:48.760540+0000","last_became_peered":"2024-09-11T22:15:48.760540+0000","last_unstale":"2024-09-11T22:15:48.761659+0000","last_undegraded":"2024-09-11T22:15:48.761659+0000","last_fullsized":"2024-09-11T22:15:48.761659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:13.738702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.756262+0000","last_change":"2024-09-11T22:15:48.753807+0000","last_active":"2024-09-11T22:15:48.756262+0000","last_peered":"2024-09-11T22:15:48.756262+0000","last_clean":"2024-09-11T22:15:48.756262+0000","last_became_active":"2024-09-11T22:15:48.753523+0000","last_became_peered":"2024-09-11T22:15:48.753523+0000","last_unstale":"2024-09-11T22:15:48.756262+0000","last_undegraded":"2024-09-11T22:15:48.756262+0000","last_fullsized":"2024-09-11T22:15:48.756262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:49.929465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746178+0000","last_change":"2024-09-11T22:15:48.746178+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746178+0000","last_undegraded":"2024-09-11T22:15:48.746178+0000","last_fullsized":"2024-09-11T22:15:48.746178+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755209+0000","last_change":"2024-09-11T22:15:48.752805+0000","last_active":"2024-09-11T22:15:48.755209+0000","last_peered":"2024-09-11T22:15:48.755209+0000","last_clean":"2024-09-11T22:15:48.755209+0000","last_became_active":"2024-09-11T22:15:48.752539+0000","last_became_peered":"2024-09-11T22:15:48.752539+0000","last_unstale":"2024-09-11T22:15:48.755209+0000","last_undegraded":"2024-09-11T22:15:48.755209+0000","last_fullsized":"2024-09-11T22:15:48.755209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:41.877937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745290+0000","last_change":"2024-09-11T22:15:48.745290+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745290+0000","last_undegraded":"2024-09-11T22:15:48.745290+0000","last_fullsized":"2024-09-11T22:15:48.745290+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755164+0000","last_change":"2024-09-11T22:15:48.753365+0000","last_active":"2024-09-11T22:15:48.755164+0000","last_peered":"2024-09-11T22:15:48.755164+0000","last_clean":"2024-09-11T22:15:48.755164+0000","last_became_active":"2024-09-11T22:15:48.753060+0000","last_became_peered":"2024-09-11T22:15:48.753060+0000","last_unstale":"2024-09-11T22:15:48.755164+0000","last_undegraded":"2024-09-11T22:15:48.755164+0000","last_fullsized":"2024-09-11T22:15:48.755164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:36.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.751840+0000","last_change":"2024-09-11T22:15:48.750585+0000","last_active":"2024-09-11T22:15:48.751840+0000","last_peered":"2024-09-11T22:15:48.751840+0000","last_clean":"2024-09-11T22:15:48.751840+0000","last_became_active":"2024-09-11T22:15:48.750301+0000","last_became_peered":"2024-09-11T22:15:48.750301+0000","last_unstale":"2024-09-11T22:15:48.751840+0000","last_undegraded":"2024-09-11T22:15:48.751840+0000","last_fullsized":"2024-09-11T22:15:48.751840+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:58.163220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746993+0000","last_change":"2024-09-11T22:15:48.746993+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746993+0000","last_undegraded":"2024-09-11T22:15:48.746993+0000","last_fullsized":"2024-09-11T22:15:48.746993+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.762156+0000","last_change":"2024-09-11T22:15:48.761035+0000","last_active":"2024-09-11T22:15:48.762156+0000","last_peered":"2024-09-11T22:15:48.762156+0000","last_clean":"2024-09-11T22:15:48.762156+0000","last_became_active":"2024-09-11T22:15:48.760673+0000","last_became_peered":"2024-09-11T22:15:48.760673+0000","last_unstale":"2024-09-11T22:15:48.762156+0000","last_undegraded":"2024-09-11T22:15:48.762156+0000","last_fullsized":"2024-09-11T22:15:48.762156+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:29.306669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749059+0000","last_change":"2024-09-11T22:15:48.749059+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749059+0000","last_undegraded":"2024-09-11T22:15:48.749059+0000","last_fullsized":"2024-09-11T22:15:48.749059+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755116+0000","last_change":"2024-09-11T22:15:48.753389+0000","last_active":"2024-09-11T22:15:48.755116+0000","last_peered":"2024-09-11T22:15:48.755116+0000","last_clean":"2024-09-11T22:15:48.755116+0000","last_became_active":"2024-09-11T22:15:48.753078+0000","last_became_peered":"2024-09-11T22:15:48.753078+0000","last_unstale":"2024-09-11T22:15:48.755116+0000","last_undegraded":"2024-09-11T22:15:48.755116+0000","last_fullsized":"2024-09-11T22:15:48.755116+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.697611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.763395+0000","last_change":"2024-09-11T22:15:49.758184+0000","last_active":"2024-09-11T22:15:49.763395+0000","last_peered":"2024-09-11T22:15:49.763395+0000","last_clean":"2024-09-11T22:15:49.763395+0000","last_became_active":"2024-09-11T22:15:49.756641+0000","last_became_peered":"2024-09-11T22:15:49.756641+0000","last_unstale":"2024-09-11T22:15:49.763395+0000","last_undegraded":"2024-09-11T22:15:49.763395+0000","last_fullsized":"2024-09-11T22:15:49.763395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:36.042212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.757296+0000","last_change":"2024-09-11T22:15:48.756390+0000","last_active":"2024-09-11T22:15:48.757296+0000","last_peered":"2024-09-11T22:15:48.757296+0000","last_clean":"2024-09-11T22:15:48.757296+0000","last_became_active":"2024-09-11T22:15:48.756076+0000","last_became_peered":"2024-09-11T22:15:48.756076+0000","last_unstale":"2024-09-11T22:15:48.757296+0000","last_undegraded":"2024-09-11T22:15:48.757296+0000","last_fullsized":"2024-09-11T22:15:48.757296+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:47.594034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742120+0000","last_change":"2024-09-11T22:15:48.742120+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742120+0000","last_undegraded":"2024-09-11T22:15:48.742120+0000","last_fullsized":"2024-09-11T22:15:48.742120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.744129+0000","last_change":"2024-09-11T22:15:48.756655+0000","last_active":"2024-09-11T22:15:49.744129+0000","last_peered":"2024-09-11T22:15:49.744129+0000","last_clean":"2024-09-11T22:15:49.744129+0000","last_became_active":"2024-09-11T22:15:48.756399+0000","last_became_peered":"2024-09-11T22:15:48.756399+0000","last_unstale":"2024-09-11T22:15:49.744129+0000","last_undegraded":"2024-09-11T22:15:49.744129+0000","last_fullsized":"2024-09-11T22:15:49.744129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:51.759680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768065+0000","last_change":"2024-09-11T22:15:49.764525+0000","last_active":"2024-09-11T22:15:49.768065+0000","last_peered":"2024-09-11T22:15:49.768065+0000","last_clean":"2024-09-11T22:15:49.768065+0000","last_became_active":"2024-09-11T22:15:49.764235+0000","last_became_peered":"2024-09-11T22:15:49.764235+0000","last_unstale":"2024-09-11T22:15:49.768065+0000","last_undegraded":"2024-09-11T22:15:49.768065+0000","last_fullsized":"2024-09-11T22:15:49.768065+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.283321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.744055+0000","last_change":"2024-09-11T22:15:48.753604+0000","last_active":"2024-09-11T22:15:49.744055+0000","last_peered":"2024-09-11T22:15:49.744055+0000","last_clean":"2024-09-11T22:15:49.744055+0000","last_became_active":"2024-09-11T22:15:48.753332+0000","last_became_peered":"2024-09-11T22:15:48.753332+0000","last_unstale":"2024-09-11T22:15:49.744055+0000","last_undegraded":"2024-09-11T22:15:49.744055+0000","last_fullsized":"2024-09-11T22:15:49.744055+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:53.705437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742099+0000","last_change":"2024-09-11T22:15:48.742099+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742099+0000","last_undegraded":"2024-09-11T22:15:48.742099+0000","last_fullsized":"2024-09-11T22:15:48.742099+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758032+0000","last_change":"2024-09-11T22:15:48.757138+0000","last_active":"2024-09-11T22:15:48.758032+0000","last_peered":"2024-09-11T22:15:48.758032+0000","last_clean":"2024-09-11T22:15:48.758032+0000","last_became_active":"2024-09-11T22:15:48.756810+0000","last_became_peered":"2024-09-11T22:15:48.756810+0000","last_unstale":"2024-09-11T22:15:48.758032+0000","last_undegraded":"2024-09-11T22:15:48.758032+0000","last_fullsized":"2024-09-11T22:15:48.758032+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:32.543800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750306+0000","last_change":"2024-09-11T22:15:48.750306+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750306+0000","last_undegraded":"2024-09-11T22:15:48.750306+0000","last_fullsized":"2024-09-11T22:15:48.750306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755495+0000","last_change":"2024-09-11T22:15:48.752014+0000","last_active":"2024-09-11T22:15:48.755495+0000","last_peered":"2024-09-11T22:15:48.755495+0000","last_clean":"2024-09-11T22:15:48.755495+0000","last_became_active":"2024-09-11T22:15:48.751698+0000","last_became_peered":"2024-09-11T22:15:48.751698+0000","last_unstale":"2024-09-11T22:15:48.755495+0000","last_undegraded":"2024-09-11T22:15:48.755495+0000","last_fullsized":"2024-09-11T22:15:48.755495+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:45.566372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.761832+0000","last_change":"2024-09-11T22:15:48.761323+0000","last_active":"2024-09-11T22:15:48.761832+0000","last_peered":"2024-09-11T22:15:48.761832+0000","last_clean":"2024-09-11T22:15:48.761832+0000","last_became_active":"2024-09-11T22:15:48.761013+0000","last_became_peered":"2024-09-11T22:15:48.761013+0000","last_unstale":"2024-09-11T22:15:48.761832+0000","last_undegraded":"2024-09-11T22:15:48.761832+0000","last_fullsized":"2024-09-11T22:15:48.761832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:29.128528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747047+0000","last_change":"2024-09-11T22:15:48.747047+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747047+0000","last_undegraded":"2024-09-11T22:15:48.747047+0000","last_fullsized":"2024-09-11T22:15:48.747047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.762304+0000","last_change":"2024-09-11T22:15:48.758059+0000","last_active":"2024-09-11T22:15:48.762304+0000","last_peered":"2024-09-11T22:15:48.762304+0000","last_clean":"2024-09-11T22:15:48.762304+0000","last_became_active":"2024-09-11T22:15:48.757769+0000","last_became_peered":"2024-09-11T22:15:48.757769+0000","last_unstale":"2024-09-11T22:15:48.762304+0000","last_undegraded":"2024-09-11T22:15:48.762304+0000","last_fullsized":"2024-09-11T22:15:48.762304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:39.198853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748634+0000","last_change":"2024-09-11T22:15:48.748634+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748634+0000","last_undegraded":"2024-09-11T22:15:48.748634+0000","last_fullsized":"2024-09-11T22:15:48.748634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760013+0000","last_change":"2024-09-11T22:15:48.756280+0000","last_active":"2024-09-11T22:15:48.760013+0000","last_peered":"2024-09-11T22:15:48.760013+0000","last_clean":"2024-09-11T22:15:48.760013+0000","last_became_active":"2024-09-11T22:15:48.755689+0000","last_became_peered":"2024-09-11T22:15:48.755689+0000","last_unstale":"2024-09-11T22:15:48.760013+0000","last_undegraded":"2024-09-11T22:15:48.760013+0000","last_fullsized":"2024-09-11T22:15:48.760013+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:22.009761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742122+0000","last_change":"2024-09-11T22:15:48.742122+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742122+0000","last_undegraded":"2024-09-11T22:15:48.742122+0000","last_fullsized":"2024-09-11T22:15:48.742122+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758989+0000","last_change":"2024-09-11T22:15:48.754680+0000","last_active":"2024-09-11T22:15:48.758989+0000","last_peered":"2024-09-11T22:15:48.758989+0000","last_clean":"2024-09-11T22:15:48.758989+0000","last_became_active":"2024-09-11T22:15:48.754396+0000","last_became_peered":"2024-09-11T22:15:48.754396+0000","last_unstale":"2024-09-11T22:15:48.758989+0000","last_undegraded":"2024-09-11T22:15:48.758989+0000","last_fullsized":"2024-09-11T22:15:48.758989+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:09.629914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748238+0000","last_change":"2024-09-11T22:15:48.748238+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748238+0000","last_undegraded":"2024-09-11T22:15:48.748238+0000","last_fullsized":"2024-09-11T22:15:48.748238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759982+0000","last_change":"2024-09-11T22:15:48.755977+0000","last_active":"2024-09-11T22:15:48.759982+0000","last_peered":"2024-09-11T22:15:48.759982+0000","last_clean":"2024-09-11T22:15:48.759982+0000","last_became_active":"2024-09-11T22:15:48.755357+0000","last_became_peered":"2024-09-11T22:15:48.755357+0000","last_unstale":"2024-09-11T22:15:48.759982+0000","last_undegraded":"2024-09-11T22:15:48.759982+0000","last_fullsized":"2024-09-11T22:15:48.759982+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:36.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:48.734082+0000","last_change":"2024-09-11T22:15:48.734082+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.734082+0000","last_undegraded":"2024-09-11T22:15:48.734082+0000","last_fullsized":"2024-09-11T22:15:48.734082+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759993+0000","last_change":"2024-09-11T22:15:48.755949+0000","last_active":"2024-09-11T22:15:48.759993+0000","last_peered":"2024-09-11T22:15:48.759993+0000","last_clean":"2024-09-11T22:15:48.759993+0000","last_became_active":"2024-09-11T22:15:48.755704+0000","last_became_peered":"2024-09-11T22:15:48.755704+0000","last_unstale":"2024-09-11T22:15:48.759993+0000","last_undegraded":"2024-09-11T22:15:48.759993+0000","last_fullsized":"2024-09-11T22:15:48.759993+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:48.772533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745331+0000","last_change":"2024-09-11T22:15:48.745331+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745331+0000","last_undegraded":"2024-09-11T22:15:48.745331+0000","last_fullsized":"2024-09-11T22:15:48.745331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760025+0000","last_change":"2024-09-11T22:15:48.756565+0000","last_active":"2024-09-11T22:15:48.760025+0000","last_peered":"2024-09-11T22:15:48.760025+0000","last_clean":"2024-09-11T22:15:48.760025+0000","last_became_active":"2024-09-11T22:15:48.755417+0000","last_became_peered":"2024-09-11T22:15:48.755417+0000","last_unstale":"2024-09-11T22:15:48.760025+0000","last_undegraded":"2024-09-11T22:15:48.760025+0000","last_fullsized":"2024-09-11T22:15:48.760025+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.697611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746647+0000","last_change":"2024-09-11T22:15:48.746647+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746647+0000","last_undegraded":"2024-09-11T22:15:48.746647+0000","last_fullsized":"2024-09-11T22:15:48.746647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:15:47.728585+0000","last_change":"2024-09-11T22:15:47.728585+0000","last_active":"2024-09-11T22:15:47.728585+0000","last_peered":"2024-09-11T22:15:47.728585+0000","last_clean":"2024-09-11T22:15:47.728585+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:47.728585+0000","last_undegraded":"2024-09-11T22:15:47.728585+0000","last_fullsized":"2024-09-11T22:15:47.728585+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":287,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-11T22:15:47.161800+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:15:47.161800+0000","last_peered":"2024-09-11T22:15:47.161800+0000","last_clean":"2024-09-11T22:15:47.161800+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:15:47.161800+0000","last_undegraded":"2024-09-11T22:15:47.161800+0000","last_fullsized":"2024-09-11T22:15:47.161800+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":7},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":62,"acting":62,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36384,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335456,"statfs":{"total":96636764160,"available":96599506944,"internally_reserved":0,"allocated":1060864,"data_stored":456180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1060864,"data_stored":456180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335468,"statfs":{"total":96636764160,"available":96599519232,"internally_reserved":0,"allocated":1048576,"data_stored":449905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1048576,"data_stored":449905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1060864,"data_stored":456180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41136,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330704,"statfs":{"total":96636764160,"available":96594640896,"internally_reserved":0,"allocated":1654784,"data_stored":1046548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41088,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330752,"statfs":{"total":96636764160,"available":96594690048,"internally_reserved":0,"allocated":1617920,"data_stored":1029399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1077248,"data_stored":463537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:15:53.437 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3f is not active+clean 2024-09-11T22:15:53.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.747768+0000', 'last_change': '2024-09-11T22:15:48.747768+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.747768+0000', 'last_undegraded': '2024-09-11T22:15:48.747768+0000', 'last_fullsized': '2024-09-11T22:15:48.747768+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:15:53.437 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3e is not active+clean 2024-09-11T22:15:53.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.747921+0000', 'last_change': '2024-09-11T22:15:48.747921+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.747921+0000', 'last_undegraded': '2024-09-11T22:15:48.747921+0000', 'last_fullsized': '2024-09-11T22:15:48.747921+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:15:53.438 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3d is not active+clean 2024-09-11T22:15:53.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:48.734082+0000', 'last_change': '2024-09-11T22:15:48.734082+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.734082+0000', 'last_undegraded': '2024-09-11T22:15:48.734082+0000', 'last_fullsized': '2024-09-11T22:15:48.734082+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:53.438 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3b is not active+clean 2024-09-11T22:15:53.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.750436+0000', 'last_change': '2024-09-11T22:15:48.750436+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.750436+0000', 'last_undegraded': '2024-09-11T22:15:48.750436+0000', 'last_fullsized': '2024-09-11T22:15:48.750436+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:15:53.438 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3a is not active+clean 2024-09-11T22:15:53.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.743047+0000', 'last_change': '2024-09-11T22:15:48.743047+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.743047+0000', 'last_undegraded': '2024-09-11T22:15:48.743047+0000', 'last_fullsized': '2024-09-11T22:15:48.743047+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:15:53.438 INFO:tasks.ceph.ceph_manager.ceph:PG 13.38 is not active+clean 2024-09-11T22:15:53.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.742623+0000', 'last_change': '2024-09-11T22:15:48.742623+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.742623+0000', 'last_undegraded': '2024-09-11T22:15:48.742623+0000', 'last_fullsized': '2024-09-11T22:15:48.742623+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:15:53.438 INFO:tasks.ceph.ceph_manager.ceph:PG 13.37 is not active+clean 2024-09-11T22:15:53.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.742644+0000', 'last_change': '2024-09-11T22:15:48.742644+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.742644+0000', 'last_undegraded': '2024-09-11T22:15:48.742644+0000', 'last_fullsized': '2024-09-11T22:15:48.742644+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:15:53.439 INFO:tasks.ceph.ceph_manager.ceph:PG 13.36 is not active+clean 2024-09-11T22:15:53.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.746572+0000', 'last_change': '2024-09-11T22:15:48.746572+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.746572+0000', 'last_undegraded': '2024-09-11T22:15:48.746572+0000', 'last_fullsized': '2024-09-11T22:15:48.746572+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:15:53.439 INFO:tasks.ceph.ceph_manager.ceph:PG 13.35 is not active+clean 2024-09-11T22:15:53.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.747412+0000', 'last_change': '2024-09-11T22:15:48.747412+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.747412+0000', 'last_undegraded': '2024-09-11T22:15:48.747412+0000', 'last_fullsized': '2024-09-11T22:15:48.747412+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:15:53.439 INFO:tasks.ceph.ceph_manager.ceph:PG 13.34 is not active+clean 2024-09-11T22:15:53.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.748236+0000', 'last_change': '2024-09-11T22:15:48.748236+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.748236+0000', 'last_undegraded': '2024-09-11T22:15:48.748236+0000', 'last_fullsized': '2024-09-11T22:15:48.748236+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:15:53.439 INFO:tasks.ceph.ceph_manager.ceph:PG 13.33 is not active+clean 2024-09-11T22:15:53.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:48.734082+0000', 'last_change': '2024-09-11T22:15:48.734082+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.734082+0000', 'last_undegraded': '2024-09-11T22:15:48.734082+0000', 'last_fullsized': '2024-09-11T22:15:48.734082+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:53.439 INFO:tasks.ceph.ceph_manager.ceph:PG 13.31 is not active+clean 2024-09-11T22:15:53.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.746473+0000', 'last_change': '2024-09-11T22:15:48.746473+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.746473+0000', 'last_undegraded': '2024-09-11T22:15:48.746473+0000', 'last_fullsized': '2024-09-11T22:15:48.746473+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:15:53.439 INFO:tasks.ceph.ceph_manager.ceph:PG 13.30 is not active+clean 2024-09-11T22:15:53.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.746585+0000', 'last_change': '2024-09-11T22:15:48.746585+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.746585+0000', 'last_undegraded': '2024-09-11T22:15:48.746585+0000', 'last_fullsized': '2024-09-11T22:15:48.746585+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:15:53.440 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2f is not active+clean 2024-09-11T22:15:53.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.747253+0000', 'last_change': '2024-09-11T22:15:48.747253+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.747253+0000', 'last_undegraded': '2024-09-11T22:15:48.747253+0000', 'last_fullsized': '2024-09-11T22:15:48.747253+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:15:53.440 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2d is not active+clean 2024-09-11T22:15:53.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.748503+0000', 'last_change': '2024-09-11T22:15:48.748503+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.748503+0000', 'last_undegraded': '2024-09-11T22:15:48.748503+0000', 'last_fullsized': '2024-09-11T22:15:48.748503+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:15:53.440 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2a is not active+clean 2024-09-11T22:15:53.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.747538+0000', 'last_change': '2024-09-11T22:15:48.747538+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.747538+0000', 'last_undegraded': '2024-09-11T22:15:48.747538+0000', 'last_fullsized': '2024-09-11T22:15:48.747538+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:15:53.440 INFO:tasks.ceph.ceph_manager.ceph:PG 13.29 is not active+clean 2024-09-11T22:15:53.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.745834+0000', 'last_change': '2024-09-11T22:15:48.745834+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.745834+0000', 'last_undegraded': '2024-09-11T22:15:48.745834+0000', 'last_fullsized': '2024-09-11T22:15:48.745834+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:15:53.440 INFO:tasks.ceph.ceph_manager.ceph:PG 13.27 is not active+clean 2024-09-11T22:15:53.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.747439+0000', 'last_change': '2024-09-11T22:15:48.747439+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.747439+0000', 'last_undegraded': '2024-09-11T22:15:48.747439+0000', 'last_fullsized': '2024-09-11T22:15:48.747439+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:15:53.441 INFO:tasks.ceph.ceph_manager.ceph:PG 13.26 is not active+clean 2024-09-11T22:15:53.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:48.734082+0000', 'last_change': '2024-09-11T22:15:48.734082+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.734082+0000', 'last_undegraded': '2024-09-11T22:15:48.734082+0000', 'last_fullsized': '2024-09-11T22:15:48.734082+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:53.441 INFO:tasks.ceph.ceph_manager.ceph:PG 13.25 is not active+clean 2024-09-11T22:15:53.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.750559+0000', 'last_change': '2024-09-11T22:15:48.750559+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.750559+0000', 'last_undegraded': '2024-09-11T22:15:48.750559+0000', 'last_fullsized': '2024-09-11T22:15:48.750559+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:15:53.441 INFO:tasks.ceph.ceph_manager.ceph:PG 13.24 is not active+clean 2024-09-11T22:15:53.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.747831+0000', 'last_change': '2024-09-11T22:15:48.747831+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.747831+0000', 'last_undegraded': '2024-09-11T22:15:48.747831+0000', 'last_fullsized': '2024-09-11T22:15:48.747831+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:15:53.441 INFO:tasks.ceph.ceph_manager.ceph:PG 13.23 is not active+clean 2024-09-11T22:15:53.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.746859+0000', 'last_change': '2024-09-11T22:15:48.746859+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.746859+0000', 'last_undegraded': '2024-09-11T22:15:48.746859+0000', 'last_fullsized': '2024-09-11T22:15:48.746859+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:15:53.441 INFO:tasks.ceph.ceph_manager.ceph:PG 13.22 is not active+clean 2024-09-11T22:15:53.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.746836+0000', 'last_change': '2024-09-11T22:15:48.746836+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.746836+0000', 'last_undegraded': '2024-09-11T22:15:48.746836+0000', 'last_fullsized': '2024-09-11T22:15:48.746836+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:15:53.441 INFO:tasks.ceph.ceph_manager.ceph:PG 13.21 is not active+clean 2024-09-11T22:15:53.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.749188+0000', 'last_change': '2024-09-11T22:15:48.749188+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.749188+0000', 'last_undegraded': '2024-09-11T22:15:48.749188+0000', 'last_fullsized': '2024-09-11T22:15:48.749188+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:15:53.442 INFO:tasks.ceph.ceph_manager.ceph:PG 13.20 is not active+clean 2024-09-11T22:15:53.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.746510+0000', 'last_change': '2024-09-11T22:15:48.746510+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.746510+0000', 'last_undegraded': '2024-09-11T22:15:48.746510+0000', 'last_fullsized': '2024-09-11T22:15:48.746510+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:15:53.442 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1e is not active+clean 2024-09-11T22:15:53.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.750702+0000', 'last_change': '2024-09-11T22:15:48.750702+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.750702+0000', 'last_undegraded': '2024-09-11T22:15:48.750702+0000', 'last_fullsized': '2024-09-11T22:15:48.750702+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:15:53.442 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1f is not active+clean 2024-09-11T22:15:53.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.747395+0000', 'last_change': '2024-09-11T22:15:48.747395+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.747395+0000', 'last_undegraded': '2024-09-11T22:15:48.747395+0000', 'last_fullsized': '2024-09-11T22:15:48.747395+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:15:53.442 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1c is not active+clean 2024-09-11T22:15:53.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.747430+0000', 'last_change': '2024-09-11T22:15:48.747430+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.747430+0000', 'last_undegraded': '2024-09-11T22:15:48.747430+0000', 'last_fullsized': '2024-09-11T22:15:48.747430+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:15:53.442 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1d is not active+clean 2024-09-11T22:15:53.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:48.734082+0000', 'last_change': '2024-09-11T22:15:48.734082+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.734082+0000', 'last_undegraded': '2024-09-11T22:15:48.734082+0000', 'last_fullsized': '2024-09-11T22:15:48.734082+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:53.443 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1a is not active+clean 2024-09-11T22:15:53.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.746353+0000', 'last_change': '2024-09-11T22:15:48.746353+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.746353+0000', 'last_undegraded': '2024-09-11T22:15:48.746353+0000', 'last_fullsized': '2024-09-11T22:15:48.746353+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:15:53.443 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1b is not active+clean 2024-09-11T22:15:53.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.750043+0000', 'last_change': '2024-09-11T22:15:48.750043+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.750043+0000', 'last_undegraded': '2024-09-11T22:15:48.750043+0000', 'last_fullsized': '2024-09-11T22:15:48.750043+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:15:53.443 INFO:tasks.ceph.ceph_manager.ceph:PG 13.18 is not active+clean 2024-09-11T22:15:53.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:48.734082+0000', 'last_change': '2024-09-11T22:15:48.734082+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.734082+0000', 'last_undegraded': '2024-09-11T22:15:48.734082+0000', 'last_fullsized': '2024-09-11T22:15:48.734082+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:53.443 INFO:tasks.ceph.ceph_manager.ceph:PG 13.19 is not active+clean 2024-09-11T22:15:53.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.745995+0000', 'last_change': '2024-09-11T22:15:48.745995+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.745995+0000', 'last_undegraded': '2024-09-11T22:15:48.745995+0000', 'last_fullsized': '2024-09-11T22:15:48.745995+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:15:53.443 INFO:tasks.ceph.ceph_manager.ceph:PG 13.16 is not active+clean 2024-09-11T22:15:53.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.744931+0000', 'last_change': '2024-09-11T22:15:48.744931+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.744931+0000', 'last_undegraded': '2024-09-11T22:15:48.744931+0000', 'last_fullsized': '2024-09-11T22:15:48.744931+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:15:53.443 INFO:tasks.ceph.ceph_manager.ceph:PG 13.17 is not active+clean 2024-09-11T22:15:53.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.742179+0000', 'last_change': '2024-09-11T22:15:48.742179+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.742179+0000', 'last_undegraded': '2024-09-11T22:15:48.742179+0000', 'last_fullsized': '2024-09-11T22:15:48.742179+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:15:53.444 INFO:tasks.ceph.ceph_manager.ceph:PG 13.14 is not active+clean 2024-09-11T22:15:53.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.749135+0000', 'last_change': '2024-09-11T22:15:48.749135+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.749135+0000', 'last_undegraded': '2024-09-11T22:15:48.749135+0000', 'last_fullsized': '2024-09-11T22:15:48.749135+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:15:53.444 INFO:tasks.ceph.ceph_manager.ceph:PG 13.15 is not active+clean 2024-09-11T22:15:53.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.749612+0000', 'last_change': '2024-09-11T22:15:48.749612+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.749612+0000', 'last_undegraded': '2024-09-11T22:15:48.749612+0000', 'last_fullsized': '2024-09-11T22:15:48.749612+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:15:53.444 INFO:tasks.ceph.ceph_manager.ceph:PG 13.12 is not active+clean 2024-09-11T22:15:53.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.749608+0000', 'last_change': '2024-09-11T22:15:48.749608+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.749608+0000', 'last_undegraded': '2024-09-11T22:15:48.749608+0000', 'last_fullsized': '2024-09-11T22:15:48.749608+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:15:53.444 INFO:tasks.ceph.ceph_manager.ceph:PG 13.13 is not active+clean 2024-09-11T22:15:53.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:48.734082+0000', 'last_change': '2024-09-11T22:15:48.734082+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.734082+0000', 'last_undegraded': '2024-09-11T22:15:48.734082+0000', 'last_fullsized': '2024-09-11T22:15:48.734082+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:53.444 INFO:tasks.ceph.ceph_manager.ceph:PG 13.10 is not active+clean 2024-09-11T22:15:53.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.746178+0000', 'last_change': '2024-09-11T22:15:48.746178+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.746178+0000', 'last_undegraded': '2024-09-11T22:15:48.746178+0000', 'last_fullsized': '2024-09-11T22:15:48.746178+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:15:53.445 INFO:tasks.ceph.ceph_manager.ceph:PG 13.11 is not active+clean 2024-09-11T22:15:53.445 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.745290+0000', 'last_change': '2024-09-11T22:15:48.745290+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.745290+0000', 'last_undegraded': '2024-09-11T22:15:48.745290+0000', 'last_fullsized': '2024-09-11T22:15:48.745290+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:15:53.445 INFO:tasks.ceph.ceph_manager.ceph:PG 13.e is not active+clean 2024-09-11T22:15:53.445 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:48.734082+0000', 'last_change': '2024-09-11T22:15:48.734082+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.734082+0000', 'last_undegraded': '2024-09-11T22:15:48.734082+0000', 'last_fullsized': '2024-09-11T22:15:48.734082+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:53.445 INFO:tasks.ceph.ceph_manager.ceph:PG 13.f is not active+clean 2024-09-11T22:15:53.445 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.746993+0000', 'last_change': '2024-09-11T22:15:48.746993+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.746993+0000', 'last_undegraded': '2024-09-11T22:15:48.746993+0000', 'last_fullsized': '2024-09-11T22:15:48.746993+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:15:53.445 INFO:tasks.ceph.ceph_manager.ceph:PG 13.d is not active+clean 2024-09-11T22:15:53.445 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.749059+0000', 'last_change': '2024-09-11T22:15:48.749059+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.749059+0000', 'last_undegraded': '2024-09-11T22:15:48.749059+0000', 'last_fullsized': '2024-09-11T22:15:48.749059+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:15:53.445 INFO:tasks.ceph.ceph_manager.ceph:PG 13.b is not active+clean 2024-09-11T22:15:53.445 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.742120+0000', 'last_change': '2024-09-11T22:15:48.742120+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.742120+0000', 'last_undegraded': '2024-09-11T22:15:48.742120+0000', 'last_fullsized': '2024-09-11T22:15:48.742120+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:15:53.445 INFO:tasks.ceph.ceph_manager.ceph:PG 13.9 is not active+clean 2024-09-11T22:15:53.446 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.742099+0000', 'last_change': '2024-09-11T22:15:48.742099+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.742099+0000', 'last_undegraded': '2024-09-11T22:15:48.742099+0000', 'last_fullsized': '2024-09-11T22:15:48.742099+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:15:53.446 INFO:tasks.ceph.ceph_manager.ceph:PG 13.6 is not active+clean 2024-09-11T22:15:53.446 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.750306+0000', 'last_change': '2024-09-11T22:15:48.750306+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.750306+0000', 'last_undegraded': '2024-09-11T22:15:48.750306+0000', 'last_fullsized': '2024-09-11T22:15:48.750306+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:15:53.446 INFO:tasks.ceph.ceph_manager.ceph:PG 13.7 is not active+clean 2024-09-11T22:15:53.446 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:48.734082+0000', 'last_change': '2024-09-11T22:15:48.734082+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.734082+0000', 'last_undegraded': '2024-09-11T22:15:48.734082+0000', 'last_fullsized': '2024-09-11T22:15:48.734082+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:53.446 INFO:tasks.ceph.ceph_manager.ceph:PG 13.4 is not active+clean 2024-09-11T22:15:53.446 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.747047+0000', 'last_change': '2024-09-11T22:15:48.747047+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.747047+0000', 'last_undegraded': '2024-09-11T22:15:48.747047+0000', 'last_fullsized': '2024-09-11T22:15:48.747047+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:15:53.446 INFO:tasks.ceph.ceph_manager.ceph:PG 13.5 is not active+clean 2024-09-11T22:15:53.446 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.748634+0000', 'last_change': '2024-09-11T22:15:48.748634+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.748634+0000', 'last_undegraded': '2024-09-11T22:15:48.748634+0000', 'last_fullsized': '2024-09-11T22:15:48.748634+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:15:53.446 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2 is not active+clean 2024-09-11T22:15:53.446 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.742122+0000', 'last_change': '2024-09-11T22:15:48.742122+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.742122+0000', 'last_undegraded': '2024-09-11T22:15:48.742122+0000', 'last_fullsized': '2024-09-11T22:15:48.742122+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:15:53.447 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3 is not active+clean 2024-09-11T22:15:53.447 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.748238+0000', 'last_change': '2024-09-11T22:15:48.748238+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.748238+0000', 'last_undegraded': '2024-09-11T22:15:48.748238+0000', 'last_fullsized': '2024-09-11T22:15:48.748238+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:15:53.447 INFO:tasks.ceph.ceph_manager.ceph:PG 13.0 is not active+clean 2024-09-11T22:15:53.447 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:48.734082+0000', 'last_change': '2024-09-11T22:15:48.734082+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.734082+0000', 'last_undegraded': '2024-09-11T22:15:48.734082+0000', 'last_fullsized': '2024-09-11T22:15:48.734082+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:53.447 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1 is not active+clean 2024-09-11T22:15:53.447 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.745331+0000', 'last_change': '2024-09-11T22:15:48.745331+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.745331+0000', 'last_undegraded': '2024-09-11T22:15:48.745331+0000', 'last_fullsized': '2024-09-11T22:15:48.745331+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:15:53.447 INFO:tasks.ceph.ceph_manager.ceph:PG 13.c is not active+clean 2024-09-11T22:15:53.447 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:15:48.746647+0000', 'last_change': '2024-09-11T22:15:48.746647+0000', 'last_active': '2024-09-11T22:15:48.734082+0000', 'last_peered': '2024-09-11T22:15:48.734082+0000', 'last_clean': '2024-09-11T22:15:48.734082+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:48.746647+0000', 'last_undegraded': '2024-09-11T22:15:48.746647+0000', 'last_fullsized': '2024-09-11T22:15:48.746647+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:48.734082+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:15:53.447 INFO:tasks.ceph.ceph_manager.ceph:PG 12.d is not active+clean 2024-09-11T22:15:53.447 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:15:47.728585+0000', 'last_change': '2024-09-11T22:15:47.728585+0000', 'last_active': '2024-09-11T22:15:47.728585+0000', 'last_peered': '2024-09-11T22:15:47.728585+0000', 'last_clean': '2024-09-11T22:15:47.728585+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:15:47.728585+0000', 'last_undegraded': '2024-09-11T22:15:47.728585+0000', 'last_fullsized': '2024-09-11T22:15:47.728585+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:15:47.728585+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:15:47.728585+0000', 'last_clean_scrub_stamp': '2024-09-11T22:15:47.728585+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:15:53.448 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:15:53.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.574+0000 7fc363082640 1 Processor -- start 2024-09-11T22:15:53.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.574+0000 7fc363082640 1 -- start start 2024-09-11T22:15:53.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.575+0000 7fc363082640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc35c15e840 0x7fc35c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.575+0000 7fc363082640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc35c0ce5f0 con 0x7fc35c0cf580 2024-09-11T22:15:53.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.575+0000 7fc363082640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc35c0ce310 con 0x7fc35c0cdd50 2024-09-11T22:15:53.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.575+0000 7fc363082640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc35c06c240 con 0x7fc35c15e840 2024-09-11T22:15:53.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.575+0000 7fc360e1e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc35c15e840 0x7fc35c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.575+0000 7fc36161f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc35c0cf580 0x7fc35c06c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44090/0 (socket says 172.21.15.50:44090) 2024-09-11T22:15:53.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.575+0000 7fc36161f640 1 -- 172.21.15.50:0/503900466 learned_addr learned my addr 172.21.15.50:0/503900466 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:53.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.575+0000 7fc360e1e640 1 -- 172.21.15.50:0/503900466 >> v1:172.21.15.77:6789/0 conn(0x7fc35c0cdd50 legacy=0x7fc35c0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:53.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.575+0000 7fc360e1e640 1 -- 172.21.15.50:0/503900466 >> v1:172.21.15.50:6789/0 conn(0x7fc35c0cf580 legacy=0x7fc35c06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.575+0000 7fc3537fe640 1 -- 172.21.15.50:0/503900466 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424387151 0 0) 0x7fc35c0ce5f0 con 0x7fc35c0cf580 2024-09-11T22:15:53.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.575+0000 7fc360e1e640 1 -- 172.21.15.50:0/503900466 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35c06bbf0 con 0x7fc35c15e840 2024-09-11T22:15:53.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.576+0000 7fc360e1e640 1 --2- 172.21.15.50:0/503900466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c15e840 0x7fc35c0b4c70 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fc358009d90 tx=0x7fc35802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa44055da66c7a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:53.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.576+0000 7fc3537fe640 1 -- 172.21.15.50:0/503900466 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358007740 con 0x7fc35c15e840 2024-09-11T22:15:53.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.576+0000 7fc3537fe640 1 -- 172.21.15.50:0/503900466 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3580078e0 con 0x7fc35c15e840 2024-09-11T22:15:53.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.576+0000 7fc3537fe640 1 -- 172.21.15.50:0/503900466 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358007cb0 con 0x7fc35c15e840 2024-09-11T22:15:53.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.577+0000 7fc363082640 1 -- 172.21.15.50:0/503900466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c15e840 msgr2=0x7fc35c0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.577+0000 7fc363082640 1 --2- 172.21.15.50:0/503900466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c15e840 0x7fc35c0b4c70 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fc358009d90 tx=0x7fc35802a6a0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.577+0000 7fc363082640 1 -- 172.21.15.50:0/503900466 shutdown_connections 2024-09-11T22:15:53.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.577+0000 7fc363082640 1 --2- 172.21.15.50:0/503900466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c15e840 0x7fc35c0b4c70 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.577+0000 7fc363082640 1 -- 172.21.15.50:0/503900466 >> 172.21.15.50:0/503900466 conn(0x7fc35c0b4150 msgr2=0x7fc35c0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:53.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.577+0000 7fc363082640 1 -- 172.21.15.50:0/503900466 shutdown_connections 2024-09-11T22:15:53.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.577+0000 7fc363082640 1 -- 172.21.15.50:0/503900466 wait complete. 2024-09-11T22:15:53.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.578+0000 7fc363082640 1 Processor -- start 2024-09-11T22:15:53.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.578+0000 7fc363082640 1 -- start start 2024-09-11T22:15:53.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc363082640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0cdd50 0x7fc35c158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc363082640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c0cf580 0x7fc35c159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc363082640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc35c15e840 0x7fc35c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc363082640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c15ec20 con 0x7fc35c0cdd50 2024-09-11T22:15:53.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc363082640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c0d0470 con 0x7fc35c0cf580 2024-09-11T22:15:53.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc363082640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc35c15eda0 con 0x7fc35c15e840 2024-09-11T22:15:53.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc360e1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0cdd50 0x7fc35c158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc360e1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0cdd50 0x7fc35c158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49872/0 (socket says 172.21.15.50:49872) 2024-09-11T22:15:53.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc360e1e640 1 -- 172.21.15.50:0/2980026293 learned_addr learned my addr 172.21.15.50:0/2980026293 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:53.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc360e1e640 1 -- 172.21.15.50:0/2980026293 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc35c15e840 msgr2=0x7fc35c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc360e1e640 1 --2- 172.21.15.50:0/2980026293 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc35c15e840 0x7fc35c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc360e1e640 1 -- 172.21.15.50:0/2980026293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c0cf580 msgr2=0x7fc35c159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc360e1e640 1 --2- 172.21.15.50:0/2980026293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c0cf580 0x7fc35c159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.579+0000 7fc360e1e640 1 -- 172.21.15.50:0/2980026293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35c15a3a0 con 0x7fc35c0cdd50 2024-09-11T22:15:53.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.580+0000 7fc360e1e640 1 --2- 172.21.15.50:0/2980026293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0cdd50 0x7fc35c158ac0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fc358009d90 tx=0x7fc358004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:53.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.580+0000 7fc3517fa640 1 -- 172.21.15.50:0/2980026293 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358040070 con 0x7fc35c0cdd50 2024-09-11T22:15:53.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.580+0000 7fc3517fa640 1 -- 172.21.15.50:0/2980026293 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc358031c40 con 0x7fc35c0cdd50 2024-09-11T22:15:53.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.580+0000 7fc3517fa640 1 -- 172.21.15.50:0/2980026293 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35803c420 con 0x7fc35c0cdd50 2024-09-11T22:15:53.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.580+0000 7fc363082640 1 -- 172.21.15.50:0/2980026293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35c15a680 con 0x7fc35c0cdd50 2024-09-11T22:15:53.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.580+0000 7fc363082640 1 -- 172.21.15.50:0/2980026293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc35c15ac40 con 0x7fc35c0cdd50 2024-09-11T22:15:53.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.581+0000 7fc363082640 1 -- 172.21.15.50:0/2980026293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc35c0b4c70 con 0x7fc35c0cdd50 2024-09-11T22:15:53.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.581+0000 7fc3517fa640 1 -- 172.21.15.50:0/2980026293 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc358039040 con 0x7fc35c0cdd50 2024-09-11T22:15:53.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.582+0000 7fc3517fa640 1 --2- 172.21.15.50:0/2980026293 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc34806be30 0x7fc34806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.582+0000 7fc3517fa640 1 -- 172.21.15.50:0/2980026293 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5709+0+0 (secure 0 0 0) 0x7fc3580ac520 con 0x7fc35c0cdd50 2024-09-11T22:15:53.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.582+0000 7fc353fff640 1 --2- 172.21.15.50:0/2980026293 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc34806be30 0x7fc34806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.583+0000 7fc353fff640 1 --2- 172.21.15.50:0/2980026293 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc34806be30 0x7fc34806e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc34c006fd0 tx=0x7fc34c006bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:53.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.586+0000 7fc3517fa640 1 -- 172.21.15.50:0/2980026293 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc35807a910 con 0x7fc35c0cdd50 2024-09-11T22:15:53.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.830+0000 7fc363082640 1 -- 172.21.15.50:0/2980026293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc35c0c7030 con 0x7fc35c0cdd50 2024-09-11T22:15:53.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.831+0000 7fc3517fa640 1 -- 172.21.15.50:0/2980026293 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1559 (secure 0 0 0) 0x7fc35807ec10 con 0x7fc35c0cdd50 2024-09-11T22:15:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:53.832 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":302,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":89,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":51},{"state_name":"creating+peering","count":46}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590438,"bytes_used":282267648,"bytes_avail":772811845632,"bytes_total":773094113280,"inactive_pgs_ratio":0.47422680258750916,"write_bytes_sec":179,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":63,"btime":"2024-09-11T22:15:51:760001+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"b","status":"up:active","gid":7110}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-09-11T22:15:39.427829+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:15:53.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.833+0000 7fc363082640 1 -- 172.21.15.50:0/2980026293 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc34806be30 msgr2=0x7fc34806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.833+0000 7fc363082640 1 --2- 172.21.15.50:0/2980026293 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc34806be30 0x7fc34806e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc34c006fd0 tx=0x7fc34c006bc0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.833+0000 7fc363082640 1 -- 172.21.15.50:0/2980026293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0cdd50 msgr2=0x7fc35c158ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.833+0000 7fc363082640 1 --2- 172.21.15.50:0/2980026293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0cdd50 0x7fc35c158ac0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fc358009d90 tx=0x7fc358004a40 comp rx=0 tx=0).stop 2024-09-11T22:15:53.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.833+0000 7fc363082640 1 -- 172.21.15.50:0/2980026293 shutdown_connections 2024-09-11T22:15:53.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.833+0000 7fc363082640 1 --2- 172.21.15.50:0/2980026293 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc34806be30 0x7fc34806e2f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.833+0000 7fc363082640 1 --2- 172.21.15.50:0/2980026293 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc35c15e840 0x7fc35c0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.833+0000 7fc363082640 1 --2- 172.21.15.50:0/2980026293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c0cf580 0x7fc35c159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.833+0000 7fc363082640 1 --2- 172.21.15.50:0/2980026293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0cdd50 0x7fc35c158ac0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.833+0000 7fc363082640 1 -- 172.21.15.50:0/2980026293 >> 172.21.15.50:0/2980026293 conn(0x7fc35c0b4150 msgr2=0x7fc35c06fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:53.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.833+0000 7fc363082640 1 -- 172.21.15.50:0/2980026293 shutdown_connections 2024-09-11T22:15:53.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.833+0000 7fc363082640 1 -- 172.21.15.50:0/2980026293 wait complete. 2024-09-11T22:15:53.844 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:15:53.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:15:53.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.945+0000 7f41c8a15640 1 Processor -- start 2024-09-11T22:15:53.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.945+0000 7f41c8a15640 1 -- start start 2024-09-11T22:15:53.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.946+0000 7f41c8a15640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41c40b0f60 0x7f41c40b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.946+0000 7f41c8a15640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c40b1340 0x7f41c4162600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.946+0000 7f41c8a15640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c4163410 con 0x7f41c4162b40 2024-09-11T22:15:53.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.946+0000 7f41c8a15640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f41c40b17a0 con 0x7f41c40b0f60 2024-09-11T22:15:53.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.946+0000 7f41c8a15640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f41c406d550 con 0x7f41c40b1340 2024-09-11T22:15:53.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.947+0000 7f41c259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41c40b0f60 0x7f41c40b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.947+0000 7f41c2d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f41c4162b40 0x7f41c40d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44100/0 (socket says 172.21.15.50:44100) 2024-09-11T22:15:53.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.947+0000 7f41c2d9d640 1 -- 172.21.15.50:0/2351473621 learned_addr learned my addr 172.21.15.50:0/2351473621 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:53.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.947+0000 7f41c1d9b640 1 --2- 172.21.15.50:0/2351473621 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c40b1340 0x7f41c4162600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.947+0000 7f41c259c640 1 -- 172.21.15.50:0/2351473621 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c40b1340 msgr2=0x7f41c4162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:53.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.947+0000 7f41c259c640 1 --2- 172.21.15.50:0/2351473621 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c40b1340 0x7f41c4162600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.947+0000 7f41c259c640 1 -- 172.21.15.50:0/2351473621 >> v1:172.21.15.50:6789/0 conn(0x7f41c4162b40 legacy=0x7f41c40d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.947+0000 7f41c159a640 1 -- 172.21.15.50:0/2351473621 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2095184245 0 0) 0x7f41c4163410 con 0x7f41c4162b40 2024-09-11T22:15:53.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.947+0000 7f41c259c640 1 -- 172.21.15.50:0/2351473621 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c406cc20 con 0x7f41c40b0f60 2024-09-11T22:15:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.948+0000 7f41c259c640 1 --2- 172.21.15.50:0/2351473621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c40b0f60 0x7f41c40b4bd0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009d90 tx=0x7f41b402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8faa1a8a12c2a8cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.948+0000 7f41c159a640 1 -- 172.21.15.50:0/2351473621 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4007740 con 0x7f41c40b0f60 2024-09-11T22:15:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.948+0000 7f41c159a640 1 -- 172.21.15.50:0/2351473621 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b40078e0 con 0x7f41c40b0f60 2024-09-11T22:15:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.948+0000 7f41c159a640 1 -- 172.21.15.50:0/2351473621 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4007cb0 con 0x7f41c40b0f60 2024-09-11T22:15:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.948+0000 7f41c8a15640 1 -- 172.21.15.50:0/2351473621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c40b0f60 msgr2=0x7f41c40b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.948+0000 7f41c8a15640 1 --2- 172.21.15.50:0/2351473621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c40b0f60 0x7f41c40b4bd0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009d90 tx=0x7f41b402a660 comp rx=0 tx=0).stop 2024-09-11T22:15:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.948+0000 7f41c8a15640 1 -- 172.21.15.50:0/2351473621 shutdown_connections 2024-09-11T22:15:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.948+0000 7f41c8a15640 1 --2- 172.21.15.50:0/2351473621 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c40b1340 0x7f41c4162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.948+0000 7f41c8a15640 1 --2- 172.21.15.50:0/2351473621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c40b0f60 0x7f41c40b4bd0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.948+0000 7f41c8a15640 1 -- 172.21.15.50:0/2351473621 >> 172.21.15.50:0/2351473621 conn(0x7f41c40b40b0 msgr2=0x7f41c40b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:53.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.948+0000 7f41c8a15640 1 -- 172.21.15.50:0/2351473621 shutdown_connections 2024-09-11T22:15:53.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.948+0000 7f41c8a15640 1 -- 172.21.15.50:0/2351473621 wait complete. 2024-09-11T22:15:53.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.950+0000 7f41c8a15640 1 Processor -- start 2024-09-11T22:15:53.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.950+0000 7f41c8a15640 1 -- start start 2024-09-11T22:15:53.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.950+0000 7f41c8a15640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c40b0f60 0x7f41c4157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.950+0000 7f41c8a15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c40b1340 0x7f41c40cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.950+0000 7f41c8a15640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c4162b40 0x7f41c40b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c8a15640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f41c406d9e0 con 0x7f41c40b0f60 2024-09-11T22:15:53.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c8a15640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41c406d1e0 con 0x7f41c40b1340 2024-09-11T22:15:53.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c8a15640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f41c406db60 con 0x7f41c4162b40 2024-09-11T22:15:53.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c40b0f60 0x7f41c4157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c40b0f60 0x7f41c4157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49892/0 (socket says 172.21.15.50:49892) 2024-09-11T22:15:53.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c259c640 1 -- 172.21.15.50:0/1588255705 learned_addr learned my addr 172.21.15.50:0/1588255705 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:53.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c2d9d640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c4162b40 0x7f41c40b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c1d9b640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c40b1340 0x7f41c40cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c259c640 1 -- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c4162b40 msgr2=0x7f41c40b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c259c640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c4162b40 0x7f41c40b7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c259c640 1 -- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c40b1340 msgr2=0x7f41c40cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:53.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c259c640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c40b1340 0x7f41c40cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:53.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c259c640 1 -- 172.21.15.50:0/1588255705 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c415c690 con 0x7f41c40b0f60 2024-09-11T22:15:53.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c2d9d640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c4162b40 0x7f41c40b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:53.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c1d9b640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c40b1340 0x7f41c40cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:53.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c259c640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c40b0f60 0x7f41c4157e70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009d90 tx=0x7f41b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:53.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41baffd640 1 -- 172.21.15.50:0/1588255705 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4040070 con 0x7f41c40b0f60 2024-09-11T22:15:53.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41baffd640 1 -- 172.21.15.50:0/1588255705 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b4031c40 con 0x7f41c40b0f60 2024-09-11T22:15:53.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c8a15640 1 -- 172.21.15.50:0/1588255705 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c415c970 con 0x7f41c40b0f60 2024-09-11T22:15:53.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41baffd640 1 -- 172.21.15.50:0/1588255705 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b403c420 con 0x7f41c40b0f60 2024-09-11T22:15:53.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.951+0000 7f41c8a15640 1 -- 172.21.15.50:0/1588255705 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c415cf30 con 0x7f41c40b0f60 2024-09-11T22:15:53.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.952+0000 7f41c8a15640 1 -- 172.21.15.50:0/1588255705 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c40c9270 con 0x7f41c40b0f60 2024-09-11T22:15:53.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.953+0000 7f41baffd640 1 -- 172.21.15.50:0/1588255705 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41b4039040 con 0x7f41c40b0f60 2024-09-11T22:15:53.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.953+0000 7f41baffd640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f41a406be30 0x7f41a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:53.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.953+0000 7f41baffd640 1 -- 172.21.15.50:0/1588255705 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5709+0+0 (secure 0 0 0) 0x7f41b40ac470 con 0x7f41c40b0f60 2024-09-11T22:15:53.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.953+0000 7f41c1d9b640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f41a406be30 0x7f41a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:53.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.954+0000 7f41c1d9b640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f41a406be30 0x7f41a406e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f41c41f8540 tx=0x7f41ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:53.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:53.958+0000 7f41baffd640 1 -- 172.21.15.50:0/1588255705 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41b403a3b0 con 0x7f41c40b0f60 2024-09-11T22:15:54.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.129+0000 7f41c8a15640 1 -- 172.21.15.50:0/1588255705 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41c40cfef0 con 0x7f41a406be30 2024-09-11T22:15:54.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.135+0000 7f41baffd640 1 -- 172.21.15.50:0/1588255705 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248237 (secure 0 0 0) 0x7f41c40cfef0 con 0x7f41a406be30 2024-09-11T22:15:54.138 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:54.139 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:15:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.138+0000 7f41c8a15640 1 -- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f41a406be30 msgr2=0x7f41a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.138+0000 7f41c8a15640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f41a406be30 0x7f41a406e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f41c41f8540 tx=0x7f41ac008040 comp rx=0 tx=0).stop 2024-09-11T22:15:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.138+0000 7f41c8a15640 1 -- 172.21.15.50:0/1588255705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c40b0f60 msgr2=0x7f41c4157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.138+0000 7f41c8a15640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c40b0f60 0x7f41c4157e70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009d90 tx=0x7f41b4004a40 comp rx=0 tx=0).stop 2024-09-11T22:15:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.138+0000 7f41c8a15640 1 -- 172.21.15.50:0/1588255705 shutdown_connections 2024-09-11T22:15:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.138+0000 7f41c8a15640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f41a406be30 0x7f41a406e2f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.138+0000 7f41c8a15640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c4162b40 0x7f41c40b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.138+0000 7f41c8a15640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c40b1340 0x7f41c40cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.138+0000 7f41c8a15640 1 --2- 172.21.15.50:0/1588255705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41c40b0f60 0x7f41c4157e70 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.138+0000 7f41c8a15640 1 -- 172.21.15.50:0/1588255705 >> 172.21.15.50:0/1588255705 conn(0x7f41c40b40b0 msgr2=0x7f41c40b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:54.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.138+0000 7f41c8a15640 1 -- 172.21.15.50:0/1588255705 shutdown_connections 2024-09-11T22:15:54.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:54.138+0000 7f41c8a15640 1 -- 172.21.15.50:0/1588255705 wait complete. 2024-09-11T22:15:54.150 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-09-11T22:15:53.430736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275652,"kb_used_data":9468,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754699068,"statfs":{"total":773094113280,"available":772811845632,"internally_reserved":0,"allocated":9695232,"data_stored":4838128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":272354865},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.696144"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747768+0000","last_change":"2024-09-11T22:15:48.747768+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747768+0000","last_undegraded":"2024-09-11T22:15:48.747768+0000","last_fullsized":"2024-09-11T22:15:48.747768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747921+0000","last_change":"2024-09-11T22:15:48.747921+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747921+0000","last_undegraded":"2024-09-11T22:15:48.747921+0000","last_fullsized":"2024-09-11T22:15:48.747921+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.652814+0000","last_change":"2024-09-11T22:15:49.761541+0000","last_active":"2024-09-11T22:15:51.652814+0000","last_peered":"2024-09-11T22:15:51.652814+0000","last_clean":"2024-09-11T22:15:51.652814+0000","last_became_active":"2024-09-11T22:15:49.761250+0000","last_became_peered":"2024-09-11T22:15:49.761250+0000","last_unstale":"2024-09-11T22:15:51.652814+0000","last_undegraded":"2024-09-11T22:15:51.652814+0000","last_fullsized":"2024-09-11T22:15:51.652814+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:31.612434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.763531+0000","last_change":"2024-09-11T22:15:49.754010+0000","last_active":"2024-09-11T22:15:49.763531+0000","last_peered":"2024-09-11T22:15:49.763531+0000","last_clean":"2024-09-11T22:15:49.763531+0000","last_became_active":"2024-09-11T22:15:49.753139+0000","last_became_peered":"2024-09-11T22:15:49.753139+0000","last_unstale":"2024-09-11T22:15:49.763531+0000","last_undegraded":"2024-09-11T22:15:49.763531+0000","last_fullsized":"2024-09-11T22:15:49.763531+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:14.317044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750436+0000","last_change":"2024-09-11T22:15:48.750436+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750436+0000","last_undegraded":"2024-09-11T22:15:48.750436+0000","last_fullsized":"2024-09-11T22:15:48.750436+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.743047+0000","last_change":"2024-09-11T22:15:48.743047+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.743047+0000","last_undegraded":"2024-09-11T22:15:48.743047+0000","last_fullsized":"2024-09-11T22:15:48.743047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.766286+0000","last_change":"2024-09-11T22:15:49.762290+0000","last_active":"2024-09-11T22:15:49.766286+0000","last_peered":"2024-09-11T22:15:49.766286+0000","last_clean":"2024-09-11T22:15:49.766286+0000","last_became_active":"2024-09-11T22:15:49.762021+0000","last_became_peered":"2024-09-11T22:15:49.762021+0000","last_unstale":"2024-09-11T22:15:49.766286+0000","last_undegraded":"2024-09-11T22:15:49.766286+0000","last_fullsized":"2024-09-11T22:15:49.766286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:24.752761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742623+0000","last_change":"2024-09-11T22:15:48.742623+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742623+0000","last_undegraded":"2024-09-11T22:15:48.742623+0000","last_fullsized":"2024-09-11T22:15:48.742623+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742644+0000","last_change":"2024-09-11T22:15:48.742644+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742644+0000","last_undegraded":"2024-09-11T22:15:48.742644+0000","last_fullsized":"2024-09-11T22:15:48.742644+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746572+0000","last_change":"2024-09-11T22:15:48.746572+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746572+0000","last_undegraded":"2024-09-11T22:15:48.746572+0000","last_fullsized":"2024-09-11T22:15:48.746572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747412+0000","last_change":"2024-09-11T22:15:48.747412+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747412+0000","last_undegraded":"2024-09-11T22:15:48.747412+0000","last_fullsized":"2024-09-11T22:15:48.747412+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748236+0000","last_change":"2024-09-11T22:15:48.748236+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748236+0000","last_undegraded":"2024-09-11T22:15:48.748236+0000","last_fullsized":"2024-09-11T22:15:48.748236+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.652796+0000","last_change":"2024-09-11T22:15:49.764802+0000","last_active":"2024-09-11T22:15:51.652796+0000","last_peered":"2024-09-11T22:15:51.652796+0000","last_clean":"2024-09-11T22:15:51.652796+0000","last_became_active":"2024-09-11T22:15:49.764221+0000","last_became_peered":"2024-09-11T22:15:49.764221+0000","last_unstale":"2024-09-11T22:15:51.652796+0000","last_undegraded":"2024-09-11T22:15:51.652796+0000","last_fullsized":"2024-09-11T22:15:51.652796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:05.855338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.763418+0000","last_change":"2024-09-11T22:15:49.758506+0000","last_active":"2024-09-11T22:15:49.763418+0000","last_peered":"2024-09-11T22:15:49.763418+0000","last_clean":"2024-09-11T22:15:49.763418+0000","last_became_active":"2024-09-11T22:15:49.757038+0000","last_became_peered":"2024-09-11T22:15:49.757038+0000","last_unstale":"2024-09-11T22:15:49.763418+0000","last_undegraded":"2024-09-11T22:15:49.763418+0000","last_fullsized":"2024-09-11T22:15:49.763418+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:29.096221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746473+0000","last_change":"2024-09-11T22:15:48.746473+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746473+0000","last_undegraded":"2024-09-11T22:15:48.746473+0000","last_fullsized":"2024-09-11T22:15:48.746473+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746585+0000","last_change":"2024-09-11T22:15:48.746585+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746585+0000","last_undegraded":"2024-09-11T22:15:48.746585+0000","last_fullsized":"2024-09-11T22:15:48.746585+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747253+0000","last_change":"2024-09-11T22:15:48.747253+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747253+0000","last_undegraded":"2024-09-11T22:15:48.747253+0000","last_fullsized":"2024-09-11T22:15:48.747253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.758932+0000","last_change":"2024-09-11T22:15:49.757671+0000","last_active":"2024-09-11T22:15:49.758932+0000","last_peered":"2024-09-11T22:15:49.758932+0000","last_clean":"2024-09-11T22:15:49.758932+0000","last_became_active":"2024-09-11T22:15:49.757377+0000","last_became_peered":"2024-09-11T22:15:49.757377+0000","last_unstale":"2024-09-11T22:15:49.758932+0000","last_undegraded":"2024-09-11T22:15:49.758932+0000","last_fullsized":"2024-09-11T22:15:49.758932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:14:20.129904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748503+0000","last_change":"2024-09-11T22:15:48.748503+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748503+0000","last_undegraded":"2024-09-11T22:15:48.748503+0000","last_fullsized":"2024-09-11T22:15:48.748503+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768399+0000","last_change":"2024-09-11T22:15:49.766261+0000","last_active":"2024-09-11T22:15:49.768399+0000","last_peered":"2024-09-11T22:15:49.768399+0000","last_clean":"2024-09-11T22:15:49.768399+0000","last_became_active":"2024-09-11T22:15:49.765950+0000","last_became_peered":"2024-09-11T22:15:49.765950+0000","last_unstale":"2024-09-11T22:15:49.768399+0000","last_undegraded":"2024-09-11T22:15:49.768399+0000","last_fullsized":"2024-09-11T22:15:49.768399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:19.770913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768497+0000","last_change":"2024-09-11T22:15:49.767809+0000","last_active":"2024-09-11T22:15:49.768497+0000","last_peered":"2024-09-11T22:15:49.768497+0000","last_clean":"2024-09-11T22:15:49.768497+0000","last_became_active":"2024-09-11T22:15:49.767536+0000","last_became_peered":"2024-09-11T22:15:49.767536+0000","last_unstale":"2024-09-11T22:15:49.768497+0000","last_undegraded":"2024-09-11T22:15:49.768497+0000","last_fullsized":"2024-09-11T22:15:49.768497+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:24.521444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747538+0000","last_change":"2024-09-11T22:15:48.747538+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747538+0000","last_undegraded":"2024-09-11T22:15:48.747538+0000","last_fullsized":"2024-09-11T22:15:48.747538+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745834+0000","last_change":"2024-09-11T22:15:48.745834+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745834+0000","last_undegraded":"2024-09-11T22:15:48.745834+0000","last_fullsized":"2024-09-11T22:15:48.745834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768087+0000","last_change":"2024-09-11T22:15:49.765353+0000","last_active":"2024-09-11T22:15:49.768087+0000","last_peered":"2024-09-11T22:15:49.768087+0000","last_clean":"2024-09-11T22:15:49.768087+0000","last_became_active":"2024-09-11T22:15:49.765075+0000","last_became_peered":"2024-09-11T22:15:49.765075+0000","last_unstale":"2024-09-11T22:15:49.768087+0000","last_undegraded":"2024-09-11T22:15:49.768087+0000","last_fullsized":"2024-09-11T22:15:49.768087+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:19.201559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747439+0000","last_change":"2024-09-11T22:15:48.747439+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747439+0000","last_undegraded":"2024-09-11T22:15:48.747439+0000","last_fullsized":"2024-09-11T22:15:48.747439+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.652749+0000","last_change":"2024-09-11T22:15:49.774179+0000","last_active":"2024-09-11T22:15:51.652749+0000","last_peered":"2024-09-11T22:15:51.652749+0000","last_clean":"2024-09-11T22:15:51.652749+0000","last_became_active":"2024-09-11T22:15:49.773810+0000","last_became_peered":"2024-09-11T22:15:49.773810+0000","last_unstale":"2024-09-11T22:15:51.652749+0000","last_undegraded":"2024-09-11T22:15:51.652749+0000","last_fullsized":"2024-09-11T22:15:51.652749+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:24.018537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750559+0000","last_change":"2024-09-11T22:15:48.750559+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750559+0000","last_undegraded":"2024-09-11T22:15:48.750559+0000","last_fullsized":"2024-09-11T22:15:48.750559+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747831+0000","last_change":"2024-09-11T22:15:48.747831+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747831+0000","last_undegraded":"2024-09-11T22:15:48.747831+0000","last_fullsized":"2024-09-11T22:15:48.747831+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746859+0000","last_change":"2024-09-11T22:15:48.746859+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746859+0000","last_undegraded":"2024-09-11T22:15:48.746859+0000","last_fullsized":"2024-09-11T22:15:48.746859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746836+0000","last_change":"2024-09-11T22:15:48.746836+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746836+0000","last_undegraded":"2024-09-11T22:15:48.746836+0000","last_fullsized":"2024-09-11T22:15:48.746836+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749188+0000","last_change":"2024-09-11T22:15:48.749188+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749188+0000","last_undegraded":"2024-09-11T22:15:48.749188+0000","last_fullsized":"2024-09-11T22:15:48.749188+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746510+0000","last_change":"2024-09-11T22:15:48.746510+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746510+0000","last_undegraded":"2024-09-11T22:15:48.746510+0000","last_fullsized":"2024-09-11T22:15:48.746510+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750702+0000","last_change":"2024-09-11T22:15:48.750702+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750702+0000","last_undegraded":"2024-09-11T22:15:48.750702+0000","last_fullsized":"2024-09-11T22:15:48.750702+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760074+0000","last_change":"2024-09-11T22:15:48.757358+0000","last_active":"2024-09-11T22:15:48.760074+0000","last_peered":"2024-09-11T22:15:48.760074+0000","last_clean":"2024-09-11T22:15:48.760074+0000","last_became_active":"2024-09-11T22:15:48.756802+0000","last_became_peered":"2024-09-11T22:15:48.756802+0000","last_unstale":"2024-09-11T22:15:48.760074+0000","last_undegraded":"2024-09-11T22:15:48.760074+0000","last_fullsized":"2024-09-11T22:15:48.760074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:04.770101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747395+0000","last_change":"2024-09-11T22:15:48.747395+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747395+0000","last_undegraded":"2024-09-11T22:15:48.747395+0000","last_fullsized":"2024-09-11T22:15:48.747395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759974+0000","last_change":"2024-09-11T22:15:48.755723+0000","last_active":"2024-09-11T22:15:48.759974+0000","last_peered":"2024-09-11T22:15:48.759974+0000","last_clean":"2024-09-11T22:15:48.759974+0000","last_became_active":"2024-09-11T22:15:48.755202+0000","last_became_peered":"2024-09-11T22:15:48.755202+0000","last_unstale":"2024-09-11T22:15:48.759974+0000","last_undegraded":"2024-09-11T22:15:48.759974+0000","last_fullsized":"2024-09-11T22:15:48.759974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:24.239471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747430+0000","last_change":"2024-09-11T22:15:48.747430+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747430+0000","last_undegraded":"2024-09-11T22:15:48.747430+0000","last_fullsized":"2024-09-11T22:15:48.747430+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758066+0000","last_change":"2024-09-11T22:15:48.756677+0000","last_active":"2024-09-11T22:15:48.758066+0000","last_peered":"2024-09-11T22:15:48.758066+0000","last_clean":"2024-09-11T22:15:48.758066+0000","last_became_active":"2024-09-11T22:15:48.756204+0000","last_became_peered":"2024-09-11T22:15:48.756204+0000","last_unstale":"2024-09-11T22:15:48.758066+0000","last_undegraded":"2024-09-11T22:15:48.758066+0000","last_fullsized":"2024-09-11T22:15:48.758066+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:09.406534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.652926+0000","last_change":"2024-09-11T22:15:49.768008+0000","last_active":"2024-09-11T22:15:51.652926+0000","last_peered":"2024-09-11T22:15:51.652926+0000","last_clean":"2024-09-11T22:15:51.652926+0000","last_became_active":"2024-09-11T22:15:49.767715+0000","last_became_peered":"2024-09-11T22:15:49.767715+0000","last_unstale":"2024-09-11T22:15:51.652926+0000","last_undegraded":"2024-09-11T22:15:51.652926+0000","last_fullsized":"2024-09-11T22:15:51.652926+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:26.319701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.761845+0000","last_change":"2024-09-11T22:15:48.760604+0000","last_active":"2024-09-11T22:15:48.761845+0000","last_peered":"2024-09-11T22:15:48.761845+0000","last_clean":"2024-09-11T22:15:48.761845+0000","last_became_active":"2024-09-11T22:15:48.760301+0000","last_became_peered":"2024-09-11T22:15:48.760301+0000","last_unstale":"2024-09-11T22:15:48.761845+0000","last_undegraded":"2024-09-11T22:15:48.761845+0000","last_fullsized":"2024-09-11T22:15:48.761845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:14.750107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746353+0000","last_change":"2024-09-11T22:15:48.746353+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746353+0000","last_undegraded":"2024-09-11T22:15:48.746353+0000","last_fullsized":"2024-09-11T22:15:48.746353+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760021+0000","last_change":"2024-09-11T22:15:48.756889+0000","last_active":"2024-09-11T22:15:48.760021+0000","last_peered":"2024-09-11T22:15:48.760021+0000","last_clean":"2024-09-11T22:15:48.760021+0000","last_became_active":"2024-09-11T22:15:48.756634+0000","last_became_peered":"2024-09-11T22:15:48.756634+0000","last_unstale":"2024-09-11T22:15:48.760021+0000","last_undegraded":"2024-09-11T22:15:48.760021+0000","last_fullsized":"2024-09-11T22:15:48.760021+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:09.629914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750043+0000","last_change":"2024-09-11T22:15:48.750043+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750043+0000","last_undegraded":"2024-09-11T22:15:48.750043+0000","last_fullsized":"2024-09-11T22:15:48.750043+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760107+0000","last_change":"2024-09-11T22:15:48.757211+0000","last_active":"2024-09-11T22:15:48.760107+0000","last_peered":"2024-09-11T22:15:48.760107+0000","last_clean":"2024-09-11T22:15:48.760107+0000","last_became_active":"2024-09-11T22:15:48.756934+0000","last_became_peered":"2024-09-11T22:15:48.756934+0000","last_unstale":"2024-09-11T22:15:48.760107+0000","last_undegraded":"2024-09-11T22:15:48.760107+0000","last_fullsized":"2024-09-11T22:15:48.760107+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:09.406534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.652597+0000","last_change":"2024-09-11T22:15:49.761546+0000","last_active":"2024-09-11T22:15:51.652597+0000","last_peered":"2024-09-11T22:15:51.652597+0000","last_clean":"2024-09-11T22:15:51.652597+0000","last_became_active":"2024-09-11T22:15:49.761226+0000","last_became_peered":"2024-09-11T22:15:49.761226+0000","last_unstale":"2024-09-11T22:15:51.652597+0000","last_undegraded":"2024-09-11T22:15:51.652597+0000","last_fullsized":"2024-09-11T22:15:51.652597+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:28.512851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758925+0000","last_change":"2024-09-11T22:15:48.758321+0000","last_active":"2024-09-11T22:15:48.758925+0000","last_peered":"2024-09-11T22:15:48.758925+0000","last_clean":"2024-09-11T22:15:48.758925+0000","last_became_active":"2024-09-11T22:15:48.758058+0000","last_became_peered":"2024-09-11T22:15:48.758058+0000","last_unstale":"2024-09-11T22:15:48.758925+0000","last_undegraded":"2024-09-11T22:15:48.758925+0000","last_fullsized":"2024-09-11T22:15:48.758925+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:04.531093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745995+0000","last_change":"2024-09-11T22:15:48.745995+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745995+0000","last_undegraded":"2024-09-11T22:15:48.745995+0000","last_fullsized":"2024-09-11T22:15:48.745995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.757688+0000","last_change":"2024-09-11T22:15:48.755608+0000","last_active":"2024-09-11T22:15:48.757688+0000","last_peered":"2024-09-11T22:15:48.757688+0000","last_clean":"2024-09-11T22:15:48.757688+0000","last_became_active":"2024-09-11T22:15:48.755303+0000","last_became_peered":"2024-09-11T22:15:48.755303+0000","last_unstale":"2024-09-11T22:15:48.757688+0000","last_undegraded":"2024-09-11T22:15:48.757688+0000","last_fullsized":"2024-09-11T22:15:48.757688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:06.185360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.744931+0000","last_change":"2024-09-11T22:15:48.744931+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.744931+0000","last_undegraded":"2024-09-11T22:15:48.744931+0000","last_fullsized":"2024-09-11T22:15:48.744931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755140+0000","last_change":"2024-09-11T22:15:48.753492+0000","last_active":"2024-09-11T22:15:48.755140+0000","last_peered":"2024-09-11T22:15:48.755140+0000","last_clean":"2024-09-11T22:15:48.755140+0000","last_became_active":"2024-09-11T22:15:48.753269+0000","last_became_peered":"2024-09-11T22:15:48.753269+0000","last_unstale":"2024-09-11T22:15:48.755140+0000","last_undegraded":"2024-09-11T22:15:48.755140+0000","last_fullsized":"2024-09-11T22:15:48.755140+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:33.429722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742179+0000","last_change":"2024-09-11T22:15:48.742179+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742179+0000","last_undegraded":"2024-09-11T22:15:48.742179+0000","last_fullsized":"2024-09-11T22:15:48.742179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759990+0000","last_change":"2024-09-11T22:15:48.756378+0000","last_active":"2024-09-11T22:15:48.759990+0000","last_peered":"2024-09-11T22:15:48.759990+0000","last_clean":"2024-09-11T22:15:48.759990+0000","last_became_active":"2024-09-11T22:15:48.756100+0000","last_became_peered":"2024-09-11T22:15:48.756100+0000","last_unstale":"2024-09-11T22:15:48.759990+0000","last_undegraded":"2024-09-11T22:15:48.759990+0000","last_fullsized":"2024-09-11T22:15:48.759990+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:32.253582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749135+0000","last_change":"2024-09-11T22:15:48.749135+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749135+0000","last_undegraded":"2024-09-11T22:15:48.749135+0000","last_fullsized":"2024-09-11T22:15:48.749135+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755160+0000","last_change":"2024-09-11T22:15:48.753488+0000","last_active":"2024-09-11T22:15:48.755160+0000","last_peered":"2024-09-11T22:15:48.755160+0000","last_clean":"2024-09-11T22:15:48.755160+0000","last_became_active":"2024-09-11T22:15:48.753210+0000","last_became_peered":"2024-09-11T22:15:48.753210+0000","last_unstale":"2024-09-11T22:15:48.755160+0000","last_undegraded":"2024-09-11T22:15:48.755160+0000","last_fullsized":"2024-09-11T22:15:48.755160+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:32.456027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749612+0000","last_change":"2024-09-11T22:15:48.749612+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749612+0000","last_undegraded":"2024-09-11T22:15:48.749612+0000","last_fullsized":"2024-09-11T22:15:48.749612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.748267+0000","last_change":"2024-09-11T22:15:48.745068+0000","last_active":"2024-09-11T22:15:48.748267+0000","last_peered":"2024-09-11T22:15:48.748267+0000","last_clean":"2024-09-11T22:15:48.748267+0000","last_became_active":"2024-09-11T22:15:48.744801+0000","last_became_peered":"2024-09-11T22:15:48.744801+0000","last_unstale":"2024-09-11T22:15:48.748267+0000","last_undegraded":"2024-09-11T22:15:48.748267+0000","last_fullsized":"2024-09-11T22:15:48.748267+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:58.192598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749608+0000","last_change":"2024-09-11T22:15:48.749608+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749608+0000","last_undegraded":"2024-09-11T22:15:48.749608+0000","last_fullsized":"2024-09-11T22:15:48.749608+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.761659+0000","last_change":"2024-09-11T22:15:48.760851+0000","last_active":"2024-09-11T22:15:48.761659+0000","last_peered":"2024-09-11T22:15:48.761659+0000","last_clean":"2024-09-11T22:15:48.761659+0000","last_became_active":"2024-09-11T22:15:48.760540+0000","last_became_peered":"2024-09-11T22:15:48.760540+0000","last_unstale":"2024-09-11T22:15:48.761659+0000","last_undegraded":"2024-09-11T22:15:48.761659+0000","last_fullsized":"2024-09-11T22:15:48.761659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:13.738702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.652718+0000","last_change":"2024-09-11T22:15:49.762353+0000","last_active":"2024-09-11T22:15:51.652718+0000","last_peered":"2024-09-11T22:15:51.652718+0000","last_clean":"2024-09-11T22:15:51.652718+0000","last_became_active":"2024-09-11T22:15:49.762075+0000","last_became_peered":"2024-09-11T22:15:49.762075+0000","last_unstale":"2024-09-11T22:15:51.652718+0000","last_undegraded":"2024-09-11T22:15:51.652718+0000","last_fullsized":"2024-09-11T22:15:51.652718+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:29.220164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.756262+0000","last_change":"2024-09-11T22:15:48.753807+0000","last_active":"2024-09-11T22:15:48.756262+0000","last_peered":"2024-09-11T22:15:48.756262+0000","last_clean":"2024-09-11T22:15:48.756262+0000","last_became_active":"2024-09-11T22:15:48.753523+0000","last_became_peered":"2024-09-11T22:15:48.753523+0000","last_unstale":"2024-09-11T22:15:48.756262+0000","last_undegraded":"2024-09-11T22:15:48.756262+0000","last_fullsized":"2024-09-11T22:15:48.756262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:49.929465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746178+0000","last_change":"2024-09-11T22:15:48.746178+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746178+0000","last_undegraded":"2024-09-11T22:15:48.746178+0000","last_fullsized":"2024-09-11T22:15:48.746178+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755209+0000","last_change":"2024-09-11T22:15:48.752805+0000","last_active":"2024-09-11T22:15:48.755209+0000","last_peered":"2024-09-11T22:15:48.755209+0000","last_clean":"2024-09-11T22:15:48.755209+0000","last_became_active":"2024-09-11T22:15:48.752539+0000","last_became_peered":"2024-09-11T22:15:48.752539+0000","last_unstale":"2024-09-11T22:15:48.755209+0000","last_undegraded":"2024-09-11T22:15:48.755209+0000","last_fullsized":"2024-09-11T22:15:48.755209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:41.877937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745290+0000","last_change":"2024-09-11T22:15:48.745290+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745290+0000","last_undegraded":"2024-09-11T22:15:48.745290+0000","last_fullsized":"2024-09-11T22:15:48.745290+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755164+0000","last_change":"2024-09-11T22:15:48.753365+0000","last_active":"2024-09-11T22:15:48.755164+0000","last_peered":"2024-09-11T22:15:48.755164+0000","last_clean":"2024-09-11T22:15:48.755164+0000","last_became_active":"2024-09-11T22:15:48.753060+0000","last_became_peered":"2024-09-11T22:15:48.753060+0000","last_unstale":"2024-09-11T22:15:48.755164+0000","last_undegraded":"2024-09-11T22:15:48.755164+0000","last_fullsized":"2024-09-11T22:15:48.755164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:36.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.652883+0000","last_change":"2024-09-11T22:15:49.762513+0000","last_active":"2024-09-11T22:15:51.652883+0000","last_peered":"2024-09-11T22:15:51.652883+0000","last_clean":"2024-09-11T22:15:51.652883+0000","last_became_active":"2024-09-11T22:15:49.762243+0000","last_became_peered":"2024-09-11T22:15:49.762243+0000","last_unstale":"2024-09-11T22:15:51.652883+0000","last_undegraded":"2024-09-11T22:15:51.652883+0000","last_fullsized":"2024-09-11T22:15:51.652883+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:36:09.441632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.751840+0000","last_change":"2024-09-11T22:15:48.750585+0000","last_active":"2024-09-11T22:15:48.751840+0000","last_peered":"2024-09-11T22:15:48.751840+0000","last_clean":"2024-09-11T22:15:48.751840+0000","last_became_active":"2024-09-11T22:15:48.750301+0000","last_became_peered":"2024-09-11T22:15:48.750301+0000","last_unstale":"2024-09-11T22:15:48.751840+0000","last_undegraded":"2024-09-11T22:15:48.751840+0000","last_fullsized":"2024-09-11T22:15:48.751840+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:58.163220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746993+0000","last_change":"2024-09-11T22:15:48.746993+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746993+0000","last_undegraded":"2024-09-11T22:15:48.746993+0000","last_fullsized":"2024-09-11T22:15:48.746993+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.762156+0000","last_change":"2024-09-11T22:15:48.761035+0000","last_active":"2024-09-11T22:15:48.762156+0000","last_peered":"2024-09-11T22:15:48.762156+0000","last_clean":"2024-09-11T22:15:48.762156+0000","last_became_active":"2024-09-11T22:15:48.760673+0000","last_became_peered":"2024-09-11T22:15:48.760673+0000","last_unstale":"2024-09-11T22:15:48.762156+0000","last_undegraded":"2024-09-11T22:15:48.762156+0000","last_fullsized":"2024-09-11T22:15:48.762156+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:29.306669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.749059+0000","last_change":"2024-09-11T22:15:48.749059+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.749059+0000","last_undegraded":"2024-09-11T22:15:48.749059+0000","last_fullsized":"2024-09-11T22:15:48.749059+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755116+0000","last_change":"2024-09-11T22:15:48.753389+0000","last_active":"2024-09-11T22:15:48.755116+0000","last_peered":"2024-09-11T22:15:48.755116+0000","last_clean":"2024-09-11T22:15:48.755116+0000","last_became_active":"2024-09-11T22:15:48.753078+0000","last_became_peered":"2024-09-11T22:15:48.753078+0000","last_unstale":"2024-09-11T22:15:48.755116+0000","last_undegraded":"2024-09-11T22:15:48.755116+0000","last_fullsized":"2024-09-11T22:15:48.755116+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.697611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.763395+0000","last_change":"2024-09-11T22:15:49.758184+0000","last_active":"2024-09-11T22:15:49.763395+0000","last_peered":"2024-09-11T22:15:49.763395+0000","last_clean":"2024-09-11T22:15:49.763395+0000","last_became_active":"2024-09-11T22:15:49.756641+0000","last_became_peered":"2024-09-11T22:15:49.756641+0000","last_unstale":"2024-09-11T22:15:49.763395+0000","last_undegraded":"2024-09-11T22:15:49.763395+0000","last_fullsized":"2024-09-11T22:15:49.763395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:36.042212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.757296+0000","last_change":"2024-09-11T22:15:48.756390+0000","last_active":"2024-09-11T22:15:48.757296+0000","last_peered":"2024-09-11T22:15:48.757296+0000","last_clean":"2024-09-11T22:15:48.757296+0000","last_became_active":"2024-09-11T22:15:48.756076+0000","last_became_peered":"2024-09-11T22:15:48.756076+0000","last_unstale":"2024-09-11T22:15:48.757296+0000","last_undegraded":"2024-09-11T22:15:48.757296+0000","last_fullsized":"2024-09-11T22:15:48.757296+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:47.594034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742120+0000","last_change":"2024-09-11T22:15:48.742120+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742120+0000","last_undegraded":"2024-09-11T22:15:48.742120+0000","last_fullsized":"2024-09-11T22:15:48.742120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.744129+0000","last_change":"2024-09-11T22:15:48.756655+0000","last_active":"2024-09-11T22:15:49.744129+0000","last_peered":"2024-09-11T22:15:49.744129+0000","last_clean":"2024-09-11T22:15:49.744129+0000","last_became_active":"2024-09-11T22:15:48.756399+0000","last_became_peered":"2024-09-11T22:15:48.756399+0000","last_unstale":"2024-09-11T22:15:49.744129+0000","last_undegraded":"2024-09-11T22:15:49.744129+0000","last_fullsized":"2024-09-11T22:15:49.744129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:51.759680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.768065+0000","last_change":"2024-09-11T22:15:49.764525+0000","last_active":"2024-09-11T22:15:49.768065+0000","last_peered":"2024-09-11T22:15:49.768065+0000","last_clean":"2024-09-11T22:15:49.768065+0000","last_became_active":"2024-09-11T22:15:49.764235+0000","last_became_peered":"2024-09-11T22:15:49.764235+0000","last_unstale":"2024-09-11T22:15:49.768065+0000","last_undegraded":"2024-09-11T22:15:49.768065+0000","last_fullsized":"2024-09-11T22:15:49.768065+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.283321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T22:15:49.744055+0000","last_change":"2024-09-11T22:15:48.753604+0000","last_active":"2024-09-11T22:15:49.744055+0000","last_peered":"2024-09-11T22:15:49.744055+0000","last_clean":"2024-09-11T22:15:49.744055+0000","last_became_active":"2024-09-11T22:15:48.753332+0000","last_became_peered":"2024-09-11T22:15:48.753332+0000","last_unstale":"2024-09-11T22:15:49.744055+0000","last_undegraded":"2024-09-11T22:15:49.744055+0000","last_fullsized":"2024-09-11T22:15:49.744055+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:53.705437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742099+0000","last_change":"2024-09-11T22:15:48.742099+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742099+0000","last_undegraded":"2024-09-11T22:15:48.742099+0000","last_fullsized":"2024-09-11T22:15:48.742099+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758032+0000","last_change":"2024-09-11T22:15:48.757138+0000","last_active":"2024-09-11T22:15:48.758032+0000","last_peered":"2024-09-11T22:15:48.758032+0000","last_clean":"2024-09-11T22:15:48.758032+0000","last_became_active":"2024-09-11T22:15:48.756810+0000","last_became_peered":"2024-09-11T22:15:48.756810+0000","last_unstale":"2024-09-11T22:15:48.758032+0000","last_undegraded":"2024-09-11T22:15:48.758032+0000","last_fullsized":"2024-09-11T22:15:48.758032+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:32.543800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.750306+0000","last_change":"2024-09-11T22:15:48.750306+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.750306+0000","last_undegraded":"2024-09-11T22:15:48.750306+0000","last_fullsized":"2024-09-11T22:15:48.750306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.755495+0000","last_change":"2024-09-11T22:15:48.752014+0000","last_active":"2024-09-11T22:15:48.755495+0000","last_peered":"2024-09-11T22:15:48.755495+0000","last_clean":"2024-09-11T22:15:48.755495+0000","last_became_active":"2024-09-11T22:15:48.751698+0000","last_became_peered":"2024-09-11T22:15:48.751698+0000","last_unstale":"2024-09-11T22:15:48.755495+0000","last_undegraded":"2024-09-11T22:15:48.755495+0000","last_fullsized":"2024-09-11T22:15:48.755495+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:45.566372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.652903+0000","last_change":"2024-09-11T22:15:49.762646+0000","last_active":"2024-09-11T22:15:51.652903+0000","last_peered":"2024-09-11T22:15:51.652903+0000","last_clean":"2024-09-11T22:15:51.652903+0000","last_became_active":"2024-09-11T22:15:49.762387+0000","last_became_peered":"2024-09-11T22:15:49.762387+0000","last_unstale":"2024-09-11T22:15:51.652903+0000","last_undegraded":"2024-09-11T22:15:51.652903+0000","last_fullsized":"2024-09-11T22:15:51.652903+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:31.527822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.761832+0000","last_change":"2024-09-11T22:15:48.761323+0000","last_active":"2024-09-11T22:15:48.761832+0000","last_peered":"2024-09-11T22:15:48.761832+0000","last_clean":"2024-09-11T22:15:48.761832+0000","last_became_active":"2024-09-11T22:15:48.761013+0000","last_became_peered":"2024-09-11T22:15:48.761013+0000","last_unstale":"2024-09-11T22:15:48.761832+0000","last_undegraded":"2024-09-11T22:15:48.761832+0000","last_fullsized":"2024-09-11T22:15:48.761832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:29.128528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.747047+0000","last_change":"2024-09-11T22:15:48.747047+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.747047+0000","last_undegraded":"2024-09-11T22:15:48.747047+0000","last_fullsized":"2024-09-11T22:15:48.747047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.762304+0000","last_change":"2024-09-11T22:15:48.758059+0000","last_active":"2024-09-11T22:15:48.762304+0000","last_peered":"2024-09-11T22:15:48.762304+0000","last_clean":"2024-09-11T22:15:48.762304+0000","last_became_active":"2024-09-11T22:15:48.757769+0000","last_became_peered":"2024-09-11T22:15:48.757769+0000","last_unstale":"2024-09-11T22:15:48.762304+0000","last_undegraded":"2024-09-11T22:15:48.762304+0000","last_fullsized":"2024-09-11T22:15:48.762304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:39.198853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748634+0000","last_change":"2024-09-11T22:15:48.748634+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748634+0000","last_undegraded":"2024-09-11T22:15:48.748634+0000","last_fullsized":"2024-09-11T22:15:48.748634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760013+0000","last_change":"2024-09-11T22:15:48.756280+0000","last_active":"2024-09-11T22:15:48.760013+0000","last_peered":"2024-09-11T22:15:48.760013+0000","last_clean":"2024-09-11T22:15:48.760013+0000","last_became_active":"2024-09-11T22:15:48.755689+0000","last_became_peered":"2024-09-11T22:15:48.755689+0000","last_unstale":"2024-09-11T22:15:48.760013+0000","last_undegraded":"2024-09-11T22:15:48.760013+0000","last_fullsized":"2024-09-11T22:15:48.760013+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:22.009761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.742122+0000","last_change":"2024-09-11T22:15:48.742122+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.742122+0000","last_undegraded":"2024-09-11T22:15:48.742122+0000","last_fullsized":"2024-09-11T22:15:48.742122+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.758989+0000","last_change":"2024-09-11T22:15:48.754680+0000","last_active":"2024-09-11T22:15:48.758989+0000","last_peered":"2024-09-11T22:15:48.758989+0000","last_clean":"2024-09-11T22:15:48.758989+0000","last_became_active":"2024-09-11T22:15:48.754396+0000","last_became_peered":"2024-09-11T22:15:48.754396+0000","last_unstale":"2024-09-11T22:15:48.758989+0000","last_undegraded":"2024-09-11T22:15:48.758989+0000","last_fullsized":"2024-09-11T22:15:48.758989+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:09.629914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.748238+0000","last_change":"2024-09-11T22:15:48.748238+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.748238+0000","last_undegraded":"2024-09-11T22:15:48.748238+0000","last_fullsized":"2024-09-11T22:15:48.748238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759982+0000","last_change":"2024-09-11T22:15:48.755977+0000","last_active":"2024-09-11T22:15:48.759982+0000","last_peered":"2024-09-11T22:15:48.759982+0000","last_clean":"2024-09-11T22:15:48.759982+0000","last_became_active":"2024-09-11T22:15:48.755357+0000","last_became_peered":"2024-09-11T22:15:48.755357+0000","last_unstale":"2024-09-11T22:15:48.759982+0000","last_undegraded":"2024-09-11T22:15:48.759982+0000","last_fullsized":"2024-09-11T22:15:48.759982+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:36.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.652703+0000","last_change":"2024-09-11T22:15:49.774136+0000","last_active":"2024-09-11T22:15:51.652703+0000","last_peered":"2024-09-11T22:15:51.652703+0000","last_clean":"2024-09-11T22:15:51.652703+0000","last_became_active":"2024-09-11T22:15:49.773836+0000","last_became_peered":"2024-09-11T22:15:49.773836+0000","last_unstale":"2024-09-11T22:15:51.652703+0000","last_undegraded":"2024-09-11T22:15:51.652703+0000","last_fullsized":"2024-09-11T22:15:51.652703+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:49.679238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.759993+0000","last_change":"2024-09-11T22:15:48.755949+0000","last_active":"2024-09-11T22:15:48.759993+0000","last_peered":"2024-09-11T22:15:48.759993+0000","last_clean":"2024-09-11T22:15:48.759993+0000","last_became_active":"2024-09-11T22:15:48.755704+0000","last_became_peered":"2024-09-11T22:15:48.755704+0000","last_unstale":"2024-09-11T22:15:48.759993+0000","last_undegraded":"2024-09-11T22:15:48.759993+0000","last_fullsized":"2024-09-11T22:15:48.759993+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:48.772533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.745331+0000","last_change":"2024-09-11T22:15:48.745331+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.745331+0000","last_undegraded":"2024-09-11T22:15:48.745331+0000","last_fullsized":"2024-09-11T22:15:48.745331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T22:15:48.760025+0000","last_change":"2024-09-11T22:15:48.756565+0000","last_active":"2024-09-11T22:15:48.760025+0000","last_peered":"2024-09-11T22:15:48.760025+0000","last_clean":"2024-09-11T22:15:48.760025+0000","last_became_active":"2024-09-11T22:15:48.755417+0000","last_became_peered":"2024-09-11T22:15:48.755417+0000","last_unstale":"2024-09-11T22:15:48.760025+0000","last_undegraded":"2024-09-11T22:15:48.760025+0000","last_fullsized":"2024-09-11T22:15:48.760025+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.697611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-11T22:15:48.746647+0000","last_change":"2024-09-11T22:15:48.746647+0000","last_active":"2024-09-11T22:15:48.734082+0000","last_peered":"2024-09-11T22:15:48.734082+0000","last_clean":"2024-09-11T22:15:48.734082+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:15:48.746647+0000","last_undegraded":"2024-09-11T22:15:48.746647+0000","last_fullsized":"2024-09-11T22:15:48.746647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"88'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.652931+0000","last_change":"2024-09-11T22:15:48.754935+0000","last_active":"2024-09-11T22:15:51.652931+0000","last_peered":"2024-09-11T22:15:51.652931+0000","last_clean":"2024-09-11T22:15:51.652931+0000","last_became_active":"2024-09-11T22:15:48.754642+0000","last_became_peered":"2024-09-11T22:15:48.754642+0000","last_unstale":"2024-09-11T22:15:51.652931+0000","last_undegraded":"2024-09-11T22:15:51.652931+0000","last_fullsized":"2024-09-11T22:15:51.652931+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:03.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":295,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.652705+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:15:51.652705+0000","last_peered":"2024-09-11T22:15:51.652705+0000","last_clean":"2024-09-11T22:15:51.652705+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:15:51.652705+0000","last_undegraded":"2024-09-11T22:15:51.652705+0000","last_fullsized":"2024-09-11T22:15:51.652705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36384,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335456,"statfs":{"total":96636764160,"available":96599506944,"internally_reserved":0,"allocated":1060864,"data_stored":456180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36388,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335452,"statfs":{"total":96636764160,"available":96599502848,"internally_reserved":0,"allocated":1060864,"data_stored":456180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335468,"statfs":{"total":96636764160,"available":96599519232,"internally_reserved":0,"allocated":1048576,"data_stored":449905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1048576,"data_stored":449905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1060864,"data_stored":456180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41136,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330704,"statfs":{"total":96636764160,"available":96594640896,"internally_reserved":0,"allocated":1654784,"data_stored":1046548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41156,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330684,"statfs":{"total":96636764160,"available":96594620416,"internally_reserved":0,"allocated":1683456,"data_stored":1059693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1077248,"data_stored":463537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:15:57.154 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:15:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.269+0000 7f7fb241e640 1 Processor -- start 2024-09-11T22:15:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.269+0000 7f7fb241e640 1 -- start start 2024-09-11T22:15:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7fb241e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fac15e840 0x7f7fac0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7fb241e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fac0ce5f0 con 0x7f7fac0cf580 2024-09-11T22:15:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7fb241e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fac0ce310 con 0x7f7fac0cdd50 2024-09-11T22:15:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7fb241e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7fac06c240 con 0x7f7fac15e840 2024-09-11T22:15:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7fb09bb640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7fac0cf580 0x7f7fac06c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44108/0 (socket says 172.21.15.50:44108) 2024-09-11T22:15:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7fb09bb640 1 -- 172.21.15.50:0/3117588104 learned_addr learned my addr 172.21.15.50:0/3117588104 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2057774256 0 0) 0x7f7fac0ce5f0 con 0x7f7fac0cf580 2024-09-11T22:15:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7fabfff640 1 --2- 172.21.15.50:0/3117588104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fac15e840 0x7f7fac0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f94003520 con 0x7f7fac0cf580 2024-09-11T22:15:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 836483677 0 0) 0x7f7f94003520 con 0x7f7fac0cf580 2024-09-11T22:15:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fac15e840 msgr2=0x7f7fac0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7faaffd640 1 --2- 172.21.15.50:0/3117588104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fac15e840 0x7f7fac0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 >> v1:172.21.15.77:6789/0 conn(0x7f7fac0cdd50 legacy=0x7f7fac0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fac06bbf0 con 0x7f7fac0cf580 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.270+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f7fa40019f0 con 0x7f7fac0cf580 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 >> v1:172.21.15.50:6789/0 conn(0x7f7fac0cf580 legacy=0x7f7fac06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7faaffd640 1 --2- 172.21.15.50:0/3117588104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f940039e0 0x7f7f94003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7faaffd640 1 --2- 172.21.15.50:0/3117588104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fac15e840 0x7f7f94004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7faaffd640 1 --2- 172.21.15.50:0/3117588104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f94004d40 0x7f7f940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7fac06c240 con 0x7f7f94004d40 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9400ba70 con 0x7f7f940039e0 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f9400bc70 con 0x7f7fac15e840 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7fb09bb640 1 --2- 172.21.15.50:0/3117588104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f94004d40 0x7f7f940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7fabfff640 1 --2- 172.21.15.50:0/3117588104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f940039e0 0x7f7f94003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7fab7fe640 1 --2- 172.21.15.50:0/3117588104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fac15e840 0x7f7f94004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7fb09bb640 1 -- 172.21.15.50:0/3117588104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fac15e840 msgr2=0x7f7f94004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7fb09bb640 1 --2- 172.21.15.50:0/3117588104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fac15e840 0x7f7f94004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7fb09bb640 1 -- 172.21.15.50:0/3117588104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f940039e0 msgr2=0x7f7f94003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7fb09bb640 1 --2- 172.21.15.50:0/3117588104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f940039e0 0x7f7f94003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.271+0000 7f7fb09bb640 1 -- 172.21.15.50:0/3117588104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f94003520 con 0x7f7f94004d40 2024-09-11T22:15:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.272+0000 7f7fb09bb640 1 --2- 172.21.15.50:0/3117588104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f94004d40 0x7f7f940051c0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400a810 tx=0x7f7f94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602c58987e290ed4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.272+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400a460 con 0x7f7f94004d40 2024-09-11T22:15:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.272+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa402f070 con 0x7f7f94004d40 2024-09-11T22:15:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.272+0000 7f7faaffd640 1 -- 172.21.15.50:0/3117588104 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa402bc90 con 0x7f7f94004d40 2024-09-11T22:15:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.272+0000 7f7fb241e640 1 -- 172.21.15.50:0/3117588104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f94004d40 msgr2=0x7f7f940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.272+0000 7f7fb241e640 1 --2- 172.21.15.50:0/3117588104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f94004d40 0x7f7f940051c0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400a810 tx=0x7f7f94005830 comp rx=0 tx=0).stop 2024-09-11T22:15:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.272+0000 7f7fb09bb640 1 -- 172.21.15.50:0/3117588104 reap_dead start 2024-09-11T22:15:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.272+0000 7f7fb241e640 1 -- 172.21.15.50:0/3117588104 shutdown_connections 2024-09-11T22:15:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.272+0000 7f7fb241e640 1 -- 172.21.15.50:0/3117588104 >> 172.21.15.50:0/3117588104 conn(0x7f7fac0b4150 msgr2=0x7f7fac0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.273+0000 7f7fb241e640 1 -- 172.21.15.50:0/3117588104 shutdown_connections 2024-09-11T22:15:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.273+0000 7f7fb241e640 1 -- 172.21.15.50:0/3117588104 wait complete. 2024-09-11T22:15:57.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.274+0000 7f7fb241e640 1 Processor -- start 2024-09-11T22:15:57.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.274+0000 7f7fb241e640 1 -- start start 2024-09-11T22:15:57.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fb241e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fac1f8100 0x7f7fac0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fb241e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fac1f84e0 0x7f7fac0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fb241e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fac0cbb60 0x7f7fac0cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fb241e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7fac15ec20 con 0x7f7fac1f84e0 2024-09-11T22:15:57.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fb241e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7fac0d0470 con 0x7f7fac0cbb60 2024-09-11T22:15:57.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fb241e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7fac15eda0 con 0x7f7fac1f8100 2024-09-11T22:15:57.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fac1f84e0 0x7f7fac0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:57.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fac1f84e0 0x7f7fac0c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49904/0 (socket says 172.21.15.50:49904) 2024-09-11T22:15:57.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fab7fe640 1 -- 172.21.15.50:0/1084662865 learned_addr learned my addr 172.21.15.50:0/1084662865 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:57.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fabfff640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fac1f8100 0x7f7fac0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:57.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fb09bb640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fac0cbb60 0x7f7fac0cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:57.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fab7fe640 1 -- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fac1f8100 msgr2=0x7f7fac0c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:57.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fab7fe640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fac1f8100 0x7f7fac0c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fab7fe640 1 -- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fac0cbb60 msgr2=0x7f7fac0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:57.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fab7fe640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fac0cbb60 0x7f7fac0cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fab7fe640 1 -- 172.21.15.50:0/1084662865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fac0c61d0 con 0x7f7fac1f84e0 2024-09-11T22:15:57.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.275+0000 7f7fb09bb640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fac0cbb60 0x7f7fac0cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:57.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.276+0000 7f7fab7fe640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fac1f84e0 0x7f7fac0c88c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000f7f0 tx=0x7f7fa000fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:57.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.276+0000 7f7fa8ff9640 1 -- 172.21.15.50:0/1084662865 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00050d0 con 0x7f7fac1f84e0 2024-09-11T22:15:57.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.276+0000 7f7fa8ff9640 1 -- 172.21.15.50:0/1084662865 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa0018070 con 0x7f7fac1f84e0 2024-09-11T22:15:57.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.276+0000 7f7fb241e640 1 -- 172.21.15.50:0/1084662865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fac0c64b0 con 0x7f7fac1f84e0 2024-09-11T22:15:57.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.276+0000 7f7fa8ff9640 1 -- 172.21.15.50:0/1084662865 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000d730 con 0x7f7fac1f84e0 2024-09-11T22:15:57.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.276+0000 7f7fb241e640 1 -- 172.21.15.50:0/1084662865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fac0c6a70 con 0x7f7fac1f84e0 2024-09-11T22:15:57.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.277+0000 7f7fb241e640 1 -- 172.21.15.50:0/1084662865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fac0b4c70 con 0x7f7fac1f84e0 2024-09-11T22:15:57.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.277+0000 7f7fa8ff9640 1 -- 172.21.15.50:0/1084662865 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fa000d8d0 con 0x7f7fac1f84e0 2024-09-11T22:15:57.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.278+0000 7f7fa8ff9640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f9806be60 0x7f7f9806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.278+0000 7f7fa8ff9640 1 -- 172.21.15.50:0/1084662865 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7f7fa008abf0 con 0x7f7fac1f84e0 2024-09-11T22:15:57.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.278+0000 7f7fabfff640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f9806be60 0x7f7f9806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:57.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.279+0000 7f7fabfff640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f9806be60 0x7f7f9806e320 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009bc0 tx=0x7f7f9c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:57.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.282+0000 7f7fa8ff9640 1 -- 172.21.15.50:0/1084662865 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fa0059580 con 0x7f7fac1f84e0 2024-09-11T22:15:57.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.453+0000 7f7fb241e640 1 -- 172.21.15.50:0/1084662865 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7fac0d0230 con 0x7f7f9806be60 2024-09-11T22:15:57.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.460+0000 7f7fa8ff9640 1 -- 172.21.15.50:0/1084662865 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252062 (secure 0 0 0) 0x7f7fac0d0230 con 0x7f7f9806be60 2024-09-11T22:15:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:57.464 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:15:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.463+0000 7f7fb241e640 1 -- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f9806be60 msgr2=0x7f7f9806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.463+0000 7f7fb241e640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f9806be60 0x7f7f9806e320 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009bc0 tx=0x7f7f9c009190 comp rx=0 tx=0).stop 2024-09-11T22:15:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.463+0000 7f7fb241e640 1 -- 172.21.15.50:0/1084662865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fac1f84e0 msgr2=0x7f7fac0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.463+0000 7f7fb241e640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fac1f84e0 0x7f7fac0c88c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000f7f0 tx=0x7f7fa000fbf0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.463+0000 7f7fb241e640 1 -- 172.21.15.50:0/1084662865 shutdown_connections 2024-09-11T22:15:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.463+0000 7f7fb241e640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f9806be60 0x7f7f9806e320 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.463+0000 7f7fb241e640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fac0cbb60 0x7f7fac0cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.463+0000 7f7fb241e640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fac1f84e0 0x7f7fac0c88c0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.463+0000 7f7fb241e640 1 --2- 172.21.15.50:0/1084662865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fac1f8100 0x7f7fac0c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.463+0000 7f7fb241e640 1 -- 172.21.15.50:0/1084662865 >> 172.21.15.50:0/1084662865 conn(0x7f7fac0b4150 msgr2=0x7f7fac0afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.463+0000 7f7fb241e640 1 -- 172.21.15.50:0/1084662865 shutdown_connections 2024-09-11T22:15:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.463+0000 7f7fb241e640 1 -- 172.21.15.50:0/1084662865 wait complete. 2024-09-11T22:15:57.475 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-09-11T22:15:57.432003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275880,"kb_used_data":9728,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754698840,"statfs":{"total":773094113280,"available":772811612160,"internally_reserved":0,"allocated":9961472,"data_stored":4951530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":272354865},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.667640"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.108177+0000","last_change":"2024-09-11T22:15:49.768309+0000","last_active":"2024-09-11T22:15:52.108177+0000","last_peered":"2024-09-11T22:15:52.108177+0000","last_clean":"2024-09-11T22:15:52.108177+0000","last_became_active":"2024-09-11T22:15:49.767777+0000","last_became_peered":"2024-09-11T22:15:49.767777+0000","last_unstale":"2024-09-11T22:15:52.108177+0000","last_undegraded":"2024-09-11T22:15:52.108177+0000","last_fullsized":"2024-09-11T22:15:52.108177+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:29.860267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.262463+0000","last_change":"2024-09-11T22:15:49.758928+0000","last_active":"2024-09-11T22:15:51.262463+0000","last_peered":"2024-09-11T22:15:51.262463+0000","last_clean":"2024-09-11T22:15:51.262463+0000","last_became_active":"2024-09-11T22:15:49.758577+0000","last_became_peered":"2024-09-11T22:15:49.758577+0000","last_unstale":"2024-09-11T22:15:51.262463+0000","last_undegraded":"2024-09-11T22:15:51.262463+0000","last_fullsized":"2024-09-11T22:15:51.262463+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:59.198095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:56.253647+0000","last_change":"2024-09-11T22:15:49.761541+0000","last_active":"2024-09-11T22:15:56.253647+0000","last_peered":"2024-09-11T22:15:56.253647+0000","last_clean":"2024-09-11T22:15:56.253647+0000","last_became_active":"2024-09-11T22:15:49.761250+0000","last_became_peered":"2024-09-11T22:15:49.761250+0000","last_unstale":"2024-09-11T22:15:56.253647+0000","last_undegraded":"2024-09-11T22:15:56.253647+0000","last_fullsized":"2024-09-11T22:15:56.253647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:31.612434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:55.866317+0000","last_change":"2024-09-11T22:15:49.754010+0000","last_active":"2024-09-11T22:15:55.866317+0000","last_peered":"2024-09-11T22:15:55.866317+0000","last_clean":"2024-09-11T22:15:55.866317+0000","last_became_active":"2024-09-11T22:15:49.753139+0000","last_became_peered":"2024-09-11T22:15:49.753139+0000","last_unstale":"2024-09-11T22:15:55.866317+0000","last_undegraded":"2024-09-11T22:15:55.866317+0000","last_fullsized":"2024-09-11T22:15:55.866317+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:20.141147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.768146+0000","last_change":"2024-09-11T22:15:49.757841+0000","last_active":"2024-09-11T22:15:50.768146+0000","last_peered":"2024-09-11T22:15:50.768146+0000","last_clean":"2024-09-11T22:15:50.768146+0000","last_became_active":"2024-09-11T22:15:49.757537+0000","last_became_peered":"2024-09-11T22:15:49.757537+0000","last_unstale":"2024-09-11T22:15:50.768146+0000","last_undegraded":"2024-09-11T22:15:50.768146+0000","last_fullsized":"2024-09-11T22:15:50.768146+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.339096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.767453+0000","last_change":"2024-09-11T22:15:49.769342+0000","last_active":"2024-09-11T22:15:50.767453+0000","last_peered":"2024-09-11T22:15:50.767453+0000","last_clean":"2024-09-11T22:15:50.767453+0000","last_became_active":"2024-09-11T22:15:49.769089+0000","last_became_peered":"2024-09-11T22:15:49.769089+0000","last_unstale":"2024-09-11T22:15:50.767453+0000","last_undegraded":"2024-09-11T22:15:50.767453+0000","last_fullsized":"2024-09-11T22:15:50.767453+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:43.495378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:55.865956+0000","last_change":"2024-09-11T22:15:49.762290+0000","last_active":"2024-09-11T22:15:55.865956+0000","last_peered":"2024-09-11T22:15:55.865956+0000","last_clean":"2024-09-11T22:15:55.865956+0000","last_became_active":"2024-09-11T22:15:49.762021+0000","last_became_peered":"2024-09-11T22:15:49.762021+0000","last_unstale":"2024-09-11T22:15:55.865956+0000","last_undegraded":"2024-09-11T22:15:55.865956+0000","last_fullsized":"2024-09-11T22:15:55.865956+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:58.230446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.767620+0000","last_change":"2024-09-11T22:15:49.759706+0000","last_active":"2024-09-11T22:15:50.767620+0000","last_peered":"2024-09-11T22:15:50.767620+0000","last_clean":"2024-09-11T22:15:50.767620+0000","last_became_active":"2024-09-11T22:15:49.759393+0000","last_became_peered":"2024-09-11T22:15:49.759393+0000","last_unstale":"2024-09-11T22:15:50.767620+0000","last_undegraded":"2024-09-11T22:15:50.767620+0000","last_fullsized":"2024-09-11T22:15:50.767620+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:29.860267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.768154+0000","last_change":"2024-09-11T22:15:49.760351+0000","last_active":"2024-09-11T22:15:50.768154+0000","last_peered":"2024-09-11T22:15:50.768154+0000","last_clean":"2024-09-11T22:15:50.768154+0000","last_became_active":"2024-09-11T22:15:49.760082+0000","last_became_peered":"2024-09-11T22:15:49.760082+0000","last_unstale":"2024-09-11T22:15:50.768154+0000","last_undegraded":"2024-09-11T22:15:50.768154+0000","last_fullsized":"2024-09-11T22:15:50.768154+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:09.667845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.108074+0000","last_change":"2024-09-11T22:15:49.756956+0000","last_active":"2024-09-11T22:15:52.108074+0000","last_peered":"2024-09-11T22:15:52.108074+0000","last_clean":"2024-09-11T22:15:52.108074+0000","last_became_active":"2024-09-11T22:15:49.756546+0000","last_became_peered":"2024-09-11T22:15:49.756546+0000","last_unstale":"2024-09-11T22:15:52.108074+0000","last_undegraded":"2024-09-11T22:15:52.108074+0000","last_fullsized":"2024-09-11T22:15:52.108074+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:09.214202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.262217+0000","last_change":"2024-09-11T22:15:49.764996+0000","last_active":"2024-09-11T22:15:51.262217+0000","last_peered":"2024-09-11T22:15:51.262217+0000","last_clean":"2024-09-11T22:15:51.262217+0000","last_became_active":"2024-09-11T22:15:49.764707+0000","last_became_peered":"2024-09-11T22:15:49.764707+0000","last_unstale":"2024-09-11T22:15:51.262217+0000","last_undegraded":"2024-09-11T22:15:51.262217+0000","last_fullsized":"2024-09-11T22:15:51.262217+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:25:44.499589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.107807+0000","last_change":"2024-09-11T22:15:49.756358+0000","last_active":"2024-09-11T22:15:52.107807+0000","last_peered":"2024-09-11T22:15:52.107807+0000","last_clean":"2024-09-11T22:15:52.107807+0000","last_became_active":"2024-09-11T22:15:49.756076+0000","last_became_peered":"2024-09-11T22:15:49.756076+0000","last_unstale":"2024-09-11T22:15:52.107807+0000","last_undegraded":"2024-09-11T22:15:52.107807+0000","last_fullsized":"2024-09-11T22:15:52.107807+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:23.513065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:56.253571+0000","last_change":"2024-09-11T22:15:49.764802+0000","last_active":"2024-09-11T22:15:56.253571+0000","last_peered":"2024-09-11T22:15:56.253571+0000","last_clean":"2024-09-11T22:15:56.253571+0000","last_became_active":"2024-09-11T22:15:49.764221+0000","last_became_peered":"2024-09-11T22:15:49.764221+0000","last_unstale":"2024-09-11T22:15:56.253571+0000","last_undegraded":"2024-09-11T22:15:56.253571+0000","last_fullsized":"2024-09-11T22:15:56.253571+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:05.855338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:55.866143+0000","last_change":"2024-09-11T22:15:49.758506+0000","last_active":"2024-09-11T22:15:55.866143+0000","last_peered":"2024-09-11T22:15:55.866143+0000","last_clean":"2024-09-11T22:15:55.866143+0000","last_became_active":"2024-09-11T22:15:49.757038+0000","last_became_peered":"2024-09-11T22:15:49.757038+0000","last_unstale":"2024-09-11T22:15:55.866143+0000","last_undegraded":"2024-09-11T22:15:55.866143+0000","last_fullsized":"2024-09-11T22:15:55.866143+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:41.049079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.107007+0000","last_change":"2024-09-11T22:15:49.765030+0000","last_active":"2024-09-11T22:15:52.107007+0000","last_peered":"2024-09-11T22:15:52.107007+0000","last_clean":"2024-09-11T22:15:52.107007+0000","last_became_active":"2024-09-11T22:15:49.764761+0000","last_became_peered":"2024-09-11T22:15:49.764761+0000","last_unstale":"2024-09-11T22:15:52.107007+0000","last_undegraded":"2024-09-11T22:15:52.107007+0000","last_fullsized":"2024-09-11T22:15:52.107007+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:51.120498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.767173+0000","last_change":"2024-09-11T22:15:49.758807+0000","last_active":"2024-09-11T22:15:50.767173+0000","last_peered":"2024-09-11T22:15:50.767173+0000","last_clean":"2024-09-11T22:15:50.767173+0000","last_became_active":"2024-09-11T22:15:49.758490+0000","last_became_peered":"2024-09-11T22:15:49.758490+0000","last_unstale":"2024-09-11T22:15:50.767173+0000","last_undegraded":"2024-09-11T22:15:50.767173+0000","last_fullsized":"2024-09-11T22:15:50.767173+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:43.495378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.768223+0000","last_change":"2024-09-11T22:15:49.756573+0000","last_active":"2024-09-11T22:15:50.768223+0000","last_peered":"2024-09-11T22:15:50.768223+0000","last_clean":"2024-09-11T22:15:50.768223+0000","last_became_active":"2024-09-11T22:15:49.756305+0000","last_became_peered":"2024-09-11T22:15:49.756305+0000","last_unstale":"2024-09-11T22:15:50.768223+0000","last_undegraded":"2024-09-11T22:15:50.768223+0000","last_fullsized":"2024-09-11T22:15:50.768223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:02.827996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:55.866502+0000","last_change":"2024-09-11T22:15:49.757671+0000","last_active":"2024-09-11T22:15:55.866502+0000","last_peered":"2024-09-11T22:15:55.866502+0000","last_clean":"2024-09-11T22:15:55.866502+0000","last_became_active":"2024-09-11T22:15:49.757377+0000","last_became_peered":"2024-09-11T22:15:49.757377+0000","last_unstale":"2024-09-11T22:15:55.866502+0000","last_undegraded":"2024-09-11T22:15:55.866502+0000","last_fullsized":"2024-09-11T22:15:55.866502+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:39.509807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.761590+0000","last_change":"2024-09-11T22:15:49.755919+0000","last_active":"2024-09-11T22:15:50.761590+0000","last_peered":"2024-09-11T22:15:50.761590+0000","last_clean":"2024-09-11T22:15:50.761590+0000","last_became_active":"2024-09-11T22:15:49.753765+0000","last_became_peered":"2024-09-11T22:15:49.753765+0000","last_unstale":"2024-09-11T22:15:50.761590+0000","last_undegraded":"2024-09-11T22:15:50.761590+0000","last_fullsized":"2024-09-11T22:15:50.761590+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:29.860267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:55.866370+0000","last_change":"2024-09-11T22:15:49.766261+0000","last_active":"2024-09-11T22:15:55.866370+0000","last_peered":"2024-09-11T22:15:55.866370+0000","last_clean":"2024-09-11T22:15:55.866370+0000","last_became_active":"2024-09-11T22:15:49.765950+0000","last_became_peered":"2024-09-11T22:15:49.765950+0000","last_unstale":"2024-09-11T22:15:55.866370+0000","last_undegraded":"2024-09-11T22:15:55.866370+0000","last_fullsized":"2024-09-11T22:15:55.866370+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:13.025467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:55.866124+0000","last_change":"2024-09-11T22:15:49.767809+0000","last_active":"2024-09-11T22:15:55.866124+0000","last_peered":"2024-09-11T22:15:55.866124+0000","last_clean":"2024-09-11T22:15:55.866124+0000","last_became_active":"2024-09-11T22:15:49.767536+0000","last_became_peered":"2024-09-11T22:15:49.767536+0000","last_unstale":"2024-09-11T22:15:55.866124+0000","last_undegraded":"2024-09-11T22:15:55.866124+0000","last_fullsized":"2024-09-11T22:15:55.866124+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:38.651489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.261942+0000","last_change":"2024-09-11T22:15:49.771153+0000","last_active":"2024-09-11T22:15:51.261942+0000","last_peered":"2024-09-11T22:15:51.261942+0000","last_clean":"2024-09-11T22:15:51.261942+0000","last_became_active":"2024-09-11T22:15:49.770814+0000","last_became_peered":"2024-09-11T22:15:49.770814+0000","last_unstale":"2024-09-11T22:15:51.261942+0000","last_undegraded":"2024-09-11T22:15:51.261942+0000","last_fullsized":"2024-09-11T22:15:51.261942+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:10.635411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.107818+0000","last_change":"2024-09-11T22:15:49.770962+0000","last_active":"2024-09-11T22:15:52.107818+0000","last_peered":"2024-09-11T22:15:52.107818+0000","last_clean":"2024-09-11T22:15:52.107818+0000","last_became_active":"2024-09-11T22:15:49.770673+0000","last_became_peered":"2024-09-11T22:15:49.770673+0000","last_unstale":"2024-09-11T22:15:52.107818+0000","last_undegraded":"2024-09-11T22:15:52.107818+0000","last_fullsized":"2024-09-11T22:15:52.107818+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:38.435825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:55.866500+0000","last_change":"2024-09-11T22:15:49.765353+0000","last_active":"2024-09-11T22:15:55.866500+0000","last_peered":"2024-09-11T22:15:55.866500+0000","last_clean":"2024-09-11T22:15:55.866500+0000","last_became_active":"2024-09-11T22:15:49.765075+0000","last_became_peered":"2024-09-11T22:15:49.765075+0000","last_unstale":"2024-09-11T22:15:55.866500+0000","last_undegraded":"2024-09-11T22:15:55.866500+0000","last_fullsized":"2024-09-11T22:15:55.866500+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:33.819812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.262455+0000","last_change":"2024-09-11T22:15:49.758712+0000","last_active":"2024-09-11T22:15:51.262455+0000","last_peered":"2024-09-11T22:15:51.262455+0000","last_clean":"2024-09-11T22:15:51.262455+0000","last_became_active":"2024-09-11T22:15:49.758431+0000","last_became_peered":"2024-09-11T22:15:49.758431+0000","last_unstale":"2024-09-11T22:15:51.262455+0000","last_undegraded":"2024-09-11T22:15:51.262455+0000","last_fullsized":"2024-09-11T22:15:51.262455+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:42.485432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:56.253740+0000","last_change":"2024-09-11T22:15:49.774179+0000","last_active":"2024-09-11T22:15:56.253740+0000","last_peered":"2024-09-11T22:15:56.253740+0000","last_clean":"2024-09-11T22:15:56.253740+0000","last_became_active":"2024-09-11T22:15:49.773810+0000","last_became_peered":"2024-09-11T22:15:49.773810+0000","last_unstale":"2024-09-11T22:15:56.253740+0000","last_undegraded":"2024-09-11T22:15:56.253740+0000","last_fullsized":"2024-09-11T22:15:56.253740+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:24.018537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.768021+0000","last_change":"2024-09-11T22:15:49.752895+0000","last_active":"2024-09-11T22:15:50.768021+0000","last_peered":"2024-09-11T22:15:50.768021+0000","last_clean":"2024-09-11T22:15:50.768021+0000","last_became_active":"2024-09-11T22:15:49.752382+0000","last_became_peered":"2024-09-11T22:15:49.752382+0000","last_unstale":"2024-09-11T22:15:50.768021+0000","last_undegraded":"2024-09-11T22:15:50.768021+0000","last_fullsized":"2024-09-11T22:15:50.768021+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:39.538849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.107816+0000","last_change":"2024-09-11T22:15:49.756678+0000","last_active":"2024-09-11T22:15:52.107816+0000","last_peered":"2024-09-11T22:15:52.107816+0000","last_clean":"2024-09-11T22:15:52.107816+0000","last_became_active":"2024-09-11T22:15:49.756293+0000","last_became_peered":"2024-09-11T22:15:49.756293+0000","last_unstale":"2024-09-11T22:15:52.107816+0000","last_undegraded":"2024-09-11T22:15:52.107816+0000","last_fullsized":"2024-09-11T22:15:52.107816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:11.774824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.262077+0000","last_change":"2024-09-11T22:15:49.755653+0000","last_active":"2024-09-11T22:15:51.262077+0000","last_peered":"2024-09-11T22:15:51.262077+0000","last_clean":"2024-09-11T22:15:51.262077+0000","last_became_active":"2024-09-11T22:15:49.755298+0000","last_became_peered":"2024-09-11T22:15:49.755298+0000","last_unstale":"2024-09-11T22:15:51.262077+0000","last_undegraded":"2024-09-11T22:15:51.262077+0000","last_fullsized":"2024-09-11T22:15:51.262077+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:05.536590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.261951+0000","last_change":"2024-09-11T22:15:49.767813+0000","last_active":"2024-09-11T22:15:51.261951+0000","last_peered":"2024-09-11T22:15:51.261951+0000","last_clean":"2024-09-11T22:15:51.261951+0000","last_became_active":"2024-09-11T22:15:49.767547+0000","last_became_peered":"2024-09-11T22:15:49.767547+0000","last_unstale":"2024-09-11T22:15:51.261951+0000","last_undegraded":"2024-09-11T22:15:51.261951+0000","last_fullsized":"2024-09-11T22:15:51.261951+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:10.412031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.767841+0000","last_change":"2024-09-11T22:15:49.760065+0000","last_active":"2024-09-11T22:15:50.767841+0000","last_peered":"2024-09-11T22:15:50.767841+0000","last_clean":"2024-09-11T22:15:50.767841+0000","last_became_active":"2024-09-11T22:15:49.759799+0000","last_became_peered":"2024-09-11T22:15:49.759799+0000","last_unstale":"2024-09-11T22:15:50.767841+0000","last_undegraded":"2024-09-11T22:15:50.767841+0000","last_fullsized":"2024-09-11T22:15:50.767841+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:34.965646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.107720+0000","last_change":"2024-09-11T22:15:49.766799+0000","last_active":"2024-09-11T22:15:52.107720+0000","last_peered":"2024-09-11T22:15:52.107720+0000","last_clean":"2024-09-11T22:15:52.107720+0000","last_became_active":"2024-09-11T22:15:49.766534+0000","last_became_peered":"2024-09-11T22:15:49.766534+0000","last_unstale":"2024-09-11T22:15:52.107720+0000","last_undegraded":"2024-09-11T22:15:52.107720+0000","last_fullsized":"2024-09-11T22:15:52.107720+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:01.340209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.767587+0000","last_change":"2024-09-11T22:15:49.758107+0000","last_active":"2024-09-11T22:15:50.767587+0000","last_peered":"2024-09-11T22:15:50.767587+0000","last_clean":"2024-09-11T22:15:50.767587+0000","last_became_active":"2024-09-11T22:15:49.757797+0000","last_became_peered":"2024-09-11T22:15:49.757797+0000","last_unstale":"2024-09-11T22:15:50.767587+0000","last_undegraded":"2024-09-11T22:15:50.767587+0000","last_fullsized":"2024-09-11T22:15:50.767587+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:07.688243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"88'4","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.108295+0000","last_change":"2024-09-11T22:15:48.757358+0000","last_active":"2024-09-11T22:15:52.108295+0000","last_peered":"2024-09-11T22:15:52.108295+0000","last_clean":"2024-09-11T22:15:52.108295+0000","last_became_active":"2024-09-11T22:15:48.756802+0000","last_became_peered":"2024-09-11T22:15:48.756802+0000","last_unstale":"2024-09-11T22:15:52.108295+0000","last_undegraded":"2024-09-11T22:15:52.108295+0000","last_fullsized":"2024-09-11T22:15:52.108295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:14.217506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.108177+0000","last_change":"2024-09-11T22:15:49.768110+0000","last_active":"2024-09-11T22:15:52.108177+0000","last_peered":"2024-09-11T22:15:52.108177+0000","last_clean":"2024-09-11T22:15:52.108177+0000","last_became_active":"2024-09-11T22:15:49.767820+0000","last_became_peered":"2024-09-11T22:15:49.767820+0000","last_unstale":"2024-09-11T22:15:52.108177+0000","last_undegraded":"2024-09-11T22:15:52.108177+0000","last_fullsized":"2024-09-11T22:15:52.108177+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:07.688243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"88'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.767865+0000","last_change":"2024-09-11T22:15:48.755723+0000","last_active":"2024-09-11T22:15:50.767865+0000","last_peered":"2024-09-11T22:15:50.767865+0000","last_clean":"2024-09-11T22:15:50.767865+0000","last_became_active":"2024-09-11T22:15:48.755202+0000","last_became_peered":"2024-09-11T22:15:48.755202+0000","last_unstale":"2024-09-11T22:15:50.767865+0000","last_undegraded":"2024-09-11T22:15:50.767865+0000","last_fullsized":"2024-09-11T22:15:50.767865+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:25:43.494093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.108067+0000","last_change":"2024-09-11T22:15:49.757293+0000","last_active":"2024-09-11T22:15:52.108067+0000","last_peered":"2024-09-11T22:15:52.108067+0000","last_clean":"2024-09-11T22:15:52.108067+0000","last_became_active":"2024-09-11T22:15:49.757028+0000","last_became_peered":"2024-09-11T22:15:49.757028+0000","last_unstale":"2024-09-11T22:15:52.108067+0000","last_undegraded":"2024-09-11T22:15:52.108067+0000","last_fullsized":"2024-09-11T22:15:52.108067+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.163266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"88'2","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.761680+0000","last_change":"2024-09-11T22:15:48.756677+0000","last_active":"2024-09-11T22:15:50.761680+0000","last_peered":"2024-09-11T22:15:50.761680+0000","last_clean":"2024-09-11T22:15:50.761680+0000","last_became_active":"2024-09-11T22:15:48.756204+0000","last_became_peered":"2024-09-11T22:15:48.756204+0000","last_unstale":"2024-09-11T22:15:50.761680+0000","last_undegraded":"2024-09-11T22:15:50.761680+0000","last_fullsized":"2024-09-11T22:15:50.761680+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:58.192598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:56.253708+0000","last_change":"2024-09-11T22:15:49.768008+0000","last_active":"2024-09-11T22:15:56.253708+0000","last_peered":"2024-09-11T22:15:56.253708+0000","last_clean":"2024-09-11T22:15:56.253708+0000","last_became_active":"2024-09-11T22:15:49.767715+0000","last_became_peered":"2024-09-11T22:15:49.767715+0000","last_unstale":"2024-09-11T22:15:56.253708+0000","last_undegraded":"2024-09-11T22:15:56.253708+0000","last_fullsized":"2024-09-11T22:15:56.253708+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:26.319701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"88'2","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.761567+0000","last_change":"2024-09-11T22:15:48.760604+0000","last_active":"2024-09-11T22:15:50.761567+0000","last_peered":"2024-09-11T22:15:50.761567+0000","last_clean":"2024-09-11T22:15:50.761567+0000","last_became_active":"2024-09-11T22:15:48.760301+0000","last_became_peered":"2024-09-11T22:15:48.760301+0000","last_unstale":"2024-09-11T22:15:50.761567+0000","last_undegraded":"2024-09-11T22:15:50.761567+0000","last_fullsized":"2024-09-11T22:15:50.761567+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:41.877937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.262129+0000","last_change":"2024-09-11T22:15:49.755828+0000","last_active":"2024-09-11T22:15:51.262129+0000","last_peered":"2024-09-11T22:15:51.262129+0000","last_clean":"2024-09-11T22:15:51.262129+0000","last_became_active":"2024-09-11T22:15:49.755371+0000","last_became_peered":"2024-09-11T22:15:49.755371+0000","last_unstale":"2024-09-11T22:15:51.262129+0000","last_undegraded":"2024-09-11T22:15:51.262129+0000","last_fullsized":"2024-09-11T22:15:51.262129+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:30.312166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"88'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.768354+0000","last_change":"2024-09-11T22:15:48.756889+0000","last_active":"2024-09-11T22:15:50.768354+0000","last_peered":"2024-09-11T22:15:50.768354+0000","last_clean":"2024-09-11T22:15:50.768354+0000","last_became_active":"2024-09-11T22:15:48.756634+0000","last_became_peered":"2024-09-11T22:15:48.756634+0000","last_unstale":"2024-09-11T22:15:50.768354+0000","last_undegraded":"2024-09-11T22:15:50.768354+0000","last_fullsized":"2024-09-11T22:15:50.768354+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:41.479935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.768172+0000","last_change":"2024-09-11T22:15:49.752927+0000","last_active":"2024-09-11T22:15:50.768172+0000","last_peered":"2024-09-11T22:15:50.768172+0000","last_clean":"2024-09-11T22:15:50.768172+0000","last_became_active":"2024-09-11T22:15:49.752650+0000","last_became_peered":"2024-09-11T22:15:49.752650+0000","last_unstale":"2024-09-11T22:15:50.768172+0000","last_undegraded":"2024-09-11T22:15:50.768172+0000","last_fullsized":"2024-09-11T22:15:50.768172+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:08.115600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"88'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.767165+0000","last_change":"2024-09-11T22:15:48.757211+0000","last_active":"2024-09-11T22:15:50.767165+0000","last_peered":"2024-09-11T22:15:50.767165+0000","last_clean":"2024-09-11T22:15:50.767165+0000","last_became_active":"2024-09-11T22:15:48.756934+0000","last_became_peered":"2024-09-11T22:15:48.756934+0000","last_unstale":"2024-09-11T22:15:50.767165+0000","last_undegraded":"2024-09-11T22:15:50.767165+0000","last_fullsized":"2024-09-11T22:15:50.767165+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:04.531093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:56.253474+0000","last_change":"2024-09-11T22:15:49.761546+0000","last_active":"2024-09-11T22:15:56.253474+0000","last_peered":"2024-09-11T22:15:56.253474+0000","last_clean":"2024-09-11T22:15:56.253474+0000","last_became_active":"2024-09-11T22:15:49.761226+0000","last_became_peered":"2024-09-11T22:15:49.761226+0000","last_unstale":"2024-09-11T22:15:56.253474+0000","last_undegraded":"2024-09-11T22:15:56.253474+0000","last_fullsized":"2024-09-11T22:15:56.253474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:28.512851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.761264+0000","last_change":"2024-09-11T22:15:48.758321+0000","last_active":"2024-09-11T22:15:50.761264+0000","last_peered":"2024-09-11T22:15:50.761264+0000","last_clean":"2024-09-11T22:15:50.761264+0000","last_became_active":"2024-09-11T22:15:48.758058+0000","last_became_peered":"2024-09-11T22:15:48.758058+0000","last_unstale":"2024-09-11T22:15:50.761264+0000","last_undegraded":"2024-09-11T22:15:50.761264+0000","last_fullsized":"2024-09-11T22:15:50.761264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:41.479935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.107064+0000","last_change":"2024-09-11T22:15:49.764394+0000","last_active":"2024-09-11T22:15:52.107064+0000","last_peered":"2024-09-11T22:15:52.107064+0000","last_clean":"2024-09-11T22:15:52.107064+0000","last_became_active":"2024-09-11T22:15:49.764085+0000","last_became_peered":"2024-09-11T22:15:49.764085+0000","last_unstale":"2024-09-11T22:15:52.107064+0000","last_undegraded":"2024-09-11T22:15:52.107064+0000","last_fullsized":"2024-09-11T22:15:52.107064+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:10.848476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.261872+0000","last_change":"2024-09-11T22:15:48.755608+0000","last_active":"2024-09-11T22:15:51.261872+0000","last_peered":"2024-09-11T22:15:51.261872+0000","last_clean":"2024-09-11T22:15:51.261872+0000","last_became_active":"2024-09-11T22:15:48.755303+0000","last_became_peered":"2024-09-11T22:15:48.755303+0000","last_unstale":"2024-09-11T22:15:51.261872+0000","last_undegraded":"2024-09-11T22:15:51.261872+0000","last_fullsized":"2024-09-11T22:15:51.261872+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:33.429722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.107500+0000","last_change":"2024-09-11T22:15:49.757362+0000","last_active":"2024-09-11T22:15:52.107500+0000","last_peered":"2024-09-11T22:15:52.107500+0000","last_clean":"2024-09-11T22:15:52.107500+0000","last_became_active":"2024-09-11T22:15:49.757047+0000","last_became_peered":"2024-09-11T22:15:49.757047+0000","last_unstale":"2024-09-11T22:15:52.107500+0000","last_undegraded":"2024-09-11T22:15:52.107500+0000","last_fullsized":"2024-09-11T22:15:52.107500+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:40.980582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.108342+0000","last_change":"2024-09-11T22:15:48.753492+0000","last_active":"2024-09-11T22:15:52.108342+0000","last_peered":"2024-09-11T22:15:52.108342+0000","last_clean":"2024-09-11T22:15:52.108342+0000","last_became_active":"2024-09-11T22:15:48.753269+0000","last_became_peered":"2024-09-11T22:15:48.753269+0000","last_unstale":"2024-09-11T22:15:52.108342+0000","last_undegraded":"2024-09-11T22:15:52.108342+0000","last_fullsized":"2024-09-11T22:15:52.108342+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:24.239471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.768303+0000","last_change":"2024-09-11T22:15:49.766606+0000","last_active":"2024-09-11T22:15:50.768303+0000","last_peered":"2024-09-11T22:15:50.768303+0000","last_clean":"2024-09-11T22:15:50.768303+0000","last_became_active":"2024-09-11T22:15:49.766333+0000","last_became_peered":"2024-09-11T22:15:49.766333+0000","last_unstale":"2024-09-11T22:15:50.768303+0000","last_undegraded":"2024-09-11T22:15:50.768303+0000","last_fullsized":"2024-09-11T22:15:50.768303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.339096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.108058+0000","last_change":"2024-09-11T22:15:48.756378+0000","last_active":"2024-09-11T22:15:52.108058+0000","last_peered":"2024-09-11T22:15:52.108058+0000","last_clean":"2024-09-11T22:15:52.108058+0000","last_became_active":"2024-09-11T22:15:48.756100+0000","last_became_peered":"2024-09-11T22:15:48.756100+0000","last_unstale":"2024-09-11T22:15:52.108058+0000","last_undegraded":"2024-09-11T22:15:52.108058+0000","last_fullsized":"2024-09-11T22:15:52.108058+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.697611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.761507+0000","last_change":"2024-09-11T22:15:49.771733+0000","last_active":"2024-09-11T22:15:50.761507+0000","last_peered":"2024-09-11T22:15:50.761507+0000","last_clean":"2024-09-11T22:15:50.761507+0000","last_became_active":"2024-09-11T22:15:49.771437+0000","last_became_peered":"2024-09-11T22:15:49.771437+0000","last_unstale":"2024-09-11T22:15:50.761507+0000","last_undegraded":"2024-09-11T22:15:50.761507+0000","last_fullsized":"2024-09-11T22:15:50.761507+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:07.688243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"88'3","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.107928+0000","last_change":"2024-09-11T22:15:48.753488+0000","last_active":"2024-09-11T22:15:52.107928+0000","last_peered":"2024-09-11T22:15:52.107928+0000","last_clean":"2024-09-11T22:15:52.107928+0000","last_became_active":"2024-09-11T22:15:48.753210+0000","last_became_peered":"2024-09-11T22:15:48.753210+0000","last_unstale":"2024-09-11T22:15:52.107928+0000","last_undegraded":"2024-09-11T22:15:52.107928+0000","last_fullsized":"2024-09-11T22:15:52.107928+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:49.102035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.768028+0000","last_change":"2024-09-11T22:15:49.759209+0000","last_active":"2024-09-11T22:15:50.768028+0000","last_peered":"2024-09-11T22:15:50.768028+0000","last_clean":"2024-09-11T22:15:50.768028+0000","last_became_active":"2024-09-11T22:15:49.758952+0000","last_became_peered":"2024-09-11T22:15:49.758952+0000","last_unstale":"2024-09-11T22:15:50.768028+0000","last_undegraded":"2024-09-11T22:15:50.768028+0000","last_fullsized":"2024-09-11T22:15:50.768028+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:09.667845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"88'6","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.768456+0000","last_change":"2024-09-11T22:15:48.745068+0000","last_active":"2024-09-11T22:15:50.768456+0000","last_peered":"2024-09-11T22:15:50.768456+0000","last_clean":"2024-09-11T22:15:50.768456+0000","last_became_active":"2024-09-11T22:15:48.744801+0000","last_became_peered":"2024-09-11T22:15:48.744801+0000","last_unstale":"2024-09-11T22:15:50.768456+0000","last_undegraded":"2024-09-11T22:15:50.768456+0000","last_fullsized":"2024-09-11T22:15:50.768456+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:56.030385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.761464+0000","last_change":"2024-09-11T22:15:49.757410+0000","last_active":"2024-09-11T22:15:50.761464+0000","last_peered":"2024-09-11T22:15:50.761464+0000","last_clean":"2024-09-11T22:15:50.761464+0000","last_became_active":"2024-09-11T22:15:49.754016+0000","last_became_peered":"2024-09-11T22:15:49.754016+0000","last_unstale":"2024-09-11T22:15:50.761464+0000","last_undegraded":"2024-09-11T22:15:50.761464+0000","last_fullsized":"2024-09-11T22:15:50.761464+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:43.495378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"88'2","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.262021+0000","last_change":"2024-09-11T22:15:48.760851+0000","last_active":"2024-09-11T22:15:51.262021+0000","last_peered":"2024-09-11T22:15:51.262021+0000","last_clean":"2024-09-11T22:15:51.262021+0000","last_became_active":"2024-09-11T22:15:48.760540+0000","last_became_peered":"2024-09-11T22:15:48.760540+0000","last_unstale":"2024-09-11T22:15:51.262021+0000","last_undegraded":"2024-09-11T22:15:51.262021+0000","last_fullsized":"2024-09-11T22:15:51.262021+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:48.772533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:56.253620+0000","last_change":"2024-09-11T22:15:49.762353+0000","last_active":"2024-09-11T22:15:56.253620+0000","last_peered":"2024-09-11T22:15:56.253620+0000","last_clean":"2024-09-11T22:15:56.253620+0000","last_became_active":"2024-09-11T22:15:49.762075+0000","last_became_peered":"2024-09-11T22:15:49.762075+0000","last_unstale":"2024-09-11T22:15:56.253620+0000","last_undegraded":"2024-09-11T22:15:56.253620+0000","last_fullsized":"2024-09-11T22:15:56.253620+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:29.220164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.107185+0000","last_change":"2024-09-11T22:15:48.753807+0000","last_active":"2024-09-11T22:15:52.107185+0000","last_peered":"2024-09-11T22:15:52.107185+0000","last_clean":"2024-09-11T22:15:52.107185+0000","last_became_active":"2024-09-11T22:15:48.753523+0000","last_became_peered":"2024-09-11T22:15:48.753523+0000","last_unstale":"2024-09-11T22:15:52.107185+0000","last_undegraded":"2024-09-11T22:15:52.107185+0000","last_fullsized":"2024-09-11T22:15:52.107185+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:43.359541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.261846+0000","last_change":"2024-09-11T22:15:49.761848+0000","last_active":"2024-09-11T22:15:51.261846+0000","last_peered":"2024-09-11T22:15:51.261846+0000","last_clean":"2024-09-11T22:15:51.261846+0000","last_became_active":"2024-09-11T22:15:49.760634+0000","last_became_peered":"2024-09-11T22:15:49.760634+0000","last_unstale":"2024-09-11T22:15:51.261846+0000","last_undegraded":"2024-09-11T22:15:51.261846+0000","last_fullsized":"2024-09-11T22:15:51.261846+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:17.703108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.768032+0000","last_change":"2024-09-11T22:15:48.752805+0000","last_active":"2024-09-11T22:15:50.768032+0000","last_peered":"2024-09-11T22:15:50.768032+0000","last_clean":"2024-09-11T22:15:50.768032+0000","last_became_active":"2024-09-11T22:15:48.752539+0000","last_became_peered":"2024-09-11T22:15:48.752539+0000","last_unstale":"2024-09-11T22:15:50.768032+0000","last_undegraded":"2024-09-11T22:15:50.768032+0000","last_fullsized":"2024-09-11T22:15:50.768032+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:56.497451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.261796+0000","last_change":"2024-09-11T22:15:49.757993+0000","last_active":"2024-09-11T22:15:51.261796+0000","last_peered":"2024-09-11T22:15:51.261796+0000","last_clean":"2024-09-11T22:15:51.261796+0000","last_became_active":"2024-09-11T22:15:49.757688+0000","last_became_peered":"2024-09-11T22:15:49.757688+0000","last_unstale":"2024-09-11T22:15:51.261796+0000","last_undegraded":"2024-09-11T22:15:51.261796+0000","last_fullsized":"2024-09-11T22:15:51.261796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:37.721635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"88'8","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.761190+0000","last_change":"2024-09-11T22:15:48.753365+0000","last_active":"2024-09-11T22:15:50.761190+0000","last_peered":"2024-09-11T22:15:50.761190+0000","last_clean":"2024-09-11T22:15:50.761190+0000","last_became_active":"2024-09-11T22:15:48.753060+0000","last_became_peered":"2024-09-11T22:15:48.753060+0000","last_unstale":"2024-09-11T22:15:50.761190+0000","last_undegraded":"2024-09-11T22:15:50.761190+0000","last_fullsized":"2024-09-11T22:15:50.761190+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:25:43.494093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:56.253741+0000","last_change":"2024-09-11T22:15:49.762513+0000","last_active":"2024-09-11T22:15:56.253741+0000","last_peered":"2024-09-11T22:15:56.253741+0000","last_clean":"2024-09-11T22:15:56.253741+0000","last_became_active":"2024-09-11T22:15:49.762243+0000","last_became_peered":"2024-09-11T22:15:49.762243+0000","last_unstale":"2024-09-11T22:15:56.253741+0000","last_undegraded":"2024-09-11T22:15:56.253741+0000","last_fullsized":"2024-09-11T22:15:56.253741+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:36:09.441632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"88'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.108404+0000","last_change":"2024-09-11T22:15:48.750585+0000","last_active":"2024-09-11T22:15:52.108404+0000","last_peered":"2024-09-11T22:15:52.108404+0000","last_clean":"2024-09-11T22:15:52.108404+0000","last_became_active":"2024-09-11T22:15:48.750301+0000","last_became_peered":"2024-09-11T22:15:48.750301+0000","last_unstale":"2024-09-11T22:15:52.108404+0000","last_undegraded":"2024-09-11T22:15:52.108404+0000","last_fullsized":"2024-09-11T22:15:52.108404+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:36.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.108286+0000","last_change":"2024-09-11T22:15:49.769468+0000","last_active":"2024-09-11T22:15:52.108286+0000","last_peered":"2024-09-11T22:15:52.108286+0000","last_clean":"2024-09-11T22:15:52.108286+0000","last_became_active":"2024-09-11T22:15:49.768690+0000","last_became_peered":"2024-09-11T22:15:49.768690+0000","last_unstale":"2024-09-11T22:15:52.108286+0000","last_undegraded":"2024-09-11T22:15:52.108286+0000","last_fullsized":"2024-09-11T22:15:52.108286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:34.965646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"88'2","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.761664+0000","last_change":"2024-09-11T22:15:48.761035+0000","last_active":"2024-09-11T22:15:50.761664+0000","last_peered":"2024-09-11T22:15:50.761664+0000","last_clean":"2024-09-11T22:15:50.761664+0000","last_became_active":"2024-09-11T22:15:48.760673+0000","last_became_peered":"2024-09-11T22:15:48.760673+0000","last_unstale":"2024-09-11T22:15:50.761664+0000","last_undegraded":"2024-09-11T22:15:50.761664+0000","last_fullsized":"2024-09-11T22:15:50.761664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:00.334713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.768201+0000","last_change":"2024-09-11T22:15:49.755011+0000","last_active":"2024-09-11T22:15:50.768201+0000","last_peered":"2024-09-11T22:15:50.768201+0000","last_clean":"2024-09-11T22:15:50.768201+0000","last_became_active":"2024-09-11T22:15:49.754626+0000","last_became_peered":"2024-09-11T22:15:49.754626+0000","last_unstale":"2024-09-11T22:15:50.768201+0000","last_undegraded":"2024-09-11T22:15:50.768201+0000","last_fullsized":"2024-09-11T22:15:50.768201+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:40.269460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.761608+0000","last_change":"2024-09-11T22:15:48.753389+0000","last_active":"2024-09-11T22:15:50.761608+0000","last_peered":"2024-09-11T22:15:50.761608+0000","last_clean":"2024-09-11T22:15:50.761608+0000","last_became_active":"2024-09-11T22:15:48.753078+0000","last_became_peered":"2024-09-11T22:15:48.753078+0000","last_unstale":"2024-09-11T22:15:50.761608+0000","last_undegraded":"2024-09-11T22:15:50.761608+0000","last_fullsized":"2024-09-11T22:15:50.761608+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:56.497451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:55.866228+0000","last_change":"2024-09-11T22:15:49.758184+0000","last_active":"2024-09-11T22:15:55.866228+0000","last_peered":"2024-09-11T22:15:55.866228+0000","last_clean":"2024-09-11T22:15:55.866228+0000","last_became_active":"2024-09-11T22:15:49.756641+0000","last_became_peered":"2024-09-11T22:15:49.756641+0000","last_unstale":"2024-09-11T22:15:55.866228+0000","last_undegraded":"2024-09-11T22:15:55.866228+0000","last_fullsized":"2024-09-11T22:15:55.866228+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:30.172146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"88'2","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.107459+0000","last_change":"2024-09-11T22:15:48.756390+0000","last_active":"2024-09-11T22:15:52.107459+0000","last_peered":"2024-09-11T22:15:52.107459+0000","last_clean":"2024-09-11T22:15:52.107459+0000","last_became_active":"2024-09-11T22:15:48.756076+0000","last_became_peered":"2024-09-11T22:15:48.756076+0000","last_unstale":"2024-09-11T22:15:52.107459+0000","last_undegraded":"2024-09-11T22:15:52.107459+0000","last_fullsized":"2024-09-11T22:15:52.107459+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:26.295130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.767746+0000","last_change":"2024-09-11T22:15:49.753983+0000","last_active":"2024-09-11T22:15:50.767746+0000","last_peered":"2024-09-11T22:15:50.767746+0000","last_clean":"2024-09-11T22:15:50.767746+0000","last_became_active":"2024-09-11T22:15:49.753724+0000","last_became_peered":"2024-09-11T22:15:49.753724+0000","last_unstale":"2024-09-11T22:15:50.767746+0000","last_undegraded":"2024-09-11T22:15:50.767746+0000","last_fullsized":"2024-09-11T22:15:50.767746+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:34.965646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:55.866276+0000","last_change":"2024-09-11T22:15:48.756655+0000","last_active":"2024-09-11T22:15:55.866276+0000","last_peered":"2024-09-11T22:15:55.866276+0000","last_clean":"2024-09-11T22:15:55.866276+0000","last_became_active":"2024-09-11T22:15:48.756399+0000","last_became_peered":"2024-09-11T22:15:48.756399+0000","last_unstale":"2024-09-11T22:15:55.866276+0000","last_undegraded":"2024-09-11T22:15:55.866276+0000","last_fullsized":"2024-09-11T22:15:55.866276+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:51.759680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:55.866641+0000","last_change":"2024-09-11T22:15:49.764525+0000","last_active":"2024-09-11T22:15:55.866641+0000","last_peered":"2024-09-11T22:15:55.866641+0000","last_clean":"2024-09-11T22:15:55.866641+0000","last_became_active":"2024-09-11T22:15:49.764235+0000","last_became_peered":"2024-09-11T22:15:49.764235+0000","last_unstale":"2024-09-11T22:15:55.866641+0000","last_undegraded":"2024-09-11T22:15:55.866641+0000","last_fullsized":"2024-09-11T22:15:55.866641+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:08.793988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:55.866000+0000","last_change":"2024-09-11T22:15:48.753604+0000","last_active":"2024-09-11T22:15:55.866000+0000","last_peered":"2024-09-11T22:15:55.866000+0000","last_clean":"2024-09-11T22:15:55.866000+0000","last_became_active":"2024-09-11T22:15:48.753332+0000","last_became_peered":"2024-09-11T22:15:48.753332+0000","last_unstale":"2024-09-11T22:15:55.866000+0000","last_undegraded":"2024-09-11T22:15:55.866000+0000","last_fullsized":"2024-09-11T22:15:55.866000+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:53.705437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.767926+0000","last_change":"2024-09-11T22:15:49.759782+0000","last_active":"2024-09-11T22:15:50.767926+0000","last_peered":"2024-09-11T22:15:50.767926+0000","last_clean":"2024-09-11T22:15:50.767926+0000","last_became_active":"2024-09-11T22:15:49.759449+0000","last_became_peered":"2024-09-11T22:15:49.759449+0000","last_unstale":"2024-09-11T22:15:50.767926+0000","last_undegraded":"2024-09-11T22:15:50.767926+0000","last_fullsized":"2024-09-11T22:15:50.767926+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:39.538849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.106922+0000","last_change":"2024-09-11T22:15:48.757138+0000","last_active":"2024-09-11T22:15:52.106922+0000","last_peered":"2024-09-11T22:15:52.106922+0000","last_clean":"2024-09-11T22:15:52.106922+0000","last_became_active":"2024-09-11T22:15:48.756810+0000","last_became_peered":"2024-09-11T22:15:48.756810+0000","last_unstale":"2024-09-11T22:15:52.106922+0000","last_undegraded":"2024-09-11T22:15:52.106922+0000","last_fullsized":"2024-09-11T22:15:52.106922+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:31.507529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.767746+0000","last_change":"2024-09-11T22:15:49.751503+0000","last_active":"2024-09-11T22:15:50.767746+0000","last_peered":"2024-09-11T22:15:50.767746+0000","last_clean":"2024-09-11T22:15:50.767746+0000","last_became_active":"2024-09-11T22:15:49.751170+0000","last_became_peered":"2024-09-11T22:15:49.751170+0000","last_unstale":"2024-09-11T22:15:50.767746+0000","last_undegraded":"2024-09-11T22:15:50.767746+0000","last_fullsized":"2024-09-11T22:15:50.767746+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:29.860267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"88'2","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.262402+0000","last_change":"2024-09-11T22:15:48.752014+0000","last_active":"2024-09-11T22:15:51.262402+0000","last_peered":"2024-09-11T22:15:51.262402+0000","last_clean":"2024-09-11T22:15:51.262402+0000","last_became_active":"2024-09-11T22:15:48.751698+0000","last_became_peered":"2024-09-11T22:15:48.751698+0000","last_unstale":"2024-09-11T22:15:51.262402+0000","last_undegraded":"2024-09-11T22:15:51.262402+0000","last_fullsized":"2024-09-11T22:15:51.262402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:58.163220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:56.253862+0000","last_change":"2024-09-11T22:15:49.762646+0000","last_active":"2024-09-11T22:15:56.253862+0000","last_peered":"2024-09-11T22:15:56.253862+0000","last_clean":"2024-09-11T22:15:56.253862+0000","last_became_active":"2024-09-11T22:15:49.762387+0000","last_became_peered":"2024-09-11T22:15:49.762387+0000","last_unstale":"2024-09-11T22:15:56.253862+0000","last_undegraded":"2024-09-11T22:15:56.253862+0000","last_fullsized":"2024-09-11T22:15:56.253862+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:31.527822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.262457+0000","last_change":"2024-09-11T22:15:48.761323+0000","last_active":"2024-09-11T22:15:51.262457+0000","last_peered":"2024-09-11T22:15:51.262457+0000","last_clean":"2024-09-11T22:15:51.262457+0000","last_became_active":"2024-09-11T22:15:48.761013+0000","last_became_peered":"2024-09-11T22:15:48.761013+0000","last_unstale":"2024-09-11T22:15:51.262457+0000","last_undegraded":"2024-09-11T22:15:51.262457+0000","last_fullsized":"2024-09-11T22:15:51.262457+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:32.456027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.108164+0000","last_change":"2024-09-11T22:15:49.754208+0000","last_active":"2024-09-11T22:15:52.108164+0000","last_peered":"2024-09-11T22:15:52.108164+0000","last_clean":"2024-09-11T22:15:52.108164+0000","last_became_active":"2024-09-11T22:15:49.753730+0000","last_became_peered":"2024-09-11T22:15:49.753730+0000","last_unstale":"2024-09-11T22:15:52.108164+0000","last_undegraded":"2024-09-11T22:15:52.108164+0000","last_fullsized":"2024-09-11T22:15:52.108164+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:43.495378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.107842+0000","last_change":"2024-09-11T22:15:48.758059+0000","last_active":"2024-09-11T22:15:52.107842+0000","last_peered":"2024-09-11T22:15:52.107842+0000","last_clean":"2024-09-11T22:15:52.107842+0000","last_became_active":"2024-09-11T22:15:48.757769+0000","last_became_peered":"2024-09-11T22:15:48.757769+0000","last_unstale":"2024-09-11T22:15:52.107842+0000","last_undegraded":"2024-09-11T22:15:52.107842+0000","last_fullsized":"2024-09-11T22:15:52.107842+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:27.536163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.768346+0000","last_change":"2024-09-11T22:15:49.759195+0000","last_active":"2024-09-11T22:15:50.768346+0000","last_peered":"2024-09-11T22:15:50.768346+0000","last_clean":"2024-09-11T22:15:50.768346+0000","last_became_active":"2024-09-11T22:15:49.758924+0000","last_became_peered":"2024-09-11T22:15:49.758924+0000","last_unstale":"2024-09-11T22:15:50.768346+0000","last_undegraded":"2024-09-11T22:15:50.768346+0000","last_fullsized":"2024-09-11T22:15:50.768346+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:44.626466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.108192+0000","last_change":"2024-09-11T22:15:48.756280+0000","last_active":"2024-09-11T22:15:52.108192+0000","last_peered":"2024-09-11T22:15:52.108192+0000","last_clean":"2024-09-11T22:15:52.108192+0000","last_became_active":"2024-09-11T22:15:48.755689+0000","last_became_peered":"2024-09-11T22:15:48.755689+0000","last_unstale":"2024-09-11T22:15:52.108192+0000","last_undegraded":"2024-09-11T22:15:52.108192+0000","last_fullsized":"2024-09-11T22:15:52.108192+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:16.305337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.767618+0000","last_change":"2024-09-11T22:15:49.753332+0000","last_active":"2024-09-11T22:15:50.767618+0000","last_peered":"2024-09-11T22:15:50.767618+0000","last_clean":"2024-09-11T22:15:50.767618+0000","last_became_active":"2024-09-11T22:15:49.753076+0000","last_became_peered":"2024-09-11T22:15:49.753076+0000","last_unstale":"2024-09-11T22:15:50.767618+0000","last_undegraded":"2024-09-11T22:15:50.767618+0000","last_fullsized":"2024-09-11T22:15:50.767618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:07.688243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.761432+0000","last_change":"2024-09-11T22:15:48.754680+0000","last_active":"2024-09-11T22:15:50.761432+0000","last_peered":"2024-09-11T22:15:50.761432+0000","last_clean":"2024-09-11T22:15:50.761432+0000","last_became_active":"2024-09-11T22:15:48.754396+0000","last_became_peered":"2024-09-11T22:15:48.754396+0000","last_unstale":"2024-09-11T22:15:50.761432+0000","last_undegraded":"2024-09-11T22:15:50.761432+0000","last_fullsized":"2024-09-11T22:15:50.761432+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:56.030385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.761423+0000","last_change":"2024-09-11T22:15:49.757170+0000","last_active":"2024-09-11T22:15:50.761423+0000","last_peered":"2024-09-11T22:15:50.761423+0000","last_clean":"2024-09-11T22:15:50.761423+0000","last_became_active":"2024-09-11T22:15:49.756853+0000","last_became_peered":"2024-09-11T22:15:49.756853+0000","last_unstale":"2024-09-11T22:15:50.761423+0000","last_undegraded":"2024-09-11T22:15:50.761423+0000","last_fullsized":"2024-09-11T22:15:50.761423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:12.818772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.767395+0000","last_change":"2024-09-11T22:15:48.755977+0000","last_active":"2024-09-11T22:15:50.767395+0000","last_peered":"2024-09-11T22:15:50.767395+0000","last_clean":"2024-09-11T22:15:50.767395+0000","last_became_active":"2024-09-11T22:15:48.755357+0000","last_became_peered":"2024-09-11T22:15:48.755357+0000","last_unstale":"2024-09-11T22:15:50.767395+0000","last_undegraded":"2024-09-11T22:15:50.767395+0000","last_fullsized":"2024-09-11T22:15:50.767395+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:57:29.306669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:56.253531+0000","last_change":"2024-09-11T22:15:49.774136+0000","last_active":"2024-09-11T22:15:56.253531+0000","last_peered":"2024-09-11T22:15:56.253531+0000","last_clean":"2024-09-11T22:15:56.253531+0000","last_became_active":"2024-09-11T22:15:49.773836+0000","last_became_peered":"2024-09-11T22:15:49.773836+0000","last_unstale":"2024-09-11T22:15:56.253531+0000","last_undegraded":"2024-09-11T22:15:56.253531+0000","last_fullsized":"2024-09-11T22:15:56.253531+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:49.679238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.107954+0000","last_change":"2024-09-11T22:15:48.755949+0000","last_active":"2024-09-11T22:15:52.107954+0000","last_peered":"2024-09-11T22:15:52.107954+0000","last_clean":"2024-09-11T22:15:52.107954+0000","last_became_active":"2024-09-11T22:15:48.755704+0000","last_became_peered":"2024-09-11T22:15:48.755704+0000","last_unstale":"2024-09-11T22:15:52.107954+0000","last_undegraded":"2024-09-11T22:15:52.107954+0000","last_fullsized":"2024-09-11T22:15:52.107954+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:18.330200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:52.108092+0000","last_change":"2024-09-11T22:15:49.755859+0000","last_active":"2024-09-11T22:15:52.108092+0000","last_peered":"2024-09-11T22:15:52.108092+0000","last_clean":"2024-09-11T22:15:52.108092+0000","last_became_active":"2024-09-11T22:15:49.755397+0000","last_became_peered":"2024-09-11T22:15:49.755397+0000","last_unstale":"2024-09-11T22:15:52.108092+0000","last_undegraded":"2024-09-11T22:15:52.108092+0000","last_fullsized":"2024-09-11T22:15:52.108092+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:12.818772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:50.767030+0000","last_change":"2024-09-11T22:15:48.756565+0000","last_active":"2024-09-11T22:15:50.767030+0000","last_peered":"2024-09-11T22:15:50.767030+0000","last_clean":"2024-09-11T22:15:50.767030+0000","last_became_active":"2024-09-11T22:15:48.755417+0000","last_became_peered":"2024-09-11T22:15:48.755417+0000","last_unstale":"2024-09-11T22:15:50.767030+0000","last_undegraded":"2024-09-11T22:15:50.767030+0000","last_fullsized":"2024-09-11T22:15:50.767030+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:14.750107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T22:15:51.262109+0000","last_change":"2024-09-11T22:15:49.760298+0000","last_active":"2024-09-11T22:15:51.262109+0000","last_peered":"2024-09-11T22:15:51.262109+0000","last_clean":"2024-09-11T22:15:51.262109+0000","last_became_active":"2024-09-11T22:15:49.759445+0000","last_became_peered":"2024-09-11T22:15:49.759445+0000","last_unstale":"2024-09-11T22:15:51.262109+0000","last_undegraded":"2024-09-11T22:15:51.262109+0000","last_fullsized":"2024-09-11T22:15:51.262109+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:48.734082+0000","last_clean_scrub_stamp":"2024-09-11T22:15:48.734082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:15.755604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"88'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:56.253772+0000","last_change":"2024-09-11T22:15:48.754935+0000","last_active":"2024-09-11T22:15:56.253772+0000","last_peered":"2024-09-11T22:15:56.253772+0000","last_clean":"2024-09-11T22:15:56.253772+0000","last_became_active":"2024-09-11T22:15:48.754642+0000","last_became_peered":"2024-09-11T22:15:48.754642+0000","last_unstale":"2024-09-11T22:15:56.253772+0000","last_undegraded":"2024-09-11T22:15:56.253772+0000","last_fullsized":"2024-09-11T22:15:56.253772+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:15:47.728585+0000","last_clean_scrub_stamp":"2024-09-11T22:15:47.728585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:03.626348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":297,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-11T22:15:56.253613+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:15:56.253613+0000","last_peered":"2024-09-11T22:15:56.253613+0000","last_clean":"2024-09-11T22:15:56.253613+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:15:56.253613+0000","last_undegraded":"2024-09-11T22:15:56.253613+0000","last_fullsized":"2024-09-11T22:15:56.253613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36420,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335420,"statfs":{"total":96636764160,"available":96599470080,"internally_reserved":0,"allocated":1097728,"data_stored":469949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36424,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335416,"statfs":{"total":96636764160,"available":96599465984,"internally_reserved":0,"allocated":1101824,"data_stored":470889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509502,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36408,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335432,"statfs":{"total":96636764160,"available":96599482368,"internally_reserved":0,"allocated":1085440,"data_stored":469255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509502,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1097728,"data_stored":470867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509502,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28100,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343740,"statfs":{"total":96636764160,"available":96607989760,"internally_reserved":0,"allocated":1097728,"data_stored":469449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509501,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41156,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330684,"statfs":{"total":96636764160,"available":96594620416,"internally_reserved":0,"allocated":1683456,"data_stored":1059657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41164,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330676,"statfs":{"total":96636764160,"available":96594612224,"internally_reserved":0,"allocated":1695744,"data_stored":1065660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1101824,"data_stored":475804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:15:57.479 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:15:57.480 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T22:15:57.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.625+0000 7f9559b78640 1 Processor -- start 2024-09-11T22:15:57.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.625+0000 7f9559b78640 1 -- start start 2024-09-11T22:15:57.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.626+0000 7f9559b78640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f955415e870 0x7f95540d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.626+0000 7f9559b78640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f95540d16d0 0x7f95540d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.626+0000 7f9559b78640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95540cfa80 con 0x7f95540d3a30 2024-09-11T22:15:57.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.626+0000 7f9559b78640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f95540d1b40 con 0x7f955415e870 2024-09-11T22:15:57.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.626+0000 7f9559b78640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f95540d3e50 con 0x7f95540d16d0 2024-09-11T22:15:57.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.626+0000 7f95537fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f955415e870 0x7f95540d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:57.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.626+0000 7f9553fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f95540d3a30 0x7f95540b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40684/0 (socket says 172.21.15.50:40684) 2024-09-11T22:15:57.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.626+0000 7f9553fff640 1 -- 172.21.15.50:0/1966286264 learned_addr learned my addr 172.21.15.50:0/1966286264 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:57.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.626+0000 7f95537fe640 1 -- 172.21.15.50:0/1966286264 >> v2:172.21.15.77:3300/0 conn(0x7f95540d16d0 msgr2=0x7f95540d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:57.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.626+0000 7f95537fe640 1 --2- 172.21.15.50:0/1966286264 >> v2:172.21.15.77:3300/0 conn(0x7f95540d16d0 0x7f95540d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.626+0000 7f95537fe640 1 -- 172.21.15.50:0/1966286264 >> v1:172.21.15.50:6789/0 conn(0x7f95540d3a30 legacy=0x7f95540b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:57.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.626+0000 7f95537fe640 1 -- 172.21.15.50:0/1966286264 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95540d40d0 con 0x7f955415e870 2024-09-11T22:15:57.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.626+0000 7f9552ffd640 1 -- 172.21.15.50:0/1966286264 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128847590 0 0) 0x7f954c001490 con 0x7f95540d3a30 2024-09-11T22:15:57.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.627+0000 7f95537fe640 1 --2- 172.21.15.50:0/1966286264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f955415e870 0x7f95540d1190 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f955406c830 tx=0x7f954402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213a6d6c00e28a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:57.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.627+0000 7f9552ffd640 1 -- 172.21.15.50:0/1966286264 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544037070 con 0x7f955415e870 2024-09-11T22:15:57.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.627+0000 7f9552ffd640 1 -- 172.21.15.50:0/1966286264 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9544032440 con 0x7f955415e870 2024-09-11T22:15:57.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.627+0000 7f9552ffd640 1 -- 172.21.15.50:0/1966286264 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544032810 con 0x7f955415e870 2024-09-11T22:15:57.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.628+0000 7f9559b78640 1 -- 172.21.15.50:0/1966286264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f955415e870 msgr2=0x7f95540d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:57.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.628+0000 7f9559b78640 1 --2- 172.21.15.50:0/1966286264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f955415e870 0x7f95540d1190 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f955406c830 tx=0x7f954402a1a0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.628+0000 7f9559b78640 1 -- 172.21.15.50:0/1966286264 shutdown_connections 2024-09-11T22:15:57.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.628+0000 7f9559b78640 1 --2- 172.21.15.50:0/1966286264 >> v2:172.21.15.77:3300/0 conn(0x7f95540d16d0 0x7f95540d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.628+0000 7f9559b78640 1 --2- 172.21.15.50:0/1966286264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f955415e870 0x7f95540d1190 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.628+0000 7f9559b78640 1 -- 172.21.15.50:0/1966286264 >> 172.21.15.50:0/1966286264 conn(0x7f95540727a0 msgr2=0x7f95540679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:57.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.628+0000 7f9559b78640 1 -- 172.21.15.50:0/1966286264 shutdown_connections 2024-09-11T22:15:57.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.628+0000 7f9559b78640 1 -- 172.21.15.50:0/1966286264 wait complete. 2024-09-11T22:15:57.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.629+0000 7f9559b78640 1 Processor -- start 2024-09-11T22:15:57.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.629+0000 7f9559b78640 1 -- start start 2024-09-11T22:15:57.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.630+0000 7f9559b78640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95540d16d0 0x7f9554158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.630+0000 7f9559b78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95540d3a30 0x7f95540cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.630+0000 7f9559b78640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f955415e870 0x7f95540ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.630+0000 7f9559b78640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f95540b7ee0 con 0x7f95540d3a30 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.630+0000 7f9559b78640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f95540b7c00 con 0x7f95540d16d0 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.630+0000 7f9559b78640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f955415ec50 con 0x7f955415e870 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.630+0000 7f954affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95540d3a30 0x7f95540cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.630+0000 7f954affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95540d3a30 0x7f95540cd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36754/0 (socket says 172.21.15.50:36754) 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.630+0000 7f954affd640 1 -- 172.21.15.50:0/2651011731 learned_addr learned my addr 172.21.15.50:0/2651011731 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.630+0000 7f95537fe640 1 --2- 172.21.15.50:0/2651011731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95540d16d0 0x7f9554158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.630+0000 7f954affd640 1 -- 172.21.15.50:0/2651011731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f955415e870 msgr2=0x7f95540ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.630+0000 7f954affd640 1 --2- 172.21.15.50:0/2651011731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f955415e870 0x7f95540ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.630+0000 7f954affd640 1 -- 172.21.15.50:0/2651011731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95540d16d0 msgr2=0x7f9554158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.631+0000 7f954affd640 1 --2- 172.21.15.50:0/2651011731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95540d16d0 0x7f9554158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.631+0000 7f954affd640 1 -- 172.21.15.50:0/2651011731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95541585b0 con 0x7f95540d3a30 2024-09-11T22:15:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.631+0000 7f954affd640 1 --2- 172.21.15.50:0/2651011731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95540d3a30 0x7f95540cd820 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f953c00b4a0 tx=0x7f953c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.631+0000 7f9550ff9640 1 -- 172.21.15.50:0/2651011731 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c014070 con 0x7f95540d3a30 2024-09-11T22:15:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.631+0000 7f9550ff9640 1 -- 172.21.15.50:0/2651011731 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953c010610 con 0x7f95540d3a30 2024-09-11T22:15:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.631+0000 7f9559b78640 1 -- 172.21.15.50:0/2651011731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95540c91b0 con 0x7f95540d3a30 2024-09-11T22:15:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.631+0000 7f9550ff9640 1 -- 172.21.15.50:0/2651011731 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c010a00 con 0x7f95540d3a30 2024-09-11T22:15:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.631+0000 7f9559b78640 1 -- 172.21.15.50:0/2651011731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95540c9770 con 0x7f95540d3a30 2024-09-11T22:15:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.632+0000 7f9559b78640 1 -- 172.21.15.50:0/2651011731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95540b78b0 con 0x7f95540d3a30 2024-09-11T22:15:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.632+0000 7f9550ff9640 1 -- 172.21.15.50:0/2651011731 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f953c017070 con 0x7f95540d3a30 2024-09-11T22:15:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.633+0000 7f9550ff9640 1 --2- 172.21.15.50:0/2651011731 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f953406be30 0x7f953406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.633+0000 7f9550ff9640 1 -- 172.21.15.50:0/2651011731 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7f953c08a880 con 0x7f95540d3a30 2024-09-11T22:15:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.633+0000 7f95537fe640 1 --2- 172.21.15.50:0/2651011731 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f953406be30 0x7f953406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.634+0000 7f95537fe640 1 --2- 172.21.15.50:0/2651011731 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f953406be30 0x7f953406e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9544034000 tx=0x7f954402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.637+0000 7f9550ff9640 1 -- 172.21.15.50:0/2651011731 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f953c0592a0 con 0x7f95540d3a30 2024-09-11T22:15:57.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.883+0000 7f9559b78640 1 -- 172.21.15.50:0/2651011731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f955415cde0 con 0x7f95540d3a30 2024-09-11T22:15:57.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.885+0000 7f9550ff9640 1 -- 172.21.15.50:0/2651011731 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f953c08a070 con 0x7f95540d3a30 2024-09-11T22:15:57.886 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:15:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:15:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-09-11T22:15:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-09-11T22:15:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T22:15:57.886 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-11T22:15:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.887+0000 7f9559b78640 1 -- 172.21.15.50:0/2651011731 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f953406be30 msgr2=0x7f953406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.887+0000 7f9559b78640 1 --2- 172.21.15.50:0/2651011731 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f953406be30 0x7f953406e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9544034000 tx=0x7f954402e000 comp rx=0 tx=0).stop 2024-09-11T22:15:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.887+0000 7f9559b78640 1 -- 172.21.15.50:0/2651011731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95540d3a30 msgr2=0x7f95540cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.887+0000 7f9559b78640 1 --2- 172.21.15.50:0/2651011731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95540d3a30 0x7f95540cd820 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f953c00b4a0 tx=0x7f953c00b960 comp rx=0 tx=0).stop 2024-09-11T22:15:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.887+0000 7f9559b78640 1 -- 172.21.15.50:0/2651011731 shutdown_connections 2024-09-11T22:15:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.887+0000 7f9559b78640 1 --2- 172.21.15.50:0/2651011731 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f953406be30 0x7f953406e2f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.887+0000 7f9559b78640 1 --2- 172.21.15.50:0/2651011731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f955415e870 0x7f95540ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.887+0000 7f9559b78640 1 --2- 172.21.15.50:0/2651011731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95540d3a30 0x7f95540cd820 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.887+0000 7f9559b78640 1 --2- 172.21.15.50:0/2651011731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95540d16d0 0x7f9554158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.887+0000 7f9559b78640 1 -- 172.21.15.50:0/2651011731 >> 172.21.15.50:0/2651011731 conn(0x7f95540727a0 msgr2=0x7f95540679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.887+0000 7f9559b78640 1 -- 172.21.15.50:0/2651011731 shutdown_connections 2024-09-11T22:15:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:57.888+0000 7f9559b78640 1 -- 172.21.15.50:0/2651011731 wait complete. 2024-09-11T22:15:57.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:15:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.000+0000 7f8ff4c9b640 1 Processor -- start 2024-09-11T22:15:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.000+0000 7f8ff4c9b640 1 -- start start 2024-09-11T22:15:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8ff4c9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ff015f350 0x7f8ff015fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8ff4c9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ff00679c0 0x7f8ff0067e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8ff4c9b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff015f7f0 con 0x7f8ff015c3c0 2024-09-11T22:15:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8ff4c9b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff006e700 con 0x7f8ff015f350 2024-09-11T22:15:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8ff4c9b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff015fad0 con 0x7f8ff00679c0 2024-09-11T22:15:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8fedd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ff015f350 0x7f8ff015fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8fee59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8ff015c3c0 0x7f8ff015ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40694/0 (socket says 172.21.15.50:40694) 2024-09-11T22:15:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8fee59c640 1 -- 172.21.15.50:0/4111265252 learned_addr learned my addr 172.21.15.50:0/4111265252 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:15:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8feed9d640 1 --2- 172.21.15.50:0/4111265252 >> v2:172.21.15.77:3300/0 conn(0x7f8ff00679c0 0x7f8ff0067e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8fedd9b640 1 -- 172.21.15.50:0/4111265252 >> v2:172.21.15.77:3300/0 conn(0x7f8ff00679c0 msgr2=0x7f8ff0067e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8fedd9b640 1 --2- 172.21.15.50:0/4111265252 >> v2:172.21.15.77:3300/0 conn(0x7f8ff00679c0 0x7f8ff0067e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8fedd9b640 1 -- 172.21.15.50:0/4111265252 >> v1:172.21.15.50:6789/0 conn(0x7f8ff015c3c0 legacy=0x7f8ff015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8fed59a640 1 -- 172.21.15.50:0/4111265252 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1428245595 0 0) 0x7f8ff015f7f0 con 0x7f8ff015c3c0 2024-09-11T22:15:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.001+0000 7f8fedd9b640 1 -- 172.21.15.50:0/4111265252 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff006e950 con 0x7f8ff015f350 2024-09-11T22:15:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.002+0000 7f8fedd9b640 1 --2- 172.21.15.50:0/4111265252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff015f350 0x7f8ff015fe60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00cfbd0 tx=0x7f8fd802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc211589cf98a60e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.002+0000 7f8fed59a640 1 -- 172.21.15.50:0/4111265252 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8037070 con 0x7f8ff015f350 2024-09-11T22:15:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.002+0000 7f8fed59a640 1 -- 172.21.15.50:0/4111265252 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd8032440 con 0x7f8ff015f350 2024-09-11T22:15:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.002+0000 7f8fed59a640 1 -- 172.21.15.50:0/4111265252 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd802ae60 con 0x7f8ff015f350 2024-09-11T22:15:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.003+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/4111265252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff015f350 msgr2=0x7f8ff015fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.003+0000 7f8ff4c9b640 1 --2- 172.21.15.50:0/4111265252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff015f350 0x7f8ff015fe60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00cfbd0 tx=0x7f8fd802a110 comp rx=0 tx=0).stop 2024-09-11T22:15:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.003+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/4111265252 shutdown_connections 2024-09-11T22:15:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.003+0000 7f8ff4c9b640 1 --2- 172.21.15.50:0/4111265252 >> v2:172.21.15.77:3300/0 conn(0x7f8ff00679c0 0x7f8ff0067e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.003+0000 7f8ff4c9b640 1 --2- 172.21.15.50:0/4111265252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff015f350 0x7f8ff015fe60 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.003+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/4111265252 >> 172.21.15.50:0/4111265252 conn(0x7f8ff0075060 msgr2=0x7f8ff006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.003+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/4111265252 shutdown_connections 2024-09-11T22:15:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.003+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/4111265252 wait complete. 2024-09-11T22:15:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.004+0000 7f8ff4c9b640 1 Processor -- start 2024-09-11T22:15:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.004+0000 7f8ff4c9b640 1 -- start start 2024-09-11T22:15:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8ff4c9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ff00679c0 0x7f8ff0157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8ff4c9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff015c3c0 0x7f8ff00cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8ff4c9b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ff015f350 0x7f8ff00cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8ff4c9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff006f150 con 0x7f8ff015c3c0 2024-09-11T22:15:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8ff4c9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff00d0940 con 0x7f8ff00679c0 2024-09-11T22:15:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8ff4c9b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff006f2d0 con 0x7f8ff015f350 2024-09-11T22:15:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8fedd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff015c3c0 0x7f8ff00cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8fedd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff015c3c0 0x7f8ff00cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36764/0 (socket says 172.21.15.50:36764) 2024-09-11T22:15:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8fedd9b640 1 -- 172.21.15.50:0/70060884 learned_addr learned my addr 172.21.15.50:0/70060884 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8fee59c640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ff00679c0 0x7f8ff0157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8feed9d640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ff015f350 0x7f8ff00cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8fedd9b640 1 -- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ff015f350 msgr2=0x7f8ff00cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8fedd9b640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ff015f350 0x7f8ff00cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8fedd9b640 1 -- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ff00679c0 msgr2=0x7f8ff0157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8fedd9b640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ff00679c0 0x7f8ff0157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8fedd9b640 1 -- 172.21.15.50:0/70060884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff01e7c60 con 0x7f8ff015c3c0 2024-09-11T22:15:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.005+0000 7f8feed9d640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ff015f350 0x7f8ff00cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.006+0000 7f8fedd9b640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff015c3c0 0x7f8ff00cb230 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8000c00 tx=0x7f8fd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.006+0000 7f8fe6ffd640 1 -- 172.21.15.50:0/70060884 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8037040 con 0x7f8ff015c3c0 2024-09-11T22:15:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.006+0000 7f8fe6ffd640 1 -- 172.21.15.50:0/70060884 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd8042070 con 0x7f8ff015c3c0 2024-09-11T22:15:58.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.006+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/70060884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff01e7f40 con 0x7f8ff015c3c0 2024-09-11T22:15:58.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.006+0000 7f8fe6ffd640 1 -- 172.21.15.50:0/70060884 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8030bd0 con 0x7f8ff015c3c0 2024-09-11T22:15:58.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.006+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/70060884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff01e8500 con 0x7f8ff015c3c0 2024-09-11T22:15:58.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.007+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/70060884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff006cae0 con 0x7f8ff015c3c0 2024-09-11T22:15:58.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.008+0000 7f8fe6ffd640 1 -- 172.21.15.50:0/70060884 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8fd8047460 con 0x7f8ff015c3c0 2024-09-11T22:15:58.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.008+0000 7f8fe6ffd640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8fd006be30 0x7f8fd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.008+0000 7f8fe6ffd640 1 -- 172.21.15.50:0/70060884 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7f8fd80aba50 con 0x7f8ff015c3c0 2024-09-11T22:15:58.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.008+0000 7f8fee59c640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8fd006be30 0x7f8fd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.009+0000 7f8fee59c640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8fd006be30 0x7f8fd006e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8000f60 tx=0x7f8fe8007b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:58.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.012+0000 7f8fe6ffd640 1 -- 172.21.15.50:0/70060884 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8fd8032e20 con 0x7f8ff015c3c0 2024-09-11T22:15:58.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.224+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/70060884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ff00cef40 con 0x7f8ff015c3c0 2024-09-11T22:15:58.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.225+0000 7f8fe6ffd640 1 -- 172.21.15.50:0/70060884 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5225 (secure 0 0 0) 0x7f8fd807a3e0 con 0x7f8ff015c3c0 2024-09-11T22:15:58.226 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:15:58.226 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":63,"btime":"2024-09-11T22:15:51:760001+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2316208539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2316208539},{"type":"v1","addr":"172.21.15.77:6837","nonce":2316208539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7101,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2875804357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2875804357},{"type":"v1","addr":"172.21.15.50:6834","nonce":2875804357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7104,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2615352620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2615352620},{"type":"v1","addr":"172.21.15.50:6835","nonce":2615352620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:15:51.106407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7110},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7110":{"gid":7110,"name":"b","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/1549905387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1549905387},{"type":"v1","addr":"172.21.15.77:6836","nonce":1549905387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7110,"qdb_cluster":[7110]},"id":6}]} 2024-09-11T22:15:58.226 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 63 2024-09-11T22:15:58.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.227+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8fd006be30 msgr2=0x7f8fd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.227+0000 7f8ff4c9b640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8fd006be30 0x7f8fd006e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8000f60 tx=0x7f8fe8007b70 comp rx=0 tx=0).stop 2024-09-11T22:15:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.227+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/70060884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff015c3c0 msgr2=0x7f8ff00cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.227+0000 7f8ff4c9b640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff015c3c0 0x7f8ff00cb230 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8000c00 tx=0x7f8fd80046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.227+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/70060884 shutdown_connections 2024-09-11T22:15:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.227+0000 7f8ff4c9b640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8fd006be30 0x7f8fd006e2f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.227+0000 7f8ff4c9b640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ff015f350 0x7f8ff00cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.227+0000 7f8ff4c9b640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff015c3c0 0x7f8ff00cb230 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.227+0000 7f8ff4c9b640 1 --2- 172.21.15.50:0/70060884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ff00679c0 0x7f8ff0157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.227+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/70060884 >> 172.21.15.50:0/70060884 conn(0x7f8ff0075060 msgr2=0x7f8ff006f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.227+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/70060884 shutdown_connections 2024-09-11T22:15:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.227+0000 7f8ff4c9b640 1 -- 172.21.15.50:0/70060884 wait complete. 2024-09-11T22:15:58.641 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:15:49.108873+0000', 'modified': '2024-09-11T22:15:51.106407+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7110}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7110': {'gid': 7110, 'name': 'b', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6836/1549905387', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6834', 'nonce': 1549905387}, {'type': 'v1', 'addr': '172.21.15.77:6836', 'nonce': 1549905387}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7110, 'qdb_cluster': [7110]} 2024-09-11T22:15:58.642 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:15:58.642 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T22:15:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.750+0000 7f6e166af640 1 Processor -- start 2024-09-11T22:15:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.750+0000 7f6e166af640 1 -- start start 2024-09-11T22:15:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.751+0000 7f6e166af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e1015fd80 0x7f6e100b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.751+0000 7f6e166af640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e100af4c0 0x7f6e100b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.751+0000 7f6e166af640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e100af940 con 0x7f6e100b2970 2024-09-11T22:15:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.751+0000 7f6e166af640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6e100afc20 con 0x7f6e100af4c0 2024-09-11T22:15:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.751+0000 7f6e166af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6e100aff00 con 0x7f6e1015fd80 2024-09-11T22:15:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.751+0000 7f6e0f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e100af4c0 0x7f6e100b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.751+0000 7f6e0f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e100af4c0 0x7f6e100b2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36772/0 (socket says 172.21.15.50:36772) 2024-09-11T22:15:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.751+0000 7f6e0f7fe640 1 -- 172.21.15.50:0/56044085 learned_addr learned my addr 172.21.15.50:0/56044085 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.751+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/56044085 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e1015fd80 0x7f6e100b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.751+0000 7f6e0f7fe640 1 -- 172.21.15.50:0/56044085 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e1015fd80 msgr2=0x7f6e100b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:58.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.751+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/56044085 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e1015fd80 0x7f6e100b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.752+0000 7f6e0f7fe640 1 -- 172.21.15.50:0/56044085 >> v1:172.21.15.77:6789/0 conn(0x7f6e100b2970 legacy=0x7f6e100d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:58.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.752+0000 7f6e0f7fe640 1 -- 172.21.15.50:0/56044085 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e100b01e0 con 0x7f6e100af4c0 2024-09-11T22:15:58.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.752+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/56044085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e100af4c0 0x7f6e100b2430 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009870 tx=0x7f6e0402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8247b56c5aba42a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:58.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.752+0000 7f6e0effd640 1 -- 172.21.15.50:0/56044085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04037070 con 0x7f6e100af4c0 2024-09-11T22:15:58.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.752+0000 7f6e0effd640 1 -- 172.21.15.50:0/56044085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e04032440 con 0x7f6e100af4c0 2024-09-11T22:15:58.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.753+0000 7f6e0effd640 1 -- 172.21.15.50:0/56044085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04032810 con 0x7f6e100af4c0 2024-09-11T22:15:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.753+0000 7f6e166af640 1 -- 172.21.15.50:0/56044085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e100af4c0 msgr2=0x7f6e100b2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.753+0000 7f6e166af640 1 --2- 172.21.15.50:0/56044085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e100af4c0 0x7f6e100b2430 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009870 tx=0x7f6e0402a1c0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.753+0000 7f6e166af640 1 -- 172.21.15.50:0/56044085 shutdown_connections 2024-09-11T22:15:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.753+0000 7f6e166af640 1 --2- 172.21.15.50:0/56044085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e100af4c0 0x7f6e100b2430 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.753+0000 7f6e166af640 1 --2- 172.21.15.50:0/56044085 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e1015fd80 0x7f6e100b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.753+0000 7f6e166af640 1 -- 172.21.15.50:0/56044085 >> 172.21.15.50:0/56044085 conn(0x7f6e1009ba50 msgr2=0x7f6e100b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.753+0000 7f6e166af640 1 -- 172.21.15.50:0/56044085 shutdown_connections 2024-09-11T22:15:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.753+0000 7f6e166af640 1 -- 172.21.15.50:0/56044085 wait complete. 2024-09-11T22:15:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.754+0000 7f6e166af640 1 Processor -- start 2024-09-11T22:15:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.755+0000 7f6e166af640 1 -- start start 2024-09-11T22:15:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.755+0000 7f6e166af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e100af4c0 0x7f6e1009fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.755+0000 7f6e166af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e100b2970 0x7f6e101f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.755+0000 7f6e166af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e1015fd80 0x7f6e100ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.755+0000 7f6e166af640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e10160160 con 0x7f6e100b2970 2024-09-11T22:15:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.755+0000 7f6e166af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6e100b3ee0 con 0x7f6e1015fd80 2024-09-11T22:15:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.755+0000 7f6e166af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6e101602e0 con 0x7f6e100af4c0 2024-09-11T22:15:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.755+0000 7f6e0f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e100b2970 0x7f6e101f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.755+0000 7f6e0f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e100b2970 0x7f6e101f81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36782/0 (socket says 172.21.15.50:36782) 2024-09-11T22:15:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.755+0000 7f6e0f7fe640 1 -- 172.21.15.50:0/317710567 learned_addr learned my addr 172.21.15.50:0/317710567 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.755+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e100af4c0 0x7f6e1009fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.755+0000 7f6e14c4c640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e1015fd80 0x7f6e100ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.756+0000 7f6e0f7fe640 1 -- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e100af4c0 msgr2=0x7f6e1009fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.756+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e100af4c0 0x7f6e1009fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.756+0000 7f6e0f7fe640 1 -- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e1015fd80 msgr2=0x7f6e100ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.756+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e1015fd80 0x7f6e100ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.756+0000 7f6e0f7fe640 1 -- 172.21.15.50:0/317710567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e101f4640 con 0x7f6e100b2970 2024-09-11T22:15:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.756+0000 7f6e14c4c640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e1015fd80 0x7f6e100ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.756+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e100b2970 0x7f6e101f81e0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009870 tx=0x7f6e040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.756+0000 7f6e0cff9640 1 -- 172.21.15.50:0/317710567 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04041070 con 0x7f6e100b2970 2024-09-11T22:15:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.756+0000 7f6e0cff9640 1 -- 172.21.15.50:0/317710567 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0403c870 con 0x7f6e100b2970 2024-09-11T22:15:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.756+0000 7f6e0cff9640 1 -- 172.21.15.50:0/317710567 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04037040 con 0x7f6e100b2970 2024-09-11T22:15:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.756+0000 7f6e166af640 1 -- 172.21.15.50:0/317710567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e101f48b0 con 0x7f6e100b2970 2024-09-11T22:15:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.756+0000 7f6e166af640 1 -- 172.21.15.50:0/317710567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e101f4e70 con 0x7f6e100b2970 2024-09-11T22:15:58.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.758+0000 7f6e0cff9640 1 -- 172.21.15.50:0/317710567 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e04044070 con 0x7f6e100b2970 2024-09-11T22:15:58.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.758+0000 7f6e0cff9640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6dfc06be60 0x7f6dfc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.758+0000 7f6e0cff9640 1 -- 172.21.15.50:0/317710567 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7f6e040abad0 con 0x7f6e100b2970 2024-09-11T22:15:58.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.758+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6dfc06be60 0x7f6dfc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.759+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6dfc06be60 0x7f6dfc06e320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6e00006fd0 tx=0x7f6e00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.759+0000 7f6e1943d740 1 Processor -- start 2024-09-11T22:15:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.759+0000 7f6e1943d740 1 -- start start 2024-09-11T22:15:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e1943d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa807da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e1943d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa8035a80 0x564fa80386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e1943d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 0x564fa80328b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e1943d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564fa7f9a520 con 0x564fa80382c0 2024-09-11T22:15:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e1943d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564fa7f423e0 con 0x564fa8039a50 2024-09-11T22:15:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e1943d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564fa7f964e0 con 0x564fa8035a80 2024-09-11T22:15:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa807da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa807da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36788/0 (socket says 172.21.15.50:36788) 2024-09-11T22:15:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e0ffff640 1 -- 172.21.15.50:0/173838397 learned_addr learned my addr 172.21.15.50:0/173838397 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e14c4c640 1 --2- 172.21.15.50:0/173838397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 0x564fa80328b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/173838397 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa8035a80 0x564fa80386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e0ffff640 1 -- 172.21.15.50:0/173838397 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa8035a80 msgr2=0x564fa80386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/173838397 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa8035a80 0x564fa80386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e0ffff640 1 -- 172.21.15.50:0/173838397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 msgr2=0x564fa80328b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/173838397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 0x564fa80328b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e0ffff640 1 -- 172.21.15.50:0/173838397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fa7f5d2f0 con 0x564fa80382c0 2024-09-11T22:15:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/173838397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa807da60 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f6e00004250 tx=0x7f6e00013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57e2a334613f8de server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6df5ffb640 1 -- 172.21.15.50:0/173838397 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00027070 con 0x564fa80382c0 2024-09-11T22:15:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.760+0000 7f6df5ffb640 1 -- 172.21.15.50:0/173838397 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e000038e0 con 0x564fa80382c0 2024-09-11T22:15:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.761+0000 7f6df5ffb640 1 -- 172.21.15.50:0/173838397 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00003c90 con 0x564fa80382c0 2024-09-11T22:15:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.761+0000 7f6e1943d740 1 -- 172.21.15.50:0/173838397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 msgr2=0x564fa807da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.761+0000 7f6e1943d740 1 --2- 172.21.15.50:0/173838397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa807da60 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f6e00004250 tx=0x7f6e00013000 comp rx=0 tx=0).stop 2024-09-11T22:15:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.761+0000 7f6e1943d740 1 -- 172.21.15.50:0/173838397 shutdown_connections 2024-09-11T22:15:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.761+0000 7f6e1943d740 1 --2- 172.21.15.50:0/173838397 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa8035a80 0x564fa80386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.761+0000 7f6e1943d740 1 --2- 172.21.15.50:0/173838397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 0x564fa80328b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.761+0000 7f6e1943d740 1 --2- 172.21.15.50:0/173838397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa807da60 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.761+0000 7f6e1943d740 1 -- 172.21.15.50:0/173838397 >> 172.21.15.50:0/173838397 conn(0x564fa8034a80 msgr2=0x564fa807cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.761+0000 7f6e1943d740 1 -- 172.21.15.50:0/173838397 shutdown_connections 2024-09-11T22:15:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.761+0000 7f6e1943d740 1 -- 172.21.15.50:0/173838397 wait complete. 2024-09-11T22:15:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.762+0000 7f6e1943d740 1 -- start start 2024-09-11T22:15:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.762+0000 7f6e1943d740 1 Processor -- start 2024-09-11T22:15:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e1943d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa80382c0 0x564fa8053950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e1943d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa8039a50 0x564fa80672a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e1943d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 0x564fa80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e1943d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564fa8033f20 con 0x564fa8039a50 2024-09-11T22:15:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e1943d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564fa7f23450 con 0x564fa80382c0 2024-09-11T22:15:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e1943d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564fa807e290 con 0x564fa808ce00 2024-09-11T22:15:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e1943d740 10 client.0 _ll_register_callbacks cb 0x564fa7cacac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e0f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa8039a50 0x564fa80672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e0f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa8039a50 0x564fa80672a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36792/0 (socket says 172.21.15.50:36792) 2024-09-11T22:15:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e0f7fe640 1 -- 172.21.15.50:0/3435707214 learned_addr learned my addr 172.21.15.50:0/3435707214 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa80382c0 0x564fa8053950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e14c4c640 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 0x564fa80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e0f7fe640 1 -- 172.21.15.50:0/3435707214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 msgr2=0x564fa80612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 0x564fa80612d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e0f7fe640 1 -- 172.21.15.50:0/3435707214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa80382c0 msgr2=0x564fa8053950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa80382c0 0x564fa8053950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e0f7fe640 1 -- 172.21.15.50:0/3435707214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fa7cad2d0 con 0x564fa8039a50 2024-09-11T22:15:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e14c4c640 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 0x564fa80612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:15:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa8039a50 0x564fa80672a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f6e04079b90 tx=0x7f6e04079f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb974dc126a0607 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.763+0000 7f6deeffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6deeffd640 1 -- 172.21.15.50:0/3435707214 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0404b040 con 0x564fa8039a50 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6deeffd640 1 -- 172.21.15.50:0/3435707214 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7f6e04082530 con 0x564fa8039a50 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6e1943d740 1 -- 172.21.15.50:0/3435707214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e000038e0 con 0x564fa8039a50 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6deeffd640 1 -- 172.21.15.50:0/3435707214 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f6e0403ce60 con 0x564fa8039a50 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6e1943d740 10 client.7269 fetch_fsmap learned FSMap version 63 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6e1943d740 1 -- 172.21.15.50:0/3435707214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x564fa7d776b0 con 0x564fa8039a50 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6deeffd640 1 -- 172.21.15.50:0/3435707214 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e000038e0 con 0x564fa8039a50 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6deeffd640 1 -- 172.21.15.50:0/3435707214 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f6e040792e0 con 0x564fa8039a50 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6e1943d740 10 client.7269 fetch_fsmap finished waiting for FSMap version 63 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6e1943d740 10 client.7269 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6e1943d740 20 client.7269 populate_metadata read hostname 'smithi050' 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6e1943d740 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x564fa8065740 0x564fa809a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6e1943d740 4 client.7269 mds_command: new command op to 7110 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:15:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6e1943d740 1 -- 172.21.15.50:0/3435707214 --> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fa7fa7c50 con 0x564fa8065740 2024-09-11T22:15:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.764+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x564fa8065740 0x564fa809a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.765+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x564fa8065740 0x564fa809a790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c043a3a83058545 server_cookie=8bed802b7b3faa26 in_seq=0 out_seq=0 2024-09-11T22:15:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.765+0000 7f6deeffd640 10 client.7269 ms_handle_connect on v2:172.21.15.77:6834/1549905387 2024-09-11T22:15:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.765+0000 7f6deeffd640 1 -- 172.21.15.50:0/3435707214 <== mds.0 v2:172.21.15.77:6834/1549905387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564fa7fa7c50 con 0x564fa8065740 2024-09-11T22:15:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.765+0000 7f6deeffd640 10 client.7269 handle_command_reply: tid=0 2024-09-11T22:15:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.765+0000 7f6e1943d740 1 client.7269 shutdown 2024-09-11T22:15:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.766+0000 7f6e1943d740 1 -- 172.21.15.50:0/3435707214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa8039a50 msgr2=0x564fa80672a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.766+0000 7f6e1943d740 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa8039a50 0x564fa80672a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f6e04079b90 tx=0x7f6e04079f50 comp rx=0 tx=0).stop 2024-09-11T22:15:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.766+0000 7f6e1943d740 1 -- 172.21.15.50:0/3435707214 shutdown_connections 2024-09-11T22:15:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.766+0000 7f6e1943d740 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x564fa8065740 0x564fa809a790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.766+0000 7f6e1943d740 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 0x564fa80612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.766+0000 7f6e1943d740 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa8039a50 0x564fa80672a0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.766+0000 7f6deeffd640 0 client.7269 ms_handle_reset on v2:172.21.15.77:6834/1549905387 2024-09-11T22:15:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.766+0000 7f6e1943d740 1 --2- 172.21.15.50:0/3435707214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa80382c0 0x564fa8053950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.766+0000 7f6e1943d740 1 -- 172.21.15.50:0/3435707214 >> 172.21.15.50:0/3435707214 conn(0x564fa8035a80 msgr2=0x564fa807ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.766+0000 7f6e1943d740 1 -- 172.21.15.50:0/3435707214 shutdown_connections 2024-09-11T22:15:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.766+0000 7f6e1943d740 1 -- 172.21.15.50:0/3435707214 wait complete. 2024-09-11T22:15:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.766+0000 7f6e1943d740 20 client.7269 trim_cache size 0 max 16384 2024-09-11T22:15:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.784+0000 7f6e1943d740 1 Processor -- start 2024-09-11T22:15:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.784+0000 7f6e1943d740 1 -- start start 2024-09-11T22:15:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e1943d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa807afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e1943d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 0x564fa807c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e1943d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 0x564fa807a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e1943d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1009e640 con 0x564fa80382c0 2024-09-11T22:15:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e1943d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1009d9a0 con 0x564fa8039a50 2024-09-11T22:15:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e1943d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1009dff0 con 0x564fa808ce00 2024-09-11T22:15:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa807afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa807afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36794/0 (socket says 172.21.15.50:36794) 2024-09-11T22:15:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e0ffff640 1 -- 172.21.15.50:0/2866903796 learned_addr learned my addr 172.21.15.50:0/2866903796 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/2866903796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 0x564fa807c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e14c4c640 1 --2- 172.21.15.50:0/2866903796 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 0x564fa807a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e0ffff640 1 -- 172.21.15.50:0/2866903796 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 msgr2=0x564fa807a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/2866903796 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 0x564fa807a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e0ffff640 1 -- 172.21.15.50:0/2866903796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 msgr2=0x564fa807c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/2866903796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 0x564fa807c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e0ffff640 1 -- 172.21.15.50:0/2866903796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fa8034820 con 0x564fa80382c0 2024-09-11T22:15:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/2866903796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 0x564fa807c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/2866903796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa807afb0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f6e00007fd0 tx=0x7f6e00014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696d4cfd67ffae2a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6df57fa640 1 -- 172.21.15.50:0/2866903796 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00027070 con 0x564fa80382c0 2024-09-11T22:15:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6df57fa640 1 -- 172.21.15.50:0/2866903796 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e00028040 con 0x564fa80382c0 2024-09-11T22:15:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.785+0000 7f6df57fa640 1 -- 172.21.15.50:0/2866903796 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00016480 con 0x564fa80382c0 2024-09-11T22:15:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.786+0000 7f6e1943d740 1 -- 172.21.15.50:0/2866903796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 msgr2=0x564fa807afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.786+0000 7f6e1943d740 1 --2- 172.21.15.50:0/2866903796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa807afb0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f6e00007fd0 tx=0x7f6e00014000 comp rx=0 tx=0).stop 2024-09-11T22:15:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.786+0000 7f6e1943d740 1 -- 172.21.15.50:0/2866903796 shutdown_connections 2024-09-11T22:15:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.786+0000 7f6e1943d740 1 --2- 172.21.15.50:0/2866903796 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 0x564fa807a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.786+0000 7f6e1943d740 1 --2- 172.21.15.50:0/2866903796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 0x564fa807c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.786+0000 7f6e1943d740 1 --2- 172.21.15.50:0/2866903796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa807afb0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.786+0000 7f6e1943d740 1 -- 172.21.15.50:0/2866903796 >> 172.21.15.50:0/2866903796 conn(0x564fa8035a80 msgr2=0x564fa807ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.786+0000 7f6e1943d740 1 -- 172.21.15.50:0/2866903796 shutdown_connections 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.786+0000 7f6e1943d740 1 -- 172.21.15.50:0/2866903796 wait complete. 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.786+0000 7f6e1943d740 1 -- start start 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.787+0000 7f6e1943d740 1 Processor -- start 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.787+0000 7f6e1943d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa80668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.787+0000 7f6e1943d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 0x564fa8095cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.787+0000 7f6e1943d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 0x564fa80fa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.787+0000 7f6e1943d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564fa80655c0 con 0x564fa80382c0 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.787+0000 7f6e1943d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564fa8033f20 con 0x564fa8039a50 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.787+0000 7f6e1943d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564fa8065c10 con 0x564fa808ce00 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.787+0000 7f6e1943d740 10 client.0 _ll_register_callbacks cb 0x7f6e040761c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:15:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.787+0000 7f6e0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa80668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.787+0000 7f6e0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa80668f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36798/0 (socket says 172.21.15.50:36798) 2024-09-11T22:15:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.787+0000 7f6e0ffff640 1 -- 172.21.15.50:0/883646468 learned_addr learned my addr 172.21.15.50:0/883646468 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/883646468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 0x564fa8095cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6e14c4c640 1 --2- 172.21.15.50:0/883646468 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 0x564fa80fa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6e0ffff640 1 -- 172.21.15.50:0/883646468 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 msgr2=0x564fa80fa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/883646468 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 0x564fa80fa640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6e0ffff640 1 -- 172.21.15.50:0/883646468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 msgr2=0x564fa8095cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/883646468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 0x564fa8095cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6e0ffff640 1 -- 172.21.15.50:0/883646468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fa8095250 con 0x564fa80382c0 2024-09-11T22:15:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6e0ffff640 1 --2- 172.21.15.50:0/883646468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa80668f0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f6e000107e0 tx=0x7f6e00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960bb625dd9a7e70 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6deeffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:15:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6deeffd640 1 -- 172.21.15.50:0/883646468 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00027070 con 0x564fa80382c0 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6deeffd640 1 -- 172.21.15.50:0/883646468 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7f6e0003b820 con 0x564fa80382c0 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6e1943d740 1 -- 172.21.15.50:0/883646468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e00028040 con 0x564fa80382c0 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6deeffd640 1 -- 172.21.15.50:0/883646468 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f6e00042050 con 0x564fa80382c0 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6e1943d740 10 client.7275 fetch_fsmap learned FSMap version 63 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6e1943d740 1 -- 172.21.15.50:0/883646468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x564fa80fab80 con 0x564fa80382c0 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6deeffd640 1 -- 172.21.15.50:0/883646468 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e00028040 con 0x564fa80382c0 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.788+0000 7f6deeffd640 1 -- 172.21.15.50:0/883646468 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f6e00045020 con 0x564fa80382c0 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.789+0000 7f6e1943d740 10 client.7275 fetch_fsmap finished waiting for FSMap version 63 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.789+0000 7f6e1943d740 10 client.7275 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.789+0000 7f6e1943d740 20 client.7275 populate_metadata read hostname 'smithi050' 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.789+0000 7f6e1943d740 1 --2- 172.21.15.50:0/883646468 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x564fa809da30 0x564fa809de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.789+0000 7f6e1943d740 4 client.7275 mds_command: new command op to 7110 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.789+0000 7f6e1943d740 1 -- 172.21.15.50:0/883646468 --> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] -- command(tid 0: {"prefix": "status"}) -- 0x564fa8064890 con 0x564fa809da30 2024-09-11T22:15:58.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.789+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/883646468 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x564fa809da30 0x564fa809de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.789+0000 7f6deeffd640 10 client.7275 ms_handle_connect on v2:172.21.15.77:6834/1549905387 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.789+0000 7f6e0f7fe640 1 --2- 172.21.15.50:0/883646468 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x564fa809da30 0x564fa809de10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e9578aed3f8ddcc server_cookie=a4c8367915c26031 in_seq=0 out_seq=0 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.789+0000 7f6deeffd640 1 -- 172.21.15.50:0/883646468 <== mds.0 v2:172.21.15.77:6834/1549905387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x564fa8064890 con 0x564fa809da30 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.789+0000 7f6deeffd640 10 client.7275 handle_command_reply: tid=0 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.789+0000 7f6e1943d740 1 client.7275 shutdown 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e1943d740 1 -- 172.21.15.50:0/883646468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 msgr2=0x564fa80668f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e1943d740 1 --2- 172.21.15.50:0/883646468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa80668f0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f6e000107e0 tx=0x7f6e00004730 comp rx=0 tx=0).stop 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e1943d740 1 -- 172.21.15.50:0/883646468 shutdown_connections 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e1943d740 1 --2- 172.21.15.50:0/883646468 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x564fa809da30 0x564fa809de10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e1943d740 1 --2- 172.21.15.50:0/883646468 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564fa808ce00 0x564fa80fa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e1943d740 1 --2- 172.21.15.50:0/883646468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564fa8039a50 0x564fa8095cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e1943d740 1 --2- 172.21.15.50:0/883646468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fa80382c0 0x564fa80668f0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e1943d740 1 -- 172.21.15.50:0/883646468 >> 172.21.15.50:0/883646468 conn(0x564fa8035a80 msgr2=0x564fa807afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6deeffd640 0 client.7275 ms_handle_reset on v2:172.21.15.77:6834/1549905387 2024-09-11T22:15:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e1943d740 1 -- 172.21.15.50:0/883646468 shutdown_connections 2024-09-11T22:15:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e1943d740 1 -- 172.21.15.50:0/883646468 wait complete. 2024-09-11T22:15:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e1943d740 20 client.7275 trim_cache size 0 max 16384 2024-09-11T22:15:58.799 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:15:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:15:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:15:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 7110, 2024-09-11T22:15:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:15:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:15:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:15:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 9.0490350199999998, 2024-09-11T22:15:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 63, 2024-09-11T22:15:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 91, 2024-09-11T22:15:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 89, 2024-09-11T22:15:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 14.062062029 2024-09-11T22:15:58.800 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:15:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e166af640 1 -- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6dfc06be60 msgr2=0x7f6dfc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e166af640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6dfc06be60 0x7f6dfc06e320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6e00006fd0 tx=0x7f6e00008040 comp rx=0 tx=0).stop 2024-09-11T22:15:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e166af640 1 -- 172.21.15.50:0/317710567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e100b2970 msgr2=0x7f6e101f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e166af640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e100b2970 0x7f6e101f81e0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009870 tx=0x7f6e040046c0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e166af640 1 -- 172.21.15.50:0/317710567 shutdown_connections 2024-09-11T22:15:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e166af640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6dfc06be60 0x7f6dfc06e320 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e166af640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e1015fd80 0x7f6e100ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e166af640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e100b2970 0x7f6e101f81e0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e166af640 1 --2- 172.21.15.50:0/317710567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e100af4c0 0x7f6e1009fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.790+0000 7f6e166af640 1 -- 172.21.15.50:0/317710567 >> 172.21.15.50:0/317710567 conn(0x7f6e1009ba50 msgr2=0x7f6e100b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.791+0000 7f6e166af640 1 -- 172.21.15.50:0/317710567 shutdown_connections 2024-09-11T22:15:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.791+0000 7f6e166af640 1 -- 172.21.15.50:0/317710567 wait complete. 2024-09-11T22:15:58.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:15:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.904+0000 7fd89b88b640 1 Processor -- start 2024-09-11T22:15:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.904+0000 7fd89b88b640 1 -- start start 2024-09-11T22:15:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd89b88b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd894156960 0x7fd89406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd89b88b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd89415d4c0 0x7fd8940cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd89b88b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8940ce470 con 0x7fd8940d03b0 2024-09-11T22:15:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd89b88b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd8940b03a0 con 0x7fd894156960 2024-09-11T22:15:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd89b88b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd8940738f0 con 0x7fd89415d4c0 2024-09-11T22:15:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd899627640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd894156960 0x7fd89406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd899627640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd894156960 0x7fd89406fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36812/0 (socket says 172.21.15.50:36812) 2024-09-11T22:15:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd899627640 1 -- 172.21.15.50:0/2317451634 learned_addr learned my addr 172.21.15.50:0/2317451634 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd898e26640 1 --2- 172.21.15.50:0/2317451634 >> v2:172.21.15.77:3300/0 conn(0x7fd89415d4c0 0x7fd8940cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd899627640 1 -- 172.21.15.50:0/2317451634 >> v2:172.21.15.77:3300/0 conn(0x7fd89415d4c0 msgr2=0x7fd8940cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:15:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd899627640 1 --2- 172.21.15.50:0/2317451634 >> v2:172.21.15.77:3300/0 conn(0x7fd89415d4c0 0x7fd8940cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd899627640 1 -- 172.21.15.50:0/2317451634 >> v1:172.21.15.77:6789/0 conn(0x7fd8940d03b0 legacy=0x7fd894160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd899627640 1 -- 172.21.15.50:0/2317451634 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8940ce750 con 0x7fd894156960 2024-09-11T22:15:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.905+0000 7fd898e26640 1 --2- 172.21.15.50:0/2317451634 >> v2:172.21.15.77:3300/0 conn(0x7fd89415d4c0 0x7fd8940cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.906+0000 7fd899627640 1 --2- 172.21.15.50:0/2317451634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894156960 0x7fd89406fd50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd894070290 tx=0x7fd89002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d31e71c99b21bfd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.906+0000 7fd88bfff640 1 -- 172.21.15.50:0/2317451634 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd890037070 con 0x7fd894156960 2024-09-11T22:15:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.906+0000 7fd88bfff640 1 -- 172.21.15.50:0/2317451634 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd890032440 con 0x7fd894156960 2024-09-11T22:15:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.906+0000 7fd88bfff640 1 -- 172.21.15.50:0/2317451634 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd890032810 con 0x7fd894156960 2024-09-11T22:15:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.907+0000 7fd89b88b640 1 -- 172.21.15.50:0/2317451634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894156960 msgr2=0x7fd89406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.907+0000 7fd89b88b640 1 --2- 172.21.15.50:0/2317451634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894156960 0x7fd89406fd50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd894070290 tx=0x7fd89002a270 comp rx=0 tx=0).stop 2024-09-11T22:15:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.907+0000 7fd89b88b640 1 -- 172.21.15.50:0/2317451634 shutdown_connections 2024-09-11T22:15:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.907+0000 7fd89b88b640 1 --2- 172.21.15.50:0/2317451634 >> v2:172.21.15.77:3300/0 conn(0x7fd89415d4c0 0x7fd8940cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.907+0000 7fd89b88b640 1 --2- 172.21.15.50:0/2317451634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894156960 0x7fd89406fd50 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.907+0000 7fd89b88b640 1 -- 172.21.15.50:0/2317451634 >> 172.21.15.50:0/2317451634 conn(0x7fd8940b2bd0 msgr2=0x7fd8940b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.907+0000 7fd89b88b640 1 -- 172.21.15.50:0/2317451634 shutdown_connections 2024-09-11T22:15:58.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.907+0000 7fd89b88b640 1 -- 172.21.15.50:0/2317451634 wait complete. 2024-09-11T22:15:58.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.908+0000 7fd89b88b640 1 Processor -- start 2024-09-11T22:15:58.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.908+0000 7fd89b88b640 1 -- start start 2024-09-11T22:15:58.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd89b88b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8940d03b0 0x7fd8941f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd89b88b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894156960 0x7fd8940b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd89b88b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89415d4c0 0x7fd8940b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd89b88b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd8940d0800 con 0x7fd894156960 2024-09-11T22:15:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd89b88b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd8940cea30 con 0x7fd89415d4c0 2024-09-11T22:15:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd89b88b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd8940b0830 con 0x7fd8940d03b0 2024-09-11T22:15:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd898e26640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894156960 0x7fd8940b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd898e26640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894156960 0x7fd8940b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36826/0 (socket says 172.21.15.50:36826) 2024-09-11T22:15:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd898e26640 1 -- 172.21.15.50:0/2723691472 learned_addr learned my addr 172.21.15.50:0/2723691472 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:15:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd899627640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8940d03b0 0x7fd8941f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd899e28640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89415d4c0 0x7fd8940b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd898e26640 1 -- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8940d03b0 msgr2=0x7fd8941f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd898e26640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8940d03b0 0x7fd8941f3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd898e26640 1 -- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89415d4c0 msgr2=0x7fd8940b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd898e26640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89415d4c0 0x7fd8940b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd898e26640 1 -- 172.21.15.50:0/2723691472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8941f3960 con 0x7fd894156960 2024-09-11T22:15:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd899e28640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89415d4c0 0x7fd8940b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:15:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.909+0000 7fd898e26640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894156960 0x7fd8940b1c50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd88400d7d0 tx=0x7fd88400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.910+0000 7fd889ffb640 1 -- 172.21.15.50:0/2723691472 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884004030 con 0x7fd894156960 2024-09-11T22:15:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.910+0000 7fd889ffb640 1 -- 172.21.15.50:0/2723691472 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8840041d0 con 0x7fd894156960 2024-09-11T22:15:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.910+0000 7fd89b88b640 1 -- 172.21.15.50:0/2723691472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd894153a90 con 0x7fd894156960 2024-09-11T22:15:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.910+0000 7fd889ffb640 1 -- 172.21.15.50:0/2723691472 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88400b660 con 0x7fd894156960 2024-09-11T22:15:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.910+0000 7fd89b88b640 1 -- 172.21.15.50:0/2723691472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8941f3190 con 0x7fd894156960 2024-09-11T22:15:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.911+0000 7fd89b88b640 1 -- 172.21.15.50:0/2723691472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd894156d40 con 0x7fd894156960 2024-09-11T22:15:58.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.911+0000 7fd889ffb640 1 -- 172.21.15.50:0/2723691472 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd88400b800 con 0x7fd894156960 2024-09-11T22:15:58.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.912+0000 7fd889ffb640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd87806be30 0x7fd87806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:15:58.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.912+0000 7fd889ffb640 1 -- 172.21.15.50:0/2723691472 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7fd88408afd0 con 0x7fd894156960 2024-09-11T22:15:58.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.912+0000 7fd899627640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd87806be30 0x7fd87806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:15:58.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.912+0000 7fd899627640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd87806be30 0x7fd87806e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd890034000 tx=0x7fd89002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:15:58.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:58.916+0000 7fd889ffb640 1 -- 172.21.15.50:0/2723691472 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd894153a90 con 0x7fd894156960 2024-09-11T22:15:59.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.125+0000 7fd89b88b640 1 -- 172.21.15.50:0/2723691472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd894155950 con 0x7fd894156960 2024-09-11T22:15:59.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.126+0000 7fd889ffb640 1 -- 172.21.15.50:0/2723691472 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) ==== 53+0+73 (secure 0 0 0) 0x7fd8840599f0 con 0x7fd894156960 2024-09-11T22:15:59.127 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:15:59.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.128+0000 7fd89b88b640 1 -- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd87806be30 msgr2=0x7fd87806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:59.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.128+0000 7fd89b88b640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd87806be30 0x7fd87806e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd890034000 tx=0x7fd89002e000 comp rx=0 tx=0).stop 2024-09-11T22:15:59.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.128+0000 7fd89b88b640 1 -- 172.21.15.50:0/2723691472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894156960 msgr2=0x7fd8940b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:15:59.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.128+0000 7fd89b88b640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894156960 0x7fd8940b1c50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd88400d7d0 tx=0x7fd88400dc90 comp rx=0 tx=0).stop 2024-09-11T22:15:59.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.128+0000 7fd89b88b640 1 -- 172.21.15.50:0/2723691472 shutdown_connections 2024-09-11T22:15:59.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.128+0000 7fd89b88b640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd87806be30 0x7fd87806e2f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:59.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.128+0000 7fd89b88b640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89415d4c0 0x7fd8940b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:59.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.128+0000 7fd89b88b640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd894156960 0x7fd8940b1c50 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:59.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.128+0000 7fd89b88b640 1 --2- 172.21.15.50:0/2723691472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8940d03b0 0x7fd8941f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:15:59.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.128+0000 7fd89b88b640 1 -- 172.21.15.50:0/2723691472 >> 172.21.15.50:0/2723691472 conn(0x7fd8940b2bd0 msgr2=0x7fd89415a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:15:59.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.128+0000 7fd89b88b640 1 -- 172.21.15.50:0/2723691472 shutdown_connections 2024-09-11T22:15:59.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59.128+0000 7fd89b88b640 1 -- 172.21.15.50:0/2723691472 wait complete. 2024-09-11T22:15:59.140 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:15:59.140 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:15:59.140 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:15:59.140 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:15:59.140 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:59.140 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:15:59.140 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:15:59.140 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:15:59.140 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:15:59.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:59.141 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:15:59.157 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:15:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:15:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:15:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:15:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:59.157 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:15:59.157 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:15:59.158 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:15:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:15:59.158 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:15:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:15:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:15:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42436sec preferred_lft 42436sec 2024-09-11T22:15:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:15:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:59.158 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:15:59.158 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:15:59.159 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:15:59.160 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:15:59.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:59.160 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:15:59.222 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:15:59.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:59.224 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:15:59.281 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:15:59.281 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:15:59.281 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:15:59.282 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:15:59.282 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:15:59.282 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:15:59.282 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:15:59.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:15:59.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:15:59.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:15:59.282 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:15:59.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:15:59.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:15:59.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:59.411 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:15:59.426 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:15:59.426 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:15:59.427 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:15:59.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:59.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:15:59.492 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:15:59.493 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:59.548 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:15:59.548 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:15:59.549 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:59.604 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:15:59.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:59.604 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:15:59.689 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:15:59.689 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:15:59.697 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:15:59.697 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:15:59.697 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:15:59.697 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:15:59.697 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:15:59.698 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:15:59.698 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:15:59.698 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:15:59.698 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:15:59.698 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:15:59.699 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:15:59.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:59.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:15:59.726 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:15:59.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:15:59.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:15:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:15:59.825 INFO:teuthology.orchestra.run.smithi050.stdout:client6664 2024-09-11T22:15:59.825 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:15:59.825 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:15:59.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:15:59.842 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-11T22:15:59.901 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2024-09-11T22:15:59.901 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-11T22:15:59.901 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2024-09-11T22:15:59.901 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:15:59.901 DEBUG:teuthology.orchestra.run.smithi050:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-11T22:15:59.901 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-11T22:16:00.007 INFO:teuthology.orchestra.run.smithi050.stdout:1099511627776 2024-09-11T22:16:00.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:16:00.017 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:00.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.157+0000 7fbfd0726640 1 Processor -- start 2024-09-11T22:16:00.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.157+0000 7fbfd0726640 1 -- start start 2024-09-11T22:16:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.158+0000 7fbfd0726640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfc80d18a0 0x7fbfc80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.158+0000 7fbfd0726640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80d3a30 0x7fbfc80b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.158+0000 7fbfd0726640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc80cfa80 con 0x7fbfc815e870 2024-09-11T22:16:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.158+0000 7fbfd0726640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fbfc80d3ea0 con 0x7fbfc80d18a0 2024-09-11T22:16:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.158+0000 7fbfd0726640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc80d40d0 con 0x7fbfc80d3a30 2024-09-11T22:16:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.158+0000 7fbfcdcc1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfc80d18a0 0x7fbfc80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.158+0000 7fbfcdcc1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfc80d18a0 0x7fbfc80d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36834/0 (socket says 172.21.15.50:36834) 2024-09-11T22:16:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.158+0000 7fbfcdcc1640 1 -- 172.21.15.50:0/2055624875 learned_addr learned my addr 172.21.15.50:0/2055624875 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.159+0000 7fbfcecc3640 1 --2- 172.21.15.50:0/2055624875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80d3a30 0x7fbfc80b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.159+0000 7fbfcdcc1640 1 -- 172.21.15.50:0/2055624875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80d3a30 msgr2=0x7fbfc80b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.159+0000 7fbfcdcc1640 1 --2- 172.21.15.50:0/2055624875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80d3a30 0x7fbfc80b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.159+0000 7fbfcdcc1640 1 -- 172.21.15.50:0/2055624875 >> v1:172.21.15.77:6789/0 conn(0x7fbfc815e870 legacy=0x7fbfc80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.159+0000 7fbfcdcc1640 1 -- 172.21.15.50:0/2055624875 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc80d43b0 con 0x7fbfc80d18a0 2024-09-11T22:16:00.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.159+0000 7fbfcecc3640 1 --2- 172.21.15.50:0/2055624875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80d3a30 0x7fbfc80b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.159+0000 7fbfcdcc1640 1 --2- 172.21.15.50:0/2055624875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc80d18a0 0x7fbfc80d34f0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fbfc806c860 tx=0x7fbfb802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecd91b6b8ff42bf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.160+0000 7fbfcd4c0640 1 -- 172.21.15.50:0/2055624875 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8037070 con 0x7fbfc80d18a0 2024-09-11T22:16:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.160+0000 7fbfcd4c0640 1 -- 172.21.15.50:0/2055624875 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb8032440 con 0x7fbfc80d18a0 2024-09-11T22:16:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.160+0000 7fbfcd4c0640 1 -- 172.21.15.50:0/2055624875 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8032810 con 0x7fbfc80d18a0 2024-09-11T22:16:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.160+0000 7fbfd0726640 1 -- 172.21.15.50:0/2055624875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc80d18a0 msgr2=0x7fbfc80d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.160+0000 7fbfd0726640 1 --2- 172.21.15.50:0/2055624875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc80d18a0 0x7fbfc80d34f0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fbfc806c860 tx=0x7fbfb802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.160+0000 7fbfd0726640 1 -- 172.21.15.50:0/2055624875 shutdown_connections 2024-09-11T22:16:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.160+0000 7fbfd0726640 1 --2- 172.21.15.50:0/2055624875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80d3a30 0x7fbfc80b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.160+0000 7fbfd0726640 1 --2- 172.21.15.50:0/2055624875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc80d18a0 0x7fbfc80d34f0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.160+0000 7fbfd0726640 1 -- 172.21.15.50:0/2055624875 >> 172.21.15.50:0/2055624875 conn(0x7fbfc80727a0 msgr2=0x7fbfc80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.160+0000 7fbfd0726640 1 -- 172.21.15.50:0/2055624875 shutdown_connections 2024-09-11T22:16:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.160+0000 7fbfd0726640 1 -- 172.21.15.50:0/2055624875 wait complete. 2024-09-11T22:16:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.161+0000 7fbfd0726640 1 Processor -- start 2024-09-11T22:16:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.161+0000 7fbfd0726640 1 -- start start 2024-09-11T22:16:00.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.162+0000 7fbfd0726640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc80d18a0 0x7fbfc81f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:00.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.162+0000 7fbfd0726640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80d3a30 0x7fbfc815c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:00.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.162+0000 7fbfd0726640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc815e870 0x7fbfc80c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:00.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.162+0000 7fbfd0726640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc815ec50 con 0x7fbfc80d18a0 2024-09-11T22:16:00.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.162+0000 7fbfd0726640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc80b7ee0 con 0x7fbfc815e870 2024-09-11T22:16:00.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.162+0000 7fbfd0726640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc80b78b0 con 0x7fbfc80d3a30 2024-09-11T22:16:00.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.162+0000 7fbfce4c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc80d18a0 0x7fbfc81f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:00.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.162+0000 7fbfce4c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc80d18a0 0x7fbfc81f4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36838/0 (socket says 172.21.15.50:36838) 2024-09-11T22:16:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.162+0000 7fbfce4c2640 1 -- 172.21.15.50:0/1449210786 learned_addr learned my addr 172.21.15.50:0/1449210786 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.162+0000 7fbfcecc3640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc815e870 0x7fbfc80c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.162+0000 7fbfcdcc1640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80d3a30 0x7fbfc815c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.163+0000 7fbfce4c2640 1 -- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80d3a30 msgr2=0x7fbfc815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.163+0000 7fbfce4c2640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80d3a30 0x7fbfc815c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.163+0000 7fbfce4c2640 1 -- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc815e870 msgr2=0x7fbfc80c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.163+0000 7fbfce4c2640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc815e870 0x7fbfc80c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.163+0000 7fbfce4c2640 1 -- 172.21.15.50:0/1449210786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc81f4b40 con 0x7fbfc80d18a0 2024-09-11T22:16:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.163+0000 7fbfcecc3640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc815e870 0x7fbfc80c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.163+0000 7fbfcdcc1640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80d3a30 0x7fbfc815c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.163+0000 7fbfce4c2640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc80d18a0 0x7fbfc81f4490 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400c7c0 tx=0x7fbfc400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.163+0000 7fbfbeffd640 1 -- 172.21.15.50:0/1449210786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4016020 con 0x7fbfc80d18a0 2024-09-11T22:16:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.163+0000 7fbfbeffd640 1 -- 172.21.15.50:0/1449210786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc400aa50 con 0x7fbfc80d18a0 2024-09-11T22:16:00.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.163+0000 7fbfd0726640 1 -- 172.21.15.50:0/1449210786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc81f4e20 con 0x7fbfc80d18a0 2024-09-11T22:16:00.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.163+0000 7fbfbeffd640 1 -- 172.21.15.50:0/1449210786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4012420 con 0x7fbfc80d18a0 2024-09-11T22:16:00.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.163+0000 7fbfd0726640 1 -- 172.21.15.50:0/1449210786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc81f53e0 con 0x7fbfc80d18a0 2024-09-11T22:16:00.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.164+0000 7fbfd0726640 1 -- 172.21.15.50:0/1449210786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc80d34f0 con 0x7fbfc80d18a0 2024-09-11T22:16:00.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.165+0000 7fbfbeffd640 1 -- 172.21.15.50:0/1449210786 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfc4019020 con 0x7fbfc80d18a0 2024-09-11T22:16:00.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.165+0000 7fbfbeffd640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbfac06be30 0x7fbfac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:00.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.165+0000 7fbfbeffd640 1 -- 172.21.15.50:0/1449210786 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7fbfc408afa0 con 0x7fbfc80d18a0 2024-09-11T22:16:00.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.165+0000 7fbfcdcc1640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbfac06be30 0x7fbfac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:00.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.166+0000 7fbfcdcc1640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbfac06be30 0x7fbfac06e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8034000 tx=0x7fbfb802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:00.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.169+0000 7fbfbeffd640 1 -- 172.21.15.50:0/1449210786 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbfc4020030 con 0x7fbfc80d18a0 2024-09-11T22:16:00.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.380+0000 7fbfd0726640 1 -- 172.21.15.50:0/1449210786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfc8067b60 con 0x7fbfc80d18a0 2024-09-11T22:16:00.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.381+0000 7fbfbeffd640 1 -- 172.21.15.50:0/1449210786 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5225 (secure 0 0 0) 0x7fbfc4059930 con 0x7fbfc80d18a0 2024-09-11T22:16:00.382 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:00.382 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":63,"btime":"2024-09-11T22:15:51:760001+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2316208539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2316208539},{"type":"v1","addr":"172.21.15.77:6837","nonce":2316208539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7101,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2875804357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2875804357},{"type":"v1","addr":"172.21.15.50:6834","nonce":2875804357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7104,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2615352620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2615352620},{"type":"v1","addr":"172.21.15.50:6835","nonce":2615352620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:15:51.106407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7110},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7110":{"gid":7110,"name":"b","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/1549905387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1549905387},{"type":"v1","addr":"172.21.15.77:6836","nonce":1549905387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7110,"qdb_cluster":[7110]},"id":6}]} 2024-09-11T22:16:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 63 2024-09-11T22:16:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.383+0000 7fbfd0726640 1 -- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbfac06be30 msgr2=0x7fbfac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.383+0000 7fbfd0726640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbfac06be30 0x7fbfac06e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8034000 tx=0x7fbfb802e000 comp rx=0 tx=0).stop 2024-09-11T22:16:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.383+0000 7fbfd0726640 1 -- 172.21.15.50:0/1449210786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc80d18a0 msgr2=0x7fbfc81f4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.383+0000 7fbfd0726640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc80d18a0 0x7fbfc81f4490 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400c7c0 tx=0x7fbfc400cc80 comp rx=0 tx=0).stop 2024-09-11T22:16:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.383+0000 7fbfd0726640 1 -- 172.21.15.50:0/1449210786 shutdown_connections 2024-09-11T22:16:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.383+0000 7fbfd0726640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbfac06be30 0x7fbfac06e2f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.383+0000 7fbfd0726640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80d3a30 0x7fbfc815c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.383+0000 7fbfd0726640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc815e870 0x7fbfc80c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.383+0000 7fbfd0726640 1 --2- 172.21.15.50:0/1449210786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc80d18a0 0x7fbfc81f4490 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.383+0000 7fbfd0726640 1 -- 172.21.15.50:0/1449210786 >> 172.21.15.50:0/1449210786 conn(0x7fbfc80727a0 msgr2=0x7fbfc815d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.383+0000 7fbfd0726640 1 -- 172.21.15.50:0/1449210786 shutdown_connections 2024-09-11T22:16:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.383+0000 7fbfd0726640 1 -- 172.21.15.50:0/1449210786 wait complete. 2024-09-11T22:16:00.395 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump inode 1099511627776 2024-09-11T22:16:00.519 INFO:teuthology.orchestra.run.smithi077.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-11T22:15:59.896416+0000","btime":"2024-09-11T22:15:59.896416+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-11T22:15:59.896416+0000","atime":"2024-09-11T22:15:59.896416+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6664,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6664,"want_loner":6664,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-11T22:16:00.520 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-11T22:15:59.896416+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-11T22:15:59.896416+0000", "change_attr": 0, "client_caps": [ { "client_id": 6664, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-11T22:15:59.896416+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6664, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-11T22:15:59.896416+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 6664, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-11T22:16:00.520 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:16:00.521 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:16:00.537 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2024-09-11T22:16:00.537 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-11T22:16:00.537 DEBUG:teuthology.orchestra.run.smithi050:> import uuid 2024-09-11T22:16:00.537 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:16:00.537 DEBUG:teuthology.orchestra.run.smithi050:> n = 21 2024-09-11T22:16:00.537 DEBUG:teuthology.orchestra.run.smithi050:> create_hard_links = False 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> if 0 > 0: 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> create_hard_links = True 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> dpath = os.path.dirname(path) 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> fnameprefix = os.path.basename(path) 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> os.makedirs(dpath, exist_ok=True) 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> try: 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> for i in range(n): 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-11T22:16:00.538 DEBUG:teuthology.orchestra.run.smithi050:> with open(fpath, '"'"'w'"'"') as f: 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> f.write(f"{i}") 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> f.flush() 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(f.fileno()) 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> os.unlink(fpath) 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(dirfd) 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> if create_hard_links: 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> for j in range(0): 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(dirfd) 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> finally: 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> os.close(dirfd) 2024-09-11T22:16:00.539 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-11T22:16:00.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:16:00.679 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:16:00.679 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:16:00.736 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:16:00.736 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:16:00.793 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:16:00.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.935+0000 7f2d8e427640 1 Processor -- start 2024-09-11T22:16:00.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.935+0000 7f2d8e427640 1 -- start start 2024-09-11T22:16:00.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.936+0000 7f2d8e427640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d8815e8e0 0x7f2d880b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:00.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.936+0000 7f2d8e427640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d88162350 0x7f2d88162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:00.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.936+0000 7f2d8e427640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d88163080 con 0x7f2d880d1580 2024-09-11T22:16:00.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.936+0000 7f2d8e427640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2d8815ecc0 con 0x7f2d88162350 2024-09-11T22:16:00.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.936+0000 7f2d8e427640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2d880d2ad0 con 0x7f2d8815e8e0 2024-09-11T22:16:00.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.936+0000 7f2d8c9c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d88162350 0x7f2d88162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:00.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.936+0000 7f2d8c9c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d88162350 0x7f2d88162800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36840/0 (socket says 172.21.15.50:36840) 2024-09-11T22:16:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.936+0000 7f2d8c9c4640 1 -- 172.21.15.50:0/2022654520 learned_addr learned my addr 172.21.15.50:0/2022654520 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.936+0000 7f2d87fff640 1 --2- 172.21.15.50:0/2022654520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d8815e8e0 0x7f2d880b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.936+0000 7f2d8c9c4640 1 -- 172.21.15.50:0/2022654520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d8815e8e0 msgr2=0x7f2d880b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.936+0000 7f2d8c9c4640 1 --2- 172.21.15.50:0/2022654520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d8815e8e0 0x7f2d880b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.936+0000 7f2d8c9c4640 1 -- 172.21.15.50:0/2022654520 >> v1:172.21.15.77:6789/0 conn(0x7f2d880d1580 legacy=0x7f2d880d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.936+0000 7f2d8c9c4640 1 -- 172.21.15.50:0/2022654520 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d880d2d20 con 0x7f2d88162350 2024-09-11T22:16:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.937+0000 7f2d8c9c4640 1 --2- 172.21.15.50:0/2022654520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d88162350 0x7f2d88162800 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009e50 tx=0x7f2d8002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f076e3865a23ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.937+0000 7f2d86ffd640 1 -- 172.21.15.50:0/2022654520 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d80036070 con 0x7f2d88162350 2024-09-11T22:16:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.937+0000 7f2d86ffd640 1 -- 172.21.15.50:0/2022654520 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d80031600 con 0x7f2d88162350 2024-09-11T22:16:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.937+0000 7f2d86ffd640 1 -- 172.21.15.50:0/2022654520 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d800319d0 con 0x7f2d88162350 2024-09-11T22:16:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.938+0000 7f2d8e427640 1 -- 172.21.15.50:0/2022654520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d88162350 msgr2=0x7f2d88162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.938+0000 7f2d8e427640 1 --2- 172.21.15.50:0/2022654520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d88162350 0x7f2d88162800 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009e50 tx=0x7f2d8002a7a0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.938+0000 7f2d8e427640 1 -- 172.21.15.50:0/2022654520 shutdown_connections 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.938+0000 7f2d8e427640 1 --2- 172.21.15.50:0/2022654520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d88162350 0x7f2d88162800 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.938+0000 7f2d8e427640 1 --2- 172.21.15.50:0/2022654520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d8815e8e0 0x7f2d880b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.938+0000 7f2d8e427640 1 -- 172.21.15.50:0/2022654520 >> 172.21.15.50:0/2022654520 conn(0x7f2d88067ba0 msgr2=0x7f2d88067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.938+0000 7f2d8e427640 1 -- 172.21.15.50:0/2022654520 shutdown_connections 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.938+0000 7f2d8e427640 1 -- 172.21.15.50:0/2022654520 wait complete. 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.939+0000 7f2d8e427640 1 Processor -- start 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.939+0000 7f2d8e427640 1 -- start start 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.940+0000 7f2d8e427640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d880d1580 0x7f2d881f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.940+0000 7f2d8e427640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d8815e8e0 0x7f2d881f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.940+0000 7f2d8e427640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d88162350 0x7f2d881f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.940+0000 7f2d8e427640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2d88162d40 con 0x7f2d8815e8e0 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.940+0000 7f2d8e427640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2d880d3370 con 0x7f2d88162350 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.940+0000 7f2d8e427640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2d880d3800 con 0x7f2d880d1580 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.940+0000 7f2d877fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d8815e8e0 0x7f2d881f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.940+0000 7f2d877fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d8815e8e0 0x7f2d881f4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36852/0 (socket says 172.21.15.50:36852) 2024-09-11T22:16:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.940+0000 7f2d877fe640 1 -- 172.21.15.50:0/1589585328 learned_addr learned my addr 172.21.15.50:0/1589585328 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.940+0000 7f2d87fff640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d880d1580 0x7f2d881f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.940+0000 7f2d8c9c4640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d88162350 0x7f2d881f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.941+0000 7f2d877fe640 1 -- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d880d1580 msgr2=0x7f2d881f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.941+0000 7f2d877fe640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d880d1580 0x7f2d881f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.941+0000 7f2d877fe640 1 -- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d88162350 msgr2=0x7f2d881f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.941+0000 7f2d877fe640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d88162350 0x7f2d881f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.941+0000 7f2d877fe640 1 -- 172.21.15.50:0/1589585328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d881f4fc0 con 0x7f2d8815e8e0 2024-09-11T22:16:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.941+0000 7f2d877fe640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d8815e8e0 0x7f2d881f4490 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00c440 tx=0x7f2d7c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.941+0000 7f2d84ff9640 1 -- 172.21.15.50:0/1589585328 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0052d0 con 0x7f2d8815e8e0 2024-09-11T22:16:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.941+0000 7f2d84ff9640 1 -- 172.21.15.50:0/1589585328 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d7c005470 con 0x7f2d8815e8e0 2024-09-11T22:16:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.941+0000 7f2d8e427640 1 -- 172.21.15.50:0/1589585328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d881f52a0 con 0x7f2d8815e8e0 2024-09-11T22:16:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.941+0000 7f2d84ff9640 1 -- 172.21.15.50:0/1589585328 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c007260 con 0x7f2d8815e8e0 2024-09-11T22:16:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.941+0000 7f2d8e427640 1 -- 172.21.15.50:0/1589585328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d880cd8b0 con 0x7f2d8815e8e0 2024-09-11T22:16:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.942+0000 7f2d8e427640 1 -- 172.21.15.50:0/1589585328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d880cd3c0 con 0x7f2d8815e8e0 2024-09-11T22:16:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.943+0000 7f2d84ff9640 1 -- 172.21.15.50:0/1589585328 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d7c007400 con 0x7f2d8815e8e0 2024-09-11T22:16:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.943+0000 7f2d84ff9640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2d7406be30 0x7f2d7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.943+0000 7f2d84ff9640 1 -- 172.21.15.50:0/1589585328 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7f2d7c08a2e0 con 0x7f2d8815e8e0 2024-09-11T22:16:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.943+0000 7f2d87fff640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2d7406be30 0x7f2d7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.944+0000 7f2d87fff640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2d7406be30 0x7f2d7406e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009b40 tx=0x7f2d78009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:00.947+0000 7f2d84ff9640 1 -- 172.21.15.50:0/1589585328 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d7c058620 con 0x7f2d8815e8e0 2024-09-11T22:16:01.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.138+0000 7f2d8e427640 1 -- 172.21.15.50:0/1589585328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2d880b7880 con 0x7f2d8815e8e0 2024-09-11T22:16:01.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.138+0000 7f2d84ff9640 1 -- 172.21.15.50:0/1589585328 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v91) ==== 80+0+0 (secure 0 0 0) 0x7f2d7c05c920 con 0x7f2d8815e8e0 2024-09-11T22:16:01.139 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:16:01.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.140+0000 7f2d8e427640 1 -- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2d7406be30 msgr2=0x7f2d7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.140+0000 7f2d8e427640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2d7406be30 0x7f2d7406e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009b40 tx=0x7f2d78009190 comp rx=0 tx=0).stop 2024-09-11T22:16:01.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.140+0000 7f2d8e427640 1 -- 172.21.15.50:0/1589585328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d8815e8e0 msgr2=0x7f2d881f4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.140+0000 7f2d8e427640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d8815e8e0 0x7f2d881f4490 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00c440 tx=0x7f2d7c001e70 comp rx=0 tx=0).stop 2024-09-11T22:16:01.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.140+0000 7f2d8e427640 1 -- 172.21.15.50:0/1589585328 shutdown_connections 2024-09-11T22:16:01.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.140+0000 7f2d8e427640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2d7406be30 0x7f2d7406e2f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.140+0000 7f2d8e427640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d88162350 0x7f2d881f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.140+0000 7f2d8e427640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d8815e8e0 0x7f2d881f4490 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.140+0000 7f2d8e427640 1 --2- 172.21.15.50:0/1589585328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d880d1580 0x7f2d881f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.140+0000 7f2d8e427640 1 -- 172.21.15.50:0/1589585328 >> 172.21.15.50:0/1589585328 conn(0x7f2d88067ba0 msgr2=0x7f2d8815f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:01.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.140+0000 7f2d8e427640 1 -- 172.21.15.50:0/1589585328 shutdown_connections 2024-09-11T22:16:01.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.140+0000 7f2d8e427640 1 -- 172.21.15.50:0/1589585328 wait complete. 2024-09-11T22:16:01.152 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:16:01.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:16:01.152 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:16:01.227 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:16:01.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:16:01.227 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:16:01.246 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2024-09-11T22:16:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.390+0000 7fea06e53640 1 Processor -- start 2024-09-11T22:16:01.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.390+0000 7fea06e53640 1 -- start start 2024-09-11T22:16:01.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.391+0000 7fea06e53640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea00161d30 0x7fea000cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.391+0000 7fea06e53640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fea000d11d0 0x7fea000d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.391+0000 7fea06e53640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea00162110 con 0x7fea000b78f0 2024-09-11T22:16:01.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.391+0000 7fea06e53640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fea000d3450 con 0x7fea000d11d0 2024-09-11T22:16:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.391+0000 7fea06e53640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fea000cfd70 con 0x7fea00161d30 2024-09-11T22:16:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.391+0000 7fea04bef640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea00161d30 0x7fea000cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.391+0000 7fea053f0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fea000d11d0 0x7fea000d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.391+0000 7fea04bef640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea00161d30 0x7fea000cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:48294/0 (socket says 172.21.15.50:48294) 2024-09-11T22:16:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.391+0000 7fea04bef640 1 -- 172.21.15.50:0/1108883450 learned_addr learned my addr 172.21.15.50:0/1108883450 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.391+0000 7fe9fffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fea000b78f0 0x7fea00162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:35398/0 (socket says 172.21.15.50:35398) 2024-09-11T22:16:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.392+0000 7fea04bef640 1 -- 172.21.15.50:0/1108883450 >> v2:172.21.15.77:3300/0 conn(0x7fea000d11d0 msgr2=0x7fea000d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.392+0000 7fea04bef640 1 --2- 172.21.15.50:0/1108883450 >> v2:172.21.15.77:3300/0 conn(0x7fea000d11d0 0x7fea000d1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.392+0000 7fea04bef640 1 -- 172.21.15.50:0/1108883450 >> v1:172.21.15.77:6789/0 conn(0x7fea000b78f0 legacy=0x7fea00162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.392+0000 7fea04bef640 1 -- 172.21.15.50:0/1108883450 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea000d2b20 con 0x7fea00161d30 2024-09-11T22:16:01.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.392+0000 7fe9ff7fe640 1 -- 172.21.15.50:0/1108883450 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345423265 0 0) 0x7fea00162110 con 0x7fea000b78f0 2024-09-11T22:16:01.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.392+0000 7fea04bef640 1 --2- 172.21.15.50:0/1108883450 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea00161d30 0x7fea000cf790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009870 tx=0x7fe9f002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a434c5a8789907 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.393+0000 7fe9ff7fe640 1 -- 172.21.15.50:0/1108883450 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0037070 con 0x7fea00161d30 2024-09-11T22:16:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.393+0000 7fe9ff7fe640 1 -- 172.21.15.50:0/1108883450 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f0032440 con 0x7fea00161d30 2024-09-11T22:16:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.393+0000 7fe9ff7fe640 1 -- 172.21.15.50:0/1108883450 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0032810 con 0x7fea00161d30 2024-09-11T22:16:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.393+0000 7fea06e53640 1 -- 172.21.15.50:0/1108883450 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea00161d30 msgr2=0x7fea000cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.393+0000 7fea06e53640 1 --2- 172.21.15.50:0/1108883450 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea00161d30 0x7fea000cf790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009870 tx=0x7fe9f002a270 comp rx=0 tx=0).stop 2024-09-11T22:16:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.393+0000 7fea06e53640 1 -- 172.21.15.50:0/1108883450 shutdown_connections 2024-09-11T22:16:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.393+0000 7fea06e53640 1 --2- 172.21.15.50:0/1108883450 >> v2:172.21.15.77:3300/0 conn(0x7fea000d11d0 0x7fea000d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.393+0000 7fea06e53640 1 --2- 172.21.15.50:0/1108883450 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea00161d30 0x7fea000cf790 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.393+0000 7fea06e53640 1 -- 172.21.15.50:0/1108883450 >> 172.21.15.50:0/1108883450 conn(0x7fea000727a0 msgr2=0x7fea000679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.393+0000 7fea06e53640 1 -- 172.21.15.50:0/1108883450 shutdown_connections 2024-09-11T22:16:01.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.393+0000 7fea06e53640 1 -- 172.21.15.50:0/1108883450 wait complete. 2024-09-11T22:16:01.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.394+0000 7fea06e53640 1 Processor -- start 2024-09-11T22:16:01.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.395+0000 7fea06e53640 1 -- start start 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.395+0000 7fea06e53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea000b78f0 0x7fea000b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.395+0000 7fea06e53640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea000d11d0 0x7fea000cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.395+0000 7fea06e53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea00161d30 0x7fea000c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.395+0000 7fea06e53640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea000b7d30 con 0x7fea000b78f0 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.395+0000 7fea06e53640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea000d30e0 con 0x7fea00161d30 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.395+0000 7fea06e53640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fea000d38e0 con 0x7fea000d11d0 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fea04bef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea000b78f0 0x7fea000b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fea04bef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea000b78f0 0x7fea000b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36864/0 (socket says 172.21.15.50:36864) 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fea04bef640 1 -- 172.21.15.50:0/1484170692 learned_addr learned my addr 172.21.15.50:0/1484170692 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fe9fffff640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea000d11d0 0x7fea000cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fea053f0640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea00161d30 0x7fea000c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fea04bef640 1 -- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea000d11d0 msgr2=0x7fea000cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fea04bef640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea000d11d0 0x7fea000cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fea04bef640 1 -- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea00161d30 msgr2=0x7fea000c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fea04bef640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea00161d30 0x7fea000c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fea04bef640 1 -- 172.21.15.50:0/1484170692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea000b5780 con 0x7fea000b78f0 2024-09-11T22:16:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fea04bef640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea000b78f0 0x7fea000b6520 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00090b0 tx=0x7fe9f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fe9fd7fa640 1 -- 172.21.15.50:0/1484170692 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0041020 con 0x7fea000b78f0 2024-09-11T22:16:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fe9fd7fa640 1 -- 172.21.15.50:0/1484170692 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f0030660 con 0x7fea000b78f0 2024-09-11T22:16:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fe9fd7fa640 1 -- 172.21.15.50:0/1484170692 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0037040 con 0x7fea000b78f0 2024-09-11T22:16:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fea06e53640 1 -- 172.21.15.50:0/1484170692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea000b5a60 con 0x7fea000b78f0 2024-09-11T22:16:01.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.396+0000 7fea06e53640 1 -- 172.21.15.50:0/1484170692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea000b6020 con 0x7fea000b78f0 2024-09-11T22:16:01.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.398+0000 7fe9fd7fa640 1 -- 172.21.15.50:0/1484170692 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9f0044020 con 0x7fea000b78f0 2024-09-11T22:16:01.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.399+0000 7fe9fd7fa640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe9ec06be30 0x7fe9ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.399+0000 7fe9fd7fa640 1 -- 172.21.15.50:0/1484170692 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7fe9f00ab5a0 con 0x7fea000b78f0 2024-09-11T22:16:01.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.399+0000 7fe9fffff640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe9ec06be30 0x7fe9ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.399+0000 7fea09bf2740 1 Processor -- start 2024-09-11T22:16:01.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.399+0000 7fe9fffff640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe9ec06be30 0x7fe9ec06e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4000f60 tx=0x7fe9f4007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.400+0000 7fea09bf2740 1 -- start start 2024-09-11T22:16:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.400+0000 7fea09bf2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 0x55bc60ec30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.400+0000 7fea09bf2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60e7b0e0 0x55bc60e7dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.400+0000 7fea09bf2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 0x55bc60e781a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.400+0000 7fea09bf2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bc60de06f0 con 0x55bc60e7d920 2024-09-11T22:16:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.400+0000 7fea09bf2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55bc60d88330 con 0x55bc60e7b0e0 2024-09-11T22:16:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.400+0000 7fea09bf2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55bc60ddc6b0 con 0x55bc60e7f0b0 2024-09-11T22:16:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.400+0000 7fea04bef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 0x55bc60ec30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.400+0000 7fea04bef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 0x55bc60ec30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36878/0 (socket says 172.21.15.50:36878) 2024-09-11T22:16:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.400+0000 7fea04bef640 1 -- 172.21.15.50:0/2641833495 learned_addr learned my addr 172.21.15.50:0/2641833495 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.400+0000 7fe9fffff640 1 --2- 172.21.15.50:0/2641833495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60e7b0e0 0x55bc60e7dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.400+0000 7fea053f0640 1 --2- 172.21.15.50:0/2641833495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 0x55bc60e781a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.401+0000 7fea04bef640 1 -- 172.21.15.50:0/2641833495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 msgr2=0x55bc60e781a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.401+0000 7fea04bef640 1 --2- 172.21.15.50:0/2641833495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 0x55bc60e781a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.401+0000 7fea04bef640 1 -- 172.21.15.50:0/2641833495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60e7b0e0 msgr2=0x55bc60e7dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.401+0000 7fea04bef640 1 --2- 172.21.15.50:0/2641833495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60e7b0e0 0x55bc60e7dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.401+0000 7fea04bef640 1 -- 172.21.15.50:0/2641833495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc60dae0d0 con 0x55bc60e7d920 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.401+0000 7fea04bef640 1 --2- 172.21.15.50:0/2641833495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 0x55bc60ec30c0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00a9a50 tx=0x7fe9f00791c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a02c0b24d69228f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.401+0000 7fe9e67fc640 1 -- 172.21.15.50:0/2641833495 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00800c0 con 0x55bc60e7d920 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.401+0000 7fe9e67fc640 1 -- 172.21.15.50:0/2641833495 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f0082390 con 0x55bc60e7d920 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.401+0000 7fe9e67fc640 1 -- 172.21.15.50:0/2641833495 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0075ed0 con 0x55bc60e7d920 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.401+0000 7fea09bf2740 1 -- 172.21.15.50:0/2641833495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 msgr2=0x55bc60ec30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.401+0000 7fea09bf2740 1 --2- 172.21.15.50:0/2641833495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 0x55bc60ec30c0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00a9a50 tx=0x7fe9f00791c0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.402+0000 7fea09bf2740 1 -- 172.21.15.50:0/2641833495 shutdown_connections 2024-09-11T22:16:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.402+0000 7fea09bf2740 1 --2- 172.21.15.50:0/2641833495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 0x55bc60e781a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.402+0000 7fea09bf2740 1 --2- 172.21.15.50:0/2641833495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60e7b0e0 0x55bc60e7dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.402+0000 7fea09bf2740 1 --2- 172.21.15.50:0/2641833495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 0x55bc60ec30c0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.402+0000 7fea09bf2740 1 -- 172.21.15.50:0/2641833495 >> 172.21.15.50:0/2641833495 conn(0x55bc60e7a370 msgr2=0x55bc60ec2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.402+0000 7fea09bf2740 1 -- 172.21.15.50:0/2641833495 shutdown_connections 2024-09-11T22:16:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.402+0000 7fea09bf2740 1 -- 172.21.15.50:0/2641833495 wait complete. 2024-09-11T22:16:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.402+0000 7fea09bf2740 1 -- start start 2024-09-11T22:16:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.402+0000 7fea09bf2740 1 Processor -- start 2024-09-11T22:16:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea09bf2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 0x55bc60e9d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea09bf2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 0x55bc60ed2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea09bf2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60ebfed0 0x55bc60e9e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea09bf2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bc60de06f0 con 0x55bc60e7d920 2024-09-11T22:16:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea09bf2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55bc60d694f0 con 0x55bc60ebfed0 2024-09-11T22:16:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea09bf2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55bc60e79810 con 0x55bc60e7f0b0 2024-09-11T22:16:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea09bf2740 10 client.0 _ll_register_callbacks cb 0x55bc60d8ab50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea04bef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 0x55bc60e9d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea04bef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 0x55bc60e9d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36890/0 (socket says 172.21.15.50:36890) 2024-09-11T22:16:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea04bef640 1 -- 172.21.15.50:0/506342416 learned_addr learned my addr 172.21.15.50:0/506342416 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fe9fffff640 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 0x55bc60ed2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea053f0640 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60ebfed0 0x55bc60e9e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea04bef640 1 -- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 msgr2=0x55bc60ed2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea04bef640 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 0x55bc60ed2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea04bef640 1 -- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60ebfed0 msgr2=0x55bc60e9e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea04bef640 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60ebfed0 0x55bc60e9e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea04bef640 1 -- 172.21.15.50:0/506342416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc60bbd7d0 con 0x55bc60e7d920 2024-09-11T22:16:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fea053f0640 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60ebfed0 0x55bc60e9e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.403+0000 7fe9fffff640 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 0x55bc60ed2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fea04bef640 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 0x55bc60e9d2e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe9f002a2b0 tx=0x7fe9f00ab070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ba1af1ed995ec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fe9df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:16:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fe9df7fe640 1 -- 172.21.15.50:0/506342416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00a8060 con 0x55bc60e7d920 2024-09-11T22:16:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fe9df7fe640 1 -- 172.21.15.50:0/506342416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7fe9f0075ed0 con 0x55bc60e7d920 2024-09-11T22:16:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fea09bf2740 1 -- 172.21.15.50:0/506342416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9f0082390 con 0x55bc60e7d920 2024-09-11T22:16:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fe9df7fe640 1 -- 172.21.15.50:0/506342416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fe9f009d050 con 0x55bc60e7d920 2024-09-11T22:16:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fea09bf2740 10 client.7302 fetch_fsmap learned FSMap version 63 2024-09-11T22:16:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fea09bf2740 1 -- 172.21.15.50:0/506342416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x55bc60af33f0 con 0x55bc60e7d920 2024-09-11T22:16:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fe9df7fe640 1 -- 172.21.15.50:0/506342416 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f0082390 con 0x55bc60e7d920 2024-09-11T22:16:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fe9df7fe640 1 -- 172.21.15.50:0/506342416 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7fe9f003a030 con 0x55bc60e7d920 2024-09-11T22:16:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fea09bf2740 10 client.7302 fetch_fsmap finished waiting for FSMap version 63 2024-09-11T22:16:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fea09bf2740 10 client.7302 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2024-09-11T22:16:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fea09bf2740 20 client.7302 populate_metadata read hostname 'smithi050' 2024-09-11T22:16:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fea09bf2740 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x55bc60ed6090 0x55bc60ed64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fea09bf2740 4 client.7302 mds_command: new command op to 7110 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fea09bf2740 1 -- 172.21.15.50:0/506342416 --> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc60dede20 con 0x55bc60ed6090 2024-09-11T22:16:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.404+0000 7fe9fffff640 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x55bc60ed6090 0x55bc60ed64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.405+0000 7fe9fffff640 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x55bc60ed6090 0x55bc60ed64e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f570bcf3234ac523 server_cookie=11d3a29bf3632908 in_seq=0 out_seq=0 2024-09-11T22:16:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.405+0000 7fe9df7fe640 10 client.7302 ms_handle_connect on v2:172.21.15.77:6834/1549905387 2024-09-11T22:16:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.405+0000 7fe9df7fe640 1 -- 172.21.15.50:0/506342416 <== mds.0 v2:172.21.15.77:6834/1549905387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc60dede20 con 0x55bc60ed6090 2024-09-11T22:16:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.405+0000 7fe9df7fe640 10 client.7302 handle_command_reply: tid=0 2024-09-11T22:16:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.405+0000 7fea09bf2740 1 client.7302 shutdown 2024-09-11T22:16:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.406+0000 7fea09bf2740 1 -- 172.21.15.50:0/506342416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 msgr2=0x55bc60e9d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.406+0000 7fea09bf2740 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 0x55bc60e9d2e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe9f002a2b0 tx=0x7fe9f00ab070 comp rx=0 tx=0).stop 2024-09-11T22:16:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.406+0000 7fea09bf2740 1 -- 172.21.15.50:0/506342416 shutdown_connections 2024-09-11T22:16:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.406+0000 7fea09bf2740 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x55bc60ed6090 0x55bc60ed64e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.406+0000 7fea09bf2740 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 0x55bc60ed2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.406+0000 7fea09bf2740 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60ebfed0 0x55bc60e9e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.406+0000 7fe9df7fe640 0 client.7302 ms_handle_reset on v2:172.21.15.77:6834/1549905387 2024-09-11T22:16:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.406+0000 7fea09bf2740 1 --2- 172.21.15.50:0/506342416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7d920 0x55bc60e9d2e0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.406+0000 7fea09bf2740 1 -- 172.21.15.50:0/506342416 >> 172.21.15.50:0/506342416 conn(0x55bc60e7b0e0 msgr2=0x55bc60ec0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.406+0000 7fea09bf2740 1 -- 172.21.15.50:0/506342416 shutdown_connections 2024-09-11T22:16:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.406+0000 7fea09bf2740 1 -- 172.21.15.50:0/506342416 wait complete. 2024-09-11T22:16:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.406+0000 7fea09bf2740 20 client.7302 trim_cache size 0 max 16384 2024-09-11T22:16:01.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.420+0000 7fea09bf2740 1 Processor -- start 2024-09-11T22:16:01.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.420+0000 7fea09bf2740 1 -- start start 2024-09-11T22:16:01.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fea09bf2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7d920 0x55bc60e9dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fea09bf2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7f0b0 0x55bc60ee67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fea09bf2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60ebfed0 0x55bc60ee6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fea09bf2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea00200c10 con 0x55bc60e7f0b0 2024-09-11T22:16:01.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fea09bf2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea001ffc90 con 0x55bc60ebfed0 2024-09-11T22:16:01.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fea09bf2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fea001feff0 con 0x55bc60e7d920 2024-09-11T22:16:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fe9fffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7f0b0 0x55bc60ee67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fe9fffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7f0b0 0x55bc60ee67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36898/0 (socket says 172.21.15.50:36898) 2024-09-11T22:16:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fe9fffff640 1 -- 172.21.15.50:0/495959782 learned_addr learned my addr 172.21.15.50:0/495959782 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fea04bef640 1 --2- 172.21.15.50:0/495959782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7d920 0x55bc60e9dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fea053f0640 1 --2- 172.21.15.50:0/495959782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60ebfed0 0x55bc60ee6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fe9fffff640 1 -- 172.21.15.50:0/495959782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7d920 msgr2=0x55bc60e9dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fe9fffff640 1 --2- 172.21.15.50:0/495959782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7d920 0x55bc60e9dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fe9fffff640 1 -- 172.21.15.50:0/495959782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60ebfed0 msgr2=0x55bc60ee6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fe9fffff640 1 --2- 172.21.15.50:0/495959782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60ebfed0 0x55bc60ee6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fe9fffff640 1 -- 172.21.15.50:0/495959782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc60ab30f0 con 0x55bc60e7f0b0 2024-09-11T22:16:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.421+0000 7fea053f0640 1 --2- 172.21.15.50:0/495959782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60ebfed0 0x55bc60ee6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.422+0000 7fe9fffff640 1 --2- 172.21.15.50:0/495959782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7f0b0 0x55bc60ee67f0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fea00068730 tx=0x7fe9f4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e869a8db3ff6a0d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.422+0000 7fe9e5ffb640 1 -- 172.21.15.50:0/495959782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4001cc0 con 0x55bc60e7f0b0 2024-09-11T22:16:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.422+0000 7fe9e5ffb640 1 -- 172.21.15.50:0/495959782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f40240d0 con 0x55bc60e7f0b0 2024-09-11T22:16:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.422+0000 7fe9e5ffb640 1 -- 172.21.15.50:0/495959782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4024db0 con 0x55bc60e7f0b0 2024-09-11T22:16:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.422+0000 7fea09bf2740 1 -- 172.21.15.50:0/495959782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7f0b0 msgr2=0x55bc60ee67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.422+0000 7fea09bf2740 1 --2- 172.21.15.50:0/495959782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7f0b0 0x55bc60ee67f0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fea00068730 tx=0x7fe9f4013000 comp rx=0 tx=0).stop 2024-09-11T22:16:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.422+0000 7fea09bf2740 1 -- 172.21.15.50:0/495959782 shutdown_connections 2024-09-11T22:16:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.422+0000 7fea09bf2740 1 --2- 172.21.15.50:0/495959782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60ebfed0 0x55bc60ee6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.422+0000 7fea09bf2740 1 --2- 172.21.15.50:0/495959782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60e7f0b0 0x55bc60ee67f0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.422+0000 7fea09bf2740 1 --2- 172.21.15.50:0/495959782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7d920 0x55bc60e9dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.422+0000 7fea09bf2740 1 -- 172.21.15.50:0/495959782 >> 172.21.15.50:0/495959782 conn(0x55bc60e7b0e0 msgr2=0x55bc60ea5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.422+0000 7fea09bf2740 1 -- 172.21.15.50:0/495959782 shutdown_connections 2024-09-11T22:16:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.422+0000 7fea09bf2740 1 -- 172.21.15.50:0/495959782 wait complete. 2024-09-11T22:16:01.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.423+0000 7fea09bf2740 1 -- start start 2024-09-11T22:16:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.423+0000 7fea09bf2740 1 Processor -- start 2024-09-11T22:16:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea09bf2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60e7d920 0x55bc60ed9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea09bf2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 0x55bc60ed9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea09bf2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60ebfed0 0x55bc60f40f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea09bf2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bc60d9deb0 con 0x55bc60ebfed0 2024-09-11T22:16:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea09bf2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea001ff640 con 0x55bc60e7d920 2024-09-11T22:16:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea09bf2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55bc60ed1cf0 con 0x55bc60e7f0b0 2024-09-11T22:16:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea09bf2740 10 client.0 _ll_register_callbacks cb 0x7fe9f0090070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea053f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60ebfed0 0x55bc60f40f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea053f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60ebfed0 0x55bc60f40f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36908/0 (socket says 172.21.15.50:36908) 2024-09-11T22:16:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea053f0640 1 -- 172.21.15.50:0/2257046659 learned_addr learned my addr 172.21.15.50:0/2257046659 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea04bef640 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60e7d920 0x55bc60ed9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fe9fffff640 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 0x55bc60ed9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea053f0640 1 -- 172.21.15.50:0/2257046659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 msgr2=0x55bc60ed9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea053f0640 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 0x55bc60ed9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea053f0640 1 -- 172.21.15.50:0/2257046659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60e7d920 msgr2=0x55bc60ed9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea053f0640 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60e7d920 0x55bc60ed9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea053f0640 1 -- 172.21.15.50:0/2257046659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc60f444d0 con 0x55bc60ebfed0 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea04bef640 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60e7d920 0x55bc60ed9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fea053f0640 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60ebfed0 0x55bc60f40f20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8004630 tx=0x7fe9f8004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52fe483c1ca0f24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.424+0000 7fe9df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fe9df7fe640 1 -- 172.21.15.50:0/2257046659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8018d90 con 0x55bc60ebfed0 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fe9df7fe640 1 -- 172.21.15.50:0/2257046659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7fe9f8022b10 con 0x55bc60ebfed0 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fea09bf2740 1 -- 172.21.15.50:0/2257046659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9f40240d0 con 0x55bc60ebfed0 2024-09-11T22:16:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fe9df7fe640 1 -- 172.21.15.50:0/2257046659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fe9f8022d10 con 0x55bc60ebfed0 2024-09-11T22:16:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fea09bf2740 10 client.7308 fetch_fsmap learned FSMap version 63 2024-09-11T22:16:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fea09bf2740 1 -- 172.21.15.50:0/2257046659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x55bc60ea5b20 con 0x55bc60ebfed0 2024-09-11T22:16:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fe9df7fe640 1 -- 172.21.15.50:0/2257046659 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f40240d0 con 0x55bc60ebfed0 2024-09-11T22:16:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fe9df7fe640 1 -- 172.21.15.50:0/2257046659 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7fe9f8029050 con 0x55bc60ebfed0 2024-09-11T22:16:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fea09bf2740 10 client.7308 fetch_fsmap finished waiting for FSMap version 63 2024-09-11T22:16:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fea09bf2740 10 client.7308 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2024-09-11T22:16:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fea09bf2740 20 client.7308 populate_metadata read hostname 'smithi050' 2024-09-11T22:16:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fea09bf2740 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x55bc60f41460 0x55bc60f41870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fea09bf2740 4 client.7308 mds_command: new command op to 7110 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:16:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fea09bf2740 1 -- 172.21.15.50:0/2257046659 --> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc60de8170 con 0x55bc60f41460 2024-09-11T22:16:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.425+0000 7fea04bef640 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x55bc60f41460 0x55bc60f41870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.426+0000 7fe9df7fe640 10 client.7308 ms_handle_connect on v2:172.21.15.77:6834/1549905387 2024-09-11T22:16:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.426+0000 7fea04bef640 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x55bc60f41460 0x55bc60f41870 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=685263e350efbbde server_cookie=522a4dec661be6be in_seq=0 out_seq=0 2024-09-11T22:16:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.437+0000 7fe9df7fe640 1 -- 172.21.15.50:0/2257046659 <== mds.0 v2:172.21.15.77:6834/1549905387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bc60de8170 con 0x55bc60f41460 2024-09-11T22:16:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.437+0000 7fe9df7fe640 10 client.7308 handle_command_reply: tid=0 2024-09-11T22:16:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.437+0000 7fea09bf2740 1 client.7308 shutdown 2024-09-11T22:16:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea09bf2740 1 -- 172.21.15.50:0/2257046659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60ebfed0 msgr2=0x55bc60f40f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea09bf2740 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60ebfed0 0x55bc60f40f20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8004630 tx=0x7fe9f8004660 comp rx=0 tx=0).stop 2024-09-11T22:16:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea09bf2740 1 -- 172.21.15.50:0/2257046659 shutdown_connections 2024-09-11T22:16:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea09bf2740 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.77:6834/1549905387,v1:172.21.15.77:6836/1549905387] conn(0x55bc60f41460 0x55bc60f41870 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea09bf2740 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc60e7f0b0 0x55bc60ed9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea09bf2740 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bc60ebfed0 0x55bc60f40f20 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fe9df7fe640 0 client.7308 ms_handle_reset on v2:172.21.15.77:6834/1549905387 2024-09-11T22:16:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea09bf2740 1 --2- 172.21.15.50:0/2257046659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc60e7d920 0x55bc60ed9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea09bf2740 1 -- 172.21.15.50:0/2257046659 >> 172.21.15.50:0/2257046659 conn(0x55bc60e7b0e0 msgr2=0x55bc60edc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea09bf2740 1 -- 172.21.15.50:0/2257046659 shutdown_connections 2024-09-11T22:16:01.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea09bf2740 1 -- 172.21.15.50:0/2257046659 wait complete. 2024-09-11T22:16:01.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea09bf2740 20 client.7308 trim_cache size 0 max 16384 2024-09-11T22:16:01.440 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:16:01.440 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:16:01.440 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:16:01.440 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:16:01.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea06e53640 1 -- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe9ec06be30 msgr2=0x7fe9ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea06e53640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe9ec06be30 0x7fe9ec06e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4000f60 tx=0x7fe9f4007d50 comp rx=0 tx=0).stop 2024-09-11T22:16:01.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea06e53640 1 -- 172.21.15.50:0/1484170692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea000b78f0 msgr2=0x7fea000b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.438+0000 7fea06e53640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea000b78f0 0x7fea000b6520 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00090b0 tx=0x7fe9f00046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.439+0000 7fea06e53640 1 -- 172.21.15.50:0/1484170692 shutdown_connections 2024-09-11T22:16:01.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.439+0000 7fea06e53640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe9ec06be30 0x7fe9ec06e2f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.439+0000 7fea06e53640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea000d11d0 0x7fea000cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.439+0000 7fea06e53640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea00161d30 0x7fea000c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.439+0000 7fea06e53640 1 --2- 172.21.15.50:0/1484170692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea000b78f0 0x7fea000b6520 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.439+0000 7fea06e53640 1 -- 172.21.15.50:0/1484170692 >> 172.21.15.50:0/1484170692 conn(0x7fea000727a0 msgr2=0x7fea000cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:01.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.439+0000 7fea06e53640 1 -- 172.21.15.50:0/1484170692 shutdown_connections 2024-09-11T22:16:01.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.439+0000 7fea06e53640 1 -- 172.21.15.50:0/1484170692 wait complete. 2024-09-11T22:16:01.450 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:16:01.450 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:16:01.451 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:16:01.451 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:16:01.451 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:16:01.451 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:16:01.452 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:16:01.452 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:16:01.462 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:16:01.462 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-11T22:16:01.463 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:16:01.463 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-11T22:16:01.464 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:16:01.464 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-11T22:16:01.465 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:16:01.465 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-11T22:16:01.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.611+0000 7f7278067640 1 Processor -- start 2024-09-11T22:16:01.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.611+0000 7f0b35cc3640 1 Processor -- start 2024-09-11T22:16:01.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.611+0000 7f82c86e4640 1 Processor -- start 2024-09-11T22:16:01.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.611+0000 7f0b35cc3640 1 -- start start 2024-09-11T22:16:01.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.611+0000 7f7278067640 1 -- start start 2024-09-11T22:16:01.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.611+0000 7f82c86e4640 1 -- start start 2024-09-11T22:16:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.611+0000 7f5dec53b640 1 Processor -- start 2024-09-11T22:16:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.611+0000 7f5dec53b640 1 -- start start 2024-09-11T22:16:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.612+0000 7f0b35cc3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b300d18a0 0x7f0b300d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.612+0000 7f0b35cc3640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b300d3a30 0x7f0b300b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.612+0000 7f0b35cc3640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b300cfa80 con 0x7f0b3015e870 2024-09-11T22:16:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.612+0000 7f0b35cc3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0b300d3ea0 con 0x7f0b300d18a0 2024-09-11T22:16:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.612+0000 7f0b35cc3640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0b300d40d0 con 0x7f0b300d3a30 2024-09-11T22:16:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.612+0000 7f0b2effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b300d18a0 0x7f0b300d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.612+0000 7f0b2effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b300d18a0 0x7f0b300d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36916/0 (socket says 172.21.15.50:36916) 2024-09-11T22:16:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.612+0000 7f0b2effd640 1 -- 172.21.15.50:0/67097992 learned_addr learned my addr 172.21.15.50:0/67097992 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.612+0000 7f82c86e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82c015c000 0x7f82c006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.612+0000 7f82c86e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f82c00680d0 0x7f82c015fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.612+0000 7f82c86e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c0162ed0 con 0x7f82c015c3e0 2024-09-11T22:16:01.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.612+0000 7f82c86e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f82c01631b0 con 0x7f82c00680d0 2024-09-11T22:16:01.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.612+0000 7f82c86e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f82c006e290 con 0x7f82c015c000 2024-09-11T22:16:01.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f0b2ffff640 1 --2- 172.21.15.50:0/67097992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b300d3a30 0x7f0b300b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f82c6480640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82c015c000 0x7f82c006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f82c6480640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82c015c000 0x7f82c006ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:48360/0 (socket says 172.21.15.50:48360) 2024-09-11T22:16:01.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f82c6480640 1 -- 172.21.15.50:0/2772175318 learned_addr learned my addr 172.21.15.50:0/2772175318 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f82c6c81640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f82c00680d0 0x7f82c015fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f82c5c7f640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f82c015c3e0 0x7f82c00679c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:35420/0 (socket says 172.21.15.50:35420) 2024-09-11T22:16:01.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f0b2effd640 1 -- 172.21.15.50:0/67097992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b300d3a30 msgr2=0x7f0b300b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:01.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f7278067640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f727015aad0 0x7f7270072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f7278067640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727015bb00 0x7f727006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f0b2effd640 1 --2- 172.21.15.50:0/67097992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b300d3a30 0x7f0b300b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f0b2effd640 1 -- 172.21.15.50:0/67097992 >> v1:172.21.15.77:6789/0 conn(0x7f0b3015e870 legacy=0x7f0b300d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f5dec53b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5de4158c80 0x7f5de40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f0b2effd640 1 -- 172.21.15.50:0/67097992 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b300d43b0 con 0x7f0b300d18a0 2024-09-11T22:16:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f0b2ffff640 1 --2- 172.21.15.50:0/67097992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b300d3a30 0x7f0b300b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:01.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f82c6480640 1 -- 172.21.15.50:0/2772175318 >> v2:172.21.15.77:3300/0 conn(0x7f82c00680d0 msgr2=0x7f82c015fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:01.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f82c6480640 1 --2- 172.21.15.50:0/2772175318 >> v2:172.21.15.77:3300/0 conn(0x7f82c00680d0 0x7f82c015fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f82c6480640 1 -- 172.21.15.50:0/2772175318 >> v1:172.21.15.77:6789/0 conn(0x7f82c015c3e0 legacy=0x7f82c00679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f82c6480640 1 -- 172.21.15.50:0/2772175318 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c006e570 con 0x7f82c015c000 2024-09-11T22:16:01.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f5dec53b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de40b3a50 0x7f5de415ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f82c6c81640 1 --2- 172.21.15.50:0/2772175318 >> v2:172.21.15.77:3300/0 conn(0x7f82c00680d0 0x7f82c015fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f5dec53b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de40b5aa0 con 0x7f5de40b5470 2024-09-11T22:16:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f5dec53b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5de4162320 con 0x7f5de4158c80 2024-09-11T22:16:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f5dec53b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5de4162570 con 0x7f5de40b3a50 2024-09-11T22:16:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f5dea2d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5de4158c80 0x7f5de40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f5dea2d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5de4158c80 0x7f5de40b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:47568/0 (socket says 172.21.15.50:47568) 2024-09-11T22:16:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f5dea2d7640 1 -- 172.21.15.50:0/3224024246 learned_addr learned my addr 172.21.15.50:0/3224024246 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f5de9ad6640 1 --1- 172.21.15.50:0/3224024246 >> v1:172.21.15.77:6789/0 conn(0x7f5de40b5470 0x7f5de40b3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:35432/0 (socket says 172.21.15.50:35432) 2024-09-11T22:16:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f5deaad8640 1 --2- 172.21.15.50:0/3224024246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de40b3a50 0x7f5de415ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.613+0000 7f7275e03640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f727015aad0 0x7f7270072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f7275e03640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f727015aad0 0x7f7270072cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36922/0 (socket says 172.21.15.50:36922) 2024-09-11T22:16:01.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f7275e03640 1 -- 172.21.15.50:0/2570991070 learned_addr learned my addr 172.21.15.50:0/2570991070 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f7275602640 1 --2- 172.21.15.50:0/2570991070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727015bb00 0x7f727006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f7278067640 1 -- 172.21.15.50:0/2570991070 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72700b5020 con 0x7f727006d5b0 2024-09-11T22:16:01.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f7278067640 1 -- 172.21.15.50:0/2570991070 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f727006da20 con 0x7f727015aad0 2024-09-11T22:16:01.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f7278067640 1 -- 172.21.15.50:0/2570991070 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f72700b4410 con 0x7f727015bb00 2024-09-11T22:16:01.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f5dea2d7640 1 -- 172.21.15.50:0/3224024246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de40b3a50 msgr2=0x7f5de415ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:01.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f5dea2d7640 1 --2- 172.21.15.50:0/3224024246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de40b3a50 0x7f5de415ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f5de92d5640 1 -- 172.21.15.50:0/3224024246 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1705429894 0 0) 0x7f5de40b5aa0 con 0x7f5de40b5470 2024-09-11T22:16:01.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f5dea2d7640 1 -- 172.21.15.50:0/3224024246 >> v1:172.21.15.77:6789/0 conn(0x7f5de40b5470 legacy=0x7f5de40b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f5dea2d7640 1 -- 172.21.15.50:0/3224024246 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de4162850 con 0x7f5de4158c80 2024-09-11T22:16:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f7275e03640 1 -- 172.21.15.50:0/2570991070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727015bb00 msgr2=0x7f727006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f7275e03640 1 --2- 172.21.15.50:0/2570991070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727015bb00 0x7f727006d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f7275e03640 1 -- 172.21.15.50:0/2570991070 >> v1:172.21.15.77:6789/0 conn(0x7f727006d5b0 legacy=0x7f727015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f7275e03640 1 -- 172.21.15.50:0/2570991070 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727015aeb0 con 0x7f727015aad0 2024-09-11T22:16:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f7275602640 1 --2- 172.21.15.50:0/2570991070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727015bb00 0x7f727006d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f0b2effd640 1 --2- 172.21.15.50:0/67097992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b300d18a0 0x7f0b300d34f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009870 tx=0x7f0b2402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca662d96cb1524 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f7274e01640 1 -- 172.21.15.50:0/2570991070 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 26453545 0 0) 0x7f72700b5020 con 0x7f727006d5b0 2024-09-11T22:16:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.614+0000 7f82c6480640 1 --2- 172.21.15.50:0/2772175318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82c015c000 0x7f82c006ed70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009870 tx=0x7f82bc02a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f046b40d22967b5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f0b2e7fc640 1 -- 172.21.15.50:0/67097992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24037070 con 0x7f0b300d18a0 2024-09-11T22:16:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f0b2e7fc640 1 -- 172.21.15.50:0/67097992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b24032440 con 0x7f0b300d18a0 2024-09-11T22:16:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f0b2e7fc640 1 -- 172.21.15.50:0/67097992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24032810 con 0x7f0b300d18a0 2024-09-11T22:16:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f82c547e640 1 -- 172.21.15.50:0/2772175318 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc037070 con 0x7f82c015c000 2024-09-11T22:16:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f82c547e640 1 -- 172.21.15.50:0/2772175318 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82bc02ad60 con 0x7f82c015c000 2024-09-11T22:16:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f82c547e640 1 -- 172.21.15.50:0/2772175318 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc032660 con 0x7f82c015c000 2024-09-11T22:16:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f5dea2d7640 1 --2- 172.21.15.50:0/3224024246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de4158c80 0x7f5de40b4f30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009870 tx=0x7f5de002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7119b229579a78c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f5de92d5640 1 -- 172.21.15.50:0/3224024246 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0037070 con 0x7f5de4158c80 2024-09-11T22:16:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f5de92d5640 1 -- 172.21.15.50:0/3224024246 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de0032440 con 0x7f5de4158c80 2024-09-11T22:16:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f5de92d5640 1 -- 172.21.15.50:0/3224024246 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0032810 con 0x7f5de4158c80 2024-09-11T22:16:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f7275e03640 1 --2- 172.21.15.50:0/2570991070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727015aad0 0x7f7270072cb0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f726c009870 tx=0x7f726c02b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a0d87891458746 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f7274e01640 1 -- 172.21.15.50:0/2570991070 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c037070 con 0x7f727015aad0 2024-09-11T22:16:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f7274e01640 1 -- 172.21.15.50:0/2570991070 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f726c030710 con 0x7f727015aad0 2024-09-11T22:16:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f7274e01640 1 -- 172.21.15.50:0/2570991070 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c030ae0 con 0x7f727015aad0 2024-09-11T22:16:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f82c86e4640 1 -- 172.21.15.50:0/2772175318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82c015c000 msgr2=0x7f82c006ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.615+0000 7f82c86e4640 1 --2- 172.21.15.50:0/2772175318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82c015c000 0x7f82c006ed70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009870 tx=0x7f82bc02a0d0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f0b35cc3640 1 -- 172.21.15.50:0/67097992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b300d18a0 msgr2=0x7f0b300d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f0b35cc3640 1 --2- 172.21.15.50:0/67097992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b300d18a0 0x7f0b300d34f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009870 tx=0x7f0b2402a250 comp rx=0 tx=0).stop 2024-09-11T22:16:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f82c86e4640 1 -- 172.21.15.50:0/2772175318 shutdown_connections 2024-09-11T22:16:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f82c86e4640 1 --2- 172.21.15.50:0/2772175318 >> v2:172.21.15.77:3300/0 conn(0x7f82c00680d0 0x7f82c015fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f82c86e4640 1 --2- 172.21.15.50:0/2772175318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82c015c000 0x7f82c006ed70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f82c86e4640 1 -- 172.21.15.50:0/2772175318 >> 172.21.15.50:0/2772175318 conn(0x7f82c0075030 msgr2=0x7f82c006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f0b35cc3640 1 -- 172.21.15.50:0/67097992 shutdown_connections 2024-09-11T22:16:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f82c86e4640 1 -- 172.21.15.50:0/2772175318 shutdown_connections 2024-09-11T22:16:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f0b35cc3640 1 --2- 172.21.15.50:0/67097992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b300d3a30 0x7f0b300b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f0b35cc3640 1 --2- 172.21.15.50:0/67097992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b300d18a0 0x7f0b300d34f0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f0b35cc3640 1 -- 172.21.15.50:0/67097992 >> 172.21.15.50:0/67097992 conn(0x7f0b300727a0 msgr2=0x7f0b300679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f82c86e4640 1 -- 172.21.15.50:0/2772175318 wait complete. 2024-09-11T22:16:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f5dec53b640 1 -- 172.21.15.50:0/3224024246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de4158c80 msgr2=0x7f5de40b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f5dec53b640 1 --2- 172.21.15.50:0/3224024246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de4158c80 0x7f5de40b4f30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009870 tx=0x7f5de002a270 comp rx=0 tx=0).stop 2024-09-11T22:16:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f5dec53b640 1 -- 172.21.15.50:0/3224024246 shutdown_connections 2024-09-11T22:16:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f5dec53b640 1 --2- 172.21.15.50:0/3224024246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de40b3a50 0x7f5de415ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f5dec53b640 1 --2- 172.21.15.50:0/3224024246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de4158c80 0x7f5de40b4f30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f5dec53b640 1 -- 172.21.15.50:0/3224024246 >> 172.21.15.50:0/3224024246 conn(0x7f5de4074c40 msgr2=0x7f5de4075020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f5dec53b640 1 -- 172.21.15.50:0/3224024246 shutdown_connections 2024-09-11T22:16:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f5dec53b640 1 -- 172.21.15.50:0/3224024246 wait complete. 2024-09-11T22:16:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f7278067640 1 -- 172.21.15.50:0/2570991070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727015aad0 msgr2=0x7f7270072cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f7278067640 1 --2- 172.21.15.50:0/2570991070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727015aad0 0x7f7270072cb0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f726c009870 tx=0x7f726c02b480 comp rx=0 tx=0).stop 2024-09-11T22:16:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f0b35cc3640 1 -- 172.21.15.50:0/67097992 shutdown_connections 2024-09-11T22:16:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f0b35cc3640 1 -- 172.21.15.50:0/67097992 wait complete. 2024-09-11T22:16:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f7278067640 1 -- 172.21.15.50:0/2570991070 shutdown_connections 2024-09-11T22:16:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f7278067640 1 --2- 172.21.15.50:0/2570991070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727015bb00 0x7f727006d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f7278067640 1 --2- 172.21.15.50:0/2570991070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727015aad0 0x7f7270072cb0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.616+0000 7f7278067640 1 -- 172.21.15.50:0/2570991070 >> 172.21.15.50:0/2570991070 conn(0x7f72700679c0 msgr2=0x7f7270067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.617+0000 7f7278067640 1 -- 172.21.15.50:0/2570991070 shutdown_connections 2024-09-11T22:16:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.617+0000 7f7278067640 1 -- 172.21.15.50:0/2570991070 wait complete. 2024-09-11T22:16:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.617+0000 7f82c86e4640 1 Processor -- start 2024-09-11T22:16:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.617+0000 7f82c86e4640 1 -- start start 2024-09-11T22:16:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f0b35cc3640 1 Processor -- start 2024-09-11T22:16:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f7278067640 1 Processor -- start 2024-09-11T22:16:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f0b35cc3640 1 -- start start 2024-09-11T22:16:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f7278067640 1 -- start start 2024-09-11T22:16:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f5dec53b640 1 Processor -- start 2024-09-11T22:16:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f5dec53b640 1 -- start start 2024-09-11T22:16:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f82c86e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82c00680d0 0x7f82c0152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f82c86e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c015c000 0x7f82c0156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f82c86e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82c015c3e0 0x7f82c00b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f82c86e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82c006f430 con 0x7f82c015c000 2024-09-11T22:16:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f82c86e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82c006f2b0 con 0x7f82c00680d0 2024-09-11T22:16:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f82c86e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f82c0160320 con 0x7f82c015c3e0 2024-09-11T22:16:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f82c5c7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c015c000 0x7f82c0156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f82c5c7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c015c000 0x7f82c0156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36938/0 (socket says 172.21.15.50:36938) 2024-09-11T22:16:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.618+0000 7f82c5c7f640 1 -- 172.21.15.50:0/9510910 learned_addr learned my addr 172.21.15.50:0/9510910 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f82c6c81640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82c015c3e0 0x7f82c00b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f82c6480640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82c00680d0 0x7f82c0152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f82c5c7f640 1 -- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82c015c3e0 msgr2=0x7f82c00b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f82c5c7f640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82c015c3e0 0x7f82c00b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f82c5c7f640 1 -- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82c00680d0 msgr2=0x7f82c0152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f82c5c7f640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82c00680d0 0x7f82c0152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f82c5c7f640 1 -- 172.21.15.50:0/9510910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c0160eb0 con 0x7f82c015c000 2024-09-11T22:16:01.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f7278067640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727006d5b0 0x7f72700af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f7278067640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727015aad0 0x7f7270129320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f7278067640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f727015bb00 0x7f7270153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f82c5c7f640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c015c000 0x7f82c0156cd0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f82b000c520 tx=0x7f82b000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f7278067640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7270071a90 con 0x7f727006d5b0 2024-09-11T22:16:01.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f7278067640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72700717b0 con 0x7f727015bb00 2024-09-11T22:16:01.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f7275e03640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727006d5b0 0x7f72700af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f7278067640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7270071d70 con 0x7f727015aad0 2024-09-11T22:16:01.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f7275e03640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727006d5b0 0x7f72700af430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36942/0 (socket says 172.21.15.50:36942) 2024-09-11T22:16:01.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f7275e03640 1 -- 172.21.15.50:0/1161976047 learned_addr learned my addr 172.21.15.50:0/1161976047 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f0b35cc3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b300d18a0 0x7f0b3014a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f7276604640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f727015bb00 0x7f7270153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f7275602640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727015aad0 0x7f7270129320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f0b35cc3640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b300d3a30 0x7f0b300cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f5dec53b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de40b3a50 0x7f5de4151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f82b6ffd640 1 -- 172.21.15.50:0/9510910 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0018070 con 0x7f82c015c000 2024-09-11T22:16:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f82b6ffd640 1 -- 172.21.15.50:0/9510910 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b00074e0 con 0x7f82c015c000 2024-09-11T22:16:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.619+0000 7f5dec53b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de40b5470 0x7f5de415e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f7275e03640 1 -- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727015aad0 msgr2=0x7f7270129320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f7275e03640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727015aad0 0x7f7270129320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f82c86e4640 1 -- 172.21.15.50:0/9510910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c0161190 con 0x7f82c015c000 2024-09-11T22:16:01.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5dec53b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de4158c80 0x7f5de40b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f7275e03640 1 -- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f727015bb00 msgr2=0x7f7270153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f7275e03640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f727015bb00 0x7f7270153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f7275e03640 1 -- 172.21.15.50:0/1161976047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72700ca470 con 0x7f727006d5b0 2024-09-11T22:16:01.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f82b6ffd640 1 -- 172.21.15.50:0/9510910 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0004a20 con 0x7f82c015c000 2024-09-11T22:16:01.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5dea2d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de40b3a50 0x7f5de4151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5dec53b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5de4159060 con 0x7f5de40b3a50 2024-09-11T22:16:01.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5dec53b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5de4072e90 con 0x7f5de40b5470 2024-09-11T22:16:01.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5dec53b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5de41591e0 con 0x7f5de4158c80 2024-09-11T22:16:01.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5de9ad6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de40b5470 0x7f5de415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f82c86e4640 1 -- 172.21.15.50:0/9510910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c0161750 con 0x7f82c015c000 2024-09-11T22:16:01.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5dea2d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de40b3a50 0x7f5de4151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36966/0 (socket says 172.21.15.50:36966) 2024-09-11T22:16:01.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5de9ad6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de40b5470 0x7f5de415e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:47584/0 (socket says 172.21.15.50:47584) 2024-09-11T22:16:01.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5de9ad6640 1 -- 172.21.15.50:0/1400628395 learned_addr learned my addr 172.21.15.50:0/1400628395 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b2f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b300d18a0 0x7f0b3014a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b2f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b300d18a0 0x7f0b3014a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36956/0 (socket says 172.21.15.50:36956) 2024-09-11T22:16:01.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b2effd640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b300d3a30 0x7f0b300cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5deaad8640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de4158c80 0x7f5de40b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b2f7fe640 1 -- 172.21.15.50:0/2331680098 learned_addr learned my addr 172.21.15.50:0/2331680098 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:01.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b35cc3640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b3015e870 0x7f0b3014ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b35cc3640 1 -- 172.21.15.50:0/2331680098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3015ec50 con 0x7f0b300d18a0 2024-09-11T22:16:01.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5de9ad6640 1 -- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de4158c80 msgr2=0x7f5de40b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5de9ad6640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de4158c80 0x7f5de40b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5de9ad6640 1 -- 172.21.15.50:0/1400628395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de40b3a50 msgr2=0x7f5de4151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5de9ad6640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de40b3a50 0x7f5de4151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5de9ad6640 1 -- 172.21.15.50:0/1400628395 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de415e770 con 0x7f5de40b5470 2024-09-11T22:16:01.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b35cc3640 1 -- 172.21.15.50:0/2331680098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b300b7ee0 con 0x7f0b3015e870 2024-09-11T22:16:01.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b35cc3640 1 -- 172.21.15.50:0/2331680098 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0b300b78b0 con 0x7f0b300d3a30 2024-09-11T22:16:01.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b2ffff640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b3015e870 0x7f0b3014ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b2effd640 1 -- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b3015e870 msgr2=0x7f0b3014ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f7275e03640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727006d5b0 0x7f72700af430 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f726c000c00 tx=0x7f726c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b2effd640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b3015e870 0x7f0b3014ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f5de9ad6640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de40b5470 0x7f5de415e230 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400c4d0 tx=0x7f5dd400c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b2effd640 1 -- 172.21.15.50:0/2331680098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b300d18a0 msgr2=0x7f0b3014a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:01.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b2effd640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b300d18a0 0x7f0b3014a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:01.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.620+0000 7f0b2effd640 1 -- 172.21.15.50:0/2331680098 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b30160ca0 con 0x7f0b300d3a30 2024-09-11T22:16:01.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f0b2f7fe640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b300d18a0 0x7f0b3014a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:01.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f5ddaffd640 1 -- 172.21.15.50:0/1400628395 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4018070 con 0x7f5de40b5470 2024-09-11T22:16:01.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f5ddaffd640 1 -- 172.21.15.50:0/1400628395 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd40074e0 con 0x7f5de40b5470 2024-09-11T22:16:01.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f5ddaffd640 1 -- 172.21.15.50:0/1400628395 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4004a20 con 0x7f5de40b5470 2024-09-11T22:16:01.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f0b2effd640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b300d3a30 0x7f0b300cb850 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0b300b7340 tx=0x7f0b240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f5dec53b640 1 -- 172.21.15.50:0/1400628395 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de4140d00 con 0x7f5de40b5470 2024-09-11T22:16:01.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f72667fc640 1 -- 172.21.15.50:0/1161976047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c037040 con 0x7f727006d5b0 2024-09-11T22:16:01.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f5dec53b640 1 -- 172.21.15.50:0/1400628395 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de41412c0 con 0x7f5de40b5470 2024-09-11T22:16:01.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f72667fc640 1 -- 172.21.15.50:0/1161976047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f726c032830 con 0x7f727006d5b0 2024-09-11T22:16:01.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f72667fc640 1 -- 172.21.15.50:0/1161976047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c032c00 con 0x7f727006d5b0 2024-09-11T22:16:01.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f7278067640 1 -- 172.21.15.50:0/1161976047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72700ca750 con 0x7f727006d5b0 2024-09-11T22:16:01.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f5deaad8640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de4158c80 0x7f5de40b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:01.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f7278067640 1 -- 172.21.15.50:0/1161976047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72700cad10 con 0x7f727006d5b0 2024-09-11T22:16:01.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f0b17fff640 1 -- 172.21.15.50:0/2331680098 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24041020 con 0x7f0b300d3a30 2024-09-11T22:16:01.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f82c86e4640 1 -- 172.21.15.50:0/9510910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c006c740 con 0x7f82c015c000 2024-09-11T22:16:01.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f0b17fff640 1 -- 172.21.15.50:0/2331680098 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b240307a0 con 0x7f0b300d3a30 2024-09-11T22:16:01.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f0b35cc3640 1 -- 172.21.15.50:0/2331680098 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b30160f80 con 0x7f0b300d3a30 2024-09-11T22:16:01.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f0b17fff640 1 -- 172.21.15.50:0/2331680098 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24037040 con 0x7f0b300d3a30 2024-09-11T22:16:01.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.621+0000 7f0b35cc3640 1 -- 172.21.15.50:0/2331680098 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b30161540 con 0x7f0b300d3a30 2024-09-11T22:16:01.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.622+0000 7f82b6ffd640 1 -- 172.21.15.50:0/9510910 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f82b0004bc0 con 0x7f82c015c000 2024-09-11T22:16:01.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.623+0000 7f5dec53b640 1 -- 172.21.15.50:0/1400628395 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de406cb60 con 0x7f5de40b5470 2024-09-11T22:16:01.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.623+0000 7f7278067640 1 -- 172.21.15.50:0/1161976047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f727015bf50 con 0x7f727006d5b0 2024-09-11T22:16:01.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.623+0000 7f82b6ffd640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f82a406be60 0x7f82a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.623+0000 7f82b6ffd640 1 -- 172.21.15.50:0/9510910 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7f82b008a190 con 0x7f82c015c000 2024-09-11T22:16:01.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.623+0000 7f0b17fff640 1 -- 172.21.15.50:0/2331680098 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b24044020 con 0x7f0b300d3a30 2024-09-11T22:16:01.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.624+0000 7f82c6480640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f82a406be60 0x7f82a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.624+0000 7f0b35cc3640 1 -- 172.21.15.50:0/2331680098 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b10005290 con 0x7f0b300d3a30 2024-09-11T22:16:01.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.624+0000 7f5ddaffd640 1 -- 172.21.15.50:0/1400628395 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5dd401b070 con 0x7f5de40b5470 2024-09-11T22:16:01.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.624+0000 7f72667fc640 1 -- 172.21.15.50:0/1161976047 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f726c03d430 con 0x7f727006d5b0 2024-09-11T22:16:01.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.624+0000 7f0b17fff640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0b1c06be80 0x7f0b1c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.624+0000 7f82c6480640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f82a406be60 0x7f82a406e320 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f82bc034000 tx=0x7f82bc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.624+0000 7f0b17fff640 1 -- 172.21.15.50:0/2331680098 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7f0b240ab5b0 con 0x7f0b300d3a30 2024-09-11T22:16:01.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.624+0000 7f0b2f7fe640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0b1c06be80 0x7f0b1c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.624+0000 7f5ddaffd640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5dc806be80 0x7f5dc806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.624+0000 7f72667fc640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f725406bf00 0x7f725406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:01.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.625+0000 7f5ddaffd640 1 -- 172.21.15.50:0/1400628395 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7f5dd408a1a0 con 0x7f5de40b5470 2024-09-11T22:16:01.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.625+0000 7f5dea2d7640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5dc806be80 0x7f5dc806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.625+0000 7f72667fc640 1 -- 172.21.15.50:0/1161976047 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5738+0+0 (secure 0 0 0) 0x7f726c0ab710 con 0x7f727006d5b0 2024-09-11T22:16:01.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.625+0000 7f7275602640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f725406bf00 0x7f725406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:01.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.625+0000 7f0b2f7fe640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0b1c06be80 0x7f0b1c06e340 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0b301ec330 tx=0x7f0b20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.625+0000 7f7275602640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f725406bf00 0x7f725406e3c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7260009560 tx=0x7f7260009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.625+0000 7f5dea2d7640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5dc806be80 0x7f5dc806e340 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5de0034000 tx=0x7f5de002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:01.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.628+0000 7f82b6ffd640 1 -- 172.21.15.50:0/9510910 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f82b00011d0 con 0x7f82c015c000 2024-09-11T22:16:01.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.629+0000 7f0b17fff640 1 -- 172.21.15.50:0/2331680098 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b2404b030 con 0x7f0b300d3a30 2024-09-11T22:16:01.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.629+0000 7f5ddaffd640 1 -- 172.21.15.50:0/1400628395 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5dd40585c0 con 0x7f5de40b5470 2024-09-11T22:16:01.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.632+0000 7f72667fc640 1 -- 172.21.15.50:0/1161976047 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f726c079ac0 con 0x7f727006d5b0 2024-09-11T22:16:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.878+0000 7f82c86e4640 1 -- 172.21.15.50:0/9510910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f82c006fb90 con 0x7f82c015c000 2024-09-11T22:16:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.879+0000 7f0b35cc3640 1 -- 172.21.15.50:0/2331680098 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f0b10005580 con 0x7f0b300d3a30 2024-09-11T22:16:01.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.898+0000 7f5dec53b640 1 -- 172.21.15.50:0/1400628395 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f5de4160920 con 0x7f5de40b5470 2024-09-11T22:16:01.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:01.900+0000 7f7278067640 1 -- 172.21.15.50:0/1161976047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f72700b5230 con 0x7f727006d5b0 2024-09-11T22:16:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.806+0000 7f82b6ffd640 1 -- 172.21.15.50:0/9510910 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7104 v64) ==== 95+0+0 (secure 0 0 0) 0x7f82b0058430 con 0x7f82c015c000 2024-09-11T22:16:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 7104 2024-09-11T22:16:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.809+0000 7f82c86e4640 1 -- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f82a406be60 msgr2=0x7f82a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.809+0000 7f82c86e4640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f82a406be60 0x7f82a406e320 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f82bc034000 tx=0x7f82bc02e000 comp rx=0 tx=0).stop 2024-09-11T22:16:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.810+0000 7f82c86e4640 1 -- 172.21.15.50:0/9510910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c015c000 msgr2=0x7f82c0156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.810+0000 7f82c86e4640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c015c000 0x7f82c0156cd0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f82b000c520 tx=0x7f82b000c920 comp rx=0 tx=0).stop 2024-09-11T22:16:02.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.810+0000 7f82c86e4640 1 -- 172.21.15.50:0/9510910 shutdown_connections 2024-09-11T22:16:02.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.810+0000 7f82c86e4640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f82a406be60 0x7f82a406e320 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.810+0000 7f82c86e4640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82c015c3e0 0x7f82c00b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.810+0000 7f82c86e4640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82c015c000 0x7f82c0156cd0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.810+0000 7f82c86e4640 1 --2- 172.21.15.50:0/9510910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82c00680d0 0x7f82c0152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.810+0000 7f82c86e4640 1 -- 172.21.15.50:0/9510910 >> 172.21.15.50:0/9510910 conn(0x7f82c0075030 msgr2=0x7f82c00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.810+0000 7f82c86e4640 1 -- 172.21.15.50:0/9510910 shutdown_connections 2024-09-11T22:16:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.810+0000 7f82c86e4640 1 -- 172.21.15.50:0/9510910 wait complete. 2024-09-11T22:16:02.821 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:16:02.821+0000 7f2a090cb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:16:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.822+0000 7f72667fc640 1 -- 172.21.15.50:0/1161976047 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7110 v65) ==== 95+0+0 (secure 0 0 0) 0x7f726c07ddc0 con 0x7f727006d5b0 2024-09-11T22:16:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 7110 2024-09-11T22:16:02.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.825+0000 7f7278067640 1 -- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f725406bf00 msgr2=0x7f725406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.825+0000 7f7278067640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f725406bf00 0x7f725406e3c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7260009560 tx=0x7f7260009190 comp rx=0 tx=0).stop 2024-09-11T22:16:02.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.825+0000 7f7278067640 1 -- 172.21.15.50:0/1161976047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727006d5b0 msgr2=0x7f72700af430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.825+0000 7f7278067640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727006d5b0 0x7f72700af430 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f726c000c00 tx=0x7f726c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.825+0000 7f0b17fff640 1 -- 172.21.15.50:0/2331680098 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7101 v65) ==== 95+0+0 (secure 0 0 0) 0x7f0b24079f20 con 0x7f0b300d3a30 2024-09-11T22:16:02.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.825+0000 7f7278067640 1 -- 172.21.15.50:0/1161976047 shutdown_connections 2024-09-11T22:16:02.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.825+0000 7f7278067640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f725406bf00 0x7f725406e3c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.825+0000 7f7278067640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f727015aad0 0x7f7270129320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.827 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 7101 2024-09-11T22:16:02.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.825+0000 7f7278067640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f727015bb00 0x7f7270153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.825+0000 7f7278067640 1 --2- 172.21.15.50:0/1161976047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f727006d5b0 0x7f72700af430 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.825+0000 7f7278067640 1 -- 172.21.15.50:0/1161976047 >> 172.21.15.50:0/1161976047 conn(0x7f72700679c0 msgr2=0x7f72700d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:02.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.825+0000 7f5ddaffd640 1 -- 172.21.15.50:0/1400628395 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6065 v65) ==== 95+0+0 (secure 0 0 0) 0x7f5dd405c8c0 con 0x7f5de40b5470 2024-09-11T22:16:02.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.825+0000 7f7278067640 1 -- 172.21.15.50:0/1161976047 shutdown_connections 2024-09-11T22:16:02.828 INFO:teuthology.orchestra.run.smithi050.stderr:failed mds gid 6065 2024-09-11T22:16:02.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.826+0000 7f7278067640 1 -- 172.21.15.50:0/1161976047 wait complete. 2024-09-11T22:16:02.830 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:16:02.830 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:16:02.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f0b35cc3640 1 -- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0b1c06be80 msgr2=0x7f0b1c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f0b35cc3640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0b1c06be80 0x7f0b1c06e340 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0b301ec330 tx=0x7f0b20009040 comp rx=0 tx=0).stop 2024-09-11T22:16:02.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f0b35cc3640 1 -- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b300d3a30 msgr2=0x7f0b300cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f0b35cc3640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b300d3a30 0x7f0b300cb850 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0b300b7340 tx=0x7f0b240046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f5dec53b640 1 -- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5dc806be80 msgr2=0x7f5dc806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f5dec53b640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5dc806be80 0x7f5dc806e340 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5de0034000 tx=0x7f5de002e000 comp rx=0 tx=0).stop 2024-09-11T22:16:02.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f5dec53b640 1 -- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de40b5470 msgr2=0x7f5de415e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:02.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f5dec53b640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de40b5470 0x7f5de415e230 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400c4d0 tx=0x7f5dd400c990 comp rx=0 tx=0).stop 2024-09-11T22:16:02.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f0b35cc3640 1 -- 172.21.15.50:0/2331680098 shutdown_connections 2024-09-11T22:16:02.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f0b35cc3640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0b1c06be80 0x7f0b1c06e340 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f0b35cc3640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b300d3a30 0x7f0b300cb850 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f0b35cc3640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b3015e870 0x7f0b3014ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f0b35cc3640 1 --2- 172.21.15.50:0/2331680098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b300d18a0 0x7f0b3014a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f0b35cc3640 1 -- 172.21.15.50:0/2331680098 >> 172.21.15.50:0/2331680098 conn(0x7f0b300727a0 msgr2=0x7f0b300d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:02.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f5dec53b640 1 -- 172.21.15.50:0/1400628395 shutdown_connections 2024-09-11T22:16:02.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f5dec53b640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5dc806be80 0x7f5dc806e340 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f5dec53b640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de4158c80 0x7f5de40b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f5dec53b640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5de40b5470 0x7f5de415e230 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f5dec53b640 1 --2- 172.21.15.50:0/1400628395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5de40b3a50 0x7f5de4151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:02.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f5dec53b640 1 -- 172.21.15.50:0/1400628395 >> 172.21.15.50:0/1400628395 conn(0x7f5de4074c40 msgr2=0x7f5de40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:02.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f5dec53b640 1 -- 172.21.15.50:0/1400628395 shutdown_connections 2024-09-11T22:16:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f0b35cc3640 1 -- 172.21.15.50:0/2331680098 shutdown_connections 2024-09-11T22:16:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f0b35cc3640 1 -- 172.21.15.50:0/2331680098 wait complete. 2024-09-11T22:16:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.829+0000 7f5dec53b640 1 -- 172.21.15.50:0/1400628395 wait complete. 2024-09-11T22:16:02.836 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:16:02.836 DEBUG:teuthology.parallel:result is None 2024-09-11T22:16:02.845 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:16:02.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:16:02.848 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:16:02.848 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:16:02.850 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:16:02.850 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:16:02.851 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:16:02.851 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:16:02.851 DEBUG:teuthology.parallel:result is None 2024-09-11T22:16:02.851 DEBUG:teuthology.parallel:result is None 2024-09-11T22:16:02.852 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:16:02.852 DEBUG:teuthology.parallel:result is None 2024-09-11T22:16:02.853 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:02.922 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:16:02.932 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:16:02.932 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:16:02.932 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:16:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.998+0000 7f5d05942640 1 Processor -- start 2024-09-11T22:16:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.998+0000 7f5d05942640 1 -- start start 2024-09-11T22:16:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5d05942640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d00162a60 0x7f5d000b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5d05942640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d00163080 con 0x7f5d0015e8e0 2024-09-11T22:16:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5d05942640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d000d2d20 con 0x7f5d000d1c90 2024-09-11T22:16:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5d05942640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d0015ecc0 con 0x7f5d00162a60 2024-09-11T22:16:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5cfeffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5d0015e8e0 0x7f5d000d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40712/0 (socket says 172.21.15.50:40712) 2024-09-11T22:16:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5cfeffd640 1 -- 172.21.15.50:0/511520195 learned_addr learned my addr 172.21.15.50:0/511520195 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5cff7fe640 1 --2- 172.21.15.50:0/511520195 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d00162a60 0x7f5d000b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5cfdffb640 1 -- 172.21.15.50:0/511520195 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1917070321 0 0) 0x7f5d00163080 con 0x7f5d0015e8e0 2024-09-11T22:16:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5cfdffb640 1 -- 172.21.15.50:0/511520195 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ce8003520 con 0x7f5d0015e8e0 2024-09-11T22:16:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5cfdffb640 1 -- 172.21.15.50:0/511520195 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799214082 0 0) 0x7f5d000d2d20 con 0x7f5d000d1c90 2024-09-11T22:16:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5cfdffb640 1 -- 172.21.15.50:0/511520195 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d00163080 con 0x7f5d000d1c90 2024-09-11T22:16:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5cff7fe640 1 -- 172.21.15.50:0/511520195 >> v1:172.21.15.77:6789/0 conn(0x7f5d000d1c90 legacy=0x7f5d00162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5cfdffb640 1 -- 172.21.15.50:0/511520195 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3658618998 0 0) 0x7f5ce8003520 con 0x7f5d0015e8e0 2024-09-11T22:16:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5cff7fe640 1 -- 172.21.15.50:0/511520195 >> v1:172.21.15.50:6789/0 conn(0x7f5d0015e8e0 legacy=0x7f5d000d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:02.999+0000 7f5cff7fe640 1 -- 172.21.15.50:0/511520195 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d000d3000 con 0x7f5d00162a60 2024-09-11T22:16:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.000+0000 7f5cff7fe640 1 --2- 172.21.15.50:0/511520195 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d00162a60 0x7f5d000b7880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009dc0 tx=0x7f5cf802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6221c9a5a7f5a73e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.000+0000 7f5cfdffb640 1 -- 172.21.15.50:0/511520195 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0001670 con 0x7f5d00162a60 2024-09-11T22:16:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.000+0000 7f5cfdffb640 1 -- 172.21.15.50:0/511520195 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf802ae50 con 0x7f5d00162a60 2024-09-11T22:16:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.000+0000 7f5cfdffb640 1 -- 172.21.15.50:0/511520195 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8007760 con 0x7f5d00162a60 2024-09-11T22:16:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.001+0000 7f5d05942640 1 -- 172.21.15.50:0/511520195 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d00162a60 msgr2=0x7f5d000b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.001+0000 7f5d05942640 1 --2- 172.21.15.50:0/511520195 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d00162a60 0x7f5d000b7880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009dc0 tx=0x7f5cf802a6f0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.001+0000 7f5d05942640 1 -- 172.21.15.50:0/511520195 shutdown_connections 2024-09-11T22:16:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.001+0000 7f5d05942640 1 --2- 172.21.15.50:0/511520195 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d00162a60 0x7f5d000b7880 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.001+0000 7f5d05942640 1 -- 172.21.15.50:0/511520195 >> 172.21.15.50:0/511520195 conn(0x7f5d00067ba0 msgr2=0x7f5d00067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.001+0000 7f5d05942640 1 -- 172.21.15.50:0/511520195 shutdown_connections 2024-09-11T22:16:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.001+0000 7f5d05942640 1 -- 172.21.15.50:0/511520195 wait complete. 2024-09-11T22:16:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.002+0000 7f5d05942640 1 Processor -- start 2024-09-11T22:16:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.002+0000 7f5d05942640 1 -- start start 2024-09-11T22:16:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5d05942640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d000d1c90 0x7f5d000ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5d05942640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d0015e8e0 0x7f5d0015b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5d05942640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d00162a60 0x7f5d001f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5d05942640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d000d3bd0 con 0x7f5d0015e8e0 2024-09-11T22:16:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5d05942640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d000d3a50 con 0x7f5d000d1c90 2024-09-11T22:16:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5d05942640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d000d3d50 con 0x7f5d00162a60 2024-09-11T22:16:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5cfe7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d0015e8e0 0x7f5d0015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5cfe7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d0015e8e0 0x7f5d0015b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36994/0 (socket says 172.21.15.50:36994) 2024-09-11T22:16:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5cfe7fc640 1 -- 172.21.15.50:0/3235931245 learned_addr learned my addr 172.21.15.50:0/3235931245 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5cfe7fc640 1 -- 172.21.15.50:0/3235931245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d00162a60 msgr2=0x7f5d001f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5cfe7fc640 1 --2- 172.21.15.50:0/3235931245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d00162a60 0x7f5d001f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5cfe7fc640 1 -- 172.21.15.50:0/3235931245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d000d1c90 msgr2=0x7f5d000ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5cfe7fc640 1 --2- 172.21.15.50:0/3235931245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d000d1c90 0x7f5d000ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.003+0000 7f5cfe7fc640 1 -- 172.21.15.50:0/3235931245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d000cace0 con 0x7f5d0015e8e0 2024-09-11T22:16:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.004+0000 7f5cfe7fc640 1 --2- 172.21.15.50:0/3235931245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d0015e8e0 0x7f5d0015b180 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400c490 tx=0x7f5cf400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.004+0000 7f5ce7fff640 1 -- 172.21.15.50:0/3235931245 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4017070 con 0x7f5d0015e8e0 2024-09-11T22:16:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.004+0000 7f5ce7fff640 1 -- 172.21.15.50:0/3235931245 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf40052d0 con 0x7f5d0015e8e0 2024-09-11T22:16:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.004+0000 7f5d05942640 1 -- 172.21.15.50:0/3235931245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0015a0e0 con 0x7f5d0015e8e0 2024-09-11T22:16:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.004+0000 7f5ce7fff640 1 -- 172.21.15.50:0/3235931245 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4003830 con 0x7f5d0015e8e0 2024-09-11T22:16:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.004+0000 7f5d05942640 1 -- 172.21.15.50:0/3235931245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d0015a6a0 con 0x7f5d0015e8e0 2024-09-11T22:16:03.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.005+0000 7f5d05942640 1 -- 172.21.15.50:0/3235931245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d000b7880 con 0x7f5d0015e8e0 2024-09-11T22:16:03.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.005+0000 7f5ce7fff640 1 -- 172.21.15.50:0/3235931245 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cf401a070 con 0x7f5d0015e8e0 2024-09-11T22:16:03.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.006+0000 7f5ce7fff640 1 --2- 172.21.15.50:0/3235931245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5cec06be30 0x7f5cec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:03.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.006+0000 7f5ce7fff640 1 -- 172.21.15.50:0/3235931245 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7f5cf408a340 con 0x7f5d0015e8e0 2024-09-11T22:16:03.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.006+0000 7f5cfeffd640 1 --2- 172.21.15.50:0/3235931245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5cec06be30 0x7f5cec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:03.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.007+0000 7f5cfeffd640 1 --2- 172.21.15.50:0/3235931245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5cec06be30 0x7f5cec06e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0001340 tx=0x7f5cf0000f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:03.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.010+0000 7f5ce7fff640 1 -- 172.21.15.50:0/3235931245 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5cf4058c80 con 0x7f5d0015e8e0 2024-09-11T22:16:03.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.223+0000 7f5d05942640 1 -- 172.21.15.50:0/3235931245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d000d1620 con 0x7f5d0015e8e0 2024-09-11T22:16:03.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.224+0000 7f5ce7fff640 1 -- 172.21.15.50:0/3235931245 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+1911 (secure 0 0 0) 0x7f5cf4058580 con 0x7f5d0015e8e0 2024-09-11T22:16:03.225 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:03.225 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":65,"btime":"2024-09-11T22:16:02:821781+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:16:02.821777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-11T22:16:03.225 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 65 2024-09-11T22:16:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.226+0000 7f5d05942640 1 -- 172.21.15.50:0/3235931245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5cec06be30 msgr2=0x7f5cec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.226+0000 7f5d05942640 1 --2- 172.21.15.50:0/3235931245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5cec06be30 0x7f5cec06e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0001340 tx=0x7f5cf0000f50 comp rx=0 tx=0).stop 2024-09-11T22:16:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.226+0000 7f5d05942640 1 -- 172.21.15.50:0/3235931245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d0015e8e0 msgr2=0x7f5d0015b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.226+0000 7f5d05942640 1 --2- 172.21.15.50:0/3235931245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d0015e8e0 0x7f5d0015b180 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400c490 tx=0x7f5cf400c950 comp rx=0 tx=0).stop 2024-09-11T22:16:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.226+0000 7f5d05942640 1 -- 172.21.15.50:0/3235931245 shutdown_connections 2024-09-11T22:16:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.226+0000 7f5d05942640 1 --2- 172.21.15.50:0/3235931245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5cec06be30 0x7f5cec06e2f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.226+0000 7f5d05942640 1 --2- 172.21.15.50:0/3235931245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d00162a60 0x7f5d001f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.226+0000 7f5d05942640 1 --2- 172.21.15.50:0/3235931245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d0015e8e0 0x7f5d0015b180 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.226+0000 7f5d05942640 1 --2- 172.21.15.50:0/3235931245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d000d1c90 0x7f5d000ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:03.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.226+0000 7f5d05942640 1 -- 172.21.15.50:0/3235931245 >> 172.21.15.50:0/3235931245 conn(0x7f5d00067ba0 msgr2=0x7f5d00067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:03.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.226+0000 7f5d05942640 1 -- 172.21.15.50:0/3235931245 shutdown_connections 2024-09-11T22:16:03.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:03.226+0000 7f5d05942640 1 -- 172.21.15.50:0/3235931245 wait complete. 2024-09-11T22:16:03.640 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:15:49.108873+0000', 'modified': '2024-09-11T22:16:02.821777+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 95, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-11T22:16:03.640 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-09-11T22:16:04.641 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:04.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.757+0000 7fc6a9186640 1 Processor -- start 2024-09-11T22:16:04.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.757+0000 7fc6a9186640 1 -- start start 2024-09-11T22:16:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.758+0000 7fc6a9186640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc6a40b5fd0 0x7fc6a40b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.758+0000 7fc6a9186640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6a415e050 0x7fc6a415e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.758+0000 7fc6a9186640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6a415cef0 con 0x7fc6a415c770 2024-09-11T22:16:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.758+0000 7fc6a9186640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc6a40b6960 con 0x7fc6a415e050 2024-09-11T22:16:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.758+0000 7fc6a9186640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc6a415d1d0 con 0x7fc6a40b5fd0 2024-09-11T22:16:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.758+0000 7fc6a359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6a415e050 0x7fc6a415e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.758+0000 7fc6a359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6a415e050 0x7fc6a415e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37010/0 (socket says 172.21.15.50:37010) 2024-09-11T22:16:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.758+0000 7fc6a359e640 1 -- 172.21.15.50:0/3373921802 learned_addr learned my addr 172.21.15.50:0/3373921802 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.758+0000 7fc6a259c640 1 --2- 172.21.15.50:0/3373921802 >> v2:172.21.15.77:3300/0 conn(0x7fc6a40b5fd0 0x7fc6a40b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.758+0000 7fc6a359e640 1 -- 172.21.15.50:0/3373921802 >> v2:172.21.15.77:3300/0 conn(0x7fc6a40b5fd0 msgr2=0x7fc6a40b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.758+0000 7fc6a359e640 1 --2- 172.21.15.50:0/3373921802 >> v2:172.21.15.77:3300/0 conn(0x7fc6a40b5fd0 0x7fc6a40b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.758+0000 7fc6a359e640 1 -- 172.21.15.50:0/3373921802 >> v1:172.21.15.77:6789/0 conn(0x7fc6a415c770 legacy=0x7fc6a40b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.758+0000 7fc6a359e640 1 -- 172.21.15.50:0/3373921802 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a415d4b0 con 0x7fc6a415e050 2024-09-11T22:16:04.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.759+0000 7fc6a359e640 1 --2- 172.21.15.50:0/3373921802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a415e050 0x7fc6a415e480 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fc6a406eb60 tx=0x7fc69c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533ef55147bf48f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:04.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.759+0000 7fc6a1d9b640 1 -- 172.21.15.50:0/3373921802 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c036070 con 0x7fc6a415e050 2024-09-11T22:16:04.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.759+0000 7fc6a1d9b640 1 -- 172.21.15.50:0/3373921802 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69c031600 con 0x7fc6a415e050 2024-09-11T22:16:04.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.759+0000 7fc6a1d9b640 1 -- 172.21.15.50:0/3373921802 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c0319d0 con 0x7fc6a415e050 2024-09-11T22:16:04.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.760+0000 7fc6a9186640 1 -- 172.21.15.50:0/3373921802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a415e050 msgr2=0x7fc6a415e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:04.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.760+0000 7fc6a9186640 1 --2- 172.21.15.50:0/3373921802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a415e050 0x7fc6a415e480 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fc6a406eb60 tx=0x7fc69c02a730 comp rx=0 tx=0).stop 2024-09-11T22:16:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.760+0000 7fc6a9186640 1 -- 172.21.15.50:0/3373921802 shutdown_connections 2024-09-11T22:16:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.760+0000 7fc6a9186640 1 --2- 172.21.15.50:0/3373921802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a415e050 0x7fc6a415e480 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.760+0000 7fc6a9186640 1 --2- 172.21.15.50:0/3373921802 >> v2:172.21.15.77:3300/0 conn(0x7fc6a40b5fd0 0x7fc6a40b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.760+0000 7fc6a9186640 1 -- 172.21.15.50:0/3373921802 >> 172.21.15.50:0/3373921802 conn(0x7fc6a40b7940 msgr2=0x7fc6a40b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.760+0000 7fc6a9186640 1 -- 172.21.15.50:0/3373921802 shutdown_connections 2024-09-11T22:16:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.760+0000 7fc6a9186640 1 -- 172.21.15.50:0/3373921802 wait complete. 2024-09-11T22:16:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.762+0000 7fc6a9186640 1 Processor -- start 2024-09-11T22:16:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.762+0000 7fc6a9186640 1 -- start start 2024-09-11T22:16:04.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.762+0000 7fc6a9186640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a40b5fd0 0x7fc6a41478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:04.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.762+0000 7fc6a9186640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6a415c770 0x7fc6a40b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.762+0000 7fc6a9186640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a415e050 0x7fc6a41579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a9186640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a40b5af0 con 0x7fc6a415e050 2024-09-11T22:16:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a9186640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a415dcb0 con 0x7fc6a40b5fd0 2024-09-11T22:16:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a9186640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a415cb50 con 0x7fc6a415c770 2024-09-11T22:16:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a415e050 0x7fc6a41579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a415e050 0x7fc6a41579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37012/0 (socket says 172.21.15.50:37012) 2024-09-11T22:16:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a359e640 1 -- 172.21.15.50:0/3660856678 learned_addr learned my addr 172.21.15.50:0/3660856678 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a259c640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6a415c770 0x7fc6a40b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a2d9d640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a40b5fd0 0x7fc6a41478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a359e640 1 -- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6a415c770 msgr2=0x7fc6a40b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a359e640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6a415c770 0x7fc6a40b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a359e640 1 -- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a40b5fd0 msgr2=0x7fc6a41478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a359e640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a40b5fd0 0x7fc6a41478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a359e640 1 -- 172.21.15.50:0/3660856678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a40b2240 con 0x7fc6a415e050 2024-09-11T22:16:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc6a359e640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a415e050 0x7fc6a41579d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009f40 tx=0x7fc69c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.763+0000 7fc68b7fe640 1 -- 172.21.15.50:0/3660856678 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c036050 con 0x7fc6a415e050 2024-09-11T22:16:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.764+0000 7fc68b7fe640 1 -- 172.21.15.50:0/3660856678 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69c042070 con 0x7fc6a415e050 2024-09-11T22:16:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.764+0000 7fc68b7fe640 1 -- 172.21.15.50:0/3660856678 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c009510 con 0x7fc6a415e050 2024-09-11T22:16:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.764+0000 7fc6a9186640 1 -- 172.21.15.50:0/3660856678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a40b2520 con 0x7fc6a415e050 2024-09-11T22:16:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.764+0000 7fc6a9186640 1 -- 172.21.15.50:0/3660856678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a40b4240 con 0x7fc6a415e050 2024-09-11T22:16:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.765+0000 7fc6a9186640 1 -- 172.21.15.50:0/3660856678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a40b6420 con 0x7fc6a415e050 2024-09-11T22:16:04.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.765+0000 7fc68b7fe640 1 -- 172.21.15.50:0/3660856678 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc69c007bf0 con 0x7fc6a415e050 2024-09-11T22:16:04.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.766+0000 7fc68b7fe640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc69006be30 0x7fc69006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:04.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.766+0000 7fc68b7fe640 1 -- 172.21.15.50:0/3660856678 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7fc69c0abad0 con 0x7fc6a415e050 2024-09-11T22:16:04.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.766+0000 7fc6a2d9d640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc69006be30 0x7fc69006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:04.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.766+0000 7fc6a2d9d640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc69006be30 0x7fc69006e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc694001780 tx=0x7fc694009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.770+0000 7fc68b7fe640 1 -- 172.21.15.50:0/3660856678 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc69c079dc0 con 0x7fc6a415e050 2024-09-11T22:16:04.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.984+0000 7fc6a9186640 1 -- 172.21.15.50:0/3660856678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6a40b26f0 con 0x7fc6a415e050 2024-09-11T22:16:04.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.984+0000 7fc68b7fe640 1 -- 172.21.15.50:0/3660856678 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5222 (secure 0 0 0) 0x7fc69c07e0c0 con 0x7fc6a415e050 2024-09-11T22:16:04.985 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:04.985 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":68,"btime":"2024-09-11T22:16:04:829350+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1026980304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1026980304},{"type":"v1","addr":"172.21.15.50:6833","nonce":1026980304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3116356224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3116356224},{"type":"v1","addr":"172.21.15.77:6836","nonce":3116356224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3001000202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3001000202},{"type":"v1","addr":"172.21.15.77:6837","nonce":3001000202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:16:03.839949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6754":{"gid":6754,"name":"a","rank":0,"incarnation":67,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.50:6835/3565485635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3565485635},{"type":"v1","addr":"172.21.15.50:6835","nonce":3565485635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-11T22:16:04.986 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 68 2024-09-11T22:16:04.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.986+0000 7fc6a9186640 1 -- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc69006be30 msgr2=0x7fc69006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:04.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.986+0000 7fc6a9186640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc69006be30 0x7fc69006e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc694001780 tx=0x7fc694009040 comp rx=0 tx=0).stop 2024-09-11T22:16:04.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.986+0000 7fc6a9186640 1 -- 172.21.15.50:0/3660856678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a415e050 msgr2=0x7fc6a41579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:04.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.986+0000 7fc6a9186640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a415e050 0x7fc6a41579d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009f40 tx=0x7fc69c004a40 comp rx=0 tx=0).stop 2024-09-11T22:16:04.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.986+0000 7fc6a9186640 1 -- 172.21.15.50:0/3660856678 shutdown_connections 2024-09-11T22:16:04.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.986+0000 7fc6a9186640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc69006be30 0x7fc69006e2f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:04.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.986+0000 7fc6a9186640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6a415c770 0x7fc6a40b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:04.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.986+0000 7fc6a9186640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a415e050 0x7fc6a41579d0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:04.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.986+0000 7fc6a9186640 1 --2- 172.21.15.50:0/3660856678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a40b5fd0 0x7fc6a41478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:04.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.986+0000 7fc6a9186640 1 -- 172.21.15.50:0/3660856678 >> 172.21.15.50:0/3660856678 conn(0x7fc6a40b7940 msgr2=0x7fc6a40b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:04.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.986+0000 7fc6a9186640 1 -- 172.21.15.50:0/3660856678 shutdown_connections 2024-09-11T22:16:04.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:04.986+0000 7fc6a9186640 1 -- 172.21.15.50:0/3660856678 wait complete. 2024-09-11T22:16:05.401 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:15:49.108873+0000', 'modified': '2024-09-11T22:16:03.839949+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 95, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6754}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6754': {'gid': 6754, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.50:6835/3565485635', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 3565485635}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 3565485635}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-11T22:16:05.402 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6754:up:reconnect 2024-09-11T22:16:06.404 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:06.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.518+0000 7f9a4524c640 1 Processor -- start 2024-09-11T22:16:06.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.518+0000 7f9a4524c640 1 -- start start 2024-09-11T22:16:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.519+0000 7f9a4524c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400d18a0 0x7f9a400d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.519+0000 7f9a4524c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a400cfa80 con 0x7f9a4015e870 2024-09-11T22:16:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.519+0000 7f9a4524c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a400d40d0 con 0x7f9a400d3a30 2024-09-11T22:16:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.519+0000 7f9a4524c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9a400d3ea0 con 0x7f9a400d18a0 2024-09-11T22:16:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.519+0000 7f9a3ed9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9a4015e870 0x7f9a400d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40728/0 (socket says 172.21.15.50:40728) 2024-09-11T22:16:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.519+0000 7f9a3ed9d640 1 -- 172.21.15.50:0/3887409321 learned_addr learned my addr 172.21.15.50:0/3887409321 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3e59c640 1 --2- 172.21.15.50:0/3887409321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400d18a0 0x7f9a400d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 630280301 0 0) 0x7f9a30001490 con 0x7f9a4015e870 2024-09-11T22:16:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a28003520 con 0x7f9a4015e870 2024-09-11T22:16:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1308238290 0 0) 0x7f9a400d40d0 con 0x7f9a400d3a30 2024-09-11T22:16:06.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a30001490 con 0x7f9a400d3a30 2024-09-11T22:16:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4150993420 0 0) 0x7f9a28003520 con 0x7f9a4015e870 2024-09-11T22:16:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400d18a0 msgr2=0x7f9a400d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 --2- 172.21.15.50:0/3887409321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400d18a0 0x7f9a400d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 >> v1:172.21.15.77:6789/0 conn(0x7f9a400d3a30 legacy=0x7f9a400b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a400d43b0 con 0x7f9a4015e870 2024-09-11T22:16:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f9a30001bc0 con 0x7f9a4015e870 2024-09-11T22:16:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 >> v1:172.21.15.50:6789/0 conn(0x7f9a4015e870 legacy=0x7f9a400d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 --2- 172.21.15.50:0/3887409321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a28003b70 0x7f9a28003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 --2- 172.21.15.50:0/3887409321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400d18a0 0x7f9a28004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 --2- 172.21.15.50:0/3887409321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a28004d40 0x7f9a280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2800ba70 con 0x7f9a28004d40 2024-09-11T22:16:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2800bbf0 con 0x7f9a28003b70 2024-09-11T22:16:06.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9a2800bdf0 con 0x7f9a400d18a0 2024-09-11T22:16:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3f59e640 1 --2- 172.21.15.50:0/3887409321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a28004d40 0x7f9a280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3ed9d640 1 --2- 172.21.15.50:0/3887409321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a28003b70 0x7f9a28003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3e59c640 1 --2- 172.21.15.50:0/3887409321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400d18a0 0x7f9a28004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3f59e640 1 -- 172.21.15.50:0/3887409321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400d18a0 msgr2=0x7f9a28004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3f59e640 1 --2- 172.21.15.50:0/3887409321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400d18a0 0x7f9a28004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3f59e640 1 -- 172.21.15.50:0/3887409321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a28003b70 msgr2=0x7f9a28003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3f59e640 1 --2- 172.21.15.50:0/3887409321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a28003b70 0x7f9a28003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.520+0000 7f9a3f59e640 1 -- 172.21.15.50:0/3887409321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a28003520 con 0x7f9a28004d40 2024-09-11T22:16:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.521+0000 7f9a3e59c640 1 --2- 172.21.15.50:0/3887409321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400d18a0 0x7f9a28004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.521+0000 7f9a3f59e640 1 --2- 172.21.15.50:0/3887409321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a28004d40 0x7f9a280051c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f9a380018d0 tx=0x7f9a28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdadf2c37795c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:06.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.521+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a380014f0 con 0x7f9a28004d40 2024-09-11T22:16:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.521+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a380052d0 con 0x7f9a28004d40 2024-09-11T22:16:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.521+0000 7f9a3dd9b640 1 -- 172.21.15.50:0/3887409321 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3802aca0 con 0x7f9a28004d40 2024-09-11T22:16:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.522+0000 7f9a4524c640 1 -- 172.21.15.50:0/3887409321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a28004d40 msgr2=0x7f9a280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.522+0000 7f9a4524c640 1 --2- 172.21.15.50:0/3887409321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a28004d40 0x7f9a280051c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f9a380018d0 tx=0x7f9a28005830 comp rx=0 tx=0).stop 2024-09-11T22:16:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.522+0000 7f9a3f59e640 1 -- 172.21.15.50:0/3887409321 reap_dead start 2024-09-11T22:16:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.522+0000 7f9a4524c640 1 -- 172.21.15.50:0/3887409321 shutdown_connections 2024-09-11T22:16:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.522+0000 7f9a4524c640 1 -- 172.21.15.50:0/3887409321 >> 172.21.15.50:0/3887409321 conn(0x7f9a400727a0 msgr2=0x7f9a400679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.522+0000 7f9a4524c640 1 -- 172.21.15.50:0/3887409321 shutdown_connections 2024-09-11T22:16:06.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.522+0000 7f9a4524c640 1 -- 172.21.15.50:0/3887409321 wait complete. 2024-09-11T22:16:06.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.524+0000 7f9a4524c640 1 Processor -- start 2024-09-11T22:16:06.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.524+0000 7f9a4524c640 1 -- start start 2024-09-11T22:16:06.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.524+0000 7f9a4524c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400b2f70 0x7f9a4014b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.524+0000 7f9a4524c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a400b3350 0x7f9a4014b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.524+0000 7f9a4524c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a4014c750 0x7f9a4014cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.524+0000 7f9a4524c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4015ec50 con 0x7f9a4014c750 2024-09-11T22:16:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.524+0000 7f9a4524c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9a400b7ee0 con 0x7f9a400b3350 2024-09-11T22:16:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.524+0000 7f9a4524c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9a400b78b0 con 0x7f9a400b2f70 2024-09-11T22:16:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.524+0000 7f9a3f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a4014c750 0x7f9a4014cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a3f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a4014c750 0x7f9a4014cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37028/0 (socket says 172.21.15.50:37028) 2024-09-11T22:16:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a3f59e640 1 -- 172.21.15.50:0/247413200 learned_addr learned my addr 172.21.15.50:0/247413200 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a3ed9d640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400b2f70 0x7f9a4014b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a3e59c640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a400b3350 0x7f9a4014b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a3f59e640 1 -- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400b2f70 msgr2=0x7f9a4014b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a3f59e640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400b2f70 0x7f9a4014b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a3f59e640 1 -- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a400b3350 msgr2=0x7f9a4014b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a3f59e640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a400b3350 0x7f9a4014b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a3f59e640 1 -- 172.21.15.50:0/247413200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4014d460 con 0x7f9a4014c750 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a3f59e640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a4014c750 0x7f9a4014cbc0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f9a3802a730 tx=0x7f9a380012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a277fe640 1 -- 172.21.15.50:0/247413200 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a380014f0 con 0x7f9a4014c750 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a277fe640 1 -- 172.21.15.50:0/247413200 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a38005480 con 0x7f9a4014c750 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a4524c640 1 -- 172.21.15.50:0/247413200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4014d740 con 0x7f9a4014c750 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a277fe640 1 -- 172.21.15.50:0/247413200 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a380050d0 con 0x7f9a4014c750 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.525+0000 7f9a4524c640 1 -- 172.21.15.50:0/247413200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a4014dd00 con 0x7f9a4014c750 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.526+0000 7f9a4524c640 1 -- 172.21.15.50:0/247413200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a400d34f0 con 0x7f9a4014c750 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.527+0000 7f9a277fe640 1 -- 172.21.15.50:0/247413200 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a38043020 con 0x7f9a4014c750 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.527+0000 7f9a277fe640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9a2c06be30 0x7f9a2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.528+0000 7f9a277fe640 1 -- 172.21.15.50:0/247413200 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7f9a380a9f60 con 0x7f9a4014c750 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.528+0000 7f9a3ed9d640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9a2c06be30 0x7f9a2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.528+0000 7f9a3ed9d640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9a2c06be30 0x7f9a2c06e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9a30004bc0 tx=0x7f9a30006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.532+0000 7f9a277fe640 1 -- 172.21.15.50:0/247413200 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a380781d0 con 0x7f9a4014c750 2024-09-11T22:16:06.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.741+0000 7f9a4524c640 1 -- 172.21.15.50:0/247413200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a400b6cb0 con 0x7f9a4014c750 2024-09-11T22:16:06.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.741+0000 7f9a277fe640 1 -- 172.21.15.50:0/247413200 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5219 (secure 0 0 0) 0x7f9a3807c4d0 con 0x7f9a4014c750 2024-09-11T22:16:06.742 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:06.742 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":69,"btime":"2024-09-11T22:16:05:830959+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1026980304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1026980304},{"type":"v1","addr":"172.21.15.50:6833","nonce":1026980304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3116356224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3116356224},{"type":"v1","addr":"172.21.15.77:6836","nonce":3116356224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3001000202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3001000202},{"type":"v1","addr":"172.21.15.77:6837","nonce":3001000202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:16:04.833760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6754":{"gid":6754,"name":"a","rank":0,"incarnation":67,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.50:6835/3565485635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3565485635},{"type":"v1","addr":"172.21.15.50:6835","nonce":3565485635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-11T22:16:06.743 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 69 2024-09-11T22:16:06.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.743+0000 7f9a4524c640 1 -- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9a2c06be30 msgr2=0x7f9a2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.743+0000 7f9a4524c640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9a2c06be30 0x7f9a2c06e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9a30004bc0 tx=0x7f9a30006040 comp rx=0 tx=0).stop 2024-09-11T22:16:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.743+0000 7f9a4524c640 1 -- 172.21.15.50:0/247413200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a4014c750 msgr2=0x7f9a4014cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.743+0000 7f9a4524c640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a4014c750 0x7f9a4014cbc0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f9a3802a730 tx=0x7f9a380012d0 comp rx=0 tx=0).stop 2024-09-11T22:16:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.743+0000 7f9a4524c640 1 -- 172.21.15.50:0/247413200 shutdown_connections 2024-09-11T22:16:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.743+0000 7f9a4524c640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9a2c06be30 0x7f9a2c06e2f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.743+0000 7f9a4524c640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a4014c750 0x7f9a4014cbc0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.743+0000 7f9a4524c640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a400b3350 0x7f9a4014b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.743+0000 7f9a4524c640 1 --2- 172.21.15.50:0/247413200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a400b2f70 0x7f9a4014b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.743+0000 7f9a4524c640 1 -- 172.21.15.50:0/247413200 >> 172.21.15.50:0/247413200 conn(0x7f9a400727a0 msgr2=0x7f9a401619b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.744+0000 7f9a4524c640 1 -- 172.21.15.50:0/247413200 shutdown_connections 2024-09-11T22:16:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:06.744+0000 7f9a4524c640 1 -- 172.21.15.50:0/247413200 wait complete. 2024-09-11T22:16:07.158 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:15:49.108873+0000', 'modified': '2024-09-11T22:16:04.833760+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 95, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6754}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6754': {'gid': 6754, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.50:6835/3565485635', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 3565485635}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 3565485635}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-11T22:16:07.158 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6754:up:rejoin 2024-09-11T22:16:08.159 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.274+0000 7fd0658ba640 1 Processor -- start 2024-09-11T22:16:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.274+0000 7fd0658ba640 1 -- start start 2024-09-11T22:16:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.275+0000 7fd0658ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd06006e0f0 0x7fd06006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.275+0000 7fd0658ba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd060072e60 0x7fd0600711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.275+0000 7fd0658ba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd06015b7e0 con 0x7fd06015b400 2024-09-11T22:16:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.275+0000 7fd0658ba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd06015f140 con 0x7fd06006e0f0 2024-09-11T22:16:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.275+0000 7fd0658ba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd06015f420 con 0x7fd060072e60 2024-09-11T22:16:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.275+0000 7fd05e7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd06006e0f0 0x7fd06006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.275+0000 7fd05effd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd06015b400 0x7fd06006d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48598/0 (socket says 172.21.15.50:48598) 2024-09-11T22:16:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.275+0000 7fd05effd640 1 -- 172.21.15.50:0/561272418 learned_addr learned my addr 172.21.15.50:0/561272418 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.275+0000 7fd05f7fe640 1 --2- 172.21.15.50:0/561272418 >> v2:172.21.15.77:3300/0 conn(0x7fd060072e60 0x7fd0600711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.276+0000 7fd05dffb640 1 -- 172.21.15.50:0/561272418 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668026985 0 0) 0x7fd06015b7e0 con 0x7fd06015b400 2024-09-11T22:16:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.276+0000 7fd05dffb640 1 -- 172.21.15.50:0/561272418 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd04c003520 con 0x7fd06015b400 2024-09-11T22:16:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.276+0000 7fd05e7fc640 1 -- 172.21.15.50:0/561272418 >> v2:172.21.15.77:3300/0 conn(0x7fd060072e60 msgr2=0x7fd0600711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.276+0000 7fd05e7fc640 1 --2- 172.21.15.50:0/561272418 >> v2:172.21.15.77:3300/0 conn(0x7fd060072e60 0x7fd0600711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.276+0000 7fd05e7fc640 1 -- 172.21.15.50:0/561272418 >> v1:172.21.15.50:6789/0 conn(0x7fd06015b400 legacy=0x7fd06006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.276+0000 7fd05dffb640 1 -- 172.21.15.50:0/561272418 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1726223016 0 0) 0x7fd04c003520 con 0x7fd06015b400 2024-09-11T22:16:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.276+0000 7fd05e7fc640 1 -- 172.21.15.50:0/561272418 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06015f700 con 0x7fd06006e0f0 2024-09-11T22:16:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.277+0000 7fd05e7fc640 1 --2- 172.21.15.50:0/561272418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd06006e0f0 0x7fd06006d070 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fd0600b3490 tx=0x7fd04802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a20c69c5339172 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.277+0000 7fd05dffb640 1 -- 172.21.15.50:0/561272418 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048037070 con 0x7fd06006e0f0 2024-09-11T22:16:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.277+0000 7fd05dffb640 1 -- 172.21.15.50:0/561272418 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04802abc0 con 0x7fd06006e0f0 2024-09-11T22:16:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.277+0000 7fd05dffb640 1 -- 172.21.15.50:0/561272418 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0500019f0 con 0x7fd06006e0f0 2024-09-11T22:16:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.277+0000 7fd0658ba640 1 -- 172.21.15.50:0/561272418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd06006e0f0 msgr2=0x7fd06006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.277+0000 7fd0658ba640 1 --2- 172.21.15.50:0/561272418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd06006e0f0 0x7fd06006d070 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fd0600b3490 tx=0x7fd04802a130 comp rx=0 tx=0).stop 2024-09-11T22:16:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.277+0000 7fd0658ba640 1 -- 172.21.15.50:0/561272418 shutdown_connections 2024-09-11T22:16:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.277+0000 7fd0658ba640 1 --2- 172.21.15.50:0/561272418 >> v2:172.21.15.77:3300/0 conn(0x7fd060072e60 0x7fd0600711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.277+0000 7fd0658ba640 1 --2- 172.21.15.50:0/561272418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd06006e0f0 0x7fd06006d070 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.277+0000 7fd0658ba640 1 -- 172.21.15.50:0/561272418 >> 172.21.15.50:0/561272418 conn(0x7fd0600679c0 msgr2=0x7fd060067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.277+0000 7fd0658ba640 1 -- 172.21.15.50:0/561272418 shutdown_connections 2024-09-11T22:16:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.277+0000 7fd0658ba640 1 -- 172.21.15.50:0/561272418 wait complete. 2024-09-11T22:16:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.279+0000 7fd0658ba640 1 Processor -- start 2024-09-11T22:16:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.279+0000 7fd0658ba640 1 -- start start 2024-09-11T22:16:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.279+0000 7fd0658ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd06006e0f0 0x7fd0601542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd0658ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd060072e60 0x7fd06015df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd0658ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd06015b400 0x7fd0600ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd0658ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd060071700 con 0x7fd060072e60 2024-09-11T22:16:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd0658ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd0600cfc50 con 0x7fd06006e0f0 2024-09-11T22:16:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd0658ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd060071880 con 0x7fd06015b400 2024-09-11T22:16:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd05e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd060072e60 0x7fd06015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd05e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd060072e60 0x7fd06015df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45370/0 (socket says 172.21.15.50:45370) 2024-09-11T22:16:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd05e7fc640 1 -- 172.21.15.50:0/809397026 learned_addr learned my addr 172.21.15.50:0/809397026 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd05effd640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd06006e0f0 0x7fd0601542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd05f7fe640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd06015b400 0x7fd0600ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd05e7fc640 1 -- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd06015b400 msgr2=0x7fd0600ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd05e7fc640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd06015b400 0x7fd0600ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd05e7fc640 1 -- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd06006e0f0 msgr2=0x7fd0601542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd05e7fc640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd06006e0f0 0x7fd0601542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd05e7fc640 1 -- 172.21.15.50:0/809397026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0601f7410 con 0x7fd060072e60 2024-09-11T22:16:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd05e7fc640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd060072e60 0x7fd06015df80 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fd048009890 tx=0x7fd0480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd057fff640 1 -- 172.21.15.50:0/809397026 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048041070 con 0x7fd060072e60 2024-09-11T22:16:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd057fff640 1 -- 172.21.15.50:0/809397026 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04803c680 con 0x7fd060072e60 2024-09-11T22:16:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd0658ba640 1 -- 172.21.15.50:0/809397026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0601f76f0 con 0x7fd060072e60 2024-09-11T22:16:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd057fff640 1 -- 172.21.15.50:0/809397026 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048037040 con 0x7fd060072e60 2024-09-11T22:16:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.280+0000 7fd0658ba640 1 -- 172.21.15.50:0/809397026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd060154810 con 0x7fd060072e60 2024-09-11T22:16:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.281+0000 7fd0658ba640 1 -- 172.21.15.50:0/809397026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06006d070 con 0x7fd060072e60 2024-09-11T22:16:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.282+0000 7fd057fff640 1 -- 172.21.15.50:0/809397026 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd048044070 con 0x7fd060072e60 2024-09-11T22:16:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.282+0000 7fd057fff640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd04006be30 0x7fd04006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.283+0000 7fd057fff640 1 -- 172.21.15.50:0/809397026 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7fd0480ab5b0 con 0x7fd060072e60 2024-09-11T22:16:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.283+0000 7fd05effd640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd04006be30 0x7fd04006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.283+0000 7fd05effd640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd04006be30 0x7fd04006e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd050005c00 tx=0x7fd050009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.287+0000 7fd057fff640 1 -- 172.21.15.50:0/809397026 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd048079f80 con 0x7fd060072e60 2024-09-11T22:16:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.496+0000 7fd0658ba640 1 -- 172.21.15.50:0/809397026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd06006c030 con 0x7fd060072e60 2024-09-11T22:16:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.497+0000 7fd057fff640 1 -- 172.21.15.50:0/809397026 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5226 (secure 0 0 0) 0x7fd048079880 con 0x7fd060072e60 2024-09-11T22:16:08.497 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:08.498 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"btime":"2024-09-11T22:16:06:835431+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1026980304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1026980304},{"type":"v1","addr":"172.21.15.50:6833","nonce":1026980304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3116356224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3116356224},{"type":"v1","addr":"172.21.15.77:6836","nonce":3116356224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3001000202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3001000202},{"type":"v1","addr":"172.21.15.77:6837","nonce":3001000202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:16:06.835421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6754":{"gid":6754,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3565485635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3565485635},{"type":"v1","addr":"172.21.15.50:6835","nonce":3565485635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6754,"qdb_cluster":[6754]},"id":6}]} 2024-09-11T22:16:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2024-09-11T22:16:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.498+0000 7fd0658ba640 1 -- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd04006be30 msgr2=0x7fd04006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.498+0000 7fd0658ba640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd04006be30 0x7fd04006e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd050005c00 tx=0x7fd050009040 comp rx=0 tx=0).stop 2024-09-11T22:16:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.498+0000 7fd0658ba640 1 -- 172.21.15.50:0/809397026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd060072e60 msgr2=0x7fd06015df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.498+0000 7fd0658ba640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd060072e60 0x7fd06015df80 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fd048009890 tx=0x7fd0480046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.499+0000 7fd0658ba640 1 -- 172.21.15.50:0/809397026 shutdown_connections 2024-09-11T22:16:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.499+0000 7fd0658ba640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd04006be30 0x7fd04006e2f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.499+0000 7fd0658ba640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd06015b400 0x7fd0600ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.499+0000 7fd0658ba640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd060072e60 0x7fd06015df80 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.499+0000 7fd0658ba640 1 --2- 172.21.15.50:0/809397026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd06006e0f0 0x7fd0601542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.499+0000 7fd0658ba640 1 -- 172.21.15.50:0/809397026 >> 172.21.15.50:0/809397026 conn(0x7fd0600679c0 msgr2=0x7fd06006d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.499+0000 7fd0658ba640 1 -- 172.21.15.50:0/809397026 shutdown_connections 2024-09-11T22:16:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:08.499+0000 7fd0658ba640 1 -- 172.21.15.50:0/809397026 wait complete. 2024-09-11T22:16:08.913 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:15:49.108873+0000', 'modified': '2024-09-11T22:16:06.835421+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 95, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6754}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6754': {'gid': 6754, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6835/3565485635', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 3565485635}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 3565485635}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6754, 'qdb_cluster': [6754]} 2024-09-11T22:16:08.913 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:16:08.914 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T22:16:09.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.020+0000 7fe25eb5f640 1 Processor -- start 2024-09-11T22:16:09.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.020+0000 7fe25eb5f640 1 -- start start 2024-09-11T22:16:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.020+0000 7fe25eb5f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe25815e870 0x7fe2580d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.021+0000 7fe25eb5f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2580d16d0 0x7fe2580d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.021+0000 7fe25eb5f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2580cfa80 con 0x7fe2580d3a30 2024-09-11T22:16:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.021+0000 7fe25eb5f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe2580d3ea0 con 0x7fe2580d16d0 2024-09-11T22:16:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.021+0000 7fe25eb5f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe2580d1b10 con 0x7fe25815e870 2024-09-11T22:16:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.021+0000 7fe257fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2580d16d0 0x7fe2580d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.021+0000 7fe257fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2580d16d0 0x7fe2580d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45372/0 (socket says 172.21.15.50:45372) 2024-09-11T22:16:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.021+0000 7fe257fff640 1 -- 172.21.15.50:0/2034828249 learned_addr learned my addr 172.21.15.50:0/2034828249 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.021+0000 7fe25c8fb640 1 --2- 172.21.15.50:0/2034828249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe25815e870 0x7fe2580d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.021+0000 7fe257fff640 1 -- 172.21.15.50:0/2034828249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe25815e870 msgr2=0x7fe2580d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.021+0000 7fe257fff640 1 --2- 172.21.15.50:0/2034828249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe25815e870 0x7fe2580d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.021+0000 7fe257fff640 1 -- 172.21.15.50:0/2034828249 >> v1:172.21.15.77:6789/0 conn(0x7fe2580d3a30 legacy=0x7fe2580b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.021+0000 7fe257fff640 1 -- 172.21.15.50:0/2034828249 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2580d40d0 con 0x7fe2580d16d0 2024-09-11T22:16:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.022+0000 7fe257fff640 1 --2- 172.21.15.50:0/2034828249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2580d16d0 0x7fe2580d34f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe248009e50 tx=0x7fe24802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d808d334f8e722 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.022+0000 7fe2577fe640 1 -- 172.21.15.50:0/2034828249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248036070 con 0x7fe2580d16d0 2024-09-11T22:16:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.022+0000 7fe2577fe640 1 -- 172.21.15.50:0/2034828249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe248031600 con 0x7fe2580d16d0 2024-09-11T22:16:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.022+0000 7fe2577fe640 1 -- 172.21.15.50:0/2034828249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2480319d0 con 0x7fe2580d16d0 2024-09-11T22:16:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.022+0000 7fe25eb5f640 1 -- 172.21.15.50:0/2034828249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2580d16d0 msgr2=0x7fe2580d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.022+0000 7fe25eb5f640 1 --2- 172.21.15.50:0/2034828249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2580d16d0 0x7fe2580d34f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe248009e50 tx=0x7fe24802a710 comp rx=0 tx=0).stop 2024-09-11T22:16:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.022+0000 7fe25eb5f640 1 -- 172.21.15.50:0/2034828249 shutdown_connections 2024-09-11T22:16:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.022+0000 7fe25eb5f640 1 --2- 172.21.15.50:0/2034828249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2580d16d0 0x7fe2580d34f0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.022+0000 7fe25eb5f640 1 --2- 172.21.15.50:0/2034828249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe25815e870 0x7fe2580d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.022+0000 7fe25eb5f640 1 -- 172.21.15.50:0/2034828249 >> 172.21.15.50:0/2034828249 conn(0x7fe2580727a0 msgr2=0x7fe2580679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.023+0000 7fe25eb5f640 1 -- 172.21.15.50:0/2034828249 shutdown_connections 2024-09-11T22:16:09.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.023+0000 7fe25eb5f640 1 -- 172.21.15.50:0/2034828249 wait complete. 2024-09-11T22:16:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.024+0000 7fe25eb5f640 1 Processor -- start 2024-09-11T22:16:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.024+0000 7fe25eb5f640 1 -- start start 2024-09-11T22:16:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25eb5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2580d16d0 0x7fe2580ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25eb5f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2580d3a30 0x7fe2581f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25eb5f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe25815e870 0x7fe25815d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25eb5f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe2580b7ee0 con 0x7fe2580d16d0 2024-09-11T22:16:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25eb5f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe2580b7c00 con 0x7fe2580d3a30 2024-09-11T22:16:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25eb5f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe25815ec50 con 0x7fe25815e870 2024-09-11T22:16:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25c8fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2580d16d0 0x7fe2580ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25c8fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2580d16d0 0x7fe2580ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45380/0 (socket says 172.21.15.50:45380) 2024-09-11T22:16:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25c8fb640 1 -- 172.21.15.50:0/351260399 learned_addr learned my addr 172.21.15.50:0/351260399 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe257fff640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2580d3a30 0x7fe2581f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25d0fc640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe25815e870 0x7fe25815d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25c8fb640 1 -- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe25815e870 msgr2=0x7fe25815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25c8fb640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe25815e870 0x7fe25815d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25c8fb640 1 -- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2580d3a30 msgr2=0x7fe2581f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25c8fb640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2580d3a30 0x7fe2581f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25c8fb640 1 -- 172.21.15.50:0/351260399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2581f5bb0 con 0x7fe2580d16d0 2024-09-11T22:16:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25d0fc640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe25815e870 0x7fe25815d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25c8fb640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2580d16d0 0x7fe2580ab860 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe25000d620 tx=0x7fe25000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe2557fa640 1 -- 172.21.15.50:0/351260399 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25000b620 con 0x7fe2580d16d0 2024-09-11T22:16:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe2557fa640 1 -- 172.21.15.50:0/351260399 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe250019070 con 0x7fe2580d16d0 2024-09-11T22:16:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25eb5f640 1 -- 172.21.15.50:0/351260399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2581f5f50 con 0x7fe2580d16d0 2024-09-11T22:16:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe2557fa640 1 -- 172.21.15.50:0/351260399 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25000ba00 con 0x7fe2580d16d0 2024-09-11T22:16:09.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.025+0000 7fe25eb5f640 1 -- 172.21.15.50:0/351260399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2581f6510 con 0x7fe2580d16d0 2024-09-11T22:16:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.027+0000 7fe2557fa640 1 -- 172.21.15.50:0/351260399 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe25000bba0 con 0x7fe2580d16d0 2024-09-11T22:16:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.027+0000 7fe2557fa640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe23806be30 0x7fe23806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.027+0000 7fe2557fa640 1 -- 172.21.15.50:0/351260399 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7fe25008b1f0 con 0x7fe2580d16d0 2024-09-11T22:16:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.028+0000 7fe257fff640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe23806be30 0x7fe23806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.028+0000 7fe257fff640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe23806be30 0x7fe23806e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe248033000 tx=0x7fe248009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.028+0000 7fe2619d5740 1 Processor -- start 2024-09-11T22:16:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.028+0000 7fe2619d5740 1 -- start start 2024-09-11T22:16:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe2619d5740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d612c0 0x55cc35da6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe2619d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5ea80 0x55cc35d616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe2619d5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d62a50 0x55cc35d5b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe2619d5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cc35cc3520 con 0x55cc35d62a50 2024-09-11T22:16:09.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe2619d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cc35c6b3e0 con 0x55cc35d5ea80 2024-09-11T22:16:09.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe2619d5740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cc35cbf4e0 con 0x55cc35d612c0 2024-09-11T22:16:09.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe25d0fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d62a50 0x55cc35d5b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe25d0fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d62a50 0x55cc35d5b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45392/0 (socket says 172.21.15.50:45392) 2024-09-11T22:16:09.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe25d0fc640 1 -- 172.21.15.50:0/3933975856 learned_addr learned my addr 172.21.15.50:0/3933975856 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:09.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe25c8fb640 1 --2- 172.21.15.50:0/3933975856 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d612c0 0x55cc35da6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe257fff640 1 --2- 172.21.15.50:0/3933975856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5ea80 0x55cc35d616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe25d0fc640 1 -- 172.21.15.50:0/3933975856 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d612c0 msgr2=0x55cc35da6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe25d0fc640 1 --2- 172.21.15.50:0/3933975856 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d612c0 0x55cc35da6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe25d0fc640 1 -- 172.21.15.50:0/3933975856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5ea80 msgr2=0x55cc35d616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe25d0fc640 1 --2- 172.21.15.50:0/3933975856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5ea80 0x55cc35d616a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe25d0fc640 1 -- 172.21.15.50:0/3933975856 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc35c862f0 con 0x55cc35d62a50 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.029+0000 7fe25d0fc640 1 --2- 172.21.15.50:0/3933975856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d62a50 0x55cc35d5b8b0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fe240001680 tx=0x7fe240001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e6c0ead16cc39f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.030+0000 7fe24e7fc640 1 -- 172.21.15.50:0/3933975856 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe240019070 con 0x55cc35d62a50 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.030+0000 7fe24e7fc640 1 -- 172.21.15.50:0/3933975856 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2400052e0 con 0x55cc35d62a50 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.030+0000 7fe24e7fc640 1 -- 172.21.15.50:0/3933975856 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24000e940 con 0x55cc35d62a50 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.030+0000 7fe2619d5740 1 -- 172.21.15.50:0/3933975856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d62a50 msgr2=0x55cc35d5b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.030+0000 7fe2619d5740 1 --2- 172.21.15.50:0/3933975856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d62a50 0x55cc35d5b8b0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fe240001680 tx=0x7fe240001b40 comp rx=0 tx=0).stop 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.030+0000 7fe2619d5740 1 -- 172.21.15.50:0/3933975856 shutdown_connections 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.030+0000 7fe2619d5740 1 --2- 172.21.15.50:0/3933975856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d62a50 0x55cc35d5b8b0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.030+0000 7fe2619d5740 1 --2- 172.21.15.50:0/3933975856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5ea80 0x55cc35d616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.030+0000 7fe2619d5740 1 --2- 172.21.15.50:0/3933975856 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d612c0 0x55cc35da6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.030+0000 7fe2619d5740 1 -- 172.21.15.50:0/3933975856 >> 172.21.15.50:0/3933975856 conn(0x55cc35d5da80 msgr2=0x55cc35da5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.030+0000 7fe2619d5740 1 -- 172.21.15.50:0/3933975856 shutdown_connections 2024-09-11T22:16:09.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.030+0000 7fe2619d5740 1 -- 172.21.15.50:0/3933975856 wait complete. 2024-09-11T22:16:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.031+0000 7fe2619d5740 1 -- start start 2024-09-11T22:16:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.031+0000 7fe2619d5740 1 Processor -- start 2024-09-11T22:16:09.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe2619d5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35d7f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe2619d5740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d62a50 0x55cc35d8b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe2619d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5f800 0x55cc35d5fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe2619d5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cc35d5cf20 con 0x55cc35d612c0 2024-09-11T22:16:09.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe2619d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cc35c4c450 con 0x55cc35d5f800 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe2619d5740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cc35da7290 con 0x55cc35d62a50 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe2619d5740 10 client.0 _ll_register_callbacks cb 0x55cc359d5ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe25c8fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35d7f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe25c8fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35d7f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45406/0 (socket says 172.21.15.50:45406) 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe25c8fb640 1 -- 172.21.15.50:0/4061158695 learned_addr learned my addr 172.21.15.50:0/4061158695 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe25c8fb640 1 -- 172.21.15.50:0/4061158695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d62a50 msgr2=0x55cc35d8b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe257fff640 1 --2- 172.21.15.50:0/4061158695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d62a50 0x55cc35d8b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe25d0fc640 1 --2- 172.21.15.50:0/4061158695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5f800 0x55cc35d5fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe25c8fb640 1 --2- 172.21.15.50:0/4061158695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d62a50 0x55cc35d8b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe25c8fb640 1 -- 172.21.15.50:0/4061158695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5f800 msgr2=0x55cc35d5fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe25c8fb640 1 --2- 172.21.15.50:0/4061158695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5f800 0x55cc35d5fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.032+0000 7fe25c8fb640 1 -- 172.21.15.50:0/4061158695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc359d62d0 con 0x55cc35d612c0 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe25c8fb640 1 --2- 172.21.15.50:0/4061158695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35d7f8d0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fe250061ae0 tx=0x7fe250058e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86720e6dba5c899a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2377fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:16:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2377fe640 1 -- 172.21.15.50:0/4061158695 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250071070 con 0x55cc35d612c0 2024-09-11T22:16:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2377fe640 1 -- 172.21.15.50:0/4061158695 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7fe250071210 con 0x55cc35d612c0 2024-09-11T22:16:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2619d5740 1 -- 172.21.15.50:0/4061158695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2400052e0 con 0x55cc35d612c0 2024-09-11T22:16:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2377fe640 1 -- 172.21.15.50:0/4061158695 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fe25005d7e0 con 0x55cc35d612c0 2024-09-11T22:16:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2619d5740 10 client.7386 fetch_fsmap learned FSMap version 70 2024-09-11T22:16:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2619d5740 1 -- 172.21.15.50:0/4061158695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55cc35aa06b0 con 0x55cc35d612c0 2024-09-11T22:16:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2377fe640 1 -- 172.21.15.50:0/4061158695 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2400052e0 con 0x55cc35d612c0 2024-09-11T22:16:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2377fe640 1 -- 172.21.15.50:0/4061158695 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7fe250013070 con 0x55cc35d612c0 2024-09-11T22:16:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2619d5740 10 client.7386 fetch_fsmap finished waiting for FSMap version 70 2024-09-11T22:16:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2619d5740 10 client.7386 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:16:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2619d5740 20 client.7386 populate_metadata read hostname 'smithi050' 2024-09-11T22:16:09.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2619d5740 1 --2- 172.21.15.50:0/4061158695 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x55cc35d80810 0x55cc35d80c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2619d5740 4 client.7386 mds_command: new command op to 6754 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe2619d5740 1 -- 172.21.15.50:0/4061158695 --> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc35cd0c50 con 0x55cc35d80810 2024-09-11T22:16:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.033+0000 7fe257fff640 1 --2- 172.21.15.50:0/4061158695 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x55cc35d80810 0x55cc35d80c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.034+0000 7fe257fff640 1 --2- 172.21.15.50:0/4061158695 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x55cc35d80810 0x55cc35d80c30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a68aed213b83268f server_cookie=ed232505881e4978 in_seq=0 out_seq=0 2024-09-11T22:16:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.034+0000 7fe2377fe640 10 client.7386 ms_handle_connect on v2:172.21.15.50:6834/3565485635 2024-09-11T22:16:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.034+0000 7fe2377fe640 1 -- 172.21.15.50:0/4061158695 <== mds.0 v2:172.21.15.50:6834/3565485635 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc35cd0c50 con 0x55cc35d80810 2024-09-11T22:16:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.034+0000 7fe2377fe640 10 client.7386 handle_command_reply: tid=0 2024-09-11T22:16:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.034+0000 7fe2619d5740 1 client.7386 shutdown 2024-09-11T22:16:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.034+0000 7fe2619d5740 1 -- 172.21.15.50:0/4061158695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 msgr2=0x55cc35d7f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.034+0000 7fe2619d5740 1 --2- 172.21.15.50:0/4061158695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35d7f8d0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fe250061ae0 tx=0x7fe250058e90 comp rx=0 tx=0).stop 2024-09-11T22:16:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.035+0000 7fe2619d5740 1 -- 172.21.15.50:0/4061158695 shutdown_connections 2024-09-11T22:16:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.035+0000 7fe2619d5740 1 --2- 172.21.15.50:0/4061158695 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x55cc35d80810 0x55cc35d80c30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.035+0000 7fe2377fe640 0 client.7386 ms_handle_reset on v2:172.21.15.50:6834/3565485635 2024-09-11T22:16:09.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.035+0000 7fe2619d5740 1 --2- 172.21.15.50:0/4061158695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d62a50 0x55cc35d8b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.035+0000 7fe2619d5740 1 --2- 172.21.15.50:0/4061158695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5f800 0x55cc35d5fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.035+0000 7fe2619d5740 1 --2- 172.21.15.50:0/4061158695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35d7f8d0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.035+0000 7fe2619d5740 1 -- 172.21.15.50:0/4061158695 >> 172.21.15.50:0/4061158695 conn(0x55cc35d5ea80 msgr2=0x55cc35da3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:09.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.035+0000 7fe2619d5740 1 -- 172.21.15.50:0/4061158695 shutdown_connections 2024-09-11T22:16:09.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.035+0000 7fe2619d5740 1 -- 172.21.15.50:0/4061158695 wait complete. 2024-09-11T22:16:09.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.035+0000 7fe2619d5740 20 client.7386 trim_cache size 0 max 16384 2024-09-11T22:16:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.053+0000 7fe2619d5740 1 Processor -- start 2024-09-11T22:16:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.053+0000 7fe2619d5740 1 -- start start 2024-09-11T22:16:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.053+0000 7fe2619d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5f800 0x55cc35da8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.053+0000 7fe2619d5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35d80bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.053+0000 7fe2619d5740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d62a50 0x55cc35d81130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.053+0000 7fe2619d5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581f7ce0 con 0x55cc35d612c0 2024-09-11T22:16:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.053+0000 7fe2619d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581f7040 con 0x55cc35d5f800 2024-09-11T22:16:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.053+0000 7fe2619d5740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe2581f7690 con 0x55cc35d62a50 2024-09-11T22:16:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.053+0000 7fe257fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35d80bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.054+0000 7fe257fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35d80bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45422/0 (socket says 172.21.15.50:45422) 2024-09-11T22:16:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.054+0000 7fe257fff640 1 -- 172.21.15.50:0/2000162888 learned_addr learned my addr 172.21.15.50:0/2000162888 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.054+0000 7fe257fff640 1 -- 172.21.15.50:0/2000162888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d62a50 msgr2=0x55cc35d81130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.054+0000 7fe257fff640 1 --2- 172.21.15.50:0/2000162888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d62a50 0x55cc35d81130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.054+0000 7fe25c8fb640 1 --2- 172.21.15.50:0/2000162888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5f800 0x55cc35da8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.054+0000 7fe257fff640 1 -- 172.21.15.50:0/2000162888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5f800 msgr2=0x55cc35da8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.054+0000 7fe257fff640 1 --2- 172.21.15.50:0/2000162888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5f800 0x55cc35da8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.054+0000 7fe257fff640 1 -- 172.21.15.50:0/2000162888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc35c49fb0 con 0x55cc35d612c0 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.054+0000 7fe257fff640 1 --2- 172.21.15.50:0/2000162888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35d80bf0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fe248009f40 tx=0x7fe24802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d015ed11625f7a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.054+0000 7fe24dffb640 1 -- 172.21.15.50:0/2000162888 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248036040 con 0x55cc35d612c0 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.054+0000 7fe24dffb640 1 -- 172.21.15.50:0/2000162888 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe248031e50 con 0x55cc35d612c0 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.054+0000 7fe24dffb640 1 -- 172.21.15.50:0/2000162888 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24803ca10 con 0x55cc35d612c0 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.055+0000 7fe2619d5740 1 -- 172.21.15.50:0/2000162888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 msgr2=0x55cc35d80bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.055+0000 7fe2619d5740 1 --2- 172.21.15.50:0/2000162888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35d80bf0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fe248009f40 tx=0x7fe24802e000 comp rx=0 tx=0).stop 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.055+0000 7fe2619d5740 1 -- 172.21.15.50:0/2000162888 shutdown_connections 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.055+0000 7fe2619d5740 1 --2- 172.21.15.50:0/2000162888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d62a50 0x55cc35d81130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.055+0000 7fe2619d5740 1 --2- 172.21.15.50:0/2000162888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35d80bf0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.055+0000 7fe2619d5740 1 --2- 172.21.15.50:0/2000162888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d5f800 0x55cc35da8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.055+0000 7fe2619d5740 1 -- 172.21.15.50:0/2000162888 >> 172.21.15.50:0/2000162888 conn(0x55cc35d5ea80 msgr2=0x55cc35d5f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.055+0000 7fe2619d5740 1 -- 172.21.15.50:0/2000162888 shutdown_connections 2024-09-11T22:16:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.055+0000 7fe2619d5740 1 -- 172.21.15.50:0/2000162888 wait complete. 2024-09-11T22:16:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.055+0000 7fe2619d5740 1 -- start start 2024-09-11T22:16:09.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.055+0000 7fe2619d5740 1 Processor -- start 2024-09-11T22:16:09.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.056+0000 7fe2619d5740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d5f800 0x55cc35e23b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.056+0000 7fe2619d5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35da5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.056+0000 7fe2619d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d62a50 0x55cc35da5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.056+0000 7fe2619d5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cc35d5ab50 con 0x55cc35d612c0 2024-09-11T22:16:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.056+0000 7fe2619d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cc35d81ae0 con 0x55cc35d62a50 2024-09-11T22:16:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.056+0000 7fe2619d5740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cc35d801e0 con 0x55cc35d5f800 2024-09-11T22:16:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.056+0000 7fe2619d5740 10 client.0 _ll_register_callbacks cb 0x7fe25008b0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.056+0000 7fe257fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35da5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.056+0000 7fe257fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35da5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45428/0 (socket says 172.21.15.50:45428) 2024-09-11T22:16:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.056+0000 7fe257fff640 1 -- 172.21.15.50:0/4023815139 learned_addr learned my addr 172.21.15.50:0/4023815139 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.056+0000 7fe25c8fb640 1 --2- 172.21.15.50:0/4023815139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d5f800 0x55cc35e23b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.056+0000 7fe25d0fc640 1 --2- 172.21.15.50:0/4023815139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d62a50 0x55cc35da5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe257fff640 1 -- 172.21.15.50:0/4023815139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d5f800 msgr2=0x55cc35e23b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe257fff640 1 --2- 172.21.15.50:0/4023815139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d5f800 0x55cc35e23b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe257fff640 1 -- 172.21.15.50:0/4023815139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d62a50 msgr2=0x55cc35da5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe257fff640 1 --2- 172.21.15.50:0/4023815139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d62a50 0x55cc35da5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe257fff640 1 -- 172.21.15.50:0/4023815139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc35dbf7f0 con 0x55cc35d612c0 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe257fff640 1 --2- 172.21.15.50:0/4023815139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35da5000 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe248009680 tx=0x7fe248004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a22b0a34e6c1cd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2377fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2377fe640 1 -- 172.21.15.50:0/4023815139 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248036040 con 0x55cc35d612c0 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2377fe640 1 -- 172.21.15.50:0/4023815139 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7fe24803c7f0 con 0x55cc35d612c0 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2619d5740 1 -- 172.21.15.50:0/4023815139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe248031e50 con 0x55cc35d612c0 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2377fe640 1 -- 172.21.15.50:0/4023815139 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fe24805f050 con 0x55cc35d612c0 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2619d5740 10 client.7392 fetch_fsmap learned FSMap version 70 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2619d5740 1 -- 172.21.15.50:0/4023815139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55cc35d812c0 con 0x55cc35d612c0 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2377fe640 1 -- 172.21.15.50:0/4023815139 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe248031e50 con 0x55cc35d612c0 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2377fe640 1 -- 172.21.15.50:0/4023815139 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7fe248062020 con 0x55cc35d612c0 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2619d5740 10 client.7392 fetch_fsmap finished waiting for FSMap version 70 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2619d5740 10 client.7392 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:16:09.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2619d5740 20 client.7392 populate_metadata read hostname 'smithi050' 2024-09-11T22:16:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2619d5740 1 --2- 172.21.15.50:0/4023815139 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x55cc35d80810 0x55cc35dc8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2619d5740 4 client.7392 mds_command: new command op to 6754 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:16:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.057+0000 7fe2619d5740 1 -- 172.21.15.50:0/4023815139 --> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] -- command(tid 0: {"prefix": "status"}) -- 0x55cc35ccafa0 con 0x55cc35d80810 2024-09-11T22:16:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe25c8fb640 1 --2- 172.21.15.50:0/4023815139 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x55cc35d80810 0x55cc35dc8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2377fe640 10 client.7392 ms_handle_connect on v2:172.21.15.50:6834/3565485635 2024-09-11T22:16:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe25c8fb640 1 --2- 172.21.15.50:0/4023815139 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x55cc35d80810 0x55cc35dc8ea0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b97da8906b9776ba server_cookie=ccc573abbb47949b in_seq=0 out_seq=0 2024-09-11T22:16:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2377fe640 1 -- 172.21.15.50:0/4023815139 <== mds.0 v2:172.21.15.50:6834/3565485635 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55cc35ccafa0 con 0x55cc35d80810 2024-09-11T22:16:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2377fe640 10 client.7392 handle_command_reply: tid=0 2024-09-11T22:16:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2619d5740 1 client.7392 shutdown 2024-09-11T22:16:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2619d5740 1 -- 172.21.15.50:0/4023815139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 msgr2=0x55cc35da5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2619d5740 1 --2- 172.21.15.50:0/4023815139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35da5000 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe248009680 tx=0x7fe248004ab0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2619d5740 1 -- 172.21.15.50:0/4023815139 shutdown_connections 2024-09-11T22:16:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2619d5740 1 --2- 172.21.15.50:0/4023815139 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x55cc35d80810 0x55cc35dc8ea0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2619d5740 1 --2- 172.21.15.50:0/4023815139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc35d62a50 0x55cc35da5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2377fe640 0 client.7392 ms_handle_reset on v2:172.21.15.50:6834/3565485635 2024-09-11T22:16:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2619d5740 1 --2- 172.21.15.50:0/4023815139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc35d612c0 0x55cc35da5000 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2619d5740 1 --2- 172.21.15.50:0/4023815139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc35d5f800 0x55cc35e23b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2619d5740 1 -- 172.21.15.50:0/4023815139 >> 172.21.15.50:0/4023815139 conn(0x55cc35d5ea80 msgr2=0x55cc35da8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2619d5740 1 -- 172.21.15.50:0/4023815139 shutdown_connections 2024-09-11T22:16:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2619d5740 1 -- 172.21.15.50:0/4023815139 wait complete. 2024-09-11T22:16:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.058+0000 7fe2619d5740 20 client.7392 trim_cache size 0 max 16384 2024-09-11T22:16:09.065 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:16:09.065 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:16:09.066 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:16:09.066 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6754, 2024-09-11T22:16:09.066 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:16:09.066 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:16:09.066 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:16:09.066 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 5.2263732879999996, 2024-09-11T22:16:09.066 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 70, 2024-09-11T22:16:09.066 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 95, 2024-09-11T22:16:09.066 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 95, 2024-09-11T22:16:09.066 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 6.1237109140000001 2024-09-11T22:16:09.066 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:16:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.059+0000 7fe25eb5f640 1 -- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe23806be30 msgr2=0x7fe23806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.059+0000 7fe25eb5f640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe23806be30 0x7fe23806e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe248033000 tx=0x7fe248009000 comp rx=0 tx=0).stop 2024-09-11T22:16:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.059+0000 7fe25eb5f640 1 -- 172.21.15.50:0/351260399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2580d16d0 msgr2=0x7fe2580ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.059+0000 7fe25eb5f640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2580d16d0 0x7fe2580ab860 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe25000d620 tx=0x7fe25000dae0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.059+0000 7fe25eb5f640 1 -- 172.21.15.50:0/351260399 shutdown_connections 2024-09-11T22:16:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.059+0000 7fe25eb5f640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe23806be30 0x7fe23806e2f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.059+0000 7fe25eb5f640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe25815e870 0x7fe25815d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.059+0000 7fe25eb5f640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2580d3a30 0x7fe2581f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.059+0000 7fe25eb5f640 1 --2- 172.21.15.50:0/351260399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2580d16d0 0x7fe2580ab860 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.059+0000 7fe25eb5f640 1 -- 172.21.15.50:0/351260399 >> 172.21.15.50:0/351260399 conn(0x7fe2580727a0 msgr2=0x7fe2580ba040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.059+0000 7fe25eb5f640 1 -- 172.21.15.50:0/351260399 shutdown_connections 2024-09-11T22:16:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.059+0000 7fe25eb5f640 1 -- 172.21.15.50:0/351260399 wait complete. 2024-09-11T22:16:09.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-11T22:16:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.175+0000 7fee7b223640 1 Processor -- start 2024-09-11T22:16:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.175+0000 7fee7b223640 1 -- start start 2024-09-11T22:16:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee7b223640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee74161d30 0x7fee740cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee7b223640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee740b78f0 0x7fee74162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee7b223640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fee740d11d0 0x7fee740d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee7b223640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fee740d3450 con 0x7fee74161d30 2024-09-11T22:16:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee7b223640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fee741632e0 con 0x7fee740d11d0 2024-09-11T22:16:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee7b223640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fee74162110 con 0x7fee740b78f0 2024-09-11T22:16:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee78fbf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee74161d30 0x7fee740cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee78fbf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee74161d30 0x7fee740cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45440/0 (socket says 172.21.15.50:45440) 2024-09-11T22:16:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee78fbf640 1 -- 172.21.15.50:0/1466952171 learned_addr learned my addr 172.21.15.50:0/1466952171 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee73fff640 1 --2- 172.21.15.50:0/1466952171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee740b78f0 0x7fee74162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee797c0640 1 --2- 172.21.15.50:0/1466952171 >> v2:172.21.15.77:3300/0 conn(0x7fee740d11d0 0x7fee740d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee78fbf640 1 -- 172.21.15.50:0/1466952171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee740b78f0 msgr2=0x7fee74162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee78fbf640 1 --2- 172.21.15.50:0/1466952171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee740b78f0 0x7fee74162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee78fbf640 1 -- 172.21.15.50:0/1466952171 >> v2:172.21.15.77:3300/0 conn(0x7fee740d11d0 msgr2=0x7fee740d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee78fbf640 1 --2- 172.21.15.50:0/1466952171 >> v2:172.21.15.77:3300/0 conn(0x7fee740d11d0 0x7fee740d1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.176+0000 7fee78fbf640 1 -- 172.21.15.50:0/1466952171 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee740cfd70 con 0x7fee74161d30 2024-09-11T22:16:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.177+0000 7fee78fbf640 1 --2- 172.21.15.50:0/1466952171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee74161d30 0x7fee740cf790 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fee740d1d70 tx=0x7fee6402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de44d49d78b854b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.177+0000 7fee737fe640 1 -- 172.21.15.50:0/1466952171 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64037070 con 0x7fee74161d30 2024-09-11T22:16:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.177+0000 7fee737fe640 1 -- 172.21.15.50:0/1466952171 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee64032440 con 0x7fee74161d30 2024-09-11T22:16:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.177+0000 7fee737fe640 1 -- 172.21.15.50:0/1466952171 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64032810 con 0x7fee74161d30 2024-09-11T22:16:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.178+0000 7fee7b223640 1 -- 172.21.15.50:0/1466952171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee74161d30 msgr2=0x7fee740cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.178+0000 7fee7b223640 1 --2- 172.21.15.50:0/1466952171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee74161d30 0x7fee740cf790 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fee740d1d70 tx=0x7fee6402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.178+0000 7fee7b223640 1 -- 172.21.15.50:0/1466952171 shutdown_connections 2024-09-11T22:16:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.178+0000 7fee7b223640 1 --2- 172.21.15.50:0/1466952171 >> v2:172.21.15.77:3300/0 conn(0x7fee740d11d0 0x7fee740d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.178+0000 7fee7b223640 1 --2- 172.21.15.50:0/1466952171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee740b78f0 0x7fee74162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.178+0000 7fee7b223640 1 --2- 172.21.15.50:0/1466952171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee74161d30 0x7fee740cf790 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.178+0000 7fee7b223640 1 -- 172.21.15.50:0/1466952171 >> 172.21.15.50:0/1466952171 conn(0x7fee740727a0 msgr2=0x7fee740679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.178+0000 7fee7b223640 1 -- 172.21.15.50:0/1466952171 shutdown_connections 2024-09-11T22:16:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.178+0000 7fee7b223640 1 -- 172.21.15.50:0/1466952171 wait complete. 2024-09-11T22:16:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.179+0000 7fee7b223640 1 Processor -- start 2024-09-11T22:16:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.179+0000 7fee7b223640 1 -- start start 2024-09-11T22:16:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.180+0000 7fee7b223640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee740b78f0 0x7fee740b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.180+0000 7fee7b223640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee740d11d0 0x7fee741567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.180+0000 7fee7b223640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee74161d30 0x7fee74155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.180+0000 7fee7b223640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fee740d30e0 con 0x7fee74161d30 2024-09-11T22:16:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.180+0000 7fee7b223640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fee740d2e00 con 0x7fee740b78f0 2024-09-11T22:16:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.180+0000 7fee7b223640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fee740b7d30 con 0x7fee740d11d0 2024-09-11T22:16:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.180+0000 7fee797c0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee74161d30 0x7fee74155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.180+0000 7fee797c0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee74161d30 0x7fee74155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45456/0 (socket says 172.21.15.50:45456) 2024-09-11T22:16:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.180+0000 7fee797c0640 1 -- 172.21.15.50:0/3272595908 learned_addr learned my addr 172.21.15.50:0/3272595908 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.180+0000 7fee78fbf640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee740b78f0 0x7fee740b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.180+0000 7fee73fff640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee740d11d0 0x7fee741567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.180+0000 7fee797c0640 1 -- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee740d11d0 msgr2=0x7fee741567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.180+0000 7fee797c0640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee740d11d0 0x7fee741567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.181+0000 7fee797c0640 1 -- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee740b78f0 msgr2=0x7fee740b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.181+0000 7fee797c0640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee740b78f0 0x7fee740b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.181+0000 7fee797c0640 1 -- 172.21.15.50:0/3272595908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee740b4600 con 0x7fee74161d30 2024-09-11T22:16:09.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.181+0000 7fee797c0640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee74161d30 0x7fee74155f90 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fee6c007e40 tx=0x7fee6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.181+0000 7fee717fa640 1 -- 172.21.15.50:0/3272595908 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c014620 con 0x7fee74161d30 2024-09-11T22:16:09.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.181+0000 7fee717fa640 1 -- 172.21.15.50:0/3272595908 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6c019070 con 0x7fee74161d30 2024-09-11T22:16:09.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.181+0000 7fee717fa640 1 -- 172.21.15.50:0/3272595908 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c014a20 con 0x7fee74161d30 2024-09-11T22:16:09.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.181+0000 7fee7b223640 1 -- 172.21.15.50:0/3272595908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee740b48e0 con 0x7fee74161d30 2024-09-11T22:16:09.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.181+0000 7fee7b223640 1 -- 172.21.15.50:0/3272595908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee740b4ea0 con 0x7fee74161d30 2024-09-11T22:16:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.182+0000 7fee7b223640 1 -- 172.21.15.50:0/3272595908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee74162da0 con 0x7fee74161d30 2024-09-11T22:16:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.182+0000 7fee717fa640 1 -- 172.21.15.50:0/3272595908 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee6c014bc0 con 0x7fee74161d30 2024-09-11T22:16:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.183+0000 7fee717fa640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee6006be60 0x7fee6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.183+0000 7fee717fa640 1 -- 172.21.15.50:0/3272595908 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7fee6c08b6c0 con 0x7fee74161d30 2024-09-11T22:16:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.183+0000 7fee78fbf640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee6006be60 0x7fee6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.184+0000 7fee78fbf640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee6006be60 0x7fee6006e320 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fee64034000 tx=0x7fee6402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.187+0000 7fee717fa640 1 -- 172.21.15.50:0/3272595908 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee6c0599c0 con 0x7fee74161d30 2024-09-11T22:16:09.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.365+0000 7fee7b223640 1 -- 172.21.15.50:0/3272595908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fee740cc190 con 0x7fee74161d30 2024-09-11T22:16:09.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.368+0000 7fee717fa640 1 -- 172.21.15.50:0/3272595908 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v27)=0 v27) ==== 117+0+0 (secure 0 0 0) 0x7fee6c05dcc0 con 0x7fee74161d30 2024-09-11T22:16:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.370+0000 7fee7b223640 1 -- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee6006be60 msgr2=0x7fee6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.370+0000 7fee7b223640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee6006be60 0x7fee6006e320 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fee64034000 tx=0x7fee6402e000 comp rx=0 tx=0).stop 2024-09-11T22:16:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.370+0000 7fee7b223640 1 -- 172.21.15.50:0/3272595908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee74161d30 msgr2=0x7fee74155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.370+0000 7fee7b223640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee74161d30 0x7fee74155f90 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fee6c007e40 tx=0x7fee6c00e4b0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.370+0000 7fee7b223640 1 -- 172.21.15.50:0/3272595908 shutdown_connections 2024-09-11T22:16:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.370+0000 7fee7b223640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee6006be60 0x7fee6006e320 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.370+0000 7fee7b223640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee740d11d0 0x7fee741567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.370+0000 7fee7b223640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee74161d30 0x7fee74155f90 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.370+0000 7fee7b223640 1 --2- 172.21.15.50:0/3272595908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee740b78f0 0x7fee740b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.371+0000 7fee7b223640 1 -- 172.21.15.50:0/3272595908 >> 172.21.15.50:0/3272595908 conn(0x7fee740727a0 msgr2=0x7fee740d38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.371+0000 7fee7b223640 1 -- 172.21.15.50:0/3272595908 shutdown_connections 2024-09-11T22:16:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.371+0000 7fee7b223640 1 -- 172.21.15.50:0/3272595908 wait complete. 2024-09-11T22:16:09.382 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-11T22:16:09.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.487+0000 7fd1b3f54640 1 Processor -- start 2024-09-11T22:16:09.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.487+0000 7fd1b3f54640 1 -- start start 2024-09-11T22:16:09.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.488+0000 7fd1b3f54640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1ac15e8e0 0x7fd1ac0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.488+0000 7fd1b3f54640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1ac0d1580 0x7fd1ac0d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.488+0000 7fd1b3f54640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1ac0d1ee0 con 0x7fd1ac162350 2024-09-11T22:16:09.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.488+0000 7fd1b3f54640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ac15ecc0 con 0x7fd1ac15e8e0 2024-09-11T22:16:09.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.488+0000 7fd1b3f54640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ac0d2ad0 con 0x7fd1ac0d1580 2024-09-11T22:16:09.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.488+0000 7fd1b1cf0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1ac15e8e0 0x7fd1ac0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.488+0000 7fd1b1cf0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1ac15e8e0 0x7fd1ac0b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45458/0 (socket says 172.21.15.50:45458) 2024-09-11T22:16:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.488+0000 7fd1b1cf0640 1 -- 172.21.15.50:0/1528416226 learned_addr learned my addr 172.21.15.50:0/1528416226 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.488+0000 7fd1b1cf0640 1 -- 172.21.15.50:0/1528416226 >> v2:172.21.15.77:3300/0 conn(0x7fd1ac0d1580 msgr2=0x7fd1ac0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.488+0000 7fd1b1cf0640 1 --2- 172.21.15.50:0/1528416226 >> v2:172.21.15.77:3300/0 conn(0x7fd1ac0d1580 0x7fd1ac0d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.488+0000 7fd1b1cf0640 1 -- 172.21.15.50:0/1528416226 >> v1:172.21.15.77:6789/0 conn(0x7fd1ac162350 legacy=0x7fd1ac1627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.488+0000 7fd1b1cf0640 1 -- 172.21.15.50:0/1528416226 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac163080 con 0x7fd1ac15e8e0 2024-09-11T22:16:09.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.489+0000 7fd1b1cf0640 1 --2- 172.21.15.50:0/1528416226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac15e8e0 0x7fd1ac0b7880 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac1622b0 tx=0x7fd1a802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5864e1e32f9cb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.489+0000 7fd1b0cee640 1 -- 172.21.15.50:0/1528416226 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8037070 con 0x7fd1ac15e8e0 2024-09-11T22:16:09.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.489+0000 7fd1b0cee640 1 -- 172.21.15.50:0/1528416226 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a8032440 con 0x7fd1ac15e8e0 2024-09-11T22:16:09.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.489+0000 7fd1b0cee640 1 -- 172.21.15.50:0/1528416226 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8032810 con 0x7fd1ac15e8e0 2024-09-11T22:16:09.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.490+0000 7fd1b3f54640 1 -- 172.21.15.50:0/1528416226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac15e8e0 msgr2=0x7fd1ac0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.490+0000 7fd1b3f54640 1 --2- 172.21.15.50:0/1528416226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac15e8e0 0x7fd1ac0b7880 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac1622b0 tx=0x7fd1a802a2c0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.490+0000 7fd1b3f54640 1 -- 172.21.15.50:0/1528416226 shutdown_connections 2024-09-11T22:16:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.490+0000 7fd1b3f54640 1 --2- 172.21.15.50:0/1528416226 >> v2:172.21.15.77:3300/0 conn(0x7fd1ac0d1580 0x7fd1ac0d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.490+0000 7fd1b3f54640 1 --2- 172.21.15.50:0/1528416226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac15e8e0 0x7fd1ac0b7880 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.490+0000 7fd1b3f54640 1 -- 172.21.15.50:0/1528416226 >> 172.21.15.50:0/1528416226 conn(0x7fd1ac067ba0 msgr2=0x7fd1ac067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.490+0000 7fd1b3f54640 1 -- 172.21.15.50:0/1528416226 shutdown_connections 2024-09-11T22:16:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.490+0000 7fd1b3f54640 1 -- 172.21.15.50:0/1528416226 wait complete. 2024-09-11T22:16:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.491+0000 7fd1b3f54640 1 Processor -- start 2024-09-11T22:16:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.491+0000 7fd1b3f54640 1 -- start start 2024-09-11T22:16:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.492+0000 7fd1b3f54640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1580 0x7fd1ac1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.492+0000 7fd1b3f54640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ac15e8e0 0x7fd1ac0cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.492+0000 7fd1b3f54640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ac162350 0x7fd1ac0b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.492+0000 7fd1b3f54640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac0d3000 con 0x7fd1ac0d1580 2024-09-11T22:16:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.492+0000 7fd1b3f54640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac0d3370 con 0x7fd1ac15e8e0 2024-09-11T22:16:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.492+0000 7fd1b3f54640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ac0d3800 con 0x7fd1ac162350 2024-09-11T22:16:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.492+0000 7fd1b1cf0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1580 0x7fd1ac1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.492+0000 7fd1b1cf0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1580 0x7fd1ac1537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45466/0 (socket says 172.21.15.50:45466) 2024-09-11T22:16:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.492+0000 7fd1b1cf0640 1 -- 172.21.15.50:0/2459620972 learned_addr learned my addr 172.21.15.50:0/2459620972 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.492+0000 7fd1b14ef640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ac15e8e0 0x7fd1ac0cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.492+0000 7fd1b24f1640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ac162350 0x7fd1ac0b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.492+0000 7fd1b1cf0640 1 -- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ac162350 msgr2=0x7fd1ac0b8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.492+0000 7fd1b1cf0640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ac162350 0x7fd1ac0b8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.493+0000 7fd1b1cf0640 1 -- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ac15e8e0 msgr2=0x7fd1ac0cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.493+0000 7fd1b1cf0640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ac15e8e0 0x7fd1ac0cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.493+0000 7fd1b1cf0640 1 -- 172.21.15.50:0/2459620972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac157e20 con 0x7fd1ac0d1580 2024-09-11T22:16:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.493+0000 7fd1b14ef640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ac15e8e0 0x7fd1ac0cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.493+0000 7fd1b24f1640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ac162350 0x7fd1ac0b8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.493+0000 7fd1b1cf0640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1580 0x7fd1ac1537a0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8000c00 tx=0x7fd1a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.493+0000 7fd1a27fc640 1 -- 172.21.15.50:0/2459620972 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8041070 con 0x7fd1ac0d1580 2024-09-11T22:16:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.493+0000 7fd1a27fc640 1 -- 172.21.15.50:0/2459620972 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a803c870 con 0x7fd1ac0d1580 2024-09-11T22:16:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.493+0000 7fd1a27fc640 1 -- 172.21.15.50:0/2459620972 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8037040 con 0x7fd1ac0d1580 2024-09-11T22:16:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.493+0000 7fd1b3f54640 1 -- 172.21.15.50:0/2459620972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ac158100 con 0x7fd1ac0d1580 2024-09-11T22:16:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.493+0000 7fd1b3f54640 1 -- 172.21.15.50:0/2459620972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ac1586c0 con 0x7fd1ac0d1580 2024-09-11T22:16:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.494+0000 7fd1b3f54640 1 -- 172.21.15.50:0/2459620972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ac0d19a0 con 0x7fd1ac0d1580 2024-09-11T22:16:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.495+0000 7fd1a27fc640 1 -- 172.21.15.50:0/2459620972 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1a8044070 con 0x7fd1ac0d1580 2024-09-11T22:16:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.495+0000 7fd1a27fc640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd19006be30 0x7fd19006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.495+0000 7fd1a27fc640 1 -- 172.21.15.50:0/2459620972 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7fd1a80abac0 con 0x7fd1ac0d1580 2024-09-11T22:16:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.495+0000 7fd1b14ef640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd19006be30 0x7fd19006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.496+0000 7fd1b14ef640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd19006be30 0x7fd19006e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd19c006fd0 tx=0x7fd19c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.499+0000 7fd1a27fc640 1 -- 172.21.15.50:0/2459620972 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1a807a5b0 con 0x7fd1ac0d1580 2024-09-11T22:16:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.674+0000 7fd1b3f54640 1 -- 172.21.15.50:0/2459620972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fd1ac0ba770 con 0x7fd1ac0d1580 2024-09-11T22:16:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.677+0000 7fd1a27fc640 1 -- 172.21.15.50:0/2459620972 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v28)=0 v28) ==== 116+0+0 (secure 0 0 0) 0x7fd1a8079eb0 con 0x7fd1ac0d1580 2024-09-11T22:16:09.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.679+0000 7fd1b3f54640 1 -- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd19006be30 msgr2=0x7fd19006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.679+0000 7fd1b3f54640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd19006be30 0x7fd19006e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd19c006fd0 tx=0x7fd19c008040 comp rx=0 tx=0).stop 2024-09-11T22:16:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.679+0000 7fd1b3f54640 1 -- 172.21.15.50:0/2459620972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1580 msgr2=0x7fd1ac1537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.679+0000 7fd1b3f54640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1580 0x7fd1ac1537a0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8000c00 tx=0x7fd1a80046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.679+0000 7fd1b3f54640 1 -- 172.21.15.50:0/2459620972 shutdown_connections 2024-09-11T22:16:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.679+0000 7fd1b3f54640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd19006be30 0x7fd19006e2f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.679+0000 7fd1b3f54640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ac162350 0x7fd1ac0b8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.679+0000 7fd1b3f54640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ac15e8e0 0x7fd1ac0cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.679+0000 7fd1b3f54640 1 --2- 172.21.15.50:0/2459620972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1580 0x7fd1ac1537a0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.679+0000 7fd1b3f54640 1 -- 172.21.15.50:0/2459620972 >> 172.21.15.50:0/2459620972 conn(0x7fd1ac067ba0 msgr2=0x7fd1ac0cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.680+0000 7fd1b3f54640 1 -- 172.21.15.50:0/2459620972 shutdown_connections 2024-09-11T22:16:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.680+0000 7fd1b3f54640 1 -- 172.21.15.50:0/2459620972 wait complete. 2024-09-11T22:16:09.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-11T22:16:09.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.796+0000 7f69f9223640 1 Processor -- start 2024-09-11T22:16:09.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.796+0000 7f69f9223640 1 -- start start 2024-09-11T22:16:09.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.797+0000 7f69f9223640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f69f40cdd50 0x7f69f40b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.797+0000 7f69f9223640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f40ce5f0 con 0x7f69f40cf580 2024-09-11T22:16:09.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.797+0000 7f69f9223640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f40ce310 con 0x7f69f415e840 2024-09-11T22:16:09.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.797+0000 7f69f9223640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f69f406c240 con 0x7f69f40cdd50 2024-09-11T22:16:09.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.797+0000 7f69f359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f69f40cdd50 0x7f69f40b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.797+0000 7f69f259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f69f40cf580 0x7f69f406c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48610/0 (socket says 172.21.15.50:48610) 2024-09-11T22:16:09.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.797+0000 7f69f259c640 1 -- 172.21.15.50:0/3597023110 learned_addr learned my addr 172.21.15.50:0/3597023110 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:09.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.798+0000 7f69f359e640 1 -- 172.21.15.50:0/3597023110 >> v1:172.21.15.77:6789/0 conn(0x7f69f415e840 legacy=0x7f69f40cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.798+0000 7f69f359e640 1 -- 172.21.15.50:0/3597023110 >> v1:172.21.15.50:6789/0 conn(0x7f69f40cf580 legacy=0x7f69f406c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.798+0000 7f69f1d9b640 1 -- 172.21.15.50:0/3597023110 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161513767 0 0) 0x7f69f40ce5f0 con 0x7f69f40cf580 2024-09-11T22:16:09.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.798+0000 7f69f359e640 1 -- 172.21.15.50:0/3597023110 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f406bbf0 con 0x7f69f40cdd50 2024-09-11T22:16:09.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.798+0000 7f69f359e640 1 --2- 172.21.15.50:0/3597023110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f40cdd50 0x7f69f40b4c70 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0097a0 tx=0x7f69ec02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608a6d2abde3830 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.798+0000 7f69f1d9b640 1 -- 172.21.15.50:0/3597023110 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec037070 con 0x7f69f40cdd50 2024-09-11T22:16:09.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.798+0000 7f69f1d9b640 1 -- 172.21.15.50:0/3597023110 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ec032440 con 0x7f69f40cdd50 2024-09-11T22:16:09.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.798+0000 7f69f1d9b640 1 -- 172.21.15.50:0/3597023110 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec032810 con 0x7f69f40cdd50 2024-09-11T22:16:09.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.799+0000 7f69f9223640 1 -- 172.21.15.50:0/3597023110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f40cdd50 msgr2=0x7f69f40b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.799+0000 7f69f9223640 1 --2- 172.21.15.50:0/3597023110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f40cdd50 0x7f69f40b4c70 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0097a0 tx=0x7f69ec02a230 comp rx=0 tx=0).stop 2024-09-11T22:16:09.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.799+0000 7f69f9223640 1 -- 172.21.15.50:0/3597023110 shutdown_connections 2024-09-11T22:16:09.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.799+0000 7f69f9223640 1 --2- 172.21.15.50:0/3597023110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f40cdd50 0x7f69f40b4c70 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.799+0000 7f69f9223640 1 -- 172.21.15.50:0/3597023110 >> 172.21.15.50:0/3597023110 conn(0x7f69f40b4150 msgr2=0x7f69f40b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:09.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.799+0000 7f69f9223640 1 -- 172.21.15.50:0/3597023110 shutdown_connections 2024-09-11T22:16:09.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.799+0000 7f69f9223640 1 -- 172.21.15.50:0/3597023110 wait complete. 2024-09-11T22:16:09.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.800+0000 7f69f9223640 1 Processor -- start 2024-09-11T22:16:09.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.801+0000 7f69f9223640 1 -- start start 2024-09-11T22:16:09.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.801+0000 7f69f9223640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69f40cdd50 0x7f69f415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.801+0000 7f69f9223640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69f40cf580 0x7f69f40b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.801+0000 7f69f9223640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f415e840 0x7f69f40b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.801+0000 7f69f9223640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69f415ec20 con 0x7f69f415e840 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.801+0000 7f69f9223640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f69f40d0470 con 0x7f69f40cf580 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.801+0000 7f69f9223640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f69f415eda0 con 0x7f69f40cdd50 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.801+0000 7f69f359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f415e840 0x7f69f40b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.801+0000 7f69f359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f415e840 0x7f69f40b79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45486/0 (socket says 172.21.15.50:45486) 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.801+0000 7f69f359e640 1 -- 172.21.15.50:0/3570990231 learned_addr learned my addr 172.21.15.50:0/3570990231 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.802+0000 7f69f259c640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69f40cf580 0x7f69f40b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.802+0000 7f69f2d9d640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69f40cdd50 0x7f69f415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.802+0000 7f69f359e640 1 -- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69f40cdd50 msgr2=0x7f69f415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.802+0000 7f69f359e640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69f40cdd50 0x7f69f415abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.802+0000 7f69f359e640 1 -- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69f40cf580 msgr2=0x7f69f40b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.802+0000 7f69f359e640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69f40cf580 0x7f69f40b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.802+0000 7f69f359e640 1 -- 172.21.15.50:0/3570990231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f40b5830 con 0x7f69f415e840 2024-09-11T22:16:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.802+0000 7f69f359e640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f415e840 0x7f69f40b79c0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0097a0 tx=0x7f69ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.802+0000 7f69eb7fe640 1 -- 172.21.15.50:0/3570990231 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec037050 con 0x7f69f415e840 2024-09-11T22:16:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.802+0000 7f69eb7fe640 1 -- 172.21.15.50:0/3570990231 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ec038040 con 0x7f69f415e840 2024-09-11T22:16:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.802+0000 7f69f9223640 1 -- 172.21.15.50:0/3570990231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f40b5b10 con 0x7f69f415e840 2024-09-11T22:16:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.802+0000 7f69eb7fe640 1 -- 172.21.15.50:0/3570990231 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec004470 con 0x7f69f415e840 2024-09-11T22:16:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.802+0000 7f69f9223640 1 -- 172.21.15.50:0/3570990231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f40ca7f0 con 0x7f69f415e840 2024-09-11T22:16:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.803+0000 7f69f9223640 1 -- 172.21.15.50:0/3570990231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f4075770 con 0x7f69f415e840 2024-09-11T22:16:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.804+0000 7f69eb7fe640 1 -- 172.21.15.50:0/3570990231 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69ec030980 con 0x7f69f415e840 2024-09-11T22:16:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.804+0000 7f69eb7fe640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69d406be30 0x7f69d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.804+0000 7f69eb7fe640 1 -- 172.21.15.50:0/3570990231 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7f69ec0abc60 con 0x7f69f415e840 2024-09-11T22:16:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.805+0000 7f69f2d9d640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69d406be30 0x7f69d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.805+0000 7f69f2d9d640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69d406be30 0x7f69d406e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f69e40012e0 tx=0x7f69e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:09.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.809+0000 7f69eb7fe640 1 -- 172.21.15.50:0/3570990231 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69ec07a630 con 0x7f69f415e840 2024-09-11T22:16:09.833 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-09-11T22:16:09.832+0000 7fbbd5509640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:16:09.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.989+0000 7f69f9223640 1 -- 172.21.15.50:0/3570990231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f69f40ce5f0 con 0x7f69f415e840 2024-09-11T22:16:09.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.992+0000 7f69eb7fe640 1 -- 172.21.15.50:0/3570990231 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v29)=0 v29) ==== 116+0+0 (secure 0 0 0) 0x7f69ec079f30 con 0x7f69f415e840 2024-09-11T22:16:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.994+0000 7f69f9223640 1 -- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69d406be30 msgr2=0x7f69d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.994+0000 7f69f9223640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69d406be30 0x7f69d406e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f69e40012e0 tx=0x7f69e4009040 comp rx=0 tx=0).stop 2024-09-11T22:16:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.994+0000 7f69f9223640 1 -- 172.21.15.50:0/3570990231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f415e840 msgr2=0x7f69f40b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.994+0000 7f69f9223640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f415e840 0x7f69f40b79c0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0097a0 tx=0x7f69ec0046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.994+0000 7f69f9223640 1 -- 172.21.15.50:0/3570990231 shutdown_connections 2024-09-11T22:16:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.994+0000 7f69f9223640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f69d406be30 0x7f69d406e2f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.994+0000 7f69f9223640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69f415e840 0x7f69f40b79c0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.994+0000 7f69f9223640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69f40cf580 0x7f69f40b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.994+0000 7f69f9223640 1 --2- 172.21.15.50:0/3570990231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69f40cdd50 0x7f69f415abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.994+0000 7f69f9223640 1 -- 172.21.15.50:0/3570990231 >> 172.21.15.50:0/3570990231 conn(0x7f69f40b4150 msgr2=0x7f69f406c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.994+0000 7f69f9223640 1 -- 172.21.15.50:0/3570990231 shutdown_connections 2024-09-11T22:16:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:09.994+0000 7f69f9223640 1 -- 172.21.15.50:0/3570990231 wait complete. 2024-09-11T22:16:10.006 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.107+0000 7f9c21e7b640 1 Processor -- start 2024-09-11T22:16:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.107+0000 7f9c21e7b640 1 -- start start 2024-09-11T22:16:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.108+0000 7f9c21e7b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9c1c0b1600 0x7f9c1c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.108+0000 7f9c21e7b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c1c0cfbd0 con 0x7f9c1c161fa0 2024-09-11T22:16:10.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.108+0000 7f9c21e7b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c1c0cfeb0 con 0x7f9c1c0cf610 2024-09-11T22:16:10.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.108+0000 7f9c21e7b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9c1c0d1220 con 0x7f9c1c0b1600 2024-09-11T22:16:10.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.108+0000 7f9c1bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9c1c0b1600 0x7f9c1c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.108+0000 7f9c1b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9c1c161fa0 0x7f9c1c0cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48620/0 (socket says 172.21.15.50:48620) 2024-09-11T22:16:10.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.108+0000 7f9c1b7fe640 1 -- 172.21.15.50:0/1418933946 learned_addr learned my addr 172.21.15.50:0/1418933946 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.108+0000 7f9c1bfff640 1 -- 172.21.15.50:0/1418933946 >> v1:172.21.15.77:6789/0 conn(0x7f9c1c0cf610 legacy=0x7f9c1c0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.108+0000 7f9c1bfff640 1 -- 172.21.15.50:0/1418933946 >> v1:172.21.15.50:6789/0 conn(0x7f9c1c161fa0 legacy=0x7f9c1c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.108+0000 7f9c1bfff640 1 -- 172.21.15.50:0/1418933946 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1c0d1470 con 0x7f9c1c0b1600 2024-09-11T22:16:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.108+0000 7f9c1a7fc640 1 -- 172.21.15.50:0/1418933946 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2936338354 0 0) 0x7f9c1c0cfbd0 con 0x7f9c1c161fa0 2024-09-11T22:16:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.109+0000 7f9c1bfff640 1 --2- 172.21.15.50:0/1418933946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0b1600 0x7f9c1c0b4d20 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009d90 tx=0x7f9c1402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4fafa5c9ed8863 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.109+0000 7f9c1a7fc640 1 -- 172.21.15.50:0/1418933946 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14007740 con 0x7f9c1c0b1600 2024-09-11T22:16:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.109+0000 7f9c1a7fc640 1 -- 172.21.15.50:0/1418933946 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c140078e0 con 0x7f9c1c0b1600 2024-09-11T22:16:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.109+0000 7f9c1a7fc640 1 -- 172.21.15.50:0/1418933946 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14007cb0 con 0x7f9c1c0b1600 2024-09-11T22:16:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.110+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1418933946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0b1600 msgr2=0x7f9c1c0b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.110+0000 7f9c21e7b640 1 --2- 172.21.15.50:0/1418933946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0b1600 0x7f9c1c0b4d20 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009d90 tx=0x7f9c1402a6f0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.110+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1418933946 shutdown_connections 2024-09-11T22:16:10.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.110+0000 7f9c21e7b640 1 --2- 172.21.15.50:0/1418933946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0b1600 0x7f9c1c0b4d20 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.110+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1418933946 >> 172.21.15.50:0/1418933946 conn(0x7f9c1c09ba50 msgr2=0x7f9c1c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.110+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1418933946 shutdown_connections 2024-09-11T22:16:10.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.110+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1418933946 wait complete. 2024-09-11T22:16:10.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.111+0000 7f9c21e7b640 1 Processor -- start 2024-09-11T22:16:10.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.111+0000 7f9c21e7b640 1 -- start start 2024-09-11T22:16:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c21e7b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0b1600 0x7f9c1c1f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c21e7b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c1c0cf610 0x7f9c1c0c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c21e7b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1c161fa0 0x7f9c1c1f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c21e7b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c0d1c70 con 0x7f9c1c0b1600 2024-09-11T22:16:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c21e7b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c0d17e0 con 0x7f9c1c161fa0 2024-09-11T22:16:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c21e7b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1c0d1df0 con 0x7f9c1c0cf610 2024-09-11T22:16:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c1b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0b1600 0x7f9c1c1f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c1b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0b1600 0x7f9c1c1f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45502/0 (socket says 172.21.15.50:45502) 2024-09-11T22:16:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c1b7fe640 1 -- 172.21.15.50:0/1851829636 learned_addr learned my addr 172.21.15.50:0/1851829636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c1bfff640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1c161fa0 0x7f9c1c1f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c1affd640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c1c0cf610 0x7f9c1c0c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c1b7fe640 1 -- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c1c0cf610 msgr2=0x7f9c1c0c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c1b7fe640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c1c0cf610 0x7f9c1c0c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c1b7fe640 1 -- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1c161fa0 msgr2=0x7f9c1c1f4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c1b7fe640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1c161fa0 0x7f9c1c1f4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c1b7fe640 1 -- 172.21.15.50:0/1851829636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1c1f8900 con 0x7f9c1c0b1600 2024-09-11T22:16:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c1affd640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c1c0cf610 0x7f9c1c0c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c1b7fe640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0b1600 0x7f9c1c1f83c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00c4a0 tx=0x7f9c0c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.112+0000 7f9c03fff640 1 -- 172.21.15.50:0/1851829636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c018070 con 0x7f9c1c0b1600 2024-09-11T22:16:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.113+0000 7f9c03fff640 1 -- 172.21.15.50:0/1851829636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0c0074e0 con 0x7f9c1c0b1600 2024-09-11T22:16:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.113+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1851829636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c1c1f7be0 con 0x7f9c1c0b1600 2024-09-11T22:16:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.113+0000 7f9c03fff640 1 -- 172.21.15.50:0/1851829636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c004a20 con 0x7f9c1c0b1600 2024-09-11T22:16:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.113+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1851829636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c1c1f5180 con 0x7f9c1c0b1600 2024-09-11T22:16:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.114+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1851829636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c1c1f53c0 con 0x7f9c1c0b1600 2024-09-11T22:16:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.114+0000 7f9c03fff640 1 -- 172.21.15.50:0/1851829636 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c0c01b070 con 0x7f9c1c0b1600 2024-09-11T22:16:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.114+0000 7f9c03fff640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.115+0000 7f9c03fff640 1 -- 172.21.15.50:0/1851829636 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7f9c0c08a100 con 0x7f9c1c0b1600 2024-09-11T22:16:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.115+0000 7f9c1affd640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.115+0000 7f9c1affd640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9c10007fd0 tx=0x7f9c10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.119+0000 7f9c03fff640 1 -- 172.21.15.50:0/1851829636 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c1c1f53c0 con 0x7f9c1c0b1600 2024-09-11T22:16:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.330+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1851829636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c1c0b44b0 con 0x7f9c1c0b1600 2024-09-11T22:16:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.331+0000 7f9c03fff640 1 -- 172.21.15.50:0/1851829636 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5226 (secure 0 0 0) 0x7f9c0c0583f0 con 0x7f9c1c0b1600 2024-09-11T22:16:10.331 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:10.332 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"btime":"2024-09-11T22:16:06:835431+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1026980304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1026980304},{"type":"v1","addr":"172.21.15.50:6833","nonce":1026980304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3116356224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3116356224},{"type":"v1","addr":"172.21.15.77:6836","nonce":3116356224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3001000202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3001000202},{"type":"v1","addr":"172.21.15.77:6837","nonce":3001000202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:16:06.835421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6754":{"gid":6754,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3565485635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3565485635},{"type":"v1","addr":"172.21.15.50:6835","nonce":3565485635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6754,"qdb_cluster":[6754]},"id":6}]} 2024-09-11T22:16:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2024-09-11T22:16:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.332+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 msgr2=0x7f9c0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.332+0000 7f9c21e7b640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9c10007fd0 tx=0x7f9c10009040 comp rx=0 tx=0).stop 2024-09-11T22:16:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.333+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1851829636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0b1600 msgr2=0x7f9c1c1f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.333+0000 7f9c21e7b640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0b1600 0x7f9c1c1f83c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00c4a0 tx=0x7f9c0c00c960 comp rx=0 tx=0).stop 2024-09-11T22:16:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.333+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1851829636 shutdown_connections 2024-09-11T22:16:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.333+0000 7f9c21e7b640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.333+0000 7f9c21e7b640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c1c0cf610 0x7f9c1c0c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.333+0000 7f9c21e7b640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1c161fa0 0x7f9c1c1f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.333+0000 7f9c21e7b640 1 --2- 172.21.15.50:0/1851829636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0b1600 0x7f9c1c1f83c0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.333+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1851829636 >> 172.21.15.50:0/1851829636 conn(0x7f9c1c09ba50 msgr2=0x7f9c1c06c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.333+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1851829636 shutdown_connections 2024-09-11T22:16:10.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.333+0000 7f9c21e7b640 1 -- 172.21.15.50:0/1851829636 wait complete. 2024-09-11T22:16:10.345 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-11T22:16:10.462 INFO:teuthology.orchestra.run.smithi050.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-11T22:16:00.668396+0000","btime":"2024-09-11T22:15:59.896416+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-11T22:16:00.668396+0000","atime":"2024-09-11T22:15:59.896416+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-11T22:16:00.668396+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-11T22:16:00.669396+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-11T22:16:00.669396+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-11T22:16:10.463 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-11T22:16:00.669396+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-11T22:15:59.896416+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-11T22:15:59.896416+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-11T22:16:00.668396+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-11T22:16:00.668396+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-11T22:16:00.668396+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-11T22:16:00.669396+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-11T22:16:10.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:16:10.464 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /testdir recursive 2024-09-11T22:16:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.569+0000 7f3d8401e640 1 Processor -- start 2024-09-11T22:16:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.569+0000 7f3d8401e640 1 -- start start 2024-09-11T22:16:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d8401e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3d7c161d60 0x7f3d7c0d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d8401e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d7c0b6e40 0x7f3d7c0b8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d8401e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7c0b7990 con 0x7f3d7c0d39f0 2024-09-11T22:16:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d8401e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f3d7c0d4530 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d8401e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3d7c0d3f70 con 0x7f3d7c161d60 2024-09-11T22:16:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d825bb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d7c0b6e40 0x7f3d7c0b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d825bb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d7c0b6e40 0x7f3d7c0b8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45512/0 (socket says 172.21.15.50:45512) 2024-09-11T22:16:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d825bb640 1 -- 172.21.15.50:0/1563283876 learned_addr learned my addr 172.21.15.50:0/1563283876 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d81dba640 1 --2- 172.21.15.50:0/1563283876 >> v2:172.21.15.77:3300/0 conn(0x7f3d7c161d60 0x7f3d7c0d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d825bb640 1 -- 172.21.15.50:0/1563283876 >> v2:172.21.15.77:3300/0 conn(0x7f3d7c161d60 msgr2=0x7f3d7c0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d825bb640 1 --2- 172.21.15.50:0/1563283876 >> v2:172.21.15.77:3300/0 conn(0x7f3d7c161d60 0x7f3d7c0d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d825bb640 1 -- 172.21.15.50:0/1563283876 >> v1:172.21.15.77:6789/0 conn(0x7f3d7c0d39f0 legacy=0x7f3d7c0b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d825bb640 1 -- 172.21.15.50:0/1563283876 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c0d4250 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.570+0000 7f3d81dba640 1 --2- 172.21.15.50:0/1563283876 >> v2:172.21.15.77:3300/0 conn(0x7f3d7c161d60 0x7f3d7c0d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.571+0000 7f3d825bb640 1 --2- 172.21.15.50:0/1563283876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d7c0b6e40 0x7f3d7c0b8150 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0d3e60 tx=0x7f3d7402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d1fe724fea982e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.571+0000 7f3d80db8640 1 -- 172.21.15.50:0/1563283876 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74036070 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.571+0000 7f3d80db8640 1 -- 172.21.15.50:0/1563283876 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d74031600 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.571+0000 7f3d80db8640 1 -- 172.21.15.50:0/1563283876 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d740319d0 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.572+0000 7f3d8401e640 1 -- 172.21.15.50:0/1563283876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d7c0b6e40 msgr2=0x7f3d7c0b8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.572+0000 7f3d8401e640 1 --2- 172.21.15.50:0/1563283876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d7c0b6e40 0x7f3d7c0b8150 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0d3e60 tx=0x7f3d7402a6c0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.572+0000 7f3d8401e640 1 -- 172.21.15.50:0/1563283876 shutdown_connections 2024-09-11T22:16:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.572+0000 7f3d8401e640 1 --2- 172.21.15.50:0/1563283876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d7c0b6e40 0x7f3d7c0b8150 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.572+0000 7f3d8401e640 1 --2- 172.21.15.50:0/1563283876 >> v2:172.21.15.77:3300/0 conn(0x7f3d7c161d60 0x7f3d7c0d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.572+0000 7f3d8401e640 1 -- 172.21.15.50:0/1563283876 >> 172.21.15.50:0/1563283876 conn(0x7f3d7c067db0 msgr2=0x7f3d7c0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.572+0000 7f3d8401e640 1 -- 172.21.15.50:0/1563283876 shutdown_connections 2024-09-11T22:16:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.572+0000 7f3d8401e640 1 -- 172.21.15.50:0/1563283876 wait complete. 2024-09-11T22:16:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.573+0000 7f3d8401e640 1 Processor -- start 2024-09-11T22:16:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.573+0000 7f3d8401e640 1 -- start start 2024-09-11T22:16:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d8401e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d7c0b6e40 0x7f3d7c159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d8401e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d7c0d39f0 0x7f3d7c0ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d8401e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d7c161d60 0x7f3d7c15cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d8401e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c0b8690 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d8401e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c0cf930 con 0x7f3d7c0d39f0 2024-09-11T22:16:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d8401e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7c0b8810 con 0x7f3d7c161d60 2024-09-11T22:16:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d81dba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d7c0b6e40 0x7f3d7c159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d81dba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d7c0b6e40 0x7f3d7c159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45526/0 (socket says 172.21.15.50:45526) 2024-09-11T22:16:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d81dba640 1 -- 172.21.15.50:0/2638840497 learned_addr learned my addr 172.21.15.50:0/2638840497 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d815b9640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d7c0d39f0 0x7f3d7c0ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d825bb640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d7c161d60 0x7f3d7c15cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d81dba640 1 -- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d7c161d60 msgr2=0x7f3d7c15cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d81dba640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d7c161d60 0x7f3d7c15cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d81dba640 1 -- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d7c0d39f0 msgr2=0x7f3d7c0ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d81dba640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d7c0d39f0 0x7f3d7c0ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d81dba640 1 -- 172.21.15.50:0/2638840497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c15d6f0 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d815b9640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d7c0d39f0 0x7f3d7c0ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d825bb640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d7c161d60 0x7f3d7c15cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d81dba640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d7c0b6e40 0x7f3d7c159190 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800c820 tx=0x7f3d7800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.574+0000 7f3d727fc640 1 -- 172.21.15.50:0/2638840497 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78015070 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.575+0000 7f3d727fc640 1 -- 172.21.15.50:0/2638840497 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d78007a30 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.575+0000 7f3d8401e640 1 -- 172.21.15.50:0/2638840497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7c15d9d0 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.575+0000 7f3d727fc640 1 -- 172.21.15.50:0/2638840497 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78007de0 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.575+0000 7f3d8401e640 1 -- 172.21.15.50:0/2638840497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7c15df90 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.576+0000 7f3d727fc640 1 -- 172.21.15.50:0/2638840497 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d78018070 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.577+0000 7f3d727fc640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3d6006be30 0x7f3d6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.577+0000 7f3d727fc640 1 -- 172.21.15.50:0/2638840497 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7f3d7808ad60 con 0x7f3d7c0b6e40 2024-09-11T22:16:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.577+0000 7f3d815b9640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3d6006be30 0x7f3d6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.578+0000 7f3d815b9640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3d6006be30 0x7f3d6006e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c15ad80 tx=0x7f3d6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.578+0000 7f3d86e8c740 1 Processor -- start 2024-09-11T22:16:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.578+0000 7f3d86e8c740 1 -- start start 2024-09-11T22:16:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d86e8c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf39a500 0x555ecf39a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d86e8c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf397cc0 0x555ecf399850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d86e8c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf398120 0x555ecf37a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d86e8c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555ecf2b6ac0 con 0x555ecf398120 2024-09-11T22:16:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d86e8c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555ecf25e7b0 con 0x555ecf397cc0 2024-09-11T22:16:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d86e8c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x555ecf2b2a80 con 0x555ecf39a500 2024-09-11T22:16:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d825bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf398120 0x555ecf37a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d825bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf398120 0x555ecf37a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45536/0 (socket says 172.21.15.50:45536) 2024-09-11T22:16:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d825bb640 1 -- 172.21.15.50:0/1440827920 learned_addr learned my addr 172.21.15.50:0/1440827920 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d815b9640 1 --2- 172.21.15.50:0/1440827920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf397cc0 0x555ecf399850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d81dba640 1 --2- 172.21.15.50:0/1440827920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf39a500 0x555ecf39a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d825bb640 1 -- 172.21.15.50:0/1440827920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf39a500 msgr2=0x555ecf39a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d825bb640 1 --2- 172.21.15.50:0/1440827920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf39a500 0x555ecf39a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d825bb640 1 -- 172.21.15.50:0/1440827920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf397cc0 msgr2=0x555ecf399850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d825bb640 1 --2- 172.21.15.50:0/1440827920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf397cc0 0x555ecf399850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d825bb640 1 -- 172.21.15.50:0/1440827920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ecf095a20 con 0x555ecf398120 2024-09-11T22:16:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d825bb640 1 --2- 172.21.15.50:0/1440827920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf398120 0x555ecf37a480 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f3d74034040 tx=0x7f3d7402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da869fba0ecf3c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d5f7fe640 1 -- 172.21.15.50:0/1440827920 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74036040 con 0x555ecf398120 2024-09-11T22:16:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.579+0000 7f3d5f7fe640 1 -- 172.21.15.50:0/1440827920 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d740315c0 con 0x555ecf398120 2024-09-11T22:16:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.580+0000 7f3d5f7fe640 1 -- 172.21.15.50:0/1440827920 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74031970 con 0x555ecf398120 2024-09-11T22:16:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.580+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1440827920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf398120 msgr2=0x555ecf37a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.580+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1440827920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf398120 0x555ecf37a480 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f3d74034040 tx=0x7f3d7402e000 comp rx=0 tx=0).stop 2024-09-11T22:16:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.580+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1440827920 shutdown_connections 2024-09-11T22:16:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.580+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1440827920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf398120 0x555ecf37a480 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.580+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1440827920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf397cc0 0x555ecf399850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.580+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1440827920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf39a500 0x555ecf39a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.580+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1440827920 >> 172.21.15.50:0/1440827920 conn(0x555ecf350160 msgr2=0x555ecf398570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.580+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1440827920 shutdown_connections 2024-09-11T22:16:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.580+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1440827920 wait complete. 2024-09-11T22:16:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.581+0000 7f3d86e8c740 1 -- start start 2024-09-11T22:16:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.581+0000 7f3d86e8c740 1 Processor -- start 2024-09-11T22:16:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d86e8c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 0x555ecf378a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d86e8c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf391450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d86e8c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 0x555ecf391990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d86e8c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555ecf396c20 con 0x555ecf39a500 2024-09-11T22:16:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d86e8c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555ecf23f7b0 con 0x555ecf398120 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d86e8c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x555ecf396f00 con 0x555ecf37cbe0 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d86e8c740 10 client.0 _ll_register_callbacks cb 0x555ecefc8e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d815b9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf391450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d815b9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf391450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45546/0 (socket says 172.21.15.50:45546) 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d815b9640 1 -- 172.21.15.50:0/446652807 learned_addr learned my addr 172.21.15.50:0/446652807 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d825bb640 1 --2- 172.21.15.50:0/446652807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 0x555ecf391990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d81dba640 1 --2- 172.21.15.50:0/446652807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 0x555ecf378a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d815b9640 1 -- 172.21.15.50:0/446652807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 msgr2=0x555ecf391990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d815b9640 1 --2- 172.21.15.50:0/446652807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 0x555ecf391990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d815b9640 1 -- 172.21.15.50:0/446652807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 msgr2=0x555ecf378a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d815b9640 1 --2- 172.21.15.50:0/446652807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 0x555ecf378a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d815b9640 1 -- 172.21.15.50:0/446652807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ecef89310 con 0x555ecf39a500 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d815b9640 1 --2- 172.21.15.50:0/446652807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf391450 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00de70 tx=0x7f3d6c003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726a4ec7f90cdb6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.582+0000 7f3d5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:16:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d5cff9640 1 -- 172.21.15.50:0/446652807 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c014e30 con 0x555ecf39a500 2024-09-11T22:16:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d5cff9640 1 -- 172.21.15.50:0/446652807 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7f3d6c007260 con 0x555ecf39a500 2024-09-11T22:16:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d86e8c740 1 -- 172.21.15.50:0/446652807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d740315c0 con 0x555ecf39a500 2024-09-11T22:16:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d5cff9640 1 -- 172.21.15.50:0/446652807 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f3d6c02d050 con 0x555ecf39a500 2024-09-11T22:16:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d86e8c740 10 client.7434 fetch_fsmap learned FSMap version 70 2024-09-11T22:16:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d86e8c740 1 -- 172.21.15.50:0/446652807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x555ecf0f61b0 con 0x555ecf39a500 2024-09-11T22:16:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d5cff9640 1 -- 172.21.15.50:0/446652807 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d740315c0 con 0x555ecf39a500 2024-09-11T22:16:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d5cff9640 1 -- 172.21.15.50:0/446652807 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7f3d6c030020 con 0x555ecf39a500 2024-09-11T22:16:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d86e8c740 10 client.7434 fetch_fsmap finished waiting for FSMap version 70 2024-09-11T22:16:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d86e8c740 10 client.7434 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-11T22:16:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d86e8c740 20 client.7434 populate_metadata read hostname 'smithi050' 2024-09-11T22:16:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/446652807 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x555ecf390590 0x555ecf3939e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d86e8c740 4 client.7434 mds_command: new command op to 6754 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d86e8c740 1 -- 172.21.15.50:0/446652807 --> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ecf2c41f0 con 0x555ecf390590 2024-09-11T22:16:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.583+0000 7f3d81dba640 1 --2- 172.21.15.50:0/446652807 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x555ecf390590 0x555ecf3939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d5cff9640 10 client.7434 ms_handle_connect on v2:172.21.15.50:6834/3565485635 2024-09-11T22:16:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d81dba640 1 --2- 172.21.15.50:0/446652807 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x555ecf390590 0x555ecf3939e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e47d9c46535d732 server_cookie=baff142c1511675e in_seq=0 out_seq=0 2024-09-11T22:16:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d5cff9640 1 -- 172.21.15.50:0/446652807 <== mds.0 v2:172.21.15.50:6834/3565485635 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ecf2c41f0 con 0x555ecf390590 2024-09-11T22:16:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d5cff9640 10 client.7434 handle_command_reply: tid=0 2024-09-11T22:16:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d86e8c740 1 client.7434 shutdown 2024-09-11T22:16:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d86e8c740 1 -- 172.21.15.50:0/446652807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 msgr2=0x555ecf391450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/446652807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf391450 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00de70 tx=0x7f3d6c003760 comp rx=0 tx=0).stop 2024-09-11T22:16:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d86e8c740 1 -- 172.21.15.50:0/446652807 shutdown_connections 2024-09-11T22:16:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/446652807 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x555ecf390590 0x555ecf3939e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/446652807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 0x555ecf391990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/446652807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf391450 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d5cff9640 0 client.7434 ms_handle_reset on v2:172.21.15.50:6834/3565485635 2024-09-11T22:16:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/446652807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 0x555ecf378a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.584+0000 7f3d86e8c740 1 -- 172.21.15.50:0/446652807 >> 172.21.15.50:0/446652807 conn(0x555ecf397cc0 msgr2=0x555ecf39aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.585+0000 7f3d86e8c740 1 -- 172.21.15.50:0/446652807 shutdown_connections 2024-09-11T22:16:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.585+0000 7f3d86e8c740 1 -- 172.21.15.50:0/446652807 wait complete. 2024-09-11T22:16:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.585+0000 7f3d86e8c740 20 client.7434 trim_cache size 0 max 16384 2024-09-11T22:16:10.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.602+0000 7f3d86e8c740 1 Processor -- start 2024-09-11T22:16:10.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.602+0000 7f3d86e8c740 1 -- start start 2024-09-11T22:16:10.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.603+0000 7f3d86e8c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 0x555ecf38e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.603+0000 7f3d86e8c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 0x555ecf37a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.603+0000 7f3d86e8c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf37a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.603+0000 7f3d86e8c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c200e80 con 0x555ecf39a500 2024-09-11T22:16:10.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.603+0000 7f3d86e8c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c1ffea0 con 0x555ecf398120 2024-09-11T22:16:10.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.603+0000 7f3d86e8c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7c1f4cb0 con 0x555ecf37cbe0 2024-09-11T22:16:10.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.603+0000 7f3d825bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf37a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.603+0000 7f3d825bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf37a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45552/0 (socket says 172.21.15.50:45552) 2024-09-11T22:16:10.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.603+0000 7f3d825bb640 1 -- 172.21.15.50:0/1211345030 learned_addr learned my addr 172.21.15.50:0/1211345030 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:10.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.603+0000 7f3d81dba640 1 --2- 172.21.15.50:0/1211345030 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 0x555ecf38e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.603+0000 7f3d815b9640 1 --2- 172.21.15.50:0/1211345030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 0x555ecf37a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.604+0000 7f3d825bb640 1 -- 172.21.15.50:0/1211345030 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 msgr2=0x555ecf38e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.604+0000 7f3d825bb640 1 --2- 172.21.15.50:0/1211345030 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 0x555ecf38e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.604+0000 7f3d825bb640 1 -- 172.21.15.50:0/1211345030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 msgr2=0x555ecf37a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.604+0000 7f3d825bb640 1 --2- 172.21.15.50:0/1211345030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 0x555ecf37a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.604+0000 7f3d825bb640 1 -- 172.21.15.50:0/1211345030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ecef623d0 con 0x555ecf39a500 2024-09-11T22:16:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.604+0000 7f3d825bb640 1 --2- 172.21.15.50:0/1211345030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf37a570 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0726d0 tx=0x7f3d74009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154b71e0c3156589 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.604+0000 7f3d5effd640 1 -- 172.21.15.50:0/1211345030 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74036070 con 0x555ecf39a500 2024-09-11T22:16:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.604+0000 7f3d5effd640 1 -- 172.21.15.50:0/1211345030 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7404c070 con 0x555ecf39a500 2024-09-11T22:16:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.604+0000 7f3d5effd640 1 -- 172.21.15.50:0/1211345030 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74003df0 con 0x555ecf39a500 2024-09-11T22:16:10.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.604+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1211345030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 msgr2=0x555ecf37a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.604+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1211345030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf37a570 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0726d0 tx=0x7f3d74009810 comp rx=0 tx=0).stop 2024-09-11T22:16:10.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.605+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1211345030 shutdown_connections 2024-09-11T22:16:10.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.605+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1211345030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf37a570 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.605+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1211345030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 0x555ecf37a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.605+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1211345030 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 0x555ecf38e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.605+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1211345030 >> 172.21.15.50:0/1211345030 conn(0x555ecf397cc0 msgr2=0x555ecf34f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.605+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1211345030 shutdown_connections 2024-09-11T22:16:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.605+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1211345030 wait complete. 2024-09-11T22:16:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.605+0000 7f3d86e8c740 1 -- start start 2024-09-11T22:16:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.605+0000 7f3d86e8c740 1 Processor -- start 2024-09-11T22:16:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.606+0000 7f3d86e8c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 0x555ecf3791f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.606+0000 7f3d86e8c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 0x555ecf34deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.606+0000 7f3d86e8c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf414d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.606+0000 7f3d86e8c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555ecf396bd0 con 0x555ecf39a500 2024-09-11T22:16:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.606+0000 7f3d86e8c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c1f5300 con 0x555ecf398120 2024-09-11T22:16:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.606+0000 7f3d86e8c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x555ecf392f90 con 0x555ecf37cbe0 2024-09-11T22:16:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.606+0000 7f3d86e8c740 10 client.0 _ll_register_callbacks cb 0x7f3d6c00db20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.606+0000 7f3d825bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf414d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.606+0000 7f3d825bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf414d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45558/0 (socket says 172.21.15.50:45558) 2024-09-11T22:16:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.606+0000 7f3d825bb640 1 -- 172.21.15.50:0/1843376074 learned_addr learned my addr 172.21.15.50:0/1843376074 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.606+0000 7f3d81dba640 1 --2- 172.21.15.50:0/1843376074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 0x555ecf3791f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.606+0000 7f3d815b9640 1 --2- 172.21.15.50:0/1843376074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 0x555ecf34deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d825bb640 1 -- 172.21.15.50:0/1843376074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 msgr2=0x555ecf3791f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d825bb640 1 --2- 172.21.15.50:0/1843376074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 0x555ecf3791f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d825bb640 1 -- 172.21.15.50:0/1843376074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 msgr2=0x555ecf34deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d825bb640 1 --2- 172.21.15.50:0/1843376074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 0x555ecf34deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d825bb640 1 -- 172.21.15.50:0/1843376074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ecf34ec20 con 0x555ecf39a500 2024-09-11T22:16:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d825bb640 1 --2- 172.21.15.50:0/1843376074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf414d90 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f3d7402a700 tx=0x7f3d74004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760836605234dab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:16:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d5cff9640 1 -- 172.21.15.50:0/1843376074 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74056070 con 0x555ecf39a500 2024-09-11T22:16:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d5cff9640 1 -- 172.21.15.50:0/1843376074 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7f3d74031d90 con 0x555ecf39a500 2024-09-11T22:16:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1843376074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d7404c070 con 0x555ecf39a500 2024-09-11T22:16:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d5cff9640 1 -- 172.21.15.50:0/1843376074 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f3d74060050 con 0x555ecf39a500 2024-09-11T22:16:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d86e8c740 10 client.7440 fetch_fsmap learned FSMap version 70 2024-09-11T22:16:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1843376074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x555ecf379730 con 0x555ecf39a500 2024-09-11T22:16:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d5cff9640 1 -- 172.21.15.50:0/1843376074 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7404c070 con 0x555ecf39a500 2024-09-11T22:16:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d5cff9640 1 -- 172.21.15.50:0/1843376074 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7f3d74063020 con 0x555ecf39a500 2024-09-11T22:16:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d86e8c740 10 client.7440 fetch_fsmap finished waiting for FSMap version 70 2024-09-11T22:16:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d86e8c740 10 client.7440 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-11T22:16:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d86e8c740 20 client.7440 populate_metadata read hostname 'smithi050' 2024-09-11T22:16:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1843376074 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x555ecf34e3f0 0x555ecf4152d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d86e8c740 4 client.7440 mds_command: new command op to 6754 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-11T22:16:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1843376074 --> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x555ecf395c90 con 0x555ecf34e3f0 2024-09-11T22:16:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.607+0000 7f3d81dba640 1 --2- 172.21.15.50:0/1843376074 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x555ecf34e3f0 0x555ecf4152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d5cff9640 10 client.7440 ms_handle_connect on v2:172.21.15.50:6834/3565485635 2024-09-11T22:16:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d81dba640 1 --2- 172.21.15.50:0/1843376074 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x555ecf34e3f0 0x555ecf4152d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebc3f96b6f4bdf8c server_cookie=4fbfd77238b4f55a in_seq=0 out_seq=0 2024-09-11T22:16:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d5cff9640 1 -- 172.21.15.50:0/1843376074 <== mds.0 v2:172.21.15.50:6834/3565485635 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555ecf395c90 con 0x555ecf34e3f0 2024-09-11T22:16:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d5cff9640 10 client.7440 handle_command_reply: tid=0 2024-09-11T22:16:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d86e8c740 1 client.7440 shutdown 2024-09-11T22:16:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1843376074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 msgr2=0x555ecf414d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1843376074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf414d90 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f3d7402a700 tx=0x7f3d74004ab0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1843376074 shutdown_connections 2024-09-11T22:16:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1843376074 >> [v2:172.21.15.50:6834/3565485635,v1:172.21.15.50:6835/3565485635] conn(0x555ecf34e3f0 0x555ecf4152d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1843376074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555ecf39a500 0x555ecf414d90 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1843376074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555ecf398120 0x555ecf34deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d86e8c740 1 --2- 172.21.15.50:0/1843376074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555ecf37cbe0 0x555ecf3791f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1843376074 >> 172.21.15.50:0/1843376074 conn(0x555ecf397cc0 msgr2=0x555ecf353b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.608+0000 7f3d5cff9640 0 client.7440 ms_handle_reset on v2:172.21.15.50:6834/3565485635 2024-09-11T22:16:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1843376074 shutdown_connections 2024-09-11T22:16:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d86e8c740 1 -- 172.21.15.50:0/1843376074 wait complete. 2024-09-11T22:16:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d86e8c740 20 client.7440 trim_cache size 0 max 16384 2024-09-11T22:16:10.616 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:16:10.616 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:16:10.616 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "43cac769-5350-4c76-83c8-cc4bf485a238", 2024-09-11T22:16:10.617 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:16:10.617 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:16:10.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d8401e640 1 -- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3d6006be30 msgr2=0x7f3d6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d8401e640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3d6006be30 0x7f3d6006e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c15ad80 tx=0x7f3d6c009040 comp rx=0 tx=0).stop 2024-09-11T22:16:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d8401e640 1 -- 172.21.15.50:0/2638840497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d7c0b6e40 msgr2=0x7f3d7c159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d8401e640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d7c0b6e40 0x7f3d7c159190 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800c820 tx=0x7f3d7800cce0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d8401e640 1 -- 172.21.15.50:0/2638840497 shutdown_connections 2024-09-11T22:16:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d8401e640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3d6006be30 0x7f3d6006e2f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d8401e640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d7c161d60 0x7f3d7c15cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d8401e640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d7c0d39f0 0x7f3d7c0ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d8401e640 1 --2- 172.21.15.50:0/2638840497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d7c0b6e40 0x7f3d7c159190 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d8401e640 1 -- 172.21.15.50:0/2638840497 >> 172.21.15.50:0/2638840497 conn(0x7f3d7c067db0 msgr2=0x7f3d7c0d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d8401e640 1 -- 172.21.15.50:0/2638840497 shutdown_connections 2024-09-11T22:16:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.609+0000 7f3d8401e640 1 -- 172.21.15.50:0/2638840497 wait complete. 2024-09-11T22:16:10.622 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.723+0000 7fec5d79f640 1 Processor -- start 2024-09-11T22:16:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.723+0000 7fec5d79f640 1 -- start start 2024-09-11T22:16:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.724+0000 7fec5d79f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec580d1c90 0x7fec580b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.724+0000 7fec5d79f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fec58162350 0x7fec581627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.724+0000 7fec5d79f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec58163080 con 0x7fec5815e8e0 2024-09-11T22:16:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.724+0000 7fec5d79f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fec5815ecc0 con 0x7fec580d1c90 2024-09-11T22:16:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.724+0000 7fec5d79f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fec580d2ad0 con 0x7fec58162350 2024-09-11T22:16:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.724+0000 7fec567fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec580d1c90 0x7fec580b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.724+0000 7fec567fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec580d1c90 0x7fec580b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45574/0 (socket says 172.21.15.50:45574) 2024-09-11T22:16:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.724+0000 7fec567fc640 1 -- 172.21.15.50:0/408088157 learned_addr learned my addr 172.21.15.50:0/408088157 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.724+0000 7fec577fe640 1 --2- 172.21.15.50:0/408088157 >> v2:172.21.15.77:3300/0 conn(0x7fec58162350 0x7fec581627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.724+0000 7fec567fc640 1 -- 172.21.15.50:0/408088157 >> v2:172.21.15.77:3300/0 conn(0x7fec58162350 msgr2=0x7fec581627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.724+0000 7fec567fc640 1 --2- 172.21.15.50:0/408088157 >> v2:172.21.15.77:3300/0 conn(0x7fec58162350 0x7fec581627a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.724+0000 7fec567fc640 1 -- 172.21.15.50:0/408088157 >> v1:172.21.15.77:6789/0 conn(0x7fec5815e8e0 legacy=0x7fec580d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.724+0000 7fec567fc640 1 -- 172.21.15.50:0/408088157 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec580d2d20 con 0x7fec580d1c90 2024-09-11T22:16:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.725+0000 7fec567fc640 1 --2- 172.21.15.50:0/408088157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec580d1c90 0x7fec580b7880 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fec580d1220 tx=0x7fec4c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1877135a018e3d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.725+0000 7fec55ffb640 1 -- 172.21.15.50:0/408088157 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c037070 con 0x7fec580d1c90 2024-09-11T22:16:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.725+0000 7fec55ffb640 1 -- 172.21.15.50:0/408088157 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4c02ae50 con 0x7fec580d1c90 2024-09-11T22:16:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.725+0000 7fec55ffb640 1 -- 172.21.15.50:0/408088157 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c032860 con 0x7fec580d1c90 2024-09-11T22:16:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.726+0000 7fec5d79f640 1 -- 172.21.15.50:0/408088157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec580d1c90 msgr2=0x7fec580b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.726+0000 7fec5d79f640 1 --2- 172.21.15.50:0/408088157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec580d1c90 0x7fec580b7880 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fec580d1220 tx=0x7fec4c02a300 comp rx=0 tx=0).stop 2024-09-11T22:16:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.726+0000 7fec5d79f640 1 -- 172.21.15.50:0/408088157 shutdown_connections 2024-09-11T22:16:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.726+0000 7fec5d79f640 1 --2- 172.21.15.50:0/408088157 >> v2:172.21.15.77:3300/0 conn(0x7fec58162350 0x7fec581627a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.726+0000 7fec5d79f640 1 --2- 172.21.15.50:0/408088157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec580d1c90 0x7fec580b7880 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.726+0000 7fec5d79f640 1 -- 172.21.15.50:0/408088157 >> 172.21.15.50:0/408088157 conn(0x7fec58067ba0 msgr2=0x7fec58067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.726+0000 7fec5d79f640 1 -- 172.21.15.50:0/408088157 shutdown_connections 2024-09-11T22:16:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.726+0000 7fec5d79f640 1 -- 172.21.15.50:0/408088157 wait complete. 2024-09-11T22:16:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.727+0000 7fec5d79f640 1 Processor -- start 2024-09-11T22:16:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.727+0000 7fec5d79f640 1 -- start start 2024-09-11T22:16:10.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec5d79f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec580d1c90 0x7fec581595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec5d79f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5815e8e0 0x7fec580cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec5d79f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec58162350 0x7fec5815f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec5d79f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fec58162ce0 con 0x7fec5815e8e0 2024-09-11T22:16:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec5d79f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fec580d3370 con 0x7fec58162350 2024-09-11T22:16:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec5d79f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fec58162e60 con 0x7fec580d1c90 2024-09-11T22:16:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec567fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5815e8e0 0x7fec580cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec567fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5815e8e0 0x7fec580cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45588/0 (socket says 172.21.15.50:45588) 2024-09-11T22:16:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec567fc640 1 -- 172.21.15.50:0/3287997443 learned_addr learned my addr 172.21.15.50:0/3287997443 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec56ffd640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec580d1c90 0x7fec581595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec577fe640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec58162350 0x7fec5815f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec567fc640 1 -- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec580d1c90 msgr2=0x7fec581595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec567fc640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec580d1c90 0x7fec581595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec567fc640 1 -- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec58162350 msgr2=0x7fec5815f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec567fc640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec58162350 0x7fec5815f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.728+0000 7fec567fc640 1 -- 172.21.15.50:0/3287997443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec581f53c0 con 0x7fec5815e8e0 2024-09-11T22:16:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.729+0000 7fec567fc640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5815e8e0 0x7fec580cb8c0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fec4c000c00 tx=0x7fec4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.729+0000 7fec3f7fe640 1 -- 172.21.15.50:0/3287997443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c041020 con 0x7fec5815e8e0 2024-09-11T22:16:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.729+0000 7fec3f7fe640 1 -- 172.21.15.50:0/3287997443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4c03c890 con 0x7fec5815e8e0 2024-09-11T22:16:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.729+0000 7fec5d79f640 1 -- 172.21.15.50:0/3287997443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec581f50e0 con 0x7fec5815e8e0 2024-09-11T22:16:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.729+0000 7fec3f7fe640 1 -- 172.21.15.50:0/3287997443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c037040 con 0x7fec5815e8e0 2024-09-11T22:16:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.729+0000 7fec5d79f640 1 -- 172.21.15.50:0/3287997443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec580b56b0 con 0x7fec5815e8e0 2024-09-11T22:16:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.730+0000 7fec5d79f640 1 -- 172.21.15.50:0/3287997443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec580b7880 con 0x7fec5815e8e0 2024-09-11T22:16:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.730+0000 7fec3f7fe640 1 -- 172.21.15.50:0/3287997443 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec4c044020 con 0x7fec5815e8e0 2024-09-11T22:16:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.731+0000 7fec3f7fe640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec4406be30 0x7fec4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:10.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.731+0000 7fec3f7fe640 1 -- 172.21.15.50:0/3287997443 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7fec4c0ab5f0 con 0x7fec5815e8e0 2024-09-11T22:16:10.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.731+0000 7fec56ffd640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec4406be30 0x7fec4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:10.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.731+0000 7fec56ffd640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec4406be30 0x7fec4406e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fec5815fd90 tx=0x7fec48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:10.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.735+0000 7fec3f7fe640 1 -- 172.21.15.50:0/3287997443 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec4c04b030 con 0x7fec5815e8e0 2024-09-11T22:16:10.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.946+0000 7fec5d79f640 1 -- 172.21.15.50:0/3287997443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec580ba770 con 0x7fec5815e8e0 2024-09-11T22:16:10.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.946+0000 7fec3f7fe640 1 -- 172.21.15.50:0/3287997443 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5226 (secure 0 0 0) 0x7fec4c079970 con 0x7fec5815e8e0 2024-09-11T22:16:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:10.947 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"btime":"2024-09-11T22:16:06:835431+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1026980304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1026980304},{"type":"v1","addr":"172.21.15.50:6833","nonce":1026980304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3116356224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3116356224},{"type":"v1","addr":"172.21.15.77:6836","nonce":3116356224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3001000202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3001000202},{"type":"v1","addr":"172.21.15.77:6837","nonce":3001000202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:16:06.835421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6754":{"gid":6754,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3565485635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3565485635},{"type":"v1","addr":"172.21.15.50:6835","nonce":3565485635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6754,"qdb_cluster":[6754]},"id":6}]} 2024-09-11T22:16:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2024-09-11T22:16:10.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.948+0000 7fec5d79f640 1 -- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec4406be30 msgr2=0x7fec4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.948+0000 7fec5d79f640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec4406be30 0x7fec4406e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fec5815fd90 tx=0x7fec48009040 comp rx=0 tx=0).stop 2024-09-11T22:16:10.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.948+0000 7fec5d79f640 1 -- 172.21.15.50:0/3287997443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5815e8e0 msgr2=0x7fec580cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.948+0000 7fec5d79f640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5815e8e0 0x7fec580cb8c0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fec4c000c00 tx=0x7fec4c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.948+0000 7fec5d79f640 1 -- 172.21.15.50:0/3287997443 shutdown_connections 2024-09-11T22:16:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.948+0000 7fec5d79f640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec4406be30 0x7fec4406e2f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.948+0000 7fec5d79f640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec58162350 0x7fec5815f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.948+0000 7fec5d79f640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5815e8e0 0x7fec580cb8c0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.948+0000 7fec5d79f640 1 --2- 172.21.15.50:0/3287997443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec580d1c90 0x7fec581595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.949+0000 7fec5d79f640 1 -- 172.21.15.50:0/3287997443 >> 172.21.15.50:0/3287997443 conn(0x7fec58067ba0 msgr2=0x7fec580cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.949+0000 7fec5d79f640 1 -- 172.21.15.50:0/3287997443 shutdown_connections 2024-09-11T22:16:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:10.949+0000 7fec5d79f640 1 -- 172.21.15.50:0/3287997443 wait complete. 2024-09-11T22:16:10.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-11T22:16:11.077 INFO:teuthology.orchestra.run.smithi050.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-11T22:16:00.668396+0000","btime":"2024-09-11T22:15:59.896416+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-11T22:16:00.668396+0000","atime":"2024-09-11T22:15:59.896416+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-11T22:16:00.668396+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-11T22:16:00.669396+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-11T22:16:00.669396+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":1,"authpin":0,"scrubqueue":0},"nref":1,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-11T22:16:11.077 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-11T22:16:00.669396+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-11T22:15:59.896416+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-11T22:15:59.896416+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-11T22:16:00.668396+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-11T22:16:00.668396+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-11T22:16:00.668396+0000", "nestlock": {}, "nlink": 1, "nref": 1, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-11T22:16:00.669396+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-11T22:16:11.078 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-11T22:16:12.656 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:16:12.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:16:16.079 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:16.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.192+0000 7f2b27c1e640 1 Processor -- start 2024-09-11T22:16:16.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.192+0000 7f2b27c1e640 1 -- start start 2024-09-11T22:16:16.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b27c1e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b2015e840 0x7f2b200b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b27c1e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b200cdd50 0x7f2b200cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b27c1e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b200ce5f0 con 0x7f2b200cf3b0 2024-09-11T22:16:16.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b27c1e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2006c240 con 0x7f2b2015e840 2024-09-11T22:16:16.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b27c1e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2b200d0470 con 0x7f2b200cdd50 2024-09-11T22:16:16.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b259ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b2015e840 0x7f2b200b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b259ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b2015e840 0x7f2b200b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45594/0 (socket says 172.21.15.50:45594) 2024-09-11T22:16:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b259ba640 1 -- 172.21.15.50:0/4119755735 learned_addr learned my addr 172.21.15.50:0/4119755735 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b251b9640 1 --2- 172.21.15.50:0/4119755735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b200cdd50 0x7f2b200cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b259ba640 1 -- 172.21.15.50:0/4119755735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b200cdd50 msgr2=0x7f2b200cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b259ba640 1 --2- 172.21.15.50:0/4119755735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b200cdd50 0x7f2b200cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b259ba640 1 -- 172.21.15.50:0/4119755735 >> v1:172.21.15.77:6789/0 conn(0x7f2b200cf3b0 legacy=0x7f2b200d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b259ba640 1 -- 172.21.15.50:0/4119755735 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b200ce310 con 0x7f2b2015e840 2024-09-11T22:16:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.193+0000 7f2b251b9640 1 --2- 172.21.15.50:0/4119755735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b200cdd50 0x7f2b200cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.194+0000 7f2b259ba640 1 --2- 172.21.15.50:0/4119755735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b2015e840 0x7f2b200b4c70 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0098a0 tx=0x7f2b1c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fcb3f68b268454 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.194+0000 7f2b249b8640 1 -- 172.21.15.50:0/4119755735 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c037070 con 0x7f2b2015e840 2024-09-11T22:16:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.194+0000 7f2b249b8640 1 -- 172.21.15.50:0/4119755735 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b1c032440 con 0x7f2b2015e840 2024-09-11T22:16:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.194+0000 7f2b249b8640 1 -- 172.21.15.50:0/4119755735 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c032810 con 0x7f2b2015e840 2024-09-11T22:16:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.195+0000 7f2b27c1e640 1 -- 172.21.15.50:0/4119755735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b2015e840 msgr2=0x7f2b200b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.195+0000 7f2b27c1e640 1 --2- 172.21.15.50:0/4119755735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b2015e840 0x7f2b200b4c70 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0098a0 tx=0x7f2b1c02a250 comp rx=0 tx=0).stop 2024-09-11T22:16:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.195+0000 7f2b27c1e640 1 -- 172.21.15.50:0/4119755735 shutdown_connections 2024-09-11T22:16:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.195+0000 7f2b27c1e640 1 --2- 172.21.15.50:0/4119755735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b200cdd50 0x7f2b200cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.195+0000 7f2b27c1e640 1 --2- 172.21.15.50:0/4119755735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b2015e840 0x7f2b200b4c70 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.195+0000 7f2b27c1e640 1 -- 172.21.15.50:0/4119755735 >> 172.21.15.50:0/4119755735 conn(0x7f2b200b4150 msgr2=0x7f2b200b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.195+0000 7f2b27c1e640 1 -- 172.21.15.50:0/4119755735 shutdown_connections 2024-09-11T22:16:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.195+0000 7f2b27c1e640 1 -- 172.21.15.50:0/4119755735 wait complete. 2024-09-11T22:16:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.196+0000 7f2b27c1e640 1 Processor -- start 2024-09-11T22:16:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.196+0000 7f2b27c1e640 1 -- start start 2024-09-11T22:16:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.197+0000 7f2b27c1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b200cdd50 0x7f2b2014f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.197+0000 7f2b27c1e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b200cf3b0 0x7f2b200c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.197+0000 7f2b27c1e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b2015e840 0x7f2b20150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.197+0000 7f2b27c1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2015ec20 con 0x7f2b200cdd50 2024-09-11T22:16:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.197+0000 7f2b27c1e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2006bed0 con 0x7f2b2015e840 2024-09-11T22:16:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.197+0000 7f2b27c1e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2015eda0 con 0x7f2b200cf3b0 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.197+0000 7f2b259ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b200cdd50 0x7f2b2014f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.197+0000 7f2b259ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b200cdd50 0x7f2b2014f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45606/0 (socket says 172.21.15.50:45606) 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.197+0000 7f2b259ba640 1 -- 172.21.15.50:0/2620517768 learned_addr learned my addr 172.21.15.50:0/2620517768 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.197+0000 7f2b259ba640 1 -- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b200cf3b0 msgr2=0x7f2b200c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.197+0000 7f2b251b9640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b200cf3b0 0x7f2b200c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.197+0000 7f2b261bb640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b2015e840 0x7f2b20150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.197+0000 7f2b259ba640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b200cf3b0 0x7f2b200c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.198+0000 7f2b259ba640 1 -- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b2015e840 msgr2=0x7f2b20150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.198+0000 7f2b259ba640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b2015e840 0x7f2b20150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.198+0000 7f2b259ba640 1 -- 172.21.15.50:0/2620517768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b200c7740 con 0x7f2b200cdd50 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.198+0000 7f2b251b9640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b200cf3b0 0x7f2b200c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.198+0000 7f2b261bb640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b2015e840 0x7f2b20150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.198+0000 7f2b259ba640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b200cdd50 0x7f2b2014f960 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0098a0 tx=0x7f2b1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.198+0000 7f2b167fc640 1 -- 172.21.15.50:0/2620517768 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c037040 con 0x7f2b200cdd50 2024-09-11T22:16:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.198+0000 7f2b167fc640 1 -- 172.21.15.50:0/2620517768 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b1c004230 con 0x7f2b200cdd50 2024-09-11T22:16:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.198+0000 7f2b167fc640 1 -- 172.21.15.50:0/2620517768 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c030620 con 0x7f2b200cdd50 2024-09-11T22:16:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.198+0000 7f2b27c1e640 1 -- 172.21.15.50:0/2620517768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b200c7a20 con 0x7f2b200cdd50 2024-09-11T22:16:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.198+0000 7f2b27c1e640 1 -- 172.21.15.50:0/2620517768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b200c82c0 con 0x7f2b200cdd50 2024-09-11T22:16:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.199+0000 7f2b27c1e640 1 -- 172.21.15.50:0/2620517768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b200c7e10 con 0x7f2b200cdd50 2024-09-11T22:16:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.200+0000 7f2b167fc640 1 -- 172.21.15.50:0/2620517768 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b1c0307c0 con 0x7f2b200cdd50 2024-09-11T22:16:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.200+0000 7f2b167fc640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2b0406be30 0x7f2b0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.200+0000 7f2b167fc640 1 -- 172.21.15.50:0/2620517768 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7f2b1c0abd80 con 0x7f2b200cdd50 2024-09-11T22:16:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.200+0000 7f2b251b9640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2b0406be30 0x7f2b0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.201+0000 7f2b251b9640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2b0406be30 0x7f2b0406e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2b10006fd0 tx=0x7f2b10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.205+0000 7f2b167fc640 1 -- 172.21.15.50:0/2620517768 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b1c07a6c0 con 0x7f2b200cdd50 2024-09-11T22:16:16.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.415+0000 7f2b27c1e640 1 -- 172.21.15.50:0/2620517768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b200cee70 con 0x7f2b200cdd50 2024-09-11T22:16:16.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.416+0000 7f2b167fc640 1 -- 172.21.15.50:0/2620517768 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5226 (secure 0 0 0) 0x7f2b1c079fc0 con 0x7f2b200cdd50 2024-09-11T22:16:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:16.418 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"btime":"2024-09-11T22:16:06:835431+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1026980304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1026980304},{"type":"v1","addr":"172.21.15.50:6833","nonce":1026980304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3116356224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3116356224},{"type":"v1","addr":"172.21.15.77:6836","nonce":3116356224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3001000202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3001000202},{"type":"v1","addr":"172.21.15.77:6837","nonce":3001000202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:16:06.835421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6754":{"gid":6754,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3565485635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3565485635},{"type":"v1","addr":"172.21.15.50:6835","nonce":3565485635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6754,"qdb_cluster":[6754]},"id":6}]} 2024-09-11T22:16:16.418 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2024-09-11T22:16:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.418+0000 7f2b27c1e640 1 -- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2b0406be30 msgr2=0x7f2b0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.418+0000 7f2b27c1e640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2b0406be30 0x7f2b0406e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2b10006fd0 tx=0x7f2b10008040 comp rx=0 tx=0).stop 2024-09-11T22:16:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.418+0000 7f2b27c1e640 1 -- 172.21.15.50:0/2620517768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b200cdd50 msgr2=0x7f2b2014f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.418+0000 7f2b27c1e640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b200cdd50 0x7f2b2014f960 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0098a0 tx=0x7f2b1c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.418+0000 7f2b27c1e640 1 -- 172.21.15.50:0/2620517768 shutdown_connections 2024-09-11T22:16:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.418+0000 7f2b27c1e640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2b0406be30 0x7f2b0406e2f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.418+0000 7f2b27c1e640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b200cf3b0 0x7f2b200c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.418+0000 7f2b27c1e640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b2015e840 0x7f2b20150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.418+0000 7f2b27c1e640 1 --2- 172.21.15.50:0/2620517768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b200cdd50 0x7f2b2014f960 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.418+0000 7f2b27c1e640 1 -- 172.21.15.50:0/2620517768 >> 172.21.15.50:0/2620517768 conn(0x7f2b200b4150 msgr2=0x7f2b20070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.418+0000 7f2b27c1e640 1 -- 172.21.15.50:0/2620517768 shutdown_connections 2024-09-11T22:16:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.418+0000 7f2b27c1e640 1 -- 172.21.15.50:0/2620517768 wait complete. 2024-09-11T22:16:16.431 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-11T22:16:16.548 INFO:teuthology.orchestra.run.smithi050.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-11T22:16:00.668396+0000","btime":"2024-09-11T22:15:59.896416+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-11T22:16:00.668396+0000","atime":"2024-09-11T22:15:59.896416+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-11T22:16:00.668396+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-11T22:16:00.669396+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-11T22:16:00.669396+0000"},"version":131,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-11T22:16:10.610349+0000","last_scrub_version":128,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":2,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-11T22:16:16.548 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-11T22:16:00.669396+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-11T22:15:59.896416+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-11T22:15:59.896416+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-11T22:16:00.668396+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-11T22:16:00.668396+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-11T22:16:10.610349+0000", "last_scrub_version": 128, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-11T22:16:00.668396+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-11T22:16:00.669396+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 131, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-11T22:16:16.548 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-11T22:16:16.549 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:16:16.549 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:16:16.610 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:16:16.651 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:16:16.651 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:16:16.651 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:16:16.651 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:16:16.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:16:16.668 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:16:16.668 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:16:16.668 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:16:16.709 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:16:16.709 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:16:16.710 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:16:16.710 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:16:16.726 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:16:16.727 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:16:16.727 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:16:16.727 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:16:16.767 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:16:16.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:16.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.867+0000 7f9ee4f31640 1 Processor -- start 2024-09-11T22:16:16.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.867+0000 7f9ee4f31640 1 -- start start 2024-09-11T22:16:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.868+0000 7f9ee4f31640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ee015e870 0x7f9ee00d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.868+0000 7f9ee4f31640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ee00d3c00 0x7f9ee00b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.868+0000 7f9ee4f31640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ee00cfa80 con 0x7f9ee00d16d0 2024-09-11T22:16:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.868+0000 7f9ee4f31640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9ee00d1b40 con 0x7f9ee00d3c00 2024-09-11T22:16:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.868+0000 7f9ee4f31640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9ee00d40d0 con 0x7f9ee015e870 2024-09-11T22:16:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.868+0000 7f9eded9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ee00d3c00 0x7f9ee00b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.869+0000 7f9eded9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ee00d3c00 0x7f9ee00b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45608/0 (socket says 172.21.15.50:45608) 2024-09-11T22:16:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.869+0000 7f9eded9d640 1 -- 172.21.15.50:0/2606283973 learned_addr learned my addr 172.21.15.50:0/2606283973 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.869+0000 7f9ede59c640 1 --2- 172.21.15.50:0/2606283973 >> v2:172.21.15.77:3300/0 conn(0x7f9ee015e870 0x7f9ee00d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.869+0000 7f9eded9d640 1 -- 172.21.15.50:0/2606283973 >> v2:172.21.15.77:3300/0 conn(0x7f9ee015e870 msgr2=0x7f9ee00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.869+0000 7f9eded9d640 1 --2- 172.21.15.50:0/2606283973 >> v2:172.21.15.77:3300/0 conn(0x7f9ee015e870 0x7f9ee00d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.869+0000 7f9eded9d640 1 -- 172.21.15.50:0/2606283973 >> v1:172.21.15.77:6789/0 conn(0x7f9ee00d16d0 legacy=0x7f9ee00d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.869+0000 7f9edd59a640 1 -- 172.21.15.50:0/2606283973 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1883971848 0 0) 0x7f9ec8001110 con 0x7f9ee00d16d0 2024-09-11T22:16:16.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.869+0000 7f9eded9d640 1 -- 172.21.15.50:0/2606283973 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee00d43b0 con 0x7f9ee00d3c00 2024-09-11T22:16:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.870+0000 7f9eded9d640 1 --2- 172.21.15.50:0/2606283973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ee00d3c00 0x7f9ee00b8400 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00d57c0 tx=0x7f9ed002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141dd15e12c1f575 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.870+0000 7f9edd59a640 1 -- 172.21.15.50:0/2606283973 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0036070 con 0x7f9ee00d3c00 2024-09-11T22:16:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.870+0000 7f9edd59a640 1 -- 172.21.15.50:0/2606283973 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed0031600 con 0x7f9ee00d3c00 2024-09-11T22:16:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.870+0000 7f9edd59a640 1 -- 172.21.15.50:0/2606283973 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed00319d0 con 0x7f9ee00d3c00 2024-09-11T22:16:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.870+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2606283973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ee00d3c00 msgr2=0x7f9ee00b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.870+0000 7f9ee4f31640 1 --2- 172.21.15.50:0/2606283973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ee00d3c00 0x7f9ee00b8400 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00d57c0 tx=0x7f9ed002a730 comp rx=0 tx=0).stop 2024-09-11T22:16:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.870+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2606283973 shutdown_connections 2024-09-11T22:16:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.870+0000 7f9ee4f31640 1 --2- 172.21.15.50:0/2606283973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ee00d3c00 0x7f9ee00b8400 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.870+0000 7f9ee4f31640 1 --2- 172.21.15.50:0/2606283973 >> v2:172.21.15.77:3300/0 conn(0x7f9ee015e870 0x7f9ee00d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.870+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2606283973 >> 172.21.15.50:0/2606283973 conn(0x7f9ee00727a0 msgr2=0x7f9ee00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:16.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.870+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2606283973 shutdown_connections 2024-09-11T22:16:16.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.870+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2606283973 wait complete. 2024-09-11T22:16:16.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.872+0000 7f9ee4f31640 1 Processor -- start 2024-09-11T22:16:16.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.872+0000 7f9ee4f31640 1 -- start start 2024-09-11T22:16:16.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ee4f31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ee00d16d0 0x7f9ee00cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ee4f31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ee00d3c00 0x7f9ee015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ee4f31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee015e870 0x7f9ee015c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ee4f31640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee015ec50 con 0x7f9ee00d16d0 2024-09-11T22:16:16.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ee4f31640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee00b7ee0 con 0x7f9ee00d3c00 2024-09-11T22:16:16.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ee4f31640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee00b78b0 con 0x7f9ee015e870 2024-09-11T22:16:16.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ede59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ee00d16d0 0x7f9ee00cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ede59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ee00d16d0 0x7f9ee00cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45612/0 (socket says 172.21.15.50:45612) 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ede59c640 1 -- 172.21.15.50:0/2169429244 learned_addr learned my addr 172.21.15.50:0/2169429244 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9eddd9b640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ee00d3c00 0x7f9ee015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9eded9d640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee015e870 0x7f9ee015c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ede59c640 1 -- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee015e870 msgr2=0x7f9ee015c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ede59c640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee015e870 0x7f9ee015c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ede59c640 1 -- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ee00d3c00 msgr2=0x7f9ee015c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ede59c640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ee00d3c00 0x7f9ee015c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ede59c640 1 -- 172.21.15.50:0/2169429244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee00cd8f0 con 0x7f9ee00d16d0 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ede59c640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ee00d16d0 0x7f9ee00cd010 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800e9b0 tx=0x7f9ed800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ed6ffd640 1 -- 172.21.15.50:0/2169429244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8017070 con 0x7f9ee00d16d0 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ed6ffd640 1 -- 172.21.15.50:0/2169429244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed800c9a0 con 0x7f9ee00d16d0 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2169429244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee00cdbd0 con 0x7f9ee00d16d0 2024-09-11T22:16:16.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ed6ffd640 1 -- 172.21.15.50:0/2169429244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed800cd90 con 0x7f9ee00d16d0 2024-09-11T22:16:16.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.873+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2169429244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee00ce190 con 0x7f9ee00d16d0 2024-09-11T22:16:16.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.874+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2169429244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee00d1190 con 0x7f9ee00d16d0 2024-09-11T22:16:16.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.875+0000 7f9ed6ffd640 1 -- 172.21.15.50:0/2169429244 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ed801a070 con 0x7f9ee00d16d0 2024-09-11T22:16:16.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.875+0000 7f9ed6ffd640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9ec006be30 0x7f9ec006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:16.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.875+0000 7f9ed6ffd640 1 -- 172.21.15.50:0/2169429244 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7f9ed808b220 con 0x7f9ee00d16d0 2024-09-11T22:16:16.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.875+0000 7f9eddd9b640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9ec006be30 0x7f9ec006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:16.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.876+0000 7f9eddd9b640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9ec006be30 0x7f9ec006e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9ee01f7c20 tx=0x7f9ec8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:16.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:16.879+0000 7f9ed6ffd640 1 -- 172.21.15.50:0/2169429244 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ed8059510 con 0x7f9ee00d16d0 2024-09-11T22:16:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.094+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2169429244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ee01619f0 con 0x7f9ee00d16d0 2024-09-11T22:16:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.095+0000 7f9ed6ffd640 1 -- 172.21.15.50:0/2169429244 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5226 (secure 0 0 0) 0x7f9ed805d810 con 0x7f9ee00d16d0 2024-09-11T22:16:17.097 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:17.097 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"btime":"2024-09-11T22:16:06:835431+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1026980304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1026980304},{"type":"v1","addr":"172.21.15.50:6833","nonce":1026980304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3116356224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3116356224},{"type":"v1","addr":"172.21.15.77:6836","nonce":3116356224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3001000202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3001000202},{"type":"v1","addr":"172.21.15.77:6837","nonce":3001000202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:16:06.835421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6754":{"gid":6754,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3565485635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3565485635},{"type":"v1","addr":"172.21.15.50:6835","nonce":3565485635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6754,"qdb_cluster":[6754]},"id":6}]} 2024-09-11T22:16:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2024-09-11T22:16:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.097+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9ec006be30 msgr2=0x7f9ec006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.097+0000 7f9ee4f31640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9ec006be30 0x7f9ec006e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9ee01f7c20 tx=0x7f9ec8009040 comp rx=0 tx=0).stop 2024-09-11T22:16:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.097+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2169429244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ee00d16d0 msgr2=0x7f9ee00cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.097+0000 7f9ee4f31640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ee00d16d0 0x7f9ee00cd010 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800e9b0 tx=0x7f9ed800ee70 comp rx=0 tx=0).stop 2024-09-11T22:16:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.097+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2169429244 shutdown_connections 2024-09-11T22:16:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.097+0000 7f9ee4f31640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9ec006be30 0x7f9ec006e2f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.097+0000 7f9ee4f31640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee015e870 0x7f9ee015c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.097+0000 7f9ee4f31640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ee00d3c00 0x7f9ee015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.097+0000 7f9ee4f31640 1 --2- 172.21.15.50:0/2169429244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ee00d16d0 0x7f9ee00cd010 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.097+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2169429244 >> 172.21.15.50:0/2169429244 conn(0x7f9ee00727a0 msgr2=0x7f9ee00b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.097+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2169429244 shutdown_connections 2024-09-11T22:16:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.097+0000 7f9ee4f31640 1 -- 172.21.15.50:0/2169429244 wait complete. 2024-09-11T22:16:17.110 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:17.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.210+0000 7ff5a1e53640 1 Processor -- start 2024-09-11T22:16:17.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.210+0000 7ff5a1e53640 1 -- start start 2024-09-11T22:16:17.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.211+0000 7ff5a1e53640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff59c15b400 0x7ff59c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.211+0000 7ff5a1e53640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff59c15b7e0 con 0x7ff59c072e60 2024-09-11T22:16:17.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.211+0000 7ff5a1e53640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff59c15f140 con 0x7ff59c06e0f0 2024-09-11T22:16:17.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.211+0000 7ff5a1e53640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff59c15f420 con 0x7ff59c15b400 2024-09-11T22:16:17.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.211+0000 7ff59affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff59c072e60 0x7ff59c06d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48628/0 (socket says 172.21.15.50:48628) 2024-09-11T22:16:17.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.211+0000 7ff59affd640 1 -- 172.21.15.50:0/321344437 learned_addr learned my addr 172.21.15.50:0/321344437 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:17.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.211+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099132667 0 0) 0x7ff59c15b7e0 con 0x7ff59c072e60 2024-09-11T22:16:17.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.211+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff584003520 con 0x7ff59c072e60 2024-09-11T22:16:17.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.211+0000 7ff59b7fe640 1 --2- 172.21.15.50:0/321344437 >> v2:172.21.15.77:3300/0 conn(0x7ff59c15b400 0x7ff59c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3085684793 0 0) 0x7ff584003520 con 0x7ff59c072e60 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 >> v2:172.21.15.77:3300/0 conn(0x7ff59c15b400 msgr2=0x7ff59c06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59a7fc640 1 --2- 172.21.15.50:0/321344437 >> v2:172.21.15.77:3300/0 conn(0x7ff59c15b400 0x7ff59c06d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 >> v1:172.21.15.77:6789/0 conn(0x7ff59c06e0f0 legacy=0x7ff59c0711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59c15f700 con 0x7ff59c072e60 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7ff590001670 con 0x7ff59c072e60 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 >> v1:172.21.15.50:6789/0 conn(0x7ff59c072e60 legacy=0x7ff59c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59a7fc640 1 --2- 172.21.15.50:0/321344437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5840039b0 0x7ff584003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59a7fc640 1 --2- 172.21.15.50:0/321344437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff584004800 0x7ff584004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59a7fc640 1 --2- 172.21.15.50:0/321344437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5840051c0 0x7ff58400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c15f420 con 0x7ff5840051c0 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff58400c060 con 0x7ff5840039b0 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff58400c260 con 0x7ff584004800 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59bfff640 1 --2- 172.21.15.50:0/321344437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5840051c0 0x7ff58400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59b7fe640 1 --2- 172.21.15.50:0/321344437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5840039b0 0x7ff584003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59affd640 1 --2- 172.21.15.50:0/321344437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff584004800 0x7ff584004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59bfff640 1 -- 172.21.15.50:0/321344437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff584004800 msgr2=0x7ff584004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59bfff640 1 --2- 172.21.15.50:0/321344437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff584004800 0x7ff584004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59bfff640 1 -- 172.21.15.50:0/321344437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5840039b0 msgr2=0x7ff584003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59bfff640 1 --2- 172.21.15.50:0/321344437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5840039b0 0x7ff584003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.212+0000 7ff59bfff640 1 -- 172.21.15.50:0/321344437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff584003520 con 0x7ff5840051c0 2024-09-11T22:16:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.213+0000 7ff59bfff640 1 -- 172.21.15.50:0/321344437 reap_dead start 2024-09-11T22:16:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.213+0000 7ff59bfff640 1 --2- 172.21.15.50:0/321344437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5840051c0 0x7ff58400b9c0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff594001e20 tx=0x7ff584005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbce6bf1eaead7c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.213+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594001a70 con 0x7ff5840051c0 2024-09-11T22:16:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.213+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff59402ae40 con 0x7ff5840051c0 2024-09-11T22:16:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.213+0000 7ff59a7fc640 1 -- 172.21.15.50:0/321344437 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594003bb0 con 0x7ff5840051c0 2024-09-11T22:16:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.214+0000 7ff5a1e53640 1 -- 172.21.15.50:0/321344437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5840051c0 msgr2=0x7ff58400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.214+0000 7ff5a1e53640 1 --2- 172.21.15.50:0/321344437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5840051c0 0x7ff58400b9c0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff594001e20 tx=0x7ff584005830 comp rx=0 tx=0).stop 2024-09-11T22:16:17.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.214+0000 7ff5a1e53640 1 -- 172.21.15.50:0/321344437 shutdown_connections 2024-09-11T22:16:17.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.214+0000 7ff5a1e53640 1 --2- 172.21.15.50:0/321344437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5840051c0 0x7ff58400b9c0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.214+0000 7ff5a1e53640 1 -- 172.21.15.50:0/321344437 >> 172.21.15.50:0/321344437 conn(0x7ff59c0679c0 msgr2=0x7ff59c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:17.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.214+0000 7ff5a1e53640 1 -- 172.21.15.50:0/321344437 shutdown_connections 2024-09-11T22:16:17.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.214+0000 7ff5a1e53640 1 -- 172.21.15.50:0/321344437 wait complete. 2024-09-11T22:16:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.215+0000 7ff5a1e53640 1 Processor -- start 2024-09-11T22:16:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.215+0000 7ff5a1e53640 1 -- start start 2024-09-11T22:16:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff5a1e53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5840051c0 0x7ff59c0ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff5a1e53640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff59c15e400 0x7ff59c0aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff5a1e53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff59c15e860 0x7ff59c0af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff5a1e53640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c06d070 con 0x7ff59c15e860 2024-09-11T22:16:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff5a1e53640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c0cfc50 con 0x7ff5840051c0 2024-09-11T22:16:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff5a1e53640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff59c06d1f0 con 0x7ff59c15e400 2024-09-11T22:16:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff59c15e860 0x7ff59c0af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff59c15e860 0x7ff59c0af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45628/0 (socket says 172.21.15.50:45628) 2024-09-11T22:16:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff59bfff640 1 -- 172.21.15.50:0/2216412231 learned_addr learned my addr 172.21.15.50:0/2216412231 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff59b7fe640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5840051c0 0x7ff59c0ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff59affd640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff59c15e400 0x7ff59c0aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff59bfff640 1 -- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff59c15e400 msgr2=0x7ff59c0aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff59bfff640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff59c15e400 0x7ff59c0aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff59bfff640 1 -- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5840051c0 msgr2=0x7ff59c0ac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff59bfff640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5840051c0 0x7ff59c0ac210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff59bfff640 1 -- 172.21.15.50:0/2216412231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59c1354e0 con 0x7ff59c15e860 2024-09-11T22:16:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.216+0000 7ff59bfff640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff59c15e860 0x7ff59c0af110 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ff59402a8f0 tx=0x7ff5940014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.217+0000 7ff583fff640 1 -- 172.21.15.50:0/2216412231 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594007db0 con 0x7ff59c15e860 2024-09-11T22:16:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.217+0000 7ff583fff640 1 -- 172.21.15.50:0/2216412231 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff594006d60 con 0x7ff59c15e860 2024-09-11T22:16:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.217+0000 7ff5a1e53640 1 -- 172.21.15.50:0/2216412231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59c1357a0 con 0x7ff59c15e860 2024-09-11T22:16:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.217+0000 7ff583fff640 1 -- 172.21.15.50:0/2216412231 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5940056a0 con 0x7ff59c15e860 2024-09-11T22:16:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.217+0000 7ff5a1e53640 1 -- 172.21.15.50:0/2216412231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff59c135d60 con 0x7ff59c15e860 2024-09-11T22:16:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.218+0000 7ff5a1e53640 1 -- 172.21.15.50:0/2216412231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff59c06d9e0 con 0x7ff59c15e860 2024-09-11T22:16:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.218+0000 7ff583fff640 1 -- 172.21.15.50:0/2216412231 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff594007030 con 0x7ff59c15e860 2024-09-11T22:16:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.219+0000 7ff583fff640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff58806be60 0x7ff58806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.219+0000 7ff583fff640 1 -- 172.21.15.50:0/2216412231 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7ff5940aa5e0 con 0x7ff59c15e860 2024-09-11T22:16:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.219+0000 7ff59b7fe640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff58806be60 0x7ff58806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.219+0000 7ff59b7fe640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff58806be60 0x7ff58806e320 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009b40 tx=0x7ff58c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.223+0000 7ff583fff640 1 -- 172.21.15.50:0/2216412231 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff594043060 con 0x7ff59c15e860 2024-09-11T22:16:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.440+0000 7ff5a1e53640 1 -- 172.21.15.50:0/2216412231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff59c0b4090 con 0x7ff59c15e860 2024-09-11T22:16:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.440+0000 7ff583fff640 1 -- 172.21.15.50:0/2216412231 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5226 (secure 0 0 0) 0x7ff594039070 con 0x7ff59c15e860 2024-09-11T22:16:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:17.442 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"btime":"2024-09-11T22:16:06:835431+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1026980304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1026980304},{"type":"v1","addr":"172.21.15.50:6833","nonce":1026980304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3116356224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3116356224},{"type":"v1","addr":"172.21.15.77:6836","nonce":3116356224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3001000202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3001000202},{"type":"v1","addr":"172.21.15.77:6837","nonce":3001000202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:16:06.835421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6754":{"gid":6754,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3565485635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3565485635},{"type":"v1","addr":"172.21.15.50:6835","nonce":3565485635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6754,"qdb_cluster":[6754]},"id":6}]} 2024-09-11T22:16:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2024-09-11T22:16:17.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.442+0000 7ff5a1e53640 1 -- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff58806be60 msgr2=0x7ff58806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.442+0000 7ff5a1e53640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff58806be60 0x7ff58806e320 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009b40 tx=0x7ff58c009190 comp rx=0 tx=0).stop 2024-09-11T22:16:17.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.442+0000 7ff5a1e53640 1 -- 172.21.15.50:0/2216412231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff59c15e860 msgr2=0x7ff59c0af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.442+0000 7ff5a1e53640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff59c15e860 0x7ff59c0af110 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ff59402a8f0 tx=0x7ff5940014a0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.442+0000 7ff5a1e53640 1 -- 172.21.15.50:0/2216412231 shutdown_connections 2024-09-11T22:16:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.442+0000 7ff5a1e53640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff58806be60 0x7ff58806e320 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.442+0000 7ff5a1e53640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff59c15e400 0x7ff59c0aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.442+0000 7ff5a1e53640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff59c15e860 0x7ff59c0af110 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.442+0000 7ff5a1e53640 1 --2- 172.21.15.50:0/2216412231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5840051c0 0x7ff59c0ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.442+0000 7ff5a1e53640 1 -- 172.21.15.50:0/2216412231 >> 172.21.15.50:0/2216412231 conn(0x7ff59c0679c0 msgr2=0x7ff59c0719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.443+0000 7ff5a1e53640 1 -- 172.21.15.50:0/2216412231 shutdown_connections 2024-09-11T22:16:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.443+0000 7ff5a1e53640 1 -- 172.21.15.50:0/2216412231 wait complete. 2024-09-11T22:16:17.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:16:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.557+0000 7fb20e877640 1 Processor -- start 2024-09-11T22:16:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.557+0000 7fb20e877640 1 -- start start 2024-09-11T22:16:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb20e877640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb2080b1600 0x7fb2080b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb20e877640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2080cfbd0 con 0x7fb2080cf610 2024-09-11T22:16:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb20e877640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2080cfeb0 con 0x7fb208161fa0 2024-09-11T22:16:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb20e877640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb2080d1220 con 0x7fb2080b1600 2024-09-11T22:16:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb2077fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb2080cf610 0x7fb2080cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41744/0 (socket says 172.21.15.50:41744) 2024-09-11T22:16:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb2077fe640 1 -- 172.21.15.50:0/92271946 learned_addr learned my addr 172.21.15.50:0/92271946 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3025014086 0 0) 0x7fb2080cfbd0 con 0x7fb2080cf610 2024-09-11T22:16:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f0003520 con 0x7fb2080cf610 2024-09-11T22:16:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb20ce14640 1 --2- 172.21.15.50:0/92271946 >> v2:172.21.15.77:3300/0 conn(0x7fb2080b1600 0x7fb2080b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1630502137 0 0) 0x7fb1f0003520 con 0x7fb2080cf610 2024-09-11T22:16:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 >> v2:172.21.15.77:3300/0 conn(0x7fb2080b1600 msgr2=0x7fb2080b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb206ffd640 1 --2- 172.21.15.50:0/92271946 >> v2:172.21.15.77:3300/0 conn(0x7fb2080b1600 0x7fb2080b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 >> v1:172.21.15.77:6789/0 conn(0x7fb208161fa0 legacy=0x7fb2080cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2080d1470 con 0x7fb2080cf610 2024-09-11T22:16:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.558+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fb1fc001670 con 0x7fb2080cf610 2024-09-11T22:16:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 >> v1:172.21.15.50:6789/0 conn(0x7fb2080cf610 legacy=0x7fb2080cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb206ffd640 1 --2- 172.21.15.50:0/92271946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f00039b0 0x7fb1f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb206ffd640 1 --2- 172.21.15.50:0/92271946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f0004800 0x7fb1f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb206ffd640 1 --2- 172.21.15.50:0/92271946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f00051c0 0x7fb1f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb2080d1220 con 0x7fb1f00051c0 2024-09-11T22:16:17.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f000c110 con 0x7fb1f0004800 2024-09-11T22:16:17.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f000c310 con 0x7fb1f00039b0 2024-09-11T22:16:17.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb20ce14640 1 --2- 172.21.15.50:0/92271946 >> v2:172.21.15.77:3300/0 conn(0x7fb2080b1600 0x7fb2080b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:17.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb20ce14640 1 --2- 172.21.15.50:0/92271946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f00051c0 0x7fb1f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb2077fe640 1 --2- 172.21.15.50:0/92271946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f0004800 0x7fb1f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb207fff640 1 --2- 172.21.15.50:0/92271946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f00039b0 0x7fb1f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb20ce14640 1 -- 172.21.15.50:0/92271946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f00039b0 msgr2=0x7fb1f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb20ce14640 1 --2- 172.21.15.50:0/92271946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f00039b0 0x7fb1f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb20ce14640 1 -- 172.21.15.50:0/92271946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f0004800 msgr2=0x7fb1f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb20ce14640 1 --2- 172.21.15.50:0/92271946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f0004800 0x7fb1f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.559+0000 7fb20ce14640 1 -- 172.21.15.50:0/92271946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f0003520 con 0x7fb1f00051c0 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.560+0000 7fb20ce14640 1 -- 172.21.15.50:0/92271946 reap_dead start 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.560+0000 7fb20ce14640 1 --2- 172.21.15.50:0/92271946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f00051c0 0x7fb1f000b9c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fb2000073e0 tx=0x7fb1f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ed0a7242de0527 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.560+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb200009c70 con 0x7fb1f00051c0 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.560+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20002c6a0 con 0x7fb1f00051c0 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.560+0000 7fb206ffd640 1 -- 172.21.15.50:0/92271946 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20002ca90 con 0x7fb1f00051c0 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.560+0000 7fb20e877640 1 -- 172.21.15.50:0/92271946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f00051c0 msgr2=0x7fb1f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.560+0000 7fb20e877640 1 --2- 172.21.15.50:0/92271946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f00051c0 0x7fb1f000b9c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fb2000073e0 tx=0x7fb1f0005830 comp rx=0 tx=0).stop 2024-09-11T22:16:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.560+0000 7fb20e877640 1 -- 172.21.15.50:0/92271946 shutdown_connections 2024-09-11T22:16:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.560+0000 7fb20e877640 1 --2- 172.21.15.50:0/92271946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f00051c0 0x7fb1f000b9c0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.560+0000 7fb20e877640 1 -- 172.21.15.50:0/92271946 >> 172.21.15.50:0/92271946 conn(0x7fb20809ba50 msgr2=0x7fb2080b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.560+0000 7fb20e877640 1 -- 172.21.15.50:0/92271946 shutdown_connections 2024-09-11T22:16:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.560+0000 7fb20e877640 1 -- 172.21.15.50:0/92271946 wait complete. 2024-09-11T22:16:17.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.562+0000 7fb20e877640 1 Processor -- start 2024-09-11T22:16:17.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.562+0000 7fb20e877640 1 -- start start 2024-09-11T22:16:17.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb20e877640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f00051c0 0x7fb20814ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb20e877640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2080c9750 0x7fb208160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb20e877640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb208160f70 0x7fb20814f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb20e877640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb2080d1c70 con 0x7fb2080c9750 2024-09-11T22:16:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb20e877640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb2080d17e0 con 0x7fb208160f70 2024-09-11T22:16:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb20e877640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb2080d1df0 con 0x7fb1f00051c0 2024-09-11T22:16:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb2077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2080c9750 0x7fb208160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb2077fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2080c9750 0x7fb208160a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38792/0 (socket says 172.21.15.50:38792) 2024-09-11T22:16:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb2077fe640 1 -- 172.21.15.50:0/3641123787 learned_addr learned my addr 172.21.15.50:0/3641123787 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb207fff640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f00051c0 0x7fb20814ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb20ce14640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb208160f70 0x7fb20814f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb2077fe640 1 -- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f00051c0 msgr2=0x7fb20814ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb2077fe640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f00051c0 0x7fb20814ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb2077fe640 1 -- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb208160f70 msgr2=0x7fb20814f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb2077fe640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb208160f70 0x7fb20814f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb2077fe640 1 -- 172.21.15.50:0/3641123787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2080c9bd0 con 0x7fb2080c9750 2024-09-11T22:16:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb2077fe640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2080c9750 0x7fb208160a30 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc007320 tx=0x7fb1fc007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb204ff9640 1 -- 172.21.15.50:0/3641123787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc01a070 con 0x7fb2080c9750 2024-09-11T22:16:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb204ff9640 1 -- 172.21.15.50:0/3641123787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1fc00f940 con 0x7fb2080c9750 2024-09-11T22:16:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb20e877640 1 -- 172.21.15.50:0/3641123787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20815f990 con 0x7fb2080c9750 2024-09-11T22:16:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb204ff9640 1 -- 172.21.15.50:0/3641123787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00fd10 con 0x7fb2080c9750 2024-09-11T22:16:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.563+0000 7fb20e877640 1 -- 172.21.15.50:0/3641123787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20815ff50 con 0x7fb2080c9750 2024-09-11T22:16:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.565+0000 7fb20e877640 1 -- 172.21.15.50:0/3641123787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb20806c930 con 0x7fb2080c9750 2024-09-11T22:16:17.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.565+0000 7fb204ff9640 1 -- 172.21.15.50:0/3641123787 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb1fc01d070 con 0x7fb2080c9750 2024-09-11T22:16:17.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.565+0000 7fb204ff9640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1f406be30 0x7fb1f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.566+0000 7fb204ff9640 1 -- 172.21.15.50:0/3641123787 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7fb1fc08a800 con 0x7fb2080c9750 2024-09-11T22:16:17.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.566+0000 7fb207fff640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1f406be30 0x7fb1f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.566+0000 7fb207fff640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1f406be30 0x7fb1f406e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8000c00 tx=0x7fb1f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:17.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.570+0000 7fb204ff9640 1 -- 172.21.15.50:0/3641123787 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb1fc058af0 con 0x7fb2080c9750 2024-09-11T22:16:17.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.745+0000 7fb20e877640 1 -- 172.21.15.50:0/3641123787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2080707f0 con 0x7fb2080c9750 2024-09-11T22:16:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.746+0000 7fb204ff9640 1 -- 172.21.15.50:0/3641123787 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+16863 (secure 0 0 0) 0x7fb1fc05cdf0 con 0x7fb2080c9750 2024-09-11T22:16:17.748 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:17.748 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:16:02.821579+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:15:46.760927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T22:15:48.092105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6836/1549905387":"2024-09-12T22:16:02.821555+0000","172.21.15.77:6834/1549905387":"2024-09-12T22:16:02.821555+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:16:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.748+0000 7fb20e877640 1 -- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1f406be30 msgr2=0x7fb1f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.748+0000 7fb20e877640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1f406be30 0x7fb1f406e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8000c00 tx=0x7fb1f8009040 comp rx=0 tx=0).stop 2024-09-11T22:16:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.748+0000 7fb20e877640 1 -- 172.21.15.50:0/3641123787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2080c9750 msgr2=0x7fb208160a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.748+0000 7fb20e877640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2080c9750 0x7fb208160a30 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc007320 tx=0x7fb1fc007720 comp rx=0 tx=0).stop 2024-09-11T22:16:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.748+0000 7fb20e877640 1 -- 172.21.15.50:0/3641123787 shutdown_connections 2024-09-11T22:16:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.748+0000 7fb20e877640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1f406be30 0x7fb1f406e2f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.748+0000 7fb20e877640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb208160f70 0x7fb20814f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.748+0000 7fb20e877640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2080c9750 0x7fb208160a30 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.748+0000 7fb20e877640 1 --2- 172.21.15.50:0/3641123787 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f00051c0 0x7fb20814ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.748+0000 7fb20e877640 1 -- 172.21.15.50:0/3641123787 >> 172.21.15.50:0/3641123787 conn(0x7fb20809ba50 msgr2=0x7fb2080af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.748+0000 7fb20e877640 1 -- 172.21.15.50:0/3641123787 shutdown_connections 2024-09-11T22:16:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.748+0000 7fb20e877640 1 -- 172.21.15.50:0/3641123787 wait complete. 2024-09-11T22:16:17.762 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:16:17.762 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:17.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.862+0000 7f2ccc96d640 1 Processor -- start 2024-09-11T22:16:17.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.862+0000 7f2ccc96d640 1 -- start start 2024-09-11T22:16:17.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2ccc96d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2cc806e0f0 0x7f2cc806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2ccc96d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2cc8072e60 0x7f2cc80711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2ccc96d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cc815b7e0 con 0x7f2cc815b400 2024-09-11T22:16:17.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2ccc96d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc815f140 con 0x7f2cc806e0f0 2024-09-11T22:16:17.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2ccc96d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc815f420 con 0x7f2cc8072e60 2024-09-11T22:16:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2cc659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2cc815b400 0x7f2cc806d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41754/0 (socket says 172.21.15.50:41754) 2024-09-11T22:16:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2cc659c640 1 -- 172.21.15.50:0/3487288716 learned_addr learned my addr 172.21.15.50:0/3487288716 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2cc5d9b640 1 --2- 172.21.15.50:0/3487288716 >> v2:172.21.15.50:3300/0 conn(0x7f2cc806e0f0 0x7f2cc806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2cc559a640 1 -- 172.21.15.50:0/3487288716 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3584425300 0 0) 0x7f2cc815b7e0 con 0x7f2cc815b400 2024-09-11T22:16:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2cc6d9d640 1 --2- 172.21.15.50:0/3487288716 >> v2:172.21.15.77:3300/0 conn(0x7f2cc8072e60 0x7f2cc80711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2cc559a640 1 -- 172.21.15.50:0/3487288716 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cb4003520 con 0x7f2cc815b400 2024-09-11T22:16:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2cc5d9b640 1 -- 172.21.15.50:0/3487288716 >> v2:172.21.15.77:3300/0 conn(0x7f2cc8072e60 msgr2=0x7f2cc80711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2cc5d9b640 1 --2- 172.21.15.50:0/3487288716 >> v2:172.21.15.77:3300/0 conn(0x7f2cc8072e60 0x7f2cc80711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2cc5d9b640 1 -- 172.21.15.50:0/3487288716 >> v1:172.21.15.50:6789/0 conn(0x7f2cc815b400 legacy=0x7f2cc806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2cc5d9b640 1 -- 172.21.15.50:0/3487288716 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc815f700 con 0x7f2cc806e0f0 2024-09-11T22:16:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.863+0000 7f2cc6d9d640 1 --2- 172.21.15.50:0/3487288716 >> v2:172.21.15.77:3300/0 conn(0x7f2cc8072e60 0x7f2cc80711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.864+0000 7f2cc5d9b640 1 --2- 172.21.15.50:0/3487288716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cc806e0f0 0x7f2cc806d070 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80b3490 tx=0x7f2cb002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fe5663a3ba3865 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.864+0000 7f2cc559a640 1 -- 172.21.15.50:0/3487288716 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0037070 con 0x7f2cc806e0f0 2024-09-11T22:16:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.864+0000 7f2cc559a640 1 -- 172.21.15.50:0/3487288716 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb0032440 con 0x7f2cc806e0f0 2024-09-11T22:16:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.864+0000 7f2cc559a640 1 -- 172.21.15.50:0/3487288716 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0032810 con 0x7f2cc806e0f0 2024-09-11T22:16:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.865+0000 7f2ccc96d640 1 -- 172.21.15.50:0/3487288716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cc806e0f0 msgr2=0x7f2cc806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.865+0000 7f2ccc96d640 1 --2- 172.21.15.50:0/3487288716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cc806e0f0 0x7f2cc806d070 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80b3490 tx=0x7f2cb002a1a0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.865+0000 7f2ccc96d640 1 -- 172.21.15.50:0/3487288716 shutdown_connections 2024-09-11T22:16:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.865+0000 7f2ccc96d640 1 --2- 172.21.15.50:0/3487288716 >> v2:172.21.15.77:3300/0 conn(0x7f2cc8072e60 0x7f2cc80711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.865+0000 7f2ccc96d640 1 --2- 172.21.15.50:0/3487288716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cc806e0f0 0x7f2cc806d070 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.865+0000 7f2ccc96d640 1 -- 172.21.15.50:0/3487288716 >> 172.21.15.50:0/3487288716 conn(0x7f2cc80679c0 msgr2=0x7f2cc8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.865+0000 7f2ccc96d640 1 -- 172.21.15.50:0/3487288716 shutdown_connections 2024-09-11T22:16:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.865+0000 7f2ccc96d640 1 -- 172.21.15.50:0/3487288716 wait complete. 2024-09-11T22:16:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.866+0000 7f2ccc96d640 1 Processor -- start 2024-09-11T22:16:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.866+0000 7f2ccc96d640 1 -- start start 2024-09-11T22:16:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.867+0000 7f2ccc96d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cc806e0f0 0x7f2cc8148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.867+0000 7f2ccc96d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cc8072e60 0x7f2cc80ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.867+0000 7f2ccc96d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cc815b400 0x7f2cc80acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.867+0000 7f2ccc96d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc8071700 con 0x7f2cc806e0f0 2024-09-11T22:16:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.867+0000 7f2ccc96d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc80cfc50 con 0x7f2cc8072e60 2024-09-11T22:16:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.867+0000 7f2ccc96d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc8071880 con 0x7f2cc815b400 2024-09-11T22:16:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.867+0000 7f2cc659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cc806e0f0 0x7f2cc8148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.867+0000 7f2cc659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cc806e0f0 0x7f2cc8148e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38798/0 (socket says 172.21.15.50:38798) 2024-09-11T22:16:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.867+0000 7f2cc659c640 1 -- 172.21.15.50:0/1756346219 learned_addr learned my addr 172.21.15.50:0/1756346219 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.867+0000 7f2cc5d9b640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cc8072e60 0x7f2cc80ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.868+0000 7f2cc6d9d640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cc815b400 0x7f2cc80acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.868+0000 7f2cc659c640 1 -- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cc815b400 msgr2=0x7f2cc80acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.868+0000 7f2cc659c640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cc815b400 0x7f2cc80acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.868+0000 7f2cc659c640 1 -- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cc8072e60 msgr2=0x7f2cc80ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.868+0000 7f2cc659c640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cc8072e60 0x7f2cc80ac6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.868+0000 7f2cc659c640 1 -- 172.21.15.50:0/1756346219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc8149340 con 0x7f2cc806e0f0 2024-09-11T22:16:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.868+0000 7f2cc5d9b640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cc8072e60 0x7f2cc80ac6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.868+0000 7f2cc659c640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cc806e0f0 0x7f2cc8148e00 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000c390 tx=0x7f2cc000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.868+0000 7f2cbeffd640 1 -- 172.21.15.50:0/1756346219 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0017070 con 0x7f2cc806e0f0 2024-09-11T22:16:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.868+0000 7f2cbeffd640 1 -- 172.21.15.50:0/1756346219 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc0005ce0 con 0x7f2cc806e0f0 2024-09-11T22:16:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.868+0000 7f2ccc96d640 1 -- 172.21.15.50:0/1756346219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc80ae860 con 0x7f2cc806e0f0 2024-09-11T22:16:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.868+0000 7f2cbeffd640 1 -- 172.21.15.50:0/1756346219 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00072f0 con 0x7f2cc806e0f0 2024-09-11T22:16:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.868+0000 7f2ccc96d640 1 -- 172.21.15.50:0/1756346219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc80af100 con 0x7f2cc806e0f0 2024-09-11T22:16:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.869+0000 7f2ccc96d640 1 -- 172.21.15.50:0/1756346219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc806d070 con 0x7f2cc806e0f0 2024-09-11T22:16:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.870+0000 7f2cbeffd640 1 -- 172.21.15.50:0/1756346219 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2cc001a070 con 0x7f2cc806e0f0 2024-09-11T22:16:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.870+0000 7f2cbeffd640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ca806be30 0x7f2ca806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.870+0000 7f2cbeffd640 1 -- 172.21.15.50:0/1756346219 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7f2cc008a2d0 con 0x7f2cc806e0f0 2024-09-11T22:16:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.870+0000 7f2cc5d9b640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ca806be30 0x7f2ca806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.871+0000 7f2cc5d9b640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ca806be30 0x7f2ca806e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0034000 tx=0x7f2cb002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:17.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:17.874+0000 7f2cbeffd640 1 -- 172.21.15.50:0/1756346219 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2cc8149340 con 0x7f2cc806e0f0 2024-09-11T22:16:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.085+0000 7f2ccc96d640 1 -- 172.21.15.50:0/1756346219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cc806da90 con 0x7f2cc806e0f0 2024-09-11T22:16:18.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.085+0000 7f2cbeffd640 1 -- 172.21.15.50:0/1756346219 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5226 (secure 0 0 0) 0x7f2cc0058c10 con 0x7f2cc806e0f0 2024-09-11T22:16:18.087 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:18.087 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"btime":"2024-09-11T22:16:06:835431+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1026980304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1026980304},{"type":"v1","addr":"172.21.15.50:6833","nonce":1026980304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3116356224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3116356224},{"type":"v1","addr":"172.21.15.77:6836","nonce":3116356224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3001000202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3001000202},{"type":"v1","addr":"172.21.15.77:6837","nonce":3001000202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:16:06.835421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6754":{"gid":6754,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3565485635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3565485635},{"type":"v1","addr":"172.21.15.50:6835","nonce":3565485635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6754,"qdb_cluster":[6754]},"id":6}]} 2024-09-11T22:16:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2024-09-11T22:16:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.087+0000 7f2ccc96d640 1 -- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ca806be30 msgr2=0x7f2ca806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.087+0000 7f2ccc96d640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ca806be30 0x7f2ca806e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0034000 tx=0x7f2cb002e000 comp rx=0 tx=0).stop 2024-09-11T22:16:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.087+0000 7f2ccc96d640 1 -- 172.21.15.50:0/1756346219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cc806e0f0 msgr2=0x7f2cc8148e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.087+0000 7f2ccc96d640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cc806e0f0 0x7f2cc8148e00 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000c390 tx=0x7f2cc000c850 comp rx=0 tx=0).stop 2024-09-11T22:16:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.087+0000 7f2ccc96d640 1 -- 172.21.15.50:0/1756346219 shutdown_connections 2024-09-11T22:16:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.087+0000 7f2ccc96d640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2ca806be30 0x7f2ca806e2f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.087+0000 7f2ccc96d640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cc815b400 0x7f2cc80acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.087+0000 7f2ccc96d640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cc8072e60 0x7f2cc80ac6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.087+0000 7f2ccc96d640 1 --2- 172.21.15.50:0/1756346219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cc806e0f0 0x7f2cc8148e00 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.087+0000 7f2ccc96d640 1 -- 172.21.15.50:0/1756346219 >> 172.21.15.50:0/1756346219 conn(0x7f2cc80679c0 msgr2=0x7f2cc80b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.087+0000 7f2ccc96d640 1 -- 172.21.15.50:0/1756346219 shutdown_connections 2024-09-11T22:16:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.087+0000 7f2ccc96d640 1 -- 172.21.15.50:0/1756346219 wait complete. 2024-09-11T22:16:18.100 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:18.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.200+0000 7f74efd8d640 1 Processor -- start 2024-09-11T22:16:18.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.201+0000 7f74efd8d640 1 -- start start 2024-09-11T22:16:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.201+0000 7f74efd8d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74e80d18a0 0x7f74e80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.201+0000 7f74efd8d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e80cfa80 con 0x7f74e815e870 2024-09-11T22:16:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.201+0000 7f74efd8d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e80d40d0 con 0x7f74e80d3a30 2024-09-11T22:16:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.201+0000 7f74efd8d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f74e80d3ea0 con 0x7f74e80d18a0 2024-09-11T22:16:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74edb29640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f74e815e870 0x7f74e80d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41770/0 (socket says 172.21.15.50:41770) 2024-09-11T22:16:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74edb29640 1 -- 172.21.15.50:0/4142394653 learned_addr learned my addr 172.21.15.50:0/4142394653 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ed328640 1 --2- 172.21.15.50:0/4142394653 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74e80d18a0 0x7f74e80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2542842575 0 0) 0x7f74e4001110 con 0x7f74e815e870 2024-09-11T22:16:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74d4003520 con 0x7f74e815e870 2024-09-11T22:16:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2998459263 0 0) 0x7f74d4003520 con 0x7f74e815e870 2024-09-11T22:16:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74e80d18a0 msgr2=0x7f74e80d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 --2- 172.21.15.50:0/4142394653 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74e80d18a0 0x7f74e80d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 >> v1:172.21.15.77:6789/0 conn(0x7f74e80d3a30 legacy=0x7f74e80b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e80d43b0 con 0x7f74e815e870 2024-09-11T22:16:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f74e4001840 con 0x7f74e815e870 2024-09-11T22:16:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 >> v1:172.21.15.50:6789/0 conn(0x7f74e815e870 legacy=0x7f74e80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 --2- 172.21.15.50:0/4142394653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d40039e0 0x7f74d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 --2- 172.21.15.50:0/4142394653 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74e80d18a0 0x7f74d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 --2- 172.21.15.50:0/4142394653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74d4004d40 0x7f74d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74d400ba70 con 0x7f74d4004d40 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f74d400bc20 con 0x7f74d40039e0 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f74d400be20 con 0x7f74e80d18a0 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ee32a640 1 --2- 172.21.15.50:0/4142394653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74d4004d40 0x7f74d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74edb29640 1 --2- 172.21.15.50:0/4142394653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d40039e0 0x7f74d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.202+0000 7f74ed328640 1 --2- 172.21.15.50:0/4142394653 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74e80d18a0 0x7f74d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.203+0000 7f74ee32a640 1 -- 172.21.15.50:0/4142394653 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74e80d18a0 msgr2=0x7f74d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.203+0000 7f74ee32a640 1 --2- 172.21.15.50:0/4142394653 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74e80d18a0 0x7f74d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.203+0000 7f74ee32a640 1 -- 172.21.15.50:0/4142394653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d40039e0 msgr2=0x7f74d4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.203+0000 7f74ee32a640 1 --2- 172.21.15.50:0/4142394653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d40039e0 0x7f74d4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.203+0000 7f74ee32a640 1 -- 172.21.15.50:0/4142394653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d4003520 con 0x7f74d4004d40 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.203+0000 7f74edb29640 1 --2- 172.21.15.50:0/4142394653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d40039e0 0x7f74d4003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.203+0000 7f74ee32a640 1 --2- 172.21.15.50:0/4142394653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74d4004d40 0x7f74d40051c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f74e0001e20 tx=0x7f74d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a899bf63697aca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.204+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0001a70 con 0x7f74d4004d40 2024-09-11T22:16:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.204+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e002ae40 con 0x7f74d4004d40 2024-09-11T22:16:18.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.204+0000 7f74ecb27640 1 -- 172.21.15.50:0/4142394653 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0003bb0 con 0x7f74d4004d40 2024-09-11T22:16:18.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.204+0000 7f74efd8d640 1 -- 172.21.15.50:0/4142394653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74d4004d40 msgr2=0x7f74d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.204+0000 7f74efd8d640 1 --2- 172.21.15.50:0/4142394653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74d4004d40 0x7f74d40051c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f74e0001e20 tx=0x7f74d4005830 comp rx=0 tx=0).stop 2024-09-11T22:16:18.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.204+0000 7f74ee32a640 1 -- 172.21.15.50:0/4142394653 reap_dead start 2024-09-11T22:16:18.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.204+0000 7f74efd8d640 1 -- 172.21.15.50:0/4142394653 shutdown_connections 2024-09-11T22:16:18.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.204+0000 7f74efd8d640 1 -- 172.21.15.50:0/4142394653 >> 172.21.15.50:0/4142394653 conn(0x7f74e80727a0 msgr2=0x7f74e80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:18.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.204+0000 7f74efd8d640 1 -- 172.21.15.50:0/4142394653 shutdown_connections 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.204+0000 7f74efd8d640 1 -- 172.21.15.50:0/4142394653 wait complete. 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.205+0000 7f74efd8d640 1 Processor -- start 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.205+0000 7f74efd8d640 1 -- start start 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.206+0000 7f74efd8d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74e815be90 0x7f74e80cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.206+0000 7f74efd8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e80ccbc0 0x7f74e815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.206+0000 7f74efd8d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e815d060 0x7f74e80cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.206+0000 7f74efd8d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74e815ec50 con 0x7f74e815d060 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.206+0000 7f74efd8d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f74e80b7ee0 con 0x7f74e80ccbc0 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.206+0000 7f74efd8d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f74e80b78b0 con 0x7f74e815be90 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.206+0000 7f74ee32a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e815d060 0x7f74e80cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.206+0000 7f74ee32a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e815d060 0x7f74e80cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38822/0 (socket says 172.21.15.50:38822) 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.206+0000 7f74ee32a640 1 -- 172.21.15.50:0/2994033063 learned_addr learned my addr 172.21.15.50:0/2994033063 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.207+0000 7f74edb29640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74e815be90 0x7f74e80cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.207+0000 7f74ed328640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e80ccbc0 0x7f74e815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.207+0000 7f74ee32a640 1 -- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74e815be90 msgr2=0x7f74e80cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.207+0000 7f74ee32a640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74e815be90 0x7f74e80cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.207+0000 7f74ee32a640 1 -- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e80ccbc0 msgr2=0x7f74e815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.207+0000 7f74ee32a640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e80ccbc0 0x7f74e815cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.207+0000 7f74ee32a640 1 -- 172.21.15.50:0/2994033063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e80ab2b0 con 0x7f74e815d060 2024-09-11T22:16:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.207+0000 7f74ee32a640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e815d060 0x7f74e80cd3e0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f74e002a8f0 tx=0x7f74e00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.207+0000 7f74de7fc640 1 -- 172.21.15.50:0/2994033063 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0042070 con 0x7f74e815d060 2024-09-11T22:16:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.207+0000 7f74de7fc640 1 -- 172.21.15.50:0/2994033063 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e0038040 con 0x7f74e815d060 2024-09-11T22:16:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.207+0000 7f74efd8d640 1 -- 172.21.15.50:0/2994033063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e80ab590 con 0x7f74e815d060 2024-09-11T22:16:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.207+0000 7f74de7fc640 1 -- 172.21.15.50:0/2994033063 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e400c0e0 con 0x7f74e815d060 2024-09-11T22:16:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.207+0000 7f74efd8d640 1 -- 172.21.15.50:0/2994033063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e80cd040 con 0x7f74e815d060 2024-09-11T22:16:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.208+0000 7f74efd8d640 1 -- 172.21.15.50:0/2994033063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e80d34f0 con 0x7f74e815d060 2024-09-11T22:16:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.209+0000 7f74de7fc640 1 -- 172.21.15.50:0/2994033063 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74e0045070 con 0x7f74e815d060 2024-09-11T22:16:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.209+0000 7f74de7fc640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f74cc06be60 0x7f74cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.209+0000 7f74de7fc640 1 -- 172.21.15.50:0/2994033063 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7f74e00aa2e0 con 0x7f74e815d060 2024-09-11T22:16:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.209+0000 7f74edb29640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f74cc06be60 0x7f74cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.210+0000 7f74edb29640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f74cc06be60 0x7f74cc06e320 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f74e40012b0 tx=0x7f74e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.213+0000 7f74de7fc640 1 -- 172.21.15.50:0/2994033063 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74e0078cb0 con 0x7f74e815d060 2024-09-11T22:16:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.426+0000 7f74efd8d640 1 -- 172.21.15.50:0/2994033063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74e815f7e0 con 0x7f74e815d060 2024-09-11T22:16:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.426+0000 7f74de7fc640 1 -- 172.21.15.50:0/2994033063 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5226 (secure 0 0 0) 0x7f74e00785b0 con 0x7f74e815d060 2024-09-11T22:16:18.428 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:18.428 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":70,"btime":"2024-09-11T22:16:06:835431+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1026980304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1026980304},{"type":"v1","addr":"172.21.15.50:6833","nonce":1026980304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3116356224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3116356224},{"type":"v1","addr":"172.21.15.77:6836","nonce":3116356224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3001000202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3001000202},{"type":"v1","addr":"172.21.15.77:6837","nonce":3001000202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:15:49.108873+0000","modified":"2024-09-11T22:16:06.835421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6754":{"gid":6754,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3565485635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3565485635},{"type":"v1","addr":"172.21.15.50:6835","nonce":3565485635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6754,"qdb_cluster":[6754]},"id":6}]} 2024-09-11T22:16:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 70 2024-09-11T22:16:18.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.428+0000 7f74efd8d640 1 -- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f74cc06be60 msgr2=0x7f74cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.428+0000 7f74efd8d640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f74cc06be60 0x7f74cc06e320 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f74e40012b0 tx=0x7f74e4009040 comp rx=0 tx=0).stop 2024-09-11T22:16:18.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.428+0000 7f74efd8d640 1 -- 172.21.15.50:0/2994033063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e815d060 msgr2=0x7f74e80cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.428+0000 7f74efd8d640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e815d060 0x7f74e80cd3e0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f74e002a8f0 tx=0x7f74e00014a0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.428+0000 7f74efd8d640 1 -- 172.21.15.50:0/2994033063 shutdown_connections 2024-09-11T22:16:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.428+0000 7f74efd8d640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f74cc06be60 0x7f74cc06e320 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.428+0000 7f74efd8d640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74e815d060 0x7f74e80cd3e0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.428+0000 7f74efd8d640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e80ccbc0 0x7f74e815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.428+0000 7f74efd8d640 1 --2- 172.21.15.50:0/2994033063 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74e815be90 0x7f74e80cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.428+0000 7f74efd8d640 1 -- 172.21.15.50:0/2994033063 >> 172.21.15.50:0/2994033063 conn(0x7f74e80727a0 msgr2=0x7f74e80b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.429+0000 7f74efd8d640 1 -- 172.21.15.50:0/2994033063 shutdown_connections 2024-09-11T22:16:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.429+0000 7f74efd8d640 1 -- 172.21.15.50:0/2994033063 wait complete. 2024-09-11T22:16:18.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:16:18.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.543+0000 7f1056a2e640 1 Processor -- start 2024-09-11T22:16:18.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.543+0000 7f1056a2e640 1 -- start start 2024-09-11T22:16:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.543+0000 7f1056a2e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f105015e870 0x7f10500d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.544+0000 7f1056a2e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10500d3c00 0x7f10500b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.544+0000 7f1056a2e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10500cfa80 con 0x7f10500d16d0 2024-09-11T22:16:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.544+0000 7f1056a2e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f10500d1b40 con 0x7f10500d3c00 2024-09-11T22:16:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.544+0000 7f1056a2e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f10500d40d0 con 0x7f105015e870 2024-09-11T22:16:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.544+0000 7f1054fcb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10500d3c00 0x7f10500b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.544+0000 7f1054fcb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10500d3c00 0x7f10500b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38834/0 (socket says 172.21.15.50:38834) 2024-09-11T22:16:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.544+0000 7f1054fcb640 1 -- 172.21.15.50:0/3622742414 learned_addr learned my addr 172.21.15.50:0/3622742414 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.544+0000 7f104ffff640 1 --2- 172.21.15.50:0/3622742414 >> v2:172.21.15.77:3300/0 conn(0x7f105015e870 0x7f10500d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.544+0000 7f1054fcb640 1 -- 172.21.15.50:0/3622742414 >> v2:172.21.15.77:3300/0 conn(0x7f105015e870 msgr2=0x7f10500d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.544+0000 7f1054fcb640 1 --2- 172.21.15.50:0/3622742414 >> v2:172.21.15.77:3300/0 conn(0x7f105015e870 0x7f10500d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.544+0000 7f1054fcb640 1 -- 172.21.15.50:0/3622742414 >> v1:172.21.15.77:6789/0 conn(0x7f10500d16d0 legacy=0x7f10500d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.544+0000 7f1054fcb640 1 -- 172.21.15.50:0/3622742414 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10500d43b0 con 0x7f10500d3c00 2024-09-11T22:16:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.545+0000 7f1054fcb640 1 --2- 172.21.15.50:0/3622742414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10500d3c00 0x7f10500b8400 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f10500d57c0 tx=0x7f104802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d173a364380cce3d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.545+0000 7f104effd640 1 -- 172.21.15.50:0/3622742414 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048036070 con 0x7f10500d3c00 2024-09-11T22:16:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.545+0000 7f104effd640 1 -- 172.21.15.50:0/3622742414 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1048031600 con 0x7f10500d3c00 2024-09-11T22:16:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.545+0000 7f104effd640 1 -- 172.21.15.50:0/3622742414 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10480319d0 con 0x7f10500d3c00 2024-09-11T22:16:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.545+0000 7f1056a2e640 1 -- 172.21.15.50:0/3622742414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10500d3c00 msgr2=0x7f10500b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.545+0000 7f1056a2e640 1 --2- 172.21.15.50:0/3622742414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10500d3c00 0x7f10500b8400 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f10500d57c0 tx=0x7f104802a730 comp rx=0 tx=0).stop 2024-09-11T22:16:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.545+0000 7f1056a2e640 1 -- 172.21.15.50:0/3622742414 shutdown_connections 2024-09-11T22:16:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.545+0000 7f1056a2e640 1 --2- 172.21.15.50:0/3622742414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10500d3c00 0x7f10500b8400 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.545+0000 7f1056a2e640 1 --2- 172.21.15.50:0/3622742414 >> v2:172.21.15.77:3300/0 conn(0x7f105015e870 0x7f10500d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.545+0000 7f1056a2e640 1 -- 172.21.15.50:0/3622742414 >> 172.21.15.50:0/3622742414 conn(0x7f10500727a0 msgr2=0x7f10500679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.545+0000 7f1056a2e640 1 -- 172.21.15.50:0/3622742414 shutdown_connections 2024-09-11T22:16:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.545+0000 7f1056a2e640 1 -- 172.21.15.50:0/3622742414 wait complete. 2024-09-11T22:16:18.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.547+0000 7f1056a2e640 1 Processor -- start 2024-09-11T22:16:18.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.547+0000 7f1056a2e640 1 -- start start 2024-09-11T22:16:18.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.547+0000 7f1056a2e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10500d16d0 0x7f10501f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.547+0000 7f1056a2e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10500d3c00 0x7f1050161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.547+0000 7f1056a2e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f105015e870 0x7f10500cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.547+0000 7f1056a2e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f105015ec50 con 0x7f105015e870 2024-09-11T22:16:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.547+0000 7f1056a2e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f10500b7ee0 con 0x7f10500d16d0 2024-09-11T22:16:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.547+0000 7f1056a2e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f10500b78b0 con 0x7f10500d3c00 2024-09-11T22:16:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f1054fcb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f105015e870 0x7f10500cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f1054fcb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f105015e870 0x7f10500cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38848/0 (socket says 172.21.15.50:38848) 2024-09-11T22:16:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f1054fcb640 1 -- 172.21.15.50:0/3636262099 learned_addr learned my addr 172.21.15.50:0/3636262099 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f104ffff640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10500d16d0 0x7f10501f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f104f7fe640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10500d3c00 0x7f1050161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f1054fcb640 1 -- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10500d3c00 msgr2=0x7f1050161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f1054fcb640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10500d3c00 0x7f1050161020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f1054fcb640 1 -- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10500d16d0 msgr2=0x7f10501f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f1054fcb640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10500d16d0 0x7f10501f53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f1054fcb640 1 -- 172.21.15.50:0/3636262099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10500cc4d0 con 0x7f105015e870 2024-09-11T22:16:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f1054fcb640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f105015e870 0x7f10500cb850 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f1048009f40 tx=0x7f1048004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f104cff9640 1 -- 172.21.15.50:0/3636262099 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048036050 con 0x7f105015e870 2024-09-11T22:16:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f104cff9640 1 -- 172.21.15.50:0/3636262099 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1048042070 con 0x7f105015e870 2024-09-11T22:16:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f104cff9640 1 -- 172.21.15.50:0/3636262099 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048009510 con 0x7f105015e870 2024-09-11T22:16:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.548+0000 7f1056a2e640 1 -- 172.21.15.50:0/3636262099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10501f4910 con 0x7f105015e870 2024-09-11T22:16:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.549+0000 7f1056a2e640 1 -- 172.21.15.50:0/3636262099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10500cc7b0 con 0x7f105015e870 2024-09-11T22:16:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.549+0000 7f1056a2e640 1 -- 172.21.15.50:0/3636262099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10501f4ae0 con 0x7f105015e870 2024-09-11T22:16:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.550+0000 7f104cff9640 1 -- 172.21.15.50:0/3636262099 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1048007bf0 con 0x7f105015e870 2024-09-11T22:16:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.550+0000 7f104cff9640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f103c06be30 0x7f103c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.550+0000 7f104cff9640 1 -- 172.21.15.50:0/3636262099 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7f10480abb80 con 0x7f105015e870 2024-09-11T22:16:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.551+0000 7f104ffff640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f103c06be30 0x7f103c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.551+0000 7f104ffff640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f103c06be30 0x7f103c06e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1040006fd0 tx=0x7f1040008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.555+0000 7f104cff9640 1 -- 172.21.15.50:0/3636262099 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1048079e70 con 0x7f105015e870 2024-09-11T22:16:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.732+0000 7f1056a2e640 1 -- 172.21.15.50:0/3636262099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10500d1190 con 0x7f105015e870 2024-09-11T22:16:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.733+0000 7f104cff9640 1 -- 172.21.15.50:0/3636262099 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+16863 (secure 0 0 0) 0x7f104807e170 con 0x7f105015e870 2024-09-11T22:16:18.735 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:18.735 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:16:02.821579+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:15:46.760927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T22:15:48.092105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6836/1549905387":"2024-09-12T22:16:02.821555+0000","172.21.15.77:6834/1549905387":"2024-09-12T22:16:02.821555+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:16:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.735+0000 7f1056a2e640 1 -- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f103c06be30 msgr2=0x7f103c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.735+0000 7f1056a2e640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f103c06be30 0x7f103c06e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1040006fd0 tx=0x7f1040008040 comp rx=0 tx=0).stop 2024-09-11T22:16:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.735+0000 7f1056a2e640 1 -- 172.21.15.50:0/3636262099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f105015e870 msgr2=0x7f10500cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.735+0000 7f1056a2e640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f105015e870 0x7f10500cb850 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f1048009f40 tx=0x7f1048004a40 comp rx=0 tx=0).stop 2024-09-11T22:16:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.735+0000 7f1056a2e640 1 -- 172.21.15.50:0/3636262099 shutdown_connections 2024-09-11T22:16:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.735+0000 7f1056a2e640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f103c06be30 0x7f103c06e2f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.735+0000 7f1056a2e640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10500d3c00 0x7f1050161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.735+0000 7f1056a2e640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f105015e870 0x7f10500cb850 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.735+0000 7f1056a2e640 1 --2- 172.21.15.50:0/3636262099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10500d16d0 0x7f10501f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.735+0000 7f1056a2e640 1 -- 172.21.15.50:0/3636262099 >> 172.21.15.50:0/3636262099 conn(0x7f10500727a0 msgr2=0x7f1050157f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.735+0000 7f1056a2e640 1 -- 172.21.15.50:0/3636262099 shutdown_connections 2024-09-11T22:16:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.735+0000 7f1056a2e640 1 -- 172.21.15.50:0/3636262099 wait complete. 2024-09-11T22:16:18.748 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:16:18.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.849+0000 7faa5b33b640 1 Processor -- start 2024-09-11T22:16:18.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.850+0000 7faa5b33b640 1 -- start start 2024-09-11T22:16:18.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.850+0000 7faa5b33b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa540d3c00 0x7faa54169420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.850+0000 7faa5b33b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa540cfa80 con 0x7faa5415e870 2024-09-11T22:16:18.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.850+0000 7faa5b33b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa540d40d0 con 0x7faa540d18a0 2024-09-11T22:16:18.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.850+0000 7faa5b33b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faa540d43b0 con 0x7faa540d3c00 2024-09-11T22:16:18.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.851+0000 7faa590d7640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faa5415e870 0x7faa540d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41786/0 (socket says 172.21.15.50:41786) 2024-09-11T22:16:18.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.851+0000 7faa590d7640 1 -- 172.21.15.50:0/2836227364 learned_addr learned my addr 172.21.15.50:0/2836227364 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:18.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.851+0000 7faa598d8640 1 --2- 172.21.15.50:0/2836227364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa540d3c00 0x7faa54169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.851+0000 7faa4bfff640 1 -- 172.21.15.50:0/2836227364 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3386219114 0 0) 0x7faa50001110 con 0x7faa5415e870 2024-09-11T22:16:18.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.851+0000 7faa4bfff640 1 -- 172.21.15.50:0/2836227364 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa40003520 con 0x7faa5415e870 2024-09-11T22:16:18.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.851+0000 7faa4bfff640 1 -- 172.21.15.50:0/2836227364 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178742188 0 0) 0x7faa540d40d0 con 0x7faa540d18a0 2024-09-11T22:16:18.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.851+0000 7faa4bfff640 1 -- 172.21.15.50:0/2836227364 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa50001110 con 0x7faa540d18a0 2024-09-11T22:16:18.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.851+0000 7faa4bfff640 1 -- 172.21.15.50:0/2836227364 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1892838539 0 0) 0x7faa40003520 con 0x7faa5415e870 2024-09-11T22:16:18.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.851+0000 7faa598d8640 1 -- 172.21.15.50:0/2836227364 >> v1:172.21.15.77:6789/0 conn(0x7faa540d18a0 legacy=0x7faa540d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.851+0000 7faa598d8640 1 -- 172.21.15.50:0/2836227364 >> v1:172.21.15.50:6789/0 conn(0x7faa5415e870 legacy=0x7faa540d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.851+0000 7faa598d8640 1 -- 172.21.15.50:0/2836227364 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa540b7c00 con 0x7faa540d3c00 2024-09-11T22:16:18.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.852+0000 7faa598d8640 1 --2- 172.21.15.50:0/2836227364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa540d3c00 0x7faa54169420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009dc0 tx=0x7faa4c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0325034ed99b45e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.852+0000 7faa4bfff640 1 -- 172.21.15.50:0/2836227364 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa50001840 con 0x7faa540d3c00 2024-09-11T22:16:18.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.852+0000 7faa4bfff640 1 -- 172.21.15.50:0/2836227364 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4c007540 con 0x7faa540d3c00 2024-09-11T22:16:18.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.852+0000 7faa4bfff640 1 -- 172.21.15.50:0/2836227364 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c0078f0 con 0x7faa540d3c00 2024-09-11T22:16:18.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.853+0000 7faa5b33b640 1 -- 172.21.15.50:0/2836227364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa540d3c00 msgr2=0x7faa54169420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.853+0000 7faa5b33b640 1 --2- 172.21.15.50:0/2836227364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa540d3c00 0x7faa54169420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009dc0 tx=0x7faa4c02a660 comp rx=0 tx=0).stop 2024-09-11T22:16:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.853+0000 7faa5b33b640 1 -- 172.21.15.50:0/2836227364 shutdown_connections 2024-09-11T22:16:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.853+0000 7faa5b33b640 1 --2- 172.21.15.50:0/2836227364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa540d3c00 0x7faa54169420 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.853+0000 7faa5b33b640 1 -- 172.21.15.50:0/2836227364 >> 172.21.15.50:0/2836227364 conn(0x7faa540727a0 msgr2=0x7faa540679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.853+0000 7faa5b33b640 1 -- 172.21.15.50:0/2836227364 shutdown_connections 2024-09-11T22:16:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.853+0000 7faa5b33b640 1 -- 172.21.15.50:0/2836227364 wait complete. 2024-09-11T22:16:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.854+0000 7faa5b33b640 1 Processor -- start 2024-09-11T22:16:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.854+0000 7faa5b33b640 1 -- start start 2024-09-11T22:16:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa5b33b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540d18a0 0x7faa540cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa5b33b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa540d3c00 0x7faa540ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa5b33b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa5415e870 0x7faa540cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa5b33b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faa540b78b0 con 0x7faa540d18a0 2024-09-11T22:16:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa5b33b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa5415ec50 con 0x7faa5415e870 2024-09-11T22:16:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa5b33b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faa540b9410 con 0x7faa540d3c00 2024-09-11T22:16:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa590d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540d18a0 0x7faa540cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa590d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540d18a0 0x7faa540cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38860/0 (socket says 172.21.15.50:38860) 2024-09-11T22:16:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa590d7640 1 -- 172.21.15.50:0/2418766504 learned_addr learned my addr 172.21.15.50:0/2418766504 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa590d7640 1 -- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa540d3c00 msgr2=0x7faa540ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa598d8640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa5415e870 0x7faa540cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa588d6640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa540d3c00 0x7faa540ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa590d7640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa540d3c00 0x7faa540ca1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa590d7640 1 -- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa5415e870 msgr2=0x7faa540cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa590d7640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa5415e870 0x7faa540cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa590d7640 1 -- 172.21.15.50:0/2418766504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa540ce320 con 0x7faa540d18a0 2024-09-11T22:16:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa590d7640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540d18a0 0x7faa540cf3c0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7faa500019b0 tx=0x7faa5000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa49ffb640 1 -- 172.21.15.50:0/2418766504 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa50017070 con 0x7faa540d18a0 2024-09-11T22:16:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa49ffb640 1 -- 172.21.15.50:0/2418766504 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa50005af0 con 0x7faa540d18a0 2024-09-11T22:16:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa5b33b640 1 -- 172.21.15.50:0/2418766504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa540ce600 con 0x7faa540d18a0 2024-09-11T22:16:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.855+0000 7faa49ffb640 1 -- 172.21.15.50:0/2418766504 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa50007070 con 0x7faa540d18a0 2024-09-11T22:16:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.856+0000 7faa5b33b640 1 -- 172.21.15.50:0/2418766504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa540cebc0 con 0x7faa540d18a0 2024-09-11T22:16:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.856+0000 7faa5b33b640 1 -- 172.21.15.50:0/2418766504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa540d34f0 con 0x7faa540d18a0 2024-09-11T22:16:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.857+0000 7faa49ffb640 1 -- 172.21.15.50:0/2418766504 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa5001a070 con 0x7faa540d18a0 2024-09-11T22:16:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.857+0000 7faa49ffb640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa3806be30 0x7faa3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.857+0000 7faa49ffb640 1 -- 172.21.15.50:0/2418766504 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5824+0+0 (secure 0 0 0) 0x7faa5008a6c0 con 0x7faa540d18a0 2024-09-11T22:16:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.858+0000 7faa588d6640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa3806be30 0x7faa3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.858+0000 7faa588d6640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa3806be30 0x7faa3806e2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7faa440010e0 tx=0x7faa44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:18.861+0000 7faa49ffb640 1 -- 172.21.15.50:0/2418766504 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faa540cfa80 con 0x7faa540d18a0 2024-09-11T22:16:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.072+0000 7faa5b33b640 1 -- 172.21.15.50:0/2418766504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7faa5415ee70 con 0x7faa540d18a0 2024-09-11T22:16:19.074 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:16:19.073+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:16:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.075+0000 7faa49ffb640 1 -- 172.21.15.50:0/2418766504 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) ==== 161+0+0 (secure 0 0 0) 0x7faa50059090 con 0x7faa540d18a0 2024-09-11T22:16:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:16:19.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.077+0000 7faa5b33b640 1 -- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa3806be30 msgr2=0x7faa3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:19.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.077+0000 7faa5b33b640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa3806be30 0x7faa3806e2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7faa440010e0 tx=0x7faa44009040 comp rx=0 tx=0).stop 2024-09-11T22:16:19.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.077+0000 7faa5b33b640 1 -- 172.21.15.50:0/2418766504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540d18a0 msgr2=0x7faa540cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:19.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.077+0000 7faa5b33b640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540d18a0 0x7faa540cf3c0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7faa500019b0 tx=0x7faa5000cb90 comp rx=0 tx=0).stop 2024-09-11T22:16:19.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.077+0000 7faa5b33b640 1 -- 172.21.15.50:0/2418766504 shutdown_connections 2024-09-11T22:16:19.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.077+0000 7faa5b33b640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faa3806be30 0x7faa3806e2f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:19.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.077+0000 7faa5b33b640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa540d3c00 0x7faa540ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:19.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.077+0000 7faa5b33b640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa5415e870 0x7faa540cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:19.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.077+0000 7faa5b33b640 1 --2- 172.21.15.50:0/2418766504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa540d18a0 0x7faa540cf3c0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:19.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.077+0000 7faa5b33b640 1 -- 172.21.15.50:0/2418766504 >> 172.21.15.50:0/2418766504 conn(0x7faa540727a0 msgr2=0x7faa540b9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:19.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.077+0000 7faa5b33b640 1 -- 172.21.15.50:0/2418766504 shutdown_connections 2024-09-11T22:16:19.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.078+0000 7faa5b33b640 1 -- 172.21.15.50:0/2418766504 wait complete. 2024-09-11T22:16:19.082 INFO:tasks.ceph.mds.a.smithi050.stderr: -1452> 2024-09-11T22:16:09.832+0000 7fbbd5509640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:16:19.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:16:19.111 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:16:19.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.196+0000 7f931a3fd640 1 Processor -- start 2024-09-11T22:16:19.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.196+0000 7f931a3fd640 1 -- start start 2024-09-11T22:16:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.197+0000 7f931a3fd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93140b1600 0x7f93140b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.197+0000 7f931a3fd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93140cfbd0 con 0x7f9314161fa0 2024-09-11T22:16:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.197+0000 7f931a3fd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93140cfeb0 con 0x7f93140cf610 2024-09-11T22:16:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.197+0000 7f931a3fd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f93140d1220 con 0x7f93140b1600 2024-09-11T22:16:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.197+0000 7f931899a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93140b1600 0x7f93140b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.197+0000 7f9313fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9314161fa0 0x7f93140cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41804/0 (socket says 172.21.15.50:41804) 2024-09-11T22:16:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.197+0000 7f9313fff640 1 -- 172.21.15.50:0/3563511797 learned_addr learned my addr 172.21.15.50:0/3563511797 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.197+0000 7f931899a640 1 -- 172.21.15.50:0/3563511797 >> v1:172.21.15.77:6789/0 conn(0x7f93140cf610 legacy=0x7f93140cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.197+0000 7f931899a640 1 -- 172.21.15.50:0/3563511797 >> v1:172.21.15.50:6789/0 conn(0x7f9314161fa0 legacy=0x7f93140cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.197+0000 7f931899a640 1 -- 172.21.15.50:0/3563511797 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93140d1470 con 0x7f93140b1600 2024-09-11T22:16:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.198+0000 7f931899a640 1 --2- 172.21.15.50:0/3563511797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93140b1600 0x7f93140b4d20 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f930c009d90 tx=0x7f930c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e244f9ecb3d7fe18 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.198+0000 7f9312ffd640 1 -- 172.21.15.50:0/3563511797 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c007740 con 0x7f93140b1600 2024-09-11T22:16:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.198+0000 7f9312ffd640 1 -- 172.21.15.50:0/3563511797 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f930c0078e0 con 0x7f93140b1600 2024-09-11T22:16:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.198+0000 7f9312ffd640 1 -- 172.21.15.50:0/3563511797 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c007cb0 con 0x7f93140b1600 2024-09-11T22:16:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.199+0000 7f931a3fd640 1 -- 172.21.15.50:0/3563511797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93140b1600 msgr2=0x7f93140b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.199+0000 7f931a3fd640 1 --2- 172.21.15.50:0/3563511797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93140b1600 0x7f93140b4d20 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f930c009d90 tx=0x7f930c02a6a0 comp rx=0 tx=0).stop 2024-09-11T22:16:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.199+0000 7f931a3fd640 1 -- 172.21.15.50:0/3563511797 shutdown_connections 2024-09-11T22:16:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.199+0000 7f931a3fd640 1 --2- 172.21.15.50:0/3563511797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93140b1600 0x7f93140b4d20 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.199+0000 7f931a3fd640 1 -- 172.21.15.50:0/3563511797 >> 172.21.15.50:0/3563511797 conn(0x7f931409ba50 msgr2=0x7f93140b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.199+0000 7f931a3fd640 1 -- 172.21.15.50:0/3563511797 shutdown_connections 2024-09-11T22:16:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.199+0000 7f931a3fd640 1 -- 172.21.15.50:0/3563511797 wait complete. 2024-09-11T22:16:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.200+0000 7f931a3fd640 1 Processor -- start 2024-09-11T22:16:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.200+0000 7f931a3fd640 1 -- start start 2024-09-11T22:16:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f931a3fd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93140b1600 0x7f93140c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f931a3fd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93140cf610 0x7f93140b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f931a3fd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9314161fa0 0x7f93140ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f931a3fd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f93140d1c70 con 0x7f93140cf610 2024-09-11T22:16:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f931a3fd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f93140d17e0 con 0x7f9314161fa0 2024-09-11T22:16:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f931a3fd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f93140d1df0 con 0x7f93140b1600 2024-09-11T22:16:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f93137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93140cf610 0x7f93140b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f93137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93140cf610 0x7f93140b5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38878/0 (socket says 172.21.15.50:38878) 2024-09-11T22:16:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f93137fe640 1 -- 172.21.15.50:0/2113886067 learned_addr learned my addr 172.21.15.50:0/2113886067 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f931899a640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9314161fa0 0x7f93140ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f9313fff640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93140b1600 0x7f93140c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f93137fe640 1 -- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93140b1600 msgr2=0x7f93140c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f93137fe640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93140b1600 0x7f93140c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f93137fe640 1 -- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9314161fa0 msgr2=0x7f93140ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f93137fe640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9314161fa0 0x7f93140ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f93137fe640 1 -- 172.21.15.50:0/2113886067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93140c98d0 con 0x7f93140cf610 2024-09-11T22:16:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.201+0000 7f9313fff640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93140b1600 0x7f93140c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.202+0000 7f93137fe640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93140cf610 0x7f93140b5fc0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f930800c430 tx=0x7f930800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.202+0000 7f9310ff9640 1 -- 172.21.15.50:0/2113886067 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308011790 con 0x7f93140cf610 2024-09-11T22:16:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.202+0000 7f9310ff9640 1 -- 172.21.15.50:0/2113886067 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9308017070 con 0x7f93140cf610 2024-09-11T22:16:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.202+0000 7f931a3fd640 1 -- 172.21.15.50:0/2113886067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93140c9bb0 con 0x7f93140cf610 2024-09-11T22:16:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.202+0000 7f9310ff9640 1 -- 172.21.15.50:0/2113886067 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308011bb0 con 0x7f93140cf610 2024-09-11T22:16:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.202+0000 7f931a3fd640 1 -- 172.21.15.50:0/2113886067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93140ca170 con 0x7f93140cf610 2024-09-11T22:16:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.203+0000 7f931a3fd640 1 -- 172.21.15.50:0/2113886067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93140ca370 con 0x7f93140cf610 2024-09-11T22:16:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.203+0000 7f9310ff9640 1 -- 172.21.15.50:0/2113886067 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f930801c460 con 0x7f93140cf610 2024-09-11T22:16:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.204+0000 7f9310ff9640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f930006be30 0x7f930006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.204+0000 7f9310ff9640 1 -- 172.21.15.50:0/2113886067 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5910+0+0 (secure 0 0 0) 0x7f930808ada0 con 0x7f93140cf610 2024-09-11T22:16:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.204+0000 7f9313fff640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f930006be30 0x7f930006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.204+0000 7f9313fff640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f930006be30 0x7f930006e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f93140cc100 tx=0x7f9304009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.208+0000 7f9310ff9640 1 -- 172.21.15.50:0/2113886067 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93140ca370 con 0x7f93140cf610 2024-09-11T22:16:19.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:19.418+0000 7f931a3fd640 1 -- 172.21.15.50:0/2113886067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f93140b4d20 con 0x7f93140cf610 2024-09-11T22:16:20.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.079+0000 7f9310ff9640 1 -- 172.21.15.50:0/2113886067 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) ==== 104+0+0 (secure 0 0 0) 0x7f9308059710 con 0x7f93140cf610 2024-09-11T22:16:20.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.082+0000 7f931a3fd640 1 -- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f930006be30 msgr2=0x7f930006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:20.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.082+0000 7f931a3fd640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f930006be30 0x7f930006e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f93140cc100 tx=0x7f9304009040 comp rx=0 tx=0).stop 2024-09-11T22:16:20.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.082+0000 7f931a3fd640 1 -- 172.21.15.50:0/2113886067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93140cf610 msgr2=0x7f93140b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:20.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.082+0000 7f931a3fd640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93140cf610 0x7f93140b5fc0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f930800c430 tx=0x7f930800c8f0 comp rx=0 tx=0).stop 2024-09-11T22:16:20.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.082+0000 7f931a3fd640 1 -- 172.21.15.50:0/2113886067 shutdown_connections 2024-09-11T22:16:20.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.082+0000 7f931a3fd640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f930006be30 0x7f930006e2f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:20.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.082+0000 7f931a3fd640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9314161fa0 0x7f93140ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:20.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.082+0000 7f931a3fd640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93140cf610 0x7f93140b5fc0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:20.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.082+0000 7f931a3fd640 1 --2- 172.21.15.50:0/2113886067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93140b1600 0x7f93140c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:20.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.082+0000 7f931a3fd640 1 -- 172.21.15.50:0/2113886067 >> 172.21.15.50:0/2113886067 conn(0x7f931409ba50 msgr2=0x7f93140ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:20.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.082+0000 7f931a3fd640 1 -- 172.21.15.50:0/2113886067 shutdown_connections 2024-09-11T22:16:20.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.082+0000 7f931a3fd640 1 -- 172.21.15.50:0/2113886067 wait complete. 2024-09-11T22:16:20.097 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:16:20.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.247+0000 7f35a1417640 1 Processor -- start 2024-09-11T22:16:20.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.247+0000 7f35a1417640 1 -- start start 2024-09-11T22:16:20.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.248+0000 7f35a1417640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f359c154ef0 0x7f359c155380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:20.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.248+0000 7f35a1417640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f359c0af550 con 0x7f359c073900 2024-09-11T22:16:20.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.248+0000 7f35a1417640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f359c0af7f0 con 0x7f359c1623a0 2024-09-11T22:16:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.248+0000 7f35a1417640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f359c073ce0 con 0x7f359c154ef0 2024-09-11T22:16:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.248+0000 7f359affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f359c073900 0x7f359c0b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41814/0 (socket says 172.21.15.50:41814) 2024-09-11T22:16:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.248+0000 7f359affd640 1 -- 172.21.15.50:0/689175546 learned_addr learned my addr 172.21.15.50:0/689175546 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.248+0000 7f359b7fe640 1 --2- 172.21.15.50:0/689175546 >> v2:172.21.15.77:3300/0 conn(0x7f359c154ef0 0x7f359c155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.249+0000 7f3599ffb640 1 -- 172.21.15.50:0/689175546 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3468609589 0 0) 0x7f359c0af550 con 0x7f359c073900 2024-09-11T22:16:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.249+0000 7f3599ffb640 1 -- 172.21.15.50:0/689175546 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3588003520 con 0x7f359c073900 2024-09-11T22:16:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.249+0000 7f359b7fe640 1 -- 172.21.15.50:0/689175546 >> v1:172.21.15.77:6789/0 conn(0x7f359c1623a0 legacy=0x7f359c1627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.249+0000 7f359b7fe640 1 -- 172.21.15.50:0/689175546 >> v1:172.21.15.50:6789/0 conn(0x7f359c073900 legacy=0x7f359c0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:20.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.249+0000 7f359b7fe640 1 -- 172.21.15.50:0/689175546 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c0afad0 con 0x7f359c154ef0 2024-09-11T22:16:20.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.249+0000 7f359b7fe640 1 --2- 172.21.15.50:0/689175546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f359c154ef0 0x7f359c155380 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f358c009d90 tx=0x7f358c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31f44e3c74a84987 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:20.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.250+0000 7f3599ffb640 1 -- 172.21.15.50:0/689175546 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c007740 con 0x7f359c154ef0 2024-09-11T22:16:20.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.250+0000 7f3599ffb640 1 -- 172.21.15.50:0/689175546 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f358c0078e0 con 0x7f359c154ef0 2024-09-11T22:16:20.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.250+0000 7f3599ffb640 1 -- 172.21.15.50:0/689175546 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c007c90 con 0x7f359c154ef0 2024-09-11T22:16:20.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.250+0000 7f35a1417640 1 -- 172.21.15.50:0/689175546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f359c154ef0 msgr2=0x7f359c155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:20.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.250+0000 7f35a1417640 1 --2- 172.21.15.50:0/689175546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f359c154ef0 0x7f359c155380 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f358c009d90 tx=0x7f358c02a660 comp rx=0 tx=0).stop 2024-09-11T22:16:20.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.250+0000 7f35a1417640 1 -- 172.21.15.50:0/689175546 shutdown_connections 2024-09-11T22:16:20.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.250+0000 7f35a1417640 1 --2- 172.21.15.50:0/689175546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f359c154ef0 0x7f359c155380 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:20.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.250+0000 7f35a1417640 1 -- 172.21.15.50:0/689175546 >> 172.21.15.50:0/689175546 conn(0x7f359c06bb50 msgr2=0x7f359c06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:20.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.250+0000 7f35a1417640 1 -- 172.21.15.50:0/689175546 shutdown_connections 2024-09-11T22:16:20.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.250+0000 7f35a1417640 1 -- 172.21.15.50:0/689175546 wait complete. 2024-09-11T22:16:20.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.252+0000 7f35a1417640 1 Processor -- start 2024-09-11T22:16:20.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.252+0000 7f35a1417640 1 -- start start 2024-09-11T22:16:20.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.252+0000 7f35a1417640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f359c073900 0x7f359c0d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.252+0000 7f35a1417640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c154ef0 0x7f359c152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.252+0000 7f35a1417640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f359c1623a0 0x7f359c153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.252+0000 7f35a1417640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f359c0b0090 con 0x7f359c154ef0 2024-09-11T22:16:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.252+0000 7f35a1417640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f359c06eb10 con 0x7f359c1623a0 2024-09-11T22:16:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.252+0000 7f35a1417640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f359c163100 con 0x7f359c073900 2024-09-11T22:16:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.252+0000 7f359a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c154ef0 0x7f359c152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.252+0000 7f359a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c154ef0 0x7f359c152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38890/0 (socket says 172.21.15.50:38890) 2024-09-11T22:16:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f359a7fc640 1 -- 172.21.15.50:0/2017642962 learned_addr learned my addr 172.21.15.50:0/2017642962 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f359b7fe640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f359c1623a0 0x7f359c153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f359affd640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f359c073900 0x7f359c0d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f359a7fc640 1 -- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f359c073900 msgr2=0x7f359c0d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:20.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f359a7fc640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f359c073900 0x7f359c0d03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:20.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f359a7fc640 1 -- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f359c1623a0 msgr2=0x7f359c153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:20.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f359a7fc640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f359c1623a0 0x7f359c153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:20.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f359a7fc640 1 -- 172.21.15.50:0/2017642962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c0cd970 con 0x7f359c154ef0 2024-09-11T22:16:20.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f359a7fc640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c154ef0 0x7f359c152a60 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f358400c3c0 tx=0x7f358400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:20.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f35937fe640 1 -- 172.21.15.50:0/2017642962 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35840052d0 con 0x7f359c154ef0 2024-09-11T22:16:20.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f35a1417640 1 -- 172.21.15.50:0/2017642962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359c159460 con 0x7f359c154ef0 2024-09-11T22:16:20.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f35937fe640 1 -- 172.21.15.50:0/2017642962 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3584005490 con 0x7f359c154ef0 2024-09-11T22:16:20.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f35937fe640 1 -- 172.21.15.50:0/2017642962 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584007260 con 0x7f359c154ef0 2024-09-11T22:16:20.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.253+0000 7f35a1417640 1 -- 172.21.15.50:0/2017642962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359c159a20 con 0x7f359c154ef0 2024-09-11T22:16:20.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.254+0000 7f35a1417640 1 -- 172.21.15.50:0/2017642962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f359c0b05b0 con 0x7f359c154ef0 2024-09-11T22:16:20.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.255+0000 7f35937fe640 1 -- 172.21.15.50:0/2017642962 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3584007400 con 0x7f359c154ef0 2024-09-11T22:16:20.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.255+0000 7f35937fe640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f357c06be30 0x7f357c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:20.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.255+0000 7f35937fe640 1 -- 172.21.15.50:0/2017642962 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5910+0+0 (secure 0 0 0) 0x7f358408a320 con 0x7f359c154ef0 2024-09-11T22:16:20.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.255+0000 7f359affd640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f357c06be30 0x7f357c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:20.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.256+0000 7f359affd640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f357c06be30 0x7f357c06e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f35940011e0 tx=0x7f3594007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:20.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.259+0000 7f35937fe640 1 -- 172.21.15.50:0/2017642962 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f35840585c0 con 0x7f359c154ef0 2024-09-11T22:16:20.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:20.433+0000 7f35a1417640 1 -- 172.21.15.50:0/2017642962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f359c15e430 con 0x7f359c154ef0 2024-09-11T22:16:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.081+0000 7f35937fe640 1 -- 172.21.15.50:0/2017642962 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) ==== 181+0+0 (secure 0 0 0) 0x7f3584077030 con 0x7f359c154ef0 2024-09-11T22:16:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:16:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.085+0000 7f35a1417640 1 -- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f357c06be30 msgr2=0x7f357c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.085+0000 7f35a1417640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f357c06be30 0x7f357c06e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f35940011e0 tx=0x7f3594007d30 comp rx=0 tx=0).stop 2024-09-11T22:16:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.085+0000 7f35a1417640 1 -- 172.21.15.50:0/2017642962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c154ef0 msgr2=0x7f359c152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.085+0000 7f35a1417640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c154ef0 0x7f359c152a60 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f358400c3c0 tx=0x7f358400c880 comp rx=0 tx=0).stop 2024-09-11T22:16:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.085+0000 7f35a1417640 1 -- 172.21.15.50:0/2017642962 shutdown_connections 2024-09-11T22:16:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.085+0000 7f35a1417640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f357c06be30 0x7f357c06e2f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.085+0000 7f35a1417640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f359c1623a0 0x7f359c153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.085+0000 7f35a1417640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c154ef0 0x7f359c152a60 secure :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f358400c3c0 tx=0x7f358400c880 comp rx=0 tx=0).stop 2024-09-11T22:16:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.085+0000 7f35a1417640 1 --2- 172.21.15.50:0/2017642962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f359c073900 0x7f359c0d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.085+0000 7f35a1417640 1 -- 172.21.15.50:0/2017642962 >> 172.21.15.50:0/2017642962 conn(0x7f359c06bb50 msgr2=0x7f359c0725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.085+0000 7f35a1417640 1 -- 172.21.15.50:0/2017642962 shutdown_connections 2024-09-11T22:16:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.085+0000 7f35a1417640 1 -- 172.21.15.50:0/2017642962 wait complete. 2024-09-11T22:16:21.100 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:16:21.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.211+0000 7fa092817640 1 Processor -- start 2024-09-11T22:16:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.211+0000 7fa092817640 1 -- start start 2024-09-11T22:16:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.212+0000 7fa092817640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa08c06ff20 0x7fa08c15eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.212+0000 7fa092817640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa08c0b2590 0x7fa08c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.212+0000 7fa092817640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa08c159050 con 0x7fa08c0afe10 2024-09-11T22:16:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.212+0000 7fa092817640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa08c0b07c0 con 0x7fa08c0b2590 2024-09-11T22:16:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.212+0000 7fa092817640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa08c070300 con 0x7fa08c06ff20 2024-09-11T22:16:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.212+0000 7fa090db4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa08c0b2590 0x7fa08c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.212+0000 7fa090db4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa08c0b2590 0x7fa08c0b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38900/0 (socket says 172.21.15.50:38900) 2024-09-11T22:16:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.212+0000 7fa090db4640 1 -- 172.21.15.50:0/1546418718 learned_addr learned my addr 172.21.15.50:0/1546418718 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.212+0000 7fa08bfff640 1 --2- 172.21.15.50:0/1546418718 >> v2:172.21.15.77:3300/0 conn(0x7fa08c06ff20 0x7fa08c15eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.212+0000 7fa090db4640 1 -- 172.21.15.50:0/1546418718 >> v2:172.21.15.77:3300/0 conn(0x7fa08c06ff20 msgr2=0x7fa08c15eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.212+0000 7fa090db4640 1 --2- 172.21.15.50:0/1546418718 >> v2:172.21.15.77:3300/0 conn(0x7fa08c06ff20 0x7fa08c15eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.212+0000 7fa090db4640 1 -- 172.21.15.50:0/1546418718 >> v1:172.21.15.77:6789/0 conn(0x7fa08c0afe10 legacy=0x7fa08c0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.212+0000 7fa090db4640 1 -- 172.21.15.50:0/1546418718 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c0ae8c0 con 0x7fa08c0b2590 2024-09-11T22:16:21.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.213+0000 7fa090db4640 1 --2- 172.21.15.50:0/1546418718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c0b2590 0x7fa08c0b0280 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa084009e80 tx=0x7fa08402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4db59ad0653191 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:21.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.213+0000 7fa08affd640 1 -- 172.21.15.50:0/1546418718 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084036070 con 0x7fa08c0b2590 2024-09-11T22:16:21.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.213+0000 7fa08affd640 1 -- 172.21.15.50:0/1546418718 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa084031600 con 0x7fa08c0b2590 2024-09-11T22:16:21.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.213+0000 7fa08affd640 1 -- 172.21.15.50:0/1546418718 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0840319d0 con 0x7fa08c0b2590 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.214+0000 7fa092817640 1 -- 172.21.15.50:0/1546418718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c0b2590 msgr2=0x7fa08c0b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.214+0000 7fa092817640 1 --2- 172.21.15.50:0/1546418718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c0b2590 0x7fa08c0b0280 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa084009e80 tx=0x7fa08402a6c0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.214+0000 7fa092817640 1 -- 172.21.15.50:0/1546418718 shutdown_connections 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.214+0000 7fa092817640 1 --2- 172.21.15.50:0/1546418718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c0b2590 0x7fa08c0b0280 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.214+0000 7fa092817640 1 --2- 172.21.15.50:0/1546418718 >> v2:172.21.15.77:3300/0 conn(0x7fa08c06ff20 0x7fa08c15eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.214+0000 7fa092817640 1 -- 172.21.15.50:0/1546418718 >> 172.21.15.50:0/1546418718 conn(0x7fa08c0b0a60 msgr2=0x7fa08c073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.214+0000 7fa092817640 1 -- 172.21.15.50:0/1546418718 shutdown_connections 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.214+0000 7fa092817640 1 -- 172.21.15.50:0/1546418718 wait complete. 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.215+0000 7fa092817640 1 Processor -- start 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.215+0000 7fa092817640 1 -- start start 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa092817640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c06ff20 0x7fa08c155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa092817640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa08c0afe10 0x7fa08c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa092817640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa08c0b2590 0x7fa08c0cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa092817640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c0af160 con 0x7fa08c06ff20 2024-09-11T22:16:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa092817640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c0aee80 con 0x7fa08c0b2590 2024-09-11T22:16:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa092817640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa08c0af440 con 0x7fa08c0afe10 2024-09-11T22:16:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa08bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c06ff20 0x7fa08c155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa08bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c06ff20 0x7fa08c155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38916/0 (socket says 172.21.15.50:38916) 2024-09-11T22:16:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa08bfff640 1 -- 172.21.15.50:0/229280407 learned_addr learned my addr 172.21.15.50:0/229280407 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa090db4640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa08c0b2590 0x7fa08c0cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa08b7fe640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa08c0afe10 0x7fa08c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa08bfff640 1 -- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa08c0afe10 msgr2=0x7fa08c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa08bfff640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa08c0afe10 0x7fa08c0ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa08bfff640 1 -- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa08c0b2590 msgr2=0x7fa08c0cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa08bfff640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa08c0b2590 0x7fa08c0cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa08bfff640 1 -- 172.21.15.50:0/229280407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c0cf170 con 0x7fa08c06ff20 2024-09-11T22:16:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa08b7fe640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa08c0afe10 0x7fa08c0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.216+0000 7fa08bfff640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c06ff20 0x7fa08c155c60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00d800 tx=0x7fa07c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.217+0000 7fa088ff9640 1 -- 172.21.15.50:0/229280407 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00b6c0 con 0x7fa08c06ff20 2024-09-11T22:16:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.217+0000 7fa088ff9640 1 -- 172.21.15.50:0/229280407 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07c019070 con 0x7fa08c06ff20 2024-09-11T22:16:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.217+0000 7fa092817640 1 -- 172.21.15.50:0/229280407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08c0cf450 con 0x7fa08c06ff20 2024-09-11T22:16:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.217+0000 7fa088ff9640 1 -- 172.21.15.50:0/229280407 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00ba80 con 0x7fa08c06ff20 2024-09-11T22:16:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.217+0000 7fa092817640 1 -- 172.21.15.50:0/229280407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08c0cfa10 con 0x7fa08c06ff20 2024-09-11T22:16:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.218+0000 7fa092817640 1 -- 172.21.15.50:0/229280407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08c15eb70 con 0x7fa08c06ff20 2024-09-11T22:16:21.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.218+0000 7fa088ff9640 1 -- 172.21.15.50:0/229280407 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa07c00bc20 con 0x7fa08c06ff20 2024-09-11T22:16:21.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.219+0000 7fa088ff9640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa07806be30 0x7fa07806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:21.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.219+0000 7fa088ff9640 1 -- 172.21.15.50:0/229280407 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5472+0+0 (secure 0 0 0) 0x7fa07c08b2a0 con 0x7fa08c06ff20 2024-09-11T22:16:21.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.219+0000 7fa08b7fe640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa07806be30 0x7fa07806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:21.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.219+0000 7fa08b7fe640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa07806be30 0x7fa07806e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0d0990 tx=0x7fa080009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:21.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.223+0000 7fa088ff9640 1 -- 172.21.15.50:0/229280407 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa07c059cc0 con 0x7fa08c06ff20 2024-09-11T22:16:21.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:21.399+0000 7fa092817640 1 -- 172.21.15.50:0/229280407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa08c074e20 con 0x7fa08c06ff20 2024-09-11T22:16:22.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.086+0000 7fa088ff9640 1 -- 172.21.15.50:0/229280407 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) ==== 169+0+0 (secure 0 0 0) 0x7fa07c08b0c0 con 0x7fa08c06ff20 2024-09-11T22:16:22.087 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:16:22.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.089+0000 7fa092817640 1 -- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa07806be30 msgr2=0x7fa07806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.089+0000 7fa092817640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa07806be30 0x7fa07806e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0d0990 tx=0x7fa080009040 comp rx=0 tx=0).stop 2024-09-11T22:16:22.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.089+0000 7fa092817640 1 -- 172.21.15.50:0/229280407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c06ff20 msgr2=0x7fa08c155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.089+0000 7fa092817640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c06ff20 0x7fa08c155c60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00d800 tx=0x7fa07c00dcc0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.090+0000 7fa092817640 1 -- 172.21.15.50:0/229280407 shutdown_connections 2024-09-11T22:16:22.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.090+0000 7fa092817640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa07806be30 0x7fa07806e2f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.090+0000 7fa092817640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa08c0afe10 0x7fa08c0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.090+0000 7fa092817640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa08c0b2590 0x7fa08c0cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.090+0000 7fa092817640 1 --2- 172.21.15.50:0/229280407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa08c06ff20 0x7fa08c155c60 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.090+0000 7fa092817640 1 -- 172.21.15.50:0/229280407 >> 172.21.15.50:0/229280407 conn(0x7fa08c0b0a60 msgr2=0x7fa08c1614f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:22.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.090+0000 7fa092817640 1 -- 172.21.15.50:0/229280407 shutdown_connections 2024-09-11T22:16:22.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.090+0000 7fa092817640 1 -- 172.21.15.50:0/229280407 wait complete. 2024-09-11T22:16:22.105 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-09-11T22:16:22.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.213+0000 7f7394a23640 1 Processor -- start 2024-09-11T22:16:22.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.213+0000 7f7394a23640 1 -- start start 2024-09-11T22:16:22.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.214+0000 7f7394a23640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f73900d18a0 0x7f73900d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.214+0000 7f7394a23640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73900d3a30 0x7f73900b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.214+0000 7f7394a23640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73900cfa80 con 0x7f739015e870 2024-09-11T22:16:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.214+0000 7f7394a23640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f73900d3ea0 con 0x7f73900d18a0 2024-09-11T22:16:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.214+0000 7f7394a23640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f73900d40d0 con 0x7f73900d3a30 2024-09-11T22:16:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.214+0000 7f738e59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f739015e870 0x7f73900d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41830/0 (socket says 172.21.15.50:41830) 2024-09-11T22:16:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.214+0000 7f738e59c640 1 -- 172.21.15.50:0/2428162856 learned_addr learned my addr 172.21.15.50:0/2428162856 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.215+0000 7f738ed9d640 1 --2- 172.21.15.50:0/2428162856 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73900d3a30 0x7f73900b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.215+0000 7f738dd9b640 1 --2- 172.21.15.50:0/2428162856 >> v2:172.21.15.77:3300/0 conn(0x7f73900d18a0 0x7f73900d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.215+0000 7f738d59a640 1 -- 172.21.15.50:0/2428162856 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 200862468 0 0) 0x7f7380001490 con 0x7f739015e870 2024-09-11T22:16:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.215+0000 7f738d59a640 1 -- 172.21.15.50:0/2428162856 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f737c003520 con 0x7f739015e870 2024-09-11T22:16:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.215+0000 7f738ed9d640 1 -- 172.21.15.50:0/2428162856 >> v2:172.21.15.77:3300/0 conn(0x7f73900d18a0 msgr2=0x7f73900d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.215+0000 7f738d59a640 1 -- 172.21.15.50:0/2428162856 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2932532314 0 0) 0x7f737c003520 con 0x7f739015e870 2024-09-11T22:16:22.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.215+0000 7f738ed9d640 1 --2- 172.21.15.50:0/2428162856 >> v2:172.21.15.77:3300/0 conn(0x7f73900d18a0 0x7f73900d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.215+0000 7f738ed9d640 1 -- 172.21.15.50:0/2428162856 >> v1:172.21.15.50:6789/0 conn(0x7f739015e870 legacy=0x7f73900d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.215+0000 7f738ed9d640 1 -- 172.21.15.50:0/2428162856 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73900d43b0 con 0x7f73900d3a30 2024-09-11T22:16:22.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.215+0000 7f738dd9b640 1 --2- 172.21.15.50:0/2428162856 >> v2:172.21.15.77:3300/0 conn(0x7f73900d18a0 0x7f73900d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:22.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.216+0000 7f738ed9d640 1 --2- 172.21.15.50:0/2428162856 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73900d3a30 0x7f73900b8400 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f73880097a0 tx=0x7f738802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=894a3df1ad2ad4ad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:22.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.216+0000 7f738d59a640 1 -- 172.21.15.50:0/2428162856 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388037070 con 0x7f73900d3a30 2024-09-11T22:16:22.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.216+0000 7f738d59a640 1 -- 172.21.15.50:0/2428162856 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738802aba0 con 0x7f73900d3a30 2024-09-11T22:16:22.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.216+0000 7f738d59a640 1 -- 172.21.15.50:0/2428162856 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380001be0 con 0x7f73900d3a30 2024-09-11T22:16:22.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.216+0000 7f7394a23640 1 -- 172.21.15.50:0/2428162856 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73900d3a30 msgr2=0x7f73900b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.216+0000 7f7394a23640 1 --2- 172.21.15.50:0/2428162856 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73900d3a30 0x7f73900b8400 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f73880097a0 tx=0x7f738802a110 comp rx=0 tx=0).stop 2024-09-11T22:16:22.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.217+0000 7f7394a23640 1 -- 172.21.15.50:0/2428162856 shutdown_connections 2024-09-11T22:16:22.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.217+0000 7f7394a23640 1 --2- 172.21.15.50:0/2428162856 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73900d3a30 0x7f73900b8400 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.217+0000 7f7394a23640 1 --2- 172.21.15.50:0/2428162856 >> v2:172.21.15.77:3300/0 conn(0x7f73900d18a0 0x7f73900d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.217+0000 7f7394a23640 1 -- 172.21.15.50:0/2428162856 >> 172.21.15.50:0/2428162856 conn(0x7f73900727a0 msgr2=0x7f73900679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:22.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.217+0000 7f7394a23640 1 -- 172.21.15.50:0/2428162856 shutdown_connections 2024-09-11T22:16:22.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.217+0000 7f7394a23640 1 -- 172.21.15.50:0/2428162856 wait complete. 2024-09-11T22:16:22.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.218+0000 7f7394a23640 1 Processor -- start 2024-09-11T22:16:22.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.218+0000 7f7394a23640 1 -- start start 2024-09-11T22:16:22.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f7394a23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d18a0 0x7f73900cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f7394a23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73900d3a30 0x7f7390157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f7394a23640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f739015e870 0x7f7390155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f7394a23640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f739015ec50 con 0x7f73900d18a0 2024-09-11T22:16:22.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f7394a23640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73900b7ee0 con 0x7f73900d3a30 2024-09-11T22:16:22.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f7394a23640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f73900b78b0 con 0x7f739015e870 2024-09-11T22:16:22.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f738e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d18a0 0x7f73900cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f738e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d18a0 0x7f73900cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38918/0 (socket says 172.21.15.50:38918) 2024-09-11T22:16:22.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f738e59c640 1 -- 172.21.15.50:0/1848242143 learned_addr learned my addr 172.21.15.50:0/1848242143 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:22.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f738ed9d640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f739015e870 0x7f7390155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f738dd9b640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73900d3a30 0x7f7390157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f738e59c640 1 -- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f739015e870 msgr2=0x7f7390155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f738e59c640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f739015e870 0x7f7390155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f738e59c640 1 -- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73900d3a30 msgr2=0x7f7390157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f738e59c640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73900d3a30 0x7f7390157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f738e59c640 1 -- 172.21.15.50:0/1848242143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739015b3e0 con 0x7f73900d18a0 2024-09-11T22:16:22.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f738e59c640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d18a0 0x7f73900cb850 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f738000cac0 tx=0x7f738000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:22.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.219+0000 7f7386ffd640 1 -- 172.21.15.50:0/1848242143 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380018070 con 0x7f73900d18a0 2024-09-11T22:16:22.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.220+0000 7f7386ffd640 1 -- 172.21.15.50:0/1848242143 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738000a680 con 0x7f73900d18a0 2024-09-11T22:16:22.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.220+0000 7f7386ffd640 1 -- 172.21.15.50:0/1848242143 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738000aab0 con 0x7f73900d18a0 2024-09-11T22:16:22.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.220+0000 7f7394a23640 1 -- 172.21.15.50:0/1848242143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739015b680 con 0x7f73900d18a0 2024-09-11T22:16:22.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.220+0000 7f7394a23640 1 -- 172.21.15.50:0/1848242143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f739015bf20 con 0x7f73900d18a0 2024-09-11T22:16:22.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.221+0000 7f7394a23640 1 -- 172.21.15.50:0/1848242143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f739015ba70 con 0x7f73900d18a0 2024-09-11T22:16:22.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.221+0000 7f7386ffd640 1 -- 172.21.15.50:0/1848242143 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f738001b070 con 0x7f73900d18a0 2024-09-11T22:16:22.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.222+0000 7f7386ffd640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f737006be30 0x7f737006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.222+0000 7f7386ffd640 1 -- 172.21.15.50:0/1848242143 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f738008a310 con 0x7f73900d18a0 2024-09-11T22:16:22.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.222+0000 7f738dd9b640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f737006be30 0x7f737006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.222+0000 7f738dd9b640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f737006be30 0x7f737006e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7378009560 tx=0x7f7378009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:22.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.226+0000 7f7386ffd640 1 -- 172.21.15.50:0/1848242143 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73900cfa80 con 0x7f73900d18a0 2024-09-11T22:16:22.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.401+0000 7f7394a23640 1 -- 172.21.15.50:0/1848242143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7f73900d34f0 con 0x7f73900d18a0 2024-09-11T22:16:22.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.404+0000 7f7386ffd640 1 -- 172.21.15.50:0/1848242143 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v30) ==== 101+0+0 (secure 0 0 0) 0x7f7380058910 con 0x7f73900d18a0 2024-09-11T22:16:22.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.406+0000 7f7394a23640 1 -- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f737006be30 msgr2=0x7f737006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.406+0000 7f7394a23640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f737006be30 0x7f737006e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7378009560 tx=0x7f7378009190 comp rx=0 tx=0).stop 2024-09-11T22:16:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.406+0000 7f7394a23640 1 -- 172.21.15.50:0/1848242143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d18a0 msgr2=0x7f73900cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.406+0000 7f7394a23640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d18a0 0x7f73900cb850 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f738000cac0 tx=0x7f738000cf80 comp rx=0 tx=0).stop 2024-09-11T22:16:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.406+0000 7f7394a23640 1 -- 172.21.15.50:0/1848242143 shutdown_connections 2024-09-11T22:16:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.406+0000 7f7394a23640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f737006be30 0x7f737006e2f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.406+0000 7f7394a23640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f739015e870 0x7f7390155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.406+0000 7f7394a23640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73900d3a30 0x7f7390157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.406+0000 7f7394a23640 1 --2- 172.21.15.50:0/1848242143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d18a0 0x7f73900cb850 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.406+0000 7f7394a23640 1 -- 172.21.15.50:0/1848242143 >> 172.21.15.50:0/1848242143 conn(0x7f73900727a0 msgr2=0x7f73900d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.406+0000 7f7394a23640 1 -- 172.21.15.50:0/1848242143 shutdown_connections 2024-09-11T22:16:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.406+0000 7f7394a23640 1 -- 172.21.15.50:0/1848242143 wait complete. 2024-09-11T22:16:22.418 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T22:16:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.522+0000 7fc440c53640 1 Processor -- start 2024-09-11T22:16:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.522+0000 7fc440c53640 1 -- start start 2024-09-11T22:16:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.523+0000 7fc440c53640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc43c162a60 0x7fc43c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.523+0000 7fc440c53640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43c163080 con 0x7fc43c15e8e0 2024-09-11T22:16:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.523+0000 7fc440c53640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43c0d2d20 con 0x7fc43c0d1c90 2024-09-11T22:16:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.523+0000 7fc440c53640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc43c15ecc0 con 0x7fc43c162a60 2024-09-11T22:16:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.523+0000 7fc43a59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc43c15e8e0 0x7fc43c0d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41838/0 (socket says 172.21.15.50:41838) 2024-09-11T22:16:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.523+0000 7fc43a59c640 1 -- 172.21.15.50:0/3408828419 learned_addr learned my addr 172.21.15.50:0/3408828419 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.523+0000 7fc43ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc43c162a60 0x7fc43c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.523+0000 7fc43ad9d640 1 -- 172.21.15.50:0/3408828419 >> v1:172.21.15.77:6789/0 conn(0x7fc43c0d1c90 legacy=0x7fc43c162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.523+0000 7fc43959a640 1 -- 172.21.15.50:0/3408828419 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871922874 0 0) 0x7fc43c163080 con 0x7fc43c15e8e0 2024-09-11T22:16:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.523+0000 7fc43ad9d640 1 -- 172.21.15.50:0/3408828419 >> v1:172.21.15.50:6789/0 conn(0x7fc43c15e8e0 legacy=0x7fc43c0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.523+0000 7fc43ad9d640 1 -- 172.21.15.50:0/3408828419 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43c0d3000 con 0x7fc43c162a60 2024-09-11T22:16:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.524+0000 7fc43ad9d640 1 --2- 172.21.15.50:0/3408828419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c162a60 0x7fc43c0b7880 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009d90 tx=0x7fc42c02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7383d31ad923958a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.524+0000 7fc43959a640 1 -- 172.21.15.50:0/3408828419 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c037070 con 0x7fc43c162a60 2024-09-11T22:16:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.524+0000 7fc43959a640 1 -- 172.21.15.50:0/3408828419 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42c007740 con 0x7fc43c162a60 2024-09-11T22:16:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.524+0000 7fc43959a640 1 -- 172.21.15.50:0/3408828419 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c007b10 con 0x7fc43c162a60 2024-09-11T22:16:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.524+0000 7fc440c53640 1 -- 172.21.15.50:0/3408828419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c162a60 msgr2=0x7fc43c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.524+0000 7fc440c53640 1 --2- 172.21.15.50:0/3408828419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c162a60 0x7fc43c0b7880 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009d90 tx=0x7fc42c02a780 comp rx=0 tx=0).stop 2024-09-11T22:16:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.525+0000 7fc440c53640 1 -- 172.21.15.50:0/3408828419 shutdown_connections 2024-09-11T22:16:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.525+0000 7fc440c53640 1 --2- 172.21.15.50:0/3408828419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c162a60 0x7fc43c0b7880 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.525+0000 7fc440c53640 1 -- 172.21.15.50:0/3408828419 >> 172.21.15.50:0/3408828419 conn(0x7fc43c067ba0 msgr2=0x7fc43c067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.525+0000 7fc440c53640 1 -- 172.21.15.50:0/3408828419 shutdown_connections 2024-09-11T22:16:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.525+0000 7fc440c53640 1 -- 172.21.15.50:0/3408828419 wait complete. 2024-09-11T22:16:22.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.526+0000 7fc440c53640 1 Processor -- start 2024-09-11T22:16:22.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.526+0000 7fc440c53640 1 -- start start 2024-09-11T22:16:22.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc440c53640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc43c0d1c90 0x7fc43c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc440c53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43c15e8e0 0x7fc43c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc440c53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c162a60 0x7fc43c1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc440c53640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c0d3c10 con 0x7fc43c162a60 2024-09-11T22:16:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc440c53640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c0d3a90 con 0x7fc43c15e8e0 2024-09-11T22:16:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc440c53640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc43c0d3d90 con 0x7fc43c0d1c90 2024-09-11T22:16:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc43ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c162a60 0x7fc43c1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc43ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c162a60 0x7fc43c1549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38932/0 (socket says 172.21.15.50:38932) 2024-09-11T22:16:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc43ad9d640 1 -- 172.21.15.50:0/2866611673 learned_addr learned my addr 172.21.15.50:0/2866611673 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc43a59c640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc43c0d1c90 0x7fc43c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc439d9b640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43c15e8e0 0x7fc43c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc43ad9d640 1 -- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc43c0d1c90 msgr2=0x7fc43c1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc43ad9d640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc43c0d1c90 0x7fc43c1555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc43ad9d640 1 -- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43c15e8e0 msgr2=0x7fc43c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc43ad9d640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43c15e8e0 0x7fc43c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc43ad9d640 1 -- 172.21.15.50:0/2866611673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43c0b4aa0 con 0x7fc43c162a60 2024-09-11T22:16:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc43ad9d640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c162a60 0x7fc43c1549d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009d90 tx=0x7fc42c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc432ffd640 1 -- 172.21.15.50:0/2866611673 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c042020 con 0x7fc43c162a60 2024-09-11T22:16:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc432ffd640 1 -- 172.21.15.50:0/2866611673 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42c032990 con 0x7fc43c162a60 2024-09-11T22:16:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.527+0000 7fc440c53640 1 -- 172.21.15.50:0/2866611673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43c0b4d80 con 0x7fc43c162a60 2024-09-11T22:16:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.528+0000 7fc432ffd640 1 -- 172.21.15.50:0/2866611673 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c037040 con 0x7fc43c162a60 2024-09-11T22:16:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.528+0000 7fc440c53640 1 -- 172.21.15.50:0/2866611673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc43c158eb0 con 0x7fc43c162a60 2024-09-11T22:16:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.529+0000 7fc440c53640 1 -- 172.21.15.50:0/2866611673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc43c0b7880 con 0x7fc43c162a60 2024-09-11T22:16:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.529+0000 7fc432ffd640 1 -- 172.21.15.50:0/2866611673 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc42c045020 con 0x7fc43c162a60 2024-09-11T22:16:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.529+0000 7fc432ffd640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc41c06be30 0x7fc41c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.530+0000 7fc432ffd640 1 -- 172.21.15.50:0/2866611673 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7fc42c0abcb0 con 0x7fc43c162a60 2024-09-11T22:16:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.530+0000 7fc43a59c640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc41c06be30 0x7fc41c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.530+0000 7fc43a59c640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc41c06be30 0x7fc41c06e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc434007f70 tx=0x7fc434007f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.534+0000 7fc432ffd640 1 -- 172.21.15.50:0/2866611673 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc42c04c030 con 0x7fc43c162a60 2024-09-11T22:16:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.708+0000 7fc440c53640 1 -- 172.21.15.50:0/2866611673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc43c0ba770 con 0x7fc43c162a60 2024-09-11T22:16:22.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.711+0000 7fc432ffd640 1 -- 172.21.15.50:0/2866611673 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7fc42c07a370 con 0x7fc43c162a60 2024-09-11T22:16:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.713+0000 7fc440c53640 1 -- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc41c06be30 msgr2=0x7fc41c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.713+0000 7fc440c53640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc41c06be30 0x7fc41c06e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc434007f70 tx=0x7fc434007f00 comp rx=0 tx=0).stop 2024-09-11T22:16:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.713+0000 7fc440c53640 1 -- 172.21.15.50:0/2866611673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c162a60 msgr2=0x7fc43c1549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.713+0000 7fc440c53640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c162a60 0x7fc43c1549d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009d90 tx=0x7fc42c004a40 comp rx=0 tx=0).stop 2024-09-11T22:16:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.713+0000 7fc440c53640 1 -- 172.21.15.50:0/2866611673 shutdown_connections 2024-09-11T22:16:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.713+0000 7fc440c53640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc41c06be30 0x7fc41c06e2f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.713+0000 7fc440c53640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc43c162a60 0x7fc43c1549d0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.713+0000 7fc440c53640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43c15e8e0 0x7fc43c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.713+0000 7fc440c53640 1 --2- 172.21.15.50:0/2866611673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc43c0d1c90 0x7fc43c1555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.713+0000 7fc440c53640 1 -- 172.21.15.50:0/2866611673 >> 172.21.15.50:0/2866611673 conn(0x7fc43c067ba0 msgr2=0x7fc43c067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.713+0000 7fc440c53640 1 -- 172.21.15.50:0/2866611673 shutdown_connections 2024-09-11T22:16:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.713+0000 7fc440c53640 1 -- 172.21.15.50:0/2866611673 wait complete. 2024-09-11T22:16:22.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_size 2024-09-11T22:16:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.828+0000 7f7ea0766640 1 Processor -- start 2024-09-11T22:16:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.828+0000 7f7ea0766640 1 -- start start 2024-09-11T22:16:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7ea0766640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e980cf610 0x7f7e980b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7ea0766640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e980b1600 0x7f7e980cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7ea0766640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e980cfbd0 con 0x7f7e98161fa0 2024-09-11T22:16:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7ea0766640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7e980d1220 con 0x7f7e980b1600 2024-09-11T22:16:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7ea0766640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7e980d17e0 con 0x7f7e980cf610 2024-09-11T22:16:22.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7e9ed03640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e980b1600 0x7f7e980cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7e9ed03640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e980b1600 0x7f7e980cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38942/0 (socket says 172.21.15.50:38942) 2024-09-11T22:16:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7e9ed03640 1 -- 172.21.15.50:0/3425657677 learned_addr learned my addr 172.21.15.50:0/3425657677 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7e9dd01640 1 --2- 172.21.15.50:0/3425657677 >> v2:172.21.15.77:3300/0 conn(0x7f7e980cf610 0x7f7e980b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7e9ed03640 1 -- 172.21.15.50:0/3425657677 >> v2:172.21.15.77:3300/0 conn(0x7f7e980cf610 msgr2=0x7f7e980b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7e9ed03640 1 --2- 172.21.15.50:0/3425657677 >> v2:172.21.15.77:3300/0 conn(0x7f7e980cf610 0x7f7e980b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7e9ed03640 1 -- 172.21.15.50:0/3425657677 >> v1:172.21.15.77:6789/0 conn(0x7f7e98161fa0 legacy=0x7f7e980cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7e9ed03640 1 -- 172.21.15.50:0/3425657677 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e980cfeb0 con 0x7f7e980b1600 2024-09-11T22:16:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.829+0000 7f7e9dd01640 1 --2- 172.21.15.50:0/3425657677 >> v2:172.21.15.77:3300/0 conn(0x7f7e980cf610 0x7f7e980b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.830+0000 7f7e9ed03640 1 --2- 172.21.15.50:0/3425657677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e980b1600 0x7f7e980cccd0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f7e9809c280 tx=0x7f7e9002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66b748d57b733c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.830+0000 7f7e9d500640 1 -- 172.21.15.50:0/3425657677 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e90036070 con 0x7f7e980b1600 2024-09-11T22:16:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.830+0000 7f7e9d500640 1 -- 172.21.15.50:0/3425657677 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e90031600 con 0x7f7e980b1600 2024-09-11T22:16:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.830+0000 7f7e9d500640 1 -- 172.21.15.50:0/3425657677 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e900319d0 con 0x7f7e980b1600 2024-09-11T22:16:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.831+0000 7f7ea0766640 1 -- 172.21.15.50:0/3425657677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e980b1600 msgr2=0x7f7e980cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.831+0000 7f7ea0766640 1 --2- 172.21.15.50:0/3425657677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e980b1600 0x7f7e980cccd0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f7e9809c280 tx=0x7f7e9002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.831+0000 7f7ea0766640 1 -- 172.21.15.50:0/3425657677 shutdown_connections 2024-09-11T22:16:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.831+0000 7f7ea0766640 1 --2- 172.21.15.50:0/3425657677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e980b1600 0x7f7e980cccd0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.831+0000 7f7ea0766640 1 --2- 172.21.15.50:0/3425657677 >> v2:172.21.15.77:3300/0 conn(0x7f7e980cf610 0x7f7e980b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.831+0000 7f7ea0766640 1 -- 172.21.15.50:0/3425657677 >> 172.21.15.50:0/3425657677 conn(0x7f7e9809ba50 msgr2=0x7f7e980b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.831+0000 7f7ea0766640 1 -- 172.21.15.50:0/3425657677 shutdown_connections 2024-09-11T22:16:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.831+0000 7f7ea0766640 1 -- 172.21.15.50:0/3425657677 wait complete. 2024-09-11T22:16:22.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.832+0000 7f7ea0766640 1 Processor -- start 2024-09-11T22:16:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.832+0000 7f7ea0766640 1 -- start start 2024-09-11T22:16:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7ea0766640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e980b1600 0x7f7e980b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7ea0766640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980cf610 0x7f7e980cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7ea0766640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e98161fa0 0x7f7e981f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7ea0766640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98162500 con 0x7f7e980b1600 2024-09-11T22:16:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7ea0766640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98162380 con 0x7f7e98161fa0 2024-09-11T22:16:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7ea0766640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7e980d1c70 con 0x7f7e980cf610 2024-09-11T22:16:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7e9e502640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e980b1600 0x7f7e980b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7e9e502640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e980b1600 0x7f7e980b7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38954/0 (socket says 172.21.15.50:38954) 2024-09-11T22:16:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7e9e502640 1 -- 172.21.15.50:0/3788182975 learned_addr learned my addr 172.21.15.50:0/3788182975 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7e9dd01640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980cf610 0x7f7e980cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7e9ed03640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e98161fa0 0x7f7e981f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7e9e502640 1 -- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980cf610 msgr2=0x7f7e980cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7e9e502640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980cf610 0x7f7e980cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7e9e502640 1 -- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e98161fa0 msgr2=0x7f7e981f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:22.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7e9e502640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e98161fa0 0x7f7e981f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:22.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7e9e502640 1 -- 172.21.15.50:0/3788182975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e980cc5b0 con 0x7f7e980b1600 2024-09-11T22:16:22.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.833+0000 7f7e9e502640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e980b1600 0x7f7e980b7900 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400c460 tx=0x7f7e9400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:22.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.834+0000 7f7e8effd640 1 -- 172.21.15.50:0/3788182975 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e94016020 con 0x7f7e980b1600 2024-09-11T22:16:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.834+0000 7f7e8effd640 1 -- 172.21.15.50:0/3788182975 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e94012870 con 0x7f7e980b1600 2024-09-11T22:16:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.834+0000 7f7e8effd640 1 -- 172.21.15.50:0/3788182975 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e94012c60 con 0x7f7e980b1600 2024-09-11T22:16:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.834+0000 7f7ea0766640 1 -- 172.21.15.50:0/3788182975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e980b7f10 con 0x7f7e980b1600 2024-09-11T22:16:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.834+0000 7f7ea0766640 1 -- 172.21.15.50:0/3788182975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e9815f530 con 0x7f7e980b1600 2024-09-11T22:16:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.835+0000 7f7ea0766640 1 -- 172.21.15.50:0/3788182975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e980b4d20 con 0x7f7e980b1600 2024-09-11T22:16:22.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.835+0000 7f7e8effd640 1 -- 172.21.15.50:0/3788182975 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e94019020 con 0x7f7e980b1600 2024-09-11T22:16:22.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.836+0000 7f7e8effd640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:22.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.836+0000 7f7e8effd640 1 -- 172.21.15.50:0/3788182975 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f7e9408a530 con 0x7f7e980b1600 2024-09-11T22:16:22.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.836+0000 7f7e9dd01640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:22.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.836+0000 7f7e9dd01640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7e980b7e40 tx=0x7f7e88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:22.840+0000 7f7e8effd640 1 -- 172.21.15.50:0/3788182975 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e94020070 con 0x7f7e980b1600 2024-09-11T22:16:23.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.015+0000 7f7ea0766640 1 -- 172.21.15.50:0/3788182975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"} v 0) -- 0x7f7e980ce5c0 con 0x7f7e980b1600 2024-09-11T22:16:23.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.018+0000 7f7e8effd640 1 -- 172.21.15.50:0/3788182975 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"}]=0 v32) ==== 101+0+0 (secure 0 0 0) 0x7f7e94058b20 con 0x7f7e980b1600 2024-09-11T22:16:23.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.020+0000 7f7ea0766640 1 -- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7c06be30 msgr2=0x7f7e7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.020+0000 7f7ea0766640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7e980b7e40 tx=0x7f7e88008040 comp rx=0 tx=0).stop 2024-09-11T22:16:23.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.020+0000 7f7ea0766640 1 -- 172.21.15.50:0/3788182975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e980b1600 msgr2=0x7f7e980b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.020+0000 7f7ea0766640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e980b1600 0x7f7e980b7900 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400c460 tx=0x7f7e9400c920 comp rx=0 tx=0).stop 2024-09-11T22:16:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.020+0000 7f7ea0766640 1 -- 172.21.15.50:0/3788182975 shutdown_connections 2024-09-11T22:16:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.020+0000 7f7ea0766640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.020+0000 7f7ea0766640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980cf610 0x7f7e980cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.020+0000 7f7ea0766640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e98161fa0 0x7f7e981f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.020+0000 7f7ea0766640 1 --2- 172.21.15.50:0/3788182975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e980b1600 0x7f7e980b7900 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.020+0000 7f7ea0766640 1 -- 172.21.15.50:0/3788182975 >> 172.21.15.50:0/3788182975 conn(0x7f7e9809ba50 msgr2=0x7f7e9806f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.020+0000 7f7ea0766640 1 -- 172.21.15.50:0/3788182975 shutdown_connections 2024-09-11T22:16:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.020+0000 7f7ea0766640 1 -- 172.21.15.50:0/3788182975 wait complete. 2024-09-11T22:16:23.032 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_bits 2024-09-11T22:16:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.136+0000 7f98383e8640 1 Processor -- start 2024-09-11T22:16:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.136+0000 7f98383e8640 1 -- start start 2024-09-11T22:16:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.137+0000 7f98383e8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f983015e8e0 0x7f98300b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.137+0000 7f98383e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98300d1580 0x7f98300d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.137+0000 7f98383e8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98300d1ee0 con 0x7f9830162350 2024-09-11T22:16:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.137+0000 7f98383e8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f983015ecc0 con 0x7f983015e8e0 2024-09-11T22:16:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.137+0000 7f98383e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f98300d2ad0 con 0x7f98300d1580 2024-09-11T22:16:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.137+0000 7f9836985640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9830162350 0x7f9830162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41852/0 (socket says 172.21.15.50:41852) 2024-09-11T22:16:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.137+0000 7f9836985640 1 -- 172.21.15.50:0/2724144905 learned_addr learned my addr 172.21.15.50:0/2724144905 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.137+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2977221872 0 0) 0x7f98300d1ee0 con 0x7f9830162350 2024-09-11T22:16:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.137+0000 7f9835983640 1 --2- 172.21.15.50:0/2724144905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98300d1580 0x7f98300d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f981c003520 con 0x7f9830162350 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9836184640 1 --2- 172.21.15.50:0/2724144905 >> v2:172.21.15.77:3300/0 conn(0x7f983015e8e0 0x7f98300b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2572460412 0 0) 0x7f981c003520 con 0x7f9830162350 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98300d1580 msgr2=0x7f98300d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 --2- 172.21.15.50:0/2724144905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98300d1580 0x7f98300d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 >> v2:172.21.15.77:3300/0 conn(0x7f983015e8e0 msgr2=0x7f98300b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 --2- 172.21.15.50:0/2724144905 >> v2:172.21.15.77:3300/0 conn(0x7f983015e8e0 0x7f98300b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9830163080 con 0x7f9830162350 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f98280019f0 con 0x7f9830162350 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 >> v1:172.21.15.50:6789/0 conn(0x7f9830162350 legacy=0x7f9830162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 --2- 172.21.15.50:0/2724144905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981c0039b0 0x7f981c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 --2- 172.21.15.50:0/2724144905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f981c004800 0x7f981c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 --2- 172.21.15.50:0/2724144905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98300d1580 0x7f981c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98300d2ad0 con 0x7f981c0039b0 2024-09-11T22:16:23.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f981c00b9c0 con 0x7f981c004800 2024-09-11T22:16:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f981c00bb40 con 0x7f98300d1580 2024-09-11T22:16:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9836184640 1 --2- 172.21.15.50:0/2724144905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981c0039b0 0x7f981c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9836985640 1 --2- 172.21.15.50:0/2724144905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98300d1580 0x7f981c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9835983640 1 --2- 172.21.15.50:0/2724144905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f981c004800 0x7f981c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9836184640 1 -- 172.21.15.50:0/2724144905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98300d1580 msgr2=0x7f981c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9836184640 1 --2- 172.21.15.50:0/2724144905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98300d1580 0x7f981c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9836184640 1 -- 172.21.15.50:0/2724144905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f981c004800 msgr2=0x7f981c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9836184640 1 --2- 172.21.15.50:0/2724144905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f981c004800 0x7f981c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.138+0000 7f9836184640 1 -- 172.21.15.50:0/2724144905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c003520 con 0x7f981c0039b0 2024-09-11T22:16:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.139+0000 7f9836184640 1 --2- 172.21.15.50:0/2724144905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981c0039b0 0x7f981c003dd0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f982c009ac0 tx=0x7f981c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1c4bd1a6fde155 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.139+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c036070 con 0x7f981c0039b0 2024-09-11T22:16:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.139+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c031400 con 0x7f981c0039b0 2024-09-11T22:16:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.139+0000 7f9835182640 1 -- 172.21.15.50:0/2724144905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c009690 con 0x7f981c0039b0 2024-09-11T22:16:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.140+0000 7f98383e8640 1 -- 172.21.15.50:0/2724144905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981c0039b0 msgr2=0x7f981c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.140+0000 7f98383e8640 1 --2- 172.21.15.50:0/2724144905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f981c0039b0 0x7f981c003dd0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f982c009ac0 tx=0x7f981c005830 comp rx=0 tx=0).stop 2024-09-11T22:16:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.140+0000 7f9836985640 1 -- 172.21.15.50:0/2724144905 reap_dead start 2024-09-11T22:16:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.140+0000 7f98383e8640 1 -- 172.21.15.50:0/2724144905 shutdown_connections 2024-09-11T22:16:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.140+0000 7f98383e8640 1 -- 172.21.15.50:0/2724144905 >> 172.21.15.50:0/2724144905 conn(0x7f9830067ba0 msgr2=0x7f9830067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.140+0000 7f98383e8640 1 -- 172.21.15.50:0/2724144905 shutdown_connections 2024-09-11T22:16:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.140+0000 7f98383e8640 1 -- 172.21.15.50:0/2724144905 wait complete. 2024-09-11T22:16:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.141+0000 7f98383e8640 1 Processor -- start 2024-09-11T22:16:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.141+0000 7f98383e8640 1 -- start start 2024-09-11T22:16:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f98383e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f981c0039b0 0x7f98300ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f98383e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f983015d7b0 0x7f98301f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f98383e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98301f4a30 0x7f98301f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f98383e8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98300d3000 con 0x7f98301f4a30 2024-09-11T22:16:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f98383e8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f98300d3370 con 0x7f983015d7b0 2024-09-11T22:16:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f98383e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f98300d19a0 con 0x7f981c0039b0 2024-09-11T22:16:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9836985640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98301f4a30 0x7f98301f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9836985640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98301f4a30 0x7f98301f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38982/0 (socket says 172.21.15.50:38982) 2024-09-11T22:16:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9836985640 1 -- 172.21.15.50:0/1608431870 learned_addr learned my addr 172.21.15.50:0/1608431870 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9836184640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f981c0039b0 0x7f98300ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9835983640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f983015d7b0 0x7f98301f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9836985640 1 -- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f981c0039b0 msgr2=0x7f98300ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9836985640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f981c0039b0 0x7f98300ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9836985640 1 -- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f983015d7b0 msgr2=0x7f98301f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9836985640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f983015d7b0 0x7f98301f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9836985640 1 -- 172.21.15.50:0/1608431870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98300cc770 con 0x7f98301f4a30 2024-09-11T22:16:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9835983640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f983015d7b0 0x7f98301f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9836184640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f981c0039b0 0x7f98300ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9836985640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98301f4a30 0x7f98301f4eb0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f98300cedf0 tx=0x7f982800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9826ffd640 1 -- 172.21.15.50:0/1608431870 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982800ee20 con 0x7f98301f4a30 2024-09-11T22:16:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9826ffd640 1 -- 172.21.15.50:0/1608431870 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9828014430 con 0x7f98301f4a30 2024-09-11T22:16:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f98383e8640 1 -- 172.21.15.50:0/1608431870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98300cca50 con 0x7f98301f4a30 2024-09-11T22:16:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f9826ffd640 1 -- 172.21.15.50:0/1608431870 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828014820 con 0x7f98301f4a30 2024-09-11T22:16:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.142+0000 7f98383e8640 1 -- 172.21.15.50:0/1608431870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98300cd010 con 0x7f98301f4a30 2024-09-11T22:16:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.143+0000 7f98383e8640 1 -- 172.21.15.50:0/1608431870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98300d1d80 con 0x7f98301f4a30 2024-09-11T22:16:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.144+0000 7f9826ffd640 1 -- 172.21.15.50:0/1608431870 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98280149c0 con 0x7f98301f4a30 2024-09-11T22:16:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.144+0000 7f9826ffd640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f981406be60 0x7f981406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.145+0000 7f9826ffd640 1 -- 172.21.15.50:0/1608431870 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f982808aae0 con 0x7f98301f4a30 2024-09-11T22:16:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.145+0000 7f9836184640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f981406be60 0x7f981406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.145+0000 7f9836184640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f981406be60 0x7f981406e320 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f982c033000 tx=0x7f982c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:23.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.149+0000 7f9826ffd640 1 -- 172.21.15.50:0/1608431870 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9828059690 con 0x7f98301f4a30 2024-09-11T22:16:23.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.327+0000 7f98383e8640 1 -- 172.21.15.50:0/1608431870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"} v 0) -- 0x7f98300cd9f0 con 0x7f98301f4a30 2024-09-11T22:16:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.330+0000 7f9826ffd640 1 -- 172.21.15.50:0/1608431870 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"}]=0 v33) ==== 101+0+0 (secure 0 0 0) 0x7f9828058f90 con 0x7f98301f4a30 2024-09-11T22:16:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.333+0000 7f98383e8640 1 -- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f981406be60 msgr2=0x7f981406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.333+0000 7f98383e8640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f981406be60 0x7f981406e320 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f982c033000 tx=0x7f982c008030 comp rx=0 tx=0).stop 2024-09-11T22:16:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.333+0000 7f98383e8640 1 -- 172.21.15.50:0/1608431870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98301f4a30 msgr2=0x7f98301f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.333+0000 7f98383e8640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98301f4a30 0x7f98301f4eb0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f98300cedf0 tx=0x7f982800e530 comp rx=0 tx=0).stop 2024-09-11T22:16:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.333+0000 7f98383e8640 1 -- 172.21.15.50:0/1608431870 shutdown_connections 2024-09-11T22:16:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.333+0000 7f98383e8640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f981406be60 0x7f981406e320 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.333+0000 7f98383e8640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98301f4a30 0x7f98301f4eb0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.333+0000 7f98383e8640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f983015d7b0 0x7f98301f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.333+0000 7f98383e8640 1 --2- 172.21.15.50:0/1608431870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f981c0039b0 0x7f98300ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.333+0000 7f98383e8640 1 -- 172.21.15.50:0/1608431870 >> 172.21.15.50:0/1608431870 conn(0x7f9830067ba0 msgr2=0x7f98300b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.333+0000 7f98383e8640 1 -- 172.21.15.50:0/1608431870 shutdown_connections 2024-09-11T22:16:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.333+0000 7f98383e8640 1 -- 172.21.15.50:0/1608431870 wait complete. 2024-09-11T22:16:23.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-11T22:16:23.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.446+0000 7fcfca1f8640 1 Processor -- start 2024-09-11T22:16:23.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.446+0000 7fcfca1f8640 1 -- start start 2024-09-11T22:16:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfca1f8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfc415e870 0x7fcfc40d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfca1f8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcfc40d16d0 0x7fcfc40d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfca1f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfc40d3a30 0x7fcfc40b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfca1f8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fcfc40d1b40 con 0x7fcfc415e870 2024-09-11T22:16:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfca1f8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcfc40cfa80 con 0x7fcfc40d16d0 2024-09-11T22:16:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfca1f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc40d3e50 con 0x7fcfc40d3a30 2024-09-11T22:16:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfc37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfc415e870 0x7fcfc40d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfc37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfc415e870 0x7fcfc40d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38988/0 (socket says 172.21.15.50:38988) 2024-09-11T22:16:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfc37fe640 1 -- 172.21.15.50:0/1680515613 learned_addr learned my addr 172.21.15.50:0/1680515613 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfc37fe640 1 -- 172.21.15.50:0/1680515613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfc40d3a30 msgr2=0x7fcfc40b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfc37fe640 1 --2- 172.21.15.50:0/1680515613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfc40d3a30 0x7fcfc40b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfc37fe640 1 -- 172.21.15.50:0/1680515613 >> v2:172.21.15.77:3300/0 conn(0x7fcfc40d16d0 msgr2=0x7fcfc40d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfc37fe640 1 --2- 172.21.15.50:0/1680515613 >> v2:172.21.15.77:3300/0 conn(0x7fcfc40d16d0 0x7fcfc40d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.447+0000 7fcfc37fe640 1 -- 172.21.15.50:0/1680515613 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc40d40d0 con 0x7fcfc415e870 2024-09-11T22:16:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.448+0000 7fcfc37fe640 1 --2- 172.21.15.50:0/1680515613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfc415e870 0x7fcfc40d1190 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40d4000 tx=0x7fcfb402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa4bf7cf39ec06e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.448+0000 7fcfc27fc640 1 -- 172.21.15.50:0/1680515613 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4037070 con 0x7fcfc415e870 2024-09-11T22:16:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.448+0000 7fcfc27fc640 1 -- 172.21.15.50:0/1680515613 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb4032440 con 0x7fcfc415e870 2024-09-11T22:16:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.448+0000 7fcfc27fc640 1 -- 172.21.15.50:0/1680515613 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4032810 con 0x7fcfc415e870 2024-09-11T22:16:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.449+0000 7fcfca1f8640 1 -- 172.21.15.50:0/1680515613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfc415e870 msgr2=0x7fcfc40d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.449+0000 7fcfca1f8640 1 --2- 172.21.15.50:0/1680515613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfc415e870 0x7fcfc40d1190 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40d4000 tx=0x7fcfb402a1c0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.449+0000 7fcfca1f8640 1 -- 172.21.15.50:0/1680515613 shutdown_connections 2024-09-11T22:16:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.449+0000 7fcfca1f8640 1 --2- 172.21.15.50:0/1680515613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfc40d3a30 0x7fcfc40b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.449+0000 7fcfca1f8640 1 --2- 172.21.15.50:0/1680515613 >> v2:172.21.15.77:3300/0 conn(0x7fcfc40d16d0 0x7fcfc40d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.449+0000 7fcfca1f8640 1 --2- 172.21.15.50:0/1680515613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfc415e870 0x7fcfc40d1190 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.449+0000 7fcfca1f8640 1 -- 172.21.15.50:0/1680515613 >> 172.21.15.50:0/1680515613 conn(0x7fcfc40727a0 msgr2=0x7fcfc40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.449+0000 7fcfca1f8640 1 -- 172.21.15.50:0/1680515613 shutdown_connections 2024-09-11T22:16:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.449+0000 7fcfca1f8640 1 -- 172.21.15.50:0/1680515613 wait complete. 2024-09-11T22:16:23.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.450+0000 7fcfca1f8640 1 Processor -- start 2024-09-11T22:16:23.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.450+0000 7fcfca1f8640 1 -- start start 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfca1f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfc40d16d0 0x7fcfc41f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfca1f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfc40d3a30 0x7fcfc415b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfca1f8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfc415e870 0x7fcfc41e6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfca1f8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc40b7ee0 con 0x7fcfc415e870 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfca1f8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc40b7c00 con 0x7fcfc40d16d0 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfca1f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc415ec50 con 0x7fcfc40d3a30 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfc3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfc415e870 0x7fcfc41e6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfc3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfc415e870 0x7fcfc41e6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39004/0 (socket says 172.21.15.50:39004) 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfc3fff640 1 -- 172.21.15.50:0/841340244 learned_addr learned my addr 172.21.15.50:0/841340244 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfc37fe640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfc40d16d0 0x7fcfc41f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfc2ffd640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfc40d3a30 0x7fcfc415b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfc3fff640 1 -- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfc40d3a30 msgr2=0x7fcfc415b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfc3fff640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfc40d3a30 0x7fcfc415b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfc3fff640 1 -- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfc40d16d0 msgr2=0x7fcfc41f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfc3fff640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfc40d16d0 0x7fcfc41f4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfc3fff640 1 -- 172.21.15.50:0/841340244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc41e7810 con 0x7fcfc415e870 2024-09-11T22:16:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfc37fe640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfc40d16d0 0x7fcfc41f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.451+0000 7fcfc2ffd640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfc40d3a30 0x7fcfc415b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.452+0000 7fcfc3fff640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfc415e870 0x7fcfc41e6e30 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00b9a0 tx=0x7fcfbc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.452+0000 7fcfabfff640 1 -- 172.21.15.50:0/841340244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc019070 con 0x7fcfc415e870 2024-09-11T22:16:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.452+0000 7fcfabfff640 1 -- 172.21.15.50:0/841340244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc00cbc0 con 0x7fcfc415e870 2024-09-11T22:16:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.452+0000 7fcfca1f8640 1 -- 172.21.15.50:0/841340244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc40cd3d0 con 0x7fcfc415e870 2024-09-11T22:16:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.452+0000 7fcfabfff640 1 -- 172.21.15.50:0/841340244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc014440 con 0x7fcfc415e870 2024-09-11T22:16:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.452+0000 7fcfca1f8640 1 -- 172.21.15.50:0/841340244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc40cd990 con 0x7fcfc415e870 2024-09-11T22:16:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.453+0000 7fcfca1f8640 1 -- 172.21.15.50:0/841340244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc40b78b0 con 0x7fcfc415e870 2024-09-11T22:16:23.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.453+0000 7fcfabfff640 1 -- 172.21.15.50:0/841340244 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfbc01c070 con 0x7fcfc415e870 2024-09-11T22:16:23.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.454+0000 7fcfabfff640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcfb006be60 0x7fcfb006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:23.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.454+0000 7fcfabfff640 1 -- 172.21.15.50:0/841340244 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7fcfbc08a860 con 0x7fcfc415e870 2024-09-11T22:16:23.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.454+0000 7fcfc37fe640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcfb006be60 0x7fcfb006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:23.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.455+0000 7fcfc37fe640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcfb006be60 0x7fcfb006e320 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4034000 tx=0x7fcfb402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:23.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.458+0000 7fcfabfff640 1 -- 172.21.15.50:0/841340244 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcfbc059540 con 0x7fcfc415e870 2024-09-11T22:16:23.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:23.714+0000 7fcfca1f8640 1 -- 172.21.15.50:0/841340244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7fcfc40cdb60 con 0x7fcfc415e870 2024-09-11T22:16:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.088+0000 7fcfabfff640 1 -- 172.21.15.50:0/841340244 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v271) ==== 151+0+0 (secure 0 0 0) 0x7fcfbc058e40 con 0x7fcfc415e870 2024-09-11T22:16:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.091+0000 7fcfca1f8640 1 -- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcfb006be60 msgr2=0x7fcfb006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.091+0000 7fcfca1f8640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcfb006be60 0x7fcfb006e320 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4034000 tx=0x7fcfb402e000 comp rx=0 tx=0).stop 2024-09-11T22:16:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.091+0000 7fcfca1f8640 1 -- 172.21.15.50:0/841340244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfc415e870 msgr2=0x7fcfc41e6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.091+0000 7fcfca1f8640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfc415e870 0x7fcfc41e6e30 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00b9a0 tx=0x7fcfbc00be60 comp rx=0 tx=0).stop 2024-09-11T22:16:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.091+0000 7fcfca1f8640 1 -- 172.21.15.50:0/841340244 shutdown_connections 2024-09-11T22:16:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.091+0000 7fcfca1f8640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcfb006be60 0x7fcfb006e320 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.091+0000 7fcfca1f8640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfc40d3a30 0x7fcfc415b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.091+0000 7fcfca1f8640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfc415e870 0x7fcfc41e6e30 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.091+0000 7fcfca1f8640 1 --2- 172.21.15.50:0/841340244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfc40d16d0 0x7fcfc41f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.091+0000 7fcfca1f8640 1 -- 172.21.15.50:0/841340244 >> 172.21.15.50:0/841340244 conn(0x7fcfc40727a0 msgr2=0x7fcfc415f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.091+0000 7fcfca1f8640 1 -- 172.21.15.50:0/841340244 shutdown_connections 2024-09-11T22:16:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.091+0000 7fcfca1f8640 1 -- 172.21.15.50:0/841340244 wait complete. 2024-09-11T22:16:24.106 INFO:tasks.cephfs_test_runner:That a directory is split during scrub. ... ok 2024-09-11T22:16:24.106 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-09-11T22:16:24.106 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-11T22:16:24.107 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:16:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.214+0000 7f56da9bd640 1 Processor -- start 2024-09-11T22:16:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.214+0000 7f56da9bd640 1 -- start start 2024-09-11T22:16:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56da9bd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d4156960 0x7f56d406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56da9bd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f56d415d4c0 0x7f56d40cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56da9bd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56d40d03b0 0x7f56d4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56da9bd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f56d40b03a0 con 0x7f56d40d03b0 2024-09-11T22:16:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56da9bd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f56d40cea30 con 0x7f56d415d4c0 2024-09-11T22:16:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56da9bd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f56d40ce470 con 0x7f56d4156960 2024-09-11T22:16:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56d8f5a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56d40d03b0 0x7f56d4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56d8f5a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56d40d03b0 0x7f56d4160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39006/0 (socket says 172.21.15.50:39006) 2024-09-11T22:16:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56d8f5a640 1 -- 172.21.15.50:0/3799791926 learned_addr learned my addr 172.21.15.50:0/3799791926 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56d37fe640 1 --2- 172.21.15.50:0/3799791926 >> v2:172.21.15.77:3300/0 conn(0x7f56d415d4c0 0x7f56d40cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56d3fff640 1 --2- 172.21.15.50:0/3799791926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d4156960 0x7f56d406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56d8f5a640 1 -- 172.21.15.50:0/3799791926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d4156960 msgr2=0x7f56d406fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56d8f5a640 1 --2- 172.21.15.50:0/3799791926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d4156960 0x7f56d406fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56d8f5a640 1 -- 172.21.15.50:0/3799791926 >> v2:172.21.15.77:3300/0 conn(0x7f56d415d4c0 msgr2=0x7f56d40cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56d8f5a640 1 --2- 172.21.15.50:0/3799791926 >> v2:172.21.15.77:3300/0 conn(0x7f56d415d4c0 0x7f56d40cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56d8f5a640 1 -- 172.21.15.50:0/3799791926 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d40ce750 con 0x7f56d40d03b0 2024-09-11T22:16:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56d3fff640 1 --2- 172.21.15.50:0/3799791926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d4156960 0x7f56d406fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.215+0000 7f56d37fe640 1 --2- 172.21.15.50:0/3799791926 >> v2:172.21.15.77:3300/0 conn(0x7f56d415d4c0 0x7f56d40cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.216+0000 7f56d8f5a640 1 --2- 172.21.15.50:0/3799791926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d40d03b0 0x7f56d4160030 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f56d4069580 tx=0x7f56cc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d4a71feafe0852 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.216+0000 7f56d2ffd640 1 -- 172.21.15.50:0/3799791926 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc036070 con 0x7f56d40d03b0 2024-09-11T22:16:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.216+0000 7f56d2ffd640 1 -- 172.21.15.50:0/3799791926 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56cc031600 con 0x7f56d40d03b0 2024-09-11T22:16:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.216+0000 7f56d2ffd640 1 -- 172.21.15.50:0/3799791926 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc0319d0 con 0x7f56d40d03b0 2024-09-11T22:16:24.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.217+0000 7f56da9bd640 1 -- 172.21.15.50:0/3799791926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d40d03b0 msgr2=0x7f56d4160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.217+0000 7f56da9bd640 1 --2- 172.21.15.50:0/3799791926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d40d03b0 0x7f56d4160030 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f56d4069580 tx=0x7f56cc02a6a0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.217+0000 7f56da9bd640 1 -- 172.21.15.50:0/3799791926 shutdown_connections 2024-09-11T22:16:24.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.217+0000 7f56da9bd640 1 --2- 172.21.15.50:0/3799791926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d40d03b0 0x7f56d4160030 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.217+0000 7f56da9bd640 1 --2- 172.21.15.50:0/3799791926 >> v2:172.21.15.77:3300/0 conn(0x7f56d415d4c0 0x7f56d40cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.217+0000 7f56da9bd640 1 --2- 172.21.15.50:0/3799791926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d4156960 0x7f56d406fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.217+0000 7f56da9bd640 1 -- 172.21.15.50:0/3799791926 >> 172.21.15.50:0/3799791926 conn(0x7f56d40b2bd0 msgr2=0x7f56d40b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:24.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.217+0000 7f56da9bd640 1 -- 172.21.15.50:0/3799791926 shutdown_connections 2024-09-11T22:16:24.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.217+0000 7f56da9bd640 1 -- 172.21.15.50:0/3799791926 wait complete. 2024-09-11T22:16:24.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.218+0000 7f56da9bd640 1 Processor -- start 2024-09-11T22:16:24.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.218+0000 7f56da9bd640 1 -- start start 2024-09-11T22:16:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56da9bd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d40d03b0 0x7f56d4158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56da9bd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d4156960 0x7f56d4072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56da9bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d415d4c0 0x7f56d4073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56da9bd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56d40b0830 con 0x7f56d4156960 2024-09-11T22:16:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56da9bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f56d415d920 con 0x7f56d415d4c0 2024-09-11T22:16:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56da9bd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f56d41f9760 con 0x7f56d40d03b0 2024-09-11T22:16:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56d37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d4156960 0x7f56d4072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56d37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d4156960 0x7f56d4072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39022/0 (socket says 172.21.15.50:39022) 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56d37fe640 1 -- 172.21.15.50:0/3397700761 learned_addr learned my addr 172.21.15.50:0/3397700761 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56d3fff640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d40d03b0 0x7f56d4158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56d8f5a640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d415d4c0 0x7f56d4073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56d37fe640 1 -- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d40d03b0 msgr2=0x7f56d4158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56d37fe640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d40d03b0 0x7f56d4158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56d37fe640 1 -- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d415d4c0 msgr2=0x7f56d4073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56d37fe640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d415d4c0 0x7f56d4073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56d37fe640 1 -- 172.21.15.50:0/3397700761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d4157080 con 0x7f56d4156960 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.219+0000 7f56d37fe640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d4156960 0x7f56d4072af0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f56c800d7d0 tx=0x7f56c800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.220+0000 7f56d0ff9640 1 -- 172.21.15.50:0/3397700761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8004030 con 0x7f56d4156960 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.220+0000 7f56d0ff9640 1 -- 172.21.15.50:0/3397700761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c80041d0 con 0x7f56d4156960 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.220+0000 7f56d0ff9640 1 -- 172.21.15.50:0/3397700761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c800b6c0 con 0x7f56d4156960 2024-09-11T22:16:24.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.220+0000 7f56da9bd640 1 -- 172.21.15.50:0/3397700761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d4157360 con 0x7f56d4156960 2024-09-11T22:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.220+0000 7f56da9bd640 1 -- 172.21.15.50:0/3397700761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d4157e40 con 0x7f56d4156960 2024-09-11T22:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.221+0000 7f56da9bd640 1 -- 172.21.15.50:0/3397700761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d4156d40 con 0x7f56d4156960 2024-09-11T22:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.221+0000 7f56d0ff9640 1 -- 172.21.15.50:0/3397700761 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56c800b860 con 0x7f56d4156960 2024-09-11T22:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.222+0000 7f56d0ff9640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f56c006be30 0x7f56c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.222+0000 7f56d0ff9640 1 -- 172.21.15.50:0/3397700761 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f56c808acc0 con 0x7f56d4156960 2024-09-11T22:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.222+0000 7f56d3fff640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f56c006be30 0x7f56c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.222+0000 7f56d3fff640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f56c006be30 0x7f56c006e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f56c4006fd0 tx=0x7f56c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.226+0000 7f56d0ff9640 1 -- 172.21.15.50:0/3397700761 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f56c8091080 con 0x7f56d4156960 2024-09-11T22:16:24.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.403+0000 7f56da9bd640 1 -- 172.21.15.50:0/3397700761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56d406ea20 con 0x7f56d4156960 2024-09-11T22:16:24.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.404+0000 7f56d0ff9640 1 -- 172.21.15.50:0/3397700761 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+13127 (secure 0 0 0) 0x7f56c80592b0 con 0x7f56d4156960 2024-09-11T22:16:24.405 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:24.405 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":98,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:16:22.082991+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6834/3565485635":"2024-09-12T22:16:19.075054+0000","172.21.15.50:6835/3565485635":"2024-09-12T22:16:19.075054+0000","172.21.15.77:6836/1549905387":"2024-09-12T22:16:02.821555+0000","172.21.15.77:6834/1549905387":"2024-09-12T22:16:02.821555+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:16:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.406+0000 7f56da9bd640 1 -- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f56c006be30 msgr2=0x7f56c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.406+0000 7f56da9bd640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f56c006be30 0x7f56c006e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f56c4006fd0 tx=0x7f56c4008040 comp rx=0 tx=0).stop 2024-09-11T22:16:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.406+0000 7f56da9bd640 1 -- 172.21.15.50:0/3397700761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d4156960 msgr2=0x7f56d4072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.406+0000 7f56da9bd640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d4156960 0x7f56d4072af0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f56c800d7d0 tx=0x7f56c800dc90 comp rx=0 tx=0).stop 2024-09-11T22:16:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.406+0000 7f56da9bd640 1 -- 172.21.15.50:0/3397700761 shutdown_connections 2024-09-11T22:16:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.406+0000 7f56da9bd640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f56c006be30 0x7f56c006e2f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.406+0000 7f56da9bd640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d415d4c0 0x7f56d4073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.406+0000 7f56da9bd640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56d4156960 0x7f56d4072af0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.406+0000 7f56da9bd640 1 --2- 172.21.15.50:0/3397700761 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d40d03b0 0x7f56d4158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.406+0000 7f56da9bd640 1 -- 172.21.15.50:0/3397700761 >> 172.21.15.50:0/3397700761 conn(0x7f56d40b2bd0 msgr2=0x7f56d406f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.406+0000 7f56da9bd640 1 -- 172.21.15.50:0/3397700761 shutdown_connections 2024-09-11T22:16:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.406+0000 7f56da9bd640 1 -- 172.21.15.50:0/3397700761 wait complete. 2024-09-11T22:16:24.418 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:11:03.407373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:16:24.418 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:16:24.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.523+0000 7f7cd296f640 1 Processor -- start 2024-09-11T22:16:24.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.523+0000 7f7cd296f640 1 -- start start 2024-09-11T22:16:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.524+0000 7f7cd296f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ccc162a60 0x7f7ccc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.524+0000 7f7cd296f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ccc163080 con 0x7f7ccc15e8e0 2024-09-11T22:16:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.524+0000 7f7cd296f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ccc0d2d20 con 0x7f7ccc0d1c90 2024-09-11T22:16:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.524+0000 7f7cd296f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7ccc15ecc0 con 0x7f7ccc162a60 2024-09-11T22:16:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.524+0000 7f7ccbfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7ccc15e8e0 0x7f7ccc0d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41864/0 (socket says 172.21.15.50:41864) 2024-09-11T22:16:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.524+0000 7f7ccbfff640 1 -- 172.21.15.50:0/1117447914 learned_addr learned my addr 172.21.15.50:0/1117447914 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668601745 0 0) 0x7f7ccc163080 con 0x7f7ccc15e8e0 2024-09-11T22:16:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7cd0f0c640 1 --2- 172.21.15.50:0/1117447914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ccc162a60 0x7f7ccc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb8003520 con 0x7f7ccc15e8e0 2024-09-11T22:16:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4074200534 0 0) 0x7f7cb8003520 con 0x7f7ccc15e8e0 2024-09-11T22:16:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ccc162a60 msgr2=0x7f7ccc0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 --2- 172.21.15.50:0/1117447914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ccc162a60 0x7f7ccc0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 >> v1:172.21.15.77:6789/0 conn(0x7f7ccc0d1c90 legacy=0x7f7ccc162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ccc0d3000 con 0x7f7ccc15e8e0 2024-09-11T22:16:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f7cbc001670 con 0x7f7ccc15e8e0 2024-09-11T22:16:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7cd0f0c640 1 --2- 172.21.15.50:0/1117447914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ccc162a60 0x7f7ccc0b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 >> v1:172.21.15.50:6789/0 conn(0x7f7ccc15e8e0 legacy=0x7f7ccc0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 --2- 172.21.15.50:0/1117447914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ccc162a60 0x7f7cb80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 --2- 172.21.15.50:0/1117447914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb8003fd0 0x7f7cb8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 --2- 172.21.15.50:0/1117447914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cb8004d40 0x7f7cb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb800bb80 con 0x7f7cb8003fd0 2024-09-11T22:16:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb800bd30 con 0x7f7cb8004d40 2024-09-11T22:16:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb800bf30 con 0x7f7ccc162a60 2024-09-11T22:16:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7cc3fff640 1 --2- 172.21.15.50:0/1117447914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb8003fd0 0x7f7cb8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7ccbfff640 1 --2- 172.21.15.50:0/1117447914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ccc162a60 0x7f7cb80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7cd0f0c640 1 --2- 172.21.15.50:0/1117447914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cb8004d40 0x7f7cb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7cc3fff640 1 -- 172.21.15.50:0/1117447914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ccc162a60 msgr2=0x7f7cb80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7cc3fff640 1 --2- 172.21.15.50:0/1117447914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ccc162a60 0x7f7cb80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7cc3fff640 1 -- 172.21.15.50:0/1117447914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cb8004d40 msgr2=0x7f7cb80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7cc3fff640 1 --2- 172.21.15.50:0/1117447914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cb8004d40 0x7f7cb80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.525+0000 7f7cc3fff640 1 -- 172.21.15.50:0/1117447914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb8003520 con 0x7f7cb8003fd0 2024-09-11T22:16:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.526+0000 7f7cc3fff640 1 --2- 172.21.15.50:0/1117447914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb8003fd0 0x7f7cb8004800 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4001750 tx=0x7f7cb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb4b6adb9b8edfb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.526+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4001370 con 0x7f7cb8003fd0 2024-09-11T22:16:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.526+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb40052d0 con 0x7f7cb8003fd0 2024-09-11T22:16:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.526+0000 7f7ccb7fe640 1 -- 172.21.15.50:0/1117447914 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb402ab20 con 0x7f7cb8003fd0 2024-09-11T22:16:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.527+0000 7f7cd296f640 1 -- 172.21.15.50:0/1117447914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb8003fd0 msgr2=0x7f7cb8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.527+0000 7f7cd296f640 1 --2- 172.21.15.50:0/1117447914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cb8003fd0 0x7f7cb8004800 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4001750 tx=0x7f7cb8005830 comp rx=0 tx=0).stop 2024-09-11T22:16:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.527+0000 7f7cd0f0c640 1 -- 172.21.15.50:0/1117447914 reap_dead start 2024-09-11T22:16:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.527+0000 7f7cd296f640 1 -- 172.21.15.50:0/1117447914 shutdown_connections 2024-09-11T22:16:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.527+0000 7f7cd296f640 1 -- 172.21.15.50:0/1117447914 >> 172.21.15.50:0/1117447914 conn(0x7f7ccc067ba0 msgr2=0x7f7ccc067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.527+0000 7f7cd296f640 1 -- 172.21.15.50:0/1117447914 shutdown_connections 2024-09-11T22:16:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.527+0000 7f7cd296f640 1 -- 172.21.15.50:0/1117447914 wait complete. 2024-09-11T22:16:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.528+0000 7f7cd296f640 1 Processor -- start 2024-09-11T22:16:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.528+0000 7f7cd296f640 1 -- start start 2024-09-11T22:16:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd296f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7cb8003fd0 0x7f7ccc157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd296f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ccc15ecc0 0x7f7ccc1610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd296f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc15f140 0x7f7ccc1615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd296f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc0b7c90 con 0x7f7ccc15f140 2024-09-11T22:16:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd296f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc0b7b10 con 0x7f7ccc15ecc0 2024-09-11T22:16:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd296f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7ccc0d2ad0 con 0x7f7cb8003fd0 2024-09-11T22:16:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd0f0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc15f140 0x7f7ccc1615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd0f0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc15f140 0x7f7ccc1615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39040/0 (socket says 172.21.15.50:39040) 2024-09-11T22:16:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd0f0c640 1 -- 172.21.15.50:0/1107378447 learned_addr learned my addr 172.21.15.50:0/1107378447 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd0f0c640 1 -- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7cb8003fd0 msgr2=0x7f7ccc157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7ccbfff640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7cb8003fd0 0x7f7ccc157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cc3fff640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ccc15ecc0 0x7f7ccc1610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd0f0c640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7cb8003fd0 0x7f7ccc157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd0f0c640 1 -- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ccc15ecc0 msgr2=0x7f7ccc1610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd0f0c640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ccc15ecc0 0x7f7ccc1610a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd0f0c640 1 -- 172.21.15.50:0/1107378447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ccc0cc390 con 0x7f7ccc15f140 2024-09-11T22:16:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.529+0000 7f7cd0f0c640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc15f140 0x7f7ccc1615e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0d1220 tx=0x7f7cc4010530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.530+0000 7f7cc97fa640 1 -- 172.21.15.50:0/1107378447 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4010d20 con 0x7f7ccc15f140 2024-09-11T22:16:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.530+0000 7f7cc97fa640 1 -- 172.21.15.50:0/1107378447 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc4003990 con 0x7f7ccc15f140 2024-09-11T22:16:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.530+0000 7f7cd296f640 1 -- 172.21.15.50:0/1107378447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ccc0cc670 con 0x7f7ccc15f140 2024-09-11T22:16:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.530+0000 7f7cc97fa640 1 -- 172.21.15.50:0/1107378447 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4003b80 con 0x7f7ccc15f140 2024-09-11T22:16:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.530+0000 7f7cd296f640 1 -- 172.21.15.50:0/1107378447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ccc0ccc30 con 0x7f7ccc15f140 2024-09-11T22:16:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.531+0000 7f7cd296f640 1 -- 172.21.15.50:0/1107378447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ccc162350 con 0x7f7ccc15f140 2024-09-11T22:16:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.531+0000 7f7cc97fa640 1 -- 172.21.15.50:0/1107378447 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cc401e020 con 0x7f7ccc15f140 2024-09-11T22:16:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.532+0000 7f7cc97fa640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7cac06be30 0x7f7cac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.532+0000 7f7cc97fa640 1 -- 172.21.15.50:0/1107378447 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f7cc408b1f0 con 0x7f7ccc15f140 2024-09-11T22:16:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.532+0000 7f7ccbfff640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7cac06be30 0x7f7cac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.533+0000 7f7ccbfff640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7cac06be30 0x7f7cac06e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc007cb0 tx=0x7f7cbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.536+0000 7f7cc97fa640 1 -- 172.21.15.50:0/1107378447 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7cc4025020 con 0x7f7ccc15f140 2024-09-11T22:16:24.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.710+0000 7f7cd296f640 1 -- 172.21.15.50:0/1107378447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7ccc0ba770 con 0x7f7ccc15f140 2024-09-11T22:16:24.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.711+0000 7f7cc97fa640 1 -- 172.21.15.50:0/1107378447 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) ==== 93+0+10 (secure 0 0 0) 0x7f7cc4059ed0 con 0x7f7ccc15f140 2024-09-11T22:16:24.711 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-11T22:16:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.713+0000 7f7cd296f640 1 -- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7cac06be30 msgr2=0x7f7cac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.713+0000 7f7cd296f640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7cac06be30 0x7f7cac06e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc007cb0 tx=0x7f7cbc009040 comp rx=0 tx=0).stop 2024-09-11T22:16:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.713+0000 7f7cd296f640 1 -- 172.21.15.50:0/1107378447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc15f140 msgr2=0x7f7ccc1615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.713+0000 7f7cd296f640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc15f140 0x7f7ccc1615e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0d1220 tx=0x7f7cc4010530 comp rx=0 tx=0).stop 2024-09-11T22:16:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.713+0000 7f7cd296f640 1 -- 172.21.15.50:0/1107378447 shutdown_connections 2024-09-11T22:16:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.713+0000 7f7cd296f640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7cac06be30 0x7f7cac06e2f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.713+0000 7f7cd296f640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc15f140 0x7f7ccc1615e0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.713+0000 7f7cd296f640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ccc15ecc0 0x7f7ccc1610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.713+0000 7f7cd296f640 1 --2- 172.21.15.50:0/1107378447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7cb8003fd0 0x7f7ccc157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.713+0000 7f7cd296f640 1 -- 172.21.15.50:0/1107378447 >> 172.21.15.50:0/1107378447 conn(0x7f7ccc067ba0 msgr2=0x7f7ccc0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.713+0000 7f7cd296f640 1 -- 172.21.15.50:0/1107378447 shutdown_connections 2024-09-11T22:16:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.713+0000 7f7cd296f640 1 -- 172.21.15.50:0/1107378447 wait complete. 2024-09-11T22:16:24.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-11T22:16:24.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.826+0000 7f431b7e4640 1 Processor -- start 2024-09-11T22:16:24.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.827+0000 7f431b7e4640 1 -- start start 2024-09-11T22:16:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.827+0000 7f431b7e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43140b1600 0x7f43140b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.827+0000 7f431b7e4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43140cfbd0 con 0x7f43140cf610 2024-09-11T22:16:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.827+0000 7f431b7e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43140cfeb0 con 0x7f4314161fa0 2024-09-11T22:16:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.827+0000 7f431b7e4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f43140d1220 con 0x7f43140b1600 2024-09-11T22:16:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.827+0000 7f4319d81640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43140b1600 0x7f43140b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.827+0000 7f4318d7f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f43140cf610 0x7f43140cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41878/0 (socket says 172.21.15.50:41878) 2024-09-11T22:16:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.828+0000 7f4318d7f640 1 -- 172.21.15.50:0/1686073733 learned_addr learned my addr 172.21.15.50:0/1686073733 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.828+0000 7f4319d81640 1 -- 172.21.15.50:0/1686073733 >> v1:172.21.15.77:6789/0 conn(0x7f4314161fa0 legacy=0x7f43140cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.828+0000 7f4319d81640 1 -- 172.21.15.50:0/1686073733 >> v1:172.21.15.50:6789/0 conn(0x7f43140cf610 legacy=0x7f43140cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.828+0000 7f4319d81640 1 -- 172.21.15.50:0/1686073733 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43140d1470 con 0x7f43140b1600 2024-09-11T22:16:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.828+0000 7f4319d81640 1 --2- 172.21.15.50:0/1686073733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43140b1600 0x7f43140b4d20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f430c0097a0 tx=0x7f430c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cef85a54ece46b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.829+0000 7f4313fff640 1 -- 172.21.15.50:0/1686073733 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c037070 con 0x7f43140b1600 2024-09-11T22:16:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.829+0000 7f4313fff640 1 -- 172.21.15.50:0/1686073733 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430c032440 con 0x7f43140b1600 2024-09-11T22:16:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.829+0000 7f4313fff640 1 -- 172.21.15.50:0/1686073733 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c032810 con 0x7f43140b1600 2024-09-11T22:16:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.829+0000 7f431b7e4640 1 -- 172.21.15.50:0/1686073733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43140b1600 msgr2=0x7f43140b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.829+0000 7f431b7e4640 1 --2- 172.21.15.50:0/1686073733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43140b1600 0x7f43140b4d20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f430c0097a0 tx=0x7f430c02a230 comp rx=0 tx=0).stop 2024-09-11T22:16:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.829+0000 7f431b7e4640 1 -- 172.21.15.50:0/1686073733 shutdown_connections 2024-09-11T22:16:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.829+0000 7f431b7e4640 1 --2- 172.21.15.50:0/1686073733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43140b1600 0x7f43140b4d20 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.829+0000 7f431b7e4640 1 -- 172.21.15.50:0/1686073733 >> 172.21.15.50:0/1686073733 conn(0x7f431409ba50 msgr2=0x7f43140b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.829+0000 7f431b7e4640 1 -- 172.21.15.50:0/1686073733 shutdown_connections 2024-09-11T22:16:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.829+0000 7f431b7e4640 1 -- 172.21.15.50:0/1686073733 wait complete. 2024-09-11T22:16:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.830+0000 7f431b7e4640 1 Processor -- start 2024-09-11T22:16:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.831+0000 7f431b7e4640 1 -- start start 2024-09-11T22:16:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.831+0000 7f431b7e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43140b1600 0x7f4314153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.831+0000 7f431b7e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43140cf610 0x7f43140b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.831+0000 7f431b7e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4314161fa0 0x7f43140b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.831+0000 7f431b7e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43140d1c70 con 0x7f4314161fa0 2024-09-11T22:16:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.831+0000 7f431b7e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43140d17e0 con 0x7f43140b1600 2024-09-11T22:16:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.831+0000 7f431b7e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43140d1df0 con 0x7f43140cf610 2024-09-11T22:16:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.831+0000 7f4319d81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4314161fa0 0x7f43140b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.831+0000 7f4319d81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4314161fa0 0x7f43140b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39066/0 (socket says 172.21.15.50:39066) 2024-09-11T22:16:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.831+0000 7f4319d81640 1 -- 172.21.15.50:0/2306961714 learned_addr learned my addr 172.21.15.50:0/2306961714 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.832+0000 7f4319580640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43140b1600 0x7f4314153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.832+0000 7f4318d7f640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43140cf610 0x7f43140b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.832+0000 7f4319d81640 1 -- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43140cf610 msgr2=0x7f43140b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.832+0000 7f4319d81640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43140cf610 0x7f43140b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.832+0000 7f4319d81640 1 -- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43140b1600 msgr2=0x7f4314153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.832+0000 7f4319d81640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43140b1600 0x7f4314153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.832+0000 7f4319d81640 1 -- 172.21.15.50:0/2306961714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43140c99a0 con 0x7f4314161fa0 2024-09-11T22:16:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.832+0000 7f4319d81640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4314161fa0 0x7f43140b34f0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f430c035040 tx=0x7f430c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.832+0000 7f4311ffb640 1 -- 172.21.15.50:0/2306961714 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c037040 con 0x7f4314161fa0 2024-09-11T22:16:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.832+0000 7f4311ffb640 1 -- 172.21.15.50:0/2306961714 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430c042070 con 0x7f4314161fa0 2024-09-11T22:16:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.832+0000 7f4311ffb640 1 -- 172.21.15.50:0/2306961714 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c030b50 con 0x7f4314161fa0 2024-09-11T22:16:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.832+0000 7f431b7e4640 1 -- 172.21.15.50:0/2306961714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43140c9c80 con 0x7f4314161fa0 2024-09-11T22:16:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.832+0000 7f431b7e4640 1 -- 172.21.15.50:0/2306961714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43140ca240 con 0x7f4314161fa0 2024-09-11T22:16:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.834+0000 7f431b7e4640 1 -- 172.21.15.50:0/2306961714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43140b4d20 con 0x7f4314161fa0 2024-09-11T22:16:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.834+0000 7f4311ffb640 1 -- 172.21.15.50:0/2306961714 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f430c030cf0 con 0x7f4314161fa0 2024-09-11T22:16:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.834+0000 7f4311ffb640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f430006be30 0x7f430006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.835+0000 7f4311ffb640 1 -- 172.21.15.50:0/2306961714 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f430c0ab710 con 0x7f4314161fa0 2024-09-11T22:16:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.835+0000 7f4319580640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f430006be30 0x7f430006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.835+0000 7f4319580640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f430006be30 0x7f430006e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4304001f10 tx=0x7f4304009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:24.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:24.839+0000 7f4311ffb640 1 -- 172.21.15.50:0/2306961714 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f430c032e20 con 0x7f4314161fa0 2024-09-11T22:16:25.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.080+0000 7f431b7e4640 1 -- 172.21.15.50:0/2306961714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f4314070310 con 0x7f4314161fa0 2024-09-11T22:16:25.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.090+0000 7f4311ffb640 1 -- 172.21.15.50:0/2306961714 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v272) ==== 161+0+0 (secure 0 0 0) 0x7f430c079c80 con 0x7f4314161fa0 2024-09-11T22:16:25.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.092+0000 7f431b7e4640 1 -- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f430006be30 msgr2=0x7f430006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.092+0000 7f431b7e4640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f430006be30 0x7f430006e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4304001f10 tx=0x7f4304009040 comp rx=0 tx=0).stop 2024-09-11T22:16:25.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.092+0000 7f431b7e4640 1 -- 172.21.15.50:0/2306961714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4314161fa0 msgr2=0x7f43140b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.092+0000 7f431b7e4640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4314161fa0 0x7f43140b34f0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f430c035040 tx=0x7f430c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.092+0000 7f431b7e4640 1 -- 172.21.15.50:0/2306961714 shutdown_connections 2024-09-11T22:16:25.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.092+0000 7f431b7e4640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f430006be30 0x7f430006e2f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.092+0000 7f431b7e4640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43140cf610 0x7f43140b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.092+0000 7f431b7e4640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4314161fa0 0x7f43140b34f0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.092+0000 7f431b7e4640 1 --2- 172.21.15.50:0/2306961714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43140b1600 0x7f4314153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.092+0000 7f431b7e4640 1 -- 172.21.15.50:0/2306961714 >> 172.21.15.50:0/2306961714 conn(0x7f431409ba50 msgr2=0x7f43140b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.092+0000 7f431b7e4640 1 -- 172.21.15.50:0/2306961714 shutdown_connections 2024-09-11T22:16:25.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.092+0000 7f431b7e4640 1 -- 172.21.15.50:0/2306961714 wait complete. 2024-09-11T22:16:25.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T22:16:25.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.208+0000 7f415fce4640 1 Processor -- start 2024-09-11T22:16:25.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.208+0000 7f415fce4640 1 -- start start 2024-09-11T22:16:25.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415fce4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f415815e840 0x7f41580b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415fce4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f41580cdd50 0x7f41580cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415fce4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41580ce5f0 con 0x7f41580cf3b0 2024-09-11T22:16:25.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415fce4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f415806c240 con 0x7f41580cdd50 2024-09-11T22:16:25.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415fce4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f41580d0470 con 0x7f415815e840 2024-09-11T22:16:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415e281640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f41580cf3b0 0x7f41580d0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41888/0 (socket says 172.21.15.50:41888) 2024-09-11T22:16:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415e281640 1 -- 172.21.15.50:0/1920031625 learned_addr learned my addr 172.21.15.50:0/1920031625 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415da80640 1 --2- 172.21.15.50:0/1920031625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f415815e840 0x7f41580b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415d27f640 1 --2- 172.21.15.50:0/1920031625 >> v2:172.21.15.77:3300/0 conn(0x7f41580cdd50 0x7f41580cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415ca7e640 1 -- 172.21.15.50:0/1920031625 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439030806 0 0) 0x7f41580ce5f0 con 0x7f41580cf3b0 2024-09-11T22:16:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415ca7e640 1 -- 172.21.15.50:0/1920031625 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4144003520 con 0x7f41580cf3b0 2024-09-11T22:16:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415ca7e640 1 -- 172.21.15.50:0/1920031625 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1893770165 0 0) 0x7f4144003520 con 0x7f41580cf3b0 2024-09-11T22:16:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415da80640 1 -- 172.21.15.50:0/1920031625 >> v2:172.21.15.77:3300/0 conn(0x7f41580cdd50 msgr2=0x7f41580cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415da80640 1 --2- 172.21.15.50:0/1920031625 >> v2:172.21.15.77:3300/0 conn(0x7f41580cdd50 0x7f41580cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415da80640 1 -- 172.21.15.50:0/1920031625 >> v1:172.21.15.50:6789/0 conn(0x7f41580cf3b0 legacy=0x7f41580d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415da80640 1 -- 172.21.15.50:0/1920031625 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41580ce310 con 0x7f415815e840 2024-09-11T22:16:25.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.209+0000 7f415d27f640 1 --2- 172.21.15.50:0/1920031625 >> v2:172.21.15.77:3300/0 conn(0x7f41580cdd50 0x7f41580cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.210+0000 7f415da80640 1 --2- 172.21.15.50:0/1920031625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f415815e840 0x7f41580b4c70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f41540097d0 tx=0x7f415402a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5389b0981b2c3039 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.210+0000 7f415ca7e640 1 -- 172.21.15.50:0/1920031625 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154037070 con 0x7f415815e840 2024-09-11T22:16:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.210+0000 7f415ca7e640 1 -- 172.21.15.50:0/1920031625 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f415402abd0 con 0x7f415815e840 2024-09-11T22:16:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.210+0000 7f415ca7e640 1 -- 172.21.15.50:0/1920031625 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41500019f0 con 0x7f415815e840 2024-09-11T22:16:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.211+0000 7f415fce4640 1 -- 172.21.15.50:0/1920031625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f415815e840 msgr2=0x7f41580b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.211+0000 7f415fce4640 1 --2- 172.21.15.50:0/1920031625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f415815e840 0x7f41580b4c70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f41540097d0 tx=0x7f415402a140 comp rx=0 tx=0).stop 2024-09-11T22:16:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.211+0000 7f415fce4640 1 -- 172.21.15.50:0/1920031625 shutdown_connections 2024-09-11T22:16:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.211+0000 7f415fce4640 1 --2- 172.21.15.50:0/1920031625 >> v2:172.21.15.77:3300/0 conn(0x7f41580cdd50 0x7f41580cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.211+0000 7f415fce4640 1 --2- 172.21.15.50:0/1920031625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f415815e840 0x7f41580b4c70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.211+0000 7f415fce4640 1 -- 172.21.15.50:0/1920031625 >> 172.21.15.50:0/1920031625 conn(0x7f41580b4150 msgr2=0x7f41580b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:25.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.211+0000 7f415fce4640 1 -- 172.21.15.50:0/1920031625 shutdown_connections 2024-09-11T22:16:25.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.211+0000 7f415fce4640 1 -- 172.21.15.50:0/1920031625 wait complete. 2024-09-11T22:16:25.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.212+0000 7f415fce4640 1 Processor -- start 2024-09-11T22:16:25.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.212+0000 7f415fce4640 1 -- start start 2024-09-11T22:16:25.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415fce4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41580cdd50 0x7f41581f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415fce4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41580cf3b0 0x7f41580b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415fce4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f415815e840 0x7f41581f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415fce4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f415815ec20 con 0x7f41580cf3b0 2024-09-11T22:16:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415fce4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f415806bed0 con 0x7f415815e840 2024-09-11T22:16:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415fce4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f415815eda0 con 0x7f41580cdd50 2024-09-11T22:16:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415d27f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41580cf3b0 0x7f41580b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415d27f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41580cf3b0 0x7f41580b71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39068/0 (socket says 172.21.15.50:39068) 2024-09-11T22:16:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415d27f640 1 -- 172.21.15.50:0/2264099964 learned_addr learned my addr 172.21.15.50:0/2264099964 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415d27f640 1 -- 172.21.15.50:0/2264099964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41580cdd50 msgr2=0x7f41581f5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415d27f640 1 --2- 172.21.15.50:0/2264099964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41580cdd50 0x7f41581f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415d27f640 1 -- 172.21.15.50:0/2264099964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f415815e840 msgr2=0x7f41581f7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415e281640 1 --2- 172.21.15.50:0/2264099964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f415815e840 0x7f41581f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415d27f640 1 --2- 172.21.15.50:0/2264099964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f415815e840 0x7f41581f7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.213+0000 7f415d27f640 1 -- 172.21.15.50:0/2264099964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41580b1b20 con 0x7f41580cf3b0 2024-09-11T22:16:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.214+0000 7f415d27f640 1 --2- 172.21.15.50:0/2264099964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41580cf3b0 0x7f41580b71e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f414800e940 tx=0x7f414800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.214+0000 7f414e7fc640 1 -- 172.21.15.50:0/2264099964 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148017070 con 0x7f41580cf3b0 2024-09-11T22:16:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.214+0000 7f414e7fc640 1 -- 172.21.15.50:0/2264099964 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f414800c9a0 con 0x7f41580cf3b0 2024-09-11T22:16:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.214+0000 7f415fce4640 1 -- 172.21.15.50:0/2264099964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41580b7720 con 0x7f41580cf3b0 2024-09-11T22:16:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.214+0000 7f414e7fc640 1 -- 172.21.15.50:0/2264099964 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414800cd70 con 0x7f41580cf3b0 2024-09-11T22:16:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.214+0000 7f415fce4640 1 -- 172.21.15.50:0/2264099964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41580b2070 con 0x7f41580cf3b0 2024-09-11T22:16:25.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.215+0000 7f415fce4640 1 -- 172.21.15.50:0/2264099964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41580cf1d0 con 0x7f41580cf3b0 2024-09-11T22:16:25.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.215+0000 7f414e7fc640 1 -- 172.21.15.50:0/2264099964 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f414801a070 con 0x7f41580cf3b0 2024-09-11T22:16:25.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.216+0000 7f414e7fc640 1 --2- 172.21.15.50:0/2264099964 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f413c06be30 0x7f413c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.216+0000 7f414e7fc640 1 -- 172.21.15.50:0/2264099964 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f414808a9b0 con 0x7f41580cf3b0 2024-09-11T22:16:25.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.216+0000 7f415da80640 1 --2- 172.21.15.50:0/2264099964 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f413c06be30 0x7f413c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:25.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.217+0000 7f415da80640 1 --2- 172.21.15.50:0/2264099964 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f413c06be30 0x7f413c06e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4154034000 tx=0x7f415402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:25.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.220+0000 7f414e7fc640 1 -- 172.21.15.50:0/2264099964 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41580cf1d0 con 0x7f41580cf3b0 2024-09-11T22:16:25.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.395+0000 7f415fce4640 1 -- 172.21.15.50:0/2264099964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f41580b4e00 con 0x7f41580cf3b0 2024-09-11T22:16:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.398+0000 7f414e7fc640 1 -- 172.21.15.50:0/2264099964 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f4148059690 con 0x7f41580cf3b0 2024-09-11T22:16:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.400+0000 7f415fce4640 1 -- 172.21.15.50:0/2264099964 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f413c06be30 msgr2=0x7f413c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.400+0000 7f415fce4640 1 --2- 172.21.15.50:0/2264099964 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f413c06be30 0x7f413c06e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4154034000 tx=0x7f415402c000 comp rx=0 tx=0).stop 2024-09-11T22:16:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.400+0000 7f415fce4640 1 -- 172.21.15.50:0/2264099964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41580cf3b0 msgr2=0x7f41580b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.400+0000 7f415fce4640 1 --2- 172.21.15.50:0/2264099964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41580cf3b0 0x7f41580b71e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f414800e940 tx=0x7f414800ee00 comp rx=0 tx=0).stop 2024-09-11T22:16:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.400+0000 7f415fce4640 1 -- 172.21.15.50:0/2264099964 shutdown_connections 2024-09-11T22:16:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.400+0000 7f415fce4640 1 --2- 172.21.15.50:0/2264099964 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f413c06be30 0x7f413c06e2f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.400+0000 7f415fce4640 1 --2- 172.21.15.50:0/2264099964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f415815e840 0x7f41581f7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.400+0000 7f415fce4640 1 --2- 172.21.15.50:0/2264099964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41580cf3b0 0x7f41580b71e0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.400+0000 7f415fce4640 1 --2- 172.21.15.50:0/2264099964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41580cdd50 0x7f41581f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.400+0000 7f415fce4640 1 -- 172.21.15.50:0/2264099964 >> 172.21.15.50:0/2264099964 conn(0x7f41580b4150 msgr2=0x7f4158070820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.400+0000 7f415fce4640 1 -- 172.21.15.50:0/2264099964 shutdown_connections 2024-09-11T22:16:25.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.400+0000 7f415fce4640 1 -- 172.21.15.50:0/2264099964 wait complete. 2024-09-11T22:16:25.412 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:16:25.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:16:25.452 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:16:25.497 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:16:25.497 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:16:25.497 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:16:25.513 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:16:25.513 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:16:25.514 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:16:25.532 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:16:25.532 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:16:25.532 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:16:25.569 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:16:25.570 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:16:25.570 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:16:25.590 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:16:25.590 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T22:16:25.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:25.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.710+0000 7f5b990af640 1 Processor -- start 2024-09-11T22:16:25.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.710+0000 7f5b990af640 1 -- start start 2024-09-11T22:16:25.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.711+0000 7f5b990af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b940ce0e0 0x7f5b940b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.711+0000 7f5b990af640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b94072630 con 0x7f5b941463b0 2024-09-11T22:16:25.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.711+0000 7f5b990af640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b940728d0 con 0x7f5b9415db60 2024-09-11T22:16:25.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.711+0000 7f5b990af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5b940d0670 con 0x7f5b940ce0e0 2024-09-11T22:16:25.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.711+0000 7f5b92d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5b941463b0 0x7f5b940cfc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41894/0 (socket says 172.21.15.50:41894) 2024-09-11T22:16:25.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.711+0000 7f5b92d9d640 1 -- 172.21.15.50:0/1265714547 learned_addr learned my addr 172.21.15.50:0/1265714547 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:25.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.711+0000 7f5b9359e640 1 --2- 172.21.15.50:0/1265714547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b940ce0e0 0x7f5b940b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:25.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.711+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756952070 0 0) 0x7f5b94072630 con 0x7f5b941463b0 2024-09-11T22:16:25.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.711+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b80003520 con 0x7f5b941463b0 2024-09-11T22:16:25.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 403514357 0 0) 0x7f5b80003520 con 0x7f5b941463b0 2024-09-11T22:16:25.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b940ce0e0 msgr2=0x7f5b940b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:25.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b91d9b640 1 --2- 172.21.15.50:0/1265714547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b940ce0e0 0x7f5b940b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 >> v1:172.21.15.77:6789/0 conn(0x7f5b9415db60 legacy=0x7f5b940cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b94072bb0 con 0x7f5b941463b0 2024-09-11T22:16:25.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f5b840019f0 con 0x7f5b941463b0 2024-09-11T22:16:25.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 >> v1:172.21.15.50:6789/0 conn(0x7f5b941463b0 legacy=0x7f5b940cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b91d9b640 1 --2- 172.21.15.50:0/1265714547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b940ce0e0 0x7f5b800039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b91d9b640 1 --2- 172.21.15.50:0/1265714547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b80003f60 0x7f5b80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b91d9b640 1 --2- 172.21.15.50:0/1265714547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b80004d40 0x7f5b800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5b940d0670 con 0x7f5b80004d40 2024-09-11T22:16:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8000baa0 con 0x7f5b80003f60 2024-09-11T22:16:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8000bca0 con 0x7f5b940ce0e0 2024-09-11T22:16:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b9359e640 1 --2- 172.21.15.50:0/1265714547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b80004d40 0x7f5b800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b92d9d640 1 --2- 172.21.15.50:0/1265714547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b940ce0e0 0x7f5b800039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b9259c640 1 --2- 172.21.15.50:0/1265714547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b80003f60 0x7f5b80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b9359e640 1 -- 172.21.15.50:0/1265714547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b940ce0e0 msgr2=0x7f5b800039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b9359e640 1 --2- 172.21.15.50:0/1265714547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b940ce0e0 0x7f5b800039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b9359e640 1 -- 172.21.15.50:0/1265714547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b80003f60 msgr2=0x7f5b80004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b9359e640 1 --2- 172.21.15.50:0/1265714547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b80003f60 0x7f5b80004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.712+0000 7f5b9359e640 1 -- 172.21.15.50:0/1265714547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b80003520 con 0x7f5b80004d40 2024-09-11T22:16:25.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.713+0000 7f5b9359e640 1 --2- 172.21.15.50:0/1265714547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b80004d40 0x7f5b800051c0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009ac0 tx=0x7f5b80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb23eabd799d86f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.713+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c036070 con 0x7f5b80004d40 2024-09-11T22:16:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.713+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b8c031400 con 0x7f5b80004d40 2024-09-11T22:16:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.713+0000 7f5b91d9b640 1 -- 172.21.15.50:0/1265714547 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c009690 con 0x7f5b80004d40 2024-09-11T22:16:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.713+0000 7f5b990af640 1 -- 172.21.15.50:0/1265714547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b80004d40 msgr2=0x7f5b800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.714+0000 7f5b990af640 1 --2- 172.21.15.50:0/1265714547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b80004d40 0x7f5b800051c0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009ac0 tx=0x7f5b80005830 comp rx=0 tx=0).stop 2024-09-11T22:16:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.714+0000 7f5b9359e640 1 -- 172.21.15.50:0/1265714547 reap_dead start 2024-09-11T22:16:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.714+0000 7f5b990af640 1 -- 172.21.15.50:0/1265714547 shutdown_connections 2024-09-11T22:16:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.714+0000 7f5b990af640 1 -- 172.21.15.50:0/1265714547 >> 172.21.15.50:0/1265714547 conn(0x7f5b94068240 msgr2=0x7f5b940b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.714+0000 7f5b990af640 1 -- 172.21.15.50:0/1265714547 shutdown_connections 2024-09-11T22:16:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.714+0000 7f5b990af640 1 -- 172.21.15.50:0/1265714547 wait complete. 2024-09-11T22:16:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.715+0000 7f5b990af640 1 Processor -- start 2024-09-11T22:16:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.715+0000 7f5b990af640 1 -- start start 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b990af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b80004d40 0x7f5b9413d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b990af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9413e6d0 0x7f5b94141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b990af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b9413ac00 0x7f5b94143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b990af640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5b94072f20 con 0x7f5b9413e6d0 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b990af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b94146790 con 0x7f5b9413ac00 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b990af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5b940733b0 con 0x7f5b80004d40 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b9259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9413e6d0 0x7f5b94141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b9259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9413e6d0 0x7f5b94141a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39096/0 (socket says 172.21.15.50:39096) 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b9259c640 1 -- 172.21.15.50:0/2060045655 learned_addr learned my addr 172.21.15.50:0/2060045655 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b92d9d640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b80004d40 0x7f5b9413d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b9359e640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b9413ac00 0x7f5b94143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b9259c640 1 -- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b80004d40 msgr2=0x7f5b9413d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b9259c640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b80004d40 0x7f5b9413d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b9259c640 1 -- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b9413ac00 msgr2=0x7f5b94143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b9259c640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b9413ac00 0x7f5b94143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.716+0000 7f5b9259c640 1 -- 172.21.15.50:0/2060045655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9413d630 con 0x7f5b9413e6d0 2024-09-11T22:16:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.717+0000 7f5b9259c640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9413e6d0 0x7f5b94141a20 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00f850 tx=0x7f5b7c00fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.717+0000 7f5b8b7fe640 1 -- 172.21.15.50:0/2060045655 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0050d0 con 0x7f5b9413e6d0 2024-09-11T22:16:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.717+0000 7f5b8b7fe640 1 -- 172.21.15.50:0/2060045655 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7c018070 con 0x7f5b9413e6d0 2024-09-11T22:16:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.717+0000 7f5b990af640 1 -- 172.21.15.50:0/2060045655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9413d910 con 0x7f5b9413e6d0 2024-09-11T22:16:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.717+0000 7f5b8b7fe640 1 -- 172.21.15.50:0/2060045655 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c00d730 con 0x7f5b9413e6d0 2024-09-11T22:16:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.717+0000 7f5b990af640 1 -- 172.21.15.50:0/2060045655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9413ded0 con 0x7f5b9413e6d0 2024-09-11T22:16:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.718+0000 7f5b990af640 1 -- 172.21.15.50:0/2060045655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b9415f770 con 0x7f5b9413e6d0 2024-09-11T22:16:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.718+0000 7f5b8b7fe640 1 -- 172.21.15.50:0/2060045655 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b7c00d8d0 con 0x7f5b9413e6d0 2024-09-11T22:16:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.719+0000 7f5b8b7fe640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b7406be60 0x7f5b7406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.719+0000 7f5b8b7fe640 1 -- 172.21.15.50:0/2060045655 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5029+0+0 (secure 0 0 0) 0x7f5b7c08a8a0 con 0x7f5b9413e6d0 2024-09-11T22:16:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.719+0000 7f5b92d9d640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b7406be60 0x7f5b7406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.720+0000 7f5b92d9d640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b7406be60 0x7f5b7406e320 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5b9415ed30 tx=0x7f5b84006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.723+0000 7f5b8b7fe640 1 -- 172.21.15.50:0/2060045655 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b7c059580 con 0x7f5b9413e6d0 2024-09-11T22:16:25.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.934+0000 7f5b990af640 1 -- 172.21.15.50:0/2060045655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b940cfc00 con 0x7f5b9413e6d0 2024-09-11T22:16:25.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.934+0000 7f5b8b7fe640 1 -- 172.21.15.50:0/2060045655 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+3908 (secure 0 0 0) 0x7f5b7c058e80 con 0x7f5b9413e6d0 2024-09-11T22:16:25.935 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:25.935 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":72,"btime":"2024-09-11T22:16:20:077232+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1026980304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1026980304},{"type":"v1","addr":"172.21.15.50:6833","nonce":1026980304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/3116356224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3116356224},{"type":"v1","addr":"172.21.15.77:6836","nonce":3116356224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3001000202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3001000202},{"type":"v1","addr":"172.21.15.77:6837","nonce":3001000202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/760635532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":760635532},{"type":"v1","addr":"172.21.15.50:6835","nonce":760635532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[]} 2024-09-11T22:16:25.936 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 72 2024-09-11T22:16:25.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.936+0000 7f5b990af640 1 -- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b7406be60 msgr2=0x7f5b7406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.936+0000 7f5b990af640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b7406be60 0x7f5b7406e320 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5b9415ed30 tx=0x7f5b84006040 comp rx=0 tx=0).stop 2024-09-11T22:16:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.936+0000 7f5b990af640 1 -- 172.21.15.50:0/2060045655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9413e6d0 msgr2=0x7f5b94141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.936+0000 7f5b990af640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9413e6d0 0x7f5b94141a20 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00f850 tx=0x7f5b7c00fc50 comp rx=0 tx=0).stop 2024-09-11T22:16:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.937+0000 7f5b990af640 1 -- 172.21.15.50:0/2060045655 shutdown_connections 2024-09-11T22:16:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.937+0000 7f5b990af640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b7406be60 0x7f5b7406e320 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.937+0000 7f5b990af640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b9413ac00 0x7f5b94143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.937+0000 7f5b990af640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b9413e6d0 0x7f5b94141a20 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.937+0000 7f5b990af640 1 --2- 172.21.15.50:0/2060045655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b80004d40 0x7f5b9413d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.937+0000 7f5b990af640 1 -- 172.21.15.50:0/2060045655 >> 172.21.15.50:0/2060045655 conn(0x7f5b94068240 msgr2=0x7f5b94071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.937+0000 7f5b990af640 1 -- 172.21.15.50:0/2060045655 shutdown_connections 2024-09-11T22:16:25.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:25.937+0000 7f5b990af640 1 -- 172.21.15.50:0/2060045655 wait complete. 2024-09-11T22:16:25.949 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:16:25.949 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T22:16:25.950 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:16:25.950 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:16:25.950 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:16:25.950 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T22:16:25.950 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:16:25.951 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:16:25.951 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:16:25.951 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T22:16:25.951 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:16:25.951 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:16:25.952 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:16:25.952 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T22:16:25.952 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:16:25.952 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:16:25.960 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:16:25.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:16:25.961 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:16:25.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:16:25.963 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:16:25.963 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:16:25.964 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:16:25.964 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:16:26.003 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:16:26.003 DEBUG:teuthology.parallel:result is None 2024-09-11T22:16:26.004 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:16:26.004 DEBUG:teuthology.parallel:result is None 2024-09-11T22:16:26.006 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:16:26.006 DEBUG:teuthology.parallel:result is None 2024-09-11T22:16:26.007 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:16:26.007 DEBUG:teuthology.parallel:result is None 2024-09-11T22:16:26.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T22:16:26.081 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:16:26.082 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:16:26.087 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:16:26.087 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:16:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.114+0000 7fc6e039f640 1 Processor -- start 2024-09-11T22:16:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.114+0000 7fc6e039f640 1 -- start start 2024-09-11T22:16:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6e039f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 0x7fc6d80d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6e039f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d80b2890 con 0x7fc6d815ffb0 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6e039f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d80b2b70 con 0x7fc6d80af390 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6e039f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d80b2e50 con 0x7fc6d80b3a40 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6de13b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc6d815ffb0 0x7fc6d80d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41910/0 (socket says 172.21.15.50:41910) 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6de13b640 1 -- 172.21.15.50:0/860580649 learned_addr learned my addr 172.21.15.50:0/860580649 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd93a640 1 --2- 172.21.15.50:0/860580649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 0x7fc6d80d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3319229540 0 0) 0x7fc6d80b2890 con 0x7fc6d815ffb0 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6c4007930 con 0x7fc6d815ffb0 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4135479507 0 0) 0x7fc6d80b2b70 con 0x7fc6d80af390 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6d80b2890 con 0x7fc6d80af390 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 627066744 0 0) 0x7fc6c4007930 con 0x7fc6d815ffb0 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 msgr2=0x7fc6d80d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 --2- 172.21.15.50:0/860580649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 0x7fc6d80d0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 >> v1:172.21.15.77:6789/0 conn(0x7fc6d80af390 legacy=0x7fc6d80af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d80b3130 con 0x7fc6d815ffb0 2024-09-11T22:16:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fc6d4001670 con 0x7fc6d815ffb0 2024-09-11T22:16:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 >> v1:172.21.15.50:6789/0 conn(0x7fc6d815ffb0 legacy=0x7fc6d80d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 --2- 172.21.15.50:0/860580649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 0x7fc6c4007f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 --2- 172.21.15.50:0/860580649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c40084e0 0x7fc6c4008c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 --2- 172.21.15.50:0/860580649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c4009150 0x7fc6c40095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d80b2e50 con 0x7fc6c40084e0 2024-09-11T22:16:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c400ff60 con 0x7fc6c4009150 2024-09-11T22:16:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.115+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c4010130 con 0x7fc6d80b3a40 2024-09-11T22:16:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.116+0000 7fc6de13b640 1 --2- 172.21.15.50:0/860580649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 0x7fc6c4007f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.116+0000 7fc6dd93a640 1 --2- 172.21.15.50:0/860580649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c40084e0 0x7fc6c4008c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.116+0000 7fc6de93c640 1 --2- 172.21.15.50:0/860580649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c4009150 0x7fc6c40095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.116+0000 7fc6de13b640 1 -- 172.21.15.50:0/860580649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c4009150 msgr2=0x7fc6c40095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.116+0000 7fc6de13b640 1 --2- 172.21.15.50:0/860580649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c4009150 0x7fc6c40095d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.116+0000 7fc6de13b640 1 -- 172.21.15.50:0/860580649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c40084e0 msgr2=0x7fc6c4008c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.116+0000 7fc6de13b640 1 --2- 172.21.15.50:0/860580649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c40084e0 0x7fc6c4008c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.116+0000 7fc6de13b640 1 -- 172.21.15.50:0/860580649 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c4007930 con 0x7fc6d80b3a40 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.116+0000 7fc6de93c640 1 --2- 172.21.15.50:0/860580649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c4009150 0x7fc6c40095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.117+0000 7fc6de13b640 1 --2- 172.21.15.50:0/860580649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 0x7fc6c4007f80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400c190 tx=0x7fc6c4009c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7f6534079d18028 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.117+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4007cc0 con 0x7fc6d80b3a40 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.117+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d4005af0 con 0x7fc6d80b3a40 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.117+0000 7fc6dd139640 1 -- 172.21.15.50:0/860580649 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4007070 con 0x7fc6d80b3a40 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.117+0000 7fc6e039f640 1 -- 172.21.15.50:0/860580649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 msgr2=0x7fc6c4007f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.117+0000 7fc6e039f640 1 --2- 172.21.15.50:0/860580649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 0x7fc6c4007f80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400c190 tx=0x7fc6c4009c40 comp rx=0 tx=0).stop 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.117+0000 7fc6de93c640 1 -- 172.21.15.50:0/860580649 reap_dead start 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.117+0000 7fc6e039f640 1 -- 172.21.15.50:0/860580649 shutdown_connections 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.117+0000 7fc6e039f640 1 -- 172.21.15.50:0/860580649 >> 172.21.15.50:0/860580649 conn(0x7fc6d80b40b0 msgr2=0x7fc6d80b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.117+0000 7fc6e039f640 1 -- 172.21.15.50:0/860580649 shutdown_connections 2024-09-11T22:16:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.117+0000 7fc6e039f640 1 -- 172.21.15.50:0/860580649 wait complete. 2024-09-11T22:16:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.119+0000 7fc6e039f640 1 Processor -- start 2024-09-11T22:16:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.119+0000 7fc6e039f640 1 -- start start 2024-09-11T22:16:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.119+0000 7fc6e039f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 0x7fc6d80c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.119+0000 7fc6e039f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d80ce3b0 0x7fc6d80ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.119+0000 7fc6e039f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6d8149080 0x7fc6d8149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.119+0000 7fc6e039f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d80b00d0 con 0x7fc6d80ce3b0 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.119+0000 7fc6e039f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d80aff50 con 0x7fc6d8149080 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.119+0000 7fc6e039f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d80b0250 con 0x7fc6d80b3a40 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.119+0000 7fc6dd93a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d80ce3b0 0x7fc6d80ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.119+0000 7fc6dd93a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d80ce3b0 0x7fc6d80ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39156/0 (socket says 172.21.15.50:39156) 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.119+0000 7fc6dd93a640 1 -- 172.21.15.50:0/4260567381 learned_addr learned my addr 172.21.15.50:0/4260567381 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.120+0000 7fc6de13b640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 0x7fc6d80c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.120+0000 7fc6de93c640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6d8149080 0x7fc6d8149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.120+0000 7fc6dd93a640 1 -- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 msgr2=0x7fc6d80c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.120+0000 7fc6dd93a640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 0x7fc6d80c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.120+0000 7fc6dd93a640 1 -- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6d8149080 msgr2=0x7fc6d8149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.120+0000 7fc6dd93a640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6d8149080 0x7fc6d8149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.120+0000 7fc6dd93a640 1 -- 172.21.15.50:0/4260567381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d8149e70 con 0x7fc6d80ce3b0 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.120+0000 7fc6dd93a640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d80ce3b0 0x7fc6d80ce810 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8011990 tx=0x7fc6c8011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.120+0000 7fc6ceffd640 1 -- 172.21.15.50:0/4260567381 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800fad0 con 0x7fc6d80ce3b0 2024-09-11T22:16:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.120+0000 7fc6ceffd640 1 -- 172.21.15.50:0/4260567381 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c800fc70 con 0x7fc6d80ce3b0 2024-09-11T22:16:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.120+0000 7fc6ceffd640 1 -- 172.21.15.50:0/4260567381 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8014440 con 0x7fc6d80ce3b0 2024-09-11T22:16:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.120+0000 7fc6e039f640 1 -- 172.21.15.50:0/4260567381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d80cf100 con 0x7fc6d80ce3b0 2024-09-11T22:16:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.120+0000 7fc6e039f640 1 -- 172.21.15.50:0/4260567381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d80cf6c0 con 0x7fc6d80ce3b0 2024-09-11T22:16:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.121+0000 7fc6e039f640 1 -- 172.21.15.50:0/4260567381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d806db40 con 0x7fc6d80ce3b0 2024-09-11T22:16:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.122+0000 7fc6ceffd640 1 -- 172.21.15.50:0/4260567381 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6c8012040 con 0x7fc6d80ce3b0 2024-09-11T22:16:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.122+0000 7fc6ceffd640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc6bc06be60 0x7fc6bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.122+0000 7fc6ceffd640 1 -- 172.21.15.50:0/4260567381 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5029+0+0 (secure 0 0 0) 0x7fc6c808b1e0 con 0x7fc6d80ce3b0 2024-09-11T22:16:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.122+0000 7fc6de13b640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc6bc06be60 0x7fc6bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.123+0000 7fc6de13b640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc6bc06be60 0x7fc6bc06e320 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4032000 tx=0x7fc6d4034040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.127+0000 7fc6ceffd640 1 -- 172.21.15.50:0/4260567381 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6c8019030 con 0x7fc6d80ce3b0 2024-09-11T22:16:26.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-11T22:16:26.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-11T22:16:26.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-11T22:16:26.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-11T22:16:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:26.314+0000 7fc6e039f640 1 -- 172.21.15.50:0/4260567381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc6d80b84e0 con 0x7fc6d80ce3b0 2024-09-11T22:16:27.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.102+0000 7fc6ceffd640 1 -- 172.21.15.50:0/4260567381 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v103) ==== 97+0+0 (secure 0 0 0) 0x7fc6c8059750 con 0x7fc6d80ce3b0 2024-09-11T22:16:27.103 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-11T22:16:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.105+0000 7fc6e039f640 1 -- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc6bc06be60 msgr2=0x7fc6bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.105+0000 7fc6e039f640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc6bc06be60 0x7fc6bc06e320 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4032000 tx=0x7fc6d4034040 comp rx=0 tx=0).stop 2024-09-11T22:16:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.105+0000 7fc6e039f640 1 -- 172.21.15.50:0/4260567381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d80ce3b0 msgr2=0x7fc6d80ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.105+0000 7fc6e039f640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d80ce3b0 0x7fc6d80ce810 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8011990 tx=0x7fc6c8011e50 comp rx=0 tx=0).stop 2024-09-11T22:16:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.106+0000 7fc6e039f640 1 -- 172.21.15.50:0/4260567381 shutdown_connections 2024-09-11T22:16:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.106+0000 7fc6e039f640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc6bc06be60 0x7fc6bc06e320 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.106+0000 7fc6e039f640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6d8149080 0x7fc6d8149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.106+0000 7fc6e039f640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d80ce3b0 0x7fc6d80ce810 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.106+0000 7fc6e039f640 1 --2- 172.21.15.50:0/4260567381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6d80b3a40 0x7fc6d80c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.106+0000 7fc6e039f640 1 -- 172.21.15.50:0/4260567381 >> 172.21.15.50:0/4260567381 conn(0x7fc6d80b40b0 msgr2=0x7fc6d806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.106+0000 7fc6e039f640 1 -- 172.21.15.50:0/4260567381 shutdown_connections 2024-09-11T22:16:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.106+0000 7fc6e039f640 1 -- 172.21.15.50:0/4260567381 wait complete. 2024-09-11T22:16:27.121 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T22:16:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.233+0000 7fc37c8e6640 1 Processor -- start 2024-09-11T22:16:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.233+0000 7fc37c8e6640 1 -- start start 2024-09-11T22:16:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37c8e6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3780b3e10 0x7fc3780b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37c8e6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3780b4f00 con 0x7fc37815c2c0 2024-09-11T22:16:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37c8e6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3780b4360 con 0x7fc3780d05e0 2024-09-11T22:16:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37c8e6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc3780b51c0 con 0x7fc3780b3e10 2024-09-11T22:16:27.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc37815c2c0 0x7fc3780cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41926/0 (socket says 172.21.15.50:41926) 2024-09-11T22:16:27.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37659c640 1 -- 172.21.15.50:0/1049931057 learned_addr learned my addr 172.21.15.50:0/1049931057 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883797674 0 0) 0x7fc3780b4f00 con 0x7fc37815c2c0 2024-09-11T22:16:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc360003520 con 0x7fc37815c2c0 2024-09-11T22:16:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc376d9d640 1 --2- 172.21.15.50:0/1049931057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3780b3e10 0x7fc3780b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2217297195 0 0) 0x7fc360003520 con 0x7fc37815c2c0 2024-09-11T22:16:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3780b3e10 msgr2=0x7fc3780b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 --2- 172.21.15.50:0/1049931057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3780b3e10 0x7fc3780b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 >> v1:172.21.15.77:6789/0 conn(0x7fc3780d05e0 legacy=0x7fc3780ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3780b54a0 con 0x7fc37815c2c0 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fc3680019f0 con 0x7fc37815c2c0 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 >> v1:172.21.15.50:6789/0 conn(0x7fc37815c2c0 legacy=0x7fc3780cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 --2- 172.21.15.50:0/1049931057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3600039e0 0x7fc360003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 --2- 172.21.15.50:0/1049931057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3780b3e10 0x7fc360004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 --2- 172.21.15.50:0/1049931057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc360004d40 0x7fc3600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc3780b51c0 con 0x7fc360004d40 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc36000ba70 con 0x7fc3600039e0 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.234+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc36000bc70 con 0x7fc3780b3e10 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.235+0000 7fc376d9d640 1 --2- 172.21.15.50:0/1049931057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc360004d40 0x7fc3600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.235+0000 7fc37659c640 1 --2- 172.21.15.50:0/1049931057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3600039e0 0x7fc360003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.235+0000 7fc375d9b640 1 --2- 172.21.15.50:0/1049931057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3780b3e10 0x7fc360004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.235+0000 7fc376d9d640 1 -- 172.21.15.50:0/1049931057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3780b3e10 msgr2=0x7fc360004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.235+0000 7fc376d9d640 1 --2- 172.21.15.50:0/1049931057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3780b3e10 0x7fc360004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.235+0000 7fc376d9d640 1 -- 172.21.15.50:0/1049931057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3600039e0 msgr2=0x7fc360003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.235+0000 7fc376d9d640 1 --2- 172.21.15.50:0/1049931057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3600039e0 0x7fc360003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.235+0000 7fc376d9d640 1 -- 172.21.15.50:0/1049931057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc360003520 con 0x7fc360004d40 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.236+0000 7fc376d9d640 1 --2- 172.21.15.50:0/1049931057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc360004d40 0x7fc3600051c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc370009a90 tx=0x7fc360005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53577155d6785d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.236+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370036070 con 0x7fc360004d40 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.236+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc370031400 con 0x7fc360004d40 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.236+0000 7fc37559a640 1 -- 172.21.15.50:0/1049931057 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370009690 con 0x7fc360004d40 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.236+0000 7fc37c8e6640 1 -- 172.21.15.50:0/1049931057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc360004d40 msgr2=0x7fc3600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.236+0000 7fc37c8e6640 1 --2- 172.21.15.50:0/1049931057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc360004d40 0x7fc3600051c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc370009a90 tx=0x7fc360005830 comp rx=0 tx=0).stop 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.236+0000 7fc376d9d640 1 -- 172.21.15.50:0/1049931057 reap_dead start 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.236+0000 7fc37c8e6640 1 -- 172.21.15.50:0/1049931057 shutdown_connections 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.237+0000 7fc37c8e6640 1 -- 172.21.15.50:0/1049931057 >> 172.21.15.50:0/1049931057 conn(0x7fc3780679c0 msgr2=0x7fc378067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.237+0000 7fc37c8e6640 1 -- 172.21.15.50:0/1049931057 shutdown_connections 2024-09-11T22:16:27.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.237+0000 7fc37c8e6640 1 -- 172.21.15.50:0/1049931057 wait complete. 2024-09-11T22:16:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.238+0000 7fc37c8e6640 1 Processor -- start 2024-09-11T22:16:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.238+0000 7fc37c8e6640 1 -- start start 2024-09-11T22:16:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc37c8e6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc360004d40 0x7fc37814f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc37c8e6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3781f23b0 0x7fc3781e3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc37c8e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3781e36b0 0x7fc378157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc37c8e6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc37806d070 con 0x7fc3781e36b0 2024-09-11T22:16:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc37c8e6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3780ce200 con 0x7fc3781f23b0 2024-09-11T22:16:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc37c8e6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc37806d1f0 con 0x7fc360004d40 2024-09-11T22:16:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc376d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3781e36b0 0x7fc378157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc37659c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc360004d40 0x7fc37814f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc376d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3781e36b0 0x7fc378157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39178/0 (socket says 172.21.15.50:39178) 2024-09-11T22:16:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc37659c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc360004d40 0x7fc37814f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:49942/0 (socket says 172.21.15.50:49942) 2024-09-11T22:16:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc376d9d640 1 -- 172.21.15.50:0/2257013000 learned_addr learned my addr 172.21.15.50:0/2257013000 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc375d9b640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3781f23b0 0x7fc3781e3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc376d9d640 1 -- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc360004d40 msgr2=0x7fc37814f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc376d9d640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc360004d40 0x7fc37814f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc376d9d640 1 -- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3781f23b0 msgr2=0x7fc3781e3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc376d9d640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3781f23b0 0x7fc3781e3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc376d9d640 1 -- 172.21.15.50:0/2257013000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3781e3bc0 con 0x7fc3781e36b0 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.239+0000 7fc37659c640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc360004d40 0x7fc37814f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.240+0000 7fc376d9d640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3781e36b0 0x7fc378157270 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fc370009a90 tx=0x7fc370004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.240+0000 7fc366ffd640 1 -- 172.21.15.50:0/2257013000 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370036040 con 0x7fc3781e36b0 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.240+0000 7fc366ffd640 1 -- 172.21.15.50:0/2257013000 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc370043070 con 0x7fc3781e36b0 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.240+0000 7fc366ffd640 1 -- 172.21.15.50:0/2257013000 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370009690 con 0x7fc3781e36b0 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.240+0000 7fc37c8e6640 1 -- 172.21.15.50:0/2257013000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3781e4900 con 0x7fc3781e36b0 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.240+0000 7fc37c8e6640 1 -- 172.21.15.50:0/2257013000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37814fd10 con 0x7fc3781e36b0 2024-09-11T22:16:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.241+0000 7fc37c8e6640 1 -- 172.21.15.50:0/2257013000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37815c6a0 con 0x7fc3781e36b0 2024-09-11T22:16:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.241+0000 7fc366ffd640 1 -- 172.21.15.50:0/2257013000 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc370039070 con 0x7fc3781e36b0 2024-09-11T22:16:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.242+0000 7fc366ffd640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc35806be60 0x7fc35806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.242+0000 7fc366ffd640 1 -- 172.21.15.50:0/2257013000 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 4857+0+0 (secure 0 0 0) 0x7fc3700aa5c0 con 0x7fc3781e36b0 2024-09-11T22:16:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.242+0000 7fc37659c640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc35806be60 0x7fc35806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.243+0000 7fc37659c640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc35806be60 0x7fc35806e320 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc368000f80 tx=0x7fc368006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:27.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.247+0000 7fc366ffd640 1 -- 172.21.15.50:0/2257013000 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc37004c020 con 0x7fc3781e36b0 2024-09-11T22:16:27.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.488+0000 7fc37c8e6640 1 -- 172.21.15.50:0/2257013000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fc37806e9f0 con 0x7fc3781e36b0 2024-09-11T22:16:27.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.488+0000 7fc366ffd640 1 -- 172.21.15.50:0/2257013000 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fc370078c60 con 0x7fc3781e36b0 2024-09-11T22:16:27.489 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:27.489 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:16:27.490 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-11T22:16:27.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.490 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-11T22:16:27.490 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w==", 2024-09-11T22:16:27.490 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.490 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:16:27.490 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:16:27.490 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:16:27.490 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.490 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.490 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-11T22:16:27.491 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg==", 2024-09-11T22:16:27.491 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.491 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:16:27.491 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:16:27.491 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:16:27.491 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.491 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.491 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-11T22:16:27.491 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ==", 2024-09-11T22:16:27.491 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw==", 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:16:27.492 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.493 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.493 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-11T22:16:27.493 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg==", 2024-09-11T22:16:27.493 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.493 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:16:27.493 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:16:27.493 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.493 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.493 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ==", 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg==", 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:16:27.494 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.495 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.495 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-11T22:16:27.495 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg==", 2024-09-11T22:16:27.495 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.495 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:16:27.495 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:16:27.495 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.495 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.495 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A==", 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw==", 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:16:27.496 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.497 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-11T22:16:27.497 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A==", 2024-09-11T22:16:27.497 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.497 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:16:27.497 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:16:27.497 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.497 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw==", 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew==", 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-11T22:16:27.498 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw==", 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-11T22:16:27.499 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg==", 2024-09-11T22:16:27.500 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.500 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:16:27.500 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:16:27.500 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:16:27.500 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:16:27.500 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.500 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-11T22:16:27.500 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw==", 2024-09-11T22:16:27.500 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.500 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBFFeJmAq9+OBAAANc9KfDvm3+wt/uED7WCvA==", 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.502 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-11T22:16:27.502 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g==", 2024-09-11T22:16:27.502 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.502 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:16:27.502 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:16:27.502 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:16:27.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.502 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-11T22:16:27.502 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg==", 2024-09-11T22:16:27.503 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:16:27.503 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:16:27.503 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:16:27.503 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:16:27.503 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.503 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.503 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-11T22:16:27.503 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:16:27.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.490+0000 7fc37c8e6640 1 -- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc35806be60 msgr2=0x7fc35806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.490+0000 7fc37c8e6640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc35806be60 0x7fc35806e320 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc368000f80 tx=0x7fc368006040 comp rx=0 tx=0).stop 2024-09-11T22:16:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.490+0000 7fc37c8e6640 1 -- 172.21.15.50:0/2257013000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3781e36b0 msgr2=0x7fc378157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.490+0000 7fc37c8e6640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3781e36b0 0x7fc378157270 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fc370009a90 tx=0x7fc370004730 comp rx=0 tx=0).stop 2024-09-11T22:16:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.490+0000 7fc37c8e6640 1 -- 172.21.15.50:0/2257013000 shutdown_connections 2024-09-11T22:16:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.490+0000 7fc37c8e6640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc35806be60 0x7fc35806e320 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.490+0000 7fc37c8e6640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3781e36b0 0x7fc378157270 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.490+0000 7fc37c8e6640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3781f23b0 0x7fc3781e3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.490+0000 7fc37c8e6640 1 --2- 172.21.15.50:0/2257013000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc360004d40 0x7fc37814f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.490+0000 7fc37c8e6640 1 -- 172.21.15.50:0/2257013000 >> 172.21.15.50:0/2257013000 conn(0x7fc3780679c0 msgr2=0x7fc3780b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.490+0000 7fc37c8e6640 1 -- 172.21.15.50:0/2257013000 shutdown_connections 2024-09-11T22:16:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.490+0000 7fc37c8e6640 1 -- 172.21.15.50:0/2257013000 wait complete. 2024-09-11T22:16:27.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:16:27.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.607+0000 7f78780ed640 1 Processor -- start 2024-09-11T22:16:27.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.607+0000 7f78780ed640 1 -- start start 2024-09-11T22:16:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f78780ed640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f787015b400 0x7f787006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f78780ed640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7870072e60 0x7f787006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f78780ed640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f787015b7e0 con 0x7f787006df20 2024-09-11T22:16:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f78780ed640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f787006e370 con 0x7f7870072e60 2024-09-11T22:16:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f78780ed640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f787015f140 con 0x7f787015b400 2024-09-11T22:16:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f7875688640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7870072e60 0x7f787006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f787668a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f787006df20 0x7f78700b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49602/0 (socket says 172.21.15.50:49602) 2024-09-11T22:16:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f787668a640 1 -- 172.21.15.50:0/852079971 learned_addr learned my addr 172.21.15.50:0/852079971 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:27.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f7875e89640 1 --2- 172.21.15.50:0/852079971 >> v2:172.21.15.77:3300/0 conn(0x7f787015b400 0x7f787006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f7875688640 1 -- 172.21.15.50:0/852079971 >> v2:172.21.15.77:3300/0 conn(0x7f787015b400 msgr2=0x7f787006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:27.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f7875688640 1 --2- 172.21.15.50:0/852079971 >> v2:172.21.15.77:3300/0 conn(0x7f787015b400 0x7f787006d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f7875688640 1 -- 172.21.15.50:0/852079971 >> v1:172.21.15.50:6789/0 conn(0x7f787006df20 legacy=0x7f78700b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f7875688640 1 -- 172.21.15.50:0/852079971 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787015f420 con 0x7f7870072e60 2024-09-11T22:16:27.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.608+0000 7f7874e87640 1 -- 172.21.15.50:0/852079971 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 145204134 0 0) 0x7f787015b7e0 con 0x7f787006df20 2024-09-11T22:16:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.609+0000 7f7875688640 1 --2- 172.21.15.50:0/852079971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7870072e60 0x7f787006d9e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f78700b56e0 tx=0x7f786002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e09ae3a231853 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.609+0000 7f7874e87640 1 -- 172.21.15.50:0/852079971 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860037070 con 0x7f7870072e60 2024-09-11T22:16:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.609+0000 7f7874e87640 1 -- 172.21.15.50:0/852079971 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7860032440 con 0x7f7870072e60 2024-09-11T22:16:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.609+0000 7f7874e87640 1 -- 172.21.15.50:0/852079971 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860032810 con 0x7f7870072e60 2024-09-11T22:16:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.610+0000 7f78780ed640 1 -- 172.21.15.50:0/852079971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7870072e60 msgr2=0x7f787006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.610+0000 7f78780ed640 1 --2- 172.21.15.50:0/852079971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7870072e60 0x7f787006d9e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f78700b56e0 tx=0x7f786002a1a0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.610+0000 7f78780ed640 1 -- 172.21.15.50:0/852079971 shutdown_connections 2024-09-11T22:16:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.610+0000 7f78780ed640 1 --2- 172.21.15.50:0/852079971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7870072e60 0x7f787006d9e0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.610+0000 7f78780ed640 1 --2- 172.21.15.50:0/852079971 >> v2:172.21.15.77:3300/0 conn(0x7f787015b400 0x7f787006d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.610+0000 7f78780ed640 1 -- 172.21.15.50:0/852079971 >> 172.21.15.50:0/852079971 conn(0x7f78700679c0 msgr2=0x7f7870067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.610+0000 7f78780ed640 1 -- 172.21.15.50:0/852079971 shutdown_connections 2024-09-11T22:16:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.610+0000 7f78780ed640 1 -- 172.21.15.50:0/852079971 wait complete. 2024-09-11T22:16:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.611+0000 7f78780ed640 1 Processor -- start 2024-09-11T22:16:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.611+0000 7f78780ed640 1 -- start start 2024-09-11T22:16:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.612+0000 7f78780ed640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787006df20 0x7f7870150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.612+0000 7f78780ed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7870072e60 0x7f7870150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.612+0000 7f78780ed640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f787015b400 0x7f787015cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.612+0000 7f78780ed640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f78700cfc50 con 0x7f7870072e60 2024-09-11T22:16:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.612+0000 7f78780ed640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f787015f9e0 con 0x7f787006df20 2024-09-11T22:16:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.612+0000 7f78780ed640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f78700721d0 con 0x7f787015b400 2024-09-11T22:16:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.612+0000 7f7875688640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7870072e60 0x7f7870150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.612+0000 7f7875688640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7870072e60 0x7f7870150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56768/0 (socket says 172.21.15.50:56768) 2024-09-11T22:16:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.612+0000 7f7875688640 1 -- 172.21.15.50:0/3724063736 learned_addr learned my addr 172.21.15.50:0/3724063736 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.612+0000 7f787668a640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f787015b400 0x7f787015cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.612+0000 7f7875e89640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787006df20 0x7f7870150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.613+0000 7f7875688640 1 -- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f787015b400 msgr2=0x7f787015cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.613+0000 7f7875688640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f787015b400 0x7f787015cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.613+0000 7f7875688640 1 -- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787006df20 msgr2=0x7f7870150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.613+0000 7f7875688640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787006df20 0x7f7870150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.613+0000 7f7875688640 1 -- 172.21.15.50:0/3724063736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787015b7e0 con 0x7f7870072e60 2024-09-11T22:16:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.613+0000 7f7875688640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7870072e60 0x7f7870150290 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f7860000c00 tx=0x7f78600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.613+0000 7f78667fc640 1 -- 172.21.15.50:0/3724063736 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860037040 con 0x7f7870072e60 2024-09-11T22:16:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.613+0000 7f78667fc640 1 -- 172.21.15.50:0/3724063736 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7860042070 con 0x7f7870072e60 2024-09-11T22:16:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.613+0000 7f78780ed640 1 -- 172.21.15.50:0/3724063736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787015bac0 con 0x7f7870072e60 2024-09-11T22:16:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.613+0000 7f78667fc640 1 -- 172.21.15.50:0/3724063736 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860030a50 con 0x7f7870072e60 2024-09-11T22:16:27.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.613+0000 7f78780ed640 1 -- 172.21.15.50:0/3724063736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787015c080 con 0x7f7870072e60 2024-09-11T22:16:27.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.614+0000 7f78780ed640 1 -- 172.21.15.50:0/3724063736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78700afc80 con 0x7f7870072e60 2024-09-11T22:16:27.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.615+0000 7f78667fc640 1 -- 172.21.15.50:0/3724063736 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7860030bf0 con 0x7f7870072e60 2024-09-11T22:16:27.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.615+0000 7f78667fc640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f785406be30 0x7f785406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.615+0000 7f78667fc640 1 -- 172.21.15.50:0/3724063736 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 4857+0+0 (secure 0 0 0) 0x7f78600ab430 con 0x7f7870072e60 2024-09-11T22:16:27.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.615+0000 7f7875e89640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f785406be30 0x7f785406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.616+0000 7f7875e89640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f785406be30 0x7f785406e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f786c006fd0 tx=0x7f786c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:27.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.619+0000 7f78667fc640 1 -- 172.21.15.50:0/3724063736 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78700afc80 con 0x7f7870072e60 2024-09-11T22:16:27.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.797+0000 7f78780ed640 1 -- 172.21.15.50:0/3724063736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7870000900 con 0x7f7870072e60 2024-09-11T22:16:27.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.797+0000 7f78667fc640 1 -- 172.21.15.50:0/3724063736 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v103) ==== 84+0+65 (secure 0 0 0) 0x7f786007a2e0 con 0x7f7870072e60 2024-09-11T22:16:27.798 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:27.798 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:16:27.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:16:27.798 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:16:27.799 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:16:27.799 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:16:27.799 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:16:27.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.799+0000 7f78780ed640 1 -- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f785406be30 msgr2=0x7f785406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.799+0000 7f78780ed640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f785406be30 0x7f785406e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f786c006fd0 tx=0x7f786c008040 comp rx=0 tx=0).stop 2024-09-11T22:16:27.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.799+0000 7f78780ed640 1 -- 172.21.15.50:0/3724063736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7870072e60 msgr2=0x7f7870150290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.799+0000 7f78780ed640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7870072e60 0x7f7870150290 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f7860000c00 tx=0x7f78600046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.799+0000 7f78780ed640 1 -- 172.21.15.50:0/3724063736 shutdown_connections 2024-09-11T22:16:27.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.799+0000 7f78780ed640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f785406be30 0x7f785406e2f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.799+0000 7f78780ed640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f787015b400 0x7f787015cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.799+0000 7f78780ed640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7870072e60 0x7f7870150290 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.799+0000 7f78780ed640 1 --2- 172.21.15.50:0/3724063736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f787006df20 0x7f7870150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.799+0000 7f78780ed640 1 -- 172.21.15.50:0/3724063736 >> 172.21.15.50:0/3724063736 conn(0x7f78700679c0 msgr2=0x7f78700d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:27.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.799+0000 7f78780ed640 1 -- 172.21.15.50:0/3724063736 shutdown_connections 2024-09-11T22:16:27.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.799+0000 7f78780ed640 1 -- 172.21.15.50:0/3724063736 wait complete. 2024-09-11T22:16:27.810 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:16:27.811 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:16:27.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.916+0000 7ff73df31640 1 Processor -- start 2024-09-11T22:16:27.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.916+0000 7ff73df31640 1 -- start start 2024-09-11T22:16:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.916+0000 7ff73df31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff738161d60 0x7ff7380d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.916+0000 7ff73df31640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7380b7990 con 0x7ff7380d39f0 2024-09-11T22:16:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.916+0000 7ff73df31640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7380d4530 con 0x7ff7380b6e40 2024-09-11T22:16:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.916+0000 7ff73df31640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff7380d3f70 con 0x7ff738161d60 2024-09-11T22:16:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff736ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff7380d39f0 0x7ff7380b6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49610/0 (socket says 172.21.15.50:49610) 2024-09-11T22:16:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff736ffd640 1 -- 172.21.15.50:0/2469825010 learned_addr learned my addr 172.21.15.50:0/2469825010 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7377fe640 1 --2- 172.21.15.50:0/2469825010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff738161d60 0x7ff7380d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3901850274 0 0) 0x7ff7380b7990 con 0x7ff7380d39f0 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff720003520 con 0x7ff7380d39f0 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1671759285 0 0) 0x7ff720003520 con 0x7ff7380d39f0 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff738161d60 msgr2=0x7ff7380d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 --2- 172.21.15.50:0/2469825010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff738161d60 0x7ff7380d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 >> v1:172.21.15.77:6789/0 conn(0x7ff7380b6e40 legacy=0x7ff7380b8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7380d4250 con 0x7ff7380d39f0 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7ff72c001690 con 0x7ff7380d39f0 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 >> v1:172.21.15.50:6789/0 conn(0x7ff7380d39f0 legacy=0x7ff7380b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 --2- 172.21.15.50:0/2469825010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7200039e0 0x7ff720003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 --2- 172.21.15.50:0/2469825010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff738161d60 0x7ff720004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 --2- 172.21.15.50:0/2469825010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff720004d40 0x7ff7200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff7380d3f70 con 0x7ff720004d40 2024-09-11T22:16:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff72000b9c0 con 0x7ff7200039e0 2024-09-11T22:16:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff72000bbc0 con 0x7ff738161d60 2024-09-11T22:16:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff737fff640 1 --2- 172.21.15.50:0/2469825010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff720004d40 0x7ff7200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff7377fe640 1 --2- 172.21.15.50:0/2469825010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7200039e0 0x7ff720003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.917+0000 7ff736ffd640 1 --2- 172.21.15.50:0/2469825010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff738161d60 0x7ff720004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.918+0000 7ff737fff640 1 -- 172.21.15.50:0/2469825010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff738161d60 msgr2=0x7ff720004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.918+0000 7ff737fff640 1 --2- 172.21.15.50:0/2469825010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff738161d60 0x7ff720004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.918+0000 7ff737fff640 1 -- 172.21.15.50:0/2469825010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7200039e0 msgr2=0x7ff720003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.918+0000 7ff737fff640 1 --2- 172.21.15.50:0/2469825010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7200039e0 0x7ff720003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.918+0000 7ff737fff640 1 -- 172.21.15.50:0/2469825010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff720003520 con 0x7ff720004d40 2024-09-11T22:16:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.918+0000 7ff737fff640 1 --2- 172.21.15.50:0/2469825010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff720004d40 0x7ff7200051c0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7ff730001f30 tx=0x7ff720005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de316f858683ad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.918+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730001b30 con 0x7ff720004d40 2024-09-11T22:16:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.918+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff730031620 con 0x7ff720004d40 2024-09-11T22:16:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.918+0000 7ff7367fc640 1 -- 172.21.15.50:0/2469825010 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730031a10 con 0x7ff720004d40 2024-09-11T22:16:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.919+0000 7ff73df31640 1 -- 172.21.15.50:0/2469825010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff720004d40 msgr2=0x7ff7200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.919+0000 7ff73df31640 1 --2- 172.21.15.50:0/2469825010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff720004d40 0x7ff7200051c0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7ff730001f30 tx=0x7ff720005830 comp rx=0 tx=0).stop 2024-09-11T22:16:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.919+0000 7ff737fff640 1 -- 172.21.15.50:0/2469825010 reap_dead start 2024-09-11T22:16:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.919+0000 7ff73df31640 1 -- 172.21.15.50:0/2469825010 shutdown_connections 2024-09-11T22:16:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.919+0000 7ff73df31640 1 -- 172.21.15.50:0/2469825010 >> 172.21.15.50:0/2469825010 conn(0x7ff738067db0 msgr2=0x7ff7380681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.919+0000 7ff73df31640 1 -- 172.21.15.50:0/2469825010 shutdown_connections 2024-09-11T22:16:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.919+0000 7ff73df31640 1 -- 172.21.15.50:0/2469825010 wait complete. 2024-09-11T22:16:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.920+0000 7ff73df31640 1 Processor -- start 2024-09-11T22:16:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.920+0000 7ff73df31640 1 -- start start 2024-09-11T22:16:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff73df31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff73814eb30 0x7ff7380ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff73df31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff73815db80 0x7ff7380cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff73df31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7380ccb10 0x7ff73815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff73df31640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff7380d34b0 con 0x7ff73814eb30 2024-09-11T22:16:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff73df31640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff7380cf930 con 0x7ff73815db80 2024-09-11T22:16:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff73df31640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff7380d3630 con 0x7ff7380ccb10 2024-09-11T22:16:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff7377fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff73814eb30 0x7ff7380ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff7377fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff73814eb30 0x7ff7380ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56792/0 (socket says 172.21.15.50:56792) 2024-09-11T22:16:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff7377fe640 1 -- 172.21.15.50:0/4059491301 learned_addr learned my addr 172.21.15.50:0/4059491301 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff737fff640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7380ccb10 0x7ff73815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff736ffd640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff73815db80 0x7ff7380cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff7377fe640 1 -- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7380ccb10 msgr2=0x7ff73815a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff7377fe640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7380ccb10 0x7ff73815a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.921+0000 7ff7377fe640 1 -- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff73815db80 msgr2=0x7ff7380cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.922+0000 7ff7377fe640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff73815db80 0x7ff7380cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.922+0000 7ff7377fe640 1 -- 172.21.15.50:0/4059491301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7380cb830 con 0x7ff73814eb30 2024-09-11T22:16:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.922+0000 7ff7377fe640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff73814eb30 0x7ff7380ce830 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7ff7280119a0 tx=0x7ff728011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.922+0000 7ff71ffff640 1 -- 172.21.15.50:0/4059491301 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72800faf0 con 0x7ff73814eb30 2024-09-11T22:16:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.922+0000 7ff71ffff640 1 -- 172.21.15.50:0/4059491301 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff72800fc90 con 0x7ff73814eb30 2024-09-11T22:16:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.922+0000 7ff73df31640 1 -- 172.21.15.50:0/4059491301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff73815e3d0 con 0x7ff73814eb30 2024-09-11T22:16:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.922+0000 7ff71ffff640 1 -- 172.21.15.50:0/4059491301 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff728014440 con 0x7ff73814eb30 2024-09-11T22:16:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.922+0000 7ff73df31640 1 -- 172.21.15.50:0/4059491301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7380cbdd0 con 0x7ff73814eb30 2024-09-11T22:16:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.923+0000 7ff73df31640 1 -- 172.21.15.50:0/4059491301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7380b57c0 con 0x7ff73814eb30 2024-09-11T22:16:27.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.923+0000 7ff71ffff640 1 -- 172.21.15.50:0/4059491301 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff728012040 con 0x7ff73814eb30 2024-09-11T22:16:27.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.924+0000 7ff71ffff640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff72406be60 0x7ff72406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:27.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.924+0000 7ff71ffff640 1 -- 172.21.15.50:0/4059491301 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 4857+0+0 (secure 0 0 0) 0x7ff72808b1c0 con 0x7ff73814eb30 2024-09-11T22:16:27.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.924+0000 7ff736ffd640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff72406be60 0x7ff72406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:27.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.925+0000 7ff736ffd640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff72406be60 0x7ff72406e320 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff72c001050 tx=0x7ff72c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:27.928+0000 7ff71ffff640 1 -- 172.21.15.50:0/4059491301 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff728019030 con 0x7ff73814eb30 2024-09-11T22:16:28.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:28.106+0000 7ff73df31640 1 -- 172.21.15.50:0/4059491301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff7380b54e0 con 0x7ff73814eb30 2024-09-11T22:16:29.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.112+0000 7ff71ffff640 1 -- 172.21.15.50:0/4059491301 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v104) ==== 138+0+0 (secure 0 0 0) 0x7ff728059870 con 0x7ff73814eb30 2024-09-11T22:16:29.113 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:16:29.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.117+0000 7ff73df31640 1 -- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff72406be60 msgr2=0x7ff72406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.117+0000 7ff73df31640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff72406be60 0x7ff72406e320 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff72c001050 tx=0x7ff72c009040 comp rx=0 tx=0).stop 2024-09-11T22:16:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.117+0000 7ff73df31640 1 -- 172.21.15.50:0/4059491301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff73814eb30 msgr2=0x7ff7380ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.117+0000 7ff73df31640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff73814eb30 0x7ff7380ce830 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7ff7280119a0 tx=0x7ff728011e60 comp rx=0 tx=0).stop 2024-09-11T22:16:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.119+0000 7ff73df31640 1 -- 172.21.15.50:0/4059491301 shutdown_connections 2024-09-11T22:16:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.119+0000 7ff73df31640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff72406be60 0x7ff72406e320 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.119+0000 7ff73df31640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7380ccb10 0x7ff73815a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.119+0000 7ff73df31640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff73815db80 0x7ff7380cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.119+0000 7ff73df31640 1 --2- 172.21.15.50:0/4059491301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff73814eb30 0x7ff7380ce830 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.119+0000 7ff73df31640 1 -- 172.21.15.50:0/4059491301 >> 172.21.15.50:0/4059491301 conn(0x7ff738067db0 msgr2=0x7ff7380d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.120+0000 7ff73df31640 1 -- 172.21.15.50:0/4059491301 shutdown_connections 2024-09-11T22:16:29.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.120+0000 7ff73df31640 1 -- 172.21.15.50:0/4059491301 wait complete. 2024-09-11T22:16:29.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:16:29.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.254+0000 7f637adc0640 1 Processor -- start 2024-09-11T22:16:29.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.254+0000 7f637adc0640 1 -- start start 2024-09-11T22:16:29.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.254+0000 7f637adc0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f63740d18a0 0x7f63740d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:29.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.254+0000 7f637adc0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63740cfa80 con 0x7f63740d3a30 2024-09-11T22:16:29.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.254+0000 7f637adc0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63740d40d0 con 0x7f637415e870 2024-09-11T22:16:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.254+0000 7f637adc0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f63740d3ea0 con 0x7f63740d18a0 2024-09-11T22:16:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f637935d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f63740d3a30 0x7f63740b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49620/0 (socket says 172.21.15.50:49620) 2024-09-11T22:16:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f637935d640 1 -- 172.21.15.50:0/1773993950 learned_addr learned my addr 172.21.15.50:0/1773993950 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f6373fff640 1 --2- 172.21.15.50:0/1773993950 >> v2:172.21.15.77:3300/0 conn(0x7f63740d18a0 0x7f63740d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1583802984 0 0) 0x7f6364001490 con 0x7f63740d3a30 2024-09-11T22:16:29.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6360003520 con 0x7f63740d3a30 2024-09-11T22:16:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1264644402 0 0) 0x7f6360003520 con 0x7f63740d3a30 2024-09-11T22:16:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 >> v2:172.21.15.77:3300/0 conn(0x7f63740d18a0 msgr2=0x7f63740d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 --2- 172.21.15.50:0/1773993950 >> v2:172.21.15.77:3300/0 conn(0x7f63740d18a0 0x7f63740d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 >> v1:172.21.15.77:6789/0 conn(0x7f637415e870 legacy=0x7f63740d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63740d43b0 con 0x7f63740d3a30 2024-09-11T22:16:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f6364001bc0 con 0x7f63740d3a30 2024-09-11T22:16:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 >> v1:172.21.15.50:6789/0 conn(0x7f63740d3a30 legacy=0x7f63740b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 --2- 172.21.15.50:0/1773993950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63600039b0 0x7f6360003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 --2- 172.21.15.50:0/1773993950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6360004800 0x7f6360004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 --2- 172.21.15.50:0/1773993950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63600051c0 0x7f636000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f636000c030 con 0x7f6360004800 2024-09-11T22:16:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f636000c1e0 con 0x7f63600039b0 2024-09-11T22:16:29.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f636000c3e0 con 0x7f63600051c0 2024-09-11T22:16:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f6373fff640 1 --2- 172.21.15.50:0/1773993950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6360004800 0x7f6360004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.255+0000 7f6378b5c640 1 --2- 172.21.15.50:0/1773993950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63600039b0 0x7f6360003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.256+0000 7f637935d640 1 --2- 172.21.15.50:0/1773993950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63600051c0 0x7f636000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.256+0000 7f6373fff640 1 -- 172.21.15.50:0/1773993950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63600051c0 msgr2=0x7f636000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.256+0000 7f6373fff640 1 --2- 172.21.15.50:0/1773993950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63600051c0 0x7f636000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.256+0000 7f6373fff640 1 -- 172.21.15.50:0/1773993950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63600039b0 msgr2=0x7f6360003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.256+0000 7f6373fff640 1 --2- 172.21.15.50:0/1773993950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63600039b0 0x7f6360003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.256+0000 7f637935d640 1 -- 172.21.15.50:0/1773993950 reap_dead start 2024-09-11T22:16:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.256+0000 7f6373fff640 1 -- 172.21.15.50:0/1773993950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6360003520 con 0x7f6360004800 2024-09-11T22:16:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.256+0000 7f6373fff640 1 --2- 172.21.15.50:0/1773993950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6360004800 0x7f6360004c80 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f635c009ac0 tx=0x7f6360005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311592a4ba4746b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.257+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c036070 con 0x7f6360004800 2024-09-11T22:16:29.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.257+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f635c031400 con 0x7f6360004800 2024-09-11T22:16:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.257+0000 7f63737fe640 1 -- 172.21.15.50:0/1773993950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c009690 con 0x7f6360004800 2024-09-11T22:16:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.257+0000 7f637adc0640 1 -- 172.21.15.50:0/1773993950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6360004800 msgr2=0x7f6360004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.257+0000 7f637adc0640 1 --2- 172.21.15.50:0/1773993950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6360004800 0x7f6360004c80 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f635c009ac0 tx=0x7f6360005830 comp rx=0 tx=0).stop 2024-09-11T22:16:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.257+0000 7f637adc0640 1 -- 172.21.15.50:0/1773993950 shutdown_connections 2024-09-11T22:16:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.257+0000 7f637adc0640 1 --2- 172.21.15.50:0/1773993950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6360004800 0x7f6360004c80 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.257+0000 7f637adc0640 1 -- 172.21.15.50:0/1773993950 >> 172.21.15.50:0/1773993950 conn(0x7f63740727a0 msgr2=0x7f63740679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.257+0000 7f637adc0640 1 -- 172.21.15.50:0/1773993950 shutdown_connections 2024-09-11T22:16:29.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.257+0000 7f637adc0640 1 -- 172.21.15.50:0/1773993950 wait complete. 2024-09-11T22:16:29.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.259+0000 7f637adc0640 1 Processor -- start 2024-09-11T22:16:29.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.259+0000 7f637adc0640 1 -- start start 2024-09-11T22:16:29.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.259+0000 7f637adc0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6360004800 0x7f637415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:29.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.259+0000 7f637adc0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63740ab180 0x7f6374160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:29.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.259+0000 7f637adc0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63740ab600 0x7f63741614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:29.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.259+0000 7f637adc0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f637415ec50 con 0x7f63740ab180 2024-09-11T22:16:29.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.259+0000 7f637adc0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f63740b7ee0 con 0x7f63740ab600 2024-09-11T22:16:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f637adc0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f63740b78b0 con 0x7f6360004800 2024-09-11T22:16:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f6373fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63740ab180 0x7f6374160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f6373fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63740ab180 0x7f6374160fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56814/0 (socket says 172.21.15.50:56814) 2024-09-11T22:16:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f6373fff640 1 -- 172.21.15.50:0/1825642682 learned_addr learned my addr 172.21.15.50:0/1825642682 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f637935d640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63740ab600 0x7f63741614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f6378b5c640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6360004800 0x7f637415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f6373fff640 1 -- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6360004800 msgr2=0x7f637415d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f6373fff640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6360004800 0x7f637415d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f6373fff640 1 -- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63740ab600 msgr2=0x7f63741614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f6373fff640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63740ab600 0x7f63741614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f6373fff640 1 -- 172.21.15.50:0/1825642682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63740cb980 con 0x7f63740ab180 2024-09-11T22:16:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f6373fff640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63740ab180 0x7f6374160fa0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f635c034040 tx=0x7f635c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f63717fa640 1 -- 172.21.15.50:0/1825642682 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c03f020 con 0x7f63740ab180 2024-09-11T22:16:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f63717fa640 1 -- 172.21.15.50:0/1825642682 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f635c037040 con 0x7f63740ab180 2024-09-11T22:16:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f637adc0640 1 -- 172.21.15.50:0/1825642682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63740cbc60 con 0x7f63740ab180 2024-09-11T22:16:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.260+0000 7f63717fa640 1 -- 172.21.15.50:0/1825642682 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c036070 con 0x7f63740ab180 2024-09-11T22:16:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.261+0000 7f637adc0640 1 -- 172.21.15.50:0/1825642682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63740cc220 con 0x7f63740ab180 2024-09-11T22:16:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.261+0000 7f637adc0640 1 -- 172.21.15.50:0/1825642682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63740d34f0 con 0x7f63740ab180 2024-09-11T22:16:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.262+0000 7f63717fa640 1 -- 172.21.15.50:0/1825642682 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f635c042020 con 0x7f63740ab180 2024-09-11T22:16:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.263+0000 7f63717fa640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f635406be60 0x7f635406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.263+0000 7f63717fa640 1 -- 172.21.15.50:0/1825642682 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5227+0+0 (secure 0 0 0) 0x7f635c0aad40 con 0x7f63740ab180 2024-09-11T22:16:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.263+0000 7f6378b5c640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f635406be60 0x7f635406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:29.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.263+0000 7f6378b5c640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f635406be60 0x7f635406e320 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f636c000c00 tx=0x7f636c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:29.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.267+0000 7f63717fa640 1 -- 172.21.15.50:0/1825642682 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f635c049030 con 0x7f63740ab180 2024-09-11T22:16:29.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:29.443+0000 7f637adc0640 1 -- 172.21.15.50:0/1825642682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f63740b9ab0 con 0x7f63740ab180 2024-09-11T22:16:30.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.117+0000 7f63717fa640 1 -- 172.21.15.50:0/1825642682 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v105) ==== 170+0+0 (secure 0 0 0) 0x7f635c0792b0 con 0x7f63740ab180 2024-09-11T22:16:30.118 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:16:30.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.120+0000 7f637adc0640 1 -- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f635406be60 msgr2=0x7f635406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.120+0000 7f637adc0640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f635406be60 0x7f635406e320 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f636c000c00 tx=0x7f636c009040 comp rx=0 tx=0).stop 2024-09-11T22:16:30.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.120+0000 7f637adc0640 1 -- 172.21.15.50:0/1825642682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63740ab180 msgr2=0x7f6374160fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.120+0000 7f637adc0640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63740ab180 0x7f6374160fa0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f635c034040 tx=0x7f635c004730 comp rx=0 tx=0).stop 2024-09-11T22:16:30.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.121+0000 7f637adc0640 1 -- 172.21.15.50:0/1825642682 shutdown_connections 2024-09-11T22:16:30.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.121+0000 7f637adc0640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f635406be60 0x7f635406e320 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.121+0000 7f637adc0640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63740ab600 0x7f63741614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.121+0000 7f637adc0640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63740ab180 0x7f6374160fa0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.121+0000 7f637adc0640 1 --2- 172.21.15.50:0/1825642682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6360004800 0x7f637415d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.121+0000 7f637adc0640 1 -- 172.21.15.50:0/1825642682 >> 172.21.15.50:0/1825642682 conn(0x7f63740727a0 msgr2=0x7f63740679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:30.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.121+0000 7f637adc0640 1 -- 172.21.15.50:0/1825642682 shutdown_connections 2024-09-11T22:16:30.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.121+0000 7f637adc0640 1 -- 172.21.15.50:0/1825642682 wait complete. 2024-09-11T22:16:30.147 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:16:30.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.255+0000 7f4980fe8640 1 Processor -- start 2024-09-11T22:16:30.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.255+0000 7f4980fe8640 1 -- start start 2024-09-11T22:16:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.256+0000 7f4980fe8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497c15aad0 0x7f497c072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.256+0000 7f4980fe8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f497c06d780 0x7f497c0b3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.256+0000 7f4980fe8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497c0b5020 con 0x7f497c15bb00 2024-09-11T22:16:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.256+0000 7f4980fe8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f497c15aeb0 con 0x7f497c06d780 2024-09-11T22:16:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.256+0000 7f4980fe8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f497c0714d0 con 0x7f497c15aad0 2024-09-11T22:16:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.256+0000 7f4979d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f497c15bb00 0x7f497c06d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49622/0 (socket says 172.21.15.50:49622) 2024-09-11T22:16:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.256+0000 7f4979d9b640 1 -- 172.21.15.50:0/2280713748 learned_addr learned my addr 172.21.15.50:0/2280713748 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.256+0000 7f497ad9d640 1 --2- 172.21.15.50:0/2280713748 >> v2:172.21.15.77:3300/0 conn(0x7f497c06d780 0x7f497c0b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.256+0000 7f497a59c640 1 --2- 172.21.15.50:0/2280713748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497c15aad0 0x7f497c072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319642519 0 0) 0x7f497c0b5020 con 0x7f497c15bb00 2024-09-11T22:16:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4968003520 con 0x7f497c15bb00 2024-09-11T22:16:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1354784386 0 0) 0x7f4968003520 con 0x7f497c15bb00 2024-09-11T22:16:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497c15aad0 msgr2=0x7f497c072cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 --2- 172.21.15.50:0/2280713748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497c15aad0 0x7f497c072cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 >> v2:172.21.15.77:3300/0 conn(0x7f497c06d780 msgr2=0x7f497c0b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 --2- 172.21.15.50:0/2280713748 >> v2:172.21.15.77:3300/0 conn(0x7f497c06d780 0x7f497c0b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c0717b0 con 0x7f497c15bb00 2024-09-11T22:16:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f4964001670 con 0x7f497c15bb00 2024-09-11T22:16:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 >> v1:172.21.15.50:6789/0 conn(0x7f497c15bb00 legacy=0x7f497c06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 --2- 172.21.15.50:0/2280713748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49680039b0 0x7f4968003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 --2- 172.21.15.50:0/2280713748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497c15aad0 0x7f4968004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 --2- 172.21.15.50:0/2280713748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4968004d40 0x7f49680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f497c15aeb0 con 0x7f49680039b0 2024-09-11T22:16:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f497c0714d0 con 0x7f4968004d40 2024-09-11T22:16:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f496800b9c0 con 0x7f497c15aad0 2024-09-11T22:16:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497ad9d640 1 --2- 172.21.15.50:0/2280713748 >> v2:172.21.15.77:3300/0 conn(0x7f497c06d780 0x7f497c0b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497a59c640 1 --2- 172.21.15.50:0/2280713748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49680039b0 0x7f4968003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f4979d9b640 1 --2- 172.21.15.50:0/2280713748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497c15aad0 0x7f4968004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497ad9d640 1 --2- 172.21.15.50:0/2280713748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4968004d40 0x7f49680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497a59c640 1 -- 172.21.15.50:0/2280713748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497c15aad0 msgr2=0x7f4968004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497a59c640 1 --2- 172.21.15.50:0/2280713748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497c15aad0 0x7f4968004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497a59c640 1 -- 172.21.15.50:0/2280713748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4968004d40 msgr2=0x7f49680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497a59c640 1 --2- 172.21.15.50:0/2280713748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4968004d40 0x7f49680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.257+0000 7f497a59c640 1 -- 172.21.15.50:0/2280713748 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4968003520 con 0x7f49680039b0 2024-09-11T22:16:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.258+0000 7f497a59c640 1 --2- 172.21.15.50:0/2280713748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49680039b0 0x7f4968003dd0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f4974009ac0 tx=0x7f4968005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6c2d42dc6ebe33 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.258+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974036070 con 0x7f49680039b0 2024-09-11T22:16:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.258+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4974031400 con 0x7f49680039b0 2024-09-11T22:16:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.258+0000 7f497959a640 1 -- 172.21.15.50:0/2280713748 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974009690 con 0x7f49680039b0 2024-09-11T22:16:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.259+0000 7f4980fe8640 1 -- 172.21.15.50:0/2280713748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49680039b0 msgr2=0x7f4968003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.259+0000 7f4980fe8640 1 --2- 172.21.15.50:0/2280713748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49680039b0 0x7f4968003dd0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f4974009ac0 tx=0x7f4968005830 comp rx=0 tx=0).stop 2024-09-11T22:16:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.259+0000 7f497ad9d640 1 -- 172.21.15.50:0/2280713748 reap_dead start 2024-09-11T22:16:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.259+0000 7f4980fe8640 1 -- 172.21.15.50:0/2280713748 shutdown_connections 2024-09-11T22:16:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.259+0000 7f4980fe8640 1 -- 172.21.15.50:0/2280713748 >> 172.21.15.50:0/2280713748 conn(0x7f497c0679c0 msgr2=0x7f497c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.259+0000 7f4980fe8640 1 -- 172.21.15.50:0/2280713748 shutdown_connections 2024-09-11T22:16:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.259+0000 7f4980fe8640 1 -- 172.21.15.50:0/2280713748 wait complete. 2024-09-11T22:16:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.260+0000 7f4980fe8640 1 Processor -- start 2024-09-11T22:16:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.260+0000 7f4980fe8640 1 -- start start 2024-09-11T22:16:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f4980fe8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49680039b0 0x7f497c1578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f4980fe8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f497c1512c0 0x7f497c0ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f4980fe8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497c0aeab0 0x7f497c150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f4980fe8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f497c072290 con 0x7f49680039b0 2024-09-11T22:16:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f4980fe8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f497c071d70 con 0x7f497c1512c0 2024-09-11T22:16:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f4980fe8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f497c15bf20 con 0x7f497c0aeab0 2024-09-11T22:16:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f497a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49680039b0 0x7f497c1578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f497a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49680039b0 0x7f497c1578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56830/0 (socket says 172.21.15.50:56830) 2024-09-11T22:16:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f497a59c640 1 -- 172.21.15.50:0/124773066 learned_addr learned my addr 172.21.15.50:0/124773066 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f4979d9b640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f497c1512c0 0x7f497c0ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f497ad9d640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497c0aeab0 0x7f497c150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f497a59c640 1 -- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497c0aeab0 msgr2=0x7f497c150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f497a59c640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497c0aeab0 0x7f497c150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f497a59c640 1 -- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f497c1512c0 msgr2=0x7f497c0ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f497a59c640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f497c1512c0 0x7f497c0ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.261+0000 7f497a59c640 1 -- 172.21.15.50:0/124773066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c156840 con 0x7f49680039b0 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.262+0000 7f497a59c640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49680039b0 0x7f497c1578e0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f4974034040 tx=0x7f4974004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.262+0000 7f4972ffd640 1 -- 172.21.15.50:0/124773066 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974040020 con 0x7f49680039b0 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.262+0000 7f4972ffd640 1 -- 172.21.15.50:0/124773066 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4974003bc0 con 0x7f49680039b0 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.262+0000 7f4972ffd640 1 -- 172.21.15.50:0/124773066 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974036040 con 0x7f49680039b0 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.262+0000 7f4980fe8640 1 -- 172.21.15.50:0/124773066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497c156b20 con 0x7f49680039b0 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.262+0000 7f4980fe8640 1 -- 172.21.15.50:0/124773066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497c1570e0 con 0x7f49680039b0 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.263+0000 7f4980fe8640 1 -- 172.21.15.50:0/124773066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f497c072cb0 con 0x7f49680039b0 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.264+0000 7f4972ffd640 1 -- 172.21.15.50:0/124773066 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4974043020 con 0x7f49680039b0 2024-09-11T22:16:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.264+0000 7f4972ffd640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f495c06be30 0x7f495c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:30.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.264+0000 7f4972ffd640 1 -- 172.21.15.50:0/124773066 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5609+0+0 (secure 0 0 0) 0x7f49740aae30 con 0x7f49680039b0 2024-09-11T22:16:30.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.264+0000 7f4979d9b640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f495c06be30 0x7f495c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:30.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.265+0000 7f4979d9b640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f495c06be30 0x7f495c06e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f497c1516c0 tx=0x7f49640078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:30.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.269+0000 7f4972ffd640 1 -- 172.21.15.50:0/124773066 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f497404a070 con 0x7f49680039b0 2024-09-11T22:16:30.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:30.479+0000 7f4980fe8640 1 -- 172.21.15.50:0/124773066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f497c0b4360 con 0x7f49680039b0 2024-09-11T22:16:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.119+0000 7f4972ffd640 1 -- 172.21.15.50:0/124773066 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v74) ==== 174+0+0 (secure 0 0 0) 0x7f49740044e0 con 0x7f49680039b0 2024-09-11T22:16:31.120 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 14 and data pool 15 2024-09-11T22:16:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.125+0000 7f4980fe8640 1 -- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f495c06be30 msgr2=0x7f495c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.125+0000 7f4980fe8640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f495c06be30 0x7f495c06e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f497c1516c0 tx=0x7f49640078f0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.125+0000 7f4980fe8640 1 -- 172.21.15.50:0/124773066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49680039b0 msgr2=0x7f497c1578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.125+0000 7f4980fe8640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49680039b0 0x7f497c1578e0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f4974034040 tx=0x7f4974004730 comp rx=0 tx=0).stop 2024-09-11T22:16:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.127+0000 7f4980fe8640 1 -- 172.21.15.50:0/124773066 shutdown_connections 2024-09-11T22:16:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.127+0000 7f4980fe8640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f495c06be30 0x7f495c06e2f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.127+0000 7f4980fe8640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497c0aeab0 0x7f497c150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.127+0000 7f4980fe8640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f497c1512c0 0x7f497c0ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.127+0000 7f4980fe8640 1 --2- 172.21.15.50:0/124773066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49680039b0 0x7f497c1578e0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.127+0000 7f4980fe8640 1 -- 172.21.15.50:0/124773066 >> 172.21.15.50:0/124773066 conn(0x7f497c0679c0 msgr2=0x7f497c0af710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:31.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.133+0000 7f4980fe8640 1 -- 172.21.15.50:0/124773066 shutdown_connections 2024-09-11T22:16:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.137+0000 7f4980fe8640 1 -- 172.21.15.50:0/124773066 wait complete. 2024-09-11T22:16:31.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:16:31.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.269+0000 7f068c79f640 1 Processor -- start 2024-09-11T22:16:31.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.269+0000 7f068c79f640 1 -- start start 2024-09-11T22:16:31.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.270+0000 7f068c79f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06841463b0 0x7f06840cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.270+0000 7f068c79f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f068415db60 0x7f06840cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.270+0000 7f068c79f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0684072630 con 0x7f06840d0180 2024-09-11T22:16:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.270+0000 7f068c79f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f06840d0670 con 0x7f06841463b0 2024-09-11T22:16:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.270+0000 7f068c79f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0684146790 con 0x7f068415db60 2024-09-11T22:16:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.270+0000 7f068ad3c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f06840d0180 0x7f06840b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49628/0 (socket says 172.21.15.50:49628) 2024-09-11T22:16:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.270+0000 7f068ad3c640 1 -- 172.21.15.50:0/507710945 learned_addr learned my addr 172.21.15.50:0/507710945 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.270+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 268379125 0 0) 0x7f0684072630 con 0x7f06840d0180 2024-09-11T22:16:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.270+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f066c003520 con 0x7f06840d0180 2024-09-11T22:16:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.270+0000 7f0689d3a640 1 --2- 172.21.15.50:0/507710945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f068415db60 0x7f06840cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.270+0000 7f068a53b640 1 --2- 172.21.15.50:0/507710945 >> v2:172.21.15.77:3300/0 conn(0x7f06841463b0 0x7f06840cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1510078648 0 0) 0x7f066c003520 con 0x7f06840d0180 2024-09-11T22:16:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f068415db60 msgr2=0x7f06840cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 --2- 172.21.15.50:0/507710945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f068415db60 0x7f06840cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 >> v2:172.21.15.77:3300/0 conn(0x7f06841463b0 msgr2=0x7f06840cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 --2- 172.21.15.50:0/507710945 >> v2:172.21.15.77:3300/0 conn(0x7f06841463b0 0x7f06840cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06840728d0 con 0x7f06840d0180 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f06740019f0 con 0x7f06840d0180 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 >> v1:172.21.15.50:6789/0 conn(0x7f06840d0180 legacy=0x7f06840b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 --2- 172.21.15.50:0/507710945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f068415db60 0x7f066c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 --2- 172.21.15.50:0/507710945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066c003f30 0x7f066c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 --2- 172.21.15.50:0/507710945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f066c004d40 0x7f066c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f06840d0670 con 0x7f066c004d40 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0684146790 con 0x7f066c003f30 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f066c00b9c0 con 0x7f068415db60 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f068ad3c640 1 --2- 172.21.15.50:0/507710945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f066c004d40 0x7f066c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f068a53b640 1 --2- 172.21.15.50:0/507710945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f068415db60 0x7f066c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f0689d3a640 1 --2- 172.21.15.50:0/507710945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066c003f30 0x7f066c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f068ad3c640 1 -- 172.21.15.50:0/507710945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f068415db60 msgr2=0x7f066c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f068ad3c640 1 --2- 172.21.15.50:0/507710945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f068415db60 0x7f066c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f068ad3c640 1 -- 172.21.15.50:0/507710945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066c003f30 msgr2=0x7f066c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f068ad3c640 1 --2- 172.21.15.50:0/507710945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066c003f30 0x7f066c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.271+0000 7f068ad3c640 1 -- 172.21.15.50:0/507710945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066c003520 con 0x7f066c004d40 2024-09-11T22:16:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.272+0000 7f068ad3c640 1 --2- 172.21.15.50:0/507710945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f066c004d40 0x7f066c0051c0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f067400a870 tx=0x7f066c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d53e29f8737d266 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.272+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067400a4c0 con 0x7f066c004d40 2024-09-11T22:16:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.272+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067402f070 con 0x7f066c004d40 2024-09-11T22:16:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.272+0000 7f0689539640 1 -- 172.21.15.50:0/507710945 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067402bcb0 con 0x7f066c004d40 2024-09-11T22:16:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.272+0000 7f068c79f640 1 -- 172.21.15.50:0/507710945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f066c004d40 msgr2=0x7f066c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.272+0000 7f068c79f640 1 --2- 172.21.15.50:0/507710945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f066c004d40 0x7f066c0051c0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f067400a870 tx=0x7f066c005830 comp rx=0 tx=0).stop 2024-09-11T22:16:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.272+0000 7f068ad3c640 1 -- 172.21.15.50:0/507710945 reap_dead start 2024-09-11T22:16:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.273+0000 7f068c79f640 1 -- 172.21.15.50:0/507710945 shutdown_connections 2024-09-11T22:16:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.273+0000 7f068c79f640 1 -- 172.21.15.50:0/507710945 >> 172.21.15.50:0/507710945 conn(0x7f0684068240 msgr2=0x7f06840b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.273+0000 7f068c79f640 1 -- 172.21.15.50:0/507710945 shutdown_connections 2024-09-11T22:16:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.273+0000 7f068c79f640 1 -- 172.21.15.50:0/507710945 wait complete. 2024-09-11T22:16:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.274+0000 7f068c79f640 1 Processor -- start 2024-09-11T22:16:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.274+0000 7f068c79f640 1 -- start start 2024-09-11T22:16:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.274+0000 7f068c79f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066c004d40 0x7f068415c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068c79f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06841418c0 0x7f0684160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068c79f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0684141d40 0x7f0684160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068c79f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f06840733b0 con 0x7f0684141d40 2024-09-11T22:16:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068c79f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0684072f20 con 0x7f066c004d40 2024-09-11T22:16:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068c79f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0684073530 con 0x7f06841418c0 2024-09-11T22:16:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068ad3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0684141d40 0x7f0684160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068ad3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0684141d40 0x7f0684160ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56848/0 (socket says 172.21.15.50:56848) 2024-09-11T22:16:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068ad3c640 1 -- 172.21.15.50:0/3580841262 learned_addr learned my addr 172.21.15.50:0/3580841262 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f0689d3a640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06841418c0 0x7f0684160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068a53b640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066c004d40 0x7f068415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068ad3c640 1 -- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06841418c0 msgr2=0x7f0684160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068ad3c640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06841418c0 0x7f0684160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068ad3c640 1 -- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066c004d40 msgr2=0x7f068415c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068ad3c640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066c004d40 0x7f068415c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068ad3c640 1 -- 172.21.15.50:0/3580841262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0684140820 con 0x7f0684141d40 2024-09-11T22:16:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068ad3c640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0684141d40 0x7f0684160ca0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f067400a870 tx=0x7f0674001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f0682ffd640 1 -- 172.21.15.50:0/3580841262 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674002030 con 0x7f0684141d40 2024-09-11T22:16:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f0682ffd640 1 -- 172.21.15.50:0/3580841262 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0674034880 con 0x7f0684141d40 2024-09-11T22:16:31.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068c79f640 1 -- 172.21.15.50:0/3580841262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0684140b00 con 0x7f0684141d40 2024-09-11T22:16:31.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f0682ffd640 1 -- 172.21.15.50:0/3580841262 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674034c30 con 0x7f0684141d40 2024-09-11T22:16:31.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.275+0000 7f068c79f640 1 -- 172.21.15.50:0/3580841262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06841410c0 con 0x7f0684141d40 2024-09-11T22:16:31.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.277+0000 7f068c79f640 1 -- 172.21.15.50:0/3580841262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06840cfc40 con 0x7f0684141d40 2024-09-11T22:16:31.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.277+0000 7f0682ffd640 1 -- 172.21.15.50:0/3580841262 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0674007070 con 0x7f0684141d40 2024-09-11T22:16:31.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.278+0000 7f0682ffd640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f067006be30 0x7f067006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.278+0000 7f0682ffd640 1 -- 172.21.15.50:0/3580841262 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f06740ab2a0 con 0x7f0684141d40 2024-09-11T22:16:31.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.278+0000 7f068a53b640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f067006be30 0x7f067006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.278+0000 7f068a53b640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f067006be30 0x7f067006e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f067c009c40 tx=0x7f067c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.282+0000 7f0682ffd640 1 -- 172.21.15.50:0/3580841262 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0674046060 con 0x7f0684141d40 2024-09-11T22:16:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.460+0000 7f068c79f640 1 -- 172.21.15.50:0/3580841262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06840b55b0 con 0x7f0684141d40 2024-09-11T22:16:31.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.461+0000 7f0682ffd640 1 -- 172.21.15.50:0/3580841262 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+16656 (secure 0 0 0) 0x7f067403e340 con 0x7f0684141d40 2024-09-11T22:16:31.462 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:31.462 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":106,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:16:30.480479+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:16:28.139569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-11T22:16:29.474681+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:16:31.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.464+0000 7f068c79f640 1 -- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f067006be30 msgr2=0x7f067006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.464+0000 7f068c79f640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f067006be30 0x7f067006e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f067c009c40 tx=0x7f067c009190 comp rx=0 tx=0).stop 2024-09-11T22:16:31.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.464+0000 7f068c79f640 1 -- 172.21.15.50:0/3580841262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0684141d40 msgr2=0x7f0684160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.464+0000 7f068c79f640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0684141d40 0x7f0684160ca0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f067400a870 tx=0x7f0674001360 comp rx=0 tx=0).stop 2024-09-11T22:16:31.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.464+0000 7f068c79f640 1 -- 172.21.15.50:0/3580841262 shutdown_connections 2024-09-11T22:16:31.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.464+0000 7f068c79f640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f067006be30 0x7f067006e2f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.464+0000 7f068c79f640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06841418c0 0x7f0684160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.464+0000 7f068c79f640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0684141d40 0x7f0684160ca0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.464+0000 7f068c79f640 1 --2- 172.21.15.50:0/3580841262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066c004d40 0x7f068415c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.464+0000 7f068c79f640 1 -- 172.21.15.50:0/3580841262 >> 172.21.15.50:0/3580841262 conn(0x7f0684068240 msgr2=0x7f06840b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:31.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.464+0000 7f068c79f640 1 -- 172.21.15.50:0/3580841262 shutdown_connections 2024-09-11T22:16:31.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.464+0000 7f068c79f640 1 -- 172.21.15.50:0/3580841262 wait complete. 2024-09-11T22:16:31.477 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:16:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.578+0000 7f126c40e640 1 Processor -- start 2024-09-11T22:16:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.578+0000 7f126c40e640 1 -- start start 2024-09-11T22:16:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.579+0000 7f126c40e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f126415e840 0x7f12640b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.579+0000 7f126c40e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12640cf580 0x7f126406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.579+0000 7f126c40e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12640ce5f0 con 0x7f12640cdd50 2024-09-11T22:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.579+0000 7f126c40e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f126406c240 con 0x7f12640cf580 2024-09-11T22:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.579+0000 7f126c40e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f12640d0470 con 0x7f126415e840 2024-09-11T22:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.579+0000 7f126a9ab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12640cf580 0x7f126406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.579+0000 7f126a9ab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12640cf580 0x7f126406c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56858/0 (socket says 172.21.15.50:56858) 2024-09-11T22:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.579+0000 7f126a9ab640 1 -- 172.21.15.50:0/567910284 learned_addr learned my addr 172.21.15.50:0/567910284 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.579+0000 7f126a1aa640 1 --2- 172.21.15.50:0/567910284 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f126415e840 0x7f12640b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.580+0000 7f126a9ab640 1 -- 172.21.15.50:0/567910284 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f126415e840 msgr2=0x7f12640b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.580+0000 7f126a9ab640 1 --2- 172.21.15.50:0/567910284 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f126415e840 0x7f12640b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.580+0000 7f126a9ab640 1 -- 172.21.15.50:0/567910284 >> v1:172.21.15.77:6789/0 conn(0x7f12640cdd50 legacy=0x7f12640cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.580+0000 7f126a9ab640 1 -- 172.21.15.50:0/567910284 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12640ce310 con 0x7f12640cf580 2024-09-11T22:16:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.580+0000 7f126a9ab640 1 --2- 172.21.15.50:0/567910284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12640cf580 0x7f126406c6d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f125c009870 tx=0x7f125c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ff1da4a5eb1086 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.580+0000 7f12691a8640 1 -- 172.21.15.50:0/567910284 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c037070 con 0x7f12640cf580 2024-09-11T22:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.581+0000 7f12691a8640 1 -- 172.21.15.50:0/567910284 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c032440 con 0x7f12640cf580 2024-09-11T22:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.581+0000 7f12691a8640 1 -- 172.21.15.50:0/567910284 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c032810 con 0x7f12640cf580 2024-09-11T22:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.581+0000 7f126c40e640 1 -- 172.21.15.50:0/567910284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12640cf580 msgr2=0x7f126406c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.581+0000 7f126c40e640 1 --2- 172.21.15.50:0/567910284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12640cf580 0x7f126406c6d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f125c009870 tx=0x7f125c02a210 comp rx=0 tx=0).stop 2024-09-11T22:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.581+0000 7f126c40e640 1 -- 172.21.15.50:0/567910284 shutdown_connections 2024-09-11T22:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.581+0000 7f126c40e640 1 --2- 172.21.15.50:0/567910284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12640cf580 0x7f126406c6d0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.581+0000 7f126c40e640 1 --2- 172.21.15.50:0/567910284 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f126415e840 0x7f12640b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.581+0000 7f126c40e640 1 -- 172.21.15.50:0/567910284 >> 172.21.15.50:0/567910284 conn(0x7f12640b4150 msgr2=0x7f12640b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.581+0000 7f126c40e640 1 -- 172.21.15.50:0/567910284 shutdown_connections 2024-09-11T22:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.581+0000 7f126c40e640 1 -- 172.21.15.50:0/567910284 wait complete. 2024-09-11T22:16:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.582+0000 7f126c40e640 1 Processor -- start 2024-09-11T22:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.582+0000 7f126c40e640 1 -- start start 2024-09-11T22:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.583+0000 7f126c40e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12640cdd50 0x7f12641f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.583+0000 7f126c40e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12640cf580 0x7f12640b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.583+0000 7f126c40e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f126415e840 0x7f12640c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.583+0000 7f126c40e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f126415ec20 con 0x7f12640cdd50 2024-09-11T22:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.583+0000 7f126c40e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f126406bed0 con 0x7f126415e840 2024-09-11T22:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.583+0000 7f126c40e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f126415eda0 con 0x7f12640cf580 2024-09-11T22:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.583+0000 7f126a1aa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12640cdd50 0x7f12641f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.583+0000 7f126a1aa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12640cdd50 0x7f12641f7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56874/0 (socket says 172.21.15.50:56874) 2024-09-11T22:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.583+0000 7f126a1aa640 1 -- 172.21.15.50:0/781871965 learned_addr learned my addr 172.21.15.50:0/781871965 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.583+0000 7f126a9ab640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f126415e840 0x7f12640c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.583+0000 7f12699a9640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12640cf580 0x7f12640b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.584+0000 7f126a1aa640 1 -- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12640cf580 msgr2=0x7f12640b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.584+0000 7f126a1aa640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12640cf580 0x7f12640b6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.584+0000 7f126a1aa640 1 -- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f126415e840 msgr2=0x7f12640c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.584+0000 7f126a1aa640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f126415e840 0x7f12640c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.584+0000 7f126a1aa640 1 -- 172.21.15.50:0/781871965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12640b7760 con 0x7f12640cdd50 2024-09-11T22:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.584+0000 7f12699a9640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12640cf580 0x7f12640b6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.584+0000 7f126a9ab640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f126415e840 0x7f12640c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.584+0000 7f126a1aa640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12640cdd50 0x7f12641f7160 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f1260007e40 tx=0x7f126000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.584+0000 7f125affd640 1 -- 172.21.15.50:0/781871965 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260014620 con 0x7f12640cdd50 2024-09-11T22:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.584+0000 7f125affd640 1 -- 172.21.15.50:0/781871965 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1260019070 con 0x7f12640cdd50 2024-09-11T22:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.584+0000 7f126c40e640 1 -- 172.21.15.50:0/781871965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12640b7a40 con 0x7f12640cdd50 2024-09-11T22:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.584+0000 7f125affd640 1 -- 172.21.15.50:0/781871965 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260014a00 con 0x7f12640cdd50 2024-09-11T22:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.584+0000 7f126c40e640 1 -- 172.21.15.50:0/781871965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12640b8000 con 0x7f12640cdd50 2024-09-11T22:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.585+0000 7f126c40e640 1 -- 172.21.15.50:0/781871965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12640b4c70 con 0x7f12640cdd50 2024-09-11T22:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.586+0000 7f125affd640 1 -- 172.21.15.50:0/781871965 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1260014ba0 con 0x7f12640cdd50 2024-09-11T22:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.586+0000 7f125affd640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f124806be30 0x7f124806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.586+0000 7f125affd640 1 -- 172.21.15.50:0/781871965 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f126008b660 con 0x7f12640cdd50 2024-09-11T22:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.586+0000 7f12699a9640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f124806be30 0x7f124806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.587+0000 7f12699a9640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f124806be30 0x7f124806e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f12640c9c50 tx=0x7f1254009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.591+0000 7f125affd640 1 -- 172.21.15.50:0/781871965 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f126005a0a0 con 0x7f12640cdd50 2024-09-11T22:16:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.767+0000 7f126c40e640 1 -- 172.21.15.50:0/781871965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12640cfbb0 con 0x7f12640cdd50 2024-09-11T22:16:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.768+0000 7f125affd640 1 -- 172.21.15.50:0/781871965 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+16656 (secure 0 0 0) 0x7f12600599a0 con 0x7f12640cdd50 2024-09-11T22:16:31.769 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:31.770 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":106,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:16:30.480479+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:16:28.139569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-11T22:16:29.474681+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:16:31.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.771+0000 7f126c40e640 1 -- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f124806be30 msgr2=0x7f124806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.771+0000 7f126c40e640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f124806be30 0x7f124806e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f12640c9c50 tx=0x7f1254009040 comp rx=0 tx=0).stop 2024-09-11T22:16:31.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.771+0000 7f126c40e640 1 -- 172.21.15.50:0/781871965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12640cdd50 msgr2=0x7f12641f7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.771+0000 7f126c40e640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12640cdd50 0x7f12641f7160 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f1260007e40 tx=0x7f126000e4b0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.771+0000 7f126c40e640 1 -- 172.21.15.50:0/781871965 shutdown_connections 2024-09-11T22:16:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.771+0000 7f126c40e640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f124806be30 0x7f124806e2f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.771+0000 7f126c40e640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12640cf580 0x7f12640b6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.771+0000 7f126c40e640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f126415e840 0x7f12640c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.771+0000 7f126c40e640 1 --2- 172.21.15.50:0/781871965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12640cdd50 0x7f12641f7160 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.771+0000 7f126c40e640 1 -- 172.21.15.50:0/781871965 >> 172.21.15.50:0/781871965 conn(0x7f12640b4150 msgr2=0x7f12640d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.771+0000 7f126c40e640 1 -- 172.21.15.50:0/781871965 shutdown_connections 2024-09-11T22:16:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.771+0000 7f126c40e640 1 -- 172.21.15.50:0/781871965 wait complete. 2024-09-11T22:16:31.783 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:16:31.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.887+0000 7f4cfc880640 1 Processor -- start 2024-09-11T22:16:31.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.887+0000 7f4cfc880640 1 -- start start 2024-09-11T22:16:31.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4cfc880640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4cf815fb60 0x7f4cf80b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4cfc880640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4cf80d0150 0x7f4cf80d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4cfc880640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf80d1290 con 0x7f4cf80d0e00 2024-09-11T22:16:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4cfc880640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf80cf510 con 0x7f4cf80d0150 2024-09-11T22:16:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4cfc880640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf80cfdb0 con 0x7f4cf815fb60 2024-09-11T22:16:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4cf6d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4cf80d0e00 0x7f4cf80cd090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49630/0 (socket says 172.21.15.50:49630) 2024-09-11T22:16:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4cf6d9d640 1 -- 172.21.15.50:0/4126450176 learned_addr learned my addr 172.21.15.50:0/4126450176 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4ceffff640 1 --2- 172.21.15.50:0/4126450176 >> v2:172.21.15.77:3300/0 conn(0x7f4cf80d0150 0x7f4cf80d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4cf659c640 1 --2- 172.21.15.50:0/4126450176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4cf815fb60 0x7f4cf80b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4cf5d9b640 1 -- 172.21.15.50:0/4126450176 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77064846 0 0) 0x7f4cf80d1290 con 0x7f4cf80d0e00 2024-09-11T22:16:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4cf5d9b640 1 -- 172.21.15.50:0/4126450176 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ce4003520 con 0x7f4cf80d0e00 2024-09-11T22:16:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4ceffff640 1 -- 172.21.15.50:0/4126450176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4cf815fb60 msgr2=0x7f4cf80b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4ceffff640 1 --2- 172.21.15.50:0/4126450176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4cf815fb60 0x7f4cf80b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4ceffff640 1 -- 172.21.15.50:0/4126450176 >> v1:172.21.15.50:6789/0 conn(0x7f4cf80d0e00 legacy=0x7f4cf80cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4ceffff640 1 -- 172.21.15.50:0/4126450176 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf815ff40 con 0x7f4cf80d0150 2024-09-11T22:16:31.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.888+0000 7f4cf659c640 1 --2- 172.21.15.50:0/4126450176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4cf815fb60 0x7f4cf80b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:31.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.889+0000 7f4ceffff640 1 --2- 172.21.15.50:0/4126450176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf80d0150 0x7f4cf80d08c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00097a0 tx=0x7f4ce002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1d5aeb6802f4bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:31.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.889+0000 7f4cf5d9b640 1 -- 172.21.15.50:0/4126450176 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0037070 con 0x7f4cf80d0150 2024-09-11T22:16:31.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.889+0000 7f4cf5d9b640 1 -- 172.21.15.50:0/4126450176 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce002ae50 con 0x7f4cf80d0150 2024-09-11T22:16:31.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.889+0000 7f4cf5d9b640 1 -- 172.21.15.50:0/4126450176 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0032640 con 0x7f4cf80d0150 2024-09-11T22:16:31.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.890+0000 7f4cfc880640 1 -- 172.21.15.50:0/4126450176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf80d0150 msgr2=0x7f4cf80d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.890+0000 7f4cfc880640 1 --2- 172.21.15.50:0/4126450176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf80d0150 0x7f4cf80d08c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00097a0 tx=0x7f4ce002a100 comp rx=0 tx=0).stop 2024-09-11T22:16:31.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.890+0000 7f4cfc880640 1 -- 172.21.15.50:0/4126450176 shutdown_connections 2024-09-11T22:16:31.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.890+0000 7f4cfc880640 1 --2- 172.21.15.50:0/4126450176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf80d0150 0x7f4cf80d08c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.890+0000 7f4cfc880640 1 --2- 172.21.15.50:0/4126450176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4cf815fb60 0x7f4cf80b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.890+0000 7f4cfc880640 1 -- 172.21.15.50:0/4126450176 >> 172.21.15.50:0/4126450176 conn(0x7f4cf80b4150 msgr2=0x7f4cf80b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:31.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.890+0000 7f4cfc880640 1 -- 172.21.15.50:0/4126450176 shutdown_connections 2024-09-11T22:16:31.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.890+0000 7f4cfc880640 1 -- 172.21.15.50:0/4126450176 wait complete. 2024-09-11T22:16:31.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.891+0000 7f4cfc880640 1 Processor -- start 2024-09-11T22:16:31.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.891+0000 7f4cfc880640 1 -- start start 2024-09-11T22:16:31.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.892+0000 7f4cfc880640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4cf80d0e00 0x7f4cf8156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.892+0000 7f4cfc880640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf815fb60 0x7f4cf80b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.892+0000 7f4cfc880640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf80b8240 0x7f4cf80caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.892+0000 7f4cfc880640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf80cfa40 con 0x7f4cf80b8240 2024-09-11T22:16:31.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.892+0000 7f4cfc880640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf80cf760 con 0x7f4cf815fb60 2024-09-11T22:16:31.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.892+0000 7f4cfc880640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf80b1930 con 0x7f4cf80d0e00 2024-09-11T22:16:31.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.892+0000 7f4cf6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf80b8240 0x7f4cf80caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.892+0000 7f4cf6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf80b8240 0x7f4cf80caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56884/0 (socket says 172.21.15.50:56884) 2024-09-11T22:16:31.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.892+0000 7f4cf6d9d640 1 -- 172.21.15.50:0/3583176143 learned_addr learned my addr 172.21.15.50:0/3583176143 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:31.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.893+0000 7f4ceffff640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf815fb60 0x7f4cf80b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.893+0000 7f4cf659c640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4cf80d0e00 0x7f4cf8156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.893+0000 7f4cf6d9d640 1 -- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4cf80d0e00 msgr2=0x7f4cf8156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.893+0000 7f4cf6d9d640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4cf80d0e00 0x7f4cf8156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.893+0000 7f4cf6d9d640 1 -- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf815fb60 msgr2=0x7f4cf80b7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.893+0000 7f4cf6d9d640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf815fb60 0x7f4cf80b7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.893+0000 7f4cf6d9d640 1 -- 172.21.15.50:0/3583176143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf80b56a0 con 0x7f4cf80b8240 2024-09-11T22:16:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.893+0000 7f4cf6d9d640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf80b8240 0x7f4cf80caa30 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000cb70 tx=0x7f4cf000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.893+0000 7f4ceeffd640 1 -- 172.21.15.50:0/3583176143 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0017070 con 0x7f4cf80b8240 2024-09-11T22:16:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.893+0000 7f4ceeffd640 1 -- 172.21.15.50:0/3583176143 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf000ad40 con 0x7f4cf80b8240 2024-09-11T22:16:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.893+0000 7f4cfc880640 1 -- 172.21.15.50:0/3583176143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf80b5980 con 0x7f4cf80b8240 2024-09-11T22:16:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.893+0000 7f4ceeffd640 1 -- 172.21.15.50:0/3583176143 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0012620 con 0x7f4cf80b8240 2024-09-11T22:16:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.893+0000 7f4cfc880640 1 -- 172.21.15.50:0/3583176143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf80b5f40 con 0x7f4cf80b8240 2024-09-11T22:16:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.894+0000 7f4cfc880640 1 -- 172.21.15.50:0/3583176143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf80d08c0 con 0x7f4cf80b8240 2024-09-11T22:16:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.895+0000 7f4ceeffd640 1 -- 172.21.15.50:0/3583176143 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cf001a070 con 0x7f4cf80b8240 2024-09-11T22:16:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.895+0000 7f4ceeffd640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4cd806be30 0x7f4cd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.895+0000 7f4ceeffd640 1 -- 172.21.15.50:0/3583176143 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f4cf008aca0 con 0x7f4cf80b8240 2024-09-11T22:16:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.895+0000 7f4cf659c640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4cd806be30 0x7f4cd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.896+0000 7f4cf659c640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4cd806be30 0x7f4cd806e2f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009560 tx=0x7f4ce8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:31.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:31.900+0000 7f4ceeffd640 1 -- 172.21.15.50:0/3583176143 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4cf00596e0 con 0x7f4cf80b8240 2024-09-11T22:16:32.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.111+0000 7f4cfc880640 1 -- 172.21.15.50:0/3583176143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4cf81590f0 con 0x7f4cf80b8240 2024-09-11T22:16:32.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.130+0000 7f4ceeffd640 1 -- 172.21.15.50:0/3583176143 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) ==== 118+0+0 (secure 0 0 0) 0x7f4cf0058fe0 con 0x7f4cf80b8240 2024-09-11T22:16:32.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.133+0000 7f4cfc880640 1 -- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4cd806be30 msgr2=0x7f4cd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:32.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.133+0000 7f4cfc880640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4cd806be30 0x7f4cd806e2f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009560 tx=0x7f4ce8008040 comp rx=0 tx=0).stop 2024-09-11T22:16:32.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.133+0000 7f4cfc880640 1 -- 172.21.15.50:0/3583176143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf80b8240 msgr2=0x7f4cf80caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:32.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.133+0000 7f4cfc880640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf80b8240 0x7f4cf80caa30 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000cb70 tx=0x7f4cf000a430 comp rx=0 tx=0).stop 2024-09-11T22:16:32.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.133+0000 7f4cfc880640 1 -- 172.21.15.50:0/3583176143 shutdown_connections 2024-09-11T22:16:32.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.133+0000 7f4cfc880640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4cd806be30 0x7f4cd806e2f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:32.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.133+0000 7f4cfc880640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cf80b8240 0x7f4cf80caa30 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:32.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.133+0000 7f4cfc880640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf815fb60 0x7f4cf80b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:32.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.133+0000 7f4cfc880640 1 --2- 172.21.15.50:0/3583176143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4cf80d0e00 0x7f4cf8156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:32.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.133+0000 7f4cfc880640 1 -- 172.21.15.50:0/3583176143 >> 172.21.15.50:0/3583176143 conn(0x7f4cf80b4150 msgr2=0x7f4cf80cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:32.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.133+0000 7f4cfc880640 1 -- 172.21.15.50:0/3583176143 shutdown_connections 2024-09-11T22:16:32.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.134+0000 7f4cfc880640 1 -- 172.21.15.50:0/3583176143 wait complete. 2024-09-11T22:16:32.145 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:16:32.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:16:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.250+0000 7f108129b640 1 Processor -- start 2024-09-11T22:16:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.250+0000 7f108129b640 1 -- start start 2024-09-11T22:16:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.251+0000 7f108129b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f107c15b400 0x7f107c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.251+0000 7f108129b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f107c072e60 0x7f107c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.251+0000 7f108129b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f107c15b7e0 con 0x7f107c06df20 2024-09-11T22:16:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.251+0000 7f108129b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f107c15f140 con 0x7f107c15b400 2024-09-11T22:16:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.251+0000 7f108129b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f107c15f420 con 0x7f107c072e60 2024-09-11T22:16:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.251+0000 7f107affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f107c15b400 0x7f107c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.251+0000 7f107a7fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f107c072e60 0x7f107c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.251+0000 7f107b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f107c06df20 0x7f107c0b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:42194/0 (socket says 172.21.15.50:42194) 2024-09-11T22:16:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.251+0000 7f107b7fe640 1 -- 172.21.15.50:0/3788808106 learned_addr learned my addr 172.21.15.50:0/3788808106 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.252+0000 7f1079ffb640 1 -- 172.21.15.50:0/3788808106 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840150288 0 0) 0x7f107c15b7e0 con 0x7f107c06df20 2024-09-11T22:16:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.252+0000 7f1079ffb640 1 -- 172.21.15.50:0/3788808106 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1064003520 con 0x7f107c06df20 2024-09-11T22:16:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.252+0000 7f107a7fc640 1 -- 172.21.15.50:0/3788808106 >> v2:172.21.15.77:3300/0 conn(0x7f107c15b400 msgr2=0x7f107c06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.252+0000 7f107a7fc640 1 --2- 172.21.15.50:0/3788808106 >> v2:172.21.15.77:3300/0 conn(0x7f107c15b400 0x7f107c06d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.252+0000 7f107a7fc640 1 -- 172.21.15.50:0/3788808106 >> v1:172.21.15.77:6789/0 conn(0x7f107c06df20 legacy=0x7f107c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.252+0000 7f107a7fc640 1 -- 172.21.15.50:0/3788808106 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c15f700 con 0x7f107c072e60 2024-09-11T22:16:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.252+0000 7f107affd640 1 --2- 172.21.15.50:0/3788808106 >> v2:172.21.15.77:3300/0 conn(0x7f107c15b400 0x7f107c06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.252+0000 7f107a7fc640 1 --2- 172.21.15.50:0/3788808106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f107c072e60 0x7f107c06d9e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f10700097a0 tx=0x7f107002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=946d8c02f65265a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.253+0000 7f1079ffb640 1 -- 172.21.15.50:0/3788808106 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070037070 con 0x7f107c072e60 2024-09-11T22:16:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.253+0000 7f1079ffb640 1 -- 172.21.15.50:0/3788808106 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1070032440 con 0x7f107c072e60 2024-09-11T22:16:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.253+0000 7f1079ffb640 1 -- 172.21.15.50:0/3788808106 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10700327f0 con 0x7f107c072e60 2024-09-11T22:16:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.253+0000 7f108129b640 1 -- 172.21.15.50:0/3788808106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f107c072e60 msgr2=0x7f107c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.253+0000 7f108129b640 1 --2- 172.21.15.50:0/3788808106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f107c072e60 0x7f107c06d9e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f10700097a0 tx=0x7f107002a180 comp rx=0 tx=0).stop 2024-09-11T22:16:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.253+0000 7f108129b640 1 -- 172.21.15.50:0/3788808106 shutdown_connections 2024-09-11T22:16:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.253+0000 7f108129b640 1 --2- 172.21.15.50:0/3788808106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f107c072e60 0x7f107c06d9e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.253+0000 7f108129b640 1 --2- 172.21.15.50:0/3788808106 >> v2:172.21.15.77:3300/0 conn(0x7f107c15b400 0x7f107c06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.253+0000 7f108129b640 1 -- 172.21.15.50:0/3788808106 >> 172.21.15.50:0/3788808106 conn(0x7f107c0679c0 msgr2=0x7f107c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.253+0000 7f108129b640 1 -- 172.21.15.50:0/3788808106 shutdown_connections 2024-09-11T22:16:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.253+0000 7f108129b640 1 -- 172.21.15.50:0/3788808106 wait complete. 2024-09-11T22:16:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.255+0000 7f108129b640 1 Processor -- start 2024-09-11T22:16:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.255+0000 7f108129b640 1 -- start start 2024-09-11T22:16:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.255+0000 7f108129b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f107c06df20 0x7f107c0add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.255+0000 7f108129b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107c072e60 0x7f107c0ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.255+0000 7f108129b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f107c15b400 0x7f107c0abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.255+0000 7f108129b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f107c0721d0 con 0x7f107c072e60 2024-09-11T22:16:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.255+0000 7f108129b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f107c0cfc50 con 0x7f107c06df20 2024-09-11T22:16:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.255+0000 7f108129b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f107c072350 con 0x7f107c15b400 2024-09-11T22:16:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.255+0000 7f107a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107c072e60 0x7f107c0ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.255+0000 7f107a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107c072e60 0x7f107c0ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56890/0 (socket says 172.21.15.50:56890) 2024-09-11T22:16:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f107a7fc640 1 -- 172.21.15.50:0/195011045 learned_addr learned my addr 172.21.15.50:0/195011045 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f107affd640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f107c06df20 0x7f107c0add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f107b7fe640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f107c15b400 0x7f107c0abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f107a7fc640 1 -- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f107c15b400 msgr2=0x7f107c0abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f107a7fc640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f107c15b400 0x7f107c0abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f107a7fc640 1 -- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f107c06df20 msgr2=0x7f107c0add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f107a7fc640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f107c06df20 0x7f107c0add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f107a7fc640 1 -- 172.21.15.50:0/195011045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c0ae880 con 0x7f107c072e60 2024-09-11T22:16:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f107a7fc640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107c072e60 0x7f107c0ae270 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f1070000c00 tx=0x7f10700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f10637fe640 1 -- 172.21.15.50:0/195011045 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070037050 con 0x7f107c072e60 2024-09-11T22:16:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f10637fe640 1 -- 172.21.15.50:0/195011045 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1070043070 con 0x7f107c072e60 2024-09-11T22:16:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f108129b640 1 -- 172.21.15.50:0/195011045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107c0aeb60 con 0x7f107c072e60 2024-09-11T22:16:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f10637fe640 1 -- 172.21.15.50:0/195011045 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070032a10 con 0x7f107c072e60 2024-09-11T22:16:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.256+0000 7f108129b640 1 -- 172.21.15.50:0/195011045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107c0af120 con 0x7f107c072e60 2024-09-11T22:16:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.257+0000 7f108129b640 1 -- 172.21.15.50:0/195011045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107c0687f0 con 0x7f107c072e60 2024-09-11T22:16:32.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.258+0000 7f10637fe640 1 -- 172.21.15.50:0/195011045 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1070032bb0 con 0x7f107c072e60 2024-09-11T22:16:32.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.258+0000 7f10637fe640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f106806be30 0x7f106806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:32.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.258+0000 7f10637fe640 1 -- 172.21.15.50:0/195011045 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f10700aba90 con 0x7f107c072e60 2024-09-11T22:16:32.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.259+0000 7f107affd640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f106806be30 0x7f106806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:32.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.259+0000 7f107affd640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f106806be30 0x7f106806e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f107c1556b0 tx=0x7f106c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:32.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.263+0000 7f10637fe640 1 -- 172.21.15.50:0/195011045 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f107c0687f0 con 0x7f107c072e60 2024-09-11T22:16:32.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:32.474+0000 7f108129b640 1 -- 172.21.15.50:0/195011045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f107c06d9e0 con 0x7f107c072e60 2024-09-11T22:16:32.878 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-11T22:16:32.878 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-11T22:16:32.878 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-11T22:16:32.878 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-11T22:16:33.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.131+0000 7f10637fe640 1 -- 172.21.15.50:0/195011045 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) ==== 122+0+0 (secure 0 0 0) 0x7f1070003e20 con 0x7f107c072e60 2024-09-11T22:16:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.134+0000 7f108129b640 1 -- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f106806be30 msgr2=0x7f106806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.134+0000 7f108129b640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f106806be30 0x7f106806e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f107c1556b0 tx=0x7f106c009190 comp rx=0 tx=0).stop 2024-09-11T22:16:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.134+0000 7f108129b640 1 -- 172.21.15.50:0/195011045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107c072e60 msgr2=0x7f107c0ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.134+0000 7f108129b640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107c072e60 0x7f107c0ae270 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f1070000c00 tx=0x7f10700046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.134+0000 7f108129b640 1 -- 172.21.15.50:0/195011045 shutdown_connections 2024-09-11T22:16:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.134+0000 7f108129b640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f106806be30 0x7f106806e2f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.134+0000 7f108129b640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f107c15b400 0x7f107c0abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.134+0000 7f108129b640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107c072e60 0x7f107c0ae270 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.134+0000 7f108129b640 1 --2- 172.21.15.50:0/195011045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f107c06df20 0x7f107c0add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.134+0000 7f108129b640 1 -- 172.21.15.50:0/195011045 >> 172.21.15.50:0/195011045 conn(0x7f107c0679c0 msgr2=0x7f107c0b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:33.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.134+0000 7f108129b640 1 -- 172.21.15.50:0/195011045 shutdown_connections 2024-09-11T22:16:33.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.134+0000 7f108129b640 1 -- 172.21.15.50:0/195011045 wait complete. 2024-09-11T22:16:33.148 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:16:33.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:33.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.254+0000 7f1bd8217640 1 Processor -- start 2024-09-11T22:16:33.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.255+0000 7f1bd8217640 1 -- start start 2024-09-11T22:16:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd8217640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1bd00d18a0 0x7f1bd00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd8217640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1bd00d3a30 0x7f1bd00b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd8217640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd00cfa80 con 0x7f1bd015e870 2024-09-11T22:16:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd8217640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd00d3ea0 con 0x7f1bd00d3a30 2024-09-11T22:16:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd8217640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd00d40d0 con 0x7f1bd00d18a0 2024-09-11T22:16:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd67b4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1bd00d3a30 0x7f1bd00b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd5fb3640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1bd015e870 0x7f1bd00d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:42208/0 (socket says 172.21.15.50:42208) 2024-09-11T22:16:33.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd5fb3640 1 -- 172.21.15.50:0/2136990960 learned_addr learned my addr 172.21.15.50:0/2136990960 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:33.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd57b2640 1 --2- 172.21.15.50:0/2136990960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1bd00d18a0 0x7f1bd00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd67b4640 1 -- 172.21.15.50:0/2136990960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1bd00d18a0 msgr2=0x7f1bd00d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:33.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd67b4640 1 --2- 172.21.15.50:0/2136990960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1bd00d18a0 0x7f1bd00d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd67b4640 1 -- 172.21.15.50:0/2136990960 >> v1:172.21.15.77:6789/0 conn(0x7f1bd015e870 legacy=0x7f1bd00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd4fb1640 1 -- 172.21.15.50:0/2136990960 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 13893199 0 0) 0x7f1bcc001110 con 0x7f1bd015e870 2024-09-11T22:16:33.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd67b4640 1 -- 172.21.15.50:0/2136990960 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd00d43b0 con 0x7f1bd00d3a30 2024-09-11T22:16:33.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.256+0000 7f1bd57b2640 1 --2- 172.21.15.50:0/2136990960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1bd00d18a0 0x7f1bd00d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:33.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.257+0000 7f1bd67b4640 1 --2- 172.21.15.50:0/2136990960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00d3a30 0x7f1bd00b8400 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009d90 tx=0x7f1bc802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5e2ed17b2f0a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:33.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.257+0000 7f1bd4fb1640 1 -- 172.21.15.50:0/2136990960 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8007740 con 0x7f1bd00d3a30 2024-09-11T22:16:33.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.257+0000 7f1bd4fb1640 1 -- 172.21.15.50:0/2136990960 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc80078e0 con 0x7f1bd00d3a30 2024-09-11T22:16:33.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.257+0000 7f1bd4fb1640 1 -- 172.21.15.50:0/2136990960 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8007cb0 con 0x7f1bd00d3a30 2024-09-11T22:16:33.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.258+0000 7f1bd8217640 1 -- 172.21.15.50:0/2136990960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00d3a30 msgr2=0x7f1bd00b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.258+0000 7f1bd8217640 1 --2- 172.21.15.50:0/2136990960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00d3a30 0x7f1bd00b8400 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009d90 tx=0x7f1bc802a660 comp rx=0 tx=0).stop 2024-09-11T22:16:33.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.258+0000 7f1bd8217640 1 -- 172.21.15.50:0/2136990960 shutdown_connections 2024-09-11T22:16:33.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.258+0000 7f1bd8217640 1 --2- 172.21.15.50:0/2136990960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00d3a30 0x7f1bd00b8400 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.258+0000 7f1bd8217640 1 --2- 172.21.15.50:0/2136990960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1bd00d18a0 0x7f1bd00d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.258+0000 7f1bd8217640 1 -- 172.21.15.50:0/2136990960 >> 172.21.15.50:0/2136990960 conn(0x7f1bd00727a0 msgr2=0x7f1bd00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:33.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.258+0000 7f1bd8217640 1 -- 172.21.15.50:0/2136990960 shutdown_connections 2024-09-11T22:16:33.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.258+0000 7f1bd8217640 1 -- 172.21.15.50:0/2136990960 wait complete. 2024-09-11T22:16:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.259+0000 7f1bd8217640 1 Processor -- start 2024-09-11T22:16:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.259+0000 7f1bd8217640 1 -- start start 2024-09-11T22:16:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd8217640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1bd00d18a0 0x7f1bd015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd8217640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd00d3a30 0x7f1bd015c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd8217640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd015e870 0x7f1bd00ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd8217640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd015ec50 con 0x7f1bd00d3a30 2024-09-11T22:16:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd8217640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd00b7ee0 con 0x7f1bd015e870 2024-09-11T22:16:33.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd8217640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd00b78b0 con 0x7f1bd00d18a0 2024-09-11T22:16:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd57b2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd00d3a30 0x7f1bd015c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd57b2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd00d3a30 0x7f1bd015c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56900/0 (socket says 172.21.15.50:56900) 2024-09-11T22:16:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd57b2640 1 -- 172.21.15.50:0/1126556038 learned_addr learned my addr 172.21.15.50:0/1126556038 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd5fb3640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1bd00d18a0 0x7f1bd015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd67b4640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd015e870 0x7f1bd00ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd57b2640 1 -- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1bd00d18a0 msgr2=0x7f1bd015cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd57b2640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1bd00d18a0 0x7f1bd015cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd57b2640 1 -- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd015e870 msgr2=0x7f1bd00ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd57b2640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd015e870 0x7f1bd00ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd57b2640 1 -- 172.21.15.50:0/1126556038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd015cd70 con 0x7f1bd00d3a30 2024-09-11T22:16:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd5fb3640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1bd00d18a0 0x7f1bd015cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd67b4640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd015e870 0x7f1bd00ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.260+0000 7f1bd57b2640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd00d3a30 0x7f1bd015c830 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000e990 tx=0x7f1bc000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:33.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.261+0000 7f1bc67fc640 1 -- 172.21.15.50:0/1126556038 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0017070 con 0x7f1bd00d3a30 2024-09-11T22:16:33.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.261+0000 7f1bc67fc640 1 -- 172.21.15.50:0/1126556038 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc000c9e0 con 0x7f1bd00d3a30 2024-09-11T22:16:33.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.261+0000 7f1bd8217640 1 -- 172.21.15.50:0/1126556038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd01e7e80 con 0x7f1bd00d3a30 2024-09-11T22:16:33.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.261+0000 7f1bc67fc640 1 -- 172.21.15.50:0/1126556038 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc000cdb0 con 0x7f1bd00d3a30 2024-09-11T22:16:33.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.261+0000 7f1bd8217640 1 -- 172.21.15.50:0/1126556038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd00cf4f0 con 0x7f1bd00d3a30 2024-09-11T22:16:33.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.262+0000 7f1bd8217640 1 -- 172.21.15.50:0/1126556038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd00d34f0 con 0x7f1bd00d3a30 2024-09-11T22:16:33.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.262+0000 7f1bc67fc640 1 -- 172.21.15.50:0/1126556038 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bc001a070 con 0x7f1bd00d3a30 2024-09-11T22:16:33.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.263+0000 7f1bc67fc640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1bb406be30 0x7f1bb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.263+0000 7f1bc67fc640 1 -- 172.21.15.50:0/1126556038 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f1bc008ad80 con 0x7f1bd00d3a30 2024-09-11T22:16:33.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.263+0000 7f1bd5fb3640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1bb406be30 0x7f1bb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.263+0000 7f1bd5fb3640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1bb406be30 0x7f1bb406e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc000f60 tx=0x7f1bcc007a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:33.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.267+0000 7f1bc67fc640 1 -- 172.21.15.50:0/1126556038 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1bd015cd70 con 0x7f1bd00d3a30 2024-09-11T22:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.479+0000 7f1bd8217640 1 -- 172.21.15.50:0/1126556038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1bd0067b60 con 0x7f1bd00d3a30 2024-09-11T22:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.480+0000 7f1bc67fc640 1 -- 172.21.15.50:0/1126556038 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5225 (secure 0 0 0) 0x7f1bc0059690 con 0x7f1bd00d3a30 2024-09-11T22:16:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:33.481 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":76,"btime":"2024-09-11T22:16:33:131505+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3921219668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3921219668},{"type":"v1","addr":"172.21.15.50:6835","nonce":3921219668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1123077854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1123077854},{"type":"v1","addr":"172.21.15.77:6837","nonce":1123077854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1576416639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1576416639},{"type":"v1","addr":"172.21.15.77:6836","nonce":1576416639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:16:30.480778+0000","modified":"2024-09-11T22:16:32.476047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7605},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7605":{"gid":7605,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/2355059741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2355059741},{"type":"v1","addr":"172.21.15.50:6834","nonce":2355059741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7605,"qdb_cluster":[7605]},"id":7}]} 2024-09-11T22:16:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 76 2024-09-11T22:16:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.482+0000 7f1bd8217640 1 -- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1bb406be30 msgr2=0x7f1bb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.482+0000 7f1bd8217640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1bb406be30 0x7f1bb406e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc000f60 tx=0x7f1bcc007a10 comp rx=0 tx=0).stop 2024-09-11T22:16:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.482+0000 7f1bd8217640 1 -- 172.21.15.50:0/1126556038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd00d3a30 msgr2=0x7f1bd015c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.482+0000 7f1bd8217640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd00d3a30 0x7f1bd015c830 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000e990 tx=0x7f1bc000ee50 comp rx=0 tx=0).stop 2024-09-11T22:16:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.482+0000 7f1bd8217640 1 -- 172.21.15.50:0/1126556038 shutdown_connections 2024-09-11T22:16:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.482+0000 7f1bd8217640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1bb406be30 0x7f1bb406e2f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.482+0000 7f1bd8217640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd015e870 0x7f1bd00ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.482+0000 7f1bd8217640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd00d3a30 0x7f1bd015c830 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.482+0000 7f1bd8217640 1 --2- 172.21.15.50:0/1126556038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1bd00d18a0 0x7f1bd015cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.482+0000 7f1bd8217640 1 -- 172.21.15.50:0/1126556038 >> 172.21.15.50:0/1126556038 conn(0x7f1bd00727a0 msgr2=0x7f1bd015f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.482+0000 7f1bd8217640 1 -- 172.21.15.50:0/1126556038 shutdown_connections 2024-09-11T22:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.482+0000 7f1bd8217640 1 -- 172.21.15.50:0/1126556038 wait complete. 2024-09-11T22:16:33.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:16:33.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.595+0000 7fcf68b42640 1 Processor -- start 2024-09-11T22:16:33.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.595+0000 7fcf68b42640 1 -- start start 2024-09-11T22:16:33.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.596+0000 7fcf68b42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf6415e870 0x7fcf640d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.596+0000 7fcf68b42640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcf640d16d0 0x7fcf640d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.596+0000 7fcf68b42640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf640cfa80 con 0x7fcf640d3a30 2024-09-11T22:16:33.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.596+0000 7fcf68b42640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcf640d3ea0 con 0x7fcf640d16d0 2024-09-11T22:16:33.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.596+0000 7fcf68b42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcf640d1b10 con 0x7fcf6415e870 2024-09-11T22:16:33.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.597+0000 7fcf61d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcf640d16d0 0x7fcf640d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.597+0000 7fcf62d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcf640d3a30 0x7fcf640b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:42218/0 (socket says 172.21.15.50:42218) 2024-09-11T22:16:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.597+0000 7fcf62d9d640 1 -- 172.21.15.50:0/2333413393 learned_addr learned my addr 172.21.15.50:0/2333413393 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.597+0000 7fcf6259c640 1 --2- 172.21.15.50:0/2333413393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf6415e870 0x7fcf640d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.597+0000 7fcf6159a640 1 -- 172.21.15.50:0/2333413393 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857135966 0 0) 0x7fcf54001490 con 0x7fcf640d3a30 2024-09-11T22:16:33.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.597+0000 7fcf6259c640 1 -- 172.21.15.50:0/2333413393 >> v2:172.21.15.77:3300/0 conn(0x7fcf640d16d0 msgr2=0x7fcf640d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:33.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.597+0000 7fcf6259c640 1 --2- 172.21.15.50:0/2333413393 >> v2:172.21.15.77:3300/0 conn(0x7fcf640d16d0 0x7fcf640d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.597+0000 7fcf6259c640 1 -- 172.21.15.50:0/2333413393 >> v1:172.21.15.77:6789/0 conn(0x7fcf640d3a30 legacy=0x7fcf640b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.597+0000 7fcf6259c640 1 -- 172.21.15.50:0/2333413393 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf640d40d0 con 0x7fcf6415e870 2024-09-11T22:16:33.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.598+0000 7fcf6259c640 1 --2- 172.21.15.50:0/2333413393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf6415e870 0x7fcf640d1190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0097a0 tx=0x7fcf5c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b55b98964b9adff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:33.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.598+0000 7fcf6159a640 1 -- 172.21.15.50:0/2333413393 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c037070 con 0x7fcf6415e870 2024-09-11T22:16:33.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.598+0000 7fcf6159a640 1 -- 172.21.15.50:0/2333413393 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5c032440 con 0x7fcf6415e870 2024-09-11T22:16:33.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.598+0000 7fcf6159a640 1 -- 172.21.15.50:0/2333413393 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c032810 con 0x7fcf6415e870 2024-09-11T22:16:33.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.599+0000 7fcf68b42640 1 -- 172.21.15.50:0/2333413393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf6415e870 msgr2=0x7fcf640d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.599+0000 7fcf68b42640 1 --2- 172.21.15.50:0/2333413393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf6415e870 0x7fcf640d1190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0097a0 tx=0x7fcf5c02a180 comp rx=0 tx=0).stop 2024-09-11T22:16:33.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.599+0000 7fcf68b42640 1 -- 172.21.15.50:0/2333413393 shutdown_connections 2024-09-11T22:16:33.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.599+0000 7fcf68b42640 1 --2- 172.21.15.50:0/2333413393 >> v2:172.21.15.77:3300/0 conn(0x7fcf640d16d0 0x7fcf640d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.599+0000 7fcf68b42640 1 --2- 172.21.15.50:0/2333413393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf6415e870 0x7fcf640d1190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.599+0000 7fcf68b42640 1 -- 172.21.15.50:0/2333413393 >> 172.21.15.50:0/2333413393 conn(0x7fcf640727a0 msgr2=0x7fcf640679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.599+0000 7fcf68b42640 1 -- 172.21.15.50:0/2333413393 shutdown_connections 2024-09-11T22:16:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.599+0000 7fcf68b42640 1 -- 172.21.15.50:0/2333413393 wait complete. 2024-09-11T22:16:33.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.600+0000 7fcf68b42640 1 Processor -- start 2024-09-11T22:16:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.600+0000 7fcf68b42640 1 -- start start 2024-09-11T22:16:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf68b42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf640d16d0 0x7fcf6415b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf68b42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf640d3a30 0x7fcf640ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf68b42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf6415e870 0x7fcf641f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf68b42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcf640b7ee0 con 0x7fcf6415e870 2024-09-11T22:16:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf68b42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcf640b7c00 con 0x7fcf640d16d0 2024-09-11T22:16:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf68b42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6415ec50 con 0x7fcf640d3a30 2024-09-11T22:16:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf62d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf6415e870 0x7fcf641f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf62d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf6415e870 0x7fcf641f81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56914/0 (socket says 172.21.15.50:56914) 2024-09-11T22:16:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf62d9d640 1 -- 172.21.15.50:0/3006038289 learned_addr learned my addr 172.21.15.50:0/3006038289 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf6259c640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf640d16d0 0x7fcf6415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf61d9b640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf640d3a30 0x7fcf640ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf62d9d640 1 -- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf640d3a30 msgr2=0x7fcf640ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf62d9d640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf640d3a30 0x7fcf640ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf62d9d640 1 -- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf640d16d0 msgr2=0x7fcf6415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf62d9d640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf640d16d0 0x7fcf6415b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf62d9d640 1 -- 172.21.15.50:0/3006038289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf640cbb80 con 0x7fcf6415e870 2024-09-11T22:16:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.601+0000 7fcf62d9d640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf6415e870 0x7fcf641f81a0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400c7f0 tx=0x7fcf5400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.602+0000 7fcf5affd640 1 -- 172.21.15.50:0/3006038289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54018070 con 0x7fcf6415e870 2024-09-11T22:16:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.602+0000 7fcf5affd640 1 -- 172.21.15.50:0/3006038289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5400a5e0 con 0x7fcf6415e870 2024-09-11T22:16:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.602+0000 7fcf68b42640 1 -- 172.21.15.50:0/3006038289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf640cbe60 con 0x7fcf6415e870 2024-09-11T22:16:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.602+0000 7fcf5affd640 1 -- 172.21.15.50:0/3006038289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400aa10 con 0x7fcf6415e870 2024-09-11T22:16:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.602+0000 7fcf68b42640 1 -- 172.21.15.50:0/3006038289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf640cc420 con 0x7fcf6415e870 2024-09-11T22:16:33.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.603+0000 7fcf68b42640 1 -- 172.21.15.50:0/3006038289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf640b78b0 con 0x7fcf6415e870 2024-09-11T22:16:33.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.603+0000 7fcf5affd640 1 -- 172.21.15.50:0/3006038289 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf5401b070 con 0x7fcf6415e870 2024-09-11T22:16:33.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.604+0000 7fcf5affd640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcf4406be30 0x7fcf4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.604+0000 7fcf5affd640 1 -- 172.21.15.50:0/3006038289 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fcf5408a3b0 con 0x7fcf6415e870 2024-09-11T22:16:33.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.604+0000 7fcf6259c640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcf4406be30 0x7fcf4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.604+0000 7fcf6259c640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcf4406be30 0x7fcf4406e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c034000 tx=0x7fcf5c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:33.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.608+0000 7fcf5affd640 1 -- 172.21.15.50:0/3006038289 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf640cfa80 con 0x7fcf6415e870 2024-09-11T22:16:33.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.784+0000 7fcf68b42640 1 -- 172.21.15.50:0/3006038289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf640b9ae0 con 0x7fcf6415e870 2024-09-11T22:16:33.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.786+0000 7fcf5affd640 1 -- 172.21.15.50:0/3006038289 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+16643 (secure 0 0 0) 0x7fcf54058710 con 0x7fcf6415e870 2024-09-11T22:16:33.787 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:33.787 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":107,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:16:32.127514+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:16:28.139569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-11T22:16:29.474681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:16:33.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.788+0000 7fcf68b42640 1 -- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcf4406be30 msgr2=0x7fcf4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.788+0000 7fcf68b42640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcf4406be30 0x7fcf4406e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c034000 tx=0x7fcf5c02e000 comp rx=0 tx=0).stop 2024-09-11T22:16:33.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.788+0000 7fcf68b42640 1 -- 172.21.15.50:0/3006038289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf6415e870 msgr2=0x7fcf641f81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.788+0000 7fcf68b42640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf6415e870 0x7fcf641f81a0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400c7f0 tx=0x7fcf5400ccb0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.788+0000 7fcf68b42640 1 -- 172.21.15.50:0/3006038289 shutdown_connections 2024-09-11T22:16:33.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.788+0000 7fcf68b42640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcf4406be30 0x7fcf4406e2f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.788+0000 7fcf68b42640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf640d3a30 0x7fcf640ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.788+0000 7fcf68b42640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf6415e870 0x7fcf641f81a0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.788+0000 7fcf68b42640 1 --2- 172.21.15.50:0/3006038289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf640d16d0 0x7fcf6415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.788+0000 7fcf68b42640 1 -- 172.21.15.50:0/3006038289 >> 172.21.15.50:0/3006038289 conn(0x7fcf640727a0 msgr2=0x7fcf640ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:33.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.788+0000 7fcf68b42640 1 -- 172.21.15.50:0/3006038289 shutdown_connections 2024-09-11T22:16:33.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.788+0000 7fcf68b42640 1 -- 172.21.15.50:0/3006038289 wait complete. 2024-09-11T22:16:33.800 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:16:33.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:16:33.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.902+0000 7f0511a65640 1 Processor -- start 2024-09-11T22:16:33.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.902+0000 7f0511a65640 1 -- start start 2024-09-11T22:16:33.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.902+0000 7f0511a65640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c161fa0 0x7f050c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f0511a65640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050c0cfbd0 con 0x7f050c0b1600 2024-09-11T22:16:33.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f0511a65640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050c0cfeb0 con 0x7f050c0cf610 2024-09-11T22:16:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f0511a65640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f050c0d1220 con 0x7f050c161fa0 2024-09-11T22:16:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f050c0b1600 0x7f050c0cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49632/0 (socket says 172.21.15.50:49632) 2024-09-11T22:16:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050affd640 1 -- 172.21.15.50:0/492619770 learned_addr learned my addr 172.21.15.50:0/492619770 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050b7fe640 1 --2- 172.21.15.50:0/492619770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c161fa0 0x7f050c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3669415682 0 0) 0x7f050c0cfbd0 con 0x7f050c0b1600 2024-09-11T22:16:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04f4003520 con 0x7f050c0b1600 2024-09-11T22:16:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1306081212 0 0) 0x7f04f4003520 con 0x7f050c0b1600 2024-09-11T22:16:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c161fa0 msgr2=0x7f050c0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 --2- 172.21.15.50:0/492619770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c161fa0 0x7f050c0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 >> v1:172.21.15.77:6789/0 conn(0x7f050c0cf610 legacy=0x7f050c0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c0d1470 con 0x7f050c0b1600 2024-09-11T22:16:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f0500001670 con 0x7f050c0b1600 2024-09-11T22:16:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 >> v1:172.21.15.50:6789/0 conn(0x7f050c0b1600 legacy=0x7f050c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 --2- 172.21.15.50:0/492619770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40039e0 0x7f04f4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 --2- 172.21.15.50:0/492619770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f4004800 0x7f04f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 --2- 172.21.15.50:0/492619770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c161fa0 0x7f04f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f050c0d1220 con 0x7f04f4004800 2024-09-11T22:16:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f04f400ba70 con 0x7f04f40039e0 2024-09-11T22:16:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f04f400bc70 con 0x7f050c161fa0 2024-09-11T22:16:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050affd640 1 --2- 172.21.15.50:0/492619770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f4004800 0x7f04f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.903+0000 7f050b7fe640 1 --2- 172.21.15.50:0/492619770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40039e0 0x7f04f4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.904+0000 7f050bfff640 1 --2- 172.21.15.50:0/492619770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c161fa0 0x7f04f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.904+0000 7f050affd640 1 -- 172.21.15.50:0/492619770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c161fa0 msgr2=0x7f04f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:33.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.904+0000 7f050affd640 1 --2- 172.21.15.50:0/492619770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c161fa0 0x7f04f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.904+0000 7f050affd640 1 -- 172.21.15.50:0/492619770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40039e0 msgr2=0x7f04f4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:33.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.904+0000 7f050affd640 1 --2- 172.21.15.50:0/492619770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f40039e0 0x7f04f4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.904+0000 7f050affd640 1 -- 172.21.15.50:0/492619770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f4003520 con 0x7f04f4004800 2024-09-11T22:16:33.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.904+0000 7f050affd640 1 --2- 172.21.15.50:0/492619770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f4004800 0x7f04f4004c80 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f0500001eb0 tx=0x7f04f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6532ab222e72bd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:33.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.905+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500007d30 con 0x7f04f4004800 2024-09-11T22:16:33.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.905+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0500005af0 con 0x7f04f4004800 2024-09-11T22:16:33.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.905+0000 7f050a7fc640 1 -- 172.21.15.50:0/492619770 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500007070 con 0x7f04f4004800 2024-09-11T22:16:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.905+0000 7f0511a65640 1 -- 172.21.15.50:0/492619770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f4004800 msgr2=0x7f04f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.905+0000 7f0511a65640 1 --2- 172.21.15.50:0/492619770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f4004800 0x7f04f4004c80 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f0500001eb0 tx=0x7f04f4005830 comp rx=0 tx=0).stop 2024-09-11T22:16:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.905+0000 7f050bfff640 1 -- 172.21.15.50:0/492619770 reap_dead start 2024-09-11T22:16:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.905+0000 7f0511a65640 1 -- 172.21.15.50:0/492619770 shutdown_connections 2024-09-11T22:16:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.905+0000 7f0511a65640 1 -- 172.21.15.50:0/492619770 >> 172.21.15.50:0/492619770 conn(0x7f050c09ba50 msgr2=0x7f050c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.905+0000 7f0511a65640 1 -- 172.21.15.50:0/492619770 shutdown_connections 2024-09-11T22:16:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.905+0000 7f0511a65640 1 -- 172.21.15.50:0/492619770 wait complete. 2024-09-11T22:16:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.906+0000 7f0511a65640 1 Processor -- start 2024-09-11T22:16:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.907+0000 7f0511a65640 1 -- start start 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.907+0000 7f0511a65640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04f4004800 0x7f050c0cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.907+0000 7f0511a65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050c0b2040 0x7f050c14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.907+0000 7f0511a65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c0b24c0 0x7f050c14fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.907+0000 7f0511a65640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f050c0d1c70 con 0x7f050c0b2040 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.907+0000 7f0511a65640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f050c0d17e0 con 0x7f050c0b24c0 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.907+0000 7f0511a65640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f050c0d1df0 con 0x7f04f4004800 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f050affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050c0b2040 0x7f050c14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f050affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050c0b2040 0x7f050c14f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56932/0 (socket says 172.21.15.50:56932) 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f050affd640 1 -- 172.21.15.50:0/3691169248 learned_addr learned my addr 172.21.15.50:0/3691169248 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f050bfff640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c0b24c0 0x7f050c14fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f050b7fe640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04f4004800 0x7f050c0cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f050affd640 1 -- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04f4004800 msgr2=0x7f050c0cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f050affd640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04f4004800 0x7f050c0cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f050affd640 1 -- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c0b24c0 msgr2=0x7f050c14fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f050affd640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c0b24c0 0x7f050c14fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f050affd640 1 -- 172.21.15.50:0/3691169248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c0b2a20 con 0x7f050c0b2040 2024-09-11T22:16:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f050affd640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050c0b2040 0x7f050c14f750 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f050000c2d0 tx=0x7f0500001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f04f3fff640 1 -- 172.21.15.50:0/3691169248 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500041030 con 0x7f050c0b2040 2024-09-11T22:16:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f04f3fff640 1 -- 172.21.15.50:0/3691169248 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0500038040 con 0x7f050c0b2040 2024-09-11T22:16:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f0511a65640 1 -- 172.21.15.50:0/3691169248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050c0b2d00 con 0x7f050c0b2040 2024-09-11T22:16:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f04f3fff640 1 -- 172.21.15.50:0/3691169248 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500001670 con 0x7f050c0b2040 2024-09-11T22:16:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.908+0000 7f0511a65640 1 -- 172.21.15.50:0/3691169248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f050c0b32c0 con 0x7f050c0b2040 2024-09-11T22:16:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.909+0000 7f0511a65640 1 -- 172.21.15.50:0/3691169248 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f050c14d3e0 con 0x7f050c0b2040 2024-09-11T22:16:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.910+0000 7f04f3fff640 1 -- 172.21.15.50:0/3691169248 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0500044070 con 0x7f050c0b2040 2024-09-11T22:16:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.910+0000 7f04f3fff640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04f806be30 0x7f04f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.910+0000 7f04f3fff640 1 -- 172.21.15.50:0/3691169248 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f05000aa6f0 con 0x7f050c0b2040 2024-09-11T22:16:33.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.911+0000 7f050b7fe640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04f806be30 0x7f04f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:33.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.911+0000 7f050b7fe640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04f806be30 0x7f04f806e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009bc0 tx=0x7f04fc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:33.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:33.915+0000 7f04f3fff640 1 -- 172.21.15.50:0/3691169248 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f050c14d3e0 con 0x7f050c0b2040 2024-09-11T22:16:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.086+0000 7f0511a65640 1 -- 172.21.15.50:0/3691169248 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f050c0cf2c0 con 0x7f04f806be30 2024-09-11T22:16:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.093+0000 7f04f3fff640 1 -- 172.21.15.50:0/3691169248 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243692 (secure 0 0 0) 0x7f050c0cf2c0 con 0x7f04f806be30 2024-09-11T22:16:34.096 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:34.098 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:16:34.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.096+0000 7f0511a65640 1 -- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04f806be30 msgr2=0x7f04f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.096+0000 7f0511a65640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04f806be30 0x7f04f806e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009bc0 tx=0x7f04fc009190 comp rx=0 tx=0).stop 2024-09-11T22:16:34.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.096+0000 7f0511a65640 1 -- 172.21.15.50:0/3691169248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050c0b2040 msgr2=0x7f050c14f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.096+0000 7f0511a65640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050c0b2040 0x7f050c14f750 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f050000c2d0 tx=0x7f0500001a40 comp rx=0 tx=0).stop 2024-09-11T22:16:34.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.096+0000 7f0511a65640 1 -- 172.21.15.50:0/3691169248 shutdown_connections 2024-09-11T22:16:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.096+0000 7f0511a65640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f04f806be30 0x7f04f806e2f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.096+0000 7f0511a65640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c0b24c0 0x7f050c14fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.096+0000 7f0511a65640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050c0b2040 0x7f050c14f750 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.096+0000 7f0511a65640 1 --2- 172.21.15.50:0/3691169248 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04f4004800 0x7f050c0cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.096+0000 7f0511a65640 1 -- 172.21.15.50:0/3691169248 >> 172.21.15.50:0/3691169248 conn(0x7f050c09ba50 msgr2=0x7f050c06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.096+0000 7f0511a65640 1 -- 172.21.15.50:0/3691169248 shutdown_connections 2024-09-11T22:16:34.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.096+0000 7f0511a65640 1 -- 172.21.15.50:0/3691169248 wait complete. 2024-09-11T22:16:34.107 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-09-11T22:16:33.441287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590514,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":281500,"kb_used_data":11164,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754693220,"statfs":{"total":773094113280,"available":772805857280,"internally_reserved":0,"allocated":11431936,"data_stored":5628571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":146,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.326892"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.138729+0000","last_change":"2024-09-11T22:16:31.132072+0000","last_active":"2024-09-11T22:16:31.138729+0000","last_peered":"2024-09-11T22:16:31.138729+0000","last_clean":"2024-09-11T22:16:31.138729+0000","last_became_active":"2024-09-11T22:16:31.131809+0000","last_became_peered":"2024-09-11T22:16:31.131809+0000","last_unstale":"2024-09-11T22:16:31.138729+0000","last_undegraded":"2024-09-11T22:16:31.138729+0000","last_fullsized":"2024-09-11T22:16:31.138729+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:52.397280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143058+0000","last_change":"2024-09-11T22:16:31.140404+0000","last_active":"2024-09-11T22:16:31.143058+0000","last_peered":"2024-09-11T22:16:31.143058+0000","last_clean":"2024-09-11T22:16:31.143058+0000","last_became_active":"2024-09-11T22:16:31.140115+0000","last_became_peered":"2024-09-11T22:16:31.140115+0000","last_unstale":"2024-09-11T22:16:31.143058+0000","last_undegraded":"2024-09-11T22:16:31.143058+0000","last_fullsized":"2024-09-11T22:16:31.143058+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.356920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.139774+0000","last_change":"2024-09-11T22:16:31.137742+0000","last_active":"2024-09-11T22:16:31.139774+0000","last_peered":"2024-09-11T22:16:31.139774+0000","last_clean":"2024-09-11T22:16:31.139774+0000","last_became_active":"2024-09-11T22:16:31.137465+0000","last_became_peered":"2024-09-11T22:16:31.137465+0000","last_unstale":"2024-09-11T22:16:31.139774+0000","last_undegraded":"2024-09-11T22:16:31.139774+0000","last_fullsized":"2024-09-11T22:16:31.139774+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.302219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.141824+0000","last_change":"2024-09-11T22:16:31.139945+0000","last_active":"2024-09-11T22:16:31.141824+0000","last_peered":"2024-09-11T22:16:31.141824+0000","last_clean":"2024-09-11T22:16:31.141824+0000","last_became_active":"2024-09-11T22:16:31.139641+0000","last_became_peered":"2024-09-11T22:16:31.139641+0000","last_unstale":"2024-09-11T22:16:31.141824+0000","last_undegraded":"2024-09-11T22:16:31.141824+0000","last_fullsized":"2024-09-11T22:16:31.141824+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:39.961376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.139900+0000","last_change":"2024-09-11T22:16:31.137051+0000","last_active":"2024-09-11T22:16:31.139900+0000","last_peered":"2024-09-11T22:16:31.139900+0000","last_clean":"2024-09-11T22:16:31.139900+0000","last_became_active":"2024-09-11T22:16:31.136536+0000","last_became_peered":"2024-09-11T22:16:31.136536+0000","last_unstale":"2024-09-11T22:16:31.139900+0000","last_undegraded":"2024-09-11T22:16:31.139900+0000","last_fullsized":"2024-09-11T22:16:31.139900+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:43.578171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.153935+0000","last_change":"2024-09-11T22:16:31.152030+0000","last_active":"2024-09-11T22:16:31.153935+0000","last_peered":"2024-09-11T22:16:31.153935+0000","last_clean":"2024-09-11T22:16:31.153935+0000","last_became_active":"2024-09-11T22:16:31.151734+0000","last_became_peered":"2024-09-11T22:16:31.151734+0000","last_unstale":"2024-09-11T22:16:31.153935+0000","last_undegraded":"2024-09-11T22:16:31.153935+0000","last_fullsized":"2024-09-11T22:16:31.153935+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:15.537243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.147925+0000","last_change":"2024-09-11T22:16:31.146858+0000","last_active":"2024-09-11T22:16:31.147925+0000","last_peered":"2024-09-11T22:16:31.147925+0000","last_clean":"2024-09-11T22:16:31.147925+0000","last_became_active":"2024-09-11T22:16:31.146546+0000","last_became_peered":"2024-09-11T22:16:31.146546+0000","last_unstale":"2024-09-11T22:16:31.147925+0000","last_undegraded":"2024-09-11T22:16:31.147925+0000","last_fullsized":"2024-09-11T22:16:31.147925+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:54.212790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.148740+0000","last_change":"2024-09-11T22:16:31.147334+0000","last_active":"2024-09-11T22:16:31.148740+0000","last_peered":"2024-09-11T22:16:31.148740+0000","last_clean":"2024-09-11T22:16:31.148740+0000","last_became_active":"2024-09-11T22:16:31.147006+0000","last_became_peered":"2024-09-11T22:16:31.147006+0000","last_unstale":"2024-09-11T22:16:31.148740+0000","last_undegraded":"2024-09-11T22:16:31.148740+0000","last_fullsized":"2024-09-11T22:16:31.148740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:57.368631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143172+0000","last_change":"2024-09-11T22:16:31.142015+0000","last_active":"2024-09-11T22:16:31.143172+0000","last_peered":"2024-09-11T22:16:31.143172+0000","last_clean":"2024-09-11T22:16:31.143172+0000","last_became_active":"2024-09-11T22:16:31.141425+0000","last_became_peered":"2024-09-11T22:16:31.141425+0000","last_unstale":"2024-09-11T22:16:31.143172+0000","last_undegraded":"2024-09-11T22:16:31.143172+0000","last_fullsized":"2024-09-11T22:16:31.143172+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:43:35.268521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.151425+0000","last_change":"2024-09-11T22:16:31.149706+0000","last_active":"2024-09-11T22:16:31.151425+0000","last_peered":"2024-09-11T22:16:31.151425+0000","last_clean":"2024-09-11T22:16:31.151425+0000","last_became_active":"2024-09-11T22:16:31.149426+0000","last_became_peered":"2024-09-11T22:16:31.149426+0000","last_unstale":"2024-09-11T22:16:31.151425+0000","last_undegraded":"2024-09-11T22:16:31.151425+0000","last_fullsized":"2024-09-11T22:16:31.151425+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:25.619855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.146070+0000","last_change":"2024-09-11T22:16:31.144398+0000","last_active":"2024-09-11T22:16:31.146070+0000","last_peered":"2024-09-11T22:16:31.146070+0000","last_clean":"2024-09-11T22:16:31.146070+0000","last_became_active":"2024-09-11T22:16:31.144121+0000","last_became_peered":"2024-09-11T22:16:31.144121+0000","last_unstale":"2024-09-11T22:16:31.146070+0000","last_undegraded":"2024-09-11T22:16:31.146070+0000","last_fullsized":"2024-09-11T22:16:31.146070+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:17.118335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.120990+0000","last_change":"2024-09-11T22:16:29.120990+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.120990+0000","last_undegraded":"2024-09-11T22:16:29.120990+0000","last_fullsized":"2024-09-11T22:16:29.120990+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.147427+0000","last_change":"2024-09-11T22:16:30.144070+0000","last_active":"2024-09-11T22:16:31.147427+0000","last_peered":"2024-09-11T22:16:31.147427+0000","last_clean":"2024-09-11T22:16:31.147427+0000","last_became_active":"2024-09-11T22:16:30.143809+0000","last_became_peered":"2024-09-11T22:16:30.143809+0000","last_unstale":"2024-09-11T22:16:31.147427+0000","last_undegraded":"2024-09-11T22:16:31.147427+0000","last_fullsized":"2024-09-11T22:16:31.147427+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:26.892307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118962+0000","last_change":"2024-09-11T22:16:29.118962+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118962+0000","last_undegraded":"2024-09-11T22:16:29.118962+0000","last_fullsized":"2024-09-11T22:16:29.118962+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118940+0000","last_change":"2024-09-11T22:16:29.118940+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118940+0000","last_undegraded":"2024-09-11T22:16:29.118940+0000","last_fullsized":"2024-09-11T22:16:29.118940+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.119109+0000","last_change":"2024-09-11T22:16:29.119109+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.119109+0000","last_undegraded":"2024-09-11T22:16:29.119109+0000","last_fullsized":"2024-09-11T22:16:29.119109+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143099+0000","last_change":"2024-09-11T22:16:31.141412+0000","last_active":"2024-09-11T22:16:31.143099+0000","last_peered":"2024-09-11T22:16:31.143099+0000","last_clean":"2024-09-11T22:16:31.143099+0000","last_became_active":"2024-09-11T22:16:31.140411+0000","last_became_peered":"2024-09-11T22:16:31.140411+0000","last_unstale":"2024-09-11T22:16:31.143099+0000","last_undegraded":"2024-09-11T22:16:31.143099+0000","last_fullsized":"2024-09-11T22:16:31.143099+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:40.247355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118456+0000","last_change":"2024-09-11T22:16:29.118456+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118456+0000","last_undegraded":"2024-09-11T22:16:29.118456+0000","last_fullsized":"2024-09-11T22:16:29.118456+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118293+0000","last_change":"2024-09-11T22:16:29.118293+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118293+0000","last_undegraded":"2024-09-11T22:16:29.118293+0000","last_fullsized":"2024-09-11T22:16:29.118293+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.120024+0000","last_change":"2024-09-11T22:16:29.120024+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.120024+0000","last_undegraded":"2024-09-11T22:16:29.120024+0000","last_fullsized":"2024-09-11T22:16:29.120024+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118586+0000","last_change":"2024-09-11T22:16:29.118586+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118586+0000","last_undegraded":"2024-09-11T22:16:29.118586+0000","last_fullsized":"2024-09-11T22:16:29.118586+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.119119+0000","last_change":"2024-09-11T22:16:29.119119+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.119119+0000","last_undegraded":"2024-09-11T22:16:29.119119+0000","last_fullsized":"2024-09-11T22:16:29.119119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"106'3","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143269+0000","last_change":"2024-09-11T22:16:30.138863+0000","last_active":"2024-09-11T22:16:31.143269+0000","last_peered":"2024-09-11T22:16:31.143269+0000","last_clean":"2024-09-11T22:16:31.143269+0000","last_became_active":"2024-09-11T22:16:30.138546+0000","last_became_peered":"2024-09-11T22:16:30.138546+0000","last_unstale":"2024-09-11T22:16:31.143269+0000","last_undegraded":"2024-09-11T22:16:31.143269+0000","last_fullsized":"2024-09-11T22:16:31.143269+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.751700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.144921+0000","last_change":"2024-09-11T22:16:31.142601+0000","last_active":"2024-09-11T22:16:31.144921+0000","last_peered":"2024-09-11T22:16:31.144921+0000","last_clean":"2024-09-11T22:16:31.144921+0000","last_became_active":"2024-09-11T22:16:31.142307+0000","last_became_peered":"2024-09-11T22:16:31.142307+0000","last_unstale":"2024-09-11T22:16:31.144921+0000","last_undegraded":"2024-09-11T22:16:31.144921+0000","last_fullsized":"2024-09-11T22:16:31.144921+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:58.641376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116627+0000","last_change":"2024-09-11T22:16:29.116627+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116627+0000","last_undegraded":"2024-09-11T22:16:29.116627+0000","last_fullsized":"2024-09-11T22:16:29.116627+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.145740+0000","last_change":"2024-09-11T22:16:30.134072+0000","last_active":"2024-09-11T22:16:31.145740+0000","last_peered":"2024-09-11T22:16:31.145740+0000","last_clean":"2024-09-11T22:16:31.145740+0000","last_became_active":"2024-09-11T22:16:30.133756+0000","last_became_peered":"2024-09-11T22:16:30.133756+0000","last_unstale":"2024-09-11T22:16:31.145740+0000","last_undegraded":"2024-09-11T22:16:31.145740+0000","last_fullsized":"2024-09-11T22:16:31.145740+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:40.093900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.134219+0000","last_change":"2024-09-11T22:16:30.134404+0000","last_active":"2024-09-11T22:16:31.134219+0000","last_peered":"2024-09-11T22:16:31.134219+0000","last_clean":"2024-09-11T22:16:31.134219+0000","last_became_active":"2024-09-11T22:16:30.133816+0000","last_became_peered":"2024-09-11T22:16:30.133816+0000","last_unstale":"2024-09-11T22:16:31.134219+0000","last_undegraded":"2024-09-11T22:16:31.134219+0000","last_fullsized":"2024-09-11T22:16:31.134219+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:51:29.870433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116140+0000","last_change":"2024-09-11T22:16:29.116140+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116140+0000","last_undegraded":"2024-09-11T22:16:29.116140+0000","last_fullsized":"2024-09-11T22:16:29.116140+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.146201+0000","last_change":"2024-09-11T22:16:31.144771+0000","last_active":"2024-09-11T22:16:31.146201+0000","last_peered":"2024-09-11T22:16:31.146201+0000","last_clean":"2024-09-11T22:16:31.146201+0000","last_became_active":"2024-09-11T22:16:31.144465+0000","last_became_peered":"2024-09-11T22:16:31.144465+0000","last_unstale":"2024-09-11T22:16:31.146201+0000","last_undegraded":"2024-09-11T22:16:31.146201+0000","last_fullsized":"2024-09-11T22:16:31.146201+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:18.425428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.119594+0000","last_change":"2024-09-11T22:16:29.119594+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.119594+0000","last_undegraded":"2024-09-11T22:16:29.119594+0000","last_fullsized":"2024-09-11T22:16:29.119594+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116342+0000","last_change":"2024-09-11T22:16:29.116342+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116342+0000","last_undegraded":"2024-09-11T22:16:29.116342+0000","last_fullsized":"2024-09-11T22:16:29.116342+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118293+0000","last_change":"2024-09-11T22:16:29.118293+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118293+0000","last_undegraded":"2024-09-11T22:16:29.118293+0000","last_fullsized":"2024-09-11T22:16:29.118293+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143155+0000","last_change":"2024-09-11T22:16:31.140281+0000","last_active":"2024-09-11T22:16:31.143155+0000","last_peered":"2024-09-11T22:16:31.143155+0000","last_clean":"2024-09-11T22:16:31.143155+0000","last_became_active":"2024-09-11T22:16:31.139962+0000","last_became_peered":"2024-09-11T22:16:31.139962+0000","last_unstale":"2024-09-11T22:16:31.143155+0000","last_undegraded":"2024-09-11T22:16:31.143155+0000","last_fullsized":"2024-09-11T22:16:31.143155+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:54.782458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118335+0000","last_change":"2024-09-11T22:16:29.118335+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118335+0000","last_undegraded":"2024-09-11T22:16:29.118335+0000","last_fullsized":"2024-09-11T22:16:29.118335+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.149170+0000","last_change":"2024-09-11T22:16:31.148199+0000","last_active":"2024-09-11T22:16:31.149170+0000","last_peered":"2024-09-11T22:16:31.149170+0000","last_clean":"2024-09-11T22:16:31.149170+0000","last_became_active":"2024-09-11T22:16:31.147855+0000","last_became_peered":"2024-09-11T22:16:31.147855+0000","last_unstale":"2024-09-11T22:16:31.149170+0000","last_undegraded":"2024-09-11T22:16:31.149170+0000","last_fullsized":"2024-09-11T22:16:31.149170+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:55.514563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118028+0000","last_change":"2024-09-11T22:16:29.118028+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118028+0000","last_undegraded":"2024-09-11T22:16:29.118028+0000","last_fullsized":"2024-09-11T22:16:29.118028+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.152225+0000","last_change":"2024-09-11T22:16:31.151401+0000","last_active":"2024-09-11T22:16:31.152225+0000","last_peered":"2024-09-11T22:16:31.152225+0000","last_clean":"2024-09-11T22:16:31.152225+0000","last_became_active":"2024-09-11T22:16:31.151128+0000","last_became_peered":"2024-09-11T22:16:31.151128+0000","last_unstale":"2024-09-11T22:16:31.152225+0000","last_undegraded":"2024-09-11T22:16:31.152225+0000","last_fullsized":"2024-09-11T22:16:31.152225+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:32.506418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116099+0000","last_change":"2024-09-11T22:16:29.116099+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116099+0000","last_undegraded":"2024-09-11T22:16:29.116099+0000","last_fullsized":"2024-09-11T22:16:29.116099+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.149922+0000","last_change":"2024-09-11T22:16:31.148915+0000","last_active":"2024-09-11T22:16:31.149922+0000","last_peered":"2024-09-11T22:16:31.149922+0000","last_clean":"2024-09-11T22:16:31.149922+0000","last_became_active":"2024-09-11T22:16:31.148608+0000","last_became_peered":"2024-09-11T22:16:31.148608+0000","last_unstale":"2024-09-11T22:16:31.149922+0000","last_undegraded":"2024-09-11T22:16:31.149922+0000","last_fullsized":"2024-09-11T22:16:31.149922+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:08.215053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116147+0000","last_change":"2024-09-11T22:16:29.116147+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116147+0000","last_undegraded":"2024-09-11T22:16:29.116147+0000","last_fullsized":"2024-09-11T22:16:29.116147+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.117035+0000","last_change":"2024-09-11T22:16:29.117035+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.117035+0000","last_undegraded":"2024-09-11T22:16:29.117035+0000","last_fullsized":"2024-09-11T22:16:29.117035+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116095+0000","last_change":"2024-09-11T22:16:29.116095+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116095+0000","last_undegraded":"2024-09-11T22:16:29.116095+0000","last_fullsized":"2024-09-11T22:16:29.116095+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.117105+0000","last_change":"2024-09-11T22:16:29.117105+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.117105+0000","last_undegraded":"2024-09-11T22:16:29.117105+0000","last_fullsized":"2024-09-11T22:16:29.117105+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.117235+0000","last_change":"2024-09-11T22:16:29.117235+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.117235+0000","last_undegraded":"2024-09-11T22:16:29.117235+0000","last_fullsized":"2024-09-11T22:16:29.117235+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118212+0000","last_change":"2024-09-11T22:16:29.118212+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118212+0000","last_undegraded":"2024-09-11T22:16:29.118212+0000","last_fullsized":"2024-09-11T22:16:29.118212+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.148062+0000","last_change":"2024-09-11T22:16:31.146357+0000","last_active":"2024-09-11T22:16:31.148062+0000","last_peered":"2024-09-11T22:16:31.148062+0000","last_clean":"2024-09-11T22:16:31.148062+0000","last_became_active":"2024-09-11T22:16:31.146047+0000","last_became_peered":"2024-09-11T22:16:31.146047+0000","last_unstale":"2024-09-11T22:16:31.148062+0000","last_undegraded":"2024-09-11T22:16:31.148062+0000","last_fullsized":"2024-09-11T22:16:31.148062+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:48.155167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.117025+0000","last_change":"2024-09-11T22:16:29.117025+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.117025+0000","last_undegraded":"2024-09-11T22:16:29.117025+0000","last_fullsized":"2024-09-11T22:16:29.117025+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118227+0000","last_change":"2024-09-11T22:16:29.118227+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118227+0000","last_undegraded":"2024-09-11T22:16:29.118227+0000","last_fullsized":"2024-09-11T22:16:29.118227+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.146406+0000","last_change":"2024-09-11T22:16:31.145558+0000","last_active":"2024-09-11T22:16:31.146406+0000","last_peered":"2024-09-11T22:16:31.146406+0000","last_clean":"2024-09-11T22:16:31.146406+0000","last_became_active":"2024-09-11T22:16:31.145190+0000","last_became_peered":"2024-09-11T22:16:31.145190+0000","last_unstale":"2024-09-11T22:16:31.146406+0000","last_undegraded":"2024-09-11T22:16:31.146406+0000","last_fullsized":"2024-09-11T22:16:31.146406+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:10.428833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118759+0000","last_change":"2024-09-11T22:16:29.118759+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118759+0000","last_undegraded":"2024-09-11T22:16:29.118759+0000","last_fullsized":"2024-09-11T22:16:29.118759+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.132339+0000","last_change":"2024-09-11T22:16:30.134155+0000","last_active":"2024-09-11T22:16:31.132339+0000","last_peered":"2024-09-11T22:16:31.132339+0000","last_clean":"2024-09-11T22:16:31.132339+0000","last_became_active":"2024-09-11T22:16:30.133835+0000","last_became_peered":"2024-09-11T22:16:30.133835+0000","last_unstale":"2024-09-11T22:16:31.132339+0000","last_undegraded":"2024-09-11T22:16:31.132339+0000","last_fullsized":"2024-09-11T22:16:31.132339+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:58.593480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.151440+0000","last_change":"2024-09-11T22:16:31.149781+0000","last_active":"2024-09-11T22:16:31.151440+0000","last_peered":"2024-09-11T22:16:31.151440+0000","last_clean":"2024-09-11T22:16:31.151440+0000","last_became_active":"2024-09-11T22:16:31.149416+0000","last_became_peered":"2024-09-11T22:16:31.149416+0000","last_unstale":"2024-09-11T22:16:31.151440+0000","last_undegraded":"2024-09-11T22:16:31.151440+0000","last_fullsized":"2024-09-11T22:16:31.151440+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:46.290268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.144821+0000","last_change":"2024-09-11T22:16:30.140162+0000","last_active":"2024-09-11T22:16:31.144821+0000","last_peered":"2024-09-11T22:16:31.144821+0000","last_clean":"2024-09-11T22:16:31.144821+0000","last_became_active":"2024-09-11T22:16:30.139889+0000","last_became_peered":"2024-09-11T22:16:30.139889+0000","last_unstale":"2024-09-11T22:16:31.144821+0000","last_undegraded":"2024-09-11T22:16:31.144821+0000","last_fullsized":"2024-09-11T22:16:31.144821+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:07.047344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":325,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.127585+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:16:31.127585+0000","last_peered":"2024-09-11T22:16:31.127585+0000","last_clean":"2024-09-11T22:16:31.127585+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:16:31.127585+0000","last_undegraded":"2024-09-11T22:16:31.127585+0000","last_fullsized":"2024-09-11T22:16:31.127585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":2},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":146,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36596,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335244,"statfs":{"total":96636764160,"available":96599289856,"internally_reserved":0,"allocated":1277952,"data_stored":555004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36584,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335256,"statfs":{"total":96636764160,"available":96599302144,"internally_reserved":0,"allocated":1265664,"data_stored":549187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40760,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331080,"statfs":{"total":96636764160,"available":96595025920,"internally_reserved":0,"allocated":1277952,"data_stored":555004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1265664,"data_stored":549187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1277952,"data_stored":555004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41336,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330504,"statfs":{"total":96636764160,"available":96594436096,"internally_reserved":0,"allocated":1871872,"data_stored":1145372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41376,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330464,"statfs":{"total":96636764160,"available":96594395136,"internally_reserved":0,"allocated":1904640,"data_stored":1158534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1290240,"data_stored":561279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:16:34.112 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:16:34.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.250+0000 7f5569d2c640 1 Processor -- start 2024-09-11T22:16:34.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.250+0000 7f5569d2c640 1 -- start start 2024-09-11T22:16:34.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.251+0000 7f5569d2c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f55640d1c90 0x7f55640b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.251+0000 7f5569d2c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5564162350 0x7f55641627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.251+0000 7f5569d2c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5564163080 con 0x7f556415e8e0 2024-09-11T22:16:34.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.251+0000 7f5569d2c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f556415ecc0 con 0x7f55640d1c90 2024-09-11T22:16:34.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.251+0000 7f5569d2c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f55640d2ad0 con 0x7f5564162350 2024-09-11T22:16:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.251+0000 7f5562ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f55640d1c90 0x7f55640b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.251+0000 7f5562ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f55640d1c90 0x7f55640b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56942/0 (socket says 172.21.15.50:56942) 2024-09-11T22:16:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.251+0000 7f5562ffd640 1 -- 172.21.15.50:0/3858837026 learned_addr learned my addr 172.21.15.50:0/3858837026 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.251+0000 7f5563fff640 1 --2- 172.21.15.50:0/3858837026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5564162350 0x7f55641627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.251+0000 7f5562ffd640 1 -- 172.21.15.50:0/3858837026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5564162350 msgr2=0x7f55641627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.251+0000 7f5562ffd640 1 --2- 172.21.15.50:0/3858837026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5564162350 0x7f55641627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.251+0000 7f5562ffd640 1 -- 172.21.15.50:0/3858837026 >> v1:172.21.15.77:6789/0 conn(0x7f556415e8e0 legacy=0x7f55640d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.251+0000 7f5562ffd640 1 -- 172.21.15.50:0/3858837026 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55640d2d20 con 0x7f55640d1c90 2024-09-11T22:16:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.252+0000 7f5562ffd640 1 --2- 172.21.15.50:0/3858837026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d1c90 0x7f55640b7880 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f5558009870 tx=0x7f555802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f51a39d3453fa57 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:34.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.252+0000 7f55627fc640 1 -- 172.21.15.50:0/3858837026 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558037070 con 0x7f55640d1c90 2024-09-11T22:16:34.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.252+0000 7f55627fc640 1 -- 172.21.15.50:0/3858837026 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555802ae50 con 0x7f55640d1c90 2024-09-11T22:16:34.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.252+0000 7f55627fc640 1 -- 172.21.15.50:0/3858837026 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558032860 con 0x7f55640d1c90 2024-09-11T22:16:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.252+0000 7f5569d2c640 1 -- 172.21.15.50:0/3858837026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d1c90 msgr2=0x7f55640b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.252+0000 7f5569d2c640 1 --2- 172.21.15.50:0/3858837026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d1c90 0x7f55640b7880 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f5558009870 tx=0x7f555802a300 comp rx=0 tx=0).stop 2024-09-11T22:16:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.253+0000 7f5569d2c640 1 -- 172.21.15.50:0/3858837026 shutdown_connections 2024-09-11T22:16:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.253+0000 7f5569d2c640 1 --2- 172.21.15.50:0/3858837026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5564162350 0x7f55641627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.253+0000 7f5569d2c640 1 --2- 172.21.15.50:0/3858837026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d1c90 0x7f55640b7880 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.253+0000 7f5569d2c640 1 -- 172.21.15.50:0/3858837026 >> 172.21.15.50:0/3858837026 conn(0x7f5564067ba0 msgr2=0x7f5564067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.253+0000 7f5569d2c640 1 -- 172.21.15.50:0/3858837026 shutdown_connections 2024-09-11T22:16:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.253+0000 7f5569d2c640 1 -- 172.21.15.50:0/3858837026 wait complete. 2024-09-11T22:16:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.254+0000 7f5569d2c640 1 Processor -- start 2024-09-11T22:16:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.254+0000 7f5569d2c640 1 -- start start 2024-09-11T22:16:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f5569d2c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d1c90 0x7f55640cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f5569d2c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f556415e8e0 0x7f55641e8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f5569d2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5564162350 0x7f55641f44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f5569d2c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5564162d20 con 0x7f55640d1c90 2024-09-11T22:16:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f5569d2c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f55640d3370 con 0x7f5564162350 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f5569d2c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f55640d3800 con 0x7f556415e8e0 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f55637fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d1c90 0x7f55640cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f55637fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d1c90 0x7f55640cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56948/0 (socket says 172.21.15.50:56948) 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f55637fe640 1 -- 172.21.15.50:0/2936703873 learned_addr learned my addr 172.21.15.50:0/2936703873 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f5562ffd640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f556415e8e0 0x7f55641e8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f5563fff640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5564162350 0x7f55641f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f55637fe640 1 -- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f556415e8e0 msgr2=0x7f55641e8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f55637fe640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f556415e8e0 0x7f55641e8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f55637fe640 1 -- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5564162350 msgr2=0x7f55641f44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f55637fe640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5564162350 0x7f55641f44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f55637fe640 1 -- 172.21.15.50:0/2936703873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55641f5050 con 0x7f55640d1c90 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f55637fe640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d1c90 0x7f55640cc2d0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f555400c400 tx=0x7f555400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f554bfff640 1 -- 172.21.15.50:0/2936703873 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55540052d0 con 0x7f55640d1c90 2024-09-11T22:16:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f554bfff640 1 -- 172.21.15.50:0/2936703873 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5554005490 con 0x7f55640d1c90 2024-09-11T22:16:34.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f5569d2c640 1 -- 172.21.15.50:0/2936703873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55641f5330 con 0x7f55640d1c90 2024-09-11T22:16:34.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.255+0000 7f554bfff640 1 -- 172.21.15.50:0/2936703873 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554007260 con 0x7f55640d1c90 2024-09-11T22:16:34.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.256+0000 7f5569d2c640 1 -- 172.21.15.50:0/2936703873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f556415e050 con 0x7f55640d1c90 2024-09-11T22:16:34.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.256+0000 7f5569d2c640 1 -- 172.21.15.50:0/2936703873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55640b7880 con 0x7f55640d1c90 2024-09-11T22:16:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.257+0000 7f554bfff640 1 -- 172.21.15.50:0/2936703873 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5554007400 con 0x7f55640d1c90 2024-09-11T22:16:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.257+0000 7f554bfff640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f555006be30 0x7f555006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.258+0000 7f554bfff640 1 -- 172.21.15.50:0/2936703873 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f555408a2f0 con 0x7f55640d1c90 2024-09-11T22:16:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.258+0000 7f5562ffd640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f555006be30 0x7f555006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.258+0000 7f5562ffd640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f555006be30 0x7f555006e2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5558034000 tx=0x7f555802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:34.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.262+0000 7f554bfff640 1 -- 172.21.15.50:0/2936703873 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5554058650 con 0x7f55640d1c90 2024-09-11T22:16:34.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.435+0000 7f5569d2c640 1 -- 172.21.15.50:0/2936703873 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55640ba770 con 0x7f555006be30 2024-09-11T22:16:34.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.441+0000 7f554bfff640 1 -- 172.21.15.50:0/2936703873 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243692 (secure 0 0 0) 0x7f55640ba770 con 0x7f555006be30 2024-09-11T22:16:34.444 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:34.446 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:16:34.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.445+0000 7f5569d2c640 1 -- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f555006be30 msgr2=0x7f555006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.445+0000 7f5569d2c640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f555006be30 0x7f555006e2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5558034000 tx=0x7f555802e000 comp rx=0 tx=0).stop 2024-09-11T22:16:34.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.445+0000 7f5569d2c640 1 -- 172.21.15.50:0/2936703873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d1c90 msgr2=0x7f55640cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.445+0000 7f5569d2c640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d1c90 0x7f55640cc2d0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f555400c400 tx=0x7f555400c8c0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.445+0000 7f5569d2c640 1 -- 172.21.15.50:0/2936703873 shutdown_connections 2024-09-11T22:16:34.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.445+0000 7f5569d2c640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f555006be30 0x7f555006e2f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.445+0000 7f5569d2c640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f556415e8e0 0x7f55641e8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.445+0000 7f5569d2c640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5564162350 0x7f55641f44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.445+0000 7f5569d2c640 1 --2- 172.21.15.50:0/2936703873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d1c90 0x7f55640cc2d0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.445+0000 7f5569d2c640 1 -- 172.21.15.50:0/2936703873 >> 172.21.15.50:0/2936703873 conn(0x7f5564067ba0 msgr2=0x7f556415f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:34.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.445+0000 7f5569d2c640 1 -- 172.21.15.50:0/2936703873 shutdown_connections 2024-09-11T22:16:34.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.445+0000 7f5569d2c640 1 -- 172.21.15.50:0/2936703873 wait complete. 2024-09-11T22:16:34.462 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-09-11T22:16:33.441287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590514,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":281500,"kb_used_data":11164,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754693220,"statfs":{"total":773094113280,"available":772805857280,"internally_reserved":0,"allocated":11431936,"data_stored":5628571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":146,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.326892"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.138729+0000","last_change":"2024-09-11T22:16:31.132072+0000","last_active":"2024-09-11T22:16:31.138729+0000","last_peered":"2024-09-11T22:16:31.138729+0000","last_clean":"2024-09-11T22:16:31.138729+0000","last_became_active":"2024-09-11T22:16:31.131809+0000","last_became_peered":"2024-09-11T22:16:31.131809+0000","last_unstale":"2024-09-11T22:16:31.138729+0000","last_undegraded":"2024-09-11T22:16:31.138729+0000","last_fullsized":"2024-09-11T22:16:31.138729+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:52.397280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143058+0000","last_change":"2024-09-11T22:16:31.140404+0000","last_active":"2024-09-11T22:16:31.143058+0000","last_peered":"2024-09-11T22:16:31.143058+0000","last_clean":"2024-09-11T22:16:31.143058+0000","last_became_active":"2024-09-11T22:16:31.140115+0000","last_became_peered":"2024-09-11T22:16:31.140115+0000","last_unstale":"2024-09-11T22:16:31.143058+0000","last_undegraded":"2024-09-11T22:16:31.143058+0000","last_fullsized":"2024-09-11T22:16:31.143058+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.356920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.139774+0000","last_change":"2024-09-11T22:16:31.137742+0000","last_active":"2024-09-11T22:16:31.139774+0000","last_peered":"2024-09-11T22:16:31.139774+0000","last_clean":"2024-09-11T22:16:31.139774+0000","last_became_active":"2024-09-11T22:16:31.137465+0000","last_became_peered":"2024-09-11T22:16:31.137465+0000","last_unstale":"2024-09-11T22:16:31.139774+0000","last_undegraded":"2024-09-11T22:16:31.139774+0000","last_fullsized":"2024-09-11T22:16:31.139774+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.302219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.141824+0000","last_change":"2024-09-11T22:16:31.139945+0000","last_active":"2024-09-11T22:16:31.141824+0000","last_peered":"2024-09-11T22:16:31.141824+0000","last_clean":"2024-09-11T22:16:31.141824+0000","last_became_active":"2024-09-11T22:16:31.139641+0000","last_became_peered":"2024-09-11T22:16:31.139641+0000","last_unstale":"2024-09-11T22:16:31.141824+0000","last_undegraded":"2024-09-11T22:16:31.141824+0000","last_fullsized":"2024-09-11T22:16:31.141824+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:39.961376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.139900+0000","last_change":"2024-09-11T22:16:31.137051+0000","last_active":"2024-09-11T22:16:31.139900+0000","last_peered":"2024-09-11T22:16:31.139900+0000","last_clean":"2024-09-11T22:16:31.139900+0000","last_became_active":"2024-09-11T22:16:31.136536+0000","last_became_peered":"2024-09-11T22:16:31.136536+0000","last_unstale":"2024-09-11T22:16:31.139900+0000","last_undegraded":"2024-09-11T22:16:31.139900+0000","last_fullsized":"2024-09-11T22:16:31.139900+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:43.578171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.153935+0000","last_change":"2024-09-11T22:16:31.152030+0000","last_active":"2024-09-11T22:16:31.153935+0000","last_peered":"2024-09-11T22:16:31.153935+0000","last_clean":"2024-09-11T22:16:31.153935+0000","last_became_active":"2024-09-11T22:16:31.151734+0000","last_became_peered":"2024-09-11T22:16:31.151734+0000","last_unstale":"2024-09-11T22:16:31.153935+0000","last_undegraded":"2024-09-11T22:16:31.153935+0000","last_fullsized":"2024-09-11T22:16:31.153935+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:15.537243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.147925+0000","last_change":"2024-09-11T22:16:31.146858+0000","last_active":"2024-09-11T22:16:31.147925+0000","last_peered":"2024-09-11T22:16:31.147925+0000","last_clean":"2024-09-11T22:16:31.147925+0000","last_became_active":"2024-09-11T22:16:31.146546+0000","last_became_peered":"2024-09-11T22:16:31.146546+0000","last_unstale":"2024-09-11T22:16:31.147925+0000","last_undegraded":"2024-09-11T22:16:31.147925+0000","last_fullsized":"2024-09-11T22:16:31.147925+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:54.212790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.148740+0000","last_change":"2024-09-11T22:16:31.147334+0000","last_active":"2024-09-11T22:16:31.148740+0000","last_peered":"2024-09-11T22:16:31.148740+0000","last_clean":"2024-09-11T22:16:31.148740+0000","last_became_active":"2024-09-11T22:16:31.147006+0000","last_became_peered":"2024-09-11T22:16:31.147006+0000","last_unstale":"2024-09-11T22:16:31.148740+0000","last_undegraded":"2024-09-11T22:16:31.148740+0000","last_fullsized":"2024-09-11T22:16:31.148740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:57.368631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143172+0000","last_change":"2024-09-11T22:16:31.142015+0000","last_active":"2024-09-11T22:16:31.143172+0000","last_peered":"2024-09-11T22:16:31.143172+0000","last_clean":"2024-09-11T22:16:31.143172+0000","last_became_active":"2024-09-11T22:16:31.141425+0000","last_became_peered":"2024-09-11T22:16:31.141425+0000","last_unstale":"2024-09-11T22:16:31.143172+0000","last_undegraded":"2024-09-11T22:16:31.143172+0000","last_fullsized":"2024-09-11T22:16:31.143172+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:43:35.268521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.151425+0000","last_change":"2024-09-11T22:16:31.149706+0000","last_active":"2024-09-11T22:16:31.151425+0000","last_peered":"2024-09-11T22:16:31.151425+0000","last_clean":"2024-09-11T22:16:31.151425+0000","last_became_active":"2024-09-11T22:16:31.149426+0000","last_became_peered":"2024-09-11T22:16:31.149426+0000","last_unstale":"2024-09-11T22:16:31.151425+0000","last_undegraded":"2024-09-11T22:16:31.151425+0000","last_fullsized":"2024-09-11T22:16:31.151425+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:25.619855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.146070+0000","last_change":"2024-09-11T22:16:31.144398+0000","last_active":"2024-09-11T22:16:31.146070+0000","last_peered":"2024-09-11T22:16:31.146070+0000","last_clean":"2024-09-11T22:16:31.146070+0000","last_became_active":"2024-09-11T22:16:31.144121+0000","last_became_peered":"2024-09-11T22:16:31.144121+0000","last_unstale":"2024-09-11T22:16:31.146070+0000","last_undegraded":"2024-09-11T22:16:31.146070+0000","last_fullsized":"2024-09-11T22:16:31.146070+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:17.118335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.120990+0000","last_change":"2024-09-11T22:16:29.120990+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.120990+0000","last_undegraded":"2024-09-11T22:16:29.120990+0000","last_fullsized":"2024-09-11T22:16:29.120990+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.147427+0000","last_change":"2024-09-11T22:16:30.144070+0000","last_active":"2024-09-11T22:16:31.147427+0000","last_peered":"2024-09-11T22:16:31.147427+0000","last_clean":"2024-09-11T22:16:31.147427+0000","last_became_active":"2024-09-11T22:16:30.143809+0000","last_became_peered":"2024-09-11T22:16:30.143809+0000","last_unstale":"2024-09-11T22:16:31.147427+0000","last_undegraded":"2024-09-11T22:16:31.147427+0000","last_fullsized":"2024-09-11T22:16:31.147427+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:26.892307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118962+0000","last_change":"2024-09-11T22:16:29.118962+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118962+0000","last_undegraded":"2024-09-11T22:16:29.118962+0000","last_fullsized":"2024-09-11T22:16:29.118962+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118940+0000","last_change":"2024-09-11T22:16:29.118940+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118940+0000","last_undegraded":"2024-09-11T22:16:29.118940+0000","last_fullsized":"2024-09-11T22:16:29.118940+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.119109+0000","last_change":"2024-09-11T22:16:29.119109+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.119109+0000","last_undegraded":"2024-09-11T22:16:29.119109+0000","last_fullsized":"2024-09-11T22:16:29.119109+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143099+0000","last_change":"2024-09-11T22:16:31.141412+0000","last_active":"2024-09-11T22:16:31.143099+0000","last_peered":"2024-09-11T22:16:31.143099+0000","last_clean":"2024-09-11T22:16:31.143099+0000","last_became_active":"2024-09-11T22:16:31.140411+0000","last_became_peered":"2024-09-11T22:16:31.140411+0000","last_unstale":"2024-09-11T22:16:31.143099+0000","last_undegraded":"2024-09-11T22:16:31.143099+0000","last_fullsized":"2024-09-11T22:16:31.143099+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:40.247355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118456+0000","last_change":"2024-09-11T22:16:29.118456+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118456+0000","last_undegraded":"2024-09-11T22:16:29.118456+0000","last_fullsized":"2024-09-11T22:16:29.118456+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118293+0000","last_change":"2024-09-11T22:16:29.118293+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118293+0000","last_undegraded":"2024-09-11T22:16:29.118293+0000","last_fullsized":"2024-09-11T22:16:29.118293+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.120024+0000","last_change":"2024-09-11T22:16:29.120024+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.120024+0000","last_undegraded":"2024-09-11T22:16:29.120024+0000","last_fullsized":"2024-09-11T22:16:29.120024+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118586+0000","last_change":"2024-09-11T22:16:29.118586+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118586+0000","last_undegraded":"2024-09-11T22:16:29.118586+0000","last_fullsized":"2024-09-11T22:16:29.118586+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.119119+0000","last_change":"2024-09-11T22:16:29.119119+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.119119+0000","last_undegraded":"2024-09-11T22:16:29.119119+0000","last_fullsized":"2024-09-11T22:16:29.119119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"106'3","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143269+0000","last_change":"2024-09-11T22:16:30.138863+0000","last_active":"2024-09-11T22:16:31.143269+0000","last_peered":"2024-09-11T22:16:31.143269+0000","last_clean":"2024-09-11T22:16:31.143269+0000","last_became_active":"2024-09-11T22:16:30.138546+0000","last_became_peered":"2024-09-11T22:16:30.138546+0000","last_unstale":"2024-09-11T22:16:31.143269+0000","last_undegraded":"2024-09-11T22:16:31.143269+0000","last_fullsized":"2024-09-11T22:16:31.143269+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.751700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.144921+0000","last_change":"2024-09-11T22:16:31.142601+0000","last_active":"2024-09-11T22:16:31.144921+0000","last_peered":"2024-09-11T22:16:31.144921+0000","last_clean":"2024-09-11T22:16:31.144921+0000","last_became_active":"2024-09-11T22:16:31.142307+0000","last_became_peered":"2024-09-11T22:16:31.142307+0000","last_unstale":"2024-09-11T22:16:31.144921+0000","last_undegraded":"2024-09-11T22:16:31.144921+0000","last_fullsized":"2024-09-11T22:16:31.144921+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:58.641376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116627+0000","last_change":"2024-09-11T22:16:29.116627+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116627+0000","last_undegraded":"2024-09-11T22:16:29.116627+0000","last_fullsized":"2024-09-11T22:16:29.116627+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.145740+0000","last_change":"2024-09-11T22:16:30.134072+0000","last_active":"2024-09-11T22:16:31.145740+0000","last_peered":"2024-09-11T22:16:31.145740+0000","last_clean":"2024-09-11T22:16:31.145740+0000","last_became_active":"2024-09-11T22:16:30.133756+0000","last_became_peered":"2024-09-11T22:16:30.133756+0000","last_unstale":"2024-09-11T22:16:31.145740+0000","last_undegraded":"2024-09-11T22:16:31.145740+0000","last_fullsized":"2024-09-11T22:16:31.145740+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:40.093900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.134219+0000","last_change":"2024-09-11T22:16:30.134404+0000","last_active":"2024-09-11T22:16:31.134219+0000","last_peered":"2024-09-11T22:16:31.134219+0000","last_clean":"2024-09-11T22:16:31.134219+0000","last_became_active":"2024-09-11T22:16:30.133816+0000","last_became_peered":"2024-09-11T22:16:30.133816+0000","last_unstale":"2024-09-11T22:16:31.134219+0000","last_undegraded":"2024-09-11T22:16:31.134219+0000","last_fullsized":"2024-09-11T22:16:31.134219+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:51:29.870433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116140+0000","last_change":"2024-09-11T22:16:29.116140+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116140+0000","last_undegraded":"2024-09-11T22:16:29.116140+0000","last_fullsized":"2024-09-11T22:16:29.116140+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.146201+0000","last_change":"2024-09-11T22:16:31.144771+0000","last_active":"2024-09-11T22:16:31.146201+0000","last_peered":"2024-09-11T22:16:31.146201+0000","last_clean":"2024-09-11T22:16:31.146201+0000","last_became_active":"2024-09-11T22:16:31.144465+0000","last_became_peered":"2024-09-11T22:16:31.144465+0000","last_unstale":"2024-09-11T22:16:31.146201+0000","last_undegraded":"2024-09-11T22:16:31.146201+0000","last_fullsized":"2024-09-11T22:16:31.146201+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:18.425428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.119594+0000","last_change":"2024-09-11T22:16:29.119594+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.119594+0000","last_undegraded":"2024-09-11T22:16:29.119594+0000","last_fullsized":"2024-09-11T22:16:29.119594+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116342+0000","last_change":"2024-09-11T22:16:29.116342+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116342+0000","last_undegraded":"2024-09-11T22:16:29.116342+0000","last_fullsized":"2024-09-11T22:16:29.116342+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118293+0000","last_change":"2024-09-11T22:16:29.118293+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118293+0000","last_undegraded":"2024-09-11T22:16:29.118293+0000","last_fullsized":"2024-09-11T22:16:29.118293+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143155+0000","last_change":"2024-09-11T22:16:31.140281+0000","last_active":"2024-09-11T22:16:31.143155+0000","last_peered":"2024-09-11T22:16:31.143155+0000","last_clean":"2024-09-11T22:16:31.143155+0000","last_became_active":"2024-09-11T22:16:31.139962+0000","last_became_peered":"2024-09-11T22:16:31.139962+0000","last_unstale":"2024-09-11T22:16:31.143155+0000","last_undegraded":"2024-09-11T22:16:31.143155+0000","last_fullsized":"2024-09-11T22:16:31.143155+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:54.782458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118335+0000","last_change":"2024-09-11T22:16:29.118335+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118335+0000","last_undegraded":"2024-09-11T22:16:29.118335+0000","last_fullsized":"2024-09-11T22:16:29.118335+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.149170+0000","last_change":"2024-09-11T22:16:31.148199+0000","last_active":"2024-09-11T22:16:31.149170+0000","last_peered":"2024-09-11T22:16:31.149170+0000","last_clean":"2024-09-11T22:16:31.149170+0000","last_became_active":"2024-09-11T22:16:31.147855+0000","last_became_peered":"2024-09-11T22:16:31.147855+0000","last_unstale":"2024-09-11T22:16:31.149170+0000","last_undegraded":"2024-09-11T22:16:31.149170+0000","last_fullsized":"2024-09-11T22:16:31.149170+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:55.514563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118028+0000","last_change":"2024-09-11T22:16:29.118028+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118028+0000","last_undegraded":"2024-09-11T22:16:29.118028+0000","last_fullsized":"2024-09-11T22:16:29.118028+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.152225+0000","last_change":"2024-09-11T22:16:31.151401+0000","last_active":"2024-09-11T22:16:31.152225+0000","last_peered":"2024-09-11T22:16:31.152225+0000","last_clean":"2024-09-11T22:16:31.152225+0000","last_became_active":"2024-09-11T22:16:31.151128+0000","last_became_peered":"2024-09-11T22:16:31.151128+0000","last_unstale":"2024-09-11T22:16:31.152225+0000","last_undegraded":"2024-09-11T22:16:31.152225+0000","last_fullsized":"2024-09-11T22:16:31.152225+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:32.506418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116099+0000","last_change":"2024-09-11T22:16:29.116099+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116099+0000","last_undegraded":"2024-09-11T22:16:29.116099+0000","last_fullsized":"2024-09-11T22:16:29.116099+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.149922+0000","last_change":"2024-09-11T22:16:31.148915+0000","last_active":"2024-09-11T22:16:31.149922+0000","last_peered":"2024-09-11T22:16:31.149922+0000","last_clean":"2024-09-11T22:16:31.149922+0000","last_became_active":"2024-09-11T22:16:31.148608+0000","last_became_peered":"2024-09-11T22:16:31.148608+0000","last_unstale":"2024-09-11T22:16:31.149922+0000","last_undegraded":"2024-09-11T22:16:31.149922+0000","last_fullsized":"2024-09-11T22:16:31.149922+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:08.215053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116147+0000","last_change":"2024-09-11T22:16:29.116147+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116147+0000","last_undegraded":"2024-09-11T22:16:29.116147+0000","last_fullsized":"2024-09-11T22:16:29.116147+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.117035+0000","last_change":"2024-09-11T22:16:29.117035+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.117035+0000","last_undegraded":"2024-09-11T22:16:29.117035+0000","last_fullsized":"2024-09-11T22:16:29.117035+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116095+0000","last_change":"2024-09-11T22:16:29.116095+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116095+0000","last_undegraded":"2024-09-11T22:16:29.116095+0000","last_fullsized":"2024-09-11T22:16:29.116095+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.117105+0000","last_change":"2024-09-11T22:16:29.117105+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.117105+0000","last_undegraded":"2024-09-11T22:16:29.117105+0000","last_fullsized":"2024-09-11T22:16:29.117105+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.117235+0000","last_change":"2024-09-11T22:16:29.117235+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.117235+0000","last_undegraded":"2024-09-11T22:16:29.117235+0000","last_fullsized":"2024-09-11T22:16:29.117235+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118212+0000","last_change":"2024-09-11T22:16:29.118212+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118212+0000","last_undegraded":"2024-09-11T22:16:29.118212+0000","last_fullsized":"2024-09-11T22:16:29.118212+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.148062+0000","last_change":"2024-09-11T22:16:31.146357+0000","last_active":"2024-09-11T22:16:31.148062+0000","last_peered":"2024-09-11T22:16:31.148062+0000","last_clean":"2024-09-11T22:16:31.148062+0000","last_became_active":"2024-09-11T22:16:31.146047+0000","last_became_peered":"2024-09-11T22:16:31.146047+0000","last_unstale":"2024-09-11T22:16:31.148062+0000","last_undegraded":"2024-09-11T22:16:31.148062+0000","last_fullsized":"2024-09-11T22:16:31.148062+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:48.155167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.117025+0000","last_change":"2024-09-11T22:16:29.117025+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.117025+0000","last_undegraded":"2024-09-11T22:16:29.117025+0000","last_fullsized":"2024-09-11T22:16:29.117025+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118227+0000","last_change":"2024-09-11T22:16:29.118227+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118227+0000","last_undegraded":"2024-09-11T22:16:29.118227+0000","last_fullsized":"2024-09-11T22:16:29.118227+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.146406+0000","last_change":"2024-09-11T22:16:31.145558+0000","last_active":"2024-09-11T22:16:31.146406+0000","last_peered":"2024-09-11T22:16:31.146406+0000","last_clean":"2024-09-11T22:16:31.146406+0000","last_became_active":"2024-09-11T22:16:31.145190+0000","last_became_peered":"2024-09-11T22:16:31.145190+0000","last_unstale":"2024-09-11T22:16:31.146406+0000","last_undegraded":"2024-09-11T22:16:31.146406+0000","last_fullsized":"2024-09-11T22:16:31.146406+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:10.428833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118759+0000","last_change":"2024-09-11T22:16:29.118759+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118759+0000","last_undegraded":"2024-09-11T22:16:29.118759+0000","last_fullsized":"2024-09-11T22:16:29.118759+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.132339+0000","last_change":"2024-09-11T22:16:30.134155+0000","last_active":"2024-09-11T22:16:31.132339+0000","last_peered":"2024-09-11T22:16:31.132339+0000","last_clean":"2024-09-11T22:16:31.132339+0000","last_became_active":"2024-09-11T22:16:30.133835+0000","last_became_peered":"2024-09-11T22:16:30.133835+0000","last_unstale":"2024-09-11T22:16:31.132339+0000","last_undegraded":"2024-09-11T22:16:31.132339+0000","last_fullsized":"2024-09-11T22:16:31.132339+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:58.593480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.151440+0000","last_change":"2024-09-11T22:16:31.149781+0000","last_active":"2024-09-11T22:16:31.151440+0000","last_peered":"2024-09-11T22:16:31.151440+0000","last_clean":"2024-09-11T22:16:31.151440+0000","last_became_active":"2024-09-11T22:16:31.149416+0000","last_became_peered":"2024-09-11T22:16:31.149416+0000","last_unstale":"2024-09-11T22:16:31.151440+0000","last_undegraded":"2024-09-11T22:16:31.151440+0000","last_fullsized":"2024-09-11T22:16:31.151440+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:46.290268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.144821+0000","last_change":"2024-09-11T22:16:30.140162+0000","last_active":"2024-09-11T22:16:31.144821+0000","last_peered":"2024-09-11T22:16:31.144821+0000","last_clean":"2024-09-11T22:16:31.144821+0000","last_became_active":"2024-09-11T22:16:30.139889+0000","last_became_peered":"2024-09-11T22:16:30.139889+0000","last_unstale":"2024-09-11T22:16:31.144821+0000","last_undegraded":"2024-09-11T22:16:31.144821+0000","last_fullsized":"2024-09-11T22:16:31.144821+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:07.047344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":325,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.127585+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:16:31.127585+0000","last_peered":"2024-09-11T22:16:31.127585+0000","last_clean":"2024-09-11T22:16:31.127585+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:16:31.127585+0000","last_undegraded":"2024-09-11T22:16:31.127585+0000","last_fullsized":"2024-09-11T22:16:31.127585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":2},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":146,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36596,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335244,"statfs":{"total":96636764160,"available":96599289856,"internally_reserved":0,"allocated":1277952,"data_stored":555004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36584,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335256,"statfs":{"total":96636764160,"available":96599302144,"internally_reserved":0,"allocated":1265664,"data_stored":549187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40760,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331080,"statfs":{"total":96636764160,"available":96595025920,"internally_reserved":0,"allocated":1277952,"data_stored":555004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1265664,"data_stored":549187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1277952,"data_stored":555004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41336,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330504,"statfs":{"total":96636764160,"available":96594436096,"internally_reserved":0,"allocated":1871872,"data_stored":1145372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41376,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330464,"statfs":{"total":96636764160,"available":96594395136,"internally_reserved":0,"allocated":1904640,"data_stored":1158534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1290240,"data_stored":561279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:16:34.469 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:16:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.606+0000 7f7f7697f640 1 Processor -- start 2024-09-11T22:16:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.606+0000 7f7f7697f640 1 -- start start 2024-09-11T22:16:34.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.607+0000 7f7f7697f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f700cf610 0x7f7f700b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.607+0000 7f7f7697f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f700cfbd0 con 0x7f7f70161fa0 2024-09-11T22:16:34.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.607+0000 7f7f7697f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f700cfeb0 con 0x7f7f700b1600 2024-09-11T22:16:34.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.607+0000 7f7f7697f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f700d1220 con 0x7f7f700cf610 2024-09-11T22:16:34.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.607+0000 7f7f6ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7f70161fa0 0x7f7f700cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49646/0 (socket says 172.21.15.50:49646) 2024-09-11T22:16:34.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.607+0000 7f7f6ffff640 1 -- 172.21.15.50:0/2107504839 learned_addr learned my addr 172.21.15.50:0/2107504839 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:34.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.607+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1745589158 0 0) 0x7f7f700cfbd0 con 0x7f7f70161fa0 2024-09-11T22:16:34.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.607+0000 7f7f6f7fe640 1 --2- 172.21.15.50:0/2107504839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f700cf610 0x7f7f700b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.607+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f58003520 con 0x7f7f70161fa0 2024-09-11T22:16:34.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4072555054 0 0) 0x7f7f58003520 con 0x7f7f70161fa0 2024-09-11T22:16:34.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f700cf610 msgr2=0x7f7f700b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:34.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6effd640 1 --2- 172.21.15.50:0/2107504839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f700cf610 0x7f7f700b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 >> v1:172.21.15.77:6789/0 conn(0x7f7f700b1600 legacy=0x7f7f700cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f700d1470 con 0x7f7f70161fa0 2024-09-11T22:16:34.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f7f60001670 con 0x7f7f70161fa0 2024-09-11T22:16:34.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 >> v1:172.21.15.50:6789/0 conn(0x7f7f70161fa0 legacy=0x7f7f700cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6effd640 1 --2- 172.21.15.50:0/2107504839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f700cf610 0x7f7f580039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6effd640 1 --2- 172.21.15.50:0/2107504839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f58003f60 0x7f7f58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6effd640 1 --2- 172.21.15.50:0/2107504839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f58004d40 0x7f7f580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f700d1220 con 0x7f7f58004d40 2024-09-11T22:16:34.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5800baa0 con 0x7f7f58003f60 2024-09-11T22:16:34.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5800bca0 con 0x7f7f700cf610 2024-09-11T22:16:34.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f74f1c640 1 --2- 172.21.15.50:0/2107504839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f58004d40 0x7f7f580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6ffff640 1 --2- 172.21.15.50:0/2107504839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f700cf610 0x7f7f580039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f6f7fe640 1 --2- 172.21.15.50:0/2107504839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f58003f60 0x7f7f58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f74f1c640 1 -- 172.21.15.50:0/2107504839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f700cf610 msgr2=0x7f7f580039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:34.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f74f1c640 1 --2- 172.21.15.50:0/2107504839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f700cf610 0x7f7f580039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f74f1c640 1 -- 172.21.15.50:0/2107504839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f58003f60 msgr2=0x7f7f58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:34.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f74f1c640 1 --2- 172.21.15.50:0/2107504839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f58003f60 0x7f7f58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.608+0000 7f7f74f1c640 1 -- 172.21.15.50:0/2107504839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f58003520 con 0x7f7f58004d40 2024-09-11T22:16:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.609+0000 7f7f74f1c640 1 --2- 172.21.15.50:0/2107504839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f58004d40 0x7f7f580051c0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f7f68001e50 tx=0x7f7f58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50118a921efc1cee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.609+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f68001a70 con 0x7f7f58004d40 2024-09-11T22:16:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.609+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f68003970 con 0x7f7f58004d40 2024-09-11T22:16:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.609+0000 7f7f6effd640 1 -- 172.21.15.50:0/2107504839 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f68003d60 con 0x7f7f58004d40 2024-09-11T22:16:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.609+0000 7f7f7697f640 1 -- 172.21.15.50:0/2107504839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f58004d40 msgr2=0x7f7f580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.609+0000 7f7f7697f640 1 --2- 172.21.15.50:0/2107504839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f58004d40 0x7f7f580051c0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f7f68001e50 tx=0x7f7f58005830 comp rx=0 tx=0).stop 2024-09-11T22:16:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.610+0000 7f7f74f1c640 1 -- 172.21.15.50:0/2107504839 reap_dead start 2024-09-11T22:16:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.610+0000 7f7f7697f640 1 -- 172.21.15.50:0/2107504839 shutdown_connections 2024-09-11T22:16:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.610+0000 7f7f7697f640 1 -- 172.21.15.50:0/2107504839 >> 172.21.15.50:0/2107504839 conn(0x7f7f7009ba50 msgr2=0x7f7f700b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:34.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.610+0000 7f7f7697f640 1 -- 172.21.15.50:0/2107504839 shutdown_connections 2024-09-11T22:16:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.610+0000 7f7f7697f640 1 -- 172.21.15.50:0/2107504839 wait complete. 2024-09-11T22:16:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.611+0000 7f7f7697f640 1 Processor -- start 2024-09-11T22:16:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.611+0000 7f7f7697f640 1 -- start start 2024-09-11T22:16:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f7697f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f701f3940 0x7f7f700ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f7697f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f701f3d20 0x7f7f700cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f7697f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f70159e40 0x7f7f700cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f7697f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f700d1c70 con 0x7f7f701f3d20 2024-09-11T22:16:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f7697f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f700d17e0 con 0x7f7f701f3940 2024-09-11T22:16:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f7697f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f700d1df0 con 0x7f7f70159e40 2024-09-11T22:16:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f6f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f701f3d20 0x7f7f700cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f6f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f701f3d20 0x7f7f700cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56970/0 (socket says 172.21.15.50:56970) 2024-09-11T22:16:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f6f7fe640 1 -- 172.21.15.50:0/739020877 learned_addr learned my addr 172.21.15.50:0/739020877 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:34.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f6ffff640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f701f3940 0x7f7f700ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f74f1c640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f70159e40 0x7f7f700cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f6f7fe640 1 -- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f70159e40 msgr2=0x7f7f700cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f6f7fe640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f70159e40 0x7f7f700cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f6f7fe640 1 -- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f701f3940 msgr2=0x7f7f700ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f6f7fe640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f701f3940 0x7f7f700ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f6f7fe640 1 -- 172.21.15.50:0/739020877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f700b6c10 con 0x7f7f701f3d20 2024-09-11T22:16:34.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f6ffff640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f701f3940 0x7f7f700ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:34.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.612+0000 7f7f6f7fe640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f701f3d20 0x7f7f700cb8a0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f7f64011940 tx=0x7f7f64011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:34.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.613+0000 7f7f6cff9640 1 -- 172.21.15.50:0/739020877 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400faf0 con 0x7f7f701f3d20 2024-09-11T22:16:34.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.613+0000 7f7f6cff9640 1 -- 172.21.15.50:0/739020877 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6400fc90 con 0x7f7f701f3d20 2024-09-11T22:16:34.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.613+0000 7f7f7697f640 1 -- 172.21.15.50:0/739020877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f700ca7f0 con 0x7f7f701f3d20 2024-09-11T22:16:34.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.613+0000 7f7f6cff9640 1 -- 172.21.15.50:0/739020877 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64014440 con 0x7f7f701f3d20 2024-09-11T22:16:34.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.613+0000 7f7f7697f640 1 -- 172.21.15.50:0/739020877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f700b6e90 con 0x7f7f701f3d20 2024-09-11T22:16:34.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.614+0000 7f7f7697f640 1 -- 172.21.15.50:0/739020877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f700b4d20 con 0x7f7f701f3d20 2024-09-11T22:16:34.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.614+0000 7f7f6cff9640 1 -- 172.21.15.50:0/739020877 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f64012040 con 0x7f7f701f3d20 2024-09-11T22:16:34.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.615+0000 7f7f6cff9640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f5c06be60 0x7f7f5c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.615+0000 7f7f6cff9640 1 -- 172.21.15.50:0/739020877 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f7f6408b500 con 0x7f7f701f3d20 2024-09-11T22:16:34.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.615+0000 7f7f6ffff640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f5c06be60 0x7f7f5c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.616+0000 7f7f6ffff640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f5c06be60 0x7f7f5c06e320 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7f60001eb0 tx=0x7f7f60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:34.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.619+0000 7f7f6cff9640 1 -- 172.21.15.50:0/739020877 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f700b6c10 con 0x7f7f701f3d20 2024-09-11T22:16:34.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.795+0000 7f7f7697f640 1 -- 172.21.15.50:0/739020877 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f70070fa0 con 0x7f7f5c06be60 2024-09-11T22:16:34.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.801+0000 7f7f6cff9640 1 -- 172.21.15.50:0/739020877 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243692 (secure 0 0 0) 0x7f7f70070fa0 con 0x7f7f5c06be60 2024-09-11T22:16:34.804 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:34.805 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:16:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.804+0000 7f7f7697f640 1 -- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f5c06be60 msgr2=0x7f7f5c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.804+0000 7f7f7697f640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f5c06be60 0x7f7f5c06e320 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7f60001eb0 tx=0x7f7f60009040 comp rx=0 tx=0).stop 2024-09-11T22:16:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.804+0000 7f7f7697f640 1 -- 172.21.15.50:0/739020877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f701f3d20 msgr2=0x7f7f700cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.804+0000 7f7f7697f640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f701f3d20 0x7f7f700cb8a0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f7f64011940 tx=0x7f7f64011e00 comp rx=0 tx=0).stop 2024-09-11T22:16:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.804+0000 7f7f7697f640 1 -- 172.21.15.50:0/739020877 shutdown_connections 2024-09-11T22:16:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.804+0000 7f7f7697f640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7f5c06be60 0x7f7f5c06e320 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.804+0000 7f7f7697f640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f70159e40 0x7f7f700cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.804+0000 7f7f7697f640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f701f3d20 0x7f7f700cb8a0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.804+0000 7f7f7697f640 1 --2- 172.21.15.50:0/739020877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f701f3940 0x7f7f700ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.804+0000 7f7f7697f640 1 -- 172.21.15.50:0/739020877 >> 172.21.15.50:0/739020877 conn(0x7f7f7009ba50 msgr2=0x7f7f7006c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.804+0000 7f7f7697f640 1 -- 172.21.15.50:0/739020877 shutdown_connections 2024-09-11T22:16:34.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.804+0000 7f7f7697f640 1 -- 172.21.15.50:0/739020877 wait complete. 2024-09-11T22:16:34.816 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-09-11T22:16:33.441287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590514,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":281500,"kb_used_data":11164,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754693220,"statfs":{"total":773094113280,"available":772805857280,"internally_reserved":0,"allocated":11431936,"data_stored":5628571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":146,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.326892"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.138729+0000","last_change":"2024-09-11T22:16:31.132072+0000","last_active":"2024-09-11T22:16:31.138729+0000","last_peered":"2024-09-11T22:16:31.138729+0000","last_clean":"2024-09-11T22:16:31.138729+0000","last_became_active":"2024-09-11T22:16:31.131809+0000","last_became_peered":"2024-09-11T22:16:31.131809+0000","last_unstale":"2024-09-11T22:16:31.138729+0000","last_undegraded":"2024-09-11T22:16:31.138729+0000","last_fullsized":"2024-09-11T22:16:31.138729+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:52.397280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143058+0000","last_change":"2024-09-11T22:16:31.140404+0000","last_active":"2024-09-11T22:16:31.143058+0000","last_peered":"2024-09-11T22:16:31.143058+0000","last_clean":"2024-09-11T22:16:31.143058+0000","last_became_active":"2024-09-11T22:16:31.140115+0000","last_became_peered":"2024-09-11T22:16:31.140115+0000","last_unstale":"2024-09-11T22:16:31.143058+0000","last_undegraded":"2024-09-11T22:16:31.143058+0000","last_fullsized":"2024-09-11T22:16:31.143058+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.356920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.139774+0000","last_change":"2024-09-11T22:16:31.137742+0000","last_active":"2024-09-11T22:16:31.139774+0000","last_peered":"2024-09-11T22:16:31.139774+0000","last_clean":"2024-09-11T22:16:31.139774+0000","last_became_active":"2024-09-11T22:16:31.137465+0000","last_became_peered":"2024-09-11T22:16:31.137465+0000","last_unstale":"2024-09-11T22:16:31.139774+0000","last_undegraded":"2024-09-11T22:16:31.139774+0000","last_fullsized":"2024-09-11T22:16:31.139774+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.302219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.141824+0000","last_change":"2024-09-11T22:16:31.139945+0000","last_active":"2024-09-11T22:16:31.141824+0000","last_peered":"2024-09-11T22:16:31.141824+0000","last_clean":"2024-09-11T22:16:31.141824+0000","last_became_active":"2024-09-11T22:16:31.139641+0000","last_became_peered":"2024-09-11T22:16:31.139641+0000","last_unstale":"2024-09-11T22:16:31.141824+0000","last_undegraded":"2024-09-11T22:16:31.141824+0000","last_fullsized":"2024-09-11T22:16:31.141824+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:39.961376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.139900+0000","last_change":"2024-09-11T22:16:31.137051+0000","last_active":"2024-09-11T22:16:31.139900+0000","last_peered":"2024-09-11T22:16:31.139900+0000","last_clean":"2024-09-11T22:16:31.139900+0000","last_became_active":"2024-09-11T22:16:31.136536+0000","last_became_peered":"2024-09-11T22:16:31.136536+0000","last_unstale":"2024-09-11T22:16:31.139900+0000","last_undegraded":"2024-09-11T22:16:31.139900+0000","last_fullsized":"2024-09-11T22:16:31.139900+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:43.578171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.153935+0000","last_change":"2024-09-11T22:16:31.152030+0000","last_active":"2024-09-11T22:16:31.153935+0000","last_peered":"2024-09-11T22:16:31.153935+0000","last_clean":"2024-09-11T22:16:31.153935+0000","last_became_active":"2024-09-11T22:16:31.151734+0000","last_became_peered":"2024-09-11T22:16:31.151734+0000","last_unstale":"2024-09-11T22:16:31.153935+0000","last_undegraded":"2024-09-11T22:16:31.153935+0000","last_fullsized":"2024-09-11T22:16:31.153935+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:15.537243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.147925+0000","last_change":"2024-09-11T22:16:31.146858+0000","last_active":"2024-09-11T22:16:31.147925+0000","last_peered":"2024-09-11T22:16:31.147925+0000","last_clean":"2024-09-11T22:16:31.147925+0000","last_became_active":"2024-09-11T22:16:31.146546+0000","last_became_peered":"2024-09-11T22:16:31.146546+0000","last_unstale":"2024-09-11T22:16:31.147925+0000","last_undegraded":"2024-09-11T22:16:31.147925+0000","last_fullsized":"2024-09-11T22:16:31.147925+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:54.212790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.148740+0000","last_change":"2024-09-11T22:16:31.147334+0000","last_active":"2024-09-11T22:16:31.148740+0000","last_peered":"2024-09-11T22:16:31.148740+0000","last_clean":"2024-09-11T22:16:31.148740+0000","last_became_active":"2024-09-11T22:16:31.147006+0000","last_became_peered":"2024-09-11T22:16:31.147006+0000","last_unstale":"2024-09-11T22:16:31.148740+0000","last_undegraded":"2024-09-11T22:16:31.148740+0000","last_fullsized":"2024-09-11T22:16:31.148740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:57.368631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143172+0000","last_change":"2024-09-11T22:16:31.142015+0000","last_active":"2024-09-11T22:16:31.143172+0000","last_peered":"2024-09-11T22:16:31.143172+0000","last_clean":"2024-09-11T22:16:31.143172+0000","last_became_active":"2024-09-11T22:16:31.141425+0000","last_became_peered":"2024-09-11T22:16:31.141425+0000","last_unstale":"2024-09-11T22:16:31.143172+0000","last_undegraded":"2024-09-11T22:16:31.143172+0000","last_fullsized":"2024-09-11T22:16:31.143172+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:43:35.268521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.151425+0000","last_change":"2024-09-11T22:16:31.149706+0000","last_active":"2024-09-11T22:16:31.151425+0000","last_peered":"2024-09-11T22:16:31.151425+0000","last_clean":"2024-09-11T22:16:31.151425+0000","last_became_active":"2024-09-11T22:16:31.149426+0000","last_became_peered":"2024-09-11T22:16:31.149426+0000","last_unstale":"2024-09-11T22:16:31.151425+0000","last_undegraded":"2024-09-11T22:16:31.151425+0000","last_fullsized":"2024-09-11T22:16:31.151425+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:25.619855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.146070+0000","last_change":"2024-09-11T22:16:31.144398+0000","last_active":"2024-09-11T22:16:31.146070+0000","last_peered":"2024-09-11T22:16:31.146070+0000","last_clean":"2024-09-11T22:16:31.146070+0000","last_became_active":"2024-09-11T22:16:31.144121+0000","last_became_peered":"2024-09-11T22:16:31.144121+0000","last_unstale":"2024-09-11T22:16:31.146070+0000","last_undegraded":"2024-09-11T22:16:31.146070+0000","last_fullsized":"2024-09-11T22:16:31.146070+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:17.118335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.120990+0000","last_change":"2024-09-11T22:16:29.120990+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.120990+0000","last_undegraded":"2024-09-11T22:16:29.120990+0000","last_fullsized":"2024-09-11T22:16:29.120990+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.147427+0000","last_change":"2024-09-11T22:16:30.144070+0000","last_active":"2024-09-11T22:16:31.147427+0000","last_peered":"2024-09-11T22:16:31.147427+0000","last_clean":"2024-09-11T22:16:31.147427+0000","last_became_active":"2024-09-11T22:16:30.143809+0000","last_became_peered":"2024-09-11T22:16:30.143809+0000","last_unstale":"2024-09-11T22:16:31.147427+0000","last_undegraded":"2024-09-11T22:16:31.147427+0000","last_fullsized":"2024-09-11T22:16:31.147427+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:26.892307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118962+0000","last_change":"2024-09-11T22:16:29.118962+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118962+0000","last_undegraded":"2024-09-11T22:16:29.118962+0000","last_fullsized":"2024-09-11T22:16:29.118962+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118940+0000","last_change":"2024-09-11T22:16:29.118940+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118940+0000","last_undegraded":"2024-09-11T22:16:29.118940+0000","last_fullsized":"2024-09-11T22:16:29.118940+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.119109+0000","last_change":"2024-09-11T22:16:29.119109+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.119109+0000","last_undegraded":"2024-09-11T22:16:29.119109+0000","last_fullsized":"2024-09-11T22:16:29.119109+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143099+0000","last_change":"2024-09-11T22:16:31.141412+0000","last_active":"2024-09-11T22:16:31.143099+0000","last_peered":"2024-09-11T22:16:31.143099+0000","last_clean":"2024-09-11T22:16:31.143099+0000","last_became_active":"2024-09-11T22:16:31.140411+0000","last_became_peered":"2024-09-11T22:16:31.140411+0000","last_unstale":"2024-09-11T22:16:31.143099+0000","last_undegraded":"2024-09-11T22:16:31.143099+0000","last_fullsized":"2024-09-11T22:16:31.143099+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:40.247355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118456+0000","last_change":"2024-09-11T22:16:29.118456+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118456+0000","last_undegraded":"2024-09-11T22:16:29.118456+0000","last_fullsized":"2024-09-11T22:16:29.118456+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118293+0000","last_change":"2024-09-11T22:16:29.118293+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118293+0000","last_undegraded":"2024-09-11T22:16:29.118293+0000","last_fullsized":"2024-09-11T22:16:29.118293+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.120024+0000","last_change":"2024-09-11T22:16:29.120024+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.120024+0000","last_undegraded":"2024-09-11T22:16:29.120024+0000","last_fullsized":"2024-09-11T22:16:29.120024+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118586+0000","last_change":"2024-09-11T22:16:29.118586+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118586+0000","last_undegraded":"2024-09-11T22:16:29.118586+0000","last_fullsized":"2024-09-11T22:16:29.118586+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.119119+0000","last_change":"2024-09-11T22:16:29.119119+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.119119+0000","last_undegraded":"2024-09-11T22:16:29.119119+0000","last_fullsized":"2024-09-11T22:16:29.119119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"106'3","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143269+0000","last_change":"2024-09-11T22:16:30.138863+0000","last_active":"2024-09-11T22:16:31.143269+0000","last_peered":"2024-09-11T22:16:31.143269+0000","last_clean":"2024-09-11T22:16:31.143269+0000","last_became_active":"2024-09-11T22:16:30.138546+0000","last_became_peered":"2024-09-11T22:16:30.138546+0000","last_unstale":"2024-09-11T22:16:31.143269+0000","last_undegraded":"2024-09-11T22:16:31.143269+0000","last_fullsized":"2024-09-11T22:16:31.143269+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.751700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.144921+0000","last_change":"2024-09-11T22:16:31.142601+0000","last_active":"2024-09-11T22:16:31.144921+0000","last_peered":"2024-09-11T22:16:31.144921+0000","last_clean":"2024-09-11T22:16:31.144921+0000","last_became_active":"2024-09-11T22:16:31.142307+0000","last_became_peered":"2024-09-11T22:16:31.142307+0000","last_unstale":"2024-09-11T22:16:31.144921+0000","last_undegraded":"2024-09-11T22:16:31.144921+0000","last_fullsized":"2024-09-11T22:16:31.144921+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:58.641376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116627+0000","last_change":"2024-09-11T22:16:29.116627+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116627+0000","last_undegraded":"2024-09-11T22:16:29.116627+0000","last_fullsized":"2024-09-11T22:16:29.116627+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.145740+0000","last_change":"2024-09-11T22:16:30.134072+0000","last_active":"2024-09-11T22:16:31.145740+0000","last_peered":"2024-09-11T22:16:31.145740+0000","last_clean":"2024-09-11T22:16:31.145740+0000","last_became_active":"2024-09-11T22:16:30.133756+0000","last_became_peered":"2024-09-11T22:16:30.133756+0000","last_unstale":"2024-09-11T22:16:31.145740+0000","last_undegraded":"2024-09-11T22:16:31.145740+0000","last_fullsized":"2024-09-11T22:16:31.145740+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:40.093900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.134219+0000","last_change":"2024-09-11T22:16:30.134404+0000","last_active":"2024-09-11T22:16:31.134219+0000","last_peered":"2024-09-11T22:16:31.134219+0000","last_clean":"2024-09-11T22:16:31.134219+0000","last_became_active":"2024-09-11T22:16:30.133816+0000","last_became_peered":"2024-09-11T22:16:30.133816+0000","last_unstale":"2024-09-11T22:16:31.134219+0000","last_undegraded":"2024-09-11T22:16:31.134219+0000","last_fullsized":"2024-09-11T22:16:31.134219+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:51:29.870433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116140+0000","last_change":"2024-09-11T22:16:29.116140+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116140+0000","last_undegraded":"2024-09-11T22:16:29.116140+0000","last_fullsized":"2024-09-11T22:16:29.116140+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.146201+0000","last_change":"2024-09-11T22:16:31.144771+0000","last_active":"2024-09-11T22:16:31.146201+0000","last_peered":"2024-09-11T22:16:31.146201+0000","last_clean":"2024-09-11T22:16:31.146201+0000","last_became_active":"2024-09-11T22:16:31.144465+0000","last_became_peered":"2024-09-11T22:16:31.144465+0000","last_unstale":"2024-09-11T22:16:31.146201+0000","last_undegraded":"2024-09-11T22:16:31.146201+0000","last_fullsized":"2024-09-11T22:16:31.146201+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:18.425428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.119594+0000","last_change":"2024-09-11T22:16:29.119594+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.119594+0000","last_undegraded":"2024-09-11T22:16:29.119594+0000","last_fullsized":"2024-09-11T22:16:29.119594+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116342+0000","last_change":"2024-09-11T22:16:29.116342+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116342+0000","last_undegraded":"2024-09-11T22:16:29.116342+0000","last_fullsized":"2024-09-11T22:16:29.116342+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118293+0000","last_change":"2024-09-11T22:16:29.118293+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118293+0000","last_undegraded":"2024-09-11T22:16:29.118293+0000","last_fullsized":"2024-09-11T22:16:29.118293+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143155+0000","last_change":"2024-09-11T22:16:31.140281+0000","last_active":"2024-09-11T22:16:31.143155+0000","last_peered":"2024-09-11T22:16:31.143155+0000","last_clean":"2024-09-11T22:16:31.143155+0000","last_became_active":"2024-09-11T22:16:31.139962+0000","last_became_peered":"2024-09-11T22:16:31.139962+0000","last_unstale":"2024-09-11T22:16:31.143155+0000","last_undegraded":"2024-09-11T22:16:31.143155+0000","last_fullsized":"2024-09-11T22:16:31.143155+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:54.782458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118335+0000","last_change":"2024-09-11T22:16:29.118335+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118335+0000","last_undegraded":"2024-09-11T22:16:29.118335+0000","last_fullsized":"2024-09-11T22:16:29.118335+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.149170+0000","last_change":"2024-09-11T22:16:31.148199+0000","last_active":"2024-09-11T22:16:31.149170+0000","last_peered":"2024-09-11T22:16:31.149170+0000","last_clean":"2024-09-11T22:16:31.149170+0000","last_became_active":"2024-09-11T22:16:31.147855+0000","last_became_peered":"2024-09-11T22:16:31.147855+0000","last_unstale":"2024-09-11T22:16:31.149170+0000","last_undegraded":"2024-09-11T22:16:31.149170+0000","last_fullsized":"2024-09-11T22:16:31.149170+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:55.514563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118028+0000","last_change":"2024-09-11T22:16:29.118028+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118028+0000","last_undegraded":"2024-09-11T22:16:29.118028+0000","last_fullsized":"2024-09-11T22:16:29.118028+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.152225+0000","last_change":"2024-09-11T22:16:31.151401+0000","last_active":"2024-09-11T22:16:31.152225+0000","last_peered":"2024-09-11T22:16:31.152225+0000","last_clean":"2024-09-11T22:16:31.152225+0000","last_became_active":"2024-09-11T22:16:31.151128+0000","last_became_peered":"2024-09-11T22:16:31.151128+0000","last_unstale":"2024-09-11T22:16:31.152225+0000","last_undegraded":"2024-09-11T22:16:31.152225+0000","last_fullsized":"2024-09-11T22:16:31.152225+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:32.506418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116099+0000","last_change":"2024-09-11T22:16:29.116099+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116099+0000","last_undegraded":"2024-09-11T22:16:29.116099+0000","last_fullsized":"2024-09-11T22:16:29.116099+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.149922+0000","last_change":"2024-09-11T22:16:31.148915+0000","last_active":"2024-09-11T22:16:31.149922+0000","last_peered":"2024-09-11T22:16:31.149922+0000","last_clean":"2024-09-11T22:16:31.149922+0000","last_became_active":"2024-09-11T22:16:31.148608+0000","last_became_peered":"2024-09-11T22:16:31.148608+0000","last_unstale":"2024-09-11T22:16:31.149922+0000","last_undegraded":"2024-09-11T22:16:31.149922+0000","last_fullsized":"2024-09-11T22:16:31.149922+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:08.215053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116147+0000","last_change":"2024-09-11T22:16:29.116147+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116147+0000","last_undegraded":"2024-09-11T22:16:29.116147+0000","last_fullsized":"2024-09-11T22:16:29.116147+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.117035+0000","last_change":"2024-09-11T22:16:29.117035+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.117035+0000","last_undegraded":"2024-09-11T22:16:29.117035+0000","last_fullsized":"2024-09-11T22:16:29.117035+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.116095+0000","last_change":"2024-09-11T22:16:29.116095+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.116095+0000","last_undegraded":"2024-09-11T22:16:29.116095+0000","last_fullsized":"2024-09-11T22:16:29.116095+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.117105+0000","last_change":"2024-09-11T22:16:29.117105+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.117105+0000","last_undegraded":"2024-09-11T22:16:29.117105+0000","last_fullsized":"2024-09-11T22:16:29.117105+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.117235+0000","last_change":"2024-09-11T22:16:29.117235+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.117235+0000","last_undegraded":"2024-09-11T22:16:29.117235+0000","last_fullsized":"2024-09-11T22:16:29.117235+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118212+0000","last_change":"2024-09-11T22:16:29.118212+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118212+0000","last_undegraded":"2024-09-11T22:16:29.118212+0000","last_fullsized":"2024-09-11T22:16:29.118212+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.148062+0000","last_change":"2024-09-11T22:16:31.146357+0000","last_active":"2024-09-11T22:16:31.148062+0000","last_peered":"2024-09-11T22:16:31.148062+0000","last_clean":"2024-09-11T22:16:31.148062+0000","last_became_active":"2024-09-11T22:16:31.146047+0000","last_became_peered":"2024-09-11T22:16:31.146047+0000","last_unstale":"2024-09-11T22:16:31.148062+0000","last_undegraded":"2024-09-11T22:16:31.148062+0000","last_fullsized":"2024-09-11T22:16:31.148062+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:48.155167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.117025+0000","last_change":"2024-09-11T22:16:29.117025+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.117025+0000","last_undegraded":"2024-09-11T22:16:29.117025+0000","last_fullsized":"2024-09-11T22:16:29.117025+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118227+0000","last_change":"2024-09-11T22:16:29.118227+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118227+0000","last_undegraded":"2024-09-11T22:16:29.118227+0000","last_fullsized":"2024-09-11T22:16:29.118227+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.146406+0000","last_change":"2024-09-11T22:16:31.145558+0000","last_active":"2024-09-11T22:16:31.146406+0000","last_peered":"2024-09-11T22:16:31.146406+0000","last_clean":"2024-09-11T22:16:31.146406+0000","last_became_active":"2024-09-11T22:16:31.145190+0000","last_became_peered":"2024-09-11T22:16:31.145190+0000","last_unstale":"2024-09-11T22:16:31.146406+0000","last_undegraded":"2024-09-11T22:16:31.146406+0000","last_fullsized":"2024-09-11T22:16:31.146406+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:10.428833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-09-11T22:16:29.118759+0000","last_change":"2024-09-11T22:16:29.118759+0000","last_active":"2024-09-11T22:16:29.108392+0000","last_peered":"2024-09-11T22:16:29.108392+0000","last_clean":"2024-09-11T22:16:29.108392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:29.118759+0000","last_undegraded":"2024-09-11T22:16:29.118759+0000","last_fullsized":"2024-09-11T22:16:29.118759+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:16:30.114149+0000","last_change":"2024-09-11T22:16:30.114149+0000","last_active":"2024-09-11T22:16:30.114149+0000","last_peered":"2024-09-11T22:16:30.114149+0000","last_clean":"2024-09-11T22:16:30.114149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:16:30.114149+0000","last_undegraded":"2024-09-11T22:16:30.114149+0000","last_fullsized":"2024-09-11T22:16:30.114149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.132339+0000","last_change":"2024-09-11T22:16:30.134155+0000","last_active":"2024-09-11T22:16:31.132339+0000","last_peered":"2024-09-11T22:16:31.132339+0000","last_clean":"2024-09-11T22:16:31.132339+0000","last_became_active":"2024-09-11T22:16:30.133835+0000","last_became_peered":"2024-09-11T22:16:30.133835+0000","last_unstale":"2024-09-11T22:16:31.132339+0000","last_undegraded":"2024-09-11T22:16:31.132339+0000","last_fullsized":"2024-09-11T22:16:31.132339+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:58.593480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.151440+0000","last_change":"2024-09-11T22:16:31.149781+0000","last_active":"2024-09-11T22:16:31.151440+0000","last_peered":"2024-09-11T22:16:31.151440+0000","last_clean":"2024-09-11T22:16:31.151440+0000","last_became_active":"2024-09-11T22:16:31.149416+0000","last_became_peered":"2024-09-11T22:16:31.149416+0000","last_unstale":"2024-09-11T22:16:31.151440+0000","last_undegraded":"2024-09-11T22:16:31.151440+0000","last_fullsized":"2024-09-11T22:16:31.151440+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:46.290268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.144821+0000","last_change":"2024-09-11T22:16:30.140162+0000","last_active":"2024-09-11T22:16:31.144821+0000","last_peered":"2024-09-11T22:16:31.144821+0000","last_clean":"2024-09-11T22:16:31.144821+0000","last_became_active":"2024-09-11T22:16:30.139889+0000","last_became_peered":"2024-09-11T22:16:30.139889+0000","last_unstale":"2024-09-11T22:16:31.144821+0000","last_undegraded":"2024-09-11T22:16:31.144821+0000","last_fullsized":"2024-09-11T22:16:31.144821+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:07.047344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":325,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.127585+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:16:31.127585+0000","last_peered":"2024-09-11T22:16:31.127585+0000","last_clean":"2024-09-11T22:16:31.127585+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:16:31.127585+0000","last_undegraded":"2024-09-11T22:16:31.127585+0000","last_fullsized":"2024-09-11T22:16:31.127585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":2},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":146,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36596,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335244,"statfs":{"total":96636764160,"available":96599289856,"internally_reserved":0,"allocated":1277952,"data_stored":555004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36584,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335256,"statfs":{"total":96636764160,"available":96599302144,"internally_reserved":0,"allocated":1265664,"data_stored":549187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40760,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331080,"statfs":{"total":96636764160,"available":96595025920,"internally_reserved":0,"allocated":1277952,"data_stored":555004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1265664,"data_stored":549187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1277952,"data_stored":555004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41336,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330504,"statfs":{"total":96636764160,"available":96594436096,"internally_reserved":0,"allocated":1871872,"data_stored":1145372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41376,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330464,"statfs":{"total":96636764160,"available":96594395136,"internally_reserved":0,"allocated":1904640,"data_stored":1158534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1290240,"data_stored":561279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:16:34.820 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3f is not active+clean 2024-09-11T22:16:34.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.820 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3e is not active+clean 2024-09-11T22:16:34.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.820 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3d is not active+clean 2024-09-11T22:16:34.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.821 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3c is not active+clean 2024-09-11T22:16:34.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.821 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3b is not active+clean 2024-09-11T22:16:34.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.821 INFO:tasks.ceph.ceph_manager.ceph:PG 15.38 is not active+clean 2024-09-11T22:16:34.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.821 INFO:tasks.ceph.ceph_manager.ceph:PG 15.37 is not active+clean 2024-09-11T22:16:34.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.822 INFO:tasks.ceph.ceph_manager.ceph:PG 15.36 is not active+clean 2024-09-11T22:16:34.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.822 INFO:tasks.ceph.ceph_manager.ceph:PG 15.34 is not active+clean 2024-09-11T22:16:34.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.822 INFO:tasks.ceph.ceph_manager.ceph:PG 15.33 is not active+clean 2024-09-11T22:16:34.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.822 INFO:tasks.ceph.ceph_manager.ceph:PG 15.31 is not active+clean 2024-09-11T22:16:34.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.822 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2f is not active+clean 2024-09-11T22:16:34.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.823 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2e is not active+clean 2024-09-11T22:16:34.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.823 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2c is not active+clean 2024-09-11T22:16:34.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.823 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2a is not active+clean 2024-09-11T22:16:34.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.823 INFO:tasks.ceph.ceph_manager.ceph:PG 15.29 is not active+clean 2024-09-11T22:16:34.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.823 INFO:tasks.ceph.ceph_manager.ceph:PG 15.27 is not active+clean 2024-09-11T22:16:34.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.824 INFO:tasks.ceph.ceph_manager.ceph:PG 15.26 is not active+clean 2024-09-11T22:16:34.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.824 INFO:tasks.ceph.ceph_manager.ceph:PG 15.24 is not active+clean 2024-09-11T22:16:34.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.824 INFO:tasks.ceph.ceph_manager.ceph:PG 15.23 is not active+clean 2024-09-11T22:16:34.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.824 INFO:tasks.ceph.ceph_manager.ceph:PG 15.21 is not active+clean 2024-09-11T22:16:34.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.825 INFO:tasks.ceph.ceph_manager.ceph:PG 15.20 is not active+clean 2024-09-11T22:16:34.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.825 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1f is not active+clean 2024-09-11T22:16:34.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.120990+0000', 'last_change': '2024-09-11T22:16:29.120990+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.120990+0000', 'last_undegraded': '2024-09-11T22:16:29.120990+0000', 'last_fullsized': '2024-09-11T22:16:29.120990+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:16:34.825 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1f is not active+clean 2024-09-11T22:16:34.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.825 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1c is not active+clean 2024-09-11T22:16:34.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.825 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1d is not active+clean 2024-09-11T22:16:34.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.118962+0000', 'last_change': '2024-09-11T22:16:29.118962+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.118962+0000', 'last_undegraded': '2024-09-11T22:16:29.118962+0000', 'last_fullsized': '2024-09-11T22:16:29.118962+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:16:34.826 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1d is not active+clean 2024-09-11T22:16:34.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.826 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1c is not active+clean 2024-09-11T22:16:34.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.118940+0000', 'last_change': '2024-09-11T22:16:29.118940+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.118940+0000', 'last_undegraded': '2024-09-11T22:16:29.118940+0000', 'last_fullsized': '2024-09-11T22:16:29.118940+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:16:34.826 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1a is not active+clean 2024-09-11T22:16:34.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.826 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1b is not active+clean 2024-09-11T22:16:34.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.119109+0000', 'last_change': '2024-09-11T22:16:29.119109+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.119109+0000', 'last_undegraded': '2024-09-11T22:16:29.119109+0000', 'last_fullsized': '2024-09-11T22:16:29.119109+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:16:34.827 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1a is not active+clean 2024-09-11T22:16:34.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.118456+0000', 'last_change': '2024-09-11T22:16:29.118456+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.118456+0000', 'last_undegraded': '2024-09-11T22:16:29.118456+0000', 'last_fullsized': '2024-09-11T22:16:29.118456+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:16:34.827 INFO:tasks.ceph.ceph_manager.ceph:PG 15.18 is not active+clean 2024-09-11T22:16:34.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.827 INFO:tasks.ceph.ceph_manager.ceph:PG 14.19 is not active+clean 2024-09-11T22:16:34.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.118293+0000', 'last_change': '2024-09-11T22:16:29.118293+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.118293+0000', 'last_undegraded': '2024-09-11T22:16:29.118293+0000', 'last_fullsized': '2024-09-11T22:16:29.118293+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:16:34.827 INFO:tasks.ceph.ceph_manager.ceph:PG 15.19 is not active+clean 2024-09-11T22:16:34.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.827 INFO:tasks.ceph.ceph_manager.ceph:PG 14.18 is not active+clean 2024-09-11T22:16:34.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.120024+0000', 'last_change': '2024-09-11T22:16:29.120024+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.120024+0000', 'last_undegraded': '2024-09-11T22:16:29.120024+0000', 'last_fullsized': '2024-09-11T22:16:29.120024+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:16:34.828 INFO:tasks.ceph.ceph_manager.ceph:PG 15.16 is not active+clean 2024-09-11T22:16:34.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.828 INFO:tasks.ceph.ceph_manager.ceph:PG 14.17 is not active+clean 2024-09-11T22:16:34.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.118586+0000', 'last_change': '2024-09-11T22:16:29.118586+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.118586+0000', 'last_undegraded': '2024-09-11T22:16:29.118586+0000', 'last_fullsized': '2024-09-11T22:16:29.118586+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:16:34.828 INFO:tasks.ceph.ceph_manager.ceph:PG 15.17 is not active+clean 2024-09-11T22:16:34.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.828 INFO:tasks.ceph.ceph_manager.ceph:PG 14.16 is not active+clean 2024-09-11T22:16:34.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.119119+0000', 'last_change': '2024-09-11T22:16:29.119119+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.119119+0000', 'last_undegraded': '2024-09-11T22:16:29.119119+0000', 'last_fullsized': '2024-09-11T22:16:29.119119+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:16:34.829 INFO:tasks.ceph.ceph_manager.ceph:PG 15.14 is not active+clean 2024-09-11T22:16:34.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.829 INFO:tasks.ceph.ceph_manager.ceph:PG 14.14 is not active+clean 2024-09-11T22:16:34.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.116627+0000', 'last_change': '2024-09-11T22:16:29.116627+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.116627+0000', 'last_undegraded': '2024-09-11T22:16:29.116627+0000', 'last_fullsized': '2024-09-11T22:16:29.116627+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:16:34.829 INFO:tasks.ceph.ceph_manager.ceph:PG 15.12 is not active+clean 2024-09-11T22:16:34.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.829 INFO:tasks.ceph.ceph_manager.ceph:PG 15.13 is not active+clean 2024-09-11T22:16:34.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.829 INFO:tasks.ceph.ceph_manager.ceph:PG 15.10 is not active+clean 2024-09-11T22:16:34.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.830 INFO:tasks.ceph.ceph_manager.ceph:PG 14.11 is not active+clean 2024-09-11T22:16:34.830 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.116140+0000', 'last_change': '2024-09-11T22:16:29.116140+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.116140+0000', 'last_undegraded': '2024-09-11T22:16:29.116140+0000', 'last_fullsized': '2024-09-11T22:16:29.116140+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:16:34.830 INFO:tasks.ceph.ceph_manager.ceph:PG 14.10 is not active+clean 2024-09-11T22:16:34.830 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.119594+0000', 'last_change': '2024-09-11T22:16:29.119594+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.119594+0000', 'last_undegraded': '2024-09-11T22:16:29.119594+0000', 'last_fullsized': '2024-09-11T22:16:29.119594+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:16:34.830 INFO:tasks.ceph.ceph_manager.ceph:PG 15.f is not active+clean 2024-09-11T22:16:34.830 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.830 INFO:tasks.ceph.ceph_manager.ceph:PG 14.e is not active+clean 2024-09-11T22:16:34.830 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.116342+0000', 'last_change': '2024-09-11T22:16:29.116342+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.116342+0000', 'last_undegraded': '2024-09-11T22:16:29.116342+0000', 'last_fullsized': '2024-09-11T22:16:29.116342+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:16:34.830 INFO:tasks.ceph.ceph_manager.ceph:PG 15.c is not active+clean 2024-09-11T22:16:34.831 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.831 INFO:tasks.ceph.ceph_manager.ceph:PG 14.d is not active+clean 2024-09-11T22:16:34.831 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.118293+0000', 'last_change': '2024-09-11T22:16:29.118293+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.118293+0000', 'last_undegraded': '2024-09-11T22:16:29.118293+0000', 'last_fullsized': '2024-09-11T22:16:29.118293+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:16:34.831 INFO:tasks.ceph.ceph_manager.ceph:PG 14.c is not active+clean 2024-09-11T22:16:34.831 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.118335+0000', 'last_change': '2024-09-11T22:16:29.118335+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.118335+0000', 'last_undegraded': '2024-09-11T22:16:29.118335+0000', 'last_fullsized': '2024-09-11T22:16:29.118335+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:16:34.831 INFO:tasks.ceph.ceph_manager.ceph:PG 14.b is not active+clean 2024-09-11T22:16:34.831 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.118028+0000', 'last_change': '2024-09-11T22:16:29.118028+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.118028+0000', 'last_undegraded': '2024-09-11T22:16:29.118028+0000', 'last_fullsized': '2024-09-11T22:16:29.118028+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:16:34.831 INFO:tasks.ceph.ceph_manager.ceph:PG 14.a is not active+clean 2024-09-11T22:16:34.831 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.116099+0000', 'last_change': '2024-09-11T22:16:29.116099+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.116099+0000', 'last_undegraded': '2024-09-11T22:16:29.116099+0000', 'last_fullsized': '2024-09-11T22:16:29.116099+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:16:34.832 INFO:tasks.ceph.ceph_manager.ceph:PG 14.9 is not active+clean 2024-09-11T22:16:34.832 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.116147+0000', 'last_change': '2024-09-11T22:16:29.116147+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.116147+0000', 'last_undegraded': '2024-09-11T22:16:29.116147+0000', 'last_fullsized': '2024-09-11T22:16:29.116147+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:16:34.832 INFO:tasks.ceph.ceph_manager.ceph:PG 15.9 is not active+clean 2024-09-11T22:16:34.832 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.832 INFO:tasks.ceph.ceph_manager.ceph:PG 14.8 is not active+clean 2024-09-11T22:16:34.832 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.117035+0000', 'last_change': '2024-09-11T22:16:29.117035+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.117035+0000', 'last_undegraded': '2024-09-11T22:16:29.117035+0000', 'last_fullsized': '2024-09-11T22:16:29.117035+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:16:34.832 INFO:tasks.ceph.ceph_manager.ceph:PG 15.6 is not active+clean 2024-09-11T22:16:34.832 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.832 INFO:tasks.ceph.ceph_manager.ceph:PG 14.7 is not active+clean 2024-09-11T22:16:34.832 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.116095+0000', 'last_change': '2024-09-11T22:16:29.116095+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.116095+0000', 'last_undegraded': '2024-09-11T22:16:29.116095+0000', 'last_fullsized': '2024-09-11T22:16:29.116095+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:16:34.833 INFO:tasks.ceph.ceph_manager.ceph:PG 15.7 is not active+clean 2024-09-11T22:16:34.833 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.833 INFO:tasks.ceph.ceph_manager.ceph:PG 14.6 is not active+clean 2024-09-11T22:16:34.833 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.117105+0000', 'last_change': '2024-09-11T22:16:29.117105+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.117105+0000', 'last_undegraded': '2024-09-11T22:16:29.117105+0000', 'last_fullsized': '2024-09-11T22:16:29.117105+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:16:34.833 INFO:tasks.ceph.ceph_manager.ceph:PG 15.4 is not active+clean 2024-09-11T22:16:34.833 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.833 INFO:tasks.ceph.ceph_manager.ceph:PG 14.5 is not active+clean 2024-09-11T22:16:34.833 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.117235+0000', 'last_change': '2024-09-11T22:16:29.117235+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.117235+0000', 'last_undegraded': '2024-09-11T22:16:29.117235+0000', 'last_fullsized': '2024-09-11T22:16:29.117235+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:16:34.833 INFO:tasks.ceph.ceph_manager.ceph:PG 15.5 is not active+clean 2024-09-11T22:16:34.833 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.833 INFO:tasks.ceph.ceph_manager.ceph:PG 14.4 is not active+clean 2024-09-11T22:16:34.834 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.118212+0000', 'last_change': '2024-09-11T22:16:29.118212+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.118212+0000', 'last_undegraded': '2024-09-11T22:16:29.118212+0000', 'last_fullsized': '2024-09-11T22:16:29.118212+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:16:34.834 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3 is not active+clean 2024-09-11T22:16:34.834 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.117025+0000', 'last_change': '2024-09-11T22:16:29.117025+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.117025+0000', 'last_undegraded': '2024-09-11T22:16:29.117025+0000', 'last_fullsized': '2024-09-11T22:16:29.117025+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:16:34.834 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3 is not active+clean 2024-09-11T22:16:34.834 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.834 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2 is not active+clean 2024-09-11T22:16:34.834 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.118227+0000', 'last_change': '2024-09-11T22:16:29.118227+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.118227+0000', 'last_undegraded': '2024-09-11T22:16:29.118227+0000', 'last_fullsized': '2024-09-11T22:16:29.118227+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:16:34.834 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1 is not active+clean 2024-09-11T22:16:34.834 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:16:29.118759+0000', 'last_change': '2024-09-11T22:16:29.118759+0000', 'last_active': '2024-09-11T22:16:29.108392+0000', 'last_peered': '2024-09-11T22:16:29.108392+0000', 'last_clean': '2024-09-11T22:16:29.108392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:29.118759+0000', 'last_undegraded': '2024-09-11T22:16:29.118759+0000', 'last_fullsized': '2024-09-11T22:16:29.118759+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:29.108392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:16:34.834 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1 is not active+clean 2024-09-11T22:16:34.835 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:16:30.114149+0000', 'last_change': '2024-09-11T22:16:30.114149+0000', 'last_active': '2024-09-11T22:16:30.114149+0000', 'last_peered': '2024-09-11T22:16:30.114149+0000', 'last_clean': '2024-09-11T22:16:30.114149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:16:30.114149+0000', 'last_undegraded': '2024-09-11T22:16:30.114149+0000', 'last_fullsized': '2024-09-11T22:16:30.114149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'last_clean_scrub_stamp': '2024-09-11T22:16:30.114149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:16:34.836 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:16:34.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.957+0000 7fb386bc4640 1 Processor -- start 2024-09-11T22:16:34.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.957+0000 7fb386bc4640 1 -- start start 2024-09-11T22:16:34.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.958+0000 7fb386bc4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3800d18a0 0x7fb3800d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.958+0000 7fb386bc4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3800d3a30 0x7fb3800b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.958+0000 7fb386bc4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3800cfa80 con 0x7fb38015e870 2024-09-11T22:16:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.958+0000 7fb386bc4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb3800d3ea0 con 0x7fb3800d18a0 2024-09-11T22:16:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.958+0000 7fb386bc4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb3800d40d0 con 0x7fb3800d3a30 2024-09-11T22:16:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.958+0000 7fb37ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3800d18a0 0x7fb3800d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.958+0000 7fb384960640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb38015e870 0x7fb3800d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49648/0 (socket says 172.21.15.50:49648) 2024-09-11T22:16:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.958+0000 7fb384960640 1 -- 172.21.15.50:0/3763512675 learned_addr learned my addr 172.21.15.50:0/3763512675 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.959+0000 7fb385161640 1 --2- 172.21.15.50:0/3763512675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3800d3a30 0x7fb3800b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.959+0000 7fb37ffff640 1 -- 172.21.15.50:0/3763512675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3800d3a30 msgr2=0x7fb3800b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.959+0000 7fb37ffff640 1 --2- 172.21.15.50:0/3763512675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3800d3a30 0x7fb3800b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.959+0000 7fb37ffff640 1 -- 172.21.15.50:0/3763512675 >> v1:172.21.15.50:6789/0 conn(0x7fb38015e870 legacy=0x7fb3800d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.959+0000 7fb37f7fe640 1 -- 172.21.15.50:0/3763512675 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1844252107 0 0) 0x7fb370001110 con 0x7fb38015e870 2024-09-11T22:16:34.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.959+0000 7fb37ffff640 1 -- 172.21.15.50:0/3763512675 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3800d43b0 con 0x7fb3800d18a0 2024-09-11T22:16:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.960+0000 7fb37ffff640 1 --2- 172.21.15.50:0/3763512675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3800d18a0 0x7fb3800d34f0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fb3740097a0 tx=0x7fb37402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca039422b9d9d92d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.960+0000 7fb37f7fe640 1 -- 172.21.15.50:0/3763512675 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374037070 con 0x7fb3800d18a0 2024-09-11T22:16:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.960+0000 7fb37f7fe640 1 -- 172.21.15.50:0/3763512675 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb374032440 con 0x7fb3800d18a0 2024-09-11T22:16:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.960+0000 7fb37f7fe640 1 -- 172.21.15.50:0/3763512675 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374032810 con 0x7fb3800d18a0 2024-09-11T22:16:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.960+0000 7fb386bc4640 1 -- 172.21.15.50:0/3763512675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3800d18a0 msgr2=0x7fb3800d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.960+0000 7fb386bc4640 1 --2- 172.21.15.50:0/3763512675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3800d18a0 0x7fb3800d34f0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fb3740097a0 tx=0x7fb37402a180 comp rx=0 tx=0).stop 2024-09-11T22:16:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.960+0000 7fb386bc4640 1 -- 172.21.15.50:0/3763512675 shutdown_connections 2024-09-11T22:16:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.960+0000 7fb386bc4640 1 --2- 172.21.15.50:0/3763512675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3800d3a30 0x7fb3800b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.960+0000 7fb386bc4640 1 --2- 172.21.15.50:0/3763512675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3800d18a0 0x7fb3800d34f0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.960+0000 7fb386bc4640 1 -- 172.21.15.50:0/3763512675 >> 172.21.15.50:0/3763512675 conn(0x7fb3800727a0 msgr2=0x7fb3800679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.960+0000 7fb386bc4640 1 -- 172.21.15.50:0/3763512675 shutdown_connections 2024-09-11T22:16:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.960+0000 7fb386bc4640 1 -- 172.21.15.50:0/3763512675 wait complete. 2024-09-11T22:16:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.961+0000 7fb386bc4640 1 Processor -- start 2024-09-11T22:16:34.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.962+0000 7fb386bc4640 1 -- start start 2024-09-11T22:16:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.962+0000 7fb386bc4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3800d18a0 0x7fb3800cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.962+0000 7fb386bc4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3800d3a30 0x7fb38015b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.962+0000 7fb386bc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb38015e870 0x7fb3800cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.962+0000 7fb386bc4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb38015ec50 con 0x7fb38015e870 2024-09-11T22:16:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.962+0000 7fb386bc4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb3800b7ee0 con 0x7fb3800d18a0 2024-09-11T22:16:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.962+0000 7fb386bc4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb3800b78b0 con 0x7fb3800d3a30 2024-09-11T22:16:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.962+0000 7fb385161640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb38015e870 0x7fb3800cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb385161640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb38015e870 0x7fb3800cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56988/0 (socket says 172.21.15.50:56988) 2024-09-11T22:16:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb385161640 1 -- 172.21.15.50:0/2290952376 learned_addr learned my addr 172.21.15.50:0/2290952376 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb37ffff640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3800d3a30 0x7fb38015b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb384960640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3800d18a0 0x7fb3800cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb385161640 1 -- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3800d3a30 msgr2=0x7fb38015b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb385161640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3800d3a30 0x7fb38015b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb385161640 1 -- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3800d18a0 msgr2=0x7fb3800cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb385161640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3800d18a0 0x7fb3800cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb385161640 1 -- 172.21.15.50:0/2290952376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3800cb2e0 con 0x7fb38015e870 2024-09-11T22:16:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb385161640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb38015e870 0x7fb3800cd990 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fb37800efc0 tx=0x7fb37800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb37d7fa640 1 -- 172.21.15.50:0/2290952376 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb378018020 con 0x7fb38015e870 2024-09-11T22:16:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb37d7fa640 1 -- 172.21.15.50:0/2290952376 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb378014480 con 0x7fb38015e870 2024-09-11T22:16:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb386bc4640 1 -- 172.21.15.50:0/2290952376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb38015b710 con 0x7fb38015e870 2024-09-11T22:16:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb37d7fa640 1 -- 172.21.15.50:0/2290952376 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb378014870 con 0x7fb38015e870 2024-09-11T22:16:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.963+0000 7fb386bc4640 1 -- 172.21.15.50:0/2290952376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3800cc540 con 0x7fb38015e870 2024-09-11T22:16:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.964+0000 7fb386bc4640 1 -- 172.21.15.50:0/2290952376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3800d34f0 con 0x7fb38015e870 2024-09-11T22:16:34.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.965+0000 7fb37d7fa640 1 -- 172.21.15.50:0/2290952376 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb378005d10 con 0x7fb38015e870 2024-09-11T22:16:34.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.965+0000 7fb37d7fa640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb36c06be30 0x7fb36c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:34.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.965+0000 7fb37d7fa640 1 -- 172.21.15.50:0/2290952376 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fb37808bc40 con 0x7fb38015e870 2024-09-11T22:16:34.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.966+0000 7fb384960640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb36c06be30 0x7fb36c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:34.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.966+0000 7fb384960640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb36c06be30 0x7fb36c06e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb3700013b0 tx=0x7fb370009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:34.970+0000 7fb37d7fa640 1 -- 172.21.15.50:0/2290952376 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb378022030 con 0x7fb38015e870 2024-09-11T22:16:35.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.210+0000 7fb386bc4640 1 -- 172.21.15.50:0/2290952376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb3800d0c40 con 0x7fb38015e870 2024-09-11T22:16:35.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.210+0000 7fb37d7fa640 1 -- 172.21.15.50:0/2290952376 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1636 (secure 0 0 0) 0x7fb378010040 con 0x7fb38015e870 2024-09-11T22:16:35.212 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:35.212 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":344,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":43},{"state_name":"active+clean","count":28},{"state_name":"creating+peering","count":26}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590514,"bytes_used":288256000,"bytes_avail":772805857280,"bytes_total":773094113280,"unknown_pgs_ratio":0.44329896569252014,"inactive_pgs_ratio":0.2680412232875824,"write_bytes_sec":2129,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":76,"btime":"2024-09-11T22:16:33:131505+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7605}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2024-09-11T22:16:19.438012+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:16:35.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.212+0000 7fb386bc4640 1 -- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb36c06be30 msgr2=0x7fb36c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:35.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.212+0000 7fb386bc4640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb36c06be30 0x7fb36c06e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb3700013b0 tx=0x7fb370009040 comp rx=0 tx=0).stop 2024-09-11T22:16:35.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.212+0000 7fb386bc4640 1 -- 172.21.15.50:0/2290952376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb38015e870 msgr2=0x7fb3800cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:35.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.212+0000 7fb386bc4640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb38015e870 0x7fb3800cd990 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fb37800efc0 tx=0x7fb37800c490 comp rx=0 tx=0).stop 2024-09-11T22:16:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.212+0000 7fb386bc4640 1 -- 172.21.15.50:0/2290952376 shutdown_connections 2024-09-11T22:16:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.212+0000 7fb386bc4640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb36c06be30 0x7fb36c06e2f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.212+0000 7fb386bc4640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3800d3a30 0x7fb38015b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.212+0000 7fb386bc4640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb38015e870 0x7fb3800cd990 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.212+0000 7fb386bc4640 1 --2- 172.21.15.50:0/2290952376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3800d18a0 0x7fb3800cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.212+0000 7fb386bc4640 1 -- 172.21.15.50:0/2290952376 >> 172.21.15.50:0/2290952376 conn(0x7fb3800727a0 msgr2=0x7fb3800b97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.213+0000 7fb386bc4640 1 -- 172.21.15.50:0/2290952376 shutdown_connections 2024-09-11T22:16:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.213+0000 7fb386bc4640 1 -- 172.21.15.50:0/2290952376 wait complete. 2024-09-11T22:16:35.224 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:16:35.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:16:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.326+0000 7f63d4e82640 1 Processor -- start 2024-09-11T22:16:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.326+0000 7f63d4e82640 1 -- start start 2024-09-11T22:16:35.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.327+0000 7f63d4e82640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63d00b4bd0 0x7f63d00b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.327+0000 7f63d4e82640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d0163410 con 0x7f63d00b0f60 2024-09-11T22:16:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.327+0000 7f63d4e82640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d006cc20 con 0x7f63d0162d10 2024-09-11T22:16:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.327+0000 7f63d4e82640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f63d006d550 con 0x7f63d00b4bd0 2024-09-11T22:16:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.327+0000 7f63ce59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f63d00b0f60 0x7f63d0162600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49664/0 (socket says 172.21.15.50:49664) 2024-09-11T22:16:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.327+0000 7f63ce59c640 1 -- 172.21.15.50:0/370581640 learned_addr learned my addr 172.21.15.50:0/370581640 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.327+0000 7f63cdd9b640 1 --2- 172.21.15.50:0/370581640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63d00b4bd0 0x7f63d00b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.327+0000 7f63cd59a640 1 -- 172.21.15.50:0/370581640 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3563101209 0 0) 0x7f63d0163410 con 0x7f63d00b0f60 2024-09-11T22:16:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.327+0000 7f63cd59a640 1 -- 172.21.15.50:0/370581640 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b8003520 con 0x7f63d00b0f60 2024-09-11T22:16:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.327+0000 7f63cd59a640 1 -- 172.21.15.50:0/370581640 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2004083743 0 0) 0x7f63d006cc20 con 0x7f63d0162d10 2024-09-11T22:16:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.327+0000 7f63cd59a640 1 -- 172.21.15.50:0/370581640 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63d0163410 con 0x7f63d0162d10 2024-09-11T22:16:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.328+0000 7f63cdd9b640 1 -- 172.21.15.50:0/370581640 >> v1:172.21.15.77:6789/0 conn(0x7f63d0162d10 legacy=0x7f63d00af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.328+0000 7f63cdd9b640 1 -- 172.21.15.50:0/370581640 >> v1:172.21.15.50:6789/0 conn(0x7f63d00b0f60 legacy=0x7f63d0162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.328+0000 7f63cd59a640 1 -- 172.21.15.50:0/370581640 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1143954345 0 0) 0x7f63b8003520 con 0x7f63d00b0f60 2024-09-11T22:16:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.328+0000 7f63cdd9b640 1 -- 172.21.15.50:0/370581640 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d006cf00 con 0x7f63d00b4bd0 2024-09-11T22:16:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.328+0000 7f63cdd9b640 1 --2- 172.21.15.50:0/370581640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63d00b4bd0 0x7f63d00b1340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f63c40097d0 tx=0x7f63c402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2a462ca4215f910 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.329+0000 7f63cd59a640 1 -- 172.21.15.50:0/370581640 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4037070 con 0x7f63d00b4bd0 2024-09-11T22:16:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.329+0000 7f63cd59a640 1 -- 172.21.15.50:0/370581640 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c402ac30 con 0x7f63d00b4bd0 2024-09-11T22:16:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.329+0000 7f63cd59a640 1 -- 172.21.15.50:0/370581640 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c0001670 con 0x7f63d00b4bd0 2024-09-11T22:16:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.329+0000 7f63d4e82640 1 -- 172.21.15.50:0/370581640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63d00b4bd0 msgr2=0x7f63d00b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.329+0000 7f63d4e82640 1 --2- 172.21.15.50:0/370581640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63d00b4bd0 0x7f63d00b1340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f63c40097d0 tx=0x7f63c402a1a0 comp rx=0 tx=0).stop 2024-09-11T22:16:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.329+0000 7f63d4e82640 1 -- 172.21.15.50:0/370581640 shutdown_connections 2024-09-11T22:16:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.329+0000 7f63d4e82640 1 --2- 172.21.15.50:0/370581640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63d00b4bd0 0x7f63d00b1340 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.329+0000 7f63d4e82640 1 -- 172.21.15.50:0/370581640 >> 172.21.15.50:0/370581640 conn(0x7f63d00b40b0 msgr2=0x7f63d00b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.329+0000 7f63d4e82640 1 -- 172.21.15.50:0/370581640 shutdown_connections 2024-09-11T22:16:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.329+0000 7f63d4e82640 1 -- 172.21.15.50:0/370581640 wait complete. 2024-09-11T22:16:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.330+0000 7f63d4e82640 1 Processor -- start 2024-09-11T22:16:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.331+0000 7f63d4e82640 1 -- start start 2024-09-11T22:16:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.331+0000 7f63d4e82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d00b0f60 0x7f63d0155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.331+0000 7f63d4e82640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63d00b4bd0 0x7f63d00c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.331+0000 7f63d4e82640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63d0162d10 0x7f63d00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.331+0000 7f63d4e82640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f63d006d9e0 con 0x7f63d00b4bd0 2024-09-11T22:16:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.331+0000 7f63d4e82640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f63d01631c0 con 0x7f63d00b0f60 2024-09-11T22:16:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.331+0000 7f63d4e82640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f63d006db60 con 0x7f63d0162d10 2024-09-11T22:16:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.331+0000 7f63cdd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63d00b4bd0 0x7f63d00c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.331+0000 7f63cdd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63d00b4bd0 0x7f63d00c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56992/0 (socket says 172.21.15.50:56992) 2024-09-11T22:16:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.331+0000 7f63cdd9b640 1 -- 172.21.15.50:0/2404601230 learned_addr learned my addr 172.21.15.50:0/2404601230 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.331+0000 7f63ce59c640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d00b0f60 0x7f63d0155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.331+0000 7f63ced9d640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63d0162d10 0x7f63d00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.332+0000 7f63cdd9b640 1 -- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63d0162d10 msgr2=0x7f63d00b77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.332+0000 7f63cdd9b640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63d0162d10 0x7f63d00b77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.332+0000 7f63cdd9b640 1 -- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d00b0f60 msgr2=0x7f63d0155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.332+0000 7f63cdd9b640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d00b0f60 0x7f63d0155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.332+0000 7f63cdd9b640 1 -- 172.21.15.50:0/2404601230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d00c7bc0 con 0x7f63d00b4bd0 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.332+0000 7f63cdd9b640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63d00b4bd0 0x7f63d00c7350 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f63c40097d0 tx=0x7f63c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.332+0000 7f63beffd640 1 -- 172.21.15.50:0/2404601230 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4037050 con 0x7f63d00b4bd0 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.332+0000 7f63beffd640 1 -- 172.21.15.50:0/2404601230 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c4043070 con 0x7f63d00b4bd0 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.332+0000 7f63d4e82640 1 -- 172.21.15.50:0/2404601230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d00c7ea0 con 0x7f63d00b4bd0 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.332+0000 7f63beffd640 1 -- 172.21.15.50:0/2404601230 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4006e10 con 0x7f63d00b4bd0 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.332+0000 7f63d4e82640 1 -- 172.21.15.50:0/2404601230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d00c8460 con 0x7f63d00b4bd0 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.333+0000 7f63d4e82640 1 -- 172.21.15.50:0/2404601230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d00c9270 con 0x7f63d00b4bd0 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.334+0000 7f63beffd640 1 -- 172.21.15.50:0/2404601230 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63c403ca10 con 0x7f63d00b4bd0 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.334+0000 7f63beffd640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f63b006be30 0x7f63b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:35.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.334+0000 7f63beffd640 1 -- 172.21.15.50:0/2404601230 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f63c40ab8e0 con 0x7f63d00b4bd0 2024-09-11T22:16:35.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.335+0000 7f63ce59c640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f63b006be30 0x7f63b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:35.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.335+0000 7f63ce59c640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f63b006be30 0x7f63b006e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f63c00017e0 tx=0x7f63c0001610 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.339+0000 7f63beffd640 1 -- 172.21.15.50:0/2404601230 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63c4079c50 con 0x7f63d00b4bd0 2024-09-11T22:16:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.510+0000 7f63d4e82640 1 -- 172.21.15.50:0/2404601230 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63d00b84e0 con 0x7f63b006be30 2024-09-11T22:16:35.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.517+0000 7f63beffd640 1 -- 172.21.15.50:0/2404601230 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252466 (secure 0 0 0) 0x7f63d00b84e0 con 0x7f63b006be30 2024-09-11T22:16:35.520 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:35.521 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:16:35.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.520+0000 7f63d4e82640 1 -- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f63b006be30 msgr2=0x7f63b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:35.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.520+0000 7f63d4e82640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f63b006be30 0x7f63b006e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f63c00017e0 tx=0x7f63c0001610 comp rx=0 tx=0).stop 2024-09-11T22:16:35.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.520+0000 7f63d4e82640 1 -- 172.21.15.50:0/2404601230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63d00b4bd0 msgr2=0x7f63d00c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:35.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.520+0000 7f63d4e82640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63d00b4bd0 0x7f63d00c7350 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f63c40097d0 tx=0x7f63c40046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:35.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.520+0000 7f63d4e82640 1 -- 172.21.15.50:0/2404601230 shutdown_connections 2024-09-11T22:16:35.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.520+0000 7f63d4e82640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f63b006be30 0x7f63b006e2f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:35.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.520+0000 7f63d4e82640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63d0162d10 0x7f63d00b77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:35.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.520+0000 7f63d4e82640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63d00b4bd0 0x7f63d00c7350 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:35.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.520+0000 7f63d4e82640 1 --2- 172.21.15.50:0/2404601230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d00b0f60 0x7f63d0155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:35.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.520+0000 7f63d4e82640 1 -- 172.21.15.50:0/2404601230 >> 172.21.15.50:0/2404601230 conn(0x7f63d00b40b0 msgr2=0x7f63d00b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:35.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.520+0000 7f63d4e82640 1 -- 172.21.15.50:0/2404601230 shutdown_connections 2024-09-11T22:16:35.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:35.520+0000 7f63d4e82640 1 -- 172.21.15.50:0/2404601230 wait complete. 2024-09-11T22:16:35.532 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2024-09-11T22:16:35.441785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":281792,"kb_used_data":11456,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754692928,"statfs":{"total":773094113280,"available":772805558272,"internally_reserved":0,"allocated":11730944,"data_stored":5760979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001645"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856934+0000","last_change":"2024-09-11T22:16:31.142231+0000","last_active":"2024-09-11T22:16:32.856934+0000","last_peered":"2024-09-11T22:16:32.856934+0000","last_clean":"2024-09-11T22:16:32.856934+0000","last_became_active":"2024-09-11T22:16:31.141942+0000","last_became_peered":"2024-09-11T22:16:31.141942+0000","last_unstale":"2024-09-11T22:16:32.856934+0000","last_undegraded":"2024-09-11T22:16:32.856934+0000","last_fullsized":"2024-09-11T22:16:32.856934+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.449580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133551+0000","last_change":"2024-09-11T22:16:31.143843+0000","last_active":"2024-09-11T22:16:32.133551+0000","last_peered":"2024-09-11T22:16:32.133551+0000","last_clean":"2024-09-11T22:16:32.133551+0000","last_became_active":"2024-09-11T22:16:31.143579+0000","last_became_peered":"2024-09-11T22:16:31.143579+0000","last_unstale":"2024-09-11T22:16:32.133551+0000","last_undegraded":"2024-09-11T22:16:32.133551+0000","last_fullsized":"2024-09-11T22:16:32.133551+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:34:33.959757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856326+0000","last_change":"2024-09-11T22:16:31.148309+0000","last_active":"2024-09-11T22:16:32.856326+0000","last_peered":"2024-09-11T22:16:32.856326+0000","last_clean":"2024-09-11T22:16:32.856326+0000","last_became_active":"2024-09-11T22:16:31.148024+0000","last_became_peered":"2024-09-11T22:16:31.148024+0000","last_unstale":"2024-09-11T22:16:32.856326+0000","last_undegraded":"2024-09-11T22:16:32.856326+0000","last_fullsized":"2024-09-11T22:16:32.856326+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:08.680694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355813+0000","last_change":"2024-09-11T22:16:31.141908+0000","last_active":"2024-09-11T22:16:32.355813+0000","last_peered":"2024-09-11T22:16:32.355813+0000","last_clean":"2024-09-11T22:16:32.355813+0000","last_became_active":"2024-09-11T22:16:31.141591+0000","last_became_peered":"2024-09-11T22:16:31.141591+0000","last_unstale":"2024-09-11T22:16:32.355813+0000","last_undegraded":"2024-09-11T22:16:32.355813+0000","last_fullsized":"2024-09-11T22:16:32.355813+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:55.433938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857400+0000","last_change":"2024-09-11T22:16:31.133523+0000","last_active":"2024-09-11T22:16:32.857400+0000","last_peered":"2024-09-11T22:16:32.857400+0000","last_clean":"2024-09-11T22:16:32.857400+0000","last_became_active":"2024-09-11T22:16:31.133257+0000","last_became_peered":"2024-09-11T22:16:31.133257+0000","last_unstale":"2024-09-11T22:16:32.857400+0000","last_undegraded":"2024-09-11T22:16:32.857400+0000","last_fullsized":"2024-09-11T22:16:32.857400+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:41.306517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.138729+0000","last_change":"2024-09-11T22:16:31.132072+0000","last_active":"2024-09-11T22:16:31.138729+0000","last_peered":"2024-09-11T22:16:31.138729+0000","last_clean":"2024-09-11T22:16:31.138729+0000","last_became_active":"2024-09-11T22:16:31.131809+0000","last_became_peered":"2024-09-11T22:16:31.131809+0000","last_unstale":"2024-09-11T22:16:31.138729+0000","last_undegraded":"2024-09-11T22:16:31.138729+0000","last_fullsized":"2024-09-11T22:16:31.138729+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:52.397280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143058+0000","last_change":"2024-09-11T22:16:31.140404+0000","last_active":"2024-09-11T22:16:31.143058+0000","last_peered":"2024-09-11T22:16:31.143058+0000","last_clean":"2024-09-11T22:16:31.143058+0000","last_became_active":"2024-09-11T22:16:31.140115+0000","last_became_peered":"2024-09-11T22:16:31.140115+0000","last_unstale":"2024-09-11T22:16:31.143058+0000","last_undegraded":"2024-09-11T22:16:31.143058+0000","last_fullsized":"2024-09-11T22:16:31.143058+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.356920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133310+0000","last_change":"2024-09-11T22:16:31.135807+0000","last_active":"2024-09-11T22:16:32.133310+0000","last_peered":"2024-09-11T22:16:32.133310+0000","last_clean":"2024-09-11T22:16:32.133310+0000","last_became_active":"2024-09-11T22:16:31.135532+0000","last_became_peered":"2024-09-11T22:16:31.135532+0000","last_unstale":"2024-09-11T22:16:32.133310+0000","last_undegraded":"2024-09-11T22:16:32.133310+0000","last_fullsized":"2024-09-11T22:16:32.133310+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:24.431553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.135406+0000","last_change":"2024-09-11T22:16:31.131851+0000","last_active":"2024-09-11T22:16:32.135406+0000","last_peered":"2024-09-11T22:16:32.135406+0000","last_clean":"2024-09-11T22:16:32.135406+0000","last_became_active":"2024-09-11T22:16:31.131590+0000","last_became_peered":"2024-09-11T22:16:31.131590+0000","last_unstale":"2024-09-11T22:16:32.135406+0000","last_undegraded":"2024-09-11T22:16:32.135406+0000","last_fullsized":"2024-09-11T22:16:32.135406+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:38.463373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857549+0000","last_change":"2024-09-11T22:16:31.140455+0000","last_active":"2024-09-11T22:16:32.857549+0000","last_peered":"2024-09-11T22:16:32.857549+0000","last_clean":"2024-09-11T22:16:32.857549+0000","last_became_active":"2024-09-11T22:16:31.140201+0000","last_became_peered":"2024-09-11T22:16:31.140201+0000","last_unstale":"2024-09-11T22:16:32.857549+0000","last_undegraded":"2024-09-11T22:16:32.857549+0000","last_fullsized":"2024-09-11T22:16:32.857549+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:13.221303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.139774+0000","last_change":"2024-09-11T22:16:31.137742+0000","last_active":"2024-09-11T22:16:31.139774+0000","last_peered":"2024-09-11T22:16:31.139774+0000","last_clean":"2024-09-11T22:16:31.139774+0000","last_became_active":"2024-09-11T22:16:31.137465+0000","last_became_peered":"2024-09-11T22:16:31.137465+0000","last_unstale":"2024-09-11T22:16:31.139774+0000","last_undegraded":"2024-09-11T22:16:31.139774+0000","last_fullsized":"2024-09-11T22:16:31.139774+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.302219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134450+0000","last_change":"2024-09-11T22:16:31.147731+0000","last_active":"2024-09-11T22:16:32.134450+0000","last_peered":"2024-09-11T22:16:32.134450+0000","last_clean":"2024-09-11T22:16:32.134450+0000","last_became_active":"2024-09-11T22:16:31.146850+0000","last_became_peered":"2024-09-11T22:16:31.146850+0000","last_unstale":"2024-09-11T22:16:32.134450+0000","last_undegraded":"2024-09-11T22:16:32.134450+0000","last_fullsized":"2024-09-11T22:16:32.134450+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:25.930260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355549+0000","last_change":"2024-09-11T22:16:31.141006+0000","last_active":"2024-09-11T22:16:32.355549+0000","last_peered":"2024-09-11T22:16:32.355549+0000","last_clean":"2024-09-11T22:16:32.355549+0000","last_became_active":"2024-09-11T22:16:31.140442+0000","last_became_peered":"2024-09-11T22:16:31.140442+0000","last_unstale":"2024-09-11T22:16:32.355549+0000","last_undegraded":"2024-09-11T22:16:32.355549+0000","last_fullsized":"2024-09-11T22:16:32.355549+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:28.758274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.141824+0000","last_change":"2024-09-11T22:16:31.139945+0000","last_active":"2024-09-11T22:16:31.141824+0000","last_peered":"2024-09-11T22:16:31.141824+0000","last_clean":"2024-09-11T22:16:31.141824+0000","last_became_active":"2024-09-11T22:16:31.139641+0000","last_became_peered":"2024-09-11T22:16:31.139641+0000","last_unstale":"2024-09-11T22:16:31.141824+0000","last_undegraded":"2024-09-11T22:16:31.141824+0000","last_fullsized":"2024-09-11T22:16:31.141824+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:39.961376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355418+0000","last_change":"2024-09-11T22:16:31.150745+0000","last_active":"2024-09-11T22:16:32.355418+0000","last_peered":"2024-09-11T22:16:32.355418+0000","last_clean":"2024-09-11T22:16:32.355418+0000","last_became_active":"2024-09-11T22:16:31.150471+0000","last_became_peered":"2024-09-11T22:16:31.150471+0000","last_unstale":"2024-09-11T22:16:32.355418+0000","last_undegraded":"2024-09-11T22:16:32.355418+0000","last_fullsized":"2024-09-11T22:16:32.355418+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:36.511773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.139900+0000","last_change":"2024-09-11T22:16:31.137051+0000","last_active":"2024-09-11T22:16:31.139900+0000","last_peered":"2024-09-11T22:16:31.139900+0000","last_clean":"2024-09-11T22:16:31.139900+0000","last_became_active":"2024-09-11T22:16:31.136536+0000","last_became_peered":"2024-09-11T22:16:31.136536+0000","last_unstale":"2024-09-11T22:16:31.139900+0000","last_undegraded":"2024-09-11T22:16:31.139900+0000","last_fullsized":"2024-09-11T22:16:31.139900+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:43.578171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133553+0000","last_change":"2024-09-11T22:16:31.143912+0000","last_active":"2024-09-11T22:16:32.133553+0000","last_peered":"2024-09-11T22:16:32.133553+0000","last_clean":"2024-09-11T22:16:32.133553+0000","last_became_active":"2024-09-11T22:16:31.143630+0000","last_became_peered":"2024-09-11T22:16:31.143630+0000","last_unstale":"2024-09-11T22:16:32.133553+0000","last_undegraded":"2024-09-11T22:16:32.133553+0000","last_fullsized":"2024-09-11T22:16:32.133553+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:02.998119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355655+0000","last_change":"2024-09-11T22:16:31.147613+0000","last_active":"2024-09-11T22:16:32.355655+0000","last_peered":"2024-09-11T22:16:32.355655+0000","last_clean":"2024-09-11T22:16:32.355655+0000","last_became_active":"2024-09-11T22:16:31.146299+0000","last_became_peered":"2024-09-11T22:16:31.146299+0000","last_unstale":"2024-09-11T22:16:32.355655+0000","last_undegraded":"2024-09-11T22:16:32.355655+0000","last_fullsized":"2024-09-11T22:16:32.355655+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:55.042439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.153935+0000","last_change":"2024-09-11T22:16:31.152030+0000","last_active":"2024-09-11T22:16:31.153935+0000","last_peered":"2024-09-11T22:16:31.153935+0000","last_clean":"2024-09-11T22:16:31.153935+0000","last_became_active":"2024-09-11T22:16:31.151734+0000","last_became_peered":"2024-09-11T22:16:31.151734+0000","last_unstale":"2024-09-11T22:16:31.153935+0000","last_undegraded":"2024-09-11T22:16:31.153935+0000","last_fullsized":"2024-09-11T22:16:31.153935+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:15.537243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134595+0000","last_change":"2024-09-11T22:16:31.131822+0000","last_active":"2024-09-11T22:16:32.134595+0000","last_peered":"2024-09-11T22:16:32.134595+0000","last_clean":"2024-09-11T22:16:32.134595+0000","last_became_active":"2024-09-11T22:16:31.131554+0000","last_became_peered":"2024-09-11T22:16:31.131554+0000","last_unstale":"2024-09-11T22:16:32.134595+0000","last_undegraded":"2024-09-11T22:16:32.134595+0000","last_fullsized":"2024-09-11T22:16:32.134595+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:55.400432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.147925+0000","last_change":"2024-09-11T22:16:31.146858+0000","last_active":"2024-09-11T22:16:31.147925+0000","last_peered":"2024-09-11T22:16:31.147925+0000","last_clean":"2024-09-11T22:16:31.147925+0000","last_became_active":"2024-09-11T22:16:31.146546+0000","last_became_peered":"2024-09-11T22:16:31.146546+0000","last_unstale":"2024-09-11T22:16:31.147925+0000","last_undegraded":"2024-09-11T22:16:31.147925+0000","last_fullsized":"2024-09-11T22:16:31.147925+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:54.212790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133290+0000","last_change":"2024-09-11T22:16:31.136301+0000","last_active":"2024-09-11T22:16:32.133290+0000","last_peered":"2024-09-11T22:16:32.133290+0000","last_clean":"2024-09-11T22:16:32.133290+0000","last_became_active":"2024-09-11T22:16:31.136010+0000","last_became_peered":"2024-09-11T22:16:31.136010+0000","last_unstale":"2024-09-11T22:16:32.133290+0000","last_undegraded":"2024-09-11T22:16:32.133290+0000","last_fullsized":"2024-09-11T22:16:32.133290+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:38.328801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133428+0000","last_change":"2024-09-11T22:16:31.143207+0000","last_active":"2024-09-11T22:16:32.133428+0000","last_peered":"2024-09-11T22:16:32.133428+0000","last_clean":"2024-09-11T22:16:32.133428+0000","last_became_active":"2024-09-11T22:16:31.142899+0000","last_became_peered":"2024-09-11T22:16:31.142899+0000","last_unstale":"2024-09-11T22:16:32.133428+0000","last_undegraded":"2024-09-11T22:16:32.133428+0000","last_fullsized":"2024-09-11T22:16:32.133428+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:43:39.724039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.148740+0000","last_change":"2024-09-11T22:16:31.147334+0000","last_active":"2024-09-11T22:16:31.148740+0000","last_peered":"2024-09-11T22:16:31.148740+0000","last_clean":"2024-09-11T22:16:31.148740+0000","last_became_active":"2024-09-11T22:16:31.147006+0000","last_became_peered":"2024-09-11T22:16:31.147006+0000","last_unstale":"2024-09-11T22:16:31.148740+0000","last_undegraded":"2024-09-11T22:16:31.148740+0000","last_fullsized":"2024-09-11T22:16:31.148740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:57.368631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857581+0000","last_change":"2024-09-11T22:16:31.139794+0000","last_active":"2024-09-11T22:16:32.857581+0000","last_peered":"2024-09-11T22:16:32.857581+0000","last_clean":"2024-09-11T22:16:32.857581+0000","last_became_active":"2024-09-11T22:16:31.138697+0000","last_became_peered":"2024-09-11T22:16:31.138697+0000","last_unstale":"2024-09-11T22:16:32.857581+0000","last_undegraded":"2024-09-11T22:16:32.857581+0000","last_fullsized":"2024-09-11T22:16:32.857581+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:21.822644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133760+0000","last_change":"2024-09-11T22:16:31.138060+0000","last_active":"2024-09-11T22:16:32.133760+0000","last_peered":"2024-09-11T22:16:32.133760+0000","last_clean":"2024-09-11T22:16:32.133760+0000","last_became_active":"2024-09-11T22:16:31.137769+0000","last_became_peered":"2024-09-11T22:16:31.137769+0000","last_unstale":"2024-09-11T22:16:32.133760+0000","last_undegraded":"2024-09-11T22:16:32.133760+0000","last_fullsized":"2024-09-11T22:16:32.133760+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:23.740045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143172+0000","last_change":"2024-09-11T22:16:31.142015+0000","last_active":"2024-09-11T22:16:31.143172+0000","last_peered":"2024-09-11T22:16:31.143172+0000","last_clean":"2024-09-11T22:16:31.143172+0000","last_became_active":"2024-09-11T22:16:31.141425+0000","last_became_peered":"2024-09-11T22:16:31.141425+0000","last_unstale":"2024-09-11T22:16:31.143172+0000","last_undegraded":"2024-09-11T22:16:31.143172+0000","last_fullsized":"2024-09-11T22:16:31.143172+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:43:35.268521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857673+0000","last_change":"2024-09-11T22:16:31.144606+0000","last_active":"2024-09-11T22:16:32.857673+0000","last_peered":"2024-09-11T22:16:32.857673+0000","last_clean":"2024-09-11T22:16:32.857673+0000","last_became_active":"2024-09-11T22:16:31.144334+0000","last_became_peered":"2024-09-11T22:16:31.144334+0000","last_unstale":"2024-09-11T22:16:32.857673+0000","last_undegraded":"2024-09-11T22:16:32.857673+0000","last_fullsized":"2024-09-11T22:16:32.857673+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:38.463373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133874+0000","last_change":"2024-09-11T22:16:31.138549+0000","last_active":"2024-09-11T22:16:32.133874+0000","last_peered":"2024-09-11T22:16:32.133874+0000","last_clean":"2024-09-11T22:16:32.133874+0000","last_became_active":"2024-09-11T22:16:31.138277+0000","last_became_peered":"2024-09-11T22:16:31.138277+0000","last_unstale":"2024-09-11T22:16:32.133874+0000","last_undegraded":"2024-09-11T22:16:32.133874+0000","last_fullsized":"2024-09-11T22:16:32.133874+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:36.511773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.151425+0000","last_change":"2024-09-11T22:16:31.149706+0000","last_active":"2024-09-11T22:16:31.151425+0000","last_peered":"2024-09-11T22:16:31.151425+0000","last_clean":"2024-09-11T22:16:31.151425+0000","last_became_active":"2024-09-11T22:16:31.149426+0000","last_became_peered":"2024-09-11T22:16:31.149426+0000","last_unstale":"2024-09-11T22:16:31.151425+0000","last_undegraded":"2024-09-11T22:16:31.151425+0000","last_fullsized":"2024-09-11T22:16:31.151425+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:25.619855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355646+0000","last_change":"2024-09-11T22:16:31.135076+0000","last_active":"2024-09-11T22:16:32.355646+0000","last_peered":"2024-09-11T22:16:32.355646+0000","last_clean":"2024-09-11T22:16:32.355646+0000","last_became_active":"2024-09-11T22:16:31.134764+0000","last_became_peered":"2024-09-11T22:16:31.134764+0000","last_unstale":"2024-09-11T22:16:32.355646+0000","last_undegraded":"2024-09-11T22:16:32.355646+0000","last_fullsized":"2024-09-11T22:16:32.355646+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:36:51.553600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856049+0000","last_change":"2024-09-11T22:16:31.152274+0000","last_active":"2024-09-11T22:16:32.856049+0000","last_peered":"2024-09-11T22:16:32.856049+0000","last_clean":"2024-09-11T22:16:32.856049+0000","last_became_active":"2024-09-11T22:16:31.152004+0000","last_became_peered":"2024-09-11T22:16:31.152004+0000","last_unstale":"2024-09-11T22:16:32.856049+0000","last_undegraded":"2024-09-11T22:16:32.856049+0000","last_fullsized":"2024-09-11T22:16:32.856049+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:13.893093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.146070+0000","last_change":"2024-09-11T22:16:31.144398+0000","last_active":"2024-09-11T22:16:31.146070+0000","last_peered":"2024-09-11T22:16:31.146070+0000","last_clean":"2024-09-11T22:16:31.146070+0000","last_became_active":"2024-09-11T22:16:31.144121+0000","last_became_peered":"2024-09-11T22:16:31.144121+0000","last_unstale":"2024-09-11T22:16:31.146070+0000","last_undegraded":"2024-09-11T22:16:31.146070+0000","last_fullsized":"2024-09-11T22:16:31.146070+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:17.118335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"106'4","reported_seq":18,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133560+0000","last_change":"2024-09-11T22:16:30.136446+0000","last_active":"2024-09-11T22:16:32.133560+0000","last_peered":"2024-09-11T22:16:32.133560+0000","last_clean":"2024-09-11T22:16:32.133560+0000","last_became_active":"2024-09-11T22:16:30.136127+0000","last_became_peered":"2024-09-11T22:16:30.136127+0000","last_unstale":"2024-09-11T22:16:32.133560+0000","last_undegraded":"2024-09-11T22:16:32.133560+0000","last_fullsized":"2024-09-11T22:16:32.133560+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:05.543005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355882+0000","last_change":"2024-09-11T22:16:31.135178+0000","last_active":"2024-09-11T22:16:32.355882+0000","last_peered":"2024-09-11T22:16:32.355882+0000","last_clean":"2024-09-11T22:16:32.355882+0000","last_became_active":"2024-09-11T22:16:31.134873+0000","last_became_peered":"2024-09-11T22:16:31.134873+0000","last_unstale":"2024-09-11T22:16:32.355882+0000","last_undegraded":"2024-09-11T22:16:32.355882+0000","last_fullsized":"2024-09-11T22:16:32.355882+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:41.065428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.147427+0000","last_change":"2024-09-11T22:16:30.144070+0000","last_active":"2024-09-11T22:16:31.147427+0000","last_peered":"2024-09-11T22:16:31.147427+0000","last_clean":"2024-09-11T22:16:31.147427+0000","last_became_active":"2024-09-11T22:16:30.143809+0000","last_became_peered":"2024-09-11T22:16:30.143809+0000","last_unstale":"2024-09-11T22:16:31.147427+0000","last_undegraded":"2024-09-11T22:16:31.147427+0000","last_fullsized":"2024-09-11T22:16:31.147427+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:26.892307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856568+0000","last_change":"2024-09-11T22:16:31.147074+0000","last_active":"2024-09-11T22:16:32.856568+0000","last_peered":"2024-09-11T22:16:32.856568+0000","last_clean":"2024-09-11T22:16:32.856568+0000","last_became_active":"2024-09-11T22:16:31.146785+0000","last_became_peered":"2024-09-11T22:16:31.146785+0000","last_unstale":"2024-09-11T22:16:32.856568+0000","last_undegraded":"2024-09-11T22:16:32.856568+0000","last_fullsized":"2024-09-11T22:16:32.856568+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:24.357126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133620+0000","last_change":"2024-09-11T22:16:30.138148+0000","last_active":"2024-09-11T22:16:32.133620+0000","last_peered":"2024-09-11T22:16:32.133620+0000","last_clean":"2024-09-11T22:16:32.133620+0000","last_became_active":"2024-09-11T22:16:30.137865+0000","last_became_peered":"2024-09-11T22:16:30.137865+0000","last_unstale":"2024-09-11T22:16:32.133620+0000","last_undegraded":"2024-09-11T22:16:32.133620+0000","last_fullsized":"2024-09-11T22:16:32.133620+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:18.620220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.135152+0000","last_change":"2024-09-11T22:16:31.134973+0000","last_active":"2024-09-11T22:16:32.135152+0000","last_peered":"2024-09-11T22:16:32.135152+0000","last_clean":"2024-09-11T22:16:32.135152+0000","last_became_active":"2024-09-11T22:16:31.134644+0000","last_became_peered":"2024-09-11T22:16:31.134644+0000","last_unstale":"2024-09-11T22:16:32.135152+0000","last_undegraded":"2024-09-11T22:16:32.135152+0000","last_fullsized":"2024-09-11T22:16:32.135152+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:53.744214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133458+0000","last_change":"2024-09-11T22:16:30.139398+0000","last_active":"2024-09-11T22:16:32.133458+0000","last_peered":"2024-09-11T22:16:32.133458+0000","last_clean":"2024-09-11T22:16:32.133458+0000","last_became_active":"2024-09-11T22:16:30.139127+0000","last_became_peered":"2024-09-11T22:16:30.139127+0000","last_unstale":"2024-09-11T22:16:32.133458+0000","last_undegraded":"2024-09-11T22:16:32.133458+0000","last_fullsized":"2024-09-11T22:16:32.133458+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:59.746406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134646+0000","last_change":"2024-09-11T22:16:31.133977+0000","last_active":"2024-09-11T22:16:32.134646+0000","last_peered":"2024-09-11T22:16:32.134646+0000","last_clean":"2024-09-11T22:16:32.134646+0000","last_became_active":"2024-09-11T22:16:31.133696+0000","last_became_peered":"2024-09-11T22:16:31.133696+0000","last_unstale":"2024-09-11T22:16:32.134646+0000","last_undegraded":"2024-09-11T22:16:32.134646+0000","last_fullsized":"2024-09-11T22:16:32.134646+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:12.708663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856298+0000","last_change":"2024-09-11T22:16:30.137762+0000","last_active":"2024-09-11T22:16:32.856298+0000","last_peered":"2024-09-11T22:16:32.856298+0000","last_clean":"2024-09-11T22:16:32.856298+0000","last_became_active":"2024-09-11T22:16:30.137498+0000","last_became_peered":"2024-09-11T22:16:30.137498+0000","last_unstale":"2024-09-11T22:16:32.856298+0000","last_undegraded":"2024-09-11T22:16:32.856298+0000","last_fullsized":"2024-09-11T22:16:32.856298+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:16.713406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143099+0000","last_change":"2024-09-11T22:16:31.141412+0000","last_active":"2024-09-11T22:16:31.143099+0000","last_peered":"2024-09-11T22:16:31.143099+0000","last_clean":"2024-09-11T22:16:31.143099+0000","last_became_active":"2024-09-11T22:16:31.140411+0000","last_became_peered":"2024-09-11T22:16:31.140411+0000","last_unstale":"2024-09-11T22:16:31.143099+0000","last_undegraded":"2024-09-11T22:16:31.143099+0000","last_fullsized":"2024-09-11T22:16:31.143099+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:40.247355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133237+0000","last_change":"2024-09-11T22:16:30.127006+0000","last_active":"2024-09-11T22:16:32.133237+0000","last_peered":"2024-09-11T22:16:32.133237+0000","last_clean":"2024-09-11T22:16:32.133237+0000","last_became_active":"2024-09-11T22:16:30.126684+0000","last_became_peered":"2024-09-11T22:16:30.126684+0000","last_unstale":"2024-09-11T22:16:32.133237+0000","last_undegraded":"2024-09-11T22:16:32.133237+0000","last_fullsized":"2024-09-11T22:16:32.133237+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:54.535530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355483+0000","last_change":"2024-09-11T22:16:31.151415+0000","last_active":"2024-09-11T22:16:32.355483+0000","last_peered":"2024-09-11T22:16:32.355483+0000","last_clean":"2024-09-11T22:16:32.355483+0000","last_became_active":"2024-09-11T22:16:31.151155+0000","last_became_peered":"2024-09-11T22:16:31.151155+0000","last_unstale":"2024-09-11T22:16:32.355483+0000","last_undegraded":"2024-09-11T22:16:32.355483+0000","last_fullsized":"2024-09-11T22:16:32.355483+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:26.126461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857234+0000","last_change":"2024-09-11T22:16:30.140931+0000","last_active":"2024-09-11T22:16:32.857234+0000","last_peered":"2024-09-11T22:16:32.857234+0000","last_clean":"2024-09-11T22:16:32.857234+0000","last_became_active":"2024-09-11T22:16:30.140620+0000","last_became_peered":"2024-09-11T22:16:30.140620+0000","last_unstale":"2024-09-11T22:16:32.857234+0000","last_undegraded":"2024-09-11T22:16:32.857234+0000","last_fullsized":"2024-09-11T22:16:32.857234+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:31.653170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134580+0000","last_change":"2024-09-11T22:16:31.128646+0000","last_active":"2024-09-11T22:16:32.134580+0000","last_peered":"2024-09-11T22:16:32.134580+0000","last_clean":"2024-09-11T22:16:32.134580+0000","last_became_active":"2024-09-11T22:16:31.128351+0000","last_became_peered":"2024-09-11T22:16:31.128351+0000","last_unstale":"2024-09-11T22:16:32.134580+0000","last_undegraded":"2024-09-11T22:16:32.134580+0000","last_fullsized":"2024-09-11T22:16:32.134580+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:13.221303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856154+0000","last_change":"2024-09-11T22:16:30.141298+0000","last_active":"2024-09-11T22:16:32.856154+0000","last_peered":"2024-09-11T22:16:32.856154+0000","last_clean":"2024-09-11T22:16:32.856154+0000","last_became_active":"2024-09-11T22:16:30.140999+0000","last_became_peered":"2024-09-11T22:16:30.140999+0000","last_unstale":"2024-09-11T22:16:32.856154+0000","last_undegraded":"2024-09-11T22:16:32.856154+0000","last_fullsized":"2024-09-11T22:16:32.856154+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:48.489911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133752+0000","last_change":"2024-09-11T22:16:31.142293+0000","last_active":"2024-09-11T22:16:32.133752+0000","last_peered":"2024-09-11T22:16:32.133752+0000","last_clean":"2024-09-11T22:16:32.133752+0000","last_became_active":"2024-09-11T22:16:31.141991+0000","last_became_peered":"2024-09-11T22:16:31.141991+0000","last_unstale":"2024-09-11T22:16:32.133752+0000","last_undegraded":"2024-09-11T22:16:32.133752+0000","last_fullsized":"2024-09-11T22:16:32.133752+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:33.967016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856967+0000","last_change":"2024-09-11T22:16:30.136911+0000","last_active":"2024-09-11T22:16:32.856967+0000","last_peered":"2024-09-11T22:16:32.856967+0000","last_clean":"2024-09-11T22:16:32.856967+0000","last_became_active":"2024-09-11T22:16:30.136363+0000","last_became_peered":"2024-09-11T22:16:30.136363+0000","last_unstale":"2024-09-11T22:16:32.856967+0000","last_undegraded":"2024-09-11T22:16:32.856967+0000","last_fullsized":"2024-09-11T22:16:32.856967+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:43.202307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.135528+0000","last_change":"2024-09-11T22:16:31.128426+0000","last_active":"2024-09-11T22:16:32.135528+0000","last_peered":"2024-09-11T22:16:32.135528+0000","last_clean":"2024-09-11T22:16:32.135528+0000","last_became_active":"2024-09-11T22:16:31.128145+0000","last_became_peered":"2024-09-11T22:16:31.128145+0000","last_unstale":"2024-09-11T22:16:32.135528+0000","last_undegraded":"2024-09-11T22:16:32.135528+0000","last_fullsized":"2024-09-11T22:16:32.135528+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:39.616358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355592+0000","last_change":"2024-09-11T22:16:30.140926+0000","last_active":"2024-09-11T22:16:32.355592+0000","last_peered":"2024-09-11T22:16:32.355592+0000","last_clean":"2024-09-11T22:16:32.355592+0000","last_became_active":"2024-09-11T22:16:30.140685+0000","last_became_peered":"2024-09-11T22:16:30.140685+0000","last_unstale":"2024-09-11T22:16:32.355592+0000","last_undegraded":"2024-09-11T22:16:32.355592+0000","last_fullsized":"2024-09-11T22:16:32.355592+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:38.610602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857657+0000","last_change":"2024-09-11T22:16:31.139026+0000","last_active":"2024-09-11T22:16:32.857657+0000","last_peered":"2024-09-11T22:16:32.857657+0000","last_clean":"2024-09-11T22:16:32.857657+0000","last_became_active":"2024-09-11T22:16:31.138707+0000","last_became_peered":"2024-09-11T22:16:31.138707+0000","last_unstale":"2024-09-11T22:16:32.857657+0000","last_undegraded":"2024-09-11T22:16:32.857657+0000","last_fullsized":"2024-09-11T22:16:32.857657+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:53.744214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"106'3","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143269+0000","last_change":"2024-09-11T22:16:30.138863+0000","last_active":"2024-09-11T22:16:31.143269+0000","last_peered":"2024-09-11T22:16:31.143269+0000","last_clean":"2024-09-11T22:16:31.143269+0000","last_became_active":"2024-09-11T22:16:30.138546+0000","last_became_peered":"2024-09-11T22:16:30.138546+0000","last_unstale":"2024-09-11T22:16:31.143269+0000","last_undegraded":"2024-09-11T22:16:31.143269+0000","last_fullsized":"2024-09-11T22:16:31.143269+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.751700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.144921+0000","last_change":"2024-09-11T22:16:31.142601+0000","last_active":"2024-09-11T22:16:31.144921+0000","last_peered":"2024-09-11T22:16:31.144921+0000","last_clean":"2024-09-11T22:16:31.144921+0000","last_became_active":"2024-09-11T22:16:31.142307+0000","last_became_peered":"2024-09-11T22:16:31.142307+0000","last_unstale":"2024-09-11T22:16:31.144921+0000","last_undegraded":"2024-09-11T22:16:31.144921+0000","last_fullsized":"2024-09-11T22:16:31.144921+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:58.641376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"106'6","reported_seq":20,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134831+0000","last_change":"2024-09-11T22:16:30.134598+0000","last_active":"2024-09-11T22:16:32.134831+0000","last_peered":"2024-09-11T22:16:32.134831+0000","last_clean":"2024-09-11T22:16:32.134831+0000","last_became_active":"2024-09-11T22:16:30.134328+0000","last_became_peered":"2024-09-11T22:16:30.134328+0000","last_unstale":"2024-09-11T22:16:32.134831+0000","last_undegraded":"2024-09-11T22:16:32.134831+0000","last_fullsized":"2024-09-11T22:16:32.134831+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:54.535530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355518+0000","last_change":"2024-09-11T22:16:31.136115+0000","last_active":"2024-09-11T22:16:32.355518+0000","last_peered":"2024-09-11T22:16:32.355518+0000","last_clean":"2024-09-11T22:16:32.355518+0000","last_became_active":"2024-09-11T22:16:31.135833+0000","last_became_peered":"2024-09-11T22:16:31.135833+0000","last_unstale":"2024-09-11T22:16:32.355518+0000","last_undegraded":"2024-09-11T22:16:32.355518+0000","last_fullsized":"2024-09-11T22:16:32.355518+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:12.447924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.145740+0000","last_change":"2024-09-11T22:16:30.134072+0000","last_active":"2024-09-11T22:16:31.145740+0000","last_peered":"2024-09-11T22:16:31.145740+0000","last_clean":"2024-09-11T22:16:31.145740+0000","last_became_active":"2024-09-11T22:16:30.133756+0000","last_became_peered":"2024-09-11T22:16:30.133756+0000","last_unstale":"2024-09-11T22:16:31.145740+0000","last_undegraded":"2024-09-11T22:16:31.145740+0000","last_fullsized":"2024-09-11T22:16:31.145740+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:40.093900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856242+0000","last_change":"2024-09-11T22:16:31.144950+0000","last_active":"2024-09-11T22:16:32.856242+0000","last_peered":"2024-09-11T22:16:32.856242+0000","last_clean":"2024-09-11T22:16:32.856242+0000","last_became_active":"2024-09-11T22:16:31.144664+0000","last_became_peered":"2024-09-11T22:16:31.144664+0000","last_unstale":"2024-09-11T22:16:32.856242+0000","last_undegraded":"2024-09-11T22:16:32.856242+0000","last_fullsized":"2024-09-11T22:16:32.856242+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:25.745105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.134219+0000","last_change":"2024-09-11T22:16:30.134404+0000","last_active":"2024-09-11T22:16:31.134219+0000","last_peered":"2024-09-11T22:16:31.134219+0000","last_clean":"2024-09-11T22:16:31.134219+0000","last_became_active":"2024-09-11T22:16:30.133816+0000","last_became_peered":"2024-09-11T22:16:30.133816+0000","last_unstale":"2024-09-11T22:16:31.134219+0000","last_undegraded":"2024-09-11T22:16:31.134219+0000","last_fullsized":"2024-09-11T22:16:31.134219+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:51:29.870433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134451+0000","last_change":"2024-09-11T22:16:31.134221+0000","last_active":"2024-09-11T22:16:32.134451+0000","last_peered":"2024-09-11T22:16:32.134451+0000","last_clean":"2024-09-11T22:16:32.134451+0000","last_became_active":"2024-09-11T22:16:31.133953+0000","last_became_peered":"2024-09-11T22:16:31.133953+0000","last_unstale":"2024-09-11T22:16:32.134451+0000","last_undegraded":"2024-09-11T22:16:32.134451+0000","last_fullsized":"2024-09-11T22:16:32.134451+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:41.306517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134528+0000","last_change":"2024-09-11T22:16:30.134672+0000","last_active":"2024-09-11T22:16:32.134528+0000","last_peered":"2024-09-11T22:16:32.134528+0000","last_clean":"2024-09-11T22:16:32.134528+0000","last_became_active":"2024-09-11T22:16:30.134397+0000","last_became_peered":"2024-09-11T22:16:30.134397+0000","last_unstale":"2024-09-11T22:16:32.134528+0000","last_undegraded":"2024-09-11T22:16:32.134528+0000","last_fullsized":"2024-09-11T22:16:32.134528+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:51.222786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.146201+0000","last_change":"2024-09-11T22:16:31.144771+0000","last_active":"2024-09-11T22:16:31.146201+0000","last_peered":"2024-09-11T22:16:31.146201+0000","last_clean":"2024-09-11T22:16:31.146201+0000","last_became_active":"2024-09-11T22:16:31.144465+0000","last_became_peered":"2024-09-11T22:16:31.144465+0000","last_unstale":"2024-09-11T22:16:31.146201+0000","last_undegraded":"2024-09-11T22:16:31.146201+0000","last_fullsized":"2024-09-11T22:16:31.146201+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:18.425428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"106'8","reported_seq":22,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856110+0000","last_change":"2024-09-11T22:16:30.140672+0000","last_active":"2024-09-11T22:16:32.856110+0000","last_peered":"2024-09-11T22:16:32.856110+0000","last_clean":"2024-09-11T22:16:32.856110+0000","last_became_active":"2024-09-11T22:16:30.140383+0000","last_became_peered":"2024-09-11T22:16:30.140383+0000","last_unstale":"2024-09-11T22:16:32.856110+0000","last_undegraded":"2024-09-11T22:16:32.856110+0000","last_fullsized":"2024-09-11T22:16:32.856110+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:20.643770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857564+0000","last_change":"2024-09-11T22:16:31.144063+0000","last_active":"2024-09-11T22:16:32.857564+0000","last_peered":"2024-09-11T22:16:32.857564+0000","last_clean":"2024-09-11T22:16:32.857564+0000","last_became_active":"2024-09-11T22:16:31.142859+0000","last_became_peered":"2024-09-11T22:16:31.142859+0000","last_unstale":"2024-09-11T22:16:32.857564+0000","last_undegraded":"2024-09-11T22:16:32.857564+0000","last_fullsized":"2024-09-11T22:16:32.857564+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:55.400432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.135237+0000","last_change":"2024-09-11T22:16:30.143254+0000","last_active":"2024-09-11T22:16:32.135237+0000","last_peered":"2024-09-11T22:16:32.135237+0000","last_clean":"2024-09-11T22:16:32.135237+0000","last_became_active":"2024-09-11T22:16:30.143054+0000","last_became_peered":"2024-09-11T22:16:30.143054+0000","last_unstale":"2024-09-11T22:16:32.135237+0000","last_undegraded":"2024-09-11T22:16:32.135237+0000","last_fullsized":"2024-09-11T22:16:32.135237+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:21.354892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134581+0000","last_change":"2024-09-11T22:16:31.136570+0000","last_active":"2024-09-11T22:16:32.134581+0000","last_peered":"2024-09-11T22:16:32.134581+0000","last_clean":"2024-09-11T22:16:32.134581+0000","last_became_active":"2024-09-11T22:16:31.136299+0000","last_became_peered":"2024-09-11T22:16:31.136299+0000","last_unstale":"2024-09-11T22:16:32.134581+0000","last_undegraded":"2024-09-11T22:16:32.134581+0000","last_fullsized":"2024-09-11T22:16:32.134581+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:55.541287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857398+0000","last_change":"2024-09-11T22:16:30.137242+0000","last_active":"2024-09-11T22:16:32.857398+0000","last_peered":"2024-09-11T22:16:32.857398+0000","last_clean":"2024-09-11T22:16:32.857398+0000","last_became_active":"2024-09-11T22:16:30.136986+0000","last_became_peered":"2024-09-11T22:16:30.136986+0000","last_unstale":"2024-09-11T22:16:32.857398+0000","last_undegraded":"2024-09-11T22:16:32.857398+0000","last_fullsized":"2024-09-11T22:16:32.857398+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:16.443823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.143155+0000","last_change":"2024-09-11T22:16:31.140281+0000","last_active":"2024-09-11T22:16:31.143155+0000","last_peered":"2024-09-11T22:16:31.143155+0000","last_clean":"2024-09-11T22:16:31.143155+0000","last_became_active":"2024-09-11T22:16:31.139962+0000","last_became_peered":"2024-09-11T22:16:31.139962+0000","last_unstale":"2024-09-11T22:16:31.143155+0000","last_undegraded":"2024-09-11T22:16:31.143155+0000","last_fullsized":"2024-09-11T22:16:31.143155+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:54.782458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133558+0000","last_change":"2024-09-11T22:16:30.138689+0000","last_active":"2024-09-11T22:16:32.133558+0000","last_peered":"2024-09-11T22:16:32.133558+0000","last_clean":"2024-09-11T22:16:32.133558+0000","last_became_active":"2024-09-11T22:16:30.138432+0000","last_became_peered":"2024-09-11T22:16:30.138432+0000","last_unstale":"2024-09-11T22:16:32.133558+0000","last_undegraded":"2024-09-11T22:16:32.133558+0000","last_fullsized":"2024-09-11T22:16:32.133558+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:52.695747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.149170+0000","last_change":"2024-09-11T22:16:31.148199+0000","last_active":"2024-09-11T22:16:31.149170+0000","last_peered":"2024-09-11T22:16:31.149170+0000","last_clean":"2024-09-11T22:16:31.149170+0000","last_became_active":"2024-09-11T22:16:31.147855+0000","last_became_peered":"2024-09-11T22:16:31.147855+0000","last_unstale":"2024-09-11T22:16:31.149170+0000","last_undegraded":"2024-09-11T22:16:31.149170+0000","last_fullsized":"2024-09-11T22:16:31.149170+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:55.514563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133933+0000","last_change":"2024-09-11T22:16:30.139771+0000","last_active":"2024-09-11T22:16:32.133933+0000","last_peered":"2024-09-11T22:16:32.133933+0000","last_clean":"2024-09-11T22:16:32.133933+0000","last_became_active":"2024-09-11T22:16:30.139512+0000","last_became_peered":"2024-09-11T22:16:30.139512+0000","last_unstale":"2024-09-11T22:16:32.133933+0000","last_undegraded":"2024-09-11T22:16:32.133933+0000","last_fullsized":"2024-09-11T22:16:32.133933+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:11.702907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.152225+0000","last_change":"2024-09-11T22:16:31.151401+0000","last_active":"2024-09-11T22:16:31.152225+0000","last_peered":"2024-09-11T22:16:31.152225+0000","last_clean":"2024-09-11T22:16:31.152225+0000","last_became_active":"2024-09-11T22:16:31.151128+0000","last_became_peered":"2024-09-11T22:16:31.151128+0000","last_unstale":"2024-09-11T22:16:31.152225+0000","last_undegraded":"2024-09-11T22:16:31.152225+0000","last_fullsized":"2024-09-11T22:16:31.152225+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:32.506418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134527+0000","last_change":"2024-09-11T22:16:30.134250+0000","last_active":"2024-09-11T22:16:32.134527+0000","last_peered":"2024-09-11T22:16:32.134527+0000","last_clean":"2024-09-11T22:16:32.134527+0000","last_became_active":"2024-09-11T22:16:30.133921+0000","last_became_peered":"2024-09-11T22:16:30.133921+0000","last_unstale":"2024-09-11T22:16:32.134527+0000","last_undegraded":"2024-09-11T22:16:32.134527+0000","last_fullsized":"2024-09-11T22:16:32.134527+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:31.653170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.149922+0000","last_change":"2024-09-11T22:16:31.148915+0000","last_active":"2024-09-11T22:16:31.149922+0000","last_peered":"2024-09-11T22:16:31.149922+0000","last_clean":"2024-09-11T22:16:31.149922+0000","last_became_active":"2024-09-11T22:16:31.148608+0000","last_became_peered":"2024-09-11T22:16:31.148608+0000","last_unstale":"2024-09-11T22:16:31.149922+0000","last_undegraded":"2024-09-11T22:16:31.149922+0000","last_fullsized":"2024-09-11T22:16:31.149922+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:08.215053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134172+0000","last_change":"2024-09-11T22:16:30.134676+0000","last_active":"2024-09-11T22:16:32.134172+0000","last_peered":"2024-09-11T22:16:32.134172+0000","last_clean":"2024-09-11T22:16:32.134172+0000","last_became_active":"2024-09-11T22:16:30.134403+0000","last_became_peered":"2024-09-11T22:16:30.134403+0000","last_unstale":"2024-09-11T22:16:32.134172+0000","last_undegraded":"2024-09-11T22:16:32.134172+0000","last_fullsized":"2024-09-11T22:16:32.134172+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:31.494808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857176+0000","last_change":"2024-09-11T22:16:31.140525+0000","last_active":"2024-09-11T22:16:32.857176+0000","last_peered":"2024-09-11T22:16:32.857176+0000","last_clean":"2024-09-11T22:16:32.857176+0000","last_became_active":"2024-09-11T22:16:31.140229+0000","last_became_peered":"2024-09-11T22:16:31.140229+0000","last_unstale":"2024-09-11T22:16:32.857176+0000","last_undegraded":"2024-09-11T22:16:32.857176+0000","last_fullsized":"2024-09-11T22:16:32.857176+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:06.548762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133202+0000","last_change":"2024-09-11T22:16:30.134260+0000","last_active":"2024-09-11T22:16:32.133202+0000","last_peered":"2024-09-11T22:16:32.133202+0000","last_clean":"2024-09-11T22:16:32.133202+0000","last_became_active":"2024-09-11T22:16:30.134009+0000","last_became_peered":"2024-09-11T22:16:30.134009+0000","last_unstale":"2024-09-11T22:16:32.133202+0000","last_undegraded":"2024-09-11T22:16:32.133202+0000","last_fullsized":"2024-09-11T22:16:32.133202+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:55.784057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133842+0000","last_change":"2024-09-11T22:16:31.131829+0000","last_active":"2024-09-11T22:16:32.133842+0000","last_peered":"2024-09-11T22:16:32.133842+0000","last_clean":"2024-09-11T22:16:32.133842+0000","last_became_active":"2024-09-11T22:16:31.131539+0000","last_became_peered":"2024-09-11T22:16:31.131539+0000","last_unstale":"2024-09-11T22:16:32.133842+0000","last_undegraded":"2024-09-11T22:16:32.133842+0000","last_fullsized":"2024-09-11T22:16:32.133842+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:50.333530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134970+0000","last_change":"2024-09-11T22:16:30.134903+0000","last_active":"2024-09-11T22:16:32.134970+0000","last_peered":"2024-09-11T22:16:32.134970+0000","last_clean":"2024-09-11T22:16:32.134970+0000","last_became_active":"2024-09-11T22:16:30.134584+0000","last_became_peered":"2024-09-11T22:16:30.134584+0000","last_unstale":"2024-09-11T22:16:32.134970+0000","last_undegraded":"2024-09-11T22:16:32.134970+0000","last_fullsized":"2024-09-11T22:16:32.134970+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:16.443823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856984+0000","last_change":"2024-09-11T22:16:31.146501+0000","last_active":"2024-09-11T22:16:32.856984+0000","last_peered":"2024-09-11T22:16:32.856984+0000","last_clean":"2024-09-11T22:16:32.856984+0000","last_became_active":"2024-09-11T22:16:31.146226+0000","last_became_peered":"2024-09-11T22:16:31.146226+0000","last_unstale":"2024-09-11T22:16:32.856984+0000","last_undegraded":"2024-09-11T22:16:32.856984+0000","last_fullsized":"2024-09-11T22:16:32.856984+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:32.658926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"107'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133818+0000","last_change":"2024-09-11T22:16:30.138814+0000","last_active":"2024-09-11T22:16:32.133818+0000","last_peered":"2024-09-11T22:16:32.133818+0000","last_clean":"2024-09-11T22:16:32.133818+0000","last_became_active":"2024-09-11T22:16:30.138533+0000","last_became_peered":"2024-09-11T22:16:30.138533+0000","last_unstale":"2024-09-11T22:16:32.133818+0000","last_undegraded":"2024-09-11T22:16:32.133818+0000","last_fullsized":"2024-09-11T22:16:32.133818+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:20.680189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856696+0000","last_change":"2024-09-11T22:16:31.141391+0000","last_active":"2024-09-11T22:16:32.856696+0000","last_peered":"2024-09-11T22:16:32.856696+0000","last_clean":"2024-09-11T22:16:32.856696+0000","last_became_active":"2024-09-11T22:16:31.140381+0000","last_became_peered":"2024-09-11T22:16:31.140381+0000","last_unstale":"2024-09-11T22:16:32.856696+0000","last_undegraded":"2024-09-11T22:16:32.856696+0000","last_fullsized":"2024-09-11T22:16:32.856696+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:19.894437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133623+0000","last_change":"2024-09-11T22:16:30.135578+0000","last_active":"2024-09-11T22:16:32.133623+0000","last_peered":"2024-09-11T22:16:32.133623+0000","last_clean":"2024-09-11T22:16:32.133623+0000","last_became_active":"2024-09-11T22:16:30.135281+0000","last_became_peered":"2024-09-11T22:16:30.135281+0000","last_unstale":"2024-09-11T22:16:32.133623+0000","last_undegraded":"2024-09-11T22:16:32.133623+0000","last_fullsized":"2024-09-11T22:16:32.133623+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:14.738238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857474+0000","last_change":"2024-09-11T22:16:31.144695+0000","last_active":"2024-09-11T22:16:32.857474+0000","last_peered":"2024-09-11T22:16:32.857474+0000","last_clean":"2024-09-11T22:16:32.857474+0000","last_became_active":"2024-09-11T22:16:31.144402+0000","last_became_peered":"2024-09-11T22:16:31.144402+0000","last_unstale":"2024-09-11T22:16:32.857474+0000","last_undegraded":"2024-09-11T22:16:32.857474+0000","last_fullsized":"2024-09-11T22:16:32.857474+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:25.930260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857696+0000","last_change":"2024-09-11T22:16:30.136438+0000","last_active":"2024-09-11T22:16:32.857696+0000","last_peered":"2024-09-11T22:16:32.857696+0000","last_clean":"2024-09-11T22:16:32.857696+0000","last_became_active":"2024-09-11T22:16:30.136142+0000","last_became_peered":"2024-09-11T22:16:30.136142+0000","last_unstale":"2024-09-11T22:16:32.857696+0000","last_undegraded":"2024-09-11T22:16:32.857696+0000","last_fullsized":"2024-09-11T22:16:32.857696+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:31.494808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.148062+0000","last_change":"2024-09-11T22:16:31.146357+0000","last_active":"2024-09-11T22:16:31.148062+0000","last_peered":"2024-09-11T22:16:31.148062+0000","last_clean":"2024-09-11T22:16:31.148062+0000","last_became_active":"2024-09-11T22:16:31.146047+0000","last_became_peered":"2024-09-11T22:16:31.146047+0000","last_unstale":"2024-09-11T22:16:31.148062+0000","last_undegraded":"2024-09-11T22:16:31.148062+0000","last_fullsized":"2024-09-11T22:16:31.148062+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:48.155167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134025+0000","last_change":"2024-09-11T22:16:30.131747+0000","last_active":"2024-09-11T22:16:32.134025+0000","last_peered":"2024-09-11T22:16:32.134025+0000","last_clean":"2024-09-11T22:16:32.134025+0000","last_became_active":"2024-09-11T22:16:30.131457+0000","last_became_peered":"2024-09-11T22:16:30.131457+0000","last_unstale":"2024-09-11T22:16:32.134025+0000","last_undegraded":"2024-09-11T22:16:32.134025+0000","last_fullsized":"2024-09-11T22:16:32.134025+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:06.464203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134952+0000","last_change":"2024-09-11T22:16:31.138620+0000","last_active":"2024-09-11T22:16:32.134952+0000","last_peered":"2024-09-11T22:16:32.134952+0000","last_clean":"2024-09-11T22:16:32.134952+0000","last_became_active":"2024-09-11T22:16:31.137910+0000","last_became_peered":"2024-09-11T22:16:31.137910+0000","last_unstale":"2024-09-11T22:16:32.134952+0000","last_undegraded":"2024-09-11T22:16:32.134952+0000","last_fullsized":"2024-09-11T22:16:32.134952+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:21.822644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857044+0000","last_change":"2024-09-11T22:16:30.138013+0000","last_active":"2024-09-11T22:16:32.857044+0000","last_peered":"2024-09-11T22:16:32.857044+0000","last_clean":"2024-09-11T22:16:32.857044+0000","last_became_active":"2024-09-11T22:16:30.137719+0000","last_became_peered":"2024-09-11T22:16:30.137719+0000","last_unstale":"2024-09-11T22:16:32.857044+0000","last_undegraded":"2024-09-11T22:16:32.857044+0000","last_fullsized":"2024-09-11T22:16:32.857044+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:18.888680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.146406+0000","last_change":"2024-09-11T22:16:31.145558+0000","last_active":"2024-09-11T22:16:31.146406+0000","last_peered":"2024-09-11T22:16:31.146406+0000","last_clean":"2024-09-11T22:16:31.146406+0000","last_became_active":"2024-09-11T22:16:31.145190+0000","last_became_peered":"2024-09-11T22:16:31.145190+0000","last_unstale":"2024-09-11T22:16:31.146406+0000","last_undegraded":"2024-09-11T22:16:31.146406+0000","last_fullsized":"2024-09-11T22:16:31.146406+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:18:10.428833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355363+0000","last_change":"2024-09-11T22:16:30.139028+0000","last_active":"2024-09-11T22:16:32.355363+0000","last_peered":"2024-09-11T22:16:32.355363+0000","last_clean":"2024-09-11T22:16:32.355363+0000","last_became_active":"2024-09-11T22:16:30.136861+0000","last_became_peered":"2024-09-11T22:16:30.136861+0000","last_unstale":"2024-09-11T22:16:32.355363+0000","last_undegraded":"2024-09-11T22:16:32.355363+0000","last_fullsized":"2024-09-11T22:16:32.355363+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:37.457616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857200+0000","last_change":"2024-09-11T22:16:31.133996+0000","last_active":"2024-09-11T22:16:32.857200+0000","last_peered":"2024-09-11T22:16:32.857200+0000","last_clean":"2024-09-11T22:16:32.857200+0000","last_became_active":"2024-09-11T22:16:31.133709+0000","last_became_peered":"2024-09-11T22:16:31.133709+0000","last_unstale":"2024-09-11T22:16:32.857200+0000","last_undegraded":"2024-09-11T22:16:32.857200+0000","last_fullsized":"2024-09-11T22:16:32.857200+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:21.685946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.132339+0000","last_change":"2024-09-11T22:16:30.134155+0000","last_active":"2024-09-11T22:16:31.132339+0000","last_peered":"2024-09-11T22:16:31.132339+0000","last_clean":"2024-09-11T22:16:31.132339+0000","last_became_active":"2024-09-11T22:16:30.133835+0000","last_became_peered":"2024-09-11T22:16:30.133835+0000","last_unstale":"2024-09-11T22:16:31.132339+0000","last_undegraded":"2024-09-11T22:16:31.132339+0000","last_fullsized":"2024-09-11T22:16:31.132339+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:58.593480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.151440+0000","last_change":"2024-09-11T22:16:31.149781+0000","last_active":"2024-09-11T22:16:31.151440+0000","last_peered":"2024-09-11T22:16:31.151440+0000","last_clean":"2024-09-11T22:16:31.151440+0000","last_became_active":"2024-09-11T22:16:31.149416+0000","last_became_peered":"2024-09-11T22:16:31.149416+0000","last_unstale":"2024-09-11T22:16:31.151440+0000","last_undegraded":"2024-09-11T22:16:31.151440+0000","last_fullsized":"2024-09-11T22:16:31.151440+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:46.290268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.144821+0000","last_change":"2024-09-11T22:16:30.140162+0000","last_active":"2024-09-11T22:16:31.144821+0000","last_peered":"2024-09-11T22:16:31.144821+0000","last_clean":"2024-09-11T22:16:31.144821+0000","last_became_active":"2024-09-11T22:16:30.139889+0000","last_became_peered":"2024-09-11T22:16:30.139889+0000","last_unstale":"2024-09-11T22:16:31.144821+0000","last_undegraded":"2024-09-11T22:16:31.144821+0000","last_fullsized":"2024-09-11T22:16:31.144821+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:07.047344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":325,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-11T22:16:31.127585+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:16:31.127585+0000","last_peered":"2024-09-11T22:16:31.127585+0000","last_clean":"2024-09-11T22:16:31.127585+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:16:31.127585+0000","last_undegraded":"2024-09-11T22:16:31.127585+0000","last_fullsized":"2024-09-11T22:16:31.127585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509511,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36644,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335196,"statfs":{"total":96636764160,"available":96599240704,"internally_reserved":0,"allocated":1323008,"data_stored":575006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36644,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335196,"statfs":{"total":96636764160,"available":96599240704,"internally_reserved":0,"allocated":1318912,"data_stored":574424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509510,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":1335296,"data_stored":576090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28328,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343512,"statfs":{"total":96636764160,"available":96607756288,"internally_reserved":0,"allocated":1331200,"data_stored":575988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509510,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1314816,"data_stored":574354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41376,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330464,"statfs":{"total":96636764160,"available":96594395136,"internally_reserved":0,"allocated":1912832,"data_stored":1165304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41376,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330464,"statfs":{"total":96636764160,"available":96594395136,"internally_reserved":0,"allocated":1904640,"data_stored":1158534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1290240,"data_stored":561279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:16:36.407 INFO:tasks.ceph.mds.c.smithi050.stderr:2024-09-11T22:16:36.406+0000 7f456e4fd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:16:38.536 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:16:38.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.649+0000 7f7ecacac640 1 Processor -- start 2024-09-11T22:16:38.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.649+0000 7f7ecacac640 1 -- start start 2024-09-11T22:16:38.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.650+0000 7f7ecacac640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ec406d780 0x7f7ec4072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:38.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.650+0000 7f7ecacac640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7ec415bb00 0x7f7ec40b3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:38.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.650+0000 7f7ecacac640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec40b5020 con 0x7f7ec415aad0 2024-09-11T22:16:38.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.650+0000 7f7ecacac640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7ec415aeb0 con 0x7f7ec415bb00 2024-09-11T22:16:38.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.650+0000 7f7ecacac640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec40714d0 con 0x7f7ec406d780 2024-09-11T22:16:38.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.650+0000 7f7ec9249640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7ec415bb00 0x7f7ec40b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:38.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.650+0000 7f7ec3fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ec406d780 0x7f7ec4072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:38.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.650+0000 7f7ec8a48640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7ec415aad0 0x7f7ec406d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:52600/0 (socket says 172.21.15.50:52600) 2024-09-11T22:16:38.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.650+0000 7f7ec3fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ec406d780 0x7f7ec4072cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:49542/0 (socket says 172.21.15.50:49542) 2024-09-11T22:16:38.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.650+0000 7f7ec8a48640 1 -- 172.21.15.50:0/3858315515 learned_addr learned my addr 172.21.15.50:0/3858315515 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:38.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.650+0000 7f7ec9249640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7ec415bb00 0x7f7ec40b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54328/0 (socket says 172.21.15.50:54328) 2024-09-11T22:16:38.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.651+0000 7f7ec3fff640 1 -- 172.21.15.50:0/3858315515 >> v2:172.21.15.77:3300/0 conn(0x7f7ec415bb00 msgr2=0x7f7ec40b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:38.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.651+0000 7f7ec3fff640 1 --2- 172.21.15.50:0/3858315515 >> v2:172.21.15.77:3300/0 conn(0x7f7ec415bb00 0x7f7ec40b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:38.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.651+0000 7f7ec3fff640 1 -- 172.21.15.50:0/3858315515 >> v1:172.21.15.77:6789/0 conn(0x7f7ec415aad0 legacy=0x7f7ec406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:38.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.651+0000 7f7ec3fff640 1 -- 172.21.15.50:0/3858315515 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec40717b0 con 0x7f7ec406d780 2024-09-11T22:16:38.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.651+0000 7f7ec9249640 1 --2- 172.21.15.50:0/3858315515 >> v2:172.21.15.77:3300/0 conn(0x7f7ec415bb00 0x7f7ec40b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:16:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.652+0000 7f7ec3fff640 1 --2- 172.21.15.50:0/3858315515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ec406d780 0x7f7ec4072cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00097a0 tx=0x7f7eb002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3accefc1ddee53b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.652+0000 7f7ec37fe640 1 -- 172.21.15.50:0/3858315515 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0037070 con 0x7f7ec406d780 2024-09-11T22:16:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.652+0000 7f7ec37fe640 1 -- 172.21.15.50:0/3858315515 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb0032440 con 0x7f7ec406d780 2024-09-11T22:16:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.652+0000 7f7ec37fe640 1 -- 172.21.15.50:0/3858315515 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0032810 con 0x7f7ec406d780 2024-09-11T22:16:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.652+0000 7f7ecacac640 1 -- 172.21.15.50:0/3858315515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ec406d780 msgr2=0x7f7ec4072cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.652+0000 7f7ecacac640 1 --2- 172.21.15.50:0/3858315515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ec406d780 0x7f7ec4072cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00097a0 tx=0x7f7eb002a180 comp rx=0 tx=0).stop 2024-09-11T22:16:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.652+0000 7f7ecacac640 1 -- 172.21.15.50:0/3858315515 shutdown_connections 2024-09-11T22:16:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.652+0000 7f7ecacac640 1 --2- 172.21.15.50:0/3858315515 >> v2:172.21.15.77:3300/0 conn(0x7f7ec415bb00 0x7f7ec40b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.652+0000 7f7ecacac640 1 --2- 172.21.15.50:0/3858315515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ec406d780 0x7f7ec4072cb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.652+0000 7f7ecacac640 1 -- 172.21.15.50:0/3858315515 >> 172.21.15.50:0/3858315515 conn(0x7f7ec40679c0 msgr2=0x7f7ec4067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.652+0000 7f7ecacac640 1 -- 172.21.15.50:0/3858315515 shutdown_connections 2024-09-11T22:16:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.652+0000 7f7ecacac640 1 -- 172.21.15.50:0/3858315515 wait complete. 2024-09-11T22:16:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.654+0000 7f7ecacac640 1 Processor -- start 2024-09-11T22:16:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.654+0000 7f7ecacac640 1 -- start start 2024-09-11T22:16:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ecacac640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ec406d780 0x7f7ec414c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ecacac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec415aad0 0x7f7ec40c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ecacac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec415bb00 0x7f7ec40ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ecacac640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec4072290 con 0x7f7ec415bb00 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ecacac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec4071d70 con 0x7f7ec415aad0 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ecacac640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec415bf40 con 0x7f7ec406d780 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ec9249640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec415bb00 0x7f7ec40ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ec9249640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec415bb00 0x7f7ec40ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35058/0 (socket says 172.21.15.50:35058) 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ec9249640 1 -- 172.21.15.50:0/3762360001 learned_addr learned my addr 172.21.15.50:0/3762360001 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ec3fff640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec415aad0 0x7f7ec40c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ec8a48640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ec406d780 0x7f7ec414c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ec9249640 1 -- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ec406d780 msgr2=0x7f7ec414c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ec9249640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ec406d780 0x7f7ec414c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ec9249640 1 -- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec415aad0 msgr2=0x7f7ec40c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ec9249640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec415aad0 0x7f7ec40c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:38.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ec9249640 1 -- 172.21.15.50:0/3762360001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec40ab6a0 con 0x7f7ec415bb00 2024-09-11T22:16:38.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ec9249640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec415bb00 0x7f7ec40ac740 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00e0c0 tx=0x7f7ebc00e580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:38.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.655+0000 7f7ec17fa640 1 -- 172.21.15.50:0/3762360001 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc00b0d0 con 0x7f7ec415bb00 2024-09-11T22:16:38.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.656+0000 7f7ecacac640 1 -- 172.21.15.50:0/3762360001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec40ab980 con 0x7f7ec415bb00 2024-09-11T22:16:38.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.656+0000 7f7ecacac640 1 -- 172.21.15.50:0/3762360001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec40abf40 con 0x7f7ec415bb00 2024-09-11T22:16:38.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.656+0000 7f7ec17fa640 1 -- 172.21.15.50:0/3762360001 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ebc00b270 con 0x7f7ec415bb00 2024-09-11T22:16:38.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.656+0000 7f7ec17fa640 1 -- 172.21.15.50:0/3762360001 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc003b90 con 0x7f7ec415bb00 2024-09-11T22:16:38.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.656+0000 7f7ecacac640 1 -- 172.21.15.50:0/3762360001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ec4072cb0 con 0x7f7ec415bb00 2024-09-11T22:16:38.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.657+0000 7f7ec17fa640 1 -- 172.21.15.50:0/3762360001 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ebc01d030 con 0x7f7ec415bb00 2024-09-11T22:16:38.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.657+0000 7f7ec17fa640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7ea806be30 0x7f7ea806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:38.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.658+0000 7f7ec17fa640 1 -- 172.21.15.50:0/3762360001 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f7ebc08d160 con 0x7f7ec415bb00 2024-09-11T22:16:38.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.658+0000 7f7ec8a48640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7ea806be30 0x7f7ea806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:38.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.658+0000 7f7ec8a48640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7ea806be30 0x7f7ea806e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8007fd0 tx=0x7f7eb8007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.662+0000 7f7ec17fa640 1 -- 172.21.15.50:0/3762360001 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ebc024020 con 0x7f7ec415bb00 2024-09-11T22:16:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.836+0000 7f7ecacac640 1 -- 172.21.15.50:0/3762360001 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7ec40c5a40 con 0x7f7ea806be30 2024-09-11T22:16:38.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.842+0000 7f7ec17fa640 1 -- 172.21.15.50:0/3762360001 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252475 (secure 0 0 0) 0x7f7ec40c5a40 con 0x7f7ea806be30 2024-09-11T22:16:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:38.847 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:16:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.845+0000 7f7ecacac640 1 -- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7ea806be30 msgr2=0x7f7ea806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.845+0000 7f7ecacac640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7ea806be30 0x7f7ea806e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8007fd0 tx=0x7f7eb8007e80 comp rx=0 tx=0).stop 2024-09-11T22:16:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.845+0000 7f7ecacac640 1 -- 172.21.15.50:0/3762360001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec415bb00 msgr2=0x7f7ec40ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.845+0000 7f7ecacac640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec415bb00 0x7f7ec40ac740 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00e0c0 tx=0x7f7ebc00e580 comp rx=0 tx=0).stop 2024-09-11T22:16:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.845+0000 7f7ecacac640 1 -- 172.21.15.50:0/3762360001 shutdown_connections 2024-09-11T22:16:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.845+0000 7f7ecacac640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7ea806be30 0x7f7ea806e2f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.845+0000 7f7ecacac640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec415bb00 0x7f7ec40ac740 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.845+0000 7f7ecacac640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec415aad0 0x7f7ec40c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.845+0000 7f7ecacac640 1 --2- 172.21.15.50:0/3762360001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ec406d780 0x7f7ec414c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.845+0000 7f7ecacac640 1 -- 172.21.15.50:0/3762360001 >> 172.21.15.50:0/3762360001 conn(0x7f7ec40679c0 msgr2=0x7f7ec40cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.845+0000 7f7ecacac640 1 -- 172.21.15.50:0/3762360001 shutdown_connections 2024-09-11T22:16:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:38.845+0000 7f7ecacac640 1 -- 172.21.15.50:0/3762360001 wait complete. 2024-09-11T22:16:38.856 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2024-09-11T22:16:37.442457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":281820,"kb_used_data":11496,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754692900,"statfs":{"total":773094113280,"available":772805529600,"internally_reserved":0,"allocated":11771904,"data_stored":5780388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.318285"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856934+0000","last_change":"2024-09-11T22:16:31.142231+0000","last_active":"2024-09-11T22:16:32.856934+0000","last_peered":"2024-09-11T22:16:32.856934+0000","last_clean":"2024-09-11T22:16:32.856934+0000","last_became_active":"2024-09-11T22:16:31.141942+0000","last_became_peered":"2024-09-11T22:16:31.141942+0000","last_unstale":"2024-09-11T22:16:32.856934+0000","last_undegraded":"2024-09-11T22:16:32.856934+0000","last_fullsized":"2024-09-11T22:16:32.856934+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.449580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133551+0000","last_change":"2024-09-11T22:16:31.143843+0000","last_active":"2024-09-11T22:16:32.133551+0000","last_peered":"2024-09-11T22:16:32.133551+0000","last_clean":"2024-09-11T22:16:32.133551+0000","last_became_active":"2024-09-11T22:16:31.143579+0000","last_became_peered":"2024-09-11T22:16:31.143579+0000","last_unstale":"2024-09-11T22:16:32.133551+0000","last_undegraded":"2024-09-11T22:16:32.133551+0000","last_fullsized":"2024-09-11T22:16:32.133551+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:34:33.959757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856326+0000","last_change":"2024-09-11T22:16:31.148309+0000","last_active":"2024-09-11T22:16:32.856326+0000","last_peered":"2024-09-11T22:16:32.856326+0000","last_clean":"2024-09-11T22:16:32.856326+0000","last_became_active":"2024-09-11T22:16:31.148024+0000","last_became_peered":"2024-09-11T22:16:31.148024+0000","last_unstale":"2024-09-11T22:16:32.856326+0000","last_undegraded":"2024-09-11T22:16:32.856326+0000","last_fullsized":"2024-09-11T22:16:32.856326+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:08.680694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355813+0000","last_change":"2024-09-11T22:16:31.141908+0000","last_active":"2024-09-11T22:16:32.355813+0000","last_peered":"2024-09-11T22:16:32.355813+0000","last_clean":"2024-09-11T22:16:32.355813+0000","last_became_active":"2024-09-11T22:16:31.141591+0000","last_became_peered":"2024-09-11T22:16:31.141591+0000","last_unstale":"2024-09-11T22:16:32.355813+0000","last_undegraded":"2024-09-11T22:16:32.355813+0000","last_fullsized":"2024-09-11T22:16:32.355813+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:55.433938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857400+0000","last_change":"2024-09-11T22:16:31.133523+0000","last_active":"2024-09-11T22:16:32.857400+0000","last_peered":"2024-09-11T22:16:32.857400+0000","last_clean":"2024-09-11T22:16:32.857400+0000","last_became_active":"2024-09-11T22:16:31.133257+0000","last_became_peered":"2024-09-11T22:16:31.133257+0000","last_unstale":"2024-09-11T22:16:32.857400+0000","last_undegraded":"2024-09-11T22:16:32.857400+0000","last_fullsized":"2024-09-11T22:16:32.857400+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:41.306517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856734+0000","last_change":"2024-09-11T22:16:31.132072+0000","last_active":"2024-09-11T22:16:32.856734+0000","last_peered":"2024-09-11T22:16:32.856734+0000","last_clean":"2024-09-11T22:16:32.856734+0000","last_became_active":"2024-09-11T22:16:31.131809+0000","last_became_peered":"2024-09-11T22:16:31.131809+0000","last_unstale":"2024-09-11T22:16:32.856734+0000","last_undegraded":"2024-09-11T22:16:32.856734+0000","last_fullsized":"2024-09-11T22:16:32.856734+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:19.348926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856679+0000","last_change":"2024-09-11T22:16:31.140404+0000","last_active":"2024-09-11T22:16:32.856679+0000","last_peered":"2024-09-11T22:16:32.856679+0000","last_clean":"2024-09-11T22:16:32.856679+0000","last_became_active":"2024-09-11T22:16:31.140115+0000","last_became_peered":"2024-09-11T22:16:31.140115+0000","last_unstale":"2024-09-11T22:16:32.856679+0000","last_undegraded":"2024-09-11T22:16:32.856679+0000","last_fullsized":"2024-09-11T22:16:32.856679+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:18.146893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133310+0000","last_change":"2024-09-11T22:16:31.135807+0000","last_active":"2024-09-11T22:16:32.133310+0000","last_peered":"2024-09-11T22:16:32.133310+0000","last_clean":"2024-09-11T22:16:32.133310+0000","last_became_active":"2024-09-11T22:16:31.135532+0000","last_became_peered":"2024-09-11T22:16:31.135532+0000","last_unstale":"2024-09-11T22:16:32.133310+0000","last_undegraded":"2024-09-11T22:16:32.133310+0000","last_fullsized":"2024-09-11T22:16:32.133310+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:24.431553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.135406+0000","last_change":"2024-09-11T22:16:31.131851+0000","last_active":"2024-09-11T22:16:32.135406+0000","last_peered":"2024-09-11T22:16:32.135406+0000","last_clean":"2024-09-11T22:16:32.135406+0000","last_became_active":"2024-09-11T22:16:31.131590+0000","last_became_peered":"2024-09-11T22:16:31.131590+0000","last_unstale":"2024-09-11T22:16:32.135406+0000","last_undegraded":"2024-09-11T22:16:32.135406+0000","last_fullsized":"2024-09-11T22:16:32.135406+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:38.463373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857549+0000","last_change":"2024-09-11T22:16:31.140455+0000","last_active":"2024-09-11T22:16:32.857549+0000","last_peered":"2024-09-11T22:16:32.857549+0000","last_clean":"2024-09-11T22:16:32.857549+0000","last_became_active":"2024-09-11T22:16:31.140201+0000","last_became_peered":"2024-09-11T22:16:31.140201+0000","last_unstale":"2024-09-11T22:16:32.857549+0000","last_undegraded":"2024-09-11T22:16:32.857549+0000","last_fullsized":"2024-09-11T22:16:32.857549+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:13.221303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856772+0000","last_change":"2024-09-11T22:16:31.137742+0000","last_active":"2024-09-11T22:16:32.856772+0000","last_peered":"2024-09-11T22:16:32.856772+0000","last_clean":"2024-09-11T22:16:32.856772+0000","last_became_active":"2024-09-11T22:16:31.137465+0000","last_became_peered":"2024-09-11T22:16:31.137465+0000","last_unstale":"2024-09-11T22:16:32.856772+0000","last_undegraded":"2024-09-11T22:16:32.856772+0000","last_fullsized":"2024-09-11T22:16:32.856772+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:55.732493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134450+0000","last_change":"2024-09-11T22:16:31.147731+0000","last_active":"2024-09-11T22:16:32.134450+0000","last_peered":"2024-09-11T22:16:32.134450+0000","last_clean":"2024-09-11T22:16:32.134450+0000","last_became_active":"2024-09-11T22:16:31.146850+0000","last_became_peered":"2024-09-11T22:16:31.146850+0000","last_unstale":"2024-09-11T22:16:32.134450+0000","last_undegraded":"2024-09-11T22:16:32.134450+0000","last_fullsized":"2024-09-11T22:16:32.134450+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:25.930260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355549+0000","last_change":"2024-09-11T22:16:31.141006+0000","last_active":"2024-09-11T22:16:32.355549+0000","last_peered":"2024-09-11T22:16:32.355549+0000","last_clean":"2024-09-11T22:16:32.355549+0000","last_became_active":"2024-09-11T22:16:31.140442+0000","last_became_peered":"2024-09-11T22:16:31.140442+0000","last_unstale":"2024-09-11T22:16:32.355549+0000","last_undegraded":"2024-09-11T22:16:32.355549+0000","last_fullsized":"2024-09-11T22:16:32.355549+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:28.758274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.855928+0000","last_change":"2024-09-11T22:16:31.139945+0000","last_active":"2024-09-11T22:16:32.855928+0000","last_peered":"2024-09-11T22:16:32.855928+0000","last_clean":"2024-09-11T22:16:32.855928+0000","last_became_active":"2024-09-11T22:16:31.139641+0000","last_became_peered":"2024-09-11T22:16:31.139641+0000","last_unstale":"2024-09-11T22:16:32.855928+0000","last_undegraded":"2024-09-11T22:16:32.855928+0000","last_fullsized":"2024-09-11T22:16:32.855928+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:45.461400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355418+0000","last_change":"2024-09-11T22:16:31.150745+0000","last_active":"2024-09-11T22:16:32.355418+0000","last_peered":"2024-09-11T22:16:32.355418+0000","last_clean":"2024-09-11T22:16:32.355418+0000","last_became_active":"2024-09-11T22:16:31.150471+0000","last_became_peered":"2024-09-11T22:16:31.150471+0000","last_unstale":"2024-09-11T22:16:32.355418+0000","last_undegraded":"2024-09-11T22:16:32.355418+0000","last_fullsized":"2024-09-11T22:16:32.355418+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:36.511773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856828+0000","last_change":"2024-09-11T22:16:31.137051+0000","last_active":"2024-09-11T22:16:32.856828+0000","last_peered":"2024-09-11T22:16:32.856828+0000","last_clean":"2024-09-11T22:16:32.856828+0000","last_became_active":"2024-09-11T22:16:31.136536+0000","last_became_peered":"2024-09-11T22:16:31.136536+0000","last_unstale":"2024-09-11T22:16:32.856828+0000","last_undegraded":"2024-09-11T22:16:32.856828+0000","last_fullsized":"2024-09-11T22:16:32.856828+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:06.917614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133553+0000","last_change":"2024-09-11T22:16:31.143912+0000","last_active":"2024-09-11T22:16:32.133553+0000","last_peered":"2024-09-11T22:16:32.133553+0000","last_clean":"2024-09-11T22:16:32.133553+0000","last_became_active":"2024-09-11T22:16:31.143630+0000","last_became_peered":"2024-09-11T22:16:31.143630+0000","last_unstale":"2024-09-11T22:16:32.133553+0000","last_undegraded":"2024-09-11T22:16:32.133553+0000","last_fullsized":"2024-09-11T22:16:32.133553+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:02.998119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355655+0000","last_change":"2024-09-11T22:16:31.147613+0000","last_active":"2024-09-11T22:16:32.355655+0000","last_peered":"2024-09-11T22:16:32.355655+0000","last_clean":"2024-09-11T22:16:32.355655+0000","last_became_active":"2024-09-11T22:16:31.146299+0000","last_became_peered":"2024-09-11T22:16:31.146299+0000","last_unstale":"2024-09-11T22:16:32.355655+0000","last_undegraded":"2024-09-11T22:16:32.355655+0000","last_fullsized":"2024-09-11T22:16:32.355655+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:55.042439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856456+0000","last_change":"2024-09-11T22:16:31.152030+0000","last_active":"2024-09-11T22:16:32.856456+0000","last_peered":"2024-09-11T22:16:32.856456+0000","last_clean":"2024-09-11T22:16:32.856456+0000","last_became_active":"2024-09-11T22:16:31.151734+0000","last_became_peered":"2024-09-11T22:16:31.151734+0000","last_unstale":"2024-09-11T22:16:32.856456+0000","last_undegraded":"2024-09-11T22:16:32.856456+0000","last_fullsized":"2024-09-11T22:16:32.856456+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:02.318297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134595+0000","last_change":"2024-09-11T22:16:31.131822+0000","last_active":"2024-09-11T22:16:32.134595+0000","last_peered":"2024-09-11T22:16:32.134595+0000","last_clean":"2024-09-11T22:16:32.134595+0000","last_became_active":"2024-09-11T22:16:31.131554+0000","last_became_peered":"2024-09-11T22:16:31.131554+0000","last_unstale":"2024-09-11T22:16:32.134595+0000","last_undegraded":"2024-09-11T22:16:32.134595+0000","last_fullsized":"2024-09-11T22:16:32.134595+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:55.400432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856536+0000","last_change":"2024-09-11T22:16:31.146858+0000","last_active":"2024-09-11T22:16:32.856536+0000","last_peered":"2024-09-11T22:16:32.856536+0000","last_clean":"2024-09-11T22:16:32.856536+0000","last_became_active":"2024-09-11T22:16:31.146546+0000","last_became_peered":"2024-09-11T22:16:31.146546+0000","last_unstale":"2024-09-11T22:16:32.856536+0000","last_undegraded":"2024-09-11T22:16:32.856536+0000","last_fullsized":"2024-09-11T22:16:32.856536+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.844211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133290+0000","last_change":"2024-09-11T22:16:31.136301+0000","last_active":"2024-09-11T22:16:32.133290+0000","last_peered":"2024-09-11T22:16:32.133290+0000","last_clean":"2024-09-11T22:16:32.133290+0000","last_became_active":"2024-09-11T22:16:31.136010+0000","last_became_peered":"2024-09-11T22:16:31.136010+0000","last_unstale":"2024-09-11T22:16:32.133290+0000","last_undegraded":"2024-09-11T22:16:32.133290+0000","last_fullsized":"2024-09-11T22:16:32.133290+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:38.328801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133428+0000","last_change":"2024-09-11T22:16:31.143207+0000","last_active":"2024-09-11T22:16:32.133428+0000","last_peered":"2024-09-11T22:16:32.133428+0000","last_clean":"2024-09-11T22:16:32.133428+0000","last_became_active":"2024-09-11T22:16:31.142899+0000","last_became_peered":"2024-09-11T22:16:31.142899+0000","last_unstale":"2024-09-11T22:16:32.133428+0000","last_undegraded":"2024-09-11T22:16:32.133428+0000","last_fullsized":"2024-09-11T22:16:32.133428+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:43:39.724039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856745+0000","last_change":"2024-09-11T22:16:31.147334+0000","last_active":"2024-09-11T22:16:32.856745+0000","last_peered":"2024-09-11T22:16:32.856745+0000","last_clean":"2024-09-11T22:16:32.856745+0000","last_became_active":"2024-09-11T22:16:31.147006+0000","last_became_peered":"2024-09-11T22:16:31.147006+0000","last_unstale":"2024-09-11T22:16:32.856745+0000","last_undegraded":"2024-09-11T22:16:32.856745+0000","last_fullsized":"2024-09-11T22:16:32.856745+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:53:40.162352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857581+0000","last_change":"2024-09-11T22:16:31.139794+0000","last_active":"2024-09-11T22:16:32.857581+0000","last_peered":"2024-09-11T22:16:32.857581+0000","last_clean":"2024-09-11T22:16:32.857581+0000","last_became_active":"2024-09-11T22:16:31.138697+0000","last_became_peered":"2024-09-11T22:16:31.138697+0000","last_unstale":"2024-09-11T22:16:32.857581+0000","last_undegraded":"2024-09-11T22:16:32.857581+0000","last_fullsized":"2024-09-11T22:16:32.857581+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:21.822644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133760+0000","last_change":"2024-09-11T22:16:31.138060+0000","last_active":"2024-09-11T22:16:32.133760+0000","last_peered":"2024-09-11T22:16:32.133760+0000","last_clean":"2024-09-11T22:16:32.133760+0000","last_became_active":"2024-09-11T22:16:31.137769+0000","last_became_peered":"2024-09-11T22:16:31.137769+0000","last_unstale":"2024-09-11T22:16:32.133760+0000","last_undegraded":"2024-09-11T22:16:32.133760+0000","last_fullsized":"2024-09-11T22:16:32.133760+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:23.740045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857309+0000","last_change":"2024-09-11T22:16:31.142015+0000","last_active":"2024-09-11T22:16:32.857309+0000","last_peered":"2024-09-11T22:16:32.857309+0000","last_clean":"2024-09-11T22:16:32.857309+0000","last_became_active":"2024-09-11T22:16:31.141425+0000","last_became_peered":"2024-09-11T22:16:31.141425+0000","last_unstale":"2024-09-11T22:16:32.857309+0000","last_undegraded":"2024-09-11T22:16:32.857309+0000","last_fullsized":"2024-09-11T22:16:32.857309+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:52.762197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857673+0000","last_change":"2024-09-11T22:16:31.144606+0000","last_active":"2024-09-11T22:16:32.857673+0000","last_peered":"2024-09-11T22:16:32.857673+0000","last_clean":"2024-09-11T22:16:32.857673+0000","last_became_active":"2024-09-11T22:16:31.144334+0000","last_became_peered":"2024-09-11T22:16:31.144334+0000","last_unstale":"2024-09-11T22:16:32.857673+0000","last_undegraded":"2024-09-11T22:16:32.857673+0000","last_fullsized":"2024-09-11T22:16:32.857673+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:38.463373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133874+0000","last_change":"2024-09-11T22:16:31.138549+0000","last_active":"2024-09-11T22:16:32.133874+0000","last_peered":"2024-09-11T22:16:32.133874+0000","last_clean":"2024-09-11T22:16:32.133874+0000","last_became_active":"2024-09-11T22:16:31.138277+0000","last_became_peered":"2024-09-11T22:16:31.138277+0000","last_unstale":"2024-09-11T22:16:32.133874+0000","last_undegraded":"2024-09-11T22:16:32.133874+0000","last_fullsized":"2024-09-11T22:16:32.133874+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:36.511773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856340+0000","last_change":"2024-09-11T22:16:31.149706+0000","last_active":"2024-09-11T22:16:32.856340+0000","last_peered":"2024-09-11T22:16:32.856340+0000","last_clean":"2024-09-11T22:16:32.856340+0000","last_became_active":"2024-09-11T22:16:31.149426+0000","last_became_peered":"2024-09-11T22:16:31.149426+0000","last_unstale":"2024-09-11T22:16:32.856340+0000","last_undegraded":"2024-09-11T22:16:32.856340+0000","last_fullsized":"2024-09-11T22:16:32.856340+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:56.873108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355646+0000","last_change":"2024-09-11T22:16:31.135076+0000","last_active":"2024-09-11T22:16:32.355646+0000","last_peered":"2024-09-11T22:16:32.355646+0000","last_clean":"2024-09-11T22:16:32.355646+0000","last_became_active":"2024-09-11T22:16:31.134764+0000","last_became_peered":"2024-09-11T22:16:31.134764+0000","last_unstale":"2024-09-11T22:16:32.355646+0000","last_undegraded":"2024-09-11T22:16:32.355646+0000","last_fullsized":"2024-09-11T22:16:32.355646+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:36:51.553600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856049+0000","last_change":"2024-09-11T22:16:31.152274+0000","last_active":"2024-09-11T22:16:32.856049+0000","last_peered":"2024-09-11T22:16:32.856049+0000","last_clean":"2024-09-11T22:16:32.856049+0000","last_became_active":"2024-09-11T22:16:31.152004+0000","last_became_peered":"2024-09-11T22:16:31.152004+0000","last_unstale":"2024-09-11T22:16:32.856049+0000","last_undegraded":"2024-09-11T22:16:32.856049+0000","last_fullsized":"2024-09-11T22:16:32.856049+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:13.893093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856722+0000","last_change":"2024-09-11T22:16:31.144398+0000","last_active":"2024-09-11T22:16:32.856722+0000","last_peered":"2024-09-11T22:16:32.856722+0000","last_clean":"2024-09-11T22:16:32.856722+0000","last_became_active":"2024-09-11T22:16:31.144121+0000","last_became_peered":"2024-09-11T22:16:31.144121+0000","last_unstale":"2024-09-11T22:16:32.856722+0000","last_undegraded":"2024-09-11T22:16:32.856722+0000","last_fullsized":"2024-09-11T22:16:32.856722+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:07:36.878968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"106'4","reported_seq":18,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133560+0000","last_change":"2024-09-11T22:16:30.136446+0000","last_active":"2024-09-11T22:16:32.133560+0000","last_peered":"2024-09-11T22:16:32.133560+0000","last_clean":"2024-09-11T22:16:32.133560+0000","last_became_active":"2024-09-11T22:16:30.136127+0000","last_became_peered":"2024-09-11T22:16:30.136127+0000","last_unstale":"2024-09-11T22:16:32.133560+0000","last_undegraded":"2024-09-11T22:16:32.133560+0000","last_fullsized":"2024-09-11T22:16:32.133560+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:05.543005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355882+0000","last_change":"2024-09-11T22:16:31.135178+0000","last_active":"2024-09-11T22:16:32.355882+0000","last_peered":"2024-09-11T22:16:32.355882+0000","last_clean":"2024-09-11T22:16:32.355882+0000","last_became_active":"2024-09-11T22:16:31.134873+0000","last_became_peered":"2024-09-11T22:16:31.134873+0000","last_unstale":"2024-09-11T22:16:32.355882+0000","last_undegraded":"2024-09-11T22:16:32.355882+0000","last_fullsized":"2024-09-11T22:16:32.355882+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:41.065428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857070+0000","last_change":"2024-09-11T22:16:30.144070+0000","last_active":"2024-09-11T22:16:32.857070+0000","last_peered":"2024-09-11T22:16:32.857070+0000","last_clean":"2024-09-11T22:16:32.857070+0000","last_became_active":"2024-09-11T22:16:30.143809+0000","last_became_peered":"2024-09-11T22:16:30.143809+0000","last_unstale":"2024-09-11T22:16:32.857070+0000","last_undegraded":"2024-09-11T22:16:32.857070+0000","last_fullsized":"2024-09-11T22:16:32.857070+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:26.892307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856568+0000","last_change":"2024-09-11T22:16:31.147074+0000","last_active":"2024-09-11T22:16:32.856568+0000","last_peered":"2024-09-11T22:16:32.856568+0000","last_clean":"2024-09-11T22:16:32.856568+0000","last_became_active":"2024-09-11T22:16:31.146785+0000","last_became_peered":"2024-09-11T22:16:31.146785+0000","last_unstale":"2024-09-11T22:16:32.856568+0000","last_undegraded":"2024-09-11T22:16:32.856568+0000","last_fullsized":"2024-09-11T22:16:32.856568+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:24.357126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133620+0000","last_change":"2024-09-11T22:16:30.138148+0000","last_active":"2024-09-11T22:16:32.133620+0000","last_peered":"2024-09-11T22:16:32.133620+0000","last_clean":"2024-09-11T22:16:32.133620+0000","last_became_active":"2024-09-11T22:16:30.137865+0000","last_became_peered":"2024-09-11T22:16:30.137865+0000","last_unstale":"2024-09-11T22:16:32.133620+0000","last_undegraded":"2024-09-11T22:16:32.133620+0000","last_fullsized":"2024-09-11T22:16:32.133620+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:18.620220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.135152+0000","last_change":"2024-09-11T22:16:31.134973+0000","last_active":"2024-09-11T22:16:32.135152+0000","last_peered":"2024-09-11T22:16:32.135152+0000","last_clean":"2024-09-11T22:16:32.135152+0000","last_became_active":"2024-09-11T22:16:31.134644+0000","last_became_peered":"2024-09-11T22:16:31.134644+0000","last_unstale":"2024-09-11T22:16:32.135152+0000","last_undegraded":"2024-09-11T22:16:32.135152+0000","last_fullsized":"2024-09-11T22:16:32.135152+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:53.744214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133458+0000","last_change":"2024-09-11T22:16:30.139398+0000","last_active":"2024-09-11T22:16:32.133458+0000","last_peered":"2024-09-11T22:16:32.133458+0000","last_clean":"2024-09-11T22:16:32.133458+0000","last_became_active":"2024-09-11T22:16:30.139127+0000","last_became_peered":"2024-09-11T22:16:30.139127+0000","last_unstale":"2024-09-11T22:16:32.133458+0000","last_undegraded":"2024-09-11T22:16:32.133458+0000","last_fullsized":"2024-09-11T22:16:32.133458+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:59.746406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134646+0000","last_change":"2024-09-11T22:16:31.133977+0000","last_active":"2024-09-11T22:16:32.134646+0000","last_peered":"2024-09-11T22:16:32.134646+0000","last_clean":"2024-09-11T22:16:32.134646+0000","last_became_active":"2024-09-11T22:16:31.133696+0000","last_became_peered":"2024-09-11T22:16:31.133696+0000","last_unstale":"2024-09-11T22:16:32.134646+0000","last_undegraded":"2024-09-11T22:16:32.134646+0000","last_fullsized":"2024-09-11T22:16:32.134646+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:12.708663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856298+0000","last_change":"2024-09-11T22:16:30.137762+0000","last_active":"2024-09-11T22:16:32.856298+0000","last_peered":"2024-09-11T22:16:32.856298+0000","last_clean":"2024-09-11T22:16:32.856298+0000","last_became_active":"2024-09-11T22:16:30.137498+0000","last_became_peered":"2024-09-11T22:16:30.137498+0000","last_unstale":"2024-09-11T22:16:32.856298+0000","last_undegraded":"2024-09-11T22:16:32.856298+0000","last_fullsized":"2024-09-11T22:16:32.856298+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:16.713406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856873+0000","last_change":"2024-09-11T22:16:31.141412+0000","last_active":"2024-09-11T22:16:32.856873+0000","last_peered":"2024-09-11T22:16:32.856873+0000","last_clean":"2024-09-11T22:16:32.856873+0000","last_became_active":"2024-09-11T22:16:31.140411+0000","last_became_peered":"2024-09-11T22:16:31.140411+0000","last_unstale":"2024-09-11T22:16:32.856873+0000","last_undegraded":"2024-09-11T22:16:32.856873+0000","last_fullsized":"2024-09-11T22:16:32.856873+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:05.836838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133237+0000","last_change":"2024-09-11T22:16:30.127006+0000","last_active":"2024-09-11T22:16:32.133237+0000","last_peered":"2024-09-11T22:16:32.133237+0000","last_clean":"2024-09-11T22:16:32.133237+0000","last_became_active":"2024-09-11T22:16:30.126684+0000","last_became_peered":"2024-09-11T22:16:30.126684+0000","last_unstale":"2024-09-11T22:16:32.133237+0000","last_undegraded":"2024-09-11T22:16:32.133237+0000","last_fullsized":"2024-09-11T22:16:32.133237+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:54.535530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355483+0000","last_change":"2024-09-11T22:16:31.151415+0000","last_active":"2024-09-11T22:16:32.355483+0000","last_peered":"2024-09-11T22:16:32.355483+0000","last_clean":"2024-09-11T22:16:32.355483+0000","last_became_active":"2024-09-11T22:16:31.151155+0000","last_became_peered":"2024-09-11T22:16:31.151155+0000","last_unstale":"2024-09-11T22:16:32.355483+0000","last_undegraded":"2024-09-11T22:16:32.355483+0000","last_fullsized":"2024-09-11T22:16:32.355483+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:26.126461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857234+0000","last_change":"2024-09-11T22:16:30.140931+0000","last_active":"2024-09-11T22:16:32.857234+0000","last_peered":"2024-09-11T22:16:32.857234+0000","last_clean":"2024-09-11T22:16:32.857234+0000","last_became_active":"2024-09-11T22:16:30.140620+0000","last_became_peered":"2024-09-11T22:16:30.140620+0000","last_unstale":"2024-09-11T22:16:32.857234+0000","last_undegraded":"2024-09-11T22:16:32.857234+0000","last_fullsized":"2024-09-11T22:16:32.857234+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:31.653170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134580+0000","last_change":"2024-09-11T22:16:31.128646+0000","last_active":"2024-09-11T22:16:32.134580+0000","last_peered":"2024-09-11T22:16:32.134580+0000","last_clean":"2024-09-11T22:16:32.134580+0000","last_became_active":"2024-09-11T22:16:31.128351+0000","last_became_peered":"2024-09-11T22:16:31.128351+0000","last_unstale":"2024-09-11T22:16:32.134580+0000","last_undegraded":"2024-09-11T22:16:32.134580+0000","last_fullsized":"2024-09-11T22:16:32.134580+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:13.221303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856154+0000","last_change":"2024-09-11T22:16:30.141298+0000","last_active":"2024-09-11T22:16:32.856154+0000","last_peered":"2024-09-11T22:16:32.856154+0000","last_clean":"2024-09-11T22:16:32.856154+0000","last_became_active":"2024-09-11T22:16:30.140999+0000","last_became_peered":"2024-09-11T22:16:30.140999+0000","last_unstale":"2024-09-11T22:16:32.856154+0000","last_undegraded":"2024-09-11T22:16:32.856154+0000","last_fullsized":"2024-09-11T22:16:32.856154+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:48.489911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133752+0000","last_change":"2024-09-11T22:16:31.142293+0000","last_active":"2024-09-11T22:16:32.133752+0000","last_peered":"2024-09-11T22:16:32.133752+0000","last_clean":"2024-09-11T22:16:32.133752+0000","last_became_active":"2024-09-11T22:16:31.141991+0000","last_became_peered":"2024-09-11T22:16:31.141991+0000","last_unstale":"2024-09-11T22:16:32.133752+0000","last_undegraded":"2024-09-11T22:16:32.133752+0000","last_fullsized":"2024-09-11T22:16:32.133752+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:33.967016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856967+0000","last_change":"2024-09-11T22:16:30.136911+0000","last_active":"2024-09-11T22:16:32.856967+0000","last_peered":"2024-09-11T22:16:32.856967+0000","last_clean":"2024-09-11T22:16:32.856967+0000","last_became_active":"2024-09-11T22:16:30.136363+0000","last_became_peered":"2024-09-11T22:16:30.136363+0000","last_unstale":"2024-09-11T22:16:32.856967+0000","last_undegraded":"2024-09-11T22:16:32.856967+0000","last_fullsized":"2024-09-11T22:16:32.856967+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:43.202307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.135528+0000","last_change":"2024-09-11T22:16:31.128426+0000","last_active":"2024-09-11T22:16:32.135528+0000","last_peered":"2024-09-11T22:16:32.135528+0000","last_clean":"2024-09-11T22:16:32.135528+0000","last_became_active":"2024-09-11T22:16:31.128145+0000","last_became_peered":"2024-09-11T22:16:31.128145+0000","last_unstale":"2024-09-11T22:16:32.135528+0000","last_undegraded":"2024-09-11T22:16:32.135528+0000","last_fullsized":"2024-09-11T22:16:32.135528+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:39.616358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355592+0000","last_change":"2024-09-11T22:16:30.140926+0000","last_active":"2024-09-11T22:16:32.355592+0000","last_peered":"2024-09-11T22:16:32.355592+0000","last_clean":"2024-09-11T22:16:32.355592+0000","last_became_active":"2024-09-11T22:16:30.140685+0000","last_became_peered":"2024-09-11T22:16:30.140685+0000","last_unstale":"2024-09-11T22:16:32.355592+0000","last_undegraded":"2024-09-11T22:16:32.355592+0000","last_fullsized":"2024-09-11T22:16:32.355592+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:38.610602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857657+0000","last_change":"2024-09-11T22:16:31.139026+0000","last_active":"2024-09-11T22:16:32.857657+0000","last_peered":"2024-09-11T22:16:32.857657+0000","last_clean":"2024-09-11T22:16:32.857657+0000","last_became_active":"2024-09-11T22:16:31.138707+0000","last_became_peered":"2024-09-11T22:16:31.138707+0000","last_unstale":"2024-09-11T22:16:32.857657+0000","last_undegraded":"2024-09-11T22:16:32.857657+0000","last_fullsized":"2024-09-11T22:16:32.857657+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:53.744214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"106'3","reported_seq":17,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857254+0000","last_change":"2024-09-11T22:16:30.138863+0000","last_active":"2024-09-11T22:16:32.857254+0000","last_peered":"2024-09-11T22:16:32.857254+0000","last_clean":"2024-09-11T22:16:32.857254+0000","last_became_active":"2024-09-11T22:16:30.138546+0000","last_became_peered":"2024-09-11T22:16:30.138546+0000","last_unstale":"2024-09-11T22:16:32.857254+0000","last_undegraded":"2024-09-11T22:16:32.857254+0000","last_fullsized":"2024-09-11T22:16:32.857254+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.751700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857123+0000","last_change":"2024-09-11T22:16:31.142601+0000","last_active":"2024-09-11T22:16:32.857123+0000","last_peered":"2024-09-11T22:16:32.857123+0000","last_clean":"2024-09-11T22:16:32.857123+0000","last_became_active":"2024-09-11T22:16:31.142307+0000","last_became_peered":"2024-09-11T22:16:31.142307+0000","last_unstale":"2024-09-11T22:16:32.857123+0000","last_undegraded":"2024-09-11T22:16:32.857123+0000","last_fullsized":"2024-09-11T22:16:32.857123+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:48.665343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"106'6","reported_seq":20,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134831+0000","last_change":"2024-09-11T22:16:30.134598+0000","last_active":"2024-09-11T22:16:32.134831+0000","last_peered":"2024-09-11T22:16:32.134831+0000","last_clean":"2024-09-11T22:16:32.134831+0000","last_became_active":"2024-09-11T22:16:30.134328+0000","last_became_peered":"2024-09-11T22:16:30.134328+0000","last_unstale":"2024-09-11T22:16:32.134831+0000","last_undegraded":"2024-09-11T22:16:32.134831+0000","last_fullsized":"2024-09-11T22:16:32.134831+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:54.535530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355518+0000","last_change":"2024-09-11T22:16:31.136115+0000","last_active":"2024-09-11T22:16:32.355518+0000","last_peered":"2024-09-11T22:16:32.355518+0000","last_clean":"2024-09-11T22:16:32.355518+0000","last_became_active":"2024-09-11T22:16:31.135833+0000","last_became_peered":"2024-09-11T22:16:31.135833+0000","last_unstale":"2024-09-11T22:16:32.355518+0000","last_undegraded":"2024-09-11T22:16:32.355518+0000","last_fullsized":"2024-09-11T22:16:32.355518+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:12.447924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856698+0000","last_change":"2024-09-11T22:16:30.134072+0000","last_active":"2024-09-11T22:16:32.856698+0000","last_peered":"2024-09-11T22:16:32.856698+0000","last_clean":"2024-09-11T22:16:32.856698+0000","last_became_active":"2024-09-11T22:16:30.133756+0000","last_became_peered":"2024-09-11T22:16:30.133756+0000","last_unstale":"2024-09-11T22:16:32.856698+0000","last_undegraded":"2024-09-11T22:16:32.856698+0000","last_fullsized":"2024-09-11T22:16:32.856698+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:40.093900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856242+0000","last_change":"2024-09-11T22:16:31.144950+0000","last_active":"2024-09-11T22:16:32.856242+0000","last_peered":"2024-09-11T22:16:32.856242+0000","last_clean":"2024-09-11T22:16:32.856242+0000","last_became_active":"2024-09-11T22:16:31.144664+0000","last_became_peered":"2024-09-11T22:16:31.144664+0000","last_unstale":"2024-09-11T22:16:32.856242+0000","last_undegraded":"2024-09-11T22:16:32.856242+0000","last_fullsized":"2024-09-11T22:16:32.856242+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:25.745105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856517+0000","last_change":"2024-09-11T22:16:30.134404+0000","last_active":"2024-09-11T22:16:32.856517+0000","last_peered":"2024-09-11T22:16:32.856517+0000","last_clean":"2024-09-11T22:16:32.856517+0000","last_became_active":"2024-09-11T22:16:30.133816+0000","last_became_peered":"2024-09-11T22:16:30.133816+0000","last_unstale":"2024-09-11T22:16:32.856517+0000","last_undegraded":"2024-09-11T22:16:32.856517+0000","last_fullsized":"2024-09-11T22:16:32.856517+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:51:29.870433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134451+0000","last_change":"2024-09-11T22:16:31.134221+0000","last_active":"2024-09-11T22:16:32.134451+0000","last_peered":"2024-09-11T22:16:32.134451+0000","last_clean":"2024-09-11T22:16:32.134451+0000","last_became_active":"2024-09-11T22:16:31.133953+0000","last_became_peered":"2024-09-11T22:16:31.133953+0000","last_unstale":"2024-09-11T22:16:32.134451+0000","last_undegraded":"2024-09-11T22:16:32.134451+0000","last_fullsized":"2024-09-11T22:16:32.134451+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:41.306517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134528+0000","last_change":"2024-09-11T22:16:30.134672+0000","last_active":"2024-09-11T22:16:32.134528+0000","last_peered":"2024-09-11T22:16:32.134528+0000","last_clean":"2024-09-11T22:16:32.134528+0000","last_became_active":"2024-09-11T22:16:30.134397+0000","last_became_peered":"2024-09-11T22:16:30.134397+0000","last_unstale":"2024-09-11T22:16:32.134528+0000","last_undegraded":"2024-09-11T22:16:32.134528+0000","last_fullsized":"2024-09-11T22:16:32.134528+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:51.222786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.855928+0000","last_change":"2024-09-11T22:16:31.144771+0000","last_active":"2024-09-11T22:16:32.855928+0000","last_peered":"2024-09-11T22:16:32.855928+0000","last_clean":"2024-09-11T22:16:32.855928+0000","last_became_active":"2024-09-11T22:16:31.144465+0000","last_became_peered":"2024-09-11T22:16:31.144465+0000","last_unstale":"2024-09-11T22:16:32.855928+0000","last_undegraded":"2024-09-11T22:16:32.855928+0000","last_fullsized":"2024-09-11T22:16:32.855928+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:17:24.821396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"106'8","reported_seq":22,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856110+0000","last_change":"2024-09-11T22:16:30.140672+0000","last_active":"2024-09-11T22:16:32.856110+0000","last_peered":"2024-09-11T22:16:32.856110+0000","last_clean":"2024-09-11T22:16:32.856110+0000","last_became_active":"2024-09-11T22:16:30.140383+0000","last_became_peered":"2024-09-11T22:16:30.140383+0000","last_unstale":"2024-09-11T22:16:32.856110+0000","last_undegraded":"2024-09-11T22:16:32.856110+0000","last_fullsized":"2024-09-11T22:16:32.856110+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:20.643770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857564+0000","last_change":"2024-09-11T22:16:31.144063+0000","last_active":"2024-09-11T22:16:32.857564+0000","last_peered":"2024-09-11T22:16:32.857564+0000","last_clean":"2024-09-11T22:16:32.857564+0000","last_became_active":"2024-09-11T22:16:31.142859+0000","last_became_peered":"2024-09-11T22:16:31.142859+0000","last_unstale":"2024-09-11T22:16:32.857564+0000","last_undegraded":"2024-09-11T22:16:32.857564+0000","last_fullsized":"2024-09-11T22:16:32.857564+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:55.400432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.135237+0000","last_change":"2024-09-11T22:16:30.143254+0000","last_active":"2024-09-11T22:16:32.135237+0000","last_peered":"2024-09-11T22:16:32.135237+0000","last_clean":"2024-09-11T22:16:32.135237+0000","last_became_active":"2024-09-11T22:16:30.143054+0000","last_became_peered":"2024-09-11T22:16:30.143054+0000","last_unstale":"2024-09-11T22:16:32.135237+0000","last_undegraded":"2024-09-11T22:16:32.135237+0000","last_fullsized":"2024-09-11T22:16:32.135237+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:21.354892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134581+0000","last_change":"2024-09-11T22:16:31.136570+0000","last_active":"2024-09-11T22:16:32.134581+0000","last_peered":"2024-09-11T22:16:32.134581+0000","last_clean":"2024-09-11T22:16:32.134581+0000","last_became_active":"2024-09-11T22:16:31.136299+0000","last_became_peered":"2024-09-11T22:16:31.136299+0000","last_unstale":"2024-09-11T22:16:32.134581+0000","last_undegraded":"2024-09-11T22:16:32.134581+0000","last_fullsized":"2024-09-11T22:16:32.134581+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:55.541287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857398+0000","last_change":"2024-09-11T22:16:30.137242+0000","last_active":"2024-09-11T22:16:32.857398+0000","last_peered":"2024-09-11T22:16:32.857398+0000","last_clean":"2024-09-11T22:16:32.857398+0000","last_became_active":"2024-09-11T22:16:30.136986+0000","last_became_peered":"2024-09-11T22:16:30.136986+0000","last_unstale":"2024-09-11T22:16:32.857398+0000","last_undegraded":"2024-09-11T22:16:32.857398+0000","last_fullsized":"2024-09-11T22:16:32.857398+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:16.443823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857149+0000","last_change":"2024-09-11T22:16:31.140281+0000","last_active":"2024-09-11T22:16:32.857149+0000","last_peered":"2024-09-11T22:16:32.857149+0000","last_clean":"2024-09-11T22:16:32.857149+0000","last_became_active":"2024-09-11T22:16:31.139962+0000","last_became_peered":"2024-09-11T22:16:31.139962+0000","last_unstale":"2024-09-11T22:16:32.857149+0000","last_undegraded":"2024-09-11T22:16:32.857149+0000","last_fullsized":"2024-09-11T22:16:32.857149+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:21.245262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133558+0000","last_change":"2024-09-11T22:16:30.138689+0000","last_active":"2024-09-11T22:16:32.133558+0000","last_peered":"2024-09-11T22:16:32.133558+0000","last_clean":"2024-09-11T22:16:32.133558+0000","last_became_active":"2024-09-11T22:16:30.138432+0000","last_became_peered":"2024-09-11T22:16:30.138432+0000","last_unstale":"2024-09-11T22:16:32.133558+0000","last_undegraded":"2024-09-11T22:16:32.133558+0000","last_fullsized":"2024-09-11T22:16:32.133558+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:52.695747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856417+0000","last_change":"2024-09-11T22:16:31.148199+0000","last_active":"2024-09-11T22:16:32.856417+0000","last_peered":"2024-09-11T22:16:32.856417+0000","last_clean":"2024-09-11T22:16:32.856417+0000","last_became_active":"2024-09-11T22:16:31.147855+0000","last_became_peered":"2024-09-11T22:16:31.147855+0000","last_unstale":"2024-09-11T22:16:32.856417+0000","last_undegraded":"2024-09-11T22:16:32.856417+0000","last_fullsized":"2024-09-11T22:16:32.856417+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:51.365021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133933+0000","last_change":"2024-09-11T22:16:30.139771+0000","last_active":"2024-09-11T22:16:32.133933+0000","last_peered":"2024-09-11T22:16:32.133933+0000","last_clean":"2024-09-11T22:16:32.133933+0000","last_became_active":"2024-09-11T22:16:30.139512+0000","last_became_peered":"2024-09-11T22:16:30.139512+0000","last_unstale":"2024-09-11T22:16:32.133933+0000","last_undegraded":"2024-09-11T22:16:32.133933+0000","last_fullsized":"2024-09-11T22:16:32.133933+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:11.702907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856634+0000","last_change":"2024-09-11T22:16:31.151401+0000","last_active":"2024-09-11T22:16:32.856634+0000","last_peered":"2024-09-11T22:16:32.856634+0000","last_clean":"2024-09-11T22:16:32.856634+0000","last_became_active":"2024-09-11T22:16:31.151128+0000","last_became_peered":"2024-09-11T22:16:31.151128+0000","last_unstale":"2024-09-11T22:16:32.856634+0000","last_undegraded":"2024-09-11T22:16:32.856634+0000","last_fullsized":"2024-09-11T22:16:32.856634+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:42.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134527+0000","last_change":"2024-09-11T22:16:30.134250+0000","last_active":"2024-09-11T22:16:32.134527+0000","last_peered":"2024-09-11T22:16:32.134527+0000","last_clean":"2024-09-11T22:16:32.134527+0000","last_became_active":"2024-09-11T22:16:30.133921+0000","last_became_peered":"2024-09-11T22:16:30.133921+0000","last_unstale":"2024-09-11T22:16:32.134527+0000","last_undegraded":"2024-09-11T22:16:32.134527+0000","last_fullsized":"2024-09-11T22:16:32.134527+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:31.653170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.855994+0000","last_change":"2024-09-11T22:16:31.148915+0000","last_active":"2024-09-11T22:16:32.855994+0000","last_peered":"2024-09-11T22:16:32.855994+0000","last_clean":"2024-09-11T22:16:32.855994+0000","last_became_active":"2024-09-11T22:16:31.148608+0000","last_became_peered":"2024-09-11T22:16:31.148608+0000","last_unstale":"2024-09-11T22:16:32.855994+0000","last_undegraded":"2024-09-11T22:16:32.855994+0000","last_fullsized":"2024-09-11T22:16:32.855994+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:12.994915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134172+0000","last_change":"2024-09-11T22:16:30.134676+0000","last_active":"2024-09-11T22:16:32.134172+0000","last_peered":"2024-09-11T22:16:32.134172+0000","last_clean":"2024-09-11T22:16:32.134172+0000","last_became_active":"2024-09-11T22:16:30.134403+0000","last_became_peered":"2024-09-11T22:16:30.134403+0000","last_unstale":"2024-09-11T22:16:32.134172+0000","last_undegraded":"2024-09-11T22:16:32.134172+0000","last_fullsized":"2024-09-11T22:16:32.134172+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:31.494808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857176+0000","last_change":"2024-09-11T22:16:31.140525+0000","last_active":"2024-09-11T22:16:32.857176+0000","last_peered":"2024-09-11T22:16:32.857176+0000","last_clean":"2024-09-11T22:16:32.857176+0000","last_became_active":"2024-09-11T22:16:31.140229+0000","last_became_peered":"2024-09-11T22:16:31.140229+0000","last_unstale":"2024-09-11T22:16:32.857176+0000","last_undegraded":"2024-09-11T22:16:32.857176+0000","last_fullsized":"2024-09-11T22:16:32.857176+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:06.548762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133202+0000","last_change":"2024-09-11T22:16:30.134260+0000","last_active":"2024-09-11T22:16:32.133202+0000","last_peered":"2024-09-11T22:16:32.133202+0000","last_clean":"2024-09-11T22:16:32.133202+0000","last_became_active":"2024-09-11T22:16:30.134009+0000","last_became_peered":"2024-09-11T22:16:30.134009+0000","last_unstale":"2024-09-11T22:16:32.133202+0000","last_undegraded":"2024-09-11T22:16:32.133202+0000","last_fullsized":"2024-09-11T22:16:32.133202+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:55.784057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133842+0000","last_change":"2024-09-11T22:16:31.131829+0000","last_active":"2024-09-11T22:16:32.133842+0000","last_peered":"2024-09-11T22:16:32.133842+0000","last_clean":"2024-09-11T22:16:32.133842+0000","last_became_active":"2024-09-11T22:16:31.131539+0000","last_became_peered":"2024-09-11T22:16:31.131539+0000","last_unstale":"2024-09-11T22:16:32.133842+0000","last_undegraded":"2024-09-11T22:16:32.133842+0000","last_fullsized":"2024-09-11T22:16:32.133842+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:50.333530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134970+0000","last_change":"2024-09-11T22:16:30.134903+0000","last_active":"2024-09-11T22:16:32.134970+0000","last_peered":"2024-09-11T22:16:32.134970+0000","last_clean":"2024-09-11T22:16:32.134970+0000","last_became_active":"2024-09-11T22:16:30.134584+0000","last_became_peered":"2024-09-11T22:16:30.134584+0000","last_unstale":"2024-09-11T22:16:32.134970+0000","last_undegraded":"2024-09-11T22:16:32.134970+0000","last_fullsized":"2024-09-11T22:16:32.134970+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:16.443823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856984+0000","last_change":"2024-09-11T22:16:31.146501+0000","last_active":"2024-09-11T22:16:32.856984+0000","last_peered":"2024-09-11T22:16:32.856984+0000","last_clean":"2024-09-11T22:16:32.856984+0000","last_became_active":"2024-09-11T22:16:31.146226+0000","last_became_peered":"2024-09-11T22:16:31.146226+0000","last_unstale":"2024-09-11T22:16:32.856984+0000","last_undegraded":"2024-09-11T22:16:32.856984+0000","last_fullsized":"2024-09-11T22:16:32.856984+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:32.658926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"107'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133818+0000","last_change":"2024-09-11T22:16:30.138814+0000","last_active":"2024-09-11T22:16:32.133818+0000","last_peered":"2024-09-11T22:16:32.133818+0000","last_clean":"2024-09-11T22:16:32.133818+0000","last_became_active":"2024-09-11T22:16:30.138533+0000","last_became_peered":"2024-09-11T22:16:30.138533+0000","last_unstale":"2024-09-11T22:16:32.133818+0000","last_undegraded":"2024-09-11T22:16:32.133818+0000","last_fullsized":"2024-09-11T22:16:32.133818+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:20.680189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856696+0000","last_change":"2024-09-11T22:16:31.141391+0000","last_active":"2024-09-11T22:16:32.856696+0000","last_peered":"2024-09-11T22:16:32.856696+0000","last_clean":"2024-09-11T22:16:32.856696+0000","last_became_active":"2024-09-11T22:16:31.140381+0000","last_became_peered":"2024-09-11T22:16:31.140381+0000","last_unstale":"2024-09-11T22:16:32.856696+0000","last_undegraded":"2024-09-11T22:16:32.856696+0000","last_fullsized":"2024-09-11T22:16:32.856696+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:19.894437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.133623+0000","last_change":"2024-09-11T22:16:30.135578+0000","last_active":"2024-09-11T22:16:32.133623+0000","last_peered":"2024-09-11T22:16:32.133623+0000","last_clean":"2024-09-11T22:16:32.133623+0000","last_became_active":"2024-09-11T22:16:30.135281+0000","last_became_peered":"2024-09-11T22:16:30.135281+0000","last_unstale":"2024-09-11T22:16:32.133623+0000","last_undegraded":"2024-09-11T22:16:32.133623+0000","last_fullsized":"2024-09-11T22:16:32.133623+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:14.738238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857474+0000","last_change":"2024-09-11T22:16:31.144695+0000","last_active":"2024-09-11T22:16:32.857474+0000","last_peered":"2024-09-11T22:16:32.857474+0000","last_clean":"2024-09-11T22:16:32.857474+0000","last_became_active":"2024-09-11T22:16:31.144402+0000","last_became_peered":"2024-09-11T22:16:31.144402+0000","last_unstale":"2024-09-11T22:16:32.857474+0000","last_undegraded":"2024-09-11T22:16:32.857474+0000","last_fullsized":"2024-09-11T22:16:32.857474+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:25.930260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857696+0000","last_change":"2024-09-11T22:16:30.136438+0000","last_active":"2024-09-11T22:16:32.857696+0000","last_peered":"2024-09-11T22:16:32.857696+0000","last_clean":"2024-09-11T22:16:32.857696+0000","last_became_active":"2024-09-11T22:16:30.136142+0000","last_became_peered":"2024-09-11T22:16:30.136142+0000","last_unstale":"2024-09-11T22:16:32.857696+0000","last_undegraded":"2024-09-11T22:16:32.857696+0000","last_fullsized":"2024-09-11T22:16:32.857696+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:31.494808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856508+0000","last_change":"2024-09-11T22:16:31.146357+0000","last_active":"2024-09-11T22:16:32.856508+0000","last_peered":"2024-09-11T22:16:32.856508+0000","last_clean":"2024-09-11T22:16:32.856508+0000","last_became_active":"2024-09-11T22:16:31.146047+0000","last_became_peered":"2024-09-11T22:16:31.146047+0000","last_unstale":"2024-09-11T22:16:32.856508+0000","last_undegraded":"2024-09-11T22:16:32.856508+0000","last_fullsized":"2024-09-11T22:16:32.856508+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:03.266134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134025+0000","last_change":"2024-09-11T22:16:30.131747+0000","last_active":"2024-09-11T22:16:32.134025+0000","last_peered":"2024-09-11T22:16:32.134025+0000","last_clean":"2024-09-11T22:16:32.134025+0000","last_became_active":"2024-09-11T22:16:30.131457+0000","last_became_peered":"2024-09-11T22:16:30.131457+0000","last_unstale":"2024-09-11T22:16:32.134025+0000","last_undegraded":"2024-09-11T22:16:32.134025+0000","last_fullsized":"2024-09-11T22:16:32.134025+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:06.464203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.134952+0000","last_change":"2024-09-11T22:16:31.138620+0000","last_active":"2024-09-11T22:16:32.134952+0000","last_peered":"2024-09-11T22:16:32.134952+0000","last_clean":"2024-09-11T22:16:32.134952+0000","last_became_active":"2024-09-11T22:16:31.137910+0000","last_became_peered":"2024-09-11T22:16:31.137910+0000","last_unstale":"2024-09-11T22:16:32.134952+0000","last_undegraded":"2024-09-11T22:16:32.134952+0000","last_fullsized":"2024-09-11T22:16:32.134952+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:21.822644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857044+0000","last_change":"2024-09-11T22:16:30.138013+0000","last_active":"2024-09-11T22:16:32.857044+0000","last_peered":"2024-09-11T22:16:32.857044+0000","last_clean":"2024-09-11T22:16:32.857044+0000","last_became_active":"2024-09-11T22:16:30.137719+0000","last_became_peered":"2024-09-11T22:16:30.137719+0000","last_unstale":"2024-09-11T22:16:32.857044+0000","last_undegraded":"2024-09-11T22:16:32.857044+0000","last_fullsized":"2024-09-11T22:16:32.857044+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:18.888680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.855939+0000","last_change":"2024-09-11T22:16:31.145558+0000","last_active":"2024-09-11T22:16:32.855939+0000","last_peered":"2024-09-11T22:16:32.855939+0000","last_clean":"2024-09-11T22:16:32.855939+0000","last_became_active":"2024-09-11T22:16:31.145190+0000","last_became_peered":"2024-09-11T22:16:31.145190+0000","last_unstale":"2024-09-11T22:16:32.855939+0000","last_undegraded":"2024-09-11T22:16:32.855939+0000","last_fullsized":"2024-09-11T22:16:32.855939+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:56.975287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.355363+0000","last_change":"2024-09-11T22:16:30.139028+0000","last_active":"2024-09-11T22:16:32.355363+0000","last_peered":"2024-09-11T22:16:32.355363+0000","last_clean":"2024-09-11T22:16:32.355363+0000","last_became_active":"2024-09-11T22:16:30.136861+0000","last_became_peered":"2024-09-11T22:16:30.136861+0000","last_unstale":"2024-09-11T22:16:32.355363+0000","last_undegraded":"2024-09-11T22:16:32.355363+0000","last_fullsized":"2024-09-11T22:16:32.355363+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:37.457616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.857200+0000","last_change":"2024-09-11T22:16:31.133996+0000","last_active":"2024-09-11T22:16:32.857200+0000","last_peered":"2024-09-11T22:16:32.857200+0000","last_clean":"2024-09-11T22:16:32.857200+0000","last_became_active":"2024-09-11T22:16:31.133709+0000","last_became_peered":"2024-09-11T22:16:31.133709+0000","last_unstale":"2024-09-11T22:16:32.857200+0000","last_undegraded":"2024-09-11T22:16:32.857200+0000","last_fullsized":"2024-09-11T22:16:32.857200+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:21.685946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856046+0000","last_change":"2024-09-11T22:16:30.134155+0000","last_active":"2024-09-11T22:16:32.856046+0000","last_peered":"2024-09-11T22:16:32.856046+0000","last_clean":"2024-09-11T22:16:32.856046+0000","last_became_active":"2024-09-11T22:16:30.133835+0000","last_became_peered":"2024-09-11T22:16:30.133835+0000","last_unstale":"2024-09-11T22:16:32.856046+0000","last_undegraded":"2024-09-11T22:16:32.856046+0000","last_fullsized":"2024-09-11T22:16:32.856046+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:58.593480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856820+0000","last_change":"2024-09-11T22:16:31.149781+0000","last_active":"2024-09-11T22:16:32.856820+0000","last_peered":"2024-09-11T22:16:32.856820+0000","last_clean":"2024-09-11T22:16:32.856820+0000","last_became_active":"2024-09-11T22:16:31.149416+0000","last_became_peered":"2024-09-11T22:16:31.149416+0000","last_unstale":"2024-09-11T22:16:32.856820+0000","last_undegraded":"2024-09-11T22:16:32.856820+0000","last_fullsized":"2024-09-11T22:16:32.856820+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:30.114149+0000","last_clean_scrub_stamp":"2024-09-11T22:16:30.114149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:43.267026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856933+0000","last_change":"2024-09-11T22:16:30.140162+0000","last_active":"2024-09-11T22:16:32.856933+0000","last_peered":"2024-09-11T22:16:32.856933+0000","last_clean":"2024-09-11T22:16:32.856933+0000","last_became_active":"2024-09-11T22:16:30.139889+0000","last_became_peered":"2024-09-11T22:16:30.139889+0000","last_unstale":"2024-09-11T22:16:32.856933+0000","last_undegraded":"2024-09-11T22:16:32.856933+0000","last_fullsized":"2024-09-11T22:16:32.856933+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:16:29.108392+0000","last_clean_scrub_stamp":"2024-09-11T22:16:29.108392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:07.047344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":327,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-11T22:16:32.856887+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:16:32.856887+0000","last_peered":"2024-09-11T22:16:32.856887+0000","last_clean":"2024-09-11T22:16:32.856887+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:16:32.856887+0000","last_undegraded":"2024-09-11T22:16:32.856887+0000","last_fullsized":"2024-09-11T22:16:32.856887+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509511,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36644,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335196,"statfs":{"total":96636764160,"available":96599240704,"internally_reserved":0,"allocated":1323008,"data_stored":575006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36644,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335196,"statfs":{"total":96636764160,"available":96599240704,"internally_reserved":0,"allocated":1318912,"data_stored":574424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509510,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":1335296,"data_stored":576090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28328,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343512,"statfs":{"total":96636764160,"available":96607756288,"internally_reserved":0,"allocated":1331200,"data_stored":575988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509510,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1314816,"data_stored":574354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41376,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330464,"statfs":{"total":96636764160,"available":96594395136,"internally_reserved":0,"allocated":1912832,"data_stored":1165304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41380,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330460,"statfs":{"total":96636764160,"available":96594391040,"internally_reserved":0,"allocated":1916928,"data_stored":1164834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":1318912,"data_stored":574388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:16:38.860 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:16:38.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T22:16:39.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.006+0000 7f0787453640 1 Processor -- start 2024-09-11T22:16:39.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.006+0000 7f0787453640 1 -- start start 2024-09-11T22:16:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f0787453640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07800d0150 0x7f07800b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f0787453640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f078015ff40 con 0x7f078015fb60 2024-09-11T22:16:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f0787453640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07800d05e0 con 0x7f07800d0fd0 2024-09-11T22:16:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f0787453640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f07800cf510 con 0x7f07800d0150 2024-09-11T22:16:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f07851ef640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f078015fb60 0x7f07800d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45126/0 (socket says 172.21.15.50:45126) 2024-09-11T22:16:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f07851ef640 1 -- 172.21.15.50:0/2332354968 learned_addr learned my addr 172.21.15.50:0/2332354968 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f07849ee640 1 --2- 172.21.15.50:0/2332354968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07800d0150 0x7f07800b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f0777fff640 1 -- 172.21.15.50:0/2332354968 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2241930699 0 0) 0x7f078015ff40 con 0x7f078015fb60 2024-09-11T22:16:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f0777fff640 1 -- 172.21.15.50:0/2332354968 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f076c003520 con 0x7f078015fb60 2024-09-11T22:16:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f0777fff640 1 -- 172.21.15.50:0/2332354968 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859092948 0 0) 0x7f07800d05e0 con 0x7f07800d0fd0 2024-09-11T22:16:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f0777fff640 1 -- 172.21.15.50:0/2332354968 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f078015ff40 con 0x7f07800d0fd0 2024-09-11T22:16:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f0777fff640 1 -- 172.21.15.50:0/2332354968 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 492969311 0 0) 0x7f076c003520 con 0x7f078015fb60 2024-09-11T22:16:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f07849ee640 1 -- 172.21.15.50:0/2332354968 >> v1:172.21.15.77:6789/0 conn(0x7f07800d0fd0 legacy=0x7f07800af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f07849ee640 1 -- 172.21.15.50:0/2332354968 >> v1:172.21.15.50:6789/0 conn(0x7f078015fb60 legacy=0x7f07800d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.007+0000 7f07849ee640 1 -- 172.21.15.50:0/2332354968 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07800cf760 con 0x7f07800d0150 2024-09-11T22:16:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.008+0000 7f07849ee640 1 --2- 172.21.15.50:0/2332354968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07800d0150 0x7f07800b4c70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07700097d0 tx=0x7f077002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9e8ad500df57922 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.008+0000 7f0777fff640 1 -- 172.21.15.50:0/2332354968 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770037070 con 0x7f07800d0150 2024-09-11T22:16:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.008+0000 7f0777fff640 1 -- 172.21.15.50:0/2332354968 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f077002ab90 con 0x7f07800d0150 2024-09-11T22:16:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.008+0000 7f0777fff640 1 -- 172.21.15.50:0/2332354968 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c001670 con 0x7f07800d0150 2024-09-11T22:16:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.009+0000 7f0787453640 1 -- 172.21.15.50:0/2332354968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07800d0150 msgr2=0x7f07800b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.009+0000 7f0787453640 1 --2- 172.21.15.50:0/2332354968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07800d0150 0x7f07800b4c70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07700097d0 tx=0x7f077002a100 comp rx=0 tx=0).stop 2024-09-11T22:16:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.009+0000 7f0787453640 1 -- 172.21.15.50:0/2332354968 shutdown_connections 2024-09-11T22:16:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.009+0000 7f0787453640 1 --2- 172.21.15.50:0/2332354968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07800d0150 0x7f07800b4c70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.009+0000 7f0787453640 1 -- 172.21.15.50:0/2332354968 >> 172.21.15.50:0/2332354968 conn(0x7f07800b4150 msgr2=0x7f07800b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.009+0000 7f0787453640 1 -- 172.21.15.50:0/2332354968 shutdown_connections 2024-09-11T22:16:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.009+0000 7f0787453640 1 -- 172.21.15.50:0/2332354968 wait complete. 2024-09-11T22:16:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.010+0000 7f0787453640 1 Processor -- start 2024-09-11T22:16:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.010+0000 7f0787453640 1 -- start start 2024-09-11T22:16:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f0787453640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07800d0fd0 0x7f078015b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f0787453640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f078015fb60 0x7f07800b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f0787453640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780159a90 0x7f07800b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f0787453640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07800b1930 con 0x7f0780159a90 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f0787453640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f07800cfdb0 con 0x7f078015fb60 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f0787453640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f07800b1ab0 con 0x7f07800d0fd0 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f07859f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780159a90 0x7f07800b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f07859f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780159a90 0x7f07800b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35074/0 (socket says 172.21.15.50:35074) 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f07859f0640 1 -- 172.21.15.50:0/3869787972 learned_addr learned my addr 172.21.15.50:0/3869787972 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f07849ee640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f078015fb60 0x7f07800b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f07859f0640 1 -- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07800d0fd0 msgr2=0x7f078015b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f07851ef640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07800d0fd0 0x7f078015b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f07859f0640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07800d0fd0 0x7f078015b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f07859f0640 1 -- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f078015fb60 msgr2=0x7f07800b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f07859f0640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f078015fb60 0x7f07800b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f07859f0640 1 -- 172.21.15.50:0/3869787972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078015bdb0 con 0x7f0780159a90 2024-09-11T22:16:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.011+0000 7f07849ee640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f078015fb60 0x7f07800b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.012+0000 7f07859f0640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780159a90 0x7f07800b70f0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f077800c790 tx=0x7f077800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.012+0000 7f0775ffb640 1 -- 172.21.15.50:0/3869787972 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778003b70 con 0x7f0780159a90 2024-09-11T22:16:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.012+0000 7f0775ffb640 1 -- 172.21.15.50:0/3869787972 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0778003d10 con 0x7f0780159a90 2024-09-11T22:16:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.012+0000 7f0787453640 1 -- 172.21.15.50:0/3869787972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078015c090 con 0x7f0780159a90 2024-09-11T22:16:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.012+0000 7f0775ffb640 1 -- 172.21.15.50:0/3869787972 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077800a9f0 con 0x7f0780159a90 2024-09-11T22:16:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.012+0000 7f0787453640 1 -- 172.21.15.50:0/3869787972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07800b5980 con 0x7f0780159a90 2024-09-11T22:16:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.013+0000 7f0787453640 1 -- 172.21.15.50:0/3869787972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07800b4c70 con 0x7f0780159a90 2024-09-11T22:16:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.013+0000 7f0775ffb640 1 -- 172.21.15.50:0/3869787972 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f077800ab90 con 0x7f0780159a90 2024-09-11T22:16:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.014+0000 7f0775ffb640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f076406be30 0x7f076406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.014+0000 7f0775ffb640 1 -- 172.21.15.50:0/3869787972 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f077808ae70 con 0x7f0780159a90 2024-09-11T22:16:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.014+0000 7f07851ef640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f076406be30 0x7f076406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.015+0000 7f07851ef640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f076406be30 0x7f076406e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f077c001380 tx=0x7f077c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.019+0000 7f0775ffb640 1 -- 172.21.15.50:0/3869787972 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0778059780 con 0x7f0780159a90 2024-09-11T22:16:39.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.262+0000 7f0787453640 1 -- 172.21.15.50:0/3869787972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f078006fce0 con 0x7f0780159a90 2024-09-11T22:16:39.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.264+0000 7f0775ffb640 1 -- 172.21.15.50:0/3869787972 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f0778059080 con 0x7f0780159a90 2024-09-11T22:16:39.265 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:16:39.265 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:16:39.265 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-09-11T22:16:39.265 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-09-11T22:16:39.266 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T22:16:39.266 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-11T22:16:39.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.267+0000 7f0787453640 1 -- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f076406be30 msgr2=0x7f076406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.267+0000 7f0787453640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f076406be30 0x7f076406e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f077c001380 tx=0x7f077c009040 comp rx=0 tx=0).stop 2024-09-11T22:16:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.267+0000 7f0787453640 1 -- 172.21.15.50:0/3869787972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780159a90 msgr2=0x7f07800b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.267+0000 7f0787453640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780159a90 0x7f07800b70f0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f077800c790 tx=0x7f077800cc50 comp rx=0 tx=0).stop 2024-09-11T22:16:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.267+0000 7f0787453640 1 -- 172.21.15.50:0/3869787972 shutdown_connections 2024-09-11T22:16:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.267+0000 7f0787453640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f076406be30 0x7f076406e2f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.267+0000 7f0787453640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780159a90 0x7f07800b70f0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.267+0000 7f0787453640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f078015fb60 0x7f07800b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.267+0000 7f0787453640 1 --2- 172.21.15.50:0/3869787972 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07800d0fd0 0x7f078015b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.267+0000 7f0787453640 1 -- 172.21.15.50:0/3869787972 >> 172.21.15.50:0/3869787972 conn(0x7f07800b4150 msgr2=0x7f07800701e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.267+0000 7f0787453640 1 -- 172.21.15.50:0/3869787972 shutdown_connections 2024-09-11T22:16:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.267+0000 7f0787453640 1 -- 172.21.15.50:0/3869787972 wait complete. 2024-09-11T22:16:39.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:16:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.380+0000 7efc6f05c640 1 Processor -- start 2024-09-11T22:16:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.380+0000 7efc6f05c640 1 -- start start 2024-09-11T22:16:39.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.381+0000 7efc6f05c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc68162a60 0x7efc680b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.381+0000 7efc6f05c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc68163080 con 0x7efc680d1c90 2024-09-11T22:16:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.381+0000 7efc6f05c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc680d2d20 con 0x7efc6815e8e0 2024-09-11T22:16:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.381+0000 7efc6f05c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efc6815ecc0 con 0x7efc68162a60 2024-09-11T22:16:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.381+0000 7efc67fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efc680d1c90 0x7efc68162350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45134/0 (socket says 172.21.15.50:45134) 2024-09-11T22:16:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.381+0000 7efc67fff640 1 -- 172.21.15.50:0/4203049878 learned_addr learned my addr 172.21.15.50:0/4203049878 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:16:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.381+0000 7efc6d5f9640 1 --2- 172.21.15.50:0/4203049878 >> v2:172.21.15.77:3300/0 conn(0x7efc68162a60 0x7efc680b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.382+0000 7efc677fe640 1 -- 172.21.15.50:0/4203049878 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3461682425 0 0) 0x7efc68163080 con 0x7efc680d1c90 2024-09-11T22:16:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.382+0000 7efc677fe640 1 -- 172.21.15.50:0/4203049878 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc50003520 con 0x7efc680d1c90 2024-09-11T22:16:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.382+0000 7efc677fe640 1 -- 172.21.15.50:0/4203049878 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3625159153 0 0) 0x7efc680d2d20 con 0x7efc6815e8e0 2024-09-11T22:16:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.382+0000 7efc677fe640 1 -- 172.21.15.50:0/4203049878 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc68163080 con 0x7efc6815e8e0 2024-09-11T22:16:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.382+0000 7efc677fe640 1 -- 172.21.15.50:0/4203049878 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2468283680 0 0) 0x7efc50003520 con 0x7efc680d1c90 2024-09-11T22:16:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.382+0000 7efc6d5f9640 1 -- 172.21.15.50:0/4203049878 >> v1:172.21.15.77:6789/0 conn(0x7efc6815e8e0 legacy=0x7efc680d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.382+0000 7efc6d5f9640 1 -- 172.21.15.50:0/4203049878 >> v1:172.21.15.50:6789/0 conn(0x7efc680d1c90 legacy=0x7efc68162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.382+0000 7efc6d5f9640 1 -- 172.21.15.50:0/4203049878 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc680d3000 con 0x7efc68162a60 2024-09-11T22:16:39.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.383+0000 7efc6d5f9640 1 --2- 172.21.15.50:0/4203049878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68162a60 0x7efc680b7880 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efc60009d90 tx=0x7efc6002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57154c3d922ce233 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:39.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.383+0000 7efc677fe640 1 -- 172.21.15.50:0/4203049878 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c001670 con 0x7efc68162a60 2024-09-11T22:16:39.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.383+0000 7efc677fe640 1 -- 172.21.15.50:0/4203049878 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60007540 con 0x7efc68162a60 2024-09-11T22:16:39.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.383+0000 7efc677fe640 1 -- 172.21.15.50:0/4203049878 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60007910 con 0x7efc68162a60 2024-09-11T22:16:39.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.383+0000 7efc6f05c640 1 -- 172.21.15.50:0/4203049878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68162a60 msgr2=0x7efc680b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.383+0000 7efc6f05c640 1 --2- 172.21.15.50:0/4203049878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68162a60 0x7efc680b7880 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efc60009d90 tx=0x7efc6002a710 comp rx=0 tx=0).stop 2024-09-11T22:16:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.383+0000 7efc6f05c640 1 -- 172.21.15.50:0/4203049878 shutdown_connections 2024-09-11T22:16:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.383+0000 7efc6f05c640 1 --2- 172.21.15.50:0/4203049878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68162a60 0x7efc680b7880 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.383+0000 7efc6f05c640 1 -- 172.21.15.50:0/4203049878 >> 172.21.15.50:0/4203049878 conn(0x7efc68067ba0 msgr2=0x7efc68067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.383+0000 7efc6f05c640 1 -- 172.21.15.50:0/4203049878 shutdown_connections 2024-09-11T22:16:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.383+0000 7efc6f05c640 1 -- 172.21.15.50:0/4203049878 wait complete. 2024-09-11T22:16:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.385+0000 7efc6f05c640 1 Processor -- start 2024-09-11T22:16:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.385+0000 7efc6f05c640 1 -- start start 2024-09-11T22:16:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.385+0000 7efc6f05c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc680d1c90 0x7efc68152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.385+0000 7efc6f05c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6815e8e0 0x7efc680b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc6f05c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68162a60 0x7efc680b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc6f05c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efc680d3c10 con 0x7efc6815e8e0 2024-09-11T22:16:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc6f05c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc680d3a90 con 0x7efc68162a60 2024-09-11T22:16:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc6f05c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efc680d3d90 con 0x7efc680d1c90 2024-09-11T22:16:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc67fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6815e8e0 0x7efc680b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc67fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6815e8e0 0x7efc680b5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35082/0 (socket says 172.21.15.50:35082) 2024-09-11T22:16:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc67fff640 1 -- 172.21.15.50:0/1308490070 learned_addr learned my addr 172.21.15.50:0/1308490070 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc6d5f9640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68162a60 0x7efc680b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc6cdf8640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc680d1c90 0x7efc68152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc67fff640 1 -- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc680d1c90 msgr2=0x7efc68152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc67fff640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc680d1c90 0x7efc68152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc67fff640 1 -- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68162a60 msgr2=0x7efc680b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc67fff640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68162a60 0x7efc680b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc67fff640 1 -- 172.21.15.50:0/1308490070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc680b6170 con 0x7efc6815e8e0 2024-09-11T22:16:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc6d5f9640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68162a60 0x7efc680b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:16:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc67fff640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6815e8e0 0x7efc680b5720 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00c5d0 tx=0x7efc5c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc657fa640 1 -- 172.21.15.50:0/1308490070 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c017070 con 0x7efc6815e8e0 2024-09-11T22:16:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc657fa640 1 -- 172.21.15.50:0/1308490070 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5c005ce0 con 0x7efc6815e8e0 2024-09-11T22:16:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc6f05c640 1 -- 172.21.15.50:0/1308490070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc680b6450 con 0x7efc6815e8e0 2024-09-11T22:16:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc657fa640 1 -- 172.21.15.50:0/1308490070 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c0072b0 con 0x7efc6815e8e0 2024-09-11T22:16:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.386+0000 7efc6f05c640 1 -- 172.21.15.50:0/1308490070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc680b6a10 con 0x7efc6815e8e0 2024-09-11T22:16:39.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.388+0000 7efc6f05c640 1 -- 172.21.15.50:0/1308490070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc680b7880 con 0x7efc6815e8e0 2024-09-11T22:16:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.388+0000 7efc657fa640 1 -- 172.21.15.50:0/1308490070 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc5c01a070 con 0x7efc6815e8e0 2024-09-11T22:16:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.389+0000 7efc657fa640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc5406be30 0x7efc5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.389+0000 7efc657fa640 1 -- 172.21.15.50:0/1308490070 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7efc5c08a270 con 0x7efc6815e8e0 2024-09-11T22:16:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.389+0000 7efc6cdf8640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc5406be30 0x7efc5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.389+0000 7efc6cdf8640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc5406be30 0x7efc5406e2f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efc580011e0 tx=0x7efc58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:39.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.393+0000 7efc657fa640 1 -- 172.21.15.50:0/1308490070 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc5c058660 con 0x7efc6815e8e0 2024-09-11T22:16:39.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.604+0000 7efc6f05c640 1 -- 172.21.15.50:0/1308490070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc680b4030 con 0x7efc6815e8e0 2024-09-11T22:16:39.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.604+0000 7efc657fa640 1 -- 172.21.15.50:0/1308490070 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5225 (secure 0 0 0) 0x7efc5c05c960 con 0x7efc6815e8e0 2024-09-11T22:16:39.633 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:16:39.634 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":76,"btime":"2024-09-11T22:16:33:131505+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3921219668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3921219668},{"type":"v1","addr":"172.21.15.50:6835","nonce":3921219668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1123077854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1123077854},{"type":"v1","addr":"172.21.15.77:6837","nonce":1123077854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1576416639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1576416639},{"type":"v1","addr":"172.21.15.77:6836","nonce":1576416639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:16:30.480778+0000","modified":"2024-09-11T22:16:32.476047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7605},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7605":{"gid":7605,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/2355059741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2355059741},{"type":"v1","addr":"172.21.15.50:6834","nonce":2355059741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7605,"qdb_cluster":[7605]},"id":7}]} 2024-09-11T22:16:39.635 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 76 2024-09-11T22:16:39.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.606+0000 7efc6f05c640 1 -- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc5406be30 msgr2=0x7efc5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.606+0000 7efc6f05c640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc5406be30 0x7efc5406e2f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efc580011e0 tx=0x7efc58009040 comp rx=0 tx=0).stop 2024-09-11T22:16:39.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.606+0000 7efc6f05c640 1 -- 172.21.15.50:0/1308490070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6815e8e0 msgr2=0x7efc680b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:39.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.606+0000 7efc6f05c640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6815e8e0 0x7efc680b5720 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00c5d0 tx=0x7efc5c00ca90 comp rx=0 tx=0).stop 2024-09-11T22:16:39.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.606+0000 7efc6f05c640 1 -- 172.21.15.50:0/1308490070 shutdown_connections 2024-09-11T22:16:39.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.606+0000 7efc6f05c640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc5406be30 0x7efc5406e2f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.606+0000 7efc6f05c640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68162a60 0x7efc680b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.606+0000 7efc6f05c640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc6815e8e0 0x7efc680b5720 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.606+0000 7efc6f05c640 1 --2- 172.21.15.50:0/1308490070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc680d1c90 0x7efc68152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:39.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.606+0000 7efc6f05c640 1 -- 172.21.15.50:0/1308490070 >> 172.21.15.50:0/1308490070 conn(0x7efc68067ba0 msgr2=0x7efc680cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:39.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.606+0000 7efc6f05c640 1 -- 172.21.15.50:0/1308490070 shutdown_connections 2024-09-11T22:16:39.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:39.606+0000 7efc6f05c640 1 -- 172.21.15.50:0/1308490070 wait complete. 2024-09-11T22:16:40.039 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:16:30.480778+0000', 'modified': '2024-09-11T22:16:32.476047+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7605}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7605': {'gid': 7605, 'name': 'c', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6834/2355059741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 2355059741}, {'type': 'v1', 'addr': '172.21.15.50:6834', 'nonce': 2355059741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7605, 'qdb_cluster': [7605]} 2024-09-11T22:16:40.039 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:16:40.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T22:16:40.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.148+0000 7ff14c87b640 1 Processor -- start 2024-09-11T22:16:40.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.148+0000 7ff14c87b640 1 -- start start 2024-09-11T22:16:40.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff14c87b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff14815fd80 0x7ff1480b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff14c87b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1480af4c0 0x7ff1480b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff14c87b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1480b2970 0x7ff1480d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff14c87b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff1480af940 con 0x7ff1480af4c0 2024-09-11T22:16:40.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff14c87b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff1480afc20 con 0x7ff14815fd80 2024-09-11T22:16:40.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff14c87b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1480aff00 con 0x7ff1480b2970 2024-09-11T22:16:40.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff145d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1480af4c0 0x7ff1480b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff145d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1480af4c0 0x7ff1480b2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35090/0 (socket says 172.21.15.50:35090) 2024-09-11T22:16:40.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff145d9b640 1 -- 172.21.15.50:0/3287364105 learned_addr learned my addr 172.21.15.50:0/3287364105 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:40.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff146d9d640 1 --2- 172.21.15.50:0/3287364105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1480b2970 0x7ff1480d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff145d9b640 1 -- 172.21.15.50:0/3287364105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1480b2970 msgr2=0x7ff1480d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:40.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff14659c640 1 --2- 172.21.15.50:0/3287364105 >> v2:172.21.15.77:3300/0 conn(0x7ff14815fd80 0x7ff1480b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff145d9b640 1 --2- 172.21.15.50:0/3287364105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1480b2970 0x7ff1480d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff145d9b640 1 -- 172.21.15.50:0/3287364105 >> v2:172.21.15.77:3300/0 conn(0x7ff14815fd80 msgr2=0x7ff1480b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:40.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff145d9b640 1 --2- 172.21.15.50:0/3287364105 >> v2:172.21.15.77:3300/0 conn(0x7ff14815fd80 0x7ff1480b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff145d9b640 1 -- 172.21.15.50:0/3287364105 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1480b01e0 con 0x7ff1480af4c0 2024-09-11T22:16:40.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff146d9d640 1 --2- 172.21.15.50:0/3287364105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1480b2970 0x7ff1480d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:40.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.149+0000 7ff14659c640 1 --2- 172.21.15.50:0/3287364105 >> v2:172.21.15.77:3300/0 conn(0x7ff14815fd80 0x7ff1480b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:40.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.150+0000 7ff145d9b640 1 --2- 172.21.15.50:0/3287364105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1480af4c0 0x7ff1480b2430 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff14806f0a0 tx=0x7ff13c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a70fad8d520c73 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:40.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.150+0000 7ff14559a640 1 -- 172.21.15.50:0/3287364105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c037070 con 0x7ff1480af4c0 2024-09-11T22:16:40.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.150+0000 7ff14559a640 1 -- 172.21.15.50:0/3287364105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13c032440 con 0x7ff1480af4c0 2024-09-11T22:16:40.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.150+0000 7ff14559a640 1 -- 172.21.15.50:0/3287364105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c032810 con 0x7ff1480af4c0 2024-09-11T22:16:40.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.151+0000 7ff14c87b640 1 -- 172.21.15.50:0/3287364105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1480af4c0 msgr2=0x7ff1480b2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.151+0000 7ff14c87b640 1 --2- 172.21.15.50:0/3287364105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1480af4c0 0x7ff1480b2430 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff14806f0a0 tx=0x7ff13c02a140 comp rx=0 tx=0).stop 2024-09-11T22:16:40.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.151+0000 7ff14c87b640 1 -- 172.21.15.50:0/3287364105 shutdown_connections 2024-09-11T22:16:40.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.151+0000 7ff14c87b640 1 --2- 172.21.15.50:0/3287364105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1480b2970 0x7ff1480d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.151+0000 7ff14c87b640 1 --2- 172.21.15.50:0/3287364105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1480af4c0 0x7ff1480b2430 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.151+0000 7ff14c87b640 1 --2- 172.21.15.50:0/3287364105 >> v2:172.21.15.77:3300/0 conn(0x7ff14815fd80 0x7ff1480b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.151+0000 7ff14c87b640 1 -- 172.21.15.50:0/3287364105 >> 172.21.15.50:0/3287364105 conn(0x7ff14809ba50 msgr2=0x7ff1480b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:40.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.151+0000 7ff14c87b640 1 -- 172.21.15.50:0/3287364105 shutdown_connections 2024-09-11T22:16:40.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.151+0000 7ff14c87b640 1 -- 172.21.15.50:0/3287364105 wait complete. 2024-09-11T22:16:40.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.152+0000 7ff14c87b640 1 Processor -- start 2024-09-11T22:16:40.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.152+0000 7ff14c87b640 1 -- start start 2024-09-11T22:16:40.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.153+0000 7ff14c87b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1480af4c0 0x7ff148153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.153+0000 7ff14c87b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1480b2970 0x7ff148153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.153+0000 7ff14c87b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14815fd80 0x7ff14809d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.153+0000 7ff14c87b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff148160160 con 0x7ff14815fd80 2024-09-11T22:16:40.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.153+0000 7ff14c87b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1480b3ee0 con 0x7ff1480af4c0 2024-09-11T22:16:40.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.153+0000 7ff14c87b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1481602e0 con 0x7ff1480b2970 2024-09-11T22:16:40.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.153+0000 7ff146d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14815fd80 0x7ff14809d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.153+0000 7ff146d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14815fd80 0x7ff14809d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35102/0 (socket says 172.21.15.50:35102) 2024-09-11T22:16:40.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.153+0000 7ff146d9d640 1 -- 172.21.15.50:0/138517823 learned_addr learned my addr 172.21.15.50:0/138517823 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:40.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.153+0000 7ff14659c640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1480af4c0 0x7ff148153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.153+0000 7ff145d9b640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1480b2970 0x7ff148153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.154+0000 7ff146d9d640 1 -- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1480b2970 msgr2=0x7ff148153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.154+0000 7ff146d9d640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1480b2970 0x7ff148153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.154+0000 7ff146d9d640 1 -- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1480af4c0 msgr2=0x7ff148153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.154+0000 7ff146d9d640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1480af4c0 0x7ff148153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.154+0000 7ff146d9d640 1 -- 172.21.15.50:0/138517823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1480cdc10 con 0x7ff14815fd80 2024-09-11T22:16:40.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.154+0000 7ff146d9d640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14815fd80 0x7ff14809d250 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff14000cd10 tx=0x7ff14000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:40.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.154+0000 7ff136ffd640 1 -- 172.21.15.50:0/138517823 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14000f680 con 0x7ff14815fd80 2024-09-11T22:16:40.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.154+0000 7ff136ffd640 1 -- 172.21.15.50:0/138517823 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff14000f840 con 0x7ff14815fd80 2024-09-11T22:16:40.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.154+0000 7ff136ffd640 1 -- 172.21.15.50:0/138517823 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14000fc30 con 0x7ff14815fd80 2024-09-11T22:16:40.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.154+0000 7ff14c87b640 1 -- 172.21.15.50:0/138517823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1480cdef0 con 0x7ff14815fd80 2024-09-11T22:16:40.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.154+0000 7ff14c87b640 1 -- 172.21.15.50:0/138517823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1480ce4b0 con 0x7ff14815fd80 2024-09-11T22:16:40.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.155+0000 7ff136ffd640 1 -- 172.21.15.50:0/138517823 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1400213f0 con 0x7ff14815fd80 2024-09-11T22:16:40.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.156+0000 7ff136ffd640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff12806be60 0x7ff12806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.156+0000 7ff136ffd640 1 -- 172.21.15.50:0/138517823 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7ff14008b9f0 con 0x7ff14815fd80 2024-09-11T22:16:40.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.156+0000 7ff14659c640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff12806be60 0x7ff12806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.157+0000 7ff14659c640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff12806be60 0x7ff12806e320 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff13800aac0 tx=0x7ff138008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:40.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.157+0000 7ff14f61c740 1 Processor -- start 2024-09-11T22:16:40.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.157+0000 7ff14f61c740 1 -- start start 2024-09-11T22:16:40.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14f61c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 0x5571ed523a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14f61c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4dba80 0x5571ed4de6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14f61c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 0x5571ed4d88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14f61c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5571ed440520 con 0x5571ed4de2c0 2024-09-11T22:16:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14f61c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5571ed3e83e0 con 0x5571ed4dfa50 2024-09-11T22:16:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14f61c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5571ed43c4e0 con 0x5571ed4dba80 2024-09-11T22:16:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 0x5571ed523a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 0x5571ed523a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35114/0 (socket says 172.21.15.50:35114) 2024-09-11T22:16:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff145d9b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4dba80 0x5571ed4de6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14659c640 1 -- 172.21.15.50:0/4218626983 learned_addr learned my addr 172.21.15.50:0/4218626983 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff146d9d640 1 --2- 172.21.15.50:0/4218626983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 0x5571ed4d88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14659c640 1 -- 172.21.15.50:0/4218626983 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4dba80 msgr2=0x5571ed4de6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14659c640 1 --2- 172.21.15.50:0/4218626983 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4dba80 0x5571ed4de6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14659c640 1 -- 172.21.15.50:0/4218626983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 msgr2=0x5571ed4d88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14659c640 1 --2- 172.21.15.50:0/4218626983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 0x5571ed4d88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.158+0000 7ff14659c640 1 -- 172.21.15.50:0/4218626983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ed4032f0 con 0x5571ed4de2c0 2024-09-11T22:16:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.159+0000 7ff14659c640 1 --2- 172.21.15.50:0/4218626983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 0x5571ed523a60 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff13800fd80 tx=0x7ff138012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5736890621a537 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.159+0000 7ff127fff640 1 -- 172.21.15.50:0/4218626983 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff138023070 con 0x5571ed4de2c0 2024-09-11T22:16:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.159+0000 7ff127fff640 1 -- 172.21.15.50:0/4218626983 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff138019070 con 0x5571ed4de2c0 2024-09-11T22:16:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.159+0000 7ff127fff640 1 -- 172.21.15.50:0/4218626983 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff138013820 con 0x5571ed4de2c0 2024-09-11T22:16:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.159+0000 7ff14f61c740 1 -- 172.21.15.50:0/4218626983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 msgr2=0x5571ed523a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.159+0000 7ff14f61c740 1 --2- 172.21.15.50:0/4218626983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 0x5571ed523a60 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff13800fd80 tx=0x7ff138012000 comp rx=0 tx=0).stop 2024-09-11T22:16:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.159+0000 7ff14f61c740 1 -- 172.21.15.50:0/4218626983 shutdown_connections 2024-09-11T22:16:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.159+0000 7ff14f61c740 1 --2- 172.21.15.50:0/4218626983 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4dba80 0x5571ed4de6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.159+0000 7ff14f61c740 1 --2- 172.21.15.50:0/4218626983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 0x5571ed4d88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.159+0000 7ff14f61c740 1 --2- 172.21.15.50:0/4218626983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 0x5571ed523a60 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.159+0000 7ff14f61c740 1 -- 172.21.15.50:0/4218626983 >> 172.21.15.50:0/4218626983 conn(0x5571ed4daa80 msgr2=0x5571ed522f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:40.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.160+0000 7ff14f61c740 1 -- 172.21.15.50:0/4218626983 shutdown_connections 2024-09-11T22:16:40.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.160+0000 7ff14f61c740 1 -- 172.21.15.50:0/4218626983 wait complete. 2024-09-11T22:16:40.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.160+0000 7ff14f61c740 1 -- start start 2024-09-11T22:16:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.160+0000 7ff14f61c740 1 Processor -- start 2024-09-11T22:16:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.161+0000 7ff14f61c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4de2c0 0x5571ed520640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.161+0000 7ff14f61c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 0x5571ed4ee790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.161+0000 7ff14f61c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4eecd0 0x5571ed4ef150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.161+0000 7ff14f61c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5571ed4d9f20 con 0x5571ed4eecd0 2024-09-11T22:16:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.161+0000 7ff14f61c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5571ed3c9450 con 0x5571ed4dfa50 2024-09-11T22:16:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.161+0000 7ff14f61c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5571ed524290 con 0x5571ed4de2c0 2024-09-11T22:16:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.161+0000 7ff14f61c740 10 client.0 _ll_register_callbacks cb 0x5571ed152ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.161+0000 7ff146d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4eecd0 0x5571ed4ef150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.161+0000 7ff146d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4eecd0 0x5571ed4ef150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35118/0 (socket says 172.21.15.50:35118) 2024-09-11T22:16:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.161+0000 7ff146d9d640 1 -- 172.21.15.50:0/283256217 learned_addr learned my addr 172.21.15.50:0/283256217 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.161+0000 7ff14659c640 1 --2- 172.21.15.50:0/283256217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4de2c0 0x5571ed520640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.161+0000 7ff145d9b640 1 --2- 172.21.15.50:0/283256217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 0x5571ed4ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff146d9d640 1 -- 172.21.15.50:0/283256217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4de2c0 msgr2=0x5571ed520640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff146d9d640 1 --2- 172.21.15.50:0/283256217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4de2c0 0x5571ed520640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff146d9d640 1 -- 172.21.15.50:0/283256217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 msgr2=0x5571ed4ee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff146d9d640 1 --2- 172.21.15.50:0/283256217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 0x5571ed4ee790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff146d9d640 1 -- 172.21.15.50:0/283256217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ed1532d0 con 0x5571ed4eecd0 2024-09-11T22:16:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff146d9d640 1 --2- 172.21.15.50:0/283256217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4eecd0 0x5571ed4ef150 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff14000ab50 tx=0x7ff140059f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0c2377e5a90929 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff1257fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:16:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff1257fa640 1 -- 172.21.15.50:0/283256217 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140087020 con 0x5571ed4eecd0 2024-09-11T22:16:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff1257fa640 1 -- 172.21.15.50:0/283256217 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7ff140062480 con 0x5571ed4eecd0 2024-09-11T22:16:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff14f61c740 1 -- 172.21.15.50:0/283256217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff138019070 con 0x5571ed4eecd0 2024-09-11T22:16:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff1257fa640 1 -- 172.21.15.50:0/283256217 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7ff140062680 con 0x5571ed4eecd0 2024-09-11T22:16:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff14f61c740 10 client.7746 fetch_fsmap learned FSMap version 76 2024-09-11T22:16:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff14f61c740 1 -- 172.21.15.50:0/283256217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x5571ed21d6b0 con 0x5571ed4eecd0 2024-09-11T22:16:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff1257fa640 1 -- 172.21.15.50:0/283256217 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff138019070 con 0x5571ed4eecd0 2024-09-11T22:16:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff1257fa640 1 -- 172.21.15.50:0/283256217 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7ff140059230 con 0x5571ed4eecd0 2024-09-11T22:16:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff14f61c740 10 client.7746 fetch_fsmap finished waiting for FSMap version 76 2024-09-11T22:16:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff14f61c740 10 client.7746 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:16:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.162+0000 7ff14f61c740 20 client.7746 populate_metadata read hostname 'smithi050' 2024-09-11T22:16:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.163+0000 7ff14f61c740 1 --2- 172.21.15.50:0/283256217 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5571ed536f30 0x5571ed537310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.163+0000 7ff14f61c740 4 client.7746 mds_command: new command op to 7605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:16:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.163+0000 7ff14f61c740 1 -- 172.21.15.50:0/283256217 --> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571ed44dc50 con 0x5571ed536f30 2024-09-11T22:16:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.163+0000 7ff14659c640 1 --2- 172.21.15.50:0/283256217 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5571ed536f30 0x5571ed537310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.163+0000 7ff1257fa640 10 client.7746 ms_handle_connect on v2:172.21.15.50:6832/2355059741 2024-09-11T22:16:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.163+0000 7ff14659c640 1 --2- 172.21.15.50:0/283256217 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5571ed536f30 0x5571ed537310 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca1ecfb4b134c77d server_cookie=1565ba48bdbb8bb4 in_seq=0 out_seq=0 2024-09-11T22:16:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff1257fa640 1 -- 172.21.15.50:0/283256217 <== mds.0 v2:172.21.15.50:6832/2355059741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571ed44dc50 con 0x5571ed536f30 2024-09-11T22:16:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff1257fa640 10 client.7746 handle_command_reply: tid=0 2024-09-11T22:16:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff14f61c740 1 client.7746 shutdown 2024-09-11T22:16:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff14f61c740 1 -- 172.21.15.50:0/283256217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4eecd0 msgr2=0x5571ed4ef150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff14f61c740 1 --2- 172.21.15.50:0/283256217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4eecd0 0x5571ed4ef150 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff14000ab50 tx=0x7ff140059f10 comp rx=0 tx=0).stop 2024-09-11T22:16:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff14f61c740 1 -- 172.21.15.50:0/283256217 shutdown_connections 2024-09-11T22:16:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff14f61c740 1 --2- 172.21.15.50:0/283256217 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5571ed536f30 0x5571ed537310 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff14f61c740 1 --2- 172.21.15.50:0/283256217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4eecd0 0x5571ed4ef150 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff14f61c740 1 --2- 172.21.15.50:0/283256217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 0x5571ed4ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff14f61c740 1 --2- 172.21.15.50:0/283256217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4de2c0 0x5571ed520640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff1257fa640 0 client.7746 ms_handle_reset on v2:172.21.15.50:6832/2355059741 2024-09-11T22:16:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff14f61c740 1 -- 172.21.15.50:0/283256217 >> 172.21.15.50:0/283256217 conn(0x5571ed4dba80 msgr2=0x5571ed502e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff14f61c740 1 -- 172.21.15.50:0/283256217 shutdown_connections 2024-09-11T22:16:40.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff14f61c740 1 -- 172.21.15.50:0/283256217 wait complete. 2024-09-11T22:16:40.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.164+0000 7ff14f61c740 20 client.7746 trim_cache size 0 max 16384 2024-09-11T22:16:40.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.182+0000 7ff14f61c740 1 Processor -- start 2024-09-11T22:16:40.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.182+0000 7ff14f61c740 1 -- start start 2024-09-11T22:16:40.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14f61c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 0x5571ed547a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14f61c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 0x5571ed520ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14f61c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4eecd0 0x5571ed521420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14f61c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1481fda00 con 0x5571ed4de2c0 2024-09-11T22:16:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14f61c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1481fcd90 con 0x5571ed4dfa50 2024-09-11T22:16:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14f61c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1481fd3b0 con 0x5571ed4eecd0 2024-09-11T22:16:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 0x5571ed547a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 0x5571ed547a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35120/0 (socket says 172.21.15.50:35120) 2024-09-11T22:16:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14659c640 1 -- 172.21.15.50:0/3337142407 learned_addr learned my addr 172.21.15.50:0/3337142407 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff145d9b640 1 --2- 172.21.15.50:0/3337142407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 0x5571ed520ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff146d9d640 1 --2- 172.21.15.50:0/3337142407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4eecd0 0x5571ed521420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14659c640 1 -- 172.21.15.50:0/3337142407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4eecd0 msgr2=0x5571ed521420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14659c640 1 --2- 172.21.15.50:0/3337142407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4eecd0 0x5571ed521420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14659c640 1 -- 172.21.15.50:0/3337142407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 msgr2=0x5571ed520ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14659c640 1 --2- 172.21.15.50:0/3337142407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 0x5571ed520ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14659c640 1 -- 172.21.15.50:0/3337142407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ed524390 con 0x5571ed4de2c0 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff145d9b640 1 --2- 172.21.15.50:0/3337142407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 0x5571ed520ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff14659c640 1 --2- 172.21.15.50:0/3337142407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 0x5571ed547a10 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ff13800a8a0 tx=0x7ff138014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b990d0413e7082f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff1277fe640 1 -- 172.21.15.50:0/3337142407 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff138023040 con 0x5571ed4de2c0 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.183+0000 7ff1277fe640 1 -- 172.21.15.50:0/3337142407 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff138019040 con 0x5571ed4de2c0 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.184+0000 7ff1277fe640 1 -- 172.21.15.50:0/3337142407 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1380288e0 con 0x5571ed4de2c0 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.184+0000 7ff14f61c740 1 -- 172.21.15.50:0/3337142407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 msgr2=0x5571ed547a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.184+0000 7ff14f61c740 1 --2- 172.21.15.50:0/3337142407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 0x5571ed547a10 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ff13800a8a0 tx=0x7ff138014000 comp rx=0 tx=0).stop 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.184+0000 7ff14f61c740 1 -- 172.21.15.50:0/3337142407 shutdown_connections 2024-09-11T22:16:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.184+0000 7ff14f61c740 1 --2- 172.21.15.50:0/3337142407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4eecd0 0x5571ed521420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.184+0000 7ff14f61c740 1 --2- 172.21.15.50:0/3337142407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4dfa50 0x5571ed520ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.184+0000 7ff14f61c740 1 --2- 172.21.15.50:0/3337142407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4de2c0 0x5571ed547a10 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.184+0000 7ff14f61c740 1 -- 172.21.15.50:0/3337142407 >> 172.21.15.50:0/3337142407 conn(0x5571ed4dba80 msgr2=0x5571ed4fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.184+0000 7ff14f61c740 1 -- 172.21.15.50:0/3337142407 shutdown_connections 2024-09-11T22:16:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.184+0000 7ff14f61c740 1 -- 172.21.15.50:0/3337142407 wait complete. 2024-09-11T22:16:40.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.185+0000 7ff14f61c740 1 -- start start 2024-09-11T22:16:40.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.185+0000 7ff14f61c740 1 Processor -- start 2024-09-11T22:16:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff14f61c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4de2c0 0x5571ed520870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff14f61c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4dfa50 0x5571ed4fe600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff14f61c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4eecd0 0x5571ed5885a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff14f61c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5571ed4f2a40 con 0x5571ed4dfa50 2024-09-11T22:16:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff14f61c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5571ed5004b0 con 0x5571ed4de2c0 2024-09-11T22:16:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff14f61c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5571ed4d7d70 con 0x5571ed4eecd0 2024-09-11T22:16:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff14f61c740 10 client.0 _ll_register_callbacks cb 0x7ff14000cc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:16:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff145d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4dfa50 0x5571ed4fe600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff145d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4dfa50 0x5571ed4fe600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35126/0 (socket says 172.21.15.50:35126) 2024-09-11T22:16:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff145d9b640 1 -- 172.21.15.50:0/1303739762 learned_addr learned my addr 172.21.15.50:0/1303739762 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff14659c640 1 --2- 172.21.15.50:0/1303739762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4de2c0 0x5571ed520870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff146d9d640 1 --2- 172.21.15.50:0/1303739762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4eecd0 0x5571ed5885a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff145d9b640 1 -- 172.21.15.50:0/1303739762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4eecd0 msgr2=0x5571ed5885a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff145d9b640 1 --2- 172.21.15.50:0/1303739762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4eecd0 0x5571ed5885a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff145d9b640 1 -- 172.21.15.50:0/1303739762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4de2c0 msgr2=0x5571ed520870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff145d9b640 1 --2- 172.21.15.50:0/1303739762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4de2c0 0x5571ed520870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff145d9b640 1 -- 172.21.15.50:0/1303739762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ed588ae0 con 0x5571ed4dfa50 2024-09-11T22:16:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff145d9b640 1 --2- 172.21.15.50:0/1303739762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4dfa50 0x5571ed4fe600 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0090b0 tx=0x7ff13c02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a38099ba126e0f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff1257fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:16:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff1257fa640 1 -- 172.21.15.50:0/1303739762 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c04b060 con 0x5571ed4dfa50 2024-09-11T22:16:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff1257fa640 1 -- 172.21.15.50:0/1303739762 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7ff13c046420 con 0x5571ed4dfa50 2024-09-11T22:16:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.186+0000 7ff14f61c740 1 -- 172.21.15.50:0/1303739762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff138019040 con 0x5571ed4dfa50 2024-09-11T22:16:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff1257fa640 1 -- 172.21.15.50:0/1303739762 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7ff13c051050 con 0x5571ed4dfa50 2024-09-11T22:16:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff14f61c740 10 client.7752 fetch_fsmap learned FSMap version 76 2024-09-11T22:16:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff14f61c740 1 -- 172.21.15.50:0/1303739762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x5571ed58b480 con 0x5571ed4dfa50 2024-09-11T22:16:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff1257fa640 1 -- 172.21.15.50:0/1303739762 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff138019040 con 0x5571ed4dfa50 2024-09-11T22:16:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff1257fa640 1 -- 172.21.15.50:0/1303739762 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7ff13c054020 con 0x5571ed4dfa50 2024-09-11T22:16:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff14f61c740 10 client.7752 fetch_fsmap finished waiting for FSMap version 76 2024-09-11T22:16:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff14f61c740 10 client.7752 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:16:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff14f61c740 20 client.7752 populate_metadata read hostname 'smithi050' 2024-09-11T22:16:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff14f61c740 1 --2- 172.21.15.50:0/1303739762 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5571ed5048b0 0x5571ed4dc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff14f61c740 4 client.7752 mds_command: new command op to 7605 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:16:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff14f61c740 1 -- 172.21.15.50:0/1303739762 --> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] -- command(tid 0: {"prefix": "status"}) -- 0x5571ed447fa0 con 0x5571ed5048b0 2024-09-11T22:16:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff14659c640 1 --2- 172.21.15.50:0/1303739762 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5571ed5048b0 0x5571ed4dc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff1257fa640 10 client.7752 ms_handle_connect on v2:172.21.15.50:6832/2355059741 2024-09-11T22:16:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.187+0000 7ff14659c640 1 --2- 172.21.15.50:0/1303739762 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5571ed5048b0 0x5571ed4dc7a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a25edf0f7bb8453 server_cookie=719ca59c000934e in_seq=0 out_seq=0 2024-09-11T22:16:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff1257fa640 1 -- 172.21.15.50:0/1303739762 <== mds.0 v2:172.21.15.50:6832/2355059741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5571ed447fa0 con 0x5571ed5048b0 2024-09-11T22:16:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff1257fa640 10 client.7752 handle_command_reply: tid=0 2024-09-11T22:16:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14f61c740 1 client.7752 shutdown 2024-09-11T22:16:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14f61c740 1 -- 172.21.15.50:0/1303739762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4dfa50 msgr2=0x5571ed4fe600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14f61c740 1 --2- 172.21.15.50:0/1303739762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4dfa50 0x5571ed4fe600 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0090b0 tx=0x7ff13c02c070 comp rx=0 tx=0).stop 2024-09-11T22:16:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14f61c740 1 -- 172.21.15.50:0/1303739762 shutdown_connections 2024-09-11T22:16:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14f61c740 1 --2- 172.21.15.50:0/1303739762 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5571ed5048b0 0x5571ed4dc7a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14f61c740 1 --2- 172.21.15.50:0/1303739762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5571ed4eecd0 0x5571ed5885a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14f61c740 1 --2- 172.21.15.50:0/1303739762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ed4dfa50 0x5571ed4fe600 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14f61c740 1 --2- 172.21.15.50:0/1303739762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5571ed4de2c0 0x5571ed520870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff1257fa640 0 client.7752 ms_handle_reset on v2:172.21.15.50:6832/2355059741 2024-09-11T22:16:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14f61c740 1 -- 172.21.15.50:0/1303739762 >> 172.21.15.50:0/1303739762 conn(0x5571ed4dba80 msgr2=0x5571ed53d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14f61c740 1 -- 172.21.15.50:0/1303739762 shutdown_connections 2024-09-11T22:16:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14f61c740 1 -- 172.21.15.50:0/1303739762 wait complete. 2024-09-11T22:16:40.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14f61c740 20 client.7752 trim_cache size 0 max 16384 2024-09-11T22:16:40.198 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:16:40.198 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:16:40.198 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:16:40.198 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 7605, 2024-09-11T22:16:40.198 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:16:40.199 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:16:40.199 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:16:40.199 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 9.0680083370000002, 2024-09-11T22:16:40.199 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 76, 2024-09-11T22:16:40.199 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 107, 2024-09-11T22:16:40.199 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 107, 2024-09-11T22:16:40.199 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 14.105010779000001 2024-09-11T22:16:40.199 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:16:40.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14c87b640 1 -- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff12806be60 msgr2=0x7ff12806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14c87b640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff12806be60 0x7ff12806e320 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff13800aac0 tx=0x7ff138008040 comp rx=0 tx=0).stop 2024-09-11T22:16:40.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14c87b640 1 -- 172.21.15.50:0/138517823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14815fd80 msgr2=0x7ff14809d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14c87b640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14815fd80 0x7ff14809d250 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff14000cd10 tx=0x7ff14000a650 comp rx=0 tx=0).stop 2024-09-11T22:16:40.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14c87b640 1 -- 172.21.15.50:0/138517823 shutdown_connections 2024-09-11T22:16:40.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14c87b640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff12806be60 0x7ff12806e320 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14c87b640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1480b2970 0x7ff148153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14c87b640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14815fd80 0x7ff14809d250 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14c87b640 1 --2- 172.21.15.50:0/138517823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1480af4c0 0x7ff148153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.188+0000 7ff14c87b640 1 -- 172.21.15.50:0/138517823 >> 172.21.15.50:0/138517823 conn(0x7ff14809ba50 msgr2=0x7ff14806f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:40.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.189+0000 7ff14c87b640 1 -- 172.21.15.50:0/138517823 shutdown_connections 2024-09-11T22:16:40.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.189+0000 7ff14c87b640 1 -- 172.21.15.50:0/138517823 wait complete. 2024-09-11T22:16:40.202 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:16:40.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.303+0000 7f6674f68640 1 Processor -- start 2024-09-11T22:16:40.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.303+0000 7f6674f68640 1 -- start start 2024-09-11T22:16:40.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.304+0000 7f6674f68640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f667015c2c0 0x7f66700b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.304+0000 7f6674f68640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f66700b3e10 0x7f66700cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.304+0000 7f6674f68640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66700b4f00 con 0x7f66700d0410 2024-09-11T22:16:40.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.304+0000 7f6674f68640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f66700cf7a0 con 0x7f66700b3e10 2024-09-11T22:16:40.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.304+0000 7f6674f68640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f66700d0840 con 0x7f667015c2c0 2024-09-11T22:16:40.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.304+0000 7f666dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f66700b3e10 0x7f66700cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.304+0000 7f666dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f66700b3e10 0x7f66700cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35132/0 (socket says 172.21.15.50:35132) 2024-09-11T22:16:40.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.304+0000 7f666dd9b640 1 -- 172.21.15.50:0/3564791684 learned_addr learned my addr 172.21.15.50:0/3564791684 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:40.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.304+0000 7f666e59c640 1 --2- 172.21.15.50:0/3564791684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f667015c2c0 0x7f66700b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.304+0000 7f666dd9b640 1 -- 172.21.15.50:0/3564791684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f667015c2c0 msgr2=0x7f66700b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:40.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.304+0000 7f666dd9b640 1 --2- 172.21.15.50:0/3564791684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f667015c2c0 0x7f66700b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.304+0000 7f666dd9b640 1 -- 172.21.15.50:0/3564791684 >> v1:172.21.15.77:6789/0 conn(0x7f66700d0410 legacy=0x7f667015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:40.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.305+0000 7f666dd9b640 1 -- 172.21.15.50:0/3564791684 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66700b4360 con 0x7f66700b3e10 2024-09-11T22:16:40.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.305+0000 7f666dd9b640 1 --2- 172.21.15.50:0/3564791684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66700b3e10 0x7f66700cfed0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f6658009870 tx=0x7f665802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebe600e4e2f90e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:40.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.305+0000 7f666d59a640 1 -- 172.21.15.50:0/3564791684 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658037070 con 0x7f66700b3e10 2024-09-11T22:16:40.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.305+0000 7f666d59a640 1 -- 172.21.15.50:0/3564791684 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6658032440 con 0x7f66700b3e10 2024-09-11T22:16:40.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.305+0000 7f666d59a640 1 -- 172.21.15.50:0/3564791684 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658032810 con 0x7f66700b3e10 2024-09-11T22:16:40.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.306+0000 7f6674f68640 1 -- 172.21.15.50:0/3564791684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66700b3e10 msgr2=0x7f66700cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.306+0000 7f6674f68640 1 --2- 172.21.15.50:0/3564791684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66700b3e10 0x7f66700cfed0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f6658009870 tx=0x7f665802a1c0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.306+0000 7f6674f68640 1 -- 172.21.15.50:0/3564791684 shutdown_connections 2024-09-11T22:16:40.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.306+0000 7f6674f68640 1 --2- 172.21.15.50:0/3564791684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66700b3e10 0x7f66700cfed0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.306+0000 7f6674f68640 1 --2- 172.21.15.50:0/3564791684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f667015c2c0 0x7f66700b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.306+0000 7f6674f68640 1 -- 172.21.15.50:0/3564791684 >> 172.21.15.50:0/3564791684 conn(0x7f66700679c0 msgr2=0x7f6670067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:40.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.306+0000 7f6674f68640 1 -- 172.21.15.50:0/3564791684 shutdown_connections 2024-09-11T22:16:40.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.306+0000 7f6674f68640 1 -- 172.21.15.50:0/3564791684 wait complete. 2024-09-11T22:16:40.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.307+0000 7f6674f68640 1 Processor -- start 2024-09-11T22:16:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.307+0000 7f6674f68640 1 -- start start 2024-09-11T22:16:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.308+0000 7f6674f68640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66700b3e10 0x7f66700b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.308+0000 7f6674f68640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66700d0410 0x7f6670140020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.308+0000 7f6674f68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667015c2c0 0x7f667014b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.308+0000 7f6674f68640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f66700cfc10 con 0x7f667015c2c0 2024-09-11T22:16:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.308+0000 7f6674f68640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f66700b54a0 con 0x7f66700b3e10 2024-09-11T22:16:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.308+0000 7f6674f68640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f66700ce200 con 0x7f66700d0410 2024-09-11T22:16:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.308+0000 7f666ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667015c2c0 0x7f667014b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.308+0000 7f666ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667015c2c0 0x7f667014b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35140/0 (socket says 172.21.15.50:35140) 2024-09-11T22:16:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.308+0000 7f666ed9d640 1 -- 172.21.15.50:0/3098917597 learned_addr learned my addr 172.21.15.50:0/3098917597 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:40.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.308+0000 7f666dd9b640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66700d0410 0x7f6670140020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.308+0000 7f666e59c640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66700b3e10 0x7f66700b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.309+0000 7f666ed9d640 1 -- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66700d0410 msgr2=0x7f6670140020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.309+0000 7f666ed9d640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66700d0410 0x7f6670140020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.309+0000 7f666ed9d640 1 -- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66700b3e10 msgr2=0x7f66700b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.309+0000 7f666ed9d640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66700b3e10 0x7f66700b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.309+0000 7f666ed9d640 1 -- 172.21.15.50:0/3098917597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667014a060 con 0x7f667015c2c0 2024-09-11T22:16:40.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.309+0000 7f666ed9d640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667015c2c0 0x7f667014b100 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f666800c3c0 tx=0x7f666800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:40.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.309+0000 7f6666ffd640 1 -- 172.21.15.50:0/3098917597 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66680052d0 con 0x7f667015c2c0 2024-09-11T22:16:40.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.309+0000 7f6666ffd640 1 -- 172.21.15.50:0/3098917597 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6668005490 con 0x7f667015c2c0 2024-09-11T22:16:40.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.309+0000 7f6666ffd640 1 -- 172.21.15.50:0/3098917597 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6668007260 con 0x7f667015c2c0 2024-09-11T22:16:40.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.309+0000 7f6674f68640 1 -- 172.21.15.50:0/3098917597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f667014a340 con 0x7f667015c2c0 2024-09-11T22:16:40.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.309+0000 7f6674f68640 1 -- 172.21.15.50:0/3098917597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f667014a900 con 0x7f667015c2c0 2024-09-11T22:16:40.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.310+0000 7f6674f68640 1 -- 172.21.15.50:0/3098917597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66700682d0 con 0x7f667015c2c0 2024-09-11T22:16:40.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.310+0000 7f6666ffd640 1 -- 172.21.15.50:0/3098917597 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6668007400 con 0x7f667015c2c0 2024-09-11T22:16:40.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.311+0000 7f6666ffd640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f665006be30 0x7f665006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:40.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.311+0000 7f6666ffd640 1 -- 172.21.15.50:0/3098917597 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f666808a280 con 0x7f667015c2c0 2024-09-11T22:16:40.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.311+0000 7f666e59c640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f665006be30 0x7f665006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:40.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.312+0000 7f666e59c640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f665006be30 0x7f665006e2f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6660003b80 tx=0x7f66600098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:40.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.315+0000 7f6666ffd640 1 -- 172.21.15.50:0/3098917597 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66700682d0 con 0x7f667015c2c0 2024-09-11T22:16:40.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.529+0000 7f6674f68640 1 -- 172.21.15.50:0/3098917597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f667006ef00 con 0x7f667015c2c0 2024-09-11T22:16:40.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.529+0000 7f6666ffd640 1 -- 172.21.15.50:0/3098917597 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) ==== 53+0+73 (secure 0 0 0) 0x7f66680585e0 con 0x7f667015c2c0 2024-09-11T22:16:40.530 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:16:40.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.531+0000 7f6674f68640 1 -- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f665006be30 msgr2=0x7f665006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.531+0000 7f6674f68640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f665006be30 0x7f665006e2f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6660003b80 tx=0x7f66600098d0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.531+0000 7f6674f68640 1 -- 172.21.15.50:0/3098917597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667015c2c0 msgr2=0x7f667014b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:40.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.531+0000 7f6674f68640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667015c2c0 0x7f667014b100 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f666800c3c0 tx=0x7f666800c880 comp rx=0 tx=0).stop 2024-09-11T22:16:40.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.531+0000 7f6674f68640 1 -- 172.21.15.50:0/3098917597 shutdown_connections 2024-09-11T22:16:40.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.531+0000 7f6674f68640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f665006be30 0x7f665006e2f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.531+0000 7f6674f68640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66700d0410 0x7f6670140020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.531+0000 7f6674f68640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f667015c2c0 0x7f667014b100 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.531+0000 7f6674f68640 1 --2- 172.21.15.50:0/3098917597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66700b3e10 0x7f66700b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.531+0000 7f6674f68640 1 -- 172.21.15.50:0/3098917597 >> 172.21.15.50:0/3098917597 conn(0x7f66700679c0 msgr2=0x7f667006e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.531+0000 7f6674f68640 1 -- 172.21.15.50:0/3098917597 shutdown_connections 2024-09-11T22:16:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40.531+0000 7f6674f68640 1 -- 172.21.15.50:0/3098917597 wait complete. 2024-09-11T22:16:40.543 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:16:40.543 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:16:40.544 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:16:40.544 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:16:40.544 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:16:40.544 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:16:40.544 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:16:40.544 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:16:40.544 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:16:40.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:16:40.544 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:16:40.560 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:16:40.560 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:16:40.561 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:16:40.561 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:16:40.561 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:16:40.561 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:16:40.561 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:16:40.561 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:16:40.561 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:16:40.561 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:16:40.561 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:16:40.561 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:16:40.561 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:16:40.561 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:16:40.561 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:16:40.562 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:16:40.562 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42395sec preferred_lft 42395sec 2024-09-11T22:16:40.562 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:16:40.562 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:16:40.562 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:16:40.562 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:16:40.562 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:16:40.562 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:16:40.562 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:16:40.562 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:16:40.562 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:16:40.562 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:16:40.562 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:16:40.563 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:16:40.563 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:16:40.563 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:16:40.563 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:16:40.563 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:16:40.563 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:16:40.563 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:16:40.563 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:16:40.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:16:40.563 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:16:40.625 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:16:40.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:16:40.627 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:16:40.684 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:16:40.685 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:16:40.685 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:16:40.685 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:16:40.685 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:16:40.685 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:16:40.685 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:16:40.685 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:16:40.685 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:16:40.685 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:16:40.686 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:16:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:16:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:16:40.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:16:40.813 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:16:40.829 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:16:40.829 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:16:40.829 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:16:40.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:16:40.829 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:16:40.895 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:16:40.895 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:16:40.951 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:16:40.951 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:16:40.951 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:16:41.007 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:16:41.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:16:41.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:16:41.093 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:16:41.093 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:16:41.100 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:16:41.100 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:16:41.101 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:16:41.101 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:16:41.101 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:16:41.101 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:16:41.101 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:16:41.101 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:16:41.101 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:16:41.101 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:16:41.103 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:16:41.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:16:41.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:16:41.128 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:16:41.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:16:41.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:16:41.231 INFO:teuthology.orchestra.run.smithi050.stdout:client6476 2024-09-11T22:16:41.231 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:16:41.231 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:16:41.247 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-11T22:16:41.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.393+0000 7fc1bb118640 1 Processor -- start 2024-09-11T22:16:41.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.393+0000 7fc1bb118640 1 -- start start 2024-09-11T22:16:41.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.394+0000 7fc1bb118640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1b4161fa0 0x7fc1b40b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:41.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.394+0000 7fc1bb118640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1b40cf610 0x7fc1b40cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:41.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.394+0000 7fc1bb118640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b40cfbd0 con 0x7fc1b40b1600 2024-09-11T22:16:41.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.394+0000 7fc1bb118640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc1b40d1220 con 0x7fc1b4161fa0 2024-09-11T22:16:41.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.394+0000 7fc1bb118640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b40d17e0 con 0x7fc1b40cf610 2024-09-11T22:16:41.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.394+0000 7fc1b8eb4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1b4161fa0 0x7fc1b40b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:41.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.394+0000 7fc1b8eb4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1b4161fa0 0x7fc1b40b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35142/0 (socket says 172.21.15.50:35142) 2024-09-11T22:16:41.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.394+0000 7fc1b8eb4640 1 -- 172.21.15.50:0/344501077 learned_addr learned my addr 172.21.15.50:0/344501077 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:41.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.394+0000 7fc1b8eb4640 1 -- 172.21.15.50:0/344501077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1b40cf610 msgr2=0x7fc1b40cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:41.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.394+0000 7fc1b8eb4640 1 --2- 172.21.15.50:0/344501077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1b40cf610 0x7fc1b40cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:41.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.394+0000 7fc1b8eb4640 1 -- 172.21.15.50:0/344501077 >> v1:172.21.15.77:6789/0 conn(0x7fc1b40b1600 legacy=0x7fc1b40cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:16:41.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.394+0000 7fc1b8eb4640 1 -- 172.21.15.50:0/344501077 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b40cfeb0 con 0x7fc1b4161fa0 2024-09-11T22:16:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.395+0000 7fc1b8eb4640 1 --2- 172.21.15.50:0/344501077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b4161fa0 0x7fc1b40b4d20 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009870 tx=0x7fc1a402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55bf9047d061005 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.395+0000 7fc1b37fe640 1 -- 172.21.15.50:0/344501077 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4037070 con 0x7fc1b4161fa0 2024-09-11T22:16:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.395+0000 7fc1b37fe640 1 -- 172.21.15.50:0/344501077 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a4032440 con 0x7fc1b4161fa0 2024-09-11T22:16:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.395+0000 7fc1b37fe640 1 -- 172.21.15.50:0/344501077 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4032810 con 0x7fc1b4161fa0 2024-09-11T22:16:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.396+0000 7fc1bb118640 1 -- 172.21.15.50:0/344501077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b4161fa0 msgr2=0x7fc1b40b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.396+0000 7fc1bb118640 1 --2- 172.21.15.50:0/344501077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b4161fa0 0x7fc1b40b4d20 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009870 tx=0x7fc1a402a210 comp rx=0 tx=0).stop 2024-09-11T22:16:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.396+0000 7fc1bb118640 1 -- 172.21.15.50:0/344501077 shutdown_connections 2024-09-11T22:16:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.396+0000 7fc1bb118640 1 --2- 172.21.15.50:0/344501077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1b40cf610 0x7fc1b40cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.396+0000 7fc1bb118640 1 --2- 172.21.15.50:0/344501077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b4161fa0 0x7fc1b40b4d20 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.396+0000 7fc1bb118640 1 -- 172.21.15.50:0/344501077 >> 172.21.15.50:0/344501077 conn(0x7fc1b409ba50 msgr2=0x7fc1b40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.396+0000 7fc1bb118640 1 -- 172.21.15.50:0/344501077 shutdown_connections 2024-09-11T22:16:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.396+0000 7fc1bb118640 1 -- 172.21.15.50:0/344501077 wait complete. 2024-09-11T22:16:41.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.397+0000 7fc1bb118640 1 Processor -- start 2024-09-11T22:16:41.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.397+0000 7fc1bb118640 1 -- start start 2024-09-11T22:16:41.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.398+0000 7fc1bb118640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b40b1600 0x7fc1b41f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:41.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.398+0000 7fc1bb118640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b40cf610 0x7fc1b40b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:41.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.398+0000 7fc1bb118640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1b4161fa0 0x7fc1b40b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:41.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.398+0000 7fc1bb118640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b4162500 con 0x7fc1b40b1600 2024-09-11T22:16:41.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.398+0000 7fc1bb118640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b4162380 con 0x7fc1b40cf610 2024-09-11T22:16:41.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.398+0000 7fc1bb118640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b40d1c70 con 0x7fc1b4161fa0 2024-09-11T22:16:41.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.398+0000 7fc1b8eb4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b40b1600 0x7fc1b41f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:41.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.398+0000 7fc1b8eb4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b40b1600 0x7fc1b41f5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35146/0 (socket says 172.21.15.50:35146) 2024-09-11T22:16:41.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.398+0000 7fc1b8eb4640 1 -- 172.21.15.50:0/1657664762 learned_addr learned my addr 172.21.15.50:0/1657664762 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:16:41.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.398+0000 7fc1b8eb4640 1 -- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1b4161fa0 msgr2=0x7fc1b40b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:41.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.398+0000 7fc1b96b5640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1b4161fa0 0x7fc1b40b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:41.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.399+0000 7fc1b3fff640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b40cf610 0x7fc1b40b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:41.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.399+0000 7fc1b8eb4640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1b4161fa0 0x7fc1b40b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:41.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.399+0000 7fc1b8eb4640 1 -- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b40cf610 msgr2=0x7fc1b40b68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:41.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.399+0000 7fc1b8eb4640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b40cf610 0x7fc1b40b68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:41.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.399+0000 7fc1b8eb4640 1 -- 172.21.15.50:0/1657664762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b41f4c60 con 0x7fc1b40b1600 2024-09-11T22:16:41.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.399+0000 7fc1b96b5640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1b4161fa0 0x7fc1b40b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:41.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.399+0000 7fc1b3fff640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b40cf610 0x7fc1b40b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:16:41.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.399+0000 7fc1b8eb4640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b40b1600 0x7fc1b41f5a40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009870 tx=0x7fc1a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:41.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.399+0000 7fc1b17fa640 1 -- 172.21.15.50:0/1657664762 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4041070 con 0x7fc1b40b1600 2024-09-11T22:16:41.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.399+0000 7fc1b17fa640 1 -- 172.21.15.50:0/1657664762 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a403c870 con 0x7fc1b40b1600 2024-09-11T22:16:41.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.399+0000 7fc1b17fa640 1 -- 172.21.15.50:0/1657664762 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4037040 con 0x7fc1b40b1600 2024-09-11T22:16:41.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.399+0000 7fc1bb118640 1 -- 172.21.15.50:0/1657664762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b41f4f40 con 0x7fc1b40b1600 2024-09-11T22:16:41.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.399+0000 7fc1bb118640 1 -- 172.21.15.50:0/1657664762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b41f5500 con 0x7fc1b40b1600 2024-09-11T22:16:41.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.400+0000 7fc1bb118640 1 -- 172.21.15.50:0/1657664762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b4075130 con 0x7fc1b40b1600 2024-09-11T22:16:41.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.401+0000 7fc1b17fa640 1 -- 172.21.15.50:0/1657664762 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1a4044070 con 0x7fc1b40b1600 2024-09-11T22:16:41.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.401+0000 7fc1b17fa640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc1a006be30 0x7fc1a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:16:41.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.402+0000 7fc1b17fa640 1 -- 172.21.15.50:0/1657664762 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fc1a40ab9b0 con 0x7fc1b40b1600 2024-09-11T22:16:41.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.402+0000 7fc1b3fff640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc1a006be30 0x7fc1a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:16:41.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.402+0000 7fc1b3fff640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc1a006be30 0x7fc1a006e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40b4750 tx=0x7fc1a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:16:41.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.406+0000 7fc1b17fa640 1 -- 172.21.15.50:0/1657664762 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1b4075130 con 0x7fc1b40b1600 2024-09-11T22:16:41.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:41.620+0000 7fc1bb118640 1 -- 172.21.15.50:0/1657664762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fc1b40c94f0 con 0x7fc1b40b1600 2024-09-11T22:16:42.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:42.158+0000 7fc1b17fa640 1 -- 172.21.15.50:0/1657664762 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v77) ==== 167+0+0 (secure 0 0 0) 0x7fc1a407a350 con 0x7fc1b40b1600 2024-09-11T22:16:42.159 INFO:teuthology.orchestra.run.smithi050.stderr:enabled new snapshots 2024-09-11T22:16:42.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:42.160+0000 7fc1bb118640 1 -- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc1a006be30 msgr2=0x7fc1a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:42.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:42.160+0000 7fc1bb118640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc1a006be30 0x7fc1a006e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40b4750 tx=0x7fc1a8009040 comp rx=0 tx=0).stop 2024-09-11T22:16:42.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:42.160+0000 7fc1bb118640 1 -- 172.21.15.50:0/1657664762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b40b1600 msgr2=0x7fc1b41f5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:16:42.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:42.160+0000 7fc1bb118640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b40b1600 0x7fc1b41f5a40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009870 tx=0x7fc1a40046c0 comp rx=0 tx=0).stop 2024-09-11T22:16:42.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:42.160+0000 7fc1bb118640 1 -- 172.21.15.50:0/1657664762 shutdown_connections 2024-09-11T22:16:42.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:42.160+0000 7fc1bb118640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc1a006be30 0x7fc1a006e2f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:42.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:42.160+0000 7fc1bb118640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1b4161fa0 0x7fc1b40b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:42.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:42.160+0000 7fc1bb118640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b40cf610 0x7fc1b40b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:42.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:42.161+0000 7fc1bb118640 1 --2- 172.21.15.50:0/1657664762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1b40b1600 0x7fc1b41f5a40 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:16:42.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:42.161+0000 7fc1bb118640 1 -- 172.21.15.50:0/1657664762 >> 172.21.15.50:0/1657664762 conn(0x7fc1b409ba50 msgr2=0x7fc1b40b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:16:42.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:42.161+0000 7fc1bb118640 1 -- 172.21.15.50:0/1657664762 shutdown_connections 2024-09-11T22:16:42.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:16:42.161+0000 7fc1bb118640 1 -- 172.21.15.50:0/1657664762 wait complete. 2024-09-11T22:16:42.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:16:42.174 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-11T22:16:42.197 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:16:42.197 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:16:42.254 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2024-09-11T22:16:42.254 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-11T22:16:42.255 DEBUG:teuthology.orchestra.run.smithi050:> import uuid 2024-09-11T22:16:42.255 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:16:42.255 DEBUG:teuthology.orchestra.run.smithi050:> n = 2000 2024-09-11T22:16:42.255 DEBUG:teuthology.orchestra.run.smithi050:> create_hard_links = False 2024-09-11T22:16:42.255 DEBUG:teuthology.orchestra.run.smithi050:> if 3 > 0: 2024-09-11T22:16:42.255 DEBUG:teuthology.orchestra.run.smithi050:> create_hard_links = True 2024-09-11T22:16:42.255 DEBUG:teuthology.orchestra.run.smithi050:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-11T22:16:42.255 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:16:42.255 DEBUG:teuthology.orchestra.run.smithi050:> dpath = os.path.dirname(path) 2024-09-11T22:16:42.256 DEBUG:teuthology.orchestra.run.smithi050:> fnameprefix = os.path.basename(path) 2024-09-11T22:16:42.256 DEBUG:teuthology.orchestra.run.smithi050:> os.makedirs(dpath, exist_ok=True) 2024-09-11T22:16:42.256 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:16:42.256 DEBUG:teuthology.orchestra.run.smithi050:> try: 2024-09-11T22:16:42.256 DEBUG:teuthology.orchestra.run.smithi050:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-11T22:16:42.256 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:16:42.256 DEBUG:teuthology.orchestra.run.smithi050:> for i in range(n): 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> with open(fpath, '"'"'w'"'"') as f: 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> f.write(f"{i}") 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> f.flush() 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(f.fileno()) 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> os.unlink(fpath) 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(dirfd) 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> if create_hard_links: 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> for j in range(3): 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-11T22:16:42.257 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2024-09-11T22:16:42.258 DEBUG:teuthology.orchestra.run.smithi050:> os.fsync(dirfd) 2024-09-11T22:16:42.258 DEBUG:teuthology.orchestra.run.smithi050:> finally: 2024-09-11T22:16:42.258 DEBUG:teuthology.orchestra.run.smithi050:> os.close(dirfd) 2024-09-11T22:16:42.258 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-11T22:16:42.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:16:42.949 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:17:01.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:17:01.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:17:01.719 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-11T22:17:01.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:17:01.767 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-11T22:17:13.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:17:13.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:17:30.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:17:30.269 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-11T22:17:30.324 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-11T22:17:30.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.427+0000 7fa8b350a640 1 Processor -- start 2024-09-11T22:17:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.427+0000 7fa8b350a640 1 -- start start 2024-09-11T22:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.428+0000 7fa8b350a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa8ac0735a0 0x7fa8ac15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.428+0000 7fa8b350a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8ac15f0e0 0x7fa8ac0728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.428+0000 7fa8b350a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8ac0b4e80 con 0x7fa8ac15c240 2024-09-11T22:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.428+0000 7fa8b350a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa8ac15c620 con 0x7fa8ac0735a0 2024-09-11T22:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.428+0000 7fa8b350a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ac15f560 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.428+0000 7fa8b0aa5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa8ac0735a0 0x7fa8ac15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.428+0000 7fa8b1aa7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8ac15f0e0 0x7fa8ac0728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.428+0000 7fa8b12a6640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa8ac15c240 0x7fa8ac0b4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:44532/0 (socket says 172.21.15.50:44532) 2024-09-11T22:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.428+0000 7fa8b12a6640 1 -- 172.21.15.50:0/401895324 learned_addr learned my addr 172.21.15.50:0/401895324 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:17:30.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.429+0000 7fa8b1aa7640 1 -- 172.21.15.50:0/401895324 >> v2:172.21.15.77:3300/0 conn(0x7fa8ac0735a0 msgr2=0x7fa8ac15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.429+0000 7fa8b1aa7640 1 --2- 172.21.15.50:0/401895324 >> v2:172.21.15.77:3300/0 conn(0x7fa8ac0735a0 0x7fa8ac15eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.429+0000 7fa8b1aa7640 1 -- 172.21.15.50:0/401895324 >> v1:172.21.15.77:6789/0 conn(0x7fa8ac15c240 legacy=0x7fa8ac0b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.429+0000 7fa8b1aa7640 1 -- 172.21.15.50:0/401895324 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ac15f840 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.429+0000 7fa8b0aa5640 1 --2- 172.21.15.50:0/401895324 >> v2:172.21.15.77:3300/0 conn(0x7fa8ac0735a0 0x7fa8ac15eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:30.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.429+0000 7fa8b1aa7640 1 --2- 172.21.15.50:0/401895324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8ac15f0e0 0x7fa8ac0728e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009d90 tx=0x7fa8a402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e98d86e5eef47230 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.430+0000 7fa8a3fff640 1 -- 172.21.15.50:0/401895324 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4007740 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.430+0000 7fa8a3fff640 1 -- 172.21.15.50:0/401895324 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a40078e0 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.430+0000 7fa8a3fff640 1 -- 172.21.15.50:0/401895324 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4007cb0 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.430+0000 7fa8b350a640 1 -- 172.21.15.50:0/401895324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8ac15f0e0 msgr2=0x7fa8ac0728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.430+0000 7fa8b350a640 1 --2- 172.21.15.50:0/401895324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8ac15f0e0 0x7fa8ac0728e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009d90 tx=0x7fa8a402a660 comp rx=0 tx=0).stop 2024-09-11T22:17:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.430+0000 7fa8b350a640 1 -- 172.21.15.50:0/401895324 shutdown_connections 2024-09-11T22:17:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.430+0000 7fa8b350a640 1 --2- 172.21.15.50:0/401895324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8ac15f0e0 0x7fa8ac0728e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.430+0000 7fa8b350a640 1 --2- 172.21.15.50:0/401895324 >> v2:172.21.15.77:3300/0 conn(0x7fa8ac0735a0 0x7fa8ac15eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.430+0000 7fa8b350a640 1 -- 172.21.15.50:0/401895324 >> 172.21.15.50:0/401895324 conn(0x7fa8ac0b2bd0 msgr2=0x7fa8ac0b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.430+0000 7fa8b350a640 1 -- 172.21.15.50:0/401895324 shutdown_connections 2024-09-11T22:17:30.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.430+0000 7fa8b350a640 1 -- 172.21.15.50:0/401895324 wait complete. 2024-09-11T22:17:30.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.432+0000 7fa8b350a640 1 Processor -- start 2024-09-11T22:17:30.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.432+0000 7fa8b350a640 1 -- start start 2024-09-11T22:17:30.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.432+0000 7fa8b350a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8ac0735a0 0x7fa8ac159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.432+0000 7fa8b350a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8ac15c240 0x7fa8ac160d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.432+0000 7fa8b350a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8ac15f0e0 0x7fa8ac1612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.432+0000 7fa8b350a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac0b4250 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.432+0000 7fa8b350a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac0b3f70 con 0x7fa8ac0735a0 2024-09-11T22:17:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.432+0000 7fa8b350a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ac072e20 con 0x7fa8ac15c240 2024-09-11T22:17:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.432+0000 7fa8b1aa7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8ac15f0e0 0x7fa8ac1612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8b1aa7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8ac15f0e0 0x7fa8ac1612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45150/0 (socket says 172.21.15.50:45150) 2024-09-11T22:17:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8b1aa7640 1 -- 172.21.15.50:0/2675904944 learned_addr learned my addr 172.21.15.50:0/2675904944 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8b12a6640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8ac0735a0 0x7fa8ac159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8b0aa5640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8ac15c240 0x7fa8ac160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8b1aa7640 1 -- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8ac15c240 msgr2=0x7fa8ac160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8b1aa7640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8ac15c240 0x7fa8ac160d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8b1aa7640 1 -- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8ac0735a0 msgr2=0x7fa8ac159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8b1aa7640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8ac0735a0 0x7fa8ac159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8b1aa7640 1 -- 172.21.15.50:0/2675904944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ac159f40 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8b1aa7640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8ac15f0e0 0x7fa8ac1612c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009eb0 tx=0x7fa8a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8a1ffb640 1 -- 172.21.15.50:0/2675904944 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a403f070 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8a1ffb640 1 -- 172.21.15.50:0/2675904944 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a4031c60 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8b350a640 1 -- 172.21.15.50:0/2675904944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ac15a220 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8a1ffb640 1 -- 172.21.15.50:0/2675904944 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4009450 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.433+0000 7fa8b350a640 1 -- 172.21.15.50:0/2675904944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ac0cdaa0 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.435+0000 7fa8a1ffb640 1 -- 172.21.15.50:0/2675904944 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8a4043650 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.435+0000 7fa8a1ffb640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa89006be30 0x7fa89006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.436+0000 7fa8a1ffb640 1 -- 172.21.15.50:0/2675904944 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fa8a40ac270 con 0x7fa8ac15f0e0 2024-09-11T22:17:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.436+0000 7fa8b12a6640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa89006be30 0x7fa89006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.436+0000 7fa8b12a6640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa89006be30 0x7fa89006e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac15fd80 tx=0x7fa8a8007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.436+0000 7fa8b629f740 1 Processor -- start 2024-09-11T22:17:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.436+0000 7fa8b629f740 1 -- start start 2024-09-11T22:17:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b629f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff99ff9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b629f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fcda0 0x562ff99fe930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b629f740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff99fd200 0x562ff99df560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b629f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562ff991b8d0 con 0x562ff99fcda0 2024-09-11T22:17:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b629f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562ff98c3620 con 0x562ff99ff5e0 2024-09-11T22:17:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b629f740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562ff9917890 con 0x562ff99fd200 2024-09-11T22:17:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b0aa5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fcda0 0x562ff99fe930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b0aa5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fcda0 0x562ff99fe930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45158/0 (socket says 172.21.15.50:45158) 2024-09-11T22:17:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b0aa5640 1 -- 172.21.15.50:0/1595723112 learned_addr learned my addr 172.21.15.50:0/1595723112 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b12a6640 1 --2- 172.21.15.50:0/1595723112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff99ff9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b1aa7640 1 --2- 172.21.15.50:0/1595723112 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff99fd200 0x562ff99df560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b0aa5640 1 -- 172.21.15.50:0/1595723112 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff99fd200 msgr2=0x562ff99df560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b0aa5640 1 --2- 172.21.15.50:0/1595723112 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff99fd200 0x562ff99df560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b0aa5640 1 -- 172.21.15.50:0/1595723112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 msgr2=0x562ff99ff9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b0aa5640 1 --2- 172.21.15.50:0/1595723112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff99ff9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.437+0000 7fa8b0aa5640 1 -- 172.21.15.50:0/1595723112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ff96f87d0 con 0x562ff99fcda0 2024-09-11T22:17:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.438+0000 7fa8b0aa5640 1 --2- 172.21.15.50:0/1595723112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fcda0 0x562ff99fe930 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fa89c004650 tx=0x7fa89c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dbe332a0d5f0fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.438+0000 7fa896ffd640 1 -- 172.21.15.50:0/1595723112 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c019070 con 0x562ff99fcda0 2024-09-11T22:17:30.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.438+0000 7fa896ffd640 1 -- 172.21.15.50:0/1595723112 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa89c009c80 con 0x562ff99fcda0 2024-09-11T22:17:30.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.438+0000 7fa896ffd640 1 -- 172.21.15.50:0/1595723112 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c015680 con 0x562ff99fcda0 2024-09-11T22:17:30.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.438+0000 7fa8b629f740 1 -- 172.21.15.50:0/1595723112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fcda0 msgr2=0x562ff99fe930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.438+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1595723112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fcda0 0x562ff99fe930 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fa89c004650 tx=0x7fa89c009190 comp rx=0 tx=0).stop 2024-09-11T22:17:30.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.438+0000 7fa8b629f740 1 -- 172.21.15.50:0/1595723112 shutdown_connections 2024-09-11T22:17:30.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.438+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1595723112 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff99fd200 0x562ff99df560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.438+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1595723112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fcda0 0x562ff99fe930 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.438+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1595723112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff99ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.438+0000 7fa8b629f740 1 -- 172.21.15.50:0/1595723112 >> 172.21.15.50:0/1595723112 conn(0x562ff99b5240 msgr2=0x562ff99fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.439+0000 7fa8b629f740 1 -- 172.21.15.50:0/1595723112 shutdown_connections 2024-09-11T22:17:30.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.439+0000 7fa8b629f740 1 -- 172.21.15.50:0/1595723112 wait complete. 2024-09-11T22:17:30.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.439+0000 7fa8b629f740 1 -- start start 2024-09-11T22:17:30.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.439+0000 7fa8b629f740 1 Processor -- start 2024-09-11T22:17:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b629f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99e3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b629f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff99dd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b629f740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b629f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562ff99fbd00 con 0x562ff99fd200 2024-09-11T22:17:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b629f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562ff98a4750 con 0x562ff99ff5e0 2024-09-11T22:17:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b629f740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562ff99fbfe0 con 0x562ff9a0d980 2024-09-11T22:17:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b629f740 10 client.0 _ll_register_callbacks cb 0x562ff98c8780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b12a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b12a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99e3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45160/0 (socket says 172.21.15.50:45160) 2024-09-11T22:17:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b12a6640 1 -- 172.21.15.50:0/1381238207 learned_addr learned my addr 172.21.15.50:0/1381238207 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b0aa5640 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff99dd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b1aa7640 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b12a6640 1 -- 172.21.15.50:0/1381238207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 msgr2=0x562ff99f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b12a6640 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99f7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b12a6640 1 -- 172.21.15.50:0/1381238207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 msgr2=0x562ff99dd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b12a6640 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff99dd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b12a6640 1 -- 172.21.15.50:0/1381238207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ff95ee0f0 con 0x562ff99fd200 2024-09-11T22:17:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.440+0000 7fa8b1aa7640 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa8b12a6640 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99e3220 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80136d0 tx=0x7fa8a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9238a308bfcf1d22 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa88bfff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:17:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa88bfff640 1 -- 172.21.15.50:0/1381238207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8020580 con 0x562ff99fd200 2024-09-11T22:17:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa88bfff640 1 -- 172.21.15.50:0/1381238207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fa8a8020720 con 0x562ff99fd200 2024-09-11T22:17:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa8b629f740 1 -- 172.21.15.50:0/1381238207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa89c009c80 con 0x562ff99fd200 2024-09-11T22:17:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa88bfff640 1 -- 172.21.15.50:0/1381238207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fa8a802e050 con 0x562ff99fd200 2024-09-11T22:17:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa8b629f740 10 client.7773 fetch_fsmap learned FSMap version 77 2024-09-11T22:17:30.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa8b629f740 1 -- 172.21.15.50:0/1381238207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x562ff9758f60 con 0x562ff99fd200 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa88bfff640 1 -- 172.21.15.50:0/1381238207 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa89c009c80 con 0x562ff99fd200 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa88bfff640 1 -- 172.21.15.50:0/1381238207 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7fa8a8031020 con 0x562ff99fd200 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa8b629f740 10 client.7773 fetch_fsmap finished waiting for FSMap version 77 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa8b629f740 10 client.7773 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa8b629f740 20 client.7773 populate_metadata read hostname 'smithi050' 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x562ff99f9780 0x562ff99f9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa8b629f740 4 client.7773 mds_command: new command op to 7605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa8b629f740 1 -- 172.21.15.50:0/1381238207 --> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ff9929000 con 0x562ff99f9780 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.441+0000 7fa8b0aa5640 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x562ff99f9780 0x562ff99f9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.442+0000 7fa8b0aa5640 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x562ff99f9780 0x562ff99f9b60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20aa1764fb23d55a server_cookie=e9c00ff6d9b3c44e in_seq=0 out_seq=0 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.442+0000 7fa88bfff640 10 client.7773 ms_handle_connect on v2:172.21.15.50:6832/2355059741 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.442+0000 7fa88bfff640 1 -- 172.21.15.50:0/1381238207 <== mds.0 v2:172.21.15.50:6832/2355059741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ff9929000 con 0x562ff99f9780 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.442+0000 7fa88bfff640 10 client.7773 handle_command_reply: tid=0 2024-09-11T22:17:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.442+0000 7fa8b629f740 1 client.7773 shutdown 2024-09-11T22:17:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.443+0000 7fa8b629f740 1 -- 172.21.15.50:0/1381238207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 msgr2=0x562ff99e3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.443+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99e3220 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80136d0 tx=0x7fa8a8000bc0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.443+0000 7fa8b629f740 1 -- 172.21.15.50:0/1381238207 shutdown_connections 2024-09-11T22:17:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.443+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x562ff99f9780 0x562ff99f9b60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.443+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.443+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff99dd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.443+0000 7fa88bfff640 0 client.7773 ms_handle_reset on v2:172.21.15.50:6832/2355059741 2024-09-11T22:17:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.443+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1381238207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99e3220 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.443+0000 7fa8b629f740 1 -- 172.21.15.50:0/1381238207 >> 172.21.15.50:0/1381238207 conn(0x562ff99fcda0 msgr2=0x562ff99dfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.443+0000 7fa8b629f740 1 -- 172.21.15.50:0/1381238207 shutdown_connections 2024-09-11T22:17:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.443+0000 7fa8b629f740 1 -- 172.21.15.50:0/1381238207 wait complete. 2024-09-11T22:17:30.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.443+0000 7fa8b629f740 20 client.7773 trim_cache size 0 max 16384 2024-09-11T22:17:30.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.459+0000 7fa8b629f740 1 Processor -- start 2024-09-11T22:17:30.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.459+0000 7fa8b629f740 1 -- start start 2024-09-11T22:17:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b629f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b629f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff99dd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b629f740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99fe940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b629f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac200dd0 con 0x562ff99fd200 2024-09-11T22:17:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b629f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac1ffdd0 con 0x562ff99ff5e0 2024-09-11T22:17:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b629f740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ac1ff130 con 0x562ff9a0d980 2024-09-11T22:17:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b12a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b12a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99f3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45162/0 (socket says 172.21.15.50:45162) 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b12a6640 1 -- 172.21.15.50:0/1921338739 learned_addr learned my addr 172.21.15.50:0/1921338739 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b0aa5640 1 --2- 172.21.15.50:0/1921338739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff99dd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b1aa7640 1 --2- 172.21.15.50:0/1921338739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b12a6640 1 -- 172.21.15.50:0/1921338739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 msgr2=0x562ff99fe940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b12a6640 1 --2- 172.21.15.50:0/1921338739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99fe940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b12a6640 1 -- 172.21.15.50:0/1921338739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 msgr2=0x562ff99dd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b12a6640 1 --2- 172.21.15.50:0/1921338739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff99dd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b12a6640 1 -- 172.21.15.50:0/1921338739 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ff99f9ed0 con 0x562ff99fd200 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b1aa7640 1 --2- 172.21.15.50:0/1921338739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99fe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8b12a6640 1 --2- 172.21.15.50:0/1921338739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99f3f20 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fa8a802c040 tx=0x7fa8a8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47673f00f9170921 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8967fc640 1 -- 172.21.15.50:0/1921338739 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80209c0 con 0x562ff99fd200 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8967fc640 1 -- 172.21.15.50:0/1921338739 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a8026070 con 0x562ff99fd200 2024-09-11T22:17:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.460+0000 7fa8967fc640 1 -- 172.21.15.50:0/1921338739 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8020dc0 con 0x562ff99fd200 2024-09-11T22:17:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.461+0000 7fa8b629f740 1 -- 172.21.15.50:0/1921338739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 msgr2=0x562ff99f3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.461+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1921338739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99f3f20 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fa8a802c040 tx=0x7fa8a8021000 comp rx=0 tx=0).stop 2024-09-11T22:17:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.461+0000 7fa8b629f740 1 -- 172.21.15.50:0/1921338739 shutdown_connections 2024-09-11T22:17:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.461+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1921338739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99fe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.461+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1921338739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff99dd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.461+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1921338739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99f3f20 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.461+0000 7fa8b629f740 1 -- 172.21.15.50:0/1921338739 >> 172.21.15.50:0/1921338739 conn(0x562ff99fcda0 msgr2=0x562ff99b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.461+0000 7fa8b629f740 1 -- 172.21.15.50:0/1921338739 shutdown_connections 2024-09-11T22:17:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.461+0000 7fa8b629f740 1 -- 172.21.15.50:0/1921338739 wait complete. 2024-09-11T22:17:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.462+0000 7fa8b629f740 1 -- start start 2024-09-11T22:17:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.462+0000 7fa8b629f740 1 Processor -- start 2024-09-11T22:17:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.462+0000 7fa8b629f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99e12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b629f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff9a71c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b629f740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99e1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b629f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac1ff780 con 0x562ff99fd200 2024-09-11T22:17:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b629f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562ff99e19a0 con 0x562ff99ff5e0 2024-09-11T22:17:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b629f740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562ff9a01210 con 0x562ff9a0d980 2024-09-11T22:17:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b629f740 10 client.0 _ll_register_callbacks cb 0x7fa8a8001c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b12a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99e12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b12a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99e12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45172/0 (socket says 172.21.15.50:45172) 2024-09-11T22:17:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b12a6640 1 -- 172.21.15.50:0/1323355263 learned_addr learned my addr 172.21.15.50:0/1323355263 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b0aa5640 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff9a71c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b1aa7640 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99e1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b12a6640 1 -- 172.21.15.50:0/1323355263 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 msgr2=0x562ff99e1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b12a6640 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99e1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b12a6640 1 -- 172.21.15.50:0/1323355263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 msgr2=0x562ff9a71c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b12a6640 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff9a71c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b12a6640 1 -- 172.21.15.50:0/1323355263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ff95c71b0 con 0x562ff99fd200 2024-09-11T22:17:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b1aa7640 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99e1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:17:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b12a6640 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99e12a0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800e160 tx=0x7fa8a800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5206310060dec661 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa88bfff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:17:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa88bfff640 1 -- 172.21.15.50:0/1323355263 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a803c640 con 0x562ff99fd200 2024-09-11T22:17:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa88bfff640 1 -- 172.21.15.50:0/1323355263 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fa8a803c7e0 con 0x562ff99fd200 2024-09-11T22:17:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b629f740 1 -- 172.21.15.50:0/1323355263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8a8026070 con 0x562ff99fd200 2024-09-11T22:17:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa88bfff640 1 -- 172.21.15.50:0/1323355263 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fa8a804a050 con 0x562ff99fd200 2024-09-11T22:17:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.463+0000 7fa8b629f740 10 client.7779 fetch_fsmap learned FSMap version 77 2024-09-11T22:17:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.464+0000 7fa8b629f740 1 -- 172.21.15.50:0/1323355263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x562ff9a00fb0 con 0x562ff99fd200 2024-09-11T22:17:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.464+0000 7fa88bfff640 1 -- 172.21.15.50:0/1323355263 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a8026070 con 0x562ff99fd200 2024-09-11T22:17:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.464+0000 7fa88bfff640 1 -- 172.21.15.50:0/1323355263 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7fa8a804d020 con 0x562ff99fd200 2024-09-11T22:17:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.464+0000 7fa8b629f740 10 client.7779 fetch_fsmap finished waiting for FSMap version 77 2024-09-11T22:17:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.464+0000 7fa8b629f740 10 client.7779 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.464+0000 7fa8b629f740 20 client.7779 populate_metadata read hostname 'smithi050' 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.464+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x562ff99e3360 0x562ff99e23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.464+0000 7fa8b629f740 4 client.7779 mds_command: new command op to 7605 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.464+0000 7fa8b629f740 1 -- 172.21.15.50:0/1323355263 --> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] -- command(tid 0: {"prefix": "perf dump"}) -- 0x562ff9923350 con 0x562ff99e3360 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.464+0000 7fa8b0aa5640 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x562ff99e3360 0x562ff99e23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.464+0000 7fa88bfff640 10 client.7779 ms_handle_connect on v2:172.21.15.50:6832/2355059741 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.464+0000 7fa8b0aa5640 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x562ff99e3360 0x562ff99e23d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeedfc62d8f564d6 server_cookie=7caa2b409d548be9 in_seq=0 out_seq=0 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa88bfff640 1 -- 172.21.15.50:0/1323355263 <== mds.0 v2:172.21.15.50:6832/2355059741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17990 (crc 0 0 0) 0x562ff9923350 con 0x562ff99e3360 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa88bfff640 10 client.7779 handle_command_reply: tid=0 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa8b629f740 1 client.7779 shutdown 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa8b629f740 1 -- 172.21.15.50:0/1323355263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 msgr2=0x562ff99e12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99e12a0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800e160 tx=0x7fa8a800a000 comp rx=0 tx=0).stop 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa8b629f740 1 -- 172.21.15.50:0/1323355263 shutdown_connections 2024-09-11T22:17:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x562ff99e3360 0x562ff99e23d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562ff9a0d980 0x562ff99e1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562ff99ff5e0 0x562ff9a71c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa88bfff640 0 client.7779 ms_handle_reset on v2:172.21.15.50:6832/2355059741 2024-09-11T22:17:30.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa8b629f740 1 --2- 172.21.15.50:0/1323355263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ff99fd200 0x562ff99e12a0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa8b629f740 1 -- 172.21.15.50:0/1323355263 >> 172.21.15.50:0/1323355263 conn(0x562ff99fcda0 msgr2=0x562ff99de800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa8b629f740 1 -- 172.21.15.50:0/1323355263 shutdown_connections 2024-09-11T22:17:30.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa8b629f740 1 -- 172.21.15.50:0/1323355263 wait complete. 2024-09-11T22:17:30.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.465+0000 7fa8b629f740 20 client.7779 trim_cache size 0 max 16384 2024-09-11T22:17:30.473 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:17:30.473 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:17:30.473 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 1793, 2024-09-11T22:17:30.473 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 1793, 2024-09-11T22:17:30.473 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 446269, 2024-09-11T22:17:30.473 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 29756809, 2024-09-11T22:17:30.473 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 9, 2024-09-11T22:17:30.473 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 3, 2024-09-11T22:17:30.473 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.247240525, 2024-09-11T22:17:30.473 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.130817757, 2024-09-11T22:17:30.473 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.040296956, 2024-09-11T22:17:30.473 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.065124101, 2024-09-11T22:17:30.473 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:17:30.474 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1792, 2024-09-11T22:17:30.474 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.332662033, 2024-09-11T22:17:30.474 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000185637 2024-09-11T22:17:30.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.474 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:17:30.474 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2, 2024-09-11T22:17:30.474 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000223, 2024-09-11T22:17:30.474 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000111 2024-09-11T22:17:30.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.474 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:17:30.474 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:17:30.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.474 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:17:30.475 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 27750, 2024-09-11T22:17:30.475 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 50198, 2024-09-11T22:17:30.475 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 9534712, 2024-09-11T22:17:30.475 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 38793209, 2024-09-11T22:17:30.475 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 8, 2024-09-11T22:17:30.475 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-09-11T22:17:30.475 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 3.454028549, 2024-09-11T22:17:30.475 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 2.382801113, 2024-09-11T22:17:30.475 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 1.432510793, 2024-09-11T22:17:30.475 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.031763269, 2024-09-11T22:17:30.475 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:17:30.475 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 50197, 2024-09-11T22:17:30.476 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.067997113, 2024-09-11T22:17:30.476 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000021276 2024-09-11T22:17:30.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.476 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:17:30.476 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 74480, 2024-09-11T22:17:30.476 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.009707382, 2024-09-11T22:17:30.476 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000130 2024-09-11T22:17:30.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.476 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-09-11T22:17:30.476 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 110352 2024-09-11T22:17:30.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.476 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:17:30.476 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 2354, 2024-09-11T22:17:30.477 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2350, 2024-09-11T22:17:30.477 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 871915, 2024-09-11T22:17:30.477 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 54297775, 2024-09-11T22:17:30.477 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 5, 2024-09-11T22:17:30.477 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-09-11T22:17:30.477 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.433458428, 2024-09-11T22:17:30.477 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.226114752, 2024-09-11T22:17:30.477 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.086079941, 2024-09-11T22:17:30.477 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.144822233, 2024-09-11T22:17:30.477 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:17:30.477 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2349, 2024-09-11T22:17:30.477 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.526000524, 2024-09-11T22:17:30.478 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000223925 2024-09-11T22:17:30.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.478 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:17:30.478 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.478 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.478 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.478 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 116224, 2024-09-11T22:17:30.478 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 18752 2024-09-11T22:17:30.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.479 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-09-11T22:17:30.479 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-09-11T22:17:30.479 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-09-11T22:17:30.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.479 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-09-11T22:17:30.479 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-09-11T22:17:30.479 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-09-11T22:17:30.479 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1417, 2024-09-11T22:17:30.479 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 19.484419425, 2024-09-11T22:17:30.479 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.013750472 2024-09-11T22:17:30.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:17:30.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.480 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-09-11T22:17:30.480 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-09-11T22:17:30.480 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-09-11T22:17:30.480 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1505, 2024-09-11T22:17:30.480 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.081989246, 2024-09-11T22:17:30.480 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000718929 2024-09-11T22:17:30.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:17:30.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.480 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-09-11T22:17:30.480 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 25245, 2024-09-11T22:17:30.480 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 25245, 2024-09-11T22:17:30.480 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-09-11T22:17:30.481 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 25245, 2024-09-11T22:17:30.481 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 439.184383177, 2024-09-11T22:17:30.481 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.017396885 2024-09-11T22:17:30.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.481 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 0, 2024-09-11T22:17:30.481 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 0, 2024-09-11T22:17:30.481 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 0, 2024-09-11T22:17:30.481 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-09-11T22:17:30.481 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 12, 2024-09-11T22:17:30.481 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 0, 2024-09-11T22:17:30.481 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 0, 2024-09-11T22:17:30.481 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 19807, 2024-09-11T22:17:30.482 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 0, 2024-09-11T22:17:30.482 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 19807, 2024-09-11T22:17:30.482 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 0, 2024-09-11T22:17:30.482 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 19806, 2024-09-11T22:17:30.482 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 0, 2024-09-11T22:17:30.482 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 162, 2024-09-11T22:17:30.482 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 162, 2024-09-11T22:17:30.482 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 2, 2024-09-11T22:17:30.482 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 45744, 2024-09-11T22:17:30.482 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 45234, 2024-09-11T22:17:30.482 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 0, 2024-09-11T22:17:30.482 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 0, 2024-09-11T22:17:30.482 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:17:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-09-11T22:17:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 85, 2024-09-11T22:17:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 0, 2024-09-11T22:17:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-09-11T22:17:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 0, 2024-09-11T22:17:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 0, 2024-09-11T22:17:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 0, 2024-09-11T22:17:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 0, 2024-09-11T22:17:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-09-11T22:17:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 0, 2024-09-11T22:17:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-09-11T22:17:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 0, 2024-09-11T22:17:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 0, 2024-09-11T22:17:30.484 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 0, 2024-09-11T22:17:30.484 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T22:17:30.484 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-09-11T22:17:30.484 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:17:30.484 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:17:30.484 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 0, 2024-09-11T22:17:30.484 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:17:30.484 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T22:17:30.484 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 0, 2024-09-11T22:17:30.484 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:17:30.484 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 1176, 2024-09-11T22:17:30.484 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 4042, 2024-09-11T22:17:30.484 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:17:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:17:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:17:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 4083, 2024-09-11T22:17:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 3368, 2024-09-11T22:17:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 25, 2024-09-11T22:17:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 14042 2024-09-11T22:17:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-09-11T22:17:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 0, 2024-09-11T22:17:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 0, 2024-09-11T22:17:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 0, 2024-09-11T22:17:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 0, 2024-09-11T22:17:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 0, 2024-09-11T22:17:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 2000, 2024-09-11T22:17:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 158, 2024-09-11T22:17:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:17:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 4122, 2024-09-11T22:17:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 1685, 2024-09-11T22:17:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 2204, 2024-09-11T22:17:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-09-11T22:17:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-09-11T22:17:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:17:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:17:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-09-11T22:17:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-09-11T22:17:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 0, 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 0, 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 28813, 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 0, 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 0, 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 28813, 2024-09-11T22:17:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 0, 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 0, 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 47, 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 0, 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 0, 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 47, 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 4, 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 0, 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 0, 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 4194304, 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 103414120, 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 0, 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2742, 2024-09-11T22:17:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 130.855482347, 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.047722641 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 0 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 2014, 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 2014, 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 0, 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 13, 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 13, 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 0, 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 19807, 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 19808, 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 1, 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 162, 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 3505, 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 3343, 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 121140, 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 231788 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 28139, 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 0, 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 25245, 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 3, 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 0, 2024-09-11T22:17:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-09-11T22:17:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2000, 2024-09-11T22:17:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.650887215, 2024-09-11T22:17:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000825443 2024-09-11T22:17:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-09-11T22:17:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 30, 2024-09-11T22:17:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.004591772, 2024-09-11T22:17:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000153059 2024-09-11T22:17:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-09-11T22:17:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-09-11T22:17:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 6000, 2024-09-11T22:17:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 7.292402315, 2024-09-11T22:17:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.001215400 2024-09-11T22:17:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-09-11T22:17:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 6997, 2024-09-11T22:17:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 5.816528272, 2024-09-11T22:17:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000831288 2024-09-11T22:17:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-09-11T22:17:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000054352, 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000054352 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.003140838, 2024-09-11T22:17:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.003140838 2024-09-11T22:17:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-09-11T22:17:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-09-11T22:17:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:17:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.026312295, 2024-09-11T22:17:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.026312295 2024-09-11T22:17:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-09-11T22:17:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:17:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000083524, 2024-09-11T22:17:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000083524 2024-09-11T22:17:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-09-11T22:17:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8, 2024-09-11T22:17:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.708274137, 2024-09-11T22:17:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.213534267 2024-09-11T22:17:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-09-11T22:17:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2204, 2024-09-11T22:17:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 403.628744889, 2024-09-11T22:17:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.183134639 2024-09-11T22:17:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-09-11T22:17:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-09-11T22:17:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-09-11T22:17:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-09-11T22:17:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:17:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.036882427, 2024-09-11T22:17:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.036882427 2024-09-11T22:17:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-09-11T22:17:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-09-11T22:17:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:17:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000263287, 2024-09-11T22:17:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000263287 2024-09-11T22:17:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-09-11T22:17:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-09-11T22:17:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-09-11T22:17:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8000, 2024-09-11T22:17:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 19.016217854, 2024-09-11T22:17:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.002377027 2024-09-11T22:17:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:17:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:17:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-09-11T22:17:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:17:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-09-11T22:17:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 1, 2024-09-11T22:17:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 1, 2024-09-11T22:17:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 0, 2024-09-11T22:17:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 1, 2024-09-11T22:17:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-09-11T22:17:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 18163, 2024-09-11T22:17:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 18163, 2024-09-11T22:17:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 45, 2024-09-11T22:17:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-09-11T22:17:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-09-11T22:17:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:17:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-09-11T22:17:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:17:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:17:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:17:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:17:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:17:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:17:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:17:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:17:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:17:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:17:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:17:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:17:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:17:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-09-11T22:17:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:17:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-09-11T22:17:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:17:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:17:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:17:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:17:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:17:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:17:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:17:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-09-11T22:17:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:17:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:17:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:17:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-09-11T22:17:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-09-11T22:17:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-09-11T22:17:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:17:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:17:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:17:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:17:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 17672187, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 6472, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 440, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 5, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 5312, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 75, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:17:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-09-11T22:17:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-09-11T22:17:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 20541253, 2024-09-11T22:17:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 862275, 2024-09-11T22:17:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-09-11T22:17:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-09-11T22:17:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-09-11T22:17:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-09-11T22:17:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-09-11T22:17:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-09-11T22:17:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-09-11T22:17:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 4617, 2024-09-11T22:17:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 99678941, 2024-09-11T22:17:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 37, 2024-09-11T22:17:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 4617, 2024-09-11T22:17:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-09-11T22:17:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 4617, 2024-09-11T22:17:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 17.550553356, 2024-09-11T22:17:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.003801289 2024-09-11T22:17:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-09-11T22:17:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-09-11T22:17:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 4617, 2024-09-11T22:17:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 4704 2024-09-11T22:17:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 4617, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 31, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 4586, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 0, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 11, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 31, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 2773, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 22, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 1685, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 0, 2024-09-11T22:17:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 35, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 0, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 22, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-09-11T22:17:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:17:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 0, 2024-09-11T22:17:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-09-11T22:17:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-09-11T22:17:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-09-11T22:17:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-09-11T22:17:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-09-11T22:17:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-09-11T22:17:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-09-11T22:17:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-09-11T22:17:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-09-11T22:17:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-09-11T22:17:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-09-11T22:17:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-09-11T22:17:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-09-11T22:17:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-09-11T22:17:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-09-11T22:17:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-09-11T22:17:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 107, 2024-09-11T22:17:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-09-11T22:17:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 1, 2024-09-11T22:17:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 8, 2024-09-11T22:17:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 8, 2024-09-11T22:17:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 0, 2024-09-11T22:17:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-09-11T22:17:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 97, 2024-09-11T22:17:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 0, 2024-09-11T22:17:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 28 2024-09-11T22:17:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-09-11T22:17:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 1, 2024-09-11T22:17:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:17:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-09-11T22:17:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-09-11T22:17:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "osd-slow-ops": { 2024-09-11T22:17:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 0 2024-09-11T22:17:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-09-11T22:17:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-09-11T22:17:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 32, 2024-09-11T22:17:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-09-11T22:17:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 32, 2024-09-11T22:17:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 1685, 2024-09-11T22:17:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 1685, 2024-09-11T22:17:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-09-11T22:17:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:17:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:17:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-09-11T22:17:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:17:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 31892, 2024-09-11T22:17:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 7977723, 2024-09-11T22:17:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:17:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 31892, 2024-09-11T22:17:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-11T22:17:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-11T22:17:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 31892, 2024-09-11T22:17:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 7977723, 2024-09-11T22:17:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:17:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:17:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-09-11T22:17:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:17:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-09-11T22:17:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:17:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-09-11T22:17:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-09-11T22:17:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:17:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-09-11T22:17:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 4617, 2024-09-11T22:17:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 99862606, 2024-09-11T22:17:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 4617, 2024-09-11T22:17:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 99862606, 2024-09-11T22:17:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:17:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 4617, 2024-09-11T22:17:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 4617, 2024-09-11T22:17:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 4617, 2024-09-11T22:17:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 4617, 2024-09-11T22:17:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:17:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:17:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:17:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:17:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-09-11T22:17:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:17:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 1685, 2024-09-11T22:17:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 183665, 2024-09-11T22:17:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:17:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 1685, 2024-09-11T22:17:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-11T22:17:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-11T22:17:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 31, 2024-09-11T22:17:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 183665, 2024-09-11T22:17:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:17:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:17:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:17:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x558d3f486500": { 2024-09-11T22:17:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 84, 2024-09-11T22:17:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-09-11T22:17:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:17:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 28813, 2024-09-11T22:17:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 99219816, 2024-09-11T22:17:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:17:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 28813, 2024-09-11T22:17:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-11T22:17:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-11T22:17:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 2742, 2024-09-11T22:17:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 99219732, 2024-09-11T22:17:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:17:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:17:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:17:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:17:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:17:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:17:30.522 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:17:30.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.466+0000 7fa8b350a640 1 -- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa89006be30 msgr2=0x7fa89006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.466+0000 7fa8b350a640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa89006be30 0x7fa89006e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac15fd80 tx=0x7fa8a8007e80 comp rx=0 tx=0).stop 2024-09-11T22:17:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.466+0000 7fa8b350a640 1 -- 172.21.15.50:0/2675904944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8ac15f0e0 msgr2=0x7fa8ac1612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.466+0000 7fa8b350a640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8ac15f0e0 0x7fa8ac1612c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009eb0 tx=0x7fa8a4004a40 comp rx=0 tx=0).stop 2024-09-11T22:17:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.466+0000 7fa8b350a640 1 -- 172.21.15.50:0/2675904944 shutdown_connections 2024-09-11T22:17:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.466+0000 7fa8b350a640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa89006be30 0x7fa89006e2f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.466+0000 7fa8b350a640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8ac15c240 0x7fa8ac160d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.466+0000 7fa8b350a640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8ac15f0e0 0x7fa8ac1612c0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.466+0000 7fa8b350a640 1 --2- 172.21.15.50:0/2675904944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8ac0735a0 0x7fa8ac159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.466+0000 7fa8b350a640 1 -- 172.21.15.50:0/2675904944 >> 172.21.15.50:0/2675904944 conn(0x7fa8ac0b2bd0 msgr2=0x7fa8ac06e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.466+0000 7fa8b350a640 1 -- 172.21.15.50:0/2675904944 shutdown_connections 2024-09-11T22:17:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.466+0000 7fa8b350a640 1 -- 172.21.15.50:0/2675904944 wait complete. 2024-09-11T22:17:30.525 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-11T22:17:30.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:17:30.525 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start '~mdsdir' recursive 2024-09-11T22:17:30.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.631+0000 7fca3f81e640 1 Processor -- start 2024-09-11T22:17:30.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.632+0000 7fca3f81e640 1 -- start start 2024-09-11T22:17:30.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.632+0000 7fca3f81e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca38161d60 0x7fca380d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.632+0000 7fca3f81e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca380d39f0 0x7fca380b6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.632+0000 7fca3f81e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca380b7990 con 0x7fca380b6c70 2024-09-11T22:17:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.632+0000 7fca3f81e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fca380b70c0 con 0x7fca380d39f0 2024-09-11T22:17:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.632+0000 7fca3f81e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fca380d4530 con 0x7fca38161d60 2024-09-11T22:17:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.633+0000 7fca3cdb9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca380d39f0 0x7fca380b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.633+0000 7fca3cdb9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fca380d39f0 0x7fca380b6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45176/0 (socket says 172.21.15.50:45176) 2024-09-11T22:17:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.633+0000 7fca3cdb9640 1 -- 172.21.15.50:0/2683079810 learned_addr learned my addr 172.21.15.50:0/2683079810 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.633+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/2683079810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca38161d60 0x7fca380d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.633+0000 7fca3cdb9640 1 -- 172.21.15.50:0/2683079810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca38161d60 msgr2=0x7fca380d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.633+0000 7fca3cdb9640 1 --2- 172.21.15.50:0/2683079810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca38161d60 0x7fca380d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.633+0000 7fca3cdb9640 1 -- 172.21.15.50:0/2683079810 >> v1:172.21.15.77:6789/0 conn(0x7fca380b6c70 legacy=0x7fca380d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.633+0000 7fca3cdb9640 1 -- 172.21.15.50:0/2683079810 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca380d3f70 con 0x7fca380d39f0 2024-09-11T22:17:30.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.634+0000 7fca3cdb9640 1 --2- 172.21.15.50:0/2683079810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca380d39f0 0x7fca380b6730 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009870 tx=0x7fca2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebed0dea80a8c96c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.634+0000 7fca37fff640 1 -- 172.21.15.50:0/2683079810 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c037070 con 0x7fca380d39f0 2024-09-11T22:17:30.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.634+0000 7fca37fff640 1 -- 172.21.15.50:0/2683079810 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2c032440 con 0x7fca380d39f0 2024-09-11T22:17:30.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.634+0000 7fca37fff640 1 -- 172.21.15.50:0/2683079810 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c032810 con 0x7fca380d39f0 2024-09-11T22:17:30.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.634+0000 7fca3f81e640 1 -- 172.21.15.50:0/2683079810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca380d39f0 msgr2=0x7fca380b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.634+0000 7fca3f81e640 1 --2- 172.21.15.50:0/2683079810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca380d39f0 0x7fca380b6730 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009870 tx=0x7fca2c02a270 comp rx=0 tx=0).stop 2024-09-11T22:17:30.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.634+0000 7fca3f81e640 1 -- 172.21.15.50:0/2683079810 shutdown_connections 2024-09-11T22:17:30.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.634+0000 7fca3f81e640 1 --2- 172.21.15.50:0/2683079810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca380d39f0 0x7fca380b6730 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.634+0000 7fca3f81e640 1 --2- 172.21.15.50:0/2683079810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca38161d60 0x7fca380d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.634+0000 7fca3f81e640 1 -- 172.21.15.50:0/2683079810 >> 172.21.15.50:0/2683079810 conn(0x7fca38067db0 msgr2=0x7fca380681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.635+0000 7fca3f81e640 1 -- 172.21.15.50:0/2683079810 shutdown_connections 2024-09-11T22:17:30.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.635+0000 7fca3f81e640 1 -- 172.21.15.50:0/2683079810 wait complete. 2024-09-11T22:17:30.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.636+0000 7fca3f81e640 1 Processor -- start 2024-09-11T22:17:30.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.636+0000 7fca3f81e640 1 -- start start 2024-09-11T22:17:30.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.636+0000 7fca3f81e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca380b6c70 0x7fca381f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.636+0000 7fca3f81e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca380d39f0 0x7fca381f1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3f81e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca38161d60 0x7fca380cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3f81e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca380cf930 con 0x7fca380d39f0 2024-09-11T22:17:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3f81e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca380b7c30 con 0x7fca380b6c70 2024-09-11T22:17:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3f81e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fca380b9160 con 0x7fca38161d60 2024-09-11T22:17:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3cdb9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca380d39f0 0x7fca381f1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3cdb9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca380d39f0 0x7fca381f1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45184/0 (socket says 172.21.15.50:45184) 2024-09-11T22:17:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3cdb9640 1 -- 172.21.15.50:0/1715469833 learned_addr learned my addr 172.21.15.50:0/1715469833 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca380b6c70 0x7fca381f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3ddbb640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca38161d60 0x7fca380cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3cdb9640 1 -- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca38161d60 msgr2=0x7fca380cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3cdb9640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca38161d60 0x7fca380cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3cdb9640 1 -- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca380b6c70 msgr2=0x7fca381f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3cdb9640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca380b6c70 0x7fca381f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3cdb9640 1 -- 172.21.15.50:0/1715469833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca380cd1a0 con 0x7fca380d39f0 2024-09-11T22:17:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3ddbb640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca38161d60 0x7fca380cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3cdb9640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca380d39f0 0x7fca381f1420 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fca2c000c00 tx=0x7fca2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca35ffb640 1 -- 172.21.15.50:0/1715469833 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c041020 con 0x7fca380d39f0 2024-09-11T22:17:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca35ffb640 1 -- 172.21.15.50:0/1715469833 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2c0306c0 con 0x7fca380d39f0 2024-09-11T22:17:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca35ffb640 1 -- 172.21.15.50:0/1715469833 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c037040 con 0x7fca380d39f0 2024-09-11T22:17:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.637+0000 7fca3f81e640 1 -- 172.21.15.50:0/1715469833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca38159950 con 0x7fca380d39f0 2024-09-11T22:17:30.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.638+0000 7fca3f81e640 1 -- 172.21.15.50:0/1715469833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca38159f10 con 0x7fca380d39f0 2024-09-11T22:17:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.639+0000 7fca35ffb640 1 -- 172.21.15.50:0/1715469833 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca2c044020 con 0x7fca380d39f0 2024-09-11T22:17:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.640+0000 7fca35ffb640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fca2406be60 0x7fca2406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.640+0000 7fca35ffb640 1 -- 172.21.15.50:0/1715469833 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fca2c0ab630 con 0x7fca380d39f0 2024-09-11T22:17:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.640+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fca2406be60 0x7fca2406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.640+0000 7fca4268e740 1 Processor -- start 2024-09-11T22:17:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.640+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fca2406be60 0x7fca2406e320 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fca300079a0 tx=0x7fca30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.640+0000 7fca4268e740 1 -- start start 2024-09-11T22:17:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.641+0000 7fca4268e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b5a500 0x55fda9b5a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.641+0000 7fca4268e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b57cc0 0x55fda9b59850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.641+0000 7fca4268e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b58120 0x55fda9b3a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.641+0000 7fca4268e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fda9a76ac0 con 0x55fda9b5a500 2024-09-11T22:17:30.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.641+0000 7fca4268e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fda9a1e7b0 con 0x55fda9b58120 2024-09-11T22:17:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.641+0000 7fca4268e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fda9a72a80 con 0x55fda9b57cc0 2024-09-11T22:17:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.641+0000 7fca3d5ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b5a500 0x55fda9b5a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.641+0000 7fca3d5ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b5a500 0x55fda9b5a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45186/0 (socket says 172.21.15.50:45186) 2024-09-11T22:17:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.641+0000 7fca3d5ba640 1 -- 172.21.15.50:0/3218644686 learned_addr learned my addr 172.21.15.50:0/3218644686 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.641+0000 7fca3cdb9640 1 --2- 172.21.15.50:0/3218644686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b57cc0 0x55fda9b59850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.641+0000 7fca3ddbb640 1 --2- 172.21.15.50:0/3218644686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b58120 0x55fda9b3a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.642+0000 7fca3d5ba640 1 -- 172.21.15.50:0/3218644686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b57cc0 msgr2=0x55fda9b59850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.642+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/3218644686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b57cc0 0x55fda9b59850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.642+0000 7fca3d5ba640 1 -- 172.21.15.50:0/3218644686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b58120 msgr2=0x55fda9b3a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.642+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/3218644686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b58120 0x55fda9b3a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.642+0000 7fca3d5ba640 1 -- 172.21.15.50:0/3218644686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fda9855a20 con 0x55fda9b5a500 2024-09-11T22:17:30.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.642+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/3218644686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b5a500 0x55fda9b5a8e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fca30010ac0 tx=0x7fca30013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22b6102b3321cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.642+0000 7fca1effd640 1 -- 172.21.15.50:0/3218644686 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3001c050 con 0x55fda9b5a500 2024-09-11T22:17:30.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.642+0000 7fca1effd640 1 -- 172.21.15.50:0/3218644686 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca30026070 con 0x55fda9b5a500 2024-09-11T22:17:30.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.642+0000 7fca1effd640 1 -- 172.21.15.50:0/3218644686 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30016e10 con 0x55fda9b5a500 2024-09-11T22:17:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.643+0000 7fca4268e740 1 -- 172.21.15.50:0/3218644686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b5a500 msgr2=0x55fda9b5a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.643+0000 7fca4268e740 1 --2- 172.21.15.50:0/3218644686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b5a500 0x55fda9b5a8e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fca30010ac0 tx=0x7fca30013000 comp rx=0 tx=0).stop 2024-09-11T22:17:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.643+0000 7fca4268e740 1 -- 172.21.15.50:0/3218644686 shutdown_connections 2024-09-11T22:17:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.643+0000 7fca4268e740 1 --2- 172.21.15.50:0/3218644686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b57cc0 0x55fda9b59850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.643+0000 7fca4268e740 1 --2- 172.21.15.50:0/3218644686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b58120 0x55fda9b3a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.643+0000 7fca4268e740 1 --2- 172.21.15.50:0/3218644686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b5a500 0x55fda9b5a8e0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.643+0000 7fca4268e740 1 -- 172.21.15.50:0/3218644686 >> 172.21.15.50:0/3218644686 conn(0x55fda9b10160 msgr2=0x55fda9b58570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.643+0000 7fca4268e740 1 -- 172.21.15.50:0/3218644686 shutdown_connections 2024-09-11T22:17:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.643+0000 7fca4268e740 1 -- 172.21.15.50:0/3218644686 wait complete. 2024-09-11T22:17:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.643+0000 7fca4268e740 1 -- start start 2024-09-11T22:17:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.643+0000 7fca4268e740 1 Processor -- start 2024-09-11T22:17:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.644+0000 7fca4268e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 0x55fda9b6baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.644+0000 7fca4268e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 0x55fda9b3b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.644+0000 7fca4268e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b385d0 0x55fda9b37e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.644+0000 7fca4268e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fda9b56c20 con 0x55fda9b58120 2024-09-11T22:17:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.644+0000 7fca4268e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fda99ff7b0 con 0x55fda9b385d0 2024-09-11T22:17:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.644+0000 7fca4268e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fda9b56f00 con 0x55fda9b5a500 2024-09-11T22:17:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.644+0000 7fca4268e740 10 client.0 _ll_register_callbacks cb 0x55fda9788e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.644+0000 7fca3d5ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 0x55fda9b6baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.644+0000 7fca3d5ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 0x55fda9b6baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45194/0 (socket says 172.21.15.50:45194) 2024-09-11T22:17:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.644+0000 7fca3d5ba640 1 -- 172.21.15.50:0/1527159907 learned_addr learned my addr 172.21.15.50:0/1527159907 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.644+0000 7fca3cdb9640 1 --2- 172.21.15.50:0/1527159907 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 0x55fda9b3b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.644+0000 7fca3ddbb640 1 --2- 172.21.15.50:0/1527159907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b385d0 0x55fda9b37e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca3d5ba640 1 -- 172.21.15.50:0/1527159907 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 msgr2=0x55fda9b3b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/1527159907 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 0x55fda9b3b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca3d5ba640 1 -- 172.21.15.50:0/1527159907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b385d0 msgr2=0x55fda9b37e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/1527159907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b385d0 0x55fda9b37e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca3d5ba640 1 -- 172.21.15.50:0/1527159907 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fda9749310 con 0x55fda9b58120 2024-09-11T22:17:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/1527159907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 0x55fda9b6baa0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x55fda9b4f3a0 tx=0x7fca30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbb1367130568d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca13fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:17:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca13fff640 1 -- 172.21.15.50:0/1527159907 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30021650 con 0x55fda9b58120 2024-09-11T22:17:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca13fff640 1 -- 172.21.15.50:0/1527159907 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fca300217f0 con 0x55fda9b58120 2024-09-11T22:17:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca4268e740 1 -- 172.21.15.50:0/1527159907 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca30026070 con 0x55fda9b58120 2024-09-11T22:17:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca13fff640 1 -- 172.21.15.50:0/1527159907 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fca3001c030 con 0x55fda9b58120 2024-09-11T22:17:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca4268e740 10 client.7791 fetch_fsmap learned FSMap version 77 2024-09-11T22:17:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca4268e740 1 -- 172.21.15.50:0/1527159907 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x55fda98b61b0 con 0x55fda9b58120 2024-09-11T22:17:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca13fff640 1 -- 172.21.15.50:0/1527159907 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca30026070 con 0x55fda9b58120 2024-09-11T22:17:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca13fff640 1 -- 172.21.15.50:0/1527159907 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7fca300219f0 con 0x55fda9b58120 2024-09-11T22:17:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca4268e740 10 client.7791 fetch_fsmap finished waiting for FSMap version 77 2024-09-11T22:17:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca4268e740 10 client.7791 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-11T22:17:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.645+0000 7fca4268e740 20 client.7791 populate_metadata read hostname 'smithi050' 2024-09-11T22:17:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.646+0000 7fca4268e740 1 --2- 172.21.15.50:0/1527159907 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55fda9b50180 0x55fda9b50e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.646+0000 7fca4268e740 4 client.7791 mds_command: new command op to 7605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.646+0000 7fca4268e740 1 -- 172.21.15.50:0/1527159907 --> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fda9a841f0 con 0x55fda9b50180 2024-09-11T22:17:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.646+0000 7fca3cdb9640 1 --2- 172.21.15.50:0/1527159907 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55fda9b50180 0x55fda9b50e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.646+0000 7fca13fff640 10 client.7791 ms_handle_connect on v2:172.21.15.50:6832/2355059741 2024-09-11T22:17:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.646+0000 7fca3cdb9640 1 --2- 172.21.15.50:0/1527159907 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55fda9b50180 0x55fda9b50e00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fc518b64aa0538f server_cookie=9cc30a479ea63d28 in_seq=0 out_seq=0 2024-09-11T22:17:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.646+0000 7fca13fff640 1 -- 172.21.15.50:0/1527159907 <== mds.0 v2:172.21.15.50:6832/2355059741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fda9a841f0 con 0x55fda9b50180 2024-09-11T22:17:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.646+0000 7fca13fff640 10 client.7791 handle_command_reply: tid=0 2024-09-11T22:17:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.647+0000 7fca4268e740 1 client.7791 shutdown 2024-09-11T22:17:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.647+0000 7fca4268e740 1 -- 172.21.15.50:0/1527159907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 msgr2=0x55fda9b6baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.647+0000 7fca4268e740 1 --2- 172.21.15.50:0/1527159907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 0x55fda9b6baa0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x55fda9b4f3a0 tx=0x7fca30004730 comp rx=0 tx=0).stop 2024-09-11T22:17:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.647+0000 7fca4268e740 1 -- 172.21.15.50:0/1527159907 shutdown_connections 2024-09-11T22:17:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.647+0000 7fca4268e740 1 --2- 172.21.15.50:0/1527159907 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55fda9b50180 0x55fda9b50e00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.647+0000 7fca4268e740 1 --2- 172.21.15.50:0/1527159907 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 0x55fda9b3b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.647+0000 7fca4268e740 1 --2- 172.21.15.50:0/1527159907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b385d0 0x55fda9b37e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.647+0000 7fca13fff640 0 client.7791 ms_handle_reset on v2:172.21.15.50:6832/2355059741 2024-09-11T22:17:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.647+0000 7fca4268e740 1 --2- 172.21.15.50:0/1527159907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 0x55fda9b6baa0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.647+0000 7fca4268e740 1 -- 172.21.15.50:0/1527159907 >> 172.21.15.50:0/1527159907 conn(0x55fda9b57cc0 msgr2=0x55fda9b58570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.647+0000 7fca4268e740 1 -- 172.21.15.50:0/1527159907 shutdown_connections 2024-09-11T22:17:30.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.647+0000 7fca4268e740 1 -- 172.21.15.50:0/1527159907 wait complete. 2024-09-11T22:17:30.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.647+0000 7fca4268e740 20 client.7791 trim_cache size 0 max 16384 2024-09-11T22:17:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.664+0000 7fca4268e740 1 Processor -- start 2024-09-11T22:17:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.664+0000 7fca4268e740 1 -- start start 2024-09-11T22:17:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.665+0000 7fca4268e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b385d0 0x55fda9b58570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.665+0000 7fca4268e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b58120 0x55fda9b58ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.665+0000 7fca4268e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 0x55fda9b54df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.665+0000 7fca4268e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca38200d40 con 0x55fda9b385d0 2024-09-11T22:17:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.665+0000 7fca4268e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca381f7a10 con 0x55fda9b58120 2024-09-11T22:17:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.665+0000 7fca4268e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fca3815b3c0 con 0x55fda9b5a500 2024-09-11T22:17:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.665+0000 7fca3d5ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b385d0 0x55fda9b58570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.665+0000 7fca3d5ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b385d0 0x55fda9b58570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45198/0 (socket says 172.21.15.50:45198) 2024-09-11T22:17:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.665+0000 7fca3d5ba640 1 -- 172.21.15.50:0/2133734318 learned_addr learned my addr 172.21.15.50:0/2133734318 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.665+0000 7fca3cdb9640 1 --2- 172.21.15.50:0/2133734318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b58120 0x55fda9b58ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.666+0000 7fca3ddbb640 1 --2- 172.21.15.50:0/2133734318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 0x55fda9b54df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.666+0000 7fca3d5ba640 1 -- 172.21.15.50:0/2133734318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 msgr2=0x55fda9b54df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.666+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/2133734318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 0x55fda9b54df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.666+0000 7fca3d5ba640 1 -- 172.21.15.50:0/2133734318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b58120 msgr2=0x55fda9b58ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.666+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/2133734318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b58120 0x55fda9b58ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.666+0000 7fca3d5ba640 1 -- 172.21.15.50:0/2133734318 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fda97223d0 con 0x55fda9b385d0 2024-09-11T22:17:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.666+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/2133734318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b385d0 0x55fda9b58570 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fca30010a40 tx=0x7fca3002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ce81db28253f41 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.666+0000 7fca1e7fc640 1 -- 172.21.15.50:0/2133734318 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30021850 con 0x55fda9b385d0 2024-09-11T22:17:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.666+0000 7fca1e7fc640 1 -- 172.21.15.50:0/2133734318 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca30026070 con 0x55fda9b385d0 2024-09-11T22:17:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.666+0000 7fca1e7fc640 1 -- 172.21.15.50:0/2133734318 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30014520 con 0x55fda9b385d0 2024-09-11T22:17:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.666+0000 7fca4268e740 1 -- 172.21.15.50:0/2133734318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b385d0 msgr2=0x55fda9b58570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.667+0000 7fca4268e740 1 --2- 172.21.15.50:0/2133734318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b385d0 0x55fda9b58570 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fca30010a40 tx=0x7fca3002c000 comp rx=0 tx=0).stop 2024-09-11T22:17:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.667+0000 7fca4268e740 1 -- 172.21.15.50:0/2133734318 shutdown_connections 2024-09-11T22:17:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.667+0000 7fca4268e740 1 --2- 172.21.15.50:0/2133734318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 0x55fda9b54df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.667+0000 7fca4268e740 1 --2- 172.21.15.50:0/2133734318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b58120 0x55fda9b58ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.667+0000 7fca4268e740 1 --2- 172.21.15.50:0/2133734318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b385d0 0x55fda9b58570 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.667+0000 7fca4268e740 1 -- 172.21.15.50:0/2133734318 >> 172.21.15.50:0/2133734318 conn(0x55fda9b57cc0 msgr2=0x55fda9b59dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.667+0000 7fca4268e740 1 -- 172.21.15.50:0/2133734318 shutdown_connections 2024-09-11T22:17:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.667+0000 7fca4268e740 1 -- 172.21.15.50:0/2133734318 wait complete. 2024-09-11T22:17:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.667+0000 7fca4268e740 1 -- start start 2024-09-11T22:17:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.667+0000 7fca4268e740 1 Processor -- start 2024-09-11T22:17:30.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.668+0000 7fca4268e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b385d0 0x55fda9b67940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.668+0000 7fca4268e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 0x55fda9b58760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.668+0000 7fca4268e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 0x55fda9b39740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.668+0000 7fca4268e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fda9b15340 con 0x55fda9b58120 2024-09-11T22:17:30.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.668+0000 7fca4268e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca38150000 con 0x55fda9b385d0 2024-09-11T22:17:30.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.668+0000 7fca4268e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fda9b146e0 con 0x55fda9b5a500 2024-09-11T22:17:30.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.668+0000 7fca4268e740 10 client.0 _ll_register_callbacks cb 0x7fca28001740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:30.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.668+0000 7fca3cdb9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 0x55fda9b58760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.668+0000 7fca3cdb9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 0x55fda9b58760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45210/0 (socket says 172.21.15.50:45210) 2024-09-11T22:17:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.668+0000 7fca3cdb9640 1 -- 172.21.15.50:0/1211553414 learned_addr learned my addr 172.21.15.50:0/1211553414 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.668+0000 7fca3ddbb640 1 --2- 172.21.15.50:0/1211553414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 0x55fda9b39740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.668+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/1211553414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b385d0 0x55fda9b67940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca3cdb9640 1 -- 172.21.15.50:0/1211553414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 msgr2=0x55fda9b39740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca3cdb9640 1 --2- 172.21.15.50:0/1211553414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 0x55fda9b39740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca3cdb9640 1 -- 172.21.15.50:0/1211553414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b385d0 msgr2=0x55fda9b67940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca3cdb9640 1 --2- 172.21.15.50:0/1211553414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b385d0 0x55fda9b67940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca3cdb9640 1 -- 172.21.15.50:0/1211553414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fda9b7c4c0 con 0x55fda9b58120 2024-09-11T22:17:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca3cdb9640 1 --2- 172.21.15.50:0/1211553414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 0x55fda9b58760 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fca2c043040 tx=0x7fca2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9c4971fcc3e936 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca13fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:17:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca13fff640 1 -- 172.21.15.50:0/1211553414 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c077b40 con 0x55fda9b58120 2024-09-11T22:17:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca13fff640 1 -- 172.21.15.50:0/1211553414 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fca2c075eb0 con 0x55fda9b58120 2024-09-11T22:17:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca4268e740 1 -- 172.21.15.50:0/1211553414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca30026070 con 0x55fda9b58120 2024-09-11T22:17:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca13fff640 1 -- 172.21.15.50:0/1211553414 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fca2c081f90 con 0x55fda9b58120 2024-09-11T22:17:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca4268e740 10 client.7797 fetch_fsmap learned FSMap version 77 2024-09-11T22:17:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca4268e740 1 -- 172.21.15.50:0/1211553414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x55fda9b50e80 con 0x55fda9b58120 2024-09-11T22:17:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca13fff640 1 -- 172.21.15.50:0/1211553414 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca30026070 con 0x55fda9b58120 2024-09-11T22:17:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca13fff640 1 -- 172.21.15.50:0/1211553414 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7fca2c03a030 con 0x55fda9b58120 2024-09-11T22:17:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca4268e740 10 client.7797 fetch_fsmap finished waiting for FSMap version 77 2024-09-11T22:17:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca4268e740 10 client.7797 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-11T22:17:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca4268e740 20 client.7797 populate_metadata read hostname 'smithi050' 2024-09-11T22:17:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca4268e740 1 --2- 172.21.15.50:0/1211553414 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55fda9b58ca0 0x55fda9b39c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca4268e740 4 client.7797 mds_command: new command op to 7605 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-11T22:17:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.669+0000 7fca4268e740 1 -- 172.21.15.50:0/1211553414 --> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x55fda9b52b90 con 0x55fda9b58ca0 2024-09-11T22:17:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.670+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/1211553414 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55fda9b58ca0 0x55fda9b39c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.670+0000 7fca3d5ba640 1 --2- 172.21.15.50:0/1211553414 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55fda9b58ca0 0x55fda9b39c80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f787078425e4c9d7 server_cookie=ceaa2e3ad2dcf288 in_seq=0 out_seq=0 2024-09-11T22:17:30.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.670+0000 7fca13fff640 10 client.7797 ms_handle_connect on v2:172.21.15.50:6832/2355059741 2024-09-11T22:17:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.680+0000 7fca13fff640 1 -- 172.21.15.50:0/1211553414 <== mds.0 v2:172.21.15.50:6832/2355059741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fda9b52b90 con 0x55fda9b58ca0 2024-09-11T22:17:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.680+0000 7fca13fff640 10 client.7797 handle_command_reply: tid=0 2024-09-11T22:17:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.680+0000 7fca4268e740 1 client.7797 shutdown 2024-09-11T22:17:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.681+0000 7fca4268e740 1 -- 172.21.15.50:0/1211553414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 msgr2=0x55fda9b58760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.681+0000 7fca4268e740 1 --2- 172.21.15.50:0/1211553414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 0x55fda9b58760 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fca2c043040 tx=0x7fca2c008040 comp rx=0 tx=0).stop 2024-09-11T22:17:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.681+0000 7fca4268e740 1 -- 172.21.15.50:0/1211553414 shutdown_connections 2024-09-11T22:17:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.681+0000 7fca4268e740 1 --2- 172.21.15.50:0/1211553414 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55fda9b58ca0 0x55fda9b39c80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.681+0000 7fca4268e740 1 --2- 172.21.15.50:0/1211553414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fda9b5a500 0x55fda9b39740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.681+0000 7fca4268e740 1 --2- 172.21.15.50:0/1211553414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fda9b58120 0x55fda9b58760 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.681+0000 7fca4268e740 1 --2- 172.21.15.50:0/1211553414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fda9b385d0 0x55fda9b67940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.681+0000 7fca4268e740 1 -- 172.21.15.50:0/1211553414 >> 172.21.15.50:0/1211553414 conn(0x55fda9b57cc0 msgr2=0x55fda9b59dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.681+0000 7fca13fff640 0 client.7797 ms_handle_reset on v2:172.21.15.50:6832/2355059741 2024-09-11T22:17:30.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.681+0000 7fca4268e740 1 -- 172.21.15.50:0/1211553414 shutdown_connections 2024-09-11T22:17:30.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.681+0000 7fca4268e740 1 -- 172.21.15.50:0/1211553414 wait complete. 2024-09-11T22:17:30.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.681+0000 7fca4268e740 20 client.7797 trim_cache size 0 max 16384 2024-09-11T22:17:30.683 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:17:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:17:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "f7497bca-b71f-4809-83cf-bfd89b000042", 2024-09-11T22:17:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:17:30.683 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:17:30.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.682+0000 7fca3f81e640 1 -- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fca2406be60 msgr2=0x7fca2406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.682+0000 7fca3f81e640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fca2406be60 0x7fca2406e320 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fca300079a0 tx=0x7fca30008040 comp rx=0 tx=0).stop 2024-09-11T22:17:30.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.682+0000 7fca3f81e640 1 -- 172.21.15.50:0/1715469833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca380d39f0 msgr2=0x7fca381f1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.682+0000 7fca3f81e640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca380d39f0 0x7fca381f1420 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fca2c000c00 tx=0x7fca2c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.682+0000 7fca3f81e640 1 -- 172.21.15.50:0/1715469833 shutdown_connections 2024-09-11T22:17:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.682+0000 7fca3f81e640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fca2406be60 0x7fca2406e320 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.682+0000 7fca3f81e640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca38161d60 0x7fca380cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.682+0000 7fca3f81e640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca380d39f0 0x7fca381f1420 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.682+0000 7fca3f81e640 1 --2- 172.21.15.50:0/1715469833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca380b6c70 0x7fca381f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.682+0000 7fca3f81e640 1 -- 172.21.15.50:0/1715469833 >> 172.21.15.50:0/1715469833 conn(0x7fca38067db0 msgr2=0x7fca380ba140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.682+0000 7fca3f81e640 1 -- 172.21.15.50:0/1715469833 shutdown_connections 2024-09-11T22:17:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.682+0000 7fca3f81e640 1 -- 172.21.15.50:0/1715469833 wait complete. 2024-09-11T22:17:30.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:17:30.694 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-11T22:17:30.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.851+0000 7f968f74b640 1 Processor -- start 2024-09-11T22:17:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.851+0000 7f968f74b640 1 -- start start 2024-09-11T22:17:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.852+0000 7f968f74b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f968815e8e0 0x7f96880b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.852+0000 7f968f74b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9688162350 0x7f96881627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.852+0000 7f968f74b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9688163080 con 0x7f96880d1580 2024-09-11T22:17:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.852+0000 7f968f74b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f968815ecc0 con 0x7f968815e8e0 2024-09-11T22:17:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.852+0000 7f968f74b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f96880d2ad0 con 0x7f9688162350 2024-09-11T22:17:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.852+0000 7f968cce6640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f96880d1580 0x7f96880d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58270/0 (socket says 172.21.15.50:58270) 2024-09-11T22:17:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.852+0000 7f968cce6640 1 -- 172.21.15.50:0/3969612435 learned_addr learned my addr 172.21.15.50:0/3969612435 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:17:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.852+0000 7f968d4e7640 1 --2- 172.21.15.50:0/3969612435 >> v2:172.21.15.77:3300/0 conn(0x7f968815e8e0 0x7f96880b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.852+0000 7f968dce8640 1 --2- 172.21.15.50:0/3969612435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9688162350 0x7f96881627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.853+0000 7f968dce8640 1 -- 172.21.15.50:0/3969612435 >> v2:172.21.15.77:3300/0 conn(0x7f968815e8e0 msgr2=0x7f96880b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.853+0000 7f968dce8640 1 --2- 172.21.15.50:0/3969612435 >> v2:172.21.15.77:3300/0 conn(0x7f968815e8e0 0x7f96880b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.853+0000 7f968dce8640 1 -- 172.21.15.50:0/3969612435 >> v1:172.21.15.50:6789/0 conn(0x7f96880d1580 legacy=0x7f96880d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.853+0000 7f968dce8640 1 -- 172.21.15.50:0/3969612435 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96880d2d20 con 0x7f9688162350 2024-09-11T22:17:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.854+0000 7f968dce8640 1 --2- 172.21.15.50:0/3969612435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9688162350 0x7f96881627e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9680009d90 tx=0x7f968002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aa9ea24e7f063c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.854+0000 7f967ffff640 1 -- 172.21.15.50:0/3969612435 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680007740 con 0x7f9688162350 2024-09-11T22:17:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.854+0000 7f967ffff640 1 -- 172.21.15.50:0/3969612435 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96800078e0 con 0x7f9688162350 2024-09-11T22:17:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.854+0000 7f967ffff640 1 -- 172.21.15.50:0/3969612435 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680007740 con 0x7f9688162350 2024-09-11T22:17:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.855+0000 7f968f74b640 1 -- 172.21.15.50:0/3969612435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9688162350 msgr2=0x7f96881627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.855+0000 7f968f74b640 1 --2- 172.21.15.50:0/3969612435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9688162350 0x7f96881627e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9680009d90 tx=0x7f968002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.855+0000 7f968f74b640 1 -- 172.21.15.50:0/3969612435 shutdown_connections 2024-09-11T22:17:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.855+0000 7f968f74b640 1 --2- 172.21.15.50:0/3969612435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9688162350 0x7f96881627e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.855+0000 7f968f74b640 1 --2- 172.21.15.50:0/3969612435 >> v2:172.21.15.77:3300/0 conn(0x7f968815e8e0 0x7f96880b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.855+0000 7f968f74b640 1 -- 172.21.15.50:0/3969612435 >> 172.21.15.50:0/3969612435 conn(0x7f9688067ba0 msgr2=0x7f9688067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.855+0000 7f968f74b640 1 -- 172.21.15.50:0/3969612435 shutdown_connections 2024-09-11T22:17:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.855+0000 7f968f74b640 1 -- 172.21.15.50:0/3969612435 wait complete. 2024-09-11T22:17:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.857+0000 7f968f74b640 1 Processor -- start 2024-09-11T22:17:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.857+0000 7f968f74b640 1 -- start start 2024-09-11T22:17:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968f74b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96880d1580 0x7f9688156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968f74b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f968815e8e0 0x7f9688159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968f74b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9688162350 0x7f96881559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968f74b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9688162d20 con 0x7f9688162350 2024-09-11T22:17:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968f74b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f96880d3370 con 0x7f96880d1580 2024-09-11T22:17:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968f74b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f96880d3800 con 0x7f968815e8e0 2024-09-11T22:17:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968cce6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f968815e8e0 0x7f9688159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968dce8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9688162350 0x7f96881559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968cce6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f968815e8e0 0x7f9688159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:49904/0 (socket says 172.21.15.50:49904) 2024-09-11T22:17:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968cce6640 1 -- 172.21.15.50:0/1917150609 learned_addr learned my addr 172.21.15.50:0/1917150609 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968d4e7640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96880d1580 0x7f9688156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968cce6640 1 -- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96880d1580 msgr2=0x7f9688156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968cce6640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96880d1580 0x7f9688156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968cce6640 1 -- 172.21.15.50:0/1917150609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9688162350 msgr2=0x7f96881559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968cce6640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9688162350 0x7f96881559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968cce6640 1 -- 172.21.15.50:0/1917150609 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9688155f00 con 0x7f968815e8e0 2024-09-11T22:17:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.858+0000 7f968dce8640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9688162350 0x7f96881559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.859+0000 7f968cce6640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f968815e8e0 0x7f9688159460 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f967800c4d0 tx=0x7f967800c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.859+0000 7f967dffb640 1 -- 172.21.15.50:0/1917150609 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678017070 con 0x7f968815e8e0 2024-09-11T22:17:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.859+0000 7f967dffb640 1 -- 172.21.15.50:0/1917150609 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9678005ce0 con 0x7f968815e8e0 2024-09-11T22:17:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.859+0000 7f968f74b640 1 -- 172.21.15.50:0/1917150609 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96880b8880 con 0x7f968815e8e0 2024-09-11T22:17:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.860+0000 7f967dffb640 1 -- 172.21.15.50:0/1917150609 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678007270 con 0x7f968815e8e0 2024-09-11T22:17:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.860+0000 7f968f74b640 1 -- 172.21.15.50:0/1917150609 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96880b8e00 con 0x7f968815e8e0 2024-09-11T22:17:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.862+0000 7f967dffb640 1 -- 172.21.15.50:0/1917150609 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f967801a070 con 0x7f968815e8e0 2024-09-11T22:17:30.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.862+0000 7f967dffb640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f966c06bf00 0x7f966c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.863+0000 7f967dffb640 1 -- 172.21.15.50:0/1917150609 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f967808a110 con 0x7f968815e8e0 2024-09-11T22:17:30.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.863+0000 7f968d4e7640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f966c06bf00 0x7f966c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.863+0000 7f968d4e7640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f966c06bf00 0x7f966c06e3c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f968815e430 tx=0x7f9684009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.865+0000 7f96925c3740 1 Processor -- start 2024-09-11T22:17:30.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.865+0000 7f96925c3740 1 -- start start 2024-09-11T22:17:30.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.866+0000 7f96925c3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81a1920 0x5608e81e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f96925c3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e819f0e0 0x5608e81a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f96925c3740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a30b0 0x5608e819c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f96925c3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5608e81046f0 con 0x5608e81a1920 2024-09-11T22:17:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f96925c3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5608e80ac330 con 0x5608e819f0e0 2024-09-11T22:17:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f96925c3740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5608e81006b0 con 0x5608e81a30b0 2024-09-11T22:17:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f968d4e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81a1920 0x5608e81e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f968d4e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81a1920 0x5608e81e70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45230/0 (socket says 172.21.15.50:45230) 2024-09-11T22:17:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f968d4e7640 1 -- 172.21.15.50:0/1331072182 learned_addr learned my addr 172.21.15.50:0/1331072182 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f968dce8640 1 --2- 172.21.15.50:0/1331072182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a30b0 0x5608e819c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f968cce6640 1 --2- 172.21.15.50:0/1331072182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e819f0e0 0x5608e81a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f968d4e7640 1 -- 172.21.15.50:0/1331072182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a30b0 msgr2=0x5608e819c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f968d4e7640 1 --2- 172.21.15.50:0/1331072182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a30b0 0x5608e819c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f968d4e7640 1 -- 172.21.15.50:0/1331072182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e819f0e0 msgr2=0x5608e81a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f968d4e7640 1 --2- 172.21.15.50:0/1331072182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e819f0e0 0x5608e81a1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f968d4e7640 1 -- 172.21.15.50:0/1331072182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608e80d20d0 con 0x5608e81a1920 2024-09-11T22:17:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.867+0000 7f968d4e7640 1 --2- 172.21.15.50:0/1331072182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81a1920 0x5608e81e70c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f9684011ee0 tx=0x7f9684014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d9c771c2035505 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.868+0000 7f966affd640 1 -- 172.21.15.50:0/1331072182 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968401b070 con 0x5608e81a1920 2024-09-11T22:17:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.868+0000 7f966affd640 1 -- 172.21.15.50:0/1331072182 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9684027070 con 0x5608e81a1920 2024-09-11T22:17:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.868+0000 7f966affd640 1 -- 172.21.15.50:0/1331072182 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684003a20 con 0x5608e81a1920 2024-09-11T22:17:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.869+0000 7f96925c3740 1 -- 172.21.15.50:0/1331072182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81a1920 msgr2=0x5608e81e70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.869+0000 7f96925c3740 1 --2- 172.21.15.50:0/1331072182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81a1920 0x5608e81e70c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f9684011ee0 tx=0x7f9684014000 comp rx=0 tx=0).stop 2024-09-11T22:17:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.869+0000 7f96925c3740 1 -- 172.21.15.50:0/1331072182 shutdown_connections 2024-09-11T22:17:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.869+0000 7f96925c3740 1 --2- 172.21.15.50:0/1331072182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a30b0 0x5608e819c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.869+0000 7f96925c3740 1 --2- 172.21.15.50:0/1331072182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e819f0e0 0x5608e81a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.869+0000 7f96925c3740 1 --2- 172.21.15.50:0/1331072182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81a1920 0x5608e81e70c0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.869+0000 7f96925c3740 1 -- 172.21.15.50:0/1331072182 >> 172.21.15.50:0/1331072182 conn(0x5608e819e370 msgr2=0x5608e81e6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.869+0000 7f96925c3740 1 -- 172.21.15.50:0/1331072182 shutdown_connections 2024-09-11T22:17:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.869+0000 7f96925c3740 1 -- 172.21.15.50:0/1331072182 wait complete. 2024-09-11T22:17:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.870+0000 7f96925c3740 1 -- start start 2024-09-11T22:17:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.870+0000 7f96925c3740 1 Processor -- start 2024-09-11T22:17:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.871+0000 7f96925c3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81a1920 0x5608e81cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f96925c3740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a30b0 0x5608e819c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f968d4e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81a1920 0x5608e81cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f96925c3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81cbb60 0x5608e81c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f96925c3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5608e819d810 con 0x5608e81cbb60 2024-09-11T22:17:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f96925c3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5608e808d4f0 con 0x5608e81a1920 2024-09-11T22:17:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f96925c3740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5608e81e78f0 con 0x5608e81a30b0 2024-09-11T22:17:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f968d4e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81a1920 0x5608e81cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:38840/0 (socket says 172.21.15.50:38840) 2024-09-11T22:17:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f96925c3740 10 client.0 _ll_register_callbacks cb 0x5608e80aeb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f968d4e7640 1 -- 172.21.15.50:0/1446761746 learned_addr learned my addr 172.21.15.50:0/1446761746 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f968cce6640 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a30b0 0x5608e819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f968dce8640 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81cbb60 0x5608e81c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f968d4e7640 1 -- 172.21.15.50:0/1446761746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a30b0 msgr2=0x5608e819c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f968d4e7640 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a30b0 0x5608e819c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f968d4e7640 1 -- 172.21.15.50:0/1446761746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81cbb60 msgr2=0x5608e81c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f968d4e7640 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81cbb60 0x5608e81c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f968d4e7640 1 -- 172.21.15.50:0/1446761746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608e7ee17d0 con 0x5608e81a1920 2024-09-11T22:17:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f968cce6640 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a30b0 0x5608e819c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:17:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.872+0000 7f968dce8640 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81cbb60 0x5608e81c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:17:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.873+0000 7f968d4e7640 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81a1920 0x5608e81cb620 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9684024040 tx=0x7f9684004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd73219bad7e6135 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.873+0000 7f9663fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-11T22:17:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.873+0000 7f9663fff640 1 -- 172.21.15.50:0/1446761746 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968401b040 con 0x5608e81a1920 2024-09-11T22:17:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.873+0000 7f96925c3740 1 -- 172.21.15.50:0/1446761746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9684027070 con 0x5608e81a1920 2024-09-11T22:17:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.873+0000 7f9663fff640 1 -- 172.21.15.50:0/1446761746 <== mon.1 v2:172.21.15.77:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f9684036ae0 con 0x5608e81a1920 2024-09-11T22:17:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.873+0000 7f9663fff640 1 -- 172.21.15.50:0/1446761746 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f968403d050 con 0x5608e81a1920 2024-09-11T22:17:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.873+0000 7f96925c3740 10 client.7156 fetch_fsmap learned FSMap version 77 2024-09-11T22:17:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.873+0000 7f96925c3740 1 -- 172.21.15.50:0/1446761746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x5608e7e173f0 con 0x5608e81a1920 2024-09-11T22:17:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.874+0000 7f9663fff640 1 -- 172.21.15.50:0/1446761746 <== mon.1 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9684027070 con 0x5608e81a1920 2024-09-11T22:17:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.874+0000 7f9663fff640 1 -- 172.21.15.50:0/1446761746 <== mon.1 v2:172.21.15.77:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7f9684040020 con 0x5608e81a1920 2024-09-11T22:17:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.874+0000 7f96925c3740 10 client.7156 fetch_fsmap finished waiting for FSMap version 77 2024-09-11T22:17:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.874+0000 7f96925c3740 10 client.7156 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-11T22:17:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.874+0000 7f96925c3740 20 client.7156 populate_metadata read hostname 'smithi050' 2024-09-11T22:17:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.874+0000 7f96925c3740 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5608e81c6760 0x5608e81fa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.874+0000 7f96925c3740 4 client.7156 mds_command: new command op to 7605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:17:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.874+0000 7f96925c3740 1 -- 172.21.15.50:0/1446761746 --> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608e8111e20 con 0x5608e81c6760 2024-09-11T22:17:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.874+0000 7f968cce6640 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5608e81c6760 0x5608e81fa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.875+0000 7f9663fff640 10 client.7156 ms_handle_connect on v2:172.21.15.50:6832/2355059741 2024-09-11T22:17:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.875+0000 7f968cce6640 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5608e81c6760 0x5608e81fa1f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f55c6099b2268855 server_cookie=b13c654d234e723f in_seq=0 out_seq=0 2024-09-11T22:17:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f9663fff640 1 -- 172.21.15.50:0/1446761746 <== mds.0 v2:172.21.15.50:6832/2355059741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608e8111e20 con 0x5608e81c6760 2024-09-11T22:17:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f9663fff640 10 client.7156 handle_command_reply: tid=0 2024-09-11T22:17:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f96925c3740 1 client.7156 shutdown 2024-09-11T22:17:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f96925c3740 1 -- 172.21.15.50:0/1446761746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81a1920 msgr2=0x5608e81cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f96925c3740 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81a1920 0x5608e81cb620 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9684024040 tx=0x7f9684004730 comp rx=0 tx=0).stop 2024-09-11T22:17:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f96925c3740 1 -- 172.21.15.50:0/1446761746 shutdown_connections 2024-09-11T22:17:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f96925c3740 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5608e81c6760 0x5608e81fa1f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f96925c3740 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a30b0 0x5608e819c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f9663fff640 0 client.7156 ms_handle_reset on v2:172.21.15.50:6832/2355059741 2024-09-11T22:17:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f96925c3740 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81cbb60 0x5608e81c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f96925c3740 1 --2- 172.21.15.50:0/1446761746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81a1920 0x5608e81cb620 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f96925c3740 1 -- 172.21.15.50:0/1446761746 >> 172.21.15.50:0/1446761746 conn(0x5608e819f0e0 msgr2=0x5608e81e5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f96925c3740 1 -- 172.21.15.50:0/1446761746 shutdown_connections 2024-09-11T22:17:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.876+0000 7f96925c3740 1 -- 172.21.15.50:0/1446761746 wait complete. 2024-09-11T22:17:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.877+0000 7f96925c3740 20 client.7156 trim_cache size 0 max 16384 2024-09-11T22:17:30.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.909+0000 7f96925c3740 1 Processor -- start 2024-09-11T22:17:30.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.909+0000 7f96925c3740 1 -- start start 2024-09-11T22:17:30.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.910+0000 7f96925c3740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a1920 0x5608e81e4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.910+0000 7f96925c3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81a30b0 0x5608e81dffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.910+0000 7f96925c3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81c6760 0x5608e81e0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.910+0000 7f96925c3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9688200c00 con 0x5608e81c6760 2024-09-11T22:17:30.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.910+0000 7f96925c3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f96880ccc80 con 0x5608e81a30b0 2024-09-11T22:17:30.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.910+0000 7f96925c3740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f96880cbfe0 con 0x5608e81a1920 2024-09-11T22:17:30.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.910+0000 7f968dce8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81c6760 0x5608e81e0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.910+0000 7f968cce6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81a30b0 0x5608e81dffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.910+0000 7f968dce8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81c6760 0x5608e81e0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45236/0 (socket says 172.21.15.50:45236) 2024-09-11T22:17:30.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.910+0000 7f968cce6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81a30b0 0x5608e81dffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:38854/0 (socket says 172.21.15.50:38854) 2024-09-11T22:17:30.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.910+0000 7f968dce8640 1 -- 172.21.15.50:0/4062392652 learned_addr learned my addr 172.21.15.50:0/4062392652 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.910+0000 7f968d4e7640 1 --2- 172.21.15.50:0/4062392652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a1920 0x5608e81e4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.911+0000 7f968dce8640 1 -- 172.21.15.50:0/4062392652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a1920 msgr2=0x5608e81e4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.911+0000 7f968dce8640 1 --2- 172.21.15.50:0/4062392652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a1920 0x5608e81e4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.911+0000 7f968dce8640 1 -- 172.21.15.50:0/4062392652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81a30b0 msgr2=0x5608e81dffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.911+0000 7f968dce8640 1 --2- 172.21.15.50:0/4062392652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81a30b0 0x5608e81dffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.911+0000 7f968dce8640 1 -- 172.21.15.50:0/4062392652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608e8197fb0 con 0x5608e81c6760 2024-09-11T22:17:30.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.911+0000 7f968dce8640 1 --2- 172.21.15.50:0/4062392652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81c6760 0x5608e81e0520 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f9680009d90 tx=0x7f968002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503822c26a04ec9b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.911+0000 7f966a7fc640 1 -- 172.21.15.50:0/4062392652 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680007740 con 0x5608e81c6760 2024-09-11T22:17:30.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.911+0000 7f966a7fc640 1 -- 172.21.15.50:0/4062392652 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9680007e40 con 0x5608e81c6760 2024-09-11T22:17:30.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.911+0000 7f966a7fc640 1 -- 172.21.15.50:0/4062392652 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968003b610 con 0x5608e81c6760 2024-09-11T22:17:30.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.912+0000 7f96925c3740 1 -- 172.21.15.50:0/4062392652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81c6760 msgr2=0x5608e81e0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.912+0000 7f96925c3740 1 --2- 172.21.15.50:0/4062392652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81c6760 0x5608e81e0520 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f9680009d90 tx=0x7f968002f000 comp rx=0 tx=0).stop 2024-09-11T22:17:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.912+0000 7f96925c3740 1 -- 172.21.15.50:0/4062392652 shutdown_connections 2024-09-11T22:17:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.912+0000 7f96925c3740 1 --2- 172.21.15.50:0/4062392652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81c6760 0x5608e81e0520 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.912+0000 7f96925c3740 1 --2- 172.21.15.50:0/4062392652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81a30b0 0x5608e81dffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.912+0000 7f96925c3740 1 --2- 172.21.15.50:0/4062392652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a1920 0x5608e81e4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.912+0000 7f96925c3740 1 -- 172.21.15.50:0/4062392652 >> 172.21.15.50:0/4062392652 conn(0x5608e819f0e0 msgr2=0x5608e81c1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.912+0000 7f96925c3740 1 -- 172.21.15.50:0/4062392652 shutdown_connections 2024-09-11T22:17:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.912+0000 7f96925c3740 1 -- 172.21.15.50:0/4062392652 wait complete. 2024-09-11T22:17:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.913+0000 7f96925c3740 1 -- start start 2024-09-11T22:17:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.913+0000 7f96925c3740 1 Processor -- start 2024-09-11T22:17:30.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.914+0000 7f96925c3740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a1920 0x5608e8266300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f96925c3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81a30b0 0x5608e825ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f96925c3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81c6760 0x5608e81c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f96925c3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96880cc630 con 0x5608e81a30b0 2024-09-11T22:17:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f96925c3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5608e81e5280 con 0x5608e81c6760 2024-09-11T22:17:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f96925c3740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5608e820a830 con 0x5608e81a1920 2024-09-11T22:17:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f968cce6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81a30b0 0x5608e825ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f968cce6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81a30b0 0x5608e825ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45238/0 (socket says 172.21.15.50:45238) 2024-09-11T22:17:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f968dce8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81c6760 0x5608e81c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f968cce6640 1 -- 172.21.15.50:0/924232997 learned_addr learned my addr 172.21.15.50:0/924232997 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:17:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f968d4e7640 1 --2- 172.21.15.50:0/924232997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a1920 0x5608e8266300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f96925c3740 10 client.0 _ll_register_callbacks cb 0x7f9684009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:17:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f968d4e7640 1 -- 172.21.15.50:0/924232997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81c6760 msgr2=0x5608e81c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f968d4e7640 1 --2- 172.21.15.50:0/924232997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81c6760 0x5608e81c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f968d4e7640 1 -- 172.21.15.50:0/924232997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81a30b0 msgr2=0x5608e825ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:17:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f968d4e7640 1 --2- 172.21.15.50:0/924232997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81a30b0 0x5608e825ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.915+0000 7f968d4e7640 1 -- 172.21.15.50:0/924232997 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5608e7dd70f0 con 0x5608e81a1920 2024-09-11T22:17:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.916+0000 7f968d4e7640 1 --2- 172.21.15.50:0/924232997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a1920 0x5608e8266300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9684004010 tx=0x7f9684018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11c5d4845eef8faf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:17:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.916+0000 7f9663fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3301/0 2024-09-11T22:17:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.916+0000 7f9663fff640 1 -- 172.21.15.50:0/924232997 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968401b040 con 0x5608e81a1920 2024-09-11T22:17:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.916+0000 7f9663fff640 1 -- 172.21.15.50:0/924232997 <== mon.2 v2:172.21.15.77:3301/0 2 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f9684003d80 con 0x5608e81a1920 2024-09-11T22:17:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.916+0000 7f96925c3740 1 -- 172.21.15.50:0/924232997 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9680007e40 con 0x5608e81a1920 2024-09-11T22:17:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.916+0000 7f9663fff640 1 -- 172.21.15.50:0/924232997 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f968404f050 con 0x5608e81a1920 2024-09-11T22:17:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.916+0000 7f96925c3740 10 client.6524 fetch_fsmap learned FSMap version 77 2024-09-11T22:17:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.916+0000 7f96925c3740 1 -- 172.21.15.50:0/924232997 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x5608e825f520 con 0x5608e81a1920 2024-09-11T22:17:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.916+0000 7f9663fff640 1 -- 172.21.15.50:0/924232997 <== mon.2 v2:172.21.15.77:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9680007e40 con 0x5608e81a1920 2024-09-11T22:17:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.917+0000 7f9663fff640 1 -- 172.21.15.50:0/924232997 <== mon.2 v2:172.21.15.77:3301/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7f9684052020 con 0x5608e81a1920 2024-09-11T22:17:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.917+0000 7f96925c3740 10 client.6524 fetch_fsmap finished waiting for FSMap version 77 2024-09-11T22:17:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.917+0000 7f96925c3740 10 client.6524 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-11T22:17:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.917+0000 7f96925c3740 20 client.6524 populate_metadata read hostname 'smithi050' 2024-09-11T22:17:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.917+0000 7f96925c3740 1 --2- 172.21.15.50:0/924232997 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5608e81cbb60 0x5608e81c5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:17:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.917+0000 7f96925c3740 4 client.6524 mds_command: new command op to 7605 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:17:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.917+0000 7f96925c3740 1 -- 172.21.15.50:0/924232997 --> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5608e810c170 con 0x5608e81cbb60 2024-09-11T22:17:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.917+0000 7f968cce6640 1 --2- 172.21.15.50:0/924232997 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5608e81cbb60 0x5608e81c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:17:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.917+0000 7f9663fff640 10 client.6524 ms_handle_connect on v2:172.21.15.50:6832/2355059741 2024-09-11T22:17:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.918+0000 7f968cce6640 1 --2- 172.21.15.50:0/924232997 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5608e81cbb60 0x5608e81c5930 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ffd4b1ddcaa8053 server_cookie=a316ed5060133d9a in_seq=0 out_seq=0 2024-09-11T22:17:30.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.918+0000 7f9663fff640 1 -- 172.21.15.50:0/924232997 <== mds.0 v2:172.21.15.50:6832/2355059741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+264 (crc 0 0 0) 0x5608e810c170 con 0x5608e81cbb60 2024-09-11T22:17:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.918+0000 7f9663fff640 10 client.6524 handle_command_reply: tid=0 2024-09-11T22:17:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.918+0000 7f96925c3740 1 client.6524 shutdown 2024-09-11T22:17:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.918+0000 7f96925c3740 1 -- 172.21.15.50:0/924232997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a1920 msgr2=0x5608e8266300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.918+0000 7f96925c3740 1 --2- 172.21.15.50:0/924232997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a1920 0x5608e8266300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9684004010 tx=0x7f9684018000 comp rx=0 tx=0).stop 2024-09-11T22:17:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.918+0000 7f96925c3740 1 -- 172.21.15.50:0/924232997 shutdown_connections 2024-09-11T22:17:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.918+0000 7f96925c3740 1 --2- 172.21.15.50:0/924232997 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x5608e81cbb60 0x5608e81c5930 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.919+0000 7f96925c3740 1 --2- 172.21.15.50:0/924232997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5608e81c6760 0x5608e81c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.919+0000 7f96925c3740 1 --2- 172.21.15.50:0/924232997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608e81a30b0 0x5608e825ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.919+0000 7f96925c3740 1 --2- 172.21.15.50:0/924232997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5608e81a1920 0x5608e8266300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.919+0000 7f96925c3740 1 -- 172.21.15.50:0/924232997 >> 172.21.15.50:0/924232997 conn(0x5608e819f0e0 msgr2=0x5608e81dffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.919+0000 7f9663fff640 0 client.6524 ms_handle_reset on v2:172.21.15.50:6832/2355059741 2024-09-11T22:17:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.919+0000 7f96925c3740 1 -- 172.21.15.50:0/924232997 shutdown_connections 2024-09-11T22:17:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.919+0000 7f96925c3740 1 -- 172.21.15.50:0/924232997 wait complete. 2024-09-11T22:17:30.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.919+0000 7f96925c3740 20 client.6524 trim_cache size 0 max 16384 2024-09-11T22:17:30.924 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:17:30.924 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "scrub active (99 inodes in the stack)", 2024-09-11T22:17:30.924 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-11T22:17:30.924 INFO:teuthology.orchestra.run.smithi050.stdout: "f7497bca-b71f-4809-83cf-bfd89b000042": { 2024-09-11T22:17:30.924 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "~mds0", 2024-09-11T22:17:30.924 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "f7497bca-b71f-4809-83cf-bfd89b000042", 2024-09-11T22:17:30.924 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive" 2024-09-11T22:17:30.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:17:30.925 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:17:30.925 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:17:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.920+0000 7f968f74b640 1 -- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f966c06bf00 msgr2=0x7f966c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.920+0000 7f968f74b640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f966c06bf00 0x7f966c06e3c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f968815e430 tx=0x7f9684009190 comp rx=0 tx=0).stop 2024-09-11T22:17:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.920+0000 7f968f74b640 1 -- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f968815e8e0 msgr2=0x7f9688159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:17:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.920+0000 7f968f74b640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f968815e8e0 0x7f9688159460 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f967800c4d0 tx=0x7f967800c990 comp rx=0 tx=0).stop 2024-09-11T22:17:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.920+0000 7f968f74b640 1 -- 172.21.15.50:0/1917150609 shutdown_connections 2024-09-11T22:17:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.920+0000 7f968f74b640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f966c06bf00 0x7f966c06e3c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.920+0000 7f968f74b640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f968815e8e0 0x7f9688159460 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.920+0000 7f968f74b640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9688162350 0x7f96881559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.920+0000 7f968f74b640 1 --2- 172.21.15.50:0/1917150609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96880d1580 0x7f9688156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:17:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.920+0000 7f968f74b640 1 -- 172.21.15.50:0/1917150609 >> 172.21.15.50:0/1917150609 conn(0x7f9688067ba0 msgr2=0x7f9688067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:17:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.920+0000 7f968f74b640 1 -- 172.21.15.50:0/1917150609 shutdown_connections 2024-09-11T22:17:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:17:30.920+0000 7f968f74b640 1 -- 172.21.15.50:0/1917150609 wait complete. 2024-09-11T22:17:30.934 INFO:tasks.cephfs.filesystem:scrub status for tag:f7497bca-b71f-4809-83cf-bfd89b000042 - {'path': '~mds0', 'tag': 'f7497bca-b71f-4809-83cf-bfd89b000042', 'options': 'recursive'} 2024-09-11T22:17:43.313 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:17:43.316 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:18:00.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:00.935 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-11T22:18:01.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.057+0000 7fe1b7fff640 1 Processor -- start 2024-09-11T22:18:01.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.058+0000 7fe1b7fff640 1 -- start start 2024-09-11T22:18:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.058+0000 7fe1b7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe1b815c210 0x7fe1b815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.058+0000 7fe1b7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1b80cf220 0x7fe1b80cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.058+0000 7fe1b7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b80cd560 con 0x7fe1b80ccda0 2024-09-11T22:18:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.058+0000 7fe1b7fff640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe1b80cde00 con 0x7fe1b80cf220 2024-09-11T22:18:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.058+0000 7fe1b7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe1b80cd840 con 0x7fe1b815c210 2024-09-11T22:18:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.059+0000 7fe1b77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1b80cf220 0x7fe1b80cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.059+0000 7fe1b77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1b80cf220 0x7fe1b80cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38840/0 (socket says 172.21.15.50:38840) 2024-09-11T22:18:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.059+0000 7fe1b77fe640 1 -- 172.21.15.50:0/1584042951 learned_addr learned my addr 172.21.15.50:0/1584042951 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.059+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/1584042951 >> v2:172.21.15.77:3300/0 conn(0x7fe1b815c210 0x7fe1b815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.059+0000 7fe1b77fe640 1 -- 172.21.15.50:0/1584042951 >> v2:172.21.15.77:3300/0 conn(0x7fe1b815c210 msgr2=0x7fe1b815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.059+0000 7fe1b77fe640 1 --2- 172.21.15.50:0/1584042951 >> v2:172.21.15.77:3300/0 conn(0x7fe1b815c210 0x7fe1b815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.059+0000 7fe1b77fe640 1 -- 172.21.15.50:0/1584042951 >> v1:172.21.15.77:6789/0 conn(0x7fe1b80ccda0 legacy=0x7fe1b806cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.059+0000 7fe1b77fe640 1 -- 172.21.15.50:0/1584042951 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b80cdb20 con 0x7fe1b80cf220 2024-09-11T22:18:01.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.060+0000 7fe1b77fe640 1 --2- 172.21.15.50:0/1584042951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b80cf220 0x7fe1b80cf650 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80b31c0 tx=0x7fe1b002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73031344d1c19f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.060+0000 7fe1b67fc640 1 -- 172.21.15.50:0/1584042951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0036070 con 0x7fe1b80cf220 2024-09-11T22:18:01.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.060+0000 7fe1b67fc640 1 -- 172.21.15.50:0/1584042951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b0031600 con 0x7fe1b80cf220 2024-09-11T22:18:01.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.060+0000 7fe1b67fc640 1 -- 172.21.15.50:0/1584042951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00319d0 con 0x7fe1b80cf220 2024-09-11T22:18:01.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.060+0000 7fe1b7fff640 1 -- 172.21.15.50:0/1584042951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b80cf220 msgr2=0x7fe1b80cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.060+0000 7fe1b7fff640 1 --2- 172.21.15.50:0/1584042951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b80cf220 0x7fe1b80cf650 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80b31c0 tx=0x7fe1b002a6a0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.060+0000 7fe1b7fff640 1 -- 172.21.15.50:0/1584042951 shutdown_connections 2024-09-11T22:18:01.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.060+0000 7fe1b7fff640 1 --2- 172.21.15.50:0/1584042951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b80cf220 0x7fe1b80cf650 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.060+0000 7fe1b7fff640 1 --2- 172.21.15.50:0/1584042951 >> v2:172.21.15.77:3300/0 conn(0x7fe1b815c210 0x7fe1b815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.060+0000 7fe1b7fff640 1 -- 172.21.15.50:0/1584042951 >> 172.21.15.50:0/1584042951 conn(0x7fe1b80b5d70 msgr2=0x7fe1b80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.061+0000 7fe1b7fff640 1 -- 172.21.15.50:0/1584042951 shutdown_connections 2024-09-11T22:18:01.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.061+0000 7fe1b7fff640 1 -- 172.21.15.50:0/1584042951 wait complete. 2024-09-11T22:18:01.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.062+0000 7fe1b7fff640 1 Processor -- start 2024-09-11T22:18:01.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.062+0000 7fe1b7fff640 1 -- start start 2024-09-11T22:18:01.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.062+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1b80ccda0 0x7fe1b81f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b80cf220 0x7fe1b80c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1b815c210 0x7fe1b80c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1b7fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b80cd210 con 0x7fe1b80cf220 2024-09-11T22:18:01.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1b7fff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b80cfb90 con 0x7fe1b815c210 2024-09-11T22:18:01.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1b7fff640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe1b815c5f0 con 0x7fe1b80ccda0 2024-09-11T22:18:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b80cf220 0x7fe1b80c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b80cf220 0x7fe1b80c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38848/0 (socket says 172.21.15.50:38848) 2024-09-11T22:18:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1affff640 1 -- 172.21.15.50:0/2253714706 learned_addr learned my addr 172.21.15.50:0/2253714706 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1b77fe640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1b815c210 0x7fe1b80c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1b80ccda0 0x7fe1b81f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1affff640 1 -- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1b80ccda0 msgr2=0x7fe1b81f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1affff640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1b80ccda0 0x7fe1b81f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1affff640 1 -- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1b815c210 msgr2=0x7fe1b80c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1affff640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1b815c210 0x7fe1b80c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1affff640 1 -- 172.21.15.50:0/2253714706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b81f53b0 con 0x7fe1b80cf220 2024-09-11T22:18:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1affff640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b80cf220 0x7fe1b80c6070 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000c400 tx=0x7fe1a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1b4ff9640 1 -- 172.21.15.50:0/2253714706 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00052d0 con 0x7fe1b80cf220 2024-09-11T22:18:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1b4ff9640 1 -- 172.21.15.50:0/2253714706 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a0005490 con 0x7fe1b80cf220 2024-09-11T22:18:01.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1b4ff9640 1 -- 172.21.15.50:0/2253714706 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0007260 con 0x7fe1b80cf220 2024-09-11T22:18:01.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1b7fff640 1 -- 172.21.15.50:0/2253714706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b81f5690 con 0x7fe1b80cf220 2024-09-11T22:18:01.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.063+0000 7fe1b7fff640 1 -- 172.21.15.50:0/2253714706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b81f5c50 con 0x7fe1b80cf220 2024-09-11T22:18:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.065+0000 7fe1b4ff9640 1 -- 172.21.15.50:0/2253714706 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe1a0007400 con 0x7fe1b80cf220 2024-09-11T22:18:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.065+0000 7fe1b4ff9640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe19806be30 0x7fe19806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.066+0000 7fe1b4ff9640 1 -- 172.21.15.50:0/2253714706 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7fe1a008a310 con 0x7fe1b80cf220 2024-09-11T22:18:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.066+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe19806be30 0x7fe19806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.066+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe19806be30 0x7fe19806e2f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8159580 tx=0x7fe1a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.066+0000 7fe1c0678740 1 Processor -- start 2024-09-11T22:18:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.066+0000 7fe1c0678740 1 -- start start 2024-09-11T22:18:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.067+0000 7fe1c0678740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068b1970 0x55b5068b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.067+0000 7fe1c0678740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068cc330 0x55b5068cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.067+0000 7fe1c0678740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068852d0 0x55b5068ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.067+0000 7fe1c0678740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b5067ea6f0 con 0x55b5068b1970 2024-09-11T22:18:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.067+0000 7fe1c0678740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b506792330 con 0x55b5068852d0 2024-09-11T22:18:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.067+0000 7fe1c0678740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b5067e66b0 con 0x55b5068cc330 2024-09-11T22:18:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.067+0000 7fe1b6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068b1970 0x55b5068b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.068+0000 7fe1b6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068b1970 0x55b5068b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38854/0 (socket says 172.21.15.50:38854) 2024-09-11T22:18:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.068+0000 7fe1b6ffd640 1 -- 172.21.15.50:0/224725815 learned_addr learned my addr 172.21.15.50:0/224725815 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.068+0000 7fe1affff640 1 --2- 172.21.15.50:0/224725815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068cc330 0x55b5068cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.068+0000 7fe1b77fe640 1 --2- 172.21.15.50:0/224725815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068852d0 0x55b5068ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.068+0000 7fe1b6ffd640 1 -- 172.21.15.50:0/224725815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068cc330 msgr2=0x55b5068cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.068+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/224725815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068cc330 0x55b5068cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.068+0000 7fe1b6ffd640 1 -- 172.21.15.50:0/224725815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068852d0 msgr2=0x55b5068ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.068+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/224725815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068852d0 0x55b5068ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.068+0000 7fe1b6ffd640 1 -- 172.21.15.50:0/224725815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5067b80d0 con 0x55b5068b1970 2024-09-11T22:18:01.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.068+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/224725815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068b1970 0x55b5068b1d50 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8010af0 tx=0x7fe1a8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3b468b5c3e35b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.068+0000 7fe1ad7fa640 1 -- 172.21.15.50:0/224725815 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a801c050 con 0x55b5068b1970 2024-09-11T22:18:01.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.068+0000 7fe1ad7fa640 1 -- 172.21.15.50:0/224725815 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a8026070 con 0x55b5068b1970 2024-09-11T22:18:01.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.068+0000 7fe1ad7fa640 1 -- 172.21.15.50:0/224725815 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8021440 con 0x55b5068b1970 2024-09-11T22:18:01.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.069+0000 7fe1c0678740 1 -- 172.21.15.50:0/224725815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068b1970 msgr2=0x55b5068b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.069+0000 7fe1c0678740 1 --2- 172.21.15.50:0/224725815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068b1970 0x55b5068b1d50 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8010af0 tx=0x7fe1a8013000 comp rx=0 tx=0).stop 2024-09-11T22:18:01.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.069+0000 7fe1c0678740 1 -- 172.21.15.50:0/224725815 shutdown_connections 2024-09-11T22:18:01.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.069+0000 7fe1c0678740 1 --2- 172.21.15.50:0/224725815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068cc330 0x55b5068cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.069+0000 7fe1c0678740 1 --2- 172.21.15.50:0/224725815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068852d0 0x55b5068ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.069+0000 7fe1c0678740 1 --2- 172.21.15.50:0/224725815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068b1970 0x55b5068b1d50 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.069+0000 7fe1c0678740 1 -- 172.21.15.50:0/224725815 >> 172.21.15.50:0/224725815 conn(0x55b506884560 msgr2=0x55b5068cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.069+0000 7fe1c0678740 1 -- 172.21.15.50:0/224725815 shutdown_connections 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.069+0000 7fe1c0678740 1 -- 172.21.15.50:0/224725815 wait complete. 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.070+0000 7fe1c0678740 1 -- start start 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.070+0000 7fe1c0678740 1 Processor -- start 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.070+0000 7fe1c0678740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068b1970 0x55b506886ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.070+0000 7fe1c0678740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 0x55b5068b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.070+0000 7fe1c0678740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b506885770 0x55b5068ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.070+0000 7fe1c0678740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b5068b2730 con 0x55b5068cc330 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.070+0000 7fe1c0678740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b5067734f0 con 0x55b506885770 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.070+0000 7fe1c0678740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b5068ccfc0 con 0x55b5068b1970 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.070+0000 7fe1c0678740 10 client.0 _ll_register_callbacks cb 0x55b506794b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 0x55b5068b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 0x55b5068b3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38858/0 (socket says 172.21.15.50:38858) 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1affff640 1 -- 172.21.15.50:0/2299074133 learned_addr learned my addr 172.21.15.50:0/2299074133 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/2299074133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068b1970 0x55b506886ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1b77fe640 1 --2- 172.21.15.50:0/2299074133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b506885770 0x55b5068ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1affff640 1 -- 172.21.15.50:0/2299074133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068b1970 msgr2=0x55b506886ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1affff640 1 --2- 172.21.15.50:0/2299074133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068b1970 0x55b506886ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1affff640 1 -- 172.21.15.50:0/2299074133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b506885770 msgr2=0x55b5068ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1affff640 1 --2- 172.21.15.50:0/2299074133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b506885770 0x55b5068ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1affff640 1 -- 172.21.15.50:0/2299074133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5065c77d0 con 0x55b5068cc330 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1affff640 1 --2- 172.21.15.50:0/2299074133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 0x55b5068b3be0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0058350 tx=0x7fe1a00587a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38efaa9499920a20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1967fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1967fc640 1 -- 172.21.15.50:0/2299074133 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0056a10 con 0x55b5068cc330 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1967fc640 1 -- 172.21.15.50:0/2299074133 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7fe1a0057aa0 con 0x55b5068cc330 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1c0678740 1 -- 172.21.15.50:0/2299074133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1a8026070 con 0x55b5068cc330 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1967fc640 1 -- 172.21.15.50:0/2299074133 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fe1a0057ca0 con 0x55b5068cc330 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1c0678740 10 client.7827 fetch_fsmap learned FSMap version 77 2024-09-11T22:18:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1c0678740 1 -- 172.21.15.50:0/2299074133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x55b5064fd3f0 con 0x55b5068cc330 2024-09-11T22:18:01.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.071+0000 7fe1967fc640 1 -- 172.21.15.50:0/2299074133 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a8026070 con 0x55b5068cc330 2024-09-11T22:18:01.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.072+0000 7fe1967fc640 1 -- 172.21.15.50:0/2299074133 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7fe1a005dae0 con 0x55b5068cc330 2024-09-11T22:18:01.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.072+0000 7fe1c0678740 10 client.7827 fetch_fsmap finished waiting for FSMap version 77 2024-09-11T22:18:01.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.072+0000 7fe1c0678740 10 client.7827 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-11T22:18:01.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.072+0000 7fe1c0678740 20 client.7827 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:01.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.072+0000 7fe1c0678740 1 --2- 172.21.15.50:0/2299074133 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55b5068b4db0 0x55b5068b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.072+0000 7fe1c0678740 4 client.7827 mds_command: new command op to 7605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:01.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.072+0000 7fe1c0678740 1 -- 172.21.15.50:0/2299074133 --> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5067f7e20 con 0x55b5068b4db0 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.072+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/2299074133 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55b5068b4db0 0x55b5068b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.072+0000 7fe1967fc640 10 client.7827 ms_handle_connect on v2:172.21.15.50:6832/2355059741 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.072+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/2299074133 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55b5068b4db0 0x55b5068b51b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e9c6416406d8797 server_cookie=754cfee24eb1558a in_seq=0 out_seq=0 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1967fc640 1 -- 172.21.15.50:0/2299074133 <== mds.0 v2:172.21.15.50:6832/2355059741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5067f7e20 con 0x55b5068b4db0 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1967fc640 10 client.7827 handle_command_reply: tid=0 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1c0678740 1 client.7827 shutdown 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1c0678740 1 -- 172.21.15.50:0/2299074133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 msgr2=0x55b5068b3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1c0678740 1 --2- 172.21.15.50:0/2299074133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 0x55b5068b3be0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0058350 tx=0x7fe1a00587a0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1c0678740 1 -- 172.21.15.50:0/2299074133 shutdown_connections 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1c0678740 1 --2- 172.21.15.50:0/2299074133 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55b5068b4db0 0x55b5068b51b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1c0678740 1 --2- 172.21.15.50:0/2299074133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b506885770 0x55b5068ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1c0678740 1 --2- 172.21.15.50:0/2299074133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 0x55b5068b3be0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1c0678740 1 --2- 172.21.15.50:0/2299074133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068b1970 0x55b506886ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1967fc640 0 client.7827 ms_handle_reset on v2:172.21.15.50:6832/2355059741 2024-09-11T22:18:01.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1c0678740 1 -- 172.21.15.50:0/2299074133 >> 172.21.15.50:0/2299074133 conn(0x55b5068852d0 msgr2=0x55b5068cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1c0678740 1 -- 172.21.15.50:0/2299074133 shutdown_connections 2024-09-11T22:18:01.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1c0678740 1 -- 172.21.15.50:0/2299074133 wait complete. 2024-09-11T22:18:01.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.073+0000 7fe1c0678740 20 client.7827 trim_cache size 0 max 16384 2024-09-11T22:18:01.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.090+0000 7fe1c0678740 1 Processor -- start 2024-09-11T22:18:01.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.091+0000 7fe1c0678740 1 -- start start 2024-09-11T22:18:01.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.091+0000 7fe1c0678740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068b1970 0x55b5068881e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.091+0000 7fe1c0678740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 0x55b5068f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.091+0000 7fe1c0678740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068d1480 0x55b5068f4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.091+0000 7fe1c0678740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b81fc670 con 0x55b5068cc330 2024-09-11T22:18:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.091+0000 7fe1c0678740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b80b4980 con 0x55b5068b1970 2024-09-11T22:18:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.091+0000 7fe1c0678740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe1b8153c30 con 0x55b5068d1480 2024-09-11T22:18:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.091+0000 7fe1affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 0x55b5068f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.091+0000 7fe1affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 0x55b5068f3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38864/0 (socket says 172.21.15.50:38864) 2024-09-11T22:18:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.091+0000 7fe1affff640 1 -- 172.21.15.50:0/2451456098 learned_addr learned my addr 172.21.15.50:0/2451456098 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.092+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/2451456098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068b1970 0x55b5068881e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.092+0000 7fe1affff640 1 -- 172.21.15.50:0/2451456098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068d1480 msgr2=0x55b5068f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.092+0000 7fe1affff640 1 --2- 172.21.15.50:0/2451456098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068d1480 0x55b5068f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.092+0000 7fe1affff640 1 -- 172.21.15.50:0/2451456098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068b1970 msgr2=0x55b5068881e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.092+0000 7fe1affff640 1 --2- 172.21.15.50:0/2451456098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068b1970 0x55b5068881e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.092+0000 7fe1affff640 1 -- 172.21.15.50:0/2451456098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5068cd290 con 0x55b5068cc330 2024-09-11T22:18:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.092+0000 7fe1affff640 1 --2- 172.21.15.50:0/2451456098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 0x55b5068f3ed0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00585e0 tx=0x7fe1a005c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622ce9a7dc8deddd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.092+0000 7fe1acff9640 1 -- 172.21.15.50:0/2451456098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0061180 con 0x55b5068cc330 2024-09-11T22:18:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.092+0000 7fe1acff9640 1 -- 172.21.15.50:0/2451456098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a0083070 con 0x55b5068cc330 2024-09-11T22:18:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.092+0000 7fe1acff9640 1 -- 172.21.15.50:0/2451456098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0054cc0 con 0x55b5068cc330 2024-09-11T22:18:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.093+0000 7fe1c0678740 1 -- 172.21.15.50:0/2451456098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 msgr2=0x55b5068f3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.093+0000 7fe1c0678740 1 --2- 172.21.15.50:0/2451456098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 0x55b5068f3ed0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00585e0 tx=0x7fe1a005c000 comp rx=0 tx=0).stop 2024-09-11T22:18:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.093+0000 7fe1c0678740 1 -- 172.21.15.50:0/2451456098 shutdown_connections 2024-09-11T22:18:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.093+0000 7fe1c0678740 1 --2- 172.21.15.50:0/2451456098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068d1480 0x55b5068f4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.093+0000 7fe1c0678740 1 --2- 172.21.15.50:0/2451456098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068cc330 0x55b5068f3ed0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.093+0000 7fe1c0678740 1 --2- 172.21.15.50:0/2451456098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068b1970 0x55b5068881e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.093+0000 7fe1c0678740 1 -- 172.21.15.50:0/2451456098 >> 172.21.15.50:0/2451456098 conn(0x55b5068852d0 msgr2=0x55b50687dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.093+0000 7fe1c0678740 1 -- 172.21.15.50:0/2451456098 shutdown_connections 2024-09-11T22:18:01.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.093+0000 7fe1c0678740 1 -- 172.21.15.50:0/2451456098 wait complete. 2024-09-11T22:18:01.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.093+0000 7fe1c0678740 1 -- start start 2024-09-11T22:18:01.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.093+0000 7fe1c0678740 1 Processor -- start 2024-09-11T22:18:01.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.094+0000 7fe1c0678740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068b1970 0x55b5068b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.094+0000 7fe1c0678740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068cc330 0x55b5069461d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.094+0000 7fe1c0678740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068d1480 0x55b5068e3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.094+0000 7fe1c0678740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b506887040 con 0x55b5068d1480 2024-09-11T22:18:01.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.094+0000 7fe1c0678740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b8154280 con 0x55b5068b1970 2024-09-11T22:18:01.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.094+0000 7fe1c0678740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b5068d5fd0 con 0x55b5068cc330 2024-09-11T22:18:01.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.094+0000 7fe1c0678740 10 client.0 _ll_register_callbacks cb 0x7fe1a00011e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:01.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.094+0000 7fe1b77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068d1480 0x55b5068e3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.094+0000 7fe1b77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068d1480 0x55b5068e3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38866/0 (socket says 172.21.15.50:38866) 2024-09-11T22:18:01.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.094+0000 7fe1b77fe640 1 -- 172.21.15.50:0/1045892601 learned_addr learned my addr 172.21.15.50:0/1045892601 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.094+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068b1970 0x55b5068b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.094+0000 7fe1affff640 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068cc330 0x55b5069461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1b77fe640 1 -- 172.21.15.50:0/1045892601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068cc330 msgr2=0x55b5069461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1b77fe640 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068cc330 0x55b5069461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1b77fe640 1 -- 172.21.15.50:0/1045892601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068b1970 msgr2=0x55b5068b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1b77fe640 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068b1970 0x55b5068b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1b77fe640 1 -- 172.21.15.50:0/1045892601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5064bd0f0 con 0x55b5068d1480 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1affff640 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068cc330 0x55b5069461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068b1970 0x55b5068b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1b77fe640 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068d1480 0x55b5068e3580 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0034040 tx=0x7fe1b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db50442778175b5e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1967fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1967fc640 1 -- 172.21.15.50:0/1045892601 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0036040 con 0x55b5068d1480 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1967fc640 1 -- 172.21.15.50:0/1045892601 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7fe1b0031c50 con 0x55b5068d1480 2024-09-11T22:18:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1c0678740 1 -- 172.21.15.50:0/1045892601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1a0083070 con 0x55b5068d1480 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1967fc640 1 -- 172.21.15.50:0/1045892601 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fe1b0052050 con 0x55b5068d1480 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1c0678740 10 client.7833 fetch_fsmap learned FSMap version 77 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1c0678740 1 -- 172.21.15.50:0/1045892601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x55b5068c8f20 con 0x55b5068d1480 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1967fc640 1 -- 172.21.15.50:0/1045892601 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a0083070 con 0x55b5068d1480 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1967fc640 1 -- 172.21.15.50:0/1045892601 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7fe1b0055020 con 0x55b5068d1480 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1c0678740 10 client.7833 fetch_fsmap finished waiting for FSMap version 77 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1c0678740 10 client.7833 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1c0678740 20 client.7833 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1c0678740 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55b5068f2ba0 0x55b5068e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1c0678740 4 client.7833 mds_command: new command op to 7605 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.095+0000 7fe1c0678740 1 -- 172.21.15.50:0/1045892601 --> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b5067f2170 con 0x55b5068f2ba0 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55b5068f2ba0 0x55b5068e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1967fc640 10 client.7833 ms_handle_connect on v2:172.21.15.50:6832/2355059741 2024-09-11T22:18:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1b6ffd640 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55b5068f2ba0 0x55b5068e3ac0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be5f11232d42ef3a server_cookie=57dafdc17528bf26 in_seq=0 out_seq=0 2024-09-11T22:18:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1967fc640 1 -- 172.21.15.50:0/1045892601 <== mds.0 v2:172.21.15.50:6832/2355059741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b5067f2170 con 0x55b5068f2ba0 2024-09-11T22:18:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1967fc640 10 client.7833 handle_command_reply: tid=0 2024-09-11T22:18:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1c0678740 1 client.7833 shutdown 2024-09-11T22:18:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1c0678740 1 -- 172.21.15.50:0/1045892601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068d1480 msgr2=0x55b5068e3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1c0678740 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068d1480 0x55b5068e3580 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0034040 tx=0x7fe1b0004a40 comp rx=0 tx=0).stop 2024-09-11T22:18:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1c0678740 1 -- 172.21.15.50:0/1045892601 shutdown_connections 2024-09-11T22:18:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1c0678740 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x55b5068f2ba0 0x55b5068e3ac0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1c0678740 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b5068cc330 0x55b5069461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1c0678740 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5068d1480 0x55b5068e3580 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1967fc640 0 client.7833 ms_handle_reset on v2:172.21.15.50:6832/2355059741 2024-09-11T22:18:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1c0678740 1 --2- 172.21.15.50:0/1045892601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b5068b1970 0x55b5068b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1c0678740 1 -- 172.21.15.50:0/1045892601 >> 172.21.15.50:0/1045892601 conn(0x55b5068852d0 msgr2=0x55b5068c8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1c0678740 1 -- 172.21.15.50:0/1045892601 shutdown_connections 2024-09-11T22:18:01.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1c0678740 1 -- 172.21.15.50:0/1045892601 wait complete. 2024-09-11T22:18:01.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.096+0000 7fe1c0678740 20 client.7833 trim_cache size 0 max 16384 2024-09-11T22:18:01.105 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:18:01.105 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-11T22:18:01.105 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-11T22:18:01.105 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:18:01.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.097+0000 7fe1b7fff640 1 -- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe19806be30 msgr2=0x7fe19806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.097+0000 7fe1b7fff640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe19806be30 0x7fe19806e2f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8159580 tx=0x7fe1a8008040 comp rx=0 tx=0).stop 2024-09-11T22:18:01.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.097+0000 7fe1b7fff640 1 -- 172.21.15.50:0/2253714706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b80cf220 msgr2=0x7fe1b80c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.097+0000 7fe1b7fff640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b80cf220 0x7fe1b80c6070 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000c400 tx=0x7fe1a000c8c0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.097+0000 7fe1b7fff640 1 -- 172.21.15.50:0/2253714706 shutdown_connections 2024-09-11T22:18:01.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.097+0000 7fe1b7fff640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe19806be30 0x7fe19806e2f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.097+0000 7fe1b7fff640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1b815c210 0x7fe1b80c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.097+0000 7fe1b7fff640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1b80cf220 0x7fe1b80c6070 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.097+0000 7fe1b7fff640 1 --2- 172.21.15.50:0/2253714706 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1b80ccda0 0x7fe1b81f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.097+0000 7fe1b7fff640 1 -- 172.21.15.50:0/2253714706 >> 172.21.15.50:0/2253714706 conn(0x7fe1b80b5d70 msgr2=0x7fe1b815af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.097+0000 7fe1b7fff640 1 -- 172.21.15.50:0/2253714706 shutdown_connections 2024-09-11T22:18:01.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.097+0000 7fe1b7fff640 1 -- 172.21.15.50:0/2253714706 wait complete. 2024-09-11T22:18:01.108 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:18:01.109 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-11T22:18:01.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.213+0000 7f6a61378640 1 Processor -- start 2024-09-11T22:18:01.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.213+0000 7f6a61378640 1 -- start start 2024-09-11T22:18:01.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.214+0000 7f6a61378640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a5c15c2c0 0x7f6a5c0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.214+0000 7f6a61378640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5c0b3e10 0x7f6a5c0cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.214+0000 7f6a61378640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a5c0b4f00 con 0x7f6a5c0d0410 2024-09-11T22:18:01.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.214+0000 7f6a61378640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6a5c0cf7a0 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.214+0000 7f6a61378640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5c0d0840 con 0x7f6a5c0b3e10 2024-09-11T22:18:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.215+0000 7f6a5affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a5c15c2c0 0x7f6a5c0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.215+0000 7f6a5b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6a5c0d0410 0x7f6a5c15fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:54508/0 (socket says 172.21.15.50:54508) 2024-09-11T22:18:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.215+0000 7f6a5a7fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5c0b3e10 0x7f6a5c0cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.215+0000 7f6a5b7fe640 1 -- 172.21.15.50:0/348304765 learned_addr learned my addr 172.21.15.50:0/348304765 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.215+0000 7f6a5affd640 1 -- 172.21.15.50:0/348304765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5c0b3e10 msgr2=0x7f6a5c0cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.215+0000 7f6a5affd640 1 --2- 172.21.15.50:0/348304765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5c0b3e10 0x7f6a5c0cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.215+0000 7f6a5affd640 1 -- 172.21.15.50:0/348304765 >> v1:172.21.15.77:6789/0 conn(0x7f6a5c0d0410 legacy=0x7f6a5c15fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.215+0000 7f6a5affd640 1 -- 172.21.15.50:0/348304765 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5c0b4360 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.216+0000 7f6a5affd640 1 --2- 172.21.15.50:0/348304765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5c15c2c0 0x7f6a5c0b46a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6a540097a0 tx=0x7f6a5402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce2f46524aa9ef55 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.216+0000 7f6a59ffb640 1 -- 172.21.15.50:0/348304765 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54037070 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.216+0000 7f6a59ffb640 1 -- 172.21.15.50:0/348304765 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5402ae50 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.216+0000 7f6a59ffb640 1 -- 172.21.15.50:0/348304765 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54032660 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.216+0000 7f6a61378640 1 -- 172.21.15.50:0/348304765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5c15c2c0 msgr2=0x7f6a5c0b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.216+0000 7f6a61378640 1 --2- 172.21.15.50:0/348304765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5c15c2c0 0x7f6a5c0b46a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6a540097a0 tx=0x7f6a5402a100 comp rx=0 tx=0).stop 2024-09-11T22:18:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.216+0000 7f6a61378640 1 -- 172.21.15.50:0/348304765 shutdown_connections 2024-09-11T22:18:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.216+0000 7f6a61378640 1 --2- 172.21.15.50:0/348304765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5c0b3e10 0x7f6a5c0cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.216+0000 7f6a61378640 1 --2- 172.21.15.50:0/348304765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5c15c2c0 0x7f6a5c0b46a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.216+0000 7f6a61378640 1 -- 172.21.15.50:0/348304765 >> 172.21.15.50:0/348304765 conn(0x7f6a5c0679c0 msgr2=0x7f6a5c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.216+0000 7f6a61378640 1 -- 172.21.15.50:0/348304765 shutdown_connections 2024-09-11T22:18:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.216+0000 7f6a61378640 1 -- 172.21.15.50:0/348304765 wait complete. 2024-09-11T22:18:01.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.218+0000 7f6a61378640 1 Processor -- start 2024-09-11T22:18:01.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.218+0000 7f6a61378640 1 -- start start 2024-09-11T22:18:01.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.218+0000 7f6a61378640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5c0b3e10 0x7f6a5c14eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.218+0000 7f6a61378640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5c0d0410 0x7f6a5c15e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.218+0000 7f6a61378640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5c15c2c0 0x7f6a5c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.218+0000 7f6a61378640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c0cfc10 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.218+0000 7f6a61378640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c0b54a0 con 0x7f6a5c0b3e10 2024-09-11T22:18:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.218+0000 7f6a61378640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5c0ce200 con 0x7f6a5c0d0410 2024-09-11T22:18:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a5b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5c15c2c0 0x7f6a5c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a5a7fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5c0d0410 0x7f6a5c15e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a5b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5c15c2c0 0x7f6a5c0b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38882/0 (socket says 172.21.15.50:38882) 2024-09-11T22:18:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a5b7fe640 1 -- 172.21.15.50:0/911145123 learned_addr learned my addr 172.21.15.50:0/911145123 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a5affd640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5c0b3e10 0x7f6a5c14eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a5b7fe640 1 -- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5c0d0410 msgr2=0x7f6a5c15e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a5b7fe640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5c0d0410 0x7f6a5c15e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a5b7fe640 1 -- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5c0b3e10 msgr2=0x7f6a5c14eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a5b7fe640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5c0b3e10 0x7f6a5c14eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a5b7fe640 1 -- 172.21.15.50:0/911145123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5c14efe0 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a5a7fc640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5c0d0410 0x7f6a5c15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a5b7fe640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5c15c2c0 0x7f6a5c0b20e0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00cbf0 tx=0x7f6a4c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a537fe640 1 -- 172.21.15.50:0/911145123 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c017070 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a537fe640 1 -- 172.21.15.50:0/911145123 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a4c00ad40 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a537fe640 1 -- 172.21.15.50:0/911145123 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c012600 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a61378640 1 -- 172.21.15.50:0/911145123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5c1f2810 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.219+0000 7f6a61378640 1 -- 172.21.15.50:0/911145123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a5c1f2dd0 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.221+0000 7f6a537fe640 1 -- 172.21.15.50:0/911145123 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a4c01a070 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.221+0000 7f6a537fe640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a3c06be30 0x7f6a3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.221+0000 7f6a537fe640 1 -- 172.21.15.50:0/911145123 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7f6a4c08ab00 con 0x7f6a5c15c2c0 2024-09-11T22:18:01.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.222+0000 7f6a5affd640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a3c06be30 0x7f6a3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.222+0000 7f6a5affd640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a3c06be30 0x7f6a3c06e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6a54034000 tx=0x7f6a5402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.222+0000 7f6a641f2740 1 Processor -- start 2024-09-11T22:18:01.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.222+0000 7f6a641f2740 1 -- start start 2024-09-11T22:18:01.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.223+0000 7f6a641f2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 0x56435073c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.223+0000 7f6a641f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350739da0 0x56435073b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.223+0000 7f6a641f2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073a200 0x56435071c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.223+0000 7f6a641f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5643506588d0 con 0x564350739da0 2024-09-11T22:18:01.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.223+0000 7f6a641f2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564350600620 con 0x56435073a200 2024-09-11T22:18:01.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.223+0000 7f6a641f2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564350654890 con 0x56435073c5e0 2024-09-11T22:18:01.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.223+0000 7f6a5a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350739da0 0x56435073b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.223+0000 7f6a5a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350739da0 0x56435073b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38892/0 (socket says 172.21.15.50:38892) 2024-09-11T22:18:01.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.223+0000 7f6a5a7fc640 1 -- 172.21.15.50:0/3809786521 learned_addr learned my addr 172.21.15.50:0/3809786521 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:01.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.223+0000 7f6a5b7fe640 1 --2- 172.21.15.50:0/3809786521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073a200 0x56435071c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.223+0000 7f6a5affd640 1 --2- 172.21.15.50:0/3809786521 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 0x56435073c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.224+0000 7f6a5a7fc640 1 -- 172.21.15.50:0/3809786521 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 msgr2=0x56435073c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.224+0000 7f6a5a7fc640 1 --2- 172.21.15.50:0/3809786521 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 0x56435073c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.224+0000 7f6a5a7fc640 1 -- 172.21.15.50:0/3809786521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073a200 msgr2=0x56435071c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.224+0000 7f6a5a7fc640 1 --2- 172.21.15.50:0/3809786521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073a200 0x56435071c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.224+0000 7f6a5a7fc640 1 -- 172.21.15.50:0/3809786521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643504357d0 con 0x564350739da0 2024-09-11T22:18:01.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.224+0000 7f6a5a7fc640 1 --2- 172.21.15.50:0/3809786521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350739da0 0x56435073b930 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009ea0 tx=0x7f6a44009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71fad14a4bc901a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.224+0000 7f6a50ff9640 1 -- 172.21.15.50:0/3809786521 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44019070 con 0x564350739da0 2024-09-11T22:18:01.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.224+0000 7f6a50ff9640 1 -- 172.21.15.50:0/3809786521 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44004240 con 0x564350739da0 2024-09-11T22:18:01.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.224+0000 7f6a50ff9640 1 -- 172.21.15.50:0/3809786521 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44003610 con 0x564350739da0 2024-09-11T22:18:01.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.225+0000 7f6a641f2740 1 -- 172.21.15.50:0/3809786521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350739da0 msgr2=0x56435073b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.225+0000 7f6a641f2740 1 --2- 172.21.15.50:0/3809786521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350739da0 0x56435073b930 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009ea0 tx=0x7f6a44009f90 comp rx=0 tx=0).stop 2024-09-11T22:18:01.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.225+0000 7f6a641f2740 1 -- 172.21.15.50:0/3809786521 shutdown_connections 2024-09-11T22:18:01.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.225+0000 7f6a641f2740 1 --2- 172.21.15.50:0/3809786521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073a200 0x56435071c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.225+0000 7f6a641f2740 1 --2- 172.21.15.50:0/3809786521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350739da0 0x56435073b930 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.225+0000 7f6a641f2740 1 --2- 172.21.15.50:0/3809786521 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 0x56435073c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.225+0000 7f6a641f2740 1 -- 172.21.15.50:0/3809786521 >> 172.21.15.50:0/3809786521 conn(0x5643506f2240 msgr2=0x56435073a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.225+0000 7f6a641f2740 1 -- 172.21.15.50:0/3809786521 shutdown_connections 2024-09-11T22:18:01.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.225+0000 7f6a641f2740 1 -- 172.21.15.50:0/3809786521 wait complete. 2024-09-11T22:18:01.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.225+0000 7f6a641f2740 1 -- start start 2024-09-11T22:18:01.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.225+0000 7f6a641f2740 1 Processor -- start 2024-09-11T22:18:01.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.226+0000 7f6a641f2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073a200 0x564350732cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.226+0000 7f6a641f2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 0x56435074b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.226+0000 7f6a641f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 0x5643507366a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.226+0000 7f6a641f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564350738d00 con 0x564350737970 2024-09-11T22:18:01.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.226+0000 7f6a641f2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5643505e1750 con 0x56435073a200 2024-09-11T22:18:01.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.226+0000 7f6a641f2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564350738fe0 con 0x56435073c5e0 2024-09-11T22:18:01.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.226+0000 7f6a641f2740 10 client.0 _ll_register_callbacks cb 0x564350605780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:01.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.226+0000 7f6a5b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 0x5643507366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.226+0000 7f6a5b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 0x5643507366a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38898/0 (socket says 172.21.15.50:38898) 2024-09-11T22:18:01.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.226+0000 7f6a5b7fe640 1 -- 172.21.15.50:0/3017778173 learned_addr learned my addr 172.21.15.50:0/3017778173 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:01.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.226+0000 7f6a5a7fc640 1 --2- 172.21.15.50:0/3017778173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 0x56435074b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.226+0000 7f6a5affd640 1 --2- 172.21.15.50:0/3017778173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073a200 0x564350732cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a5b7fe640 1 -- 172.21.15.50:0/3017778173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 msgr2=0x56435074b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a5b7fe640 1 --2- 172.21.15.50:0/3017778173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 0x56435074b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a5b7fe640 1 -- 172.21.15.50:0/3017778173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073a200 msgr2=0x564350732cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a5b7fe640 1 --2- 172.21.15.50:0/3017778173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073a200 0x564350732cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a5b7fe640 1 -- 172.21.15.50:0/3017778173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56435032b0f0 con 0x564350737970 2024-09-11T22:18:01.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a5b7fe640 1 --2- 172.21.15.50:0/3017778173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 0x5643507366a0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0552a0 tx=0x7f6a4c058f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba245b95e963077c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:01.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a39ffb640 1 -- 172.21.15.50:0/3017778173 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0616e0 con 0x564350737970 2024-09-11T22:18:01.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a39ffb640 1 -- 172.21.15.50:0/3017778173 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7f6a4c004b60 con 0x564350737970 2024-09-11T22:18:01.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a641f2740 1 -- 172.21.15.50:0/3017778173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a44004240 con 0x564350737970 2024-09-11T22:18:01.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a39ffb640 1 -- 172.21.15.50:0/3017778173 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f6a4c058290 con 0x564350737970 2024-09-11T22:18:01.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a641f2740 10 client.7842 fetch_fsmap learned FSMap version 77 2024-09-11T22:18:01.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a641f2740 1 -- 172.21.15.50:0/3017778173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x564350495f60 con 0x564350737970 2024-09-11T22:18:01.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a39ffb640 1 -- 172.21.15.50:0/3017778173 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44004240 con 0x564350737970 2024-09-11T22:18:01.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a39ffb640 1 -- 172.21.15.50:0/3017778173 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7f6a4c058430 con 0x564350737970 2024-09-11T22:18:01.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a641f2740 10 client.7842 fetch_fsmap finished waiting for FSMap version 77 2024-09-11T22:18:01.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a641f2740 10 client.7842 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-11T22:18:01.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a641f2740 20 client.7842 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:01.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a641f2740 1 --2- 172.21.15.50:0/3017778173 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x564350733a20 0x564350733e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a641f2740 4 client.7842 mds_command: new command op to 7605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a641f2740 1 -- 172.21.15.50:0/3017778173 --> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564350666000 con 0x564350733a20 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.227+0000 7f6a5affd640 1 --2- 172.21.15.50:0/3017778173 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x564350733a20 0x564350733e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.228+0000 7f6a39ffb640 10 client.7842 ms_handle_connect on v2:172.21.15.50:6832/2355059741 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.228+0000 7f6a5affd640 1 --2- 172.21.15.50:0/3017778173 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x564350733a20 0x564350733e30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc07d95bde81b6a8 server_cookie=17d5945faeaa5dda in_seq=0 out_seq=0 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.228+0000 7f6a39ffb640 1 -- 172.21.15.50:0/3017778173 <== mds.0 v2:172.21.15.50:6832/2355059741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564350666000 con 0x564350733a20 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.228+0000 7f6a39ffb640 10 client.7842 handle_command_reply: tid=0 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.228+0000 7f6a641f2740 1 client.7842 shutdown 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.229+0000 7f6a641f2740 1 -- 172.21.15.50:0/3017778173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 msgr2=0x5643507366a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.229+0000 7f6a641f2740 1 --2- 172.21.15.50:0/3017778173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 0x5643507366a0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0552a0 tx=0x7f6a4c058f00 comp rx=0 tx=0).stop 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.229+0000 7f6a641f2740 1 -- 172.21.15.50:0/3017778173 shutdown_connections 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.229+0000 7f6a641f2740 1 --2- 172.21.15.50:0/3017778173 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x564350733a20 0x564350733e30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.229+0000 7f6a641f2740 1 --2- 172.21.15.50:0/3017778173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 0x56435074b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.229+0000 7f6a641f2740 1 --2- 172.21.15.50:0/3017778173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 0x5643507366a0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.229+0000 7f6a39ffb640 0 client.7842 ms_handle_reset on v2:172.21.15.50:6832/2355059741 2024-09-11T22:18:01.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.229+0000 7f6a641f2740 1 --2- 172.21.15.50:0/3017778173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073a200 0x564350732cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.229+0000 7f6a641f2740 1 -- 172.21.15.50:0/3017778173 >> 172.21.15.50:0/3017778173 conn(0x564350739da0 msgr2=0x56435073a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.229+0000 7f6a641f2740 1 -- 172.21.15.50:0/3017778173 shutdown_connections 2024-09-11T22:18:01.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.229+0000 7f6a641f2740 1 -- 172.21.15.50:0/3017778173 wait complete. 2024-09-11T22:18:01.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.229+0000 7f6a641f2740 20 client.7842 trim_cache size 0 max 16384 2024-09-11T22:18:01.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.245+0000 7f6a641f2740 1 Processor -- start 2024-09-11T22:18:01.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.245+0000 7f6a641f2740 1 -- start start 2024-09-11T22:18:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a641f2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564350737970 0x564350732c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a641f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56435073a200 0x5643507331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a641f2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 0x56435074a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a641f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c1fecf0 con 0x56435073a200 2024-09-11T22:18:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a641f2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c1f6a10 con 0x564350737970 2024-09-11T22:18:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a641f2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5c1f5d70 con 0x56435073c5e0 2024-09-11T22:18:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a5a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56435073a200 0x5643507331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a5a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56435073a200 0x5643507331d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38900/0 (socket says 172.21.15.50:38900) 2024-09-11T22:18:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a5a7fc640 1 -- 172.21.15.50:0/2553726978 learned_addr learned my addr 172.21.15.50:0/2553726978 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a5b7fe640 1 --2- 172.21.15.50:0/2553726978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 0x56435074a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a5affd640 1 --2- 172.21.15.50:0/2553726978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564350737970 0x564350732c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a5a7fc640 1 -- 172.21.15.50:0/2553726978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 msgr2=0x56435074a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a5a7fc640 1 --2- 172.21.15.50:0/2553726978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 0x56435074a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a5a7fc640 1 -- 172.21.15.50:0/2553726978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564350737970 msgr2=0x564350732c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a5a7fc640 1 --2- 172.21.15.50:0/2553726978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564350737970 0x564350732c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a5a7fc640 1 -- 172.21.15.50:0/2553726978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643503041b0 con 0x56435073a200 2024-09-11T22:18:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a5a7fc640 1 --2- 172.21.15.50:0/2553726978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56435073a200 0x5643507331d0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f6a44011b20 tx=0x7f6a44016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd541e0365bae18 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a3bfff640 1 -- 172.21.15.50:0/2553726978 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4402e070 con 0x56435073a200 2024-09-11T22:18:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a3bfff640 1 -- 172.21.15.50:0/2553726978 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44004240 con 0x56435073a200 2024-09-11T22:18:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.246+0000 7f6a3bfff640 1 -- 172.21.15.50:0/2553726978 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44019040 con 0x56435073a200 2024-09-11T22:18:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.247+0000 7f6a641f2740 1 -- 172.21.15.50:0/2553726978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56435073a200 msgr2=0x5643507331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.247+0000 7f6a641f2740 1 --2- 172.21.15.50:0/2553726978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56435073a200 0x5643507331d0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f6a44011b20 tx=0x7f6a44016000 comp rx=0 tx=0).stop 2024-09-11T22:18:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.247+0000 7f6a641f2740 1 -- 172.21.15.50:0/2553726978 shutdown_connections 2024-09-11T22:18:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.247+0000 7f6a641f2740 1 --2- 172.21.15.50:0/2553726978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073c5e0 0x56435074a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.247+0000 7f6a641f2740 1 --2- 172.21.15.50:0/2553726978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56435073a200 0x5643507331d0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.247+0000 7f6a641f2740 1 --2- 172.21.15.50:0/2553726978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564350737970 0x564350732c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.247+0000 7f6a641f2740 1 -- 172.21.15.50:0/2553726978 >> 172.21.15.50:0/2553726978 conn(0x564350739da0 msgr2=0x564350737100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.247+0000 7f6a641f2740 1 -- 172.21.15.50:0/2553726978 shutdown_connections 2024-09-11T22:18:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.247+0000 7f6a641f2740 1 -- 172.21.15.50:0/2553726978 wait complete. 2024-09-11T22:18:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.247+0000 7f6a641f2740 1 -- start start 2024-09-11T22:18:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.248+0000 7f6a641f2740 1 Processor -- start 2024-09-11T22:18:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.248+0000 7f6a641f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 0x56435073a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.248+0000 7f6a641f2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073a200 0x564350735df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.248+0000 7f6a641f2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073c5e0 0x5643507b5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.248+0000 7f6a641f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c1f63c0 con 0x564350737970 2024-09-11T22:18:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.248+0000 7f6a641f2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56435071edc0 con 0x56435073c5e0 2024-09-11T22:18:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.248+0000 7f6a641f2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5643507b98b0 con 0x56435073a200 2024-09-11T22:18:01.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.248+0000 7f6a641f2740 10 client.0 _ll_register_callbacks cb 0x7f6a4c058a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.248+0000 7f6a5affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 0x56435073a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.248+0000 7f6a5affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 0x56435073a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38916/0 (socket says 172.21.15.50:38916) 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.248+0000 7f6a5affd640 1 -- 172.21.15.50:0/2072313041 learned_addr learned my addr 172.21.15.50:0/2072313041 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.248+0000 7f6a5a7fc640 1 --2- 172.21.15.50:0/2072313041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073a200 0x564350735df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.248+0000 7f6a5b7fe640 1 --2- 172.21.15.50:0/2072313041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073c5e0 0x5643507b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a5affd640 1 -- 172.21.15.50:0/2072313041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073a200 msgr2=0x564350735df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a5affd640 1 --2- 172.21.15.50:0/2072313041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073a200 0x564350735df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a5affd640 1 -- 172.21.15.50:0/2072313041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073c5e0 msgr2=0x5643507b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a5affd640 1 --2- 172.21.15.50:0/2072313041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073c5e0 0x5643507b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a5affd640 1 -- 172.21.15.50:0/2072313041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643507b8c90 con 0x564350737970 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a5affd640 1 --2- 172.21.15.50:0/2072313041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 0x56435073a5e0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f6a54035040 tx=0x7f6a54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a95c4bb730f176 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a39ffb640 1 -- 172.21.15.50:0/2072313041 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54059060 con 0x564350737970 2024-09-11T22:18:01.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a39ffb640 1 -- 172.21.15.50:0/2072313041 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7f6a54054470 con 0x564350737970 2024-09-11T22:18:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a641f2740 1 -- 172.21.15.50:0/2072313041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a44004240 con 0x564350737970 2024-09-11T22:18:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a39ffb640 1 -- 172.21.15.50:0/2072313041 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f6a5405f050 con 0x564350737970 2024-09-11T22:18:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a641f2740 10 client.7848 fetch_fsmap learned FSMap version 77 2024-09-11T22:18:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a641f2740 1 -- 172.21.15.50:0/2072313041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x5643507b95f0 con 0x564350737970 2024-09-11T22:18:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a39ffb640 1 -- 172.21.15.50:0/2072313041 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44004240 con 0x564350737970 2024-09-11T22:18:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.249+0000 7f6a39ffb640 1 -- 172.21.15.50:0/2072313041 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7f6a54062020 con 0x564350737970 2024-09-11T22:18:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.250+0000 7f6a641f2740 10 client.7848 fetch_fsmap finished waiting for FSMap version 77 2024-09-11T22:18:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.250+0000 7f6a641f2740 10 client.7848 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-11T22:18:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.250+0000 7f6a641f2740 20 client.7848 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.250+0000 7f6a641f2740 1 --2- 172.21.15.50:0/2072313041 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x56435075b770 0x56435075bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.250+0000 7f6a641f2740 4 client.7848 mds_command: new command op to 7605 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-11T22:18:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.250+0000 7f6a641f2740 1 -- 172.21.15.50:0/2072313041 --> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] -- command(tid 0: {"prefix": "perf dump"}) -- 0x56435071db20 con 0x56435075b770 2024-09-11T22:18:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.250+0000 7f6a5a7fc640 1 --2- 172.21.15.50:0/2072313041 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x56435075b770 0x56435075bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.250+0000 7f6a5a7fc640 1 --2- 172.21.15.50:0/2072313041 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x56435075b770 0x56435075bb70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20fe8d5a4bea8f28 server_cookie=c6b97e985d69bc44 in_seq=0 out_seq=0 2024-09-11T22:18:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.250+0000 7f6a39ffb640 10 client.7848 ms_handle_connect on v2:172.21.15.50:6832/2355059741 2024-09-11T22:18:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.250+0000 7f6a39ffb640 1 -- 172.21.15.50:0/2072313041 <== mds.0 v2:172.21.15.50:6832/2355059741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18005 (crc 0 0 0) 0x56435071db20 con 0x56435075b770 2024-09-11T22:18:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.250+0000 7f6a39ffb640 10 client.7848 handle_command_reply: tid=0 2024-09-11T22:18:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.250+0000 7f6a641f2740 1 client.7848 shutdown 2024-09-11T22:18:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a641f2740 1 -- 172.21.15.50:0/2072313041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 msgr2=0x56435073a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a641f2740 1 --2- 172.21.15.50:0/2072313041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 0x56435073a5e0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f6a54035040 tx=0x7f6a54004730 comp rx=0 tx=0).stop 2024-09-11T22:18:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a641f2740 1 -- 172.21.15.50:0/2072313041 shutdown_connections 2024-09-11T22:18:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a641f2740 1 --2- 172.21.15.50:0/2072313041 >> [v2:172.21.15.50:6832/2355059741,v1:172.21.15.50:6834/2355059741] conn(0x56435075b770 0x56435075bb70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a641f2740 1 --2- 172.21.15.50:0/2072313041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56435073a200 0x564350735df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a39ffb640 0 client.7848 ms_handle_reset on v2:172.21.15.50:6832/2355059741 2024-09-11T22:18:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a641f2740 1 --2- 172.21.15.50:0/2072313041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56435073c5e0 0x5643507b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a641f2740 1 --2- 172.21.15.50:0/2072313041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564350737970 0x56435073a5e0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a641f2740 1 -- 172.21.15.50:0/2072313041 >> 172.21.15.50:0/2072313041 conn(0x564350739da0 msgr2=0x56435075fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a641f2740 1 -- 172.21.15.50:0/2072313041 shutdown_connections 2024-09-11T22:18:01.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a641f2740 1 -- 172.21.15.50:0/2072313041 wait complete. 2024-09-11T22:18:01.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a641f2740 20 client.7848 trim_cache size 0 max 16384 2024-09-11T22:18:01.258 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:18:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:18:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 3280, 2024-09-11T22:18:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 3280, 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 823461, 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 30359344, 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 17, 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 6, 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.347226233, 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.165748617, 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.065109834, 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.098937763, 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3279, 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.452833631, 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000138101 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 10, 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000001335, 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000133 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 28483, 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 50905, 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 9729594, 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 39034539, 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 8, 2024-09-11T22:18:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-09-11T22:18:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 3.504718504, 2024-09-11T22:18:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 2.398060475, 2024-09-11T22:18:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 1.445489101, 2024-09-11T22:18:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.050292309, 2024-09-11T22:18:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:18:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 50904, 2024-09-11T22:18:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.134413533, 2024-09-11T22:18:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000022285 2024-09-11T22:18:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:18:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 74516, 2024-09-11T22:18:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.009713729, 2024-09-11T22:18:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000130 2024-09-11T22:18:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-09-11T22:18:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 121248 2024-09-11T22:18:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:18:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 4226, 2024-09-11T22:18:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 4222, 2024-09-11T22:18:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 1550649, 2024-09-11T22:18:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 56320972, 2024-09-11T22:18:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 5, 2024-09-11T22:18:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.580802576, 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.295819173, 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.114004573, 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.185745402, 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 4221, 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.722981465, 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000171282 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 120368, 2024-09-11T22:18:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 25744 2024-09-11T22:18:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-09-11T22:18:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-09-11T22:18:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-09-11T22:18:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-09-11T22:18:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-09-11T22:18:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-09-11T22:18:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2823, 2024-09-11T22:18:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 19.842677909, 2024-09-11T22:18:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.007028933 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3399, 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.294132324, 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000380739 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 25245, 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 25245, 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 25245, 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 439.184383177, 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.017396885 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 0, 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 0, 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 0, 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 12, 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 0, 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 0, 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 17807, 2024-09-11T22:18:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 0, 2024-09-11T22:18:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 17807, 2024-09-11T22:18:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 0, 2024-09-11T22:18:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 17806, 2024-09-11T22:18:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 0, 2024-09-11T22:18:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 2, 2024-09-11T22:18:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 2, 2024-09-11T22:18:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 2, 2024-09-11T22:18:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 45745, 2024-09-11T22:18:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 45235, 2024-09-11T22:18:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 0, 2024-09-11T22:18:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 0, 2024-09-11T22:18:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:18:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-09-11T22:18:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 85, 2024-09-11T22:18:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 0, 2024-09-11T22:18:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-09-11T22:18:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 0, 2024-09-11T22:18:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 0, 2024-09-11T22:18:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 0, 2024-09-11T22:18:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 0, 2024-09-11T22:18:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-09-11T22:18:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 2011, 2024-09-11T22:18:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-09-11T22:18:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 0, 2024-09-11T22:18:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 0, 2024-09-11T22:18:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 0, 2024-09-11T22:18:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 2011, 2024-09-11T22:18:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-09-11T22:18:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:18:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:18:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 11, 2024-09-11T22:18:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 1, 2024-09-11T22:18:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 10, 2024-09-11T22:18:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 2000, 2024-09-11T22:18:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:18:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 1176, 2024-09-11T22:18:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 4042, 2024-09-11T22:18:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:18:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 4083, 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 3368, 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 26, 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 14042 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 0, 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 0, 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 0, 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 0, 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 0, 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 0, 2024-09-11T22:18:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 0, 2024-09-11T22:18:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:18:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 4122, 2024-09-11T22:18:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 3685, 2024-09-11T22:18:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 2204, 2024-09-11T22:18:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-09-11T22:18:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-09-11T22:18:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:18:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:18:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-09-11T22:18:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-09-11T22:18:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:18:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:18:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 1, 2024-09-11T22:18:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 0, 2024-09-11T22:18:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-09-11T22:18:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:18:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-09-11T22:18:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0 2024-09-11T22:18:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-09-11T22:18:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 0, 2024-09-11T22:18:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 30820, 2024-09-11T22:18:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 0, 2024-09-11T22:18:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 0, 2024-09-11T22:18:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 30820, 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 0, 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 0, 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 49, 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 0, 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 0, 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 49, 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 4, 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 0, 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 0, 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 4194304, 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 104616676, 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 0, 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-09-11T22:18:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2746, 2024-09-11T22:18:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 130.880728658, 2024-09-11T22:18:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.047662319 2024-09-11T22:18:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 0 2024-09-11T22:18:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-09-11T22:18:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 14, 2024-09-11T22:18:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 2015, 2024-09-11T22:18:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 2001, 2024-09-11T22:18:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 13, 2024-09-11T22:18:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 13, 2024-09-11T22:18:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 0, 2024-09-11T22:18:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 17807, 2024-09-11T22:18:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 19808, 2024-09-11T22:18:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 2001, 2024-09-11T22:18:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 2, 2024-09-11T22:18:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 3505, 2024-09-11T22:18:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 3503, 2024-09-11T22:18:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 111648, 2024-09-11T22:18:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 231788 2024-09-11T22:18:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-09-11T22:18:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 28139, 2024-09-11T22:18:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 0, 2024-09-11T22:18:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 25245, 2024-09-11T22:18:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 5, 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 0, 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2000, 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.650887215, 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000825443 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 30, 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.004591772, 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000153059 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-09-11T22:18:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 6000, 2024-09-11T22:18:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 7.292402315, 2024-09-11T22:18:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.001215400 2024-09-11T22:18:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-09-11T22:18:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 6997, 2024-09-11T22:18:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 5.816528272, 2024-09-11T22:18:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000831288 2024-09-11T22:18:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-09-11T22:18:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-09-11T22:18:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-09-11T22:18:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-09-11T22:18:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-09-11T22:18:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:18:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000054352, 2024-09-11T22:18:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000054352 2024-09-11T22:18:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-09-11T22:18:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-09-11T22:18:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:18:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.003140838, 2024-09-11T22:18:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.003140838 2024-09-11T22:18:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-09-11T22:18:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-09-11T22:18:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:18:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.026312295, 2024-09-11T22:18:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.026312295 2024-09-11T22:18:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-09-11T22:18:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:18:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000083524, 2024-09-11T22:18:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000083524 2024-09-11T22:18:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-09-11T22:18:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8, 2024-09-11T22:18:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.708274137, 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.213534267 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2204, 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 403.628744889, 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.183134639 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-09-11T22:18:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-09-11T22:18:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-09-11T22:18:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:18:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.036882427, 2024-09-11T22:18:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.036882427 2024-09-11T22:18:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-09-11T22:18:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-09-11T22:18:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-09-11T22:18:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000263287, 2024-09-11T22:18:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000263287 2024-09-11T22:18:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-09-11T22:18:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-09-11T22:18:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-09-11T22:18:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8000, 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 19.016217854, 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.002377027 2024-09-11T22:18:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 1, 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 1, 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 0, 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 1, 2024-09-11T22:18:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-09-11T22:18:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 18163, 2024-09-11T22:18:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 18163, 2024-09-11T22:18:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 75, 2024-09-11T22:18:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-09-11T22:18:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-09-11T22:18:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:18:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-09-11T22:18:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:18:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:18:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:18:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:18:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:18:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:18:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:18:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 250475, 2024-09-11T22:18:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 94, 2024-09-11T22:18:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 440, 2024-09-11T22:18:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 5, 2024-09-11T22:18:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-09-11T22:18:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-09-11T22:18:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:18:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-09-11T22:18:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:18:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-09-11T22:18:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 5416, 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 77, 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 13410909, 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 660797, 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-09-11T22:18:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-09-11T22:18:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-09-11T22:18:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 8653, 2024-09-11T22:18:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 101096404, 2024-09-11T22:18:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 37, 2024-09-11T22:18:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 8653, 2024-09-11T22:18:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-09-11T22:18:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8653, 2024-09-11T22:18:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 27.564298464, 2024-09-11T22:18:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.003185519 2024-09-11T22:18:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-09-11T22:18:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-09-11T22:18:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8653, 2024-09-11T22:18:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 8743 2024-09-11T22:18:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 8653, 2024-09-11T22:18:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 2050, 2024-09-11T22:18:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 6603, 2024-09-11T22:18:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-09-11T22:18:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-09-11T22:18:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 0, 2024-09-11T22:18:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 11, 2024-09-11T22:18:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 38, 2024-09-11T22:18:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 2783, 2024-09-11T22:18:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 26, 2024-09-11T22:18:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-09-11T22:18:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-09-11T22:18:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 1685, 2024-09-11T22:18:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 0, 2024-09-11T22:18:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 2035, 2024-09-11T22:18:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-09-11T22:18:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-09-11T22:18:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-09-11T22:18:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 2012, 2024-09-11T22:18:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 22, 2024-09-11T22:18:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:18:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-09-11T22:18:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:18:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-09-11T22:18:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-09-11T22:18:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-09-11T22:18:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:18:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-09-11T22:18:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:18:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 0, 2024-09-11T22:18:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-09-11T22:18:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-09-11T22:18:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-09-11T22:18:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-09-11T22:18:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-09-11T22:18:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-09-11T22:18:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-09-11T22:18:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-09-11T22:18:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-09-11T22:18:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-09-11T22:18:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-09-11T22:18:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-09-11T22:18:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-09-11T22:18:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-09-11T22:18:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-09-11T22:18:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-09-11T22:18:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 109, 2024-09-11T22:18:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-09-11T22:18:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 3, 2024-09-11T22:18:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 8, 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 8, 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 0, 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 101, 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 0, 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 30 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 1, 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.299 INFO:teuthology.orchestra.run.smithi050.stdout: "osd-slow-ops": { 2024-09-11T22:18:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 0 2024-09-11T22:18:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-09-11T22:18:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-09-11T22:18:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 32, 2024-09-11T22:18:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-09-11T22:18:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 32, 2024-09-11T22:18:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 3685, 2024-09-11T22:18:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 3685, 2024-09-11T22:18:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-09-11T22:18:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:18:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 35984, 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 8859578, 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 35984, 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 35984, 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 8859578, 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-09-11T22:18:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:18:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-09-11T22:18:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:18:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-09-11T22:18:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-09-11T22:18:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:18:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-09-11T22:18:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 8653, 2024-09-11T22:18:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 101482069, 2024-09-11T22:18:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 8653, 2024-09-11T22:18:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 101482069, 2024-09-11T22:18:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:18:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-09-11T22:18:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:18:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-09-11T22:18:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:18:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-09-11T22:18:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-09-11T22:18:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:18:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-09-11T22:18:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 8653, 2024-09-11T22:18:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 8653, 2024-09-11T22:18:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 8653, 2024-09-11T22:18:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 8653, 2024-09-11T22:18:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:18:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:01.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 3685, 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 385665, 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 3685, 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 37, 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 385665, 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:18:01.305 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x558d3f486500": { 2024-09-11T22:18:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-11T22:18:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-09-11T22:18:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-11T22:18:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 30820, 2024-09-11T22:18:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 100422372, 2024-09-11T22:18:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-11T22:18:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 30820, 2024-09-11T22:18:01.306 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-11T22:18:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-11T22:18:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 2746, 2024-09-11T22:18:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 100422372, 2024-09-11T22:18:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-11T22:18:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-11T22:18:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-11T22:18:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-11T22:18:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:01.307 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:01.307 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:18:01.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a61378640 1 -- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a3c06be30 msgr2=0x7f6a3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a61378640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a3c06be30 0x7f6a3c06e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6a54034000 tx=0x7f6a5402e000 comp rx=0 tx=0).stop 2024-09-11T22:18:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a61378640 1 -- 172.21.15.50:0/911145123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5c15c2c0 msgr2=0x7f6a5c0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a61378640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5c15c2c0 0x7f6a5c0b20e0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00cbf0 tx=0x7f6a4c00a430 comp rx=0 tx=0).stop 2024-09-11T22:18:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a61378640 1 -- 172.21.15.50:0/911145123 shutdown_connections 2024-09-11T22:18:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a61378640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a3c06be30 0x7f6a3c06e2f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a61378640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5c0d0410 0x7f6a5c15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a61378640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5c15c2c0 0x7f6a5c0b20e0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a61378640 1 --2- 172.21.15.50:0/911145123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5c0b3e10 0x7f6a5c14eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a61378640 1 -- 172.21.15.50:0/911145123 >> 172.21.15.50:0/911145123 conn(0x7f6a5c0679c0 msgr2=0x7f6a5c06dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a61378640 1 -- 172.21.15.50:0/911145123 shutdown_connections 2024-09-11T22:18:01.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.251+0000 7f6a61378640 1 -- 172.21.15.50:0/911145123 wait complete. 2024-09-11T22:18:01.310 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:18:01.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:18:01.356 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:18:01.408 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:18:01.408 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:18:01.408 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:18:01.409 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:01.426 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:18:01.426 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:01.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:18:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.624+0000 7f6377827640 1 Processor -- start 2024-09-11T22:18:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.624+0000 7f6377827640 1 -- start start 2024-09-11T22:18:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.625+0000 7f6377827640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63700b0cd0 0x7f63700d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.625+0000 7f6377827640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f63700b7060 0x7f63700d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.625+0000 7f6377827640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63700d11a0 con 0x7f637015d770 2024-09-11T22:18:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.625+0000 7f6377827640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f637015ca40 con 0x7f63700b7060 2024-09-11T22:18:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.625+0000 7f6377827640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f637015cc90 con 0x7f63700b0cd0 2024-09-11T22:18:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.625+0000 7f6374dc2640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f637015d770 0x7f63700b6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42082/0 (socket says 172.21.15.50:42082) 2024-09-11T22:18:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.625+0000 7f6374dc2640 1 -- 172.21.15.50:0/131060739 learned_addr learned my addr 172.21.15.50:0/131060739 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.626+0000 7f63755c3640 1 --2- 172.21.15.50:0/131060739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63700b0cd0 0x7f63700d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.626+0000 7f6375dc4640 1 --2- 172.21.15.50:0/131060739 >> v2:172.21.15.77:3300/0 conn(0x7f63700b7060 0x7f63700d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.626+0000 7f636ffff640 1 -- 172.21.15.50:0/131060739 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3661631389 0 0) 0x7f63700d11a0 con 0x7f637015d770 2024-09-11T22:18:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.626+0000 7f636ffff640 1 -- 172.21.15.50:0/131060739 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6358003520 con 0x7f637015d770 2024-09-11T22:18:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.626+0000 7f636ffff640 1 -- 172.21.15.50:0/131060739 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1948921995 0 0) 0x7f6358003520 con 0x7f637015d770 2024-09-11T22:18:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.626+0000 7f6375dc4640 1 -- 172.21.15.50:0/131060739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63700b0cd0 msgr2=0x7f63700d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.626+0000 7f6375dc4640 1 --2- 172.21.15.50:0/131060739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63700b0cd0 0x7f63700d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.626+0000 7f6375dc4640 1 -- 172.21.15.50:0/131060739 >> v1:172.21.15.50:6789/0 conn(0x7f637015d770 legacy=0x7f63700b6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.626+0000 7f6375dc4640 1 -- 172.21.15.50:0/131060739 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637015cf70 con 0x7f63700b7060 2024-09-11T22:18:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.626+0000 7f63755c3640 1 --2- 172.21.15.50:0/131060739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63700b0cd0 0x7f63700d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.627+0000 7f6375dc4640 1 --2- 172.21.15.50:0/131060739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63700b7060 0x7f63700d0b40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6360009d90 tx=0x7f636002a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef80c62da0a65975 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.627+0000 7f636ffff640 1 -- 172.21.15.50:0/131060739 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364001670 con 0x7f63700b7060 2024-09-11T22:18:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.627+0000 7f636ffff640 1 -- 172.21.15.50:0/131060739 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6360007540 con 0x7f63700b7060 2024-09-11T22:18:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.627+0000 7f636ffff640 1 -- 172.21.15.50:0/131060739 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63600078f0 con 0x7f63700b7060 2024-09-11T22:18:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.628+0000 7f6377827640 1 -- 172.21.15.50:0/131060739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63700b7060 msgr2=0x7f63700d0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.628+0000 7f6377827640 1 --2- 172.21.15.50:0/131060739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63700b7060 0x7f63700d0b40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6360009d90 tx=0x7f636002a560 comp rx=0 tx=0).stop 2024-09-11T22:18:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.628+0000 7f6377827640 1 -- 172.21.15.50:0/131060739 shutdown_connections 2024-09-11T22:18:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.628+0000 7f6377827640 1 --2- 172.21.15.50:0/131060739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63700b7060 0x7f63700d0b40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.628+0000 7f6377827640 1 --2- 172.21.15.50:0/131060739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63700b0cd0 0x7f63700d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.628+0000 7f6377827640 1 -- 172.21.15.50:0/131060739 >> 172.21.15.50:0/131060739 conn(0x7f637006bd30 msgr2=0x7f637006c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.628+0000 7f6377827640 1 -- 172.21.15.50:0/131060739 shutdown_connections 2024-09-11T22:18:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.628+0000 7f6377827640 1 -- 172.21.15.50:0/131060739 wait complete. 2024-09-11T22:18:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.629+0000 7f6377827640 1 Processor -- start 2024-09-11T22:18:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.629+0000 7f6377827640 1 -- start start 2024-09-11T22:18:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6377827640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63700b0cd0 0x7f6370151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6377827640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700b7060 0x7f637015aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6377827640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637015d770 0x7f63701534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6377827640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6370073190 con 0x7f63700b7060 2024-09-11T22:18:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6377827640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f63700b10b0 con 0x7f63700b0cd0 2024-09-11T22:18:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6377827640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f637006e1e0 con 0x7f637015d770 2024-09-11T22:18:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6374dc2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700b7060 0x7f637015aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6374dc2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700b7060 0x7f637015aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38922/0 (socket says 172.21.15.50:38922) 2024-09-11T22:18:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6374dc2640 1 -- 172.21.15.50:0/2927365822 learned_addr learned my addr 172.21.15.50:0/2927365822 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6375dc4640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637015d770 0x7f63701534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f63755c3640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63700b0cd0 0x7f6370151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6374dc2640 1 -- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637015d770 msgr2=0x7f63701534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6374dc2640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637015d770 0x7f63701534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6374dc2640 1 -- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63700b0cd0 msgr2=0x7f6370151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6374dc2640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63700b0cd0 0x7f6370151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6374dc2640 1 -- 172.21.15.50:0/2927365822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6370159540 con 0x7f63700b7060 2024-09-11T22:18:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6375dc4640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637015d770 0x7f63701534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f63755c3640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63700b0cd0 0x7f6370151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6374dc2640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700b7060 0x7f637015aff0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f636400c730 tx=0x7f636400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f636dffb640 1 -- 172.21.15.50:0/2927365822 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364017070 con 0x7f63700b7060 2024-09-11T22:18:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f636dffb640 1 -- 172.21.15.50:0/2927365822 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6364005ad0 con 0x7f63700b7060 2024-09-11T22:18:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f6377827640 1 -- 172.21.15.50:0/2927365822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6370159820 con 0x7f63700b7060 2024-09-11T22:18:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.630+0000 7f636dffb640 1 -- 172.21.15.50:0/2927365822 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364007070 con 0x7f63700b7060 2024-09-11T22:18:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.631+0000 7f6377827640 1 -- 172.21.15.50:0/2927365822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6370159de0 con 0x7f63700b7060 2024-09-11T22:18:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.632+0000 7f6377827640 1 -- 172.21.15.50:0/2927365822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63701f1fc0 con 0x7f63700b7060 2024-09-11T22:18:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.632+0000 7f636dffb640 1 -- 172.21.15.50:0/2927365822 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f636401a070 con 0x7f63700b7060 2024-09-11T22:18:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.632+0000 7f636dffb640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f635c06be60 0x7f635c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.632+0000 7f636dffb640 1 -- 172.21.15.50:0/2927365822 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7f636408a110 con 0x7f63700b7060 2024-09-11T22:18:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.633+0000 7f63755c3640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f635c06be60 0x7f635c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.633+0000 7f63755c3640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f635c06be60 0x7f635c06e320 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6368009ac0 tx=0x7f6368008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.637+0000 7f636dffb640 1 -- 172.21.15.50:0/2927365822 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63640584e0 con 0x7f63700b7060 2024-09-11T22:18:01.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.826+0000 7f6377827640 1 -- 172.21.15.50:0/2927365822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f63700b6950 con 0x7f63700b7060 2024-09-11T22:18:01.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.826+0000 7f636dffb640 1 -- 172.21.15.50:0/2927365822 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v109) ==== 80+0+0 (secure 0 0 0) 0x7f636405c7e0 con 0x7f63700b7060 2024-09-11T22:18:01.827 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:18:01.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.828+0000 7f6377827640 1 -- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f635c06be60 msgr2=0x7f635c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.828+0000 7f6377827640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f635c06be60 0x7f635c06e320 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6368009ac0 tx=0x7f6368008040 comp rx=0 tx=0).stop 2024-09-11T22:18:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.828+0000 7f6377827640 1 -- 172.21.15.50:0/2927365822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700b7060 msgr2=0x7f637015aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.828+0000 7f6377827640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700b7060 0x7f637015aff0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f636400c730 tx=0x7f636400cbf0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.828+0000 7f6377827640 1 -- 172.21.15.50:0/2927365822 shutdown_connections 2024-09-11T22:18:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.828+0000 7f6377827640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f635c06be60 0x7f635c06e320 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.828+0000 7f6377827640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f637015d770 0x7f63701534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.828+0000 7f6377827640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700b7060 0x7f637015aff0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.828+0000 7f6377827640 1 --2- 172.21.15.50:0/2927365822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63700b0cd0 0x7f6370151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.828+0000 7f6377827640 1 -- 172.21.15.50:0/2927365822 >> 172.21.15.50:0/2927365822 conn(0x7f637006bd30 msgr2=0x7f637006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.828+0000 7f6377827640 1 -- 172.21.15.50:0/2927365822 shutdown_connections 2024-09-11T22:18:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:01.828+0000 7f6377827640 1 -- 172.21.15.50:0/2927365822 wait complete. 2024-09-11T22:18:01.839 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:18:01.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:01.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:18:01.881 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:18:01.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:01.881 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:18:01.937 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:18:01.937 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:18:01.937 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:01.954 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:18:01.954 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:18:01.954 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:18:01.954 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:01.992 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:18:01.992 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:18:01.993 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:18:01.993 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:02.011 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:18:02.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:18:02.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.134+0000 7f88ecb2c640 1 Processor -- start 2024-09-11T22:18:02.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.134+0000 7f88ecb2c640 1 -- start start 2024-09-11T22:18:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88ecb2c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88e80cf790 0x7f88e80b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88ecb2c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88e80d11d0 0x7f88e80d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88ecb2c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88e8162110 con 0x7f88e8161d30 2024-09-11T22:18:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88ecb2c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f88e80d1b80 con 0x7f88e80cf790 2024-09-11T22:18:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88ecb2c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f88e80d3450 con 0x7f88e80d11d0 2024-09-11T22:18:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88e5d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88e80cf790 0x7f88e80b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88e659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f88e8161d30 0x7f88e8162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42088/0 (socket says 172.21.15.50:42088) 2024-09-11T22:18:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88e659c640 1 -- 172.21.15.50:0/1982109031 learned_addr learned my addr 172.21.15.50:0/1982109031 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88e6d9d640 1 --2- 172.21.15.50:0/1982109031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88e80d11d0 0x7f88e80d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88e5d9b640 1 -- 172.21.15.50:0/1982109031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88e80d11d0 msgr2=0x7f88e80d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88e5d9b640 1 --2- 172.21.15.50:0/1982109031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88e80d11d0 0x7f88e80d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88e5d9b640 1 -- 172.21.15.50:0/1982109031 >> v1:172.21.15.50:6789/0 conn(0x7f88e8161d30 legacy=0x7f88e8162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88e5d9b640 1 -- 172.21.15.50:0/1982109031 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e80cfd70 con 0x7f88e80cf790 2024-09-11T22:18:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.135+0000 7f88e559a640 1 -- 172.21.15.50:0/1982109031 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 618508499 0 0) 0x7f88e8162110 con 0x7f88e8161d30 2024-09-11T22:18:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.136+0000 7f88e5d9b640 1 --2- 172.21.15.50:0/1982109031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e80cf790 0x7f88e80b78f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f88d00097a0 tx=0x7f88d002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87384d7265ea50d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.136+0000 7f88e559a640 1 -- 172.21.15.50:0/1982109031 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0037070 con 0x7f88e80cf790 2024-09-11T22:18:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.136+0000 7f88e559a640 1 -- 172.21.15.50:0/1982109031 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d0032440 con 0x7f88e80cf790 2024-09-11T22:18:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.136+0000 7f88e559a640 1 -- 172.21.15.50:0/1982109031 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0032810 con 0x7f88e80cf790 2024-09-11T22:18:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.136+0000 7f88ecb2c640 1 -- 172.21.15.50:0/1982109031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e80cf790 msgr2=0x7f88e80b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.136+0000 7f88ecb2c640 1 --2- 172.21.15.50:0/1982109031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e80cf790 0x7f88e80b78f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f88d00097a0 tx=0x7f88d002a180 comp rx=0 tx=0).stop 2024-09-11T22:18:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.137+0000 7f88ecb2c640 1 -- 172.21.15.50:0/1982109031 shutdown_connections 2024-09-11T22:18:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.137+0000 7f88ecb2c640 1 --2- 172.21.15.50:0/1982109031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88e80d11d0 0x7f88e80d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.137+0000 7f88ecb2c640 1 --2- 172.21.15.50:0/1982109031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e80cf790 0x7f88e80b78f0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.137+0000 7f88ecb2c640 1 -- 172.21.15.50:0/1982109031 >> 172.21.15.50:0/1982109031 conn(0x7f88e80727a0 msgr2=0x7f88e80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.137+0000 7f88ecb2c640 1 -- 172.21.15.50:0/1982109031 shutdown_connections 2024-09-11T22:18:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.137+0000 7f88ecb2c640 1 -- 172.21.15.50:0/1982109031 wait complete. 2024-09-11T22:18:02.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.138+0000 7f88ecb2c640 1 Processor -- start 2024-09-11T22:18:02.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.138+0000 7f88ecb2c640 1 -- start start 2024-09-11T22:18:02.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88ecb2c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e80cf790 0x7f88e80b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88ecb2c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88e80d11d0 0x7f88e815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88ecb2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88e8161d30 0x7f88e81f5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88ecb2c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88e80d2e00 con 0x7f88e80cf790 2024-09-11T22:18:02.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88ecb2c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88e80b7e30 con 0x7f88e8161d30 2024-09-11T22:18:02.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88ecb2c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f88e80d30e0 con 0x7f88e80d11d0 2024-09-11T22:18:02.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88e659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e80cf790 0x7f88e80b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88e659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e80cf790 0x7f88e80b5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38940/0 (socket says 172.21.15.50:38940) 2024-09-11T22:18:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88e659c640 1 -- 172.21.15.50:0/941428668 learned_addr learned my addr 172.21.15.50:0/941428668 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88e6d9d640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88e8161d30 0x7f88e81f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88e5d9b640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88e80d11d0 0x7f88e815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88e659c640 1 -- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88e80d11d0 msgr2=0x7f88e815b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88e659c640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88e80d11d0 0x7f88e815b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88e659c640 1 -- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88e8161d30 msgr2=0x7f88e81f5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88e659c640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88e8161d30 0x7f88e81f5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88e659c640 1 -- 172.21.15.50:0/941428668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e815bee0 con 0x7f88e80cf790 2024-09-11T22:18:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88e659c640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e80cf790 0x7f88e80b5920 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f88e000c460 tx=0x7f88e000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.139+0000 7f88deffd640 1 -- 172.21.15.50:0/941428668 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e0018070 con 0x7f88e80cf790 2024-09-11T22:18:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.140+0000 7f88deffd640 1 -- 172.21.15.50:0/941428668 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e0007500 con 0x7f88e80cf790 2024-09-11T22:18:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.140+0000 7f88ecb2c640 1 -- 172.21.15.50:0/941428668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e80cb110 con 0x7f88e80cf790 2024-09-11T22:18:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.140+0000 7f88deffd640 1 -- 172.21.15.50:0/941428668 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e0004a20 con 0x7f88e80cf790 2024-09-11T22:18:02.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.140+0000 7f88ecb2c640 1 -- 172.21.15.50:0/941428668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e80b5120 con 0x7f88e80cf790 2024-09-11T22:18:02.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.140+0000 7f88ecb2c640 1 -- 172.21.15.50:0/941428668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88e80b3ea0 con 0x7f88e80cf790 2024-09-11T22:18:02.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.141+0000 7f88deffd640 1 -- 172.21.15.50:0/941428668 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88e001b070 con 0x7f88e80cf790 2024-09-11T22:18:02.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.142+0000 7f88deffd640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88c806be30 0x7f88c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.142+0000 7f88deffd640 1 -- 172.21.15.50:0/941428668 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7f88e0089ff0 con 0x7f88e80cf790 2024-09-11T22:18:02.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.142+0000 7f88e5d9b640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88c806be30 0x7f88c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.142+0000 7f88e5d9b640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88c806be30 0x7f88c806e2f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f88d0034000 tx=0x7f88d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.146+0000 7f88deffd640 1 -- 172.21.15.50:0/941428668 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88e80b3ea0 con 0x7f88e80cf790 2024-09-11T22:18:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.357+0000 7f88ecb2c640 1 -- 172.21.15.50:0/941428668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88e80b8ff0 con 0x7f88e80cf790 2024-09-11T22:18:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.357+0000 7f88deffd640 1 -- 172.21.15.50:0/941428668 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5225 (secure 0 0 0) 0x7f88e00583c0 con 0x7f88e80cf790 2024-09-11T22:18:02.358 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:02.358 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":77,"btime":"2024-09-11T22:16:42:153332+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3921219668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3921219668},{"type":"v1","addr":"172.21.15.50:6835","nonce":3921219668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1123077854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1123077854},{"type":"v1","addr":"172.21.15.77:6837","nonce":1123077854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1576416639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1576416639},{"type":"v1","addr":"172.21.15.77:6836","nonce":1576416639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-11T22:16:30.480778+0000","modified":"2024-09-11T22:16:41.621342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7605},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7605":{"gid":7605,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/2355059741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2355059741},{"type":"v1","addr":"172.21.15.50:6834","nonce":2355059741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7605,"qdb_cluster":[7605]},"id":7}]} 2024-09-11T22:18:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 77 2024-09-11T22:18:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.359+0000 7f88ecb2c640 1 -- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88c806be30 msgr2=0x7f88c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.359+0000 7f88ecb2c640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88c806be30 0x7f88c806e2f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f88d0034000 tx=0x7f88d002e000 comp rx=0 tx=0).stop 2024-09-11T22:18:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.359+0000 7f88ecb2c640 1 -- 172.21.15.50:0/941428668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e80cf790 msgr2=0x7f88e80b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.359+0000 7f88ecb2c640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e80cf790 0x7f88e80b5920 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f88e000c460 tx=0x7f88e000c920 comp rx=0 tx=0).stop 2024-09-11T22:18:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.359+0000 7f88ecb2c640 1 -- 172.21.15.50:0/941428668 shutdown_connections 2024-09-11T22:18:02.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.359+0000 7f88ecb2c640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88c806be30 0x7f88c806e2f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.359+0000 7f88ecb2c640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88e80d11d0 0x7f88e815b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.359+0000 7f88ecb2c640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88e8161d30 0x7f88e81f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.359+0000 7f88ecb2c640 1 --2- 172.21.15.50:0/941428668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e80cf790 0x7f88e80b5920 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.359+0000 7f88ecb2c640 1 -- 172.21.15.50:0/941428668 >> 172.21.15.50:0/941428668 conn(0x7f88e80727a0 msgr2=0x7f88e80d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:02.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.359+0000 7f88ecb2c640 1 -- 172.21.15.50:0/941428668 shutdown_connections 2024-09-11T22:18:02.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.359+0000 7f88ecb2c640 1 -- 172.21.15.50:0/941428668 wait complete. 2024-09-11T22:18:02.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:18:02.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.472+0000 7fdc61c9b640 1 Processor -- start 2024-09-11T22:18:02.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.472+0000 7fdc61c9b640 1 -- start start 2024-09-11T22:18:02.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.473+0000 7fdc61c9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc5c15e870 0x7fdc5c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.473+0000 7fdc61c9b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5c0d3c00 0x7fdc5c0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.473+0000 7fdc61c9b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc5c0cfa80 con 0x7fdc5c0d16d0 2024-09-11T22:18:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.473+0000 7fdc61c9b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fdc5c0d1b40 con 0x7fdc5c15e870 2024-09-11T22:18:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.473+0000 7fdc61c9b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5c0d40d0 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.473+0000 7fdc5bfff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5c0d3c00 0x7fdc5c0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.473+0000 7fdc5b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc5c15e870 0x7fdc5c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.473+0000 7fdc5affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdc5c0d16d0 0x7fdc5c0d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:54524/0 (socket says 172.21.15.50:54524) 2024-09-11T22:18:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.473+0000 7fdc5bfff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5c0d3c00 0x7fdc5c0b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:37184/0 (socket says 172.21.15.50:37184) 2024-09-11T22:18:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.473+0000 7fdc5affd640 1 -- 172.21.15.50:0/4001761988 learned_addr learned my addr 172.21.15.50:0/4001761988 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.474+0000 7fdc5b7fe640 1 -- 172.21.15.50:0/4001761988 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5c0d3c00 msgr2=0x7fdc5c0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.474+0000 7fdc5b7fe640 1 --2- 172.21.15.50:0/4001761988 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5c0d3c00 0x7fdc5c0b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.474+0000 7fdc5b7fe640 1 -- 172.21.15.50:0/4001761988 >> v1:172.21.15.77:6789/0 conn(0x7fdc5c0d16d0 legacy=0x7fdc5c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.474+0000 7fdc5b7fe640 1 -- 172.21.15.50:0/4001761988 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5c0d43b0 con 0x7fdc5c15e870 2024-09-11T22:18:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.474+0000 7fdc5a7fc640 1 -- 172.21.15.50:0/4001761988 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076689348 0 0) 0x7fdc4c001110 con 0x7fdc5c0d16d0 2024-09-11T22:18:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.474+0000 7fdc5bfff640 1 --2- 172.21.15.50:0/4001761988 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5c0d3c00 0x7fdc5c0b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.474+0000 7fdc5b7fe640 1 --2- 172.21.15.50:0/4001761988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5c15e870 0x7fdc5c0d1190 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdc440097a0 tx=0x7fdc4402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcbd987913d81502 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.475+0000 7fdc5a7fc640 1 -- 172.21.15.50:0/4001761988 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44037070 con 0x7fdc5c15e870 2024-09-11T22:18:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.475+0000 7fdc5a7fc640 1 -- 172.21.15.50:0/4001761988 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc44032440 con 0x7fdc5c15e870 2024-09-11T22:18:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.475+0000 7fdc5a7fc640 1 -- 172.21.15.50:0/4001761988 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44032810 con 0x7fdc5c15e870 2024-09-11T22:18:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.475+0000 7fdc61c9b640 1 -- 172.21.15.50:0/4001761988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5c15e870 msgr2=0x7fdc5c0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.475+0000 7fdc61c9b640 1 --2- 172.21.15.50:0/4001761988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5c15e870 0x7fdc5c0d1190 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdc440097a0 tx=0x7fdc4402a180 comp rx=0 tx=0).stop 2024-09-11T22:18:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.475+0000 7fdc61c9b640 1 -- 172.21.15.50:0/4001761988 shutdown_connections 2024-09-11T22:18:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.475+0000 7fdc61c9b640 1 --2- 172.21.15.50:0/4001761988 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5c0d3c00 0x7fdc5c0b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.475+0000 7fdc61c9b640 1 --2- 172.21.15.50:0/4001761988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5c15e870 0x7fdc5c0d1190 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.475+0000 7fdc61c9b640 1 -- 172.21.15.50:0/4001761988 >> 172.21.15.50:0/4001761988 conn(0x7fdc5c0727a0 msgr2=0x7fdc5c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.475+0000 7fdc61c9b640 1 -- 172.21.15.50:0/4001761988 shutdown_connections 2024-09-11T22:18:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.475+0000 7fdc61c9b640 1 -- 172.21.15.50:0/4001761988 wait complete. 2024-09-11T22:18:02.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.476+0000 7fdc61c9b640 1 Processor -- start 2024-09-11T22:18:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.477+0000 7fdc61c9b640 1 -- start start 2024-09-11T22:18:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.477+0000 7fdc61c9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5c0d16d0 0x7fdc5c1f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.477+0000 7fdc61c9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c0d3c00 0x7fdc5c157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.477+0000 7fdc61c9b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5c15e870 0x7fdc5c159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.477+0000 7fdc61c9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c15ec50 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.477+0000 7fdc61c9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c0b7ee0 con 0x7fdc5c0d16d0 2024-09-11T22:18:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.477+0000 7fdc61c9b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5c0b78b0 con 0x7fdc5c15e870 2024-09-11T22:18:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.477+0000 7fdc5affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c0d3c00 0x7fdc5c157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.477+0000 7fdc5affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c0d3c00 0x7fdc5c157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38948/0 (socket says 172.21.15.50:38948) 2024-09-11T22:18:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.477+0000 7fdc5affd640 1 -- 172.21.15.50:0/2150360074 learned_addr learned my addr 172.21.15.50:0/2150360074 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.477+0000 7fdc5bfff640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5c15e870 0x7fdc5c159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.477+0000 7fdc5b7fe640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5c0d16d0 0x7fdc5c1f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.478+0000 7fdc5affd640 1 -- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5c15e870 msgr2=0x7fdc5c159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.478+0000 7fdc5affd640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5c15e870 0x7fdc5c159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.478+0000 7fdc5affd640 1 -- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5c0d16d0 msgr2=0x7fdc5c1f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.478+0000 7fdc5affd640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5c0d16d0 0x7fdc5c1f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.478+0000 7fdc5affd640 1 -- 172.21.15.50:0/2150360074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5c0cddd0 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.478+0000 7fdc5b7fe640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5c0d16d0 0x7fdc5c1f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.478+0000 7fdc5affd640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c0d3c00 0x7fdc5c157ce0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00c400 tx=0x7fdc4c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.478+0000 7fdc53fff640 1 -- 172.21.15.50:0/2150360074 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c017070 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.478+0000 7fdc53fff640 1 -- 172.21.15.50:0/2150360074 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c005ce0 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.478+0000 7fdc61c9b640 1 -- 172.21.15.50:0/2150360074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5c0ce0b0 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.478+0000 7fdc53fff640 1 -- 172.21.15.50:0/2150360074 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c007310 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.478+0000 7fdc61c9b640 1 -- 172.21.15.50:0/2150360074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc5c0ce670 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.479+0000 7fdc61c9b640 1 -- 172.21.15.50:0/2150360074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc5c0d1190 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.480+0000 7fdc53fff640 1 -- 172.21.15.50:0/2150360074 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc4c01a070 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.480+0000 7fdc53fff640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdc3c06be60 0x7fdc3c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.480+0000 7fdc53fff640 1 -- 172.21.15.50:0/2150360074 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7fdc4c08a050 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.480+0000 7fdc5b7fe640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdc3c06be60 0x7fdc3c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.481+0000 7fdc5b7fe640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdc3c06be60 0x7fdc3c06e320 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdc44034000 tx=0x7fdc4402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.485+0000 7fdc53fff640 1 -- 172.21.15.50:0/2150360074 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc5c0cfa80 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.698+0000 7fdc61c9b640 1 -- 172.21.15.50:0/2150360074 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc5c0b9f20 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.698+0000 7fdc53fff640 1 -- 172.21.15.50:0/2150360074 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5225 (secure 0 0 0) 0x7fdc4c058420 con 0x7fdc5c0d3c00 2024-09-11T22:18:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:02.699 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":77,"btime":"2024-09-11T22:16:42:153332+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3921219668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3921219668},{"type":"v1","addr":"172.21.15.50:6835","nonce":3921219668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1123077854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1123077854},{"type":"v1","addr":"172.21.15.77:6837","nonce":1123077854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1576416639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1576416639},{"type":"v1","addr":"172.21.15.77:6836","nonce":1576416639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-11T22:16:30.480778+0000","modified":"2024-09-11T22:16:41.621342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7605},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7605":{"gid":7605,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/2355059741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2355059741},{"type":"v1","addr":"172.21.15.50:6834","nonce":2355059741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7605,"qdb_cluster":[7605]},"id":7}]} 2024-09-11T22:18:02.700 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 77 2024-09-11T22:18:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.701+0000 7fdc61c9b640 1 -- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdc3c06be60 msgr2=0x7fdc3c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.701+0000 7fdc61c9b640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdc3c06be60 0x7fdc3c06e320 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdc44034000 tx=0x7fdc4402e000 comp rx=0 tx=0).stop 2024-09-11T22:18:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.701+0000 7fdc61c9b640 1 -- 172.21.15.50:0/2150360074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c0d3c00 msgr2=0x7fdc5c157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.701+0000 7fdc61c9b640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c0d3c00 0x7fdc5c157ce0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00c400 tx=0x7fdc4c00c800 comp rx=0 tx=0).stop 2024-09-11T22:18:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.701+0000 7fdc61c9b640 1 -- 172.21.15.50:0/2150360074 shutdown_connections 2024-09-11T22:18:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.701+0000 7fdc61c9b640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdc3c06be60 0x7fdc3c06e320 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.701+0000 7fdc61c9b640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5c15e870 0x7fdc5c159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.701+0000 7fdc61c9b640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc5c0d3c00 0x7fdc5c157ce0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.701+0000 7fdc61c9b640 1 --2- 172.21.15.50:0/2150360074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5c0d16d0 0x7fdc5c1f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.701+0000 7fdc61c9b640 1 -- 172.21.15.50:0/2150360074 >> 172.21.15.50:0/2150360074 conn(0x7fdc5c0727a0 msgr2=0x7fdc5c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:02.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.701+0000 7fdc61c9b640 1 -- 172.21.15.50:0/2150360074 shutdown_connections 2024-09-11T22:18:02.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.701+0000 7fdc61c9b640 1 -- 172.21.15.50:0/2150360074 wait complete. 2024-09-11T22:18:02.713 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:18:02.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.814+0000 7f116a9b9640 1 Processor -- start 2024-09-11T22:18:02.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.814+0000 7f116a9b9640 1 -- start start 2024-09-11T22:18:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.815+0000 7f116a9b9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11640d1c90 0x7f11640b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.815+0000 7f116a9b9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1164163080 con 0x7f116415e8e0 2024-09-11T22:18:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.815+0000 7f116a9b9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11640d2d20 con 0x7f1164162350 2024-09-11T22:18:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.815+0000 7f116a9b9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f116415ecc0 con 0x7f11640d1c90 2024-09-11T22:18:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.815+0000 7f11637fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11640d1c90 0x7f11640b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.815+0000 7f1163fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f116415e8e0 0x7f11640d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42090/0 (socket says 172.21.15.50:42090) 2024-09-11T22:18:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.815+0000 7f1163fff640 1 -- 172.21.15.50:0/69109551 learned_addr learned my addr 172.21.15.50:0/69109551 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.815+0000 7f11637fe640 1 -- 172.21.15.50:0/69109551 >> v1:172.21.15.77:6789/0 conn(0x7f1164162350 legacy=0x7f11641627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.815+0000 7f11637fe640 1 -- 172.21.15.50:0/69109551 >> v1:172.21.15.50:6789/0 conn(0x7f116415e8e0 legacy=0x7f11640d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.815+0000 7f11637fe640 1 -- 172.21.15.50:0/69109551 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11640d3000 con 0x7f11640d1c90 2024-09-11T22:18:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.815+0000 7f1162ffd640 1 -- 172.21.15.50:0/69109551 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627009224 0 0) 0x7f1164163080 con 0x7f116415e8e0 2024-09-11T22:18:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.816+0000 7f11637fe640 1 --2- 172.21.15.50:0/69109551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11640d1c90 0x7f11640b7880 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f11580097a0 tx=0x7f115802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669e7c834388b85f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.816+0000 7f1162ffd640 1 -- 172.21.15.50:0/69109551 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158037070 con 0x7f11640d1c90 2024-09-11T22:18:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.816+0000 7f1162ffd640 1 -- 172.21.15.50:0/69109551 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1158032440 con 0x7f11640d1c90 2024-09-11T22:18:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.816+0000 7f1162ffd640 1 -- 172.21.15.50:0/69109551 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158032810 con 0x7f11640d1c90 2024-09-11T22:18:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.817+0000 7f116a9b9640 1 -- 172.21.15.50:0/69109551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11640d1c90 msgr2=0x7f11640b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.817+0000 7f116a9b9640 1 --2- 172.21.15.50:0/69109551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11640d1c90 0x7f11640b7880 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f11580097a0 tx=0x7f115802a270 comp rx=0 tx=0).stop 2024-09-11T22:18:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.817+0000 7f116a9b9640 1 -- 172.21.15.50:0/69109551 shutdown_connections 2024-09-11T22:18:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.817+0000 7f116a9b9640 1 --2- 172.21.15.50:0/69109551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11640d1c90 0x7f11640b7880 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.817+0000 7f116a9b9640 1 -- 172.21.15.50:0/69109551 >> 172.21.15.50:0/69109551 conn(0x7f1164067ba0 msgr2=0x7f1164067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.817+0000 7f116a9b9640 1 -- 172.21.15.50:0/69109551 shutdown_connections 2024-09-11T22:18:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.817+0000 7f116a9b9640 1 -- 172.21.15.50:0/69109551 wait complete. 2024-09-11T22:18:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.818+0000 7f116a9b9640 1 Processor -- start 2024-09-11T22:18:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.818+0000 7f116a9b9640 1 -- start start 2024-09-11T22:18:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f116a9b9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11640d1c90 0x7f11641525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f116a9b9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116415e8e0 0x7f11641f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f116a9b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1164162350 0x7f11641f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f116a9b9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f11640d3c10 con 0x7f116415e8e0 2024-09-11T22:18:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f116a9b9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f11640d3a90 con 0x7f1164162350 2024-09-11T22:18:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f116a9b9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f11640d3d90 con 0x7f11640d1c90 2024-09-11T22:18:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f11637fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116415e8e0 0x7f11641f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f11637fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116415e8e0 0x7f11641f7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38972/0 (socket says 172.21.15.50:38972) 2024-09-11T22:18:02.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f11637fe640 1 -- 172.21.15.50:0/1609885129 learned_addr learned my addr 172.21.15.50:0/1609885129 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:02.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f11637fe640 1 -- 172.21.15.50:0/1609885129 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11640d1c90 msgr2=0x7f11641525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f11637fe640 1 --2- 172.21.15.50:0/1609885129 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11640d1c90 0x7f11641525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f11637fe640 1 -- 172.21.15.50:0/1609885129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1164162350 msgr2=0x7f11641f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:02.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f1168f56640 1 --2- 172.21.15.50:0/1609885129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1164162350 0x7f11641f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f11637fe640 1 --2- 172.21.15.50:0/1609885129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1164162350 0x7f11641f7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:02.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f11637fe640 1 -- 172.21.15.50:0/1609885129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1164158df0 con 0x7f116415e8e0 2024-09-11T22:18:02.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.819+0000 7f11637fe640 1 --2- 172.21.15.50:0/1609885129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116415e8e0 0x7f11641f7a00 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f11580097a0 tx=0x7f11580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.820+0000 7f1160ff9640 1 -- 172.21.15.50:0/1609885129 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158041070 con 0x7f116415e8e0 2024-09-11T22:18:02.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.820+0000 7f1160ff9640 1 -- 172.21.15.50:0/1609885129 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f115803c870 con 0x7f116415e8e0 2024-09-11T22:18:02.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.820+0000 7f116a9b9640 1 -- 172.21.15.50:0/1609885129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11641590d0 con 0x7f116415e8e0 2024-09-11T22:18:02.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.820+0000 7f1160ff9640 1 -- 172.21.15.50:0/1609885129 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158037040 con 0x7f116415e8e0 2024-09-11T22:18:02.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.820+0000 7f116a9b9640 1 -- 172.21.15.50:0/1609885129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1164159690 con 0x7f116415e8e0 2024-09-11T22:18:02.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.821+0000 7f116a9b9640 1 -- 172.21.15.50:0/1609885129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11640b7880 con 0x7f116415e8e0 2024-09-11T22:18:02.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.821+0000 7f1160ff9640 1 -- 172.21.15.50:0/1609885129 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1158044070 con 0x7f116415e8e0 2024-09-11T22:18:02.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.822+0000 7f1160ff9640 1 --2- 172.21.15.50:0/1609885129 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f115006be30 0x7f115006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:02.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.822+0000 7f1160ff9640 1 -- 172.21.15.50:0/1609885129 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7f11580abb90 con 0x7f116415e8e0 2024-09-11T22:18:02.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.822+0000 7f1163fff640 1 --2- 172.21.15.50:0/1609885129 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f115006be30 0x7f115006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:02.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.822+0000 7f1163fff640 1 --2- 172.21.15.50:0/1609885129 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f115006be30 0x7f115006e2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1154007fd0 tx=0x7f1154007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:02.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:02.826+0000 7f1160ff9640 1 -- 172.21.15.50:0/1609885129 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f115807a5a0 con 0x7f116415e8e0 2024-09-11T22:18:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.004+0000 7f116a9b9640 1 -- 172.21.15.50:0/1609885129 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11640ba770 con 0x7f116415e8e0 2024-09-11T22:18:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.005+0000 7f1160ff9640 1 -- 172.21.15.50:0/1609885129 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+16710 (secure 0 0 0) 0x7f1158079ea0 con 0x7f116415e8e0 2024-09-11T22:18:03.006 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:03.006 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:17:41.016875+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:16:28.139569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-11T22:16:29.474681+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":108,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:18:03.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.007+0000 7f116a9b9640 1 -- 172.21.15.50:0/1609885129 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f115006be30 msgr2=0x7f115006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.007+0000 7f116a9b9640 1 --2- 172.21.15.50:0/1609885129 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f115006be30 0x7f115006e2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1154007fd0 tx=0x7f1154007920 comp rx=0 tx=0).stop 2024-09-11T22:18:03.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.007+0000 7f116a9b9640 1 -- 172.21.15.50:0/1609885129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116415e8e0 msgr2=0x7f11641f7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.007+0000 7f116a9b9640 1 --2- 172.21.15.50:0/1609885129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116415e8e0 0x7f11641f7a00 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f11580097a0 tx=0x7f11580046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.007+0000 7f116a9b9640 1 -- 172.21.15.50:0/1609885129 shutdown_connections 2024-09-11T22:18:03.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.007+0000 7f116a9b9640 1 --2- 172.21.15.50:0/1609885129 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f115006be30 0x7f115006e2f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.007+0000 7f116a9b9640 1 --2- 172.21.15.50:0/1609885129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1164162350 0x7f11641f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.007+0000 7f116a9b9640 1 --2- 172.21.15.50:0/1609885129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116415e8e0 0x7f11641f7a00 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.007+0000 7f116a9b9640 1 --2- 172.21.15.50:0/1609885129 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11640d1c90 0x7f11641525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.007+0000 7f116a9b9640 1 -- 172.21.15.50:0/1609885129 >> 172.21.15.50:0/1609885129 conn(0x7f1164067ba0 msgr2=0x7f116415faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:03.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.007+0000 7f116a9b9640 1 -- 172.21.15.50:0/1609885129 shutdown_connections 2024-09-11T22:18:03.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.007+0000 7f116a9b9640 1 -- 172.21.15.50:0/1609885129 wait complete. 2024-09-11T22:18:03.019 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:18:03.019 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:18:03.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.121+0000 7f43d0dbe640 1 Processor -- start 2024-09-11T22:18:03.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.121+0000 7f43d0dbe640 1 -- start start 2024-09-11T22:18:03.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.121+0000 7f43d0dbe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43cc15e870 0x7f43cc0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.121+0000 7f43d0dbe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43cc0d3c00 0x7f43cc0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.121+0000 7f43d0dbe640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43cc0cfa80 con 0x7f43cc0d16d0 2024-09-11T22:18:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.121+0000 7f43d0dbe640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f43cc0d1b40 con 0x7f43cc15e870 2024-09-11T22:18:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.121+0000 7f43d0dbe640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43cc0d40d0 con 0x7f43cc0d3c00 2024-09-11T22:18:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.122+0000 7f43ca59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43cc15e870 0x7f43cc0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.122+0000 7f43ca59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43cc15e870 0x7f43cc0d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38988/0 (socket says 172.21.15.50:38988) 2024-09-11T22:18:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.122+0000 7f43ca59c640 1 -- 172.21.15.50:0/3344806247 learned_addr learned my addr 172.21.15.50:0/3344806247 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.122+0000 7f43cad9d640 1 --2- 172.21.15.50:0/3344806247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43cc0d3c00 0x7f43cc0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.122+0000 7f43ca59c640 1 -- 172.21.15.50:0/3344806247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43cc0d3c00 msgr2=0x7f43cc0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.122+0000 7f43ca59c640 1 --2- 172.21.15.50:0/3344806247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43cc0d3c00 0x7f43cc0b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.122+0000 7f43ca59c640 1 -- 172.21.15.50:0/3344806247 >> v1:172.21.15.77:6789/0 conn(0x7f43cc0d16d0 legacy=0x7f43cc0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.122+0000 7f43ca59c640 1 -- 172.21.15.50:0/3344806247 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc0d43b0 con 0x7f43cc15e870 2024-09-11T22:18:03.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.123+0000 7f43ca59c640 1 --2- 172.21.15.50:0/3344806247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43cc15e870 0x7f43cc0d1190 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009870 tx=0x7f43bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7d350ae256571b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:03.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.123+0000 7f43c9d9b640 1 -- 172.21.15.50:0/3344806247 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc037070 con 0x7f43cc15e870 2024-09-11T22:18:03.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.123+0000 7f43c9d9b640 1 -- 172.21.15.50:0/3344806247 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc032440 con 0x7f43cc15e870 2024-09-11T22:18:03.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.123+0000 7f43c9d9b640 1 -- 172.21.15.50:0/3344806247 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc032810 con 0x7f43cc15e870 2024-09-11T22:18:03.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.123+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3344806247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43cc15e870 msgr2=0x7f43cc0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.123+0000 7f43d0dbe640 1 --2- 172.21.15.50:0/3344806247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43cc15e870 0x7f43cc0d1190 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009870 tx=0x7f43bc02a270 comp rx=0 tx=0).stop 2024-09-11T22:18:03.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.123+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3344806247 shutdown_connections 2024-09-11T22:18:03.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.123+0000 7f43d0dbe640 1 --2- 172.21.15.50:0/3344806247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43cc0d3c00 0x7f43cc0b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.123+0000 7f43d0dbe640 1 --2- 172.21.15.50:0/3344806247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43cc15e870 0x7f43cc0d1190 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.123+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3344806247 >> 172.21.15.50:0/3344806247 conn(0x7f43cc0727a0 msgr2=0x7f43cc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:03.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.123+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3344806247 shutdown_connections 2024-09-11T22:18:03.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.123+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3344806247 wait complete. 2024-09-11T22:18:03.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.125+0000 7f43d0dbe640 1 Processor -- start 2024-09-11T22:18:03.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.125+0000 7f43d0dbe640 1 -- start start 2024-09-11T22:18:03.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43d0dbe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43cc0d16d0 0x7f43cc156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43d0dbe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43cc0d3c00 0x7f43cc15b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43d0dbe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43cc15e870 0x7f43cc157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43d0dbe640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc15ec50 con 0x7f43cc0d16d0 2024-09-11T22:18:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43d0dbe640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc0b7ee0 con 0x7f43cc0d3c00 2024-09-11T22:18:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43d0dbe640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43cc0b78b0 con 0x7f43cc15e870 2024-09-11T22:18:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43ca59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43cc0d16d0 0x7f43cc156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43ca59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43cc0d16d0 0x7f43cc156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39004/0 (socket says 172.21.15.50:39004) 2024-09-11T22:18:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43ca59c640 1 -- 172.21.15.50:0/3029590393 learned_addr learned my addr 172.21.15.50:0/3029590393 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43c3fff640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43cc0d3c00 0x7f43cc15b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43cad9d640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43cc15e870 0x7f43cc157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43ca59c640 1 -- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43cc15e870 msgr2=0x7f43cc157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43ca59c640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43cc15e870 0x7f43cc157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43ca59c640 1 -- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43cc0d3c00 msgr2=0x7f43cc15b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43ca59c640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43cc0d3c00 0x7f43cc15b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43ca59c640 1 -- 172.21.15.50:0/3029590393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc15add0 con 0x7f43cc0d16d0 2024-09-11T22:18:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43c3fff640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43cc0d3c00 0x7f43cc15b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43cad9d640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43cc15e870 0x7f43cc157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43ca59c640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43cc0d16d0 0x7f43cc156b30 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f43bc02a2b0 tx=0x7f43bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43c2ffd640 1 -- 172.21.15.50:0/3029590393 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc037040 con 0x7f43cc0d16d0 2024-09-11T22:18:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43c2ffd640 1 -- 172.21.15.50:0/3029590393 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc042070 con 0x7f43cc0d16d0 2024-09-11T22:18:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3029590393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43cc15a810 con 0x7f43cc0d16d0 2024-09-11T22:18:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43c2ffd640 1 -- 172.21.15.50:0/3029590393 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc030880 con 0x7f43cc0d16d0 2024-09-11T22:18:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.126+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3029590393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43cc157070 con 0x7f43cc0d16d0 2024-09-11T22:18:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.127+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3029590393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43cc0d1190 con 0x7f43cc0d16d0 2024-09-11T22:18:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.128+0000 7f43c2ffd640 1 -- 172.21.15.50:0/3029590393 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43bc030a20 con 0x7f43cc0d16d0 2024-09-11T22:18:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.128+0000 7f43c2ffd640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43ac06be30 0x7f43ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.129+0000 7f43c2ffd640 1 -- 172.21.15.50:0/3029590393 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7f43bc0ab790 con 0x7f43cc0d16d0 2024-09-11T22:18:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.129+0000 7f43c3fff640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43ac06be30 0x7f43ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.129+0000 7f43c3fff640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43ac06be30 0x7f43ac06e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f43b4007fd0 tx=0x7f43b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:03.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.133+0000 7f43c2ffd640 1 -- 172.21.15.50:0/3029590393 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43bc07a080 con 0x7f43cc0d16d0 2024-09-11T22:18:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.344+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3029590393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43cc15db80 con 0x7f43cc0d16d0 2024-09-11T22:18:03.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.344+0000 7f43c2ffd640 1 -- 172.21.15.50:0/3029590393 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5225 (secure 0 0 0) 0x7f43bc079980 con 0x7f43cc0d16d0 2024-09-11T22:18:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:03.345 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":77,"btime":"2024-09-11T22:16:42:153332+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3921219668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3921219668},{"type":"v1","addr":"172.21.15.50:6835","nonce":3921219668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1123077854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1123077854},{"type":"v1","addr":"172.21.15.77:6837","nonce":1123077854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1576416639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1576416639},{"type":"v1","addr":"172.21.15.77:6836","nonce":1576416639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-11T22:16:30.480778+0000","modified":"2024-09-11T22:16:41.621342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7605},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7605":{"gid":7605,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/2355059741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2355059741},{"type":"v1","addr":"172.21.15.50:6834","nonce":2355059741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7605,"qdb_cluster":[7605]},"id":7}]} 2024-09-11T22:18:03.346 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 77 2024-09-11T22:18:03.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.346+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43ac06be30 msgr2=0x7f43ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.346+0000 7f43d0dbe640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43ac06be30 0x7f43ac06e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f43b4007fd0 tx=0x7f43b4009040 comp rx=0 tx=0).stop 2024-09-11T22:18:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.346+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3029590393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43cc0d16d0 msgr2=0x7f43cc156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.346+0000 7f43d0dbe640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43cc0d16d0 0x7f43cc156b30 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f43bc02a2b0 tx=0x7f43bc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.346+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3029590393 shutdown_connections 2024-09-11T22:18:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.346+0000 7f43d0dbe640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43ac06be30 0x7f43ac06e2f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.346+0000 7f43d0dbe640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43cc15e870 0x7f43cc157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.346+0000 7f43d0dbe640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43cc0d3c00 0x7f43cc15b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.347+0000 7f43d0dbe640 1 --2- 172.21.15.50:0/3029590393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43cc0d16d0 0x7f43cc156b30 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.347+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3029590393 >> 172.21.15.50:0/3029590393 conn(0x7f43cc0727a0 msgr2=0x7f43cc15bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.347+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3029590393 shutdown_connections 2024-09-11T22:18:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.347+0000 7f43d0dbe640 1 -- 172.21.15.50:0/3029590393 wait complete. 2024-09-11T22:18:03.358 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:18:03.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.459+0000 7f129f118640 1 Processor -- start 2024-09-11T22:18:03.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.459+0000 7f129f118640 1 -- start start 2024-09-11T22:18:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.460+0000 7f129f118640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12980d1c90 0x7f12980b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.460+0000 7f129f118640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1298162350 0x7f12981627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.460+0000 7f129f118640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1298163080 con 0x7f129815e8e0 2024-09-11T22:18:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.460+0000 7f129f118640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f129815ecc0 con 0x7f12980d1c90 2024-09-11T22:18:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.460+0000 7f129f118640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f12980d2ad0 con 0x7f1298162350 2024-09-11T22:18:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.460+0000 7f1297fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12980d1c90 0x7f12980b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.460+0000 7f129ceb4640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f129815e8e0 0x7f12980d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42100/0 (socket says 172.21.15.50:42100) 2024-09-11T22:18:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.460+0000 7f129ceb4640 1 -- 172.21.15.50:0/3722684971 learned_addr learned my addr 172.21.15.50:0/3722684971 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.461+0000 7f129d6b5640 1 --2- 172.21.15.50:0/3722684971 >> v2:172.21.15.77:3300/0 conn(0x7f1298162350 0x7f12981627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.461+0000 7f1297fff640 1 -- 172.21.15.50:0/3722684971 >> v2:172.21.15.77:3300/0 conn(0x7f1298162350 msgr2=0x7f12981627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.461+0000 7f1297fff640 1 --2- 172.21.15.50:0/3722684971 >> v2:172.21.15.77:3300/0 conn(0x7f1298162350 0x7f12981627a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.461+0000 7f1297fff640 1 -- 172.21.15.50:0/3722684971 >> v1:172.21.15.50:6789/0 conn(0x7f129815e8e0 legacy=0x7f12980d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.461+0000 7f1297fff640 1 -- 172.21.15.50:0/3722684971 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12980d2d20 con 0x7f12980d1c90 2024-09-11T22:18:03.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.461+0000 7f129d6b5640 1 --2- 172.21.15.50:0/3722684971 >> v2:172.21.15.77:3300/0 conn(0x7f1298162350 0x7f12981627a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.461+0000 7f1297fff640 1 --2- 172.21.15.50:0/3722684971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12980d1c90 0x7f12980b7880 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f12980d1220 tx=0x7f128c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26a9d360147cdfe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.461+0000 7f12977fe640 1 -- 172.21.15.50:0/3722684971 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128c037070 con 0x7f12980d1c90 2024-09-11T22:18:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.462+0000 7f12977fe640 1 -- 172.21.15.50:0/3722684971 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f128c032440 con 0x7f12980d1c90 2024-09-11T22:18:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.462+0000 7f12977fe640 1 -- 172.21.15.50:0/3722684971 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128c032810 con 0x7f12980d1c90 2024-09-11T22:18:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.462+0000 7f129f118640 1 -- 172.21.15.50:0/3722684971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12980d1c90 msgr2=0x7f12980b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.462+0000 7f129f118640 1 --2- 172.21.15.50:0/3722684971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12980d1c90 0x7f12980b7880 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f12980d1220 tx=0x7f128c02a230 comp rx=0 tx=0).stop 2024-09-11T22:18:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.462+0000 7f129f118640 1 -- 172.21.15.50:0/3722684971 shutdown_connections 2024-09-11T22:18:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.462+0000 7f129f118640 1 --2- 172.21.15.50:0/3722684971 >> v2:172.21.15.77:3300/0 conn(0x7f1298162350 0x7f12981627a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.462+0000 7f129f118640 1 --2- 172.21.15.50:0/3722684971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12980d1c90 0x7f12980b7880 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.462+0000 7f129f118640 1 -- 172.21.15.50:0/3722684971 >> 172.21.15.50:0/3722684971 conn(0x7f1298067ba0 msgr2=0x7f1298067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.462+0000 7f129f118640 1 -- 172.21.15.50:0/3722684971 shutdown_connections 2024-09-11T22:18:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.462+0000 7f129f118640 1 -- 172.21.15.50:0/3722684971 wait complete. 2024-09-11T22:18:03.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.463+0000 7f129f118640 1 Processor -- start 2024-09-11T22:18:03.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.463+0000 7f129f118640 1 -- start start 2024-09-11T22:18:03.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.464+0000 7f129f118640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12980d1c90 0x7f12980ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.464+0000 7f129f118640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129815e8e0 0x7f12980b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.464+0000 7f129f118640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1298162350 0x7f12980b8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.464+0000 7f129f118640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1298162ce0 con 0x7f129815e8e0 2024-09-11T22:18:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.464+0000 7f129f118640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f12980d3370 con 0x7f1298162350 2024-09-11T22:18:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.464+0000 7f129f118640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1298162e60 con 0x7f12980d1c90 2024-09-11T22:18:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.464+0000 7f1297fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129815e8e0 0x7f12980b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.464+0000 7f1297fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129815e8e0 0x7f12980b80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39032/0 (socket says 172.21.15.50:39032) 2024-09-11T22:18:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.464+0000 7f1297fff640 1 -- 172.21.15.50:0/1832614813 learned_addr learned my addr 172.21.15.50:0/1832614813 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.464+0000 7f129ceb4640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12980d1c90 0x7f12980ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.465+0000 7f129d6b5640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1298162350 0x7f12980b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.465+0000 7f1297fff640 1 -- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12980d1c90 msgr2=0x7f12980ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.465+0000 7f1297fff640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12980d1c90 0x7f12980ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.465+0000 7f1297fff640 1 -- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1298162350 msgr2=0x7f12980b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.465+0000 7f1297fff640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1298162350 0x7f12980b8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.465+0000 7f1297fff640 1 -- 172.21.15.50:0/1832614813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12981f52f0 con 0x7f129815e8e0 2024-09-11T22:18:03.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.465+0000 7f1297fff640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129815e8e0 0x7f12980b80e0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f128c000c00 tx=0x7f128c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:03.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.465+0000 7f12957fa640 1 -- 172.21.15.50:0/1832614813 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128c037040 con 0x7f129815e8e0 2024-09-11T22:18:03.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.465+0000 7f12957fa640 1 -- 172.21.15.50:0/1832614813 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f128c042070 con 0x7f129815e8e0 2024-09-11T22:18:03.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.465+0000 7f129f118640 1 -- 172.21.15.50:0/1832614813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12980b44a0 con 0x7f129815e8e0 2024-09-11T22:18:03.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.465+0000 7f12957fa640 1 -- 172.21.15.50:0/1832614813 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128c030a50 con 0x7f129815e8e0 2024-09-11T22:18:03.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.465+0000 7f129f118640 1 -- 172.21.15.50:0/1832614813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12980b4a60 con 0x7f129815e8e0 2024-09-11T22:18:03.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.466+0000 7f129f118640 1 -- 172.21.15.50:0/1832614813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12980b7880 con 0x7f129815e8e0 2024-09-11T22:18:03.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.467+0000 7f12957fa640 1 -- 172.21.15.50:0/1832614813 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f128c030bf0 con 0x7f129815e8e0 2024-09-11T22:18:03.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.467+0000 7f12957fa640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f128406be30 0x7f128406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.468+0000 7f12957fa640 1 -- 172.21.15.50:0/1832614813 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7f128c0ab7d0 con 0x7f129815e8e0 2024-09-11T22:18:03.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.468+0000 7f129ceb4640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f128406be30 0x7f128406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.468+0000 7f129ceb4640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f128406be30 0x7f128406e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1288007fd0 tx=0x7f1288007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:03.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.472+0000 7f12957fa640 1 -- 172.21.15.50:0/1832614813 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f128c079c30 con 0x7f129815e8e0 2024-09-11T22:18:03.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.687+0000 7f129f118640 1 -- 172.21.15.50:0/1832614813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12980d1900 con 0x7f129815e8e0 2024-09-11T22:18:03.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.688+0000 7f12957fa640 1 -- 172.21.15.50:0/1832614813 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5225 (secure 0 0 0) 0x7f128c07df30 con 0x7f129815e8e0 2024-09-11T22:18:03.688 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:03.689 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":77,"btime":"2024-09-11T22:16:42:153332+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3921219668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3921219668},{"type":"v1","addr":"172.21.15.50:6835","nonce":3921219668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1123077854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1123077854},{"type":"v1","addr":"172.21.15.77:6837","nonce":1123077854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1576416639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1576416639},{"type":"v1","addr":"172.21.15.77:6836","nonce":1576416639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-11T22:16:30.480778+0000","modified":"2024-09-11T22:16:41.621342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7605},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7605":{"gid":7605,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/2355059741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2355059741},{"type":"v1","addr":"172.21.15.50:6834","nonce":2355059741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7605,"qdb_cluster":[7605]},"id":7}]} 2024-09-11T22:18:03.689 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 77 2024-09-11T22:18:03.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.690+0000 7f129f118640 1 -- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f128406be30 msgr2=0x7f128406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.690+0000 7f129f118640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f128406be30 0x7f128406e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1288007fd0 tx=0x7f1288007e80 comp rx=0 tx=0).stop 2024-09-11T22:18:03.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.690+0000 7f129f118640 1 -- 172.21.15.50:0/1832614813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129815e8e0 msgr2=0x7f12980b80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.690+0000 7f129f118640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129815e8e0 0x7f12980b80e0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f128c000c00 tx=0x7f128c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.690+0000 7f129f118640 1 -- 172.21.15.50:0/1832614813 shutdown_connections 2024-09-11T22:18:03.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.690+0000 7f129f118640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f128406be30 0x7f128406e2f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.690+0000 7f129f118640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1298162350 0x7f12980b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.690+0000 7f129f118640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f129815e8e0 0x7f12980b80e0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.690+0000 7f129f118640 1 --2- 172.21.15.50:0/1832614813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12980d1c90 0x7f12980ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.690+0000 7f129f118640 1 -- 172.21.15.50:0/1832614813 >> 172.21.15.50:0/1832614813 conn(0x7f1298067ba0 msgr2=0x7f12980cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:03.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.690+0000 7f129f118640 1 -- 172.21.15.50:0/1832614813 shutdown_connections 2024-09-11T22:18:03.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.690+0000 7f129f118640 1 -- 172.21.15.50:0/1832614813 wait complete. 2024-09-11T22:18:03.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:18:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.803+0000 7fe6f85b7640 1 Processor -- start 2024-09-11T22:18:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.803+0000 7fe6f85b7640 1 -- start start 2024-09-11T22:18:03.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f85b7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6f00cf610 0x7fe6f00b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f85b7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6f00cfbd0 con 0x7fe6f00b1600 2024-09-11T22:18:03.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f85b7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6f00cfeb0 con 0x7fe6f0161fa0 2024-09-11T22:18:03.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f85b7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f00d1220 con 0x7fe6f00cf610 2024-09-11T22:18:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f6b54640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe6f00b1600 0x7fe6f00cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42110/0 (socket says 172.21.15.50:42110) 2024-09-11T22:18:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f6b54640 1 -- 172.21.15.50:0/2544818584 learned_addr learned my addr 172.21.15.50:0/2544818584 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f5b52640 1 --2- 172.21.15.50:0/2544818584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6f00cf610 0x7fe6f00b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2589689272 0 0) 0x7fe6f00cfbd0 con 0x7fe6f00b1600 2024-09-11T22:18:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6dc003520 con 0x7fe6f00b1600 2024-09-11T22:18:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2031069985 0 0) 0x7fe6dc003520 con 0x7fe6f00b1600 2024-09-11T22:18:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6f00cf610 msgr2=0x7fe6f00b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f5351640 1 --2- 172.21.15.50:0/2544818584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6f00cf610 0x7fe6f00b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 >> v1:172.21.15.77:6789/0 conn(0x7fe6f0161fa0 legacy=0x7fe6f00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f00d1470 con 0x7fe6f00b1600 2024-09-11T22:18:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fe6e80019f0 con 0x7fe6f00b1600 2024-09-11T22:18:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.804+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 >> v1:172.21.15.50:6789/0 conn(0x7fe6f00b1600 legacy=0x7fe6f00cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f5351640 1 --2- 172.21.15.50:0/2544818584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6dc0039e0 0x7fe6dc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f5351640 1 --2- 172.21.15.50:0/2544818584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6dc004390 0x7fe6dc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f5351640 1 --2- 172.21.15.50:0/2544818584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6f00cf610 0x7fe6dc0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f00d1220 con 0x7fe6dc0039e0 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6dc00b9c0 con 0x7fe6dc004390 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe6dc00bbc0 con 0x7fe6f00cf610 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f6353640 1 --2- 172.21.15.50:0/2544818584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6dc0039e0 0x7fe6dc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f5b52640 1 --2- 172.21.15.50:0/2544818584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6dc004390 0x7fe6dc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f6b54640 1 --2- 172.21.15.50:0/2544818584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6f00cf610 0x7fe6dc0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f6353640 1 -- 172.21.15.50:0/2544818584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6f00cf610 msgr2=0x7fe6dc0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f6353640 1 --2- 172.21.15.50:0/2544818584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6f00cf610 0x7fe6dc0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f6353640 1 -- 172.21.15.50:0/2544818584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6dc004390 msgr2=0x7fe6dc004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f6353640 1 --2- 172.21.15.50:0/2544818584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6dc004390 0x7fe6dc004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.805+0000 7fe6f6353640 1 -- 172.21.15.50:0/2544818584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6dc003520 con 0x7fe6dc0039e0 2024-09-11T22:18:03.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.806+0000 7fe6f6353640 1 --2- 172.21.15.50:0/2544818584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6dc0039e0 0x7fe6dc003dc0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec001860 tx=0x7fe6dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3e83ac5b740819 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.806+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec037070 con 0x7fe6dc0039e0 2024-09-11T22:18:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.806+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec02ac30 con 0x7fe6dc0039e0 2024-09-11T22:18:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.806+0000 7fe6f5351640 1 -- 172.21.15.50:0/2544818584 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec001430 con 0x7fe6dc0039e0 2024-09-11T22:18:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.806+0000 7fe6f85b7640 1 -- 172.21.15.50:0/2544818584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6dc0039e0 msgr2=0x7fe6dc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.806+0000 7fe6f85b7640 1 --2- 172.21.15.50:0/2544818584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6dc0039e0 0x7fe6dc003dc0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec001860 tx=0x7fe6dc005830 comp rx=0 tx=0).stop 2024-09-11T22:18:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.806+0000 7fe6f6b54640 1 -- 172.21.15.50:0/2544818584 reap_dead start 2024-09-11T22:18:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.807+0000 7fe6f85b7640 1 -- 172.21.15.50:0/2544818584 shutdown_connections 2024-09-11T22:18:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.807+0000 7fe6f85b7640 1 -- 172.21.15.50:0/2544818584 >> 172.21.15.50:0/2544818584 conn(0x7fe6f009ba50 msgr2=0x7fe6f00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.807+0000 7fe6f85b7640 1 -- 172.21.15.50:0/2544818584 shutdown_connections 2024-09-11T22:18:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.807+0000 7fe6f85b7640 1 -- 172.21.15.50:0/2544818584 wait complete. 2024-09-11T22:18:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.808+0000 7fe6f85b7640 1 Processor -- start 2024-09-11T22:18:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.808+0000 7fe6f85b7640 1 -- start start 2024-09-11T22:18:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.808+0000 7fe6f85b7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6dc0039e0 0x7fe6f01f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.808+0000 7fe6f85b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6f015fd70 0x7fe6f006bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.808+0000 7fe6f85b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f01f8120 0x7fe6f01f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.808+0000 7fe6f85b7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f00d1c70 con 0x7fe6f01f8120 2024-09-11T22:18:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.808+0000 7fe6f85b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f00d17e0 con 0x7fe6f015fd70 2024-09-11T22:18:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f85b7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f00d1df0 con 0x7fe6dc0039e0 2024-09-11T22:18:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f6b54640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f01f8120 0x7fe6f01f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f6353640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6dc0039e0 0x7fe6f01f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f5b52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6f015fd70 0x7fe6f006bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f6b54640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f01f8120 0x7fe6f01f3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39062/0 (socket says 172.21.15.50:39062) 2024-09-11T22:18:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f6b54640 1 -- 172.21.15.50:0/3175351312 learned_addr learned my addr 172.21.15.50:0/3175351312 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f6b54640 1 -- 172.21.15.50:0/3175351312 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6dc0039e0 msgr2=0x7fe6f01f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f6b54640 1 --2- 172.21.15.50:0/3175351312 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6dc0039e0 0x7fe6f01f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f6b54640 1 -- 172.21.15.50:0/3175351312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6f015fd70 msgr2=0x7fe6f006bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f6b54640 1 --2- 172.21.15.50:0/3175351312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6f015fd70 0x7fe6f006bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f6b54640 1 -- 172.21.15.50:0/3175351312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f0160550 con 0x7fe6f01f8120 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f6b54640 1 --2- 172.21.15.50:0/3175351312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f01f8120 0x7fe6f01f3360 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0072990 tx=0x7fe6e8007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6e6ffd640 1 -- 172.21.15.50:0/3175351312 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8017020 con 0x7fe6f01f8120 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6e6ffd640 1 -- 172.21.15.50:0/3175351312 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e800ab80 con 0x7fe6f01f8120 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f85b7640 1 -- 172.21.15.50:0/3175351312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f01f7680 con 0x7fe6f01f8120 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6e6ffd640 1 -- 172.21.15.50:0/3175351312 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80133f0 con 0x7fe6f01f8120 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.809+0000 7fe6f85b7640 1 -- 172.21.15.50:0/3175351312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f01f7920 con 0x7fe6f01f8120 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.810+0000 7fe6f85b7640 1 -- 172.21.15.50:0/3175351312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6f00b4d20 con 0x7fe6f01f8120 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.811+0000 7fe6e6ffd640 1 -- 172.21.15.50:0/3175351312 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6e801a020 con 0x7fe6f01f8120 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.811+0000 7fe6e6ffd640 1 --2- 172.21.15.50:0/3175351312 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6d406be30 0x7fe6d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.811+0000 7fe6e6ffd640 1 -- 172.21.15.50:0/3175351312 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7fe6e808b4d0 con 0x7fe6f01f8120 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.811+0000 7fe6f6353640 1 --2- 172.21.15.50:0/3175351312 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6d406be30 0x7fe6d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.812+0000 7fe6f6353640 1 --2- 172.21.15.50:0/3175351312 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6d406be30 0x7fe6d406e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec001860 tx=0x7fe6ec009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:03.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.815+0000 7fe6e6ffd640 1 -- 172.21.15.50:0/3175351312 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6e8021020 con 0x7fe6f01f8120 2024-09-11T22:18:03.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.990+0000 7fe6f85b7640 1 -- 172.21.15.50:0/3175351312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6f006c9c0 con 0x7fe6f01f8120 2024-09-11T22:18:03.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.992+0000 7fe6e6ffd640 1 -- 172.21.15.50:0/3175351312 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+16710 (secure 0 0 0) 0x7fe6e8059ef0 con 0x7fe6f01f8120 2024-09-11T22:18:03.993 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:03.993 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:17:41.016875+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:16:28.139569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-11T22:16:29.474681+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":108,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:18:03.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.994+0000 7fe6f85b7640 1 -- 172.21.15.50:0/3175351312 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6d406be30 msgr2=0x7fe6d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.994+0000 7fe6f85b7640 1 --2- 172.21.15.50:0/3175351312 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6d406be30 0x7fe6d406e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec001860 tx=0x7fe6ec009030 comp rx=0 tx=0).stop 2024-09-11T22:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.994+0000 7fe6f85b7640 1 -- 172.21.15.50:0/3175351312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f01f8120 msgr2=0x7fe6f01f3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.994+0000 7fe6f85b7640 1 --2- 172.21.15.50:0/3175351312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f01f8120 0x7fe6f01f3360 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0072990 tx=0x7fe6e8007b10 comp rx=0 tx=0).stop 2024-09-11T22:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.994+0000 7fe6f85b7640 1 -- 172.21.15.50:0/3175351312 shutdown_connections 2024-09-11T22:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.994+0000 7fe6f85b7640 1 --2- 172.21.15.50:0/3175351312 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6d406be30 0x7fe6d406e2f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.994+0000 7fe6f85b7640 1 --2- 172.21.15.50:0/3175351312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6f01f8120 0x7fe6f01f3360 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.994+0000 7fe6f85b7640 1 --2- 172.21.15.50:0/3175351312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6f015fd70 0x7fe6f006bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.994+0000 7fe6f85b7640 1 --2- 172.21.15.50:0/3175351312 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6dc0039e0 0x7fe6f01f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.994+0000 7fe6f85b7640 1 -- 172.21.15.50:0/3175351312 >> 172.21.15.50:0/3175351312 conn(0x7fe6f009ba50 msgr2=0x7fe6f00b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.994+0000 7fe6f85b7640 1 -- 172.21.15.50:0/3175351312 shutdown_connections 2024-09-11T22:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:03.994+0000 7fe6f85b7640 1 -- 172.21.15.50:0/3175351312 wait complete. 2024-09-11T22:18:04.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:18:04.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.107+0000 7fe3ac2d7640 1 Processor -- start 2024-09-11T22:18:04.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.107+0000 7fe3ac2d7640 1 -- start start 2024-09-11T22:18:04.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.108+0000 7fe3ac2d7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3a415c2c0 0x7fe3a40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:04.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.108+0000 7fe3ac2d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3a40d05e0 0x7fe3a40ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:04.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.108+0000 7fe3ac2d7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a40b4f00 con 0x7fe3a40b3e10 2024-09-11T22:18:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.108+0000 7fe3ac2d7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a40b4360 con 0x7fe3a415c2c0 2024-09-11T22:18:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.108+0000 7fe3ac2d7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a40b51c0 con 0x7fe3a40d05e0 2024-09-11T22:18:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.108+0000 7fe3aa073640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3a415c2c0 0x7fe3a40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.108+0000 7fe3a9872640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe3a40b3e10 0x7fe3a40cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42120/0 (socket says 172.21.15.50:42120) 2024-09-11T22:18:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.108+0000 7fe3a9872640 1 -- 172.21.15.50:0/2147145387 learned_addr learned my addr 172.21.15.50:0/2147145387 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.109+0000 7fe3aa073640 1 -- 172.21.15.50:0/2147145387 >> v2:172.21.15.77:3300/0 conn(0x7fe3a40d05e0 msgr2=0x7fe3a40ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.109+0000 7fe3aa874640 1 --2- 172.21.15.50:0/2147145387 >> v2:172.21.15.77:3300/0 conn(0x7fe3a40d05e0 0x7fe3a40ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.109+0000 7fe3a9071640 1 -- 172.21.15.50:0/2147145387 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 357150085 0 0) 0x7fe3a40b4f00 con 0x7fe3a40b3e10 2024-09-11T22:18:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.109+0000 7fe3aa073640 1 --2- 172.21.15.50:0/2147145387 >> v2:172.21.15.77:3300/0 conn(0x7fe3a40d05e0 0x7fe3a40ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.109+0000 7fe3aa073640 1 -- 172.21.15.50:0/2147145387 >> v1:172.21.15.50:6789/0 conn(0x7fe3a40b3e10 legacy=0x7fe3a40cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.109+0000 7fe3aa073640 1 -- 172.21.15.50:0/2147145387 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a40b54a0 con 0x7fe3a415c2c0 2024-09-11T22:18:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.109+0000 7fe3aa874640 1 --2- 172.21.15.50:0/2147145387 >> v2:172.21.15.77:3300/0 conn(0x7fe3a40d05e0 0x7fe3a40ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:04.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.109+0000 7fe3aa073640 1 --2- 172.21.15.50:0/2147145387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a415c2c0 0x7fe3a40b46a0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40b4260 tx=0x7fe39c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6200fdad561a87c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:04.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.109+0000 7fe3a9071640 1 -- 172.21.15.50:0/2147145387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c037070 con 0x7fe3a415c2c0 2024-09-11T22:18:04.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.110+0000 7fe3a9071640 1 -- 172.21.15.50:0/2147145387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c032440 con 0x7fe3a415c2c0 2024-09-11T22:18:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.110+0000 7fe3a9071640 1 -- 172.21.15.50:0/2147145387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c032810 con 0x7fe3a415c2c0 2024-09-11T22:18:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.110+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/2147145387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a415c2c0 msgr2=0x7fe3a40b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.110+0000 7fe3ac2d7640 1 --2- 172.21.15.50:0/2147145387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a415c2c0 0x7fe3a40b46a0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40b4260 tx=0x7fe39c02a1a0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.110+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/2147145387 shutdown_connections 2024-09-11T22:18:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.110+0000 7fe3ac2d7640 1 --2- 172.21.15.50:0/2147145387 >> v2:172.21.15.77:3300/0 conn(0x7fe3a40d05e0 0x7fe3a40ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.110+0000 7fe3ac2d7640 1 --2- 172.21.15.50:0/2147145387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a415c2c0 0x7fe3a40b46a0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.110+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/2147145387 >> 172.21.15.50:0/2147145387 conn(0x7fe3a40679c0 msgr2=0x7fe3a4067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.110+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/2147145387 shutdown_connections 2024-09-11T22:18:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.110+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/2147145387 wait complete. 2024-09-11T22:18:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.111+0000 7fe3ac2d7640 1 Processor -- start 2024-09-11T22:18:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.111+0000 7fe3ac2d7640 1 -- start start 2024-09-11T22:18:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.112+0000 7fe3ac2d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3a40b3e10 0x7fe3a41f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.112+0000 7fe3ac2d7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3a40d05e0 0x7fe3a41f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.112+0000 7fe3ac2d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a415c2c0 0x7fe3a4143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.112+0000 7fe3ac2d7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a406d070 con 0x7fe3a415c2c0 2024-09-11T22:18:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.112+0000 7fe3ac2d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a40ce200 con 0x7fe3a40b3e10 2024-09-11T22:18:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.112+0000 7fe3ac2d7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a406d1f0 con 0x7fe3a40d05e0 2024-09-11T22:18:04.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.112+0000 7fe3aa874640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a415c2c0 0x7fe3a4143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:04.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.112+0000 7fe3aa874640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a415c2c0 0x7fe3a4143c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39084/0 (socket says 172.21.15.50:39084) 2024-09-11T22:18:04.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.112+0000 7fe3aa874640 1 -- 172.21.15.50:0/349533893 learned_addr learned my addr 172.21.15.50:0/349533893 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:04.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.112+0000 7fe3aa073640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3a40b3e10 0x7fe3a41f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:04.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.112+0000 7fe3a9872640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3a40d05e0 0x7fe3a41f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:04.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.113+0000 7fe3aa874640 1 -- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3a40d05e0 msgr2=0x7fe3a41f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:04.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.113+0000 7fe3aa874640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3a40d05e0 0x7fe3a41f29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.113+0000 7fe3aa874640 1 -- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3a40b3e10 msgr2=0x7fe3a41f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.113+0000 7fe3aa874640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3a40b3e10 0x7fe3a41f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.113+0000 7fe3aa874640 1 -- 172.21.15.50:0/349533893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a41f5bc0 con 0x7fe3a415c2c0 2024-09-11T22:18:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.113+0000 7fe3aa874640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a415c2c0 0x7fe3a4143c80 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fe39400cef0 tx=0x7fe39400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.113+0000 7fe3a2ffd640 1 -- 172.21.15.50:0/349533893 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39401a070 con 0x7fe3a415c2c0 2024-09-11T22:18:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.113+0000 7fe3a2ffd640 1 -- 172.21.15.50:0/349533893 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39400d860 con 0x7fe3a415c2c0 2024-09-11T22:18:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.113+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/349533893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a41f5ea0 con 0x7fe3a415c2c0 2024-09-11T22:18:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.113+0000 7fe3a2ffd640 1 -- 172.21.15.50:0/349533893 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39400dc50 con 0x7fe3a415c2c0 2024-09-11T22:18:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.113+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/349533893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a415daa0 con 0x7fe3a415c2c0 2024-09-11T22:18:04.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.114+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/349533893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a41f63c0 con 0x7fe3a415c2c0 2024-09-11T22:18:04.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.115+0000 7fe3a2ffd640 1 -- 172.21.15.50:0/349533893 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe39401d070 con 0x7fe3a415c2c0 2024-09-11T22:18:04.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.115+0000 7fe3a2ffd640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe39006be30 0x7fe39006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:04.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.115+0000 7fe3a2ffd640 1 -- 172.21.15.50:0/349533893 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5737+0+0 (secure 0 0 0) 0x7fe39408b6a0 con 0x7fe3a415c2c0 2024-09-11T22:18:04.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.115+0000 7fe3aa073640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe39006be30 0x7fe39006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:04.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.116+0000 7fe3aa073640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe39006be30 0x7fe39006e2f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe39c034000 tx=0x7fe39c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.119+0000 7fe3a2ffd640 1 -- 172.21.15.50:0/349533893 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe3a41f63c0 con 0x7fe3a415c2c0 2024-09-11T22:18:04.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.331+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/349533893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe3a415c6a0 con 0x7fe3a415c2c0 2024-09-11T22:18:04.332 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:18:04.332+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:18:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.333+0000 7fe3a2ffd640 1 -- 172.21.15.50:0/349533893 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) ==== 161+0+0 (secure 0 0 0) 0x7fe394059aa0 con 0x7fe3a415c2c0 2024-09-11T22:18:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:18:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.336+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe39006be30 msgr2=0x7fe39006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.336+0000 7fe3ac2d7640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe39006be30 0x7fe39006e2f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe39c034000 tx=0x7fe39c02e000 comp rx=0 tx=0).stop 2024-09-11T22:18:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.336+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/349533893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a415c2c0 msgr2=0x7fe3a4143c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.336+0000 7fe3ac2d7640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a415c2c0 0x7fe3a4143c80 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fe39400cef0 tx=0x7fe39400a710 comp rx=0 tx=0).stop 2024-09-11T22:18:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.336+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/349533893 shutdown_connections 2024-09-11T22:18:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.336+0000 7fe3ac2d7640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe39006be30 0x7fe39006e2f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.336+0000 7fe3ac2d7640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3a40d05e0 0x7fe3a41f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.336+0000 7fe3ac2d7640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a415c2c0 0x7fe3a4143c80 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.336+0000 7fe3ac2d7640 1 --2- 172.21.15.50:0/349533893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3a40b3e10 0x7fe3a41f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.336+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/349533893 >> 172.21.15.50:0/349533893 conn(0x7fe3a40679c0 msgr2=0x7fe3a40b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:04.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.336+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/349533893 shutdown_connections 2024-09-11T22:18:04.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.336+0000 7fe3ac2d7640 1 -- 172.21.15.50:0/349533893 wait complete. 2024-09-11T22:18:04.349 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:18:04.378 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:18:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.455+0000 7fce3f5b9640 1 Processor -- start 2024-09-11T22:18:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.455+0000 7fce3f5b9640 1 -- start start 2024-09-11T22:18:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.456+0000 7fce3f5b9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fce38161fa0 0x7fce380b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.456+0000 7fce3f5b9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce380cf610 0x7fce380cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.456+0000 7fce3f5b9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce380cfbd0 con 0x7fce380b1600 2024-09-11T22:18:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.456+0000 7fce3f5b9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fce380d1220 con 0x7fce38161fa0 2024-09-11T22:18:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.456+0000 7fce3f5b9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fce380d17e0 con 0x7fce380cf610 2024-09-11T22:18:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.456+0000 7fce3d355640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fce38161fa0 0x7fce380b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.456+0000 7fce3d355640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fce38161fa0 0x7fce380b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39114/0 (socket says 172.21.15.50:39114) 2024-09-11T22:18:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.456+0000 7fce3d355640 1 -- 172.21.15.50:0/2406536858 learned_addr learned my addr 172.21.15.50:0/2406536858 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:04.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.456+0000 7fce3db56640 1 --2- 172.21.15.50:0/2406536858 >> v2:172.21.15.77:3300/0 conn(0x7fce380cf610 0x7fce380cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.456+0000 7fce3d355640 1 -- 172.21.15.50:0/2406536858 >> v2:172.21.15.77:3300/0 conn(0x7fce380cf610 msgr2=0x7fce380cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.456+0000 7fce3d355640 1 --2- 172.21.15.50:0/2406536858 >> v2:172.21.15.77:3300/0 conn(0x7fce380cf610 0x7fce380cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.456+0000 7fce3d355640 1 -- 172.21.15.50:0/2406536858 >> v1:172.21.15.77:6789/0 conn(0x7fce380b1600 legacy=0x7fce380cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.457+0000 7fce3d355640 1 -- 172.21.15.50:0/2406536858 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce380cfeb0 con 0x7fce38161fa0 2024-09-11T22:18:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.457+0000 7fce3db56640 1 --2- 172.21.15.50:0/2406536858 >> v2:172.21.15.77:3300/0 conn(0x7fce380cf610 0x7fce380cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.457+0000 7fce3d355640 1 --2- 172.21.15.50:0/2406536858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce38161fa0 0x7fce380b4d20 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fce380b2010 tx=0x7fce3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2184a61f915ac949 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.457+0000 7fce2ffff640 1 -- 172.21.15.50:0/2406536858 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34037070 con 0x7fce38161fa0 2024-09-11T22:18:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.457+0000 7fce2ffff640 1 -- 172.21.15.50:0/2406536858 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce34032440 con 0x7fce38161fa0 2024-09-11T22:18:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.457+0000 7fce2ffff640 1 -- 172.21.15.50:0/2406536858 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34032810 con 0x7fce38161fa0 2024-09-11T22:18:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.458+0000 7fce3f5b9640 1 -- 172.21.15.50:0/2406536858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce38161fa0 msgr2=0x7fce380b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.458+0000 7fce3f5b9640 1 --2- 172.21.15.50:0/2406536858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce38161fa0 0x7fce380b4d20 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fce380b2010 tx=0x7fce3402a270 comp rx=0 tx=0).stop 2024-09-11T22:18:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.458+0000 7fce3f5b9640 1 -- 172.21.15.50:0/2406536858 shutdown_connections 2024-09-11T22:18:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.458+0000 7fce3f5b9640 1 --2- 172.21.15.50:0/2406536858 >> v2:172.21.15.77:3300/0 conn(0x7fce380cf610 0x7fce380cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.458+0000 7fce3f5b9640 1 --2- 172.21.15.50:0/2406536858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce38161fa0 0x7fce380b4d20 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.458+0000 7fce3f5b9640 1 -- 172.21.15.50:0/2406536858 >> 172.21.15.50:0/2406536858 conn(0x7fce3809ba50 msgr2=0x7fce380b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.458+0000 7fce3f5b9640 1 -- 172.21.15.50:0/2406536858 shutdown_connections 2024-09-11T22:18:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.458+0000 7fce3f5b9640 1 -- 172.21.15.50:0/2406536858 wait complete. 2024-09-11T22:18:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.459+0000 7fce3f5b9640 1 Processor -- start 2024-09-11T22:18:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.459+0000 7fce3f5b9640 1 -- start start 2024-09-11T22:18:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3f5b9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce380b1600 0x7fce38154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3f5b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce380cf610 0x7fce380b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3f5b9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce38161fa0 0x7fce380b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3f5b9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce38162500 con 0x7fce380b1600 2024-09-11T22:18:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3f5b9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce38162380 con 0x7fce380cf610 2024-09-11T22:18:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3f5b9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fce380d1c70 con 0x7fce38161fa0 2024-09-11T22:18:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3d355640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce380b1600 0x7fce38154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3d355640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce380b1600 0x7fce38154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39126/0 (socket says 172.21.15.50:39126) 2024-09-11T22:18:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3d355640 1 -- 172.21.15.50:0/1495715839 learned_addr learned my addr 172.21.15.50:0/1495715839 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3cb54640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce380cf610 0x7fce380b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3db56640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce38161fa0 0x7fce380b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3d355640 1 -- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce38161fa0 msgr2=0x7fce380b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3d355640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce38161fa0 0x7fce380b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3d355640 1 -- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce380cf610 msgr2=0x7fce380b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3d355640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce380cf610 0x7fce380b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.460+0000 7fce3d355640 1 -- 172.21.15.50:0/1495715839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce380cb520 con 0x7fce380b1600 2024-09-11T22:18:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.461+0000 7fce3d355640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce380b1600 0x7fce38154c40 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fce3402a2b0 tx=0x7fce340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.461+0000 7fce2dffb640 1 -- 172.21.15.50:0/1495715839 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34041020 con 0x7fce380b1600 2024-09-11T22:18:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.461+0000 7fce2dffb640 1 -- 172.21.15.50:0/1495715839 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce340306c0 con 0x7fce380b1600 2024-09-11T22:18:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.461+0000 7fce3f5b9640 1 -- 172.21.15.50:0/1495715839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce380cb7c0 con 0x7fce380b1600 2024-09-11T22:18:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.461+0000 7fce2dffb640 1 -- 172.21.15.50:0/1495715839 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34037040 con 0x7fce380b1600 2024-09-11T22:18:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.461+0000 7fce3f5b9640 1 -- 172.21.15.50:0/1495715839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce380b6c70 con 0x7fce380b1600 2024-09-11T22:18:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.462+0000 7fce3f5b9640 1 -- 172.21.15.50:0/1495715839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce380d0e60 con 0x7fce380b1600 2024-09-11T22:18:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.463+0000 7fce2dffb640 1 -- 172.21.15.50:0/1495715839 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce34044020 con 0x7fce380b1600 2024-09-11T22:18:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.463+0000 7fce2dffb640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fce1c06be30 0x7fce1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.463+0000 7fce2dffb640 1 -- 172.21.15.50:0/1495715839 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5795+0+0 (secure 0 0 0) 0x7fce340ab500 con 0x7fce380b1600 2024-09-11T22:18:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.463+0000 7fce3cb54640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fce1c06be30 0x7fce1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:04.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.464+0000 7fce3cb54640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fce1c06be30 0x7fce1c06e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fce3815ecd0 tx=0x7fce28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:04.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.467+0000 7fce2dffb640 1 -- 172.21.15.50:0/1495715839 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce380d0e60 con 0x7fce380b1600 2024-09-11T22:18:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:04.684+0000 7fce3f5b9640 1 -- 172.21.15.50:0/1495715839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fce380b4d20 con 0x7fce380b1600 2024-09-11T22:18:05.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.334+0000 7fce2dffb640 1 -- 172.21.15.50:0/1495715839 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) ==== 104+0+0 (secure 0 0 0) 0x7fce3404b030 con 0x7fce380b1600 2024-09-11T22:18:05.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.338+0000 7fce3f5b9640 1 -- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fce1c06be30 msgr2=0x7fce1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:05.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.338+0000 7fce3f5b9640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fce1c06be30 0x7fce1c06e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fce3815ecd0 tx=0x7fce28009040 comp rx=0 tx=0).stop 2024-09-11T22:18:05.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.338+0000 7fce3f5b9640 1 -- 172.21.15.50:0/1495715839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce380b1600 msgr2=0x7fce38154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:05.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.338+0000 7fce3f5b9640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce380b1600 0x7fce38154c40 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fce3402a2b0 tx=0x7fce340046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:05.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.338+0000 7fce3f5b9640 1 -- 172.21.15.50:0/1495715839 shutdown_connections 2024-09-11T22:18:05.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.338+0000 7fce3f5b9640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fce1c06be30 0x7fce1c06e2f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:05.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.338+0000 7fce3f5b9640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce38161fa0 0x7fce380b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:05.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.338+0000 7fce3f5b9640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce380cf610 0x7fce380b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:05.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.338+0000 7fce3f5b9640 1 --2- 172.21.15.50:0/1495715839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce380b1600 0x7fce38154c40 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:05.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.338+0000 7fce3f5b9640 1 -- 172.21.15.50:0/1495715839 >> 172.21.15.50:0/1495715839 conn(0x7fce3809ba50 msgr2=0x7fce380b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:05.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.338+0000 7fce3f5b9640 1 -- 172.21.15.50:0/1495715839 shutdown_connections 2024-09-11T22:18:05.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.338+0000 7fce3f5b9640 1 -- 172.21.15.50:0/1495715839 wait complete. 2024-09-11T22:18:05.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:18:05.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.508+0000 7f0a1afb7640 1 Processor -- start 2024-09-11T22:18:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.508+0000 7f0a1afb7640 1 -- start start 2024-09-11T22:18:05.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a1afb7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0a140b6730 0x7f0a140b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:05.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a1afb7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a140b8150 0x7f0a140b8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:05.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a1afb7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a140b7990 con 0x7f0a14161d60 2024-09-11T22:18:05.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a1afb7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0a140b70e0 con 0x7f0a140b6730 2024-09-11T22:18:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a1afb7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0a140d4530 con 0x7f0a140b8150 2024-09-11T22:18:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a18d53640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0a14161d60 0x7f0a140d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42122/0 (socket says 172.21.15.50:42122) 2024-09-11T22:18:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a18d53640 1 -- 172.21.15.50:0/3128412624 learned_addr learned my addr 172.21.15.50:0/3128412624 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2083820277 0 0) 0x7f0a140b7990 con 0x7f0a14161d60 2024-09-11T22:18:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a13fff640 1 --2- 172.21.15.50:0/3128412624 >> v2:172.21.15.77:3300/0 conn(0x7f0a140b6730 0x7f0a140b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a04003520 con 0x7f0a14161d60 2024-09-11T22:18:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a19554640 1 --2- 172.21.15.50:0/3128412624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a140b8150 0x7f0a140b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 399063909 0 0) 0x7f0a04003520 con 0x7f0a14161d60 2024-09-11T22:18:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a140b8150 msgr2=0x7f0a140b8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 --2- 172.21.15.50:0/3128412624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a140b8150 0x7f0a140b8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 >> v2:172.21.15.77:3300/0 conn(0x7f0a140b6730 msgr2=0x7f0a140b6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 --2- 172.21.15.50:0/3128412624 >> v2:172.21.15.77:3300/0 conn(0x7f0a140b6730 0x7f0a140b6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a140d3f70 con 0x7f0a14161d60 2024-09-11T22:18:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f0a08001670 con 0x7f0a14161d60 2024-09-11T22:18:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 >> v1:172.21.15.50:6789/0 conn(0x7f0a14161d60 legacy=0x7f0a140d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 --2- 172.21.15.50:0/3128412624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a140b8150 0x7f0a040039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 --2- 172.21.15.50:0/3128412624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a04003f30 0x7f0a04004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 --2- 172.21.15.50:0/3128412624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04004d40 0x7f0a040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0a140b70e0 con 0x7f0a04004d40 2024-09-11T22:18:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0a140d4530 con 0x7f0a04003f30 2024-09-11T22:18:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.509+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0a0400b9c0 con 0x7f0a140b8150 2024-09-11T22:18:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.510+0000 7f0a19554640 1 --2- 172.21.15.50:0/3128412624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04004d40 0x7f0a040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.510+0000 7f0a18d53640 1 --2- 172.21.15.50:0/3128412624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a140b8150 0x7f0a040039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.510+0000 7f0a13fff640 1 --2- 172.21.15.50:0/3128412624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a04003f30 0x7f0a04004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.510+0000 7f0a19554640 1 -- 172.21.15.50:0/3128412624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a140b8150 msgr2=0x7f0a040039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.510+0000 7f0a19554640 1 --2- 172.21.15.50:0/3128412624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a140b8150 0x7f0a040039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.510+0000 7f0a19554640 1 -- 172.21.15.50:0/3128412624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a04003f30 msgr2=0x7f0a04004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.510+0000 7f0a19554640 1 --2- 172.21.15.50:0/3128412624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a04003f30 0x7f0a04004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.510+0000 7f0a19554640 1 -- 172.21.15.50:0/3128412624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a04003520 con 0x7f0a04004d40 2024-09-11T22:18:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.511+0000 7f0a19554640 1 --2- 172.21.15.50:0/3128412624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04004d40 0x7f0a040051c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009fc0 tx=0x7f0a04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fea5d5b67ae59f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.511+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c009c10 con 0x7f0a04004d40 2024-09-11T22:18:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.511+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a0c036070 con 0x7f0a04004d40 2024-09-11T22:18:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.511+0000 7f0a137fe640 1 -- 172.21.15.50:0/3128412624 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c031670 con 0x7f0a04004d40 2024-09-11T22:18:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.511+0000 7f0a1afb7640 1 -- 172.21.15.50:0/3128412624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04004d40 msgr2=0x7f0a040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.511+0000 7f0a1afb7640 1 --2- 172.21.15.50:0/3128412624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04004d40 0x7f0a040051c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009fc0 tx=0x7f0a04005830 comp rx=0 tx=0).stop 2024-09-11T22:18:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.511+0000 7f0a19554640 1 -- 172.21.15.50:0/3128412624 reap_dead start 2024-09-11T22:18:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.511+0000 7f0a1afb7640 1 -- 172.21.15.50:0/3128412624 shutdown_connections 2024-09-11T22:18:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.511+0000 7f0a1afb7640 1 -- 172.21.15.50:0/3128412624 >> 172.21.15.50:0/3128412624 conn(0x7f0a14067db0 msgr2=0x7f0a140681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.511+0000 7f0a1afb7640 1 -- 172.21.15.50:0/3128412624 shutdown_connections 2024-09-11T22:18:05.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.511+0000 7f0a1afb7640 1 -- 172.21.15.50:0/3128412624 wait complete. 2024-09-11T22:18:05.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.513+0000 7f0a1afb7640 1 Processor -- start 2024-09-11T22:18:05.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.513+0000 7f0a1afb7640 1 -- start start 2024-09-11T22:18:05.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.513+0000 7f0a1afb7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a1415bd50 0x7f0a140ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:05.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.513+0000 7f0a1afb7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a1415c130 0x7f0a140abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:05.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.513+0000 7f0a1afb7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a140ac0a0 0x7f0a1415ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:05.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.513+0000 7f0a1afb7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0a140cf930 con 0x7f0a140ac0a0 2024-09-11T22:18:05.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.513+0000 7f0a1afb7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0a140b7c30 con 0x7f0a1415bd50 2024-09-11T22:18:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.513+0000 7f0a1afb7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0a140d3bc0 con 0x7f0a1415c130 2024-09-11T22:18:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a19554640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a140ac0a0 0x7f0a1415ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a19554640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a140ac0a0 0x7f0a1415ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39152/0 (socket says 172.21.15.50:39152) 2024-09-11T22:18:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a19554640 1 -- 172.21.15.50:0/392769195 learned_addr learned my addr 172.21.15.50:0/392769195 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a18d53640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a1415bd50 0x7f0a140ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a13fff640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a1415c130 0x7f0a140abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a19554640 1 -- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a1415c130 msgr2=0x7f0a140abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a19554640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a1415c130 0x7f0a140abb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a19554640 1 -- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a1415bd50 msgr2=0x7f0a140ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a19554640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a1415bd50 0x7f0a140ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a19554640 1 -- 172.21.15.50:0/392769195 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a140addd0 con 0x7f0a140ac0a0 2024-09-11T22:18:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a19554640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a140ac0a0 0x7f0a1415ea00 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c033040 tx=0x7f0a0c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a117fa640 1 -- 172.21.15.50:0/392769195 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c009c10 con 0x7f0a140ac0a0 2024-09-11T22:18:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a117fa640 1 -- 172.21.15.50:0/392769195 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a0c031dd0 con 0x7f0a140ac0a0 2024-09-11T22:18:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a1afb7640 1 -- 172.21.15.50:0/392769195 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a140acad0 con 0x7f0a140ac0a0 2024-09-11T22:18:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a117fa640 1 -- 172.21.15.50:0/392769195 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c003bb0 con 0x7f0a140ac0a0 2024-09-11T22:18:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.514+0000 7f0a1afb7640 1 -- 172.21.15.50:0/392769195 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a140ad090 con 0x7f0a140ac0a0 2024-09-11T22:18:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.516+0000 7f0a1afb7640 1 -- 172.21.15.50:0/392769195 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a140b6ba0 con 0x7f0a140ac0a0 2024-09-11T22:18:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.516+0000 7f0a117fa640 1 -- 172.21.15.50:0/392769195 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a0c005d10 con 0x7f0a140ac0a0 2024-09-11T22:18:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.516+0000 7f0a117fa640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f09f806be30 0x7f09f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.517+0000 7f0a117fa640 1 -- 172.21.15.50:0/392769195 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5795+0+0 (secure 0 0 0) 0x7f0a0c0abcc0 con 0x7f0a140ac0a0 2024-09-11T22:18:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.517+0000 7f0a18d53640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f09f806be30 0x7f09f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.517+0000 7f0a18d53640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f09f806be30 0x7f09f806e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0a08004840 tx=0x7f0a08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:05.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.521+0000 7f0a117fa640 1 -- 172.21.15.50:0/392769195 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a0c049060 con 0x7f0a140ac0a0 2024-09-11T22:18:05.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:05.694+0000 7f0a1afb7640 1 -- 172.21.15.50:0/392769195 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0a140b49f0 con 0x7f0a140ac0a0 2024-09-11T22:18:06.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.335+0000 7f0a117fa640 1 -- 172.21.15.50:0/392769195 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v111) ==== 181+0+0 (secure 0 0 0) 0x7f0a0c07a6a0 con 0x7f0a140ac0a0 2024-09-11T22:18:06.336 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:18:06.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.339+0000 7f0a1afb7640 1 -- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f09f806be30 msgr2=0x7f09f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:06.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.339+0000 7f0a1afb7640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f09f806be30 0x7f09f806e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0a08004840 tx=0x7f0a08009040 comp rx=0 tx=0).stop 2024-09-11T22:18:06.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.339+0000 7f0a1afb7640 1 -- 172.21.15.50:0/392769195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a140ac0a0 msgr2=0x7f0a1415ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:06.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.339+0000 7f0a1afb7640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a140ac0a0 0x7f0a1415ea00 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c033040 tx=0x7f0a0c009750 comp rx=0 tx=0).stop 2024-09-11T22:18:06.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.339+0000 7f0a1afb7640 1 -- 172.21.15.50:0/392769195 shutdown_connections 2024-09-11T22:18:06.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.339+0000 7f0a1afb7640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f09f806be30 0x7f09f806e2f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:06.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.339+0000 7f0a1afb7640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a1415c130 0x7f0a140abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:06.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.339+0000 7f0a1afb7640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a140ac0a0 0x7f0a1415ea00 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:06.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.339+0000 7f0a1afb7640 1 --2- 172.21.15.50:0/392769195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a1415bd50 0x7f0a140ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:06.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.339+0000 7f0a1afb7640 1 -- 172.21.15.50:0/392769195 >> 172.21.15.50:0/392769195 conn(0x7f0a14067db0 msgr2=0x7f0a140b5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:06.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.339+0000 7f0a1afb7640 1 -- 172.21.15.50:0/392769195 shutdown_connections 2024-09-11T22:18:06.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.339+0000 7f0a1afb7640 1 -- 172.21.15.50:0/392769195 wait complete. 2024-09-11T22:18:06.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:18:06.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.467+0000 7fa7b8b2a640 1 Processor -- start 2024-09-11T22:18:06.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.467+0000 7fa7b8b2a640 1 -- start start 2024-09-11T22:18:06.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.468+0000 7fa7b8b2a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7b4161fa0 0x7fa7b40b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:06.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.468+0000 7fa7b8b2a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b40cfbd0 con 0x7fa7b40b1600 2024-09-11T22:18:06.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.468+0000 7fa7b8b2a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b40cfeb0 con 0x7fa7b40cf610 2024-09-11T22:18:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.468+0000 7fa7b8b2a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b40d1220 con 0x7fa7b4161fa0 2024-09-11T22:18:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.468+0000 7fa7b1d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa7b40b1600 0x7fa7b40cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42132/0 (socket says 172.21.15.50:42132) 2024-09-11T22:18:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.468+0000 7fa7b1d9b640 1 -- 172.21.15.50:0/4054905503 learned_addr learned my addr 172.21.15.50:0/4054905503 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.468+0000 7fa7b259c640 1 --2- 172.21.15.50:0/4054905503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7b4161fa0 0x7fa7b40b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.468+0000 7fa7b159a640 1 -- 172.21.15.50:0/4054905503 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3196019938 0 0) 0x7fa7b40cfbd0 con 0x7fa7b40b1600 2024-09-11T22:18:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.468+0000 7fa7b159a640 1 -- 172.21.15.50:0/4054905503 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa79c003520 con 0x7fa7b40b1600 2024-09-11T22:18:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.469+0000 7fa7b159a640 1 -- 172.21.15.50:0/4054905503 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1296518551 0 0) 0x7fa7b40cfeb0 con 0x7fa7b40cf610 2024-09-11T22:18:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.469+0000 7fa7b159a640 1 -- 172.21.15.50:0/4054905503 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7b40cfbd0 con 0x7fa7b40cf610 2024-09-11T22:18:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.469+0000 7fa7b259c640 1 -- 172.21.15.50:0/4054905503 >> v1:172.21.15.77:6789/0 conn(0x7fa7b40cf610 legacy=0x7fa7b40cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.469+0000 7fa7b259c640 1 -- 172.21.15.50:0/4054905503 >> v1:172.21.15.50:6789/0 conn(0x7fa7b40b1600 legacy=0x7fa7b40cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.469+0000 7fa7b159a640 1 -- 172.21.15.50:0/4054905503 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 187678652 0 0) 0x7fa79c003520 con 0x7fa7b40b1600 2024-09-11T22:18:06.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.469+0000 7fa7b259c640 1 -- 172.21.15.50:0/4054905503 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b40d1470 con 0x7fa7b4161fa0 2024-09-11T22:18:06.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.470+0000 7fa7b259c640 1 --2- 172.21.15.50:0/4054905503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7b4161fa0 0x7fa7b40b4d20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40097d0 tx=0x7fa7a402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0e12f205c380385 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.470+0000 7fa7b159a640 1 -- 172.21.15.50:0/4054905503 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4037070 con 0x7fa7b4161fa0 2024-09-11T22:18:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.470+0000 7fa7b159a640 1 -- 172.21.15.50:0/4054905503 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a402ac30 con 0x7fa7b4161fa0 2024-09-11T22:18:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.470+0000 7fa7b159a640 1 -- 172.21.15.50:0/4054905503 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8001670 con 0x7fa7b4161fa0 2024-09-11T22:18:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.470+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/4054905503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7b4161fa0 msgr2=0x7fa7b40b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.470+0000 7fa7b8b2a640 1 --2- 172.21.15.50:0/4054905503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7b4161fa0 0x7fa7b40b4d20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40097d0 tx=0x7fa7a402a1a0 comp rx=0 tx=0).stop 2024-09-11T22:18:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.470+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/4054905503 shutdown_connections 2024-09-11T22:18:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.470+0000 7fa7b8b2a640 1 --2- 172.21.15.50:0/4054905503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7b4161fa0 0x7fa7b40b4d20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.470+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/4054905503 >> 172.21.15.50:0/4054905503 conn(0x7fa7b409ba50 msgr2=0x7fa7b40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.470+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/4054905503 shutdown_connections 2024-09-11T22:18:06.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.470+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/4054905503 wait complete. 2024-09-11T22:18:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.472+0000 7fa7b8b2a640 1 Processor -- start 2024-09-11T22:18:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.472+0000 7fa7b8b2a640 1 -- start start 2024-09-11T22:18:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.472+0000 7fa7b8b2a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b40b1600 0x7fa7b4160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.472+0000 7fa7b8b2a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7b40cf610 0x7fa7b40cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.472+0000 7fa7b8b2a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b4161fa0 0x7fa7b40cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.472+0000 7fa7b8b2a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b40d1c70 con 0x7fa7b4161fa0 2024-09-11T22:18:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.472+0000 7fa7b8b2a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b40d17e0 con 0x7fa7b40b1600 2024-09-11T22:18:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.472+0000 7fa7b8b2a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b40d1df0 con 0x7fa7b40cf610 2024-09-11T22:18:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7b2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b4161fa0 0x7fa7b40cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7b1d9b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7b40cf610 0x7fa7b40cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7b2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b4161fa0 0x7fa7b40cb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39164/0 (socket says 172.21.15.50:39164) 2024-09-11T22:18:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7b2d9d640 1 -- 172.21.15.50:0/1569055582 learned_addr learned my addr 172.21.15.50:0/1569055582 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7b259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b40b1600 0x7fa7b4160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7b2d9d640 1 -- 172.21.15.50:0/1569055582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7b40cf610 msgr2=0x7fa7b40cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7b2d9d640 1 --2- 172.21.15.50:0/1569055582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7b40cf610 0x7fa7b40cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:06.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7b2d9d640 1 -- 172.21.15.50:0/1569055582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b40b1600 msgr2=0x7fa7b4160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:06.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7b2d9d640 1 --2- 172.21.15.50:0/1569055582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b40b1600 0x7fa7b4160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:06.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7b2d9d640 1 -- 172.21.15.50:0/1569055582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b40b2060 con 0x7fa7b4161fa0 2024-09-11T22:18:06.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7b2d9d640 1 --2- 172.21.15.50:0/1569055582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b4161fa0 0x7fa7b40cb870 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00c790 tx=0x7fa7ac00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:06.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7a2ffd640 1 -- 172.21.15.50:0/1569055582 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac003b70 con 0x7fa7b4161fa0 2024-09-11T22:18:06.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7a2ffd640 1 -- 172.21.15.50:0/1569055582 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ac003d10 con 0x7fa7b4161fa0 2024-09-11T22:18:06.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/1569055582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b40b2340 con 0x7fa7b4161fa0 2024-09-11T22:18:06.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7a2ffd640 1 -- 172.21.15.50:0/1569055582 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac00aa50 con 0x7fa7b4161fa0 2024-09-11T22:18:06.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.473+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/1569055582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b40b2900 con 0x7fa7b4161fa0 2024-09-11T22:18:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.474+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/1569055582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b40b4d20 con 0x7fa7b4161fa0 2024-09-11T22:18:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.475+0000 7fa7a2ffd640 1 -- 172.21.15.50:0/1569055582 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7ac00abf0 con 0x7fa7b4161fa0 2024-09-11T22:18:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.475+0000 7fa7a2ffd640 1 --2- 172.21.15.50:0/1569055582 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa79406be30 0x7fa79406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.475+0000 7fa7a2ffd640 1 -- 172.21.15.50:0/1569055582 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5357+0+0 (secure 0 0 0) 0x7fa7ac08ac20 con 0x7fa7b4161fa0 2024-09-11T22:18:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.476+0000 7fa7b259c640 1 --2- 172.21.15.50:0/1569055582 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa79406be30 0x7fa79406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:06.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.476+0000 7fa7b259c640 1 --2- 172.21.15.50:0/1569055582 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa79406be30 0x7fa79406e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4034000 tx=0x7fa7a402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:06.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.481+0000 7fa7a2ffd640 1 -- 172.21.15.50:0/1569055582 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7ac059040 con 0x7fa7b4161fa0 2024-09-11T22:18:06.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:06.667+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/1569055582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa7b40b3000 con 0x7fa7b4161fa0 2024-09-11T22:18:07.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.345+0000 7fa7a2ffd640 1 -- 172.21.15.50:0/1569055582 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v112) ==== 169+0+0 (secure 0 0 0) 0x7fa7ac05d340 con 0x7fa7b4161fa0 2024-09-11T22:18:07.346 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:18:07.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.349+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/1569055582 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa79406be30 msgr2=0x7fa79406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:07.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.349+0000 7fa7b8b2a640 1 --2- 172.21.15.50:0/1569055582 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa79406be30 0x7fa79406e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4034000 tx=0x7fa7a402e000 comp rx=0 tx=0).stop 2024-09-11T22:18:07.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.349+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/1569055582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b4161fa0 msgr2=0x7fa7b40cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:07.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.349+0000 7fa7b8b2a640 1 --2- 172.21.15.50:0/1569055582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b4161fa0 0x7fa7b40cb870 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00c790 tx=0x7fa7ac00cc50 comp rx=0 tx=0).stop 2024-09-11T22:18:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.349+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/1569055582 shutdown_connections 2024-09-11T22:18:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.349+0000 7fa7b8b2a640 1 --2- 172.21.15.50:0/1569055582 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa79406be30 0x7fa79406e2f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.349+0000 7fa7b8b2a640 1 --2- 172.21.15.50:0/1569055582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7b40cf610 0x7fa7b40cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.349+0000 7fa7b8b2a640 1 --2- 172.21.15.50:0/1569055582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b4161fa0 0x7fa7b40cb870 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.349+0000 7fa7b8b2a640 1 --2- 172.21.15.50:0/1569055582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b40b1600 0x7fa7b4160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.349+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/1569055582 >> 172.21.15.50:0/1569055582 conn(0x7fa7b409ba50 msgr2=0x7fa7b40b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.349+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/1569055582 shutdown_connections 2024-09-11T22:18:07.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.349+0000 7fa7b8b2a640 1 -- 172.21.15.50:0/1569055582 wait complete. 2024-09-11T22:18:07.366 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T22:18:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.475+0000 7f468899f640 1 Processor -- start 2024-09-11T22:18:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.475+0000 7f468899f640 1 -- start start 2024-09-11T22:18:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.476+0000 7f468899f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f468415c2c0 0x7f46840b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.476+0000 7f468899f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46840b4f00 con 0x7f46840b3e10 2024-09-11T22:18:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.476+0000 7f468899f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46840b4360 con 0x7f46840d05e0 2024-09-11T22:18:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.476+0000 7f468899f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f46840b51c0 con 0x7f468415c2c0 2024-09-11T22:18:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.476+0000 7f468259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f468415c2c0 0x7f46840b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.476+0000 7f4681d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f46840b3e10 0x7f46840cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51168/0 (socket says 172.21.15.50:51168) 2024-09-11T22:18:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.476+0000 7f4681d9b640 1 -- 172.21.15.50:0/4034669932 learned_addr learned my addr 172.21.15.50:0/4034669932 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.476+0000 7f468259c640 1 -- 172.21.15.50:0/4034669932 >> v1:172.21.15.77:6789/0 conn(0x7f46840d05e0 legacy=0x7f46840ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.476+0000 7f468259c640 1 -- 172.21.15.50:0/4034669932 >> v1:172.21.15.50:6789/0 conn(0x7f46840b3e10 legacy=0x7f46840cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.476+0000 7f468259c640 1 -- 172.21.15.50:0/4034669932 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46840b54a0 con 0x7f468415c2c0 2024-09-11T22:18:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.477+0000 7f468259c640 1 --2- 172.21.15.50:0/4034669932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f468415c2c0 0x7f46840b46a0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f467c009d90 tx=0x7f467c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306945a4dd1245a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.477+0000 7f468159a640 1 -- 172.21.15.50:0/4034669932 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c007740 con 0x7f468415c2c0 2024-09-11T22:18:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.477+0000 7f468159a640 1 -- 172.21.15.50:0/4034669932 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467c0078e0 con 0x7f468415c2c0 2024-09-11T22:18:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.477+0000 7f468159a640 1 -- 172.21.15.50:0/4034669932 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c007cb0 con 0x7f468415c2c0 2024-09-11T22:18:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.478+0000 7f468899f640 1 -- 172.21.15.50:0/4034669932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f468415c2c0 msgr2=0x7f46840b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.478+0000 7f468899f640 1 --2- 172.21.15.50:0/4034669932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f468415c2c0 0x7f46840b46a0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f467c009d90 tx=0x7f467c02a6f0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.478+0000 7f468899f640 1 -- 172.21.15.50:0/4034669932 shutdown_connections 2024-09-11T22:18:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.478+0000 7f468899f640 1 --2- 172.21.15.50:0/4034669932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f468415c2c0 0x7f46840b46a0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.478+0000 7f468899f640 1 -- 172.21.15.50:0/4034669932 >> 172.21.15.50:0/4034669932 conn(0x7f46840679c0 msgr2=0x7f4684067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.478+0000 7f468899f640 1 -- 172.21.15.50:0/4034669932 shutdown_connections 2024-09-11T22:18:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.478+0000 7f468899f640 1 -- 172.21.15.50:0/4034669932 wait complete. 2024-09-11T22:18:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.479+0000 7f468899f640 1 Processor -- start 2024-09-11T22:18:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.479+0000 7f468899f640 1 -- start start 2024-09-11T22:18:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f468899f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46840b3e10 0x7f4684150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f468899f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46840d05e0 0x7f468415f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f468899f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f468415c2c0 0x7f46840ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f468899f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f468406d070 con 0x7f46840d05e0 2024-09-11T22:18:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f468899f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46840ce200 con 0x7f468415c2c0 2024-09-11T22:18:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f468899f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f468406d1f0 con 0x7f46840b3e10 2024-09-11T22:18:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f4681d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46840d05e0 0x7f468415f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f4681d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46840d05e0 0x7f468415f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50644/0 (socket says 172.21.15.50:50644) 2024-09-11T22:18:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f4681d9b640 1 -- 172.21.15.50:0/1401569890 learned_addr learned my addr 172.21.15.50:0/1401569890 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f468259c640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46840b3e10 0x7f4684150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f4682d9d640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f468415c2c0 0x7f46840ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f4681d9b640 1 -- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46840b3e10 msgr2=0x7f4684150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f4681d9b640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46840b3e10 0x7f4684150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f4681d9b640 1 -- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f468415c2c0 msgr2=0x7f46840ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f4681d9b640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f468415c2c0 0x7f46840ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.480+0000 7f4681d9b640 1 -- 172.21.15.50:0/1401569890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46840af930 con 0x7f46840d05e0 2024-09-11T22:18:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.481+0000 7f4681d9b640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46840d05e0 0x7f468415f1e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f466c00c4a0 tx=0x7f466c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:07.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.481+0000 7f467affd640 1 -- 172.21.15.50:0/1401569890 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c017070 con 0x7f46840d05e0 2024-09-11T22:18:07.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.481+0000 7f467affd640 1 -- 172.21.15.50:0/1401569890 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f466c005ce0 con 0x7f46840d05e0 2024-09-11T22:18:07.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.481+0000 7f467affd640 1 -- 172.21.15.50:0/1401569890 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c007270 con 0x7f46840d05e0 2024-09-11T22:18:07.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.481+0000 7f468899f640 1 -- 172.21.15.50:0/1401569890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46840af370 con 0x7f46840d05e0 2024-09-11T22:18:07.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.481+0000 7f468899f640 1 -- 172.21.15.50:0/1401569890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4684151130 con 0x7f46840d05e0 2024-09-11T22:18:07.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.482+0000 7f468899f640 1 -- 172.21.15.50:0/1401569890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468415c6a0 con 0x7f46840d05e0 2024-09-11T22:18:07.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.482+0000 7f467affd640 1 -- 172.21.15.50:0/1401569890 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f466c01a070 con 0x7f46840d05e0 2024-09-11T22:18:07.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.483+0000 7f467affd640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f466406be30 0x7f466406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.483+0000 7f467affd640 1 -- 172.21.15.50:0/1401569890 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7f466c089e50 con 0x7f46840d05e0 2024-09-11T22:18:07.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.483+0000 7f468259c640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f466406be30 0x7f466406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.483+0000 7f468259c640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f466406be30 0x7f466406e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f467c034000 tx=0x7f467c033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:07.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.487+0000 7f467affd640 1 -- 172.21.15.50:0/1401569890 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f466c058420 con 0x7f46840d05e0 2024-09-11T22:18:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.663+0000 7f468899f640 1 -- 172.21.15.50:0/1401569890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f4684160090 con 0x7f46840d05e0 2024-09-11T22:18:07.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.666+0000 7f467affd640 1 -- 172.21.15.50:0/1401569890 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v35) ==== 104+0+0 (secure 0 0 0) 0x7f466c05c720 con 0x7f46840d05e0 2024-09-11T22:18:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.668+0000 7f468899f640 1 -- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f466406be30 msgr2=0x7f466406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.668+0000 7f468899f640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f466406be30 0x7f466406e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f467c034000 tx=0x7f467c033040 comp rx=0 tx=0).stop 2024-09-11T22:18:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.668+0000 7f468899f640 1 -- 172.21.15.50:0/1401569890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46840d05e0 msgr2=0x7f468415f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.668+0000 7f468899f640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46840d05e0 0x7f468415f1e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f466c00c4a0 tx=0x7f466c00c960 comp rx=0 tx=0).stop 2024-09-11T22:18:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.668+0000 7f468899f640 1 -- 172.21.15.50:0/1401569890 shutdown_connections 2024-09-11T22:18:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.668+0000 7f468899f640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f466406be30 0x7f466406e2f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.668+0000 7f468899f640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f468415c2c0 0x7f46840ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.668+0000 7f468899f640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46840d05e0 0x7f468415f1e0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.668+0000 7f468899f640 1 --2- 172.21.15.50:0/1401569890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46840b3e10 0x7f4684150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.668+0000 7f468899f640 1 -- 172.21.15.50:0/1401569890 >> 172.21.15.50:0/1401569890 conn(0x7f46840679c0 msgr2=0x7f4684160890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.668+0000 7f468899f640 1 -- 172.21.15.50:0/1401569890 shutdown_connections 2024-09-11T22:18:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.668+0000 7f468899f640 1 -- 172.21.15.50:0/1401569890 wait complete. 2024-09-11T22:18:07.680 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-11T22:18:07.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.781+0000 7f1eab986640 1 Processor -- start 2024-09-11T22:18:07.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.781+0000 7f1eab986640 1 -- start start 2024-09-11T22:18:07.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.782+0000 7f1eab986640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41463b0 0x7f1ea40cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.782+0000 7f1eab986640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1ea40ce0e0 0x7f1ea40b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.782+0000 7f1eab986640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ea4072630 con 0x7f1ea415db60 2024-09-11T22:18:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.782+0000 7f1eab986640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1ea40d0670 con 0x7f1ea40ce0e0 2024-09-11T22:18:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.782+0000 7f1eab986640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea4146790 con 0x7f1ea41463b0 2024-09-11T22:18:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.782+0000 7f1ea8f21640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1ea415db60 0x7f1ea40cd9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51184/0 (socket says 172.21.15.50:51184) 2024-09-11T22:18:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.782+0000 7f1ea8f21640 1 -- 172.21.15.50:0/2051529489 learned_addr learned my addr 172.21.15.50:0/2051529489 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea9f23640 1 --2- 172.21.15.50:0/2051529489 >> v2:172.21.15.77:3300/0 conn(0x7f1ea40ce0e0 0x7f1ea40b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea9722640 1 --2- 172.21.15.50:0/2051529489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41463b0 0x7f1ea40cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2253963777 0 0) 0x7f1ea4072630 con 0x7f1ea415db60 2024-09-11T22:18:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e8c003520 con 0x7f1ea415db60 2024-09-11T22:18:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2102123814 0 0) 0x7f1e8c003520 con 0x7f1ea415db60 2024-09-11T22:18:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41463b0 msgr2=0x7f1ea40cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 --2- 172.21.15.50:0/2051529489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41463b0 0x7f1ea40cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 >> v2:172.21.15.77:3300/0 conn(0x7f1ea40ce0e0 msgr2=0x7f1ea40b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 --2- 172.21.15.50:0/2051529489 >> v2:172.21.15.77:3300/0 conn(0x7f1ea40ce0e0 0x7f1ea40b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea40728d0 con 0x7f1ea415db60 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f1e98001670 con 0x7f1ea415db60 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 >> v1:172.21.15.50:6789/0 conn(0x7f1ea415db60 legacy=0x7f1ea40cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea9722640 1 --2- 172.21.15.50:0/2051529489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41463b0 0x7f1ea40cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 --2- 172.21.15.50:0/2051529489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8c0039b0 0x7f1e8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 --2- 172.21.15.50:0/2051529489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41463b0 0x7f1e8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 --2- 172.21.15.50:0/2051529489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e8c004d40 0x7f1e8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea40d0670 con 0x7f1e8c0039b0 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4146790 con 0x7f1e8c004d40 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1e8c00b9c0 con 0x7f1ea41463b0 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea9722640 1 --2- 172.21.15.50:0/2051529489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8c0039b0 0x7f1e8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea8f21640 1 --2- 172.21.15.50:0/2051529489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41463b0 0x7f1e8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea9f23640 1 --2- 172.21.15.50:0/2051529489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e8c004d40 0x7f1e8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea9722640 1 -- 172.21.15.50:0/2051529489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41463b0 msgr2=0x7f1e8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea9722640 1 --2- 172.21.15.50:0/2051529489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41463b0 0x7f1e8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea9722640 1 -- 172.21.15.50:0/2051529489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e8c004d40 msgr2=0x7f1e8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea9722640 1 --2- 172.21.15.50:0/2051529489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e8c004d40 0x7f1e8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.783+0000 7f1ea9722640 1 -- 172.21.15.50:0/2051529489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8c003520 con 0x7f1e8c0039b0 2024-09-11T22:18:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.784+0000 7f1ea9722640 1 --2- 172.21.15.50:0/2051529489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8c0039b0 0x7f1e8c003dd0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009c90 tx=0x7f1e8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a488378b43d4897 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.784+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c036070 con 0x7f1e8c0039b0 2024-09-11T22:18:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.784+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9c031400 con 0x7f1e8c0039b0 2024-09-11T22:18:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.784+0000 7f1ea3fff640 1 -- 172.21.15.50:0/2051529489 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c009860 con 0x7f1e8c0039b0 2024-09-11T22:18:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.785+0000 7f1eab986640 1 -- 172.21.15.50:0/2051529489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8c0039b0 msgr2=0x7f1e8c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.785+0000 7f1eab986640 1 --2- 172.21.15.50:0/2051529489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8c0039b0 0x7f1e8c003dd0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009c90 tx=0x7f1e8c005830 comp rx=0 tx=0).stop 2024-09-11T22:18:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.785+0000 7f1ea9f23640 1 -- 172.21.15.50:0/2051529489 reap_dead start 2024-09-11T22:18:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.785+0000 7f1eab986640 1 -- 172.21.15.50:0/2051529489 shutdown_connections 2024-09-11T22:18:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.785+0000 7f1eab986640 1 -- 172.21.15.50:0/2051529489 >> 172.21.15.50:0/2051529489 conn(0x7f1ea4068240 msgr2=0x7f1ea40b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.785+0000 7f1eab986640 1 -- 172.21.15.50:0/2051529489 shutdown_connections 2024-09-11T22:18:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.785+0000 7f1eab986640 1 -- 172.21.15.50:0/2051529489 wait complete. 2024-09-11T22:18:07.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.786+0000 7f1eab986640 1 Processor -- start 2024-09-11T22:18:07.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.786+0000 7f1eab986640 1 -- start start 2024-09-11T22:18:07.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1eab986640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8c0039b0 0x7f1ea415bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1eab986640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea40c5900 0x7f1ea413e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1eab986640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41f2830 0x7f1ea415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1eab986640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea40733b0 con 0x7f1e8c0039b0 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1eab986640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4072f20 con 0x7f1ea40c5900 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1eab986640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea4073530 con 0x7f1ea41f2830 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1ea9722640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8c0039b0 0x7f1ea415bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1ea9722640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8c0039b0 0x7f1ea415bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50676/0 (socket says 172.21.15.50:50676) 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1ea9722640 1 -- 172.21.15.50:0/4283853956 learned_addr learned my addr 172.21.15.50:0/4283853956 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1ea8f21640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea40c5900 0x7f1ea413e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1ea9f23640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41f2830 0x7f1ea415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1ea9722640 1 -- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41f2830 msgr2=0x7f1ea415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1ea9722640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41f2830 0x7f1ea415e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1ea9722640 1 -- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea40c5900 msgr2=0x7f1ea413e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1ea9722640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea40c5900 0x7f1ea413e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1ea9722640 1 -- 172.21.15.50:0/4283853956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea40c5e50 con 0x7f1e8c0039b0 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.787+0000 7f1ea9f23640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41f2830 0x7f1ea415e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.788+0000 7f1ea9722640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8c0039b0 0x7f1ea415bd00 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c000c00 tx=0x7f1e9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.788+0000 7f1ea1ffb640 1 -- 172.21.15.50:0/4283853956 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c040070 con 0x7f1e8c0039b0 2024-09-11T22:18:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.788+0000 7f1ea1ffb640 1 -- 172.21.15.50:0/4283853956 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9c0093e0 con 0x7f1e8c0039b0 2024-09-11T22:18:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.788+0000 7f1eab986640 1 -- 172.21.15.50:0/4283853956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea413f6c0 con 0x7f1e8c0039b0 2024-09-11T22:18:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.788+0000 7f1ea1ffb640 1 -- 172.21.15.50:0/4283853956 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c036040 con 0x7f1e8c0039b0 2024-09-11T22:18:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.788+0000 7f1eab986640 1 -- 172.21.15.50:0/4283853956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea413fc80 con 0x7f1e8c0039b0 2024-09-11T22:18:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.789+0000 7f1eab986640 1 -- 172.21.15.50:0/4283853956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea4145580 con 0x7f1e8c0039b0 2024-09-11T22:18:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.789+0000 7f1ea1ffb640 1 -- 172.21.15.50:0/4283853956 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e9c043070 con 0x7f1e8c0039b0 2024-09-11T22:18:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.790+0000 7f1ea1ffb640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e9006be30 0x7f1e9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.790+0000 7f1ea1ffb640 1 -- 172.21.15.50:0/4283853956 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7f1e9c0ab1b0 con 0x7f1e8c0039b0 2024-09-11T22:18:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.790+0000 7f1ea8f21640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e9006be30 0x7f1e9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.790+0000 7f1ea8f21640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e9006be30 0x7f1e9006e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1ea415f310 tx=0x7f1e98007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:07.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:07.794+0000 7f1ea1ffb640 1 -- 172.21.15.50:0/4283853956 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ea4145580 con 0x7f1e8c0039b0 2024-09-11T22:18:08.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.037+0000 7f1eab986640 1 -- 172.21.15.50:0/4283853956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f1ea40cd9d0 con 0x7f1e8c0039b0 2024-09-11T22:18:08.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.353+0000 7f1ea1ffb640 1 -- 172.21.15.50:0/4283853956 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v336) ==== 158+0+0 (secure 0 0 0) 0x7f1e9c0796e0 con 0x7f1e8c0039b0 2024-09-11T22:18:08.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.355+0000 7f1eab986640 1 -- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e9006be30 msgr2=0x7f1e9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:08.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.355+0000 7f1eab986640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e9006be30 0x7f1e9006e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1ea415f310 tx=0x7f1e98007040 comp rx=0 tx=0).stop 2024-09-11T22:18:08.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.355+0000 7f1eab986640 1 -- 172.21.15.50:0/4283853956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8c0039b0 msgr2=0x7f1ea415bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:08.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.355+0000 7f1eab986640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8c0039b0 0x7f1ea415bd00 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c000c00 tx=0x7f1e9c004730 comp rx=0 tx=0).stop 2024-09-11T22:18:08.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.355+0000 7f1eab986640 1 -- 172.21.15.50:0/4283853956 shutdown_connections 2024-09-11T22:18:08.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.355+0000 7f1eab986640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e9006be30 0x7f1e9006e2f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.355+0000 7f1eab986640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea41f2830 0x7f1ea415e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.355+0000 7f1eab986640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea40c5900 0x7f1ea413e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.355+0000 7f1eab986640 1 --2- 172.21.15.50:0/4283853956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e8c0039b0 0x7f1ea415bd00 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.355+0000 7f1eab986640 1 -- 172.21.15.50:0/4283853956 >> 172.21.15.50:0/4283853956 conn(0x7f1ea4068240 msgr2=0x7f1ea40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:08.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.355+0000 7f1eab986640 1 -- 172.21.15.50:0/4283853956 shutdown_connections 2024-09-11T22:18:08.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.355+0000 7f1eab986640 1 -- 172.21.15.50:0/4283853956 wait complete. 2024-09-11T22:18:08.368 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-09-11T22:18:08.368 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-11T22:18:08.368 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:18:08.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.471+0000 7f1921eed640 1 Processor -- start 2024-09-11T22:18:08.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.471+0000 7f1921eed640 1 -- start start 2024-09-11T22:18:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f1921eed640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f191c15fb60 0x7f191c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f1921eed640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f191c0d0150 0x7f191c0d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f1921eed640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191c0d0e00 0x7f191c0cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f1921eed640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f191c0cf510 con 0x7f191c0d0150 2024-09-11T22:18:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f1921eed640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f191c0cfdb0 con 0x7f191c15fb60 2024-09-11T22:18:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f1921eed640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f191c0d1290 con 0x7f191c0d0e00 2024-09-11T22:18:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f191affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f191c0d0150 0x7f191c0d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f191affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f191c0d0150 0x7f191c0d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50690/0 (socket says 172.21.15.50:50690) 2024-09-11T22:18:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f191affd640 1 -- 172.21.15.50:0/2311441120 learned_addr learned my addr 172.21.15.50:0/2311441120 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f191bfff640 1 --2- 172.21.15.50:0/2311441120 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191c0d0e00 0x7f191c0cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f191b7fe640 1 --2- 172.21.15.50:0/2311441120 >> v2:172.21.15.77:3300/0 conn(0x7f191c15fb60 0x7f191c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f191affd640 1 -- 172.21.15.50:0/2311441120 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191c0d0e00 msgr2=0x7f191c0cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f191affd640 1 --2- 172.21.15.50:0/2311441120 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191c0d0e00 0x7f191c0cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f191affd640 1 -- 172.21.15.50:0/2311441120 >> v2:172.21.15.77:3300/0 conn(0x7f191c15fb60 msgr2=0x7f191c0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f191affd640 1 --2- 172.21.15.50:0/2311441120 >> v2:172.21.15.77:3300/0 conn(0x7f191c15fb60 0x7f191c0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.472+0000 7f191affd640 1 -- 172.21.15.50:0/2311441120 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c15ff40 con 0x7f191c0d0150 2024-09-11T22:18:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.473+0000 7f191affd640 1 --2- 172.21.15.50:0/2311441120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f191c0d0150 0x7f191c0d08c0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f191c072ec0 tx=0x7f191002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10bfbca8f52cef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.473+0000 7f191a7fc640 1 -- 172.21.15.50:0/2311441120 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1910037070 con 0x7f191c0d0150 2024-09-11T22:18:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.473+0000 7f191a7fc640 1 -- 172.21.15.50:0/2311441120 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1910032440 con 0x7f191c0d0150 2024-09-11T22:18:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.473+0000 7f191a7fc640 1 -- 172.21.15.50:0/2311441120 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1910032810 con 0x7f191c0d0150 2024-09-11T22:18:08.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.474+0000 7f1921eed640 1 -- 172.21.15.50:0/2311441120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f191c0d0150 msgr2=0x7f191c0d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:08.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.474+0000 7f1921eed640 1 --2- 172.21.15.50:0/2311441120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f191c0d0150 0x7f191c0d08c0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f191c072ec0 tx=0x7f191002a140 comp rx=0 tx=0).stop 2024-09-11T22:18:08.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.474+0000 7f1921eed640 1 -- 172.21.15.50:0/2311441120 shutdown_connections 2024-09-11T22:18:08.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.474+0000 7f1921eed640 1 --2- 172.21.15.50:0/2311441120 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191c0d0e00 0x7f191c0cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.474+0000 7f1921eed640 1 --2- 172.21.15.50:0/2311441120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f191c0d0150 0x7f191c0d08c0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.474+0000 7f1921eed640 1 --2- 172.21.15.50:0/2311441120 >> v2:172.21.15.77:3300/0 conn(0x7f191c15fb60 0x7f191c0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.474+0000 7f1921eed640 1 -- 172.21.15.50:0/2311441120 >> 172.21.15.50:0/2311441120 conn(0x7f191c0b4150 msgr2=0x7f191c0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.474+0000 7f1921eed640 1 -- 172.21.15.50:0/2311441120 shutdown_connections 2024-09-11T22:18:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.474+0000 7f1921eed640 1 -- 172.21.15.50:0/2311441120 wait complete. 2024-09-11T22:18:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.475+0000 7f1921eed640 1 Processor -- start 2024-09-11T22:18:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.475+0000 7f1921eed640 1 -- start start 2024-09-11T22:18:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f1921eed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f191c0d0e00 0x7f191c0b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f1921eed640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191c15fb60 0x7f191c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f1921eed640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f191c0b7a20 0x7f191c159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f1921eed640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f191c0cfa40 con 0x7f191c0d0e00 2024-09-11T22:18:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f1921eed640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f191c0cf760 con 0x7f191c0b7a20 2024-09-11T22:18:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f1921eed640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f191c0b1930 con 0x7f191c15fb60 2024-09-11T22:18:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f191b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f191c0d0e00 0x7f191c0b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f191b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f191c0d0e00 0x7f191c0b74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50702/0 (socket says 172.21.15.50:50702) 2024-09-11T22:18:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f191b7fe640 1 -- 172.21.15.50:0/1409598056 learned_addr learned my addr 172.21.15.50:0/1409598056 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f191affd640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191c15fb60 0x7f191c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f191bfff640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f191c0b7a20 0x7f191c159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f191b7fe640 1 -- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191c15fb60 msgr2=0x7f191c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f191b7fe640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191c15fb60 0x7f191c1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f191b7fe640 1 -- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f191c0b7a20 msgr2=0x7f191c159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f191b7fe640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f191c0b7a20 0x7f191c159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f191b7fe640 1 -- 172.21.15.50:0/1409598056 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c0b6440 con 0x7f191c0d0e00 2024-09-11T22:18:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f191affd640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191c15fb60 0x7f191c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.476+0000 7f191b7fe640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f191c0d0e00 0x7f191c0b74e0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f190c00d800 tx=0x7f190c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.477+0000 7f1903fff640 1 -- 172.21.15.50:0/1409598056 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c00b6c0 con 0x7f191c0d0e00 2024-09-11T22:18:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.477+0000 7f1903fff640 1 -- 172.21.15.50:0/1409598056 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190c019070 con 0x7f191c0d0e00 2024-09-11T22:18:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.477+0000 7f1903fff640 1 -- 172.21.15.50:0/1409598056 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c00ba80 con 0x7f191c0d0e00 2024-09-11T22:18:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.477+0000 7f1921eed640 1 -- 172.21.15.50:0/1409598056 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191c0b6720 con 0x7f191c0d0e00 2024-09-11T22:18:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.477+0000 7f1921eed640 1 -- 172.21.15.50:0/1409598056 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191c0b6ce0 con 0x7f191c0d0e00 2024-09-11T22:18:08.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.478+0000 7f1921eed640 1 -- 172.21.15.50:0/1409598056 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f191c0d08c0 con 0x7f191c0d0e00 2024-09-11T22:18:08.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.478+0000 7f1903fff640 1 -- 172.21.15.50:0/1409598056 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f190c00bc20 con 0x7f191c0d0e00 2024-09-11T22:18:08.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.479+0000 7f1903fff640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f190806be30 0x7f190806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:08.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.479+0000 7f1903fff640 1 -- 172.21.15.50:0/1409598056 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7f190c08af00 con 0x7f191c0d0e00 2024-09-11T22:18:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.479+0000 7f191affd640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f190806be30 0x7f190806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.479+0000 7f191affd640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f190806be30 0x7f190806e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1910034000 tx=0x7f191002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.483+0000 7f1903fff640 1 -- 172.21.15.50:0/1409598056 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f190c059c40 con 0x7f191c0d0e00 2024-09-11T22:18:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.663+0000 7f1921eed640 1 -- 172.21.15.50:0/1409598056 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f191c06f2b0 con 0x7f191c0d0e00 2024-09-11T22:18:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.664+0000 7f1903fff640 1 -- 172.21.15.50:0/1409598056 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) ==== 74+0+13006 (secure 0 0 0) 0x7f190c059540 con 0x7f191c0d0e00 2024-09-11T22:18:08.665 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:08.665 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":112,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:18:07.344735+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6834/2355059741":"2024-09-12T22:18:04.332824+0000","172.21.15.50:6832/2355059741":"2024-09-12T22:18:04.332824+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:18:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.666+0000 7f1921eed640 1 -- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f190806be30 msgr2=0x7f190806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.666+0000 7f1921eed640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f190806be30 0x7f190806e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1910034000 tx=0x7f191002e000 comp rx=0 tx=0).stop 2024-09-11T22:18:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.666+0000 7f1921eed640 1 -- 172.21.15.50:0/1409598056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f191c0d0e00 msgr2=0x7f191c0b74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.666+0000 7f1921eed640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f191c0d0e00 0x7f191c0b74e0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f190c00d800 tx=0x7f190c00dcc0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.666+0000 7f1921eed640 1 -- 172.21.15.50:0/1409598056 shutdown_connections 2024-09-11T22:18:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.666+0000 7f1921eed640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f190806be30 0x7f190806e2f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.666+0000 7f1921eed640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191c15fb60 0x7f191c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.666+0000 7f1921eed640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f191c0b7a20 0x7f191c159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.666+0000 7f1921eed640 1 --2- 172.21.15.50:0/1409598056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f191c0d0e00 0x7f191c0b74e0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.666+0000 7f1921eed640 1 -- 172.21.15.50:0/1409598056 >> 172.21.15.50:0/1409598056 conn(0x7f191c0b4150 msgr2=0x7f191c0afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.666+0000 7f1921eed640 1 -- 172.21.15.50:0/1409598056 shutdown_connections 2024-09-11T22:18:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.666+0000 7f1921eed640 1 -- 172.21.15.50:0/1409598056 wait complete. 2024-09-11T22:18:08.678 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:11:03.407373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:18:08.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:18:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.783+0000 7f153d2ba640 1 Processor -- start 2024-09-11T22:18:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.783+0000 7f153d2ba640 1 -- start start 2024-09-11T22:18:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.784+0000 7f153d2ba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f153815e8e0 0x7f15380b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.784+0000 7f153d2ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15380d1580 0x7f15380d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.784+0000 7f153d2ba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15380d1ee0 con 0x7f1538162350 2024-09-11T22:18:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.784+0000 7f153d2ba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f153815ecc0 con 0x7f153815e8e0 2024-09-11T22:18:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.784+0000 7f153d2ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f15380d2ad0 con 0x7f15380d1580 2024-09-11T22:18:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.784+0000 7f15377fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1538162350 0x7f1538162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51198/0 (socket says 172.21.15.50:51198) 2024-09-11T22:18:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.784+0000 7f15377fe640 1 -- 172.21.15.50:0/1755308165 learned_addr learned my addr 172.21.15.50:0/1755308165 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.784+0000 7f15367fc640 1 --2- 172.21.15.50:0/1755308165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15380d1580 0x7f15380d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.784+0000 7f1536ffd640 1 --2- 172.21.15.50:0/1755308165 >> v2:172.21.15.77:3300/0 conn(0x7f153815e8e0 0x7f15380b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.784+0000 7f1535ffb640 1 -- 172.21.15.50:0/1755308165 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2592966215 0 0) 0x7f15380d1ee0 con 0x7f1538162350 2024-09-11T22:18:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.784+0000 7f1535ffb640 1 -- 172.21.15.50:0/1755308165 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1524003520 con 0x7f1538162350 2024-09-11T22:18:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.785+0000 7f15367fc640 1 -- 172.21.15.50:0/1755308165 >> v2:172.21.15.77:3300/0 conn(0x7f153815e8e0 msgr2=0x7f15380b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.785+0000 7f15367fc640 1 --2- 172.21.15.50:0/1755308165 >> v2:172.21.15.77:3300/0 conn(0x7f153815e8e0 0x7f15380b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.785+0000 7f15367fc640 1 -- 172.21.15.50:0/1755308165 >> v1:172.21.15.50:6789/0 conn(0x7f1538162350 legacy=0x7f1538162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.785+0000 7f15367fc640 1 -- 172.21.15.50:0/1755308165 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1538163080 con 0x7f15380d1580 2024-09-11T22:18:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.785+0000 7f15367fc640 1 --2- 172.21.15.50:0/1755308165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15380d1580 0x7f15380d19a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f15200097a0 tx=0x7f152002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3bc9527f4d95b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.786+0000 7f1535ffb640 1 -- 172.21.15.50:0/1755308165 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520037070 con 0x7f15380d1580 2024-09-11T22:18:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.786+0000 7f1535ffb640 1 -- 172.21.15.50:0/1755308165 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1520032440 con 0x7f15380d1580 2024-09-11T22:18:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.786+0000 7f1535ffb640 1 -- 172.21.15.50:0/1755308165 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520032810 con 0x7f15380d1580 2024-09-11T22:18:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.786+0000 7f153d2ba640 1 -- 172.21.15.50:0/1755308165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15380d1580 msgr2=0x7f15380d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.786+0000 7f153d2ba640 1 --2- 172.21.15.50:0/1755308165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15380d1580 0x7f15380d19a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f15200097a0 tx=0x7f152002a210 comp rx=0 tx=0).stop 2024-09-11T22:18:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.786+0000 7f153d2ba640 1 -- 172.21.15.50:0/1755308165 shutdown_connections 2024-09-11T22:18:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.786+0000 7f153d2ba640 1 --2- 172.21.15.50:0/1755308165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15380d1580 0x7f15380d19a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.786+0000 7f153d2ba640 1 --2- 172.21.15.50:0/1755308165 >> v2:172.21.15.77:3300/0 conn(0x7f153815e8e0 0x7f15380b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.786+0000 7f153d2ba640 1 -- 172.21.15.50:0/1755308165 >> 172.21.15.50:0/1755308165 conn(0x7f1538067ba0 msgr2=0x7f1538067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.786+0000 7f153d2ba640 1 -- 172.21.15.50:0/1755308165 shutdown_connections 2024-09-11T22:18:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.786+0000 7f153d2ba640 1 -- 172.21.15.50:0/1755308165 wait complete. 2024-09-11T22:18:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.788+0000 7f153d2ba640 1 Processor -- start 2024-09-11T22:18:08.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.788+0000 7f153d2ba640 1 -- start start 2024-09-11T22:18:08.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.788+0000 7f153d2ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15380d1580 0x7f1538152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:08.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.788+0000 7f153d2ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f153815e8e0 0x7f15380b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:08.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.788+0000 7f153d2ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1538162350 0x7f15380b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:08.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.788+0000 7f153d2ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f15380d3000 con 0x7f15380d1580 2024-09-11T22:18:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.788+0000 7f153d2ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f15380d3370 con 0x7f153815e8e0 2024-09-11T22:18:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.788+0000 7f153d2ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f15380d3800 con 0x7f1538162350 2024-09-11T22:18:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.788+0000 7f1536ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15380d1580 0x7f1538152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f1536ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15380d1580 0x7f1538152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50712/0 (socket says 172.21.15.50:50712) 2024-09-11T22:18:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f1536ffd640 1 -- 172.21.15.50:0/118512974 learned_addr learned my addr 172.21.15.50:0/118512974 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f15367fc640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f153815e8e0 0x7f15380b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f15377fe640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1538162350 0x7f15380b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f1536ffd640 1 -- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1538162350 msgr2=0x7f15380b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f1536ffd640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1538162350 0x7f15380b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f1536ffd640 1 -- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f153815e8e0 msgr2=0x7f15380b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f1536ffd640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f153815e8e0 0x7f15380b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f1536ffd640 1 -- 172.21.15.50:0/118512974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15380b4dc0 con 0x7f15380d1580 2024-09-11T22:18:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f1536ffd640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15380d1580 0x7f1538152d70 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f153000e9b0 tx=0x7f153000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f152f7fe640 1 -- 172.21.15.50:0/118512974 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530017070 con 0x7f15380d1580 2024-09-11T22:18:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f152f7fe640 1 -- 172.21.15.50:0/118512974 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f153000c9a0 con 0x7f15380d1580 2024-09-11T22:18:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f153d2ba640 1 -- 172.21.15.50:0/118512974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15380b50a0 con 0x7f15380d1580 2024-09-11T22:18:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f152f7fe640 1 -- 172.21.15.50:0/118512974 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153000cd90 con 0x7f15380d1580 2024-09-11T22:18:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.789+0000 7f153d2ba640 1 -- 172.21.15.50:0/118512974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15380b5940 con 0x7f15380d1580 2024-09-11T22:18:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.790+0000 7f153d2ba640 1 -- 172.21.15.50:0/118512974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15380b5270 con 0x7f15380d1580 2024-09-11T22:18:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.791+0000 7f152f7fe640 1 -- 172.21.15.50:0/118512974 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f153001a070 con 0x7f15380d1580 2024-09-11T22:18:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.791+0000 7f152f7fe640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f151806be30 0x7f151806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.791+0000 7f152f7fe640 1 -- 172.21.15.50:0/118512974 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7f153008aeb0 con 0x7f15380d1580 2024-09-11T22:18:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.791+0000 7f15367fc640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f151806be30 0x7f151806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.792+0000 7f15367fc640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f151806be30 0x7f151806e2f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1520034000 tx=0x7f152002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.795+0000 7f152f7fe640 1 -- 172.21.15.50:0/118512974 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1530059510 con 0x7f15380d1580 2024-09-11T22:18:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.969+0000 7f153d2ba640 1 -- 172.21.15.50:0/118512974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f15380b7880 con 0x7f15380d1580 2024-09-11T22:18:08.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.969+0000 7f152f7fe640 1 -- 172.21.15.50:0/118512974 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v112) ==== 93+0+10 (secure 0 0 0) 0x7f153005d810 con 0x7f15380d1580 2024-09-11T22:18:08.971 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-11T22:18:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.971+0000 7f153d2ba640 1 -- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f151806be30 msgr2=0x7f151806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.971+0000 7f153d2ba640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f151806be30 0x7f151806e2f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1520034000 tx=0x7f152002e000 comp rx=0 tx=0).stop 2024-09-11T22:18:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.971+0000 7f153d2ba640 1 -- 172.21.15.50:0/118512974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15380d1580 msgr2=0x7f1538152d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.971+0000 7f153d2ba640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15380d1580 0x7f1538152d70 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f153000e9b0 tx=0x7f153000ee70 comp rx=0 tx=0).stop 2024-09-11T22:18:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.971+0000 7f153d2ba640 1 -- 172.21.15.50:0/118512974 shutdown_connections 2024-09-11T22:18:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.971+0000 7f153d2ba640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f151806be30 0x7f151806e2f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.971+0000 7f153d2ba640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1538162350 0x7f15380b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.971+0000 7f153d2ba640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f153815e8e0 0x7f15380b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.971+0000 7f153d2ba640 1 --2- 172.21.15.50:0/118512974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15380d1580 0x7f1538152d70 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.971+0000 7f153d2ba640 1 -- 172.21.15.50:0/118512974 >> 172.21.15.50:0/118512974 conn(0x7f1538067ba0 msgr2=0x7f153815f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.971+0000 7f153d2ba640 1 -- 172.21.15.50:0/118512974 shutdown_connections 2024-09-11T22:18:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:08.971+0000 7f153d2ba640 1 -- 172.21.15.50:0/118512974 wait complete. 2024-09-11T22:18:08.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-11T22:18:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.084+0000 7f4ac816d640 1 Processor -- start 2024-09-11T22:18:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.084+0000 7f4ac816d640 1 -- start start 2024-09-11T22:18:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac816d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4ac0161fa0 0x7f4ac00b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac816d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ac00cf610 0x7f4ac00cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac816d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac00cfbd0 con 0x7f4ac00b1600 2024-09-11T22:18:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac816d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac00d1220 con 0x7f4ac00cf610 2024-09-11T22:18:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac816d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac00d17e0 con 0x7f4ac0161fa0 2024-09-11T22:18:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac670a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ac00cf610 0x7f4ac00cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac670a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ac00cf610 0x7f4ac00cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50714/0 (socket says 172.21.15.50:50714) 2024-09-11T22:18:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac670a640 1 -- 172.21.15.50:0/3261185145 learned_addr learned my addr 172.21.15.50:0/3261185145 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:09.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac5f09640 1 --2- 172.21.15.50:0/3261185145 >> v2:172.21.15.77:3300/0 conn(0x7f4ac0161fa0 0x7f4ac00b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:09.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac670a640 1 -- 172.21.15.50:0/3261185145 >> v2:172.21.15.77:3300/0 conn(0x7f4ac0161fa0 msgr2=0x7f4ac00b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:09.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac670a640 1 --2- 172.21.15.50:0/3261185145 >> v2:172.21.15.77:3300/0 conn(0x7f4ac0161fa0 0x7f4ac00b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac670a640 1 -- 172.21.15.50:0/3261185145 >> v1:172.21.15.77:6789/0 conn(0x7f4ac00b1600 legacy=0x7f4ac00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:09.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac670a640 1 -- 172.21.15.50:0/3261185145 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac00cfeb0 con 0x7f4ac00cf610 2024-09-11T22:18:09.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.085+0000 7f4ac5f09640 1 --2- 172.21.15.50:0/3261185145 >> v2:172.21.15.77:3300/0 conn(0x7f4ac0161fa0 0x7f4ac00b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.086+0000 7f4ac670a640 1 --2- 172.21.15.50:0/3261185145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00cf610 0x7f4ac00cccd0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0072960 tx=0x7f4ab802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86db70a04612c41f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.086+0000 7f4ac4f07640 1 -- 172.21.15.50:0/3261185145 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8036070 con 0x7f4ac00cf610 2024-09-11T22:18:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.086+0000 7f4ac4f07640 1 -- 172.21.15.50:0/3261185145 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab8031600 con 0x7f4ac00cf610 2024-09-11T22:18:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.086+0000 7f4ac4f07640 1 -- 172.21.15.50:0/3261185145 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80319d0 con 0x7f4ac00cf610 2024-09-11T22:18:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.087+0000 7f4ac816d640 1 -- 172.21.15.50:0/3261185145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00cf610 msgr2=0x7f4ac00cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.087+0000 7f4ac816d640 1 --2- 172.21.15.50:0/3261185145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00cf610 0x7f4ac00cccd0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0072960 tx=0x7f4ab802a730 comp rx=0 tx=0).stop 2024-09-11T22:18:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.087+0000 7f4ac816d640 1 -- 172.21.15.50:0/3261185145 shutdown_connections 2024-09-11T22:18:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.087+0000 7f4ac816d640 1 --2- 172.21.15.50:0/3261185145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00cf610 0x7f4ac00cccd0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.087+0000 7f4ac816d640 1 --2- 172.21.15.50:0/3261185145 >> v2:172.21.15.77:3300/0 conn(0x7f4ac0161fa0 0x7f4ac00b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.087+0000 7f4ac816d640 1 -- 172.21.15.50:0/3261185145 >> 172.21.15.50:0/3261185145 conn(0x7f4ac009ba50 msgr2=0x7f4ac00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.087+0000 7f4ac816d640 1 -- 172.21.15.50:0/3261185145 shutdown_connections 2024-09-11T22:18:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.087+0000 7f4ac816d640 1 -- 172.21.15.50:0/3261185145 wait complete. 2024-09-11T22:18:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.088+0000 7f4ac816d640 1 Processor -- start 2024-09-11T22:18:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.088+0000 7f4ac816d640 1 -- start start 2024-09-11T22:18:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac816d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00b1600 0x7f4ac00c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac816d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac00cf610 0x7f4ac00b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac816d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac0161fa0 0x7f4ac00b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac816d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac0162500 con 0x7f4ac00b1600 2024-09-11T22:18:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac816d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac0162380 con 0x7f4ac0161fa0 2024-09-11T22:18:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac816d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac00d1c70 con 0x7f4ac00cf610 2024-09-11T22:18:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac5f09640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00b1600 0x7f4ac00c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac5f09640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00b1600 0x7f4ac00c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50716/0 (socket says 172.21.15.50:50716) 2024-09-11T22:18:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac5f09640 1 -- 172.21.15.50:0/291404947 learned_addr learned my addr 172.21.15.50:0/291404947 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac670a640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac0161fa0 0x7f4ac00b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac5708640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac00cf610 0x7f4ac00b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac5f09640 1 -- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac00cf610 msgr2=0x7f4ac00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac5f09640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac00cf610 0x7f4ac00b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac5f09640 1 -- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac0161fa0 msgr2=0x7f4ac00b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac5f09640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac0161fa0 0x7f4ac00b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac5f09640 1 -- 172.21.15.50:0/291404947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac00c9dc0 con 0x7f4ac00b1600 2024-09-11T22:18:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.089+0000 7f4ac5f09640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00b1600 0x7f4ac00c9750 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00e730 tx=0x7f4abc00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.090+0000 7f4ab27fc640 1 -- 172.21.15.50:0/291404947 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc00f040 con 0x7f4ac00b1600 2024-09-11T22:18:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.090+0000 7f4ab27fc640 1 -- 172.21.15.50:0/291404947 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4abc004230 con 0x7f4ac00b1600 2024-09-11T22:18:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.090+0000 7f4ac816d640 1 -- 172.21.15.50:0/291404947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac00ca0a0 con 0x7f4ac00b1600 2024-09-11T22:18:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.090+0000 7f4ab27fc640 1 -- 172.21.15.50:0/291404947 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc00ee40 con 0x7f4ac00b1600 2024-09-11T22:18:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.090+0000 7f4ac816d640 1 -- 172.21.15.50:0/291404947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac00ca660 con 0x7f4ac00b1600 2024-09-11T22:18:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.091+0000 7f4ac816d640 1 -- 172.21.15.50:0/291404947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac00b4b10 con 0x7f4ac00b1600 2024-09-11T22:18:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.091+0000 7f4ab27fc640 1 -- 172.21.15.50:0/291404947 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4abc00c6d0 con 0x7f4ac00b1600 2024-09-11T22:18:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.092+0000 7f4ab27fc640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4aa406be30 0x7f4aa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.092+0000 7f4ab27fc640 1 -- 172.21.15.50:0/291404947 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7f4abc08a7e0 con 0x7f4ac00b1600 2024-09-11T22:18:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.092+0000 7f4ac5708640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4aa406be30 0x7f4aa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.092+0000 7f4ac5708640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4aa406be30 0x7f4aa406e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0070f20 tx=0x7f4ab4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.096+0000 7f4ab27fc640 1 -- 172.21.15.50:0/291404947 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ac00b4b10 con 0x7f4ac00b1600 2024-09-11T22:18:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.338+0000 7f4ac816d640 1 -- 172.21.15.50:0/291404947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7f4ac00cf3c0 con 0x7f4ac00b1600 2024-09-11T22:18:09.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.354+0000 7f4ab27fc640 1 -- 172.21.15.50:0/291404947 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v337) ==== 147+0+0 (secure 0 0 0) 0x7f4ac00cf3c0 con 0x7f4ac00b1600 2024-09-11T22:18:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.356+0000 7f4ac816d640 1 -- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4aa406be30 msgr2=0x7f4aa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.356+0000 7f4ac816d640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4aa406be30 0x7f4aa406e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0070f20 tx=0x7f4ab4009040 comp rx=0 tx=0).stop 2024-09-11T22:18:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.356+0000 7f4ac816d640 1 -- 172.21.15.50:0/291404947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00b1600 msgr2=0x7f4ac00c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.356+0000 7f4ac816d640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00b1600 0x7f4ac00c9750 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00e730 tx=0x7f4abc00ebf0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.356+0000 7f4ac816d640 1 -- 172.21.15.50:0/291404947 shutdown_connections 2024-09-11T22:18:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.356+0000 7f4ac816d640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4aa406be30 0x7f4aa406e2f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.356+0000 7f4ac816d640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac00cf610 0x7f4ac00b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.356+0000 7f4ac816d640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac0161fa0 0x7f4ac00b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.356+0000 7f4ac816d640 1 --2- 172.21.15.50:0/291404947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00b1600 0x7f4ac00c9750 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.356+0000 7f4ac816d640 1 -- 172.21.15.50:0/291404947 >> 172.21.15.50:0/291404947 conn(0x7f4ac009ba50 msgr2=0x7f4ac006f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.357+0000 7f4ac816d640 1 -- 172.21.15.50:0/291404947 shutdown_connections 2024-09-11T22:18:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.357+0000 7f4ac816d640 1 -- 172.21.15.50:0/291404947 wait complete. 2024-09-11T22:18:09.368 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T22:18:09.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.472+0000 7fc1920af640 1 Processor -- start 2024-09-11T22:18:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.472+0000 7fc1920af640 1 -- start start 2024-09-11T22:18:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.472+0000 7fc1920af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc18c15e840 0x7fc18c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.472+0000 7fc1920af640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc18c0cf580 0x7fc18c06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.473+0000 7fc1920af640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc18c0ce5f0 con 0x7fc18c0cdd50 2024-09-11T22:18:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.473+0000 7fc1920af640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc18c06c240 con 0x7fc18c0cf580 2024-09-11T22:18:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.473+0000 7fc1920af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc18c0d0470 con 0x7fc18c15e840 2024-09-11T22:18:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.473+0000 7fc18bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc18c0cf580 0x7fc18c06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.473+0000 7fc18affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc18c0cdd50 0x7fc18c0cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:41520/0 (socket says 172.21.15.50:41520) 2024-09-11T22:18:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.473+0000 7fc18b7fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc18c15e840 0x7fc18c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.473+0000 7fc18affd640 1 -- 172.21.15.50:0/4027895524 learned_addr learned my addr 172.21.15.50:0/4027895524 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.473+0000 7fc18bfff640 1 -- 172.21.15.50:0/4027895524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc18c15e840 msgr2=0x7fc18c0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.473+0000 7fc18bfff640 1 --2- 172.21.15.50:0/4027895524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc18c15e840 0x7fc18c0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.473+0000 7fc18bfff640 1 -- 172.21.15.50:0/4027895524 >> v1:172.21.15.77:6789/0 conn(0x7fc18c0cdd50 legacy=0x7fc18c0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.473+0000 7fc18bfff640 1 -- 172.21.15.50:0/4027895524 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c0ce310 con 0x7fc18c0cf580 2024-09-11T22:18:09.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.474+0000 7fc18bfff640 1 --2- 172.21.15.50:0/4027895524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0cf580 0x7fc18c06c6d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc184009d90 tx=0x7fc18402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b13c8c25374a1af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.474+0000 7fc18a7fc640 1 -- 172.21.15.50:0/4027895524 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc184007740 con 0x7fc18c0cf580 2024-09-11T22:18:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.474+0000 7fc18a7fc640 1 -- 172.21.15.50:0/4027895524 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1840078e0 con 0x7fc18c0cf580 2024-09-11T22:18:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.474+0000 7fc18a7fc640 1 -- 172.21.15.50:0/4027895524 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc184007cb0 con 0x7fc18c0cf580 2024-09-11T22:18:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.475+0000 7fc1920af640 1 -- 172.21.15.50:0/4027895524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0cf580 msgr2=0x7fc18c06c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.475+0000 7fc1920af640 1 --2- 172.21.15.50:0/4027895524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0cf580 0x7fc18c06c6d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc184009d90 tx=0x7fc18402a660 comp rx=0 tx=0).stop 2024-09-11T22:18:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.475+0000 7fc1920af640 1 -- 172.21.15.50:0/4027895524 shutdown_connections 2024-09-11T22:18:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.475+0000 7fc1920af640 1 --2- 172.21.15.50:0/4027895524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0cf580 0x7fc18c06c6d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.475+0000 7fc1920af640 1 --2- 172.21.15.50:0/4027895524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc18c15e840 0x7fc18c0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.475+0000 7fc1920af640 1 -- 172.21.15.50:0/4027895524 >> 172.21.15.50:0/4027895524 conn(0x7fc18c0b4150 msgr2=0x7fc18c0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.475+0000 7fc1920af640 1 -- 172.21.15.50:0/4027895524 shutdown_connections 2024-09-11T22:18:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.475+0000 7fc1920af640 1 -- 172.21.15.50:0/4027895524 wait complete. 2024-09-11T22:18:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.476+0000 7fc1920af640 1 Processor -- start 2024-09-11T22:18:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.476+0000 7fc1920af640 1 -- start start 2024-09-11T22:18:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc1920af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0cdd50 0x7fc18c0c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc1920af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18c0cf580 0x7fc18c15b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc1920af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc18c15e840 0x7fc18c0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc1920af640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c15ec20 con 0x7fc18c0cf580 2024-09-11T22:18:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc1920af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c06bed0 con 0x7fc18c0cdd50 2024-09-11T22:18:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc1920af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc18c15eda0 con 0x7fc18c15e840 2024-09-11T22:18:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc18affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18c0cf580 0x7fc18c15b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc18affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18c0cf580 0x7fc18c15b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50718/0 (socket says 172.21.15.50:50718) 2024-09-11T22:18:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc18affd640 1 -- 172.21.15.50:0/1816497070 learned_addr learned my addr 172.21.15.50:0/1816497070 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc18b7fe640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0cdd50 0x7fc18c0c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc18bfff640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc18c15e840 0x7fc18c0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc18affd640 1 -- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc18c15e840 msgr2=0x7fc18c0c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc18affd640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc18c15e840 0x7fc18c0c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc18affd640 1 -- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0cdd50 msgr2=0x7fc18c0c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc18affd640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0cdd50 0x7fc18c0c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.477+0000 7fc18affd640 1 -- 172.21.15.50:0/1816497070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c0cada0 con 0x7fc18c0cf580 2024-09-11T22:18:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.478+0000 7fc18affd640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18c0cf580 0x7fc18c15b9b0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fc18000c440 tx=0x7fc180001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.478+0000 7fc173fff640 1 -- 172.21.15.50:0/1816497070 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc180017070 con 0x7fc18c0cf580 2024-09-11T22:18:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.478+0000 7fc173fff640 1 -- 172.21.15.50:0/1816497070 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc180005ce0 con 0x7fc18c0cf580 2024-09-11T22:18:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.478+0000 7fc1920af640 1 -- 172.21.15.50:0/1816497070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc18c0cb080 con 0x7fc18c0cf580 2024-09-11T22:18:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.478+0000 7fc173fff640 1 -- 172.21.15.50:0/1816497070 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1800072f0 con 0x7fc18c0cf580 2024-09-11T22:18:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.478+0000 7fc1920af640 1 -- 172.21.15.50:0/1816497070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc18c0cb640 con 0x7fc18c0cf580 2024-09-11T22:18:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.479+0000 7fc1920af640 1 -- 172.21.15.50:0/1816497070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc18c0b4c70 con 0x7fc18c0cf580 2024-09-11T22:18:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.479+0000 7fc173fff640 1 -- 172.21.15.50:0/1816497070 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc18001a070 con 0x7fc18c0cf580 2024-09-11T22:18:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.480+0000 7fc173fff640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc17806be30 0x7fc17806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.480+0000 7fc173fff640 1 -- 172.21.15.50:0/1816497070 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7fc180089ee0 con 0x7fc18c0cf580 2024-09-11T22:18:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.480+0000 7fc18b7fe640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc17806be30 0x7fc17806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.481+0000 7fc18b7fe640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc17806be30 0x7fc17806e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009aa0 tx=0x7fc17c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.484+0000 7fc173fff640 1 -- 172.21.15.50:0/1816497070 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc180058540 con 0x7fc18c0cf580 2024-09-11T22:18:09.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.663+0000 7fc1920af640 1 -- 172.21.15.50:0/1816497070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc18c15bef0 con 0x7fc18c0cf580 2024-09-11T22:18:09.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.666+0000 7fc173fff640 1 -- 172.21.15.50:0/1816497070 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7fc18005c840 con 0x7fc18c0cf580 2024-09-11T22:18:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.668+0000 7fc1920af640 1 -- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc17806be30 msgr2=0x7fc17806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.668+0000 7fc1920af640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc17806be30 0x7fc17806e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009aa0 tx=0x7fc17c009190 comp rx=0 tx=0).stop 2024-09-11T22:18:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.668+0000 7fc1920af640 1 -- 172.21.15.50:0/1816497070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18c0cf580 msgr2=0x7fc18c15b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.668+0000 7fc1920af640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18c0cf580 0x7fc18c15b9b0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fc18000c440 tx=0x7fc180001e70 comp rx=0 tx=0).stop 2024-09-11T22:18:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.668+0000 7fc1920af640 1 -- 172.21.15.50:0/1816497070 shutdown_connections 2024-09-11T22:18:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.668+0000 7fc1920af640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc17806be30 0x7fc17806e2f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.668+0000 7fc1920af640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc18c15e840 0x7fc18c0c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.668+0000 7fc1920af640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18c0cf580 0x7fc18c15b9b0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.668+0000 7fc1920af640 1 --2- 172.21.15.50:0/1816497070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0cdd50 0x7fc18c0c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.668+0000 7fc1920af640 1 -- 172.21.15.50:0/1816497070 >> 172.21.15.50:0/1816497070 conn(0x7fc18c0b4150 msgr2=0x7fc18c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.668+0000 7fc1920af640 1 -- 172.21.15.50:0/1816497070 shutdown_connections 2024-09-11T22:18:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.668+0000 7fc1920af640 1 -- 172.21.15.50:0/1816497070 wait complete. 2024-09-11T22:18:09.680 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:18:09.680 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:18:09.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:18:09.775 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:18:09.775 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:18:09.775 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:09.791 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:18:09.792 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:18:09.792 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:09.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:18:09.810 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:18:09.810 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:09.847 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:18:09.847 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:18:09.847 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:09.867 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:18:09.867 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T22:18:09.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:18:09.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.991+0000 7fdf26496640 1 Processor -- start 2024-09-11T22:18:09.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.992+0000 7fdf26496640 1 -- start start 2024-09-11T22:18:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.993+0000 7fdf26496640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf20162f20 0x7fdf200c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.993+0000 7fdf26496640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf20167690 con 0x7fdf200b2c20 2024-09-11T22:18:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.993+0000 7fdf26496640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf200b1e60 con 0x7fdf200b3c50 2024-09-11T22:18:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.993+0000 7fdf26496640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fdf200d0460 con 0x7fdf20162f20 2024-09-11T22:18:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.993+0000 7fdf1ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf20162f20 0x7fdf200c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.993+0000 7fdf1ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf20162f20 0x7fdf200c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50734/0 (socket says 172.21.15.50:50734) 2024-09-11T22:18:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.993+0000 7fdf1ffff640 1 -- 172.21.15.50:0/4099406429 learned_addr learned my addr 172.21.15.50:0/4099406429 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:09.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.993+0000 7fdf1f7fe640 1 --1- 172.21.15.50:0/4099406429 >> v1:172.21.15.50:6789/0 conn(0x7fdf200b2c20 0x7fdf20166870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51206/0 (socket says 172.21.15.50:51206) 2024-09-11T22:18:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.993+0000 7fdf1ffff640 1 -- 172.21.15.50:0/4099406429 >> v1:172.21.15.77:6789/0 conn(0x7fdf200b3c50 legacy=0x7fdf20166f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.993+0000 7fdf1ffff640 1 -- 172.21.15.50:0/4099406429 >> v1:172.21.15.50:6789/0 conn(0x7fdf200b2c20 legacy=0x7fdf20166870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.993+0000 7fdf1ffff640 1 -- 172.21.15.50:0/4099406429 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf200b2140 con 0x7fdf20162f20 2024-09-11T22:18:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.994+0000 7fdf1ffff640 1 --2- 172.21.15.50:0/4099406429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf20162f20 0x7fdf200c5530 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009870 tx=0x7fdf1002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde240d2ea962a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.995+0000 7fdf1effd640 1 -- 172.21.15.50:0/4099406429 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10037070 con 0x7fdf20162f20 2024-09-11T22:18:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.995+0000 7fdf1effd640 1 -- 172.21.15.50:0/4099406429 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf10032440 con 0x7fdf20162f20 2024-09-11T22:18:09.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.995+0000 7fdf1effd640 1 -- 172.21.15.50:0/4099406429 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10032810 con 0x7fdf20162f20 2024-09-11T22:18:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.996+0000 7fdf26496640 1 -- 172.21.15.50:0/4099406429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf20162f20 msgr2=0x7fdf200c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.996+0000 7fdf26496640 1 --2- 172.21.15.50:0/4099406429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf20162f20 0x7fdf200c5530 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009870 tx=0x7fdf1002a270 comp rx=0 tx=0).stop 2024-09-11T22:18:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.996+0000 7fdf26496640 1 -- 172.21.15.50:0/4099406429 shutdown_connections 2024-09-11T22:18:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.996+0000 7fdf26496640 1 --2- 172.21.15.50:0/4099406429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf20162f20 0x7fdf200c5530 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.996+0000 7fdf26496640 1 -- 172.21.15.50:0/4099406429 >> 172.21.15.50:0/4099406429 conn(0x7fdf200b40b0 msgr2=0x7fdf200b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.996+0000 7fdf26496640 1 -- 172.21.15.50:0/4099406429 shutdown_connections 2024-09-11T22:18:09.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.996+0000 7fdf26496640 1 -- 172.21.15.50:0/4099406429 wait complete. 2024-09-11T22:18:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.998+0000 7fdf26496640 1 Processor -- start 2024-09-11T22:18:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.998+0000 7fdf26496640 1 -- start start 2024-09-11T22:18:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf26496640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf200b2c20 0x7fdf201f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf26496640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf200b3c50 0x7fdf201fc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf26496640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf20162f20 0x7fdf200d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf26496640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdf200d06b0 con 0x7fdf200b3c50 2024-09-11T22:18:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf26496640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf200b2700 con 0x7fdf200b2c20 2024-09-11T22:18:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf26496640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdf200d2170 con 0x7fdf20162f20 2024-09-11T22:18:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf1f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf200b3c50 0x7fdf201fc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf1f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf200b3c50 0x7fdf201fc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50750/0 (socket says 172.21.15.50:50750) 2024-09-11T22:18:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf1f7fe640 1 -- 172.21.15.50:0/175503024 learned_addr learned my addr 172.21.15.50:0/175503024 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf1ffff640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf200b2c20 0x7fdf201f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf24a33640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf20162f20 0x7fdf200d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf1f7fe640 1 -- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf20162f20 msgr2=0x7fdf200d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf1f7fe640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf20162f20 0x7fdf200d24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf1f7fe640 1 -- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf200b2c20 msgr2=0x7fdf201f5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf1f7fe640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf200b2c20 0x7fdf201f5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:09.999+0000 7fdf1f7fe640 1 -- 172.21.15.50:0/175503024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf201f8dc0 con 0x7fdf200b3c50 2024-09-11T22:18:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.000+0000 7fdf1f7fe640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf200b3c50 0x7fdf201fc960 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400c480 tx=0x7fdf1400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:10.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.000+0000 7fdf1cff9640 1 -- 172.21.15.50:0/175503024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14017070 con 0x7fdf200b3c50 2024-09-11T22:18:10.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.000+0000 7fdf1cff9640 1 -- 172.21.15.50:0/175503024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf14007480 con 0x7fdf200b3c50 2024-09-11T22:18:10.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.000+0000 7fdf26496640 1 -- 172.21.15.50:0/175503024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf201f90a0 con 0x7fdf200b3c50 2024-09-11T22:18:10.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.000+0000 7fdf1cff9640 1 -- 172.21.15.50:0/175503024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14005a50 con 0x7fdf200b3c50 2024-09-11T22:18:10.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.000+0000 7fdf26496640 1 -- 172.21.15.50:0/175503024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf201f9660 con 0x7fdf200b3c50 2024-09-11T22:18:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.001+0000 7fdf26496640 1 -- 172.21.15.50:0/175503024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf200b4bd0 con 0x7fdf200b3c50 2024-09-11T22:18:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.001+0000 7fdf1cff9640 1 -- 172.21.15.50:0/175503024 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf1401a070 con 0x7fdf200b3c50 2024-09-11T22:18:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.002+0000 7fdf1cff9640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf0c06be60 0x7fdf0c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.002+0000 7fdf1cff9640 1 -- 172.21.15.50:0/175503024 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7fdf14089e50 con 0x7fdf200b3c50 2024-09-11T22:18:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.002+0000 7fdf1ffff640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf0c06be60 0x7fdf0c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.003+0000 7fdf1ffff640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf0c06be60 0x7fdf0c06e320 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdf10034000 tx=0x7fdf1002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.006+0000 7fdf1cff9640 1 -- 172.21.15.50:0/175503024 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf14058b90 con 0x7fdf200b3c50 2024-09-11T22:18:10.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.217+0000 7fdf26496640 1 -- 172.21.15.50:0/175503024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf200b84e0 con 0x7fdf200b3c50 2024-09-11T22:18:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.217+0000 7fdf1cff9640 1 -- 172.21.15.50:0/175503024 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+3911 (secure 0 0 0) 0x7fdf14058490 con 0x7fdf200b3c50 2024-09-11T22:18:10.218 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:10.218 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":79,"btime":"2024-09-11T22:18:05:334220+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3921219668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3921219668},{"type":"v1","addr":"172.21.15.50:6835","nonce":3921219668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1123077854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1123077854},{"type":"v1","addr":"172.21.15.77:6837","nonce":1123077854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1576416639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1576416639},{"type":"v1","addr":"172.21.15.77:6836","nonce":1576416639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7911,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4142753728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4142753728},{"type":"v1","addr":"172.21.15.50:6834","nonce":4142753728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[]} 2024-09-11T22:18:10.218 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 79 2024-09-11T22:18:10.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.219+0000 7fdf26496640 1 -- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf0c06be60 msgr2=0x7fdf0c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.219+0000 7fdf26496640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf0c06be60 0x7fdf0c06e320 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdf10034000 tx=0x7fdf1002e000 comp rx=0 tx=0).stop 2024-09-11T22:18:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.219+0000 7fdf26496640 1 -- 172.21.15.50:0/175503024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf200b3c50 msgr2=0x7fdf201fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.219+0000 7fdf26496640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf200b3c50 0x7fdf201fc960 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400c480 tx=0x7fdf1400c940 comp rx=0 tx=0).stop 2024-09-11T22:18:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.219+0000 7fdf26496640 1 -- 172.21.15.50:0/175503024 shutdown_connections 2024-09-11T22:18:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.219+0000 7fdf26496640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fdf0c06be60 0x7fdf0c06e320 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.219+0000 7fdf26496640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf20162f20 0x7fdf200d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.219+0000 7fdf26496640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf200b3c50 0x7fdf201fc960 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:10.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.219+0000 7fdf26496640 1 --2- 172.21.15.50:0/175503024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf200b2c20 0x7fdf201f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.219+0000 7fdf26496640 1 -- 172.21.15.50:0/175503024 >> 172.21.15.50:0/175503024 conn(0x7fdf200b40b0 msgr2=0x7fdf200b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.219+0000 7fdf26496640 1 -- 172.21.15.50:0/175503024 shutdown_connections 2024-09-11T22:18:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.219+0000 7fdf26496640 1 -- 172.21.15.50:0/175503024 wait complete. 2024-09-11T22:18:10.231 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:18:10.231 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T22:18:10.232 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:18:10.232 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:18:10.232 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:18:10.232 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T22:18:10.232 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:18:10.232 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:18:10.232 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:18:10.233 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T22:18:10.233 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:18:10.233 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:18:10.233 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:18:10.233 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T22:18:10.233 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:18:10.233 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:18:10.241 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:18:10.242 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:18:10.242 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:18:10.242 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:18:10.244 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:18:10.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:18:10.245 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:18:10.245 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:18:10.284 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:18:10.284 DEBUG:teuthology.parallel:result is None 2024-09-11T22:18:10.285 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:18:10.285 DEBUG:teuthology.parallel:result is None 2024-09-11T22:18:10.287 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:18:10.287 DEBUG:teuthology.parallel:result is None 2024-09-11T22:18:10.288 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:18:10.288 DEBUG:teuthology.parallel:result is None 2024-09-11T22:18:10.288 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T22:18:10.363 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:18:10.363 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:18:10.368 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:18:10.369 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:18:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.396+0000 7f7397465640 1 Processor -- start 2024-09-11T22:18:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.396+0000 7f7397465640 1 -- start start 2024-09-11T22:18:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.397+0000 7f7397465640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73900d3c00 0x7f7390169420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.397+0000 7f7397465640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73900cfa80 con 0x7f739015e870 2024-09-11T22:18:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.397+0000 7f7397465640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73900d40d0 con 0x7f73900d18a0 2024-09-11T22:18:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.397+0000 7f7397465640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f73900d43b0 con 0x7f73900d3c00 2024-09-11T22:18:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.397+0000 7f7395a02640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73900d3c00 0x7f7390169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.397+0000 7f7395201640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f739015e870 0x7f73900d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51216/0 (socket says 172.21.15.50:51216) 2024-09-11T22:18:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.397+0000 7f7395201640 1 -- 172.21.15.50:0/2340217059 learned_addr learned my addr 172.21.15.50:0/2340217059 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.398+0000 7f7387fff640 1 -- 172.21.15.50:0/2340217059 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017480953 0 0) 0x7f73900d40d0 con 0x7f73900d18a0 2024-09-11T22:18:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.398+0000 7f7387fff640 1 -- 172.21.15.50:0/2340217059 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f737c003520 con 0x7f73900d18a0 2024-09-11T22:18:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.398+0000 7f7395a02640 1 -- 172.21.15.50:0/2340217059 >> v1:172.21.15.77:6789/0 conn(0x7f73900d18a0 legacy=0x7f73900d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.398+0000 7f7395a02640 1 -- 172.21.15.50:0/2340217059 >> v1:172.21.15.50:6789/0 conn(0x7f739015e870 legacy=0x7f73900d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.398+0000 7f7387fff640 1 -- 172.21.15.50:0/2340217059 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3604598228 0 0) 0x7f738c001110 con 0x7f739015e870 2024-09-11T22:18:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.398+0000 7f7395a02640 1 -- 172.21.15.50:0/2340217059 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73900b7c00 con 0x7f73900d3c00 2024-09-11T22:18:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.399+0000 7f7395a02640 1 --2- 172.21.15.50:0/2340217059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d3c00 0x7f7390169420 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f7388009d90 tx=0x7f738802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e4ee49881cd0ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.399+0000 7f7387fff640 1 -- 172.21.15.50:0/2340217059 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388007740 con 0x7f73900d3c00 2024-09-11T22:18:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.399+0000 7f7387fff640 1 -- 172.21.15.50:0/2340217059 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73880078e0 con 0x7f73900d3c00 2024-09-11T22:18:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.399+0000 7f7387fff640 1 -- 172.21.15.50:0/2340217059 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388007c90 con 0x7f73900d3c00 2024-09-11T22:18:10.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.399+0000 7f7397465640 1 -- 172.21.15.50:0/2340217059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d3c00 msgr2=0x7f7390169420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:10.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.399+0000 7f7397465640 1 --2- 172.21.15.50:0/2340217059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d3c00 0x7f7390169420 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f7388009d90 tx=0x7f738802a6f0 comp rx=0 tx=0).stop 2024-09-11T22:18:10.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.399+0000 7f7397465640 1 -- 172.21.15.50:0/2340217059 shutdown_connections 2024-09-11T22:18:10.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.399+0000 7f7397465640 1 --2- 172.21.15.50:0/2340217059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d3c00 0x7f7390169420 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.399+0000 7f7397465640 1 -- 172.21.15.50:0/2340217059 >> 172.21.15.50:0/2340217059 conn(0x7f73900727a0 msgr2=0x7f73900679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.400+0000 7f7397465640 1 -- 172.21.15.50:0/2340217059 shutdown_connections 2024-09-11T22:18:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.400+0000 7f7397465640 1 -- 172.21.15.50:0/2340217059 wait complete. 2024-09-11T22:18:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.401+0000 7f7397465640 1 Processor -- start 2024-09-11T22:18:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.401+0000 7f7397465640 1 -- start start 2024-09-11T22:18:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.401+0000 7f7397465640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73900d18a0 0x7f73900cf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.401+0000 7f7397465640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d3c00 0x7f73900ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.401+0000 7f7397465640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f739015e870 0x7f73901e7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.401+0000 7f7397465640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73900b78b0 con 0x7f73900d3c00 2024-09-11T22:18:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.401+0000 7f7397465640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f739015ec50 con 0x7f739015e870 2024-09-11T22:18:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.401+0000 7f7397465640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f73900b9410 con 0x7f73900d18a0 2024-09-11T22:18:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7394a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d3c00 0x7f73900ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7394a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d3c00 0x7f73900ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50800/0 (socket says 172.21.15.50:50800) 2024-09-11T22:18:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7394a00640 1 -- 172.21.15.50:0/2874140898 learned_addr learned my addr 172.21.15.50:0/2874140898 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7395201640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73900d18a0 0x7f73900cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7395a02640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f739015e870 0x7f73901e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7394a00640 1 -- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73900d18a0 msgr2=0x7f73900cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7394a00640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73900d18a0 0x7f73900cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7394a00640 1 -- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f739015e870 msgr2=0x7f73901e7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7394a00640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f739015e870 0x7f73901e7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7394a00640 1 -- 172.21.15.50:0/2874140898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73900cc140 con 0x7f73900d3c00 2024-09-11T22:18:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7394a00640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d3c00 0x7f73900ca6c0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f738000c490 tx=0x7f738000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7385ffb640 1 -- 172.21.15.50:0/2874140898 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73800052d0 con 0x7f73900d3c00 2024-09-11T22:18:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7385ffb640 1 -- 172.21.15.50:0/2874140898 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7380005470 con 0x7f73900d3c00 2024-09-11T22:18:10.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7397465640 1 -- 172.21.15.50:0/2874140898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73900cdfa0 con 0x7f73900d3c00 2024-09-11T22:18:10.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7385ffb640 1 -- 172.21.15.50:0/2874140898 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380012850 con 0x7f73900d3c00 2024-09-11T22:18:10.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.402+0000 7f7397465640 1 -- 172.21.15.50:0/2874140898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73900ce560 con 0x7f73900d3c00 2024-09-11T22:18:10.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.403+0000 7f7397465640 1 -- 172.21.15.50:0/2874140898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73900d34f0 con 0x7f73900d3c00 2024-09-11T22:18:10.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.404+0000 7f7385ffb640 1 -- 172.21.15.50:0/2874140898 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f73800129f0 con 0x7f73900d3c00 2024-09-11T22:18:10.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.404+0000 7f7385ffb640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f737406be30 0x7f737406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:10.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.405+0000 7f7385ffb640 1 -- 172.21.15.50:0/2874140898 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4943+0+0 (secure 0 0 0) 0x7f738008a630 con 0x7f73900d3c00 2024-09-11T22:18:10.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.405+0000 7f7395201640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f737406be30 0x7f737406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:10.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.405+0000 7f7395201640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f737406be30 0x7f737406e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f738c000f60 tx=0x7f738c007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:10.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.409+0000 7f7385ffb640 1 -- 172.21.15.50:0/2874140898 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7380058d20 con 0x7f73900d3c00 2024-09-11T22:18:10.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:10.596+0000 7f7397465640 1 -- 172.21.15.50:0/2874140898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7390161ee0 con 0x7f73900d3c00 2024-09-11T22:18:11.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.368+0000 7f7385ffb640 1 -- 172.21.15.50:0/2874140898 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v114) ==== 97+0+0 (secure 0 0 0) 0x7f738005f070 con 0x7f73900d3c00 2024-09-11T22:18:11.369 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-11T22:18:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.372+0000 7f7397465640 1 -- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f737406be30 msgr2=0x7f737406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.372+0000 7f7397465640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f737406be30 0x7f737406e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f738c000f60 tx=0x7f738c007e40 comp rx=0 tx=0).stop 2024-09-11T22:18:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.372+0000 7f7397465640 1 -- 172.21.15.50:0/2874140898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d3c00 msgr2=0x7f73900ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.372+0000 7f7397465640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d3c00 0x7f73900ca6c0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f738000c490 tx=0x7f738000c950 comp rx=0 tx=0).stop 2024-09-11T22:18:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.372+0000 7f7397465640 1 -- 172.21.15.50:0/2874140898 shutdown_connections 2024-09-11T22:18:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.372+0000 7f7397465640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f737406be30 0x7f737406e2f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.372+0000 7f7397465640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f739015e870 0x7f73901e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.372+0000 7f7397465640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900d3c00 0x7f73900ca6c0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.372+0000 7f7397465640 1 --2- 172.21.15.50:0/2874140898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73900d18a0 0x7f73900cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.372+0000 7f7397465640 1 -- 172.21.15.50:0/2874140898 >> 172.21.15.50:0/2874140898 conn(0x7f73900727a0 msgr2=0x7f73900b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:11.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.372+0000 7f7397465640 1 -- 172.21.15.50:0/2874140898 shutdown_connections 2024-09-11T22:18:11.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.372+0000 7f7397465640 1 -- 172.21.15.50:0/2874140898 wait complete. 2024-09-11T22:18:11.387 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T22:18:11.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.496+0000 7f6eacfd6640 1 Processor -- start 2024-09-11T22:18:11.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.496+0000 7f6eacfd6640 1 -- start start 2024-09-11T22:18:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.497+0000 7f6eacfd6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ea80cf580 0x7f6ea80b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.497+0000 7f6eacfd6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ea80ce5f0 con 0x7f6ea815e840 2024-09-11T22:18:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.497+0000 7f6eacfd6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ea80ce310 con 0x7f6ea80cdd50 2024-09-11T22:18:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.497+0000 7f6eacfd6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea806c240 con 0x7f6ea80cf580 2024-09-11T22:18:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.497+0000 7f6ea659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6ea815e840 0x7f6ea80cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51228/0 (socket says 172.21.15.50:51228) 2024-09-11T22:18:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.497+0000 7f6ea659c640 1 -- 172.21.15.50:0/1577445280 learned_addr learned my addr 172.21.15.50:0/1577445280 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.497+0000 7f6e9ffff640 1 --2- 172.21.15.50:0/1577445280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ea80cf580 0x7f6ea80b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.497+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3880437185 0 0) 0x7f6ea80ce5f0 con 0x7f6ea815e840 2024-09-11T22:18:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.497+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e94003520 con 0x7f6ea815e840 2024-09-11T22:18:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2032498846 0 0) 0x7f6ea80ce310 con 0x7f6ea80cdd50 2024-09-11T22:18:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ea80ce5f0 con 0x7f6ea80cdd50 2024-09-11T22:18:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2789771964 0 0) 0x7f6e94003520 con 0x7f6ea815e840 2024-09-11T22:18:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ea80cf580 msgr2=0x7f6ea80b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 --2- 172.21.15.50:0/1577445280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ea80cf580 0x7f6ea80b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 >> v1:172.21.15.77:6789/0 conn(0x7f6ea80cdd50 legacy=0x7f6ea806c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea806bbf0 con 0x7f6ea815e840 2024-09-11T22:18:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f6e98001670 con 0x7f6ea815e840 2024-09-11T22:18:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 >> v1:172.21.15.50:6789/0 conn(0x7f6ea815e840 legacy=0x7f6ea80cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 --2- 172.21.15.50:0/1577445280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ea80cf580 0x7f6e94003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 --2- 172.21.15.50:0/1577445280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e940040d0 0x7f6e94004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 --2- 172.21.15.50:0/1577445280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e94004d40 0x7f6e940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea806c240 con 0x7f6e940040d0 2024-09-11T22:18:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9400baa0 con 0x7f6e94004d40 2024-09-11T22:18:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9400bca0 con 0x7f6ea80cf580 2024-09-11T22:18:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6e9ffff640 1 --2- 172.21.15.50:0/1577445280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e940040d0 0x7f6e94004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea659c640 1 --2- 172.21.15.50:0/1577445280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ea80cf580 0x7f6e94003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6ea6d9d640 1 --2- 172.21.15.50:0/1577445280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e94004d40 0x7f6e940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6e9ffff640 1 -- 172.21.15.50:0/1577445280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ea80cf580 msgr2=0x7f6e94003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6e9ffff640 1 --2- 172.21.15.50:0/1577445280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ea80cf580 0x7f6e94003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6e9ffff640 1 -- 172.21.15.50:0/1577445280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e94004d40 msgr2=0x7f6e940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6e9ffff640 1 --2- 172.21.15.50:0/1577445280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e94004d40 0x7f6e940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.498+0000 7f6e9ffff640 1 -- 172.21.15.50:0/1577445280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e94003520 con 0x7f6e940040d0 2024-09-11T22:18:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.499+0000 7f6e9ffff640 1 --2- 172.21.15.50:0/1577445280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e940040d0 0x7f6e94004800 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8162450 tx=0x7f6e94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36d71851ebd48ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.499+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90036070 con 0x7f6e940040d0 2024-09-11T22:18:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.499+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e90031400 con 0x7f6e940040d0 2024-09-11T22:18:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.499+0000 7f6ea5d9b640 1 -- 172.21.15.50:0/1577445280 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90009690 con 0x7f6e940040d0 2024-09-11T22:18:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.500+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1577445280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e940040d0 msgr2=0x7f6e94004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.500+0000 7f6eacfd6640 1 --2- 172.21.15.50:0/1577445280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e940040d0 0x7f6e94004800 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8162450 tx=0x7f6e94005830 comp rx=0 tx=0).stop 2024-09-11T22:18:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.500+0000 7f6ea6d9d640 1 -- 172.21.15.50:0/1577445280 reap_dead start 2024-09-11T22:18:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.500+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1577445280 shutdown_connections 2024-09-11T22:18:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.500+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1577445280 >> 172.21.15.50:0/1577445280 conn(0x7f6ea80b4150 msgr2=0x7f6ea80b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.500+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1577445280 shutdown_connections 2024-09-11T22:18:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.500+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1577445280 wait complete. 2024-09-11T22:18:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.501+0000 7f6eacfd6640 1 Processor -- start 2024-09-11T22:18:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.501+0000 7f6eacfd6640 1 -- start start 2024-09-11T22:18:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6eacfd6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e940040d0 0x7f6ea80c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6eacfd6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea809fde0 0x7f6ea80c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6eacfd6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea815aa30 0x7f6ea815ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6eacfd6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea815ec20 con 0x7f6ea815aa30 2024-09-11T22:18:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6eacfd6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea80d0470 con 0x7f6ea809fde0 2024-09-11T22:18:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6eacfd6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea815eda0 con 0x7f6e940040d0 2024-09-11T22:18:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6ea6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea815aa30 0x7f6ea815ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6ea6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea815aa30 0x7f6ea815ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50808/0 (socket says 172.21.15.50:50808) 2024-09-11T22:18:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6ea6d9d640 1 -- 172.21.15.50:0/1514737408 learned_addr learned my addr 172.21.15.50:0/1514737408 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6ea659c640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e940040d0 0x7f6ea80c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6e9ffff640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea809fde0 0x7f6ea80c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6ea6d9d640 1 -- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e940040d0 msgr2=0x7f6ea80c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6ea6d9d640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e940040d0 0x7f6ea80c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6ea6d9d640 1 -- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea809fde0 msgr2=0x7f6ea80c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6ea6d9d640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea809fde0 0x7f6ea80c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6ea6d9d640 1 -- 172.21.15.50:0/1514737408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea80c7290 con 0x7f6ea815aa30 2024-09-11T22:18:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.502+0000 7f6ea6d9d640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea815aa30 0x7f6ea815ae90 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80d2300 tx=0x7f6ea000fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.503+0000 7f6e9effd640 1 -- 172.21.15.50:0/1514737408 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0019070 con 0x7f6ea815aa30 2024-09-11T22:18:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.503+0000 7f6e9effd640 1 -- 172.21.15.50:0/1514737408 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea0006e20 con 0x7f6ea815aa30 2024-09-11T22:18:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.503+0000 7f6e9effd640 1 -- 172.21.15.50:0/1514737408 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0003b70 con 0x7f6ea815aa30 2024-09-11T22:18:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.503+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1514737408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea80c7570 con 0x7f6ea815aa30 2024-09-11T22:18:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.503+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1514737408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea80cb0b0 con 0x7f6ea815aa30 2024-09-11T22:18:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.504+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1514737408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea80cb2b0 con 0x7f6ea815aa30 2024-09-11T22:18:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.504+0000 7f6e9effd640 1 -- 172.21.15.50:0/1514737408 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ea001c070 con 0x7f6ea815aa30 2024-09-11T22:18:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.505+0000 7f6e9effd640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6e8806be60 0x7f6e8806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.505+0000 7f6e9effd640 1 -- 172.21.15.50:0/1514737408 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4857+0+0 (secure 0 0 0) 0x7f6ea0089d20 con 0x7f6ea815aa30 2024-09-11T22:18:11.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.505+0000 7f6ea659c640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6e8806be60 0x7f6e8806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.505+0000 7f6ea659c640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6e8806be60 0x7f6e8806e320 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6e98001200 tx=0x7f6e98001e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:11.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.509+0000 7f6e9effd640 1 -- 172.21.15.50:0/1514737408 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ea80cb2b0 con 0x7f6ea815aa30 2024-09-11T22:18:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.751+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1514737408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6ea815b430 con 0x7f6ea815aa30 2024-09-11T22:18:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.752+0000 7f6e9effd640 1 -- 172.21.15.50:0/1514737408 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f6ea0058460 con 0x7f6ea815aa30 2024-09-11T22:18:11.753 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:11.753 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:18:11.753 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-11T22:18:11.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.753 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-11T22:18:11.753 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w==", 2024-09-11T22:18:11.754 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.754 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:18:11.754 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:18:11.754 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:18:11.754 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.754 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.754 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-11T22:18:11.754 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg==", 2024-09-11T22:18:11.754 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.754 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:18:11.755 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:18:11.755 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:18:11.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.755 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-11T22:18:11.755 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ==", 2024-09-11T22:18:11.755 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.755 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:18:11.755 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:18:11.755 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:18:11.756 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.756 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.756 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-11T22:18:11.756 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw==", 2024-09-11T22:18:11.756 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.756 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:18:11.757 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:18:11.757 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:18:11.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.757 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-11T22:18:11.757 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg==", 2024-09-11T22:18:11.757 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.757 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:18:11.757 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:18:11.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.758 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.758 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-11T22:18:11.758 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ==", 2024-09-11T22:18:11.758 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.758 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:18:11.758 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:18:11.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.758 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.759 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-11T22:18:11.759 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg==", 2024-09-11T22:18:11.759 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.759 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:18:11.759 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:18:11.759 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.759 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-11T22:18:11.760 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg==", 2024-09-11T22:18:11.760 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.760 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:18:11.760 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:18:11.760 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.760 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.760 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-11T22:18:11.760 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A==", 2024-09-11T22:18:11.760 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.760 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:18:11.761 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:18:11.761 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.761 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.761 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-11T22:18:11.761 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw==", 2024-09-11T22:18:11.761 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.761 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:18:11.761 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:18:11.761 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.762 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.762 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-11T22:18:11.762 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A==", 2024-09-11T22:18:11.762 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.762 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:18:11.762 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:18:11.762 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.762 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.763 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-11T22:18:11.763 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw==", 2024-09-11T22:18:11.763 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.763 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:18:11.763 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:18:11.763 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.763 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-11T22:18:11.763 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew==", 2024-09-11T22:18:11.764 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.764 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:18:11.764 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-11T22:18:11.764 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T22:18:11.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.764 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-11T22:18:11.764 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw==", 2024-09-11T22:18:11.764 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.764 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:18:11.764 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:18:11.765 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:18:11.765 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:18:11.765 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.765 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-11T22:18:11.765 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg==", 2024-09-11T22:18:11.765 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.765 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:18:11.765 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:18:11.765 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:18:11.766 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:18:11.766 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.766 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-11T22:18:11.766 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw==", 2024-09-11T22:18:11.766 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.766 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:18:11.766 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:18:11.766 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:18:11.766 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:18:11.767 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.767 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-11T22:18:11.767 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBFFeJmAq9+OBAAANc9KfDvm3+wt/uED7WCvA==", 2024-09-11T22:18:11.767 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.767 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:18:11.767 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:18:11.767 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:18:11.767 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.767 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.768 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-11T22:18:11.768 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g==", 2024-09-11T22:18:11.768 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.768 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:18:11.768 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:18:11.768 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.768 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:18:11.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:11.768 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-11T22:18:11.769 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg==", 2024-09-11T22:18:11.769 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:18:11.769 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:18:11.769 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:18:11.769 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:18:11.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:11.769 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-11T22:18:11.769 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:18:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.754+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6e8806be60 msgr2=0x7f6e8806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.754+0000 7f6eacfd6640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6e8806be60 0x7f6e8806e320 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6e98001200 tx=0x7f6e98001e40 comp rx=0 tx=0).stop 2024-09-11T22:18:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.754+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1514737408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea815aa30 msgr2=0x7f6ea815ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.754+0000 7f6eacfd6640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea815aa30 0x7f6ea815ae90 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80d2300 tx=0x7f6ea000fd60 comp rx=0 tx=0).stop 2024-09-11T22:18:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.754+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1514737408 shutdown_connections 2024-09-11T22:18:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.754+0000 7f6eacfd6640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6e8806be60 0x7f6e8806e320 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.754+0000 7f6eacfd6640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ea815aa30 0x7f6ea815ae90 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.754+0000 7f6eacfd6640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea809fde0 0x7f6ea80c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.754+0000 7f6eacfd6640 1 --2- 172.21.15.50:0/1514737408 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e940040d0 0x7f6ea80c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.754+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1514737408 >> 172.21.15.50:0/1514737408 conn(0x7f6ea80b4150 msgr2=0x7f6ea80b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.754+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1514737408 shutdown_connections 2024-09-11T22:18:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.754+0000 7f6eacfd6640 1 -- 172.21.15.50:0/1514737408 wait complete. 2024-09-11T22:18:11.772 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:18:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.874+0000 7fe8549a1640 1 Processor -- start 2024-09-11T22:18:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.874+0000 7fe8549a1640 1 -- start start 2024-09-11T22:18:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.875+0000 7fe8549a1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe85015c2c0 0x7fe8500b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.875+0000 7fe8549a1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8500d05e0 0x7fe8500ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.875+0000 7fe8549a1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8500b4f00 con 0x7fe8500b3e10 2024-09-11T22:18:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.875+0000 7fe8549a1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe8500b4360 con 0x7fe85015c2c0 2024-09-11T22:18:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.875+0000 7fe8549a1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe8500b51c0 con 0x7fe8500d05e0 2024-09-11T22:18:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.875+0000 7fe84e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe85015c2c0 0x7fe8500b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.875+0000 7fe84dd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe8500b3e10 0x7fe8500cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51238/0 (socket says 172.21.15.50:51238) 2024-09-11T22:18:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.875+0000 7fe84dd9b640 1 -- 172.21.15.50:0/2405340561 learned_addr learned my addr 172.21.15.50:0/2405340561 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.875+0000 7fe84ed9d640 1 --2- 172.21.15.50:0/2405340561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8500d05e0 0x7fe8500ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.875+0000 7fe84e59c640 1 -- 172.21.15.50:0/2405340561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8500d05e0 msgr2=0x7fe8500ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.875+0000 7fe84e59c640 1 --2- 172.21.15.50:0/2405340561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8500d05e0 0x7fe8500ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.876+0000 7fe84e59c640 1 -- 172.21.15.50:0/2405340561 >> v1:172.21.15.50:6789/0 conn(0x7fe8500b3e10 legacy=0x7fe8500cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.876+0000 7fe84e59c640 1 -- 172.21.15.50:0/2405340561 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8500b54a0 con 0x7fe85015c2c0 2024-09-11T22:18:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.876+0000 7fe84d59a640 1 -- 172.21.15.50:0/2405340561 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292662960 0 0) 0x7fe8500b4f00 con 0x7fe8500b3e10 2024-09-11T22:18:11.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.876+0000 7fe84e59c640 1 --2- 172.21.15.50:0/2405340561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe85015c2c0 0x7fe8500b46a0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fe8480097a0 tx=0x7fe84802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2984e72582b3af3a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:11.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.876+0000 7fe84d59a640 1 -- 172.21.15.50:0/2405340561 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe848037070 con 0x7fe85015c2c0 2024-09-11T22:18:11.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.876+0000 7fe84d59a640 1 -- 172.21.15.50:0/2405340561 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe848032440 con 0x7fe85015c2c0 2024-09-11T22:18:11.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.876+0000 7fe84d59a640 1 -- 172.21.15.50:0/2405340561 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe848032810 con 0x7fe85015c2c0 2024-09-11T22:18:11.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.877+0000 7fe8549a1640 1 -- 172.21.15.50:0/2405340561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe85015c2c0 msgr2=0x7fe8500b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:11.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.877+0000 7fe8549a1640 1 --2- 172.21.15.50:0/2405340561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe85015c2c0 0x7fe8500b46a0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fe8480097a0 tx=0x7fe84802a180 comp rx=0 tx=0).stop 2024-09-11T22:18:11.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.877+0000 7fe8549a1640 1 -- 172.21.15.50:0/2405340561 shutdown_connections 2024-09-11T22:18:11.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.877+0000 7fe8549a1640 1 --2- 172.21.15.50:0/2405340561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8500d05e0 0x7fe8500ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.877+0000 7fe8549a1640 1 --2- 172.21.15.50:0/2405340561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe85015c2c0 0x7fe8500b46a0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.877+0000 7fe8549a1640 1 -- 172.21.15.50:0/2405340561 >> 172.21.15.50:0/2405340561 conn(0x7fe8500679c0 msgr2=0x7fe850067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:11.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.877+0000 7fe8549a1640 1 -- 172.21.15.50:0/2405340561 shutdown_connections 2024-09-11T22:18:11.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.877+0000 7fe8549a1640 1 -- 172.21.15.50:0/2405340561 wait complete. 2024-09-11T22:18:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.878+0000 7fe8549a1640 1 Processor -- start 2024-09-11T22:18:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.878+0000 7fe8549a1640 1 -- start start 2024-09-11T22:18:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.879+0000 7fe8549a1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8500b3e10 0x7fe850150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.879+0000 7fe8549a1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8500d05e0 0x7fe8500ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.879+0000 7fe8549a1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe85015c2c0 0x7fe8500aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.879+0000 7fe8549a1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe85006d070 con 0x7fe8500b3e10 2024-09-11T22:18:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.879+0000 7fe8549a1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe8500ce200 con 0x7fe8500d05e0 2024-09-11T22:18:11.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.879+0000 7fe8549a1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe85006d1f0 con 0x7fe85015c2c0 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.879+0000 7fe84e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8500b3e10 0x7fe850150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.879+0000 7fe84e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8500b3e10 0x7fe850150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50816/0 (socket says 172.21.15.50:50816) 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.879+0000 7fe84e59c640 1 -- 172.21.15.50:0/2778735863 learned_addr learned my addr 172.21.15.50:0/2778735863 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.879+0000 7fe84ed9d640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe85015c2c0 0x7fe8500aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.879+0000 7fe84dd9b640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8500d05e0 0x7fe8500ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.880+0000 7fe84e59c640 1 -- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe85015c2c0 msgr2=0x7fe8500aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.880+0000 7fe84e59c640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe85015c2c0 0x7fe8500aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.880+0000 7fe84e59c640 1 -- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8500d05e0 msgr2=0x7fe8500ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.880+0000 7fe84e59c640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8500d05e0 0x7fe8500ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.880+0000 7fe84e59c640 1 -- 172.21.15.50:0/2778735863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe850151410 con 0x7fe8500b3e10 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.880+0000 7fe84ed9d640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe85015c2c0 0x7fe8500aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.880+0000 7fe84e59c640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8500b3e10 0x7fe850150ed0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fe8480098c0 tx=0x7fe8480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.880+0000 7fe846ffd640 1 -- 172.21.15.50:0/2778735863 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe848037040 con 0x7fe8500b3e10 2024-09-11T22:18:11.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.880+0000 7fe846ffd640 1 -- 172.21.15.50:0/2778735863 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe848030770 con 0x7fe8500b3e10 2024-09-11T22:18:11.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.880+0000 7fe8549a1640 1 -- 172.21.15.50:0/2778735863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8501f4740 con 0x7fe8500b3e10 2024-09-11T22:18:11.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.880+0000 7fe846ffd640 1 -- 172.21.15.50:0/2778735863 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe848030b40 con 0x7fe8500b3e10 2024-09-11T22:18:11.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.880+0000 7fe8549a1640 1 -- 172.21.15.50:0/2778735863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8501f4d00 con 0x7fe8500b3e10 2024-09-11T22:18:11.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.881+0000 7fe8549a1640 1 -- 172.21.15.50:0/2778735863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe85015c6a0 con 0x7fe8500b3e10 2024-09-11T22:18:11.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.881+0000 7fe846ffd640 1 -- 172.21.15.50:0/2778735863 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe848044020 con 0x7fe8500b3e10 2024-09-11T22:18:11.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.882+0000 7fe846ffd640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe83006be30 0x7fe83006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:11.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.882+0000 7fe846ffd640 1 -- 172.21.15.50:0/2778735863 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4857+0+0 (secure 0 0 0) 0x7fe8480aaf70 con 0x7fe8500b3e10 2024-09-11T22:18:11.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.882+0000 7fe84dd9b640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe83006be30 0x7fe83006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:11.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.883+0000 7fe84dd9b640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe83006be30 0x7fe83006e2f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe8500b1df0 tx=0x7fe838007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:11.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:11.886+0000 7fe846ffd640 1 -- 172.21.15.50:0/2778735863 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe848032e20 con 0x7fe8500b3e10 2024-09-11T22:18:12.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.062+0000 7fe8549a1640 1 -- 172.21.15.50:0/2778735863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe8500b11d0 con 0x7fe8500b3e10 2024-09-11T22:18:12.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.063+0000 7fe846ffd640 1 -- 172.21.15.50:0/2778735863 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v116) ==== 84+0+65 (secure 0 0 0) 0x7fe848079c70 con 0x7fe8500b3e10 2024-09-11T22:18:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:12.064 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:18:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:18:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:18:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:18:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:12.064 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:18:12.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.065+0000 7fe8549a1640 1 -- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe83006be30 msgr2=0x7fe83006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:12.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.065+0000 7fe8549a1640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe83006be30 0x7fe83006e2f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe8500b1df0 tx=0x7fe838007d50 comp rx=0 tx=0).stop 2024-09-11T22:18:12.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.065+0000 7fe8549a1640 1 -- 172.21.15.50:0/2778735863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8500b3e10 msgr2=0x7fe850150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:12.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.065+0000 7fe8549a1640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8500b3e10 0x7fe850150ed0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fe8480098c0 tx=0x7fe8480046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:12.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.065+0000 7fe8549a1640 1 -- 172.21.15.50:0/2778735863 shutdown_connections 2024-09-11T22:18:12.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.065+0000 7fe8549a1640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe83006be30 0x7fe83006e2f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:12.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.065+0000 7fe8549a1640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe85015c2c0 0x7fe8500aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:12.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.065+0000 7fe8549a1640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8500d05e0 0x7fe8500ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:12.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.065+0000 7fe8549a1640 1 --2- 172.21.15.50:0/2778735863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8500b3e10 0x7fe850150ed0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:12.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.065+0000 7fe8549a1640 1 -- 172.21.15.50:0/2778735863 >> 172.21.15.50:0/2778735863 conn(0x7fe8500679c0 msgr2=0x7fe850151d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:12.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.065+0000 7fe8549a1640 1 -- 172.21.15.50:0/2778735863 shutdown_connections 2024-09-11T22:18:12.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.065+0000 7fe8549a1640 1 -- 172.21.15.50:0/2778735863 wait complete. 2024-09-11T22:18:12.076 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:18:12.076 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:18:12.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.181+0000 7ffa0442c640 1 Processor -- start 2024-09-11T22:18:12.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.181+0000 7ffa0442c640 1 -- start start 2024-09-11T22:18:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.182+0000 7ffa0442c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff9fc06ffb0 0x7ff9fc0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.182+0000 7ffa0442c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9fc162280 con 0x7ff9fc06f300 2024-09-11T22:18:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.182+0000 7ffa0442c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9fc06c700 con 0x7ff9fc161ea0 2024-09-11T22:18:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.182+0000 7ffa0442c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff9fc06c9e0 con 0x7ff9fc06ffb0 2024-09-11T22:18:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.183+0000 7ffa029c9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff9fc06f300 0x7ff9fc0d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51250/0 (socket says 172.21.15.50:51250) 2024-09-11T22:18:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.183+0000 7ffa029c9640 1 -- 172.21.15.50:0/2241069203 learned_addr learned my addr 172.21.15.50:0/2241069203 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.183+0000 7ffa019c7640 1 --2- 172.21.15.50:0/2241069203 >> v2:172.21.15.77:3300/0 conn(0x7ff9fc06ffb0 0x7ff9fc0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.183+0000 7ffa011c6640 1 -- 172.21.15.50:0/2241069203 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1023441135 0 0) 0x7ff9fc162280 con 0x7ff9fc06f300 2024-09-11T22:18:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.183+0000 7ffa011c6640 1 -- 172.21.15.50:0/2241069203 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e8003520 con 0x7ff9fc06f300 2024-09-11T22:18:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.183+0000 7ffa019c7640 1 -- 172.21.15.50:0/2241069203 >> v1:172.21.15.77:6789/0 conn(0x7ff9fc161ea0 legacy=0x7ff9fc06f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.183+0000 7ffa019c7640 1 -- 172.21.15.50:0/2241069203 >> v1:172.21.15.50:6789/0 conn(0x7ff9fc06f300 legacy=0x7ff9fc0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.183+0000 7ffa019c7640 1 -- 172.21.15.50:0/2241069203 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9fc06ccc0 con 0x7ff9fc06ffb0 2024-09-11T22:18:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.184+0000 7ffa019c7640 1 --2- 172.21.15.50:0/2241069203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc06ffb0 0x7ff9fc0b4c70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc162450 tx=0x7ff9ec02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=721923ebd8a7e380 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.184+0000 7ffa011c6640 1 -- 172.21.15.50:0/2241069203 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec037070 con 0x7ff9fc06ffb0 2024-09-11T22:18:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.184+0000 7ffa011c6640 1 -- 172.21.15.50:0/2241069203 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ec032440 con 0x7ff9fc06ffb0 2024-09-11T22:18:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.184+0000 7ffa011c6640 1 -- 172.21.15.50:0/2241069203 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0327f0 con 0x7ff9fc06ffb0 2024-09-11T22:18:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.185+0000 7ffa0442c640 1 -- 172.21.15.50:0/2241069203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc06ffb0 msgr2=0x7ff9fc0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.185+0000 7ffa0442c640 1 --2- 172.21.15.50:0/2241069203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc06ffb0 0x7ff9fc0b4c70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc162450 tx=0x7ff9ec02a180 comp rx=0 tx=0).stop 2024-09-11T22:18:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.185+0000 7ffa0442c640 1 -- 172.21.15.50:0/2241069203 shutdown_connections 2024-09-11T22:18:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.185+0000 7ffa0442c640 1 --2- 172.21.15.50:0/2241069203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc06ffb0 0x7ff9fc0b4c70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:12.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.185+0000 7ffa0442c640 1 -- 172.21.15.50:0/2241069203 >> 172.21.15.50:0/2241069203 conn(0x7ff9fc0b4150 msgr2=0x7ff9fc0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:12.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.185+0000 7ffa0442c640 1 -- 172.21.15.50:0/2241069203 shutdown_connections 2024-09-11T22:18:12.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.185+0000 7ffa0442c640 1 -- 172.21.15.50:0/2241069203 wait complete. 2024-09-11T22:18:12.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.186+0000 7ffa0442c640 1 Processor -- start 2024-09-11T22:18:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.186+0000 7ffa0442c640 1 -- start start 2024-09-11T22:18:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa0442c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc06f300 0x7ff9fc0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa0442c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc06ffb0 0x7ff9fc158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa0442c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9fc161ea0 0x7ff9fc159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa0442c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc06d7a0 con 0x7ff9fc06f300 2024-09-11T22:18:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa0442c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc06d280 con 0x7ff9fc06ffb0 2024-09-11T22:18:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa0442c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff9fc06d920 con 0x7ff9fc161ea0 2024-09-11T22:18:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa021c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc06f300 0x7ff9fc0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa021c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc06f300 0x7ff9fc0c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50820/0 (socket says 172.21.15.50:50820) 2024-09-11T22:18:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa021c8640 1 -- 172.21.15.50:0/272553177 learned_addr learned my addr 172.21.15.50:0/272553177 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa019c7640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc06ffb0 0x7ff9fc158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa029c9640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9fc161ea0 0x7ff9fc159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa021c8640 1 -- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9fc161ea0 msgr2=0x7ff9fc159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa021c8640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9fc161ea0 0x7ff9fc159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa021c8640 1 -- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc06ffb0 msgr2=0x7ff9fc158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa021c8640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc06ffb0 0x7ff9fc158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa021c8640 1 -- 172.21.15.50:0/272553177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9fc0b64a0 con 0x7ff9fc06f300 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa029c9640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9fc161ea0 0x7ff9fc159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa021c8640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc06f300 0x7ff9fc0c6c60 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800c3f0 tx=0x7ff9f800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ff9f2ffd640 1 -- 172.21.15.50:0/272553177 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f80052d0 con 0x7ff9fc06f300 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ff9f2ffd640 1 -- 172.21.15.50:0/272553177 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f8005490 con 0x7ff9fc06f300 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ffa0442c640 1 -- 172.21.15.50:0/272553177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9fc15a280 con 0x7ff9fc06f300 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.187+0000 7ff9f2ffd640 1 -- 172.21.15.50:0/272553177 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8007260 con 0x7ff9fc06f300 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.188+0000 7ffa0442c640 1 -- 172.21.15.50:0/272553177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9fc0b6760 con 0x7ff9fc06f300 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.189+0000 7ffa0442c640 1 -- 172.21.15.50:0/272553177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9fc075770 con 0x7ff9fc06f300 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.189+0000 7ff9f2ffd640 1 -- 172.21.15.50:0/272553177 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9f8007400 con 0x7ff9fc06f300 2024-09-11T22:18:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.189+0000 7ff9f2ffd640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff9e006be30 0x7ff9e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.190+0000 7ff9f2ffd640 1 -- 172.21.15.50:0/272553177 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4857+0+0 (secure 0 0 0) 0x7ff9f8089f80 con 0x7ff9fc06f300 2024-09-11T22:18:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.190+0000 7ffa019c7640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff9e006be30 0x7ff9e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.190+0000 7ffa019c7640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff9e006be30 0x7ff9e006e2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec034000 tx=0x7ff9ec02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:12.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.194+0000 7ff9f2ffd640 1 -- 172.21.15.50:0/272553177 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff9fc075770 con 0x7ff9fc06f300 2024-09-11T22:18:12.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:12.374+0000 7ffa0442c640 1 -- 172.21.15.50:0/272553177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff9fc0b4c70 con 0x7ff9fc06f300 2024-09-11T22:18:13.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.371+0000 7ff9f2ffd640 1 -- 172.21.15.50:0/272553177 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v117) ==== 138+0+0 (secure 0 0 0) 0x7ff9f8058c70 con 0x7ff9fc06f300 2024-09-11T22:18:13.372 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:18:13.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.375+0000 7ffa0442c640 1 -- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff9e006be30 msgr2=0x7ff9e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:13.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.375+0000 7ffa0442c640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff9e006be30 0x7ff9e006e2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec034000 tx=0x7ff9ec02e000 comp rx=0 tx=0).stop 2024-09-11T22:18:13.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.375+0000 7ffa0442c640 1 -- 172.21.15.50:0/272553177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc06f300 msgr2=0x7ff9fc0c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:13.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.375+0000 7ffa0442c640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc06f300 0x7ff9fc0c6c60 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800c3f0 tx=0x7ff9f800c8b0 comp rx=0 tx=0).stop 2024-09-11T22:18:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.376+0000 7ffa0442c640 1 -- 172.21.15.50:0/272553177 shutdown_connections 2024-09-11T22:18:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.376+0000 7ffa0442c640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff9e006be30 0x7ff9e006e2f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.376+0000 7ffa0442c640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9fc161ea0 0x7ff9fc159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:13.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.376+0000 7ffa0442c640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc06ffb0 0x7ff9fc158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:13.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.376+0000 7ffa0442c640 1 --2- 172.21.15.50:0/272553177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc06f300 0x7ff9fc0c6c60 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:13.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.376+0000 7ffa0442c640 1 -- 172.21.15.50:0/272553177 >> 172.21.15.50:0/272553177 conn(0x7ff9fc0b4150 msgr2=0x7ff9fc069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:13.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.378+0000 7ffa0442c640 1 -- 172.21.15.50:0/272553177 shutdown_connections 2024-09-11T22:18:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.379+0000 7ffa0442c640 1 -- 172.21.15.50:0/272553177 wait complete. 2024-09-11T22:18:13.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:18:13.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:18:13.394 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:18:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.549+0000 7f3f5f65c640 1 Processor -- start 2024-09-11T22:18:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.549+0000 7f3f5f65c640 1 -- start start 2024-09-11T22:18:13.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.550+0000 7f3f5f65c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3f5815e8e0 0x7f3f580b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:13.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.550+0000 7f3f5f65c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f580d1580 0x7f3f580d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:13.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.550+0000 7f3f5f65c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f580d1ee0 con 0x7f3f58162350 2024-09-11T22:18:13.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.550+0000 7f3f5f65c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3f5815ecc0 con 0x7f3f5815e8e0 2024-09-11T22:18:13.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.550+0000 7f3f5f65c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3f580d2ad0 con 0x7f3f580d1580 2024-09-11T22:18:13.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.550+0000 7f3f5dbf9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3f58162350 0x7f3f58162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51262/0 (socket says 172.21.15.50:51262) 2024-09-11T22:18:13.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.550+0000 7f3f5dbf9640 1 -- 172.21.15.50:0/3739304233 learned_addr learned my addr 172.21.15.50:0/3739304233 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:13.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f5d3f8640 1 --2- 172.21.15.50:0/3739304233 >> v2:172.21.15.77:3300/0 conn(0x7f3f5815e8e0 0x7f3f580b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:13.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f5cbf7640 1 --2- 172.21.15.50:0/3739304233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f580d1580 0x7f3f580d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:13.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009493329 0 0) 0x7f3f580d1ee0 con 0x7f3f58162350 2024-09-11T22:18:13.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f44003520 con 0x7f3f58162350 2024-09-11T22:18:13.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1966268653 0 0) 0x7f3f44003520 con 0x7f3f58162350 2024-09-11T22:18:13.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f580d1580 msgr2=0x7f3f580d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:13.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 --2- 172.21.15.50:0/3739304233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f580d1580 0x7f3f580d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:13.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 >> v2:172.21.15.77:3300/0 conn(0x7f3f5815e8e0 msgr2=0x7f3f580b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:13.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 --2- 172.21.15.50:0/3739304233 >> v2:172.21.15.77:3300/0 conn(0x7f3f5815e8e0 0x7f3f580b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:13.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f58163080 con 0x7f3f58162350 2024-09-11T22:18:13.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f3f500019f0 con 0x7f3f58162350 2024-09-11T22:18:13.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 >> v1:172.21.15.50:6789/0 conn(0x7f3f58162350 legacy=0x7f3f58162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:13.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 --2- 172.21.15.50:0/3739304233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f440039b0 0x7f3f44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 --2- 172.21.15.50:0/3739304233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f44004800 0x7f3f44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 --2- 172.21.15.50:0/3739304233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f580d1580 0x7f3f440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f580d2ad0 con 0x7f3f440039b0 2024-09-11T22:18:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4400b9c0 con 0x7f3f44004800 2024-09-11T22:18:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3f4400bb40 con 0x7f3f580d1580 2024-09-11T22:18:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f5d3f8640 1 --2- 172.21.15.50:0/3739304233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f440039b0 0x7f3f44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f5cbf7640 1 --2- 172.21.15.50:0/3739304233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f44004800 0x7f3f44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f5dbf9640 1 --2- 172.21.15.50:0/3739304233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f580d1580 0x7f3f440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f5d3f8640 1 -- 172.21.15.50:0/3739304233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f580d1580 msgr2=0x7f3f440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f5d3f8640 1 --2- 172.21.15.50:0/3739304233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f580d1580 0x7f3f440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:13.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f5d3f8640 1 -- 172.21.15.50:0/3739304233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f44004800 msgr2=0x7f3f44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:13.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f5d3f8640 1 --2- 172.21.15.50:0/3739304233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f44004800 0x7f3f44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:13.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f5d3f8640 1 -- 172.21.15.50:0/3739304233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f44003520 con 0x7f3f440039b0 2024-09-11T22:18:13.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.551+0000 7f3f5cbf7640 1 --2- 172.21.15.50:0/3739304233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f44004800 0x7f3f44004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:13.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.552+0000 7f3f5d3f8640 1 --2- 172.21.15.50:0/3739304233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f440039b0 0x7f3f44003dd0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009ac0 tx=0x7f3f44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bab958dcd2249ad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:13.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.552+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f54036070 con 0x7f3f440039b0 2024-09-11T22:18:13.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.552+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f54031400 con 0x7f3f440039b0 2024-09-11T22:18:13.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.552+0000 7f3f4ffff640 1 -- 172.21.15.50:0/3739304233 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f54009690 con 0x7f3f440039b0 2024-09-11T22:18:13.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.553+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3739304233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f440039b0 msgr2=0x7f3f44003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:13.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.553+0000 7f3f5f65c640 1 --2- 172.21.15.50:0/3739304233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f440039b0 0x7f3f44003dd0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009ac0 tx=0x7f3f44005830 comp rx=0 tx=0).stop 2024-09-11T22:18:13.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.553+0000 7f3f5dbf9640 1 -- 172.21.15.50:0/3739304233 reap_dead start 2024-09-11T22:18:13.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.553+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3739304233 shutdown_connections 2024-09-11T22:18:13.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.553+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3739304233 >> 172.21.15.50:0/3739304233 conn(0x7f3f58067ba0 msgr2=0x7f3f58067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:13.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.553+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3739304233 shutdown_connections 2024-09-11T22:18:13.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.553+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3739304233 wait complete. 2024-09-11T22:18:13.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.554+0000 7f3f5f65c640 1 Processor -- start 2024-09-11T22:18:13.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.554+0000 7f3f5f65c640 1 -- start start 2024-09-11T22:18:13.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5f65c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f440039b0 0x7f3f580ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:13.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5f65c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f5815d7b0 0x7f3f581f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:13.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5f65c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f581f4a30 0x7f3f581f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:13.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5f65c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f580d3000 con 0x7f3f581f4a30 2024-09-11T22:18:13.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5f65c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f580d3370 con 0x7f3f440039b0 2024-09-11T22:18:13.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5f65c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3f580d19a0 con 0x7f3f5815d7b0 2024-09-11T22:18:13.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5dbf9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f581f4a30 0x7f3f581f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:13.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5dbf9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f581f4a30 0x7f3f581f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50838/0 (socket says 172.21.15.50:50838) 2024-09-11T22:18:13.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5dbf9640 1 -- 172.21.15.50:0/3161051570 learned_addr learned my addr 172.21.15.50:0/3161051570 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:13.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5cbf7640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f5815d7b0 0x7f3f581f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:13.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5d3f8640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f440039b0 0x7f3f580ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:13.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5dbf9640 1 -- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f5815d7b0 msgr2=0x7f3f581f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:13.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5dbf9640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f5815d7b0 0x7f3f581f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:13.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5dbf9640 1 -- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f440039b0 msgr2=0x7f3f580ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:13.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5dbf9640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f440039b0 0x7f3f580ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:13.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.555+0000 7f3f5dbf9640 1 -- 172.21.15.50:0/3161051570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f580cc770 con 0x7f3f581f4a30 2024-09-11T22:18:13.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.556+0000 7f3f5dbf9640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f581f4a30 0x7f3f581f4eb0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f3f580cedf0 tx=0x7f3f5000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:13.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.556+0000 7f3f4dffb640 1 -- 172.21.15.50:0/3161051570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5000eda0 con 0x7f3f581f4a30 2024-09-11T22:18:13.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.556+0000 7f3f4dffb640 1 -- 172.21.15.50:0/3161051570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f50014430 con 0x7f3f581f4a30 2024-09-11T22:18:13.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.556+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3161051570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f580cca50 con 0x7f3f581f4a30 2024-09-11T22:18:13.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.556+0000 7f3f4dffb640 1 -- 172.21.15.50:0/3161051570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f50014820 con 0x7f3f581f4a30 2024-09-11T22:18:13.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.556+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3161051570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f580cd010 con 0x7f3f581f4a30 2024-09-11T22:18:13.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.557+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3161051570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f580d1d80 con 0x7f3f581f4a30 2024-09-11T22:18:13.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.558+0000 7f3f4dffb640 1 -- 172.21.15.50:0/3161051570 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f500149c0 con 0x7f3f581f4a30 2024-09-11T22:18:13.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.558+0000 7f3f4dffb640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f3c06be60 0x7f3f3c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:13.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.558+0000 7f3f4dffb640 1 -- 172.21.15.50:0/3161051570 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5227+0+0 (secure 0 0 0) 0x7f3f5008aa20 con 0x7f3f581f4a30 2024-09-11T22:18:13.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.558+0000 7f3f5d3f8640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f3c06be60 0x7f3f3c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:13.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.559+0000 7f3f5d3f8640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f3c06be60 0x7f3f3c06e320 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3f54033000 tx=0x7f3f54008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:13.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.563+0000 7f3f4dffb640 1 -- 172.21.15.50:0/3161051570 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f500595b0 con 0x7f3f581f4a30 2024-09-11T22:18:13.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:13.739+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3161051570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3f580cd9f0 con 0x7f3f581f4a30 2024-09-11T22:18:14.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.376+0000 7f3f4dffb640 1 -- 172.21.15.50:0/3161051570 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v118) ==== 170+0+0 (secure 0 0 0) 0x7f3f50058eb0 con 0x7f3f581f4a30 2024-09-11T22:18:14.378 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:18:14.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.379+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f3c06be60 msgr2=0x7f3f3c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:14.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.380+0000 7f3f5f65c640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f3c06be60 0x7f3f3c06e320 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3f54033000 tx=0x7f3f54008030 comp rx=0 tx=0).stop 2024-09-11T22:18:14.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.380+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3161051570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f581f4a30 msgr2=0x7f3f581f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:14.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.380+0000 7f3f5f65c640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f581f4a30 0x7f3f581f4eb0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f3f580cedf0 tx=0x7f3f5000e530 comp rx=0 tx=0).stop 2024-09-11T22:18:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.380+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3161051570 shutdown_connections 2024-09-11T22:18:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.380+0000 7f3f5f65c640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f3c06be60 0x7f3f3c06e320 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.380+0000 7f3f5f65c640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f5815d7b0 0x7f3f581f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.380+0000 7f3f5f65c640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f581f4a30 0x7f3f581f4eb0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.380+0000 7f3f5f65c640 1 --2- 172.21.15.50:0/3161051570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f440039b0 0x7f3f580ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.380+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3161051570 >> 172.21.15.50:0/3161051570 conn(0x7f3f58067ba0 msgr2=0x7f3f580b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.380+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3161051570 shutdown_connections 2024-09-11T22:18:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.381+0000 7f3f5f65c640 1 -- 172.21.15.50:0/3161051570 wait complete. 2024-09-11T22:18:14.411 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:18:14.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.521+0000 7f52c5467640 1 Processor -- start 2024-09-11T22:18:14.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.521+0000 7f52c5467640 1 -- start start 2024-09-11T22:18:14.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.522+0000 7f52c5467640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52c015e840 0x7f52c00b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.522+0000 7f52c5467640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c00cdd50 0x7f52c00cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.522+0000 7f52c5467640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c00ce5f0 con 0x7f52c00cf3b0 2024-09-11T22:18:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.522+0000 7f52c5467640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f52c006c240 con 0x7f52c015e840 2024-09-11T22:18:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.522+0000 7f52c5467640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52c00d0470 con 0x7f52c00cdd50 2024-09-11T22:18:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.522+0000 7f52be7fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c00cdd50 0x7f52c00cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.522+0000 7f52beffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52c015e840 0x7f52c00b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.522+0000 7f52be7fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c00cdd50 0x7f52c00cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:37782/0 (socket says 172.21.15.50:37782) 2024-09-11T22:18:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.522+0000 7f52be7fc640 1 -- 172.21.15.50:0/246441665 learned_addr learned my addr 172.21.15.50:0/246441665 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:14.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.522+0000 7f52be7fc640 1 -- 172.21.15.50:0/246441665 >> v2:172.21.15.77:3300/0 conn(0x7f52c015e840 msgr2=0x7f52c00b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:14.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.522+0000 7f52be7fc640 1 --2- 172.21.15.50:0/246441665 >> v2:172.21.15.77:3300/0 conn(0x7f52c015e840 0x7f52c00b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.522+0000 7f52be7fc640 1 -- 172.21.15.50:0/246441665 >> v1:172.21.15.77:6789/0 conn(0x7f52c00cf3b0 legacy=0x7f52c00d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:14.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.523+0000 7f52be7fc640 1 -- 172.21.15.50:0/246441665 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c00ce310 con 0x7f52c00cdd50 2024-09-11T22:18:14.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.523+0000 7f52bdffb640 1 -- 172.21.15.50:0/246441665 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2312043072 0 0) 0x7f52c00ce5f0 con 0x7f52c00cf3b0 2024-09-11T22:18:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.523+0000 7f52beffd640 1 --2- 172.21.15.50:0/246441665 >> v2:172.21.15.77:3300/0 conn(0x7f52c015e840 0x7f52c00b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.523+0000 7f52be7fc640 1 --2- 172.21.15.50:0/246441665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c00cdd50 0x7f52c00cee70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f52b40098a0 tx=0x7f52b402a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78002bd3467ba8f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.523+0000 7f52bdffb640 1 -- 172.21.15.50:0/246441665 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4037070 con 0x7f52c00cdd50 2024-09-11T22:18:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.524+0000 7f52bdffb640 1 -- 172.21.15.50:0/246441665 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b4032440 con 0x7f52c00cdd50 2024-09-11T22:18:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.524+0000 7f52bdffb640 1 -- 172.21.15.50:0/246441665 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4032810 con 0x7f52c00cdd50 2024-09-11T22:18:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.524+0000 7f52c5467640 1 -- 172.21.15.50:0/246441665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c00cdd50 msgr2=0x7f52c00cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.524+0000 7f52c5467640 1 --2- 172.21.15.50:0/246441665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c00cdd50 0x7f52c00cee70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f52b40098a0 tx=0x7f52b402a290 comp rx=0 tx=0).stop 2024-09-11T22:18:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.524+0000 7f52c5467640 1 -- 172.21.15.50:0/246441665 shutdown_connections 2024-09-11T22:18:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.524+0000 7f52c5467640 1 --2- 172.21.15.50:0/246441665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c00cdd50 0x7f52c00cee70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.524+0000 7f52c5467640 1 --2- 172.21.15.50:0/246441665 >> v2:172.21.15.77:3300/0 conn(0x7f52c015e840 0x7f52c00b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.524+0000 7f52c5467640 1 -- 172.21.15.50:0/246441665 >> 172.21.15.50:0/246441665 conn(0x7f52c00b4150 msgr2=0x7f52c00b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.524+0000 7f52c5467640 1 -- 172.21.15.50:0/246441665 shutdown_connections 2024-09-11T22:18:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.524+0000 7f52c5467640 1 -- 172.21.15.50:0/246441665 wait complete. 2024-09-11T22:18:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.525+0000 7f52c5467640 1 Processor -- start 2024-09-11T22:18:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.526+0000 7f52c5467640 1 -- start start 2024-09-11T22:18:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.526+0000 7f52c5467640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52c00cdd50 0x7f52c00b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.526+0000 7f52c5467640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c00cf3b0 0x7f52c0155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.526+0000 7f52c5467640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c015e840 0x7f52c00b7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.526+0000 7f52c5467640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f52c015ec20 con 0x7f52c00cf3b0 2024-09-11T22:18:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.526+0000 7f52c5467640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52c006bed0 con 0x7f52c00cdd50 2024-09-11T22:18:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.526+0000 7f52c5467640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52c015eda0 con 0x7f52c015e840 2024-09-11T22:18:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.526+0000 7f52be7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c00cf3b0 0x7f52c0155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.526+0000 7f52beffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52c00cdd50 0x7f52c00b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.526+0000 7f52be7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c00cf3b0 0x7f52c0155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50842/0 (socket says 172.21.15.50:50842) 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.526+0000 7f52be7fc640 1 -- 172.21.15.50:0/2996530379 learned_addr learned my addr 172.21.15.50:0/2996530379 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.526+0000 7f52bf7fe640 1 --2- 172.21.15.50:0/2996530379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c015e840 0x7f52c00b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.527+0000 7f52be7fc640 1 -- 172.21.15.50:0/2996530379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c015e840 msgr2=0x7f52c00b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.527+0000 7f52be7fc640 1 --2- 172.21.15.50:0/2996530379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c015e840 0x7f52c00b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.527+0000 7f52be7fc640 1 -- 172.21.15.50:0/2996530379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52c00cdd50 msgr2=0x7f52c00b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.527+0000 7f52be7fc640 1 --2- 172.21.15.50:0/2996530379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52c00cdd50 0x7f52c00b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.527+0000 7f52be7fc640 1 -- 172.21.15.50:0/2996530379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c00b55f0 con 0x7f52c00cf3b0 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.527+0000 7f52be7fc640 1 --2- 172.21.15.50:0/2996530379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c00cf3b0 0x7f52c0155b70 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f52b4000c00 tx=0x7f52b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.527+0000 7f52a77fe640 1 -- 172.21.15.50:0/2996530379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4037040 con 0x7f52c00cf3b0 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.527+0000 7f52a77fe640 1 -- 172.21.15.50:0/2996530379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b4042070 con 0x7f52c00cf3b0 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.527+0000 7f52c5467640 1 -- 172.21.15.50:0/2996530379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c00b82c0 con 0x7f52c00cf3b0 2024-09-11T22:18:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.527+0000 7f52a77fe640 1 -- 172.21.15.50:0/2996530379 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4030880 con 0x7f52c00cf3b0 2024-09-11T22:18:14.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.527+0000 7f52c5467640 1 -- 172.21.15.50:0/2996530379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c01560b0 con 0x7f52c00cf3b0 2024-09-11T22:18:14.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.528+0000 7f52c5467640 1 -- 172.21.15.50:0/2996530379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c0070f30 con 0x7f52c00cf3b0 2024-09-11T22:18:14.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.529+0000 7f52a77fe640 1 -- 172.21.15.50:0/2996530379 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52b4030a20 con 0x7f52c00cf3b0 2024-09-11T22:18:14.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.529+0000 7f52a77fe640 1 --2- 172.21.15.50:0/2996530379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52ac06be60 0x7f52ac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:14.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.529+0000 7f52a77fe640 1 -- 172.21.15.50:0/2996530379 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5609+0+0 (secure 0 0 0) 0x7f52b40ab580 con 0x7f52c00cf3b0 2024-09-11T22:18:14.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.530+0000 7f52beffd640 1 --2- 172.21.15.50:0/2996530379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52ac06be60 0x7f52ac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:14.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.530+0000 7f52beffd640 1 --2- 172.21.15.50:0/2996530379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52ac06be60 0x7f52ac06e320 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f52b0009560 tx=0x7f52b0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:14.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.534+0000 7f52a77fe640 1 -- 172.21.15.50:0/2996530379 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52c0070f30 con 0x7f52c00cf3b0 2024-09-11T22:18:14.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:14.746+0000 7f52c5467640 1 -- 172.21.15.50:0/2996530379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f52c00cee70 con 0x7f52c00cf3b0 2024-09-11T22:18:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.378+0000 7f52a77fe640 1 -- 172.21.15.50:0/2996530379 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v82) ==== 174+0+0 (secure 0 0 0) 0x7f52b40798a0 con 0x7f52c00cf3b0 2024-09-11T22:18:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 16 and data pool 17 2024-09-11T22:18:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.382+0000 7f52c5467640 1 -- 172.21.15.50:0/2996530379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52ac06be60 msgr2=0x7f52ac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.382+0000 7f52c5467640 1 --2- 172.21.15.50:0/2996530379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52ac06be60 0x7f52ac06e320 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f52b0009560 tx=0x7f52b0009190 comp rx=0 tx=0).stop 2024-09-11T22:18:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.382+0000 7f52c5467640 1 -- 172.21.15.50:0/2996530379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c00cf3b0 msgr2=0x7f52c0155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.382+0000 7f52c5467640 1 --2- 172.21.15.50:0/2996530379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c00cf3b0 0x7f52c0155b70 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f52b4000c00 tx=0x7f52b40046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.382+0000 7f52c5467640 1 -- 172.21.15.50:0/2996530379 shutdown_connections 2024-09-11T22:18:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.382+0000 7f52c5467640 1 --2- 172.21.15.50:0/2996530379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52ac06be60 0x7f52ac06e320 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.382+0000 7f52c5467640 1 --2- 172.21.15.50:0/2996530379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c015e840 0x7f52c00b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.382+0000 7f52c5467640 1 --2- 172.21.15.50:0/2996530379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c00cf3b0 0x7f52c0155b70 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.382+0000 7f52c5467640 1 --2- 172.21.15.50:0/2996530379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52c00cdd50 0x7f52c00b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.382+0000 7f52c5467640 1 -- 172.21.15.50:0/2996530379 >> 172.21.15.50:0/2996530379 conn(0x7f52c00b4150 msgr2=0x7f52c0070620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.382+0000 7f52c5467640 1 -- 172.21.15.50:0/2996530379 shutdown_connections 2024-09-11T22:18:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.382+0000 7f52c5467640 1 -- 172.21.15.50:0/2996530379 wait complete. 2024-09-11T22:18:15.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:18:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.521+0000 7f02f1282640 1 Processor -- start 2024-09-11T22:18:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.521+0000 7f02f1282640 1 -- start start 2024-09-11T22:18:15.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.522+0000 7f02f1282640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02ec15b400 0x7f02ec06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.522+0000 7f02f1282640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02ec06e0f0 0x7f02ec0711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.522+0000 7f02f1282640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02ec15b7e0 con 0x7f02ec072e60 2024-09-11T22:18:15.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.522+0000 7f02f1282640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f02ec15f140 con 0x7f02ec06e0f0 2024-09-11T22:18:15.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.522+0000 7f02f1282640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f02ec15f420 con 0x7f02ec15b400 2024-09-11T22:18:15.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.522+0000 7f02eb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02ec06e0f0 0x7f02ec0711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.522+0000 7f02eb7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02ec06e0f0 0x7f02ec0711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50856/0 (socket says 172.21.15.50:50856) 2024-09-11T22:18:15.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.522+0000 7f02eb7fe640 1 -- 172.21.15.50:0/1095807765 learned_addr learned my addr 172.21.15.50:0/1095807765 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:15.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.522+0000 7f02eb7fe640 1 -- 172.21.15.50:0/1095807765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02ec15b400 msgr2=0x7f02ec06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:15.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.522+0000 7f02eaffd640 1 --2- 172.21.15.50:0/1095807765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02ec15b400 0x7f02ec06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.522+0000 7f02eb7fe640 1 --2- 172.21.15.50:0/1095807765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02ec15b400 0x7f02ec06d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.522+0000 7f02eb7fe640 1 -- 172.21.15.50:0/1095807765 >> v1:172.21.15.77:6789/0 conn(0x7f02ec072e60 legacy=0x7f02ec06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:15.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.522+0000 7f02eb7fe640 1 -- 172.21.15.50:0/1095807765 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ec15f700 con 0x7f02ec06e0f0 2024-09-11T22:18:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.523+0000 7f02eb7fe640 1 --2- 172.21.15.50:0/1095807765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02ec06e0f0 0x7f02ec0711c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00d150 tx=0x7f02dc02c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9720f43e8c84fc21 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.523+0000 7f02e9ffb640 1 -- 172.21.15.50:0/1095807765 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc00b2e0 con 0x7f02ec06e0f0 2024-09-11T22:18:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.523+0000 7f02e9ffb640 1 -- 172.21.15.50:0/1095807765 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02dc009600 con 0x7f02ec06e0f0 2024-09-11T22:18:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.523+0000 7f02e9ffb640 1 -- 172.21.15.50:0/1095807765 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc00b480 con 0x7f02ec06e0f0 2024-09-11T22:18:15.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.524+0000 7f02f1282640 1 -- 172.21.15.50:0/1095807765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02ec06e0f0 msgr2=0x7f02ec0711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.524+0000 7f02f1282640 1 --2- 172.21.15.50:0/1095807765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02ec06e0f0 0x7f02ec0711c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00d150 tx=0x7f02dc02c8e0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.524+0000 7f02f1282640 1 -- 172.21.15.50:0/1095807765 shutdown_connections 2024-09-11T22:18:15.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.524+0000 7f02f1282640 1 --2- 172.21.15.50:0/1095807765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02ec06e0f0 0x7f02ec0711c0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.524+0000 7f02f1282640 1 --2- 172.21.15.50:0/1095807765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02ec15b400 0x7f02ec06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.524+0000 7f02f1282640 1 -- 172.21.15.50:0/1095807765 >> 172.21.15.50:0/1095807765 conn(0x7f02ec0679c0 msgr2=0x7f02ec067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:15.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.524+0000 7f02f1282640 1 -- 172.21.15.50:0/1095807765 shutdown_connections 2024-09-11T22:18:15.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.524+0000 7f02f1282640 1 -- 172.21.15.50:0/1095807765 wait complete. 2024-09-11T22:18:15.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.525+0000 7f02f1282640 1 Processor -- start 2024-09-11T22:18:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.525+0000 7f02f1282640 1 -- start start 2024-09-11T22:18:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02f1282640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02ec06e0f0 0x7f02ec154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02f1282640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02ec072e60 0x7f02ec1f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02f1282640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02ec15b400 0x7f02ec1f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02f1282640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec071700 con 0x7f02ec072e60 2024-09-11T22:18:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02f1282640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec0cfc50 con 0x7f02ec15b400 2024-09-11T22:18:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02f1282640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f02ec071880 con 0x7f02ec06e0f0 2024-09-11T22:18:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02ea7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02ec072e60 0x7f02ec1f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02ea7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02ec072e60 0x7f02ec1f3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50858/0 (socket says 172.21.15.50:50858) 2024-09-11T22:18:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02ea7fc640 1 -- 172.21.15.50:0/3554492549 learned_addr learned my addr 172.21.15.50:0/3554492549 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02eaffd640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02ec06e0f0 0x7f02ec154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02eb7fe640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02ec15b400 0x7f02ec1f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02ea7fc640 1 -- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02ec06e0f0 msgr2=0x7f02ec154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02ea7fc640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02ec06e0f0 0x7f02ec154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02ea7fc640 1 -- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02ec15b400 msgr2=0x7f02ec1f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02ea7fc640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02ec15b400 0x7f02ec1f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.526+0000 7f02ea7fc640 1 -- 172.21.15.50:0/3554492549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ec0b00b0 con 0x7f02ec072e60 2024-09-11T22:18:15.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.527+0000 7f02ea7fc640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02ec072e60 0x7f02ec1f3b70 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f02d400c440 tx=0x7f02d400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:15.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.527+0000 7f02e37fe640 1 -- 172.21.15.50:0/3554492549 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d4007020 con 0x7f02ec072e60 2024-09-11T22:18:15.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.527+0000 7f02e37fe640 1 -- 172.21.15.50:0/3554492549 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d40071c0 con 0x7f02ec072e60 2024-09-11T22:18:15.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.527+0000 7f02f1282640 1 -- 172.21.15.50:0/3554492549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02ec15e450 con 0x7f02ec072e60 2024-09-11T22:18:15.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.527+0000 7f02e37fe640 1 -- 172.21.15.50:0/3554492549 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d40075b0 con 0x7f02ec072e60 2024-09-11T22:18:15.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.527+0000 7f02f1282640 1 -- 172.21.15.50:0/3554492549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02ec15ea10 con 0x7f02ec072e60 2024-09-11T22:18:15.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.528+0000 7f02f1282640 1 -- 172.21.15.50:0/3554492549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02ec0711c0 con 0x7f02ec072e60 2024-09-11T22:18:15.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.529+0000 7f02e37fe640 1 -- 172.21.15.50:0/3554492549 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02d4019020 con 0x7f02ec072e60 2024-09-11T22:18:15.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.529+0000 7f02e37fe640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02cc06be30 0x7f02cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.529+0000 7f02e37fe640 1 -- 172.21.15.50:0/3554492549 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5709+0+0 (secure 0 0 0) 0x7f02d408a440 con 0x7f02ec072e60 2024-09-11T22:18:15.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.530+0000 7f02eaffd640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02cc06be30 0x7f02cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.530+0000 7f02eaffd640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02cc06be30 0x7f02cc06e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f02ec15d300 tx=0x7f02e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:15.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.533+0000 7f02e37fe640 1 -- 172.21.15.50:0/3554492549 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02ec0b00b0 con 0x7f02ec072e60 2024-09-11T22:18:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.713+0000 7f02f1282640 1 -- 172.21.15.50:0/3554492549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02ec069ba0 con 0x7f02ec072e60 2024-09-11T22:18:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.714+0000 7f02e37fe640 1 -- 172.21.15.50:0/3554492549 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16664 (secure 0 0 0) 0x7f02d4058830 con 0x7f02ec072e60 2024-09-11T22:18:15.716 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:15.716 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":119,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:18:14.748590+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:18:12.405607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-11T22:18:13.770508+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:18:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.716+0000 7f02f1282640 1 -- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02cc06be30 msgr2=0x7f02cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.716+0000 7f02f1282640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02cc06be30 0x7f02cc06e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f02ec15d300 tx=0x7f02e4008040 comp rx=0 tx=0).stop 2024-09-11T22:18:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.716+0000 7f02f1282640 1 -- 172.21.15.50:0/3554492549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02ec072e60 msgr2=0x7f02ec1f3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.716+0000 7f02f1282640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02ec072e60 0x7f02ec1f3b70 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f02d400c440 tx=0x7f02d400c900 comp rx=0 tx=0).stop 2024-09-11T22:18:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.716+0000 7f02f1282640 1 -- 172.21.15.50:0/3554492549 shutdown_connections 2024-09-11T22:18:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.716+0000 7f02f1282640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02cc06be30 0x7f02cc06e2f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.716+0000 7f02f1282640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02ec15b400 0x7f02ec1f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.716+0000 7f02f1282640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02ec072e60 0x7f02ec1f3b70 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.716+0000 7f02f1282640 1 --2- 172.21.15.50:0/3554492549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02ec06e0f0 0x7f02ec154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.716+0000 7f02f1282640 1 -- 172.21.15.50:0/3554492549 >> 172.21.15.50:0/3554492549 conn(0x7f02ec0679c0 msgr2=0x7f02ec157df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.716+0000 7f02f1282640 1 -- 172.21.15.50:0/3554492549 shutdown_connections 2024-09-11T22:18:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.716+0000 7f02f1282640 1 -- 172.21.15.50:0/3554492549 wait complete. 2024-09-11T22:18:15.729 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:18:15.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.831+0000 7fecb23b0640 1 Processor -- start 2024-09-11T22:18:15.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.831+0000 7fecb23b0640 1 -- start start 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.832+0000 7fecb23b0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fecac0d18a0 0x7fecac0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.832+0000 7fecb23b0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecac0d3a30 0x7fecac0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.832+0000 7fecb23b0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecac0cfa80 con 0x7fecac15e870 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.832+0000 7fecb23b0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fecac0d3ea0 con 0x7fecac0d18a0 2024-09-11T22:18:15.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.832+0000 7fecb23b0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fecac0d40d0 con 0x7fecac0d3a30 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.832+0000 7feca3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fecac0d18a0 0x7fecac0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.832+0000 7feca3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fecac0d18a0 0x7fecac0d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50864/0 (socket says 172.21.15.50:50864) 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.832+0000 7feca3fff640 1 -- 172.21.15.50:0/1167513665 learned_addr learned my addr 172.21.15.50:0/1167513665 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.832+0000 7fecb094d640 1 --2- 172.21.15.50:0/1167513665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecac0d3a30 0x7fecac0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.832+0000 7feca3fff640 1 -- 172.21.15.50:0/1167513665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecac0d3a30 msgr2=0x7fecac0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.832+0000 7feca3fff640 1 --2- 172.21.15.50:0/1167513665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecac0d3a30 0x7fecac0b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.832+0000 7feca3fff640 1 -- 172.21.15.50:0/1167513665 >> v1:172.21.15.77:6789/0 conn(0x7fecac15e870 legacy=0x7fecac0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.833+0000 7feca3fff640 1 -- 172.21.15.50:0/1167513665 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecac0d43b0 con 0x7fecac0d18a0 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.833+0000 7feca3fff640 1 --2- 172.21.15.50:0/1167513665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecac0d18a0 0x7fecac0d34f0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fecac06c860 tx=0x7fec9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff6b6c5dcd97fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.833+0000 7fecab7fe640 1 -- 172.21.15.50:0/1167513665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94037070 con 0x7fecac0d18a0 2024-09-11T22:18:15.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.833+0000 7fecab7fe640 1 -- 172.21.15.50:0/1167513665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec94032440 con 0x7fecac0d18a0 2024-09-11T22:18:15.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.833+0000 7fecab7fe640 1 -- 172.21.15.50:0/1167513665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94032810 con 0x7fecac0d18a0 2024-09-11T22:18:15.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.834+0000 7fecb23b0640 1 -- 172.21.15.50:0/1167513665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecac0d18a0 msgr2=0x7fecac0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.834+0000 7fecb23b0640 1 --2- 172.21.15.50:0/1167513665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecac0d18a0 0x7fecac0d34f0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fecac06c860 tx=0x7fec9402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.834+0000 7fecb23b0640 1 -- 172.21.15.50:0/1167513665 shutdown_connections 2024-09-11T22:18:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.834+0000 7fecb23b0640 1 --2- 172.21.15.50:0/1167513665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecac0d3a30 0x7fecac0b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.834+0000 7fecb23b0640 1 --2- 172.21.15.50:0/1167513665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecac0d18a0 0x7fecac0d34f0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.834+0000 7fecb23b0640 1 -- 172.21.15.50:0/1167513665 >> 172.21.15.50:0/1167513665 conn(0x7fecac0727a0 msgr2=0x7fecac0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.834+0000 7fecb23b0640 1 -- 172.21.15.50:0/1167513665 shutdown_connections 2024-09-11T22:18:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.834+0000 7fecb23b0640 1 -- 172.21.15.50:0/1167513665 wait complete. 2024-09-11T22:18:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.835+0000 7fecb23b0640 1 Processor -- start 2024-09-11T22:18:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.835+0000 7fecb23b0640 1 -- start start 2024-09-11T22:18:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7fecb23b0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecac0d18a0 0x7fecac0cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7fecb23b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecac0d3a30 0x7fecac15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7fecb23b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecac15e870 0x7fecac0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7fecb23b0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fecac15ec50 con 0x7fecac0d3a30 2024-09-11T22:18:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7fecb23b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fecac0b7ee0 con 0x7fecac15e870 2024-09-11T22:18:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7fecb23b0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fecac0b78b0 con 0x7fecac0d18a0 2024-09-11T22:18:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7feca3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecac0d3a30 0x7fecac15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7feca3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecac0d3a30 0x7fecac15cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50876/0 (socket says 172.21.15.50:50876) 2024-09-11T22:18:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7feca3fff640 1 -- 172.21.15.50:0/1039952198 learned_addr learned my addr 172.21.15.50:0/1039952198 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7fecabfff640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecac0d18a0 0x7fecac0cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7fecb094d640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecac15e870 0x7fecac0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7feca3fff640 1 -- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecac0d18a0 msgr2=0x7fecac0cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7feca3fff640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecac0d18a0 0x7fecac0cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7feca3fff640 1 -- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecac15e870 msgr2=0x7fecac0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.836+0000 7feca3fff640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecac15e870 0x7fecac0ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.837+0000 7feca3fff640 1 -- 172.21.15.50:0/1039952198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecac15d0b0 con 0x7fecac0d3a30 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.837+0000 7fecb094d640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecac15e870 0x7fecac0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.837+0000 7feca3fff640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecac0d3a30 0x7fecac15cb70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fec94000c00 tx=0x7fec940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.837+0000 7feca97fa640 1 -- 172.21.15.50:0/1039952198 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94041020 con 0x7fecac0d3a30 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.837+0000 7feca97fa640 1 -- 172.21.15.50:0/1039952198 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec940306c0 con 0x7fecac0d3a30 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.837+0000 7fecb23b0640 1 -- 172.21.15.50:0/1039952198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecac0ccc30 con 0x7fecac0d3a30 2024-09-11T22:18:15.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.837+0000 7feca97fa640 1 -- 172.21.15.50:0/1039952198 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94037040 con 0x7fecac0d3a30 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.837+0000 7fecb23b0640 1 -- 172.21.15.50:0/1039952198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecac0b5f90 con 0x7fecac0d3a30 2024-09-11T22:18:15.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.838+0000 7fecb23b0640 1 -- 172.21.15.50:0/1039952198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecac0d34f0 con 0x7fecac0d3a30 2024-09-11T22:18:15.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.839+0000 7feca97fa640 1 -- 172.21.15.50:0/1039952198 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec94044020 con 0x7fecac0d3a30 2024-09-11T22:18:15.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.839+0000 7feca97fa640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec8c06be30 0x7fec8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:15.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.839+0000 7feca97fa640 1 -- 172.21.15.50:0/1039952198 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5709+0+0 (secure 0 0 0) 0x7fec940ab660 con 0x7fecac0d3a30 2024-09-11T22:18:15.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.839+0000 7fecabfff640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec8c06be30 0x7fec8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:15.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.840+0000 7fecabfff640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec8c06be30 0x7fec8c06e2f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fec9c004f60 tx=0x7fec9c007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:15.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:15.843+0000 7feca97fa640 1 -- 172.21.15.50:0/1039952198 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec9404b030 con 0x7fecac0d3a30 2024-09-11T22:18:16.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.020+0000 7fecb23b0640 1 -- 172.21.15.50:0/1039952198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecac067a60 con 0x7fecac0d3a30 2024-09-11T22:18:16.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.022+0000 7feca97fa640 1 -- 172.21.15.50:0/1039952198 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16664 (secure 0 0 0) 0x7fecac0cfa80 con 0x7fecac0d3a30 2024-09-11T22:18:16.024 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:16.024 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":119,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:18:14.748590+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:18:12.405607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-11T22:18:13.770508+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:18:16.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.024+0000 7fecb23b0640 1 -- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec8c06be30 msgr2=0x7fec8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:16.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.024+0000 7fecb23b0640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec8c06be30 0x7fec8c06e2f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fec9c004f60 tx=0x7fec9c007e30 comp rx=0 tx=0).stop 2024-09-11T22:18:16.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.024+0000 7fecb23b0640 1 -- 172.21.15.50:0/1039952198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecac0d3a30 msgr2=0x7fecac15cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:16.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.024+0000 7fecb23b0640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecac0d3a30 0x7fecac15cb70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fec94000c00 tx=0x7fec940046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:16.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.024+0000 7fecb23b0640 1 -- 172.21.15.50:0/1039952198 shutdown_connections 2024-09-11T22:18:16.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.024+0000 7fecb23b0640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fec8c06be30 0x7fec8c06e2f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:16.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.024+0000 7fecb23b0640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecac15e870 0x7fecac0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:16.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.024+0000 7fecb23b0640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecac0d3a30 0x7fecac15cb70 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:16.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.024+0000 7fecb23b0640 1 --2- 172.21.15.50:0/1039952198 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecac0d18a0 0x7fecac0cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:16.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.024+0000 7fecb23b0640 1 -- 172.21.15.50:0/1039952198 >> 172.21.15.50:0/1039952198 conn(0x7fecac0727a0 msgr2=0x7fecac0b9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:16.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.024+0000 7fecb23b0640 1 -- 172.21.15.50:0/1039952198 shutdown_connections 2024-09-11T22:18:16.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.024+0000 7fecb23b0640 1 -- 172.21.15.50:0/1039952198 wait complete. 2024-09-11T22:18:16.038 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:18:16.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.142+0000 7f9351fcf640 1 Processor -- start 2024-09-11T22:18:16.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.142+0000 7f9351fcf640 1 -- start start 2024-09-11T22:18:16.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.142+0000 7f9351fcf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f934c15e870 0x7f934c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:16.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.142+0000 7f9351fcf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f934c0d3c00 0x7f934c0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:16.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f9351fcf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934c0cfa80 con 0x7f934c0d16d0 2024-09-11T22:18:16.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f9351fcf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f934c0d1b40 con 0x7f934c15e870 2024-09-11T22:18:16.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f9351fcf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f934c0d40d0 con 0x7f934c0d3c00 2024-09-11T22:18:16.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f934b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f934c15e870 0x7f934c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:16.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f934affd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f934c0d16d0 0x7f934c0d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51278/0 (socket says 172.21.15.50:51278) 2024-09-11T22:18:16.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f934b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f934c15e870 0x7f934c0d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50886/0 (socket says 172.21.15.50:50886) 2024-09-11T22:18:16.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f934affd640 1 -- 172.21.15.50:0/2351487500 learned_addr learned my addr 172.21.15.50:0/2351487500 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:16.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f934bfff640 1 --2- 172.21.15.50:0/2351487500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f934c0d3c00 0x7f934c0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:16.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f934b7fe640 1 -- 172.21.15.50:0/2351487500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f934c0d3c00 msgr2=0x7f934c0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:16.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f934b7fe640 1 --2- 172.21.15.50:0/2351487500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f934c0d3c00 0x7f934c0b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:16.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f934b7fe640 1 -- 172.21.15.50:0/2351487500 >> v1:172.21.15.50:6789/0 conn(0x7f934c0d16d0 legacy=0x7f934c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:16.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f934a7fc640 1 -- 172.21.15.50:0/2351487500 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 556408546 0 0) 0x7f9340001110 con 0x7f934c0d16d0 2024-09-11T22:18:16.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f934b7fe640 1 -- 172.21.15.50:0/2351487500 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c0d43b0 con 0x7f934c15e870 2024-09-11T22:18:16.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.143+0000 7f934bfff640 1 --2- 172.21.15.50:0/2351487500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f934c0d3c00 0x7f934c0b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:16.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.144+0000 7f934b7fe640 1 --2- 172.21.15.50:0/2351487500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c15e870 0x7f934c0d1190 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f933c0097a0 tx=0x7f933c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a82e6cd26090f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:16.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.144+0000 7f934a7fc640 1 -- 172.21.15.50:0/2351487500 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c037070 con 0x7f934c15e870 2024-09-11T22:18:16.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.144+0000 7f934a7fc640 1 -- 172.21.15.50:0/2351487500 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933c032440 con 0x7f934c15e870 2024-09-11T22:18:16.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.144+0000 7f934a7fc640 1 -- 172.21.15.50:0/2351487500 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c032810 con 0x7f934c15e870 2024-09-11T22:18:16.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.144+0000 7f9351fcf640 1 -- 172.21.15.50:0/2351487500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c15e870 msgr2=0x7f934c0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:16.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.144+0000 7f9351fcf640 1 --2- 172.21.15.50:0/2351487500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c15e870 0x7f934c0d1190 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f933c0097a0 tx=0x7f933c02a180 comp rx=0 tx=0).stop 2024-09-11T22:18:16.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.144+0000 7f9351fcf640 1 -- 172.21.15.50:0/2351487500 shutdown_connections 2024-09-11T22:18:16.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.144+0000 7f9351fcf640 1 --2- 172.21.15.50:0/2351487500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f934c0d3c00 0x7f934c0b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:16.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.144+0000 7f9351fcf640 1 --2- 172.21.15.50:0/2351487500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c15e870 0x7f934c0d1190 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:16.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.144+0000 7f9351fcf640 1 -- 172.21.15.50:0/2351487500 >> 172.21.15.50:0/2351487500 conn(0x7f934c0727a0 msgr2=0x7f934c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:16.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.145+0000 7f9351fcf640 1 -- 172.21.15.50:0/2351487500 shutdown_connections 2024-09-11T22:18:16.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.145+0000 7f9351fcf640 1 -- 172.21.15.50:0/2351487500 wait complete. 2024-09-11T22:18:16.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.146+0000 7f9351fcf640 1 Processor -- start 2024-09-11T22:18:16.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.146+0000 7f9351fcf640 1 -- start start 2024-09-11T22:18:16.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f9351fcf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f934c0d16d0 0x7f934c1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:16.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f9351fcf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f934c0d3c00 0x7f934c153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:16.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f9351fcf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c15e870 0x7f934c1e9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:16.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f9351fcf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f934c15ec50 con 0x7f934c15e870 2024-09-11T22:18:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f9351fcf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f934c0b7ee0 con 0x7f934c0d16d0 2024-09-11T22:18:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f9351fcf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f934c0b78b0 con 0x7f934c0d3c00 2024-09-11T22:18:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f934bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c15e870 0x7f934c1e9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f934bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c15e870 0x7f934c1e9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50900/0 (socket says 172.21.15.50:50900) 2024-09-11T22:18:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f934bfff640 1 -- 172.21.15.50:0/1735762146 learned_addr learned my addr 172.21.15.50:0/1735762146 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f934affd640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f934c0d3c00 0x7f934c153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f934b7fe640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f934c0d16d0 0x7f934c1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f934bfff640 1 -- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f934c0d3c00 msgr2=0x7f934c153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f934bfff640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f934c0d3c00 0x7f934c153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f934bfff640 1 -- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f934c0d16d0 msgr2=0x7f934c1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f934bfff640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f934c0d16d0 0x7f934c1548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f934bfff640 1 -- 172.21.15.50:0/1735762146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c1616c0 con 0x7f934c15e870 2024-09-11T22:18:16.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f934b7fe640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f934c0d16d0 0x7f934c1548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:16.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f934affd640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f934c0d3c00 0x7f934c153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:16.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f934bfff640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c15e870 0x7f934c1e9290 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f934400ceb0 tx=0x7f934400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:16.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f9333fff640 1 -- 172.21.15.50:0/1735762146 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934401a070 con 0x7f934c15e870 2024-09-11T22:18:16.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.147+0000 7f9333fff640 1 -- 172.21.15.50:0/1735762146 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f934400d840 con 0x7f934c15e870 2024-09-11T22:18:16.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.148+0000 7f9351fcf640 1 -- 172.21.15.50:0/1735762146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934c160620 con 0x7f934c15e870 2024-09-11T22:18:16.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.148+0000 7f9333fff640 1 -- 172.21.15.50:0/1735762146 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934400dc30 con 0x7f934c15e870 2024-09-11T22:18:16.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.148+0000 7f9351fcf640 1 -- 172.21.15.50:0/1735762146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934c160be0 con 0x7f934c15e870 2024-09-11T22:18:16.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.149+0000 7f9351fcf640 1 -- 172.21.15.50:0/1735762146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934c0d1190 con 0x7f934c15e870 2024-09-11T22:18:16.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.149+0000 7f9333fff640 1 -- 172.21.15.50:0/1735762146 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f934401d070 con 0x7f934c15e870 2024-09-11T22:18:16.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.150+0000 7f9333fff640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f933806be60 0x7f933806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:16.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.150+0000 7f9333fff640 1 -- 172.21.15.50:0/1735762146 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5709+0+0 (secure 0 0 0) 0x7f934408b620 con 0x7f934c15e870 2024-09-11T22:18:16.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.150+0000 7f934b7fe640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f933806be60 0x7f933806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:16.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.151+0000 7f934b7fe640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f933806be60 0x7f933806e320 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f933c034000 tx=0x7f933c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:16.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.154+0000 7f9333fff640 1 -- 172.21.15.50:0/1735762146 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f934405a060 con 0x7f934c15e870 2024-09-11T22:18:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:16.365+0000 7f9351fcf640 1 -- 172.21.15.50:0/1735762146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f934c15dd60 con 0x7f934c15e870 2024-09-11T22:18:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.029+0000 7f9333fff640 1 -- 172.21.15.50:0/1735762146 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v84) ==== 118+0+0 (secure 0 0 0) 0x7f9344059960 con 0x7f934c15e870 2024-09-11T22:18:17.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.032+0000 7f9351fcf640 1 -- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f933806be60 msgr2=0x7f933806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.032+0000 7f9351fcf640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f933806be60 0x7f933806e320 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f933c034000 tx=0x7f933c02e000 comp rx=0 tx=0).stop 2024-09-11T22:18:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.032+0000 7f9351fcf640 1 -- 172.21.15.50:0/1735762146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c15e870 msgr2=0x7f934c1e9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.032+0000 7f9351fcf640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c15e870 0x7f934c1e9290 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f934400ceb0 tx=0x7f934400a710 comp rx=0 tx=0).stop 2024-09-11T22:18:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.032+0000 7f9351fcf640 1 -- 172.21.15.50:0/1735762146 shutdown_connections 2024-09-11T22:18:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.032+0000 7f9351fcf640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f933806be60 0x7f933806e320 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.032+0000 7f9351fcf640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f934c0d3c00 0x7f934c153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.032+0000 7f9351fcf640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c15e870 0x7f934c1e9290 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.032+0000 7f9351fcf640 1 --2- 172.21.15.50:0/1735762146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f934c0d16d0 0x7f934c1548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.032+0000 7f9351fcf640 1 -- 172.21.15.50:0/1735762146 >> 172.21.15.50:0/1735762146 conn(0x7f934c0727a0 msgr2=0x7f934c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.032+0000 7f9351fcf640 1 -- 172.21.15.50:0/1735762146 shutdown_connections 2024-09-11T22:18:17.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.032+0000 7f9351fcf640 1 -- 172.21.15.50:0/1735762146 wait complete. 2024-09-11T22:18:17.047 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:18:17.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:18:17.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.159+0000 7f3f9c381640 1 Processor -- start 2024-09-11T22:18:17.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.159+0000 7f3f9c381640 1 -- start start 2024-09-11T22:18:17.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.160+0000 7f3f9c381640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f9415e8e0 0x7f3f940b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.160+0000 7f3f9c381640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f940d1580 0x7f3f940d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.160+0000 7f3f9c381640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f940d1ee0 con 0x7f3f94162350 2024-09-11T22:18:17.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.160+0000 7f3f9c381640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f3f9415ecc0 con 0x7f3f940d1580 2024-09-11T22:18:17.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.160+0000 7f3f9c381640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3f940d2ad0 con 0x7f3f9415e8e0 2024-09-11T22:18:17.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.160+0000 7f3f9991c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f940d1580 0x7f3f940d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.160+0000 7f3f9991c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f940d1580 0x7f3f940d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50908/0 (socket says 172.21.15.50:50908) 2024-09-11T22:18:17.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.160+0000 7f3f9991c640 1 -- 172.21.15.50:0/2670725981 learned_addr learned my addr 172.21.15.50:0/2670725981 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:17.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.160+0000 7f3f9a11d640 1 --2- 172.21.15.50:0/2670725981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f9415e8e0 0x7f3f940b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.160+0000 7f3f9991c640 1 -- 172.21.15.50:0/2670725981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f9415e8e0 msgr2=0x7f3f940b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:17.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.160+0000 7f3f9991c640 1 --2- 172.21.15.50:0/2670725981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f9415e8e0 0x7f3f940b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.160+0000 7f3f9991c640 1 -- 172.21.15.50:0/2670725981 >> v1:172.21.15.77:6789/0 conn(0x7f3f94162350 legacy=0x7f3f94162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.160+0000 7f3f9991c640 1 -- 172.21.15.50:0/2670725981 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f94163080 con 0x7f3f940d1580 2024-09-11T22:18:17.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.161+0000 7f3f9991c640 1 --2- 172.21.15.50:0/2670725981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940d1580 0x7f3f940d19a0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009870 tx=0x7f3f8402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637317f6a489bf02 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:17.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.161+0000 7f3f9911b640 1 -- 172.21.15.50:0/2670725981 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84037070 con 0x7f3f940d1580 2024-09-11T22:18:17.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.161+0000 7f3f9911b640 1 -- 172.21.15.50:0/2670725981 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f8402ae50 con 0x7f3f940d1580 2024-09-11T22:18:17.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.161+0000 7f3f9911b640 1 -- 172.21.15.50:0/2670725981 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84032860 con 0x7f3f940d1580 2024-09-11T22:18:17.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.162+0000 7f3f9c381640 1 -- 172.21.15.50:0/2670725981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940d1580 msgr2=0x7f3f940d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.162+0000 7f3f9c381640 1 --2- 172.21.15.50:0/2670725981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940d1580 0x7f3f940d19a0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009870 tx=0x7f3f8402a300 comp rx=0 tx=0).stop 2024-09-11T22:18:17.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.162+0000 7f3f9c381640 1 -- 172.21.15.50:0/2670725981 shutdown_connections 2024-09-11T22:18:17.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.162+0000 7f3f9c381640 1 --2- 172.21.15.50:0/2670725981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940d1580 0x7f3f940d19a0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.162+0000 7f3f9c381640 1 --2- 172.21.15.50:0/2670725981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f9415e8e0 0x7f3f940b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.162+0000 7f3f9c381640 1 -- 172.21.15.50:0/2670725981 >> 172.21.15.50:0/2670725981 conn(0x7f3f94067ba0 msgr2=0x7f3f94067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:17.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.162+0000 7f3f9c381640 1 -- 172.21.15.50:0/2670725981 shutdown_connections 2024-09-11T22:18:17.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.162+0000 7f3f9c381640 1 -- 172.21.15.50:0/2670725981 wait complete. 2024-09-11T22:18:17.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.163+0000 7f3f9c381640 1 Processor -- start 2024-09-11T22:18:17.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.163+0000 7f3f9c381640 1 -- start start 2024-09-11T22:18:17.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9c381640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940d1580 0x7f3f940b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9c381640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f9415e8e0 0x7f3f940cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9c381640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f94162350 0x7f3f940ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9c381640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f940d3000 con 0x7f3f940d1580 2024-09-11T22:18:17.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9c381640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f940d3370 con 0x7f3f9415e8e0 2024-09-11T22:18:17.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9c381640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3f940d3800 con 0x7f3f94162350 2024-09-11T22:18:17.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9a11d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940d1580 0x7f3f940b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9a11d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940d1580 0x7f3f940b6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50916/0 (socket says 172.21.15.50:50916) 2024-09-11T22:18:17.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9a11d640 1 -- 172.21.15.50:0/1695817760 learned_addr learned my addr 172.21.15.50:0/1695817760 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:17.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9a11d640 1 -- 172.21.15.50:0/1695817760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f94162350 msgr2=0x7f3f940ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9a11d640 1 --2- 172.21.15.50:0/1695817760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f94162350 0x7f3f940ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9a11d640 1 -- 172.21.15.50:0/1695817760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f9415e8e0 msgr2=0x7f3f940cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:17.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9a11d640 1 --2- 172.21.15.50:0/1695817760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f9415e8e0 0x7f3f940cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:17.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9a11d640 1 -- 172.21.15.50:0/1695817760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9415cf40 con 0x7f3f940d1580 2024-09-11T22:18:17.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9a11d640 1 --2- 172.21.15.50:0/1695817760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940d1580 0x7f3f940b6690 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000d800 tx=0x7f3f9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:17.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f8affd640 1 -- 172.21.15.50:0/1695817760 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000b6c0 con 0x7f3f940d1580 2024-09-11T22:18:17.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f8affd640 1 -- 172.21.15.50:0/1695817760 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f90019070 con 0x7f3f940d1580 2024-09-11T22:18:17.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9c381640 1 -- 172.21.15.50:0/1695817760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f940ce7a0 con 0x7f3f940d1580 2024-09-11T22:18:17.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f8affd640 1 -- 172.21.15.50:0/1695817760 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000bac0 con 0x7f3f940d1580 2024-09-11T22:18:17.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.164+0000 7f3f9c381640 1 -- 172.21.15.50:0/1695817760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f941e8770 con 0x7f3f940d1580 2024-09-11T22:18:17.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.165+0000 7f3f9c381640 1 -- 172.21.15.50:0/1695817760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f941e8020 con 0x7f3f940d1580 2024-09-11T22:18:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.166+0000 7f3f8affd640 1 -- 172.21.15.50:0/1695817760 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f9000bc60 con 0x7f3f940d1580 2024-09-11T22:18:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.166+0000 7f3f8affd640 1 --2- 172.21.15.50:0/1695817760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f7806be30 0x7f3f7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.166+0000 7f3f8affd640 1 -- 172.21.15.50:0/1695817760 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f3f9008b380 con 0x7f3f940d1580 2024-09-11T22:18:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.167+0000 7f3f9991c640 1 --2- 172.21.15.50:0/1695817760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f7806be30 0x7f3f7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.167+0000 7f3f9991c640 1 --2- 172.21.15.50:0/1695817760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f7806be30 0x7f3f7806e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3f84034000 tx=0x7f3f8402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:17.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.171+0000 7f3f8affd640 1 -- 172.21.15.50:0/1695817760 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f90059d20 con 0x7f3f940d1580 2024-09-11T22:18:17.374 INFO:tasks.ceph.mds.d.smithi077.stderr:2024-09-11T22:18:17.374+0000 7f41aa779640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:18:17.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:17.380+0000 7f3f9c381640 1 -- 172.21.15.50:0/1695817760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3f940d19a0 con 0x7f3f940d1580 2024-09-11T22:18:18.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.030+0000 7f3f8affd640 1 -- 172.21.15.50:0/1695817760 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v85) ==== 122+0+0 (secure 0 0 0) 0x7f3f90059620 con 0x7f3f940d1580 2024-09-11T22:18:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.034+0000 7f3f9c381640 1 -- 172.21.15.50:0/1695817760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f7806be30 msgr2=0x7f3f7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.034+0000 7f3f9c381640 1 --2- 172.21.15.50:0/1695817760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f7806be30 0x7f3f7806e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3f84034000 tx=0x7f3f8402c000 comp rx=0 tx=0).stop 2024-09-11T22:18:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.034+0000 7f3f9c381640 1 -- 172.21.15.50:0/1695817760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940d1580 msgr2=0x7f3f940b6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.034+0000 7f3f9c381640 1 --2- 172.21.15.50:0/1695817760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940d1580 0x7f3f940b6690 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000d800 tx=0x7f3f9000dcc0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.034+0000 7f3f9c381640 1 -- 172.21.15.50:0/1695817760 shutdown_connections 2024-09-11T22:18:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.034+0000 7f3f9c381640 1 --2- 172.21.15.50:0/1695817760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3f7806be30 0x7f3f7806e2f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.034+0000 7f3f9c381640 1 --2- 172.21.15.50:0/1695817760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f94162350 0x7f3f940ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.034+0000 7f3f9c381640 1 --2- 172.21.15.50:0/1695817760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f9415e8e0 0x7f3f940cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.034+0000 7f3f9c381640 1 --2- 172.21.15.50:0/1695817760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f940d1580 0x7f3f940b6690 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.034+0000 7f3f9c381640 1 -- 172.21.15.50:0/1695817760 >> 172.21.15.50:0/1695817760 conn(0x7f3f94067ba0 msgr2=0x7f3f94160880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.034+0000 7f3f9c381640 1 -- 172.21.15.50:0/1695817760 shutdown_connections 2024-09-11T22:18:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.034+0000 7f3f9c381640 1 -- 172.21.15.50:0/1695817760 wait complete. 2024-09-11T22:18:18.049 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:18:18.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:18:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.156+0000 7fcd0112a640 1 Processor -- start 2024-09-11T22:18:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.156+0000 7fcd0112a640 1 -- start start 2024-09-11T22:18:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.157+0000 7fcd0112a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccfc15e8e0 0x7fccfc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.157+0000 7fcd0112a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccfc163080 con 0x7fccfc0d1580 2024-09-11T22:18:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.157+0000 7fcd0112a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccfc0d2d20 con 0x7fccfc162350 2024-09-11T22:18:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.157+0000 7fcd0112a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fccfc15ecc0 con 0x7fccfc15e8e0 2024-09-11T22:18:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.157+0000 7fccfa59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fccfc0d1580 0x7fccfc0d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46322/0 (socket says 172.21.15.50:46322) 2024-09-11T22:18:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.157+0000 7fccfa59c640 1 -- 172.21.15.50:0/3555528443 learned_addr learned my addr 172.21.15.50:0/3555528443 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.157+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345026273 0 0) 0x7fccfc163080 con 0x7fccfc0d1580 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.157+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcce4003520 con 0x7fccfc0d1580 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.157+0000 7fccfad9d640 1 --2- 172.21.15.50:0/3555528443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccfc15e8e0 0x7fccfc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3265705835 0 0) 0x7fcce4003520 con 0x7fccfc0d1580 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccfc15e8e0 msgr2=0x7fccfc0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccf9d9b640 1 --2- 172.21.15.50:0/3555528443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccfc15e8e0 0x7fccfc0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 >> v1:172.21.15.77:6789/0 conn(0x7fccfc162350 legacy=0x7fccfc162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccfc0d3000 con 0x7fccfc0d1580 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fccf0001670 con 0x7fccfc0d1580 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 >> v1:172.21.15.50:6789/0 conn(0x7fccfc0d1580 legacy=0x7fccfc0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccf9d9b640 1 --2- 172.21.15.50:0/3555528443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccfc15e8e0 0x7fcce40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccf9d9b640 1 --2- 172.21.15.50:0/3555528443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce4003f20 0x7fcce4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccf9d9b640 1 --2- 172.21.15.50:0/3555528443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcce4004d40 0x7fcce40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcce400b9f0 con 0x7fcce4004d40 2024-09-11T22:18:18.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcce400bba0 con 0x7fcce4003f20 2024-09-11T22:18:18.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcce400bda0 con 0x7fccfc15e8e0 2024-09-11T22:18:18.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccfb59e640 1 --2- 172.21.15.50:0/3555528443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcce4004d40 0x7fcce40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccfad9d640 1 --2- 172.21.15.50:0/3555528443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccfc15e8e0 0x7fcce40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccfa59c640 1 --2- 172.21.15.50:0/3555528443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce4003f20 0x7fcce4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccfb59e640 1 -- 172.21.15.50:0/3555528443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccfc15e8e0 msgr2=0x7fcce40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:18.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccfb59e640 1 --2- 172.21.15.50:0/3555528443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccfc15e8e0 0x7fcce40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccfb59e640 1 -- 172.21.15.50:0/3555528443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce4003f20 msgr2=0x7fcce4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:18.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccfb59e640 1 --2- 172.21.15.50:0/3555528443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcce4003f20 0x7fcce4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.158+0000 7fccfb59e640 1 -- 172.21.15.50:0/3555528443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce4003520 con 0x7fcce4004d40 2024-09-11T22:18:18.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.159+0000 7fccfb59e640 1 --2- 172.21.15.50:0/3555528443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcce4004d40 0x7fcce40051c0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fccf4001f60 tx=0x7fcce4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952190b348c2964 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:18.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.159+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf4001b30 con 0x7fcce4004d40 2024-09-11T22:18:18.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.159+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccf4031620 con 0x7fcce4004d40 2024-09-11T22:18:18.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.159+0000 7fccf9d9b640 1 -- 172.21.15.50:0/3555528443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf4031a10 con 0x7fcce4004d40 2024-09-11T22:18:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.160+0000 7fcd0112a640 1 -- 172.21.15.50:0/3555528443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcce4004d40 msgr2=0x7fcce40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.160+0000 7fcd0112a640 1 --2- 172.21.15.50:0/3555528443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcce4004d40 0x7fcce40051c0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fccf4001f60 tx=0x7fcce4005830 comp rx=0 tx=0).stop 2024-09-11T22:18:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.160+0000 7fccfb59e640 1 -- 172.21.15.50:0/3555528443 reap_dead start 2024-09-11T22:18:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.160+0000 7fcd0112a640 1 -- 172.21.15.50:0/3555528443 shutdown_connections 2024-09-11T22:18:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.160+0000 7fcd0112a640 1 -- 172.21.15.50:0/3555528443 >> 172.21.15.50:0/3555528443 conn(0x7fccfc067ba0 msgr2=0x7fccfc067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.160+0000 7fcd0112a640 1 -- 172.21.15.50:0/3555528443 shutdown_connections 2024-09-11T22:18:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.160+0000 7fcd0112a640 1 -- 172.21.15.50:0/3555528443 wait complete. 2024-09-11T22:18:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.161+0000 7fcd0112a640 1 Processor -- start 2024-09-11T22:18:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.161+0000 7fcd0112a640 1 -- start start 2024-09-11T22:18:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fcd0112a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcce4004d40 0x7fccfc0ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fcd0112a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccfc1f4f70 0x7fccfc150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fcd0112a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccfc1f5410 0x7fccfc0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fcd0112a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc0b7c10 con 0x7fccfc1f4f70 2024-09-11T22:18:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fcd0112a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc0b7a90 con 0x7fccfc1f5410 2024-09-11T22:18:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fcd0112a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fccfc0d2ad0 con 0x7fcce4004d40 2024-09-11T22:18:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fccfa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccfc1f4f70 0x7fccfc150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fccfa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccfc1f4f70 0x7fccfc150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56234/0 (socket says 172.21.15.50:56234) 2024-09-11T22:18:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fccfa59c640 1 -- 172.21.15.50:0/505537395 learned_addr learned my addr 172.21.15.50:0/505537395 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fccfb59e640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccfc1f5410 0x7fccfc0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fccfad9d640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcce4004d40 0x7fccfc0ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fccfa59c640 1 -- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcce4004d40 msgr2=0x7fccfc0ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fccfa59c640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcce4004d40 0x7fccfc0ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fccfa59c640 1 -- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccfc1f5410 msgr2=0x7fccfc0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fccfa59c640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccfc1f5410 0x7fccfc0b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.162+0000 7fccfa59c640 1 -- 172.21.15.50:0/505537395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccfc0cb8c0 con 0x7fccfc1f4f70 2024-09-11T22:18:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.163+0000 7fccfa59c640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccfc1f4f70 0x7fccfc150b00 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fccf0007290 tx=0x7fccf0007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.163+0000 7fcce37fe640 1 -- 172.21.15.50:0/505537395 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf000f8e0 con 0x7fccfc1f4f70 2024-09-11T22:18:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.163+0000 7fcce37fe640 1 -- 172.21.15.50:0/505537395 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccf0018070 con 0x7fccfc1f4f70 2024-09-11T22:18:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.163+0000 7fcd0112a640 1 -- 172.21.15.50:0/505537395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccfc0cbba0 con 0x7fccfc1f4f70 2024-09-11T22:18:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.163+0000 7fcce37fe640 1 -- 172.21.15.50:0/505537395 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf000fce0 con 0x7fccfc1f4f70 2024-09-11T22:18:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.163+0000 7fcd0112a640 1 -- 172.21.15.50:0/505537395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccfc0cc160 con 0x7fccfc1f4f70 2024-09-11T22:18:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.164+0000 7fcd0112a640 1 -- 172.21.15.50:0/505537395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccfc0d19a0 con 0x7fccfc1f4f70 2024-09-11T22:18:18.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.164+0000 7fcce37fe640 1 -- 172.21.15.50:0/505537395 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fccf001d460 con 0x7fccfc1f4f70 2024-09-11T22:18:18.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.165+0000 7fcce37fe640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcce806be30 0x7fcce806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.165+0000 7fcce37fe640 1 -- 172.21.15.50:0/505537395 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fccf008ae20 con 0x7fccfc1f4f70 2024-09-11T22:18:18.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.165+0000 7fccfad9d640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcce806be30 0x7fcce806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.166+0000 7fccfad9d640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcce806be30 0x7fcce806e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fccec009bc0 tx=0x7fccec009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:18.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.170+0000 7fcce37fe640 1 -- 172.21.15.50:0/505537395 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fccf00597d0 con 0x7fccfc1f4f70 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.382+0000 7fcd0112a640 1 -- 172.21.15.50:0/505537395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccfc0b3ab0 con 0x7fccfc1f4f70 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.382+0000 7fcce37fe640 1 -- 172.21.15.50:0/505537395 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5225 (secure 0 0 0) 0x7fccf00590d0 con 0x7fccfc1f4f70 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"btime":"2024-09-11T22:18:18:030997+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1864699161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1864699161},{"type":"v1","addr":"172.21.15.77:6835","nonce":1864699161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3677751855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3677751855},{"type":"v1","addr":"172.21.15.50:6834","nonce":3677751855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7315,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2276588552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2276588552},{"type":"v1","addr":"172.21.15.50:6835","nonce":2276588552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:18:14.748913+0000","modified":"2024-09-11T22:18:17.383059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7324":{"gid":7324,"name":"d","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1480049118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1480049118},{"type":"v1","addr":"172.21.15.77:6837","nonce":1480049118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7324,"qdb_cluster":[7324]},"id":8}]} 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.384+0000 7fcd0112a640 1 -- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcce806be30 msgr2=0x7fcce806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.384+0000 7fcd0112a640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcce806be30 0x7fcce806e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fccec009bc0 tx=0x7fccec009190 comp rx=0 tx=0).stop 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.384+0000 7fcd0112a640 1 -- 172.21.15.50:0/505537395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccfc1f4f70 msgr2=0x7fccfc150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.384+0000 7fcd0112a640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccfc1f4f70 0x7fccfc150b00 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fccf0007290 tx=0x7fccf0007690 comp rx=0 tx=0).stop 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.384+0000 7fcd0112a640 1 -- 172.21.15.50:0/505537395 shutdown_connections 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.384+0000 7fcd0112a640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcce806be30 0x7fcce806e2f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.384+0000 7fcd0112a640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccfc1f5410 0x7fccfc0b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.384+0000 7fcd0112a640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccfc1f4f70 0x7fccfc150b00 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.384+0000 7fcd0112a640 1 --2- 172.21.15.50:0/505537395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcce4004d40 0x7fccfc0ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.384+0000 7fcd0112a640 1 -- 172.21.15.50:0/505537395 >> 172.21.15.50:0/505537395 conn(0x7fccfc067ba0 msgr2=0x7fccfc069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.384+0000 7fcd0112a640 1 -- 172.21.15.50:0/505537395 shutdown_connections 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.384+0000 7fcd0112a640 1 -- 172.21.15.50:0/505537395 wait complete. 2024-09-11T22:18:18.396 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:18:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.498+0000 7feb5e398640 1 Processor -- start 2024-09-11T22:18:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.498+0000 7feb5e398640 1 -- start start 2024-09-11T22:18:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.499+0000 7feb5e398640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb5815c3c0 0x7feb5815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.499+0000 7feb5e398640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb580680d0 0x7feb5815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.499+0000 7feb5e398640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5815f7f0 con 0x7feb5815ec40 2024-09-11T22:18:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.499+0000 7feb5e398640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7feb5806e700 con 0x7feb580680d0 2024-09-11T22:18:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.499+0000 7feb5e398640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7feb5815fad0 con 0x7feb5815c3c0 2024-09-11T22:18:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.499+0000 7feb5c935640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb580680d0 0x7feb5815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.499+0000 7feb5c935640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb580680d0 0x7feb5815f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56242/0 (socket says 172.21.15.50:56242) 2024-09-11T22:18:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.499+0000 7feb5c935640 1 -- 172.21.15.50:0/2350094684 learned_addr learned my addr 172.21.15.50:0/2350094684 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.500+0000 7feb57fff640 1 --2- 172.21.15.50:0/2350094684 >> v2:172.21.15.77:3300/0 conn(0x7feb5815c3c0 0x7feb5815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.500+0000 7feb5c935640 1 -- 172.21.15.50:0/2350094684 >> v2:172.21.15.77:3300/0 conn(0x7feb5815c3c0 msgr2=0x7feb5815fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.500+0000 7feb5c935640 1 --2- 172.21.15.50:0/2350094684 >> v2:172.21.15.77:3300/0 conn(0x7feb5815c3c0 0x7feb5815fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.500+0000 7feb5c935640 1 -- 172.21.15.50:0/2350094684 >> v1:172.21.15.77:6789/0 conn(0x7feb5815ec40 legacy=0x7feb580679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.500+0000 7feb5c935640 1 -- 172.21.15.50:0/2350094684 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5806e950 con 0x7feb580680d0 2024-09-11T22:18:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.500+0000 7feb5c935640 1 --2- 172.21.15.50:0/2350094684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb580680d0 0x7feb5815f0b0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7feb58071b10 tx=0x7feb5002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed7a9d8464249f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.501+0000 7feb577fe640 1 -- 172.21.15.50:0/2350094684 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50036070 con 0x7feb580680d0 2024-09-11T22:18:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.501+0000 7feb577fe640 1 -- 172.21.15.50:0/2350094684 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb50031600 con 0x7feb580680d0 2024-09-11T22:18:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.501+0000 7feb577fe640 1 -- 172.21.15.50:0/2350094684 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb500319d0 con 0x7feb580680d0 2024-09-11T22:18:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.501+0000 7feb5e398640 1 -- 172.21.15.50:0/2350094684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb580680d0 msgr2=0x7feb5815f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.501+0000 7feb5e398640 1 --2- 172.21.15.50:0/2350094684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb580680d0 0x7feb5815f0b0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7feb58071b10 tx=0x7feb5002a6a0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.501+0000 7feb5e398640 1 -- 172.21.15.50:0/2350094684 shutdown_connections 2024-09-11T22:18:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.501+0000 7feb5e398640 1 --2- 172.21.15.50:0/2350094684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb580680d0 0x7feb5815f0b0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.501+0000 7feb5e398640 1 --2- 172.21.15.50:0/2350094684 >> v2:172.21.15.77:3300/0 conn(0x7feb5815c3c0 0x7feb5815fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.501+0000 7feb5e398640 1 -- 172.21.15.50:0/2350094684 >> 172.21.15.50:0/2350094684 conn(0x7feb58075060 msgr2=0x7feb5806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.501+0000 7feb5e398640 1 -- 172.21.15.50:0/2350094684 shutdown_connections 2024-09-11T22:18:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.501+0000 7feb5e398640 1 -- 172.21.15.50:0/2350094684 wait complete. 2024-09-11T22:18:18.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.502+0000 7feb5e398640 1 Processor -- start 2024-09-11T22:18:18.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.502+0000 7feb5e398640 1 -- start start 2024-09-11T22:18:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.503+0000 7feb5e398640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb580680d0 0x7feb58158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.503+0000 7feb5e398640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb5815c3c0 0x7feb580cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.503+0000 7feb5e398640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb5815ec40 0x7feb580ab530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.503+0000 7feb5e398640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feb5806f150 con 0x7feb5815ec40 2024-09-11T22:18:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.503+0000 7feb5e398640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feb580d0940 con 0x7feb580680d0 2024-09-11T22:18:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.503+0000 7feb5e398640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7feb5806f2d0 con 0x7feb5815c3c0 2024-09-11T22:18:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.503+0000 7feb5c935640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb5815ec40 0x7feb580ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.503+0000 7feb5c935640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb5815ec40 0x7feb580ab530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56256/0 (socket says 172.21.15.50:56256) 2024-09-11T22:18:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.503+0000 7feb5c935640 1 -- 172.21.15.50:0/3443312960 learned_addr learned my addr 172.21.15.50:0/3443312960 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.503+0000 7feb57fff640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb580680d0 0x7feb58158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.503+0000 7feb4ffff640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb5815c3c0 0x7feb580cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.504+0000 7feb5c935640 1 -- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb5815c3c0 msgr2=0x7feb580cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.504+0000 7feb5c935640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb5815c3c0 0x7feb580cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.504+0000 7feb5c935640 1 -- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb580680d0 msgr2=0x7feb58158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.504+0000 7feb5c935640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb580680d0 0x7feb58158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.504+0000 7feb5c935640 1 -- 172.21.15.50:0/3443312960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb580cb8c0 con 0x7feb5815ec40 2024-09-11T22:18:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.504+0000 7feb4ffff640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb5815c3c0 0x7feb580cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.504+0000 7feb5c935640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb5815ec40 0x7feb580ab530 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7feb50009f40 tx=0x7feb50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.504+0000 7feb557fa640 1 -- 172.21.15.50:0/3443312960 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50036050 con 0x7feb5815ec40 2024-09-11T22:18:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.504+0000 7feb557fa640 1 -- 172.21.15.50:0/3443312960 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb50042070 con 0x7feb5815ec40 2024-09-11T22:18:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.504+0000 7feb557fa640 1 -- 172.21.15.50:0/3443312960 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50009510 con 0x7feb5815ec40 2024-09-11T22:18:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.504+0000 7feb5e398640 1 -- 172.21.15.50:0/3443312960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb580cbba0 con 0x7feb5815ec40 2024-09-11T22:18:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.504+0000 7feb5e398640 1 -- 172.21.15.50:0/3443312960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb580cc160 con 0x7feb5815ec40 2024-09-11T22:18:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.505+0000 7feb5e398640 1 -- 172.21.15.50:0/3443312960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb5815fe60 con 0x7feb5815ec40 2024-09-11T22:18:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.506+0000 7feb557fa640 1 -- 172.21.15.50:0/3443312960 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb50007c70 con 0x7feb5815ec40 2024-09-11T22:18:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.506+0000 7feb557fa640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feb3806be30 0x7feb3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.506+0000 7feb557fa640 1 -- 172.21.15.50:0/3443312960 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7feb500abbf0 con 0x7feb5815ec40 2024-09-11T22:18:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.506+0000 7feb57fff640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feb3806be30 0x7feb3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.507+0000 7feb57fff640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feb3806be30 0x7feb3806e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7feb48009b40 tx=0x7feb48009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.511+0000 7feb557fa640 1 -- 172.21.15.50:0/3443312960 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb5007a630 con 0x7feb5815ec40 2024-09-11T22:18:18.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.686+0000 7feb5e398640 1 -- 172.21.15.50:0/3443312960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb58161d90 con 0x7feb5815ec40 2024-09-11T22:18:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.687+0000 7feb557fa640 1 -- 172.21.15.50:0/3443312960 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+16651 (secure 0 0 0) 0x7feb50079f30 con 0x7feb5815ec40 2024-09-11T22:18:18.688 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:18.688 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":120,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:18:16.390342+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:18:12.405607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-11T22:18:13.770508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:18:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.689+0000 7feb5e398640 1 -- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feb3806be30 msgr2=0x7feb3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.689+0000 7feb5e398640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feb3806be30 0x7feb3806e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7feb48009b40 tx=0x7feb48009190 comp rx=0 tx=0).stop 2024-09-11T22:18:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.689+0000 7feb5e398640 1 -- 172.21.15.50:0/3443312960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb5815ec40 msgr2=0x7feb580ab530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.689+0000 7feb5e398640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb5815ec40 0x7feb580ab530 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7feb50009f40 tx=0x7feb50004a40 comp rx=0 tx=0).stop 2024-09-11T22:18:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.689+0000 7feb5e398640 1 -- 172.21.15.50:0/3443312960 shutdown_connections 2024-09-11T22:18:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.689+0000 7feb5e398640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feb3806be30 0x7feb3806e2f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.689+0000 7feb5e398640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb5815c3c0 0x7feb580cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.689+0000 7feb5e398640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb5815ec40 0x7feb580ab530 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.689+0000 7feb5e398640 1 --2- 172.21.15.50:0/3443312960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb580680d0 0x7feb58158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.689+0000 7feb5e398640 1 -- 172.21.15.50:0/3443312960 >> 172.21.15.50:0/3443312960 conn(0x7feb58075060 msgr2=0x7feb5815a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.689+0000 7feb5e398640 1 -- 172.21.15.50:0/3443312960 shutdown_connections 2024-09-11T22:18:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.689+0000 7feb5e398640 1 -- 172.21.15.50:0/3443312960 wait complete. 2024-09-11T22:18:18.701 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:18:18.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:18:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.803+0000 7f545dfb7640 1 Processor -- start 2024-09-11T22:18:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.803+0000 7f545dfb7640 1 -- start start 2024-09-11T22:18:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.803+0000 7f545dfb7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f545815c2c0 0x7f54580b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.803+0000 7f545dfb7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f54580d05e0 0x7f54580ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.803+0000 7f545dfb7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54580b4f00 con 0x7f54580b3e10 2024-09-11T22:18:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.803+0000 7f545dfb7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f54580b4360 con 0x7f545815c2c0 2024-09-11T22:18:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.803+0000 7f545dfb7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f54580b51c0 con 0x7f54580d05e0 2024-09-11T22:18:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.804+0000 7f54577fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f545815c2c0 0x7f54580b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.804+0000 7f544effd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f54580b3e10 0x7f54580cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46324/0 (socket says 172.21.15.50:46324) 2024-09-11T22:18:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.804+0000 7f544effd640 1 -- 172.21.15.50:0/2363410174 learned_addr learned my addr 172.21.15.50:0/2363410174 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.804+0000 7f5457fff640 1 --2- 172.21.15.50:0/2363410174 >> v2:172.21.15.77:3300/0 conn(0x7f54580d05e0 0x7f54580ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.804+0000 7f54577fe640 1 -- 172.21.15.50:0/2363410174 >> v2:172.21.15.77:3300/0 conn(0x7f54580d05e0 msgr2=0x7f54580ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.804+0000 7f54577fe640 1 --2- 172.21.15.50:0/2363410174 >> v2:172.21.15.77:3300/0 conn(0x7f54580d05e0 0x7f54580ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.804+0000 7f54577fe640 1 -- 172.21.15.50:0/2363410174 >> v1:172.21.15.50:6789/0 conn(0x7f54580b3e10 legacy=0x7f54580cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.804+0000 7f54577fe640 1 -- 172.21.15.50:0/2363410174 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54580b54a0 con 0x7f545815c2c0 2024-09-11T22:18:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.804+0000 7f5456ffd640 1 -- 172.21.15.50:0/2363410174 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1614053380 0 0) 0x7f54580b4f00 con 0x7f54580b3e10 2024-09-11T22:18:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.804+0000 7f5457fff640 1 --2- 172.21.15.50:0/2363410174 >> v2:172.21.15.77:3300/0 conn(0x7f54580d05e0 0x7f54580ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.805+0000 7f54577fe640 1 --2- 172.21.15.50:0/2363410174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f545815c2c0 0x7f54580b46a0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f54580b4260 tx=0x7f544802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837977d72971fb8d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.805+0000 7f5456ffd640 1 -- 172.21.15.50:0/2363410174 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5448037070 con 0x7f545815c2c0 2024-09-11T22:18:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.805+0000 7f5456ffd640 1 -- 172.21.15.50:0/2363410174 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5448032440 con 0x7f545815c2c0 2024-09-11T22:18:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.805+0000 7f5456ffd640 1 -- 172.21.15.50:0/2363410174 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5448032810 con 0x7f545815c2c0 2024-09-11T22:18:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.805+0000 7f545dfb7640 1 -- 172.21.15.50:0/2363410174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f545815c2c0 msgr2=0x7f54580b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.805+0000 7f545dfb7640 1 --2- 172.21.15.50:0/2363410174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f545815c2c0 0x7f54580b46a0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f54580b4260 tx=0x7f544802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.805+0000 7f545dfb7640 1 -- 172.21.15.50:0/2363410174 shutdown_connections 2024-09-11T22:18:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.805+0000 7f545dfb7640 1 --2- 172.21.15.50:0/2363410174 >> v2:172.21.15.77:3300/0 conn(0x7f54580d05e0 0x7f54580ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.805+0000 7f545dfb7640 1 --2- 172.21.15.50:0/2363410174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f545815c2c0 0x7f54580b46a0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.805+0000 7f545dfb7640 1 -- 172.21.15.50:0/2363410174 >> 172.21.15.50:0/2363410174 conn(0x7f54580679c0 msgr2=0x7f5458067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.805+0000 7f545dfb7640 1 -- 172.21.15.50:0/2363410174 shutdown_connections 2024-09-11T22:18:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.806+0000 7f545dfb7640 1 -- 172.21.15.50:0/2363410174 wait complete. 2024-09-11T22:18:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.807+0000 7f545dfb7640 1 Processor -- start 2024-09-11T22:18:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.807+0000 7f545dfb7640 1 -- start start 2024-09-11T22:18:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f545dfb7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54580b3e10 0x7f54580acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f545dfb7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54580d05e0 0x7f54580ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f545dfb7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f545815c2c0 0x7f54581f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f545dfb7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f545806d070 con 0x7f54580d05e0 2024-09-11T22:18:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f545dfb7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f54580ce200 con 0x7f54580b3e10 2024-09-11T22:18:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f545dfb7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f545806d1f0 con 0x7f545815c2c0 2024-09-11T22:18:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f544effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54580d05e0 0x7f54580ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f544effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54580d05e0 0x7f54580ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56272/0 (socket says 172.21.15.50:56272) 2024-09-11T22:18:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f544effd640 1 -- 172.21.15.50:0/3586748052 learned_addr learned my addr 172.21.15.50:0/3586748052 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f54577fe640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54580b3e10 0x7f54580acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f5457fff640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f545815c2c0 0x7f54581f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f544effd640 1 -- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f545815c2c0 msgr2=0x7f54581f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f544effd640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f545815c2c0 0x7f54581f1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f544effd640 1 -- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54580b3e10 msgr2=0x7f54580acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f544effd640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54580b3e10 0x7f54580acc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f544effd640 1 -- 172.21.15.50:0/3586748052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54580ad980 con 0x7f54580d05e0 2024-09-11T22:18:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f54577fe640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54580b3e10 0x7f54580acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f544effd640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54580d05e0 0x7f54580ad150 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f544000c4d0 tx=0x7f544000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f5454ff9640 1 -- 172.21.15.50:0/3586748052 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5440018070 con 0x7f54580d05e0 2024-09-11T22:18:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f5454ff9640 1 -- 172.21.15.50:0/3586748052 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5440007500 con 0x7f54580d05e0 2024-09-11T22:18:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f545dfb7640 1 -- 172.21.15.50:0/3586748052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54580adc60 con 0x7f54580d05e0 2024-09-11T22:18:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.808+0000 7f5454ff9640 1 -- 172.21.15.50:0/3586748052 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5440004a20 con 0x7f54580d05e0 2024-09-11T22:18:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.809+0000 7f545dfb7640 1 -- 172.21.15.50:0/3586748052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54580ae220 con 0x7f54580d05e0 2024-09-11T22:18:18.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.810+0000 7f545dfb7640 1 -- 172.21.15.50:0/3586748052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545815c6a0 con 0x7f54580d05e0 2024-09-11T22:18:18.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.810+0000 7f5454ff9640 1 -- 172.21.15.50:0/3586748052 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f544001b070 con 0x7f54580d05e0 2024-09-11T22:18:18.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.811+0000 7f5454ff9640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f543806be60 0x7f543806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:18.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.811+0000 7f5454ff9640 1 -- 172.21.15.50:0/3586748052 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f544008a1b0 con 0x7f54580d05e0 2024-09-11T22:18:18.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.811+0000 7f54577fe640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f543806be60 0x7f543806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:18.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.811+0000 7f54577fe640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f543806be60 0x7f543806e320 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5448034000 tx=0x7f544802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:18.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.815+0000 7f5454ff9640 1 -- 172.21.15.50:0/3586748052 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5440058b60 con 0x7f54580d05e0 2024-09-11T22:18:18.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.986+0000 7f545dfb7640 1 -- 172.21.15.50:0/3586748052 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f54581522c0 con 0x7f543806be60 2024-09-11T22:18:18.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.992+0000 7f5454ff9640 1 -- 172.21.15.50:0/3586748052 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248174 (secure 0 0 0) 0x7f54581522c0 con 0x7f543806be60 2024-09-11T22:18:18.997 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:18:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.995+0000 7f545dfb7640 1 -- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f543806be60 msgr2=0x7f543806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.995+0000 7f545dfb7640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f543806be60 0x7f543806e320 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5448034000 tx=0x7f544802e000 comp rx=0 tx=0).stop 2024-09-11T22:18:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.995+0000 7f545dfb7640 1 -- 172.21.15.50:0/3586748052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54580d05e0 msgr2=0x7f54580ad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.995+0000 7f545dfb7640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54580d05e0 0x7f54580ad150 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f544000c4d0 tx=0x7f544000c990 comp rx=0 tx=0).stop 2024-09-11T22:18:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.995+0000 7f545dfb7640 1 -- 172.21.15.50:0/3586748052 shutdown_connections 2024-09-11T22:18:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.995+0000 7f545dfb7640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f543806be60 0x7f543806e320 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.995+0000 7f545dfb7640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f545815c2c0 0x7f54581f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.995+0000 7f545dfb7640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54580d05e0 0x7f54580ad150 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.995+0000 7f545dfb7640 1 --2- 172.21.15.50:0/3586748052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54580b3e10 0x7f54580acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.995+0000 7f545dfb7640 1 -- 172.21.15.50:0/3586748052 >> 172.21.15.50:0/3586748052 conn(0x7f54580679c0 msgr2=0x7f5458160770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.995+0000 7f545dfb7640 1 -- 172.21.15.50:0/3586748052 shutdown_connections 2024-09-11T22:18:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:18.995+0000 7f545dfb7640 1 -- 172.21.15.50:0/3586748052 wait complete. 2024-09-11T22:18:19.007 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-11T22:18:17.468201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":180,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":399452,"kb_used_data":12524,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754575268,"statfs":{"total":773094113280,"available":772685074432,"internally_reserved":0,"allocated":12824576,"data_stored":6258176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":396021297},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.094833"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.391419+0000","last_change":"2024-09-11T22:18:14.391419+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.391419+0000","last_undegraded":"2024-09-11T22:18:14.391419+0000","last_fullsized":"2024-09-11T22:18:14.391419+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.383030+0000","last_change":"2024-09-11T22:18:14.383030+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.383030+0000","last_undegraded":"2024-09-11T22:18:14.383030+0000","last_fullsized":"2024-09-11T22:18:14.383030+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082458+0000","last_change":"2024-09-11T22:18:15.404107+0000","last_active":"2024-09-11T22:18:17.082458+0000","last_peered":"2024-09-11T22:18:17.082458+0000","last_clean":"2024-09-11T22:18:17.082458+0000","last_became_active":"2024-09-11T22:18:15.403793+0000","last_became_peered":"2024-09-11T22:18:15.403793+0000","last_unstale":"2024-09-11T22:18:17.082458+0000","last_undegraded":"2024-09-11T22:18:17.082458+0000","last_fullsized":"2024-09-11T22:18:17.082458+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:00.201633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.389515+0000","last_change":"2024-09-11T22:18:14.389515+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.389515+0000","last_undegraded":"2024-09-11T22:18:14.389515+0000","last_fullsized":"2024-09-11T22:18:14.389515+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.394843+0000","last_change":"2024-09-11T22:18:15.391099+0000","last_active":"2024-09-11T22:18:15.394843+0000","last_peered":"2024-09-11T22:18:15.394843+0000","last_clean":"2024-09-11T22:18:15.394843+0000","last_became_active":"2024-09-11T22:18:15.390672+0000","last_became_peered":"2024-09-11T22:18:15.390672+0000","last_unstale":"2024-09-11T22:18:15.394843+0000","last_undegraded":"2024-09-11T22:18:15.394843+0000","last_fullsized":"2024-09-11T22:18:15.394843+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:05.504125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385085+0000","last_change":"2024-09-11T22:18:14.385085+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385085+0000","last_undegraded":"2024-09-11T22:18:14.385085+0000","last_fullsized":"2024-09-11T22:18:14.385085+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385248+0000","last_change":"2024-09-11T22:18:14.385248+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385248+0000","last_undegraded":"2024-09-11T22:18:14.385248+0000","last_fullsized":"2024-09-11T22:18:14.385248+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082119+0000","last_change":"2024-09-11T22:18:15.407146+0000","last_active":"2024-09-11T22:18:17.082119+0000","last_peered":"2024-09-11T22:18:17.082119+0000","last_clean":"2024-09-11T22:18:17.082119+0000","last_became_active":"2024-09-11T22:18:15.406866+0000","last_became_peered":"2024-09-11T22:18:15.406866+0000","last_unstale":"2024-09-11T22:18:17.082119+0000","last_undegraded":"2024-09-11T22:18:17.082119+0000","last_fullsized":"2024-09-11T22:18:17.082119+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:39.415424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.391022+0000","last_change":"2024-09-11T22:18:14.391022+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.391022+0000","last_undegraded":"2024-09-11T22:18:14.391022+0000","last_fullsized":"2024-09-11T22:18:14.391022+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.395127+0000","last_change":"2024-09-11T22:18:14.395127+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.395127+0000","last_undegraded":"2024-09-11T22:18:14.395127+0000","last_fullsized":"2024-09-11T22:18:14.395127+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.383540+0000","last_change":"2024-09-11T22:18:14.383540+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.383540+0000","last_undegraded":"2024-09-11T22:18:14.383540+0000","last_fullsized":"2024-09-11T22:18:14.383540+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.388541+0000","last_change":"2024-09-11T22:18:14.388541+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.388541+0000","last_undegraded":"2024-09-11T22:18:14.388541+0000","last_fullsized":"2024-09-11T22:18:14.388541+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082040+0000","last_change":"2024-09-11T22:18:15.401611+0000","last_active":"2024-09-11T22:18:17.082040+0000","last_peered":"2024-09-11T22:18:17.082040+0000","last_clean":"2024-09-11T22:18:17.082040+0000","last_became_active":"2024-09-11T22:18:15.401153+0000","last_became_peered":"2024-09-11T22:18:15.401153+0000","last_unstale":"2024-09-11T22:18:17.082040+0000","last_undegraded":"2024-09-11T22:18:17.082040+0000","last_fullsized":"2024-09-11T22:18:17.082040+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:49.865380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082235+0000","last_change":"2024-09-11T22:18:15.400570+0000","last_active":"2024-09-11T22:18:17.082235+0000","last_peered":"2024-09-11T22:18:17.082235+0000","last_clean":"2024-09-11T22:18:17.082235+0000","last_became_active":"2024-09-11T22:18:15.400292+0000","last_became_peered":"2024-09-11T22:18:15.400292+0000","last_unstale":"2024-09-11T22:18:17.082235+0000","last_undegraded":"2024-09-11T22:18:17.082235+0000","last_fullsized":"2024-09-11T22:18:17.082235+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:59.644890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.387227+0000","last_change":"2024-09-11T22:18:14.387227+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.387227+0000","last_undegraded":"2024-09-11T22:18:14.387227+0000","last_fullsized":"2024-09-11T22:18:14.387227+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386781+0000","last_change":"2024-09-11T22:18:14.386781+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386781+0000","last_undegraded":"2024-09-11T22:18:14.386781+0000","last_fullsized":"2024-09-11T22:18:14.386781+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386731+0000","last_change":"2024-09-11T22:18:14.386731+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386731+0000","last_undegraded":"2024-09-11T22:18:14.386731+0000","last_fullsized":"2024-09-11T22:18:14.386731+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386398+0000","last_change":"2024-09-11T22:18:14.386398+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386398+0000","last_undegraded":"2024-09-11T22:18:14.386398+0000","last_fullsized":"2024-09-11T22:18:14.386398+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082602+0000","last_change":"2024-09-11T22:18:15.401501+0000","last_active":"2024-09-11T22:18:17.082602+0000","last_peered":"2024-09-11T22:18:17.082602+0000","last_clean":"2024-09-11T22:18:17.082602+0000","last_became_active":"2024-09-11T22:18:15.401260+0000","last_became_peered":"2024-09-11T22:18:15.401260+0000","last_unstale":"2024-09-11T22:18:17.082602+0000","last_undegraded":"2024-09-11T22:18:17.082602+0000","last_fullsized":"2024-09-11T22:18:17.082602+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:28.302797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.383039+0000","last_change":"2024-09-11T22:18:14.383039+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.383039+0000","last_undegraded":"2024-09-11T22:18:14.383039+0000","last_fullsized":"2024-09-11T22:18:14.383039+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.382775+0000","last_change":"2024-09-11T22:18:14.382775+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.382775+0000","last_undegraded":"2024-09-11T22:18:14.382775+0000","last_fullsized":"2024-09-11T22:18:14.382775+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385000+0000","last_change":"2024-09-11T22:18:14.385000+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385000+0000","last_undegraded":"2024-09-11T22:18:14.385000+0000","last_fullsized":"2024-09-11T22:18:14.385000+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.383563+0000","last_change":"2024-09-11T22:18:14.383563+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.383563+0000","last_undegraded":"2024-09-11T22:18:14.383563+0000","last_fullsized":"2024-09-11T22:18:14.383563+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386929+0000","last_change":"2024-09-11T22:18:14.386929+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386929+0000","last_undegraded":"2024-09-11T22:18:14.386929+0000","last_fullsized":"2024-09-11T22:18:14.386929+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386301+0000","last_change":"2024-09-11T22:18:14.386301+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386301+0000","last_undegraded":"2024-09-11T22:18:14.386301+0000","last_fullsized":"2024-09-11T22:18:14.386301+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.394723+0000","last_change":"2024-09-11T22:18:14.394723+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.394723+0000","last_undegraded":"2024-09-11T22:18:14.394723+0000","last_fullsized":"2024-09-11T22:18:14.394723+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.387354+0000","last_change":"2024-09-11T22:18:14.387354+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.387354+0000","last_undegraded":"2024-09-11T22:18:14.387354+0000","last_fullsized":"2024-09-11T22:18:14.387354+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.387608+0000","last_change":"2024-09-11T22:18:14.387608+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.387608+0000","last_undegraded":"2024-09-11T22:18:14.387608+0000","last_fullsized":"2024-09-11T22:18:14.387608+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384511+0000","last_change":"2024-09-11T22:18:14.384511+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384511+0000","last_undegraded":"2024-09-11T22:18:14.384511+0000","last_fullsized":"2024-09-11T22:18:14.384511+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386084+0000","last_change":"2024-09-11T22:18:14.386084+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386084+0000","last_undegraded":"2024-09-11T22:18:14.386084+0000","last_fullsized":"2024-09-11T22:18:14.386084+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386101+0000","last_change":"2024-09-11T22:18:14.386101+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386101+0000","last_undegraded":"2024-09-11T22:18:14.386101+0000","last_fullsized":"2024-09-11T22:18:14.386101+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385633+0000","last_change":"2024-09-11T22:18:14.385633+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385633+0000","last_undegraded":"2024-09-11T22:18:14.385633+0000","last_fullsized":"2024-09-11T22:18:14.385633+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385431+0000","last_change":"2024-09-11T22:18:14.385431+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385431+0000","last_undegraded":"2024-09-11T22:18:14.385431+0000","last_fullsized":"2024-09-11T22:18:14.385431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394791+0000","last_change":"2024-09-11T22:18:14.392883+0000","last_active":"2024-09-11T22:18:14.394791+0000","last_peered":"2024-09-11T22:18:14.394791+0000","last_clean":"2024-09-11T22:18:14.394791+0000","last_became_active":"2024-09-11T22:18:14.392587+0000","last_became_peered":"2024-09-11T22:18:14.392587+0000","last_unstale":"2024-09-11T22:18:14.394791+0000","last_undegraded":"2024-09-11T22:18:14.394791+0000","last_fullsized":"2024-09-11T22:18:14.394791+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:29.635935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386482+0000","last_change":"2024-09-11T22:18:14.386482+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386482+0000","last_undegraded":"2024-09-11T22:18:14.386482+0000","last_fullsized":"2024-09-11T22:18:14.386482+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081902+0000","last_change":"2024-09-11T22:18:14.395419+0000","last_active":"2024-09-11T22:18:17.081902+0000","last_peered":"2024-09-11T22:18:17.081902+0000","last_clean":"2024-09-11T22:18:17.081902+0000","last_became_active":"2024-09-11T22:18:14.395085+0000","last_became_peered":"2024-09-11T22:18:14.395085+0000","last_unstale":"2024-09-11T22:18:17.081902+0000","last_undegraded":"2024-09-11T22:18:17.081902+0000","last_fullsized":"2024-09-11T22:18:17.081902+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:52.212295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385932+0000","last_change":"2024-09-11T22:18:14.385932+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385932+0000","last_undegraded":"2024-09-11T22:18:14.385932+0000","last_fullsized":"2024-09-11T22:18:14.385932+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.413307+0000","last_change":"2024-09-11T22:18:14.395434+0000","last_active":"2024-09-11T22:18:15.413307+0000","last_peered":"2024-09-11T22:18:15.413307+0000","last_clean":"2024-09-11T22:18:15.413307+0000","last_became_active":"2024-09-11T22:18:14.395167+0000","last_became_peered":"2024-09-11T22:18:14.395167+0000","last_unstale":"2024-09-11T22:18:15.413307+0000","last_undegraded":"2024-09-11T22:18:15.413307+0000","last_fullsized":"2024-09-11T22:18:15.413307+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.171196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082622+0000","last_change":"2024-09-11T22:18:15.406179+0000","last_active":"2024-09-11T22:18:17.082622+0000","last_peered":"2024-09-11T22:18:17.082622+0000","last_clean":"2024-09-11T22:18:17.082622+0000","last_became_active":"2024-09-11T22:18:15.405865+0000","last_became_peered":"2024-09-11T22:18:15.405865+0000","last_unstale":"2024-09-11T22:18:17.082622+0000","last_undegraded":"2024-09-11T22:18:17.082622+0000","last_fullsized":"2024-09-11T22:18:17.082622+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:23.941974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.413974+0000","last_change":"2024-09-11T22:18:14.393274+0000","last_active":"2024-09-11T22:18:15.413974+0000","last_peered":"2024-09-11T22:18:15.413974+0000","last_clean":"2024-09-11T22:18:15.413974+0000","last_became_active":"2024-09-11T22:18:14.392989+0000","last_became_peered":"2024-09-11T22:18:14.392989+0000","last_unstale":"2024-09-11T22:18:15.413974+0000","last_undegraded":"2024-09-11T22:18:15.413974+0000","last_fullsized":"2024-09-11T22:18:15.413974+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:23.415934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384176+0000","last_change":"2024-09-11T22:18:14.384176+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384176+0000","last_undegraded":"2024-09-11T22:18:14.384176+0000","last_fullsized":"2024-09-11T22:18:14.384176+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.390807+0000","last_change":"2024-09-11T22:18:14.389662+0000","last_active":"2024-09-11T22:18:14.390807+0000","last_peered":"2024-09-11T22:18:14.390807+0000","last_clean":"2024-09-11T22:18:14.390807+0000","last_became_active":"2024-09-11T22:18:14.389378+0000","last_became_peered":"2024-09-11T22:18:14.389378+0000","last_unstale":"2024-09-11T22:18:14.390807+0000","last_undegraded":"2024-09-11T22:18:14.390807+0000","last_fullsized":"2024-09-11T22:18:14.390807+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:50.431556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384136+0000","last_change":"2024-09-11T22:18:14.384136+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384136+0000","last_undegraded":"2024-09-11T22:18:14.384136+0000","last_fullsized":"2024-09-11T22:18:14.384136+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.392138+0000","last_change":"2024-09-11T22:18:14.391141+0000","last_active":"2024-09-11T22:18:14.392138+0000","last_peered":"2024-09-11T22:18:14.392138+0000","last_clean":"2024-09-11T22:18:14.392138+0000","last_became_active":"2024-09-11T22:18:14.390849+0000","last_became_peered":"2024-09-11T22:18:14.390849+0000","last_unstale":"2024-09-11T22:18:14.392138+0000","last_undegraded":"2024-09-11T22:18:14.392138+0000","last_fullsized":"2024-09-11T22:18:14.392138+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:09.073102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386381+0000","last_change":"2024-09-11T22:18:14.386381+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386381+0000","last_undegraded":"2024-09-11T22:18:14.386381+0000","last_fullsized":"2024-09-11T22:18:14.386381+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.392786+0000","last_change":"2024-09-11T22:18:14.392141+0000","last_active":"2024-09-11T22:18:14.392786+0000","last_peered":"2024-09-11T22:18:14.392786+0000","last_clean":"2024-09-11T22:18:14.392786+0000","last_became_active":"2024-09-11T22:18:14.391864+0000","last_became_peered":"2024-09-11T22:18:14.391864+0000","last_unstale":"2024-09-11T22:18:14.392786+0000","last_undegraded":"2024-09-11T22:18:14.392786+0000","last_fullsized":"2024-09-11T22:18:14.392786+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:45.199493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385664+0000","last_change":"2024-09-11T22:18:14.385664+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385664+0000","last_undegraded":"2024-09-11T22:18:14.385664+0000","last_fullsized":"2024-09-11T22:18:14.385664+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.401502+0000","last_change":"2024-09-11T22:18:14.400180+0000","last_active":"2024-09-11T22:18:14.401502+0000","last_peered":"2024-09-11T22:18:14.401502+0000","last_clean":"2024-09-11T22:18:14.401502+0000","last_became_active":"2024-09-11T22:18:14.399884+0000","last_became_peered":"2024-09-11T22:18:14.399884+0000","last_unstale":"2024-09-11T22:18:14.401502+0000","last_undegraded":"2024-09-11T22:18:14.401502+0000","last_fullsized":"2024-09-11T22:18:14.401502+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:44.455410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384643+0000","last_change":"2024-09-11T22:18:14.384643+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384643+0000","last_undegraded":"2024-09-11T22:18:14.384643+0000","last_fullsized":"2024-09-11T22:18:14.384643+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.382418+0000","last_change":"2024-09-11T22:18:14.394020+0000","last_active":"2024-09-11T22:18:15.382418+0000","last_peered":"2024-09-11T22:18:15.382418+0000","last_clean":"2024-09-11T22:18:15.382418+0000","last_became_active":"2024-09-11T22:18:14.393713+0000","last_became_peered":"2024-09-11T22:18:14.393713+0000","last_unstale":"2024-09-11T22:18:15.382418+0000","last_undegraded":"2024-09-11T22:18:15.382418+0000","last_fullsized":"2024-09-11T22:18:15.382418+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:38.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386038+0000","last_change":"2024-09-11T22:18:14.386038+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386038+0000","last_undegraded":"2024-09-11T22:18:14.386038+0000","last_fullsized":"2024-09-11T22:18:14.386038+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.392105+0000","last_change":"2024-09-11T22:18:14.390561+0000","last_active":"2024-09-11T22:18:14.392105+0000","last_peered":"2024-09-11T22:18:14.392105+0000","last_clean":"2024-09-11T22:18:14.392105+0000","last_became_active":"2024-09-11T22:18:14.390247+0000","last_became_peered":"2024-09-11T22:18:14.390247+0000","last_unstale":"2024-09-11T22:18:14.392105+0000","last_undegraded":"2024-09-11T22:18:14.392105+0000","last_fullsized":"2024-09-11T22:18:14.392105+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:19.364246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385251+0000","last_change":"2024-09-11T22:18:14.385251+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385251+0000","last_undegraded":"2024-09-11T22:18:14.385251+0000","last_fullsized":"2024-09-11T22:18:14.385251+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.403006+0000","last_change":"2024-09-11T22:18:14.402317+0000","last_active":"2024-09-11T22:18:14.403006+0000","last_peered":"2024-09-11T22:18:14.403006+0000","last_clean":"2024-09-11T22:18:14.403006+0000","last_became_active":"2024-09-11T22:18:14.401937+0000","last_became_peered":"2024-09-11T22:18:14.401937+0000","last_unstale":"2024-09-11T22:18:14.403006+0000","last_undegraded":"2024-09-11T22:18:14.403006+0000","last_fullsized":"2024-09-11T22:18:14.403006+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:19.364246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384410+0000","last_change":"2024-09-11T22:18:14.384410+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384410+0000","last_undegraded":"2024-09-11T22:18:14.384410+0000","last_fullsized":"2024-09-11T22:18:14.384410+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.400332+0000","last_change":"2024-09-11T22:18:14.399464+0000","last_active":"2024-09-11T22:18:14.400332+0000","last_peered":"2024-09-11T22:18:14.400332+0000","last_clean":"2024-09-11T22:18:14.400332+0000","last_became_active":"2024-09-11T22:18:14.399179+0000","last_became_peered":"2024-09-11T22:18:14.399179+0000","last_unstale":"2024-09-11T22:18:14.400332+0000","last_undegraded":"2024-09-11T22:18:14.400332+0000","last_fullsized":"2024-09-11T22:18:14.400332+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:57.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384524+0000","last_change":"2024-09-11T22:18:14.384524+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384524+0000","last_undegraded":"2024-09-11T22:18:14.384524+0000","last_fullsized":"2024-09-11T22:18:14.384524+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.397474+0000","last_change":"2024-09-11T22:18:14.394153+0000","last_active":"2024-09-11T22:18:14.397474+0000","last_peered":"2024-09-11T22:18:14.397474+0000","last_clean":"2024-09-11T22:18:14.397474+0000","last_became_active":"2024-09-11T22:18:14.393807+0000","last_became_peered":"2024-09-11T22:18:14.393807+0000","last_unstale":"2024-09-11T22:18:14.397474+0000","last_undegraded":"2024-09-11T22:18:14.397474+0000","last_fullsized":"2024-09-11T22:18:14.397474+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:50.431556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384255+0000","last_change":"2024-09-11T22:18:14.384255+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384255+0000","last_undegraded":"2024-09-11T22:18:14.384255+0000","last_fullsized":"2024-09-11T22:18:14.384255+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.402438+0000","last_change":"2024-09-11T22:18:14.402005+0000","last_active":"2024-09-11T22:18:14.402438+0000","last_peered":"2024-09-11T22:18:14.402438+0000","last_clean":"2024-09-11T22:18:14.402438+0000","last_became_active":"2024-09-11T22:18:14.401763+0000","last_became_peered":"2024-09-11T22:18:14.401763+0000","last_unstale":"2024-09-11T22:18:14.402438+0000","last_undegraded":"2024-09-11T22:18:14.402438+0000","last_fullsized":"2024-09-11T22:18:14.402438+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:27.533288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.387117+0000","last_change":"2024-09-11T22:18:14.387117+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.387117+0000","last_undegraded":"2024-09-11T22:18:14.387117+0000","last_fullsized":"2024-09-11T22:18:14.387117+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"119'8","reported_seq":20,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.412514+0000","last_change":"2024-09-11T22:18:14.400223+0000","last_active":"2024-09-11T22:18:15.412514+0000","last_peered":"2024-09-11T22:18:15.412514+0000","last_clean":"2024-09-11T22:18:15.412514+0000","last_became_active":"2024-09-11T22:18:14.399666+0000","last_became_peered":"2024-09-11T22:18:14.399666+0000","last_unstale":"2024-09-11T22:18:15.412514+0000","last_undegraded":"2024-09-11T22:18:15.412514+0000","last_fullsized":"2024-09-11T22:18:15.412514+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:01.400475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.397968+0000","last_change":"2024-09-11T22:18:15.395943+0000","last_active":"2024-09-11T22:18:15.397968+0000","last_peered":"2024-09-11T22:18:15.397968+0000","last_clean":"2024-09-11T22:18:15.397968+0000","last_became_active":"2024-09-11T22:18:15.395087+0000","last_became_peered":"2024-09-11T22:18:15.395087+0000","last_unstale":"2024-09-11T22:18:15.397968+0000","last_undegraded":"2024-09-11T22:18:15.397968+0000","last_fullsized":"2024-09-11T22:18:15.397968+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.021061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.400885+0000","last_change":"2024-09-11T22:18:14.397820+0000","last_active":"2024-09-11T22:18:14.400885+0000","last_peered":"2024-09-11T22:18:14.400885+0000","last_clean":"2024-09-11T22:18:14.400885+0000","last_became_active":"2024-09-11T22:18:14.397467+0000","last_became_peered":"2024-09-11T22:18:14.397467+0000","last_unstale":"2024-09-11T22:18:14.400885+0000","last_undegraded":"2024-09-11T22:18:14.400885+0000","last_fullsized":"2024-09-11T22:18:14.400885+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:12.906587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385396+0000","last_change":"2024-09-11T22:18:14.385396+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385396+0000","last_undegraded":"2024-09-11T22:18:14.385396+0000","last_fullsized":"2024-09-11T22:18:14.385396+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.413949+0000","last_change":"2024-09-11T22:18:14.392009+0000","last_active":"2024-09-11T22:18:15.413949+0000","last_peered":"2024-09-11T22:18:15.413949+0000","last_clean":"2024-09-11T22:18:15.413949+0000","last_became_active":"2024-09-11T22:18:14.391704+0000","last_became_peered":"2024-09-11T22:18:14.391704+0000","last_unstale":"2024-09-11T22:18:15.413949+0000","last_undegraded":"2024-09-11T22:18:15.413949+0000","last_fullsized":"2024-09-11T22:18:15.413949+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:49.090421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082155+0000","last_change":"2024-09-11T22:18:15.398734+0000","last_active":"2024-09-11T22:18:17.082155+0000","last_peered":"2024-09-11T22:18:17.082155+0000","last_clean":"2024-09-11T22:18:17.082155+0000","last_became_active":"2024-09-11T22:18:15.398387+0000","last_became_peered":"2024-09-11T22:18:15.398387+0000","last_unstale":"2024-09-11T22:18:17.082155+0000","last_undegraded":"2024-09-11T22:18:17.082155+0000","last_fullsized":"2024-09-11T22:18:17.082155+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:15.451642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394934+0000","last_change":"2024-09-11T22:18:14.393793+0000","last_active":"2024-09-11T22:18:14.394934+0000","last_peered":"2024-09-11T22:18:14.394934+0000","last_clean":"2024-09-11T22:18:14.394934+0000","last_became_active":"2024-09-11T22:18:14.393496+0000","last_became_peered":"2024-09-11T22:18:14.393496+0000","last_unstale":"2024-09-11T22:18:14.394934+0000","last_undegraded":"2024-09-11T22:18:14.394934+0000","last_fullsized":"2024-09-11T22:18:14.394934+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:25.765535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082769+0000","last_change":"2024-09-11T22:18:15.406005+0000","last_active":"2024-09-11T22:18:17.082769+0000","last_peered":"2024-09-11T22:18:17.082769+0000","last_clean":"2024-09-11T22:18:17.082769+0000","last_became_active":"2024-09-11T22:18:15.405672+0000","last_became_peered":"2024-09-11T22:18:15.405672+0000","last_unstale":"2024-09-11T22:18:17.082769+0000","last_undegraded":"2024-09-11T22:18:17.082769+0000","last_fullsized":"2024-09-11T22:18:17.082769+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:21.104121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.396571+0000","last_change":"2024-09-11T22:18:14.395819+0000","last_active":"2024-09-11T22:18:14.396571+0000","last_peered":"2024-09-11T22:18:14.396571+0000","last_clean":"2024-09-11T22:18:14.396571+0000","last_became_active":"2024-09-11T22:18:14.395449+0000","last_became_peered":"2024-09-11T22:18:14.395449+0000","last_unstale":"2024-09-11T22:18:14.396571+0000","last_undegraded":"2024-09-11T22:18:14.396571+0000","last_fullsized":"2024-09-11T22:18:14.396571+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:48.276567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082374+0000","last_change":"2024-09-11T22:18:15.403455+0000","last_active":"2024-09-11T22:18:17.082374+0000","last_peered":"2024-09-11T22:18:17.082374+0000","last_clean":"2024-09-11T22:18:17.082374+0000","last_became_active":"2024-09-11T22:18:15.403172+0000","last_became_peered":"2024-09-11T22:18:15.403172+0000","last_unstale":"2024-09-11T22:18:17.082374+0000","last_undegraded":"2024-09-11T22:18:17.082374+0000","last_fullsized":"2024-09-11T22:18:17.082374+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:46.227885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394362+0000","last_change":"2024-09-11T22:18:14.392831+0000","last_active":"2024-09-11T22:18:14.394362+0000","last_peered":"2024-09-11T22:18:14.394362+0000","last_clean":"2024-09-11T22:18:14.394362+0000","last_became_active":"2024-09-11T22:18:14.392454+0000","last_became_peered":"2024-09-11T22:18:14.392454+0000","last_unstale":"2024-09-11T22:18:14.394362+0000","last_undegraded":"2024-09-11T22:18:14.394362+0000","last_fullsized":"2024-09-11T22:18:14.394362+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:00.751960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.389927+0000","last_change":"2024-09-11T22:18:14.389927+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.389927+0000","last_undegraded":"2024-09-11T22:18:14.389927+0000","last_fullsized":"2024-09-11T22:18:14.389927+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.382646+0000","last_change":"2024-09-11T22:18:14.394805+0000","last_active":"2024-09-11T22:18:15.382646+0000","last_peered":"2024-09-11T22:18:15.382646+0000","last_clean":"2024-09-11T22:18:15.382646+0000","last_became_active":"2024-09-11T22:18:14.394547+0000","last_became_peered":"2024-09-11T22:18:14.394547+0000","last_unstale":"2024-09-11T22:18:15.382646+0000","last_undegraded":"2024-09-11T22:18:15.382646+0000","last_fullsized":"2024-09-11T22:18:15.382646+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:31.918926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082286+0000","last_change":"2024-09-11T22:18:15.400740+0000","last_active":"2024-09-11T22:18:17.082286+0000","last_peered":"2024-09-11T22:18:17.082286+0000","last_clean":"2024-09-11T22:18:17.082286+0000","last_became_active":"2024-09-11T22:18:15.400458+0000","last_became_peered":"2024-09-11T22:18:15.400458+0000","last_unstale":"2024-09-11T22:18:17.082286+0000","last_undegraded":"2024-09-11T22:18:17.082286+0000","last_fullsized":"2024-09-11T22:18:17.082286+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.947194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394331+0000","last_change":"2024-09-11T22:18:14.393175+0000","last_active":"2024-09-11T22:18:14.394331+0000","last_peered":"2024-09-11T22:18:14.394331+0000","last_clean":"2024-09-11T22:18:14.394331+0000","last_became_active":"2024-09-11T22:18:14.389968+0000","last_became_peered":"2024-09-11T22:18:14.389968+0000","last_unstale":"2024-09-11T22:18:14.394331+0000","last_undegraded":"2024-09-11T22:18:14.394331+0000","last_fullsized":"2024-09-11T22:18:14.394331+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:46.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386709+0000","last_change":"2024-09-11T22:18:14.386709+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386709+0000","last_undegraded":"2024-09-11T22:18:14.386709+0000","last_fullsized":"2024-09-11T22:18:14.386709+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.402979+0000","last_change":"2024-09-11T22:18:14.401946+0000","last_active":"2024-09-11T22:18:14.402979+0000","last_peered":"2024-09-11T22:18:14.402979+0000","last_clean":"2024-09-11T22:18:14.402979+0000","last_became_active":"2024-09-11T22:18:14.401243+0000","last_became_peered":"2024-09-11T22:18:14.401243+0000","last_unstale":"2024-09-11T22:18:14.402979+0000","last_undegraded":"2024-09-11T22:18:14.402979+0000","last_fullsized":"2024-09-11T22:18:14.402979+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:00.030990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385967+0000","last_change":"2024-09-11T22:18:14.385967+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385967+0000","last_undegraded":"2024-09-11T22:18:14.385967+0000","last_fullsized":"2024-09-11T22:18:14.385967+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.397455+0000","last_change":"2024-09-11T22:18:14.395777+0000","last_active":"2024-09-11T22:18:14.397455+0000","last_peered":"2024-09-11T22:18:14.397455+0000","last_clean":"2024-09-11T22:18:14.397455+0000","last_became_active":"2024-09-11T22:18:14.395436+0000","last_became_peered":"2024-09-11T22:18:14.395436+0000","last_unstale":"2024-09-11T22:18:14.397455+0000","last_undegraded":"2024-09-11T22:18:14.397455+0000","last_fullsized":"2024-09-11T22:18:14.397455+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:10.730302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.390590+0000","last_change":"2024-09-11T22:18:14.390590+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.390590+0000","last_undegraded":"2024-09-11T22:18:14.390590+0000","last_fullsized":"2024-09-11T22:18:14.390590+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394388+0000","last_change":"2024-09-11T22:18:14.392721+0000","last_active":"2024-09-11T22:18:14.394388+0000","last_peered":"2024-09-11T22:18:14.394388+0000","last_clean":"2024-09-11T22:18:14.394388+0000","last_became_active":"2024-09-11T22:18:14.392450+0000","last_became_peered":"2024-09-11T22:18:14.392450+0000","last_unstale":"2024-09-11T22:18:14.394388+0000","last_undegraded":"2024-09-11T22:18:14.394388+0000","last_fullsized":"2024-09-11T22:18:14.394388+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:38.957310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.388147+0000","last_change":"2024-09-11T22:18:14.388147+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.388147+0000","last_undegraded":"2024-09-11T22:18:14.388147+0000","last_fullsized":"2024-09-11T22:18:14.388147+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.402675+0000","last_change":"2024-09-11T22:18:14.401709+0000","last_active":"2024-09-11T22:18:14.402675+0000","last_peered":"2024-09-11T22:18:14.402675+0000","last_clean":"2024-09-11T22:18:14.402675+0000","last_became_active":"2024-09-11T22:18:14.401223+0000","last_became_peered":"2024-09-11T22:18:14.401223+0000","last_unstale":"2024-09-11T22:18:14.402675+0000","last_undegraded":"2024-09-11T22:18:14.402675+0000","last_fullsized":"2024-09-11T22:18:14.402675+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:29.174812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385657+0000","last_change":"2024-09-11T22:18:14.385657+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385657+0000","last_undegraded":"2024-09-11T22:18:14.385657+0000","last_fullsized":"2024-09-11T22:18:14.385657+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.398799+0000","last_change":"2024-09-11T22:18:14.397568+0000","last_active":"2024-09-11T22:18:14.398799+0000","last_peered":"2024-09-11T22:18:14.398799+0000","last_clean":"2024-09-11T22:18:14.398799+0000","last_became_active":"2024-09-11T22:18:14.397290+0000","last_became_peered":"2024-09-11T22:18:14.397290+0000","last_unstale":"2024-09-11T22:18:14.398799+0000","last_undegraded":"2024-09-11T22:18:14.398799+0000","last_fullsized":"2024-09-11T22:18:14.398799+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:03.775272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.382794+0000","last_change":"2024-09-11T22:18:14.382794+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.382794+0000","last_undegraded":"2024-09-11T22:18:14.382794+0000","last_fullsized":"2024-09-11T22:18:14.382794+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394819+0000","last_change":"2024-09-11T22:18:14.392868+0000","last_active":"2024-09-11T22:18:14.394819+0000","last_peered":"2024-09-11T22:18:14.394819+0000","last_clean":"2024-09-11T22:18:14.394819+0000","last_became_active":"2024-09-11T22:18:14.392570+0000","last_became_peered":"2024-09-11T22:18:14.392570+0000","last_unstale":"2024-09-11T22:18:14.394819+0000","last_undegraded":"2024-09-11T22:18:14.394819+0000","last_fullsized":"2024-09-11T22:18:14.394819+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:56.568071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.383622+0000","last_change":"2024-09-11T22:18:14.383622+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.383622+0000","last_undegraded":"2024-09-11T22:18:14.383622+0000","last_fullsized":"2024-09-11T22:18:14.383622+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394613+0000","last_change":"2024-09-11T22:18:14.393814+0000","last_active":"2024-09-11T22:18:14.394613+0000","last_peered":"2024-09-11T22:18:14.394613+0000","last_clean":"2024-09-11T22:18:14.394613+0000","last_became_active":"2024-09-11T22:18:14.393396+0000","last_became_peered":"2024-09-11T22:18:14.393396+0000","last_unstale":"2024-09-11T22:18:14.394613+0000","last_undegraded":"2024-09-11T22:18:14.394613+0000","last_fullsized":"2024-09-11T22:18:14.394613+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:38.957310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082307+0000","last_change":"2024-09-11T22:18:15.408858+0000","last_active":"2024-09-11T22:18:17.082307+0000","last_peered":"2024-09-11T22:18:17.082307+0000","last_clean":"2024-09-11T22:18:17.082307+0000","last_became_active":"2024-09-11T22:18:15.408384+0000","last_became_peered":"2024-09-11T22:18:15.408384+0000","last_unstale":"2024-09-11T22:18:17.082307+0000","last_undegraded":"2024-09-11T22:18:17.082307+0000","last_fullsized":"2024-09-11T22:18:17.082307+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:45:12.601612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.382293+0000","last_change":"2024-09-11T22:18:14.396779+0000","last_active":"2024-09-11T22:18:15.382293+0000","last_peered":"2024-09-11T22:18:15.382293+0000","last_clean":"2024-09-11T22:18:15.382293+0000","last_became_active":"2024-09-11T22:18:14.396480+0000","last_became_peered":"2024-09-11T22:18:14.396480+0000","last_unstale":"2024-09-11T22:18:15.382293+0000","last_undegraded":"2024-09-11T22:18:15.382293+0000","last_fullsized":"2024-09-11T22:18:15.382293+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:02.602508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384193+0000","last_change":"2024-09-11T22:18:14.384193+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384193+0000","last_undegraded":"2024-09-11T22:18:14.384193+0000","last_fullsized":"2024-09-11T22:18:14.384193+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.403131+0000","last_change":"2024-09-11T22:18:14.402459+0000","last_active":"2024-09-11T22:18:14.403131+0000","last_peered":"2024-09-11T22:18:14.403131+0000","last_clean":"2024-09-11T22:18:14.403131+0000","last_became_active":"2024-09-11T22:18:14.402137+0000","last_became_peered":"2024-09-11T22:18:14.402137+0000","last_unstale":"2024-09-11T22:18:14.403131+0000","last_undegraded":"2024-09-11T22:18:14.403131+0000","last_fullsized":"2024-09-11T22:18:14.403131+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:09.073102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384812+0000","last_change":"2024-09-11T22:18:14.384812+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384812+0000","last_undegraded":"2024-09-11T22:18:14.384812+0000","last_fullsized":"2024-09-11T22:18:14.384812+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.396562+0000","last_change":"2024-09-11T22:18:14.395747+0000","last_active":"2024-09-11T22:18:14.396562+0000","last_peered":"2024-09-11T22:18:14.396562+0000","last_clean":"2024-09-11T22:18:14.396562+0000","last_became_active":"2024-09-11T22:18:14.395432+0000","last_became_peered":"2024-09-11T22:18:14.395432+0000","last_unstale":"2024-09-11T22:18:14.396562+0000","last_undegraded":"2024-09-11T22:18:14.396562+0000","last_fullsized":"2024-09-11T22:18:14.396562+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:15.717819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":351,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082372+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:18:17.082372+0000","last_peered":"2024-09-11T22:18:17.082372+0000","last_clean":"2024-09-11T22:18:17.082372+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:18:17.082372+0000","last_undegraded":"2024-09-11T22:18:17.082372+0000","last_fullsized":"2024-09-11T22:18:17.082372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509531,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46492,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325348,"statfs":{"total":96636764160,"available":96589156352,"internally_reserved":0,"allocated":1445888,"data_stored":630553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509528,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40920,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330920,"statfs":{"total":96636764160,"available":96594862080,"internally_reserved":0,"allocated":1445888,"data_stored":630553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509530,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46488,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325352,"statfs":{"total":96636764160,"available":96589160448,"internally_reserved":0,"allocated":1445888,"data_stored":630553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509530,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54808,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317032,"statfs":{"total":96636764160,"available":96580640768,"internally_reserved":0,"allocated":1445888,"data_stored":630553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509530,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58972,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312868,"statfs":{"total":96636764160,"available":96576376832,"internally_reserved":0,"allocated":1445888,"data_stored":630553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509529,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51228,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320612,"statfs":{"total":96636764160,"available":96584306688,"internally_reserved":0,"allocated":2039808,"data_stored":1220921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45704,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326136,"statfs":{"total":96636764160,"available":96589963264,"internally_reserved":0,"allocated":2084864,"data_stored":1240887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54840,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317000,"statfs":{"total":96636764160,"available":96580608000,"internally_reserved":0,"allocated":1470464,"data_stored":643603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:18:19.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:18:19.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.149+0000 7f88b9eac640 1 Processor -- start 2024-09-11T22:18:19.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.149+0000 7f88b9eac640 1 -- start start 2024-09-11T22:18:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.149+0000 7f88b9eac640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88b40d18a0 0x7f88b40d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.149+0000 7f88b9eac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88b40d3a30 0x7f88b40b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.149+0000 7f88b9eac640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88b40cfa80 con 0x7f88b415e870 2024-09-11T22:18:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.149+0000 7f88b9eac640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f88b40d3ea0 con 0x7f88b40d3a30 2024-09-11T22:18:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.149+0000 7f88b9eac640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f88b40d40d0 con 0x7f88b40d18a0 2024-09-11T22:18:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.150+0000 7f88b3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88b40d3a30 0x7f88b40b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.150+0000 7f88b3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88b40d3a30 0x7f88b40b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56282/0 (socket says 172.21.15.50:56282) 2024-09-11T22:18:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.150+0000 7f88b3fff640 1 -- 172.21.15.50:0/2287017521 learned_addr learned my addr 172.21.15.50:0/2287017521 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.150+0000 7f88b2ffd640 1 --2- 172.21.15.50:0/2287017521 >> v2:172.21.15.77:3300/0 conn(0x7f88b40d18a0 0x7f88b40d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.150+0000 7f88b3fff640 1 -- 172.21.15.50:0/2287017521 >> v2:172.21.15.77:3300/0 conn(0x7f88b40d18a0 msgr2=0x7f88b40d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.150+0000 7f88b3fff640 1 --2- 172.21.15.50:0/2287017521 >> v2:172.21.15.77:3300/0 conn(0x7f88b40d18a0 0x7f88b40d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.150+0000 7f88b3fff640 1 -- 172.21.15.50:0/2287017521 >> v1:172.21.15.77:6789/0 conn(0x7f88b415e870 legacy=0x7f88b40d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:19.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.150+0000 7f88b3fff640 1 -- 172.21.15.50:0/2287017521 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b40d43b0 con 0x7f88b40d3a30 2024-09-11T22:18:19.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.151+0000 7f88b3fff640 1 --2- 172.21.15.50:0/2287017521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b40d3a30 0x7f88b40b8400 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f88b406c860 tx=0x7f88ac02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36abd5b9bc0ab125 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:19.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.151+0000 7f88b27fc640 1 -- 172.21.15.50:0/2287017521 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac036070 con 0x7f88b40d3a30 2024-09-11T22:18:19.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.151+0000 7f88b27fc640 1 -- 172.21.15.50:0/2287017521 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ac031600 con 0x7f88b40d3a30 2024-09-11T22:18:19.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.151+0000 7f88b27fc640 1 -- 172.21.15.50:0/2287017521 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0319d0 con 0x7f88b40d3a30 2024-09-11T22:18:19.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.151+0000 7f88b9eac640 1 -- 172.21.15.50:0/2287017521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b40d3a30 msgr2=0x7f88b40b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.151+0000 7f88b9eac640 1 --2- 172.21.15.50:0/2287017521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b40d3a30 0x7f88b40b8400 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f88b406c860 tx=0x7f88ac02a6f0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.151+0000 7f88b9eac640 1 -- 172.21.15.50:0/2287017521 shutdown_connections 2024-09-11T22:18:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.151+0000 7f88b9eac640 1 --2- 172.21.15.50:0/2287017521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b40d3a30 0x7f88b40b8400 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.151+0000 7f88b9eac640 1 --2- 172.21.15.50:0/2287017521 >> v2:172.21.15.77:3300/0 conn(0x7f88b40d18a0 0x7f88b40d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.151+0000 7f88b9eac640 1 -- 172.21.15.50:0/2287017521 >> 172.21.15.50:0/2287017521 conn(0x7f88b40727a0 msgr2=0x7f88b40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.151+0000 7f88b9eac640 1 -- 172.21.15.50:0/2287017521 shutdown_connections 2024-09-11T22:18:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.151+0000 7f88b9eac640 1 -- 172.21.15.50:0/2287017521 wait complete. 2024-09-11T22:18:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.153+0000 7f88b9eac640 1 Processor -- start 2024-09-11T22:18:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.153+0000 7f88b9eac640 1 -- start start 2024-09-11T22:18:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b9eac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b40d18a0 0x7f88b4155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b9eac640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b40d3a30 0x7f88b4155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b9eac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b415e870 0x7f88b41588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b9eac640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88b415ec50 con 0x7f88b40d18a0 2024-09-11T22:18:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b9eac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88b40b7ee0 con 0x7f88b415e870 2024-09-11T22:18:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b9eac640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f88b40b78b0 con 0x7f88b40d3a30 2024-09-11T22:18:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b40d18a0 0x7f88b4155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b40d18a0 0x7f88b4155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56290/0 (socket says 172.21.15.50:56290) 2024-09-11T22:18:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b37fe640 1 -- 172.21.15.50:0/1045419391 learned_addr learned my addr 172.21.15.50:0/1045419391 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b3fff640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b415e870 0x7f88b41588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b2ffd640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b40d3a30 0x7f88b4155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b37fe640 1 -- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b40d3a30 msgr2=0x7f88b4155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b37fe640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b40d3a30 0x7f88b4155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b37fe640 1 -- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b415e870 msgr2=0x7f88b41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b37fe640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b415e870 0x7f88b41588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b37fe640 1 -- 172.21.15.50:0/1045419391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b41571d0 con 0x7f88b40d18a0 2024-09-11T22:18:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b37fe640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b40d18a0 0x7f88b4155f70 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f88a400c460 tx=0x7f88a400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f889bfff640 1 -- 172.21.15.50:0/1045419391 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4016020 con 0x7f88b40d18a0 2024-09-11T22:18:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f889bfff640 1 -- 172.21.15.50:0/1045419391 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a4012870 con 0x7f88b40d18a0 2024-09-11T22:18:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b9eac640 1 -- 172.21.15.50:0/1045419391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b4160790 con 0x7f88b40d18a0 2024-09-11T22:18:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f889bfff640 1 -- 172.21.15.50:0/1045419391 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4012c60 con 0x7f88b40d18a0 2024-09-11T22:18:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.154+0000 7f88b9eac640 1 -- 172.21.15.50:0/1045419391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b4155be0 con 0x7f88b40d18a0 2024-09-11T22:18:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.155+0000 7f88b9eac640 1 -- 172.21.15.50:0/1045419391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88b40d34f0 con 0x7f88b40d18a0 2024-09-11T22:18:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.156+0000 7f889bfff640 1 -- 172.21.15.50:0/1045419391 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88a4019020 con 0x7f88b40d18a0 2024-09-11T22:18:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.156+0000 7f889bfff640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88a006be30 0x7f88a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.156+0000 7f889bfff640 1 -- 172.21.15.50:0/1045419391 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f88a408aeb0 con 0x7f88b40d18a0 2024-09-11T22:18:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.157+0000 7f88b2ffd640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88a006be30 0x7f88a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.157+0000 7f88b2ffd640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88a006be30 0x7f88a006e2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f88a8006fd0 tx=0x7f88a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.161+0000 7f889bfff640 1 -- 172.21.15.50:0/1045419391 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88a4020020 con 0x7f88b40d18a0 2024-09-11T22:18:19.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.333+0000 7f88b9eac640 1 -- 172.21.15.50:0/1045419391 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88b41574b0 con 0x7f88a006be30 2024-09-11T22:18:19.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.339+0000 7f889bfff640 1 -- 172.21.15.50:0/1045419391 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248174 (secure 0 0 0) 0x7f88b41574b0 con 0x7f88a006be30 2024-09-11T22:18:19.342 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:19.344 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:18:19.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.342+0000 7f88b9eac640 1 -- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88a006be30 msgr2=0x7f88a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.342+0000 7f88b9eac640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88a006be30 0x7f88a006e2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f88a8006fd0 tx=0x7f88a8008040 comp rx=0 tx=0).stop 2024-09-11T22:18:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.342+0000 7f88b9eac640 1 -- 172.21.15.50:0/1045419391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b40d18a0 msgr2=0x7f88b4155f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.342+0000 7f88b9eac640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b40d18a0 0x7f88b4155f70 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f88a400c460 tx=0x7f88a400c920 comp rx=0 tx=0).stop 2024-09-11T22:18:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.342+0000 7f88b9eac640 1 -- 172.21.15.50:0/1045419391 shutdown_connections 2024-09-11T22:18:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.342+0000 7f88b9eac640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88a006be30 0x7f88a006e2f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.342+0000 7f88b9eac640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88b40d3a30 0x7f88b4155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.342+0000 7f88b9eac640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b415e870 0x7f88b41588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.342+0000 7f88b9eac640 1 --2- 172.21.15.50:0/1045419391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88b40d18a0 0x7f88b4155f70 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.342+0000 7f88b9eac640 1 -- 172.21.15.50:0/1045419391 >> 172.21.15.50:0/1045419391 conn(0x7f88b40727a0 msgr2=0x7f88b40b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.342+0000 7f88b9eac640 1 -- 172.21.15.50:0/1045419391 shutdown_connections 2024-09-11T22:18:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.342+0000 7f88b9eac640 1 -- 172.21.15.50:0/1045419391 wait complete. 2024-09-11T22:18:19.353 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-11T22:18:17.468201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":180,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":399452,"kb_used_data":12524,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754575268,"statfs":{"total":773094113280,"available":772685074432,"internally_reserved":0,"allocated":12824576,"data_stored":6258176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":396021297},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.094833"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.391419+0000","last_change":"2024-09-11T22:18:14.391419+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.391419+0000","last_undegraded":"2024-09-11T22:18:14.391419+0000","last_fullsized":"2024-09-11T22:18:14.391419+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.383030+0000","last_change":"2024-09-11T22:18:14.383030+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.383030+0000","last_undegraded":"2024-09-11T22:18:14.383030+0000","last_fullsized":"2024-09-11T22:18:14.383030+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082458+0000","last_change":"2024-09-11T22:18:15.404107+0000","last_active":"2024-09-11T22:18:17.082458+0000","last_peered":"2024-09-11T22:18:17.082458+0000","last_clean":"2024-09-11T22:18:17.082458+0000","last_became_active":"2024-09-11T22:18:15.403793+0000","last_became_peered":"2024-09-11T22:18:15.403793+0000","last_unstale":"2024-09-11T22:18:17.082458+0000","last_undegraded":"2024-09-11T22:18:17.082458+0000","last_fullsized":"2024-09-11T22:18:17.082458+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:00.201633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.389515+0000","last_change":"2024-09-11T22:18:14.389515+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.389515+0000","last_undegraded":"2024-09-11T22:18:14.389515+0000","last_fullsized":"2024-09-11T22:18:14.389515+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.394843+0000","last_change":"2024-09-11T22:18:15.391099+0000","last_active":"2024-09-11T22:18:15.394843+0000","last_peered":"2024-09-11T22:18:15.394843+0000","last_clean":"2024-09-11T22:18:15.394843+0000","last_became_active":"2024-09-11T22:18:15.390672+0000","last_became_peered":"2024-09-11T22:18:15.390672+0000","last_unstale":"2024-09-11T22:18:15.394843+0000","last_undegraded":"2024-09-11T22:18:15.394843+0000","last_fullsized":"2024-09-11T22:18:15.394843+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:05.504125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385085+0000","last_change":"2024-09-11T22:18:14.385085+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385085+0000","last_undegraded":"2024-09-11T22:18:14.385085+0000","last_fullsized":"2024-09-11T22:18:14.385085+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385248+0000","last_change":"2024-09-11T22:18:14.385248+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385248+0000","last_undegraded":"2024-09-11T22:18:14.385248+0000","last_fullsized":"2024-09-11T22:18:14.385248+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082119+0000","last_change":"2024-09-11T22:18:15.407146+0000","last_active":"2024-09-11T22:18:17.082119+0000","last_peered":"2024-09-11T22:18:17.082119+0000","last_clean":"2024-09-11T22:18:17.082119+0000","last_became_active":"2024-09-11T22:18:15.406866+0000","last_became_peered":"2024-09-11T22:18:15.406866+0000","last_unstale":"2024-09-11T22:18:17.082119+0000","last_undegraded":"2024-09-11T22:18:17.082119+0000","last_fullsized":"2024-09-11T22:18:17.082119+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:39.415424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.391022+0000","last_change":"2024-09-11T22:18:14.391022+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.391022+0000","last_undegraded":"2024-09-11T22:18:14.391022+0000","last_fullsized":"2024-09-11T22:18:14.391022+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.395127+0000","last_change":"2024-09-11T22:18:14.395127+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.395127+0000","last_undegraded":"2024-09-11T22:18:14.395127+0000","last_fullsized":"2024-09-11T22:18:14.395127+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.383540+0000","last_change":"2024-09-11T22:18:14.383540+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.383540+0000","last_undegraded":"2024-09-11T22:18:14.383540+0000","last_fullsized":"2024-09-11T22:18:14.383540+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.388541+0000","last_change":"2024-09-11T22:18:14.388541+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.388541+0000","last_undegraded":"2024-09-11T22:18:14.388541+0000","last_fullsized":"2024-09-11T22:18:14.388541+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082040+0000","last_change":"2024-09-11T22:18:15.401611+0000","last_active":"2024-09-11T22:18:17.082040+0000","last_peered":"2024-09-11T22:18:17.082040+0000","last_clean":"2024-09-11T22:18:17.082040+0000","last_became_active":"2024-09-11T22:18:15.401153+0000","last_became_peered":"2024-09-11T22:18:15.401153+0000","last_unstale":"2024-09-11T22:18:17.082040+0000","last_undegraded":"2024-09-11T22:18:17.082040+0000","last_fullsized":"2024-09-11T22:18:17.082040+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:49.865380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082235+0000","last_change":"2024-09-11T22:18:15.400570+0000","last_active":"2024-09-11T22:18:17.082235+0000","last_peered":"2024-09-11T22:18:17.082235+0000","last_clean":"2024-09-11T22:18:17.082235+0000","last_became_active":"2024-09-11T22:18:15.400292+0000","last_became_peered":"2024-09-11T22:18:15.400292+0000","last_unstale":"2024-09-11T22:18:17.082235+0000","last_undegraded":"2024-09-11T22:18:17.082235+0000","last_fullsized":"2024-09-11T22:18:17.082235+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:59.644890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.387227+0000","last_change":"2024-09-11T22:18:14.387227+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.387227+0000","last_undegraded":"2024-09-11T22:18:14.387227+0000","last_fullsized":"2024-09-11T22:18:14.387227+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386781+0000","last_change":"2024-09-11T22:18:14.386781+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386781+0000","last_undegraded":"2024-09-11T22:18:14.386781+0000","last_fullsized":"2024-09-11T22:18:14.386781+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386731+0000","last_change":"2024-09-11T22:18:14.386731+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386731+0000","last_undegraded":"2024-09-11T22:18:14.386731+0000","last_fullsized":"2024-09-11T22:18:14.386731+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386398+0000","last_change":"2024-09-11T22:18:14.386398+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386398+0000","last_undegraded":"2024-09-11T22:18:14.386398+0000","last_fullsized":"2024-09-11T22:18:14.386398+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082602+0000","last_change":"2024-09-11T22:18:15.401501+0000","last_active":"2024-09-11T22:18:17.082602+0000","last_peered":"2024-09-11T22:18:17.082602+0000","last_clean":"2024-09-11T22:18:17.082602+0000","last_became_active":"2024-09-11T22:18:15.401260+0000","last_became_peered":"2024-09-11T22:18:15.401260+0000","last_unstale":"2024-09-11T22:18:17.082602+0000","last_undegraded":"2024-09-11T22:18:17.082602+0000","last_fullsized":"2024-09-11T22:18:17.082602+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:28.302797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.383039+0000","last_change":"2024-09-11T22:18:14.383039+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.383039+0000","last_undegraded":"2024-09-11T22:18:14.383039+0000","last_fullsized":"2024-09-11T22:18:14.383039+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.382775+0000","last_change":"2024-09-11T22:18:14.382775+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.382775+0000","last_undegraded":"2024-09-11T22:18:14.382775+0000","last_fullsized":"2024-09-11T22:18:14.382775+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385000+0000","last_change":"2024-09-11T22:18:14.385000+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385000+0000","last_undegraded":"2024-09-11T22:18:14.385000+0000","last_fullsized":"2024-09-11T22:18:14.385000+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.383563+0000","last_change":"2024-09-11T22:18:14.383563+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.383563+0000","last_undegraded":"2024-09-11T22:18:14.383563+0000","last_fullsized":"2024-09-11T22:18:14.383563+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386929+0000","last_change":"2024-09-11T22:18:14.386929+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386929+0000","last_undegraded":"2024-09-11T22:18:14.386929+0000","last_fullsized":"2024-09-11T22:18:14.386929+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386301+0000","last_change":"2024-09-11T22:18:14.386301+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386301+0000","last_undegraded":"2024-09-11T22:18:14.386301+0000","last_fullsized":"2024-09-11T22:18:14.386301+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.394723+0000","last_change":"2024-09-11T22:18:14.394723+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.394723+0000","last_undegraded":"2024-09-11T22:18:14.394723+0000","last_fullsized":"2024-09-11T22:18:14.394723+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.387354+0000","last_change":"2024-09-11T22:18:14.387354+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.387354+0000","last_undegraded":"2024-09-11T22:18:14.387354+0000","last_fullsized":"2024-09-11T22:18:14.387354+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.387608+0000","last_change":"2024-09-11T22:18:14.387608+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.387608+0000","last_undegraded":"2024-09-11T22:18:14.387608+0000","last_fullsized":"2024-09-11T22:18:14.387608+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384511+0000","last_change":"2024-09-11T22:18:14.384511+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384511+0000","last_undegraded":"2024-09-11T22:18:14.384511+0000","last_fullsized":"2024-09-11T22:18:14.384511+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386084+0000","last_change":"2024-09-11T22:18:14.386084+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386084+0000","last_undegraded":"2024-09-11T22:18:14.386084+0000","last_fullsized":"2024-09-11T22:18:14.386084+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386101+0000","last_change":"2024-09-11T22:18:14.386101+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386101+0000","last_undegraded":"2024-09-11T22:18:14.386101+0000","last_fullsized":"2024-09-11T22:18:14.386101+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385633+0000","last_change":"2024-09-11T22:18:14.385633+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385633+0000","last_undegraded":"2024-09-11T22:18:14.385633+0000","last_fullsized":"2024-09-11T22:18:14.385633+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385431+0000","last_change":"2024-09-11T22:18:14.385431+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385431+0000","last_undegraded":"2024-09-11T22:18:14.385431+0000","last_fullsized":"2024-09-11T22:18:14.385431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394791+0000","last_change":"2024-09-11T22:18:14.392883+0000","last_active":"2024-09-11T22:18:14.394791+0000","last_peered":"2024-09-11T22:18:14.394791+0000","last_clean":"2024-09-11T22:18:14.394791+0000","last_became_active":"2024-09-11T22:18:14.392587+0000","last_became_peered":"2024-09-11T22:18:14.392587+0000","last_unstale":"2024-09-11T22:18:14.394791+0000","last_undegraded":"2024-09-11T22:18:14.394791+0000","last_fullsized":"2024-09-11T22:18:14.394791+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:29.635935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386482+0000","last_change":"2024-09-11T22:18:14.386482+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386482+0000","last_undegraded":"2024-09-11T22:18:14.386482+0000","last_fullsized":"2024-09-11T22:18:14.386482+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081902+0000","last_change":"2024-09-11T22:18:14.395419+0000","last_active":"2024-09-11T22:18:17.081902+0000","last_peered":"2024-09-11T22:18:17.081902+0000","last_clean":"2024-09-11T22:18:17.081902+0000","last_became_active":"2024-09-11T22:18:14.395085+0000","last_became_peered":"2024-09-11T22:18:14.395085+0000","last_unstale":"2024-09-11T22:18:17.081902+0000","last_undegraded":"2024-09-11T22:18:17.081902+0000","last_fullsized":"2024-09-11T22:18:17.081902+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:52.212295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385932+0000","last_change":"2024-09-11T22:18:14.385932+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385932+0000","last_undegraded":"2024-09-11T22:18:14.385932+0000","last_fullsized":"2024-09-11T22:18:14.385932+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.413307+0000","last_change":"2024-09-11T22:18:14.395434+0000","last_active":"2024-09-11T22:18:15.413307+0000","last_peered":"2024-09-11T22:18:15.413307+0000","last_clean":"2024-09-11T22:18:15.413307+0000","last_became_active":"2024-09-11T22:18:14.395167+0000","last_became_peered":"2024-09-11T22:18:14.395167+0000","last_unstale":"2024-09-11T22:18:15.413307+0000","last_undegraded":"2024-09-11T22:18:15.413307+0000","last_fullsized":"2024-09-11T22:18:15.413307+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.171196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082622+0000","last_change":"2024-09-11T22:18:15.406179+0000","last_active":"2024-09-11T22:18:17.082622+0000","last_peered":"2024-09-11T22:18:17.082622+0000","last_clean":"2024-09-11T22:18:17.082622+0000","last_became_active":"2024-09-11T22:18:15.405865+0000","last_became_peered":"2024-09-11T22:18:15.405865+0000","last_unstale":"2024-09-11T22:18:17.082622+0000","last_undegraded":"2024-09-11T22:18:17.082622+0000","last_fullsized":"2024-09-11T22:18:17.082622+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:23.941974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.413974+0000","last_change":"2024-09-11T22:18:14.393274+0000","last_active":"2024-09-11T22:18:15.413974+0000","last_peered":"2024-09-11T22:18:15.413974+0000","last_clean":"2024-09-11T22:18:15.413974+0000","last_became_active":"2024-09-11T22:18:14.392989+0000","last_became_peered":"2024-09-11T22:18:14.392989+0000","last_unstale":"2024-09-11T22:18:15.413974+0000","last_undegraded":"2024-09-11T22:18:15.413974+0000","last_fullsized":"2024-09-11T22:18:15.413974+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:23.415934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384176+0000","last_change":"2024-09-11T22:18:14.384176+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384176+0000","last_undegraded":"2024-09-11T22:18:14.384176+0000","last_fullsized":"2024-09-11T22:18:14.384176+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.390807+0000","last_change":"2024-09-11T22:18:14.389662+0000","last_active":"2024-09-11T22:18:14.390807+0000","last_peered":"2024-09-11T22:18:14.390807+0000","last_clean":"2024-09-11T22:18:14.390807+0000","last_became_active":"2024-09-11T22:18:14.389378+0000","last_became_peered":"2024-09-11T22:18:14.389378+0000","last_unstale":"2024-09-11T22:18:14.390807+0000","last_undegraded":"2024-09-11T22:18:14.390807+0000","last_fullsized":"2024-09-11T22:18:14.390807+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:50.431556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384136+0000","last_change":"2024-09-11T22:18:14.384136+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384136+0000","last_undegraded":"2024-09-11T22:18:14.384136+0000","last_fullsized":"2024-09-11T22:18:14.384136+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.392138+0000","last_change":"2024-09-11T22:18:14.391141+0000","last_active":"2024-09-11T22:18:14.392138+0000","last_peered":"2024-09-11T22:18:14.392138+0000","last_clean":"2024-09-11T22:18:14.392138+0000","last_became_active":"2024-09-11T22:18:14.390849+0000","last_became_peered":"2024-09-11T22:18:14.390849+0000","last_unstale":"2024-09-11T22:18:14.392138+0000","last_undegraded":"2024-09-11T22:18:14.392138+0000","last_fullsized":"2024-09-11T22:18:14.392138+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:09.073102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386381+0000","last_change":"2024-09-11T22:18:14.386381+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386381+0000","last_undegraded":"2024-09-11T22:18:14.386381+0000","last_fullsized":"2024-09-11T22:18:14.386381+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.392786+0000","last_change":"2024-09-11T22:18:14.392141+0000","last_active":"2024-09-11T22:18:14.392786+0000","last_peered":"2024-09-11T22:18:14.392786+0000","last_clean":"2024-09-11T22:18:14.392786+0000","last_became_active":"2024-09-11T22:18:14.391864+0000","last_became_peered":"2024-09-11T22:18:14.391864+0000","last_unstale":"2024-09-11T22:18:14.392786+0000","last_undegraded":"2024-09-11T22:18:14.392786+0000","last_fullsized":"2024-09-11T22:18:14.392786+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:45.199493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385664+0000","last_change":"2024-09-11T22:18:14.385664+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385664+0000","last_undegraded":"2024-09-11T22:18:14.385664+0000","last_fullsized":"2024-09-11T22:18:14.385664+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.401502+0000","last_change":"2024-09-11T22:18:14.400180+0000","last_active":"2024-09-11T22:18:14.401502+0000","last_peered":"2024-09-11T22:18:14.401502+0000","last_clean":"2024-09-11T22:18:14.401502+0000","last_became_active":"2024-09-11T22:18:14.399884+0000","last_became_peered":"2024-09-11T22:18:14.399884+0000","last_unstale":"2024-09-11T22:18:14.401502+0000","last_undegraded":"2024-09-11T22:18:14.401502+0000","last_fullsized":"2024-09-11T22:18:14.401502+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:44.455410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384643+0000","last_change":"2024-09-11T22:18:14.384643+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384643+0000","last_undegraded":"2024-09-11T22:18:14.384643+0000","last_fullsized":"2024-09-11T22:18:14.384643+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.382418+0000","last_change":"2024-09-11T22:18:14.394020+0000","last_active":"2024-09-11T22:18:15.382418+0000","last_peered":"2024-09-11T22:18:15.382418+0000","last_clean":"2024-09-11T22:18:15.382418+0000","last_became_active":"2024-09-11T22:18:14.393713+0000","last_became_peered":"2024-09-11T22:18:14.393713+0000","last_unstale":"2024-09-11T22:18:15.382418+0000","last_undegraded":"2024-09-11T22:18:15.382418+0000","last_fullsized":"2024-09-11T22:18:15.382418+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:38.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386038+0000","last_change":"2024-09-11T22:18:14.386038+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386038+0000","last_undegraded":"2024-09-11T22:18:14.386038+0000","last_fullsized":"2024-09-11T22:18:14.386038+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.392105+0000","last_change":"2024-09-11T22:18:14.390561+0000","last_active":"2024-09-11T22:18:14.392105+0000","last_peered":"2024-09-11T22:18:14.392105+0000","last_clean":"2024-09-11T22:18:14.392105+0000","last_became_active":"2024-09-11T22:18:14.390247+0000","last_became_peered":"2024-09-11T22:18:14.390247+0000","last_unstale":"2024-09-11T22:18:14.392105+0000","last_undegraded":"2024-09-11T22:18:14.392105+0000","last_fullsized":"2024-09-11T22:18:14.392105+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:19.364246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385251+0000","last_change":"2024-09-11T22:18:14.385251+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385251+0000","last_undegraded":"2024-09-11T22:18:14.385251+0000","last_fullsized":"2024-09-11T22:18:14.385251+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.403006+0000","last_change":"2024-09-11T22:18:14.402317+0000","last_active":"2024-09-11T22:18:14.403006+0000","last_peered":"2024-09-11T22:18:14.403006+0000","last_clean":"2024-09-11T22:18:14.403006+0000","last_became_active":"2024-09-11T22:18:14.401937+0000","last_became_peered":"2024-09-11T22:18:14.401937+0000","last_unstale":"2024-09-11T22:18:14.403006+0000","last_undegraded":"2024-09-11T22:18:14.403006+0000","last_fullsized":"2024-09-11T22:18:14.403006+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:19.364246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384410+0000","last_change":"2024-09-11T22:18:14.384410+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384410+0000","last_undegraded":"2024-09-11T22:18:14.384410+0000","last_fullsized":"2024-09-11T22:18:14.384410+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.400332+0000","last_change":"2024-09-11T22:18:14.399464+0000","last_active":"2024-09-11T22:18:14.400332+0000","last_peered":"2024-09-11T22:18:14.400332+0000","last_clean":"2024-09-11T22:18:14.400332+0000","last_became_active":"2024-09-11T22:18:14.399179+0000","last_became_peered":"2024-09-11T22:18:14.399179+0000","last_unstale":"2024-09-11T22:18:14.400332+0000","last_undegraded":"2024-09-11T22:18:14.400332+0000","last_fullsized":"2024-09-11T22:18:14.400332+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:57.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384524+0000","last_change":"2024-09-11T22:18:14.384524+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384524+0000","last_undegraded":"2024-09-11T22:18:14.384524+0000","last_fullsized":"2024-09-11T22:18:14.384524+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.397474+0000","last_change":"2024-09-11T22:18:14.394153+0000","last_active":"2024-09-11T22:18:14.397474+0000","last_peered":"2024-09-11T22:18:14.397474+0000","last_clean":"2024-09-11T22:18:14.397474+0000","last_became_active":"2024-09-11T22:18:14.393807+0000","last_became_peered":"2024-09-11T22:18:14.393807+0000","last_unstale":"2024-09-11T22:18:14.397474+0000","last_undegraded":"2024-09-11T22:18:14.397474+0000","last_fullsized":"2024-09-11T22:18:14.397474+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:50.431556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384255+0000","last_change":"2024-09-11T22:18:14.384255+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384255+0000","last_undegraded":"2024-09-11T22:18:14.384255+0000","last_fullsized":"2024-09-11T22:18:14.384255+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.402438+0000","last_change":"2024-09-11T22:18:14.402005+0000","last_active":"2024-09-11T22:18:14.402438+0000","last_peered":"2024-09-11T22:18:14.402438+0000","last_clean":"2024-09-11T22:18:14.402438+0000","last_became_active":"2024-09-11T22:18:14.401763+0000","last_became_peered":"2024-09-11T22:18:14.401763+0000","last_unstale":"2024-09-11T22:18:14.402438+0000","last_undegraded":"2024-09-11T22:18:14.402438+0000","last_fullsized":"2024-09-11T22:18:14.402438+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:27.533288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.387117+0000","last_change":"2024-09-11T22:18:14.387117+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.387117+0000","last_undegraded":"2024-09-11T22:18:14.387117+0000","last_fullsized":"2024-09-11T22:18:14.387117+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"119'8","reported_seq":20,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.412514+0000","last_change":"2024-09-11T22:18:14.400223+0000","last_active":"2024-09-11T22:18:15.412514+0000","last_peered":"2024-09-11T22:18:15.412514+0000","last_clean":"2024-09-11T22:18:15.412514+0000","last_became_active":"2024-09-11T22:18:14.399666+0000","last_became_peered":"2024-09-11T22:18:14.399666+0000","last_unstale":"2024-09-11T22:18:15.412514+0000","last_undegraded":"2024-09-11T22:18:15.412514+0000","last_fullsized":"2024-09-11T22:18:15.412514+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:01.400475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.397968+0000","last_change":"2024-09-11T22:18:15.395943+0000","last_active":"2024-09-11T22:18:15.397968+0000","last_peered":"2024-09-11T22:18:15.397968+0000","last_clean":"2024-09-11T22:18:15.397968+0000","last_became_active":"2024-09-11T22:18:15.395087+0000","last_became_peered":"2024-09-11T22:18:15.395087+0000","last_unstale":"2024-09-11T22:18:15.397968+0000","last_undegraded":"2024-09-11T22:18:15.397968+0000","last_fullsized":"2024-09-11T22:18:15.397968+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.021061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.400885+0000","last_change":"2024-09-11T22:18:14.397820+0000","last_active":"2024-09-11T22:18:14.400885+0000","last_peered":"2024-09-11T22:18:14.400885+0000","last_clean":"2024-09-11T22:18:14.400885+0000","last_became_active":"2024-09-11T22:18:14.397467+0000","last_became_peered":"2024-09-11T22:18:14.397467+0000","last_unstale":"2024-09-11T22:18:14.400885+0000","last_undegraded":"2024-09-11T22:18:14.400885+0000","last_fullsized":"2024-09-11T22:18:14.400885+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:12.906587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385396+0000","last_change":"2024-09-11T22:18:14.385396+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385396+0000","last_undegraded":"2024-09-11T22:18:14.385396+0000","last_fullsized":"2024-09-11T22:18:14.385396+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.413949+0000","last_change":"2024-09-11T22:18:14.392009+0000","last_active":"2024-09-11T22:18:15.413949+0000","last_peered":"2024-09-11T22:18:15.413949+0000","last_clean":"2024-09-11T22:18:15.413949+0000","last_became_active":"2024-09-11T22:18:14.391704+0000","last_became_peered":"2024-09-11T22:18:14.391704+0000","last_unstale":"2024-09-11T22:18:15.413949+0000","last_undegraded":"2024-09-11T22:18:15.413949+0000","last_fullsized":"2024-09-11T22:18:15.413949+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:49.090421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082155+0000","last_change":"2024-09-11T22:18:15.398734+0000","last_active":"2024-09-11T22:18:17.082155+0000","last_peered":"2024-09-11T22:18:17.082155+0000","last_clean":"2024-09-11T22:18:17.082155+0000","last_became_active":"2024-09-11T22:18:15.398387+0000","last_became_peered":"2024-09-11T22:18:15.398387+0000","last_unstale":"2024-09-11T22:18:17.082155+0000","last_undegraded":"2024-09-11T22:18:17.082155+0000","last_fullsized":"2024-09-11T22:18:17.082155+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:15.451642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394934+0000","last_change":"2024-09-11T22:18:14.393793+0000","last_active":"2024-09-11T22:18:14.394934+0000","last_peered":"2024-09-11T22:18:14.394934+0000","last_clean":"2024-09-11T22:18:14.394934+0000","last_became_active":"2024-09-11T22:18:14.393496+0000","last_became_peered":"2024-09-11T22:18:14.393496+0000","last_unstale":"2024-09-11T22:18:14.394934+0000","last_undegraded":"2024-09-11T22:18:14.394934+0000","last_fullsized":"2024-09-11T22:18:14.394934+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:25.765535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082769+0000","last_change":"2024-09-11T22:18:15.406005+0000","last_active":"2024-09-11T22:18:17.082769+0000","last_peered":"2024-09-11T22:18:17.082769+0000","last_clean":"2024-09-11T22:18:17.082769+0000","last_became_active":"2024-09-11T22:18:15.405672+0000","last_became_peered":"2024-09-11T22:18:15.405672+0000","last_unstale":"2024-09-11T22:18:17.082769+0000","last_undegraded":"2024-09-11T22:18:17.082769+0000","last_fullsized":"2024-09-11T22:18:17.082769+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:21.104121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.396571+0000","last_change":"2024-09-11T22:18:14.395819+0000","last_active":"2024-09-11T22:18:14.396571+0000","last_peered":"2024-09-11T22:18:14.396571+0000","last_clean":"2024-09-11T22:18:14.396571+0000","last_became_active":"2024-09-11T22:18:14.395449+0000","last_became_peered":"2024-09-11T22:18:14.395449+0000","last_unstale":"2024-09-11T22:18:14.396571+0000","last_undegraded":"2024-09-11T22:18:14.396571+0000","last_fullsized":"2024-09-11T22:18:14.396571+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:48.276567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082374+0000","last_change":"2024-09-11T22:18:15.403455+0000","last_active":"2024-09-11T22:18:17.082374+0000","last_peered":"2024-09-11T22:18:17.082374+0000","last_clean":"2024-09-11T22:18:17.082374+0000","last_became_active":"2024-09-11T22:18:15.403172+0000","last_became_peered":"2024-09-11T22:18:15.403172+0000","last_unstale":"2024-09-11T22:18:17.082374+0000","last_undegraded":"2024-09-11T22:18:17.082374+0000","last_fullsized":"2024-09-11T22:18:17.082374+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:46.227885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394362+0000","last_change":"2024-09-11T22:18:14.392831+0000","last_active":"2024-09-11T22:18:14.394362+0000","last_peered":"2024-09-11T22:18:14.394362+0000","last_clean":"2024-09-11T22:18:14.394362+0000","last_became_active":"2024-09-11T22:18:14.392454+0000","last_became_peered":"2024-09-11T22:18:14.392454+0000","last_unstale":"2024-09-11T22:18:14.394362+0000","last_undegraded":"2024-09-11T22:18:14.394362+0000","last_fullsized":"2024-09-11T22:18:14.394362+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:00.751960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.389927+0000","last_change":"2024-09-11T22:18:14.389927+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.389927+0000","last_undegraded":"2024-09-11T22:18:14.389927+0000","last_fullsized":"2024-09-11T22:18:14.389927+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.382646+0000","last_change":"2024-09-11T22:18:14.394805+0000","last_active":"2024-09-11T22:18:15.382646+0000","last_peered":"2024-09-11T22:18:15.382646+0000","last_clean":"2024-09-11T22:18:15.382646+0000","last_became_active":"2024-09-11T22:18:14.394547+0000","last_became_peered":"2024-09-11T22:18:14.394547+0000","last_unstale":"2024-09-11T22:18:15.382646+0000","last_undegraded":"2024-09-11T22:18:15.382646+0000","last_fullsized":"2024-09-11T22:18:15.382646+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:31.918926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082286+0000","last_change":"2024-09-11T22:18:15.400740+0000","last_active":"2024-09-11T22:18:17.082286+0000","last_peered":"2024-09-11T22:18:17.082286+0000","last_clean":"2024-09-11T22:18:17.082286+0000","last_became_active":"2024-09-11T22:18:15.400458+0000","last_became_peered":"2024-09-11T22:18:15.400458+0000","last_unstale":"2024-09-11T22:18:17.082286+0000","last_undegraded":"2024-09-11T22:18:17.082286+0000","last_fullsized":"2024-09-11T22:18:17.082286+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.947194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394331+0000","last_change":"2024-09-11T22:18:14.393175+0000","last_active":"2024-09-11T22:18:14.394331+0000","last_peered":"2024-09-11T22:18:14.394331+0000","last_clean":"2024-09-11T22:18:14.394331+0000","last_became_active":"2024-09-11T22:18:14.389968+0000","last_became_peered":"2024-09-11T22:18:14.389968+0000","last_unstale":"2024-09-11T22:18:14.394331+0000","last_undegraded":"2024-09-11T22:18:14.394331+0000","last_fullsized":"2024-09-11T22:18:14.394331+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:46.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.386709+0000","last_change":"2024-09-11T22:18:14.386709+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.386709+0000","last_undegraded":"2024-09-11T22:18:14.386709+0000","last_fullsized":"2024-09-11T22:18:14.386709+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.402979+0000","last_change":"2024-09-11T22:18:14.401946+0000","last_active":"2024-09-11T22:18:14.402979+0000","last_peered":"2024-09-11T22:18:14.402979+0000","last_clean":"2024-09-11T22:18:14.402979+0000","last_became_active":"2024-09-11T22:18:14.401243+0000","last_became_peered":"2024-09-11T22:18:14.401243+0000","last_unstale":"2024-09-11T22:18:14.402979+0000","last_undegraded":"2024-09-11T22:18:14.402979+0000","last_fullsized":"2024-09-11T22:18:14.402979+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:00.030990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385967+0000","last_change":"2024-09-11T22:18:14.385967+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385967+0000","last_undegraded":"2024-09-11T22:18:14.385967+0000","last_fullsized":"2024-09-11T22:18:14.385967+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.397455+0000","last_change":"2024-09-11T22:18:14.395777+0000","last_active":"2024-09-11T22:18:14.397455+0000","last_peered":"2024-09-11T22:18:14.397455+0000","last_clean":"2024-09-11T22:18:14.397455+0000","last_became_active":"2024-09-11T22:18:14.395436+0000","last_became_peered":"2024-09-11T22:18:14.395436+0000","last_unstale":"2024-09-11T22:18:14.397455+0000","last_undegraded":"2024-09-11T22:18:14.397455+0000","last_fullsized":"2024-09-11T22:18:14.397455+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:10.730302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.390590+0000","last_change":"2024-09-11T22:18:14.390590+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.390590+0000","last_undegraded":"2024-09-11T22:18:14.390590+0000","last_fullsized":"2024-09-11T22:18:14.390590+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394388+0000","last_change":"2024-09-11T22:18:14.392721+0000","last_active":"2024-09-11T22:18:14.394388+0000","last_peered":"2024-09-11T22:18:14.394388+0000","last_clean":"2024-09-11T22:18:14.394388+0000","last_became_active":"2024-09-11T22:18:14.392450+0000","last_became_peered":"2024-09-11T22:18:14.392450+0000","last_unstale":"2024-09-11T22:18:14.394388+0000","last_undegraded":"2024-09-11T22:18:14.394388+0000","last_fullsized":"2024-09-11T22:18:14.394388+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:38.957310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.388147+0000","last_change":"2024-09-11T22:18:14.388147+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.388147+0000","last_undegraded":"2024-09-11T22:18:14.388147+0000","last_fullsized":"2024-09-11T22:18:14.388147+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.402675+0000","last_change":"2024-09-11T22:18:14.401709+0000","last_active":"2024-09-11T22:18:14.402675+0000","last_peered":"2024-09-11T22:18:14.402675+0000","last_clean":"2024-09-11T22:18:14.402675+0000","last_became_active":"2024-09-11T22:18:14.401223+0000","last_became_peered":"2024-09-11T22:18:14.401223+0000","last_unstale":"2024-09-11T22:18:14.402675+0000","last_undegraded":"2024-09-11T22:18:14.402675+0000","last_fullsized":"2024-09-11T22:18:14.402675+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:29.174812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.385657+0000","last_change":"2024-09-11T22:18:14.385657+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.385657+0000","last_undegraded":"2024-09-11T22:18:14.385657+0000","last_fullsized":"2024-09-11T22:18:14.385657+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.398799+0000","last_change":"2024-09-11T22:18:14.397568+0000","last_active":"2024-09-11T22:18:14.398799+0000","last_peered":"2024-09-11T22:18:14.398799+0000","last_clean":"2024-09-11T22:18:14.398799+0000","last_became_active":"2024-09-11T22:18:14.397290+0000","last_became_peered":"2024-09-11T22:18:14.397290+0000","last_unstale":"2024-09-11T22:18:14.398799+0000","last_undegraded":"2024-09-11T22:18:14.398799+0000","last_fullsized":"2024-09-11T22:18:14.398799+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:03.775272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.382794+0000","last_change":"2024-09-11T22:18:14.382794+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.382794+0000","last_undegraded":"2024-09-11T22:18:14.382794+0000","last_fullsized":"2024-09-11T22:18:14.382794+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394819+0000","last_change":"2024-09-11T22:18:14.392868+0000","last_active":"2024-09-11T22:18:14.394819+0000","last_peered":"2024-09-11T22:18:14.394819+0000","last_clean":"2024-09-11T22:18:14.394819+0000","last_became_active":"2024-09-11T22:18:14.392570+0000","last_became_peered":"2024-09-11T22:18:14.392570+0000","last_unstale":"2024-09-11T22:18:14.394819+0000","last_undegraded":"2024-09-11T22:18:14.394819+0000","last_fullsized":"2024-09-11T22:18:14.394819+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:56.568071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.383622+0000","last_change":"2024-09-11T22:18:14.383622+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.383622+0000","last_undegraded":"2024-09-11T22:18:14.383622+0000","last_fullsized":"2024-09-11T22:18:14.383622+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.394613+0000","last_change":"2024-09-11T22:18:14.393814+0000","last_active":"2024-09-11T22:18:14.394613+0000","last_peered":"2024-09-11T22:18:14.394613+0000","last_clean":"2024-09-11T22:18:14.394613+0000","last_became_active":"2024-09-11T22:18:14.393396+0000","last_became_peered":"2024-09-11T22:18:14.393396+0000","last_unstale":"2024-09-11T22:18:14.394613+0000","last_undegraded":"2024-09-11T22:18:14.394613+0000","last_fullsized":"2024-09-11T22:18:14.394613+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:38.957310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082307+0000","last_change":"2024-09-11T22:18:15.408858+0000","last_active":"2024-09-11T22:18:17.082307+0000","last_peered":"2024-09-11T22:18:17.082307+0000","last_clean":"2024-09-11T22:18:17.082307+0000","last_became_active":"2024-09-11T22:18:15.408384+0000","last_became_peered":"2024-09-11T22:18:15.408384+0000","last_unstale":"2024-09-11T22:18:17.082307+0000","last_undegraded":"2024-09-11T22:18:17.082307+0000","last_fullsized":"2024-09-11T22:18:17.082307+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:45:12.601612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.382293+0000","last_change":"2024-09-11T22:18:14.396779+0000","last_active":"2024-09-11T22:18:15.382293+0000","last_peered":"2024-09-11T22:18:15.382293+0000","last_clean":"2024-09-11T22:18:15.382293+0000","last_became_active":"2024-09-11T22:18:14.396480+0000","last_became_peered":"2024-09-11T22:18:14.396480+0000","last_unstale":"2024-09-11T22:18:15.382293+0000","last_undegraded":"2024-09-11T22:18:15.382293+0000","last_fullsized":"2024-09-11T22:18:15.382293+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:02.602508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384193+0000","last_change":"2024-09-11T22:18:14.384193+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384193+0000","last_undegraded":"2024-09-11T22:18:14.384193+0000","last_fullsized":"2024-09-11T22:18:14.384193+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.403131+0000","last_change":"2024-09-11T22:18:14.402459+0000","last_active":"2024-09-11T22:18:14.403131+0000","last_peered":"2024-09-11T22:18:14.403131+0000","last_clean":"2024-09-11T22:18:14.403131+0000","last_became_active":"2024-09-11T22:18:14.402137+0000","last_became_peered":"2024-09-11T22:18:14.402137+0000","last_unstale":"2024-09-11T22:18:14.403131+0000","last_undegraded":"2024-09-11T22:18:14.403131+0000","last_fullsized":"2024-09-11T22:18:14.403131+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:09.073102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":118,"state":"creating+peering","last_fresh":"2024-09-11T22:18:14.384812+0000","last_change":"2024-09-11T22:18:14.384812+0000","last_active":"2024-09-11T22:18:14.373012+0000","last_peered":"2024-09-11T22:18:14.373012+0000","last_clean":"2024-09-11T22:18:14.373012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:18:14.384812+0000","last_undegraded":"2024-09-11T22:18:14.384812+0000","last_fullsized":"2024-09-11T22:18:14.384812+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-11T22:18:14.396562+0000","last_change":"2024-09-11T22:18:14.395747+0000","last_active":"2024-09-11T22:18:14.396562+0000","last_peered":"2024-09-11T22:18:14.396562+0000","last_clean":"2024-09-11T22:18:14.396562+0000","last_became_active":"2024-09-11T22:18:14.395432+0000","last_became_peered":"2024-09-11T22:18:14.395432+0000","last_unstale":"2024-09-11T22:18:14.396562+0000","last_undegraded":"2024-09-11T22:18:14.396562+0000","last_fullsized":"2024-09-11T22:18:14.396562+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:15.717819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":351,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082372+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:18:17.082372+0000","last_peered":"2024-09-11T22:18:17.082372+0000","last_clean":"2024-09-11T22:18:17.082372+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:18:17.082372+0000","last_undegraded":"2024-09-11T22:18:17.082372+0000","last_fullsized":"2024-09-11T22:18:17.082372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509531,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46492,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325348,"statfs":{"total":96636764160,"available":96589156352,"internally_reserved":0,"allocated":1445888,"data_stored":630553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509528,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40920,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330920,"statfs":{"total":96636764160,"available":96594862080,"internally_reserved":0,"allocated":1445888,"data_stored":630553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509530,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46488,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325352,"statfs":{"total":96636764160,"available":96589160448,"internally_reserved":0,"allocated":1445888,"data_stored":630553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509530,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54808,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317032,"statfs":{"total":96636764160,"available":96580640768,"internally_reserved":0,"allocated":1445888,"data_stored":630553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509530,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58972,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312868,"statfs":{"total":96636764160,"available":96576376832,"internally_reserved":0,"allocated":1445888,"data_stored":630553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509529,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51228,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320612,"statfs":{"total":96636764160,"available":96584306688,"internally_reserved":0,"allocated":2039808,"data_stored":1220921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45704,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326136,"statfs":{"total":96636764160,"available":96589963264,"internally_reserved":0,"allocated":2084864,"data_stored":1240887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54840,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317000,"statfs":{"total":96636764160,"available":96580608000,"internally_reserved":0,"allocated":1470464,"data_stored":643603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:18:19.357 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:18:19.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.495+0000 7fb3d72e6640 1 Processor -- start 2024-09-11T22:18:19.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.495+0000 7fb3d72e6640 1 -- start start 2024-09-11T22:18:19.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.496+0000 7fb3d72e6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb3d015e8e0 0x7fb3d00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.496+0000 7fb3d72e6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3d0162350 0x7fb3d01627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.496+0000 7fb3d72e6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3d0163080 con 0x7fb3d00d1580 2024-09-11T22:18:19.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.496+0000 7fb3d72e6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb3d015ecc0 con 0x7fb3d015e8e0 2024-09-11T22:18:19.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.496+0000 7fb3d72e6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d00d2ad0 con 0x7fb3d0162350 2024-09-11T22:18:19.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.496+0000 7fb3d5082640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb3d015e8e0 0x7fb3d00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.496+0000 7fb3d5883640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3d0162350 0x7fb3d01627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.496+0000 7fb3d5082640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb3d015e8e0 0x7fb3d00b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:60576/0 (socket says 172.21.15.50:60576) 2024-09-11T22:18:19.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.496+0000 7fb3d4881640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb3d00d1580 0x7fb3d00d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:39826/0 (socket says 172.21.15.50:39826) 2024-09-11T22:18:19.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.496+0000 7fb3d5082640 1 -- 172.21.15.50:0/3292583769 learned_addr learned my addr 172.21.15.50:0/3292583769 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:19.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.497+0000 7fb3d5082640 1 -- 172.21.15.50:0/3292583769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3d0162350 msgr2=0x7fb3d01627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:19.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.497+0000 7fb3d5082640 1 --2- 172.21.15.50:0/3292583769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3d0162350 0x7fb3d01627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.497+0000 7fb3d5082640 1 -- 172.21.15.50:0/3292583769 >> v1:172.21.15.77:6789/0 conn(0x7fb3d00d1580 legacy=0x7fb3d00d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.497+0000 7fb3d5082640 1 -- 172.21.15.50:0/3292583769 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d00d2d20 con 0x7fb3d015e8e0 2024-09-11T22:18:19.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.497+0000 7fb3c7fff640 1 -- 172.21.15.50:0/3292583769 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1413463962 0 0) 0x7fb3d0163080 con 0x7fb3d00d1580 2024-09-11T22:18:19.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.497+0000 7fb3d5883640 1 --2- 172.21.15.50:0/3292583769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3d0162350 0x7fb3d01627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.497+0000 7fb3d5082640 1 --2- 172.21.15.50:0/3292583769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d015e8e0 0x7fb3d00b7880 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009870 tx=0x7fb3cc02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a66785b8935cc8b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.498+0000 7fb3c7fff640 1 -- 172.21.15.50:0/3292583769 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc037070 con 0x7fb3d015e8e0 2024-09-11T22:18:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.498+0000 7fb3c7fff640 1 -- 172.21.15.50:0/3292583769 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3cc02ae50 con 0x7fb3d015e8e0 2024-09-11T22:18:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.498+0000 7fb3c7fff640 1 -- 172.21.15.50:0/3292583769 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc032860 con 0x7fb3d015e8e0 2024-09-11T22:18:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.498+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3292583769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d015e8e0 msgr2=0x7fb3d00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.498+0000 7fb3d72e6640 1 --2- 172.21.15.50:0/3292583769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d015e8e0 0x7fb3d00b7880 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009870 tx=0x7fb3cc02a300 comp rx=0 tx=0).stop 2024-09-11T22:18:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.498+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3292583769 shutdown_connections 2024-09-11T22:18:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.498+0000 7fb3d72e6640 1 --2- 172.21.15.50:0/3292583769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3d0162350 0x7fb3d01627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.498+0000 7fb3d72e6640 1 --2- 172.21.15.50:0/3292583769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d015e8e0 0x7fb3d00b7880 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.498+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3292583769 >> 172.21.15.50:0/3292583769 conn(0x7fb3d0067ba0 msgr2=0x7fb3d0067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.498+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3292583769 shutdown_connections 2024-09-11T22:18:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.498+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3292583769 wait complete. 2024-09-11T22:18:19.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.499+0000 7fb3d72e6640 1 Processor -- start 2024-09-11T22:18:19.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.499+0000 7fb3d72e6640 1 -- start start 2024-09-11T22:18:19.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.500+0000 7fb3d72e6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3d00d1580 0x7fb3d0159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.500+0000 7fb3d72e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3d015e8e0 0x7fb3d0154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.500+0000 7fb3d72e6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d0162350 0x7fb3d00cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.500+0000 7fb3d72e6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d0162d20 con 0x7fb3d015e8e0 2024-09-11T22:18:19.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.500+0000 7fb3d72e6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d00d3370 con 0x7fb3d0162350 2024-09-11T22:18:19.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.500+0000 7fb3d72e6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d00d3800 con 0x7fb3d00d1580 2024-09-11T22:18:19.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.500+0000 7fb3d4881640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3d015e8e0 0x7fb3d0154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.500+0000 7fb3d4881640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3d015e8e0 0x7fb3d0154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56294/0 (socket says 172.21.15.50:56294) 2024-09-11T22:18:19.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.500+0000 7fb3d4881640 1 -- 172.21.15.50:0/3354622841 learned_addr learned my addr 172.21.15.50:0/3354622841 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:19.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.501+0000 7fb3d5883640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d0162350 0x7fb3d00cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.501+0000 7fb3d5082640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3d00d1580 0x7fb3d0159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.501+0000 7fb3d4881640 1 -- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3d00d1580 msgr2=0x7fb3d0159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.501+0000 7fb3d4881640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3d00d1580 0x7fb3d0159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.501+0000 7fb3d4881640 1 -- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d0162350 msgr2=0x7fb3d00cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.501+0000 7fb3d4881640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d0162350 0x7fb3d00cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.501+0000 7fb3d4881640 1 -- 172.21.15.50:0/3354622841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d0159bd0 con 0x7fb3d015e8e0 2024-09-11T22:18:19.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.501+0000 7fb3d4881640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3d015e8e0 0x7fb3d0154480 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000c4d0 tx=0x7fb3c000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:19.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.501+0000 7fb3c5ffb640 1 -- 172.21.15.50:0/3354622841 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0018070 con 0x7fb3d015e8e0 2024-09-11T22:18:19.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.501+0000 7fb3c5ffb640 1 -- 172.21.15.50:0/3354622841 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c0007500 con 0x7fb3d015e8e0 2024-09-11T22:18:19.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.501+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3354622841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d00b7e60 con 0x7fb3d015e8e0 2024-09-11T22:18:19.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.501+0000 7fb3c5ffb640 1 -- 172.21.15.50:0/3354622841 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0004a20 con 0x7fb3d015e8e0 2024-09-11T22:18:19.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.501+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3354622841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d00b8420 con 0x7fb3d015e8e0 2024-09-11T22:18:19.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.502+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3354622841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d00b7880 con 0x7fb3d015e8e0 2024-09-11T22:18:19.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.503+0000 7fb3c5ffb640 1 -- 172.21.15.50:0/3354622841 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3c001b070 con 0x7fb3d015e8e0 2024-09-11T22:18:19.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.503+0000 7fb3c5ffb640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb3b406be30 0x7fb3b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.503+0000 7fb3c5ffb640 1 -- 172.21.15.50:0/3354622841 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fb3c008a1e0 con 0x7fb3d015e8e0 2024-09-11T22:18:19.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.503+0000 7fb3d5082640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb3b406be30 0x7fb3b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.504+0000 7fb3d5082640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb3b406be30 0x7fb3b406e2f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc034000 tx=0x7fb3cc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:19.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.508+0000 7fb3c5ffb640 1 -- 172.21.15.50:0/3354622841 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3c0058b90 con 0x7fb3d015e8e0 2024-09-11T22:18:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.681+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3354622841 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3d00ba770 con 0x7fb3b406be30 2024-09-11T22:18:19.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.688+0000 7fb3c5ffb640 1 -- 172.21.15.50:0/3354622841 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252481 (secure 0 0 0) 0x7fb3d00ba770 con 0x7fb3b406be30 2024-09-11T22:18:19.692 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:19.694 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:18:19.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.691+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb3b406be30 msgr2=0x7fb3b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.691+0000 7fb3d72e6640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb3b406be30 0x7fb3b406e2f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc034000 tx=0x7fb3cc02e000 comp rx=0 tx=0).stop 2024-09-11T22:18:19.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.691+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3354622841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3d015e8e0 msgr2=0x7fb3d0154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.691+0000 7fb3d72e6640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3d015e8e0 0x7fb3d0154480 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000c4d0 tx=0x7fb3c000c990 comp rx=0 tx=0).stop 2024-09-11T22:18:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.691+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3354622841 shutdown_connections 2024-09-11T22:18:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.691+0000 7fb3d72e6640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb3b406be30 0x7fb3b406e2f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.691+0000 7fb3d72e6640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d0162350 0x7fb3d00cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.691+0000 7fb3d72e6640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3d015e8e0 0x7fb3d0154480 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.691+0000 7fb3d72e6640 1 --2- 172.21.15.50:0/3354622841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3d00d1580 0x7fb3d0159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.691+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3354622841 >> 172.21.15.50:0/3354622841 conn(0x7fb3d0067ba0 msgr2=0x7fb3d0067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.691+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3354622841 shutdown_connections 2024-09-11T22:18:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.691+0000 7fb3d72e6640 1 -- 172.21.15.50:0/3354622841 wait complete. 2024-09-11T22:18:19.703 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-11T22:18:19.468647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403892,"kb_used_data":12796,"kb_used_omap":12,"kb_used_meta":390899,"kb_avail":754570828,"statfs":{"total":773094113280,"available":772680527872,"internally_reserved":0,"allocated":13103104,"data_stored":6378480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":400281137},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001389"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893406+0000","last_change":"2024-09-11T22:18:15.409177+0000","last_active":"2024-09-11T22:18:16.893406+0000","last_peered":"2024-09-11T22:18:16.893406+0000","last_clean":"2024-09-11T22:18:16.893406+0000","last_became_active":"2024-09-11T22:18:15.408821+0000","last_became_peered":"2024-09-11T22:18:15.408821+0000","last_unstale":"2024-09-11T22:18:16.893406+0000","last_undegraded":"2024-09-11T22:18:16.893406+0000","last_fullsized":"2024-09-11T22:18:16.893406+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:37.178747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082482+0000","last_change":"2024-09-11T22:18:15.407839+0000","last_active":"2024-09-11T22:18:17.082482+0000","last_peered":"2024-09-11T22:18:17.082482+0000","last_clean":"2024-09-11T22:18:17.082482+0000","last_became_active":"2024-09-11T22:18:15.407562+0000","last_became_peered":"2024-09-11T22:18:15.407562+0000","last_unstale":"2024-09-11T22:18:17.082482+0000","last_undegraded":"2024-09-11T22:18:17.082482+0000","last_fullsized":"2024-09-11T22:18:17.082482+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:15.807600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082458+0000","last_change":"2024-09-11T22:18:15.404107+0000","last_active":"2024-09-11T22:18:17.082458+0000","last_peered":"2024-09-11T22:18:17.082458+0000","last_clean":"2024-09-11T22:18:17.082458+0000","last_became_active":"2024-09-11T22:18:15.403793+0000","last_became_peered":"2024-09-11T22:18:15.403793+0000","last_unstale":"2024-09-11T22:18:17.082458+0000","last_undegraded":"2024-09-11T22:18:17.082458+0000","last_fullsized":"2024-09-11T22:18:17.082458+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:00.201633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893154+0000","last_change":"2024-09-11T22:18:15.402759+0000","last_active":"2024-09-11T22:18:16.893154+0000","last_peered":"2024-09-11T22:18:16.893154+0000","last_clean":"2024-09-11T22:18:16.893154+0000","last_became_active":"2024-09-11T22:18:15.402466+0000","last_became_peered":"2024-09-11T22:18:15.402466+0000","last_unstale":"2024-09-11T22:18:16.893154+0000","last_undegraded":"2024-09-11T22:18:16.893154+0000","last_fullsized":"2024-09-11T22:18:16.893154+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:55.190102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.394843+0000","last_change":"2024-09-11T22:18:15.391099+0000","last_active":"2024-09-11T22:18:15.394843+0000","last_peered":"2024-09-11T22:18:15.394843+0000","last_clean":"2024-09-11T22:18:15.394843+0000","last_became_active":"2024-09-11T22:18:15.390672+0000","last_became_peered":"2024-09-11T22:18:15.390672+0000","last_unstale":"2024-09-11T22:18:15.394843+0000","last_undegraded":"2024-09-11T22:18:15.394843+0000","last_fullsized":"2024-09-11T22:18:15.394843+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:05.504125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398635+0000","last_change":"2024-09-11T22:18:15.404541+0000","last_active":"2024-09-11T22:18:16.398635+0000","last_peered":"2024-09-11T22:18:16.398635+0000","last_clean":"2024-09-11T22:18:16.398635+0000","last_became_active":"2024-09-11T22:18:15.404272+0000","last_became_peered":"2024-09-11T22:18:15.404272+0000","last_unstale":"2024-09-11T22:18:16.398635+0000","last_undegraded":"2024-09-11T22:18:16.398635+0000","last_fullsized":"2024-09-11T22:18:16.398635+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:37.132606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406533+0000","last_change":"2024-09-11T22:18:15.389553+0000","last_active":"2024-09-11T22:18:16.406533+0000","last_peered":"2024-09-11T22:18:16.406533+0000","last_clean":"2024-09-11T22:18:16.406533+0000","last_became_active":"2024-09-11T22:18:15.389272+0000","last_became_peered":"2024-09-11T22:18:15.389272+0000","last_unstale":"2024-09-11T22:18:16.406533+0000","last_undegraded":"2024-09-11T22:18:16.406533+0000","last_fullsized":"2024-09-11T22:18:16.406533+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:46.204774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082119+0000","last_change":"2024-09-11T22:18:15.407146+0000","last_active":"2024-09-11T22:18:17.082119+0000","last_peered":"2024-09-11T22:18:17.082119+0000","last_clean":"2024-09-11T22:18:17.082119+0000","last_became_active":"2024-09-11T22:18:15.406866+0000","last_became_peered":"2024-09-11T22:18:15.406866+0000","last_unstale":"2024-09-11T22:18:17.082119+0000","last_undegraded":"2024-09-11T22:18:17.082119+0000","last_fullsized":"2024-09-11T22:18:17.082119+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:39.415424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893448+0000","last_change":"2024-09-11T22:18:15.397882+0000","last_active":"2024-09-11T22:18:16.893448+0000","last_peered":"2024-09-11T22:18:16.893448+0000","last_clean":"2024-09-11T22:18:16.893448+0000","last_became_active":"2024-09-11T22:18:15.397607+0000","last_became_peered":"2024-09-11T22:18:15.397607+0000","last_unstale":"2024-09-11T22:18:16.893448+0000","last_undegraded":"2024-09-11T22:18:16.893448+0000","last_fullsized":"2024-09-11T22:18:16.893448+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:19.681850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893421+0000","last_change":"2024-09-11T22:18:15.405141+0000","last_active":"2024-09-11T22:18:16.893421+0000","last_peered":"2024-09-11T22:18:16.893421+0000","last_clean":"2024-09-11T22:18:16.893421+0000","last_became_active":"2024-09-11T22:18:15.399615+0000","last_became_peered":"2024-09-11T22:18:15.399615+0000","last_unstale":"2024-09-11T22:18:16.893421+0000","last_undegraded":"2024-09-11T22:18:16.893421+0000","last_fullsized":"2024-09-11T22:18:16.893421+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:45.597623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082102+0000","last_change":"2024-09-11T22:18:15.402133+0000","last_active":"2024-09-11T22:18:17.082102+0000","last_peered":"2024-09-11T22:18:17.082102+0000","last_clean":"2024-09-11T22:18:17.082102+0000","last_became_active":"2024-09-11T22:18:15.401892+0000","last_became_peered":"2024-09-11T22:18:15.401892+0000","last_unstale":"2024-09-11T22:18:17.082102+0000","last_undegraded":"2024-09-11T22:18:17.082102+0000","last_fullsized":"2024-09-11T22:18:17.082102+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:10.078383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893163+0000","last_change":"2024-09-11T22:18:15.395858+0000","last_active":"2024-09-11T22:18:16.893163+0000","last_peered":"2024-09-11T22:18:16.893163+0000","last_clean":"2024-09-11T22:18:16.893163+0000","last_became_active":"2024-09-11T22:18:15.395576+0000","last_became_peered":"2024-09-11T22:18:15.395576+0000","last_unstale":"2024-09-11T22:18:16.893163+0000","last_undegraded":"2024-09-11T22:18:16.893163+0000","last_fullsized":"2024-09-11T22:18:16.893163+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:39.816196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082040+0000","last_change":"2024-09-11T22:18:15.401611+0000","last_active":"2024-09-11T22:18:17.082040+0000","last_peered":"2024-09-11T22:18:17.082040+0000","last_clean":"2024-09-11T22:18:17.082040+0000","last_became_active":"2024-09-11T22:18:15.401153+0000","last_became_peered":"2024-09-11T22:18:15.401153+0000","last_unstale":"2024-09-11T22:18:17.082040+0000","last_undegraded":"2024-09-11T22:18:17.082040+0000","last_fullsized":"2024-09-11T22:18:17.082040+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:49.865380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082235+0000","last_change":"2024-09-11T22:18:15.400570+0000","last_active":"2024-09-11T22:18:17.082235+0000","last_peered":"2024-09-11T22:18:17.082235+0000","last_clean":"2024-09-11T22:18:17.082235+0000","last_became_active":"2024-09-11T22:18:15.400292+0000","last_became_peered":"2024-09-11T22:18:15.400292+0000","last_unstale":"2024-09-11T22:18:17.082235+0000","last_undegraded":"2024-09-11T22:18:17.082235+0000","last_fullsized":"2024-09-11T22:18:17.082235+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:59.644890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398589+0000","last_change":"2024-09-11T22:18:15.405103+0000","last_active":"2024-09-11T22:18:16.398589+0000","last_peered":"2024-09-11T22:18:16.398589+0000","last_clean":"2024-09-11T22:18:16.398589+0000","last_became_active":"2024-09-11T22:18:15.404759+0000","last_became_peered":"2024-09-11T22:18:15.404759+0000","last_unstale":"2024-09-11T22:18:16.398589+0000","last_undegraded":"2024-09-11T22:18:16.398589+0000","last_fullsized":"2024-09-11T22:18:16.398589+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:29.712119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892762+0000","last_change":"2024-09-11T22:18:15.400781+0000","last_active":"2024-09-11T22:18:16.892762+0000","last_peered":"2024-09-11T22:18:16.892762+0000","last_clean":"2024-09-11T22:18:16.892762+0000","last_became_active":"2024-09-11T22:18:15.398089+0000","last_became_peered":"2024-09-11T22:18:15.398089+0000","last_unstale":"2024-09-11T22:18:16.892762+0000","last_undegraded":"2024-09-11T22:18:16.892762+0000","last_fullsized":"2024-09-11T22:18:16.892762+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:18.105927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082671+0000","last_change":"2024-09-11T22:18:15.405401+0000","last_active":"2024-09-11T22:18:17.082671+0000","last_peered":"2024-09-11T22:18:17.082671+0000","last_clean":"2024-09-11T22:18:17.082671+0000","last_became_active":"2024-09-11T22:18:15.404891+0000","last_became_peered":"2024-09-11T22:18:15.404891+0000","last_unstale":"2024-09-11T22:18:17.082671+0000","last_undegraded":"2024-09-11T22:18:17.082671+0000","last_fullsized":"2024-09-11T22:18:17.082671+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:31.146707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406049+0000","last_change":"2024-09-11T22:18:15.397439+0000","last_active":"2024-09-11T22:18:16.406049+0000","last_peered":"2024-09-11T22:18:16.406049+0000","last_clean":"2024-09-11T22:18:16.406049+0000","last_became_active":"2024-09-11T22:18:15.397160+0000","last_became_peered":"2024-09-11T22:18:15.397160+0000","last_unstale":"2024-09-11T22:18:16.406049+0000","last_undegraded":"2024-09-11T22:18:16.406049+0000","last_fullsized":"2024-09-11T22:18:16.406049+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:13.911868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082602+0000","last_change":"2024-09-11T22:18:15.401501+0000","last_active":"2024-09-11T22:18:17.082602+0000","last_peered":"2024-09-11T22:18:17.082602+0000","last_clean":"2024-09-11T22:18:17.082602+0000","last_became_active":"2024-09-11T22:18:15.401260+0000","last_became_peered":"2024-09-11T22:18:15.401260+0000","last_unstale":"2024-09-11T22:18:17.082602+0000","last_undegraded":"2024-09-11T22:18:17.082602+0000","last_fullsized":"2024-09-11T22:18:17.082602+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:28.302797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082438+0000","last_change":"2024-09-11T22:18:15.399188+0000","last_active":"2024-09-11T22:18:17.082438+0000","last_peered":"2024-09-11T22:18:17.082438+0000","last_clean":"2024-09-11T22:18:17.082438+0000","last_became_active":"2024-09-11T22:18:15.398888+0000","last_became_peered":"2024-09-11T22:18:15.398888+0000","last_unstale":"2024-09-11T22:18:17.082438+0000","last_undegraded":"2024-09-11T22:18:17.082438+0000","last_fullsized":"2024-09-11T22:18:17.082438+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:04.780553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082114+0000","last_change":"2024-09-11T22:18:15.401009+0000","last_active":"2024-09-11T22:18:17.082114+0000","last_peered":"2024-09-11T22:18:17.082114+0000","last_clean":"2024-09-11T22:18:17.082114+0000","last_became_active":"2024-09-11T22:18:15.400439+0000","last_became_peered":"2024-09-11T22:18:15.400439+0000","last_unstale":"2024-09-11T22:18:17.082114+0000","last_undegraded":"2024-09-11T22:18:17.082114+0000","last_fullsized":"2024-09-11T22:18:17.082114+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:11.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081778+0000","last_change":"2024-09-11T22:18:15.401263+0000","last_active":"2024-09-11T22:18:17.081778+0000","last_peered":"2024-09-11T22:18:17.081778+0000","last_clean":"2024-09-11T22:18:17.081778+0000","last_became_active":"2024-09-11T22:18:15.400714+0000","last_became_peered":"2024-09-11T22:18:15.400714+0000","last_unstale":"2024-09-11T22:18:17.081778+0000","last_undegraded":"2024-09-11T22:18:17.081778+0000","last_fullsized":"2024-09-11T22:18:17.081778+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:01.590421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081610+0000","last_change":"2024-09-11T22:18:15.399817+0000","last_active":"2024-09-11T22:18:17.081610+0000","last_peered":"2024-09-11T22:18:17.081610+0000","last_clean":"2024-09-11T22:18:17.081610+0000","last_became_active":"2024-09-11T22:18:15.399529+0000","last_became_peered":"2024-09-11T22:18:15.399529+0000","last_unstale":"2024-09-11T22:18:17.081610+0000","last_undegraded":"2024-09-11T22:18:17.081610+0000","last_fullsized":"2024-09-11T22:18:17.081610+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:45.460691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081745+0000","last_change":"2024-09-11T22:18:15.400489+0000","last_active":"2024-09-11T22:18:17.081745+0000","last_peered":"2024-09-11T22:18:17.081745+0000","last_clean":"2024-09-11T22:18:17.081745+0000","last_became_active":"2024-09-11T22:18:15.399974+0000","last_became_peered":"2024-09-11T22:18:15.399974+0000","last_unstale":"2024-09-11T22:18:17.081745+0000","last_undegraded":"2024-09-11T22:18:17.081745+0000","last_fullsized":"2024-09-11T22:18:17.081745+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:40.818166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082649+0000","last_change":"2024-09-11T22:18:15.405171+0000","last_active":"2024-09-11T22:18:17.082649+0000","last_peered":"2024-09-11T22:18:17.082649+0000","last_clean":"2024-09-11T22:18:17.082649+0000","last_became_active":"2024-09-11T22:18:15.404504+0000","last_became_peered":"2024-09-11T22:18:15.404504+0000","last_unstale":"2024-09-11T22:18:17.082649+0000","last_undegraded":"2024-09-11T22:18:17.082649+0000","last_fullsized":"2024-09-11T22:18:17.082649+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:43.508984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893585+0000","last_change":"2024-09-11T22:18:15.409016+0000","last_active":"2024-09-11T22:18:16.893585+0000","last_peered":"2024-09-11T22:18:16.893585+0000","last_clean":"2024-09-11T22:18:16.893585+0000","last_became_active":"2024-09-11T22:18:15.408314+0000","last_became_peered":"2024-09-11T22:18:15.408314+0000","last_unstale":"2024-09-11T22:18:16.893585+0000","last_undegraded":"2024-09-11T22:18:16.893585+0000","last_fullsized":"2024-09-11T22:18:16.893585+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:53.455324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398821+0000","last_change":"2024-09-11T22:18:15.396012+0000","last_active":"2024-09-11T22:18:16.398821+0000","last_peered":"2024-09-11T22:18:16.398821+0000","last_clean":"2024-09-11T22:18:16.398821+0000","last_became_active":"2024-09-11T22:18:15.395731+0000","last_became_peered":"2024-09-11T22:18:15.395731+0000","last_unstale":"2024-09-11T22:18:16.398821+0000","last_undegraded":"2024-09-11T22:18:16.398821+0000","last_fullsized":"2024-09-11T22:18:16.398821+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:30.758503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082064+0000","last_change":"2024-09-11T22:18:15.398339+0000","last_active":"2024-09-11T22:18:17.082064+0000","last_peered":"2024-09-11T22:18:17.082064+0000","last_clean":"2024-09-11T22:18:17.082064+0000","last_became_active":"2024-09-11T22:18:15.397355+0000","last_became_peered":"2024-09-11T22:18:15.397355+0000","last_unstale":"2024-09-11T22:18:17.082064+0000","last_undegraded":"2024-09-11T22:18:17.082064+0000","last_fullsized":"2024-09-11T22:18:17.082064+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:08.839766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082495+0000","last_change":"2024-09-11T22:18:15.400684+0000","last_active":"2024-09-11T22:18:17.082495+0000","last_peered":"2024-09-11T22:18:17.082495+0000","last_clean":"2024-09-11T22:18:17.082495+0000","last_became_active":"2024-09-11T22:18:15.400112+0000","last_became_peered":"2024-09-11T22:18:15.400112+0000","last_unstale":"2024-09-11T22:18:17.082495+0000","last_undegraded":"2024-09-11T22:18:17.082495+0000","last_fullsized":"2024-09-11T22:18:17.082495+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:30.649569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406670+0000","last_change":"2024-09-11T22:18:15.394017+0000","last_active":"2024-09-11T22:18:16.406670+0000","last_peered":"2024-09-11T22:18:16.406670+0000","last_clean":"2024-09-11T22:18:16.406670+0000","last_became_active":"2024-09-11T22:18:15.393688+0000","last_became_peered":"2024-09-11T22:18:15.393688+0000","last_unstale":"2024-09-11T22:18:16.406670+0000","last_undegraded":"2024-09-11T22:18:16.406670+0000","last_fullsized":"2024-09-11T22:18:16.406670+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:39.962591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893120+0000","last_change":"2024-09-11T22:18:15.404322+0000","last_active":"2024-09-11T22:18:16.893120+0000","last_peered":"2024-09-11T22:18:16.893120+0000","last_clean":"2024-09-11T22:18:16.893120+0000","last_became_active":"2024-09-11T22:18:15.404004+0000","last_became_peered":"2024-09-11T22:18:15.404004+0000","last_unstale":"2024-09-11T22:18:16.893120+0000","last_undegraded":"2024-09-11T22:18:16.893120+0000","last_fullsized":"2024-09-11T22:18:16.893120+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:22.541890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398782+0000","last_change":"2024-09-11T22:18:15.405566+0000","last_active":"2024-09-11T22:18:16.398782+0000","last_peered":"2024-09-11T22:18:16.398782+0000","last_clean":"2024-09-11T22:18:16.398782+0000","last_became_active":"2024-09-11T22:18:15.405314+0000","last_became_peered":"2024-09-11T22:18:15.405314+0000","last_unstale":"2024-09-11T22:18:16.398782+0000","last_undegraded":"2024-09-11T22:18:16.398782+0000","last_fullsized":"2024-09-11T22:18:16.398782+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:25.985413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398808+0000","last_change":"2024-09-11T22:18:15.399963+0000","last_active":"2024-09-11T22:18:16.398808+0000","last_peered":"2024-09-11T22:18:16.398808+0000","last_clean":"2024-09-11T22:18:16.398808+0000","last_became_active":"2024-09-11T22:18:15.399692+0000","last_became_peered":"2024-09-11T22:18:15.399692+0000","last_unstale":"2024-09-11T22:18:16.398808+0000","last_undegraded":"2024-09-11T22:18:16.398808+0000","last_fullsized":"2024-09-11T22:18:16.398808+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:33.564986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"119'4","reported_seq":18,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.407045+0000","last_change":"2024-09-11T22:18:14.392883+0000","last_active":"2024-09-11T22:18:16.407045+0000","last_peered":"2024-09-11T22:18:16.407045+0000","last_clean":"2024-09-11T22:18:16.407045+0000","last_became_active":"2024-09-11T22:18:14.392587+0000","last_became_peered":"2024-09-11T22:18:14.392587+0000","last_unstale":"2024-09-11T22:18:16.407045+0000","last_undegraded":"2024-09-11T22:18:16.407045+0000","last_fullsized":"2024-09-11T22:18:16.407045+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:24.067043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406257+0000","last_change":"2024-09-11T22:18:15.400262+0000","last_active":"2024-09-11T22:18:16.406257+0000","last_peered":"2024-09-11T22:18:16.406257+0000","last_clean":"2024-09-11T22:18:16.406257+0000","last_became_active":"2024-09-11T22:18:15.397855+0000","last_became_peered":"2024-09-11T22:18:15.397855+0000","last_unstale":"2024-09-11T22:18:16.406257+0000","last_undegraded":"2024-09-11T22:18:16.406257+0000","last_fullsized":"2024-09-11T22:18:16.406257+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:45.460691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081902+0000","last_change":"2024-09-11T22:18:14.395419+0000","last_active":"2024-09-11T22:18:17.081902+0000","last_peered":"2024-09-11T22:18:17.081902+0000","last_clean":"2024-09-11T22:18:17.081902+0000","last_became_active":"2024-09-11T22:18:14.395085+0000","last_became_peered":"2024-09-11T22:18:14.395085+0000","last_unstale":"2024-09-11T22:18:17.081902+0000","last_undegraded":"2024-09-11T22:18:17.081902+0000","last_fullsized":"2024-09-11T22:18:17.081902+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:52.212295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398871+0000","last_change":"2024-09-11T22:18:15.406141+0000","last_active":"2024-09-11T22:18:16.398871+0000","last_peered":"2024-09-11T22:18:16.398871+0000","last_clean":"2024-09-11T22:18:16.398871+0000","last_became_active":"2024-09-11T22:18:15.405875+0000","last_became_peered":"2024-09-11T22:18:15.405875+0000","last_unstale":"2024-09-11T22:18:16.398871+0000","last_undegraded":"2024-09-11T22:18:16.398871+0000","last_fullsized":"2024-09-11T22:18:16.398871+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:46.204774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.413307+0000","last_change":"2024-09-11T22:18:14.395434+0000","last_active":"2024-09-11T22:18:15.413307+0000","last_peered":"2024-09-11T22:18:15.413307+0000","last_clean":"2024-09-11T22:18:15.413307+0000","last_became_active":"2024-09-11T22:18:14.395167+0000","last_became_peered":"2024-09-11T22:18:14.395167+0000","last_unstale":"2024-09-11T22:18:15.413307+0000","last_undegraded":"2024-09-11T22:18:15.413307+0000","last_fullsized":"2024-09-11T22:18:15.413307+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.171196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082622+0000","last_change":"2024-09-11T22:18:15.406179+0000","last_active":"2024-09-11T22:18:17.082622+0000","last_peered":"2024-09-11T22:18:17.082622+0000","last_clean":"2024-09-11T22:18:17.082622+0000","last_became_active":"2024-09-11T22:18:15.405865+0000","last_became_peered":"2024-09-11T22:18:15.405865+0000","last_unstale":"2024-09-11T22:18:17.082622+0000","last_undegraded":"2024-09-11T22:18:17.082622+0000","last_fullsized":"2024-09-11T22:18:17.082622+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:23.941974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.413974+0000","last_change":"2024-09-11T22:18:14.393274+0000","last_active":"2024-09-11T22:18:15.413974+0000","last_peered":"2024-09-11T22:18:15.413974+0000","last_clean":"2024-09-11T22:18:15.413974+0000","last_became_active":"2024-09-11T22:18:14.392989+0000","last_became_peered":"2024-09-11T22:18:14.392989+0000","last_unstale":"2024-09-11T22:18:15.413974+0000","last_undegraded":"2024-09-11T22:18:15.413974+0000","last_fullsized":"2024-09-11T22:18:15.413974+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:23.415934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892991+0000","last_change":"2024-09-11T22:18:15.398632+0000","last_active":"2024-09-11T22:18:16.892991+0000","last_peered":"2024-09-11T22:18:16.892991+0000","last_clean":"2024-09-11T22:18:16.892991+0000","last_became_active":"2024-09-11T22:18:15.398337+0000","last_became_peered":"2024-09-11T22:18:15.398337+0000","last_unstale":"2024-09-11T22:18:16.892991+0000","last_undegraded":"2024-09-11T22:18:16.892991+0000","last_fullsized":"2024-09-11T22:18:16.892991+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:49.193586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406655+0000","last_change":"2024-09-11T22:18:14.389662+0000","last_active":"2024-09-11T22:18:16.406655+0000","last_peered":"2024-09-11T22:18:16.406655+0000","last_clean":"2024-09-11T22:18:16.406655+0000","last_became_active":"2024-09-11T22:18:14.389378+0000","last_became_peered":"2024-09-11T22:18:14.389378+0000","last_unstale":"2024-09-11T22:18:16.406655+0000","last_undegraded":"2024-09-11T22:18:16.406655+0000","last_fullsized":"2024-09-11T22:18:16.406655+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:53.266021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081616+0000","last_change":"2024-09-11T22:18:15.408617+0000","last_active":"2024-09-11T22:18:17.081616+0000","last_peered":"2024-09-11T22:18:17.081616+0000","last_clean":"2024-09-11T22:18:17.081616+0000","last_became_active":"2024-09-11T22:18:15.408165+0000","last_became_peered":"2024-09-11T22:18:15.408165+0000","last_unstale":"2024-09-11T22:18:17.081616+0000","last_undegraded":"2024-09-11T22:18:17.081616+0000","last_fullsized":"2024-09-11T22:18:17.081616+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:30.180093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081907+0000","last_change":"2024-09-11T22:18:14.391141+0000","last_active":"2024-09-11T22:18:17.081907+0000","last_peered":"2024-09-11T22:18:17.081907+0000","last_clean":"2024-09-11T22:18:17.081907+0000","last_became_active":"2024-09-11T22:18:14.390849+0000","last_became_peered":"2024-09-11T22:18:14.390849+0000","last_unstale":"2024-09-11T22:18:17.081907+0000","last_undegraded":"2024-09-11T22:18:17.081907+0000","last_fullsized":"2024-09-11T22:18:17.081907+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:14.802319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892829+0000","last_change":"2024-09-11T22:18:15.396143+0000","last_active":"2024-09-11T22:18:16.892829+0000","last_peered":"2024-09-11T22:18:16.892829+0000","last_clean":"2024-09-11T22:18:16.892829+0000","last_became_active":"2024-09-11T22:18:15.395083+0000","last_became_peered":"2024-09-11T22:18:15.395083+0000","last_unstale":"2024-09-11T22:18:16.892829+0000","last_undegraded":"2024-09-11T22:18:16.892829+0000","last_fullsized":"2024-09-11T22:18:16.892829+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:08.839766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081666+0000","last_change":"2024-09-11T22:18:14.392141+0000","last_active":"2024-09-11T22:18:17.081666+0000","last_peered":"2024-09-11T22:18:17.081666+0000","last_clean":"2024-09-11T22:18:17.081666+0000","last_became_active":"2024-09-11T22:18:14.391864+0000","last_became_peered":"2024-09-11T22:18:14.391864+0000","last_unstale":"2024-09-11T22:18:17.081666+0000","last_undegraded":"2024-09-11T22:18:17.081666+0000","last_fullsized":"2024-09-11T22:18:17.081666+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:27.533288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406497+0000","last_change":"2024-09-11T22:18:15.389921+0000","last_active":"2024-09-11T22:18:16.406497+0000","last_peered":"2024-09-11T22:18:16.406497+0000","last_clean":"2024-09-11T22:18:16.406497+0000","last_became_active":"2024-09-11T22:18:15.389453+0000","last_became_peered":"2024-09-11T22:18:15.389453+0000","last_unstale":"2024-09-11T22:18:16.406497+0000","last_undegraded":"2024-09-11T22:18:16.406497+0000","last_fullsized":"2024-09-11T22:18:16.406497+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:30.758503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893145+0000","last_change":"2024-09-11T22:18:14.400180+0000","last_active":"2024-09-11T22:18:16.893145+0000","last_peered":"2024-09-11T22:18:16.893145+0000","last_clean":"2024-09-11T22:18:16.893145+0000","last_became_active":"2024-09-11T22:18:14.399884+0000","last_became_peered":"2024-09-11T22:18:14.399884+0000","last_unstale":"2024-09-11T22:18:16.893145+0000","last_undegraded":"2024-09-11T22:18:16.893145+0000","last_fullsized":"2024-09-11T22:18:16.893145+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:29.644288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.407060+0000","last_change":"2024-09-11T22:18:15.396417+0000","last_active":"2024-09-11T22:18:16.407060+0000","last_peered":"2024-09-11T22:18:16.407060+0000","last_clean":"2024-09-11T22:18:16.407060+0000","last_became_active":"2024-09-11T22:18:15.396092+0000","last_became_peered":"2024-09-11T22:18:15.396092+0000","last_unstale":"2024-09-11T22:18:16.407060+0000","last_undegraded":"2024-09-11T22:18:16.407060+0000","last_fullsized":"2024-09-11T22:18:16.407060+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:28.538570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.382418+0000","last_change":"2024-09-11T22:18:14.394020+0000","last_active":"2024-09-11T22:18:15.382418+0000","last_peered":"2024-09-11T22:18:15.382418+0000","last_clean":"2024-09-11T22:18:15.382418+0000","last_became_active":"2024-09-11T22:18:14.393713+0000","last_became_peered":"2024-09-11T22:18:14.393713+0000","last_unstale":"2024-09-11T22:18:15.382418+0000","last_undegraded":"2024-09-11T22:18:15.382418+0000","last_fullsized":"2024-09-11T22:18:15.382418+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:38.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406434+0000","last_change":"2024-09-11T22:18:15.400549+0000","last_active":"2024-09-11T22:18:16.406434+0000","last_peered":"2024-09-11T22:18:16.406434+0000","last_clean":"2024-09-11T22:18:16.406434+0000","last_became_active":"2024-09-11T22:18:15.400232+0000","last_became_peered":"2024-09-11T22:18:15.400232+0000","last_unstale":"2024-09-11T22:18:16.406434+0000","last_undegraded":"2024-09-11T22:18:16.406434+0000","last_fullsized":"2024-09-11T22:18:16.406434+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:30.180093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081678+0000","last_change":"2024-09-11T22:18:14.390561+0000","last_active":"2024-09-11T22:18:17.081678+0000","last_peered":"2024-09-11T22:18:17.081678+0000","last_clean":"2024-09-11T22:18:17.081678+0000","last_became_active":"2024-09-11T22:18:14.390247+0000","last_became_peered":"2024-09-11T22:18:14.390247+0000","last_unstale":"2024-09-11T22:18:17.081678+0000","last_undegraded":"2024-09-11T22:18:17.081678+0000","last_fullsized":"2024-09-11T22:18:17.081678+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:29.644288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082205+0000","last_change":"2024-09-11T22:18:15.404648+0000","last_active":"2024-09-11T22:18:17.082205+0000","last_peered":"2024-09-11T22:18:17.082205+0000","last_clean":"2024-09-11T22:18:17.082205+0000","last_became_active":"2024-09-11T22:18:15.404259+0000","last_became_peered":"2024-09-11T22:18:15.404259+0000","last_unstale":"2024-09-11T22:18:17.082205+0000","last_undegraded":"2024-09-11T22:18:17.082205+0000","last_fullsized":"2024-09-11T22:18:17.082205+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:18.105927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"119'3","reported_seq":17,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893071+0000","last_change":"2024-09-11T22:18:14.402317+0000","last_active":"2024-09-11T22:18:16.893071+0000","last_peered":"2024-09-11T22:18:16.893071+0000","last_clean":"2024-09-11T22:18:16.893071+0000","last_became_active":"2024-09-11T22:18:14.401937+0000","last_became_peered":"2024-09-11T22:18:14.401937+0000","last_unstale":"2024-09-11T22:18:16.893071+0000","last_undegraded":"2024-09-11T22:18:16.893071+0000","last_fullsized":"2024-09-11T22:18:16.893071+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:10.730302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406777+0000","last_change":"2024-09-11T22:18:15.397228+0000","last_active":"2024-09-11T22:18:16.406777+0000","last_peered":"2024-09-11T22:18:16.406777+0000","last_clean":"2024-09-11T22:18:16.406777+0000","last_became_active":"2024-09-11T22:18:15.396919+0000","last_became_peered":"2024-09-11T22:18:15.396919+0000","last_unstale":"2024-09-11T22:18:16.406777+0000","last_undegraded":"2024-09-11T22:18:16.406777+0000","last_fullsized":"2024-09-11T22:18:16.406777+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:26.770816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"119'6","reported_seq":20,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893382+0000","last_change":"2024-09-11T22:18:14.399464+0000","last_active":"2024-09-11T22:18:16.893382+0000","last_peered":"2024-09-11T22:18:16.893382+0000","last_clean":"2024-09-11T22:18:16.893382+0000","last_became_active":"2024-09-11T22:18:14.399179+0000","last_became_peered":"2024-09-11T22:18:14.399179+0000","last_unstale":"2024-09-11T22:18:16.893382+0000","last_undegraded":"2024-09-11T22:18:16.893382+0000","last_fullsized":"2024-09-11T22:18:16.893382+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:03.775272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081782+0000","last_change":"2024-09-11T22:18:15.406385+0000","last_active":"2024-09-11T22:18:17.081782+0000","last_peered":"2024-09-11T22:18:17.081782+0000","last_clean":"2024-09-11T22:18:17.081782+0000","last_became_active":"2024-09-11T22:18:15.406078+0000","last_became_peered":"2024-09-11T22:18:15.406078+0000","last_unstale":"2024-09-11T22:18:17.081782+0000","last_undegraded":"2024-09-11T22:18:17.081782+0000","last_fullsized":"2024-09-11T22:18:17.081782+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:30.218569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"119'2","reported_seq":16,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398987+0000","last_change":"2024-09-11T22:18:14.394153+0000","last_active":"2024-09-11T22:18:16.398987+0000","last_peered":"2024-09-11T22:18:16.398987+0000","last_clean":"2024-09-11T22:18:16.398987+0000","last_became_active":"2024-09-11T22:18:14.393807+0000","last_became_peered":"2024-09-11T22:18:14.393807+0000","last_unstale":"2024-09-11T22:18:16.398987+0000","last_undegraded":"2024-09-11T22:18:16.398987+0000","last_fullsized":"2024-09-11T22:18:16.398987+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:29.635935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081537+0000","last_change":"2024-09-11T22:18:15.400235+0000","last_active":"2024-09-11T22:18:17.081537+0000","last_peered":"2024-09-11T22:18:17.081537+0000","last_clean":"2024-09-11T22:18:17.081537+0000","last_became_active":"2024-09-11T22:18:15.399928+0000","last_became_peered":"2024-09-11T22:18:15.399928+0000","last_unstale":"2024-09-11T22:18:17.081537+0000","last_undegraded":"2024-09-11T22:18:17.081537+0000","last_fullsized":"2024-09-11T22:18:17.081537+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:29.715459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.405855+0000","last_change":"2024-09-11T22:18:14.402005+0000","last_active":"2024-09-11T22:18:16.405855+0000","last_peered":"2024-09-11T22:18:16.405855+0000","last_clean":"2024-09-11T22:18:16.405855+0000","last_became_active":"2024-09-11T22:18:14.401763+0000","last_became_peered":"2024-09-11T22:18:14.401763+0000","last_unstale":"2024-09-11T22:18:16.405855+0000","last_undegraded":"2024-09-11T22:18:16.405855+0000","last_fullsized":"2024-09-11T22:18:16.405855+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:47.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081505+0000","last_change":"2024-09-11T22:18:15.401904+0000","last_active":"2024-09-11T22:18:17.081505+0000","last_peered":"2024-09-11T22:18:17.081505+0000","last_clean":"2024-09-11T22:18:17.081505+0000","last_became_active":"2024-09-11T22:18:15.401590+0000","last_became_peered":"2024-09-11T22:18:15.401590+0000","last_unstale":"2024-09-11T22:18:17.081505+0000","last_undegraded":"2024-09-11T22:18:17.081505+0000","last_fullsized":"2024-09-11T22:18:17.081505+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:36:56.029652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"119'8","reported_seq":20,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.412514+0000","last_change":"2024-09-11T22:18:14.400223+0000","last_active":"2024-09-11T22:18:15.412514+0000","last_peered":"2024-09-11T22:18:15.412514+0000","last_clean":"2024-09-11T22:18:15.412514+0000","last_became_active":"2024-09-11T22:18:14.399666+0000","last_became_peered":"2024-09-11T22:18:14.399666+0000","last_unstale":"2024-09-11T22:18:15.412514+0000","last_undegraded":"2024-09-11T22:18:15.412514+0000","last_fullsized":"2024-09-11T22:18:15.412514+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:01.400475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.397968+0000","last_change":"2024-09-11T22:18:15.395943+0000","last_active":"2024-09-11T22:18:15.397968+0000","last_peered":"2024-09-11T22:18:15.397968+0000","last_clean":"2024-09-11T22:18:15.397968+0000","last_became_active":"2024-09-11T22:18:15.395087+0000","last_became_peered":"2024-09-11T22:18:15.395087+0000","last_unstale":"2024-09-11T22:18:15.397968+0000","last_undegraded":"2024-09-11T22:18:15.397968+0000","last_fullsized":"2024-09-11T22:18:15.397968+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.021061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893541+0000","last_change":"2024-09-11T22:18:14.397820+0000","last_active":"2024-09-11T22:18:16.893541+0000","last_peered":"2024-09-11T22:18:16.893541+0000","last_clean":"2024-09-11T22:18:16.893541+0000","last_became_active":"2024-09-11T22:18:14.397467+0000","last_became_peered":"2024-09-11T22:18:14.397467+0000","last_unstale":"2024-09-11T22:18:16.893541+0000","last_undegraded":"2024-09-11T22:18:16.893541+0000","last_fullsized":"2024-09-11T22:18:16.893541+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:30.141426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398985+0000","last_change":"2024-09-11T22:18:15.393494+0000","last_active":"2024-09-11T22:18:16.398985+0000","last_peered":"2024-09-11T22:18:16.398985+0000","last_clean":"2024-09-11T22:18:16.398985+0000","last_became_active":"2024-09-11T22:18:15.393182+0000","last_became_peered":"2024-09-11T22:18:15.393182+0000","last_unstale":"2024-09-11T22:18:16.398985+0000","last_undegraded":"2024-09-11T22:18:16.398985+0000","last_fullsized":"2024-09-11T22:18:16.398985+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:39.962591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.413949+0000","last_change":"2024-09-11T22:18:14.392009+0000","last_active":"2024-09-11T22:18:15.413949+0000","last_peered":"2024-09-11T22:18:15.413949+0000","last_clean":"2024-09-11T22:18:15.413949+0000","last_became_active":"2024-09-11T22:18:14.391704+0000","last_became_peered":"2024-09-11T22:18:14.391704+0000","last_unstale":"2024-09-11T22:18:15.413949+0000","last_undegraded":"2024-09-11T22:18:15.413949+0000","last_fullsized":"2024-09-11T22:18:15.413949+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:49.090421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082155+0000","last_change":"2024-09-11T22:18:15.398734+0000","last_active":"2024-09-11T22:18:17.082155+0000","last_peered":"2024-09-11T22:18:17.082155+0000","last_clean":"2024-09-11T22:18:17.082155+0000","last_became_active":"2024-09-11T22:18:15.398387+0000","last_became_peered":"2024-09-11T22:18:15.398387+0000","last_unstale":"2024-09-11T22:18:17.082155+0000","last_undegraded":"2024-09-11T22:18:17.082155+0000","last_fullsized":"2024-09-11T22:18:17.082155+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:15.451642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406040+0000","last_change":"2024-09-11T22:18:14.393793+0000","last_active":"2024-09-11T22:18:16.406040+0000","last_peered":"2024-09-11T22:18:16.406040+0000","last_clean":"2024-09-11T22:18:16.406040+0000","last_became_active":"2024-09-11T22:18:14.393496+0000","last_became_peered":"2024-09-11T22:18:14.393496+0000","last_unstale":"2024-09-11T22:18:16.406040+0000","last_undegraded":"2024-09-11T22:18:16.406040+0000","last_fullsized":"2024-09-11T22:18:16.406040+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:52.461559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082769+0000","last_change":"2024-09-11T22:18:15.406005+0000","last_active":"2024-09-11T22:18:17.082769+0000","last_peered":"2024-09-11T22:18:17.082769+0000","last_clean":"2024-09-11T22:18:17.082769+0000","last_became_active":"2024-09-11T22:18:15.405672+0000","last_became_peered":"2024-09-11T22:18:15.405672+0000","last_unstale":"2024-09-11T22:18:17.082769+0000","last_undegraded":"2024-09-11T22:18:17.082769+0000","last_fullsized":"2024-09-11T22:18:17.082769+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:21.104121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406853+0000","last_change":"2024-09-11T22:18:14.395819+0000","last_active":"2024-09-11T22:18:16.406853+0000","last_peered":"2024-09-11T22:18:16.406853+0000","last_clean":"2024-09-11T22:18:16.406853+0000","last_became_active":"2024-09-11T22:18:14.395449+0000","last_became_peered":"2024-09-11T22:18:14.395449+0000","last_unstale":"2024-09-11T22:18:16.406853+0000","last_undegraded":"2024-09-11T22:18:16.406853+0000","last_fullsized":"2024-09-11T22:18:16.406853+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:57.778756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082374+0000","last_change":"2024-09-11T22:18:15.403455+0000","last_active":"2024-09-11T22:18:17.082374+0000","last_peered":"2024-09-11T22:18:17.082374+0000","last_clean":"2024-09-11T22:18:17.082374+0000","last_became_active":"2024-09-11T22:18:15.403172+0000","last_became_peered":"2024-09-11T22:18:15.403172+0000","last_unstale":"2024-09-11T22:18:17.082374+0000","last_undegraded":"2024-09-11T22:18:17.082374+0000","last_fullsized":"2024-09-11T22:18:17.082374+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:46.227885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"119'2","reported_seq":16,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398983+0000","last_change":"2024-09-11T22:18:14.392831+0000","last_active":"2024-09-11T22:18:16.398983+0000","last_peered":"2024-09-11T22:18:16.398983+0000","last_clean":"2024-09-11T22:18:16.398983+0000","last_became_active":"2024-09-11T22:18:14.392454+0000","last_became_peered":"2024-09-11T22:18:14.392454+0000","last_unstale":"2024-09-11T22:18:16.398983+0000","last_undegraded":"2024-09-11T22:18:16.398983+0000","last_fullsized":"2024-09-11T22:18:16.398983+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:15.717819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892929+0000","last_change":"2024-09-11T22:18:15.397239+0000","last_active":"2024-09-11T22:18:16.892929+0000","last_peered":"2024-09-11T22:18:16.892929+0000","last_clean":"2024-09-11T22:18:16.892929+0000","last_became_active":"2024-09-11T22:18:15.396921+0000","last_became_peered":"2024-09-11T22:18:15.396921+0000","last_unstale":"2024-09-11T22:18:16.892929+0000","last_undegraded":"2024-09-11T22:18:16.892929+0000","last_fullsized":"2024-09-11T22:18:16.892929+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:53.152937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.382646+0000","last_change":"2024-09-11T22:18:14.394805+0000","last_active":"2024-09-11T22:18:15.382646+0000","last_peered":"2024-09-11T22:18:15.382646+0000","last_clean":"2024-09-11T22:18:15.382646+0000","last_became_active":"2024-09-11T22:18:14.394547+0000","last_became_peered":"2024-09-11T22:18:14.394547+0000","last_unstale":"2024-09-11T22:18:15.382646+0000","last_undegraded":"2024-09-11T22:18:15.382646+0000","last_fullsized":"2024-09-11T22:18:15.382646+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:31.918926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082286+0000","last_change":"2024-09-11T22:18:15.400740+0000","last_active":"2024-09-11T22:18:17.082286+0000","last_peered":"2024-09-11T22:18:17.082286+0000","last_clean":"2024-09-11T22:18:17.082286+0000","last_became_active":"2024-09-11T22:18:15.400458+0000","last_became_peered":"2024-09-11T22:18:15.400458+0000","last_unstale":"2024-09-11T22:18:17.082286+0000","last_undegraded":"2024-09-11T22:18:17.082286+0000","last_fullsized":"2024-09-11T22:18:17.082286+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.947194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398534+0000","last_change":"2024-09-11T22:18:14.393175+0000","last_active":"2024-09-11T22:18:16.398534+0000","last_peered":"2024-09-11T22:18:16.398534+0000","last_clean":"2024-09-11T22:18:16.398534+0000","last_became_active":"2024-09-11T22:18:14.389968+0000","last_became_peered":"2024-09-11T22:18:14.389968+0000","last_unstale":"2024-09-11T22:18:16.398534+0000","last_undegraded":"2024-09-11T22:18:16.398534+0000","last_fullsized":"2024-09-11T22:18:16.398534+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:56.568071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081524+0000","last_change":"2024-09-11T22:18:15.394965+0000","last_active":"2024-09-11T22:18:17.081524+0000","last_peered":"2024-09-11T22:18:17.081524+0000","last_clean":"2024-09-11T22:18:17.081524+0000","last_became_active":"2024-09-11T22:18:15.394640+0000","last_became_peered":"2024-09-11T22:18:15.394640+0000","last_unstale":"2024-09-11T22:18:17.081524+0000","last_undegraded":"2024-09-11T22:18:17.081524+0000","last_fullsized":"2024-09-11T22:18:17.081524+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:40:20.212512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893352+0000","last_change":"2024-09-11T22:18:14.401946+0000","last_active":"2024-09-11T22:18:16.893352+0000","last_peered":"2024-09-11T22:18:16.893352+0000","last_clean":"2024-09-11T22:18:16.893352+0000","last_became_active":"2024-09-11T22:18:14.401243+0000","last_became_peered":"2024-09-11T22:18:14.401243+0000","last_unstale":"2024-09-11T22:18:16.893352+0000","last_undegraded":"2024-09-11T22:18:16.893352+0000","last_fullsized":"2024-09-11T22:18:16.893352+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:42.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406209+0000","last_change":"2024-09-11T22:18:15.399899+0000","last_active":"2024-09-11T22:18:16.406209+0000","last_peered":"2024-09-11T22:18:16.406209+0000","last_clean":"2024-09-11T22:18:16.406209+0000","last_became_active":"2024-09-11T22:18:15.399629+0000","last_became_peered":"2024-09-11T22:18:15.399629+0000","last_unstale":"2024-09-11T22:18:16.406209+0000","last_undegraded":"2024-09-11T22:18:16.406209+0000","last_fullsized":"2024-09-11T22:18:16.406209+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:58.686162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"119'2","reported_seq":16,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082424+0000","last_change":"2024-09-11T22:18:14.395777+0000","last_active":"2024-09-11T22:18:17.082424+0000","last_peered":"2024-09-11T22:18:17.082424+0000","last_clean":"2024-09-11T22:18:17.082424+0000","last_became_active":"2024-09-11T22:18:14.395436+0000","last_became_peered":"2024-09-11T22:18:14.395436+0000","last_unstale":"2024-09-11T22:18:17.082424+0000","last_undegraded":"2024-09-11T22:18:17.082424+0000","last_fullsized":"2024-09-11T22:18:17.082424+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:42.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893597+0000","last_change":"2024-09-11T22:18:15.400542+0000","last_active":"2024-09-11T22:18:16.893597+0000","last_peered":"2024-09-11T22:18:16.893597+0000","last_clean":"2024-09-11T22:18:16.893597+0000","last_became_active":"2024-09-11T22:18:15.400269+0000","last_became_peered":"2024-09-11T22:18:15.400269+0000","last_unstale":"2024-09-11T22:18:16.893597+0000","last_undegraded":"2024-09-11T22:18:16.893597+0000","last_fullsized":"2024-09-11T22:18:16.893597+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:14.733594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406300+0000","last_change":"2024-09-11T22:18:14.392721+0000","last_active":"2024-09-11T22:18:16.406300+0000","last_peered":"2024-09-11T22:18:16.406300+0000","last_clean":"2024-09-11T22:18:16.406300+0000","last_became_active":"2024-09-11T22:18:14.392450+0000","last_became_peered":"2024-09-11T22:18:14.392450+0000","last_unstale":"2024-09-11T22:18:16.406300+0000","last_undegraded":"2024-09-11T22:18:16.406300+0000","last_fullsized":"2024-09-11T22:18:16.406300+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:02.921225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893364+0000","last_change":"2024-09-11T22:18:15.394562+0000","last_active":"2024-09-11T22:18:16.893364+0000","last_peered":"2024-09-11T22:18:16.893364+0000","last_clean":"2024-09-11T22:18:16.893364+0000","last_became_active":"2024-09-11T22:18:15.394263+0000","last_became_peered":"2024-09-11T22:18:15.394263+0000","last_unstale":"2024-09-11T22:18:16.893364+0000","last_undegraded":"2024-09-11T22:18:16.893364+0000","last_fullsized":"2024-09-11T22:18:16.893364+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:18.247242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893199+0000","last_change":"2024-09-11T22:18:14.401709+0000","last_active":"2024-09-11T22:18:16.893199+0000","last_peered":"2024-09-11T22:18:16.893199+0000","last_clean":"2024-09-11T22:18:16.893199+0000","last_became_active":"2024-09-11T22:18:14.401223+0000","last_became_peered":"2024-09-11T22:18:14.401223+0000","last_unstale":"2024-09-11T22:18:16.893199+0000","last_undegraded":"2024-09-11T22:18:16.893199+0000","last_fullsized":"2024-09-11T22:18:16.893199+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:14.802319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.405980+0000","last_change":"2024-09-11T22:18:15.398847+0000","last_active":"2024-09-11T22:18:16.405980+0000","last_peered":"2024-09-11T22:18:16.405980+0000","last_clean":"2024-09-11T22:18:16.405980+0000","last_became_active":"2024-09-11T22:18:15.398532+0000","last_became_peered":"2024-09-11T22:18:15.398532+0000","last_unstale":"2024-09-11T22:18:16.405980+0000","last_undegraded":"2024-09-11T22:18:16.405980+0000","last_fullsized":"2024-09-11T22:18:16.405980+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:02.260371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082287+0000","last_change":"2024-09-11T22:18:14.397568+0000","last_active":"2024-09-11T22:18:17.082287+0000","last_peered":"2024-09-11T22:18:17.082287+0000","last_clean":"2024-09-11T22:18:17.082287+0000","last_became_active":"2024-09-11T22:18:14.397290+0000","last_became_peered":"2024-09-11T22:18:14.397290+0000","last_unstale":"2024-09-11T22:18:17.082287+0000","last_undegraded":"2024-09-11T22:18:17.082287+0000","last_fullsized":"2024-09-11T22:18:17.082287+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:30.141426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081716+0000","last_change":"2024-09-11T22:18:15.403041+0000","last_active":"2024-09-11T22:18:17.081716+0000","last_peered":"2024-09-11T22:18:17.081716+0000","last_clean":"2024-09-11T22:18:17.081716+0000","last_became_active":"2024-09-11T22:18:15.402576+0000","last_became_peered":"2024-09-11T22:18:15.402576+0000","last_unstale":"2024-09-11T22:18:17.081716+0000","last_undegraded":"2024-09-11T22:18:17.081716+0000","last_fullsized":"2024-09-11T22:18:17.081716+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:01.036271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406831+0000","last_change":"2024-09-11T22:18:14.392868+0000","last_active":"2024-09-11T22:18:16.406831+0000","last_peered":"2024-09-11T22:18:16.406831+0000","last_clean":"2024-09-11T22:18:16.406831+0000","last_became_active":"2024-09-11T22:18:14.392570+0000","last_became_peered":"2024-09-11T22:18:14.392570+0000","last_unstale":"2024-09-11T22:18:16.406831+0000","last_undegraded":"2024-09-11T22:18:16.406831+0000","last_fullsized":"2024-09-11T22:18:16.406831+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:19.096947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081901+0000","last_change":"2024-09-11T22:18:15.399104+0000","last_active":"2024-09-11T22:18:17.081901+0000","last_peered":"2024-09-11T22:18:17.081901+0000","last_clean":"2024-09-11T22:18:17.081901+0000","last_became_active":"2024-09-11T22:18:15.398826+0000","last_became_peered":"2024-09-11T22:18:15.398826+0000","last_unstale":"2024-09-11T22:18:17.081901+0000","last_undegraded":"2024-09-11T22:18:17.081901+0000","last_fullsized":"2024-09-11T22:18:17.081901+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:20.369527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081620+0000","last_change":"2024-09-11T22:18:14.393814+0000","last_active":"2024-09-11T22:18:17.081620+0000","last_peered":"2024-09-11T22:18:17.081620+0000","last_clean":"2024-09-11T22:18:17.081620+0000","last_became_active":"2024-09-11T22:18:14.393396+0000","last_became_peered":"2024-09-11T22:18:14.393396+0000","last_unstale":"2024-09-11T22:18:17.081620+0000","last_undegraded":"2024-09-11T22:18:17.081620+0000","last_fullsized":"2024-09-11T22:18:17.081620+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:25.765535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082307+0000","last_change":"2024-09-11T22:18:15.408858+0000","last_active":"2024-09-11T22:18:17.082307+0000","last_peered":"2024-09-11T22:18:17.082307+0000","last_clean":"2024-09-11T22:18:17.082307+0000","last_became_active":"2024-09-11T22:18:15.408384+0000","last_became_peered":"2024-09-11T22:18:15.408384+0000","last_unstale":"2024-09-11T22:18:17.082307+0000","last_undegraded":"2024-09-11T22:18:17.082307+0000","last_fullsized":"2024-09-11T22:18:17.082307+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:45:12.601612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.382293+0000","last_change":"2024-09-11T22:18:14.396779+0000","last_active":"2024-09-11T22:18:15.382293+0000","last_peered":"2024-09-11T22:18:15.382293+0000","last_clean":"2024-09-11T22:18:15.382293+0000","last_became_active":"2024-09-11T22:18:14.396480+0000","last_became_peered":"2024-09-11T22:18:14.396480+0000","last_unstale":"2024-09-11T22:18:15.382293+0000","last_undegraded":"2024-09-11T22:18:15.382293+0000","last_fullsized":"2024-09-11T22:18:15.382293+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:02.602508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892954+0000","last_change":"2024-09-11T22:18:15.394847+0000","last_active":"2024-09-11T22:18:16.892954+0000","last_peered":"2024-09-11T22:18:16.892954+0000","last_clean":"2024-09-11T22:18:16.892954+0000","last_became_active":"2024-09-11T22:18:15.394501+0000","last_became_peered":"2024-09-11T22:18:15.394501+0000","last_unstale":"2024-09-11T22:18:16.892954+0000","last_undegraded":"2024-09-11T22:18:16.892954+0000","last_fullsized":"2024-09-11T22:18:16.892954+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:06.734809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893321+0000","last_change":"2024-09-11T22:18:14.402459+0000","last_active":"2024-09-11T22:18:16.893321+0000","last_peered":"2024-09-11T22:18:16.893321+0000","last_clean":"2024-09-11T22:18:16.893321+0000","last_became_active":"2024-09-11T22:18:14.402137+0000","last_became_peered":"2024-09-11T22:18:14.402137+0000","last_unstale":"2024-09-11T22:18:16.893321+0000","last_undegraded":"2024-09-11T22:18:16.893321+0000","last_fullsized":"2024-09-11T22:18:16.893321+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:52.403862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081869+0000","last_change":"2024-09-11T22:18:15.400260+0000","last_active":"2024-09-11T22:18:17.081869+0000","last_peered":"2024-09-11T22:18:17.081869+0000","last_clean":"2024-09-11T22:18:17.081869+0000","last_became_active":"2024-09-11T22:18:15.399579+0000","last_became_peered":"2024-09-11T22:18:15.399579+0000","last_unstale":"2024-09-11T22:18:17.081869+0000","last_undegraded":"2024-09-11T22:18:17.081869+0000","last_fullsized":"2024-09-11T22:18:17.081869+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:07.195973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406652+0000","last_change":"2024-09-11T22:18:14.395747+0000","last_active":"2024-09-11T22:18:16.406652+0000","last_peered":"2024-09-11T22:18:16.406652+0000","last_clean":"2024-09-11T22:18:16.406652+0000","last_became_active":"2024-09-11T22:18:14.395432+0000","last_became_peered":"2024-09-11T22:18:14.395432+0000","last_unstale":"2024-09-11T22:18:16.406652+0000","last_undegraded":"2024-09-11T22:18:16.406652+0000","last_fullsized":"2024-09-11T22:18:16.406652+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:32.281716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":351,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082372+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:18:17.082372+0000","last_peered":"2024-09-11T22:18:17.082372+0000","last_clean":"2024-09-11T22:18:17.082372+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:18:17.082372+0000","last_undegraded":"2024-09-11T22:18:17.082372+0000","last_fullsized":"2024-09-11T22:18:17.082372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509532,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46536,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325304,"statfs":{"total":96636764160,"available":96589111296,"internally_reserved":0,"allocated":1486848,"data_stored":649973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509529,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40968,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330872,"statfs":{"total":96636764160,"available":96594812928,"internally_reserved":0,"allocated":1490944,"data_stored":650507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509531,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50684,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321156,"statfs":{"total":96636764160,"available":96584863744,"internally_reserved":0,"allocated":1482752,"data_stored":649903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509531,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54860,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316980,"statfs":{"total":96636764160,"available":96580587520,"internally_reserved":0,"allocated":1499136,"data_stored":651585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509531,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59016,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312824,"statfs":{"total":96636764160,"available":96576331776,"internally_reserved":0,"allocated":1490944,"data_stored":650027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509530,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51284,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320556,"statfs":{"total":96636764160,"available":96584249344,"internally_reserved":0,"allocated":2097152,"data_stored":1241995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45704,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326136,"statfs":{"total":96636764160,"available":96589963264,"internally_reserved":0,"allocated":2084864,"data_stored":1240887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54840,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317000,"statfs":{"total":96636764160,"available":96580608000,"internally_reserved":0,"allocated":1470464,"data_stored":643603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:18:19.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:18:19.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.844+0000 7f846643c640 1 Processor -- start 2024-09-11T22:18:19.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.844+0000 7f846643c640 1 -- start start 2024-09-11T22:18:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.844+0000 7f846643c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f84600d18a0 0x7f84600d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.844+0000 7f846643c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84600cfa80 con 0x7f84600d3a30 2024-09-11T22:18:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.845+0000 7f846643c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84600d40d0 con 0x7f846015e870 2024-09-11T22:18:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.845+0000 7f846643c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f84600d3ea0 con 0x7f84600d18a0 2024-09-11T22:18:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.845+0000 7f84649d9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f84600d3a30 0x7f84600b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46330/0 (socket says 172.21.15.50:46330) 2024-09-11T22:18:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.845+0000 7f84649d9640 1 -- 172.21.15.50:0/1785646062 learned_addr learned my addr 172.21.15.50:0/1785646062 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.845+0000 7f845f7fe640 1 --2- 172.21.15.50:0/1785646062 >> v2:172.21.15.50:3300/0 conn(0x7f84600d18a0 0x7f84600d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.845+0000 7f845f7fe640 1 -- 172.21.15.50:0/1785646062 >> v1:172.21.15.77:6789/0 conn(0x7f846015e870 legacy=0x7f84600d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.845+0000 7f845f7fe640 1 -- 172.21.15.50:0/1785646062 >> v1:172.21.15.50:6789/0 conn(0x7f84600d3a30 legacy=0x7f84600b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.845+0000 7f845f7fe640 1 -- 172.21.15.50:0/1785646062 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84600d43b0 con 0x7f84600d18a0 2024-09-11T22:18:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.845+0000 7f845effd640 1 -- 172.21.15.50:0/1785646062 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 458996437 0 0) 0x7f8458001490 con 0x7f84600d3a30 2024-09-11T22:18:19.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.846+0000 7f845f7fe640 1 --2- 172.21.15.50:0/1785646062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84600d18a0 0x7f84600d34f0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f84540097a0 tx=0x7f845402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8577bcb7da30c7fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:19.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.846+0000 7f845effd640 1 -- 172.21.15.50:0/1785646062 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454037070 con 0x7f84600d18a0 2024-09-11T22:18:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.846+0000 7f845effd640 1 -- 172.21.15.50:0/1785646062 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8454032440 con 0x7f84600d18a0 2024-09-11T22:18:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.846+0000 7f845effd640 1 -- 172.21.15.50:0/1785646062 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454032810 con 0x7f84600d18a0 2024-09-11T22:18:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.846+0000 7f846643c640 1 -- 172.21.15.50:0/1785646062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84600d18a0 msgr2=0x7f84600d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.846+0000 7f846643c640 1 --2- 172.21.15.50:0/1785646062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84600d18a0 0x7f84600d34f0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f84540097a0 tx=0x7f845402a230 comp rx=0 tx=0).stop 2024-09-11T22:18:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.846+0000 7f846643c640 1 -- 172.21.15.50:0/1785646062 shutdown_connections 2024-09-11T22:18:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.846+0000 7f846643c640 1 --2- 172.21.15.50:0/1785646062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84600d18a0 0x7f84600d34f0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.846+0000 7f846643c640 1 -- 172.21.15.50:0/1785646062 >> 172.21.15.50:0/1785646062 conn(0x7f84600727a0 msgr2=0x7f84600679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.847+0000 7f846643c640 1 -- 172.21.15.50:0/1785646062 shutdown_connections 2024-09-11T22:18:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.847+0000 7f846643c640 1 -- 172.21.15.50:0/1785646062 wait complete. 2024-09-11T22:18:19.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.848+0000 7f846643c640 1 Processor -- start 2024-09-11T22:18:19.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.848+0000 7f846643c640 1 -- start start 2024-09-11T22:18:19.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f846643c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84600d18a0 0x7f84600b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f846643c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84600d3a30 0x7f84600caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f846643c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f846015e870 0x7f8460149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f846643c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f846015ec50 con 0x7f84600d18a0 2024-09-11T22:18:19.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f846643c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f84600b7ee0 con 0x7f84600d3a30 2024-09-11T22:18:19.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f846643c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f84600b78b0 con 0x7f846015e870 2024-09-11T22:18:19.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84600d18a0 0x7f84600b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84600d18a0 0x7f84600b5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56310/0 (socket says 172.21.15.50:56310) 2024-09-11T22:18:19.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845ffff640 1 -- 172.21.15.50:0/3730149714 learned_addr learned my addr 172.21.15.50:0/3730149714 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:19.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f84649d9640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f846015e870 0x7f8460149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845ffff640 1 -- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f846015e870 msgr2=0x7f8460149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845f7fe640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84600d3a30 0x7f84600caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845ffff640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f846015e870 0x7f8460149ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845ffff640 1 -- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84600d3a30 msgr2=0x7f84600caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:19.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845ffff640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84600d3a30 0x7f84600caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:19.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845ffff640 1 -- 172.21.15.50:0/3730149714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84600b5a10 con 0x7f84600d18a0 2024-09-11T22:18:19.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845f7fe640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84600d3a30 0x7f84600caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:19.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845ffff640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84600d18a0 0x7f84600b5380 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f845000c480 tx=0x7f845000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:19.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845cff9640 1 -- 172.21.15.50:0/3730149714 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84500052d0 con 0x7f84600d18a0 2024-09-11T22:18:19.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845cff9640 1 -- 172.21.15.50:0/3730149714 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8450005470 con 0x7f84600d18a0 2024-09-11T22:18:19.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f845cff9640 1 -- 172.21.15.50:0/3730149714 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450012870 con 0x7f84600d18a0 2024-09-11T22:18:19.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.849+0000 7f846643c640 1 -- 172.21.15.50:0/3730149714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84600b5cf0 con 0x7f84600d18a0 2024-09-11T22:18:19.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.850+0000 7f846643c640 1 -- 172.21.15.50:0/3730149714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84600b62b0 con 0x7f84600d18a0 2024-09-11T22:18:19.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.850+0000 7f846643c640 1 -- 172.21.15.50:0/3730149714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84600d34f0 con 0x7f84600d18a0 2024-09-11T22:18:19.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.851+0000 7f845cff9640 1 -- 172.21.15.50:0/3730149714 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8450012a10 con 0x7f84600d18a0 2024-09-11T22:18:19.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.851+0000 7f845cff9640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f844c06be30 0x7f844c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:19.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.851+0000 7f845cff9640 1 -- 172.21.15.50:0/3730149714 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f845008ab20 con 0x7f84600d18a0 2024-09-11T22:18:19.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.852+0000 7f845f7fe640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f844c06be30 0x7f844c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:19.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.852+0000 7f845f7fe640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f844c06be30 0x7f844c06e2f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8454034000 tx=0x7f845402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:19.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:19.856+0000 7f845cff9640 1 -- 172.21.15.50:0/3730149714 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84500594c0 con 0x7f84600d18a0 2024-09-11T22:18:20.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.096+0000 7f846643c640 1 -- 172.21.15.50:0/3730149714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f84601604d0 con 0x7f84600d18a0 2024-09-11T22:18:20.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.097+0000 7f845cff9640 1 -- 172.21.15.50:0/3730149714 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1218 (secure 0 0 0) 0x7f8450058dc0 con 0x7f84600d18a0 2024-09-11T22:18:20.098 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:20.098 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":448,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":120,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":413585408,"bytes_avail":772680527872,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":85,"btime":"2024-09-11T22:18:18:030997+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":7324}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-11T22:17:37.458664+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:18:20.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.098+0000 7f846643c640 1 -- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f844c06be30 msgr2=0x7f844c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.098+0000 7f846643c640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f844c06be30 0x7f844c06e2f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8454034000 tx=0x7f845402e000 comp rx=0 tx=0).stop 2024-09-11T22:18:20.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.098+0000 7f846643c640 1 -- 172.21.15.50:0/3730149714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84600d18a0 msgr2=0x7f84600b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.098+0000 7f846643c640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84600d18a0 0x7f84600b5380 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f845000c480 tx=0x7f845000c940 comp rx=0 tx=0).stop 2024-09-11T22:18:20.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.099+0000 7f846643c640 1 -- 172.21.15.50:0/3730149714 shutdown_connections 2024-09-11T22:18:20.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.099+0000 7f846643c640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f844c06be30 0x7f844c06e2f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.099+0000 7f846643c640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f846015e870 0x7f8460149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.099+0000 7f846643c640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84600d3a30 0x7f84600caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.099+0000 7f846643c640 1 --2- 172.21.15.50:0/3730149714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84600d18a0 0x7f84600b5380 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.099+0000 7f846643c640 1 -- 172.21.15.50:0/3730149714 >> 172.21.15.50:0/3730149714 conn(0x7f84600727a0 msgr2=0x7f84600d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:20.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.099+0000 7f846643c640 1 -- 172.21.15.50:0/3730149714 shutdown_connections 2024-09-11T22:18:20.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.099+0000 7f846643c640 1 -- 172.21.15.50:0/3730149714 wait complete. 2024-09-11T22:18:20.110 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:18:20.110 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:18:20.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.212+0000 7fa82dcd9640 1 Processor -- start 2024-09-11T22:18:20.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.212+0000 7fa82dcd9640 1 -- start start 2024-09-11T22:18:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.213+0000 7fa82dcd9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa82815c240 0x7fa8280b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.213+0000 7fa82dcd9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8280728e0 0x7fa828072d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.213+0000 7fa82dcd9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82815c620 con 0x7fa8280735a0 2024-09-11T22:18:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.213+0000 7fa82dcd9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa828073290 con 0x7fa8280728e0 2024-09-11T22:18:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.213+0000 7fa82dcd9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa82815f2b0 con 0x7fa82815c240 2024-09-11T22:18:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.213+0000 7fa827fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8280728e0 0x7fa828072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.213+0000 7fa827fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8280728e0 0x7fa828072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56322/0 (socket says 172.21.15.50:56322) 2024-09-11T22:18:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.213+0000 7fa827fff640 1 -- 172.21.15.50:0/747464010 learned_addr learned my addr 172.21.15.50:0/747464010 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.213+0000 7fa8277fe640 1 --2- 172.21.15.50:0/747464010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa82815c240 0x7fa8280b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.213+0000 7fa827fff640 1 -- 172.21.15.50:0/747464010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa82815c240 msgr2=0x7fa8280b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.213+0000 7fa827fff640 1 --2- 172.21.15.50:0/747464010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa82815c240 0x7fa8280b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.213+0000 7fa827fff640 1 -- 172.21.15.50:0/747464010 >> v1:172.21.15.77:6789/0 conn(0x7fa8280735a0 legacy=0x7fa82815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.213+0000 7fa827fff640 1 -- 172.21.15.50:0/747464010 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82815f560 con 0x7fa8280728e0 2024-09-11T22:18:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.214+0000 7fa827fff640 1 --2- 172.21.15.50:0/747464010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8280728e0 0x7fa828072d50 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fa820009e50 tx=0x7fa82002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4841139cafda1173 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.214+0000 7fa8267fc640 1 -- 172.21.15.50:0/747464010 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820036070 con 0x7fa8280728e0 2024-09-11T22:18:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.214+0000 7fa8267fc640 1 -- 172.21.15.50:0/747464010 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa820031600 con 0x7fa8280728e0 2024-09-11T22:18:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.214+0000 7fa8267fc640 1 -- 172.21.15.50:0/747464010 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8200319d0 con 0x7fa8280728e0 2024-09-11T22:18:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.215+0000 7fa82dcd9640 1 -- 172.21.15.50:0/747464010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8280728e0 msgr2=0x7fa828072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.215+0000 7fa82dcd9640 1 --2- 172.21.15.50:0/747464010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8280728e0 0x7fa828072d50 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fa820009e50 tx=0x7fa82002a710 comp rx=0 tx=0).stop 2024-09-11T22:18:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.215+0000 7fa82dcd9640 1 -- 172.21.15.50:0/747464010 shutdown_connections 2024-09-11T22:18:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.215+0000 7fa82dcd9640 1 --2- 172.21.15.50:0/747464010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8280728e0 0x7fa828072d50 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.215+0000 7fa82dcd9640 1 --2- 172.21.15.50:0/747464010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa82815c240 0x7fa8280b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.215+0000 7fa82dcd9640 1 -- 172.21.15.50:0/747464010 >> 172.21.15.50:0/747464010 conn(0x7fa8280b2bd0 msgr2=0x7fa8280b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.215+0000 7fa82dcd9640 1 -- 172.21.15.50:0/747464010 shutdown_connections 2024-09-11T22:18:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.215+0000 7fa82dcd9640 1 -- 172.21.15.50:0/747464010 wait complete. 2024-09-11T22:18:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.216+0000 7fa82dcd9640 1 Processor -- start 2024-09-11T22:18:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.216+0000 7fa82dcd9640 1 -- start start 2024-09-11T22:18:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.217+0000 7fa82dcd9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8280728e0 0x7fa828141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.217+0000 7fa82dcd9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8280735a0 0x7fa8281425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.217+0000 7fa82dcd9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa82815c240 0x7fa828159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.217+0000 7fa82dcd9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa8280b3f70 con 0x7fa82815c240 2024-09-11T22:18:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.217+0000 7fa82dcd9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa82815fb20 con 0x7fa8280735a0 2024-09-11T22:18:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.217+0000 7fa82dcd9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8280b4250 con 0x7fa8280728e0 2024-09-11T22:18:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.217+0000 7fa827fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa82815c240 0x7fa828159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.217+0000 7fa827fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa82815c240 0x7fa828159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56332/0 (socket says 172.21.15.50:56332) 2024-09-11T22:18:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.217+0000 7fa827fff640 1 -- 172.21.15.50:0/702688716 learned_addr learned my addr 172.21.15.50:0/702688716 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.217+0000 7fa8277fe640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8280728e0 0x7fa828141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.217+0000 7fa826ffd640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8280735a0 0x7fa8281425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.218+0000 7fa827fff640 1 -- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8280728e0 msgr2=0x7fa828141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.218+0000 7fa827fff640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8280728e0 0x7fa828141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.218+0000 7fa827fff640 1 -- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8280735a0 msgr2=0x7fa8281425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.218+0000 7fa827fff640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8280735a0 0x7fa8281425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.218+0000 7fa827fff640 1 -- 172.21.15.50:0/702688716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8281549a0 con 0x7fa82815c240 2024-09-11T22:18:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.218+0000 7fa8277fe640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8280728e0 0x7fa828141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.218+0000 7fa827fff640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa82815c240 0x7fa828159960 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fa820009f70 tx=0x7fa820004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.218+0000 7fa80ffff640 1 -- 172.21.15.50:0/702688716 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82003f020 con 0x7fa82815c240 2024-09-11T22:18:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.218+0000 7fa80ffff640 1 -- 172.21.15.50:0/702688716 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa820037040 con 0x7fa82815c240 2024-09-11T22:18:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.218+0000 7fa82dcd9640 1 -- 172.21.15.50:0/702688716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa828142f10 con 0x7fa82815c240 2024-09-11T22:18:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.218+0000 7fa80ffff640 1 -- 172.21.15.50:0/702688716 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820036070 con 0x7fa82815c240 2024-09-11T22:18:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.218+0000 7fa82dcd9640 1 -- 172.21.15.50:0/702688716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa828158ba0 con 0x7fa82815c240 2024-09-11T22:18:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.219+0000 7fa82dcd9640 1 -- 172.21.15.50:0/702688716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa828162ff0 con 0x7fa82815c240 2024-09-11T22:18:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.219+0000 7fa80ffff640 1 -- 172.21.15.50:0/702688716 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa820042020 con 0x7fa82815c240 2024-09-11T22:18:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.220+0000 7fa80ffff640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa81406be30 0x7fa81406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.220+0000 7fa80ffff640 1 -- 172.21.15.50:0/702688716 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fa8200ab320 con 0x7fa82815c240 2024-09-11T22:18:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.220+0000 7fa8277fe640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa81406be30 0x7fa81406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.221+0000 7fa8277fe640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa81406be30 0x7fa81406e2f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa818006fd0 tx=0x7fa818008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.224+0000 7fa80ffff640 1 -- 172.21.15.50:0/702688716 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa828162ff0 con 0x7fa82815c240 2024-09-11T22:18:20.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.397+0000 7fa82dcd9640 1 -- 172.21.15.50:0/702688716 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa828072d50 con 0x7fa81406be30 2024-09-11T22:18:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.403+0000 7fa80ffff640 1 -- 172.21.15.50:0/702688716 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252481 (secure 0 0 0) 0x7fa828072d50 con 0x7fa81406be30 2024-09-11T22:18:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:20.408 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:18:20.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.407+0000 7fa82dcd9640 1 -- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa81406be30 msgr2=0x7fa81406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.407+0000 7fa82dcd9640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa81406be30 0x7fa81406e2f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa818006fd0 tx=0x7fa818008040 comp rx=0 tx=0).stop 2024-09-11T22:18:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.407+0000 7fa82dcd9640 1 -- 172.21.15.50:0/702688716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa82815c240 msgr2=0x7fa828159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.407+0000 7fa82dcd9640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa82815c240 0x7fa828159960 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fa820009f70 tx=0x7fa820004a40 comp rx=0 tx=0).stop 2024-09-11T22:18:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.407+0000 7fa82dcd9640 1 -- 172.21.15.50:0/702688716 shutdown_connections 2024-09-11T22:18:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.407+0000 7fa82dcd9640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa81406be30 0x7fa81406e2f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.407+0000 7fa82dcd9640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa82815c240 0x7fa828159960 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.407+0000 7fa82dcd9640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8280735a0 0x7fa8281425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.407+0000 7fa82dcd9640 1 --2- 172.21.15.50:0/702688716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8280728e0 0x7fa828141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:20.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.407+0000 7fa82dcd9640 1 -- 172.21.15.50:0/702688716 >> 172.21.15.50:0/702688716 conn(0x7fa8280b2bd0 msgr2=0x7fa82806e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:20.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.407+0000 7fa82dcd9640 1 -- 172.21.15.50:0/702688716 shutdown_connections 2024-09-11T22:18:20.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:20.407+0000 7fa82dcd9640 1 -- 172.21.15.50:0/702688716 wait complete. 2024-09-11T22:18:20.419 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-11T22:18:19.468647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403892,"kb_used_data":12796,"kb_used_omap":12,"kb_used_meta":390899,"kb_avail":754570828,"statfs":{"total":773094113280,"available":772680527872,"internally_reserved":0,"allocated":13103104,"data_stored":6378480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":400281137},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001389"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893406+0000","last_change":"2024-09-11T22:18:15.409177+0000","last_active":"2024-09-11T22:18:16.893406+0000","last_peered":"2024-09-11T22:18:16.893406+0000","last_clean":"2024-09-11T22:18:16.893406+0000","last_became_active":"2024-09-11T22:18:15.408821+0000","last_became_peered":"2024-09-11T22:18:15.408821+0000","last_unstale":"2024-09-11T22:18:16.893406+0000","last_undegraded":"2024-09-11T22:18:16.893406+0000","last_fullsized":"2024-09-11T22:18:16.893406+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:37.178747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082482+0000","last_change":"2024-09-11T22:18:15.407839+0000","last_active":"2024-09-11T22:18:17.082482+0000","last_peered":"2024-09-11T22:18:17.082482+0000","last_clean":"2024-09-11T22:18:17.082482+0000","last_became_active":"2024-09-11T22:18:15.407562+0000","last_became_peered":"2024-09-11T22:18:15.407562+0000","last_unstale":"2024-09-11T22:18:17.082482+0000","last_undegraded":"2024-09-11T22:18:17.082482+0000","last_fullsized":"2024-09-11T22:18:17.082482+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:15.807600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082458+0000","last_change":"2024-09-11T22:18:15.404107+0000","last_active":"2024-09-11T22:18:17.082458+0000","last_peered":"2024-09-11T22:18:17.082458+0000","last_clean":"2024-09-11T22:18:17.082458+0000","last_became_active":"2024-09-11T22:18:15.403793+0000","last_became_peered":"2024-09-11T22:18:15.403793+0000","last_unstale":"2024-09-11T22:18:17.082458+0000","last_undegraded":"2024-09-11T22:18:17.082458+0000","last_fullsized":"2024-09-11T22:18:17.082458+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:00.201633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893154+0000","last_change":"2024-09-11T22:18:15.402759+0000","last_active":"2024-09-11T22:18:16.893154+0000","last_peered":"2024-09-11T22:18:16.893154+0000","last_clean":"2024-09-11T22:18:16.893154+0000","last_became_active":"2024-09-11T22:18:15.402466+0000","last_became_peered":"2024-09-11T22:18:15.402466+0000","last_unstale":"2024-09-11T22:18:16.893154+0000","last_undegraded":"2024-09-11T22:18:16.893154+0000","last_fullsized":"2024-09-11T22:18:16.893154+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:55.190102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.394843+0000","last_change":"2024-09-11T22:18:15.391099+0000","last_active":"2024-09-11T22:18:15.394843+0000","last_peered":"2024-09-11T22:18:15.394843+0000","last_clean":"2024-09-11T22:18:15.394843+0000","last_became_active":"2024-09-11T22:18:15.390672+0000","last_became_peered":"2024-09-11T22:18:15.390672+0000","last_unstale":"2024-09-11T22:18:15.394843+0000","last_undegraded":"2024-09-11T22:18:15.394843+0000","last_fullsized":"2024-09-11T22:18:15.394843+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:05.504125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398635+0000","last_change":"2024-09-11T22:18:15.404541+0000","last_active":"2024-09-11T22:18:16.398635+0000","last_peered":"2024-09-11T22:18:16.398635+0000","last_clean":"2024-09-11T22:18:16.398635+0000","last_became_active":"2024-09-11T22:18:15.404272+0000","last_became_peered":"2024-09-11T22:18:15.404272+0000","last_unstale":"2024-09-11T22:18:16.398635+0000","last_undegraded":"2024-09-11T22:18:16.398635+0000","last_fullsized":"2024-09-11T22:18:16.398635+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:37.132606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406533+0000","last_change":"2024-09-11T22:18:15.389553+0000","last_active":"2024-09-11T22:18:16.406533+0000","last_peered":"2024-09-11T22:18:16.406533+0000","last_clean":"2024-09-11T22:18:16.406533+0000","last_became_active":"2024-09-11T22:18:15.389272+0000","last_became_peered":"2024-09-11T22:18:15.389272+0000","last_unstale":"2024-09-11T22:18:16.406533+0000","last_undegraded":"2024-09-11T22:18:16.406533+0000","last_fullsized":"2024-09-11T22:18:16.406533+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:46.204774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082119+0000","last_change":"2024-09-11T22:18:15.407146+0000","last_active":"2024-09-11T22:18:17.082119+0000","last_peered":"2024-09-11T22:18:17.082119+0000","last_clean":"2024-09-11T22:18:17.082119+0000","last_became_active":"2024-09-11T22:18:15.406866+0000","last_became_peered":"2024-09-11T22:18:15.406866+0000","last_unstale":"2024-09-11T22:18:17.082119+0000","last_undegraded":"2024-09-11T22:18:17.082119+0000","last_fullsized":"2024-09-11T22:18:17.082119+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:39.415424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893448+0000","last_change":"2024-09-11T22:18:15.397882+0000","last_active":"2024-09-11T22:18:16.893448+0000","last_peered":"2024-09-11T22:18:16.893448+0000","last_clean":"2024-09-11T22:18:16.893448+0000","last_became_active":"2024-09-11T22:18:15.397607+0000","last_became_peered":"2024-09-11T22:18:15.397607+0000","last_unstale":"2024-09-11T22:18:16.893448+0000","last_undegraded":"2024-09-11T22:18:16.893448+0000","last_fullsized":"2024-09-11T22:18:16.893448+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:19.681850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893421+0000","last_change":"2024-09-11T22:18:15.405141+0000","last_active":"2024-09-11T22:18:16.893421+0000","last_peered":"2024-09-11T22:18:16.893421+0000","last_clean":"2024-09-11T22:18:16.893421+0000","last_became_active":"2024-09-11T22:18:15.399615+0000","last_became_peered":"2024-09-11T22:18:15.399615+0000","last_unstale":"2024-09-11T22:18:16.893421+0000","last_undegraded":"2024-09-11T22:18:16.893421+0000","last_fullsized":"2024-09-11T22:18:16.893421+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:45.597623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082102+0000","last_change":"2024-09-11T22:18:15.402133+0000","last_active":"2024-09-11T22:18:17.082102+0000","last_peered":"2024-09-11T22:18:17.082102+0000","last_clean":"2024-09-11T22:18:17.082102+0000","last_became_active":"2024-09-11T22:18:15.401892+0000","last_became_peered":"2024-09-11T22:18:15.401892+0000","last_unstale":"2024-09-11T22:18:17.082102+0000","last_undegraded":"2024-09-11T22:18:17.082102+0000","last_fullsized":"2024-09-11T22:18:17.082102+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:10.078383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893163+0000","last_change":"2024-09-11T22:18:15.395858+0000","last_active":"2024-09-11T22:18:16.893163+0000","last_peered":"2024-09-11T22:18:16.893163+0000","last_clean":"2024-09-11T22:18:16.893163+0000","last_became_active":"2024-09-11T22:18:15.395576+0000","last_became_peered":"2024-09-11T22:18:15.395576+0000","last_unstale":"2024-09-11T22:18:16.893163+0000","last_undegraded":"2024-09-11T22:18:16.893163+0000","last_fullsized":"2024-09-11T22:18:16.893163+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:39.816196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082040+0000","last_change":"2024-09-11T22:18:15.401611+0000","last_active":"2024-09-11T22:18:17.082040+0000","last_peered":"2024-09-11T22:18:17.082040+0000","last_clean":"2024-09-11T22:18:17.082040+0000","last_became_active":"2024-09-11T22:18:15.401153+0000","last_became_peered":"2024-09-11T22:18:15.401153+0000","last_unstale":"2024-09-11T22:18:17.082040+0000","last_undegraded":"2024-09-11T22:18:17.082040+0000","last_fullsized":"2024-09-11T22:18:17.082040+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:49.865380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082235+0000","last_change":"2024-09-11T22:18:15.400570+0000","last_active":"2024-09-11T22:18:17.082235+0000","last_peered":"2024-09-11T22:18:17.082235+0000","last_clean":"2024-09-11T22:18:17.082235+0000","last_became_active":"2024-09-11T22:18:15.400292+0000","last_became_peered":"2024-09-11T22:18:15.400292+0000","last_unstale":"2024-09-11T22:18:17.082235+0000","last_undegraded":"2024-09-11T22:18:17.082235+0000","last_fullsized":"2024-09-11T22:18:17.082235+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:59.644890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398589+0000","last_change":"2024-09-11T22:18:15.405103+0000","last_active":"2024-09-11T22:18:16.398589+0000","last_peered":"2024-09-11T22:18:16.398589+0000","last_clean":"2024-09-11T22:18:16.398589+0000","last_became_active":"2024-09-11T22:18:15.404759+0000","last_became_peered":"2024-09-11T22:18:15.404759+0000","last_unstale":"2024-09-11T22:18:16.398589+0000","last_undegraded":"2024-09-11T22:18:16.398589+0000","last_fullsized":"2024-09-11T22:18:16.398589+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:29.712119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892762+0000","last_change":"2024-09-11T22:18:15.400781+0000","last_active":"2024-09-11T22:18:16.892762+0000","last_peered":"2024-09-11T22:18:16.892762+0000","last_clean":"2024-09-11T22:18:16.892762+0000","last_became_active":"2024-09-11T22:18:15.398089+0000","last_became_peered":"2024-09-11T22:18:15.398089+0000","last_unstale":"2024-09-11T22:18:16.892762+0000","last_undegraded":"2024-09-11T22:18:16.892762+0000","last_fullsized":"2024-09-11T22:18:16.892762+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:18.105927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082671+0000","last_change":"2024-09-11T22:18:15.405401+0000","last_active":"2024-09-11T22:18:17.082671+0000","last_peered":"2024-09-11T22:18:17.082671+0000","last_clean":"2024-09-11T22:18:17.082671+0000","last_became_active":"2024-09-11T22:18:15.404891+0000","last_became_peered":"2024-09-11T22:18:15.404891+0000","last_unstale":"2024-09-11T22:18:17.082671+0000","last_undegraded":"2024-09-11T22:18:17.082671+0000","last_fullsized":"2024-09-11T22:18:17.082671+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:31.146707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406049+0000","last_change":"2024-09-11T22:18:15.397439+0000","last_active":"2024-09-11T22:18:16.406049+0000","last_peered":"2024-09-11T22:18:16.406049+0000","last_clean":"2024-09-11T22:18:16.406049+0000","last_became_active":"2024-09-11T22:18:15.397160+0000","last_became_peered":"2024-09-11T22:18:15.397160+0000","last_unstale":"2024-09-11T22:18:16.406049+0000","last_undegraded":"2024-09-11T22:18:16.406049+0000","last_fullsized":"2024-09-11T22:18:16.406049+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:13.911868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082602+0000","last_change":"2024-09-11T22:18:15.401501+0000","last_active":"2024-09-11T22:18:17.082602+0000","last_peered":"2024-09-11T22:18:17.082602+0000","last_clean":"2024-09-11T22:18:17.082602+0000","last_became_active":"2024-09-11T22:18:15.401260+0000","last_became_peered":"2024-09-11T22:18:15.401260+0000","last_unstale":"2024-09-11T22:18:17.082602+0000","last_undegraded":"2024-09-11T22:18:17.082602+0000","last_fullsized":"2024-09-11T22:18:17.082602+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:28.302797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082438+0000","last_change":"2024-09-11T22:18:15.399188+0000","last_active":"2024-09-11T22:18:17.082438+0000","last_peered":"2024-09-11T22:18:17.082438+0000","last_clean":"2024-09-11T22:18:17.082438+0000","last_became_active":"2024-09-11T22:18:15.398888+0000","last_became_peered":"2024-09-11T22:18:15.398888+0000","last_unstale":"2024-09-11T22:18:17.082438+0000","last_undegraded":"2024-09-11T22:18:17.082438+0000","last_fullsized":"2024-09-11T22:18:17.082438+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:04.780553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082114+0000","last_change":"2024-09-11T22:18:15.401009+0000","last_active":"2024-09-11T22:18:17.082114+0000","last_peered":"2024-09-11T22:18:17.082114+0000","last_clean":"2024-09-11T22:18:17.082114+0000","last_became_active":"2024-09-11T22:18:15.400439+0000","last_became_peered":"2024-09-11T22:18:15.400439+0000","last_unstale":"2024-09-11T22:18:17.082114+0000","last_undegraded":"2024-09-11T22:18:17.082114+0000","last_fullsized":"2024-09-11T22:18:17.082114+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:11.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081778+0000","last_change":"2024-09-11T22:18:15.401263+0000","last_active":"2024-09-11T22:18:17.081778+0000","last_peered":"2024-09-11T22:18:17.081778+0000","last_clean":"2024-09-11T22:18:17.081778+0000","last_became_active":"2024-09-11T22:18:15.400714+0000","last_became_peered":"2024-09-11T22:18:15.400714+0000","last_unstale":"2024-09-11T22:18:17.081778+0000","last_undegraded":"2024-09-11T22:18:17.081778+0000","last_fullsized":"2024-09-11T22:18:17.081778+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:01.590421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081610+0000","last_change":"2024-09-11T22:18:15.399817+0000","last_active":"2024-09-11T22:18:17.081610+0000","last_peered":"2024-09-11T22:18:17.081610+0000","last_clean":"2024-09-11T22:18:17.081610+0000","last_became_active":"2024-09-11T22:18:15.399529+0000","last_became_peered":"2024-09-11T22:18:15.399529+0000","last_unstale":"2024-09-11T22:18:17.081610+0000","last_undegraded":"2024-09-11T22:18:17.081610+0000","last_fullsized":"2024-09-11T22:18:17.081610+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:45.460691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081745+0000","last_change":"2024-09-11T22:18:15.400489+0000","last_active":"2024-09-11T22:18:17.081745+0000","last_peered":"2024-09-11T22:18:17.081745+0000","last_clean":"2024-09-11T22:18:17.081745+0000","last_became_active":"2024-09-11T22:18:15.399974+0000","last_became_peered":"2024-09-11T22:18:15.399974+0000","last_unstale":"2024-09-11T22:18:17.081745+0000","last_undegraded":"2024-09-11T22:18:17.081745+0000","last_fullsized":"2024-09-11T22:18:17.081745+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:40.818166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082649+0000","last_change":"2024-09-11T22:18:15.405171+0000","last_active":"2024-09-11T22:18:17.082649+0000","last_peered":"2024-09-11T22:18:17.082649+0000","last_clean":"2024-09-11T22:18:17.082649+0000","last_became_active":"2024-09-11T22:18:15.404504+0000","last_became_peered":"2024-09-11T22:18:15.404504+0000","last_unstale":"2024-09-11T22:18:17.082649+0000","last_undegraded":"2024-09-11T22:18:17.082649+0000","last_fullsized":"2024-09-11T22:18:17.082649+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:43.508984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893585+0000","last_change":"2024-09-11T22:18:15.409016+0000","last_active":"2024-09-11T22:18:16.893585+0000","last_peered":"2024-09-11T22:18:16.893585+0000","last_clean":"2024-09-11T22:18:16.893585+0000","last_became_active":"2024-09-11T22:18:15.408314+0000","last_became_peered":"2024-09-11T22:18:15.408314+0000","last_unstale":"2024-09-11T22:18:16.893585+0000","last_undegraded":"2024-09-11T22:18:16.893585+0000","last_fullsized":"2024-09-11T22:18:16.893585+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:53.455324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398821+0000","last_change":"2024-09-11T22:18:15.396012+0000","last_active":"2024-09-11T22:18:16.398821+0000","last_peered":"2024-09-11T22:18:16.398821+0000","last_clean":"2024-09-11T22:18:16.398821+0000","last_became_active":"2024-09-11T22:18:15.395731+0000","last_became_peered":"2024-09-11T22:18:15.395731+0000","last_unstale":"2024-09-11T22:18:16.398821+0000","last_undegraded":"2024-09-11T22:18:16.398821+0000","last_fullsized":"2024-09-11T22:18:16.398821+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:30.758503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082064+0000","last_change":"2024-09-11T22:18:15.398339+0000","last_active":"2024-09-11T22:18:17.082064+0000","last_peered":"2024-09-11T22:18:17.082064+0000","last_clean":"2024-09-11T22:18:17.082064+0000","last_became_active":"2024-09-11T22:18:15.397355+0000","last_became_peered":"2024-09-11T22:18:15.397355+0000","last_unstale":"2024-09-11T22:18:17.082064+0000","last_undegraded":"2024-09-11T22:18:17.082064+0000","last_fullsized":"2024-09-11T22:18:17.082064+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:08.839766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082495+0000","last_change":"2024-09-11T22:18:15.400684+0000","last_active":"2024-09-11T22:18:17.082495+0000","last_peered":"2024-09-11T22:18:17.082495+0000","last_clean":"2024-09-11T22:18:17.082495+0000","last_became_active":"2024-09-11T22:18:15.400112+0000","last_became_peered":"2024-09-11T22:18:15.400112+0000","last_unstale":"2024-09-11T22:18:17.082495+0000","last_undegraded":"2024-09-11T22:18:17.082495+0000","last_fullsized":"2024-09-11T22:18:17.082495+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:30.649569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406670+0000","last_change":"2024-09-11T22:18:15.394017+0000","last_active":"2024-09-11T22:18:16.406670+0000","last_peered":"2024-09-11T22:18:16.406670+0000","last_clean":"2024-09-11T22:18:16.406670+0000","last_became_active":"2024-09-11T22:18:15.393688+0000","last_became_peered":"2024-09-11T22:18:15.393688+0000","last_unstale":"2024-09-11T22:18:16.406670+0000","last_undegraded":"2024-09-11T22:18:16.406670+0000","last_fullsized":"2024-09-11T22:18:16.406670+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:39.962591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893120+0000","last_change":"2024-09-11T22:18:15.404322+0000","last_active":"2024-09-11T22:18:16.893120+0000","last_peered":"2024-09-11T22:18:16.893120+0000","last_clean":"2024-09-11T22:18:16.893120+0000","last_became_active":"2024-09-11T22:18:15.404004+0000","last_became_peered":"2024-09-11T22:18:15.404004+0000","last_unstale":"2024-09-11T22:18:16.893120+0000","last_undegraded":"2024-09-11T22:18:16.893120+0000","last_fullsized":"2024-09-11T22:18:16.893120+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:22.541890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398782+0000","last_change":"2024-09-11T22:18:15.405566+0000","last_active":"2024-09-11T22:18:16.398782+0000","last_peered":"2024-09-11T22:18:16.398782+0000","last_clean":"2024-09-11T22:18:16.398782+0000","last_became_active":"2024-09-11T22:18:15.405314+0000","last_became_peered":"2024-09-11T22:18:15.405314+0000","last_unstale":"2024-09-11T22:18:16.398782+0000","last_undegraded":"2024-09-11T22:18:16.398782+0000","last_fullsized":"2024-09-11T22:18:16.398782+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:25.985413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398808+0000","last_change":"2024-09-11T22:18:15.399963+0000","last_active":"2024-09-11T22:18:16.398808+0000","last_peered":"2024-09-11T22:18:16.398808+0000","last_clean":"2024-09-11T22:18:16.398808+0000","last_became_active":"2024-09-11T22:18:15.399692+0000","last_became_peered":"2024-09-11T22:18:15.399692+0000","last_unstale":"2024-09-11T22:18:16.398808+0000","last_undegraded":"2024-09-11T22:18:16.398808+0000","last_fullsized":"2024-09-11T22:18:16.398808+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:33.564986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"119'4","reported_seq":18,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.407045+0000","last_change":"2024-09-11T22:18:14.392883+0000","last_active":"2024-09-11T22:18:16.407045+0000","last_peered":"2024-09-11T22:18:16.407045+0000","last_clean":"2024-09-11T22:18:16.407045+0000","last_became_active":"2024-09-11T22:18:14.392587+0000","last_became_peered":"2024-09-11T22:18:14.392587+0000","last_unstale":"2024-09-11T22:18:16.407045+0000","last_undegraded":"2024-09-11T22:18:16.407045+0000","last_fullsized":"2024-09-11T22:18:16.407045+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:24.067043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406257+0000","last_change":"2024-09-11T22:18:15.400262+0000","last_active":"2024-09-11T22:18:16.406257+0000","last_peered":"2024-09-11T22:18:16.406257+0000","last_clean":"2024-09-11T22:18:16.406257+0000","last_became_active":"2024-09-11T22:18:15.397855+0000","last_became_peered":"2024-09-11T22:18:15.397855+0000","last_unstale":"2024-09-11T22:18:16.406257+0000","last_undegraded":"2024-09-11T22:18:16.406257+0000","last_fullsized":"2024-09-11T22:18:16.406257+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:45.460691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081902+0000","last_change":"2024-09-11T22:18:14.395419+0000","last_active":"2024-09-11T22:18:17.081902+0000","last_peered":"2024-09-11T22:18:17.081902+0000","last_clean":"2024-09-11T22:18:17.081902+0000","last_became_active":"2024-09-11T22:18:14.395085+0000","last_became_peered":"2024-09-11T22:18:14.395085+0000","last_unstale":"2024-09-11T22:18:17.081902+0000","last_undegraded":"2024-09-11T22:18:17.081902+0000","last_fullsized":"2024-09-11T22:18:17.081902+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:52.212295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398871+0000","last_change":"2024-09-11T22:18:15.406141+0000","last_active":"2024-09-11T22:18:16.398871+0000","last_peered":"2024-09-11T22:18:16.398871+0000","last_clean":"2024-09-11T22:18:16.398871+0000","last_became_active":"2024-09-11T22:18:15.405875+0000","last_became_peered":"2024-09-11T22:18:15.405875+0000","last_unstale":"2024-09-11T22:18:16.398871+0000","last_undegraded":"2024-09-11T22:18:16.398871+0000","last_fullsized":"2024-09-11T22:18:16.398871+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:46.204774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.413307+0000","last_change":"2024-09-11T22:18:14.395434+0000","last_active":"2024-09-11T22:18:15.413307+0000","last_peered":"2024-09-11T22:18:15.413307+0000","last_clean":"2024-09-11T22:18:15.413307+0000","last_became_active":"2024-09-11T22:18:14.395167+0000","last_became_peered":"2024-09-11T22:18:14.395167+0000","last_unstale":"2024-09-11T22:18:15.413307+0000","last_undegraded":"2024-09-11T22:18:15.413307+0000","last_fullsized":"2024-09-11T22:18:15.413307+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.171196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082622+0000","last_change":"2024-09-11T22:18:15.406179+0000","last_active":"2024-09-11T22:18:17.082622+0000","last_peered":"2024-09-11T22:18:17.082622+0000","last_clean":"2024-09-11T22:18:17.082622+0000","last_became_active":"2024-09-11T22:18:15.405865+0000","last_became_peered":"2024-09-11T22:18:15.405865+0000","last_unstale":"2024-09-11T22:18:17.082622+0000","last_undegraded":"2024-09-11T22:18:17.082622+0000","last_fullsized":"2024-09-11T22:18:17.082622+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:23.941974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.413974+0000","last_change":"2024-09-11T22:18:14.393274+0000","last_active":"2024-09-11T22:18:15.413974+0000","last_peered":"2024-09-11T22:18:15.413974+0000","last_clean":"2024-09-11T22:18:15.413974+0000","last_became_active":"2024-09-11T22:18:14.392989+0000","last_became_peered":"2024-09-11T22:18:14.392989+0000","last_unstale":"2024-09-11T22:18:15.413974+0000","last_undegraded":"2024-09-11T22:18:15.413974+0000","last_fullsized":"2024-09-11T22:18:15.413974+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:23.415934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892991+0000","last_change":"2024-09-11T22:18:15.398632+0000","last_active":"2024-09-11T22:18:16.892991+0000","last_peered":"2024-09-11T22:18:16.892991+0000","last_clean":"2024-09-11T22:18:16.892991+0000","last_became_active":"2024-09-11T22:18:15.398337+0000","last_became_peered":"2024-09-11T22:18:15.398337+0000","last_unstale":"2024-09-11T22:18:16.892991+0000","last_undegraded":"2024-09-11T22:18:16.892991+0000","last_fullsized":"2024-09-11T22:18:16.892991+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:49.193586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406655+0000","last_change":"2024-09-11T22:18:14.389662+0000","last_active":"2024-09-11T22:18:16.406655+0000","last_peered":"2024-09-11T22:18:16.406655+0000","last_clean":"2024-09-11T22:18:16.406655+0000","last_became_active":"2024-09-11T22:18:14.389378+0000","last_became_peered":"2024-09-11T22:18:14.389378+0000","last_unstale":"2024-09-11T22:18:16.406655+0000","last_undegraded":"2024-09-11T22:18:16.406655+0000","last_fullsized":"2024-09-11T22:18:16.406655+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:53.266021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081616+0000","last_change":"2024-09-11T22:18:15.408617+0000","last_active":"2024-09-11T22:18:17.081616+0000","last_peered":"2024-09-11T22:18:17.081616+0000","last_clean":"2024-09-11T22:18:17.081616+0000","last_became_active":"2024-09-11T22:18:15.408165+0000","last_became_peered":"2024-09-11T22:18:15.408165+0000","last_unstale":"2024-09-11T22:18:17.081616+0000","last_undegraded":"2024-09-11T22:18:17.081616+0000","last_fullsized":"2024-09-11T22:18:17.081616+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:30.180093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081907+0000","last_change":"2024-09-11T22:18:14.391141+0000","last_active":"2024-09-11T22:18:17.081907+0000","last_peered":"2024-09-11T22:18:17.081907+0000","last_clean":"2024-09-11T22:18:17.081907+0000","last_became_active":"2024-09-11T22:18:14.390849+0000","last_became_peered":"2024-09-11T22:18:14.390849+0000","last_unstale":"2024-09-11T22:18:17.081907+0000","last_undegraded":"2024-09-11T22:18:17.081907+0000","last_fullsized":"2024-09-11T22:18:17.081907+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:14.802319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892829+0000","last_change":"2024-09-11T22:18:15.396143+0000","last_active":"2024-09-11T22:18:16.892829+0000","last_peered":"2024-09-11T22:18:16.892829+0000","last_clean":"2024-09-11T22:18:16.892829+0000","last_became_active":"2024-09-11T22:18:15.395083+0000","last_became_peered":"2024-09-11T22:18:15.395083+0000","last_unstale":"2024-09-11T22:18:16.892829+0000","last_undegraded":"2024-09-11T22:18:16.892829+0000","last_fullsized":"2024-09-11T22:18:16.892829+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:08.839766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081666+0000","last_change":"2024-09-11T22:18:14.392141+0000","last_active":"2024-09-11T22:18:17.081666+0000","last_peered":"2024-09-11T22:18:17.081666+0000","last_clean":"2024-09-11T22:18:17.081666+0000","last_became_active":"2024-09-11T22:18:14.391864+0000","last_became_peered":"2024-09-11T22:18:14.391864+0000","last_unstale":"2024-09-11T22:18:17.081666+0000","last_undegraded":"2024-09-11T22:18:17.081666+0000","last_fullsized":"2024-09-11T22:18:17.081666+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:27.533288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406497+0000","last_change":"2024-09-11T22:18:15.389921+0000","last_active":"2024-09-11T22:18:16.406497+0000","last_peered":"2024-09-11T22:18:16.406497+0000","last_clean":"2024-09-11T22:18:16.406497+0000","last_became_active":"2024-09-11T22:18:15.389453+0000","last_became_peered":"2024-09-11T22:18:15.389453+0000","last_unstale":"2024-09-11T22:18:16.406497+0000","last_undegraded":"2024-09-11T22:18:16.406497+0000","last_fullsized":"2024-09-11T22:18:16.406497+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:30.758503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893145+0000","last_change":"2024-09-11T22:18:14.400180+0000","last_active":"2024-09-11T22:18:16.893145+0000","last_peered":"2024-09-11T22:18:16.893145+0000","last_clean":"2024-09-11T22:18:16.893145+0000","last_became_active":"2024-09-11T22:18:14.399884+0000","last_became_peered":"2024-09-11T22:18:14.399884+0000","last_unstale":"2024-09-11T22:18:16.893145+0000","last_undegraded":"2024-09-11T22:18:16.893145+0000","last_fullsized":"2024-09-11T22:18:16.893145+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:29.644288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.407060+0000","last_change":"2024-09-11T22:18:15.396417+0000","last_active":"2024-09-11T22:18:16.407060+0000","last_peered":"2024-09-11T22:18:16.407060+0000","last_clean":"2024-09-11T22:18:16.407060+0000","last_became_active":"2024-09-11T22:18:15.396092+0000","last_became_peered":"2024-09-11T22:18:15.396092+0000","last_unstale":"2024-09-11T22:18:16.407060+0000","last_undegraded":"2024-09-11T22:18:16.407060+0000","last_fullsized":"2024-09-11T22:18:16.407060+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:28.538570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.382418+0000","last_change":"2024-09-11T22:18:14.394020+0000","last_active":"2024-09-11T22:18:15.382418+0000","last_peered":"2024-09-11T22:18:15.382418+0000","last_clean":"2024-09-11T22:18:15.382418+0000","last_became_active":"2024-09-11T22:18:14.393713+0000","last_became_peered":"2024-09-11T22:18:14.393713+0000","last_unstale":"2024-09-11T22:18:15.382418+0000","last_undegraded":"2024-09-11T22:18:15.382418+0000","last_fullsized":"2024-09-11T22:18:15.382418+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:38.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406434+0000","last_change":"2024-09-11T22:18:15.400549+0000","last_active":"2024-09-11T22:18:16.406434+0000","last_peered":"2024-09-11T22:18:16.406434+0000","last_clean":"2024-09-11T22:18:16.406434+0000","last_became_active":"2024-09-11T22:18:15.400232+0000","last_became_peered":"2024-09-11T22:18:15.400232+0000","last_unstale":"2024-09-11T22:18:16.406434+0000","last_undegraded":"2024-09-11T22:18:16.406434+0000","last_fullsized":"2024-09-11T22:18:16.406434+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:30.180093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081678+0000","last_change":"2024-09-11T22:18:14.390561+0000","last_active":"2024-09-11T22:18:17.081678+0000","last_peered":"2024-09-11T22:18:17.081678+0000","last_clean":"2024-09-11T22:18:17.081678+0000","last_became_active":"2024-09-11T22:18:14.390247+0000","last_became_peered":"2024-09-11T22:18:14.390247+0000","last_unstale":"2024-09-11T22:18:17.081678+0000","last_undegraded":"2024-09-11T22:18:17.081678+0000","last_fullsized":"2024-09-11T22:18:17.081678+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:29.644288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082205+0000","last_change":"2024-09-11T22:18:15.404648+0000","last_active":"2024-09-11T22:18:17.082205+0000","last_peered":"2024-09-11T22:18:17.082205+0000","last_clean":"2024-09-11T22:18:17.082205+0000","last_became_active":"2024-09-11T22:18:15.404259+0000","last_became_peered":"2024-09-11T22:18:15.404259+0000","last_unstale":"2024-09-11T22:18:17.082205+0000","last_undegraded":"2024-09-11T22:18:17.082205+0000","last_fullsized":"2024-09-11T22:18:17.082205+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:18.105927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"119'3","reported_seq":17,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893071+0000","last_change":"2024-09-11T22:18:14.402317+0000","last_active":"2024-09-11T22:18:16.893071+0000","last_peered":"2024-09-11T22:18:16.893071+0000","last_clean":"2024-09-11T22:18:16.893071+0000","last_became_active":"2024-09-11T22:18:14.401937+0000","last_became_peered":"2024-09-11T22:18:14.401937+0000","last_unstale":"2024-09-11T22:18:16.893071+0000","last_undegraded":"2024-09-11T22:18:16.893071+0000","last_fullsized":"2024-09-11T22:18:16.893071+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:10.730302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406777+0000","last_change":"2024-09-11T22:18:15.397228+0000","last_active":"2024-09-11T22:18:16.406777+0000","last_peered":"2024-09-11T22:18:16.406777+0000","last_clean":"2024-09-11T22:18:16.406777+0000","last_became_active":"2024-09-11T22:18:15.396919+0000","last_became_peered":"2024-09-11T22:18:15.396919+0000","last_unstale":"2024-09-11T22:18:16.406777+0000","last_undegraded":"2024-09-11T22:18:16.406777+0000","last_fullsized":"2024-09-11T22:18:16.406777+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:26.770816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"119'6","reported_seq":20,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893382+0000","last_change":"2024-09-11T22:18:14.399464+0000","last_active":"2024-09-11T22:18:16.893382+0000","last_peered":"2024-09-11T22:18:16.893382+0000","last_clean":"2024-09-11T22:18:16.893382+0000","last_became_active":"2024-09-11T22:18:14.399179+0000","last_became_peered":"2024-09-11T22:18:14.399179+0000","last_unstale":"2024-09-11T22:18:16.893382+0000","last_undegraded":"2024-09-11T22:18:16.893382+0000","last_fullsized":"2024-09-11T22:18:16.893382+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:03.775272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081782+0000","last_change":"2024-09-11T22:18:15.406385+0000","last_active":"2024-09-11T22:18:17.081782+0000","last_peered":"2024-09-11T22:18:17.081782+0000","last_clean":"2024-09-11T22:18:17.081782+0000","last_became_active":"2024-09-11T22:18:15.406078+0000","last_became_peered":"2024-09-11T22:18:15.406078+0000","last_unstale":"2024-09-11T22:18:17.081782+0000","last_undegraded":"2024-09-11T22:18:17.081782+0000","last_fullsized":"2024-09-11T22:18:17.081782+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:30.218569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"119'2","reported_seq":16,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398987+0000","last_change":"2024-09-11T22:18:14.394153+0000","last_active":"2024-09-11T22:18:16.398987+0000","last_peered":"2024-09-11T22:18:16.398987+0000","last_clean":"2024-09-11T22:18:16.398987+0000","last_became_active":"2024-09-11T22:18:14.393807+0000","last_became_peered":"2024-09-11T22:18:14.393807+0000","last_unstale":"2024-09-11T22:18:16.398987+0000","last_undegraded":"2024-09-11T22:18:16.398987+0000","last_fullsized":"2024-09-11T22:18:16.398987+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:29.635935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081537+0000","last_change":"2024-09-11T22:18:15.400235+0000","last_active":"2024-09-11T22:18:17.081537+0000","last_peered":"2024-09-11T22:18:17.081537+0000","last_clean":"2024-09-11T22:18:17.081537+0000","last_became_active":"2024-09-11T22:18:15.399928+0000","last_became_peered":"2024-09-11T22:18:15.399928+0000","last_unstale":"2024-09-11T22:18:17.081537+0000","last_undegraded":"2024-09-11T22:18:17.081537+0000","last_fullsized":"2024-09-11T22:18:17.081537+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:29.715459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.405855+0000","last_change":"2024-09-11T22:18:14.402005+0000","last_active":"2024-09-11T22:18:16.405855+0000","last_peered":"2024-09-11T22:18:16.405855+0000","last_clean":"2024-09-11T22:18:16.405855+0000","last_became_active":"2024-09-11T22:18:14.401763+0000","last_became_peered":"2024-09-11T22:18:14.401763+0000","last_unstale":"2024-09-11T22:18:16.405855+0000","last_undegraded":"2024-09-11T22:18:16.405855+0000","last_fullsized":"2024-09-11T22:18:16.405855+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:47.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081505+0000","last_change":"2024-09-11T22:18:15.401904+0000","last_active":"2024-09-11T22:18:17.081505+0000","last_peered":"2024-09-11T22:18:17.081505+0000","last_clean":"2024-09-11T22:18:17.081505+0000","last_became_active":"2024-09-11T22:18:15.401590+0000","last_became_peered":"2024-09-11T22:18:15.401590+0000","last_unstale":"2024-09-11T22:18:17.081505+0000","last_undegraded":"2024-09-11T22:18:17.081505+0000","last_fullsized":"2024-09-11T22:18:17.081505+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:36:56.029652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"119'8","reported_seq":20,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.412514+0000","last_change":"2024-09-11T22:18:14.400223+0000","last_active":"2024-09-11T22:18:15.412514+0000","last_peered":"2024-09-11T22:18:15.412514+0000","last_clean":"2024-09-11T22:18:15.412514+0000","last_became_active":"2024-09-11T22:18:14.399666+0000","last_became_peered":"2024-09-11T22:18:14.399666+0000","last_unstale":"2024-09-11T22:18:15.412514+0000","last_undegraded":"2024-09-11T22:18:15.412514+0000","last_fullsized":"2024-09-11T22:18:15.412514+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:01.400475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.397968+0000","last_change":"2024-09-11T22:18:15.395943+0000","last_active":"2024-09-11T22:18:15.397968+0000","last_peered":"2024-09-11T22:18:15.397968+0000","last_clean":"2024-09-11T22:18:15.397968+0000","last_became_active":"2024-09-11T22:18:15.395087+0000","last_became_peered":"2024-09-11T22:18:15.395087+0000","last_unstale":"2024-09-11T22:18:15.397968+0000","last_undegraded":"2024-09-11T22:18:15.397968+0000","last_fullsized":"2024-09-11T22:18:15.397968+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:37.021061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893541+0000","last_change":"2024-09-11T22:18:14.397820+0000","last_active":"2024-09-11T22:18:16.893541+0000","last_peered":"2024-09-11T22:18:16.893541+0000","last_clean":"2024-09-11T22:18:16.893541+0000","last_became_active":"2024-09-11T22:18:14.397467+0000","last_became_peered":"2024-09-11T22:18:14.397467+0000","last_unstale":"2024-09-11T22:18:16.893541+0000","last_undegraded":"2024-09-11T22:18:16.893541+0000","last_fullsized":"2024-09-11T22:18:16.893541+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:30.141426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398985+0000","last_change":"2024-09-11T22:18:15.393494+0000","last_active":"2024-09-11T22:18:16.398985+0000","last_peered":"2024-09-11T22:18:16.398985+0000","last_clean":"2024-09-11T22:18:16.398985+0000","last_became_active":"2024-09-11T22:18:15.393182+0000","last_became_peered":"2024-09-11T22:18:15.393182+0000","last_unstale":"2024-09-11T22:18:16.398985+0000","last_undegraded":"2024-09-11T22:18:16.398985+0000","last_fullsized":"2024-09-11T22:18:16.398985+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:39.962591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"119'2","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.413949+0000","last_change":"2024-09-11T22:18:14.392009+0000","last_active":"2024-09-11T22:18:15.413949+0000","last_peered":"2024-09-11T22:18:15.413949+0000","last_clean":"2024-09-11T22:18:15.413949+0000","last_became_active":"2024-09-11T22:18:14.391704+0000","last_became_peered":"2024-09-11T22:18:14.391704+0000","last_unstale":"2024-09-11T22:18:15.413949+0000","last_undegraded":"2024-09-11T22:18:15.413949+0000","last_fullsized":"2024-09-11T22:18:15.413949+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:49.090421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082155+0000","last_change":"2024-09-11T22:18:15.398734+0000","last_active":"2024-09-11T22:18:17.082155+0000","last_peered":"2024-09-11T22:18:17.082155+0000","last_clean":"2024-09-11T22:18:17.082155+0000","last_became_active":"2024-09-11T22:18:15.398387+0000","last_became_peered":"2024-09-11T22:18:15.398387+0000","last_unstale":"2024-09-11T22:18:17.082155+0000","last_undegraded":"2024-09-11T22:18:17.082155+0000","last_fullsized":"2024-09-11T22:18:17.082155+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:15.451642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406040+0000","last_change":"2024-09-11T22:18:14.393793+0000","last_active":"2024-09-11T22:18:16.406040+0000","last_peered":"2024-09-11T22:18:16.406040+0000","last_clean":"2024-09-11T22:18:16.406040+0000","last_became_active":"2024-09-11T22:18:14.393496+0000","last_became_peered":"2024-09-11T22:18:14.393496+0000","last_unstale":"2024-09-11T22:18:16.406040+0000","last_undegraded":"2024-09-11T22:18:16.406040+0000","last_fullsized":"2024-09-11T22:18:16.406040+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:52.461559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082769+0000","last_change":"2024-09-11T22:18:15.406005+0000","last_active":"2024-09-11T22:18:17.082769+0000","last_peered":"2024-09-11T22:18:17.082769+0000","last_clean":"2024-09-11T22:18:17.082769+0000","last_became_active":"2024-09-11T22:18:15.405672+0000","last_became_peered":"2024-09-11T22:18:15.405672+0000","last_unstale":"2024-09-11T22:18:17.082769+0000","last_undegraded":"2024-09-11T22:18:17.082769+0000","last_fullsized":"2024-09-11T22:18:17.082769+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:21.104121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406853+0000","last_change":"2024-09-11T22:18:14.395819+0000","last_active":"2024-09-11T22:18:16.406853+0000","last_peered":"2024-09-11T22:18:16.406853+0000","last_clean":"2024-09-11T22:18:16.406853+0000","last_became_active":"2024-09-11T22:18:14.395449+0000","last_became_peered":"2024-09-11T22:18:14.395449+0000","last_unstale":"2024-09-11T22:18:16.406853+0000","last_undegraded":"2024-09-11T22:18:16.406853+0000","last_fullsized":"2024-09-11T22:18:16.406853+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:57.778756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082374+0000","last_change":"2024-09-11T22:18:15.403455+0000","last_active":"2024-09-11T22:18:17.082374+0000","last_peered":"2024-09-11T22:18:17.082374+0000","last_clean":"2024-09-11T22:18:17.082374+0000","last_became_active":"2024-09-11T22:18:15.403172+0000","last_became_peered":"2024-09-11T22:18:15.403172+0000","last_unstale":"2024-09-11T22:18:17.082374+0000","last_undegraded":"2024-09-11T22:18:17.082374+0000","last_fullsized":"2024-09-11T22:18:17.082374+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:46.227885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"119'2","reported_seq":16,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398983+0000","last_change":"2024-09-11T22:18:14.392831+0000","last_active":"2024-09-11T22:18:16.398983+0000","last_peered":"2024-09-11T22:18:16.398983+0000","last_clean":"2024-09-11T22:18:16.398983+0000","last_became_active":"2024-09-11T22:18:14.392454+0000","last_became_peered":"2024-09-11T22:18:14.392454+0000","last_unstale":"2024-09-11T22:18:16.398983+0000","last_undegraded":"2024-09-11T22:18:16.398983+0000","last_fullsized":"2024-09-11T22:18:16.398983+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:15.717819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892929+0000","last_change":"2024-09-11T22:18:15.397239+0000","last_active":"2024-09-11T22:18:16.892929+0000","last_peered":"2024-09-11T22:18:16.892929+0000","last_clean":"2024-09-11T22:18:16.892929+0000","last_became_active":"2024-09-11T22:18:15.396921+0000","last_became_peered":"2024-09-11T22:18:15.396921+0000","last_unstale":"2024-09-11T22:18:16.892929+0000","last_undegraded":"2024-09-11T22:18:16.892929+0000","last_fullsized":"2024-09-11T22:18:16.892929+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:53.152937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.382646+0000","last_change":"2024-09-11T22:18:14.394805+0000","last_active":"2024-09-11T22:18:15.382646+0000","last_peered":"2024-09-11T22:18:15.382646+0000","last_clean":"2024-09-11T22:18:15.382646+0000","last_became_active":"2024-09-11T22:18:14.394547+0000","last_became_peered":"2024-09-11T22:18:14.394547+0000","last_unstale":"2024-09-11T22:18:15.382646+0000","last_undegraded":"2024-09-11T22:18:15.382646+0000","last_fullsized":"2024-09-11T22:18:15.382646+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:31.918926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082286+0000","last_change":"2024-09-11T22:18:15.400740+0000","last_active":"2024-09-11T22:18:17.082286+0000","last_peered":"2024-09-11T22:18:17.082286+0000","last_clean":"2024-09-11T22:18:17.082286+0000","last_became_active":"2024-09-11T22:18:15.400458+0000","last_became_peered":"2024-09-11T22:18:15.400458+0000","last_unstale":"2024-09-11T22:18:17.082286+0000","last_undegraded":"2024-09-11T22:18:17.082286+0000","last_fullsized":"2024-09-11T22:18:17.082286+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.947194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398534+0000","last_change":"2024-09-11T22:18:14.393175+0000","last_active":"2024-09-11T22:18:16.398534+0000","last_peered":"2024-09-11T22:18:16.398534+0000","last_clean":"2024-09-11T22:18:16.398534+0000","last_became_active":"2024-09-11T22:18:14.389968+0000","last_became_peered":"2024-09-11T22:18:14.389968+0000","last_unstale":"2024-09-11T22:18:16.398534+0000","last_undegraded":"2024-09-11T22:18:16.398534+0000","last_fullsized":"2024-09-11T22:18:16.398534+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:56.568071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081524+0000","last_change":"2024-09-11T22:18:15.394965+0000","last_active":"2024-09-11T22:18:17.081524+0000","last_peered":"2024-09-11T22:18:17.081524+0000","last_clean":"2024-09-11T22:18:17.081524+0000","last_became_active":"2024-09-11T22:18:15.394640+0000","last_became_peered":"2024-09-11T22:18:15.394640+0000","last_unstale":"2024-09-11T22:18:17.081524+0000","last_undegraded":"2024-09-11T22:18:17.081524+0000","last_fullsized":"2024-09-11T22:18:17.081524+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:40:20.212512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893352+0000","last_change":"2024-09-11T22:18:14.401946+0000","last_active":"2024-09-11T22:18:16.893352+0000","last_peered":"2024-09-11T22:18:16.893352+0000","last_clean":"2024-09-11T22:18:16.893352+0000","last_became_active":"2024-09-11T22:18:14.401243+0000","last_became_peered":"2024-09-11T22:18:14.401243+0000","last_unstale":"2024-09-11T22:18:16.893352+0000","last_undegraded":"2024-09-11T22:18:16.893352+0000","last_fullsized":"2024-09-11T22:18:16.893352+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:42.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406209+0000","last_change":"2024-09-11T22:18:15.399899+0000","last_active":"2024-09-11T22:18:16.406209+0000","last_peered":"2024-09-11T22:18:16.406209+0000","last_clean":"2024-09-11T22:18:16.406209+0000","last_became_active":"2024-09-11T22:18:15.399629+0000","last_became_peered":"2024-09-11T22:18:15.399629+0000","last_unstale":"2024-09-11T22:18:16.406209+0000","last_undegraded":"2024-09-11T22:18:16.406209+0000","last_fullsized":"2024-09-11T22:18:16.406209+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:58.686162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"119'2","reported_seq":16,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082424+0000","last_change":"2024-09-11T22:18:14.395777+0000","last_active":"2024-09-11T22:18:17.082424+0000","last_peered":"2024-09-11T22:18:17.082424+0000","last_clean":"2024-09-11T22:18:17.082424+0000","last_became_active":"2024-09-11T22:18:14.395436+0000","last_became_peered":"2024-09-11T22:18:14.395436+0000","last_unstale":"2024-09-11T22:18:17.082424+0000","last_undegraded":"2024-09-11T22:18:17.082424+0000","last_fullsized":"2024-09-11T22:18:17.082424+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:42.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893597+0000","last_change":"2024-09-11T22:18:15.400542+0000","last_active":"2024-09-11T22:18:16.893597+0000","last_peered":"2024-09-11T22:18:16.893597+0000","last_clean":"2024-09-11T22:18:16.893597+0000","last_became_active":"2024-09-11T22:18:15.400269+0000","last_became_peered":"2024-09-11T22:18:15.400269+0000","last_unstale":"2024-09-11T22:18:16.893597+0000","last_undegraded":"2024-09-11T22:18:16.893597+0000","last_fullsized":"2024-09-11T22:18:16.893597+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:14.733594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406300+0000","last_change":"2024-09-11T22:18:14.392721+0000","last_active":"2024-09-11T22:18:16.406300+0000","last_peered":"2024-09-11T22:18:16.406300+0000","last_clean":"2024-09-11T22:18:16.406300+0000","last_became_active":"2024-09-11T22:18:14.392450+0000","last_became_peered":"2024-09-11T22:18:14.392450+0000","last_unstale":"2024-09-11T22:18:16.406300+0000","last_undegraded":"2024-09-11T22:18:16.406300+0000","last_fullsized":"2024-09-11T22:18:16.406300+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:02.921225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893364+0000","last_change":"2024-09-11T22:18:15.394562+0000","last_active":"2024-09-11T22:18:16.893364+0000","last_peered":"2024-09-11T22:18:16.893364+0000","last_clean":"2024-09-11T22:18:16.893364+0000","last_became_active":"2024-09-11T22:18:15.394263+0000","last_became_peered":"2024-09-11T22:18:15.394263+0000","last_unstale":"2024-09-11T22:18:16.893364+0000","last_undegraded":"2024-09-11T22:18:16.893364+0000","last_fullsized":"2024-09-11T22:18:16.893364+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:18.247242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893199+0000","last_change":"2024-09-11T22:18:14.401709+0000","last_active":"2024-09-11T22:18:16.893199+0000","last_peered":"2024-09-11T22:18:16.893199+0000","last_clean":"2024-09-11T22:18:16.893199+0000","last_became_active":"2024-09-11T22:18:14.401223+0000","last_became_peered":"2024-09-11T22:18:14.401223+0000","last_unstale":"2024-09-11T22:18:16.893199+0000","last_undegraded":"2024-09-11T22:18:16.893199+0000","last_fullsized":"2024-09-11T22:18:16.893199+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:14.802319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.405980+0000","last_change":"2024-09-11T22:18:15.398847+0000","last_active":"2024-09-11T22:18:16.405980+0000","last_peered":"2024-09-11T22:18:16.405980+0000","last_clean":"2024-09-11T22:18:16.405980+0000","last_became_active":"2024-09-11T22:18:15.398532+0000","last_became_peered":"2024-09-11T22:18:15.398532+0000","last_unstale":"2024-09-11T22:18:16.405980+0000","last_undegraded":"2024-09-11T22:18:16.405980+0000","last_fullsized":"2024-09-11T22:18:16.405980+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:02.260371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082287+0000","last_change":"2024-09-11T22:18:14.397568+0000","last_active":"2024-09-11T22:18:17.082287+0000","last_peered":"2024-09-11T22:18:17.082287+0000","last_clean":"2024-09-11T22:18:17.082287+0000","last_became_active":"2024-09-11T22:18:14.397290+0000","last_became_peered":"2024-09-11T22:18:14.397290+0000","last_unstale":"2024-09-11T22:18:17.082287+0000","last_undegraded":"2024-09-11T22:18:17.082287+0000","last_fullsized":"2024-09-11T22:18:17.082287+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:30.141426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081716+0000","last_change":"2024-09-11T22:18:15.403041+0000","last_active":"2024-09-11T22:18:17.081716+0000","last_peered":"2024-09-11T22:18:17.081716+0000","last_clean":"2024-09-11T22:18:17.081716+0000","last_became_active":"2024-09-11T22:18:15.402576+0000","last_became_peered":"2024-09-11T22:18:15.402576+0000","last_unstale":"2024-09-11T22:18:17.081716+0000","last_undegraded":"2024-09-11T22:18:17.081716+0000","last_fullsized":"2024-09-11T22:18:17.081716+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:01.036271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406831+0000","last_change":"2024-09-11T22:18:14.392868+0000","last_active":"2024-09-11T22:18:16.406831+0000","last_peered":"2024-09-11T22:18:16.406831+0000","last_clean":"2024-09-11T22:18:16.406831+0000","last_became_active":"2024-09-11T22:18:14.392570+0000","last_became_peered":"2024-09-11T22:18:14.392570+0000","last_unstale":"2024-09-11T22:18:16.406831+0000","last_undegraded":"2024-09-11T22:18:16.406831+0000","last_fullsized":"2024-09-11T22:18:16.406831+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:19.096947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081901+0000","last_change":"2024-09-11T22:18:15.399104+0000","last_active":"2024-09-11T22:18:17.081901+0000","last_peered":"2024-09-11T22:18:17.081901+0000","last_clean":"2024-09-11T22:18:17.081901+0000","last_became_active":"2024-09-11T22:18:15.398826+0000","last_became_peered":"2024-09-11T22:18:15.398826+0000","last_unstale":"2024-09-11T22:18:17.081901+0000","last_undegraded":"2024-09-11T22:18:17.081901+0000","last_fullsized":"2024-09-11T22:18:17.081901+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:20.369527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081620+0000","last_change":"2024-09-11T22:18:14.393814+0000","last_active":"2024-09-11T22:18:17.081620+0000","last_peered":"2024-09-11T22:18:17.081620+0000","last_clean":"2024-09-11T22:18:17.081620+0000","last_became_active":"2024-09-11T22:18:14.393396+0000","last_became_peered":"2024-09-11T22:18:14.393396+0000","last_unstale":"2024-09-11T22:18:17.081620+0000","last_undegraded":"2024-09-11T22:18:17.081620+0000","last_fullsized":"2024-09-11T22:18:17.081620+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:25.765535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082307+0000","last_change":"2024-09-11T22:18:15.408858+0000","last_active":"2024-09-11T22:18:17.082307+0000","last_peered":"2024-09-11T22:18:17.082307+0000","last_clean":"2024-09-11T22:18:17.082307+0000","last_became_active":"2024-09-11T22:18:15.408384+0000","last_became_peered":"2024-09-11T22:18:15.408384+0000","last_unstale":"2024-09-11T22:18:17.082307+0000","last_undegraded":"2024-09-11T22:18:17.082307+0000","last_fullsized":"2024-09-11T22:18:17.082307+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:45:12.601612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-11T22:18:15.382293+0000","last_change":"2024-09-11T22:18:14.396779+0000","last_active":"2024-09-11T22:18:15.382293+0000","last_peered":"2024-09-11T22:18:15.382293+0000","last_clean":"2024-09-11T22:18:15.382293+0000","last_became_active":"2024-09-11T22:18:14.396480+0000","last_became_peered":"2024-09-11T22:18:14.396480+0000","last_unstale":"2024-09-11T22:18:15.382293+0000","last_undegraded":"2024-09-11T22:18:15.382293+0000","last_fullsized":"2024-09-11T22:18:15.382293+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:02.602508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892954+0000","last_change":"2024-09-11T22:18:15.394847+0000","last_active":"2024-09-11T22:18:16.892954+0000","last_peered":"2024-09-11T22:18:16.892954+0000","last_clean":"2024-09-11T22:18:16.892954+0000","last_became_active":"2024-09-11T22:18:15.394501+0000","last_became_peered":"2024-09-11T22:18:15.394501+0000","last_unstale":"2024-09-11T22:18:16.892954+0000","last_undegraded":"2024-09-11T22:18:16.892954+0000","last_fullsized":"2024-09-11T22:18:16.892954+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:06.734809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893321+0000","last_change":"2024-09-11T22:18:14.402459+0000","last_active":"2024-09-11T22:18:16.893321+0000","last_peered":"2024-09-11T22:18:16.893321+0000","last_clean":"2024-09-11T22:18:16.893321+0000","last_became_active":"2024-09-11T22:18:14.402137+0000","last_became_peered":"2024-09-11T22:18:14.402137+0000","last_unstale":"2024-09-11T22:18:16.893321+0000","last_undegraded":"2024-09-11T22:18:16.893321+0000","last_fullsized":"2024-09-11T22:18:16.893321+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:52.403862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081869+0000","last_change":"2024-09-11T22:18:15.400260+0000","last_active":"2024-09-11T22:18:17.081869+0000","last_peered":"2024-09-11T22:18:17.081869+0000","last_clean":"2024-09-11T22:18:17.081869+0000","last_became_active":"2024-09-11T22:18:15.399579+0000","last_became_peered":"2024-09-11T22:18:15.399579+0000","last_unstale":"2024-09-11T22:18:17.081869+0000","last_undegraded":"2024-09-11T22:18:17.081869+0000","last_fullsized":"2024-09-11T22:18:17.081869+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:07.195973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406652+0000","last_change":"2024-09-11T22:18:14.395747+0000","last_active":"2024-09-11T22:18:16.406652+0000","last_peered":"2024-09-11T22:18:16.406652+0000","last_clean":"2024-09-11T22:18:16.406652+0000","last_became_active":"2024-09-11T22:18:14.395432+0000","last_became_peered":"2024-09-11T22:18:14.395432+0000","last_unstale":"2024-09-11T22:18:16.406652+0000","last_undegraded":"2024-09-11T22:18:16.406652+0000","last_fullsized":"2024-09-11T22:18:16.406652+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:32.281716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":351,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082372+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:18:17.082372+0000","last_peered":"2024-09-11T22:18:17.082372+0000","last_clean":"2024-09-11T22:18:17.082372+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:18:17.082372+0000","last_undegraded":"2024-09-11T22:18:17.082372+0000","last_fullsized":"2024-09-11T22:18:17.082372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509532,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46536,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325304,"statfs":{"total":96636764160,"available":96589111296,"internally_reserved":0,"allocated":1486848,"data_stored":649973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509529,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40968,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330872,"statfs":{"total":96636764160,"available":96594812928,"internally_reserved":0,"allocated":1490944,"data_stored":650507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509531,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50684,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321156,"statfs":{"total":96636764160,"available":96584863744,"internally_reserved":0,"allocated":1482752,"data_stored":649903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509531,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54860,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316980,"statfs":{"total":96636764160,"available":96580587520,"internally_reserved":0,"allocated":1499136,"data_stored":651585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509531,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59016,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312824,"statfs":{"total":96636764160,"available":96576331776,"internally_reserved":0,"allocated":1490944,"data_stored":650027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509530,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51284,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320556,"statfs":{"total":96636764160,"available":96584249344,"internally_reserved":0,"allocated":2097152,"data_stored":1241995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45704,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326136,"statfs":{"total":96636764160,"available":96589963264,"internally_reserved":0,"allocated":2084864,"data_stored":1240887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54840,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317000,"statfs":{"total":96636764160,"available":96580608000,"internally_reserved":0,"allocated":1470464,"data_stored":643603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:18:23.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:18:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.537+0000 7fb604eba640 1 Processor -- start 2024-09-11T22:18:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.537+0000 7fb604eba640 1 -- start start 2024-09-11T22:18:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.538+0000 7fb604eba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb60015e840 0x7fb6000b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.538+0000 7fb604eba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6000ce5f0 con 0x7fb6000cdd50 2024-09-11T22:18:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.538+0000 7fb604eba640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6000ce310 con 0x7fb6000cf580 2024-09-11T22:18:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.538+0000 7fb604eba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb60006c240 con 0x7fb60015e840 2024-09-11T22:18:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.538+0000 7fb5fe59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb60015e840 0x7fb6000b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.538+0000 7fb5f7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb6000cdd50 0x7fb6000cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46340/0 (socket says 172.21.15.50:46340) 2024-09-11T22:18:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.538+0000 7fb5f7fff640 1 -- 172.21.15.50:0/3282341166 learned_addr learned my addr 172.21.15.50:0/3282341166 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.538+0000 7fb5fe59c640 1 -- 172.21.15.50:0/3282341166 >> v1:172.21.15.77:6789/0 conn(0x7fb6000cf580 legacy=0x7fb60006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.538+0000 7fb5fe59c640 1 -- 172.21.15.50:0/3282341166 >> v1:172.21.15.50:6789/0 conn(0x7fb6000cdd50 legacy=0x7fb6000cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.538+0000 7fb5fe59c640 1 -- 172.21.15.50:0/3282341166 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60006bbf0 con 0x7fb60015e840 2024-09-11T22:18:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.538+0000 7fb5fdd9b640 1 -- 172.21.15.50:0/3282341166 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413006713 0 0) 0x7fb6000ce5f0 con 0x7fb6000cdd50 2024-09-11T22:18:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.539+0000 7fb5fe59c640 1 --2- 172.21.15.50:0/3282341166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb60015e840 0x7fb6000b4c70 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00097a0 tx=0x7fb5f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62d648e2397273a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.539+0000 7fb5fdd9b640 1 -- 172.21.15.50:0/3282341166 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0037070 con 0x7fb60015e840 2024-09-11T22:18:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.539+0000 7fb5fdd9b640 1 -- 172.21.15.50:0/3282341166 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f0032440 con 0x7fb60015e840 2024-09-11T22:18:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.539+0000 7fb5fdd9b640 1 -- 172.21.15.50:0/3282341166 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0032810 con 0x7fb60015e840 2024-09-11T22:18:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.540+0000 7fb604eba640 1 -- 172.21.15.50:0/3282341166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb60015e840 msgr2=0x7fb6000b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.540+0000 7fb604eba640 1 --2- 172.21.15.50:0/3282341166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb60015e840 0x7fb6000b4c70 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00097a0 tx=0x7fb5f002a1e0 comp rx=0 tx=0).stop 2024-09-11T22:18:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.540+0000 7fb604eba640 1 -- 172.21.15.50:0/3282341166 shutdown_connections 2024-09-11T22:18:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.540+0000 7fb604eba640 1 --2- 172.21.15.50:0/3282341166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb60015e840 0x7fb6000b4c70 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.540+0000 7fb604eba640 1 -- 172.21.15.50:0/3282341166 >> 172.21.15.50:0/3282341166 conn(0x7fb6000b4150 msgr2=0x7fb6000b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.540+0000 7fb604eba640 1 -- 172.21.15.50:0/3282341166 shutdown_connections 2024-09-11T22:18:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.540+0000 7fb604eba640 1 -- 172.21.15.50:0/3282341166 wait complete. 2024-09-11T22:18:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.541+0000 7fb604eba640 1 Processor -- start 2024-09-11T22:18:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.541+0000 7fb604eba640 1 -- start start 2024-09-11T22:18:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.542+0000 7fb604eba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6000cdd50 0x7fb600155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.542+0000 7fb604eba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000cf580 0x7fb6000b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.542+0000 7fb604eba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb60015e840 0x7fb60015d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.542+0000 7fb604eba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb60015ec20 con 0x7fb6000cf580 2024-09-11T22:18:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.542+0000 7fb604eba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb6000d0470 con 0x7fb6000cdd50 2024-09-11T22:18:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.542+0000 7fb604eba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb60015eda0 con 0x7fb60015e840 2024-09-11T22:18:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.542+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000cf580 0x7fb6000b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.542+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000cf580 0x7fb6000b7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56348/0 (socket says 172.21.15.50:56348) 2024-09-11T22:18:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.542+0000 7fb5f7fff640 1 -- 172.21.15.50:0/2576477637 learned_addr learned my addr 172.21.15.50:0/2576477637 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.542+0000 7fb5fe59c640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6000cdd50 0x7fb600155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.542+0000 7fb5fed9d640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb60015e840 0x7fb60015d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.543+0000 7fb5f7fff640 1 -- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb60015e840 msgr2=0x7fb60015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.543+0000 7fb5f7fff640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb60015e840 0x7fb60015d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.543+0000 7fb5f7fff640 1 -- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6000cdd50 msgr2=0x7fb600155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.543+0000 7fb5f7fff640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6000cdd50 0x7fb600155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.543+0000 7fb5f7fff640 1 -- 172.21.15.50:0/2576477637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6000b8240 con 0x7fb6000cf580 2024-09-11T22:18:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.543+0000 7fb5f7fff640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000cf580 0x7fb6000b7d00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800c460 tx=0x7fb5e800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.543+0000 7fb5f6ffd640 1 -- 172.21.15.50:0/2576477637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8018070 con 0x7fb6000cf580 2024-09-11T22:18:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.543+0000 7fb5f6ffd640 1 -- 172.21.15.50:0/2576477637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e8007500 con 0x7fb6000cf580 2024-09-11T22:18:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.543+0000 7fb604eba640 1 -- 172.21.15.50:0/2576477637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6000c7310 con 0x7fb6000cf580 2024-09-11T22:18:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.543+0000 7fb5f6ffd640 1 -- 172.21.15.50:0/2576477637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8004a20 con 0x7fb6000cf580 2024-09-11T22:18:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.543+0000 7fb604eba640 1 -- 172.21.15.50:0/2576477637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6000c78d0 con 0x7fb6000cf580 2024-09-11T22:18:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.544+0000 7fb604eba640 1 -- 172.21.15.50:0/2576477637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6000b4c70 con 0x7fb6000cf580 2024-09-11T22:18:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.545+0000 7fb5f6ffd640 1 -- 172.21.15.50:0/2576477637 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5e801b070 con 0x7fb6000cf580 2024-09-11T22:18:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.545+0000 7fb5f6ffd640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5e006be30 0x7fb5e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.545+0000 7fb5f6ffd640 1 -- 172.21.15.50:0/2576477637 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fb5e8089fd0 con 0x7fb6000cf580 2024-09-11T22:18:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.545+0000 7fb5fe59c640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5e006be30 0x7fb5e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.546+0000 7fb5fe59c640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5e006be30 0x7fb5e006e2f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0034000 tx=0x7fb5f002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.550+0000 7fb5f6ffd640 1 -- 172.21.15.50:0/2576477637 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5e80583c0 con 0x7fb6000cf580 2024-09-11T22:18:23.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.723+0000 7fb604eba640 1 -- 172.21.15.50:0/2576477637 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6000d14a0 con 0x7fb5e006be30 2024-09-11T22:18:23.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.729+0000 7fb5f6ffd640 1 -- 172.21.15.50:0/2576477637 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252459 (secure 0 0 0) 0x7fb6000d14a0 con 0x7fb5e006be30 2024-09-11T22:18:23.733 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:23.735 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:18:23.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.732+0000 7fb604eba640 1 -- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5e006be30 msgr2=0x7fb5e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.732+0000 7fb604eba640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5e006be30 0x7fb5e006e2f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0034000 tx=0x7fb5f002e000 comp rx=0 tx=0).stop 2024-09-11T22:18:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.732+0000 7fb604eba640 1 -- 172.21.15.50:0/2576477637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000cf580 msgr2=0x7fb6000b7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.732+0000 7fb604eba640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000cf580 0x7fb6000b7d00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800c460 tx=0x7fb5e800c920 comp rx=0 tx=0).stop 2024-09-11T22:18:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.732+0000 7fb604eba640 1 -- 172.21.15.50:0/2576477637 shutdown_connections 2024-09-11T22:18:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.732+0000 7fb604eba640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5e006be30 0x7fb5e006e2f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.732+0000 7fb604eba640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb60015e840 0x7fb60015d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.732+0000 7fb604eba640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000cf580 0x7fb6000b7d00 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.732+0000 7fb604eba640 1 --2- 172.21.15.50:0/2576477637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6000cdd50 0x7fb600155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.732+0000 7fb604eba640 1 -- 172.21.15.50:0/2576477637 >> 172.21.15.50:0/2576477637 conn(0x7fb6000b4150 msgr2=0x7fb6000cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:23.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.732+0000 7fb604eba640 1 -- 172.21.15.50:0/2576477637 shutdown_connections 2024-09-11T22:18:23.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.732+0000 7fb604eba640 1 -- 172.21.15.50:0/2576477637 wait complete. 2024-09-11T22:18:23.744 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-11T22:18:23.469733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403896,"kb_used_data":12808,"kb_used_omap":12,"kb_used_meta":390899,"kb_avail":754570824,"statfs":{"total":773094113280,"available":772680523776,"internally_reserved":0,"allocated":13115392,"data_stored":6384780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":400281137},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.085453"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893406+0000","last_change":"2024-09-11T22:18:15.409177+0000","last_active":"2024-09-11T22:18:16.893406+0000","last_peered":"2024-09-11T22:18:16.893406+0000","last_clean":"2024-09-11T22:18:16.893406+0000","last_became_active":"2024-09-11T22:18:15.408821+0000","last_became_peered":"2024-09-11T22:18:15.408821+0000","last_unstale":"2024-09-11T22:18:16.893406+0000","last_undegraded":"2024-09-11T22:18:16.893406+0000","last_fullsized":"2024-09-11T22:18:16.893406+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:37.178747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082482+0000","last_change":"2024-09-11T22:18:15.407839+0000","last_active":"2024-09-11T22:18:17.082482+0000","last_peered":"2024-09-11T22:18:17.082482+0000","last_clean":"2024-09-11T22:18:17.082482+0000","last_became_active":"2024-09-11T22:18:15.407562+0000","last_became_peered":"2024-09-11T22:18:15.407562+0000","last_unstale":"2024-09-11T22:18:17.082482+0000","last_undegraded":"2024-09-11T22:18:17.082482+0000","last_fullsized":"2024-09-11T22:18:17.082482+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:15.807600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082458+0000","last_change":"2024-09-11T22:18:15.404107+0000","last_active":"2024-09-11T22:18:17.082458+0000","last_peered":"2024-09-11T22:18:17.082458+0000","last_clean":"2024-09-11T22:18:17.082458+0000","last_became_active":"2024-09-11T22:18:15.403793+0000","last_became_peered":"2024-09-11T22:18:15.403793+0000","last_unstale":"2024-09-11T22:18:17.082458+0000","last_undegraded":"2024-09-11T22:18:17.082458+0000","last_fullsized":"2024-09-11T22:18:17.082458+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:00.201633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893154+0000","last_change":"2024-09-11T22:18:15.402759+0000","last_active":"2024-09-11T22:18:16.893154+0000","last_peered":"2024-09-11T22:18:16.893154+0000","last_clean":"2024-09-11T22:18:16.893154+0000","last_became_active":"2024-09-11T22:18:15.402466+0000","last_became_peered":"2024-09-11T22:18:15.402466+0000","last_unstale":"2024-09-11T22:18:16.893154+0000","last_undegraded":"2024-09-11T22:18:16.893154+0000","last_fullsized":"2024-09-11T22:18:16.893154+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:55.190102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081815+0000","last_change":"2024-09-11T22:18:15.391099+0000","last_active":"2024-09-11T22:18:17.081815+0000","last_peered":"2024-09-11T22:18:17.081815+0000","last_clean":"2024-09-11T22:18:17.081815+0000","last_became_active":"2024-09-11T22:18:15.390672+0000","last_became_peered":"2024-09-11T22:18:15.390672+0000","last_unstale":"2024-09-11T22:18:17.081815+0000","last_undegraded":"2024-09-11T22:18:17.081815+0000","last_fullsized":"2024-09-11T22:18:17.081815+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:27.676482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398635+0000","last_change":"2024-09-11T22:18:15.404541+0000","last_active":"2024-09-11T22:18:16.398635+0000","last_peered":"2024-09-11T22:18:16.398635+0000","last_clean":"2024-09-11T22:18:16.398635+0000","last_became_active":"2024-09-11T22:18:15.404272+0000","last_became_peered":"2024-09-11T22:18:15.404272+0000","last_unstale":"2024-09-11T22:18:16.398635+0000","last_undegraded":"2024-09-11T22:18:16.398635+0000","last_fullsized":"2024-09-11T22:18:16.398635+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:37.132606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406533+0000","last_change":"2024-09-11T22:18:15.389553+0000","last_active":"2024-09-11T22:18:16.406533+0000","last_peered":"2024-09-11T22:18:16.406533+0000","last_clean":"2024-09-11T22:18:16.406533+0000","last_became_active":"2024-09-11T22:18:15.389272+0000","last_became_peered":"2024-09-11T22:18:15.389272+0000","last_unstale":"2024-09-11T22:18:16.406533+0000","last_undegraded":"2024-09-11T22:18:16.406533+0000","last_fullsized":"2024-09-11T22:18:16.406533+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:46.204774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082119+0000","last_change":"2024-09-11T22:18:15.407146+0000","last_active":"2024-09-11T22:18:17.082119+0000","last_peered":"2024-09-11T22:18:17.082119+0000","last_clean":"2024-09-11T22:18:17.082119+0000","last_became_active":"2024-09-11T22:18:15.406866+0000","last_became_peered":"2024-09-11T22:18:15.406866+0000","last_unstale":"2024-09-11T22:18:17.082119+0000","last_undegraded":"2024-09-11T22:18:17.082119+0000","last_fullsized":"2024-09-11T22:18:17.082119+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:39.415424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893448+0000","last_change":"2024-09-11T22:18:15.397882+0000","last_active":"2024-09-11T22:18:16.893448+0000","last_peered":"2024-09-11T22:18:16.893448+0000","last_clean":"2024-09-11T22:18:16.893448+0000","last_became_active":"2024-09-11T22:18:15.397607+0000","last_became_peered":"2024-09-11T22:18:15.397607+0000","last_unstale":"2024-09-11T22:18:16.893448+0000","last_undegraded":"2024-09-11T22:18:16.893448+0000","last_fullsized":"2024-09-11T22:18:16.893448+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:19.681850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893421+0000","last_change":"2024-09-11T22:18:15.405141+0000","last_active":"2024-09-11T22:18:16.893421+0000","last_peered":"2024-09-11T22:18:16.893421+0000","last_clean":"2024-09-11T22:18:16.893421+0000","last_became_active":"2024-09-11T22:18:15.399615+0000","last_became_peered":"2024-09-11T22:18:15.399615+0000","last_unstale":"2024-09-11T22:18:16.893421+0000","last_undegraded":"2024-09-11T22:18:16.893421+0000","last_fullsized":"2024-09-11T22:18:16.893421+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:45.597623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082102+0000","last_change":"2024-09-11T22:18:15.402133+0000","last_active":"2024-09-11T22:18:17.082102+0000","last_peered":"2024-09-11T22:18:17.082102+0000","last_clean":"2024-09-11T22:18:17.082102+0000","last_became_active":"2024-09-11T22:18:15.401892+0000","last_became_peered":"2024-09-11T22:18:15.401892+0000","last_unstale":"2024-09-11T22:18:17.082102+0000","last_undegraded":"2024-09-11T22:18:17.082102+0000","last_fullsized":"2024-09-11T22:18:17.082102+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:10.078383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893163+0000","last_change":"2024-09-11T22:18:15.395858+0000","last_active":"2024-09-11T22:18:16.893163+0000","last_peered":"2024-09-11T22:18:16.893163+0000","last_clean":"2024-09-11T22:18:16.893163+0000","last_became_active":"2024-09-11T22:18:15.395576+0000","last_became_peered":"2024-09-11T22:18:15.395576+0000","last_unstale":"2024-09-11T22:18:16.893163+0000","last_undegraded":"2024-09-11T22:18:16.893163+0000","last_fullsized":"2024-09-11T22:18:16.893163+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:39.816196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082040+0000","last_change":"2024-09-11T22:18:15.401611+0000","last_active":"2024-09-11T22:18:17.082040+0000","last_peered":"2024-09-11T22:18:17.082040+0000","last_clean":"2024-09-11T22:18:17.082040+0000","last_became_active":"2024-09-11T22:18:15.401153+0000","last_became_peered":"2024-09-11T22:18:15.401153+0000","last_unstale":"2024-09-11T22:18:17.082040+0000","last_undegraded":"2024-09-11T22:18:17.082040+0000","last_fullsized":"2024-09-11T22:18:17.082040+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:49.865380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082235+0000","last_change":"2024-09-11T22:18:15.400570+0000","last_active":"2024-09-11T22:18:17.082235+0000","last_peered":"2024-09-11T22:18:17.082235+0000","last_clean":"2024-09-11T22:18:17.082235+0000","last_became_active":"2024-09-11T22:18:15.400292+0000","last_became_peered":"2024-09-11T22:18:15.400292+0000","last_unstale":"2024-09-11T22:18:17.082235+0000","last_undegraded":"2024-09-11T22:18:17.082235+0000","last_fullsized":"2024-09-11T22:18:17.082235+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:59.644890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398589+0000","last_change":"2024-09-11T22:18:15.405103+0000","last_active":"2024-09-11T22:18:16.398589+0000","last_peered":"2024-09-11T22:18:16.398589+0000","last_clean":"2024-09-11T22:18:16.398589+0000","last_became_active":"2024-09-11T22:18:15.404759+0000","last_became_peered":"2024-09-11T22:18:15.404759+0000","last_unstale":"2024-09-11T22:18:16.398589+0000","last_undegraded":"2024-09-11T22:18:16.398589+0000","last_fullsized":"2024-09-11T22:18:16.398589+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:29.712119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892762+0000","last_change":"2024-09-11T22:18:15.400781+0000","last_active":"2024-09-11T22:18:16.892762+0000","last_peered":"2024-09-11T22:18:16.892762+0000","last_clean":"2024-09-11T22:18:16.892762+0000","last_became_active":"2024-09-11T22:18:15.398089+0000","last_became_peered":"2024-09-11T22:18:15.398089+0000","last_unstale":"2024-09-11T22:18:16.892762+0000","last_undegraded":"2024-09-11T22:18:16.892762+0000","last_fullsized":"2024-09-11T22:18:16.892762+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:18.105927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082671+0000","last_change":"2024-09-11T22:18:15.405401+0000","last_active":"2024-09-11T22:18:17.082671+0000","last_peered":"2024-09-11T22:18:17.082671+0000","last_clean":"2024-09-11T22:18:17.082671+0000","last_became_active":"2024-09-11T22:18:15.404891+0000","last_became_peered":"2024-09-11T22:18:15.404891+0000","last_unstale":"2024-09-11T22:18:17.082671+0000","last_undegraded":"2024-09-11T22:18:17.082671+0000","last_fullsized":"2024-09-11T22:18:17.082671+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:31.146707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406049+0000","last_change":"2024-09-11T22:18:15.397439+0000","last_active":"2024-09-11T22:18:16.406049+0000","last_peered":"2024-09-11T22:18:16.406049+0000","last_clean":"2024-09-11T22:18:16.406049+0000","last_became_active":"2024-09-11T22:18:15.397160+0000","last_became_peered":"2024-09-11T22:18:15.397160+0000","last_unstale":"2024-09-11T22:18:16.406049+0000","last_undegraded":"2024-09-11T22:18:16.406049+0000","last_fullsized":"2024-09-11T22:18:16.406049+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:13.911868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082602+0000","last_change":"2024-09-11T22:18:15.401501+0000","last_active":"2024-09-11T22:18:17.082602+0000","last_peered":"2024-09-11T22:18:17.082602+0000","last_clean":"2024-09-11T22:18:17.082602+0000","last_became_active":"2024-09-11T22:18:15.401260+0000","last_became_peered":"2024-09-11T22:18:15.401260+0000","last_unstale":"2024-09-11T22:18:17.082602+0000","last_undegraded":"2024-09-11T22:18:17.082602+0000","last_fullsized":"2024-09-11T22:18:17.082602+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:28.302797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082438+0000","last_change":"2024-09-11T22:18:15.399188+0000","last_active":"2024-09-11T22:18:17.082438+0000","last_peered":"2024-09-11T22:18:17.082438+0000","last_clean":"2024-09-11T22:18:17.082438+0000","last_became_active":"2024-09-11T22:18:15.398888+0000","last_became_peered":"2024-09-11T22:18:15.398888+0000","last_unstale":"2024-09-11T22:18:17.082438+0000","last_undegraded":"2024-09-11T22:18:17.082438+0000","last_fullsized":"2024-09-11T22:18:17.082438+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:04.780553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082114+0000","last_change":"2024-09-11T22:18:15.401009+0000","last_active":"2024-09-11T22:18:17.082114+0000","last_peered":"2024-09-11T22:18:17.082114+0000","last_clean":"2024-09-11T22:18:17.082114+0000","last_became_active":"2024-09-11T22:18:15.400439+0000","last_became_peered":"2024-09-11T22:18:15.400439+0000","last_unstale":"2024-09-11T22:18:17.082114+0000","last_undegraded":"2024-09-11T22:18:17.082114+0000","last_fullsized":"2024-09-11T22:18:17.082114+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:11.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081778+0000","last_change":"2024-09-11T22:18:15.401263+0000","last_active":"2024-09-11T22:18:17.081778+0000","last_peered":"2024-09-11T22:18:17.081778+0000","last_clean":"2024-09-11T22:18:17.081778+0000","last_became_active":"2024-09-11T22:18:15.400714+0000","last_became_peered":"2024-09-11T22:18:15.400714+0000","last_unstale":"2024-09-11T22:18:17.081778+0000","last_undegraded":"2024-09-11T22:18:17.081778+0000","last_fullsized":"2024-09-11T22:18:17.081778+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:01.590421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081610+0000","last_change":"2024-09-11T22:18:15.399817+0000","last_active":"2024-09-11T22:18:17.081610+0000","last_peered":"2024-09-11T22:18:17.081610+0000","last_clean":"2024-09-11T22:18:17.081610+0000","last_became_active":"2024-09-11T22:18:15.399529+0000","last_became_peered":"2024-09-11T22:18:15.399529+0000","last_unstale":"2024-09-11T22:18:17.081610+0000","last_undegraded":"2024-09-11T22:18:17.081610+0000","last_fullsized":"2024-09-11T22:18:17.081610+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:45.460691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081745+0000","last_change":"2024-09-11T22:18:15.400489+0000","last_active":"2024-09-11T22:18:17.081745+0000","last_peered":"2024-09-11T22:18:17.081745+0000","last_clean":"2024-09-11T22:18:17.081745+0000","last_became_active":"2024-09-11T22:18:15.399974+0000","last_became_peered":"2024-09-11T22:18:15.399974+0000","last_unstale":"2024-09-11T22:18:17.081745+0000","last_undegraded":"2024-09-11T22:18:17.081745+0000","last_fullsized":"2024-09-11T22:18:17.081745+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:40.818166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082649+0000","last_change":"2024-09-11T22:18:15.405171+0000","last_active":"2024-09-11T22:18:17.082649+0000","last_peered":"2024-09-11T22:18:17.082649+0000","last_clean":"2024-09-11T22:18:17.082649+0000","last_became_active":"2024-09-11T22:18:15.404504+0000","last_became_peered":"2024-09-11T22:18:15.404504+0000","last_unstale":"2024-09-11T22:18:17.082649+0000","last_undegraded":"2024-09-11T22:18:17.082649+0000","last_fullsized":"2024-09-11T22:18:17.082649+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:43.508984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893585+0000","last_change":"2024-09-11T22:18:15.409016+0000","last_active":"2024-09-11T22:18:16.893585+0000","last_peered":"2024-09-11T22:18:16.893585+0000","last_clean":"2024-09-11T22:18:16.893585+0000","last_became_active":"2024-09-11T22:18:15.408314+0000","last_became_peered":"2024-09-11T22:18:15.408314+0000","last_unstale":"2024-09-11T22:18:16.893585+0000","last_undegraded":"2024-09-11T22:18:16.893585+0000","last_fullsized":"2024-09-11T22:18:16.893585+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:53.455324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398821+0000","last_change":"2024-09-11T22:18:15.396012+0000","last_active":"2024-09-11T22:18:16.398821+0000","last_peered":"2024-09-11T22:18:16.398821+0000","last_clean":"2024-09-11T22:18:16.398821+0000","last_became_active":"2024-09-11T22:18:15.395731+0000","last_became_peered":"2024-09-11T22:18:15.395731+0000","last_unstale":"2024-09-11T22:18:16.398821+0000","last_undegraded":"2024-09-11T22:18:16.398821+0000","last_fullsized":"2024-09-11T22:18:16.398821+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:30.758503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082064+0000","last_change":"2024-09-11T22:18:15.398339+0000","last_active":"2024-09-11T22:18:17.082064+0000","last_peered":"2024-09-11T22:18:17.082064+0000","last_clean":"2024-09-11T22:18:17.082064+0000","last_became_active":"2024-09-11T22:18:15.397355+0000","last_became_peered":"2024-09-11T22:18:15.397355+0000","last_unstale":"2024-09-11T22:18:17.082064+0000","last_undegraded":"2024-09-11T22:18:17.082064+0000","last_fullsized":"2024-09-11T22:18:17.082064+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:08.839766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082495+0000","last_change":"2024-09-11T22:18:15.400684+0000","last_active":"2024-09-11T22:18:17.082495+0000","last_peered":"2024-09-11T22:18:17.082495+0000","last_clean":"2024-09-11T22:18:17.082495+0000","last_became_active":"2024-09-11T22:18:15.400112+0000","last_became_peered":"2024-09-11T22:18:15.400112+0000","last_unstale":"2024-09-11T22:18:17.082495+0000","last_undegraded":"2024-09-11T22:18:17.082495+0000","last_fullsized":"2024-09-11T22:18:17.082495+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:30.649569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406670+0000","last_change":"2024-09-11T22:18:15.394017+0000","last_active":"2024-09-11T22:18:16.406670+0000","last_peered":"2024-09-11T22:18:16.406670+0000","last_clean":"2024-09-11T22:18:16.406670+0000","last_became_active":"2024-09-11T22:18:15.393688+0000","last_became_peered":"2024-09-11T22:18:15.393688+0000","last_unstale":"2024-09-11T22:18:16.406670+0000","last_undegraded":"2024-09-11T22:18:16.406670+0000","last_fullsized":"2024-09-11T22:18:16.406670+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:39.962591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893120+0000","last_change":"2024-09-11T22:18:15.404322+0000","last_active":"2024-09-11T22:18:16.893120+0000","last_peered":"2024-09-11T22:18:16.893120+0000","last_clean":"2024-09-11T22:18:16.893120+0000","last_became_active":"2024-09-11T22:18:15.404004+0000","last_became_peered":"2024-09-11T22:18:15.404004+0000","last_unstale":"2024-09-11T22:18:16.893120+0000","last_undegraded":"2024-09-11T22:18:16.893120+0000","last_fullsized":"2024-09-11T22:18:16.893120+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:22.541890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398782+0000","last_change":"2024-09-11T22:18:15.405566+0000","last_active":"2024-09-11T22:18:16.398782+0000","last_peered":"2024-09-11T22:18:16.398782+0000","last_clean":"2024-09-11T22:18:16.398782+0000","last_became_active":"2024-09-11T22:18:15.405314+0000","last_became_peered":"2024-09-11T22:18:15.405314+0000","last_unstale":"2024-09-11T22:18:16.398782+0000","last_undegraded":"2024-09-11T22:18:16.398782+0000","last_fullsized":"2024-09-11T22:18:16.398782+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:25.985413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398808+0000","last_change":"2024-09-11T22:18:15.399963+0000","last_active":"2024-09-11T22:18:16.398808+0000","last_peered":"2024-09-11T22:18:16.398808+0000","last_clean":"2024-09-11T22:18:16.398808+0000","last_became_active":"2024-09-11T22:18:15.399692+0000","last_became_peered":"2024-09-11T22:18:15.399692+0000","last_unstale":"2024-09-11T22:18:16.398808+0000","last_undegraded":"2024-09-11T22:18:16.398808+0000","last_fullsized":"2024-09-11T22:18:16.398808+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:33.564986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"119'4","reported_seq":18,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.407045+0000","last_change":"2024-09-11T22:18:14.392883+0000","last_active":"2024-09-11T22:18:16.407045+0000","last_peered":"2024-09-11T22:18:16.407045+0000","last_clean":"2024-09-11T22:18:16.407045+0000","last_became_active":"2024-09-11T22:18:14.392587+0000","last_became_peered":"2024-09-11T22:18:14.392587+0000","last_unstale":"2024-09-11T22:18:16.407045+0000","last_undegraded":"2024-09-11T22:18:16.407045+0000","last_fullsized":"2024-09-11T22:18:16.407045+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:24.067043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406257+0000","last_change":"2024-09-11T22:18:15.400262+0000","last_active":"2024-09-11T22:18:16.406257+0000","last_peered":"2024-09-11T22:18:16.406257+0000","last_clean":"2024-09-11T22:18:16.406257+0000","last_became_active":"2024-09-11T22:18:15.397855+0000","last_became_peered":"2024-09-11T22:18:15.397855+0000","last_unstale":"2024-09-11T22:18:16.406257+0000","last_undegraded":"2024-09-11T22:18:16.406257+0000","last_fullsized":"2024-09-11T22:18:16.406257+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:45.460691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081902+0000","last_change":"2024-09-11T22:18:14.395419+0000","last_active":"2024-09-11T22:18:17.081902+0000","last_peered":"2024-09-11T22:18:17.081902+0000","last_clean":"2024-09-11T22:18:17.081902+0000","last_became_active":"2024-09-11T22:18:14.395085+0000","last_became_peered":"2024-09-11T22:18:14.395085+0000","last_unstale":"2024-09-11T22:18:17.081902+0000","last_undegraded":"2024-09-11T22:18:17.081902+0000","last_fullsized":"2024-09-11T22:18:17.081902+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:52.212295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398871+0000","last_change":"2024-09-11T22:18:15.406141+0000","last_active":"2024-09-11T22:18:16.398871+0000","last_peered":"2024-09-11T22:18:16.398871+0000","last_clean":"2024-09-11T22:18:16.398871+0000","last_became_active":"2024-09-11T22:18:15.405875+0000","last_became_peered":"2024-09-11T22:18:15.405875+0000","last_unstale":"2024-09-11T22:18:16.398871+0000","last_undegraded":"2024-09-11T22:18:16.398871+0000","last_fullsized":"2024-09-11T22:18:16.398871+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:21:46.204774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"119'2","reported_seq":16,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081374+0000","last_change":"2024-09-11T22:18:14.395434+0000","last_active":"2024-09-11T22:18:17.081374+0000","last_peered":"2024-09-11T22:18:17.081374+0000","last_clean":"2024-09-11T22:18:17.081374+0000","last_became_active":"2024-09-11T22:18:14.395167+0000","last_became_peered":"2024-09-11T22:18:14.395167+0000","last_unstale":"2024-09-11T22:18:17.081374+0000","last_undegraded":"2024-09-11T22:18:17.081374+0000","last_fullsized":"2024-09-11T22:18:17.081374+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.171196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082622+0000","last_change":"2024-09-11T22:18:15.406179+0000","last_active":"2024-09-11T22:18:17.082622+0000","last_peered":"2024-09-11T22:18:17.082622+0000","last_clean":"2024-09-11T22:18:17.082622+0000","last_became_active":"2024-09-11T22:18:15.405865+0000","last_became_peered":"2024-09-11T22:18:15.405865+0000","last_unstale":"2024-09-11T22:18:17.082622+0000","last_undegraded":"2024-09-11T22:18:17.082622+0000","last_fullsized":"2024-09-11T22:18:17.082622+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:23.941974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"119'2","reported_seq":16,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081222+0000","last_change":"2024-09-11T22:18:14.393274+0000","last_active":"2024-09-11T22:18:17.081222+0000","last_peered":"2024-09-11T22:18:17.081222+0000","last_clean":"2024-09-11T22:18:17.081222+0000","last_became_active":"2024-09-11T22:18:14.392989+0000","last_became_peered":"2024-09-11T22:18:14.392989+0000","last_unstale":"2024-09-11T22:18:17.081222+0000","last_undegraded":"2024-09-11T22:18:17.081222+0000","last_fullsized":"2024-09-11T22:18:17.081222+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:23.415934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892991+0000","last_change":"2024-09-11T22:18:15.398632+0000","last_active":"2024-09-11T22:18:16.892991+0000","last_peered":"2024-09-11T22:18:16.892991+0000","last_clean":"2024-09-11T22:18:16.892991+0000","last_became_active":"2024-09-11T22:18:15.398337+0000","last_became_peered":"2024-09-11T22:18:15.398337+0000","last_unstale":"2024-09-11T22:18:16.892991+0000","last_undegraded":"2024-09-11T22:18:16.892991+0000","last_fullsized":"2024-09-11T22:18:16.892991+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:49.193586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406655+0000","last_change":"2024-09-11T22:18:14.389662+0000","last_active":"2024-09-11T22:18:16.406655+0000","last_peered":"2024-09-11T22:18:16.406655+0000","last_clean":"2024-09-11T22:18:16.406655+0000","last_became_active":"2024-09-11T22:18:14.389378+0000","last_became_peered":"2024-09-11T22:18:14.389378+0000","last_unstale":"2024-09-11T22:18:16.406655+0000","last_undegraded":"2024-09-11T22:18:16.406655+0000","last_fullsized":"2024-09-11T22:18:16.406655+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:53.266021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081616+0000","last_change":"2024-09-11T22:18:15.408617+0000","last_active":"2024-09-11T22:18:17.081616+0000","last_peered":"2024-09-11T22:18:17.081616+0000","last_clean":"2024-09-11T22:18:17.081616+0000","last_became_active":"2024-09-11T22:18:15.408165+0000","last_became_peered":"2024-09-11T22:18:15.408165+0000","last_unstale":"2024-09-11T22:18:17.081616+0000","last_undegraded":"2024-09-11T22:18:17.081616+0000","last_fullsized":"2024-09-11T22:18:17.081616+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:30.180093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081907+0000","last_change":"2024-09-11T22:18:14.391141+0000","last_active":"2024-09-11T22:18:17.081907+0000","last_peered":"2024-09-11T22:18:17.081907+0000","last_clean":"2024-09-11T22:18:17.081907+0000","last_became_active":"2024-09-11T22:18:14.390849+0000","last_became_peered":"2024-09-11T22:18:14.390849+0000","last_unstale":"2024-09-11T22:18:17.081907+0000","last_undegraded":"2024-09-11T22:18:17.081907+0000","last_fullsized":"2024-09-11T22:18:17.081907+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:14.802319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892829+0000","last_change":"2024-09-11T22:18:15.396143+0000","last_active":"2024-09-11T22:18:16.892829+0000","last_peered":"2024-09-11T22:18:16.892829+0000","last_clean":"2024-09-11T22:18:16.892829+0000","last_became_active":"2024-09-11T22:18:15.395083+0000","last_became_peered":"2024-09-11T22:18:15.395083+0000","last_unstale":"2024-09-11T22:18:16.892829+0000","last_undegraded":"2024-09-11T22:18:16.892829+0000","last_fullsized":"2024-09-11T22:18:16.892829+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:08.839766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081666+0000","last_change":"2024-09-11T22:18:14.392141+0000","last_active":"2024-09-11T22:18:17.081666+0000","last_peered":"2024-09-11T22:18:17.081666+0000","last_clean":"2024-09-11T22:18:17.081666+0000","last_became_active":"2024-09-11T22:18:14.391864+0000","last_became_peered":"2024-09-11T22:18:14.391864+0000","last_unstale":"2024-09-11T22:18:17.081666+0000","last_undegraded":"2024-09-11T22:18:17.081666+0000","last_fullsized":"2024-09-11T22:18:17.081666+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:27.533288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406497+0000","last_change":"2024-09-11T22:18:15.389921+0000","last_active":"2024-09-11T22:18:16.406497+0000","last_peered":"2024-09-11T22:18:16.406497+0000","last_clean":"2024-09-11T22:18:16.406497+0000","last_became_active":"2024-09-11T22:18:15.389453+0000","last_became_peered":"2024-09-11T22:18:15.389453+0000","last_unstale":"2024-09-11T22:18:16.406497+0000","last_undegraded":"2024-09-11T22:18:16.406497+0000","last_fullsized":"2024-09-11T22:18:16.406497+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:30.758503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893145+0000","last_change":"2024-09-11T22:18:14.400180+0000","last_active":"2024-09-11T22:18:16.893145+0000","last_peered":"2024-09-11T22:18:16.893145+0000","last_clean":"2024-09-11T22:18:16.893145+0000","last_became_active":"2024-09-11T22:18:14.399884+0000","last_became_peered":"2024-09-11T22:18:14.399884+0000","last_unstale":"2024-09-11T22:18:16.893145+0000","last_undegraded":"2024-09-11T22:18:16.893145+0000","last_fullsized":"2024-09-11T22:18:16.893145+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:29.644288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.407060+0000","last_change":"2024-09-11T22:18:15.396417+0000","last_active":"2024-09-11T22:18:16.407060+0000","last_peered":"2024-09-11T22:18:16.407060+0000","last_clean":"2024-09-11T22:18:16.407060+0000","last_became_active":"2024-09-11T22:18:15.396092+0000","last_became_peered":"2024-09-11T22:18:15.396092+0000","last_unstale":"2024-09-11T22:18:16.407060+0000","last_undegraded":"2024-09-11T22:18:16.407060+0000","last_fullsized":"2024-09-11T22:18:16.407060+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:28.538570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081257+0000","last_change":"2024-09-11T22:18:14.394020+0000","last_active":"2024-09-11T22:18:17.081257+0000","last_peered":"2024-09-11T22:18:17.081257+0000","last_clean":"2024-09-11T22:18:17.081257+0000","last_became_active":"2024-09-11T22:18:14.393713+0000","last_became_peered":"2024-09-11T22:18:14.393713+0000","last_unstale":"2024-09-11T22:18:17.081257+0000","last_undegraded":"2024-09-11T22:18:17.081257+0000","last_fullsized":"2024-09-11T22:18:17.081257+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:38.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406434+0000","last_change":"2024-09-11T22:18:15.400549+0000","last_active":"2024-09-11T22:18:16.406434+0000","last_peered":"2024-09-11T22:18:16.406434+0000","last_clean":"2024-09-11T22:18:16.406434+0000","last_became_active":"2024-09-11T22:18:15.400232+0000","last_became_peered":"2024-09-11T22:18:15.400232+0000","last_unstale":"2024-09-11T22:18:16.406434+0000","last_undegraded":"2024-09-11T22:18:16.406434+0000","last_fullsized":"2024-09-11T22:18:16.406434+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:30.180093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081678+0000","last_change":"2024-09-11T22:18:14.390561+0000","last_active":"2024-09-11T22:18:17.081678+0000","last_peered":"2024-09-11T22:18:17.081678+0000","last_clean":"2024-09-11T22:18:17.081678+0000","last_became_active":"2024-09-11T22:18:14.390247+0000","last_became_peered":"2024-09-11T22:18:14.390247+0000","last_unstale":"2024-09-11T22:18:17.081678+0000","last_undegraded":"2024-09-11T22:18:17.081678+0000","last_fullsized":"2024-09-11T22:18:17.081678+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:29.644288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082205+0000","last_change":"2024-09-11T22:18:15.404648+0000","last_active":"2024-09-11T22:18:17.082205+0000","last_peered":"2024-09-11T22:18:17.082205+0000","last_clean":"2024-09-11T22:18:17.082205+0000","last_became_active":"2024-09-11T22:18:15.404259+0000","last_became_peered":"2024-09-11T22:18:15.404259+0000","last_unstale":"2024-09-11T22:18:17.082205+0000","last_undegraded":"2024-09-11T22:18:17.082205+0000","last_fullsized":"2024-09-11T22:18:17.082205+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:18.105927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"119'3","reported_seq":17,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893071+0000","last_change":"2024-09-11T22:18:14.402317+0000","last_active":"2024-09-11T22:18:16.893071+0000","last_peered":"2024-09-11T22:18:16.893071+0000","last_clean":"2024-09-11T22:18:16.893071+0000","last_became_active":"2024-09-11T22:18:14.401937+0000","last_became_peered":"2024-09-11T22:18:14.401937+0000","last_unstale":"2024-09-11T22:18:16.893071+0000","last_undegraded":"2024-09-11T22:18:16.893071+0000","last_fullsized":"2024-09-11T22:18:16.893071+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:10.730302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406777+0000","last_change":"2024-09-11T22:18:15.397228+0000","last_active":"2024-09-11T22:18:16.406777+0000","last_peered":"2024-09-11T22:18:16.406777+0000","last_clean":"2024-09-11T22:18:16.406777+0000","last_became_active":"2024-09-11T22:18:15.396919+0000","last_became_peered":"2024-09-11T22:18:15.396919+0000","last_unstale":"2024-09-11T22:18:16.406777+0000","last_undegraded":"2024-09-11T22:18:16.406777+0000","last_fullsized":"2024-09-11T22:18:16.406777+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:26.770816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"119'6","reported_seq":20,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893382+0000","last_change":"2024-09-11T22:18:14.399464+0000","last_active":"2024-09-11T22:18:16.893382+0000","last_peered":"2024-09-11T22:18:16.893382+0000","last_clean":"2024-09-11T22:18:16.893382+0000","last_became_active":"2024-09-11T22:18:14.399179+0000","last_became_peered":"2024-09-11T22:18:14.399179+0000","last_unstale":"2024-09-11T22:18:16.893382+0000","last_undegraded":"2024-09-11T22:18:16.893382+0000","last_fullsized":"2024-09-11T22:18:16.893382+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:03.775272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081782+0000","last_change":"2024-09-11T22:18:15.406385+0000","last_active":"2024-09-11T22:18:17.081782+0000","last_peered":"2024-09-11T22:18:17.081782+0000","last_clean":"2024-09-11T22:18:17.081782+0000","last_became_active":"2024-09-11T22:18:15.406078+0000","last_became_peered":"2024-09-11T22:18:15.406078+0000","last_unstale":"2024-09-11T22:18:17.081782+0000","last_undegraded":"2024-09-11T22:18:17.081782+0000","last_fullsized":"2024-09-11T22:18:17.081782+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:30.218569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"119'2","reported_seq":16,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398987+0000","last_change":"2024-09-11T22:18:14.394153+0000","last_active":"2024-09-11T22:18:16.398987+0000","last_peered":"2024-09-11T22:18:16.398987+0000","last_clean":"2024-09-11T22:18:16.398987+0000","last_became_active":"2024-09-11T22:18:14.393807+0000","last_became_peered":"2024-09-11T22:18:14.393807+0000","last_unstale":"2024-09-11T22:18:16.398987+0000","last_undegraded":"2024-09-11T22:18:16.398987+0000","last_fullsized":"2024-09-11T22:18:16.398987+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:29.635935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081537+0000","last_change":"2024-09-11T22:18:15.400235+0000","last_active":"2024-09-11T22:18:17.081537+0000","last_peered":"2024-09-11T22:18:17.081537+0000","last_clean":"2024-09-11T22:18:17.081537+0000","last_became_active":"2024-09-11T22:18:15.399928+0000","last_became_peered":"2024-09-11T22:18:15.399928+0000","last_unstale":"2024-09-11T22:18:17.081537+0000","last_undegraded":"2024-09-11T22:18:17.081537+0000","last_fullsized":"2024-09-11T22:18:17.081537+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:29.715459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.405855+0000","last_change":"2024-09-11T22:18:14.402005+0000","last_active":"2024-09-11T22:18:16.405855+0000","last_peered":"2024-09-11T22:18:16.405855+0000","last_clean":"2024-09-11T22:18:16.405855+0000","last_became_active":"2024-09-11T22:18:14.401763+0000","last_became_peered":"2024-09-11T22:18:14.401763+0000","last_unstale":"2024-09-11T22:18:16.405855+0000","last_undegraded":"2024-09-11T22:18:16.405855+0000","last_fullsized":"2024-09-11T22:18:16.405855+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:47.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081505+0000","last_change":"2024-09-11T22:18:15.401904+0000","last_active":"2024-09-11T22:18:17.081505+0000","last_peered":"2024-09-11T22:18:17.081505+0000","last_clean":"2024-09-11T22:18:17.081505+0000","last_became_active":"2024-09-11T22:18:15.401590+0000","last_became_peered":"2024-09-11T22:18:15.401590+0000","last_unstale":"2024-09-11T22:18:17.081505+0000","last_undegraded":"2024-09-11T22:18:17.081505+0000","last_fullsized":"2024-09-11T22:18:17.081505+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:36:56.029652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"119'8","reported_seq":22,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081070+0000","last_change":"2024-09-11T22:18:14.400223+0000","last_active":"2024-09-11T22:18:17.081070+0000","last_peered":"2024-09-11T22:18:17.081070+0000","last_clean":"2024-09-11T22:18:17.081070+0000","last_became_active":"2024-09-11T22:18:14.399666+0000","last_became_peered":"2024-09-11T22:18:14.399666+0000","last_unstale":"2024-09-11T22:18:17.081070+0000","last_undegraded":"2024-09-11T22:18:17.081070+0000","last_fullsized":"2024-09-11T22:18:17.081070+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:01.400475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081414+0000","last_change":"2024-09-11T22:18:15.395943+0000","last_active":"2024-09-11T22:18:17.081414+0000","last_peered":"2024-09-11T22:18:17.081414+0000","last_clean":"2024-09-11T22:18:17.081414+0000","last_became_active":"2024-09-11T22:18:15.395087+0000","last_became_peered":"2024-09-11T22:18:15.395087+0000","last_unstale":"2024-09-11T22:18:17.081414+0000","last_undegraded":"2024-09-11T22:18:17.081414+0000","last_fullsized":"2024-09-11T22:18:17.081414+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:52.983778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893541+0000","last_change":"2024-09-11T22:18:14.397820+0000","last_active":"2024-09-11T22:18:16.893541+0000","last_peered":"2024-09-11T22:18:16.893541+0000","last_clean":"2024-09-11T22:18:16.893541+0000","last_became_active":"2024-09-11T22:18:14.397467+0000","last_became_peered":"2024-09-11T22:18:14.397467+0000","last_unstale":"2024-09-11T22:18:16.893541+0000","last_undegraded":"2024-09-11T22:18:16.893541+0000","last_fullsized":"2024-09-11T22:18:16.893541+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:30.141426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398985+0000","last_change":"2024-09-11T22:18:15.393494+0000","last_active":"2024-09-11T22:18:16.398985+0000","last_peered":"2024-09-11T22:18:16.398985+0000","last_clean":"2024-09-11T22:18:16.398985+0000","last_became_active":"2024-09-11T22:18:15.393182+0000","last_became_peered":"2024-09-11T22:18:15.393182+0000","last_unstale":"2024-09-11T22:18:16.398985+0000","last_undegraded":"2024-09-11T22:18:16.398985+0000","last_fullsized":"2024-09-11T22:18:16.398985+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:39.962591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"119'2","reported_seq":16,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081388+0000","last_change":"2024-09-11T22:18:14.392009+0000","last_active":"2024-09-11T22:18:17.081388+0000","last_peered":"2024-09-11T22:18:17.081388+0000","last_clean":"2024-09-11T22:18:17.081388+0000","last_became_active":"2024-09-11T22:18:14.391704+0000","last_became_peered":"2024-09-11T22:18:14.391704+0000","last_unstale":"2024-09-11T22:18:17.081388+0000","last_undegraded":"2024-09-11T22:18:17.081388+0000","last_fullsized":"2024-09-11T22:18:17.081388+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:49.090421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082155+0000","last_change":"2024-09-11T22:18:15.398734+0000","last_active":"2024-09-11T22:18:17.082155+0000","last_peered":"2024-09-11T22:18:17.082155+0000","last_clean":"2024-09-11T22:18:17.082155+0000","last_became_active":"2024-09-11T22:18:15.398387+0000","last_became_peered":"2024-09-11T22:18:15.398387+0000","last_unstale":"2024-09-11T22:18:17.082155+0000","last_undegraded":"2024-09-11T22:18:17.082155+0000","last_fullsized":"2024-09-11T22:18:17.082155+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:15.451642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406040+0000","last_change":"2024-09-11T22:18:14.393793+0000","last_active":"2024-09-11T22:18:16.406040+0000","last_peered":"2024-09-11T22:18:16.406040+0000","last_clean":"2024-09-11T22:18:16.406040+0000","last_became_active":"2024-09-11T22:18:14.393496+0000","last_became_peered":"2024-09-11T22:18:14.393496+0000","last_unstale":"2024-09-11T22:18:16.406040+0000","last_undegraded":"2024-09-11T22:18:16.406040+0000","last_fullsized":"2024-09-11T22:18:16.406040+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:52.461559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082769+0000","last_change":"2024-09-11T22:18:15.406005+0000","last_active":"2024-09-11T22:18:17.082769+0000","last_peered":"2024-09-11T22:18:17.082769+0000","last_clean":"2024-09-11T22:18:17.082769+0000","last_became_active":"2024-09-11T22:18:15.405672+0000","last_became_peered":"2024-09-11T22:18:15.405672+0000","last_unstale":"2024-09-11T22:18:17.082769+0000","last_undegraded":"2024-09-11T22:18:17.082769+0000","last_fullsized":"2024-09-11T22:18:17.082769+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:21.104121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406853+0000","last_change":"2024-09-11T22:18:14.395819+0000","last_active":"2024-09-11T22:18:16.406853+0000","last_peered":"2024-09-11T22:18:16.406853+0000","last_clean":"2024-09-11T22:18:16.406853+0000","last_became_active":"2024-09-11T22:18:14.395449+0000","last_became_peered":"2024-09-11T22:18:14.395449+0000","last_unstale":"2024-09-11T22:18:16.406853+0000","last_undegraded":"2024-09-11T22:18:16.406853+0000","last_fullsized":"2024-09-11T22:18:16.406853+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:57.778756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082374+0000","last_change":"2024-09-11T22:18:15.403455+0000","last_active":"2024-09-11T22:18:17.082374+0000","last_peered":"2024-09-11T22:18:17.082374+0000","last_clean":"2024-09-11T22:18:17.082374+0000","last_became_active":"2024-09-11T22:18:15.403172+0000","last_became_peered":"2024-09-11T22:18:15.403172+0000","last_unstale":"2024-09-11T22:18:17.082374+0000","last_undegraded":"2024-09-11T22:18:17.082374+0000","last_fullsized":"2024-09-11T22:18:17.082374+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:46.227885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"119'2","reported_seq":16,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398983+0000","last_change":"2024-09-11T22:18:14.392831+0000","last_active":"2024-09-11T22:18:16.398983+0000","last_peered":"2024-09-11T22:18:16.398983+0000","last_clean":"2024-09-11T22:18:16.398983+0000","last_became_active":"2024-09-11T22:18:14.392454+0000","last_became_peered":"2024-09-11T22:18:14.392454+0000","last_unstale":"2024-09-11T22:18:16.398983+0000","last_undegraded":"2024-09-11T22:18:16.398983+0000","last_fullsized":"2024-09-11T22:18:16.398983+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:15.717819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892929+0000","last_change":"2024-09-11T22:18:15.397239+0000","last_active":"2024-09-11T22:18:16.892929+0000","last_peered":"2024-09-11T22:18:16.892929+0000","last_clean":"2024-09-11T22:18:16.892929+0000","last_became_active":"2024-09-11T22:18:15.396921+0000","last_became_peered":"2024-09-11T22:18:15.396921+0000","last_unstale":"2024-09-11T22:18:16.892929+0000","last_undegraded":"2024-09-11T22:18:16.892929+0000","last_fullsized":"2024-09-11T22:18:16.892929+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:53.152937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081499+0000","last_change":"2024-09-11T22:18:14.394805+0000","last_active":"2024-09-11T22:18:17.081499+0000","last_peered":"2024-09-11T22:18:17.081499+0000","last_clean":"2024-09-11T22:18:17.081499+0000","last_became_active":"2024-09-11T22:18:14.394547+0000","last_became_peered":"2024-09-11T22:18:14.394547+0000","last_unstale":"2024-09-11T22:18:17.081499+0000","last_undegraded":"2024-09-11T22:18:17.081499+0000","last_fullsized":"2024-09-11T22:18:17.081499+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:31.918926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082286+0000","last_change":"2024-09-11T22:18:15.400740+0000","last_active":"2024-09-11T22:18:17.082286+0000","last_peered":"2024-09-11T22:18:17.082286+0000","last_clean":"2024-09-11T22:18:17.082286+0000","last_became_active":"2024-09-11T22:18:15.400458+0000","last_became_peered":"2024-09-11T22:18:15.400458+0000","last_unstale":"2024-09-11T22:18:17.082286+0000","last_undegraded":"2024-09-11T22:18:17.082286+0000","last_fullsized":"2024-09-11T22:18:17.082286+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:01.947194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.398534+0000","last_change":"2024-09-11T22:18:14.393175+0000","last_active":"2024-09-11T22:18:16.398534+0000","last_peered":"2024-09-11T22:18:16.398534+0000","last_clean":"2024-09-11T22:18:16.398534+0000","last_became_active":"2024-09-11T22:18:14.389968+0000","last_became_peered":"2024-09-11T22:18:14.389968+0000","last_unstale":"2024-09-11T22:18:16.398534+0000","last_undegraded":"2024-09-11T22:18:16.398534+0000","last_fullsized":"2024-09-11T22:18:16.398534+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:56.568071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081524+0000","last_change":"2024-09-11T22:18:15.394965+0000","last_active":"2024-09-11T22:18:17.081524+0000","last_peered":"2024-09-11T22:18:17.081524+0000","last_clean":"2024-09-11T22:18:17.081524+0000","last_became_active":"2024-09-11T22:18:15.394640+0000","last_became_peered":"2024-09-11T22:18:15.394640+0000","last_unstale":"2024-09-11T22:18:17.081524+0000","last_undegraded":"2024-09-11T22:18:17.081524+0000","last_fullsized":"2024-09-11T22:18:17.081524+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:40:20.212512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893352+0000","last_change":"2024-09-11T22:18:14.401946+0000","last_active":"2024-09-11T22:18:16.893352+0000","last_peered":"2024-09-11T22:18:16.893352+0000","last_clean":"2024-09-11T22:18:16.893352+0000","last_became_active":"2024-09-11T22:18:14.401243+0000","last_became_peered":"2024-09-11T22:18:14.401243+0000","last_unstale":"2024-09-11T22:18:16.893352+0000","last_undegraded":"2024-09-11T22:18:16.893352+0000","last_fullsized":"2024-09-11T22:18:16.893352+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:42.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406209+0000","last_change":"2024-09-11T22:18:15.399899+0000","last_active":"2024-09-11T22:18:16.406209+0000","last_peered":"2024-09-11T22:18:16.406209+0000","last_clean":"2024-09-11T22:18:16.406209+0000","last_became_active":"2024-09-11T22:18:15.399629+0000","last_became_peered":"2024-09-11T22:18:15.399629+0000","last_unstale":"2024-09-11T22:18:16.406209+0000","last_undegraded":"2024-09-11T22:18:16.406209+0000","last_fullsized":"2024-09-11T22:18:16.406209+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:58.686162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"119'2","reported_seq":16,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082424+0000","last_change":"2024-09-11T22:18:14.395777+0000","last_active":"2024-09-11T22:18:17.082424+0000","last_peered":"2024-09-11T22:18:17.082424+0000","last_clean":"2024-09-11T22:18:17.082424+0000","last_became_active":"2024-09-11T22:18:14.395436+0000","last_became_peered":"2024-09-11T22:18:14.395436+0000","last_unstale":"2024-09-11T22:18:17.082424+0000","last_undegraded":"2024-09-11T22:18:17.082424+0000","last_fullsized":"2024-09-11T22:18:17.082424+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:42.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893597+0000","last_change":"2024-09-11T22:18:15.400542+0000","last_active":"2024-09-11T22:18:16.893597+0000","last_peered":"2024-09-11T22:18:16.893597+0000","last_clean":"2024-09-11T22:18:16.893597+0000","last_became_active":"2024-09-11T22:18:15.400269+0000","last_became_peered":"2024-09-11T22:18:15.400269+0000","last_unstale":"2024-09-11T22:18:16.893597+0000","last_undegraded":"2024-09-11T22:18:16.893597+0000","last_fullsized":"2024-09-11T22:18:16.893597+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:14.733594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"119'1","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406300+0000","last_change":"2024-09-11T22:18:14.392721+0000","last_active":"2024-09-11T22:18:16.406300+0000","last_peered":"2024-09-11T22:18:16.406300+0000","last_clean":"2024-09-11T22:18:16.406300+0000","last_became_active":"2024-09-11T22:18:14.392450+0000","last_became_peered":"2024-09-11T22:18:14.392450+0000","last_unstale":"2024-09-11T22:18:16.406300+0000","last_undegraded":"2024-09-11T22:18:16.406300+0000","last_fullsized":"2024-09-11T22:18:16.406300+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:02.921225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893364+0000","last_change":"2024-09-11T22:18:15.394562+0000","last_active":"2024-09-11T22:18:16.893364+0000","last_peered":"2024-09-11T22:18:16.893364+0000","last_clean":"2024-09-11T22:18:16.893364+0000","last_became_active":"2024-09-11T22:18:15.394263+0000","last_became_peered":"2024-09-11T22:18:15.394263+0000","last_unstale":"2024-09-11T22:18:16.893364+0000","last_undegraded":"2024-09-11T22:18:16.893364+0000","last_fullsized":"2024-09-11T22:18:16.893364+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:18.247242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893199+0000","last_change":"2024-09-11T22:18:14.401709+0000","last_active":"2024-09-11T22:18:16.893199+0000","last_peered":"2024-09-11T22:18:16.893199+0000","last_clean":"2024-09-11T22:18:16.893199+0000","last_became_active":"2024-09-11T22:18:14.401223+0000","last_became_peered":"2024-09-11T22:18:14.401223+0000","last_unstale":"2024-09-11T22:18:16.893199+0000","last_undegraded":"2024-09-11T22:18:16.893199+0000","last_fullsized":"2024-09-11T22:18:16.893199+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:14.802319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.405980+0000","last_change":"2024-09-11T22:18:15.398847+0000","last_active":"2024-09-11T22:18:16.405980+0000","last_peered":"2024-09-11T22:18:16.405980+0000","last_clean":"2024-09-11T22:18:16.405980+0000","last_became_active":"2024-09-11T22:18:15.398532+0000","last_became_peered":"2024-09-11T22:18:15.398532+0000","last_unstale":"2024-09-11T22:18:16.405980+0000","last_undegraded":"2024-09-11T22:18:16.405980+0000","last_fullsized":"2024-09-11T22:18:16.405980+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:02.260371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082287+0000","last_change":"2024-09-11T22:18:14.397568+0000","last_active":"2024-09-11T22:18:17.082287+0000","last_peered":"2024-09-11T22:18:17.082287+0000","last_clean":"2024-09-11T22:18:17.082287+0000","last_became_active":"2024-09-11T22:18:14.397290+0000","last_became_peered":"2024-09-11T22:18:14.397290+0000","last_unstale":"2024-09-11T22:18:17.082287+0000","last_undegraded":"2024-09-11T22:18:17.082287+0000","last_fullsized":"2024-09-11T22:18:17.082287+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:30.141426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081716+0000","last_change":"2024-09-11T22:18:15.403041+0000","last_active":"2024-09-11T22:18:17.081716+0000","last_peered":"2024-09-11T22:18:17.081716+0000","last_clean":"2024-09-11T22:18:17.081716+0000","last_became_active":"2024-09-11T22:18:15.402576+0000","last_became_peered":"2024-09-11T22:18:15.402576+0000","last_unstale":"2024-09-11T22:18:17.081716+0000","last_undegraded":"2024-09-11T22:18:17.081716+0000","last_fullsized":"2024-09-11T22:18:17.081716+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:01.036271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406831+0000","last_change":"2024-09-11T22:18:14.392868+0000","last_active":"2024-09-11T22:18:16.406831+0000","last_peered":"2024-09-11T22:18:16.406831+0000","last_clean":"2024-09-11T22:18:16.406831+0000","last_became_active":"2024-09-11T22:18:14.392570+0000","last_became_peered":"2024-09-11T22:18:14.392570+0000","last_unstale":"2024-09-11T22:18:16.406831+0000","last_undegraded":"2024-09-11T22:18:16.406831+0000","last_fullsized":"2024-09-11T22:18:16.406831+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:19.096947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081901+0000","last_change":"2024-09-11T22:18:15.399104+0000","last_active":"2024-09-11T22:18:17.081901+0000","last_peered":"2024-09-11T22:18:17.081901+0000","last_clean":"2024-09-11T22:18:17.081901+0000","last_became_active":"2024-09-11T22:18:15.398826+0000","last_became_peered":"2024-09-11T22:18:15.398826+0000","last_unstale":"2024-09-11T22:18:17.081901+0000","last_undegraded":"2024-09-11T22:18:17.081901+0000","last_fullsized":"2024-09-11T22:18:17.081901+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:20.369527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081620+0000","last_change":"2024-09-11T22:18:14.393814+0000","last_active":"2024-09-11T22:18:17.081620+0000","last_peered":"2024-09-11T22:18:17.081620+0000","last_clean":"2024-09-11T22:18:17.081620+0000","last_became_active":"2024-09-11T22:18:14.393396+0000","last_became_peered":"2024-09-11T22:18:14.393396+0000","last_unstale":"2024-09-11T22:18:17.081620+0000","last_undegraded":"2024-09-11T22:18:17.081620+0000","last_fullsized":"2024-09-11T22:18:17.081620+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:25.765535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082307+0000","last_change":"2024-09-11T22:18:15.408858+0000","last_active":"2024-09-11T22:18:17.082307+0000","last_peered":"2024-09-11T22:18:17.082307+0000","last_clean":"2024-09-11T22:18:17.082307+0000","last_became_active":"2024-09-11T22:18:15.408384+0000","last_became_peered":"2024-09-11T22:18:15.408384+0000","last_unstale":"2024-09-11T22:18:17.082307+0000","last_undegraded":"2024-09-11T22:18:17.082307+0000","last_fullsized":"2024-09-11T22:18:17.082307+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:45:12.601612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081179+0000","last_change":"2024-09-11T22:18:14.396779+0000","last_active":"2024-09-11T22:18:17.081179+0000","last_peered":"2024-09-11T22:18:17.081179+0000","last_clean":"2024-09-11T22:18:17.081179+0000","last_became_active":"2024-09-11T22:18:14.396480+0000","last_became_peered":"2024-09-11T22:18:14.396480+0000","last_unstale":"2024-09-11T22:18:17.081179+0000","last_undegraded":"2024-09-11T22:18:17.081179+0000","last_fullsized":"2024-09-11T22:18:17.081179+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:02.602508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.892954+0000","last_change":"2024-09-11T22:18:15.394847+0000","last_active":"2024-09-11T22:18:16.892954+0000","last_peered":"2024-09-11T22:18:16.892954+0000","last_clean":"2024-09-11T22:18:16.892954+0000","last_became_active":"2024-09-11T22:18:15.394501+0000","last_became_peered":"2024-09-11T22:18:15.394501+0000","last_unstale":"2024-09-11T22:18:16.892954+0000","last_undegraded":"2024-09-11T22:18:16.892954+0000","last_fullsized":"2024-09-11T22:18:16.892954+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:06.734809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.893321+0000","last_change":"2024-09-11T22:18:14.402459+0000","last_active":"2024-09-11T22:18:16.893321+0000","last_peered":"2024-09-11T22:18:16.893321+0000","last_clean":"2024-09-11T22:18:16.893321+0000","last_became_active":"2024-09-11T22:18:14.402137+0000","last_became_peered":"2024-09-11T22:18:14.402137+0000","last_unstale":"2024-09-11T22:18:16.893321+0000","last_undegraded":"2024-09-11T22:18:16.893321+0000","last_fullsized":"2024-09-11T22:18:16.893321+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:52.403862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.081869+0000","last_change":"2024-09-11T22:18:15.400260+0000","last_active":"2024-09-11T22:18:17.081869+0000","last_peered":"2024-09-11T22:18:17.081869+0000","last_clean":"2024-09-11T22:18:17.081869+0000","last_became_active":"2024-09-11T22:18:15.399579+0000","last_became_peered":"2024-09-11T22:18:15.399579+0000","last_unstale":"2024-09-11T22:18:17.081869+0000","last_undegraded":"2024-09-11T22:18:17.081869+0000","last_fullsized":"2024-09-11T22:18:17.081869+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:14.373012+0000","last_clean_scrub_stamp":"2024-09-11T22:18:14.373012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:07.195973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:16.406652+0000","last_change":"2024-09-11T22:18:14.395747+0000","last_active":"2024-09-11T22:18:16.406652+0000","last_peered":"2024-09-11T22:18:16.406652+0000","last_clean":"2024-09-11T22:18:16.406652+0000","last_became_active":"2024-09-11T22:18:14.395432+0000","last_became_peered":"2024-09-11T22:18:14.395432+0000","last_unstale":"2024-09-11T22:18:16.406652+0000","last_undegraded":"2024-09-11T22:18:16.406652+0000","last_fullsized":"2024-09-11T22:18:16.406652+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:18:13.367731+0000","last_clean_scrub_stamp":"2024-09-11T22:18:13.367731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:32.281716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":351,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-11T22:18:17.082372+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:18:17.082372+0000","last_peered":"2024-09-11T22:18:17.082372+0000","last_clean":"2024-09-11T22:18:17.082372+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:18:17.082372+0000","last_undegraded":"2024-09-11T22:18:17.082372+0000","last_fullsized":"2024-09-11T22:18:17.082372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509532,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46536,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325304,"statfs":{"total":96636764160,"available":96589111296,"internally_reserved":0,"allocated":1486848,"data_stored":649973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509529,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40968,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330872,"statfs":{"total":96636764160,"available":96594812928,"internally_reserved":0,"allocated":1490944,"data_stored":650507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509531,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50684,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321156,"statfs":{"total":96636764160,"available":96584863744,"internally_reserved":0,"allocated":1482752,"data_stored":649903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509531,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54860,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316980,"statfs":{"total":96636764160,"available":96580587520,"internally_reserved":0,"allocated":1499136,"data_stored":651585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509531,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59016,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312824,"statfs":{"total":96636764160,"available":96576331776,"internally_reserved":0,"allocated":1490944,"data_stored":650027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509530,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51284,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320556,"statfs":{"total":96636764160,"available":96584249344,"internally_reserved":0,"allocated":2097152,"data_stored":1241995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45704,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326136,"statfs":{"total":96636764160,"available":96589963264,"internally_reserved":0,"allocated":2084864,"data_stored":1240887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54844,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316996,"statfs":{"total":96636764160,"available":96580603904,"internally_reserved":0,"allocated":1482752,"data_stored":649903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:18:23.751 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:18:23.752 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T22:18:23.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.892+0000 7f086372c640 1 Processor -- start 2024-09-11T22:18:23.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.893+0000 7f086372c640 1 -- start start 2024-09-11T22:18:23.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.893+0000 7f086372c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0d18a0 0x7f085c0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:23.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.893+0000 7f086372c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f085c0d3a30 0x7f085c0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.893+0000 7f086372c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f085c0cfa80 con 0x7f085c15e870 2024-09-11T22:18:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.893+0000 7f086372c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f085c0d3ea0 con 0x7f085c0d3a30 2024-09-11T22:18:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.893+0000 7f086372c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f085c0d40d0 con 0x7f085c0d18a0 2024-09-11T22:18:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.894+0000 7f0860cc7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0d18a0 0x7f085c0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.894+0000 7f0861cc9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f085c0d3a30 0x7f085c0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.894+0000 7f08614c8640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f085c15e870 0x7f085c0d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:39860/0 (socket says 172.21.15.50:39860) 2024-09-11T22:18:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.894+0000 7f0861cc9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f085c0d3a30 0x7f085c0b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:60610/0 (socket says 172.21.15.50:60610) 2024-09-11T22:18:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.894+0000 7f08614c8640 1 -- 172.21.15.50:0/2187885679 learned_addr learned my addr 172.21.15.50:0/2187885679 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.894+0000 7f0861cc9640 1 -- 172.21.15.50:0/2187885679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0d18a0 msgr2=0x7f085c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.894+0000 7f0861cc9640 1 --2- 172.21.15.50:0/2187885679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0d18a0 0x7f085c0d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.894+0000 7f0861cc9640 1 -- 172.21.15.50:0/2187885679 >> v1:172.21.15.77:6789/0 conn(0x7f085c15e870 legacy=0x7f085c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.894+0000 7f085bfff640 1 -- 172.21.15.50:0/2187885679 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4055655187 0 0) 0x7f084c001490 con 0x7f085c15e870 2024-09-11T22:18:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.894+0000 7f0861cc9640 1 -- 172.21.15.50:0/2187885679 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085c0d43b0 con 0x7f085c0d3a30 2024-09-11T22:18:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.894+0000 7f0860cc7640 1 --2- 172.21.15.50:0/2187885679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0d18a0 0x7f085c0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.895+0000 7f0861cc9640 1 --2- 172.21.15.50:0/2187885679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f085c0d3a30 0x7f085c0b8400 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f08540097a0 tx=0x7f085402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6bcf38c834214bf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.895+0000 7f085bfff640 1 -- 172.21.15.50:0/2187885679 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0854037070 con 0x7f085c0d3a30 2024-09-11T22:18:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.895+0000 7f085bfff640 1 -- 172.21.15.50:0/2187885679 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0854032440 con 0x7f085c0d3a30 2024-09-11T22:18:23.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.895+0000 7f085bfff640 1 -- 172.21.15.50:0/2187885679 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0854032810 con 0x7f085c0d3a30 2024-09-11T22:18:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.896+0000 7f086372c640 1 -- 172.21.15.50:0/2187885679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f085c0d3a30 msgr2=0x7f085c0b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.896+0000 7f086372c640 1 --2- 172.21.15.50:0/2187885679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f085c0d3a30 0x7f085c0b8400 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f08540097a0 tx=0x7f085402a180 comp rx=0 tx=0).stop 2024-09-11T22:18:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.896+0000 7f086372c640 1 -- 172.21.15.50:0/2187885679 shutdown_connections 2024-09-11T22:18:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.896+0000 7f086372c640 1 --2- 172.21.15.50:0/2187885679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f085c0d3a30 0x7f085c0b8400 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.896+0000 7f086372c640 1 --2- 172.21.15.50:0/2187885679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0d18a0 0x7f085c0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:23.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.896+0000 7f086372c640 1 -- 172.21.15.50:0/2187885679 >> 172.21.15.50:0/2187885679 conn(0x7f085c0727a0 msgr2=0x7f085c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:23.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.896+0000 7f086372c640 1 -- 172.21.15.50:0/2187885679 shutdown_connections 2024-09-11T22:18:23.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.896+0000 7f086372c640 1 -- 172.21.15.50:0/2187885679 wait complete. 2024-09-11T22:18:23.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.897+0000 7f086372c640 1 Processor -- start 2024-09-11T22:18:23.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.897+0000 7f086372c640 1 -- start start 2024-09-11T22:18:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f086372c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f085c0d18a0 0x7f085c0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f086372c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0d3a30 0x7f085c15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f086372c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f085c15e870 0x7f085c0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f086372c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f085c15ec50 con 0x7f085c15e870 2024-09-11T22:18:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f086372c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f085c0b7ee0 con 0x7f085c0d18a0 2024-09-11T22:18:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f086372c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f085c0b78b0 con 0x7f085c0d3a30 2024-09-11T22:18:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f0861cc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f085c15e870 0x7f085c0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f0861cc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f085c15e870 0x7f085c0ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56358/0 (socket says 172.21.15.50:56358) 2024-09-11T22:18:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f0861cc9640 1 -- 172.21.15.50:0/252236536 learned_addr learned my addr 172.21.15.50:0/252236536 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f08614c8640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f085c0d18a0 0x7f085c0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f0860cc7640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0d3a30 0x7f085c15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f0861cc9640 1 -- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0d3a30 msgr2=0x7f085c15bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f0861cc9640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0d3a30 0x7f085c15bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f0861cc9640 1 -- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f085c0d18a0 msgr2=0x7f085c0c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f0861cc9640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f085c0d18a0 0x7f085c0c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.898+0000 7f0861cc9640 1 -- 172.21.15.50:0/252236536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085c0ca5d0 con 0x7f085c15e870 2024-09-11T22:18:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.899+0000 7f0861cc9640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f085c15e870 0x7f085c0ce9c0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f0854035040 tx=0x7f08540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.899+0000 7f0859ffb640 1 -- 172.21.15.50:0/252236536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0854037050 con 0x7f085c15e870 2024-09-11T22:18:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.899+0000 7f0859ffb640 1 -- 172.21.15.50:0/252236536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0854038040 con 0x7f085c15e870 2024-09-11T22:18:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.899+0000 7f086372c640 1 -- 172.21.15.50:0/252236536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f085c0ca8b0 con 0x7f085c15e870 2024-09-11T22:18:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.899+0000 7f0859ffb640 1 -- 172.21.15.50:0/252236536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0854004450 con 0x7f085c15e870 2024-09-11T22:18:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.899+0000 7f086372c640 1 -- 172.21.15.50:0/252236536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f085c0cc5e0 con 0x7f085c15e870 2024-09-11T22:18:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.900+0000 7f086372c640 1 -- 172.21.15.50:0/252236536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f085c0d34f0 con 0x7f085c15e870 2024-09-11T22:18:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.900+0000 7f0859ffb640 1 -- 172.21.15.50:0/252236536 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f085403c6d0 con 0x7f085c15e870 2024-09-11T22:18:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.901+0000 7f0859ffb640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f084806be30 0x7f084806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.901+0000 7f0859ffb640 1 -- 172.21.15.50:0/252236536 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f08540ab6e0 con 0x7f085c15e870 2024-09-11T22:18:23.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.901+0000 7f08614c8640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f084806be30 0x7f084806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:23.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.902+0000 7f08614c8640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f084806be30 0x7f084806e2f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f084c0012e0 tx=0x7f084c007ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:23.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:23.905+0000 7f0859ffb640 1 -- 172.21.15.50:0/252236536 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0854079a40 con 0x7f085c15e870 2024-09-11T22:18:24.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.146+0000 7f086372c640 1 -- 172.21.15.50:0/252236536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f085c067bf0 con 0x7f085c15e870 2024-09-11T22:18:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.148+0000 7f0859ffb640 1 -- 172.21.15.50:0/252236536 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f085407dd40 con 0x7f085c15e870 2024-09-11T22:18:24.148 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:18:24.148 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:18:24.148 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-09-11T22:18:24.149 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-09-11T22:18:24.149 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T22:18:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-11T22:18:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.150+0000 7f086372c640 1 -- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f084806be30 msgr2=0x7f084806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.150+0000 7f086372c640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f084806be30 0x7f084806e2f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f084c0012e0 tx=0x7f084c007ed0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.150+0000 7f086372c640 1 -- 172.21.15.50:0/252236536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f085c15e870 msgr2=0x7f085c0ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.150+0000 7f086372c640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f085c15e870 0x7f085c0ce9c0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f0854035040 tx=0x7f08540046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.150+0000 7f086372c640 1 -- 172.21.15.50:0/252236536 shutdown_connections 2024-09-11T22:18:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.150+0000 7f086372c640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f084806be30 0x7f084806e2f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.150+0000 7f086372c640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0d3a30 0x7f085c15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.150+0000 7f086372c640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f085c15e870 0x7f085c0ce9c0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.150+0000 7f086372c640 1 --2- 172.21.15.50:0/252236536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f085c0d18a0 0x7f085c0c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.150+0000 7f086372c640 1 -- 172.21.15.50:0/252236536 >> 172.21.15.50:0/252236536 conn(0x7f085c0727a0 msgr2=0x7f085c0b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.150+0000 7f086372c640 1 -- 172.21.15.50:0/252236536 shutdown_connections 2024-09-11T22:18:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.150+0000 7f086372c640 1 -- 172.21.15.50:0/252236536 wait complete. 2024-09-11T22:18:24.161 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:18:24.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.263+0000 7f142add6640 1 Processor -- start 2024-09-11T22:18:24.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.263+0000 7f142add6640 1 -- start start 2024-09-11T22:18:24.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f142add6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f142415b400 0x7f142406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:24.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f142add6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1424072e60 0x7f142406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:24.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f142add6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f142406df20 0x7f14240b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:24.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f142add6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f142415b7e0 con 0x7f142415b400 2024-09-11T22:18:24.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f142add6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f142415f140 con 0x7f1424072e60 2024-09-11T22:18:24.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f142add6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f142415f420 con 0x7f142406df20 2024-09-11T22:18:24.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f1428b72640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f142415b400 0x7f142406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:24.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f1428b72640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f142415b400 0x7f142406d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56374/0 (socket says 172.21.15.50:56374) 2024-09-11T22:18:24.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f1428b72640 1 -- 172.21.15.50:0/810506223 learned_addr learned my addr 172.21.15.50:0/810506223 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:24.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f1428b72640 1 -- 172.21.15.50:0/810506223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f142406df20 msgr2=0x7f14240b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:24.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f1428b72640 1 --2- 172.21.15.50:0/810506223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f142406df20 0x7f14240b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f1428b72640 1 -- 172.21.15.50:0/810506223 >> v2:172.21.15.77:3300/0 conn(0x7f1424072e60 msgr2=0x7f142406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:24.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f1428b72640 1 --2- 172.21.15.50:0/810506223 >> v2:172.21.15.77:3300/0 conn(0x7f1424072e60 0x7f142406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.264+0000 7f1428b72640 1 -- 172.21.15.50:0/810506223 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142415f700 con 0x7f142415b400 2024-09-11T22:18:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.265+0000 7f1428b72640 1 --2- 172.21.15.50:0/810506223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142415b400 0x7f142406d070 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f14240b56b0 tx=0x7f141c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e529c8811fb1b57d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.265+0000 7f14237fe640 1 -- 172.21.15.50:0/810506223 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c036070 con 0x7f142415b400 2024-09-11T22:18:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.265+0000 7f14237fe640 1 -- 172.21.15.50:0/810506223 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141c031600 con 0x7f142415b400 2024-09-11T22:18:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.265+0000 7f14237fe640 1 -- 172.21.15.50:0/810506223 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c0319d0 con 0x7f142415b400 2024-09-11T22:18:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.266+0000 7f142add6640 1 -- 172.21.15.50:0/810506223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142415b400 msgr2=0x7f142406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.266+0000 7f142add6640 1 --2- 172.21.15.50:0/810506223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142415b400 0x7f142406d070 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f14240b56b0 tx=0x7f141c02a6a0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.266+0000 7f142add6640 1 -- 172.21.15.50:0/810506223 shutdown_connections 2024-09-11T22:18:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.266+0000 7f142add6640 1 --2- 172.21.15.50:0/810506223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f142406df20 0x7f14240b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.266+0000 7f142add6640 1 --2- 172.21.15.50:0/810506223 >> v2:172.21.15.77:3300/0 conn(0x7f1424072e60 0x7f142406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.266+0000 7f142add6640 1 --2- 172.21.15.50:0/810506223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142415b400 0x7f142406d070 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.266+0000 7f142add6640 1 -- 172.21.15.50:0/810506223 >> 172.21.15.50:0/810506223 conn(0x7f14240679c0 msgr2=0x7f1424067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.266+0000 7f142add6640 1 -- 172.21.15.50:0/810506223 shutdown_connections 2024-09-11T22:18:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.266+0000 7f142add6640 1 -- 172.21.15.50:0/810506223 wait complete. 2024-09-11T22:18:24.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.267+0000 7f142add6640 1 Processor -- start 2024-09-11T22:18:24.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.267+0000 7f142add6640 1 -- start start 2024-09-11T22:18:24.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.268+0000 7f142add6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f142406df20 0x7f14240cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:24.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.268+0000 7f142add6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1424072e60 0x7f14240aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:24.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.268+0000 7f142add6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142415b400 0x7f14241f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:24.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.268+0000 7f142add6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f14240b4b50 con 0x7f142415b400 2024-09-11T22:18:24.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.268+0000 7f142add6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f14240cfc50 con 0x7f142406df20 2024-09-11T22:18:24.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.268+0000 7f142add6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f14240b4cd0 con 0x7f1424072e60 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.268+0000 7f1429373640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142415b400 0x7f14241f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.268+0000 7f1429373640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142415b400 0x7f14241f4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56378/0 (socket says 172.21.15.50:56378) 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.268+0000 7f1429373640 1 -- 172.21.15.50:0/509732130 learned_addr learned my addr 172.21.15.50:0/509732130 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.268+0000 7f1428b72640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f142406df20 0x7f14240cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.268+0000 7f1423fff640 1 --2- 172.21.15.50:0/509732130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1424072e60 0x7f14240aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.269+0000 7f1429373640 1 -- 172.21.15.50:0/509732130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1424072e60 msgr2=0x7f14240aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.269+0000 7f1429373640 1 --2- 172.21.15.50:0/509732130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1424072e60 0x7f14240aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.269+0000 7f1429373640 1 -- 172.21.15.50:0/509732130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f142406df20 msgr2=0x7f14240cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.269+0000 7f1429373640 1 --2- 172.21.15.50:0/509732130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f142406df20 0x7f14240cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.269+0000 7f1429373640 1 -- 172.21.15.50:0/509732130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14240ce220 con 0x7f142415b400 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.269+0000 7f1429373640 1 --2- 172.21.15.50:0/509732130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142415b400 0x7f14241f4760 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f1414009fd0 tx=0x7f141400b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.269+0000 7f14217fa640 1 -- 172.21.15.50:0/509732130 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414015020 con 0x7f142415b400 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.269+0000 7f14217fa640 1 -- 172.21.15.50:0/509732130 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1414011830 con 0x7f142415b400 2024-09-11T22:18:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.269+0000 7f142add6640 1 -- 172.21.15.50:0/509732130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14241f5270 con 0x7f142415b400 2024-09-11T22:18:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.269+0000 7f14217fa640 1 -- 172.21.15.50:0/509732130 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414011c00 con 0x7f142415b400 2024-09-11T22:18:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.269+0000 7f142add6640 1 -- 172.21.15.50:0/509732130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14240ce4e0 con 0x7f142415b400 2024-09-11T22:18:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.270+0000 7f142add6640 1 -- 172.21.15.50:0/509732130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14240b4610 con 0x7f142415b400 2024-09-11T22:18:24.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.270+0000 7f14217fa640 1 -- 172.21.15.50:0/509732130 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1414018020 con 0x7f142415b400 2024-09-11T22:18:24.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.271+0000 7f14217fa640 1 --2- 172.21.15.50:0/509732130 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f141006be30 0x7f141006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:24.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.271+0000 7f14217fa640 1 -- 172.21.15.50:0/509732130 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f141408ac20 con 0x7f142415b400 2024-09-11T22:18:24.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.271+0000 7f1428b72640 1 --2- 172.21.15.50:0/509732130 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f141006be30 0x7f141006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:24.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.272+0000 7f1428b72640 1 --2- 172.21.15.50:0/509732130 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f141006be30 0x7f141006e2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f141c033000 tx=0x7f141c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:24.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.275+0000 7f14217fa640 1 -- 172.21.15.50:0/509732130 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f141401f020 con 0x7f142415b400 2024-09-11T22:18:24.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.488+0000 7f142add6640 1 -- 172.21.15.50:0/509732130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14240b2aa0 con 0x7f142415b400 2024-09-11T22:18:24.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.489+0000 7f14217fa640 1 -- 172.21.15.50:0/509732130 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5225 (secure 0 0 0) 0x7f1414059660 con 0x7f142415b400 2024-09-11T22:18:24.490 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:24.490 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"btime":"2024-09-11T22:18:18:030997+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1864699161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1864699161},{"type":"v1","addr":"172.21.15.77:6835","nonce":1864699161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3677751855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3677751855},{"type":"v1","addr":"172.21.15.50:6834","nonce":3677751855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7315,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2276588552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2276588552},{"type":"v1","addr":"172.21.15.50:6835","nonce":2276588552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:18:14.748913+0000","modified":"2024-09-11T22:18:17.383059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7324":{"gid":7324,"name":"d","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1480049118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1480049118},{"type":"v1","addr":"172.21.15.77:6837","nonce":1480049118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7324,"qdb_cluster":[7324]},"id":8}]} 2024-09-11T22:18:24.490 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2024-09-11T22:18:24.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.491+0000 7f142add6640 1 -- 172.21.15.50:0/509732130 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f141006be30 msgr2=0x7f141006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:24.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.491+0000 7f142add6640 1 --2- 172.21.15.50:0/509732130 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f141006be30 0x7f141006e2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f141c033000 tx=0x7f141c009000 comp rx=0 tx=0).stop 2024-09-11T22:18:24.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.491+0000 7f142add6640 1 -- 172.21.15.50:0/509732130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142415b400 msgr2=0x7f14241f4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:24.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.491+0000 7f142add6640 1 --2- 172.21.15.50:0/509732130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142415b400 0x7f14241f4760 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f1414009fd0 tx=0x7f141400b820 comp rx=0 tx=0).stop 2024-09-11T22:18:24.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.491+0000 7f142add6640 1 -- 172.21.15.50:0/509732130 shutdown_connections 2024-09-11T22:18:24.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.491+0000 7f142add6640 1 --2- 172.21.15.50:0/509732130 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f141006be30 0x7f141006e2f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.491+0000 7f142add6640 1 --2- 172.21.15.50:0/509732130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1424072e60 0x7f14240aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.491+0000 7f142add6640 1 --2- 172.21.15.50:0/509732130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142415b400 0x7f14241f4760 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.491+0000 7f142add6640 1 --2- 172.21.15.50:0/509732130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f142406df20 0x7f14240cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:24.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.491+0000 7f142add6640 1 -- 172.21.15.50:0/509732130 >> 172.21.15.50:0/509732130 conn(0x7f14240679c0 msgr2=0x7f142406e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:24.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.491+0000 7f142add6640 1 -- 172.21.15.50:0/509732130 shutdown_connections 2024-09-11T22:18:24.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:24.491+0000 7f142add6640 1 -- 172.21.15.50:0/509732130 wait complete. 2024-09-11T22:18:24.906 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 85, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:18:14.748913+0000', 'modified': '2024-09-11T22:18:17.383059+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7324}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7324': {'gid': 7324, 'name': 'd', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6837/1480049118', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6836', 'nonce': 1480049118}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 1480049118}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7324, 'qdb_cluster': [7324]} 2024-09-11T22:18:24.906 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:18:24.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-11T22:18:25.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.017+0000 7f073a8fa640 1 Processor -- start 2024-09-11T22:18:25.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.017+0000 7f073a8fa640 1 -- start start 2024-09-11T22:18:25.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.018+0000 7f073a8fa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f07340b3e10 0x7f07340b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.018+0000 7f073a8fa640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07340b4f00 con 0x7f07340d05e0 2024-09-11T22:18:25.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.018+0000 7f073a8fa640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07340b4360 con 0x7f073415c2c0 2024-09-11T22:18:25.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.018+0000 7f073a8fa640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f07340b51c0 con 0x7f07340b3e10 2024-09-11T22:18:25.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.018+0000 7f07337fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f07340d05e0 0x7f07340ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46344/0 (socket says 172.21.15.50:46344) 2024-09-11T22:18:25.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.018+0000 7f07337fe640 1 -- 172.21.15.50:0/1359219157 learned_addr learned my addr 172.21.15.50:0/1359219157 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.018+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966378532 0 0) 0x7f07340b4f00 con 0x7f07340d05e0 2024-09-11T22:18:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.018+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f071c003520 con 0x7f07340d05e0 2024-09-11T22:18:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.018+0000 7f0738e97640 1 --2- 172.21.15.50:0/1359219157 >> v2:172.21.15.77:3300/0 conn(0x7f07340b3e10 0x7f07340b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 407159202 0 0) 0x7f071c003520 con 0x7f07340d05e0 2024-09-11T22:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 >> v2:172.21.15.77:3300/0 conn(0x7f07340b3e10 msgr2=0x7f07340b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0732ffd640 1 --2- 172.21.15.50:0/1359219157 >> v2:172.21.15.77:3300/0 conn(0x7f07340b3e10 0x7f07340b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 >> v1:172.21.15.77:6789/0 conn(0x7f073415c2c0 legacy=0x7f07340cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07340b54a0 con 0x7f07340d05e0 2024-09-11T22:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f0728001670 con 0x7f07340d05e0 2024-09-11T22:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 >> v1:172.21.15.50:6789/0 conn(0x7f07340d05e0 legacy=0x7f07340ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0732ffd640 1 --2- 172.21.15.50:0/1359219157 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f071c0039b0 0x7f071c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0732ffd640 1 --2- 172.21.15.50:0/1359219157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f071c004800 0x7f071c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0732ffd640 1 --2- 172.21.15.50:0/1359219157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f071c0051c0 0x7f071c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07340b51c0 con 0x7f071c004800 2024-09-11T22:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f071c00c060 con 0x7f071c0051c0 2024-09-11T22:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f071c00c260 con 0x7f071c0039b0 2024-09-11T22:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f07337fe640 1 --2- 172.21.15.50:0/1359219157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f071c004800 0x7f071c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0733fff640 1 --2- 172.21.15.50:0/1359219157 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f071c0039b0 0x7f071c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0738e97640 1 --2- 172.21.15.50:0/1359219157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f071c0051c0 0x7f071c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f07337fe640 1 -- 172.21.15.50:0/1359219157 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f071c0039b0 msgr2=0x7f071c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f07337fe640 1 --2- 172.21.15.50:0/1359219157 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f071c0039b0 0x7f071c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f07337fe640 1 -- 172.21.15.50:0/1359219157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f071c0051c0 msgr2=0x7f071c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f07337fe640 1 --2- 172.21.15.50:0/1359219157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f071c0051c0 0x7f071c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f07337fe640 1 -- 172.21.15.50:0/1359219157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071c003520 con 0x7f071c004800 2024-09-11T22:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.019+0000 7f0738e97640 1 -- 172.21.15.50:0/1359219157 reap_dead start 2024-09-11T22:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.020+0000 7f07337fe640 1 --2- 172.21.15.50:0/1359219157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f071c004800 0x7f071c004c80 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f072800c240 tx=0x7f071c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91d9de2aa5d97b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.020+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728007cf0 con 0x7f071c004800 2024-09-11T22:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.020+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0728005af0 con 0x7f071c004800 2024-09-11T22:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.020+0000 7f0732ffd640 1 -- 172.21.15.50:0/1359219157 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728007070 con 0x7f071c004800 2024-09-11T22:18:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.021+0000 7f073a8fa640 1 -- 172.21.15.50:0/1359219157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f071c004800 msgr2=0x7f071c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.021+0000 7f073a8fa640 1 --2- 172.21.15.50:0/1359219157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f071c004800 0x7f071c004c80 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f072800c240 tx=0x7f071c005830 comp rx=0 tx=0).stop 2024-09-11T22:18:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.021+0000 7f073a8fa640 1 -- 172.21.15.50:0/1359219157 shutdown_connections 2024-09-11T22:18:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.021+0000 7f073a8fa640 1 --2- 172.21.15.50:0/1359219157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f071c004800 0x7f071c004c80 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.021+0000 7f073a8fa640 1 -- 172.21.15.50:0/1359219157 >> 172.21.15.50:0/1359219157 conn(0x7f07340679c0 msgr2=0x7f0734067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.021+0000 7f073a8fa640 1 -- 172.21.15.50:0/1359219157 shutdown_connections 2024-09-11T22:18:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.021+0000 7f073a8fa640 1 -- 172.21.15.50:0/1359219157 wait complete. 2024-09-11T22:18:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.022+0000 7f073a8fa640 1 Processor -- start 2024-09-11T22:18:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.022+0000 7f073a8fa640 1 -- start start 2024-09-11T22:18:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f073a8fa640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f071c004800 0x7f073414cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f073a8fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073414adc0 0x7f073415e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f073a8fa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f073406de30 0x7f073406e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f073a8fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f073406d070 con 0x7f073414adc0 2024-09-11T22:18:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f073a8fa640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f07340ce200 con 0x7f073406de30 2024-09-11T22:18:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f073a8fa640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f073406d1f0 con 0x7f071c004800 2024-09-11T22:18:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f07337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073414adc0 0x7f073415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f07337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073414adc0 0x7f073415e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56390/0 (socket says 172.21.15.50:56390) 2024-09-11T22:18:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f07337fe640 1 -- 172.21.15.50:0/530542357 learned_addr learned my addr 172.21.15.50:0/530542357 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f0738e97640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f073406de30 0x7f073406e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f0733fff640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f071c004800 0x7f073414cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f07337fe640 1 -- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f071c004800 msgr2=0x7f073414cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f07337fe640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f071c004800 0x7f073414cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f07337fe640 1 -- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f073406de30 msgr2=0x7f073406e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f07337fe640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f073406de30 0x7f073406e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f07337fe640 1 -- 172.21.15.50:0/530542357 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073414d4d0 con 0x7f073414adc0 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f0733fff640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f071c004800 0x7f073414cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.023+0000 7f07337fe640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073414adc0 0x7f073415e540 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f072800c360 tx=0x7f07340b5670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.024+0000 7f0730ff9640 1 -- 172.21.15.50:0/530542357 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728040030 con 0x7f073414adc0 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.024+0000 7f0730ff9640 1 -- 172.21.15.50:0/530542357 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0728000ed0 con 0x7f073414adc0 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.024+0000 7f0730ff9640 1 -- 172.21.15.50:0/530542357 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728037040 con 0x7f073414adc0 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.024+0000 7f073a8fa640 1 -- 172.21.15.50:0/530542357 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f073414d7b0 con 0x7f073414adc0 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.024+0000 7f073a8fa640 1 -- 172.21.15.50:0/530542357 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f073414dd70 con 0x7f073414adc0 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.026+0000 7f0730ff9640 1 -- 172.21.15.50:0/530542357 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0728043070 con 0x7f073414adc0 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.026+0000 7f0730ff9640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f072006be60 0x7f072006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.026+0000 7f0730ff9640 1 -- 172.21.15.50:0/530542357 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f07280aa7f0 con 0x7f073414adc0 2024-09-11T22:18:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.026+0000 7f0733fff640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f072006be60 0x7f072006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.027+0000 7f0733fff640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f072006be60 0x7f072006e320 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0724000c00 tx=0x7f0724009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.027+0000 7f073d694740 1 Processor -- start 2024-09-11T22:18:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.027+0000 7f073d694740 1 -- start start 2024-09-11T22:18:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f073d694740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b7b120 0x5654a8b7b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f073d694740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b95ae0 0x5654a8b97290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f073d694740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b4ea80 0x5654a8b977d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f073d694740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5654a8ab3520 con 0x5654a8b95ae0 2024-09-11T22:18:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f073d694740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5654a8a5b3e0 con 0x5654a8b7b120 2024-09-11T22:18:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f073d694740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5654a8aaf4e0 con 0x5654a8b4ea80 2024-09-11T22:18:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f07337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b95ae0 0x5654a8b97290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f07337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b95ae0 0x5654a8b97290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56400/0 (socket says 172.21.15.50:56400) 2024-09-11T22:18:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f07337fe640 1 -- 172.21.15.50:0/3732410019 learned_addr learned my addr 172.21.15.50:0/3732410019 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f0738e97640 1 --2- 172.21.15.50:0/3732410019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b4ea80 0x5654a8b977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f0733fff640 1 --2- 172.21.15.50:0/3732410019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b7b120 0x5654a8b7b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f07337fe640 1 -- 172.21.15.50:0/3732410019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b4ea80 msgr2=0x5654a8b977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f07337fe640 1 --2- 172.21.15.50:0/3732410019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b4ea80 0x5654a8b977d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f07337fe640 1 -- 172.21.15.50:0/3732410019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b7b120 msgr2=0x5654a8b7b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f07337fe640 1 --2- 172.21.15.50:0/3732410019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b7b120 0x5654a8b7b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f07337fe640 1 -- 172.21.15.50:0/3732410019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654a8a762f0 con 0x5654a8b95ae0 2024-09-11T22:18:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f0733fff640 1 --2- 172.21.15.50:0/3732410019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b7b120 0x5654a8b7b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.028+0000 7f07337fe640 1 --2- 172.21.15.50:0/3732410019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b95ae0 0x5654a8b97290 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f07280a8d20 tx=0x7f0728078540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc2551dc1bc5a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.029+0000 7f0719ffb640 1 -- 172.21.15.50:0/3732410019 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728081690 con 0x5654a8b95ae0 2024-09-11T22:18:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.029+0000 7f0719ffb640 1 -- 172.21.15.50:0/3732410019 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0728076b50 con 0x5654a8b95ae0 2024-09-11T22:18:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.029+0000 7f0719ffb640 1 -- 172.21.15.50:0/3732410019 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728075120 con 0x5654a8b95ae0 2024-09-11T22:18:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.029+0000 7f073d694740 1 -- 172.21.15.50:0/3732410019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b95ae0 msgr2=0x5654a8b97290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.029+0000 7f073d694740 1 --2- 172.21.15.50:0/3732410019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b95ae0 0x5654a8b97290 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f07280a8d20 tx=0x7f0728078540 comp rx=0 tx=0).stop 2024-09-11T22:18:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.029+0000 7f073d694740 1 -- 172.21.15.50:0/3732410019 shutdown_connections 2024-09-11T22:18:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.029+0000 7f073d694740 1 --2- 172.21.15.50:0/3732410019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b4ea80 0x5654a8b977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.029+0000 7f073d694740 1 --2- 172.21.15.50:0/3732410019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b95ae0 0x5654a8b97290 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.029+0000 7f073d694740 1 --2- 172.21.15.50:0/3732410019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b7b120 0x5654a8b7b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.029+0000 7f073d694740 1 -- 172.21.15.50:0/3732410019 >> 172.21.15.50:0/3732410019 conn(0x5654a8b4da80 msgr2=0x5654a8b95f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.029+0000 7f073d694740 1 -- 172.21.15.50:0/3732410019 shutdown_connections 2024-09-11T22:18:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.029+0000 7f073d694740 1 -- 172.21.15.50:0/3732410019 wait complete. 2024-09-11T22:18:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.030+0000 7f073d694740 1 -- start start 2024-09-11T22:18:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.030+0000 7f073d694740 1 Processor -- start 2024-09-11T22:18:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f073d694740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 0x5654a8b77710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f073d694740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b95ae0 0x5654a8b7a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f073d694740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b7a890 0x5654a8b4b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f073d694740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5654a8aaf4e0 con 0x5654a8b7b120 2024-09-11T22:18:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f073d694740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5654a8a3c450 con 0x5654a8b95ae0 2024-09-11T22:18:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f073d694740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5654a8ab3520 con 0x5654a8b7a890 2024-09-11T22:18:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f073d694740 10 client.0 _ll_register_callbacks cb 0x5654a87c5ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f0733fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 0x5654a8b77710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f0733fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 0x5654a8b77710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56404/0 (socket says 172.21.15.50:56404) 2024-09-11T22:18:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f0733fff640 1 -- 172.21.15.50:0/938092061 learned_addr learned my addr 172.21.15.50:0/938092061 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f07337fe640 1 --2- 172.21.15.50:0/938092061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b95ae0 0x5654a8b7a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f0738e97640 1 --2- 172.21.15.50:0/938092061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b7a890 0x5654a8b4b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f0733fff640 1 -- 172.21.15.50:0/938092061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b7a890 msgr2=0x5654a8b4b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f0733fff640 1 --2- 172.21.15.50:0/938092061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b7a890 0x5654a8b4b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f0733fff640 1 -- 172.21.15.50:0/938092061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b95ae0 msgr2=0x5654a8b7a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f0733fff640 1 --2- 172.21.15.50:0/938092061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b95ae0 0x5654a8b7a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.031+0000 7f0733fff640 1 -- 172.21.15.50:0/938092061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654a87c62d0 con 0x5654a8b7b120 2024-09-11T22:18:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f0733fff640 1 --2- 172.21.15.50:0/938092061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 0x5654a8b77710 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f0724015520 tx=0x7f0724001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8cbb8330a5ef2e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f0712ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f0712ffd640 1 -- 172.21.15.50:0/938092061 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724028060 con 0x5654a8b7b120 2024-09-11T22:18:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f0712ffd640 1 -- 172.21.15.50:0/938092061 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f0724023aa0 con 0x5654a8b7b120 2024-09-11T22:18:25.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f073d694740 1 -- 172.21.15.50:0/938092061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0728076b50 con 0x5654a8b7b120 2024-09-11T22:18:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f0712ffd640 1 -- 172.21.15.50:0/938092061 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f072401b070 con 0x5654a8b7b120 2024-09-11T22:18:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f073d694740 10 client.8136 fetch_fsmap learned FSMap version 85 2024-09-11T22:18:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f073d694740 1 -- 172.21.15.50:0/938092061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x5654a88906b0 con 0x5654a8b7b120 2024-09-11T22:18:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f0712ffd640 1 -- 172.21.15.50:0/938092061 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0728076b50 con 0x5654a8b7b120 2024-09-11T22:18:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f0712ffd640 1 -- 172.21.15.50:0/938092061 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f0724021070 con 0x5654a8b7b120 2024-09-11T22:18:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f073d694740 10 client.8136 fetch_fsmap finished waiting for FSMap version 85 2024-09-11T22:18:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f073d694740 10 client.8136 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-11T22:18:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f073d694740 20 client.8136 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f073d694740 1 --2- 172.21.15.50:0/938092061 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x5654a8b90710 0x5654a8b90af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f073d694740 4 client.8136 mds_command: new command op to 7324 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.032+0000 7f073d694740 1 -- 172.21.15.50:0/938092061 --> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654a8ac0c50 con 0x5654a8b90710 2024-09-11T22:18:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.033+0000 7f07337fe640 1 --2- 172.21.15.50:0/938092061 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x5654a8b90710 0x5654a8b90af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.033+0000 7f07337fe640 1 --2- 172.21.15.50:0/938092061 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x5654a8b90710 0x5654a8b90af0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75f3b46dcdc7f17 server_cookie=dfab4a4b4e8b923e in_seq=0 out_seq=0 2024-09-11T22:18:25.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.033+0000 7f0712ffd640 10 client.8136 ms_handle_connect on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f0712ffd640 1 -- 172.21.15.50:0/938092061 <== mds.0 v2:172.21.15.77:6836/1480049118 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654a8ac0c50 con 0x5654a8b90710 2024-09-11T22:18:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f0712ffd640 10 client.8136 handle_command_reply: tid=0 2024-09-11T22:18:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f073d694740 1 client.8136 shutdown 2024-09-11T22:18:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f073d694740 1 -- 172.21.15.50:0/938092061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 msgr2=0x5654a8b77710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f073d694740 1 --2- 172.21.15.50:0/938092061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 0x5654a8b77710 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f0724015520 tx=0x7f0724001120 comp rx=0 tx=0).stop 2024-09-11T22:18:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f073d694740 1 -- 172.21.15.50:0/938092061 shutdown_connections 2024-09-11T22:18:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f073d694740 1 --2- 172.21.15.50:0/938092061 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x5654a8b90710 0x5654a8b90af0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f073d694740 1 --2- 172.21.15.50:0/938092061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b7a890 0x5654a8b4b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f073d694740 1 --2- 172.21.15.50:0/938092061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b95ae0 0x5654a8b7a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f0712ffd640 0 client.8136 ms_handle_reset on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f073d694740 1 --2- 172.21.15.50:0/938092061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 0x5654a8b77710 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f073d694740 1 -- 172.21.15.50:0/938092061 >> 172.21.15.50:0/938092061 conn(0x5654a8b4ea80 msgr2=0x5654a8b4a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f073d694740 1 -- 172.21.15.50:0/938092061 shutdown_connections 2024-09-11T22:18:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f073d694740 1 -- 172.21.15.50:0/938092061 wait complete. 2024-09-11T22:18:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.034+0000 7f073d694740 20 client.8136 trim_cache size 0 max 16384 2024-09-11T22:18:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.052+0000 7f073d694740 1 Processor -- start 2024-09-11T22:18:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.052+0000 7f073d694740 1 -- start start 2024-09-11T22:18:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.053+0000 7f073d694740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b7a890 0x5654a8b75250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.053+0000 7f073d694740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 0x5654a8b90ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.053+0000 7f073d694740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b95ae0 0x5654a8bbde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.053+0000 7f073d694740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0734072ee0 con 0x5654a8b7b120 2024-09-11T22:18:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.053+0000 7f073d694740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0734072240 con 0x5654a8b95ae0 2024-09-11T22:18:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.053+0000 7f073d694740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0734072890 con 0x5654a8b7a890 2024-09-11T22:18:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.053+0000 7f07337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 0x5654a8b90ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.053+0000 7f07337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 0x5654a8b90ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56416/0 (socket says 172.21.15.50:56416) 2024-09-11T22:18:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.053+0000 7f07337fe640 1 -- 172.21.15.50:0/1050757573 learned_addr learned my addr 172.21.15.50:0/1050757573 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.053+0000 7f0738e97640 1 --2- 172.21.15.50:0/1050757573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b95ae0 0x5654a8bbde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.053+0000 7f0733fff640 1 --2- 172.21.15.50:0/1050757573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b7a890 0x5654a8b75250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.054+0000 7f07337fe640 1 -- 172.21.15.50:0/1050757573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b7a890 msgr2=0x5654a8b75250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.054+0000 7f07337fe640 1 --2- 172.21.15.50:0/1050757573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b7a890 0x5654a8b75250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.054+0000 7f07337fe640 1 -- 172.21.15.50:0/1050757573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b95ae0 msgr2=0x5654a8bbde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.054+0000 7f07337fe640 1 --2- 172.21.15.50:0/1050757573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b95ae0 0x5654a8bbde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.054+0000 7f07337fe640 1 -- 172.21.15.50:0/1050757573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654a8b4cd00 con 0x5654a8b7b120 2024-09-11T22:18:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.054+0000 7f0738e97640 1 --2- 172.21.15.50:0/1050757573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b95ae0 0x5654a8bbde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.054+0000 7f07337fe640 1 --2- 172.21.15.50:0/1050757573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 0x5654a8b90ce0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f0728001970 tx=0x7f072808e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427ff7fab4e5f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.054+0000 7f07197fa640 1 -- 172.21.15.50:0/1050757573 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728001670 con 0x5654a8b7b120 2024-09-11T22:18:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.054+0000 7f07197fa640 1 -- 172.21.15.50:0/1050757573 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0728075120 con 0x5654a8b7b120 2024-09-11T22:18:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.054+0000 7f07197fa640 1 -- 172.21.15.50:0/1050757573 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07280964c0 con 0x5654a8b7b120 2024-09-11T22:18:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.054+0000 7f073d694740 1 -- 172.21.15.50:0/1050757573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 msgr2=0x5654a8b90ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.054+0000 7f073d694740 1 --2- 172.21.15.50:0/1050757573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 0x5654a8b90ce0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f0728001970 tx=0x7f072808e000 comp rx=0 tx=0).stop 2024-09-11T22:18:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.055+0000 7f073d694740 1 -- 172.21.15.50:0/1050757573 shutdown_connections 2024-09-11T22:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.055+0000 7f073d694740 1 --2- 172.21.15.50:0/1050757573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b95ae0 0x5654a8bbde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.055+0000 7f073d694740 1 --2- 172.21.15.50:0/1050757573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7b120 0x5654a8b90ce0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.055+0000 7f073d694740 1 --2- 172.21.15.50:0/1050757573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b7a890 0x5654a8b75250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.055+0000 7f073d694740 1 -- 172.21.15.50:0/1050757573 >> 172.21.15.50:0/1050757573 conn(0x5654a8b4ea80 msgr2=0x5654a8b91820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.055+0000 7f073d694740 1 -- 172.21.15.50:0/1050757573 shutdown_connections 2024-09-11T22:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.055+0000 7f073d694740 1 -- 172.21.15.50:0/1050757573 wait complete. 2024-09-11T22:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.055+0000 7f073d694740 1 -- start start 2024-09-11T22:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.055+0000 7f073d694740 1 Processor -- start 2024-09-11T22:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f073d694740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7a890 0x5654a8b94bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f073d694740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b7b120 0x5654a8bbe420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f073d694740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b95ae0 0x5654a8b98e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f073d694740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5654a8b79800 con 0x5654a8b7a890 2024-09-11T22:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f073d694740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5654a8a5b3e0 con 0x5654a8b7b120 2024-09-11T22:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f073d694740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5654a8b921d0 con 0x5654a8b95ae0 2024-09-11T22:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f073d694740 10 client.0 _ll_register_callbacks cb 0x7f07240052d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f0733fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7a890 0x5654a8b94bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f0733fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7a890 0x5654a8b94bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56424/0 (socket says 172.21.15.50:56424) 2024-09-11T22:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f0733fff640 1 -- 172.21.15.50:0/2761242484 learned_addr learned my addr 172.21.15.50:0/2761242484 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f0738e97640 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b95ae0 0x5654a8b98e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f07337fe640 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b7b120 0x5654a8bbe420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f0733fff640 1 -- 172.21.15.50:0/2761242484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b95ae0 msgr2=0x5654a8b98e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f0733fff640 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b95ae0 0x5654a8b98e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f0733fff640 1 -- 172.21.15.50:0/2761242484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b7b120 msgr2=0x5654a8bbe420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f0733fff640 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b7b120 0x5654a8bbe420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f0733fff640 1 -- 172.21.15.50:0/2761242484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654a8bb3990 con 0x5654a8b7a890 2024-09-11T22:18:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.056+0000 7f07337fe640 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b7b120 0x5654a8bbe420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f0733fff640 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7a890 0x5654a8b94bd0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f07240011d0 tx=0x7f0724015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b23cc958a41d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f0712ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f0712ffd640 1 -- 172.21.15.50:0/2761242484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072403c070 con 0x5654a8b7a890 2024-09-11T22:18:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f0712ffd640 1 -- 172.21.15.50:0/2761242484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f0724007020 con 0x5654a8b7a890 2024-09-11T22:18:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f073d694740 1 -- 172.21.15.50:0/2761242484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0728075120 con 0x5654a8b7a890 2024-09-11T22:18:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f0712ffd640 1 -- 172.21.15.50:0/2761242484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f0724046050 con 0x5654a8b7a890 2024-09-11T22:18:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f073d694740 10 client.8142 fetch_fsmap learned FSMap version 85 2024-09-11T22:18:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f073d694740 1 -- 172.21.15.50:0/2761242484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x5654a8bb4290 con 0x5654a8b7a890 2024-09-11T22:18:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f0712ffd640 1 -- 172.21.15.50:0/2761242484 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0728075120 con 0x5654a8b7a890 2024-09-11T22:18:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f0712ffd640 1 -- 172.21.15.50:0/2761242484 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f0724049020 con 0x5654a8b7a890 2024-09-11T22:18:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f073d694740 10 client.8142 fetch_fsmap finished waiting for FSMap version 85 2024-09-11T22:18:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f073d694740 10 client.8142 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-11T22:18:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f073d694740 20 client.8142 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f073d694740 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x5654a8c18d60 0x5654a8c14d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f073d694740 4 client.8142 mds_command: new command op to 7324 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:18:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f073d694740 1 -- 172.21.15.50:0/2761242484 --> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] -- command(tid 0: {"prefix": "status"}) -- 0x5654a8b8d840 con 0x5654a8c18d60 2024-09-11T22:18:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.057+0000 7f07337fe640 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x5654a8c18d60 0x5654a8c14d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f07337fe640 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x5654a8c18d60 0x5654a8c14d30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d3589e9b70dafca server_cookie=a6ad00e2b578e121 in_seq=0 out_seq=0 2024-09-11T22:18:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f0712ffd640 10 client.8142 ms_handle_connect on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f0712ffd640 1 -- 172.21.15.50:0/2761242484 <== mds.0 v2:172.21.15.77:6836/1480049118 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5654a8b8d840 con 0x5654a8c18d60 2024-09-11T22:18:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f0712ffd640 10 client.8142 handle_command_reply: tid=0 2024-09-11T22:18:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f073d694740 1 client.8142 shutdown 2024-09-11T22:18:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f073d694740 1 -- 172.21.15.50:0/2761242484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7a890 msgr2=0x5654a8b94bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f073d694740 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7a890 0x5654a8b94bd0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f07240011d0 tx=0x7f0724015000 comp rx=0 tx=0).stop 2024-09-11T22:18:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f073d694740 1 -- 172.21.15.50:0/2761242484 shutdown_connections 2024-09-11T22:18:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f073d694740 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x5654a8c18d60 0x5654a8c14d30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f073d694740 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654a8b95ae0 0x5654a8b98e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f073d694740 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654a8b7b120 0x5654a8bbe420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f0712ffd640 0 client.8142 ms_handle_reset on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f073d694740 1 --2- 172.21.15.50:0/2761242484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654a8b7a890 0x5654a8b94bd0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f073d694740 1 -- 172.21.15.50:0/2761242484 >> 172.21.15.50:0/2761242484 conn(0x5654a8b4ea80 msgr2=0x5654a8b46ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f073d694740 1 -- 172.21.15.50:0/2761242484 shutdown_connections 2024-09-11T22:18:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f073d694740 1 -- 172.21.15.50:0/2761242484 wait complete. 2024-09-11T22:18:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.058+0000 7f073d694740 20 client.8142 trim_cache size 0 max 16384 2024-09-11T22:18:25.065 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:18:25.066 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:18:25.066 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:18:25.066 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 7324, 2024-09-11T22:18:25.066 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:18:25.066 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:18:25.066 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:18:25.066 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 9.6781441109999999, 2024-09-11T22:18:25.066 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 85, 2024-09-11T22:18:25.066 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 120, 2024-09-11T22:18:25.066 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 120, 2024-09-11T22:18:25.066 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 14.687299982000001 2024-09-11T22:18:25.066 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:18:25.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.059+0000 7f073a8fa640 1 -- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f072006be60 msgr2=0x7f072006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.059+0000 7f073a8fa640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f072006be60 0x7f072006e320 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0724000c00 tx=0x7f0724009040 comp rx=0 tx=0).stop 2024-09-11T22:18:25.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.059+0000 7f073a8fa640 1 -- 172.21.15.50:0/530542357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073414adc0 msgr2=0x7f073415e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.059+0000 7f073a8fa640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073414adc0 0x7f073415e540 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f072800c360 tx=0x7f07340b5670 comp rx=0 tx=0).stop 2024-09-11T22:18:25.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.059+0000 7f073a8fa640 1 -- 172.21.15.50:0/530542357 shutdown_connections 2024-09-11T22:18:25.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.059+0000 7f073a8fa640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f072006be60 0x7f072006e320 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.059+0000 7f073a8fa640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f073406de30 0x7f073406e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.059+0000 7f073a8fa640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f073414adc0 0x7f073415e540 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.059+0000 7f073a8fa640 1 --2- 172.21.15.50:0/530542357 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f071c004800 0x7f073414cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.059+0000 7f073a8fa640 1 -- 172.21.15.50:0/530542357 >> 172.21.15.50:0/530542357 conn(0x7f07340679c0 msgr2=0x7f07340b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:25.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.059+0000 7f073a8fa640 1 -- 172.21.15.50:0/530542357 shutdown_connections 2024-09-11T22:18:25.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.059+0000 7f073a8fa640 1 -- 172.21.15.50:0/530542357 wait complete. 2024-09-11T22:18:25.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:18:25.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.172+0000 7efe75884640 1 Processor -- start 2024-09-11T22:18:25.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.172+0000 7efe75884640 1 -- start start 2024-09-11T22:18:25.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe75884640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efe70161fa0 0x7efe700b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe75884640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe700cf610 0x7efe700cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe75884640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe700cfbd0 con 0x7efe700b1600 2024-09-11T22:18:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe75884640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efe700d1220 con 0x7efe70161fa0 2024-09-11T22:18:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe75884640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efe700d17e0 con 0x7efe700cf610 2024-09-11T22:18:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe6e7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efe700b1600 0x7efe700cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46348/0 (socket says 172.21.15.50:46348) 2024-09-11T22:18:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe6e7fc640 1 -- 172.21.15.50:0/1088475477 learned_addr learned my addr 172.21.15.50:0/1088475477 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe6effd640 1 --2- 172.21.15.50:0/1088475477 >> v2:172.21.15.77:3300/0 conn(0x7efe70161fa0 0x7efe700b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe6f7fe640 1 --2- 172.21.15.50:0/1088475477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe700cf610 0x7efe700cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe6dffb640 1 -- 172.21.15.50:0/1088475477 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1299927921 0 0) 0x7efe700cfbd0 con 0x7efe700b1600 2024-09-11T22:18:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe6dffb640 1 -- 172.21.15.50:0/1088475477 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe5c003520 con 0x7efe700b1600 2024-09-11T22:18:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe6effd640 1 -- 172.21.15.50:0/1088475477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe700cf610 msgr2=0x7efe700cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe6effd640 1 --2- 172.21.15.50:0/1088475477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe700cf610 0x7efe700cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe6effd640 1 -- 172.21.15.50:0/1088475477 >> v1:172.21.15.50:6789/0 conn(0x7efe700b1600 legacy=0x7efe700cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.173+0000 7efe6effd640 1 -- 172.21.15.50:0/1088475477 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe700cfeb0 con 0x7efe70161fa0 2024-09-11T22:18:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.174+0000 7efe6effd640 1 --2- 172.21.15.50:0/1088475477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70161fa0 0x7efe700b4d20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efe680097a0 tx=0x7efe6802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e170a48bcee1daf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.174+0000 7efe6dffb640 1 -- 172.21.15.50:0/1088475477 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68037070 con 0x7efe70161fa0 2024-09-11T22:18:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.174+0000 7efe6dffb640 1 -- 172.21.15.50:0/1088475477 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe68032440 con 0x7efe70161fa0 2024-09-11T22:18:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.174+0000 7efe6dffb640 1 -- 172.21.15.50:0/1088475477 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe680327f0 con 0x7efe70161fa0 2024-09-11T22:18:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.175+0000 7efe75884640 1 -- 172.21.15.50:0/1088475477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70161fa0 msgr2=0x7efe700b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.175+0000 7efe75884640 1 --2- 172.21.15.50:0/1088475477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70161fa0 0x7efe700b4d20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efe680097a0 tx=0x7efe6802a180 comp rx=0 tx=0).stop 2024-09-11T22:18:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.175+0000 7efe75884640 1 -- 172.21.15.50:0/1088475477 shutdown_connections 2024-09-11T22:18:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.175+0000 7efe75884640 1 --2- 172.21.15.50:0/1088475477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe700cf610 0x7efe700cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.175+0000 7efe75884640 1 --2- 172.21.15.50:0/1088475477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70161fa0 0x7efe700b4d20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.175+0000 7efe75884640 1 -- 172.21.15.50:0/1088475477 >> 172.21.15.50:0/1088475477 conn(0x7efe7009ba50 msgr2=0x7efe700b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:25.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.175+0000 7efe75884640 1 -- 172.21.15.50:0/1088475477 shutdown_connections 2024-09-11T22:18:25.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.175+0000 7efe75884640 1 -- 172.21.15.50:0/1088475477 wait complete. 2024-09-11T22:18:25.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.176+0000 7efe75884640 1 Processor -- start 2024-09-11T22:18:25.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.176+0000 7efe75884640 1 -- start start 2024-09-11T22:18:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.177+0000 7efe75884640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe700b1600 0x7efe700b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.177+0000 7efe75884640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe700cf610 0x7efe7015fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.177+0000 7efe75884640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe70161fa0 0x7efe700b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.177+0000 7efe75884640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efe70162500 con 0x7efe70161fa0 2024-09-11T22:18:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.177+0000 7efe75884640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efe70162380 con 0x7efe700b1600 2024-09-11T22:18:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.177+0000 7efe75884640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efe700d1c70 con 0x7efe700cf610 2024-09-11T22:18:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.177+0000 7efe6f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe70161fa0 0x7efe700b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.177+0000 7efe6f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe70161fa0 0x7efe700b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56436/0 (socket says 172.21.15.50:56436) 2024-09-11T22:18:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.177+0000 7efe6f7fe640 1 -- 172.21.15.50:0/1502228338 learned_addr learned my addr 172.21.15.50:0/1502228338 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.177+0000 7efe6effd640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe700b1600 0x7efe700b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.177+0000 7efe6e7fc640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe700cf610 0x7efe7015fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.178+0000 7efe6f7fe640 1 -- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe700cf610 msgr2=0x7efe7015fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.178+0000 7efe6f7fe640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe700cf610 0x7efe7015fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.178+0000 7efe6f7fe640 1 -- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe700b1600 msgr2=0x7efe700b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.178+0000 7efe6f7fe640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe700b1600 0x7efe700b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.178+0000 7efe6f7fe640 1 -- 172.21.15.50:0/1502228338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe700b2fc0 con 0x7efe70161fa0 2024-09-11T22:18:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.178+0000 7efe6f7fe640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe70161fa0 0x7efe700b33f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7efe6000efc0 tx=0x7efe6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.178+0000 7efe67fff640 1 -- 172.21.15.50:0/1502228338 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60018020 con 0x7efe70161fa0 2024-09-11T22:18:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.178+0000 7efe67fff640 1 -- 172.21.15.50:0/1502228338 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe60014480 con 0x7efe70161fa0 2024-09-11T22:18:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.178+0000 7efe75884640 1 -- 172.21.15.50:0/1502228338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe700c99a0 con 0x7efe70161fa0 2024-09-11T22:18:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.178+0000 7efe67fff640 1 -- 172.21.15.50:0/1502228338 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60014870 con 0x7efe70161fa0 2024-09-11T22:18:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.178+0000 7efe75884640 1 -- 172.21.15.50:0/1502228338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe700c9f60 con 0x7efe70161fa0 2024-09-11T22:18:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.179+0000 7efe75884640 1 -- 172.21.15.50:0/1502228338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe700b4d20 con 0x7efe70161fa0 2024-09-11T22:18:25.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.180+0000 7efe67fff640 1 -- 172.21.15.50:0/1502228338 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe60005d10 con 0x7efe70161fa0 2024-09-11T22:18:25.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.180+0000 7efe67fff640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efe5006be30 0x7efe5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:25.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.180+0000 7efe67fff640 1 -- 172.21.15.50:0/1502228338 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7efe6008b980 con 0x7efe70161fa0 2024-09-11T22:18:25.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.180+0000 7efe6effd640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efe5006be30 0x7efe5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:25.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.181+0000 7efe6effd640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efe5006be30 0x7efe5006e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efe68034000 tx=0x7efe6802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.184+0000 7efe67fff640 1 -- 172.21.15.50:0/1502228338 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe60022070 con 0x7efe70161fa0 2024-09-11T22:18:25.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.396+0000 7efe75884640 1 -- 172.21.15.50:0/1502228338 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efe700b4860 con 0x7efe70161fa0 2024-09-11T22:18:25.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.396+0000 7efe67fff640 1 -- 172.21.15.50:0/1502228338 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) ==== 53+0+73 (secure 0 0 0) 0x7efe60010040 con 0x7efe70161fa0 2024-09-11T22:18:25.397 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:18:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.398+0000 7efe75884640 1 -- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efe5006be30 msgr2=0x7efe5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.398+0000 7efe75884640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efe5006be30 0x7efe5006e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efe68034000 tx=0x7efe6802e000 comp rx=0 tx=0).stop 2024-09-11T22:18:25.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.398+0000 7efe75884640 1 -- 172.21.15.50:0/1502228338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe70161fa0 msgr2=0x7efe700b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.398+0000 7efe75884640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe70161fa0 0x7efe700b33f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7efe6000efc0 tx=0x7efe6000c490 comp rx=0 tx=0).stop 2024-09-11T22:18:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.398+0000 7efe75884640 1 -- 172.21.15.50:0/1502228338 shutdown_connections 2024-09-11T22:18:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.398+0000 7efe75884640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efe5006be30 0x7efe5006e2f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.398+0000 7efe75884640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe700cf610 0x7efe7015fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.398+0000 7efe75884640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe70161fa0 0x7efe700b33f0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.398+0000 7efe75884640 1 --2- 172.21.15.50:0/1502228338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe700b1600 0x7efe700b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.398+0000 7efe75884640 1 -- 172.21.15.50:0/1502228338 >> 172.21.15.50:0/1502228338 conn(0x7efe7009ba50 msgr2=0x7efe7006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.398+0000 7efe75884640 1 -- 172.21.15.50:0/1502228338 shutdown_connections 2024-09-11T22:18:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25.398+0000 7efe75884640 1 -- 172.21.15.50:0/1502228338 wait complete. 2024-09-11T22:18:25.410 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:18:25.410 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:18:25.410 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:18:25.410 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:18:25.410 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:18:25.410 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:18:25.411 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:18:25.411 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:18:25.411 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:18:25.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:25.411 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:18:25.427 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:18:25.427 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:18:25.427 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:18:25.428 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:18:25.428 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:18:25.428 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:18:25.428 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:18:25.428 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:18:25.428 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:18:25.428 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:18:25.428 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:18:25.428 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:18:25.428 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:18:25.428 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:18:25.428 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:18:25.429 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:18:25.429 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42290sec preferred_lft 42290sec 2024-09-11T22:18:25.429 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:18:25.429 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:18:25.429 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:18:25.429 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:18:25.429 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:18:25.429 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:18:25.429 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:18:25.429 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:18:25.429 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:18:25.429 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:18:25.429 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:18:25.430 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:18:25.430 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:18:25.430 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:18:25.430 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:18:25.430 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:18:25.430 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:18:25.430 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:18:25.430 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:18:25.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:25.431 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:18:25.491 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:18:25.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:25.493 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:18:25.550 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:18:25.550 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:18:25.550 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:18:25.550 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:18:25.550 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:18:25.551 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:18:25.551 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:25.551 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:18:25.551 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:18:25.551 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:18:25.551 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:18:25.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:25.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:25.680 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:18:25.696 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:18:25.696 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:18:25.696 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:18:25.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:25.697 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:18:25.762 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:18:25.763 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:18:25.818 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:18:25.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:18:25.819 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:18:25.874 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:18:25.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:25.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:18:25.959 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:18:25.959 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:18:25.968 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:18:25.968 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:18:25.968 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:18:25.968 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:18:25.968 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:18:25.968 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:18:25.968 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:18:25.968 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:18:25.969 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:18:25.969 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:18:25.970 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:18:25.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:25.970 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:18:26.037 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:18:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:26.141 INFO:teuthology.orchestra.run.smithi050.stdout:client8151 2024-09-11T22:18:26.141 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:18:26.141 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:26.158 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:26.158 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:26.158 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.0 2024-09-11T22:18:26.158 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:26.158 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:26.158 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:26.158 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:26.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:26.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.268 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945162 s, 111 MB/s 2024-09-11T22:18:26.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.278 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.278 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080087 s, 131 MB/s 2024-09-11T22:18:26.288 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.288 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.288 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00816828 s, 128 MB/s 2024-09-11T22:18:26.296 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.296 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.296 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067603 s, 155 MB/s 2024-09-11T22:18:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788388 s, 133 MB/s 2024-09-11T22:18:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778241 s, 135 MB/s 2024-09-11T22:18:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865762 s, 121 MB/s 2024-09-11T22:18:26.336 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.336 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.336 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776351 s, 135 MB/s 2024-09-11T22:18:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074915 s, 140 MB/s 2024-09-11T22:18:26.354 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.354 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.354 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753457 s, 139 MB/s 2024-09-11T22:18:26.363 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.363 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.363 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693988 s, 151 MB/s 2024-09-11T22:18:26.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.372 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736515 s, 142 MB/s 2024-09-11T22:18:26.381 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.381 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.382 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723605 s, 145 MB/s 2024-09-11T22:18:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858519 s, 122 MB/s 2024-09-11T22:18:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00829667 s, 126 MB/s 2024-09-11T22:18:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068868 s, 152 MB/s 2024-09-11T22:18:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675776 s, 155 MB/s 2024-09-11T22:18:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.428 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776385 s, 135 MB/s 2024-09-11T22:18:26.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.437 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690323 s, 152 MB/s 2024-09-11T22:18:26.445 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.445 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.445 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662182 s, 158 MB/s 2024-09-11T22:18:26.455 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.455 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.456 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858649 s, 122 MB/s 2024-09-11T22:18:26.465 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.465 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.465 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761185 s, 138 MB/s 2024-09-11T22:18:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.474 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716533 s, 146 MB/s 2024-09-11T22:18:26.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.483 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670033 s, 156 MB/s 2024-09-11T22:18:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00795399 s, 132 MB/s 2024-09-11T22:18:26.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.501 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721515 s, 145 MB/s 2024-09-11T22:18:26.509 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.509 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.509 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652784 s, 161 MB/s 2024-09-11T22:18:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.518 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730115 s, 144 MB/s 2024-09-11T22:18:26.527 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.527 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.527 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732463 s, 143 MB/s 2024-09-11T22:18:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.536 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736346 s, 142 MB/s 2024-09-11T22:18:26.544 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.544 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.545 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632953 s, 166 MB/s 2024-09-11T22:18:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781966 s, 134 MB/s 2024-09-11T22:18:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:26.561 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:26.561 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:26.561 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.1 2024-09-11T22:18:26.561 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:26.561 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:26.561 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:26.561 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:26.623 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.623 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.623 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762866 s, 137 MB/s 2024-09-11T22:18:26.633 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.633 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.633 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787413 s, 133 MB/s 2024-09-11T22:18:26.641 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.641 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.641 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680708 s, 154 MB/s 2024-09-11T22:18:26.649 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.649 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.649 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651517 s, 161 MB/s 2024-09-11T22:18:26.657 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.657 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.657 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650736 s, 161 MB/s 2024-09-11T22:18:26.665 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.665 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.665 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635735 s, 165 MB/s 2024-09-11T22:18:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741546 s, 141 MB/s 2024-09-11T22:18:26.683 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.683 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.683 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067515 s, 155 MB/s 2024-09-11T22:18:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758416 s, 138 MB/s 2024-09-11T22:18:26.701 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.701 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.701 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727063 s, 144 MB/s 2024-09-11T22:18:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664645 s, 158 MB/s 2024-09-11T22:18:26.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.718 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066105 s, 159 MB/s 2024-09-11T22:18:26.726 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.726 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.726 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668815 s, 157 MB/s 2024-09-11T22:18:26.735 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.735 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.735 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681699 s, 154 MB/s 2024-09-11T22:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729298 s, 144 MB/s 2024-09-11T22:18:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729336 s, 144 MB/s 2024-09-11T22:18:26.762 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.762 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.762 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072402 s, 145 MB/s 2024-09-11T22:18:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.772 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742941 s, 141 MB/s 2024-09-11T22:18:26.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.781 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758216 s, 138 MB/s 2024-09-11T22:18:26.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.790 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715967 s, 146 MB/s 2024-09-11T22:18:26.798 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690213 s, 152 MB/s 2024-09-11T22:18:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683426 s, 153 MB/s 2024-09-11T22:18:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736993 s, 142 MB/s 2024-09-11T22:18:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698574 s, 150 MB/s 2024-09-11T22:18:26.834 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.835 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.835 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711021 s, 147 MB/s 2024-09-11T22:18:26.843 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.843 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.843 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677987 s, 155 MB/s 2024-09-11T22:18:26.852 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.852 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.852 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673901 s, 156 MB/s 2024-09-11T22:18:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.861 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739628 s, 142 MB/s 2024-09-11T22:18:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746318 s, 140 MB/s 2024-09-11T22:18:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670148 s, 156 MB/s 2024-09-11T22:18:26.888 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.888 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.888 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764526 s, 137 MB/s 2024-09-11T22:18:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786559 s, 133 MB/s 2024-09-11T22:18:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:26.905 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:26.905 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:26.905 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.2 2024-09-11T22:18:26.905 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:26.905 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:26.905 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:26.905 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:26.965 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.965 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.965 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681923 s, 154 MB/s 2024-09-11T22:18:26.975 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.975 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.975 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783022 s, 134 MB/s 2024-09-11T22:18:26.983 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.984 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.984 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709666 s, 148 MB/s 2024-09-11T22:18:26.992 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:26.992 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:26.992 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067909 s, 154 MB/s 2024-09-11T22:18:27.001 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.001 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.001 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730002 s, 144 MB/s 2024-09-11T22:18:27.011 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.011 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.011 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072724 s, 144 MB/s 2024-09-11T22:18:27.020 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.020 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.020 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076894 s, 136 MB/s 2024-09-11T22:18:27.028 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.028 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.029 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681594 s, 154 MB/s 2024-09-11T22:18:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745023 s, 141 MB/s 2024-09-11T22:18:27.046 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.047 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071933 s, 146 MB/s 2024-09-11T22:18:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674952 s, 155 MB/s 2024-09-11T22:18:27.064 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.065 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075349 s, 139 MB/s 2024-09-11T22:18:27.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.074 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753782 s, 139 MB/s 2024-09-11T22:18:27.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.083 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752801 s, 139 MB/s 2024-09-11T22:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730113 s, 144 MB/s 2024-09-11T22:18:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661085 s, 159 MB/s 2024-09-11T22:18:27.110 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.110 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.110 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733456 s, 143 MB/s 2024-09-11T22:18:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006865 s, 153 MB/s 2024-09-11T22:18:27.127 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.127 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.127 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677506 s, 155 MB/s 2024-09-11T22:18:27.136 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.136 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.136 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067601 s, 155 MB/s 2024-09-11T22:18:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773196 s, 136 MB/s 2024-09-11T22:18:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683214 s, 153 MB/s 2024-09-11T22:18:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071391 s, 147 MB/s 2024-09-11T22:18:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658784 s, 159 MB/s 2024-09-11T22:18:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735987 s, 142 MB/s 2024-09-11T22:18:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706468 s, 148 MB/s 2024-09-11T22:18:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.198 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666455 s, 157 MB/s 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.208 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759011 s, 138 MB/s 2024-09-11T22:18:27.216 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708357 s, 148 MB/s 2024-09-11T22:18:27.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.226 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706659 s, 148 MB/s 2024-09-11T22:18:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665456 s, 158 MB/s 2024-09-11T22:18:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761134 s, 138 MB/s 2024-09-11T22:18:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:27.250 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:27.250 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:27.250 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.3 2024-09-11T22:18:27.250 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:27.251 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:27.251 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:27.251 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:27.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721494 s, 145 MB/s 2024-09-11T22:18:27.320 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.320 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.320 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726632 s, 144 MB/s 2024-09-11T22:18:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.328 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643279 s, 163 MB/s 2024-09-11T22:18:27.337 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.337 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.337 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721495 s, 145 MB/s 2024-09-11T22:18:27.345 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.346 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.346 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689073 s, 152 MB/s 2024-09-11T22:18:27.355 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.355 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.355 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726643 s, 144 MB/s 2024-09-11T22:18:27.364 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.364 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.364 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073068 s, 144 MB/s 2024-09-11T22:18:27.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.373 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.373 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695202 s, 151 MB/s 2024-09-11T22:18:27.381 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.381 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.381 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685525 s, 153 MB/s 2024-09-11T22:18:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649357 s, 161 MB/s 2024-09-11T22:18:27.398 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.399 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732654 s, 143 MB/s 2024-09-11T22:18:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733067 s, 143 MB/s 2024-09-11T22:18:27.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.416 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658367 s, 159 MB/s 2024-09-11T22:18:27.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.424 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686024 s, 153 MB/s 2024-09-11T22:18:27.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.433 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670173 s, 156 MB/s 2024-09-11T22:18:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705264 s, 149 MB/s 2024-09-11T22:18:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719264 s, 146 MB/s 2024-09-11T22:18:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732298 s, 143 MB/s 2024-09-11T22:18:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068455 s, 153 MB/s 2024-09-11T22:18:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.477 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.477 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652836 s, 161 MB/s 2024-09-11T22:18:27.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.485 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723816 s, 145 MB/s 2024-09-11T22:18:27.495 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.496 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843884 s, 124 MB/s 2024-09-11T22:18:27.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.505 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730351 s, 144 MB/s 2024-09-11T22:18:27.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.514 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683976 s, 153 MB/s 2024-09-11T22:18:27.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.523 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.523 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757738 s, 138 MB/s 2024-09-11T22:18:27.531 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.531 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.531 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687334 s, 153 MB/s 2024-09-11T22:18:27.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.541 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762719 s, 137 MB/s 2024-09-11T22:18:27.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.550 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735242 s, 143 MB/s 2024-09-11T22:18:27.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675371 s, 155 MB/s 2024-09-11T22:18:27.567 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.567 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.567 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684875 s, 153 MB/s 2024-09-11T22:18:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844913 s, 124 MB/s 2024-09-11T22:18:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657257 s, 160 MB/s 2024-09-11T22:18:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:27.592 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:27.593 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:27.593 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.4 2024-09-11T22:18:27.593 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:27.593 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:27.593 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:27.593 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:27.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695329 s, 151 MB/s 2024-09-11T22:18:27.662 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.662 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.662 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719275 s, 146 MB/s 2024-09-11T22:18:27.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.671 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725202 s, 145 MB/s 2024-09-11T22:18:27.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.680 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.680 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070532 s, 149 MB/s 2024-09-11T22:18:27.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.688 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723168 s, 145 MB/s 2024-09-11T22:18:27.697 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.697 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.697 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069881 s, 150 MB/s 2024-09-11T22:18:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.706 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676285 s, 155 MB/s 2024-09-11T22:18:27.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.715 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691273 s, 152 MB/s 2024-09-11T22:18:27.723 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.723 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.723 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690492 s, 152 MB/s 2024-09-11T22:18:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.732 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715569 s, 147 MB/s 2024-09-11T22:18:27.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.742 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759385 s, 138 MB/s 2024-09-11T22:18:27.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.750 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664491 s, 158 MB/s 2024-09-11T22:18:27.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.759 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659425 s, 159 MB/s 2024-09-11T22:18:27.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.767 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705278 s, 149 MB/s 2024-09-11T22:18:27.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.776 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713857 s, 147 MB/s 2024-09-11T22:18:27.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.785 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690935 s, 152 MB/s 2024-09-11T22:18:27.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.794 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074646 s, 140 MB/s 2024-09-11T22:18:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.802 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664978 s, 158 MB/s 2024-09-11T22:18:27.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.811 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726712 s, 144 MB/s 2024-09-11T22:18:27.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.820 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739264 s, 142 MB/s 2024-09-11T22:18:27.830 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.830 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.830 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774061 s, 135 MB/s 2024-09-11T22:18:27.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.838 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653248 s, 161 MB/s 2024-09-11T22:18:27.847 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.848 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767338 s, 137 MB/s 2024-09-11T22:18:27.858 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.858 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.858 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00822775 s, 127 MB/s 2024-09-11T22:18:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650367 s, 161 MB/s 2024-09-11T22:18:27.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.876 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.876 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760017 s, 138 MB/s 2024-09-11T22:18:27.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.884 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692714 s, 151 MB/s 2024-09-11T22:18:27.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.893 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741351 s, 141 MB/s 2024-09-11T22:18:27.903 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.903 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.904 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810679 s, 129 MB/s 2024-09-11T22:18:27.913 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.913 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.913 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074283 s, 141 MB/s 2024-09-11T22:18:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741056 s, 141 MB/s 2024-09-11T22:18:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634943 s, 165 MB/s 2024-09-11T22:18:27.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:27.937 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:27.937 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:27.937 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.5 2024-09-11T22:18:27.937 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:27.937 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:27.937 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:27.937 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:27.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:27.998 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:27.998 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:27.998 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738181 s, 142 MB/s 2024-09-11T22:18:28.007 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.007 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.007 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730884 s, 143 MB/s 2024-09-11T22:18:28.016 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.016 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.016 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719863 s, 146 MB/s 2024-09-11T22:18:28.025 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.025 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.025 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686789 s, 153 MB/s 2024-09-11T22:18:28.034 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.034 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.034 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766164 s, 137 MB/s 2024-09-11T22:18:28.044 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.044 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.044 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073992 s, 142 MB/s 2024-09-11T22:18:28.052 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.052 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.052 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648179 s, 162 MB/s 2024-09-11T22:18:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693633 s, 151 MB/s 2024-09-11T22:18:28.071 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.071 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.071 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858832 s, 122 MB/s 2024-09-11T22:18:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.081 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737976 s, 142 MB/s 2024-09-11T22:18:28.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.090 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074073 s, 142 MB/s 2024-09-11T22:18:28.098 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.099 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.099 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697653 s, 150 MB/s 2024-09-11T22:18:28.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.108 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070807 s, 148 MB/s 2024-09-11T22:18:28.116 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.116 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.116 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638633 s, 164 MB/s 2024-09-11T22:18:28.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.126 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007822 s, 134 MB/s 2024-09-11T22:18:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675976 s, 155 MB/s 2024-09-11T22:18:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661032 s, 159 MB/s 2024-09-11T22:18:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630086 s, 166 MB/s 2024-09-11T22:18:28.159 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.159 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.159 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703196 s, 149 MB/s 2024-09-11T22:18:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709029 s, 148 MB/s 2024-09-11T22:18:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712805 s, 147 MB/s 2024-09-11T22:18:28.186 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.186 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.186 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719529 s, 146 MB/s 2024-09-11T22:18:28.195 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.195 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.195 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648165 s, 162 MB/s 2024-09-11T22:18:28.203 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.203 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.203 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760582 s, 138 MB/s 2024-09-11T22:18:28.212 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.212 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.212 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707669 s, 148 MB/s 2024-09-11T22:18:28.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.221 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739474 s, 142 MB/s 2024-09-11T22:18:28.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.230 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695458 s, 151 MB/s 2024-09-11T22:18:28.238 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.238 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.239 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666252 s, 157 MB/s 2024-09-11T22:18:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777955 s, 135 MB/s 2024-09-11T22:18:28.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.257 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758254 s, 138 MB/s 2024-09-11T22:18:28.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.266 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726357 s, 144 MB/s 2024-09-11T22:18:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680285 s, 154 MB/s 2024-09-11T22:18:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:28.282 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:28.282 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:28.282 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.6 2024-09-11T22:18:28.282 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:28.282 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:28.282 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:28.282 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:28.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:28.342 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.342 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.342 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654138 s, 160 MB/s 2024-09-11T22:18:28.351 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.351 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.351 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693108 s, 151 MB/s 2024-09-11T22:18:28.359 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.360 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711891 s, 147 MB/s 2024-09-11T22:18:28.370 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.370 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.370 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841437 s, 125 MB/s 2024-09-11T22:18:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.379 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731941 s, 143 MB/s 2024-09-11T22:18:28.387 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.387 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.387 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660488 s, 159 MB/s 2024-09-11T22:18:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785583 s, 133 MB/s 2024-09-11T22:18:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726784 s, 144 MB/s 2024-09-11T22:18:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758819 s, 138 MB/s 2024-09-11T22:18:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733779 s, 143 MB/s 2024-09-11T22:18:28.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.433 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693667 s, 151 MB/s 2024-09-11T22:18:28.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.441 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632779 s, 166 MB/s 2024-09-11T22:18:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.449 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651784 s, 161 MB/s 2024-09-11T22:18:28.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.458 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708179 s, 148 MB/s 2024-09-11T22:18:28.467 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.467 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.467 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682309 s, 154 MB/s 2024-09-11T22:18:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746106 s, 141 MB/s 2024-09-11T22:18:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.484 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616544 s, 170 MB/s 2024-09-11T22:18:28.492 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.492 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.492 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066697 s, 157 MB/s 2024-09-11T22:18:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685537 s, 153 MB/s 2024-09-11T22:18:28.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.511 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793296 s, 132 MB/s 2024-09-11T22:18:28.521 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.521 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.521 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00823268 s, 127 MB/s 2024-09-11T22:18:28.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.530 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760648 s, 138 MB/s 2024-09-11T22:18:28.540 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.540 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.540 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769861 s, 136 MB/s 2024-09-11T22:18:28.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.548 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663041 s, 158 MB/s 2024-09-11T22:18:28.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.557 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686543 s, 153 MB/s 2024-09-11T22:18:28.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.565 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067267 s, 156 MB/s 2024-09-11T22:18:28.574 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.574 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.574 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666628 s, 157 MB/s 2024-09-11T22:18:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743303 s, 141 MB/s 2024-09-11T22:18:28.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.592 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699019 s, 150 MB/s 2024-09-11T22:18:28.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.600 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672 s, 156 MB/s 2024-09-11T22:18:28.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.609 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747091 s, 140 MB/s 2024-09-11T22:18:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665225 s, 158 MB/s 2024-09-11T22:18:28.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:28.624 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:28.624 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:28.624 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.7 2024-09-11T22:18:28.624 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:28.624 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:28.625 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:28.625 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075642 s, 139 MB/s 2024-09-11T22:18:28.696 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.696 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.696 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868473 s, 121 MB/s 2024-09-11T22:18:28.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.705 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736088 s, 142 MB/s 2024-09-11T22:18:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746372 s, 140 MB/s 2024-09-11T22:18:28.723 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.724 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078591 s, 133 MB/s 2024-09-11T22:18:28.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.733 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738243 s, 142 MB/s 2024-09-11T22:18:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648974 s, 162 MB/s 2024-09-11T22:18:28.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.750 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724055 s, 145 MB/s 2024-09-11T22:18:28.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.758 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676557 s, 155 MB/s 2024-09-11T22:18:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654969 s, 160 MB/s 2024-09-11T22:18:28.775 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.775 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.775 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701732 s, 149 MB/s 2024-09-11T22:18:28.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.784 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668371 s, 157 MB/s 2024-09-11T22:18:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698931 s, 150 MB/s 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724089 s, 145 MB/s 2024-09-11T22:18:28.810 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.810 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.810 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643907 s, 163 MB/s 2024-09-11T22:18:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724142 s, 145 MB/s 2024-09-11T22:18:28.827 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.827 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.827 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646485 s, 162 MB/s 2024-09-11T22:18:28.836 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.836 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.836 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701229 s, 150 MB/s 2024-09-11T22:18:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067704 s, 155 MB/s 2024-09-11T22:18:28.853 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.853 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.853 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693276 s, 151 MB/s 2024-09-11T22:18:28.863 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.863 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.863 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737203 s, 142 MB/s 2024-09-11T22:18:28.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.872 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745971 s, 141 MB/s 2024-09-11T22:18:28.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.881 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710799 s, 148 MB/s 2024-09-11T22:18:28.890 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.891 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827543 s, 127 MB/s 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.900 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630474 s, 166 MB/s 2024-09-11T22:18:28.907 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725464 s, 145 MB/s 2024-09-11T22:18:28.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.917 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.917 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711958 s, 147 MB/s 2024-09-11T22:18:28.924 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.925 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640416 s, 164 MB/s 2024-09-11T22:18:28.934 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.935 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786731 s, 133 MB/s 2024-09-11T22:18:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722266 s, 145 MB/s 2024-09-11T22:18:28.951 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.951 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.952 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672884 s, 156 MB/s 2024-09-11T22:18:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663177 s, 158 MB/s 2024-09-11T22:18:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:28.966 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:28.967 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:28.967 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.8 2024-09-11T22:18:28.967 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:28.967 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:28.967 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:28.967 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:29.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:30.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.557 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722609 s, 145 MB/s 2024-09-11T22:18:30.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.557 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677716 s, 155 MB/s 2024-09-11T22:18:30.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.557 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765917 s, 137 MB/s 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725522 s, 145 MB/s 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763192 s, 137 MB/s 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732243 s, 143 MB/s 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698825 s, 150 MB/s 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741735 s, 141 MB/s 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763091 s, 137 MB/s 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651451 s, 161 MB/s 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632986 s, 166 MB/s 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732318 s, 143 MB/s 2024-09-11T22:18:30.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706796 s, 148 MB/s 2024-09-11T22:18:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745532 s, 141 MB/s 2024-09-11T22:18:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647996 s, 162 MB/s 2024-09-11T22:18:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00832643 s, 126 MB/s 2024-09-11T22:18:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.560 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632181 s, 166 MB/s 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670656 s, 156 MB/s 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074157 s, 141 MB/s 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732304 s, 143 MB/s 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765524 s, 137 MB/s 2024-09-11T22:18:30.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.562 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839505 s, 125 MB/s 2024-09-11T22:18:30.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.562 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580378 s, 181 MB/s 2024-09-11T22:18:30.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.562 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072726 s, 144 MB/s 2024-09-11T22:18:30.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.562 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680869 s, 154 MB/s 2024-09-11T22:18:30.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.563 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725994 s, 144 MB/s 2024-09-11T22:18:30.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.563 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657454 s, 159 MB/s 2024-09-11T22:18:30.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.563 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627803 s, 167 MB/s 2024-09-11T22:18:30.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.563 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641299 s, 164 MB/s 2024-09-11T22:18:30.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.564 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697054 s, 150 MB/s 2024-09-11T22:18:30.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.564 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759097 s, 138 MB/s 2024-09-11T22:18:30.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.564 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733834 s, 143 MB/s 2024-09-11T22:18:30.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:30.565 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:30.565 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:30.565 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.9 2024-09-11T22:18:30.565 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:30.565 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:30.565 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:30.565 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:30.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:30.636 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.636 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.636 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787182 s, 133 MB/s 2024-09-11T22:18:30.645 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.645 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.645 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743575 s, 141 MB/s 2024-09-11T22:18:30.654 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.654 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.654 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690331 s, 152 MB/s 2024-09-11T22:18:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874345 s, 120 MB/s 2024-09-11T22:18:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.674 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744158 s, 141 MB/s 2024-09-11T22:18:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.685 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682451 s, 154 MB/s 2024-09-11T22:18:30.691 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.691 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.691 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635521 s, 165 MB/s 2024-09-11T22:18:30.700 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.700 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.700 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707399 s, 148 MB/s 2024-09-11T22:18:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.714 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00801201 s, 131 MB/s 2024-09-11T22:18:30.719 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.719 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.719 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079499 s, 132 MB/s 2024-09-11T22:18:30.728 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.728 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.728 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714316 s, 147 MB/s 2024-09-11T22:18:30.737 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.737 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.737 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676374 s, 155 MB/s 2024-09-11T22:18:30.745 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.746 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.746 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668993 s, 157 MB/s 2024-09-11T22:18:30.754 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.755 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.755 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756987 s, 139 MB/s 2024-09-11T22:18:30.763 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.763 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.764 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707463 s, 148 MB/s 2024-09-11T22:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.773 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771349 s, 136 MB/s 2024-09-11T22:18:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.781 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671401 s, 156 MB/s 2024-09-11T22:18:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.790 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715251 s, 147 MB/s 2024-09-11T22:18:30.800 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.800 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.800 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793577 s, 132 MB/s 2024-09-11T22:18:30.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.808 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656905 s, 160 MB/s 2024-09-11T22:18:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731076 s, 143 MB/s 2024-09-11T22:18:30.826 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.826 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.826 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687562 s, 153 MB/s 2024-09-11T22:18:30.836 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.836 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.836 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779197 s, 135 MB/s 2024-09-11T22:18:30.844 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688333 s, 152 MB/s 2024-09-11T22:18:30.853 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.853 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.853 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679847 s, 154 MB/s 2024-09-11T22:18:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.863 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.863 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756742 s, 139 MB/s 2024-09-11T22:18:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.871 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.872 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696261 s, 151 MB/s 2024-09-11T22:18:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700703 s, 150 MB/s 2024-09-11T22:18:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702273 s, 149 MB/s 2024-09-11T22:18:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687253 s, 153 MB/s 2024-09-11T22:18:30.906 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.906 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.907 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734417 s, 143 MB/s 2024-09-11T22:18:30.914 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.914 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619267 s, 169 MB/s 2024-09-11T22:18:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:30.921 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:30.921 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:30.921 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.10 2024-09-11T22:18:30.921 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:30.922 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:30.922 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:30.922 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:30.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.982 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.982 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676458 s, 155 MB/s 2024-09-11T22:18:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00822116 s, 128 MB/s 2024-09-11T22:18:31.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.001 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.001 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073275 s, 143 MB/s 2024-09-11T22:18:31.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.010 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717091 s, 146 MB/s 2024-09-11T22:18:31.018 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.019 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718211 s, 146 MB/s 2024-09-11T22:18:31.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.027 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678518 s, 155 MB/s 2024-09-11T22:18:31.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.037 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749911 s, 140 MB/s 2024-09-11T22:18:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725834 s, 144 MB/s 2024-09-11T22:18:31.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.055 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759257 s, 138 MB/s 2024-09-11T22:18:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856633 s, 122 MB/s 2024-09-11T22:18:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067564 s, 155 MB/s 2024-09-11T22:18:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683985 s, 153 MB/s 2024-09-11T22:18:31.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.092 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796692 s, 132 MB/s 2024-09-11T22:18:31.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.101 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746422 s, 140 MB/s 2024-09-11T22:18:31.110 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.110 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.110 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696771 s, 150 MB/s 2024-09-11T22:18:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734922 s, 143 MB/s 2024-09-11T22:18:31.128 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695976 s, 151 MB/s 2024-09-11T22:18:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671672 s, 156 MB/s 2024-09-11T22:18:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068603 s, 153 MB/s 2024-09-11T22:18:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677396 s, 155 MB/s 2024-09-11T22:18:31.164 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.164 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.164 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757958 s, 138 MB/s 2024-09-11T22:18:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620256 s, 169 MB/s 2024-09-11T22:18:31.181 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.181 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.181 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757855 s, 138 MB/s 2024-09-11T22:18:31.190 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.190 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.190 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694667 s, 151 MB/s 2024-09-11T22:18:31.198 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.199 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.199 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658943 s, 159 MB/s 2024-09-11T22:18:31.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.207 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723833 s, 145 MB/s 2024-09-11T22:18:31.216 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.216 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686623 s, 153 MB/s 2024-09-11T22:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699258 s, 150 MB/s 2024-09-11T22:18:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715206 s, 147 MB/s 2024-09-11T22:18:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679489 s, 154 MB/s 2024-09-11T22:18:31.251 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.252 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.252 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721945 s, 145 MB/s 2024-09-11T22:18:31.261 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.261 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.261 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719997 s, 146 MB/s 2024-09-11T22:18:31.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:31.267 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:31.267 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:31.268 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.11 2024-09-11T22:18:31.268 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:31.268 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:31.268 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:31.268 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662052 s, 158 MB/s 2024-09-11T22:18:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810917 s, 129 MB/s 2024-09-11T22:18:31.346 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.347 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073207 s, 143 MB/s 2024-09-11T22:18:31.356 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.356 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.356 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733424 s, 143 MB/s 2024-09-11T22:18:31.364 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.364 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.364 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643266 s, 163 MB/s 2024-09-11T22:18:31.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.372 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653476 s, 160 MB/s 2024-09-11T22:18:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068466 s, 153 MB/s 2024-09-11T22:18:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653569 s, 160 MB/s 2024-09-11T22:18:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.397 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706414 s, 148 MB/s 2024-09-11T22:18:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684765 s, 153 MB/s 2024-09-11T22:18:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735011 s, 143 MB/s 2024-09-11T22:18:31.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.424 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699894 s, 150 MB/s 2024-09-11T22:18:31.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.433 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703561 s, 149 MB/s 2024-09-11T22:18:31.442 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.442 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.442 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069479 s, 151 MB/s 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.450 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650253 s, 161 MB/s 2024-09-11T22:18:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064507 s, 163 MB/s 2024-09-11T22:18:31.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.466 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662577 s, 158 MB/s 2024-09-11T22:18:31.475 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.475 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.475 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683651 s, 153 MB/s 2024-09-11T22:18:31.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.484 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715203 s, 147 MB/s 2024-09-11T22:18:31.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.493 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073921 s, 142 MB/s 2024-09-11T22:18:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.502 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658809 s, 159 MB/s 2024-09-11T22:18:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.510 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006496 s, 161 MB/s 2024-09-11T22:18:31.519 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.519 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.519 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799805 s, 131 MB/s 2024-09-11T22:18:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.528 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.528 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653232 s, 161 MB/s 2024-09-11T22:18:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720894 s, 145 MB/s 2024-09-11T22:18:31.545 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.545 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.545 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672843 s, 156 MB/s 2024-09-11T22:18:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663577 s, 158 MB/s 2024-09-11T22:18:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652533 s, 161 MB/s 2024-09-11T22:18:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648078 s, 162 MB/s 2024-09-11T22:18:31.578 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.578 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738632 s, 142 MB/s 2024-09-11T22:18:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850581 s, 123 MB/s 2024-09-11T22:18:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726308 s, 144 MB/s 2024-09-11T22:18:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:31.605 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:31.605 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:31.605 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.12 2024-09-11T22:18:31.605 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:31.605 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:31.605 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:31.605 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:31.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:31.666 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.666 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.666 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743794 s, 141 MB/s 2024-09-11T22:18:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069896 s, 150 MB/s 2024-09-11T22:18:31.684 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.684 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.684 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764211 s, 137 MB/s 2024-09-11T22:18:31.693 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.693 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.693 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068084 s, 154 MB/s 2024-09-11T22:18:31.702 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.702 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.702 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727161 s, 144 MB/s 2024-09-11T22:18:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.710 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649434 s, 161 MB/s 2024-09-11T22:18:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.719 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735414 s, 143 MB/s 2024-09-11T22:18:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075391 s, 139 MB/s 2024-09-11T22:18:31.739 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.739 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.739 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862301 s, 122 MB/s 2024-09-11T22:18:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701269 s, 150 MB/s 2024-09-11T22:18:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674739 s, 155 MB/s 2024-09-11T22:18:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652523 s, 161 MB/s 2024-09-11T22:18:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733851 s, 143 MB/s 2024-09-11T22:18:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638415 s, 164 MB/s 2024-09-11T22:18:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657283 s, 160 MB/s 2024-09-11T22:18:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640048 s, 164 MB/s 2024-09-11T22:18:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847852 s, 124 MB/s 2024-09-11T22:18:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.817 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.817 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666994 s, 157 MB/s 2024-09-11T22:18:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766941 s, 137 MB/s 2024-09-11T22:18:31.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.837 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884702 s, 119 MB/s 2024-09-11T22:18:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076241 s, 138 MB/s 2024-09-11T22:18:31.854 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.855 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681261 s, 154 MB/s 2024-09-11T22:18:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064928 s, 161 MB/s 2024-09-11T22:18:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670745 s, 156 MB/s 2024-09-11T22:18:31.880 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.881 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739085 s, 142 MB/s 2024-09-11T22:18:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755662 s, 139 MB/s 2024-09-11T22:18:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664413 s, 158 MB/s 2024-09-11T22:18:31.907 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.907 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.907 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712239 s, 147 MB/s 2024-09-11T22:18:31.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.916 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074746 s, 140 MB/s 2024-09-11T22:18:31.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.925 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748007 s, 140 MB/s 2024-09-11T22:18:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663514 s, 158 MB/s 2024-09-11T22:18:31.943 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:31.943 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:31.943 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771448 s, 136 MB/s 2024-09-11T22:18:31.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:31.950 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:31.950 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:31.951 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.13 2024-09-11T22:18:31.951 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:31.951 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:31.951 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:31.951 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727861 s, 144 MB/s 2024-09-11T22:18:32.020 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.020 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.020 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676934 s, 155 MB/s 2024-09-11T22:18:32.029 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.030 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735159 s, 143 MB/s 2024-09-11T22:18:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804462 s, 130 MB/s 2024-09-11T22:18:32.048 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.048 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.048 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675743 s, 155 MB/s 2024-09-11T22:18:32.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.057 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758162 s, 138 MB/s 2024-09-11T22:18:32.067 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.067 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.067 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828316 s, 127 MB/s 2024-09-11T22:18:32.077 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.077 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.077 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079303 s, 132 MB/s 2024-09-11T22:18:32.085 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.086 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.086 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662369 s, 158 MB/s 2024-09-11T22:18:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.094 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671922 s, 156 MB/s 2024-09-11T22:18:32.103 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.103 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.103 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717889 s, 146 MB/s 2024-09-11T22:18:32.112 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.112 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.113 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733269 s, 143 MB/s 2024-09-11T22:18:32.121 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.121 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.121 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662624 s, 158 MB/s 2024-09-11T22:18:32.130 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.130 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.130 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069377 s, 151 MB/s 2024-09-11T22:18:32.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.138 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655494 s, 160 MB/s 2024-09-11T22:18:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651071 s, 161 MB/s 2024-09-11T22:18:32.156 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.156 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.156 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780172 s, 134 MB/s 2024-09-11T22:18:32.165 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.165 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.165 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725172 s, 145 MB/s 2024-09-11T22:18:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742463 s, 141 MB/s 2024-09-11T22:18:32.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.183 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.183 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678613 s, 155 MB/s 2024-09-11T22:18:32.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.191 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669865 s, 157 MB/s 2024-09-11T22:18:32.201 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.201 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.201 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840158 s, 125 MB/s 2024-09-11T22:18:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661284 s, 159 MB/s 2024-09-11T22:18:32.218 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.218 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.218 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688443 s, 152 MB/s 2024-09-11T22:18:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625965 s, 168 MB/s 2024-09-11T22:18:32.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.234 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655722 s, 160 MB/s 2024-09-11T22:18:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578245 s, 181 MB/s 2024-09-11T22:18:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681549 s, 154 MB/s 2024-09-11T22:18:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067691 s, 155 MB/s 2024-09-11T22:18:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742215 s, 141 MB/s 2024-09-11T22:18:32.276 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.277 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685115 s, 153 MB/s 2024-09-11T22:18:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076555 s, 137 MB/s 2024-09-11T22:18:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:32.293 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:32.293 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:32.293 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.14 2024-09-11T22:18:32.293 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:32.293 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:32.293 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:32.293 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:32.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.353 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701012 s, 150 MB/s 2024-09-11T22:18:32.361 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.362 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677555 s, 155 MB/s 2024-09-11T22:18:32.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.371 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776176 s, 135 MB/s 2024-09-11T22:18:32.379 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.379 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.379 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650689 s, 161 MB/s 2024-09-11T22:18:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.389 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743325 s, 141 MB/s 2024-09-11T22:18:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652933 s, 161 MB/s 2024-09-11T22:18:32.405 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.405 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.406 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707887 s, 148 MB/s 2024-09-11T22:18:32.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.415 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711388 s, 147 MB/s 2024-09-11T22:18:32.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.425 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792608 s, 132 MB/s 2024-09-11T22:18:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645978 s, 162 MB/s 2024-09-11T22:18:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739958 s, 142 MB/s 2024-09-11T22:18:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703144 s, 149 MB/s 2024-09-11T22:18:32.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.460 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705225 s, 149 MB/s 2024-09-11T22:18:32.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.469 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074533 s, 141 MB/s 2024-09-11T22:18:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789301 s, 133 MB/s 2024-09-11T22:18:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.488 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705623 s, 149 MB/s 2024-09-11T22:18:32.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.496 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666441 s, 157 MB/s 2024-09-11T22:18:32.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.505 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727174 s, 144 MB/s 2024-09-11T22:18:32.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.514 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741825 s, 141 MB/s 2024-09-11T22:18:32.524 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.524 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.524 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756849 s, 139 MB/s 2024-09-11T22:18:32.533 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.533 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.533 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742835 s, 141 MB/s 2024-09-11T22:18:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625432 s, 168 MB/s 2024-09-11T22:18:32.553 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.553 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.553 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764742 s, 137 MB/s 2024-09-11T22:18:32.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642784 s, 163 MB/s 2024-09-11T22:18:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006301 s, 166 MB/s 2024-09-11T22:18:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616915 s, 170 MB/s 2024-09-11T22:18:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727939 s, 144 MB/s 2024-09-11T22:18:32.593 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.593 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.593 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731264 s, 143 MB/s 2024-09-11T22:18:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735773 s, 143 MB/s 2024-09-11T22:18:32.611 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.611 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.611 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670758 s, 156 MB/s 2024-09-11T22:18:32.619 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.619 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.620 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669001 s, 157 MB/s 2024-09-11T22:18:32.628 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.628 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.629 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713048 s, 147 MB/s 2024-09-11T22:18:32.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:32.635 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:32.635 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:32.635 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.15 2024-09-11T22:18:32.635 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:32.635 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:32.635 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:32.635 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:32.696 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.696 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.696 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743107 s, 141 MB/s 2024-09-11T22:18:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694212 s, 151 MB/s 2024-09-11T22:18:32.713 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.713 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.713 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685825 s, 153 MB/s 2024-09-11T22:18:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746945 s, 140 MB/s 2024-09-11T22:18:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718501 s, 146 MB/s 2024-09-11T22:18:32.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.740 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621486 s, 169 MB/s 2024-09-11T22:18:32.748 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.749 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693843 s, 151 MB/s 2024-09-11T22:18:32.757 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.758 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720003 s, 146 MB/s 2024-09-11T22:18:32.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.766 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704349 s, 149 MB/s 2024-09-11T22:18:32.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.776 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076726 s, 137 MB/s 2024-09-11T22:18:32.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.784 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695124 s, 151 MB/s 2024-09-11T22:18:32.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.794 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766832 s, 137 MB/s 2024-09-11T22:18:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.803 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730416 s, 144 MB/s 2024-09-11T22:18:32.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.812 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072975 s, 144 MB/s 2024-09-11T22:18:32.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.821 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726161 s, 144 MB/s 2024-09-11T22:18:32.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.829 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673601 s, 156 MB/s 2024-09-11T22:18:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733985 s, 143 MB/s 2024-09-11T22:18:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752496 s, 139 MB/s 2024-09-11T22:18:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071289 s, 147 MB/s 2024-09-11T22:18:32.865 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.866 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687173 s, 153 MB/s 2024-09-11T22:18:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684245 s, 153 MB/s 2024-09-11T22:18:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.883 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700516 s, 150 MB/s 2024-09-11T22:18:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718545 s, 146 MB/s 2024-09-11T22:18:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687079 s, 153 MB/s 2024-09-11T22:18:32.909 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.909 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.909 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680593 s, 154 MB/s 2024-09-11T22:18:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.919 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.919 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740967 s, 142 MB/s 2024-09-11T22:18:32.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.928 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759003 s, 138 MB/s 2024-09-11T22:18:32.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.936 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063822 s, 164 MB/s 2024-09-11T22:18:32.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.945 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707763 s, 148 MB/s 2024-09-11T22:18:32.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.953 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713802 s, 147 MB/s 2024-09-11T22:18:32.963 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.963 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.963 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00791094 s, 133 MB/s 2024-09-11T22:18:32.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:32.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:32.972 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684982 s, 153 MB/s 2024-09-11T22:18:32.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:32.979 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:32.979 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:32.980 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.16 2024-09-11T22:18:32.980 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:32.980 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:32.980 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:32.980 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:33.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:33.041 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.041 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.041 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755972 s, 139 MB/s 2024-09-11T22:18:33.049 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.050 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.050 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723189 s, 145 MB/s 2024-09-11T22:18:33.058 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.058 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.058 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710222 s, 148 MB/s 2024-09-11T22:18:33.069 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.069 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.069 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888475 s, 118 MB/s 2024-09-11T22:18:33.077 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.077 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.077 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650159 s, 161 MB/s 2024-09-11T22:18:33.086 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.086 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.086 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664509 s, 158 MB/s 2024-09-11T22:18:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741437 s, 141 MB/s 2024-09-11T22:18:33.103 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.103 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.103 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647308 s, 162 MB/s 2024-09-11T22:18:33.112 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.112 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.112 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741974 s, 141 MB/s 2024-09-11T22:18:33.121 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.121 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.121 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689323 s, 152 MB/s 2024-09-11T22:18:33.130 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.130 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.130 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726794 s, 144 MB/s 2024-09-11T22:18:33.139 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.139 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.139 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735647 s, 143 MB/s 2024-09-11T22:18:33.148 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.148 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.148 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662649 s, 158 MB/s 2024-09-11T22:18:33.156 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.157 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.157 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679098 s, 154 MB/s 2024-09-11T22:18:33.165 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.165 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.165 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063514 s, 165 MB/s 2024-09-11T22:18:33.174 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.174 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.174 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735117 s, 143 MB/s 2024-09-11T22:18:33.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.182 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678152 s, 155 MB/s 2024-09-11T22:18:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.192 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.192 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747521 s, 140 MB/s 2024-09-11T22:18:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737155 s, 142 MB/s 2024-09-11T22:18:33.210 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.210 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.210 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075734 s, 138 MB/s 2024-09-11T22:18:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070926 s, 148 MB/s 2024-09-11T22:18:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660982 s, 159 MB/s 2024-09-11T22:18:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692507 s, 151 MB/s 2024-09-11T22:18:33.245 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.245 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.245 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738965 s, 142 MB/s 2024-09-11T22:18:33.255 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.255 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.255 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760312 s, 138 MB/s 2024-09-11T22:18:33.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.264 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.264 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679724 s, 154 MB/s 2024-09-11T22:18:33.273 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.273 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.273 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771673 s, 136 MB/s 2024-09-11T22:18:33.283 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.283 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.283 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787033 s, 133 MB/s 2024-09-11T22:18:33.291 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.291 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699128 s, 150 MB/s 2024-09-11T22:18:33.300 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.301 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722105 s, 145 MB/s 2024-09-11T22:18:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706303 s, 148 MB/s 2024-09-11T22:18:33.318 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.319 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.319 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731771 s, 143 MB/s 2024-09-11T22:18:33.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:33.325 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:33.325 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:33.326 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.17 2024-09-11T22:18:33.326 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:33.326 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:33.326 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:33.326 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:33.386 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.386 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.386 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007118 s, 147 MB/s 2024-09-11T22:18:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.395 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710038 s, 148 MB/s 2024-09-11T22:18:33.405 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.405 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.405 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760393 s, 138 MB/s 2024-09-11T22:18:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855609 s, 123 MB/s 2024-09-11T22:18:33.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.425 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768646 s, 136 MB/s 2024-09-11T22:18:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647496 s, 162 MB/s 2024-09-11T22:18:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.442 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724224 s, 145 MB/s 2024-09-11T22:18:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682979 s, 154 MB/s 2024-09-11T22:18:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758911 s, 138 MB/s 2024-09-11T22:18:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796623 s, 132 MB/s 2024-09-11T22:18:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652019 s, 161 MB/s 2024-09-11T22:18:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676832 s, 155 MB/s 2024-09-11T22:18:33.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.496 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748705 s, 140 MB/s 2024-09-11T22:18:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675209 s, 155 MB/s 2024-09-11T22:18:33.513 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.514 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751004 s, 140 MB/s 2024-09-11T22:18:33.523 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.523 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.523 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751329 s, 140 MB/s 2024-09-11T22:18:33.532 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.532 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.532 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692768 s, 151 MB/s 2024-09-11T22:18:33.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.541 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745837 s, 141 MB/s 2024-09-11T22:18:33.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.550 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712984 s, 147 MB/s 2024-09-11T22:18:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669297 s, 157 MB/s 2024-09-11T22:18:33.567 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.567 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.567 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678293 s, 155 MB/s 2024-09-11T22:18:33.576 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.576 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.576 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674156 s, 156 MB/s 2024-09-11T22:18:33.585 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.585 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.585 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745913 s, 141 MB/s 2024-09-11T22:18:33.594 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.594 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.594 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717406 s, 146 MB/s 2024-09-11T22:18:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734498 s, 143 MB/s 2024-09-11T22:18:33.612 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.612 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.612 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711814 s, 147 MB/s 2024-09-11T22:18:33.620 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.621 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.621 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680043 s, 154 MB/s 2024-09-11T22:18:33.629 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.629 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.629 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665865 s, 157 MB/s 2024-09-11T22:18:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.638 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746255 s, 141 MB/s 2024-09-11T22:18:33.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.647 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686723 s, 153 MB/s 2024-09-11T22:18:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.656 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672337 s, 156 MB/s 2024-09-11T22:18:33.665 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.665 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.665 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737108 s, 142 MB/s 2024-09-11T22:18:33.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:33.672 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:33.672 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:33.672 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.18 2024-09-11T22:18:33.672 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:33.672 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:33.672 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:33.672 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:33.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:33.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.733 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738309 s, 142 MB/s 2024-09-11T22:18:33.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.742 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737838 s, 142 MB/s 2024-09-11T22:18:33.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.751 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735212 s, 143 MB/s 2024-09-11T22:18:33.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.761 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.761 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727818 s, 144 MB/s 2024-09-11T22:18:33.769 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.769 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.770 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718036 s, 146 MB/s 2024-09-11T22:18:33.779 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.779 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.779 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752524 s, 139 MB/s 2024-09-11T22:18:33.787 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.788 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.788 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741837 s, 141 MB/s 2024-09-11T22:18:33.797 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.797 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.797 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728271 s, 144 MB/s 2024-09-11T22:18:33.805 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.806 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.806 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713771 s, 147 MB/s 2024-09-11T22:18:33.815 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.815 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.815 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745353 s, 141 MB/s 2024-09-11T22:18:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073108 s, 143 MB/s 2024-09-11T22:18:33.832 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.832 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.832 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668993 s, 157 MB/s 2024-09-11T22:18:33.841 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.841 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.841 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677838 s, 155 MB/s 2024-09-11T22:18:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775145 s, 135 MB/s 2024-09-11T22:18:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685876 s, 153 MB/s 2024-09-11T22:18:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647865 s, 162 MB/s 2024-09-11T22:18:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733392 s, 143 MB/s 2024-09-11T22:18:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678398 s, 155 MB/s 2024-09-11T22:18:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069112 s, 152 MB/s 2024-09-11T22:18:33.903 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.903 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.903 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704495 s, 149 MB/s 2024-09-11T22:18:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729145 s, 144 MB/s 2024-09-11T22:18:33.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.920 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699194 s, 150 MB/s 2024-09-11T22:18:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.930 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00829614 s, 126 MB/s 2024-09-11T22:18:33.939 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.939 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.939 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676372 s, 155 MB/s 2024-09-11T22:18:33.948 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.948 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.948 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702516 s, 149 MB/s 2024-09-11T22:18:33.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.956 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679152 s, 154 MB/s 2024-09-11T22:18:33.965 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.965 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.965 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714365 s, 147 MB/s 2024-09-11T22:18:33.974 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.974 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.974 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680241 s, 154 MB/s 2024-09-11T22:18:33.983 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.984 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.984 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744065 s, 141 MB/s 2024-09-11T22:18:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661052 s, 159 MB/s 2024-09-11T22:18:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.002 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727695 s, 144 MB/s 2024-09-11T22:18:34.011 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.011 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.011 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747205 s, 140 MB/s 2024-09-11T22:18:34.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:34.017 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:34.018 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:34.018 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.19 2024-09-11T22:18:34.018 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:34.018 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:34.018 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:34.018 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:34.079 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.079 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.079 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007427 s, 141 MB/s 2024-09-11T22:18:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687731 s, 152 MB/s 2024-09-11T22:18:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727879 s, 144 MB/s 2024-09-11T22:18:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.105 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707699 s, 148 MB/s 2024-09-11T22:18:34.114 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.114 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.114 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067102 s, 156 MB/s 2024-09-11T22:18:34.122 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.122 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.122 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634407 s, 165 MB/s 2024-09-11T22:18:34.131 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.131 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.131 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741326 s, 141 MB/s 2024-09-11T22:18:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.140 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071613 s, 146 MB/s 2024-09-11T22:18:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.149 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701516 s, 149 MB/s 2024-09-11T22:18:34.158 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.158 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.158 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662955 s, 158 MB/s 2024-09-11T22:18:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693348 s, 151 MB/s 2024-09-11T22:18:34.175 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.175 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.176 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717989 s, 146 MB/s 2024-09-11T22:18:34.184 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.184 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.184 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672152 s, 156 MB/s 2024-09-11T22:18:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.193 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707173 s, 148 MB/s 2024-09-11T22:18:34.203 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.203 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.203 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733914 s, 143 MB/s 2024-09-11T22:18:34.211 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.211 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.211 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686888 s, 153 MB/s 2024-09-11T22:18:34.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.221 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735736 s, 143 MB/s 2024-09-11T22:18:34.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.230 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775014 s, 135 MB/s 2024-09-11T22:18:34.239 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.239 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.239 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746283 s, 141 MB/s 2024-09-11T22:18:34.248 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.248 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.248 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681398 s, 154 MB/s 2024-09-11T22:18:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703445 s, 149 MB/s 2024-09-11T22:18:34.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.267 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751395 s, 140 MB/s 2024-09-11T22:18:34.275 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.276 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.276 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756709 s, 139 MB/s 2024-09-11T22:18:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.284 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690782 s, 152 MB/s 2024-09-11T22:18:34.292 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.293 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.293 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662338 s, 158 MB/s 2024-09-11T22:18:34.301 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.301 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.302 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697085 s, 150 MB/s 2024-09-11T22:18:34.310 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.310 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.310 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645231 s, 163 MB/s 2024-09-11T22:18:34.318 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.319 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.319 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697881 s, 150 MB/s 2024-09-11T22:18:34.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.327 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.327 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632642 s, 166 MB/s 2024-09-11T22:18:34.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.336 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.336 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735798 s, 143 MB/s 2024-09-11T22:18:34.345 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.346 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.346 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842013 s, 125 MB/s 2024-09-11T22:18:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662511 s, 158 MB/s 2024-09-11T22:18:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:34.361 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:34.362 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:34.362 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.20 2024-09-11T22:18:34.362 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:34.362 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:34.362 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:34.362 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:34.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:34.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.424 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774392 s, 135 MB/s 2024-09-11T22:18:34.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.433 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670178 s, 156 MB/s 2024-09-11T22:18:34.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.442 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.442 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742517 s, 141 MB/s 2024-09-11T22:18:34.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.451 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.451 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726194 s, 144 MB/s 2024-09-11T22:18:34.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.460 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769805 s, 136 MB/s 2024-09-11T22:18:34.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.469 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757616 s, 138 MB/s 2024-09-11T22:18:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670647 s, 156 MB/s 2024-09-11T22:18:34.487 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.487 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.487 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754055 s, 139 MB/s 2024-09-11T22:18:34.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.496 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743579 s, 141 MB/s 2024-09-11T22:18:34.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.505 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738674 s, 142 MB/s 2024-09-11T22:18:34.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.514 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672903 s, 156 MB/s 2024-09-11T22:18:34.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.522 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666275 s, 157 MB/s 2024-09-11T22:18:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757811 s, 138 MB/s 2024-09-11T22:18:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767064 s, 137 MB/s 2024-09-11T22:18:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757142 s, 138 MB/s 2024-09-11T22:18:34.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690367 s, 152 MB/s 2024-09-11T22:18:34.568 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.568 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.568 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768794 s, 136 MB/s 2024-09-11T22:18:34.576 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.577 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673241 s, 156 MB/s 2024-09-11T22:18:34.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.586 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700079 s, 150 MB/s 2024-09-11T22:18:34.594 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.597 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.597 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697507 s, 150 MB/s 2024-09-11T22:18:34.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.603 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685533 s, 153 MB/s 2024-09-11T22:18:34.613 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.613 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.613 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769646 s, 136 MB/s 2024-09-11T22:18:34.622 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.622 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.623 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710774 s, 148 MB/s 2024-09-11T22:18:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759041 s, 138 MB/s 2024-09-11T22:18:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733297 s, 143 MB/s 2024-09-11T22:18:34.649 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.649 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.649 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660801 s, 159 MB/s 2024-09-11T22:18:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686882 s, 153 MB/s 2024-09-11T22:18:34.667 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.667 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.667 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721256 s, 145 MB/s 2024-09-11T22:18:34.676 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.676 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.676 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738791 s, 142 MB/s 2024-09-11T22:18:34.685 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.685 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.685 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073532 s, 143 MB/s 2024-09-11T22:18:34.692 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.693 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.693 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618932 s, 169 MB/s 2024-09-11T22:18:34.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.703 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838064 s, 125 MB/s 2024-09-11T22:18:34.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:34.709 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:34.710 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:34.710 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.21 2024-09-11T22:18:34.710 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:34.710 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:34.710 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:34.710 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:34.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718143 s, 146 MB/s 2024-09-11T22:18:34.779 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.780 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.780 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064403 s, 163 MB/s 2024-09-11T22:18:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747354 s, 140 MB/s 2024-09-11T22:18:34.796 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.796 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.797 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666704 s, 157 MB/s 2024-09-11T22:18:34.805 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.806 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.806 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727898 s, 144 MB/s 2024-09-11T22:18:34.816 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.816 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.816 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842552 s, 124 MB/s 2024-09-11T22:18:34.824 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.824 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.824 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661016 s, 159 MB/s 2024-09-11T22:18:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.832 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.833 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650008 s, 161 MB/s 2024-09-11T22:18:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636607 s, 165 MB/s 2024-09-11T22:18:34.849 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.849 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.849 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711212 s, 147 MB/s 2024-09-11T22:18:34.858 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.858 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.858 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694434 s, 151 MB/s 2024-09-11T22:18:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734058 s, 143 MB/s 2024-09-11T22:18:34.876 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.876 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.876 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751335 s, 140 MB/s 2024-09-11T22:18:34.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.885 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643221 s, 163 MB/s 2024-09-11T22:18:34.892 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.892 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.892 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640797 s, 164 MB/s 2024-09-11T22:18:34.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.900 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654888 s, 160 MB/s 2024-09-11T22:18:34.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.909 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672357 s, 156 MB/s 2024-09-11T22:18:34.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.918 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072021 s, 146 MB/s 2024-09-11T22:18:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762435 s, 138 MB/s 2024-09-11T22:18:34.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.936 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744216 s, 141 MB/s 2024-09-11T22:18:34.946 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.946 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.946 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077823 s, 135 MB/s 2024-09-11T22:18:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657277 s, 160 MB/s 2024-09-11T22:18:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649572 s, 161 MB/s 2024-09-11T22:18:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664564 s, 158 MB/s 2024-09-11T22:18:34.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.980 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073488 s, 143 MB/s 2024-09-11T22:18:34.988 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.988 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.989 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688574 s, 152 MB/s 2024-09-11T22:18:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:34.998 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:34.998 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763209 s, 137 MB/s 2024-09-11T22:18:35.007 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.007 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.007 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684797 s, 153 MB/s 2024-09-11T22:18:35.015 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.015 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.015 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068115 s, 154 MB/s 2024-09-11T22:18:35.024 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.024 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.024 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715359 s, 147 MB/s 2024-09-11T22:18:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00814024 s, 129 MB/s 2024-09-11T22:18:35.042 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.042 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.042 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067874 s, 154 MB/s 2024-09-11T22:18:35.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:35.049 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:35.049 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:35.049 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.22 2024-09-11T22:18:35.049 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:35.050 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:35.050 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:35.050 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:35.111 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.111 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.111 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068063 s, 154 MB/s 2024-09-11T22:18:35.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.120 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729703 s, 144 MB/s 2024-09-11T22:18:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071756 s, 146 MB/s 2024-09-11T22:18:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667043 s, 157 MB/s 2024-09-11T22:18:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738705 s, 142 MB/s 2024-09-11T22:18:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.156 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715197 s, 147 MB/s 2024-09-11T22:18:35.165 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.165 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.165 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735587 s, 143 MB/s 2024-09-11T22:18:35.174 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.174 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.174 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007458 s, 141 MB/s 2024-09-11T22:18:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649275 s, 161 MB/s 2024-09-11T22:18:35.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.191 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706138 s, 148 MB/s 2024-09-11T22:18:35.199 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.199 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.199 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663884 s, 158 MB/s 2024-09-11T22:18:35.208 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.208 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.208 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717235 s, 146 MB/s 2024-09-11T22:18:35.217 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.218 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.218 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007543 s, 139 MB/s 2024-09-11T22:18:35.227 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.227 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.227 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743172 s, 141 MB/s 2024-09-11T22:18:35.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.236 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748227 s, 140 MB/s 2024-09-11T22:18:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687912 s, 152 MB/s 2024-09-11T22:18:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748825 s, 140 MB/s 2024-09-11T22:18:35.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.263 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704863 s, 149 MB/s 2024-09-11T22:18:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.272 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688245 s, 152 MB/s 2024-09-11T22:18:35.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.280 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735019 s, 143 MB/s 2024-09-11T22:18:35.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.289 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681591 s, 154 MB/s 2024-09-11T22:18:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641476 s, 163 MB/s 2024-09-11T22:18:35.306 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.307 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779006 s, 135 MB/s 2024-09-11T22:18:35.317 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.317 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.317 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00893025 s, 117 MB/s 2024-09-11T22:18:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736363 s, 142 MB/s 2024-09-11T22:18:35.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007279 s, 144 MB/s 2024-09-11T22:18:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.345 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746749 s, 140 MB/s 2024-09-11T22:18:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.354 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740083 s, 142 MB/s 2024-09-11T22:18:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.362 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673138 s, 156 MB/s 2024-09-11T22:18:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717036 s, 146 MB/s 2024-09-11T22:18:35.381 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.381 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.381 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759783 s, 138 MB/s 2024-09-11T22:18:35.391 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.391 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.391 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870974 s, 120 MB/s 2024-09-11T22:18:35.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:35.399 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:35.399 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:35.399 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.23 2024-09-11T22:18:35.400 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:35.400 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:35.400 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:35.400 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:35.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.513 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.513 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740623 s, 142 MB/s 2024-09-11T22:18:35.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.521 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627101 s, 167 MB/s 2024-09-11T22:18:35.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.529 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671111 s, 156 MB/s 2024-09-11T22:18:35.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.537 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667754 s, 157 MB/s 2024-09-11T22:18:35.546 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.546 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.546 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671253 s, 156 MB/s 2024-09-11T22:18:35.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.554 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668545 s, 157 MB/s 2024-09-11T22:18:35.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.564 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084889 s, 124 MB/s 2024-09-11T22:18:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709124 s, 148 MB/s 2024-09-11T22:18:35.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.582 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710375 s, 148 MB/s 2024-09-11T22:18:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.591 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660218 s, 159 MB/s 2024-09-11T22:18:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.599 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691958 s, 152 MB/s 2024-09-11T22:18:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731523 s, 143 MB/s 2024-09-11T22:18:35.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.618 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.618 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711119 s, 147 MB/s 2024-09-11T22:18:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.626 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658222 s, 159 MB/s 2024-09-11T22:18:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743844 s, 141 MB/s 2024-09-11T22:18:35.644 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.644 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.644 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676226 s, 155 MB/s 2024-09-11T22:18:35.652 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.652 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.652 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677094 s, 155 MB/s 2024-09-11T22:18:35.661 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.661 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.662 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744115 s, 141 MB/s 2024-09-11T22:18:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714164 s, 147 MB/s 2024-09-11T22:18:35.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.679 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738691 s, 142 MB/s 2024-09-11T22:18:35.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.689 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070223 s, 149 MB/s 2024-09-11T22:18:35.697 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.697 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.697 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709146 s, 148 MB/s 2024-09-11T22:18:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737493 s, 142 MB/s 2024-09-11T22:18:35.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.715 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642631 s, 163 MB/s 2024-09-11T22:18:35.723 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.723 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.723 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694326 s, 151 MB/s 2024-09-11T22:18:35.732 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.732 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.732 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737846 s, 142 MB/s 2024-09-11T22:18:35.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.741 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068843 s, 152 MB/s 2024-09-11T22:18:35.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.750 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073589 s, 142 MB/s 2024-09-11T22:18:35.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.759 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676288 s, 155 MB/s 2024-09-11T22:18:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653392 s, 160 MB/s 2024-09-11T22:18:35.775 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.775 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.775 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758834 s, 138 MB/s 2024-09-11T22:18:35.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.784 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696714 s, 151 MB/s 2024-09-11T22:18:35.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:35.791 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:35.791 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:35.791 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.24 2024-09-11T22:18:35.791 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:35.791 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:35.791 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:35.791 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:35.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:35.852 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.852 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.852 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748437 s, 140 MB/s 2024-09-11T22:18:35.861 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.861 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.861 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743366 s, 141 MB/s 2024-09-11T22:18:35.870 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.870 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.870 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670138 s, 156 MB/s 2024-09-11T22:18:35.878 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.878 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.878 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697194 s, 150 MB/s 2024-09-11T22:18:35.888 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.888 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.888 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072426 s, 145 MB/s 2024-09-11T22:18:35.897 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.897 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.897 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724865 s, 145 MB/s 2024-09-11T22:18:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659213 s, 159 MB/s 2024-09-11T22:18:35.914 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.914 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.914 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689667 s, 152 MB/s 2024-09-11T22:18:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719668 s, 146 MB/s 2024-09-11T22:18:35.932 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.933 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.933 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727545 s, 144 MB/s 2024-09-11T22:18:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.942 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781339 s, 134 MB/s 2024-09-11T22:18:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713554 s, 147 MB/s 2024-09-11T22:18:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726409 s, 144 MB/s 2024-09-11T22:18:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673667 s, 156 MB/s 2024-09-11T22:18:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.977 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675959 s, 155 MB/s 2024-09-11T22:18:35.985 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.986 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.986 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697367 s, 150 MB/s 2024-09-11T22:18:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734189 s, 143 MB/s 2024-09-11T22:18:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637552 s, 164 MB/s 2024-09-11T22:18:36.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.012 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703217 s, 149 MB/s 2024-09-11T22:18:36.020 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.020 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.021 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666655 s, 157 MB/s 2024-09-11T22:18:36.029 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.029 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.029 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731024 s, 143 MB/s 2024-09-11T22:18:36.038 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.038 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.038 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676303 s, 155 MB/s 2024-09-11T22:18:36.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.047 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734196 s, 143 MB/s 2024-09-11T22:18:36.056 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.056 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.056 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677991 s, 155 MB/s 2024-09-11T22:18:36.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.065 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745281 s, 141 MB/s 2024-09-11T22:18:36.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.074 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666137 s, 157 MB/s 2024-09-11T22:18:36.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.083 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745196 s, 141 MB/s 2024-09-11T22:18:36.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.093 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.093 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765507 s, 137 MB/s 2024-09-11T22:18:36.100 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.101 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641664 s, 163 MB/s 2024-09-11T22:18:36.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.109 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670648 s, 156 MB/s 2024-09-11T22:18:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063925 s, 164 MB/s 2024-09-11T22:18:36.126 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.126 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.126 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682759 s, 154 MB/s 2024-09-11T22:18:36.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:36.133 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:36.133 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:36.133 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.25 2024-09-11T22:18:36.133 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:36.133 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:36.133 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:36.133 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:36.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071435 s, 147 MB/s 2024-09-11T22:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641692 s, 163 MB/s 2024-09-11T22:18:36.211 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.211 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.211 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749065 s, 140 MB/s 2024-09-11T22:18:36.220 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.220 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.220 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767354 s, 137 MB/s 2024-09-11T22:18:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693245 s, 151 MB/s 2024-09-11T22:18:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.237 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658102 s, 159 MB/s 2024-09-11T22:18:36.246 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.246 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.246 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735728 s, 143 MB/s 2024-09-11T22:18:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.256 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774273 s, 135 MB/s 2024-09-11T22:18:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.264 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670601 s, 156 MB/s 2024-09-11T22:18:36.273 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.273 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.273 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660802 s, 159 MB/s 2024-09-11T22:18:36.282 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.282 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.283 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00807954 s, 130 MB/s 2024-09-11T22:18:36.291 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.292 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.292 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734041 s, 143 MB/s 2024-09-11T22:18:36.301 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.301 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.301 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757543 s, 138 MB/s 2024-09-11T22:18:36.309 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.309 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.309 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660101 s, 159 MB/s 2024-09-11T22:18:36.317 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.318 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.318 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664485 s, 158 MB/s 2024-09-11T22:18:36.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.326 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652803 s, 161 MB/s 2024-09-11T22:18:36.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.335 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732122 s, 143 MB/s 2024-09-11T22:18:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071871 s, 146 MB/s 2024-09-11T22:18:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.353 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007391 s, 142 MB/s 2024-09-11T22:18:36.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.362 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751983 s, 139 MB/s 2024-09-11T22:18:36.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.371 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715348 s, 147 MB/s 2024-09-11T22:18:36.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.380 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690987 s, 152 MB/s 2024-09-11T22:18:36.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.389 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715837 s, 146 MB/s 2024-09-11T22:18:36.398 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.398 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.398 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716183 s, 146 MB/s 2024-09-11T22:18:36.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.406 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069323 s, 151 MB/s 2024-09-11T22:18:36.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.416 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739579 s, 142 MB/s 2024-09-11T22:18:36.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.424 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657206 s, 160 MB/s 2024-09-11T22:18:36.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.433 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673577 s, 156 MB/s 2024-09-11T22:18:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647646 s, 162 MB/s 2024-09-11T22:18:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714456 s, 147 MB/s 2024-09-11T22:18:36.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.458 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687511 s, 153 MB/s 2024-09-11T22:18:36.468 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.468 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.468 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781809 s, 134 MB/s 2024-09-11T22:18:36.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:36.475 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:36.475 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:36.475 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.26 2024-09-11T22:18:36.475 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:36.475 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:36.475 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:36.475 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:36.534 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.535 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.535 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624296 s, 168 MB/s 2024-09-11T22:18:36.544 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.544 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.544 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782006 s, 134 MB/s 2024-09-11T22:18:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.554 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792926 s, 132 MB/s 2024-09-11T22:18:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.562 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657173 s, 160 MB/s 2024-09-11T22:18:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712708 s, 147 MB/s 2024-09-11T22:18:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688684 s, 152 MB/s 2024-09-11T22:18:36.588 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.588 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.588 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646374 s, 162 MB/s 2024-09-11T22:18:36.597 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.597 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.597 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753308 s, 139 MB/s 2024-09-11T22:18:36.607 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.607 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.607 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784198 s, 134 MB/s 2024-09-11T22:18:36.616 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.616 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.616 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705115 s, 149 MB/s 2024-09-11T22:18:36.624 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.625 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721301 s, 145 MB/s 2024-09-11T22:18:36.634 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.634 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.634 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763003 s, 137 MB/s 2024-09-11T22:18:36.642 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.643 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068776 s, 152 MB/s 2024-09-11T22:18:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747942 s, 140 MB/s 2024-09-11T22:18:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.661 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746499 s, 140 MB/s 2024-09-11T22:18:36.669 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.669 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.669 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658504 s, 159 MB/s 2024-09-11T22:18:36.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.677 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657441 s, 159 MB/s 2024-09-11T22:18:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.686 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669282 s, 157 MB/s 2024-09-11T22:18:36.694 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.695 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.695 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693337 s, 151 MB/s 2024-09-11T22:18:36.704 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.704 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.704 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803247 s, 131 MB/s 2024-09-11T22:18:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708939 s, 148 MB/s 2024-09-11T22:18:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800697 s, 131 MB/s 2024-09-11T22:18:36.731 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683476 s, 153 MB/s 2024-09-11T22:18:36.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.740 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637155 s, 165 MB/s 2024-09-11T22:18:36.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.749 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723015 s, 145 MB/s 2024-09-11T22:18:36.757 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.758 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690533 s, 152 MB/s 2024-09-11T22:18:36.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.766 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683681 s, 153 MB/s 2024-09-11T22:18:36.774 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.774 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.774 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065329 s, 161 MB/s 2024-09-11T22:18:36.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.784 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798492 s, 131 MB/s 2024-09-11T22:18:36.793 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.793 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.793 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694735 s, 151 MB/s 2024-09-11T22:18:36.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.802 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676499 s, 155 MB/s 2024-09-11T22:18:36.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.812 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844029 s, 124 MB/s 2024-09-11T22:18:36.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:36.819 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:36.820 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:36.820 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.27 2024-09-11T22:18:36.820 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:36.820 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:36.820 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:36.820 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:36.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:36.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.881 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646362 s, 162 MB/s 2024-09-11T22:18:36.890 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.890 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.890 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835397 s, 126 MB/s 2024-09-11T22:18:36.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.900 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763659 s, 137 MB/s 2024-09-11T22:18:36.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.908 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667117 s, 157 MB/s 2024-09-11T22:18:36.917 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.917 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.917 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690905 s, 152 MB/s 2024-09-11T22:18:36.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.927 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882081 s, 119 MB/s 2024-09-11T22:18:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738386 s, 142 MB/s 2024-09-11T22:18:36.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.946 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703866 s, 149 MB/s 2024-09-11T22:18:36.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.954 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689662 s, 152 MB/s 2024-09-11T22:18:36.964 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.964 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.964 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736498 s, 142 MB/s 2024-09-11T22:18:36.973 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.973 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.973 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733196 s, 143 MB/s 2024-09-11T22:18:36.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.981 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652016 s, 161 MB/s 2024-09-11T22:18:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712272 s, 147 MB/s 2024-09-11T22:18:37.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.000 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00794013 s, 132 MB/s 2024-09-11T22:18:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742023 s, 141 MB/s 2024-09-11T22:18:37.018 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.018 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.018 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753808 s, 139 MB/s 2024-09-11T22:18:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658121 s, 159 MB/s 2024-09-11T22:18:37.035 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.035 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.035 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719181 s, 146 MB/s 2024-09-11T22:18:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.045 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752566 s, 139 MB/s 2024-09-11T22:18:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658464 s, 159 MB/s 2024-09-11T22:18:37.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.062 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721167 s, 145 MB/s 2024-09-11T22:18:37.071 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.072 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.072 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774127 s, 135 MB/s 2024-09-11T22:18:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738152 s, 142 MB/s 2024-09-11T22:18:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067912 s, 154 MB/s 2024-09-11T22:18:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642671 s, 163 MB/s 2024-09-11T22:18:37.106 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.107 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.107 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739097 s, 142 MB/s 2024-09-11T22:18:37.116 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.116 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.116 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763204 s, 137 MB/s 2024-09-11T22:18:37.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.125 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739793 s, 142 MB/s 2024-09-11T22:18:37.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.135 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757417 s, 138 MB/s 2024-09-11T22:18:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737142 s, 142 MB/s 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.152 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636896 s, 165 MB/s 2024-09-11T22:18:37.160 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.160 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.160 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673239 s, 156 MB/s 2024-09-11T22:18:37.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:37.166 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:37.167 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:37.167 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.28 2024-09-11T22:18:37.167 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:37.167 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:37.167 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:37.167 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:37.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:37.227 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.227 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.227 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649114 s, 162 MB/s 2024-09-11T22:18:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793507 s, 132 MB/s 2024-09-11T22:18:37.245 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.245 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.245 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643891 s, 163 MB/s 2024-09-11T22:18:37.254 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.254 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.254 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760465 s, 138 MB/s 2024-09-11T22:18:37.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.262 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656716 s, 160 MB/s 2024-09-11T22:18:37.270 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.270 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.270 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655423 s, 160 MB/s 2024-09-11T22:18:37.279 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.279 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.280 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773428 s, 136 MB/s 2024-09-11T22:18:37.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.289 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731597 s, 143 MB/s 2024-09-11T22:18:37.298 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.298 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.299 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796632 s, 132 MB/s 2024-09-11T22:18:37.306 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.307 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636525 s, 165 MB/s 2024-09-11T22:18:37.315 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.315 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.315 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710203 s, 148 MB/s 2024-09-11T22:18:37.324 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.324 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.325 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743089 s, 141 MB/s 2024-09-11T22:18:37.334 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.334 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.334 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741738 s, 141 MB/s 2024-09-11T22:18:37.343 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.343 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.343 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759867 s, 138 MB/s 2024-09-11T22:18:37.352 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.353 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716246 s, 146 MB/s 2024-09-11T22:18:37.361 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.361 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.361 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066644 s, 157 MB/s 2024-09-11T22:18:37.369 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.369 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.370 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066973 s, 157 MB/s 2024-09-11T22:18:37.378 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.378 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.378 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730339 s, 144 MB/s 2024-09-11T22:18:37.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.388 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781839 s, 134 MB/s 2024-09-11T22:18:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742253 s, 141 MB/s 2024-09-11T22:18:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077272 s, 136 MB/s 2024-09-11T22:18:37.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.416 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763222 s, 137 MB/s 2024-09-11T22:18:37.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.424 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636306 s, 165 MB/s 2024-09-11T22:18:37.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.433 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741322 s, 141 MB/s 2024-09-11T22:18:37.442 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.442 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.442 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066572 s, 158 MB/s 2024-09-11T22:18:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731987 s, 143 MB/s 2024-09-11T22:18:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734359 s, 143 MB/s 2024-09-11T22:18:37.468 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.468 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.469 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686327 s, 153 MB/s 2024-09-11T22:18:37.477 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.478 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746849 s, 140 MB/s 2024-09-11T22:18:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.487 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669509 s, 157 MB/s 2024-09-11T22:18:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737514 s, 142 MB/s 2024-09-11T22:18:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797447 s, 131 MB/s 2024-09-11T22:18:37.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:37.512 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:37.512 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:37.512 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.29 2024-09-11T22:18:37.512 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:37.513 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:37.513 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:37.513 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:37.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:37.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.573 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733424 s, 143 MB/s 2024-09-11T22:18:37.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.583 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778192 s, 135 MB/s 2024-09-11T22:18:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066372 s, 158 MB/s 2024-09-11T22:18:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.601 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772382 s, 136 MB/s 2024-09-11T22:18:37.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.609 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689749 s, 152 MB/s 2024-09-11T22:18:37.618 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.618 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.618 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653663 s, 160 MB/s 2024-09-11T22:18:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648581 s, 162 MB/s 2024-09-11T22:18:37.635 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.636 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.636 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778456 s, 135 MB/s 2024-09-11T22:18:37.644 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.644 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.644 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695632 s, 151 MB/s 2024-09-11T22:18:37.653 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.653 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.653 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651844 s, 161 MB/s 2024-09-11T22:18:37.662 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.662 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.662 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074095 s, 142 MB/s 2024-09-11T22:18:37.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.671 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718547 s, 146 MB/s 2024-09-11T22:18:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663577 s, 158 MB/s 2024-09-11T22:18:37.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.689 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693715 s, 151 MB/s 2024-09-11T22:18:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691113 s, 152 MB/s 2024-09-11T22:18:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.706 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069846 s, 150 MB/s 2024-09-11T22:18:37.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.715 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728618 s, 144 MB/s 2024-09-11T22:18:37.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.724 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708039 s, 148 MB/s 2024-09-11T22:18:37.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.733 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731379 s, 143 MB/s 2024-09-11T22:18:37.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.742 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699662 s, 150 MB/s 2024-09-11T22:18:37.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.751 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714924 s, 147 MB/s 2024-09-11T22:18:37.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.760 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718116 s, 146 MB/s 2024-09-11T22:18:37.769 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.769 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.769 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719116 s, 146 MB/s 2024-09-11T22:18:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.778 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.778 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069615 s, 151 MB/s 2024-09-11T22:18:37.786 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710612 s, 148 MB/s 2024-09-11T22:18:37.796 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.796 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.796 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783446 s, 134 MB/s 2024-09-11T22:18:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.805 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693852 s, 151 MB/s 2024-09-11T22:18:37.815 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.815 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.815 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830747 s, 126 MB/s 2024-09-11T22:18:37.824 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.824 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.824 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680698 s, 154 MB/s 2024-09-11T22:18:37.833 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.834 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.834 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780779 s, 134 MB/s 2024-09-11T22:18:37.843 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.843 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.843 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074211 s, 141 MB/s 2024-09-11T22:18:37.851 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.851 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.851 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674294 s, 156 MB/s 2024-09-11T22:18:37.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:37.858 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:37.858 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:37.858 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.30 2024-09-11T22:18:37.858 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:37.858 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:37.858 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:37.859 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:37.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.918 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633319 s, 166 MB/s 2024-09-11T22:18:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.926 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611123 s, 172 MB/s 2024-09-11T22:18:37.934 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.934 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.934 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724503 s, 145 MB/s 2024-09-11T22:18:37.944 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.944 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.944 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749794 s, 140 MB/s 2024-09-11T22:18:37.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.953 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742297 s, 141 MB/s 2024-09-11T22:18:37.961 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.962 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066144 s, 159 MB/s 2024-09-11T22:18:37.970 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.970 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.970 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662814 s, 158 MB/s 2024-09-11T22:18:37.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.978 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671869 s, 156 MB/s 2024-09-11T22:18:37.986 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.987 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.987 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628541 s, 167 MB/s 2024-09-11T22:18:37.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:37.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:37.995 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731089 s, 143 MB/s 2024-09-11T22:18:38.004 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.004 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.004 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691361 s, 152 MB/s 2024-09-11T22:18:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661639 s, 158 MB/s 2024-09-11T22:18:38.022 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.022 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.022 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00821701 s, 128 MB/s 2024-09-11T22:18:38.031 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.031 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.031 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687541 s, 153 MB/s 2024-09-11T22:18:38.040 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.040 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.040 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687972 s, 152 MB/s 2024-09-11T22:18:38.049 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.049 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.049 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725362 s, 145 MB/s 2024-09-11T22:18:38.058 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.058 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.058 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069979 s, 150 MB/s 2024-09-11T22:18:38.066 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.067 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.067 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662784 s, 158 MB/s 2024-09-11T22:18:38.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.076 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.076 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733561 s, 143 MB/s 2024-09-11T22:18:38.084 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.084 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.084 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693557 s, 151 MB/s 2024-09-11T22:18:38.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.094 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746271 s, 141 MB/s 2024-09-11T22:18:38.102 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.102 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.102 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654866 s, 160 MB/s 2024-09-11T22:18:38.111 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.111 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.111 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753531 s, 139 MB/s 2024-09-11T22:18:38.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.120 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703034 s, 149 MB/s 2024-09-11T22:18:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.129 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687955 s, 152 MB/s 2024-09-11T22:18:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.138 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687807 s, 152 MB/s 2024-09-11T22:18:38.146 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.146 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.146 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655894 s, 160 MB/s 2024-09-11T22:18:38.155 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.155 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.155 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712965 s, 147 MB/s 2024-09-11T22:18:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.164 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706257 s, 148 MB/s 2024-09-11T22:18:38.173 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.173 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.173 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723602 s, 145 MB/s 2024-09-11T22:18:38.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.182 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720784 s, 145 MB/s 2024-09-11T22:18:38.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.192 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076651 s, 137 MB/s 2024-09-11T22:18:38.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:38.198 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:18:38.198 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:18:38.198 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.31 2024-09-11T22:18:38.198 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:18:38.199 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:18:38.199 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:18:38.199 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:18:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:18:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762459 s, 138 MB/s 2024-09-11T22:18:38.267 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.268 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645837 s, 162 MB/s 2024-09-11T22:18:38.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.277 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719221 s, 146 MB/s 2024-09-11T22:18:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646593 s, 162 MB/s 2024-09-11T22:18:38.294 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.294 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.294 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725353 s, 145 MB/s 2024-09-11T22:18:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.303 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068428 s, 153 MB/s 2024-09-11T22:18:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.312 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729945 s, 144 MB/s 2024-09-11T22:18:38.320 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.320 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.320 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640164 s, 164 MB/s 2024-09-11T22:18:38.329 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.329 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.329 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751578 s, 140 MB/s 2024-09-11T22:18:38.338 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.338 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.338 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660168 s, 159 MB/s 2024-09-11T22:18:38.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.347 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760293 s, 138 MB/s 2024-09-11T22:18:38.356 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.356 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.356 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692757 s, 151 MB/s 2024-09-11T22:18:38.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.365 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712024 s, 147 MB/s 2024-09-11T22:18:38.374 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.374 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.374 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660481 s, 159 MB/s 2024-09-11T22:18:38.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.383 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711495 s, 147 MB/s 2024-09-11T22:18:38.392 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.393 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740732 s, 142 MB/s 2024-09-11T22:18:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746245 s, 141 MB/s 2024-09-11T22:18:38.410 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.411 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.411 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664777 s, 158 MB/s 2024-09-11T22:18:38.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.419 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657473 s, 159 MB/s 2024-09-11T22:18:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679333 s, 154 MB/s 2024-09-11T22:18:38.436 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.436 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.436 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673181 s, 156 MB/s 2024-09-11T22:18:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735529 s, 143 MB/s 2024-09-11T22:18:38.453 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.453 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.453 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664971 s, 158 MB/s 2024-09-11T22:18:38.462 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.462 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.462 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675115 s, 155 MB/s 2024-09-11T22:18:38.472 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.472 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.472 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766847 s, 137 MB/s 2024-09-11T22:18:38.480 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.480 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.481 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704463 s, 149 MB/s 2024-09-11T22:18:38.489 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.489 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.489 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070786 s, 148 MB/s 2024-09-11T22:18:38.498 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.499 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.499 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732123 s, 143 MB/s 2024-09-11T22:18:38.508 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.508 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.508 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726942 s, 144 MB/s 2024-09-11T22:18:38.517 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.517 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.517 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723418 s, 145 MB/s 2024-09-11T22:18:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737888 s, 142 MB/s 2024-09-11T22:18:38.535 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:18:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:18:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744429 s, 141 MB/s 2024-09-11T22:18:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:18:38.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:38.542 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-09-11T22:18:38.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.648+0000 7fc662ed0640 1 Processor -- start 2024-09-11T22:18:38.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.648+0000 7fc662ed0640 1 -- start start 2024-09-11T22:18:38.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.649+0000 7fc662ed0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc65c06ff20 0x7fc65c15eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.649+0000 7fc662ed0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc65c159050 con 0x7fc65c0afe10 2024-09-11T22:18:38.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.649+0000 7fc662ed0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc65c0ae8c0 con 0x7fc65c0b2590 2024-09-11T22:18:38.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.649+0000 7fc662ed0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc65c070300 con 0x7fc65c06ff20 2024-09-11T22:18:38.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.649+0000 7fc660c6c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc65c06ff20 0x7fc65c15eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.649+0000 7fc65bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc65c0afe10 0x7fc65c0b1e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58820/0 (socket says 172.21.15.50:58820) 2024-09-11T22:18:38.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.649+0000 7fc660c6c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc65c06ff20 0x7fc65c15eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60806/0 (socket says 172.21.15.50:60806) 2024-09-11T22:18:38.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.649+0000 7fc65bfff640 1 -- 172.21.15.50:0/3750377164 learned_addr learned my addr 172.21.15.50:0/3750377164 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:38.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.649+0000 7fc660c6c640 1 -- 172.21.15.50:0/3750377164 >> v1:172.21.15.77:6789/0 conn(0x7fc65c0b2590 legacy=0x7fc65c162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.649+0000 7fc660c6c640 1 -- 172.21.15.50:0/3750377164 >> v1:172.21.15.50:6789/0 conn(0x7fc65c0afe10 legacy=0x7fc65c0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.649+0000 7fc660c6c640 1 -- 172.21.15.50:0/3750377164 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc65c0aeba0 con 0x7fc65c06ff20 2024-09-11T22:18:38.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.649+0000 7fc65b7fe640 1 -- 172.21.15.50:0/3750377164 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3723443591 0 0) 0x7fc648001110 con 0x7fc65c0afe10 2024-09-11T22:18:38.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.650+0000 7fc660c6c640 1 --2- 172.21.15.50:0/3750377164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc65c06ff20 0x7fc65c15eb70 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc6500097d0 tx=0x7fc65002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8805c58a45c4574 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.650+0000 7fc65b7fe640 1 -- 172.21.15.50:0/3750377164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc650037070 con 0x7fc65c06ff20 2024-09-11T22:18:38.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.650+0000 7fc65b7fe640 1 -- 172.21.15.50:0/3750377164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc650032440 con 0x7fc65c06ff20 2024-09-11T22:18:38.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.650+0000 7fc65b7fe640 1 -- 172.21.15.50:0/3750377164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc650032810 con 0x7fc65c06ff20 2024-09-11T22:18:38.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.651+0000 7fc662ed0640 1 -- 172.21.15.50:0/3750377164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc65c06ff20 msgr2=0x7fc65c15eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.651+0000 7fc662ed0640 1 --2- 172.21.15.50:0/3750377164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc65c06ff20 0x7fc65c15eb70 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc6500097d0 tx=0x7fc65002a1c0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.651+0000 7fc662ed0640 1 -- 172.21.15.50:0/3750377164 shutdown_connections 2024-09-11T22:18:38.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.651+0000 7fc662ed0640 1 --2- 172.21.15.50:0/3750377164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc65c06ff20 0x7fc65c15eb70 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.651+0000 7fc662ed0640 1 -- 172.21.15.50:0/3750377164 >> 172.21.15.50:0/3750377164 conn(0x7fc65c0b0a60 msgr2=0x7fc65c073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.651+0000 7fc662ed0640 1 -- 172.21.15.50:0/3750377164 shutdown_connections 2024-09-11T22:18:38.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.651+0000 7fc662ed0640 1 -- 172.21.15.50:0/3750377164 wait complete. 2024-09-11T22:18:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.652+0000 7fc662ed0640 1 Processor -- start 2024-09-11T22:18:38.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.652+0000 7fc662ed0640 1 -- start start 2024-09-11T22:18:38.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc662ed0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc65c06ff20 0x7fc65c155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc662ed0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc65c0afe10 0x7fc65c0b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc662ed0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc65c0b2590 0x7fc65c1471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc662ed0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc65c0af440 con 0x7fc65c0afe10 2024-09-11T22:18:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc662ed0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc65c0af160 con 0x7fc65c06ff20 2024-09-11T22:18:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc662ed0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc65c0af720 con 0x7fc65c0b2590 2024-09-11T22:18:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc65bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc65c0afe10 0x7fc65c0b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc65bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc65c0afe10 0x7fc65c0b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60820/0 (socket says 172.21.15.50:60820) 2024-09-11T22:18:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc65bfff640 1 -- 172.21.15.50:0/2341399289 learned_addr learned my addr 172.21.15.50:0/2341399289 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc660c6c640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc65c06ff20 0x7fc65c155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc66146d640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc65c0b2590 0x7fc65c1471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc65bfff640 1 -- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc65c0b2590 msgr2=0x7fc65c1471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc65bfff640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc65c0b2590 0x7fc65c1471f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc65bfff640 1 -- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc65c06ff20 msgr2=0x7fc65c155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc65bfff640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc65c06ff20 0x7fc65c155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.653+0000 7fc65bfff640 1 -- 172.21.15.50:0/2341399289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc65c0cd670 con 0x7fc65c0afe10 2024-09-11T22:18:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.654+0000 7fc65bfff640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc65c0afe10 0x7fc65c0b10b0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc64800c780 tx=0x7fc64800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.654+0000 7fc6597fa640 1 -- 172.21.15.50:0/2341399289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc648018070 con 0x7fc65c0afe10 2024-09-11T22:18:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.654+0000 7fc6597fa640 1 -- 172.21.15.50:0/2341399289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6480072d0 con 0x7fc65c0afe10 2024-09-11T22:18:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.654+0000 7fc662ed0640 1 -- 172.21.15.50:0/2341399289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc65c0cd950 con 0x7fc65c0afe10 2024-09-11T22:18:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.654+0000 7fc6597fa640 1 -- 172.21.15.50:0/2341399289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6480047e0 con 0x7fc65c0afe10 2024-09-11T22:18:38.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.654+0000 7fc662ed0640 1 -- 172.21.15.50:0/2341399289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc65c0ce1f0 con 0x7fc65c0afe10 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.655+0000 7fc6597fa640 1 -- 172.21.15.50:0/2341399289 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc64801b070 con 0x7fc65c0afe10 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.656+0000 7fc6597fa640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc64006be30 0x7fc64006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.656+0000 7fc6597fa640 1 -- 172.21.15.50:0/2341399289 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fc64808a080 con 0x7fc65c0afe10 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.656+0000 7fc660c6c640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc64006be30 0x7fc64006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.657+0000 7fc665c66740 1 Processor -- start 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.657+0000 7fc660c6c640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc64006be30 0x7fc64006e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc650034000 tx=0x7fc65002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.657+0000 7fc665c66740 1 -- start start 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.657+0000 7fc665c66740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c23a70 0x558ef9c23e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.657+0000 7fc665c66740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c0a1f0 0x558ef9c08a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.657+0000 7fc665c66740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c54420 0x558ef9c54970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.657+0000 7fc665c66740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558ef9b71bc0 con 0x558ef9c0a1f0 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.657+0000 7fc665c66740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558ef9b19970 con 0x558ef9c23a70 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.657+0000 7fc665c66740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558ef9b6db80 con 0x558ef9c54420 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc65bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c0a1f0 0x558ef9c08a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc660c6c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c23a70 0x558ef9c23e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc65bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c0a1f0 0x558ef9c08a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60822/0 (socket says 172.21.15.50:60822) 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc66146d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c54420 0x558ef9c54970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc65bfff640 1 -- 172.21.15.50:0/3753778003 learned_addr learned my addr 172.21.15.50:0/3753778003 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc660c6c640 1 --2- 172.21.15.50:0/3753778003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c23a70 0x558ef9c23e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54728/0 (socket says 172.21.15.50:54728) 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc65bfff640 1 -- 172.21.15.50:0/3753778003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c54420 msgr2=0x558ef9c54970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc65bfff640 1 --2- 172.21.15.50:0/3753778003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c54420 0x558ef9c54970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc65bfff640 1 -- 172.21.15.50:0/3753778003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c23a70 msgr2=0x558ef9c23e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc65bfff640 1 --2- 172.21.15.50:0/3753778003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c23a70 0x558ef9c23e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc65bfff640 1 -- 172.21.15.50:0/3753778003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef9950ba0 con 0x558ef9c0a1f0 2024-09-11T22:18:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc65bfff640 1 --2- 172.21.15.50:0/3753778003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c0a1f0 0x558ef9c08a50 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc6480885b0 tx=0x7fc648007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e158dd3b9fcc2e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc6467fc640 1 -- 172.21.15.50:0/3753778003 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc648060fa0 con 0x558ef9c0a1f0 2024-09-11T22:18:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc6467fc640 1 -- 172.21.15.50:0/3753778003 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc648056770 con 0x558ef9c0a1f0 2024-09-11T22:18:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.658+0000 7fc6467fc640 1 -- 172.21.15.50:0/3753778003 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc648070170 con 0x558ef9c0a1f0 2024-09-11T22:18:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.659+0000 7fc665c66740 1 -- 172.21.15.50:0/3753778003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c0a1f0 msgr2=0x558ef9c08a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.659+0000 7fc665c66740 1 --2- 172.21.15.50:0/3753778003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c0a1f0 0x558ef9c08a50 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc6480885b0 tx=0x7fc648007d00 comp rx=0 tx=0).stop 2024-09-11T22:18:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.659+0000 7fc665c66740 1 -- 172.21.15.50:0/3753778003 shutdown_connections 2024-09-11T22:18:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.659+0000 7fc665c66740 1 --2- 172.21.15.50:0/3753778003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c54420 0x558ef9c54970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.659+0000 7fc665c66740 1 --2- 172.21.15.50:0/3753778003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c0a1f0 0x558ef9c08a50 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.659+0000 7fc665c66740 1 --2- 172.21.15.50:0/3753778003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c23a70 0x558ef9c23e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.659+0000 7fc665c66740 1 -- 172.21.15.50:0/3753778003 >> 172.21.15.50:0/3753778003 conn(0x558ef9c0ac20 msgr2=0x558ef9c52fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.659+0000 7fc665c66740 1 -- 172.21.15.50:0/3753778003 shutdown_connections 2024-09-11T22:18:38.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.659+0000 7fc665c66740 1 -- 172.21.15.50:0/3753778003 wait complete. 2024-09-11T22:18:38.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.659+0000 7fc665c66740 1 -- start start 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.660+0000 7fc665c66740 1 Processor -- start 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.660+0000 7fc665c66740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c23a70 0x558ef9c491c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.660+0000 7fc665c66740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c54420 0x558ef9c66690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.660+0000 7fc665c66740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 0x558ef9c66bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.660+0000 7fc665c66740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558ef9c09150 con 0x558ef9c383b0 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.660+0000 7fc665c66740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558ef9b2cd70 con 0x558ef9c23a70 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.660+0000 7fc665c66740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558ef9c09430 con 0x558ef9c54420 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.660+0000 7fc665c66740 10 client.0 _ll_register_callbacks cb 0x558ef9883f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.660+0000 7fc66146d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 0x558ef9c66bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.660+0000 7fc660c6c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c23a70 0x558ef9c491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.660+0000 7fc66146d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 0x558ef9c66bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60832/0 (socket says 172.21.15.50:60832) 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.660+0000 7fc65bfff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c54420 0x558ef9c66690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.660+0000 7fc66146d640 1 -- 172.21.15.50:0/249550806 learned_addr learned my addr 172.21.15.50:0/249550806 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc66146d640 1 -- 172.21.15.50:0/249550806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c54420 msgr2=0x558ef9c66690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc66146d640 1 --2- 172.21.15.50:0/249550806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c54420 0x558ef9c66690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc66146d640 1 -- 172.21.15.50:0/249550806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c23a70 msgr2=0x558ef9c491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc66146d640 1 --2- 172.21.15.50:0/249550806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c23a70 0x558ef9c491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc66146d640 1 -- 172.21.15.50:0/249550806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ef9844490 con 0x558ef9c383b0 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc660c6c640 1 --2- 172.21.15.50:0/249550806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c23a70 0x558ef9c491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc66146d640 1 --2- 172.21.15.50:0/249550806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 0x558ef9c66bd0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc654012660 tx=0x7fc654012b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea9920c82c33cb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc63b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:38.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc63b7fe640 1 -- 172.21.15.50:0/249550806 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654019020 con 0x558ef9c383b0 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc63b7fe640 1 -- 172.21.15.50:0/249550806 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fc654003970 con 0x558ef9c383b0 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc665c66740 1 -- 172.21.15.50:0/249550806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc648056770 con 0x558ef9c383b0 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc63b7fe640 1 -- 172.21.15.50:0/249550806 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fc654023050 con 0x558ef9c383b0 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc665c66740 10 client.8166 fetch_fsmap learned FSMap version 85 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc665c66740 1 -- 172.21.15.50:0/249550806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x558ef99b1330 con 0x558ef9c383b0 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.661+0000 7fc63b7fe640 1 -- 172.21.15.50:0/249550806 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc648056770 con 0x558ef9c383b0 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.662+0000 7fc63b7fe640 1 -- 172.21.15.50:0/249550806 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7fc654026020 con 0x558ef9c383b0 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.662+0000 7fc665c66740 10 client.8166 fetch_fsmap finished waiting for FSMap version 85 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.662+0000 7fc665c66740 10 client.8166 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.662+0000 7fc665c66740 20 client.8166 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.662+0000 7fc665c66740 1 --2- 172.21.15.50:0/249550806 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x558ef9c4ec90 0x558ef9c4f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.662+0000 7fc665c66740 4 client.8166 mds_command: new command op to 7324 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:38.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.662+0000 7fc665c66740 1 -- 172.21.15.50:0/249550806 --> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ef9af6c80 con 0x558ef9c4ec90 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.662+0000 7fc660c6c640 1 --2- 172.21.15.50:0/249550806 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x558ef9c4ec90 0x558ef9c4f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.662+0000 7fc63b7fe640 10 client.8166 ms_handle_connect on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.662+0000 7fc660c6c640 1 --2- 172.21.15.50:0/249550806 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x558ef9c4ec90 0x558ef9c4f070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa28e7581e37a32b server_cookie=4fb1560e484da409 in_seq=0 out_seq=0 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc63b7fe640 1 -- 172.21.15.50:0/249550806 <== mds.0 v2:172.21.15.77:6836/1480049118 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558ef9af6c80 con 0x558ef9c4ec90 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc63b7fe640 10 client.8166 handle_command_reply: tid=0 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc665c66740 1 client.8166 shutdown 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc665c66740 1 -- 172.21.15.50:0/249550806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 msgr2=0x558ef9c66bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc665c66740 1 --2- 172.21.15.50:0/249550806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 0x558ef9c66bd0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc654012660 tx=0x7fc654012b20 comp rx=0 tx=0).stop 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc665c66740 1 -- 172.21.15.50:0/249550806 shutdown_connections 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc665c66740 1 --2- 172.21.15.50:0/249550806 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x558ef9c4ec90 0x558ef9c4f070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc665c66740 1 --2- 172.21.15.50:0/249550806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c54420 0x558ef9c66690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc665c66740 1 --2- 172.21.15.50:0/249550806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 0x558ef9c66bd0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc63b7fe640 0 client.8166 ms_handle_reset on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:38.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc665c66740 1 --2- 172.21.15.50:0/249550806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c23a70 0x558ef9c491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc665c66740 1 -- 172.21.15.50:0/249550806 >> 172.21.15.50:0/249550806 conn(0x558ef9c0a1f0 msgr2=0x558ef9c54900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc665c66740 1 -- 172.21.15.50:0/249550806 shutdown_connections 2024-09-11T22:18:38.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc665c66740 1 -- 172.21.15.50:0/249550806 wait complete. 2024-09-11T22:18:38.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.663+0000 7fc665c66740 20 client.8166 trim_cache size 0 max 16384 2024-09-11T22:18:38.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.680+0000 7fc665c66740 1 Processor -- start 2024-09-11T22:18:38.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.681+0000 7fc665c66740 1 -- start start 2024-09-11T22:18:38.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.681+0000 7fc665c66740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c23a70 0x558ef9c23270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.681+0000 7fc665c66740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 0x558ef9c50760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.681+0000 7fc665c66740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c54420 0x558ef9c4f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.681+0000 7fc665c66740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc65c200db0 con 0x558ef9c383b0 2024-09-11T22:18:38.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.681+0000 7fc665c66740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc65c1ffdd0 con 0x558ef9c54420 2024-09-11T22:18:38.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.681+0000 7fc665c66740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc65c1ff230 con 0x558ef9c23a70 2024-09-11T22:18:38.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.681+0000 7fc65bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 0x558ef9c50760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.681+0000 7fc65bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 0x558ef9c50760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60842/0 (socket says 172.21.15.50:60842) 2024-09-11T22:18:38.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.681+0000 7fc65bfff640 1 -- 172.21.15.50:0/3094665046 learned_addr learned my addr 172.21.15.50:0/3094665046 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:38.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.681+0000 7fc66146d640 1 --2- 172.21.15.50:0/3094665046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c54420 0x558ef9c4f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.682+0000 7fc660c6c640 1 --2- 172.21.15.50:0/3094665046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c23a70 0x558ef9c23270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.682+0000 7fc65bfff640 1 -- 172.21.15.50:0/3094665046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c23a70 msgr2=0x558ef9c23270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.682+0000 7fc65bfff640 1 --2- 172.21.15.50:0/3094665046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c23a70 0x558ef9c23270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.682+0000 7fc65bfff640 1 -- 172.21.15.50:0/3094665046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c54420 msgr2=0x558ef9c4f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.682+0000 7fc65bfff640 1 --2- 172.21.15.50:0/3094665046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c54420 0x558ef9c4f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.682+0000 7fc65bfff640 1 -- 172.21.15.50:0/3094665046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef981d550 con 0x558ef9c383b0 2024-09-11T22:18:38.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.682+0000 7fc660c6c640 1 --2- 172.21.15.50:0/3094665046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c23a70 0x558ef9c23270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:38.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.682+0000 7fc65bfff640 1 --2- 172.21.15.50:0/3094665046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 0x558ef9c50760 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fc64808a050 tx=0x7fc64801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc37eb67c5a3b671 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.682+0000 7fc645ffb640 1 -- 172.21.15.50:0/3094665046 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc648056510 con 0x558ef9c383b0 2024-09-11T22:18:38.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.682+0000 7fc645ffb640 1 -- 172.21.15.50:0/3094665046 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6480882d0 con 0x558ef9c383b0 2024-09-11T22:18:38.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.682+0000 7fc645ffb640 1 -- 172.21.15.50:0/3094665046 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc648054ae0 con 0x558ef9c383b0 2024-09-11T22:18:38.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.682+0000 7fc665c66740 1 -- 172.21.15.50:0/3094665046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 msgr2=0x558ef9c50760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.682+0000 7fc665c66740 1 --2- 172.21.15.50:0/3094665046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 0x558ef9c50760 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fc64808a050 tx=0x7fc64801e000 comp rx=0 tx=0).stop 2024-09-11T22:18:38.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.683+0000 7fc665c66740 1 -- 172.21.15.50:0/3094665046 shutdown_connections 2024-09-11T22:18:38.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.683+0000 7fc665c66740 1 --2- 172.21.15.50:0/3094665046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c54420 0x558ef9c4f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.683+0000 7fc665c66740 1 --2- 172.21.15.50:0/3094665046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c383b0 0x558ef9c50760 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.683+0000 7fc665c66740 1 --2- 172.21.15.50:0/3094665046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c23a70 0x558ef9c23270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.683+0000 7fc665c66740 1 -- 172.21.15.50:0/3094665046 >> 172.21.15.50:0/3094665046 conn(0x558ef9c0a1f0 msgr2=0x558ef9c669c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.683+0000 7fc665c66740 1 -- 172.21.15.50:0/3094665046 shutdown_connections 2024-09-11T22:18:38.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.683+0000 7fc665c66740 1 -- 172.21.15.50:0/3094665046 wait complete. 2024-09-11T22:18:38.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.683+0000 7fc665c66740 1 -- start start 2024-09-11T22:18:38.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.683+0000 7fc665c66740 1 Processor -- start 2024-09-11T22:18:38.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc665c66740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c23a70 0x558ef9c51240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc665c66740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c383b0 0x558ef9cd0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc665c66740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c54420 0x558ef9c66340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc665c66740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc65c1ff780 con 0x558ef9c23a70 2024-09-11T22:18:38.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc665c66740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558ef9c04060 con 0x558ef9c54420 2024-09-11T22:18:38.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc665c66740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558ef9c74a50 con 0x558ef9c383b0 2024-09-11T22:18:38.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc665c66740 10 client.0 _ll_register_callbacks cb 0x7fc654001990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:38.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc660c6c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c23a70 0x558ef9c51240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc660c6c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c23a70 0x558ef9c51240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60844/0 (socket says 172.21.15.50:60844) 2024-09-11T22:18:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc660c6c640 1 -- 172.21.15.50:0/2706519179 learned_addr learned my addr 172.21.15.50:0/2706519179 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc65bfff640 1 --2- 172.21.15.50:0/2706519179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c383b0 0x558ef9cd0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc66146d640 1 --2- 172.21.15.50:0/2706519179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c54420 0x558ef9c66340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc660c6c640 1 -- 172.21.15.50:0/2706519179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c383b0 msgr2=0x558ef9cd0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc660c6c640 1 --2- 172.21.15.50:0/2706519179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c383b0 0x558ef9cd0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc660c6c640 1 -- 172.21.15.50:0/2706519179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c54420 msgr2=0x558ef9c66340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.684+0000 7fc660c6c640 1 --2- 172.21.15.50:0/2706519179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c54420 0x558ef9c66340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc660c6c640 1 -- 172.21.15.50:0/2706519179 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ef9c626b0 con 0x558ef9c23a70 2024-09-11T22:18:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc660c6c640 1 --2- 172.21.15.50:0/2706519179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c23a70 0x558ef9c51240 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fc650000c00 tx=0x7fc65002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be717e372070298 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc63b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc63b7fe640 1 -- 172.21.15.50:0/2706519179 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc650041040 con 0x558ef9c23a70 2024-09-11T22:18:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc63b7fe640 1 -- 172.21.15.50:0/2706519179 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fc65004a9e0 con 0x558ef9c23a70 2024-09-11T22:18:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc665c66740 1 -- 172.21.15.50:0/2706519179 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6480882d0 con 0x558ef9c23a70 2024-09-11T22:18:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc63b7fe640 1 -- 172.21.15.50:0/2706519179 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fc65005f050 con 0x558ef9c23a70 2024-09-11T22:18:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc665c66740 10 client.8172 fetch_fsmap learned FSMap version 85 2024-09-11T22:18:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc665c66740 1 -- 172.21.15.50:0/2706519179 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x558ef9c51780 con 0x558ef9c23a70 2024-09-11T22:18:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc63b7fe640 1 -- 172.21.15.50:0/2706519179 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6480882d0 con 0x558ef9c23a70 2024-09-11T22:18:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc63b7fe640 1 -- 172.21.15.50:0/2706519179 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7fc650062020 con 0x558ef9c23a70 2024-09-11T22:18:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc665c66740 10 client.8172 fetch_fsmap finished waiting for FSMap version 85 2024-09-11T22:18:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc665c66740 10 client.8172 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-11T22:18:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc665c66740 20 client.8172 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc665c66740 1 --2- 172.21.15.50:0/2706519179 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x558ef9c66880 0x558ef9c0df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc665c66740 4 client.8172 mds_command: new command op to 7324 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-11T22:18:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc665c66740 1 -- 172.21.15.50:0/2706519179 --> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x558ef9b7f2f0 con 0x558ef9c66880 2024-09-11T22:18:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.685+0000 7fc65bfff640 1 --2- 172.21.15.50:0/2706519179 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x558ef9c66880 0x558ef9c0df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.686+0000 7fc63b7fe640 10 client.8172 ms_handle_connect on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.686+0000 7fc65bfff640 1 --2- 172.21.15.50:0/2706519179 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x558ef9c66880 0x558ef9c0df40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c30a901ac9021c server_cookie=823129b94a920b90 in_seq=0 out_seq=0 2024-09-11T22:18:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc63b7fe640 1 -- 172.21.15.50:0/2706519179 <== mds.0 v2:172.21.15.77:6836/1480049118 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558ef9b7f2f0 con 0x558ef9c66880 2024-09-11T22:18:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc63b7fe640 10 client.8172 handle_command_reply: tid=0 2024-09-11T22:18:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc665c66740 1 client.8172 shutdown 2024-09-11T22:18:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc665c66740 1 -- 172.21.15.50:0/2706519179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c23a70 msgr2=0x558ef9c51240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc665c66740 1 --2- 172.21.15.50:0/2706519179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c23a70 0x558ef9c51240 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fc650000c00 tx=0x7fc65002c070 comp rx=0 tx=0).stop 2024-09-11T22:18:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc665c66740 1 -- 172.21.15.50:0/2706519179 shutdown_connections 2024-09-11T22:18:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc665c66740 1 --2- 172.21.15.50:0/2706519179 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x558ef9c66880 0x558ef9c0df40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc665c66740 1 --2- 172.21.15.50:0/2706519179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558ef9c383b0 0x558ef9cd0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc665c66740 1 --2- 172.21.15.50:0/2706519179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558ef9c54420 0x558ef9c66340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc63b7fe640 0 client.8172 ms_handle_reset on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc665c66740 1 --2- 172.21.15.50:0/2706519179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558ef9c23a70 0x558ef9c51240 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc665c66740 1 -- 172.21.15.50:0/2706519179 >> 172.21.15.50:0/2706519179 conn(0x558ef9c0a1f0 msgr2=0x558ef9c37970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc665c66740 1 -- 172.21.15.50:0/2706519179 shutdown_connections 2024-09-11T22:18:38.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc665c66740 1 -- 172.21.15.50:0/2706519179 wait complete. 2024-09-11T22:18:38.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.688+0000 7fc665c66740 20 client.8172 trim_cache size 0 max 16384 2024-09-11T22:18:38.694 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:18:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:18:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "34f63064-afda-45b0-aca6-6db1ea6a2c4f", 2024-09-11T22:18:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:18:38.694 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:18:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.689+0000 7fc662ed0640 1 -- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc64006be30 msgr2=0x7fc64006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.689+0000 7fc662ed0640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc64006be30 0x7fc64006e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc650034000 tx=0x7fc65002e000 comp rx=0 tx=0).stop 2024-09-11T22:18:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.689+0000 7fc662ed0640 1 -- 172.21.15.50:0/2341399289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc65c0afe10 msgr2=0x7fc65c0b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.689+0000 7fc662ed0640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc65c0afe10 0x7fc65c0b10b0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc64800c780 tx=0x7fc64800cc40 comp rx=0 tx=0).stop 2024-09-11T22:18:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.689+0000 7fc662ed0640 1 -- 172.21.15.50:0/2341399289 shutdown_connections 2024-09-11T22:18:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.689+0000 7fc662ed0640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc64006be30 0x7fc64006e2f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.689+0000 7fc662ed0640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc65c0b2590 0x7fc65c1471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.689+0000 7fc662ed0640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc65c0afe10 0x7fc65c0b10b0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.689+0000 7fc662ed0640 1 --2- 172.21.15.50:0/2341399289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc65c06ff20 0x7fc65c155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.689+0000 7fc662ed0640 1 -- 172.21.15.50:0/2341399289 >> 172.21.15.50:0/2341399289 conn(0x7fc65c0b0a60 msgr2=0x7fc65c15f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.689+0000 7fc662ed0640 1 -- 172.21.15.50:0/2341399289 shutdown_connections 2024-09-11T22:18:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.689+0000 7fc662ed0640 1 -- 172.21.15.50:0/2341399289 wait complete. 2024-09-11T22:18:38.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:38.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub abort 2024-09-11T22:18:38.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.814+0000 7fa080386640 1 Processor -- start 2024-09-11T22:18:38.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.814+0000 7fa080386640 1 -- start start 2024-09-11T22:18:38.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.815+0000 7fa080386640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa07815b400 0x7fa07806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.815+0000 7fa080386640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa078072e60 0x7fa07806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.815+0000 7fa080386640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa07815b7e0 con 0x7fa07806df20 2024-09-11T22:18:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.815+0000 7fa080386640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa07806e390 con 0x7fa078072e60 2024-09-11T22:18:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.815+0000 7fa080386640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa07815f140 con 0x7fa07815b400 2024-09-11T22:18:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.815+0000 7fa07e923640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa07806df20 0x7fa0780b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58822/0 (socket says 172.21.15.50:58822) 2024-09-11T22:18:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.815+0000 7fa07e923640 1 -- 172.21.15.50:0/2431049288 learned_addr learned my addr 172.21.15.50:0/2431049288 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.815+0000 7fa07d921640 1 --2- 172.21.15.50:0/2431049288 >> v2:172.21.15.77:3300/0 conn(0x7fa078072e60 0x7fa07806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.815+0000 7fa07e122640 1 --2- 172.21.15.50:0/2431049288 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa07815b400 0x7fa07806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.815+0000 7fa07d120640 1 -- 172.21.15.50:0/2431049288 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252925975 0 0) 0x7fa07815b7e0 con 0x7fa07806df20 2024-09-11T22:18:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.815+0000 7fa07d120640 1 -- 172.21.15.50:0/2431049288 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa064003520 con 0x7fa07806df20 2024-09-11T22:18:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.816+0000 7fa07e122640 1 -- 172.21.15.50:0/2431049288 >> v2:172.21.15.77:3300/0 conn(0x7fa078072e60 msgr2=0x7fa07806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.816+0000 7fa07e122640 1 --2- 172.21.15.50:0/2431049288 >> v2:172.21.15.77:3300/0 conn(0x7fa078072e60 0x7fa07806d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.816+0000 7fa07e122640 1 -- 172.21.15.50:0/2431049288 >> v1:172.21.15.50:6789/0 conn(0x7fa07806df20 legacy=0x7fa0780b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.816+0000 7fa07d120640 1 -- 172.21.15.50:0/2431049288 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3842512726 0 0) 0x7fa064003520 con 0x7fa07806df20 2024-09-11T22:18:38.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.816+0000 7fa07e122640 1 -- 172.21.15.50:0/2431049288 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07815f420 con 0x7fa07815b400 2024-09-11T22:18:38.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.816+0000 7fa07d921640 1 --2- 172.21.15.50:0/2431049288 >> v2:172.21.15.77:3300/0 conn(0x7fa078072e60 0x7fa07806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.816+0000 7fa07e122640 1 --2- 172.21.15.50:0/2431049288 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa07815b400 0x7fa07806d070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa0740097a0 tx=0x7fa07402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8423790d5934f7d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.817+0000 7fa07d120640 1 -- 172.21.15.50:0/2431049288 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074037070 con 0x7fa07815b400 2024-09-11T22:18:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.817+0000 7fa07d120640 1 -- 172.21.15.50:0/2431049288 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07402aba0 con 0x7fa07815b400 2024-09-11T22:18:38.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.817+0000 7fa07d120640 1 -- 172.21.15.50:0/2431049288 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0700019f0 con 0x7fa07815b400 2024-09-11T22:18:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.817+0000 7fa080386640 1 -- 172.21.15.50:0/2431049288 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa07815b400 msgr2=0x7fa07806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.817+0000 7fa080386640 1 --2- 172.21.15.50:0/2431049288 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa07815b400 0x7fa07806d070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa0740097a0 tx=0x7fa07402a110 comp rx=0 tx=0).stop 2024-09-11T22:18:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.817+0000 7fa080386640 1 -- 172.21.15.50:0/2431049288 shutdown_connections 2024-09-11T22:18:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.817+0000 7fa080386640 1 --2- 172.21.15.50:0/2431049288 >> v2:172.21.15.77:3300/0 conn(0x7fa078072e60 0x7fa07806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.817+0000 7fa080386640 1 --2- 172.21.15.50:0/2431049288 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa07815b400 0x7fa07806d070 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.817+0000 7fa080386640 1 -- 172.21.15.50:0/2431049288 >> 172.21.15.50:0/2431049288 conn(0x7fa0780679c0 msgr2=0x7fa078067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.817+0000 7fa080386640 1 -- 172.21.15.50:0/2431049288 shutdown_connections 2024-09-11T22:18:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.817+0000 7fa080386640 1 -- 172.21.15.50:0/2431049288 wait complete. 2024-09-11T22:18:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.818+0000 7fa080386640 1 Processor -- start 2024-09-11T22:18:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.818+0000 7fa080386640 1 -- start start 2024-09-11T22:18:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.819+0000 7fa080386640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa07806df20 0x7fa07815e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.819+0000 7fa080386640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa078072e60 0x7fa07814b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.819+0000 7fa080386640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07815b400 0x7fa078147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.819+0000 7fa080386640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0780cfc50 con 0x7fa07815b400 2024-09-11T22:18:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.819+0000 7fa080386640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa07815f9e0 con 0x7fa07806df20 2024-09-11T22:18:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.819+0000 7fa080386640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa0780721d0 con 0x7fa078072e60 2024-09-11T22:18:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.819+0000 7fa07e923640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07815b400 0x7fa078147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.819+0000 7fa07e923640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07815b400 0x7fa078147330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60858/0 (socket says 172.21.15.50:60858) 2024-09-11T22:18:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.819+0000 7fa07e923640 1 -- 172.21.15.50:0/2094210824 learned_addr learned my addr 172.21.15.50:0/2094210824 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.819+0000 7fa07e122640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa07806df20 0x7fa07815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.819+0000 7fa07d921640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa078072e60 0x7fa07814b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.820+0000 7fa07e923640 1 -- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa078072e60 msgr2=0x7fa07814b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.820+0000 7fa07e923640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa078072e60 0x7fa07814b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.820+0000 7fa07e923640 1 -- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa07806df20 msgr2=0x7fa07815e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.820+0000 7fa07e923640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa07806df20 0x7fa07815e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.820+0000 7fa07e923640 1 -- 172.21.15.50:0/2094210824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07814b930 con 0x7fa07815b400 2024-09-11T22:18:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.820+0000 7fa07e923640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07815b400 0x7fa078147330 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fa070001b60 tx=0x7fa07000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.820+0000 7fa06effd640 1 -- 172.21.15.50:0/2094210824 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa070017070 con 0x7fa07815b400 2024-09-11T22:18:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.820+0000 7fa06effd640 1 -- 172.21.15.50:0/2094210824 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa070012400 con 0x7fa07815b400 2024-09-11T22:18:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.820+0000 7fa080386640 1 -- 172.21.15.50:0/2094210824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07814bc10 con 0x7fa07815b400 2024-09-11T22:18:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.820+0000 7fa06effd640 1 -- 172.21.15.50:0/2094210824 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0700127b0 con 0x7fa07815b400 2024-09-11T22:18:38.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.820+0000 7fa080386640 1 -- 172.21.15.50:0/2094210824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa07814c1d0 con 0x7fa07815b400 2024-09-11T22:18:38.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.822+0000 7fa06effd640 1 -- 172.21.15.50:0/2094210824 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa07001a070 con 0x7fa07815b400 2024-09-11T22:18:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.822+0000 7fa06effd640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa05c06be60 0x7fa05c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.822+0000 7fa06effd640 1 -- 172.21.15.50:0/2094210824 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fa07008aca0 con 0x7fa07815b400 2024-09-11T22:18:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.822+0000 7fa07e122640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa05c06be60 0x7fa05c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.823+0000 7fa07e122640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa05c06be60 0x7fa05c06e320 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa074034000 tx=0x7fa07402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.823+0000 7fa0831f9740 1 Processor -- start 2024-09-11T22:18:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.823+0000 7fa0831f9740 1 -- start start 2024-09-11T22:18:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa0831f9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379c55e0 0x555b379c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa0831f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c2da0 0x555b379c4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa0831f9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 0x555b379a5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa0831f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555b378e18d0 con 0x555b379c2da0 2024-09-11T22:18:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa0831f9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555b37889620 con 0x555b379c55e0 2024-09-11T22:18:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa0831f9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x555b378dd890 con 0x555b379c3200 2024-09-11T22:18:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa07d921640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c2da0 0x555b379c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa07d921640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c2da0 0x555b379c4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60874/0 (socket says 172.21.15.50:60874) 2024-09-11T22:18:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa07d921640 1 -- 172.21.15.50:0/1011716622 learned_addr learned my addr 172.21.15.50:0/1011716622 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa07e122640 1 --2- 172.21.15.50:0/1011716622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379c55e0 0x555b379c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa07e923640 1 --2- 172.21.15.50:0/1011716622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 0x555b379a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa07d921640 1 -- 172.21.15.50:0/1011716622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 msgr2=0x555b379a5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa07d921640 1 --2- 172.21.15.50:0/1011716622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 0x555b379a5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa07d921640 1 -- 172.21.15.50:0/1011716622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379c55e0 msgr2=0x555b379c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa07d921640 1 --2- 172.21.15.50:0/1011716622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379c55e0 0x555b379c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa07d921640 1 -- 172.21.15.50:0/1011716622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b376be7d0 con 0x555b379c2da0 2024-09-11T22:18:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.824+0000 7fa07e122640 1 --2- 172.21.15.50:0/1011716622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379c55e0 0x555b379c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.825+0000 7fa07d921640 1 --2- 172.21.15.50:0/1011716622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c2da0 0x555b379c4930 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fa068009b60 tx=0x7fa068011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a24c4cb5f633ad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.825+0000 7fa05bfff640 1 -- 172.21.15.50:0/1011716622 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068009e60 con 0x555b379c2da0 2024-09-11T22:18:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.825+0000 7fa05bfff640 1 -- 172.21.15.50:0/1011716622 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa068014440 con 0x555b379c2da0 2024-09-11T22:18:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.825+0000 7fa05bfff640 1 -- 172.21.15.50:0/1011716622 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068014810 con 0x555b379c2da0 2024-09-11T22:18:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.825+0000 7fa0831f9740 1 -- 172.21.15.50:0/1011716622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c2da0 msgr2=0x555b379c4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.825+0000 7fa0831f9740 1 --2- 172.21.15.50:0/1011716622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c2da0 0x555b379c4930 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fa068009b60 tx=0x7fa068011690 comp rx=0 tx=0).stop 2024-09-11T22:18:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.825+0000 7fa0831f9740 1 -- 172.21.15.50:0/1011716622 shutdown_connections 2024-09-11T22:18:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.825+0000 7fa0831f9740 1 --2- 172.21.15.50:0/1011716622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 0x555b379a5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.825+0000 7fa0831f9740 1 --2- 172.21.15.50:0/1011716622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c2da0 0x555b379c4930 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.825+0000 7fa0831f9740 1 --2- 172.21.15.50:0/1011716622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379c55e0 0x555b379c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.825+0000 7fa0831f9740 1 -- 172.21.15.50:0/1011716622 >> 172.21.15.50:0/1011716622 conn(0x555b3797b240 msgr2=0x555b379c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.826+0000 7fa0831f9740 1 -- 172.21.15.50:0/1011716622 shutdown_connections 2024-09-11T22:18:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.826+0000 7fa0831f9740 1 -- 172.21.15.50:0/1011716622 wait complete. 2024-09-11T22:18:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.826+0000 7fa0831f9740 1 -- start start 2024-09-11T22:18:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.826+0000 7fa0831f9740 1 Processor -- start 2024-09-11T22:18:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.827+0000 7fa0831f9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 0x555b379be6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.827+0000 7fa0831f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c55e0 0x555b379a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.827+0000 7fa0831f9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379786a0 0x555b37978b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.827+0000 7fa0831f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555b379c1d00 con 0x555b379c55e0 2024-09-11T22:18:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.827+0000 7fa0831f9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555b3786a750 con 0x555b379786a0 2024-09-11T22:18:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.827+0000 7fa0831f9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x555b379c1fe0 con 0x555b379c3200 2024-09-11T22:18:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.827+0000 7fa0831f9740 10 client.0 _ll_register_callbacks cb 0x555b3788e780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.827+0000 7fa07d921640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c55e0 0x555b379a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.827+0000 7fa07d921640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c55e0 0x555b379a2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60878/0 (socket says 172.21.15.50:60878) 2024-09-11T22:18:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.827+0000 7fa07d921640 1 -- 172.21.15.50:0/1771077220 learned_addr learned my addr 172.21.15.50:0/1771077220 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.827+0000 7fa07e923640 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379786a0 0x555b37978b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.827+0000 7fa07e122640 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 0x555b379be6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa07d921640 1 -- 172.21.15.50:0/1771077220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 msgr2=0x555b379be6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa07d921640 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 0x555b379be6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa07d921640 1 -- 172.21.15.50:0/1771077220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379786a0 msgr2=0x555b37978b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa07d921640 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379786a0 0x555b37978b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa07d921640 1 -- 172.21.15.50:0/1771077220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b375b40f0 con 0x555b379c55e0 2024-09-11T22:18:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa07e923640 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379786a0 0x555b37978b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa07d921640 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c55e0 0x555b379a2a80 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fa068011b90 tx=0x7fa068004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d8e840ed90372e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa0597fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa0597fa640 1 -- 172.21.15.50:0/1771077220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068009e60 con 0x555b379c55e0 2024-09-11T22:18:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa0597fa640 1 -- 172.21.15.50:0/1771077220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fa068028aa0 con 0x555b379c55e0 2024-09-11T22:18:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa0831f9740 1 -- 172.21.15.50:0/1771077220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa068014440 con 0x555b379c55e0 2024-09-11T22:18:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa0597fa640 1 -- 172.21.15.50:0/1771077220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fa06802f050 con 0x555b379c55e0 2024-09-11T22:18:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa0831f9740 10 client.8184 fetch_fsmap learned FSMap version 85 2024-09-11T22:18:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa0831f9740 1 -- 172.21.15.50:0/1771077220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x555b3771ef60 con 0x555b379c55e0 2024-09-11T22:18:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa0597fa640 1 -- 172.21.15.50:0/1771077220 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa068014440 con 0x555b379c55e0 2024-09-11T22:18:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa0597fa640 1 -- 172.21.15.50:0/1771077220 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7fa068032020 con 0x555b379c55e0 2024-09-11T22:18:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.828+0000 7fa0831f9740 10 client.8184 fetch_fsmap finished waiting for FSMap version 85 2024-09-11T22:18:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.829+0000 7fa0831f9740 10 client.8184 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-11T22:18:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.829+0000 7fa0831f9740 20 client.8184 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.829+0000 7fa0831f9740 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x555b379a6b00 0x555b379a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.829+0000 7fa0831f9740 4 client.8184 mds_command: new command op to 7324 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.829+0000 7fa0831f9740 1 -- 172.21.15.50:0/1771077220 --> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b378ef000 con 0x555b379a6b00 2024-09-11T22:18:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.829+0000 7fa07e122640 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x555b379a6b00 0x555b379a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.829+0000 7fa07e122640 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x555b379a6b00 0x555b379a6ee0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e8e0a4e645783f6 server_cookie=a53f33bf9bc2aa8c in_seq=0 out_seq=0 2024-09-11T22:18:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.829+0000 7fa0597fa640 10 client.8184 ms_handle_connect on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0597fa640 1 -- 172.21.15.50:0/1771077220 <== mds.0 v2:172.21.15.77:6836/1480049118 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555b378ef000 con 0x555b379a6b00 2024-09-11T22:18:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0597fa640 10 client.8184 handle_command_reply: tid=0 2024-09-11T22:18:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0831f9740 1 client.8184 shutdown 2024-09-11T22:18:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0831f9740 1 -- 172.21.15.50:0/1771077220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c55e0 msgr2=0x555b379a2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0831f9740 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c55e0 0x555b379a2a80 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fa068011b90 tx=0x7fa068004730 comp rx=0 tx=0).stop 2024-09-11T22:18:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0831f9740 1 -- 172.21.15.50:0/1771077220 shutdown_connections 2024-09-11T22:18:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0831f9740 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x555b379a6b00 0x555b379a6ee0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0831f9740 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379786a0 0x555b37978b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0597fa640 0 client.8184 ms_handle_reset on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0831f9740 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c55e0 0x555b379a2a80 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0831f9740 1 --2- 172.21.15.50:0/1771077220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 0x555b379be6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0831f9740 1 -- 172.21.15.50:0/1771077220 >> 172.21.15.50:0/1771077220 conn(0x555b379c2da0 msgr2=0x555b379a5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0831f9740 1 -- 172.21.15.50:0/1771077220 shutdown_connections 2024-09-11T22:18:38.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0831f9740 1 -- 172.21.15.50:0/1771077220 wait complete. 2024-09-11T22:18:38.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.830+0000 7fa0831f9740 20 client.8184 trim_cache size 0 max 16384 2024-09-11T22:18:38.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.847+0000 7fa0831f9740 1 Processor -- start 2024-09-11T22:18:38.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.847+0000 7fa0831f9740 1 -- start start 2024-09-11T22:18:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa0831f9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379786a0 0x555b379c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa0831f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379a6b00 0x555b3797a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa0831f9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 0x555b3797a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa0831f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0781fe710 con 0x555b379a6b00 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa0831f9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa0781fd8c0 con 0x555b379786a0 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa0831f9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa0780b0f20 con 0x555b379c3200 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa07d921640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379a6b00 0x555b3797a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa07d921640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379a6b00 0x555b3797a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60892/0 (socket says 172.21.15.50:60892) 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa07d921640 1 -- 172.21.15.50:0/4164342532 learned_addr learned my addr 172.21.15.50:0/4164342532 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa07e122640 1 --2- 172.21.15.50:0/4164342532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379786a0 0x555b379c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa07e923640 1 --2- 172.21.15.50:0/4164342532 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 0x555b3797a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa07d921640 1 -- 172.21.15.50:0/4164342532 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 msgr2=0x555b3797a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa07d921640 1 --2- 172.21.15.50:0/4164342532 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 0x555b3797a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa07d921640 1 -- 172.21.15.50:0/4164342532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379786a0 msgr2=0x555b379c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa07d921640 1 --2- 172.21.15.50:0/4164342532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379786a0 0x555b379c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa07d921640 1 -- 172.21.15.50:0/4164342532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b3758d1b0 con 0x555b379a6b00 2024-09-11T22:18:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa07e122640 1 --2- 172.21.15.50:0/4164342532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379786a0 0x555b379c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.848+0000 7fa07d921640 1 --2- 172.21.15.50:0/4164342532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379a6b00 0x555b3797a180 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fa068009310 tx=0x7fa068020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd65465f124c0592 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.849+0000 7fa05b7fe640 1 -- 172.21.15.50:0/4164342532 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068009e60 con 0x555b379a6b00 2024-09-11T22:18:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.849+0000 7fa05b7fe640 1 -- 172.21.15.50:0/4164342532 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa068003a20 con 0x555b379a6b00 2024-09-11T22:18:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.849+0000 7fa05b7fe640 1 -- 172.21.15.50:0/4164342532 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068003df0 con 0x555b379a6b00 2024-09-11T22:18:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.849+0000 7fa0831f9740 1 -- 172.21.15.50:0/4164342532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379a6b00 msgr2=0x555b3797a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.849+0000 7fa0831f9740 1 --2- 172.21.15.50:0/4164342532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379a6b00 0x555b3797a180 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fa068009310 tx=0x7fa068020070 comp rx=0 tx=0).stop 2024-09-11T22:18:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.849+0000 7fa0831f9740 1 -- 172.21.15.50:0/4164342532 shutdown_connections 2024-09-11T22:18:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.849+0000 7fa0831f9740 1 --2- 172.21.15.50:0/4164342532 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379c3200 0x555b3797a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.849+0000 7fa0831f9740 1 --2- 172.21.15.50:0/4164342532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379a6b00 0x555b3797a180 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.849+0000 7fa0831f9740 1 --2- 172.21.15.50:0/4164342532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379786a0 0x555b379c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.849+0000 7fa0831f9740 1 -- 172.21.15.50:0/4164342532 >> 172.21.15.50:0/4164342532 conn(0x555b379c2da0 msgr2=0x555b379d6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.849+0000 7fa0831f9740 1 -- 172.21.15.50:0/4164342532 shutdown_connections 2024-09-11T22:18:38.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.849+0000 7fa0831f9740 1 -- 172.21.15.50:0/4164342532 wait complete. 2024-09-11T22:18:38.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.850+0000 7fa0831f9740 1 -- start start 2024-09-11T22:18:38.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.850+0000 7fa0831f9740 1 Processor -- start 2024-09-11T22:18:38.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa0831f9740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379786a0 0x555b379e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa0831f9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379a6b00 0x555b37a2a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa0831f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c3200 0x555b379bed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa0831f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555b379c1980 con 0x555b379c3200 2024-09-11T22:18:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa0831f9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa0780b2390 con 0x555b379a6b00 2024-09-11T22:18:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa0831f9740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x555b379c1cd0 con 0x555b379786a0 2024-09-11T22:18:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa0831f9740 10 client.0 _ll_register_callbacks cb 0x7fa0680099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa07e923640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c3200 0x555b379bed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa07e923640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c3200 0x555b379bed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60898/0 (socket says 172.21.15.50:60898) 2024-09-11T22:18:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa07e923640 1 -- 172.21.15.50:0/3387650928 learned_addr learned my addr 172.21.15.50:0/3387650928 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa07d921640 1 --2- 172.21.15.50:0/3387650928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379a6b00 0x555b37a2a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa07e122640 1 --2- 172.21.15.50:0/3387650928 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379786a0 0x555b379e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa07e923640 1 -- 172.21.15.50:0/3387650928 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379786a0 msgr2=0x555b379e75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa07e923640 1 --2- 172.21.15.50:0/3387650928 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379786a0 0x555b379e75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa07e923640 1 -- 172.21.15.50:0/3387650928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379a6b00 msgr2=0x555b37a2a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa07e923640 1 --2- 172.21.15.50:0/3387650928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379a6b00 0x555b37a2a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa07e923640 1 -- 172.21.15.50:0/3387650928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b3797abc0 con 0x555b379c3200 2024-09-11T22:18:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa07e923640 1 --2- 172.21.15.50:0/3387650928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c3200 0x555b379bed00 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fa070089170 tx=0x7fa0700590c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667cd0777ec31a6a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.851+0000 7fa0597fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0597fa640 1 -- 172.21.15.50:0/3387650928 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa070087060 con 0x555b379c3200 2024-09-11T22:18:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0597fa640 1 -- 172.21.15.50:0/3387650928 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fa070004d60 con 0x555b379c3200 2024-09-11T22:18:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0831f9740 1 -- 172.21.15.50:0/3387650928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa068003a20 con 0x555b379c3200 2024-09-11T22:18:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0597fa640 1 -- 172.21.15.50:0/3387650928 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fa070061b30 con 0x555b379c3200 2024-09-11T22:18:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0831f9740 10 client.8190 fetch_fsmap learned FSMap version 85 2024-09-11T22:18:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0831f9740 1 -- 172.21.15.50:0/3387650928 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x555b37a2aba0 con 0x555b379c3200 2024-09-11T22:18:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0597fa640 1 -- 172.21.15.50:0/3387650928 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa068003a20 con 0x555b379c3200 2024-09-11T22:18:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0597fa640 1 -- 172.21.15.50:0/3387650928 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7fa070079070 con 0x555b379c3200 2024-09-11T22:18:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0831f9740 10 client.8190 fetch_fsmap finished waiting for FSMap version 85 2024-09-11T22:18:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0831f9740 10 client.8190 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-11T22:18:38.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0831f9740 20 client.8190 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0831f9740 1 --2- 172.21.15.50:0/3387650928 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x555b379c55e0 0x555b379bf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0831f9740 4 client.8190 mds_command: new command op to 7324 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-11T22:18:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa0831f9740 1 -- 172.21.15.50:0/3387650928 --> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x555b378e9350 con 0x555b379c55e0 2024-09-11T22:18:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.852+0000 7fa07e122640 1 --2- 172.21.15.50:0/3387650928 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x555b379c55e0 0x555b379bf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa07e122640 1 --2- 172.21.15.50:0/3387650928 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x555b379c55e0 0x555b379bf240 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98a91b05a9b849df server_cookie=68e4c613637ff6a in_seq=0 out_seq=0 2024-09-11T22:18:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0597fa640 10 client.8190 ms_handle_connect on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0597fa640 1 -- 172.21.15.50:0/3387650928 <== mds.0 v2:172.21.15.77:6836/1480049118 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555b378e9350 con 0x555b379c55e0 2024-09-11T22:18:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0597fa640 10 client.8190 handle_command_reply: tid=0 2024-09-11T22:18:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0831f9740 1 client.8190 shutdown 2024-09-11T22:18:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0831f9740 1 -- 172.21.15.50:0/3387650928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c3200 msgr2=0x555b379bed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0831f9740 1 --2- 172.21.15.50:0/3387650928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c3200 0x555b379bed00 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fa070089170 tx=0x7fa0700590c0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0831f9740 1 -- 172.21.15.50:0/3387650928 shutdown_connections 2024-09-11T22:18:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0831f9740 1 --2- 172.21.15.50:0/3387650928 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x555b379c55e0 0x555b379bf240 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0831f9740 1 --2- 172.21.15.50:0/3387650928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555b379c3200 0x555b379bed00 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0831f9740 1 --2- 172.21.15.50:0/3387650928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555b379a6b00 0x555b37a2a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0597fa640 0 client.8190 ms_handle_reset on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:38.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0831f9740 1 --2- 172.21.15.50:0/3387650928 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555b379786a0 0x555b379e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0831f9740 1 -- 172.21.15.50:0/3387650928 >> 172.21.15.50:0/3387650928 conn(0x555b379c2da0 msgr2=0x555b379c6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0831f9740 1 -- 172.21.15.50:0/3387650928 shutdown_connections 2024-09-11T22:18:38.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0831f9740 1 -- 172.21.15.50:0/3387650928 wait complete. 2024-09-11T22:18:38.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.853+0000 7fa0831f9740 20 client.8190 trim_cache size 0 max 16384 2024-09-11T22:18:38.860 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:18:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:18:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:18:38.861 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:18:38.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.854+0000 7fa080386640 1 -- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa05c06be60 msgr2=0x7fa05c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.854+0000 7fa080386640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa05c06be60 0x7fa05c06e320 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa074034000 tx=0x7fa07402e000 comp rx=0 tx=0).stop 2024-09-11T22:18:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.854+0000 7fa080386640 1 -- 172.21.15.50:0/2094210824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07815b400 msgr2=0x7fa078147330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.854+0000 7fa080386640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07815b400 0x7fa078147330 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fa070001b60 tx=0x7fa07000a430 comp rx=0 tx=0).stop 2024-09-11T22:18:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.854+0000 7fa080386640 1 -- 172.21.15.50:0/2094210824 shutdown_connections 2024-09-11T22:18:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.854+0000 7fa080386640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa05c06be60 0x7fa05c06e320 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.854+0000 7fa080386640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa078072e60 0x7fa07814b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.854+0000 7fa080386640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07815b400 0x7fa078147330 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.854+0000 7fa080386640 1 --2- 172.21.15.50:0/2094210824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa07806df20 0x7fa07815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.854+0000 7fa080386640 1 -- 172.21.15.50:0/2094210824 >> 172.21.15.50:0/2094210824 conn(0x7fa0780679c0 msgr2=0x7fa078071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.854+0000 7fa080386640 1 -- 172.21.15.50:0/2094210824 shutdown_connections 2024-09-11T22:18:38.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.854+0000 7fa080386640 1 -- 172.21.15.50:0/2094210824 wait complete. 2024-09-11T22:18:38.865 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-11T22:18:38.865 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-11T22:18:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.968+0000 7f4d2522e640 1 Processor -- start 2024-09-11T22:18:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.968+0000 7f4d2522e640 1 -- start start 2024-09-11T22:18:38.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.969+0000 7f4d2522e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d2015e870 0x7f4d200d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.969+0000 7f4d2522e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d200cfa80 con 0x7f4d200d16d0 2024-09-11T22:18:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.969+0000 7f4d2522e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d200d40d0 con 0x7f4d200d3c00 2024-09-11T22:18:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.969+0000 7f4d2522e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d200d1b10 con 0x7f4d2015e870 2024-09-11T22:18:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.969+0000 7f4d1e59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4d200d16d0 0x7f4d200d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58838/0 (socket says 172.21.15.50:58838) 2024-09-11T22:18:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.969+0000 7f4d1e59c640 1 -- 172.21.15.50:0/1150339952 learned_addr learned my addr 172.21.15.50:0/1150339952 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.969+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/1150339952 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d2015e870 0x7f4d200d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.969+0000 7f4d1dd9b640 1 -- 172.21.15.50:0/1150339952 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 934024479 0 0) 0x7f4d14001110 con 0x7f4d200d16d0 2024-09-11T22:18:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.969+0000 7f4d1dd9b640 1 -- 172.21.15.50:0/1150339952 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d08003520 con 0x7f4d200d16d0 2024-09-11T22:18:38.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.969+0000 7f4d1dd9b640 1 -- 172.21.15.50:0/1150339952 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214558822 0 0) 0x7f4d200d40d0 con 0x7f4d200d3c00 2024-09-11T22:18:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.969+0000 7f4d1dd9b640 1 -- 172.21.15.50:0/1150339952 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d14001110 con 0x7f4d200d3c00 2024-09-11T22:18:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.969+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/1150339952 >> v1:172.21.15.77:6789/0 conn(0x7f4d200d3c00 legacy=0x7f4d200b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.969+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/1150339952 >> v1:172.21.15.50:6789/0 conn(0x7f4d200d16d0 legacy=0x7f4d200d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.970+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/1150339952 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d200d43b0 con 0x7f4d2015e870 2024-09-11T22:18:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.970+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/1150339952 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d2015e870 0x7f4d200d1190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4d100097d0 tx=0x7f4d1002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1598b1a96138844 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.970+0000 7f4d1dd9b640 1 -- 172.21.15.50:0/1150339952 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d10037070 con 0x7f4d2015e870 2024-09-11T22:18:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.970+0000 7f4d1dd9b640 1 -- 172.21.15.50:0/1150339952 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d10032440 con 0x7f4d2015e870 2024-09-11T22:18:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.970+0000 7f4d1dd9b640 1 -- 172.21.15.50:0/1150339952 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d10032810 con 0x7f4d2015e870 2024-09-11T22:18:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.971+0000 7f4d2522e640 1 -- 172.21.15.50:0/1150339952 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d2015e870 msgr2=0x7f4d200d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.971+0000 7f4d2522e640 1 --2- 172.21.15.50:0/1150339952 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d2015e870 0x7f4d200d1190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4d100097d0 tx=0x7f4d1002a210 comp rx=0 tx=0).stop 2024-09-11T22:18:38.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.971+0000 7f4d2522e640 1 -- 172.21.15.50:0/1150339952 shutdown_connections 2024-09-11T22:18:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.971+0000 7f4d2522e640 1 --2- 172.21.15.50:0/1150339952 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d2015e870 0x7f4d200d1190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.971+0000 7f4d2522e640 1 -- 172.21.15.50:0/1150339952 >> 172.21.15.50:0/1150339952 conn(0x7f4d200727a0 msgr2=0x7f4d200679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.971+0000 7f4d2522e640 1 -- 172.21.15.50:0/1150339952 shutdown_connections 2024-09-11T22:18:38.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.971+0000 7f4d2522e640 1 -- 172.21.15.50:0/1150339952 wait complete. 2024-09-11T22:18:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.972+0000 7f4d2522e640 1 Processor -- start 2024-09-11T22:18:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.973+0000 7f4d2522e640 1 -- start start 2024-09-11T22:18:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.973+0000 7f4d2522e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200d16d0 0x7f4d2015a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.973+0000 7f4d2522e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d200d3c00 0x7f4d201f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.973+0000 7f4d2522e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2015e870 0x7f4d20159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.973+0000 7f4d2522e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2015ec50 con 0x7f4d2015e870 2024-09-11T22:18:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.973+0000 7f4d2522e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d200b7ee0 con 0x7f4d200d16d0 2024-09-11T22:18:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.973+0000 7f4d2522e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d200b78b0 con 0x7f4d200d3c00 2024-09-11T22:18:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.973+0000 7f4d1f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2015e870 0x7f4d20159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.973+0000 7f4d1ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200d16d0 0x7f4d2015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.973+0000 7f4d1e59c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d200d3c00 0x7f4d201f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.973+0000 7f4d1f59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2015e870 0x7f4d20159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60914/0 (socket says 172.21.15.50:60914) 2024-09-11T22:18:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.973+0000 7f4d1f59e640 1 -- 172.21.15.50:0/3336262772 learned_addr learned my addr 172.21.15.50:0/3336262772 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.974+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/3336262772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d200d3c00 msgr2=0x7f4d201f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.974+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/3336262772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d200d3c00 0x7f4d201f5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.974+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/3336262772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2015e870 msgr2=0x7f4d20159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.974+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/3336262772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2015e870 0x7f4d20159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.974+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/3336262772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2015aa10 con 0x7f4d200d16d0 2024-09-11T22:18:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.974+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/3336262772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200d16d0 0x7f4d2015a430 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4d10031000 tx=0x7f4d100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.974+0000 7f4d077fe640 1 -- 172.21.15.50:0/3336262772 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d10041020 con 0x7f4d200d16d0 2024-09-11T22:18:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.974+0000 7f4d077fe640 1 -- 172.21.15.50:0/3336262772 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1003d720 con 0x7f4d200d16d0 2024-09-11T22:18:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.974+0000 7f4d2522e640 1 -- 172.21.15.50:0/3336262772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d20158a80 con 0x7f4d200d16d0 2024-09-11T22:18:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.974+0000 7f4d077fe640 1 -- 172.21.15.50:0/3336262772 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d10037040 con 0x7f4d200d16d0 2024-09-11T22:18:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.974+0000 7f4d2522e640 1 -- 172.21.15.50:0/3336262772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d20159040 con 0x7f4d200d16d0 2024-09-11T22:18:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.976+0000 7f4d077fe640 1 -- 172.21.15.50:0/3336262772 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d10044020 con 0x7f4d200d16d0 2024-09-11T22:18:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.977+0000 7f4d077fe640 1 --2- 172.21.15.50:0/3336262772 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d0c06be30 0x7f4d0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.977+0000 7f4d077fe640 1 -- 172.21.15.50:0/3336262772 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f4d100ab530 con 0x7f4d200d16d0 2024-09-11T22:18:38.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.977+0000 7f4d1e59c640 1 --2- 172.21.15.50:0/3336262772 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d0c06be30 0x7f4d0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.977+0000 7f4d1e59c640 1 --2- 172.21.15.50:0/3336262772 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d0c06be30 0x7f4d0c06e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4d2006ce70 tx=0x7f4d14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.977+0000 7f4d27fcd740 1 Processor -- start 2024-09-11T22:18:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.978+0000 7f4d27fcd740 1 -- start start 2024-09-11T22:18:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.978+0000 7f4d27fcd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e85888d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.978+0000 7f4d27fcd740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e8588450e0 0x55e858847d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.978+0000 7f4d27fcd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 0x55e8588421a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.978+0000 7f4d27fcd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e8587aa6f0 con 0x55e858847920 2024-09-11T22:18:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.978+0000 7f4d27fcd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e858752330 con 0x55e8588490b0 2024-09-11T22:18:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.978+0000 7f4d27fcd740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e8587a66b0 con 0x55e8588450e0 2024-09-11T22:18:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.978+0000 7f4d1ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e85888d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.978+0000 7f4d1e59c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e8588450e0 0x55e858847d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.978+0000 7f4d1ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e85888d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60926/0 (socket says 172.21.15.50:60926) 2024-09-11T22:18:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.978+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/1748535386 learned_addr learned my addr 172.21.15.50:0/1748535386 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.979+0000 7f4d1f59e640 1 --2- 172.21.15.50:0/1748535386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 0x55e8588421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.979+0000 7f4d1e59c640 1 -- 172.21.15.50:0/1748535386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 msgr2=0x55e8588421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.979+0000 7f4d1e59c640 1 --2- 172.21.15.50:0/1748535386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 0x55e8588421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.979+0000 7f4d1e59c640 1 -- 172.21.15.50:0/1748535386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 msgr2=0x55e85888d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.979+0000 7f4d1e59c640 1 --2- 172.21.15.50:0/1748535386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e85888d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.979+0000 7f4d1e59c640 1 -- 172.21.15.50:0/1748535386 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8587780d0 con 0x55e8588450e0 2024-09-11T22:18:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.979+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/1748535386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e85888d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.979+0000 7f4d1e59c640 1 --2- 172.21.15.50:0/1748535386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e8588450e0 0x55e858847d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4d14005880 tx=0x7f4d14012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6819829e25384eb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.979+0000 7f4d04ff9640 1 -- 172.21.15.50:0/1748535386 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14025070 con 0x55e8588450e0 2024-09-11T22:18:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.979+0000 7f4d04ff9640 1 -- 172.21.15.50:0/1748535386 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1401b050 con 0x55e8588450e0 2024-09-11T22:18:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.979+0000 7f4d04ff9640 1 -- 172.21.15.50:0/1748535386 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14020410 con 0x55e8588450e0 2024-09-11T22:18:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.980+0000 7f4d27fcd740 1 -- 172.21.15.50:0/1748535386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e8588450e0 msgr2=0x55e858847d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.980+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/1748535386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e8588450e0 0x55e858847d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4d14005880 tx=0x7f4d14012000 comp rx=0 tx=0).stop 2024-09-11T22:18:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.980+0000 7f4d27fcd740 1 -- 172.21.15.50:0/1748535386 shutdown_connections 2024-09-11T22:18:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.980+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/1748535386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e8588450e0 0x55e858847d00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.980+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/1748535386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 0x55e8588421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.980+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/1748535386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e85888d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.980+0000 7f4d27fcd740 1 -- 172.21.15.50:0/1748535386 >> 172.21.15.50:0/1748535386 conn(0x55e858844370 msgr2=0x55e85888c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.980+0000 7f4d27fcd740 1 -- 172.21.15.50:0/1748535386 shutdown_connections 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.980+0000 7f4d27fcd740 1 -- 172.21.15.50:0/1748535386 wait complete. 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.980+0000 7f4d27fcd740 1 -- start start 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.980+0000 7f4d27fcd740 1 Processor -- start 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.981+0000 7f4d27fcd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e858847920 0x55e85886f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.981+0000 7f4d27fcd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8588490b0 0x55e8588721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.981+0000 7f4d27fcd740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 0x55e858869d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.981+0000 7f4d27fcd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e858843810 con 0x55e8588490b0 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.981+0000 7f4d27fcd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e8587334f0 con 0x55e858847920 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.981+0000 7f4d27fcd740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e85888d8f0 con 0x55e858886270 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.981+0000 7f4d27fcd740 10 client.0 _ll_register_callbacks cb 0x55e858754b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.981+0000 7f4d1e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8588490b0 0x55e8588721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.981+0000 7f4d1e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8588490b0 0x55e8588721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60934/0 (socket says 172.21.15.50:60934) 2024-09-11T22:18:38.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.981+0000 7f4d1e59c640 1 -- 172.21.15.50:0/278039619 learned_addr learned my addr 172.21.15.50:0/278039619 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.981+0000 7f4d1f59e640 1 --2- 172.21.15.50:0/278039619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 0x55e858869d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.981+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/278039619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e858847920 0x55e85886f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d1e59c640 1 -- 172.21.15.50:0/278039619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 msgr2=0x55e858869d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d1e59c640 1 --2- 172.21.15.50:0/278039619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 0x55e858869d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d1e59c640 1 -- 172.21.15.50:0/278039619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e858847920 msgr2=0x55e85886f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d1e59c640 1 --2- 172.21.15.50:0/278039619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e858847920 0x55e85886f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d1e59c640 1 -- 172.21.15.50:0/278039619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8585877d0 con 0x55e8588490b0 2024-09-11T22:18:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d1e59c640 1 --2- 172.21.15.50:0/278039619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8588490b0 0x55e8588721a0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f4d14001eb0 tx=0x7f4d140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a252943d2dd7f31 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4cfdffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4cfdffb640 1 -- 172.21.15.50:0/278039619 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1402e020 con 0x55e8588490b0 2024-09-11T22:18:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d27fcd740 1 -- 172.21.15.50:0/278039619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d1401b050 con 0x55e8588490b0 2024-09-11T22:18:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4cfdffb640 1 -- 172.21.15.50:0/278039619 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f4d1402a610 con 0x55e8588490b0 2024-09-11T22:18:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4cfdffb640 1 -- 172.21.15.50:0/278039619 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f4d14038050 con 0x55e8588490b0 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d27fcd740 10 client.8202 fetch_fsmap learned FSMap version 85 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d27fcd740 1 -- 172.21.15.50:0/278039619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55e8584bd3f0 con 0x55e8588490b0 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4cfdffb640 1 -- 172.21.15.50:0/278039619 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1401b050 con 0x55e8588490b0 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4cfdffb640 1 -- 172.21.15.50:0/278039619 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f4d1403b020 con 0x55e8588490b0 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d27fcd740 10 client.8202 fetch_fsmap finished waiting for FSMap version 85 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d27fcd740 10 client.8202 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d27fcd740 20 client.8202 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/278039619 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55e858886650 0x55e85886c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d27fcd740 4 client.8202 mds_command: new command op to 7324 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.982+0000 7f4d27fcd740 1 -- 172.21.15.50:0/278039619 --> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8587b7e20 con 0x55e858886650 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.983+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/278039619 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55e858886650 0x55e85886c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.983+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/278039619 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55e858886650 0x55e85886c110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b3aa531a17d1682 server_cookie=9896e23551612c07 in_seq=0 out_seq=0 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.983+0000 7f4cfdffb640 10 client.8202 ms_handle_connect on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:38.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4cfdffb640 1 -- 172.21.15.50:0/278039619 <== mds.0 v2:172.21.15.77:6836/1480049118 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e8587b7e20 con 0x55e858886650 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4cfdffb640 10 client.8202 handle_command_reply: tid=0 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4d27fcd740 1 client.8202 shutdown 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4d27fcd740 1 -- 172.21.15.50:0/278039619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8588490b0 msgr2=0x55e8588721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/278039619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8588490b0 0x55e8588721a0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f4d14001eb0 tx=0x7f4d140057f0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4d27fcd740 1 -- 172.21.15.50:0/278039619 shutdown_connections 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/278039619 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55e858886650 0x55e85886c110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/278039619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 0x55e858869d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/278039619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e8588490b0 0x55e8588721a0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4cfdffb640 0 client.8202 ms_handle_reset on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/278039619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e858847920 0x55e85886f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4d27fcd740 1 -- 172.21.15.50:0/278039619 >> 172.21.15.50:0/278039619 conn(0x55e8588450e0 msgr2=0x55e85888e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4d27fcd740 1 -- 172.21.15.50:0/278039619 shutdown_connections 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4d27fcd740 1 -- 172.21.15.50:0/278039619 wait complete. 2024-09-11T22:18:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:38.984+0000 7f4d27fcd740 20 client.8202 trim_cache size 0 max 16384 2024-09-11T22:18:39.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.001+0000 7f4d27fcd740 1 Processor -- start 2024-09-11T22:18:39.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.001+0000 7f4d27fcd740 1 -- start start 2024-09-11T22:18:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d27fcd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e858889be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d27fcd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 0x55e8588b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d27fcd740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 0x55e8588b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d27fcd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d201f8930 con 0x55e858847920 2024-09-11T22:18:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d27fcd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d20154b20 con 0x55e8588490b0 2024-09-11T22:18:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d27fcd740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d20155e70 con 0x55e858886270 2024-09-11T22:18:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d1ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e858889be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d1ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e858889be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60946/0 (socket says 172.21.15.50:60946) 2024-09-11T22:18:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/530473033 learned_addr learned my addr 172.21.15.50:0/530473033 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/530473033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 msgr2=0x55e8588b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/530473033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 0x55e8588b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/530473033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 msgr2=0x55e8588b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/530473033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 0x55e8588b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.002+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/530473033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e85847d0f0 con 0x55e858847920 2024-09-11T22:18:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.003+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/530473033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e858889be0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009720 tx=0x7f4d100a9920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a87df6052a0679 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.003+0000 7f4cfffff640 1 -- 172.21.15.50:0/530473033 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d10087070 con 0x55e858847920 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.003+0000 7f4cfffff640 1 -- 172.21.15.50:0/530473033 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d100824d0 con 0x55e858847920 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.003+0000 7f4cfffff640 1 -- 172.21.15.50:0/530473033 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d10077ca0 con 0x55e858847920 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.003+0000 7f4d27fcd740 1 -- 172.21.15.50:0/530473033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 msgr2=0x55e858889be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.003+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/530473033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e858889be0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009720 tx=0x7f4d100a9920 comp rx=0 tx=0).stop 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.003+0000 7f4d27fcd740 1 -- 172.21.15.50:0/530473033 shutdown_connections 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.003+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/530473033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 0x55e8588b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.003+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/530473033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 0x55e8588b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.003+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/530473033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e858889be0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.003+0000 7f4d27fcd740 1 -- 172.21.15.50:0/530473033 >> 172.21.15.50:0/530473033 conn(0x55e8588450e0 msgr2=0x55e85886f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.003+0000 7f4d27fcd740 1 -- 172.21.15.50:0/530473033 shutdown_connections 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.003+0000 7f4d27fcd740 1 -- 172.21.15.50:0/530473033 wait complete. 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.004+0000 7f4d27fcd740 1 -- start start 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.004+0000 7f4d27fcd740 1 Processor -- start 2024-09-11T22:18:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d27fcd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e85890a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d27fcd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 0x55e858846ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d27fcd740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 0x55e85888faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d27fcd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e858870880 con 0x55e858847920 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d27fcd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d201544d0 con 0x55e8588490b0 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d27fcd740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e85876d180 con 0x55e858886270 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d27fcd740 10 client.0 _ll_register_callbacks cb 0x7f4d14023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d1ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e85890a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d1ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e85890a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60952/0 (socket says 172.21.15.50:60952) 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/1253472931 learned_addr learned my addr 172.21.15.50:0/1253472931 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d1e59c640 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 0x55e858846ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d1f59e640 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 0x55e85888faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/1253472931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 msgr2=0x55e85888faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 0x55e85888faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/1253472931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 msgr2=0x55e858846ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 0x55e858846ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d1ed9d640 1 -- 172.21.15.50:0/1253472931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e85890ac70 con 0x55e858847920 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d1e59c640 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 0x55e858846ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d1ed9d640 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e85890a730 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f4d100091d0 tx=0x7f4d100ab040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a887d6e23b0069 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4cfdffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4cfdffb640 1 -- 172.21.15.50:0/1253472931 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d10087030 con 0x55e858847920 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4cfdffb640 1 -- 172.21.15.50:0/1253472931 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f4d100a9ad0 con 0x55e858847920 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d27fcd740 1 -- 172.21.15.50:0/1253472931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d100824d0 con 0x55e858847920 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4cfdffb640 1 -- 172.21.15.50:0/1253472931 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f4d100800b0 con 0x55e858847920 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d27fcd740 10 client.8208 fetch_fsmap learned FSMap version 85 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.005+0000 7f4d27fcd740 1 -- 172.21.15.50:0/1253472931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55e8588858c0 con 0x55e858847920 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4cfdffb640 1 -- 172.21.15.50:0/1253472931 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d100824d0 con 0x55e858847920 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4cfdffb640 1 -- 172.21.15.50:0/1253472931 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f4d1003a030 con 0x55e858847920 2024-09-11T22:18:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4d27fcd740 10 client.8208 fetch_fsmap finished waiting for FSMap version 85 2024-09-11T22:18:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4d27fcd740 10 client.8208 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-11T22:18:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4d27fcd740 20 client.8208 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55e8588659a0 0x55e858865db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4d27fcd740 4 client.8208 mds_command: new command op to 7324 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:18:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4d27fcd740 1 -- 172.21.15.50:0/1253472931 --> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e8587b2170 con 0x55e8588659a0 2024-09-11T22:18:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4d1e59c640 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55e8588659a0 0x55e858865db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4d1e59c640 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55e8588659a0 0x55e858865db0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eebffc5941c5dbc server_cookie=41ef2dbf738d4070 in_seq=0 out_seq=0 2024-09-11T22:18:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4cfdffb640 10 client.8208 ms_handle_connect on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4cfdffb640 1 -- 172.21.15.50:0/1253472931 <== mds.0 v2:172.21.15.77:6836/1480049118 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x55e8587b2170 con 0x55e8588659a0 2024-09-11T22:18:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4cfdffb640 10 client.8208 handle_command_reply: tid=0 2024-09-11T22:18:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.006+0000 7f4d27fcd740 1 client.8208 shutdown 2024-09-11T22:18:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d27fcd740 1 -- 172.21.15.50:0/1253472931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 msgr2=0x55e85890a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e85890a730 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f4d100091d0 tx=0x7f4d100ab040 comp rx=0 tx=0).stop 2024-09-11T22:18:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d27fcd740 1 -- 172.21.15.50:0/1253472931 shutdown_connections 2024-09-11T22:18:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55e8588659a0 0x55e858865db0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e858886270 0x55e85888faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e8588490b0 0x55e858846ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d27fcd740 1 --2- 172.21.15.50:0/1253472931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e858847920 0x55e85890a730 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4cfdffb640 0 client.8208 ms_handle_reset on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d27fcd740 1 -- 172.21.15.50:0/1253472931 >> 172.21.15.50:0/1253472931 conn(0x55e8588450e0 msgr2=0x55e85886d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d27fcd740 1 -- 172.21.15.50:0/1253472931 shutdown_connections 2024-09-11T22:18:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d27fcd740 1 -- 172.21.15.50:0/1253472931 wait complete. 2024-09-11T22:18:39.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d27fcd740 20 client.8208 trim_cache size 0 max 16384 2024-09-11T22:18:39.016 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:18:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:18:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-11T22:18:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "34f63064-afda-45b0-aca6-6db1ea6a2c4f": { 2024-09-11T22:18:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/scrub_control_test_path", 2024-09-11T22:18:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "34f63064-afda-45b0-aca6-6db1ea6a2c4f", 2024-09-11T22:18:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive" 2024-09-11T22:18:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:18:39.017 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:18:39.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d2522e640 1 -- 172.21.15.50:0/3336262772 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d0c06be30 msgr2=0x7f4d0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d2522e640 1 --2- 172.21.15.50:0/3336262772 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d0c06be30 0x7f4d0c06e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4d2006ce70 tx=0x7f4d14009040 comp rx=0 tx=0).stop 2024-09-11T22:18:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d2522e640 1 -- 172.21.15.50:0/3336262772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200d16d0 msgr2=0x7f4d2015a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d2522e640 1 --2- 172.21.15.50:0/3336262772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200d16d0 0x7f4d2015a430 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4d10031000 tx=0x7f4d100046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d2522e640 1 -- 172.21.15.50:0/3336262772 shutdown_connections 2024-09-11T22:18:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d2522e640 1 --2- 172.21.15.50:0/3336262772 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d0c06be30 0x7f4d0c06e2f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d2522e640 1 --2- 172.21.15.50:0/3336262772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d200d3c00 0x7f4d201f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d2522e640 1 --2- 172.21.15.50:0/3336262772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2015e870 0x7f4d20159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d2522e640 1 --2- 172.21.15.50:0/3336262772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200d16d0 0x7f4d2015a430 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d2522e640 1 -- 172.21.15.50:0/3336262772 >> 172.21.15.50:0/3336262772 conn(0x7f4d200727a0 msgr2=0x7f4d200b6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d2522e640 1 -- 172.21.15.50:0/3336262772 shutdown_connections 2024-09-11T22:18:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:39.007+0000 7f4d2522e640 1 -- 172.21.15.50:0/3336262772 wait complete. 2024-09-11T22:18:43.516 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:18:43.519 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:18:44.022 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-11T22:18:44.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-11T22:18:44.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.139+0000 7f45abec0640 1 Processor -- start 2024-09-11T22:18:44.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.139+0000 7f45abec0640 1 -- start start 2024-09-11T22:18:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45abec0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a4161fa0 0x7f45a40b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45abec0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a40cfbd0 con 0x7f45a40b1600 2024-09-11T22:18:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45abec0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a40cfeb0 con 0x7f45a40cf610 2024-09-11T22:18:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45abec0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f45a40d1220 con 0x7f45a4161fa0 2024-09-11T22:18:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45a945b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f45a40b1600 0x7f45a40cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58852/0 (socket says 172.21.15.50:58852) 2024-09-11T22:18:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45a945b640 1 -- 172.21.15.50:0/1162606466 learned_addr learned my addr 172.21.15.50:0/1162606466 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/1162606466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a4161fa0 0x7f45a40b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168061580 0 0) 0x7f45a40cfbd0 con 0x7f45a40b1600 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4590003520 con 0x7f45a40b1600 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 254140375 0 0) 0x7f4590003520 con 0x7f45a40b1600 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a4161fa0 msgr2=0x7f45a40b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45a8c5a640 1 --2- 172.21.15.50:0/1162606466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a4161fa0 0x7f45a40b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 >> v1:172.21.15.77:6789/0 conn(0x7f45a40cf610 legacy=0x7f45a40cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a40d1470 con 0x7f45a40b1600 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.140+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f4594001670 con 0x7f45a40b1600 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 >> v1:172.21.15.50:6789/0 conn(0x7f45a40b1600 legacy=0x7f45a40cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a8c5a640 1 --2- 172.21.15.50:0/1162606466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45900039e0 0x7f4590003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a8c5a640 1 --2- 172.21.15.50:0/1162606466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4590004390 0x7f4590004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a8c5a640 1 --2- 172.21.15.50:0/1162606466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a4161fa0 0x7f45900050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f45a40d1220 con 0x7f45900039e0 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f459000b9c0 con 0x7f4590004390 2024-09-11T22:18:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f459000bbc0 con 0x7f45a4161fa0 2024-09-11T22:18:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/1162606466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45900039e0 0x7f4590003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a945b640 1 --2- 172.21.15.50:0/1162606466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4590004390 0x7f4590004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45aa45d640 1 --2- 172.21.15.50:0/1162606466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a4161fa0 0x7f45900050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a9c5c640 1 -- 172.21.15.50:0/1162606466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a4161fa0 msgr2=0x7f45900050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/1162606466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a4161fa0 0x7f45900050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a9c5c640 1 -- 172.21.15.50:0/1162606466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4590004390 msgr2=0x7f4590004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/1162606466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4590004390 0x7f4590004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.141+0000 7f45a9c5c640 1 -- 172.21.15.50:0/1162606466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4590003520 con 0x7f45900039e0 2024-09-11T22:18:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.142+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/1162606466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45900039e0 0x7f4590003dc0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009ac0 tx=0x7f4590005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3004cfcc57f3178 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.142+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0036070 con 0x7f45900039e0 2024-09-11T22:18:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.142+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a0031400 con 0x7f45900039e0 2024-09-11T22:18:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.142+0000 7f45a8c5a640 1 -- 172.21.15.50:0/1162606466 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0009690 con 0x7f45900039e0 2024-09-11T22:18:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.142+0000 7f45abec0640 1 -- 172.21.15.50:0/1162606466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45900039e0 msgr2=0x7f4590003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.142+0000 7f45abec0640 1 --2- 172.21.15.50:0/1162606466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45900039e0 0x7f4590003dc0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009ac0 tx=0x7f4590005830 comp rx=0 tx=0).stop 2024-09-11T22:18:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.143+0000 7f45aa45d640 1 -- 172.21.15.50:0/1162606466 reap_dead start 2024-09-11T22:18:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.143+0000 7f45abec0640 1 -- 172.21.15.50:0/1162606466 shutdown_connections 2024-09-11T22:18:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.143+0000 7f45abec0640 1 -- 172.21.15.50:0/1162606466 >> 172.21.15.50:0/1162606466 conn(0x7f45a409ba50 msgr2=0x7f45a40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.143+0000 7f45abec0640 1 -- 172.21.15.50:0/1162606466 shutdown_connections 2024-09-11T22:18:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.143+0000 7f45abec0640 1 -- 172.21.15.50:0/1162606466 wait complete. 2024-09-11T22:18:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.144+0000 7f45abec0640 1 Processor -- start 2024-09-11T22:18:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.144+0000 7f45abec0640 1 -- start start 2024-09-11T22:18:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45abec0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45900039e0 0x7f45a40b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45abec0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a415de40 0x7f45a40b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45abec0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40cc250 0x7f45a40b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45abec0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f45a40d1c70 con 0x7f45a40cc250 2024-09-11T22:18:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45abec0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f45a40d17e0 con 0x7f45900039e0 2024-09-11T22:18:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45abec0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f45a40d1df0 con 0x7f45a415de40 2024-09-11T22:18:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45aa45d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40cc250 0x7f45a40b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45aa45d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40cc250 0x7f45a40b7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60970/0 (socket says 172.21.15.50:60970) 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45aa45d640 1 -- 172.21.15.50:0/1132821353 learned_addr learned my addr 172.21.15.50:0/1132821353 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45900039e0 0x7f45a40b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45a945b640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a415de40 0x7f45a40b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45aa45d640 1 -- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a415de40 msgr2=0x7f45a40b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45aa45d640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a415de40 0x7f45a40b79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45aa45d640 1 -- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45900039e0 msgr2=0x7f45a40b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45aa45d640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45900039e0 0x7f45a40b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45aa45d640 1 -- 172.21.15.50:0/1132821353 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a40c9060 con 0x7f45a40cc250 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45a945b640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a415de40 0x7f45a40b79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.145+0000 7f45aa45d640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40cc250 0x7f45a40b7ee0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f459c00fae0 tx=0x7f459c002180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.146+0000 7f459a7fc640 1 -- 172.21.15.50:0/1132821353 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c019070 con 0x7f45a40cc250 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.146+0000 7f459a7fc640 1 -- 172.21.15.50:0/1132821353 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c006d60 con 0x7f45a40cc250 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.146+0000 7f45abec0640 1 -- 172.21.15.50:0/1132821353 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a40c9300 con 0x7f45a40cc250 2024-09-11T22:18:44.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.146+0000 7f459a7fc640 1 -- 172.21.15.50:0/1132821353 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c003b90 con 0x7f45a40cc250 2024-09-11T22:18:44.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.146+0000 7f45abec0640 1 -- 172.21.15.50:0/1132821353 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a40b4720 con 0x7f45a40cc250 2024-09-11T22:18:44.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.147+0000 7f459a7fc640 1 -- 172.21.15.50:0/1132821353 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f459c01c070 con 0x7f45a40cc250 2024-09-11T22:18:44.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.148+0000 7f459a7fc640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f458806be60 0x7f458806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.148+0000 7f459a7fc640 1 -- 172.21.15.50:0/1132821353 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f459c08a1c0 con 0x7f45a40cc250 2024-09-11T22:18:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.148+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f458806be60 0x7f458806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.149+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f458806be60 0x7f458806e320 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009ac0 tx=0x7f45a0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.149+0000 7f45aec54740 1 Processor -- start 2024-09-11T22:18:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.149+0000 7f45aec54740 1 -- start start 2024-09-11T22:18:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45aec54740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff8087e920 0x55ff808c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45aec54740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087c0e0 0x55ff8087ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45aec54740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 0x55ff808791a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45aec54740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ff807e16f0 con 0x55ff8087c0e0 2024-09-11T22:18:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45aec54740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ff80789330 con 0x55ff8087e920 2024-09-11T22:18:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45aec54740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ff807dd6b0 con 0x55ff808800b0 2024-09-11T22:18:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45a945b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087c0e0 0x55ff8087ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45a945b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087c0e0 0x55ff8087ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60982/0 (socket says 172.21.15.50:60982) 2024-09-11T22:18:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45a945b640 1 -- 172.21.15.50:0/691105908 learned_addr learned my addr 172.21.15.50:0/691105908 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/691105908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff8087e920 0x55ff808c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45aa45d640 1 --2- 172.21.15.50:0/691105908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 0x55ff808791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45a945b640 1 -- 172.21.15.50:0/691105908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 msgr2=0x55ff808791a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45a945b640 1 --2- 172.21.15.50:0/691105908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 0x55ff808791a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45a945b640 1 -- 172.21.15.50:0/691105908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff8087e920 msgr2=0x55ff808c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45a945b640 1 --2- 172.21.15.50:0/691105908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff8087e920 0x55ff808c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.150+0000 7f45a945b640 1 -- 172.21.15.50:0/691105908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff807af0d0 con 0x55ff8087c0e0 2024-09-11T22:18:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.151+0000 7f45a945b640 1 --2- 172.21.15.50:0/691105908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087c0e0 0x55ff8087ed00 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f4594007c90 tx=0x7f4594004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d7f1f5b13ddfb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.151+0000 7f45877fe640 1 -- 172.21.15.50:0/691105908 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594004ce0 con 0x55ff8087c0e0 2024-09-11T22:18:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.151+0000 7f45877fe640 1 -- 172.21.15.50:0/691105908 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459401a070 con 0x55ff8087c0e0 2024-09-11T22:18:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.151+0000 7f45877fe640 1 -- 172.21.15.50:0/691105908 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594015670 con 0x55ff8087c0e0 2024-09-11T22:18:44.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.151+0000 7f45aec54740 1 -- 172.21.15.50:0/691105908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087c0e0 msgr2=0x55ff8087ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.151+0000 7f45aec54740 1 --2- 172.21.15.50:0/691105908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087c0e0 0x55ff8087ed00 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f4594007c90 tx=0x7f4594004bb0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.151+0000 7f45aec54740 1 -- 172.21.15.50:0/691105908 shutdown_connections 2024-09-11T22:18:44.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.151+0000 7f45aec54740 1 --2- 172.21.15.50:0/691105908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 0x55ff808791a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.151+0000 7f45aec54740 1 --2- 172.21.15.50:0/691105908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087c0e0 0x55ff8087ed00 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.151+0000 7f45aec54740 1 --2- 172.21.15.50:0/691105908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff8087e920 0x55ff808c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.151+0000 7f45aec54740 1 -- 172.21.15.50:0/691105908 >> 172.21.15.50:0/691105908 conn(0x55ff8087b370 msgr2=0x55ff808c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:44.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.151+0000 7f45aec54740 1 -- 172.21.15.50:0/691105908 shutdown_connections 2024-09-11T22:18:44.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.151+0000 7f45aec54740 1 -- 172.21.15.50:0/691105908 wait complete. 2024-09-11T22:18:44.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.152+0000 7f45aec54740 1 -- start start 2024-09-11T22:18:44.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.152+0000 7f45aec54740 1 Processor -- start 2024-09-11T22:18:44.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45aec54740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087e920 0x55ff808a6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45aec54740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 0x55ff808a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45aec54740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff808a9010 0x55ff8089ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45aec54740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ff8087a810 con 0x55ff8087e920 2024-09-11T22:18:44.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45aec54740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ff8076a4f0 con 0x55ff808a9010 2024-09-11T22:18:44.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45aec54740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ff808c48f0 con 0x55ff808800b0 2024-09-11T22:18:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45aec54740 10 client.0 _ll_register_callbacks cb 0x55ff8078bb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45a9c5c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087e920 0x55ff808a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45a9c5c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087e920 0x55ff808a6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60986/0 (socket says 172.21.15.50:60986) 2024-09-11T22:18:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45a9c5c640 1 -- 172.21.15.50:0/1662196040 learned_addr learned my addr 172.21.15.50:0/1662196040 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45a945b640 1 --2- 172.21.15.50:0/1662196040 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 0x55ff808a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45aa45d640 1 --2- 172.21.15.50:0/1662196040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff808a9010 0x55ff8089ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45a9c5c640 1 -- 172.21.15.50:0/1662196040 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 msgr2=0x55ff808a8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.153+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/1662196040 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 0x55ff808a8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f45a9c5c640 1 -- 172.21.15.50:0/1662196040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff808a9010 msgr2=0x55ff8089ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/1662196040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff808a9010 0x55ff8089ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f45a9c5c640 1 -- 172.21.15.50:0/1662196040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff805be7d0 con 0x55ff8087e920 2024-09-11T22:18:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/1662196040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087e920 0x55ff808a6420 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009be0 tx=0x7f45a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3649fb1c8ce2e6b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f4584ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f4584ff9640 1 -- 172.21.15.50:0/1662196040 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0036040 con 0x55ff8087e920 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f4584ff9640 1 -- 172.21.15.50:0/1662196040 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f45a0003a20 con 0x55ff8087e920 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f45aec54740 1 -- 172.21.15.50:0/1662196040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f459401a070 con 0x55ff8087e920 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f4584ff9640 1 -- 172.21.15.50:0/1662196040 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f45a0056050 con 0x55ff8087e920 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f45aec54740 10 client.8220 fetch_fsmap learned FSMap version 85 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f45aec54740 1 -- 172.21.15.50:0/1662196040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55ff804f43f0 con 0x55ff8087e920 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f4584ff9640 1 -- 172.21.15.50:0/1662196040 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459401a070 con 0x55ff8087e920 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f4584ff9640 1 -- 172.21.15.50:0/1662196040 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f45a0059020 con 0x55ff8087e920 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f45aec54740 10 client.8220 fetch_fsmap finished waiting for FSMap version 85 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f45aec54740 10 client.8220 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f45aec54740 20 client.8220 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f45aec54740 1 --2- 172.21.15.50:0/1662196040 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55ff8089ec80 0x55ff8089f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f45aec54740 4 client.8220 mds_command: new command op to 7324 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:18:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.154+0000 7f45aec54740 1 -- 172.21.15.50:0/1662196040 --> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff807eee20 con 0x55ff8089ec80 2024-09-11T22:18:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.155+0000 7f45a945b640 1 --2- 172.21.15.50:0/1662196040 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55ff8089ec80 0x55ff8089f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.155+0000 7f4584ff9640 10 client.8220 ms_handle_connect on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.155+0000 7f45a945b640 1 --2- 172.21.15.50:0/1662196040 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55ff8089ec80 0x55ff8089f0c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d9c6c9f9ad17f1 server_cookie=9d4473e1fd189230 in_seq=0 out_seq=0 2024-09-11T22:18:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f4584ff9640 1 -- 172.21.15.50:0/1662196040 <== mds.0 v2:172.21.15.77:6836/1480049118 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff807eee20 con 0x55ff8089ec80 2024-09-11T22:18:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f4584ff9640 10 client.8220 handle_command_reply: tid=0 2024-09-11T22:18:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f45aec54740 1 client.8220 shutdown 2024-09-11T22:18:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f45aec54740 1 -- 172.21.15.50:0/1662196040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087e920 msgr2=0x55ff808a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f45aec54740 1 --2- 172.21.15.50:0/1662196040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087e920 0x55ff808a6420 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009be0 tx=0x7f45a00046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f45aec54740 1 -- 172.21.15.50:0/1662196040 shutdown_connections 2024-09-11T22:18:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f45aec54740 1 --2- 172.21.15.50:0/1662196040 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55ff8089ec80 0x55ff8089f0c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f45aec54740 1 --2- 172.21.15.50:0/1662196040 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 0x55ff808a8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f45aec54740 1 --2- 172.21.15.50:0/1662196040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff808a9010 0x55ff8089ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f4584ff9640 0 client.8220 ms_handle_reset on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f45aec54740 1 --2- 172.21.15.50:0/1662196040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff8087e920 0x55ff808a6420 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f45aec54740 1 -- 172.21.15.50:0/1662196040 >> 172.21.15.50:0/1662196040 conn(0x55ff8087c0e0 msgr2=0x55ff808c24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f45aec54740 1 -- 172.21.15.50:0/1662196040 shutdown_connections 2024-09-11T22:18:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f45aec54740 1 -- 172.21.15.50:0/1662196040 wait complete. 2024-09-11T22:18:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.156+0000 7f45aec54740 20 client.8220 trim_cache size 0 max 16384 2024-09-11T22:18:44.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.174+0000 7f45aec54740 1 Processor -- start 2024-09-11T22:18:44.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.174+0000 7f45aec54740 1 -- start start 2024-09-11T22:18:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.174+0000 7f45aec54740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff8087e920 0x55ff808a8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.174+0000 7f45aec54740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 0x55ff808c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.174+0000 7f45aec54740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808a9010 0x55ff808e71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.174+0000 7f45aec54740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f45a4201240 con 0x55ff808a9010 2024-09-11T22:18:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.174+0000 7f45aec54740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f45a42002e0 con 0x55ff8087e920 2024-09-11T22:18:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.174+0000 7f45aec54740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f45a40cac50 con 0x55ff808800b0 2024-09-11T22:18:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f45aa45d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808a9010 0x55ff808e71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f45aa45d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808a9010 0x55ff808e71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60998/0 (socket says 172.21.15.50:60998) 2024-09-11T22:18:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f45aa45d640 1 -- 172.21.15.50:0/3960599152 learned_addr learned my addr 172.21.15.50:0/3960599152 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f45a945b640 1 --2- 172.21.15.50:0/3960599152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 0x55ff808c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/3960599152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff8087e920 0x55ff808a8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f45aa45d640 1 -- 172.21.15.50:0/3960599152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 msgr2=0x55ff808c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f45aa45d640 1 --2- 172.21.15.50:0/3960599152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 0x55ff808c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f45aa45d640 1 -- 172.21.15.50:0/3960599152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff8087e920 msgr2=0x55ff808a8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f45aa45d640 1 --2- 172.21.15.50:0/3960599152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff8087e920 0x55ff808a8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f45aa45d640 1 -- 172.21.15.50:0/3960599152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff804b40f0 con 0x55ff808a9010 2024-09-11T22:18:44.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f45aa45d640 1 --2- 172.21.15.50:0/3960599152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808a9010 0x55ff808e71b0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f459c00d5e0 tx=0x7f459c058180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b94529a1f26b72b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:44.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f4586ffd640 1 -- 172.21.15.50:0/3960599152 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c061040 con 0x55ff808a9010 2024-09-11T22:18:44.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f4586ffd640 1 -- 172.21.15.50:0/3960599152 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c085020 con 0x55ff808a9010 2024-09-11T22:18:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.175+0000 7f4586ffd640 1 -- 172.21.15.50:0/3960599152 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c056810 con 0x55ff808a9010 2024-09-11T22:18:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.176+0000 7f45aec54740 1 -- 172.21.15.50:0/3960599152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808a9010 msgr2=0x55ff808e71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.176+0000 7f45aec54740 1 --2- 172.21.15.50:0/3960599152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808a9010 0x55ff808e71b0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f459c00d5e0 tx=0x7f459c058180 comp rx=0 tx=0).stop 2024-09-11T22:18:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.176+0000 7f45aec54740 1 -- 172.21.15.50:0/3960599152 shutdown_connections 2024-09-11T22:18:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.176+0000 7f45aec54740 1 --2- 172.21.15.50:0/3960599152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff808800b0 0x55ff808c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.176+0000 7f45aec54740 1 --2- 172.21.15.50:0/3960599152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808a9010 0x55ff808e71b0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.176+0000 7f45aec54740 1 --2- 172.21.15.50:0/3960599152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff8087e920 0x55ff808a8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.176+0000 7f45aec54740 1 -- 172.21.15.50:0/3960599152 >> 172.21.15.50:0/3960599152 conn(0x55ff8087c0e0 msgr2=0x55ff8089a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.176+0000 7f45aec54740 1 -- 172.21.15.50:0/3960599152 shutdown_connections 2024-09-11T22:18:44.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.176+0000 7f45aec54740 1 -- 172.21.15.50:0/3960599152 wait complete. 2024-09-11T22:18:44.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.176+0000 7f45aec54740 1 -- start start 2024-09-11T22:18:44.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.176+0000 7f45aec54740 1 Processor -- start 2024-09-11T22:18:44.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.177+0000 7f45aec54740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff8087e920 0x55ff808e7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.177+0000 7f45aec54740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808800b0 0x55ff808e7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.177+0000 7f45aec54740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff808a9010 0x55ff80940e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.177+0000 7f45aec54740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ff808a6960 con 0x55ff808800b0 2024-09-11T22:18:44.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.177+0000 7f45aec54740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f45a41ffcc0 con 0x55ff808a9010 2024-09-11T22:18:44.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.177+0000 7f45aec54740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ff80941d40 con 0x55ff8087e920 2024-09-11T22:18:44.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.177+0000 7f45aec54740 10 client.0 _ll_register_callbacks cb 0x7f45a0009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:18:44.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.177+0000 7f45a945b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808800b0 0x55ff808e7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45a945b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808800b0 0x55ff808e7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32778/0 (socket says 172.21.15.50:32778) 2024-09-11T22:18:44.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45a945b640 1 -- 172.21.15.50:0/4291221109 learned_addr learned my addr 172.21.15.50:0/4291221109 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:44.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff8087e920 0x55ff808e7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45aa45d640 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff808a9010 0x55ff80940e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45a945b640 1 -- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff8087e920 msgr2=0x55ff808e7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45a945b640 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff8087e920 0x55ff808e7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45a945b640 1 -- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff808a9010 msgr2=0x55ff80940e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45a945b640 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff808a9010 0x55ff80940e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45a945b640 1 -- 172.21.15.50:0/4291221109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff808c68f0 con 0x55ff808800b0 2024-09-11T22:18:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff8087e920 0x55ff808e7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45aa45d640 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff808a9010 0x55ff80940e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45a945b640 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808800b0 0x55ff808e7990 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f45940018f0 tx=0x7f45940019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f290cac835a2c0c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f4584ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:18:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f4584ff9640 1 -- 172.21.15.50:0/4291221109 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459402b5b0 con 0x55ff808800b0 2024-09-11T22:18:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f4584ff9640 1 -- 172.21.15.50:0/4291221109 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f459402b750 con 0x55ff808800b0 2024-09-11T22:18:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45aec54740 1 -- 172.21.15.50:0/4291221109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f459c085020 con 0x55ff808800b0 2024-09-11T22:18:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f4584ff9640 1 -- 172.21.15.50:0/4291221109 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f459402b950 con 0x55ff808800b0 2024-09-11T22:18:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45aec54740 10 client.8226 fetch_fsmap learned FSMap version 85 2024-09-11T22:18:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.178+0000 7f45aec54740 1 -- 172.21.15.50:0/4291221109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55ff80941a80 con 0x55ff808800b0 2024-09-11T22:18:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f4584ff9640 1 -- 172.21.15.50:0/4291221109 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c085020 con 0x55ff808800b0 2024-09-11T22:18:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f4584ff9640 1 -- 172.21.15.50:0/4291221109 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7f4594004ce0 con 0x55ff808800b0 2024-09-11T22:18:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f45aec54740 10 client.8226 fetch_fsmap finished waiting for FSMap version 85 2024-09-11T22:18:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f45aec54740 10 client.8226 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-11T22:18:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f45aec54740 20 client.8226 populate_metadata read hostname 'smithi050' 2024-09-11T22:18:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f45aec54740 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55ff808a1140 0x55ff809413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f45aec54740 4 client.8226 mds_command: new command op to 7324 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:18:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f45aec54740 1 -- 172.21.15.50:0/4291221109 --> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ff807e9170 con 0x55ff808a1140 2024-09-11T22:18:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55ff808a1140 0x55ff809413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f4584ff9640 10 client.8226 ms_handle_connect on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f45a9c5c640 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55ff808a1140 0x55ff809413d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4899165152e832a server_cookie=acc7f2adc2fdad12 in_seq=0 out_seq=0 2024-09-11T22:18:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f4584ff9640 1 -- 172.21.15.50:0/4291221109 <== mds.0 v2:172.21.15.77:6836/1480049118 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ff807e9170 con 0x55ff808a1140 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f4584ff9640 10 client.8226 handle_command_reply: tid=0 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.179+0000 7f45aec54740 1 client.8226 shutdown 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45aec54740 1 -- 172.21.15.50:0/4291221109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808800b0 msgr2=0x55ff808e7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45aec54740 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808800b0 0x55ff808e7990 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f45940018f0 tx=0x7f45940019c0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45aec54740 1 -- 172.21.15.50:0/4291221109 shutdown_connections 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45aec54740 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:6836/1480049118,v1:172.21.15.77:6837/1480049118] conn(0x55ff808a1140 0x55ff809413d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45aec54740 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff808a9010 0x55ff80940e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45aec54740 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff808800b0 0x55ff808e7990 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f4584ff9640 0 client.8226 ms_handle_reset on v2:172.21.15.77:6836/1480049118 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45aec54740 1 --2- 172.21.15.50:0/4291221109 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff8087e920 0x55ff808e7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45aec54740 1 -- 172.21.15.50:0/4291221109 >> 172.21.15.50:0/4291221109 conn(0x55ff8087c0e0 msgr2=0x55ff808c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45aec54740 1 -- 172.21.15.50:0/4291221109 shutdown_connections 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45aec54740 1 -- 172.21.15.50:0/4291221109 wait complete. 2024-09-11T22:18:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45aec54740 20 client.8226 trim_cache size 0 max 16384 2024-09-11T22:18:44.189 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:18:44.189 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-11T22:18:44.189 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-11T22:18:44.189 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:18:44.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45abec0640 1 -- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f458806be60 msgr2=0x7f458806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45abec0640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f458806be60 0x7f458806e320 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009ac0 tx=0x7f45a0008030 comp rx=0 tx=0).stop 2024-09-11T22:18:44.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45abec0640 1 -- 172.21.15.50:0/1132821353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40cc250 msgr2=0x7f45a40b7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45abec0640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40cc250 0x7f45a40b7ee0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f459c00fae0 tx=0x7f459c002180 comp rx=0 tx=0).stop 2024-09-11T22:18:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45abec0640 1 -- 172.21.15.50:0/1132821353 shutdown_connections 2024-09-11T22:18:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45abec0640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f458806be60 0x7f458806e320 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45abec0640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45a415de40 0x7f45a40b79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45abec0640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40cc250 0x7f45a40b7ee0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45abec0640 1 --2- 172.21.15.50:0/1132821353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45900039e0 0x7f45a40b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45abec0640 1 -- 172.21.15.50:0/1132821353 >> 172.21.15.50:0/1132821353 conn(0x7f45a409ba50 msgr2=0x7f45a406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45abec0640 1 -- 172.21.15.50:0/1132821353 shutdown_connections 2024-09-11T22:18:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.180+0000 7f45abec0640 1 -- 172.21.15.50:0/1132821353 wait complete. 2024-09-11T22:18:44.192 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:18:44.192 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:18:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.294+0000 7f8739c53640 1 Processor -- start 2024-09-11T22:18:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.294+0000 7f8739c53640 1 -- start start 2024-09-11T22:18:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.294+0000 7f8739c53640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f87340d18a0 0x7f87340d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.294+0000 7f8739c53640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f87340d3a30 0x7f87340b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.294+0000 7f8739c53640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87340cfa80 con 0x7f873415e870 2024-09-11T22:18:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.294+0000 7f8739c53640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f87340d3ea0 con 0x7f87340d18a0 2024-09-11T22:18:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.294+0000 7f8739c53640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f87340d40d0 con 0x7f87340d3a30 2024-09-11T22:18:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.295+0000 7f8732ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f87340d18a0 0x7f87340d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.295+0000 7f8732ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f87340d18a0 0x7f87340d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32790/0 (socket says 172.21.15.50:32790) 2024-09-11T22:18:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.295+0000 7f87337fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f873415e870 0x7f87340d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58858/0 (socket says 172.21.15.50:58858) 2024-09-11T22:18:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.295+0000 7f8732ffd640 1 -- 172.21.15.50:0/1343291333 learned_addr learned my addr 172.21.15.50:0/1343291333 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.295+0000 7f8733fff640 1 --2- 172.21.15.50:0/1343291333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f87340d3a30 0x7f87340b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.295+0000 7f8732ffd640 1 -- 172.21.15.50:0/1343291333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f87340d3a30 msgr2=0x7f87340b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.295+0000 7f8732ffd640 1 --2- 172.21.15.50:0/1343291333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f87340d3a30 0x7f87340b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.295+0000 7f8732ffd640 1 -- 172.21.15.50:0/1343291333 >> v1:172.21.15.50:6789/0 conn(0x7f873415e870 legacy=0x7f87340d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.295+0000 7f8732ffd640 1 -- 172.21.15.50:0/1343291333 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87340d43b0 con 0x7f87340d18a0 2024-09-11T22:18:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.295+0000 7f87327fc640 1 -- 172.21.15.50:0/1343291333 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294275786 0 0) 0x7f8724001110 con 0x7f873415e870 2024-09-11T22:18:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.295+0000 7f8733fff640 1 --2- 172.21.15.50:0/1343291333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f87340d3a30 0x7f87340b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:44.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.296+0000 7f8732ffd640 1 --2- 172.21.15.50:0/1343291333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340d18a0 0x7f87340d34f0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f8728009870 tx=0x7f872802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797a04380d6fa509 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.296+0000 7f87327fc640 1 -- 172.21.15.50:0/1343291333 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728037070 con 0x7f87340d18a0 2024-09-11T22:18:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.296+0000 7f87327fc640 1 -- 172.21.15.50:0/1343291333 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8728032440 con 0x7f87340d18a0 2024-09-11T22:18:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.296+0000 7f87327fc640 1 -- 172.21.15.50:0/1343291333 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728032810 con 0x7f87340d18a0 2024-09-11T22:18:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.296+0000 7f8739c53640 1 -- 172.21.15.50:0/1343291333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340d18a0 msgr2=0x7f87340d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.296+0000 7f8739c53640 1 --2- 172.21.15.50:0/1343291333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340d18a0 0x7f87340d34f0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f8728009870 tx=0x7f872802a270 comp rx=0 tx=0).stop 2024-09-11T22:18:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.296+0000 7f8739c53640 1 -- 172.21.15.50:0/1343291333 shutdown_connections 2024-09-11T22:18:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.296+0000 7f8739c53640 1 --2- 172.21.15.50:0/1343291333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f87340d3a30 0x7f87340b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.296+0000 7f8739c53640 1 --2- 172.21.15.50:0/1343291333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340d18a0 0x7f87340d34f0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.296+0000 7f8739c53640 1 -- 172.21.15.50:0/1343291333 >> 172.21.15.50:0/1343291333 conn(0x7f87340727a0 msgr2=0x7f87340679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.296+0000 7f8739c53640 1 -- 172.21.15.50:0/1343291333 shutdown_connections 2024-09-11T22:18:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.296+0000 7f8739c53640 1 -- 172.21.15.50:0/1343291333 wait complete. 2024-09-11T22:18:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.298+0000 7f8739c53640 1 Processor -- start 2024-09-11T22:18:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.298+0000 7f8739c53640 1 -- start start 2024-09-11T22:18:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.298+0000 7f8739c53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340d18a0 0x7f87341e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.298+0000 7f8739c53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87340d3a30 0x7f87341e79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.298+0000 7f8739c53640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f873415e870 0x7f873415d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.298+0000 7f8739c53640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f873415ec50 con 0x7f87340d18a0 2024-09-11T22:18:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.298+0000 7f8739c53640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f87340b7ee0 con 0x7f87340d3a30 2024-09-11T22:18:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.298+0000 7f8739c53640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f87340b78b0 con 0x7f873415e870 2024-09-11T22:18:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f87337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340d18a0 0x7f87341e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f87337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340d18a0 0x7f87341e8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32796/0 (socket says 172.21.15.50:32796) 2024-09-11T22:18:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f87337fe640 1 -- 172.21.15.50:0/2542670932 learned_addr learned my addr 172.21.15.50:0/2542670932 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f8733fff640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f873415e870 0x7f873415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f8732ffd640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87340d3a30 0x7f87341e79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f87337fe640 1 -- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f873415e870 msgr2=0x7f873415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f87337fe640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f873415e870 0x7f873415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f87337fe640 1 -- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87340d3a30 msgr2=0x7f87341e79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f87337fe640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87340d3a30 0x7f87341e79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f87337fe640 1 -- 172.21.15.50:0/2542670932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87341e7f10 con 0x7f87340d18a0 2024-09-11T22:18:44.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f8732ffd640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87340d3a30 0x7f87341e79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:44.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f87337fe640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340d18a0 0x7f87341e8150 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f872400c780 tx=0x7f872400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:44.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f871bfff640 1 -- 172.21.15.50:0/2542670932 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724018070 con 0x7f87340d18a0 2024-09-11T22:18:44.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f871bfff640 1 -- 172.21.15.50:0/2542670932 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8724007290 con 0x7f87340d18a0 2024-09-11T22:18:44.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f8739c53640 1 -- 172.21.15.50:0/2542670932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87341e87e0 con 0x7f87340d18a0 2024-09-11T22:18:44.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f871bfff640 1 -- 172.21.15.50:0/2542670932 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724007680 con 0x7f87340d18a0 2024-09-11T22:18:44.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.299+0000 7f8739c53640 1 -- 172.21.15.50:0/2542670932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87341ea770 con 0x7f87340d18a0 2024-09-11T22:18:44.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.300+0000 7f8739c53640 1 -- 172.21.15.50:0/2542670932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87340d34f0 con 0x7f87340d18a0 2024-09-11T22:18:44.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.301+0000 7f871bfff640 1 -- 172.21.15.50:0/2542670932 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f872401b070 con 0x7f87340d18a0 2024-09-11T22:18:44.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.301+0000 7f871bfff640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f872006be30 0x7f872006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.301+0000 7f871bfff640 1 -- 172.21.15.50:0/2542670932 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f872408a040 con 0x7f87340d18a0 2024-09-11T22:18:44.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.302+0000 7f8732ffd640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f872006be30 0x7f872006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.302+0000 7f8732ffd640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f872006be30 0x7f872006e2f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8728034000 tx=0x7f872802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.306+0000 7f871bfff640 1 -- 172.21.15.50:0/2542670932 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87340cfa80 con 0x7f87340d18a0 2024-09-11T22:18:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.519+0000 7f8739c53640 1 -- 172.21.15.50:0/2542670932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87340d2ca0 con 0x7f87340d18a0 2024-09-11T22:18:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.519+0000 7f871bfff640 1 -- 172.21.15.50:0/2542670932 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5225 (secure 0 0 0) 0x7f8724058a80 con 0x7f87340d18a0 2024-09-11T22:18:44.520 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:44.520 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"btime":"2024-09-11T22:18:18:030997+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1864699161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1864699161},{"type":"v1","addr":"172.21.15.77:6835","nonce":1864699161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3677751855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3677751855},{"type":"v1","addr":"172.21.15.50:6834","nonce":3677751855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7315,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2276588552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2276588552},{"type":"v1","addr":"172.21.15.50:6835","nonce":2276588552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:18:14.748913+0000","modified":"2024-09-11T22:18:17.383059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7324":{"gid":7324,"name":"d","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1480049118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1480049118},{"type":"v1","addr":"172.21.15.77:6837","nonce":1480049118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7324,"qdb_cluster":[7324]},"id":8}]} 2024-09-11T22:18:44.521 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2024-09-11T22:18:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.521+0000 7f8739c53640 1 -- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f872006be30 msgr2=0x7f872006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.521+0000 7f8739c53640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f872006be30 0x7f872006e2f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8728034000 tx=0x7f872802e000 comp rx=0 tx=0).stop 2024-09-11T22:18:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.521+0000 7f8739c53640 1 -- 172.21.15.50:0/2542670932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340d18a0 msgr2=0x7f87341e8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.521+0000 7f8739c53640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340d18a0 0x7f87341e8150 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f872400c780 tx=0x7f872400cc40 comp rx=0 tx=0).stop 2024-09-11T22:18:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.521+0000 7f8739c53640 1 -- 172.21.15.50:0/2542670932 shutdown_connections 2024-09-11T22:18:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.521+0000 7f8739c53640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f872006be30 0x7f872006e2f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.521+0000 7f8739c53640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f873415e870 0x7f873415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.521+0000 7f8739c53640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87340d3a30 0x7f87341e79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.521+0000 7f8739c53640 1 --2- 172.21.15.50:0/2542670932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340d18a0 0x7f87341e8150 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.521+0000 7f8739c53640 1 -- 172.21.15.50:0/2542670932 >> 172.21.15.50:0/2542670932 conn(0x7f87340727a0 msgr2=0x7f87340b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.522+0000 7f8739c53640 1 -- 172.21.15.50:0/2542670932 shutdown_connections 2024-09-11T22:18:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.522+0000 7f8739c53640 1 -- 172.21.15.50:0/2542670932 wait complete. 2024-09-11T22:18:44.533 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-11T22:18:44.533 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:18:44.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.633+0000 7f7c63e5e640 1 Processor -- start 2024-09-11T22:18:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.634+0000 7f7c63e5e640 1 -- start start 2024-09-11T22:18:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.634+0000 7f7c63e5e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c5c15b400 0x7f7c5c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.634+0000 7f7c63e5e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5c072e60 0x7f7c5c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.634+0000 7f7c63e5e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7c5c06df20 0x7f7c5c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.634+0000 7f7c63e5e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7c5c15b7e0 con 0x7f7c5c15b400 2024-09-11T22:18:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.634+0000 7f7c63e5e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7c5c15f140 con 0x7f7c5c06df20 2024-09-11T22:18:44.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.634+0000 7f7c63e5e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c5c15f420 con 0x7f7c5c072e60 2024-09-11T22:18:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.635+0000 7f7c61bfa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c5c15b400 0x7f7c5c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.635+0000 7f7c61bfa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c5c15b400 0x7f7c5c06d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32800/0 (socket says 172.21.15.50:32800) 2024-09-11T22:18:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.635+0000 7f7c61bfa640 1 -- 172.21.15.50:0/3467781279 learned_addr learned my addr 172.21.15.50:0/3467781279 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.635+0000 7f7c61bfa640 1 -- 172.21.15.50:0/3467781279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5c072e60 msgr2=0x7f7c5c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.635+0000 7f7c61bfa640 1 --2- 172.21.15.50:0/3467781279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5c072e60 0x7f7c5c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.635+0000 7f7c61bfa640 1 -- 172.21.15.50:0/3467781279 >> v2:172.21.15.77:3300/0 conn(0x7f7c5c06df20 msgr2=0x7f7c5c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.635+0000 7f7c623fb640 1 --2- 172.21.15.50:0/3467781279 >> v2:172.21.15.77:3300/0 conn(0x7f7c5c06df20 0x7f7c5c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.635+0000 7f7c61bfa640 1 --2- 172.21.15.50:0/3467781279 >> v2:172.21.15.77:3300/0 conn(0x7f7c5c06df20 0x7f7c5c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.635+0000 7f7c61bfa640 1 -- 172.21.15.50:0/3467781279 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5c15f700 con 0x7f7c5c15b400 2024-09-11T22:18:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.635+0000 7f7c623fb640 1 --2- 172.21.15.50:0/3467781279 >> v2:172.21.15.77:3300/0 conn(0x7f7c5c06df20 0x7f7c5c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.636+0000 7f7c61bfa640 1 --2- 172.21.15.50:0/3467781279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5c15b400 0x7f7c5c06d070 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0cf730 tx=0x7f7c4c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d409cfd052ab5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.636+0000 7f7c60bf8640 1 -- 172.21.15.50:0/3467781279 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c036070 con 0x7f7c5c15b400 2024-09-11T22:18:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.636+0000 7f7c60bf8640 1 -- 172.21.15.50:0/3467781279 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4c031600 con 0x7f7c5c15b400 2024-09-11T22:18:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.636+0000 7f7c60bf8640 1 -- 172.21.15.50:0/3467781279 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c0319d0 con 0x7f7c5c15b400 2024-09-11T22:18:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.636+0000 7f7c63e5e640 1 -- 172.21.15.50:0/3467781279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5c15b400 msgr2=0x7f7c5c06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.636+0000 7f7c63e5e640 1 --2- 172.21.15.50:0/3467781279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5c15b400 0x7f7c5c06d070 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0cf730 tx=0x7f7c4c02a6a0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.636+0000 7f7c63e5e640 1 -- 172.21.15.50:0/3467781279 shutdown_connections 2024-09-11T22:18:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.636+0000 7f7c63e5e640 1 --2- 172.21.15.50:0/3467781279 >> v2:172.21.15.77:3300/0 conn(0x7f7c5c06df20 0x7f7c5c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.636+0000 7f7c63e5e640 1 --2- 172.21.15.50:0/3467781279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5c072e60 0x7f7c5c06d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.636+0000 7f7c63e5e640 1 --2- 172.21.15.50:0/3467781279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5c15b400 0x7f7c5c06d070 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.636+0000 7f7c63e5e640 1 -- 172.21.15.50:0/3467781279 >> 172.21.15.50:0/3467781279 conn(0x7f7c5c0679c0 msgr2=0x7f7c5c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.637+0000 7f7c63e5e640 1 -- 172.21.15.50:0/3467781279 shutdown_connections 2024-09-11T22:18:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.637+0000 7f7c63e5e640 1 -- 172.21.15.50:0/3467781279 wait complete. 2024-09-11T22:18:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.638+0000 7f7c63e5e640 1 Processor -- start 2024-09-11T22:18:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.638+0000 7f7c63e5e640 1 -- start start 2024-09-11T22:18:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.638+0000 7f7c63e5e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5c06df20 0x7f7c5c0aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.638+0000 7f7c63e5e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5c072e60 0x7f7c5c1434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.638+0000 7f7c63e5e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c5c15b400 0x7f7c5c143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c63e5e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c0b4b50 con 0x7f7c5c06df20 2024-09-11T22:18:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c63e5e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c0cfc50 con 0x7f7c5c15b400 2024-09-11T22:18:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c63e5e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c5c0b4cd0 con 0x7f7c5c072e60 2024-09-11T22:18:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c61bfa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5c06df20 0x7f7c5c0aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c61bfa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5c06df20 0x7f7c5c0aa4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32806/0 (socket says 172.21.15.50:32806) 2024-09-11T22:18:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c61bfa640 1 -- 172.21.15.50:0/1926151875 learned_addr learned my addr 172.21.15.50:0/1926151875 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c613f9640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5c072e60 0x7f7c5c1434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c623fb640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c5c15b400 0x7f7c5c143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c61bfa640 1 -- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5c072e60 msgr2=0x7f7c5c1434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c61bfa640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5c072e60 0x7f7c5c1434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c61bfa640 1 -- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c5c15b400 msgr2=0x7f7c5c143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c61bfa640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c5c15b400 0x7f7c5c143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c61bfa640 1 -- 172.21.15.50:0/1926151875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5c144360 con 0x7f7c5c06df20 2024-09-11T22:18:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c61bfa640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5c06df20 0x7f7c5c0aa4b0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c034040 tx=0x7f7c4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c5a7fc640 1 -- 172.21.15.50:0/1926151875 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c041020 con 0x7f7c5c06df20 2024-09-11T22:18:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c5a7fc640 1 -- 172.21.15.50:0/1926151875 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4c007800 con 0x7f7c5c06df20 2024-09-11T22:18:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c5a7fc640 1 -- 172.21.15.50:0/1926151875 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c036040 con 0x7f7c5c06df20 2024-09-11T22:18:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c63e5e640 1 -- 172.21.15.50:0/1926151875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5c144640 con 0x7f7c5c06df20 2024-09-11T22:18:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.639+0000 7f7c63e5e640 1 -- 172.21.15.50:0/1926151875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c5c144c00 con 0x7f7c5c06df20 2024-09-11T22:18:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.640+0000 7f7c63e5e640 1 -- 172.21.15.50:0/1926151875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c5c0b5100 con 0x7f7c5c06df20 2024-09-11T22:18:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.641+0000 7f7c5a7fc640 1 -- 172.21.15.50:0/1926151875 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c4c044020 con 0x7f7c5c06df20 2024-09-11T22:18:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.641+0000 7f7c5a7fc640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c4806be30 0x7f7c4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.641+0000 7f7c5a7fc640 1 -- 172.21.15.50:0/1926151875 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f7c4c0abd40 con 0x7f7c5c06df20 2024-09-11T22:18:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.642+0000 7f7c613f9640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c4806be30 0x7f7c4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.642+0000 7f7c613f9640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c4806be30 0x7f7c4806e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0af830 tx=0x7f7c50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.646+0000 7f7c5a7fc640 1 -- 172.21.15.50:0/1926151875 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c4c04b030 con 0x7f7c5c06df20 2024-09-11T22:18:44.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.890+0000 7f7c63e5e640 1 -- 172.21.15.50:0/1926151875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7c5c072230 con 0x7f7c5c06df20 2024-09-11T22:18:44.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.890+0000 7f7c5a7fc640 1 -- 172.21.15.50:0/1926151875 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1230 (secure 0 0 0) 0x7f7c4c07a660 con 0x7f7c5c06df20 2024-09-11T22:18:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:44.891 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":473,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":120,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1075939160,"bytes_used":2567831552,"bytes_avail":770526281728,"bytes_total":773094113280,"write_bytes_sec":66974974,"read_op_per_sec":0,"write_op_per_sec":66},"fsmap":{"epoch":85,"btime":"2024-09-11T22:18:18:030997+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":7324}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-11T22:17:37.458664+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:18:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.892+0000 7f7c63e5e640 1 -- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c4806be30 msgr2=0x7f7c4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.892+0000 7f7c63e5e640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c4806be30 0x7f7c4806e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0af830 tx=0x7f7c50008040 comp rx=0 tx=0).stop 2024-09-11T22:18:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.892+0000 7f7c63e5e640 1 -- 172.21.15.50:0/1926151875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5c06df20 msgr2=0x7f7c5c0aa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.892+0000 7f7c63e5e640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5c06df20 0x7f7c5c0aa4b0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c034040 tx=0x7f7c4c004a40 comp rx=0 tx=0).stop 2024-09-11T22:18:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.892+0000 7f7c63e5e640 1 -- 172.21.15.50:0/1926151875 shutdown_connections 2024-09-11T22:18:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.892+0000 7f7c63e5e640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c4806be30 0x7f7c4806e2f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.892+0000 7f7c63e5e640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5c072e60 0x7f7c5c1434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.892+0000 7f7c63e5e640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c5c15b400 0x7f7c5c143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.892+0000 7f7c63e5e640 1 --2- 172.21.15.50:0/1926151875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5c06df20 0x7f7c5c0aa4b0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.892+0000 7f7c63e5e640 1 -- 172.21.15.50:0/1926151875 >> 172.21.15.50:0/1926151875 conn(0x7f7c5c0679c0 msgr2=0x7f7c5c0b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.892+0000 7f7c63e5e640 1 -- 172.21.15.50:0/1926151875 shutdown_connections 2024-09-11T22:18:44.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:44.892+0000 7f7c63e5e640 1 -- 172.21.15.50:0/1926151875 wait complete. 2024-09-11T22:18:44.904 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-11T22:18:44.904 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:18:44.904 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:18:44.949 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:18:44.999 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:18:44.999 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:18:44.999 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:18:44.999 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:45.016 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:18:45.016 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:45.071 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:18:45.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.214+0000 7fb73d7c4640 1 Processor -- start 2024-09-11T22:18:45.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.214+0000 7fb73d7c4640 1 -- start start 2024-09-11T22:18:45.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.215+0000 7fb73d7c4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb73815e840 0x7fb7380b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.215+0000 7fb73d7c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7380cf580 0x7fb73806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.215+0000 7fb73d7c4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7380ce5f0 con 0x7fb7380cdd50 2024-09-11T22:18:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.215+0000 7fb73d7c4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb73806c240 con 0x7fb7380cf580 2024-09-11T22:18:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.215+0000 7fb73d7c4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb7380d0470 con 0x7fb73815e840 2024-09-11T22:18:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.215+0000 7fb7377fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7380cf580 0x7fb73806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.215+0000 7fb7377fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7380cf580 0x7fb73806c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32808/0 (socket says 172.21.15.50:32808) 2024-09-11T22:18:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.215+0000 7fb7377fe640 1 -- 172.21.15.50:0/296756057 learned_addr learned my addr 172.21.15.50:0/296756057 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.215+0000 7fb7367fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb7380cdd50 0x7fb7380cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58872/0 (socket says 172.21.15.50:58872) 2024-09-11T22:18:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.216+0000 7fb7377fe640 1 -- 172.21.15.50:0/296756057 >> v2:172.21.15.77:3300/0 conn(0x7fb73815e840 msgr2=0x7fb7380b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.216+0000 7fb736ffd640 1 --2- 172.21.15.50:0/296756057 >> v2:172.21.15.77:3300/0 conn(0x7fb73815e840 0x7fb7380b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.216+0000 7fb7377fe640 1 --2- 172.21.15.50:0/296756057 >> v2:172.21.15.77:3300/0 conn(0x7fb73815e840 0x7fb7380b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.216+0000 7fb7377fe640 1 -- 172.21.15.50:0/296756057 >> v1:172.21.15.50:6789/0 conn(0x7fb7380cdd50 legacy=0x7fb7380cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.216+0000 7fb735ffb640 1 -- 172.21.15.50:0/296756057 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878352115 0 0) 0x7fb7380ce5f0 con 0x7fb7380cdd50 2024-09-11T22:18:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.216+0000 7fb7377fe640 1 -- 172.21.15.50:0/296756057 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7380ce310 con 0x7fb7380cf580 2024-09-11T22:18:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.216+0000 7fb7377fe640 1 --2- 172.21.15.50:0/296756057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7380cf580 0x7fb73806c6d0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fb7380694b0 tx=0x7fb72802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237fa09312104b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.216+0000 7fb735ffb640 1 -- 172.21.15.50:0/296756057 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728036070 con 0x7fb7380cf580 2024-09-11T22:18:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.217+0000 7fb735ffb640 1 -- 172.21.15.50:0/296756057 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb728031600 con 0x7fb7380cf580 2024-09-11T22:18:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.217+0000 7fb735ffb640 1 -- 172.21.15.50:0/296756057 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7280319d0 con 0x7fb7380cf580 2024-09-11T22:18:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.217+0000 7fb73d7c4640 1 -- 172.21.15.50:0/296756057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7380cf580 msgr2=0x7fb73806c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.217+0000 7fb73d7c4640 1 --2- 172.21.15.50:0/296756057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7380cf580 0x7fb73806c6d0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fb7380694b0 tx=0x7fb72802a730 comp rx=0 tx=0).stop 2024-09-11T22:18:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.217+0000 7fb73d7c4640 1 -- 172.21.15.50:0/296756057 shutdown_connections 2024-09-11T22:18:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.217+0000 7fb73d7c4640 1 --2- 172.21.15.50:0/296756057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7380cf580 0x7fb73806c6d0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.217+0000 7fb73d7c4640 1 --2- 172.21.15.50:0/296756057 >> v2:172.21.15.77:3300/0 conn(0x7fb73815e840 0x7fb7380b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.217+0000 7fb73d7c4640 1 -- 172.21.15.50:0/296756057 >> 172.21.15.50:0/296756057 conn(0x7fb7380b4150 msgr2=0x7fb7380b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.217+0000 7fb73d7c4640 1 -- 172.21.15.50:0/296756057 shutdown_connections 2024-09-11T22:18:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.217+0000 7fb73d7c4640 1 -- 172.21.15.50:0/296756057 wait complete. 2024-09-11T22:18:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.218+0000 7fb73d7c4640 1 Processor -- start 2024-09-11T22:18:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.219+0000 7fb73d7c4640 1 -- start start 2024-09-11T22:18:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.219+0000 7fb73d7c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7380cdd50 0x7fb73815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.219+0000 7fb73d7c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7380cf580 0x7fb73815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.219+0000 7fb73d7c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb73815e840 0x7fb73815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.219+0000 7fb73d7c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb73815ec20 con 0x7fb7380cf580 2024-09-11T22:18:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.219+0000 7fb73d7c4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb73806bed0 con 0x7fb73815e840 2024-09-11T22:18:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.219+0000 7fb73d7c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb73815eda0 con 0x7fb7380cdd50 2024-09-11T22:18:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.219+0000 7fb7367fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7380cf580 0x7fb73815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.219+0000 7fb7367fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7380cf580 0x7fb73815c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32818/0 (socket says 172.21.15.50:32818) 2024-09-11T22:18:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.219+0000 7fb7367fc640 1 -- 172.21.15.50:0/742054066 learned_addr learned my addr 172.21.15.50:0/742054066 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.219+0000 7fb7377fe640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb73815e840 0x7fb73815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.219+0000 7fb736ffd640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7380cdd50 0x7fb73815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.220+0000 7fb7367fc640 1 -- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7380cdd50 msgr2=0x7fb73815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.220+0000 7fb7367fc640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7380cdd50 0x7fb73815bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.220+0000 7fb7367fc640 1 -- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb73815e840 msgr2=0x7fb73815cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.220+0000 7fb7367fc640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb73815e840 0x7fb73815cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.220+0000 7fb7367fc640 1 -- 172.21.15.50:0/742054066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7380b66f0 con 0x7fb7380cf580 2024-09-11T22:18:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.220+0000 7fb7367fc640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7380cf580 0x7fb73815c870 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fb72000c4d0 tx=0x7fb72000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.220+0000 7fb72f7fe640 1 -- 172.21.15.50:0/742054066 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720018070 con 0x7fb7380cf580 2024-09-11T22:18:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.220+0000 7fb72f7fe640 1 -- 172.21.15.50:0/742054066 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb720007500 con 0x7fb7380cf580 2024-09-11T22:18:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.220+0000 7fb72f7fe640 1 -- 172.21.15.50:0/742054066 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720004a20 con 0x7fb7380cf580 2024-09-11T22:18:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.220+0000 7fb73d7c4640 1 -- 172.21.15.50:0/742054066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7380b69d0 con 0x7fb7380cf580 2024-09-11T22:18:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.220+0000 7fb73d7c4640 1 -- 172.21.15.50:0/742054066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7380b6f90 con 0x7fb7380cf580 2024-09-11T22:18:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.221+0000 7fb73d7c4640 1 -- 172.21.15.50:0/742054066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7380b4c70 con 0x7fb7380cf580 2024-09-11T22:18:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.222+0000 7fb72f7fe640 1 -- 172.21.15.50:0/742054066 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb72001b070 con 0x7fb7380cf580 2024-09-11T22:18:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.222+0000 7fb72f7fe640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb71806be30 0x7fb71806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.222+0000 7fb72f7fe640 1 -- 172.21.15.50:0/742054066 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fb72008a0a0 con 0x7fb7380cf580 2024-09-11T22:18:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.222+0000 7fb736ffd640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb71806be30 0x7fb71806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.223+0000 7fb736ffd640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb71806be30 0x7fb71806e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb738070db0 tx=0x7fb730008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:45.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.226+0000 7fb72f7fe640 1 -- 172.21.15.50:0/742054066 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb720058490 con 0x7fb7380cf580 2024-09-11T22:18:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.414+0000 7fb73d7c4640 1 -- 172.21.15.50:0/742054066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb7380cfa00 con 0x7fb7380cf580 2024-09-11T22:18:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.414+0000 7fb72f7fe640 1 -- 172.21.15.50:0/742054066 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v120) ==== 80+0+0 (secure 0 0 0) 0x7fb72005c790 con 0x7fb7380cf580 2024-09-11T22:18:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:18:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.417+0000 7fb73d7c4640 1 -- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb71806be30 msgr2=0x7fb71806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.417+0000 7fb73d7c4640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb71806be30 0x7fb71806e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb738070db0 tx=0x7fb730008040 comp rx=0 tx=0).stop 2024-09-11T22:18:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.417+0000 7fb73d7c4640 1 -- 172.21.15.50:0/742054066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7380cf580 msgr2=0x7fb73815c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.417+0000 7fb73d7c4640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7380cf580 0x7fb73815c870 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fb72000c4d0 tx=0x7fb72000c990 comp rx=0 tx=0).stop 2024-09-11T22:18:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.417+0000 7fb73d7c4640 1 -- 172.21.15.50:0/742054066 shutdown_connections 2024-09-11T22:18:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.417+0000 7fb73d7c4640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb71806be30 0x7fb71806e2f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.417+0000 7fb73d7c4640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb73815e840 0x7fb73815cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:45.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.417+0000 7fb73d7c4640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7380cf580 0x7fb73815c870 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:45.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.417+0000 7fb73d7c4640 1 --2- 172.21.15.50:0/742054066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7380cdd50 0x7fb73815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:45.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.417+0000 7fb73d7c4640 1 -- 172.21.15.50:0/742054066 >> 172.21.15.50:0/742054066 conn(0x7fb7380b4150 msgr2=0x7fb7380b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:45.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.417+0000 7fb73d7c4640 1 -- 172.21.15.50:0/742054066 shutdown_connections 2024-09-11T22:18:45.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:45.417+0000 7fb73d7c4640 1 -- 172.21.15.50:0/742054066 wait complete. 2024-09-11T22:18:45.428 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:18:45.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:45.429 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:18:46.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:18:46.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:18:46.062 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:18:46.084 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:18:46.085 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:18:46.085 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:46.100 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:18:46.100 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:18:46.100 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:18:46.101 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:46.141 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:18:46.141 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:18:46.141 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:18:46.141 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:46.157 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:18:46.157 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:18:46.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.283+0000 7f8c50694640 1 Processor -- start 2024-09-11T22:18:46.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.283+0000 7f8c50694640 1 -- start start 2024-09-11T22:18:46.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c50694640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c4815c2c0 0x7f8c480b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c50694640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c480d05e0 0x7f8c480ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c50694640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c480b4f00 con 0x7f8c480b3e10 2024-09-11T22:18:46.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c50694640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8c480b4360 con 0x7f8c480d05e0 2024-09-11T22:18:46.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c50694640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8c480b51c0 con 0x7f8c4815c2c0 2024-09-11T22:18:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c4ec31640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c480d05e0 0x7f8c480ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c4dc2f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8c480b3e10 0x7f8c480cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58888/0 (socket says 172.21.15.50:58888) 2024-09-11T22:18:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c4dc2f640 1 -- 172.21.15.50:0/1792593374 learned_addr learned my addr 172.21.15.50:0/1792593374 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c4e430640 1 --2- 172.21.15.50:0/1792593374 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c4815c2c0 0x7f8c480b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c4ec31640 1 -- 172.21.15.50:0/1792593374 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c4815c2c0 msgr2=0x7f8c480b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c4ec31640 1 --2- 172.21.15.50:0/1792593374 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c4815c2c0 0x7f8c480b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c4ec31640 1 -- 172.21.15.50:0/1792593374 >> v1:172.21.15.50:6789/0 conn(0x7f8c480b3e10 legacy=0x7f8c480cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c4ec31640 1 -- 172.21.15.50:0/1792593374 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c480b54a0 con 0x7f8c480d05e0 2024-09-11T22:18:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.284+0000 7f8c4d42e640 1 -- 172.21.15.50:0/1792593374 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 15850213 0 0) 0x7f8c480b4f00 con 0x7f8c480b3e10 2024-09-11T22:18:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.285+0000 7f8c4ec31640 1 --2- 172.21.15.50:0/1792593374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c480d05e0 0x7f8c480ce790 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009d90 tx=0x7f8c4002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d59cee010ee4d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.285+0000 7f8c4d42e640 1 -- 172.21.15.50:0/1792593374 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c40031600 con 0x7f8c480d05e0 2024-09-11T22:18:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.285+0000 7f8c4d42e640 1 -- 172.21.15.50:0/1792593374 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c400317a0 con 0x7f8c480d05e0 2024-09-11T22:18:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.285+0000 7f8c4d42e640 1 -- 172.21.15.50:0/1792593374 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c40031b70 con 0x7f8c480d05e0 2024-09-11T22:18:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.286+0000 7f8c50694640 1 -- 172.21.15.50:0/1792593374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c480d05e0 msgr2=0x7f8c480ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.286+0000 7f8c50694640 1 --2- 172.21.15.50:0/1792593374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c480d05e0 0x7f8c480ce790 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009d90 tx=0x7f8c4002a5d0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.286+0000 7f8c50694640 1 -- 172.21.15.50:0/1792593374 shutdown_connections 2024-09-11T22:18:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.286+0000 7f8c50694640 1 --2- 172.21.15.50:0/1792593374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c480d05e0 0x7f8c480ce790 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.286+0000 7f8c50694640 1 --2- 172.21.15.50:0/1792593374 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c4815c2c0 0x7f8c480b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.286+0000 7f8c50694640 1 -- 172.21.15.50:0/1792593374 >> 172.21.15.50:0/1792593374 conn(0x7f8c480679c0 msgr2=0x7f8c48067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.286+0000 7f8c50694640 1 -- 172.21.15.50:0/1792593374 shutdown_connections 2024-09-11T22:18:46.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.286+0000 7f8c50694640 1 -- 172.21.15.50:0/1792593374 wait complete. 2024-09-11T22:18:46.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.287+0000 7f8c50694640 1 Processor -- start 2024-09-11T22:18:46.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.287+0000 7f8c50694640 1 -- start start 2024-09-11T22:18:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c50694640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c480b3e10 0x7f8c4815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c50694640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c480d05e0 0x7f8c4813ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c50694640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c4815c2c0 0x7f8c4815f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c50694640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4806d070 con 0x7f8c480b3e10 2024-09-11T22:18:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c50694640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480ce200 con 0x7f8c4815c2c0 2024-09-11T22:18:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c50694640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4806d1f0 con 0x7f8c480d05e0 2024-09-11T22:18:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c4e430640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c480b3e10 0x7f8c4815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c4e430640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c480b3e10 0x7f8c4815ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32842/0 (socket says 172.21.15.50:32842) 2024-09-11T22:18:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c4e430640 1 -- 172.21.15.50:0/1296661329 learned_addr learned my addr 172.21.15.50:0/1296661329 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c4dc2f640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c480d05e0 0x7f8c4813ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c4ec31640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c4815c2c0 0x7f8c4815f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c4e430640 1 -- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c480d05e0 msgr2=0x7f8c4813ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c4e430640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c480d05e0 0x7f8c4813ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c4e430640 1 -- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c4815c2c0 msgr2=0x7f8c4815f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c4e430640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c4815c2c0 0x7f8c4815f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c4e430640 1 -- 172.21.15.50:0/1296661329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4814eca0 con 0x7f8c480b3e10 2024-09-11T22:18:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c4e430640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c480b3e10 0x7f8c4815ac30 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400d5f0 tx=0x7f8c4400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c3effd640 1 -- 172.21.15.50:0/1296661329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c440125f0 con 0x7f8c480b3e10 2024-09-11T22:18:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c3effd640 1 -- 172.21.15.50:0/1296661329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c44019070 con 0x7f8c480b3e10 2024-09-11T22:18:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c50694640 1 -- 172.21.15.50:0/1296661329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c481598b0 con 0x7f8c480b3e10 2024-09-11T22:18:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c3effd640 1 -- 172.21.15.50:0/1296661329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c440129d0 con 0x7f8c480b3e10 2024-09-11T22:18:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.288+0000 7f8c50694640 1 -- 172.21.15.50:0/1296661329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c4815a150 con 0x7f8c480b3e10 2024-09-11T22:18:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.289+0000 7f8c50694640 1 -- 172.21.15.50:0/1296661329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c480d0b40 con 0x7f8c480b3e10 2024-09-11T22:18:46.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.290+0000 7f8c3effd640 1 -- 172.21.15.50:0/1296661329 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c44012b70 con 0x7f8c480b3e10 2024-09-11T22:18:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.290+0000 7f8c3effd640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8c2c06be30 0x7f8c2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.291+0000 7f8c3effd640 1 -- 172.21.15.50:0/1296661329 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f8c4408b2e0 con 0x7f8c480b3e10 2024-09-11T22:18:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.291+0000 7f8c4dc2f640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8c2c06be30 0x7f8c2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.291+0000 7f8c4dc2f640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8c2c06be30 0x7f8c2c06e2f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8c38007fd0 tx=0x7f8c38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.295+0000 7f8c3effd640 1 -- 172.21.15.50:0/1296661329 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c4814eca0 con 0x7f8c480b3e10 2024-09-11T22:18:46.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.511+0000 7f8c50694640 1 -- 172.21.15.50:0/1296661329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c48159b90 con 0x7f8c480b3e10 2024-09-11T22:18:46.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.512+0000 7f8c3effd640 1 -- 172.21.15.50:0/1296661329 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5225 (secure 0 0 0) 0x7f8c44059c00 con 0x7f8c480b3e10 2024-09-11T22:18:46.513 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:46.513 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"btime":"2024-09-11T22:18:18:030997+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1864699161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1864699161},{"type":"v1","addr":"172.21.15.77:6835","nonce":1864699161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3677751855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3677751855},{"type":"v1","addr":"172.21.15.50:6834","nonce":3677751855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7315,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2276588552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2276588552},{"type":"v1","addr":"172.21.15.50:6835","nonce":2276588552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:18:14.748913+0000","modified":"2024-09-11T22:18:17.383059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7324":{"gid":7324,"name":"d","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1480049118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1480049118},{"type":"v1","addr":"172.21.15.77:6837","nonce":1480049118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7324,"qdb_cluster":[7324]},"id":8}]} 2024-09-11T22:18:46.513 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2024-09-11T22:18:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.514+0000 7f8c50694640 1 -- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8c2c06be30 msgr2=0x7f8c2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.514+0000 7f8c50694640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8c2c06be30 0x7f8c2c06e2f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8c38007fd0 tx=0x7f8c38009040 comp rx=0 tx=0).stop 2024-09-11T22:18:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.514+0000 7f8c50694640 1 -- 172.21.15.50:0/1296661329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c480b3e10 msgr2=0x7f8c4815ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.514+0000 7f8c50694640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c480b3e10 0x7f8c4815ac30 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400d5f0 tx=0x7f8c4400dab0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.514+0000 7f8c50694640 1 -- 172.21.15.50:0/1296661329 shutdown_connections 2024-09-11T22:18:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.514+0000 7f8c50694640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8c2c06be30 0x7f8c2c06e2f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.514+0000 7f8c50694640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c480d05e0 0x7f8c4813ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.514+0000 7f8c50694640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c4815c2c0 0x7f8c4815f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.514+0000 7f8c50694640 1 --2- 172.21.15.50:0/1296661329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c480b3e10 0x7f8c4815ac30 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.514+0000 7f8c50694640 1 -- 172.21.15.50:0/1296661329 >> 172.21.15.50:0/1296661329 conn(0x7f8c480679c0 msgr2=0x7f8c480ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.514+0000 7f8c50694640 1 -- 172.21.15.50:0/1296661329 shutdown_connections 2024-09-11T22:18:46.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.514+0000 7f8c50694640 1 -- 172.21.15.50:0/1296661329 wait complete. 2024-09-11T22:18:46.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:18:46.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.627+0000 7f8a8a354640 1 Processor -- start 2024-09-11T22:18:46.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.627+0000 7f8a8a354640 1 -- start start 2024-09-11T22:18:46.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.628+0000 7f8a8a354640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a8415b400 0x7f8a8406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.628+0000 7f8a8a354640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a8406e0f0 0x7f8a840711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.628+0000 7f8a8a354640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a8415b7e0 con 0x7f8a84072e60 2024-09-11T22:18:46.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.628+0000 7f8a8a354640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8a8415f140 con 0x7f8a8415b400 2024-09-11T22:18:46.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.628+0000 7f8a8a354640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8a8415f420 con 0x7f8a8406e0f0 2024-09-11T22:18:46.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.628+0000 7f8a83fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a8415b400 0x7f8a8406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.628+0000 7f8a83fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a8415b400 0x7f8a8406d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32854/0 (socket says 172.21.15.50:32854) 2024-09-11T22:18:46.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.628+0000 7f8a83fff640 1 -- 172.21.15.50:0/2757285777 learned_addr learned my addr 172.21.15.50:0/2757285777 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:46.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.629+0000 7f8a83fff640 1 -- 172.21.15.50:0/2757285777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a8406e0f0 msgr2=0x7f8a840711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:46.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.629+0000 7f8a888f1640 1 --2- 172.21.15.50:0/2757285777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a8406e0f0 0x7f8a840711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.629+0000 7f8a83fff640 1 --2- 172.21.15.50:0/2757285777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a8406e0f0 0x7f8a840711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.629+0000 7f8a83fff640 1 -- 172.21.15.50:0/2757285777 >> v1:172.21.15.77:6789/0 conn(0x7f8a84072e60 legacy=0x7f8a8406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:46.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.629+0000 7f8a83fff640 1 -- 172.21.15.50:0/2757285777 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8415f700 con 0x7f8a8415b400 2024-09-11T22:18:46.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.629+0000 7f8a83fff640 1 --2- 172.21.15.50:0/2757285777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8415b400 0x7f8a8406d070 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009870 tx=0x7f8a7402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5191dd0f3849ed9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.629+0000 7f8a82ffd640 1 -- 172.21.15.50:0/2757285777 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74037070 con 0x7f8a8415b400 2024-09-11T22:18:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.630+0000 7f8a82ffd640 1 -- 172.21.15.50:0/2757285777 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a74032440 con 0x7f8a8415b400 2024-09-11T22:18:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.630+0000 7f8a82ffd640 1 -- 172.21.15.50:0/2757285777 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74032810 con 0x7f8a8415b400 2024-09-11T22:18:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.630+0000 7f8a8a354640 1 -- 172.21.15.50:0/2757285777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8415b400 msgr2=0x7f8a8406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.630+0000 7f8a8a354640 1 --2- 172.21.15.50:0/2757285777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8415b400 0x7f8a8406d070 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009870 tx=0x7f8a7402a210 comp rx=0 tx=0).stop 2024-09-11T22:18:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.630+0000 7f8a8a354640 1 -- 172.21.15.50:0/2757285777 shutdown_connections 2024-09-11T22:18:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.630+0000 7f8a8a354640 1 --2- 172.21.15.50:0/2757285777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a8406e0f0 0x7f8a840711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.630+0000 7f8a8a354640 1 --2- 172.21.15.50:0/2757285777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8415b400 0x7f8a8406d070 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.630+0000 7f8a8a354640 1 -- 172.21.15.50:0/2757285777 >> 172.21.15.50:0/2757285777 conn(0x7f8a840679c0 msgr2=0x7f8a84067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:46.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.630+0000 7f8a8a354640 1 -- 172.21.15.50:0/2757285777 shutdown_connections 2024-09-11T22:18:46.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.630+0000 7f8a8a354640 1 -- 172.21.15.50:0/2757285777 wait complete. 2024-09-11T22:18:46.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.631+0000 7f8a8a354640 1 Processor -- start 2024-09-11T22:18:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.631+0000 7f8a8a354640 1 -- start start 2024-09-11T22:18:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.632+0000 7f8a8a354640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a8406e0f0 0x7f8a841403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.632+0000 7f8a8a354640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a84072e60 0x7f8a84157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.632+0000 7f8a8a354640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8415b400 0x7f8a84152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.632+0000 7f8a8a354640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a84071700 con 0x7f8a8415b400 2024-09-11T22:18:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.632+0000 7f8a8a354640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a840cfc50 con 0x7f8a8406e0f0 2024-09-11T22:18:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.632+0000 7f8a8a354640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8a84071880 con 0x7f8a84072e60 2024-09-11T22:18:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.632+0000 7f8a888f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8415b400 0x7f8a84152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.632+0000 7f8a83fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a8406e0f0 0x7f8a841403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.632+0000 7f8a888f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8415b400 0x7f8a84152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32866/0 (socket says 172.21.15.50:32866) 2024-09-11T22:18:46.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.632+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a84072e60 0x7f8a84157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.632+0000 7f8a888f1640 1 -- 172.21.15.50:0/3488866979 learned_addr learned my addr 172.21.15.50:0/3488866979 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.633+0000 7f8a888f1640 1 -- 172.21.15.50:0/3488866979 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a84072e60 msgr2=0x7f8a84157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.633+0000 7f8a888f1640 1 --2- 172.21.15.50:0/3488866979 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a84072e60 0x7f8a84157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.633+0000 7f8a888f1640 1 -- 172.21.15.50:0/3488866979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a8406e0f0 msgr2=0x7f8a841403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.633+0000 7f8a888f1640 1 --2- 172.21.15.50:0/3488866979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a8406e0f0 0x7f8a841403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.633+0000 7f8a888f1640 1 -- 172.21.15.50:0/3488866979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a84159930 con 0x7f8a8415b400 2024-09-11T22:18:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.633+0000 7f8a888f1640 1 --2- 172.21.15.50:0/3488866979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8415b400 0x7f8a84152e20 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00cd20 tx=0x7f8a7c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.633+0000 7f8a80ff9640 1 -- 172.21.15.50:0/3488866979 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c003b90 con 0x7f8a8415b400 2024-09-11T22:18:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.633+0000 7f8a80ff9640 1 -- 172.21.15.50:0/3488866979 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7c003d30 con 0x7f8a8415b400 2024-09-11T22:18:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.633+0000 7f8a8a354640 1 -- 172.21.15.50:0/3488866979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a84159c10 con 0x7f8a8415b400 2024-09-11T22:18:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.633+0000 7f8a80ff9640 1 -- 172.21.15.50:0/3488866979 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c004240 con 0x7f8a8415b400 2024-09-11T22:18:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.633+0000 7f8a8a354640 1 -- 172.21.15.50:0/3488866979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8415a1d0 con 0x7f8a8415b400 2024-09-11T22:18:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.634+0000 7f8a8a354640 1 -- 172.21.15.50:0/3488866979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a840711c0 con 0x7f8a8415b400 2024-09-11T22:18:46.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.634+0000 7f8a80ff9640 1 -- 172.21.15.50:0/3488866979 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a7c0043e0 con 0x7f8a8415b400 2024-09-11T22:18:46.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.635+0000 7f8a80ff9640 1 --2- 172.21.15.50:0/3488866979 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a7006be30 0x7f8a7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.635+0000 7f8a80ff9640 1 -- 172.21.15.50:0/3488866979 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f8a7c08b7c0 con 0x7f8a8415b400 2024-09-11T22:18:46.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.635+0000 7f8a83fff640 1 --2- 172.21.15.50:0/3488866979 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a7006be30 0x7f8a7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.636+0000 7f8a83fff640 1 --2- 172.21.15.50:0/3488866979 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a7006be30 0x7f8a7006e2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8a74034000 tx=0x7f8a7402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.639+0000 7f8a80ff9640 1 -- 172.21.15.50:0/3488866979 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a7c059bb0 con 0x7f8a8415b400 2024-09-11T22:18:46.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.849+0000 7f8a8a354640 1 -- 172.21.15.50:0/3488866979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a840cd850 con 0x7f8a8415b400 2024-09-11T22:18:46.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.850+0000 7f8a80ff9640 1 -- 172.21.15.50:0/3488866979 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5225 (secure 0 0 0) 0x7f8a7c05deb0 con 0x7f8a8415b400 2024-09-11T22:18:46.851 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:46.851 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"btime":"2024-09-11T22:18:18:030997+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1864699161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1864699161},{"type":"v1","addr":"172.21.15.77:6835","nonce":1864699161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3677751855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3677751855},{"type":"v1","addr":"172.21.15.50:6834","nonce":3677751855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7315,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2276588552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2276588552},{"type":"v1","addr":"172.21.15.50:6835","nonce":2276588552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:18:14.748913+0000","modified":"2024-09-11T22:18:17.383059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7324":{"gid":7324,"name":"d","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1480049118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1480049118},{"type":"v1","addr":"172.21.15.77:6837","nonce":1480049118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7324,"qdb_cluster":[7324]},"id":8}]} 2024-09-11T22:18:46.851 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2024-09-11T22:18:46.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.852+0000 7f8a8a354640 1 -- 172.21.15.50:0/3488866979 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a7006be30 msgr2=0x7f8a7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.852+0000 7f8a8a354640 1 --2- 172.21.15.50:0/3488866979 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a7006be30 0x7f8a7006e2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8a74034000 tx=0x7f8a7402e000 comp rx=0 tx=0).stop 2024-09-11T22:18:46.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.852+0000 7f8a8a354640 1 -- 172.21.15.50:0/3488866979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8415b400 msgr2=0x7f8a84152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.852+0000 7f8a8a354640 1 --2- 172.21.15.50:0/3488866979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8415b400 0x7f8a84152e20 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00cd20 tx=0x7f8a7c00a660 comp rx=0 tx=0).stop 2024-09-11T22:18:46.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.852+0000 7f8a8a354640 1 -- 172.21.15.50:0/3488866979 shutdown_connections 2024-09-11T22:18:46.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.852+0000 7f8a8a354640 1 --2- 172.21.15.50:0/3488866979 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a7006be30 0x7f8a7006e2f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.852+0000 7f8a8a354640 1 --2- 172.21.15.50:0/3488866979 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a84072e60 0x7f8a84157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.852+0000 7f8a8a354640 1 --2- 172.21.15.50:0/3488866979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8415b400 0x7f8a84152e20 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.852+0000 7f8a8a354640 1 --2- 172.21.15.50:0/3488866979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a8406e0f0 0x7f8a841403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.852+0000 7f8a8a354640 1 -- 172.21.15.50:0/3488866979 >> 172.21.15.50:0/3488866979 conn(0x7f8a840679c0 msgr2=0x7f8a840cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:46.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.852+0000 7f8a8a354640 1 -- 172.21.15.50:0/3488866979 shutdown_connections 2024-09-11T22:18:46.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.852+0000 7f8a8a354640 1 -- 172.21.15.50:0/3488866979 wait complete. 2024-09-11T22:18:46.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:18:46.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.966+0000 7f64edcba640 1 Processor -- start 2024-09-11T22:18:46.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.966+0000 7f64edcba640 1 -- start start 2024-09-11T22:18:46.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.966+0000 7f64edcba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64e815c2c0 0x7f64e80b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.967+0000 7f64edcba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64e80b3e10 0x7f64e80cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.967+0000 7f64edcba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e80b4f00 con 0x7f64e80d0410 2024-09-11T22:18:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.967+0000 7f64edcba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f64e80cf7a0 con 0x7f64e815c2c0 2024-09-11T22:18:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.967+0000 7f64edcba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f64e80d0840 con 0x7f64e80b3e10 2024-09-11T22:18:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.967+0000 7f64e77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64e815c2c0 0x7f64e80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.967+0000 7f64e7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f64e80d0410 0x7f64e815fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58894/0 (socket says 172.21.15.50:58894) 2024-09-11T22:18:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.967+0000 7f64e7fff640 1 -- 172.21.15.50:0/738063300 learned_addr learned my addr 172.21.15.50:0/738063300 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.967+0000 7f64deffd640 1 --2- 172.21.15.50:0/738063300 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64e80b3e10 0x7f64e80cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.967+0000 7f64e77fe640 1 -- 172.21.15.50:0/738063300 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64e80b3e10 msgr2=0x7f64e80cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.967+0000 7f64e77fe640 1 --2- 172.21.15.50:0/738063300 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64e80b3e10 0x7f64e80cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.967+0000 7f64e77fe640 1 -- 172.21.15.50:0/738063300 >> v1:172.21.15.50:6789/0 conn(0x7f64e80d0410 legacy=0x7f64e815fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.967+0000 7f64e77fe640 1 -- 172.21.15.50:0/738063300 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e80b4360 con 0x7f64e815c2c0 2024-09-11T22:18:46.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.968+0000 7f64e77fe640 1 --2- 172.21.15.50:0/738063300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e815c2c0 0x7f64e80b46a0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f64d80097a0 tx=0x7f64d802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5235df0b56576e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:46.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.968+0000 7f64e6ffd640 1 -- 172.21.15.50:0/738063300 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d8037070 con 0x7f64e815c2c0 2024-09-11T22:18:46.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.968+0000 7f64e6ffd640 1 -- 172.21.15.50:0/738063300 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d802ae50 con 0x7f64e815c2c0 2024-09-11T22:18:46.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.968+0000 7f64e6ffd640 1 -- 172.21.15.50:0/738063300 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d8032660 con 0x7f64e815c2c0 2024-09-11T22:18:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.968+0000 7f64edcba640 1 -- 172.21.15.50:0/738063300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e815c2c0 msgr2=0x7f64e80b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.968+0000 7f64edcba640 1 --2- 172.21.15.50:0/738063300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e815c2c0 0x7f64e80b46a0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f64d80097a0 tx=0x7f64d802a100 comp rx=0 tx=0).stop 2024-09-11T22:18:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.969+0000 7f64edcba640 1 -- 172.21.15.50:0/738063300 shutdown_connections 2024-09-11T22:18:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.969+0000 7f64edcba640 1 --2- 172.21.15.50:0/738063300 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64e80b3e10 0x7f64e80cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.969+0000 7f64edcba640 1 --2- 172.21.15.50:0/738063300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e815c2c0 0x7f64e80b46a0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.969+0000 7f64edcba640 1 -- 172.21.15.50:0/738063300 >> 172.21.15.50:0/738063300 conn(0x7f64e80679c0 msgr2=0x7f64e8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.969+0000 7f64edcba640 1 -- 172.21.15.50:0/738063300 shutdown_connections 2024-09-11T22:18:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.969+0000 7f64edcba640 1 -- 172.21.15.50:0/738063300 wait complete. 2024-09-11T22:18:46.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.970+0000 7f64edcba640 1 Processor -- start 2024-09-11T22:18:46.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.970+0000 7f64edcba640 1 -- start start 2024-09-11T22:18:46.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64edcba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e80b3e10 0x7f64e814e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64edcba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64e80d0410 0x7f64e814ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64edcba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64e815c2c0 0x7f64e8071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64edcba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f64e80cfc10 con 0x7f64e80b3e10 2024-09-11T22:18:46.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64edcba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f64e80b54a0 con 0x7f64e815c2c0 2024-09-11T22:18:46.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64edcba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f64e80ce200 con 0x7f64e80d0410 2024-09-11T22:18:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64e77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e80b3e10 0x7f64e814e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64e77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e80b3e10 0x7f64e814e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32880/0 (socket says 172.21.15.50:32880) 2024-09-11T22:18:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64e77fe640 1 -- 172.21.15.50:0/3857700052 learned_addr learned my addr 172.21.15.50:0/3857700052 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64e7fff640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64e815c2c0 0x7f64e8071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64deffd640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64e80d0410 0x7f64e814ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64e77fe640 1 -- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64e80d0410 msgr2=0x7f64e814ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64e77fe640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64e80d0410 0x7f64e814ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64e77fe640 1 -- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64e815c2c0 msgr2=0x7f64e8071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64e77fe640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64e815c2c0 0x7f64e8071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64e77fe640 1 -- 172.21.15.50:0/3857700052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e8071570 con 0x7f64e80b3e10 2024-09-11T22:18:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64e77fe640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e80b3e10 0x7f64e814e160 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f64d80098c0 tx=0x7f64d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.971+0000 7f64e4ff9640 1 -- 172.21.15.50:0/3857700052 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d8041030 con 0x7f64e80b3e10 2024-09-11T22:18:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.972+0000 7f64e4ff9640 1 -- 172.21.15.50:0/3857700052 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d802ac50 con 0x7f64e80b3e10 2024-09-11T22:18:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.972+0000 7f64edcba640 1 -- 172.21.15.50:0/3857700052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e8071840 con 0x7f64e80b3e10 2024-09-11T22:18:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.972+0000 7f64e4ff9640 1 -- 172.21.15.50:0/3857700052 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d8037040 con 0x7f64e80b3e10 2024-09-11T22:18:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.972+0000 7f64edcba640 1 -- 172.21.15.50:0/3857700052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e8071e00 con 0x7f64e80b3e10 2024-09-11T22:18:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.973+0000 7f64edcba640 1 -- 172.21.15.50:0/3857700052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e806d070 con 0x7f64e80b3e10 2024-09-11T22:18:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.973+0000 7f64e4ff9640 1 -- 172.21.15.50:0/3857700052 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f64d8044070 con 0x7f64e80b3e10 2024-09-11T22:18:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.973+0000 7f64e4ff9640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f64c806be30 0x7f64c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.973+0000 7f64e4ff9640 1 -- 172.21.15.50:0/3857700052 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f64d80ab2b0 con 0x7f64e80b3e10 2024-09-11T22:18:46.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.974+0000 7f64deffd640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f64c806be30 0x7f64c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:46.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.974+0000 7f64deffd640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f64c806be30 0x7f64c806e2f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f64e80d0170 tx=0x7f64d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:46.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:46.978+0000 7f64e4ff9640 1 -- 172.21.15.50:0/3857700052 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f64d8079610 con 0x7f64e80b3e10 2024-09-11T22:18:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.157+0000 7f64edcba640 1 -- 172.21.15.50:0/3857700052 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64e80b15f0 con 0x7f64e80b3e10 2024-09-11T22:18:47.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.158+0000 7f64e4ff9640 1 -- 172.21.15.50:0/3857700052 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+16651 (secure 0 0 0) 0x7f64d807d910 con 0x7f64e80b3e10 2024-09-11T22:18:47.159 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":120,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:18:16.390342+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:18:12.405607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-11T22:18:13.770508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:18:47.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.160+0000 7f64edcba640 1 -- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f64c806be30 msgr2=0x7f64c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.160+0000 7f64edcba640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f64c806be30 0x7f64c806e2f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f64e80d0170 tx=0x7f64d0008040 comp rx=0 tx=0).stop 2024-09-11T22:18:47.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.160+0000 7f64edcba640 1 -- 172.21.15.50:0/3857700052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e80b3e10 msgr2=0x7f64e814e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.160+0000 7f64edcba640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e80b3e10 0x7f64e814e160 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f64d80098c0 tx=0x7f64d80046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.160+0000 7f64edcba640 1 -- 172.21.15.50:0/3857700052 shutdown_connections 2024-09-11T22:18:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.160+0000 7f64edcba640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f64c806be30 0x7f64c806e2f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.160+0000 7f64edcba640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64e80d0410 0x7f64e814ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.160+0000 7f64edcba640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64e815c2c0 0x7f64e8071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.160+0000 7f64edcba640 1 --2- 172.21.15.50:0/3857700052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64e80b3e10 0x7f64e814e160 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.160+0000 7f64edcba640 1 -- 172.21.15.50:0/3857700052 >> 172.21.15.50:0/3857700052 conn(0x7f64e80679c0 msgr2=0x7f64e806e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.161+0000 7f64edcba640 1 -- 172.21.15.50:0/3857700052 shutdown_connections 2024-09-11T22:18:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.161+0000 7f64edcba640 1 -- 172.21.15.50:0/3857700052 wait complete. 2024-09-11T22:18:47.173 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:18:47.173 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:18:47.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.276+0000 7fc61024c640 1 Processor -- start 2024-09-11T22:18:47.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.276+0000 7fc61024c640 1 -- start start 2024-09-11T22:18:47.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc61024c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc60815e8e0 0x7fc6080b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc61024c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc608162350 0x7fc6081627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc61024c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc608163080 con 0x7fc6080d1580 2024-09-11T22:18:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc61024c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc60815ecc0 con 0x7fc60815e8e0 2024-09-11T22:18:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc61024c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6080d2ad0 con 0x7fc608162350 2024-09-11T22:18:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc60dfe8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc60815e8e0 0x7fc6080b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc60dfe8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc60815e8e0 0x7fc6080b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32892/0 (socket says 172.21.15.50:32892) 2024-09-11T22:18:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc60dfe8640 1 -- 172.21.15.50:0/3241252732 learned_addr learned my addr 172.21.15.50:0/3241252732 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc60e7e9640 1 --2- 172.21.15.50:0/3241252732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc608162350 0x7fc6081627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc60dfe8640 1 -- 172.21.15.50:0/3241252732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc608162350 msgr2=0x7fc6081627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc60dfe8640 1 --2- 172.21.15.50:0/3241252732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc608162350 0x7fc6081627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc60dfe8640 1 -- 172.21.15.50:0/3241252732 >> v1:172.21.15.77:6789/0 conn(0x7fc6080d1580 legacy=0x7fc6080d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:47.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc60dfe8640 1 -- 172.21.15.50:0/3241252732 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6080d2d20 con 0x7fc60815e8e0 2024-09-11T22:18:47.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.277+0000 7fc60e7e9640 1 --2- 172.21.15.50:0/3241252732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc608162350 0x7fc6081627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.278+0000 7fc60dfe8640 1 --2- 172.21.15.50:0/3241252732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc60815e8e0 0x7fc6080b7880 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fc604009870 tx=0x7fc60402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcda849c690939a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.278+0000 7fc60cfe6640 1 -- 172.21.15.50:0/3241252732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604037070 con 0x7fc60815e8e0 2024-09-11T22:18:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.278+0000 7fc60cfe6640 1 -- 172.21.15.50:0/3241252732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc604032440 con 0x7fc60815e8e0 2024-09-11T22:18:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.278+0000 7fc60cfe6640 1 -- 172.21.15.50:0/3241252732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604032810 con 0x7fc60815e8e0 2024-09-11T22:18:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.279+0000 7fc61024c640 1 -- 172.21.15.50:0/3241252732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc60815e8e0 msgr2=0x7fc6080b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.279+0000 7fc61024c640 1 --2- 172.21.15.50:0/3241252732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc60815e8e0 0x7fc6080b7880 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fc604009870 tx=0x7fc60402a2a0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.279+0000 7fc61024c640 1 -- 172.21.15.50:0/3241252732 shutdown_connections 2024-09-11T22:18:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.279+0000 7fc61024c640 1 --2- 172.21.15.50:0/3241252732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc608162350 0x7fc6081627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.279+0000 7fc61024c640 1 --2- 172.21.15.50:0/3241252732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc60815e8e0 0x7fc6080b7880 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.279+0000 7fc61024c640 1 -- 172.21.15.50:0/3241252732 >> 172.21.15.50:0/3241252732 conn(0x7fc608067ba0 msgr2=0x7fc608067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.279+0000 7fc61024c640 1 -- 172.21.15.50:0/3241252732 shutdown_connections 2024-09-11T22:18:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.279+0000 7fc61024c640 1 -- 172.21.15.50:0/3241252732 wait complete. 2024-09-11T22:18:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.280+0000 7fc61024c640 1 Processor -- start 2024-09-11T22:18:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.280+0000 7fc61024c640 1 -- start start 2024-09-11T22:18:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc61024c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080d1580 0x7fc608154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc61024c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc60815e8e0 0x7fc608154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc61024c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc608162350 0x7fc6080b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc61024c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc608162d20 con 0x7fc608162350 2024-09-11T22:18:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc61024c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6080d3370 con 0x7fc6080d1580 2024-09-11T22:18:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc61024c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6080d3800 con 0x7fc60815e8e0 2024-09-11T22:18:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc60e7e9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc608162350 0x7fc6080b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc60e7e9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc608162350 0x7fc6080b7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32906/0 (socket says 172.21.15.50:32906) 2024-09-11T22:18:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc60e7e9640 1 -- 172.21.15.50:0/3316384455 learned_addr learned my addr 172.21.15.50:0/3316384455 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc60d7e7640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc60815e8e0 0x7fc608154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc60dfe8640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080d1580 0x7fc608154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc60e7e9640 1 -- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc60815e8e0 msgr2=0x7fc608154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc60e7e9640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc60815e8e0 0x7fc608154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc60e7e9640 1 -- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080d1580 msgr2=0x7fc608154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc60e7e9640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080d1580 0x7fc608154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.281+0000 7fc60e7e9640 1 -- 172.21.15.50:0/3316384455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6080b9450 con 0x7fc608162350 2024-09-11T22:18:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.282+0000 7fc60e7e9640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc608162350 0x7fc6080b7e60 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fc60000cd80 tx=0x7fc60000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.282+0000 7fc5fe7fc640 1 -- 172.21.15.50:0/3316384455 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60000f680 con 0x7fc608162350 2024-09-11T22:18:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.282+0000 7fc5fe7fc640 1 -- 172.21.15.50:0/3316384455 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60000f840 con 0x7fc608162350 2024-09-11T22:18:47.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.282+0000 7fc5fe7fc640 1 -- 172.21.15.50:0/3316384455 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60000fc30 con 0x7fc608162350 2024-09-11T22:18:47.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.282+0000 7fc61024c640 1 -- 172.21.15.50:0/3316384455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6080b9710 con 0x7fc608162350 2024-09-11T22:18:47.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.282+0000 7fc61024c640 1 -- 172.21.15.50:0/3316384455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc608159a50 con 0x7fc608162350 2024-09-11T22:18:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.283+0000 7fc61024c640 1 -- 172.21.15.50:0/3316384455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6080b7880 con 0x7fc608162350 2024-09-11T22:18:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.283+0000 7fc5fe7fc640 1 -- 172.21.15.50:0/3316384455 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6000213f0 con 0x7fc608162350 2024-09-11T22:18:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.284+0000 7fc5fe7fc640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc5ec06be60 0x7fc5ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.284+0000 7fc5fe7fc640 1 -- 172.21.15.50:0/3316384455 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7fc60008bb10 con 0x7fc608162350 2024-09-11T22:18:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.284+0000 7fc60dfe8640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc5ec06be60 0x7fc5ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.285+0000 7fc60dfe8640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc5ec06be60 0x7fc5ec06e320 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc604034000 tx=0x7fc60402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:47.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.288+0000 7fc5fe7fc640 1 -- 172.21.15.50:0/3316384455 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc600014030 con 0x7fc608162350 2024-09-11T22:18:47.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.504+0000 7fc61024c640 1 -- 172.21.15.50:0/3316384455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6080ba770 con 0x7fc608162350 2024-09-11T22:18:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.504+0000 7fc5fe7fc640 1 -- 172.21.15.50:0/3316384455 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5225 (secure 0 0 0) 0x7fc600059e60 con 0x7fc608162350 2024-09-11T22:18:47.506 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:47.507 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"btime":"2024-09-11T22:18:18:030997+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1864699161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1864699161},{"type":"v1","addr":"172.21.15.77:6835","nonce":1864699161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3677751855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3677751855},{"type":"v1","addr":"172.21.15.50:6834","nonce":3677751855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7315,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2276588552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2276588552},{"type":"v1","addr":"172.21.15.50:6835","nonce":2276588552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:18:14.748913+0000","modified":"2024-09-11T22:18:17.383059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7324":{"gid":7324,"name":"d","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1480049118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1480049118},{"type":"v1","addr":"172.21.15.77:6837","nonce":1480049118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7324,"qdb_cluster":[7324]},"id":8}]} 2024-09-11T22:18:47.508 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2024-09-11T22:18:47.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.506+0000 7fc61024c640 1 -- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc5ec06be60 msgr2=0x7fc5ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.506+0000 7fc61024c640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc5ec06be60 0x7fc5ec06e320 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc604034000 tx=0x7fc60402e000 comp rx=0 tx=0).stop 2024-09-11T22:18:47.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.506+0000 7fc61024c640 1 -- 172.21.15.50:0/3316384455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc608162350 msgr2=0x7fc6080b7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.506+0000 7fc61024c640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc608162350 0x7fc6080b7e60 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fc60000cd80 tx=0x7fc60000a650 comp rx=0 tx=0).stop 2024-09-11T22:18:47.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.506+0000 7fc61024c640 1 -- 172.21.15.50:0/3316384455 shutdown_connections 2024-09-11T22:18:47.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.506+0000 7fc61024c640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc5ec06be60 0x7fc5ec06e320 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.506+0000 7fc61024c640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc60815e8e0 0x7fc608154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.506+0000 7fc61024c640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc608162350 0x7fc6080b7e60 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.506+0000 7fc61024c640 1 --2- 172.21.15.50:0/3316384455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080d1580 0x7fc608154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.506+0000 7fc61024c640 1 -- 172.21.15.50:0/3316384455 >> 172.21.15.50:0/3316384455 conn(0x7fc608067ba0 msgr2=0x7fc608067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.506+0000 7fc61024c640 1 -- 172.21.15.50:0/3316384455 shutdown_connections 2024-09-11T22:18:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.506+0000 7fc61024c640 1 -- 172.21.15.50:0/3316384455 wait complete. 2024-09-11T22:18:47.518 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.620+0000 7efcadf9f640 1 Processor -- start 2024-09-11T22:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.620+0000 7efcadf9f640 1 -- start start 2024-09-11T22:18:47.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.621+0000 7efcadf9f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efca80b86d0 0x7efca81692d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.621+0000 7efcadf9f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca815eb90 con 0x7efca80d4650 2024-09-11T22:18:47.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.621+0000 7efcadf9f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca80d28a0 con 0x7efca815e7b0 2024-09-11T22:18:47.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.621+0000 7efcadf9f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7efca80d3470 con 0x7efca80b86d0 2024-09-11T22:18:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.621+0000 7efcad79e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efca80b86d0 0x7efca81692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.621+0000 7efca7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efca80d4650 0x7efca80d4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44550/0 (socket says 172.21.15.50:44550) 2024-09-11T22:18:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.621+0000 7efca7fff640 1 -- 172.21.15.50:0/967981116 learned_addr learned my addr 172.21.15.50:0/967981116 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.622+0000 7efcad79e640 1 -- 172.21.15.50:0/967981116 >> v1:172.21.15.77:6789/0 conn(0x7efca815e7b0 legacy=0x7efca80d3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.622+0000 7efcad79e640 1 -- 172.21.15.50:0/967981116 >> v1:172.21.15.50:6789/0 conn(0x7efca80d4650 legacy=0x7efca80d4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.622+0000 7efcad79e640 1 -- 172.21.15.50:0/967981116 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca80d2b40 con 0x7efca80b86d0 2024-09-11T22:18:47.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.622+0000 7efcad79e640 1 --2- 172.21.15.50:0/967981116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca80b86d0 0x7efca81692d0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7efca80cecc0 tx=0x7efca002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf69c2211327e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:47.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.623+0000 7efca77fe640 1 -- 172.21.15.50:0/967981116 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0037070 con 0x7efca80b86d0 2024-09-11T22:18:47.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.623+0000 7efca77fe640 1 -- 172.21.15.50:0/967981116 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca0032440 con 0x7efca80b86d0 2024-09-11T22:18:47.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.623+0000 7efca77fe640 1 -- 172.21.15.50:0/967981116 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0032810 con 0x7efca80b86d0 2024-09-11T22:18:47.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.623+0000 7efcadf9f640 1 -- 172.21.15.50:0/967981116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca80b86d0 msgr2=0x7efca81692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.623+0000 7efcadf9f640 1 --2- 172.21.15.50:0/967981116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca80b86d0 0x7efca81692d0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7efca80cecc0 tx=0x7efca002a230 comp rx=0 tx=0).stop 2024-09-11T22:18:47.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.623+0000 7efcadf9f640 1 -- 172.21.15.50:0/967981116 shutdown_connections 2024-09-11T22:18:47.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.623+0000 7efcadf9f640 1 --2- 172.21.15.50:0/967981116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca80b86d0 0x7efca81692d0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.623+0000 7efcadf9f640 1 -- 172.21.15.50:0/967981116 >> 172.21.15.50:0/967981116 conn(0x7efca8072590 msgr2=0x7efca80729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:47.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.623+0000 7efcadf9f640 1 -- 172.21.15.50:0/967981116 shutdown_connections 2024-09-11T22:18:47.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.623+0000 7efcadf9f640 1 -- 172.21.15.50:0/967981116 wait complete. 2024-09-11T22:18:47.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.624+0000 7efcadf9f640 1 Processor -- start 2024-09-11T22:18:47.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.624+0000 7efcadf9f640 1 -- start start 2024-09-11T22:18:47.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.625+0000 7efcadf9f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efca80b86d0 0x7efca8157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.625+0000 7efcadf9f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efca80d4650 0x7efca80b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.625+0000 7efcadf9f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca815e7b0 0x7efca80b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.625+0000 7efcadf9f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efca80cfb90 con 0x7efca815e7b0 2024-09-11T22:18:47.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.625+0000 7efcadf9f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efca80d3100 con 0x7efca80b86d0 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.625+0000 7efcadf9f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efca80d42a0 con 0x7efca80d4650 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.625+0000 7efcad79e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca815e7b0 0x7efca80b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.625+0000 7efcacf9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efca80b86d0 0x7efca8157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.625+0000 7efcad79e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca815e7b0 0x7efca80b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59206/0 (socket says 172.21.15.50:59206) 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.625+0000 7efcad79e640 1 -- 172.21.15.50:0/1647274295 learned_addr learned my addr 172.21.15.50:0/1647274295 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.626+0000 7efca7fff640 1 --2- 172.21.15.50:0/1647274295 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efca80d4650 0x7efca80b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.626+0000 7efcad79e640 1 -- 172.21.15.50:0/1647274295 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efca80d4650 msgr2=0x7efca80b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.626+0000 7efcad79e640 1 --2- 172.21.15.50:0/1647274295 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efca80d4650 0x7efca80b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.626+0000 7efcad79e640 1 -- 172.21.15.50:0/1647274295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efca80b86d0 msgr2=0x7efca8157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.626+0000 7efcad79e640 1 --2- 172.21.15.50:0/1647274295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efca80b86d0 0x7efca8157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.626+0000 7efcad79e640 1 -- 172.21.15.50:0/1647274295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca80b3380 con 0x7efca815e7b0 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.626+0000 7efcad79e640 1 --2- 172.21.15.50:0/1647274295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca815e7b0 0x7efca80b62f0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7efca0009890 tx=0x7efca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.626+0000 7efca57fa640 1 -- 172.21.15.50:0/1647274295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0041070 con 0x7efca815e7b0 2024-09-11T22:18:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.626+0000 7efca57fa640 1 -- 172.21.15.50:0/1647274295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca003c890 con 0x7efca815e7b0 2024-09-11T22:18:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.626+0000 7efcadf9f640 1 -- 172.21.15.50:0/1647274295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca8158570 con 0x7efca815e7b0 2024-09-11T22:18:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.626+0000 7efca57fa640 1 -- 172.21.15.50:0/1647274295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0037040 con 0x7efca815e7b0 2024-09-11T22:18:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.626+0000 7efcadf9f640 1 -- 172.21.15.50:0/1647274295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca8158b30 con 0x7efca815e7b0 2024-09-11T22:18:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.627+0000 7efcadf9f640 1 -- 172.21.15.50:0/1647274295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efca80d4a70 con 0x7efca815e7b0 2024-09-11T22:18:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.628+0000 7efca57fa640 1 -- 172.21.15.50:0/1647274295 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efca0044070 con 0x7efca815e7b0 2024-09-11T22:18:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.628+0000 7efca57fa640 1 --2- 172.21.15.50:0/1647274295 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc8806be30 0x7efc8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.628+0000 7efca57fa640 1 -- 172.21.15.50:0/1647274295 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7efca00ab970 con 0x7efca815e7b0 2024-09-11T22:18:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.629+0000 7efcacf9d640 1 --2- 172.21.15.50:0/1647274295 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc8806be30 0x7efc8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.629+0000 7efcacf9d640 1 --2- 172.21.15.50:0/1647274295 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc8806be30 0x7efc8806e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efca81f7bb0 tx=0x7efc98009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:47.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.633+0000 7efca57fa640 1 -- 172.21.15.50:0/1647274295 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efca0079e80 con 0x7efca815e7b0 2024-09-11T22:18:47.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.845+0000 7efcadf9f640 1 -- 172.21.15.50:0/1647274295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efca80ba070 con 0x7efca815e7b0 2024-09-11T22:18:47.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.845+0000 7efca57fa640 1 -- 172.21.15.50:0/1647274295 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5225 (secure 0 0 0) 0x7efca007e180 con 0x7efca815e7b0 2024-09-11T22:18:47.846 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:47.846 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":85,"btime":"2024-09-11T22:18:18:030997+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1864699161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1864699161},{"type":"v1","addr":"172.21.15.77:6835","nonce":1864699161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3677751855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3677751855},{"type":"v1","addr":"172.21.15.50:6834","nonce":3677751855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7315,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2276588552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2276588552},{"type":"v1","addr":"172.21.15.50:6835","nonce":2276588552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:18:14.748913+0000","modified":"2024-09-11T22:18:17.383059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7324":{"gid":7324,"name":"d","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1480049118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1480049118},{"type":"v1","addr":"172.21.15.77:6837","nonce":1480049118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7324,"qdb_cluster":[7324]},"id":8}]} 2024-09-11T22:18:47.847 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 85 2024-09-11T22:18:47.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.847+0000 7efcadf9f640 1 -- 172.21.15.50:0/1647274295 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc8806be30 msgr2=0x7efc8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.847+0000 7efcadf9f640 1 --2- 172.21.15.50:0/1647274295 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc8806be30 0x7efc8806e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efca81f7bb0 tx=0x7efc98009060 comp rx=0 tx=0).stop 2024-09-11T22:18:47.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.847+0000 7efcadf9f640 1 -- 172.21.15.50:0/1647274295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca815e7b0 msgr2=0x7efca80b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.847+0000 7efcadf9f640 1 --2- 172.21.15.50:0/1647274295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca815e7b0 0x7efca80b62f0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7efca0009890 tx=0x7efca00046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.847+0000 7efcadf9f640 1 -- 172.21.15.50:0/1647274295 shutdown_connections 2024-09-11T22:18:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.847+0000 7efcadf9f640 1 --2- 172.21.15.50:0/1647274295 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc8806be30 0x7efc8806e2f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.847+0000 7efcadf9f640 1 --2- 172.21.15.50:0/1647274295 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efca80d4650 0x7efca80b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.847+0000 7efcadf9f640 1 --2- 172.21.15.50:0/1647274295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efca815e7b0 0x7efca80b62f0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.847+0000 7efcadf9f640 1 --2- 172.21.15.50:0/1647274295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efca80b86d0 0x7efca8157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.847+0000 7efcadf9f640 1 -- 172.21.15.50:0/1647274295 >> 172.21.15.50:0/1647274295 conn(0x7efca8072590 msgr2=0x7efca80b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.847+0000 7efcadf9f640 1 -- 172.21.15.50:0/1647274295 shutdown_connections 2024-09-11T22:18:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.847+0000 7efcadf9f640 1 -- 172.21.15.50:0/1647274295 wait complete. 2024-09-11T22:18:47.859 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:18:47.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.961+0000 7f6fcc35f640 1 Processor -- start 2024-09-11T22:18:47.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.961+0000 7f6fcc35f640 1 -- start start 2024-09-11T22:18:47.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.962+0000 7f6fcc35f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fc4161d30 0x7f6fc40cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.962+0000 7f6fcc35f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fc4162110 con 0x7f6fc40d11d0 2024-09-11T22:18:47.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.962+0000 7f6fcc35f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fc40cfd70 con 0x7f6fc40b78f0 2024-09-11T22:18:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.962+0000 7f6fcc35f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6fc40d3450 con 0x7f6fc4161d30 2024-09-11T22:18:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.962+0000 7f6fca0fb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fc4161d30 0x7f6fc40cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.962+0000 7f6fca8fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6fc40d11d0 0x7f6fc40d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44562/0 (socket says 172.21.15.50:44562) 2024-09-11T22:18:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.962+0000 7f6fca8fc640 1 -- 172.21.15.50:0/3787397840 learned_addr learned my addr 172.21.15.50:0/3787397840 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.962+0000 7f6fca0fb640 1 -- 172.21.15.50:0/3787397840 >> v1:172.21.15.77:6789/0 conn(0x7f6fc40b78f0 legacy=0x7f6fc4162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.962+0000 7f6fca0fb640 1 -- 172.21.15.50:0/3787397840 >> v1:172.21.15.50:6789/0 conn(0x7f6fc40d11d0 legacy=0x7f6fc40d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.962+0000 7f6fca0fb640 1 -- 172.21.15.50:0/3787397840 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc40d2b20 con 0x7f6fc4161d30 2024-09-11T22:18:47.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.963+0000 7f6fca0fb640 1 --2- 172.21.15.50:0/3787397840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4161d30 0x7f6fc40cf790 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00097a0 tx=0x7f6fc002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578ea3f0cd211713 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:47.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.963+0000 7f6fc90f9640 1 -- 172.21.15.50:0/3787397840 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0037070 con 0x7f6fc4161d30 2024-09-11T22:18:47.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.963+0000 7f6fc90f9640 1 -- 172.21.15.50:0/3787397840 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc0032440 con 0x7f6fc4161d30 2024-09-11T22:18:47.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.963+0000 7f6fc90f9640 1 -- 172.21.15.50:0/3787397840 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0032810 con 0x7f6fc4161d30 2024-09-11T22:18:47.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.964+0000 7f6fcc35f640 1 -- 172.21.15.50:0/3787397840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4161d30 msgr2=0x7f6fc40cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.964+0000 7f6fcc35f640 1 --2- 172.21.15.50:0/3787397840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4161d30 0x7f6fc40cf790 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00097a0 tx=0x7f6fc002a230 comp rx=0 tx=0).stop 2024-09-11T22:18:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.964+0000 7f6fcc35f640 1 -- 172.21.15.50:0/3787397840 shutdown_connections 2024-09-11T22:18:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.964+0000 7f6fcc35f640 1 --2- 172.21.15.50:0/3787397840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4161d30 0x7f6fc40cf790 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.964+0000 7f6fcc35f640 1 -- 172.21.15.50:0/3787397840 >> 172.21.15.50:0/3787397840 conn(0x7f6fc40727a0 msgr2=0x7f6fc40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.964+0000 7f6fcc35f640 1 -- 172.21.15.50:0/3787397840 shutdown_connections 2024-09-11T22:18:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.964+0000 7f6fcc35f640 1 -- 172.21.15.50:0/3787397840 wait complete. 2024-09-11T22:18:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.965+0000 7f6fcc35f640 1 Processor -- start 2024-09-11T22:18:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.965+0000 7f6fcc35f640 1 -- start start 2024-09-11T22:18:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fcc35f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc40b78f0 0x7f6fc40b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fcc35f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fc40d11d0 0x7f6fc415df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fcc35f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4161d30 0x7f6fc4156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fcc35f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc40b7d60 con 0x7f6fc4161d30 2024-09-11T22:18:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fcc35f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc40d30e0 con 0x7f6fc40d11d0 2024-09-11T22:18:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fcc35f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc40d1600 con 0x7f6fc40b78f0 2024-09-11T22:18:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fca8fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4161d30 0x7f6fc4156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fca8fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4161d30 0x7f6fc4156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59238/0 (socket says 172.21.15.50:59238) 2024-09-11T22:18:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fca8fc640 1 -- 172.21.15.50:0/277305276 learned_addr learned my addr 172.21.15.50:0/277305276 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fca8fc640 1 -- 172.21.15.50:0/277305276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc40b78f0 msgr2=0x7f6fc40b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fca8fc640 1 --2- 172.21.15.50:0/277305276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc40b78f0 0x7f6fc40b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fca8fc640 1 -- 172.21.15.50:0/277305276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fc40d11d0 msgr2=0x7f6fc415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fca8fc640 1 --2- 172.21.15.50:0/277305276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fc40d11d0 0x7f6fc415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.966+0000 7f6fca8fc640 1 -- 172.21.15.50:0/277305276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc415e450 con 0x7f6fc4161d30 2024-09-11T22:18:47.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.967+0000 7f6fca8fc640 1 --2- 172.21.15.50:0/277305276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4161d30 0x7f6fc4156920 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00cbc0 tx=0x7f6fbc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.967+0000 7f6fbaffd640 1 -- 172.21.15.50:0/277305276 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc017070 con 0x7f6fc4161d30 2024-09-11T22:18:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.967+0000 7f6fbaffd640 1 -- 172.21.15.50:0/277305276 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fbc00ad40 con 0x7f6fc4161d30 2024-09-11T22:18:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.967+0000 7f6fbaffd640 1 -- 172.21.15.50:0/277305276 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc012600 con 0x7f6fc4161d30 2024-09-11T22:18:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.967+0000 7f6fcc35f640 1 -- 172.21.15.50:0/277305276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc40b5880 con 0x7f6fc4161d30 2024-09-11T22:18:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.967+0000 7f6fcc35f640 1 -- 172.21.15.50:0/277305276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc40b5e40 con 0x7f6fc4161d30 2024-09-11T22:18:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.968+0000 7f6fcc35f640 1 -- 172.21.15.50:0/277305276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fc40d1990 con 0x7f6fc4161d30 2024-09-11T22:18:47.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.968+0000 7f6fbaffd640 1 -- 172.21.15.50:0/277305276 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6fbc01a070 con 0x7f6fc4161d30 2024-09-11T22:18:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.969+0000 7f6fbaffd640 1 --2- 172.21.15.50:0/277305276 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6fa806be30 0x7f6fa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.969+0000 7f6fbaffd640 1 -- 172.21.15.50:0/277305276 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f6fbc08aa40 con 0x7f6fc4161d30 2024-09-11T22:18:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.969+0000 7f6fca0fb640 1 --2- 172.21.15.50:0/277305276 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6fa806be30 0x7f6fa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.970+0000 7f6fca0fb640 1 --2- 172.21.15.50:0/277305276 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6fa806be30 0x7f6fa806e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0034000 tx=0x7f6fc002c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:47.973+0000 7f6fbaffd640 1 -- 172.21.15.50:0/277305276 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6fbc058da0 con 0x7f6fc4161d30 2024-09-11T22:18:48.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.150+0000 7f6fcc35f640 1 -- 172.21.15.50:0/277305276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6fc40d2900 con 0x7f6fc4161d30 2024-09-11T22:18:48.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.151+0000 7f6fbaffd640 1 -- 172.21.15.50:0/277305276 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+16651 (secure 0 0 0) 0x7f6fbc08ae20 con 0x7f6fc4161d30 2024-09-11T22:18:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:48.153 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":120,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:18:16.390342+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:18:12.405607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-11T22:18:13.770508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:18:48.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.153+0000 7f6fcc35f640 1 -- 172.21.15.50:0/277305276 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6fa806be30 msgr2=0x7f6fa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:48.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.153+0000 7f6fcc35f640 1 --2- 172.21.15.50:0/277305276 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6fa806be30 0x7f6fa806e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0034000 tx=0x7f6fc002c000 comp rx=0 tx=0).stop 2024-09-11T22:18:48.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.153+0000 7f6fcc35f640 1 -- 172.21.15.50:0/277305276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4161d30 msgr2=0x7f6fc4156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:48.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.153+0000 7f6fcc35f640 1 --2- 172.21.15.50:0/277305276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4161d30 0x7f6fc4156920 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00cbc0 tx=0x7f6fbc00a430 comp rx=0 tx=0).stop 2024-09-11T22:18:48.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.153+0000 7f6fcc35f640 1 -- 172.21.15.50:0/277305276 shutdown_connections 2024-09-11T22:18:48.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.153+0000 7f6fcc35f640 1 --2- 172.21.15.50:0/277305276 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6fa806be30 0x7f6fa806e2f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.153+0000 7f6fcc35f640 1 --2- 172.21.15.50:0/277305276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fc4161d30 0x7f6fc4156920 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.153+0000 7f6fcc35f640 1 --2- 172.21.15.50:0/277305276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fc40d11d0 0x7f6fc415df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.153+0000 7f6fcc35f640 1 --2- 172.21.15.50:0/277305276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc40b78f0 0x7f6fc40b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.153+0000 7f6fcc35f640 1 -- 172.21.15.50:0/277305276 >> 172.21.15.50:0/277305276 conn(0x7f6fc40727a0 msgr2=0x7f6fc40cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:48.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.153+0000 7f6fcc35f640 1 -- 172.21.15.50:0/277305276 shutdown_connections 2024-09-11T22:18:48.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.153+0000 7f6fcc35f640 1 -- 172.21.15.50:0/277305276 wait complete. 2024-09-11T22:18:48.166 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:18:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.268+0000 7fabb9f6d640 1 Processor -- start 2024-09-11T22:18:48.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.268+0000 7fabb9f6d640 1 -- start start 2024-09-11T22:18:48.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb9f6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabb415c2c0 0x7fabb40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:48.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb9f6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fabb40d05e0 0x7fabb40ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:48.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb9f6d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabb40b4f00 con 0x7fabb40b3e10 2024-09-11T22:18:48.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb9f6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fabb40b4360 con 0x7fabb40d05e0 2024-09-11T22:18:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb9f6d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fabb40b51c0 con 0x7fabb415c2c0 2024-09-11T22:18:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fabb40d05e0 0x7fabb40ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fabb40b3e10 0x7fabb40cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44572/0 (socket says 172.21.15.50:44572) 2024-09-11T22:18:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb2ffd640 1 -- 172.21.15.50:0/1335854578 learned_addr learned my addr 172.21.15.50:0/1335854578 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb3fff640 1 -- 172.21.15.50:0/1335854578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabb415c2c0 msgr2=0x7fabb40b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb37fe640 1 --2- 172.21.15.50:0/1335854578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabb415c2c0 0x7fabb40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb3fff640 1 --2- 172.21.15.50:0/1335854578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabb415c2c0 0x7fabb40b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb3fff640 1 -- 172.21.15.50:0/1335854578 >> v1:172.21.15.50:6789/0 conn(0x7fabb40b3e10 legacy=0x7fabb40cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb3fff640 1 -- 172.21.15.50:0/1335854578 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb40b54a0 con 0x7fabb40d05e0 2024-09-11T22:18:48.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.269+0000 7fabb27fc640 1 -- 172.21.15.50:0/1335854578 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3111540224 0 0) 0x7fabb40b4f00 con 0x7fabb40b3e10 2024-09-11T22:18:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.270+0000 7fabb3fff640 1 --2- 172.21.15.50:0/1335854578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40d05e0 0x7fabb40ce790 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fabac009d90 tx=0x7fabac02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389c8227f3d8d4ee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.270+0000 7fabb27fc640 1 -- 172.21.15.50:0/1335854578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac031600 con 0x7fabb40d05e0 2024-09-11T22:18:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.270+0000 7fabb27fc640 1 -- 172.21.15.50:0/1335854578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabac0317a0 con 0x7fabb40d05e0 2024-09-11T22:18:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.270+0000 7fabb27fc640 1 -- 172.21.15.50:0/1335854578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac031b70 con 0x7fabb40d05e0 2024-09-11T22:18:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.271+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1335854578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40d05e0 msgr2=0x7fabb40ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:48.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.271+0000 7fabb9f6d640 1 --2- 172.21.15.50:0/1335854578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40d05e0 0x7fabb40ce790 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fabac009d90 tx=0x7fabac02a5d0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.271+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1335854578 shutdown_connections 2024-09-11T22:18:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.271+0000 7fabb9f6d640 1 --2- 172.21.15.50:0/1335854578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40d05e0 0x7fabb40ce790 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.271+0000 7fabb9f6d640 1 --2- 172.21.15.50:0/1335854578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabb415c2c0 0x7fabb40b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.271+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1335854578 >> 172.21.15.50:0/1335854578 conn(0x7fabb40679c0 msgr2=0x7fabb4067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:48.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.271+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1335854578 shutdown_connections 2024-09-11T22:18:48.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.271+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1335854578 wait complete. 2024-09-11T22:18:48.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.272+0000 7fabb9f6d640 1 Processor -- start 2024-09-11T22:18:48.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.272+0000 7fabb9f6d640 1 -- start start 2024-09-11T22:18:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb9f6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40b3e10 0x7fabb4157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb9f6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabb40d05e0 0x7fabb4072100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb9f6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabb415c2c0 0x7fabb4072640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb9f6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fabb406d070 con 0x7fabb40b3e10 2024-09-11T22:18:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb9f6d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fabb40ce200 con 0x7fabb40d05e0 2024-09-11T22:18:48.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb9f6d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fabb406d1f0 con 0x7fabb415c2c0 2024-09-11T22:18:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40b3e10 0x7fabb4157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40b3e10 0x7fabb4157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59252/0 (socket says 172.21.15.50:59252) 2024-09-11T22:18:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb37fe640 1 -- 172.21.15.50:0/1129926204 learned_addr learned my addr 172.21.15.50:0/1129926204 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb3fff640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabb415c2c0 0x7fabb4072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb2ffd640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabb40d05e0 0x7fabb4072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb37fe640 1 -- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabb415c2c0 msgr2=0x7fabb4072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb37fe640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabb415c2c0 0x7fabb4072640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb37fe640 1 -- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabb40d05e0 msgr2=0x7fabb4072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb37fe640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabb40d05e0 0x7fabb4072100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb37fe640 1 -- 172.21.15.50:0/1129926204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb4158130 con 0x7fabb40b3e10 2024-09-11T22:18:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.273+0000 7fabb2ffd640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabb40d05e0 0x7fabb4072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.274+0000 7fabb37fe640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40b3e10 0x7fabb4157bf0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7faba400c820 tx=0x7faba400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.274+0000 7fab9bfff640 1 -- 172.21.15.50:0/1129926204 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba4015070 con 0x7fabb40b3e10 2024-09-11T22:18:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.274+0000 7fab9bfff640 1 -- 172.21.15.50:0/1129926204 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba4004020 con 0x7fabb40b3e10 2024-09-11T22:18:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.274+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1129926204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb4156b50 con 0x7fabb40b3e10 2024-09-11T22:18:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.274+0000 7fab9bfff640 1 -- 172.21.15.50:0/1129926204 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba40043f0 con 0x7fabb40b3e10 2024-09-11T22:18:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.274+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1129926204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb4157110 con 0x7fabb40b3e10 2024-09-11T22:18:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.275+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1129926204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb4158d30 con 0x7fabb40b3e10 2024-09-11T22:18:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.275+0000 7fab9bfff640 1 -- 172.21.15.50:0/1129926204 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faba4007830 con 0x7fabb40b3e10 2024-09-11T22:18:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.276+0000 7fab9bfff640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faba006be30 0x7faba006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.276+0000 7fab9bfff640 1 -- 172.21.15.50:0/1129926204 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7faba408abe0 con 0x7fabb40b3e10 2024-09-11T22:18:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.276+0000 7fabb2ffd640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faba006be30 0x7faba006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.277+0000 7fabb2ffd640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faba006be30 0x7faba006e2f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fabb40b0f20 tx=0x7faba8007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.280+0000 7fab9bfff640 1 -- 172.21.15.50:0/1129926204 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabb4158d30 con 0x7fabb40b3e10 2024-09-11T22:18:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.496+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1129926204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fabb415c6a0 con 0x7fabb40b3e10 2024-09-11T22:18:48.497 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:18:48.496+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:18:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.498+0000 7fab9bfff640 1 -- 172.21.15.50:0/1129926204 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) ==== 161+0+0 (secure 0 0 0) 0x7fabb4158130 con 0x7fabb40b3e10 2024-09-11T22:18:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:18:48.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.500+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faba006be30 msgr2=0x7faba006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.500+0000 7fabb9f6d640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faba006be30 0x7faba006e2f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fabb40b0f20 tx=0x7faba8007c10 comp rx=0 tx=0).stop 2024-09-11T22:18:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.500+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1129926204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40b3e10 msgr2=0x7fabb4157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.500+0000 7fabb9f6d640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40b3e10 0x7fabb4157bf0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7faba400c820 tx=0x7faba400cce0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.501+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1129926204 shutdown_connections 2024-09-11T22:18:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.501+0000 7fabb9f6d640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faba006be30 0x7faba006e2f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.501+0000 7fabb9f6d640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabb415c2c0 0x7fabb4072640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.501+0000 7fabb9f6d640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabb40d05e0 0x7fabb4072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.501+0000 7fabb9f6d640 1 --2- 172.21.15.50:0/1129926204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabb40b3e10 0x7fabb4157bf0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.501+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1129926204 >> 172.21.15.50:0/1129926204 conn(0x7fabb40679c0 msgr2=0x7fabb4158620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.501+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1129926204 shutdown_connections 2024-09-11T22:18:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.501+0000 7fabb9f6d640 1 -- 172.21.15.50:0/1129926204 wait complete. 2024-09-11T22:18:48.512 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:18:48.542 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:18:48.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.616+0000 7fe2006b7640 1 Processor -- start 2024-09-11T22:18:48.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.616+0000 7fe2006b7640 1 -- start start 2024-09-11T22:18:48.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.617+0000 7fe2006b7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1f80cdd50 0x7fe1f80b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:48.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.617+0000 7fe2006b7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f80ce5f0 con 0x7fe1f80cf580 2024-09-11T22:18:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.617+0000 7fe2006b7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f80ce310 con 0x7fe1f815e840 2024-09-11T22:18:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.617+0000 7fe2006b7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe1f806c240 con 0x7fe1f80cdd50 2024-09-11T22:18:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.617+0000 7fe1fec54640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1f80cdd50 0x7fe1f80b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.617+0000 7fe1fdc52640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe1f80cf580 0x7fe1f806c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44588/0 (socket says 172.21.15.50:44588) 2024-09-11T22:18:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.617+0000 7fe1fdc52640 1 -- 172.21.15.50:0/2939122890 learned_addr learned my addr 172.21.15.50:0/2939122890 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.617+0000 7fe1fd451640 1 -- 172.21.15.50:0/2939122890 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713578097 0 0) 0x7fe1f80ce5f0 con 0x7fe1f80cf580 2024-09-11T22:18:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.617+0000 7fe1fd451640 1 -- 172.21.15.50:0/2939122890 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1e4003520 con 0x7fe1f80cf580 2024-09-11T22:18:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.617+0000 7fe1fec54640 1 -- 172.21.15.50:0/2939122890 >> v1:172.21.15.77:6789/0 conn(0x7fe1f815e840 legacy=0x7fe1f80cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.617+0000 7fe1fec54640 1 -- 172.21.15.50:0/2939122890 >> v1:172.21.15.50:6789/0 conn(0x7fe1f80cf580 legacy=0x7fe1f806c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.618+0000 7fe1fec54640 1 -- 172.21.15.50:0/2939122890 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f806bbf0 con 0x7fe1f80cdd50 2024-09-11T22:18:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.618+0000 7fe1fec54640 1 --2- 172.21.15.50:0/2939122890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80cdd50 0x7fe1f80b4c70 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009d90 tx=0x7fe1f002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9849f127dec1ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.618+0000 7fe1fd451640 1 -- 172.21.15.50:0/2939122890 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0007740 con 0x7fe1f80cdd50 2024-09-11T22:18:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.618+0000 7fe1fd451640 1 -- 172.21.15.50:0/2939122890 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f00078e0 con 0x7fe1f80cdd50 2024-09-11T22:18:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.618+0000 7fe1fd451640 1 -- 172.21.15.50:0/2939122890 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0007cb0 con 0x7fe1f80cdd50 2024-09-11T22:18:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.619+0000 7fe2006b7640 1 -- 172.21.15.50:0/2939122890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80cdd50 msgr2=0x7fe1f80b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.619+0000 7fe2006b7640 1 --2- 172.21.15.50:0/2939122890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80cdd50 0x7fe1f80b4c70 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009d90 tx=0x7fe1f002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.619+0000 7fe2006b7640 1 -- 172.21.15.50:0/2939122890 shutdown_connections 2024-09-11T22:18:48.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.619+0000 7fe2006b7640 1 --2- 172.21.15.50:0/2939122890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80cdd50 0x7fe1f80b4c70 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.619+0000 7fe2006b7640 1 -- 172.21.15.50:0/2939122890 >> 172.21.15.50:0/2939122890 conn(0x7fe1f80b4150 msgr2=0x7fe1f80b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:48.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.619+0000 7fe2006b7640 1 -- 172.21.15.50:0/2939122890 shutdown_connections 2024-09-11T22:18:48.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.619+0000 7fe2006b7640 1 -- 172.21.15.50:0/2939122890 wait complete. 2024-09-11T22:18:48.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.620+0000 7fe2006b7640 1 Processor -- start 2024-09-11T22:18:48.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.620+0000 7fe2006b7640 1 -- start start 2024-09-11T22:18:48.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe2006b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80cdd50 0x7fe1f814b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:48.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe2006b7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1f80cf580 0x7fe1f80b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:48.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe2006b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f815e840 0x7fe1f80b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:48.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe2006b7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f815ec20 con 0x7fe1f80cdd50 2024-09-11T22:18:48.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe2006b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f80d0470 con 0x7fe1f815e840 2024-09-11T22:18:48.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe2006b7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f815eda0 con 0x7fe1f80cf580 2024-09-11T22:18:48.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe1fe453640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80cdd50 0x7fe1f814b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:48.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe1fe453640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80cdd50 0x7fe1f814b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59272/0 (socket says 172.21.15.50:59272) 2024-09-11T22:18:48.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe1fe453640 1 -- 172.21.15.50:0/2104555337 learned_addr learned my addr 172.21.15.50:0/2104555337 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:48.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe1fdc52640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1f80cf580 0x7fe1f80b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:48.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe1fec54640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f815e840 0x7fe1f80b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:48.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe1fe453640 1 -- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1f80cf580 msgr2=0x7fe1f80b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:48.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe1fe453640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1f80cf580 0x7fe1f80b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe1fe453640 1 -- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f815e840 msgr2=0x7fe1f80b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe1fe453640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f815e840 0x7fe1f80b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe1fe453640 1 -- 172.21.15.50:0/2104555337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f80ca380 con 0x7fe1f80cdd50 2024-09-11T22:18:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.621+0000 7fe1fdc52640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1f80cf580 0x7fe1f80b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.622+0000 7fe1fe453640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80cdd50 0x7fe1f814b920 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400c400 tx=0x7fe1f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.622+0000 7fe1eeffd640 1 -- 172.21.15.50:0/2104555337 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f40052d0 con 0x7fe1f80cdd50 2024-09-11T22:18:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.622+0000 7fe1eeffd640 1 -- 172.21.15.50:0/2104555337 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f4005490 con 0x7fe1f80cdd50 2024-09-11T22:18:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.622+0000 7fe1eeffd640 1 -- 172.21.15.50:0/2104555337 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4007260 con 0x7fe1f80cdd50 2024-09-11T22:18:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.622+0000 7fe2006b7640 1 -- 172.21.15.50:0/2104555337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f80ca660 con 0x7fe1f80cdd50 2024-09-11T22:18:48.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.622+0000 7fe2006b7640 1 -- 172.21.15.50:0/2104555337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f814be60 con 0x7fe1f80cdd50 2024-09-11T22:18:48.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.623+0000 7fe2006b7640 1 -- 172.21.15.50:0/2104555337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f8075770 con 0x7fe1f80cdd50 2024-09-11T22:18:48.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.623+0000 7fe1eeffd640 1 -- 172.21.15.50:0/2104555337 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe1f4007400 con 0x7fe1f80cdd50 2024-09-11T22:18:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.624+0000 7fe1eeffd640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe1dc06be30 0x7fe1dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.624+0000 7fe1eeffd640 1 -- 172.21.15.50:0/2104555337 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5795+0+0 (secure 0 0 0) 0x7fe1f408a2c0 con 0x7fe1f80cdd50 2024-09-11T22:18:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.624+0000 7fe1fdc52640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe1dc06be30 0x7fe1dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.625+0000 7fe1fdc52640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe1dc06be30 0x7fe1dc06e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe1f81f7d20 tx=0x7fe1e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.628+0000 7fe1eeffd640 1 -- 172.21.15.50:0/2104555337 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1f4058650 con 0x7fe1f80cdd50 2024-09-11T22:18:48.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:48.840+0000 7fe2006b7640 1 -- 172.21.15.50:0/2104555337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe1f806d3a0 con 0x7fe1f80cdd50 2024-09-11T22:18:49.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.499+0000 7fe1eeffd640 1 -- 172.21.15.50:0/2104555337 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) ==== 104+0+0 (secure 0 0 0) 0x7fe1f405c950 con 0x7fe1f80cdd50 2024-09-11T22:18:49.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.502+0000 7fe2006b7640 1 -- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe1dc06be30 msgr2=0x7fe1dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.502+0000 7fe2006b7640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe1dc06be30 0x7fe1dc06e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe1f81f7d20 tx=0x7fe1e8009040 comp rx=0 tx=0).stop 2024-09-11T22:18:49.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.502+0000 7fe2006b7640 1 -- 172.21.15.50:0/2104555337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80cdd50 msgr2=0x7fe1f814b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.502+0000 7fe2006b7640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80cdd50 0x7fe1f814b920 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400c400 tx=0x7fe1f400c8c0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.502+0000 7fe2006b7640 1 -- 172.21.15.50:0/2104555337 shutdown_connections 2024-09-11T22:18:49.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.502+0000 7fe2006b7640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe1dc06be30 0x7fe1dc06e2f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.502+0000 7fe2006b7640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1f80cf580 0x7fe1f80b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.502+0000 7fe2006b7640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1f815e840 0x7fe1f80b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.502+0000 7fe2006b7640 1 --2- 172.21.15.50:0/2104555337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1f80cdd50 0x7fe1f814b920 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.502+0000 7fe2006b7640 1 -- 172.21.15.50:0/2104555337 >> 172.21.15.50:0/2104555337 conn(0x7fe1f80b4150 msgr2=0x7fe1f8070850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:49.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.502+0000 7fe2006b7640 1 -- 172.21.15.50:0/2104555337 shutdown_connections 2024-09-11T22:18:49.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.502+0000 7fe2006b7640 1 -- 172.21.15.50:0/2104555337 wait complete. 2024-09-11T22:18:49.516 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:18:49.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.630+0000 7f18d162c640 1 Processor -- start 2024-09-11T22:18:49.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.630+0000 7f18d162c640 1 -- start start 2024-09-11T22:18:49.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18d162c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18cc15dd50 0x7f18cc06e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18d162c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f18cc06e6a0 0x7f18cc0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18d162c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18cc15ca60 con 0x7f18cc15c680 2024-09-11T22:18:49.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18d162c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f18cc0b3fd0 con 0x7f18cc06e6a0 2024-09-11T22:18:49.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18d162c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f18cc0c6380 con 0x7f18cc15dd50 2024-09-11T22:18:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18caffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f18cc15c680 0x7f18cc0c58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44596/0 (socket says 172.21.15.50:44596) 2024-09-11T22:18:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18caffd640 1 -- 172.21.15.50:0/3537315089 learned_addr learned my addr 172.21.15.50:0/3537315089 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18cb7fe640 1 --2- 172.21.15.50:0/3537315089 >> v2:172.21.15.50:3300/0 conn(0x7f18cc06e6a0 0x7f18cc0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18ca7fc640 1 --2- 172.21.15.50:0/3537315089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18cc15dd50 0x7f18cc06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18c9ffb640 1 -- 172.21.15.50:0/3537315089 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2367975105 0 0) 0x7f18bc001110 con 0x7f18cc15c680 2024-09-11T22:18:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18c9ffb640 1 -- 172.21.15.50:0/3537315089 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18b4003520 con 0x7f18cc15c680 2024-09-11T22:18:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18cb7fe640 1 -- 172.21.15.50:0/3537315089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18cc15dd50 msgr2=0x7f18cc06e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18cb7fe640 1 --2- 172.21.15.50:0/3537315089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18cc15dd50 0x7f18cc06e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18cb7fe640 1 -- 172.21.15.50:0/3537315089 >> v1:172.21.15.50:6789/0 conn(0x7f18cc15c680 legacy=0x7f18cc0c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.631+0000 7f18cb7fe640 1 -- 172.21.15.50:0/3537315089 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc0b4220 con 0x7f18cc06e6a0 2024-09-11T22:18:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.632+0000 7f18cb7fe640 1 --2- 172.21.15.50:0/3537315089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18cc06e6a0 0x7f18cc0b4d00 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009d90 tx=0x7f18c402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5814254244e52dab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.632+0000 7f18c9ffb640 1 -- 172.21.15.50:0/3537315089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4007740 con 0x7f18cc06e6a0 2024-09-11T22:18:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.632+0000 7f18c9ffb640 1 -- 172.21.15.50:0/3537315089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c40078e0 con 0x7f18cc06e6a0 2024-09-11T22:18:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.632+0000 7f18c9ffb640 1 -- 172.21.15.50:0/3537315089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4007cb0 con 0x7f18cc06e6a0 2024-09-11T22:18:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.633+0000 7f18d162c640 1 -- 172.21.15.50:0/3537315089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18cc06e6a0 msgr2=0x7f18cc0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.633+0000 7f18d162c640 1 --2- 172.21.15.50:0/3537315089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18cc06e6a0 0x7f18cc0b4d00 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009d90 tx=0x7f18c402a660 comp rx=0 tx=0).stop 2024-09-11T22:18:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.633+0000 7f18d162c640 1 -- 172.21.15.50:0/3537315089 shutdown_connections 2024-09-11T22:18:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.633+0000 7f18d162c640 1 --2- 172.21.15.50:0/3537315089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18cc06e6a0 0x7f18cc0b4d00 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.633+0000 7f18d162c640 1 --2- 172.21.15.50:0/3537315089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18cc15dd50 0x7f18cc06e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.633+0000 7f18d162c640 1 -- 172.21.15.50:0/3537315089 >> 172.21.15.50:0/3537315089 conn(0x7f18cc075270 msgr2=0x7f18cc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.633+0000 7f18d162c640 1 -- 172.21.15.50:0/3537315089 shutdown_connections 2024-09-11T22:18:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.633+0000 7f18d162c640 1 -- 172.21.15.50:0/3537315089 wait complete. 2024-09-11T22:18:49.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.634+0000 7f18d162c640 1 Processor -- start 2024-09-11T22:18:49.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.634+0000 7f18d162c640 1 -- start start 2024-09-11T22:18:49.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18d162c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18cc06e6a0 0x7f18cc153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18d162c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18cc15c680 0x7f18cc155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18d162c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18cc15dd50 0x7f18cc0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18d162c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc15da90 con 0x7f18cc06e6a0 2024-09-11T22:18:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18d162c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc0b47e0 con 0x7f18cc15dd50 2024-09-11T22:18:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18d162c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f18cc0c5fd0 con 0x7f18cc15c680 2024-09-11T22:18:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18caffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18cc06e6a0 0x7f18cc153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18caffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18cc06e6a0 0x7f18cc153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59294/0 (socket says 172.21.15.50:59294) 2024-09-11T22:18:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18caffd640 1 -- 172.21.15.50:0/2137961079 learned_addr learned my addr 172.21.15.50:0/2137961079 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18ca7fc640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18cc15c680 0x7f18cc155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18cb7fe640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18cc15dd50 0x7f18cc0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18caffd640 1 -- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18cc15c680 msgr2=0x7f18cc155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18caffd640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18cc15c680 0x7f18cc155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18caffd640 1 -- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18cc15dd50 msgr2=0x7f18cc0cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18caffd640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18cc15dd50 0x7f18cc0cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18caffd640 1 -- 172.21.15.50:0/2137961079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc146bf0 con 0x7f18cc06e6a0 2024-09-11T22:18:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18ca7fc640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18cc15c680 0x7f18cc155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.635+0000 7f18cb7fe640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18cc15dd50 0x7f18cc0cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.636+0000 7f18caffd640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18cc06e6a0 0x7f18cc153ba0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00c730 tx=0x7f18bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.636+0000 7f18b37fe640 1 -- 172.21.15.50:0/2137961079 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc017070 con 0x7f18cc06e6a0 2024-09-11T22:18:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.636+0000 7f18b37fe640 1 -- 172.21.15.50:0/2137961079 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18bc005ad0 con 0x7f18cc06e6a0 2024-09-11T22:18:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.636+0000 7f18b37fe640 1 -- 172.21.15.50:0/2137961079 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc007e20 con 0x7f18cc06e6a0 2024-09-11T22:18:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.636+0000 7f18d162c640 1 -- 172.21.15.50:0/2137961079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc146ed0 con 0x7f18cc06e6a0 2024-09-11T22:18:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.636+0000 7f18d162c640 1 -- 172.21.15.50:0/2137961079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc147490 con 0x7f18cc06e6a0 2024-09-11T22:18:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.637+0000 7f18d162c640 1 -- 172.21.15.50:0/2137961079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18cc075770 con 0x7f18cc06e6a0 2024-09-11T22:18:49.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.638+0000 7f18b37fe640 1 -- 172.21.15.50:0/2137961079 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18bc01a070 con 0x7f18cc06e6a0 2024-09-11T22:18:49.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.638+0000 7f18b37fe640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f18b806be30 0x7f18b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:49.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.638+0000 7f18b37fe640 1 -- 172.21.15.50:0/2137961079 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5795+0+0 (secure 0 0 0) 0x7f18bc08a290 con 0x7f18cc06e6a0 2024-09-11T22:18:49.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.638+0000 7f18ca7fc640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f18b806be30 0x7f18b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:49.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.639+0000 7f18ca7fc640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f18b806be30 0x7f18b806e2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f18c0006fd0 tx=0x7f18c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:49.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.642+0000 7f18b37fe640 1 -- 172.21.15.50:0/2137961079 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18cc075770 con 0x7f18cc06e6a0 2024-09-11T22:18:49.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:49.818+0000 7f18d162c640 1 -- 172.21.15.50:0/2137961079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f18cc06e160 con 0x7f18cc06e6a0 2024-09-11T22:18:50.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.501+0000 7f18b37fe640 1 -- 172.21.15.50:0/2137961079 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v122) ==== 181+0+0 (secure 0 0 0) 0x7f18cc15ca60 con 0x7f18cc06e6a0 2024-09-11T22:18:50.501 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:18:50.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.504+0000 7f18d162c640 1 -- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f18b806be30 msgr2=0x7f18b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:50.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.504+0000 7f18d162c640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f18b806be30 0x7f18b806e2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f18c0006fd0 tx=0x7f18c0008040 comp rx=0 tx=0).stop 2024-09-11T22:18:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.504+0000 7f18d162c640 1 -- 172.21.15.50:0/2137961079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18cc06e6a0 msgr2=0x7f18cc153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.504+0000 7f18d162c640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18cc06e6a0 0x7f18cc153ba0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00c730 tx=0x7f18bc00cbf0 comp rx=0 tx=0).stop 2024-09-11T22:18:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.504+0000 7f18d162c640 1 -- 172.21.15.50:0/2137961079 shutdown_connections 2024-09-11T22:18:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.504+0000 7f18d162c640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f18b806be30 0x7f18b806e2f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.504+0000 7f18d162c640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18cc15c680 0x7f18cc155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.504+0000 7f18d162c640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18cc15dd50 0x7f18cc0cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.504+0000 7f18d162c640 1 --2- 172.21.15.50:0/2137961079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18cc06e6a0 0x7f18cc153ba0 secure :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00c730 tx=0x7f18bc00cbf0 comp rx=0 tx=0).stop 2024-09-11T22:18:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.504+0000 7f18d162c640 1 -- 172.21.15.50:0/2137961079 >> 172.21.15.50:0/2137961079 conn(0x7f18cc075270 msgr2=0x7f18cc15cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.505+0000 7f18d162c640 1 -- 172.21.15.50:0/2137961079 shutdown_connections 2024-09-11T22:18:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.505+0000 7f18d162c640 1 -- 172.21.15.50:0/2137961079 wait complete. 2024-09-11T22:18:50.521 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:18:50.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.633+0000 7f1185742640 1 Processor -- start 2024-09-11T22:18:50.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.633+0000 7f1185742640 1 -- start start 2024-09-11T22:18:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f1185742640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f118015e8e0 0x7f11800b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f1185742640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1180162350 0x7f1180162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f1185742640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1180163080 con 0x7f11800d1580 2024-09-11T22:18:50.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f1185742640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f118015ecc0 con 0x7f1180162350 2024-09-11T22:18:50.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f1185742640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f11800d2ad0 con 0x7f118015e8e0 2024-09-11T22:18:50.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f117f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1180162350 0x7f1180162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:50.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f117e7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f11800d1580 0x7f11800d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44600/0 (socket says 172.21.15.50:44600) 2024-09-11T22:18:50.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f117e7fc640 1 -- 172.21.15.50:0/119743164 learned_addr learned my addr 172.21.15.50:0/119743164 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:50.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f117effd640 1 --2- 172.21.15.50:0/119743164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f118015e8e0 0x7f11800b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:50.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f117f7fe640 1 -- 172.21.15.50:0/119743164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f118015e8e0 msgr2=0x7f11800b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:50.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f117f7fe640 1 --2- 172.21.15.50:0/119743164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f118015e8e0 0x7f11800b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:50.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f117f7fe640 1 -- 172.21.15.50:0/119743164 >> v1:172.21.15.50:6789/0 conn(0x7f11800d1580 legacy=0x7f11800d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:50.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f117dffb640 1 -- 172.21.15.50:0/119743164 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4194055248 0 0) 0x7f1180163080 con 0x7f11800d1580 2024-09-11T22:18:50.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.634+0000 7f117f7fe640 1 -- 172.21.15.50:0/119743164 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11800d2d20 con 0x7f1180162350 2024-09-11T22:18:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.635+0000 7f117f7fe640 1 --2- 172.21.15.50:0/119743164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1180162350 0x7f1180162800 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f1178009d90 tx=0x7f117802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3973398911c07ad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.635+0000 7f117dffb640 1 -- 172.21.15.50:0/119743164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178007740 con 0x7f1180162350 2024-09-11T22:18:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.635+0000 7f117dffb640 1 -- 172.21.15.50:0/119743164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11780078e0 con 0x7f1180162350 2024-09-11T22:18:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.635+0000 7f117dffb640 1 -- 172.21.15.50:0/119743164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178007cb0 con 0x7f1180162350 2024-09-11T22:18:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.636+0000 7f1185742640 1 -- 172.21.15.50:0/119743164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1180162350 msgr2=0x7f1180162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.636+0000 7f1185742640 1 --2- 172.21.15.50:0/119743164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1180162350 0x7f1180162800 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f1178009d90 tx=0x7f117802a6f0 comp rx=0 tx=0).stop 2024-09-11T22:18:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.636+0000 7f1185742640 1 -- 172.21.15.50:0/119743164 shutdown_connections 2024-09-11T22:18:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.636+0000 7f1185742640 1 --2- 172.21.15.50:0/119743164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1180162350 0x7f1180162800 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.636+0000 7f1185742640 1 --2- 172.21.15.50:0/119743164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f118015e8e0 0x7f11800b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.636+0000 7f1185742640 1 -- 172.21.15.50:0/119743164 >> 172.21.15.50:0/119743164 conn(0x7f1180067ba0 msgr2=0x7f1180067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.636+0000 7f1185742640 1 -- 172.21.15.50:0/119743164 shutdown_connections 2024-09-11T22:18:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.636+0000 7f1185742640 1 -- 172.21.15.50:0/119743164 wait complete. 2024-09-11T22:18:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.637+0000 7f1185742640 1 Processor -- start 2024-09-11T22:18:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.637+0000 7f1185742640 1 -- start start 2024-09-11T22:18:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.638+0000 7f1185742640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11800d1580 0x7f11800b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.638+0000 7f1185742640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f118015e8e0 0x7f11800cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.638+0000 7f1185742640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1180162350 0x7f11800ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.638+0000 7f1185742640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1180162d40 con 0x7f1180162350 2024-09-11T22:18:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.638+0000 7f1185742640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f11800d3370 con 0x7f11800d1580 2024-09-11T22:18:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.638+0000 7f1185742640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f11800d3800 con 0x7f118015e8e0 2024-09-11T22:18:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.638+0000 7f117f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1180162350 0x7f11800ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.638+0000 7f117f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1180162350 0x7f11800ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59312/0 (socket says 172.21.15.50:59312) 2024-09-11T22:18:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.638+0000 7f117f7fe640 1 -- 172.21.15.50:0/1033456691 learned_addr learned my addr 172.21.15.50:0/1033456691 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.638+0000 7f117e7fc640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f118015e8e0 0x7f11800cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.638+0000 7f117effd640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11800d1580 0x7f11800b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.639+0000 7f117f7fe640 1 -- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f118015e8e0 msgr2=0x7f11800cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.639+0000 7f117f7fe640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f118015e8e0 0x7f11800cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.639+0000 7f117f7fe640 1 -- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11800d1580 msgr2=0x7f11800b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.639+0000 7f117f7fe640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11800d1580 0x7f11800b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.639+0000 7f117f7fe640 1 -- 172.21.15.50:0/1033456691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1180156530 con 0x7f1180162350 2024-09-11T22:18:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.639+0000 7f117f7fe640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1180162350 0x7f11800ca7a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f1178009eb0 tx=0x7f1178004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.639+0000 7f11677fe640 1 -- 172.21.15.50:0/1033456691 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178041030 con 0x7f1180162350 2024-09-11T22:18:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.639+0000 7f11677fe640 1 -- 172.21.15.50:0/1033456691 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11780319c0 con 0x7f1180162350 2024-09-11T22:18:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.639+0000 7f11677fe640 1 -- 172.21.15.50:0/1033456691 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178031d70 con 0x7f1180162350 2024-09-11T22:18:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.639+0000 7f1185742640 1 -- 172.21.15.50:0/1033456691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11800b43f0 con 0x7f1180162350 2024-09-11T22:18:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.639+0000 7f1185742640 1 -- 172.21.15.50:0/1033456691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11800b49b0 con 0x7f1180162350 2024-09-11T22:18:50.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.640+0000 7f1185742640 1 -- 172.21.15.50:0/1033456691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11800b7880 con 0x7f1180162350 2024-09-11T22:18:50.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.641+0000 7f11677fe640 1 -- 172.21.15.50:0/1033456691 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1178039040 con 0x7f1180162350 2024-09-11T22:18:50.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.641+0000 7f11677fe640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f116c06be30 0x7f116c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:50.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.641+0000 7f11677fe640 1 -- 172.21.15.50:0/1033456691 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5357+0+0 (secure 0 0 0) 0x7f11780abf60 con 0x7f1180162350 2024-09-11T22:18:50.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.641+0000 7f117effd640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f116c06be30 0x7f116c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:50.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.642+0000 7f117effd640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f116c06be30 0x7f116c06e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1170006fd0 tx=0x7f1170008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.645+0000 7f11677fe640 1 -- 172.21.15.50:0/1033456691 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1180156530 con 0x7f1180162350 2024-09-11T22:18:50.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:50.820+0000 7f1185742640 1 -- 172.21.15.50:0/1033456691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f11800ba770 con 0x7f1180162350 2024-09-11T22:18:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.502+0000 7f11677fe640 1 -- 172.21.15.50:0/1033456691 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v123) ==== 169+0+0 (secure 0 0 0) 0x7f117807a4b0 con 0x7f1180162350 2024-09-11T22:18:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:18:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.506+0000 7f1185742640 1 -- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f116c06be30 msgr2=0x7f116c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.506+0000 7f1185742640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f116c06be30 0x7f116c06e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1170006fd0 tx=0x7f1170008040 comp rx=0 tx=0).stop 2024-09-11T22:18:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.506+0000 7f1185742640 1 -- 172.21.15.50:0/1033456691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1180162350 msgr2=0x7f11800ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.506+0000 7f1185742640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1180162350 0x7f11800ca7a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f1178009eb0 tx=0x7f1178004a40 comp rx=0 tx=0).stop 2024-09-11T22:18:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.507+0000 7f1185742640 1 -- 172.21.15.50:0/1033456691 shutdown_connections 2024-09-11T22:18:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.507+0000 7f1185742640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f116c06be30 0x7f116c06e2f0 secure :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1170006fd0 tx=0x7f1170008040 comp rx=0 tx=0).stop 2024-09-11T22:18:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.507+0000 7f1185742640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f118015e8e0 0x7f11800cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.507+0000 7f1185742640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1180162350 0x7f11800ca7a0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.507+0000 7f1185742640 1 --2- 172.21.15.50:0/1033456691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11800d1580 0x7f11800b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.507+0000 7f1185742640 1 -- 172.21.15.50:0/1033456691 >> 172.21.15.50:0/1033456691 conn(0x7f1180067ba0 msgr2=0x7f1180067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.507+0000 7f1185742640 1 -- 172.21.15.50:0/1033456691 shutdown_connections 2024-09-11T22:18:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.507+0000 7f1185742640 1 -- 172.21.15.50:0/1033456691 wait complete. 2024-09-11T22:18:51.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T22:18:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.658+0000 7f2e7d817640 1 Processor -- start 2024-09-11T22:18:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.659+0000 7f2e7d817640 1 -- start start 2024-09-11T22:18:51.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.660+0000 7f2e7d817640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e7815c770 0x7f2e780b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:51.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.660+0000 7f2e7d817640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e780b5920 0x7f2e780b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.660+0000 7f2e7d817640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e7815f060 con 0x7f2e780b6510 2024-09-11T22:18:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.660+0000 7f2e7d817640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2e780b6940 con 0x7f2e780b5920 2024-09-11T22:18:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.660+0000 7f2e7d817640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2e7815cef0 con 0x7f2e7815c770 2024-09-11T22:18:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.660+0000 7f2e767fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e780b5920 0x7f2e780b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.660+0000 7f2e767fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e780b5920 0x7f2e780b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59318/0 (socket says 172.21.15.50:59318) 2024-09-11T22:18:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.660+0000 7f2e767fc640 1 -- 172.21.15.50:0/1109544148 learned_addr learned my addr 172.21.15.50:0/1109544148 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.661+0000 7f2e76ffd640 1 --2- 172.21.15.50:0/1109544148 >> v2:172.21.15.77:3300/0 conn(0x7f2e7815c770 0x7f2e780b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.662+0000 7f2e76ffd640 1 -- 172.21.15.50:0/1109544148 >> v2:172.21.15.50:3300/0 conn(0x7f2e780b5920 msgr2=0x7f2e780b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.662+0000 7f2e76ffd640 1 --2- 172.21.15.50:0/1109544148 >> v2:172.21.15.50:3300/0 conn(0x7f2e780b5920 0x7f2e780b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.662+0000 7f2e76ffd640 1 -- 172.21.15.50:0/1109544148 >> v1:172.21.15.50:6789/0 conn(0x7f2e780b6510 legacy=0x7f2e780d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.662+0000 7f2e76ffd640 1 -- 172.21.15.50:0/1109544148 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7815d1d0 con 0x7f2e7815c770 2024-09-11T22:18:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.663+0000 7f2e76ffd640 1 --2- 172.21.15.50:0/1109544148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7815c770 0x7f2e780b53e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2e7806e560 tx=0x7f2e68033160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eba757133ff1a859 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.664+0000 7f2e75ffb640 1 -- 172.21.15.50:0/1109544148 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68040070 con 0x7f2e7815c770 2024-09-11T22:18:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.664+0000 7f2e75ffb640 1 -- 172.21.15.50:0/1109544148 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6803b440 con 0x7f2e7815c770 2024-09-11T22:18:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.664+0000 7f2e75ffb640 1 -- 172.21.15.50:0/1109544148 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6803b810 con 0x7f2e7815c770 2024-09-11T22:18:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.665+0000 7f2e7d817640 1 -- 172.21.15.50:0/1109544148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7815c770 msgr2=0x7f2e780b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.665+0000 7f2e7d817640 1 --2- 172.21.15.50:0/1109544148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7815c770 0x7f2e780b53e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2e7806e560 tx=0x7f2e68033160 comp rx=0 tx=0).stop 2024-09-11T22:18:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.666+0000 7f2e7d817640 1 -- 172.21.15.50:0/1109544148 shutdown_connections 2024-09-11T22:18:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.666+0000 7f2e7d817640 1 --2- 172.21.15.50:0/1109544148 >> v2:172.21.15.50:3300/0 conn(0x7f2e780b5920 0x7f2e780b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.666+0000 7f2e7d817640 1 --2- 172.21.15.50:0/1109544148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7815c770 0x7f2e780b53e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.666+0000 7f2e7d817640 1 -- 172.21.15.50:0/1109544148 >> 172.21.15.50:0/1109544148 conn(0x7f2e780b7940 msgr2=0x7f2e780b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.667+0000 7f2e7d817640 1 -- 172.21.15.50:0/1109544148 shutdown_connections 2024-09-11T22:18:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.668+0000 7f2e7d817640 1 -- 172.21.15.50:0/1109544148 wait complete. 2024-09-11T22:18:51.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.670+0000 7f2e7d817640 1 Processor -- start 2024-09-11T22:18:51.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.670+0000 7f2e7d817640 1 -- start start 2024-09-11T22:18:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.671+0000 7f2e7d817640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e780b5920 0x7f2e7814c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.671+0000 7f2e7d817640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e780b6510 0x7f2e780cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.671+0000 7f2e7d817640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7815c770 0x7f2e781f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.671+0000 7f2e7d817640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7815dcb0 con 0x7f2e780b6510 2024-09-11T22:18:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.671+0000 7f2e7d817640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7815d790 con 0x7f2e7815c770 2024-09-11T22:18:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.671+0000 7f2e7d817640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2e7815cb50 con 0x7f2e780b5920 2024-09-11T22:18:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.671+0000 7f2e76ffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e780b5920 0x7f2e7814c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.671+0000 7f2e76ffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e780b5920 0x7f2e7814c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:51778/0 (socket says 172.21.15.50:51778) 2024-09-11T22:18:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.671+0000 7f2e76ffd640 1 -- 172.21.15.50:0/2421277274 learned_addr learned my addr 172.21.15.50:0/2421277274 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.672+0000 7f2e777fe640 1 --2- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7815c770 0x7f2e781f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.672+0000 7f2e76ffd640 1 -- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7815c770 msgr2=0x7f2e781f03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.672+0000 7f2e76ffd640 1 --2- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7815c770 0x7f2e781f03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.672+0000 7f2e76ffd640 1 -- 172.21.15.50:0/2421277274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e780b6510 msgr2=0x7f2e780cefa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:18:51.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.672+0000 7f2e76ffd640 1 --2- 172.21.15.50:0/2421277274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e780b6510 0x7f2e780cefa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.672+0000 7f2e76ffd640 1 -- 172.21.15.50:0/2421277274 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e781f0f20 con 0x7f2e780b5920 2024-09-11T22:18:51.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.672+0000 7f2e76ffd640 1 --2- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e780b5920 0x7f2e7814c3d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2e68033750 tx=0x7f2e680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.674+0000 7f2e5ffff640 1 -- 172.21.15.50:0/2421277274 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6804b020 con 0x7f2e780b5920 2024-09-11T22:18:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.674+0000 7f2e5ffff640 1 -- 172.21.15.50:0/2421277274 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e68039780 con 0x7f2e780b5920 2024-09-11T22:18:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.674+0000 7f2e5ffff640 1 -- 172.21.15.50:0/2421277274 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68040040 con 0x7f2e780b5920 2024-09-11T22:18:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.674+0000 7f2e7d817640 1 -- 172.21.15.50:0/2421277274 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e781f1200 con 0x7f2e780b5920 2024-09-11T22:18:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.674+0000 7f2e7d817640 1 -- 172.21.15.50:0/2421277274 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e78150af0 con 0x7f2e780b5920 2024-09-11T22:18:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.676+0000 7f2e7d817640 1 -- 172.21.15.50:0/2421277274 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e780ce590 con 0x7f2e780b5920 2024-09-11T22:18:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.677+0000 7f2e5ffff640 1 -- 172.21.15.50:0/2421277274 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e6804e020 con 0x7f2e780b5920 2024-09-11T22:18:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.678+0000 7f2e5ffff640 1 --2- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e6406be80 0x7f2e6406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.678+0000 7f2e5ffff640 1 -- 172.21.15.50:0/2421277274 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(123..123 src has 1..123) ==== 4943+0+0 (secure 0 0 0) 0x7f2e680b4830 con 0x7f2e780b5920 2024-09-11T22:18:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.678+0000 7f2e767fc640 1 --2- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e6406be80 0x7f2e6406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.679+0000 7f2e767fc640 1 --2- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e6406be80 0x7f2e6406e340 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2e781f4aa0 tx=0x7f2e6c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.685+0000 7f2e5ffff640 1 -- 172.21.15.50:0/2421277274 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e68055030 con 0x7f2e780b5920 2024-09-11T22:18:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.863+0000 7f2e7d817640 1 -- 172.21.15.50:0/2421277274 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f2e780b0bd0 con 0x7f2e780b5920 2024-09-11T22:18:51.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.868+0000 7f2e5ffff640 1 -- 172.21.15.50:0/2421277274 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7f2e68083550 con 0x7f2e780b5920 2024-09-11T22:18:51.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.870+0000 7f2e7d817640 1 -- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e6406be80 msgr2=0x7f2e6406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.870+0000 7f2e7d817640 1 --2- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e6406be80 0x7f2e6406e340 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2e781f4aa0 tx=0x7f2e6c009240 comp rx=0 tx=0).stop 2024-09-11T22:18:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.870+0000 7f2e7d817640 1 -- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e780b5920 msgr2=0x7f2e7814c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.870+0000 7f2e7d817640 1 --2- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e780b5920 0x7f2e7814c3d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2e68033750 tx=0x7f2e680046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.870+0000 7f2e7d817640 1 -- 172.21.15.50:0/2421277274 shutdown_connections 2024-09-11T22:18:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.870+0000 7f2e7d817640 1 --2- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e6406be80 0x7f2e6406e340 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.870+0000 7f2e7d817640 1 --2- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7815c770 0x7f2e781f03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.870+0000 7f2e7d817640 1 --2- 172.21.15.50:0/2421277274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e780b6510 0x7f2e780cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.870+0000 7f2e7d817640 1 --2- 172.21.15.50:0/2421277274 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e780b5920 0x7f2e7814c3d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.870+0000 7f2e7d817640 1 -- 172.21.15.50:0/2421277274 >> 172.21.15.50:0/2421277274 conn(0x7f2e780b7940 msgr2=0x7f2e7814d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.870+0000 7f2e7d817640 1 -- 172.21.15.50:0/2421277274 shutdown_connections 2024-09-11T22:18:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.870+0000 7f2e7d817640 1 -- 172.21.15.50:0/2421277274 wait complete. 2024-09-11T22:18:51.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-11T22:18:51.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.984+0000 7fe50c47b640 1 Processor -- start 2024-09-11T22:18:51.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.984+0000 7fe50c47b640 1 -- start start 2024-09-11T22:18:51.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.985+0000 7fe50c47b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe50415e870 0x7fe5040d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:51.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.985+0000 7fe50c47b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5040cfa80 con 0x7fe5040d16d0 2024-09-11T22:18:51.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.985+0000 7fe50c47b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5040d40d0 con 0x7fe5040d3c00 2024-09-11T22:18:51.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.985+0000 7fe50c47b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe5040d1b40 con 0x7fe50415e870 2024-09-11T22:18:51.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.985+0000 7fe50a217640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe50415e870 0x7fe5040d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:51.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.985+0000 7fe509a16640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe5040d16d0 0x7fe5040d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44618/0 (socket says 172.21.15.50:44618) 2024-09-11T22:18:51.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.985+0000 7fe509a16640 1 -- 172.21.15.50:0/723381890 learned_addr learned my addr 172.21.15.50:0/723381890 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:51.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.986+0000 7fe50a217640 1 -- 172.21.15.50:0/723381890 >> v1:172.21.15.77:6789/0 conn(0x7fe5040d3c00 legacy=0x7fe5040b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:51.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.986+0000 7fe50a217640 1 -- 172.21.15.50:0/723381890 >> v1:172.21.15.50:6789/0 conn(0x7fe5040d16d0 legacy=0x7fe5040d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:51.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.986+0000 7fe50a217640 1 -- 172.21.15.50:0/723381890 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5040d43b0 con 0x7fe50415e870 2024-09-11T22:18:51.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.986+0000 7fe50a217640 1 --2- 172.21.15.50:0/723381890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe50415e870 0x7fe5040d1190 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fe5000097a0 tx=0x7fe50002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ddf2291116c722 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:51.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.987+0000 7fe509215640 1 -- 172.21.15.50:0/723381890 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500037070 con 0x7fe50415e870 2024-09-11T22:18:51.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.987+0000 7fe509215640 1 -- 172.21.15.50:0/723381890 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe500032440 con 0x7fe50415e870 2024-09-11T22:18:51.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.987+0000 7fe509215640 1 -- 172.21.15.50:0/723381890 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500032810 con 0x7fe50415e870 2024-09-11T22:18:51.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.987+0000 7fe50c47b640 1 -- 172.21.15.50:0/723381890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe50415e870 msgr2=0x7fe5040d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:51.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.987+0000 7fe50c47b640 1 --2- 172.21.15.50:0/723381890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe50415e870 0x7fe5040d1190 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fe5000097a0 tx=0x7fe50002a1e0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.987+0000 7fe50c47b640 1 -- 172.21.15.50:0/723381890 shutdown_connections 2024-09-11T22:18:51.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.987+0000 7fe50c47b640 1 --2- 172.21.15.50:0/723381890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe50415e870 0x7fe5040d1190 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.987+0000 7fe50c47b640 1 -- 172.21.15.50:0/723381890 >> 172.21.15.50:0/723381890 conn(0x7fe5040727a0 msgr2=0x7fe5040679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:51.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.987+0000 7fe50c47b640 1 -- 172.21.15.50:0/723381890 shutdown_connections 2024-09-11T22:18:51.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.987+0000 7fe50c47b640 1 -- 172.21.15.50:0/723381890 wait complete. 2024-09-11T22:18:51.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.988+0000 7fe50c47b640 1 Processor -- start 2024-09-11T22:18:51.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.988+0000 7fe50c47b640 1 -- start start 2024-09-11T22:18:51.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.989+0000 7fe50c47b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5040d16d0 0x7fe504154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:51.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.989+0000 7fe50c47b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5040d3c00 0x7fe5040cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:51.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.989+0000 7fe50c47b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50415e870 0x7fe5040cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:51.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.989+0000 7fe50c47b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe50415ec50 con 0x7fe5040d3c00 2024-09-11T22:18:51.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.989+0000 7fe50c47b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe5040b7ee0 con 0x7fe5040d16d0 2024-09-11T22:18:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.989+0000 7fe50c47b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe5040b78b0 con 0x7fe50415e870 2024-09-11T22:18:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.989+0000 7fe509a16640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5040d3c00 0x7fe5040cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.989+0000 7fe509a16640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5040d3c00 0x7fe5040cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59342/0 (socket says 172.21.15.50:59342) 2024-09-11T22:18:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.989+0000 7fe509a16640 1 -- 172.21.15.50:0/1186036842 learned_addr learned my addr 172.21.15.50:0/1186036842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.989+0000 7fe50a217640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5040d16d0 0x7fe504154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.989+0000 7fe50aa18640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50415e870 0x7fe5040cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.990+0000 7fe509a16640 1 -- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50415e870 msgr2=0x7fe5040cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.990+0000 7fe509a16640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50415e870 0x7fe5040cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.990+0000 7fe509a16640 1 -- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5040d16d0 msgr2=0x7fe504154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.990+0000 7fe509a16640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5040d16d0 0x7fe504154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.990+0000 7fe509a16640 1 -- 172.21.15.50:0/1186036842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5040c9c00 con 0x7fe5040d3c00 2024-09-11T22:18:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.990+0000 7fe509a16640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5040d3c00 0x7fe5040cd890 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400c3f0 tx=0x7fe4f400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.990+0000 7fe4faffd640 1 -- 172.21.15.50:0/1186036842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4017070 con 0x7fe5040d3c00 2024-09-11T22:18:51.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.990+0000 7fe4faffd640 1 -- 172.21.15.50:0/1186036842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f4005ce0 con 0x7fe5040d3c00 2024-09-11T22:18:51.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.990+0000 7fe4faffd640 1 -- 172.21.15.50:0/1186036842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f40072f0 con 0x7fe5040d3c00 2024-09-11T22:18:51.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.990+0000 7fe50c47b640 1 -- 172.21.15.50:0/1186036842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5040c9080 con 0x7fe5040d3c00 2024-09-11T22:18:51.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.990+0000 7fe50c47b640 1 -- 172.21.15.50:0/1186036842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5040c9640 con 0x7fe5040d3c00 2024-09-11T22:18:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.991+0000 7fe50c47b640 1 -- 172.21.15.50:0/1186036842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5040d1190 con 0x7fe5040d3c00 2024-09-11T22:18:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.992+0000 7fe4faffd640 1 -- 172.21.15.50:0/1186036842 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe4f401a070 con 0x7fe5040d3c00 2024-09-11T22:18:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.992+0000 7fe4faffd640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe4e806be60 0x7fe4e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.992+0000 7fe4faffd640 1 -- 172.21.15.50:0/1186036842 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 4943+0+0 (secure 0 0 0) 0x7fe4f4089dd0 con 0x7fe5040d3c00 2024-09-11T22:18:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.992+0000 7fe50a217640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe4e806be60 0x7fe4e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:51.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.993+0000 7fe50a217640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe4e806be60 0x7fe4e806e320 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe500034000 tx=0x7fe50002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:51.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:51.996+0000 7fe4faffd640 1 -- 172.21.15.50:0/1186036842 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5040cfa80 con 0x7fe5040d3c00 2024-09-11T22:18:52.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.245+0000 7fe50c47b640 1 -- 172.21.15.50:0/1186036842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7fe5040cb5e0 con 0x7fe5040d3c00 2024-09-11T22:18:52.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.503+0000 7fe4faffd640 1 -- 172.21.15.50:0/1186036842 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v370) ==== 144+0+0 (secure 0 0 0) 0x7fe4f408b020 con 0x7fe5040d3c00 2024-09-11T22:18:52.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.506+0000 7fe50c47b640 1 -- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe4e806be60 msgr2=0x7fe4e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:52.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.506+0000 7fe50c47b640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe4e806be60 0x7fe4e806e320 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe500034000 tx=0x7fe50002e000 comp rx=0 tx=0).stop 2024-09-11T22:18:52.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.506+0000 7fe50c47b640 1 -- 172.21.15.50:0/1186036842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5040d3c00 msgr2=0x7fe5040cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:52.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.506+0000 7fe50c47b640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5040d3c00 0x7fe5040cd890 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400c3f0 tx=0x7fe4f400c8b0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.506+0000 7fe50c47b640 1 -- 172.21.15.50:0/1186036842 shutdown_connections 2024-09-11T22:18:52.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.506+0000 7fe50c47b640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe4e806be60 0x7fe4e806e320 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.506+0000 7fe50c47b640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50415e870 0x7fe5040cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.506+0000 7fe50c47b640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5040d3c00 0x7fe5040cd890 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.506+0000 7fe50c47b640 1 --2- 172.21.15.50:0/1186036842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5040d16d0 0x7fe504154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.506+0000 7fe50c47b640 1 -- 172.21.15.50:0/1186036842 >> 172.21.15.50:0/1186036842 conn(0x7fe5040727a0 msgr2=0x7fe5040b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:52.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.506+0000 7fe50c47b640 1 -- 172.21.15.50:0/1186036842 shutdown_connections 2024-09-11T22:18:52.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.506+0000 7fe50c47b640 1 -- 172.21.15.50:0/1186036842 wait complete. 2024-09-11T22:18:52.519 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-11T22:18:52.519 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-11T22:18:52.520 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:18:52.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.622+0000 7f2d599a2640 1 Processor -- start 2024-09-11T22:18:52.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.622+0000 7f2d599a2640 1 -- start start 2024-09-11T22:18:52.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.623+0000 7f2d599a2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2d5415e7b0 0x7f2d540d3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.623+0000 7f2d599a2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d540d4d60 0x7f2d540b76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.623+0000 7f2d599a2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5415eb90 con 0x7f2d540d40d0 2024-09-11T22:18:52.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.623+0000 7f2d599a2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2d540d3470 con 0x7f2d540d4d60 2024-09-11T22:18:52.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.623+0000 7f2d599a2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2d540d28a0 con 0x7f2d5415e7b0 2024-09-11T22:18:52.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.623+0000 7f2d591a1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d540d4d60 0x7f2d540b76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.623+0000 7f2d591a1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d540d4d60 0x7f2d540b76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59346/0 (socket says 172.21.15.50:59346) 2024-09-11T22:18:52.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.623+0000 7f2d591a1640 1 -- 172.21.15.50:0/3554176438 learned_addr learned my addr 172.21.15.50:0/3554176438 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:52.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.624+0000 7f2d589a0640 1 --2- 172.21.15.50:0/3554176438 >> v2:172.21.15.77:3300/0 conn(0x7f2d5415e7b0 0x7f2d540d3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.624+0000 7f2d591a1640 1 -- 172.21.15.50:0/3554176438 >> v2:172.21.15.77:3300/0 conn(0x7f2d5415e7b0 msgr2=0x7f2d540d3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:52.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.624+0000 7f2d591a1640 1 --2- 172.21.15.50:0/3554176438 >> v2:172.21.15.77:3300/0 conn(0x7f2d5415e7b0 0x7f2d540d3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.624+0000 7f2d591a1640 1 -- 172.21.15.50:0/3554176438 >> v1:172.21.15.77:6789/0 conn(0x7f2d540d40d0 legacy=0x7f2d540d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:52.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.624+0000 7f2d591a1640 1 -- 172.21.15.50:0/3554176438 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d540d2b40 con 0x7f2d540d4d60 2024-09-11T22:18:52.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.624+0000 7f2d589a0640 1 --2- 172.21.15.50:0/3554176438 >> v2:172.21.15.77:3300/0 conn(0x7f2d5415e7b0 0x7f2d540d3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:52.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.624+0000 7f2d591a1640 1 --2- 172.21.15.50:0/3554176438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d540d4d60 0x7f2d540b76c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f2d540d33e0 tx=0x7f2d4c02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4185a5b0546c3eae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:52.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.625+0000 7f2d537fe640 1 -- 172.21.15.50:0/3554176438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c036070 con 0x7f2d540d4d60 2024-09-11T22:18:52.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.625+0000 7f2d537fe640 1 -- 172.21.15.50:0/3554176438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d4c031600 con 0x7f2d540d4d60 2024-09-11T22:18:52.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.625+0000 7f2d537fe640 1 -- 172.21.15.50:0/3554176438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0319d0 con 0x7f2d540d4d60 2024-09-11T22:18:52.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.625+0000 7f2d599a2640 1 -- 172.21.15.50:0/3554176438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d540d4d60 msgr2=0x7f2d540b76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:52.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.625+0000 7f2d599a2640 1 --2- 172.21.15.50:0/3554176438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d540d4d60 0x7f2d540b76c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f2d540d33e0 tx=0x7f2d4c02a750 comp rx=0 tx=0).stop 2024-09-11T22:18:52.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.625+0000 7f2d599a2640 1 -- 172.21.15.50:0/3554176438 shutdown_connections 2024-09-11T22:18:52.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.625+0000 7f2d599a2640 1 --2- 172.21.15.50:0/3554176438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d540d4d60 0x7f2d540b76c0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.625+0000 7f2d599a2640 1 --2- 172.21.15.50:0/3554176438 >> v2:172.21.15.77:3300/0 conn(0x7f2d5415e7b0 0x7f2d540d3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.625+0000 7f2d599a2640 1 -- 172.21.15.50:0/3554176438 >> 172.21.15.50:0/3554176438 conn(0x7f2d54072590 msgr2=0x7f2d540729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:52.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.625+0000 7f2d599a2640 1 -- 172.21.15.50:0/3554176438 shutdown_connections 2024-09-11T22:18:52.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.625+0000 7f2d599a2640 1 -- 172.21.15.50:0/3554176438 wait complete. 2024-09-11T22:18:52.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.626+0000 7f2d599a2640 1 Processor -- start 2024-09-11T22:18:52.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.626+0000 7f2d599a2640 1 -- start start 2024-09-11T22:18:52.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.627+0000 7f2d599a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d540d40d0 0x7f2d541f4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.627+0000 7f2d599a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d540d4d60 0x7f2d540b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.627+0000 7f2d599a2640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d5415e7b0 0x7f2d54158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.627+0000 7f2d599a2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2d540cfb90 con 0x7f2d540d40d0 2024-09-11T22:18:52.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.627+0000 7f2d599a2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2d540d3100 con 0x7f2d540d4d60 2024-09-11T22:18:52.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.627+0000 7f2d599a2640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2d540b7c00 con 0x7f2d5415e7b0 2024-09-11T22:18:52.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.627+0000 7f2d589a0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d540d40d0 0x7f2d541f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.627+0000 7f2d589a0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d540d40d0 0x7f2d541f4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59360/0 (socket says 172.21.15.50:59360) 2024-09-11T22:18:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.627+0000 7f2d589a0640 1 -- 172.21.15.50:0/2756828451 learned_addr learned my addr 172.21.15.50:0/2756828451 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.627+0000 7f2d53fff640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d540d4d60 0x7f2d540b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.627+0000 7f2d591a1640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d5415e7b0 0x7f2d54158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.628+0000 7f2d589a0640 1 -- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d5415e7b0 msgr2=0x7f2d54158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.628+0000 7f2d589a0640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d5415e7b0 0x7f2d54158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.628+0000 7f2d589a0640 1 -- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d540d4d60 msgr2=0x7f2d540b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.628+0000 7f2d589a0640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d540d4d60 0x7f2d540b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.628+0000 7f2d589a0640 1 -- 172.21.15.50:0/2756828451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d541f4d90 con 0x7f2d540d40d0 2024-09-11T22:18:52.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.628+0000 7f2d589a0640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d540d40d0 0x7f2d541f4850 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c7f0 tx=0x7f2d4400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:52.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.628+0000 7f2d517fa640 1 -- 172.21.15.50:0/2756828451 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44015070 con 0x7f2d540d40d0 2024-09-11T22:18:52.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.628+0000 7f2d517fa640 1 -- 172.21.15.50:0/2756828451 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d44007820 con 0x7f2d540d40d0 2024-09-11T22:18:52.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.628+0000 7f2d517fa640 1 -- 172.21.15.50:0/2756828451 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44007bd0 con 0x7f2d540d40d0 2024-09-11T22:18:52.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.628+0000 7f2d599a2640 1 -- 172.21.15.50:0/2756828451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d540b4370 con 0x7f2d540d40d0 2024-09-11T22:18:52.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.628+0000 7f2d599a2640 1 -- 172.21.15.50:0/2756828451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d540b4930 con 0x7f2d540d40d0 2024-09-11T22:18:52.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.629+0000 7f2d599a2640 1 -- 172.21.15.50:0/2756828451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d540b76c0 con 0x7f2d540d40d0 2024-09-11T22:18:52.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.630+0000 7f2d517fa640 1 -- 172.21.15.50:0/2756828451 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d44018070 con 0x7f2d540d40d0 2024-09-11T22:18:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.630+0000 7f2d517fa640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2d4006be60 0x7f2d4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.630+0000 7f2d517fa640 1 -- 172.21.15.50:0/2756828451 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 4943+0+0 (secure 0 0 0) 0x7f2d4408ac60 con 0x7f2d540d40d0 2024-09-11T22:18:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.630+0000 7f2d53fff640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2d4006be60 0x7f2d4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.631+0000 7f2d53fff640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2d4006be60 0x7f2d4006e320 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2d540b3a90 tx=0x7f2d48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.634+0000 7f2d517fa640 1 -- 172.21.15.50:0/2756828451 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d44059910 con 0x7f2d540d40d0 2024-09-11T22:18:52.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.813+0000 7f2d599a2640 1 -- 172.21.15.50:0/2756828451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d540ce790 con 0x7f2d540d40d0 2024-09-11T22:18:52.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.814+0000 7f2d517fa640 1 -- 172.21.15.50:0/2756828451 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+13006 (secure 0 0 0) 0x7f2d44059210 con 0x7f2d540d40d0 2024-09-11T22:18:52.815 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:52.815 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":123,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:18:51.501780+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6837/1480049118":"2024-09-12T22:18:48.497335+0000","172.21.15.77:6836/1480049118":"2024-09-12T22:18:48.497335+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:18:52.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.816+0000 7f2d599a2640 1 -- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2d4006be60 msgr2=0x7f2d4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:52.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.816+0000 7f2d599a2640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2d4006be60 0x7f2d4006e320 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2d540b3a90 tx=0x7f2d48009040 comp rx=0 tx=0).stop 2024-09-11T22:18:52.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.816+0000 7f2d599a2640 1 -- 172.21.15.50:0/2756828451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d540d40d0 msgr2=0x7f2d541f4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:52.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.816+0000 7f2d599a2640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d540d40d0 0x7f2d541f4850 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c7f0 tx=0x7f2d4400ccb0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.816+0000 7f2d599a2640 1 -- 172.21.15.50:0/2756828451 shutdown_connections 2024-09-11T22:18:52.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.816+0000 7f2d599a2640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2d4006be60 0x7f2d4006e320 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.816+0000 7f2d599a2640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d5415e7b0 0x7f2d54158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.816+0000 7f2d599a2640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d540d4d60 0x7f2d540b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.816+0000 7f2d599a2640 1 --2- 172.21.15.50:0/2756828451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d540d40d0 0x7f2d541f4850 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.816+0000 7f2d599a2640 1 -- 172.21.15.50:0/2756828451 >> 172.21.15.50:0/2756828451 conn(0x7f2d54072590 msgr2=0x7f2d540b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:52.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.816+0000 7f2d599a2640 1 -- 172.21.15.50:0/2756828451 shutdown_connections 2024-09-11T22:18:52.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.816+0000 7f2d599a2640 1 -- 172.21.15.50:0/2756828451 wait complete. 2024-09-11T22:18:52.829 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:11:03.407373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:18:52.829 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:18:52.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.934+0000 7f052761e640 1 Processor -- start 2024-09-11T22:18:52.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.934+0000 7f052761e640 1 -- start start 2024-09-11T22:18:52.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.935+0000 7f052761e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0520161fa0 0x7f05200b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.935+0000 7f052761e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05200cf610 0x7f05200cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.935+0000 7f052761e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05200cfbd0 con 0x7f05200b1600 2024-09-11T22:18:52.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.935+0000 7f052761e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f05200d1220 con 0x7f0520161fa0 2024-09-11T22:18:52.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.935+0000 7f052761e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f05200d17e0 con 0x7f05200cf610 2024-09-11T22:18:52.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.935+0000 7f0524bb9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f05200b1600 0x7f05200cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44626/0 (socket says 172.21.15.50:44626) 2024-09-11T22:18:52.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.935+0000 7f0524bb9640 1 -- 172.21.15.50:0/706500461 learned_addr learned my addr 172.21.15.50:0/706500461 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:52.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.935+0000 7f05253ba640 1 --2- 172.21.15.50:0/706500461 >> v2:172.21.15.77:3300/0 conn(0x7f0520161fa0 0x7f05200b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.935+0000 7f0525bbb640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05200cf610 0x7f05200cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.935+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530608361 0 0) 0x7f05200cfbd0 con 0x7f05200b1600 2024-09-11T22:18:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.935+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f050c003520 con 0x7f05200b1600 2024-09-11T22:18:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3396528055 0 0) 0x7f050c003520 con 0x7f05200b1600 2024-09-11T22:18:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05200cf610 msgr2=0x7f05200cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05200cf610 0x7f05200cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 >> v2:172.21.15.77:3300/0 conn(0x7f0520161fa0 msgr2=0x7f05200b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 --2- 172.21.15.50:0/706500461 >> v2:172.21.15.77:3300/0 conn(0x7f0520161fa0 0x7f05200b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05200cfeb0 con 0x7f05200b1600 2024-09-11T22:18:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f0510001670 con 0x7f05200b1600 2024-09-11T22:18:52.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f05253ba640 1 --2- 172.21.15.50:0/706500461 >> v2:172.21.15.77:3300/0 conn(0x7f0520161fa0 0x7f05200b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:18:52.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 >> v1:172.21.15.50:6789/0 conn(0x7f05200b1600 legacy=0x7f05200cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:52.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05200cf610 0x7f050c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050c003f30 0x7f050c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c004d40 0x7f050c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f05200d1220 con 0x7f050c003f30 2024-09-11T22:18:52.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f05200d17e0 con 0x7f050c004d40 2024-09-11T22:18:52.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f050c00b9c0 con 0x7f05200cf610 2024-09-11T22:18:52.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0524bb9640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050c003f30 0x7f050c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f05253ba640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05200cf610 0x7f050c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0525bbb640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c004d40 0x7f050c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0524bb9640 1 -- 172.21.15.50:0/706500461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05200cf610 msgr2=0x7f050c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:52.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0524bb9640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05200cf610 0x7f050c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0524bb9640 1 -- 172.21.15.50:0/706500461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c004d40 msgr2=0x7f050c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:52.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0524bb9640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c004d40 0x7f050c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0524bb9640 1 -- 172.21.15.50:0/706500461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c003520 con 0x7f050c003f30 2024-09-11T22:18:52.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f05253ba640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05200cf610 0x7f050c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:52.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.936+0000 7f0525bbb640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050c004d40 0x7f050c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:52.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.937+0000 7f0524bb9640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050c003f30 0x7f050c004800 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f051000c210 tx=0x7f050c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee6a221b3a61b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:52.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.937+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510007d50 con 0x7f050c003f30 2024-09-11T22:18:52.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.937+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f051002e070 con 0x7f050c003f30 2024-09-11T22:18:52.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.937+0000 7f0517fff640 1 -- 172.21.15.50:0/706500461 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510005d90 con 0x7f050c003f30 2024-09-11T22:18:52.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.937+0000 7f052761e640 1 -- 172.21.15.50:0/706500461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050c003f30 msgr2=0x7f050c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:52.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.937+0000 7f052761e640 1 --2- 172.21.15.50:0/706500461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f050c003f30 0x7f050c004800 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f051000c210 tx=0x7f050c005830 comp rx=0 tx=0).stop 2024-09-11T22:18:52.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.938+0000 7f0525bbb640 1 -- 172.21.15.50:0/706500461 reap_dead start 2024-09-11T22:18:52.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.938+0000 7f052761e640 1 -- 172.21.15.50:0/706500461 shutdown_connections 2024-09-11T22:18:52.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.938+0000 7f052761e640 1 -- 172.21.15.50:0/706500461 >> 172.21.15.50:0/706500461 conn(0x7f052009ba50 msgr2=0x7f05200b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:52.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.938+0000 7f052761e640 1 -- 172.21.15.50:0/706500461 shutdown_connections 2024-09-11T22:18:52.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.938+0000 7f052761e640 1 -- 172.21.15.50:0/706500461 wait complete. 2024-09-11T22:18:52.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.939+0000 7f052761e640 1 Processor -- start 2024-09-11T22:18:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.939+0000 7f052761e640 1 -- start start 2024-09-11T22:18:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f052761e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c003f30 0x7f05200cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f052761e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05201f43b0 0x7f05200c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f052761e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05201603e0 0x7f052015d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f052761e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0520162500 con 0x7f05201f43b0 2024-09-11T22:18:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f052761e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0520162380 con 0x7f05201603e0 2024-09-11T22:18:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f052761e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f05200d1c70 con 0x7f050c003f30 2024-09-11T22:18:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f0524bb9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05201f43b0 0x7f05200c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f0524bb9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05201f43b0 0x7f05200c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59374/0 (socket says 172.21.15.50:59374) 2024-09-11T22:18:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f0524bb9640 1 -- 172.21.15.50:0/4147247432 learned_addr learned my addr 172.21.15.50:0/4147247432 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f05253ba640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c003f30 0x7f05200cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f0525bbb640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05201603e0 0x7f052015d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f0524bb9640 1 -- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c003f30 msgr2=0x7f05200cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f0524bb9640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c003f30 0x7f05200cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f0524bb9640 1 -- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05201603e0 msgr2=0x7f052015d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f0524bb9640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05201603e0 0x7f052015d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f0524bb9640 1 -- 172.21.15.50:0/4147247432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05201f4970 con 0x7f05201f43b0 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f05253ba640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c003f30 0x7f05200cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f0524bb9640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05201f43b0 0x7f05200c9750 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f0510034040 tx=0x7f0510001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f0515ffb640 1 -- 172.21.15.50:0/4147247432 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510042070 con 0x7f05201f43b0 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f0515ffb640 1 -- 172.21.15.50:0/4147247432 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0510007480 con 0x7f05201f43b0 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f052761e640 1 -- 172.21.15.50:0/4147247432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05201f4c50 con 0x7f05201f43b0 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.940+0000 7f0515ffb640 1 -- 172.21.15.50:0/4147247432 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510001c90 con 0x7f05201f43b0 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.941+0000 7f052761e640 1 -- 172.21.15.50:0/4147247432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05201f5210 con 0x7f05201f43b0 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.942+0000 7f052761e640 1 -- 172.21.15.50:0/4147247432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05200b4d20 con 0x7f05201f43b0 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.942+0000 7f0515ffb640 1 -- 172.21.15.50:0/4147247432 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0510045070 con 0x7f05201f43b0 2024-09-11T22:18:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.943+0000 7f0515ffb640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f050406be60 0x7f050406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:52.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.943+0000 7f0515ffb640 1 -- 172.21.15.50:0/4147247432 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 4943+0+0 (secure 0 0 0) 0x7f05100ab910 con 0x7f05201f43b0 2024-09-11T22:18:52.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.943+0000 7f05253ba640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f050406be60 0x7f050406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:52.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.944+0000 7f05253ba640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f050406be60 0x7f050406e320 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f051c009c10 tx=0x7f051c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:52.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:52.947+0000 7f0515ffb640 1 -- 172.21.15.50:0/4147247432 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f051004c030 con 0x7f05201f43b0 2024-09-11T22:18:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.123+0000 7f052761e640 1 -- 172.21.15.50:0/4147247432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f052006f5e0 con 0x7f05201f43b0 2024-09-11T22:18:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.123+0000 7f0515ffb640 1 -- 172.21.15.50:0/4147247432 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) ==== 93+0+10 (secure 0 0 0) 0x7f051003c340 con 0x7f05201f43b0 2024-09-11T22:18:53.124 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-11T22:18:53.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.125+0000 7f052761e640 1 -- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f050406be60 msgr2=0x7f050406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.125+0000 7f052761e640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f050406be60 0x7f050406e320 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f051c009c10 tx=0x7f051c008040 comp rx=0 tx=0).stop 2024-09-11T22:18:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.125+0000 7f052761e640 1 -- 172.21.15.50:0/4147247432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05201f43b0 msgr2=0x7f05200c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.125+0000 7f052761e640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05201f43b0 0x7f05200c9750 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f0510034040 tx=0x7f0510001a40 comp rx=0 tx=0).stop 2024-09-11T22:18:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.125+0000 7f052761e640 1 -- 172.21.15.50:0/4147247432 shutdown_connections 2024-09-11T22:18:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.125+0000 7f052761e640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f050406be60 0x7f050406e320 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.125+0000 7f052761e640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05201603e0 0x7f052015d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.125+0000 7f052761e640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05201f43b0 0x7f05200c9750 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.125+0000 7f052761e640 1 --2- 172.21.15.50:0/4147247432 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050c003f30 0x7f05200cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.125+0000 7f052761e640 1 -- 172.21.15.50:0/4147247432 >> 172.21.15.50:0/4147247432 conn(0x7f052009ba50 msgr2=0x7f052006fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.125+0000 7f052761e640 1 -- 172.21.15.50:0/4147247432 shutdown_connections 2024-09-11T22:18:53.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.125+0000 7f052761e640 1 -- 172.21.15.50:0/4147247432 wait complete. 2024-09-11T22:18:53.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-11T22:18:53.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.239+0000 7f0e7b227640 1 Processor -- start 2024-09-11T22:18:53.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.239+0000 7f0e7b227640 1 -- start start 2024-09-11T22:18:53.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.240+0000 7f0e7b227640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0e7415e8e0 0x7f0e740b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:53.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.240+0000 7f0e7b227640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e740d1580 0x7f0e740d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.240+0000 7f0e7b227640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e74162350 0x7f0e741627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.240+0000 7f0e7b227640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0e7415ecc0 con 0x7f0e740d1580 2024-09-11T22:18:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.240+0000 7f0e7b227640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0e740d2ad0 con 0x7f0e7415e8e0 2024-09-11T22:18:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.240+0000 7f0e7b227640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0e740d3370 con 0x7f0e74162350 2024-09-11T22:18:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.240+0000 7f0e73fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e740d1580 0x7f0e740d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.240+0000 7f0e73fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e740d1580 0x7f0e740d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59382/0 (socket says 172.21.15.50:59382) 2024-09-11T22:18:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.240+0000 7f0e73fff640 1 -- 172.21.15.50:0/657837935 learned_addr learned my addr 172.21.15.50:0/657837935 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.240+0000 7f0e78fc3640 1 --2- 172.21.15.50:0/657837935 >> v2:172.21.15.77:3300/0 conn(0x7f0e7415e8e0 0x7f0e740b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.240+0000 7f0e797c4640 1 --2- 172.21.15.50:0/657837935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e74162350 0x7f0e741627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.241+0000 7f0e73fff640 1 -- 172.21.15.50:0/657837935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e74162350 msgr2=0x7f0e741627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.241+0000 7f0e73fff640 1 --2- 172.21.15.50:0/657837935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e74162350 0x7f0e741627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.241+0000 7f0e73fff640 1 -- 172.21.15.50:0/657837935 >> v2:172.21.15.77:3300/0 conn(0x7f0e7415e8e0 msgr2=0x7f0e740b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:53.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.241+0000 7f0e73fff640 1 --2- 172.21.15.50:0/657837935 >> v2:172.21.15.77:3300/0 conn(0x7f0e7415e8e0 0x7f0e740b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.241+0000 7f0e73fff640 1 -- 172.21.15.50:0/657837935 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e740d1ee0 con 0x7f0e740d1580 2024-09-11T22:18:53.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.241+0000 7f0e73fff640 1 --2- 172.21.15.50:0/657837935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e740d1580 0x7f0e740d19a0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f0e7408d630 tx=0x7f0e6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb585b78fe5dc3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:53.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.241+0000 7f0e737fe640 1 -- 172.21.15.50:0/657837935 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e68037070 con 0x7f0e740d1580 2024-09-11T22:18:53.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.241+0000 7f0e737fe640 1 -- 172.21.15.50:0/657837935 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e68032440 con 0x7f0e740d1580 2024-09-11T22:18:53.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.242+0000 7f0e737fe640 1 -- 172.21.15.50:0/657837935 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e68032810 con 0x7f0e740d1580 2024-09-11T22:18:53.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.242+0000 7f0e7b227640 1 -- 172.21.15.50:0/657837935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e740d1580 msgr2=0x7f0e740d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:53.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.242+0000 7f0e7b227640 1 --2- 172.21.15.50:0/657837935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e740d1580 0x7f0e740d19a0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f0e7408d630 tx=0x7f0e6802a270 comp rx=0 tx=0).stop 2024-09-11T22:18:53.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.242+0000 7f0e7b227640 1 -- 172.21.15.50:0/657837935 shutdown_connections 2024-09-11T22:18:53.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.242+0000 7f0e7b227640 1 --2- 172.21.15.50:0/657837935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e74162350 0x7f0e741627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.242+0000 7f0e7b227640 1 --2- 172.21.15.50:0/657837935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e740d1580 0x7f0e740d19a0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.242+0000 7f0e7b227640 1 --2- 172.21.15.50:0/657837935 >> v2:172.21.15.77:3300/0 conn(0x7f0e7415e8e0 0x7f0e740b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.242+0000 7f0e7b227640 1 -- 172.21.15.50:0/657837935 >> 172.21.15.50:0/657837935 conn(0x7f0e74067ba0 msgr2=0x7f0e74067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.242+0000 7f0e7b227640 1 -- 172.21.15.50:0/657837935 shutdown_connections 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.242+0000 7f0e7b227640 1 -- 172.21.15.50:0/657837935 wait complete. 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.243+0000 7f0e7b227640 1 Processor -- start 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.243+0000 7f0e7b227640 1 -- start start 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.244+0000 7f0e7b227640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e740d1580 0x7f0e7415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.244+0000 7f0e7b227640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e7415e8e0 0x7f0e740cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.244+0000 7f0e7b227640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e74162350 0x7f0e7415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.244+0000 7f0e7b227640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0e740d3000 con 0x7f0e74162350 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.244+0000 7f0e7b227640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0e740d2d20 con 0x7f0e7415e8e0 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.244+0000 7f0e7b227640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0e74162d20 con 0x7f0e740d1580 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.244+0000 7f0e797c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e74162350 0x7f0e7415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:53.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.244+0000 7f0e797c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e74162350 0x7f0e7415acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59388/0 (socket says 172.21.15.50:59388) 2024-09-11T22:18:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.244+0000 7f0e797c4640 1 -- 172.21.15.50:0/2158051715 learned_addr learned my addr 172.21.15.50:0/2158051715 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.245+0000 7f0e78fc3640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e740d1580 0x7f0e7415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.245+0000 7f0e73fff640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e7415e8e0 0x7f0e740cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.245+0000 7f0e797c4640 1 -- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e740d1580 msgr2=0x7f0e7415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.245+0000 7f0e797c4640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e740d1580 0x7f0e7415b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.245+0000 7f0e797c4640 1 -- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e7415e8e0 msgr2=0x7f0e740cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.245+0000 7f0e797c4640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e7415e8e0 0x7f0e740cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.245+0000 7f0e797c4640 1 -- 172.21.15.50:0/2158051715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e740b2f20 con 0x7f0e74162350 2024-09-11T22:18:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.245+0000 7f0e797c4640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e74162350 0x7f0e7415acf0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c00efc0 tx=0x7f0e6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.245+0000 7f0e717fa640 1 -- 172.21.15.50:0/2158051715 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c018020 con 0x7f0e74162350 2024-09-11T22:18:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.245+0000 7f0e717fa640 1 -- 172.21.15.50:0/2158051715 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e6c014480 con 0x7f0e74162350 2024-09-11T22:18:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.245+0000 7f0e717fa640 1 -- 172.21.15.50:0/2158051715 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c014870 con 0x7f0e74162350 2024-09-11T22:18:53.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.245+0000 7f0e7b227640 1 -- 172.21.15.50:0/2158051715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e740b3200 con 0x7f0e74162350 2024-09-11T22:18:53.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.245+0000 7f0e7b227640 1 -- 172.21.15.50:0/2158051715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e7415bd00 con 0x7f0e74162350 2024-09-11T22:18:53.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.246+0000 7f0e7b227640 1 -- 172.21.15.50:0/2158051715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e740b7880 con 0x7f0e74162350 2024-09-11T22:18:53.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.247+0000 7f0e717fa640 1 -- 172.21.15.50:0/2158051715 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e6c005d10 con 0x7f0e74162350 2024-09-11T22:18:53.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.247+0000 7f0e717fa640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e6006be60 0x7f0e6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.248+0000 7f0e717fa640 1 -- 172.21.15.50:0/2158051715 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 4943+0+0 (secure 0 0 0) 0x7f0e6c08b5e0 con 0x7f0e74162350 2024-09-11T22:18:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.248+0000 7f0e78fc3640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e6006be60 0x7f0e6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:53.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.248+0000 7f0e78fc3640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e6006be60 0x7f0e6006e320 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0e740b6de0 tx=0x7f0e64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:53.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.252+0000 7f0e717fa640 1 -- 172.21.15.50:0/2158051715 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e6c022070 con 0x7f0e74162350 2024-09-11T22:18:53.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.491+0000 7f0e7b227640 1 -- 172.21.15.50:0/2158051715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7f0e740ba770 con 0x7f0e74162350 2024-09-11T22:18:53.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.509+0000 7f0e717fa640 1 -- 172.21.15.50:0/2158051715 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v371) ==== 158+0+0 (secure 0 0 0) 0x7f0e6c010040 con 0x7f0e74162350 2024-09-11T22:18:53.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.511+0000 7f0e7b227640 1 -- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e6006be60 msgr2=0x7f0e6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:53.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.511+0000 7f0e7b227640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e6006be60 0x7f0e6006e320 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0e740b6de0 tx=0x7f0e64008040 comp rx=0 tx=0).stop 2024-09-11T22:18:53.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.511+0000 7f0e7b227640 1 -- 172.21.15.50:0/2158051715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e74162350 msgr2=0x7f0e7415acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:53.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.511+0000 7f0e7b227640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e74162350 0x7f0e7415acf0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c00efc0 tx=0x7f0e6c00c490 comp rx=0 tx=0).stop 2024-09-11T22:18:53.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.511+0000 7f0e7b227640 1 -- 172.21.15.50:0/2158051715 shutdown_connections 2024-09-11T22:18:53.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.511+0000 7f0e7b227640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e6006be60 0x7f0e6006e320 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.511+0000 7f0e7b227640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e74162350 0x7f0e7415acf0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.511+0000 7f0e7b227640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e7415e8e0 0x7f0e740cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.511+0000 7f0e7b227640 1 --2- 172.21.15.50:0/2158051715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e740d1580 0x7f0e7415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.511+0000 7f0e7b227640 1 -- 172.21.15.50:0/2158051715 >> 172.21.15.50:0/2158051715 conn(0x7f0e74067ba0 msgr2=0x7f0e74067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:53.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.512+0000 7f0e7b227640 1 -- 172.21.15.50:0/2158051715 shutdown_connections 2024-09-11T22:18:53.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.512+0000 7f0e7b227640 1 -- 172.21.15.50:0/2158051715 wait complete. 2024-09-11T22:18:53.524 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T22:18:53.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.628+0000 7f275d9e4640 1 Processor -- start 2024-09-11T22:18:53.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.628+0000 7f275d9e4640 1 -- start start 2024-09-11T22:18:53.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.629+0000 7f275d9e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27580d18e0 0x7f27580d34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:53.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.629+0000 7f275d9e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27580d3a20 0x7f27580b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:53.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.629+0000 7f275d9e4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27580d4220 con 0x7f275815e8d0 2024-09-11T22:18:53.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.629+0000 7f275d9e4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f275815ecb0 con 0x7f27580d18e0 2024-09-11T22:18:53.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.629+0000 7f275d9e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f27580d4500 con 0x7f27580d3a20 2024-09-11T22:18:53.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.629+0000 7f2756ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f275815e8d0 0x7f27580d11d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44628/0 (socket says 172.21.15.50:44628) 2024-09-11T22:18:53.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.629+0000 7f2756ffd640 1 -- 172.21.15.50:0/475264639 learned_addr learned my addr 172.21.15.50:0/475264639 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:18:53.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.629+0000 7f27567fc640 1 --2- 172.21.15.50:0/475264639 >> v2:172.21.15.50:3300/0 conn(0x7f27580d18e0 0x7f27580d34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:53.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.630+0000 7f27577fe640 1 --2- 172.21.15.50:0/475264639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27580d3a20 0x7f27580b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:53.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.630+0000 7f2755ffb640 1 -- 172.21.15.50:0/475264639 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1374516599 0 0) 0x7f27580d4220 con 0x7f275815e8d0 2024-09-11T22:18:53.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.630+0000 7f2755ffb640 1 -- 172.21.15.50:0/475264639 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2744003520 con 0x7f275815e8d0 2024-09-11T22:18:53.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.630+0000 7f27567fc640 1 -- 172.21.15.50:0/475264639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27580d3a20 msgr2=0x7f27580b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:53.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.630+0000 7f27567fc640 1 --2- 172.21.15.50:0/475264639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27580d3a20 0x7f27580b83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.630+0000 7f27567fc640 1 -- 172.21.15.50:0/475264639 >> v1:172.21.15.50:6789/0 conn(0x7f275815e8d0 legacy=0x7f27580d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.630+0000 7f27567fc640 1 -- 172.21.15.50:0/475264639 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27580b7bc0 con 0x7f27580d18e0 2024-09-11T22:18:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.630+0000 7f27567fc640 1 --2- 172.21.15.50:0/475264639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27580d18e0 0x7f27580d34e0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f27400097a0 tx=0x7f274002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524a3e6dc769b0ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.631+0000 7f2755ffb640 1 -- 172.21.15.50:0/475264639 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740037070 con 0x7f27580d18e0 2024-09-11T22:18:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.631+0000 7f2755ffb640 1 -- 172.21.15.50:0/475264639 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2740032440 con 0x7f27580d18e0 2024-09-11T22:18:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.631+0000 7f2755ffb640 1 -- 172.21.15.50:0/475264639 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740032810 con 0x7f27580d18e0 2024-09-11T22:18:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.631+0000 7f275d9e4640 1 -- 172.21.15.50:0/475264639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27580d18e0 msgr2=0x7f27580d34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.631+0000 7f275d9e4640 1 --2- 172.21.15.50:0/475264639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27580d18e0 0x7f27580d34e0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f27400097a0 tx=0x7f274002a180 comp rx=0 tx=0).stop 2024-09-11T22:18:53.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.631+0000 7f275d9e4640 1 -- 172.21.15.50:0/475264639 shutdown_connections 2024-09-11T22:18:53.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.631+0000 7f275d9e4640 1 --2- 172.21.15.50:0/475264639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27580d3a20 0x7f27580b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.631+0000 7f275d9e4640 1 --2- 172.21.15.50:0/475264639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27580d18e0 0x7f27580d34e0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.631+0000 7f275d9e4640 1 -- 172.21.15.50:0/475264639 >> 172.21.15.50:0/475264639 conn(0x7f27580727a0 msgr2=0x7f27580679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:53.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.631+0000 7f275d9e4640 1 -- 172.21.15.50:0/475264639 shutdown_connections 2024-09-11T22:18:53.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.631+0000 7f275d9e4640 1 -- 172.21.15.50:0/475264639 wait complete. 2024-09-11T22:18:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.632+0000 7f275d9e4640 1 Processor -- start 2024-09-11T22:18:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.633+0000 7f275d9e4640 1 -- start start 2024-09-11T22:18:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.633+0000 7f275d9e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27580d18e0 0x7f27580ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.633+0000 7f275d9e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27580d3a20 0x7f275814b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.633+0000 7f275d9e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f275815e8d0 0x7f27581f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.633+0000 7f275d9e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27580b7960 con 0x7f27580d3a20 2024-09-11T22:18:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.633+0000 7f275d9e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f27580b77e0 con 0x7f275815e8d0 2024-09-11T22:18:53.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.633+0000 7f275d9e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f27580b8900 con 0x7f27580d18e0 2024-09-11T22:18:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.633+0000 7f27567fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27580d3a20 0x7f275814b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.633+0000 7f27567fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27580d3a20 0x7f275814b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59396/0 (socket says 172.21.15.50:59396) 2024-09-11T22:18:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.633+0000 7f27567fc640 1 -- 172.21.15.50:0/4035236144 learned_addr learned my addr 172.21.15.50:0/4035236144 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f2756ffd640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27580d18e0 0x7f27580ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f27577fe640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f275815e8d0 0x7f27581f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f27567fc640 1 -- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27580d18e0 msgr2=0x7f27580ab1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f27567fc640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27580d18e0 0x7f27580ab1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f27567fc640 1 -- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f275815e8d0 msgr2=0x7f27581f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f27567fc640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f275815e8d0 0x7f27581f3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f27567fc640 1 -- 172.21.15.50:0/4035236144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275814ba00 con 0x7f27580d3a20 2024-09-11T22:18:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f2756ffd640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27580d18e0 0x7f27580ab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f27577fe640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f275815e8d0 0x7f27581f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:18:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f27567fc640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27580d3a20 0x7f275814b000 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f2740035040 tx=0x7f27400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f274ffff640 1 -- 172.21.15.50:0/4035236144 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740041030 con 0x7f27580d3a20 2024-09-11T22:18:53.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f274ffff640 1 -- 172.21.15.50:0/4035236144 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274003d4e0 con 0x7f27580d3a20 2024-09-11T22:18:53.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f275d9e4640 1 -- 172.21.15.50:0/4035236144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275814bce0 con 0x7f27580d3a20 2024-09-11T22:18:53.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f274ffff640 1 -- 172.21.15.50:0/4035236144 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740037040 con 0x7f27580d3a20 2024-09-11T22:18:53.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.634+0000 7f275d9e4640 1 -- 172.21.15.50:0/4035236144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275814c2a0 con 0x7f27580d3a20 2024-09-11T22:18:53.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.635+0000 7f275d9e4640 1 -- 172.21.15.50:0/4035236144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27580d34e0 con 0x7f27580d3a20 2024-09-11T22:18:53.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.636+0000 7f274ffff640 1 -- 172.21.15.50:0/4035236144 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2740044070 con 0x7f27580d3a20 2024-09-11T22:18:53.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.636+0000 7f274ffff640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f273806be30 0x7f273806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:53.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.636+0000 7f274ffff640 1 -- 172.21.15.50:0/4035236144 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 4943+0+0 (secure 0 0 0) 0x7f27400ab230 con 0x7f27580d3a20 2024-09-11T22:18:53.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.636+0000 7f2756ffd640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f273806be30 0x7f273806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:53.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.637+0000 7f2756ffd640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f273806be30 0x7f273806e2f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2748005c00 tx=0x7f2748009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:53.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.640+0000 7f274ffff640 1 -- 172.21.15.50:0/4035236144 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2740044e40 con 0x7f27580d3a20 2024-09-11T22:18:53.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.815+0000 7f275d9e4640 1 -- 172.21.15.50:0/4035236144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f275806bfc0 con 0x7f27580d3a20 2024-09-11T22:18:53.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.821+0000 7f274ffff640 1 -- 172.21.15.50:0/4035236144 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f2740079e60 con 0x7f27580d3a20 2024-09-11T22:18:53.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.823+0000 7f275d9e4640 1 -- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f273806be30 msgr2=0x7f273806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:53.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.823+0000 7f275d9e4640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f273806be30 0x7f273806e2f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2748005c00 tx=0x7f2748009040 comp rx=0 tx=0).stop 2024-09-11T22:18:53.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.823+0000 7f275d9e4640 1 -- 172.21.15.50:0/4035236144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27580d3a20 msgr2=0x7f275814b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:53.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.823+0000 7f275d9e4640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27580d3a20 0x7f275814b000 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f2740035040 tx=0x7f27400046c0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.823+0000 7f275d9e4640 1 -- 172.21.15.50:0/4035236144 shutdown_connections 2024-09-11T22:18:53.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.823+0000 7f275d9e4640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f273806be30 0x7f273806e2f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.823+0000 7f275d9e4640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f275815e8d0 0x7f27581f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.823+0000 7f275d9e4640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27580d3a20 0x7f275814b000 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.823+0000 7f275d9e4640 1 --2- 172.21.15.50:0/4035236144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27580d18e0 0x7f27580ab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:53.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.823+0000 7f275d9e4640 1 -- 172.21.15.50:0/4035236144 >> 172.21.15.50:0/4035236144 conn(0x7f27580727a0 msgr2=0x7f27580d2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:53.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.823+0000 7f275d9e4640 1 -- 172.21.15.50:0/4035236144 shutdown_connections 2024-09-11T22:18:53.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:53.823+0000 7f275d9e4640 1 -- 172.21.15.50:0/4035236144 wait complete. 2024-09-11T22:18:53.836 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:18:53.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:18:53.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:18:53.927 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:18:53.927 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:18:53.927 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:53.944 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:18:53.944 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:18:53.944 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:53.986 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:18:53.986 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:18:53.986 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:54.002 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:18:54.002 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:18:54.003 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:18:54.045 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:18:54.045 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T22:18:54.045 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:18:54.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.146+0000 7f3e5a5f6640 1 Processor -- start 2024-09-11T22:18:54.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.146+0000 7f3e5a5f6640 1 -- start start 2024-09-11T22:18:54.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.147+0000 7f3e5a5f6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e5415e840 0x7f3e540b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:54.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.147+0000 7f3e5a5f6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e540cdd50 0x7f3e540cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:54.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.147+0000 7f3e5a5f6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e540ce5f0 con 0x7f3e540cf3b0 2024-09-11T22:18:54.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.147+0000 7f3e5a5f6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f3e5406c240 con 0x7f3e540cdd50 2024-09-11T22:18:54.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.147+0000 7f3e5a5f6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3e540d0470 con 0x7f3e5415e840 2024-09-11T22:18:54.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.147+0000 7f3e537fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e540cdd50 0x7f3e540cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.147+0000 7f3e537fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3e540cdd50 0x7f3e540cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59400/0 (socket says 172.21.15.50:59400) 2024-09-11T22:18:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.147+0000 7f3e537fe640 1 -- 172.21.15.50:0/319287224 learned_addr learned my addr 172.21.15.50:0/319287224 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.147+0000 7f3e53fff640 1 --2- 172.21.15.50:0/319287224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e5415e840 0x7f3e540b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.147+0000 7f3e537fe640 1 -- 172.21.15.50:0/319287224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e5415e840 msgr2=0x7f3e540b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.147+0000 7f3e537fe640 1 --2- 172.21.15.50:0/319287224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e5415e840 0x7f3e540b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.147+0000 7f3e537fe640 1 -- 172.21.15.50:0/319287224 >> v1:172.21.15.77:6789/0 conn(0x7f3e540cf3b0 legacy=0x7f3e540d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:18:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.147+0000 7f3e537fe640 1 -- 172.21.15.50:0/319287224 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e540ce310 con 0x7f3e540cdd50 2024-09-11T22:18:54.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.148+0000 7f3e537fe640 1 --2- 172.21.15.50:0/319287224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e540cdd50 0x7f3e540cee70 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f3e480098a0 tx=0x7f3e4802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1dfe5e37d7ff84 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:54.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.148+0000 7f3e52ffd640 1 -- 172.21.15.50:0/319287224 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48037070 con 0x7f3e540cdd50 2024-09-11T22:18:54.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.148+0000 7f3e52ffd640 1 -- 172.21.15.50:0/319287224 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e48032440 con 0x7f3e540cdd50 2024-09-11T22:18:54.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.148+0000 7f3e52ffd640 1 -- 172.21.15.50:0/319287224 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48032810 con 0x7f3e540cdd50 2024-09-11T22:18:54.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.149+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/319287224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e540cdd50 msgr2=0x7f3e540cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:54.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.149+0000 7f3e5a5f6640 1 --2- 172.21.15.50:0/319287224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e540cdd50 0x7f3e540cee70 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f3e480098a0 tx=0x7f3e4802a290 comp rx=0 tx=0).stop 2024-09-11T22:18:54.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.149+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/319287224 shutdown_connections 2024-09-11T22:18:54.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.149+0000 7f3e5a5f6640 1 --2- 172.21.15.50:0/319287224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e540cdd50 0x7f3e540cee70 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:54.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.149+0000 7f3e5a5f6640 1 --2- 172.21.15.50:0/319287224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e5415e840 0x7f3e540b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:54.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.149+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/319287224 >> 172.21.15.50:0/319287224 conn(0x7f3e540b4150 msgr2=0x7f3e540b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:54.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.149+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/319287224 shutdown_connections 2024-09-11T22:18:54.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.149+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/319287224 wait complete. 2024-09-11T22:18:54.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.150+0000 7f3e5a5f6640 1 Processor -- start 2024-09-11T22:18:54.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.150+0000 7f3e5a5f6640 1 -- start start 2024-09-11T22:18:54.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e5a5f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e540cdd50 0x7f3e5409fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:54.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e5a5f6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e540cf3b0 0x7f3e540c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:54.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e5a5f6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e5415e840 0x7f3e540ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:54.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e5a5f6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5415ec20 con 0x7f3e540cdd50 2024-09-11T22:18:54.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e5a5f6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5406bed0 con 0x7f3e540cf3b0 2024-09-11T22:18:54.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e5a5f6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5415eda0 con 0x7f3e5415e840 2024-09-11T22:18:54.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e53fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e540cdd50 0x7f3e5409fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:54.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e53fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e540cdd50 0x7f3e5409fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59410/0 (socket says 172.21.15.50:59410) 2024-09-11T22:18:54.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e53fff640 1 -- 172.21.15.50:0/493160636 learned_addr learned my addr 172.21.15.50:0/493160636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:18:54.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e58b93640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e5415e840 0x7f3e540ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e537fe640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e540cf3b0 0x7f3e540c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e53fff640 1 -- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e5415e840 msgr2=0x7f3e540ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e53fff640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e5415e840 0x7f3e540ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e53fff640 1 -- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e540cf3b0 msgr2=0x7f3e540c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e53fff640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e540cf3b0 0x7f3e540c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.151+0000 7f3e53fff640 1 -- 172.21.15.50:0/493160636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e540c61d0 con 0x7f3e540cdd50 2024-09-11T22:18:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.152+0000 7f3e53fff640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e540cdd50 0x7f3e5409fbe0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400d830 tx=0x7f3e4400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.152+0000 7f3e50ff9640 1 -- 172.21.15.50:0/493160636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400b6c0 con 0x7f3e540cdd50 2024-09-11T22:18:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.152+0000 7f3e50ff9640 1 -- 172.21.15.50:0/493160636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e44019070 con 0x7f3e540cdd50 2024-09-11T22:18:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.152+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/493160636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e540c64b0 con 0x7f3e540cdd50 2024-09-11T22:18:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.152+0000 7f3e50ff9640 1 -- 172.21.15.50:0/493160636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400ba80 con 0x7f3e540cdd50 2024-09-11T22:18:54.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.152+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/493160636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e540c6a70 con 0x7f3e540cdd50 2024-09-11T22:18:54.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.153+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/493160636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e5406d680 con 0x7f3e540cdd50 2024-09-11T22:18:54.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.153+0000 7f3e50ff9640 1 -- 172.21.15.50:0/493160636 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e4400bc20 con 0x7f3e540cdd50 2024-09-11T22:18:54.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.154+0000 7f3e50ff9640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3e4006be60 0x7f3e4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:18:54.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.154+0000 7f3e50ff9640 1 -- 172.21.15.50:0/493160636 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 4943+0+0 (secure 0 0 0) 0x7f3e4408af40 con 0x7f3e540cdd50 2024-09-11T22:18:54.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.154+0000 7f3e537fe640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3e4006be60 0x7f3e4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:18:54.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.154+0000 7f3e537fe640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3e4006be60 0x7f3e4006e320 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3e48034000 tx=0x7f3e4802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:18:54.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.158+0000 7f3e50ff9640 1 -- 172.21.15.50:0/493160636 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e4401c360 con 0x7f3e540cdd50 2024-09-11T22:18:54.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.370+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/493160636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e5406e1d0 con 0x7f3e540cdd50 2024-09-11T22:18:54.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.370+0000 7f3e50ff9640 1 -- 172.21.15.50:0/493160636 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+3911 (secure 0 0 0) 0x7f3e44059c80 con 0x7f3e540cdd50 2024-09-11T22:18:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:18:54.372 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":87,"btime":"2024-09-11T22:18:49:498979+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1864699161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1864699161},{"type":"v1","addr":"172.21.15.77:6835","nonce":1864699161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3677751855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3677751855},{"type":"v1","addr":"172.21.15.50:6834","nonce":3677751855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7315,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2276588552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2276588552},{"type":"v1","addr":"172.21.15.50:6835","nonce":2276588552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7558,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3129219167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3129219167},{"type":"v1","addr":"172.21.15.77:6837","nonce":3129219167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87}],"filesystems":[]} 2024-09-11T22:18:54.373 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 87 2024-09-11T22:18:54.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.373+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3e4006be60 msgr2=0x7f3e4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:54.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.373+0000 7f3e5a5f6640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3e4006be60 0x7f3e4006e320 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3e48034000 tx=0x7f3e4802e000 comp rx=0 tx=0).stop 2024-09-11T22:18:54.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.373+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/493160636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e540cdd50 msgr2=0x7f3e5409fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:18:54.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.373+0000 7f3e5a5f6640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e540cdd50 0x7f3e5409fbe0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400d830 tx=0x7f3e4400dcf0 comp rx=0 tx=0).stop 2024-09-11T22:18:54.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.373+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/493160636 shutdown_connections 2024-09-11T22:18:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.373+0000 7f3e5a5f6640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3e4006be60 0x7f3e4006e320 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.373+0000 7f3e5a5f6640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e5415e840 0x7f3e540ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.373+0000 7f3e5a5f6640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e540cf3b0 0x7f3e540c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.373+0000 7f3e5a5f6640 1 --2- 172.21.15.50:0/493160636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e540cdd50 0x7f3e5409fbe0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:18:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.373+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/493160636 >> 172.21.15.50:0/493160636 conn(0x7f3e540b4150 msgr2=0x7f3e540afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:18:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.373+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/493160636 shutdown_connections 2024-09-11T22:18:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:18:54.373+0000 7f3e5a5f6640 1 -- 172.21.15.50:0/493160636 wait complete. 2024-09-11T22:18:54.386 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:18:54.386 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T22:18:54.386 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:18:54.386 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:18:54.386 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:18:54.387 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T22:18:54.387 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:18:54.387 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:18:54.387 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:18:54.387 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T22:18:54.387 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:18:54.387 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:18:54.387 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:18:54.388 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T22:18:54.388 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:18:54.388 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:18:54.396 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:18:54.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:18:54.398 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:18:54.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:18:54.399 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:18:54.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:18:54.439 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:18:54.439 DEBUG:teuthology.parallel:result is None 2024-09-11T22:18:54.442 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:18:54.442 DEBUG:teuthology.parallel:result is None 2024-09-11T22:18:54.442 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:18:54.443 DEBUG:teuthology.parallel:result is None 2024-09-11T22:18:54.519 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:18:54.523 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:18:54.524 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:19:00.396 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:19:00.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:19:00.399 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:19:00.400 DEBUG:teuthology.parallel:result is None 2024-09-11T22:19:00.400 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T22:19:00.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-11T22:19:00.489 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:19:00.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.515+0000 7f1763282640 1 Processor -- start 2024-09-11T22:19:00.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.515+0000 7f1763282640 1 -- start start 2024-09-11T22:19:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.516+0000 7f1763282640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f175c15e870 0x7f175c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.516+0000 7f1763282640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f175c0d3c00 0x7f175c0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.516+0000 7f1763282640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f175c0cfa80 con 0x7f175c0d16d0 2024-09-11T22:19:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.516+0000 7f1763282640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f175c0d1b10 con 0x7f175c0d3c00 2024-09-11T22:19:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.516+0000 7f1763282640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f175c0d40d0 con 0x7f175c15e870 2024-09-11T22:19:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.516+0000 7f176081d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f175c0d16d0 0x7f175c0d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56520/0 (socket says 172.21.15.50:56520) 2024-09-11T22:19:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.516+0000 7f176081d640 1 -- 172.21.15.50:0/2952938116 learned_addr learned my addr 172.21.15.50:0/2952938116 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.517+0000 7f176181f640 1 --2- 172.21.15.50:0/2952938116 >> v2:172.21.15.77:3300/0 conn(0x7f175c0d3c00 0x7f175c0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.517+0000 7f176101e640 1 --2- 172.21.15.50:0/2952938116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f175c15e870 0x7f175c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.517+0000 7f1753fff640 1 -- 172.21.15.50:0/2952938116 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926459205 0 0) 0x7f174c001110 con 0x7f175c0d16d0 2024-09-11T22:19:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.517+0000 7f1753fff640 1 -- 172.21.15.50:0/2952938116 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1748003520 con 0x7f175c0d16d0 2024-09-11T22:19:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.517+0000 7f176181f640 1 -- 172.21.15.50:0/2952938116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f175c15e870 msgr2=0x7f175c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.517+0000 7f176181f640 1 --2- 172.21.15.50:0/2952938116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f175c15e870 0x7f175c0d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.517+0000 7f1753fff640 1 -- 172.21.15.50:0/2952938116 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 122364923 0 0) 0x7f1748003520 con 0x7f175c0d16d0 2024-09-11T22:19:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.517+0000 7f176181f640 1 -- 172.21.15.50:0/2952938116 >> v1:172.21.15.50:6789/0 conn(0x7f175c0d16d0 legacy=0x7f175c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.517+0000 7f176181f640 1 -- 172.21.15.50:0/2952938116 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175c0d43b0 con 0x7f175c0d3c00 2024-09-11T22:19:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.517+0000 7f176101e640 1 --2- 172.21.15.50:0/2952938116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f175c15e870 0x7f175c0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:00.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.518+0000 7f176181f640 1 --2- 172.21.15.50:0/2952938116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f175c0d3c00 0x7f175c0b8400 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1754009d90 tx=0x7f175402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8e76de94027c163 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:00.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.518+0000 7f1753fff640 1 -- 172.21.15.50:0/2952938116 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c001860 con 0x7f175c0d3c00 2024-09-11T22:19:00.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.518+0000 7f1753fff640 1 -- 172.21.15.50:0/2952938116 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1754007540 con 0x7f175c0d3c00 2024-09-11T22:19:00.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.518+0000 7f1753fff640 1 -- 172.21.15.50:0/2952938116 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17540078f0 con 0x7f175c0d3c00 2024-09-11T22:19:00.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.518+0000 7f1763282640 1 -- 172.21.15.50:0/2952938116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f175c0d3c00 msgr2=0x7f175c0b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:00.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.518+0000 7f1763282640 1 --2- 172.21.15.50:0/2952938116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f175c0d3c00 0x7f175c0b8400 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1754009d90 tx=0x7f175402a5f0 comp rx=0 tx=0).stop 2024-09-11T22:19:00.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.518+0000 7f1763282640 1 -- 172.21.15.50:0/2952938116 shutdown_connections 2024-09-11T22:19:00.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.518+0000 7f1763282640 1 --2- 172.21.15.50:0/2952938116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f175c0d3c00 0x7f175c0b8400 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:00.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.518+0000 7f1763282640 1 --2- 172.21.15.50:0/2952938116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f175c15e870 0x7f175c0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:00.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.518+0000 7f1763282640 1 -- 172.21.15.50:0/2952938116 >> 172.21.15.50:0/2952938116 conn(0x7f175c0727a0 msgr2=0x7f175c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:00.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.519+0000 7f1763282640 1 -- 172.21.15.50:0/2952938116 shutdown_connections 2024-09-11T22:19:00.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.519+0000 7f1763282640 1 -- 172.21.15.50:0/2952938116 wait complete. 2024-09-11T22:19:00.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.520+0000 7f1763282640 1 Processor -- start 2024-09-11T22:19:00.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.520+0000 7f1763282640 1 -- start start 2024-09-11T22:19:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f1763282640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f175c0d16d0 0x7f175c1f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f1763282640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f175c0d3c00 0x7f175c159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f1763282640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e870 0x7f175c161600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f1763282640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f175c15ec50 con 0x7f175c15e870 2024-09-11T22:19:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f1763282640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f175c0b7ee0 con 0x7f175c0d3c00 2024-09-11T22:19:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f1763282640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f175c0b78b0 con 0x7f175c0d16d0 2024-09-11T22:19:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f176181f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e870 0x7f175c161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f176181f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e870 0x7f175c161600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42388/0 (socket says 172.21.15.50:42388) 2024-09-11T22:19:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f176181f640 1 -- 172.21.15.50:0/13145140 learned_addr learned my addr 172.21.15.50:0/13145140 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f176101e640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f175c0d16d0 0x7f175c1f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f176081d640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f175c0d3c00 0x7f175c159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f176181f640 1 -- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f175c0d16d0 msgr2=0x7f175c1f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f176181f640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f175c0d16d0 0x7f175c1f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f176181f640 1 -- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f175c0d3c00 msgr2=0x7f175c159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f176181f640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f175c0d3c00 0x7f175c159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f176181f640 1 -- 172.21.15.50:0/13145140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175c0cb570 con 0x7f175c15e870 2024-09-11T22:19:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.521+0000 7f176181f640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e870 0x7f175c161600 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f1754009eb0 tx=0x7f1754004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.522+0000 7f1751ffb640 1 -- 172.21.15.50:0/13145140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1754040070 con 0x7f175c15e870 2024-09-11T22:19:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.522+0000 7f1751ffb640 1 -- 172.21.15.50:0/13145140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1754031c40 con 0x7f175c15e870 2024-09-11T22:19:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.522+0000 7f1763282640 1 -- 172.21.15.50:0/13145140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175c15a3c0 con 0x7f175c15e870 2024-09-11T22:19:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.522+0000 7f1751ffb640 1 -- 172.21.15.50:0/13145140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1754009450 con 0x7f175c15e870 2024-09-11T22:19:00.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.522+0000 7f1763282640 1 -- 172.21.15.50:0/13145140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f175c15a980 con 0x7f175c15e870 2024-09-11T22:19:00.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.523+0000 7f1763282640 1 -- 172.21.15.50:0/13145140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f175c0d1190 con 0x7f175c15e870 2024-09-11T22:19:00.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.523+0000 7f1751ffb640 1 -- 172.21.15.50:0/13145140 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1754039040 con 0x7f175c15e870 2024-09-11T22:19:00.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.524+0000 7f1751ffb640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f174006be30 0x7f174006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:00.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.524+0000 7f1751ffb640 1 -- 172.21.15.50:0/13145140 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4943+0+0 (secure 0 0 0) 0x7f17540abeb0 con 0x7f175c15e870 2024-09-11T22:19:00.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.524+0000 7f176101e640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f174006be30 0x7f174006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:00.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.525+0000 7f176101e640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f174006be30 0x7f174006e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f175c160d70 tx=0x7f1758009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:00.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.528+0000 7f1751ffb640 1 -- 172.21.15.50:0/13145140 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f175407a470 con 0x7f175c15e870 2024-09-11T22:19:00.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:00.717+0000 7f1763282640 1 -- 172.21.15.50:0/13145140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f175c0b5120 con 0x7f175c15e870 2024-09-11T22:19:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.548+0000 7f1751ffb640 1 -- 172.21.15.50:0/13145140 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v128) ==== 97+0+0 (secure 0 0 0) 0x7f175407e770 con 0x7f175c15e870 2024-09-11T22:19:01.549 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-11T22:19:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.551+0000 7f1763282640 1 -- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f174006be30 msgr2=0x7f174006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.551+0000 7f1763282640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f174006be30 0x7f174006e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f175c160d70 tx=0x7f1758009190 comp rx=0 tx=0).stop 2024-09-11T22:19:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.551+0000 7f1763282640 1 -- 172.21.15.50:0/13145140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e870 msgr2=0x7f175c161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.551+0000 7f1763282640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e870 0x7f175c161600 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f1754009eb0 tx=0x7f1754004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.551+0000 7f1763282640 1 -- 172.21.15.50:0/13145140 shutdown_connections 2024-09-11T22:19:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.551+0000 7f1763282640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f174006be30 0x7f174006e2f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.551+0000 7f1763282640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e870 0x7f175c161600 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.551+0000 7f1763282640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f175c0d3c00 0x7f175c159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.551+0000 7f1763282640 1 --2- 172.21.15.50:0/13145140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f175c0d16d0 0x7f175c1f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.551+0000 7f1763282640 1 -- 172.21.15.50:0/13145140 >> 172.21.15.50:0/13145140 conn(0x7f175c0727a0 msgr2=0x7f175c0b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.551+0000 7f1763282640 1 -- 172.21.15.50:0/13145140 shutdown_connections 2024-09-11T22:19:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.551+0000 7f1763282640 1 -- 172.21.15.50:0/13145140 wait complete. 2024-09-11T22:19:01.566 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T22:19:01.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.675+0000 7f291ca23640 1 Processor -- start 2024-09-11T22:19:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.675+0000 7f291ca23640 1 -- start start 2024-09-11T22:19:01.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.675+0000 7f291ca23640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f291815b400 0x7f291806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.676+0000 7f291ca23640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f291806e0f0 0x7f29180711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.676+0000 7f291ca23640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f291815b7e0 con 0x7f2918072e60 2024-09-11T22:19:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.676+0000 7f291ca23640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f291815f140 con 0x7f291806e0f0 2024-09-11T22:19:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.676+0000 7f291ca23640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f291815f420 con 0x7f291815b400 2024-09-11T22:19:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.676+0000 7f2916d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f291806e0f0 0x7f29180711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.676+0000 7f2916d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f291806e0f0 0x7f29180711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42396/0 (socket says 172.21.15.50:42396) 2024-09-11T22:19:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.676+0000 7f2916d9d640 1 -- 172.21.15.50:0/1636264626 learned_addr learned my addr 172.21.15.50:0/1636264626 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.676+0000 7f291659c640 1 --2- 172.21.15.50:0/1636264626 >> v2:172.21.15.77:3300/0 conn(0x7f291815b400 0x7f291806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.676+0000 7f2916d9d640 1 -- 172.21.15.50:0/1636264626 >> v2:172.21.15.77:3300/0 conn(0x7f291815b400 msgr2=0x7f291806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.676+0000 7f2916d9d640 1 --2- 172.21.15.50:0/1636264626 >> v2:172.21.15.77:3300/0 conn(0x7f291815b400 0x7f291806d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.676+0000 7f2916d9d640 1 -- 172.21.15.50:0/1636264626 >> v1:172.21.15.77:6789/0 conn(0x7f2918072e60 legacy=0x7f291806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.676+0000 7f2916d9d640 1 -- 172.21.15.50:0/1636264626 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291815f700 con 0x7f291806e0f0 2024-09-11T22:19:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.677+0000 7f2916d9d640 1 --2- 172.21.15.50:0/1636264626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f291806e0f0 0x7f29180711c0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f29180b56e0 tx=0x7f291002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e3462b969e5867 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.677+0000 7f2915d9b640 1 -- 172.21.15.50:0/1636264626 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910036070 con 0x7f291806e0f0 2024-09-11T22:19:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.677+0000 7f2915d9b640 1 -- 172.21.15.50:0/1636264626 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2910031600 con 0x7f291806e0f0 2024-09-11T22:19:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.677+0000 7f2915d9b640 1 -- 172.21.15.50:0/1636264626 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29100319d0 con 0x7f291806e0f0 2024-09-11T22:19:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.677+0000 7f291ca23640 1 -- 172.21.15.50:0/1636264626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f291806e0f0 msgr2=0x7f29180711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.677+0000 7f291ca23640 1 --2- 172.21.15.50:0/1636264626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f291806e0f0 0x7f29180711c0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f29180b56e0 tx=0x7f291002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.678+0000 7f291ca23640 1 -- 172.21.15.50:0/1636264626 shutdown_connections 2024-09-11T22:19:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.678+0000 7f291ca23640 1 --2- 172.21.15.50:0/1636264626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f291806e0f0 0x7f29180711c0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.678+0000 7f291ca23640 1 --2- 172.21.15.50:0/1636264626 >> v2:172.21.15.77:3300/0 conn(0x7f291815b400 0x7f291806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.678+0000 7f291ca23640 1 -- 172.21.15.50:0/1636264626 >> 172.21.15.50:0/1636264626 conn(0x7f29180679c0 msgr2=0x7f2918067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.678+0000 7f291ca23640 1 -- 172.21.15.50:0/1636264626 shutdown_connections 2024-09-11T22:19:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.678+0000 7f291ca23640 1 -- 172.21.15.50:0/1636264626 wait complete. 2024-09-11T22:19:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.679+0000 7f291ca23640 1 Processor -- start 2024-09-11T22:19:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.679+0000 7f291ca23640 1 -- start start 2024-09-11T22:19:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f291ca23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291806e0f0 0x7f29181f4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f291ca23640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2918072e60 0x7f29180b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f291ca23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f291815b400 0x7f29180b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f291ca23640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2918071700 con 0x7f291815b400 2024-09-11T22:19:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f291ca23640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29180cfc50 con 0x7f291806e0f0 2024-09-11T22:19:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f291ca23640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2918071880 con 0x7f2918072e60 2024-09-11T22:19:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f2916d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f291815b400 0x7f29180b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f2916d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f291815b400 0x7f29180b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42408/0 (socket says 172.21.15.50:42408) 2024-09-11T22:19:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f2916d9d640 1 -- 172.21.15.50:0/1365430862 learned_addr learned my addr 172.21.15.50:0/1365430862 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f291659c640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291806e0f0 0x7f29181f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f290dd9b640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2918072e60 0x7f29180b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f2916d9d640 1 -- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2918072e60 msgr2=0x7f29180b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f2916d9d640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2918072e60 0x7f29180b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f2916d9d640 1 -- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291806e0f0 msgr2=0x7f29181f4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:01.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f2916d9d640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291806e0f0 0x7f29181f4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f2916d9d640 1 -- 172.21.15.50:0/1365430862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29180b2930 con 0x7f291815b400 2024-09-11T22:19:01.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.680+0000 7f2916d9d640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f291815b400 0x7f29180b47c0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f291002ace0 tx=0x7f2910004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:01.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.681+0000 7f290f7fe640 1 -- 172.21.15.50:0/1365430862 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910036050 con 0x7f291815b400 2024-09-11T22:19:01.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.681+0000 7f290f7fe640 1 -- 172.21.15.50:0/1365430862 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2910042070 con 0x7f291815b400 2024-09-11T22:19:01.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.681+0000 7f290f7fe640 1 -- 172.21.15.50:0/1365430862 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910009510 con 0x7f291815b400 2024-09-11T22:19:01.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.681+0000 7f291ca23640 1 -- 172.21.15.50:0/1365430862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29180b1b70 con 0x7f291815b400 2024-09-11T22:19:01.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.681+0000 7f291ca23640 1 -- 172.21.15.50:0/1365430862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29180b2130 con 0x7f291815b400 2024-09-11T22:19:01.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.682+0000 7f291ca23640 1 -- 172.21.15.50:0/1365430862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2918069ee0 con 0x7f291815b400 2024-09-11T22:19:01.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.682+0000 7f290f7fe640 1 -- 172.21.15.50:0/1365430862 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2910007bd0 con 0x7f291815b400 2024-09-11T22:19:01.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.683+0000 7f290f7fe640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f28f806be30 0x7f28f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:01.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.683+0000 7f290f7fe640 1 -- 172.21.15.50:0/1365430862 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4857+0+0 (secure 0 0 0) 0x7f29100ab8c0 con 0x7f291815b400 2024-09-11T22:19:01.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.683+0000 7f291659c640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f28f806be30 0x7f28f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.683+0000 7f291659c640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f28f806be30 0x7f28f806e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f29180ccf20 tx=0x7f2908008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:01.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.687+0000 7f290f7fe640 1 -- 172.21.15.50:0/1365430862 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f291007a650 con 0x7f291815b400 2024-09-11T22:19:01.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.927+0000 7f291ca23640 1 -- 172.21.15.50:0/1365430862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f291806c030 con 0x7f291815b400 2024-09-11T22:19:01.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.927+0000 7f290f7fe640 1 -- 172.21.15.50:0/1365430862 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7f2910079f50 con 0x7f291815b400 2024-09-11T22:19:01.929 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:01.929 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:19:01.929 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-11T22:19:01.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.929 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-11T22:19:01.929 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w==", 2024-09-11T22:19:01.929 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.929 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:01.929 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:19:01.929 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:19:01.930 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.930 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-11T22:19:01.930 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg==", 2024-09-11T22:19:01.930 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.930 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:01.930 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:19:01.930 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:19:01.930 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-11T22:19:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ==", 2024-09-11T22:19:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:19:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:19:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.932 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-11T22:19:01.932 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw==", 2024-09-11T22:19:01.932 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.932 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:01.932 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:19:01.932 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:19:01.932 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.932 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-11T22:19:01.933 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg==", 2024-09-11T22:19:01.933 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.933 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:01.933 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:01.933 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.933 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.933 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-11T22:19:01.933 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ==", 2024-09-11T22:19:01.933 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.934 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:01.934 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:01.934 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.934 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.934 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-11T22:19:01.934 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg==", 2024-09-11T22:19:01.934 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.934 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:01.934 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:01.934 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.935 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.935 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-11T22:19:01.935 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg==", 2024-09-11T22:19:01.935 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.935 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:01.935 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:01.935 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.935 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.936 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-11T22:19:01.936 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A==", 2024-09-11T22:19:01.936 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.936 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:01.936 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:01.936 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.936 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-11T22:19:01.936 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw==", 2024-09-11T22:19:01.937 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.937 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:01.937 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:01.937 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.937 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.937 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-11T22:19:01.937 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A==", 2024-09-11T22:19:01.937 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.937 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:01.937 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:01.938 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.938 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.938 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-11T22:19:01.938 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw==", 2024-09-11T22:19:01.938 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.938 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:01.938 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:01.938 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.938 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.939 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-11T22:19:01.939 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew==", 2024-09-11T22:19:01.939 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.939 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:01.939 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-11T22:19:01.939 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T22:19:01.939 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.939 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-11T22:19:01.940 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw==", 2024-09-11T22:19:01.940 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.940 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:01.941 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:19:01.941 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:19:01.941 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:19:01.941 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.941 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-11T22:19:01.941 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg==", 2024-09-11T22:19:01.941 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.941 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:01.941 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:19:01.941 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:19:01.941 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:19:01.942 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.942 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-11T22:19:01.942 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw==", 2024-09-11T22:19:01.942 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.942 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:01.942 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:19:01.942 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:19:01.942 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:19:01.942 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.943 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-11T22:19:01.943 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBFFeJmAq9+OBAAANc9KfDvm3+wt/uED7WCvA==", 2024-09-11T22:19:01.943 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.943 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:19:01.943 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:19:01.943 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:19:01.943 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.943 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.943 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-11T22:19:01.943 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g==", 2024-09-11T22:19:01.943 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg==", 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.944 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:01.945 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-11T22:19:01.945 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:19:01.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.929+0000 7f291ca23640 1 -- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f28f806be30 msgr2=0x7f28f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:01.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.929+0000 7f291ca23640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f28f806be30 0x7f28f806e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f29180ccf20 tx=0x7f2908008040 comp rx=0 tx=0).stop 2024-09-11T22:19:01.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.929+0000 7f291ca23640 1 -- 172.21.15.50:0/1365430862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f291815b400 msgr2=0x7f29180b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:01.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.929+0000 7f291ca23640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f291815b400 0x7f29180b47c0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f291002ace0 tx=0x7f2910004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:01.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.929+0000 7f291ca23640 1 -- 172.21.15.50:0/1365430862 shutdown_connections 2024-09-11T22:19:01.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.929+0000 7f291ca23640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f28f806be30 0x7f28f806e2f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.929+0000 7f291ca23640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2918072e60 0x7f29180b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.929+0000 7f291ca23640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f291815b400 0x7f29180b47c0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.929+0000 7f291ca23640 1 --2- 172.21.15.50:0/1365430862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291806e0f0 0x7f29181f4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:01.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.929+0000 7f291ca23640 1 -- 172.21.15.50:0/1365430862 >> 172.21.15.50:0/1365430862 conn(0x7f29180679c0 msgr2=0x7f29180cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:01.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.930+0000 7f291ca23640 1 -- 172.21.15.50:0/1365430862 shutdown_connections 2024-09-11T22:19:01.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:01.930+0000 7f291ca23640 1 -- 172.21.15.50:0/1365430862 wait complete. 2024-09-11T22:19:01.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.048+0000 7f590af76640 1 Processor -- start 2024-09-11T22:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.049+0000 7f590af76640 1 -- start start 2024-09-11T22:19:02.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.049+0000 7f590af76640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f59040b0f60 0x7f59040b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.049+0000 7f590af76640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5904162d10 0x7f59040af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.049+0000 7f590af76640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59041631a0 con 0x7f59040b1340 2024-09-11T22:19:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.049+0000 7f590af76640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f59040b17a0 con 0x7f5904162d10 2024-09-11T22:19:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.049+0000 7f590af76640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f590406d550 con 0x7f59040b0f60 2024-09-11T22:19:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.049+0000 7f5903fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f59040b1340 0x7f5904162600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56536/0 (socket says 172.21.15.50:56536) 2024-09-11T22:19:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.050+0000 7f5909513640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5904162d10 0x7f59040af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.050+0000 7f5903fff640 1 -- 172.21.15.50:0/3930487668 learned_addr learned my addr 172.21.15.50:0/3930487668 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.050+0000 7f5908d12640 1 --2- 172.21.15.50:0/3930487668 >> v2:172.21.15.77:3300/0 conn(0x7f59040b0f60 0x7f59040b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.050+0000 7f59037fe640 1 -- 172.21.15.50:0/3930487668 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4196135331 0 0) 0x7f59041631a0 con 0x7f59040b1340 2024-09-11T22:19:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.050+0000 7f59037fe640 1 -- 172.21.15.50:0/3930487668 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58f0003520 con 0x7f59040b1340 2024-09-11T22:19:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.050+0000 7f5909513640 1 -- 172.21.15.50:0/3930487668 >> v2:172.21.15.77:3300/0 conn(0x7f59040b0f60 msgr2=0x7f59040b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.050+0000 7f5909513640 1 --2- 172.21.15.50:0/3930487668 >> v2:172.21.15.77:3300/0 conn(0x7f59040b0f60 0x7f59040b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.050+0000 7f5909513640 1 -- 172.21.15.50:0/3930487668 >> v1:172.21.15.50:6789/0 conn(0x7f59040b1340 legacy=0x7f5904162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.050+0000 7f5909513640 1 -- 172.21.15.50:0/3930487668 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5904163410 con 0x7f5904162d10 2024-09-11T22:19:02.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.051+0000 7f5909513640 1 --2- 172.21.15.50:0/3930487668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5904162d10 0x7f59040af390 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f59040743a0 tx=0x7f58ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbe4d06066e0c7f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:02.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.051+0000 7f59037fe640 1 -- 172.21.15.50:0/3930487668 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec037070 con 0x7f5904162d10 2024-09-11T22:19:02.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.051+0000 7f59037fe640 1 -- 172.21.15.50:0/3930487668 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ec032440 con 0x7f5904162d10 2024-09-11T22:19:02.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.051+0000 7f59037fe640 1 -- 172.21.15.50:0/3930487668 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec032810 con 0x7f5904162d10 2024-09-11T22:19:02.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.051+0000 7f590af76640 1 -- 172.21.15.50:0/3930487668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5904162d10 msgr2=0x7f59040af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.051+0000 7f590af76640 1 --2- 172.21.15.50:0/3930487668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5904162d10 0x7f59040af390 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f59040743a0 tx=0x7f58ec02a1a0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.051+0000 7f590af76640 1 -- 172.21.15.50:0/3930487668 shutdown_connections 2024-09-11T22:19:02.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.051+0000 7f590af76640 1 --2- 172.21.15.50:0/3930487668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5904162d10 0x7f59040af390 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.051+0000 7f590af76640 1 --2- 172.21.15.50:0/3930487668 >> v2:172.21.15.77:3300/0 conn(0x7f59040b0f60 0x7f59040b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.051+0000 7f590af76640 1 -- 172.21.15.50:0/3930487668 >> 172.21.15.50:0/3930487668 conn(0x7f59040b40b0 msgr2=0x7f59040b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:02.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.051+0000 7f590af76640 1 -- 172.21.15.50:0/3930487668 shutdown_connections 2024-09-11T22:19:02.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.051+0000 7f590af76640 1 -- 172.21.15.50:0/3930487668 wait complete. 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.053+0000 7f590af76640 1 Processor -- start 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.053+0000 7f590af76640 1 -- start start 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.053+0000 7f590af76640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59040b0f60 0x7f59040c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.053+0000 7f590af76640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59040b1340 0x7f59040703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f590af76640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5904162d10 0x7f5904070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f590af76640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f590406d1e0 con 0x7f59040b1340 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f590af76640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f590406cf00 con 0x7f5904162d10 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f590af76640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f590406d9e0 con 0x7f59040b0f60 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f5903fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59040b1340 0x7f59040703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f5903fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59040b1340 0x7f59040703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42432/0 (socket says 172.21.15.50:42432) 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f5903fff640 1 -- 172.21.15.50:0/1493533916 learned_addr learned my addr 172.21.15.50:0/1493533916 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f5909513640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5904162d10 0x7f5904070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f5908d12640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59040b0f60 0x7f59040c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f5903fff640 1 -- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59040b0f60 msgr2=0x7f59040c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f5903fff640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59040b0f60 0x7f59040c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f5903fff640 1 -- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5904162d10 msgr2=0x7f5904070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f5903fff640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5904162d10 0x7f5904070900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f5903fff640 1 -- 172.21.15.50:0/1493533916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59040c6cc0 con 0x7f59040b1340 2024-09-11T22:19:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f5909513640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5904162d10 0x7f5904070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f5903fff640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59040b1340 0x7f59040703c0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c430 tx=0x7f58f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f59017fa640 1 -- 172.21.15.50:0/1493533916 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4017070 con 0x7f59040b1340 2024-09-11T22:19:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f59017fa640 1 -- 172.21.15.50:0/1493533916 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f4005ce0 con 0x7f59040b1340 2024-09-11T22:19:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f590af76640 1 -- 172.21.15.50:0/1493533916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59040c6fa0 con 0x7f59040b1340 2024-09-11T22:19:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f59017fa640 1 -- 172.21.15.50:0/1493533916 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f40072f0 con 0x7f59040b1340 2024-09-11T22:19:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.054+0000 7f590af76640 1 -- 172.21.15.50:0/1493533916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59040c7560 con 0x7f59040b1340 2024-09-11T22:19:02.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.055+0000 7f590af76640 1 -- 172.21.15.50:0/1493533916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59040b4bd0 con 0x7f59040b1340 2024-09-11T22:19:02.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.056+0000 7f59017fa640 1 -- 172.21.15.50:0/1493533916 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58f401a070 con 0x7f59040b1340 2024-09-11T22:19:02.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.056+0000 7f59017fa640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58e406be60 0x7f58e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.056+0000 7f59017fa640 1 -- 172.21.15.50:0/1493533916 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4857+0+0 (secure 0 0 0) 0x7f58f4089fe0 con 0x7f59040b1340 2024-09-11T22:19:02.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.057+0000 7f5908d12640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58e406be60 0x7f58e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.057+0000 7f5908d12640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58e406be60 0x7f58e406e320 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009fd0 tx=0x7f58fc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:02.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.061+0000 7f59017fa640 1 -- 172.21.15.50:0/1493533916 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58f4058ca0 con 0x7f59040b1340 2024-09-11T22:19:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.237+0000 7f590af76640 1 -- 172.21.15.50:0/1493533916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f59040b84e0 con 0x7f59040b1340 2024-09-11T22:19:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.237+0000 7f59017fa640 1 -- 172.21.15.50:0/1493533916 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v128) ==== 84+0+65 (secure 0 0 0) 0x7f58f40585a0 con 0x7f59040b1340 2024-09-11T22:19:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:02.238 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:19:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:19:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:19:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:02.239 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:19:02.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.239+0000 7f590af76640 1 -- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58e406be60 msgr2=0x7f58e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.239+0000 7f590af76640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58e406be60 0x7f58e406e320 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009fd0 tx=0x7f58fc00b040 comp rx=0 tx=0).stop 2024-09-11T22:19:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.239+0000 7f590af76640 1 -- 172.21.15.50:0/1493533916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59040b1340 msgr2=0x7f59040703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.240+0000 7f590af76640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59040b1340 0x7f59040703c0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c430 tx=0x7f58f400c8f0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.240+0000 7f590af76640 1 -- 172.21.15.50:0/1493533916 shutdown_connections 2024-09-11T22:19:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.240+0000 7f590af76640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58e406be60 0x7f58e406e320 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.240+0000 7f590af76640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5904162d10 0x7f5904070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.240+0000 7f590af76640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59040b1340 0x7f59040703c0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.240+0000 7f590af76640 1 --2- 172.21.15.50:0/1493533916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59040b0f60 0x7f59040c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.240+0000 7f590af76640 1 -- 172.21.15.50:0/1493533916 >> 172.21.15.50:0/1493533916 conn(0x7f59040b40b0 msgr2=0x7f59040af390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.240+0000 7f590af76640 1 -- 172.21.15.50:0/1493533916 shutdown_connections 2024-09-11T22:19:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.240+0000 7f590af76640 1 -- 172.21.15.50:0/1493533916 wait complete. 2024-09-11T22:19:02.252 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:19:02.252 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:19:02.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.358+0000 7f888b3fd640 1 Processor -- start 2024-09-11T22:19:02.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.358+0000 7f888b3fd640 1 -- start start 2024-09-11T22:19:02.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.359+0000 7f888b3fd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f888415e8e0 0x7f88840b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.359+0000 7f888b3fd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88840d1580 0x7f88840d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.359+0000 7f888b3fd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8884162350 0x7f8884162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.359+0000 7f888b3fd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f888415ecc0 con 0x7f8884162350 2024-09-11T22:19:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.359+0000 7f888b3fd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f88840d2ad0 con 0x7f88840d1580 2024-09-11T22:19:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.359+0000 7f888b3fd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f88840d3370 con 0x7f888415e8e0 2024-09-11T22:19:02.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.359+0000 7f888999a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8884162350 0x7f8884162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.359+0000 7f888999a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8884162350 0x7f8884162800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42436/0 (socket says 172.21.15.50:42436) 2024-09-11T22:19:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.359+0000 7f888999a640 1 -- 172.21.15.50:0/1945998225 learned_addr learned my addr 172.21.15.50:0/1945998225 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.359+0000 7f8888998640 1 --2- 172.21.15.50:0/1945998225 >> v2:172.21.15.77:3300/0 conn(0x7f88840d1580 0x7f88840d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.359+0000 7f8889199640 1 --2- 172.21.15.50:0/1945998225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f888415e8e0 0x7f88840b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.359+0000 7f888999a640 1 -- 172.21.15.50:0/1945998225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f888415e8e0 msgr2=0x7f88840b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.359+0000 7f888999a640 1 --2- 172.21.15.50:0/1945998225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f888415e8e0 0x7f88840b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.360+0000 7f888999a640 1 -- 172.21.15.50:0/1945998225 >> v2:172.21.15.77:3300/0 conn(0x7f88840d1580 msgr2=0x7f88840d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.360+0000 7f888999a640 1 --2- 172.21.15.50:0/1945998225 >> v2:172.21.15.77:3300/0 conn(0x7f88840d1580 0x7f88840d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.360+0000 7f888999a640 1 -- 172.21.15.50:0/1945998225 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88840d1ee0 con 0x7f8884162350 2024-09-11T22:19:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.360+0000 7f888999a640 1 --2- 172.21.15.50:0/1945998225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8884162350 0x7f8884162800 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f88840b73e0 tx=0x7f887c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac1f1ea3adcb373 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:02.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.360+0000 7f887bfff640 1 -- 172.21.15.50:0/1945998225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c036070 con 0x7f8884162350 2024-09-11T22:19:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.360+0000 7f887bfff640 1 -- 172.21.15.50:0/1945998225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887c031600 con 0x7f8884162350 2024-09-11T22:19:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.360+0000 7f887bfff640 1 -- 172.21.15.50:0/1945998225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c0319d0 con 0x7f8884162350 2024-09-11T22:19:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.361+0000 7f888b3fd640 1 -- 172.21.15.50:0/1945998225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8884162350 msgr2=0x7f8884162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.361+0000 7f888b3fd640 1 --2- 172.21.15.50:0/1945998225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8884162350 0x7f8884162800 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f88840b73e0 tx=0x7f887c02a730 comp rx=0 tx=0).stop 2024-09-11T22:19:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.361+0000 7f888b3fd640 1 -- 172.21.15.50:0/1945998225 shutdown_connections 2024-09-11T22:19:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.361+0000 7f888b3fd640 1 --2- 172.21.15.50:0/1945998225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8884162350 0x7f8884162800 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.361+0000 7f888b3fd640 1 --2- 172.21.15.50:0/1945998225 >> v2:172.21.15.77:3300/0 conn(0x7f88840d1580 0x7f88840d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.361+0000 7f888b3fd640 1 --2- 172.21.15.50:0/1945998225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f888415e8e0 0x7f88840b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.361+0000 7f888b3fd640 1 -- 172.21.15.50:0/1945998225 >> 172.21.15.50:0/1945998225 conn(0x7f8884067ba0 msgr2=0x7f8884067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:02.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.361+0000 7f888b3fd640 1 -- 172.21.15.50:0/1945998225 shutdown_connections 2024-09-11T22:19:02.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.361+0000 7f888b3fd640 1 -- 172.21.15.50:0/1945998225 wait complete. 2024-09-11T22:19:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.362+0000 7f888b3fd640 1 Processor -- start 2024-09-11T22:19:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.362+0000 7f888b3fd640 1 -- start start 2024-09-11T22:19:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f888b3fd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88840d1580 0x7f88840b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f888b3fd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f888415e8e0 0x7f88840ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f888b3fd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8884162350 0x7f888414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f888b3fd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88840d3000 con 0x7f888415e8e0 2024-09-11T22:19:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f888b3fd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88840d2d20 con 0x7f8884162350 2024-09-11T22:19:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f888b3fd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8884162d40 con 0x7f88840d1580 2024-09-11T22:19:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f8888998640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f888415e8e0 0x7f88840ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f8888998640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f888415e8e0 0x7f88840ca810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42448/0 (socket says 172.21.15.50:42448) 2024-09-11T22:19:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f8888998640 1 -- 172.21.15.50:0/506880325 learned_addr learned my addr 172.21.15.50:0/506880325 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f888999a640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8884162350 0x7f888414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f8889199640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88840d1580 0x7f88840b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f8888998640 1 -- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88840d1580 msgr2=0x7f88840b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f8888998640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88840d1580 0x7f88840b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f8888998640 1 -- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8884162350 msgr2=0x7f888414e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.363+0000 7f8888998640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8884162350 0x7f888414e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.364+0000 7f8888998640 1 -- 172.21.15.50:0/506880325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88840cad50 con 0x7f888415e8e0 2024-09-11T22:19:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.364+0000 7f8888998640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f888415e8e0 0x7f88840ca810 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f887400e860 tx=0x7f887400ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.364+0000 7f8879ffb640 1 -- 172.21.15.50:0/506880325 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874017070 con 0x7f888415e8e0 2024-09-11T22:19:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.364+0000 7f8879ffb640 1 -- 172.21.15.50:0/506880325 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887400c940 con 0x7f888415e8e0 2024-09-11T22:19:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.364+0000 7f888b3fd640 1 -- 172.21.15.50:0/506880325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f888414e5e0 con 0x7f888415e8e0 2024-09-11T22:19:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.364+0000 7f8879ffb640 1 -- 172.21.15.50:0/506880325 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887400cd10 con 0x7f888415e8e0 2024-09-11T22:19:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.364+0000 7f888b3fd640 1 -- 172.21.15.50:0/506880325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88840b5a80 con 0x7f888415e8e0 2024-09-11T22:19:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.365+0000 7f888b3fd640 1 -- 172.21.15.50:0/506880325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88840b7880 con 0x7f888415e8e0 2024-09-11T22:19:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.366+0000 7f8879ffb640 1 -- 172.21.15.50:0/506880325 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f887401a070 con 0x7f888415e8e0 2024-09-11T22:19:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.366+0000 7f8879ffb640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f886806be30 0x7f886806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.366+0000 7f8879ffb640 1 -- 172.21.15.50:0/506880325 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4857+0+0 (secure 0 0 0) 0x7f887408a700 con 0x7f888415e8e0 2024-09-11T22:19:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.366+0000 7f8889199640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f886806be30 0x7f886806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.367+0000 7f8889199640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f886806be30 0x7f886806e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8880009b40 tx=0x7f8880009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:02.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.371+0000 7f8879ffb640 1 -- 172.21.15.50:0/506880325 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8874058e40 con 0x7f888415e8e0 2024-09-11T22:19:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.546+0000 7f888b3fd640 1 -- 172.21.15.50:0/506880325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f88840ba770 con 0x7f888415e8e0 2024-09-11T22:19:02.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.629+0000 7f8879ffb640 1 -- 172.21.15.50:0/506880325 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v129) ==== 138+0+0 (secure 0 0 0) 0x7f887405d140 con 0x7f888415e8e0 2024-09-11T22:19:02.629 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:19:02.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.631+0000 7f888b3fd640 1 -- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f886806be30 msgr2=0x7f886806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.631+0000 7f888b3fd640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f886806be30 0x7f886806e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8880009b40 tx=0x7f8880009190 comp rx=0 tx=0).stop 2024-09-11T22:19:02.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.631+0000 7f888b3fd640 1 -- 172.21.15.50:0/506880325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f888415e8e0 msgr2=0x7f88840ca810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.631+0000 7f888b3fd640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f888415e8e0 0x7f88840ca810 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f887400e860 tx=0x7f887400ed20 comp rx=0 tx=0).stop 2024-09-11T22:19:02.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.631+0000 7f888b3fd640 1 -- 172.21.15.50:0/506880325 shutdown_connections 2024-09-11T22:19:02.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.631+0000 7f888b3fd640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f886806be30 0x7f886806e2f0 secure :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8880009b40 tx=0x7f8880009190 comp rx=0 tx=0).stop 2024-09-11T22:19:02.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.631+0000 7f888b3fd640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8884162350 0x7f888414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.631+0000 7f888b3fd640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f888415e8e0 0x7f88840ca810 secure :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f887400e860 tx=0x7f887400ed20 comp rx=0 tx=0).stop 2024-09-11T22:19:02.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.631+0000 7f888b3fd640 1 --2- 172.21.15.50:0/506880325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88840d1580 0x7f88840b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.631+0000 7f888b3fd640 1 -- 172.21.15.50:0/506880325 >> 172.21.15.50:0/506880325 conn(0x7f8884067ba0 msgr2=0x7f8884067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:02.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.632+0000 7f888b3fd640 1 -- 172.21.15.50:0/506880325 shutdown_connections 2024-09-11T22:19:02.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.632+0000 7f888b3fd640 1 -- 172.21.15.50:0/506880325 wait complete. 2024-09-11T22:19:02.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:19:02.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.756+0000 7f89aae4c640 1 Processor -- start 2024-09-11T22:19:02.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.756+0000 7f89aae4c640 1 -- start start 2024-09-11T22:19:02.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.757+0000 7f89aae4c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89a40b3e10 0x7f89a40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.757+0000 7f89aae4c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a40b4f00 con 0x7f89a40d05e0 2024-09-11T22:19:02.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.757+0000 7f89aae4c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a40b4360 con 0x7f89a415c2c0 2024-09-11T22:19:02.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.757+0000 7f89aae4c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f89a40b51c0 con 0x7f89a40b3e10 2024-09-11T22:19:02.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.757+0000 7f89a93e9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89a40b3e10 0x7f89a40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.757+0000 7f89a3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f89a40d05e0 0x7f89a40ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56544/0 (socket says 172.21.15.50:56544) 2024-09-11T22:19:02.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.757+0000 7f89a93e9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89a40b3e10 0x7f89a40b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42456/0 (socket says 172.21.15.50:42456) 2024-09-11T22:19:02.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.757+0000 7f89a3fff640 1 -- 172.21.15.50:0/1052417965 learned_addr learned my addr 172.21.15.50:0/1052417965 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:02.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.757+0000 7f89a93e9640 1 -- 172.21.15.50:0/1052417965 >> v1:172.21.15.77:6789/0 conn(0x7f89a415c2c0 legacy=0x7f89a40cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.758+0000 7f89a93e9640 1 -- 172.21.15.50:0/1052417965 >> v1:172.21.15.50:6789/0 conn(0x7f89a40d05e0 legacy=0x7f89a40ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.758+0000 7f89a93e9640 1 -- 172.21.15.50:0/1052417965 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a40b54a0 con 0x7f89a40b3e10 2024-09-11T22:19:02.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.758+0000 7f89a37fe640 1 -- 172.21.15.50:0/1052417965 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1313924483 0 0) 0x7f89a40b4f00 con 0x7f89a40d05e0 2024-09-11T22:19:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.758+0000 7f89a93e9640 1 --2- 172.21.15.50:0/1052417965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a40b3e10 0x7f89a40b46a0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f899c009d90 tx=0x7f899c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743d2db5e8151816 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.758+0000 7f89a37fe640 1 -- 172.21.15.50:0/1052417965 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c007740 con 0x7f89a40b3e10 2024-09-11T22:19:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.758+0000 7f89a37fe640 1 -- 172.21.15.50:0/1052417965 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899c0078e0 con 0x7f89a40b3e10 2024-09-11T22:19:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.758+0000 7f89a37fe640 1 -- 172.21.15.50:0/1052417965 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c007cb0 con 0x7f89a40b3e10 2024-09-11T22:19:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.759+0000 7f89aae4c640 1 -- 172.21.15.50:0/1052417965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a40b3e10 msgr2=0x7f89a40b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.759+0000 7f89aae4c640 1 --2- 172.21.15.50:0/1052417965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a40b3e10 0x7f89a40b46a0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f899c009d90 tx=0x7f899c02a6f0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.759+0000 7f89aae4c640 1 -- 172.21.15.50:0/1052417965 shutdown_connections 2024-09-11T22:19:02.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.759+0000 7f89aae4c640 1 --2- 172.21.15.50:0/1052417965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a40b3e10 0x7f89a40b46a0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.759+0000 7f89aae4c640 1 -- 172.21.15.50:0/1052417965 >> 172.21.15.50:0/1052417965 conn(0x7f89a40679c0 msgr2=0x7f89a4067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:02.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.759+0000 7f89aae4c640 1 -- 172.21.15.50:0/1052417965 shutdown_connections 2024-09-11T22:19:02.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.759+0000 7f89aae4c640 1 -- 172.21.15.50:0/1052417965 wait complete. 2024-09-11T22:19:02.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.760+0000 7f89aae4c640 1 Processor -- start 2024-09-11T22:19:02.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.760+0000 7f89aae4c640 1 -- start start 2024-09-11T22:19:02.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.761+0000 7f89aae4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a40b3e10 0x7f89a413ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.761+0000 7f89aae4c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a40d05e0 0x7f89a4072630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.761+0000 7f89aae4c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a415c2c0 0x7f89a40ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.761+0000 7f89aae4c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f89a406d070 con 0x7f89a415c2c0 2024-09-11T22:19:02.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.761+0000 7f89aae4c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89a40ce200 con 0x7f89a40b3e10 2024-09-11T22:19:02.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.761+0000 7f89aae4c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f89a406d1f0 con 0x7f89a40d05e0 2024-09-11T22:19:02.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.761+0000 7f89a93e9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a415c2c0 0x7f89a40ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.761+0000 7f89a93e9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a415c2c0 0x7f89a40ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42466/0 (socket says 172.21.15.50:42466) 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.761+0000 7f89a93e9640 1 -- 172.21.15.50:0/2134672343 learned_addr learned my addr 172.21.15.50:0/2134672343 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.761+0000 7f89a8be8640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a40b3e10 0x7f89a413ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.761+0000 7f89a3fff640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a40d05e0 0x7f89a4072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.762+0000 7f89a93e9640 1 -- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a40d05e0 msgr2=0x7f89a4072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.762+0000 7f89a93e9640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a40d05e0 0x7f89a4072630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.762+0000 7f89a93e9640 1 -- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a40b3e10 msgr2=0x7f89a413ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.762+0000 7f89a93e9640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a40b3e10 0x7f89a413ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.762+0000 7f89a93e9640 1 -- 172.21.15.50:0/2134672343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a4072dd0 con 0x7f89a415c2c0 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.762+0000 7f89a93e9640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a415c2c0 0x7f89a40ae8c0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f899c009d90 tx=0x7f899c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.762+0000 7f89a17fa640 1 -- 172.21.15.50:0/2134672343 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c040070 con 0x7f89a415c2c0 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.762+0000 7f89a17fa640 1 -- 172.21.15.50:0/2134672343 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899c031c40 con 0x7f89a415c2c0 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.762+0000 7f89aae4c640 1 -- 172.21.15.50:0/2134672343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a41e5fb0 con 0x7f89a415c2c0 2024-09-11T22:19:02.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.762+0000 7f89a17fa640 1 -- 172.21.15.50:0/2134672343 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c003990 con 0x7f89a415c2c0 2024-09-11T22:19:02.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.762+0000 7f89aae4c640 1 -- 172.21.15.50:0/2134672343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a4148790 con 0x7f89a415c2c0 2024-09-11T22:19:02.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.763+0000 7f89aae4c640 1 -- 172.21.15.50:0/2134672343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a415c6a0 con 0x7f89a415c2c0 2024-09-11T22:19:02.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.764+0000 7f89a17fa640 1 -- 172.21.15.50:0/2134672343 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f899c039040 con 0x7f89a415c2c0 2024-09-11T22:19:02.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.764+0000 7f89a17fa640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f898806be30 0x7f898806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:02.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.764+0000 7f89a17fa640 1 -- 172.21.15.50:0/2134672343 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5227+0+0 (secure 0 0 0) 0x7f899c0abee0 con 0x7f89a415c2c0 2024-09-11T22:19:02.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.765+0000 7f89a8be8640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f898806be30 0x7f898806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:02.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.765+0000 7f89a8be8640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f898806be30 0x7f898806e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8998000f60 tx=0x7f8998009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:02.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.769+0000 7f89a17fa640 1 -- 172.21.15.50:0/2134672343 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f899c07a4b0 con 0x7f89a415c2c0 2024-09-11T22:19:02.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:02.946+0000 7f89aae4c640 1 -- 172.21.15.50:0/2134672343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f89a40ccad0 con 0x7f89a415c2c0 2024-09-11T22:19:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.636+0000 7f89a17fa640 1 -- 172.21.15.50:0/2134672343 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v130) ==== 170+0+0 (secure 0 0 0) 0x7f899c07e7b0 con 0x7f89a415c2c0 2024-09-11T22:19:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:19:03.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.640+0000 7f89aae4c640 1 -- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f898806be30 msgr2=0x7f898806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:03.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.640+0000 7f89aae4c640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f898806be30 0x7f898806e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8998000f60 tx=0x7f8998009040 comp rx=0 tx=0).stop 2024-09-11T22:19:03.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.640+0000 7f89aae4c640 1 -- 172.21.15.50:0/2134672343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a415c2c0 msgr2=0x7f89a40ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:03.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.640+0000 7f89aae4c640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a415c2c0 0x7f89a40ae8c0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f899c009d90 tx=0x7f899c004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:03.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.642+0000 7f89aae4c640 1 -- 172.21.15.50:0/2134672343 shutdown_connections 2024-09-11T22:19:03.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.642+0000 7f89aae4c640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f898806be30 0x7f898806e2f0 secure :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8998000f60 tx=0x7f8998009040 comp rx=0 tx=0).stop 2024-09-11T22:19:03.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.642+0000 7f89aae4c640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a40d05e0 0x7f89a4072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:03.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.642+0000 7f89aae4c640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a415c2c0 0x7f89a40ae8c0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:03.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.642+0000 7f89aae4c640 1 --2- 172.21.15.50:0/2134672343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a40b3e10 0x7f89a413ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:03.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.642+0000 7f89aae4c640 1 -- 172.21.15.50:0/2134672343 >> 172.21.15.50:0/2134672343 conn(0x7f89a40679c0 msgr2=0x7f89a4067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:03.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.647+0000 7f89aae4c640 1 -- 172.21.15.50:0/2134672343 shutdown_connections 2024-09-11T22:19:03.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.648+0000 7f89aae4c640 1 -- 172.21.15.50:0/2134672343 wait complete. 2024-09-11T22:19:03.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:19:03.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.778+0000 7f1bee986640 1 Processor -- start 2024-09-11T22:19:03.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.778+0000 7f1bee986640 1 -- start start 2024-09-11T22:19:03.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.779+0000 7f1bee986640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1be80cf610 0x7f1be80b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:03.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.779+0000 7f1bee986640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be80cfbd0 con 0x7f1be8161fa0 2024-09-11T22:19:03.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.779+0000 7f1bee986640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be80cfeb0 con 0x7f1be80b1600 2024-09-11T22:19:03.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.779+0000 7f1bee986640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1be80d1220 con 0x7f1be80cf610 2024-09-11T22:19:03.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.779+0000 7f1be77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1be80cf610 0x7f1be80b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:03.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.779+0000 7f1be7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1be8161fa0 0x7f1be80cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56560/0 (socket says 172.21.15.50:56560) 2024-09-11T22:19:03.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.779+0000 7f1be7fff640 1 -- 172.21.15.50:0/499937455 learned_addr learned my addr 172.21.15.50:0/499937455 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:03.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.779+0000 7f1be77fe640 1 -- 172.21.15.50:0/499937455 >> v1:172.21.15.77:6789/0 conn(0x7f1be80b1600 legacy=0x7f1be80cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:03.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.779+0000 7f1be77fe640 1 -- 172.21.15.50:0/499937455 >> v1:172.21.15.50:6789/0 conn(0x7f1be8161fa0 legacy=0x7f1be80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:03.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.779+0000 7f1be77fe640 1 -- 172.21.15.50:0/499937455 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be80d1470 con 0x7f1be80cf610 2024-09-11T22:19:03.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.780+0000 7f1be77fe640 1 --2- 172.21.15.50:0/499937455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be80cf610 0x7f1be80b4d20 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0097a0 tx=0x7f1bdc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f003d58759c4a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:03.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.780+0000 7f1be6ffd640 1 -- 172.21.15.50:0/499937455 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc037070 con 0x7f1be80cf610 2024-09-11T22:19:03.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.780+0000 7f1be6ffd640 1 -- 172.21.15.50:0/499937455 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc032440 con 0x7f1be80cf610 2024-09-11T22:19:03.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.780+0000 7f1be6ffd640 1 -- 172.21.15.50:0/499937455 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc032810 con 0x7f1be80cf610 2024-09-11T22:19:03.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.781+0000 7f1bee986640 1 -- 172.21.15.50:0/499937455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be80cf610 msgr2=0x7f1be80b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:03.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.781+0000 7f1bee986640 1 --2- 172.21.15.50:0/499937455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be80cf610 0x7f1be80b4d20 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0097a0 tx=0x7f1bdc02a1e0 comp rx=0 tx=0).stop 2024-09-11T22:19:03.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.781+0000 7f1bee986640 1 -- 172.21.15.50:0/499937455 shutdown_connections 2024-09-11T22:19:03.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.781+0000 7f1bee986640 1 --2- 172.21.15.50:0/499937455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be80cf610 0x7f1be80b4d20 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:03.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.781+0000 7f1bee986640 1 -- 172.21.15.50:0/499937455 >> 172.21.15.50:0/499937455 conn(0x7f1be809ba50 msgr2=0x7f1be80b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:03.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.781+0000 7f1bee986640 1 -- 172.21.15.50:0/499937455 shutdown_connections 2024-09-11T22:19:03.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.781+0000 7f1bee986640 1 -- 172.21.15.50:0/499937455 wait complete. 2024-09-11T22:19:03.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.782+0000 7f1bee986640 1 Processor -- start 2024-09-11T22:19:03.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.782+0000 7f1bee986640 1 -- start start 2024-09-11T22:19:03.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.783+0000 7f1bee986640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be80b1600 0x7f1be80c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:03.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.783+0000 7f1bee986640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1be80cf610 0x7f1be815e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:03.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.783+0000 7f1bee986640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be8161fa0 0x7f1be80b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:03.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.783+0000 7f1bee986640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1be80d1c70 con 0x7f1be80b1600 2024-09-11T22:19:03.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.783+0000 7f1bee986640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1be80d17e0 con 0x7f1be8161fa0 2024-09-11T22:19:03.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.783+0000 7f1bee986640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1be80d1df0 con 0x7f1be80cf610 2024-09-11T22:19:03.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.783+0000 7f1be7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be80b1600 0x7f1be80c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:03.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.783+0000 7f1be7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be80b1600 0x7f1be80c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42480/0 (socket says 172.21.15.50:42480) 2024-09-11T22:19:03.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.783+0000 7f1be7fff640 1 -- 172.21.15.50:0/491790925 learned_addr learned my addr 172.21.15.50:0/491790925 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.783+0000 7f1be77fe640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1be80cf610 0x7f1be815e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.783+0000 7f1becf23640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be8161fa0 0x7f1be80b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.784+0000 7f1be7fff640 1 -- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1be80cf610 msgr2=0x7f1be815e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.784+0000 7f1be7fff640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1be80cf610 0x7f1be815e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.784+0000 7f1be7fff640 1 -- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be8161fa0 msgr2=0x7f1be80b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.784+0000 7f1be7fff640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be8161fa0 0x7f1be80b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.784+0000 7f1be7fff640 1 -- 172.21.15.50:0/491790925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be81f47e0 con 0x7f1be80b1600 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.784+0000 7f1becf23640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be8161fa0 0x7f1be80b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.784+0000 7f1be7fff640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be80b1600 0x7f1be80c6100 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800c400 tx=0x7f1bd800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.784+0000 7f1be4ff9640 1 -- 172.21.15.50:0/491790925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8017070 con 0x7f1be80b1600 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.784+0000 7f1be4ff9640 1 -- 172.21.15.50:0/491790925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd8005ce0 con 0x7f1be80b1600 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.784+0000 7f1bee986640 1 -- 172.21.15.50:0/491790925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be80b8450 con 0x7f1be80b1600 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.784+0000 7f1be4ff9640 1 -- 172.21.15.50:0/491790925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80072f0 con 0x7f1be80b1600 2024-09-11T22:19:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.784+0000 7f1bee986640 1 -- 172.21.15.50:0/491790925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be81f4aa0 con 0x7f1be80b1600 2024-09-11T22:19:03.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.785+0000 7f1bee986640 1 -- 172.21.15.50:0/491790925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be80b4d20 con 0x7f1be80b1600 2024-09-11T22:19:03.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.785+0000 7f1be4ff9640 1 -- 172.21.15.50:0/491790925 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bd801a070 con 0x7f1be80b1600 2024-09-11T22:19:03.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.786+0000 7f1be4ff9640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1bd406be30 0x7f1bd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:03.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.786+0000 7f1be4ff9640 1 -- 172.21.15.50:0/491790925 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5609+0+0 (secure 0 0 0) 0x7f1bd808a190 con 0x7f1be80b1600 2024-09-11T22:19:03.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.786+0000 7f1be77fe640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1bd406be30 0x7f1bd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:03.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.787+0000 7f1be77fe640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1bd406be30 0x7f1bd406e2f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc034000 tx=0x7f1bdc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:03.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:03.791+0000 7f1be4ff9640 1 -- 172.21.15.50:0/491790925 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1bd8058540 con 0x7f1be80b1600 2024-09-11T22:19:04.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.003+0000 7f1bee986640 1 -- 172.21.15.50:0/491790925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1be80d2140 con 0x7f1be80b1600 2024-09-11T22:19:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.637+0000 7f1be4ff9640 1 -- 172.21.15.50:0/491790925 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v91) ==== 174+0+0 (secure 0 0 0) 0x7f1bd805c840 con 0x7f1be80b1600 2024-09-11T22:19:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 18 and data pool 19 2024-09-11T22:19:04.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.640+0000 7f1bee986640 1 -- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1bd406be30 msgr2=0x7f1bd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:04.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.640+0000 7f1bee986640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1bd406be30 0x7f1bd406e2f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc034000 tx=0x7f1bdc02e000 comp rx=0 tx=0).stop 2024-09-11T22:19:04.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.640+0000 7f1bee986640 1 -- 172.21.15.50:0/491790925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be80b1600 msgr2=0x7f1be80c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:04.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.640+0000 7f1bee986640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be80b1600 0x7f1be80c6100 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800c400 tx=0x7f1bd800c8c0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.641+0000 7f1bee986640 1 -- 172.21.15.50:0/491790925 shutdown_connections 2024-09-11T22:19:04.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.641+0000 7f1bee986640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1bd406be30 0x7f1bd406e2f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.641+0000 7f1bee986640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1be80cf610 0x7f1be815e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.641+0000 7f1bee986640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be8161fa0 0x7f1be80b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.641+0000 7f1bee986640 1 --2- 172.21.15.50:0/491790925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1be80b1600 0x7f1be80c6100 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.641+0000 7f1bee986640 1 -- 172.21.15.50:0/491790925 >> 172.21.15.50:0/491790925 conn(0x7f1be809ba50 msgr2=0x7f1be80cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:04.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.641+0000 7f1bee986640 1 -- 172.21.15.50:0/491790925 shutdown_connections 2024-09-11T22:19:04.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.641+0000 7f1bee986640 1 -- 172.21.15.50:0/491790925 wait complete. 2024-09-11T22:19:04.658 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:19:04.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.763+0000 7f2c59952640 1 Processor -- start 2024-09-11T22:19:04.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.764+0000 7f2c59952640 1 -- start start 2024-09-11T22:19:04.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.764+0000 7f2c59952640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2c540cf790 0x7f2c540b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:04.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.764+0000 7f2c59952640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c540d11d0 0x7f2c540d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:04.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.764+0000 7f2c59952640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c54162110 con 0x7f2c54161d30 2024-09-11T22:19:04.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.764+0000 7f2c59952640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2c540d1b80 con 0x7f2c540cf790 2024-09-11T22:19:04.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.764+0000 7f2c59952640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2c540d3450 con 0x7f2c540d11d0 2024-09-11T22:19:04.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.765+0000 7f2c527fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2c540cf790 0x7f2c540b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:04.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.765+0000 7f2c537fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c540d11d0 0x7f2c540d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:04.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.765+0000 7f2c52ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2c54161d30 0x7f2c54162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:36716/0 (socket says 172.21.15.50:36716) 2024-09-11T22:19:04.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.765+0000 7f2c537fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c540d11d0 0x7f2c540d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:46064/0 (socket says 172.21.15.50:46064) 2024-09-11T22:19:04.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.765+0000 7f2c52ffd640 1 -- 172.21.15.50:0/159223754 learned_addr learned my addr 172.21.15.50:0/159223754 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:04.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.765+0000 7f2c527fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2c540cf790 0x7f2c540b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:33976/0 (socket says 172.21.15.50:33976) 2024-09-11T22:19:04.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.765+0000 7f2c527fc640 1 -- 172.21.15.50:0/159223754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c540d11d0 msgr2=0x7f2c540d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:04.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.765+0000 7f2c527fc640 1 --2- 172.21.15.50:0/159223754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c540d11d0 0x7f2c540d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.765+0000 7f2c527fc640 1 -- 172.21.15.50:0/159223754 >> v1:172.21.15.77:6789/0 conn(0x7f2c54161d30 legacy=0x7f2c54162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.765+0000 7f2c527fc640 1 -- 172.21.15.50:0/159223754 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c540cfd70 con 0x7f2c540cf790 2024-09-11T22:19:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.766+0000 7f2c527fc640 1 --2- 172.21.15.50:0/159223754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c540cf790 0x7f2c540b78f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2c480097a0 tx=0x7f2c4802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17eb58b8d86eaaaa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.766+0000 7f2c51ffb640 1 -- 172.21.15.50:0/159223754 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48037070 con 0x7f2c540cf790 2024-09-11T22:19:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.766+0000 7f2c51ffb640 1 -- 172.21.15.50:0/159223754 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c48032440 con 0x7f2c540cf790 2024-09-11T22:19:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.766+0000 7f2c51ffb640 1 -- 172.21.15.50:0/159223754 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48032810 con 0x7f2c540cf790 2024-09-11T22:19:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.767+0000 7f2c59952640 1 -- 172.21.15.50:0/159223754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c540cf790 msgr2=0x7f2c540b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.767+0000 7f2c59952640 1 --2- 172.21.15.50:0/159223754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c540cf790 0x7f2c540b78f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2c480097a0 tx=0x7f2c4802a180 comp rx=0 tx=0).stop 2024-09-11T22:19:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.767+0000 7f2c59952640 1 -- 172.21.15.50:0/159223754 shutdown_connections 2024-09-11T22:19:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.767+0000 7f2c59952640 1 --2- 172.21.15.50:0/159223754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c540d11d0 0x7f2c540d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.767+0000 7f2c59952640 1 --2- 172.21.15.50:0/159223754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c540cf790 0x7f2c540b78f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.767+0000 7f2c59952640 1 -- 172.21.15.50:0/159223754 >> 172.21.15.50:0/159223754 conn(0x7f2c540727a0 msgr2=0x7f2c540679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.767+0000 7f2c59952640 1 -- 172.21.15.50:0/159223754 shutdown_connections 2024-09-11T22:19:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.767+0000 7f2c59952640 1 -- 172.21.15.50:0/159223754 wait complete. 2024-09-11T22:19:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.768+0000 7f2c59952640 1 Processor -- start 2024-09-11T22:19:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.768+0000 7f2c59952640 1 -- start start 2024-09-11T22:19:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c59952640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c540cf790 0x7f2c540b6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c59952640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c540d11d0 0x7f2c541f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c59952640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c54161d30 0x7f2c541f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c59952640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2c540d2e00 con 0x7f2c54161d30 2024-09-11T22:19:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c59952640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2c540b7e30 con 0x7f2c540d11d0 2024-09-11T22:19:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c59952640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2c540d30e0 con 0x7f2c540cf790 2024-09-11T22:19:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c537fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c54161d30 0x7f2c541f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c537fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c54161d30 0x7f2c541f5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42496/0 (socket says 172.21.15.50:42496) 2024-09-11T22:19:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c537fe640 1 -- 172.21.15.50:0/400865165 learned_addr learned my addr 172.21.15.50:0/400865165 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c52ffd640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c540cf790 0x7f2c540b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c527fc640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c540d11d0 0x7f2c541f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:04.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c537fe640 1 -- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c540cf790 msgr2=0x7f2c540b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:04.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c537fe640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c540cf790 0x7f2c540b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c537fe640 1 -- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c540d11d0 msgr2=0x7f2c541f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:04.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c537fe640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c540d11d0 0x7f2c541f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.769+0000 7f2c537fe640 1 -- 172.21.15.50:0/400865165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c540b55b0 con 0x7f2c54161d30 2024-09-11T22:19:04.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.770+0000 7f2c537fe640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c54161d30 0x7f2c541f5620 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00e930 tx=0x7f2c4c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:04.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.770+0000 7f2c3bfff640 1 -- 172.21.15.50:0/400865165 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c017070 con 0x7f2c54161d30 2024-09-11T22:19:04.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.770+0000 7f2c3bfff640 1 -- 172.21.15.50:0/400865165 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4c00c980 con 0x7f2c54161d30 2024-09-11T22:19:04.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.770+0000 7f2c59952640 1 -- 172.21.15.50:0/400865165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c540b5890 con 0x7f2c54161d30 2024-09-11T22:19:04.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.770+0000 7f2c3bfff640 1 -- 172.21.15.50:0/400865165 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c00cd70 con 0x7f2c54161d30 2024-09-11T22:19:04.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.770+0000 7f2c59952640 1 -- 172.21.15.50:0/400865165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c540b5e50 con 0x7f2c54161d30 2024-09-11T22:19:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.771+0000 7f2c59952640 1 -- 172.21.15.50:0/400865165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c540b78f0 con 0x7f2c54161d30 2024-09-11T22:19:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.771+0000 7f2c3bfff640 1 -- 172.21.15.50:0/400865165 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c4c01a070 con 0x7f2c54161d30 2024-09-11T22:19:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.772+0000 7f2c3bfff640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2c4006be30 0x7f2c4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.772+0000 7f2c3bfff640 1 -- 172.21.15.50:0/400865165 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f2c4c08b0d0 con 0x7f2c54161d30 2024-09-11T22:19:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.772+0000 7f2c52ffd640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2c4006be30 0x7f2c4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.773+0000 7f2c52ffd640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2c4006be30 0x7f2c4006e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2c5415b2e0 tx=0x7f2c44001990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:04.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.777+0000 7f2c3bfff640 1 -- 172.21.15.50:0/400865165 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c4c059580 con 0x7f2c54161d30 2024-09-11T22:19:04.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.952+0000 7f2c59952640 1 -- 172.21.15.50:0/400865165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c541585a0 con 0x7f2c54161d30 2024-09-11T22:19:04.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.953+0000 7f2c3bfff640 1 -- 172.21.15.50:0/400865165 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+16716 (secure 0 0 0) 0x7f2c4c05d880 con 0x7f2c54161d30 2024-09-11T22:19:04.954 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:04.954 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":131,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:19:04.005266+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:19:02.578071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-11T22:19:02.977390+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:19:04.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.955+0000 7f2c59952640 1 -- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2c4006be30 msgr2=0x7f2c4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:04.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.955+0000 7f2c59952640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2c4006be30 0x7f2c4006e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2c5415b2e0 tx=0x7f2c44001990 comp rx=0 tx=0).stop 2024-09-11T22:19:04.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.955+0000 7f2c59952640 1 -- 172.21.15.50:0/400865165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c54161d30 msgr2=0x7f2c541f5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:04.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.955+0000 7f2c59952640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c54161d30 0x7f2c541f5620 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00e930 tx=0x7f2c4c00edf0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.955+0000 7f2c59952640 1 -- 172.21.15.50:0/400865165 shutdown_connections 2024-09-11T22:19:04.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.955+0000 7f2c59952640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2c4006be30 0x7f2c4006e2f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.955+0000 7f2c59952640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c54161d30 0x7f2c541f5620 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.955+0000 7f2c59952640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c540d11d0 0x7f2c541f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.955+0000 7f2c59952640 1 --2- 172.21.15.50:0/400865165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c540cf790 0x7f2c540b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:04.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.955+0000 7f2c59952640 1 -- 172.21.15.50:0/400865165 >> 172.21.15.50:0/400865165 conn(0x7f2c540727a0 msgr2=0x7f2c540b9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:04.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.955+0000 7f2c59952640 1 -- 172.21.15.50:0/400865165 shutdown_connections 2024-09-11T22:19:04.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:04.955+0000 7f2c59952640 1 -- 172.21.15.50:0/400865165 wait complete. 2024-09-11T22:19:04.968 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:19:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.069+0000 7f0c64c23640 1 Processor -- start 2024-09-11T22:19:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.069+0000 7f0c64c23640 1 -- start start 2024-09-11T22:19:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.070+0000 7f0c64c23640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c6015fb60 0x7f0c600b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.070+0000 7f0c64c23640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6015ff40 con 0x7f0c600d0fd0 2024-09-11T22:19:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.070+0000 7f0c64c23640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c600d05e0 con 0x7f0c600d0150 2024-09-11T22:19:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.070+0000 7f0c64c23640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0c600cf510 con 0x7f0c6015fb60 2024-09-11T22:19:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.070+0000 7f0c5ed9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0c600d0fd0 0x7f0c600af670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56562/0 (socket says 172.21.15.50:56562) 2024-09-11T22:19:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.070+0000 7f0c5ed9d640 1 -- 172.21.15.50:0/2398037557 learned_addr learned my addr 172.21.15.50:0/2398037557 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.070+0000 7f0c5e59c640 1 --2- 172.21.15.50:0/2398037557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c6015fb60 0x7f0c600b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.070+0000 7f0c5d59a640 1 -- 172.21.15.50:0/2398037557 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4265429243 0 0) 0x7f0c6015ff40 con 0x7f0c600d0fd0 2024-09-11T22:19:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.071+0000 7f0c5d59a640 1 -- 172.21.15.50:0/2398037557 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c48003520 con 0x7f0c600d0fd0 2024-09-11T22:19:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.071+0000 7f0c5d59a640 1 -- 172.21.15.50:0/2398037557 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1545799568 0 0) 0x7f0c600d05e0 con 0x7f0c600d0150 2024-09-11T22:19:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.071+0000 7f0c5d59a640 1 -- 172.21.15.50:0/2398037557 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c6015ff40 con 0x7f0c600d0150 2024-09-11T22:19:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.071+0000 7f0c5e59c640 1 -- 172.21.15.50:0/2398037557 >> v1:172.21.15.77:6789/0 conn(0x7f0c600d0150 legacy=0x7f0c600d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.071+0000 7f0c5e59c640 1 -- 172.21.15.50:0/2398037557 >> v1:172.21.15.50:6789/0 conn(0x7f0c600d0fd0 legacy=0x7f0c600af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.071+0000 7f0c5e59c640 1 -- 172.21.15.50:0/2398037557 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c600cf760 con 0x7f0c6015fb60 2024-09-11T22:19:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.071+0000 7f0c5e59c640 1 --2- 172.21.15.50:0/2398037557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c6015fb60 0x7f0c600b4c70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0c500097d0 tx=0x7f0c5002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81b44131bb797d65 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.072+0000 7f0c5d59a640 1 -- 172.21.15.50:0/2398037557 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50037070 con 0x7f0c6015fb60 2024-09-11T22:19:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.072+0000 7f0c5d59a640 1 -- 172.21.15.50:0/2398037557 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c50032440 con 0x7f0c6015fb60 2024-09-11T22:19:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.072+0000 7f0c5d59a640 1 -- 172.21.15.50:0/2398037557 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c500327f0 con 0x7f0c6015fb60 2024-09-11T22:19:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.072+0000 7f0c64c23640 1 -- 172.21.15.50:0/2398037557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c6015fb60 msgr2=0x7f0c600b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.072+0000 7f0c64c23640 1 --2- 172.21.15.50:0/2398037557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c6015fb60 0x7f0c600b4c70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0c500097d0 tx=0x7f0c5002a180 comp rx=0 tx=0).stop 2024-09-11T22:19:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.072+0000 7f0c64c23640 1 -- 172.21.15.50:0/2398037557 shutdown_connections 2024-09-11T22:19:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.072+0000 7f0c64c23640 1 --2- 172.21.15.50:0/2398037557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c6015fb60 0x7f0c600b4c70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.072+0000 7f0c64c23640 1 -- 172.21.15.50:0/2398037557 >> 172.21.15.50:0/2398037557 conn(0x7f0c600b4150 msgr2=0x7f0c600b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.072+0000 7f0c64c23640 1 -- 172.21.15.50:0/2398037557 shutdown_connections 2024-09-11T22:19:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.072+0000 7f0c64c23640 1 -- 172.21.15.50:0/2398037557 wait complete. 2024-09-11T22:19:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.074+0000 7f0c64c23640 1 Processor -- start 2024-09-11T22:19:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.074+0000 7f0c64c23640 1 -- start start 2024-09-11T22:19:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.074+0000 7f0c64c23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c600d0fd0 0x7f0c600c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.074+0000 7f0c64c23640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c6015fb60 0x7f0c601f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.074+0000 7f0c64c23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c600c6300 0x7f0c601f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.074+0000 7f0c64c23640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0c600b1930 con 0x7f0c600d0fd0 2024-09-11T22:19:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.074+0000 7f0c64c23640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0c600cfdb0 con 0x7f0c600c6300 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.074+0000 7f0c64c23640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0c600b1ab0 con 0x7f0c6015fb60 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c5e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c600d0fd0 0x7f0c600c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c5e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c600d0fd0 0x7f0c600c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42504/0 (socket says 172.21.15.50:42504) 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c5e59c640 1 -- 172.21.15.50:0/3491721215 learned_addr learned my addr 172.21.15.50:0/3491721215 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c5ed9d640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c600c6300 0x7f0c601f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c5dd9b640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c6015fb60 0x7f0c601f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c5e59c640 1 -- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c6015fb60 msgr2=0x7f0c601f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c5e59c640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c6015fb60 0x7f0c601f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c5e59c640 1 -- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c600c6300 msgr2=0x7f0c601f5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c5e59c640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c600c6300 0x7f0c601f5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c5e59c640 1 -- 172.21.15.50:0/3491721215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c600c88e0 con 0x7f0c600d0fd0 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c5dd9b640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c6015fb60 0x7f0c601f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c5e59c640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c600d0fd0 0x7f0c600c5dc0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f0c50000c00 tx=0x7f0c500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:05.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c4effd640 1 -- 172.21.15.50:0/3491721215 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50041020 con 0x7f0c600d0fd0 2024-09-11T22:19:05.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c4effd640 1 -- 172.21.15.50:0/3491721215 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c5003d620 con 0x7f0c600d0fd0 2024-09-11T22:19:05.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c64c23640 1 -- 172.21.15.50:0/3491721215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c600c8bc0 con 0x7f0c600d0fd0 2024-09-11T22:19:05.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c4effd640 1 -- 172.21.15.50:0/3491721215 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50037040 con 0x7f0c600d0fd0 2024-09-11T22:19:05.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.075+0000 7f0c64c23640 1 -- 172.21.15.50:0/3491721215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c600caab0 con 0x7f0c600d0fd0 2024-09-11T22:19:05.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.076+0000 7f0c64c23640 1 -- 172.21.15.50:0/3491721215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c600b4c70 con 0x7f0c600d0fd0 2024-09-11T22:19:05.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.077+0000 7f0c4effd640 1 -- 172.21.15.50:0/3491721215 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c50044020 con 0x7f0c600d0fd0 2024-09-11T22:19:05.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.077+0000 7f0c4effd640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c4006be30 0x7f0c4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:05.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.077+0000 7f0c4effd640 1 -- 172.21.15.50:0/3491721215 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f0c500ab640 con 0x7f0c600d0fd0 2024-09-11T22:19:05.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.077+0000 7f0c5dd9b640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c4006be30 0x7f0c4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:05.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.078+0000 7f0c5dd9b640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c4006be30 0x7f0c4006e2f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0c6015e130 tx=0x7f0c54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:05.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.081+0000 7f0c4effd640 1 -- 172.21.15.50:0/3491721215 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c5004b030 con 0x7f0c600d0fd0 2024-09-11T22:19:05.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.256+0000 7f0c64c23640 1 -- 172.21.15.50:0/3491721215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c600ce9f0 con 0x7f0c600d0fd0 2024-09-11T22:19:05.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.258+0000 7f0c4effd640 1 -- 172.21.15.50:0/3491721215 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+16716 (secure 0 0 0) 0x7f0c50079f60 con 0x7f0c600d0fd0 2024-09-11T22:19:05.260 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:05.260 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":131,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:19:04.005266+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:19:02.578071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-11T22:19:02.977390+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:19:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.259+0000 7f0c64c23640 1 -- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c4006be30 msgr2=0x7f0c4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.259+0000 7f0c64c23640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c4006be30 0x7f0c4006e2f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0c6015e130 tx=0x7f0c54009040 comp rx=0 tx=0).stop 2024-09-11T22:19:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.259+0000 7f0c64c23640 1 -- 172.21.15.50:0/3491721215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c600d0fd0 msgr2=0x7f0c600c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:05.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.259+0000 7f0c64c23640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c600d0fd0 0x7f0c600c5dc0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f0c50000c00 tx=0x7f0c500046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.260+0000 7f0c64c23640 1 -- 172.21.15.50:0/3491721215 shutdown_connections 2024-09-11T22:19:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.260+0000 7f0c64c23640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c4006be30 0x7f0c4006e2f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.260+0000 7f0c64c23640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c6015fb60 0x7f0c601f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.260+0000 7f0c64c23640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c600c6300 0x7f0c601f5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.260+0000 7f0c64c23640 1 --2- 172.21.15.50:0/3491721215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c600d0fd0 0x7f0c600c5dc0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.260+0000 7f0c64c23640 1 -- 172.21.15.50:0/3491721215 >> 172.21.15.50:0/3491721215 conn(0x7f0c600b4150 msgr2=0x7f0c600702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.260+0000 7f0c64c23640 1 -- 172.21.15.50:0/3491721215 shutdown_connections 2024-09-11T22:19:05.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.260+0000 7f0c64c23640 1 -- 172.21.15.50:0/3491721215 wait complete. 2024-09-11T22:19:05.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:19:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.413+0000 7f8b6c7e8640 1 Processor -- start 2024-09-11T22:19:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.413+0000 7f8b6c7e8640 1 -- start start 2024-09-11T22:19:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.414+0000 7f8b6c7e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b640cf790 0x7f8b640b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.414+0000 7f8b6c7e8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b640d11d0 0x7f8b640d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.414+0000 7f8b6c7e8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b64162110 con 0x7f8b64161d30 2024-09-11T22:19:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.414+0000 7f8b6c7e8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8b640d3450 con 0x7f8b640d11d0 2024-09-11T22:19:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.414+0000 7f8b6c7e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8b640b7e30 con 0x7f8b640cf790 2024-09-11T22:19:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.414+0000 7f8b6a584640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8b64161d30 0x7f8b64162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56574/0 (socket says 172.21.15.50:56574) 2024-09-11T22:19:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.414+0000 7f8b6a584640 1 -- 172.21.15.50:0/271111135 learned_addr learned my addr 172.21.15.50:0/271111135 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:05.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.414+0000 7f8b6ad85640 1 --2- 172.21.15.50:0/271111135 >> v2:172.21.15.50:3300/0 conn(0x7f8b640d11d0 0x7f8b640d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:05.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.414+0000 7f8b69d83640 1 --2- 172.21.15.50:0/271111135 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b640cf790 0x7f8b640b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:05.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.414+0000 7f8b69582640 1 -- 172.21.15.50:0/271111135 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2904869905 0 0) 0x7f8b64162110 con 0x7f8b64161d30 2024-09-11T22:19:05.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.414+0000 7f8b69582640 1 -- 172.21.15.50:0/271111135 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b50003520 con 0x7f8b64161d30 2024-09-11T22:19:05.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.415+0000 7f8b6ad85640 1 -- 172.21.15.50:0/271111135 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b640cf790 msgr2=0x7f8b640b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:05.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.415+0000 7f8b6ad85640 1 --2- 172.21.15.50:0/271111135 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b640cf790 0x7f8b640b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.415+0000 7f8b6ad85640 1 -- 172.21.15.50:0/271111135 >> v1:172.21.15.50:6789/0 conn(0x7f8b64161d30 legacy=0x7f8b64162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.415+0000 7f8b6ad85640 1 -- 172.21.15.50:0/271111135 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b640cfd70 con 0x7f8b640d11d0 2024-09-11T22:19:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.415+0000 7f8b69d83640 1 --2- 172.21.15.50:0/271111135 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b640cf790 0x7f8b640b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.415+0000 7f8b6ad85640 1 --2- 172.21.15.50:0/271111135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b640d11d0 0x7f8b640d1660 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009d90 tx=0x7f8b5c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61f1b17efdedb1f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.415+0000 7f8b69582640 1 -- 172.21.15.50:0/271111135 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c007740 con 0x7f8b640d11d0 2024-09-11T22:19:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.415+0000 7f8b69582640 1 -- 172.21.15.50:0/271111135 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5c0078e0 con 0x7f8b640d11d0 2024-09-11T22:19:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.415+0000 7f8b69582640 1 -- 172.21.15.50:0/271111135 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c007cb0 con 0x7f8b640d11d0 2024-09-11T22:19:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.416+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/271111135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b640d11d0 msgr2=0x7f8b640d1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.416+0000 7f8b6c7e8640 1 --2- 172.21.15.50:0/271111135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b640d11d0 0x7f8b640d1660 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009d90 tx=0x7f8b5c02a660 comp rx=0 tx=0).stop 2024-09-11T22:19:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.416+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/271111135 shutdown_connections 2024-09-11T22:19:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.416+0000 7f8b6c7e8640 1 --2- 172.21.15.50:0/271111135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b640d11d0 0x7f8b640d1660 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.416+0000 7f8b6c7e8640 1 --2- 172.21.15.50:0/271111135 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b640cf790 0x7f8b640b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:05.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.416+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/271111135 >> 172.21.15.50:0/271111135 conn(0x7f8b640727a0 msgr2=0x7f8b640679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:05.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.416+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/271111135 shutdown_connections 2024-09-11T22:19:05.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.416+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/271111135 wait complete. 2024-09-11T22:19:05.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.417+0000 7f8b6c7e8640 1 Processor -- start 2024-09-11T22:19:05.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.417+0000 7f8b6c7e8640 1 -- start start 2024-09-11T22:19:05.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6c7e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cf790 0x7f8b640c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6c7e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b640d11d0 0x7f8b640cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6c7e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64161d30 0x7f8b641f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6c7e8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8b640d30e0 con 0x7f8b64161d30 2024-09-11T22:19:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6c7e8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8b640d2e00 con 0x7f8b640cf790 2024-09-11T22:19:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6c7e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8b640d38e0 con 0x7f8b640d11d0 2024-09-11T22:19:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6ad85640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64161d30 0x7f8b641f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6ad85640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64161d30 0x7f8b641f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42522/0 (socket says 172.21.15.50:42522) 2024-09-11T22:19:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6ad85640 1 -- 172.21.15.50:0/4152936253 learned_addr learned my addr 172.21.15.50:0/4152936253 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b69d83640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b640d11d0 0x7f8b640cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6a584640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cf790 0x7f8b640c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6ad85640 1 -- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b640d11d0 msgr2=0x7f8b640cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6ad85640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b640d11d0 0x7f8b640cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6ad85640 1 -- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cf790 msgr2=0x7f8b640c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6ad85640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cf790 0x7f8b640c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b6ad85640 1 -- 172.21.15.50:0/4152936253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b641f61d0 con 0x7f8b64161d30 2024-09-11T22:19:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.418+0000 7f8b69d83640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b640d11d0 0x7f8b640cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.419+0000 7f8b6ad85640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64161d30 0x7f8b641f57b0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009eb0 tx=0x7f8b5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.419+0000 7f8b5affd640 1 -- 172.21.15.50:0/4152936253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c040070 con 0x7f8b64161d30 2024-09-11T22:19:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.419+0000 7f8b5affd640 1 -- 172.21.15.50:0/4152936253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5c031bc0 con 0x7f8b64161d30 2024-09-11T22:19:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.419+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/4152936253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b640c86d0 con 0x7f8b64161d30 2024-09-11T22:19:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.419+0000 7f8b5affd640 1 -- 172.21.15.50:0/4152936253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c009450 con 0x7f8b64161d30 2024-09-11T22:19:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.419+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/4152936253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b640c8c90 con 0x7f8b64161d30 2024-09-11T22:19:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.420+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/4152936253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b640b78f0 con 0x7f8b64161d30 2024-09-11T22:19:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.420+0000 7f8b5affd640 1 -- 172.21.15.50:0/4152936253 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b5c039040 con 0x7f8b64161d30 2024-09-11T22:19:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.421+0000 7f8b5affd640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b4806be30 0x7f8b4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.421+0000 7f8b5affd640 1 -- 172.21.15.50:0/4152936253 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f8b5c0ac6f0 con 0x7f8b64161d30 2024-09-11T22:19:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.421+0000 7f8b6a584640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b4806be30 0x7f8b4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.421+0000 7f8b6a584640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b4806be30 0x7f8b4806e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8b60005880 tx=0x7f8b60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.425+0000 7f8b5affd640 1 -- 172.21.15.50:0/4152936253 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b5c07aa50 con 0x7f8b64161d30 2024-09-11T22:19:05.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:05.640+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/4152936253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8b640d2900 con 0x7f8b64161d30 2024-09-11T22:19:06.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.648+0000 7f8b5affd640 1 -- 172.21.15.50:0/4152936253 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v93) ==== 118+0+0 (secure 0 0 0) 0x7f8b5c07ed50 con 0x7f8b64161d30 2024-09-11T22:19:06.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.651+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b4806be30 msgr2=0x7f8b4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:06.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.651+0000 7f8b6c7e8640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b4806be30 0x7f8b4806e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8b60005880 tx=0x7f8b60009040 comp rx=0 tx=0).stop 2024-09-11T22:19:06.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.651+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/4152936253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64161d30 msgr2=0x7f8b641f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:06.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.651+0000 7f8b6c7e8640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64161d30 0x7f8b641f57b0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009eb0 tx=0x7f8b5c004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:06.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.651+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/4152936253 shutdown_connections 2024-09-11T22:19:06.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.651+0000 7f8b6c7e8640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b4806be30 0x7f8b4806e2f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:06.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.651+0000 7f8b6c7e8640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b640d11d0 0x7f8b640cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:06.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.651+0000 7f8b6c7e8640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64161d30 0x7f8b641f57b0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:06.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.651+0000 7f8b6c7e8640 1 --2- 172.21.15.50:0/4152936253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cf790 0x7f8b640c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:06.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.651+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/4152936253 >> 172.21.15.50:0/4152936253 conn(0x7f8b640727a0 msgr2=0x7f8b6415de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:06.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.651+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/4152936253 shutdown_connections 2024-09-11T22:19:06.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.651+0000 7f8b6c7e8640 1 -- 172.21.15.50:0/4152936253 wait complete. 2024-09-11T22:19:06.665 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:19:06.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:19:06.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.777+0000 7f7a09280640 1 Processor -- start 2024-09-11T22:19:06.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.777+0000 7f7a09280640 1 -- start start 2024-09-11T22:19:06.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.778+0000 7f7a09280640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a0415c770 0x7f7a040b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.778+0000 7f7a09280640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7a040b66e0 0x7f7a0415e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.778+0000 7f7a09280640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a0415cef0 con 0x7f7a040b5920 2024-09-11T22:19:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.778+0000 7f7a09280640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7a0415d1d0 con 0x7f7a0415c770 2024-09-11T22:19:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.778+0000 7f7a09280640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7a0415d4b0 con 0x7f7a040b66e0 2024-09-11T22:19:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.778+0000 7f7a02ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a0415c770 0x7f7a040b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.778+0000 7f7a02ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a0415c770 0x7f7a040b53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42530/0 (socket says 172.21.15.50:42530) 2024-09-11T22:19:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.778+0000 7f7a02ffd640 1 -- 172.21.15.50:0/2004963421 learned_addr learned my addr 172.21.15.50:0/2004963421 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.779+0000 7f7a037fe640 1 --2- 172.21.15.50:0/2004963421 >> v2:172.21.15.77:3300/0 conn(0x7f7a040b66e0 0x7f7a0415e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.779+0000 7f7a02ffd640 1 -- 172.21.15.50:0/2004963421 >> v2:172.21.15.77:3300/0 conn(0x7f7a040b66e0 msgr2=0x7f7a0415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.779+0000 7f7a02ffd640 1 --2- 172.21.15.50:0/2004963421 >> v2:172.21.15.77:3300/0 conn(0x7f7a040b66e0 0x7f7a0415e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.779+0000 7f7a02ffd640 1 -- 172.21.15.50:0/2004963421 >> v1:172.21.15.77:6789/0 conn(0x7f7a040b5920 legacy=0x7f7a040b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.779+0000 7f7a02ffd640 1 -- 172.21.15.50:0/2004963421 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0415d790 con 0x7f7a0415c770 2024-09-11T22:19:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.779+0000 7f7a02ffd640 1 --2- 172.21.15.50:0/2004963421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a0415c770 0x7f7a040b53e0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f7a04073180 tx=0x7f79f402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7025136863a7d0fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.780+0000 7f7a01ffb640 1 -- 172.21.15.50:0/2004963421 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f4036070 con 0x7f7a0415c770 2024-09-11T22:19:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.780+0000 7f7a01ffb640 1 -- 172.21.15.50:0/2004963421 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f4031600 con 0x7f7a0415c770 2024-09-11T22:19:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.780+0000 7f7a01ffb640 1 -- 172.21.15.50:0/2004963421 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f40319d0 con 0x7f7a0415c770 2024-09-11T22:19:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.780+0000 7f7a09280640 1 -- 172.21.15.50:0/2004963421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a0415c770 msgr2=0x7f7a040b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.780+0000 7f7a09280640 1 --2- 172.21.15.50:0/2004963421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a0415c770 0x7f7a040b53e0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f7a04073180 tx=0x7f79f402a6f0 comp rx=0 tx=0).stop 2024-09-11T22:19:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.780+0000 7f7a09280640 1 -- 172.21.15.50:0/2004963421 shutdown_connections 2024-09-11T22:19:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.780+0000 7f7a09280640 1 --2- 172.21.15.50:0/2004963421 >> v2:172.21.15.77:3300/0 conn(0x7f7a040b66e0 0x7f7a0415e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.780+0000 7f7a09280640 1 --2- 172.21.15.50:0/2004963421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a0415c770 0x7f7a040b53e0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.780+0000 7f7a09280640 1 -- 172.21.15.50:0/2004963421 >> 172.21.15.50:0/2004963421 conn(0x7f7a040b7940 msgr2=0x7f7a040b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.780+0000 7f7a09280640 1 -- 172.21.15.50:0/2004963421 shutdown_connections 2024-09-11T22:19:06.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.780+0000 7f7a09280640 1 -- 172.21.15.50:0/2004963421 wait complete. 2024-09-11T22:19:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.782+0000 7f7a09280640 1 Processor -- start 2024-09-11T22:19:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.782+0000 7f7a09280640 1 -- start start 2024-09-11T22:19:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.782+0000 7f7a09280640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a040b5920 0x7f7a0414c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.782+0000 7f7a09280640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7a040b66e0 0x7f7a040b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.782+0000 7f7a09280640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a0415c770 0x7f7a040b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.782+0000 7f7a09280640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0415ccd0 con 0x7f7a0415c770 2024-09-11T22:19:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.782+0000 7f7a09280640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0415cb50 con 0x7f7a040b5920 2024-09-11T22:19:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.782+0000 7f7a09280640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7a0415e590 con 0x7f7a040b66e0 2024-09-11T22:19:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.782+0000 7f7a037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a0415c770 0x7f7a040b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.782+0000 7f7a037fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a0415c770 0x7f7a040b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42540/0 (socket says 172.21.15.50:42540) 2024-09-11T22:19:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.782+0000 7f7a037fe640 1 -- 172.21.15.50:0/863938055 learned_addr learned my addr 172.21.15.50:0/863938055 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f7a02ffd640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a040b5920 0x7f7a0414c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f7a027fc640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7a040b66e0 0x7f7a040b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f7a037fe640 1 -- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7a040b66e0 msgr2=0x7f7a040b2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f7a037fe640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7a040b66e0 0x7f7a040b2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f7a037fe640 1 -- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a040b5920 msgr2=0x7f7a0414c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f7a037fe640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a040b5920 0x7f7a0414c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f7a037fe640 1 -- 172.21.15.50:0/863938055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0406cc90 con 0x7f7a0415c770 2024-09-11T22:19:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f7a027fc640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7a040b66e0 0x7f7a040b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f7a037fe640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a0415c770 0x7f7a040b3180 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00d600 tx=0x7f79fc00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f79fb7fe640 1 -- 172.21.15.50:0/863938055 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0125f0 con 0x7f7a0415c770 2024-09-11T22:19:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f79fb7fe640 1 -- 172.21.15.50:0/863938055 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc019070 con 0x7f7a0415c770 2024-09-11T22:19:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f79fb7fe640 1 -- 172.21.15.50:0/863938055 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0129d0 con 0x7f7a0415c770 2024-09-11T22:19:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f7a09280640 1 -- 172.21.15.50:0/863938055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a0406cf70 con 0x7f7a0415c770 2024-09-11T22:19:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.783+0000 7f7a09280640 1 -- 172.21.15.50:0/863938055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a0406d530 con 0x7f7a0415c770 2024-09-11T22:19:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.784+0000 7f7a09280640 1 -- 172.21.15.50:0/863938055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a0415e050 con 0x7f7a0415c770 2024-09-11T22:19:06.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.785+0000 7f79fb7fe640 1 -- 172.21.15.50:0/863938055 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79fc012b70 con 0x7f7a0415c770 2024-09-11T22:19:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.785+0000 7f79fb7fe640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79e406be30 0x7f79e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.785+0000 7f79fb7fe640 1 -- 172.21.15.50:0/863938055 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f79fc08b2d0 con 0x7f7a0415c770 2024-09-11T22:19:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.785+0000 7f7a02ffd640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79e406be30 0x7f79e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.786+0000 7f7a02ffd640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79e406be30 0x7f79e406e2f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f79f4033000 tx=0x7f79f4009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:06.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:06.790+0000 7f79fb7fe640 1 -- 172.21.15.50:0/863938055 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79fc059c80 con 0x7f7a0415c770 2024-09-11T22:19:07.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.000+0000 7f7a09280640 1 -- 172.21.15.50:0/863938055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7a040b4ca0 con 0x7f7a0415c770 2024-09-11T22:19:07.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-11T22:19:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.656+0000 7f79fb7fe640 1 -- 172.21.15.50:0/863938055 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v94) ==== 122+0+0 (secure 0 0 0) 0x7f79fc059580 con 0x7f7a0415c770 2024-09-11T22:19:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.659+0000 7f7a09280640 1 -- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79e406be30 msgr2=0x7f79e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.659+0000 7f7a09280640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79e406be30 0x7f79e406e2f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f79f4033000 tx=0x7f79f4009000 comp rx=0 tx=0).stop 2024-09-11T22:19:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.659+0000 7f7a09280640 1 -- 172.21.15.50:0/863938055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a0415c770 msgr2=0x7f7a040b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.659+0000 7f7a09280640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a0415c770 0x7f7a040b3180 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00d600 tx=0x7f79fc00dac0 comp rx=0 tx=0).stop 2024-09-11T22:19:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.659+0000 7f7a09280640 1 -- 172.21.15.50:0/863938055 shutdown_connections 2024-09-11T22:19:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.659+0000 7f7a09280640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79e406be30 0x7f79e406e2f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.659+0000 7f7a09280640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7a040b66e0 0x7f7a040b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.659+0000 7f7a09280640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a0415c770 0x7f7a040b3180 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.659+0000 7f7a09280640 1 --2- 172.21.15.50:0/863938055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a040b5920 0x7f7a0414c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.659+0000 7f7a09280640 1 -- 172.21.15.50:0/863938055 >> 172.21.15.50:0/863938055 conn(0x7f7a040b7940 msgr2=0x7f7a04070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.659+0000 7f7a09280640 1 -- 172.21.15.50:0/863938055 shutdown_connections 2024-09-11T22:19:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.659+0000 7f7a09280640 1 -- 172.21.15.50:0/863938055 wait complete. 2024-09-11T22:19:07.673 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:19:07.673 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:07.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.781+0000 7fd2e016d640 1 Processor -- start 2024-09-11T22:19:07.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.782+0000 7fd2e016d640 1 -- start start 2024-09-11T22:19:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.782+0000 7fd2e016d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d806d780 0x7fd2d8072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.782+0000 7fd2e016d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d80b5020 con 0x7fd2d815aad0 2024-09-11T22:19:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.782+0000 7fd2e016d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d815aeb0 con 0x7fd2d815bb00 2024-09-11T22:19:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.782+0000 7fd2e016d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d80714d0 con 0x7fd2d806d780 2024-09-11T22:19:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2ddf09640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd2d815aad0 0x7fd2d806d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36406/0 (socket says 172.21.15.50:36406) 2024-09-11T22:19:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2ddf09640 1 -- 172.21.15.50:0/1057811573 learned_addr learned my addr 172.21.15.50:0/1057811573 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dd708640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d806d780 0x7fd2d8072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944282075 0 0) 0x7fd2d80b5020 con 0x7fd2d815aad0 2024-09-11T22:19:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2c0003440 con 0x7fd2d815aad0 2024-09-11T22:19:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459348047 0 0) 0x7fd2d815aeb0 con 0x7fd2d815bb00 2024-09-11T22:19:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2d80b5020 con 0x7fd2d815bb00 2024-09-11T22:19:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1601961664 0 0) 0x7fd2c0003440 con 0x7fd2d815aad0 2024-09-11T22:19:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d806d780 msgr2=0x7fd2d8072cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d806d780 0x7fd2d8072cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 >> v1:172.21.15.77:6789/0 conn(0x7fd2d815bb00 legacy=0x7fd2d80b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d80717b0 con 0x7fd2d815aad0 2024-09-11T22:19:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fd2c80019f0 con 0x7fd2d815aad0 2024-09-11T22:19:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 >> v1:172.21.15.50:6789/0 conn(0x7fd2d815aad0 legacy=0x7fd2d806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c0003c60 0x7fd2c0008850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c0004140 0x7fd2c000ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c000b490 0x7fd2c000d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d80714d0 con 0x7fd2c0003c60 2024-09-11T22:19:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c000e1b0 con 0x7fd2c0004140 2024-09-11T22:19:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c000e3b0 con 0x7fd2c000b490 2024-09-11T22:19:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2dd708640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d806d780 0x7fd2d8072cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2ddf09640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c0003c60 0x7fd2c0008850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.783+0000 7fd2de70a640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c000b490 0x7fd2c000d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.784+0000 7fd2dd708640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c0004140 0x7fd2c000ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.784+0000 7fd2ddf09640 1 -- 172.21.15.50:0/1057811573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c000b490 msgr2=0x7fd2c000d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.784+0000 7fd2ddf09640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c000b490 0x7fd2c000d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.784+0000 7fd2ddf09640 1 -- 172.21.15.50:0/1057811573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c0004140 msgr2=0x7fd2c000ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.784+0000 7fd2ddf09640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c0004140 0x7fd2c000ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.784+0000 7fd2ddf09640 1 -- 172.21.15.50:0/1057811573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c0003440 con 0x7fd2c0003c60 2024-09-11T22:19:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.784+0000 7fd2dd708640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2c0004140 0x7fd2c000ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.784+0000 7fd2ddf09640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c0003c60 0x7fd2c0008850 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800a810 tx=0x7fd2c0003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6517f68e7f23ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.785+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c800a430 con 0x7fd2c0003c60 2024-09-11T22:19:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.785+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c802f070 con 0x7fd2c0003c60 2024-09-11T22:19:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.785+0000 7fd2dcf07640 1 -- 172.21.15.50:0/1057811573 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c802bc70 con 0x7fd2c0003c60 2024-09-11T22:19:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.785+0000 7fd2e016d640 1 -- 172.21.15.50:0/1057811573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c0003c60 msgr2=0x7fd2c0008850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.785+0000 7fd2e016d640 1 --2- 172.21.15.50:0/1057811573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2c0003c60 0x7fd2c0008850 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800a810 tx=0x7fd2c0003730 comp rx=0 tx=0).stop 2024-09-11T22:19:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.785+0000 7fd2de70a640 1 -- 172.21.15.50:0/1057811573 reap_dead start 2024-09-11T22:19:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.785+0000 7fd2e016d640 1 -- 172.21.15.50:0/1057811573 shutdown_connections 2024-09-11T22:19:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.785+0000 7fd2e016d640 1 -- 172.21.15.50:0/1057811573 >> 172.21.15.50:0/1057811573 conn(0x7fd2d80679c0 msgr2=0x7fd2d8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.785+0000 7fd2e016d640 1 -- 172.21.15.50:0/1057811573 shutdown_connections 2024-09-11T22:19:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.785+0000 7fd2e016d640 1 -- 172.21.15.50:0/1057811573 wait complete. 2024-09-11T22:19:07.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.786+0000 7fd2e016d640 1 Processor -- start 2024-09-11T22:19:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.786+0000 7fd2e016d640 1 -- start start 2024-09-11T22:19:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.787+0000 7fd2e016d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c0003c60 0x7fd2d80aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.787+0000 7fd2e016d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d80ab080 0x7fd2d8155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.787+0000 7fd2e016d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d81f3650 0x7fd2d81f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.787+0000 7fd2e016d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d8072290 con 0x7fd2d80ab080 2024-09-11T22:19:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.787+0000 7fd2e016d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d8071d70 con 0x7fd2d81f3650 2024-09-11T22:19:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.787+0000 7fd2e016d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d815bf40 con 0x7fd2c0003c60 2024-09-11T22:19:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.787+0000 7fd2dd708640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d80ab080 0x7fd2d8155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.787+0000 7fd2dd708640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d80ab080 0x7fd2d8155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56694/0 (socket says 172.21.15.50:56694) 2024-09-11T22:19:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.787+0000 7fd2dd708640 1 -- 172.21.15.50:0/4042093992 learned_addr learned my addr 172.21.15.50:0/4042093992 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.787+0000 7fd2de70a640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d81f3650 0x7fd2d81f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.787+0000 7fd2ddf09640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c0003c60 0x7fd2d80aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.788+0000 7fd2dd708640 1 -- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c0003c60 msgr2=0x7fd2d80aa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.788+0000 7fd2dd708640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c0003c60 0x7fd2d80aa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.788+0000 7fd2dd708640 1 -- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d81f3650 msgr2=0x7fd2d81f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.788+0000 7fd2dd708640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d81f3650 0x7fd2d81f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.788+0000 7fd2dd708640 1 -- 172.21.15.50:0/4042093992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d80c8780 con 0x7fd2d80ab080 2024-09-11T22:19:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.788+0000 7fd2dd708640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d80ab080 0x7fd2d8155e60 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0116a0 tx=0x7fd2cc011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.788+0000 7fd2d67fc640 1 -- 172.21.15.50:0/4042093992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc00f9c0 con 0x7fd2d80ab080 2024-09-11T22:19:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.788+0000 7fd2d67fc640 1 -- 172.21.15.50:0/4042093992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2cc00fb60 con 0x7fd2d80ab080 2024-09-11T22:19:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.788+0000 7fd2e016d640 1 -- 172.21.15.50:0/4042093992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d80c8a60 con 0x7fd2d80ab080 2024-09-11T22:19:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.788+0000 7fd2d67fc640 1 -- 172.21.15.50:0/4042093992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc015460 con 0x7fd2d80ab080 2024-09-11T22:19:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.788+0000 7fd2e016d640 1 -- 172.21.15.50:0/4042093992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d80c9020 con 0x7fd2d80ab080 2024-09-11T22:19:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.789+0000 7fd2e016d640 1 -- 172.21.15.50:0/4042093992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d80cea30 con 0x7fd2d80ab080 2024-09-11T22:19:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.790+0000 7fd2d67fc640 1 -- 172.21.15.50:0/4042093992 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2cc015600 con 0x7fd2d80ab080 2024-09-11T22:19:07.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.790+0000 7fd2d67fc640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2c406be60 0x7fd2c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:07.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.790+0000 7fd2d67fc640 1 -- 172.21.15.50:0/4042093992 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fd2cc08b3f0 con 0x7fd2d80ab080 2024-09-11T22:19:07.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.790+0000 7fd2ddf09640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2c406be60 0x7fd2c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:07.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.791+0000 7fd2ddf09640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2c406be60 0x7fd2c406e320 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8033000 tx=0x7fd2c8007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:07.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:07.795+0000 7fd2d67fc640 1 -- 172.21.15.50:0/4042093992 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2cc019030 con 0x7fd2d80ab080 2024-09-11T22:19:08.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.005+0000 7fd2e016d640 1 -- 172.21.15.50:0/4042093992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2d806a050 con 0x7fd2d80ab080 2024-09-11T22:19:08.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.006+0000 7fd2d67fc640 1 -- 172.21.15.50:0/4042093992 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7fd2cc059750 con 0x7fd2d80ab080 2024-09-11T22:19:08.006 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:08.007 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:08.007 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:08.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.008+0000 7fd2e016d640 1 -- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2c406be60 msgr2=0x7fd2c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.008+0000 7fd2e016d640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2c406be60 0x7fd2c406e320 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8033000 tx=0x7fd2c8007000 comp rx=0 tx=0).stop 2024-09-11T22:19:08.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.008+0000 7fd2e016d640 1 -- 172.21.15.50:0/4042093992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d80ab080 msgr2=0x7fd2d8155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.008+0000 7fd2e016d640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d80ab080 0x7fd2d8155e60 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0116a0 tx=0x7fd2cc011b60 comp rx=0 tx=0).stop 2024-09-11T22:19:08.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.008+0000 7fd2e016d640 1 -- 172.21.15.50:0/4042093992 shutdown_connections 2024-09-11T22:19:08.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.008+0000 7fd2e016d640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2c406be60 0x7fd2c406e320 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.008+0000 7fd2e016d640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d81f3650 0x7fd2d81f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.008+0000 7fd2e016d640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d80ab080 0x7fd2d8155e60 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.008+0000 7fd2e016d640 1 --2- 172.21.15.50:0/4042093992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2c0003c60 0x7fd2d80aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.008+0000 7fd2e016d640 1 -- 172.21.15.50:0/4042093992 >> 172.21.15.50:0/4042093992 conn(0x7fd2d80679c0 msgr2=0x7fd2d80b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:08.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.008+0000 7fd2e016d640 1 -- 172.21.15.50:0/4042093992 shutdown_connections 2024-09-11T22:19:08.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.008+0000 7fd2e016d640 1 -- 172.21.15.50:0/4042093992 wait complete. 2024-09-11T22:19:08.019 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:19:08.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.122+0000 7f7c762ba640 1 Processor -- start 2024-09-11T22:19:08.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.122+0000 7f7c762ba640 1 -- start start 2024-09-11T22:19:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c762ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c700d1c90 0x7f7c700b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c762ba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c70163080 con 0x7f7c70162350 2024-09-11T22:19:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c762ba640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c700d2d20 con 0x7f7c7015e8e0 2024-09-11T22:19:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c762ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c7015ecc0 con 0x7f7c700d1c90 2024-09-11T22:19:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c74857640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7c70162350 0x7f7c701627e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36420/0 (socket says 172.21.15.50:36420) 2024-09-11T22:19:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c74857640 1 -- 172.21.15.50:0/1815619359 learned_addr learned my addr 172.21.15.50:0/1815619359 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c6f7fe640 1 --2- 172.21.15.50:0/1815619359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c700d1c90 0x7f7c700b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4041782390 0 0) 0x7f7c70163080 con 0x7f7c70162350 2024-09-11T22:19:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c58003520 con 0x7f7c70162350 2024-09-11T22:19:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4217604406 0 0) 0x7f7c58003520 con 0x7f7c70162350 2024-09-11T22:19:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c700d1c90 msgr2=0x7f7c700b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c6effd640 1 --2- 172.21.15.50:0/1815619359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c700d1c90 0x7f7c700b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 >> v1:172.21.15.77:6789/0 conn(0x7f7c7015e8e0 legacy=0x7f7c700d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c700d3000 con 0x7f7c70162350 2024-09-11T22:19:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.123+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f7c680019f0 con 0x7f7c70162350 2024-09-11T22:19:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 >> v1:172.21.15.50:6789/0 conn(0x7f7c70162350 legacy=0x7f7c701627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6effd640 1 --2- 172.21.15.50:0/1815619359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c700d1c90 0x7f7c580039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6effd640 1 --2- 172.21.15.50:0/1815619359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c58003f60 0x7f7c58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6effd640 1 --2- 172.21.15.50:0/1815619359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c58004d40 0x7f7c580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5800bb00 con 0x7f7c58003f60 2024-09-11T22:19:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5800bcb0 con 0x7f7c58004d40 2024-09-11T22:19:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c5800beb0 con 0x7f7c700d1c90 2024-09-11T22:19:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6f7fe640 1 --2- 172.21.15.50:0/1815619359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c58003f60 0x7f7c58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6ffff640 1 --2- 172.21.15.50:0/1815619359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c700d1c90 0x7f7c580039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c74857640 1 --2- 172.21.15.50:0/1815619359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c58004d40 0x7f7c580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6f7fe640 1 -- 172.21.15.50:0/1815619359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c700d1c90 msgr2=0x7f7c580039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6f7fe640 1 --2- 172.21.15.50:0/1815619359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c700d1c90 0x7f7c580039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6f7fe640 1 -- 172.21.15.50:0/1815619359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c58004d40 msgr2=0x7f7c580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6f7fe640 1 --2- 172.21.15.50:0/1815619359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c58004d40 0x7f7c580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.124+0000 7f7c6f7fe640 1 -- 172.21.15.50:0/1815619359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c58003520 con 0x7f7c58003f60 2024-09-11T22:19:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.125+0000 7f7c6f7fe640 1 --2- 172.21.15.50:0/1815619359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c58003f60 0x7f7c58004800 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f7c701622b0 tx=0x7f7c58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ac97b4d38688d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.125+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64036070 con 0x7f7c58003f60 2024-09-11T22:19:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.125+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c64031400 con 0x7f7c58003f60 2024-09-11T22:19:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.125+0000 7f7c6effd640 1 -- 172.21.15.50:0/1815619359 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64009690 con 0x7f7c58003f60 2024-09-11T22:19:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.125+0000 7f7c762ba640 1 -- 172.21.15.50:0/1815619359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c58003f60 msgr2=0x7f7c58004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.125+0000 7f7c762ba640 1 --2- 172.21.15.50:0/1815619359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c58003f60 0x7f7c58004800 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f7c701622b0 tx=0x7f7c58005830 comp rx=0 tx=0).stop 2024-09-11T22:19:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.125+0000 7f7c74857640 1 -- 172.21.15.50:0/1815619359 reap_dead start 2024-09-11T22:19:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.125+0000 7f7c762ba640 1 -- 172.21.15.50:0/1815619359 shutdown_connections 2024-09-11T22:19:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.125+0000 7f7c762ba640 1 -- 172.21.15.50:0/1815619359 >> 172.21.15.50:0/1815619359 conn(0x7f7c70067ba0 msgr2=0x7f7c70067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.125+0000 7f7c762ba640 1 -- 172.21.15.50:0/1815619359 shutdown_connections 2024-09-11T22:19:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.125+0000 7f7c762ba640 1 -- 172.21.15.50:0/1815619359 wait complete. 2024-09-11T22:19:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.127+0000 7f7c762ba640 1 Processor -- start 2024-09-11T22:19:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.127+0000 7f7c762ba640 1 -- start start 2024-09-11T22:19:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.127+0000 7f7c762ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c58003f60 0x7f7c70157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.127+0000 7f7c762ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c70159dc0 0x7f7c70160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.127+0000 7f7c762ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015a240 0x7f7c700ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c762ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c700b7c10 con 0x7f7c7015a240 2024-09-11T22:19:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c762ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c700b7a90 con 0x7f7c70159dc0 2024-09-11T22:19:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c762ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c700d2ad0 con 0x7f7c58003f60 2024-09-11T22:19:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c74857640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015a240 0x7f7c700ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c74857640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015a240 0x7f7c700ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56720/0 (socket says 172.21.15.50:56720) 2024-09-11T22:19:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c74857640 1 -- 172.21.15.50:0/3068917687 learned_addr learned my addr 172.21.15.50:0/3068917687 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c6ffff640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c58003f60 0x7f7c70157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c6f7fe640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c70159dc0 0x7f7c70160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c74857640 1 -- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c58003f60 msgr2=0x7f7c70157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c74857640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c58003f60 0x7f7c70157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c74857640 1 -- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c70159dc0 msgr2=0x7f7c70160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c74857640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c70159dc0 0x7f7c70160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c74857640 1 -- 172.21.15.50:0/3068917687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c700cbd30 con 0x7f7c7015a240 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c6f7fe640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c70159dc0 0x7f7c70160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c6ffff640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c58003f60 0x7f7c70157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c74857640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015a240 0x7f7c700ce1b0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f7c700d0ff0 tx=0x7f7c68007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c6cff9640 1 -- 172.21.15.50:0/3068917687 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800ab60 con 0x7f7c7015a240 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c6cff9640 1 -- 172.21.15.50:0/3068917687 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c68018070 con 0x7f7c7015a240 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c762ba640 1 -- 172.21.15.50:0/3068917687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c700cc010 con 0x7f7c7015a240 2024-09-11T22:19:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c6cff9640 1 -- 172.21.15.50:0/3068917687 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c680133f0 con 0x7f7c7015a240 2024-09-11T22:19:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.128+0000 7f7c762ba640 1 -- 172.21.15.50:0/3068917687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c7015ff40 con 0x7f7c7015a240 2024-09-11T22:19:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.129+0000 7f7c762ba640 1 -- 172.21.15.50:0/3068917687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c700d1580 con 0x7f7c7015a240 2024-09-11T22:19:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.130+0000 7f7c6cff9640 1 -- 172.21.15.50:0/3068917687 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c68013590 con 0x7f7c7015a240 2024-09-11T22:19:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.130+0000 7f7c6cff9640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c5c06be60 0x7f7c5c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.130+0000 7f7c6cff9640 1 -- 172.21.15.50:0/3068917687 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f7c6808b460 con 0x7f7c7015a240 2024-09-11T22:19:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.130+0000 7f7c6ffff640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c5c06be60 0x7f7c5c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.131+0000 7f7c6ffff640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c5c06be60 0x7f7c5c06e320 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7c600036b0 tx=0x7f7c60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.135+0000 7f7c6cff9640 1 -- 172.21.15.50:0/3068917687 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c68059720 con 0x7f7c7015a240 2024-09-11T22:19:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.310+0000 7f7c762ba640 1 -- 172.21.15.50:0/3068917687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c700ba770 con 0x7f7c7015a240 2024-09-11T22:19:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.311+0000 7f7c6cff9640 1 -- 172.21.15.50:0/3068917687 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+16703 (secure 0 0 0) 0x7f7c6805da20 con 0x7f7c7015a240 2024-09-11T22:19:08.312 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:08.312 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":132,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:19:05.582808+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:19:02.578071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-11T22:19:02.977390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:19:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.313+0000 7f7c762ba640 1 -- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c5c06be60 msgr2=0x7f7c5c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.313+0000 7f7c762ba640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c5c06be60 0x7f7c5c06e320 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7c600036b0 tx=0x7f7c60009040 comp rx=0 tx=0).stop 2024-09-11T22:19:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.313+0000 7f7c762ba640 1 -- 172.21.15.50:0/3068917687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015a240 msgr2=0x7f7c700ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.313+0000 7f7c762ba640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015a240 0x7f7c700ce1b0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f7c700d0ff0 tx=0x7f7c68007a90 comp rx=0 tx=0).stop 2024-09-11T22:19:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.313+0000 7f7c762ba640 1 -- 172.21.15.50:0/3068917687 shutdown_connections 2024-09-11T22:19:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.313+0000 7f7c762ba640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c5c06be60 0x7f7c5c06e320 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.313+0000 7f7c762ba640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015a240 0x7f7c700ce1b0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.313+0000 7f7c762ba640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c70159dc0 0x7f7c70160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.313+0000 7f7c762ba640 1 --2- 172.21.15.50:0/3068917687 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c58003f60 0x7f7c70157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.313+0000 7f7c762ba640 1 -- 172.21.15.50:0/3068917687 >> 172.21.15.50:0/3068917687 conn(0x7f7c70067ba0 msgr2=0x7f7c700b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.313+0000 7f7c762ba640 1 -- 172.21.15.50:0/3068917687 shutdown_connections 2024-09-11T22:19:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.313+0000 7f7c762ba640 1 -- 172.21.15.50:0/3068917687 wait complete. 2024-09-11T22:19:08.325 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:19:08.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:19:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.426+0000 7fa63cac9640 1 Processor -- start 2024-09-11T22:19:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.426+0000 7fa63cac9640 1 -- start start 2024-09-11T22:19:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.426+0000 7fa63cac9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa63815e8e0 0x7fa6380b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.427+0000 7fa63cac9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa638162350 0x7fa6381627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.427+0000 7fa63cac9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa638163080 con 0x7fa6380d1580 2024-09-11T22:19:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.427+0000 7fa63cac9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa63815ecc0 con 0x7fa63815e8e0 2024-09-11T22:19:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.427+0000 7fa63cac9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa6380d2ad0 con 0x7fa638162350 2024-09-11T22:19:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.427+0000 7fa63659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa63815e8e0 0x7fa6380b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.427+0000 7fa63659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa63815e8e0 0x7fa6380b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56728/0 (socket says 172.21.15.50:56728) 2024-09-11T22:19:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.427+0000 7fa63659c640 1 -- 172.21.15.50:0/1176722049 learned_addr learned my addr 172.21.15.50:0/1176722049 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.427+0000 7fa636d9d640 1 --2- 172.21.15.50:0/1176722049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa638162350 0x7fa6381627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.427+0000 7fa63659c640 1 -- 172.21.15.50:0/1176722049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa638162350 msgr2=0x7fa6381627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.427+0000 7fa63659c640 1 --2- 172.21.15.50:0/1176722049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa638162350 0x7fa6381627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.427+0000 7fa63659c640 1 -- 172.21.15.50:0/1176722049 >> v1:172.21.15.77:6789/0 conn(0x7fa6380d1580 legacy=0x7fa6380d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.427+0000 7fa63659c640 1 -- 172.21.15.50:0/1176722049 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6380d2d20 con 0x7fa63815e8e0 2024-09-11T22:19:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.428+0000 7fa63659c640 1 --2- 172.21.15.50:0/1176722049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa63815e8e0 0x7fa6380b7880 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fa628009870 tx=0x7fa62802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d905238adcafd647 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.428+0000 7fa63559a640 1 -- 172.21.15.50:0/1176722049 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa628037070 con 0x7fa63815e8e0 2024-09-11T22:19:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.428+0000 7fa63559a640 1 -- 172.21.15.50:0/1176722049 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa628032440 con 0x7fa63815e8e0 2024-09-11T22:19:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.428+0000 7fa63559a640 1 -- 172.21.15.50:0/1176722049 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa628032810 con 0x7fa63815e8e0 2024-09-11T22:19:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.428+0000 7fa63cac9640 1 -- 172.21.15.50:0/1176722049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa63815e8e0 msgr2=0x7fa6380b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.428+0000 7fa63cac9640 1 --2- 172.21.15.50:0/1176722049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa63815e8e0 0x7fa6380b7880 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fa628009870 tx=0x7fa62802a2a0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.429+0000 7fa63cac9640 1 -- 172.21.15.50:0/1176722049 shutdown_connections 2024-09-11T22:19:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.429+0000 7fa63cac9640 1 --2- 172.21.15.50:0/1176722049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa638162350 0x7fa6381627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.429+0000 7fa63cac9640 1 --2- 172.21.15.50:0/1176722049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa63815e8e0 0x7fa6380b7880 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.429+0000 7fa63cac9640 1 -- 172.21.15.50:0/1176722049 >> 172.21.15.50:0/1176722049 conn(0x7fa638067ba0 msgr2=0x7fa638067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:08.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.429+0000 7fa63cac9640 1 -- 172.21.15.50:0/1176722049 shutdown_connections 2024-09-11T22:19:08.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.429+0000 7fa63cac9640 1 -- 172.21.15.50:0/1176722049 wait complete. 2024-09-11T22:19:08.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.430+0000 7fa63cac9640 1 Processor -- start 2024-09-11T22:19:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.430+0000 7fa63cac9640 1 -- start start 2024-09-11T22:19:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa63cac9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6380d1580 0x7fa6380b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa63cac9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa63815e8e0 0x7fa638158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa63cac9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa638162350 0x7fa6380cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa63cac9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa638162d20 con 0x7fa63815e8e0 2024-09-11T22:19:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa63cac9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6380d3370 con 0x7fa6380d1580 2024-09-11T22:19:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa63cac9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa6380d3800 con 0x7fa638162350 2024-09-11T22:19:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa635d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa63815e8e0 0x7fa638158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa635d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa63815e8e0 0x7fa638158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56740/0 (socket says 172.21.15.50:56740) 2024-09-11T22:19:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa635d9b640 1 -- 172.21.15.50:0/1410866982 learned_addr learned my addr 172.21.15.50:0/1410866982 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa63659c640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6380d1580 0x7fa6380b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa636d9d640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa638162350 0x7fa6380cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa635d9b640 1 -- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa638162350 msgr2=0x7fa6380cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa635d9b640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa638162350 0x7fa6380cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa635d9b640 1 -- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6380d1580 msgr2=0x7fa6380b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa635d9b640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6380d1580 0x7fa6380b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa635d9b640 1 -- 172.21.15.50:0/1410866982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6380ce4f0 con 0x7fa63815e8e0 2024-09-11T22:19:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa635d9b640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa63815e8e0 0x7fa638158600 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00c430 tx=0x7fa62c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa626ffd640 1 -- 172.21.15.50:0/1410866982 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62c011790 con 0x7fa63815e8e0 2024-09-11T22:19:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa626ffd640 1 -- 172.21.15.50:0/1410866982 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa62c017070 con 0x7fa63815e8e0 2024-09-11T22:19:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa63cac9640 1 -- 172.21.15.50:0/1410866982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6380ce790 con 0x7fa63815e8e0 2024-09-11T22:19:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.431+0000 7fa626ffd640 1 -- 172.21.15.50:0/1410866982 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62c011bb0 con 0x7fa63815e8e0 2024-09-11T22:19:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.432+0000 7fa63cac9640 1 -- 172.21.15.50:0/1410866982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa638156a80 con 0x7fa63815e8e0 2024-09-11T22:19:08.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.433+0000 7fa63cac9640 1 -- 172.21.15.50:0/1410866982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6380b7880 con 0x7fa63815e8e0 2024-09-11T22:19:08.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.433+0000 7fa626ffd640 1 -- 172.21.15.50:0/1410866982 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa62c01c460 con 0x7fa63815e8e0 2024-09-11T22:19:08.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.433+0000 7fa626ffd640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa61806be30 0x7fa61806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.434+0000 7fa626ffd640 1 -- 172.21.15.50:0/1410866982 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fa62c08ab50 con 0x7fa63815e8e0 2024-09-11T22:19:08.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.434+0000 7fa63659c640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa61806be30 0x7fa61806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.434+0000 7fa63659c640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa61806be30 0x7fa61806e2f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa628034000 tx=0x7fa62802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:08.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.438+0000 7fa626ffd640 1 -- 172.21.15.50:0/1410866982 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa62c058f40 con 0x7fa63815e8e0 2024-09-11T22:19:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.610+0000 7fa63cac9640 1 -- 172.21.15.50:0/1410866982 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa638158b40 con 0x7fa61806be30 2024-09-11T22:19:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.617+0000 7fa626ffd640 1 -- 172.21.15.50:0/1410866982 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248857 (secure 0 0 0) 0x7fa638158b40 con 0x7fa61806be30 2024-09-11T22:19:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:08.622 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:19:08.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.620+0000 7fa63cac9640 1 -- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa61806be30 msgr2=0x7fa61806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.620+0000 7fa63cac9640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa61806be30 0x7fa61806e2f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa628034000 tx=0x7fa62802e000 comp rx=0 tx=0).stop 2024-09-11T22:19:08.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.620+0000 7fa63cac9640 1 -- 172.21.15.50:0/1410866982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa63815e8e0 msgr2=0x7fa638158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.620+0000 7fa63cac9640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa63815e8e0 0x7fa638158600 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00c430 tx=0x7fa62c00c8f0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.620+0000 7fa63cac9640 1 -- 172.21.15.50:0/1410866982 shutdown_connections 2024-09-11T22:19:08.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.620+0000 7fa63cac9640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa61806be30 0x7fa61806e2f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.620+0000 7fa63cac9640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa638162350 0x7fa6380cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.620+0000 7fa63cac9640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa63815e8e0 0x7fa638158600 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.620+0000 7fa63cac9640 1 --2- 172.21.15.50:0/1410866982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6380d1580 0x7fa6380b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.620+0000 7fa63cac9640 1 -- 172.21.15.50:0/1410866982 >> 172.21.15.50:0/1410866982 conn(0x7fa638067ba0 msgr2=0x7fa638067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:08.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.620+0000 7fa63cac9640 1 -- 172.21.15.50:0/1410866982 shutdown_connections 2024-09-11T22:19:08.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.620+0000 7fa63cac9640 1 -- 172.21.15.50:0/1410866982 wait complete. 2024-09-11T22:19:08.632 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2024-09-11T22:19:07.479437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":418812,"kb_used_data":13824,"kb_used_omap":12,"kb_used_meta":404787,"kb_avail":754555908,"statfs":{"total":773094113280,"available":772665249792,"internally_reserved":0,"allocated":14155776,"data_stored":6839921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":414502449},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.841792"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221490+0000","last_change":"2024-09-11T22:19:04.601864+0000","last_active":"2024-09-11T22:19:06.221490+0000","last_peered":"2024-09-11T22:19:06.221490+0000","last_clean":"2024-09-11T22:19:06.221490+0000","last_became_active":"2024-09-11T22:19:04.601567+0000","last_became_peered":"2024-09-11T22:19:04.601567+0000","last_unstale":"2024-09-11T22:19:06.221490+0000","last_undegraded":"2024-09-11T22:19:06.221490+0000","last_fullsized":"2024-09-11T22:19:06.221490+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:37.691839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646967+0000","last_change":"2024-09-11T22:19:03.646967+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646967+0000","last_undegraded":"2024-09-11T22:19:03.646967+0000","last_fullsized":"2024-09-11T22:19:03.646967+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646915+0000","last_change":"2024-09-11T22:19:03.646915+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646915+0000","last_undegraded":"2024-09-11T22:19:03.646915+0000","last_fullsized":"2024-09-11T22:19:03.646915+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220838+0000","last_change":"2024-09-11T22:19:04.601956+0000","last_active":"2024-09-11T22:19:06.220838+0000","last_peered":"2024-09-11T22:19:06.220838+0000","last_clean":"2024-09-11T22:19:06.220838+0000","last_became_active":"2024-09-11T22:19:04.601249+0000","last_became_peered":"2024-09-11T22:19:04.601249+0000","last_unstale":"2024-09-11T22:19:06.220838+0000","last_undegraded":"2024-09-11T22:19:06.220838+0000","last_fullsized":"2024-09-11T22:19:06.220838+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:37.836260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220888+0000","last_change":"2024-09-11T22:19:04.600564+0000","last_active":"2024-09-11T22:19:06.220888+0000","last_peered":"2024-09-11T22:19:06.220888+0000","last_clean":"2024-09-11T22:19:06.220888+0000","last_became_active":"2024-09-11T22:19:04.600260+0000","last_became_peered":"2024-09-11T22:19:04.600260+0000","last_unstale":"2024-09-11T22:19:06.220888+0000","last_undegraded":"2024-09-11T22:19:06.220888+0000","last_fullsized":"2024-09-11T22:19:06.220888+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:28.037951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645647+0000","last_change":"2024-09-11T22:19:03.645647+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645647+0000","last_undegraded":"2024-09-11T22:19:03.645647+0000","last_fullsized":"2024-09-11T22:19:03.645647+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646415+0000","last_change":"2024-09-11T22:19:03.646415+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646415+0000","last_undegraded":"2024-09-11T22:19:03.646415+0000","last_fullsized":"2024-09-11T22:19:03.646415+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.648115+0000","last_change":"2024-09-11T22:19:03.648115+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.648115+0000","last_undegraded":"2024-09-11T22:19:03.648115+0000","last_fullsized":"2024-09-11T22:19:03.648115+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647765+0000","last_change":"2024-09-11T22:19:03.647765+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647765+0000","last_undegraded":"2024-09-11T22:19:03.647765+0000","last_fullsized":"2024-09-11T22:19:03.647765+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646359+0000","last_change":"2024-09-11T22:19:03.646359+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646359+0000","last_undegraded":"2024-09-11T22:19:03.646359+0000","last_fullsized":"2024-09-11T22:19:03.646359+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645905+0000","last_change":"2024-09-11T22:19:03.645905+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645905+0000","last_undegraded":"2024-09-11T22:19:03.645905+0000","last_fullsized":"2024-09-11T22:19:03.645905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.648618+0000","last_change":"2024-09-11T22:19:03.648618+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.648618+0000","last_undegraded":"2024-09-11T22:19:03.648618+0000","last_fullsized":"2024-09-11T22:19:03.648618+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221695+0000","last_change":"2024-09-11T22:19:04.602810+0000","last_active":"2024-09-11T22:19:06.221695+0000","last_peered":"2024-09-11T22:19:06.221695+0000","last_clean":"2024-09-11T22:19:06.221695+0000","last_became_active":"2024-09-11T22:19:04.602529+0000","last_became_peered":"2024-09-11T22:19:04.602529+0000","last_unstale":"2024-09-11T22:19:06.221695+0000","last_undegraded":"2024-09-11T22:19:06.221695+0000","last_fullsized":"2024-09-11T22:19:06.221695+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:29.956339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647340+0000","last_change":"2024-09-11T22:19:03.647340+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647340+0000","last_undegraded":"2024-09-11T22:19:03.647340+0000","last_fullsized":"2024-09-11T22:19:03.647340+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220653+0000","last_change":"2024-09-11T22:19:04.607415+0000","last_active":"2024-09-11T22:19:06.220653+0000","last_peered":"2024-09-11T22:19:06.220653+0000","last_clean":"2024-09-11T22:19:06.220653+0000","last_became_active":"2024-09-11T22:19:04.606931+0000","last_became_peered":"2024-09-11T22:19:04.606931+0000","last_unstale":"2024-09-11T22:19:06.220653+0000","last_undegraded":"2024-09-11T22:19:06.220653+0000","last_fullsized":"2024-09-11T22:19:06.220653+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:19.955155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.642771+0000","last_change":"2024-09-11T22:19:03.642771+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.642771+0000","last_undegraded":"2024-09-11T22:19:03.642771+0000","last_fullsized":"2024-09-11T22:19:03.642771+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647245+0000","last_change":"2024-09-11T22:19:03.647245+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647245+0000","last_undegraded":"2024-09-11T22:19:03.647245+0000","last_fullsized":"2024-09-11T22:19:03.647245+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644781+0000","last_change":"2024-09-11T22:19:03.644781+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644781+0000","last_undegraded":"2024-09-11T22:19:03.644781+0000","last_fullsized":"2024-09-11T22:19:03.644781+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645467+0000","last_change":"2024-09-11T22:19:03.645467+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645467+0000","last_undegraded":"2024-09-11T22:19:03.645467+0000","last_fullsized":"2024-09-11T22:19:03.645467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.643896+0000","last_change":"2024-09-11T22:19:03.643896+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.643896+0000","last_undegraded":"2024-09-11T22:19:03.643896+0000","last_fullsized":"2024-09-11T22:19:03.643896+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221080+0000","last_change":"2024-09-11T22:19:04.601152+0000","last_active":"2024-09-11T22:19:06.221080+0000","last_peered":"2024-09-11T22:19:06.221080+0000","last_clean":"2024-09-11T22:19:06.221080+0000","last_became_active":"2024-09-11T22:19:04.600735+0000","last_became_peered":"2024-09-11T22:19:04.600735+0000","last_unstale":"2024-09-11T22:19:06.221080+0000","last_undegraded":"2024-09-11T22:19:06.221080+0000","last_fullsized":"2024-09-11T22:19:06.221080+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:17.626424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644957+0000","last_change":"2024-09-11T22:19:03.644957+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644957+0000","last_undegraded":"2024-09-11T22:19:03.644957+0000","last_fullsized":"2024-09-11T22:19:03.644957+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.648306+0000","last_change":"2024-09-11T22:19:03.648306+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.648306+0000","last_undegraded":"2024-09-11T22:19:03.648306+0000","last_fullsized":"2024-09-11T22:19:03.648306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645472+0000","last_change":"2024-09-11T22:19:03.645472+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645472+0000","last_undegraded":"2024-09-11T22:19:03.645472+0000","last_fullsized":"2024-09-11T22:19:03.645472+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644031+0000","last_change":"2024-09-11T22:19:03.644031+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644031+0000","last_undegraded":"2024-09-11T22:19:03.644031+0000","last_fullsized":"2024-09-11T22:19:03.644031+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.643965+0000","last_change":"2024-09-11T22:19:03.643965+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.643965+0000","last_undegraded":"2024-09-11T22:19:03.643965+0000","last_fullsized":"2024-09-11T22:19:03.643965+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221170+0000","last_change":"2024-09-11T22:19:04.602111+0000","last_active":"2024-09-11T22:19:06.221170+0000","last_peered":"2024-09-11T22:19:06.221170+0000","last_clean":"2024-09-11T22:19:06.221170+0000","last_became_active":"2024-09-11T22:19:04.601787+0000","last_became_peered":"2024-09-11T22:19:04.601787+0000","last_unstale":"2024-09-11T22:19:06.221170+0000","last_undegraded":"2024-09-11T22:19:06.221170+0000","last_fullsized":"2024-09-11T22:19:06.221170+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:52.810353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647353+0000","last_change":"2024-09-11T22:19:03.647353+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647353+0000","last_undegraded":"2024-09-11T22:19:03.647353+0000","last_fullsized":"2024-09-11T22:19:03.647353+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221867+0000","last_change":"2024-09-11T22:19:04.602158+0000","last_active":"2024-09-11T22:19:06.221867+0000","last_peered":"2024-09-11T22:19:06.221867+0000","last_clean":"2024-09-11T22:19:06.221867+0000","last_became_active":"2024-09-11T22:19:04.601160+0000","last_became_peered":"2024-09-11T22:19:04.601160+0000","last_unstale":"2024-09-11T22:19:06.221867+0000","last_undegraded":"2024-09-11T22:19:06.221867+0000","last_fullsized":"2024-09-11T22:19:06.221867+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:57.657597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221384+0000","last_change":"2024-09-11T22:19:04.607266+0000","last_active":"2024-09-11T22:19:06.221384+0000","last_peered":"2024-09-11T22:19:06.221384+0000","last_clean":"2024-09-11T22:19:06.221384+0000","last_became_active":"2024-09-11T22:19:04.606798+0000","last_became_peered":"2024-09-11T22:19:04.606798+0000","last_unstale":"2024-09-11T22:19:06.221384+0000","last_undegraded":"2024-09-11T22:19:06.221384+0000","last_fullsized":"2024-09-11T22:19:06.221384+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:54.948029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220650+0000","last_change":"2024-09-11T22:19:04.607858+0000","last_active":"2024-09-11T22:19:06.220650+0000","last_peered":"2024-09-11T22:19:06.220650+0000","last_clean":"2024-09-11T22:19:06.220650+0000","last_became_active":"2024-09-11T22:19:04.607583+0000","last_became_peered":"2024-09-11T22:19:04.607583+0000","last_unstale":"2024-09-11T22:19:06.220650+0000","last_undegraded":"2024-09-11T22:19:06.220650+0000","last_fullsized":"2024-09-11T22:19:06.220650+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:38.749909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646409+0000","last_change":"2024-09-11T22:19:03.646409+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646409+0000","last_undegraded":"2024-09-11T22:19:03.646409+0000","last_fullsized":"2024-09-11T22:19:03.646409+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.643125+0000","last_change":"2024-09-11T22:19:03.643125+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.643125+0000","last_undegraded":"2024-09-11T22:19:03.643125+0000","last_fullsized":"2024-09-11T22:19:03.643125+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"131'4","reported_seq":18,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221244+0000","last_change":"2024-09-11T22:19:03.657633+0000","last_active":"2024-09-11T22:19:06.221244+0000","last_peered":"2024-09-11T22:19:06.221244+0000","last_clean":"2024-09-11T22:19:06.221244+0000","last_became_active":"2024-09-11T22:19:03.657372+0000","last_became_peered":"2024-09-11T22:19:03.657372+0000","last_unstale":"2024-09-11T22:19:06.221244+0000","last_undegraded":"2024-09-11T22:19:06.221244+0000","last_fullsized":"2024-09-11T22:19:06.221244+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:37.662172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646417+0000","last_change":"2024-09-11T22:19:03.646417+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646417+0000","last_undegraded":"2024-09-11T22:19:03.646417+0000","last_fullsized":"2024-09-11T22:19:03.646417+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.655005+0000","last_change":"2024-09-11T22:19:03.652664+0000","last_active":"2024-09-11T22:19:03.655005+0000","last_peered":"2024-09-11T22:19:03.655005+0000","last_clean":"2024-09-11T22:19:03.655005+0000","last_became_active":"2024-09-11T22:19:03.652377+0000","last_became_peered":"2024-09-11T22:19:03.652377+0000","last_unstale":"2024-09-11T22:19:03.655005+0000","last_undegraded":"2024-09-11T22:19:03.655005+0000","last_fullsized":"2024-09-11T22:19:03.655005+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:59.990828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221101+0000","last_change":"2024-09-11T22:19:04.607846+0000","last_active":"2024-09-11T22:19:06.221101+0000","last_peered":"2024-09-11T22:19:06.221101+0000","last_clean":"2024-09-11T22:19:06.221101+0000","last_became_active":"2024-09-11T22:19:04.607539+0000","last_became_peered":"2024-09-11T22:19:04.607539+0000","last_unstale":"2024-09-11T22:19:06.221101+0000","last_undegraded":"2024-09-11T22:19:06.221101+0000","last_fullsized":"2024-09-11T22:19:06.221101+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:39.137292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.647048+0000","last_change":"2024-09-11T22:19:03.646165+0000","last_active":"2024-09-11T22:19:03.647048+0000","last_peered":"2024-09-11T22:19:03.647048+0000","last_clean":"2024-09-11T22:19:03.647048+0000","last_became_active":"2024-09-11T22:19:03.644773+0000","last_became_peered":"2024-09-11T22:19:03.644773+0000","last_unstale":"2024-09-11T22:19:03.647048+0000","last_undegraded":"2024-09-11T22:19:03.647048+0000","last_fullsized":"2024-09-11T22:19:03.647048+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:16.119947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221299+0000","last_change":"2024-09-11T22:19:04.608209+0000","last_active":"2024-09-11T22:19:06.221299+0000","last_peered":"2024-09-11T22:19:06.221299+0000","last_clean":"2024-09-11T22:19:06.221299+0000","last_became_active":"2024-09-11T22:19:04.607723+0000","last_became_peered":"2024-09-11T22:19:04.607723+0000","last_unstale":"2024-09-11T22:19:06.221299+0000","last_undegraded":"2024-09-11T22:19:06.221299+0000","last_fullsized":"2024-09-11T22:19:06.221299+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:29.361777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.651364+0000","last_change":"2024-09-11T22:19:03.649748+0000","last_active":"2024-09-11T22:19:03.651364+0000","last_peered":"2024-09-11T22:19:03.651364+0000","last_clean":"2024-09-11T22:19:03.651364+0000","last_became_active":"2024-09-11T22:19:03.649467+0000","last_became_peered":"2024-09-11T22:19:03.649467+0000","last_unstale":"2024-09-11T22:19:03.651364+0000","last_undegraded":"2024-09-11T22:19:03.651364+0000","last_fullsized":"2024-09-11T22:19:03.651364+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:49.291515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.642694+0000","last_change":"2024-09-11T22:19:03.642694+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.642694+0000","last_undegraded":"2024-09-11T22:19:03.642694+0000","last_fullsized":"2024-09-11T22:19:03.642694+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.649957+0000","last_change":"2024-09-11T22:19:03.649522+0000","last_active":"2024-09-11T22:19:03.649957+0000","last_peered":"2024-09-11T22:19:03.649957+0000","last_clean":"2024-09-11T22:19:03.649957+0000","last_became_active":"2024-09-11T22:19:03.649244+0000","last_became_peered":"2024-09-11T22:19:03.649244+0000","last_unstale":"2024-09-11T22:19:03.649957+0000","last_undegraded":"2024-09-11T22:19:03.649957+0000","last_fullsized":"2024-09-11T22:19:03.649957+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:18.435337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646636+0000","last_change":"2024-09-11T22:19:03.646636+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646636+0000","last_undegraded":"2024-09-11T22:19:03.646636+0000","last_fullsized":"2024-09-11T22:19:03.646636+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.654369+0000","last_change":"2024-09-11T22:19:03.651101+0000","last_active":"2024-09-11T22:19:03.654369+0000","last_peered":"2024-09-11T22:19:03.654369+0000","last_clean":"2024-09-11T22:19:03.654369+0000","last_became_active":"2024-09-11T22:19:03.650795+0000","last_became_peered":"2024-09-11T22:19:03.650795+0000","last_unstale":"2024-09-11T22:19:03.654369+0000","last_undegraded":"2024-09-11T22:19:03.654369+0000","last_fullsized":"2024-09-11T22:19:03.654369+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:00.676418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647684+0000","last_change":"2024-09-11T22:19:03.647684+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647684+0000","last_undegraded":"2024-09-11T22:19:03.647684+0000","last_fullsized":"2024-09-11T22:19:03.647684+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.659911+0000","last_change":"2024-09-11T22:19:03.659081+0000","last_active":"2024-09-11T22:19:03.659911+0000","last_peered":"2024-09-11T22:19:03.659911+0000","last_clean":"2024-09-11T22:19:03.659911+0000","last_became_active":"2024-09-11T22:19:03.658782+0000","last_became_peered":"2024-09-11T22:19:03.658782+0000","last_unstale":"2024-09-11T22:19:03.659911+0000","last_undegraded":"2024-09-11T22:19:03.659911+0000","last_fullsized":"2024-09-11T22:19:03.659911+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:29.073410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644799+0000","last_change":"2024-09-11T22:19:03.644799+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644799+0000","last_undegraded":"2024-09-11T22:19:03.644799+0000","last_fullsized":"2024-09-11T22:19:03.644799+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.658351+0000","last_change":"2024-09-11T22:19:03.656863+0000","last_active":"2024-09-11T22:19:03.658351+0000","last_peered":"2024-09-11T22:19:03.658351+0000","last_clean":"2024-09-11T22:19:03.658351+0000","last_became_active":"2024-09-11T22:19:03.656244+0000","last_became_peered":"2024-09-11T22:19:03.656244+0000","last_unstale":"2024-09-11T22:19:03.658351+0000","last_undegraded":"2024-09-11T22:19:03.658351+0000","last_fullsized":"2024-09-11T22:19:03.658351+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:58.333628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221522+0000","last_change":"2024-09-11T22:19:04.599432+0000","last_active":"2024-09-11T22:19:06.221522+0000","last_peered":"2024-09-11T22:19:06.221522+0000","last_clean":"2024-09-11T22:19:06.221522+0000","last_became_active":"2024-09-11T22:19:04.599151+0000","last_became_peered":"2024-09-11T22:19:04.599151+0000","last_unstale":"2024-09-11T22:19:06.221522+0000","last_undegraded":"2024-09-11T22:19:06.221522+0000","last_fullsized":"2024-09-11T22:19:06.221522+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:06.264509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.654350+0000","last_change":"2024-09-11T22:19:03.652549+0000","last_active":"2024-09-11T22:19:03.654350+0000","last_peered":"2024-09-11T22:19:03.654350+0000","last_clean":"2024-09-11T22:19:03.654350+0000","last_became_active":"2024-09-11T22:19:03.652228+0000","last_became_peered":"2024-09-11T22:19:03.652228+0000","last_unstale":"2024-09-11T22:19:03.654350+0000","last_undegraded":"2024-09-11T22:19:03.654350+0000","last_fullsized":"2024-09-11T22:19:03.654350+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:58.333628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.651017+0000","last_change":"2024-09-11T22:19:03.651017+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.651017+0000","last_undegraded":"2024-09-11T22:19:03.651017+0000","last_fullsized":"2024-09-11T22:19:03.651017+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.658221+0000","last_change":"2024-09-11T22:19:03.657825+0000","last_active":"2024-09-11T22:19:03.658221+0000","last_peered":"2024-09-11T22:19:03.658221+0000","last_clean":"2024-09-11T22:19:03.658221+0000","last_became_active":"2024-09-11T22:19:03.657543+0000","last_became_peered":"2024-09-11T22:19:03.657543+0000","last_unstale":"2024-09-11T22:19:03.658221+0000","last_undegraded":"2024-09-11T22:19:03.658221+0000","last_fullsized":"2024-09-11T22:19:03.658221+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:23.987707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221245+0000","last_change":"2024-09-11T22:19:04.605484+0000","last_active":"2024-09-11T22:19:06.221245+0000","last_peered":"2024-09-11T22:19:06.221245+0000","last_clean":"2024-09-11T22:19:06.221245+0000","last_became_active":"2024-09-11T22:19:04.605208+0000","last_became_peered":"2024-09-11T22:19:04.605208+0000","last_unstale":"2024-09-11T22:19:06.221245+0000","last_undegraded":"2024-09-11T22:19:06.221245+0000","last_fullsized":"2024-09-11T22:19:06.221245+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:20.257908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657853+0000","last_change":"2024-09-11T22:19:03.656806+0000","last_active":"2024-09-11T22:19:03.657853+0000","last_peered":"2024-09-11T22:19:03.657853+0000","last_clean":"2024-09-11T22:19:03.657853+0000","last_became_active":"2024-09-11T22:19:03.656469+0000","last_became_peered":"2024-09-11T22:19:03.656469+0000","last_unstale":"2024-09-11T22:19:03.657853+0000","last_undegraded":"2024-09-11T22:19:03.657853+0000","last_fullsized":"2024-09-11T22:19:03.657853+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:04.062844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221354+0000","last_change":"2024-09-11T22:19:04.605154+0000","last_active":"2024-09-11T22:19:06.221354+0000","last_peered":"2024-09-11T22:19:06.221354+0000","last_clean":"2024-09-11T22:19:06.221354+0000","last_became_active":"2024-09-11T22:19:04.604838+0000","last_became_peered":"2024-09-11T22:19:04.604838+0000","last_unstale":"2024-09-11T22:19:06.221354+0000","last_undegraded":"2024-09-11T22:19:06.221354+0000","last_fullsized":"2024-09-11T22:19:06.221354+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:14.391949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.659642+0000","last_change":"2024-09-11T22:19:03.658102+0000","last_active":"2024-09-11T22:19:03.659642+0000","last_peered":"2024-09-11T22:19:03.659642+0000","last_clean":"2024-09-11T22:19:03.659642+0000","last_became_active":"2024-09-11T22:19:03.657816+0000","last_became_peered":"2024-09-11T22:19:03.657816+0000","last_unstale":"2024-09-11T22:19:03.659642+0000","last_undegraded":"2024-09-11T22:19:03.659642+0000","last_fullsized":"2024-09-11T22:19:03.659642+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221877+0000","last_change":"2024-09-11T22:19:04.598642+0000","last_active":"2024-09-11T22:19:06.221877+0000","last_peered":"2024-09-11T22:19:06.221877+0000","last_clean":"2024-09-11T22:19:06.221877+0000","last_became_active":"2024-09-11T22:19:04.598329+0000","last_became_peered":"2024-09-11T22:19:04.598329+0000","last_unstale":"2024-09-11T22:19:06.221877+0000","last_undegraded":"2024-09-11T22:19:06.221877+0000","last_fullsized":"2024-09-11T22:19:06.221877+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:27.785617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221244+0000","last_change":"2024-09-11T22:19:03.652627+0000","last_active":"2024-09-11T22:19:06.221244+0000","last_peered":"2024-09-11T22:19:06.221244+0000","last_clean":"2024-09-11T22:19:06.221244+0000","last_became_active":"2024-09-11T22:19:03.652320+0000","last_became_peered":"2024-09-11T22:19:03.652320+0000","last_unstale":"2024-09-11T22:19:06.221244+0000","last_undegraded":"2024-09-11T22:19:06.221244+0000","last_fullsized":"2024-09-11T22:19:06.221244+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:23.173009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645070+0000","last_change":"2024-09-11T22:19:03.645070+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645070+0000","last_undegraded":"2024-09-11T22:19:03.645070+0000","last_fullsized":"2024-09-11T22:19:03.645070+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.658634+0000","last_change":"2024-09-11T22:19:03.657984+0000","last_active":"2024-09-11T22:19:03.658634+0000","last_peered":"2024-09-11T22:19:03.658634+0000","last_clean":"2024-09-11T22:19:03.658634+0000","last_became_active":"2024-09-11T22:19:03.657671+0000","last_became_peered":"2024-09-11T22:19:03.657671+0000","last_unstale":"2024-09-11T22:19:03.658634+0000","last_undegraded":"2024-09-11T22:19:03.658634+0000","last_fullsized":"2024-09-11T22:19:03.658634+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:59.990828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.649683+0000","last_change":"2024-09-11T22:19:03.649683+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.649683+0000","last_undegraded":"2024-09-11T22:19:03.649683+0000","last_fullsized":"2024-09-11T22:19:03.649683+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.659686+0000","last_change":"2024-09-11T22:19:03.658740+0000","last_active":"2024-09-11T22:19:03.659686+0000","last_peered":"2024-09-11T22:19:03.659686+0000","last_clean":"2024-09-11T22:19:03.659686+0000","last_became_active":"2024-09-11T22:19:03.658380+0000","last_became_peered":"2024-09-11T22:19:03.658380+0000","last_unstale":"2024-09-11T22:19:03.659686+0000","last_undegraded":"2024-09-11T22:19:03.659686+0000","last_fullsized":"2024-09-11T22:19:03.659686+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:04.183505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.651524+0000","last_change":"2024-09-11T22:19:03.651524+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.651524+0000","last_undegraded":"2024-09-11T22:19:03.651524+0000","last_fullsized":"2024-09-11T22:19:03.651524+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.660408+0000","last_change":"2024-09-11T22:19:03.658363+0000","last_active":"2024-09-11T22:19:03.660408+0000","last_peered":"2024-09-11T22:19:03.660408+0000","last_clean":"2024-09-11T22:19:03.660408+0000","last_became_active":"2024-09-11T22:19:03.658100+0000","last_became_peered":"2024-09-11T22:19:03.658100+0000","last_unstale":"2024-09-11T22:19:03.660408+0000","last_undegraded":"2024-09-11T22:19:03.660408+0000","last_fullsized":"2024-09-11T22:19:03.660408+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:18.904813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.650603+0000","last_change":"2024-09-11T22:19:03.650603+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.650603+0000","last_undegraded":"2024-09-11T22:19:03.650603+0000","last_fullsized":"2024-09-11T22:19:03.650603+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657204+0000","last_change":"2024-09-11T22:19:03.655955+0000","last_active":"2024-09-11T22:19:03.657204+0000","last_peered":"2024-09-11T22:19:03.657204+0000","last_clean":"2024-09-11T22:19:03.657204+0000","last_became_active":"2024-09-11T22:19:03.655394+0000","last_became_peered":"2024-09-11T22:19:03.655394+0000","last_unstale":"2024-09-11T22:19:03.657204+0000","last_undegraded":"2024-09-11T22:19:03.657204+0000","last_fullsized":"2024-09-11T22:19:03.657204+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:02.941518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.643335+0000","last_change":"2024-09-11T22:19:03.643335+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.643335+0000","last_undegraded":"2024-09-11T22:19:03.643335+0000","last_fullsized":"2024-09-11T22:19:03.643335+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.660133+0000","last_change":"2024-09-11T22:19:03.659192+0000","last_active":"2024-09-11T22:19:03.660133+0000","last_peered":"2024-09-11T22:19:03.660133+0000","last_clean":"2024-09-11T22:19:03.660133+0000","last_became_active":"2024-09-11T22:19:03.658919+0000","last_became_peered":"2024-09-11T22:19:03.658919+0000","last_unstale":"2024-09-11T22:19:03.660133+0000","last_undegraded":"2024-09-11T22:19:03.660133+0000","last_fullsized":"2024-09-11T22:19:03.660133+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:49.845665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646303+0000","last_change":"2024-09-11T22:19:03.646303+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646303+0000","last_undegraded":"2024-09-11T22:19:03.646303+0000","last_fullsized":"2024-09-11T22:19:03.646303+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.654959+0000","last_change":"2024-09-11T22:19:03.652729+0000","last_active":"2024-09-11T22:19:03.654959+0000","last_peered":"2024-09-11T22:19:03.654959+0000","last_clean":"2024-09-11T22:19:03.654959+0000","last_became_active":"2024-09-11T22:19:03.652408+0000","last_became_peered":"2024-09-11T22:19:03.652408+0000","last_unstale":"2024-09-11T22:19:03.654959+0000","last_undegraded":"2024-09-11T22:19:03.654959+0000","last_fullsized":"2024-09-11T22:19:03.654959+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:53.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221136+0000","last_change":"2024-09-11T22:19:04.601130+0000","last_active":"2024-09-11T22:19:06.221136+0000","last_peered":"2024-09-11T22:19:06.221136+0000","last_clean":"2024-09-11T22:19:06.221136+0000","last_became_active":"2024-09-11T22:19:04.600847+0000","last_became_peered":"2024-09-11T22:19:04.600847+0000","last_unstale":"2024-09-11T22:19:06.221136+0000","last_undegraded":"2024-09-11T22:19:06.221136+0000","last_fullsized":"2024-09-11T22:19:06.221136+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:23.840570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.652877+0000","last_change":"2024-09-11T22:19:03.651763+0000","last_active":"2024-09-11T22:19:03.652877+0000","last_peered":"2024-09-11T22:19:03.652877+0000","last_clean":"2024-09-11T22:19:03.652877+0000","last_became_active":"2024-09-11T22:19:03.651464+0000","last_became_peered":"2024-09-11T22:19:03.651464+0000","last_unstale":"2024-09-11T22:19:03.652877+0000","last_undegraded":"2024-09-11T22:19:03.652877+0000","last_fullsized":"2024-09-11T22:19:03.652877+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.624771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645738+0000","last_change":"2024-09-11T22:19:03.645738+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645738+0000","last_undegraded":"2024-09-11T22:19:03.645738+0000","last_fullsized":"2024-09-11T22:19:03.645738+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657471+0000","last_change":"2024-09-11T22:19:03.656329+0000","last_active":"2024-09-11T22:19:03.657471+0000","last_peered":"2024-09-11T22:19:03.657471+0000","last_clean":"2024-09-11T22:19:03.657471+0000","last_became_active":"2024-09-11T22:19:03.656010+0000","last_became_peered":"2024-09-11T22:19:03.656010+0000","last_unstale":"2024-09-11T22:19:03.657471+0000","last_undegraded":"2024-09-11T22:19:03.657471+0000","last_fullsized":"2024-09-11T22:19:03.657471+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:56.317365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644128+0000","last_change":"2024-09-11T22:19:03.644128+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644128+0000","last_undegraded":"2024-09-11T22:19:03.644128+0000","last_fullsized":"2024-09-11T22:19:03.644128+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.654935+0000","last_change":"2024-09-11T22:19:03.652845+0000","last_active":"2024-09-11T22:19:03.654935+0000","last_peered":"2024-09-11T22:19:03.654935+0000","last_clean":"2024-09-11T22:19:03.654935+0000","last_became_active":"2024-09-11T22:19:03.651928+0000","last_became_peered":"2024-09-11T22:19:03.651928+0000","last_unstale":"2024-09-11T22:19:03.654935+0000","last_undegraded":"2024-09-11T22:19:03.654935+0000","last_fullsized":"2024-09-11T22:19:03.654935+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:16.168301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220474+0000","last_change":"2024-09-11T22:19:04.607489+0000","last_active":"2024-09-11T22:19:06.220474+0000","last_peered":"2024-09-11T22:19:06.220474+0000","last_clean":"2024-09-11T22:19:06.220474+0000","last_became_active":"2024-09-11T22:19:04.606950+0000","last_became_peered":"2024-09-11T22:19:04.606950+0000","last_unstale":"2024-09-11T22:19:06.220474+0000","last_undegraded":"2024-09-11T22:19:06.220474+0000","last_fullsized":"2024-09-11T22:19:06.220474+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:55.783154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657103+0000","last_change":"2024-09-11T22:19:03.655592+0000","last_active":"2024-09-11T22:19:03.657103+0000","last_peered":"2024-09-11T22:19:03.657103+0000","last_clean":"2024-09-11T22:19:03.657103+0000","last_became_active":"2024-09-11T22:19:03.655319+0000","last_became_peered":"2024-09-11T22:19:03.655319+0000","last_unstale":"2024-09-11T22:19:03.657103+0000","last_undegraded":"2024-09-11T22:19:03.657103+0000","last_fullsized":"2024-09-11T22:19:03.657103+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:10.586681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.648516+0000","last_change":"2024-09-11T22:19:03.648516+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.648516+0000","last_undegraded":"2024-09-11T22:19:03.648516+0000","last_fullsized":"2024-09-11T22:19:03.648516+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221624+0000","last_change":"2024-09-11T22:19:03.653122+0000","last_active":"2024-09-11T22:19:06.221624+0000","last_peered":"2024-09-11T22:19:06.221624+0000","last_clean":"2024-09-11T22:19:06.221624+0000","last_became_active":"2024-09-11T22:19:03.652733+0000","last_became_peered":"2024-09-11T22:19:03.652733+0000","last_unstale":"2024-09-11T22:19:06.221624+0000","last_undegraded":"2024-09-11T22:19:06.221624+0000","last_fullsized":"2024-09-11T22:19:06.221624+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:46.127177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221677+0000","last_change":"2024-09-11T22:19:04.607324+0000","last_active":"2024-09-11T22:19:06.221677+0000","last_peered":"2024-09-11T22:19:06.221677+0000","last_clean":"2024-09-11T22:19:06.221677+0000","last_became_active":"2024-09-11T22:19:04.606948+0000","last_became_peered":"2024-09-11T22:19:04.606948+0000","last_unstale":"2024-09-11T22:19:06.221677+0000","last_undegraded":"2024-09-11T22:19:06.221677+0000","last_fullsized":"2024-09-11T22:19:06.221677+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:42.474866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"132'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.644363+0000","last_change":"2024-09-11T22:19:03.658179+0000","last_active":"2024-09-11T22:19:06.644363+0000","last_peered":"2024-09-11T22:19:06.644363+0000","last_clean":"2024-09-11T22:19:06.644363+0000","last_became_active":"2024-09-11T22:19:03.657895+0000","last_became_peered":"2024-09-11T22:19:03.657895+0000","last_unstale":"2024-09-11T22:19:06.644363+0000","last_undegraded":"2024-09-11T22:19:06.644363+0000","last_fullsized":"2024-09-11T22:19:06.644363+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:08.667757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645750+0000","last_change":"2024-09-11T22:19:03.645750+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645750+0000","last_undegraded":"2024-09-11T22:19:03.645750+0000","last_fullsized":"2024-09-11T22:19:03.645750+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657453+0000","last_change":"2024-09-11T22:19:03.656565+0000","last_active":"2024-09-11T22:19:03.657453+0000","last_peered":"2024-09-11T22:19:03.657453+0000","last_clean":"2024-09-11T22:19:03.657453+0000","last_became_active":"2024-09-11T22:19:03.656260+0000","last_became_peered":"2024-09-11T22:19:03.656260+0000","last_unstale":"2024-09-11T22:19:03.657453+0000","last_undegraded":"2024-09-11T22:19:03.657453+0000","last_fullsized":"2024-09-11T22:19:03.657453+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.624771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646960+0000","last_change":"2024-09-11T22:19:03.646960+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646960+0000","last_undegraded":"2024-09-11T22:19:03.646960+0000","last_fullsized":"2024-09-11T22:19:03.646960+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.651353+0000","last_change":"2024-09-11T22:19:03.649388+0000","last_active":"2024-09-11T22:19:03.651353+0000","last_peered":"2024-09-11T22:19:03.651353+0000","last_clean":"2024-09-11T22:19:03.651353+0000","last_became_active":"2024-09-11T22:19:03.649080+0000","last_became_peered":"2024-09-11T22:19:03.649080+0000","last_unstale":"2024-09-11T22:19:03.651353+0000","last_undegraded":"2024-09-11T22:19:03.651353+0000","last_fullsized":"2024-09-11T22:19:03.651353+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:59.208623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220720+0000","last_change":"2024-09-11T22:19:04.607362+0000","last_active":"2024-09-11T22:19:06.220720+0000","last_peered":"2024-09-11T22:19:06.220720+0000","last_clean":"2024-09-11T22:19:06.220720+0000","last_became_active":"2024-09-11T22:19:04.607063+0000","last_became_peered":"2024-09-11T22:19:04.607063+0000","last_unstale":"2024-09-11T22:19:06.220720+0000","last_undegraded":"2024-09-11T22:19:06.220720+0000","last_fullsized":"2024-09-11T22:19:06.220720+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:59.918367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.659606+0000","last_change":"2024-09-11T22:19:03.659074+0000","last_active":"2024-09-11T22:19:03.659606+0000","last_peered":"2024-09-11T22:19:03.659606+0000","last_clean":"2024-09-11T22:19:03.659606+0000","last_became_active":"2024-09-11T22:19:03.658750+0000","last_became_peered":"2024-09-11T22:19:03.658750+0000","last_unstale":"2024-09-11T22:19:03.659606+0000","last_undegraded":"2024-09-11T22:19:03.659606+0000","last_fullsized":"2024-09-11T22:19:03.659606+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:53.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646875+0000","last_change":"2024-09-11T22:19:03.646875+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646875+0000","last_undegraded":"2024-09-11T22:19:03.646875+0000","last_fullsized":"2024-09-11T22:19:03.646875+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220823+0000","last_change":"2024-09-11T22:19:03.657654+0000","last_active":"2024-09-11T22:19:06.220823+0000","last_peered":"2024-09-11T22:19:06.220823+0000","last_clean":"2024-09-11T22:19:06.220823+0000","last_became_active":"2024-09-11T22:19:03.657357+0000","last_became_peered":"2024-09-11T22:19:03.657357+0000","last_unstale":"2024-09-11T22:19:06.220823+0000","last_undegraded":"2024-09-11T22:19:06.220823+0000","last_fullsized":"2024-09-11T22:19:06.220823+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:51.252945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.642253+0000","last_change":"2024-09-11T22:19:03.642253+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.642253+0000","last_undegraded":"2024-09-11T22:19:03.642253+0000","last_fullsized":"2024-09-11T22:19:03.642253+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657879+0000","last_change":"2024-09-11T22:19:03.657049+0000","last_active":"2024-09-11T22:19:03.657879+0000","last_peered":"2024-09-11T22:19:03.657879+0000","last_clean":"2024-09-11T22:19:03.657879+0000","last_became_active":"2024-09-11T22:19:03.656761+0000","last_became_peered":"2024-09-11T22:19:03.656761+0000","last_unstale":"2024-09-11T22:19:03.657879+0000","last_undegraded":"2024-09-11T22:19:03.657879+0000","last_fullsized":"2024-09-11T22:19:03.657879+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:02.231666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644367+0000","last_change":"2024-09-11T22:19:03.644367+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644367+0000","last_undegraded":"2024-09-11T22:19:03.644367+0000","last_fullsized":"2024-09-11T22:19:03.644367+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.655602+0000","last_change":"2024-09-11T22:19:03.652831+0000","last_active":"2024-09-11T22:19:03.655602+0000","last_peered":"2024-09-11T22:19:03.655602+0000","last_clean":"2024-09-11T22:19:03.655602+0000","last_became_active":"2024-09-11T22:19:03.652532+0000","last_became_peered":"2024-09-11T22:19:03.652532+0000","last_unstale":"2024-09-11T22:19:03.655602+0000","last_undegraded":"2024-09-11T22:19:03.655602+0000","last_fullsized":"2024-09-11T22:19:03.655602+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:24.912463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220918+0000","last_change":"2024-09-11T22:19:04.607288+0000","last_active":"2024-09-11T22:19:06.220918+0000","last_peered":"2024-09-11T22:19:06.220918+0000","last_clean":"2024-09-11T22:19:06.220918+0000","last_became_active":"2024-09-11T22:19:04.606876+0000","last_became_peered":"2024-09-11T22:19:04.606876+0000","last_unstale":"2024-09-11T22:19:06.220918+0000","last_undegraded":"2024-09-11T22:19:06.220918+0000","last_fullsized":"2024-09-11T22:19:06.220918+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.340880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221001+0000","last_change":"2024-09-11T22:19:03.660606+0000","last_active":"2024-09-11T22:19:06.221001+0000","last_peered":"2024-09-11T22:19:06.221001+0000","last_clean":"2024-09-11T22:19:06.221001+0000","last_became_active":"2024-09-11T22:19:03.660282+0000","last_became_peered":"2024-09-11T22:19:03.660282+0000","last_unstale":"2024-09-11T22:19:06.221001+0000","last_undegraded":"2024-09-11T22:19:06.221001+0000","last_fullsized":"2024-09-11T22:19:06.221001+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.710149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":372,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220377+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:19:06.220377+0000","last_peered":"2024-09-11T22:19:06.220377+0000","last_clean":"2024-09-11T22:19:06.220377+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:19:06.220377+0000","last_undegraded":"2024-09-11T22:19:06.220377+0000","last_fullsized":"2024-09-11T22:19:06.220377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46656,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325184,"statfs":{"total":96636764160,"available":96588988416,"internally_reserved":0,"allocated":1613824,"data_stored":705343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45244,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326596,"statfs":{"total":96636764160,"available":96590434304,"internally_reserved":0,"allocated":1613824,"data_stored":705343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50820,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321020,"statfs":{"total":96636764160,"available":96584724480,"internally_reserved":0,"allocated":1613824,"data_stored":705343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54968,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316872,"statfs":{"total":96636764160,"available":96580476928,"internally_reserved":0,"allocated":1601536,"data_stored":699068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59132,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312708,"statfs":{"total":96636764160,"available":96576212992,"internally_reserved":0,"allocated":1613824,"data_stored":705343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509539,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55552,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316288,"statfs":{"total":96636764160,"available":96579878912,"internally_reserved":0,"allocated":2207744,"data_stored":1295711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47288,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324552,"statfs":{"total":96636764160,"available":96588341248,"internally_reserved":0,"allocated":2256896,"data_stored":1311036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59152,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312688,"statfs":{"total":96636764160,"available":96576192512,"internally_reserved":0,"allocated":1634304,"data_stored":712734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:19:08.636 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:19:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.775+0000 7f6f59186640 1 Processor -- start 2024-09-11T22:19:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.775+0000 7f6f59186640 1 -- start start 2024-09-11T22:19:08.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.776+0000 7f6f59186640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6f54161d30 0x7f6f540cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.776+0000 7f6f59186640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6f540b78f0 0x7f6f54162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.776+0000 7f6f59186640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f541632e0 con 0x7f6f540d11d0 2024-09-11T22:19:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.776+0000 7f6f59186640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6f540d3450 con 0x7f6f540b78f0 2024-09-11T22:19:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.776+0000 7f6f59186640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6f54162110 con 0x7f6f54161d30 2024-09-11T22:19:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.776+0000 7f6f5259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6f540b78f0 0x7f6f54162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.776+0000 7f6f5359e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6f540d11d0 0x7f6f540d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36426/0 (socket says 172.21.15.50:36426) 2024-09-11T22:19:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.776+0000 7f6f5359e640 1 -- 172.21.15.50:0/1499077458 learned_addr learned my addr 172.21.15.50:0/1499077458 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.776+0000 7f6f52d9d640 1 --2- 172.21.15.50:0/1499077458 >> v2:172.21.15.77:3300/0 conn(0x7f6f54161d30 0x7f6f540cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.776+0000 7f6f5259c640 1 -- 172.21.15.50:0/1499077458 >> v2:172.21.15.77:3300/0 conn(0x7f6f54161d30 msgr2=0x7f6f540cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.776+0000 7f6f5259c640 1 --2- 172.21.15.50:0/1499077458 >> v2:172.21.15.77:3300/0 conn(0x7f6f54161d30 0x7f6f540cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.776+0000 7f6f5259c640 1 -- 172.21.15.50:0/1499077458 >> v1:172.21.15.50:6789/0 conn(0x7f6f540d11d0 legacy=0x7f6f540d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.776+0000 7f6f5259c640 1 -- 172.21.15.50:0/1499077458 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f540cfd70 con 0x7f6f540b78f0 2024-09-11T22:19:08.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.777+0000 7f6f5259c640 1 --2- 172.21.15.50:0/1499077458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f540b78f0 0x7f6f54162da0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f6f54073050 tx=0x7f6f3c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7557a74b45f3beef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.777+0000 7f6f51d9b640 1 -- 172.21.15.50:0/1499077458 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c037070 con 0x7f6f540b78f0 2024-09-11T22:19:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.777+0000 7f6f51d9b640 1 -- 172.21.15.50:0/1499077458 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3c032440 con 0x7f6f540b78f0 2024-09-11T22:19:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.777+0000 7f6f51d9b640 1 -- 172.21.15.50:0/1499077458 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c032810 con 0x7f6f540b78f0 2024-09-11T22:19:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.778+0000 7f6f59186640 1 -- 172.21.15.50:0/1499077458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f540b78f0 msgr2=0x7f6f54162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.778+0000 7f6f59186640 1 --2- 172.21.15.50:0/1499077458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f540b78f0 0x7f6f54162da0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f6f54073050 tx=0x7f6f3c02a1a0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.778+0000 7f6f59186640 1 -- 172.21.15.50:0/1499077458 shutdown_connections 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.778+0000 7f6f59186640 1 --2- 172.21.15.50:0/1499077458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f540b78f0 0x7f6f54162da0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.778+0000 7f6f59186640 1 --2- 172.21.15.50:0/1499077458 >> v2:172.21.15.77:3300/0 conn(0x7f6f54161d30 0x7f6f540cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.778+0000 7f6f59186640 1 -- 172.21.15.50:0/1499077458 >> 172.21.15.50:0/1499077458 conn(0x7f6f540727a0 msgr2=0x7f6f540679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.778+0000 7f6f59186640 1 -- 172.21.15.50:0/1499077458 shutdown_connections 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.778+0000 7f6f59186640 1 -- 172.21.15.50:0/1499077458 wait complete. 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.779+0000 7f6f59186640 1 Processor -- start 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.780+0000 7f6f59186640 1 -- start start 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.780+0000 7f6f59186640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f540b78f0 0x7f6f540caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.780+0000 7f6f59186640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f540d11d0 0x7f6f541f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.780+0000 7f6f59186640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f54161d30 0x7f6f5415fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.780+0000 7f6f59186640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6f540d30e0 con 0x7f6f54161d30 2024-09-11T22:19:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.780+0000 7f6f59186640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f540d2e00 con 0x7f6f540b78f0 2024-09-11T22:19:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.780+0000 7f6f59186640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6f540b7d60 con 0x7f6f540d11d0 2024-09-11T22:19:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.780+0000 7f6f5359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f54161d30 0x7f6f5415fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.780+0000 7f6f5359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f54161d30 0x7f6f5415fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56762/0 (socket says 172.21.15.50:56762) 2024-09-11T22:19:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.780+0000 7f6f5359e640 1 -- 172.21.15.50:0/817300984 learned_addr learned my addr 172.21.15.50:0/817300984 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.780+0000 7f6f52d9d640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f540b78f0 0x7f6f540caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.781+0000 7f6f5259c640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f540d11d0 0x7f6f541f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.781+0000 7f6f5359e640 1 -- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f540d11d0 msgr2=0x7f6f541f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.781+0000 7f6f5359e640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f540d11d0 0x7f6f541f5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.781+0000 7f6f5359e640 1 -- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f540b78f0 msgr2=0x7f6f540caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.781+0000 7f6f5359e640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f540b78f0 0x7f6f540caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.781+0000 7f6f5359e640 1 -- 172.21.15.50:0/817300984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f540b35d0 con 0x7f6f54161d30 2024-09-11T22:19:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.781+0000 7f6f5259c640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f540d11d0 0x7f6f541f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.781+0000 7f6f5359e640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f54161d30 0x7f6f5415fa30 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400c420 tx=0x7f6f4400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.781+0000 7f6f4b7fe640 1 -- 172.21.15.50:0/817300984 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44017070 con 0x7f6f54161d30 2024-09-11T22:19:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.781+0000 7f6f4b7fe640 1 -- 172.21.15.50:0/817300984 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f44005ce0 con 0x7f6f54161d30 2024-09-11T22:19:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.781+0000 7f6f4b7fe640 1 -- 172.21.15.50:0/817300984 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f440072d0 con 0x7f6f54161d30 2024-09-11T22:19:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.781+0000 7f6f59186640 1 -- 172.21.15.50:0/817300984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f540c9a20 con 0x7f6f54161d30 2024-09-11T22:19:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.781+0000 7f6f59186640 1 -- 172.21.15.50:0/817300984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f540c9fe0 con 0x7f6f54161d30 2024-09-11T22:19:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.782+0000 7f6f59186640 1 -- 172.21.15.50:0/817300984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f540d2900 con 0x7f6f54161d30 2024-09-11T22:19:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.783+0000 7f6f4b7fe640 1 -- 172.21.15.50:0/817300984 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f4401a070 con 0x7f6f54161d30 2024-09-11T22:19:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.783+0000 7f6f4b7fe640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6f3406be30 0x7f6f3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.783+0000 7f6f4b7fe640 1 -- 172.21.15.50:0/817300984 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f6f4408a070 con 0x7f6f54161d30 2024-09-11T22:19:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.783+0000 7f6f52d9d640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6f3406be30 0x7f6f3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.784+0000 7f6f52d9d640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6f3406be30 0x7f6f3406e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6f540b72e0 tx=0x7f6f4c0098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.788+0000 7f6f4b7fe640 1 -- 172.21.15.50:0/817300984 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f44058460 con 0x7f6f54161d30 2024-09-11T22:19:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.961+0000 7f6f59186640 1 -- 172.21.15.50:0/817300984 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f540ce590 con 0x7f6f3406be30 2024-09-11T22:19:08.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.967+0000 7f6f4b7fe640 1 -- 172.21.15.50:0/817300984 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248857 (secure 0 0 0) 0x7f6f540ce590 con 0x7f6f3406be30 2024-09-11T22:19:08.970 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:08.971 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:19:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.970+0000 7f6f59186640 1 -- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6f3406be30 msgr2=0x7f6f3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.970+0000 7f6f59186640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6f3406be30 0x7f6f3406e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6f540b72e0 tx=0x7f6f4c0098d0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.970+0000 7f6f59186640 1 -- 172.21.15.50:0/817300984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f54161d30 msgr2=0x7f6f5415fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.970+0000 7f6f59186640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f54161d30 0x7f6f5415fa30 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400c420 tx=0x7f6f4400c8e0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.970+0000 7f6f59186640 1 -- 172.21.15.50:0/817300984 shutdown_connections 2024-09-11T22:19:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.970+0000 7f6f59186640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6f3406be30 0x7f6f3406e2f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.970+0000 7f6f59186640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f540d11d0 0x7f6f541f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.970+0000 7f6f59186640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f54161d30 0x7f6f5415fa30 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.970+0000 7f6f59186640 1 --2- 172.21.15.50:0/817300984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f540b78f0 0x7f6f540caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.970+0000 7f6f59186640 1 -- 172.21.15.50:0/817300984 >> 172.21.15.50:0/817300984 conn(0x7f6f540727a0 msgr2=0x7f6f540ba100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.970+0000 7f6f59186640 1 -- 172.21.15.50:0/817300984 shutdown_connections 2024-09-11T22:19:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:08.970+0000 7f6f59186640 1 -- 172.21.15.50:0/817300984 wait complete. 2024-09-11T22:19:08.982 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2024-09-11T22:19:07.479437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":418812,"kb_used_data":13824,"kb_used_omap":12,"kb_used_meta":404787,"kb_avail":754555908,"statfs":{"total":773094113280,"available":772665249792,"internally_reserved":0,"allocated":14155776,"data_stored":6839921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":414502449},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.841792"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221490+0000","last_change":"2024-09-11T22:19:04.601864+0000","last_active":"2024-09-11T22:19:06.221490+0000","last_peered":"2024-09-11T22:19:06.221490+0000","last_clean":"2024-09-11T22:19:06.221490+0000","last_became_active":"2024-09-11T22:19:04.601567+0000","last_became_peered":"2024-09-11T22:19:04.601567+0000","last_unstale":"2024-09-11T22:19:06.221490+0000","last_undegraded":"2024-09-11T22:19:06.221490+0000","last_fullsized":"2024-09-11T22:19:06.221490+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:37.691839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646967+0000","last_change":"2024-09-11T22:19:03.646967+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646967+0000","last_undegraded":"2024-09-11T22:19:03.646967+0000","last_fullsized":"2024-09-11T22:19:03.646967+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646915+0000","last_change":"2024-09-11T22:19:03.646915+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646915+0000","last_undegraded":"2024-09-11T22:19:03.646915+0000","last_fullsized":"2024-09-11T22:19:03.646915+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220838+0000","last_change":"2024-09-11T22:19:04.601956+0000","last_active":"2024-09-11T22:19:06.220838+0000","last_peered":"2024-09-11T22:19:06.220838+0000","last_clean":"2024-09-11T22:19:06.220838+0000","last_became_active":"2024-09-11T22:19:04.601249+0000","last_became_peered":"2024-09-11T22:19:04.601249+0000","last_unstale":"2024-09-11T22:19:06.220838+0000","last_undegraded":"2024-09-11T22:19:06.220838+0000","last_fullsized":"2024-09-11T22:19:06.220838+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:37.836260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220888+0000","last_change":"2024-09-11T22:19:04.600564+0000","last_active":"2024-09-11T22:19:06.220888+0000","last_peered":"2024-09-11T22:19:06.220888+0000","last_clean":"2024-09-11T22:19:06.220888+0000","last_became_active":"2024-09-11T22:19:04.600260+0000","last_became_peered":"2024-09-11T22:19:04.600260+0000","last_unstale":"2024-09-11T22:19:06.220888+0000","last_undegraded":"2024-09-11T22:19:06.220888+0000","last_fullsized":"2024-09-11T22:19:06.220888+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:28.037951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645647+0000","last_change":"2024-09-11T22:19:03.645647+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645647+0000","last_undegraded":"2024-09-11T22:19:03.645647+0000","last_fullsized":"2024-09-11T22:19:03.645647+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646415+0000","last_change":"2024-09-11T22:19:03.646415+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646415+0000","last_undegraded":"2024-09-11T22:19:03.646415+0000","last_fullsized":"2024-09-11T22:19:03.646415+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.648115+0000","last_change":"2024-09-11T22:19:03.648115+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.648115+0000","last_undegraded":"2024-09-11T22:19:03.648115+0000","last_fullsized":"2024-09-11T22:19:03.648115+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647765+0000","last_change":"2024-09-11T22:19:03.647765+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647765+0000","last_undegraded":"2024-09-11T22:19:03.647765+0000","last_fullsized":"2024-09-11T22:19:03.647765+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646359+0000","last_change":"2024-09-11T22:19:03.646359+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646359+0000","last_undegraded":"2024-09-11T22:19:03.646359+0000","last_fullsized":"2024-09-11T22:19:03.646359+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645905+0000","last_change":"2024-09-11T22:19:03.645905+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645905+0000","last_undegraded":"2024-09-11T22:19:03.645905+0000","last_fullsized":"2024-09-11T22:19:03.645905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.648618+0000","last_change":"2024-09-11T22:19:03.648618+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.648618+0000","last_undegraded":"2024-09-11T22:19:03.648618+0000","last_fullsized":"2024-09-11T22:19:03.648618+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221695+0000","last_change":"2024-09-11T22:19:04.602810+0000","last_active":"2024-09-11T22:19:06.221695+0000","last_peered":"2024-09-11T22:19:06.221695+0000","last_clean":"2024-09-11T22:19:06.221695+0000","last_became_active":"2024-09-11T22:19:04.602529+0000","last_became_peered":"2024-09-11T22:19:04.602529+0000","last_unstale":"2024-09-11T22:19:06.221695+0000","last_undegraded":"2024-09-11T22:19:06.221695+0000","last_fullsized":"2024-09-11T22:19:06.221695+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:29.956339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647340+0000","last_change":"2024-09-11T22:19:03.647340+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647340+0000","last_undegraded":"2024-09-11T22:19:03.647340+0000","last_fullsized":"2024-09-11T22:19:03.647340+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220653+0000","last_change":"2024-09-11T22:19:04.607415+0000","last_active":"2024-09-11T22:19:06.220653+0000","last_peered":"2024-09-11T22:19:06.220653+0000","last_clean":"2024-09-11T22:19:06.220653+0000","last_became_active":"2024-09-11T22:19:04.606931+0000","last_became_peered":"2024-09-11T22:19:04.606931+0000","last_unstale":"2024-09-11T22:19:06.220653+0000","last_undegraded":"2024-09-11T22:19:06.220653+0000","last_fullsized":"2024-09-11T22:19:06.220653+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:19.955155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.642771+0000","last_change":"2024-09-11T22:19:03.642771+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.642771+0000","last_undegraded":"2024-09-11T22:19:03.642771+0000","last_fullsized":"2024-09-11T22:19:03.642771+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647245+0000","last_change":"2024-09-11T22:19:03.647245+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647245+0000","last_undegraded":"2024-09-11T22:19:03.647245+0000","last_fullsized":"2024-09-11T22:19:03.647245+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644781+0000","last_change":"2024-09-11T22:19:03.644781+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644781+0000","last_undegraded":"2024-09-11T22:19:03.644781+0000","last_fullsized":"2024-09-11T22:19:03.644781+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645467+0000","last_change":"2024-09-11T22:19:03.645467+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645467+0000","last_undegraded":"2024-09-11T22:19:03.645467+0000","last_fullsized":"2024-09-11T22:19:03.645467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.643896+0000","last_change":"2024-09-11T22:19:03.643896+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.643896+0000","last_undegraded":"2024-09-11T22:19:03.643896+0000","last_fullsized":"2024-09-11T22:19:03.643896+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221080+0000","last_change":"2024-09-11T22:19:04.601152+0000","last_active":"2024-09-11T22:19:06.221080+0000","last_peered":"2024-09-11T22:19:06.221080+0000","last_clean":"2024-09-11T22:19:06.221080+0000","last_became_active":"2024-09-11T22:19:04.600735+0000","last_became_peered":"2024-09-11T22:19:04.600735+0000","last_unstale":"2024-09-11T22:19:06.221080+0000","last_undegraded":"2024-09-11T22:19:06.221080+0000","last_fullsized":"2024-09-11T22:19:06.221080+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:17.626424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644957+0000","last_change":"2024-09-11T22:19:03.644957+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644957+0000","last_undegraded":"2024-09-11T22:19:03.644957+0000","last_fullsized":"2024-09-11T22:19:03.644957+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.648306+0000","last_change":"2024-09-11T22:19:03.648306+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.648306+0000","last_undegraded":"2024-09-11T22:19:03.648306+0000","last_fullsized":"2024-09-11T22:19:03.648306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645472+0000","last_change":"2024-09-11T22:19:03.645472+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645472+0000","last_undegraded":"2024-09-11T22:19:03.645472+0000","last_fullsized":"2024-09-11T22:19:03.645472+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644031+0000","last_change":"2024-09-11T22:19:03.644031+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644031+0000","last_undegraded":"2024-09-11T22:19:03.644031+0000","last_fullsized":"2024-09-11T22:19:03.644031+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.643965+0000","last_change":"2024-09-11T22:19:03.643965+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.643965+0000","last_undegraded":"2024-09-11T22:19:03.643965+0000","last_fullsized":"2024-09-11T22:19:03.643965+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221170+0000","last_change":"2024-09-11T22:19:04.602111+0000","last_active":"2024-09-11T22:19:06.221170+0000","last_peered":"2024-09-11T22:19:06.221170+0000","last_clean":"2024-09-11T22:19:06.221170+0000","last_became_active":"2024-09-11T22:19:04.601787+0000","last_became_peered":"2024-09-11T22:19:04.601787+0000","last_unstale":"2024-09-11T22:19:06.221170+0000","last_undegraded":"2024-09-11T22:19:06.221170+0000","last_fullsized":"2024-09-11T22:19:06.221170+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:52.810353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647353+0000","last_change":"2024-09-11T22:19:03.647353+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647353+0000","last_undegraded":"2024-09-11T22:19:03.647353+0000","last_fullsized":"2024-09-11T22:19:03.647353+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221867+0000","last_change":"2024-09-11T22:19:04.602158+0000","last_active":"2024-09-11T22:19:06.221867+0000","last_peered":"2024-09-11T22:19:06.221867+0000","last_clean":"2024-09-11T22:19:06.221867+0000","last_became_active":"2024-09-11T22:19:04.601160+0000","last_became_peered":"2024-09-11T22:19:04.601160+0000","last_unstale":"2024-09-11T22:19:06.221867+0000","last_undegraded":"2024-09-11T22:19:06.221867+0000","last_fullsized":"2024-09-11T22:19:06.221867+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:57.657597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221384+0000","last_change":"2024-09-11T22:19:04.607266+0000","last_active":"2024-09-11T22:19:06.221384+0000","last_peered":"2024-09-11T22:19:06.221384+0000","last_clean":"2024-09-11T22:19:06.221384+0000","last_became_active":"2024-09-11T22:19:04.606798+0000","last_became_peered":"2024-09-11T22:19:04.606798+0000","last_unstale":"2024-09-11T22:19:06.221384+0000","last_undegraded":"2024-09-11T22:19:06.221384+0000","last_fullsized":"2024-09-11T22:19:06.221384+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:54.948029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220650+0000","last_change":"2024-09-11T22:19:04.607858+0000","last_active":"2024-09-11T22:19:06.220650+0000","last_peered":"2024-09-11T22:19:06.220650+0000","last_clean":"2024-09-11T22:19:06.220650+0000","last_became_active":"2024-09-11T22:19:04.607583+0000","last_became_peered":"2024-09-11T22:19:04.607583+0000","last_unstale":"2024-09-11T22:19:06.220650+0000","last_undegraded":"2024-09-11T22:19:06.220650+0000","last_fullsized":"2024-09-11T22:19:06.220650+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:38.749909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646409+0000","last_change":"2024-09-11T22:19:03.646409+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646409+0000","last_undegraded":"2024-09-11T22:19:03.646409+0000","last_fullsized":"2024-09-11T22:19:03.646409+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.643125+0000","last_change":"2024-09-11T22:19:03.643125+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.643125+0000","last_undegraded":"2024-09-11T22:19:03.643125+0000","last_fullsized":"2024-09-11T22:19:03.643125+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"131'4","reported_seq":18,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221244+0000","last_change":"2024-09-11T22:19:03.657633+0000","last_active":"2024-09-11T22:19:06.221244+0000","last_peered":"2024-09-11T22:19:06.221244+0000","last_clean":"2024-09-11T22:19:06.221244+0000","last_became_active":"2024-09-11T22:19:03.657372+0000","last_became_peered":"2024-09-11T22:19:03.657372+0000","last_unstale":"2024-09-11T22:19:06.221244+0000","last_undegraded":"2024-09-11T22:19:06.221244+0000","last_fullsized":"2024-09-11T22:19:06.221244+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:37.662172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646417+0000","last_change":"2024-09-11T22:19:03.646417+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646417+0000","last_undegraded":"2024-09-11T22:19:03.646417+0000","last_fullsized":"2024-09-11T22:19:03.646417+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.655005+0000","last_change":"2024-09-11T22:19:03.652664+0000","last_active":"2024-09-11T22:19:03.655005+0000","last_peered":"2024-09-11T22:19:03.655005+0000","last_clean":"2024-09-11T22:19:03.655005+0000","last_became_active":"2024-09-11T22:19:03.652377+0000","last_became_peered":"2024-09-11T22:19:03.652377+0000","last_unstale":"2024-09-11T22:19:03.655005+0000","last_undegraded":"2024-09-11T22:19:03.655005+0000","last_fullsized":"2024-09-11T22:19:03.655005+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:59.990828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221101+0000","last_change":"2024-09-11T22:19:04.607846+0000","last_active":"2024-09-11T22:19:06.221101+0000","last_peered":"2024-09-11T22:19:06.221101+0000","last_clean":"2024-09-11T22:19:06.221101+0000","last_became_active":"2024-09-11T22:19:04.607539+0000","last_became_peered":"2024-09-11T22:19:04.607539+0000","last_unstale":"2024-09-11T22:19:06.221101+0000","last_undegraded":"2024-09-11T22:19:06.221101+0000","last_fullsized":"2024-09-11T22:19:06.221101+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:39.137292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.647048+0000","last_change":"2024-09-11T22:19:03.646165+0000","last_active":"2024-09-11T22:19:03.647048+0000","last_peered":"2024-09-11T22:19:03.647048+0000","last_clean":"2024-09-11T22:19:03.647048+0000","last_became_active":"2024-09-11T22:19:03.644773+0000","last_became_peered":"2024-09-11T22:19:03.644773+0000","last_unstale":"2024-09-11T22:19:03.647048+0000","last_undegraded":"2024-09-11T22:19:03.647048+0000","last_fullsized":"2024-09-11T22:19:03.647048+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:16.119947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221299+0000","last_change":"2024-09-11T22:19:04.608209+0000","last_active":"2024-09-11T22:19:06.221299+0000","last_peered":"2024-09-11T22:19:06.221299+0000","last_clean":"2024-09-11T22:19:06.221299+0000","last_became_active":"2024-09-11T22:19:04.607723+0000","last_became_peered":"2024-09-11T22:19:04.607723+0000","last_unstale":"2024-09-11T22:19:06.221299+0000","last_undegraded":"2024-09-11T22:19:06.221299+0000","last_fullsized":"2024-09-11T22:19:06.221299+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:29.361777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.651364+0000","last_change":"2024-09-11T22:19:03.649748+0000","last_active":"2024-09-11T22:19:03.651364+0000","last_peered":"2024-09-11T22:19:03.651364+0000","last_clean":"2024-09-11T22:19:03.651364+0000","last_became_active":"2024-09-11T22:19:03.649467+0000","last_became_peered":"2024-09-11T22:19:03.649467+0000","last_unstale":"2024-09-11T22:19:03.651364+0000","last_undegraded":"2024-09-11T22:19:03.651364+0000","last_fullsized":"2024-09-11T22:19:03.651364+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:49.291515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.642694+0000","last_change":"2024-09-11T22:19:03.642694+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.642694+0000","last_undegraded":"2024-09-11T22:19:03.642694+0000","last_fullsized":"2024-09-11T22:19:03.642694+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.649957+0000","last_change":"2024-09-11T22:19:03.649522+0000","last_active":"2024-09-11T22:19:03.649957+0000","last_peered":"2024-09-11T22:19:03.649957+0000","last_clean":"2024-09-11T22:19:03.649957+0000","last_became_active":"2024-09-11T22:19:03.649244+0000","last_became_peered":"2024-09-11T22:19:03.649244+0000","last_unstale":"2024-09-11T22:19:03.649957+0000","last_undegraded":"2024-09-11T22:19:03.649957+0000","last_fullsized":"2024-09-11T22:19:03.649957+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:18.435337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646636+0000","last_change":"2024-09-11T22:19:03.646636+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646636+0000","last_undegraded":"2024-09-11T22:19:03.646636+0000","last_fullsized":"2024-09-11T22:19:03.646636+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.654369+0000","last_change":"2024-09-11T22:19:03.651101+0000","last_active":"2024-09-11T22:19:03.654369+0000","last_peered":"2024-09-11T22:19:03.654369+0000","last_clean":"2024-09-11T22:19:03.654369+0000","last_became_active":"2024-09-11T22:19:03.650795+0000","last_became_peered":"2024-09-11T22:19:03.650795+0000","last_unstale":"2024-09-11T22:19:03.654369+0000","last_undegraded":"2024-09-11T22:19:03.654369+0000","last_fullsized":"2024-09-11T22:19:03.654369+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:00.676418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647684+0000","last_change":"2024-09-11T22:19:03.647684+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647684+0000","last_undegraded":"2024-09-11T22:19:03.647684+0000","last_fullsized":"2024-09-11T22:19:03.647684+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.659911+0000","last_change":"2024-09-11T22:19:03.659081+0000","last_active":"2024-09-11T22:19:03.659911+0000","last_peered":"2024-09-11T22:19:03.659911+0000","last_clean":"2024-09-11T22:19:03.659911+0000","last_became_active":"2024-09-11T22:19:03.658782+0000","last_became_peered":"2024-09-11T22:19:03.658782+0000","last_unstale":"2024-09-11T22:19:03.659911+0000","last_undegraded":"2024-09-11T22:19:03.659911+0000","last_fullsized":"2024-09-11T22:19:03.659911+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:29.073410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644799+0000","last_change":"2024-09-11T22:19:03.644799+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644799+0000","last_undegraded":"2024-09-11T22:19:03.644799+0000","last_fullsized":"2024-09-11T22:19:03.644799+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.658351+0000","last_change":"2024-09-11T22:19:03.656863+0000","last_active":"2024-09-11T22:19:03.658351+0000","last_peered":"2024-09-11T22:19:03.658351+0000","last_clean":"2024-09-11T22:19:03.658351+0000","last_became_active":"2024-09-11T22:19:03.656244+0000","last_became_peered":"2024-09-11T22:19:03.656244+0000","last_unstale":"2024-09-11T22:19:03.658351+0000","last_undegraded":"2024-09-11T22:19:03.658351+0000","last_fullsized":"2024-09-11T22:19:03.658351+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:58.333628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221522+0000","last_change":"2024-09-11T22:19:04.599432+0000","last_active":"2024-09-11T22:19:06.221522+0000","last_peered":"2024-09-11T22:19:06.221522+0000","last_clean":"2024-09-11T22:19:06.221522+0000","last_became_active":"2024-09-11T22:19:04.599151+0000","last_became_peered":"2024-09-11T22:19:04.599151+0000","last_unstale":"2024-09-11T22:19:06.221522+0000","last_undegraded":"2024-09-11T22:19:06.221522+0000","last_fullsized":"2024-09-11T22:19:06.221522+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:06.264509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.654350+0000","last_change":"2024-09-11T22:19:03.652549+0000","last_active":"2024-09-11T22:19:03.654350+0000","last_peered":"2024-09-11T22:19:03.654350+0000","last_clean":"2024-09-11T22:19:03.654350+0000","last_became_active":"2024-09-11T22:19:03.652228+0000","last_became_peered":"2024-09-11T22:19:03.652228+0000","last_unstale":"2024-09-11T22:19:03.654350+0000","last_undegraded":"2024-09-11T22:19:03.654350+0000","last_fullsized":"2024-09-11T22:19:03.654350+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:58.333628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.651017+0000","last_change":"2024-09-11T22:19:03.651017+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.651017+0000","last_undegraded":"2024-09-11T22:19:03.651017+0000","last_fullsized":"2024-09-11T22:19:03.651017+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.658221+0000","last_change":"2024-09-11T22:19:03.657825+0000","last_active":"2024-09-11T22:19:03.658221+0000","last_peered":"2024-09-11T22:19:03.658221+0000","last_clean":"2024-09-11T22:19:03.658221+0000","last_became_active":"2024-09-11T22:19:03.657543+0000","last_became_peered":"2024-09-11T22:19:03.657543+0000","last_unstale":"2024-09-11T22:19:03.658221+0000","last_undegraded":"2024-09-11T22:19:03.658221+0000","last_fullsized":"2024-09-11T22:19:03.658221+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:23.987707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221245+0000","last_change":"2024-09-11T22:19:04.605484+0000","last_active":"2024-09-11T22:19:06.221245+0000","last_peered":"2024-09-11T22:19:06.221245+0000","last_clean":"2024-09-11T22:19:06.221245+0000","last_became_active":"2024-09-11T22:19:04.605208+0000","last_became_peered":"2024-09-11T22:19:04.605208+0000","last_unstale":"2024-09-11T22:19:06.221245+0000","last_undegraded":"2024-09-11T22:19:06.221245+0000","last_fullsized":"2024-09-11T22:19:06.221245+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:20.257908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657853+0000","last_change":"2024-09-11T22:19:03.656806+0000","last_active":"2024-09-11T22:19:03.657853+0000","last_peered":"2024-09-11T22:19:03.657853+0000","last_clean":"2024-09-11T22:19:03.657853+0000","last_became_active":"2024-09-11T22:19:03.656469+0000","last_became_peered":"2024-09-11T22:19:03.656469+0000","last_unstale":"2024-09-11T22:19:03.657853+0000","last_undegraded":"2024-09-11T22:19:03.657853+0000","last_fullsized":"2024-09-11T22:19:03.657853+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:04.062844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221354+0000","last_change":"2024-09-11T22:19:04.605154+0000","last_active":"2024-09-11T22:19:06.221354+0000","last_peered":"2024-09-11T22:19:06.221354+0000","last_clean":"2024-09-11T22:19:06.221354+0000","last_became_active":"2024-09-11T22:19:04.604838+0000","last_became_peered":"2024-09-11T22:19:04.604838+0000","last_unstale":"2024-09-11T22:19:06.221354+0000","last_undegraded":"2024-09-11T22:19:06.221354+0000","last_fullsized":"2024-09-11T22:19:06.221354+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:14.391949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.659642+0000","last_change":"2024-09-11T22:19:03.658102+0000","last_active":"2024-09-11T22:19:03.659642+0000","last_peered":"2024-09-11T22:19:03.659642+0000","last_clean":"2024-09-11T22:19:03.659642+0000","last_became_active":"2024-09-11T22:19:03.657816+0000","last_became_peered":"2024-09-11T22:19:03.657816+0000","last_unstale":"2024-09-11T22:19:03.659642+0000","last_undegraded":"2024-09-11T22:19:03.659642+0000","last_fullsized":"2024-09-11T22:19:03.659642+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221877+0000","last_change":"2024-09-11T22:19:04.598642+0000","last_active":"2024-09-11T22:19:06.221877+0000","last_peered":"2024-09-11T22:19:06.221877+0000","last_clean":"2024-09-11T22:19:06.221877+0000","last_became_active":"2024-09-11T22:19:04.598329+0000","last_became_peered":"2024-09-11T22:19:04.598329+0000","last_unstale":"2024-09-11T22:19:06.221877+0000","last_undegraded":"2024-09-11T22:19:06.221877+0000","last_fullsized":"2024-09-11T22:19:06.221877+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:27.785617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221244+0000","last_change":"2024-09-11T22:19:03.652627+0000","last_active":"2024-09-11T22:19:06.221244+0000","last_peered":"2024-09-11T22:19:06.221244+0000","last_clean":"2024-09-11T22:19:06.221244+0000","last_became_active":"2024-09-11T22:19:03.652320+0000","last_became_peered":"2024-09-11T22:19:03.652320+0000","last_unstale":"2024-09-11T22:19:06.221244+0000","last_undegraded":"2024-09-11T22:19:06.221244+0000","last_fullsized":"2024-09-11T22:19:06.221244+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:23.173009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645070+0000","last_change":"2024-09-11T22:19:03.645070+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645070+0000","last_undegraded":"2024-09-11T22:19:03.645070+0000","last_fullsized":"2024-09-11T22:19:03.645070+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.658634+0000","last_change":"2024-09-11T22:19:03.657984+0000","last_active":"2024-09-11T22:19:03.658634+0000","last_peered":"2024-09-11T22:19:03.658634+0000","last_clean":"2024-09-11T22:19:03.658634+0000","last_became_active":"2024-09-11T22:19:03.657671+0000","last_became_peered":"2024-09-11T22:19:03.657671+0000","last_unstale":"2024-09-11T22:19:03.658634+0000","last_undegraded":"2024-09-11T22:19:03.658634+0000","last_fullsized":"2024-09-11T22:19:03.658634+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:59.990828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.649683+0000","last_change":"2024-09-11T22:19:03.649683+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.649683+0000","last_undegraded":"2024-09-11T22:19:03.649683+0000","last_fullsized":"2024-09-11T22:19:03.649683+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.659686+0000","last_change":"2024-09-11T22:19:03.658740+0000","last_active":"2024-09-11T22:19:03.659686+0000","last_peered":"2024-09-11T22:19:03.659686+0000","last_clean":"2024-09-11T22:19:03.659686+0000","last_became_active":"2024-09-11T22:19:03.658380+0000","last_became_peered":"2024-09-11T22:19:03.658380+0000","last_unstale":"2024-09-11T22:19:03.659686+0000","last_undegraded":"2024-09-11T22:19:03.659686+0000","last_fullsized":"2024-09-11T22:19:03.659686+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:04.183505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.651524+0000","last_change":"2024-09-11T22:19:03.651524+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.651524+0000","last_undegraded":"2024-09-11T22:19:03.651524+0000","last_fullsized":"2024-09-11T22:19:03.651524+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.660408+0000","last_change":"2024-09-11T22:19:03.658363+0000","last_active":"2024-09-11T22:19:03.660408+0000","last_peered":"2024-09-11T22:19:03.660408+0000","last_clean":"2024-09-11T22:19:03.660408+0000","last_became_active":"2024-09-11T22:19:03.658100+0000","last_became_peered":"2024-09-11T22:19:03.658100+0000","last_unstale":"2024-09-11T22:19:03.660408+0000","last_undegraded":"2024-09-11T22:19:03.660408+0000","last_fullsized":"2024-09-11T22:19:03.660408+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:18.904813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.650603+0000","last_change":"2024-09-11T22:19:03.650603+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.650603+0000","last_undegraded":"2024-09-11T22:19:03.650603+0000","last_fullsized":"2024-09-11T22:19:03.650603+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657204+0000","last_change":"2024-09-11T22:19:03.655955+0000","last_active":"2024-09-11T22:19:03.657204+0000","last_peered":"2024-09-11T22:19:03.657204+0000","last_clean":"2024-09-11T22:19:03.657204+0000","last_became_active":"2024-09-11T22:19:03.655394+0000","last_became_peered":"2024-09-11T22:19:03.655394+0000","last_unstale":"2024-09-11T22:19:03.657204+0000","last_undegraded":"2024-09-11T22:19:03.657204+0000","last_fullsized":"2024-09-11T22:19:03.657204+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:02.941518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.643335+0000","last_change":"2024-09-11T22:19:03.643335+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.643335+0000","last_undegraded":"2024-09-11T22:19:03.643335+0000","last_fullsized":"2024-09-11T22:19:03.643335+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.660133+0000","last_change":"2024-09-11T22:19:03.659192+0000","last_active":"2024-09-11T22:19:03.660133+0000","last_peered":"2024-09-11T22:19:03.660133+0000","last_clean":"2024-09-11T22:19:03.660133+0000","last_became_active":"2024-09-11T22:19:03.658919+0000","last_became_peered":"2024-09-11T22:19:03.658919+0000","last_unstale":"2024-09-11T22:19:03.660133+0000","last_undegraded":"2024-09-11T22:19:03.660133+0000","last_fullsized":"2024-09-11T22:19:03.660133+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:49.845665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646303+0000","last_change":"2024-09-11T22:19:03.646303+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646303+0000","last_undegraded":"2024-09-11T22:19:03.646303+0000","last_fullsized":"2024-09-11T22:19:03.646303+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.654959+0000","last_change":"2024-09-11T22:19:03.652729+0000","last_active":"2024-09-11T22:19:03.654959+0000","last_peered":"2024-09-11T22:19:03.654959+0000","last_clean":"2024-09-11T22:19:03.654959+0000","last_became_active":"2024-09-11T22:19:03.652408+0000","last_became_peered":"2024-09-11T22:19:03.652408+0000","last_unstale":"2024-09-11T22:19:03.654959+0000","last_undegraded":"2024-09-11T22:19:03.654959+0000","last_fullsized":"2024-09-11T22:19:03.654959+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:53.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221136+0000","last_change":"2024-09-11T22:19:04.601130+0000","last_active":"2024-09-11T22:19:06.221136+0000","last_peered":"2024-09-11T22:19:06.221136+0000","last_clean":"2024-09-11T22:19:06.221136+0000","last_became_active":"2024-09-11T22:19:04.600847+0000","last_became_peered":"2024-09-11T22:19:04.600847+0000","last_unstale":"2024-09-11T22:19:06.221136+0000","last_undegraded":"2024-09-11T22:19:06.221136+0000","last_fullsized":"2024-09-11T22:19:06.221136+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:23.840570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.652877+0000","last_change":"2024-09-11T22:19:03.651763+0000","last_active":"2024-09-11T22:19:03.652877+0000","last_peered":"2024-09-11T22:19:03.652877+0000","last_clean":"2024-09-11T22:19:03.652877+0000","last_became_active":"2024-09-11T22:19:03.651464+0000","last_became_peered":"2024-09-11T22:19:03.651464+0000","last_unstale":"2024-09-11T22:19:03.652877+0000","last_undegraded":"2024-09-11T22:19:03.652877+0000","last_fullsized":"2024-09-11T22:19:03.652877+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.624771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645738+0000","last_change":"2024-09-11T22:19:03.645738+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645738+0000","last_undegraded":"2024-09-11T22:19:03.645738+0000","last_fullsized":"2024-09-11T22:19:03.645738+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657471+0000","last_change":"2024-09-11T22:19:03.656329+0000","last_active":"2024-09-11T22:19:03.657471+0000","last_peered":"2024-09-11T22:19:03.657471+0000","last_clean":"2024-09-11T22:19:03.657471+0000","last_became_active":"2024-09-11T22:19:03.656010+0000","last_became_peered":"2024-09-11T22:19:03.656010+0000","last_unstale":"2024-09-11T22:19:03.657471+0000","last_undegraded":"2024-09-11T22:19:03.657471+0000","last_fullsized":"2024-09-11T22:19:03.657471+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:56.317365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644128+0000","last_change":"2024-09-11T22:19:03.644128+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644128+0000","last_undegraded":"2024-09-11T22:19:03.644128+0000","last_fullsized":"2024-09-11T22:19:03.644128+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.654935+0000","last_change":"2024-09-11T22:19:03.652845+0000","last_active":"2024-09-11T22:19:03.654935+0000","last_peered":"2024-09-11T22:19:03.654935+0000","last_clean":"2024-09-11T22:19:03.654935+0000","last_became_active":"2024-09-11T22:19:03.651928+0000","last_became_peered":"2024-09-11T22:19:03.651928+0000","last_unstale":"2024-09-11T22:19:03.654935+0000","last_undegraded":"2024-09-11T22:19:03.654935+0000","last_fullsized":"2024-09-11T22:19:03.654935+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:16.168301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220474+0000","last_change":"2024-09-11T22:19:04.607489+0000","last_active":"2024-09-11T22:19:06.220474+0000","last_peered":"2024-09-11T22:19:06.220474+0000","last_clean":"2024-09-11T22:19:06.220474+0000","last_became_active":"2024-09-11T22:19:04.606950+0000","last_became_peered":"2024-09-11T22:19:04.606950+0000","last_unstale":"2024-09-11T22:19:06.220474+0000","last_undegraded":"2024-09-11T22:19:06.220474+0000","last_fullsized":"2024-09-11T22:19:06.220474+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:55.783154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657103+0000","last_change":"2024-09-11T22:19:03.655592+0000","last_active":"2024-09-11T22:19:03.657103+0000","last_peered":"2024-09-11T22:19:03.657103+0000","last_clean":"2024-09-11T22:19:03.657103+0000","last_became_active":"2024-09-11T22:19:03.655319+0000","last_became_peered":"2024-09-11T22:19:03.655319+0000","last_unstale":"2024-09-11T22:19:03.657103+0000","last_undegraded":"2024-09-11T22:19:03.657103+0000","last_fullsized":"2024-09-11T22:19:03.657103+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:10.586681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.648516+0000","last_change":"2024-09-11T22:19:03.648516+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.648516+0000","last_undegraded":"2024-09-11T22:19:03.648516+0000","last_fullsized":"2024-09-11T22:19:03.648516+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221624+0000","last_change":"2024-09-11T22:19:03.653122+0000","last_active":"2024-09-11T22:19:06.221624+0000","last_peered":"2024-09-11T22:19:06.221624+0000","last_clean":"2024-09-11T22:19:06.221624+0000","last_became_active":"2024-09-11T22:19:03.652733+0000","last_became_peered":"2024-09-11T22:19:03.652733+0000","last_unstale":"2024-09-11T22:19:06.221624+0000","last_undegraded":"2024-09-11T22:19:06.221624+0000","last_fullsized":"2024-09-11T22:19:06.221624+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:46.127177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221677+0000","last_change":"2024-09-11T22:19:04.607324+0000","last_active":"2024-09-11T22:19:06.221677+0000","last_peered":"2024-09-11T22:19:06.221677+0000","last_clean":"2024-09-11T22:19:06.221677+0000","last_became_active":"2024-09-11T22:19:04.606948+0000","last_became_peered":"2024-09-11T22:19:04.606948+0000","last_unstale":"2024-09-11T22:19:06.221677+0000","last_undegraded":"2024-09-11T22:19:06.221677+0000","last_fullsized":"2024-09-11T22:19:06.221677+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:42.474866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"132'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.644363+0000","last_change":"2024-09-11T22:19:03.658179+0000","last_active":"2024-09-11T22:19:06.644363+0000","last_peered":"2024-09-11T22:19:06.644363+0000","last_clean":"2024-09-11T22:19:06.644363+0000","last_became_active":"2024-09-11T22:19:03.657895+0000","last_became_peered":"2024-09-11T22:19:03.657895+0000","last_unstale":"2024-09-11T22:19:06.644363+0000","last_undegraded":"2024-09-11T22:19:06.644363+0000","last_fullsized":"2024-09-11T22:19:06.644363+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:08.667757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645750+0000","last_change":"2024-09-11T22:19:03.645750+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645750+0000","last_undegraded":"2024-09-11T22:19:03.645750+0000","last_fullsized":"2024-09-11T22:19:03.645750+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657453+0000","last_change":"2024-09-11T22:19:03.656565+0000","last_active":"2024-09-11T22:19:03.657453+0000","last_peered":"2024-09-11T22:19:03.657453+0000","last_clean":"2024-09-11T22:19:03.657453+0000","last_became_active":"2024-09-11T22:19:03.656260+0000","last_became_peered":"2024-09-11T22:19:03.656260+0000","last_unstale":"2024-09-11T22:19:03.657453+0000","last_undegraded":"2024-09-11T22:19:03.657453+0000","last_fullsized":"2024-09-11T22:19:03.657453+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.624771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646960+0000","last_change":"2024-09-11T22:19:03.646960+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646960+0000","last_undegraded":"2024-09-11T22:19:03.646960+0000","last_fullsized":"2024-09-11T22:19:03.646960+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.651353+0000","last_change":"2024-09-11T22:19:03.649388+0000","last_active":"2024-09-11T22:19:03.651353+0000","last_peered":"2024-09-11T22:19:03.651353+0000","last_clean":"2024-09-11T22:19:03.651353+0000","last_became_active":"2024-09-11T22:19:03.649080+0000","last_became_peered":"2024-09-11T22:19:03.649080+0000","last_unstale":"2024-09-11T22:19:03.651353+0000","last_undegraded":"2024-09-11T22:19:03.651353+0000","last_fullsized":"2024-09-11T22:19:03.651353+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:59.208623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220720+0000","last_change":"2024-09-11T22:19:04.607362+0000","last_active":"2024-09-11T22:19:06.220720+0000","last_peered":"2024-09-11T22:19:06.220720+0000","last_clean":"2024-09-11T22:19:06.220720+0000","last_became_active":"2024-09-11T22:19:04.607063+0000","last_became_peered":"2024-09-11T22:19:04.607063+0000","last_unstale":"2024-09-11T22:19:06.220720+0000","last_undegraded":"2024-09-11T22:19:06.220720+0000","last_fullsized":"2024-09-11T22:19:06.220720+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:59.918367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.659606+0000","last_change":"2024-09-11T22:19:03.659074+0000","last_active":"2024-09-11T22:19:03.659606+0000","last_peered":"2024-09-11T22:19:03.659606+0000","last_clean":"2024-09-11T22:19:03.659606+0000","last_became_active":"2024-09-11T22:19:03.658750+0000","last_became_peered":"2024-09-11T22:19:03.658750+0000","last_unstale":"2024-09-11T22:19:03.659606+0000","last_undegraded":"2024-09-11T22:19:03.659606+0000","last_fullsized":"2024-09-11T22:19:03.659606+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:53.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646875+0000","last_change":"2024-09-11T22:19:03.646875+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646875+0000","last_undegraded":"2024-09-11T22:19:03.646875+0000","last_fullsized":"2024-09-11T22:19:03.646875+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220823+0000","last_change":"2024-09-11T22:19:03.657654+0000","last_active":"2024-09-11T22:19:06.220823+0000","last_peered":"2024-09-11T22:19:06.220823+0000","last_clean":"2024-09-11T22:19:06.220823+0000","last_became_active":"2024-09-11T22:19:03.657357+0000","last_became_peered":"2024-09-11T22:19:03.657357+0000","last_unstale":"2024-09-11T22:19:06.220823+0000","last_undegraded":"2024-09-11T22:19:06.220823+0000","last_fullsized":"2024-09-11T22:19:06.220823+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:51.252945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.642253+0000","last_change":"2024-09-11T22:19:03.642253+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.642253+0000","last_undegraded":"2024-09-11T22:19:03.642253+0000","last_fullsized":"2024-09-11T22:19:03.642253+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657879+0000","last_change":"2024-09-11T22:19:03.657049+0000","last_active":"2024-09-11T22:19:03.657879+0000","last_peered":"2024-09-11T22:19:03.657879+0000","last_clean":"2024-09-11T22:19:03.657879+0000","last_became_active":"2024-09-11T22:19:03.656761+0000","last_became_peered":"2024-09-11T22:19:03.656761+0000","last_unstale":"2024-09-11T22:19:03.657879+0000","last_undegraded":"2024-09-11T22:19:03.657879+0000","last_fullsized":"2024-09-11T22:19:03.657879+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:02.231666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644367+0000","last_change":"2024-09-11T22:19:03.644367+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644367+0000","last_undegraded":"2024-09-11T22:19:03.644367+0000","last_fullsized":"2024-09-11T22:19:03.644367+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.655602+0000","last_change":"2024-09-11T22:19:03.652831+0000","last_active":"2024-09-11T22:19:03.655602+0000","last_peered":"2024-09-11T22:19:03.655602+0000","last_clean":"2024-09-11T22:19:03.655602+0000","last_became_active":"2024-09-11T22:19:03.652532+0000","last_became_peered":"2024-09-11T22:19:03.652532+0000","last_unstale":"2024-09-11T22:19:03.655602+0000","last_undegraded":"2024-09-11T22:19:03.655602+0000","last_fullsized":"2024-09-11T22:19:03.655602+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:24.912463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220918+0000","last_change":"2024-09-11T22:19:04.607288+0000","last_active":"2024-09-11T22:19:06.220918+0000","last_peered":"2024-09-11T22:19:06.220918+0000","last_clean":"2024-09-11T22:19:06.220918+0000","last_became_active":"2024-09-11T22:19:04.606876+0000","last_became_peered":"2024-09-11T22:19:04.606876+0000","last_unstale":"2024-09-11T22:19:06.220918+0000","last_undegraded":"2024-09-11T22:19:06.220918+0000","last_fullsized":"2024-09-11T22:19:06.220918+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.340880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221001+0000","last_change":"2024-09-11T22:19:03.660606+0000","last_active":"2024-09-11T22:19:06.221001+0000","last_peered":"2024-09-11T22:19:06.221001+0000","last_clean":"2024-09-11T22:19:06.221001+0000","last_became_active":"2024-09-11T22:19:03.660282+0000","last_became_peered":"2024-09-11T22:19:03.660282+0000","last_unstale":"2024-09-11T22:19:06.221001+0000","last_undegraded":"2024-09-11T22:19:06.221001+0000","last_fullsized":"2024-09-11T22:19:06.221001+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.710149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":372,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220377+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:19:06.220377+0000","last_peered":"2024-09-11T22:19:06.220377+0000","last_clean":"2024-09-11T22:19:06.220377+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:19:06.220377+0000","last_undegraded":"2024-09-11T22:19:06.220377+0000","last_fullsized":"2024-09-11T22:19:06.220377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46656,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325184,"statfs":{"total":96636764160,"available":96588988416,"internally_reserved":0,"allocated":1613824,"data_stored":705343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45244,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326596,"statfs":{"total":96636764160,"available":96590434304,"internally_reserved":0,"allocated":1613824,"data_stored":705343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50820,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321020,"statfs":{"total":96636764160,"available":96584724480,"internally_reserved":0,"allocated":1613824,"data_stored":705343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54968,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316872,"statfs":{"total":96636764160,"available":96580476928,"internally_reserved":0,"allocated":1601536,"data_stored":699068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59132,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312708,"statfs":{"total":96636764160,"available":96576212992,"internally_reserved":0,"allocated":1613824,"data_stored":705343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509539,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55552,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316288,"statfs":{"total":96636764160,"available":96579878912,"internally_reserved":0,"allocated":2207744,"data_stored":1295711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47288,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324552,"statfs":{"total":96636764160,"available":96588341248,"internally_reserved":0,"allocated":2256896,"data_stored":1311036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59152,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312688,"statfs":{"total":96636764160,"available":96576192512,"internally_reserved":0,"allocated":1634304,"data_stored":712734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:19:08.986 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:19:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.124+0000 7fc6c082e640 1 Processor -- start 2024-09-11T22:19:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.124+0000 7fc6c082e640 1 -- start start 2024-09-11T22:19:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6c082e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6bc0cf580 0x7fc6bc0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6c082e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6bc0cdd50 0x7fc6bc06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6c082e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6bc0ce5f0 con 0x7fc6bc15e840 2024-09-11T22:19:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6c082e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc6bc06c240 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6c082e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6bc0d0470 con 0x7fc6bc0cf580 2024-09-11T22:19:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6bad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6bc0cdd50 0x7fc6bc06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6bad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6bc0cdd50 0x7fc6bc06c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56774/0 (socket says 172.21.15.50:56774) 2024-09-11T22:19:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6bad9d640 1 -- 172.21.15.50:0/900871291 learned_addr learned my addr 172.21.15.50:0/900871291 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6b9d9b640 1 --2- 172.21.15.50:0/900871291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6bc0cf580 0x7fc6bc0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6bad9d640 1 -- 172.21.15.50:0/900871291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6bc0cf580 msgr2=0x7fc6bc0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6bad9d640 1 --2- 172.21.15.50:0/900871291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6bc0cf580 0x7fc6bc0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6bad9d640 1 -- 172.21.15.50:0/900871291 >> v1:172.21.15.77:6789/0 conn(0x7fc6bc15e840 legacy=0x7fc6bc0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6bad9d640 1 -- 172.21.15.50:0/900871291 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc0ce310 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.125+0000 7fc6b9d9b640 1 --2- 172.21.15.50:0/900871291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6bc0cf580 0x7fc6bc0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.126+0000 7fc6bad9d640 1 --2- 172.21.15.50:0/900871291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0cdd50 0x7fc6bc06c6d0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009e50 tx=0x7fc6b402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b49da37ce0530d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.126+0000 7fc6b959a640 1 -- 172.21.15.50:0/900871291 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4036070 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.126+0000 7fc6b959a640 1 -- 172.21.15.50:0/900871291 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b4031600 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.126+0000 7fc6b959a640 1 -- 172.21.15.50:0/900871291 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b40319d0 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.127+0000 7fc6c082e640 1 -- 172.21.15.50:0/900871291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0cdd50 msgr2=0x7fc6bc06c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.127+0000 7fc6c082e640 1 --2- 172.21.15.50:0/900871291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0cdd50 0x7fc6bc06c6d0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009e50 tx=0x7fc6b402a710 comp rx=0 tx=0).stop 2024-09-11T22:19:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.127+0000 7fc6c082e640 1 -- 172.21.15.50:0/900871291 shutdown_connections 2024-09-11T22:19:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.127+0000 7fc6c082e640 1 --2- 172.21.15.50:0/900871291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0cdd50 0x7fc6bc06c6d0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.127+0000 7fc6c082e640 1 --2- 172.21.15.50:0/900871291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6bc0cf580 0x7fc6bc0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.127+0000 7fc6c082e640 1 -- 172.21.15.50:0/900871291 >> 172.21.15.50:0/900871291 conn(0x7fc6bc0b4150 msgr2=0x7fc6bc0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.127+0000 7fc6c082e640 1 -- 172.21.15.50:0/900871291 shutdown_connections 2024-09-11T22:19:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.127+0000 7fc6c082e640 1 -- 172.21.15.50:0/900871291 wait complete. 2024-09-11T22:19:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.128+0000 7fc6c082e640 1 Processor -- start 2024-09-11T22:19:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.128+0000 7fc6c082e640 1 -- start start 2024-09-11T22:19:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6c082e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0cdd50 0x7fc6bc0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6c082e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6bc0cf580 0x7fc6bc15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6c082e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6bc15e840 0x7fc6bc155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6c082e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc15ec20 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6c082e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc06bed0 con 0x7fc6bc15e840 2024-09-11T22:19:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6c082e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6bc15eda0 con 0x7fc6bc0cf580 2024-09-11T22:19:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6ba59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0cdd50 0x7fc6bc0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6ba59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0cdd50 0x7fc6bc0cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56786/0 (socket says 172.21.15.50:56786) 2024-09-11T22:19:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6ba59c640 1 -- 172.21.15.50:0/674919601 learned_addr learned my addr 172.21.15.50:0/674919601 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6bad9d640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6bc15e840 0x7fc6bc155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6b9d9b640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6bc0cf580 0x7fc6bc15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6ba59c640 1 -- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6bc0cf580 msgr2=0x7fc6bc15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6ba59c640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6bc0cf580 0x7fc6bc15efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6ba59c640 1 -- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6bc15e840 msgr2=0x7fc6bc155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6ba59c640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6bc15e840 0x7fc6bc155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.129+0000 7fc6ba59c640 1 -- 172.21.15.50:0/674919601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc15f750 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.130+0000 7fc6ba59c640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0cdd50 0x7fc6bc0cc630 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00c3f0 tx=0x7fc6ac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.130+0000 7fc6aaffd640 1 -- 172.21.15.50:0/674919601 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0052d0 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.130+0000 7fc6aaffd640 1 -- 172.21.15.50:0/674919601 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ac005490 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.130+0000 7fc6c082e640 1 -- 172.21.15.50:0/674919601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6bc15fa30 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.130+0000 7fc6aaffd640 1 -- 172.21.15.50:0/674919601 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac007260 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.130+0000 7fc6c082e640 1 -- 172.21.15.50:0/674919601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6bc15fff0 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.131+0000 7fc6c082e640 1 -- 172.21.15.50:0/674919601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6bc0b4c70 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.131+0000 7fc6aaffd640 1 -- 172.21.15.50:0/674919601 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6ac007400 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.132+0000 7fc6aaffd640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc69c06be30 0x7fc69c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.132+0000 7fc6aaffd640 1 -- 172.21.15.50:0/674919601 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fc6ac08a1e0 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.132+0000 7fc6b9d9b640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc69c06be30 0x7fc69c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.133+0000 7fc6b9d9b640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc69c06be30 0x7fc69c06e2f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc15e0a0 tx=0x7fc6b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.136+0000 7fc6aaffd640 1 -- 172.21.15.50:0/674919601 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6ac0585d0 con 0x7fc6bc0cdd50 2024-09-11T22:19:09.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.308+0000 7fc6c082e640 1 -- 172.21.15.50:0/674919601 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6bc15f4f0 con 0x7fc69c06be30 2024-09-11T22:19:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.314+0000 7fc6aaffd640 1 -- 172.21.15.50:0/674919601 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248857 (secure 0 0 0) 0x7fc6b0010840 con 0x7fc69c06be30 2024-09-11T22:19:09.318 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:09.319 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:19:09.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.317+0000 7fc6c082e640 1 -- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc69c06be30 msgr2=0x7fc69c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.317+0000 7fc6c082e640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc69c06be30 0x7fc69c06e2f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc15e0a0 tx=0x7fc6b0008040 comp rx=0 tx=0).stop 2024-09-11T22:19:09.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.317+0000 7fc6c082e640 1 -- 172.21.15.50:0/674919601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0cdd50 msgr2=0x7fc6bc0cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.317+0000 7fc6c082e640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0cdd50 0x7fc6bc0cc630 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00c3f0 tx=0x7fc6ac00c8b0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.317+0000 7fc6c082e640 1 -- 172.21.15.50:0/674919601 shutdown_connections 2024-09-11T22:19:09.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.318+0000 7fc6c082e640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc69c06be30 0x7fc69c06e2f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.318+0000 7fc6c082e640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6bc0cf580 0x7fc6bc15efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.318+0000 7fc6c082e640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6bc15e840 0x7fc6bc155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.318+0000 7fc6c082e640 1 --2- 172.21.15.50:0/674919601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0cdd50 0x7fc6bc0cc630 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.318+0000 7fc6c082e640 1 -- 172.21.15.50:0/674919601 >> 172.21.15.50:0/674919601 conn(0x7fc6bc0b4150 msgr2=0x7fc6bc070850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:09.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.318+0000 7fc6c082e640 1 -- 172.21.15.50:0/674919601 shutdown_connections 2024-09-11T22:19:09.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.318+0000 7fc6c082e640 1 -- 172.21.15.50:0/674919601 wait complete. 2024-09-11T22:19:09.329 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2024-09-11T22:19:07.479437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":418812,"kb_used_data":13824,"kb_used_omap":12,"kb_used_meta":404787,"kb_avail":754555908,"statfs":{"total":773094113280,"available":772665249792,"internally_reserved":0,"allocated":14155776,"data_stored":6839921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":414502449},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.841792"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221490+0000","last_change":"2024-09-11T22:19:04.601864+0000","last_active":"2024-09-11T22:19:06.221490+0000","last_peered":"2024-09-11T22:19:06.221490+0000","last_clean":"2024-09-11T22:19:06.221490+0000","last_became_active":"2024-09-11T22:19:04.601567+0000","last_became_peered":"2024-09-11T22:19:04.601567+0000","last_unstale":"2024-09-11T22:19:06.221490+0000","last_undegraded":"2024-09-11T22:19:06.221490+0000","last_fullsized":"2024-09-11T22:19:06.221490+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:37.691839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646967+0000","last_change":"2024-09-11T22:19:03.646967+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646967+0000","last_undegraded":"2024-09-11T22:19:03.646967+0000","last_fullsized":"2024-09-11T22:19:03.646967+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646915+0000","last_change":"2024-09-11T22:19:03.646915+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646915+0000","last_undegraded":"2024-09-11T22:19:03.646915+0000","last_fullsized":"2024-09-11T22:19:03.646915+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220838+0000","last_change":"2024-09-11T22:19:04.601956+0000","last_active":"2024-09-11T22:19:06.220838+0000","last_peered":"2024-09-11T22:19:06.220838+0000","last_clean":"2024-09-11T22:19:06.220838+0000","last_became_active":"2024-09-11T22:19:04.601249+0000","last_became_peered":"2024-09-11T22:19:04.601249+0000","last_unstale":"2024-09-11T22:19:06.220838+0000","last_undegraded":"2024-09-11T22:19:06.220838+0000","last_fullsized":"2024-09-11T22:19:06.220838+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:37.836260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220888+0000","last_change":"2024-09-11T22:19:04.600564+0000","last_active":"2024-09-11T22:19:06.220888+0000","last_peered":"2024-09-11T22:19:06.220888+0000","last_clean":"2024-09-11T22:19:06.220888+0000","last_became_active":"2024-09-11T22:19:04.600260+0000","last_became_peered":"2024-09-11T22:19:04.600260+0000","last_unstale":"2024-09-11T22:19:06.220888+0000","last_undegraded":"2024-09-11T22:19:06.220888+0000","last_fullsized":"2024-09-11T22:19:06.220888+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:28.037951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645647+0000","last_change":"2024-09-11T22:19:03.645647+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645647+0000","last_undegraded":"2024-09-11T22:19:03.645647+0000","last_fullsized":"2024-09-11T22:19:03.645647+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646415+0000","last_change":"2024-09-11T22:19:03.646415+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646415+0000","last_undegraded":"2024-09-11T22:19:03.646415+0000","last_fullsized":"2024-09-11T22:19:03.646415+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.648115+0000","last_change":"2024-09-11T22:19:03.648115+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.648115+0000","last_undegraded":"2024-09-11T22:19:03.648115+0000","last_fullsized":"2024-09-11T22:19:03.648115+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647765+0000","last_change":"2024-09-11T22:19:03.647765+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647765+0000","last_undegraded":"2024-09-11T22:19:03.647765+0000","last_fullsized":"2024-09-11T22:19:03.647765+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646359+0000","last_change":"2024-09-11T22:19:03.646359+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646359+0000","last_undegraded":"2024-09-11T22:19:03.646359+0000","last_fullsized":"2024-09-11T22:19:03.646359+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645905+0000","last_change":"2024-09-11T22:19:03.645905+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645905+0000","last_undegraded":"2024-09-11T22:19:03.645905+0000","last_fullsized":"2024-09-11T22:19:03.645905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.648618+0000","last_change":"2024-09-11T22:19:03.648618+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.648618+0000","last_undegraded":"2024-09-11T22:19:03.648618+0000","last_fullsized":"2024-09-11T22:19:03.648618+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221695+0000","last_change":"2024-09-11T22:19:04.602810+0000","last_active":"2024-09-11T22:19:06.221695+0000","last_peered":"2024-09-11T22:19:06.221695+0000","last_clean":"2024-09-11T22:19:06.221695+0000","last_became_active":"2024-09-11T22:19:04.602529+0000","last_became_peered":"2024-09-11T22:19:04.602529+0000","last_unstale":"2024-09-11T22:19:06.221695+0000","last_undegraded":"2024-09-11T22:19:06.221695+0000","last_fullsized":"2024-09-11T22:19:06.221695+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:29.956339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647340+0000","last_change":"2024-09-11T22:19:03.647340+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647340+0000","last_undegraded":"2024-09-11T22:19:03.647340+0000","last_fullsized":"2024-09-11T22:19:03.647340+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220653+0000","last_change":"2024-09-11T22:19:04.607415+0000","last_active":"2024-09-11T22:19:06.220653+0000","last_peered":"2024-09-11T22:19:06.220653+0000","last_clean":"2024-09-11T22:19:06.220653+0000","last_became_active":"2024-09-11T22:19:04.606931+0000","last_became_peered":"2024-09-11T22:19:04.606931+0000","last_unstale":"2024-09-11T22:19:06.220653+0000","last_undegraded":"2024-09-11T22:19:06.220653+0000","last_fullsized":"2024-09-11T22:19:06.220653+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:19.955155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.642771+0000","last_change":"2024-09-11T22:19:03.642771+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.642771+0000","last_undegraded":"2024-09-11T22:19:03.642771+0000","last_fullsized":"2024-09-11T22:19:03.642771+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647245+0000","last_change":"2024-09-11T22:19:03.647245+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647245+0000","last_undegraded":"2024-09-11T22:19:03.647245+0000","last_fullsized":"2024-09-11T22:19:03.647245+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644781+0000","last_change":"2024-09-11T22:19:03.644781+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644781+0000","last_undegraded":"2024-09-11T22:19:03.644781+0000","last_fullsized":"2024-09-11T22:19:03.644781+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645467+0000","last_change":"2024-09-11T22:19:03.645467+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645467+0000","last_undegraded":"2024-09-11T22:19:03.645467+0000","last_fullsized":"2024-09-11T22:19:03.645467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.643896+0000","last_change":"2024-09-11T22:19:03.643896+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.643896+0000","last_undegraded":"2024-09-11T22:19:03.643896+0000","last_fullsized":"2024-09-11T22:19:03.643896+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221080+0000","last_change":"2024-09-11T22:19:04.601152+0000","last_active":"2024-09-11T22:19:06.221080+0000","last_peered":"2024-09-11T22:19:06.221080+0000","last_clean":"2024-09-11T22:19:06.221080+0000","last_became_active":"2024-09-11T22:19:04.600735+0000","last_became_peered":"2024-09-11T22:19:04.600735+0000","last_unstale":"2024-09-11T22:19:06.221080+0000","last_undegraded":"2024-09-11T22:19:06.221080+0000","last_fullsized":"2024-09-11T22:19:06.221080+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:17.626424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644957+0000","last_change":"2024-09-11T22:19:03.644957+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644957+0000","last_undegraded":"2024-09-11T22:19:03.644957+0000","last_fullsized":"2024-09-11T22:19:03.644957+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.648306+0000","last_change":"2024-09-11T22:19:03.648306+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.648306+0000","last_undegraded":"2024-09-11T22:19:03.648306+0000","last_fullsized":"2024-09-11T22:19:03.648306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645472+0000","last_change":"2024-09-11T22:19:03.645472+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645472+0000","last_undegraded":"2024-09-11T22:19:03.645472+0000","last_fullsized":"2024-09-11T22:19:03.645472+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644031+0000","last_change":"2024-09-11T22:19:03.644031+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644031+0000","last_undegraded":"2024-09-11T22:19:03.644031+0000","last_fullsized":"2024-09-11T22:19:03.644031+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.643965+0000","last_change":"2024-09-11T22:19:03.643965+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.643965+0000","last_undegraded":"2024-09-11T22:19:03.643965+0000","last_fullsized":"2024-09-11T22:19:03.643965+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221170+0000","last_change":"2024-09-11T22:19:04.602111+0000","last_active":"2024-09-11T22:19:06.221170+0000","last_peered":"2024-09-11T22:19:06.221170+0000","last_clean":"2024-09-11T22:19:06.221170+0000","last_became_active":"2024-09-11T22:19:04.601787+0000","last_became_peered":"2024-09-11T22:19:04.601787+0000","last_unstale":"2024-09-11T22:19:06.221170+0000","last_undegraded":"2024-09-11T22:19:06.221170+0000","last_fullsized":"2024-09-11T22:19:06.221170+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:52.810353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647353+0000","last_change":"2024-09-11T22:19:03.647353+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647353+0000","last_undegraded":"2024-09-11T22:19:03.647353+0000","last_fullsized":"2024-09-11T22:19:03.647353+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221867+0000","last_change":"2024-09-11T22:19:04.602158+0000","last_active":"2024-09-11T22:19:06.221867+0000","last_peered":"2024-09-11T22:19:06.221867+0000","last_clean":"2024-09-11T22:19:06.221867+0000","last_became_active":"2024-09-11T22:19:04.601160+0000","last_became_peered":"2024-09-11T22:19:04.601160+0000","last_unstale":"2024-09-11T22:19:06.221867+0000","last_undegraded":"2024-09-11T22:19:06.221867+0000","last_fullsized":"2024-09-11T22:19:06.221867+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:57.657597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221384+0000","last_change":"2024-09-11T22:19:04.607266+0000","last_active":"2024-09-11T22:19:06.221384+0000","last_peered":"2024-09-11T22:19:06.221384+0000","last_clean":"2024-09-11T22:19:06.221384+0000","last_became_active":"2024-09-11T22:19:04.606798+0000","last_became_peered":"2024-09-11T22:19:04.606798+0000","last_unstale":"2024-09-11T22:19:06.221384+0000","last_undegraded":"2024-09-11T22:19:06.221384+0000","last_fullsized":"2024-09-11T22:19:06.221384+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:54.948029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220650+0000","last_change":"2024-09-11T22:19:04.607858+0000","last_active":"2024-09-11T22:19:06.220650+0000","last_peered":"2024-09-11T22:19:06.220650+0000","last_clean":"2024-09-11T22:19:06.220650+0000","last_became_active":"2024-09-11T22:19:04.607583+0000","last_became_peered":"2024-09-11T22:19:04.607583+0000","last_unstale":"2024-09-11T22:19:06.220650+0000","last_undegraded":"2024-09-11T22:19:06.220650+0000","last_fullsized":"2024-09-11T22:19:06.220650+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:38.749909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646409+0000","last_change":"2024-09-11T22:19:03.646409+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646409+0000","last_undegraded":"2024-09-11T22:19:03.646409+0000","last_fullsized":"2024-09-11T22:19:03.646409+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.643125+0000","last_change":"2024-09-11T22:19:03.643125+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.643125+0000","last_undegraded":"2024-09-11T22:19:03.643125+0000","last_fullsized":"2024-09-11T22:19:03.643125+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"131'4","reported_seq":18,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221244+0000","last_change":"2024-09-11T22:19:03.657633+0000","last_active":"2024-09-11T22:19:06.221244+0000","last_peered":"2024-09-11T22:19:06.221244+0000","last_clean":"2024-09-11T22:19:06.221244+0000","last_became_active":"2024-09-11T22:19:03.657372+0000","last_became_peered":"2024-09-11T22:19:03.657372+0000","last_unstale":"2024-09-11T22:19:06.221244+0000","last_undegraded":"2024-09-11T22:19:06.221244+0000","last_fullsized":"2024-09-11T22:19:06.221244+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:37.662172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646417+0000","last_change":"2024-09-11T22:19:03.646417+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646417+0000","last_undegraded":"2024-09-11T22:19:03.646417+0000","last_fullsized":"2024-09-11T22:19:03.646417+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.655005+0000","last_change":"2024-09-11T22:19:03.652664+0000","last_active":"2024-09-11T22:19:03.655005+0000","last_peered":"2024-09-11T22:19:03.655005+0000","last_clean":"2024-09-11T22:19:03.655005+0000","last_became_active":"2024-09-11T22:19:03.652377+0000","last_became_peered":"2024-09-11T22:19:03.652377+0000","last_unstale":"2024-09-11T22:19:03.655005+0000","last_undegraded":"2024-09-11T22:19:03.655005+0000","last_fullsized":"2024-09-11T22:19:03.655005+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:59.990828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221101+0000","last_change":"2024-09-11T22:19:04.607846+0000","last_active":"2024-09-11T22:19:06.221101+0000","last_peered":"2024-09-11T22:19:06.221101+0000","last_clean":"2024-09-11T22:19:06.221101+0000","last_became_active":"2024-09-11T22:19:04.607539+0000","last_became_peered":"2024-09-11T22:19:04.607539+0000","last_unstale":"2024-09-11T22:19:06.221101+0000","last_undegraded":"2024-09-11T22:19:06.221101+0000","last_fullsized":"2024-09-11T22:19:06.221101+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:39.137292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.647048+0000","last_change":"2024-09-11T22:19:03.646165+0000","last_active":"2024-09-11T22:19:03.647048+0000","last_peered":"2024-09-11T22:19:03.647048+0000","last_clean":"2024-09-11T22:19:03.647048+0000","last_became_active":"2024-09-11T22:19:03.644773+0000","last_became_peered":"2024-09-11T22:19:03.644773+0000","last_unstale":"2024-09-11T22:19:03.647048+0000","last_undegraded":"2024-09-11T22:19:03.647048+0000","last_fullsized":"2024-09-11T22:19:03.647048+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:16.119947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221299+0000","last_change":"2024-09-11T22:19:04.608209+0000","last_active":"2024-09-11T22:19:06.221299+0000","last_peered":"2024-09-11T22:19:06.221299+0000","last_clean":"2024-09-11T22:19:06.221299+0000","last_became_active":"2024-09-11T22:19:04.607723+0000","last_became_peered":"2024-09-11T22:19:04.607723+0000","last_unstale":"2024-09-11T22:19:06.221299+0000","last_undegraded":"2024-09-11T22:19:06.221299+0000","last_fullsized":"2024-09-11T22:19:06.221299+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:29.361777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.651364+0000","last_change":"2024-09-11T22:19:03.649748+0000","last_active":"2024-09-11T22:19:03.651364+0000","last_peered":"2024-09-11T22:19:03.651364+0000","last_clean":"2024-09-11T22:19:03.651364+0000","last_became_active":"2024-09-11T22:19:03.649467+0000","last_became_peered":"2024-09-11T22:19:03.649467+0000","last_unstale":"2024-09-11T22:19:03.651364+0000","last_undegraded":"2024-09-11T22:19:03.651364+0000","last_fullsized":"2024-09-11T22:19:03.651364+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:49.291515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.642694+0000","last_change":"2024-09-11T22:19:03.642694+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.642694+0000","last_undegraded":"2024-09-11T22:19:03.642694+0000","last_fullsized":"2024-09-11T22:19:03.642694+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.649957+0000","last_change":"2024-09-11T22:19:03.649522+0000","last_active":"2024-09-11T22:19:03.649957+0000","last_peered":"2024-09-11T22:19:03.649957+0000","last_clean":"2024-09-11T22:19:03.649957+0000","last_became_active":"2024-09-11T22:19:03.649244+0000","last_became_peered":"2024-09-11T22:19:03.649244+0000","last_unstale":"2024-09-11T22:19:03.649957+0000","last_undegraded":"2024-09-11T22:19:03.649957+0000","last_fullsized":"2024-09-11T22:19:03.649957+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:18.435337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646636+0000","last_change":"2024-09-11T22:19:03.646636+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646636+0000","last_undegraded":"2024-09-11T22:19:03.646636+0000","last_fullsized":"2024-09-11T22:19:03.646636+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.654369+0000","last_change":"2024-09-11T22:19:03.651101+0000","last_active":"2024-09-11T22:19:03.654369+0000","last_peered":"2024-09-11T22:19:03.654369+0000","last_clean":"2024-09-11T22:19:03.654369+0000","last_became_active":"2024-09-11T22:19:03.650795+0000","last_became_peered":"2024-09-11T22:19:03.650795+0000","last_unstale":"2024-09-11T22:19:03.654369+0000","last_undegraded":"2024-09-11T22:19:03.654369+0000","last_fullsized":"2024-09-11T22:19:03.654369+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:00.676418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.647684+0000","last_change":"2024-09-11T22:19:03.647684+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.647684+0000","last_undegraded":"2024-09-11T22:19:03.647684+0000","last_fullsized":"2024-09-11T22:19:03.647684+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.659911+0000","last_change":"2024-09-11T22:19:03.659081+0000","last_active":"2024-09-11T22:19:03.659911+0000","last_peered":"2024-09-11T22:19:03.659911+0000","last_clean":"2024-09-11T22:19:03.659911+0000","last_became_active":"2024-09-11T22:19:03.658782+0000","last_became_peered":"2024-09-11T22:19:03.658782+0000","last_unstale":"2024-09-11T22:19:03.659911+0000","last_undegraded":"2024-09-11T22:19:03.659911+0000","last_fullsized":"2024-09-11T22:19:03.659911+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:29.073410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644799+0000","last_change":"2024-09-11T22:19:03.644799+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644799+0000","last_undegraded":"2024-09-11T22:19:03.644799+0000","last_fullsized":"2024-09-11T22:19:03.644799+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.658351+0000","last_change":"2024-09-11T22:19:03.656863+0000","last_active":"2024-09-11T22:19:03.658351+0000","last_peered":"2024-09-11T22:19:03.658351+0000","last_clean":"2024-09-11T22:19:03.658351+0000","last_became_active":"2024-09-11T22:19:03.656244+0000","last_became_peered":"2024-09-11T22:19:03.656244+0000","last_unstale":"2024-09-11T22:19:03.658351+0000","last_undegraded":"2024-09-11T22:19:03.658351+0000","last_fullsized":"2024-09-11T22:19:03.658351+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:58.333628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221522+0000","last_change":"2024-09-11T22:19:04.599432+0000","last_active":"2024-09-11T22:19:06.221522+0000","last_peered":"2024-09-11T22:19:06.221522+0000","last_clean":"2024-09-11T22:19:06.221522+0000","last_became_active":"2024-09-11T22:19:04.599151+0000","last_became_peered":"2024-09-11T22:19:04.599151+0000","last_unstale":"2024-09-11T22:19:06.221522+0000","last_undegraded":"2024-09-11T22:19:06.221522+0000","last_fullsized":"2024-09-11T22:19:06.221522+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:06.264509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.654350+0000","last_change":"2024-09-11T22:19:03.652549+0000","last_active":"2024-09-11T22:19:03.654350+0000","last_peered":"2024-09-11T22:19:03.654350+0000","last_clean":"2024-09-11T22:19:03.654350+0000","last_became_active":"2024-09-11T22:19:03.652228+0000","last_became_peered":"2024-09-11T22:19:03.652228+0000","last_unstale":"2024-09-11T22:19:03.654350+0000","last_undegraded":"2024-09-11T22:19:03.654350+0000","last_fullsized":"2024-09-11T22:19:03.654350+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:58.333628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.651017+0000","last_change":"2024-09-11T22:19:03.651017+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.651017+0000","last_undegraded":"2024-09-11T22:19:03.651017+0000","last_fullsized":"2024-09-11T22:19:03.651017+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.658221+0000","last_change":"2024-09-11T22:19:03.657825+0000","last_active":"2024-09-11T22:19:03.658221+0000","last_peered":"2024-09-11T22:19:03.658221+0000","last_clean":"2024-09-11T22:19:03.658221+0000","last_became_active":"2024-09-11T22:19:03.657543+0000","last_became_peered":"2024-09-11T22:19:03.657543+0000","last_unstale":"2024-09-11T22:19:03.658221+0000","last_undegraded":"2024-09-11T22:19:03.658221+0000","last_fullsized":"2024-09-11T22:19:03.658221+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:23.987707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221245+0000","last_change":"2024-09-11T22:19:04.605484+0000","last_active":"2024-09-11T22:19:06.221245+0000","last_peered":"2024-09-11T22:19:06.221245+0000","last_clean":"2024-09-11T22:19:06.221245+0000","last_became_active":"2024-09-11T22:19:04.605208+0000","last_became_peered":"2024-09-11T22:19:04.605208+0000","last_unstale":"2024-09-11T22:19:06.221245+0000","last_undegraded":"2024-09-11T22:19:06.221245+0000","last_fullsized":"2024-09-11T22:19:06.221245+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:20.257908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657853+0000","last_change":"2024-09-11T22:19:03.656806+0000","last_active":"2024-09-11T22:19:03.657853+0000","last_peered":"2024-09-11T22:19:03.657853+0000","last_clean":"2024-09-11T22:19:03.657853+0000","last_became_active":"2024-09-11T22:19:03.656469+0000","last_became_peered":"2024-09-11T22:19:03.656469+0000","last_unstale":"2024-09-11T22:19:03.657853+0000","last_undegraded":"2024-09-11T22:19:03.657853+0000","last_fullsized":"2024-09-11T22:19:03.657853+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:04.062844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221354+0000","last_change":"2024-09-11T22:19:04.605154+0000","last_active":"2024-09-11T22:19:06.221354+0000","last_peered":"2024-09-11T22:19:06.221354+0000","last_clean":"2024-09-11T22:19:06.221354+0000","last_became_active":"2024-09-11T22:19:04.604838+0000","last_became_peered":"2024-09-11T22:19:04.604838+0000","last_unstale":"2024-09-11T22:19:06.221354+0000","last_undegraded":"2024-09-11T22:19:06.221354+0000","last_fullsized":"2024-09-11T22:19:06.221354+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:14.391949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.659642+0000","last_change":"2024-09-11T22:19:03.658102+0000","last_active":"2024-09-11T22:19:03.659642+0000","last_peered":"2024-09-11T22:19:03.659642+0000","last_clean":"2024-09-11T22:19:03.659642+0000","last_became_active":"2024-09-11T22:19:03.657816+0000","last_became_peered":"2024-09-11T22:19:03.657816+0000","last_unstale":"2024-09-11T22:19:03.659642+0000","last_undegraded":"2024-09-11T22:19:03.659642+0000","last_fullsized":"2024-09-11T22:19:03.659642+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221877+0000","last_change":"2024-09-11T22:19:04.598642+0000","last_active":"2024-09-11T22:19:06.221877+0000","last_peered":"2024-09-11T22:19:06.221877+0000","last_clean":"2024-09-11T22:19:06.221877+0000","last_became_active":"2024-09-11T22:19:04.598329+0000","last_became_peered":"2024-09-11T22:19:04.598329+0000","last_unstale":"2024-09-11T22:19:06.221877+0000","last_undegraded":"2024-09-11T22:19:06.221877+0000","last_fullsized":"2024-09-11T22:19:06.221877+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:27.785617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221244+0000","last_change":"2024-09-11T22:19:03.652627+0000","last_active":"2024-09-11T22:19:06.221244+0000","last_peered":"2024-09-11T22:19:06.221244+0000","last_clean":"2024-09-11T22:19:06.221244+0000","last_became_active":"2024-09-11T22:19:03.652320+0000","last_became_peered":"2024-09-11T22:19:03.652320+0000","last_unstale":"2024-09-11T22:19:06.221244+0000","last_undegraded":"2024-09-11T22:19:06.221244+0000","last_fullsized":"2024-09-11T22:19:06.221244+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:23.173009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645070+0000","last_change":"2024-09-11T22:19:03.645070+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645070+0000","last_undegraded":"2024-09-11T22:19:03.645070+0000","last_fullsized":"2024-09-11T22:19:03.645070+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.658634+0000","last_change":"2024-09-11T22:19:03.657984+0000","last_active":"2024-09-11T22:19:03.658634+0000","last_peered":"2024-09-11T22:19:03.658634+0000","last_clean":"2024-09-11T22:19:03.658634+0000","last_became_active":"2024-09-11T22:19:03.657671+0000","last_became_peered":"2024-09-11T22:19:03.657671+0000","last_unstale":"2024-09-11T22:19:03.658634+0000","last_undegraded":"2024-09-11T22:19:03.658634+0000","last_fullsized":"2024-09-11T22:19:03.658634+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:59.990828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.649683+0000","last_change":"2024-09-11T22:19:03.649683+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.649683+0000","last_undegraded":"2024-09-11T22:19:03.649683+0000","last_fullsized":"2024-09-11T22:19:03.649683+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.659686+0000","last_change":"2024-09-11T22:19:03.658740+0000","last_active":"2024-09-11T22:19:03.659686+0000","last_peered":"2024-09-11T22:19:03.659686+0000","last_clean":"2024-09-11T22:19:03.659686+0000","last_became_active":"2024-09-11T22:19:03.658380+0000","last_became_peered":"2024-09-11T22:19:03.658380+0000","last_unstale":"2024-09-11T22:19:03.659686+0000","last_undegraded":"2024-09-11T22:19:03.659686+0000","last_fullsized":"2024-09-11T22:19:03.659686+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:04.183505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.651524+0000","last_change":"2024-09-11T22:19:03.651524+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.651524+0000","last_undegraded":"2024-09-11T22:19:03.651524+0000","last_fullsized":"2024-09-11T22:19:03.651524+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.660408+0000","last_change":"2024-09-11T22:19:03.658363+0000","last_active":"2024-09-11T22:19:03.660408+0000","last_peered":"2024-09-11T22:19:03.660408+0000","last_clean":"2024-09-11T22:19:03.660408+0000","last_became_active":"2024-09-11T22:19:03.658100+0000","last_became_peered":"2024-09-11T22:19:03.658100+0000","last_unstale":"2024-09-11T22:19:03.660408+0000","last_undegraded":"2024-09-11T22:19:03.660408+0000","last_fullsized":"2024-09-11T22:19:03.660408+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:18.904813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.650603+0000","last_change":"2024-09-11T22:19:03.650603+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.650603+0000","last_undegraded":"2024-09-11T22:19:03.650603+0000","last_fullsized":"2024-09-11T22:19:03.650603+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657204+0000","last_change":"2024-09-11T22:19:03.655955+0000","last_active":"2024-09-11T22:19:03.657204+0000","last_peered":"2024-09-11T22:19:03.657204+0000","last_clean":"2024-09-11T22:19:03.657204+0000","last_became_active":"2024-09-11T22:19:03.655394+0000","last_became_peered":"2024-09-11T22:19:03.655394+0000","last_unstale":"2024-09-11T22:19:03.657204+0000","last_undegraded":"2024-09-11T22:19:03.657204+0000","last_fullsized":"2024-09-11T22:19:03.657204+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:02.941518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.643335+0000","last_change":"2024-09-11T22:19:03.643335+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.643335+0000","last_undegraded":"2024-09-11T22:19:03.643335+0000","last_fullsized":"2024-09-11T22:19:03.643335+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.660133+0000","last_change":"2024-09-11T22:19:03.659192+0000","last_active":"2024-09-11T22:19:03.660133+0000","last_peered":"2024-09-11T22:19:03.660133+0000","last_clean":"2024-09-11T22:19:03.660133+0000","last_became_active":"2024-09-11T22:19:03.658919+0000","last_became_peered":"2024-09-11T22:19:03.658919+0000","last_unstale":"2024-09-11T22:19:03.660133+0000","last_undegraded":"2024-09-11T22:19:03.660133+0000","last_fullsized":"2024-09-11T22:19:03.660133+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:49.845665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646303+0000","last_change":"2024-09-11T22:19:03.646303+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646303+0000","last_undegraded":"2024-09-11T22:19:03.646303+0000","last_fullsized":"2024-09-11T22:19:03.646303+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.654959+0000","last_change":"2024-09-11T22:19:03.652729+0000","last_active":"2024-09-11T22:19:03.654959+0000","last_peered":"2024-09-11T22:19:03.654959+0000","last_clean":"2024-09-11T22:19:03.654959+0000","last_became_active":"2024-09-11T22:19:03.652408+0000","last_became_peered":"2024-09-11T22:19:03.652408+0000","last_unstale":"2024-09-11T22:19:03.654959+0000","last_undegraded":"2024-09-11T22:19:03.654959+0000","last_fullsized":"2024-09-11T22:19:03.654959+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:53.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221136+0000","last_change":"2024-09-11T22:19:04.601130+0000","last_active":"2024-09-11T22:19:06.221136+0000","last_peered":"2024-09-11T22:19:06.221136+0000","last_clean":"2024-09-11T22:19:06.221136+0000","last_became_active":"2024-09-11T22:19:04.600847+0000","last_became_peered":"2024-09-11T22:19:04.600847+0000","last_unstale":"2024-09-11T22:19:06.221136+0000","last_undegraded":"2024-09-11T22:19:06.221136+0000","last_fullsized":"2024-09-11T22:19:06.221136+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:23.840570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.652877+0000","last_change":"2024-09-11T22:19:03.651763+0000","last_active":"2024-09-11T22:19:03.652877+0000","last_peered":"2024-09-11T22:19:03.652877+0000","last_clean":"2024-09-11T22:19:03.652877+0000","last_became_active":"2024-09-11T22:19:03.651464+0000","last_became_peered":"2024-09-11T22:19:03.651464+0000","last_unstale":"2024-09-11T22:19:03.652877+0000","last_undegraded":"2024-09-11T22:19:03.652877+0000","last_fullsized":"2024-09-11T22:19:03.652877+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.624771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645738+0000","last_change":"2024-09-11T22:19:03.645738+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645738+0000","last_undegraded":"2024-09-11T22:19:03.645738+0000","last_fullsized":"2024-09-11T22:19:03.645738+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657471+0000","last_change":"2024-09-11T22:19:03.656329+0000","last_active":"2024-09-11T22:19:03.657471+0000","last_peered":"2024-09-11T22:19:03.657471+0000","last_clean":"2024-09-11T22:19:03.657471+0000","last_became_active":"2024-09-11T22:19:03.656010+0000","last_became_peered":"2024-09-11T22:19:03.656010+0000","last_unstale":"2024-09-11T22:19:03.657471+0000","last_undegraded":"2024-09-11T22:19:03.657471+0000","last_fullsized":"2024-09-11T22:19:03.657471+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:56.317365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644128+0000","last_change":"2024-09-11T22:19:03.644128+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644128+0000","last_undegraded":"2024-09-11T22:19:03.644128+0000","last_fullsized":"2024-09-11T22:19:03.644128+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.654935+0000","last_change":"2024-09-11T22:19:03.652845+0000","last_active":"2024-09-11T22:19:03.654935+0000","last_peered":"2024-09-11T22:19:03.654935+0000","last_clean":"2024-09-11T22:19:03.654935+0000","last_became_active":"2024-09-11T22:19:03.651928+0000","last_became_peered":"2024-09-11T22:19:03.651928+0000","last_unstale":"2024-09-11T22:19:03.654935+0000","last_undegraded":"2024-09-11T22:19:03.654935+0000","last_fullsized":"2024-09-11T22:19:03.654935+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:16.168301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220474+0000","last_change":"2024-09-11T22:19:04.607489+0000","last_active":"2024-09-11T22:19:06.220474+0000","last_peered":"2024-09-11T22:19:06.220474+0000","last_clean":"2024-09-11T22:19:06.220474+0000","last_became_active":"2024-09-11T22:19:04.606950+0000","last_became_peered":"2024-09-11T22:19:04.606950+0000","last_unstale":"2024-09-11T22:19:06.220474+0000","last_undegraded":"2024-09-11T22:19:06.220474+0000","last_fullsized":"2024-09-11T22:19:06.220474+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:55.783154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657103+0000","last_change":"2024-09-11T22:19:03.655592+0000","last_active":"2024-09-11T22:19:03.657103+0000","last_peered":"2024-09-11T22:19:03.657103+0000","last_clean":"2024-09-11T22:19:03.657103+0000","last_became_active":"2024-09-11T22:19:03.655319+0000","last_became_peered":"2024-09-11T22:19:03.655319+0000","last_unstale":"2024-09-11T22:19:03.657103+0000","last_undegraded":"2024-09-11T22:19:03.657103+0000","last_fullsized":"2024-09-11T22:19:03.657103+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:10.586681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.648516+0000","last_change":"2024-09-11T22:19:03.648516+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.648516+0000","last_undegraded":"2024-09-11T22:19:03.648516+0000","last_fullsized":"2024-09-11T22:19:03.648516+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221624+0000","last_change":"2024-09-11T22:19:03.653122+0000","last_active":"2024-09-11T22:19:06.221624+0000","last_peered":"2024-09-11T22:19:06.221624+0000","last_clean":"2024-09-11T22:19:06.221624+0000","last_became_active":"2024-09-11T22:19:03.652733+0000","last_became_peered":"2024-09-11T22:19:03.652733+0000","last_unstale":"2024-09-11T22:19:06.221624+0000","last_undegraded":"2024-09-11T22:19:06.221624+0000","last_fullsized":"2024-09-11T22:19:06.221624+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:46.127177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221677+0000","last_change":"2024-09-11T22:19:04.607324+0000","last_active":"2024-09-11T22:19:06.221677+0000","last_peered":"2024-09-11T22:19:06.221677+0000","last_clean":"2024-09-11T22:19:06.221677+0000","last_became_active":"2024-09-11T22:19:04.606948+0000","last_became_peered":"2024-09-11T22:19:04.606948+0000","last_unstale":"2024-09-11T22:19:06.221677+0000","last_undegraded":"2024-09-11T22:19:06.221677+0000","last_fullsized":"2024-09-11T22:19:06.221677+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:42.474866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"132'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.644363+0000","last_change":"2024-09-11T22:19:03.658179+0000","last_active":"2024-09-11T22:19:06.644363+0000","last_peered":"2024-09-11T22:19:06.644363+0000","last_clean":"2024-09-11T22:19:06.644363+0000","last_became_active":"2024-09-11T22:19:03.657895+0000","last_became_peered":"2024-09-11T22:19:03.657895+0000","last_unstale":"2024-09-11T22:19:06.644363+0000","last_undegraded":"2024-09-11T22:19:06.644363+0000","last_fullsized":"2024-09-11T22:19:06.644363+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:08.667757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.645750+0000","last_change":"2024-09-11T22:19:03.645750+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.645750+0000","last_undegraded":"2024-09-11T22:19:03.645750+0000","last_fullsized":"2024-09-11T22:19:03.645750+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657453+0000","last_change":"2024-09-11T22:19:03.656565+0000","last_active":"2024-09-11T22:19:03.657453+0000","last_peered":"2024-09-11T22:19:03.657453+0000","last_clean":"2024-09-11T22:19:03.657453+0000","last_became_active":"2024-09-11T22:19:03.656260+0000","last_became_peered":"2024-09-11T22:19:03.656260+0000","last_unstale":"2024-09-11T22:19:03.657453+0000","last_undegraded":"2024-09-11T22:19:03.657453+0000","last_fullsized":"2024-09-11T22:19:03.657453+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:08.624771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646960+0000","last_change":"2024-09-11T22:19:03.646960+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646960+0000","last_undegraded":"2024-09-11T22:19:03.646960+0000","last_fullsized":"2024-09-11T22:19:03.646960+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.651353+0000","last_change":"2024-09-11T22:19:03.649388+0000","last_active":"2024-09-11T22:19:03.651353+0000","last_peered":"2024-09-11T22:19:03.651353+0000","last_clean":"2024-09-11T22:19:03.651353+0000","last_became_active":"2024-09-11T22:19:03.649080+0000","last_became_peered":"2024-09-11T22:19:03.649080+0000","last_unstale":"2024-09-11T22:19:03.651353+0000","last_undegraded":"2024-09-11T22:19:03.651353+0000","last_fullsized":"2024-09-11T22:19:03.651353+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:59.208623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220720+0000","last_change":"2024-09-11T22:19:04.607362+0000","last_active":"2024-09-11T22:19:06.220720+0000","last_peered":"2024-09-11T22:19:06.220720+0000","last_clean":"2024-09-11T22:19:06.220720+0000","last_became_active":"2024-09-11T22:19:04.607063+0000","last_became_peered":"2024-09-11T22:19:04.607063+0000","last_unstale":"2024-09-11T22:19:06.220720+0000","last_undegraded":"2024-09-11T22:19:06.220720+0000","last_fullsized":"2024-09-11T22:19:06.220720+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:59.918367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.659606+0000","last_change":"2024-09-11T22:19:03.659074+0000","last_active":"2024-09-11T22:19:03.659606+0000","last_peered":"2024-09-11T22:19:03.659606+0000","last_clean":"2024-09-11T22:19:03.659606+0000","last_became_active":"2024-09-11T22:19:03.658750+0000","last_became_peered":"2024-09-11T22:19:03.658750+0000","last_unstale":"2024-09-11T22:19:03.659606+0000","last_undegraded":"2024-09-11T22:19:03.659606+0000","last_fullsized":"2024-09-11T22:19:03.659606+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:53.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.646875+0000","last_change":"2024-09-11T22:19:03.646875+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.646875+0000","last_undegraded":"2024-09-11T22:19:03.646875+0000","last_fullsized":"2024-09-11T22:19:03.646875+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220823+0000","last_change":"2024-09-11T22:19:03.657654+0000","last_active":"2024-09-11T22:19:06.220823+0000","last_peered":"2024-09-11T22:19:06.220823+0000","last_clean":"2024-09-11T22:19:06.220823+0000","last_became_active":"2024-09-11T22:19:03.657357+0000","last_became_peered":"2024-09-11T22:19:03.657357+0000","last_unstale":"2024-09-11T22:19:06.220823+0000","last_undegraded":"2024-09-11T22:19:06.220823+0000","last_fullsized":"2024-09-11T22:19:06.220823+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:51.252945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.642253+0000","last_change":"2024-09-11T22:19:03.642253+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.642253+0000","last_undegraded":"2024-09-11T22:19:03.642253+0000","last_fullsized":"2024-09-11T22:19:03.642253+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.657879+0000","last_change":"2024-09-11T22:19:03.657049+0000","last_active":"2024-09-11T22:19:03.657879+0000","last_peered":"2024-09-11T22:19:03.657879+0000","last_clean":"2024-09-11T22:19:03.657879+0000","last_became_active":"2024-09-11T22:19:03.656761+0000","last_became_peered":"2024-09-11T22:19:03.656761+0000","last_unstale":"2024-09-11T22:19:03.657879+0000","last_undegraded":"2024-09-11T22:19:03.657879+0000","last_fullsized":"2024-09-11T22:19:03.657879+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:02.231666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-09-11T22:19:03.644367+0000","last_change":"2024-09-11T22:19:03.644367+0000","last_active":"2024-09-11T22:19:03.630301+0000","last_peered":"2024-09-11T22:19:03.630301+0000","last_clean":"2024-09-11T22:19:03.630301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:03.644367+0000","last_undegraded":"2024-09-11T22:19:03.644367+0000","last_fullsized":"2024-09-11T22:19:03.644367+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-11T22:19:03.655602+0000","last_change":"2024-09-11T22:19:03.652831+0000","last_active":"2024-09-11T22:19:03.655602+0000","last_peered":"2024-09-11T22:19:03.655602+0000","last_clean":"2024-09-11T22:19:03.655602+0000","last_became_active":"2024-09-11T22:19:03.652532+0000","last_became_peered":"2024-09-11T22:19:03.652532+0000","last_unstale":"2024-09-11T22:19:03.655602+0000","last_undegraded":"2024-09-11T22:19:03.655602+0000","last_fullsized":"2024-09-11T22:19:03.655602+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:24.912463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220918+0000","last_change":"2024-09-11T22:19:04.607288+0000","last_active":"2024-09-11T22:19:06.220918+0000","last_peered":"2024-09-11T22:19:06.220918+0000","last_clean":"2024-09-11T22:19:06.220918+0000","last_became_active":"2024-09-11T22:19:04.606876+0000","last_became_peered":"2024-09-11T22:19:04.606876+0000","last_unstale":"2024-09-11T22:19:06.220918+0000","last_undegraded":"2024-09-11T22:19:06.220918+0000","last_fullsized":"2024-09-11T22:19:06.220918+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.340880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221001+0000","last_change":"2024-09-11T22:19:03.660606+0000","last_active":"2024-09-11T22:19:06.221001+0000","last_peered":"2024-09-11T22:19:06.221001+0000","last_clean":"2024-09-11T22:19:06.221001+0000","last_became_active":"2024-09-11T22:19:03.660282+0000","last_became_peered":"2024-09-11T22:19:03.660282+0000","last_unstale":"2024-09-11T22:19:06.221001+0000","last_undegraded":"2024-09-11T22:19:06.221001+0000","last_fullsized":"2024-09-11T22:19:06.221001+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.710149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":372,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220377+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:19:06.220377+0000","last_peered":"2024-09-11T22:19:06.220377+0000","last_clean":"2024-09-11T22:19:06.220377+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:19:06.220377+0000","last_undegraded":"2024-09-11T22:19:06.220377+0000","last_fullsized":"2024-09-11T22:19:06.220377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46656,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325184,"statfs":{"total":96636764160,"available":96588988416,"internally_reserved":0,"allocated":1613824,"data_stored":705343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45244,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326596,"statfs":{"total":96636764160,"available":96590434304,"internally_reserved":0,"allocated":1613824,"data_stored":705343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50820,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321020,"statfs":{"total":96636764160,"available":96584724480,"internally_reserved":0,"allocated":1613824,"data_stored":705343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54968,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316872,"statfs":{"total":96636764160,"available":96580476928,"internally_reserved":0,"allocated":1601536,"data_stored":699068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59132,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312708,"statfs":{"total":96636764160,"available":96576212992,"internally_reserved":0,"allocated":1613824,"data_stored":705343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509539,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55552,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316288,"statfs":{"total":96636764160,"available":96579878912,"internally_reserved":0,"allocated":2207744,"data_stored":1295711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47288,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324552,"statfs":{"total":96636764160,"available":96588341248,"internally_reserved":0,"allocated":2256896,"data_stored":1311036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59152,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312688,"statfs":{"total":96636764160,"available":96576192512,"internally_reserved":0,"allocated":1634304,"data_stored":712734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:19:09.333 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3e is not active+clean 2024-09-11T22:19:09.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.646967+0000', 'last_change': '2024-09-11T22:19:03.646967+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.646967+0000', 'last_undegraded': '2024-09-11T22:19:03.646967+0000', 'last_fullsized': '2024-09-11T22:19:03.646967+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:19:09.333 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3d is not active+clean 2024-09-11T22:19:09.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.646915+0000', 'last_change': '2024-09-11T22:19:03.646915+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.646915+0000', 'last_undegraded': '2024-09-11T22:19:03.646915+0000', 'last_fullsized': '2024-09-11T22:19:03.646915+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:19:09.334 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3a is not active+clean 2024-09-11T22:19:09.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.645647+0000', 'last_change': '2024-09-11T22:19:03.645647+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.645647+0000', 'last_undegraded': '2024-09-11T22:19:03.645647+0000', 'last_fullsized': '2024-09-11T22:19:03.645647+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:19:09.334 INFO:tasks.ceph.ceph_manager.ceph:PG 19.39 is not active+clean 2024-09-11T22:19:09.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.646415+0000', 'last_change': '2024-09-11T22:19:03.646415+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.646415+0000', 'last_undegraded': '2024-09-11T22:19:03.646415+0000', 'last_fullsized': '2024-09-11T22:19:03.646415+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:19:09.334 INFO:tasks.ceph.ceph_manager.ceph:PG 19.38 is not active+clean 2024-09-11T22:19:09.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.648115+0000', 'last_change': '2024-09-11T22:19:03.648115+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.648115+0000', 'last_undegraded': '2024-09-11T22:19:03.648115+0000', 'last_fullsized': '2024-09-11T22:19:03.648115+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:19:09.334 INFO:tasks.ceph.ceph_manager.ceph:PG 19.37 is not active+clean 2024-09-11T22:19:09.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.647765+0000', 'last_change': '2024-09-11T22:19:03.647765+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.647765+0000', 'last_undegraded': '2024-09-11T22:19:03.647765+0000', 'last_fullsized': '2024-09-11T22:19:03.647765+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:19:09.335 INFO:tasks.ceph.ceph_manager.ceph:PG 19.36 is not active+clean 2024-09-11T22:19:09.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.646359+0000', 'last_change': '2024-09-11T22:19:03.646359+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.646359+0000', 'last_undegraded': '2024-09-11T22:19:03.646359+0000', 'last_fullsized': '2024-09-11T22:19:03.646359+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:19:09.335 INFO:tasks.ceph.ceph_manager.ceph:PG 19.35 is not active+clean 2024-09-11T22:19:09.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.645905+0000', 'last_change': '2024-09-11T22:19:03.645905+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.645905+0000', 'last_undegraded': '2024-09-11T22:19:03.645905+0000', 'last_fullsized': '2024-09-11T22:19:03.645905+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:19:09.335 INFO:tasks.ceph.ceph_manager.ceph:PG 19.34 is not active+clean 2024-09-11T22:19:09.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.648618+0000', 'last_change': '2024-09-11T22:19:03.648618+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.648618+0000', 'last_undegraded': '2024-09-11T22:19:03.648618+0000', 'last_fullsized': '2024-09-11T22:19:03.648618+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:19:09.335 INFO:tasks.ceph.ceph_manager.ceph:PG 19.32 is not active+clean 2024-09-11T22:19:09.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.647340+0000', 'last_change': '2024-09-11T22:19:03.647340+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.647340+0000', 'last_undegraded': '2024-09-11T22:19:03.647340+0000', 'last_fullsized': '2024-09-11T22:19:03.647340+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:19:09.335 INFO:tasks.ceph.ceph_manager.ceph:PG 19.30 is not active+clean 2024-09-11T22:19:09.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.642771+0000', 'last_change': '2024-09-11T22:19:03.642771+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.642771+0000', 'last_undegraded': '2024-09-11T22:19:03.642771+0000', 'last_fullsized': '2024-09-11T22:19:03.642771+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:19:09.336 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2f is not active+clean 2024-09-11T22:19:09.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.647245+0000', 'last_change': '2024-09-11T22:19:03.647245+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.647245+0000', 'last_undegraded': '2024-09-11T22:19:03.647245+0000', 'last_fullsized': '2024-09-11T22:19:03.647245+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:19:09.336 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2e is not active+clean 2024-09-11T22:19:09.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.644781+0000', 'last_change': '2024-09-11T22:19:03.644781+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.644781+0000', 'last_undegraded': '2024-09-11T22:19:03.644781+0000', 'last_fullsized': '2024-09-11T22:19:03.644781+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:19:09.336 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2d is not active+clean 2024-09-11T22:19:09.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.645467+0000', 'last_change': '2024-09-11T22:19:03.645467+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.645467+0000', 'last_undegraded': '2024-09-11T22:19:03.645467+0000', 'last_fullsized': '2024-09-11T22:19:03.645467+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:19:09.336 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2c is not active+clean 2024-09-11T22:19:09.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.643896+0000', 'last_change': '2024-09-11T22:19:03.643896+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.643896+0000', 'last_undegraded': '2024-09-11T22:19:03.643896+0000', 'last_fullsized': '2024-09-11T22:19:03.643896+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:19:09.337 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2a is not active+clean 2024-09-11T22:19:09.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.644957+0000', 'last_change': '2024-09-11T22:19:03.644957+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.644957+0000', 'last_undegraded': '2024-09-11T22:19:03.644957+0000', 'last_fullsized': '2024-09-11T22:19:03.644957+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:19:09.337 INFO:tasks.ceph.ceph_manager.ceph:PG 19.29 is not active+clean 2024-09-11T22:19:09.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.648306+0000', 'last_change': '2024-09-11T22:19:03.648306+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.648306+0000', 'last_undegraded': '2024-09-11T22:19:03.648306+0000', 'last_fullsized': '2024-09-11T22:19:03.648306+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:19:09.337 INFO:tasks.ceph.ceph_manager.ceph:PG 19.28 is not active+clean 2024-09-11T22:19:09.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.645472+0000', 'last_change': '2024-09-11T22:19:03.645472+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.645472+0000', 'last_undegraded': '2024-09-11T22:19:03.645472+0000', 'last_fullsized': '2024-09-11T22:19:03.645472+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:19:09.337 INFO:tasks.ceph.ceph_manager.ceph:PG 19.27 is not active+clean 2024-09-11T22:19:09.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.644031+0000', 'last_change': '2024-09-11T22:19:03.644031+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.644031+0000', 'last_undegraded': '2024-09-11T22:19:03.644031+0000', 'last_fullsized': '2024-09-11T22:19:03.644031+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:19:09.337 INFO:tasks.ceph.ceph_manager.ceph:PG 19.26 is not active+clean 2024-09-11T22:19:09.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.643965+0000', 'last_change': '2024-09-11T22:19:03.643965+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.643965+0000', 'last_undegraded': '2024-09-11T22:19:03.643965+0000', 'last_fullsized': '2024-09-11T22:19:03.643965+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:19:09.338 INFO:tasks.ceph.ceph_manager.ceph:PG 19.24 is not active+clean 2024-09-11T22:19:09.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.647353+0000', 'last_change': '2024-09-11T22:19:03.647353+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.647353+0000', 'last_undegraded': '2024-09-11T22:19:03.647353+0000', 'last_fullsized': '2024-09-11T22:19:03.647353+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:19:09.338 INFO:tasks.ceph.ceph_manager.ceph:PG 19.20 is not active+clean 2024-09-11T22:19:09.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.646409+0000', 'last_change': '2024-09-11T22:19:03.646409+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.646409+0000', 'last_undegraded': '2024-09-11T22:19:03.646409+0000', 'last_fullsized': '2024-09-11T22:19:03.646409+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:19:09.338 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1e is not active+clean 2024-09-11T22:19:09.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.643125+0000', 'last_change': '2024-09-11T22:19:03.643125+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.643125+0000', 'last_undegraded': '2024-09-11T22:19:03.643125+0000', 'last_fullsized': '2024-09-11T22:19:03.643125+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:19:09.338 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1f is not active+clean 2024-09-11T22:19:09.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.646417+0000', 'last_change': '2024-09-11T22:19:03.646417+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.646417+0000', 'last_undegraded': '2024-09-11T22:19:03.646417+0000', 'last_fullsized': '2024-09-11T22:19:03.646417+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:19:09.338 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1a is not active+clean 2024-09-11T22:19:09.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.642694+0000', 'last_change': '2024-09-11T22:19:03.642694+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.642694+0000', 'last_undegraded': '2024-09-11T22:19:03.642694+0000', 'last_fullsized': '2024-09-11T22:19:03.642694+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:19:09.339 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1b is not active+clean 2024-09-11T22:19:09.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.646636+0000', 'last_change': '2024-09-11T22:19:03.646636+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.646636+0000', 'last_undegraded': '2024-09-11T22:19:03.646636+0000', 'last_fullsized': '2024-09-11T22:19:03.646636+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:19:09.339 INFO:tasks.ceph.ceph_manager.ceph:PG 19.18 is not active+clean 2024-09-11T22:19:09.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.647684+0000', 'last_change': '2024-09-11T22:19:03.647684+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.647684+0000', 'last_undegraded': '2024-09-11T22:19:03.647684+0000', 'last_fullsized': '2024-09-11T22:19:03.647684+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:19:09.339 INFO:tasks.ceph.ceph_manager.ceph:PG 19.19 is not active+clean 2024-09-11T22:19:09.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.644799+0000', 'last_change': '2024-09-11T22:19:03.644799+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.644799+0000', 'last_undegraded': '2024-09-11T22:19:03.644799+0000', 'last_fullsized': '2024-09-11T22:19:03.644799+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:19:09.339 INFO:tasks.ceph.ceph_manager.ceph:PG 19.17 is not active+clean 2024-09-11T22:19:09.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.651017+0000', 'last_change': '2024-09-11T22:19:03.651017+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.651017+0000', 'last_undegraded': '2024-09-11T22:19:03.651017+0000', 'last_fullsized': '2024-09-11T22:19:03.651017+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:19:09.339 INFO:tasks.ceph.ceph_manager.ceph:PG 19.10 is not active+clean 2024-09-11T22:19:09.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.645070+0000', 'last_change': '2024-09-11T22:19:03.645070+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.645070+0000', 'last_undegraded': '2024-09-11T22:19:03.645070+0000', 'last_fullsized': '2024-09-11T22:19:03.645070+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:19:09.340 INFO:tasks.ceph.ceph_manager.ceph:PG 19.11 is not active+clean 2024-09-11T22:19:09.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.649683+0000', 'last_change': '2024-09-11T22:19:03.649683+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.649683+0000', 'last_undegraded': '2024-09-11T22:19:03.649683+0000', 'last_fullsized': '2024-09-11T22:19:03.649683+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:19:09.340 INFO:tasks.ceph.ceph_manager.ceph:PG 19.e is not active+clean 2024-09-11T22:19:09.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.651524+0000', 'last_change': '2024-09-11T22:19:03.651524+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.651524+0000', 'last_undegraded': '2024-09-11T22:19:03.651524+0000', 'last_fullsized': '2024-09-11T22:19:03.651524+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:19:09.340 INFO:tasks.ceph.ceph_manager.ceph:PG 19.f is not active+clean 2024-09-11T22:19:09.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.650603+0000', 'last_change': '2024-09-11T22:19:03.650603+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.650603+0000', 'last_undegraded': '2024-09-11T22:19:03.650603+0000', 'last_fullsized': '2024-09-11T22:19:03.650603+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:19:09.340 INFO:tasks.ceph.ceph_manager.ceph:PG 19.c is not active+clean 2024-09-11T22:19:09.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.643335+0000', 'last_change': '2024-09-11T22:19:03.643335+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.643335+0000', 'last_undegraded': '2024-09-11T22:19:03.643335+0000', 'last_fullsized': '2024-09-11T22:19:03.643335+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:19:09.340 INFO:tasks.ceph.ceph_manager.ceph:PG 19.d is not active+clean 2024-09-11T22:19:09.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.646303+0000', 'last_change': '2024-09-11T22:19:03.646303+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.646303+0000', 'last_undegraded': '2024-09-11T22:19:03.646303+0000', 'last_fullsized': '2024-09-11T22:19:03.646303+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:19:09.341 INFO:tasks.ceph.ceph_manager.ceph:PG 19.b is not active+clean 2024-09-11T22:19:09.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.645738+0000', 'last_change': '2024-09-11T22:19:03.645738+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.645738+0000', 'last_undegraded': '2024-09-11T22:19:03.645738+0000', 'last_fullsized': '2024-09-11T22:19:03.645738+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:19:09.341 INFO:tasks.ceph.ceph_manager.ceph:PG 19.8 is not active+clean 2024-09-11T22:19:09.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.644128+0000', 'last_change': '2024-09-11T22:19:03.644128+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.644128+0000', 'last_undegraded': '2024-09-11T22:19:03.644128+0000', 'last_fullsized': '2024-09-11T22:19:03.644128+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:19:09.341 INFO:tasks.ceph.ceph_manager.ceph:PG 19.6 is not active+clean 2024-09-11T22:19:09.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.648516+0000', 'last_change': '2024-09-11T22:19:03.648516+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.648516+0000', 'last_undegraded': '2024-09-11T22:19:03.648516+0000', 'last_fullsized': '2024-09-11T22:19:03.648516+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:19:09.341 INFO:tasks.ceph.ceph_manager.ceph:PG 19.4 is not active+clean 2024-09-11T22:19:09.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.645750+0000', 'last_change': '2024-09-11T22:19:03.645750+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.645750+0000', 'last_undegraded': '2024-09-11T22:19:03.645750+0000', 'last_fullsized': '2024-09-11T22:19:03.645750+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:19:09.341 INFO:tasks.ceph.ceph_manager.ceph:PG 19.5 is not active+clean 2024-09-11T22:19:09.341 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.646960+0000', 'last_change': '2024-09-11T22:19:03.646960+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.646960+0000', 'last_undegraded': '2024-09-11T22:19:03.646960+0000', 'last_fullsized': '2024-09-11T22:19:03.646960+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:19:09.341 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3 is not active+clean 2024-09-11T22:19:09.342 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.646875+0000', 'last_change': '2024-09-11T22:19:03.646875+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.646875+0000', 'last_undegraded': '2024-09-11T22:19:03.646875+0000', 'last_fullsized': '2024-09-11T22:19:03.646875+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:19:09.342 INFO:tasks.ceph.ceph_manager.ceph:PG 19.0 is not active+clean 2024-09-11T22:19:09.342 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.642253+0000', 'last_change': '2024-09-11T22:19:03.642253+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.642253+0000', 'last_undegraded': '2024-09-11T22:19:03.642253+0000', 'last_fullsized': '2024-09-11T22:19:03.642253+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:19:09.342 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1 is not active+clean 2024-09-11T22:19:09.342 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:19:03.644367+0000', 'last_change': '2024-09-11T22:19:03.644367+0000', 'last_active': '2024-09-11T22:19:03.630301+0000', 'last_peered': '2024-09-11T22:19:03.630301+0000', 'last_clean': '2024-09-11T22:19:03.630301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:19:03.644367+0000', 'last_undegraded': '2024-09-11T22:19:03.644367+0000', 'last_fullsized': '2024-09-11T22:19:03.644367+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'last_clean_scrub_stamp': '2024-09-11T22:19:03.630301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:19:09.343 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:19:09.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.470+0000 7f6cc7e7b640 1 Processor -- start 2024-09-11T22:19:09.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.470+0000 7f6cc7e7b640 1 -- start start 2024-09-11T22:19:09.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.471+0000 7f6cc7e7b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cc015e840 0x7f6cc00b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.471+0000 7f6cc7e7b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cc00cf580 0x7f6cc006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.471+0000 7f6cc7e7b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc00ce5f0 con 0x7f6cc00cdd50 2024-09-11T22:19:09.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.471+0000 7f6cc7e7b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6cc006c240 con 0x7f6cc015e840 2024-09-11T22:19:09.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.471+0000 7f6cc7e7b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc00d0470 con 0x7f6cc00cf580 2024-09-11T22:19:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.471+0000 7f6cc5c17640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cc015e840 0x7f6cc00b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.471+0000 7f6cc5c17640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cc015e840 0x7f6cc00b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56802/0 (socket says 172.21.15.50:56802) 2024-09-11T22:19:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.471+0000 7f6cc5c17640 1 -- 172.21.15.50:0/2823752378 learned_addr learned my addr 172.21.15.50:0/2823752378 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.471+0000 7f6cc5c17640 1 -- 172.21.15.50:0/2823752378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cc00cf580 msgr2=0x7f6cc006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.471+0000 7f6cc5c17640 1 --2- 172.21.15.50:0/2823752378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cc00cf580 0x7f6cc006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.471+0000 7f6cc5c17640 1 -- 172.21.15.50:0/2823752378 >> v1:172.21.15.77:6789/0 conn(0x7f6cc00cdd50 legacy=0x7f6cc00cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.471+0000 7f6cc5c17640 1 -- 172.21.15.50:0/2823752378 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc00ce310 con 0x7f6cc015e840 2024-09-11T22:19:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.472+0000 7f6cc5c17640 1 --2- 172.21.15.50:0/2823752378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc015e840 0x7f6cc00b4c70 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009870 tx=0x7f6cbc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95e341949e6e734 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.472+0000 7f6cc4c15640 1 -- 172.21.15.50:0/2823752378 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc037070 con 0x7f6cc015e840 2024-09-11T22:19:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.472+0000 7f6cc4c15640 1 -- 172.21.15.50:0/2823752378 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cbc032440 con 0x7f6cc015e840 2024-09-11T22:19:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.472+0000 7f6cc4c15640 1 -- 172.21.15.50:0/2823752378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc032810 con 0x7f6cc015e840 2024-09-11T22:19:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.473+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/2823752378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc015e840 msgr2=0x7f6cc00b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.473+0000 7f6cc7e7b640 1 --2- 172.21.15.50:0/2823752378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc015e840 0x7f6cc00b4c70 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009870 tx=0x7f6cbc02a210 comp rx=0 tx=0).stop 2024-09-11T22:19:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.473+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/2823752378 shutdown_connections 2024-09-11T22:19:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.473+0000 7f6cc7e7b640 1 --2- 172.21.15.50:0/2823752378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cc00cf580 0x7f6cc006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.473+0000 7f6cc7e7b640 1 --2- 172.21.15.50:0/2823752378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc015e840 0x7f6cc00b4c70 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.473+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/2823752378 >> 172.21.15.50:0/2823752378 conn(0x7f6cc00b4150 msgr2=0x7f6cc00b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.473+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/2823752378 shutdown_connections 2024-09-11T22:19:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.473+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/2823752378 wait complete. 2024-09-11T22:19:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.474+0000 7f6cc7e7b640 1 Processor -- start 2024-09-11T22:19:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.474+0000 7f6cc7e7b640 1 -- start start 2024-09-11T22:19:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc7e7b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cc00cdd50 0x7f6cc015c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc7e7b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc00cf580 0x7f6cc00cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc7e7b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cc015e840 0x7f6cc00d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc7e7b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc015ec20 con 0x7f6cc00cf580 2024-09-11T22:19:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc7e7b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc006bed0 con 0x7f6cc015e840 2024-09-11T22:19:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc7e7b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc015eda0 con 0x7f6cc00cdd50 2024-09-11T22:19:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc5416640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc00cf580 0x7f6cc00cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc5416640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc00cf580 0x7f6cc00cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56814/0 (socket says 172.21.15.50:56814) 2024-09-11T22:19:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc5416640 1 -- 172.21.15.50:0/737053257 learned_addr learned my addr 172.21.15.50:0/737053257 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc5c17640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cc00cdd50 0x7f6cc015c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc6418640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cc015e840 0x7f6cc00d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc5416640 1 -- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cc00cdd50 msgr2=0x7f6cc015c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc5416640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cc00cdd50 0x7f6cc015c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc5416640 1 -- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cc015e840 msgr2=0x7f6cc00d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc5416640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cc015e840 0x7f6cc00d0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc5416640 1 -- 172.21.15.50:0/737053257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc00ca420 con 0x7f6cc00cf580 2024-09-11T22:19:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.475+0000 7f6cc5416640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc00cf580 0x7f6cc00cbf00 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c430 tx=0x7f6cb000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.476+0000 7f6cb67fc640 1 -- 172.21.15.50:0/737053257 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0011790 con 0x7f6cc00cf580 2024-09-11T22:19:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.476+0000 7f6cb67fc640 1 -- 172.21.15.50:0/737053257 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb0017070 con 0x7f6cc00cf580 2024-09-11T22:19:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.476+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/737053257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc00ca700 con 0x7f6cc00cf580 2024-09-11T22:19:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.476+0000 7f6cb67fc640 1 -- 172.21.15.50:0/737053257 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0011bb0 con 0x7f6cc00cf580 2024-09-11T22:19:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.476+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/737053257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc00cacc0 con 0x7f6cc00cf580 2024-09-11T22:19:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.477+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/737053257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc00b4c70 con 0x7f6cc00cf580 2024-09-11T22:19:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.477+0000 7f6cb67fc640 1 -- 172.21.15.50:0/737053257 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6cb001c460 con 0x7f6cc00cf580 2024-09-11T22:19:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.478+0000 7f6cb67fc640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6ca406be30 0x7f6ca406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.478+0000 7f6cb67fc640 1 -- 172.21.15.50:0/737053257 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f6cb008ac90 con 0x7f6cc00cf580 2024-09-11T22:19:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.478+0000 7f6cc5c17640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6ca406be30 0x7f6ca406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.478+0000 7f6cc5c17640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6ca406be30 0x7f6ca406e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc034000 tx=0x7f6cbc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.482+0000 7f6cb67fc640 1 -- 172.21.15.50:0/737053257 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6cb00596d0 con 0x7f6cc00cf580 2024-09-11T22:19:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.726+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/737053257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6cc00cfce0 con 0x7f6cc00cf580 2024-09-11T22:19:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.727+0000 7f6cb67fc640 1 -- 172.21.15.50:0/737053257 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1476 (secure 0 0 0) 0x7f6cb0058fd0 con 0x7f6cc00cf580 2024-09-11T22:19:09.728 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:09.728 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":498,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":132,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":430501888,"bytes_avail":772663611392,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8412}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-11T22:18:49.475903+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:19:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.729+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6ca406be30 msgr2=0x7f6ca406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.729+0000 7f6cc7e7b640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6ca406be30 0x7f6ca406e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc034000 tx=0x7f6cbc02e000 comp rx=0 tx=0).stop 2024-09-11T22:19:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.729+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/737053257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc00cf580 msgr2=0x7f6cc00cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.729+0000 7f6cc7e7b640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc00cf580 0x7f6cc00cbf00 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c430 tx=0x7f6cb000c8f0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.729+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/737053257 shutdown_connections 2024-09-11T22:19:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.729+0000 7f6cc7e7b640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6ca406be30 0x7f6ca406e2f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.729+0000 7f6cc7e7b640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cc015e840 0x7f6cc00d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.729+0000 7f6cc7e7b640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cc00cf580 0x7f6cc00cbf00 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.729+0000 7f6cc7e7b640 1 --2- 172.21.15.50:0/737053257 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cc00cdd50 0x7f6cc015c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.729+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/737053257 >> 172.21.15.50:0/737053257 conn(0x7f6cc00b4150 msgr2=0x7f6cc0070630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.729+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/737053257 shutdown_connections 2024-09-11T22:19:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.729+0000 7f6cc7e7b640 1 -- 172.21.15.50:0/737053257 wait complete. 2024-09-11T22:19:09.741 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:19:09.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:19:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.843+0000 7f875f877640 1 Processor -- start 2024-09-11T22:19:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.843+0000 7f875f877640 1 -- start start 2024-09-11T22:19:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.844+0000 7f875f877640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f875815c3c0 0x7f875815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.844+0000 7f875f877640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f875815ec40 0x7f875815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.844+0000 7f875f877640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f87580679c0 0x7f8758067e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.844+0000 7f875f877640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8758068370 con 0x7f875815c3c0 2024-09-11T22:19:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.844+0000 7f875f877640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f875806e700 con 0x7f87580679c0 2024-09-11T22:19:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.844+0000 7f875f877640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f875815f7f0 con 0x7f875815ec40 2024-09-11T22:19:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.844+0000 7f875d613640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f875815c3c0 0x7f875815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.844+0000 7f875d613640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f875815c3c0 0x7f875815fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56816/0 (socket says 172.21.15.50:56816) 2024-09-11T22:19:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.844+0000 7f875d613640 1 -- 172.21.15.50:0/2286911297 learned_addr learned my addr 172.21.15.50:0/2286911297 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.845+0000 7f875ce12640 1 --2- 172.21.15.50:0/2286911297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f875815ec40 0x7f875815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.845+0000 7f875de14640 1 --2- 172.21.15.50:0/2286911297 >> v2:172.21.15.77:3300/0 conn(0x7f87580679c0 0x7f8758067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.845+0000 7f875d613640 1 -- 172.21.15.50:0/2286911297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f875815ec40 msgr2=0x7f875815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.845+0000 7f875d613640 1 --2- 172.21.15.50:0/2286911297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f875815ec40 0x7f875815f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.845+0000 7f875d613640 1 -- 172.21.15.50:0/2286911297 >> v2:172.21.15.77:3300/0 conn(0x7f87580679c0 msgr2=0x7f8758067e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.845+0000 7f875d613640 1 --2- 172.21.15.50:0/2286911297 >> v2:172.21.15.77:3300/0 conn(0x7f87580679c0 0x7f8758067e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.845+0000 7f875d613640 1 -- 172.21.15.50:0/2286911297 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f875815fad0 con 0x7f875815c3c0 2024-09-11T22:19:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.845+0000 7f875ce12640 1 --2- 172.21.15.50:0/2286911297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f875815ec40 0x7f875815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.845+0000 7f875d613640 1 --2- 172.21.15.50:0/2286911297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f875815c3c0 0x7f875815fe60 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f875806c7d0 tx=0x7f874802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11ca3dc1a245894 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.846+0000 7f8757fff640 1 -- 172.21.15.50:0/2286911297 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748036070 con 0x7f875815c3c0 2024-09-11T22:19:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.846+0000 7f8757fff640 1 -- 172.21.15.50:0/2286911297 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8748031600 con 0x7f875815c3c0 2024-09-11T22:19:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.846+0000 7f8757fff640 1 -- 172.21.15.50:0/2286911297 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87480319d0 con 0x7f875815c3c0 2024-09-11T22:19:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.846+0000 7f875f877640 1 -- 172.21.15.50:0/2286911297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f875815c3c0 msgr2=0x7f875815fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.846+0000 7f875f877640 1 --2- 172.21.15.50:0/2286911297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f875815c3c0 0x7f875815fe60 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f875806c7d0 tx=0x7f874802a610 comp rx=0 tx=0).stop 2024-09-11T22:19:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.846+0000 7f875f877640 1 -- 172.21.15.50:0/2286911297 shutdown_connections 2024-09-11T22:19:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.846+0000 7f875f877640 1 --2- 172.21.15.50:0/2286911297 >> v2:172.21.15.77:3300/0 conn(0x7f87580679c0 0x7f8758067e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.846+0000 7f875f877640 1 --2- 172.21.15.50:0/2286911297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f875815ec40 0x7f875815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.846+0000 7f875f877640 1 --2- 172.21.15.50:0/2286911297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f875815c3c0 0x7f875815fe60 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.846+0000 7f875f877640 1 -- 172.21.15.50:0/2286911297 >> 172.21.15.50:0/2286911297 conn(0x7f8758075060 msgr2=0x7f875806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.846+0000 7f875f877640 1 -- 172.21.15.50:0/2286911297 shutdown_connections 2024-09-11T22:19:09.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.846+0000 7f875f877640 1 -- 172.21.15.50:0/2286911297 wait complete. 2024-09-11T22:19:09.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.847+0000 7f875f877640 1 Processor -- start 2024-09-11T22:19:09.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.848+0000 7f875f877640 1 -- start start 2024-09-11T22:19:09.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.848+0000 7f875f877640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87580679c0 0x7f875815acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.848+0000 7f875f877640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f875815c3c0 0x7f87580cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.848+0000 7f875f877640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f875815ec40 0x7f875814d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.848+0000 7f875f877640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f87580d0940 con 0x7f87580679c0 2024-09-11T22:19:09.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.848+0000 7f875f877640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f875806ec30 con 0x7f875815ec40 2024-09-11T22:19:09.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.848+0000 7f875f877640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f875806f150 con 0x7f875815c3c0 2024-09-11T22:19:09.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.848+0000 7f875d613640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87580679c0 0x7f875815acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.848+0000 7f875d613640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87580679c0 0x7f875815acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56818/0 (socket says 172.21.15.50:56818) 2024-09-11T22:19:09.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.848+0000 7f875d613640 1 -- 172.21.15.50:0/2339657194 learned_addr learned my addr 172.21.15.50:0/2339657194 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:09.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.848+0000 7f875ce12640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f875815c3c0 0x7f87580cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.848+0000 7f875de14640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f875815ec40 0x7f875814d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.849+0000 7f875d613640 1 -- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f875815c3c0 msgr2=0x7f87580cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.849+0000 7f875d613640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f875815c3c0 0x7f87580cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.849+0000 7f875d613640 1 -- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f875815ec40 msgr2=0x7f875814d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:09.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.849+0000 7f875d613640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f875815ec40 0x7f875814d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:09.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.849+0000 7f875d613640 1 -- 172.21.15.50:0/2339657194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87580cb240 con 0x7f87580679c0 2024-09-11T22:19:09.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.849+0000 7f875de14640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f875815ec40 0x7f875814d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:09.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.849+0000 7f875d613640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87580679c0 0x7f875815acc0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8748034040 tx=0x7f8748004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.849+0000 7f8755ffb640 1 -- 172.21.15.50:0/2339657194 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748036050 con 0x7f87580679c0 2024-09-11T22:19:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.849+0000 7f8755ffb640 1 -- 172.21.15.50:0/2339657194 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8748042070 con 0x7f87580679c0 2024-09-11T22:19:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.849+0000 7f875f877640 1 -- 172.21.15.50:0/2339657194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87580cb520 con 0x7f87580679c0 2024-09-11T22:19:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.849+0000 7f8755ffb640 1 -- 172.21.15.50:0/2339657194 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748009510 con 0x7f87580679c0 2024-09-11T22:19:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.849+0000 7f875f877640 1 -- 172.21.15.50:0/2339657194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87580cbae0 con 0x7f87580679c0 2024-09-11T22:19:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.850+0000 7f875f877640 1 -- 172.21.15.50:0/2339657194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f875806cae0 con 0x7f87580679c0 2024-09-11T22:19:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.851+0000 7f8755ffb640 1 -- 172.21.15.50:0/2339657194 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8748007c30 con 0x7f87580679c0 2024-09-11T22:19:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.851+0000 7f8755ffb640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f874406be30 0x7f874406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:09.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.851+0000 7f8755ffb640 1 -- 172.21.15.50:0/2339657194 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f87480abc20 con 0x7f87580679c0 2024-09-11T22:19:09.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.851+0000 7f875ce12640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f874406be30 0x7f874406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:09.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.852+0000 7f875ce12640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f874406be30 0x7f874406e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f87580cf5d0 tx=0x7f874c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:09.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:09.856+0000 7f8755ffb640 1 -- 172.21.15.50:0/2339657194 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f874807a660 con 0x7f87580679c0 2024-09-11T22:19:10.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.028+0000 7f875f877640 1 -- 172.21.15.50:0/2339657194 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8758067e30 con 0x7f874406be30 2024-09-11T22:19:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.034+0000 7f8755ffb640 1 -- 172.21.15.50:0/2339657194 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252482 (secure 0 0 0) 0x7f8758067e30 con 0x7f874406be30 2024-09-11T22:19:10.039 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:10.041 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:19:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.037+0000 7f875f877640 1 -- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f874406be30 msgr2=0x7f874406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.037+0000 7f875f877640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f874406be30 0x7f874406e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f87580cf5d0 tx=0x7f874c008040 comp rx=0 tx=0).stop 2024-09-11T22:19:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.037+0000 7f875f877640 1 -- 172.21.15.50:0/2339657194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87580679c0 msgr2=0x7f875815acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.037+0000 7f875f877640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87580679c0 0x7f875815acc0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8748034040 tx=0x7f8748004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.037+0000 7f875f877640 1 -- 172.21.15.50:0/2339657194 shutdown_connections 2024-09-11T22:19:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.037+0000 7f875f877640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f874406be30 0x7f874406e2f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.037+0000 7f875f877640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f875815c3c0 0x7f87580cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.037+0000 7f875f877640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f875815ec40 0x7f875814d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.037+0000 7f875f877640 1 --2- 172.21.15.50:0/2339657194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87580679c0 0x7f875815acc0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.037+0000 7f875f877640 1 -- 172.21.15.50:0/2339657194 >> 172.21.15.50:0/2339657194 conn(0x7f8758075060 msgr2=0x7f8758160e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.037+0000 7f875f877640 1 -- 172.21.15.50:0/2339657194 shutdown_connections 2024-09-11T22:19:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:10.037+0000 7f875f877640 1 -- 172.21.15.50:0/2339657194 wait complete. 2024-09-11T22:19:10.050 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-11T22:19:09.479931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":420412,"kb_used_data":14012,"kb_used_omap":12,"kb_used_meta":406195,"kb_avail":754554308,"statfs":{"total":773094113280,"available":772663611392,"internally_reserved":0,"allocated":14348288,"data_stored":6926600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":415944241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001308"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221490+0000","last_change":"2024-09-11T22:19:04.601864+0000","last_active":"2024-09-11T22:19:06.221490+0000","last_peered":"2024-09-11T22:19:06.221490+0000","last_clean":"2024-09-11T22:19:06.221490+0000","last_became_active":"2024-09-11T22:19:04.601567+0000","last_became_peered":"2024-09-11T22:19:04.601567+0000","last_unstale":"2024-09-11T22:19:06.221490+0000","last_undegraded":"2024-09-11T22:19:06.221490+0000","last_fullsized":"2024-09-11T22:19:06.221490+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:37.691839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221938+0000","last_change":"2024-09-11T22:19:04.594827+0000","last_active":"2024-09-11T22:19:06.221938+0000","last_peered":"2024-09-11T22:19:06.221938+0000","last_clean":"2024-09-11T22:19:06.221938+0000","last_became_active":"2024-09-11T22:19:04.594503+0000","last_became_peered":"2024-09-11T22:19:04.594503+0000","last_unstale":"2024-09-11T22:19:06.221938+0000","last_undegraded":"2024-09-11T22:19:06.221938+0000","last_fullsized":"2024-09-11T22:19:06.221938+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:11.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221039+0000","last_change":"2024-09-11T22:19:04.603202+0000","last_active":"2024-09-11T22:19:06.221039+0000","last_peered":"2024-09-11T22:19:06.221039+0000","last_clean":"2024-09-11T22:19:06.221039+0000","last_became_active":"2024-09-11T22:19:04.602864+0000","last_became_peered":"2024-09-11T22:19:04.602864+0000","last_unstale":"2024-09-11T22:19:06.221039+0000","last_undegraded":"2024-09-11T22:19:06.221039+0000","last_fullsized":"2024-09-11T22:19:06.221039+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:42.410226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220838+0000","last_change":"2024-09-11T22:19:04.601956+0000","last_active":"2024-09-11T22:19:06.220838+0000","last_peered":"2024-09-11T22:19:06.220838+0000","last_clean":"2024-09-11T22:19:06.220838+0000","last_became_active":"2024-09-11T22:19:04.601249+0000","last_became_peered":"2024-09-11T22:19:04.601249+0000","last_unstale":"2024-09-11T22:19:06.220838+0000","last_undegraded":"2024-09-11T22:19:06.220838+0000","last_fullsized":"2024-09-11T22:19:06.220838+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:37.836260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220888+0000","last_change":"2024-09-11T22:19:04.600564+0000","last_active":"2024-09-11T22:19:06.220888+0000","last_peered":"2024-09-11T22:19:06.220888+0000","last_clean":"2024-09-11T22:19:06.220888+0000","last_became_active":"2024-09-11T22:19:04.600260+0000","last_became_peered":"2024-09-11T22:19:04.600260+0000","last_unstale":"2024-09-11T22:19:06.220888+0000","last_undegraded":"2024-09-11T22:19:06.220888+0000","last_fullsized":"2024-09-11T22:19:06.220888+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:28.037951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590490+0000","last_change":"2024-09-11T22:19:04.596429+0000","last_active":"2024-09-11T22:19:05.590490+0000","last_peered":"2024-09-11T22:19:05.590490+0000","last_clean":"2024-09-11T22:19:05.590490+0000","last_became_active":"2024-09-11T22:19:04.596123+0000","last_became_peered":"2024-09-11T22:19:04.596123+0000","last_unstale":"2024-09-11T22:19:05.590490+0000","last_undegraded":"2024-09-11T22:19:05.590490+0000","last_fullsized":"2024-09-11T22:19:05.590490+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:08.939139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589416+0000","last_change":"2024-09-11T22:19:04.604445+0000","last_active":"2024-09-11T22:19:05.589416+0000","last_peered":"2024-09-11T22:19:05.589416+0000","last_clean":"2024-09-11T22:19:05.589416+0000","last_became_active":"2024-09-11T22:19:04.604150+0000","last_became_peered":"2024-09-11T22:19:04.604150+0000","last_unstale":"2024-09-11T22:19:05.589416+0000","last_undegraded":"2024-09-11T22:19:05.589416+0000","last_fullsized":"2024-09-11T22:19:05.589416+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:26.436036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220579+0000","last_change":"2024-09-11T22:19:04.602875+0000","last_active":"2024-09-11T22:19:06.220579+0000","last_peered":"2024-09-11T22:19:06.220579+0000","last_clean":"2024-09-11T22:19:06.220579+0000","last_became_active":"2024-09-11T22:19:04.602609+0000","last_became_peered":"2024-09-11T22:19:04.602609+0000","last_unstale":"2024-09-11T22:19:06.220579+0000","last_undegraded":"2024-09-11T22:19:06.220579+0000","last_fullsized":"2024-09-11T22:19:06.220579+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:07.363216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221573+0000","last_change":"2024-09-11T22:19:04.607058+0000","last_active":"2024-09-11T22:19:06.221573+0000","last_peered":"2024-09-11T22:19:06.221573+0000","last_clean":"2024-09-11T22:19:06.221573+0000","last_became_active":"2024-09-11T22:19:04.606785+0000","last_became_peered":"2024-09-11T22:19:04.606785+0000","last_unstale":"2024-09-11T22:19:06.221573+0000","last_undegraded":"2024-09-11T22:19:06.221573+0000","last_fullsized":"2024-09-11T22:19:06.221573+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:07.504531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.222021+0000","last_change":"2024-09-11T22:19:04.594296+0000","last_active":"2024-09-11T22:19:06.222021+0000","last_peered":"2024-09-11T22:19:06.222021+0000","last_clean":"2024-09-11T22:19:06.222021+0000","last_became_active":"2024-09-11T22:19:04.594002+0000","last_became_peered":"2024-09-11T22:19:04.594002+0000","last_unstale":"2024-09-11T22:19:06.222021+0000","last_undegraded":"2024-09-11T22:19:06.222021+0000","last_fullsized":"2024-09-11T22:19:06.222021+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:29.073485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585912+0000","last_change":"2024-09-11T22:19:04.598000+0000","last_active":"2024-09-11T22:19:05.585912+0000","last_peered":"2024-09-11T22:19:05.585912+0000","last_clean":"2024-09-11T22:19:05.585912+0000","last_became_active":"2024-09-11T22:19:04.597209+0000","last_became_peered":"2024-09-11T22:19:04.597209+0000","last_unstale":"2024-09-11T22:19:05.585912+0000","last_undegraded":"2024-09-11T22:19:05.585912+0000","last_fullsized":"2024-09-11T22:19:05.585912+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:51.166441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221218+0000","last_change":"2024-09-11T22:19:04.601702+0000","last_active":"2024-09-11T22:19:06.221218+0000","last_peered":"2024-09-11T22:19:06.221218+0000","last_clean":"2024-09-11T22:19:06.221218+0000","last_became_active":"2024-09-11T22:19:04.601406+0000","last_became_peered":"2024-09-11T22:19:04.601406+0000","last_unstale":"2024-09-11T22:19:06.221218+0000","last_undegraded":"2024-09-11T22:19:06.221218+0000","last_fullsized":"2024-09-11T22:19:06.221218+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:38.450875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221695+0000","last_change":"2024-09-11T22:19:04.602810+0000","last_active":"2024-09-11T22:19:06.221695+0000","last_peered":"2024-09-11T22:19:06.221695+0000","last_clean":"2024-09-11T22:19:06.221695+0000","last_became_active":"2024-09-11T22:19:04.602529+0000","last_became_peered":"2024-09-11T22:19:04.602529+0000","last_unstale":"2024-09-11T22:19:06.221695+0000","last_undegraded":"2024-09-11T22:19:06.221695+0000","last_fullsized":"2024-09-11T22:19:06.221695+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:29.956339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220440+0000","last_change":"2024-09-11T22:19:04.595649+0000","last_active":"2024-09-11T22:19:06.220440+0000","last_peered":"2024-09-11T22:19:06.220440+0000","last_clean":"2024-09-11T22:19:06.220440+0000","last_became_active":"2024-09-11T22:19:04.595377+0000","last_became_peered":"2024-09-11T22:19:04.595377+0000","last_unstale":"2024-09-11T22:19:06.220440+0000","last_undegraded":"2024-09-11T22:19:06.220440+0000","last_fullsized":"2024-09-11T22:19:06.220440+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:50.847710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220653+0000","last_change":"2024-09-11T22:19:04.607415+0000","last_active":"2024-09-11T22:19:06.220653+0000","last_peered":"2024-09-11T22:19:06.220653+0000","last_clean":"2024-09-11T22:19:06.220653+0000","last_became_active":"2024-09-11T22:19:04.606931+0000","last_became_peered":"2024-09-11T22:19:04.606931+0000","last_unstale":"2024-09-11T22:19:06.220653+0000","last_undegraded":"2024-09-11T22:19:06.220653+0000","last_fullsized":"2024-09-11T22:19:06.220653+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:19.955155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220646+0000","last_change":"2024-09-11T22:19:04.594698+0000","last_active":"2024-09-11T22:19:06.220646+0000","last_peered":"2024-09-11T22:19:06.220646+0000","last_clean":"2024-09-11T22:19:06.220646+0000","last_became_active":"2024-09-11T22:19:04.594364+0000","last_became_peered":"2024-09-11T22:19:04.594364+0000","last_unstale":"2024-09-11T22:19:06.220646+0000","last_undegraded":"2024-09-11T22:19:06.220646+0000","last_fullsized":"2024-09-11T22:19:06.220646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:26.445183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590603+0000","last_change":"2024-09-11T22:19:04.601077+0000","last_active":"2024-09-11T22:19:05.590603+0000","last_peered":"2024-09-11T22:19:05.590603+0000","last_clean":"2024-09-11T22:19:05.590603+0000","last_became_active":"2024-09-11T22:19:04.600814+0000","last_became_peered":"2024-09-11T22:19:04.600814+0000","last_unstale":"2024-09-11T22:19:05.590603+0000","last_undegraded":"2024-09-11T22:19:05.590603+0000","last_fullsized":"2024-09-11T22:19:05.590603+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:46:03.990883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221738+0000","last_change":"2024-09-11T22:19:04.595951+0000","last_active":"2024-09-11T22:19:06.221738+0000","last_peered":"2024-09-11T22:19:06.221738+0000","last_clean":"2024-09-11T22:19:06.221738+0000","last_became_active":"2024-09-11T22:19:04.595538+0000","last_became_peered":"2024-09-11T22:19:04.595538+0000","last_unstale":"2024-09-11T22:19:06.221738+0000","last_undegraded":"2024-09-11T22:19:06.221738+0000","last_fullsized":"2024-09-11T22:19:06.221738+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:38.617549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585959+0000","last_change":"2024-09-11T22:19:04.594286+0000","last_active":"2024-09-11T22:19:05.585959+0000","last_peered":"2024-09-11T22:19:05.585959+0000","last_clean":"2024-09-11T22:19:05.585959+0000","last_became_active":"2024-09-11T22:19:04.593993+0000","last_became_peered":"2024-09-11T22:19:04.593993+0000","last_unstale":"2024-09-11T22:19:05.585959+0000","last_undegraded":"2024-09-11T22:19:05.585959+0000","last_fullsized":"2024-09-11T22:19:05.585959+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:57.710743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221352+0000","last_change":"2024-09-11T22:19:04.595911+0000","last_active":"2024-09-11T22:19:06.221352+0000","last_peered":"2024-09-11T22:19:06.221352+0000","last_clean":"2024-09-11T22:19:06.221352+0000","last_became_active":"2024-09-11T22:19:04.595229+0000","last_became_peered":"2024-09-11T22:19:04.595229+0000","last_unstale":"2024-09-11T22:19:06.221352+0000","last_undegraded":"2024-09-11T22:19:06.221352+0000","last_fullsized":"2024-09-11T22:19:06.221352+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:19.581227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221080+0000","last_change":"2024-09-11T22:19:04.601152+0000","last_active":"2024-09-11T22:19:06.221080+0000","last_peered":"2024-09-11T22:19:06.221080+0000","last_clean":"2024-09-11T22:19:06.221080+0000","last_became_active":"2024-09-11T22:19:04.600735+0000","last_became_peered":"2024-09-11T22:19:04.600735+0000","last_unstale":"2024-09-11T22:19:06.221080+0000","last_undegraded":"2024-09-11T22:19:06.221080+0000","last_fullsized":"2024-09-11T22:19:06.221080+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:17.626424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585822+0000","last_change":"2024-09-11T22:19:04.596752+0000","last_active":"2024-09-11T22:19:05.585822+0000","last_peered":"2024-09-11T22:19:05.585822+0000","last_clean":"2024-09-11T22:19:05.585822+0000","last_became_active":"2024-09-11T22:19:04.596451+0000","last_became_peered":"2024-09-11T22:19:04.596451+0000","last_unstale":"2024-09-11T22:19:05.585822+0000","last_undegraded":"2024-09-11T22:19:05.585822+0000","last_fullsized":"2024-09-11T22:19:05.585822+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:17.699842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221247+0000","last_change":"2024-09-11T22:19:04.599336+0000","last_active":"2024-09-11T22:19:06.221247+0000","last_peered":"2024-09-11T22:19:06.221247+0000","last_clean":"2024-09-11T22:19:06.221247+0000","last_became_active":"2024-09-11T22:19:04.599038+0000","last_became_peered":"2024-09-11T22:19:04.599038+0000","last_unstale":"2024-09-11T22:19:06.221247+0000","last_undegraded":"2024-09-11T22:19:06.221247+0000","last_fullsized":"2024-09-11T22:19:06.221247+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:11.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585688+0000","last_change":"2024-09-11T22:19:04.596498+0000","last_active":"2024-09-11T22:19:05.585688+0000","last_peered":"2024-09-11T22:19:05.585688+0000","last_clean":"2024-09-11T22:19:05.585688+0000","last_became_active":"2024-09-11T22:19:04.596215+0000","last_became_peered":"2024-09-11T22:19:04.596215+0000","last_unstale":"2024-09-11T22:19:05.585688+0000","last_undegraded":"2024-09-11T22:19:05.585688+0000","last_fullsized":"2024-09-11T22:19:05.585688+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:35.628231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221783+0000","last_change":"2024-09-11T22:19:04.597919+0000","last_active":"2024-09-11T22:19:06.221783+0000","last_peered":"2024-09-11T22:19:06.221783+0000","last_clean":"2024-09-11T22:19:06.221783+0000","last_became_active":"2024-09-11T22:19:04.597600+0000","last_became_peered":"2024-09-11T22:19:04.597600+0000","last_unstale":"2024-09-11T22:19:06.221783+0000","last_undegraded":"2024-09-11T22:19:06.221783+0000","last_fullsized":"2024-09-11T22:19:06.221783+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:38.450875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221912+0000","last_change":"2024-09-11T22:19:04.596094+0000","last_active":"2024-09-11T22:19:06.221912+0000","last_peered":"2024-09-11T22:19:06.221912+0000","last_clean":"2024-09-11T22:19:06.221912+0000","last_became_active":"2024-09-11T22:19:04.595654+0000","last_became_peered":"2024-09-11T22:19:04.595654+0000","last_unstale":"2024-09-11T22:19:06.221912+0000","last_undegraded":"2024-09-11T22:19:06.221912+0000","last_fullsized":"2024-09-11T22:19:06.221912+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:50.805838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221170+0000","last_change":"2024-09-11T22:19:04.602111+0000","last_active":"2024-09-11T22:19:06.221170+0000","last_peered":"2024-09-11T22:19:06.221170+0000","last_clean":"2024-09-11T22:19:06.221170+0000","last_became_active":"2024-09-11T22:19:04.601787+0000","last_became_peered":"2024-09-11T22:19:04.601787+0000","last_unstale":"2024-09-11T22:19:06.221170+0000","last_undegraded":"2024-09-11T22:19:06.221170+0000","last_fullsized":"2024-09-11T22:19:06.221170+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:52.810353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589641+0000","last_change":"2024-09-11T22:19:04.605030+0000","last_active":"2024-09-11T22:19:05.589641+0000","last_peered":"2024-09-11T22:19:05.589641+0000","last_clean":"2024-09-11T22:19:05.589641+0000","last_became_active":"2024-09-11T22:19:04.604526+0000","last_became_peered":"2024-09-11T22:19:04.604526+0000","last_unstale":"2024-09-11T22:19:05.589641+0000","last_undegraded":"2024-09-11T22:19:05.589641+0000","last_fullsized":"2024-09-11T22:19:05.589641+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:29.419254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221867+0000","last_change":"2024-09-11T22:19:04.602158+0000","last_active":"2024-09-11T22:19:06.221867+0000","last_peered":"2024-09-11T22:19:06.221867+0000","last_clean":"2024-09-11T22:19:06.221867+0000","last_became_active":"2024-09-11T22:19:04.601160+0000","last_became_peered":"2024-09-11T22:19:04.601160+0000","last_unstale":"2024-09-11T22:19:06.221867+0000","last_undegraded":"2024-09-11T22:19:06.221867+0000","last_fullsized":"2024-09-11T22:19:06.221867+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:57.657597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221384+0000","last_change":"2024-09-11T22:19:04.607266+0000","last_active":"2024-09-11T22:19:06.221384+0000","last_peered":"2024-09-11T22:19:06.221384+0000","last_clean":"2024-09-11T22:19:06.221384+0000","last_became_active":"2024-09-11T22:19:04.606798+0000","last_became_peered":"2024-09-11T22:19:04.606798+0000","last_unstale":"2024-09-11T22:19:06.221384+0000","last_undegraded":"2024-09-11T22:19:06.221384+0000","last_fullsized":"2024-09-11T22:19:06.221384+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:54.948029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220650+0000","last_change":"2024-09-11T22:19:04.607858+0000","last_active":"2024-09-11T22:19:06.220650+0000","last_peered":"2024-09-11T22:19:06.220650+0000","last_clean":"2024-09-11T22:19:06.220650+0000","last_became_active":"2024-09-11T22:19:04.607583+0000","last_became_peered":"2024-09-11T22:19:04.607583+0000","last_unstale":"2024-09-11T22:19:06.220650+0000","last_undegraded":"2024-09-11T22:19:06.220650+0000","last_fullsized":"2024-09-11T22:19:06.220650+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:38.749909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589416+0000","last_change":"2024-09-11T22:19:04.603587+0000","last_active":"2024-09-11T22:19:05.589416+0000","last_peered":"2024-09-11T22:19:05.589416+0000","last_clean":"2024-09-11T22:19:05.589416+0000","last_became_active":"2024-09-11T22:19:04.603220+0000","last_became_peered":"2024-09-11T22:19:04.603220+0000","last_unstale":"2024-09-11T22:19:05.589416+0000","last_undegraded":"2024-09-11T22:19:05.589416+0000","last_fullsized":"2024-09-11T22:19:05.589416+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:07.504531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.222033+0000","last_change":"2024-09-11T22:19:04.595836+0000","last_active":"2024-09-11T22:19:06.222033+0000","last_peered":"2024-09-11T22:19:06.222033+0000","last_clean":"2024-09-11T22:19:06.222033+0000","last_became_active":"2024-09-11T22:19:04.595241+0000","last_became_peered":"2024-09-11T22:19:04.595241+0000","last_unstale":"2024-09-11T22:19:06.222033+0000","last_undegraded":"2024-09-11T22:19:06.222033+0000","last_fullsized":"2024-09-11T22:19:06.222033+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:35.628231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"131'4","reported_seq":18,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221244+0000","last_change":"2024-09-11T22:19:03.657633+0000","last_active":"2024-09-11T22:19:06.221244+0000","last_peered":"2024-09-11T22:19:06.221244+0000","last_clean":"2024-09-11T22:19:06.221244+0000","last_became_active":"2024-09-11T22:19:03.657372+0000","last_became_peered":"2024-09-11T22:19:03.657372+0000","last_unstale":"2024-09-11T22:19:06.221244+0000","last_undegraded":"2024-09-11T22:19:06.221244+0000","last_fullsized":"2024-09-11T22:19:06.221244+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:37.662172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221688+0000","last_change":"2024-09-11T22:19:04.599738+0000","last_active":"2024-09-11T22:19:06.221688+0000","last_peered":"2024-09-11T22:19:06.221688+0000","last_clean":"2024-09-11T22:19:06.221688+0000","last_became_active":"2024-09-11T22:19:04.599317+0000","last_became_peered":"2024-09-11T22:19:04.599317+0000","last_unstale":"2024-09-11T22:19:06.221688+0000","last_undegraded":"2024-09-11T22:19:06.221688+0000","last_fullsized":"2024-09-11T22:19:06.221688+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:26.436036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590027+0000","last_change":"2024-09-11T22:19:03.652664+0000","last_active":"2024-09-11T22:19:05.590027+0000","last_peered":"2024-09-11T22:19:05.590027+0000","last_clean":"2024-09-11T22:19:05.590027+0000","last_became_active":"2024-09-11T22:19:03.652377+0000","last_became_peered":"2024-09-11T22:19:03.652377+0000","last_unstale":"2024-09-11T22:19:05.590027+0000","last_undegraded":"2024-09-11T22:19:05.590027+0000","last_fullsized":"2024-09-11T22:19:05.590027+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:19.401951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221101+0000","last_change":"2024-09-11T22:19:04.607846+0000","last_active":"2024-09-11T22:19:06.221101+0000","last_peered":"2024-09-11T22:19:06.221101+0000","last_clean":"2024-09-11T22:19:06.221101+0000","last_became_active":"2024-09-11T22:19:04.607539+0000","last_became_peered":"2024-09-11T22:19:04.607539+0000","last_unstale":"2024-09-11T22:19:06.221101+0000","last_undegraded":"2024-09-11T22:19:06.221101+0000","last_fullsized":"2024-09-11T22:19:06.221101+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:39.137292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.586016+0000","last_change":"2024-09-11T22:19:03.646165+0000","last_active":"2024-09-11T22:19:05.586016+0000","last_peered":"2024-09-11T22:19:05.586016+0000","last_clean":"2024-09-11T22:19:05.586016+0000","last_became_active":"2024-09-11T22:19:03.644773+0000","last_became_peered":"2024-09-11T22:19:03.644773+0000","last_unstale":"2024-09-11T22:19:05.586016+0000","last_undegraded":"2024-09-11T22:19:05.586016+0000","last_fullsized":"2024-09-11T22:19:05.586016+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:37.762092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221299+0000","last_change":"2024-09-11T22:19:04.608209+0000","last_active":"2024-09-11T22:19:06.221299+0000","last_peered":"2024-09-11T22:19:06.221299+0000","last_clean":"2024-09-11T22:19:06.221299+0000","last_became_active":"2024-09-11T22:19:04.607723+0000","last_became_peered":"2024-09-11T22:19:04.607723+0000","last_unstale":"2024-09-11T22:19:06.221299+0000","last_undegraded":"2024-09-11T22:19:06.221299+0000","last_fullsized":"2024-09-11T22:19:06.221299+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:29.361777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220848+0000","last_change":"2024-09-11T22:19:03.649748+0000","last_active":"2024-09-11T22:19:06.220848+0000","last_peered":"2024-09-11T22:19:06.220848+0000","last_clean":"2024-09-11T22:19:06.220848+0000","last_became_active":"2024-09-11T22:19:03.649467+0000","last_became_peered":"2024-09-11T22:19:03.649467+0000","last_unstale":"2024-09-11T22:19:06.220848+0000","last_undegraded":"2024-09-11T22:19:06.220848+0000","last_fullsized":"2024-09-11T22:19:06.220848+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:43.376628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220817+0000","last_change":"2024-09-11T22:19:04.590837+0000","last_active":"2024-09-11T22:19:06.220817+0000","last_peered":"2024-09-11T22:19:06.220817+0000","last_clean":"2024-09-11T22:19:06.220817+0000","last_became_active":"2024-09-11T22:19:04.590545+0000","last_became_peered":"2024-09-11T22:19:04.590545+0000","last_unstale":"2024-09-11T22:19:06.220817+0000","last_undegraded":"2024-09-11T22:19:06.220817+0000","last_fullsized":"2024-09-11T22:19:06.220817+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:15.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220281+0000","last_change":"2024-09-11T22:19:03.649522+0000","last_active":"2024-09-11T22:19:06.220281+0000","last_peered":"2024-09-11T22:19:06.220281+0000","last_clean":"2024-09-11T22:19:06.220281+0000","last_became_active":"2024-09-11T22:19:03.649244+0000","last_became_peered":"2024-09-11T22:19:03.649244+0000","last_unstale":"2024-09-11T22:19:06.220281+0000","last_undegraded":"2024-09-11T22:19:06.220281+0000","last_fullsized":"2024-09-11T22:19:06.220281+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:18.904813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590572+0000","last_change":"2024-09-11T22:19:04.602059+0000","last_active":"2024-09-11T22:19:05.590572+0000","last_peered":"2024-09-11T22:19:05.590572+0000","last_clean":"2024-09-11T22:19:05.590572+0000","last_became_active":"2024-09-11T22:19:04.601601+0000","last_became_peered":"2024-09-11T22:19:04.601601+0000","last_unstale":"2024-09-11T22:19:05.590572+0000","last_undegraded":"2024-09-11T22:19:05.590572+0000","last_fullsized":"2024-09-11T22:19:05.590572+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:42.712613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220925+0000","last_change":"2024-09-11T22:19:03.651101+0000","last_active":"2024-09-11T22:19:06.220925+0000","last_peered":"2024-09-11T22:19:06.220925+0000","last_clean":"2024-09-11T22:19:06.220925+0000","last_became_active":"2024-09-11T22:19:03.650795+0000","last_became_peered":"2024-09-11T22:19:03.650795+0000","last_unstale":"2024-09-11T22:19:06.220925+0000","last_undegraded":"2024-09-11T22:19:06.220925+0000","last_fullsized":"2024-09-11T22:19:06.220925+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:05.644348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220706+0000","last_change":"2024-09-11T22:19:04.602369+0000","last_active":"2024-09-11T22:19:06.220706+0000","last_peered":"2024-09-11T22:19:06.220706+0000","last_clean":"2024-09-11T22:19:06.220706+0000","last_became_active":"2024-09-11T22:19:04.602101+0000","last_became_peered":"2024-09-11T22:19:04.602101+0000","last_unstale":"2024-09-11T22:19:06.220706+0000","last_undegraded":"2024-09-11T22:19:06.220706+0000","last_fullsized":"2024-09-11T22:19:06.220706+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:55.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589687+0000","last_change":"2024-09-11T22:19:03.659081+0000","last_active":"2024-09-11T22:19:05.589687+0000","last_peered":"2024-09-11T22:19:05.589687+0000","last_clean":"2024-09-11T22:19:05.589687+0000","last_became_active":"2024-09-11T22:19:03.658782+0000","last_became_peered":"2024-09-11T22:19:03.658782+0000","last_unstale":"2024-09-11T22:19:05.589687+0000","last_undegraded":"2024-09-11T22:19:05.589687+0000","last_fullsized":"2024-09-11T22:19:05.589687+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:18.473813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221042+0000","last_change":"2024-09-11T22:19:04.602726+0000","last_active":"2024-09-11T22:19:06.221042+0000","last_peered":"2024-09-11T22:19:06.221042+0000","last_clean":"2024-09-11T22:19:06.221042+0000","last_became_active":"2024-09-11T22:19:04.602439+0000","last_became_peered":"2024-09-11T22:19:04.602439+0000","last_unstale":"2024-09-11T22:19:06.221042+0000","last_undegraded":"2024-09-11T22:19:06.221042+0000","last_fullsized":"2024-09-11T22:19:06.221042+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:07.363216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220859+0000","last_change":"2024-09-11T22:19:03.656863+0000","last_active":"2024-09-11T22:19:06.220859+0000","last_peered":"2024-09-11T22:19:06.220859+0000","last_clean":"2024-09-11T22:19:06.220859+0000","last_became_active":"2024-09-11T22:19:03.656244+0000","last_became_peered":"2024-09-11T22:19:03.656244+0000","last_unstale":"2024-09-11T22:19:06.220859+0000","last_undegraded":"2024-09-11T22:19:06.220859+0000","last_fullsized":"2024-09-11T22:19:06.220859+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:19.401951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221522+0000","last_change":"2024-09-11T22:19:04.599432+0000","last_active":"2024-09-11T22:19:06.221522+0000","last_peered":"2024-09-11T22:19:06.221522+0000","last_clean":"2024-09-11T22:19:06.221522+0000","last_became_active":"2024-09-11T22:19:04.599151+0000","last_became_peered":"2024-09-11T22:19:04.599151+0000","last_unstale":"2024-09-11T22:19:06.221522+0000","last_undegraded":"2024-09-11T22:19:06.221522+0000","last_fullsized":"2024-09-11T22:19:06.221522+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:06.264509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590038+0000","last_change":"2024-09-11T22:19:03.652549+0000","last_active":"2024-09-11T22:19:05.590038+0000","last_peered":"2024-09-11T22:19:05.590038+0000","last_clean":"2024-09-11T22:19:05.590038+0000","last_became_active":"2024-09-11T22:19:03.652228+0000","last_became_peered":"2024-09-11T22:19:03.652228+0000","last_unstale":"2024-09-11T22:19:05.590038+0000","last_undegraded":"2024-09-11T22:19:05.590038+0000","last_fullsized":"2024-09-11T22:19:05.590038+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:24:38.593905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589821+0000","last_change":"2024-09-11T22:19:04.602330+0000","last_active":"2024-09-11T22:19:05.589821+0000","last_peered":"2024-09-11T22:19:05.589821+0000","last_clean":"2024-09-11T22:19:05.589821+0000","last_became_active":"2024-09-11T22:19:04.602043+0000","last_became_peered":"2024-09-11T22:19:04.602043+0000","last_unstale":"2024-09-11T22:19:05.589821+0000","last_undegraded":"2024-09-11T22:19:05.589821+0000","last_fullsized":"2024-09-11T22:19:05.589821+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:45.286941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.222015+0000","last_change":"2024-09-11T22:19:03.657825+0000","last_active":"2024-09-11T22:19:06.222015+0000","last_peered":"2024-09-11T22:19:06.222015+0000","last_clean":"2024-09-11T22:19:06.222015+0000","last_became_active":"2024-09-11T22:19:03.657543+0000","last_became_peered":"2024-09-11T22:19:03.657543+0000","last_unstale":"2024-09-11T22:19:06.222015+0000","last_undegraded":"2024-09-11T22:19:06.222015+0000","last_fullsized":"2024-09-11T22:19:06.222015+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:43.363066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221245+0000","last_change":"2024-09-11T22:19:04.605484+0000","last_active":"2024-09-11T22:19:06.221245+0000","last_peered":"2024-09-11T22:19:06.221245+0000","last_clean":"2024-09-11T22:19:06.221245+0000","last_became_active":"2024-09-11T22:19:04.605208+0000","last_became_peered":"2024-09-11T22:19:04.605208+0000","last_unstale":"2024-09-11T22:19:06.221245+0000","last_undegraded":"2024-09-11T22:19:06.221245+0000","last_fullsized":"2024-09-11T22:19:06.221245+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:20.257908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"131'3","reported_seq":17,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589472+0000","last_change":"2024-09-11T22:19:03.656806+0000","last_active":"2024-09-11T22:19:05.589472+0000","last_peered":"2024-09-11T22:19:05.589472+0000","last_clean":"2024-09-11T22:19:05.589472+0000","last_became_active":"2024-09-11T22:19:03.656469+0000","last_became_peered":"2024-09-11T22:19:03.656469+0000","last_unstale":"2024-09-11T22:19:05.589472+0000","last_undegraded":"2024-09-11T22:19:05.589472+0000","last_fullsized":"2024-09-11T22:19:05.589472+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:43.376628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221354+0000","last_change":"2024-09-11T22:19:04.605154+0000","last_active":"2024-09-11T22:19:06.221354+0000","last_peered":"2024-09-11T22:19:06.221354+0000","last_clean":"2024-09-11T22:19:06.221354+0000","last_became_active":"2024-09-11T22:19:04.604838+0000","last_became_peered":"2024-09-11T22:19:04.604838+0000","last_unstale":"2024-09-11T22:19:06.221354+0000","last_undegraded":"2024-09-11T22:19:06.221354+0000","last_fullsized":"2024-09-11T22:19:06.221354+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:14.391949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"131'6","reported_seq":20,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221300+0000","last_change":"2024-09-11T22:19:03.658102+0000","last_active":"2024-09-11T22:19:06.221300+0000","last_peered":"2024-09-11T22:19:06.221300+0000","last_clean":"2024-09-11T22:19:06.221300+0000","last_became_active":"2024-09-11T22:19:03.657816+0000","last_became_peered":"2024-09-11T22:19:03.657816+0000","last_unstale":"2024-09-11T22:19:06.221300+0000","last_undegraded":"2024-09-11T22:19:06.221300+0000","last_fullsized":"2024-09-11T22:19:06.221300+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:29.373948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221877+0000","last_change":"2024-09-11T22:19:04.598642+0000","last_active":"2024-09-11T22:19:06.221877+0000","last_peered":"2024-09-11T22:19:06.221877+0000","last_clean":"2024-09-11T22:19:06.221877+0000","last_became_active":"2024-09-11T22:19:04.598329+0000","last_became_peered":"2024-09-11T22:19:04.598329+0000","last_unstale":"2024-09-11T22:19:06.221877+0000","last_undegraded":"2024-09-11T22:19:06.221877+0000","last_fullsized":"2024-09-11T22:19:06.221877+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:27.785617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221244+0000","last_change":"2024-09-11T22:19:03.652627+0000","last_active":"2024-09-11T22:19:06.221244+0000","last_peered":"2024-09-11T22:19:06.221244+0000","last_clean":"2024-09-11T22:19:06.221244+0000","last_became_active":"2024-09-11T22:19:03.652320+0000","last_became_peered":"2024-09-11T22:19:03.652320+0000","last_unstale":"2024-09-11T22:19:06.221244+0000","last_undegraded":"2024-09-11T22:19:06.221244+0000","last_fullsized":"2024-09-11T22:19:06.221244+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:23.173009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220210+0000","last_change":"2024-09-11T22:19:04.601649+0000","last_active":"2024-09-11T22:19:06.220210+0000","last_peered":"2024-09-11T22:19:06.220210+0000","last_clean":"2024-09-11T22:19:06.220210+0000","last_became_active":"2024-09-11T22:19:04.601363+0000","last_became_peered":"2024-09-11T22:19:04.601363+0000","last_unstale":"2024-09-11T22:19:06.220210+0000","last_undegraded":"2024-09-11T22:19:06.220210+0000","last_fullsized":"2024-09-11T22:19:06.220210+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:19.475857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221274+0000","last_change":"2024-09-11T22:19:03.657984+0000","last_active":"2024-09-11T22:19:06.221274+0000","last_peered":"2024-09-11T22:19:06.221274+0000","last_clean":"2024-09-11T22:19:06.221274+0000","last_became_active":"2024-09-11T22:19:03.657671+0000","last_became_peered":"2024-09-11T22:19:03.657671+0000","last_unstale":"2024-09-11T22:19:06.221274+0000","last_undegraded":"2024-09-11T22:19:06.221274+0000","last_fullsized":"2024-09-11T22:19:06.221274+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:41.664387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221409+0000","last_change":"2024-09-11T22:19:04.603019+0000","last_active":"2024-09-11T22:19:06.221409+0000","last_peered":"2024-09-11T22:19:06.221409+0000","last_clean":"2024-09-11T22:19:06.221409+0000","last_became_active":"2024-09-11T22:19:04.601460+0000","last_became_peered":"2024-09-11T22:19:04.601460+0000","last_unstale":"2024-09-11T22:19:06.221409+0000","last_undegraded":"2024-09-11T22:19:06.221409+0000","last_fullsized":"2024-09-11T22:19:06.221409+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:29.073485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"131'8","reported_seq":22,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220769+0000","last_change":"2024-09-11T22:19:03.658740+0000","last_active":"2024-09-11T22:19:06.220769+0000","last_peered":"2024-09-11T22:19:06.220769+0000","last_clean":"2024-09-11T22:19:06.220769+0000","last_became_active":"2024-09-11T22:19:03.658380+0000","last_became_peered":"2024-09-11T22:19:03.658380+0000","last_unstale":"2024-09-11T22:19:06.220769+0000","last_undegraded":"2024-09-11T22:19:06.220769+0000","last_fullsized":"2024-09-11T22:19:06.220769+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:43:10.447662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221530+0000","last_change":"2024-09-11T22:19:04.602064+0000","last_active":"2024-09-11T22:19:06.221530+0000","last_peered":"2024-09-11T22:19:06.221530+0000","last_clean":"2024-09-11T22:19:06.221530+0000","last_became_active":"2024-09-11T22:19:04.601781+0000","last_became_peered":"2024-09-11T22:19:04.601781+0000","last_unstale":"2024-09-11T22:19:06.221530+0000","last_undegraded":"2024-09-11T22:19:06.221530+0000","last_fullsized":"2024-09-11T22:19:06.221530+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:44.447391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590143+0000","last_change":"2024-09-11T22:19:03.658363+0000","last_active":"2024-09-11T22:19:05.590143+0000","last_peered":"2024-09-11T22:19:05.590143+0000","last_clean":"2024-09-11T22:19:05.590143+0000","last_became_active":"2024-09-11T22:19:03.658100+0000","last_became_peered":"2024-09-11T22:19:03.658100+0000","last_unstale":"2024-09-11T22:19:05.590143+0000","last_undegraded":"2024-09-11T22:19:05.590143+0000","last_fullsized":"2024-09-11T22:19:05.590143+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:58.049878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589968+0000","last_change":"2024-09-11T22:19:04.598194+0000","last_active":"2024-09-11T22:19:05.589968+0000","last_peered":"2024-09-11T22:19:05.589968+0000","last_clean":"2024-09-11T22:19:05.589968+0000","last_became_active":"2024-09-11T22:19:04.597881+0000","last_became_peered":"2024-09-11T22:19:04.597881+0000","last_unstale":"2024-09-11T22:19:05.589968+0000","last_undegraded":"2024-09-11T22:19:05.589968+0000","last_fullsized":"2024-09-11T22:19:05.589968+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:18.972748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.586041+0000","last_change":"2024-09-11T22:19:03.655955+0000","last_active":"2024-09-11T22:19:05.586041+0000","last_peered":"2024-09-11T22:19:05.586041+0000","last_clean":"2024-09-11T22:19:05.586041+0000","last_became_active":"2024-09-11T22:19:03.655394+0000","last_became_peered":"2024-09-11T22:19:03.655394+0000","last_unstale":"2024-09-11T22:19:05.586041+0000","last_undegraded":"2024-09-11T22:19:05.586041+0000","last_fullsized":"2024-09-11T22:19:05.586041+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:14.809749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221372+0000","last_change":"2024-09-11T22:19:04.594995+0000","last_active":"2024-09-11T22:19:06.221372+0000","last_peered":"2024-09-11T22:19:06.221372+0000","last_clean":"2024-09-11T22:19:06.221372+0000","last_became_active":"2024-09-11T22:19:04.594455+0000","last_became_peered":"2024-09-11T22:19:04.594455+0000","last_unstale":"2024-09-11T22:19:06.221372+0000","last_undegraded":"2024-09-11T22:19:06.221372+0000","last_fullsized":"2024-09-11T22:19:06.221372+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:30.319413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590332+0000","last_change":"2024-09-11T22:19:03.659192+0000","last_active":"2024-09-11T22:19:05.590332+0000","last_peered":"2024-09-11T22:19:05.590332+0000","last_clean":"2024-09-11T22:19:05.590332+0000","last_became_active":"2024-09-11T22:19:03.658919+0000","last_became_peered":"2024-09-11T22:19:03.658919+0000","last_unstale":"2024-09-11T22:19:05.590332+0000","last_undegraded":"2024-09-11T22:19:05.590332+0000","last_fullsized":"2024-09-11T22:19:05.590332+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:55.451217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221535+0000","last_change":"2024-09-11T22:19:04.602280+0000","last_active":"2024-09-11T22:19:06.221535+0000","last_peered":"2024-09-11T22:19:06.221535+0000","last_clean":"2024-09-11T22:19:06.221535+0000","last_became_active":"2024-09-11T22:19:04.601993+0000","last_became_peered":"2024-09-11T22:19:04.601993+0000","last_unstale":"2024-09-11T22:19:06.221535+0000","last_undegraded":"2024-09-11T22:19:06.221535+0000","last_fullsized":"2024-09-11T22:19:06.221535+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:42.410226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589786+0000","last_change":"2024-09-11T22:19:03.652729+0000","last_active":"2024-09-11T22:19:05.589786+0000","last_peered":"2024-09-11T22:19:05.589786+0000","last_clean":"2024-09-11T22:19:05.589786+0000","last_became_active":"2024-09-11T22:19:03.652408+0000","last_became_peered":"2024-09-11T22:19:03.652408+0000","last_unstale":"2024-09-11T22:19:05.589786+0000","last_undegraded":"2024-09-11T22:19:05.589786+0000","last_fullsized":"2024-09-11T22:19:05.589786+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:31.764228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221136+0000","last_change":"2024-09-11T22:19:04.601130+0000","last_active":"2024-09-11T22:19:06.221136+0000","last_peered":"2024-09-11T22:19:06.221136+0000","last_clean":"2024-09-11T22:19:06.221136+0000","last_became_active":"2024-09-11T22:19:04.600847+0000","last_became_peered":"2024-09-11T22:19:04.600847+0000","last_unstale":"2024-09-11T22:19:06.221136+0000","last_undegraded":"2024-09-11T22:19:06.221136+0000","last_fullsized":"2024-09-11T22:19:06.221136+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:23.840570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589911+0000","last_change":"2024-09-11T22:19:03.651763+0000","last_active":"2024-09-11T22:19:05.589911+0000","last_peered":"2024-09-11T22:19:05.589911+0000","last_clean":"2024-09-11T22:19:05.589911+0000","last_became_active":"2024-09-11T22:19:03.651464+0000","last_became_peered":"2024-09-11T22:19:03.651464+0000","last_unstale":"2024-09-11T22:19:05.589911+0000","last_undegraded":"2024-09-11T22:19:05.589911+0000","last_fullsized":"2024-09-11T22:19:05.589911+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:41.664387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590839+0000","last_change":"2024-09-11T22:19:04.602659+0000","last_active":"2024-09-11T22:19:05.590839+0000","last_peered":"2024-09-11T22:19:05.590839+0000","last_clean":"2024-09-11T22:19:05.590839+0000","last_became_active":"2024-09-11T22:19:04.602396+0000","last_became_peered":"2024-09-11T22:19:04.602396+0000","last_unstale":"2024-09-11T22:19:05.590839+0000","last_undegraded":"2024-09-11T22:19:05.590839+0000","last_fullsized":"2024-09-11T22:19:05.590839+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:21.748724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221038+0000","last_change":"2024-09-11T22:19:03.656329+0000","last_active":"2024-09-11T22:19:06.221038+0000","last_peered":"2024-09-11T22:19:06.221038+0000","last_clean":"2024-09-11T22:19:06.221038+0000","last_became_active":"2024-09-11T22:19:03.656010+0000","last_became_peered":"2024-09-11T22:19:03.656010+0000","last_unstale":"2024-09-11T22:19:06.221038+0000","last_undegraded":"2024-09-11T22:19:06.221038+0000","last_fullsized":"2024-09-11T22:19:06.221038+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:28.902538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220751+0000","last_change":"2024-09-11T22:19:04.600403+0000","last_active":"2024-09-11T22:19:06.220751+0000","last_peered":"2024-09-11T22:19:06.220751+0000","last_clean":"2024-09-11T22:19:06.220751+0000","last_became_active":"2024-09-11T22:19:04.600067+0000","last_became_peered":"2024-09-11T22:19:04.600067+0000","last_unstale":"2024-09-11T22:19:06.220751+0000","last_undegraded":"2024-09-11T22:19:06.220751+0000","last_fullsized":"2024-09-11T22:19:06.220751+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:58.097055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221119+0000","last_change":"2024-09-11T22:19:03.652845+0000","last_active":"2024-09-11T22:19:06.221119+0000","last_peered":"2024-09-11T22:19:06.221119+0000","last_clean":"2024-09-11T22:19:06.221119+0000","last_became_active":"2024-09-11T22:19:03.651928+0000","last_became_peered":"2024-09-11T22:19:03.651928+0000","last_unstale":"2024-09-11T22:19:06.221119+0000","last_undegraded":"2024-09-11T22:19:06.221119+0000","last_fullsized":"2024-09-11T22:19:06.221119+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:28.020640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220474+0000","last_change":"2024-09-11T22:19:04.607489+0000","last_active":"2024-09-11T22:19:06.220474+0000","last_peered":"2024-09-11T22:19:06.220474+0000","last_clean":"2024-09-11T22:19:06.220474+0000","last_became_active":"2024-09-11T22:19:04.606950+0000","last_became_peered":"2024-09-11T22:19:04.606950+0000","last_unstale":"2024-09-11T22:19:06.220474+0000","last_undegraded":"2024-09-11T22:19:06.220474+0000","last_fullsized":"2024-09-11T22:19:06.220474+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:55.783154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585618+0000","last_change":"2024-09-11T22:19:03.655592+0000","last_active":"2024-09-11T22:19:05.585618+0000","last_peered":"2024-09-11T22:19:05.585618+0000","last_clean":"2024-09-11T22:19:05.585618+0000","last_became_active":"2024-09-11T22:19:03.655319+0000","last_became_peered":"2024-09-11T22:19:03.655319+0000","last_unstale":"2024-09-11T22:19:05.585618+0000","last_undegraded":"2024-09-11T22:19:05.585618+0000","last_fullsized":"2024-09-11T22:19:05.585618+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:17.274260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590774+0000","last_change":"2024-09-11T22:19:04.592226+0000","last_active":"2024-09-11T22:19:05.590774+0000","last_peered":"2024-09-11T22:19:05.590774+0000","last_clean":"2024-09-11T22:19:05.590774+0000","last_became_active":"2024-09-11T22:19:04.591831+0000","last_became_peered":"2024-09-11T22:19:04.591831+0000","last_unstale":"2024-09-11T22:19:05.590774+0000","last_undegraded":"2024-09-11T22:19:05.590774+0000","last_fullsized":"2024-09-11T22:19:05.590774+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:25.712813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221624+0000","last_change":"2024-09-11T22:19:03.653122+0000","last_active":"2024-09-11T22:19:06.221624+0000","last_peered":"2024-09-11T22:19:06.221624+0000","last_clean":"2024-09-11T22:19:06.221624+0000","last_became_active":"2024-09-11T22:19:03.652733+0000","last_became_peered":"2024-09-11T22:19:03.652733+0000","last_unstale":"2024-09-11T22:19:06.221624+0000","last_undegraded":"2024-09-11T22:19:06.221624+0000","last_fullsized":"2024-09-11T22:19:06.221624+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:46.127177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221677+0000","last_change":"2024-09-11T22:19:04.607324+0000","last_active":"2024-09-11T22:19:06.221677+0000","last_peered":"2024-09-11T22:19:06.221677+0000","last_clean":"2024-09-11T22:19:06.221677+0000","last_became_active":"2024-09-11T22:19:04.606948+0000","last_became_peered":"2024-09-11T22:19:04.606948+0000","last_unstale":"2024-09-11T22:19:06.221677+0000","last_undegraded":"2024-09-11T22:19:06.221677+0000","last_fullsized":"2024-09-11T22:19:06.221677+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:42.474866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"132'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.644363+0000","last_change":"2024-09-11T22:19:03.658179+0000","last_active":"2024-09-11T22:19:06.644363+0000","last_peered":"2024-09-11T22:19:06.644363+0000","last_clean":"2024-09-11T22:19:06.644363+0000","last_became_active":"2024-09-11T22:19:03.657895+0000","last_became_peered":"2024-09-11T22:19:03.657895+0000","last_unstale":"2024-09-11T22:19:06.644363+0000","last_undegraded":"2024-09-11T22:19:06.644363+0000","last_fullsized":"2024-09-11T22:19:06.644363+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:08.667757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220681+0000","last_change":"2024-09-11T22:19:04.600520+0000","last_active":"2024-09-11T22:19:06.220681+0000","last_peered":"2024-09-11T22:19:06.220681+0000","last_clean":"2024-09-11T22:19:06.220681+0000","last_became_active":"2024-09-11T22:19:04.600238+0000","last_became_peered":"2024-09-11T22:19:04.600238+0000","last_unstale":"2024-09-11T22:19:06.220681+0000","last_undegraded":"2024-09-11T22:19:06.220681+0000","last_fullsized":"2024-09-11T22:19:06.220681+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:56.453262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221670+0000","last_change":"2024-09-11T22:19:03.656565+0000","last_active":"2024-09-11T22:19:06.221670+0000","last_peered":"2024-09-11T22:19:06.221670+0000","last_clean":"2024-09-11T22:19:06.221670+0000","last_became_active":"2024-09-11T22:19:03.656260+0000","last_became_peered":"2024-09-11T22:19:03.656260+0000","last_unstale":"2024-09-11T22:19:06.221670+0000","last_undegraded":"2024-09-11T22:19:06.221670+0000","last_fullsized":"2024-09-11T22:19:06.221670+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:24:38.593905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590421+0000","last_change":"2024-09-11T22:19:04.595704+0000","last_active":"2024-09-11T22:19:05.590421+0000","last_peered":"2024-09-11T22:19:05.590421+0000","last_clean":"2024-09-11T22:19:05.590421+0000","last_became_active":"2024-09-11T22:19:04.595062+0000","last_became_peered":"2024-09-11T22:19:04.595062+0000","last_unstale":"2024-09-11T22:19:05.590421+0000","last_undegraded":"2024-09-11T22:19:05.590421+0000","last_fullsized":"2024-09-11T22:19:05.590421+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:34.854912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585918+0000","last_change":"2024-09-11T22:19:03.649388+0000","last_active":"2024-09-11T22:19:05.585918+0000","last_peered":"2024-09-11T22:19:05.585918+0000","last_clean":"2024-09-11T22:19:05.585918+0000","last_became_active":"2024-09-11T22:19:03.649080+0000","last_became_peered":"2024-09-11T22:19:03.649080+0000","last_unstale":"2024-09-11T22:19:05.585918+0000","last_undegraded":"2024-09-11T22:19:05.585918+0000","last_fullsized":"2024-09-11T22:19:05.585918+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:25.443138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220720+0000","last_change":"2024-09-11T22:19:04.607362+0000","last_active":"2024-09-11T22:19:06.220720+0000","last_peered":"2024-09-11T22:19:06.220720+0000","last_clean":"2024-09-11T22:19:06.220720+0000","last_became_active":"2024-09-11T22:19:04.607063+0000","last_became_peered":"2024-09-11T22:19:04.607063+0000","last_unstale":"2024-09-11T22:19:06.220720+0000","last_undegraded":"2024-09-11T22:19:06.220720+0000","last_fullsized":"2024-09-11T22:19:06.220720+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:59.918367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220407+0000","last_change":"2024-09-11T22:19:03.659074+0000","last_active":"2024-09-11T22:19:06.220407+0000","last_peered":"2024-09-11T22:19:06.220407+0000","last_clean":"2024-09-11T22:19:06.220407+0000","last_became_active":"2024-09-11T22:19:03.658750+0000","last_became_peered":"2024-09-11T22:19:03.658750+0000","last_unstale":"2024-09-11T22:19:06.220407+0000","last_undegraded":"2024-09-11T22:19:06.220407+0000","last_fullsized":"2024-09-11T22:19:06.220407+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:31.764228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589676+0000","last_change":"2024-09-11T22:19:04.597543+0000","last_active":"2024-09-11T22:19:05.589676+0000","last_peered":"2024-09-11T22:19:05.589676+0000","last_clean":"2024-09-11T22:19:05.589676+0000","last_became_active":"2024-09-11T22:19:04.597262+0000","last_became_peered":"2024-09-11T22:19:04.597262+0000","last_unstale":"2024-09-11T22:19:05.589676+0000","last_undegraded":"2024-09-11T22:19:05.589676+0000","last_fullsized":"2024-09-11T22:19:05.589676+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:41:09.469801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220823+0000","last_change":"2024-09-11T22:19:03.657654+0000","last_active":"2024-09-11T22:19:06.220823+0000","last_peered":"2024-09-11T22:19:06.220823+0000","last_clean":"2024-09-11T22:19:06.220823+0000","last_became_active":"2024-09-11T22:19:03.657357+0000","last_became_peered":"2024-09-11T22:19:03.657357+0000","last_unstale":"2024-09-11T22:19:06.220823+0000","last_undegraded":"2024-09-11T22:19:06.220823+0000","last_fullsized":"2024-09-11T22:19:06.220823+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:51.252945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220645+0000","last_change":"2024-09-11T22:19:04.601746+0000","last_active":"2024-09-11T22:19:06.220645+0000","last_peered":"2024-09-11T22:19:06.220645+0000","last_clean":"2024-09-11T22:19:06.220645+0000","last_became_active":"2024-09-11T22:19:04.600201+0000","last_became_peered":"2024-09-11T22:19:04.600201+0000","last_unstale":"2024-09-11T22:19:06.220645+0000","last_undegraded":"2024-09-11T22:19:06.220645+0000","last_fullsized":"2024-09-11T22:19:06.220645+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:38.764137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221216+0000","last_change":"2024-09-11T22:19:03.657049+0000","last_active":"2024-09-11T22:19:06.221216+0000","last_peered":"2024-09-11T22:19:06.221216+0000","last_clean":"2024-09-11T22:19:06.221216+0000","last_became_active":"2024-09-11T22:19:03.656761+0000","last_became_peered":"2024-09-11T22:19:03.656761+0000","last_unstale":"2024-09-11T22:19:06.221216+0000","last_undegraded":"2024-09-11T22:19:06.221216+0000","last_fullsized":"2024-09-11T22:19:06.221216+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:23.063038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221186+0000","last_change":"2024-09-11T22:19:04.599763+0000","last_active":"2024-09-11T22:19:06.221186+0000","last_peered":"2024-09-11T22:19:06.221186+0000","last_clean":"2024-09-11T22:19:06.221186+0000","last_became_active":"2024-09-11T22:19:04.599487+0000","last_became_peered":"2024-09-11T22:19:04.599487+0000","last_unstale":"2024-09-11T22:19:06.221186+0000","last_undegraded":"2024-09-11T22:19:06.221186+0000","last_fullsized":"2024-09-11T22:19:06.221186+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:55.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585735+0000","last_change":"2024-09-11T22:19:03.652831+0000","last_active":"2024-09-11T22:19:05.585735+0000","last_peered":"2024-09-11T22:19:05.585735+0000","last_clean":"2024-09-11T22:19:05.585735+0000","last_became_active":"2024-09-11T22:19:03.652532+0000","last_became_peered":"2024-09-11T22:19:03.652532+0000","last_unstale":"2024-09-11T22:19:05.585735+0000","last_undegraded":"2024-09-11T22:19:05.585735+0000","last_fullsized":"2024-09-11T22:19:05.585735+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:49.366586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220918+0000","last_change":"2024-09-11T22:19:04.607288+0000","last_active":"2024-09-11T22:19:06.220918+0000","last_peered":"2024-09-11T22:19:06.220918+0000","last_clean":"2024-09-11T22:19:06.220918+0000","last_became_active":"2024-09-11T22:19:04.606876+0000","last_became_peered":"2024-09-11T22:19:04.606876+0000","last_unstale":"2024-09-11T22:19:06.220918+0000","last_undegraded":"2024-09-11T22:19:06.220918+0000","last_fullsized":"2024-09-11T22:19:06.220918+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.340880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221001+0000","last_change":"2024-09-11T22:19:03.660606+0000","last_active":"2024-09-11T22:19:06.221001+0000","last_peered":"2024-09-11T22:19:06.221001+0000","last_clean":"2024-09-11T22:19:06.221001+0000","last_became_active":"2024-09-11T22:19:03.660282+0000","last_became_peered":"2024-09-11T22:19:03.660282+0000","last_unstale":"2024-09-11T22:19:06.221001+0000","last_undegraded":"2024-09-11T22:19:06.221001+0000","last_fullsized":"2024-09-11T22:19:06.221001+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.710149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":372,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220377+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:19:06.220377+0000","last_peered":"2024-09-11T22:19:06.220377+0000","last_clean":"2024-09-11T22:19:06.220377+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:19:06.220377+0000","last_undegraded":"2024-09-11T22:19:06.220377+0000","last_fullsized":"2024-09-11T22:19:06.220377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509542,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46688,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325152,"statfs":{"total":96636764160,"available":96588955648,"internally_reserved":0,"allocated":1650688,"data_stored":720030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509539,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46692,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325148,"statfs":{"total":96636764160,"available":96588951552,"internally_reserved":0,"allocated":1646592,"data_stored":718530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509541,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50844,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320996,"statfs":{"total":96636764160,"available":96584699904,"internally_reserved":0,"allocated":1642496,"data_stored":718488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509541,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55008,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316832,"statfs":{"total":96636764160,"available":96580435968,"internally_reserved":0,"allocated":1646592,"data_stored":718578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509541,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59156,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312684,"statfs":{"total":96636764160,"available":96576188416,"internally_reserved":0,"allocated":1638400,"data_stored":718418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509540,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55584,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316256,"statfs":{"total":96636764160,"available":96579846144,"internally_reserved":0,"allocated":2232320,"data_stored":1308786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47288,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324552,"statfs":{"total":96636764160,"available":96588341248,"internally_reserved":0,"allocated":2256896,"data_stored":1311036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59152,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312688,"statfs":{"total":96636764160,"available":96576192512,"internally_reserved":0,"allocated":1634304,"data_stored":712734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:19:10.538 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-09-11T22:19:10.538+0000 7fecd5990640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:19:13.057 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:19:13.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.171+0000 7f2072bc4640 1 Processor -- start 2024-09-11T22:19:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.171+0000 7f2072bc4640 1 -- start start 2024-09-11T22:19:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.172+0000 7f2072bc4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f206c0cfd70 0x7f206c072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.172+0000 7f2072bc4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f206c0b45b0 0x7f206c0b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.172+0000 7f2072bc4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f206c0d0150 con 0x7f206c0b5470 2024-09-11T22:19:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.172+0000 7f2072bc4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f206c0b4f60 con 0x7f206c0cfd70 2024-09-11T22:19:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.172+0000 7f2072bc4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f206c0b3510 con 0x7f206c0b45b0 2024-09-11T22:19:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.172+0000 7f2070960640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f206c0cfd70 0x7f206c072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.173+0000 7f206bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f206c0b5470 0x7f206c16b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36442/0 (socket says 172.21.15.50:36442) 2024-09-11T22:19:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.173+0000 7f2070960640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f206c0cfd70 0x7f206c072cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56828/0 (socket says 172.21.15.50:56828) 2024-09-11T22:19:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.173+0000 7f206bfff640 1 -- 172.21.15.50:0/3194067198 learned_addr learned my addr 172.21.15.50:0/3194067198 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.173+0000 7f2071161640 1 --2- 172.21.15.50:0/3194067198 >> v2:172.21.15.77:3300/0 conn(0x7f206c0b45b0 0x7f206c0b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.173+0000 7f2070960640 1 -- 172.21.15.50:0/3194067198 >> v2:172.21.15.77:3300/0 conn(0x7f206c0b45b0 msgr2=0x7f206c0b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.173+0000 7f2070960640 1 --2- 172.21.15.50:0/3194067198 >> v2:172.21.15.77:3300/0 conn(0x7f206c0b45b0 0x7f206c0b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.173+0000 7f2070960640 1 -- 172.21.15.50:0/3194067198 >> v1:172.21.15.50:6789/0 conn(0x7f206c0b5470 legacy=0x7f206c16b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.173+0000 7f2070960640 1 -- 172.21.15.50:0/3194067198 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206c0b37f0 con 0x7f206c0cfd70 2024-09-11T22:19:13.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.174+0000 7f2070960640 1 --2- 172.21.15.50:0/3194067198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f206c0cfd70 0x7f206c072cb0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f206c06e650 tx=0x7f205c02b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778e3e1b58e7c954 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:13.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.174+0000 7f206b7fe640 1 -- 172.21.15.50:0/3194067198 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c00a4e0 con 0x7f206c0cfd70 2024-09-11T22:19:13.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.174+0000 7f206b7fe640 1 -- 172.21.15.50:0/3194067198 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205c00a680 con 0x7f206c0cfd70 2024-09-11T22:19:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.174+0000 7f206b7fe640 1 -- 172.21.15.50:0/3194067198 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c00aa70 con 0x7f206c0cfd70 2024-09-11T22:19:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.174+0000 7f2072bc4640 1 -- 172.21.15.50:0/3194067198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f206c0cfd70 msgr2=0x7f206c072cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.174+0000 7f2072bc4640 1 --2- 172.21.15.50:0/3194067198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f206c0cfd70 0x7f206c072cb0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f206c06e650 tx=0x7f205c02b590 comp rx=0 tx=0).stop 2024-09-11T22:19:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.174+0000 7f2072bc4640 1 -- 172.21.15.50:0/3194067198 shutdown_connections 2024-09-11T22:19:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.174+0000 7f2072bc4640 1 --2- 172.21.15.50:0/3194067198 >> v2:172.21.15.77:3300/0 conn(0x7f206c0b45b0 0x7f206c0b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.174+0000 7f2072bc4640 1 --2- 172.21.15.50:0/3194067198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f206c0cfd70 0x7f206c072cb0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.174+0000 7f2072bc4640 1 -- 172.21.15.50:0/3194067198 >> 172.21.15.50:0/3194067198 conn(0x7f206c0b2100 msgr2=0x7f206c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.175+0000 7f2072bc4640 1 -- 172.21.15.50:0/3194067198 shutdown_connections 2024-09-11T22:19:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.175+0000 7f2072bc4640 1 -- 172.21.15.50:0/3194067198 wait complete. 2024-09-11T22:19:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.176+0000 7f2072bc4640 1 Processor -- start 2024-09-11T22:19:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.176+0000 7f2072bc4640 1 -- start start 2024-09-11T22:19:13.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2072bc4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f206c0b45b0 0x7f206c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2072bc4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f206c0b5470 0x7f206c08bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2072bc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f206c0cfd70 0x7f206c15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2072bc4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f206c0b4090 con 0x7f206c0cfd70 2024-09-11T22:19:13.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2072bc4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f206c0b3db0 con 0x7f206c0b45b0 2024-09-11T22:19:13.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2072bc4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f206c16c090 con 0x7f206c0b5470 2024-09-11T22:19:13.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2071161640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f206c0cfd70 0x7f206c15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2071161640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f206c0cfd70 0x7f206c15eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56844/0 (socket says 172.21.15.50:56844) 2024-09-11T22:19:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2071161640 1 -- 172.21.15.50:0/360115481 learned_addr learned my addr 172.21.15.50:0/360115481 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f206bfff640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f206c0b5470 0x7f206c08bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2070960640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f206c0b45b0 0x7f206c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2071161640 1 -- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f206c0b5470 msgr2=0x7f206c08bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2071161640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f206c0b5470 0x7f206c08bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2071161640 1 -- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f206c0b45b0 msgr2=0x7f206c15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2071161640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f206c0b45b0 0x7f206c15d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2071161640 1 -- 172.21.15.50:0/360115481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206c168b70 con 0x7f206c0cfd70 2024-09-11T22:19:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f206bfff640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f206c0b5470 0x7f206c08bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.177+0000 7f2070960640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f206c0b45b0 0x7f206c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.178+0000 7f2071161640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f206c0cfd70 0x7f206c15eb80 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f206400d830 tx=0x7f206400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:13.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.178+0000 7f20697fa640 1 -- 172.21.15.50:0/360115481 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206400b6c0 con 0x7f206c0cfd70 2024-09-11T22:19:13.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.178+0000 7f20697fa640 1 -- 172.21.15.50:0/360115481 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2064019070 con 0x7f206c0cfd70 2024-09-11T22:19:13.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.178+0000 7f2072bc4640 1 -- 172.21.15.50:0/360115481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f206c168e50 con 0x7f206c0cfd70 2024-09-11T22:19:13.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.178+0000 7f20697fa640 1 -- 172.21.15.50:0/360115481 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206400bac0 con 0x7f206c0cfd70 2024-09-11T22:19:13.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.178+0000 7f2072bc4640 1 -- 172.21.15.50:0/360115481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f206c169410 con 0x7f206c0cfd70 2024-09-11T22:19:13.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.179+0000 7f2072bc4640 1 -- 172.21.15.50:0/360115481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f206c0b4a20 con 0x7f206c0cfd70 2024-09-11T22:19:13.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.179+0000 7f20697fa640 1 -- 172.21.15.50:0/360115481 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f206401e460 con 0x7f206c0cfd70 2024-09-11T22:19:13.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.180+0000 7f20697fa640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f204c06be30 0x7f204c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.180+0000 7f20697fa640 1 -- 172.21.15.50:0/360115481 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f206408b500 con 0x7f206c0cfd70 2024-09-11T22:19:13.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.180+0000 7f2070960640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f204c06be30 0x7f204c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.181+0000 7f2070960640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f204c06be30 0x7f204c06e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f205c033000 tx=0x7f205c00a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:13.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.184+0000 7f20697fa640 1 -- 172.21.15.50:0/360115481 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2064059eb0 con 0x7f206c0cfd70 2024-09-11T22:19:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.359+0000 7f2072bc4640 1 -- 172.21.15.50:0/360115481 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f206c0afa50 con 0x7f204c06be30 2024-09-11T22:19:13.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.365+0000 7f20697fa640 1 -- 172.21.15.50:0/360115481 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252471 (secure 0 0 0) 0x7f206c0afa50 con 0x7f204c06be30 2024-09-11T22:19:13.369 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:19:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.368+0000 7f2072bc4640 1 -- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f204c06be30 msgr2=0x7f204c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.368+0000 7f2072bc4640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f204c06be30 0x7f204c06e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f205c033000 tx=0x7f205c00a000 comp rx=0 tx=0).stop 2024-09-11T22:19:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.368+0000 7f2072bc4640 1 -- 172.21.15.50:0/360115481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f206c0cfd70 msgr2=0x7f206c15eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.368+0000 7f2072bc4640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f206c0cfd70 0x7f206c15eb80 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f206400d830 tx=0x7f206400dcf0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.368+0000 7f2072bc4640 1 -- 172.21.15.50:0/360115481 shutdown_connections 2024-09-11T22:19:13.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.368+0000 7f2072bc4640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f204c06be30 0x7f204c06e2f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.368+0000 7f2072bc4640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f206c0b5470 0x7f206c08bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.368+0000 7f2072bc4640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f206c0cfd70 0x7f206c15eb80 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.368+0000 7f2072bc4640 1 --2- 172.21.15.50:0/360115481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f206c0b45b0 0x7f206c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.368+0000 7f2072bc4640 1 -- 172.21.15.50:0/360115481 >> 172.21.15.50:0/360115481 conn(0x7f206c0b2100 msgr2=0x7f206c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:13.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.368+0000 7f2072bc4640 1 -- 172.21.15.50:0/360115481 shutdown_connections 2024-09-11T22:19:13.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.368+0000 7f2072bc4640 1 -- 172.21.15.50:0/360115481 wait complete. 2024-09-11T22:19:13.380 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":370,"stamp":"2024-09-11T22:19:11.480451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":420428,"kb_used_data":14024,"kb_used_omap":12,"kb_used_meta":406195,"kb_avail":754554292,"statfs":{"total":773094113280,"available":772663595008,"internally_reserved":0,"allocated":14360576,"data_stored":6932900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":415944241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.837117"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221490+0000","last_change":"2024-09-11T22:19:04.601864+0000","last_active":"2024-09-11T22:19:06.221490+0000","last_peered":"2024-09-11T22:19:06.221490+0000","last_clean":"2024-09-11T22:19:06.221490+0000","last_became_active":"2024-09-11T22:19:04.601567+0000","last_became_peered":"2024-09-11T22:19:04.601567+0000","last_unstale":"2024-09-11T22:19:06.221490+0000","last_undegraded":"2024-09-11T22:19:06.221490+0000","last_fullsized":"2024-09-11T22:19:06.221490+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:37.691839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221938+0000","last_change":"2024-09-11T22:19:04.594827+0000","last_active":"2024-09-11T22:19:06.221938+0000","last_peered":"2024-09-11T22:19:06.221938+0000","last_clean":"2024-09-11T22:19:06.221938+0000","last_became_active":"2024-09-11T22:19:04.594503+0000","last_became_peered":"2024-09-11T22:19:04.594503+0000","last_unstale":"2024-09-11T22:19:06.221938+0000","last_undegraded":"2024-09-11T22:19:06.221938+0000","last_fullsized":"2024-09-11T22:19:06.221938+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:11.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221039+0000","last_change":"2024-09-11T22:19:04.603202+0000","last_active":"2024-09-11T22:19:06.221039+0000","last_peered":"2024-09-11T22:19:06.221039+0000","last_clean":"2024-09-11T22:19:06.221039+0000","last_became_active":"2024-09-11T22:19:04.602864+0000","last_became_peered":"2024-09-11T22:19:04.602864+0000","last_unstale":"2024-09-11T22:19:06.221039+0000","last_undegraded":"2024-09-11T22:19:06.221039+0000","last_fullsized":"2024-09-11T22:19:06.221039+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:42.410226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220838+0000","last_change":"2024-09-11T22:19:04.601956+0000","last_active":"2024-09-11T22:19:06.220838+0000","last_peered":"2024-09-11T22:19:06.220838+0000","last_clean":"2024-09-11T22:19:06.220838+0000","last_became_active":"2024-09-11T22:19:04.601249+0000","last_became_peered":"2024-09-11T22:19:04.601249+0000","last_unstale":"2024-09-11T22:19:06.220838+0000","last_undegraded":"2024-09-11T22:19:06.220838+0000","last_fullsized":"2024-09-11T22:19:06.220838+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:37.836260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220888+0000","last_change":"2024-09-11T22:19:04.600564+0000","last_active":"2024-09-11T22:19:06.220888+0000","last_peered":"2024-09-11T22:19:06.220888+0000","last_clean":"2024-09-11T22:19:06.220888+0000","last_became_active":"2024-09-11T22:19:04.600260+0000","last_became_peered":"2024-09-11T22:19:04.600260+0000","last_unstale":"2024-09-11T22:19:06.220888+0000","last_undegraded":"2024-09-11T22:19:06.220888+0000","last_fullsized":"2024-09-11T22:19:06.220888+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:28.037951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590490+0000","last_change":"2024-09-11T22:19:04.596429+0000","last_active":"2024-09-11T22:19:05.590490+0000","last_peered":"2024-09-11T22:19:05.590490+0000","last_clean":"2024-09-11T22:19:05.590490+0000","last_became_active":"2024-09-11T22:19:04.596123+0000","last_became_peered":"2024-09-11T22:19:04.596123+0000","last_unstale":"2024-09-11T22:19:05.590490+0000","last_undegraded":"2024-09-11T22:19:05.590490+0000","last_fullsized":"2024-09-11T22:19:05.590490+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:08.939139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589416+0000","last_change":"2024-09-11T22:19:04.604445+0000","last_active":"2024-09-11T22:19:05.589416+0000","last_peered":"2024-09-11T22:19:05.589416+0000","last_clean":"2024-09-11T22:19:05.589416+0000","last_became_active":"2024-09-11T22:19:04.604150+0000","last_became_peered":"2024-09-11T22:19:04.604150+0000","last_unstale":"2024-09-11T22:19:05.589416+0000","last_undegraded":"2024-09-11T22:19:05.589416+0000","last_fullsized":"2024-09-11T22:19:05.589416+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:26.436036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220579+0000","last_change":"2024-09-11T22:19:04.602875+0000","last_active":"2024-09-11T22:19:06.220579+0000","last_peered":"2024-09-11T22:19:06.220579+0000","last_clean":"2024-09-11T22:19:06.220579+0000","last_became_active":"2024-09-11T22:19:04.602609+0000","last_became_peered":"2024-09-11T22:19:04.602609+0000","last_unstale":"2024-09-11T22:19:06.220579+0000","last_undegraded":"2024-09-11T22:19:06.220579+0000","last_fullsized":"2024-09-11T22:19:06.220579+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:07.363216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221573+0000","last_change":"2024-09-11T22:19:04.607058+0000","last_active":"2024-09-11T22:19:06.221573+0000","last_peered":"2024-09-11T22:19:06.221573+0000","last_clean":"2024-09-11T22:19:06.221573+0000","last_became_active":"2024-09-11T22:19:04.606785+0000","last_became_peered":"2024-09-11T22:19:04.606785+0000","last_unstale":"2024-09-11T22:19:06.221573+0000","last_undegraded":"2024-09-11T22:19:06.221573+0000","last_fullsized":"2024-09-11T22:19:06.221573+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:07.504531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.222021+0000","last_change":"2024-09-11T22:19:04.594296+0000","last_active":"2024-09-11T22:19:06.222021+0000","last_peered":"2024-09-11T22:19:06.222021+0000","last_clean":"2024-09-11T22:19:06.222021+0000","last_became_active":"2024-09-11T22:19:04.594002+0000","last_became_peered":"2024-09-11T22:19:04.594002+0000","last_unstale":"2024-09-11T22:19:06.222021+0000","last_undegraded":"2024-09-11T22:19:06.222021+0000","last_fullsized":"2024-09-11T22:19:06.222021+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:29.073485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585912+0000","last_change":"2024-09-11T22:19:04.598000+0000","last_active":"2024-09-11T22:19:05.585912+0000","last_peered":"2024-09-11T22:19:05.585912+0000","last_clean":"2024-09-11T22:19:05.585912+0000","last_became_active":"2024-09-11T22:19:04.597209+0000","last_became_peered":"2024-09-11T22:19:04.597209+0000","last_unstale":"2024-09-11T22:19:05.585912+0000","last_undegraded":"2024-09-11T22:19:05.585912+0000","last_fullsized":"2024-09-11T22:19:05.585912+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:51.166441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221218+0000","last_change":"2024-09-11T22:19:04.601702+0000","last_active":"2024-09-11T22:19:06.221218+0000","last_peered":"2024-09-11T22:19:06.221218+0000","last_clean":"2024-09-11T22:19:06.221218+0000","last_became_active":"2024-09-11T22:19:04.601406+0000","last_became_peered":"2024-09-11T22:19:04.601406+0000","last_unstale":"2024-09-11T22:19:06.221218+0000","last_undegraded":"2024-09-11T22:19:06.221218+0000","last_fullsized":"2024-09-11T22:19:06.221218+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:38.450875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221695+0000","last_change":"2024-09-11T22:19:04.602810+0000","last_active":"2024-09-11T22:19:06.221695+0000","last_peered":"2024-09-11T22:19:06.221695+0000","last_clean":"2024-09-11T22:19:06.221695+0000","last_became_active":"2024-09-11T22:19:04.602529+0000","last_became_peered":"2024-09-11T22:19:04.602529+0000","last_unstale":"2024-09-11T22:19:06.221695+0000","last_undegraded":"2024-09-11T22:19:06.221695+0000","last_fullsized":"2024-09-11T22:19:06.221695+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:29.956339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220440+0000","last_change":"2024-09-11T22:19:04.595649+0000","last_active":"2024-09-11T22:19:06.220440+0000","last_peered":"2024-09-11T22:19:06.220440+0000","last_clean":"2024-09-11T22:19:06.220440+0000","last_became_active":"2024-09-11T22:19:04.595377+0000","last_became_peered":"2024-09-11T22:19:04.595377+0000","last_unstale":"2024-09-11T22:19:06.220440+0000","last_undegraded":"2024-09-11T22:19:06.220440+0000","last_fullsized":"2024-09-11T22:19:06.220440+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:50.847710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220653+0000","last_change":"2024-09-11T22:19:04.607415+0000","last_active":"2024-09-11T22:19:06.220653+0000","last_peered":"2024-09-11T22:19:06.220653+0000","last_clean":"2024-09-11T22:19:06.220653+0000","last_became_active":"2024-09-11T22:19:04.606931+0000","last_became_peered":"2024-09-11T22:19:04.606931+0000","last_unstale":"2024-09-11T22:19:06.220653+0000","last_undegraded":"2024-09-11T22:19:06.220653+0000","last_fullsized":"2024-09-11T22:19:06.220653+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:19.955155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220646+0000","last_change":"2024-09-11T22:19:04.594698+0000","last_active":"2024-09-11T22:19:06.220646+0000","last_peered":"2024-09-11T22:19:06.220646+0000","last_clean":"2024-09-11T22:19:06.220646+0000","last_became_active":"2024-09-11T22:19:04.594364+0000","last_became_peered":"2024-09-11T22:19:04.594364+0000","last_unstale":"2024-09-11T22:19:06.220646+0000","last_undegraded":"2024-09-11T22:19:06.220646+0000","last_fullsized":"2024-09-11T22:19:06.220646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:26.445183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590603+0000","last_change":"2024-09-11T22:19:04.601077+0000","last_active":"2024-09-11T22:19:05.590603+0000","last_peered":"2024-09-11T22:19:05.590603+0000","last_clean":"2024-09-11T22:19:05.590603+0000","last_became_active":"2024-09-11T22:19:04.600814+0000","last_became_peered":"2024-09-11T22:19:04.600814+0000","last_unstale":"2024-09-11T22:19:05.590603+0000","last_undegraded":"2024-09-11T22:19:05.590603+0000","last_fullsized":"2024-09-11T22:19:05.590603+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:46:03.990883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221738+0000","last_change":"2024-09-11T22:19:04.595951+0000","last_active":"2024-09-11T22:19:06.221738+0000","last_peered":"2024-09-11T22:19:06.221738+0000","last_clean":"2024-09-11T22:19:06.221738+0000","last_became_active":"2024-09-11T22:19:04.595538+0000","last_became_peered":"2024-09-11T22:19:04.595538+0000","last_unstale":"2024-09-11T22:19:06.221738+0000","last_undegraded":"2024-09-11T22:19:06.221738+0000","last_fullsized":"2024-09-11T22:19:06.221738+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:38.617549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585959+0000","last_change":"2024-09-11T22:19:04.594286+0000","last_active":"2024-09-11T22:19:05.585959+0000","last_peered":"2024-09-11T22:19:05.585959+0000","last_clean":"2024-09-11T22:19:05.585959+0000","last_became_active":"2024-09-11T22:19:04.593993+0000","last_became_peered":"2024-09-11T22:19:04.593993+0000","last_unstale":"2024-09-11T22:19:05.585959+0000","last_undegraded":"2024-09-11T22:19:05.585959+0000","last_fullsized":"2024-09-11T22:19:05.585959+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:57.710743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221352+0000","last_change":"2024-09-11T22:19:04.595911+0000","last_active":"2024-09-11T22:19:06.221352+0000","last_peered":"2024-09-11T22:19:06.221352+0000","last_clean":"2024-09-11T22:19:06.221352+0000","last_became_active":"2024-09-11T22:19:04.595229+0000","last_became_peered":"2024-09-11T22:19:04.595229+0000","last_unstale":"2024-09-11T22:19:06.221352+0000","last_undegraded":"2024-09-11T22:19:06.221352+0000","last_fullsized":"2024-09-11T22:19:06.221352+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:19.581227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221080+0000","last_change":"2024-09-11T22:19:04.601152+0000","last_active":"2024-09-11T22:19:06.221080+0000","last_peered":"2024-09-11T22:19:06.221080+0000","last_clean":"2024-09-11T22:19:06.221080+0000","last_became_active":"2024-09-11T22:19:04.600735+0000","last_became_peered":"2024-09-11T22:19:04.600735+0000","last_unstale":"2024-09-11T22:19:06.221080+0000","last_undegraded":"2024-09-11T22:19:06.221080+0000","last_fullsized":"2024-09-11T22:19:06.221080+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:17.626424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585822+0000","last_change":"2024-09-11T22:19:04.596752+0000","last_active":"2024-09-11T22:19:05.585822+0000","last_peered":"2024-09-11T22:19:05.585822+0000","last_clean":"2024-09-11T22:19:05.585822+0000","last_became_active":"2024-09-11T22:19:04.596451+0000","last_became_peered":"2024-09-11T22:19:04.596451+0000","last_unstale":"2024-09-11T22:19:05.585822+0000","last_undegraded":"2024-09-11T22:19:05.585822+0000","last_fullsized":"2024-09-11T22:19:05.585822+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:17.699842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221247+0000","last_change":"2024-09-11T22:19:04.599336+0000","last_active":"2024-09-11T22:19:06.221247+0000","last_peered":"2024-09-11T22:19:06.221247+0000","last_clean":"2024-09-11T22:19:06.221247+0000","last_became_active":"2024-09-11T22:19:04.599038+0000","last_became_peered":"2024-09-11T22:19:04.599038+0000","last_unstale":"2024-09-11T22:19:06.221247+0000","last_undegraded":"2024-09-11T22:19:06.221247+0000","last_fullsized":"2024-09-11T22:19:06.221247+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:11.799179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585688+0000","last_change":"2024-09-11T22:19:04.596498+0000","last_active":"2024-09-11T22:19:05.585688+0000","last_peered":"2024-09-11T22:19:05.585688+0000","last_clean":"2024-09-11T22:19:05.585688+0000","last_became_active":"2024-09-11T22:19:04.596215+0000","last_became_peered":"2024-09-11T22:19:04.596215+0000","last_unstale":"2024-09-11T22:19:05.585688+0000","last_undegraded":"2024-09-11T22:19:05.585688+0000","last_fullsized":"2024-09-11T22:19:05.585688+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:35.628231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221783+0000","last_change":"2024-09-11T22:19:04.597919+0000","last_active":"2024-09-11T22:19:06.221783+0000","last_peered":"2024-09-11T22:19:06.221783+0000","last_clean":"2024-09-11T22:19:06.221783+0000","last_became_active":"2024-09-11T22:19:04.597600+0000","last_became_peered":"2024-09-11T22:19:04.597600+0000","last_unstale":"2024-09-11T22:19:06.221783+0000","last_undegraded":"2024-09-11T22:19:06.221783+0000","last_fullsized":"2024-09-11T22:19:06.221783+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:38.450875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221912+0000","last_change":"2024-09-11T22:19:04.596094+0000","last_active":"2024-09-11T22:19:06.221912+0000","last_peered":"2024-09-11T22:19:06.221912+0000","last_clean":"2024-09-11T22:19:06.221912+0000","last_became_active":"2024-09-11T22:19:04.595654+0000","last_became_peered":"2024-09-11T22:19:04.595654+0000","last_unstale":"2024-09-11T22:19:06.221912+0000","last_undegraded":"2024-09-11T22:19:06.221912+0000","last_fullsized":"2024-09-11T22:19:06.221912+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:50.805838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221170+0000","last_change":"2024-09-11T22:19:04.602111+0000","last_active":"2024-09-11T22:19:06.221170+0000","last_peered":"2024-09-11T22:19:06.221170+0000","last_clean":"2024-09-11T22:19:06.221170+0000","last_became_active":"2024-09-11T22:19:04.601787+0000","last_became_peered":"2024-09-11T22:19:04.601787+0000","last_unstale":"2024-09-11T22:19:06.221170+0000","last_undegraded":"2024-09-11T22:19:06.221170+0000","last_fullsized":"2024-09-11T22:19:06.221170+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:52.810353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589641+0000","last_change":"2024-09-11T22:19:04.605030+0000","last_active":"2024-09-11T22:19:05.589641+0000","last_peered":"2024-09-11T22:19:05.589641+0000","last_clean":"2024-09-11T22:19:05.589641+0000","last_became_active":"2024-09-11T22:19:04.604526+0000","last_became_peered":"2024-09-11T22:19:04.604526+0000","last_unstale":"2024-09-11T22:19:05.589641+0000","last_undegraded":"2024-09-11T22:19:05.589641+0000","last_fullsized":"2024-09-11T22:19:05.589641+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:29.419254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221867+0000","last_change":"2024-09-11T22:19:04.602158+0000","last_active":"2024-09-11T22:19:06.221867+0000","last_peered":"2024-09-11T22:19:06.221867+0000","last_clean":"2024-09-11T22:19:06.221867+0000","last_became_active":"2024-09-11T22:19:04.601160+0000","last_became_peered":"2024-09-11T22:19:04.601160+0000","last_unstale":"2024-09-11T22:19:06.221867+0000","last_undegraded":"2024-09-11T22:19:06.221867+0000","last_fullsized":"2024-09-11T22:19:06.221867+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:57.657597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221384+0000","last_change":"2024-09-11T22:19:04.607266+0000","last_active":"2024-09-11T22:19:06.221384+0000","last_peered":"2024-09-11T22:19:06.221384+0000","last_clean":"2024-09-11T22:19:06.221384+0000","last_became_active":"2024-09-11T22:19:04.606798+0000","last_became_peered":"2024-09-11T22:19:04.606798+0000","last_unstale":"2024-09-11T22:19:06.221384+0000","last_undegraded":"2024-09-11T22:19:06.221384+0000","last_fullsized":"2024-09-11T22:19:06.221384+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:54.948029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220650+0000","last_change":"2024-09-11T22:19:04.607858+0000","last_active":"2024-09-11T22:19:06.220650+0000","last_peered":"2024-09-11T22:19:06.220650+0000","last_clean":"2024-09-11T22:19:06.220650+0000","last_became_active":"2024-09-11T22:19:04.607583+0000","last_became_peered":"2024-09-11T22:19:04.607583+0000","last_unstale":"2024-09-11T22:19:06.220650+0000","last_undegraded":"2024-09-11T22:19:06.220650+0000","last_fullsized":"2024-09-11T22:19:06.220650+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:38.749909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589416+0000","last_change":"2024-09-11T22:19:04.603587+0000","last_active":"2024-09-11T22:19:05.589416+0000","last_peered":"2024-09-11T22:19:05.589416+0000","last_clean":"2024-09-11T22:19:05.589416+0000","last_became_active":"2024-09-11T22:19:04.603220+0000","last_became_peered":"2024-09-11T22:19:04.603220+0000","last_unstale":"2024-09-11T22:19:05.589416+0000","last_undegraded":"2024-09-11T22:19:05.589416+0000","last_fullsized":"2024-09-11T22:19:05.589416+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:07.504531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.222033+0000","last_change":"2024-09-11T22:19:04.595836+0000","last_active":"2024-09-11T22:19:06.222033+0000","last_peered":"2024-09-11T22:19:06.222033+0000","last_clean":"2024-09-11T22:19:06.222033+0000","last_became_active":"2024-09-11T22:19:04.595241+0000","last_became_peered":"2024-09-11T22:19:04.595241+0000","last_unstale":"2024-09-11T22:19:06.222033+0000","last_undegraded":"2024-09-11T22:19:06.222033+0000","last_fullsized":"2024-09-11T22:19:06.222033+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:35.628231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"131'4","reported_seq":18,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221244+0000","last_change":"2024-09-11T22:19:03.657633+0000","last_active":"2024-09-11T22:19:06.221244+0000","last_peered":"2024-09-11T22:19:06.221244+0000","last_clean":"2024-09-11T22:19:06.221244+0000","last_became_active":"2024-09-11T22:19:03.657372+0000","last_became_peered":"2024-09-11T22:19:03.657372+0000","last_unstale":"2024-09-11T22:19:06.221244+0000","last_undegraded":"2024-09-11T22:19:06.221244+0000","last_fullsized":"2024-09-11T22:19:06.221244+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:37.662172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221688+0000","last_change":"2024-09-11T22:19:04.599738+0000","last_active":"2024-09-11T22:19:06.221688+0000","last_peered":"2024-09-11T22:19:06.221688+0000","last_clean":"2024-09-11T22:19:06.221688+0000","last_became_active":"2024-09-11T22:19:04.599317+0000","last_became_peered":"2024-09-11T22:19:04.599317+0000","last_unstale":"2024-09-11T22:19:06.221688+0000","last_undegraded":"2024-09-11T22:19:06.221688+0000","last_fullsized":"2024-09-11T22:19:06.221688+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:26.436036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590027+0000","last_change":"2024-09-11T22:19:03.652664+0000","last_active":"2024-09-11T22:19:05.590027+0000","last_peered":"2024-09-11T22:19:05.590027+0000","last_clean":"2024-09-11T22:19:05.590027+0000","last_became_active":"2024-09-11T22:19:03.652377+0000","last_became_peered":"2024-09-11T22:19:03.652377+0000","last_unstale":"2024-09-11T22:19:05.590027+0000","last_undegraded":"2024-09-11T22:19:05.590027+0000","last_fullsized":"2024-09-11T22:19:05.590027+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:19.401951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221101+0000","last_change":"2024-09-11T22:19:04.607846+0000","last_active":"2024-09-11T22:19:06.221101+0000","last_peered":"2024-09-11T22:19:06.221101+0000","last_clean":"2024-09-11T22:19:06.221101+0000","last_became_active":"2024-09-11T22:19:04.607539+0000","last_became_peered":"2024-09-11T22:19:04.607539+0000","last_unstale":"2024-09-11T22:19:06.221101+0000","last_undegraded":"2024-09-11T22:19:06.221101+0000","last_fullsized":"2024-09-11T22:19:06.221101+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:39.137292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.586016+0000","last_change":"2024-09-11T22:19:03.646165+0000","last_active":"2024-09-11T22:19:05.586016+0000","last_peered":"2024-09-11T22:19:05.586016+0000","last_clean":"2024-09-11T22:19:05.586016+0000","last_became_active":"2024-09-11T22:19:03.644773+0000","last_became_peered":"2024-09-11T22:19:03.644773+0000","last_unstale":"2024-09-11T22:19:05.586016+0000","last_undegraded":"2024-09-11T22:19:05.586016+0000","last_fullsized":"2024-09-11T22:19:05.586016+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:37.762092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221299+0000","last_change":"2024-09-11T22:19:04.608209+0000","last_active":"2024-09-11T22:19:06.221299+0000","last_peered":"2024-09-11T22:19:06.221299+0000","last_clean":"2024-09-11T22:19:06.221299+0000","last_became_active":"2024-09-11T22:19:04.607723+0000","last_became_peered":"2024-09-11T22:19:04.607723+0000","last_unstale":"2024-09-11T22:19:06.221299+0000","last_undegraded":"2024-09-11T22:19:06.221299+0000","last_fullsized":"2024-09-11T22:19:06.221299+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:29.361777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220848+0000","last_change":"2024-09-11T22:19:03.649748+0000","last_active":"2024-09-11T22:19:06.220848+0000","last_peered":"2024-09-11T22:19:06.220848+0000","last_clean":"2024-09-11T22:19:06.220848+0000","last_became_active":"2024-09-11T22:19:03.649467+0000","last_became_peered":"2024-09-11T22:19:03.649467+0000","last_unstale":"2024-09-11T22:19:06.220848+0000","last_undegraded":"2024-09-11T22:19:06.220848+0000","last_fullsized":"2024-09-11T22:19:06.220848+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:43.376628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220817+0000","last_change":"2024-09-11T22:19:04.590837+0000","last_active":"2024-09-11T22:19:06.220817+0000","last_peered":"2024-09-11T22:19:06.220817+0000","last_clean":"2024-09-11T22:19:06.220817+0000","last_became_active":"2024-09-11T22:19:04.590545+0000","last_became_peered":"2024-09-11T22:19:04.590545+0000","last_unstale":"2024-09-11T22:19:06.220817+0000","last_undegraded":"2024-09-11T22:19:06.220817+0000","last_fullsized":"2024-09-11T22:19:06.220817+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:15.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220281+0000","last_change":"2024-09-11T22:19:03.649522+0000","last_active":"2024-09-11T22:19:06.220281+0000","last_peered":"2024-09-11T22:19:06.220281+0000","last_clean":"2024-09-11T22:19:06.220281+0000","last_became_active":"2024-09-11T22:19:03.649244+0000","last_became_peered":"2024-09-11T22:19:03.649244+0000","last_unstale":"2024-09-11T22:19:06.220281+0000","last_undegraded":"2024-09-11T22:19:06.220281+0000","last_fullsized":"2024-09-11T22:19:06.220281+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:18.904813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590572+0000","last_change":"2024-09-11T22:19:04.602059+0000","last_active":"2024-09-11T22:19:05.590572+0000","last_peered":"2024-09-11T22:19:05.590572+0000","last_clean":"2024-09-11T22:19:05.590572+0000","last_became_active":"2024-09-11T22:19:04.601601+0000","last_became_peered":"2024-09-11T22:19:04.601601+0000","last_unstale":"2024-09-11T22:19:05.590572+0000","last_undegraded":"2024-09-11T22:19:05.590572+0000","last_fullsized":"2024-09-11T22:19:05.590572+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:42.712613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220925+0000","last_change":"2024-09-11T22:19:03.651101+0000","last_active":"2024-09-11T22:19:06.220925+0000","last_peered":"2024-09-11T22:19:06.220925+0000","last_clean":"2024-09-11T22:19:06.220925+0000","last_became_active":"2024-09-11T22:19:03.650795+0000","last_became_peered":"2024-09-11T22:19:03.650795+0000","last_unstale":"2024-09-11T22:19:06.220925+0000","last_undegraded":"2024-09-11T22:19:06.220925+0000","last_fullsized":"2024-09-11T22:19:06.220925+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:05.644348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220706+0000","last_change":"2024-09-11T22:19:04.602369+0000","last_active":"2024-09-11T22:19:06.220706+0000","last_peered":"2024-09-11T22:19:06.220706+0000","last_clean":"2024-09-11T22:19:06.220706+0000","last_became_active":"2024-09-11T22:19:04.602101+0000","last_became_peered":"2024-09-11T22:19:04.602101+0000","last_unstale":"2024-09-11T22:19:06.220706+0000","last_undegraded":"2024-09-11T22:19:06.220706+0000","last_fullsized":"2024-09-11T22:19:06.220706+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:55.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589687+0000","last_change":"2024-09-11T22:19:03.659081+0000","last_active":"2024-09-11T22:19:05.589687+0000","last_peered":"2024-09-11T22:19:05.589687+0000","last_clean":"2024-09-11T22:19:05.589687+0000","last_became_active":"2024-09-11T22:19:03.658782+0000","last_became_peered":"2024-09-11T22:19:03.658782+0000","last_unstale":"2024-09-11T22:19:05.589687+0000","last_undegraded":"2024-09-11T22:19:05.589687+0000","last_fullsized":"2024-09-11T22:19:05.589687+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:18.473813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221042+0000","last_change":"2024-09-11T22:19:04.602726+0000","last_active":"2024-09-11T22:19:06.221042+0000","last_peered":"2024-09-11T22:19:06.221042+0000","last_clean":"2024-09-11T22:19:06.221042+0000","last_became_active":"2024-09-11T22:19:04.602439+0000","last_became_peered":"2024-09-11T22:19:04.602439+0000","last_unstale":"2024-09-11T22:19:06.221042+0000","last_undegraded":"2024-09-11T22:19:06.221042+0000","last_fullsized":"2024-09-11T22:19:06.221042+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:07.363216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220859+0000","last_change":"2024-09-11T22:19:03.656863+0000","last_active":"2024-09-11T22:19:06.220859+0000","last_peered":"2024-09-11T22:19:06.220859+0000","last_clean":"2024-09-11T22:19:06.220859+0000","last_became_active":"2024-09-11T22:19:03.656244+0000","last_became_peered":"2024-09-11T22:19:03.656244+0000","last_unstale":"2024-09-11T22:19:06.220859+0000","last_undegraded":"2024-09-11T22:19:06.220859+0000","last_fullsized":"2024-09-11T22:19:06.220859+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:19.401951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221522+0000","last_change":"2024-09-11T22:19:04.599432+0000","last_active":"2024-09-11T22:19:06.221522+0000","last_peered":"2024-09-11T22:19:06.221522+0000","last_clean":"2024-09-11T22:19:06.221522+0000","last_became_active":"2024-09-11T22:19:04.599151+0000","last_became_peered":"2024-09-11T22:19:04.599151+0000","last_unstale":"2024-09-11T22:19:06.221522+0000","last_undegraded":"2024-09-11T22:19:06.221522+0000","last_fullsized":"2024-09-11T22:19:06.221522+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:06.264509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590038+0000","last_change":"2024-09-11T22:19:03.652549+0000","last_active":"2024-09-11T22:19:05.590038+0000","last_peered":"2024-09-11T22:19:05.590038+0000","last_clean":"2024-09-11T22:19:05.590038+0000","last_became_active":"2024-09-11T22:19:03.652228+0000","last_became_peered":"2024-09-11T22:19:03.652228+0000","last_unstale":"2024-09-11T22:19:05.590038+0000","last_undegraded":"2024-09-11T22:19:05.590038+0000","last_fullsized":"2024-09-11T22:19:05.590038+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:24:38.593905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589821+0000","last_change":"2024-09-11T22:19:04.602330+0000","last_active":"2024-09-11T22:19:05.589821+0000","last_peered":"2024-09-11T22:19:05.589821+0000","last_clean":"2024-09-11T22:19:05.589821+0000","last_became_active":"2024-09-11T22:19:04.602043+0000","last_became_peered":"2024-09-11T22:19:04.602043+0000","last_unstale":"2024-09-11T22:19:05.589821+0000","last_undegraded":"2024-09-11T22:19:05.589821+0000","last_fullsized":"2024-09-11T22:19:05.589821+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:45.286941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.222015+0000","last_change":"2024-09-11T22:19:03.657825+0000","last_active":"2024-09-11T22:19:06.222015+0000","last_peered":"2024-09-11T22:19:06.222015+0000","last_clean":"2024-09-11T22:19:06.222015+0000","last_became_active":"2024-09-11T22:19:03.657543+0000","last_became_peered":"2024-09-11T22:19:03.657543+0000","last_unstale":"2024-09-11T22:19:06.222015+0000","last_undegraded":"2024-09-11T22:19:06.222015+0000","last_fullsized":"2024-09-11T22:19:06.222015+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:43.363066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221245+0000","last_change":"2024-09-11T22:19:04.605484+0000","last_active":"2024-09-11T22:19:06.221245+0000","last_peered":"2024-09-11T22:19:06.221245+0000","last_clean":"2024-09-11T22:19:06.221245+0000","last_became_active":"2024-09-11T22:19:04.605208+0000","last_became_peered":"2024-09-11T22:19:04.605208+0000","last_unstale":"2024-09-11T22:19:06.221245+0000","last_undegraded":"2024-09-11T22:19:06.221245+0000","last_fullsized":"2024-09-11T22:19:06.221245+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:20.257908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"131'3","reported_seq":17,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589472+0000","last_change":"2024-09-11T22:19:03.656806+0000","last_active":"2024-09-11T22:19:05.589472+0000","last_peered":"2024-09-11T22:19:05.589472+0000","last_clean":"2024-09-11T22:19:05.589472+0000","last_became_active":"2024-09-11T22:19:03.656469+0000","last_became_peered":"2024-09-11T22:19:03.656469+0000","last_unstale":"2024-09-11T22:19:05.589472+0000","last_undegraded":"2024-09-11T22:19:05.589472+0000","last_fullsized":"2024-09-11T22:19:05.589472+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:43.376628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221354+0000","last_change":"2024-09-11T22:19:04.605154+0000","last_active":"2024-09-11T22:19:06.221354+0000","last_peered":"2024-09-11T22:19:06.221354+0000","last_clean":"2024-09-11T22:19:06.221354+0000","last_became_active":"2024-09-11T22:19:04.604838+0000","last_became_peered":"2024-09-11T22:19:04.604838+0000","last_unstale":"2024-09-11T22:19:06.221354+0000","last_undegraded":"2024-09-11T22:19:06.221354+0000","last_fullsized":"2024-09-11T22:19:06.221354+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:14.391949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"131'6","reported_seq":20,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221300+0000","last_change":"2024-09-11T22:19:03.658102+0000","last_active":"2024-09-11T22:19:06.221300+0000","last_peered":"2024-09-11T22:19:06.221300+0000","last_clean":"2024-09-11T22:19:06.221300+0000","last_became_active":"2024-09-11T22:19:03.657816+0000","last_became_peered":"2024-09-11T22:19:03.657816+0000","last_unstale":"2024-09-11T22:19:06.221300+0000","last_undegraded":"2024-09-11T22:19:06.221300+0000","last_fullsized":"2024-09-11T22:19:06.221300+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:29.373948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221877+0000","last_change":"2024-09-11T22:19:04.598642+0000","last_active":"2024-09-11T22:19:06.221877+0000","last_peered":"2024-09-11T22:19:06.221877+0000","last_clean":"2024-09-11T22:19:06.221877+0000","last_became_active":"2024-09-11T22:19:04.598329+0000","last_became_peered":"2024-09-11T22:19:04.598329+0000","last_unstale":"2024-09-11T22:19:06.221877+0000","last_undegraded":"2024-09-11T22:19:06.221877+0000","last_fullsized":"2024-09-11T22:19:06.221877+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:27.785617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221244+0000","last_change":"2024-09-11T22:19:03.652627+0000","last_active":"2024-09-11T22:19:06.221244+0000","last_peered":"2024-09-11T22:19:06.221244+0000","last_clean":"2024-09-11T22:19:06.221244+0000","last_became_active":"2024-09-11T22:19:03.652320+0000","last_became_peered":"2024-09-11T22:19:03.652320+0000","last_unstale":"2024-09-11T22:19:06.221244+0000","last_undegraded":"2024-09-11T22:19:06.221244+0000","last_fullsized":"2024-09-11T22:19:06.221244+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:23.173009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220210+0000","last_change":"2024-09-11T22:19:04.601649+0000","last_active":"2024-09-11T22:19:06.220210+0000","last_peered":"2024-09-11T22:19:06.220210+0000","last_clean":"2024-09-11T22:19:06.220210+0000","last_became_active":"2024-09-11T22:19:04.601363+0000","last_became_peered":"2024-09-11T22:19:04.601363+0000","last_unstale":"2024-09-11T22:19:06.220210+0000","last_undegraded":"2024-09-11T22:19:06.220210+0000","last_fullsized":"2024-09-11T22:19:06.220210+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:56:19.475857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221274+0000","last_change":"2024-09-11T22:19:03.657984+0000","last_active":"2024-09-11T22:19:06.221274+0000","last_peered":"2024-09-11T22:19:06.221274+0000","last_clean":"2024-09-11T22:19:06.221274+0000","last_became_active":"2024-09-11T22:19:03.657671+0000","last_became_peered":"2024-09-11T22:19:03.657671+0000","last_unstale":"2024-09-11T22:19:06.221274+0000","last_undegraded":"2024-09-11T22:19:06.221274+0000","last_fullsized":"2024-09-11T22:19:06.221274+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:41.664387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221409+0000","last_change":"2024-09-11T22:19:04.603019+0000","last_active":"2024-09-11T22:19:06.221409+0000","last_peered":"2024-09-11T22:19:06.221409+0000","last_clean":"2024-09-11T22:19:06.221409+0000","last_became_active":"2024-09-11T22:19:04.601460+0000","last_became_peered":"2024-09-11T22:19:04.601460+0000","last_unstale":"2024-09-11T22:19:06.221409+0000","last_undegraded":"2024-09-11T22:19:06.221409+0000","last_fullsized":"2024-09-11T22:19:06.221409+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:29.073485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"131'8","reported_seq":22,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220769+0000","last_change":"2024-09-11T22:19:03.658740+0000","last_active":"2024-09-11T22:19:06.220769+0000","last_peered":"2024-09-11T22:19:06.220769+0000","last_clean":"2024-09-11T22:19:06.220769+0000","last_became_active":"2024-09-11T22:19:03.658380+0000","last_became_peered":"2024-09-11T22:19:03.658380+0000","last_unstale":"2024-09-11T22:19:06.220769+0000","last_undegraded":"2024-09-11T22:19:06.220769+0000","last_fullsized":"2024-09-11T22:19:06.220769+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:43:10.447662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221530+0000","last_change":"2024-09-11T22:19:04.602064+0000","last_active":"2024-09-11T22:19:06.221530+0000","last_peered":"2024-09-11T22:19:06.221530+0000","last_clean":"2024-09-11T22:19:06.221530+0000","last_became_active":"2024-09-11T22:19:04.601781+0000","last_became_peered":"2024-09-11T22:19:04.601781+0000","last_unstale":"2024-09-11T22:19:06.221530+0000","last_undegraded":"2024-09-11T22:19:06.221530+0000","last_fullsized":"2024-09-11T22:19:06.221530+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:44.447391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590143+0000","last_change":"2024-09-11T22:19:03.658363+0000","last_active":"2024-09-11T22:19:05.590143+0000","last_peered":"2024-09-11T22:19:05.590143+0000","last_clean":"2024-09-11T22:19:05.590143+0000","last_became_active":"2024-09-11T22:19:03.658100+0000","last_became_peered":"2024-09-11T22:19:03.658100+0000","last_unstale":"2024-09-11T22:19:05.590143+0000","last_undegraded":"2024-09-11T22:19:05.590143+0000","last_fullsized":"2024-09-11T22:19:05.590143+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:58.049878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589968+0000","last_change":"2024-09-11T22:19:04.598194+0000","last_active":"2024-09-11T22:19:05.589968+0000","last_peered":"2024-09-11T22:19:05.589968+0000","last_clean":"2024-09-11T22:19:05.589968+0000","last_became_active":"2024-09-11T22:19:04.597881+0000","last_became_peered":"2024-09-11T22:19:04.597881+0000","last_unstale":"2024-09-11T22:19:05.589968+0000","last_undegraded":"2024-09-11T22:19:05.589968+0000","last_fullsized":"2024-09-11T22:19:05.589968+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:18.972748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.586041+0000","last_change":"2024-09-11T22:19:03.655955+0000","last_active":"2024-09-11T22:19:05.586041+0000","last_peered":"2024-09-11T22:19:05.586041+0000","last_clean":"2024-09-11T22:19:05.586041+0000","last_became_active":"2024-09-11T22:19:03.655394+0000","last_became_peered":"2024-09-11T22:19:03.655394+0000","last_unstale":"2024-09-11T22:19:05.586041+0000","last_undegraded":"2024-09-11T22:19:05.586041+0000","last_fullsized":"2024-09-11T22:19:05.586041+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:14.809749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221372+0000","last_change":"2024-09-11T22:19:04.594995+0000","last_active":"2024-09-11T22:19:06.221372+0000","last_peered":"2024-09-11T22:19:06.221372+0000","last_clean":"2024-09-11T22:19:06.221372+0000","last_became_active":"2024-09-11T22:19:04.594455+0000","last_became_peered":"2024-09-11T22:19:04.594455+0000","last_unstale":"2024-09-11T22:19:06.221372+0000","last_undegraded":"2024-09-11T22:19:06.221372+0000","last_fullsized":"2024-09-11T22:19:06.221372+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:30.319413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"131'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590332+0000","last_change":"2024-09-11T22:19:03.659192+0000","last_active":"2024-09-11T22:19:05.590332+0000","last_peered":"2024-09-11T22:19:05.590332+0000","last_clean":"2024-09-11T22:19:05.590332+0000","last_became_active":"2024-09-11T22:19:03.658919+0000","last_became_peered":"2024-09-11T22:19:03.658919+0000","last_unstale":"2024-09-11T22:19:05.590332+0000","last_undegraded":"2024-09-11T22:19:05.590332+0000","last_fullsized":"2024-09-11T22:19:05.590332+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:55.451217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221535+0000","last_change":"2024-09-11T22:19:04.602280+0000","last_active":"2024-09-11T22:19:06.221535+0000","last_peered":"2024-09-11T22:19:06.221535+0000","last_clean":"2024-09-11T22:19:06.221535+0000","last_became_active":"2024-09-11T22:19:04.601993+0000","last_became_peered":"2024-09-11T22:19:04.601993+0000","last_unstale":"2024-09-11T22:19:06.221535+0000","last_undegraded":"2024-09-11T22:19:06.221535+0000","last_fullsized":"2024-09-11T22:19:06.221535+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:42.410226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589786+0000","last_change":"2024-09-11T22:19:03.652729+0000","last_active":"2024-09-11T22:19:05.589786+0000","last_peered":"2024-09-11T22:19:05.589786+0000","last_clean":"2024-09-11T22:19:05.589786+0000","last_became_active":"2024-09-11T22:19:03.652408+0000","last_became_peered":"2024-09-11T22:19:03.652408+0000","last_unstale":"2024-09-11T22:19:05.589786+0000","last_undegraded":"2024-09-11T22:19:05.589786+0000","last_fullsized":"2024-09-11T22:19:05.589786+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:31.764228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221136+0000","last_change":"2024-09-11T22:19:04.601130+0000","last_active":"2024-09-11T22:19:06.221136+0000","last_peered":"2024-09-11T22:19:06.221136+0000","last_clean":"2024-09-11T22:19:06.221136+0000","last_became_active":"2024-09-11T22:19:04.600847+0000","last_became_peered":"2024-09-11T22:19:04.600847+0000","last_unstale":"2024-09-11T22:19:06.221136+0000","last_undegraded":"2024-09-11T22:19:06.221136+0000","last_fullsized":"2024-09-11T22:19:06.221136+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:23.840570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589911+0000","last_change":"2024-09-11T22:19:03.651763+0000","last_active":"2024-09-11T22:19:05.589911+0000","last_peered":"2024-09-11T22:19:05.589911+0000","last_clean":"2024-09-11T22:19:05.589911+0000","last_became_active":"2024-09-11T22:19:03.651464+0000","last_became_peered":"2024-09-11T22:19:03.651464+0000","last_unstale":"2024-09-11T22:19:05.589911+0000","last_undegraded":"2024-09-11T22:19:05.589911+0000","last_fullsized":"2024-09-11T22:19:05.589911+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:41.664387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590839+0000","last_change":"2024-09-11T22:19:04.602659+0000","last_active":"2024-09-11T22:19:05.590839+0000","last_peered":"2024-09-11T22:19:05.590839+0000","last_clean":"2024-09-11T22:19:05.590839+0000","last_became_active":"2024-09-11T22:19:04.602396+0000","last_became_peered":"2024-09-11T22:19:04.602396+0000","last_unstale":"2024-09-11T22:19:05.590839+0000","last_undegraded":"2024-09-11T22:19:05.590839+0000","last_fullsized":"2024-09-11T22:19:05.590839+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:21.748724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221038+0000","last_change":"2024-09-11T22:19:03.656329+0000","last_active":"2024-09-11T22:19:06.221038+0000","last_peered":"2024-09-11T22:19:06.221038+0000","last_clean":"2024-09-11T22:19:06.221038+0000","last_became_active":"2024-09-11T22:19:03.656010+0000","last_became_peered":"2024-09-11T22:19:03.656010+0000","last_unstale":"2024-09-11T22:19:06.221038+0000","last_undegraded":"2024-09-11T22:19:06.221038+0000","last_fullsized":"2024-09-11T22:19:06.221038+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:28.902538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220751+0000","last_change":"2024-09-11T22:19:04.600403+0000","last_active":"2024-09-11T22:19:06.220751+0000","last_peered":"2024-09-11T22:19:06.220751+0000","last_clean":"2024-09-11T22:19:06.220751+0000","last_became_active":"2024-09-11T22:19:04.600067+0000","last_became_peered":"2024-09-11T22:19:04.600067+0000","last_unstale":"2024-09-11T22:19:06.220751+0000","last_undegraded":"2024-09-11T22:19:06.220751+0000","last_fullsized":"2024-09-11T22:19:06.220751+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:58.097055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221119+0000","last_change":"2024-09-11T22:19:03.652845+0000","last_active":"2024-09-11T22:19:06.221119+0000","last_peered":"2024-09-11T22:19:06.221119+0000","last_clean":"2024-09-11T22:19:06.221119+0000","last_became_active":"2024-09-11T22:19:03.651928+0000","last_became_peered":"2024-09-11T22:19:03.651928+0000","last_unstale":"2024-09-11T22:19:06.221119+0000","last_undegraded":"2024-09-11T22:19:06.221119+0000","last_fullsized":"2024-09-11T22:19:06.221119+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:28.020640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220474+0000","last_change":"2024-09-11T22:19:04.607489+0000","last_active":"2024-09-11T22:19:06.220474+0000","last_peered":"2024-09-11T22:19:06.220474+0000","last_clean":"2024-09-11T22:19:06.220474+0000","last_became_active":"2024-09-11T22:19:04.606950+0000","last_became_peered":"2024-09-11T22:19:04.606950+0000","last_unstale":"2024-09-11T22:19:06.220474+0000","last_undegraded":"2024-09-11T22:19:06.220474+0000","last_fullsized":"2024-09-11T22:19:06.220474+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:55.783154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585618+0000","last_change":"2024-09-11T22:19:03.655592+0000","last_active":"2024-09-11T22:19:05.585618+0000","last_peered":"2024-09-11T22:19:05.585618+0000","last_clean":"2024-09-11T22:19:05.585618+0000","last_became_active":"2024-09-11T22:19:03.655319+0000","last_became_peered":"2024-09-11T22:19:03.655319+0000","last_unstale":"2024-09-11T22:19:05.585618+0000","last_undegraded":"2024-09-11T22:19:05.585618+0000","last_fullsized":"2024-09-11T22:19:05.585618+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:17.274260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590774+0000","last_change":"2024-09-11T22:19:04.592226+0000","last_active":"2024-09-11T22:19:05.590774+0000","last_peered":"2024-09-11T22:19:05.590774+0000","last_clean":"2024-09-11T22:19:05.590774+0000","last_became_active":"2024-09-11T22:19:04.591831+0000","last_became_peered":"2024-09-11T22:19:04.591831+0000","last_unstale":"2024-09-11T22:19:05.590774+0000","last_undegraded":"2024-09-11T22:19:05.590774+0000","last_fullsized":"2024-09-11T22:19:05.590774+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:25.712813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221624+0000","last_change":"2024-09-11T22:19:03.653122+0000","last_active":"2024-09-11T22:19:06.221624+0000","last_peered":"2024-09-11T22:19:06.221624+0000","last_clean":"2024-09-11T22:19:06.221624+0000","last_became_active":"2024-09-11T22:19:03.652733+0000","last_became_peered":"2024-09-11T22:19:03.652733+0000","last_unstale":"2024-09-11T22:19:06.221624+0000","last_undegraded":"2024-09-11T22:19:06.221624+0000","last_fullsized":"2024-09-11T22:19:06.221624+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:46.127177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221677+0000","last_change":"2024-09-11T22:19:04.607324+0000","last_active":"2024-09-11T22:19:06.221677+0000","last_peered":"2024-09-11T22:19:06.221677+0000","last_clean":"2024-09-11T22:19:06.221677+0000","last_became_active":"2024-09-11T22:19:04.606948+0000","last_became_peered":"2024-09-11T22:19:04.606948+0000","last_unstale":"2024-09-11T22:19:06.221677+0000","last_undegraded":"2024-09-11T22:19:06.221677+0000","last_fullsized":"2024-09-11T22:19:06.221677+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:42.474866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"132'1","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.644363+0000","last_change":"2024-09-11T22:19:03.658179+0000","last_active":"2024-09-11T22:19:06.644363+0000","last_peered":"2024-09-11T22:19:06.644363+0000","last_clean":"2024-09-11T22:19:06.644363+0000","last_became_active":"2024-09-11T22:19:03.657895+0000","last_became_peered":"2024-09-11T22:19:03.657895+0000","last_unstale":"2024-09-11T22:19:06.644363+0000","last_undegraded":"2024-09-11T22:19:06.644363+0000","last_fullsized":"2024-09-11T22:19:06.644363+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:08.667757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220681+0000","last_change":"2024-09-11T22:19:04.600520+0000","last_active":"2024-09-11T22:19:06.220681+0000","last_peered":"2024-09-11T22:19:06.220681+0000","last_clean":"2024-09-11T22:19:06.220681+0000","last_became_active":"2024-09-11T22:19:04.600238+0000","last_became_peered":"2024-09-11T22:19:04.600238+0000","last_unstale":"2024-09-11T22:19:06.220681+0000","last_undegraded":"2024-09-11T22:19:06.220681+0000","last_fullsized":"2024-09-11T22:19:06.220681+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:56.453262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221670+0000","last_change":"2024-09-11T22:19:03.656565+0000","last_active":"2024-09-11T22:19:06.221670+0000","last_peered":"2024-09-11T22:19:06.221670+0000","last_clean":"2024-09-11T22:19:06.221670+0000","last_became_active":"2024-09-11T22:19:03.656260+0000","last_became_peered":"2024-09-11T22:19:03.656260+0000","last_unstale":"2024-09-11T22:19:06.221670+0000","last_undegraded":"2024-09-11T22:19:06.221670+0000","last_fullsized":"2024-09-11T22:19:06.221670+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:24:38.593905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.590421+0000","last_change":"2024-09-11T22:19:04.595704+0000","last_active":"2024-09-11T22:19:05.590421+0000","last_peered":"2024-09-11T22:19:05.590421+0000","last_clean":"2024-09-11T22:19:05.590421+0000","last_became_active":"2024-09-11T22:19:04.595062+0000","last_became_peered":"2024-09-11T22:19:04.595062+0000","last_unstale":"2024-09-11T22:19:05.590421+0000","last_undegraded":"2024-09-11T22:19:05.590421+0000","last_fullsized":"2024-09-11T22:19:05.590421+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:34.854912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585918+0000","last_change":"2024-09-11T22:19:03.649388+0000","last_active":"2024-09-11T22:19:05.585918+0000","last_peered":"2024-09-11T22:19:05.585918+0000","last_clean":"2024-09-11T22:19:05.585918+0000","last_became_active":"2024-09-11T22:19:03.649080+0000","last_became_peered":"2024-09-11T22:19:03.649080+0000","last_unstale":"2024-09-11T22:19:05.585918+0000","last_undegraded":"2024-09-11T22:19:05.585918+0000","last_fullsized":"2024-09-11T22:19:05.585918+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:25.443138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220720+0000","last_change":"2024-09-11T22:19:04.607362+0000","last_active":"2024-09-11T22:19:06.220720+0000","last_peered":"2024-09-11T22:19:06.220720+0000","last_clean":"2024-09-11T22:19:06.220720+0000","last_became_active":"2024-09-11T22:19:04.607063+0000","last_became_peered":"2024-09-11T22:19:04.607063+0000","last_unstale":"2024-09-11T22:19:06.220720+0000","last_undegraded":"2024-09-11T22:19:06.220720+0000","last_fullsized":"2024-09-11T22:19:06.220720+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:59.918367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220407+0000","last_change":"2024-09-11T22:19:03.659074+0000","last_active":"2024-09-11T22:19:06.220407+0000","last_peered":"2024-09-11T22:19:06.220407+0000","last_clean":"2024-09-11T22:19:06.220407+0000","last_became_active":"2024-09-11T22:19:03.658750+0000","last_became_peered":"2024-09-11T22:19:03.658750+0000","last_unstale":"2024-09-11T22:19:06.220407+0000","last_undegraded":"2024-09-11T22:19:06.220407+0000","last_fullsized":"2024-09-11T22:19:06.220407+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:31.764228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.589676+0000","last_change":"2024-09-11T22:19:04.597543+0000","last_active":"2024-09-11T22:19:05.589676+0000","last_peered":"2024-09-11T22:19:05.589676+0000","last_clean":"2024-09-11T22:19:05.589676+0000","last_became_active":"2024-09-11T22:19:04.597262+0000","last_became_peered":"2024-09-11T22:19:04.597262+0000","last_unstale":"2024-09-11T22:19:05.589676+0000","last_undegraded":"2024-09-11T22:19:05.589676+0000","last_fullsized":"2024-09-11T22:19:05.589676+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:41:09.469801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220823+0000","last_change":"2024-09-11T22:19:03.657654+0000","last_active":"2024-09-11T22:19:06.220823+0000","last_peered":"2024-09-11T22:19:06.220823+0000","last_clean":"2024-09-11T22:19:06.220823+0000","last_became_active":"2024-09-11T22:19:03.657357+0000","last_became_peered":"2024-09-11T22:19:03.657357+0000","last_unstale":"2024-09-11T22:19:06.220823+0000","last_undegraded":"2024-09-11T22:19:06.220823+0000","last_fullsized":"2024-09-11T22:19:06.220823+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:51.252945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220645+0000","last_change":"2024-09-11T22:19:04.601746+0000","last_active":"2024-09-11T22:19:06.220645+0000","last_peered":"2024-09-11T22:19:06.220645+0000","last_clean":"2024-09-11T22:19:06.220645+0000","last_became_active":"2024-09-11T22:19:04.600201+0000","last_became_peered":"2024-09-11T22:19:04.600201+0000","last_unstale":"2024-09-11T22:19:06.220645+0000","last_undegraded":"2024-09-11T22:19:06.220645+0000","last_fullsized":"2024-09-11T22:19:06.220645+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:38.764137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221216+0000","last_change":"2024-09-11T22:19:03.657049+0000","last_active":"2024-09-11T22:19:06.221216+0000","last_peered":"2024-09-11T22:19:06.221216+0000","last_clean":"2024-09-11T22:19:06.221216+0000","last_became_active":"2024-09-11T22:19:03.656761+0000","last_became_peered":"2024-09-11T22:19:03.656761+0000","last_unstale":"2024-09-11T22:19:06.221216+0000","last_undegraded":"2024-09-11T22:19:06.221216+0000","last_fullsized":"2024-09-11T22:19:06.221216+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:23.063038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221186+0000","last_change":"2024-09-11T22:19:04.599763+0000","last_active":"2024-09-11T22:19:06.221186+0000","last_peered":"2024-09-11T22:19:06.221186+0000","last_clean":"2024-09-11T22:19:06.221186+0000","last_became_active":"2024-09-11T22:19:04.599487+0000","last_became_peered":"2024-09-11T22:19:04.599487+0000","last_unstale":"2024-09-11T22:19:06.221186+0000","last_undegraded":"2024-09-11T22:19:06.221186+0000","last_fullsized":"2024-09-11T22:19:06.221186+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:55.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:05.585735+0000","last_change":"2024-09-11T22:19:03.652831+0000","last_active":"2024-09-11T22:19:05.585735+0000","last_peered":"2024-09-11T22:19:05.585735+0000","last_clean":"2024-09-11T22:19:05.585735+0000","last_became_active":"2024-09-11T22:19:03.652532+0000","last_became_peered":"2024-09-11T22:19:03.652532+0000","last_unstale":"2024-09-11T22:19:05.585735+0000","last_undegraded":"2024-09-11T22:19:05.585735+0000","last_fullsized":"2024-09-11T22:19:05.585735+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:49.366586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220918+0000","last_change":"2024-09-11T22:19:04.607288+0000","last_active":"2024-09-11T22:19:06.220918+0000","last_peered":"2024-09-11T22:19:06.220918+0000","last_clean":"2024-09-11T22:19:06.220918+0000","last_became_active":"2024-09-11T22:19:04.606876+0000","last_became_peered":"2024-09-11T22:19:04.606876+0000","last_unstale":"2024-09-11T22:19:06.220918+0000","last_undegraded":"2024-09-11T22:19:06.220918+0000","last_fullsized":"2024-09-11T22:19:06.220918+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:03.630301+0000","last_clean_scrub_stamp":"2024-09-11T22:19:03.630301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.340880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"131'2","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.221001+0000","last_change":"2024-09-11T22:19:03.660606+0000","last_active":"2024-09-11T22:19:06.221001+0000","last_peered":"2024-09-11T22:19:06.221001+0000","last_clean":"2024-09-11T22:19:06.221001+0000","last_became_active":"2024-09-11T22:19:03.660282+0000","last_became_peered":"2024-09-11T22:19:03.660282+0000","last_unstale":"2024-09-11T22:19:06.221001+0000","last_undegraded":"2024-09-11T22:19:06.221001+0000","last_fullsized":"2024-09-11T22:19:06.221001+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:02.628256+0000","last_clean_scrub_stamp":"2024-09-11T22:19:02.628256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.710149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":372,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T22:19:06.220377+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:19:06.220377+0000","last_peered":"2024-09-11T22:19:06.220377+0000","last_clean":"2024-09-11T22:19:06.220377+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:19:06.220377+0000","last_undegraded":"2024-09-11T22:19:06.220377+0000","last_fullsized":"2024-09-11T22:19:06.220377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509542,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46688,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325152,"statfs":{"total":96636764160,"available":96588955648,"internally_reserved":0,"allocated":1650688,"data_stored":720030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509539,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46692,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325148,"statfs":{"total":96636764160,"available":96588951552,"internally_reserved":0,"allocated":1646592,"data_stored":718530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509541,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50844,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320996,"statfs":{"total":96636764160,"available":96584699904,"internally_reserved":0,"allocated":1642496,"data_stored":718488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509541,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55008,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316832,"statfs":{"total":96636764160,"available":96580435968,"internally_reserved":0,"allocated":1646592,"data_stored":718578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509541,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59156,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312684,"statfs":{"total":96636764160,"available":96576188416,"internally_reserved":0,"allocated":1638400,"data_stored":718418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509540,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55584,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316256,"statfs":{"total":96636764160,"available":96579846144,"internally_reserved":0,"allocated":2232320,"data_stored":1308786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47288,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324552,"statfs":{"total":96636764160,"available":96588341248,"internally_reserved":0,"allocated":2256896,"data_stored":1311036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574948,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59168,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312672,"statfs":{"total":96636764160,"available":96576176128,"internally_reserved":0,"allocated":1646592,"data_stored":719034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:19:13.384 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:19:13.385 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T22:19:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.530+0000 7f6f00996640 1 Processor -- start 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.530+0000 7f6f00996640 1 -- start start 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.531+0000 7f6f00996640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6efc0cf580 0x7f6efc0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.531+0000 7f6f00996640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6efc0ce5f0 con 0x7f6efc15e840 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.531+0000 7f6f00996640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6efc0ce310 con 0x7f6efc0cdd50 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.531+0000 7f6f00996640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6efc06c240 con 0x7f6efc0cf580 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.531+0000 7f6efa59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6efc15e840 0x7f6efc0cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36450/0 (socket says 172.21.15.50:36450) 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.531+0000 7f6efa59c640 1 -- 172.21.15.50:0/3601166873 learned_addr learned my addr 172.21.15.50:0/3601166873 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.531+0000 7f6ef3fff640 1 --2- 172.21.15.50:0/3601166873 >> v2:172.21.15.77:3300/0 conn(0x7f6efc0cf580 0x7f6efc0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.531+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724097021 0 0) 0x7f6efc0ce5f0 con 0x7f6efc15e840 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.531+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ee8003520 con 0x7f6efc15e840 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.531+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1175590756 0 0) 0x7f6ee8003520 con 0x7f6efc15e840 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.531+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 >> v2:172.21.15.77:3300/0 conn(0x7f6efc0cf580 msgr2=0x7f6efc0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.531+0000 7f6ef9d9b640 1 --2- 172.21.15.50:0/3601166873 >> v2:172.21.15.77:3300/0 conn(0x7f6efc0cf580 0x7f6efc0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.531+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 >> v1:172.21.15.77:6789/0 conn(0x7f6efc0cdd50 legacy=0x7f6efc06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6efc06bbf0 con 0x7f6efc15e840 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f6eec001670 con 0x7f6efc15e840 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 >> v1:172.21.15.50:6789/0 conn(0x7f6efc15e840 legacy=0x7f6efc0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6ef9d9b640 1 --2- 172.21.15.50:0/3601166873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee80039b0 0x7f6ee8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6ef9d9b640 1 --2- 172.21.15.50:0/3601166873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8004800 0x7f6ee8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6ef9d9b640 1 --2- 172.21.15.50:0/3601166873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ee80051c0 0x7f6ee800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc06c240 con 0x7f6ee80039b0 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee800c060 con 0x7f6ee8004800 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee800c260 con 0x7f6ee80051c0 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6efa59c640 1 --2- 172.21.15.50:0/3601166873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee80039b0 0x7f6ee8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6ef3fff640 1 --2- 172.21.15.50:0/3601166873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8004800 0x7f6ee8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6efad9d640 1 --2- 172.21.15.50:0/3601166873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ee80051c0 0x7f6ee800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6efa59c640 1 -- 172.21.15.50:0/3601166873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ee80051c0 msgr2=0x7f6ee800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6efa59c640 1 --2- 172.21.15.50:0/3601166873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ee80051c0 0x7f6ee800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6efa59c640 1 -- 172.21.15.50:0/3601166873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8004800 msgr2=0x7f6ee8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6efa59c640 1 --2- 172.21.15.50:0/3601166873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8004800 0x7f6ee8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6efa59c640 1 -- 172.21.15.50:0/3601166873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee8003520 con 0x7f6ee80039b0 2024-09-11T22:19:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6efad9d640 1 -- 172.21.15.50:0/3601166873 reap_dead start 2024-09-11T22:19:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.532+0000 7f6ef3fff640 1 --2- 172.21.15.50:0/3601166873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ee8004800 0x7f6ee8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.533+0000 7f6efa59c640 1 --2- 172.21.15.50:0/3601166873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee80039b0 0x7f6ee8003dd0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00c240 tx=0x7f6ee8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cce0d06a43b6cc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.533+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec007cf0 con 0x7f6ee80039b0 2024-09-11T22:19:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.533+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eec0058d0 con 0x7f6ee80039b0 2024-09-11T22:19:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.533+0000 7f6ef9d9b640 1 -- 172.21.15.50:0/3601166873 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec005ca0 con 0x7f6ee80039b0 2024-09-11T22:19:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.533+0000 7f6f00996640 1 -- 172.21.15.50:0/3601166873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee80039b0 msgr2=0x7f6ee8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.533+0000 7f6f00996640 1 --2- 172.21.15.50:0/3601166873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee80039b0 0x7f6ee8003dd0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00c240 tx=0x7f6ee8005830 comp rx=0 tx=0).stop 2024-09-11T22:19:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.533+0000 7f6f00996640 1 -- 172.21.15.50:0/3601166873 shutdown_connections 2024-09-11T22:19:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.533+0000 7f6f00996640 1 --2- 172.21.15.50:0/3601166873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee80039b0 0x7f6ee8003dd0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.533+0000 7f6f00996640 1 -- 172.21.15.50:0/3601166873 >> 172.21.15.50:0/3601166873 conn(0x7f6efc0b4150 msgr2=0x7f6efc0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.533+0000 7f6f00996640 1 -- 172.21.15.50:0/3601166873 shutdown_connections 2024-09-11T22:19:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.534+0000 7f6f00996640 1 -- 172.21.15.50:0/3601166873 wait complete. 2024-09-11T22:19:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.535+0000 7f6f00996640 1 Processor -- start 2024-09-11T22:19:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.535+0000 7f6f00996640 1 -- start start 2024-09-11T22:19:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6f00996640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee80039b0 0x7f6efc1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6f00996640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6efc15c8b0 0x7f6efc15ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6f00996640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6efc160b70 0x7f6efc160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6f00996640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc15ec20 con 0x7f6ee80039b0 2024-09-11T22:19:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6f00996640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc0d0470 con 0x7f6efc15c8b0 2024-09-11T22:19:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6f00996640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6efc15eda0 con 0x7f6efc160b70 2024-09-11T22:19:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6efa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee80039b0 0x7f6efc1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6efa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee80039b0 0x7f6efc1579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56854/0 (socket says 172.21.15.50:56854) 2024-09-11T22:19:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6efa59c640 1 -- 172.21.15.50:0/85011927 learned_addr learned my addr 172.21.15.50:0/85011927 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6ef3fff640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6efc15c8b0 0x7f6efc15ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6efa59c640 1 -- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6efc160b70 msgr2=0x7f6efc160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6efad9d640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6efc160b70 0x7f6efc160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6efa59c640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6efc160b70 0x7f6efc160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6efa59c640 1 -- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6efc15c8b0 msgr2=0x7f6efc15ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6efa59c640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6efc15c8b0 0x7f6efc15ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6efa59c640 1 -- 172.21.15.50:0/85011927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6efc15f160 con 0x7f6ee80039b0 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6ef3fff640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6efc15c8b0 0x7f6efc15ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6efad9d640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6efc160b70 0x7f6efc160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6efa59c640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee80039b0 0x7f6efc1579e0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00c360 tx=0x7f6efc0ce4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6ef2ffd640 1 -- 172.21.15.50:0/85011927 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec038040 con 0x7f6ee80039b0 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6ef2ffd640 1 -- 172.21.15.50:0/85011927 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eec042070 con 0x7f6ee80039b0 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6f00996640 1 -- 172.21.15.50:0/85011927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6efc15f440 con 0x7f6ee80039b0 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6ef2ffd640 1 -- 172.21.15.50:0/85011927 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec001c30 con 0x7f6ee80039b0 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.536+0000 7f6f00996640 1 -- 172.21.15.50:0/85011927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6efc15fa00 con 0x7f6ee80039b0 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.537+0000 7f6f00996640 1 -- 172.21.15.50:0/85011927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6efc075770 con 0x7f6ee80039b0 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.538+0000 7f6ef2ffd640 1 -- 172.21.15.50:0/85011927 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6eec0049e0 con 0x7f6ee80039b0 2024-09-11T22:19:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.538+0000 7f6ef2ffd640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6edc06be30 0x7f6edc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.538+0000 7f6ef2ffd640 1 -- 172.21.15.50:0/85011927 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f6eec0aaee0 con 0x7f6ee80039b0 2024-09-11T22:19:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.538+0000 7f6ef3fff640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6edc06be30 0x7f6edc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.539+0000 7f6ef3fff640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6edc06be30 0x7f6edc06e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6efc15d680 tx=0x7f6ee4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:13.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.542+0000 7f6ef2ffd640 1 -- 172.21.15.50:0/85011927 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6eec079800 con 0x7f6ee80039b0 2024-09-11T22:19:13.579 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:19:13.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:19:13.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.787+0000 7f6f00996640 1 -- 172.21.15.50:0/85011927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6efc0ce5f0 con 0x7f6ee80039b0 2024-09-11T22:19:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.789+0000 7f6ef2ffd640 1 -- 172.21.15.50:0/85011927 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7f6eec079100 con 0x7f6ee80039b0 2024-09-11T22:19:13.789 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:19:13.790 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:19:13.790 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-09-11T22:19:13.790 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-09-11T22:19:13.790 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T22:19:13.790 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-11T22:19:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.791+0000 7f6f00996640 1 -- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6edc06be30 msgr2=0x7f6edc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.791+0000 7f6f00996640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6edc06be30 0x7f6edc06e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6efc15d680 tx=0x7f6ee4008040 comp rx=0 tx=0).stop 2024-09-11T22:19:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.791+0000 7f6f00996640 1 -- 172.21.15.50:0/85011927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee80039b0 msgr2=0x7f6efc1579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.791+0000 7f6f00996640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee80039b0 0x7f6efc1579e0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00c360 tx=0x7f6efc0ce4e0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.791+0000 7f6f00996640 1 -- 172.21.15.50:0/85011927 shutdown_connections 2024-09-11T22:19:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.791+0000 7f6f00996640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6edc06be30 0x7f6edc06e2f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.791+0000 7f6f00996640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6efc160b70 0x7f6efc160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.791+0000 7f6f00996640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6efc15c8b0 0x7f6efc15ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.791+0000 7f6f00996640 1 --2- 172.21.15.50:0/85011927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee80039b0 0x7f6efc1579e0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.791+0000 7f6f00996640 1 -- 172.21.15.50:0/85011927 >> 172.21.15.50:0/85011927 conn(0x7f6efc0b4150 msgr2=0x7f6efc070990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.791+0000 7f6f00996640 1 -- 172.21.15.50:0/85011927 shutdown_connections 2024-09-11T22:19:13.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.791+0000 7f6f00996640 1 -- 172.21.15.50:0/85011927 wait complete. 2024-09-11T22:19:13.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:13.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.904+0000 7f6c5268b640 1 Processor -- start 2024-09-11T22:19:13.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.904+0000 7f6c5268b640 1 -- start start 2024-09-11T22:19:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.905+0000 7f6c5268b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4c15b400 0x7f6c4c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.905+0000 7f6c5268b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6c4c072e60 0x7f6c4c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.905+0000 7f6c5268b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c4c15b7e0 con 0x7f6c4c06df20 2024-09-11T22:19:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.905+0000 7f6c5268b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6c4c06e390 con 0x7f6c4c072e60 2024-09-11T22:19:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.905+0000 7f6c5268b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4c15f140 con 0x7f6c4c15b400 2024-09-11T22:19:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.905+0000 7f6c4bfff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4c15b400 0x7f6c4c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.905+0000 7f6c4b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6c4c072e60 0x7f6c4c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.905+0000 7f6c4bfff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4c15b400 0x7f6c4c06d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:33564/0 (socket says 172.21.15.50:33564) 2024-09-11T22:19:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.905+0000 7f6c50c28640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6c4c06df20 0x7f6c4c0b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:44462/0 (socket says 172.21.15.50:44462) 2024-09-11T22:19:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.905+0000 7f6c4bfff640 1 -- 172.21.15.50:0/68424630 learned_addr learned my addr 172.21.15.50:0/68424630 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.906+0000 7f6c4b7fe640 1 -- 172.21.15.50:0/68424630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4c15b400 msgr2=0x7f6c4c06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.906+0000 7f6c4b7fe640 1 --2- 172.21.15.50:0/68424630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4c15b400 0x7f6c4c06d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.906+0000 7f6c4b7fe640 1 -- 172.21.15.50:0/68424630 >> v1:172.21.15.77:6789/0 conn(0x7f6c4c06df20 legacy=0x7f6c4c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.906+0000 7f6c4b7fe640 1 -- 172.21.15.50:0/68424630 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c15f420 con 0x7f6c4c072e60 2024-09-11T22:19:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.906+0000 7f6c4bfff640 1 --2- 172.21.15.50:0/68424630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4c15b400 0x7f6c4c06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.906+0000 7f6c4b7fe640 1 --2- 172.21.15.50:0/68424630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c072e60 0x7f6c4c06d9e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0097a0 tx=0x7f6c3c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3daf8f25ab00958f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.907+0000 7f6c4affd640 1 -- 172.21.15.50:0/68424630 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c037070 con 0x7f6c4c072e60 2024-09-11T22:19:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.907+0000 7f6c4affd640 1 -- 172.21.15.50:0/68424630 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c032440 con 0x7f6c4c072e60 2024-09-11T22:19:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.907+0000 7f6c4affd640 1 -- 172.21.15.50:0/68424630 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c032810 con 0x7f6c4c072e60 2024-09-11T22:19:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.907+0000 7f6c5268b640 1 -- 172.21.15.50:0/68424630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c072e60 msgr2=0x7f6c4c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.907+0000 7f6c5268b640 1 --2- 172.21.15.50:0/68424630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c072e60 0x7f6c4c06d9e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0097a0 tx=0x7f6c3c02a180 comp rx=0 tx=0).stop 2024-09-11T22:19:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.907+0000 7f6c5268b640 1 -- 172.21.15.50:0/68424630 shutdown_connections 2024-09-11T22:19:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.907+0000 7f6c5268b640 1 --2- 172.21.15.50:0/68424630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c072e60 0x7f6c4c06d9e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.907+0000 7f6c5268b640 1 --2- 172.21.15.50:0/68424630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4c15b400 0x7f6c4c06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.907+0000 7f6c5268b640 1 -- 172.21.15.50:0/68424630 >> 172.21.15.50:0/68424630 conn(0x7f6c4c0679c0 msgr2=0x7f6c4c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.907+0000 7f6c5268b640 1 -- 172.21.15.50:0/68424630 shutdown_connections 2024-09-11T22:19:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.907+0000 7f6c5268b640 1 -- 172.21.15.50:0/68424630 wait complete. 2024-09-11T22:19:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.908+0000 7f6c5268b640 1 Processor -- start 2024-09-11T22:19:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.909+0000 7f6c5268b640 1 -- start start 2024-09-11T22:19:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.909+0000 7f6c5268b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4c06df20 0x7f6c4c151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.909+0000 7f6c5268b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c072e60 0x7f6c4c14d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.909+0000 7f6c5268b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c15b400 0x7f6c4c14bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.909+0000 7f6c5268b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c0cfc50 con 0x7f6c4c072e60 2024-09-11T22:19:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.909+0000 7f6c5268b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c15f9e0 con 0x7f6c4c15b400 2024-09-11T22:19:13.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.909+0000 7f6c5268b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4c0721d0 con 0x7f6c4c06df20 2024-09-11T22:19:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.909+0000 7f6c4b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c072e60 0x7f6c4c14d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.909+0000 7f6c4b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c072e60 0x7f6c4c14d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56856/0 (socket says 172.21.15.50:56856) 2024-09-11T22:19:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.909+0000 7f6c4b7fe640 1 -- 172.21.15.50:0/3858551466 learned_addr learned my addr 172.21.15.50:0/3858551466 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.909+0000 7f6c50c28640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c15b400 0x7f6c4c14bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.909+0000 7f6c4bfff640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4c06df20 0x7f6c4c151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.910+0000 7f6c4b7fe640 1 -- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4c06df20 msgr2=0x7f6c4c151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.910+0000 7f6c4b7fe640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4c06df20 0x7f6c4c151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.910+0000 7f6c4b7fe640 1 -- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c15b400 msgr2=0x7f6c4c14bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.910+0000 7f6c4b7fe640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c15b400 0x7f6c4c14bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.910+0000 7f6c4b7fe640 1 -- 172.21.15.50:0/3858551466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c14d8b0 con 0x7f6c4c072e60 2024-09-11T22:19:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.910+0000 7f6c4b7fe640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c072e60 0x7f6c4c14d0b0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c035040 tx=0x7f6c3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.910+0000 7f6c48ff9640 1 -- 172.21.15.50:0/3858551466 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c037040 con 0x7f6c4c072e60 2024-09-11T22:19:13.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.910+0000 7f6c48ff9640 1 -- 172.21.15.50:0/3858551466 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c030500 con 0x7f6c4c072e60 2024-09-11T22:19:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.910+0000 7f6c5268b640 1 -- 172.21.15.50:0/3858551466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4c152150 con 0x7f6c4c072e60 2024-09-11T22:19:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.910+0000 7f6c48ff9640 1 -- 172.21.15.50:0/3858551466 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c030910 con 0x7f6c4c072e60 2024-09-11T22:19:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.910+0000 7f6c5268b640 1 -- 172.21.15.50:0/3858551466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4c14de30 con 0x7f6c4c072e60 2024-09-11T22:19:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.911+0000 7f6c5268b640 1 -- 172.21.15.50:0/3858551466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c4c072940 con 0x7f6c4c072e60 2024-09-11T22:19:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.912+0000 7f6c48ff9640 1 -- 172.21.15.50:0/3858551466 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c3c044020 con 0x7f6c4c072e60 2024-09-11T22:19:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.912+0000 7f6c48ff9640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c2c06be30 0x7f6c2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.912+0000 7f6c48ff9640 1 -- 172.21.15.50:0/3858551466 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f6c3c0ab070 con 0x7f6c4c072e60 2024-09-11T22:19:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.912+0000 7f6c4bfff640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c2c06be30 0x7f6c2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.913+0000 7f6c4bfff640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c2c06be30 0x7f6c2c06e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6c34006ca0 tx=0x7f6c34009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:13.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:13.916+0000 7f6c48ff9640 1 -- 172.21.15.50:0/3858551466 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c3c079350 con 0x7f6c4c072e60 2024-09-11T22:19:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.125+0000 7f6c5268b640 1 -- 172.21.15.50:0/3858551466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c4c14d5f0 con 0x7f6c4c072e60 2024-09-11T22:19:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.125+0000 7f6c48ff9640 1 -- 172.21.15.50:0/3858551466 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7f6c3c07d650 con 0x7f6c4c072e60 2024-09-11T22:19:14.126 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:14.126 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:14.127 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.127+0000 7f6c5268b640 1 -- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c2c06be30 msgr2=0x7f6c2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.127+0000 7f6c5268b640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c2c06be30 0x7f6c2c06e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6c34006ca0 tx=0x7f6c34009240 comp rx=0 tx=0).stop 2024-09-11T22:19:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.127+0000 7f6c5268b640 1 -- 172.21.15.50:0/3858551466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c072e60 msgr2=0x7f6c4c14d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.127+0000 7f6c5268b640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c072e60 0x7f6c4c14d0b0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c035040 tx=0x7f6c3c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.127+0000 7f6c5268b640 1 -- 172.21.15.50:0/3858551466 shutdown_connections 2024-09-11T22:19:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.127+0000 7f6c5268b640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c2c06be30 0x7f6c2c06e2f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.127+0000 7f6c5268b640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c15b400 0x7f6c4c14bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.127+0000 7f6c5268b640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c072e60 0x7f6c4c14d0b0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.127+0000 7f6c5268b640 1 --2- 172.21.15.50:0/3858551466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4c06df20 0x7f6c4c151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.127+0000 7f6c5268b640 1 -- 172.21.15.50:0/3858551466 >> 172.21.15.50:0/3858551466 conn(0x7f6c4c0679c0 msgr2=0x7f6c4c0b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:14.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.128+0000 7f6c5268b640 1 -- 172.21.15.50:0/3858551466 shutdown_connections 2024-09-11T22:19:14.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.128+0000 7f6c5268b640 1 -- 172.21.15.50:0/3858551466 wait complete. 2024-09-11T22:19:14.542 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 94, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:19:04.005571+0000', 'modified': '2024-09-11T22:19:07.002081+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8412}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8412': {'gid': 8412, 'name': 'a', 'rank': 0, 'incarnation': 91, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/3438568728', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 3438568728}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 3438568728}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8412, 'qdb_cluster': [8412]} 2024-09-11T22:19:14.542 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:19:14.542 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T22:19:14.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.649+0000 7f6e8abf6640 1 Processor -- start 2024-09-11T22:19:14.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.649+0000 7f6e8abf6640 1 -- start start 2024-09-11T22:19:14.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.650+0000 7f6e8abf6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e840d1c90 0x7f6e840b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.650+0000 7f6e8abf6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e84162350 0x7f6e841627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.650+0000 7f6e8abf6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e84163080 con 0x7f6e8415e8e0 2024-09-11T22:19:14.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.650+0000 7f6e8abf6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6e8415ecc0 con 0x7f6e84162350 2024-09-11T22:19:14.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.650+0000 7f6e8abf6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6e840d2ad0 con 0x7f6e840d1c90 2024-09-11T22:19:14.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.650+0000 7f6e89193640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e84162350 0x7f6e841627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.650+0000 7f6e89193640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e84162350 0x7f6e841627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56860/0 (socket says 172.21.15.50:56860) 2024-09-11T22:19:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.650+0000 7f6e89193640 1 -- 172.21.15.50:0/4180681777 learned_addr learned my addr 172.21.15.50:0/4180681777 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.650+0000 7f6e83fff640 1 --2- 172.21.15.50:0/4180681777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e840d1c90 0x7f6e840b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.651+0000 7f6e89193640 1 -- 172.21.15.50:0/4180681777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e840d1c90 msgr2=0x7f6e840b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.651+0000 7f6e89193640 1 --2- 172.21.15.50:0/4180681777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e840d1c90 0x7f6e840b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.651+0000 7f6e89193640 1 -- 172.21.15.50:0/4180681777 >> v1:172.21.15.77:6789/0 conn(0x7f6e8415e8e0 legacy=0x7f6e840d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.651+0000 7f6e89193640 1 -- 172.21.15.50:0/4180681777 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e840d2d20 con 0x7f6e84162350 2024-09-11T22:19:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.651+0000 7f6e89193640 1 --2- 172.21.15.50:0/4180681777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e84162350 0x7f6e841627e0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009e50 tx=0x7f6e7c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22700022c4725818 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.652+0000 7f6e837fe640 1 -- 172.21.15.50:0/4180681777 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c036070 con 0x7f6e84162350 2024-09-11T22:19:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.652+0000 7f6e837fe640 1 -- 172.21.15.50:0/4180681777 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7c031600 con 0x7f6e84162350 2024-09-11T22:19:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.652+0000 7f6e837fe640 1 -- 172.21.15.50:0/4180681777 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0319d0 con 0x7f6e84162350 2024-09-11T22:19:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.652+0000 7f6e8abf6640 1 -- 172.21.15.50:0/4180681777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e84162350 msgr2=0x7f6e841627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.652+0000 7f6e8abf6640 1 --2- 172.21.15.50:0/4180681777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e84162350 0x7f6e841627e0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009e50 tx=0x7f6e7c02a7a0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.652+0000 7f6e8abf6640 1 -- 172.21.15.50:0/4180681777 shutdown_connections 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.652+0000 7f6e8abf6640 1 --2- 172.21.15.50:0/4180681777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e84162350 0x7f6e841627e0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.652+0000 7f6e8abf6640 1 --2- 172.21.15.50:0/4180681777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e840d1c90 0x7f6e840b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.652+0000 7f6e8abf6640 1 -- 172.21.15.50:0/4180681777 >> 172.21.15.50:0/4180681777 conn(0x7f6e84067ba0 msgr2=0x7f6e84067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.652+0000 7f6e8abf6640 1 -- 172.21.15.50:0/4180681777 shutdown_connections 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.652+0000 7f6e8abf6640 1 -- 172.21.15.50:0/4180681777 wait complete. 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.653+0000 7f6e8abf6640 1 Processor -- start 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.653+0000 7f6e8abf6640 1 -- start start 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.654+0000 7f6e8abf6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e840d1c90 0x7f6e840b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.654+0000 7f6e8abf6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e8415e8e0 0x7f6e840cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.654+0000 7f6e8abf6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e84162350 0x7f6e8415cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.654+0000 7f6e8abf6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e84162d20 con 0x7f6e840d1c90 2024-09-11T22:19:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.654+0000 7f6e8abf6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6e840d3370 con 0x7f6e8415e8e0 2024-09-11T22:19:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.654+0000 7f6e8abf6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6e840d3800 con 0x7f6e84162350 2024-09-11T22:19:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.654+0000 7f6e88992640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e840d1c90 0x7f6e840b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.654+0000 7f6e88992640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e840d1c90 0x7f6e840b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56876/0 (socket says 172.21.15.50:56876) 2024-09-11T22:19:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.654+0000 7f6e88992640 1 -- 172.21.15.50:0/3899297299 learned_addr learned my addr 172.21.15.50:0/3899297299 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.654+0000 7f6e83fff640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e8415e8e0 0x7f6e840cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.654+0000 7f6e89193640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e84162350 0x7f6e8415cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.655+0000 7f6e88992640 1 -- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e84162350 msgr2=0x7f6e8415cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.655+0000 7f6e88992640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e84162350 0x7f6e8415cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.655+0000 7f6e88992640 1 -- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e8415e8e0 msgr2=0x7f6e840cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.655+0000 7f6e88992640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e8415e8e0 0x7f6e840cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.655+0000 7f6e88992640 1 -- 172.21.15.50:0/3899297299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8415d090 con 0x7f6e840d1c90 2024-09-11T22:19:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.655+0000 7f6e88992640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e840d1c90 0x7f6e840b60f0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400c430 tx=0x7f6e7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.655+0000 7f6e817fa640 1 -- 172.21.15.50:0/3899297299 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e740052d0 con 0x7f6e840d1c90 2024-09-11T22:19:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.655+0000 7f6e817fa640 1 -- 172.21.15.50:0/3899297299 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e74005490 con 0x7f6e840d1c90 2024-09-11T22:19:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.655+0000 7f6e817fa640 1 -- 172.21.15.50:0/3899297299 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e74007260 con 0x7f6e840d1c90 2024-09-11T22:19:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.655+0000 7f6e8abf6640 1 -- 172.21.15.50:0/3899297299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e840cca40 con 0x7f6e840d1c90 2024-09-11T22:19:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.655+0000 7f6e8abf6640 1 -- 172.21.15.50:0/3899297299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e840cd000 con 0x7f6e840d1c90 2024-09-11T22:19:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.657+0000 7f6e817fa640 1 -- 172.21.15.50:0/3899297299 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e74007400 con 0x7f6e840d1c90 2024-09-11T22:19:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.657+0000 7f6e817fa640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6e7006be30 0x7f6e7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.657+0000 7f6e817fa640 1 -- 172.21.15.50:0/3899297299 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f6e7408a240 con 0x7f6e840d1c90 2024-09-11T22:19:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.657+0000 7f6e83fff640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6e7006be30 0x7f6e7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.658+0000 7f6e83fff640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6e7006be30 0x7f6e7006e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6e840cb080 tx=0x7f6e78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.658+0000 7f6e8da6a740 1 Processor -- start 2024-09-11T22:19:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.658+0000 7f6e8da6a740 1 -- start start 2024-09-11T22:19:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e8da6a740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b8502c0 0x55aa3b895a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e8da6a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b84da80 0x55aa3b8506a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e8da6a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b851a50 0x55aa3b84a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e8da6a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aa3b7b2520 con 0x55aa3b84da80 2024-09-11T22:19:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e8da6a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55aa3b75a3e0 con 0x55aa3b851a50 2024-09-11T22:19:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e8da6a740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55aa3b7ae4e0 con 0x55aa3b8502c0 2024-09-11T22:19:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b84da80 0x55aa3b8506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e88992640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b8502c0 0x55aa3b895a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b84da80 0x55aa3b8506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56882/0 (socket says 172.21.15.50:56882) 2024-09-11T22:19:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e83fff640 1 -- 172.21.15.50:0/2946861555 learned_addr learned my addr 172.21.15.50:0/2946861555 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e89193640 1 --2- 172.21.15.50:0/2946861555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b851a50 0x55aa3b84a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e83fff640 1 -- 172.21.15.50:0/2946861555 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b8502c0 msgr2=0x55aa3b895a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e83fff640 1 --2- 172.21.15.50:0/2946861555 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b8502c0 0x55aa3b895a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e83fff640 1 -- 172.21.15.50:0/2946861555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b851a50 msgr2=0x55aa3b84a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e83fff640 1 --2- 172.21.15.50:0/2946861555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b851a50 0x55aa3b84a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.659+0000 7f6e83fff640 1 -- 172.21.15.50:0/2946861555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa3b7752f0 con 0x55aa3b84da80 2024-09-11T22:19:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.660+0000 7f6e83fff640 1 --2- 172.21.15.50:0/2946861555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b84da80 0x55aa3b8506a0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f6e78010b20 tx=0x7f6e78013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a770febb397f9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.660+0000 7f6e6affd640 1 -- 172.21.15.50:0/2946861555 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78026070 con 0x55aa3b84da80 2024-09-11T22:19:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.660+0000 7f6e6affd640 1 -- 172.21.15.50:0/2946861555 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7801a070 con 0x55aa3b84da80 2024-09-11T22:19:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.660+0000 7f6e6affd640 1 -- 172.21.15.50:0/2946861555 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7801c050 con 0x55aa3b84da80 2024-09-11T22:19:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.660+0000 7f6e8da6a740 1 -- 172.21.15.50:0/2946861555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b84da80 msgr2=0x55aa3b8506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.660+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/2946861555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b84da80 0x55aa3b8506a0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f6e78010b20 tx=0x7f6e78013000 comp rx=0 tx=0).stop 2024-09-11T22:19:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.660+0000 7f6e8da6a740 1 -- 172.21.15.50:0/2946861555 shutdown_connections 2024-09-11T22:19:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.660+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/2946861555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b851a50 0x55aa3b84a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.660+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/2946861555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b84da80 0x55aa3b8506a0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.660+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/2946861555 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b8502c0 0x55aa3b895a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.660+0000 7f6e8da6a740 1 -- 172.21.15.50:0/2946861555 >> 172.21.15.50:0/2946861555 conn(0x55aa3b84ca80 msgr2=0x55aa3b894f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.660+0000 7f6e8da6a740 1 -- 172.21.15.50:0/2946861555 shutdown_connections 2024-09-11T22:19:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.661+0000 7f6e8da6a740 1 -- 172.21.15.50:0/2946861555 wait complete. 2024-09-11T22:19:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.661+0000 7f6e8da6a740 1 -- start start 2024-09-11T22:19:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.661+0000 7f6e8da6a740 1 Processor -- start 2024-09-11T22:19:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e8da6a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b8502c0 0x55aa3b878920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e8da6a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b851a50 0x55aa3b878e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e8da6a740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b86a500 0x55aa3b8663c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e8da6a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aa3b84bf20 con 0x55aa3b851a50 2024-09-11T22:19:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e8da6a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55aa3b73b450 con 0x55aa3b8502c0 2024-09-11T22:19:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e8da6a740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55aa3b896290 con 0x55aa3b86a500 2024-09-11T22:19:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e8da6a740 10 client.0 _ll_register_callbacks cb 0x55aa3b4c4ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b851a50 0x55aa3b878e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b851a50 0x55aa3b878e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56888/0 (socket says 172.21.15.50:56888) 2024-09-11T22:19:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e83fff640 1 -- 172.21.15.50:0/2997568920 learned_addr learned my addr 172.21.15.50:0/2997568920 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e88992640 1 --2- 172.21.15.50:0/2997568920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b8502c0 0x55aa3b878920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e89193640 1 --2- 172.21.15.50:0/2997568920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b86a500 0x55aa3b8663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e83fff640 1 -- 172.21.15.50:0/2997568920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b86a500 msgr2=0x55aa3b8663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e83fff640 1 --2- 172.21.15.50:0/2997568920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b86a500 0x55aa3b8663c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e83fff640 1 -- 172.21.15.50:0/2997568920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b8502c0 msgr2=0x55aa3b878920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e83fff640 1 --2- 172.21.15.50:0/2997568920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b8502c0 0x55aa3b878920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.662+0000 7f6e83fff640 1 -- 172.21.15.50:0/2997568920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa3b4c52d0 con 0x55aa3b851a50 2024-09-11T22:19:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e83fff640 1 --2- 172.21.15.50:0/2997568920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b851a50 0x55aa3b878e60 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f6e780074a0 tx=0x7f6e78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d609a23accd08218 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e637fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e637fe640 1 -- 172.21.15.50:0/2997568920 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78026040 con 0x55aa3b851a50 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e637fe640 1 -- 172.21.15.50:0/2997568920 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f6e78003810 con 0x55aa3b851a50 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e8da6a740 1 -- 172.21.15.50:0/2997568920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e7801a070 con 0x55aa3b851a50 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e637fe640 1 -- 172.21.15.50:0/2997568920 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f6e7801c030 con 0x55aa3b851a50 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e8da6a740 10 client.8556 fetch_fsmap learned FSMap version 94 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e8da6a740 1 -- 172.21.15.50:0/2997568920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55aa3b58f6b0 con 0x55aa3b851a50 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e637fe640 1 -- 172.21.15.50:0/2997568920 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7801a070 con 0x55aa3b851a50 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e637fe640 1 -- 172.21.15.50:0/2997568920 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f6e78029070 con 0x55aa3b851a50 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e8da6a740 10 client.8556 fetch_fsmap finished waiting for FSMap version 94 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e8da6a740 10 client.8556 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e8da6a740 20 client.8556 populate_metadata read hostname 'smithi050' 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/2997568920 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aa3b8ae260 0x55aa3b8b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e8da6a740 4 client.8556 mds_command: new command op to 8412 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e8da6a740 1 -- 172.21.15.50:0/2997568920 --> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa3b7bfc50 con 0x55aa3b8ae260 2024-09-11T22:19:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.663+0000 7f6e88992640 1 --2- 172.21.15.50:0/2997568920 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aa3b8ae260 0x55aa3b8b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.664+0000 7f6e637fe640 10 client.8556 ms_handle_connect on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.664+0000 7f6e88992640 1 --2- 172.21.15.50:0/2997568920 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aa3b8ae260 0x55aa3b8b2540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3ad289e0bda63c2 server_cookie=12dad5566e6d437f in_seq=0 out_seq=0 2024-09-11T22:19:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.664+0000 7f6e637fe640 1 -- 172.21.15.50:0/2997568920 <== mds.0 v2:172.21.15.50:6834/3438568728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa3b7bfc50 con 0x55aa3b8ae260 2024-09-11T22:19:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.664+0000 7f6e637fe640 10 client.8556 handle_command_reply: tid=0 2024-09-11T22:19:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.664+0000 7f6e8da6a740 1 client.8556 shutdown 2024-09-11T22:19:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.664+0000 7f6e8da6a740 1 -- 172.21.15.50:0/2997568920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b851a50 msgr2=0x55aa3b878e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.664+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/2997568920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b851a50 0x55aa3b878e60 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f6e780074a0 tx=0x7f6e78004730 comp rx=0 tx=0).stop 2024-09-11T22:19:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.665+0000 7f6e8da6a740 1 -- 172.21.15.50:0/2997568920 shutdown_connections 2024-09-11T22:19:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.665+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/2997568920 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aa3b8ae260 0x55aa3b8b2540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.665+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/2997568920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b86a500 0x55aa3b8663c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.665+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/2997568920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b851a50 0x55aa3b878e60 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.665+0000 7f6e637fe640 0 client.8556 ms_handle_reset on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:14.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.665+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/2997568920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b8502c0 0x55aa3b878920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.665+0000 7f6e8da6a740 1 -- 172.21.15.50:0/2997568920 >> 172.21.15.50:0/2997568920 conn(0x55aa3b84da80 msgr2=0x55aa3b84e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:14.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.665+0000 7f6e8da6a740 1 -- 172.21.15.50:0/2997568920 shutdown_connections 2024-09-11T22:19:14.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.665+0000 7f6e8da6a740 1 -- 172.21.15.50:0/2997568920 wait complete. 2024-09-11T22:19:14.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.665+0000 7f6e8da6a740 20 client.8556 trim_cache size 0 max 16384 2024-09-11T22:19:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.683+0000 7f6e8da6a740 1 Processor -- start 2024-09-11T22:19:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.683+0000 7f6e8da6a740 1 -- start start 2024-09-11T22:19:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e8da6a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b8502c0 0x55aa3b896a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e8da6a740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b851a50 0x55aa3b909950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e8da6a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 0x55aa3b87a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e8da6a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e841ffd40 con 0x55aa3b86a500 2024-09-11T22:19:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e8da6a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6e841f4e30 con 0x55aa3b8502c0 2024-09-11T22:19:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e8da6a740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6e841f5480 con 0x55aa3b851a50 2024-09-11T22:19:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e89193640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 0x55aa3b87a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e89193640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 0x55aa3b87a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56894/0 (socket says 172.21.15.50:56894) 2024-09-11T22:19:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e89193640 1 -- 172.21.15.50:0/42827858 learned_addr learned my addr 172.21.15.50:0/42827858 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e89193640 1 -- 172.21.15.50:0/42827858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b851a50 msgr2=0x55aa3b909950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e83fff640 1 --2- 172.21.15.50:0/42827858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b851a50 0x55aa3b909950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e88992640 1 --2- 172.21.15.50:0/42827858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b8502c0 0x55aa3b896a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e89193640 1 --2- 172.21.15.50:0/42827858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b851a50 0x55aa3b909950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e89193640 1 -- 172.21.15.50:0/42827858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b8502c0 msgr2=0x55aa3b896a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e89193640 1 --2- 172.21.15.50:0/42827858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b8502c0 0x55aa3b896a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e89193640 1 -- 172.21.15.50:0/42827858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa3b894a80 con 0x55aa3b86a500 2024-09-11T22:19:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e83fff640 1 --2- 172.21.15.50:0/42827858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b851a50 0x55aa3b909950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e88992640 1 --2- 172.21.15.50:0/42827858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b8502c0 0x55aa3b896a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.684+0000 7f6e89193640 1 --2- 172.21.15.50:0/42827858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 0x55aa3b87a0d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009f70 tx=0x7f6e7c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e0c52215dab32e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.685+0000 7f6e6a7fc640 1 -- 172.21.15.50:0/42827858 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c04c070 con 0x55aa3b86a500 2024-09-11T22:19:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.685+0000 7f6e6a7fc640 1 -- 172.21.15.50:0/42827858 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7c037040 con 0x55aa3b86a500 2024-09-11T22:19:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.685+0000 7f6e6a7fc640 1 -- 172.21.15.50:0/42827858 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c036040 con 0x55aa3b86a500 2024-09-11T22:19:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.685+0000 7f6e8da6a740 1 -- 172.21.15.50:0/42827858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 msgr2=0x55aa3b87a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.685+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/42827858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 0x55aa3b87a0d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009f70 tx=0x7f6e7c02e000 comp rx=0 tx=0).stop 2024-09-11T22:19:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.685+0000 7f6e8da6a740 1 -- 172.21.15.50:0/42827858 shutdown_connections 2024-09-11T22:19:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.685+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/42827858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b851a50 0x55aa3b909950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.685+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/42827858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 0x55aa3b87a0d0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.685+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/42827858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b8502c0 0x55aa3b896a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.685+0000 7f6e8da6a740 1 -- 172.21.15.50:0/42827858 >> 172.21.15.50:0/42827858 conn(0x55aa3b84da80 msgr2=0x55aa3b869b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.685+0000 7f6e8da6a740 1 -- 172.21.15.50:0/42827858 shutdown_connections 2024-09-11T22:19:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.685+0000 7f6e8da6a740 1 -- 172.21.15.50:0/42827858 wait complete. 2024-09-11T22:19:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.686+0000 7f6e8da6a740 1 -- start start 2024-09-11T22:19:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.686+0000 7f6e8da6a740 1 Processor -- start 2024-09-11T22:19:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e8da6a740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b8502c0 0x55aa3b8a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e8da6a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b851a50 0x55aa3b891810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e8da6a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 0x55aa3b891d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e8da6a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aa3b867280 con 0x55aa3b86a500 2024-09-11T22:19:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e8da6a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55aa3b866e30 con 0x55aa3b851a50 2024-09-11T22:19:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e8da6a740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55aa3b8ae700 con 0x55aa3b8502c0 2024-09-11T22:19:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e8da6a740 10 client.0 _ll_register_callbacks cb 0x7f6e78024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e89193640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 0x55aa3b891d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e89193640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 0x55aa3b891d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56908/0 (socket says 172.21.15.50:56908) 2024-09-11T22:19:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e89193640 1 -- 172.21.15.50:0/1428004877 learned_addr learned my addr 172.21.15.50:0/1428004877 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e83fff640 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b851a50 0x55aa3b891810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e88992640 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b8502c0 0x55aa3b8a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e89193640 1 -- 172.21.15.50:0/1428004877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b8502c0 msgr2=0x55aa3b8a37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e89193640 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b8502c0 0x55aa3b8a37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e89193640 1 -- 172.21.15.50:0/1428004877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b851a50 msgr2=0x55aa3b891810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e89193640 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b851a50 0x55aa3b891810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e89193640 1 -- 172.21.15.50:0/1428004877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa3b876580 con 0x55aa3b86a500 2024-09-11T22:19:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e83fff640 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b851a50 0x55aa3b891810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e88992640 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b8502c0 0x55aa3b8a37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e89193640 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 0x55aa3b891d50 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c04a040 tx=0x7f6e7c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b647be5467250a17 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e637fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:19:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.687+0000 7f6e637fe640 1 -- 172.21.15.50:0/1428004877 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c04c030 con 0x55aa3b86a500 2024-09-11T22:19:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e637fe640 1 -- 172.21.15.50:0/1428004877 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f6e7c053ac0 con 0x55aa3b86a500 2024-09-11T22:19:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e8da6a740 1 -- 172.21.15.50:0/1428004877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e7c037040 con 0x55aa3b86a500 2024-09-11T22:19:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e637fe640 1 -- 172.21.15.50:0/1428004877 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f6e7c036050 con 0x55aa3b86a500 2024-09-11T22:19:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e8da6a740 10 client.8562 fetch_fsmap learned FSMap version 94 2024-09-11T22:19:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e8da6a740 1 -- 172.21.15.50:0/1428004877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55aa3b8925e0 con 0x55aa3b86a500 2024-09-11T22:19:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e637fe640 1 -- 172.21.15.50:0/1428004877 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7c037040 con 0x55aa3b86a500 2024-09-11T22:19:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e637fe640 1 -- 172.21.15.50:0/1428004877 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f6e7c05d080 con 0x55aa3b86a500 2024-09-11T22:19:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e8da6a740 10 client.8562 fetch_fsmap finished waiting for FSMap version 94 2024-09-11T22:19:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e8da6a740 10 client.8562 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:19:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e8da6a740 20 client.8562 populate_metadata read hostname 'smithi050' 2024-09-11T22:19:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aa3b898320 0x55aa3b898700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e8da6a740 4 client.8562 mds_command: new command op to 8412 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:19:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e8da6a740 1 -- 172.21.15.50:0/1428004877 --> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] -- command(tid 0: {"prefix": "status"}) -- 0x55aa3b7b9fa0 con 0x55aa3b898320 2024-09-11T22:19:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e88992640 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aa3b898320 0x55aa3b898700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e637fe640 10 client.8562 ms_handle_connect on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.688+0000 7f6e88992640 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aa3b898320 0x55aa3b898700 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa1555a9b50493cd server_cookie=b245790e1509ec19 in_seq=0 out_seq=0 2024-09-11T22:19:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e637fe640 1 -- 172.21.15.50:0/1428004877 <== mds.0 v2:172.21.15.50:6834/3438568728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55aa3b7b9fa0 con 0x55aa3b898320 2024-09-11T22:19:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e637fe640 10 client.8562 handle_command_reply: tid=0 2024-09-11T22:19:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e8da6a740 1 client.8562 shutdown 2024-09-11T22:19:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e8da6a740 1 -- 172.21.15.50:0/1428004877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 msgr2=0x55aa3b891d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 0x55aa3b891d50 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c04a040 tx=0x7f6e7c004ab0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e8da6a740 1 -- 172.21.15.50:0/1428004877 shutdown_connections 2024-09-11T22:19:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aa3b898320 0x55aa3b898700 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa3b86a500 0x55aa3b891d50 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aa3b851a50 0x55aa3b891810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e637fe640 0 client.8562 ms_handle_reset on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e8da6a740 1 --2- 172.21.15.50:0/1428004877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aa3b8502c0 0x55aa3b8a37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e8da6a740 1 -- 172.21.15.50:0/1428004877 >> 172.21.15.50:0/1428004877 conn(0x55aa3b84da80 msgr2=0x55aa3b896a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e8da6a740 1 -- 172.21.15.50:0/1428004877 shutdown_connections 2024-09-11T22:19:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e8da6a740 1 -- 172.21.15.50:0/1428004877 wait complete. 2024-09-11T22:19:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.689+0000 7f6e8da6a740 20 client.8562 trim_cache size 0 max 16384 2024-09-11T22:19:14.698 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:19:14.698 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:19:14.699 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:19:14.699 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 8412, 2024-09-11T22:19:14.699 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:19:14.699 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:19:14.699 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:19:14.699 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 10.05062234, 2024-09-11T22:19:14.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 94, 2024-09-11T22:19:14.699 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 132, 2024-09-11T22:19:14.699 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 132, 2024-09-11T22:19:14.699 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 14.198719261999999 2024-09-11T22:19:14.699 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:19:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.690+0000 7f6e8abf6640 1 -- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6e7006be30 msgr2=0x7f6e7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.690+0000 7f6e8abf6640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6e7006be30 0x7f6e7006e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6e840cb080 tx=0x7f6e78008040 comp rx=0 tx=0).stop 2024-09-11T22:19:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.690+0000 7f6e8abf6640 1 -- 172.21.15.50:0/3899297299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e840d1c90 msgr2=0x7f6e840b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.690+0000 7f6e8abf6640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e840d1c90 0x7f6e840b60f0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400c430 tx=0x7f6e7400c8f0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.690+0000 7f6e8abf6640 1 -- 172.21.15.50:0/3899297299 shutdown_connections 2024-09-11T22:19:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.690+0000 7f6e8abf6640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6e7006be30 0x7f6e7006e2f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.690+0000 7f6e8abf6640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e84162350 0x7f6e8415cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.690+0000 7f6e8abf6640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e8415e8e0 0x7f6e840cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.690+0000 7f6e8abf6640 1 --2- 172.21.15.50:0/3899297299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e840d1c90 0x7f6e840b60f0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.690+0000 7f6e8abf6640 1 -- 172.21.15.50:0/3899297299 >> 172.21.15.50:0/3899297299 conn(0x7f6e84067ba0 msgr2=0x7f6e84067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.690+0000 7f6e8abf6640 1 -- 172.21.15.50:0/3899297299 shutdown_connections 2024-09-11T22:19:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.690+0000 7f6e8abf6640 1 -- 172.21.15.50:0/3899297299 wait complete. 2024-09-11T22:19:14.703 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:19:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.804+0000 7fbc3053a640 1 Processor -- start 2024-09-11T22:19:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.804+0000 7fbc3053a640 1 -- start start 2024-09-11T22:19:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.805+0000 7fbc3053a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc280d18a0 0x7fbc280d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.805+0000 7fbc3053a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbc280d3a30 0x7fbc280b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.805+0000 7fbc3053a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc280cfa80 con 0x7fbc2815e870 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.805+0000 7fbc3053a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbc280d3ea0 con 0x7fbc280d3a30 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.805+0000 7fbc3053a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbc280d40d0 con 0x7fbc280d18a0 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.805+0000 7fbc2e2d6640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbc2815e870 0x7fbc280d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36462/0 (socket says 172.21.15.50:36462) 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.805+0000 7fbc2e2d6640 1 -- 172.21.15.50:0/870968147 learned_addr learned my addr 172.21.15.50:0/870968147 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.806+0000 7fbc2ead7640 1 --2- 172.21.15.50:0/870968147 >> v2:172.21.15.77:3300/0 conn(0x7fbc280d3a30 0x7fbc280b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.806+0000 7fbc2dad5640 1 --2- 172.21.15.50:0/870968147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc280d18a0 0x7fbc280d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.806+0000 7fbc2d2d4640 1 -- 172.21.15.50:0/870968147 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154109684 0 0) 0x7fbc18001490 con 0x7fbc2815e870 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.806+0000 7fbc2d2d4640 1 -- 172.21.15.50:0/870968147 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc10003520 con 0x7fbc2815e870 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.806+0000 7fbc2dad5640 1 -- 172.21.15.50:0/870968147 >> v2:172.21.15.77:3300/0 conn(0x7fbc280d3a30 msgr2=0x7fbc280b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.806+0000 7fbc2dad5640 1 --2- 172.21.15.50:0/870968147 >> v2:172.21.15.77:3300/0 conn(0x7fbc280d3a30 0x7fbc280b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.806+0000 7fbc2dad5640 1 -- 172.21.15.50:0/870968147 >> v1:172.21.15.50:6789/0 conn(0x7fbc2815e870 legacy=0x7fbc280d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.806+0000 7fbc2d2d4640 1 -- 172.21.15.50:0/870968147 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 329131365 0 0) 0x7fbc10003520 con 0x7fbc2815e870 2024-09-11T22:19:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.806+0000 7fbc2dad5640 1 -- 172.21.15.50:0/870968147 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc280d43b0 con 0x7fbc280d18a0 2024-09-11T22:19:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.807+0000 7fbc2dad5640 1 --2- 172.21.15.50:0/870968147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc280d18a0 0x7fbc280d34f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0097a0 tx=0x7fbc1c02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9f25b5424cd1dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.807+0000 7fbc2d2d4640 1 -- 172.21.15.50:0/870968147 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c037070 con 0x7fbc280d18a0 2024-09-11T22:19:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.807+0000 7fbc2d2d4640 1 -- 172.21.15.50:0/870968147 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1c02aba0 con 0x7fbc280d18a0 2024-09-11T22:19:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.807+0000 7fbc2d2d4640 1 -- 172.21.15.50:0/870968147 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18001bc0 con 0x7fbc280d18a0 2024-09-11T22:19:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.807+0000 7fbc3053a640 1 -- 172.21.15.50:0/870968147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc280d18a0 msgr2=0x7fbc280d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.807+0000 7fbc3053a640 1 --2- 172.21.15.50:0/870968147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc280d18a0 0x7fbc280d34f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0097a0 tx=0x7fbc1c02a110 comp rx=0 tx=0).stop 2024-09-11T22:19:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.808+0000 7fbc3053a640 1 -- 172.21.15.50:0/870968147 shutdown_connections 2024-09-11T22:19:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.808+0000 7fbc3053a640 1 --2- 172.21.15.50:0/870968147 >> v2:172.21.15.77:3300/0 conn(0x7fbc280d3a30 0x7fbc280b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.808+0000 7fbc3053a640 1 --2- 172.21.15.50:0/870968147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc280d18a0 0x7fbc280d34f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.808+0000 7fbc3053a640 1 -- 172.21.15.50:0/870968147 >> 172.21.15.50:0/870968147 conn(0x7fbc280727a0 msgr2=0x7fbc280679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.808+0000 7fbc3053a640 1 -- 172.21.15.50:0/870968147 shutdown_connections 2024-09-11T22:19:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.808+0000 7fbc3053a640 1 -- 172.21.15.50:0/870968147 wait complete. 2024-09-11T22:19:14.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.809+0000 7fbc3053a640 1 Processor -- start 2024-09-11T22:19:14.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.809+0000 7fbc3053a640 1 -- start start 2024-09-11T22:19:14.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.809+0000 7fbc3053a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc280d18a0 0x7fbc2814cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.809+0000 7fbc3053a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc280d3a30 0x7fbc280b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.809+0000 7fbc3053a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc2815e870 0x7fbc280cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.809+0000 7fbc3053a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2815ec50 con 0x7fbc280d3a30 2024-09-11T22:19:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.809+0000 7fbc3053a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbc280b7ee0 con 0x7fbc2815e870 2024-09-11T22:19:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.809+0000 7fbc3053a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbc280b78b0 con 0x7fbc280d18a0 2024-09-11T22:19:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc2dad5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc280d3a30 0x7fbc280b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc2dad5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc280d3a30 0x7fbc280b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56910/0 (socket says 172.21.15.50:56910) 2024-09-11T22:19:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc2dad5640 1 -- 172.21.15.50:0/3248448862 learned_addr learned my addr 172.21.15.50:0/3248448862 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc2e2d6640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc280d18a0 0x7fbc2814cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc2ead7640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc2815e870 0x7fbc280cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc2dad5640 1 -- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc280d18a0 msgr2=0x7fbc2814cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc2dad5640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc280d18a0 0x7fbc2814cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc2dad5640 1 -- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc2815e870 msgr2=0x7fbc280cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:14.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc2dad5640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc2815e870 0x7fbc280cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:14.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc2dad5640 1 -- 172.21.15.50:0/3248448862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2814d1e0 con 0x7fbc280d3a30 2024-09-11T22:19:14.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc2dad5640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc280d3a30 0x7fbc280b4bd0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c035040 tx=0x7fbc1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc26ffd640 1 -- 172.21.15.50:0/3248448862 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c041020 con 0x7fbc280d3a30 2024-09-11T22:19:14.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc26ffd640 1 -- 172.21.15.50:0/3248448862 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1c03d620 con 0x7fbc280d3a30 2024-09-11T22:19:14.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc3053a640 1 -- 172.21.15.50:0/3248448862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc280b5420 con 0x7fbc280d3a30 2024-09-11T22:19:14.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc26ffd640 1 -- 172.21.15.50:0/3248448862 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c037040 con 0x7fbc280d3a30 2024-09-11T22:19:14.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.810+0000 7fbc3053a640 1 -- 172.21.15.50:0/3248448862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc280b59e0 con 0x7fbc280d3a30 2024-09-11T22:19:14.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.811+0000 7fbc3053a640 1 -- 172.21.15.50:0/3248448862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc280d34f0 con 0x7fbc280d3a30 2024-09-11T22:19:14.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.812+0000 7fbc26ffd640 1 -- 172.21.15.50:0/3248448862 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc1c044020 con 0x7fbc280d3a30 2024-09-11T22:19:14.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.812+0000 7fbc26ffd640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc1406be30 0x7fbc1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:14.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.812+0000 7fbc26ffd640 1 -- 172.21.15.50:0/3248448862 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fbc1c0ab1c0 con 0x7fbc280d3a30 2024-09-11T22:19:14.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.812+0000 7fbc2e2d6640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc1406be30 0x7fbc1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:14.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.813+0000 7fbc2e2d6640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc1406be30 0x7fbc1406e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbc18005c00 tx=0x7fbc18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:14.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:14.816+0000 7fbc26ffd640 1 -- 172.21.15.50:0/3248448862 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc1c04b030 con 0x7fbc280d3a30 2024-09-11T22:19:15.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.026+0000 7fbc3053a640 1 -- 172.21.15.50:0/3248448862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbc280b5110 con 0x7fbc280d3a30 2024-09-11T22:19:15.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.026+0000 7fbc26ffd640 1 -- 172.21.15.50:0/3248448862 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v94) ==== 53+0+73 (secure 0 0 0) 0x7fbc1c0795b0 con 0x7fbc280d3a30 2024-09-11T22:19:15.027 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:19:15.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.028+0000 7fbc3053a640 1 -- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc1406be30 msgr2=0x7fbc1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:15.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.028+0000 7fbc3053a640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc1406be30 0x7fbc1406e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbc18005c00 tx=0x7fbc18009040 comp rx=0 tx=0).stop 2024-09-11T22:19:15.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.028+0000 7fbc3053a640 1 -- 172.21.15.50:0/3248448862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc280d3a30 msgr2=0x7fbc280b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:15.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.028+0000 7fbc3053a640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc280d3a30 0x7fbc280b4bd0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c035040 tx=0x7fbc1c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.028+0000 7fbc3053a640 1 -- 172.21.15.50:0/3248448862 shutdown_connections 2024-09-11T22:19:15.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.028+0000 7fbc3053a640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc1406be30 0x7fbc1406e2f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.028+0000 7fbc3053a640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc2815e870 0x7fbc280cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.028+0000 7fbc3053a640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc280d3a30 0x7fbc280b4bd0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.028+0000 7fbc3053a640 1 --2- 172.21.15.50:0/3248448862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc280d18a0 0x7fbc2814cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.028+0000 7fbc3053a640 1 -- 172.21.15.50:0/3248448862 >> 172.21.15.50:0/3248448862 conn(0x7fbc280727a0 msgr2=0x7fbc280ba1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.028+0000 7fbc3053a640 1 -- 172.21.15.50:0/3248448862 shutdown_connections 2024-09-11T22:19:15.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15.028+0000 7fbc3053a640 1 -- 172.21.15.50:0/3248448862 wait complete. 2024-09-11T22:19:15.040 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:19:15.040 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:19:15.040 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:19:15.040 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:19:15.040 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:19:15.040 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:19:15.040 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:19:15.040 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:19:15.040 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:19:15.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:15.041 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:19:15.057 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:19:15.057 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:19:15.057 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:19:15.057 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:19:15.057 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42240sec preferred_lft 42240sec 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:19:15.058 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:19:15.059 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:19:15.059 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:19:15.059 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:19:15.059 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:19:15.059 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:19:15.059 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:19:15.059 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:19:15.059 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:19:15.059 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:19:15.059 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:19:15.059 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:19:15.059 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:19:15.059 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:19:15.060 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:19:15.060 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:19:15.060 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:19:15.060 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:19:15.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:15.060 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:19:15.122 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:19:15.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:15.124 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:19:15.181 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:19:15.181 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:19:15.181 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:19:15.181 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:19:15.182 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:19:15.182 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:19:15.182 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:15.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:19:15.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:19:15.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:19:15.183 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:15.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:19:15.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:15.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:15.310 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:19:15.325 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:19:15.326 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:19:15.326 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:19:15.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:15.326 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:19:15.391 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:19:15.391 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:19:15.447 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:19:15.448 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:19:15.448 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:19:15.503 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:19:15.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:15.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:19:15.588 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:19:15.588 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:19:15.596 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:19:15.596 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:19:15.596 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:19:15.596 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:19:15.596 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:19:15.597 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:19:15.597 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:19:15.597 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:19:15.597 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:19:15.597 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:19:15.598 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:19:15.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:15.599 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:19:15.624 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:19:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:15.727 INFO:teuthology.orchestra.run.smithi050.stdout:client7007 2024-09-11T22:19:15.728 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:19:15.728 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:19:15.744 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-11T22:19:15.744 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-09-11T22:19:15.744 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:15.744 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:15.745 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.0 2024-09-11T22:19:15.745 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:15.745 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:15.745 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:15.745 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:15.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:15.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.855 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103025 s, 102 MB/s 2024-09-11T22:19:15.865 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.865 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.865 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810592 s, 129 MB/s 2024-09-11T22:19:15.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.874 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732262 s, 143 MB/s 2024-09-11T22:19:15.883 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.883 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.883 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728004 s, 144 MB/s 2024-09-11T22:19:15.892 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.892 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.892 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743882 s, 141 MB/s 2024-09-11T22:19:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707527 s, 148 MB/s 2024-09-11T22:19:15.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.911 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830222 s, 126 MB/s 2024-09-11T22:19:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769814 s, 136 MB/s 2024-09-11T22:19:15.930 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.930 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.930 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00795989 s, 132 MB/s 2024-09-11T22:19:15.938 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.938 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.938 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681665 s, 154 MB/s 2024-09-11T22:19:15.947 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.947 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.947 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666977 s, 157 MB/s 2024-09-11T22:19:15.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.957 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852774 s, 123 MB/s 2024-09-11T22:19:15.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.966 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720597 s, 146 MB/s 2024-09-11T22:19:15.976 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.976 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.976 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765308 s, 137 MB/s 2024-09-11T22:19:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00815984 s, 129 MB/s 2024-09-11T22:19:15.996 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:15.996 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:15.996 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824951 s, 127 MB/s 2024-09-11T22:19:16.006 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.006 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.006 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766411 s, 137 MB/s 2024-09-11T22:19:16.015 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.015 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.015 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007688 s, 136 MB/s 2024-09-11T22:19:16.026 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.026 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.026 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00889744 s, 118 MB/s 2024-09-11T22:19:16.034 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.035 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.035 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703968 s, 149 MB/s 2024-09-11T22:19:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.043 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647018 s, 162 MB/s 2024-09-11T22:19:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809347 s, 130 MB/s 2024-09-11T22:19:16.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.062 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770296 s, 136 MB/s 2024-09-11T22:19:16.072 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.072 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.072 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715033 s, 147 MB/s 2024-09-11T22:19:16.081 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.081 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.081 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770329 s, 136 MB/s 2024-09-11T22:19:16.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.090 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682186 s, 154 MB/s 2024-09-11T22:19:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852266 s, 123 MB/s 2024-09-11T22:19:16.110 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.110 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.110 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740633 s, 142 MB/s 2024-09-11T22:19:16.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.119 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740024 s, 142 MB/s 2024-09-11T22:19:16.128 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.128 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.128 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071836 s, 146 MB/s 2024-09-11T22:19:16.137 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.137 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.137 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740005 s, 142 MB/s 2024-09-11T22:19:16.147 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.147 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.147 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851072 s, 123 MB/s 2024-09-11T22:19:16.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:16.154 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:16.154 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:16.154 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.1 2024-09-11T22:19:16.154 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:16.154 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:16.154 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:16.154 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:16.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707584 s, 148 MB/s 2024-09-11T22:19:16.231 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.231 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.231 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754025 s, 139 MB/s 2024-09-11T22:19:16.240 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.240 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.240 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732884 s, 143 MB/s 2024-09-11T22:19:16.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.249 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755962 s, 139 MB/s 2024-09-11T22:19:16.258 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.258 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.258 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742368 s, 141 MB/s 2024-09-11T22:19:16.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.268 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776411 s, 135 MB/s 2024-09-11T22:19:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703451 s, 149 MB/s 2024-09-11T22:19:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.287 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.287 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724907 s, 145 MB/s 2024-09-11T22:19:16.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.295 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769671 s, 136 MB/s 2024-09-11T22:19:16.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.305 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732639 s, 143 MB/s 2024-09-11T22:19:16.313 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.314 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.314 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755025 s, 139 MB/s 2024-09-11T22:19:16.321 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.321 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643572 s, 163 MB/s 2024-09-11T22:19:16.330 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.330 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.330 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682106 s, 154 MB/s 2024-09-11T22:19:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732963 s, 143 MB/s 2024-09-11T22:19:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.348 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678176 s, 155 MB/s 2024-09-11T22:19:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726981 s, 144 MB/s 2024-09-11T22:19:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698615 s, 150 MB/s 2024-09-11T22:19:16.373 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.373 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.374 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006455 s, 162 MB/s 2024-09-11T22:19:16.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.383 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799902 s, 131 MB/s 2024-09-11T22:19:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753241 s, 139 MB/s 2024-09-11T22:19:16.401 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.401 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.401 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753882 s, 139 MB/s 2024-09-11T22:19:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726137 s, 144 MB/s 2024-09-11T22:19:16.418 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.418 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670925 s, 156 MB/s 2024-09-11T22:19:16.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.428 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00802841 s, 131 MB/s 2024-09-11T22:19:16.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.438 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.438 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764985 s, 137 MB/s 2024-09-11T22:19:16.446 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.446 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.446 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711442 s, 147 MB/s 2024-09-11T22:19:16.455 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.455 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.455 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076168 s, 138 MB/s 2024-09-11T22:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739355 s, 142 MB/s 2024-09-11T22:19:16.473 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.473 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.473 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740464 s, 142 MB/s 2024-09-11T22:19:16.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.482 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733141 s, 143 MB/s 2024-09-11T22:19:16.491 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.491 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.491 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707508 s, 148 MB/s 2024-09-11T22:19:16.500 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.500 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.500 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727699 s, 144 MB/s 2024-09-11T22:19:16.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:16.507 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:16.507 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:16.507 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.2 2024-09-11T22:19:16.507 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:16.507 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:16.507 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:16.507 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:16.568 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.568 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.568 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077566 s, 135 MB/s 2024-09-11T22:19:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697164 s, 150 MB/s 2024-09-11T22:19:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854212 s, 123 MB/s 2024-09-11T22:19:16.596 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.596 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.596 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713889 s, 147 MB/s 2024-09-11T22:19:16.604 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.604 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.604 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687331 s, 153 MB/s 2024-09-11T22:19:16.613 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.613 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.614 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721844 s, 145 MB/s 2024-09-11T22:19:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843066 s, 124 MB/s 2024-09-11T22:19:16.632 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.633 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714274 s, 147 MB/s 2024-09-11T22:19:16.641 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.641 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.641 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698233 s, 150 MB/s 2024-09-11T22:19:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701002 s, 150 MB/s 2024-09-11T22:19:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.659 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716757 s, 146 MB/s 2024-09-11T22:19:16.668 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.669 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.669 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729764 s, 144 MB/s 2024-09-11T22:19:16.676 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.676 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.677 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665129 s, 158 MB/s 2024-09-11T22:19:16.685 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.685 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.685 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705106 s, 149 MB/s 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.695 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786441 s, 133 MB/s 2024-09-11T22:19:16.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.703 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648832 s, 162 MB/s 2024-09-11T22:19:16.712 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.712 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.712 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731633 s, 143 MB/s 2024-09-11T22:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640351 s, 164 MB/s 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.728 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.729 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675549 s, 155 MB/s 2024-09-11T22:19:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646186 s, 162 MB/s 2024-09-11T22:19:16.745 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.745 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.745 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746576 s, 140 MB/s 2024-09-11T22:19:16.754 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.754 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.754 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728538 s, 144 MB/s 2024-09-11T22:19:16.763 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.763 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.763 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701741 s, 149 MB/s 2024-09-11T22:19:16.772 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.772 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.772 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069679 s, 150 MB/s 2024-09-11T22:19:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724935 s, 145 MB/s 2024-09-11T22:19:16.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.790 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778023 s, 135 MB/s 2024-09-11T22:19:16.799 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.799 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.799 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723984 s, 145 MB/s 2024-09-11T22:19:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722851 s, 145 MB/s 2024-09-11T22:19:16.817 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.818 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.818 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075801 s, 138 MB/s 2024-09-11T22:19:16.826 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.826 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.826 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073588 s, 142 MB/s 2024-09-11T22:19:16.835 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.835 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.835 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067444 s, 155 MB/s 2024-09-11T22:19:16.844 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.844 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.844 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735254 s, 143 MB/s 2024-09-11T22:19:16.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:16.851 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:16.851 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:16.851 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.3 2024-09-11T22:19:16.851 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:16.851 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:16.851 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:16.851 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:16.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:16.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.911 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660586 s, 159 MB/s 2024-09-11T22:19:16.919 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.919 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.919 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669748 s, 157 MB/s 2024-09-11T22:19:16.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.928 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718844 s, 146 MB/s 2024-09-11T22:19:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665184 s, 158 MB/s 2024-09-11T22:19:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.946 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.946 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762751 s, 137 MB/s 2024-09-11T22:19:16.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.954 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071545 s, 147 MB/s 2024-09-11T22:19:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701127 s, 150 MB/s 2024-09-11T22:19:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836864 s, 125 MB/s 2024-09-11T22:19:16.982 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.982 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.982 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726893 s, 144 MB/s 2024-09-11T22:19:16.991 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:16.991 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:16.991 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718785 s, 146 MB/s 2024-09-11T22:19:17.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.000 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687859 s, 152 MB/s 2024-09-11T22:19:17.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.009 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074556 s, 141 MB/s 2024-09-11T22:19:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.018 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723874 s, 145 MB/s 2024-09-11T22:19:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732696 s, 143 MB/s 2024-09-11T22:19:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.036 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680648 s, 154 MB/s 2024-09-11T22:19:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745035 s, 141 MB/s 2024-09-11T22:19:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.053 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652962 s, 161 MB/s 2024-09-11T22:19:17.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.062 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737214 s, 142 MB/s 2024-09-11T22:19:17.071 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.071 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.071 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722502 s, 145 MB/s 2024-09-11T22:19:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708631 s, 148 MB/s 2024-09-11T22:19:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637986 s, 164 MB/s 2024-09-11T22:19:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696358 s, 151 MB/s 2024-09-11T22:19:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711143 s, 147 MB/s 2024-09-11T22:19:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.114 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731734 s, 143 MB/s 2024-09-11T22:19:17.123 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.123 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.123 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720229 s, 146 MB/s 2024-09-11T22:19:17.132 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.132 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.132 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731187 s, 143 MB/s 2024-09-11T22:19:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871027 s, 120 MB/s 2024-09-11T22:19:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744783 s, 141 MB/s 2024-09-11T22:19:17.160 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.161 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719776 s, 146 MB/s 2024-09-11T22:19:17.169 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.169 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.169 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725801 s, 144 MB/s 2024-09-11T22:19:17.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.179 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0081044 s, 129 MB/s 2024-09-11T22:19:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730458 s, 144 MB/s 2024-09-11T22:19:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:17.195 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:17.195 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:17.195 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.4 2024-09-11T22:19:17.195 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:17.195 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:17.195 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:17.195 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:17.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:17.256 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.256 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.256 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758304 s, 138 MB/s 2024-09-11T22:19:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639208 s, 164 MB/s 2024-09-11T22:19:17.273 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.273 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.273 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068859 s, 152 MB/s 2024-09-11T22:19:17.281 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.281 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.281 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725331 s, 145 MB/s 2024-09-11T22:19:17.291 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.291 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.291 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799228 s, 131 MB/s 2024-09-11T22:19:17.299 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.299 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.299 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641244 s, 164 MB/s 2024-09-11T22:19:17.308 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.308 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.308 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758724 s, 138 MB/s 2024-09-11T22:19:17.317 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.317 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.317 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707221 s, 148 MB/s 2024-09-11T22:19:17.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.326 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725792 s, 144 MB/s 2024-09-11T22:19:17.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.335 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698514 s, 150 MB/s 2024-09-11T22:19:17.345 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.345 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.345 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838923 s, 125 MB/s 2024-09-11T22:19:17.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699839 s, 150 MB/s 2024-09-11T22:19:17.363 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.363 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.363 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076891 s, 136 MB/s 2024-09-11T22:19:17.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.372 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708688 s, 148 MB/s 2024-09-11T22:19:17.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.380 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648607 s, 162 MB/s 2024-09-11T22:19:17.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725519 s, 145 MB/s 2024-09-11T22:19:17.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.397 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707829 s, 148 MB/s 2024-09-11T22:19:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073043 s, 144 MB/s 2024-09-11T22:19:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750373 s, 140 MB/s 2024-09-11T22:19:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743818 s, 141 MB/s 2024-09-11T22:19:17.434 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.434 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.434 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727473 s, 144 MB/s 2024-09-11T22:19:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737805 s, 142 MB/s 2024-09-11T22:19:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731072 s, 143 MB/s 2024-09-11T22:19:17.461 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.461 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.461 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709744 s, 148 MB/s 2024-09-11T22:19:17.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.469 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698134 s, 150 MB/s 2024-09-11T22:19:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793588 s, 132 MB/s 2024-09-11T22:19:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084535 s, 124 MB/s 2024-09-11T22:19:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747857 s, 140 MB/s 2024-09-11T22:19:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736387 s, 142 MB/s 2024-09-11T22:19:17.515 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.516 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.516 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636743 s, 165 MB/s 2024-09-11T22:19:17.524 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.524 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.524 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631533 s, 166 MB/s 2024-09-11T22:19:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680096 s, 154 MB/s 2024-09-11T22:19:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:17.539 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:17.539 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:17.539 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.5 2024-09-11T22:19:17.539 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:17.539 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:17.539 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:17.539 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729384 s, 144 MB/s 2024-09-11T22:19:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744849 s, 141 MB/s 2024-09-11T22:19:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064605 s, 162 MB/s 2024-09-11T22:19:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730456 s, 144 MB/s 2024-09-11T22:19:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687542 s, 153 MB/s 2024-09-11T22:19:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718349 s, 146 MB/s 2024-09-11T22:19:17.652 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.652 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.652 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758205 s, 138 MB/s 2024-09-11T22:19:17.661 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.661 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.661 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759468 s, 138 MB/s 2024-09-11T22:19:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780893 s, 134 MB/s 2024-09-11T22:19:17.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.681 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766517 s, 137 MB/s 2024-09-11T22:19:17.689 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.690 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754939 s, 139 MB/s 2024-09-11T22:19:17.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.699 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076561 s, 137 MB/s 2024-09-11T22:19:17.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.707 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657541 s, 159 MB/s 2024-09-11T22:19:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713526 s, 147 MB/s 2024-09-11T22:19:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725802 s, 144 MB/s 2024-09-11T22:19:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643689 s, 163 MB/s 2024-09-11T22:19:17.741 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.741 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.741 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645567 s, 162 MB/s 2024-09-11T22:19:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691833 s, 152 MB/s 2024-09-11T22:19:17.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739777 s, 142 MB/s 2024-09-11T22:19:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710452 s, 148 MB/s 2024-09-11T22:19:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734601 s, 143 MB/s 2024-09-11T22:19:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733638 s, 143 MB/s 2024-09-11T22:19:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733465 s, 143 MB/s 2024-09-11T22:19:17.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.803 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703043 s, 149 MB/s 2024-09-11T22:19:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652738 s, 161 MB/s 2024-09-11T22:19:17.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.821 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757927 s, 138 MB/s 2024-09-11T22:19:17.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.829 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644634 s, 163 MB/s 2024-09-11T22:19:17.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.837 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660779 s, 159 MB/s 2024-09-11T22:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728218 s, 144 MB/s 2024-09-11T22:19:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738852 s, 142 MB/s 2024-09-11T22:19:17.863 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.863 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.863 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684921 s, 153 MB/s 2024-09-11T22:19:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667212 s, 157 MB/s 2024-09-11T22:19:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:17.879 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:17.879 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:17.879 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.6 2024-09-11T22:19:17.879 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:17.879 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:17.879 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:17.879 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:17.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684797 s, 153 MB/s 2024-09-11T22:19:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737943 s, 142 MB/s 2024-09-11T22:19:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654234 s, 160 MB/s 2024-09-11T22:19:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712762 s, 147 MB/s 2024-09-11T22:19:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751169 s, 140 MB/s 2024-09-11T22:19:17.983 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.983 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.983 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728568 s, 144 MB/s 2024-09-11T22:19:17.993 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:17.993 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:17.993 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841314 s, 125 MB/s 2024-09-11T22:19:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731963 s, 143 MB/s 2024-09-11T22:19:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667942 s, 157 MB/s 2024-09-11T22:19:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739323 s, 142 MB/s 2024-09-11T22:19:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632671 s, 166 MB/s 2024-09-11T22:19:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708395 s, 148 MB/s 2024-09-11T22:19:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722509 s, 145 MB/s 2024-09-11T22:19:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649363 s, 161 MB/s 2024-09-11T22:19:18.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.062 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727204 s, 144 MB/s 2024-09-11T22:19:18.071 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.071 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.071 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724826 s, 145 MB/s 2024-09-11T22:19:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701038 s, 150 MB/s 2024-09-11T22:19:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713843 s, 147 MB/s 2024-09-11T22:19:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683846 s, 153 MB/s 2024-09-11T22:19:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729214 s, 144 MB/s 2024-09-11T22:19:18.114 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.114 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.115 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648699 s, 162 MB/s 2024-09-11T22:19:18.123 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.123 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.123 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678412 s, 155 MB/s 2024-09-11T22:19:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693308 s, 151 MB/s 2024-09-11T22:19:18.140 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.140 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.140 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725155 s, 145 MB/s 2024-09-11T22:19:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632613 s, 166 MB/s 2024-09-11T22:19:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746621 s, 140 MB/s 2024-09-11T22:19:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.166 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626527 s, 167 MB/s 2024-09-11T22:19:18.174 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.174 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.174 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728193 s, 144 MB/s 2024-09-11T22:19:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643303 s, 163 MB/s 2024-09-11T22:19:18.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.191 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737284 s, 142 MB/s 2024-09-11T22:19:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.201 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781981 s, 134 MB/s 2024-09-11T22:19:18.210 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.210 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.210 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075863 s, 138 MB/s 2024-09-11T22:19:18.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:18.217 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:18.217 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:18.217 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.7 2024-09-11T22:19:18.217 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:18.217 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:18.217 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:18.217 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:18.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747394 s, 140 MB/s 2024-09-11T22:19:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083945 s, 125 MB/s 2024-09-11T22:19:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066583 s, 157 MB/s 2024-09-11T22:19:18.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.304 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663698 s, 158 MB/s 2024-09-11T22:19:18.313 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.313 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.313 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724649 s, 145 MB/s 2024-09-11T22:19:18.322 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.323 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.323 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077169 s, 136 MB/s 2024-09-11T22:19:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825011 s, 127 MB/s 2024-09-11T22:19:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739767 s, 142 MB/s 2024-09-11T22:19:18.350 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.350 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.351 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723707 s, 145 MB/s 2024-09-11T22:19:18.360 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.360 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.360 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766373 s, 137 MB/s 2024-09-11T22:19:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.369 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675774 s, 155 MB/s 2024-09-11T22:19:18.377 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.377 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.377 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727381 s, 144 MB/s 2024-09-11T22:19:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.387 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747603 s, 140 MB/s 2024-09-11T22:19:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778411 s, 135 MB/s 2024-09-11T22:19:18.404 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.404 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.404 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634391 s, 165 MB/s 2024-09-11T22:19:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756145 s, 139 MB/s 2024-09-11T22:19:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766011 s, 137 MB/s 2024-09-11T22:19:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.432 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741605 s, 141 MB/s 2024-09-11T22:19:18.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.441 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752102 s, 139 MB/s 2024-09-11T22:19:18.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.450 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729656 s, 144 MB/s 2024-09-11T22:19:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738847 s, 142 MB/s 2024-09-11T22:19:18.468 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.468 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.468 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703257 s, 149 MB/s 2024-09-11T22:19:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.478 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865083 s, 121 MB/s 2024-09-11T22:19:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724889 s, 145 MB/s 2024-09-11T22:19:18.497 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.497 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.497 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672273 s, 156 MB/s 2024-09-11T22:19:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661434 s, 159 MB/s 2024-09-11T22:19:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089225 s, 118 MB/s 2024-09-11T22:19:18.523 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.523 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.523 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680035 s, 154 MB/s 2024-09-11T22:19:18.531 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.531 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.531 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682975 s, 154 MB/s 2024-09-11T22:19:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748094 s, 140 MB/s 2024-09-11T22:19:18.549 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.550 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714367 s, 147 MB/s 2024-09-11T22:19:18.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719853 s, 146 MB/s 2024-09-11T22:19:18.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:18.566 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:18.566 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:18.566 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.8 2024-09-11T22:19:18.566 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:18.566 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:18.566 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:18.567 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:18.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733697 s, 143 MB/s 2024-09-11T22:19:18.636 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.636 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.636 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744862 s, 141 MB/s 2024-09-11T22:19:18.645 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.645 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.645 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716982 s, 146 MB/s 2024-09-11T22:19:18.654 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.654 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.655 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719009 s, 146 MB/s 2024-09-11T22:19:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066923 s, 157 MB/s 2024-09-11T22:19:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713042 s, 147 MB/s 2024-09-11T22:19:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851888 s, 123 MB/s 2024-09-11T22:19:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746679 s, 140 MB/s 2024-09-11T22:19:18.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.700 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.700 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007234 s, 145 MB/s 2024-09-11T22:19:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703314 s, 149 MB/s 2024-09-11T22:19:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652209 s, 161 MB/s 2024-09-11T22:19:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715158 s, 147 MB/s 2024-09-11T22:19:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643994 s, 163 MB/s 2024-09-11T22:19:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063952 s, 164 MB/s 2024-09-11T22:19:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641738 s, 163 MB/s 2024-09-11T22:19:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735932 s, 142 MB/s 2024-09-11T22:19:18.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.767 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069132 s, 152 MB/s 2024-09-11T22:19:18.775 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.775 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.775 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060766 s, 173 MB/s 2024-09-11T22:19:18.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.783 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700603 s, 150 MB/s 2024-09-11T22:19:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077634 s, 135 MB/s 2024-09-11T22:19:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742976 s, 141 MB/s 2024-09-11T22:19:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753492 s, 139 MB/s 2024-09-11T22:19:18.819 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.819 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650476 s, 161 MB/s 2024-09-11T22:19:18.828 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.828 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.829 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007231 s, 145 MB/s 2024-09-11T22:19:18.836 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.837 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670205 s, 156 MB/s 2024-09-11T22:19:18.845 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.845 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.846 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720636 s, 146 MB/s 2024-09-11T22:19:18.854 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.854 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.854 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739367 s, 142 MB/s 2024-09-11T22:19:18.863 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.863 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.863 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730798 s, 143 MB/s 2024-09-11T22:19:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741039 s, 142 MB/s 2024-09-11T22:19:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741638 s, 141 MB/s 2024-09-11T22:19:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733456 s, 143 MB/s 2024-09-11T22:19:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654804 s, 160 MB/s 2024-09-11T22:19:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:18.906 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:18.906 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:18.906 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.9 2024-09-11T22:19:18.907 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:18.907 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:18.907 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:18.907 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:18.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:18.967 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.967 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.967 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690917 s, 152 MB/s 2024-09-11T22:19:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878592 s, 119 MB/s 2024-09-11T22:19:18.986 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.986 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.986 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007273 s, 144 MB/s 2024-09-11T22:19:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071611 s, 146 MB/s 2024-09-11T22:19:19.004 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774802 s, 135 MB/s 2024-09-11T22:19:19.013 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.013 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.013 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686705 s, 153 MB/s 2024-09-11T22:19:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727394 s, 144 MB/s 2024-09-11T22:19:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721947 s, 145 MB/s 2024-09-11T22:19:19.040 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.040 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.040 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741939 s, 141 MB/s 2024-09-11T22:19:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673815 s, 156 MB/s 2024-09-11T22:19:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777249 s, 135 MB/s 2024-09-11T22:19:19.067 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.067 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.067 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751059 s, 140 MB/s 2024-09-11T22:19:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671566 s, 156 MB/s 2024-09-11T22:19:19.084 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.084 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.084 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763021 s, 137 MB/s 2024-09-11T22:19:19.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.094 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769754 s, 136 MB/s 2024-09-11T22:19:19.102 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.102 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.102 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680274 s, 154 MB/s 2024-09-11T22:19:19.111 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.111 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.111 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715467 s, 147 MB/s 2024-09-11T22:19:19.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.120 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712341 s, 147 MB/s 2024-09-11T22:19:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702646 s, 149 MB/s 2024-09-11T22:19:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667611 s, 157 MB/s 2024-09-11T22:19:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722304 s, 145 MB/s 2024-09-11T22:19:19.155 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.155 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.155 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071578 s, 146 MB/s 2024-09-11T22:19:19.163 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.163 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.163 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643284 s, 163 MB/s 2024-09-11T22:19:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740285 s, 142 MB/s 2024-09-11T22:19:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723678 s, 145 MB/s 2024-09-11T22:19:19.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.189 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636367 s, 165 MB/s 2024-09-11T22:19:19.198 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.198 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.198 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743293 s, 141 MB/s 2024-09-11T22:19:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694586 s, 151 MB/s 2024-09-11T22:19:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065252 s, 161 MB/s 2024-09-11T22:19:19.224 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.224 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.224 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735803 s, 143 MB/s 2024-09-11T22:19:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731778 s, 143 MB/s 2024-09-11T22:19:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690451 s, 152 MB/s 2024-09-11T22:19:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:19.248 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:19.248 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:19.249 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.10 2024-09-11T22:19:19.249 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:19.249 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:19.249 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:19.249 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664826 s, 158 MB/s 2024-09-11T22:19:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721354 s, 145 MB/s 2024-09-11T22:19:19.327 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.327 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.327 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800716 s, 131 MB/s 2024-09-11T22:19:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722053 s, 145 MB/s 2024-09-11T22:19:19.345 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.345 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.345 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713975 s, 147 MB/s 2024-09-11T22:19:19.354 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.354 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.354 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755029 s, 139 MB/s 2024-09-11T22:19:19.363 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.363 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.363 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758012 s, 138 MB/s 2024-09-11T22:19:19.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.372 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696882 s, 150 MB/s 2024-09-11T22:19:19.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.380 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622723 s, 168 MB/s 2024-09-11T22:19:19.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.388 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683664 s, 153 MB/s 2024-09-11T22:19:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713093 s, 147 MB/s 2024-09-11T22:19:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733595 s, 143 MB/s 2024-09-11T22:19:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749916 s, 140 MB/s 2024-09-11T22:19:19.423 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.423 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.423 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642488 s, 163 MB/s 2024-09-11T22:19:19.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.432 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738896 s, 142 MB/s 2024-09-11T22:19:19.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.441 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645885 s, 162 MB/s 2024-09-11T22:19:19.449 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.449 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.449 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728378 s, 144 MB/s 2024-09-11T22:19:19.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.458 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712183 s, 147 MB/s 2024-09-11T22:19:19.467 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.467 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.467 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741433 s, 141 MB/s 2024-09-11T22:19:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757689 s, 138 MB/s 2024-09-11T22:19:19.486 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.486 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.486 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796016 s, 132 MB/s 2024-09-11T22:19:19.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.495 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653677 s, 160 MB/s 2024-09-11T22:19:19.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.504 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760532 s, 138 MB/s 2024-09-11T22:19:19.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.513 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.513 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731137 s, 143 MB/s 2024-09-11T22:19:19.521 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.521 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.521 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677468 s, 155 MB/s 2024-09-11T22:19:19.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.530 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721613 s, 145 MB/s 2024-09-11T22:19:19.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.539 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743028 s, 141 MB/s 2024-09-11T22:19:19.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.548 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720565 s, 146 MB/s 2024-09-11T22:19:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742323 s, 141 MB/s 2024-09-11T22:19:19.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.565 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649175 s, 162 MB/s 2024-09-11T22:19:19.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672258 s, 156 MB/s 2024-09-11T22:19:19.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.582 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684461 s, 153 MB/s 2024-09-11T22:19:19.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:19.589 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:19.589 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:19.589 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.11 2024-09-11T22:19:19.589 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:19.589 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:19.589 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:19.589 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:19.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:19.649 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717079 s, 146 MB/s 2024-09-11T22:19:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765843 s, 137 MB/s 2024-09-11T22:19:19.668 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.668 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.668 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755826 s, 139 MB/s 2024-09-11T22:19:19.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.677 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705926 s, 149 MB/s 2024-09-11T22:19:19.687 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.687 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.687 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00814857 s, 129 MB/s 2024-09-11T22:19:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.696 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731213 s, 143 MB/s 2024-09-11T22:19:19.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.705 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763367 s, 137 MB/s 2024-09-11T22:19:19.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.714 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730045 s, 144 MB/s 2024-09-11T22:19:19.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.724 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773359 s, 136 MB/s 2024-09-11T22:19:19.732 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.732 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.732 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689897 s, 152 MB/s 2024-09-11T22:19:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.741 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064057 s, 164 MB/s 2024-09-11T22:19:19.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.749 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654117 s, 160 MB/s 2024-09-11T22:19:19.757 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.757 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.757 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658218 s, 159 MB/s 2024-09-11T22:19:19.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.766 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759523 s, 138 MB/s 2024-09-11T22:19:19.775 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.775 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.775 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751083 s, 140 MB/s 2024-09-11T22:19:19.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.784 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755578 s, 139 MB/s 2024-09-11T22:19:19.793 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.793 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.793 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719564 s, 146 MB/s 2024-09-11T22:19:19.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.803 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803044 s, 131 MB/s 2024-09-11T22:19:19.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.812 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747188 s, 140 MB/s 2024-09-11T22:19:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709027 s, 148 MB/s 2024-09-11T22:19:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707633 s, 148 MB/s 2024-09-11T22:19:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769495 s, 136 MB/s 2024-09-11T22:19:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.849 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746899 s, 140 MB/s 2024-09-11T22:19:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728313 s, 144 MB/s 2024-09-11T22:19:19.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.867 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073244 s, 143 MB/s 2024-09-11T22:19:19.877 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.877 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.877 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845696 s, 124 MB/s 2024-09-11T22:19:19.886 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.886 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.886 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766263 s, 137 MB/s 2024-09-11T22:19:19.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.895 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701028 s, 150 MB/s 2024-09-11T22:19:19.903 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.903 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.903 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662506 s, 158 MB/s 2024-09-11T22:19:19.912 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.912 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.912 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073933 s, 142 MB/s 2024-09-11T22:19:19.922 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.925 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782288 s, 134 MB/s 2024-09-11T22:19:19.931 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.931 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.931 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068599 s, 153 MB/s 2024-09-11T22:19:19.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:19.938 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:19.938 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:19.938 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.12 2024-09-11T22:19:19.938 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:19.938 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:19.938 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:19.939 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:19.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:19.998 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:19.998 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:19.998 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067295 s, 156 MB/s 2024-09-11T22:19:20.007 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.007 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.007 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714222 s, 147 MB/s 2024-09-11T22:19:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757828 s, 138 MB/s 2024-09-11T22:19:20.025 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.025 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.025 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667924 s, 157 MB/s 2024-09-11T22:19:20.034 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.034 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.034 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697559 s, 150 MB/s 2024-09-11T22:19:20.042 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.042 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.042 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695786 s, 151 MB/s 2024-09-11T22:19:20.051 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.052 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.052 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728226 s, 144 MB/s 2024-09-11T22:19:20.060 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.060 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.060 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730382 s, 144 MB/s 2024-09-11T22:19:20.069 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.070 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.070 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778028 s, 135 MB/s 2024-09-11T22:19:20.078 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.078 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.078 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644035 s, 163 MB/s 2024-09-11T22:19:20.086 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.086 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.086 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665896 s, 157 MB/s 2024-09-11T22:19:20.093 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.094 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616439 s, 170 MB/s 2024-09-11T22:19:20.102 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.103 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.103 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742221 s, 141 MB/s 2024-09-11T22:19:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721004 s, 145 MB/s 2024-09-11T22:19:20.121 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.122 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.122 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00834483 s, 126 MB/s 2024-09-11T22:19:20.130 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.130 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.130 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705064 s, 149 MB/s 2024-09-11T22:19:20.139 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.139 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.139 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074876 s, 140 MB/s 2024-09-11T22:19:20.149 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.149 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.149 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756057 s, 139 MB/s 2024-09-11T22:19:20.157 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.158 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.158 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722081 s, 145 MB/s 2024-09-11T22:19:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689837 s, 152 MB/s 2024-09-11T22:19:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.175 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.176 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730573 s, 144 MB/s 2024-09-11T22:19:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740298 s, 142 MB/s 2024-09-11T22:19:20.193 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.193 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.193 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678881 s, 154 MB/s 2024-09-11T22:19:20.201 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.201 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.202 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721268 s, 145 MB/s 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637775 s, 164 MB/s 2024-09-11T22:19:20.219 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.219 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.219 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741655 s, 141 MB/s 2024-09-11T22:19:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740033 s, 142 MB/s 2024-09-11T22:19:20.237 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756037 s, 139 MB/s 2024-09-11T22:19:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.246 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714851 s, 147 MB/s 2024-09-11T22:19:20.255 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.255 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.255 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704955 s, 149 MB/s 2024-09-11T22:19:20.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.263 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740196 s, 142 MB/s 2024-09-11T22:19:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.273 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.273 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749905 s, 140 MB/s 2024-09-11T22:19:20.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:20.279 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:20.279 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:20.279 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.13 2024-09-11T22:19:20.280 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:20.280 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:20.280 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:20.280 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:20.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:20.339 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.339 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.339 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646464 s, 162 MB/s 2024-09-11T22:19:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725674 s, 144 MB/s 2024-09-11T22:19:20.357 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.357 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.357 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772305 s, 136 MB/s 2024-09-11T22:19:20.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.365 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662077 s, 158 MB/s 2024-09-11T22:19:20.373 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.373 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.373 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651396 s, 161 MB/s 2024-09-11T22:19:20.382 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.382 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.382 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707972 s, 148 MB/s 2024-09-11T22:19:20.391 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.391 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.391 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714031 s, 147 MB/s 2024-09-11T22:19:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079235 s, 132 MB/s 2024-09-11T22:19:20.409 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.409 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.409 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073191 s, 143 MB/s 2024-09-11T22:19:20.418 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.418 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.418 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728225 s, 144 MB/s 2024-09-11T22:19:20.427 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.427 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.427 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708604 s, 148 MB/s 2024-09-11T22:19:20.435 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.436 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.436 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681965 s, 154 MB/s 2024-09-11T22:19:20.445 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.445 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.445 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744639 s, 141 MB/s 2024-09-11T22:19:20.453 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.453 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.453 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706264 s, 148 MB/s 2024-09-11T22:19:20.462 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.462 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.463 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731161 s, 143 MB/s 2024-09-11T22:19:20.471 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.471 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.471 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669043 s, 157 MB/s 2024-09-11T22:19:20.480 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.480 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.480 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735433 s, 143 MB/s 2024-09-11T22:19:20.489 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.489 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.489 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753179 s, 139 MB/s 2024-09-11T22:19:20.498 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.498 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.498 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725094 s, 145 MB/s 2024-09-11T22:19:20.507 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.507 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.507 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699577 s, 150 MB/s 2024-09-11T22:19:20.516 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.516 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.516 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726338 s, 144 MB/s 2024-09-11T22:19:20.526 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.526 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.527 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869087 s, 121 MB/s 2024-09-11T22:19:20.535 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.535 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.536 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714797 s, 147 MB/s 2024-09-11T22:19:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661865 s, 158 MB/s 2024-09-11T22:19:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674978 s, 155 MB/s 2024-09-11T22:19:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710462 s, 148 MB/s 2024-09-11T22:19:20.570 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.571 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.571 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719113 s, 146 MB/s 2024-09-11T22:19:20.579 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.579 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.579 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659804 s, 159 MB/s 2024-09-11T22:19:20.587 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.587 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.587 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065559 s, 160 MB/s 2024-09-11T22:19:20.597 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.597 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.597 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836542 s, 125 MB/s 2024-09-11T22:19:20.608 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.608 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.608 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846579 s, 124 MB/s 2024-09-11T22:19:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720582 s, 146 MB/s 2024-09-11T22:19:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:20.624 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:20.624 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:20.624 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.14 2024-09-11T22:19:20.624 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:20.624 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:20.624 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:20.624 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:20.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:20.685 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.686 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.686 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749056 s, 140 MB/s 2024-09-11T22:19:20.695 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.695 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.695 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739946 s, 142 MB/s 2024-09-11T22:19:20.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.703 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643398 s, 163 MB/s 2024-09-11T22:19:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683267 s, 153 MB/s 2024-09-11T22:19:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706847 s, 148 MB/s 2024-09-11T22:19:20.728 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.728 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.729 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665746 s, 158 MB/s 2024-09-11T22:19:20.737 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.738 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.738 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727457 s, 144 MB/s 2024-09-11T22:19:20.746 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.746 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.747 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735217 s, 143 MB/s 2024-09-11T22:19:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769095 s, 136 MB/s 2024-09-11T22:19:20.765 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.765 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.765 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753915 s, 139 MB/s 2024-09-11T22:19:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007241 s, 145 MB/s 2024-09-11T22:19:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.783 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751593 s, 140 MB/s 2024-09-11T22:19:20.792 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.792 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.792 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072028 s, 146 MB/s 2024-09-11T22:19:20.800 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.800 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.801 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661998 s, 158 MB/s 2024-09-11T22:19:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627818 s, 167 MB/s 2024-09-11T22:19:20.817 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.817 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.817 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072958 s, 144 MB/s 2024-09-11T22:19:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661288 s, 159 MB/s 2024-09-11T22:19:20.834 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.834 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.834 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709757 s, 148 MB/s 2024-09-11T22:19:20.843 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.843 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.843 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705416 s, 149 MB/s 2024-09-11T22:19:20.851 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.851 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.851 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675741 s, 155 MB/s 2024-09-11T22:19:20.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.859 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645382 s, 162 MB/s 2024-09-11T22:19:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633108 s, 166 MB/s 2024-09-11T22:19:20.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.875 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643418 s, 163 MB/s 2024-09-11T22:19:20.883 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.883 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.883 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655483 s, 160 MB/s 2024-09-11T22:19:20.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.891 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678536 s, 155 MB/s 2024-09-11T22:19:20.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.900 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709279 s, 148 MB/s 2024-09-11T22:19:20.909 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.909 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.909 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715888 s, 146 MB/s 2024-09-11T22:19:20.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.918 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720561 s, 146 MB/s 2024-09-11T22:19:20.926 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721306 s, 145 MB/s 2024-09-11T22:19:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737493 s, 142 MB/s 2024-09-11T22:19:20.944 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.945 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716928 s, 146 MB/s 2024-09-11T22:19:20.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:20.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:20.954 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735151 s, 143 MB/s 2024-09-11T22:19:20.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:20.960 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:20.960 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:20.960 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.15 2024-09-11T22:19:20.961 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:20.961 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:20.961 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:20.961 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:21.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.021 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075173 s, 139 MB/s 2024-09-11T22:19:21.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.030 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710841 s, 148 MB/s 2024-09-11T22:19:21.039 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.039 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.039 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717393 s, 146 MB/s 2024-09-11T22:19:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.047 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677962 s, 155 MB/s 2024-09-11T22:19:21.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.057 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763781 s, 137 MB/s 2024-09-11T22:19:21.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.066 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.066 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711646 s, 147 MB/s 2024-09-11T22:19:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.075 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752119 s, 139 MB/s 2024-09-11T22:19:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710272 s, 148 MB/s 2024-09-11T22:19:21.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.093 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.093 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749133 s, 140 MB/s 2024-09-11T22:19:21.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.101 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683121 s, 153 MB/s 2024-09-11T22:19:21.110 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.110 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.110 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731475 s, 143 MB/s 2024-09-11T22:19:21.118 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.118 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.118 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634337 s, 165 MB/s 2024-09-11T22:19:21.126 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.126 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.126 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698229 s, 150 MB/s 2024-09-11T22:19:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.136 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755293 s, 139 MB/s 2024-09-11T22:19:21.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.145 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726311 s, 144 MB/s 2024-09-11T22:19:21.153 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.153 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.153 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631173 s, 166 MB/s 2024-09-11T22:19:21.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.161 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715394 s, 147 MB/s 2024-09-11T22:19:21.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.170 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738224 s, 142 MB/s 2024-09-11T22:19:21.178 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.179 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064166 s, 163 MB/s 2024-09-11T22:19:21.186 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.186 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.187 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631361 s, 166 MB/s 2024-09-11T22:19:21.194 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.194 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.194 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624796 s, 168 MB/s 2024-09-11T22:19:21.203 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.203 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.203 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074515 s, 141 MB/s 2024-09-11T22:19:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714717 s, 147 MB/s 2024-09-11T22:19:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064728 s, 162 MB/s 2024-09-11T22:19:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718458 s, 146 MB/s 2024-09-11T22:19:21.237 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.237 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.237 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697441 s, 150 MB/s 2024-09-11T22:19:21.246 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.246 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.246 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680718 s, 154 MB/s 2024-09-11T22:19:21.255 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.255 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.255 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076348 s, 137 MB/s 2024-09-11T22:19:21.264 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.264 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.264 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070537 s, 149 MB/s 2024-09-11T22:19:21.273 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.273 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.273 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711954 s, 147 MB/s 2024-09-11T22:19:21.282 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.282 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.282 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073354 s, 143 MB/s 2024-09-11T22:19:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649935 s, 161 MB/s 2024-09-11T22:19:21.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:21.297 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:21.297 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:21.297 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.16 2024-09-11T22:19:21.297 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:21.297 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:21.297 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:21.297 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:21.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:21.357 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.357 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.357 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068348 s, 153 MB/s 2024-09-11T22:19:21.366 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.366 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.366 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741998 s, 141 MB/s 2024-09-11T22:19:21.375 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.375 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.375 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732313 s, 143 MB/s 2024-09-11T22:19:21.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.383 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669059 s, 157 MB/s 2024-09-11T22:19:21.391 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.392 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.392 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068541 s, 153 MB/s 2024-09-11T22:19:21.401 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.401 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.401 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727166 s, 144 MB/s 2024-09-11T22:19:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.409 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644422 s, 163 MB/s 2024-09-11T22:19:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652736 s, 161 MB/s 2024-09-11T22:19:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731602 s, 143 MB/s 2024-09-11T22:19:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736798 s, 142 MB/s 2024-09-11T22:19:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.444 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733848 s, 143 MB/s 2024-09-11T22:19:21.453 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.453 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.453 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716386 s, 146 MB/s 2024-09-11T22:19:21.461 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.461 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.461 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657774 s, 159 MB/s 2024-09-11T22:19:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064683 s, 162 MB/s 2024-09-11T22:19:21.477 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.477 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.477 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636499 s, 165 MB/s 2024-09-11T22:19:21.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.485 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070491 s, 149 MB/s 2024-09-11T22:19:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.495 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.495 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764198 s, 137 MB/s 2024-09-11T22:19:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772631 s, 136 MB/s 2024-09-11T22:19:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758815 s, 138 MB/s 2024-09-11T22:19:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718049 s, 146 MB/s 2024-09-11T22:19:21.531 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.531 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.531 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736662 s, 142 MB/s 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.541 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798859 s, 131 MB/s 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.550 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725123 s, 145 MB/s 2024-09-11T22:19:21.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.558 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672062 s, 156 MB/s 2024-09-11T22:19:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.567 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694872 s, 151 MB/s 2024-09-11T22:19:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066641 s, 157 MB/s 2024-09-11T22:19:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.584 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065351 s, 160 MB/s 2024-09-11T22:19:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683997 s, 153 MB/s 2024-09-11T22:19:21.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.600 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636918 s, 165 MB/s 2024-09-11T22:19:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734778 s, 143 MB/s 2024-09-11T22:19:21.618 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.618 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.618 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720125 s, 146 MB/s 2024-09-11T22:19:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666893 s, 157 MB/s 2024-09-11T22:19:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:21.633 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:21.633 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:21.633 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.17 2024-09-11T22:19:21.633 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:21.633 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:21.633 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:21.634 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:21.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:21.694 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.694 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.694 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728549 s, 144 MB/s 2024-09-11T22:19:21.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.703 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729196 s, 144 MB/s 2024-09-11T22:19:21.712 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.712 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.712 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731315 s, 143 MB/s 2024-09-11T22:19:21.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.721 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.721 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691046 s, 152 MB/s 2024-09-11T22:19:21.729 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.729 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.730 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705088 s, 149 MB/s 2024-09-11T22:19:21.738 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.738 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.738 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716663 s, 146 MB/s 2024-09-11T22:19:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.747 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742469 s, 141 MB/s 2024-09-11T22:19:21.757 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.757 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.757 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745002 s, 141 MB/s 2024-09-11T22:19:21.765 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.766 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732403 s, 143 MB/s 2024-09-11T22:19:21.774 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.774 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.774 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648487 s, 162 MB/s 2024-09-11T22:19:21.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.783 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781179 s, 134 MB/s 2024-09-11T22:19:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737463 s, 142 MB/s 2024-09-11T22:19:21.800 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.800 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643517 s, 163 MB/s 2024-09-11T22:19:21.809 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.809 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.809 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682762 s, 154 MB/s 2024-09-11T22:19:21.818 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.818 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.818 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741747 s, 141 MB/s 2024-09-11T22:19:21.826 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.826 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.826 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661717 s, 158 MB/s 2024-09-11T22:19:21.835 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.835 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.835 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736189 s, 142 MB/s 2024-09-11T22:19:21.844 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.844 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.844 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070705 s, 148 MB/s 2024-09-11T22:19:21.854 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.854 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.854 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858679 s, 122 MB/s 2024-09-11T22:19:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.863 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717062 s, 146 MB/s 2024-09-11T22:19:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.872 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720701 s, 145 MB/s 2024-09-11T22:19:21.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.881 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006984 s, 150 MB/s 2024-09-11T22:19:21.889 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.890 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.890 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714947 s, 147 MB/s 2024-09-11T22:19:21.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.899 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.899 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717159 s, 146 MB/s 2024-09-11T22:19:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.908 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728868 s, 144 MB/s 2024-09-11T22:19:21.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.917 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.917 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722061 s, 145 MB/s 2024-09-11T22:19:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781841 s, 134 MB/s 2024-09-11T22:19:21.935 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.935 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.935 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744546 s, 141 MB/s 2024-09-11T22:19:21.943 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.943 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.943 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064859 s, 162 MB/s 2024-09-11T22:19:21.951 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.951 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.951 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065406 s, 160 MB/s 2024-09-11T22:19:21.960 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.960 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.960 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719665 s, 146 MB/s 2024-09-11T22:19:21.968 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:21.969 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:21.969 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656859 s, 160 MB/s 2024-09-11T22:19:21.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:21.975 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:21.975 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:21.975 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.18 2024-09-11T22:19:21.975 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:21.975 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:21.975 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:21.975 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:22.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:22.035 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.035 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.035 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651505 s, 161 MB/s 2024-09-11T22:19:22.044 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.044 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.044 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725241 s, 145 MB/s 2024-09-11T22:19:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735073 s, 143 MB/s 2024-09-11T22:19:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.063 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798729 s, 131 MB/s 2024-09-11T22:19:22.071 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.071 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.071 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701666 s, 149 MB/s 2024-09-11T22:19:22.080 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.080 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.080 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734583 s, 143 MB/s 2024-09-11T22:19:22.089 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.089 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.089 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733857 s, 143 MB/s 2024-09-11T22:19:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726134 s, 144 MB/s 2024-09-11T22:19:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765251 s, 137 MB/s 2024-09-11T22:19:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725358 s, 145 MB/s 2024-09-11T22:19:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643235 s, 163 MB/s 2024-09-11T22:19:22.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.134 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747369 s, 140 MB/s 2024-09-11T22:19:22.142 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.143 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710336 s, 148 MB/s 2024-09-11T22:19:22.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.152 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792529 s, 132 MB/s 2024-09-11T22:19:22.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.161 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725549 s, 145 MB/s 2024-09-11T22:19:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690039 s, 152 MB/s 2024-09-11T22:19:22.180 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.180 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.180 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844224 s, 124 MB/s 2024-09-11T22:19:22.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.189 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681733 s, 154 MB/s 2024-09-11T22:19:22.198 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.198 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.198 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733238 s, 143 MB/s 2024-09-11T22:19:22.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.207 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747553 s, 140 MB/s 2024-09-11T22:19:22.217 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.217 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.217 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836423 s, 125 MB/s 2024-09-11T22:19:22.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.225 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671515 s, 156 MB/s 2024-09-11T22:19:22.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.234 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072633 s, 144 MB/s 2024-09-11T22:19:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069401 s, 151 MB/s 2024-09-11T22:19:22.251 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.251 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.251 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650522 s, 161 MB/s 2024-09-11T22:19:22.260 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.260 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.260 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750689 s, 140 MB/s 2024-09-11T22:19:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744602 s, 141 MB/s 2024-09-11T22:19:22.279 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.279 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.279 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765911 s, 137 MB/s 2024-09-11T22:19:22.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.289 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836781 s, 125 MB/s 2024-09-11T22:19:22.298 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.298 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.298 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722471 s, 145 MB/s 2024-09-11T22:19:22.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.307 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721823 s, 145 MB/s 2024-09-11T22:19:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674628 s, 155 MB/s 2024-09-11T22:19:22.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:22.322 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:22.322 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:22.322 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.19 2024-09-11T22:19:22.322 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:22.322 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:22.322 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:22.322 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:22.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.381 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063541 s, 165 MB/s 2024-09-11T22:19:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781015 s, 134 MB/s 2024-09-11T22:19:22.400 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.400 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.401 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779789 s, 134 MB/s 2024-09-11T22:19:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630832 s, 166 MB/s 2024-09-11T22:19:22.417 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.417 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.417 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709518 s, 148 MB/s 2024-09-11T22:19:22.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.425 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662903 s, 158 MB/s 2024-09-11T22:19:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721989 s, 145 MB/s 2024-09-11T22:19:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715327 s, 147 MB/s 2024-09-11T22:19:22.452 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.452 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.452 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733105 s, 143 MB/s 2024-09-11T22:19:22.461 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.461 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.461 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724987 s, 145 MB/s 2024-09-11T22:19:22.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.469 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696253 s, 151 MB/s 2024-09-11T22:19:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697952 s, 150 MB/s 2024-09-11T22:19:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719576 s, 146 MB/s 2024-09-11T22:19:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740045 s, 142 MB/s 2024-09-11T22:19:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704646 s, 149 MB/s 2024-09-11T22:19:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616209 s, 170 MB/s 2024-09-11T22:19:22.521 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766893 s, 137 MB/s 2024-09-11T22:19:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714294 s, 147 MB/s 2024-09-11T22:19:22.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.540 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734498 s, 143 MB/s 2024-09-11T22:19:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702419 s, 149 MB/s 2024-09-11T22:19:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063024 s, 166 MB/s 2024-09-11T22:19:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698484 s, 150 MB/s 2024-09-11T22:19:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650938 s, 161 MB/s 2024-09-11T22:19:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767532 s, 137 MB/s 2024-09-11T22:19:22.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.591 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654316 s, 160 MB/s 2024-09-11T22:19:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833636 s, 126 MB/s 2024-09-11T22:19:22.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.609 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720861 s, 145 MB/s 2024-09-11T22:19:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750065 s, 140 MB/s 2024-09-11T22:19:22.628 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.628 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.628 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766574 s, 137 MB/s 2024-09-11T22:19:22.636 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.636 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.636 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654563 s, 160 MB/s 2024-09-11T22:19:22.645 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.645 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.645 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726539 s, 144 MB/s 2024-09-11T22:19:22.654 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.657 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.657 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699311 s, 150 MB/s 2024-09-11T22:19:22.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:22.660 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:22.661 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:22.661 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.20 2024-09-11T22:19:22.661 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:22.661 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:22.661 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:22.661 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:22.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.721 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674864 s, 155 MB/s 2024-09-11T22:19:22.730 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.730 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.730 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653423 s, 160 MB/s 2024-09-11T22:19:22.739 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.739 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.739 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743588 s, 141 MB/s 2024-09-11T22:19:22.747 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.747 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.748 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717295 s, 146 MB/s 2024-09-11T22:19:22.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.756 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663455 s, 158 MB/s 2024-09-11T22:19:22.764 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.765 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.765 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692345 s, 151 MB/s 2024-09-11T22:19:22.774 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.774 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.774 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745596 s, 141 MB/s 2024-09-11T22:19:22.782 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.783 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705284 s, 149 MB/s 2024-09-11T22:19:22.792 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.792 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.792 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734341 s, 143 MB/s 2024-09-11T22:19:22.800 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.800 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.800 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676526 s, 155 MB/s 2024-09-11T22:19:22.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.811 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724267 s, 145 MB/s 2024-09-11T22:19:22.818 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.818 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.818 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762988 s, 137 MB/s 2024-09-11T22:19:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641516 s, 163 MB/s 2024-09-11T22:19:22.835 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.835 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.835 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717075 s, 146 MB/s 2024-09-11T22:19:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701802 s, 149 MB/s 2024-09-11T22:19:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751915 s, 139 MB/s 2024-09-11T22:19:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744858 s, 141 MB/s 2024-09-11T22:19:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623037 s, 168 MB/s 2024-09-11T22:19:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.879 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685163 s, 153 MB/s 2024-09-11T22:19:22.888 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.888 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.888 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729921 s, 144 MB/s 2024-09-11T22:19:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637509 s, 164 MB/s 2024-09-11T22:19:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708271 s, 148 MB/s 2024-09-11T22:19:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619661 s, 169 MB/s 2024-09-11T22:19:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735712 s, 143 MB/s 2024-09-11T22:19:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855422 s, 123 MB/s 2024-09-11T22:19:22.940 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.941 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.941 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761714 s, 138 MB/s 2024-09-11T22:19:22.949 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.949 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.949 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647402 s, 162 MB/s 2024-09-11T22:19:22.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.957 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715186 s, 147 MB/s 2024-09-11T22:19:22.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.966 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681239 s, 154 MB/s 2024-09-11T22:19:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732962 s, 143 MB/s 2024-09-11T22:19:22.985 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.985 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.985 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750249 s, 140 MB/s 2024-09-11T22:19:22.993 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:22.993 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:22.993 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724556 s, 145 MB/s 2024-09-11T22:19:22.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:23.000 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:23.000 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:23.000 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.21 2024-09-11T22:19:23.000 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:23.000 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:23.000 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:23.000 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:23.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.060 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.060 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066331 s, 158 MB/s 2024-09-11T22:19:23.068 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.068 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.068 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710879 s, 148 MB/s 2024-09-11T22:19:23.077 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.077 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.077 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069201 s, 152 MB/s 2024-09-11T22:19:23.086 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.086 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.086 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749676 s, 140 MB/s 2024-09-11T22:19:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737636 s, 142 MB/s 2024-09-11T22:19:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629189 s, 167 MB/s 2024-09-11T22:19:23.112 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.112 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.112 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728584 s, 144 MB/s 2024-09-11T22:19:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674306 s, 156 MB/s 2024-09-11T22:19:23.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.129 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686788 s, 153 MB/s 2024-09-11T22:19:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656943 s, 160 MB/s 2024-09-11T22:19:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651673 s, 161 MB/s 2024-09-11T22:19:23.154 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.154 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.154 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726739 s, 144 MB/s 2024-09-11T22:19:23.163 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.163 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.163 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715366 s, 147 MB/s 2024-09-11T22:19:23.172 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.172 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.172 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073794 s, 142 MB/s 2024-09-11T22:19:23.181 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.181 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.181 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732594 s, 143 MB/s 2024-09-11T22:19:23.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.197 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145433 s, 72.1 MB/s 2024-09-11T22:19:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723681 s, 145 MB/s 2024-09-11T22:19:23.214 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.215 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688914 s, 152 MB/s 2024-09-11T22:19:23.224 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.224 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.224 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733733 s, 143 MB/s 2024-09-11T22:19:23.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.233 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.233 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712345 s, 147 MB/s 2024-09-11T22:19:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.242 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728339 s, 144 MB/s 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699019 s, 150 MB/s 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.259 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718135 s, 146 MB/s 2024-09-11T22:19:23.269 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.269 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.269 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770723 s, 136 MB/s 2024-09-11T22:19:23.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.277 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658223 s, 159 MB/s 2024-09-11T22:19:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.286 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733673 s, 143 MB/s 2024-09-11T22:19:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725101 s, 145 MB/s 2024-09-11T22:19:23.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.304 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632004 s, 166 MB/s 2024-09-11T22:19:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636139 s, 165 MB/s 2024-09-11T22:19:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771232 s, 136 MB/s 2024-09-11T22:19:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.330 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741727 s, 141 MB/s 2024-09-11T22:19:23.338 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735691 s, 143 MB/s 2024-09-11T22:19:23.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:23.345 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:23.345 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:23.345 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.22 2024-09-11T22:19:23.345 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:23.345 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:23.346 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:23.346 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:23.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:23.405 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.406 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690612 s, 152 MB/s 2024-09-11T22:19:23.414 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.415 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684392 s, 153 MB/s 2024-09-11T22:19:23.423 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.423 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.423 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727061 s, 144 MB/s 2024-09-11T22:19:23.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.432 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729853 s, 144 MB/s 2024-09-11T22:19:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716402 s, 146 MB/s 2024-09-11T22:19:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732023 s, 143 MB/s 2024-09-11T22:19:23.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.459 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.459 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679563 s, 154 MB/s 2024-09-11T22:19:23.467 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.467 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.467 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651038 s, 161 MB/s 2024-09-11T22:19:23.476 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.476 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.476 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068604 s, 153 MB/s 2024-09-11T22:19:23.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.485 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753988 s, 139 MB/s 2024-09-11T22:19:23.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.494 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793922 s, 132 MB/s 2024-09-11T22:19:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783298 s, 134 MB/s 2024-09-11T22:19:23.513 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.513 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.513 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750074 s, 140 MB/s 2024-09-11T22:19:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.522 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708768 s, 148 MB/s 2024-09-11T22:19:23.531 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.531 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.531 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751286 s, 140 MB/s 2024-09-11T22:19:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672981 s, 156 MB/s 2024-09-11T22:19:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714508 s, 147 MB/s 2024-09-11T22:19:23.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.558 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731387 s, 143 MB/s 2024-09-11T22:19:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718583 s, 146 MB/s 2024-09-11T22:19:23.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.577 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747235 s, 140 MB/s 2024-09-11T22:19:23.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.586 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728944 s, 144 MB/s 2024-09-11T22:19:23.596 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.596 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.596 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799105 s, 131 MB/s 2024-09-11T22:19:23.605 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.605 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.605 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742722 s, 141 MB/s 2024-09-11T22:19:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762286 s, 138 MB/s 2024-09-11T22:19:23.624 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.624 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.624 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804374 s, 130 MB/s 2024-09-11T22:19:23.633 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.633 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.633 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693229 s, 151 MB/s 2024-09-11T22:19:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764879 s, 137 MB/s 2024-09-11T22:19:23.651 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.651 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.651 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721765 s, 145 MB/s 2024-09-11T22:19:23.660 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.660 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.660 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718434 s, 146 MB/s 2024-09-11T22:19:23.669 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.669 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.669 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723961 s, 145 MB/s 2024-09-11T22:19:23.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.679 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751667 s, 140 MB/s 2024-09-11T22:19:23.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.688 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718391 s, 146 MB/s 2024-09-11T22:19:23.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:23.695 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:23.695 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:23.695 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.23 2024-09-11T22:19:23.695 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:23.695 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:23.695 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:23.695 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:23.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:23.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.757 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766057 s, 137 MB/s 2024-09-11T22:19:23.765 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.765 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.765 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643391 s, 163 MB/s 2024-09-11T22:19:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.774 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.774 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671669 s, 156 MB/s 2024-09-11T22:19:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742832 s, 141 MB/s 2024-09-11T22:19:23.792 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.792 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.792 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701612 s, 149 MB/s 2024-09-11T22:19:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691608 s, 152 MB/s 2024-09-11T22:19:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648099 s, 162 MB/s 2024-09-11T22:19:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753474 s, 139 MB/s 2024-09-11T22:19:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666893 s, 157 MB/s 2024-09-11T22:19:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064325 s, 163 MB/s 2024-09-11T22:19:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734655 s, 143 MB/s 2024-09-11T22:19:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737621 s, 142 MB/s 2024-09-11T22:19:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070782 s, 148 MB/s 2024-09-11T22:19:23.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.872 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066084 s, 159 MB/s 2024-09-11T22:19:23.880 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.880 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.880 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646503 s, 162 MB/s 2024-09-11T22:19:23.889 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.889 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.889 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718505 s, 146 MB/s 2024-09-11T22:19:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.898 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749862 s, 140 MB/s 2024-09-11T22:19:23.907 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.907 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.907 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720273 s, 146 MB/s 2024-09-11T22:19:23.915 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.916 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709423 s, 148 MB/s 2024-09-11T22:19:23.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.925 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743047 s, 141 MB/s 2024-09-11T22:19:23.933 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.934 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.934 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707791 s, 148 MB/s 2024-09-11T22:19:23.943 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.943 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.943 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803277 s, 131 MB/s 2024-09-11T22:19:23.952 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.953 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737741 s, 142 MB/s 2024-09-11T22:19:23.961 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.961 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.961 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691601 s, 152 MB/s 2024-09-11T22:19:23.970 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752922 s, 139 MB/s 2024-09-11T22:19:23.979 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.979 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.979 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069303 s, 151 MB/s 2024-09-11T22:19:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624645 s, 168 MB/s 2024-09-11T22:19:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666908 s, 157 MB/s 2024-09-11T22:19:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645394 s, 162 MB/s 2024-09-11T22:19:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726166 s, 144 MB/s 2024-09-11T22:19:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.021 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723202 s, 145 MB/s 2024-09-11T22:19:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739158 s, 142 MB/s 2024-09-11T22:19:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:24.037 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:24.037 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:24.037 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.24 2024-09-11T22:19:24.037 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:24.037 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:24.037 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:24.037 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:24.097 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.097 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.098 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072299 s, 145 MB/s 2024-09-11T22:19:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771717 s, 136 MB/s 2024-09-11T22:19:24.115 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.115 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.115 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661799 s, 158 MB/s 2024-09-11T22:19:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.124 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747951 s, 140 MB/s 2024-09-11T22:19:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752341 s, 139 MB/s 2024-09-11T22:19:24.142 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.142 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.142 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692261 s, 151 MB/s 2024-09-11T22:19:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.151 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684749 s, 153 MB/s 2024-09-11T22:19:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075416 s, 139 MB/s 2024-09-11T22:19:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751931 s, 139 MB/s 2024-09-11T22:19:24.178 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.178 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.178 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739175 s, 142 MB/s 2024-09-11T22:19:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.188 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754228 s, 139 MB/s 2024-09-11T22:19:24.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.197 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741579 s, 141 MB/s 2024-09-11T22:19:24.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.206 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732178 s, 143 MB/s 2024-09-11T22:19:24.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.216 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.216 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00820798 s, 128 MB/s 2024-09-11T22:19:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.224 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653824 s, 160 MB/s 2024-09-11T22:19:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.232 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652681 s, 161 MB/s 2024-09-11T22:19:24.241 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.241 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.241 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728107 s, 144 MB/s 2024-09-11T22:19:24.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.250 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719059 s, 146 MB/s 2024-09-11T22:19:24.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.259 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727565 s, 144 MB/s 2024-09-11T22:19:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741811 s, 141 MB/s 2024-09-11T22:19:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738783 s, 142 MB/s 2024-09-11T22:19:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653829 s, 160 MB/s 2024-09-11T22:19:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847542 s, 124 MB/s 2024-09-11T22:19:24.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.304 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732972 s, 143 MB/s 2024-09-11T22:19:24.313 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.313 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.313 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723456 s, 145 MB/s 2024-09-11T22:19:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698469 s, 150 MB/s 2024-09-11T22:19:24.331 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.331 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.331 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720889 s, 145 MB/s 2024-09-11T22:19:24.339 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.339 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.339 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657289 s, 160 MB/s 2024-09-11T22:19:24.348 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.348 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.348 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734703 s, 143 MB/s 2024-09-11T22:19:24.357 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.357 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.357 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721486 s, 145 MB/s 2024-09-11T22:19:24.366 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.366 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.366 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760131 s, 138 MB/s 2024-09-11T22:19:24.375 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.375 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.375 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738023 s, 142 MB/s 2024-09-11T22:19:24.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:24.382 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:24.382 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:24.382 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.25 2024-09-11T22:19:24.382 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:24.382 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:24.383 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:24.383 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:24.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736284 s, 142 MB/s 2024-09-11T22:19:24.452 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.452 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.452 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669614 s, 157 MB/s 2024-09-11T22:19:24.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.460 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720378 s, 146 MB/s 2024-09-11T22:19:24.470 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.470 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.470 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836294 s, 125 MB/s 2024-09-11T22:19:24.479 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.479 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.479 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717708 s, 146 MB/s 2024-09-11T22:19:24.488 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.488 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.488 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072375 s, 145 MB/s 2024-09-11T22:19:24.497 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.497 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.497 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708171 s, 148 MB/s 2024-09-11T22:19:24.506 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.506 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.506 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714825 s, 147 MB/s 2024-09-11T22:19:24.516 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.516 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.516 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862675 s, 122 MB/s 2024-09-11T22:19:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076071 s, 138 MB/s 2024-09-11T22:19:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727783 s, 144 MB/s 2024-09-11T22:19:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753219 s, 139 MB/s 2024-09-11T22:19:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711627 s, 147 MB/s 2024-09-11T22:19:24.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705392 s, 149 MB/s 2024-09-11T22:19:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844583 s, 124 MB/s 2024-09-11T22:19:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.581 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643055 s, 163 MB/s 2024-09-11T22:19:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758318 s, 138 MB/s 2024-09-11T22:19:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720595 s, 146 MB/s 2024-09-11T22:19:24.607 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.607 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.607 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735143 s, 143 MB/s 2024-09-11T22:19:24.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.617 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691378 s, 152 MB/s 2024-09-11T22:19:24.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.625 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728489 s, 144 MB/s 2024-09-11T22:19:24.633 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.634 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.634 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071614 s, 146 MB/s 2024-09-11T22:19:24.642 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.643 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.643 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723602 s, 145 MB/s 2024-09-11T22:19:24.650 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.651 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.651 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629266 s, 167 MB/s 2024-09-11T22:19:24.660 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.660 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.660 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755361 s, 139 MB/s 2024-09-11T22:19:24.669 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.669 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.669 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729859 s, 144 MB/s 2024-09-11T22:19:24.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.677 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066761 s, 157 MB/s 2024-09-11T22:19:24.687 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.687 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.687 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00807146 s, 130 MB/s 2024-09-11T22:19:24.696 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.696 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.696 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679486 s, 154 MB/s 2024-09-11T22:19:24.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.705 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750147 s, 140 MB/s 2024-09-11T22:19:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.714 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745518 s, 141 MB/s 2024-09-11T22:19:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701433 s, 149 MB/s 2024-09-11T22:19:24.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:24.729 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:24.730 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:24.730 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.26 2024-09-11T22:19:24.730 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:24.730 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:24.730 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:24.730 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:24.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737374 s, 142 MB/s 2024-09-11T22:19:24.799 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.799 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.799 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754759 s, 139 MB/s 2024-09-11T22:19:24.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.809 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074046 s, 142 MB/s 2024-09-11T22:19:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.817 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670802 s, 156 MB/s 2024-09-11T22:19:24.825 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.825 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.825 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660471 s, 159 MB/s 2024-09-11T22:19:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065801 s, 159 MB/s 2024-09-11T22:19:24.841 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.841 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.841 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666567 s, 157 MB/s 2024-09-11T22:19:24.849 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.849 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.849 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643021 s, 163 MB/s 2024-09-11T22:19:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747359 s, 140 MB/s 2024-09-11T22:19:24.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.867 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706866 s, 148 MB/s 2024-09-11T22:19:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745218 s, 141 MB/s 2024-09-11T22:19:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.885 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725693 s, 144 MB/s 2024-09-11T22:19:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067422 s, 156 MB/s 2024-09-11T22:19:24.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.902 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610212 s, 172 MB/s 2024-09-11T22:19:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.910 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064883 s, 162 MB/s 2024-09-11T22:19:24.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.918 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613127 s, 171 MB/s 2024-09-11T22:19:24.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.927 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074199 s, 141 MB/s 2024-09-11T22:19:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748697 s, 140 MB/s 2024-09-11T22:19:24.944 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.944 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.945 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640202 s, 164 MB/s 2024-09-11T22:19:24.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.953 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642584 s, 163 MB/s 2024-09-11T22:19:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.962 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735146 s, 143 MB/s 2024-09-11T22:19:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731693 s, 143 MB/s 2024-09-11T22:19:24.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.980 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074838 s, 140 MB/s 2024-09-11T22:19:24.989 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.989 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.990 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696524 s, 151 MB/s 2024-09-11T22:19:24.999 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:24.999 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:24.999 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753932 s, 139 MB/s 2024-09-11T22:19:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707556 s, 148 MB/s 2024-09-11T22:19:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.018 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727652 s, 144 MB/s 2024-09-11T22:19:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732344 s, 143 MB/s 2024-09-11T22:19:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073385 s, 143 MB/s 2024-09-11T22:19:25.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.045 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065914 s, 159 MB/s 2024-09-11T22:19:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007337 s, 143 MB/s 2024-09-11T22:19:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649642 s, 161 MB/s 2024-09-11T22:19:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:25.070 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:25.070 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:25.070 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.27 2024-09-11T22:19:25.070 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:25.070 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:25.070 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:25.070 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:25.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:25.131 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.131 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.131 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074794 s, 140 MB/s 2024-09-11T22:19:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.140 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645257 s, 163 MB/s 2024-09-11T22:19:25.149 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.149 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.149 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741889 s, 141 MB/s 2024-09-11T22:19:25.158 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.159 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.159 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742394 s, 141 MB/s 2024-09-11T22:19:25.167 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.167 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.167 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656029 s, 160 MB/s 2024-09-11T22:19:25.176 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.176 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.176 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071538 s, 147 MB/s 2024-09-11T22:19:25.186 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.186 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.186 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754583 s, 139 MB/s 2024-09-11T22:19:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715483 s, 147 MB/s 2024-09-11T22:19:25.205 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.205 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.205 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722273 s, 145 MB/s 2024-09-11T22:19:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616958 s, 170 MB/s 2024-09-11T22:19:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.222 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746848 s, 140 MB/s 2024-09-11T22:19:25.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.232 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738487 s, 142 MB/s 2024-09-11T22:19:25.241 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.241 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.241 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704966 s, 149 MB/s 2024-09-11T22:19:25.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.250 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066656 s, 157 MB/s 2024-09-11T22:19:25.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.259 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670906 s, 156 MB/s 2024-09-11T22:19:25.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.268 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750475 s, 140 MB/s 2024-09-11T22:19:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691069 s, 152 MB/s 2024-09-11T22:19:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657608 s, 159 MB/s 2024-09-11T22:19:25.294 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.294 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.294 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716525 s, 146 MB/s 2024-09-11T22:19:25.303 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.303 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.303 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723526 s, 145 MB/s 2024-09-11T22:19:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.313 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.313 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708172 s, 148 MB/s 2024-09-11T22:19:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747283 s, 140 MB/s 2024-09-11T22:19:25.331 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.331 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.331 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793881 s, 132 MB/s 2024-09-11T22:19:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774801 s, 135 MB/s 2024-09-11T22:19:25.351 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.351 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.351 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00802607 s, 131 MB/s 2024-09-11T22:19:25.359 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.359 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.359 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690188 s, 152 MB/s 2024-09-11T22:19:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.368 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725405 s, 145 MB/s 2024-09-11T22:19:25.377 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.377 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.377 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719373 s, 146 MB/s 2024-09-11T22:19:25.386 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.386 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.386 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700979 s, 150 MB/s 2024-09-11T22:19:25.394 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.394 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.394 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664844 s, 158 MB/s 2024-09-11T22:19:25.403 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.403 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.403 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731687 s, 143 MB/s 2024-09-11T22:19:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.411 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646855 s, 162 MB/s 2024-09-11T22:19:25.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:25.418 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:25.418 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:25.418 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.28 2024-09-11T22:19:25.418 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:25.418 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:25.418 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:25.418 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:25.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:25.480 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.480 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.480 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862295 s, 122 MB/s 2024-09-11T22:19:25.489 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.489 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.489 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704525 s, 149 MB/s 2024-09-11T22:19:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918372 s, 114 MB/s 2024-09-11T22:19:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106977 s, 98.0 MB/s 2024-09-11T22:19:25.525 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.525 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.525 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102456 s, 102 MB/s 2024-09-11T22:19:25.534 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.534 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.534 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714908 s, 147 MB/s 2024-09-11T22:19:25.544 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.544 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.544 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828762 s, 127 MB/s 2024-09-11T22:19:25.553 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.553 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.553 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722134 s, 145 MB/s 2024-09-11T22:19:25.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.562 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730931 s, 143 MB/s 2024-09-11T22:19:25.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.572 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773649 s, 136 MB/s 2024-09-11T22:19:25.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.582 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759142 s, 138 MB/s 2024-09-11T22:19:25.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.591 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074284 s, 141 MB/s 2024-09-11T22:19:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983931 s, 107 MB/s 2024-09-11T22:19:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797529 s, 131 MB/s 2024-09-11T22:19:25.621 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.621 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.621 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006808 s, 154 MB/s 2024-09-11T22:19:25.629 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.630 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.630 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620871 s, 169 MB/s 2024-09-11T22:19:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706626 s, 148 MB/s 2024-09-11T22:19:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711472 s, 147 MB/s 2024-09-11T22:19:25.657 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.657 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.657 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827518 s, 127 MB/s 2024-09-11T22:19:25.666 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.666 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.666 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731343 s, 143 MB/s 2024-09-11T22:19:25.676 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.676 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.676 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786809 s, 133 MB/s 2024-09-11T22:19:25.684 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.684 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689869 s, 152 MB/s 2024-09-11T22:19:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708654 s, 148 MB/s 2024-09-11T22:19:25.701 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.701 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.701 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640514 s, 164 MB/s 2024-09-11T22:19:25.709 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.710 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.710 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665412 s, 158 MB/s 2024-09-11T22:19:25.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.718 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734048 s, 143 MB/s 2024-09-11T22:19:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718557 s, 146 MB/s 2024-09-11T22:19:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712002 s, 147 MB/s 2024-09-11T22:19:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659217 s, 159 MB/s 2024-09-11T22:19:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.754 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740431 s, 142 MB/s 2024-09-11T22:19:25.762 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.763 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.763 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735093 s, 143 MB/s 2024-09-11T22:19:25.772 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.772 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.772 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743827 s, 141 MB/s 2024-09-11T22:19:25.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:25.779 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:25.779 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:25.779 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.29 2024-09-11T22:19:25.779 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:25.779 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:25.779 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:25.779 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673612 s, 156 MB/s 2024-09-11T22:19:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778133 s, 135 MB/s 2024-09-11T22:19:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659994 s, 159 MB/s 2024-09-11T22:19:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073918 s, 142 MB/s 2024-09-11T22:19:25.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.875 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758666 s, 138 MB/s 2024-09-11T22:19:25.882 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635651 s, 165 MB/s 2024-09-11T22:19:25.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.891 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663872 s, 158 MB/s 2024-09-11T22:19:25.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.900 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068879 s, 152 MB/s 2024-09-11T22:19:25.909 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.909 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.909 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789912 s, 133 MB/s 2024-09-11T22:19:25.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.919 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726375 s, 144 MB/s 2024-09-11T22:19:25.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.928 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766421 s, 137 MB/s 2024-09-11T22:19:25.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.937 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072616 s, 144 MB/s 2024-09-11T22:19:25.946 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.946 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.946 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730956 s, 143 MB/s 2024-09-11T22:19:25.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.955 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.955 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718159 s, 146 MB/s 2024-09-11T22:19:25.963 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.963 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.964 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071927 s, 146 MB/s 2024-09-11T22:19:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720744 s, 145 MB/s 2024-09-11T22:19:25.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.981 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717932 s, 146 MB/s 2024-09-11T22:19:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:25.990 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704367 s, 149 MB/s 2024-09-11T22:19:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879257 s, 119 MB/s 2024-09-11T22:19:26.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.009 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678866 s, 154 MB/s 2024-09-11T22:19:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.017 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.018 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716971 s, 146 MB/s 2024-09-11T22:19:26.026 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.026 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.027 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071994 s, 146 MB/s 2024-09-11T22:19:26.035 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.036 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751156 s, 140 MB/s 2024-09-11T22:19:26.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.045 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737464 s, 142 MB/s 2024-09-11T22:19:26.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.055 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087233 s, 120 MB/s 2024-09-11T22:19:26.064 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.065 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761239 s, 138 MB/s 2024-09-11T22:19:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719553 s, 146 MB/s 2024-09-11T22:19:26.082 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.082 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.082 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720327 s, 146 MB/s 2024-09-11T22:19:26.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.090 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630033 s, 166 MB/s 2024-09-11T22:19:26.098 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.098 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.098 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657889 s, 159 MB/s 2024-09-11T22:19:26.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.108 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692783 s, 151 MB/s 2024-09-11T22:19:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735674 s, 143 MB/s 2024-09-11T22:19:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:26.122 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:26.123 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:26.123 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.30 2024-09-11T22:19:26.123 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:26.123 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:26.123 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:26.123 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689105 s, 152 MB/s 2024-09-11T22:19:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.191 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636201 s, 165 MB/s 2024-09-11T22:19:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684715 s, 153 MB/s 2024-09-11T22:19:26.209 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.209 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.209 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769334 s, 136 MB/s 2024-09-11T22:19:26.217 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.217 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.217 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698885 s, 150 MB/s 2024-09-11T22:19:26.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.226 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.226 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063934 s, 164 MB/s 2024-09-11T22:19:26.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.235 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.235 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723228 s, 145 MB/s 2024-09-11T22:19:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690415 s, 152 MB/s 2024-09-11T22:19:26.252 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.252 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.252 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715001 s, 147 MB/s 2024-09-11T22:19:26.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.262 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792994 s, 132 MB/s 2024-09-11T22:19:26.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.271 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728212 s, 144 MB/s 2024-09-11T22:19:26.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.280 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752507 s, 139 MB/s 2024-09-11T22:19:26.288 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.289 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715775 s, 146 MB/s 2024-09-11T22:19:26.298 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.298 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.299 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788009 s, 133 MB/s 2024-09-11T22:19:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.306 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645159 s, 163 MB/s 2024-09-11T22:19:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697155 s, 150 MB/s 2024-09-11T22:19:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745834 s, 141 MB/s 2024-09-11T22:19:26.333 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.333 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.333 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689204 s, 152 MB/s 2024-09-11T22:19:26.342 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.342 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.342 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722248 s, 145 MB/s 2024-09-11T22:19:26.351 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.351 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.351 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768016 s, 137 MB/s 2024-09-11T22:19:26.361 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.361 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.361 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853414 s, 123 MB/s 2024-09-11T22:19:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073518 s, 143 MB/s 2024-09-11T22:19:26.378 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.378 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.378 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626286 s, 167 MB/s 2024-09-11T22:19:26.387 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.387 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.387 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739176 s, 142 MB/s 2024-09-11T22:19:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646264 s, 162 MB/s 2024-09-11T22:19:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755124 s, 139 MB/s 2024-09-11T22:19:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645065 s, 163 MB/s 2024-09-11T22:19:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689825 s, 152 MB/s 2024-09-11T22:19:26.430 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.430 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.430 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730482 s, 144 MB/s 2024-09-11T22:19:26.439 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.439 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.439 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718505 s, 146 MB/s 2024-09-11T22:19:26.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.448 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724313 s, 145 MB/s 2024-09-11T22:19:26.457 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.457 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.457 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721967 s, 145 MB/s 2024-09-11T22:19:26.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:26.463 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:19:26.463 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:19:26.464 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.31 2024-09-11T22:19:26.464 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:19:26.464 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:19:26.464 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:19:26.464 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:19:26.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:19:26.524 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.524 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.524 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732918 s, 143 MB/s 2024-09-11T22:19:26.532 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.533 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.533 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071022 s, 148 MB/s 2024-09-11T22:19:26.542 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.543 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00818859 s, 128 MB/s 2024-09-11T22:19:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068582 s, 153 MB/s 2024-09-11T22:19:26.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637009 s, 165 MB/s 2024-09-11T22:19:26.568 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.568 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.568 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741172 s, 141 MB/s 2024-09-11T22:19:26.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.577 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736697 s, 142 MB/s 2024-09-11T22:19:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715327 s, 147 MB/s 2024-09-11T22:19:26.594 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.594 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.594 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626032 s, 167 MB/s 2024-09-11T22:19:26.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.603 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738821 s, 142 MB/s 2024-09-11T22:19:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738697 s, 142 MB/s 2024-09-11T22:19:26.620 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.620 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.620 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640776 s, 164 MB/s 2024-09-11T22:19:26.629 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.629 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.629 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695097 s, 151 MB/s 2024-09-11T22:19:26.638 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.638 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.638 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718463 s, 146 MB/s 2024-09-11T22:19:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.647 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713564 s, 147 MB/s 2024-09-11T22:19:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700482 s, 150 MB/s 2024-09-11T22:19:26.664 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.664 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.665 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724764 s, 145 MB/s 2024-09-11T22:19:26.673 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.673 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.673 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066163 s, 158 MB/s 2024-09-11T22:19:26.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.681 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676678 s, 155 MB/s 2024-09-11T22:19:26.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.690 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651055 s, 161 MB/s 2024-09-11T22:19:26.698 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.698 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.699 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735904 s, 142 MB/s 2024-09-11T22:19:26.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.707 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724499 s, 145 MB/s 2024-09-11T22:19:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.718 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804178 s, 130 MB/s 2024-09-11T22:19:26.726 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.726 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.726 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732969 s, 143 MB/s 2024-09-11T22:19:26.735 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.735 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.736 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708532 s, 148 MB/s 2024-09-11T22:19:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731783 s, 143 MB/s 2024-09-11T22:19:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.754 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766625 s, 137 MB/s 2024-09-11T22:19:26.761 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.762 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.762 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648957 s, 162 MB/s 2024-09-11T22:19:26.770 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.770 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.771 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745246 s, 141 MB/s 2024-09-11T22:19:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.779 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.780 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725088 s, 145 MB/s 2024-09-11T22:19:26.788 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.789 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738936 s, 142 MB/s 2024-09-11T22:19:26.798 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:19:26.798 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:19:26.798 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728312 s, 144 MB/s 2024-09-11T22:19:26.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:19:26.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:26.805 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-09-11T22:19:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.911+0000 7fabd183c640 1 Processor -- start 2024-09-11T22:19:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.911+0000 7fabd183c640 1 -- start start 2024-09-11T22:19:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabd183c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fabcc161fa0 0x7fabcc0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabd183c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fabcc0cf610 0x7fabcc0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabd183c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabcc0cfbd0 con 0x7fabcc0b1600 2024-09-11T22:19:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabd183c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fabcc0d1220 con 0x7fabcc161fa0 2024-09-11T22:19:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabd183c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fabcc0d17e0 con 0x7fabcc0cf610 2024-09-11T22:19:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabcaffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fabcc161fa0 0x7fabcc0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabca7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fabcc0b1600 0x7fabcc0cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35332/0 (socket says 172.21.15.50:35332) 2024-09-11T22:19:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabca7fc640 1 -- 172.21.15.50:0/2344497620 learned_addr learned my addr 172.21.15.50:0/2344497620 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabcb7fe640 1 --2- 172.21.15.50:0/2344497620 >> v2:172.21.15.77:3300/0 conn(0x7fabcc0cf610 0x7fabcc0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabcaffd640 1 -- 172.21.15.50:0/2344497620 >> v2:172.21.15.77:3300/0 conn(0x7fabcc0cf610 msgr2=0x7fabcc0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabcaffd640 1 --2- 172.21.15.50:0/2344497620 >> v2:172.21.15.77:3300/0 conn(0x7fabcc0cf610 0x7fabcc0cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabcaffd640 1 -- 172.21.15.50:0/2344497620 >> v1:172.21.15.50:6789/0 conn(0x7fabcc0b1600 legacy=0x7fabcc0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabcaffd640 1 -- 172.21.15.50:0/2344497620 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabcc0cfeb0 con 0x7fabcc161fa0 2024-09-11T22:19:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.912+0000 7fabc9ffb640 1 -- 172.21.15.50:0/2344497620 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3621681581 0 0) 0x7fabcc0cfbd0 con 0x7fabcc0b1600 2024-09-11T22:19:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.913+0000 7fabcaffd640 1 --2- 172.21.15.50:0/2344497620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabcc161fa0 0x7fabcc0b4d20 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0b2010 tx=0x7fabbc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9da501e101de236 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.913+0000 7fabc9ffb640 1 -- 172.21.15.50:0/2344497620 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc037070 con 0x7fabcc161fa0 2024-09-11T22:19:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.913+0000 7fabc9ffb640 1 -- 172.21.15.50:0/2344497620 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabbc032440 con 0x7fabcc161fa0 2024-09-11T22:19:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.913+0000 7fabc9ffb640 1 -- 172.21.15.50:0/2344497620 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc032810 con 0x7fabcc161fa0 2024-09-11T22:19:26.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.914+0000 7fabd183c640 1 -- 172.21.15.50:0/2344497620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabcc161fa0 msgr2=0x7fabcc0b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:26.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.914+0000 7fabd183c640 1 --2- 172.21.15.50:0/2344497620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabcc161fa0 0x7fabcc0b4d20 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0b2010 tx=0x7fabbc02a1a0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.914+0000 7fabd183c640 1 -- 172.21.15.50:0/2344497620 shutdown_connections 2024-09-11T22:19:26.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.914+0000 7fabd183c640 1 --2- 172.21.15.50:0/2344497620 >> v2:172.21.15.77:3300/0 conn(0x7fabcc0cf610 0x7fabcc0cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.914+0000 7fabd183c640 1 --2- 172.21.15.50:0/2344497620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabcc161fa0 0x7fabcc0b4d20 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.914+0000 7fabd183c640 1 -- 172.21.15.50:0/2344497620 >> 172.21.15.50:0/2344497620 conn(0x7fabcc09ba50 msgr2=0x7fabcc0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.914+0000 7fabd183c640 1 -- 172.21.15.50:0/2344497620 shutdown_connections 2024-09-11T22:19:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.914+0000 7fabd183c640 1 -- 172.21.15.50:0/2344497620 wait complete. 2024-09-11T22:19:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.915+0000 7fabd183c640 1 Processor -- start 2024-09-11T22:19:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.915+0000 7fabd183c640 1 -- start start 2024-09-11T22:19:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.916+0000 7fabd183c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabcc0b1600 0x7fabcc15b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.916+0000 7fabd183c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabcc0cf610 0x7fabcc160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.916+0000 7fabd183c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabcc161fa0 0x7fabcc15d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.916+0000 7fabd183c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc162500 con 0x7fabcc161fa0 2024-09-11T22:19:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.916+0000 7fabd183c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc162380 con 0x7fabcc0b1600 2024-09-11T22:19:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.916+0000 7fabd183c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fabcc0d1c70 con 0x7fabcc0cf610 2024-09-11T22:19:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.916+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabcc161fa0 0x7fabcc15d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.916+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabcc161fa0 0x7fabcc15d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36870/0 (socket says 172.21.15.50:36870) 2024-09-11T22:19:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.916+0000 7fabcb7fe640 1 -- 172.21.15.50:0/290548392 learned_addr learned my addr 172.21.15.50:0/290548392 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.916+0000 7fabcaffd640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabcc0b1600 0x7fabcc15b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.916+0000 7fabca7fc640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabcc0cf610 0x7fabcc160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.917+0000 7fabcb7fe640 1 -- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabcc0cf610 msgr2=0x7fabcc160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.917+0000 7fabcb7fe640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabcc0cf610 0x7fabcc160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.917+0000 7fabcb7fe640 1 -- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabcc0b1600 msgr2=0x7fabcc15b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.917+0000 7fabcb7fe640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabcc0b1600 0x7fabcc15b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.917+0000 7fabcb7fe640 1 -- 172.21.15.50:0/290548392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabcc1f4390 con 0x7fabcc161fa0 2024-09-11T22:19:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.917+0000 7fabcb7fe640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabcc161fa0 0x7fabcc15d9c0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fabc400efc0 tx=0x7fabc400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.917+0000 7fabb3fff640 1 -- 172.21.15.50:0/290548392 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4018020 con 0x7fabcc161fa0 2024-09-11T22:19:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.917+0000 7fabb3fff640 1 -- 172.21.15.50:0/290548392 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc4014480 con 0x7fabcc161fa0 2024-09-11T22:19:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.917+0000 7fabd183c640 1 -- 172.21.15.50:0/290548392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabcc1f4600 con 0x7fabcc161fa0 2024-09-11T22:19:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.917+0000 7fabb3fff640 1 -- 172.21.15.50:0/290548392 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4014870 con 0x7fabcc161fa0 2024-09-11T22:19:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.917+0000 7fabd183c640 1 -- 172.21.15.50:0/290548392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabcc1f4bc0 con 0x7fabcc161fa0 2024-09-11T22:19:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.918+0000 7fabb3fff640 1 -- 172.21.15.50:0/290548392 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fabc4005d10 con 0x7fabcc161fa0 2024-09-11T22:19:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.919+0000 7fabb3fff640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fabb806be30 0x7fabb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.919+0000 7fabb3fff640 1 -- 172.21.15.50:0/290548392 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fabc408bbd0 con 0x7fabcc161fa0 2024-09-11T22:19:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.919+0000 7fabcaffd640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fabb806be30 0x7fabb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.920+0000 7fabcaffd640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fabb806be30 0x7fabb806e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fabbc034000 tx=0x7fabbc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.920+0000 7fabd45d5740 1 Processor -- start 2024-09-11T22:19:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.920+0000 7fabd45d5740 1 -- start start 2024-09-11T22:19:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabd45d5740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f1ca70 0x5558f6f1ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabd45d5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f031f0 0x5558f6f01a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabd45d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f4d420 0x5558f6f4d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabd45d5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5558f6e6abc0 con 0x5558f6f031f0 2024-09-11T22:19:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabd45d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5558f6e12970 con 0x5558f6f4d420 2024-09-11T22:19:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabd45d5740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5558f6e66b80 con 0x5558f6f1ca70 2024-09-11T22:19:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabca7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f031f0 0x5558f6f01a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabcaffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f1ca70 0x5558f6f1ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f4d420 0x5558f6f4d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabca7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f031f0 0x5558f6f01a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36886/0 (socket says 172.21.15.50:36886) 2024-09-11T22:19:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabca7fc640 1 -- 172.21.15.50:0/2045913386 learned_addr learned my addr 172.21.15.50:0/2045913386 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabcaffd640 1 -- 172.21.15.50:0/2045913386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f4d420 msgr2=0x5558f6f4d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabcaffd640 1 --2- 172.21.15.50:0/2045913386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f4d420 0x5558f6f4d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabcaffd640 1 -- 172.21.15.50:0/2045913386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f031f0 msgr2=0x5558f6f01a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabcaffd640 1 --2- 172.21.15.50:0/2045913386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f031f0 0x5558f6f01a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabcaffd640 1 -- 172.21.15.50:0/2045913386 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f6c49ba0 con 0x5558f6f1ca70 2024-09-11T22:19:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabca7fc640 1 --2- 172.21.15.50:0/2045913386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f031f0 0x5558f6f01a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.921+0000 7fabcb7fe640 1 --2- 172.21.15.50:0/2045913386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f4d420 0x5558f6f4d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:26.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.922+0000 7fabcaffd640 1 --2- 172.21.15.50:0/2045913386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f1ca70 0x5558f6f1ce50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0728e0 tx=0x7fabbc02c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c53092f75b423b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.922+0000 7fabb17fa640 1 -- 172.21.15.50:0/2045913386 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc037040 con 0x5558f6f1ca70 2024-09-11T22:19:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.922+0000 7fabb17fa640 1 -- 172.21.15.50:0/2045913386 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabbc04d070 con 0x5558f6f1ca70 2024-09-11T22:19:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.922+0000 7fabb17fa640 1 -- 172.21.15.50:0/2045913386 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc03c440 con 0x5558f6f1ca70 2024-09-11T22:19:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.922+0000 7fabd45d5740 1 -- 172.21.15.50:0/2045913386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f1ca70 msgr2=0x5558f6f1ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.922+0000 7fabd45d5740 1 --2- 172.21.15.50:0/2045913386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f1ca70 0x5558f6f1ce50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0728e0 tx=0x7fabbc02c000 comp rx=0 tx=0).stop 2024-09-11T22:19:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.922+0000 7fabd45d5740 1 -- 172.21.15.50:0/2045913386 shutdown_connections 2024-09-11T22:19:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.922+0000 7fabd45d5740 1 --2- 172.21.15.50:0/2045913386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f4d420 0x5558f6f4d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.922+0000 7fabd45d5740 1 --2- 172.21.15.50:0/2045913386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f031f0 0x5558f6f01a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.922+0000 7fabd45d5740 1 --2- 172.21.15.50:0/2045913386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f1ca70 0x5558f6f1ce50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.922+0000 7fabd45d5740 1 -- 172.21.15.50:0/2045913386 >> 172.21.15.50:0/2045913386 conn(0x5558f6f03c20 msgr2=0x5558f6f4bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:26.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.923+0000 7fabd45d5740 1 -- 172.21.15.50:0/2045913386 shutdown_connections 2024-09-11T22:19:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.923+0000 7fabd45d5740 1 -- 172.21.15.50:0/2045913386 wait complete. 2024-09-11T22:19:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.923+0000 7fabd45d5740 1 -- start start 2024-09-11T22:19:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.923+0000 7fabd45d5740 1 Processor -- start 2024-09-11T22:19:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabd45d5740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f1ca70 0x5558f6f46380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabd45d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f4d420 0x5558f6f48940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabd45d5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f41b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabd45d5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5558f6f02150 con 0x5558f6f48e80 2024-09-11T22:19:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabd45d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5558f6e25d70 con 0x5558f6f4d420 2024-09-11T22:19:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabd45d5740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5558f6f02430 con 0x5558f6f1ca70 2024-09-11T22:19:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabd45d5740 10 client.0 _ll_register_callbacks cb 0x5558f6b7cf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:26.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f41b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f41b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36892/0 (socket says 172.21.15.50:36892) 2024-09-11T22:19:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabcb7fe640 1 -- 172.21.15.50:0/1884592031 learned_addr learned my addr 172.21.15.50:0/1884592031 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabca7fc640 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f4d420 0x5558f6f48940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabcaffd640 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f1ca70 0x5558f6f46380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabcb7fe640 1 -- 172.21.15.50:0/1884592031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f1ca70 msgr2=0x5558f6f46380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabcb7fe640 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f1ca70 0x5558f6f46380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabcb7fe640 1 -- 172.21.15.50:0/1884592031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f4d420 msgr2=0x5558f6f48940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabcb7fe640 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f4d420 0x5558f6f48940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabcb7fe640 1 -- 172.21.15.50:0/1884592031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558f6b3d490 con 0x5558f6f48e80 2024-09-11T22:19:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabcaffd640 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f1ca70 0x5558f6f46380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabca7fc640 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f4d420 0x5558f6f48940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabcb7fe640 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f41b10 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fabc4059b90 tx=0x7fabc405e310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68758567553df82a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.924+0000 7fabaa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:19:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabaa7fc640 1 -- 172.21.15.50:0/1884592031 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4087020 con 0x5558f6f48e80 2024-09-11T22:19:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabaa7fc640 1 -- 172.21.15.50:0/1884592031 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fabc40592e0 con 0x5558f6f48e80 2024-09-11T22:19:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabd45d5740 1 -- 172.21.15.50:0/1884592031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabbc04d070 con 0x5558f6f48e80 2024-09-11T22:19:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabaa7fc640 1 -- 172.21.15.50:0/1884592031 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7fabc4059520 con 0x5558f6f48e80 2024-09-11T22:19:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabd45d5740 10 client.8583 fetch_fsmap learned FSMap version 94 2024-09-11T22:19:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabd45d5740 1 -- 172.21.15.50:0/1884592031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x5558f6caa330 con 0x5558f6f48e80 2024-09-11T22:19:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabaa7fc640 1 -- 172.21.15.50:0/1884592031 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabbc04d070 con 0x5558f6f48e80 2024-09-11T22:19:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabaa7fc640 1 -- 172.21.15.50:0/1884592031 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7fabc407d080 con 0x5558f6f48e80 2024-09-11T22:19:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabd45d5740 10 client.8583 fetch_fsmap finished waiting for FSMap version 94 2024-09-11T22:19:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabd45d5740 10 client.8583 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-11T22:19:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabd45d5740 20 client.8583 populate_metadata read hostname 'smithi050' 2024-09-11T22:19:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabd45d5740 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x5558f6f5fae0 0x5558f6f5fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabd45d5740 4 client.8583 mds_command: new command op to 8412 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabd45d5740 1 -- 172.21.15.50:0/1884592031 --> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558f6defc80 con 0x5558f6f5fae0 2024-09-11T22:19:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabcaffd640 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x5558f6f5fae0 0x5558f6f5fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabaa7fc640 10 client.8583 ms_handle_connect on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.925+0000 7fabcaffd640 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x5558f6f5fae0 0x5558f6f5fef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0114b8ebeac847b server_cookie=9c5883d6fd0f8d10 in_seq=0 out_seq=0 2024-09-11T22:19:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabaa7fc640 1 -- 172.21.15.50:0/1884592031 <== mds.0 v2:172.21.15.50:6834/3438568728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558f6defc80 con 0x5558f6f5fae0 2024-09-11T22:19:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabaa7fc640 10 client.8583 handle_command_reply: tid=0 2024-09-11T22:19:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabd45d5740 1 client.8583 shutdown 2024-09-11T22:19:26.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabd45d5740 1 -- 172.21.15.50:0/1884592031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 msgr2=0x5558f6f41b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabd45d5740 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f41b10 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fabc4059b90 tx=0x7fabc405e310 comp rx=0 tx=0).stop 2024-09-11T22:19:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabd45d5740 1 -- 172.21.15.50:0/1884592031 shutdown_connections 2024-09-11T22:19:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabd45d5740 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x5558f6f5fae0 0x5558f6f5fef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabd45d5740 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f41b10 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabd45d5740 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f4d420 0x5558f6f48940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabd45d5740 1 --2- 172.21.15.50:0/1884592031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f1ca70 0x5558f6f46380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabaa7fc640 0 client.8583 ms_handle_reset on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabd45d5740 1 -- 172.21.15.50:0/1884592031 >> 172.21.15.50:0/1884592031 conn(0x5558f6f031f0 msgr2=0x5558f6f4f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:26.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabd45d5740 1 -- 172.21.15.50:0/1884592031 shutdown_connections 2024-09-11T22:19:26.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabd45d5740 1 -- 172.21.15.50:0/1884592031 wait complete. 2024-09-11T22:19:26.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.926+0000 7fabd45d5740 20 client.8583 trim_cache size 0 max 16384 2024-09-11T22:19:26.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.944+0000 7fabd45d5740 1 Processor -- start 2024-09-11T22:19:26.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.944+0000 7fabd45d5740 1 -- start start 2024-09-11T22:19:26.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabd45d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f1ca70 0x5558f6f4f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabd45d5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f70230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabd45d5740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f4d420 0x5558f6f70770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabd45d5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc200a80 con 0x5558f6f48e80 2024-09-11T22:19:26.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabd45d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc1ffc10 con 0x5558f6f1ca70 2024-09-11T22:19:26.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabd45d5740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fabcc15fc20 con 0x5558f6f4d420 2024-09-11T22:19:26.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabca7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f70230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabca7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f70230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36908/0 (socket says 172.21.15.50:36908) 2024-09-11T22:19:26.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabca7fc640 1 -- 172.21.15.50:0/25598948 learned_addr learned my addr 172.21.15.50:0/25598948 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:26.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabcaffd640 1 --2- 172.21.15.50:0/25598948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f1ca70 0x5558f6f4f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabcb7fe640 1 --2- 172.21.15.50:0/25598948 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f4d420 0x5558f6f70770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabca7fc640 1 -- 172.21.15.50:0/25598948 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f4d420 msgr2=0x5558f6f70770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabca7fc640 1 --2- 172.21.15.50:0/25598948 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f4d420 0x5558f6f70770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabca7fc640 1 -- 172.21.15.50:0/25598948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f1ca70 msgr2=0x5558f6f4f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabca7fc640 1 --2- 172.21.15.50:0/25598948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f1ca70 0x5558f6f4f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabca7fc640 1 -- 172.21.15.50:0/25598948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f6f43320 con 0x5558f6f48e80 2024-09-11T22:19:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabcaffd640 1 --2- 172.21.15.50:0/25598948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f1ca70 0x5558f6f4f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.945+0000 7fabca7fc640 1 --2- 172.21.15.50:0/25598948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f70230 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fabc00077c0 tx=0x7fabc0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4849cb33a8516822 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.946+0000 7fabb0ff9640 1 -- 172.21.15.50:0/25598948 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0004e50 con 0x5558f6f48e80 2024-09-11T22:19:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.946+0000 7fabb0ff9640 1 -- 172.21.15.50:0/25598948 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc001c020 con 0x5558f6f48e80 2024-09-11T22:19:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.946+0000 7fabb0ff9640 1 -- 172.21.15.50:0/25598948 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0015b40 con 0x5558f6f48e80 2024-09-11T22:19:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.946+0000 7fabd45d5740 1 -- 172.21.15.50:0/25598948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 msgr2=0x5558f6f70230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:26.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.946+0000 7fabd45d5740 1 --2- 172.21.15.50:0/25598948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f70230 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fabc00077c0 tx=0x7fabc0009040 comp rx=0 tx=0).stop 2024-09-11T22:19:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.946+0000 7fabd45d5740 1 -- 172.21.15.50:0/25598948 shutdown_connections 2024-09-11T22:19:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.946+0000 7fabd45d5740 1 --2- 172.21.15.50:0/25598948 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f4d420 0x5558f6f70770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.946+0000 7fabd45d5740 1 --2- 172.21.15.50:0/25598948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f70230 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.946+0000 7fabd45d5740 1 --2- 172.21.15.50:0/25598948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f1ca70 0x5558f6f4f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.946+0000 7fabd45d5740 1 -- 172.21.15.50:0/25598948 >> 172.21.15.50:0/25598948 conn(0x5558f6f031f0 msgr2=0x5558f6f426d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.946+0000 7fabd45d5740 1 -- 172.21.15.50:0/25598948 shutdown_connections 2024-09-11T22:19:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.946+0000 7fabd45d5740 1 -- 172.21.15.50:0/25598948 wait complete. 2024-09-11T22:19:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.947+0000 7fabd45d5740 1 -- start start 2024-09-11T22:19:26.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.947+0000 7fabd45d5740 1 Processor -- start 2024-09-11T22:19:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabd45d5740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f1ca70 0x5558f6fb0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabd45d5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f1b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabd45d5740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f4d420 0x5558f6f47ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabd45d5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc0ca3c0 con 0x5558f6f48e80 2024-09-11T22:19:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabd45d5740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5558f6f1b920 con 0x5558f6f1ca70 2024-09-11T22:19:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabd45d5740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5558f6f4ddc0 con 0x5558f6f4d420 2024-09-11T22:19:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabd45d5740 10 client.0 _ll_register_callbacks cb 0x7fabc40597f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabca7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f1b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabca7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f1b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36918/0 (socket says 172.21.15.50:36918) 2024-09-11T22:19:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabca7fc640 1 -- 172.21.15.50:0/3378780530 learned_addr learned my addr 172.21.15.50:0/3378780530 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabcaffd640 1 --2- 172.21.15.50:0/3378780530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f1ca70 0x5558f6fb0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabcb7fe640 1 --2- 172.21.15.50:0/3378780530 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f4d420 0x5558f6f47ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabca7fc640 1 -- 172.21.15.50:0/3378780530 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f4d420 msgr2=0x5558f6f47ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabca7fc640 1 --2- 172.21.15.50:0/3378780530 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f4d420 0x5558f6f47ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabca7fc640 1 -- 172.21.15.50:0/3378780530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f1ca70 msgr2=0x5558f6fb0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabca7fc640 1 --2- 172.21.15.50:0/3378780530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f1ca70 0x5558f6fb0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabca7fc640 1 -- 172.21.15.50:0/3378780530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558f6b16550 con 0x5558f6f48e80 2024-09-11T22:19:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabca7fc640 1 --2- 172.21.15.50:0/3378780530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f1b020 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fabc0007790 tx=0x7fabc0001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24aeec101d91e93 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabaa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:19:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabaa7fc640 1 -- 172.21.15.50:0/3378780530 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0025070 con 0x5558f6f48e80 2024-09-11T22:19:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabaa7fc640 1 -- 172.21.15.50:0/3378780530 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fabc0017940 con 0x5558f6f48e80 2024-09-11T22:19:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabd45d5740 1 -- 172.21.15.50:0/3378780530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabc001c020 con 0x5558f6f48e80 2024-09-11T22:19:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.948+0000 7fabaa7fc640 1 -- 172.21.15.50:0/3378780530 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7fabc0030050 con 0x5558f6f48e80 2024-09-11T22:19:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.949+0000 7fabd45d5740 10 client.8589 fetch_fsmap learned FSMap version 94 2024-09-11T22:19:26.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.949+0000 7fabd45d5740 1 -- 172.21.15.50:0/3378780530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x5558f6f1b660 con 0x5558f6f48e80 2024-09-11T22:19:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.949+0000 7fabaa7fc640 1 -- 172.21.15.50:0/3378780530 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc001c020 con 0x5558f6f48e80 2024-09-11T22:19:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.949+0000 7fabaa7fc640 1 -- 172.21.15.50:0/3378780530 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7fabc0033020 con 0x5558f6f48e80 2024-09-11T22:19:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.949+0000 7fabd45d5740 10 client.8589 fetch_fsmap finished waiting for FSMap version 94 2024-09-11T22:19:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.949+0000 7fabd45d5740 10 client.8589 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-11T22:19:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.949+0000 7fabd45d5740 20 client.8589 populate_metadata read hostname 'smithi050' 2024-09-11T22:19:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.949+0000 7fabd45d5740 1 --2- 172.21.15.50:0/3378780530 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x5558f6f07600 0x5558f6f079e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.949+0000 7fabd45d5740 4 client.8589 mds_command: new command op to 8412 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-11T22:19:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.949+0000 7fabd45d5740 1 -- 172.21.15.50:0/3378780530 --> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x5558f6f33250 con 0x5558f6f07600 2024-09-11T22:19:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.949+0000 7fabcaffd640 1 --2- 172.21.15.50:0/3378780530 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x5558f6f07600 0x5558f6f079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.949+0000 7fabcaffd640 1 --2- 172.21.15.50:0/3378780530 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x5558f6f07600 0x5558f6f079e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39da01bac7e7efb2 server_cookie=e6f2cec08200042d in_seq=0 out_seq=0 2024-09-11T22:19:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.949+0000 7fabaa7fc640 10 client.8589 ms_handle_connect on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.951+0000 7fabaa7fc640 1 -- 172.21.15.50:0/3378780530 <== mds.0 v2:172.21.15.50:6834/3438568728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5558f6f33250 con 0x5558f6f07600 2024-09-11T22:19:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.951+0000 7fabaa7fc640 10 client.8589 handle_command_reply: tid=0 2024-09-11T22:19:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.951+0000 7fabd45d5740 1 client.8589 shutdown 2024-09-11T22:19:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd45d5740 1 -- 172.21.15.50:0/3378780530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 msgr2=0x5558f6f1b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd45d5740 1 --2- 172.21.15.50:0/3378780530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f1b020 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fabc0007790 tx=0x7fabc0001080 comp rx=0 tx=0).stop 2024-09-11T22:19:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd45d5740 1 -- 172.21.15.50:0/3378780530 shutdown_connections 2024-09-11T22:19:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd45d5740 1 --2- 172.21.15.50:0/3378780530 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x5558f6f07600 0x5558f6f079e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd45d5740 1 --2- 172.21.15.50:0/3378780530 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558f6f4d420 0x5558f6f47ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd45d5740 1 --2- 172.21.15.50:0/3378780530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5558f6f48e80 0x5558f6f1b020 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd45d5740 1 --2- 172.21.15.50:0/3378780530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558f6f1ca70 0x5558f6fb0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd45d5740 1 -- 172.21.15.50:0/3378780530 >> 172.21.15.50:0/3378780530 conn(0x5558f6f031f0 msgr2=0x5558f6f44c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabaa7fc640 0 client.8589 ms_handle_reset on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd45d5740 1 -- 172.21.15.50:0/3378780530 shutdown_connections 2024-09-11T22:19:26.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd45d5740 1 -- 172.21.15.50:0/3378780530 wait complete. 2024-09-11T22:19:26.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd45d5740 20 client.8589 trim_cache size 0 max 16384 2024-09-11T22:19:26.958 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:19:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:19:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "1a29dffb-4af7-4af5-8fc1-aacaf4ff0ebe", 2024-09-11T22:19:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:19:26.958 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:19:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd183c640 1 -- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fabb806be30 msgr2=0x7fabb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd183c640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fabb806be30 0x7fabb806e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fabbc034000 tx=0x7fabbc02e000 comp rx=0 tx=0).stop 2024-09-11T22:19:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd183c640 1 -- 172.21.15.50:0/290548392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabcc161fa0 msgr2=0x7fabcc15d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.952+0000 7fabd183c640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabcc161fa0 0x7fabcc15d9c0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fabc400efc0 tx=0x7fabc400c490 comp rx=0 tx=0).stop 2024-09-11T22:19:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.953+0000 7fabd183c640 1 -- 172.21.15.50:0/290548392 shutdown_connections 2024-09-11T22:19:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.953+0000 7fabd183c640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fabb806be30 0x7fabb806e2f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.953+0000 7fabd183c640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabcc0cf610 0x7fabcc160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.953+0000 7fabd183c640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabcc161fa0 0x7fabcc15d9c0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.953+0000 7fabd183c640 1 --2- 172.21.15.50:0/290548392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabcc0b1600 0x7fabcc15b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.953+0000 7fabd183c640 1 -- 172.21.15.50:0/290548392 >> 172.21.15.50:0/290548392 conn(0x7fabcc09ba50 msgr2=0x7fabcc06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.953+0000 7fabd183c640 1 -- 172.21.15.50:0/290548392 shutdown_connections 2024-09-11T22:19:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:26.953+0000 7fabd183c640 1 -- 172.21.15.50:0/290548392 wait complete. 2024-09-11T22:19:26.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:26.965 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub pause 2024-09-11T22:19:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.096+0000 7fc801faf640 1 Processor -- start 2024-09-11T22:19:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.096+0000 7fc801faf640 1 -- start start 2024-09-11T22:19:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc801faf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7fc161fa0 0x7fc7fc0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc801faf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7fc0cf610 0x7fc7fc0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc801faf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7fc0cfbd0 con 0x7fc7fc0b1600 2024-09-11T22:19:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc801faf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc7fc0d1220 con 0x7fc7fc0cf610 2024-09-11T22:19:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc801faf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc7fc0d17e0 con 0x7fc7fc161fa0 2024-09-11T22:19:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc7fbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7fc0cf610 0x7fc7fc0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc7fbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7fc0cf610 0x7fc7fc0cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36930/0 (socket says 172.21.15.50:36930) 2024-09-11T22:19:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc7f2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc7fc0b1600 0x7fc7fc0cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35346/0 (socket says 172.21.15.50:35346) 2024-09-11T22:19:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc7fbfff640 1 -- 172.21.15.50:0/2831769620 learned_addr learned my addr 172.21.15.50:0/2831769620 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/2831769620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7fc161fa0 0x7fc7fc0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc7fbfff640 1 -- 172.21.15.50:0/2831769620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7fc161fa0 msgr2=0x7fc7fc0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc7fbfff640 1 --2- 172.21.15.50:0/2831769620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7fc161fa0 0x7fc7fc0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc7fbfff640 1 -- 172.21.15.50:0/2831769620 >> v1:172.21.15.50:6789/0 conn(0x7fc7fc0b1600 legacy=0x7fc7fc0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc7fbfff640 1 -- 172.21.15.50:0/2831769620 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7fc0cfeb0 con 0x7fc7fc0cf610 2024-09-11T22:19:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.097+0000 7fc7faffd640 1 -- 172.21.15.50:0/2831769620 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 656683941 0 0) 0x7fc7fc0cfbd0 con 0x7fc7fc0b1600 2024-09-11T22:19:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.098+0000 7fc7fbfff640 1 --2- 172.21.15.50:0/2831769620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7fc0cf610 0x7fc7fc0cccd0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009e50 tx=0x7fc7f402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4fa9f77f027d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.098+0000 7fc7faffd640 1 -- 172.21.15.50:0/2831769620 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4036070 con 0x7fc7fc0cf610 2024-09-11T22:19:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.098+0000 7fc7faffd640 1 -- 172.21.15.50:0/2831769620 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f4031600 con 0x7fc7fc0cf610 2024-09-11T22:19:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.098+0000 7fc7faffd640 1 -- 172.21.15.50:0/2831769620 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40319d0 con 0x7fc7fc0cf610 2024-09-11T22:19:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.099+0000 7fc801faf640 1 -- 172.21.15.50:0/2831769620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7fc0cf610 msgr2=0x7fc7fc0cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.099+0000 7fc801faf640 1 --2- 172.21.15.50:0/2831769620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7fc0cf610 0x7fc7fc0cccd0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009e50 tx=0x7fc7f402a710 comp rx=0 tx=0).stop 2024-09-11T22:19:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.099+0000 7fc801faf640 1 -- 172.21.15.50:0/2831769620 shutdown_connections 2024-09-11T22:19:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.099+0000 7fc801faf640 1 --2- 172.21.15.50:0/2831769620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7fc0cf610 0x7fc7fc0cccd0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.099+0000 7fc801faf640 1 --2- 172.21.15.50:0/2831769620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7fc161fa0 0x7fc7fc0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.099+0000 7fc801faf640 1 -- 172.21.15.50:0/2831769620 >> 172.21.15.50:0/2831769620 conn(0x7fc7fc09ba50 msgr2=0x7fc7fc0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.099+0000 7fc801faf640 1 -- 172.21.15.50:0/2831769620 shutdown_connections 2024-09-11T22:19:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.099+0000 7fc801faf640 1 -- 172.21.15.50:0/2831769620 wait complete. 2024-09-11T22:19:27.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.100+0000 7fc801faf640 1 Processor -- start 2024-09-11T22:19:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.100+0000 7fc801faf640 1 -- start start 2024-09-11T22:19:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc801faf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7fc0b1600 0x7fc7fc0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc801faf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7fc0cf610 0x7fc7fc14ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc801faf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7fc161fa0 0x7fc7fc160f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc801faf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc7fc162500 con 0x7fc7fc161fa0 2024-09-11T22:19:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc801faf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc7fc162380 con 0x7fc7fc0b1600 2024-09-11T22:19:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc801faf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc7fc0d1c70 con 0x7fc7fc0cf610 2024-09-11T22:19:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7fc161fa0 0x7fc7fc160f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7fc161fa0 0x7fc7fc160f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36942/0 (socket says 172.21.15.50:36942) 2024-09-11T22:19:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc7fbfff640 1 -- 172.21.15.50:0/1172855908 learned_addr learned my addr 172.21.15.50:0/1172855908 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7fc0b1600 0x7fc7fc0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc7f2ffd640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7fc0cf610 0x7fc7fc14ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc7fbfff640 1 -- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7fc0cf610 msgr2=0x7fc7fc14ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc7fbfff640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7fc0cf610 0x7fc7fc14ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc7fbfff640 1 -- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7fc0b1600 msgr2=0x7fc7fc0c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc7fbfff640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7fc0b1600 0x7fc7fc0c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.101+0000 7fc7fbfff640 1 -- 172.21.15.50:0/1172855908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7fc1601a0 con 0x7fc7fc161fa0 2024-09-11T22:19:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.102+0000 7fc7fbfff640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7fc161fa0 0x7fc7fc160f60 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4034040 tx=0x7fc7f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.102+0000 7fc7f8ff9640 1 -- 172.21.15.50:0/1172855908 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4041020 con 0x7fc7fc161fa0 2024-09-11T22:19:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.102+0000 7fc7f8ff9640 1 -- 172.21.15.50:0/1172855908 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f4037040 con 0x7fc7fc161fa0 2024-09-11T22:19:27.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.102+0000 7fc801faf640 1 -- 172.21.15.50:0/1172855908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7fc160480 con 0x7fc7fc161fa0 2024-09-11T22:19:27.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.102+0000 7fc7f8ff9640 1 -- 172.21.15.50:0/1172855908 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4036050 con 0x7fc7fc161fa0 2024-09-11T22:19:27.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.102+0000 7fc801faf640 1 -- 172.21.15.50:0/1172855908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7fc160a40 con 0x7fc7fc161fa0 2024-09-11T22:19:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.103+0000 7fc7f8ff9640 1 -- 172.21.15.50:0/1172855908 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7f4007bd0 con 0x7fc7fc161fa0 2024-09-11T22:19:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.104+0000 7fc7f8ff9640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc7dc06be30 0x7fc7dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.104+0000 7fc7f8ff9640 1 -- 172.21.15.50:0/1172855908 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fc7f40ab550 con 0x7fc7fc161fa0 2024-09-11T22:19:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.104+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc7dc06be30 0x7fc7dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.104+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc7dc06be30 0x7fc7dc06e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec006fd0 tx=0x7fc7ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.105+0000 7fc804e24740 1 Processor -- start 2024-09-11T22:19:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.105+0000 7fc804e24740 1 -- start start 2024-09-11T22:19:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.105+0000 7fc804e24740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d35e0 0x56148e8d39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.105+0000 7fc804e24740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d0da0 0x56148e8d2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.105+0000 7fc804e24740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 0x56148e8b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.105+0000 7fc804e24740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56148e7ef8d0 con 0x56148e8d1200 2024-09-11T22:19:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.105+0000 7fc804e24740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56148e797620 con 0x56148e8d35e0 2024-09-11T22:19:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.105+0000 7fc804e24740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56148e7eb890 con 0x56148e8d0da0 2024-09-11T22:19:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 0x56148e8b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 0x56148e8b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36944/0 (socket says 172.21.15.50:36944) 2024-09-11T22:19:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7fbfff640 1 -- 172.21.15.50:0/3251385393 learned_addr learned my addr 172.21.15.50:0/3251385393 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/3251385393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d35e0 0x56148e8d39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7f2ffd640 1 --2- 172.21.15.50:0/3251385393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d0da0 0x56148e8d2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7fbfff640 1 -- 172.21.15.50:0/3251385393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d0da0 msgr2=0x56148e8d2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7fbfff640 1 --2- 172.21.15.50:0/3251385393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d0da0 0x56148e8d2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7fbfff640 1 -- 172.21.15.50:0/3251385393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d35e0 msgr2=0x56148e8d39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7fbfff640 1 --2- 172.21.15.50:0/3251385393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d35e0 0x56148e8d39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7fbfff640 1 -- 172.21.15.50:0/3251385393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56148e5cc7d0 con 0x56148e8d1200 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7fbfff640 1 --2- 172.21.15.50:0/3251385393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 0x56148e8b3560 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40797a0 tx=0x7fc7f4075b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f93e31dadf91740 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7f17fa640 1 -- 172.21.15.50:0/3251385393 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4009510 con 0x56148e8d1200 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7f17fa640 1 -- 172.21.15.50:0/3251385393 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f4031600 con 0x56148e8d1200 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.106+0000 7fc7f17fa640 1 -- 172.21.15.50:0/3251385393 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4079810 con 0x56148e8d1200 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.107+0000 7fc804e24740 1 -- 172.21.15.50:0/3251385393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 msgr2=0x56148e8b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.107+0000 7fc804e24740 1 --2- 172.21.15.50:0/3251385393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 0x56148e8b3560 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40797a0 tx=0x7fc7f4075b80 comp rx=0 tx=0).stop 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.107+0000 7fc804e24740 1 -- 172.21.15.50:0/3251385393 shutdown_connections 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.107+0000 7fc804e24740 1 --2- 172.21.15.50:0/3251385393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d0da0 0x56148e8d2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.107+0000 7fc804e24740 1 --2- 172.21.15.50:0/3251385393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 0x56148e8b3560 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.107+0000 7fc804e24740 1 --2- 172.21.15.50:0/3251385393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d35e0 0x56148e8d39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.107+0000 7fc804e24740 1 -- 172.21.15.50:0/3251385393 >> 172.21.15.50:0/3251385393 conn(0x56148e889240 msgr2=0x56148e8d1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.107+0000 7fc804e24740 1 -- 172.21.15.50:0/3251385393 shutdown_connections 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.107+0000 7fc804e24740 1 -- 172.21.15.50:0/3251385393 wait complete. 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.108+0000 7fc804e24740 1 -- start start 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.108+0000 7fc804e24740 1 Processor -- start 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.108+0000 7fc804e24740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d1200 0x56148e8b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.108+0000 7fc804e24740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d35e0 0x56148e8b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.108+0000 7fc804e24740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 0x56148e8b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.108+0000 7fc804e24740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56148e7ef8d0 con 0x56148e8b1280 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.108+0000 7fc804e24740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56148e778750 con 0x56148e8d1200 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.108+0000 7fc804e24740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56148e8cfd00 con 0x56148e8d35e0 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc804e24740 10 client.0 _ll_register_callbacks cb 0x56148e79c780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 0x56148e8b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 0x56148e8b6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36958/0 (socket says 172.21.15.50:36958) 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7fbfff640 1 -- 172.21.15.50:0/4084377557 learned_addr learned my addr 172.21.15.50:0/4084377557 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d1200 0x56148e8b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7f2ffd640 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d35e0 0x56148e8b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7fbfff640 1 -- 172.21.15.50:0/4084377557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d35e0 msgr2=0x56148e8b68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7fbfff640 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d35e0 0x56148e8b68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7fbfff640 1 -- 172.21.15.50:0/4084377557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d1200 msgr2=0x56148e8b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7fbfff640 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d1200 0x56148e8b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7fbfff640 1 -- 172.21.15.50:0/4084377557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56148e4c20f0 con 0x56148e8b1280 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d1200 0x56148e8b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7fbfff640 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 0x56148e8b6e30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40ab010 tx=0x7fc7f4037f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11be03875ce7cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7da7fc640 1 -- 172.21.15.50:0/4084377557 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40ab2b0 con 0x56148e8b1280 2024-09-11T22:19:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7da7fc640 1 -- 172.21.15.50:0/4084377557 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fc7f4078c60 con 0x56148e8b1280 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc804e24740 1 -- 172.21.15.50:0/4084377557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7f4031600 con 0x56148e8b1280 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7da7fc640 1 -- 172.21.15.50:0/4084377557 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7fc7f407db10 con 0x56148e8b1280 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc804e24740 10 client.8604 fetch_fsmap learned FSMap version 94 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc804e24740 1 -- 172.21.15.50:0/4084377557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x56148e62cf60 con 0x56148e8b1280 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.109+0000 7fc7da7fc640 1 -- 172.21.15.50:0/4084377557 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f4031600 con 0x56148e8b1280 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.110+0000 7fc7da7fc640 1 -- 172.21.15.50:0/4084377557 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7fc7f4098b00 con 0x56148e8b1280 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.110+0000 7fc804e24740 10 client.8604 fetch_fsmap finished waiting for FSMap version 94 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.110+0000 7fc804e24740 10 client.8604 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.110+0000 7fc804e24740 20 client.8604 populate_metadata read hostname 'smithi050' 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.110+0000 7fc804e24740 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x56148e8c89c0 0x56148e8c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.110+0000 7fc804e24740 4 client.8604 mds_command: new command op to 8412 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.110+0000 7fc804e24740 1 -- 172.21.15.50:0/4084377557 --> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56148e7fd000 con 0x56148e8c89c0 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.110+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x56148e8c89c0 0x56148e8c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.110+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x56148e8c89c0 0x56148e8c8da0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dd35fdac927268d server_cookie=24c9cfec67bc8740 in_seq=0 out_seq=0 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.110+0000 7fc7da7fc640 10 client.8604 ms_handle_connect on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc7da7fc640 1 -- 172.21.15.50:0/4084377557 <== mds.0 v2:172.21.15.50:6834/3438568728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56148e7fd000 con 0x56148e8c89c0 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc7da7fc640 10 client.8604 handle_command_reply: tid=0 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc804e24740 1 client.8604 shutdown 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc804e24740 1 -- 172.21.15.50:0/4084377557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 msgr2=0x56148e8b6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc804e24740 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 0x56148e8b6e30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40ab010 tx=0x7fc7f4037f90 comp rx=0 tx=0).stop 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc804e24740 1 -- 172.21.15.50:0/4084377557 shutdown_connections 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc804e24740 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x56148e8c89c0 0x56148e8c8da0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc804e24740 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d35e0 0x56148e8b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc804e24740 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 0x56148e8b6e30 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc7da7fc640 0 client.8604 ms_handle_reset on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc804e24740 1 --2- 172.21.15.50:0/4084377557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d1200 0x56148e8b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc804e24740 1 -- 172.21.15.50:0/4084377557 >> 172.21.15.50:0/4084377557 conn(0x56148e8d0da0 msgr2=0x56148e8b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc804e24740 1 -- 172.21.15.50:0/4084377557 shutdown_connections 2024-09-11T22:19:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc804e24740 1 -- 172.21.15.50:0/4084377557 wait complete. 2024-09-11T22:19:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.111+0000 7fc804e24740 20 client.8604 trim_cache size 0 max 16384 2024-09-11T22:19:27.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.128+0000 7fc804e24740 1 Processor -- start 2024-09-11T22:19:27.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.128+0000 7fc804e24740 1 -- start start 2024-09-11T22:19:27.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc804e24740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8b1280 0x56148e8c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc804e24740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 0x56148e8afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc804e24740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d35e0 0x56148e88c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc804e24740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc7fc200b70 con 0x56148e8d1200 2024-09-11T22:19:27.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc804e24740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc7fc1ffc20 con 0x56148e8b1280 2024-09-11T22:19:27.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc804e24740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc7fc15f960 con 0x56148e8d35e0 2024-09-11T22:19:27.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc7f2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 0x56148e8afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc7f2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 0x56148e8afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36966/0 (socket says 172.21.15.50:36966) 2024-09-11T22:19:27.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc7f2ffd640 1 -- 172.21.15.50:0/1934295232 learned_addr learned my addr 172.21.15.50:0/1934295232 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/1934295232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8b1280 0x56148e8c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc7fbfff640 1 --2- 172.21.15.50:0/1934295232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d35e0 0x56148e88c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc7f2ffd640 1 -- 172.21.15.50:0/1934295232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d35e0 msgr2=0x56148e88c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc7f2ffd640 1 --2- 172.21.15.50:0/1934295232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d35e0 0x56148e88c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc7f2ffd640 1 -- 172.21.15.50:0/1934295232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8b1280 msgr2=0x56148e8c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc7f2ffd640 1 --2- 172.21.15.50:0/1934295232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8b1280 0x56148e8c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc7f2ffd640 1 -- 172.21.15.50:0/1934295232 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56148e49b1b0 con 0x56148e8d1200 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/1934295232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8b1280 0x56148e8c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.129+0000 7fc7f2ffd640 1 --2- 172.21.15.50:0/1934295232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 0x56148e8afda0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4007770 tx=0x7fc7e4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6be022e8e26da7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.130+0000 7fc7f0ff9640 1 -- 172.21.15.50:0/1934295232 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e401a070 con 0x56148e8d1200 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.130+0000 7fc7f0ff9640 1 -- 172.21.15.50:0/1934295232 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e40148a0 con 0x56148e8d1200 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.130+0000 7fc7f0ff9640 1 -- 172.21.15.50:0/1934295232 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4014c90 con 0x56148e8d1200 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.130+0000 7fc804e24740 1 -- 172.21.15.50:0/1934295232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 msgr2=0x56148e8afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.130+0000 7fc804e24740 1 --2- 172.21.15.50:0/1934295232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 0x56148e8afda0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4007770 tx=0x7fc7e4009040 comp rx=0 tx=0).stop 2024-09-11T22:19:27.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.130+0000 7fc804e24740 1 -- 172.21.15.50:0/1934295232 shutdown_connections 2024-09-11T22:19:27.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.130+0000 7fc804e24740 1 --2- 172.21.15.50:0/1934295232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d35e0 0x56148e88c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.130+0000 7fc804e24740 1 --2- 172.21.15.50:0/1934295232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8d1200 0x56148e8afda0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.130+0000 7fc804e24740 1 --2- 172.21.15.50:0/1934295232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8b1280 0x56148e8c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.130+0000 7fc804e24740 1 -- 172.21.15.50:0/1934295232 >> 172.21.15.50:0/1934295232 conn(0x56148e8d0da0 msgr2=0x56148e8d5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.130+0000 7fc804e24740 1 -- 172.21.15.50:0/1934295232 shutdown_connections 2024-09-11T22:19:27.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.130+0000 7fc804e24740 1 -- 172.21.15.50:0/1934295232 wait complete. 2024-09-11T22:19:27.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.131+0000 7fc804e24740 1 -- start start 2024-09-11T22:19:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.131+0000 7fc804e24740 1 Processor -- start 2024-09-11T22:19:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc804e24740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 0x56148e8d17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc804e24740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d1200 0x56148e94ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc804e24740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d35e0 0x56148e8e3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc804e24740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56148e887b00 con 0x56148e8b1280 2024-09-11T22:19:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc804e24740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc7fc1ff750 con 0x56148e8d35e0 2024-09-11T22:19:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc804e24740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56148e8c9740 con 0x56148e8d1200 2024-09-11T22:19:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc804e24740 10 client.0 _ll_register_callbacks cb 0x7fc7f4007f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7fb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 0x56148e8d17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7fb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 0x56148e8d17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36968/0 (socket says 172.21.15.50:36968) 2024-09-11T22:19:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7fb7fe640 1 -- 172.21.15.50:0/1420768131 learned_addr learned my addr 172.21.15.50:0/1420768131 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7fbfff640 1 --2- 172.21.15.50:0/1420768131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d35e0 0x56148e8e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7f2ffd640 1 --2- 172.21.15.50:0/1420768131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d1200 0x56148e94ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7fb7fe640 1 -- 172.21.15.50:0/1420768131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d1200 msgr2=0x56148e94ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/1420768131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d1200 0x56148e94ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7fb7fe640 1 -- 172.21.15.50:0/1420768131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d35e0 msgr2=0x56148e8e3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/1420768131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d35e0 0x56148e8e3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7fb7fe640 1 -- 172.21.15.50:0/1420768131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56148e882710 con 0x56148e8b1280 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7fb7fe640 1 --2- 172.21.15.50:0/1420768131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 0x56148e8d17d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0074a0 tx=0x7fc7ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b0b6277c4e4aa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7da7fc640 1 -- 172.21.15.50:0/1420768131 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec01c040 con 0x56148e8b1280 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7da7fc640 1 -- 172.21.15.50:0/1420768131 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fc7ec00f040 con 0x56148e8b1280 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc804e24740 1 -- 172.21.15.50:0/1420768131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7e40148a0 con 0x56148e8b1280 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.132+0000 7fc7da7fc640 1 -- 172.21.15.50:0/1420768131 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7fc7ec035050 con 0x56148e8b1280 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.133+0000 7fc804e24740 10 client.8610 fetch_fsmap learned FSMap version 94 2024-09-11T22:19:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.133+0000 7fc804e24740 1 -- 172.21.15.50:0/1420768131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x56148e8d1d10 con 0x56148e8b1280 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.133+0000 7fc7da7fc640 1 -- 172.21.15.50:0/1420768131 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e40148a0 con 0x56148e8b1280 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.133+0000 7fc7da7fc640 1 -- 172.21.15.50:0/1420768131 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7fc7ec038020 con 0x56148e8b1280 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.133+0000 7fc804e24740 10 client.8610 fetch_fsmap finished waiting for FSMap version 94 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.133+0000 7fc804e24740 10 client.8610 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.133+0000 7fc804e24740 20 client.8610 populate_metadata read hostname 'smithi050' 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.133+0000 7fc804e24740 1 --2- 172.21.15.50:0/1420768131 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x56148e94ef50 0x56148e885ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.133+0000 7fc804e24740 4 client.8610 mds_command: new command op to 8412 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.133+0000 7fc804e24740 1 -- 172.21.15.50:0/1420768131 --> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x56148e7f7350 con 0x56148e94ef50 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.133+0000 7fc7f2ffd640 1 --2- 172.21.15.50:0/1420768131 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x56148e94ef50 0x56148e885ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.133+0000 7fc7da7fc640 10 client.8610 ms_handle_connect on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.133+0000 7fc7f2ffd640 1 --2- 172.21.15.50:0/1420768131 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x56148e94ef50 0x56148e885ff0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c6d9cd3cef03018 server_cookie=24fba20a74a8dfc5 in_seq=0 out_seq=0 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc7da7fc640 1 -- 172.21.15.50:0/1420768131 <== mds.0 v2:172.21.15.50:6834/3438568728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56148e7f7350 con 0x56148e94ef50 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc7da7fc640 10 client.8610 handle_command_reply: tid=0 2024-09-11T22:19:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc804e24740 1 client.8610 shutdown 2024-09-11T22:19:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc804e24740 1 -- 172.21.15.50:0/1420768131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 msgr2=0x56148e8d17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc804e24740 1 --2- 172.21.15.50:0/1420768131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 0x56148e8d17d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0074a0 tx=0x7fc7ec004730 comp rx=0 tx=0).stop 2024-09-11T22:19:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc804e24740 1 -- 172.21.15.50:0/1420768131 shutdown_connections 2024-09-11T22:19:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc804e24740 1 --2- 172.21.15.50:0/1420768131 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x56148e94ef50 0x56148e885ff0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc804e24740 1 --2- 172.21.15.50:0/1420768131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56148e8d1200 0x56148e94ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc804e24740 1 --2- 172.21.15.50:0/1420768131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56148e8d35e0 0x56148e8e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc7da7fc640 0 client.8610 ms_handle_reset on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc804e24740 1 --2- 172.21.15.50:0/1420768131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56148e8b1280 0x56148e8d17d0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc804e24740 1 -- 172.21.15.50:0/1420768131 >> 172.21.15.50:0/1420768131 conn(0x56148e8d0da0 msgr2=0x56148e8afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc804e24740 1 -- 172.21.15.50:0/1420768131 shutdown_connections 2024-09-11T22:19:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc804e24740 1 -- 172.21.15.50:0/1420768131 wait complete. 2024-09-11T22:19:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc804e24740 20 client.8610 trim_cache size 0 max 16384 2024-09-11T22:19:27.141 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:19:27.141 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:19:27.141 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:19:27.141 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:19:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc801faf640 1 -- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc7dc06be30 msgr2=0x7fc7dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc801faf640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc7dc06be30 0x7fc7dc06e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec006fd0 tx=0x7fc7ec008040 comp rx=0 tx=0).stop 2024-09-11T22:19:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc801faf640 1 -- 172.21.15.50:0/1172855908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7fc161fa0 msgr2=0x7fc7fc160f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc801faf640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7fc161fa0 0x7fc7fc160f60 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4034040 tx=0x7fc7f4004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc801faf640 1 -- 172.21.15.50:0/1172855908 shutdown_connections 2024-09-11T22:19:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc801faf640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc7dc06be30 0x7fc7dc06e2f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc801faf640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7fc0cf610 0x7fc7fc14ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc801faf640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7fc161fa0 0x7fc7fc160f60 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc801faf640 1 --2- 172.21.15.50:0/1172855908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7fc0b1600 0x7fc7fc0c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.134+0000 7fc801faf640 1 -- 172.21.15.50:0/1172855908 >> 172.21.15.50:0/1172855908 conn(0x7fc7fc09ba50 msgr2=0x7fc7fc0b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.135+0000 7fc801faf640 1 -- 172.21.15.50:0/1172855908 shutdown_connections 2024-09-11T22:19:27.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.135+0000 7fc801faf640 1 -- 172.21.15.50:0/1172855908 wait complete. 2024-09-11T22:19:27.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:27.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-11T22:19:27.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.249+0000 7f28beaed640 1 Processor -- start 2024-09-11T22:19:27.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.249+0000 7f28beaed640 1 -- start start 2024-09-11T22:19:27.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.249+0000 7f28beaed640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b815e870 0x7f28b80d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.249+0000 7f28beaed640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28b80d16d0 0x7f28b80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.249+0000 7f28beaed640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28b80d3a30 0x7f28b80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.249+0000 7f28beaed640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f28b80d3ea0 con 0x7f28b80d3a30 2024-09-11T22:19:27.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.249+0000 7f28beaed640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f28b80d1b10 con 0x7f28b80d16d0 2024-09-11T22:19:27.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.249+0000 7f28beaed640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f28b80cfa80 con 0x7f28b815e870 2024-09-11T22:19:27.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.250+0000 7f28bd08a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28b80d3a30 0x7f28b80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.250+0000 7f28bd08a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28b80d3a30 0x7f28b80b6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36982/0 (socket says 172.21.15.50:36982) 2024-09-11T22:19:27.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.250+0000 7f28bd08a640 1 -- 172.21.15.50:0/1490663347 learned_addr learned my addr 172.21.15.50:0/1490663347 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.250+0000 7f28b7fff640 1 --2- 172.21.15.50:0/1490663347 >> v2:172.21.15.77:3300/0 conn(0x7f28b80d16d0 0x7f28b80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.250+0000 7f28bc889640 1 --2- 172.21.15.50:0/1490663347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b815e870 0x7f28b80d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.250+0000 7f28b7fff640 1 -- 172.21.15.50:0/1490663347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b815e870 msgr2=0x7f28b80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.250+0000 7f28b7fff640 1 --2- 172.21.15.50:0/1490663347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b815e870 0x7f28b80d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.250+0000 7f28b7fff640 1 -- 172.21.15.50:0/1490663347 >> v2:172.21.15.50:3300/0 conn(0x7f28b80d3a30 msgr2=0x7f28b80b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.250+0000 7f28b7fff640 1 --2- 172.21.15.50:0/1490663347 >> v2:172.21.15.50:3300/0 conn(0x7f28b80d3a30 0x7f28b80b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.250+0000 7f28b7fff640 1 -- 172.21.15.50:0/1490663347 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b80d40d0 con 0x7f28b80d16d0 2024-09-11T22:19:27.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.250+0000 7f28bd08a640 1 --2- 172.21.15.50:0/1490663347 >> v2:172.21.15.50:3300/0 conn(0x7f28b80d3a30 0x7f28b80b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:27.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.251+0000 7f28b7fff640 1 --2- 172.21.15.50:0/1490663347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b80d16d0 0x7f28b80d34f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f28b80cfc30 tx=0x7f28a402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=494c1ce722cbe18e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.251+0000 7f28b77fe640 1 -- 172.21.15.50:0/1490663347 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a4037070 con 0x7f28b80d16d0 2024-09-11T22:19:27.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.251+0000 7f28b77fe640 1 -- 172.21.15.50:0/1490663347 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a402ae50 con 0x7f28b80d16d0 2024-09-11T22:19:27.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.251+0000 7f28b77fe640 1 -- 172.21.15.50:0/1490663347 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a4032660 con 0x7f28b80d16d0 2024-09-11T22:19:27.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.251+0000 7f28beaed640 1 -- 172.21.15.50:0/1490663347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b80d16d0 msgr2=0x7f28b80d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.251+0000 7f28beaed640 1 --2- 172.21.15.50:0/1490663347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b80d16d0 0x7f28b80d34f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f28b80cfc30 tx=0x7f28a402a100 comp rx=0 tx=0).stop 2024-09-11T22:19:27.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.251+0000 7f28beaed640 1 -- 172.21.15.50:0/1490663347 shutdown_connections 2024-09-11T22:19:27.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.251+0000 7f28beaed640 1 --2- 172.21.15.50:0/1490663347 >> v2:172.21.15.50:3300/0 conn(0x7f28b80d3a30 0x7f28b80b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.251+0000 7f28beaed640 1 --2- 172.21.15.50:0/1490663347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b80d16d0 0x7f28b80d34f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.251+0000 7f28beaed640 1 --2- 172.21.15.50:0/1490663347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b815e870 0x7f28b80d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.251+0000 7f28beaed640 1 -- 172.21.15.50:0/1490663347 >> 172.21.15.50:0/1490663347 conn(0x7f28b80727a0 msgr2=0x7f28b80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.252+0000 7f28beaed640 1 -- 172.21.15.50:0/1490663347 shutdown_connections 2024-09-11T22:19:27.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.252+0000 7f28beaed640 1 -- 172.21.15.50:0/1490663347 wait complete. 2024-09-11T22:19:27.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.253+0000 7f28beaed640 1 Processor -- start 2024-09-11T22:19:27.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.253+0000 7f28beaed640 1 -- start start 2024-09-11T22:19:27.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28beaed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b80d16d0 0x7f28b80ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28beaed640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b80d3a30 0x7f28b8150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28beaed640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b815e870 0x7f28b81e7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28beaed640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f28b80b7ee0 con 0x7f28b80d16d0 2024-09-11T22:19:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28beaed640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f28b80b7c00 con 0x7f28b815e870 2024-09-11T22:19:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28beaed640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f28b815ec50 con 0x7f28b80d3a30 2024-09-11T22:19:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28bc889640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b80d16d0 0x7f28b80ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28bc889640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b80d16d0 0x7f28b80ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36986/0 (socket says 172.21.15.50:36986) 2024-09-11T22:19:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28bc889640 1 -- 172.21.15.50:0/130201265 learned_addr learned my addr 172.21.15.50:0/130201265 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28b7fff640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b80d3a30 0x7f28b8150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28bd08a640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b815e870 0x7f28b81e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28bc889640 1 -- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b80d3a30 msgr2=0x7f28b8150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28bc889640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b80d3a30 0x7f28b8150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28bc889640 1 -- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b815e870 msgr2=0x7f28b81e7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28bc889640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b815e870 0x7f28b81e7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28bc889640 1 -- 172.21.15.50:0/130201265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b80ab460 con 0x7f28b80d16d0 2024-09-11T22:19:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28bd08a640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b815e870 0x7f28b81e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28bc889640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b80d16d0 0x7f28b80ad150 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00e8a0 tx=0x7f28ac00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28b57fa640 1 -- 172.21.15.50:0/130201265 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac017070 con 0x7f28b80d16d0 2024-09-11T22:19:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28b57fa640 1 -- 172.21.15.50:0/130201265 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ac00c940 con 0x7f28b80d16d0 2024-09-11T22:19:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28beaed640 1 -- 172.21.15.50:0/130201265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b8151190 con 0x7f28b80d16d0 2024-09-11T22:19:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28b57fa640 1 -- 172.21.15.50:0/130201265 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac00cd30 con 0x7f28b80d16d0 2024-09-11T22:19:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.254+0000 7f28beaed640 1 -- 172.21.15.50:0/130201265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b81f63f0 con 0x7f28b80d16d0 2024-09-11T22:19:27.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.256+0000 7f28b57fa640 1 -- 172.21.15.50:0/130201265 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28ac01a070 con 0x7f28b80d16d0 2024-09-11T22:19:27.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.256+0000 7f28b57fa640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f289c06be30 0x7f289c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.257+0000 7f28b57fa640 1 -- 172.21.15.50:0/130201265 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f28ac08ad80 con 0x7f28b80d16d0 2024-09-11T22:19:27.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.257+0000 7f28b7fff640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f289c06be30 0x7f289c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.257+0000 7f28b7fff640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f289c06be30 0x7f289c06e2f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f28a4034000 tx=0x7f28a402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.257+0000 7f28c1888740 1 Processor -- start 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.257+0000 7f28c1888740 1 -- start start 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.258+0000 7f28c1888740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e13920 0x561ad8e590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.258+0000 7f28c1888740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e110e0 0x561ad8e13d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.258+0000 7f28c1888740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e150b0 0x561ad8e0e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.258+0000 7f28c1888740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561ad8d766f0 con 0x561ad8e150b0 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.258+0000 7f28c1888740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561ad8d1e330 con 0x561ad8e110e0 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.258+0000 7f28c1888740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x561ad8d726b0 con 0x561ad8e13920 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.258+0000 7f28bc889640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e13920 0x561ad8e590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.258+0000 7f28bd08a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e150b0 0x561ad8e0e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.258+0000 7f28bc889640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e13920 0x561ad8e590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:53284/0 (socket says 172.21.15.50:53284) 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.258+0000 7f28bc889640 1 -- 172.21.15.50:0/816307825 learned_addr learned my addr 172.21.15.50:0/816307825 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.258+0000 7f28b7fff640 1 --2- 172.21.15.50:0/816307825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e110e0 0x561ad8e13d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.259+0000 7f28bc889640 1 -- 172.21.15.50:0/816307825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e110e0 msgr2=0x561ad8e13d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.259+0000 7f28bc889640 1 --2- 172.21.15.50:0/816307825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e110e0 0x561ad8e13d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.259+0000 7f28bc889640 1 -- 172.21.15.50:0/816307825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e150b0 msgr2=0x561ad8e0e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.259+0000 7f28bc889640 1 --2- 172.21.15.50:0/816307825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e150b0 0x561ad8e0e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.259+0000 7f28bc889640 1 -- 172.21.15.50:0/816307825 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ad8d440d0 con 0x561ad8e13920 2024-09-11T22:19:27.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.259+0000 7f28bc889640 1 --2- 172.21.15.50:0/816307825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e13920 0x561ad8e590c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0615c0 tx=0x7f28ac058fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d4212b824aee708 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.259+0000 7f28a27fc640 1 -- 172.21.15.50:0/816307825 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac072070 con 0x561ad8e13920 2024-09-11T22:19:27.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.259+0000 7f28a27fc640 1 -- 172.21.15.50:0/816307825 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ac061af0 con 0x561ad8e13920 2024-09-11T22:19:27.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.259+0000 7f28a27fc640 1 -- 172.21.15.50:0/816307825 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac021070 con 0x561ad8e13920 2024-09-11T22:19:27.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.259+0000 7f28c1888740 1 -- 172.21.15.50:0/816307825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e13920 msgr2=0x561ad8e590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.259+0000 7f28c1888740 1 --2- 172.21.15.50:0/816307825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e13920 0x561ad8e590c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0615c0 tx=0x7f28ac058fc0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.260+0000 7f28c1888740 1 -- 172.21.15.50:0/816307825 shutdown_connections 2024-09-11T22:19:27.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.260+0000 7f28c1888740 1 --2- 172.21.15.50:0/816307825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e150b0 0x561ad8e0e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.260+0000 7f28c1888740 1 --2- 172.21.15.50:0/816307825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e110e0 0x561ad8e13d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.260+0000 7f28c1888740 1 --2- 172.21.15.50:0/816307825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e13920 0x561ad8e590c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.260+0000 7f28c1888740 1 -- 172.21.15.50:0/816307825 >> 172.21.15.50:0/816307825 conn(0x561ad8e10370 msgr2=0x561ad8e58590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.260+0000 7f28c1888740 1 -- 172.21.15.50:0/816307825 shutdown_connections 2024-09-11T22:19:27.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.260+0000 7f28c1888740 1 -- 172.21.15.50:0/816307825 wait complete. 2024-09-11T22:19:27.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.260+0000 7f28c1888740 1 -- start start 2024-09-11T22:19:27.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.260+0000 7f28c1888740 1 Processor -- start 2024-09-11T22:19:27.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.261+0000 7f28c1888740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e13920 0x561ad8e55a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.261+0000 7f28c1888740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e150b0 0x561ad8e3be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.261+0000 7f28c1888740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e3c370 0x561ad8e372a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.261+0000 7f28c1888740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561ad8e0f810 con 0x561ad8e150b0 2024-09-11T22:19:27.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.261+0000 7f28c1888740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561ad8cff4f0 con 0x561ad8e3c370 2024-09-11T22:19:27.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.261+0000 7f28c1888740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x561ad8e598f0 con 0x561ad8e13920 2024-09-11T22:19:27.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.261+0000 7f28c1888740 10 client.0 _ll_register_callbacks cb 0x561ad8d20b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:27.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.261+0000 7f28b7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e150b0 0x561ad8e3be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.261+0000 7f28b7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e150b0 0x561ad8e3be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37014/0 (socket says 172.21.15.50:37014) 2024-09-11T22:19:27.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.261+0000 7f28b7fff640 1 -- 172.21.15.50:0/2928838013 learned_addr learned my addr 172.21.15.50:0/2928838013 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.261+0000 7f28bd08a640 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e3c370 0x561ad8e372a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.261+0000 7f28bc889640 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e13920 0x561ad8e55a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28b7fff640 1 -- 172.21.15.50:0/2928838013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e13920 msgr2=0x561ad8e55a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28b7fff640 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e13920 0x561ad8e55a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28b7fff640 1 -- 172.21.15.50:0/2928838013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e3c370 msgr2=0x561ad8e372a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28b7fff640 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e3c370 0x561ad8e372a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28b7fff640 1 -- 172.21.15.50:0/2928838013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ad8b537d0 con 0x561ad8e150b0 2024-09-11T22:19:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28bc889640 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e13920 0x561ad8e55a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28b7fff640 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e150b0 0x561ad8e3be30 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009860 tx=0x7f28a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac18fb3e88068f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28977fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:19:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28977fe640 1 -- 172.21.15.50:0/2928838013 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a404e020 con 0x561ad8e150b0 2024-09-11T22:19:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28977fe640 1 -- 172.21.15.50:0/2928838013 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f28a4049850 con 0x561ad8e150b0 2024-09-11T22:19:27.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28c1888740 1 -- 172.21.15.50:0/2928838013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28ac061af0 con 0x561ad8e150b0 2024-09-11T22:19:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28977fe640 1 -- 172.21.15.50:0/2928838013 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f28a4037040 con 0x561ad8e150b0 2024-09-11T22:19:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28c1888740 10 client.8622 fetch_fsmap learned FSMap version 94 2024-09-11T22:19:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28c1888740 1 -- 172.21.15.50:0/2928838013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x561ad8a893f0 con 0x561ad8e150b0 2024-09-11T22:19:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28977fe640 1 -- 172.21.15.50:0/2928838013 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ac061af0 con 0x561ad8e150b0 2024-09-11T22:19:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28977fe640 1 -- 172.21.15.50:0/2928838013 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f28a4049a50 con 0x561ad8e150b0 2024-09-11T22:19:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28c1888740 10 client.8622 fetch_fsmap finished waiting for FSMap version 94 2024-09-11T22:19:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28c1888740 10 client.8622 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-11T22:19:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28c1888740 20 client.8622 populate_metadata read hostname 'smithi050' 2024-09-11T22:19:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28c1888740 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x561ad8e6be30 0x561ad8e6c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28c1888740 4 client.8622 mds_command: new command op to 8412 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.262+0000 7f28c1888740 1 -- 172.21.15.50:0/2928838013 --> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ad8d83e20 con 0x561ad8e6be30 2024-09-11T22:19:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.263+0000 7f28bc889640 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x561ad8e6be30 0x561ad8e6c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.263+0000 7f28977fe640 10 client.8622 ms_handle_connect on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.263+0000 7f28bc889640 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x561ad8e6be30 0x561ad8e6c260 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eed427e999cf98f server_cookie=2c5660f984986566 in_seq=0 out_seq=0 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.263+0000 7f28977fe640 1 -- 172.21.15.50:0/2928838013 <== mds.0 v2:172.21.15.50:6834/3438568728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561ad8d83e20 con 0x561ad8e6be30 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.263+0000 7f28977fe640 10 client.8622 handle_command_reply: tid=0 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.263+0000 7f28c1888740 1 client.8622 shutdown 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.264+0000 7f28c1888740 1 -- 172.21.15.50:0/2928838013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e150b0 msgr2=0x561ad8e3be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.264+0000 7f28c1888740 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e150b0 0x561ad8e3be30 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009860 tx=0x7f28a4004730 comp rx=0 tx=0).stop 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.264+0000 7f28c1888740 1 -- 172.21.15.50:0/2928838013 shutdown_connections 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.264+0000 7f28c1888740 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x561ad8e6be30 0x561ad8e6c260 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.264+0000 7f28c1888740 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e3c370 0x561ad8e372a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.264+0000 7f28977fe640 0 client.8622 ms_handle_reset on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.264+0000 7f28c1888740 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e150b0 0x561ad8e3be30 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.264+0000 7f28c1888740 1 --2- 172.21.15.50:0/2928838013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e13920 0x561ad8e55a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.264+0000 7f28c1888740 1 -- 172.21.15.50:0/2928838013 >> 172.21.15.50:0/2928838013 conn(0x561ad8e110e0 msgr2=0x561ad8e575c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.264+0000 7f28c1888740 1 -- 172.21.15.50:0/2928838013 shutdown_connections 2024-09-11T22:19:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.264+0000 7f28c1888740 1 -- 172.21.15.50:0/2928838013 wait complete. 2024-09-11T22:19:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.264+0000 7f28c1888740 20 client.8622 trim_cache size 0 max 16384 2024-09-11T22:19:27.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.281+0000 7f28c1888740 1 Processor -- start 2024-09-11T22:19:27.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.281+0000 7f28c1888740 1 -- start start 2024-09-11T22:19:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28c1888740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 0x561ad8e5aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28c1888740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e150b0 0x561ad8e68050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28c1888740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e3c370 0x561ad8e56610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28c1888740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f28b8200d50 con 0x561ad8e13920 2024-09-11T22:19:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28c1888740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f28b81f55f0 con 0x561ad8e3c370 2024-09-11T22:19:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28c1888740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f28b81f4950 con 0x561ad8e150b0 2024-09-11T22:19:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28bc889640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 0x561ad8e5aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28bc889640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 0x561ad8e5aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37018/0 (socket says 172.21.15.50:37018) 2024-09-11T22:19:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28bc889640 1 -- 172.21.15.50:0/3902307517 learned_addr learned my addr 172.21.15.50:0/3902307517 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28bd08a640 1 --2- 172.21.15.50:0/3902307517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e3c370 0x561ad8e56610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28b7fff640 1 --2- 172.21.15.50:0/3902307517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e150b0 0x561ad8e68050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28bc889640 1 -- 172.21.15.50:0/3902307517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e150b0 msgr2=0x561ad8e68050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28bc889640 1 --2- 172.21.15.50:0/3902307517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e150b0 0x561ad8e68050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28bc889640 1 -- 172.21.15.50:0/3902307517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e3c370 msgr2=0x561ad8e56610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28bc889640 1 --2- 172.21.15.50:0/3902307517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e3c370 0x561ad8e56610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28bc889640 1 -- 172.21.15.50:0/3902307517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ad8e10110 con 0x561ad8e13920 2024-09-11T22:19:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28bc889640 1 --2- 172.21.15.50:0/3902307517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 0x561ad8e5aa80 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0615c0 tx=0x7f28ac078000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c43932c2010860 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.282+0000 7f28a1ffb640 1 -- 172.21.15.50:0/3902307517 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac087070 con 0x561ad8e13920 2024-09-11T22:19:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.283+0000 7f28a1ffb640 1 -- 172.21.15.50:0/3902307517 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ac055630 con 0x561ad8e13920 2024-09-11T22:19:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.283+0000 7f28a1ffb640 1 -- 172.21.15.50:0/3902307517 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac072040 con 0x561ad8e13920 2024-09-11T22:19:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.283+0000 7f28c1888740 1 -- 172.21.15.50:0/3902307517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 msgr2=0x561ad8e5aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.283+0000 7f28c1888740 1 --2- 172.21.15.50:0/3902307517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 0x561ad8e5aa80 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0615c0 tx=0x7f28ac078000 comp rx=0 tx=0).stop 2024-09-11T22:19:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.283+0000 7f28c1888740 1 -- 172.21.15.50:0/3902307517 shutdown_connections 2024-09-11T22:19:27.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.283+0000 7f28c1888740 1 --2- 172.21.15.50:0/3902307517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e150b0 0x561ad8e68050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.283+0000 7f28c1888740 1 --2- 172.21.15.50:0/3902307517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e3c370 0x561ad8e56610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.283+0000 7f28c1888740 1 --2- 172.21.15.50:0/3902307517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 0x561ad8e5aa80 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.283+0000 7f28c1888740 1 -- 172.21.15.50:0/3902307517 >> 172.21.15.50:0/3902307517 conn(0x561ad8e110e0 msgr2=0x561ad8e7c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.283+0000 7f28c1888740 1 -- 172.21.15.50:0/3902307517 shutdown_connections 2024-09-11T22:19:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.283+0000 7f28c1888740 1 -- 172.21.15.50:0/3902307517 wait complete. 2024-09-11T22:19:27.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.284+0000 7f28c1888740 1 -- start start 2024-09-11T22:19:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.284+0000 7f28c1888740 1 Processor -- start 2024-09-11T22:19:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28c1888740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 0x561ad8ed6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28c1888740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e150b0 0x561ad8e69a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28c1888740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e3c370 0x561ad8e39ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28c1888740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561ad8e584c0 con 0x561ad8e13920 2024-09-11T22:19:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28c1888740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f28b81f4fa0 con 0x561ad8e150b0 2024-09-11T22:19:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28c1888740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x561ad8e0f300 con 0x561ad8e3c370 2024-09-11T22:19:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28c1888740 10 client.0 _ll_register_callbacks cb 0x7f28ac009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28bc889640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 0x561ad8ed6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28bc889640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 0x561ad8ed6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37030/0 (socket says 172.21.15.50:37030) 2024-09-11T22:19:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28bc889640 1 -- 172.21.15.50:0/2953276547 learned_addr learned my addr 172.21.15.50:0/2953276547 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28bd08a640 1 --2- 172.21.15.50:0/2953276547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e3c370 0x561ad8e39ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28b7fff640 1 --2- 172.21.15.50:0/2953276547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e150b0 0x561ad8e69a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28bc889640 1 -- 172.21.15.50:0/2953276547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e3c370 msgr2=0x561ad8e39ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28bc889640 1 --2- 172.21.15.50:0/2953276547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e3c370 0x561ad8e39ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28bc889640 1 -- 172.21.15.50:0/2953276547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e150b0 msgr2=0x561ad8e69a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28bc889640 1 --2- 172.21.15.50:0/2953276547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e150b0 0x561ad8e69a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28bc889640 1 -- 172.21.15.50:0/2953276547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ad8a490f0 con 0x561ad8e13920 2024-09-11T22:19:27.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28bc889640 1 --2- 172.21.15.50:0/2953276547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 0x561ad8ed6770 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00e870 tx=0x7f28ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170c7e4b0e3d3bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28977fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:19:27.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28977fe640 1 -- 172.21.15.50:0/2953276547 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac087050 con 0x561ad8e13920 2024-09-11T22:19:27.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28977fe640 1 -- 172.21.15.50:0/2953276547 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f28ac076bb0 con 0x561ad8e13920 2024-09-11T22:19:27.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.285+0000 7f28c1888740 1 -- 172.21.15.50:0/2953276547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28ac055630 con 0x561ad8e13920 2024-09-11T22:19:27.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28977fe640 1 -- 172.21.15.50:0/2953276547 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f28ac068050 con 0x561ad8e13920 2024-09-11T22:19:27.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28c1888740 10 client.8628 fetch_fsmap learned FSMap version 94 2024-09-11T22:19:27.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28c1888740 1 -- 172.21.15.50:0/2953276547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x561ad8e7beb0 con 0x561ad8e13920 2024-09-11T22:19:27.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28977fe640 1 -- 172.21.15.50:0/2953276547 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ac055630 con 0x561ad8e13920 2024-09-11T22:19:27.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28977fe640 1 -- 172.21.15.50:0/2953276547 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7f28ac06b020 con 0x561ad8e13920 2024-09-11T22:19:27.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28c1888740 10 client.8628 fetch_fsmap finished waiting for FSMap version 94 2024-09-11T22:19:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28c1888740 10 client.8628 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-11T22:19:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28c1888740 20 client.8628 populate_metadata read hostname 'smithi050' 2024-09-11T22:19:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28c1888740 1 --2- 172.21.15.50:0/2953276547 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x561ad8e14c50 0x561ad8e58760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28c1888740 4 client.8628 mds_command: new command op to 8412 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:19:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28c1888740 1 -- 172.21.15.50:0/2953276547 --> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561ad8d7e170 con 0x561ad8e14c50 2024-09-11T22:19:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28b7fff640 1 --2- 172.21.15.50:0/2953276547 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x561ad8e14c50 0x561ad8e58760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28977fe640 10 client.8628 ms_handle_connect on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28b7fff640 1 --2- 172.21.15.50:0/2953276547 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x561ad8e14c50 0x561ad8e58760 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bc044ade8ba491 server_cookie=42f26a6e668a5910 in_seq=0 out_seq=0 2024-09-11T22:19:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28977fe640 1 -- 172.21.15.50:0/2953276547 <== mds.0 v2:172.21.15.50:6834/3438568728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x561ad8d7e170 con 0x561ad8e14c50 2024-09-11T22:19:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28977fe640 10 client.8628 handle_command_reply: tid=0 2024-09-11T22:19:27.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.286+0000 7f28c1888740 1 client.8628 shutdown 2024-09-11T22:19:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28c1888740 1 -- 172.21.15.50:0/2953276547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 msgr2=0x561ad8ed6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28c1888740 1 --2- 172.21.15.50:0/2953276547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 0x561ad8ed6770 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00e870 tx=0x7f28ac000bc0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28c1888740 1 -- 172.21.15.50:0/2953276547 shutdown_connections 2024-09-11T22:19:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28c1888740 1 --2- 172.21.15.50:0/2953276547 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x561ad8e14c50 0x561ad8e58760 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28c1888740 1 --2- 172.21.15.50:0/2953276547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561ad8e3c370 0x561ad8e39ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28c1888740 1 --2- 172.21.15.50:0/2953276547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ad8e150b0 0x561ad8e69a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28977fe640 0 client.8628 ms_handle_reset on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28c1888740 1 --2- 172.21.15.50:0/2953276547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ad8e13920 0x561ad8ed6770 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28c1888740 1 -- 172.21.15.50:0/2953276547 >> 172.21.15.50:0/2953276547 conn(0x561ad8e110e0 msgr2=0x561ad8e68050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28c1888740 1 -- 172.21.15.50:0/2953276547 shutdown_connections 2024-09-11T22:19:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28c1888740 1 -- 172.21.15.50:0/2953276547 wait complete. 2024-09-11T22:19:27.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28c1888740 20 client.8628 trim_cache size 0 max 16384 2024-09-11T22:19:27.295 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:19:27.295 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-11T22:19:27.295 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-11T22:19:27.295 INFO:teuthology.orchestra.run.smithi050.stdout: "1a29dffb-4af7-4af5-8fc1-aacaf4ff0ebe": { 2024-09-11T22:19:27.295 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/scrub_control_test_path", 2024-09-11T22:19:27.295 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "1a29dffb-4af7-4af5-8fc1-aacaf4ff0ebe", 2024-09-11T22:19:27.295 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive" 2024-09-11T22:19:27.295 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:27.295 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:27.295 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:19:27.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28beaed640 1 -- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f289c06be30 msgr2=0x7f289c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28beaed640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f289c06be30 0x7f289c06e2f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f28a4034000 tx=0x7f28a402e000 comp rx=0 tx=0).stop 2024-09-11T22:19:27.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28beaed640 1 -- 172.21.15.50:0/130201265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b80d16d0 msgr2=0x7f28b80ad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28beaed640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b80d16d0 0x7f28b80ad150 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00e8a0 tx=0x7f28ac00ed60 comp rx=0 tx=0).stop 2024-09-11T22:19:27.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28beaed640 1 -- 172.21.15.50:0/130201265 shutdown_connections 2024-09-11T22:19:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28beaed640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f289c06be30 0x7f289c06e2f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28beaed640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b80d3a30 0x7f28b8150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28beaed640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b815e870 0x7f28b81e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28beaed640 1 --2- 172.21.15.50:0/130201265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b80d16d0 0x7f28b80ad150 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28beaed640 1 -- 172.21.15.50:0/130201265 >> 172.21.15.50:0/130201265 conn(0x7f28b80727a0 msgr2=0x7f28b80ba0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28beaed640 1 -- 172.21.15.50:0/130201265 shutdown_connections 2024-09-11T22:19:27.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.287+0000 7f28beaed640 1 -- 172.21.15.50:0/130201265 wait complete. 2024-09-11T22:19:27.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:27.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.400+0000 7fd4fbbe4640 1 Processor -- start 2024-09-11T22:19:27.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.400+0000 7fd4fbbe4640 1 -- start start 2024-09-11T22:19:27.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.400+0000 7fd4fbbe4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f4161fa0 0x7fd4f40b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.400+0000 7fd4fbbe4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4f40cf610 0x7fd4f40cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4fbbe4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f40cfbd0 con 0x7fd4f40b1600 2024-09-11T22:19:27.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4fbbe4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f40d1220 con 0x7fd4f40cf610 2024-09-11T22:19:27.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4fbbe4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f40d17e0 con 0x7fd4f4161fa0 2024-09-11T22:19:27.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4f9980640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f4161fa0 0x7fd4f40b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4fa181640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4f40cf610 0x7fd4f40cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4f917f640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd4f40b1600 0x7fd4f40cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:50584/0 (socket says 172.21.15.50:50584) 2024-09-11T22:19:27.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4f9980640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f4161fa0 0x7fd4f40b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:53336/0 (socket says 172.21.15.50:53336) 2024-09-11T22:19:27.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4fa181640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4f40cf610 0x7fd4f40cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:57464/0 (socket says 172.21.15.50:57464) 2024-09-11T22:19:27.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4f917f640 1 -- 172.21.15.50:0/2940758232 learned_addr learned my addr 172.21.15.50:0/2940758232 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:27.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4fa181640 1 -- 172.21.15.50:0/2940758232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f4161fa0 msgr2=0x7fd4f40b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:27.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4fa181640 1 --2- 172.21.15.50:0/2940758232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f4161fa0 0x7fd4f40b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4fa181640 1 -- 172.21.15.50:0/2940758232 >> v1:172.21.15.77:6789/0 conn(0x7fd4f40b1600 legacy=0x7fd4f40cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4fa181640 1 -- 172.21.15.50:0/2940758232 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f40cfeb0 con 0x7fd4f40cf610 2024-09-11T22:19:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.401+0000 7fd4f897e640 1 -- 172.21.15.50:0/2940758232 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189931633 0 0) 0x7fd4f40cfbd0 con 0x7fd4f40b1600 2024-09-11T22:19:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.402+0000 7fd4fa181640 1 --2- 172.21.15.50:0/2940758232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f40cf610 0x7fd4f40cccd0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009d90 tx=0x7fd4ec02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c21ce8fee79c422 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.402+0000 7fd4f897e640 1 -- 172.21.15.50:0/2940758232 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec007740 con 0x7fd4f40cf610 2024-09-11T22:19:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.402+0000 7fd4f897e640 1 -- 172.21.15.50:0/2940758232 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec0078e0 con 0x7fd4f40cf610 2024-09-11T22:19:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.402+0000 7fd4f897e640 1 -- 172.21.15.50:0/2940758232 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec007cb0 con 0x7fd4f40cf610 2024-09-11T22:19:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.402+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/2940758232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f40cf610 msgr2=0x7fd4f40cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.402+0000 7fd4fbbe4640 1 --2- 172.21.15.50:0/2940758232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f40cf610 0x7fd4f40cccd0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009d90 tx=0x7fd4ec02a660 comp rx=0 tx=0).stop 2024-09-11T22:19:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.403+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/2940758232 shutdown_connections 2024-09-11T22:19:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.403+0000 7fd4fbbe4640 1 --2- 172.21.15.50:0/2940758232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f40cf610 0x7fd4f40cccd0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.403+0000 7fd4fbbe4640 1 --2- 172.21.15.50:0/2940758232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f4161fa0 0x7fd4f40b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.403+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/2940758232 >> 172.21.15.50:0/2940758232 conn(0x7fd4f409ba50 msgr2=0x7fd4f40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.403+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/2940758232 shutdown_connections 2024-09-11T22:19:27.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.403+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/2940758232 wait complete. 2024-09-11T22:19:27.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.404+0000 7fd4fbbe4640 1 Processor -- start 2024-09-11T22:19:27.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.404+0000 7fd4fbbe4640 1 -- start start 2024-09-11T22:19:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fbbe4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f40b1600 0x7fd4f40c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fbbe4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f40cf610 0x7fd4f40b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fbbe4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f4161fa0 0x7fd4f406bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fbbe4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f4162500 con 0x7fd4f4161fa0 2024-09-11T22:19:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fbbe4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f4162380 con 0x7fd4f40cf610 2024-09-11T22:19:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fbbe4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f40d1c70 con 0x7fd4f40b1600 2024-09-11T22:19:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fa181640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f4161fa0 0x7fd4f406bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fa181640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f4161fa0 0x7fd4f406bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37042/0 (socket says 172.21.15.50:37042) 2024-09-11T22:19:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fa181640 1 -- 172.21.15.50:0/3071684064 learned_addr learned my addr 172.21.15.50:0/3071684064 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4f917f640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f40cf610 0x7fd4f40b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4f9980640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f40b1600 0x7fd4f40c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fa181640 1 -- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f40b1600 msgr2=0x7fd4f40c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fa181640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f40b1600 0x7fd4f40c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fa181640 1 -- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f40cf610 msgr2=0x7fd4f40b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fa181640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f40cf610 0x7fd4f40b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fa181640 1 -- 172.21.15.50:0/3071684064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f40b3550 con 0x7fd4f4161fa0 2024-09-11T22:19:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.405+0000 7fd4fa181640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f4161fa0 0x7fd4f406bb50 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009eb0 tx=0x7fd4ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.406+0000 7fd4ea7fc640 1 -- 172.21.15.50:0/3071684064 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec040070 con 0x7fd4f4161fa0 2024-09-11T22:19:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.406+0000 7fd4ea7fc640 1 -- 172.21.15.50:0/3071684064 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec031bc0 con 0x7fd4f4161fa0 2024-09-11T22:19:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.406+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/3071684064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f40b3830 con 0x7fd4f4161fa0 2024-09-11T22:19:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.406+0000 7fd4ea7fc640 1 -- 172.21.15.50:0/3071684064 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec009450 con 0x7fd4f4161fa0 2024-09-11T22:19:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.406+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/3071684064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f40b3df0 con 0x7fd4f4161fa0 2024-09-11T22:19:27.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.407+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/3071684064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f40b4310 con 0x7fd4f4161fa0 2024-09-11T22:19:27.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.407+0000 7fd4ea7fc640 1 -- 172.21.15.50:0/3071684064 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4ec039040 con 0x7fd4f4161fa0 2024-09-11T22:19:27.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.408+0000 7fd4ea7fc640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4d806be30 0x7fd4d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.408+0000 7fd4ea7fc640 1 -- 172.21.15.50:0/3071684064 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fd4ec0ac4f0 con 0x7fd4f4161fa0 2024-09-11T22:19:27.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.408+0000 7fd4f9980640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4d806be30 0x7fd4d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.408+0000 7fd4f9980640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4d806be30 0x7fd4d806e2f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0009b40 tx=0x7fd4f0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.412+0000 7fd4ea7fc640 1 -- 172.21.15.50:0/3071684064 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4ec07a8e0 con 0x7fd4f4161fa0 2024-09-11T22:19:27.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.624+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/3071684064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4f40b4d20 con 0x7fd4f4161fa0 2024-09-11T22:19:27.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.624+0000 7fd4ea7fc640 1 -- 172.21.15.50:0/3071684064 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7fd4ec07ebe0 con 0x7fd4f4161fa0 2024-09-11T22:19:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:27.626 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.627+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4d806be30 msgr2=0x7fd4d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.627+0000 7fd4fbbe4640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4d806be30 0x7fd4d806e2f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0009b40 tx=0x7fd4f0009190 comp rx=0 tx=0).stop 2024-09-11T22:19:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.627+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/3071684064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f4161fa0 msgr2=0x7fd4f406bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.627+0000 7fd4fbbe4640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f4161fa0 0x7fd4f406bb50 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009eb0 tx=0x7fd4ec004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.627+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/3071684064 shutdown_connections 2024-09-11T22:19:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.627+0000 7fd4fbbe4640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4d806be30 0x7fd4d806e2f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.627+0000 7fd4fbbe4640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f4161fa0 0x7fd4f406bb50 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.627+0000 7fd4fbbe4640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f40cf610 0x7fd4f40b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.627+0000 7fd4fbbe4640 1 --2- 172.21.15.50:0/3071684064 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f40b1600 0x7fd4f40c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.627+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/3071684064 >> 172.21.15.50:0/3071684064 conn(0x7fd4f409ba50 msgr2=0x7fd4f4161050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.627+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/3071684064 shutdown_connections 2024-09-11T22:19:27.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.627+0000 7fd4fbbe4640 1 -- 172.21.15.50:0/3071684064 wait complete. 2024-09-11T22:19:27.638 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-11T22:19:27.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:19:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.740+0000 7f820a131640 1 Processor -- start 2024-09-11T22:19:27.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.740+0000 7f820a131640 1 -- start start 2024-09-11T22:19:27.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.741+0000 7f820a131640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f820415ffb0 0x7f82040d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.741+0000 7f820a131640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82040b2890 con 0x7f82040b3a40 2024-09-11T22:19:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.741+0000 7f820a131640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82040b2b70 con 0x7f82040af390 2024-09-11T22:19:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.741+0000 7f820a131640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f82040b2e50 con 0x7f820415ffb0 2024-09-11T22:19:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.741+0000 7f8202ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f82040b3a40 0x7f82040d09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51814/0 (socket says 172.21.15.50:51814) 2024-09-11T22:19:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.741+0000 7f82037fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f820415ffb0 0x7f82040d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.741+0000 7f8202ffd640 1 -- 172.21.15.50:0/118852694 learned_addr learned my addr 172.21.15.50:0/118852694 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.742+0000 7f82027fc640 1 -- 172.21.15.50:0/118852694 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3994490399 0 0) 0x7f82040b2890 con 0x7f82040b3a40 2024-09-11T22:19:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.742+0000 7f82027fc640 1 -- 172.21.15.50:0/118852694 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81f0003520 con 0x7f82040b3a40 2024-09-11T22:19:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.742+0000 7f82037fe640 1 -- 172.21.15.50:0/118852694 >> v1:172.21.15.77:6789/0 conn(0x7f82040af390 legacy=0x7f82040af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.742+0000 7f82037fe640 1 -- 172.21.15.50:0/118852694 >> v1:172.21.15.50:6789/0 conn(0x7f82040b3a40 legacy=0x7f82040d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.742+0000 7f82037fe640 1 -- 172.21.15.50:0/118852694 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82040b3130 con 0x7f820415ffb0 2024-09-11T22:19:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.743+0000 7f82037fe640 1 --2- 172.21.15.50:0/118852694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f820415ffb0 0x7f82040d0460 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009d90 tx=0x7f81f402a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e49b7f6da8f59b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.743+0000 7f82027fc640 1 -- 172.21.15.50:0/118852694 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f4007740 con 0x7f820415ffb0 2024-09-11T22:19:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.743+0000 7f82027fc640 1 -- 172.21.15.50:0/118852694 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f40078e0 con 0x7f820415ffb0 2024-09-11T22:19:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.743+0000 7f82027fc640 1 -- 172.21.15.50:0/118852694 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f4007cb0 con 0x7f820415ffb0 2024-09-11T22:19:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.743+0000 7f820a131640 1 -- 172.21.15.50:0/118852694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f820415ffb0 msgr2=0x7f82040d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.743+0000 7f820a131640 1 --2- 172.21.15.50:0/118852694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f820415ffb0 0x7f82040d0460 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009d90 tx=0x7f81f402a580 comp rx=0 tx=0).stop 2024-09-11T22:19:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.743+0000 7f820a131640 1 -- 172.21.15.50:0/118852694 shutdown_connections 2024-09-11T22:19:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.743+0000 7f820a131640 1 --2- 172.21.15.50:0/118852694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f820415ffb0 0x7f82040d0460 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.743+0000 7f820a131640 1 -- 172.21.15.50:0/118852694 >> 172.21.15.50:0/118852694 conn(0x7f82040b40b0 msgr2=0x7f82040b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.743+0000 7f820a131640 1 -- 172.21.15.50:0/118852694 shutdown_connections 2024-09-11T22:19:27.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.743+0000 7f820a131640 1 -- 172.21.15.50:0/118852694 wait complete. 2024-09-11T22:19:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.744+0000 7f820a131640 1 Processor -- start 2024-09-11T22:19:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.745+0000 7f820a131640 1 -- start start 2024-09-11T22:19:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.745+0000 7f820a131640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82040af390 0x7f82040c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.745+0000 7f820a131640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82040b3a40 0x7f82040cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.745+0000 7f820a131640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f820415ffb0 0x7f82040702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.745+0000 7f820a131640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82040d1230 con 0x7f82040b3a40 2024-09-11T22:19:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.745+0000 7f820a131640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82040d10b0 con 0x7f82040af390 2024-09-11T22:19:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.745+0000 7f820a131640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f82040aff30 con 0x7f820415ffb0 2024-09-11T22:19:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.745+0000 7f8202ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82040b3a40 0x7f82040cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f8202ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82040b3a40 0x7f82040cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59250/0 (socket says 172.21.15.50:59250) 2024-09-11T22:19:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f8202ffd640 1 -- 172.21.15.50:0/688802170 learned_addr learned my addr 172.21.15.50:0/688802170 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f82037fe640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82040af390 0x7f82040c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f8203fff640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f820415ffb0 0x7f82040702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f8202ffd640 1 -- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f820415ffb0 msgr2=0x7f82040702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f8202ffd640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f820415ffb0 0x7f82040702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f8202ffd640 1 -- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82040af390 msgr2=0x7f82040c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f8202ffd640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82040af390 0x7f82040c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f8202ffd640 1 -- 172.21.15.50:0/688802170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82040c9b70 con 0x7f82040b3a40 2024-09-11T22:19:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f8202ffd640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82040b3a40 0x7f82040cb4b0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00c530 tx=0x7f81ec00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f81fbfff640 1 -- 172.21.15.50:0/688802170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec017070 con 0x7f82040b3a40 2024-09-11T22:19:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f81fbfff640 1 -- 172.21.15.50:0/688802170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec005ce0 con 0x7f82040b3a40 2024-09-11T22:19:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f820a131640 1 -- 172.21.15.50:0/688802170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82040c6090 con 0x7f82040b3a40 2024-09-11T22:19:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f81fbfff640 1 -- 172.21.15.50:0/688802170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0072b0 con 0x7f82040b3a40 2024-09-11T22:19:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.746+0000 7f820a131640 1 -- 172.21.15.50:0/688802170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82040c6630 con 0x7f82040b3a40 2024-09-11T22:19:27.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.747+0000 7f820a131640 1 -- 172.21.15.50:0/688802170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82040b0a50 con 0x7f82040b3a40 2024-09-11T22:19:27.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.748+0000 7f81fbfff640 1 -- 172.21.15.50:0/688802170 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81ec01a070 con 0x7f82040b3a40 2024-09-11T22:19:27.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.748+0000 7f81fbfff640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81e406be30 0x7f81e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:27.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.748+0000 7f81fbfff640 1 -- 172.21.15.50:0/688802170 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f81ec08a3a0 con 0x7f82040b3a40 2024-09-11T22:19:27.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.748+0000 7f82037fe640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81e406be30 0x7f81e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:27.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.749+0000 7f82037fe640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81e406be30 0x7f81e406e2f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f81f4034000 tx=0x7f81f402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.753+0000 7f81fbfff640 1 -- 172.21.15.50:0/688802170 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81ec058cf0 con 0x7f82040b3a40 2024-09-11T22:19:27.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.993+0000 7f820a131640 1 -- 172.21.15.50:0/688802170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f82040b84e0 con 0x7f82040b3a40 2024-09-11T22:19:27.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.994+0000 7f81fbfff640 1 -- 172.21.15.50:0/688802170 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1486 (secure 0 0 0) 0x7f81ec0585f0 con 0x7f82040b3a40 2024-09-11T22:19:27.995 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:27.995 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":516,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":132,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":892,"data_bytes":911703426,"bytes_used":2129985536,"bytes_avail":770964127744,"bytes_total":773094113280,"write_bytes_sec":75918055,"read_op_per_sec":0,"write_op_per_sec":74},"fsmap":{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8412}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-11T22:18:49.475903+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:19:27.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.996+0000 7f820a131640 1 -- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81e406be30 msgr2=0x7f81e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.996+0000 7f820a131640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81e406be30 0x7f81e406e2f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f81f4034000 tx=0x7f81f402f000 comp rx=0 tx=0).stop 2024-09-11T22:19:27.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.996+0000 7f820a131640 1 -- 172.21.15.50:0/688802170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82040b3a40 msgr2=0x7f82040cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:27.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.996+0000 7f820a131640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82040b3a40 0x7f82040cb4b0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00c530 tx=0x7f81ec00c9f0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.996+0000 7f820a131640 1 -- 172.21.15.50:0/688802170 shutdown_connections 2024-09-11T22:19:27.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.996+0000 7f820a131640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81e406be30 0x7f81e406e2f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.996+0000 7f820a131640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f820415ffb0 0x7f82040702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.996+0000 7f820a131640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82040b3a40 0x7f82040cb4b0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.996+0000 7f820a131640 1 --2- 172.21.15.50:0/688802170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82040af390 0x7f82040c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:27.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.996+0000 7f820a131640 1 -- 172.21.15.50:0/688802170 >> 172.21.15.50:0/688802170 conn(0x7f82040b40b0 msgr2=0x7f82040cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:27.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.996+0000 7f820a131640 1 -- 172.21.15.50:0/688802170 shutdown_connections 2024-09-11T22:19:27.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:27.996+0000 7f820a131640 1 -- 172.21.15.50:0/688802170 wait complete. 2024-09-11T22:19:28.007 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-11T22:19:29.008 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:29.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.123+0000 7f4ac70f1640 1 Processor -- start 2024-09-11T22:19:29.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.123+0000 7f4ac70f1640 1 -- start start 2024-09-11T22:19:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.124+0000 7f4ac70f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac00d0fd0 0x7f4ac00b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.124+0000 7f4ac70f1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac015ff40 con 0x7f4ac00d0150 2024-09-11T22:19:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.124+0000 7f4ac70f1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac00d05e0 con 0x7f4ac015fb60 2024-09-11T22:19:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.124+0000 7f4ac70f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac00cf510 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.124+0000 7f4abffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4ac00d0150 0x7f4ac00af670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51824/0 (socket says 172.21.15.50:51824) 2024-09-11T22:19:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.124+0000 7f4abffff640 1 -- 172.21.15.50:0/2480702564 learned_addr learned my addr 172.21.15.50:0/2480702564 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.124+0000 7f4ac568e640 1 --2- 172.21.15.50:0/2480702564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac00d0fd0 0x7f4ac00b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.124+0000 7f4abf7fe640 1 -- 172.21.15.50:0/2480702564 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1895931624 0 0) 0x7f4ac015ff40 con 0x7f4ac00d0150 2024-09-11T22:19:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.124+0000 7f4abf7fe640 1 -- 172.21.15.50:0/2480702564 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aac003520 con 0x7f4ac00d0150 2024-09-11T22:19:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.124+0000 7f4abf7fe640 1 -- 172.21.15.50:0/2480702564 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1816512775 0 0) 0x7f4ac00d05e0 con 0x7f4ac015fb60 2024-09-11T22:19:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.124+0000 7f4abf7fe640 1 -- 172.21.15.50:0/2480702564 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ac015ff40 con 0x7f4ac015fb60 2024-09-11T22:19:29.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.124+0000 7f4ac568e640 1 -- 172.21.15.50:0/2480702564 >> v1:172.21.15.77:6789/0 conn(0x7f4ac015fb60 legacy=0x7f4ac00d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:29.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.125+0000 7f4ac568e640 1 -- 172.21.15.50:0/2480702564 >> v1:172.21.15.50:6789/0 conn(0x7f4ac00d0150 legacy=0x7f4ac00af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:29.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.125+0000 7f4ac568e640 1 -- 172.21.15.50:0/2480702564 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac00cf760 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.125+0000 7f4ac568e640 1 --2- 172.21.15.50:0/2480702564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac00d0fd0 0x7f4ac00b4c70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8009dc0 tx=0x7f4ab802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8534a206704d928 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:29.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.126+0000 7f4abf7fe640 1 -- 172.21.15.50:0/2480702564 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab802ae60 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.126+0000 7f4abf7fe640 1 -- 172.21.15.50:0/2480702564 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab8007740 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.126+0000 7f4abf7fe640 1 -- 172.21.15.50:0/2480702564 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8007b10 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.126+0000 7f4ac70f1640 1 -- 172.21.15.50:0/2480702564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac00d0fd0 msgr2=0x7f4ac00b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:29.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.126+0000 7f4ac70f1640 1 --2- 172.21.15.50:0/2480702564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac00d0fd0 0x7f4ac00b4c70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8009dc0 tx=0x7f4ab802a640 comp rx=0 tx=0).stop 2024-09-11T22:19:29.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.126+0000 7f4ac70f1640 1 -- 172.21.15.50:0/2480702564 shutdown_connections 2024-09-11T22:19:29.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.126+0000 7f4ac70f1640 1 --2- 172.21.15.50:0/2480702564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac00d0fd0 0x7f4ac00b4c70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.126+0000 7f4ac70f1640 1 -- 172.21.15.50:0/2480702564 >> 172.21.15.50:0/2480702564 conn(0x7f4ac00b4150 msgr2=0x7f4ac00b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:29.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.126+0000 7f4ac70f1640 1 -- 172.21.15.50:0/2480702564 shutdown_connections 2024-09-11T22:19:29.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.126+0000 7f4ac70f1640 1 -- 172.21.15.50:0/2480702564 wait complete. 2024-09-11T22:19:29.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.128+0000 7f4ac70f1640 1 Processor -- start 2024-09-11T22:19:29.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.128+0000 7f4ac70f1640 1 -- start start 2024-09-11T22:19:29.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac70f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00d0fd0 0x7f4ac00cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:29.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac70f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac015fb60 0x7f4ac00caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:29.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac70f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac015c1b0 0x7f4ac01598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:29.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac70f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac00b1930 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac70f1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac00cfdb0 con 0x7f4ac015fb60 2024-09-11T22:19:29.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac70f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac00b1ab0 con 0x7f4ac015c1b0 2024-09-11T22:19:29.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac4e8d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00d0fd0 0x7f4ac00cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:29.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac4e8d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00d0fd0 0x7f4ac00cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59264/0 (socket says 172.21.15.50:59264) 2024-09-11T22:19:29.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac4e8d640 1 -- 172.21.15.50:0/3356067105 learned_addr learned my addr 172.21.15.50:0/3356067105 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:29.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4abffff640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac015fb60 0x7f4ac00caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:29.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac4e8d640 1 -- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac015c1b0 msgr2=0x7f4ac01598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:29.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac568e640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac015c1b0 0x7f4ac01598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:29.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac4e8d640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac015c1b0 0x7f4ac01598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac4e8d640 1 -- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac015fb60 msgr2=0x7f4ac00caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:29.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac4e8d640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac015fb60 0x7f4ac00caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac4e8d640 1 -- 172.21.15.50:0/3356067105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac00cb5c0 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4abffff640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac015fb60 0x7f4ac00caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:29.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.129+0000 7f4ac4e8d640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00d0fd0 0x7f4ac00cc660 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000c430 tx=0x7f4ab000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:29.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.130+0000 7f4abd7fa640 1 -- 172.21.15.50:0/3356067105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0017070 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.130+0000 7f4ac70f1640 1 -- 172.21.15.50:0/3356067105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac00cb8a0 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.130+0000 7f4abd7fa640 1 -- 172.21.15.50:0/3356067105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab00052f0 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.130+0000 7f4abd7fa640 1 -- 172.21.15.50:0/3356067105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0003830 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.130+0000 7f4ac70f1640 1 -- 172.21.15.50:0/3356067105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac00cbe60 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.131+0000 7f4ac70f1640 1 -- 172.21.15.50:0/3356067105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac00b4c70 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.131+0000 7f4abd7fa640 1 -- 172.21.15.50:0/3356067105 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ab001a070 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.132+0000 7f4abd7fa640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4aa006be30 0x7f4aa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.132+0000 7f4abd7fa640 1 -- 172.21.15.50:0/3356067105 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f4ab008a2e0 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.132+0000 7f4abffff640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4aa006be30 0x7f4aa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.133+0000 7f4abffff640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4aa006be30 0x7f4aa006e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4ac015b970 tx=0x7f4aa8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:29.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.136+0000 7f4abd7fa640 1 -- 172.21.15.50:0/3356067105 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ab0058c10 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.348+0000 7f4ac70f1640 1 -- 172.21.15.50:0/3356067105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ac00cef50 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.349+0000 7f4abd7fa640 1 -- 172.21.15.50:0/3356067105 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7f4ab0077030 con 0x7f4ac00d0fd0 2024-09-11T22:19:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:29.350 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:29.350 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:29.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.351+0000 7f4ac70f1640 1 -- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4aa006be30 msgr2=0x7f4aa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:29.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.351+0000 7f4ac70f1640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4aa006be30 0x7f4aa006e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4ac015b970 tx=0x7f4aa8009040 comp rx=0 tx=0).stop 2024-09-11T22:19:29.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.351+0000 7f4ac70f1640 1 -- 172.21.15.50:0/3356067105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00d0fd0 msgr2=0x7f4ac00cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:29.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.351+0000 7f4ac70f1640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00d0fd0 0x7f4ac00cc660 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000c430 tx=0x7f4ab000c8f0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.351+0000 7f4ac70f1640 1 -- 172.21.15.50:0/3356067105 shutdown_connections 2024-09-11T22:19:29.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.351+0000 7f4ac70f1640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4aa006be30 0x7f4aa006e2f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.351+0000 7f4ac70f1640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac015c1b0 0x7f4ac01598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.351+0000 7f4ac70f1640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac015fb60 0x7f4ac00caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.351+0000 7f4ac70f1640 1 --2- 172.21.15.50:0/3356067105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac00d0fd0 0x7f4ac00cc660 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.351+0000 7f4ac70f1640 1 -- 172.21.15.50:0/3356067105 >> 172.21.15.50:0/3356067105 conn(0x7f4ac00b4150 msgr2=0x7f4ac00d2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:29.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.351+0000 7f4ac70f1640 1 -- 172.21.15.50:0/3356067105 shutdown_connections 2024-09-11T22:19:29.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.351+0000 7f4ac70f1640 1 -- 172.21.15.50:0/3356067105 wait complete. 2024-09-11T22:19:29.362 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-11T22:19:29.363 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:19:29.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.463+0000 7fbd610a4640 1 Processor -- start 2024-09-11T22:19:29.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.463+0000 7fbd610a4640 1 -- start start 2024-09-11T22:19:29.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.464+0000 7fbd610a4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd5c0b0f60 0x7fbd5c0b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:29.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.464+0000 7fbd610a4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbd5c0b1340 0x7fbd5c162600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:29.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.464+0000 7fbd610a4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd5c162b40 0x7fbd5c0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:29.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.464+0000 7fbd610a4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fbd5c0b17a0 con 0x7fbd5c162b40 2024-09-11T22:19:29.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.464+0000 7fbd610a4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbd5c06d550 con 0x7fbd5c0b1340 2024-09-11T22:19:29.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.464+0000 7fbd610a4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbd5c163410 con 0x7fbd5c0b0f60 2024-09-11T22:19:29.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.464+0000 7fbd5b59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd5c162b40 0x7fbd5c0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:29.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.464+0000 7fbd5b59e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd5c162b40 0x7fbd5c0d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59270/0 (socket says 172.21.15.50:59270) 2024-09-11T22:19:29.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.464+0000 7fbd5b59e640 1 -- 172.21.15.50:0/1246193598 learned_addr learned my addr 172.21.15.50:0/1246193598 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:29.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.465+0000 7fbd5a59c640 1 --2- 172.21.15.50:0/1246193598 >> v2:172.21.15.77:3300/0 conn(0x7fbd5c0b1340 0x7fbd5c162600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:29.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.465+0000 7fbd5ad9d640 1 --2- 172.21.15.50:0/1246193598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd5c0b0f60 0x7fbd5c0b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:29.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.465+0000 7fbd5b59e640 1 -- 172.21.15.50:0/1246193598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd5c0b0f60 msgr2=0x7fbd5c0b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:29.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.465+0000 7fbd5b59e640 1 --2- 172.21.15.50:0/1246193598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd5c0b0f60 0x7fbd5c0b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.465+0000 7fbd5b59e640 1 -- 172.21.15.50:0/1246193598 >> v2:172.21.15.77:3300/0 conn(0x7fbd5c0b1340 msgr2=0x7fbd5c162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.465+0000 7fbd5b59e640 1 --2- 172.21.15.50:0/1246193598 >> v2:172.21.15.77:3300/0 conn(0x7fbd5c0b1340 0x7fbd5c162600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.465+0000 7fbd5b59e640 1 -- 172.21.15.50:0/1246193598 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5c06cc20 con 0x7fbd5c162b40 2024-09-11T22:19:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.465+0000 7fbd5a59c640 1 --2- 172.21.15.50:0/1246193598 >> v2:172.21.15.77:3300/0 conn(0x7fbd5c0b1340 0x7fbd5c162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.465+0000 7fbd5ad9d640 1 --2- 172.21.15.50:0/1246193598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd5c0b0f60 0x7fbd5c0b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:29.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.465+0000 7fbd5b59e640 1 --2- 172.21.15.50:0/1246193598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd5c162b40 0x7fbd5c0d0460 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c072a40 tx=0x7fbd5402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f69a67a04bdf29 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:29.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.466+0000 7fbd59d9b640 1 -- 172.21.15.50:0/1246193598 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54037070 con 0x7fbd5c162b40 2024-09-11T22:19:29.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.466+0000 7fbd59d9b640 1 -- 172.21.15.50:0/1246193598 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd54032440 con 0x7fbd5c162b40 2024-09-11T22:19:29.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.466+0000 7fbd59d9b640 1 -- 172.21.15.50:0/1246193598 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54032810 con 0x7fbd5c162b40 2024-09-11T22:19:29.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.466+0000 7fbd610a4640 1 -- 172.21.15.50:0/1246193598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd5c162b40 msgr2=0x7fbd5c0d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.466+0000 7fbd610a4640 1 --2- 172.21.15.50:0/1246193598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd5c162b40 0x7fbd5c0d0460 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c072a40 tx=0x7fbd5402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.466+0000 7fbd610a4640 1 -- 172.21.15.50:0/1246193598 shutdown_connections 2024-09-11T22:19:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.466+0000 7fbd610a4640 1 --2- 172.21.15.50:0/1246193598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd5c162b40 0x7fbd5c0d0460 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.466+0000 7fbd610a4640 1 --2- 172.21.15.50:0/1246193598 >> v2:172.21.15.77:3300/0 conn(0x7fbd5c0b1340 0x7fbd5c162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.466+0000 7fbd610a4640 1 --2- 172.21.15.50:0/1246193598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd5c0b0f60 0x7fbd5c0b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.466+0000 7fbd610a4640 1 -- 172.21.15.50:0/1246193598 >> 172.21.15.50:0/1246193598 conn(0x7fbd5c0b40b0 msgr2=0x7fbd5c0b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.466+0000 7fbd610a4640 1 -- 172.21.15.50:0/1246193598 shutdown_connections 2024-09-11T22:19:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.466+0000 7fbd610a4640 1 -- 172.21.15.50:0/1246193598 wait complete. 2024-09-11T22:19:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.468+0000 7fbd610a4640 1 Processor -- start 2024-09-11T22:19:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.468+0000 7fbd610a4640 1 -- start start 2024-09-11T22:19:29.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.468+0000 7fbd610a4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd5c0b0f60 0x7fbd5c1e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:29.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.468+0000 7fbd610a4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd5c0b1340 0x7fbd5c14f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:29.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.468+0000 7fbd610a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd5c162b40 0x7fbd5c15dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:29.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.468+0000 7fbd610a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c06d9e0 con 0x7fbd5c162b40 2024-09-11T22:19:29.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.468+0000 7fbd610a4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c06d1e0 con 0x7fbd5c0b0f60 2024-09-11T22:19:29.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.468+0000 7fbd610a4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbd5c06db60 con 0x7fbd5c0b1340 2024-09-11T22:19:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd5b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd5c162b40 0x7fbd5c15dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd5b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd5c162b40 0x7fbd5c15dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59276/0 (socket says 172.21.15.50:59276) 2024-09-11T22:19:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd5b59e640 1 -- 172.21.15.50:0/1766346483 learned_addr learned my addr 172.21.15.50:0/1766346483 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd5a59c640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd5c0b1340 0x7fbd5c14f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd5ad9d640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd5c0b0f60 0x7fbd5c1e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd5b59e640 1 -- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd5c0b1340 msgr2=0x7fbd5c14f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd5b59e640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd5c0b1340 0x7fbd5c14f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd5b59e640 1 -- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd5c0b0f60 msgr2=0x7fbd5c1e8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd5b59e640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd5c0b0f60 0x7fbd5c1e8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd5b59e640 1 -- 172.21.15.50:0/1766346483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5c1e8e40 con 0x7fbd5c162b40 2024-09-11T22:19:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd5b59e640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd5c162b40 0x7fbd5c15dd30 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fbd540090b0 tx=0x7fbd540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd537fe640 1 -- 172.21.15.50:0/1766346483 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54041070 con 0x7fbd5c162b40 2024-09-11T22:19:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd537fe640 1 -- 172.21.15.50:0/1766346483 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5403c890 con 0x7fbd5c162b40 2024-09-11T22:19:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd610a4640 1 -- 172.21.15.50:0/1766346483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5c1e9120 con 0x7fbd5c162b40 2024-09-11T22:19:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd537fe640 1 -- 172.21.15.50:0/1766346483 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54037040 con 0x7fbd5c162b40 2024-09-11T22:19:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.469+0000 7fbd610a4640 1 -- 172.21.15.50:0/1766346483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5c1e96e0 con 0x7fbd5c162b40 2024-09-11T22:19:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.470+0000 7fbd610a4640 1 -- 172.21.15.50:0/1766346483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd5c162ff0 con 0x7fbd5c162b40 2024-09-11T22:19:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.471+0000 7fbd537fe640 1 -- 172.21.15.50:0/1766346483 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd54044070 con 0x7fbd5c162b40 2024-09-11T22:19:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.471+0000 7fbd537fe640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbd3c06be30 0x7fbd3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:29.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.471+0000 7fbd537fe640 1 -- 172.21.15.50:0/1766346483 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fbd540aba40 con 0x7fbd5c162b40 2024-09-11T22:19:29.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.471+0000 7fbd5ad9d640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbd3c06be30 0x7fbd3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:29.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.472+0000 7fbd5ad9d640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbd3c06be30 0x7fbd3c06e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c007fc0 tx=0x7fbd4c007550 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:29.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.476+0000 7fbd537fe640 1 -- 172.21.15.50:0/1766346483 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd5407a5a0 con 0x7fbd5c162b40 2024-09-11T22:19:29.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.717+0000 7fbd610a4640 1 -- 172.21.15.50:0/1766346483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbd5c0c9270 con 0x7fbd5c162b40 2024-09-11T22:19:29.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.717+0000 7fbd537fe640 1 -- 172.21.15.50:0/1766346483 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1488 (secure 0 0 0) 0x7fbd54079ea0 con 0x7fbd5c162b40 2024-09-11T22:19:29.722 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:29.722 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":518,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":132,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1041,"data_bytes":1068988791,"bytes_used":2535915520,"bytes_avail":770558197760,"bytes_total":773094113280,"write_bytes_sec":87101320,"read_op_per_sec":0,"write_op_per_sec":85},"fsmap":{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8412}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-11T22:18:49.475903+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:19:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.719+0000 7fbd610a4640 1 -- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbd3c06be30 msgr2=0x7fbd3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.719+0000 7fbd610a4640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbd3c06be30 0x7fbd3c06e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c007fc0 tx=0x7fbd4c007550 comp rx=0 tx=0).stop 2024-09-11T22:19:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.719+0000 7fbd610a4640 1 -- 172.21.15.50:0/1766346483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd5c162b40 msgr2=0x7fbd5c15dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.719+0000 7fbd610a4640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd5c162b40 0x7fbd5c15dd30 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fbd540090b0 tx=0x7fbd540046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.719+0000 7fbd610a4640 1 -- 172.21.15.50:0/1766346483 shutdown_connections 2024-09-11T22:19:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.719+0000 7fbd610a4640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbd3c06be30 0x7fbd3c06e2f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.719+0000 7fbd610a4640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd5c0b1340 0x7fbd5c14f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.719+0000 7fbd610a4640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd5c162b40 0x7fbd5c15dd30 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.719+0000 7fbd610a4640 1 --2- 172.21.15.50:0/1766346483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd5c0b0f60 0x7fbd5c1e8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.719+0000 7fbd610a4640 1 -- 172.21.15.50:0/1766346483 >> 172.21.15.50:0/1766346483 conn(0x7fbd5c0b40b0 msgr2=0x7fbd5c0b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.719+0000 7fbd610a4640 1 -- 172.21.15.50:0/1766346483 shutdown_connections 2024-09-11T22:19:29.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:29.719+0000 7fbd610a4640 1 -- 172.21.15.50:0/1766346483 wait complete. 2024-09-11T22:19:29.731 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-11T22:19:30.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.846+0000 7f3b0215f640 1 Processor -- start 2024-09-11T22:19:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.846+0000 7f3b0215f640 1 -- start start 2024-09-11T22:19:30.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.846+0000 7f3b0215f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3afc0d3c00 0x7f3afc169420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:30.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.846+0000 7f3b0215f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3afc0cfa80 con 0x7f3afc0d18a0 2024-09-11T22:19:30.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.846+0000 7f3b0215f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3afc0d40d0 con 0x7f3afc15e870 2024-09-11T22:19:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.846+0000 7f3b0215f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3afc0d43b0 con 0x7f3afc0d3c00 2024-09-11T22:19:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afaffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3afc0d18a0 0x7f3afc0d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51840/0 (socket says 172.21.15.50:51840) 2024-09-11T22:19:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afaffd640 1 -- 172.21.15.50:0/3950685414 learned_addr learned my addr 172.21.15.50:0/3950685414 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891549928 0 0) 0x7f3af0001110 con 0x7f3afc0d18a0 2024-09-11T22:19:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afbfff640 1 --2- 172.21.15.50:0/3950685414 >> v2:172.21.15.77:3300/0 conn(0x7f3afc0d3c00 0x7f3afc169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ae4003520 con 0x7f3afc0d18a0 2024-09-11T22:19:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 235957518 0 0) 0x7f3ae4003520 con 0x7f3afc0d18a0 2024-09-11T22:19:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 >> v2:172.21.15.77:3300/0 conn(0x7f3afc0d3c00 msgr2=0x7f3afc169420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 --2- 172.21.15.50:0/3950685414 >> v2:172.21.15.77:3300/0 conn(0x7f3afc0d3c00 0x7f3afc169420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 >> v1:172.21.15.77:6789/0 conn(0x7f3afc15e870 legacy=0x7f3afc0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc0b7c00 con 0x7f3afc0d18a0 2024-09-11T22:19:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f3af0001840 con 0x7f3afc0d18a0 2024-09-11T22:19:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 >> v1:172.21.15.50:6789/0 conn(0x7f3afc0d18a0 legacy=0x7f3afc0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 --2- 172.21.15.50:0/3950685414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae40039b0 0x7f3ae4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 --2- 172.21.15.50:0/3950685414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ae40043b0 0x7f3ae4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 --2- 172.21.15.50:0/3950685414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4005080 0x7f3ae400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc0d43b0 con 0x7f3ae4005080 2024-09-11T22:19:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae400bfe0 con 0x7f3ae40039b0 2024-09-11T22:19:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae400c1e0 con 0x7f3ae40043b0 2024-09-11T22:19:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afbfff640 1 --2- 172.21.15.50:0/3950685414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4005080 0x7f3ae400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.847+0000 7f3afb7fe640 1 --2- 172.21.15.50:0/3950685414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae40039b0 0x7f3ae4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.848+0000 7f3afaffd640 1 --2- 172.21.15.50:0/3950685414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ae40043b0 0x7f3ae4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.848+0000 7f3afbfff640 1 -- 172.21.15.50:0/3950685414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ae40043b0 msgr2=0x7f3ae4004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.848+0000 7f3afbfff640 1 --2- 172.21.15.50:0/3950685414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ae40043b0 0x7f3ae4004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.848+0000 7f3afbfff640 1 -- 172.21.15.50:0/3950685414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae40039b0 msgr2=0x7f3ae4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.848+0000 7f3afbfff640 1 --2- 172.21.15.50:0/3950685414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae40039b0 0x7f3ae4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.848+0000 7f3afbfff640 1 -- 172.21.15.50:0/3950685414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae4003520 con 0x7f3ae4005080 2024-09-11T22:19:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.848+0000 7f3afbfff640 1 -- 172.21.15.50:0/3950685414 reap_dead start 2024-09-11T22:19:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.849+0000 7f3afbfff640 1 --2- 172.21.15.50:0/3950685414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4005080 0x7f3ae400b9c0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009ac0 tx=0x7f3ae4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c16249bd324c455 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.849+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4009690 con 0x7f3ae4005080 2024-09-11T22:19:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.849+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af4004020 con 0x7f3ae4005080 2024-09-11T22:19:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.849+0000 7f3afa7fc640 1 -- 172.21.15.50:0/3950685414 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4004410 con 0x7f3ae4005080 2024-09-11T22:19:30.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.849+0000 7f3b0215f640 1 -- 172.21.15.50:0/3950685414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4005080 msgr2=0x7f3ae400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:30.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.849+0000 7f3b0215f640 1 --2- 172.21.15.50:0/3950685414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4005080 0x7f3ae400b9c0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009ac0 tx=0x7f3ae4005830 comp rx=0 tx=0).stop 2024-09-11T22:19:30.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.849+0000 7f3b0215f640 1 -- 172.21.15.50:0/3950685414 shutdown_connections 2024-09-11T22:19:30.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.849+0000 7f3b0215f640 1 --2- 172.21.15.50:0/3950685414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4005080 0x7f3ae400b9c0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:30.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.849+0000 7f3b0215f640 1 -- 172.21.15.50:0/3950685414 >> 172.21.15.50:0/3950685414 conn(0x7f3afc0727a0 msgr2=0x7f3afc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.849+0000 7f3b0215f640 1 -- 172.21.15.50:0/3950685414 shutdown_connections 2024-09-11T22:19:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.849+0000 7f3b0215f640 1 -- 172.21.15.50:0/3950685414 wait complete. 2024-09-11T22:19:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.851+0000 7f3b0215f640 1 Processor -- start 2024-09-11T22:19:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.851+0000 7f3b0215f640 1 -- start start 2024-09-11T22:19:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.851+0000 7f3b0215f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae4005080 0x7f3afc0ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.851+0000 7f3b0215f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3afc15b590 0x7f3afc14c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3b0215f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc14ca00 0x7f3afc0ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3b0215f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc0b78b0 con 0x7f3afc14ca00 2024-09-11T22:19:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3b0215f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc15ec50 con 0x7f3ae4005080 2024-09-11T22:19:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3b0215f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3afc0d34f0 con 0x7f3afc15b590 2024-09-11T22:19:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3afbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc14ca00 0x7f3afc0ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:30.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3afbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc14ca00 0x7f3afc0ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59292/0 (socket says 172.21.15.50:59292) 2024-09-11T22:19:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3afbfff640 1 -- 172.21.15.50:0/809722126 learned_addr learned my addr 172.21.15.50:0/809722126 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3afaffd640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3afc15b590 0x7f3afc14c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3afb7fe640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae4005080 0x7f3afc0ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3afbfff640 1 -- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3afc15b590 msgr2=0x7f3afc14c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3afbfff640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3afc15b590 0x7f3afc14c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3afbfff640 1 -- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae4005080 msgr2=0x7f3afc0ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3afbfff640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae4005080 0x7f3afc0ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3afbfff640 1 -- 172.21.15.50:0/809722126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc0cbba0 con 0x7f3afc14ca00 2024-09-11T22:19:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3afbfff640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc14ca00 0x7f3afc0ccc40 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f3af402abe0 tx=0x7f3af4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3ae3fff640 1 -- 172.21.15.50:0/809722126 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af400f040 con 0x7f3afc14ca00 2024-09-11T22:19:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3ae3fff640 1 -- 172.21.15.50:0/809722126 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af4040070 con 0x7f3afc14ca00 2024-09-11T22:19:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3b0215f640 1 -- 172.21.15.50:0/809722126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3afc0cbe80 con 0x7f3afc14ca00 2024-09-11T22:19:30.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3ae3fff640 1 -- 172.21.15.50:0/809722126 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af403a6b0 con 0x7f3afc14ca00 2024-09-11T22:19:30.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.852+0000 7f3b0215f640 1 -- 172.21.15.50:0/809722126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3afc0cc440 con 0x7f3afc14ca00 2024-09-11T22:19:30.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.853+0000 7f3b0215f640 1 -- 172.21.15.50:0/809722126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3afc0d3820 con 0x7f3afc14ca00 2024-09-11T22:19:30.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.854+0000 7f3ae3fff640 1 -- 172.21.15.50:0/809722126 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3af403a850 con 0x7f3afc14ca00 2024-09-11T22:19:30.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.855+0000 7f3ae3fff640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3ae806be30 0x7f3ae806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:30.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.855+0000 7f3ae3fff640 1 -- 172.21.15.50:0/809722126 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f3af40aae60 con 0x7f3afc14ca00 2024-09-11T22:19:30.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.855+0000 7f3afb7fe640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3ae806be30 0x7f3ae806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:30.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.855+0000 7f3afb7fe640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3ae806be30 0x7f3ae806e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3aec001f90 tx=0x7f3aec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:30.859+0000 7f3ae3fff640 1 -- 172.21.15.50:0/809722126 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3af404a020 con 0x7f3afc14ca00 2024-09-11T22:19:31.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.073+0000 7f3b0215f640 1 -- 172.21.15.50:0/809722126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3afc15d8d0 con 0x7f3afc14ca00 2024-09-11T22:19:31.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.073+0000 7f3ae3fff640 1 -- 172.21.15.50:0/809722126 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7f3af4079130 con 0x7f3afc14ca00 2024-09-11T22:19:31.074 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:31.074 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:31.076 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.076+0000 7f3b0215f640 1 -- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3ae806be30 msgr2=0x7f3ae806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.076+0000 7f3b0215f640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3ae806be30 0x7f3ae806e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3aec001f90 tx=0x7f3aec009040 comp rx=0 tx=0).stop 2024-09-11T22:19:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.076+0000 7f3b0215f640 1 -- 172.21.15.50:0/809722126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc14ca00 msgr2=0x7f3afc0ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.076+0000 7f3b0215f640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc14ca00 0x7f3afc0ccc40 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f3af402abe0 tx=0x7f3af4004730 comp rx=0 tx=0).stop 2024-09-11T22:19:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.076+0000 7f3b0215f640 1 -- 172.21.15.50:0/809722126 shutdown_connections 2024-09-11T22:19:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.076+0000 7f3b0215f640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3ae806be30 0x7f3ae806e2f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.076+0000 7f3b0215f640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3afc15b590 0x7f3afc14c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.076+0000 7f3b0215f640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc14ca00 0x7f3afc0ccc40 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.076+0000 7f3b0215f640 1 --2- 172.21.15.50:0/809722126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae4005080 0x7f3afc0ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.076+0000 7f3b0215f640 1 -- 172.21.15.50:0/809722126 >> 172.21.15.50:0/809722126 conn(0x7f3afc0727a0 msgr2=0x7f3afc0b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.076+0000 7f3b0215f640 1 -- 172.21.15.50:0/809722126 shutdown_connections 2024-09-11T22:19:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.076+0000 7f3b0215f640 1 -- 172.21.15.50:0/809722126 wait complete. 2024-09-11T22:19:31.087 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-11T22:19:31.087 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:19:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.188+0000 7f138208d640 1 Processor -- start 2024-09-11T22:19:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.188+0000 7f138208d640 1 -- start start 2024-09-11T22:19:31.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.188+0000 7f138208d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f137c15f350 0x7f137c15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:31.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.188+0000 7f138208d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f137c0679c0 0x7f137c067e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:31.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.188+0000 7f138208d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137c15f7f0 con 0x7f137c15c3c0 2024-09-11T22:19:31.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.188+0000 7f138208d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f137c06e700 con 0x7f137c15f350 2024-09-11T22:19:31.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.188+0000 7f138208d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f137c15fad0 con 0x7f137c0679c0 2024-09-11T22:19:31.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.189+0000 7f137bfff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f137c0679c0 0x7f137c067e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:31.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.189+0000 7f137affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f137c15f350 0x7f137c15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:31.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.189+0000 7f137bfff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f137c0679c0 0x7f137c067e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:53072/0 (socket says 172.21.15.50:53072) 2024-09-11T22:19:31.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.189+0000 7f137b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f137c15c3c0 0x7f137c15ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:53176/0 (socket says 172.21.15.50:53176) 2024-09-11T22:19:31.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.189+0000 7f137bfff640 1 -- 172.21.15.50:0/835741276 learned_addr learned my addr 172.21.15.50:0/835741276 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:31.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.189+0000 7f137affd640 1 --2- 172.21.15.50:0/835741276 >> v2:172.21.15.77:3300/0 conn(0x7f137c15f350 0x7f137c15fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54404/0 (socket says 172.21.15.50:54404) 2024-09-11T22:19:31.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.189+0000 7f137affd640 1 -- 172.21.15.50:0/835741276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f137c0679c0 msgr2=0x7f137c067e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.189+0000 7f137affd640 1 --2- 172.21.15.50:0/835741276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f137c0679c0 0x7f137c067e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.189+0000 7f137affd640 1 -- 172.21.15.50:0/835741276 >> v1:172.21.15.77:6789/0 conn(0x7f137c15c3c0 legacy=0x7f137c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.189+0000 7f137affd640 1 -- 172.21.15.50:0/835741276 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c06e950 con 0x7f137c15f350 2024-09-11T22:19:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.190+0000 7f137affd640 1 --2- 172.21.15.50:0/835741276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f137c15f350 0x7f137c15fe60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f13640097a0 tx=0x7f136402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13a54a92c2f11d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.190+0000 7f137a7fc640 1 -- 172.21.15.50:0/835741276 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1364037070 con 0x7f137c15f350 2024-09-11T22:19:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.190+0000 7f137a7fc640 1 -- 172.21.15.50:0/835741276 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f136402ae50 con 0x7f137c15f350 2024-09-11T22:19:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.190+0000 7f137a7fc640 1 -- 172.21.15.50:0/835741276 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1364032660 con 0x7f137c15f350 2024-09-11T22:19:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.191+0000 7f138208d640 1 -- 172.21.15.50:0/835741276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f137c15f350 msgr2=0x7f137c15fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.191+0000 7f138208d640 1 --2- 172.21.15.50:0/835741276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f137c15f350 0x7f137c15fe60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f13640097a0 tx=0x7f136402a100 comp rx=0 tx=0).stop 2024-09-11T22:19:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.191+0000 7f138208d640 1 -- 172.21.15.50:0/835741276 shutdown_connections 2024-09-11T22:19:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.191+0000 7f138208d640 1 --2- 172.21.15.50:0/835741276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f137c0679c0 0x7f137c067e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.191+0000 7f138208d640 1 --2- 172.21.15.50:0/835741276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f137c15f350 0x7f137c15fe60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.191+0000 7f138208d640 1 -- 172.21.15.50:0/835741276 >> 172.21.15.50:0/835741276 conn(0x7f137c075060 msgr2=0x7f137c06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:31.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.191+0000 7f138208d640 1 -- 172.21.15.50:0/835741276 shutdown_connections 2024-09-11T22:19:31.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.191+0000 7f138208d640 1 -- 172.21.15.50:0/835741276 wait complete. 2024-09-11T22:19:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.192+0000 7f138208d640 1 Processor -- start 2024-09-11T22:19:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.192+0000 7f138208d640 1 -- start start 2024-09-11T22:19:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f138208d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137c0679c0 0x7f137c1e7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f138208d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f137c15c3c0 0x7f137c155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f138208d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f137c15f350 0x7f137c1e89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f138208d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f137c06f150 con 0x7f137c0679c0 2024-09-11T22:19:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f138208d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f137c0d0940 con 0x7f137c15c3c0 2024-09-11T22:19:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f138208d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f137c06f2d0 con 0x7f137c15f350 2024-09-11T22:19:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f137b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137c0679c0 0x7f137c1e7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f137b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137c0679c0 0x7f137c1e7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59308/0 (socket says 172.21.15.50:59308) 2024-09-11T22:19:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f137b7fe640 1 -- 172.21.15.50:0/3414576875 learned_addr learned my addr 172.21.15.50:0/3414576875 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f137bfff640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f137c15f350 0x7f137c1e89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f137affd640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f137c15c3c0 0x7f137c155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f137b7fe640 1 -- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f137c15f350 msgr2=0x7f137c1e89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f137b7fe640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f137c15f350 0x7f137c1e89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f137b7fe640 1 -- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f137c15c3c0 msgr2=0x7f137c155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f137b7fe640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f137c15c3c0 0x7f137c155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f137b7fe640 1 -- 172.21.15.50:0/3414576875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c156210 con 0x7f137c0679c0 2024-09-11T22:19:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.193+0000 7f137bfff640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f137c15f350 0x7f137c1e89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.194+0000 7f137b7fe640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137c0679c0 0x7f137c1e7b90 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f136c00c400 tx=0x7f136c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:31.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.194+0000 7f1373fff640 1 -- 172.21.15.50:0/3414576875 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c0074e0 con 0x7f137c0679c0 2024-09-11T22:19:31.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.194+0000 7f138208d640 1 -- 172.21.15.50:0/3414576875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137c1564f0 con 0x7f137c0679c0 2024-09-11T22:19:31.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.194+0000 7f1373fff640 1 -- 172.21.15.50:0/3414576875 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f136c007680 con 0x7f137c0679c0 2024-09-11T22:19:31.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.194+0000 7f1373fff640 1 -- 172.21.15.50:0/3414576875 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c004a00 con 0x7f137c0679c0 2024-09-11T22:19:31.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.194+0000 7f138208d640 1 -- 172.21.15.50:0/3414576875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f137c156ab0 con 0x7f137c0679c0 2024-09-11T22:19:31.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.195+0000 7f138208d640 1 -- 172.21.15.50:0/3414576875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f137c06cae0 con 0x7f137c0679c0 2024-09-11T22:19:31.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.195+0000 7f1373fff640 1 -- 172.21.15.50:0/3414576875 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f136c01a020 con 0x7f137c0679c0 2024-09-11T22:19:31.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.196+0000 7f1373fff640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f135c06be30 0x7f135c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:31.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.196+0000 7f1373fff640 1 -- 172.21.15.50:0/3414576875 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f136c08a5f0 con 0x7f137c0679c0 2024-09-11T22:19:31.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.196+0000 7f137affd640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f135c06be30 0x7f135c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:31.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.197+0000 7f137affd640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f135c06be30 0x7f135c06e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1364034000 tx=0x7f136402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.200+0000 7f1373fff640 1 -- 172.21.15.50:0/3414576875 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f136c0588d0 con 0x7f137c0679c0 2024-09-11T22:19:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.443+0000 7f138208d640 1 -- 172.21.15.50:0/3414576875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f137c161f80 con 0x7f137c0679c0 2024-09-11T22:19:31.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.443+0000 7f1373fff640 1 -- 172.21.15.50:0/3414576875 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1488 (secure 0 0 0) 0x7f136c05cbd0 con 0x7f137c0679c0 2024-09-11T22:19:31.444 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:31.444 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":520,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":132,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1041,"data_bytes":1068988791,"bytes_used":2535915520,"bytes_avail":770558197760,"bytes_total":773094113280,"write_bytes_sec":87101320,"read_op_per_sec":0,"write_op_per_sec":85},"fsmap":{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8412}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-11T22:18:49.475903+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:19:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.446+0000 7f138208d640 1 -- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f135c06be30 msgr2=0x7f135c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.446+0000 7f138208d640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f135c06be30 0x7f135c06e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1364034000 tx=0x7f136402e000 comp rx=0 tx=0).stop 2024-09-11T22:19:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.446+0000 7f138208d640 1 -- 172.21.15.50:0/3414576875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137c0679c0 msgr2=0x7f137c1e7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.446+0000 7f138208d640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137c0679c0 0x7f137c1e7b90 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f136c00c400 tx=0x7f136c00c8c0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.446+0000 7f138208d640 1 -- 172.21.15.50:0/3414576875 shutdown_connections 2024-09-11T22:19:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.446+0000 7f138208d640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f135c06be30 0x7f135c06e2f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.446+0000 7f138208d640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f137c15f350 0x7f137c1e89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.446+0000 7f138208d640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f137c15c3c0 0x7f137c155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.446+0000 7f138208d640 1 --2- 172.21.15.50:0/3414576875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137c0679c0 0x7f137c1e7b90 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.446+0000 7f138208d640 1 -- 172.21.15.50:0/3414576875 >> 172.21.15.50:0/3414576875 conn(0x7f137c075060 msgr2=0x7f137c0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:31.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.446+0000 7f138208d640 1 -- 172.21.15.50:0/3414576875 shutdown_connections 2024-09-11T22:19:31.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:31.446+0000 7f138208d640 1 -- 172.21.15.50:0/3414576875 wait complete. 2024-09-11T22:19:31.457 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-11T22:19:32.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.572+0000 7fbe87c9b640 1 Processor -- start 2024-09-11T22:19:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.572+0000 7fbe87c9b640 1 -- start start 2024-09-11T22:19:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.573+0000 7fbe87c9b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe8015c2c0 0x7fbe800b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.573+0000 7fbe87c9b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe800b4f00 con 0x7fbe800b3e10 2024-09-11T22:19:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.573+0000 7fbe87c9b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe800b4360 con 0x7fbe800d05e0 2024-09-11T22:19:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.573+0000 7fbe87c9b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbe800b51c0 con 0x7fbe8015c2c0 2024-09-11T22:19:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.574+0000 7fbe85236640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbe800b3e10 0x7fbe800cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51854/0 (socket says 172.21.15.50:51854) 2024-09-11T22:19:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.574+0000 7fbe85236640 1 -- 172.21.15.50:0/394806056 learned_addr learned my addr 172.21.15.50:0/394806056 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.574+0000 7fbe85a37640 1 --2- 172.21.15.50:0/394806056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe8015c2c0 0x7fbe800b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.574+0000 7fbe84a35640 1 -- 172.21.15.50:0/394806056 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 987126958 0 0) 0x7fbe800b4f00 con 0x7fbe800b3e10 2024-09-11T22:19:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.574+0000 7fbe84a35640 1 -- 172.21.15.50:0/394806056 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe68003520 con 0x7fbe800b3e10 2024-09-11T22:19:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.574+0000 7fbe84a35640 1 -- 172.21.15.50:0/394806056 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3367264252 0 0) 0x7fbe800b4360 con 0x7fbe800d05e0 2024-09-11T22:19:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.574+0000 7fbe84a35640 1 -- 172.21.15.50:0/394806056 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe800b4f00 con 0x7fbe800d05e0 2024-09-11T22:19:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.574+0000 7fbe85a37640 1 -- 172.21.15.50:0/394806056 >> v1:172.21.15.77:6789/0 conn(0x7fbe800d05e0 legacy=0x7fbe800ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.574+0000 7fbe85a37640 1 -- 172.21.15.50:0/394806056 >> v1:172.21.15.50:6789/0 conn(0x7fbe800b3e10 legacy=0x7fbe800cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.574+0000 7fbe85a37640 1 -- 172.21.15.50:0/394806056 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe800b54a0 con 0x7fbe8015c2c0 2024-09-11T22:19:32.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.575+0000 7fbe85a37640 1 --2- 172.21.15.50:0/394806056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe8015c2c0 0x7fbe800b46a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009dc0 tx=0x7fbe7002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5150d6bf5f436bdd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:32.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.575+0000 7fbe84a35640 1 -- 172.21.15.50:0/394806056 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7002ae60 con 0x7fbe8015c2c0 2024-09-11T22:19:32.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.575+0000 7fbe84a35640 1 -- 172.21.15.50:0/394806056 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe70007740 con 0x7fbe8015c2c0 2024-09-11T22:19:32.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.575+0000 7fbe84a35640 1 -- 172.21.15.50:0/394806056 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70007b10 con 0x7fbe8015c2c0 2024-09-11T22:19:32.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.576+0000 7fbe87c9b640 1 -- 172.21.15.50:0/394806056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe8015c2c0 msgr2=0x7fbe800b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:32.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.576+0000 7fbe87c9b640 1 --2- 172.21.15.50:0/394806056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe8015c2c0 0x7fbe800b46a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009dc0 tx=0x7fbe7002a640 comp rx=0 tx=0).stop 2024-09-11T22:19:32.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.576+0000 7fbe87c9b640 1 -- 172.21.15.50:0/394806056 shutdown_connections 2024-09-11T22:19:32.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.576+0000 7fbe87c9b640 1 --2- 172.21.15.50:0/394806056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe8015c2c0 0x7fbe800b46a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.576+0000 7fbe87c9b640 1 -- 172.21.15.50:0/394806056 >> 172.21.15.50:0/394806056 conn(0x7fbe800679c0 msgr2=0x7fbe80067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:32.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.576+0000 7fbe87c9b640 1 -- 172.21.15.50:0/394806056 shutdown_connections 2024-09-11T22:19:32.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.576+0000 7fbe87c9b640 1 -- 172.21.15.50:0/394806056 wait complete. 2024-09-11T22:19:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.577+0000 7fbe87c9b640 1 Processor -- start 2024-09-11T22:19:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.577+0000 7fbe87c9b640 1 -- start start 2024-09-11T22:19:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe87c9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe800b3e10 0x7fbe800ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe87c9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d05e0 0x7fbe800ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe87c9b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe8015c2c0 0x7fbe800ad720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe87c9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8006d070 con 0x7fbe800d05e0 2024-09-11T22:19:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe87c9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe800ce200 con 0x7fbe800b3e10 2024-09-11T22:19:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe87c9b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbe8006d1f0 con 0x7fbe8015c2c0 2024-09-11T22:19:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe85236640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d05e0 0x7fbe800ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe85236640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d05e0 0x7fbe800ad1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59316/0 (socket says 172.21.15.50:59316) 2024-09-11T22:19:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe85236640 1 -- 172.21.15.50:0/2991068945 learned_addr learned my addr 172.21.15.50:0/2991068945 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe85a37640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe800b3e10 0x7fbe800ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe86238640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe8015c2c0 0x7fbe800ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe85236640 1 -- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe8015c2c0 msgr2=0x7fbe800ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe85236640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe8015c2c0 0x7fbe800ad720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe85236640 1 -- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe800b3e10 msgr2=0x7fbe800ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe85236640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe800b3e10 0x7fbe800ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe85236640 1 -- 172.21.15.50:0/2991068945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe80152430 con 0x7fbe800d05e0 2024-09-11T22:19:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.578+0000 7fbe86238640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe8015c2c0 0x7fbe800ad720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.579+0000 7fbe85236640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d05e0 0x7fbe800ad1e0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400c500 tx=0x7fbe7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.579+0000 7fbe7e7fc640 1 -- 172.21.15.50:0/2991068945 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74017070 con 0x7fbe800d05e0 2024-09-11T22:19:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.579+0000 7fbe7e7fc640 1 -- 172.21.15.50:0/2991068945 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe74005ce0 con 0x7fbe800d05e0 2024-09-11T22:19:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.579+0000 7fbe87c9b640 1 -- 172.21.15.50:0/2991068945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe80071b70 con 0x7fbe800d05e0 2024-09-11T22:19:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.579+0000 7fbe7e7fc640 1 -- 172.21.15.50:0/2991068945 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe740072f0 con 0x7fbe800d05e0 2024-09-11T22:19:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.579+0000 7fbe87c9b640 1 -- 172.21.15.50:0/2991068945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe80072130 con 0x7fbe800d05e0 2024-09-11T22:19:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.580+0000 7fbe87c9b640 1 -- 172.21.15.50:0/2991068945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe8015c6a0 con 0x7fbe800d05e0 2024-09-11T22:19:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.580+0000 7fbe7e7fc640 1 -- 172.21.15.50:0/2991068945 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe7401a070 con 0x7fbe800d05e0 2024-09-11T22:19:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.581+0000 7fbe7e7fc640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe6c06be30 0x7fbe6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.581+0000 7fbe7e7fc640 1 -- 172.21.15.50:0/2991068945 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fbe7408a150 con 0x7fbe800d05e0 2024-09-11T22:19:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.581+0000 7fbe85a37640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe6c06be30 0x7fbe6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.582+0000 7fbe85a37640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe6c06be30 0x7fbe6c06e2f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbe70034000 tx=0x7fbe70033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.585+0000 7fbe7e7fc640 1 -- 172.21.15.50:0/2991068945 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe74058540 con 0x7fbe800d05e0 2024-09-11T22:19:32.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.797+0000 7fbe87c9b640 1 -- 172.21.15.50:0/2991068945 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe80160e70 con 0x7fbe800d05e0 2024-09-11T22:19:32.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.797+0000 7fbe7e7fc640 1 -- 172.21.15.50:0/2991068945 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7fbe7405c840 con 0x7fbe800d05e0 2024-09-11T22:19:32.799 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:32.800 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:32.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.799+0000 7fbe87c9b640 1 -- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe6c06be30 msgr2=0x7fbe6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.799+0000 7fbe87c9b640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe6c06be30 0x7fbe6c06e2f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbe70034000 tx=0x7fbe70033040 comp rx=0 tx=0).stop 2024-09-11T22:19:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.799+0000 7fbe87c9b640 1 -- 172.21.15.50:0/2991068945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d05e0 msgr2=0x7fbe800ad1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.799+0000 7fbe87c9b640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d05e0 0x7fbe800ad1e0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400c500 tx=0x7fbe7400c9c0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.799+0000 7fbe87c9b640 1 -- 172.21.15.50:0/2991068945 shutdown_connections 2024-09-11T22:19:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.799+0000 7fbe87c9b640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe6c06be30 0x7fbe6c06e2f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.799+0000 7fbe87c9b640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe8015c2c0 0x7fbe800ad720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.799+0000 7fbe87c9b640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d05e0 0x7fbe800ad1e0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.799+0000 7fbe87c9b640 1 --2- 172.21.15.50:0/2991068945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe800b3e10 0x7fbe800ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.799+0000 7fbe87c9b640 1 -- 172.21.15.50:0/2991068945 >> 172.21.15.50:0/2991068945 conn(0x7fbe800679c0 msgr2=0x7fbe8015ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.800+0000 7fbe87c9b640 1 -- 172.21.15.50:0/2991068945 shutdown_connections 2024-09-11T22:19:32.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.800+0000 7fbe87c9b640 1 -- 172.21.15.50:0/2991068945 wait complete. 2024-09-11T22:19:32.812 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-11T22:19:32.813 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:19:32.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.912+0000 7fddfcea5640 1 Processor -- start 2024-09-11T22:19:32.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.912+0000 7fddfcea5640 1 -- start start 2024-09-11T22:19:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.913+0000 7fddfcea5640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddf80d1c90 0x7fddf80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.913+0000 7fddfcea5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddf8162350 0x7fddf81627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.913+0000 7fddfcea5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf8163080 con 0x7fddf815e8e0 2024-09-11T22:19:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.913+0000 7fddfcea5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fddf815ecc0 con 0x7fddf8162350 2024-09-11T22:19:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.913+0000 7fddfcea5640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fddf80d2ad0 con 0x7fddf80d1c90 2024-09-11T22:19:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.913+0000 7fddf6d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddf8162350 0x7fddf81627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.913+0000 7fddf6d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddf8162350 0x7fddf81627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59320/0 (socket says 172.21.15.50:59320) 2024-09-11T22:19:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.913+0000 7fddf659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fddf815e8e0 0x7fddf80d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51862/0 (socket says 172.21.15.50:51862) 2024-09-11T22:19:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.913+0000 7fddf6d9d640 1 -- 172.21.15.50:0/2639835370 learned_addr learned my addr 172.21.15.50:0/2639835370 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.914+0000 7fddf6d9d640 1 -- 172.21.15.50:0/2639835370 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddf80d1c90 msgr2=0x7fddf80b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.914+0000 7fddf5d9b640 1 --2- 172.21.15.50:0/2639835370 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddf80d1c90 0x7fddf80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.914+0000 7fddf6d9d640 1 --2- 172.21.15.50:0/2639835370 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddf80d1c90 0x7fddf80b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.914+0000 7fddf6d9d640 1 -- 172.21.15.50:0/2639835370 >> v1:172.21.15.50:6789/0 conn(0x7fddf815e8e0 legacy=0x7fddf80d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.914+0000 7fddf559a640 1 -- 172.21.15.50:0/2639835370 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2673395007 0 0) 0x7fddf8163080 con 0x7fddf815e8e0 2024-09-11T22:19:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.914+0000 7fddf6d9d640 1 -- 172.21.15.50:0/2639835370 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf80d2d20 con 0x7fddf8162350 2024-09-11T22:19:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.914+0000 7fddf6d9d640 1 --2- 172.21.15.50:0/2639835370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf8162350 0x7fddf81627e0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009870 tx=0x7fddf002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8201b43273e3612 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.915+0000 7fddf559a640 1 -- 172.21.15.50:0/2639835370 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0037070 con 0x7fddf8162350 2024-09-11T22:19:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.915+0000 7fddf559a640 1 -- 172.21.15.50:0/2639835370 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf002ae50 con 0x7fddf8162350 2024-09-11T22:19:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.915+0000 7fddf559a640 1 -- 172.21.15.50:0/2639835370 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0032860 con 0x7fddf8162350 2024-09-11T22:19:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.915+0000 7fddfcea5640 1 -- 172.21.15.50:0/2639835370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf8162350 msgr2=0x7fddf81627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.915+0000 7fddfcea5640 1 --2- 172.21.15.50:0/2639835370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf8162350 0x7fddf81627e0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009870 tx=0x7fddf002a300 comp rx=0 tx=0).stop 2024-09-11T22:19:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.915+0000 7fddfcea5640 1 -- 172.21.15.50:0/2639835370 shutdown_connections 2024-09-11T22:19:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.915+0000 7fddfcea5640 1 --2- 172.21.15.50:0/2639835370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf8162350 0x7fddf81627e0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.915+0000 7fddfcea5640 1 --2- 172.21.15.50:0/2639835370 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddf80d1c90 0x7fddf80b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.915+0000 7fddfcea5640 1 -- 172.21.15.50:0/2639835370 >> 172.21.15.50:0/2639835370 conn(0x7fddf8067ba0 msgr2=0x7fddf8067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.915+0000 7fddfcea5640 1 -- 172.21.15.50:0/2639835370 shutdown_connections 2024-09-11T22:19:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.915+0000 7fddfcea5640 1 -- 172.21.15.50:0/2639835370 wait complete. 2024-09-11T22:19:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.917+0000 7fddfcea5640 1 Processor -- start 2024-09-11T22:19:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.917+0000 7fddfcea5640 1 -- start start 2024-09-11T22:19:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.917+0000 7fddfcea5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80d1c90 0x7fddf8155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.917+0000 7fddfcea5640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddf815e8e0 0x7fddf80b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.917+0000 7fddfcea5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf8162350 0x7fddf815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.917+0000 7fddfcea5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fddf8162d20 con 0x7fddf80d1c90 2024-09-11T22:19:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.917+0000 7fddfcea5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fddf80d3370 con 0x7fddf8162350 2024-09-11T22:19:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.917+0000 7fddfcea5640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fddf80d3800 con 0x7fddf815e8e0 2024-09-11T22:19:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.917+0000 7fddf659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80d1c90 0x7fddf8155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.917+0000 7fddf659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80d1c90 0x7fddf8155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59336/0 (socket says 172.21.15.50:59336) 2024-09-11T22:19:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.917+0000 7fddf659c640 1 -- 172.21.15.50:0/51279309 learned_addr learned my addr 172.21.15.50:0/51279309 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.918+0000 7fddf5d9b640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddf815e8e0 0x7fddf80b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.918+0000 7fddf659c640 1 -- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddf815e8e0 msgr2=0x7fddf80b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.918+0000 7fddf6d9d640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf8162350 0x7fddf815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.918+0000 7fddf659c640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddf815e8e0 0x7fddf80b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.918+0000 7fddf659c640 1 -- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf8162350 msgr2=0x7fddf815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.918+0000 7fddf659c640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf8162350 0x7fddf815d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.918+0000 7fddf659c640 1 -- 172.21.15.50:0/51279309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf81e8ca0 con 0x7fddf80d1c90 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.918+0000 7fddf659c640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80d1c90 0x7fddf8155850 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fdde800c890 tx=0x7fdde800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.918+0000 7fddeeffd640 1 -- 172.21.15.50:0/51279309 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde8018070 con 0x7fddf80d1c90 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.918+0000 7fddeeffd640 1 -- 172.21.15.50:0/51279309 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde800a640 con 0x7fddf80d1c90 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.918+0000 7fddfcea5640 1 -- 172.21.15.50:0/51279309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf81e8f80 con 0x7fddf80d1c90 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.918+0000 7fddeeffd640 1 -- 172.21.15.50:0/51279309 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde800aa30 con 0x7fddf80d1c90 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.918+0000 7fddfcea5640 1 -- 172.21.15.50:0/51279309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf81e9540 con 0x7fddf80d1c90 2024-09-11T22:19:32.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.919+0000 7fddfcea5640 1 -- 172.21.15.50:0/51279309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf80b7880 con 0x7fddf80d1c90 2024-09-11T22:19:32.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.920+0000 7fddeeffd640 1 -- 172.21.15.50:0/51279309 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdde801b070 con 0x7fddf80d1c90 2024-09-11T22:19:32.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.920+0000 7fddeeffd640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddd806be30 0x7fddd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:32.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.920+0000 7fddeeffd640 1 -- 172.21.15.50:0/51279309 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fdde808a4e0 con 0x7fddf80d1c90 2024-09-11T22:19:32.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.920+0000 7fddf5d9b640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddd806be30 0x7fddd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:32.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.921+0000 7fddf5d9b640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddd806be30 0x7fddd806e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdde0006fd0 tx=0x7fdde0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:32.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:32.925+0000 7fddeeffd640 1 -- 172.21.15.50:0/51279309 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdde8058f20 con 0x7fddf80d1c90 2024-09-11T22:19:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.167+0000 7fddfcea5640 1 -- 172.21.15.50:0/51279309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fddf8156430 con 0x7fddf80d1c90 2024-09-11T22:19:33.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.167+0000 7fddeeffd640 1 -- 172.21.15.50:0/51279309 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7fdde8058820 con 0x7fddf80d1c90 2024-09-11T22:19:33.169 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:33.169 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":521,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":132,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076328823,"bytes_used":2588344320,"bytes_avail":770505768960,"bytes_total":773094113280,"write_bytes_sec":67442827,"read_op_per_sec":0,"write_op_per_sec":66},"fsmap":{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8412}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-11T22:19:31.485493+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:19:33.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.169+0000 7fddfcea5640 1 -- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddd806be30 msgr2=0x7fddd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.169+0000 7fddfcea5640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddd806be30 0x7fddd806e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdde0006fd0 tx=0x7fdde0008040 comp rx=0 tx=0).stop 2024-09-11T22:19:33.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.169+0000 7fddfcea5640 1 -- 172.21.15.50:0/51279309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80d1c90 msgr2=0x7fddf8155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.169+0000 7fddfcea5640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80d1c90 0x7fddf8155850 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fdde800c890 tx=0x7fdde800cd50 comp rx=0 tx=0).stop 2024-09-11T22:19:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.169+0000 7fddfcea5640 1 -- 172.21.15.50:0/51279309 shutdown_connections 2024-09-11T22:19:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.169+0000 7fddfcea5640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fddd806be30 0x7fddd806e2f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.169+0000 7fddfcea5640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddf815e8e0 0x7fddf80b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.169+0000 7fddfcea5640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf8162350 0x7fddf815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.169+0000 7fddfcea5640 1 --2- 172.21.15.50:0/51279309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddf80d1c90 0x7fddf8155850 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.169+0000 7fddfcea5640 1 -- 172.21.15.50:0/51279309 >> 172.21.15.50:0/51279309 conn(0x7fddf8067ba0 msgr2=0x7fddf80b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.169+0000 7fddfcea5640 1 -- 172.21.15.50:0/51279309 shutdown_connections 2024-09-11T22:19:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.169+0000 7fddfcea5640 1 -- 172.21.15.50:0/51279309 wait complete. 2024-09-11T22:19:33.182 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-11T22:19:33.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:33.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub resume 2024-09-11T22:19:33.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.284+0000 7fed89fbd640 1 Processor -- start 2024-09-11T22:19:33.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.284+0000 7fed89fbd640 1 -- start start 2024-09-11T22:19:33.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.285+0000 7fed89fbd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed840d18a0 0x7fed840d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.285+0000 7fed89fbd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed840cfa80 con 0x7fed840d3a30 2024-09-11T22:19:33.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.285+0000 7fed89fbd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed840d40d0 con 0x7fed8415e870 2024-09-11T22:19:33.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.285+0000 7fed89fbd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fed840d3ea0 con 0x7fed840d18a0 2024-09-11T22:19:33.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.285+0000 7fed83fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fed840d3a30 0x7fed840b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51876/0 (socket says 172.21.15.50:51876) 2024-09-11T22:19:33.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.285+0000 7fed83fff640 1 -- 172.21.15.50:0/1683042377 learned_addr learned my addr 172.21.15.50:0/1683042377 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:33.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed82ffd640 1 --2- 172.21.15.50:0/1683042377 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed840d18a0 0x7fed840d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475417541 0 0) 0x7fed7c001490 con 0x7fed840d3a30 2024-09-11T22:19:33.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed6c003520 con 0x7fed840d3a30 2024-09-11T22:19:33.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 569864193 0 0) 0x7fed6c003520 con 0x7fed840d3a30 2024-09-11T22:19:33.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed840d18a0 msgr2=0x7fed840d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 --2- 172.21.15.50:0/1683042377 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed840d18a0 0x7fed840d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 >> v1:172.21.15.77:6789/0 conn(0x7fed8415e870 legacy=0x7fed840d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed840d43b0 con 0x7fed840d3a30 2024-09-11T22:19:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fed7c001bc0 con 0x7fed840d3a30 2024-09-11T22:19:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 >> v1:172.21.15.50:6789/0 conn(0x7fed840d3a30 legacy=0x7fed840b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 --2- 172.21.15.50:0/1683042377 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed840d18a0 0x7fed6c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 --2- 172.21.15.50:0/1683042377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6c003f60 0x7fed6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 --2- 172.21.15.50:0/1683042377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed6c004d40 0x7fed6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c00ba70 con 0x7fed6c004d40 2024-09-11T22:19:33.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c00bc20 con 0x7fed6c003f60 2024-09-11T22:19:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fed6c00be20 con 0x7fed840d18a0 2024-09-11T22:19:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed83fff640 1 --2- 172.21.15.50:0/1683042377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed6c004d40 0x7fed6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed837fe640 1 --2- 172.21.15.50:0/1683042377 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed840d18a0 0x7fed6c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed82ffd640 1 --2- 172.21.15.50:0/1683042377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6c003f60 0x7fed6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed83fff640 1 -- 172.21.15.50:0/1683042377 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed840d18a0 msgr2=0x7fed6c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed83fff640 1 --2- 172.21.15.50:0/1683042377 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed840d18a0 0x7fed6c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed83fff640 1 -- 172.21.15.50:0/1683042377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6c003f60 msgr2=0x7fed6c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed83fff640 1 --2- 172.21.15.50:0/1683042377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6c003f60 0x7fed6c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.286+0000 7fed83fff640 1 -- 172.21.15.50:0/1683042377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6c003520 con 0x7fed6c004d40 2024-09-11T22:19:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.287+0000 7fed83fff640 1 --2- 172.21.15.50:0/1683042377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed6c004d40 0x7fed6c0051c0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00aa20 tx=0x7fed6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923c46aa1d97ccaf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.287+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c00a640 con 0x7fed6c004d40 2024-09-11T22:19:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.287+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed7c02f070 con 0x7fed6c004d40 2024-09-11T22:19:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.287+0000 7fed827fc640 1 -- 172.21.15.50:0/1683042377 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c034470 con 0x7fed6c004d40 2024-09-11T22:19:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.288+0000 7fed89fbd640 1 -- 172.21.15.50:0/1683042377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed6c004d40 msgr2=0x7fed6c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.288+0000 7fed89fbd640 1 --2- 172.21.15.50:0/1683042377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed6c004d40 0x7fed6c0051c0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00aa20 tx=0x7fed6c005830 comp rx=0 tx=0).stop 2024-09-11T22:19:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.288+0000 7fed83fff640 1 -- 172.21.15.50:0/1683042377 reap_dead start 2024-09-11T22:19:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.288+0000 7fed89fbd640 1 -- 172.21.15.50:0/1683042377 shutdown_connections 2024-09-11T22:19:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.288+0000 7fed89fbd640 1 -- 172.21.15.50:0/1683042377 >> 172.21.15.50:0/1683042377 conn(0x7fed840727a0 msgr2=0x7fed840679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.288+0000 7fed89fbd640 1 -- 172.21.15.50:0/1683042377 shutdown_connections 2024-09-11T22:19:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.288+0000 7fed89fbd640 1 -- 172.21.15.50:0/1683042377 wait complete. 2024-09-11T22:19:33.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.289+0000 7fed89fbd640 1 Processor -- start 2024-09-11T22:19:33.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.289+0000 7fed89fbd640 1 -- start start 2024-09-11T22:19:33.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed89fbd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed6c004d40 0x7fed841f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed89fbd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed840cc260 0x7fed84157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed89fbd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed84157b60 0x7fed841f8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed89fbd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fed8415ec50 con 0x7fed84157b60 2024-09-11T22:19:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed89fbd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed840b7ee0 con 0x7fed840cc260 2024-09-11T22:19:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed89fbd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fed840b78b0 con 0x7fed6c004d40 2024-09-11T22:19:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed84157b60 0x7fed841f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed84157b60 0x7fed841f8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59354/0 (socket says 172.21.15.50:59354) 2024-09-11T22:19:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed83fff640 1 -- 172.21.15.50:0/4214447547 learned_addr learned my addr 172.21.15.50:0/4214447547 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed82ffd640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed840cc260 0x7fed84157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed837fe640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed6c004d40 0x7fed841f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed83fff640 1 -- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed6c004d40 msgr2=0x7fed841f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed83fff640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed6c004d40 0x7fed841f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed83fff640 1 -- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed840cc260 msgr2=0x7fed84157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed83fff640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed840cc260 0x7fed84157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed83fff640 1 -- 172.21.15.50:0/4214447547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed840cca90 con 0x7fed84157b60 2024-09-11T22:19:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.290+0000 7fed837fe640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed6c004d40 0x7fed841f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.291+0000 7fed83fff640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed84157b60 0x7fed841f8420 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fed7c02b6e0 tx=0x7fed840d42a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.291+0000 7fed6bfff640 1 -- 172.21.15.50:0/4214447547 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c00a640 con 0x7fed84157b60 2024-09-11T22:19:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.291+0000 7fed6bfff640 1 -- 172.21.15.50:0/4214447547 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed7c034880 con 0x7fed84157b60 2024-09-11T22:19:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.291+0000 7fed89fbd640 1 -- 172.21.15.50:0/4214447547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed84158d50 con 0x7fed84157b60 2024-09-11T22:19:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.291+0000 7fed6bfff640 1 -- 172.21.15.50:0/4214447547 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c034c50 con 0x7fed84157b60 2024-09-11T22:19:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.291+0000 7fed89fbd640 1 -- 172.21.15.50:0/4214447547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed84159310 con 0x7fed84157b60 2024-09-11T22:19:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.292+0000 7fed6bfff640 1 -- 172.21.15.50:0/4214447547 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed7c007070 con 0x7fed84157b60 2024-09-11T22:19:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.293+0000 7fed6bfff640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed7006be60 0x7fed7006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.293+0000 7fed6bfff640 1 -- 172.21.15.50:0/4214447547 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fed7c0ab140 con 0x7fed84157b60 2024-09-11T22:19:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.293+0000 7fed837fe640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed7006be60 0x7fed7006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.294+0000 7fed837fe640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed7006be60 0x7fed7006e320 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fed740036b0 tx=0x7fed74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.294+0000 7fed8ce32740 1 Processor -- start 2024-09-11T22:19:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.294+0000 7fed8ce32740 1 -- start start 2024-09-11T22:19:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed8ce32740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc4e920 0x55aecbc940c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed8ce32740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc4c0e0 0x55aecbc4ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed8ce32740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc500b0 0x55aecbc491a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed8ce32740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aecbbb16f0 con 0x55aecbc500b0 2024-09-11T22:19:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed8ce32740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55aecbb59330 con 0x55aecbc4c0e0 2024-09-11T22:19:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed8ce32740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55aecbbad6b0 con 0x55aecbc4e920 2024-09-11T22:19:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc500b0 0x55aecbc491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc500b0 0x55aecbc491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59362/0 (socket says 172.21.15.50:59362) 2024-09-11T22:19:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed83fff640 1 -- 172.21.15.50:0/2674276350 learned_addr learned my addr 172.21.15.50:0/2674276350 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed82ffd640 1 --2- 172.21.15.50:0/2674276350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc4c0e0 0x55aecbc4ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed83fff640 1 -- 172.21.15.50:0/2674276350 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc4e920 msgr2=0x55aecbc940c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed83fff640 1 --2- 172.21.15.50:0/2674276350 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc4e920 0x55aecbc940c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed83fff640 1 -- 172.21.15.50:0/2674276350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc4c0e0 msgr2=0x55aecbc4ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed83fff640 1 --2- 172.21.15.50:0/2674276350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc4c0e0 0x55aecbc4ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed83fff640 1 -- 172.21.15.50:0/2674276350 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aecbb7f0d0 con 0x55aecbc500b0 2024-09-11T22:19:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed83fff640 1 --2- 172.21.15.50:0/2674276350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc500b0 0x55aecbc491a0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0a95b0 tx=0x7fed7c078fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c72dcde00610d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed697fa640 1 -- 172.21.15.50:0/2674276350 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c079a60 con 0x55aecbc500b0 2024-09-11T22:19:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed697fa640 1 -- 172.21.15.50:0/2674276350 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed7c02f070 con 0x55aecbc500b0 2024-09-11T22:19:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.295+0000 7fed697fa640 1 -- 172.21.15.50:0/2674276350 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c079360 con 0x55aecbc500b0 2024-09-11T22:19:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.296+0000 7fed8ce32740 1 -- 172.21.15.50:0/2674276350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc500b0 msgr2=0x55aecbc491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.296+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2674276350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc500b0 0x55aecbc491a0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0a95b0 tx=0x7fed7c078fd0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.296+0000 7fed8ce32740 1 -- 172.21.15.50:0/2674276350 shutdown_connections 2024-09-11T22:19:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.296+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2674276350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc500b0 0x55aecbc491a0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.296+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2674276350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc4c0e0 0x55aecbc4ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.296+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2674276350 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc4e920 0x55aecbc940c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.296+0000 7fed8ce32740 1 -- 172.21.15.50:0/2674276350 >> 172.21.15.50:0/2674276350 conn(0x55aecbc4b370 msgr2=0x55aecbc93590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.296+0000 7fed8ce32740 1 -- 172.21.15.50:0/2674276350 shutdown_connections 2024-09-11T22:19:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.296+0000 7fed8ce32740 1 -- 172.21.15.50:0/2674276350 wait complete. 2024-09-11T22:19:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.297+0000 7fed8ce32740 1 -- start start 2024-09-11T22:19:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.297+0000 7fed8ce32740 1 Processor -- start 2024-09-11T22:19:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed8ce32740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 0x55aecbc79090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed8ce32740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc500b0 0x55aecbc6dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed8ce32740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc78210 0x55aecbc495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed8ce32740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aecbb59330 con 0x55aecbc4e920 2024-09-11T22:19:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed8ce32740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55aecbb3a4f0 con 0x55aecbc500b0 2024-09-11T22:19:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed8ce32740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55aecbbb16f0 con 0x55aecbc78210 2024-09-11T22:19:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed8ce32740 10 client.0 _ll_register_callbacks cb 0x55aecbb5bb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 0x55aecbc79090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 0x55aecbc79090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59368/0 (socket says 172.21.15.50:59368) 2024-09-11T22:19:33.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed837fe640 1 -- 172.21.15.50:0/1222126090 learned_addr learned my addr 172.21.15.50:0/1222126090 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:33.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed83fff640 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc78210 0x55aecbc495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed82ffd640 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc500b0 0x55aecbc6dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed837fe640 1 -- 172.21.15.50:0/1222126090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc78210 msgr2=0x55aecbc495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed837fe640 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc78210 0x55aecbc495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed837fe640 1 -- 172.21.15.50:0/1222126090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc500b0 msgr2=0x55aecbc6dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed837fe640 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc500b0 0x55aecbc6dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed837fe640 1 -- 172.21.15.50:0/1222126090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aecb98e7d0 con 0x55aecbc4e920 2024-09-11T22:19:33.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed83fff640 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc78210 0x55aecbc495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:33.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed82ffd640 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc500b0 0x55aecbc6dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:33.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed837fe640 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 0x55aecbc79090 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fed74017500 tx=0x7fed74007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7268cd2cb3745e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.298+0000 7fed627fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:19:33.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed627fc640 1 -- 172.21.15.50:0/1222126090 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74015470 con 0x55aecbc4e920 2024-09-11T22:19:33.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed627fc640 1 -- 172.21.15.50:0/1222126090 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fed74025ad0 con 0x55aecbc4e920 2024-09-11T22:19:33.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed8ce32740 1 -- 172.21.15.50:0/1222126090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed7c02f070 con 0x55aecbc4e920 2024-09-11T22:19:33.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed627fc640 1 -- 172.21.15.50:0/1222126090 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7fed74025cd0 con 0x55aecbc4e920 2024-09-11T22:19:33.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed8ce32740 10 client.8688 fetch_fsmap learned FSMap version 94 2024-09-11T22:19:33.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed8ce32740 1 -- 172.21.15.50:0/1222126090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55aecb8c43f0 con 0x55aecbc4e920 2024-09-11T22:19:33.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed627fc640 1 -- 172.21.15.50:0/1222126090 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed7c02f070 con 0x55aecbc4e920 2024-09-11T22:19:33.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed627fc640 1 -- 172.21.15.50:0/1222126090 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7fed7402c050 con 0x55aecbc4e920 2024-09-11T22:19:33.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed8ce32740 10 client.8688 fetch_fsmap finished waiting for FSMap version 94 2024-09-11T22:19:33.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed8ce32740 10 client.8688 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-11T22:19:33.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed8ce32740 20 client.8688 populate_metadata read hostname 'smithi050' 2024-09-11T22:19:33.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed8ce32740 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aecbc76420 0x55aecbc76800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed8ce32740 4 client.8688 mds_command: new command op to 8412 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:33.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed8ce32740 1 -- 172.21.15.50:0/1222126090 --> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aecbbbee20 con 0x55aecbc76420 2024-09-11T22:19:33.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed82ffd640 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aecbc76420 0x55aecbc76800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed82ffd640 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aecbc76420 0x55aecbc76800 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e00b70af1dfbd789 server_cookie=4c4ae6306172b060 in_seq=0 out_seq=0 2024-09-11T22:19:33.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.299+0000 7fed627fc640 10 client.8688 ms_handle_connect on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:33.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed627fc640 1 -- 172.21.15.50:0/1222126090 <== mds.0 v2:172.21.15.50:6834/3438568728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aecbbbee20 con 0x55aecbc76420 2024-09-11T22:19:33.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed627fc640 10 client.8688 handle_command_reply: tid=0 2024-09-11T22:19:33.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed8ce32740 1 client.8688 shutdown 2024-09-11T22:19:33.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed8ce32740 1 -- 172.21.15.50:0/1222126090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 msgr2=0x55aecbc79090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed8ce32740 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 0x55aecbc79090 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fed74017500 tx=0x7fed74007c80 comp rx=0 tx=0).stop 2024-09-11T22:19:33.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed8ce32740 1 -- 172.21.15.50:0/1222126090 shutdown_connections 2024-09-11T22:19:33.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed8ce32740 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aecbc76420 0x55aecbc76800 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed8ce32740 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc78210 0x55aecbc495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed8ce32740 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc500b0 0x55aecbc6dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed8ce32740 1 --2- 172.21.15.50:0/1222126090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 0x55aecbc79090 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed8ce32740 1 -- 172.21.15.50:0/1222126090 >> 172.21.15.50:0/1222126090 conn(0x55aecbc4c0e0 msgr2=0x55aecbc92b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed627fc640 0 client.8688 ms_handle_reset on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:33.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed8ce32740 1 -- 172.21.15.50:0/1222126090 shutdown_connections 2024-09-11T22:19:33.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.300+0000 7fed8ce32740 1 -- 172.21.15.50:0/1222126090 wait complete. 2024-09-11T22:19:33.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.301+0000 7fed8ce32740 20 client.8688 trim_cache size 0 max 16384 2024-09-11T22:19:33.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.318+0000 7fed8ce32740 1 Processor -- start 2024-09-11T22:19:33.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.318+0000 7fed8ce32740 1 -- start start 2024-09-11T22:19:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.318+0000 7fed8ce32740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 0x55aecbc77770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.318+0000 7fed8ce32740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc500b0 0x55aecbc75900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.318+0000 7fed8ce32740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc78210 0x55aecbc91610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.318+0000 7fed8ce32740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fed84201300 con 0x55aecbc4e920 2024-09-11T22:19:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.318+0000 7fed8ce32740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed840ce570 con 0x55aecbc78210 2024-09-11T22:19:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.318+0000 7fed8ce32740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fed840cd8d0 con 0x55aecbc500b0 2024-09-11T22:19:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 0x55aecbc77770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 0x55aecbc77770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59376/0 (socket says 172.21.15.50:59376) 2024-09-11T22:19:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed837fe640 1 -- 172.21.15.50:0/2522298987 learned_addr learned my addr 172.21.15.50:0/2522298987 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed83fff640 1 --2- 172.21.15.50:0/2522298987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc78210 0x55aecbc91610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed82ffd640 1 --2- 172.21.15.50:0/2522298987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc500b0 0x55aecbc75900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed837fe640 1 -- 172.21.15.50:0/2522298987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc500b0 msgr2=0x55aecbc75900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed837fe640 1 --2- 172.21.15.50:0/2522298987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc500b0 0x55aecbc75900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed837fe640 1 -- 172.21.15.50:0/2522298987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc78210 msgr2=0x55aecbc91610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed837fe640 1 --2- 172.21.15.50:0/2522298987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc78210 0x55aecbc91610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed837fe640 1 -- 172.21.15.50:0/2522298987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aecb8840f0 con 0x55aecbc4e920 2024-09-11T22:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed83fff640 1 --2- 172.21.15.50:0/2522298987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc78210 0x55aecbc91610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed82ffd640 1 --2- 172.21.15.50:0/2522298987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc500b0 0x55aecbc75900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed837fe640 1 --2- 172.21.15.50:0/2522298987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 0x55aecbc77770 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fed74001420 tx=0x7fed7401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58aec92113ae634 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed68ff9640 1 -- 172.21.15.50:0/2522298987 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74015780 con 0x55aecbc4e920 2024-09-11T22:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed68ff9640 1 -- 172.21.15.50:0/2522298987 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed74015920 con 0x55aecbc4e920 2024-09-11T22:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.319+0000 7fed68ff9640 1 -- 172.21.15.50:0/2522298987 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74015cf0 con 0x55aecbc4e920 2024-09-11T22:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.320+0000 7fed8ce32740 1 -- 172.21.15.50:0/2522298987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 msgr2=0x55aecbc77770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.320+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2522298987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 0x55aecbc77770 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fed74001420 tx=0x7fed7401f000 comp rx=0 tx=0).stop 2024-09-11T22:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.320+0000 7fed8ce32740 1 -- 172.21.15.50:0/2522298987 shutdown_connections 2024-09-11T22:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.320+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2522298987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc500b0 0x55aecbc75900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.320+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2522298987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc78210 0x55aecbc91610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.320+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2522298987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc4e920 0x55aecbc77770 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.320+0000 7fed8ce32740 1 -- 172.21.15.50:0/2522298987 >> 172.21.15.50:0/2522298987 conn(0x55aecbc4c0e0 msgr2=0x55aecbca53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.320+0000 7fed8ce32740 1 -- 172.21.15.50:0/2522298987 shutdown_connections 2024-09-11T22:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.320+0000 7fed8ce32740 1 -- 172.21.15.50:0/2522298987 wait complete. 2024-09-11T22:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.321+0000 7fed8ce32740 1 -- start start 2024-09-11T22:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.321+0000 7fed8ce32740 1 Processor -- start 2024-09-11T22:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.321+0000 7fed8ce32740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc4e920 0x55aecbc74f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.321+0000 7fed8ce32740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc500b0 0x55aecbc91610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed8ce32740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc78210 0x55aecbd18da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed8ce32740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aecbc78ac0 con 0x55aecbc78210 2024-09-11T22:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed8ce32740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed840cdf20 con 0x55aecbc500b0 2024-09-11T22:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed8ce32740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55aecbc6ed30 con 0x55aecbc4e920 2024-09-11T22:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed8ce32740 10 client.0 _ll_register_callbacks cb 0x7fed74005370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc78210 0x55aecbd18da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed83fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc78210 0x55aecbd18da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59378/0 (socket says 172.21.15.50:59378) 2024-09-11T22:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed83fff640 1 -- 172.21.15.50:0/2662867637 learned_addr learned my addr 172.21.15.50:0/2662867637 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed82ffd640 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc500b0 0x55aecbc91610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed837fe640 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc4e920 0x55aecbc74f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed83fff640 1 -- 172.21.15.50:0/2662867637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc4e920 msgr2=0x55aecbc74f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed83fff640 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc4e920 0x55aecbc74f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed83fff640 1 -- 172.21.15.50:0/2662867637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc500b0 msgr2=0x55aecbc91610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed83fff640 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc500b0 0x55aecbc91610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed83fff640 1 -- 172.21.15.50:0/2662867637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aecbc91b50 con 0x55aecbc78210 2024-09-11T22:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed82ffd640 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc500b0 0x55aecbc91610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed83fff640 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc78210 0x55aecbd18da0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fed7c081aa0 tx=0x7fed7c07c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a08507cc7989e15 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed627fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed627fc640 1 -- 172.21.15.50:0/2662867637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c095070 con 0x55aecbc78210 2024-09-11T22:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed627fc640 1 -- 172.21.15.50:0/2662867637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fed7c098360 con 0x55aecbc78210 2024-09-11T22:19:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed8ce32740 1 -- 172.21.15.50:0/2662867637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed74015920 con 0x55aecbc78210 2024-09-11T22:19:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed627fc640 1 -- 172.21.15.50:0/2662867637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7fed7c0a0050 con 0x55aecbc78210 2024-09-11T22:19:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed8ce32740 10 client.8694 fetch_fsmap learned FSMap version 94 2024-09-11T22:19:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.322+0000 7fed8ce32740 1 -- 172.21.15.50:0/2662867637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55aecbc91b50 con 0x55aecbc78210 2024-09-11T22:19:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed627fc640 1 -- 172.21.15.50:0/2662867637 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed74015920 con 0x55aecbc78210 2024-09-11T22:19:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed627fc640 1 -- 172.21.15.50:0/2662867637 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7fed7c0759d0 con 0x55aecbc78210 2024-09-11T22:19:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 10 client.8694 fetch_fsmap finished waiting for FSMap version 94 2024-09-11T22:19:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 10 client.8694 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-11T22:19:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 20 client.8694 populate_metadata read hostname 'smithi050' 2024-09-11T22:19:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aecbc6d120 0x55aecbc6d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 4 client.8694 mds_command: new command op to 8412 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-11T22:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 1 -- 172.21.15.50:0/2662867637 --> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55aecbbb9170 con 0x55aecbc6d120 2024-09-11T22:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed837fe640 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aecbc6d120 0x55aecbc6d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed627fc640 10 client.8694 ms_handle_connect on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed837fe640 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aecbc6d120 0x55aecbc6d500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3552634f92a31d79 server_cookie=f5e6358861f42153 in_seq=0 out_seq=0 2024-09-11T22:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed627fc640 1 -- 172.21.15.50:0/2662867637 <== mds.0 v2:172.21.15.50:6834/3438568728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55aecbbb9170 con 0x55aecbc6d120 2024-09-11T22:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed627fc640 10 client.8694 handle_command_reply: tid=0 2024-09-11T22:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 1 client.8694 shutdown 2024-09-11T22:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 1 -- 172.21.15.50:0/2662867637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc78210 msgr2=0x55aecbd18da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc78210 0x55aecbd18da0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fed7c081aa0 tx=0x7fed7c07c070 comp rx=0 tx=0).stop 2024-09-11T22:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 1 -- 172.21.15.50:0/2662867637 shutdown_connections 2024-09-11T22:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x55aecbc6d120 0x55aecbc6d500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aecbc78210 0x55aecbd18da0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aecbc500b0 0x55aecbc91610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed627fc640 0 client.8694 ms_handle_reset on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 1 --2- 172.21.15.50:0/2662867637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55aecbc4e920 0x55aecbc74f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.323+0000 7fed8ce32740 1 -- 172.21.15.50:0/2662867637 >> 172.21.15.50:0/2662867637 conn(0x55aecbc4c0e0 msgr2=0x55aecbca53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed8ce32740 1 -- 172.21.15.50:0/2662867637 shutdown_connections 2024-09-11T22:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed8ce32740 1 -- 172.21.15.50:0/2662867637 wait complete. 2024-09-11T22:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed8ce32740 20 client.8694 trim_cache size 0 max 16384 2024-09-11T22:19:33.335 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:19:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:19:33.336 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:19:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed89fbd640 1 -- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed7006be60 msgr2=0x7fed7006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed89fbd640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed7006be60 0x7fed7006e320 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fed740036b0 tx=0x7fed74009040 comp rx=0 tx=0).stop 2024-09-11T22:19:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed89fbd640 1 -- 172.21.15.50:0/4214447547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed84157b60 msgr2=0x7fed841f8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed89fbd640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed84157b60 0x7fed841f8420 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fed7c02b6e0 tx=0x7fed840d42a0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed89fbd640 1 -- 172.21.15.50:0/4214447547 shutdown_connections 2024-09-11T22:19:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed89fbd640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed7006be60 0x7fed7006e320 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed89fbd640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed84157b60 0x7fed841f8420 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed89fbd640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed840cc260 0x7fed84157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed89fbd640 1 --2- 172.21.15.50:0/4214447547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed6c004d40 0x7fed841f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed89fbd640 1 -- 172.21.15.50:0/4214447547 >> 172.21.15.50:0/4214447547 conn(0x7fed840727a0 msgr2=0x7fed840679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed89fbd640 1 -- 172.21.15.50:0/4214447547 shutdown_connections 2024-09-11T22:19:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.324+0000 7fed89fbd640 1 -- 172.21.15.50:0/4214447547 wait complete. 2024-09-11T22:19:33.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:33.339 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-11T22:19:33.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.441+0000 7ff99f2c3640 1 Processor -- start 2024-09-11T22:19:33.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.441+0000 7ff99f2c3640 1 -- start start 2024-09-11T22:19:33.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99f2c3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff99815c3c0 0x7ff99815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99f2c3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff99815ec40 0x7ff99815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99f2c3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99815f7f0 con 0x7ff9980679c0 2024-09-11T22:19:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99f2c3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff99806e700 con 0x7ff99815c3c0 2024-09-11T22:19:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99f2c3640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff99815fad0 con 0x7ff99815ec40 2024-09-11T22:19:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99d05f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff99815c3c0 0x7ff99815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99d860640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff9980679c0 0x7ff99806f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51882/0 (socket says 172.21.15.50:51882) 2024-09-11T22:19:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99d860640 1 -- 172.21.15.50:0/1386207981 learned_addr learned my addr 172.21.15.50:0/1386207981 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99c85e640 1 --2- 172.21.15.50:0/1386207981 >> v2:172.21.15.77:3300/0 conn(0x7ff99815ec40 0x7ff99815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff98ffff640 1 -- 172.21.15.50:0/1386207981 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253081545 0 0) 0x7ff99815f7f0 con 0x7ff9980679c0 2024-09-11T22:19:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff98ffff640 1 -- 172.21.15.50:0/1386207981 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff984003520 con 0x7ff9980679c0 2024-09-11T22:19:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99d05f640 1 -- 172.21.15.50:0/1386207981 >> v2:172.21.15.77:3300/0 conn(0x7ff99815ec40 msgr2=0x7ff99815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99d05f640 1 --2- 172.21.15.50:0/1386207981 >> v2:172.21.15.77:3300/0 conn(0x7ff99815ec40 0x7ff99815f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99d05f640 1 -- 172.21.15.50:0/1386207981 >> v1:172.21.15.50:6789/0 conn(0x7ff9980679c0 legacy=0x7ff99806f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99d05f640 1 -- 172.21.15.50:0/1386207981 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99806e950 con 0x7ff99815c3c0 2024-09-11T22:19:33.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.442+0000 7ff99c85e640 1 --2- 172.21.15.50:0/1386207981 >> v2:172.21.15.77:3300/0 conn(0x7ff99815ec40 0x7ff99815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:33.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.443+0000 7ff99d05f640 1 --2- 172.21.15.50:0/1386207981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99815c3c0 0x7ff99815fe60 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7ff9981621f0 tx=0x7ff99402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17629b82b8155682 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.443+0000 7ff98ffff640 1 -- 172.21.15.50:0/1386207981 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff994007740 con 0x7ff99815c3c0 2024-09-11T22:19:33.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.443+0000 7ff98ffff640 1 -- 172.21.15.50:0/1386207981 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9940078e0 con 0x7ff99815c3c0 2024-09-11T22:19:33.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.443+0000 7ff98ffff640 1 -- 172.21.15.50:0/1386207981 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff994007cb0 con 0x7ff99815c3c0 2024-09-11T22:19:33.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.444+0000 7ff99f2c3640 1 -- 172.21.15.50:0/1386207981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99815c3c0 msgr2=0x7ff99815fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.444+0000 7ff99f2c3640 1 --2- 172.21.15.50:0/1386207981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99815c3c0 0x7ff99815fe60 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7ff9981621f0 tx=0x7ff99402a5f0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.444+0000 7ff99f2c3640 1 -- 172.21.15.50:0/1386207981 shutdown_connections 2024-09-11T22:19:33.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.444+0000 7ff99f2c3640 1 --2- 172.21.15.50:0/1386207981 >> v2:172.21.15.77:3300/0 conn(0x7ff99815ec40 0x7ff99815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.444+0000 7ff99f2c3640 1 --2- 172.21.15.50:0/1386207981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99815c3c0 0x7ff99815fe60 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.444+0000 7ff99f2c3640 1 -- 172.21.15.50:0/1386207981 >> 172.21.15.50:0/1386207981 conn(0x7ff998075060 msgr2=0x7ff99806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.444+0000 7ff99f2c3640 1 -- 172.21.15.50:0/1386207981 shutdown_connections 2024-09-11T22:19:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.444+0000 7ff99f2c3640 1 -- 172.21.15.50:0/1386207981 wait complete. 2024-09-11T22:19:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.445+0000 7ff99f2c3640 1 Processor -- start 2024-09-11T22:19:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.445+0000 7ff99f2c3640 1 -- start start 2024-09-11T22:19:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99f2c3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9980679c0 0x7ff998158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99f2c3640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff99815c3c0 0x7ff9981563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99f2c3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99815ec40 0x7ff9980ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99f2c3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff998067e30 con 0x7ff99815ec40 2024-09-11T22:19:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99f2c3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9980d0940 con 0x7ff9980679c0 2024-09-11T22:19:33.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99f2c3640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff998067fb0 con 0x7ff99815c3c0 2024-09-11T22:19:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99d860640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99815ec40 0x7ff9980ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99d860640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99815ec40 0x7ff9980ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59408/0 (socket says 172.21.15.50:59408) 2024-09-11T22:19:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99d860640 1 -- 172.21.15.50:0/3295006553 learned_addr learned my addr 172.21.15.50:0/3295006553 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99d05f640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9980679c0 0x7ff998158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99c85e640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff99815c3c0 0x7ff9981563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99d860640 1 -- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff99815c3c0 msgr2=0x7ff9981563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99d860640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff99815c3c0 0x7ff9981563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99d860640 1 -- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9980679c0 msgr2=0x7ff998158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99d860640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9980679c0 0x7ff998158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99d860640 1 -- 172.21.15.50:0/3295006553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9981f4740 con 0x7ff99815ec40 2024-09-11T22:19:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99d05f640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9980679c0 0x7ff998158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:33.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99c85e640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff99815c3c0 0x7ff9981563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff99d860640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99815ec40 0x7ff9980ce370 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7ff99000c460 tx=0x7ff99000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.446+0000 7ff98dffb640 1 -- 172.21.15.50:0/3295006553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990017070 con 0x7ff99815ec40 2024-09-11T22:19:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.447+0000 7ff98dffb640 1 -- 172.21.15.50:0/3295006553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff990005ce0 con 0x7ff99815ec40 2024-09-11T22:19:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.447+0000 7ff99f2c3640 1 -- 172.21.15.50:0/3295006553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9981f4a20 con 0x7ff99815ec40 2024-09-11T22:19:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.447+0000 7ff98dffb640 1 -- 172.21.15.50:0/3295006553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9900072b0 con 0x7ff99815ec40 2024-09-11T22:19:33.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.447+0000 7ff99f2c3640 1 -- 172.21.15.50:0/3295006553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9981f4fe0 con 0x7ff99815ec40 2024-09-11T22:19:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.448+0000 7ff98dffb640 1 -- 172.21.15.50:0/3295006553 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff99001a070 con 0x7ff99815ec40 2024-09-11T22:19:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.449+0000 7ff98dffb640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff97c06be60 0x7ff97c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.449+0000 7ff98dffb640 1 -- 172.21.15.50:0/3295006553 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7ff99008a1e0 con 0x7ff99815ec40 2024-09-11T22:19:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.449+0000 7ff99d05f640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff97c06be60 0x7ff97c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.450+0000 7ff99d05f640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff97c06be60 0x7ff97c06e320 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff994034000 tx=0x7ff99402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.450+0000 7ff9a205d740 1 Processor -- start 2024-09-11T22:19:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.450+0000 7ff9a205d740 1 -- start start 2024-09-11T22:19:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff9a205d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 0x562b47c210c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff9a205d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bd90e0 0x562b47bdbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff9a205d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 0x562b47bd61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff9a205d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562b47b3e6f0 con 0x562b47bdd0b0 2024-09-11T22:19:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff9a205d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562b47ae6330 con 0x562b47bdb920 2024-09-11T22:19:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff9a205d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562b47b3a6b0 con 0x562b47bd90e0 2024-09-11T22:19:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff99d860640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 0x562b47bd61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff99d860640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 0x562b47bd61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59416/0 (socket says 172.21.15.50:59416) 2024-09-11T22:19:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff99d860640 1 -- 172.21.15.50:0/3605806808 learned_addr learned my addr 172.21.15.50:0/3605806808 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff99d05f640 1 --2- 172.21.15.50:0/3605806808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 0x562b47c210c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff99c85e640 1 --2- 172.21.15.50:0/3605806808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bd90e0 0x562b47bdbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff99d860640 1 -- 172.21.15.50:0/3605806808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bd90e0 msgr2=0x562b47bdbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff99d860640 1 --2- 172.21.15.50:0/3605806808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bd90e0 0x562b47bdbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff99d860640 1 -- 172.21.15.50:0/3605806808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 msgr2=0x562b47c210c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff99d860640 1 --2- 172.21.15.50:0/3605806808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 0x562b47c210c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff99d860640 1 -- 172.21.15.50:0/3605806808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b47b0c0d0 con 0x562b47bdd0b0 2024-09-11T22:19:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff99d860640 1 --2- 172.21.15.50:0/3605806808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 0x562b47bd61a0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7ff990001200 tx=0x7ff990058540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f758fa6c0a4d48 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff982ffd640 1 -- 172.21.15.50:0/3605806808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990056780 con 0x562b47bdd0b0 2024-09-11T22:19:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff982ffd640 1 -- 172.21.15.50:0/3605806808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff990054af0 con 0x562b47bdd0b0 2024-09-11T22:19:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.451+0000 7ff982ffd640 1 -- 172.21.15.50:0/3605806808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990060dd0 con 0x562b47bdd0b0 2024-09-11T22:19:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.452+0000 7ff9a205d740 1 -- 172.21.15.50:0/3605806808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 msgr2=0x562b47bd61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.452+0000 7ff9a205d740 1 --2- 172.21.15.50:0/3605806808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 0x562b47bd61a0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7ff990001200 tx=0x7ff990058540 comp rx=0 tx=0).stop 2024-09-11T22:19:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.452+0000 7ff9a205d740 1 -- 172.21.15.50:0/3605806808 shutdown_connections 2024-09-11T22:19:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.452+0000 7ff9a205d740 1 --2- 172.21.15.50:0/3605806808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bd90e0 0x562b47bdbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.452+0000 7ff9a205d740 1 --2- 172.21.15.50:0/3605806808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 0x562b47bd61a0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.452+0000 7ff9a205d740 1 --2- 172.21.15.50:0/3605806808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 0x562b47c210c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.452+0000 7ff9a205d740 1 -- 172.21.15.50:0/3605806808 >> 172.21.15.50:0/3605806808 conn(0x562b47bd8370 msgr2=0x562b47c20590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.452+0000 7ff9a205d740 1 -- 172.21.15.50:0/3605806808 shutdown_connections 2024-09-11T22:19:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.452+0000 7ff9a205d740 1 -- 172.21.15.50:0/3605806808 wait complete. 2024-09-11T22:19:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.453+0000 7ff9a205d740 1 -- start start 2024-09-11T22:19:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.453+0000 7ff9a205d740 1 Processor -- start 2024-09-11T22:19:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff9a205d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 0x562b47bd5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff9a205d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 0x562b47c1dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff9a205d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47c054a0 0x562b47c35150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff9a205d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562b47bd7810 con 0x562b47bdd0b0 2024-09-11T22:19:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff9a205d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562b47ac74f0 con 0x562b47bdb920 2024-09-11T22:19:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff9a205d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562b47c218f0 con 0x562b47c054a0 2024-09-11T22:19:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff9a205d740 10 client.0 _ll_register_callbacks cb 0x562b47ae8b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff99c85e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 0x562b47c1dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff99c85e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 0x562b47c1dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59432/0 (socket says 172.21.15.50:59432) 2024-09-11T22:19:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff99c85e640 1 -- 172.21.15.50:0/3956092584 learned_addr learned my addr 172.21.15.50:0/3956092584 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff99c85e640 1 -- 172.21.15.50:0/3956092584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47c054a0 msgr2=0x562b47c35150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff99c85e640 1 --2- 172.21.15.50:0/3956092584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47c054a0 0x562b47c35150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff99c85e640 1 -- 172.21.15.50:0/3956092584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 msgr2=0x562b47bd5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff99c85e640 1 --2- 172.21.15.50:0/3956092584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 0x562b47bd5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff99c85e640 1 -- 172.21.15.50:0/3956092584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b4791b7d0 con 0x562b47bdd0b0 2024-09-11T22:19:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff99c85e640 1 --2- 172.21.15.50:0/3956092584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 0x562b47c1dbf0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7ff988003f60 tx=0x7ff988003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501b18ea05964a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff977fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:19:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff977fff640 1 -- 172.21.15.50:0/3956092584 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988019070 con 0x562b47bdd0b0 2024-09-11T22:19:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff977fff640 1 -- 172.21.15.50:0/3956092584 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7ff988015650 con 0x562b47bdd0b0 2024-09-11T22:19:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff9a205d740 1 -- 172.21.15.50:0/3956092584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff990054af0 con 0x562b47bdd0b0 2024-09-11T22:19:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff977fff640 1 -- 172.21.15.50:0/3956092584 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7ff988024050 con 0x562b47bdd0b0 2024-09-11T22:19:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff9a205d740 10 client.8709 fetch_fsmap learned FSMap version 94 2024-09-11T22:19:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.454+0000 7ff9a205d740 1 -- 172.21.15.50:0/3956092584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x562b478513f0 con 0x562b47bdd0b0 2024-09-11T22:19:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.455+0000 7ff977fff640 1 -- 172.21.15.50:0/3956092584 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff990054af0 con 0x562b47bdd0b0 2024-09-11T22:19:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.455+0000 7ff977fff640 1 -- 172.21.15.50:0/3956092584 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7ff988027020 con 0x562b47bdd0b0 2024-09-11T22:19:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.455+0000 7ff9a205d740 10 client.8709 fetch_fsmap finished waiting for FSMap version 94 2024-09-11T22:19:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.455+0000 7ff9a205d740 10 client.8709 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-11T22:19:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.455+0000 7ff9a205d740 20 client.8709 populate_metadata read hostname 'smithi050' 2024-09-11T22:19:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.455+0000 7ff9a205d740 1 --2- 172.21.15.50:0/3956092584 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x562b47c35690 0x562b47bda550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.455+0000 7ff9a205d740 4 client.8709 mds_command: new command op to 8412 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:19:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.455+0000 7ff9a205d740 1 -- 172.21.15.50:0/3956092584 --> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b47b4be20 con 0x562b47c35690 2024-09-11T22:19:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.455+0000 7ff99d05f640 1 --2- 172.21.15.50:0/3956092584 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x562b47c35690 0x562b47bda550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.455+0000 7ff977fff640 10 client.8709 ms_handle_connect on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.455+0000 7ff99d05f640 1 --2- 172.21.15.50:0/3956092584 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x562b47c35690 0x562b47bda550 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fbe2fa5ff5d20ca server_cookie=de6e50b1bf31de1a in_seq=0 out_seq=0 2024-09-11T22:19:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff977fff640 1 -- 172.21.15.50:0/3956092584 <== mds.0 v2:172.21.15.50:6834/3438568728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b47b4be20 con 0x562b47c35690 2024-09-11T22:19:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff977fff640 10 client.8709 handle_command_reply: tid=0 2024-09-11T22:19:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff9a205d740 1 client.8709 shutdown 2024-09-11T22:19:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff9a205d740 1 -- 172.21.15.50:0/3956092584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 msgr2=0x562b47c1dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff9a205d740 1 --2- 172.21.15.50:0/3956092584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 0x562b47c1dbf0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7ff988003f60 tx=0x7ff988003f90 comp rx=0 tx=0).stop 2024-09-11T22:19:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff9a205d740 1 -- 172.21.15.50:0/3956092584 shutdown_connections 2024-09-11T22:19:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff9a205d740 1 --2- 172.21.15.50:0/3956092584 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x562b47c35690 0x562b47bda550 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff9a205d740 1 --2- 172.21.15.50:0/3956092584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47c054a0 0x562b47c35150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff9a205d740 1 --2- 172.21.15.50:0/3956092584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47bdd0b0 0x562b47c1dbf0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff9a205d740 1 --2- 172.21.15.50:0/3956092584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 0x562b47bd5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff9a205d740 1 -- 172.21.15.50:0/3956092584 >> 172.21.15.50:0/3956092584 conn(0x562b47bd90e0 msgr2=0x562b47c220f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff977fff640 0 client.8709 ms_handle_reset on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff9a205d740 1 -- 172.21.15.50:0/3956092584 shutdown_connections 2024-09-11T22:19:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff9a205d740 1 -- 172.21.15.50:0/3956092584 wait complete. 2024-09-11T22:19:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.456+0000 7ff9a205d740 20 client.8709 trim_cache size 0 max 16384 2024-09-11T22:19:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.473+0000 7ff9a205d740 1 Processor -- start 2024-09-11T22:19:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.474+0000 7ff9a205d740 1 -- start start 2024-09-11T22:19:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.474+0000 7ff9a205d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 0x562b47c45600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.474+0000 7ff9a205d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bdd0b0 0x562b47bda680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.474+0000 7ff9a205d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 0x562b47bfd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.474+0000 7ff9a205d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff998200a20 con 0x562b47c054a0 2024-09-11T22:19:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.474+0000 7ff9a205d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff99815ac30 con 0x562b47bdb920 2024-09-11T22:19:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.474+0000 7ff9a205d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff9981f8650 con 0x562b47bdd0b0 2024-09-11T22:19:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.474+0000 7ff99d860640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 0x562b47bfd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.474+0000 7ff99d860640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 0x562b47bfd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59438/0 (socket says 172.21.15.50:59438) 2024-09-11T22:19:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.474+0000 7ff99d860640 1 -- 172.21.15.50:0/2647034987 learned_addr learned my addr 172.21.15.50:0/2647034987 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.474+0000 7ff99c85e640 1 --2- 172.21.15.50:0/2647034987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bdd0b0 0x562b47bda680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.474+0000 7ff99d05f640 1 --2- 172.21.15.50:0/2647034987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 0x562b47c45600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.475+0000 7ff99d860640 1 -- 172.21.15.50:0/2647034987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bdd0b0 msgr2=0x562b47bda680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.475+0000 7ff99d860640 1 --2- 172.21.15.50:0/2647034987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bdd0b0 0x562b47bda680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.475+0000 7ff99d860640 1 -- 172.21.15.50:0/2647034987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 msgr2=0x562b47c45600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.475+0000 7ff99d860640 1 --2- 172.21.15.50:0/2647034987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 0x562b47c45600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.475+0000 7ff99d860640 1 -- 172.21.15.50:0/2647034987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b478110f0 con 0x562b47c054a0 2024-09-11T22:19:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.475+0000 7ff99d860640 1 --2- 172.21.15.50:0/2647034987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 0x562b47bfd0c0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7ff99005c9f0 tx=0x7ff990014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cff5d340e853b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.475+0000 7ff9827fc640 1 -- 172.21.15.50:0/2647034987 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990075070 con 0x562b47c054a0 2024-09-11T22:19:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.475+0000 7ff9827fc640 1 -- 172.21.15.50:0/2647034987 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff990056780 con 0x562b47c054a0 2024-09-11T22:19:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.475+0000 7ff9827fc640 1 -- 172.21.15.50:0/2647034987 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990054af0 con 0x562b47c054a0 2024-09-11T22:19:33.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.475+0000 7ff9a205d740 1 -- 172.21.15.50:0/2647034987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 msgr2=0x562b47bfd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.475+0000 7ff9a205d740 1 --2- 172.21.15.50:0/2647034987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 0x562b47bfd0c0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7ff99005c9f0 tx=0x7ff990014070 comp rx=0 tx=0).stop 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.476+0000 7ff9a205d740 1 -- 172.21.15.50:0/2647034987 shutdown_connections 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.476+0000 7ff9a205d740 1 --2- 172.21.15.50:0/2647034987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bdd0b0 0x562b47bda680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.476+0000 7ff9a205d740 1 --2- 172.21.15.50:0/2647034987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 0x562b47bfd0c0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.476+0000 7ff9a205d740 1 --2- 172.21.15.50:0/2647034987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdb920 0x562b47c45600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.476+0000 7ff9a205d740 1 -- 172.21.15.50:0/2647034987 >> 172.21.15.50:0/2647034987 conn(0x562b47bd90e0 msgr2=0x562b47c1d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.476+0000 7ff9a205d740 1 -- 172.21.15.50:0/2647034987 shutdown_connections 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.476+0000 7ff9a205d740 1 -- 172.21.15.50:0/2647034987 wait complete. 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.476+0000 7ff9a205d740 1 -- start start 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.476+0000 7ff9a205d740 1 Processor -- start 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.477+0000 7ff9a205d740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bdb920 0x562b47c858d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.477+0000 7ff9a205d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdd0b0 0x562b47bd61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.477+0000 7ff9a205d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 0x562b47bd6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.477+0000 7ff9a205d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562b47b4be20 con 0x562b47c054a0 2024-09-11T22:19:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.477+0000 7ff9a205d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff99815a5e0 con 0x562b47bdd0b0 2024-09-11T22:19:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.477+0000 7ff9a205d740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562b47c1dee0 con 0x562b47bdb920 2024-09-11T22:19:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.477+0000 7ff9a205d740 10 client.0 _ll_register_callbacks cb 0x7ff988004280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:19:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.477+0000 7ff99d860640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 0x562b47bd6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.477+0000 7ff99d860640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 0x562b47bd6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59448/0 (socket says 172.21.15.50:59448) 2024-09-11T22:19:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.477+0000 7ff99d860640 1 -- 172.21.15.50:0/2033333355 learned_addr learned my addr 172.21.15.50:0/2033333355 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.477+0000 7ff99d05f640 1 --2- 172.21.15.50:0/2033333355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bdb920 0x562b47c858d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.477+0000 7ff99c85e640 1 --2- 172.21.15.50:0/2033333355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdd0b0 0x562b47bd61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff99d860640 1 -- 172.21.15.50:0/2033333355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bdb920 msgr2=0x562b47c858d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff99d860640 1 --2- 172.21.15.50:0/2033333355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bdb920 0x562b47c858d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff99d860640 1 -- 172.21.15.50:0/2033333355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdd0b0 msgr2=0x562b47bd61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff99d860640 1 --2- 172.21.15.50:0/2033333355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdd0b0 0x562b47bd61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff99d860640 1 -- 172.21.15.50:0/2033333355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b47c22500 con 0x562b47c054a0 2024-09-11T22:19:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff99d860640 1 --2- 172.21.15.50:0/2033333355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 0x562b47bd6710 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7ff990000f60 tx=0x7ff990001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e92c8225301e07 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff977fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:19:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff977fff640 1 -- 172.21.15.50:0/2033333355 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990075020 con 0x562b47c054a0 2024-09-11T22:19:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff977fff640 1 -- 172.21.15.50:0/2033333355 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7ff990060dd0 con 0x562b47c054a0 2024-09-11T22:19:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff9a205d740 1 -- 172.21.15.50:0/2033333355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff990056780 con 0x562b47c054a0 2024-09-11T22:19:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff977fff640 1 -- 172.21.15.50:0/2033333355 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7ff99007f050 con 0x562b47c054a0 2024-09-11T22:19:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff9a205d740 10 client.8715 fetch_fsmap learned FSMap version 94 2024-09-11T22:19:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff9a205d740 1 -- 172.21.15.50:0/2033333355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x562b47bd6c50 con 0x562b47c054a0 2024-09-11T22:19:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff977fff640 1 -- 172.21.15.50:0/2033333355 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff990056780 con 0x562b47c054a0 2024-09-11T22:19:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff977fff640 1 -- 172.21.15.50:0/2033333355 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7ff9900772c0 con 0x562b47c054a0 2024-09-11T22:19:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff9a205d740 10 client.8715 fetch_fsmap finished waiting for FSMap version 94 2024-09-11T22:19:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff9a205d740 10 client.8715 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-11T22:19:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff9a205d740 20 client.8715 populate_metadata read hostname 'smithi050' 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff9a205d740 1 --2- 172.21.15.50:0/2033333355 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x562b47c02ec0 0x562b47c1e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff9a205d740 4 client.8715 mds_command: new command op to 8412 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff9a205d740 1 -- 172.21.15.50:0/2033333355 --> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562b47b46170 con 0x562b47c02ec0 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.478+0000 7ff99d05f640 1 --2- 172.21.15.50:0/2033333355 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x562b47c02ec0 0x562b47c1e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff977fff640 10 client.8715 ms_handle_connect on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff99d05f640 1 --2- 172.21.15.50:0/2033333355 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x562b47c02ec0 0x562b47c1e540 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2707ff64e000ebe2 server_cookie=e4a049b71c11b08c in_seq=0 out_seq=0 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff977fff640 1 -- 172.21.15.50:0/2033333355 <== mds.0 v2:172.21.15.50:6834/3438568728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562b47b46170 con 0x562b47c02ec0 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff977fff640 10 client.8715 handle_command_reply: tid=0 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff9a205d740 1 client.8715 shutdown 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff9a205d740 1 -- 172.21.15.50:0/2033333355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 msgr2=0x562b47bd6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff9a205d740 1 --2- 172.21.15.50:0/2033333355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 0x562b47bd6710 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7ff990000f60 tx=0x7ff990001150 comp rx=0 tx=0).stop 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff9a205d740 1 -- 172.21.15.50:0/2033333355 shutdown_connections 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff9a205d740 1 --2- 172.21.15.50:0/2033333355 >> [v2:172.21.15.50:6834/3438568728,v1:172.21.15.50:6835/3438568728] conn(0x562b47c02ec0 0x562b47c1e540 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff9a205d740 1 --2- 172.21.15.50:0/2033333355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b47c054a0 0x562b47bd6710 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff9a205d740 1 --2- 172.21.15.50:0/2033333355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562b47bdd0b0 0x562b47bd61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff977fff640 0 client.8715 ms_handle_reset on v2:172.21.15.50:6834/3438568728 2024-09-11T22:19:33.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff9a205d740 1 --2- 172.21.15.50:0/2033333355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562b47bdb920 0x562b47c858d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff9a205d740 1 -- 172.21.15.50:0/2033333355 >> 172.21.15.50:0/2033333355 conn(0x562b47bd90e0 msgr2=0x562b47bda890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff9a205d740 1 -- 172.21.15.50:0/2033333355 shutdown_connections 2024-09-11T22:19:33.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff9a205d740 1 -- 172.21.15.50:0/2033333355 wait complete. 2024-09-11T22:19:33.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.479+0000 7ff9a205d740 20 client.8715 trim_cache size 0 max 16384 2024-09-11T22:19:33.487 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:19:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-11T22:19:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-11T22:19:33.488 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:19:33.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.480+0000 7ff99f2c3640 1 -- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff97c06be60 msgr2=0x7ff97c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.480+0000 7ff99f2c3640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff97c06be60 0x7ff97c06e320 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff994034000 tx=0x7ff99402f000 comp rx=0 tx=0).stop 2024-09-11T22:19:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.480+0000 7ff99f2c3640 1 -- 172.21.15.50:0/3295006553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99815ec40 msgr2=0x7ff9980ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.480+0000 7ff99f2c3640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99815ec40 0x7ff9980ce370 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7ff99000c460 tx=0x7ff99000c920 comp rx=0 tx=0).stop 2024-09-11T22:19:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.480+0000 7ff99f2c3640 1 -- 172.21.15.50:0/3295006553 shutdown_connections 2024-09-11T22:19:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.480+0000 7ff99f2c3640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff97c06be60 0x7ff97c06e320 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.480+0000 7ff99f2c3640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff99815c3c0 0x7ff9981563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.480+0000 7ff99f2c3640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99815ec40 0x7ff9980ce370 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.480+0000 7ff99f2c3640 1 --2- 172.21.15.50:0/3295006553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9980679c0 0x7ff998158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.480+0000 7ff99f2c3640 1 -- 172.21.15.50:0/3295006553 >> 172.21.15.50:0/3295006553 conn(0x7ff998075060 msgr2=0x7ff9981610b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.480+0000 7ff99f2c3640 1 -- 172.21.15.50:0/3295006553 shutdown_connections 2024-09-11T22:19:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.480+0000 7ff99f2c3640 1 -- 172.21.15.50:0/3295006553 wait complete. 2024-09-11T22:19:33.492 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:33.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.592+0000 7f48d55e4640 1 Processor -- start 2024-09-11T22:19:33.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.592+0000 7f48d55e4640 1 -- start start 2024-09-11T22:19:33.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.593+0000 7f48d55e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00cf610 0x7f48d00b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.593+0000 7f48d55e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f48d00b1600 0x7f48d00cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.593+0000 7f48d55e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d00cfbd0 con 0x7f48d0161fa0 2024-09-11T22:19:33.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.593+0000 7f48d55e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f48d00d1220 con 0x7f48d00b1600 2024-09-11T22:19:33.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.593+0000 7f48d55e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f48d00d17e0 con 0x7f48d00cf610 2024-09-11T22:19:33.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.593+0000 7f48cf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f48d00b1600 0x7f48d00cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.593+0000 7f48ce7fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00cf610 0x7f48d00b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.594+0000 7f48ceffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f48d0161fa0 0x7f48d00cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:53202/0 (socket says 172.21.15.50:53202) 2024-09-11T22:19:33.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.594+0000 7f48ceffd640 1 -- 172.21.15.50:0/2958366339 learned_addr learned my addr 172.21.15.50:0/2958366339 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:33.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.594+0000 7f48cdffb640 1 -- 172.21.15.50:0/2958366339 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2718687375 0 0) 0x7f48d00cfbd0 con 0x7f48d0161fa0 2024-09-11T22:19:33.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.594+0000 7f48cdffb640 1 -- 172.21.15.50:0/2958366339 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48bc003520 con 0x7f48d0161fa0 2024-09-11T22:19:33.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.594+0000 7f48ce7fc640 1 -- 172.21.15.50:0/2958366339 >> v2:172.21.15.77:3300/0 conn(0x7f48d00b1600 msgr2=0x7f48d00cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.594+0000 7f48ce7fc640 1 --2- 172.21.15.50:0/2958366339 >> v2:172.21.15.77:3300/0 conn(0x7f48d00b1600 0x7f48d00cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.594+0000 7f48ce7fc640 1 -- 172.21.15.50:0/2958366339 >> v1:172.21.15.77:6789/0 conn(0x7f48d0161fa0 legacy=0x7f48d00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.594+0000 7f48ce7fc640 1 -- 172.21.15.50:0/2958366339 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d00cfeb0 con 0x7f48d00cf610 2024-09-11T22:19:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.595+0000 7f48ce7fc640 1 --2- 172.21.15.50:0/2958366339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00cf610 0x7f48d00b4d20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f48b80097a0 tx=0x7f48b802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4fce0b1b817d6e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.595+0000 7f48cdffb640 1 -- 172.21.15.50:0/2958366339 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8037070 con 0x7f48d00cf610 2024-09-11T22:19:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.595+0000 7f48cdffb640 1 -- 172.21.15.50:0/2958366339 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b8032440 con 0x7f48d00cf610 2024-09-11T22:19:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.595+0000 7f48cdffb640 1 -- 172.21.15.50:0/2958366339 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b80327f0 con 0x7f48d00cf610 2024-09-11T22:19:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.595+0000 7f48d55e4640 1 -- 172.21.15.50:0/2958366339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00cf610 msgr2=0x7f48d00b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.595+0000 7f48d55e4640 1 --2- 172.21.15.50:0/2958366339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00cf610 0x7f48d00b4d20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f48b80097a0 tx=0x7f48b802a180 comp rx=0 tx=0).stop 2024-09-11T22:19:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.596+0000 7f48d55e4640 1 -- 172.21.15.50:0/2958366339 shutdown_connections 2024-09-11T22:19:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.596+0000 7f48d55e4640 1 --2- 172.21.15.50:0/2958366339 >> v2:172.21.15.77:3300/0 conn(0x7f48d00b1600 0x7f48d00cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.596+0000 7f48d55e4640 1 --2- 172.21.15.50:0/2958366339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00cf610 0x7f48d00b4d20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.596+0000 7f48d55e4640 1 -- 172.21.15.50:0/2958366339 >> 172.21.15.50:0/2958366339 conn(0x7f48d009ba50 msgr2=0x7f48d00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.596+0000 7f48d55e4640 1 -- 172.21.15.50:0/2958366339 shutdown_connections 2024-09-11T22:19:33.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.596+0000 7f48d55e4640 1 -- 172.21.15.50:0/2958366339 wait complete. 2024-09-11T22:19:33.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.597+0000 7f48d55e4640 1 Processor -- start 2024-09-11T22:19:33.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.597+0000 7f48d55e4640 1 -- start start 2024-09-11T22:19:33.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48d55e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00b1600 0x7f48d0160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48d55e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d00cf610 0x7f48d00cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48d55e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48d0161fa0 0x7f48d0160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48d55e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f48d0162500 con 0x7f48d00cf610 2024-09-11T22:19:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48d55e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f48d0162380 con 0x7f48d0161fa0 2024-09-11T22:19:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48d55e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f48d00d1c70 con 0x7f48d00b1600 2024-09-11T22:19:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48ce7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d00cf610 0x7f48d00cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48ce7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d00cf610 0x7f48d00cbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59454/0 (socket says 172.21.15.50:59454) 2024-09-11T22:19:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48ce7fc640 1 -- 172.21.15.50:0/3572881139 learned_addr learned my addr 172.21.15.50:0/3572881139 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48ceffd640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00b1600 0x7f48d0160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48cf7fe640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48d0161fa0 0x7f48d0160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48ce7fc640 1 -- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00b1600 msgr2=0x7f48d0160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48ce7fc640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00b1600 0x7f48d0160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48ce7fc640 1 -- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48d0161fa0 msgr2=0x7f48d0160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48ce7fc640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48d0161fa0 0x7f48d0160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.598+0000 7f48ce7fc640 1 -- 172.21.15.50:0/3572881139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d00b8490 con 0x7f48d00cf610 2024-09-11T22:19:33.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.599+0000 7f48ce7fc640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d00cf610 0x7f48d00cbe40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f48b802a1c0 tx=0x7f48b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.599+0000 7f48c77fe640 1 -- 172.21.15.50:0/3572881139 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8037040 con 0x7f48d00cf610 2024-09-11T22:19:33.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.599+0000 7f48c77fe640 1 -- 172.21.15.50:0/3572881139 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b8042070 con 0x7f48d00cf610 2024-09-11T22:19:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.599+0000 7f48d55e4640 1 -- 172.21.15.50:0/3572881139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d00b7910 con 0x7f48d00cf610 2024-09-11T22:19:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.599+0000 7f48c77fe640 1 -- 172.21.15.50:0/3572881139 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b803b930 con 0x7f48d00cf610 2024-09-11T22:19:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.599+0000 7f48d55e4640 1 -- 172.21.15.50:0/3572881139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d00b7ed0 con 0x7f48d00cf610 2024-09-11T22:19:33.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.600+0000 7f48d55e4640 1 -- 172.21.15.50:0/3572881139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d00b4d20 con 0x7f48d00cf610 2024-09-11T22:19:33.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.600+0000 7f48c77fe640 1 -- 172.21.15.50:0/3572881139 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48b803bad0 con 0x7f48d00cf610 2024-09-11T22:19:33.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.601+0000 7f48c77fe640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f48b006be30 0x7f48b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.601+0000 7f48c77fe640 1 -- 172.21.15.50:0/3572881139 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f48b80ab590 con 0x7f48d00cf610 2024-09-11T22:19:33.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.601+0000 7f48ceffd640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f48b006be30 0x7f48b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.602+0000 7f48ceffd640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f48b006be30 0x7f48b006e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f48c0005c00 tx=0x7f48c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.605+0000 7f48c77fe640 1 -- 172.21.15.50:0/3572881139 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f48b8079900 con 0x7f48d00cf610 2024-09-11T22:19:33.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.818+0000 7f48d55e4640 1 -- 172.21.15.50:0/3572881139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48d006ca30 con 0x7f48d00cf610 2024-09-11T22:19:33.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.818+0000 7f48c77fe640 1 -- 172.21.15.50:0/3572881139 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7f48b807dc00 con 0x7f48d00cf610 2024-09-11T22:19:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:33.820 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:33.821 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:33.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.820+0000 7f48d55e4640 1 -- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f48b006be30 msgr2=0x7f48b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.820+0000 7f48d55e4640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f48b006be30 0x7f48b006e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f48c0005c00 tx=0x7f48c0009040 comp rx=0 tx=0).stop 2024-09-11T22:19:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.820+0000 7f48d55e4640 1 -- 172.21.15.50:0/3572881139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d00cf610 msgr2=0x7f48d00cbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.820+0000 7f48d55e4640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d00cf610 0x7f48d00cbe40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f48b802a1c0 tx=0x7f48b80046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.821+0000 7f48d55e4640 1 -- 172.21.15.50:0/3572881139 shutdown_connections 2024-09-11T22:19:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.821+0000 7f48d55e4640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f48b006be30 0x7f48b006e2f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.821+0000 7f48d55e4640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48d0161fa0 0x7f48d0160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.821+0000 7f48d55e4640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d00cf610 0x7f48d00cbe40 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.821+0000 7f48d55e4640 1 --2- 172.21.15.50:0/3572881139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00b1600 0x7f48d0160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.821+0000 7f48d55e4640 1 -- 172.21.15.50:0/3572881139 >> 172.21.15.50:0/3572881139 conn(0x7f48d009ba50 msgr2=0x7f48d00af700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.821+0000 7f48d55e4640 1 -- 172.21.15.50:0/3572881139 shutdown_connections 2024-09-11T22:19:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.821+0000 7f48d55e4640 1 -- 172.21.15.50:0/3572881139 wait complete. 2024-09-11T22:19:33.833 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-11T22:19:33.833 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:19:33.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.933+0000 7f7bed6d2640 1 Processor -- start 2024-09-11T22:19:33.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.933+0000 7f7bed6d2640 1 -- start start 2024-09-11T22:19:33.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7bed6d2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7be80cf610 0x7f7be80b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7bed6d2640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7be80b1600 0x7f7be80cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7bed6d2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be80cfbd0 con 0x7f7be8161fa0 2024-09-11T22:19:33.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7bed6d2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7be80d1220 con 0x7f7be80cf610 2024-09-11T22:19:33.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7bed6d2640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7be80d17e0 con 0x7f7be80b1600 2024-09-11T22:19:33.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7be67fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7be80cf610 0x7f7be80b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7be6ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7be8161fa0 0x7f7be80cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51890/0 (socket says 172.21.15.50:51890) 2024-09-11T22:19:33.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7be6ffd640 1 -- 172.21.15.50:0/649174655 learned_addr learned my addr 172.21.15.50:0/649174655 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:33.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7be77fe640 1 --2- 172.21.15.50:0/649174655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7be80b1600 0x7f7be80cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7be67fc640 1 -- 172.21.15.50:0/649174655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7be80b1600 msgr2=0x7f7be80cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:33.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7be67fc640 1 --2- 172.21.15.50:0/649174655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7be80b1600 0x7f7be80cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7be67fc640 1 -- 172.21.15.50:0/649174655 >> v1:172.21.15.50:6789/0 conn(0x7f7be8161fa0 legacy=0x7f7be80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7be67fc640 1 -- 172.21.15.50:0/649174655 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be80cfeb0 con 0x7f7be80cf610 2024-09-11T22:19:33.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.934+0000 7f7be5ffb640 1 -- 172.21.15.50:0/649174655 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3841917170 0 0) 0x7f7be80cfbd0 con 0x7f7be8161fa0 2024-09-11T22:19:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.935+0000 7f7be67fc640 1 --2- 172.21.15.50:0/649174655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be80cf610 0x7f7be80b4d20 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0097a0 tx=0x7f7bdc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bea2a4b65553a9c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.935+0000 7f7be5ffb640 1 -- 172.21.15.50:0/649174655 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc037070 con 0x7f7be80cf610 2024-09-11T22:19:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.935+0000 7f7be5ffb640 1 -- 172.21.15.50:0/649174655 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bdc032440 con 0x7f7be80cf610 2024-09-11T22:19:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.935+0000 7f7be5ffb640 1 -- 172.21.15.50:0/649174655 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc032810 con 0x7f7be80cf610 2024-09-11T22:19:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.936+0000 7f7bed6d2640 1 -- 172.21.15.50:0/649174655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be80cf610 msgr2=0x7f7be80b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.936+0000 7f7bed6d2640 1 --2- 172.21.15.50:0/649174655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be80cf610 0x7f7be80b4d20 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0097a0 tx=0x7f7bdc02a180 comp rx=0 tx=0).stop 2024-09-11T22:19:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.936+0000 7f7bed6d2640 1 -- 172.21.15.50:0/649174655 shutdown_connections 2024-09-11T22:19:33.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.936+0000 7f7bed6d2640 1 --2- 172.21.15.50:0/649174655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7be80b1600 0x7f7be80cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.936+0000 7f7bed6d2640 1 --2- 172.21.15.50:0/649174655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be80cf610 0x7f7be80b4d20 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.936+0000 7f7bed6d2640 1 -- 172.21.15.50:0/649174655 >> 172.21.15.50:0/649174655 conn(0x7f7be809ba50 msgr2=0x7f7be80b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.936+0000 7f7bed6d2640 1 -- 172.21.15.50:0/649174655 shutdown_connections 2024-09-11T22:19:33.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.936+0000 7f7bed6d2640 1 -- 172.21.15.50:0/649174655 wait complete. 2024-09-11T22:19:33.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.937+0000 7f7bed6d2640 1 Processor -- start 2024-09-11T22:19:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.937+0000 7f7bed6d2640 1 -- start start 2024-09-11T22:19:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7bed6d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be80b1600 0x7f7be80cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7bed6d2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7be80cf610 0x7f7be80b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7bed6d2640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7be8161fa0 0x7f7be815b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7bed6d2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7be8162500 con 0x7f7be80b1600 2024-09-11T22:19:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7bed6d2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7be8162380 con 0x7f7be80cf610 2024-09-11T22:19:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7bed6d2640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7be80d1c70 con 0x7f7be8161fa0 2024-09-11T22:19:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7be6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be80b1600 0x7f7be80cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7be6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be80b1600 0x7f7be80cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59464/0 (socket says 172.21.15.50:59464) 2024-09-11T22:19:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7be6ffd640 1 -- 172.21.15.50:0/38750715 learned_addr learned my addr 172.21.15.50:0/38750715 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7be77fe640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7be8161fa0 0x7f7be815b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7be67fc640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7be80cf610 0x7f7be80b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7be6ffd640 1 -- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7be8161fa0 msgr2=0x7f7be815b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7be6ffd640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7be8161fa0 0x7f7be815b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7be6ffd640 1 -- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7be80cf610 msgr2=0x7f7be80b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7be6ffd640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7be80cf610 0x7f7be80b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.938+0000 7f7be6ffd640 1 -- 172.21.15.50:0/38750715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be80ca160 con 0x7f7be80b1600 2024-09-11T22:19:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.939+0000 7f7be6ffd640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be80b1600 0x7f7be80cb200 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800c430 tx=0x7f7bd800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.939+0000 7f7bcf7fe640 1 -- 172.21.15.50:0/38750715 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd80074e0 con 0x7f7be80b1600 2024-09-11T22:19:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.939+0000 7f7bcf7fe640 1 -- 172.21.15.50:0/38750715 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd80047e0 con 0x7f7be80b1600 2024-09-11T22:19:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.939+0000 7f7bed6d2640 1 -- 172.21.15.50:0/38750715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be80ca440 con 0x7f7be80b1600 2024-09-11T22:19:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.939+0000 7f7bcf7fe640 1 -- 172.21.15.50:0/38750715 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8004bd0 con 0x7f7be80b1600 2024-09-11T22:19:33.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.939+0000 7f7bed6d2640 1 -- 172.21.15.50:0/38750715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be80caa00 con 0x7f7be80b1600 2024-09-11T22:19:33.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.940+0000 7f7bed6d2640 1 -- 172.21.15.50:0/38750715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be80b4d20 con 0x7f7be80b1600 2024-09-11T22:19:33.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.940+0000 7f7bcf7fe640 1 -- 172.21.15.50:0/38750715 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7bd8011070 con 0x7f7be80b1600 2024-09-11T22:19:33.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.941+0000 7f7bcf7fe640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7bd406be30 0x7f7bd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.941+0000 7f7bcf7fe640 1 -- 172.21.15.50:0/38750715 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f7bd808a980 con 0x7f7be80b1600 2024-09-11T22:19:33.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.941+0000 7f7be67fc640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7bd406be30 0x7f7bd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.941+0000 7f7be67fc640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7bd406be30 0x7f7bd406e2f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc034000 tx=0x7f7bdc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:33.945+0000 7f7bcf7fe640 1 -- 172.21.15.50:0/38750715 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7bd8058ce0 con 0x7f7be80b1600 2024-09-11T22:19:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.192+0000 7f7bed6d2640 1 -- 172.21.15.50:0/38750715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7be806cb00 con 0x7f7be80b1600 2024-09-11T22:19:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.192+0000 7f7bcf7fe640 1 -- 172.21.15.50:0/38750715 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7f7bd805cfe0 con 0x7f7be80b1600 2024-09-11T22:19:34.194 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:34.194 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":523,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":132,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076328823,"bytes_used":2590674944,"bytes_avail":770503438336,"bytes_total":773094113280,"write_bytes_sec":60280324,"read_op_per_sec":0,"write_op_per_sec":59},"fsmap":{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8412}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-11T22:19:31.485493+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:19:34.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.194+0000 7f7bed6d2640 1 -- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7bd406be30 msgr2=0x7f7bd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.194+0000 7f7bed6d2640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7bd406be30 0x7f7bd406e2f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc034000 tx=0x7f7bdc02e000 comp rx=0 tx=0).stop 2024-09-11T22:19:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.194+0000 7f7bed6d2640 1 -- 172.21.15.50:0/38750715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be80b1600 msgr2=0x7f7be80cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.194+0000 7f7bed6d2640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be80b1600 0x7f7be80cb200 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800c430 tx=0x7f7bd800c8f0 comp rx=0 tx=0).stop 2024-09-11T22:19:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.194+0000 7f7bed6d2640 1 -- 172.21.15.50:0/38750715 shutdown_connections 2024-09-11T22:19:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.194+0000 7f7bed6d2640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7bd406be30 0x7f7bd406e2f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.194+0000 7f7bed6d2640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7be8161fa0 0x7f7be815b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.194+0000 7f7bed6d2640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7be80cf610 0x7f7be80b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.194+0000 7f7bed6d2640 1 --2- 172.21.15.50:0/38750715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be80b1600 0x7f7be80cb200 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.194+0000 7f7bed6d2640 1 -- 172.21.15.50:0/38750715 >> 172.21.15.50:0/38750715 conn(0x7f7be809ba50 msgr2=0x7f7be806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.194+0000 7f7bed6d2640 1 -- 172.21.15.50:0/38750715 shutdown_connections 2024-09-11T22:19:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:34.195+0000 7f7bed6d2640 1 -- 172.21.15.50:0/38750715 wait complete. 2024-09-11T22:19:34.207 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-11T22:19:35.208 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:35.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.321+0000 7efcbbf98640 1 Processor -- start 2024-09-11T22:19:35.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.322+0000 7efcbbf98640 1 -- start start 2024-09-11T22:19:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.322+0000 7efcbbf98640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efcb4161fa0 0x7efcb40b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:35.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.322+0000 7efcbbf98640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efcb40b1600 0x7efcb40cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:35.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.322+0000 7efcbbf98640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb40cfbd0 con 0x7efcb40cf440 2024-09-11T22:19:35.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.322+0000 7efcbbf98640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7efcb40cdce0 con 0x7efcb40b1600 2024-09-11T22:19:35.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.322+0000 7efcbbf98640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efcb40d1220 con 0x7efcb4161fa0 2024-09-11T22:19:35.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.322+0000 7efcb9533640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efcb40b1600 0x7efcb40cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:35.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.322+0000 7efcba535640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efcb40cf440 0x7efcb406bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51902/0 (socket says 172.21.15.50:51902) 2024-09-11T22:19:35.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.323+0000 7efcba535640 1 -- 172.21.15.50:0/948508969 learned_addr learned my addr 172.21.15.50:0/948508969 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:35.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.323+0000 7efcb9d34640 1 --2- 172.21.15.50:0/948508969 >> v2:172.21.15.77:3300/0 conn(0x7efcb4161fa0 0x7efcb40b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:35.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.323+0000 7efcb9533640 1 -- 172.21.15.50:0/948508969 >> v2:172.21.15.77:3300/0 conn(0x7efcb4161fa0 msgr2=0x7efcb40b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:35.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.323+0000 7efcb9533640 1 --2- 172.21.15.50:0/948508969 >> v2:172.21.15.77:3300/0 conn(0x7efcb4161fa0 0x7efcb40b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.323+0000 7efcb9533640 1 -- 172.21.15.50:0/948508969 >> v1:172.21.15.50:6789/0 conn(0x7efcb40cf440 legacy=0x7efcb406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.323+0000 7efcb8d32640 1 -- 172.21.15.50:0/948508969 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2006535603 0 0) 0x7efcb40cfbd0 con 0x7efcb40cf440 2024-09-11T22:19:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.323+0000 7efcb9533640 1 -- 172.21.15.50:0/948508969 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb40cfeb0 con 0x7efcb40b1600 2024-09-11T22:19:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.324+0000 7efcb9533640 1 --2- 172.21.15.50:0/948508969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb40b1600 0x7efcb40cef00 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7efcb4072960 tx=0x7efca402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fdf72ac6e633ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.324+0000 7efcb8d32640 1 -- 172.21.15.50:0/948508969 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4037070 con 0x7efcb40b1600 2024-09-11T22:19:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.324+0000 7efcb8d32640 1 -- 172.21.15.50:0/948508969 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca4032440 con 0x7efcb40b1600 2024-09-11T22:19:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.324+0000 7efcb8d32640 1 -- 172.21.15.50:0/948508969 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4032810 con 0x7efcb40b1600 2024-09-11T22:19:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.324+0000 7efcbbf98640 1 -- 172.21.15.50:0/948508969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb40b1600 msgr2=0x7efcb40cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.324+0000 7efcbbf98640 1 --2- 172.21.15.50:0/948508969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb40b1600 0x7efcb40cef00 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7efcb4072960 tx=0x7efca402a1a0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.324+0000 7efcbbf98640 1 -- 172.21.15.50:0/948508969 shutdown_connections 2024-09-11T22:19:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.324+0000 7efcbbf98640 1 --2- 172.21.15.50:0/948508969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb40b1600 0x7efcb40cef00 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.324+0000 7efcbbf98640 1 --2- 172.21.15.50:0/948508969 >> v2:172.21.15.77:3300/0 conn(0x7efcb4161fa0 0x7efcb40b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.324+0000 7efcbbf98640 1 -- 172.21.15.50:0/948508969 >> 172.21.15.50:0/948508969 conn(0x7efcb409ba50 msgr2=0x7efcb40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:35.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.325+0000 7efcbbf98640 1 -- 172.21.15.50:0/948508969 shutdown_connections 2024-09-11T22:19:35.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.325+0000 7efcbbf98640 1 -- 172.21.15.50:0/948508969 wait complete. 2024-09-11T22:19:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.326+0000 7efcbbf98640 1 Processor -- start 2024-09-11T22:19:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.326+0000 7efcbbf98640 1 -- start start 2024-09-11T22:19:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcbbf98640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb40b1600 0x7efcb40c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcbbf98640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efcb40cf440 0x7efcb415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcbbf98640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efcb4161fa0 0x7efcb40c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcbbf98640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efcb40cf870 con 0x7efcb40b1600 2024-09-11T22:19:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcbbf98640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efcb40d17e0 con 0x7efcb4161fa0 2024-09-11T22:19:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcbbf98640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efcb4162380 con 0x7efcb40cf440 2024-09-11T22:19:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcb9d34640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb40b1600 0x7efcb40c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcb9d34640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb40b1600 0x7efcb40c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59488/0 (socket says 172.21.15.50:59488) 2024-09-11T22:19:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcb9d34640 1 -- 172.21.15.50:0/1224217218 learned_addr learned my addr 172.21.15.50:0/1224217218 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcba535640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efcb4161fa0 0x7efcb40c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcb9533640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efcb40cf440 0x7efcb415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcb9d34640 1 -- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efcb40cf440 msgr2=0x7efcb415d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcb9d34640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efcb40cf440 0x7efcb415d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcb9d34640 1 -- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efcb4161fa0 msgr2=0x7efcb40c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcb9d34640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efcb4161fa0 0x7efcb40c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcb9d34640 1 -- 172.21.15.50:0/1224217218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb40c99a0 con 0x7efcb40b1600 2024-09-11T22:19:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcb9d34640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb40b1600 0x7efcb40c8a10 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7efcb000d620 tx=0x7efcb000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcaa7fc640 1 -- 172.21.15.50:0/1224217218 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb000b620 con 0x7efcb40b1600 2024-09-11T22:19:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcaa7fc640 1 -- 172.21.15.50:0/1224217218 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb0019070 con 0x7efcb40b1600 2024-09-11T22:19:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcbbf98640 1 -- 172.21.15.50:0/1224217218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb40c9c80 con 0x7efcb40b1600 2024-09-11T22:19:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.327+0000 7efcaa7fc640 1 -- 172.21.15.50:0/1224217218 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb000ba00 con 0x7efcb40b1600 2024-09-11T22:19:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.328+0000 7efcbbf98640 1 -- 172.21.15.50:0/1224217218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb415dbf0 con 0x7efcb40b1600 2024-09-11T22:19:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.328+0000 7efcbbf98640 1 -- 172.21.15.50:0/1224217218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb40c9730 con 0x7efcb40b1600 2024-09-11T22:19:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.329+0000 7efcaa7fc640 1 -- 172.21.15.50:0/1224217218 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efcb000bba0 con 0x7efcb40b1600 2024-09-11T22:19:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.330+0000 7efcaa7fc640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc9806be30 0x7efc9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.330+0000 7efcaa7fc640 1 -- 172.21.15.50:0/1224217218 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7efcb008b1e0 con 0x7efcb40b1600 2024-09-11T22:19:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.330+0000 7efcb9533640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc9806be30 0x7efc9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.330+0000 7efcb9533640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc9806be30 0x7efc9806e2f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efca4034000 tx=0x7efca402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:35.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.334+0000 7efcaa7fc640 1 -- 172.21.15.50:0/1224217218 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efcb0059c20 con 0x7efcb40b1600 2024-09-11T22:19:35.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.548+0000 7efcbbf98640 1 -- 172.21.15.50:0/1224217218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcb40d1c70 con 0x7efcb40b1600 2024-09-11T22:19:35.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.548+0000 7efcaa7fc640 1 -- 172.21.15.50:0/1224217218 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7efcb0059520 con 0x7efcb40b1600 2024-09-11T22:19:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:35.550 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:35.550 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:35.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.550+0000 7efcbbf98640 1 -- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc9806be30 msgr2=0x7efc9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:35.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.550+0000 7efcbbf98640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc9806be30 0x7efc9806e2f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efca4034000 tx=0x7efca402e000 comp rx=0 tx=0).stop 2024-09-11T22:19:35.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.550+0000 7efcbbf98640 1 -- 172.21.15.50:0/1224217218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb40b1600 msgr2=0x7efcb40c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:35.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.550+0000 7efcbbf98640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb40b1600 0x7efcb40c8a10 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7efcb000d620 tx=0x7efcb000dae0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.550+0000 7efcbbf98640 1 -- 172.21.15.50:0/1224217218 shutdown_connections 2024-09-11T22:19:35.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.550+0000 7efcbbf98640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efc9806be30 0x7efc9806e2f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.550+0000 7efcbbf98640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efcb40cf440 0x7efcb415d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.550+0000 7efcbbf98640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efcb4161fa0 0x7efcb40c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.550+0000 7efcbbf98640 1 --2- 172.21.15.50:0/1224217218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb40b1600 0x7efcb40c8a10 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.550+0000 7efcbbf98640 1 -- 172.21.15.50:0/1224217218 >> 172.21.15.50:0/1224217218 conn(0x7efcb409ba50 msgr2=0x7efcb40cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:35.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.550+0000 7efcbbf98640 1 -- 172.21.15.50:0/1224217218 shutdown_connections 2024-09-11T22:19:35.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.550+0000 7efcbbf98640 1 -- 172.21.15.50:0/1224217218 wait complete. 2024-09-11T22:19:35.563 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-11T22:19:35.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:19:35.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.663+0000 7fbe85b0c640 1 Processor -- start 2024-09-11T22:19:35.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.663+0000 7fbe85b0c640 1 -- start start 2024-09-11T22:19:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.664+0000 7fbe85b0c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbe8015e870 0x7fbe800d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.664+0000 7fbe85b0c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe800cfa80 con 0x7fbe800d16d0 2024-09-11T22:19:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.664+0000 7fbe85b0c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe800d40d0 con 0x7fbe800d3c00 2024-09-11T22:19:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.664+0000 7fbe85b0c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbe800d1b40 con 0x7fbe8015e870 2024-09-11T22:19:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.664+0000 7fbe7effd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbe800d16d0 0x7fbe800d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51910/0 (socket says 172.21.15.50:51910) 2024-09-11T22:19:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.664+0000 7fbe7effd640 1 -- 172.21.15.50:0/3552715040 learned_addr learned my addr 172.21.15.50:0/3552715040 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:35.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.664+0000 7fbe7f7fe640 1 --2- 172.21.15.50:0/3552715040 >> v2:172.21.15.77:3300/0 conn(0x7fbe8015e870 0x7fbe800d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:35.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.664+0000 7fbe7e7fc640 1 -- 172.21.15.50:0/3552715040 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2452188172 0 0) 0x7fbe74001110 con 0x7fbe800d16d0 2024-09-11T22:19:35.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.664+0000 7fbe7e7fc640 1 -- 172.21.15.50:0/3552715040 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe68003520 con 0x7fbe800d16d0 2024-09-11T22:19:35.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.665+0000 7fbe7f7fe640 1 -- 172.21.15.50:0/3552715040 >> v1:172.21.15.77:6789/0 conn(0x7fbe800d3c00 legacy=0x7fbe800b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:35.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.665+0000 7fbe7e7fc640 1 -- 172.21.15.50:0/3552715040 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2870006693 0 0) 0x7fbe68003520 con 0x7fbe800d16d0 2024-09-11T22:19:35.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.665+0000 7fbe7f7fe640 1 -- 172.21.15.50:0/3552715040 >> v1:172.21.15.50:6789/0 conn(0x7fbe800d16d0 legacy=0x7fbe800d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:35.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.665+0000 7fbe7f7fe640 1 -- 172.21.15.50:0/3552715040 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe800d43b0 con 0x7fbe8015e870 2024-09-11T22:19:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.665+0000 7fbe7f7fe640 1 --2- 172.21.15.50:0/3552715040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe8015e870 0x7fbe800d1190 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbe700097a0 tx=0x7fbe7002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26816a1bdab5693e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.665+0000 7fbe7e7fc640 1 -- 172.21.15.50:0/3552715040 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70037070 con 0x7fbe8015e870 2024-09-11T22:19:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.666+0000 7fbe7e7fc640 1 -- 172.21.15.50:0/3552715040 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7002ac50 con 0x7fbe8015e870 2024-09-11T22:19:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.666+0000 7fbe7e7fc640 1 -- 172.21.15.50:0/3552715040 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74001840 con 0x7fbe8015e870 2024-09-11T22:19:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.666+0000 7fbe85b0c640 1 -- 172.21.15.50:0/3552715040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe8015e870 msgr2=0x7fbe800d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.666+0000 7fbe85b0c640 1 --2- 172.21.15.50:0/3552715040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe8015e870 0x7fbe800d1190 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbe700097a0 tx=0x7fbe7002a1c0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.666+0000 7fbe85b0c640 1 -- 172.21.15.50:0/3552715040 shutdown_connections 2024-09-11T22:19:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.666+0000 7fbe85b0c640 1 --2- 172.21.15.50:0/3552715040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe8015e870 0x7fbe800d1190 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.666+0000 7fbe85b0c640 1 -- 172.21.15.50:0/3552715040 >> 172.21.15.50:0/3552715040 conn(0x7fbe800727a0 msgr2=0x7fbe800679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.666+0000 7fbe85b0c640 1 -- 172.21.15.50:0/3552715040 shutdown_connections 2024-09-11T22:19:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.666+0000 7fbe85b0c640 1 -- 172.21.15.50:0/3552715040 wait complete. 2024-09-11T22:19:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.667+0000 7fbe85b0c640 1 Processor -- start 2024-09-11T22:19:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.668+0000 7fbe85b0c640 1 -- start start 2024-09-11T22:19:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.668+0000 7fbe85b0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d16d0 0x7fbe800cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.668+0000 7fbe85b0c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe800d3c00 0x7fbe801f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.668+0000 7fbe85b0c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe8015e870 0x7fbe80154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.668+0000 7fbe85b0c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8015ec50 con 0x7fbe800d16d0 2024-09-11T22:19:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.668+0000 7fbe85b0c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe800b7ee0 con 0x7fbe8015e870 2024-09-11T22:19:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.668+0000 7fbe85b0c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbe800b78b0 con 0x7fbe800d3c00 2024-09-11T22:19:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.668+0000 7fbe7f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d16d0 0x7fbe800cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.668+0000 7fbe7f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d16d0 0x7fbe800cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59494/0 (socket says 172.21.15.50:59494) 2024-09-11T22:19:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.668+0000 7fbe7f7fe640 1 -- 172.21.15.50:0/380326025 learned_addr learned my addr 172.21.15.50:0/380326025 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe7effd640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe800d3c00 0x7fbe801f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe7ffff640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe8015e870 0x7fbe80154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe7f7fe640 1 -- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe800d3c00 msgr2=0x7fbe801f81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe7f7fe640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe800d3c00 0x7fbe801f81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe7f7fe640 1 -- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe8015e870 msgr2=0x7fbe80154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe7f7fe640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe8015e870 0x7fbe80154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe7f7fe640 1 -- 172.21.15.50:0/380326025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe800ccdc0 con 0x7fbe800d16d0 2024-09-11T22:19:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe7ffff640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe8015e870 0x7fbe80154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe7effd640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe800d3c00 0x7fbe801f81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe7f7fe640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d16d0 0x7fbe800cc260 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fbe700097a0 tx=0x7fbe700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe67fff640 1 -- 172.21.15.50:0/380326025 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70037040 con 0x7fbe800d16d0 2024-09-11T22:19:35.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe67fff640 1 -- 172.21.15.50:0/380326025 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe70004030 con 0x7fbe800d16d0 2024-09-11T22:19:35.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe85b0c640 1 -- 172.21.15.50:0/380326025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe800cd0a0 con 0x7fbe800d16d0 2024-09-11T22:19:35.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe67fff640 1 -- 172.21.15.50:0/380326025 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70004420 con 0x7fbe800d16d0 2024-09-11T22:19:35.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.669+0000 7fbe85b0c640 1 -- 172.21.15.50:0/380326025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe800cd660 con 0x7fbe800d16d0 2024-09-11T22:19:35.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.670+0000 7fbe85b0c640 1 -- 172.21.15.50:0/380326025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe800d1190 con 0x7fbe800d16d0 2024-09-11T22:19:35.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.671+0000 7fbe67fff640 1 -- 172.21.15.50:0/380326025 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe70003610 con 0x7fbe800d16d0 2024-09-11T22:19:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.671+0000 7fbe67fff640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe6c06be30 0x7fbe6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.671+0000 7fbe67fff640 1 -- 172.21.15.50:0/380326025 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fbe700abb60 con 0x7fbe800d16d0 2024-09-11T22:19:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.671+0000 7fbe7effd640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe6c06be30 0x7fbe6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.672+0000 7fbe7effd640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe6c06be30 0x7fbe6c06e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbe8015df70 tx=0x7fbe74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:35.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.675+0000 7fbe67fff640 1 -- 172.21.15.50:0/380326025 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe7007a520 con 0x7fbe800d16d0 2024-09-11T22:19:35.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.916+0000 7fbe85b0c640 1 -- 172.21.15.50:0/380326025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbe800b9f80 con 0x7fbe800d16d0 2024-09-11T22:19:35.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.917+0000 7fbe67fff640 1 -- 172.21.15.50:0/380326025 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7fbe70079e20 con 0x7fbe800d16d0 2024-09-11T22:19:35.919 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:35.919 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":524,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":132,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076328823,"bytes_used":2590674944,"bytes_avail":770503438336,"bytes_total":773094113280,"write_bytes_sec":60280324,"read_op_per_sec":0,"write_op_per_sec":59},"fsmap":{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8412}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-11T22:19:31.485493+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:19:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.919+0000 7fbe85b0c640 1 -- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe6c06be30 msgr2=0x7fbe6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.919+0000 7fbe85b0c640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe6c06be30 0x7fbe6c06e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbe8015df70 tx=0x7fbe74009040 comp rx=0 tx=0).stop 2024-09-11T22:19:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.919+0000 7fbe85b0c640 1 -- 172.21.15.50:0/380326025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d16d0 msgr2=0x7fbe800cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.919+0000 7fbe85b0c640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d16d0 0x7fbe800cc260 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fbe700097a0 tx=0x7fbe700046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.919+0000 7fbe85b0c640 1 -- 172.21.15.50:0/380326025 shutdown_connections 2024-09-11T22:19:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.919+0000 7fbe85b0c640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbe6c06be30 0x7fbe6c06e2f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.919+0000 7fbe85b0c640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe800d3c00 0x7fbe801f81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.919+0000 7fbe85b0c640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe8015e870 0x7fbe80154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.919+0000 7fbe85b0c640 1 --2- 172.21.15.50:0/380326025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe800d16d0 0x7fbe800cc260 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.919+0000 7fbe85b0c640 1 -- 172.21.15.50:0/380326025 >> 172.21.15.50:0/380326025 conn(0x7fbe800727a0 msgr2=0x7fbe800b8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:35.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.919+0000 7fbe85b0c640 1 -- 172.21.15.50:0/380326025 shutdown_connections 2024-09-11T22:19:35.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:35.919+0000 7fbe85b0c640 1 -- 172.21.15.50:0/380326025 wait complete. 2024-09-11T22:19:35.932 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-11T22:19:36.933 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.048+0000 7fb06b30a640 1 Processor -- start 2024-09-11T22:19:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.048+0000 7fb06b30a640 1 -- start start 2024-09-11T22:19:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb06b30a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb0640d18e0 0x7fb0640d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb06b30a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb06415eb70 0x7fb0640d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb06b30a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0640d31b0 con 0x7fb06415e790 2024-09-11T22:19:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb06b30a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb0640d3dc0 con 0x7fb06415eb70 2024-09-11T22:19:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb06b30a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb0640d3490 con 0x7fb0640d18e0 2024-09-11T22:19:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb0698a7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb06415eb70 0x7fb0640d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb0698a7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb06415eb70 0x7fb0640d2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59508/0 (socket says 172.21.15.50:59508) 2024-09-11T22:19:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb0698a7640 1 -- 172.21.15.50:0/3625057897 learned_addr learned my addr 172.21.15.50:0/3625057897 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb0688a5640 1 --2- 172.21.15.50:0/3625057897 >> v2:172.21.15.77:3300/0 conn(0x7fb0640d18e0 0x7fb0640d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb0698a7640 1 -- 172.21.15.50:0/3625057897 >> v2:172.21.15.77:3300/0 conn(0x7fb0640d18e0 msgr2=0x7fb0640d4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:37.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb0698a7640 1 --2- 172.21.15.50:0/3625057897 >> v2:172.21.15.77:3300/0 conn(0x7fb0640d18e0 0x7fb0640d4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb0698a7640 1 -- 172.21.15.50:0/3625057897 >> v1:172.21.15.77:6789/0 conn(0x7fb06415e790 legacy=0x7fb0640d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:37.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb0698a7640 1 -- 172.21.15.50:0/3625057897 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0640d3770 con 0x7fb06415eb70 2024-09-11T22:19:37.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.049+0000 7fb0688a5640 1 --2- 172.21.15.50:0/3625057897 >> v2:172.21.15.77:3300/0 conn(0x7fb0640d18e0 0x7fb0640d4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.050+0000 7fb0698a7640 1 --2- 172.21.15.50:0/3625057897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb06415eb70 0x7fb0640d2b20 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fb06408dc00 tx=0x7fb05c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd2b05765258813 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.050+0000 7fb05bfff640 1 -- 172.21.15.50:0/3625057897 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c036070 con 0x7fb06415eb70 2024-09-11T22:19:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.050+0000 7fb05bfff640 1 -- 172.21.15.50:0/3625057897 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05c031600 con 0x7fb06415eb70 2024-09-11T22:19:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.050+0000 7fb05bfff640 1 -- 172.21.15.50:0/3625057897 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c0319d0 con 0x7fb06415eb70 2024-09-11T22:19:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.051+0000 7fb06b30a640 1 -- 172.21.15.50:0/3625057897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb06415eb70 msgr2=0x7fb0640d2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.051+0000 7fb06b30a640 1 --2- 172.21.15.50:0/3625057897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb06415eb70 0x7fb0640d2b20 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fb06408dc00 tx=0x7fb05c02a6f0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.051+0000 7fb06b30a640 1 -- 172.21.15.50:0/3625057897 shutdown_connections 2024-09-11T22:19:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.051+0000 7fb06b30a640 1 --2- 172.21.15.50:0/3625057897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb06415eb70 0x7fb0640d2b20 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.051+0000 7fb06b30a640 1 --2- 172.21.15.50:0/3625057897 >> v2:172.21.15.77:3300/0 conn(0x7fb0640d18e0 0x7fb0640d4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.051+0000 7fb06b30a640 1 -- 172.21.15.50:0/3625057897 >> 172.21.15.50:0/3625057897 conn(0x7fb0640727a0 msgr2=0x7fb0640679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.051+0000 7fb06b30a640 1 -- 172.21.15.50:0/3625057897 shutdown_connections 2024-09-11T22:19:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.051+0000 7fb06b30a640 1 -- 172.21.15.50:0/3625057897 wait complete. 2024-09-11T22:19:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.052+0000 7fb06b30a640 1 Processor -- start 2024-09-11T22:19:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.052+0000 7fb06b30a640 1 -- start start 2024-09-11T22:19:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb06b30a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0640d18e0 0x7fb0641e9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb06b30a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb06415e790 0x7fb0641e7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb06b30a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb06415eb70 0x7fb0641e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb06b30a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0640ba3b0 con 0x7fb06415eb70 2024-09-11T22:19:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb06b30a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0640ba230 con 0x7fb06415e790 2024-09-11T22:19:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb06b30a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb0640ba530 con 0x7fb0640d18e0 2024-09-11T22:19:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb0698a7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb06415eb70 0x7fb0641e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb0698a7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb06415eb70 0x7fb0641e7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59520/0 (socket says 172.21.15.50:59520) 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb0698a7640 1 -- 172.21.15.50:0/2466705858 learned_addr learned my addr 172.21.15.50:0/2466705858 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb0688a5640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb06415e790 0x7fb0641e7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb0690a6640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0640d18e0 0x7fb0641e9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb0698a7640 1 -- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0640d18e0 msgr2=0x7fb0641e9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb0698a7640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0640d18e0 0x7fb0641e9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb0698a7640 1 -- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb06415e790 msgr2=0x7fb0641e7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb0698a7640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb06415e790 0x7fb0641e7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb0698a7640 1 -- 172.21.15.50:0/2466705858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb064159fe0 con 0x7fb06415eb70 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb0690a6640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0640d18e0 0x7fb0641e9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb0688a5640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb06415e790 0x7fb0641e7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.053+0000 7fb0698a7640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb06415eb70 0x7fb0641e7540 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009f40 tx=0x7fb05c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.054+0000 7fb059ffb640 1 -- 172.21.15.50:0/2466705858 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c041020 con 0x7fb06415eb70 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.054+0000 7fb059ffb640 1 -- 172.21.15.50:0/2466705858 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05c007780 con 0x7fb06415eb70 2024-09-11T22:19:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.054+0000 7fb06b30a640 1 -- 172.21.15.50:0/2466705858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06415a2c0 con 0x7fb06415eb70 2024-09-11T22:19:37.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.054+0000 7fb059ffb640 1 -- 172.21.15.50:0/2466705858 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c036040 con 0x7fb06415eb70 2024-09-11T22:19:37.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.054+0000 7fb06b30a640 1 -- 172.21.15.50:0/2466705858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb06415ada0 con 0x7fb06415eb70 2024-09-11T22:19:37.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.055+0000 7fb06b30a640 1 -- 172.21.15.50:0/2466705858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb064068390 con 0x7fb06415eb70 2024-09-11T22:19:37.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.056+0000 7fb059ffb640 1 -- 172.21.15.50:0/2466705858 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb05c044020 con 0x7fb06415eb70 2024-09-11T22:19:37.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.056+0000 7fb059ffb640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb04806be30 0x7fb04806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:37.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.056+0000 7fb059ffb640 1 -- 172.21.15.50:0/2466705858 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fb05c0abc40 con 0x7fb06415eb70 2024-09-11T22:19:37.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.056+0000 7fb0690a6640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb04806be30 0x7fb04806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:37.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.057+0000 7fb0690a6640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb04806be30 0x7fb04806e2f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb0640d07c0 tx=0x7fb060009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:37.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.060+0000 7fb059ffb640 1 -- 172.21.15.50:0/2466705858 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb05c04b030 con 0x7fb06415eb70 2024-09-11T22:19:37.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.272+0000 7fb06b30a640 1 -- 172.21.15.50:0/2466705858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0640d4230 con 0x7fb06415eb70 2024-09-11T22:19:37.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.273+0000 7fb059ffb640 1 -- 172.21.15.50:0/2466705858 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7fb05c07a5f0 con 0x7fb06415eb70 2024-09-11T22:19:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:37.274 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:37.274 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:37.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.275+0000 7fb06b30a640 1 -- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb04806be30 msgr2=0x7fb04806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:37.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.275+0000 7fb06b30a640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb04806be30 0x7fb04806e2f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb0640d07c0 tx=0x7fb060009040 comp rx=0 tx=0).stop 2024-09-11T22:19:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.275+0000 7fb06b30a640 1 -- 172.21.15.50:0/2466705858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb06415eb70 msgr2=0x7fb0641e7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.275+0000 7fb06b30a640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb06415eb70 0x7fb0641e7540 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009f40 tx=0x7fb05c004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.275+0000 7fb06b30a640 1 -- 172.21.15.50:0/2466705858 shutdown_connections 2024-09-11T22:19:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.275+0000 7fb06b30a640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb04806be30 0x7fb04806e2f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.275+0000 7fb06b30a640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb06415eb70 0x7fb0641e7540 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.275+0000 7fb06b30a640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb06415e790 0x7fb0641e7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.275+0000 7fb06b30a640 1 --2- 172.21.15.50:0/2466705858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0640d18e0 0x7fb0641e9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.275+0000 7fb06b30a640 1 -- 172.21.15.50:0/2466705858 >> 172.21.15.50:0/2466705858 conn(0x7fb0640727a0 msgr2=0x7fb064151c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.275+0000 7fb06b30a640 1 -- 172.21.15.50:0/2466705858 shutdown_connections 2024-09-11T22:19:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.275+0000 7fb06b30a640 1 -- 172.21.15.50:0/2466705858 wait complete. 2024-09-11T22:19:37.286 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-11T22:19:37.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:19:37.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.387+0000 7f5230a47640 1 Processor -- start 2024-09-11T22:19:37.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.387+0000 7f5230a47640 1 -- start start 2024-09-11T22:19:37.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.388+0000 7f5230a47640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f522c15e840 0x7f522c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.388+0000 7f5230a47640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0cf580 0x7f522c06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.388+0000 7f5230a47640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f522c0ce5f0 con 0x7f522c0cdd50 2024-09-11T22:19:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.388+0000 7f5230a47640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f522c06c240 con 0x7f522c15e840 2024-09-11T22:19:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.388+0000 7f5230a47640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f522c0d0470 con 0x7f522c0cf580 2024-09-11T22:19:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.388+0000 7f522ad9d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0cf580 0x7f522c06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.388+0000 7f522a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f522c15e840 0x7f522c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.388+0000 7f522ad9d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0cf580 0x7f522c06c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:53314/0 (socket says 172.21.15.50:53314) 2024-09-11T22:19:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.388+0000 7f5223fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f522c0cdd50 0x7f522c0cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:53236/0 (socket says 172.21.15.50:53236) 2024-09-11T22:19:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.389+0000 7f522ad9d640 1 -- 172.21.15.50:0/2942372718 learned_addr learned my addr 172.21.15.50:0/2942372718 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.389+0000 7f5229d9b640 1 -- 172.21.15.50:0/2942372718 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 32209508 0 0) 0x7f522c0ce5f0 con 0x7f522c0cdd50 2024-09-11T22:19:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.389+0000 7f5229d9b640 1 -- 172.21.15.50:0/2942372718 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5218003520 con 0x7f522c0cdd50 2024-09-11T22:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.389+0000 7f522ad9d640 1 -- 172.21.15.50:0/2942372718 >> v2:172.21.15.77:3300/0 conn(0x7f522c15e840 msgr2=0x7f522c0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.389+0000 7f522ad9d640 1 --2- 172.21.15.50:0/2942372718 >> v2:172.21.15.77:3300/0 conn(0x7f522c15e840 0x7f522c0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.389+0000 7f522ad9d640 1 -- 172.21.15.50:0/2942372718 >> v1:172.21.15.77:6789/0 conn(0x7f522c0cdd50 legacy=0x7f522c0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.389+0000 7f522ad9d640 1 -- 172.21.15.50:0/2942372718 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c0ce310 con 0x7f522c0cf580 2024-09-11T22:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.389+0000 7f522a59c640 1 --2- 172.21.15.50:0/2942372718 >> v2:172.21.15.77:3300/0 conn(0x7f522c15e840 0x7f522c0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.390+0000 7f522ad9d640 1 --2- 172.21.15.50:0/2942372718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0cf580 0x7f522c06c6d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5224009e50 tx=0x7f522402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af3a6f150dbe9c00 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.390+0000 7f5229d9b640 1 -- 172.21.15.50:0/2942372718 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224036070 con 0x7f522c0cf580 2024-09-11T22:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.390+0000 7f5229d9b640 1 -- 172.21.15.50:0/2942372718 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5224031600 con 0x7f522c0cf580 2024-09-11T22:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.390+0000 7f5229d9b640 1 -- 172.21.15.50:0/2942372718 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52240319b0 con 0x7f522c0cf580 2024-09-11T22:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.390+0000 7f5230a47640 1 -- 172.21.15.50:0/2942372718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0cf580 msgr2=0x7f522c06c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.390+0000 7f5230a47640 1 --2- 172.21.15.50:0/2942372718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0cf580 0x7f522c06c6d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5224009e50 tx=0x7f522402a710 comp rx=0 tx=0).stop 2024-09-11T22:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.390+0000 7f5230a47640 1 -- 172.21.15.50:0/2942372718 shutdown_connections 2024-09-11T22:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.390+0000 7f5230a47640 1 --2- 172.21.15.50:0/2942372718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0cf580 0x7f522c06c6d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.390+0000 7f5230a47640 1 --2- 172.21.15.50:0/2942372718 >> v2:172.21.15.77:3300/0 conn(0x7f522c15e840 0x7f522c0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.390+0000 7f5230a47640 1 -- 172.21.15.50:0/2942372718 >> 172.21.15.50:0/2942372718 conn(0x7f522c0b4150 msgr2=0x7f522c0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.391+0000 7f5230a47640 1 -- 172.21.15.50:0/2942372718 shutdown_connections 2024-09-11T22:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.391+0000 7f5230a47640 1 -- 172.21.15.50:0/2942372718 wait complete. 2024-09-11T22:19:37.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.392+0000 7f5230a47640 1 Processor -- start 2024-09-11T22:19:37.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.392+0000 7f5230a47640 1 -- start start 2024-09-11T22:19:37.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f5230a47640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c0cdd50 0x7f522c15b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:37.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f5230a47640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0cf580 0x7f522c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:37.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f5230a47640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c15e840 0x7f522c0b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:37.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f5230a47640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f522c15ec20 con 0x7f522c15e840 2024-09-11T22:19:37.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f5230a47640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f522c06bed0 con 0x7f522c0cdd50 2024-09-11T22:19:37.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f5230a47640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f522c15eda0 con 0x7f522c0cf580 2024-09-11T22:19:37.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f522ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c15e840 0x7f522c0b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:37.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f522a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c0cdd50 0x7f522c15b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f522ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c15e840 0x7f522c0b6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59524/0 (socket says 172.21.15.50:59524) 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f522ad9d640 1 -- 172.21.15.50:0/2033783659 learned_addr learned my addr 172.21.15.50:0/2033783659 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f5223fff640 1 --2- 172.21.15.50:0/2033783659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0cf580 0x7f522c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f522ad9d640 1 -- 172.21.15.50:0/2033783659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0cf580 msgr2=0x7f522c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f522ad9d640 1 --2- 172.21.15.50:0/2033783659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0cf580 0x7f522c0c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f522ad9d640 1 -- 172.21.15.50:0/2033783659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c0cdd50 msgr2=0x7f522c15b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f522ad9d640 1 --2- 172.21.15.50:0/2033783659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c0cdd50 0x7f522c15b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f522ad9d640 1 -- 172.21.15.50:0/2033783659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c0c7300 con 0x7f522c15e840 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f522ad9d640 1 --2- 172.21.15.50:0/2033783659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c15e840 0x7f522c0b6b40 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f5224009f70 tx=0x7f5224004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f5222ffd640 1 -- 172.21.15.50:0/2033783659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522403f020 con 0x7f522c15e840 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f5222ffd640 1 -- 172.21.15.50:0/2033783659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5224037040 con 0x7f522c15e840 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.393+0000 7f5230a47640 1 -- 172.21.15.50:0/2033783659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522c0ca190 con 0x7f522c15e840 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.394+0000 7f5222ffd640 1 -- 172.21.15.50:0/2033783659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224036070 con 0x7f522c15e840 2024-09-11T22:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.394+0000 7f5230a47640 1 -- 172.21.15.50:0/2033783659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f522c15df10 con 0x7f522c15e840 2024-09-11T22:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.394+0000 7f5230a47640 1 -- 172.21.15.50:0/2033783659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f522c0b4c70 con 0x7f522c15e840 2024-09-11T22:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.395+0000 7f5222ffd640 1 -- 172.21.15.50:0/2033783659 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5224042020 con 0x7f522c15e840 2024-09-11T22:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.395+0000 7f5222ffd640 1 --2- 172.21.15.50:0/2033783659 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f520c06be30 0x7f520c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.396+0000 7f5222ffd640 1 -- 172.21.15.50:0/2033783659 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f52240ab170 con 0x7f522c15e840 2024-09-11T22:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.396+0000 7f522a59c640 1 --2- 172.21.15.50:0/2033783659 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f520c06be30 0x7f520c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.396+0000 7f522a59c640 1 --2- 172.21.15.50:0/2033783659 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f520c06be30 0x7f520c06e2f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f521c009560 tx=0x7f521c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:37.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.400+0000 7f5222ffd640 1 -- 172.21.15.50:0/2033783659 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5224049030 con 0x7f522c15e840 2024-09-11T22:19:37.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.640+0000 7f5230a47640 1 -- 172.21.15.50:0/2033783659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f522c0d1500 con 0x7f522c15e840 2024-09-11T22:19:37.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.641+0000 7f5222ffd640 1 -- 172.21.15.50:0/2033783659 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7f5224007c70 con 0x7f522c15e840 2024-09-11T22:19:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:37.641 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":526,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":132,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076564128,"bytes_used":2590908416,"bytes_avail":770503204864,"bytes_total":773094113280,"write_bytes_sec":54878539,"read_op_per_sec":0,"write_op_per_sec":53},"fsmap":{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8412}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-11T22:19:31.485493+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:19:37.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.642+0000 7f5230a47640 1 -- 172.21.15.50:0/2033783659 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f520c06be30 msgr2=0x7f520c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:37.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.642+0000 7f5230a47640 1 --2- 172.21.15.50:0/2033783659 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f520c06be30 0x7f520c06e2f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f521c009560 tx=0x7f521c009190 comp rx=0 tx=0).stop 2024-09-11T22:19:37.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.642+0000 7f5230a47640 1 -- 172.21.15.50:0/2033783659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c15e840 msgr2=0x7f522c0b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:37.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.642+0000 7f5230a47640 1 --2- 172.21.15.50:0/2033783659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c15e840 0x7f522c0b6b40 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f5224009f70 tx=0x7f5224004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:37.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.643+0000 7f5230a47640 1 -- 172.21.15.50:0/2033783659 shutdown_connections 2024-09-11T22:19:37.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.643+0000 7f5230a47640 1 --2- 172.21.15.50:0/2033783659 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f520c06be30 0x7f520c06e2f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.643+0000 7f5230a47640 1 --2- 172.21.15.50:0/2033783659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f522c0cf580 0x7f522c0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.643+0000 7f5230a47640 1 --2- 172.21.15.50:0/2033783659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f522c15e840 0x7f522c0b6b40 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.643+0000 7f5230a47640 1 --2- 172.21.15.50:0/2033783659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f522c0cdd50 0x7f522c15b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:37.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.643+0000 7f5230a47640 1 -- 172.21.15.50:0/2033783659 >> 172.21.15.50:0/2033783659 conn(0x7f522c0b4150 msgr2=0x7f522c0b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:37.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.643+0000 7f5230a47640 1 -- 172.21.15.50:0/2033783659 shutdown_connections 2024-09-11T22:19:37.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:37.643+0000 7f5230a47640 1 -- 172.21.15.50:0/2033783659 wait complete. 2024-09-11T22:19:37.654 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-11T22:19:38.656 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:38.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.770+0000 7f9e4c9af640 1 Processor -- start 2024-09-11T22:19:38.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.770+0000 7f9e4c9af640 1 -- start start 2024-09-11T22:19:38.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.771+0000 7f9e4c9af640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e480d0150 0x7f9e480b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:38.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.771+0000 7f9e4c9af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e480d0fd0 0x7f9e480af670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:38.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.771+0000 7f9e4c9af640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e4815ff40 con 0x7f9e4815fb60 2024-09-11T22:19:38.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.771+0000 7f9e4c9af640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9e480cf510 con 0x7f9e480d0150 2024-09-11T22:19:38.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.771+0000 7f9e4c9af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9e480cfdb0 con 0x7f9e480d0fd0 2024-09-11T22:19:38.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.771+0000 7f9e45d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e480d0150 0x7f9e480b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:38.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.771+0000 7f9e4659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9e4815fb60 0x7f9e480d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57128/0 (socket says 172.21.15.50:57128) 2024-09-11T22:19:38.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.771+0000 7f9e4659c640 1 -- 172.21.15.50:0/490975497 learned_addr learned my addr 172.21.15.50:0/490975497 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:38.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.771+0000 7f9e46d9d640 1 --2- 172.21.15.50:0/490975497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e480d0fd0 0x7f9e480af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:38.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.772+0000 7f9e45d9b640 1 -- 172.21.15.50:0/490975497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e480d0fd0 msgr2=0x7f9e480af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:38.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.772+0000 7f9e45d9b640 1 --2- 172.21.15.50:0/490975497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e480d0fd0 0x7f9e480af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:38.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.772+0000 7f9e45d9b640 1 -- 172.21.15.50:0/490975497 >> v1:172.21.15.50:6789/0 conn(0x7f9e4815fb60 legacy=0x7f9e480d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:38.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.772+0000 7f9e4559a640 1 -- 172.21.15.50:0/490975497 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4133604500 0 0) 0x7f9e4815ff40 con 0x7f9e4815fb60 2024-09-11T22:19:38.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.772+0000 7f9e45d9b640 1 -- 172.21.15.50:0/490975497 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e480d05e0 con 0x7f9e480d0150 2024-09-11T22:19:38.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.772+0000 7f9e46d9d640 1 --2- 172.21.15.50:0/490975497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e480d0fd0 0x7f9e480af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:38.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.772+0000 7f9e45d9b640 1 --2- 172.21.15.50:0/490975497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e480d0150 0x7f9e480b4c70 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0097a0 tx=0x7f9e3c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f959ccc307e67da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:38.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.772+0000 7f9e4559a640 1 -- 172.21.15.50:0/490975497 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c037070 con 0x7f9e480d0150 2024-09-11T22:19:38.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.773+0000 7f9e4559a640 1 -- 172.21.15.50:0/490975497 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e3c02ae50 con 0x7f9e480d0150 2024-09-11T22:19:38.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.773+0000 7f9e4559a640 1 -- 172.21.15.50:0/490975497 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c032660 con 0x7f9e480d0150 2024-09-11T22:19:38.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.773+0000 7f9e4c9af640 1 -- 172.21.15.50:0/490975497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e480d0150 msgr2=0x7f9e480b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:38.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.773+0000 7f9e4c9af640 1 --2- 172.21.15.50:0/490975497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e480d0150 0x7f9e480b4c70 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0097a0 tx=0x7f9e3c02a100 comp rx=0 tx=0).stop 2024-09-11T22:19:38.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.773+0000 7f9e4c9af640 1 -- 172.21.15.50:0/490975497 shutdown_connections 2024-09-11T22:19:38.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.773+0000 7f9e4c9af640 1 --2- 172.21.15.50:0/490975497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e480d0fd0 0x7f9e480af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:38.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.773+0000 7f9e4c9af640 1 --2- 172.21.15.50:0/490975497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e480d0150 0x7f9e480b4c70 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:38.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.773+0000 7f9e4c9af640 1 -- 172.21.15.50:0/490975497 >> 172.21.15.50:0/490975497 conn(0x7f9e480b4150 msgr2=0x7f9e480b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:38.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.773+0000 7f9e4c9af640 1 -- 172.21.15.50:0/490975497 shutdown_connections 2024-09-11T22:19:38.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.773+0000 7f9e4c9af640 1 -- 172.21.15.50:0/490975497 wait complete. 2024-09-11T22:19:38.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.775+0000 7f9e4c9af640 1 Processor -- start 2024-09-11T22:19:38.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.775+0000 7f9e4c9af640 1 -- start start 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.775+0000 7f9e4c9af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e480d0fd0 0x7f9e48152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.775+0000 7f9e4c9af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4815fb60 0x7f9e480ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.775+0000 7f9e4c9af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e480ca950 0x7f9e480cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.775+0000 7f9e4c9af640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9e480b1930 con 0x7f9e480d0fd0 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.775+0000 7f9e4c9af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e480cfa40 con 0x7f9e4815fb60 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.775+0000 7f9e4c9af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9e480b1ab0 con 0x7f9e480ca950 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.775+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e480d0fd0 0x7f9e48152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e480d0fd0 0x7f9e48152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37666/0 (socket says 172.21.15.50:37666) 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e4659c640 1 -- 172.21.15.50:0/143708826 learned_addr learned my addr 172.21.15.50:0/143708826 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e46d9d640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e480ca950 0x7f9e480cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e45d9b640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4815fb60 0x7f9e480ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e4659c640 1 -- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e480ca950 msgr2=0x7f9e480cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e4659c640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e480ca950 0x7f9e480cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:38.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e4659c640 1 -- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4815fb60 msgr2=0x7f9e480ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e4659c640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4815fb60 0x7f9e480ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e4659c640 1 -- 172.21.15.50:0/143708826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e480cbc90 con 0x7f9e480d0fd0 2024-09-11T22:19:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e45d9b640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4815fb60 0x7f9e480ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e4659c640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e480d0fd0 0x7f9e48152bb0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800c430 tx=0x7f9e3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e36ffd640 1 -- 172.21.15.50:0/143708826 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e380074e0 con 0x7f9e480d0fd0 2024-09-11T22:19:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e36ffd640 1 -- 172.21.15.50:0/143708826 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e380047e0 con 0x7f9e480d0fd0 2024-09-11T22:19:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e4c9af640 1 -- 172.21.15.50:0/143708826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e480c9650 con 0x7f9e480d0fd0 2024-09-11T22:19:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e36ffd640 1 -- 172.21.15.50:0/143708826 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38004bd0 con 0x7f9e480d0fd0 2024-09-11T22:19:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.776+0000 7f9e4c9af640 1 -- 172.21.15.50:0/143708826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e480c9c10 con 0x7f9e480d0fd0 2024-09-11T22:19:38.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.777+0000 7f9e4c9af640 1 -- 172.21.15.50:0/143708826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e480d1750 con 0x7f9e480d0fd0 2024-09-11T22:19:38.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.778+0000 7f9e36ffd640 1 -- 172.21.15.50:0/143708826 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e38011070 con 0x7f9e480d0fd0 2024-09-11T22:19:38.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.778+0000 7f9e36ffd640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9e2806be30 0x7f9e2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:38.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.778+0000 7f9e36ffd640 1 -- 172.21.15.50:0/143708826 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f9e3808ab00 con 0x7f9e480d0fd0 2024-09-11T22:19:38.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.778+0000 7f9e45d9b640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9e2806be30 0x7f9e2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:38.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.779+0000 7f9e45d9b640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9e2806be30 0x7f9e2806e2f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c034000 tx=0x7f9e3c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:38.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.782+0000 7f9e36ffd640 1 -- 172.21.15.50:0/143708826 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e480d1750 con 0x7f9e480d0fd0 2024-09-11T22:19:38.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.991+0000 7f9e4c9af640 1 -- 172.21.15.50:0/143708826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e480b4c70 con 0x7f9e480d0fd0 2024-09-11T22:19:38.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.992+0000 7f9e36ffd640 1 -- 172.21.15.50:0/143708826 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7f9e380594b0 con 0x7f9e480d0fd0 2024-09-11T22:19:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:38.993 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:38.993 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:38.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.994+0000 7f9e4c9af640 1 -- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9e2806be30 msgr2=0x7f9e2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:38.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.994+0000 7f9e4c9af640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9e2806be30 0x7f9e2806e2f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c034000 tx=0x7f9e3c02e000 comp rx=0 tx=0).stop 2024-09-11T22:19:38.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.994+0000 7f9e4c9af640 1 -- 172.21.15.50:0/143708826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e480d0fd0 msgr2=0x7f9e48152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:38.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.994+0000 7f9e4c9af640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e480d0fd0 0x7f9e48152bb0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800c430 tx=0x7f9e3800c8f0 comp rx=0 tx=0).stop 2024-09-11T22:19:38.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.994+0000 7f9e4c9af640 1 -- 172.21.15.50:0/143708826 shutdown_connections 2024-09-11T22:19:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.994+0000 7f9e4c9af640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9e2806be30 0x7f9e2806e2f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.994+0000 7f9e4c9af640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e480ca950 0x7f9e480cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.994+0000 7f9e4c9af640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e4815fb60 0x7f9e480ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.994+0000 7f9e4c9af640 1 --2- 172.21.15.50:0/143708826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e480d0fd0 0x7f9e48152bb0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.994+0000 7f9e4c9af640 1 -- 172.21.15.50:0/143708826 >> 172.21.15.50:0/143708826 conn(0x7f9e480b4150 msgr2=0x7f9e480b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.994+0000 7f9e4c9af640 1 -- 172.21.15.50:0/143708826 shutdown_connections 2024-09-11T22:19:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:38.994+0000 7f9e4c9af640 1 -- 172.21.15.50:0/143708826 wait complete. 2024-09-11T22:19:39.006 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-11T22:19:39.006 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:19:39.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.106+0000 7f0fc9ed7640 1 Processor -- start 2024-09-11T22:19:39.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.106+0000 7f0fc9ed7640 1 -- start start 2024-09-11T22:19:39.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.107+0000 7f0fc9ed7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0fc415e8e0 0x7f0fc40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:39.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.107+0000 7f0fc9ed7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc4163080 con 0x7f0fc40d1580 2024-09-11T22:19:39.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.107+0000 7f0fc9ed7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc40d2d20 con 0x7f0fc4162350 2024-09-11T22:19:39.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.107+0000 7f0fc9ed7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc415ecc0 con 0x7f0fc415e8e0 2024-09-11T22:19:39.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.107+0000 7f0fc37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0fc415e8e0 0x7f0fc40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:39.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.107+0000 7f0fc2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0fc40d1580 0x7f0fc40d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57138/0 (socket says 172.21.15.50:57138) 2024-09-11T22:19:39.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.107+0000 7f0fc2ffd640 1 -- 172.21.15.50:0/1904432391 learned_addr learned my addr 172.21.15.50:0/1904432391 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:39.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.108+0000 7f0fc27fc640 1 -- 172.21.15.50:0/1904432391 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3309874541 0 0) 0x7f0fc4163080 con 0x7f0fc40d1580 2024-09-11T22:19:39.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.108+0000 7f0fc27fc640 1 -- 172.21.15.50:0/1904432391 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fac003520 con 0x7f0fc40d1580 2024-09-11T22:19:39.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.108+0000 7f0fc37fe640 1 -- 172.21.15.50:0/1904432391 >> v1:172.21.15.77:6789/0 conn(0x7f0fc4162350 legacy=0x7f0fc41627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:39.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.108+0000 7f0fc37fe640 1 -- 172.21.15.50:0/1904432391 >> v1:172.21.15.50:6789/0 conn(0x7f0fc40d1580 legacy=0x7f0fc40d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:39.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.108+0000 7f0fc37fe640 1 -- 172.21.15.50:0/1904432391 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc40d3000 con 0x7f0fc415e8e0 2024-09-11T22:19:39.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.108+0000 7f0fc37fe640 1 --2- 172.21.15.50:0/1904432391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc415e8e0 0x7f0fc40b7880 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40097a0 tx=0x7f0fb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82dd94753738158 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:39.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.109+0000 7f0fc27fc640 1 -- 172.21.15.50:0/1904432391 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4037070 con 0x7f0fc415e8e0 2024-09-11T22:19:39.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.109+0000 7f0fc27fc640 1 -- 172.21.15.50:0/1904432391 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb4032440 con 0x7f0fc415e8e0 2024-09-11T22:19:39.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.109+0000 7f0fc27fc640 1 -- 172.21.15.50:0/1904432391 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40327f0 con 0x7f0fc415e8e0 2024-09-11T22:19:39.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.109+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/1904432391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc415e8e0 msgr2=0x7f0fc40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:39.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.109+0000 7f0fc9ed7640 1 --2- 172.21.15.50:0/1904432391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc415e8e0 0x7f0fc40b7880 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40097a0 tx=0x7f0fb402a270 comp rx=0 tx=0).stop 2024-09-11T22:19:39.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.109+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/1904432391 shutdown_connections 2024-09-11T22:19:39.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.109+0000 7f0fc9ed7640 1 --2- 172.21.15.50:0/1904432391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc415e8e0 0x7f0fc40b7880 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.109+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/1904432391 >> 172.21.15.50:0/1904432391 conn(0x7f0fc4067ba0 msgr2=0x7f0fc4067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:39.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.109+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/1904432391 shutdown_connections 2024-09-11T22:19:39.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.109+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/1904432391 wait complete. 2024-09-11T22:19:39.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.110+0000 7f0fc9ed7640 1 Processor -- start 2024-09-11T22:19:39.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.111+0000 7f0fc9ed7640 1 -- start start 2024-09-11T22:19:39.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.111+0000 7f0fc9ed7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fc40d1580 0x7f0fc41499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.111+0000 7f0fc9ed7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc415e8e0 0x7f0fc40b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.111+0000 7f0fc9ed7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc4162350 0x7f0fc40b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.111+0000 7f0fc9ed7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc40d3c10 con 0x7f0fc415e8e0 2024-09-11T22:19:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.111+0000 7f0fc9ed7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc40d3a90 con 0x7f0fc4162350 2024-09-11T22:19:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.111+0000 7f0fc9ed7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc40d3d90 con 0x7f0fc40d1580 2024-09-11T22:19:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.111+0000 7f0fc2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc415e8e0 0x7f0fc40b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fc2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc415e8e0 0x7f0fc40b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37694/0 (socket says 172.21.15.50:37694) 2024-09-11T22:19:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fc2ffd640 1 -- 172.21.15.50:0/4056600591 learned_addr learned my addr 172.21.15.50:0/4056600591 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fc37fe640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fc40d1580 0x7f0fc41499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fc3fff640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc4162350 0x7f0fc40b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fc2ffd640 1 -- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fc40d1580 msgr2=0x7f0fc41499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fc2ffd640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fc40d1580 0x7f0fc41499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fc2ffd640 1 -- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc4162350 msgr2=0x7f0fc40b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:39.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fc2ffd640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc4162350 0x7f0fc40b6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fc2ffd640 1 -- 172.21.15.50:0/4056600591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc40b71b0 con 0x7f0fc415e8e0 2024-09-11T22:19:39.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fc2ffd640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc415e8e0 0x7f0fc40b3630 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800c430 tx=0x7f0fb800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:39.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fabfff640 1 -- 172.21.15.50:0/4056600591 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8017070 con 0x7f0fc415e8e0 2024-09-11T22:19:39.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fabfff640 1 -- 172.21.15.50:0/4056600591 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb8005ce0 con 0x7f0fc415e8e0 2024-09-11T22:19:39.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fabfff640 1 -- 172.21.15.50:0/4056600591 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80072f0 con 0x7f0fc415e8e0 2024-09-11T22:19:39.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/4056600591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc414a060 con 0x7f0fc415e8e0 2024-09-11T22:19:39.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.112+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/4056600591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc414a620 con 0x7f0fc415e8e0 2024-09-11T22:19:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.113+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/4056600591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc40b7880 con 0x7f0fc415e8e0 2024-09-11T22:19:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.114+0000 7f0fabfff640 1 -- 172.21.15.50:0/4056600591 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0fb801a070 con 0x7f0fc415e8e0 2024-09-11T22:19:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.114+0000 7f0fabfff640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0fb006be30 0x7f0fb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.115+0000 7f0fabfff640 1 -- 172.21.15.50:0/4056600591 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f0fb808a350 con 0x7f0fc415e8e0 2024-09-11T22:19:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.115+0000 7f0fc37fe640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0fb006be30 0x7f0fb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:39.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.115+0000 7f0fc37fe640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0fb006be30 0x7f0fb006e2f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4034000 tx=0x7f0fb402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:39.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.119+0000 7f0fabfff640 1 -- 172.21.15.50:0/4056600591 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0fc40b71b0 con 0x7f0fc415e8e0 2024-09-11T22:19:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.365+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/4056600591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0fc4162c00 con 0x7f0fc415e8e0 2024-09-11T22:19:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.366+0000 7f0fabfff640 1 -- 172.21.15.50:0/4056600591 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1617 (secure 0 0 0) 0x7f0fb8058610 con 0x7f0fc415e8e0 2024-09-11T22:19:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:39.367 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":528,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":132,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076564128,"bytes_used":2590912512,"bytes_avail":770503200768,"bytes_total":773094113280,"write_bytes_sec":27455492,"read_op_per_sec":0,"write_op_per_sec":27},"fsmap":{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8412}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-11T22:19:37.487132+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:19:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.368+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0fb006be30 msgr2=0x7f0fb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.368+0000 7f0fc9ed7640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0fb006be30 0x7f0fb006e2f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4034000 tx=0x7f0fb402e000 comp rx=0 tx=0).stop 2024-09-11T22:19:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.368+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/4056600591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc415e8e0 msgr2=0x7f0fc40b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.368+0000 7f0fc9ed7640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc415e8e0 0x7f0fc40b3630 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800c430 tx=0x7f0fb800c8f0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.368+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/4056600591 shutdown_connections 2024-09-11T22:19:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.368+0000 7f0fc9ed7640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0fb006be30 0x7f0fb006e2f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.368+0000 7f0fc9ed7640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc4162350 0x7f0fc40b6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.368+0000 7f0fc9ed7640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fc415e8e0 0x7f0fc40b3630 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.368+0000 7f0fc9ed7640 1 --2- 172.21.15.50:0/4056600591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fc40d1580 0x7f0fc41499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.368+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/4056600591 >> 172.21.15.50:0/4056600591 conn(0x7f0fc4067ba0 msgr2=0x7f0fc40d19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:39.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.368+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/4056600591 shutdown_connections 2024-09-11T22:19:39.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.368+0000 7f0fc9ed7640 1 -- 172.21.15.50:0/4056600591 wait complete. 2024-09-11T22:19:39.380 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-11T22:19:39.380 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:19:39.380 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:19:39.424 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:19:39.467 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:19:39.467 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:19:39.467 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:19:39.467 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:19:39.484 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:19:39.484 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:19:39.541 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:19:39.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.683+0000 7f81e8d9f640 1 Processor -- start 2024-09-11T22:19:39.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.683+0000 7f81e8d9f640 1 -- start start 2024-09-11T22:19:39.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e8d9f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81e40d14a0 0x7f81e40b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:39.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e8d9f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e40b6ef0 con 0x7f81e40b36a0 2024-09-11T22:19:39.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e8d9f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e40cf9c0 con 0x7f81e415e800 2024-09-11T22:19:39.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e8d9f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f81e40cf770 con 0x7f81e40d14a0 2024-09-11T22:19:39.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f81e40b36a0 0x7f81e40d1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57142/0 (socket says 172.21.15.50:57142) 2024-09-11T22:19:39.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e2ffd640 1 -- 172.21.15.50:0/3484993963 learned_addr learned my addr 172.21.15.50:0/3484993963 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:39.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 573404511 0 0) 0x7f81e40b6ef0 con 0x7f81e40b36a0 2024-09-11T22:19:39.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81cc003520 con 0x7f81e40b36a0 2024-09-11T22:19:39.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e37fe640 1 --2- 172.21.15.50:0/3484993963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81e40d14a0 0x7f81e40b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:39.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2920953658 0 0) 0x7f81cc003520 con 0x7f81e40b36a0 2024-09-11T22:19:39.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81e40d14a0 msgr2=0x7f81e40b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:39.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e27fc640 1 --2- 172.21.15.50:0/3484993963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81e40d14a0 0x7f81e40b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 >> v1:172.21.15.77:6789/0 conn(0x7f81e415e800 legacy=0x7f81e40d2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:39.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.684+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e40d2930 con 0x7f81e40b36a0 2024-09-11T22:19:39.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f81d8001670 con 0x7f81e40b36a0 2024-09-11T22:19:39.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 >> v1:172.21.15.50:6789/0 conn(0x7f81e40b36a0 legacy=0x7f81e40d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:39.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e27fc640 1 --2- 172.21.15.50:0/3484993963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81cc0039e0 0x7f81cc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:39.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e27fc640 1 --2- 172.21.15.50:0/3484993963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81e40d14a0 0x7f81cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:39.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e27fc640 1 --2- 172.21.15.50:0/3484993963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81cc004d40 0x7f81cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:39.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f81e40cf770 con 0x7f81cc004d40 2024-09-11T22:19:39.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc00bba0 con 0x7f81cc0039e0 2024-09-11T22:19:39.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f81cc00bda0 con 0x7f81e40d14a0 2024-09-11T22:19:39.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e3fff640 1 --2- 172.21.15.50:0/3484993963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81cc004d40 0x7f81cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:39.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e2ffd640 1 --2- 172.21.15.50:0/3484993963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81e40d14a0 0x7f81cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:39.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e37fe640 1 --2- 172.21.15.50:0/3484993963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81cc0039e0 0x7f81cc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:39.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e3fff640 1 -- 172.21.15.50:0/3484993963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81e40d14a0 msgr2=0x7f81cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:39.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e3fff640 1 --2- 172.21.15.50:0/3484993963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81e40d14a0 0x7f81cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e3fff640 1 -- 172.21.15.50:0/3484993963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81cc0039e0 msgr2=0x7f81cc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:39.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e3fff640 1 --2- 172.21.15.50:0/3484993963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81cc0039e0 0x7f81cc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.685+0000 7f81e3fff640 1 -- 172.21.15.50:0/3484993963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81cc003520 con 0x7f81cc004d40 2024-09-11T22:19:39.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.686+0000 7f81e3fff640 1 --2- 172.21.15.50:0/3484993963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81cc004d40 0x7f81cc0051c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f81dc001e50 tx=0x7f81cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611cbf89c854661a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:39.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.686+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc001a70 con 0x7f81cc004d40 2024-09-11T22:19:39.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.686+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc003970 con 0x7f81cc004d40 2024-09-11T22:19:39.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.686+0000 7f81e27fc640 1 -- 172.21.15.50:0/3484993963 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc003d60 con 0x7f81cc004d40 2024-09-11T22:19:39.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.686+0000 7f81e8d9f640 1 -- 172.21.15.50:0/3484993963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81cc004d40 msgr2=0x7f81cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:39.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.686+0000 7f81e8d9f640 1 --2- 172.21.15.50:0/3484993963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81cc004d40 0x7f81cc0051c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f81dc001e50 tx=0x7f81cc005830 comp rx=0 tx=0).stop 2024-09-11T22:19:39.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.686+0000 7f81e3fff640 1 -- 172.21.15.50:0/3484993963 reap_dead start 2024-09-11T22:19:39.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.686+0000 7f81e8d9f640 1 -- 172.21.15.50:0/3484993963 shutdown_connections 2024-09-11T22:19:39.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.686+0000 7f81e8d9f640 1 -- 172.21.15.50:0/3484993963 >> 172.21.15.50:0/3484993963 conn(0x7f81e4067ba0 msgr2=0x7f81e4067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:39.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.687+0000 7f81e8d9f640 1 -- 172.21.15.50:0/3484993963 shutdown_connections 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.687+0000 7f81e8d9f640 1 -- 172.21.15.50:0/3484993963 wait complete. 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.688+0000 7f81e8d9f640 1 Processor -- start 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.688+0000 7f81e8d9f640 1 -- start start 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e8d9f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81cc004d40 0x7f81e40cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e8d9f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81e40c8070 0x7f81e4155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e8d9f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81e40cb970 0x7f81e415f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e8d9f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f81e40cfe20 con 0x7f81cc004d40 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e8d9f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81e40cfca0 con 0x7f81e40cb970 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e8d9f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f81e40b3b10 con 0x7f81e40c8070 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81cc004d40 0x7f81e40cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81cc004d40 0x7f81e40cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37714/0 (socket says 172.21.15.50:37714) 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e37fe640 1 -- 172.21.15.50:0/2133621093 learned_addr learned my addr 172.21.15.50:0/2133621093 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e2ffd640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81e40c8070 0x7f81e4155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e3fff640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81e40cb970 0x7f81e415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e37fe640 1 -- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81e40c8070 msgr2=0x7f81e4155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e37fe640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81e40c8070 0x7f81e4155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e37fe640 1 -- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81e40cb970 msgr2=0x7f81e415f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e37fe640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81e40cb970 0x7f81e415f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e37fe640 1 -- 172.21.15.50:0/2133621093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e40cce70 con 0x7f81cc004d40 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e3fff640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81e40cb970 0x7f81e415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e37fe640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81cc004d40 0x7f81e40cc850 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f81d400b7f0 tx=0x7f81d400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81cbfff640 1 -- 172.21.15.50:0/2133621093 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4018070 con 0x7f81cc004d40 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81cbfff640 1 -- 172.21.15.50:0/2133621093 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d4010830 con 0x7f81cc004d40 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e8d9f640 1 -- 172.21.15.50:0/2133621093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e40c9880 con 0x7f81cc004d40 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81cbfff640 1 -- 172.21.15.50:0/2133621093 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4010c00 con 0x7f81cc004d40 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.689+0000 7f81e8d9f640 1 -- 172.21.15.50:0/2133621093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e40c9e40 con 0x7f81cc004d40 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.690+0000 7f81e8d9f640 1 -- 172.21.15.50:0/2133621093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e40b3e90 con 0x7f81cc004d40 2024-09-11T22:19:39.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.691+0000 7f81cbfff640 1 -- 172.21.15.50:0/2133621093 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81d401b070 con 0x7f81cc004d40 2024-09-11T22:19:39.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.691+0000 7f81cbfff640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81d006be30 0x7f81d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:39.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.691+0000 7f81cbfff640 1 -- 172.21.15.50:0/2133621093 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f81d408b280 con 0x7f81cc004d40 2024-09-11T22:19:39.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.692+0000 7f81e2ffd640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81d006be30 0x7f81d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:39.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.692+0000 7f81e2ffd640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81d006be30 0x7f81d006e2f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f81d8000ff0 tx=0x7f81d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:39.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.696+0000 7f81cbfff640 1 -- 172.21.15.50:0/2133621093 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81d4059cc0 con 0x7f81cc004d40 2024-09-11T22:19:39.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.882+0000 7f81e8d9f640 1 -- 172.21.15.50:0/2133621093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f81e40b41d0 con 0x7f81cc004d40 2024-09-11T22:19:39.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.882+0000 7f81cbfff640 1 -- 172.21.15.50:0/2133621093 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v132) ==== 80+0+0 (secure 0 0 0) 0x7f81d40595c0 con 0x7f81cc004d40 2024-09-11T22:19:39.883 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:19:39.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.884+0000 7f81e8d9f640 1 -- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81d006be30 msgr2=0x7f81d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.884+0000 7f81e8d9f640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81d006be30 0x7f81d006e2f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f81d8000ff0 tx=0x7f81d8009040 comp rx=0 tx=0).stop 2024-09-11T22:19:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.884+0000 7f81e8d9f640 1 -- 172.21.15.50:0/2133621093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81cc004d40 msgr2=0x7f81e40cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.884+0000 7f81e8d9f640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81cc004d40 0x7f81e40cc850 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f81d400b7f0 tx=0x7f81d400bcb0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.884+0000 7f81e8d9f640 1 -- 172.21.15.50:0/2133621093 shutdown_connections 2024-09-11T22:19:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.884+0000 7f81e8d9f640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f81d006be30 0x7f81d006e2f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.884+0000 7f81e8d9f640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81e40c8070 0x7f81e4155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.884+0000 7f81e8d9f640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81e40cb970 0x7f81e415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.884+0000 7f81e8d9f640 1 --2- 172.21.15.50:0/2133621093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81cc004d40 0x7f81e40cc850 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.884+0000 7f81e8d9f640 1 -- 172.21.15.50:0/2133621093 >> 172.21.15.50:0/2133621093 conn(0x7f81e4067ba0 msgr2=0x7f81e40b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.885+0000 7f81e8d9f640 1 -- 172.21.15.50:0/2133621093 shutdown_connections 2024-09-11T22:19:39.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:39.885+0000 7f81e8d9f640 1 -- 172.21.15.50:0/2133621093 wait complete. 2024-09-11T22:19:39.896 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:19:39.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:39.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:19:40.537 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:19:40.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:19:40.538 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:19:40.565 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:19:40.565 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:19:40.565 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:19:40.582 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:19:40.582 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:19:40.582 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:19:40.583 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:19:40.621 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:19:40.621 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:19:40.622 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:19:40.622 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:19:40.640 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:19:40.641 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.763+0000 7fd0ef267640 1 Processor -- start 2024-09-11T22:19:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.764+0000 7fd0ef267640 1 -- start start 2024-09-11T22:19:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.764+0000 7fd0ef267640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0e815e870 0x7fd0e80d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.764+0000 7fd0ef267640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e80cfa80 con 0x7fd0e80d3c00 2024-09-11T22:19:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.765+0000 7fd0ef267640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e80d40d0 con 0x7fd0e80d16d0 2024-09-11T22:19:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.765+0000 7fd0ef267640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e80d1b40 con 0x7fd0e815e870 2024-09-11T22:19:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.765+0000 7fd0ec802640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd0e80d16d0 0x7fd0e80d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:34030/0 (socket says 172.21.15.50:34030) 2024-09-11T22:19:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.765+0000 7fd0ec802640 1 -- 172.21.15.50:0/1040931756 learned_addr learned my addr 172.21.15.50:0/1040931756 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.765+0000 7fd0ed003640 1 --2- 172.21.15.50:0/1040931756 >> v2:172.21.15.50:3300/0 conn(0x7fd0e815e870 0x7fd0e80d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.765+0000 7fd0ed804640 1 --1- 172.21.15.50:0/1040931756 >> v1:172.21.15.50:6789/0 conn(0x7fd0e80d3c00 0x7fd0e80b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57152/0 (socket says 172.21.15.50:57152) 2024-09-11T22:19:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.765+0000 7fd0dffff640 1 -- 172.21.15.50:0/1040931756 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2184672895 0 0) 0x7fd0e80d40d0 con 0x7fd0e80d16d0 2024-09-11T22:19:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.765+0000 7fd0ed003640 1 -- 172.21.15.50:0/1040931756 >> v1:172.21.15.77:6789/0 conn(0x7fd0e80d16d0 legacy=0x7fd0e80d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.765+0000 7fd0ed003640 1 -- 172.21.15.50:0/1040931756 >> v1:172.21.15.50:6789/0 conn(0x7fd0e80d3c00 legacy=0x7fd0e80b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.765+0000 7fd0ed003640 1 -- 172.21.15.50:0/1040931756 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e80d43b0 con 0x7fd0e815e870 2024-09-11T22:19:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.766+0000 7fd0ed003640 1 --2- 172.21.15.50:0/1040931756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e815e870 0x7fd0e80d1190 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40097a0 tx=0x7fd0e402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22d14a1f2994eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.766+0000 7fd0dffff640 1 -- 172.21.15.50:0/1040931756 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4037070 con 0x7fd0e815e870 2024-09-11T22:19:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.766+0000 7fd0dffff640 1 -- 172.21.15.50:0/1040931756 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e402adc0 con 0x7fd0e815e870 2024-09-11T22:19:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.766+0000 7fd0dffff640 1 -- 172.21.15.50:0/1040931756 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4032660 con 0x7fd0e815e870 2024-09-11T22:19:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.767+0000 7fd0ef267640 1 -- 172.21.15.50:0/1040931756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e815e870 msgr2=0x7fd0e80d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.767+0000 7fd0ef267640 1 --2- 172.21.15.50:0/1040931756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e815e870 0x7fd0e80d1190 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40097a0 tx=0x7fd0e402a130 comp rx=0 tx=0).stop 2024-09-11T22:19:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.767+0000 7fd0ef267640 1 -- 172.21.15.50:0/1040931756 shutdown_connections 2024-09-11T22:19:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.767+0000 7fd0ef267640 1 --2- 172.21.15.50:0/1040931756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e815e870 0x7fd0e80d1190 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.767+0000 7fd0ef267640 1 -- 172.21.15.50:0/1040931756 >> 172.21.15.50:0/1040931756 conn(0x7fd0e80727a0 msgr2=0x7fd0e80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.767+0000 7fd0ef267640 1 -- 172.21.15.50:0/1040931756 shutdown_connections 2024-09-11T22:19:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.767+0000 7fd0ef267640 1 -- 172.21.15.50:0/1040931756 wait complete. 2024-09-11T22:19:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.768+0000 7fd0ef267640 1 Processor -- start 2024-09-11T22:19:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.768+0000 7fd0ef267640 1 -- start start 2024-09-11T22:19:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ef267640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0e80d16d0 0x7fd0e815b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ef267640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80d3c00 0x7fd0e80cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ef267640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e815e870 0x7fd0e80cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ef267640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e815ec50 con 0x7fd0e80d3c00 2024-09-11T22:19:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ef267640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e80b7ee0 con 0x7fd0e815e870 2024-09-11T22:19:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ef267640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e80b78b0 con 0x7fd0e80d16d0 2024-09-11T22:19:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ec802640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80d3c00 0x7fd0e80cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ec802640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80d3c00 0x7fd0e80cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37724/0 (socket says 172.21.15.50:37724) 2024-09-11T22:19:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ec802640 1 -- 172.21.15.50:0/113267141 learned_addr learned my addr 172.21.15.50:0/113267141 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ed804640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e815e870 0x7fd0e80cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ed003640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0e80d16d0 0x7fd0e815b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ec802640 1 -- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0e80d16d0 msgr2=0x7fd0e815b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ec802640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0e80d16d0 0x7fd0e815b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ec802640 1 -- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e815e870 msgr2=0x7fd0e80cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ec802640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e815e870 0x7fd0e80cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.769+0000 7fd0ec802640 1 -- 172.21.15.50:0/113267141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e80b6b40 con 0x7fd0e80d3c00 2024-09-11T22:19:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.770+0000 7fd0ec802640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80d3c00 0x7fd0e80cc2d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800c3f0 tx=0x7fd0d800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.770+0000 7fd0ddffb640 1 -- 172.21.15.50:0/113267141 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80074e0 con 0x7fd0e80d3c00 2024-09-11T22:19:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.770+0000 7fd0ddffb640 1 -- 172.21.15.50:0/113267141 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d80047e0 con 0x7fd0e80d3c00 2024-09-11T22:19:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.770+0000 7fd0ddffb640 1 -- 172.21.15.50:0/113267141 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8004c10 con 0x7fd0e80d3c00 2024-09-11T22:19:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.770+0000 7fd0ef267640 1 -- 172.21.15.50:0/113267141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e815bb40 con 0x7fd0e80d3c00 2024-09-11T22:19:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.770+0000 7fd0ef267640 1 -- 172.21.15.50:0/113267141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e80b6860 con 0x7fd0e80d3c00 2024-09-11T22:19:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.771+0000 7fd0ef267640 1 -- 172.21.15.50:0/113267141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e80d1190 con 0x7fd0e80d3c00 2024-09-11T22:19:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.772+0000 7fd0ddffb640 1 -- 172.21.15.50:0/113267141 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0d8011070 con 0x7fd0e80d3c00 2024-09-11T22:19:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.772+0000 7fd0ddffb640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd0cc06be30 0x7fd0cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.772+0000 7fd0ddffb640 1 -- 172.21.15.50:0/113267141 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fd0d808a870 con 0x7fd0e80d3c00 2024-09-11T22:19:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.772+0000 7fd0ed003640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd0cc06be30 0x7fd0cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.773+0000 7fd0ed003640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd0cc06be30 0x7fd0cc06e2f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4034000 tx=0x7fd0e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.776+0000 7fd0ddffb640 1 -- 172.21.15.50:0/113267141 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0d8058c60 con 0x7fd0e80d3c00 2024-09-11T22:19:40.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.989+0000 7fd0ef267640 1 -- 172.21.15.50:0/113267141 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0e80c9220 con 0x7fd0e80d3c00 2024-09-11T22:19:40.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.989+0000 7fd0ddffb640 1 -- 172.21.15.50:0/113267141 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7fd0d805cf60 con 0x7fd0e80d3c00 2024-09-11T22:19:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:40.990 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:40.991 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:40.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.991+0000 7fd0ef267640 1 -- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd0cc06be30 msgr2=0x7fd0cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:40.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.991+0000 7fd0ef267640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd0cc06be30 0x7fd0cc06e2f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4034000 tx=0x7fd0e402e000 comp rx=0 tx=0).stop 2024-09-11T22:19:40.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.991+0000 7fd0ef267640 1 -- 172.21.15.50:0/113267141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80d3c00 msgr2=0x7fd0e80cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:40.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.991+0000 7fd0ef267640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80d3c00 0x7fd0e80cc2d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800c3f0 tx=0x7fd0d800c8b0 comp rx=0 tx=0).stop 2024-09-11T22:19:40.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.991+0000 7fd0ef267640 1 -- 172.21.15.50:0/113267141 shutdown_connections 2024-09-11T22:19:40.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.991+0000 7fd0ef267640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd0cc06be30 0x7fd0cc06e2f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:40.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.991+0000 7fd0ef267640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e815e870 0x7fd0e80cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:40.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.991+0000 7fd0ef267640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80d3c00 0x7fd0e80cc2d0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:40.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.991+0000 7fd0ef267640 1 --2- 172.21.15.50:0/113267141 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0e80d16d0 0x7fd0e815b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:40.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.991+0000 7fd0ef267640 1 -- 172.21.15.50:0/113267141 >> 172.21.15.50:0/113267141 conn(0x7fd0e80727a0 msgr2=0x7fd0e815ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:40.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.992+0000 7fd0ef267640 1 -- 172.21.15.50:0/113267141 shutdown_connections 2024-09-11T22:19:40.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:40.992+0000 7fd0ef267640 1 -- 172.21.15.50:0/113267141 wait complete. 2024-09-11T22:19:41.003 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:41.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.105+0000 7fba42b91640 1 Processor -- start 2024-09-11T22:19:41.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.105+0000 7fba42b91640 1 -- start start 2024-09-11T22:19:41.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.106+0000 7fba42b91640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba3c15e840 0x7fba3c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.106+0000 7fba42b91640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3c0ce5f0 con 0x7fba3c0cf580 2024-09-11T22:19:41.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.106+0000 7fba42b91640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3c0ce310 con 0x7fba3c0cdd50 2024-09-11T22:19:41.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.106+0000 7fba42b91640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fba3c06c240 con 0x7fba3c15e840 2024-09-11T22:19:41.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.106+0000 7fba4112e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fba3c0cf580 0x7fba3c06c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57160/0 (socket says 172.21.15.50:57160) 2024-09-11T22:19:41.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.106+0000 7fba4112e640 1 -- 172.21.15.50:0/4012874923 learned_addr learned my addr 172.21.15.50:0/4012874923 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:41.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.106+0000 7fba4092d640 1 --2- 172.21.15.50:0/4012874923 >> v2:172.21.15.77:3300/0 conn(0x7fba3c15e840 0x7fba3c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873242724 0 0) 0x7fba3c0ce5f0 con 0x7fba3c0cf580 2024-09-11T22:19:41.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba24003520 con 0x7fba3c0cf580 2024-09-11T22:19:41.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1278320367 0 0) 0x7fba24003520 con 0x7fba3c0cf580 2024-09-11T22:19:41.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 >> v2:172.21.15.77:3300/0 conn(0x7fba3c15e840 msgr2=0x7fba3c0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:41.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 --2- 172.21.15.50:0/4012874923 >> v2:172.21.15.77:3300/0 conn(0x7fba3c15e840 0x7fba3c0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 >> v1:172.21.15.77:6789/0 conn(0x7fba3c0cdd50 legacy=0x7fba3c0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c06bbf0 con 0x7fba3c0cf580 2024-09-11T22:19:41.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fba340019f0 con 0x7fba3c0cf580 2024-09-11T22:19:41.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 >> v1:172.21.15.50:6789/0 conn(0x7fba3c0cf580 legacy=0x7fba3c06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 --2- 172.21.15.50:0/4012874923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba240039b0 0x7fba24003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 --2- 172.21.15.50:0/4012874923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba24004800 0x7fba24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 --2- 172.21.15.50:0/4012874923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba240051c0 0x7fba2400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c06c240 con 0x7fba240051c0 2024-09-11T22:19:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba2400c060 con 0x7fba240039b0 2024-09-11T22:19:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fba2400c260 con 0x7fba24004800 2024-09-11T22:19:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba4112e640 1 --2- 172.21.15.50:0/4012874923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba240051c0 0x7fba2400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba4092d640 1 --2- 172.21.15.50:0/4012874923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba240039b0 0x7fba24003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3bfff640 1 --2- 172.21.15.50:0/4012874923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba24004800 0x7fba24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba4112e640 1 -- 172.21.15.50:0/4012874923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba24004800 msgr2=0x7fba24004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba4112e640 1 --2- 172.21.15.50:0/4012874923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba24004800 0x7fba24004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba4112e640 1 -- 172.21.15.50:0/4012874923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba240039b0 msgr2=0x7fba24003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba4112e640 1 --2- 172.21.15.50:0/4012874923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba240039b0 0x7fba24003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba4112e640 1 -- 172.21.15.50:0/4012874923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba24003520 con 0x7fba240051c0 2024-09-11T22:19:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.107+0000 7fba3bfff640 1 --2- 172.21.15.50:0/4012874923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba24004800 0x7fba24004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.108+0000 7fba4112e640 1 -- 172.21.15.50:0/4012874923 reap_dead start 2024-09-11T22:19:41.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.108+0000 7fba4112e640 1 --2- 172.21.15.50:0/4012874923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba240051c0 0x7fba2400b9c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fba3400a840 tx=0x7fba24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d65b60fcb9192e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:41.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.108+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3400a460 con 0x7fba240051c0 2024-09-11T22:19:41.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.108+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3402f070 con 0x7fba240051c0 2024-09-11T22:19:41.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.108+0000 7fba3b7fe640 1 -- 172.21.15.50:0/4012874923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3402bcb0 con 0x7fba240051c0 2024-09-11T22:19:41.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.109+0000 7fba42b91640 1 -- 172.21.15.50:0/4012874923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba240051c0 msgr2=0x7fba2400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.109+0000 7fba42b91640 1 --2- 172.21.15.50:0/4012874923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba240051c0 0x7fba2400b9c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fba3400a840 tx=0x7fba24005830 comp rx=0 tx=0).stop 2024-09-11T22:19:41.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.109+0000 7fba42b91640 1 -- 172.21.15.50:0/4012874923 shutdown_connections 2024-09-11T22:19:41.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.109+0000 7fba42b91640 1 --2- 172.21.15.50:0/4012874923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba240051c0 0x7fba2400b9c0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.109+0000 7fba42b91640 1 -- 172.21.15.50:0/4012874923 >> 172.21.15.50:0/4012874923 conn(0x7fba3c0b4150 msgr2=0x7fba3c0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:41.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.109+0000 7fba42b91640 1 -- 172.21.15.50:0/4012874923 shutdown_connections 2024-09-11T22:19:41.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.109+0000 7fba42b91640 1 -- 172.21.15.50:0/4012874923 wait complete. 2024-09-11T22:19:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.110+0000 7fba42b91640 1 Processor -- start 2024-09-11T22:19:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.110+0000 7fba42b91640 1 -- start start 2024-09-11T22:19:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba42b91640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba240051c0 0x7fba3c15d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba42b91640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba3c0c5f80 0x7fba3c0b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba42b91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3c15c560 0x7fba3c15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba42b91640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c15ec20 con 0x7fba240051c0 2024-09-11T22:19:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba42b91640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c0d0470 con 0x7fba3c15c560 2024-09-11T22:19:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba42b91640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fba3c15eda0 con 0x7fba3c0c5f80 2024-09-11T22:19:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba4092d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba240051c0 0x7fba3c15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba4092d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba240051c0 0x7fba3c15d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37734/0 (socket says 172.21.15.50:37734) 2024-09-11T22:19:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba4092d640 1 -- 172.21.15.50:0/117081424 learned_addr learned my addr 172.21.15.50:0/117081424 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba3bfff640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba3c0c5f80 0x7fba3c0b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba4112e640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3c15c560 0x7fba3c15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba4092d640 1 -- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba3c0c5f80 msgr2=0x7fba3c0b7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba4092d640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba3c0c5f80 0x7fba3c0b7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba4092d640 1 -- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3c15c560 msgr2=0x7fba3c15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba4092d640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3c15c560 0x7fba3c15c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba4092d640 1 -- 172.21.15.50:0/117081424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c1f88b0 con 0x7fba240051c0 2024-09-11T22:19:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba4112e640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3c15c560 0x7fba3c15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.111+0000 7fba4092d640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba240051c0 0x7fba3c15d510 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fba2c011940 tx=0x7fba2c011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:41.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.112+0000 7fba397fa640 1 -- 172.21.15.50:0/117081424 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c00fa90 con 0x7fba240051c0 2024-09-11T22:19:41.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.112+0000 7fba397fa640 1 -- 172.21.15.50:0/117081424 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba2c00fc30 con 0x7fba240051c0 2024-09-11T22:19:41.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.112+0000 7fba42b91640 1 -- 172.21.15.50:0/117081424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3c0c6b30 con 0x7fba240051c0 2024-09-11T22:19:41.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.112+0000 7fba397fa640 1 -- 172.21.15.50:0/117081424 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c014440 con 0x7fba240051c0 2024-09-11T22:19:41.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.112+0000 7fba42b91640 1 -- 172.21.15.50:0/117081424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3c1f85a0 con 0x7fba240051c0 2024-09-11T22:19:41.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.113+0000 7fba42b91640 1 -- 172.21.15.50:0/117081424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3c0b4c70 con 0x7fba240051c0 2024-09-11T22:19:41.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.113+0000 7fba397fa640 1 -- 172.21.15.50:0/117081424 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba2c012040 con 0x7fba240051c0 2024-09-11T22:19:41.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.114+0000 7fba397fa640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fba2806be60 0x7fba2806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.114+0000 7fba397fa640 1 -- 172.21.15.50:0/117081424 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fba2c08b2e0 con 0x7fba240051c0 2024-09-11T22:19:41.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.114+0000 7fba3bfff640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fba2806be60 0x7fba2806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.114+0000 7fba3bfff640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fba2806be60 0x7fba2806e320 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fba30000c00 tx=0x7fba30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:41.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.118+0000 7fba397fa640 1 -- 172.21.15.50:0/117081424 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba2c019030 con 0x7fba240051c0 2024-09-11T22:19:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.327+0000 7fba42b91640 1 -- 172.21.15.50:0/117081424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba3c15dfd0 con 0x7fba240051c0 2024-09-11T22:19:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.328+0000 7fba397fa640 1 -- 172.21.15.50:0/117081424 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7fba2c059d20 con 0x7fba240051c0 2024-09-11T22:19:41.329 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:41.329 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:41.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.329+0000 7fba42b91640 1 -- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fba2806be60 msgr2=0x7fba2806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.329+0000 7fba42b91640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fba2806be60 0x7fba2806e320 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fba30000c00 tx=0x7fba30009040 comp rx=0 tx=0).stop 2024-09-11T22:19:41.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.329+0000 7fba42b91640 1 -- 172.21.15.50:0/117081424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba240051c0 msgr2=0x7fba3c15d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.329+0000 7fba42b91640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba240051c0 0x7fba3c15d510 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fba2c011940 tx=0x7fba2c011e00 comp rx=0 tx=0).stop 2024-09-11T22:19:41.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.330+0000 7fba42b91640 1 -- 172.21.15.50:0/117081424 shutdown_connections 2024-09-11T22:19:41.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.330+0000 7fba42b91640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fba2806be60 0x7fba2806e320 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.330+0000 7fba42b91640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba3c0c5f80 0x7fba3c0b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.330+0000 7fba42b91640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3c15c560 0x7fba3c15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.330+0000 7fba42b91640 1 --2- 172.21.15.50:0/117081424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba240051c0 0x7fba3c15d510 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.330+0000 7fba42b91640 1 -- 172.21.15.50:0/117081424 >> 172.21.15.50:0/117081424 conn(0x7fba3c0b4150 msgr2=0x7fba3c15a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:41.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.330+0000 7fba42b91640 1 -- 172.21.15.50:0/117081424 shutdown_connections 2024-09-11T22:19:41.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.330+0000 7fba42b91640 1 -- 172.21.15.50:0/117081424 wait complete. 2024-09-11T22:19:41.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:19:41.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.443+0000 7f4d57d6d640 1 Processor -- start 2024-09-11T22:19:41.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.444+0000 7f4d57d6d640 1 -- start start 2024-09-11T22:19:41.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.444+0000 7f4d57d6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5015e870 0x7f4d500d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.444+0000 7f4d57d6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d500d16d0 0x7f4d500d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.444+0000 7f4d57d6d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d500cfa80 con 0x7f4d500d3a30 2024-09-11T22:19:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.444+0000 7f4d57d6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4d500d3ea0 con 0x7f4d500d16d0 2024-09-11T22:19:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.444+0000 7f4d57d6d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d500d1b10 con 0x7f4d5015e870 2024-09-11T22:19:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.445+0000 7f4d55308640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d500d16d0 0x7f4d500d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.445+0000 7f4d55308640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d500d16d0 0x7f4d500d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37744/0 (socket says 172.21.15.50:37744) 2024-09-11T22:19:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.445+0000 7f4d55308640 1 -- 172.21.15.50:0/3006980421 learned_addr learned my addr 172.21.15.50:0/3006980421 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.445+0000 7f4d55b09640 1 --2- 172.21.15.50:0/3006980421 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5015e870 0x7f4d500d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.445+0000 7f4d55308640 1 -- 172.21.15.50:0/3006980421 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5015e870 msgr2=0x7f4d500d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.445+0000 7f4d55308640 1 --2- 172.21.15.50:0/3006980421 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5015e870 0x7f4d500d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.445+0000 7f4d55308640 1 -- 172.21.15.50:0/3006980421 >> v1:172.21.15.77:6789/0 conn(0x7f4d500d3a30 legacy=0x7f4d500b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.445+0000 7f4d55308640 1 -- 172.21.15.50:0/3006980421 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d500d40d0 con 0x7f4d500d16d0 2024-09-11T22:19:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.446+0000 7f4d55308640 1 --2- 172.21.15.50:0/3006980421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d500d16d0 0x7f4d500d34f0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009870 tx=0x7f4d4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb2aca3fa00a227 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.446+0000 7f4d54b07640 1 -- 172.21.15.50:0/3006980421 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44037070 con 0x7f4d500d16d0 2024-09-11T22:19:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.446+0000 7f4d54b07640 1 -- 172.21.15.50:0/3006980421 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d44032440 con 0x7f4d500d16d0 2024-09-11T22:19:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.446+0000 7f4d54b07640 1 -- 172.21.15.50:0/3006980421 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44032810 con 0x7f4d500d16d0 2024-09-11T22:19:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.446+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3006980421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d500d16d0 msgr2=0x7f4d500d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.446+0000 7f4d57d6d640 1 --2- 172.21.15.50:0/3006980421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d500d16d0 0x7f4d500d34f0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009870 tx=0x7f4d4402a270 comp rx=0 tx=0).stop 2024-09-11T22:19:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.446+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3006980421 shutdown_connections 2024-09-11T22:19:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.446+0000 7f4d57d6d640 1 --2- 172.21.15.50:0/3006980421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d500d16d0 0x7f4d500d34f0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.446+0000 7f4d57d6d640 1 --2- 172.21.15.50:0/3006980421 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5015e870 0x7f4d500d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.446+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3006980421 >> 172.21.15.50:0/3006980421 conn(0x7f4d500727a0 msgr2=0x7f4d500679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.446+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3006980421 shutdown_connections 2024-09-11T22:19:41.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.446+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3006980421 wait complete. 2024-09-11T22:19:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.448+0000 7f4d57d6d640 1 Processor -- start 2024-09-11T22:19:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.448+0000 7f4d57d6d640 1 -- start start 2024-09-11T22:19:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.448+0000 7f4d57d6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d500d16d0 0x7f4d50154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.448+0000 7f4d57d6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d500d3a30 0x7f4d500cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.448+0000 7f4d57d6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5015e870 0x7f4d500cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.448+0000 7f4d57d6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d500b7ee0 con 0x7f4d500d3a30 2024-09-11T22:19:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.448+0000 7f4d57d6d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d500b7c00 con 0x7f4d500d16d0 2024-09-11T22:19:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.448+0000 7f4d57d6d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d5015ec50 con 0x7f4d5015e870 2024-09-11T22:19:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d55308640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d500d3a30 0x7f4d500cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d55308640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d500d3a30 0x7f4d500cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37748/0 (socket says 172.21.15.50:37748) 2024-09-11T22:19:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d55308640 1 -- 172.21.15.50:0/3386679835 learned_addr learned my addr 172.21.15.50:0/3386679835 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d5630a640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5015e870 0x7f4d500cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d55308640 1 -- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5015e870 msgr2=0x7f4d500cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d55b09640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d500d16d0 0x7f4d50154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d55308640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5015e870 0x7f4d500cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d55308640 1 -- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d500d16d0 msgr2=0x7f4d50154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d55308640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d500d16d0 0x7f4d50154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d55308640 1 -- 172.21.15.50:0/3386679835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d501e7c10 con 0x7f4d500d3a30 2024-09-11T22:19:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d55308640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d500d3a30 0x7f4d500cd150 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f4d44000c00 tx=0x7f4d440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d4e7fc640 1 -- 172.21.15.50:0/3386679835 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44037040 con 0x7f4d500d3a30 2024-09-11T22:19:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d4e7fc640 1 -- 172.21.15.50:0/3386679835 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d44042070 con 0x7f4d500d3a30 2024-09-11T22:19:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d4e7fc640 1 -- 172.21.15.50:0/3386679835 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44030880 con 0x7f4d500d3a30 2024-09-11T22:19:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3386679835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d501e7ef0 con 0x7f4d500d3a30 2024-09-11T22:19:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.449+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3386679835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d501e84b0 con 0x7f4d500d3a30 2024-09-11T22:19:41.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.450+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3386679835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d50075770 con 0x7f4d500d3a30 2024-09-11T22:19:41.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.451+0000 7f4d4e7fc640 1 -- 172.21.15.50:0/3386679835 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d44030a20 con 0x7f4d500d3a30 2024-09-11T22:19:41.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.451+0000 7f4d4e7fc640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d3c06be30 0x7f4d3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.451+0000 7f4d4e7fc640 1 -- 172.21.15.50:0/3386679835 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f4d440ab720 con 0x7f4d500d3a30 2024-09-11T22:19:41.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.451+0000 7f4d55b09640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d3c06be30 0x7f4d3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.452+0000 7f4d55b09640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d3c06be30 0x7f4d3c06e2f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4d5015bf30 tx=0x7f4d4000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:41.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.455+0000 7f4d4e7fc640 1 -- 172.21.15.50:0/3386679835 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d4407a0d0 con 0x7f4d500d3a30 2024-09-11T22:19:41.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.632+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3386679835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d500b7940 con 0x7f4d500d3a30 2024-09-11T22:19:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.633+0000 7f4d4e7fc640 1 -- 172.21.15.50:0/3386679835 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+16703 (secure 0 0 0) 0x7f4d440799d0 con 0x7f4d500d3a30 2024-09-11T22:19:41.634 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:41.634 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":132,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:19:05.582808+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:19:02.578071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-11T22:19:02.977390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:19:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.635+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d3c06be30 msgr2=0x7f4d3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.635+0000 7f4d57d6d640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d3c06be30 0x7f4d3c06e2f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4d5015bf30 tx=0x7f4d4000b040 comp rx=0 tx=0).stop 2024-09-11T22:19:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.635+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3386679835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d500d3a30 msgr2=0x7f4d500cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.635+0000 7f4d57d6d640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d500d3a30 0x7f4d500cd150 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f4d44000c00 tx=0x7f4d440046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.635+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3386679835 shutdown_connections 2024-09-11T22:19:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.635+0000 7f4d57d6d640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d3c06be30 0x7f4d3c06e2f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.635+0000 7f4d57d6d640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5015e870 0x7f4d500cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.635+0000 7f4d57d6d640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d500d3a30 0x7f4d500cd150 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.635+0000 7f4d57d6d640 1 --2- 172.21.15.50:0/3386679835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d500d16d0 0x7f4d50154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.635+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3386679835 >> 172.21.15.50:0/3386679835 conn(0x7f4d500727a0 msgr2=0x7f4d500cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.635+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3386679835 shutdown_connections 2024-09-11T22:19:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.635+0000 7f4d57d6d640 1 -- 172.21.15.50:0/3386679835 wait complete. 2024-09-11T22:19:41.647 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:19:41.647 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.749+0000 7f64dc0ac640 1 Processor -- start 2024-09-11T22:19:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.749+0000 7f64dc0ac640 1 -- start start 2024-09-11T22:19:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.750+0000 7f64dc0ac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64d415b400 0x7f64d406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.750+0000 7f64dc0ac640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64d4072e60 0x7f64d406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.750+0000 7f64dc0ac640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64d415b7e0 con 0x7f64d406df20 2024-09-11T22:19:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.750+0000 7f64dc0ac640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f64d415f140 con 0x7f64d415b400 2024-09-11T22:19:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.750+0000 7f64dc0ac640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f64d415f420 con 0x7f64d4072e60 2024-09-11T22:19:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.750+0000 7f64d9e48640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64d415b400 0x7f64d406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.750+0000 7f64d9e48640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64d415b400 0x7f64d406d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37754/0 (socket says 172.21.15.50:37754) 2024-09-11T22:19:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.750+0000 7f64d9e48640 1 -- 172.21.15.50:0/2984387962 learned_addr learned my addr 172.21.15.50:0/2984387962 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.750+0000 7f64d9647640 1 --2- 172.21.15.50:0/2984387962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64d4072e60 0x7f64d406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.750+0000 7f64d9e48640 1 -- 172.21.15.50:0/2984387962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64d4072e60 msgr2=0x7f64d406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.750+0000 7f64d9e48640 1 --2- 172.21.15.50:0/2984387962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64d4072e60 0x7f64d406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.751+0000 7f64d9e48640 1 -- 172.21.15.50:0/2984387962 >> v1:172.21.15.77:6789/0 conn(0x7f64d406df20 legacy=0x7f64d40b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.751+0000 7f64d9e48640 1 -- 172.21.15.50:0/2984387962 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d415f700 con 0x7f64d415b400 2024-09-11T22:19:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.751+0000 7f64d9e48640 1 --2- 172.21.15.50:0/2984387962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64d415b400 0x7f64d406d070 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009870 tx=0x7f64cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3f02a7d4931923 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.751+0000 7f64d8e46640 1 -- 172.21.15.50:0/2984387962 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64cc037070 con 0x7f64d415b400 2024-09-11T22:19:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.751+0000 7f64d8e46640 1 -- 172.21.15.50:0/2984387962 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64cc032440 con 0x7f64d415b400 2024-09-11T22:19:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.751+0000 7f64d8e46640 1 -- 172.21.15.50:0/2984387962 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64cc032810 con 0x7f64d415b400 2024-09-11T22:19:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.752+0000 7f64dc0ac640 1 -- 172.21.15.50:0/2984387962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64d415b400 msgr2=0x7f64d406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.752+0000 7f64dc0ac640 1 --2- 172.21.15.50:0/2984387962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64d415b400 0x7f64d406d070 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009870 tx=0x7f64cc02a270 comp rx=0 tx=0).stop 2024-09-11T22:19:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.752+0000 7f64dc0ac640 1 -- 172.21.15.50:0/2984387962 shutdown_connections 2024-09-11T22:19:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.752+0000 7f64dc0ac640 1 --2- 172.21.15.50:0/2984387962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64d4072e60 0x7f64d406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.752+0000 7f64dc0ac640 1 --2- 172.21.15.50:0/2984387962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64d415b400 0x7f64d406d070 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.752+0000 7f64dc0ac640 1 -- 172.21.15.50:0/2984387962 >> 172.21.15.50:0/2984387962 conn(0x7f64d40679c0 msgr2=0x7f64d4067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.752+0000 7f64dc0ac640 1 -- 172.21.15.50:0/2984387962 shutdown_connections 2024-09-11T22:19:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.752+0000 7f64dc0ac640 1 -- 172.21.15.50:0/2984387962 wait complete. 2024-09-11T22:19:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.753+0000 7f64dc0ac640 1 Processor -- start 2024-09-11T22:19:41.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.753+0000 7f64dc0ac640 1 -- start start 2024-09-11T22:19:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64dc0ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64d406df20 0x7f64d40cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64dc0ac640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64d4072e60 0x7f64d40c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64dc0ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64d415b400 0x7f64d41f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64dc0ac640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f64d40721d0 con 0x7f64d406df20 2024-09-11T22:19:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64dc0ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f64d40cfc50 con 0x7f64d415b400 2024-09-11T22:19:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64dc0ac640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f64d4072350 con 0x7f64d4072e60 2024-09-11T22:19:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64d9e48640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64d406df20 0x7f64d40cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64d9e48640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64d406df20 0x7f64d40cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37764/0 (socket says 172.21.15.50:37764) 2024-09-11T22:19:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64d9e48640 1 -- 172.21.15.50:0/3972971681 learned_addr learned my addr 172.21.15.50:0/3972971681 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:41.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64d9647640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64d4072e60 0x7f64d40c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64da649640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64d415b400 0x7f64d41f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64d9e48640 1 -- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64d4072e60 msgr2=0x7f64d40c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64d9e48640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64d4072e60 0x7f64d40c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64d9e48640 1 -- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64d415b400 msgr2=0x7f64d41f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64d9e48640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64d415b400 0x7f64d41f5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64d9e48640 1 -- 172.21.15.50:0/3972971681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d40ab0d0 con 0x7f64d406df20 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.754+0000 7f64da649640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64d415b400 0x7f64d41f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.755+0000 7f64d9e48640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64d406df20 0x7f64d40cbff0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009870 tx=0x7f64cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.755+0000 7f64d27fc640 1 -- 172.21.15.50:0/3972971681 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64cc041070 con 0x7f64d406df20 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.755+0000 7f64d27fc640 1 -- 172.21.15.50:0/3972971681 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64cc03c890 con 0x7f64d406df20 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.755+0000 7f64dc0ac640 1 -- 172.21.15.50:0/3972971681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64d40ab3b0 con 0x7f64d406df20 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.755+0000 7f64d27fc640 1 -- 172.21.15.50:0/3972971681 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64cc037040 con 0x7f64d406df20 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.755+0000 7f64dc0ac640 1 -- 172.21.15.50:0/3972971681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64d40ab970 con 0x7f64d406df20 2024-09-11T22:19:41.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.756+0000 7f64dc0ac640 1 -- 172.21.15.50:0/3972971681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64d406d9e0 con 0x7f64d406df20 2024-09-11T22:19:41.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.756+0000 7f64d27fc640 1 -- 172.21.15.50:0/3972971681 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f64cc044070 con 0x7f64d406df20 2024-09-11T22:19:41.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.757+0000 7f64d27fc640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f64c006be30 0x7f64c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:41.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.757+0000 7f64d27fc640 1 -- 172.21.15.50:0/3972971681 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f64cc0ab850 con 0x7f64d406df20 2024-09-11T22:19:41.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.757+0000 7f64d9647640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f64c006be30 0x7f64c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:41.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.758+0000 7f64d9647640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f64c006be30 0x7f64c006e2f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f64d40d0c10 tx=0x7f64c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:41.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.761+0000 7f64d27fc640 1 -- 172.21.15.50:0/3972971681 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f64cc07a1f0 con 0x7f64d406df20 2024-09-11T22:19:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.976+0000 7f64dc0ac640 1 -- 172.21.15.50:0/3972971681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64d415eb50 con 0x7f64d406df20 2024-09-11T22:19:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.976+0000 7f64d27fc640 1 -- 172.21.15.50:0/3972971681 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7f64cc079af0 con 0x7f64d406df20 2024-09-11T22:19:41.978 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:41.978 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:41.978 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.978+0000 7f64dc0ac640 1 -- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f64c006be30 msgr2=0x7f64c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.978+0000 7f64dc0ac640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f64c006be30 0x7f64c006e2f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f64d40d0c10 tx=0x7f64c8008040 comp rx=0 tx=0).stop 2024-09-11T22:19:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.978+0000 7f64dc0ac640 1 -- 172.21.15.50:0/3972971681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64d406df20 msgr2=0x7f64d40cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.978+0000 7f64dc0ac640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64d406df20 0x7f64d40cbff0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009870 tx=0x7f64cc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.978+0000 7f64dc0ac640 1 -- 172.21.15.50:0/3972971681 shutdown_connections 2024-09-11T22:19:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.978+0000 7f64dc0ac640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f64c006be30 0x7f64c006e2f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.978+0000 7f64dc0ac640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64d4072e60 0x7f64d40c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.978+0000 7f64dc0ac640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64d415b400 0x7f64d41f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.978+0000 7f64dc0ac640 1 --2- 172.21.15.50:0/3972971681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64d406df20 0x7f64d40cbff0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.978+0000 7f64dc0ac640 1 -- 172.21.15.50:0/3972971681 >> 172.21.15.50:0/3972971681 conn(0x7f64d40679c0 msgr2=0x7f64d40b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.979+0000 7f64dc0ac640 1 -- 172.21.15.50:0/3972971681 shutdown_connections 2024-09-11T22:19:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:41.979+0000 7f64dc0ac640 1 -- 172.21.15.50:0/3972971681 wait complete. 2024-09-11T22:19:41.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.118+0000 7f80b849b640 1 Processor -- start 2024-09-11T22:19:42.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.118+0000 7f80b849b640 1 -- start start 2024-09-11T22:19:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.119+0000 7f80b849b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f80b015c240 0x7f80b00b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.119+0000 7f80b849b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f80b00735a0 0x7f80b015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.119+0000 7f80b849b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80b015c620 con 0x7f80b015f0e0 2024-09-11T22:19:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.119+0000 7f80b849b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f80b015f560 con 0x7f80b015c240 2024-09-11T22:19:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.119+0000 7f80b849b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f80b015f840 con 0x7f80b00735a0 2024-09-11T22:19:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.119+0000 7f80b6237640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f80b015c240 0x7f80b00b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.119+0000 7f80b6a38640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f80b015f0e0 0x7f80b00728e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57172/0 (socket says 172.21.15.50:57172) 2024-09-11T22:19:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.119+0000 7f80b6237640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f80b015c240 0x7f80b00b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37766/0 (socket says 172.21.15.50:37766) 2024-09-11T22:19:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.119+0000 7f80b6a38640 1 -- 172.21.15.50:0/2849189929 learned_addr learned my addr 172.21.15.50:0/2849189929 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.119+0000 7f80b5a36640 1 --2- 172.21.15.50:0/2849189929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f80b00735a0 0x7f80b015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.120+0000 7f80b6237640 1 -- 172.21.15.50:0/2849189929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f80b00735a0 msgr2=0x7f80b015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.120+0000 7f80b6237640 1 --2- 172.21.15.50:0/2849189929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f80b00735a0 0x7f80b015eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.120+0000 7f80b6237640 1 -- 172.21.15.50:0/2849189929 >> v1:172.21.15.50:6789/0 conn(0x7f80b015f0e0 legacy=0x7f80b00728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.120+0000 7f80b5235640 1 -- 172.21.15.50:0/2849189929 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1123349409 0 0) 0x7f80b015c620 con 0x7f80b015f0e0 2024-09-11T22:19:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.120+0000 7f80b6237640 1 -- 172.21.15.50:0/2849189929 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b015fb20 con 0x7f80b015c240 2024-09-11T22:19:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.120+0000 7f80b6237640 1 --2- 172.21.15.50:0/2849189929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80b015c240 0x7f80b00b4770 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0097a0 tx=0x7f80ac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2f9384dc3f1bae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.121+0000 7f80b5235640 1 -- 172.21.15.50:0/2849189929 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac037070 con 0x7f80b015c240 2024-09-11T22:19:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.121+0000 7f80b5235640 1 -- 172.21.15.50:0/2849189929 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80ac032440 con 0x7f80b015c240 2024-09-11T22:19:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.121+0000 7f80b5235640 1 -- 172.21.15.50:0/2849189929 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac032810 con 0x7f80b015c240 2024-09-11T22:19:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.121+0000 7f80b849b640 1 -- 172.21.15.50:0/2849189929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80b015c240 msgr2=0x7f80b00b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.121+0000 7f80b849b640 1 --2- 172.21.15.50:0/2849189929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80b015c240 0x7f80b00b4770 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0097a0 tx=0x7f80ac02a180 comp rx=0 tx=0).stop 2024-09-11T22:19:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.121+0000 7f80b849b640 1 -- 172.21.15.50:0/2849189929 shutdown_connections 2024-09-11T22:19:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.121+0000 7f80b849b640 1 --2- 172.21.15.50:0/2849189929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f80b00735a0 0x7f80b015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.121+0000 7f80b849b640 1 --2- 172.21.15.50:0/2849189929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80b015c240 0x7f80b00b4770 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.121+0000 7f80b849b640 1 -- 172.21.15.50:0/2849189929 >> 172.21.15.50:0/2849189929 conn(0x7f80b00b2bd0 msgr2=0x7f80b00b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.121+0000 7f80b849b640 1 -- 172.21.15.50:0/2849189929 shutdown_connections 2024-09-11T22:19:42.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.121+0000 7f80b849b640 1 -- 172.21.15.50:0/2849189929 wait complete. 2024-09-11T22:19:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.122+0000 7f80b849b640 1 Processor -- start 2024-09-11T22:19:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.122+0000 7f80b849b640 1 -- start start 2024-09-11T22:19:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.123+0000 7f80b849b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80b00735a0 0x7f80b01f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.123+0000 7f80b849b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80b015c240 0x7f80b00cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.123+0000 7f80b849b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f80b015f0e0 0x7f80b0159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.123+0000 7f80b849b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f80b00b4cb0 con 0x7f80b00735a0 2024-09-11T22:19:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.123+0000 7f80b849b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f80b00b4250 con 0x7f80b015c240 2024-09-11T22:19:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.123+0000 7f80b849b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f80b00b4e30 con 0x7f80b015f0e0 2024-09-11T22:19:42.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.123+0000 7f80b6237640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80b00735a0 0x7f80b01f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.123+0000 7f80b6237640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80b00735a0 0x7f80b01f4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37774/0 (socket says 172.21.15.50:37774) 2024-09-11T22:19:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.123+0000 7f80b6237640 1 -- 172.21.15.50:0/1590932399 learned_addr learned my addr 172.21.15.50:0/1590932399 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.123+0000 7f80b6a38640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f80b015f0e0 0x7f80b0159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.123+0000 7f80b5a36640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80b015c240 0x7f80b00cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.124+0000 7f80b6237640 1 -- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f80b015f0e0 msgr2=0x7f80b0159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.124+0000 7f80b6237640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f80b015f0e0 0x7f80b0159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.124+0000 7f80b6237640 1 -- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80b015c240 msgr2=0x7f80b00cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.124+0000 7f80b6237640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80b015c240 0x7f80b00cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.124+0000 7f80b6237640 1 -- 172.21.15.50:0/1590932399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b01f8720 con 0x7f80b00735a0 2024-09-11T22:19:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.124+0000 7f80b6237640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80b00735a0 0x7f80b01f4ce0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f80ac000c00 tx=0x7f80ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.124+0000 7f80a6ffd640 1 -- 172.21.15.50:0/1590932399 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac037050 con 0x7f80b00735a0 2024-09-11T22:19:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.124+0000 7f80a6ffd640 1 -- 172.21.15.50:0/1590932399 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80ac038040 con 0x7f80b00735a0 2024-09-11T22:19:42.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.124+0000 7f80b849b640 1 -- 172.21.15.50:0/1590932399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b01f7ba0 con 0x7f80b00735a0 2024-09-11T22:19:42.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.124+0000 7f80a6ffd640 1 -- 172.21.15.50:0/1590932399 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac004490 con 0x7f80b00735a0 2024-09-11T22:19:42.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.124+0000 7f80b849b640 1 -- 172.21.15.50:0/1590932399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b01f8160 con 0x7f80b00735a0 2024-09-11T22:19:42.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.125+0000 7f80b849b640 1 -- 172.21.15.50:0/1590932399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b015eba0 con 0x7f80b00735a0 2024-09-11T22:19:42.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.126+0000 7f80a6ffd640 1 -- 172.21.15.50:0/1590932399 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80ac030900 con 0x7f80b00735a0 2024-09-11T22:19:42.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.126+0000 7f80a6ffd640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f809406be30 0x7f809406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.126+0000 7f80a6ffd640 1 -- 172.21.15.50:0/1590932399 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f80ac0ab980 con 0x7f80b00735a0 2024-09-11T22:19:42.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.126+0000 7f80b5a36640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f809406be30 0x7f809406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.127+0000 7f80b5a36640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f809406be30 0x7f809406e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f80b0162100 tx=0x7f80a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:42.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.131+0000 7f80a6ffd640 1 -- 172.21.15.50:0/1590932399 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80ac07a450 con 0x7f80b00735a0 2024-09-11T22:19:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.340+0000 7f80b849b640 1 -- 172.21.15.50:0/1590932399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80b00af520 con 0x7f80b00735a0 2024-09-11T22:19:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.340+0000 7f80a6ffd640 1 -- 172.21.15.50:0/1590932399 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5225 (secure 0 0 0) 0x7f80ac079d50 con 0x7f80b00735a0 2024-09-11T22:19:42.341 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:42.342 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"btime":"2024-09-11T22:19:07:649679+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:04.005571+0000","modified":"2024-09-11T22:19:07.002081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3438568728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3438568728},{"type":"v1","addr":"172.21.15.50:6835","nonce":3438568728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8412,"qdb_cluster":[8412]},"id":9}]} 2024-09-11T22:19:42.342 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 94 2024-09-11T22:19:42.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.342+0000 7f80b849b640 1 -- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f809406be30 msgr2=0x7f809406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.342+0000 7f80b849b640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f809406be30 0x7f809406e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f80b0162100 tx=0x7f80a0008040 comp rx=0 tx=0).stop 2024-09-11T22:19:42.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.342+0000 7f80b849b640 1 -- 172.21.15.50:0/1590932399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80b00735a0 msgr2=0x7f80b01f4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.342+0000 7f80b849b640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80b00735a0 0x7f80b01f4ce0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f80ac000c00 tx=0x7f80ac0046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.342+0000 7f80b849b640 1 -- 172.21.15.50:0/1590932399 shutdown_connections 2024-09-11T22:19:42.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.342+0000 7f80b849b640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f809406be30 0x7f809406e2f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.342+0000 7f80b849b640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f80b015f0e0 0x7f80b0159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.342+0000 7f80b849b640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80b015c240 0x7f80b00cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.342+0000 7f80b849b640 1 --2- 172.21.15.50:0/1590932399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f80b00735a0 0x7f80b01f4ce0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.342+0000 7f80b849b640 1 -- 172.21.15.50:0/1590932399 >> 172.21.15.50:0/1590932399 conn(0x7f80b00b2bd0 msgr2=0x7f80b00728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:42.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.342+0000 7f80b849b640 1 -- 172.21.15.50:0/1590932399 shutdown_connections 2024-09-11T22:19:42.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.342+0000 7f80b849b640 1 -- 172.21.15.50:0/1590932399 wait complete. 2024-09-11T22:19:42.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:19:42.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.455+0000 7f62e24d2640 1 Processor -- start 2024-09-11T22:19:42.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.455+0000 7f62e24d2640 1 -- start start 2024-09-11T22:19:42.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.456+0000 7f62e24d2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f62dc15e8e0 0x7f62dc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.456+0000 7f62e24d2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f62dc162350 0x7f62dc1627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.456+0000 7f62e24d2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62dc163080 con 0x7f62dc0d1580 2024-09-11T22:19:42.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.456+0000 7f62e24d2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f62dc15ecc0 con 0x7f62dc162350 2024-09-11T22:19:42.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.456+0000 7f62e24d2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f62dc0d2ad0 con 0x7f62dc15e8e0 2024-09-11T22:19:42.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.456+0000 7f62e0a6f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f62dc162350 0x7f62dc1627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.456+0000 7f62e0a6f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f62dc162350 0x7f62dc1627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37776/0 (socket says 172.21.15.50:37776) 2024-09-11T22:19:42.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.456+0000 7f62e0a6f640 1 -- 172.21.15.50:0/867244578 learned_addr learned my addr 172.21.15.50:0/867244578 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:42.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.456+0000 7f62dbfff640 1 --2- 172.21.15.50:0/867244578 >> v2:172.21.15.77:3300/0 conn(0x7f62dc15e8e0 0x7f62dc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.457+0000 7f62e0a6f640 1 -- 172.21.15.50:0/867244578 >> v2:172.21.15.77:3300/0 conn(0x7f62dc15e8e0 msgr2=0x7f62dc0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:42.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.457+0000 7f62e0a6f640 1 --2- 172.21.15.50:0/867244578 >> v2:172.21.15.77:3300/0 conn(0x7f62dc15e8e0 0x7f62dc0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.457+0000 7f62e0a6f640 1 -- 172.21.15.50:0/867244578 >> v1:172.21.15.77:6789/0 conn(0x7f62dc0d1580 legacy=0x7f62dc0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.457+0000 7f62e0a6f640 1 -- 172.21.15.50:0/867244578 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62dc0d2d20 con 0x7f62dc162350 2024-09-11T22:19:42.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.457+0000 7f62e0a6f640 1 --2- 172.21.15.50:0/867244578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62dc162350 0x7f62dc1627a0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f62dc08d630 tx=0x7f62d402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec74fcbcb72948ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:42.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.458+0000 7f62daffd640 1 -- 172.21.15.50:0/867244578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4036070 con 0x7f62dc162350 2024-09-11T22:19:42.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.458+0000 7f62daffd640 1 -- 172.21.15.50:0/867244578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d4031600 con 0x7f62dc162350 2024-09-11T22:19:42.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.458+0000 7f62daffd640 1 -- 172.21.15.50:0/867244578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d40319f0 con 0x7f62dc162350 2024-09-11T22:19:42.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.458+0000 7f62e24d2640 1 -- 172.21.15.50:0/867244578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62dc162350 msgr2=0x7f62dc1627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.458+0000 7f62e24d2640 1 --2- 172.21.15.50:0/867244578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62dc162350 0x7f62dc1627a0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f62dc08d630 tx=0x7f62d402a7c0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.458+0000 7f62e24d2640 1 -- 172.21.15.50:0/867244578 shutdown_connections 2024-09-11T22:19:42.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.458+0000 7f62e24d2640 1 --2- 172.21.15.50:0/867244578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62dc162350 0x7f62dc1627a0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.458+0000 7f62e24d2640 1 --2- 172.21.15.50:0/867244578 >> v2:172.21.15.77:3300/0 conn(0x7f62dc15e8e0 0x7f62dc0b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.458+0000 7f62e24d2640 1 -- 172.21.15.50:0/867244578 >> 172.21.15.50:0/867244578 conn(0x7f62dc067ba0 msgr2=0x7f62dc067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:42.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.458+0000 7f62e24d2640 1 -- 172.21.15.50:0/867244578 shutdown_connections 2024-09-11T22:19:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.458+0000 7f62e24d2640 1 -- 172.21.15.50:0/867244578 wait complete. 2024-09-11T22:19:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.459+0000 7f62e24d2640 1 Processor -- start 2024-09-11T22:19:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.460+0000 7f62e24d2640 1 -- start start 2024-09-11T22:19:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.460+0000 7f62e24d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62dc0d1580 0x7f62dc1e9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.460+0000 7f62e24d2640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62dc15e8e0 0x7f62dc0b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.460+0000 7f62e24d2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62dc162350 0x7f62dc0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.460+0000 7f62e24d2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc162ce0 con 0x7f62dc0d1580 2024-09-11T22:19:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.460+0000 7f62e24d2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc0d3370 con 0x7f62dc162350 2024-09-11T22:19:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.460+0000 7f62e24d2640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f62dc162e60 con 0x7f62dc15e8e0 2024-09-11T22:19:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.460+0000 7f62dbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62dc0d1580 0x7f62dc1e9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.460+0000 7f62dbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62dc0d1580 0x7f62dc1e9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37788/0 (socket says 172.21.15.50:37788) 2024-09-11T22:19:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.460+0000 7f62dbfff640 1 -- 172.21.15.50:0/436177806 learned_addr learned my addr 172.21.15.50:0/436177806 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.460+0000 7f62e0a6f640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62dc162350 0x7f62dc0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.460+0000 7f62db7fe640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62dc15e8e0 0x7f62dc0b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.461+0000 7f62dbfff640 1 -- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62dc15e8e0 msgr2=0x7f62dc0b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.461+0000 7f62dbfff640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62dc15e8e0 0x7f62dc0b64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.461+0000 7f62dbfff640 1 -- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62dc162350 msgr2=0x7f62dc0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.461+0000 7f62dbfff640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62dc162350 0x7f62dc0cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.461+0000 7f62dbfff640 1 -- 172.21.15.50:0/436177806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62dc0cbdc0 con 0x7f62dc0d1580 2024-09-11T22:19:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.461+0000 7f62dbfff640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62dc0d1580 0x7f62dc1e9b50 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00e960 tx=0x7f62cc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.461+0000 7f62d8ff9640 1 -- 172.21.15.50:0/436177806 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc017070 con 0x7f62dc0d1580 2024-09-11T22:19:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.461+0000 7f62d8ff9640 1 -- 172.21.15.50:0/436177806 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62cc00ca00 con 0x7f62dc0d1580 2024-09-11T22:19:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.461+0000 7f62e24d2640 1 -- 172.21.15.50:0/436177806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62dc0cc0a0 con 0x7f62dc0d1580 2024-09-11T22:19:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.461+0000 7f62d8ff9640 1 -- 172.21.15.50:0/436177806 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc00cdf0 con 0x7f62dc0d1580 2024-09-11T22:19:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.461+0000 7f62e24d2640 1 -- 172.21.15.50:0/436177806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62dc0cc660 con 0x7f62dc0d1580 2024-09-11T22:19:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.462+0000 7f62e24d2640 1 -- 172.21.15.50:0/436177806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62dc0b7880 con 0x7f62dc0d1580 2024-09-11T22:19:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.463+0000 7f62d8ff9640 1 -- 172.21.15.50:0/436177806 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f62cc01a070 con 0x7f62dc0d1580 2024-09-11T22:19:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.463+0000 7f62d8ff9640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f62c806be30 0x7f62c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.463+0000 7f62d8ff9640 1 -- 172.21.15.50:0/436177806 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f62cc08b140 con 0x7f62dc0d1580 2024-09-11T22:19:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.463+0000 7f62db7fe640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f62c806be30 0x7f62c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.464+0000 7f62db7fe640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f62c806be30 0x7f62c806e2f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f62dc15f0e0 tx=0x7f62d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:42.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.467+0000 7f62d8ff9640 1 -- 172.21.15.50:0/436177806 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62cc059530 con 0x7f62dc0d1580 2024-09-11T22:19:42.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.643+0000 7f62e24d2640 1 -- 172.21.15.50:0/436177806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62dc0ba770 con 0x7f62dc0d1580 2024-09-11T22:19:42.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.644+0000 7f62d8ff9640 1 -- 172.21.15.50:0/436177806 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+16703 (secure 0 0 0) 0x7f62cc05d830 con 0x7f62dc0d1580 2024-09-11T22:19:42.645 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:42.645 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":132,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:19:05.582808+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:19:02.578071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-11T22:19:02.977390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:19:42.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.646+0000 7f62e24d2640 1 -- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f62c806be30 msgr2=0x7f62c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.646+0000 7f62e24d2640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f62c806be30 0x7f62c806e2f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f62dc15f0e0 tx=0x7f62d0009040 comp rx=0 tx=0).stop 2024-09-11T22:19:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.646+0000 7f62e24d2640 1 -- 172.21.15.50:0/436177806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62dc0d1580 msgr2=0x7f62dc1e9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.646+0000 7f62e24d2640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62dc0d1580 0x7f62dc1e9b50 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00e960 tx=0x7f62cc00ee20 comp rx=0 tx=0).stop 2024-09-11T22:19:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.647+0000 7f62e24d2640 1 -- 172.21.15.50:0/436177806 shutdown_connections 2024-09-11T22:19:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.647+0000 7f62e24d2640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f62c806be30 0x7f62c806e2f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.647+0000 7f62e24d2640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62dc15e8e0 0x7f62dc0b64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.647+0000 7f62e24d2640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62dc162350 0x7f62dc0cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.647+0000 7f62e24d2640 1 --2- 172.21.15.50:0/436177806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62dc0d1580 0x7f62dc1e9b50 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.647+0000 7f62e24d2640 1 -- 172.21.15.50:0/436177806 >> 172.21.15.50:0/436177806 conn(0x7f62dc067ba0 msgr2=0x7f62dc15fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.647+0000 7f62e24d2640 1 -- 172.21.15.50:0/436177806 shutdown_connections 2024-09-11T22:19:42.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.647+0000 7f62e24d2640 1 -- 172.21.15.50:0/436177806 wait complete. 2024-09-11T22:19:42.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:19:42.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.761+0000 7fd2b2f26640 1 Processor -- start 2024-09-11T22:19:42.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.761+0000 7fd2b2f26640 1 -- start start 2024-09-11T22:19:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2b2f26640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2ac0b3e10 0x7fd2ac0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2b2f26640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ac0b4f00 con 0x7fd2ac0d05e0 2024-09-11T22:19:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2b2f26640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ac0b4360 con 0x7fd2ac15c2c0 2024-09-11T22:19:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2b2f26640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac0b51c0 con 0x7fd2ac0b3e10 2024-09-11T22:19:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2abfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd2ac0d05e0 0x7fd2ac0ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57178/0 (socket says 172.21.15.50:57178) 2024-09-11T22:19:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2abfff640 1 -- 172.21.15.50:0/1369833472 learned_addr learned my addr 172.21.15.50:0/1369833472 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 114980551 0 0) 0x7fd2ac0b4f00 con 0x7fd2ac0d05e0 2024-09-11T22:19:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd29c003520 con 0x7fd2ac0d05e0 2024-09-11T22:19:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2b14c3640 1 --2- 172.21.15.50:0/1369833472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2ac0b3e10 0x7fd2ac0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2872043299 0 0) 0x7fd29c003520 con 0x7fd2ac0d05e0 2024-09-11T22:19:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2ac0b3e10 msgr2=0x7fd2ac0b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 --2- 172.21.15.50:0/1369833472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2ac0b3e10 0x7fd2ac0b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 >> v1:172.21.15.77:6789/0 conn(0x7fd2ac15c2c0 legacy=0x7fd2ac0cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac0b54a0 con 0x7fd2ac0d05e0 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fd298001670 con 0x7fd2ac0d05e0 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 >> v1:172.21.15.50:6789/0 conn(0x7fd2ac0d05e0 legacy=0x7fd2ac0ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 --2- 172.21.15.50:0/1369833472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2ac0b3e10 0x7fd29c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 --2- 172.21.15.50:0/1369833472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c004010 0x7fd29c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 --2- 172.21.15.50:0/1369833472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c004d40 0x7fd29c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac0b51c0 con 0x7fd29c004010 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c00bb80 con 0x7fd29c004d40 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.762+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd29c00bd80 con 0x7fd2ac0b3e10 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.763+0000 7fd2abfff640 1 --2- 172.21.15.50:0/1369833472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c004010 0x7fd29c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.763+0000 7fd2b0cc2640 1 --2- 172.21.15.50:0/1369833472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2ac0b3e10 0x7fd29c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.763+0000 7fd2b14c3640 1 --2- 172.21.15.50:0/1369833472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c004d40 0x7fd29c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.763+0000 7fd2abfff640 1 -- 172.21.15.50:0/1369833472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2ac0b3e10 msgr2=0x7fd29c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:42.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.763+0000 7fd2abfff640 1 --2- 172.21.15.50:0/1369833472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2ac0b3e10 0x7fd29c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.763+0000 7fd2abfff640 1 -- 172.21.15.50:0/1369833472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c004d40 msgr2=0x7fd29c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:42.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.763+0000 7fd2abfff640 1 --2- 172.21.15.50:0/1369833472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c004d40 0x7fd29c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.763+0000 7fd2abfff640 1 -- 172.21.15.50:0/1369833472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29c003520 con 0x7fd29c004010 2024-09-11T22:19:42.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.763+0000 7fd2abfff640 1 --2- 172.21.15.50:0/1369833472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c004010 0x7fd29c004800 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fd29800c240 tx=0x7fd29c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f269d6f8bb9d59c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.764+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd298007cf0 con 0x7fd29c004010 2024-09-11T22:19:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.764+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2980058d0 con 0x7fd29c004010 2024-09-11T22:19:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.764+0000 7fd2ab7fe640 1 -- 172.21.15.50:0/1369833472 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd298005d20 con 0x7fd29c004010 2024-09-11T22:19:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.764+0000 7fd2b2f26640 1 -- 172.21.15.50:0/1369833472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c004010 msgr2=0x7fd29c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.764+0000 7fd2b2f26640 1 --2- 172.21.15.50:0/1369833472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c004010 0x7fd29c004800 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fd29800c240 tx=0x7fd29c005830 comp rx=0 tx=0).stop 2024-09-11T22:19:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.764+0000 7fd2b14c3640 1 -- 172.21.15.50:0/1369833472 reap_dead start 2024-09-11T22:19:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.764+0000 7fd2b2f26640 1 -- 172.21.15.50:0/1369833472 shutdown_connections 2024-09-11T22:19:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.764+0000 7fd2b2f26640 1 -- 172.21.15.50:0/1369833472 >> 172.21.15.50:0/1369833472 conn(0x7fd2ac0679c0 msgr2=0x7fd2ac067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.764+0000 7fd2b2f26640 1 -- 172.21.15.50:0/1369833472 shutdown_connections 2024-09-11T22:19:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.764+0000 7fd2b2f26640 1 -- 172.21.15.50:0/1369833472 wait complete. 2024-09-11T22:19:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.765+0000 7fd2b2f26640 1 Processor -- start 2024-09-11T22:19:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.766+0000 7fd2b2f26640 1 -- start start 2024-09-11T22:19:42.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.766+0000 7fd2b2f26640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c004010 0x7fd2ac0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.766+0000 7fd2b2f26640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2ac0cbdc0 0x7fd2ac144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.766+0000 7fd2b2f26640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2ac071030 0x7fd2ac0714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.766+0000 7fd2b2f26640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac06d070 con 0x7fd29c004010 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.766+0000 7fd2b2f26640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac0ce200 con 0x7fd2ac071030 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.766+0000 7fd2b2f26640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac06d1f0 con 0x7fd2ac0cbdc0 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2b0cc2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c004010 0x7fd2ac0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2b0cc2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c004010 0x7fd2ac0c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37810/0 (socket says 172.21.15.50:37810) 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2b0cc2640 1 -- 172.21.15.50:0/3023759641 learned_addr learned my addr 172.21.15.50:0/3023759641 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2b14c3640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2ac071030 0x7fd2ac0714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2abfff640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2ac0cbdc0 0x7fd2ac144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2b0cc2640 1 -- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2ac0cbdc0 msgr2=0x7fd2ac144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2b0cc2640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2ac0cbdc0 0x7fd2ac144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2b0cc2640 1 -- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2ac071030 msgr2=0x7fd2ac0714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2b0cc2640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2ac071030 0x7fd2ac0714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2b0cc2640 1 -- 172.21.15.50:0/3023759641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac144f40 con 0x7fd29c004010 2024-09-11T22:19:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2b14c3640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2ac071030 0x7fd2ac0714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2b0cc2640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c004010 0x7fd2ac0c8d40 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000f820 tx=0x7fd2a000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2a97fa640 1 -- 172.21.15.50:0/3023759641 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a00050d0 con 0x7fd29c004010 2024-09-11T22:19:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2a97fa640 1 -- 172.21.15.50:0/3023759641 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a0018070 con 0x7fd29c004010 2024-09-11T22:19:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2a97fa640 1 -- 172.21.15.50:0/3023759641 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0005490 con 0x7fd29c004010 2024-09-11T22:19:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2b2f26640 1 -- 172.21.15.50:0/3023759641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ac0c93d0 con 0x7fd29c004010 2024-09-11T22:19:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.767+0000 7fd2b2f26640 1 -- 172.21.15.50:0/3023759641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ac145480 con 0x7fd29c004010 2024-09-11T22:19:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.768+0000 7fd2b2f26640 1 -- 172.21.15.50:0/3023759641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ac15c6a0 con 0x7fd29c004010 2024-09-11T22:19:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.769+0000 7fd2a97fa640 1 -- 172.21.15.50:0/3023759641 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2a000d6d0 con 0x7fd29c004010 2024-09-11T22:19:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.769+0000 7fd2a97fa640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd29006be30 0x7fd29006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.769+0000 7fd2a97fa640 1 -- 172.21.15.50:0/3023759641 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fd2a008ac80 con 0x7fd29c004010 2024-09-11T22:19:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.770+0000 7fd2abfff640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd29006be30 0x7fd29006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:42.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.770+0000 7fd2abfff640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd29006be30 0x7fd29006e2f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd298033000 tx=0x7fd298009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.774+0000 7fd2a97fa640 1 -- 172.21.15.50:0/3023759641 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2a0059630 con 0x7fd29c004010 2024-09-11T22:19:42.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.984+0000 7fd2b2f26640 1 -- 172.21.15.50:0/3023759641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd2ac06dfd0 con 0x7fd29c004010 2024-09-11T22:19:42.985 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:19:42.985+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:19:42.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.986+0000 7fd2a97fa640 1 -- 172.21.15.50:0/3023759641 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v95) ==== 161+0+0 (secure 0 0 0) 0x7fd2a0058f30 con 0x7fd29c004010 2024-09-11T22:19:42.987 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:19:42.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.989+0000 7fd2b2f26640 1 -- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd29006be30 msgr2=0x7fd29006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.989+0000 7fd2b2f26640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd29006be30 0x7fd29006e2f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd298033000 tx=0x7fd298009030 comp rx=0 tx=0).stop 2024-09-11T22:19:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.989+0000 7fd2b2f26640 1 -- 172.21.15.50:0/3023759641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c004010 msgr2=0x7fd2ac0c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.989+0000 7fd2b2f26640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c004010 0x7fd2ac0c8d40 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000f820 tx=0x7fd2a000fce0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.989+0000 7fd2b2f26640 1 -- 172.21.15.50:0/3023759641 shutdown_connections 2024-09-11T22:19:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.989+0000 7fd2b2f26640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd29006be30 0x7fd29006e2f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.989+0000 7fd2b2f26640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2ac0cbdc0 0x7fd2ac144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.989+0000 7fd2b2f26640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2ac071030 0x7fd2ac0714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.989+0000 7fd2b2f26640 1 --2- 172.21.15.50:0/3023759641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd29c004010 0x7fd2ac0c8d40 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.989+0000 7fd2b2f26640 1 -- 172.21.15.50:0/3023759641 >> 172.21.15.50:0/3023759641 conn(0x7fd2ac0679c0 msgr2=0x7fd2ac0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.989+0000 7fd2b2f26640 1 -- 172.21.15.50:0/3023759641 shutdown_connections 2024-09-11T22:19:42.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:42.989+0000 7fd2b2f26640 1 -- 172.21.15.50:0/3023759641 wait complete. 2024-09-11T22:19:43.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:19:43.030 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:19:43.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.106+0000 7f047af86640 1 Processor -- start 2024-09-11T22:19:43.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.106+0000 7f047af86640 1 -- start start 2024-09-11T22:19:43.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.107+0000 7f047af86640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0474073900 0x7f04740b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:43.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.107+0000 7f047af86640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04740b5300 0x7f04741623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:43.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.107+0000 7f047af86640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04740af550 con 0x7f04741628e0 2024-09-11T22:19:43.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.107+0000 7f047af86640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0474073ce0 con 0x7f0474073900 2024-09-11T22:19:43.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.107+0000 7f047af86640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f047406eb10 con 0x7f04740b5300 2024-09-11T22:19:43.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.107+0000 7f0479523640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f04741628e0 0x7f0474154ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57188/0 (socket says 172.21.15.50:57188) 2024-09-11T22:19:43.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.107+0000 7f0479523640 1 -- 172.21.15.50:0/800841575 learned_addr learned my addr 172.21.15.50:0/800841575 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:43.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f0478d22640 1 --2- 172.21.15.50:0/800841575 >> v2:172.21.15.77:3300/0 conn(0x7f0474073900 0x7f04740b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:43.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f0473fff640 1 --2- 172.21.15.50:0/800841575 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04740b5300 0x7f04741623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:43.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156092788 0 0) 0x7f04740af550 con 0x7f04741628e0 2024-09-11T22:19:43.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f045c003520 con 0x7f04741628e0 2024-09-11T22:19:43.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2850082884 0 0) 0x7f045c003520 con 0x7f04741628e0 2024-09-11T22:19:43.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04740b5300 msgr2=0x7f04741623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:43.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 --2- 172.21.15.50:0/800841575 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04740b5300 0x7f04741623a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:43.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 >> v2:172.21.15.77:3300/0 conn(0x7f0474073900 msgr2=0x7f04740b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:43.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 --2- 172.21.15.50:0/800841575 >> v2:172.21.15.77:3300/0 conn(0x7f0474073900 0x7f04740b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:43.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04740af7f0 con 0x7f04741628e0 2024-09-11T22:19:43.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f046c0019f0 con 0x7f04741628e0 2024-09-11T22:19:43.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 >> v1:172.21.15.50:6789/0 conn(0x7f04741628e0 legacy=0x7f0474154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:43.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 --2- 172.21.15.50:0/800841575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f045c0039b0 0x7f045c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:43.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 --2- 172.21.15.50:0/800841575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f045c004800 0x7f045c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:43.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 --2- 172.21.15.50:0/800841575 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04740b5300 0x7f045c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:43.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0474073ce0 con 0x7f045c004800 2024-09-11T22:19:43.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f047406eb10 con 0x7f045c0039b0 2024-09-11T22:19:43.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f045c00b9c0 con 0x7f04740b5300 2024-09-11T22:19:43.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f0473fff640 1 --2- 172.21.15.50:0/800841575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f045c004800 0x7f045c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:43.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f0478d22640 1 --2- 172.21.15.50:0/800841575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f045c0039b0 0x7f045c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:43.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f0479523640 1 --2- 172.21.15.50:0/800841575 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04740b5300 0x7f045c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:43.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f0473fff640 1 -- 172.21.15.50:0/800841575 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04740b5300 msgr2=0x7f045c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:43.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f0473fff640 1 --2- 172.21.15.50:0/800841575 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04740b5300 0x7f045c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:43.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f0473fff640 1 -- 172.21.15.50:0/800841575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f045c0039b0 msgr2=0x7f045c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:43.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f0473fff640 1 --2- 172.21.15.50:0/800841575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f045c0039b0 0x7f045c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:43.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.108+0000 7f0473fff640 1 -- 172.21.15.50:0/800841575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045c003520 con 0x7f045c004800 2024-09-11T22:19:43.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.109+0000 7f0473fff640 1 --2- 172.21.15.50:0/800841575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f045c004800 0x7f045c004c80 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f0468009af0 tx=0x7f045c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0b3f0346828526 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:43.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.109+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0468036070 con 0x7f045c004800 2024-09-11T22:19:43.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.109+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0468031400 con 0x7f045c004800 2024-09-11T22:19:43.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.109+0000 7f04737fe640 1 -- 172.21.15.50:0/800841575 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0468009690 con 0x7f045c004800 2024-09-11T22:19:43.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.110+0000 7f047af86640 1 -- 172.21.15.50:0/800841575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f045c004800 msgr2=0x7f045c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.110+0000 7f047af86640 1 --2- 172.21.15.50:0/800841575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f045c004800 0x7f045c004c80 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f0468009af0 tx=0x7f045c005830 comp rx=0 tx=0).stop 2024-09-11T22:19:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.110+0000 7f0479523640 1 -- 172.21.15.50:0/800841575 reap_dead start 2024-09-11T22:19:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.110+0000 7f047af86640 1 -- 172.21.15.50:0/800841575 shutdown_connections 2024-09-11T22:19:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.110+0000 7f047af86640 1 -- 172.21.15.50:0/800841575 >> 172.21.15.50:0/800841575 conn(0x7f047406bb50 msgr2=0x7f047406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.110+0000 7f047af86640 1 -- 172.21.15.50:0/800841575 shutdown_connections 2024-09-11T22:19:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.110+0000 7f047af86640 1 -- 172.21.15.50:0/800841575 wait complete. 2024-09-11T22:19:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.111+0000 7f047af86640 1 Processor -- start 2024-09-11T22:19:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.111+0000 7f047af86640 1 -- start start 2024-09-11T22:19:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f047af86640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f045c004800 0x7f0474147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f047af86640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04741593c0 0x7f04741f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f047af86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f047415b530 0x7f047415b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f047af86640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04740b0090 con 0x7f045c004800 2024-09-11T22:19:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f047af86640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f04740afdb0 con 0x7f047415b530 2024-09-11T22:19:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f047af86640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0474163100 con 0x7f04741593c0 2024-09-11T22:19:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f0478d22640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f045c004800 0x7f0474147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f0478d22640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f045c004800 0x7f0474147800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37832/0 (socket says 172.21.15.50:37832) 2024-09-11T22:19:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f0478d22640 1 -- 172.21.15.50:0/3707798792 learned_addr learned my addr 172.21.15.50:0/3707798792 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f0479523640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f047415b530 0x7f047415b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f0473fff640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04741593c0 0x7f04741f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f0478d22640 1 -- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04741593c0 msgr2=0x7f04741f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f0478d22640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04741593c0 0x7f04741f4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f0478d22640 1 -- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f047415b530 msgr2=0x7f047415b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f0478d22640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f047415b530 0x7f047415b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.112+0000 7f0478d22640 1 -- 172.21.15.50:0/3707798792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04741598a0 con 0x7f045c004800 2024-09-11T22:19:43.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.113+0000 7f0478d22640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f045c004800 0x7f0474147800 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f0464011aa0 tx=0x7f0464011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.113+0000 7f04717fa640 1 -- 172.21.15.50:0/3707798792 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046400fa60 con 0x7f045c004800 2024-09-11T22:19:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.113+0000 7f04717fa640 1 -- 172.21.15.50:0/3707798792 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f046400fc00 con 0x7f045c004800 2024-09-11T22:19:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.113+0000 7f047af86640 1 -- 172.21.15.50:0/3707798792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0474159b80 con 0x7f045c004800 2024-09-11T22:19:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.113+0000 7f04717fa640 1 -- 172.21.15.50:0/3707798792 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0464014440 con 0x7f045c004800 2024-09-11T22:19:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.113+0000 7f047af86640 1 -- 172.21.15.50:0/3707798792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047415a140 con 0x7f045c004800 2024-09-11T22:19:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.114+0000 7f047af86640 1 -- 172.21.15.50:0/3707798792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04740b05b0 con 0x7f045c004800 2024-09-11T22:19:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.114+0000 7f04717fa640 1 -- 172.21.15.50:0/3707798792 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0464012040 con 0x7f045c004800 2024-09-11T22:19:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.115+0000 7f04717fa640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f046006be60 0x7f046006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.115+0000 7f04717fa640 1 -- 172.21.15.50:0/3707798792 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5795+0+0 (secure 0 0 0) 0x7f046408b420 con 0x7f045c004800 2024-09-11T22:19:43.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.115+0000 7f0473fff640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f046006be60 0x7f046006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.116+0000 7f0473fff640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f046006be60 0x7f046006e320 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0468033000 tx=0x7f0468008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.119+0000 7f04717fa640 1 -- 172.21.15.50:0/3707798792 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0464019030 con 0x7f045c004800 2024-09-11T22:19:43.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.331+0000 7f047af86640 1 -- 172.21.15.50:0/3707798792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f04740b5890 con 0x7f045c004800 2024-09-11T22:19:43.694 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:19:43.696 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:19:43.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.988+0000 7f04717fa640 1 -- 172.21.15.50:0/3707798792 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v96) ==== 104+0+0 (secure 0 0 0) 0x7f0464059d70 con 0x7f045c004800 2024-09-11T22:19:43.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.990+0000 7f047af86640 1 -- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f046006be60 msgr2=0x7f046006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:43.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.990+0000 7f047af86640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f046006be60 0x7f046006e320 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0468033000 tx=0x7f0468008030 comp rx=0 tx=0).stop 2024-09-11T22:19:43.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.990+0000 7f047af86640 1 -- 172.21.15.50:0/3707798792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f045c004800 msgr2=0x7f0474147800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:43.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.990+0000 7f047af86640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f045c004800 0x7f0474147800 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f0464011aa0 tx=0x7f0464011ea0 comp rx=0 tx=0).stop 2024-09-11T22:19:43.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.990+0000 7f047af86640 1 -- 172.21.15.50:0/3707798792 shutdown_connections 2024-09-11T22:19:43.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.990+0000 7f047af86640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f046006be60 0x7f046006e320 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:43.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.990+0000 7f047af86640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04741593c0 0x7f04741f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.990+0000 7f047af86640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f047415b530 0x7f047415b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.990+0000 7f047af86640 1 --2- 172.21.15.50:0/3707798792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f045c004800 0x7f0474147800 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.990+0000 7f047af86640 1 -- 172.21.15.50:0/3707798792 >> 172.21.15.50:0/3707798792 conn(0x7f047406bb50 msgr2=0x7f047415ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.990+0000 7f047af86640 1 -- 172.21.15.50:0/3707798792 shutdown_connections 2024-09-11T22:19:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:43.990+0000 7f047af86640 1 -- 172.21.15.50:0/3707798792 wait complete. 2024-09-11T22:19:44.004 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:19:44.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.113+0000 7fd59b742640 1 Processor -- start 2024-09-11T22:19:44.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.114+0000 7fd59b742640 1 -- start start 2024-09-11T22:19:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd59b742640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd59415e8e0 0x7fd5940b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd59b742640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd594163080 con 0x7fd5940d1580 2024-09-11T22:19:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd59b742640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5940d2d20 con 0x7fd594162350 2024-09-11T22:19:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd59b742640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd59415ecc0 con 0x7fd59415e8e0 2024-09-11T22:19:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd598cdd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd5940d1580 0x7fd5940d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57200/0 (socket says 172.21.15.50:57200) 2024-09-11T22:19:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd598cdd640 1 -- 172.21.15.50:0/2359771986 learned_addr learned my addr 172.21.15.50:0/2359771986 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd5994de640 1 --2- 172.21.15.50:0/2359771986 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd59415e8e0 0x7fd5940b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3168365478 0 0) 0x7fd594163080 con 0x7fd5940d1580 2024-09-11T22:19:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd580003520 con 0x7fd5940d1580 2024-09-11T22:19:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3846734853 0 0) 0x7fd5940d2d20 con 0x7fd594162350 2024-09-11T22:19:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd594163080 con 0x7fd594162350 2024-09-11T22:19:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3098719795 0 0) 0x7fd580003520 con 0x7fd5940d1580 2024-09-11T22:19:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd59415e8e0 msgr2=0x7fd5940b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 --2- 172.21.15.50:0/2359771986 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd59415e8e0 0x7fd5940b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 >> v1:172.21.15.77:6789/0 conn(0x7fd594162350 legacy=0x7fd594162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5940d3000 con 0x7fd5940d1580 2024-09-11T22:19:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fd5840015f0 con 0x7fd5940d1580 2024-09-11T22:19:44.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 >> v1:172.21.15.50:6789/0 conn(0x7fd5940d1580 legacy=0x7fd5940d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:44.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 --2- 172.21.15.50:0/2359771986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580003b70 0x7fd580003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:44.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 --2- 172.21.15.50:0/2359771986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580004800 0x7fd580004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:44.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 --2- 172.21.15.50:0/2359771986 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd59415e8e0 0x7fd5800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:44.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd58000ba70 con 0x7fd580003b70 2024-09-11T22:19:44.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd58000bbf0 con 0x7fd580004800 2024-09-11T22:19:44.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd58000bdf0 con 0x7fd59415e8e0 2024-09-11T22:19:44.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.115+0000 7fd5994de640 1 --2- 172.21.15.50:0/2359771986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580003b70 0x7fd580003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:44.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.116+0000 7fd598cdd640 1 --2- 172.21.15.50:0/2359771986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580004800 0x7fd580004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.116+0000 7fd599cdf640 1 --2- 172.21.15.50:0/2359771986 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd59415e8e0 0x7fd5800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.116+0000 7fd5994de640 1 -- 172.21.15.50:0/2359771986 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd59415e8e0 msgr2=0x7fd5800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.116+0000 7fd5994de640 1 --2- 172.21.15.50:0/2359771986 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd59415e8e0 0x7fd5800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.116+0000 7fd5994de640 1 -- 172.21.15.50:0/2359771986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580004800 msgr2=0x7fd580004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.116+0000 7fd5994de640 1 --2- 172.21.15.50:0/2359771986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580004800 0x7fd580004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.116+0000 7fd5994de640 1 -- 172.21.15.50:0/2359771986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd580003520 con 0x7fd580003b70 2024-09-11T22:19:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.117+0000 7fd5994de640 1 --2- 172.21.15.50:0/2359771986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580003b70 0x7fd580003f70 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fd590009ac0 tx=0x7fd580005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e62efd8c957bd53 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.117+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd590036070 con 0x7fd580003b70 2024-09-11T22:19:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.117+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd590031400 con 0x7fd580003b70 2024-09-11T22:19:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.117+0000 7fd58bfff640 1 -- 172.21.15.50:0/2359771986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd590009690 con 0x7fd580003b70 2024-09-11T22:19:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.117+0000 7fd59b742640 1 -- 172.21.15.50:0/2359771986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580003b70 msgr2=0x7fd580003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.117+0000 7fd59b742640 1 --2- 172.21.15.50:0/2359771986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580003b70 0x7fd580003f70 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fd590009ac0 tx=0x7fd580005830 comp rx=0 tx=0).stop 2024-09-11T22:19:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.117+0000 7fd599cdf640 1 -- 172.21.15.50:0/2359771986 reap_dead start 2024-09-11T22:19:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.117+0000 7fd59b742640 1 -- 172.21.15.50:0/2359771986 shutdown_connections 2024-09-11T22:19:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.117+0000 7fd59b742640 1 -- 172.21.15.50:0/2359771986 >> 172.21.15.50:0/2359771986 conn(0x7fd594067ba0 msgr2=0x7fd594067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.117+0000 7fd59b742640 1 -- 172.21.15.50:0/2359771986 shutdown_connections 2024-09-11T22:19:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.117+0000 7fd59b742640 1 -- 172.21.15.50:0/2359771986 wait complete. 2024-09-11T22:19:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.118+0000 7fd59b742640 1 Processor -- start 2024-09-11T22:19:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.119+0000 7fd59b742640 1 -- start start 2024-09-11T22:19:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.119+0000 7fd59b742640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580003b70 0x7fd5941578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.119+0000 7fd59b742640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd59415ae10 0x7fd59415b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.119+0000 7fd59b742640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd594160b70 0x7fd594161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.119+0000 7fd59b742640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd5940b7c50 con 0x7fd594160b70 2024-09-11T22:19:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.119+0000 7fd59b742640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5940b7ad0 con 0x7fd580003b70 2024-09-11T22:19:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.119+0000 7fd59b742640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5940d2ad0 con 0x7fd59415ae10 2024-09-11T22:19:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.119+0000 7fd599cdf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd594160b70 0x7fd594161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.119+0000 7fd599cdf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd594160b70 0x7fd594161020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37846/0 (socket says 172.21.15.50:37846) 2024-09-11T22:19:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.119+0000 7fd599cdf640 1 -- 172.21.15.50:0/1071822368 learned_addr learned my addr 172.21.15.50:0/1071822368 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.119+0000 7fd5994de640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580003b70 0x7fd5941578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.119+0000 7fd598cdd640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd59415ae10 0x7fd59415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.120+0000 7fd599cdf640 1 -- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd59415ae10 msgr2=0x7fd59415b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.120+0000 7fd599cdf640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd59415ae10 0x7fd59415b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.120+0000 7fd599cdf640 1 -- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580003b70 msgr2=0x7fd5941578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.120+0000 7fd599cdf640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580003b70 0x7fd5941578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.120+0000 7fd599cdf640 1 -- 172.21.15.50:0/1071822368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5940cb8c0 con 0x7fd594160b70 2024-09-11T22:19:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.120+0000 7fd599cdf640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd594160b70 0x7fd594161020 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fd594162730 tx=0x7fd58c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.120+0000 7fd589ffb640 1 -- 172.21.15.50:0/1071822368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c019070 con 0x7fd594160b70 2024-09-11T22:19:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.120+0000 7fd589ffb640 1 -- 172.21.15.50:0/1071822368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd58c006e20 con 0x7fd594160b70 2024-09-11T22:19:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.120+0000 7fd589ffb640 1 -- 172.21.15.50:0/1071822368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c003b90 con 0x7fd594160b70 2024-09-11T22:19:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.120+0000 7fd59b742640 1 -- 172.21.15.50:0/1071822368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59415fdb0 con 0x7fd594160b70 2024-09-11T22:19:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.120+0000 7fd59b742640 1 -- 172.21.15.50:0/1071822368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd594160370 con 0x7fd594160b70 2024-09-11T22:19:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.121+0000 7fd59b742640 1 -- 172.21.15.50:0/1071822368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5940d19a0 con 0x7fd594160b70 2024-09-11T22:19:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.121+0000 7fd589ffb640 1 -- 172.21.15.50:0/1071822368 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd58c01c070 con 0x7fd594160b70 2024-09-11T22:19:44.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.122+0000 7fd589ffb640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd57806be30 0x7fd57806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:44.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.122+0000 7fd589ffb640 1 -- 172.21.15.50:0/1071822368 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5795+0+0 (secure 0 0 0) 0x7fd58c08a380 con 0x7fd594160b70 2024-09-11T22:19:44.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.122+0000 7fd5994de640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd57806be30 0x7fd57806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:44.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.123+0000 7fd5994de640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd57806be30 0x7fd57806e2f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd590033000 tx=0x7fd590008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:44.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.127+0000 7fd589ffb640 1 -- 172.21.15.50:0/1071822368 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd58c058710 con 0x7fd594160b70 2024-09-11T22:19:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:44.301+0000 7fd59b742640 1 -- 172.21.15.50:0/1071822368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd594158e70 con 0x7fd594160b70 2024-09-11T22:19:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.088+0000 7fd589ffb640 1 -- 172.21.15.50:0/1071822368 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v134) ==== 181+0+0 (secure 0 0 0) 0x7fd58c05ca10 con 0x7fd594160b70 2024-09-11T22:19:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:19:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.092+0000 7fd59b742640 1 -- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd57806be30 msgr2=0x7fd57806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.092+0000 7fd59b742640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd57806be30 0x7fd57806e2f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd590033000 tx=0x7fd590008030 comp rx=0 tx=0).stop 2024-09-11T22:19:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.092+0000 7fd59b742640 1 -- 172.21.15.50:0/1071822368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd594160b70 msgr2=0x7fd594161020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.092+0000 7fd59b742640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd594160b70 0x7fd594161020 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fd594162730 tx=0x7fd58c00ff70 comp rx=0 tx=0).stop 2024-09-11T22:19:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.092+0000 7fd59b742640 1 -- 172.21.15.50:0/1071822368 shutdown_connections 2024-09-11T22:19:45.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.092+0000 7fd59b742640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd57806be30 0x7fd57806e2f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.092+0000 7fd59b742640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd59415ae10 0x7fd59415b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.092+0000 7fd59b742640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd594160b70 0x7fd594161020 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.092+0000 7fd59b742640 1 --2- 172.21.15.50:0/1071822368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580003b70 0x7fd5941578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.092+0000 7fd59b742640 1 -- 172.21.15.50:0/1071822368 >> 172.21.15.50:0/1071822368 conn(0x7fd594067ba0 msgr2=0x7fd5940b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.093+0000 7fd59b742640 1 -- 172.21.15.50:0/1071822368 shutdown_connections 2024-09-11T22:19:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.093+0000 7fd59b742640 1 -- 172.21.15.50:0/1071822368 wait complete. 2024-09-11T22:19:45.108 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:19:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.221+0000 7fb5c640e640 1 Processor -- start 2024-09-11T22:19:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.221+0000 7fb5c640e640 1 -- start start 2024-09-11T22:19:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5c640e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5c0161fa0 0x7fb5c00b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5c640e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5c00b1600 0x7fb5c00cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5c640e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c00cfbd0 con 0x7fb5c00cf440 2024-09-11T22:19:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5c640e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c00cdce0 con 0x7fb5c0161fa0 2024-09-11T22:19:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5c640e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c00d1220 con 0x7fb5c00b1600 2024-09-11T22:19:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5bffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5c0161fa0 0x7fb5c00b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5c49ab640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb5c00cf440 0x7fb5c006bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57216/0 (socket says 172.21.15.50:57216) 2024-09-11T22:19:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5c49ab640 1 -- 172.21.15.50:0/1109711174 learned_addr learned my addr 172.21.15.50:0/1109711174 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5bf7fe640 1 --2- 172.21.15.50:0/1109711174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5c00b1600 0x7fb5c00cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5bffff640 1 -- 172.21.15.50:0/1109711174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5c00b1600 msgr2=0x7fb5c00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5bffff640 1 --2- 172.21.15.50:0/1109711174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5c00b1600 0x7fb5c00cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5bffff640 1 -- 172.21.15.50:0/1109711174 >> v1:172.21.15.50:6789/0 conn(0x7fb5c00cf440 legacy=0x7fb5c006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5bffff640 1 -- 172.21.15.50:0/1109711174 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c00cfeb0 con 0x7fb5c0161fa0 2024-09-11T22:19:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.222+0000 7fb5beffd640 1 -- 172.21.15.50:0/1109711174 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80237478 0 0) 0x7fb5c00cfbd0 con 0x7fb5c00cf440 2024-09-11T22:19:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.223+0000 7fb5bffff640 1 --2- 172.21.15.50:0/1109711174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c0161fa0 0x7fb5c00b4d20 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00097a0 tx=0x7fb5b002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e490081545c8d1a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.223+0000 7fb5beffd640 1 -- 172.21.15.50:0/1109711174 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0037070 con 0x7fb5c0161fa0 2024-09-11T22:19:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.223+0000 7fb5beffd640 1 -- 172.21.15.50:0/1109711174 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b0032440 con 0x7fb5c0161fa0 2024-09-11T22:19:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.223+0000 7fb5beffd640 1 -- 172.21.15.50:0/1109711174 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0032810 con 0x7fb5c0161fa0 2024-09-11T22:19:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.224+0000 7fb5c640e640 1 -- 172.21.15.50:0/1109711174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c0161fa0 msgr2=0x7fb5c00b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.224+0000 7fb5c640e640 1 --2- 172.21.15.50:0/1109711174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c0161fa0 0x7fb5c00b4d20 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00097a0 tx=0x7fb5b002a180 comp rx=0 tx=0).stop 2024-09-11T22:19:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.224+0000 7fb5c640e640 1 -- 172.21.15.50:0/1109711174 shutdown_connections 2024-09-11T22:19:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.224+0000 7fb5c640e640 1 --2- 172.21.15.50:0/1109711174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5c00b1600 0x7fb5c00cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.224+0000 7fb5c640e640 1 --2- 172.21.15.50:0/1109711174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c0161fa0 0x7fb5c00b4d20 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.224+0000 7fb5c640e640 1 -- 172.21.15.50:0/1109711174 >> 172.21.15.50:0/1109711174 conn(0x7fb5c009ba50 msgr2=0x7fb5c00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.224+0000 7fb5c640e640 1 -- 172.21.15.50:0/1109711174 shutdown_connections 2024-09-11T22:19:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.224+0000 7fb5c640e640 1 -- 172.21.15.50:0/1109711174 wait complete. 2024-09-11T22:19:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.225+0000 7fb5c640e640 1 Processor -- start 2024-09-11T22:19:45.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.225+0000 7fb5c640e640 1 -- start start 2024-09-11T22:19:45.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5c640e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c00b1600 0x7fb5c00c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:45.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5c640e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5c00cf440 0x7fb5c00c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5c640e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5c0161fa0 0x7fb5c00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5c640e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c00cf8f0 con 0x7fb5c00b1600 2024-09-11T22:19:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5c640e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c00d17e0 con 0x7fb5c00cf440 2024-09-11T22:19:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5c640e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c0162380 con 0x7fb5c0161fa0 2024-09-11T22:19:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5bffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c00b1600 0x7fb5c00c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5bffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c00b1600 0x7fb5c00c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37854/0 (socket says 172.21.15.50:37854) 2024-09-11T22:19:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5bffff640 1 -- 172.21.15.50:0/1422682014 learned_addr learned my addr 172.21.15.50:0/1422682014 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5c49ab640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5c0161fa0 0x7fb5c00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5bf7fe640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5c00cf440 0x7fb5c00c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5bffff640 1 -- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5c0161fa0 msgr2=0x7fb5c00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5bffff640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5c0161fa0 0x7fb5c00cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5bffff640 1 -- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5c00cf440 msgr2=0x7fb5c00c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5bffff640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5c00cf440 0x7fb5c00c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.226+0000 7fb5bffff640 1 -- 172.21.15.50:0/1422682014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c00b2a50 con 0x7fb5c00b1600 2024-09-11T22:19:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.227+0000 7fb5bffff640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c00b1600 0x7fb5c00c9750 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00097a0 tx=0x7fb5b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.227+0000 7fb5bcff9640 1 -- 172.21.15.50:0/1422682014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0037050 con 0x7fb5c00b1600 2024-09-11T22:19:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.227+0000 7fb5bcff9640 1 -- 172.21.15.50:0/1422682014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b0038040 con 0x7fb5c00b1600 2024-09-11T22:19:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.227+0000 7fb5c640e640 1 -- 172.21.15.50:0/1422682014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c00b2cf0 con 0x7fb5c00b1600 2024-09-11T22:19:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.227+0000 7fb5bcff9640 1 -- 172.21.15.50:0/1422682014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0004490 con 0x7fb5c00b1600 2024-09-11T22:19:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.227+0000 7fb5c640e640 1 -- 172.21.15.50:0/1422682014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c00b32b0 con 0x7fb5c00b1600 2024-09-11T22:19:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.228+0000 7fb5c640e640 1 -- 172.21.15.50:0/1422682014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c00cf070 con 0x7fb5c00b1600 2024-09-11T22:19:45.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.228+0000 7fb5bcff9640 1 -- 172.21.15.50:0/1422682014 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5b003c6d0 con 0x7fb5c00b1600 2024-09-11T22:19:45.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.229+0000 7fb5bcff9640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5ac06be30 0x7fb5ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:45.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.229+0000 7fb5bcff9640 1 -- 172.21.15.50:0/1422682014 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5357+0+0 (secure 0 0 0) 0x7fb5b00ab620 con 0x7fb5c00b1600 2024-09-11T22:19:45.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.229+0000 7fb5bf7fe640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5ac06be30 0x7fb5ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:45.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.229+0000 7fb5bf7fe640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5ac06be30 0x7fb5ac06e2f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0070270 tx=0x7fb5b4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:45.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.233+0000 7fb5bcff9640 1 -- 172.21.15.50:0/1422682014 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5c00cf070 con 0x7fb5c00b1600 2024-09-11T22:19:45.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:45.408+0000 7fb5c640e640 1 -- 172.21.15.50:0/1422682014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb5c00d1c70 con 0x7fb5c00b1600 2024-09-11T22:19:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.099+0000 7fb5bcff9640 1 -- 172.21.15.50:0/1422682014 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v135) ==== 169+0+0 (secure 0 0 0) 0x7fb5b0079ad0 con 0x7fb5c00b1600 2024-09-11T22:19:46.101 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:19:46.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.103+0000 7fb5c640e640 1 -- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5ac06be30 msgr2=0x7fb5ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.103+0000 7fb5c640e640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5ac06be30 0x7fb5ac06e2f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0070270 tx=0x7fb5b4009190 comp rx=0 tx=0).stop 2024-09-11T22:19:46.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.103+0000 7fb5c640e640 1 -- 172.21.15.50:0/1422682014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c00b1600 msgr2=0x7fb5c00c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.103+0000 7fb5c640e640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c00b1600 0x7fb5c00c9750 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00097a0 tx=0x7fb5b00046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.104+0000 7fb5c640e640 1 -- 172.21.15.50:0/1422682014 shutdown_connections 2024-09-11T22:19:46.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.104+0000 7fb5c640e640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5ac06be30 0x7fb5ac06e2f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.104+0000 7fb5c640e640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5c0161fa0 0x7fb5c00cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.104+0000 7fb5c640e640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5c00cf440 0x7fb5c00c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.104+0000 7fb5c640e640 1 --2- 172.21.15.50:0/1422682014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c00b1600 0x7fb5c00c9750 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.104+0000 7fb5c640e640 1 -- 172.21.15.50:0/1422682014 >> 172.21.15.50:0/1422682014 conn(0x7fb5c009ba50 msgr2=0x7fb5c00ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:46.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.104+0000 7fb5c640e640 1 -- 172.21.15.50:0/1422682014 shutdown_connections 2024-09-11T22:19:46.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.104+0000 7fb5c640e640 1 -- 172.21.15.50:0/1422682014 wait complete. 2024-09-11T22:19:46.125 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T22:19:46.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.243+0000 7fae23c53640 1 Processor -- start 2024-09-11T22:19:46.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.243+0000 7fae23c53640 1 -- start start 2024-09-11T22:19:46.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.244+0000 7fae23c53640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae1c15e8e0 0x7fae1c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:46.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.244+0000 7fae23c53640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fae1c0d1580 0x7fae1c0d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:46.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.244+0000 7fae23c53640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae1c0d1ee0 con 0x7fae1c162350 2024-09-11T22:19:46.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.244+0000 7fae23c53640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fae1c15ecc0 con 0x7fae1c0d1580 2024-09-11T22:19:46.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.244+0000 7fae23c53640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fae1c0d2ad0 con 0x7fae1c15e8e0 2024-09-11T22:19:46.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.244+0000 7fae219ef640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae1c15e8e0 0x7fae1c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:46.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.244+0000 7fae211ee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fae1c0d1580 0x7fae1c0d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:46.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.244+0000 7fae221f0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fae1c162350 0x7fae1c162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:34084/0 (socket says 172.21.15.50:34084) 2024-09-11T22:19:46.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.244+0000 7fae221f0640 1 -- 172.21.15.50:0/2168175698 learned_addr learned my addr 172.21.15.50:0/2168175698 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:46.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.245+0000 7fae219ef640 1 -- 172.21.15.50:0/2168175698 >> v2:172.21.15.77:3300/0 conn(0x7fae1c0d1580 msgr2=0x7fae1c0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:46.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.245+0000 7fae219ef640 1 --2- 172.21.15.50:0/2168175698 >> v2:172.21.15.77:3300/0 conn(0x7fae1c0d1580 0x7fae1c0d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.245+0000 7fae219ef640 1 -- 172.21.15.50:0/2168175698 >> v1:172.21.15.77:6789/0 conn(0x7fae1c162350 legacy=0x7fae1c162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.245+0000 7fae209ed640 1 -- 172.21.15.50:0/2168175698 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 722377692 0 0) 0x7fae1c0d1ee0 con 0x7fae1c162350 2024-09-11T22:19:46.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.245+0000 7fae219ef640 1 -- 172.21.15.50:0/2168175698 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c163080 con 0x7fae1c15e8e0 2024-09-11T22:19:46.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.246+0000 7fae219ef640 1 --2- 172.21.15.50:0/2168175698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae1c15e8e0 0x7fae1c0b7880 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fae180097a0 tx=0x7fae1802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44afef81e26bccfc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:46.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.246+0000 7fae209ed640 1 -- 172.21.15.50:0/2168175698 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18037070 con 0x7fae1c15e8e0 2024-09-11T22:19:46.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.246+0000 7fae209ed640 1 -- 172.21.15.50:0/2168175698 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae18032440 con 0x7fae1c15e8e0 2024-09-11T22:19:46.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.246+0000 7fae209ed640 1 -- 172.21.15.50:0/2168175698 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18032810 con 0x7fae1c15e8e0 2024-09-11T22:19:46.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.246+0000 7fae23c53640 1 -- 172.21.15.50:0/2168175698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae1c15e8e0 msgr2=0x7fae1c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.246+0000 7fae23c53640 1 --2- 172.21.15.50:0/2168175698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae1c15e8e0 0x7fae1c0b7880 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fae180097a0 tx=0x7fae1802a210 comp rx=0 tx=0).stop 2024-09-11T22:19:46.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.246+0000 7fae23c53640 1 -- 172.21.15.50:0/2168175698 shutdown_connections 2024-09-11T22:19:46.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.246+0000 7fae23c53640 1 --2- 172.21.15.50:0/2168175698 >> v2:172.21.15.77:3300/0 conn(0x7fae1c0d1580 0x7fae1c0d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.246+0000 7fae23c53640 1 --2- 172.21.15.50:0/2168175698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae1c15e8e0 0x7fae1c0b7880 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.246+0000 7fae23c53640 1 -- 172.21.15.50:0/2168175698 >> 172.21.15.50:0/2168175698 conn(0x7fae1c067ba0 msgr2=0x7fae1c067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:46.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.246+0000 7fae23c53640 1 -- 172.21.15.50:0/2168175698 shutdown_connections 2024-09-11T22:19:46.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.246+0000 7fae23c53640 1 -- 172.21.15.50:0/2168175698 wait complete. 2024-09-11T22:19:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.248+0000 7fae23c53640 1 Processor -- start 2024-09-11T22:19:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.248+0000 7fae23c53640 1 -- start start 2024-09-11T22:19:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.248+0000 7fae23c53640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae1c0d1580 0x7fae1c0b69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.248+0000 7fae23c53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae1c15e8e0 0x7fae1c14c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.248+0000 7fae23c53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae1c162350 0x7fae1c1605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.248+0000 7fae23c53640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c0d3000 con 0x7fae1c162350 2024-09-11T22:19:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.248+0000 7fae23c53640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c0d3370 con 0x7fae1c15e8e0 2024-09-11T22:19:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.248+0000 7fae23c53640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fae1c0d3800 con 0x7fae1c0d1580 2024-09-11T22:19:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.248+0000 7fae219ef640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae1c0d1580 0x7fae1c0b69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.248+0000 7fae219ef640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae1c0d1580 0x7fae1c0b69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:50892/0 (socket says 172.21.15.50:50892) 2024-09-11T22:19:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.248+0000 7fae219ef640 1 -- 172.21.15.50:0/706734993 learned_addr learned my addr 172.21.15.50:0/706734993 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.248+0000 7fae221f0640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae1c162350 0x7fae1c1605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.248+0000 7fae211ee640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae1c15e8e0 0x7fae1c14c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.249+0000 7fae219ef640 1 -- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae1c15e8e0 msgr2=0x7fae1c14c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.249+0000 7fae219ef640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae1c15e8e0 0x7fae1c14c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.249+0000 7fae219ef640 1 -- 172.21.15.50:0/706734993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae1c162350 msgr2=0x7fae1c1605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.249+0000 7fae219ef640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae1c162350 0x7fae1c1605a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.249+0000 7fae219ef640 1 -- 172.21.15.50:0/706734993 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c0b6f10 con 0x7fae1c0d1580 2024-09-11T22:19:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.249+0000 7fae219ef640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae1c0d1580 0x7fae1c0b69d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fae18000c00 tx=0x7fae180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.249+0000 7fae127fc640 1 -- 172.21.15.50:0/706734993 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18041070 con 0x7fae1c0d1580 2024-09-11T22:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.249+0000 7fae127fc640 1 -- 172.21.15.50:0/706734993 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae1803c870 con 0x7fae1c0d1580 2024-09-11T22:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.249+0000 7fae23c53640 1 -- 172.21.15.50:0/706734993 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1c14cf10 con 0x7fae1c0d1580 2024-09-11T22:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.249+0000 7fae127fc640 1 -- 172.21.15.50:0/706734993 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18037040 con 0x7fae1c0d1580 2024-09-11T22:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.249+0000 7fae23c53640 1 -- 172.21.15.50:0/706734993 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1c14d4d0 con 0x7fae1c0d1580 2024-09-11T22:19:46.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.250+0000 7fae23c53640 1 -- 172.21.15.50:0/706734993 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae1c14d6d0 con 0x7fae1c0d1580 2024-09-11T22:19:46.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.251+0000 7fae127fc640 1 -- 172.21.15.50:0/706734993 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae18044070 con 0x7fae1c0d1580 2024-09-11T22:19:46.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.251+0000 7fae127fc640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fae0006be30 0x7fae0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:46.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.251+0000 7fae127fc640 1 -- 172.21.15.50:0/706734993 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7fae180ab800 con 0x7fae1c0d1580 2024-09-11T22:19:46.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.251+0000 7fae211ee640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fae0006be30 0x7fae0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:46.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.252+0000 7fae211ee640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fae0006be30 0x7fae0006e2f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fae1c161780 tx=0x7fae0c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.256+0000 7fae127fc640 1 -- 172.21.15.50:0/706734993 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae1c14d6d0 con 0x7fae1c0d1580 2024-09-11T22:19:46.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.434+0000 7fae23c53640 1 -- 172.21.15.50:0/706734993 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fae1c0b7880 con 0x7fae1c0d1580 2024-09-11T22:19:46.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.439+0000 7fae127fc640 1 -- 172.21.15.50:0/706734993 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7fae18079ee0 con 0x7fae1c0d1580 2024-09-11T22:19:46.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.441+0000 7fae23c53640 1 -- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fae0006be30 msgr2=0x7fae0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.441+0000 7fae23c53640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fae0006be30 0x7fae0006e2f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fae1c161780 tx=0x7fae0c009190 comp rx=0 tx=0).stop 2024-09-11T22:19:46.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.441+0000 7fae23c53640 1 -- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae1c0d1580 msgr2=0x7fae1c0b69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.441+0000 7fae23c53640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae1c0d1580 0x7fae1c0b69d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fae18000c00 tx=0x7fae180046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.441+0000 7fae23c53640 1 -- 172.21.15.50:0/706734993 shutdown_connections 2024-09-11T22:19:46.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.441+0000 7fae23c53640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fae0006be30 0x7fae0006e2f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.441+0000 7fae23c53640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae1c162350 0x7fae1c1605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.441+0000 7fae23c53640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae1c15e8e0 0x7fae1c14c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.441+0000 7fae23c53640 1 --2- 172.21.15.50:0/706734993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae1c0d1580 0x7fae1c0b69d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.441+0000 7fae23c53640 1 -- 172.21.15.50:0/706734993 >> 172.21.15.50:0/706734993 conn(0x7fae1c067ba0 msgr2=0x7fae1c069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:46.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.441+0000 7fae23c53640 1 -- 172.21.15.50:0/706734993 shutdown_connections 2024-09-11T22:19:46.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.441+0000 7fae23c53640 1 -- 172.21.15.50:0/706734993 wait complete. 2024-09-11T22:19:46.453 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-11T22:19:46.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.555+0000 7f7b607f6640 1 Processor -- start 2024-09-11T22:19:46.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.555+0000 7f7b607f6640 1 -- start start 2024-09-11T22:19:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.556+0000 7f7b607f6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b5815fc00 0x7f7b580d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.556+0000 7f7b607f6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b5815ffe0 con 0x7f7b580cf660 2024-09-11T22:19:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.556+0000 7f7b607f6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b580cfaf0 con 0x7f7b580ce0e0 2024-09-11T22:19:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.556+0000 7f7b607f6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7b580b5550 con 0x7f7b5815fc00 2024-09-11T22:19:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.556+0000 7f7b5e592640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b5815fc00 0x7f7b580d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.556+0000 7f7b5dd91640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7b580cf660 0x7f7b580ccf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57220/0 (socket says 172.21.15.50:57220) 2024-09-11T22:19:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.556+0000 7f7b5dd91640 1 -- 172.21.15.50:0/3425428304 learned_addr learned my addr 172.21.15.50:0/3425428304 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.556+0000 7f7b5e592640 1 -- 172.21.15.50:0/3425428304 >> v1:172.21.15.77:6789/0 conn(0x7f7b580ce0e0 legacy=0x7f7b580cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.556+0000 7f7b5e592640 1 -- 172.21.15.50:0/3425428304 >> v1:172.21.15.50:6789/0 conn(0x7f7b580cf660 legacy=0x7f7b580ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.556+0000 7f7b5e592640 1 -- 172.21.15.50:0/3425428304 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b580cfdd0 con 0x7f7b5815fc00 2024-09-11T22:19:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.557+0000 7f7b5e592640 1 --2- 172.21.15.50:0/3425428304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5815fc00 0x7f7b580d07d0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f7b540097a0 tx=0x7f7b5402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff089e9321a6a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.557+0000 7f7b5d590640 1 -- 172.21.15.50:0/3425428304 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54037070 con 0x7f7b5815fc00 2024-09-11T22:19:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.557+0000 7f7b5d590640 1 -- 172.21.15.50:0/3425428304 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b54032640 con 0x7f7b5815fc00 2024-09-11T22:19:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.557+0000 7f7b5d590640 1 -- 172.21.15.50:0/3425428304 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54032a10 con 0x7f7b5815fc00 2024-09-11T22:19:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.558+0000 7f7b607f6640 1 -- 172.21.15.50:0/3425428304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5815fc00 msgr2=0x7f7b580d07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.558+0000 7f7b607f6640 1 --2- 172.21.15.50:0/3425428304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5815fc00 0x7f7b580d07d0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f7b540097a0 tx=0x7f7b5402a2c0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.558+0000 7f7b607f6640 1 -- 172.21.15.50:0/3425428304 shutdown_connections 2024-09-11T22:19:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.558+0000 7f7b607f6640 1 --2- 172.21.15.50:0/3425428304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5815fc00 0x7f7b580d07d0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.558+0000 7f7b607f6640 1 -- 172.21.15.50:0/3425428304 >> 172.21.15.50:0/3425428304 conn(0x7f7b580b4250 msgr2=0x7f7b580b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.558+0000 7f7b607f6640 1 -- 172.21.15.50:0/3425428304 shutdown_connections 2024-09-11T22:19:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.558+0000 7f7b607f6640 1 -- 172.21.15.50:0/3425428304 wait complete. 2024-09-11T22:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.559+0000 7f7b607f6640 1 Processor -- start 2024-09-11T22:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.559+0000 7f7b607f6640 1 -- start start 2024-09-11T22:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b607f6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b580ce0e0 0x7f7b58153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b607f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5815fc00 0x7f7b581590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b607f6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b58157be0 0x7f7b58159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b607f6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7b580cdd80 con 0x7f7b5815fc00 2024-09-11T22:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b607f6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7b580b5b10 con 0x7f7b580ce0e0 2024-09-11T22:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b607f6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7b580b6fb0 con 0x7f7b58157be0 2024-09-11T22:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b5dd91640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5815fc00 0x7f7b581590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b5dd91640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5815fc00 0x7f7b581590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37892/0 (socket says 172.21.15.50:37892) 2024-09-11T22:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b5dd91640 1 -- 172.21.15.50:0/2218544442 learned_addr learned my addr 172.21.15.50:0/2218544442 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b5e592640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b580ce0e0 0x7f7b58153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b5ed93640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b58157be0 0x7f7b58159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b5dd91640 1 -- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b58157be0 msgr2=0x7f7b58159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b5dd91640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b58157be0 0x7f7b58159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b5dd91640 1 -- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b580ce0e0 msgr2=0x7f7b58153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b5dd91640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b580ce0e0 0x7f7b58153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b5dd91640 1 -- 172.21.15.50:0/2218544442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b58158740 con 0x7f7b5815fc00 2024-09-11T22:19:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.560+0000 7f7b5dd91640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5815fc00 0x7f7b581590c0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800c500 tx=0x7f7b4800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.561+0000 7f7b4effd640 1 -- 172.21.15.50:0/2218544442 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48017070 con 0x7f7b5815fc00 2024-09-11T22:19:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.561+0000 7f7b4effd640 1 -- 172.21.15.50:0/2218544442 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b48005ce0 con 0x7f7b5815fc00 2024-09-11T22:19:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.561+0000 7f7b607f6640 1 -- 172.21.15.50:0/2218544442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b58158180 con 0x7f7b5815fc00 2024-09-11T22:19:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.561+0000 7f7b4effd640 1 -- 172.21.15.50:0/2218544442 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b480072f0 con 0x7f7b5815fc00 2024-09-11T22:19:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.561+0000 7f7b607f6640 1 -- 172.21.15.50:0/2218544442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b581541d0 con 0x7f7b5815fc00 2024-09-11T22:19:46.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.562+0000 7f7b607f6640 1 -- 172.21.15.50:0/2218544442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b580ce740 con 0x7f7b5815fc00 2024-09-11T22:19:46.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.562+0000 7f7b4effd640 1 -- 172.21.15.50:0/2218544442 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b4801a070 con 0x7f7b5815fc00 2024-09-11T22:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.563+0000 7f7b4effd640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7b3c06be60 0x7f7b3c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.563+0000 7f7b4effd640 1 -- 172.21.15.50:0/2218544442 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7f7b48089df0 con 0x7f7b5815fc00 2024-09-11T22:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.563+0000 7f7b5e592640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7b3c06be60 0x7f7b3c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.563+0000 7f7b5e592640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7b3c06be60 0x7f7b3c06e320 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7b54034000 tx=0x7f7b5402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:46.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.567+0000 7f7b4effd640 1 -- 172.21.15.50:0/2218544442 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b48058440 con 0x7f7b5815fc00 2024-09-11T22:19:46.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:46.807+0000 7f7b607f6640 1 -- 172.21.15.50:0/2218544442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7f7b580d08b0 con 0x7f7b5815fc00 2024-09-11T22:19:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.101+0000 7f7b4effd640 1 -- 172.21.15.50:0/2218544442 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v416) ==== 155+0+0 (secure 0 0 0) 0x7f7b4805c740 con 0x7f7b5815fc00 2024-09-11T22:19:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.103+0000 7f7b607f6640 1 -- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7b3c06be60 msgr2=0x7f7b3c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.103+0000 7f7b607f6640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7b3c06be60 0x7f7b3c06e320 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7b54034000 tx=0x7f7b5402e000 comp rx=0 tx=0).stop 2024-09-11T22:19:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.103+0000 7f7b607f6640 1 -- 172.21.15.50:0/2218544442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5815fc00 msgr2=0x7f7b581590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.103+0000 7f7b607f6640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5815fc00 0x7f7b581590c0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800c500 tx=0x7f7b4800c9c0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.103+0000 7f7b607f6640 1 -- 172.21.15.50:0/2218544442 shutdown_connections 2024-09-11T22:19:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.103+0000 7f7b607f6640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7b3c06be60 0x7f7b3c06e320 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.103+0000 7f7b607f6640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b58157be0 0x7f7b58159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.103+0000 7f7b607f6640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5815fc00 0x7f7b581590c0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.103+0000 7f7b607f6640 1 --2- 172.21.15.50:0/2218544442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b580ce0e0 0x7f7b58153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.103+0000 7f7b607f6640 1 -- 172.21.15.50:0/2218544442 >> 172.21.15.50:0/2218544442 conn(0x7f7b580b4250 msgr2=0x7f7b580b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.103+0000 7f7b607f6640 1 -- 172.21.15.50:0/2218544442 shutdown_connections 2024-09-11T22:19:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.104+0000 7f7b607f6640 1 -- 172.21.15.50:0/2218544442 wait complete. 2024-09-11T22:19:47.116 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-11T22:19:47.117 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-11T22:19:47.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:19:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.221+0000 7f7fce13b640 1 Processor -- start 2024-09-11T22:19:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.222+0000 7f7fce13b640 1 -- start start 2024-09-11T22:19:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.222+0000 7f7fce13b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc815e870 0x7f7fc80d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.222+0000 7f7fce13b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fc80d16d0 0x7f7fc80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.222+0000 7f7fce13b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7fc80d3a30 0x7f7fc80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.222+0000 7f7fce13b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc80d3ea0 con 0x7f7fc80d16d0 2024-09-11T22:19:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.222+0000 7f7fce13b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc80d1b10 con 0x7f7fc80d3a30 2024-09-11T22:19:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.222+0000 7f7fce13b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc80cfa80 con 0x7f7fc815e870 2024-09-11T22:19:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.223+0000 7f7fc6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fc80d16d0 0x7f7fc80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.223+0000 7f7fc6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fc80d16d0 0x7f7fc80d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37898/0 (socket says 172.21.15.50:37898) 2024-09-11T22:19:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.223+0000 7f7fc6ffd640 1 -- 172.21.15.50:0/564762764 learned_addr learned my addr 172.21.15.50:0/564762764 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.223+0000 7f7fc7fff640 1 --2- 172.21.15.50:0/564762764 >> v2:172.21.15.77:3300/0 conn(0x7f7fc80d3a30 0x7f7fc80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.223+0000 7f7fc6ffd640 1 -- 172.21.15.50:0/564762764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc815e870 msgr2=0x7f7fc80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.223+0000 7f7fc77fe640 1 --2- 172.21.15.50:0/564762764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc815e870 0x7f7fc80d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.223+0000 7f7fc6ffd640 1 --2- 172.21.15.50:0/564762764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc815e870 0x7f7fc80d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.223+0000 7f7fc6ffd640 1 -- 172.21.15.50:0/564762764 >> v2:172.21.15.77:3300/0 conn(0x7f7fc80d3a30 msgr2=0x7f7fc80b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:47.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.223+0000 7f7fc6ffd640 1 --2- 172.21.15.50:0/564762764 >> v2:172.21.15.77:3300/0 conn(0x7f7fc80d3a30 0x7f7fc80b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.223+0000 7f7fc6ffd640 1 -- 172.21.15.50:0/564762764 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc80d40d0 con 0x7f7fc80d16d0 2024-09-11T22:19:47.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.223+0000 7f7fc7fff640 1 --2- 172.21.15.50:0/564762764 >> v2:172.21.15.77:3300/0 conn(0x7f7fc80d3a30 0x7f7fc80b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:47.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.223+0000 7f7fc77fe640 1 --2- 172.21.15.50:0/564762764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc815e870 0x7f7fc80d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:47.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.224+0000 7f7fc6ffd640 1 --2- 172.21.15.50:0/564762764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc80d16d0 0x7f7fc80d34f0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80cfc30 tx=0x7f7fbc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be54b3355c32fe63 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:47.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.224+0000 7f7fc67fc640 1 -- 172.21.15.50:0/564762764 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc037070 con 0x7f7fc80d16d0 2024-09-11T22:19:47.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.224+0000 7f7fc67fc640 1 -- 172.21.15.50:0/564762764 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fbc032440 con 0x7f7fc80d16d0 2024-09-11T22:19:47.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.224+0000 7f7fc67fc640 1 -- 172.21.15.50:0/564762764 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc032810 con 0x7f7fc80d16d0 2024-09-11T22:19:47.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.224+0000 7f7fce13b640 1 -- 172.21.15.50:0/564762764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc80d16d0 msgr2=0x7f7fc80d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.224+0000 7f7fce13b640 1 --2- 172.21.15.50:0/564762764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc80d16d0 0x7f7fc80d34f0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80cfc30 tx=0x7f7fbc02a1c0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.224+0000 7f7fce13b640 1 -- 172.21.15.50:0/564762764 shutdown_connections 2024-09-11T22:19:47.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.224+0000 7f7fce13b640 1 --2- 172.21.15.50:0/564762764 >> v2:172.21.15.77:3300/0 conn(0x7f7fc80d3a30 0x7f7fc80b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.224+0000 7f7fce13b640 1 --2- 172.21.15.50:0/564762764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc80d16d0 0x7f7fc80d34f0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.224+0000 7f7fce13b640 1 --2- 172.21.15.50:0/564762764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc815e870 0x7f7fc80d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.224+0000 7f7fce13b640 1 -- 172.21.15.50:0/564762764 >> 172.21.15.50:0/564762764 conn(0x7f7fc80727a0 msgr2=0x7f7fc80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:47.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.224+0000 7f7fce13b640 1 -- 172.21.15.50:0/564762764 shutdown_connections 2024-09-11T22:19:47.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.224+0000 7f7fce13b640 1 -- 172.21.15.50:0/564762764 wait complete. 2024-09-11T22:19:47.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.226+0000 7f7fce13b640 1 Processor -- start 2024-09-11T22:19:47.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.226+0000 7f7fce13b640 1 -- start start 2024-09-11T22:19:47.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.226+0000 7f7fce13b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fc80d16d0 0x7f7fc80b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.226+0000 7f7fce13b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc80d3a30 0x7f7fc8157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.226+0000 7f7fce13b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc815e870 0x7f7fc80cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fce13b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80b7ee0 con 0x7f7fc815e870 2024-09-11T22:19:47.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fce13b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80b7c00 con 0x7f7fc80d16d0 2024-09-11T22:19:47.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fce13b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc815ec50 con 0x7f7fc80d3a30 2024-09-11T22:19:47.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fc7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc815e870 0x7f7fc80cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fc7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc815e870 0x7f7fc80cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37914/0 (socket says 172.21.15.50:37914) 2024-09-11T22:19:47.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fc7fff640 1 -- 172.21.15.50:0/1454926618 learned_addr learned my addr 172.21.15.50:0/1454926618 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:47.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fc77fe640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fc80d16d0 0x7f7fc80b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fc6ffd640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc80d3a30 0x7f7fc8157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fc7fff640 1 -- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc80d3a30 msgr2=0x7f7fc8157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fc7fff640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc80d3a30 0x7f7fc8157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fc7fff640 1 -- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fc80d16d0 msgr2=0x7f7fc80b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fc7fff640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fc80d16d0 0x7f7fc80b67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fc7fff640 1 -- 172.21.15.50:0/1454926618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc80cc4b0 con 0x7f7fc815e870 2024-09-11T22:19:47.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fc7fff640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc815e870 0x7f7fc80cd270 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000c7f0 tx=0x7f7fc000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:47.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7faffff640 1 -- 172.21.15.50:0/1454926618 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0015070 con 0x7f7fc815e870 2024-09-11T22:19:47.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7faffff640 1 -- 172.21.15.50:0/1454926618 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc0007820 con 0x7f7fc815e870 2024-09-11T22:19:47.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fce13b640 1 -- 172.21.15.50:0/1454926618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc80cc790 con 0x7f7fc815e870 2024-09-11T22:19:47.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7faffff640 1 -- 172.21.15.50:0/1454926618 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0007c10 con 0x7f7fc815e870 2024-09-11T22:19:47.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.227+0000 7f7fce13b640 1 -- 172.21.15.50:0/1454926618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc80b6d30 con 0x7f7fc815e870 2024-09-11T22:19:47.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.228+0000 7f7fce13b640 1 -- 172.21.15.50:0/1454926618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc80b78b0 con 0x7f7fc815e870 2024-09-11T22:19:47.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.229+0000 7f7faffff640 1 -- 172.21.15.50:0/1454926618 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fc0018070 con 0x7f7fc815e870 2024-09-11T22:19:47.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.230+0000 7f7faffff640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7fb406be30 0x7f7fb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.230+0000 7f7faffff640 1 -- 172.21.15.50:0/1454926618 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7f7fc008ac20 con 0x7f7fc815e870 2024-09-11T22:19:47.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.230+0000 7f7fc77fe640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7fb406be30 0x7f7fb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.231+0000 7f7fc77fe640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7fb406be30 0x7f7fb406e2f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800f500 tx=0x7f7fb8007770 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:47.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.234+0000 7f7faffff640 1 -- 172.21.15.50:0/1454926618 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fc0059340 con 0x7f7fc815e870 2024-09-11T22:19:47.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.413+0000 7f7fce13b640 1 -- 172.21.15.50:0/1454926618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fc80b93b0 con 0x7f7fc815e870 2024-09-11T22:19:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.414+0000 7f7faffff640 1 -- 172.21.15.50:0/1454926618 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) ==== 74+0+13006 (secure 0 0 0) 0x7f7fc005d640 con 0x7f7fc815e870 2024-09-11T22:19:47.415 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:47.415 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":135,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:19:46.096312+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/3438568728":"2024-09-12T22:19:42.985832+0000","172.21.15.50:6834/3438568728":"2024-09-12T22:19:42.985832+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:19:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.416+0000 7f7fce13b640 1 -- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7fb406be30 msgr2=0x7f7fb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.416+0000 7f7fce13b640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7fb406be30 0x7f7fb406e2f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800f500 tx=0x7f7fb8007770 comp rx=0 tx=0).stop 2024-09-11T22:19:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.416+0000 7f7fce13b640 1 -- 172.21.15.50:0/1454926618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc815e870 msgr2=0x7f7fc80cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.416+0000 7f7fce13b640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc815e870 0x7f7fc80cd270 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000c7f0 tx=0x7f7fc000ccb0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.416+0000 7f7fce13b640 1 -- 172.21.15.50:0/1454926618 shutdown_connections 2024-09-11T22:19:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.416+0000 7f7fce13b640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7fb406be30 0x7f7fb406e2f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.416+0000 7f7fce13b640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7fc80d3a30 0x7f7fc8157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.416+0000 7f7fce13b640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fc815e870 0x7f7fc80cd270 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.416+0000 7f7fce13b640 1 --2- 172.21.15.50:0/1454926618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7fc80d16d0 0x7f7fc80b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.416+0000 7f7fce13b640 1 -- 172.21.15.50:0/1454926618 >> 172.21.15.50:0/1454926618 conn(0x7f7fc80727a0 msgr2=0x7f7fc80b9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:47.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.416+0000 7f7fce13b640 1 -- 172.21.15.50:0/1454926618 shutdown_connections 2024-09-11T22:19:47.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.416+0000 7f7fce13b640 1 -- 172.21.15.50:0/1454926618 wait complete. 2024-09-11T22:19:47.429 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:11:03.407373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:19:47.429 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:19:47.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.542+0000 7ff691fb9640 1 Processor -- start 2024-09-11T22:19:47.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.542+0000 7ff691fb9640 1 -- start start 2024-09-11T22:19:47.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.543+0000 7ff691fb9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff68c15e840 0x7ff68c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.543+0000 7ff691fb9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68c0ce5f0 con 0x7ff68c0cf580 2024-09-11T22:19:47.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.543+0000 7ff691fb9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68c0ce310 con 0x7ff68c0cdd50 2024-09-11T22:19:47.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.543+0000 7ff691fb9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff68c06c240 con 0x7ff68c15e840 2024-09-11T22:19:47.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.543+0000 7ff68b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff68c15e840 0x7ff68c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.543+0000 7ff68b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff68c15e840 0x7ff68c0b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48960/0 (socket says 172.21.15.50:48960) 2024-09-11T22:19:47.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.543+0000 7ff68bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff68c0cf580 0x7ff68c06c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34084/0 (socket says 172.21.15.50:34084) 2024-09-11T22:19:47.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.543+0000 7ff68b7fe640 1 -- 172.21.15.50:0/1014708896 learned_addr learned my addr 172.21.15.50:0/1014708896 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:47.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.543+0000 7ff68b7fe640 1 -- 172.21.15.50:0/1014708896 >> v1:172.21.15.77:6789/0 conn(0x7ff68c0cdd50 legacy=0x7ff68c0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:47.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.544+0000 7ff68b7fe640 1 -- 172.21.15.50:0/1014708896 >> v1:172.21.15.50:6789/0 conn(0x7ff68c0cf580 legacy=0x7ff68c06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.544+0000 7ff68affd640 1 -- 172.21.15.50:0/1014708896 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884746670 0 0) 0x7ff68c0ce5f0 con 0x7ff68c0cf580 2024-09-11T22:19:47.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.544+0000 7ff68b7fe640 1 -- 172.21.15.50:0/1014708896 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68c06bbf0 con 0x7ff68c15e840 2024-09-11T22:19:47.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.544+0000 7ff68b7fe640 1 --2- 172.21.15.50:0/1014708896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68c15e840 0x7ff68c0b4c70 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7ff67c009870 tx=0x7ff67c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7954ce74782b0fe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:47.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.544+0000 7ff68affd640 1 -- 172.21.15.50:0/1014708896 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c037070 con 0x7ff68c15e840 2024-09-11T22:19:47.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.545+0000 7ff68affd640 1 -- 172.21.15.50:0/1014708896 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff67c032440 con 0x7ff68c15e840 2024-09-11T22:19:47.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.545+0000 7ff68affd640 1 -- 172.21.15.50:0/1014708896 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c032810 con 0x7ff68c15e840 2024-09-11T22:19:47.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.545+0000 7ff691fb9640 1 -- 172.21.15.50:0/1014708896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68c15e840 msgr2=0x7ff68c0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.545+0000 7ff691fb9640 1 --2- 172.21.15.50:0/1014708896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68c15e840 0x7ff68c0b4c70 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7ff67c009870 tx=0x7ff67c02a2a0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.545+0000 7ff691fb9640 1 -- 172.21.15.50:0/1014708896 shutdown_connections 2024-09-11T22:19:47.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.545+0000 7ff691fb9640 1 --2- 172.21.15.50:0/1014708896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68c15e840 0x7ff68c0b4c70 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.545+0000 7ff691fb9640 1 -- 172.21.15.50:0/1014708896 >> 172.21.15.50:0/1014708896 conn(0x7ff68c0b4150 msgr2=0x7ff68c0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:47.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.545+0000 7ff691fb9640 1 -- 172.21.15.50:0/1014708896 shutdown_connections 2024-09-11T22:19:47.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.545+0000 7ff691fb9640 1 -- 172.21.15.50:0/1014708896 wait complete. 2024-09-11T22:19:47.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.546+0000 7ff691fb9640 1 Processor -- start 2024-09-11T22:19:47.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.546+0000 7ff691fb9640 1 -- start start 2024-09-11T22:19:47.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.547+0000 7ff691fb9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff68c0cdd50 0x7ff68c0b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.547+0000 7ff691fb9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff68c0cf580 0x7ff68c1f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.547+0000 7ff691fb9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68c15e840 0x7ff68c1f8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.547+0000 7ff691fb9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c15ec20 con 0x7ff68c15e840 2024-09-11T22:19:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.547+0000 7ff691fb9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c0d0470 con 0x7ff68c0cdd50 2024-09-11T22:19:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.547+0000 7ff691fb9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff68c15eda0 con 0x7ff68c0cf580 2024-09-11T22:19:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.547+0000 7ff68bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68c15e840 0x7ff68c1f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.547+0000 7ff68bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68c15e840 0x7ff68c1f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48970/0 (socket says 172.21.15.50:48970) 2024-09-11T22:19:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.547+0000 7ff68bfff640 1 -- 172.21.15.50:0/3512501444 learned_addr learned my addr 172.21.15.50:0/3512501444 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.548+0000 7ff68b7fe640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff68c0cdd50 0x7ff68c0b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.548+0000 7ff683fff640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff68c0cf580 0x7ff68c1f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.548+0000 7ff68bfff640 1 -- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff68c0cf580 msgr2=0x7ff68c1f7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.548+0000 7ff68bfff640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff68c0cf580 0x7ff68c1f7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.548+0000 7ff68bfff640 1 -- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff68c0cdd50 msgr2=0x7ff68c0b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.548+0000 7ff68bfff640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff68c0cdd50 0x7ff68c0b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.548+0000 7ff68bfff640 1 -- 172.21.15.50:0/3512501444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68c0b6360 con 0x7ff68c15e840 2024-09-11T22:19:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.548+0000 7ff68bfff640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68c15e840 0x7ff68c1f8250 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c7a0 tx=0x7ff68400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:47.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.548+0000 7ff688ff9640 1 -- 172.21.15.50:0/3512501444 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684018070 con 0x7ff68c15e840 2024-09-11T22:19:47.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.548+0000 7ff688ff9640 1 -- 172.21.15.50:0/3512501444 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68400a640 con 0x7ff68c15e840 2024-09-11T22:19:47.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.548+0000 7ff688ff9640 1 -- 172.21.15.50:0/3512501444 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68400aab0 con 0x7ff68c15e840 2024-09-11T22:19:47.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.548+0000 7ff691fb9640 1 -- 172.21.15.50:0/3512501444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68c0b6640 con 0x7ff68c15e840 2024-09-11T22:19:47.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.548+0000 7ff691fb9640 1 -- 172.21.15.50:0/3512501444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff68c0b5f50 con 0x7ff68c15e840 2024-09-11T22:19:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.549+0000 7ff691fb9640 1 -- 172.21.15.50:0/3512501444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff68c0b6a30 con 0x7ff68c15e840 2024-09-11T22:19:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.549+0000 7ff688ff9640 1 -- 172.21.15.50:0/3512501444 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff68401b070 con 0x7ff68c15e840 2024-09-11T22:19:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.550+0000 7ff688ff9640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff66c06be30 0x7ff66c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.550+0000 7ff688ff9640 1 -- 172.21.15.50:0/3512501444 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7ff68408a1a0 con 0x7ff68c15e840 2024-09-11T22:19:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.550+0000 7ff68b7fe640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff66c06be30 0x7ff66c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.551+0000 7ff68b7fe640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff66c06be30 0x7ff66c06e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff67c034000 tx=0x7ff67c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:47.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.554+0000 7ff688ff9640 1 -- 172.21.15.50:0/3512501444 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff684058e50 con 0x7ff68c15e840 2024-09-11T22:19:47.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.729+0000 7ff691fb9640 1 -- 172.21.15.50:0/3512501444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff68c0b6810 con 0x7ff68c15e840 2024-09-11T22:19:47.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.730+0000 7ff688ff9640 1 -- 172.21.15.50:0/3512501444 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) ==== 93+0+10 (secure 0 0 0) 0x7ff684058750 con 0x7ff68c15e840 2024-09-11T22:19:47.731 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-11T22:19:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.731+0000 7ff691fb9640 1 -- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff66c06be30 msgr2=0x7ff66c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.731+0000 7ff691fb9640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff66c06be30 0x7ff66c06e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff67c034000 tx=0x7ff67c02e000 comp rx=0 tx=0).stop 2024-09-11T22:19:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.731+0000 7ff691fb9640 1 -- 172.21.15.50:0/3512501444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68c15e840 msgr2=0x7ff68c1f8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.731+0000 7ff691fb9640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68c15e840 0x7ff68c1f8250 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c7a0 tx=0x7ff68400cc60 comp rx=0 tx=0).stop 2024-09-11T22:19:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.732+0000 7ff691fb9640 1 -- 172.21.15.50:0/3512501444 shutdown_connections 2024-09-11T22:19:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.732+0000 7ff691fb9640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff66c06be30 0x7ff66c06e2f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.732+0000 7ff691fb9640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff68c0cf580 0x7ff68c1f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.732+0000 7ff691fb9640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff68c15e840 0x7ff68c1f8250 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.732+0000 7ff691fb9640 1 --2- 172.21.15.50:0/3512501444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff68c0cdd50 0x7ff68c0b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.732+0000 7ff691fb9640 1 -- 172.21.15.50:0/3512501444 >> 172.21.15.50:0/3512501444 conn(0x7ff68c0b4150 msgr2=0x7ff68c06fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.732+0000 7ff691fb9640 1 -- 172.21.15.50:0/3512501444 shutdown_connections 2024-09-11T22:19:47.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.732+0000 7ff691fb9640 1 -- 172.21.15.50:0/3512501444 wait complete. 2024-09-11T22:19:47.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-11T22:19:47.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.846+0000 7fd2d894b640 1 Processor -- start 2024-09-11T22:19:47.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.846+0000 7fd2d894b640 1 -- start start 2024-09-11T22:19:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2d894b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d415e8e0 0x7fd2d40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2d894b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2d40d1580 0x7fd2d40d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2d894b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd2d4162350 0x7fd2d4162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2d894b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d415ecc0 con 0x7fd2d40d1580 2024-09-11T22:19:47.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2d894b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d40d2ad0 con 0x7fd2d4162350 2024-09-11T22:19:47.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2d894b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d40d3370 con 0x7fd2d415e8e0 2024-09-11T22:19:47.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2cbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2d40d1580 0x7fd2d40d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2cbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2d40d1580 0x7fd2d40d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48980/0 (socket says 172.21.15.50:48980) 2024-09-11T22:19:47.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2cbfff640 1 -- 172.21.15.50:0/875310379 learned_addr learned my addr 172.21.15.50:0/875310379 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:47.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2d2d9d640 1 --2- 172.21.15.50:0/875310379 >> v2:172.21.15.77:3300/0 conn(0x7fd2d4162350 0x7fd2d4162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2d259c640 1 --2- 172.21.15.50:0/875310379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d415e8e0 0x7fd2d40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2cbfff640 1 -- 172.21.15.50:0/875310379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d415e8e0 msgr2=0x7fd2d40b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:47.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2cbfff640 1 --2- 172.21.15.50:0/875310379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d415e8e0 0x7fd2d40b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2cbfff640 1 -- 172.21.15.50:0/875310379 >> v2:172.21.15.77:3300/0 conn(0x7fd2d4162350 msgr2=0x7fd2d4162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:47.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2cbfff640 1 --2- 172.21.15.50:0/875310379 >> v2:172.21.15.77:3300/0 conn(0x7fd2d4162350 0x7fd2d4162800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.847+0000 7fd2cbfff640 1 -- 172.21.15.50:0/875310379 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d40d1ee0 con 0x7fd2d40d1580 2024-09-11T22:19:47.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.848+0000 7fd2cbfff640 1 --2- 172.21.15.50:0/875310379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d40d1580 0x7fd2d40d19a0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40b76d0 tx=0x7fd2bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3470dccee9d4d77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:47.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.848+0000 7fd2d1d9b640 1 -- 172.21.15.50:0/875310379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc037070 con 0x7fd2d40d1580 2024-09-11T22:19:47.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.848+0000 7fd2d1d9b640 1 -- 172.21.15.50:0/875310379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2bc032440 con 0x7fd2d40d1580 2024-09-11T22:19:47.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.848+0000 7fd2d1d9b640 1 -- 172.21.15.50:0/875310379 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc032810 con 0x7fd2d40d1580 2024-09-11T22:19:47.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.849+0000 7fd2d894b640 1 -- 172.21.15.50:0/875310379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d40d1580 msgr2=0x7fd2d40d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.849+0000 7fd2d894b640 1 --2- 172.21.15.50:0/875310379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d40d1580 0x7fd2d40d19a0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40b76d0 tx=0x7fd2bc02a270 comp rx=0 tx=0).stop 2024-09-11T22:19:47.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.849+0000 7fd2d894b640 1 -- 172.21.15.50:0/875310379 shutdown_connections 2024-09-11T22:19:47.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.849+0000 7fd2d894b640 1 --2- 172.21.15.50:0/875310379 >> v2:172.21.15.77:3300/0 conn(0x7fd2d4162350 0x7fd2d4162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.849+0000 7fd2d894b640 1 --2- 172.21.15.50:0/875310379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d40d1580 0x7fd2d40d19a0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.849+0000 7fd2d894b640 1 --2- 172.21.15.50:0/875310379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d415e8e0 0x7fd2d40b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.849+0000 7fd2d894b640 1 -- 172.21.15.50:0/875310379 >> 172.21.15.50:0/875310379 conn(0x7fd2d4067ba0 msgr2=0x7fd2d4067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:47.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.849+0000 7fd2d894b640 1 -- 172.21.15.50:0/875310379 shutdown_connections 2024-09-11T22:19:47.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.849+0000 7fd2d894b640 1 -- 172.21.15.50:0/875310379 wait complete. 2024-09-11T22:19:47.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.850+0000 7fd2d894b640 1 Processor -- start 2024-09-11T22:19:47.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.850+0000 7fd2d894b640 1 -- start start 2024-09-11T22:19:47.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d894b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d40d1580 0x7fd2d40ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d894b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d415e8e0 0x7fd2d41f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d894b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d4162350 0x7fd2d415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d894b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d40d3000 con 0x7fd2d40d1580 2024-09-11T22:19:47.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d894b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d40d2d20 con 0x7fd2d415e8e0 2024-09-11T22:19:47.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d894b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d4162d40 con 0x7fd2d4162350 2024-09-11T22:19:47.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d40d1580 0x7fd2d40ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d40d1580 0x7fd2d40ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48984/0 (socket says 172.21.15.50:48984) 2024-09-11T22:19:47.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d259c640 1 -- 172.21.15.50:0/262170094 learned_addr learned my addr 172.21.15.50:0/262170094 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:47.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2cbfff640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d415e8e0 0x7fd2d41f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d2d9d640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d4162350 0x7fd2d415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d259c640 1 -- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d4162350 msgr2=0x7fd2d415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d259c640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d4162350 0x7fd2d415b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d259c640 1 -- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d415e8e0 msgr2=0x7fd2d41f8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:47.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d259c640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d415e8e0 0x7fd2d41f8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d259c640 1 -- 172.21.15.50:0/262170094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d40cce70 con 0x7fd2d40d1580 2024-09-11T22:19:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.851+0000 7fd2d259c640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d40d1580 0x7fd2d40ca9a0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400c7f0 tx=0x7fd2c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.852+0000 7fd2caffd640 1 -- 172.21.15.50:0/262170094 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4015070 con 0x7fd2d40d1580 2024-09-11T22:19:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.852+0000 7fd2caffd640 1 -- 172.21.15.50:0/262170094 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c4004220 con 0x7fd2d40d1580 2024-09-11T22:19:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.852+0000 7fd2d894b640 1 -- 172.21.15.50:0/262170094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d40cd150 con 0x7fd2d40d1580 2024-09-11T22:19:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.852+0000 7fd2caffd640 1 -- 172.21.15.50:0/262170094 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4007620 con 0x7fd2d40d1580 2024-09-11T22:19:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.852+0000 7fd2d894b640 1 -- 172.21.15.50:0/262170094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d41f8040 con 0x7fd2d40d1580 2024-09-11T22:19:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.853+0000 7fd2d894b640 1 -- 172.21.15.50:0/262170094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d40b7880 con 0x7fd2d40d1580 2024-09-11T22:19:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.853+0000 7fd2caffd640 1 -- 172.21.15.50:0/262170094 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2c40079d0 con 0x7fd2d40d1580 2024-09-11T22:19:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.854+0000 7fd2caffd640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2b406be30 0x7fd2b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:47.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.854+0000 7fd2caffd640 1 -- 172.21.15.50:0/262170094 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7fd2c408ab30 con 0x7fd2d40d1580 2024-09-11T22:19:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.854+0000 7fd2cbfff640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2b406be30 0x7fd2b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.854+0000 7fd2cbfff640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2b406be30 0x7fd2b406e2f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc034000 tx=0x7fd2bc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:47.858+0000 7fd2caffd640 1 -- 172.21.15.50:0/262170094 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2c4059190 con 0x7fd2d40d1580 2024-09-11T22:19:48.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:48.117+0000 7fd2d894b640 1 -- 172.21.15.50:0/262170094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7fd2d40ba770 con 0x7fd2d40d1580 2024-09-11T22:19:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.107+0000 7fd2caffd640 1 -- 172.21.15.50:0/262170094 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v418) ==== 169+0+0 (secure 0 0 0) 0x7fd2c405d490 con 0x7fd2d40d1580 2024-09-11T22:19:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.110+0000 7fd2d894b640 1 -- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2b406be30 msgr2=0x7fd2b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.110+0000 7fd2d894b640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2b406be30 0x7fd2b406e2f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc034000 tx=0x7fd2bc02e000 comp rx=0 tx=0).stop 2024-09-11T22:19:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.110+0000 7fd2d894b640 1 -- 172.21.15.50:0/262170094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d40d1580 msgr2=0x7fd2d40ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.110+0000 7fd2d894b640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d40d1580 0x7fd2d40ca9a0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400c7f0 tx=0x7fd2c400ccb0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.110+0000 7fd2d894b640 1 -- 172.21.15.50:0/262170094 shutdown_connections 2024-09-11T22:19:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.110+0000 7fd2d894b640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2b406be30 0x7fd2b406e2f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.110+0000 7fd2d894b640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2d4162350 0x7fd2d415b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.110+0000 7fd2d894b640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d415e8e0 0x7fd2d41f8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.110+0000 7fd2d894b640 1 --2- 172.21.15.50:0/262170094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2d40d1580 0x7fd2d40ca9a0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.110+0000 7fd2d894b640 1 -- 172.21.15.50:0/262170094 >> 172.21.15.50:0/262170094 conn(0x7fd2d4067ba0 msgr2=0x7fd2d415ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.110+0000 7fd2d894b640 1 -- 172.21.15.50:0/262170094 shutdown_connections 2024-09-11T22:19:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.110+0000 7fd2d894b640 1 -- 172.21.15.50:0/262170094 wait complete. 2024-09-11T22:19:49.125 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T22:19:49.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.236+0000 7f5c1b1e4640 1 Processor -- start 2024-09-11T22:19:49.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.236+0000 7f5c1b1e4640 1 -- start start 2024-09-11T22:19:49.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.237+0000 7f5c1b1e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5c140d18a0 0x7f5c140d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.237+0000 7f5c1b1e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c140d3a30 0x7f5c140b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.237+0000 7f5c1b1e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c140cfa80 con 0x7f5c1415e870 2024-09-11T22:19:49.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.237+0000 7f5c1b1e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5c140d3ea0 con 0x7f5c140d18a0 2024-09-11T22:19:49.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.237+0000 7f5c1b1e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5c140d40d0 con 0x7f5c140d3a30 2024-09-11T22:19:49.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.237+0000 7f5c13fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5c140d18a0 0x7f5c140d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.237+0000 7f5c19781640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c140d3a30 0x7f5c140b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.238+0000 7f5c13fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5c140d18a0 0x7f5c140d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:37046/0 (socket says 172.21.15.50:37046) 2024-09-11T22:19:49.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.238+0000 7f5c13fff640 1 -- 172.21.15.50:0/1591908041 learned_addr learned my addr 172.21.15.50:0/1591908041 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:49.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.238+0000 7f5c18f80640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5c1415e870 0x7f5c140d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:47456/0 (socket says 172.21.15.50:47456) 2024-09-11T22:19:49.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.238+0000 7f5c13fff640 1 -- 172.21.15.50:0/1591908041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c140d3a30 msgr2=0x7f5c140b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:49.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.238+0000 7f5c13fff640 1 --2- 172.21.15.50:0/1591908041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c140d3a30 0x7f5c140b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.238+0000 7f5c13fff640 1 -- 172.21.15.50:0/1591908041 >> v1:172.21.15.77:6789/0 conn(0x7f5c1415e870 legacy=0x7f5c140d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.238+0000 7f5c137fe640 1 -- 172.21.15.50:0/1591908041 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3804203418 0 0) 0x7f5c04001110 con 0x7f5c1415e870 2024-09-11T22:19:49.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.238+0000 7f5c13fff640 1 -- 172.21.15.50:0/1591908041 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c140d43b0 con 0x7f5c140d18a0 2024-09-11T22:19:49.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.239+0000 7f5c13fff640 1 --2- 172.21.15.50:0/1591908041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c140d18a0 0x7f5c140d34f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009870 tx=0x7f5c0802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91eed890e7df2e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:49.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.239+0000 7f5c137fe640 1 -- 172.21.15.50:0/1591908041 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08037070 con 0x7f5c140d18a0 2024-09-11T22:19:49.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.239+0000 7f5c137fe640 1 -- 172.21.15.50:0/1591908041 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c08032440 con 0x7f5c140d18a0 2024-09-11T22:19:49.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.239+0000 7f5c137fe640 1 -- 172.21.15.50:0/1591908041 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08032810 con 0x7f5c140d18a0 2024-09-11T22:19:49.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.239+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/1591908041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c140d18a0 msgr2=0x7f5c140d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.239+0000 7f5c1b1e4640 1 --2- 172.21.15.50:0/1591908041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c140d18a0 0x7f5c140d34f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009870 tx=0x7f5c0802a270 comp rx=0 tx=0).stop 2024-09-11T22:19:49.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.239+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/1591908041 shutdown_connections 2024-09-11T22:19:49.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.239+0000 7f5c1b1e4640 1 --2- 172.21.15.50:0/1591908041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c140d3a30 0x7f5c140b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.239+0000 7f5c1b1e4640 1 --2- 172.21.15.50:0/1591908041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c140d18a0 0x7f5c140d34f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.239+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/1591908041 >> 172.21.15.50:0/1591908041 conn(0x7f5c140727a0 msgr2=0x7f5c140679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:49.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.239+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/1591908041 shutdown_connections 2024-09-11T22:19:49.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.240+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/1591908041 wait complete. 2024-09-11T22:19:49.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.241+0000 7f5c1b1e4640 1 Processor -- start 2024-09-11T22:19:49.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.241+0000 7f5c1b1e4640 1 -- start start 2024-09-11T22:19:49.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c1b1e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c140d18a0 0x7f5c141f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c1b1e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c140d3a30 0x7f5c141f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c1b1e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c1415e870 0x7f5c140cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c1b1e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1415ec50 con 0x7f5c1415e870 2024-09-11T22:19:49.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c1b1e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5c140b7ee0 con 0x7f5c140d3a30 2024-09-11T22:19:49.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c1b1e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5c140b78b0 con 0x7f5c140d18a0 2024-09-11T22:19:49.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c19781640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c1415e870 0x7f5c140cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c19781640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c1415e870 0x7f5c140cc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48994/0 (socket says 172.21.15.50:48994) 2024-09-11T22:19:49.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c19781640 1 -- 172.21.15.50:0/2774149727 learned_addr learned my addr 172.21.15.50:0/2774149727 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:49.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c13fff640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c140d3a30 0x7f5c141f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c18f80640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c140d18a0 0x7f5c141f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c19781640 1 -- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c140d18a0 msgr2=0x7f5c141f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c19781640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c140d18a0 0x7f5c141f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c19781640 1 -- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c140d3a30 msgr2=0x7f5c141f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c19781640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c140d3a30 0x7f5c141f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c19781640 1 -- 172.21.15.50:0/2774149727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c14160190 con 0x7f5c1415e870 2024-09-11T22:19:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c18f80640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c140d18a0 0x7f5c141f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c19781640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c1415e870 0x7f5c140cc1f0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00efc0 tx=0x7f5c0c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.242+0000 7f5c117fa640 1 -- 172.21.15.50:0/2774149727 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c018020 con 0x7f5c1415e870 2024-09-11T22:19:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.243+0000 7f5c117fa640 1 -- 172.21.15.50:0/2774149727 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0c014480 con 0x7f5c1415e870 2024-09-11T22:19:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.243+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/2774149727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c14160470 con 0x7f5c1415e870 2024-09-11T22:19:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.243+0000 7f5c117fa640 1 -- 172.21.15.50:0/2774149727 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c014870 con 0x7f5c1415e870 2024-09-11T22:19:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.243+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/2774149727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c14160a30 con 0x7f5c1415e870 2024-09-11T22:19:49.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.244+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/2774149727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c140d34f0 con 0x7f5c1415e870 2024-09-11T22:19:49.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.244+0000 7f5c117fa640 1 -- 172.21.15.50:0/2774149727 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c0c005d10 con 0x7f5c1415e870 2024-09-11T22:19:49.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.244+0000 7f5c117fa640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5c0006be30 0x7f5c0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.245+0000 7f5c117fa640 1 -- 172.21.15.50:0/2774149727 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7f5c0c08b8c0 con 0x7f5c1415e870 2024-09-11T22:19:49.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.245+0000 7f5c18f80640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5c0006be30 0x7f5c0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.245+0000 7f5c18f80640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5c0006be30 0x7f5c0006e2f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5c04000f60 tx=0x7f5c04007a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:49.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.249+0000 7f5c117fa640 1 -- 172.21.15.50:0/2774149727 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c0c022030 con 0x7f5c1415e870 2024-09-11T22:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.426+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/2774149727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5c14068670 con 0x7f5c1415e870 2024-09-11T22:19:49.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.429+0000 7f5c117fa640 1 -- 172.21.15.50:0/2774149727 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f5c0c010040 con 0x7f5c1415e870 2024-09-11T22:19:49.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.431+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5c0006be30 msgr2=0x7f5c0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.431+0000 7f5c1b1e4640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5c0006be30 0x7f5c0006e2f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5c04000f60 tx=0x7f5c04007a30 comp rx=0 tx=0).stop 2024-09-11T22:19:49.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.431+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/2774149727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c1415e870 msgr2=0x7f5c140cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.431+0000 7f5c1b1e4640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c1415e870 0x7f5c140cc1f0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00efc0 tx=0x7f5c0c00c490 comp rx=0 tx=0).stop 2024-09-11T22:19:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.432+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/2774149727 shutdown_connections 2024-09-11T22:19:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.432+0000 7f5c1b1e4640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5c0006be30 0x7f5c0006e2f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.432+0000 7f5c1b1e4640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c1415e870 0x7f5c140cc1f0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.432+0000 7f5c1b1e4640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c140d3a30 0x7f5c141f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.432+0000 7f5c1b1e4640 1 --2- 172.21.15.50:0/2774149727 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c140d18a0 0x7f5c141f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.432+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/2774149727 >> 172.21.15.50:0/2774149727 conn(0x7f5c140727a0 msgr2=0x7f5c140ca330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.432+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/2774149727 shutdown_connections 2024-09-11T22:19:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.432+0000 7f5c1b1e4640 1 -- 172.21.15.50:0/2774149727 wait complete. 2024-09-11T22:19:49.444 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:19:49.444 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:19:49.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:19:49.544 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:19:49.545 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:19:49.545 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:19:49.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:19:49.562 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:19:49.562 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:19:49.580 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:19:49.580 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:19:49.580 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:19:49.617 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:19:49.618 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:19:49.618 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:19:49.637 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:19:49.637 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T22:19:49.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.758+0000 7f0a05ffd640 1 Processor -- start 2024-09-11T22:19:49.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.758+0000 7f0a05ffd640 1 -- start start 2024-09-11T22:19:49.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.759+0000 7f0a05ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a0015fb60 0x7f0a000b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.759+0000 7f0a05ffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a000d0150 0x7f0a000d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.759+0000 7f0a05ffd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a000d1290 con 0x7f0a000d0e00 2024-09-11T22:19:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.759+0000 7f0a05ffd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0a000cf510 con 0x7f0a0015fb60 2024-09-11T22:19:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.759+0000 7f0a05ffd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0a000cfdb0 con 0x7f0a000d0150 2024-09-11T22:19:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.759+0000 7f09ff7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a0015fb60 0x7f0a000b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.759+0000 7f09ff7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a0015fb60 0x7f0a000b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49010/0 (socket says 172.21.15.50:49010) 2024-09-11T22:19:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.760+0000 7f09ff7fe640 1 -- 172.21.15.50:0/662317887 learned_addr learned my addr 172.21.15.50:0/662317887 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.760+0000 7f09feffd640 1 --2- 172.21.15.50:0/662317887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a000d0150 0x7f0a000d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.760+0000 7f09ff7fe640 1 -- 172.21.15.50:0/662317887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a000d0150 msgr2=0x7f0a000d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.760+0000 7f09ff7fe640 1 --2- 172.21.15.50:0/662317887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a000d0150 0x7f0a000d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.760+0000 7f09ff7fe640 1 -- 172.21.15.50:0/662317887 >> v1:172.21.15.77:6789/0 conn(0x7f0a000d0e00 legacy=0x7f0a000cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.760+0000 7f09ff7fe640 1 -- 172.21.15.50:0/662317887 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a0015ff40 con 0x7f0a0015fb60 2024-09-11T22:19:49.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.760+0000 7f09ff7fe640 1 --2- 172.21.15.50:0/662317887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0015fb60 0x7f0a000b4c70 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009870 tx=0x7f09f002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81bdd31d23e92e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.761+0000 7f09fe7fc640 1 -- 172.21.15.50:0/662317887 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0037070 con 0x7f0a0015fb60 2024-09-11T22:19:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.761+0000 7f09fe7fc640 1 -- 172.21.15.50:0/662317887 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f0032440 con 0x7f0a0015fb60 2024-09-11T22:19:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.761+0000 7f09fe7fc640 1 -- 172.21.15.50:0/662317887 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0032810 con 0x7f0a0015fb60 2024-09-11T22:19:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.761+0000 7f0a05ffd640 1 -- 172.21.15.50:0/662317887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0015fb60 msgr2=0x7f0a000b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.761+0000 7f0a05ffd640 1 --2- 172.21.15.50:0/662317887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0015fb60 0x7f0a000b4c70 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009870 tx=0x7f09f002a1c0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.761+0000 7f0a05ffd640 1 -- 172.21.15.50:0/662317887 shutdown_connections 2024-09-11T22:19:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.761+0000 7f0a05ffd640 1 --2- 172.21.15.50:0/662317887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a000d0150 0x7f0a000d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.761+0000 7f0a05ffd640 1 --2- 172.21.15.50:0/662317887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0015fb60 0x7f0a000b4c70 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.761+0000 7f0a05ffd640 1 -- 172.21.15.50:0/662317887 >> 172.21.15.50:0/662317887 conn(0x7f0a000b4150 msgr2=0x7f0a000b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.761+0000 7f0a05ffd640 1 -- 172.21.15.50:0/662317887 shutdown_connections 2024-09-11T22:19:49.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.761+0000 7f0a05ffd640 1 -- 172.21.15.50:0/662317887 wait complete. 2024-09-11T22:19:49.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.762+0000 7f0a05ffd640 1 Processor -- start 2024-09-11T22:19:49.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.763+0000 7f0a05ffd640 1 -- start start 2024-09-11T22:19:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.763+0000 7f0a05ffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a000d0e00 0x7f0a000b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.763+0000 7f0a05ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0015fb60 0x7f0a00155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.763+0000 7f0a05ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a000c5dc0 0x7f0a001e9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.763+0000 7f0a05ffd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0a000cfa40 con 0x7f0a0015fb60 2024-09-11T22:19:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.763+0000 7f0a05ffd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0a000cf760 con 0x7f0a000c5dc0 2024-09-11T22:19:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.763+0000 7f0a05ffd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0a000b1930 con 0x7f0a000d0e00 2024-09-11T22:19:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09feffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0015fb60 0x7f0a00155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09feffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0015fb60 0x7f0a00155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49024/0 (socket says 172.21.15.50:49024) 2024-09-11T22:19:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09feffd640 1 -- 172.21.15.50:0/3439669041 learned_addr learned my addr 172.21.15.50:0/3439669041 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09ff7fe640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a000d0e00 0x7f0a000b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09fffff640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a000c5dc0 0x7f0a001e9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09feffd640 1 -- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a000d0e00 msgr2=0x7f0a000b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09feffd640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a000d0e00 0x7f0a000b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09feffd640 1 -- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a000c5dc0 msgr2=0x7f0a001e9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09feffd640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a000c5dc0 0x7f0a001e9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09feffd640 1 -- 172.21.15.50:0/3439669041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a00155b40 con 0x7f0a0015fb60 2024-09-11T22:19:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09feffd640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0015fb60 0x7f0a00155600 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f09f400e870 tx=0x7f09f400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09e7fff640 1 -- 172.21.15.50:0/3439669041 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f4017070 con 0x7f0a0015fb60 2024-09-11T22:19:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09e7fff640 1 -- 172.21.15.50:0/3439669041 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f400ee60 con 0x7f0a0015fb60 2024-09-11T22:19:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f0a05ffd640 1 -- 172.21.15.50:0/3439669041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a000b5f60 con 0x7f0a0015fb60 2024-09-11T22:19:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f09e7fff640 1 -- 172.21.15.50:0/3439669041 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f400cb60 con 0x7f0a0015fb60 2024-09-11T22:19:49.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.764+0000 7f0a05ffd640 1 -- 172.21.15.50:0/3439669041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a0006bda0 con 0x7f0a0015fb60 2024-09-11T22:19:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.765+0000 7f0a05ffd640 1 -- 172.21.15.50:0/3439669041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a000d08c0 con 0x7f0a0015fb60 2024-09-11T22:19:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.766+0000 7f09e7fff640 1 -- 172.21.15.50:0/3439669041 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09f401a070 con 0x7f0a0015fb60 2024-09-11T22:19:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.766+0000 7f09e7fff640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f09ec06be30 0x7f09ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.766+0000 7f09e7fff640 1 -- 172.21.15.50:0/3439669041 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7f09f408aa00 con 0x7f0a0015fb60 2024-09-11T22:19:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.767+0000 7f09ff7fe640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f09ec06be30 0x7f09ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:49.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.767+0000 7f09ff7fe640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f09ec06be30 0x7f09ec06e2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f09f0034000 tx=0x7f09f002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:49.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.771+0000 7f09e7fff640 1 -- 172.21.15.50:0/3439669041 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a00155b40 con 0x7f0a0015fb60 2024-09-11T22:19:49.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.982+0000 7f0a05ffd640 1 -- 172.21.15.50:0/3439669041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a000b4cf0 con 0x7f0a0015fb60 2024-09-11T22:19:49.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.983+0000 7f09e7fff640 1 -- 172.21.15.50:0/3439669041 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+3911 (secure 0 0 0) 0x7f09f4058fc0 con 0x7f0a0015fb60 2024-09-11T22:19:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:49.984 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":96,"btime":"2024-09-11T22:19:43:987421+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2712907764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2712907764},{"type":"v1","addr":"172.21.15.77:6835","nonce":2712907764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3174101067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3174101067},{"type":"v1","addr":"172.21.15.77:6837","nonce":3174101067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3237081993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3237081993},{"type":"v1","addr":"172.21.15.50:6833","nonce":3237081993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":8826,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2632460351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2632460351},{"type":"v1","addr":"172.21.15.50:6835","nonce":2632460351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[]} 2024-09-11T22:19:49.984 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 96 2024-09-11T22:19:49.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.985+0000 7f0a05ffd640 1 -- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f09ec06be30 msgr2=0x7f09ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.985+0000 7f0a05ffd640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f09ec06be30 0x7f09ec06e2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f09f0034000 tx=0x7f09f002e000 comp rx=0 tx=0).stop 2024-09-11T22:19:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.985+0000 7f0a05ffd640 1 -- 172.21.15.50:0/3439669041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0015fb60 msgr2=0x7f0a00155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.985+0000 7f0a05ffd640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0015fb60 0x7f0a00155600 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f09f400e870 tx=0x7f09f400ed30 comp rx=0 tx=0).stop 2024-09-11T22:19:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.985+0000 7f0a05ffd640 1 -- 172.21.15.50:0/3439669041 shutdown_connections 2024-09-11T22:19:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.985+0000 7f0a05ffd640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f09ec06be30 0x7f09ec06e2f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.985+0000 7f0a05ffd640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a000c5dc0 0x7f0a001e9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.985+0000 7f0a05ffd640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a0015fb60 0x7f0a00155600 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.985+0000 7f0a05ffd640 1 --2- 172.21.15.50:0/3439669041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a000d0e00 0x7f0a000b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.985+0000 7f0a05ffd640 1 -- 172.21.15.50:0/3439669041 >> 172.21.15.50:0/3439669041 conn(0x7f0a000b4150 msgr2=0x7f0a000b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.985+0000 7f0a05ffd640 1 -- 172.21.15.50:0/3439669041 shutdown_connections 2024-09-11T22:19:49.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:49.985+0000 7f0a05ffd640 1 -- 172.21.15.50:0/3439669041 wait complete. 2024-09-11T22:19:49.997 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:19:49.997 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T22:19:49.997 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:19:49.997 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:19:49.997 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:19:49.998 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T22:19:49.998 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:19:49.998 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:19:49.998 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:19:49.998 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T22:19:49.998 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:19:49.998 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:19:49.999 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:19:49.999 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T22:19:49.999 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:19:49.999 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:19:50.011 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:19:50.012 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:19:50.013 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:19:50.013 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:19:50.014 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:19:50.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:19:50.014 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:19:50.015 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:19:50.054 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:19:50.054 DEBUG:teuthology.parallel:result is None 2024-09-11T22:19:50.055 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:19:50.055 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:19:50.055 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:19:50.056 DEBUG:teuthology.parallel:result is None 2024-09-11T22:19:50.056 DEBUG:teuthology.parallel:result is None 2024-09-11T22:19:50.056 DEBUG:teuthology.parallel:result is None 2024-09-11T22:19:50.056 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T22:19:50.132 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:19:50.133 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:19:50.138 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:19:50.139 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:19:50.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.164+0000 7fb1f4b49640 1 Processor -- start 2024-09-11T22:19:50.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.164+0000 7fb1f4b49640 1 -- start start 2024-09-11T22:19:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1f4b49640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1f015aad0 0x7fb1f0072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1f4b49640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f00b5020 con 0x7fb1f006d780 2024-09-11T22:19:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1f4b49640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f015aeb0 con 0x7fb1f015bb00 2024-09-11T22:19:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1f4b49640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f00714d0 con 0x7fb1f015aad0 2024-09-11T22:19:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1eed9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb1f006d780 0x7fb1f00b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34090/0 (socket says 172.21.15.50:34090) 2024-09-11T22:19:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1eed9d640 1 -- 172.21.15.50:0/829053139 learned_addr learned my addr 172.21.15.50:0/829053139 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1ee59c640 1 --2- 172.21.15.50:0/829053139 >> v2:172.21.15.77:3300/0 conn(0x7fb1f015aad0 0x7fb1f0072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1ed59a640 1 -- 172.21.15.50:0/829053139 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2021107488 0 0) 0x7fb1f00b5020 con 0x7fb1f006d780 2024-09-11T22:19:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1ed59a640 1 -- 172.21.15.50:0/829053139 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1d8003520 con 0x7fb1f006d780 2024-09-11T22:19:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1ed59a640 1 -- 172.21.15.50:0/829053139 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 480053569 0 0) 0x7fb1f015aeb0 con 0x7fb1f015bb00 2024-09-11T22:19:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1ed59a640 1 -- 172.21.15.50:0/829053139 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f00b5020 con 0x7fb1f015bb00 2024-09-11T22:19:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1ee59c640 1 -- 172.21.15.50:0/829053139 >> v1:172.21.15.77:6789/0 conn(0x7fb1f015bb00 legacy=0x7fb1f006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1ee59c640 1 -- 172.21.15.50:0/829053139 >> v1:172.21.15.50:6789/0 conn(0x7fb1f006d780 legacy=0x7fb1f00b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.165+0000 7fb1ee59c640 1 -- 172.21.15.50:0/829053139 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f00717b0 con 0x7fb1f015aad0 2024-09-11T22:19:50.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.166+0000 7fb1ee59c640 1 --2- 172.21.15.50:0/829053139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f015aad0 0x7fb1f0072cb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000a940 tx=0x7fb1e002a4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf3eb7c9004a06 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:50.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.166+0000 7fb1ed59a640 1 -- 172.21.15.50:0/829053139 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e000b040 con 0x7fb1f015aad0 2024-09-11T22:19:50.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.166+0000 7fb1ed59a640 1 -- 172.21.15.50:0/829053139 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e002f710 con 0x7fb1f015aad0 2024-09-11T22:19:50.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.166+0000 7fb1ed59a640 1 -- 172.21.15.50:0/829053139 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e002fae0 con 0x7fb1f015aad0 2024-09-11T22:19:50.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.167+0000 7fb1f4b49640 1 -- 172.21.15.50:0/829053139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f015aad0 msgr2=0x7fb1f0072cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:50.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.167+0000 7fb1f4b49640 1 --2- 172.21.15.50:0/829053139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f015aad0 0x7fb1f0072cb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000a940 tx=0x7fb1e002a4d0 comp rx=0 tx=0).stop 2024-09-11T22:19:50.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.167+0000 7fb1f4b49640 1 -- 172.21.15.50:0/829053139 shutdown_connections 2024-09-11T22:19:50.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.167+0000 7fb1f4b49640 1 --2- 172.21.15.50:0/829053139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f015aad0 0x7fb1f0072cb0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:50.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.167+0000 7fb1f4b49640 1 -- 172.21.15.50:0/829053139 >> 172.21.15.50:0/829053139 conn(0x7fb1f00679c0 msgr2=0x7fb1f0067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:50.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.167+0000 7fb1f4b49640 1 -- 172.21.15.50:0/829053139 shutdown_connections 2024-09-11T22:19:50.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.167+0000 7fb1f4b49640 1 -- 172.21.15.50:0/829053139 wait complete. 2024-09-11T22:19:50.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.168+0000 7fb1f4b49640 1 Processor -- start 2024-09-11T22:19:50.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.168+0000 7fb1f4b49640 1 -- start start 2024-09-11T22:19:50.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1f4b49640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f006d780 0x7fb1f0152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:50.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1f4b49640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f015aad0 0x7fb1f00c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:50.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1f4b49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015bb00 0x7fb1f00acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:50.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1f4b49640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f015bf50 con 0x7fb1f015bb00 2024-09-11T22:19:50.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1f4b49640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f0071d70 con 0x7fb1f006d780 2024-09-11T22:19:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1f4b49640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f0072290 con 0x7fb1f015aad0 2024-09-11T22:19:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1eed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015bb00 0x7fb1f00acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1eed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015bb00 0x7fb1f00acf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49044/0 (socket says 172.21.15.50:49044) 2024-09-11T22:19:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1eed9d640 1 -- 172.21.15.50:0/3077069315 learned_addr learned my addr 172.21.15.50:0/3077069315 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1ee59c640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f006d780 0x7fb1f0152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1edd9b640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f015aad0 0x7fb1f00c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1eed9d640 1 -- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f015aad0 msgr2=0x7fb1f00c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1eed9d640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f015aad0 0x7fb1f00c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.169+0000 7fb1eed9d640 1 -- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f006d780 msgr2=0x7fb1f0152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.170+0000 7fb1eed9d640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f006d780 0x7fb1f0152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.170+0000 7fb1eed9d640 1 -- 172.21.15.50:0/3077069315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f00c9e00 con 0x7fb1f015bb00 2024-09-11T22:19:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.170+0000 7fb1edd9b640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f015aad0 0x7fb1f00c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.170+0000 7fb1eed9d640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015bb00 0x7fb1f00acf70 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800cbf0 tx=0x7fb1e800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:50.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.170+0000 7fb1deffd640 1 -- 172.21.15.50:0/3077069315 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8017070 con 0x7fb1f015bb00 2024-09-11T22:19:50.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.170+0000 7fb1deffd640 1 -- 172.21.15.50:0/3077069315 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e800acf0 con 0x7fb1f015bb00 2024-09-11T22:19:50.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.170+0000 7fb1f4b49640 1 -- 172.21.15.50:0/3077069315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f00ca0e0 con 0x7fb1f015bb00 2024-09-11T22:19:50.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.170+0000 7fb1deffd640 1 -- 172.21.15.50:0/3077069315 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8012600 con 0x7fb1f015bb00 2024-09-11T22:19:50.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.171+0000 7fb1f4b49640 1 -- 172.21.15.50:0/3077069315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f00ca6a0 con 0x7fb1f015bb00 2024-09-11T22:19:50.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.171+0000 7fb1f4b49640 1 -- 172.21.15.50:0/3077069315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f0072cb0 con 0x7fb1f015bb00 2024-09-11T22:19:50.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.171+0000 7fb1deffd640 1 -- 172.21.15.50:0/3077069315 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb1e801a070 con 0x7fb1f015bb00 2024-09-11T22:19:50.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.172+0000 7fb1deffd640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1d006be60 0x7fb1d006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:50.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.172+0000 7fb1deffd640 1 -- 172.21.15.50:0/3077069315 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7fb1e808a7e0 con 0x7fb1f015bb00 2024-09-11T22:19:50.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.172+0000 7fb1ee59c640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1d006be60 0x7fb1d006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:50.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.173+0000 7fb1ee59c640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1d006be60 0x7fb1d006e320 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0034000 tx=0x7fb1e000c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:50.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.176+0000 7fb1deffd640 1 -- 172.21.15.50:0/3077069315 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb1e8058ed0 con 0x7fb1f015bb00 2024-09-11T22:19:50.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:50.362+0000 7fb1f4b49640 1 -- 172.21.15.50:0/3077069315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb1f00b49c0 con 0x7fb1f015bb00 2024-09-11T22:19:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.457+0000 7fb1deffd640 1 -- 172.21.15.50:0/3077069315 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v140) ==== 97+0+0 (secure 0 0 0) 0x7fb1e805d1d0 con 0x7fb1f015bb00 2024-09-11T22:19:51.458 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-11T22:19:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.460+0000 7fb1f4b49640 1 -- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1d006be60 msgr2=0x7fb1d006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.460+0000 7fb1f4b49640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1d006be60 0x7fb1d006e320 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0034000 tx=0x7fb1e000c040 comp rx=0 tx=0).stop 2024-09-11T22:19:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.460+0000 7fb1f4b49640 1 -- 172.21.15.50:0/3077069315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015bb00 msgr2=0x7fb1f00acf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.460+0000 7fb1f4b49640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015bb00 0x7fb1f00acf70 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800cbf0 tx=0x7fb1e800a430 comp rx=0 tx=0).stop 2024-09-11T22:19:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.460+0000 7fb1f4b49640 1 -- 172.21.15.50:0/3077069315 shutdown_connections 2024-09-11T22:19:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.460+0000 7fb1f4b49640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1d006be60 0x7fb1d006e320 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.460+0000 7fb1f4b49640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1f015aad0 0x7fb1f00c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.460+0000 7fb1f4b49640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1f015bb00 0x7fb1f00acf70 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.460+0000 7fb1f4b49640 1 --2- 172.21.15.50:0/3077069315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f006d780 0x7fb1f0152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.460+0000 7fb1f4b49640 1 -- 172.21.15.50:0/3077069315 >> 172.21.15.50:0/3077069315 conn(0x7fb1f00679c0 msgr2=0x7fb1f00cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.460+0000 7fb1f4b49640 1 -- 172.21.15.50:0/3077069315 shutdown_connections 2024-09-11T22:19:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.460+0000 7fb1f4b49640 1 -- 172.21.15.50:0/3077069315 wait complete. 2024-09-11T22:19:51.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T22:19:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.583+0000 7fd4eec8d640 1 Processor -- start 2024-09-11T22:19:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.583+0000 7fd4eec8d640 1 -- start start 2024-09-11T22:19:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eec8d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4e8161d30 0x7fd4e80cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eec8d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4e80b78f0 0x7fd4e8162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eec8d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4e80d11d0 0x7fd4e80d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eec8d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e80d1b80 con 0x7fd4e8161d30 2024-09-11T22:19:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eec8d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e80d3450 con 0x7fd4e80b78f0 2024-09-11T22:19:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eec8d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e81632e0 con 0x7fd4e80d11d0 2024-09-11T22:19:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eca29640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4e8161d30 0x7fd4e80cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eca29640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4e8161d30 0x7fd4e80cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49046/0 (socket says 172.21.15.50:49046) 2024-09-11T22:19:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eca29640 1 -- 172.21.15.50:0/3440905131 learned_addr learned my addr 172.21.15.50:0/3440905131 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4ed22a640 1 --2- 172.21.15.50:0/3440905131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4e80d11d0 0x7fd4e80d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4dffff640 1 --2- 172.21.15.50:0/3440905131 >> v2:172.21.15.77:3300/0 conn(0x7fd4e80b78f0 0x7fd4e8162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eca29640 1 -- 172.21.15.50:0/3440905131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4e80d11d0 msgr2=0x7fd4e80d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eca29640 1 --2- 172.21.15.50:0/3440905131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4e80d11d0 0x7fd4e80d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eca29640 1 -- 172.21.15.50:0/3440905131 >> v2:172.21.15.77:3300/0 conn(0x7fd4e80b78f0 msgr2=0x7fd4e8162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eca29640 1 --2- 172.21.15.50:0/3440905131 >> v2:172.21.15.77:3300/0 conn(0x7fd4e80b78f0 0x7fd4e8162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4eca29640 1 -- 172.21.15.50:0/3440905131 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e8162110 con 0x7fd4e8161d30 2024-09-11T22:19:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.584+0000 7fd4ed22a640 1 --2- 172.21.15.50:0/3440905131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4e80d11d0 0x7fd4e80d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.585+0000 7fd4eca29640 1 --2- 172.21.15.50:0/3440905131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4e8161d30 0x7fd4e80cf790 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8068730 tx=0x7fd4e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2601804bc39b55 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.585+0000 7fd4df7fe640 1 -- 172.21.15.50:0/3440905131 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4037070 con 0x7fd4e8161d30 2024-09-11T22:19:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.585+0000 7fd4df7fe640 1 -- 172.21.15.50:0/3440905131 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e4032440 con 0x7fd4e8161d30 2024-09-11T22:19:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.585+0000 7fd4df7fe640 1 -- 172.21.15.50:0/3440905131 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4032810 con 0x7fd4e8161d30 2024-09-11T22:19:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.586+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3440905131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4e8161d30 msgr2=0x7fd4e80cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.586+0000 7fd4eec8d640 1 --2- 172.21.15.50:0/3440905131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4e8161d30 0x7fd4e80cf790 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8068730 tx=0x7fd4e402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.586+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3440905131 shutdown_connections 2024-09-11T22:19:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.586+0000 7fd4eec8d640 1 --2- 172.21.15.50:0/3440905131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4e80d11d0 0x7fd4e80d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.586+0000 7fd4eec8d640 1 --2- 172.21.15.50:0/3440905131 >> v2:172.21.15.77:3300/0 conn(0x7fd4e80b78f0 0x7fd4e8162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.586+0000 7fd4eec8d640 1 --2- 172.21.15.50:0/3440905131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4e8161d30 0x7fd4e80cf790 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.586+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3440905131 >> 172.21.15.50:0/3440905131 conn(0x7fd4e80727a0 msgr2=0x7fd4e80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:51.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.586+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3440905131 shutdown_connections 2024-09-11T22:19:51.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.586+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3440905131 wait complete. 2024-09-11T22:19:51.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.587+0000 7fd4eec8d640 1 Processor -- start 2024-09-11T22:19:51.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.587+0000 7fd4eec8d640 1 -- start start 2024-09-11T22:19:51.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4eec8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4e80b78f0 0x7fd4e80c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:51.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4eec8d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4e80d11d0 0x7fd4e80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:51.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4eec8d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4e8161d30 0x7fd4e80b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4eec8d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e80d2e00 con 0x7fd4e8161d30 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4eec8d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e80d2b20 con 0x7fd4e80b78f0 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4eec8d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e80d30e0 con 0x7fd4e80d11d0 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4ed22a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4e8161d30 0x7fd4e80b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4ed22a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4e8161d30 0x7fd4e80b65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49054/0 (socket says 172.21.15.50:49054) 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4ed22a640 1 -- 172.21.15.50:0/3903520080 learned_addr learned my addr 172.21.15.50:0/3903520080 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4eca29640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4e80b78f0 0x7fd4e80c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4dffff640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4e80d11d0 0x7fd4e80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4ed22a640 1 -- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4e80d11d0 msgr2=0x7fd4e80b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4ed22a640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4e80d11d0 0x7fd4e80b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4ed22a640 1 -- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4e80b78f0 msgr2=0x7fd4e80c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4ed22a640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4e80b78f0 0x7fd4e80c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.588+0000 7fd4ed22a640 1 -- 172.21.15.50:0/3903520080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e81f8760 con 0x7fd4e8161d30 2024-09-11T22:19:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.589+0000 7fd4ed22a640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4e8161d30 0x7fd4e80b65d0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0007f20 tx=0x7fd4e000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.589+0000 7fd4dd7fa640 1 -- 172.21.15.50:0/3903520080 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e001a070 con 0x7fd4e8161d30 2024-09-11T22:19:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.589+0000 7fd4dd7fa640 1 -- 172.21.15.50:0/3903520080 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e0003b90 con 0x7fd4e8161d30 2024-09-11T22:19:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.589+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3903520080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e81f8a40 con 0x7fd4e8161d30 2024-09-11T22:19:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.589+0000 7fd4dd7fa640 1 -- 172.21.15.50:0/3903520080 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0004030 con 0x7fd4e8161d30 2024-09-11T22:19:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.589+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3903520080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e81f9000 con 0x7fd4e8161d30 2024-09-11T22:19:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.590+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3903520080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e80b7d60 con 0x7fd4e8161d30 2024-09-11T22:19:51.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.590+0000 7fd4dd7fa640 1 -- 172.21.15.50:0/3903520080 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4e001d070 con 0x7fd4e8161d30 2024-09-11T22:19:51.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.591+0000 7fd4dd7fa640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4d406be30 0x7fd4d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:51.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.591+0000 7fd4dd7fa640 1 -- 172.21.15.50:0/3903520080 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 4857+0+0 (secure 0 0 0) 0x7fd4e008adb0 con 0x7fd4e8161d30 2024-09-11T22:19:51.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.591+0000 7fd4eca29640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4d406be30 0x7fd4d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:51.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.592+0000 7fd4eca29640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4d406be30 0x7fd4d406e2f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4034000 tx=0x7fd4e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:51.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.596+0000 7fd4dd7fa640 1 -- 172.21.15.50:0/3903520080 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4e0010070 con 0x7fd4e8161d30 2024-09-11T22:19:51.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.836+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3903520080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd4e80b3880 con 0x7fd4e8161d30 2024-09-11T22:19:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.836+0000 7fd4dd7fa640 1 -- 172.21.15.50:0/3903520080 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7fd4e0059b40 con 0x7fd4e8161d30 2024-09-11T22:19:51.837 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:51.837 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:19:51.837 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-11T22:19:51.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.838 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-11T22:19:51.838 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w==", 2024-09-11T22:19:51.838 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.838 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:51.838 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:19:51.838 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:19:51.838 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.838 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-11T22:19:51.838 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg==", 2024-09-11T22:19:51.838 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ==", 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:19:51.839 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.840 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.840 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-11T22:19:51.840 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw==", 2024-09-11T22:19:51.840 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.840 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:51.840 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:19:51.840 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:19:51.840 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.840 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg==", 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ==", 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:51.841 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:51.842 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.842 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.842 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-11T22:19:51.842 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg==", 2024-09-11T22:19:51.843 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.843 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:51.843 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:51.843 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.843 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.843 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-11T22:19:51.843 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg==", 2024-09-11T22:19:51.843 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.843 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:51.843 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:51.843 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A==", 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-11T22:19:51.844 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw==", 2024-09-11T22:19:51.845 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.845 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:51.845 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:51.845 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.845 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-11T22:19:51.845 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A==", 2024-09-11T22:19:51.845 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.845 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:51.845 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:51.846 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.846 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.846 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-11T22:19:51.846 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw==", 2024-09-11T22:19:51.846 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.846 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:19:51.846 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:19:51.846 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.846 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-11T22:19:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew==", 2024-09-11T22:19:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-11T22:19:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T22:19:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-11T22:19:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw==", 2024-09-11T22:19:51.847 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.848 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:51.848 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:19:51.849 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:19:51.849 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:19:51.849 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.850 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-11T22:19:51.850 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg==", 2024-09-11T22:19:51.850 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.850 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:51.850 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:19:51.850 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:19:51.850 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:19:51.850 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.850 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-11T22:19:51.850 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw==", 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBFFeJmAq9+OBAAANc9KfDvm3+wt/uED7WCvA==", 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:19:51.851 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:19:51.852 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.852 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.852 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-11T22:19:51.852 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g==", 2024-09-11T22:19:51.852 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.852 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:19:51.852 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:19:51.852 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.852 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:19:51.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:51.853 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-11T22:19:51.853 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg==", 2024-09-11T22:19:51.853 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:19:51.853 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:19:51.853 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:19:51.853 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:19:51.853 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.853 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:51.853 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-11T22:19:51.853 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:19:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.838+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4d406be30 msgr2=0x7fd4d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.838+0000 7fd4eec8d640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4d406be30 0x7fd4d406e2f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4034000 tx=0x7fd4e402e000 comp rx=0 tx=0).stop 2024-09-11T22:19:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.838+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3903520080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4e8161d30 msgr2=0x7fd4e80b65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.838+0000 7fd4eec8d640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4e8161d30 0x7fd4e80b65d0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0007f20 tx=0x7fd4e000d560 comp rx=0 tx=0).stop 2024-09-11T22:19:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.838+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3903520080 shutdown_connections 2024-09-11T22:19:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.838+0000 7fd4eec8d640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4d406be30 0x7fd4d406e2f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.838+0000 7fd4eec8d640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4e80d11d0 0x7fd4e80b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.838+0000 7fd4eec8d640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4e8161d30 0x7fd4e80b65d0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.838+0000 7fd4eec8d640 1 --2- 172.21.15.50:0/3903520080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4e80b78f0 0x7fd4e80c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.838+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3903520080 >> 172.21.15.50:0/3903520080 conn(0x7fd4e80727a0 msgr2=0x7fd4e80cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:51.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.838+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3903520080 shutdown_connections 2024-09-11T22:19:51.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.838+0000 7fd4eec8d640 1 -- 172.21.15.50:0/3903520080 wait complete. 2024-09-11T22:19:51.856 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:19:51.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.958+0000 7f890e3e4640 1 Processor -- start 2024-09-11T22:19:51.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.958+0000 7f890e3e4640 1 -- start start 2024-09-11T22:19:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.959+0000 7f890e3e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f890815c510 0x7f890806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.959+0000 7f890e3e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89080680d0 0x7f890815c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:51.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.959+0000 7f890e3e4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f890806ec90 con 0x7f890806e730 2024-09-11T22:19:51.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.959+0000 7f890e3e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f890806ef70 con 0x7f890815c510 2024-09-11T22:19:51.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.959+0000 7f890e3e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f890806f250 con 0x7f89080680d0 2024-09-11T22:19:51.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.959+0000 7f89077fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f890806e730 0x7f89080679c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34094/0 (socket says 172.21.15.50:34094) 2024-09-11T22:19:51.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.959+0000 7f89077fe640 1 -- 172.21.15.50:0/1645110161 learned_addr learned my addr 172.21.15.50:0/1645110161 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:51.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.959+0000 7f890c981640 1 --2- 172.21.15.50:0/1645110161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89080680d0 0x7f890815c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:51.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.959+0000 7f8907fff640 1 --2- 172.21.15.50:0/1645110161 >> v2:172.21.15.77:3300/0 conn(0x7f890815c510 0x7f890806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:51.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.959+0000 7f8906ffd640 1 -- 172.21.15.50:0/1645110161 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 657673596 0 0) 0x7f890806ec90 con 0x7f890806e730 2024-09-11T22:19:51.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.960+0000 7f8906ffd640 1 -- 172.21.15.50:0/1645110161 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88f0003520 con 0x7f890806e730 2024-09-11T22:19:51.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.960+0000 7f890c981640 1 -- 172.21.15.50:0/1645110161 >> v2:172.21.15.77:3300/0 conn(0x7f890815c510 msgr2=0x7f890806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:51.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.960+0000 7f890c981640 1 --2- 172.21.15.50:0/1645110161 >> v2:172.21.15.77:3300/0 conn(0x7f890815c510 0x7f890806e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.960+0000 7f890c981640 1 -- 172.21.15.50:0/1645110161 >> v1:172.21.15.50:6789/0 conn(0x7f890806e730 legacy=0x7f89080679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:51.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.960+0000 7f890c981640 1 -- 172.21.15.50:0/1645110161 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890806f530 con 0x7f89080680d0 2024-09-11T22:19:51.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.960+0000 7f890c981640 1 --2- 172.21.15.50:0/1645110161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89080680d0 0x7f890815c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8900009d90 tx=0x7f890002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f39ec02aa84238d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:51.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.961+0000 7f8906ffd640 1 -- 172.21.15.50:0/1645110161 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900007740 con 0x7f89080680d0 2024-09-11T22:19:51.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.961+0000 7f8906ffd640 1 -- 172.21.15.50:0/1645110161 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89000078e0 con 0x7f89080680d0 2024-09-11T22:19:51.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.961+0000 7f8906ffd640 1 -- 172.21.15.50:0/1645110161 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900007c90 con 0x7f89080680d0 2024-09-11T22:19:51.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.961+0000 7f890e3e4640 1 -- 172.21.15.50:0/1645110161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89080680d0 msgr2=0x7f890815c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:51.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.961+0000 7f890e3e4640 1 --2- 172.21.15.50:0/1645110161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89080680d0 0x7f890815c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8900009d90 tx=0x7f890002a660 comp rx=0 tx=0).stop 2024-09-11T22:19:51.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.961+0000 7f890e3e4640 1 -- 172.21.15.50:0/1645110161 shutdown_connections 2024-09-11T22:19:51.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.961+0000 7f890e3e4640 1 --2- 172.21.15.50:0/1645110161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89080680d0 0x7f890815c8f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.961+0000 7f890e3e4640 1 --2- 172.21.15.50:0/1645110161 >> v2:172.21.15.77:3300/0 conn(0x7f890815c510 0x7f890806e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.961+0000 7f890e3e4640 1 -- 172.21.15.50:0/1645110161 >> 172.21.15.50:0/1645110161 conn(0x7f8908075060 msgr2=0x7f890806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:51.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.961+0000 7f890e3e4640 1 -- 172.21.15.50:0/1645110161 shutdown_connections 2024-09-11T22:19:51.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.961+0000 7f890e3e4640 1 -- 172.21.15.50:0/1645110161 wait complete. 2024-09-11T22:19:51.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.962+0000 7f890e3e4640 1 Processor -- start 2024-09-11T22:19:51.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.963+0000 7f890e3e4640 1 -- start start 2024-09-11T22:19:51.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.963+0000 7f890e3e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89080680d0 0x7f8908150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:51.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.963+0000 7f890e3e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f890806e730 0x7f8908154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:51.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.963+0000 7f890e3e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f890815c510 0x7f89080cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:51.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.963+0000 7f890e3e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f890806fd30 con 0x7f890815c510 2024-09-11T22:19:51.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.963+0000 7f890e3e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f890806c820 con 0x7f89080680d0 2024-09-11T22:19:51.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.963+0000 7f890e3e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f890815ce30 con 0x7f890806e730 2024-09-11T22:19:51.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.963+0000 7f890c981640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f890815c510 0x7f89080cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.963+0000 7f890c981640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f890815c510 0x7f89080cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49056/0 (socket says 172.21.15.50:49056) 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.963+0000 7f890c981640 1 -- 172.21.15.50:0/914524805 learned_addr learned my addr 172.21.15.50:0/914524805 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.963+0000 7f8907fff640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89080680d0 0x7f8908150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.963+0000 7f89077fe640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f890806e730 0x7f8908154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.964+0000 7f890c981640 1 -- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f890806e730 msgr2=0x7f8908154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.964+0000 7f890c981640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f890806e730 0x7f8908154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.964+0000 7f890c981640 1 -- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89080680d0 msgr2=0x7f8908150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.964+0000 7f890c981640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89080680d0 0x7f8908150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.964+0000 7f890c981640 1 -- 172.21.15.50:0/914524805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89080cf5f0 con 0x7f890815c510 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.964+0000 7f890c981640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f890815c510 0x7f89080cf0b0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f8900009eb0 tx=0x7f8900004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.964+0000 7f8904ff9640 1 -- 172.21.15.50:0/914524805 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900040070 con 0x7f890815c510 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.964+0000 7f8904ff9640 1 -- 172.21.15.50:0/914524805 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8900031c60 con 0x7f890815c510 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.964+0000 7f890e3e4640 1 -- 172.21.15.50:0/914524805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89080cbe70 con 0x7f890815c510 2024-09-11T22:19:51.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.964+0000 7f8904ff9640 1 -- 172.21.15.50:0/914524805 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900009450 con 0x7f890815c510 2024-09-11T22:19:51.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.964+0000 7f890e3e4640 1 -- 172.21.15.50:0/914524805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89080cc130 con 0x7f890815c510 2024-09-11T22:19:51.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.965+0000 7f890e3e4640 1 -- 172.21.15.50:0/914524805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f890815c8f0 con 0x7f890815c510 2024-09-11T22:19:51.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.966+0000 7f8904ff9640 1 -- 172.21.15.50:0/914524805 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8900039040 con 0x7f890815c510 2024-09-11T22:19:51.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.966+0000 7f8904ff9640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88f406be30 0x7f88f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:51.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.966+0000 7f8904ff9640 1 -- 172.21.15.50:0/914524805 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 4857+0+0 (secure 0 0 0) 0x7f89000abdf0 con 0x7f890815c510 2024-09-11T22:19:51.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.966+0000 7f8907fff640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88f406be30 0x7f88f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:51.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.967+0000 7f8907fff640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88f406be30 0x7f88f406e2f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f88f8009aa0 tx=0x7f88f8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:51.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:51.970+0000 7f8904ff9640 1 -- 172.21.15.50:0/914524805 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f890007a4a0 con 0x7f890815c510 2024-09-11T22:19:52.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.152+0000 7f890e3e4640 1 -- 172.21.15.50:0/914524805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f890815a700 con 0x7f890815c510 2024-09-11T22:19:52.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.152+0000 7f8904ff9640 1 -- 172.21.15.50:0/914524805 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v140) ==== 84+0+65 (secure 0 0 0) 0x7f890007e7a0 con 0x7f890815c510 2024-09-11T22:19:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:52.153 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:19:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:19:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:19:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:19:52.153 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:19:52.153 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:19:52.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.154+0000 7f890e3e4640 1 -- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88f406be30 msgr2=0x7f88f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:52.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.154+0000 7f890e3e4640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88f406be30 0x7f88f406e2f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f88f8009aa0 tx=0x7f88f8009190 comp rx=0 tx=0).stop 2024-09-11T22:19:52.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.154+0000 7f890e3e4640 1 -- 172.21.15.50:0/914524805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f890815c510 msgr2=0x7f89080cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:52.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.154+0000 7f890e3e4640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f890815c510 0x7f89080cf0b0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f8900009eb0 tx=0x7f8900004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.154+0000 7f890e3e4640 1 -- 172.21.15.50:0/914524805 shutdown_connections 2024-09-11T22:19:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.154+0000 7f890e3e4640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f88f406be30 0x7f88f406e2f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.154+0000 7f890e3e4640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f890806e730 0x7f8908154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.154+0000 7f890e3e4640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f890815c510 0x7f89080cf0b0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.154+0000 7f890e3e4640 1 --2- 172.21.15.50:0/914524805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89080680d0 0x7f8908150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.154+0000 7f890e3e4640 1 -- 172.21.15.50:0/914524805 >> 172.21.15.50:0/914524805 conn(0x7f8908075060 msgr2=0x7f8908159970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.154+0000 7f890e3e4640 1 -- 172.21.15.50:0/914524805 shutdown_connections 2024-09-11T22:19:52.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.154+0000 7f890e3e4640 1 -- 172.21.15.50:0/914524805 wait complete. 2024-09-11T22:19:52.166 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:19:52.166 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:19:52.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.272+0000 7f8b74b66640 1 Processor -- start 2024-09-11T22:19:52.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.272+0000 7f8b74b66640 1 -- start start 2024-09-11T22:19:52.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.272+0000 7f8b74b66640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b700b2590 0x7f8b7015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.273+0000 7f8b74b66640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b70159050 con 0x7f8b7006ff20 2024-09-11T22:19:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.273+0000 7f8b74b66640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b700ae8c0 con 0x7f8b700b0520 2024-09-11T22:19:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.273+0000 7f8b74b66640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8b70070300 con 0x7f8b700b2590 2024-09-11T22:19:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.273+0000 7f8b6ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b700b2590 0x7f8b7015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.273+0000 7f8b6e59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8b7006ff20 0x7f8b700afe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34098/0 (socket says 172.21.15.50:34098) 2024-09-11T22:19:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.273+0000 7f8b6e59c640 1 -- 172.21.15.50:0/2823126355 learned_addr learned my addr 172.21.15.50:0/2823126355 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.273+0000 7f8b6dd9b640 1 -- 172.21.15.50:0/2823126355 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 40402842 0 0) 0x7f8b60001110 con 0x7f8b7006ff20 2024-09-11T22:19:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.273+0000 7f8b6dd9b640 1 -- 172.21.15.50:0/2823126355 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b5c003520 con 0x7f8b7006ff20 2024-09-11T22:19:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.273+0000 7f8b6ed9d640 1 -- 172.21.15.50:0/2823126355 >> v1:172.21.15.77:6789/0 conn(0x7f8b700b0520 legacy=0x7f8b700b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.273+0000 7f8b6ed9d640 1 -- 172.21.15.50:0/2823126355 >> v1:172.21.15.50:6789/0 conn(0x7f8b7006ff20 legacy=0x7f8b700afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.273+0000 7f8b6ed9d640 1 -- 172.21.15.50:0/2823126355 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b700aeba0 con 0x7f8b700b2590 2024-09-11T22:19:52.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.274+0000 7f8b6ed9d640 1 --2- 172.21.15.50:0/2823126355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b700b2590 0x7f8b7015eb70 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009d90 tx=0x7f8b6802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f6870daa6041ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.274+0000 7f8b6dd9b640 1 -- 172.21.15.50:0/2823126355 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68007740 con 0x7f8b700b2590 2024-09-11T22:19:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.274+0000 7f8b6dd9b640 1 -- 172.21.15.50:0/2823126355 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b680078e0 con 0x7f8b700b2590 2024-09-11T22:19:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.274+0000 7f8b6dd9b640 1 -- 172.21.15.50:0/2823126355 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68007cb0 con 0x7f8b700b2590 2024-09-11T22:19:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.274+0000 7f8b74b66640 1 -- 172.21.15.50:0/2823126355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b700b2590 msgr2=0x7f8b7015eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.274+0000 7f8b74b66640 1 --2- 172.21.15.50:0/2823126355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b700b2590 0x7f8b7015eb70 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009d90 tx=0x7f8b6802a660 comp rx=0 tx=0).stop 2024-09-11T22:19:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.274+0000 7f8b74b66640 1 -- 172.21.15.50:0/2823126355 shutdown_connections 2024-09-11T22:19:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.274+0000 7f8b74b66640 1 --2- 172.21.15.50:0/2823126355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b700b2590 0x7f8b7015eb70 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.274+0000 7f8b74b66640 1 -- 172.21.15.50:0/2823126355 >> 172.21.15.50:0/2823126355 conn(0x7f8b700b0a60 msgr2=0x7f8b70073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.275+0000 7f8b74b66640 1 -- 172.21.15.50:0/2823126355 shutdown_connections 2024-09-11T22:19:52.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.275+0000 7f8b74b66640 1 -- 172.21.15.50:0/2823126355 wait complete. 2024-09-11T22:19:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.276+0000 7f8b74b66640 1 Processor -- start 2024-09-11T22:19:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.276+0000 7f8b74b66640 1 -- start start 2024-09-11T22:19:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.276+0000 7f8b74b66640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b7006ff20 0x7f8b70140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b74b66640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b700b0520 0x7f8b70143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b74b66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b700b2590 0x7f8b70153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b74b66640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8b700af440 con 0x7f8b700b2590 2024-09-11T22:19:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b74b66640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8b700af160 con 0x7f8b700b0520 2024-09-11T22:19:52.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b74b66640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8b700af720 con 0x7f8b7006ff20 2024-09-11T22:19:52.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b6ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b700b2590 0x7f8b70153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:52.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b6ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b700b2590 0x7f8b70153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49080/0 (socket says 172.21.15.50:49080) 2024-09-11T22:19:52.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b6ed9d640 1 -- 172.21.15.50:0/3866004846 learned_addr learned my addr 172.21.15.50:0/3866004846 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:52.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b6e59c640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b7006ff20 0x7f8b70140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:52.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b67fff640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b700b0520 0x7f8b70143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:52.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b6ed9d640 1 -- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b7006ff20 msgr2=0x7f8b70140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:52.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b6ed9d640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b7006ff20 0x7f8b70140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:52.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b6ed9d640 1 -- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b700b0520 msgr2=0x7f8b70143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:52.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b6ed9d640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b700b0520 0x7f8b70143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:52.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b6ed9d640 1 -- 172.21.15.50:0/3866004846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b70143980 con 0x7f8b700b2590 2024-09-11T22:19:52.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b6ed9d640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b700b2590 0x7f8b70153160 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009eb0 tx=0x7f8b68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:52.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b66ffd640 1 -- 172.21.15.50:0/3866004846 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6803f070 con 0x7f8b700b2590 2024-09-11T22:19:52.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b66ffd640 1 -- 172.21.15.50:0/3866004846 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b68031bc0 con 0x7f8b700b2590 2024-09-11T22:19:52.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b66ffd640 1 -- 172.21.15.50:0/3866004846 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68009450 con 0x7f8b700b2590 2024-09-11T22:19:52.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.277+0000 7f8b74b66640 1 -- 172.21.15.50:0/3866004846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b701508e0 con 0x7f8b700b2590 2024-09-11T22:19:52.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.278+0000 7f8b74b66640 1 -- 172.21.15.50:0/3866004846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b70155920 con 0x7f8b700b2590 2024-09-11T22:19:52.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.279+0000 7f8b74b66640 1 -- 172.21.15.50:0/3866004846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b7015eb70 con 0x7f8b700b2590 2024-09-11T22:19:52.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.279+0000 7f8b66ffd640 1 -- 172.21.15.50:0/3866004846 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b6803b410 con 0x7f8b700b2590 2024-09-11T22:19:52.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.279+0000 7f8b66ffd640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b5006be60 0x7f8b5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:52.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.280+0000 7f8b66ffd640 1 -- 172.21.15.50:0/3866004846 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 4857+0+0 (secure 0 0 0) 0x7f8b680ac120 con 0x7f8b700b2590 2024-09-11T22:19:52.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.280+0000 7f8b6e59c640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b5006be60 0x7f8b5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:52.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.280+0000 7f8b6e59c640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b5006be60 0x7f8b5006e320 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8b600012b0 tx=0x7f8b60007b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:52.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.284+0000 7f8b66ffd640 1 -- 172.21.15.50:0/3866004846 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b6807a7e0 con 0x7f8b700b2590 2024-09-11T22:19:52.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:52.461+0000 7f8b74b66640 1 -- 172.21.15.50:0/3866004846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8b70074e20 con 0x7f8b700b2590 2024-09-11T22:19:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.460+0000 7f8b66ffd640 1 -- 172.21.15.50:0/3866004846 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v141) ==== 138+0+0 (secure 0 0 0) 0x7f8b6807eae0 con 0x7f8b700b2590 2024-09-11T22:19:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:19:53.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.464+0000 7f8b74b66640 1 -- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b5006be60 msgr2=0x7f8b5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:53.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.464+0000 7f8b74b66640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b5006be60 0x7f8b5006e320 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8b600012b0 tx=0x7f8b60007b70 comp rx=0 tx=0).stop 2024-09-11T22:19:53.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.464+0000 7f8b74b66640 1 -- 172.21.15.50:0/3866004846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b700b2590 msgr2=0x7f8b70153160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:53.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.464+0000 7f8b74b66640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b700b2590 0x7f8b70153160 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009eb0 tx=0x7f8b68004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:53.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.464+0000 7f8b74b66640 1 -- 172.21.15.50:0/3866004846 shutdown_connections 2024-09-11T22:19:53.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.464+0000 7f8b74b66640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b5006be60 0x7f8b5006e320 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:53.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.464+0000 7f8b74b66640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b700b2590 0x7f8b70153160 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:53.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.464+0000 7f8b74b66640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b700b0520 0x7f8b70143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:53.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.464+0000 7f8b74b66640 1 --2- 172.21.15.50:0/3866004846 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b7006ff20 0x7f8b70140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:53.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.464+0000 7f8b74b66640 1 -- 172.21.15.50:0/3866004846 >> 172.21.15.50:0/3866004846 conn(0x7f8b700b0a60 msgr2=0x7f8b70073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:53.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.464+0000 7f8b74b66640 1 -- 172.21.15.50:0/3866004846 shutdown_connections 2024-09-11T22:19:53.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.464+0000 7f8b74b66640 1 -- 172.21.15.50:0/3866004846 wait complete. 2024-09-11T22:19:53.481 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:19:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.597+0000 7ff0eda3c640 1 Processor -- start 2024-09-11T22:19:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.597+0000 7ff0eda3c640 1 -- start start 2024-09-11T22:19:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0eda3c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0e815c2c0 0x7ff0e80b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0eda3c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0e80b3e10 0x7ff0e80cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0eda3c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e80d0810 con 0x7ff0e80d0410 2024-09-11T22:19:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0eda3c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e80cf7a0 con 0x7ff0e815c2c0 2024-09-11T22:19:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0eda3c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e80b4f00 con 0x7ff0e80b3e10 2024-09-11T22:19:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0e6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0e815c2c0 0x7ff0e80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0e6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff0e815c2c0 0x7ff0e80b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49086/0 (socket says 172.21.15.50:49086) 2024-09-11T22:19:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0e6ffd640 1 -- 172.21.15.50:0/383803703 learned_addr learned my addr 172.21.15.50:0/383803703 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0e77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff0e80d0410 0x7ff0e815fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34108/0 (socket says 172.21.15.50:34108) 2024-09-11T22:19:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0e67fc640 1 --2- 172.21.15.50:0/383803703 >> v2:172.21.15.77:3300/0 conn(0x7ff0e80b3e10 0x7ff0e80cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0e6ffd640 1 -- 172.21.15.50:0/383803703 >> v2:172.21.15.77:3300/0 conn(0x7ff0e80b3e10 msgr2=0x7ff0e80cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0e6ffd640 1 --2- 172.21.15.50:0/383803703 >> v2:172.21.15.77:3300/0 conn(0x7ff0e80b3e10 0x7ff0e80cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0e6ffd640 1 -- 172.21.15.50:0/383803703 >> v1:172.21.15.50:6789/0 conn(0x7ff0e80d0410 legacy=0x7ff0e815fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0e6ffd640 1 -- 172.21.15.50:0/383803703 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e80b4360 con 0x7ff0e815c2c0 2024-09-11T22:19:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.598+0000 7ff0e5ffb640 1 -- 172.21.15.50:0/383803703 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2596661072 0 0) 0x7ff0e80d0810 con 0x7ff0e80d0410 2024-09-11T22:19:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.599+0000 7ff0e6ffd640 1 --2- 172.21.15.50:0/383803703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e815c2c0 0x7ff0e80b46a0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7ff0e815ff20 tx=0x7ff0d802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a449dc314c9df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.599+0000 7ff0e5ffb640 1 -- 172.21.15.50:0/383803703 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8036070 con 0x7ff0e815c2c0 2024-09-11T22:19:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.599+0000 7ff0e5ffb640 1 -- 172.21.15.50:0/383803703 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d8031600 con 0x7ff0e815c2c0 2024-09-11T22:19:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.599+0000 7ff0e5ffb640 1 -- 172.21.15.50:0/383803703 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d80319d0 con 0x7ff0e815c2c0 2024-09-11T22:19:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.600+0000 7ff0eda3c640 1 -- 172.21.15.50:0/383803703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e815c2c0 msgr2=0x7ff0e80b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.600+0000 7ff0eda3c640 1 --2- 172.21.15.50:0/383803703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e815c2c0 0x7ff0e80b46a0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7ff0e815ff20 tx=0x7ff0d802a730 comp rx=0 tx=0).stop 2024-09-11T22:19:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.600+0000 7ff0eda3c640 1 -- 172.21.15.50:0/383803703 shutdown_connections 2024-09-11T22:19:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.600+0000 7ff0eda3c640 1 --2- 172.21.15.50:0/383803703 >> v2:172.21.15.77:3300/0 conn(0x7ff0e80b3e10 0x7ff0e80cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.600+0000 7ff0eda3c640 1 --2- 172.21.15.50:0/383803703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e815c2c0 0x7ff0e80b46a0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.600+0000 7ff0eda3c640 1 -- 172.21.15.50:0/383803703 >> 172.21.15.50:0/383803703 conn(0x7ff0e80679c0 msgr2=0x7ff0e8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.600+0000 7ff0eda3c640 1 -- 172.21.15.50:0/383803703 shutdown_connections 2024-09-11T22:19:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.600+0000 7ff0eda3c640 1 -- 172.21.15.50:0/383803703 wait complete. 2024-09-11T22:19:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.601+0000 7ff0eda3c640 1 Processor -- start 2024-09-11T22:19:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.601+0000 7ff0eda3c640 1 -- start start 2024-09-11T22:19:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.602+0000 7ff0eda3c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0e80b3e10 0x7ff0e8148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.602+0000 7ff0eda3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e80d0410 0x7ff0e80cece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.602+0000 7ff0eda3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e815c2c0 0x7ff0e8071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.602+0000 7ff0eda3c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e80cfc10 con 0x7ff0e80d0410 2024-09-11T22:19:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.602+0000 7ff0eda3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e80b54a0 con 0x7ff0e815c2c0 2024-09-11T22:19:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.602+0000 7ff0eda3c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e80ce200 con 0x7ff0e80b3e10 2024-09-11T22:19:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.602+0000 7ff0e67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e80d0410 0x7ff0e80cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.602+0000 7ff0e67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e80d0410 0x7ff0e80cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49096/0 (socket says 172.21.15.50:49096) 2024-09-11T22:19:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.602+0000 7ff0e67fc640 1 -- 172.21.15.50:0/2477661841 learned_addr learned my addr 172.21.15.50:0/2477661841 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.602+0000 7ff0e77fe640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e815c2c0 0x7ff0e8071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.603+0000 7ff0e6ffd640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0e80b3e10 0x7ff0e8148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.603+0000 7ff0e67fc640 1 -- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0e80b3e10 msgr2=0x7ff0e8148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.603+0000 7ff0e67fc640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0e80b3e10 0x7ff0e8148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.603+0000 7ff0e67fc640 1 -- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e815c2c0 msgr2=0x7ff0e8071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.603+0000 7ff0e67fc640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e815c2c0 0x7ff0e8071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.603+0000 7ff0e67fc640 1 -- 172.21.15.50:0/2477661841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e814ca60 con 0x7ff0e80d0410 2024-09-11T22:19:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.603+0000 7ff0e77fe640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e815c2c0 0x7ff0e8071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.603+0000 7ff0e67fc640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e80d0410 0x7ff0e80cece0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000e9e0 tx=0x7ff0d000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.603+0000 7ff0dffff640 1 -- 172.21.15.50:0/2477661841 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0017070 con 0x7ff0e80d0410 2024-09-11T22:19:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.603+0000 7ff0dffff640 1 -- 172.21.15.50:0/2477661841 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d000c9d0 con 0x7ff0e80d0410 2024-09-11T22:19:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.603+0000 7ff0eda3c640 1 -- 172.21.15.50:0/2477661841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e80af0f0 con 0x7ff0e80d0410 2024-09-11T22:19:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.603+0000 7ff0dffff640 1 -- 172.21.15.50:0/2477661841 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000cdc0 con 0x7ff0e80d0410 2024-09-11T22:19:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.603+0000 7ff0eda3c640 1 -- 172.21.15.50:0/2477661841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e814c6c0 con 0x7ff0e80d0410 2024-09-11T22:19:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.604+0000 7ff0eda3c640 1 -- 172.21.15.50:0/2477661841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e806d070 con 0x7ff0e80d0410 2024-09-11T22:19:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.605+0000 7ff0dffff640 1 -- 172.21.15.50:0/2477661841 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0d001a070 con 0x7ff0e80d0410 2024-09-11T22:19:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.605+0000 7ff0dffff640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff0c806be60 0x7ff0c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.605+0000 7ff0dffff640 1 -- 172.21.15.50:0/2477661841 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5227+0+0 (secure 0 0 0) 0x7ff0d008af90 con 0x7ff0e80d0410 2024-09-11T22:19:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.606+0000 7ff0e6ffd640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff0c806be60 0x7ff0c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.606+0000 7ff0e6ffd640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff0c806be60 0x7ff0c806e320 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8033000 tx=0x7ff0d8009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.610+0000 7ff0dffff640 1 -- 172.21.15.50:0/2477661841 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0d0059bb0 con 0x7ff0e80d0410 2024-09-11T22:19:53.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:53.788+0000 7ff0eda3c640 1 -- 172.21.15.50:0/2477661841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff0e80b0010 con 0x7ff0e80d0410 2024-09-11T22:19:54.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.462+0000 7ff0dffff640 1 -- 172.21.15.50:0/2477661841 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v142) ==== 170+0+0 (secure 0 0 0) 0x7ff0d00594b0 con 0x7ff0e80d0410 2024-09-11T22:19:54.463 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:19:54.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.466+0000 7ff0eda3c640 1 -- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff0c806be60 msgr2=0x7ff0c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.466+0000 7ff0eda3c640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff0c806be60 0x7ff0c806e320 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8033000 tx=0x7ff0d8009000 comp rx=0 tx=0).stop 2024-09-11T22:19:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.466+0000 7ff0eda3c640 1 -- 172.21.15.50:0/2477661841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e80d0410 msgr2=0x7ff0e80cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.466+0000 7ff0eda3c640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e80d0410 0x7ff0e80cece0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000e9e0 tx=0x7ff0d000eea0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.466+0000 7ff0eda3c640 1 -- 172.21.15.50:0/2477661841 shutdown_connections 2024-09-11T22:19:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.466+0000 7ff0eda3c640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff0c806be60 0x7ff0c806e320 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.466+0000 7ff0eda3c640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0e815c2c0 0x7ff0e8071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.466+0000 7ff0eda3c640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0e80d0410 0x7ff0e80cece0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.466+0000 7ff0eda3c640 1 --2- 172.21.15.50:0/2477661841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0e80b3e10 0x7ff0e8148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.466+0000 7ff0eda3c640 1 -- 172.21.15.50:0/2477661841 >> 172.21.15.50:0/2477661841 conn(0x7ff0e80679c0 msgr2=0x7ff0e8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:54.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.466+0000 7ff0eda3c640 1 -- 172.21.15.50:0/2477661841 shutdown_connections 2024-09-11T22:19:54.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.467+0000 7ff0eda3c640 1 -- 172.21.15.50:0/2477661841 wait complete. 2024-09-11T22:19:54.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:19:54.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.605+0000 7f1f3705e640 1 Processor -- start 2024-09-11T22:19:54.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.605+0000 7f1f3705e640 1 -- start start 2024-09-11T22:19:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.606+0000 7f1f3705e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f30161fa0 0x7f1f300b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.606+0000 7f1f3705e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1f300b1600 0x7f1f300cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.606+0000 7f1f3705e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1f300cf440 0x7f1f3006bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.606+0000 7f1f3705e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1f300d1220 con 0x7f1f300b1600 2024-09-11T22:19:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.606+0000 7f1f3705e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1f300d17e0 con 0x7f1f300cf440 2024-09-11T22:19:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.606+0000 7f1f3705e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1f300cfbd0 con 0x7f1f30161fa0 2024-09-11T22:19:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.606+0000 7f1f2ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1f300b1600 0x7f1f300cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.606+0000 7f1f2ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1f300b1600 0x7f1f300cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49108/0 (socket says 172.21.15.50:49108) 2024-09-11T22:19:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.606+0000 7f1f2ffff640 1 -- 172.21.15.50:0/2647203262 learned_addr learned my addr 172.21.15.50:0/2647203262 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.607+0000 7f1f355fb640 1 --2- 172.21.15.50:0/2647203262 >> v2:172.21.15.77:3300/0 conn(0x7f1f300cf440 0x7f1f3006bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.607+0000 7f1f34dfa640 1 --2- 172.21.15.50:0/2647203262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f30161fa0 0x7f1f300b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.607+0000 7f1f2ffff640 1 -- 172.21.15.50:0/2647203262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f30161fa0 msgr2=0x7f1f300b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.607+0000 7f1f2ffff640 1 --2- 172.21.15.50:0/2647203262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f30161fa0 0x7f1f300b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.607+0000 7f1f2ffff640 1 -- 172.21.15.50:0/2647203262 >> v2:172.21.15.77:3300/0 conn(0x7f1f300cf440 msgr2=0x7f1f3006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:54.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.607+0000 7f1f2ffff640 1 --2- 172.21.15.50:0/2647203262 >> v2:172.21.15.77:3300/0 conn(0x7f1f300cf440 0x7f1f3006bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.607+0000 7f1f2ffff640 1 -- 172.21.15.50:0/2647203262 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f300cfeb0 con 0x7f1f300b1600 2024-09-11T22:19:54.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.607+0000 7f1f34dfa640 1 --2- 172.21.15.50:0/2647203262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f30161fa0 0x7f1f300b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:54.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.607+0000 7f1f2ffff640 1 --2- 172.21.15.50:0/2647203262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300b1600 0x7f1f300cef00 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f1f30073640 tx=0x7f1f2402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae02a3eba6c397f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:54.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.608+0000 7f1f2f7fe640 1 -- 172.21.15.50:0/2647203262 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f24037070 con 0x7f1f300b1600 2024-09-11T22:19:54.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.608+0000 7f1f2f7fe640 1 -- 172.21.15.50:0/2647203262 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f24032440 con 0x7f1f300b1600 2024-09-11T22:19:54.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.608+0000 7f1f2f7fe640 1 -- 172.21.15.50:0/2647203262 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f24032810 con 0x7f1f300b1600 2024-09-11T22:19:54.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.608+0000 7f1f3705e640 1 -- 172.21.15.50:0/2647203262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300b1600 msgr2=0x7f1f300cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.608+0000 7f1f3705e640 1 --2- 172.21.15.50:0/2647203262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300b1600 0x7f1f300cef00 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f1f30073640 tx=0x7f1f2402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.608+0000 7f1f3705e640 1 -- 172.21.15.50:0/2647203262 shutdown_connections 2024-09-11T22:19:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.608+0000 7f1f3705e640 1 --2- 172.21.15.50:0/2647203262 >> v2:172.21.15.77:3300/0 conn(0x7f1f300cf440 0x7f1f3006bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.608+0000 7f1f3705e640 1 --2- 172.21.15.50:0/2647203262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300b1600 0x7f1f300cef00 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.608+0000 7f1f3705e640 1 --2- 172.21.15.50:0/2647203262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f30161fa0 0x7f1f300b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.608+0000 7f1f3705e640 1 -- 172.21.15.50:0/2647203262 >> 172.21.15.50:0/2647203262 conn(0x7f1f3009ba50 msgr2=0x7f1f300b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.608+0000 7f1f3705e640 1 -- 172.21.15.50:0/2647203262 shutdown_connections 2024-09-11T22:19:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.608+0000 7f1f3705e640 1 -- 172.21.15.50:0/2647203262 wait complete. 2024-09-11T22:19:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.609+0000 7f1f3705e640 1 Processor -- start 2024-09-11T22:19:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.609+0000 7f1f3705e640 1 -- start start 2024-09-11T22:19:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.610+0000 7f1f3705e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f300b1600 0x7f1f301544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.610+0000 7f1f3705e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f300cf440 0x7f1f301f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.610+0000 7f1f3705e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f30161fa0 0x7f1f3015d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.610+0000 7f1f3705e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f30162380 con 0x7f1f30161fa0 2024-09-11T22:19:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.610+0000 7f1f3705e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1f300cf8f0 con 0x7f1f300b1600 2024-09-11T22:19:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.610+0000 7f1f3705e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1f30162500 con 0x7f1f300cf440 2024-09-11T22:19:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.610+0000 7f1f355fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f30161fa0 0x7f1f3015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.610+0000 7f1f355fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f30161fa0 0x7f1f3015d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49112/0 (socket says 172.21.15.50:49112) 2024-09-11T22:19:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.610+0000 7f1f355fb640 1 -- 172.21.15.50:0/3076135031 learned_addr learned my addr 172.21.15.50:0/3076135031 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.611+0000 7f1f2ffff640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f300cf440 0x7f1f301f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.611+0000 7f1f34dfa640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f300b1600 0x7f1f301544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.611+0000 7f1f355fb640 1 -- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f300cf440 msgr2=0x7f1f301f87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.611+0000 7f1f355fb640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f300cf440 0x7f1f301f87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.611+0000 7f1f355fb640 1 -- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f300b1600 msgr2=0x7f1f301544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.611+0000 7f1f355fb640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f300b1600 0x7f1f301544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.611+0000 7f1f355fb640 1 -- 172.21.15.50:0/3076135031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f30160ed0 con 0x7f1f30161fa0 2024-09-11T22:19:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.611+0000 7f1f355fb640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f30161fa0 0x7f1f3015d620 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f1f28007e40 tx=0x7f1f2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.611+0000 7f1f2d7fa640 1 -- 172.21.15.50:0/3076135031 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28014620 con 0x7f1f30161fa0 2024-09-11T22:19:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.611+0000 7f1f2d7fa640 1 -- 172.21.15.50:0/3076135031 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f28019070 con 0x7f1f30161fa0 2024-09-11T22:19:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.611+0000 7f1f3705e640 1 -- 172.21.15.50:0/3076135031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f301611b0 con 0x7f1f30161fa0 2024-09-11T22:19:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.611+0000 7f1f2d7fa640 1 -- 172.21.15.50:0/3076135031 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28014a20 con 0x7f1f30161fa0 2024-09-11T22:19:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.611+0000 7f1f3705e640 1 -- 172.21.15.50:0/3076135031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f301f82c0 con 0x7f1f30161fa0 2024-09-11T22:19:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.612+0000 7f1f3705e640 1 -- 172.21.15.50:0/3076135031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f30075770 con 0x7f1f30161fa0 2024-09-11T22:19:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.613+0000 7f1f2d7fa640 1 -- 172.21.15.50:0/3076135031 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f28014bc0 con 0x7f1f30161fa0 2024-09-11T22:19:54.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.613+0000 7f1f2d7fa640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1f1c06be30 0x7f1f1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:54.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.613+0000 7f1f2d7fa640 1 -- 172.21.15.50:0/3076135031 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5609+0+0 (secure 0 0 0) 0x7f1f2808b660 con 0x7f1f30161fa0 2024-09-11T22:19:54.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.614+0000 7f1f34dfa640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1f1c06be30 0x7f1f1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:54.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.614+0000 7f1f34dfa640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1f1c06be30 0x7f1f1c06e2f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000aa40 tx=0x7f1f20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:54.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.618+0000 7f1f2d7fa640 1 -- 172.21.15.50:0/3076135031 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f30075770 con 0x7f1f30161fa0 2024-09-11T22:19:54.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:54.829+0000 7f1f3705e640 1 -- 172.21.15.50:0/3076135031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1f300b1cf0 con 0x7f1f30161fa0 2024-09-11T22:19:55.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.473+0000 7f1f2d7fa640 1 -- 172.21.15.50:0/3076135031 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v98) ==== 174+0+0 (secure 0 0 0) 0x7f1f300b1cf0 con 0x7f1f30161fa0 2024-09-11T22:19:55.474 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 20 and data pool 21 2024-09-11T22:19:55.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.477+0000 7f1f3705e640 1 -- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1f1c06be30 msgr2=0x7f1f1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:55.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.477+0000 7f1f3705e640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1f1c06be30 0x7f1f1c06e2f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000aa40 tx=0x7f1f20008040 comp rx=0 tx=0).stop 2024-09-11T22:19:55.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.477+0000 7f1f3705e640 1 -- 172.21.15.50:0/3076135031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f30161fa0 msgr2=0x7f1f3015d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:55.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.477+0000 7f1f3705e640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f30161fa0 0x7f1f3015d620 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f1f28007e40 tx=0x7f1f2800e4b0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.477+0000 7f1f3705e640 1 -- 172.21.15.50:0/3076135031 shutdown_connections 2024-09-11T22:19:55.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.477+0000 7f1f3705e640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1f1c06be30 0x7f1f1c06e2f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.477+0000 7f1f3705e640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f300cf440 0x7f1f301f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.477+0000 7f1f3705e640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f30161fa0 0x7f1f3015d620 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.477+0000 7f1f3705e640 1 --2- 172.21.15.50:0/3076135031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f300b1600 0x7f1f301544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.477+0000 7f1f3705e640 1 -- 172.21.15.50:0/3076135031 >> 172.21.15.50:0/3076135031 conn(0x7f1f3009ba50 msgr2=0x7f1f300af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:55.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.477+0000 7f1f3705e640 1 -- 172.21.15.50:0/3076135031 shutdown_connections 2024-09-11T22:19:55.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.477+0000 7f1f3705e640 1 -- 172.21.15.50:0/3076135031 wait complete. 2024-09-11T22:19:55.511 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:19:55.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.618+0000 7fd69e60e640 1 Processor -- start 2024-09-11T22:19:55.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.618+0000 7fd69e60e640 1 -- start start 2024-09-11T22:19:55.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.619+0000 7fd69e60e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd69815c2c0 0x7fd6980b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.619+0000 7fd69e60e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6980b4f00 con 0x7fd6980b3e10 2024-09-11T22:19:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.619+0000 7fd69e60e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6980b4360 con 0x7fd6980d05e0 2024-09-11T22:19:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.619+0000 7fd69e60e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd6980b51c0 con 0x7fd69815c2c0 2024-09-11T22:19:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.619+0000 7fd6977fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd6980b3e10 0x7fd6980cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34118/0 (socket says 172.21.15.50:34118) 2024-09-11T22:19:55.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.619+0000 7fd6977fe640 1 -- 172.21.15.50:0/4006728757 learned_addr learned my addr 172.21.15.50:0/4006728757 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.619+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1392990261 0 0) 0x7fd6980b4f00 con 0x7fd6980b3e10 2024-09-11T22:19:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.619+0000 7fd697fff640 1 --2- 172.21.15.50:0/4006728757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd69815c2c0 0x7fd6980b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.619+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd680003520 con 0x7fd6980b3e10 2024-09-11T22:19:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 412646364 0 0) 0x7fd680003520 con 0x7fd6980b3e10 2024-09-11T22:19:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd69815c2c0 msgr2=0x7fd6980b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd696ffd640 1 --2- 172.21.15.50:0/4006728757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd69815c2c0 0x7fd6980b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 >> v1:172.21.15.77:6789/0 conn(0x7fd6980d05e0 legacy=0x7fd6980ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6980b54a0 con 0x7fd6980b3e10 2024-09-11T22:19:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fd68c001670 con 0x7fd6980b3e10 2024-09-11T22:19:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 >> v1:172.21.15.50:6789/0 conn(0x7fd6980b3e10 legacy=0x7fd6980cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:55.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd696ffd640 1 --2- 172.21.15.50:0/4006728757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd69815c2c0 0x7fd6800039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd696ffd640 1 --2- 172.21.15.50:0/4006728757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd680003f20 0x7fd680004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd696ffd640 1 --2- 172.21.15.50:0/4006728757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd680004d40 0x7fd6800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd6980b51c0 con 0x7fd680003f20 2024-09-11T22:19:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd68000bad0 con 0x7fd680004d40 2024-09-11T22:19:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd68000bcd0 con 0x7fd69815c2c0 2024-09-11T22:19:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd6977fe640 1 --2- 172.21.15.50:0/4006728757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd680003f20 0x7fd680004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd697fff640 1 --2- 172.21.15.50:0/4006728757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd69815c2c0 0x7fd6800039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd69cbab640 1 --2- 172.21.15.50:0/4006728757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd680004d40 0x7fd6800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd6977fe640 1 -- 172.21.15.50:0/4006728757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd69815c2c0 msgr2=0x7fd6800039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd6977fe640 1 --2- 172.21.15.50:0/4006728757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd69815c2c0 0x7fd6800039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd6977fe640 1 -- 172.21.15.50:0/4006728757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd680004d40 msgr2=0x7fd6800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:55.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd6977fe640 1 --2- 172.21.15.50:0/4006728757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd680004d40 0x7fd6800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd6977fe640 1 -- 172.21.15.50:0/4006728757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd680003520 con 0x7fd680003f20 2024-09-11T22:19:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.620+0000 7fd697fff640 1 --2- 172.21.15.50:0/4006728757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd69815c2c0 0x7fd6800039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.621+0000 7fd6977fe640 1 --2- 172.21.15.50:0/4006728757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd680003f20 0x7fd680004800 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00c240 tx=0x7fd680005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d01d20411328b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.621+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c007d10 con 0x7fd680003f20 2024-09-11T22:19:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.621+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd68c0058d0 con 0x7fd680003f20 2024-09-11T22:19:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.621+0000 7fd696ffd640 1 -- 172.21.15.50:0/4006728757 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c005d20 con 0x7fd680003f20 2024-09-11T22:19:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.622+0000 7fd69e60e640 1 -- 172.21.15.50:0/4006728757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd680003f20 msgr2=0x7fd680004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.622+0000 7fd69e60e640 1 --2- 172.21.15.50:0/4006728757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd680003f20 0x7fd680004800 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00c240 tx=0x7fd680005830 comp rx=0 tx=0).stop 2024-09-11T22:19:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.622+0000 7fd69cbab640 1 -- 172.21.15.50:0/4006728757 reap_dead start 2024-09-11T22:19:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.622+0000 7fd69e60e640 1 -- 172.21.15.50:0/4006728757 shutdown_connections 2024-09-11T22:19:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.622+0000 7fd69e60e640 1 -- 172.21.15.50:0/4006728757 >> 172.21.15.50:0/4006728757 conn(0x7fd6980679c0 msgr2=0x7fd698067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.622+0000 7fd69e60e640 1 -- 172.21.15.50:0/4006728757 shutdown_connections 2024-09-11T22:19:55.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.622+0000 7fd69e60e640 1 -- 172.21.15.50:0/4006728757 wait complete. 2024-09-11T22:19:55.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.623+0000 7fd69e60e640 1 Processor -- start 2024-09-11T22:19:55.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.623+0000 7fd69e60e640 1 -- start start 2024-09-11T22:19:55.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd69e60e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd680003f20 0x7fd6981540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd69e60e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd698072b70 0x7fd69814b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd69e60e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6981f8770 0x7fd6980ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd69e60e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd69806d070 con 0x7fd680003f20 2024-09-11T22:19:55.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd69e60e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd6980ce200 con 0x7fd698072b70 2024-09-11T22:19:55.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd69e60e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd69806d1f0 con 0x7fd6981f8770 2024-09-11T22:19:55.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd697fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd680003f20 0x7fd6981540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd697fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd680003f20 0x7fd6981540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49118/0 (socket says 172.21.15.50:49118) 2024-09-11T22:19:55.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd697fff640 1 -- 172.21.15.50:0/625787140 learned_addr learned my addr 172.21.15.50:0/625787140 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:55.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd6977fe640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd698072b70 0x7fd69814b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd69cbab640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6981f8770 0x7fd6980ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd697fff640 1 -- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6981f8770 msgr2=0x7fd6980ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:55.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd697fff640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6981f8770 0x7fd6980ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd697fff640 1 -- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd698072b70 msgr2=0x7fd69814b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:55.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd697fff640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd698072b70 0x7fd69814b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd697fff640 1 -- 172.21.15.50:0/625787140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd698158460 con 0x7fd680003f20 2024-09-11T22:19:55.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd69cbab640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6981f8770 0x7fd6980ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:55.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd697fff640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd680003f20 0x7fd6981540c0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fd688011d00 tx=0x7fd68800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:55.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.624+0000 7fd694ff9640 1 -- 172.21.15.50:0/625787140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68800fcc0 con 0x7fd680003f20 2024-09-11T22:19:55.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.625+0000 7fd694ff9640 1 -- 172.21.15.50:0/625787140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd68800fe60 con 0x7fd680003f20 2024-09-11T22:19:55.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.625+0000 7fd69e60e640 1 -- 172.21.15.50:0/625787140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd698072ff0 con 0x7fd680003f20 2024-09-11T22:19:55.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.625+0000 7fd694ff9640 1 -- 172.21.15.50:0/625787140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688014680 con 0x7fd680003f20 2024-09-11T22:19:55.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.625+0000 7fd69e60e640 1 -- 172.21.15.50:0/625787140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6981f7f70 con 0x7fd680003f20 2024-09-11T22:19:55.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.626+0000 7fd69e60e640 1 -- 172.21.15.50:0/625787140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd698158940 con 0x7fd680003f20 2024-09-11T22:19:55.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.626+0000 7fd694ff9640 1 -- 172.21.15.50:0/625787140 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd688012040 con 0x7fd680003f20 2024-09-11T22:19:55.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.627+0000 7fd694ff9640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd68406be30 0x7fd68406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.627+0000 7fd694ff9640 1 -- 172.21.15.50:0/625787140 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7fd68808b720 con 0x7fd680003f20 2024-09-11T22:19:55.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.627+0000 7fd6977fe640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd68406be30 0x7fd68406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.627+0000 7fd6977fe640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd68406be30 0x7fd68406e2f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd68c033000 tx=0x7fd68c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:55.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.631+0000 7fd694ff9640 1 -- 172.21.15.50:0/625787140 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd688019030 con 0x7fd680003f20 2024-09-11T22:19:55.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.810+0000 7fd69e60e640 1 -- 172.21.15.50:0/625787140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd69815c730 con 0x7fd680003f20 2024-09-11T22:19:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.811+0000 7fd694ff9640 1 -- 172.21.15.50:0/625787140 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+16716 (secure 0 0 0) 0x7fd68805a030 con 0x7fd680003f20 2024-09-11T22:19:55.812 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:55.812 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":143,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:19:54.830609+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:19:52.493103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-11T22:19:53.819282+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:19:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.813+0000 7fd69e60e640 1 -- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd68406be30 msgr2=0x7fd68406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.813+0000 7fd69e60e640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd68406be30 0x7fd68406e2f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd68c033000 tx=0x7fd68c009030 comp rx=0 tx=0).stop 2024-09-11T22:19:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.813+0000 7fd69e60e640 1 -- 172.21.15.50:0/625787140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd680003f20 msgr2=0x7fd6981540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.813+0000 7fd69e60e640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd680003f20 0x7fd6981540c0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fd688011d00 tx=0x7fd68800f610 comp rx=0 tx=0).stop 2024-09-11T22:19:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.813+0000 7fd69e60e640 1 -- 172.21.15.50:0/625787140 shutdown_connections 2024-09-11T22:19:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.814+0000 7fd69e60e640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd68406be30 0x7fd68406e2f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.814+0000 7fd69e60e640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6981f8770 0x7fd6980ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.814+0000 7fd69e60e640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd698072b70 0x7fd69814b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.814+0000 7fd69e60e640 1 --2- 172.21.15.50:0/625787140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd680003f20 0x7fd6981540c0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.814+0000 7fd69e60e640 1 -- 172.21.15.50:0/625787140 >> 172.21.15.50:0/625787140 conn(0x7fd6980679c0 msgr2=0x7fd6980cfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.814+0000 7fd69e60e640 1 -- 172.21.15.50:0/625787140 shutdown_connections 2024-09-11T22:19:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.814+0000 7fd69e60e640 1 -- 172.21.15.50:0/625787140 wait complete. 2024-09-11T22:19:55.826 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:19:55.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.926+0000 7f337a077640 1 Processor -- start 2024-09-11T22:19:55.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.926+0000 7f337a077640 1 -- start start 2024-09-11T22:19:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.927+0000 7f337a077640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3374161d30 0x7f33740cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.927+0000 7f337a077640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33740b78f0 0x7f3374162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.927+0000 7f337a077640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33741632e0 con 0x7f33740d11d0 2024-09-11T22:19:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.927+0000 7f337a077640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f33740d3450 con 0x7f3374161d30 2024-09-11T22:19:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.927+0000 7f337a077640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3374162110 con 0x7f33740b78f0 2024-09-11T22:19:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.927+0000 7f3373fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f33740d11d0 0x7f33740d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34124/0 (socket says 172.21.15.50:34124) 2024-09-11T22:19:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.927+0000 7f3373fff640 1 -- 172.21.15.50:0/4276245696 learned_addr learned my addr 172.21.15.50:0/4276245696 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.928+0000 7f3372ffd640 1 --2- 172.21.15.50:0/4276245696 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33740b78f0 0x7f3374162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.928+0000 7f33737fe640 1 --2- 172.21.15.50:0/4276245696 >> v2:172.21.15.77:3300/0 conn(0x7f3374161d30 0x7f33740cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.928+0000 7f33727fc640 1 -- 172.21.15.50:0/4276245696 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3922256464 0 0) 0x7f33741632e0 con 0x7f33740d11d0 2024-09-11T22:19:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.928+0000 7f33727fc640 1 -- 172.21.15.50:0/4276245696 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3360003520 con 0x7f33740d11d0 2024-09-11T22:19:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.928+0000 7f33737fe640 1 -- 172.21.15.50:0/4276245696 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33740b78f0 msgr2=0x7f3374162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.928+0000 7f33737fe640 1 --2- 172.21.15.50:0/4276245696 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33740b78f0 0x7f3374162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.928+0000 7f33737fe640 1 -- 172.21.15.50:0/4276245696 >> v1:172.21.15.50:6789/0 conn(0x7f33740d11d0 legacy=0x7f33740d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.928+0000 7f33737fe640 1 -- 172.21.15.50:0/4276245696 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33740cfd70 con 0x7f3374161d30 2024-09-11T22:19:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.928+0000 7f3372ffd640 1 --2- 172.21.15.50:0/4276245696 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33740b78f0 0x7f3374162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.929+0000 7f33737fe640 1 --2- 172.21.15.50:0/4276245696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3374161d30 0x7f33740cf790 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f33640097a0 tx=0x7f336402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=664dec4af2725fdd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.929+0000 7f33727fc640 1 -- 172.21.15.50:0/4276245696 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3364037070 con 0x7f3374161d30 2024-09-11T22:19:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.929+0000 7f33727fc640 1 -- 172.21.15.50:0/4276245696 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3364032440 con 0x7f3374161d30 2024-09-11T22:19:55.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.929+0000 7f33727fc640 1 -- 172.21.15.50:0/4276245696 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33640327f0 con 0x7f3374161d30 2024-09-11T22:19:55.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.929+0000 7f337a077640 1 -- 172.21.15.50:0/4276245696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3374161d30 msgr2=0x7f33740cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.929+0000 7f337a077640 1 --2- 172.21.15.50:0/4276245696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3374161d30 0x7f33740cf790 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f33640097a0 tx=0x7f336402a180 comp rx=0 tx=0).stop 2024-09-11T22:19:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.929+0000 7f337a077640 1 -- 172.21.15.50:0/4276245696 shutdown_connections 2024-09-11T22:19:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.929+0000 7f337a077640 1 --2- 172.21.15.50:0/4276245696 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33740b78f0 0x7f3374162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.929+0000 7f337a077640 1 --2- 172.21.15.50:0/4276245696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3374161d30 0x7f33740cf790 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.929+0000 7f337a077640 1 -- 172.21.15.50:0/4276245696 >> 172.21.15.50:0/4276245696 conn(0x7f33740727a0 msgr2=0x7f33740679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.929+0000 7f337a077640 1 -- 172.21.15.50:0/4276245696 shutdown_connections 2024-09-11T22:19:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.929+0000 7f337a077640 1 -- 172.21.15.50:0/4276245696 wait complete. 2024-09-11T22:19:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.931+0000 7f337a077640 1 Processor -- start 2024-09-11T22:19:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.931+0000 7f337a077640 1 -- start start 2024-09-11T22:19:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.931+0000 7f337a077640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33740b78f0 0x7f33740ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.931+0000 7f337a077640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740d11d0 0x7f3374155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.931+0000 7f337a077640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3374161d30 0x7f33740ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.931+0000 7f337a077640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33740d30e0 con 0x7f33740d11d0 2024-09-11T22:19:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.931+0000 7f337a077640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f33740d2e00 con 0x7f3374161d30 2024-09-11T22:19:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.931+0000 7f337a077640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f33740b7d30 con 0x7f33740b78f0 2024-09-11T22:19:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f3372ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740d11d0 0x7f3374155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f3372ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740d11d0 0x7f3374155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49126/0 (socket says 172.21.15.50:49126) 2024-09-11T22:19:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f3372ffd640 1 -- 172.21.15.50:0/3959831534 learned_addr learned my addr 172.21.15.50:0/3959831534 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f3373fff640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3374161d30 0x7f33740ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f33737fe640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33740b78f0 0x7f33740ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f3372ffd640 1 -- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33740b78f0 msgr2=0x7f33740ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f3372ffd640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33740b78f0 0x7f33740ac0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f3372ffd640 1 -- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3374161d30 msgr2=0x7f33740ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f3372ffd640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3374161d30 0x7f33740ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:55.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f3372ffd640 1 -- 172.21.15.50:0/3959831534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33741f5420 con 0x7f33740d11d0 2024-09-11T22:19:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f3372ffd640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740d11d0 0x7f3374155b70 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f335c00ebb0 tx=0x7f335c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f336bfff640 1 -- 172.21.15.50:0/3959831534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c017070 con 0x7f33740d11d0 2024-09-11T22:19:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f336bfff640 1 -- 172.21.15.50:0/3959831534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f335c00cc30 con 0x7f33740d11d0 2024-09-11T22:19:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f337a077640 1 -- 172.21.15.50:0/3959831534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33740ab320 con 0x7f33740d11d0 2024-09-11T22:19:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f336bfff640 1 -- 172.21.15.50:0/3959831534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c013470 con 0x7f33740d11d0 2024-09-11T22:19:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.932+0000 7f337a077640 1 -- 172.21.15.50:0/3959831534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33740ab8e0 con 0x7f33740d11d0 2024-09-11T22:19:55.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.933+0000 7f337a077640 1 -- 172.21.15.50:0/3959831534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33740cf790 con 0x7f33740d11d0 2024-09-11T22:19:55.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.934+0000 7f336bfff640 1 -- 172.21.15.50:0/3959831534 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f335c01a070 con 0x7f33740d11d0 2024-09-11T22:19:55.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.934+0000 7f336bfff640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f335406be30 0x7f335406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:55.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.935+0000 7f336bfff640 1 -- 172.21.15.50:0/3959831534 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f335c08ad70 con 0x7f33740d11d0 2024-09-11T22:19:55.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.935+0000 7f33737fe640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f335406be30 0x7f335406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:55.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.935+0000 7f33737fe640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f335406be30 0x7f335406e2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3364034000 tx=0x7f336402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:55.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:55.939+0000 7f336bfff640 1 -- 172.21.15.50:0/3959831534 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f33741f5420 con 0x7f33740d11d0 2024-09-11T22:19:56.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.116+0000 7f337a077640 1 -- 172.21.15.50:0/3959831534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33740d2900 con 0x7f33740d11d0 2024-09-11T22:19:56.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.117+0000 7f336bfff640 1 -- 172.21.15.50:0/3959831534 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+16716 (secure 0 0 0) 0x7f335c0780c0 con 0x7f33740d11d0 2024-09-11T22:19:56.118 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:56.118 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":143,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:19:54.830609+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:19:52.493103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-11T22:19:53.819282+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:19:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.119+0000 7f337a077640 1 -- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f335406be30 msgr2=0x7f335406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.119+0000 7f337a077640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f335406be30 0x7f335406e2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3364034000 tx=0x7f336402e000 comp rx=0 tx=0).stop 2024-09-11T22:19:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.119+0000 7f337a077640 1 -- 172.21.15.50:0/3959831534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740d11d0 msgr2=0x7f3374155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.119+0000 7f337a077640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740d11d0 0x7f3374155b70 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f335c00ebb0 tx=0x7f335c00c520 comp rx=0 tx=0).stop 2024-09-11T22:19:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.119+0000 7f337a077640 1 -- 172.21.15.50:0/3959831534 shutdown_connections 2024-09-11T22:19:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.119+0000 7f337a077640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f335406be30 0x7f335406e2f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.119+0000 7f337a077640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3374161d30 0x7f33740ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.119+0000 7f337a077640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33740d11d0 0x7f3374155b70 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.119+0000 7f337a077640 1 --2- 172.21.15.50:0/3959831534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33740b78f0 0x7f33740ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.119+0000 7f337a077640 1 -- 172.21.15.50:0/3959831534 >> 172.21.15.50:0/3959831534 conn(0x7f33740727a0 msgr2=0x7f3374160ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.119+0000 7f337a077640 1 -- 172.21.15.50:0/3959831534 shutdown_connections 2024-09-11T22:19:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.119+0000 7f337a077640 1 -- 172.21.15.50:0/3959831534 wait complete. 2024-09-11T22:19:56.121 INFO:tasks.ceph.mds.c.smithi050.stderr:2024-09-11T22:19:56.120+0000 7fdc71ac2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:19:56.131 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:19:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.236+0000 7f6cb30ac640 1 Processor -- start 2024-09-11T22:19:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.236+0000 7f6cb30ac640 1 -- start start 2024-09-11T22:19:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.237+0000 7f6cb30ac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cac15fd80 0x7f6cac0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.237+0000 7f6cb30ac640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cac0af940 con 0x7f6cac0af4c0 2024-09-11T22:19:56.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.237+0000 7f6cb30ac640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cac0afc20 con 0x7f6cac0b09e0 2024-09-11T22:19:56.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.237+0000 7f6cb30ac640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6cac0d1500 con 0x7f6cac15fd80 2024-09-11T22:19:56.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.237+0000 7f6cb0e48640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cac15fd80 0x7f6cac0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.237+0000 7f6cabfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6cac0af4c0 0x7f6cac0b2430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34138/0 (socket says 172.21.15.50:34138) 2024-09-11T22:19:56.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.237+0000 7f6cb0e48640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cac15fd80 0x7f6cac0b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49138/0 (socket says 172.21.15.50:49138) 2024-09-11T22:19:56.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.237+0000 7f6cabfff640 1 -- 172.21.15.50:0/2256129575 learned_addr learned my addr 172.21.15.50:0/2256129575 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:56.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.238+0000 7f6cb0e48640 1 -- 172.21.15.50:0/2256129575 >> v1:172.21.15.77:6789/0 conn(0x7f6cac0b09e0 legacy=0x7f6cac0b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:56.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.238+0000 7f6cb0e48640 1 -- 172.21.15.50:0/2256129575 >> v1:172.21.15.50:6789/0 conn(0x7f6cac0af4c0 legacy=0x7f6cac0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.238+0000 7f6cb0e48640 1 -- 172.21.15.50:0/2256129575 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac0aff00 con 0x7f6cac15fd80 2024-09-11T22:19:56.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.238+0000 7f6cab7fe640 1 -- 172.21.15.50:0/2256129575 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366524082 0 0) 0x7f6cac0af940 con 0x7f6cac0af4c0 2024-09-11T22:19:56.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.238+0000 7f6cb0e48640 1 --2- 172.21.15.50:0/2256129575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cac15fd80 0x7f6cac0b1ef0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009d90 tx=0x7f6c9c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4d95a356024946 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:56.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.239+0000 7f6cab7fe640 1 -- 172.21.15.50:0/2256129575 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c031600 con 0x7f6cac15fd80 2024-09-11T22:19:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.239+0000 7f6cab7fe640 1 -- 172.21.15.50:0/2256129575 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9c0317a0 con 0x7f6cac15fd80 2024-09-11T22:19:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.239+0000 7f6cab7fe640 1 -- 172.21.15.50:0/2256129575 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c031b70 con 0x7f6cac15fd80 2024-09-11T22:19:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.239+0000 7f6cb30ac640 1 -- 172.21.15.50:0/2256129575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cac15fd80 msgr2=0x7f6cac0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.239+0000 7f6cb30ac640 1 --2- 172.21.15.50:0/2256129575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cac15fd80 0x7f6cac0b1ef0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009d90 tx=0x7f6c9c02a610 comp rx=0 tx=0).stop 2024-09-11T22:19:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.239+0000 7f6cb30ac640 1 -- 172.21.15.50:0/2256129575 shutdown_connections 2024-09-11T22:19:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.239+0000 7f6cb30ac640 1 --2- 172.21.15.50:0/2256129575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cac15fd80 0x7f6cac0b1ef0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.239+0000 7f6cb30ac640 1 -- 172.21.15.50:0/2256129575 >> 172.21.15.50:0/2256129575 conn(0x7f6cac09ba50 msgr2=0x7f6cac0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.239+0000 7f6cb30ac640 1 -- 172.21.15.50:0/2256129575 shutdown_connections 2024-09-11T22:19:56.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.239+0000 7f6cb30ac640 1 -- 172.21.15.50:0/2256129575 wait complete. 2024-09-11T22:19:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.240+0000 7f6cb30ac640 1 Processor -- start 2024-09-11T22:19:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.240+0000 7f6cb30ac640 1 -- start start 2024-09-11T22:19:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.241+0000 7f6cb30ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cac0af4c0 0x7f6cac0c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.241+0000 7f6cb30ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cac0b09e0 0x7f6cac155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.241+0000 7f6cb30ac640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cac15fd80 0x7f6cac156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.241+0000 7f6cb30ac640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac0b3ee0 con 0x7f6cac0af4c0 2024-09-11T22:19:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.241+0000 7f6cb30ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac0b04c0 con 0x7f6cac0b09e0 2024-09-11T22:19:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.241+0000 7f6cb30ac640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6cac160160 con 0x7f6cac15fd80 2024-09-11T22:19:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.241+0000 7f6cb0e48640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cac0af4c0 0x7f6cac0c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.241+0000 7f6cb0e48640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cac0af4c0 0x7f6cac0c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49142/0 (socket says 172.21.15.50:49142) 2024-09-11T22:19:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.241+0000 7f6cb0e48640 1 -- 172.21.15.50:0/703090592 learned_addr learned my addr 172.21.15.50:0/703090592 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6cabfff640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cac0b09e0 0x7f6cac155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6cb1649640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cac15fd80 0x7f6cac156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6cb0e48640 1 -- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cac15fd80 msgr2=0x7f6cac156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6cb0e48640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cac15fd80 0x7f6cac156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6cb0e48640 1 -- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cac0b09e0 msgr2=0x7f6cac155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6cb0e48640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cac0b09e0 0x7f6cac155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6cb0e48640 1 -- 172.21.15.50:0/703090592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac1f4680 con 0x7f6cac0af4c0 2024-09-11T22:19:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6cabfff640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cac0b09e0 0x7f6cac155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6cb0e48640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cac0af4c0 0x7f6cac0c8560 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009d90 tx=0x7f6c9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6ca97fa640 1 -- 172.21.15.50:0/703090592 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c040070 con 0x7f6cac0af4c0 2024-09-11T22:19:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6ca97fa640 1 -- 172.21.15.50:0/703090592 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9c030be0 con 0x7f6cac0af4c0 2024-09-11T22:19:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6cb30ac640 1 -- 172.21.15.50:0/703090592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cac1f4960 con 0x7f6cac0af4c0 2024-09-11T22:19:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6ca97fa640 1 -- 172.21.15.50:0/703090592 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c03c420 con 0x7f6cac0af4c0 2024-09-11T22:19:56.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.242+0000 7f6cb30ac640 1 -- 172.21.15.50:0/703090592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cac1f4f20 con 0x7f6cac0af4c0 2024-09-11T22:19:56.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.243+0000 7f6cb30ac640 1 -- 172.21.15.50:0/703090592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cac0b0e50 con 0x7f6cac0af4c0 2024-09-11T22:19:56.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.244+0000 7f6ca97fa640 1 -- 172.21.15.50:0/703090592 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c9c039040 con 0x7f6cac0af4c0 2024-09-11T22:19:56.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.244+0000 7f6ca97fa640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c8c06be30 0x7f6c8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.244+0000 7f6ca97fa640 1 -- 172.21.15.50:0/703090592 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f6c9c0ac340 con 0x7f6cac0af4c0 2024-09-11T22:19:56.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.244+0000 7f6cabfff640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c8c06be30 0x7f6c8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.245+0000 7f6cabfff640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c8c06be30 0x7f6c8c06e2f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6c94000f60 tx=0x7f6c94007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:56.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.249+0000 7f6ca97fa640 1 -- 172.21.15.50:0/703090592 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c9c07adb0 con 0x7f6cac0af4c0 2024-09-11T22:19:56.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:56.461+0000 7f6cb30ac640 1 -- 172.21.15.50:0/703090592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6cac0b33f0 con 0x7f6cac0af4c0 2024-09-11T22:19:57.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.043+0000 7f6ca97fa640 1 -- 172.21.15.50:0/703090592 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v100) ==== 118+0+0 (secure 0 0 0) 0x7f6c9c07a6b0 con 0x7f6cac0af4c0 2024-09-11T22:19:57.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.046+0000 7f6cb30ac640 1 -- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c8c06be30 msgr2=0x7f6c8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.047+0000 7f6cb30ac640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c8c06be30 0x7f6c8c06e2f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6c94000f60 tx=0x7f6c94007ca0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.047+0000 7f6cb30ac640 1 -- 172.21.15.50:0/703090592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cac0af4c0 msgr2=0x7f6cac0c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.047+0000 7f6cb30ac640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cac0af4c0 0x7f6cac0c8560 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009d90 tx=0x7f6c9c004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:57.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.047+0000 7f6cb30ac640 1 -- 172.21.15.50:0/703090592 shutdown_connections 2024-09-11T22:19:57.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.047+0000 7f6cb30ac640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c8c06be30 0x7f6c8c06e2f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.047+0000 7f6cb30ac640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cac15fd80 0x7f6cac156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.047+0000 7f6cb30ac640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cac0b09e0 0x7f6cac155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.047+0000 7f6cb30ac640 1 --2- 172.21.15.50:0/703090592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cac0af4c0 0x7f6cac0c8560 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.047+0000 7f6cb30ac640 1 -- 172.21.15.50:0/703090592 >> 172.21.15.50:0/703090592 conn(0x7f6cac09ba50 msgr2=0x7f6cac0c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.047+0000 7f6cb30ac640 1 -- 172.21.15.50:0/703090592 shutdown_connections 2024-09-11T22:19:57.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.047+0000 7f6cb30ac640 1 -- 172.21.15.50:0/703090592 wait complete. 2024-09-11T22:19:57.061 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:19:57.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:19:57.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.172+0000 7feb9811a640 1 Processor -- start 2024-09-11T22:19:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.172+0000 7feb9811a640 1 -- start start 2024-09-11T22:19:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb9811a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb900cf580 0x7feb900b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb9811a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb900cdd50 0x7feb9006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb9811a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb900ce5f0 con 0x7feb9015e840 2024-09-11T22:19:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb9811a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7feb9006c240 con 0x7feb900cf580 2024-09-11T22:19:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb9811a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7feb900d0470 con 0x7feb900cdd50 2024-09-11T22:19:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb956b5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb900cf580 0x7feb900b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb956b5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feb900cf580 0x7feb900b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49146/0 (socket says 172.21.15.50:49146) 2024-09-11T22:19:57.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb956b5640 1 -- 172.21.15.50:0/3981474244 learned_addr learned my addr 172.21.15.50:0/3981474244 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb966b7640 1 --2- 172.21.15.50:0/3981474244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb900cdd50 0x7feb9006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb956b5640 1 -- 172.21.15.50:0/3981474244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb900cdd50 msgr2=0x7feb9006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb956b5640 1 --2- 172.21.15.50:0/3981474244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb900cdd50 0x7feb9006c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb956b5640 1 -- 172.21.15.50:0/3981474244 >> v1:172.21.15.77:6789/0 conn(0x7feb9015e840 legacy=0x7feb900cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb956b5640 1 -- 172.21.15.50:0/3981474244 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb900ce310 con 0x7feb900cf580 2024-09-11T22:19:57.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.173+0000 7feb966b7640 1 --2- 172.21.15.50:0/3981474244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb900cdd50 0x7feb9006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.174+0000 7feb956b5640 1 --2- 172.21.15.50:0/3981474244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb900cf580 0x7feb900b4c70 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7feb80009870 tx=0x7feb8002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67755f5a77ba9207 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.174+0000 7feb94eb4640 1 -- 172.21.15.50:0/3981474244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80037070 con 0x7feb900cf580 2024-09-11T22:19:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.174+0000 7feb94eb4640 1 -- 172.21.15.50:0/3981474244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb80032440 con 0x7feb900cf580 2024-09-11T22:19:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.174+0000 7feb94eb4640 1 -- 172.21.15.50:0/3981474244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80032810 con 0x7feb900cf580 2024-09-11T22:19:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.175+0000 7feb9811a640 1 -- 172.21.15.50:0/3981474244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb900cf580 msgr2=0x7feb900b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.175+0000 7feb9811a640 1 --2- 172.21.15.50:0/3981474244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb900cf580 0x7feb900b4c70 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7feb80009870 tx=0x7feb8002a210 comp rx=0 tx=0).stop 2024-09-11T22:19:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.175+0000 7feb9811a640 1 -- 172.21.15.50:0/3981474244 shutdown_connections 2024-09-11T22:19:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.175+0000 7feb9811a640 1 --2- 172.21.15.50:0/3981474244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb900cdd50 0x7feb9006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.175+0000 7feb9811a640 1 --2- 172.21.15.50:0/3981474244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb900cf580 0x7feb900b4c70 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.175+0000 7feb9811a640 1 -- 172.21.15.50:0/3981474244 >> 172.21.15.50:0/3981474244 conn(0x7feb900b4150 msgr2=0x7feb900b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.175+0000 7feb9811a640 1 -- 172.21.15.50:0/3981474244 shutdown_connections 2024-09-11T22:19:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.175+0000 7feb9811a640 1 -- 172.21.15.50:0/3981474244 wait complete. 2024-09-11T22:19:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.176+0000 7feb9811a640 1 Processor -- start 2024-09-11T22:19:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.176+0000 7feb9811a640 1 -- start start 2024-09-11T22:19:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb9811a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb900cdd50 0x7feb900b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb9811a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb900cf580 0x7feb900c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb9811a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9015e840 0x7feb900b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb9811a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feb9015ec20 con 0x7feb900cdd50 2024-09-11T22:19:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb9811a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feb9006bed0 con 0x7feb9015e840 2024-09-11T22:19:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb9811a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7feb9015eda0 con 0x7feb900cf580 2024-09-11T22:19:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb95eb6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb900cdd50 0x7feb900b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb95eb6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb900cdd50 0x7feb900b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49154/0 (socket says 172.21.15.50:49154) 2024-09-11T22:19:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb95eb6640 1 -- 172.21.15.50:0/1464649086 learned_addr learned my addr 172.21.15.50:0/1464649086 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb956b5640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb900cf580 0x7feb900c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb966b7640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9015e840 0x7feb900b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb95eb6640 1 -- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb900cf580 msgr2=0x7feb900c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb95eb6640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb900cf580 0x7feb900c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb95eb6640 1 -- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9015e840 msgr2=0x7feb900b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb95eb6640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9015e840 0x7feb900b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb95eb6640 1 -- 172.21.15.50:0/1464649086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb900c7290 con 0x7feb900cdd50 2024-09-11T22:19:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.177+0000 7feb966b7640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9015e840 0x7feb900b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.178+0000 7feb95eb6640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb900cdd50 0x7feb900b3810 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c430 tx=0x7feb8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.178+0000 7feb867fc640 1 -- 172.21.15.50:0/1464649086 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c011790 con 0x7feb900cdd50 2024-09-11T22:19:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.178+0000 7feb867fc640 1 -- 172.21.15.50:0/1464649086 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8c017070 con 0x7feb900cdd50 2024-09-11T22:19:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.178+0000 7feb9811a640 1 -- 172.21.15.50:0/1464649086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb901f4740 con 0x7feb900cdd50 2024-09-11T22:19:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.178+0000 7feb867fc640 1 -- 172.21.15.50:0/1464649086 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c011bb0 con 0x7feb900cdd50 2024-09-11T22:19:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.178+0000 7feb9811a640 1 -- 172.21.15.50:0/1464649086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb901f4d00 con 0x7feb900cdd50 2024-09-11T22:19:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.179+0000 7feb9811a640 1 -- 172.21.15.50:0/1464649086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb900c6230 con 0x7feb900cdd50 2024-09-11T22:19:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.179+0000 7feb867fc640 1 -- 172.21.15.50:0/1464649086 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb8c01c460 con 0x7feb900cdd50 2024-09-11T22:19:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.180+0000 7feb867fc640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feb7406be30 0x7feb7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.180+0000 7feb867fc640 1 -- 172.21.15.50:0/1464649086 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7feb8c08ac90 con 0x7feb900cdd50 2024-09-11T22:19:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.180+0000 7feb956b5640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feb7406be30 0x7feb7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.181+0000 7feb956b5640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feb7406be30 0x7feb7406e2f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7feb80034000 tx=0x7feb8002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.184+0000 7feb867fc640 1 -- 172.21.15.50:0/1464649086 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb8c059640 con 0x7feb900cdd50 2024-09-11T22:19:57.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:57.393+0000 7feb9811a640 1 -- 172.21.15.50:0/1464649086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7feb900b4c70 con 0x7feb900cdd50 2024-09-11T22:19:58.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.048+0000 7feb867fc640 1 -- 172.21.15.50:0/1464649086 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v101) ==== 122+0+0 (secure 0 0 0) 0x7feb8c058f40 con 0x7feb900cdd50 2024-09-11T22:19:58.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.051+0000 7feb9811a640 1 -- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feb7406be30 msgr2=0x7feb7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.051+0000 7feb9811a640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feb7406be30 0x7feb7406e2f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7feb80034000 tx=0x7feb8002e000 comp rx=0 tx=0).stop 2024-09-11T22:19:58.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.051+0000 7feb9811a640 1 -- 172.21.15.50:0/1464649086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb900cdd50 msgr2=0x7feb900b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.051+0000 7feb9811a640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb900cdd50 0x7feb900b3810 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c430 tx=0x7feb8c00c8f0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.051+0000 7feb9811a640 1 -- 172.21.15.50:0/1464649086 shutdown_connections 2024-09-11T22:19:58.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.051+0000 7feb9811a640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7feb7406be30 0x7feb7406e2f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.051+0000 7feb9811a640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb900cf580 0x7feb900c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.051+0000 7feb9811a640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9015e840 0x7feb900b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.051+0000 7feb9811a640 1 --2- 172.21.15.50:0/1464649086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb900cdd50 0x7feb900b3810 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.051+0000 7feb9811a640 1 -- 172.21.15.50:0/1464649086 >> 172.21.15.50:0/1464649086 conn(0x7feb900b4150 msgr2=0x7feb900709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.051+0000 7feb9811a640 1 -- 172.21.15.50:0/1464649086 shutdown_connections 2024-09-11T22:19:58.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.051+0000 7feb9811a640 1 -- 172.21.15.50:0/1464649086 wait complete. 2024-09-11T22:19:58.066 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:19:58.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:19:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.175+0000 7ff939cc3640 1 Processor -- start 2024-09-11T22:19:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.175+0000 7ff939cc3640 1 -- start start 2024-09-11T22:19:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff939cc3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff93415fb60 0x7ff9340b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff939cc3640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9340d0150 0x7ff9340d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff939cc3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9340d0e00 0x7ff9340cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff939cc3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff9340cf510 con 0x7ff9340d0e00 2024-09-11T22:19:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff939cc3640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff9340cfdb0 con 0x7ff93415fb60 2024-09-11T22:19:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff939cc3640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff9340d1290 con 0x7ff9340d0150 2024-09-11T22:19:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff933fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9340d0e00 0x7ff9340cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff933fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9340d0e00 0x7ff9340cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45198/0 (socket says 172.21.15.50:45198) 2024-09-11T22:19:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff933fff640 1 -- 172.21.15.50:0/2740984128 learned_addr learned my addr 172.21.15.50:0/2740984128 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff9337fe640 1 --2- 172.21.15.50:0/2740984128 >> v2:172.21.15.77:3300/0 conn(0x7ff93415fb60 0x7ff9340b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff932ffd640 1 --2- 172.21.15.50:0/2740984128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9340d0150 0x7ff9340d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff933fff640 1 -- 172.21.15.50:0/2740984128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9340d0150 msgr2=0x7ff9340d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff933fff640 1 --2- 172.21.15.50:0/2740984128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9340d0150 0x7ff9340d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff933fff640 1 -- 172.21.15.50:0/2740984128 >> v2:172.21.15.77:3300/0 conn(0x7ff93415fb60 msgr2=0x7ff9340b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff933fff640 1 --2- 172.21.15.50:0/2740984128 >> v2:172.21.15.77:3300/0 conn(0x7ff93415fb60 0x7ff9340b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.176+0000 7ff933fff640 1 -- 172.21.15.50:0/2740984128 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93415ff40 con 0x7ff9340d0e00 2024-09-11T22:19:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.177+0000 7ff933fff640 1 --2- 172.21.15.50:0/2740984128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9340d0e00 0x7ff9340cd090 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7ff934072ec0 tx=0x7ff92c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68f0db4f9605dc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.177+0000 7ff9327fc640 1 -- 172.21.15.50:0/2740984128 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c036070 con 0x7ff9340d0e00 2024-09-11T22:19:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.177+0000 7ff9327fc640 1 -- 172.21.15.50:0/2740984128 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92c031600 con 0x7ff9340d0e00 2024-09-11T22:19:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.177+0000 7ff9327fc640 1 -- 172.21.15.50:0/2740984128 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0319d0 con 0x7ff9340d0e00 2024-09-11T22:19:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.178+0000 7ff939cc3640 1 -- 172.21.15.50:0/2740984128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9340d0e00 msgr2=0x7ff9340cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.178+0000 7ff939cc3640 1 --2- 172.21.15.50:0/2740984128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9340d0e00 0x7ff9340cd090 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7ff934072ec0 tx=0x7ff92c02a610 comp rx=0 tx=0).stop 2024-09-11T22:19:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.178+0000 7ff939cc3640 1 -- 172.21.15.50:0/2740984128 shutdown_connections 2024-09-11T22:19:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.178+0000 7ff939cc3640 1 --2- 172.21.15.50:0/2740984128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9340d0e00 0x7ff9340cd090 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.178+0000 7ff939cc3640 1 --2- 172.21.15.50:0/2740984128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9340d0150 0x7ff9340d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.178+0000 7ff939cc3640 1 --2- 172.21.15.50:0/2740984128 >> v2:172.21.15.77:3300/0 conn(0x7ff93415fb60 0x7ff9340b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.178+0000 7ff939cc3640 1 -- 172.21.15.50:0/2740984128 >> 172.21.15.50:0/2740984128 conn(0x7ff9340b4150 msgr2=0x7ff9340b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.178+0000 7ff939cc3640 1 -- 172.21.15.50:0/2740984128 shutdown_connections 2024-09-11T22:19:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.178+0000 7ff939cc3640 1 -- 172.21.15.50:0/2740984128 wait complete. 2024-09-11T22:19:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.179+0000 7ff939cc3640 1 Processor -- start 2024-09-11T22:19:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.179+0000 7ff939cc3640 1 -- start start 2024-09-11T22:19:58.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.180+0000 7ff939cc3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9340d0e00 0x7ff9340b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.180+0000 7ff939cc3640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff93415fb60 0x7ff93414b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.180+0000 7ff939cc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff934149310 0x7ff93414bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.180+0000 7ff939cc3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff9340cfa40 con 0x7ff9340d0e00 2024-09-11T22:19:58.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.180+0000 7ff939cc3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9340cf760 con 0x7ff934149310 2024-09-11T22:19:58.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.180+0000 7ff939cc3640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff9340b1930 con 0x7ff93415fb60 2024-09-11T22:19:58.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.180+0000 7ff9337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9340d0e00 0x7ff9340b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.180+0000 7ff9337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9340d0e00 0x7ff9340b7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45212/0 (socket says 172.21.15.50:45212) 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.180+0000 7ff9337fe640 1 -- 172.21.15.50:0/314586829 learned_addr learned my addr 172.21.15.50:0/314586829 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.180+0000 7ff933fff640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff934149310 0x7ff93414bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.180+0000 7ff932ffd640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff93415fb60 0x7ff93414b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.181+0000 7ff9337fe640 1 -- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff93415fb60 msgr2=0x7ff93414b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.181+0000 7ff9337fe640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff93415fb60 0x7ff93414b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.181+0000 7ff9337fe640 1 -- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff934149310 msgr2=0x7ff93414bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.181+0000 7ff9337fe640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff934149310 0x7ff93414bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.181+0000 7ff9337fe640 1 -- 172.21.15.50:0/314586829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9340b68f0 con 0x7ff9340d0e00 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.181+0000 7ff9337fe640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9340d0e00 0x7ff9340b7990 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7ff92400d5f0 tx=0x7ff92400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.181+0000 7ff91bfff640 1 -- 172.21.15.50:0/314586829 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9240125f0 con 0x7ff9340d0e00 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.181+0000 7ff91bfff640 1 -- 172.21.15.50:0/314586829 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff924019070 con 0x7ff9340d0e00 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.181+0000 7ff939cc3640 1 -- 172.21.15.50:0/314586829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9340b6bd0 con 0x7ff9340d0e00 2024-09-11T22:19:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.181+0000 7ff91bfff640 1 -- 172.21.15.50:0/314586829 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9240129d0 con 0x7ff9340d0e00 2024-09-11T22:19:58.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.181+0000 7ff939cc3640 1 -- 172.21.15.50:0/314586829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9340b7190 con 0x7ff9340d0e00 2024-09-11T22:19:58.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.182+0000 7ff939cc3640 1 -- 172.21.15.50:0/314586829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9340d08c0 con 0x7ff9340d0e00 2024-09-11T22:19:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.183+0000 7ff91bfff640 1 -- 172.21.15.50:0/314586829 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff924012b70 con 0x7ff9340d0e00 2024-09-11T22:19:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.183+0000 7ff91bfff640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff92006be30 0x7ff92006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.183+0000 7ff91bfff640 1 -- 172.21.15.50:0/314586829 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7ff92408aff0 con 0x7ff9340d0e00 2024-09-11T22:19:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.183+0000 7ff932ffd640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff92006be30 0x7ff92006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.184+0000 7ff932ffd640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff92006be30 0x7ff92006e2f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff9340cf1a0 tx=0x7ff928008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.187+0000 7ff91bfff640 1 -- 172.21.15.50:0/314586829 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff9240593e0 con 0x7ff9340d0e00 2024-09-11T22:19:58.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.400+0000 7ff939cc3640 1 -- 172.21.15.50:0/314586829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9340b0cd0 con 0x7ff9340d0e00 2024-09-11T22:19:58.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.400+0000 7ff91bfff640 1 -- 172.21.15.50:0/314586829 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7ff92405d6e0 con 0x7ff9340d0e00 2024-09-11T22:19:58.401 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:58.401 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:19:58.402 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:19:58.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.402+0000 7ff939cc3640 1 -- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff92006be30 msgr2=0x7ff92006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.402+0000 7ff939cc3640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff92006be30 0x7ff92006e2f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff9340cf1a0 tx=0x7ff928008040 comp rx=0 tx=0).stop 2024-09-11T22:19:58.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.402+0000 7ff939cc3640 1 -- 172.21.15.50:0/314586829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9340d0e00 msgr2=0x7ff9340b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.402+0000 7ff939cc3640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9340d0e00 0x7ff9340b7990 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7ff92400d5f0 tx=0x7ff92400dab0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.402+0000 7ff939cc3640 1 -- 172.21.15.50:0/314586829 shutdown_connections 2024-09-11T22:19:58.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.402+0000 7ff939cc3640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff92006be30 0x7ff92006e2f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.402+0000 7ff939cc3640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff93415fb60 0x7ff93414b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.402+0000 7ff939cc3640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff934149310 0x7ff93414bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.402+0000 7ff939cc3640 1 --2- 172.21.15.50:0/314586829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9340d0e00 0x7ff9340b7990 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.402+0000 7ff939cc3640 1 -- 172.21.15.50:0/314586829 >> 172.21.15.50:0/314586829 conn(0x7ff9340b4150 msgr2=0x7ff9340b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.402+0000 7ff939cc3640 1 -- 172.21.15.50:0/314586829 shutdown_connections 2024-09-11T22:19:58.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.402+0000 7ff939cc3640 1 -- 172.21.15.50:0/314586829 wait complete. 2024-09-11T22:19:58.414 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:19:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.516+0000 7fe772a27640 1 Processor -- start 2024-09-11T22:19:58.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.516+0000 7fe772a27640 1 -- start start 2024-09-11T22:19:58.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.517+0000 7fe772a27640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe76c161fa0 0x7fe76c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.517+0000 7fe772a27640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe76c0b1600 0x7fe76c0cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.517+0000 7fe772a27640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe76c0cfbd0 con 0x7fe76c0cf440 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.517+0000 7fe772a27640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe76c0cdce0 con 0x7fe76c0b1600 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.517+0000 7fe772a27640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe76c0d1220 con 0x7fe76c161fa0 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.517+0000 7fe770fc4640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe76c0cf440 0x7fe76c06bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50360/0 (socket says 172.21.15.50:50360) 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.517+0000 7fe770fc4640 1 -- 172.21.15.50:0/3410052916 learned_addr learned my addr 172.21.15.50:0/3410052916 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.517+0000 7fe76b7fe640 1 --2- 172.21.15.50:0/3410052916 >> v2:172.21.15.77:3300/0 conn(0x7fe76c0b1600 0x7fe76c0cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.517+0000 7fe76bfff640 1 --2- 172.21.15.50:0/3410052916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe76c161fa0 0x7fe76c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.518+0000 7fe76affd640 1 -- 172.21.15.50:0/3410052916 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 117845319 0 0) 0x7fe76c0cfbd0 con 0x7fe76c0cf440 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.518+0000 7fe76affd640 1 -- 172.21.15.50:0/3410052916 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe754003520 con 0x7fe76c0cf440 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.518+0000 7fe76b7fe640 1 -- 172.21.15.50:0/3410052916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe76c161fa0 msgr2=0x7fe76c0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.518+0000 7fe76b7fe640 1 --2- 172.21.15.50:0/3410052916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe76c161fa0 0x7fe76c0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.518+0000 7fe76b7fe640 1 -- 172.21.15.50:0/3410052916 >> v1:172.21.15.50:6789/0 conn(0x7fe76c0cf440 legacy=0x7fe76c06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.518+0000 7fe76b7fe640 1 -- 172.21.15.50:0/3410052916 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76c0cfeb0 con 0x7fe76c0b1600 2024-09-11T22:19:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.518+0000 7fe76bfff640 1 --2- 172.21.15.50:0/3410052916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe76c161fa0 0x7fe76c0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.519+0000 7fe76b7fe640 1 --2- 172.21.15.50:0/3410052916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe76c0b1600 0x7fe76c0cef00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe7600097a0 tx=0x7fe76002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=438fe7c8ab35e55b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.519+0000 7fe76affd640 1 -- 172.21.15.50:0/3410052916 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760037070 con 0x7fe76c0b1600 2024-09-11T22:19:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.519+0000 7fe76affd640 1 -- 172.21.15.50:0/3410052916 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe760032440 con 0x7fe76c0b1600 2024-09-11T22:19:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.519+0000 7fe76affd640 1 -- 172.21.15.50:0/3410052916 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760032810 con 0x7fe76c0b1600 2024-09-11T22:19:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.519+0000 7fe772a27640 1 -- 172.21.15.50:0/3410052916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe76c0b1600 msgr2=0x7fe76c0cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.519+0000 7fe772a27640 1 --2- 172.21.15.50:0/3410052916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe76c0b1600 0x7fe76c0cef00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe7600097a0 tx=0x7fe76002a180 comp rx=0 tx=0).stop 2024-09-11T22:19:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.519+0000 7fe772a27640 1 -- 172.21.15.50:0/3410052916 shutdown_connections 2024-09-11T22:19:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.519+0000 7fe772a27640 1 --2- 172.21.15.50:0/3410052916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe76c0b1600 0x7fe76c0cef00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.519+0000 7fe772a27640 1 --2- 172.21.15.50:0/3410052916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe76c161fa0 0x7fe76c0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.519+0000 7fe772a27640 1 -- 172.21.15.50:0/3410052916 >> 172.21.15.50:0/3410052916 conn(0x7fe76c09ba50 msgr2=0x7fe76c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.519+0000 7fe772a27640 1 -- 172.21.15.50:0/3410052916 shutdown_connections 2024-09-11T22:19:58.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.519+0000 7fe772a27640 1 -- 172.21.15.50:0/3410052916 wait complete. 2024-09-11T22:19:58.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.521+0000 7fe772a27640 1 Processor -- start 2024-09-11T22:19:58.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.521+0000 7fe772a27640 1 -- start start 2024-09-11T22:19:58.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.521+0000 7fe772a27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe76c0b1600 0x7fe76c0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe772a27640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe76c0cf440 0x7fe76c160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe772a27640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe76c161fa0 0x7fe76c160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe772a27640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe76c0cf8f0 con 0x7fe76c0b1600 2024-09-11T22:19:58.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe772a27640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe76c0d17e0 con 0x7fe76c161fa0 2024-09-11T22:19:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe772a27640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe76c162380 con 0x7fe76c0cf440 2024-09-11T22:19:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe76bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe76c0b1600 0x7fe76c0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe76bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe76c0b1600 0x7fe76c0b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45220/0 (socket says 172.21.15.50:45220) 2024-09-11T22:19:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe76bfff640 1 -- 172.21.15.50:0/1541502574 learned_addr learned my addr 172.21.15.50:0/1541502574 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe770fc4640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe76c161fa0 0x7fe76c160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe76b7fe640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe76c0cf440 0x7fe76c160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe76bfff640 1 -- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe76c0cf440 msgr2=0x7fe76c160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe76bfff640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe76c0cf440 0x7fe76c160770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe76bfff640 1 -- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe76c161fa0 msgr2=0x7fe76c160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe76bfff640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe76c161fa0 0x7fe76c160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe76bfff640 1 -- 172.21.15.50:0/1541502574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76c0b4220 con 0x7fe76c0b1600 2024-09-11T22:19:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe76bfff640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe76c0b1600 0x7fe76c0b2040 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00ec10 tx=0x7fe75c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe768ff9640 1 -- 172.21.15.50:0/1541502574 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c017070 con 0x7fe76c0b1600 2024-09-11T22:19:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe768ff9640 1 -- 172.21.15.50:0/1541502574 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75c00cc30 con 0x7fe76c0b1600 2024-09-11T22:19:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe772a27640 1 -- 172.21.15.50:0/1541502574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76c0cac90 con 0x7fe76c0b1600 2024-09-11T22:19:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe768ff9640 1 -- 172.21.15.50:0/1541502574 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c013470 con 0x7fe76c0b1600 2024-09-11T22:19:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.522+0000 7fe772a27640 1 -- 172.21.15.50:0/1541502574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe76c1f84c0 con 0x7fe76c0b1600 2024-09-11T22:19:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.523+0000 7fe772a27640 1 -- 172.21.15.50:0/1541502574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe76c0d1c70 con 0x7fe76c0b1600 2024-09-11T22:19:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.524+0000 7fe768ff9640 1 -- 172.21.15.50:0/1541502574 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe75c01a070 con 0x7fe76c0b1600 2024-09-11T22:19:58.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.524+0000 7fe768ff9640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe75806be30 0x7fe75806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.524+0000 7fe768ff9640 1 -- 172.21.15.50:0/1541502574 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fe75c08ae00 con 0x7fe76c0b1600 2024-09-11T22:19:58.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.524+0000 7fe76b7fe640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe75806be30 0x7fe75806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.525+0000 7fe76b7fe640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe75806be30 0x7fe75806e2f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe760034000 tx=0x7fe76002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.529+0000 7fe768ff9640 1 -- 172.21.15.50:0/1541502574 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe75c0597a0 con 0x7fe76c0b1600 2024-09-11T22:19:58.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.704+0000 7fe772a27640 1 -- 172.21.15.50:0/1541502574 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe76c0d1000 con 0x7fe76c0b1600 2024-09-11T22:19:58.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.705+0000 7fe768ff9640 1 -- 172.21.15.50:0/1541502574 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+16703 (secure 0 0 0) 0x7fe75c0590a0 con 0x7fe76c0b1600 2024-09-11T22:19:58.706 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:58.706 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":144,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:19:56.485259+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:19:52.493103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-11T22:19:53.819282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:19:58.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.707+0000 7fe772a27640 1 -- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe75806be30 msgr2=0x7fe75806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.707+0000 7fe772a27640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe75806be30 0x7fe75806e2f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe760034000 tx=0x7fe76002e000 comp rx=0 tx=0).stop 2024-09-11T22:19:58.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.707+0000 7fe772a27640 1 -- 172.21.15.50:0/1541502574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe76c0b1600 msgr2=0x7fe76c0b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.707+0000 7fe772a27640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe76c0b1600 0x7fe76c0b2040 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00ec10 tx=0x7fe75c00c520 comp rx=0 tx=0).stop 2024-09-11T22:19:58.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.707+0000 7fe772a27640 1 -- 172.21.15.50:0/1541502574 shutdown_connections 2024-09-11T22:19:58.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.707+0000 7fe772a27640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe75806be30 0x7fe75806e2f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.707+0000 7fe772a27640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe76c0cf440 0x7fe76c160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.707+0000 7fe772a27640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe76c161fa0 0x7fe76c160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.707+0000 7fe772a27640 1 --2- 172.21.15.50:0/1541502574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe76c0b1600 0x7fe76c0b2040 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.707+0000 7fe772a27640 1 -- 172.21.15.50:0/1541502574 >> 172.21.15.50:0/1541502574 conn(0x7fe76c09ba50 msgr2=0x7fe76c070050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.707+0000 7fe772a27640 1 -- 172.21.15.50:0/1541502574 shutdown_connections 2024-09-11T22:19:58.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.707+0000 7fe772a27640 1 -- 172.21.15.50:0/1541502574 wait complete. 2024-09-11T22:19:58.719 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:19:58.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:19:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.820+0000 7ff44d591640 1 Processor -- start 2024-09-11T22:19:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.820+0000 7ff44d591640 1 -- start start 2024-09-11T22:19:58.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.821+0000 7ff44d591640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff448156b80 0x7ff44806f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.821+0000 7ff44d591640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff448073210 con 0x7ff44806f910 2024-09-11T22:19:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.821+0000 7ff44d591640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4480ced40 con 0x7ff4480b7060 2024-09-11T22:19:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.821+0000 7ff44d591640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff44806e6b0 con 0x7ff448156b80 2024-09-11T22:19:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.821+0000 7ff446ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff448156b80 0x7ff44806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.821+0000 7ff4467fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff44806f910 0x7ff4480b6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50366/0 (socket says 172.21.15.50:50366) 2024-09-11T22:19:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.821+0000 7ff4467fc640 1 -- 172.21.15.50:0/3693920351 learned_addr learned my addr 172.21.15.50:0/3693920351 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.822+0000 7ff446ffd640 1 -- 172.21.15.50:0/3693920351 >> v1:172.21.15.77:6789/0 conn(0x7ff4480b7060 legacy=0x7ff44815ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.822+0000 7ff445ffb640 1 -- 172.21.15.50:0/3693920351 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4064026440 0 0) 0x7ff448073210 con 0x7ff44806f910 2024-09-11T22:19:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.822+0000 7ff446ffd640 1 -- 172.21.15.50:0/3693920351 >> v1:172.21.15.50:6789/0 conn(0x7ff44806f910 legacy=0x7ff4480b6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.822+0000 7ff446ffd640 1 -- 172.21.15.50:0/3693920351 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4480cf020 con 0x7ff448156b80 2024-09-11T22:19:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.822+0000 7ff446ffd640 1 --2- 172.21.15.50:0/3693920351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff448156b80 0x7ff44806f100 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7ff4400097a0 tx=0x7ff44002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed57b8a07eeab5a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.823+0000 7ff445ffb640 1 -- 172.21.15.50:0/3693920351 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440037070 con 0x7ff448156b80 2024-09-11T22:19:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.823+0000 7ff445ffb640 1 -- 172.21.15.50:0/3693920351 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff440032440 con 0x7ff448156b80 2024-09-11T22:19:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.823+0000 7ff445ffb640 1 -- 172.21.15.50:0/3693920351 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440032810 con 0x7ff448156b80 2024-09-11T22:19:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.823+0000 7ff44d591640 1 -- 172.21.15.50:0/3693920351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff448156b80 msgr2=0x7ff44806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.823+0000 7ff44d591640 1 --2- 172.21.15.50:0/3693920351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff448156b80 0x7ff44806f100 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7ff4400097a0 tx=0x7ff44002a1e0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.823+0000 7ff44d591640 1 -- 172.21.15.50:0/3693920351 shutdown_connections 2024-09-11T22:19:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.823+0000 7ff44d591640 1 --2- 172.21.15.50:0/3693920351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff448156b80 0x7ff44806f100 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.823+0000 7ff44d591640 1 -- 172.21.15.50:0/3693920351 >> 172.21.15.50:0/3693920351 conn(0x7ff44806bd30 msgr2=0x7ff44806c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.823+0000 7ff44d591640 1 -- 172.21.15.50:0/3693920351 shutdown_connections 2024-09-11T22:19:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.823+0000 7ff44d591640 1 -- 172.21.15.50:0/3693920351 wait complete. 2024-09-11T22:19:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.825+0000 7ff44d591640 1 Processor -- start 2024-09-11T22:19:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.825+0000 7ff44d591640 1 -- start start 2024-09-11T22:19:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.825+0000 7ff44d591640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44806f910 0x7ff448158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.825+0000 7ff44d591640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4480b7060 0x7ff448159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.825+0000 7ff44d591640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff448156b80 0x7ff4480b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.825+0000 7ff44d591640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff4480ce980 con 0x7ff44806f910 2024-09-11T22:19:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.825+0000 7ff44d591640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff44806ec70 con 0x7ff4480b7060 2024-09-11T22:19:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.825+0000 7ff44d591640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff4480ceb00 con 0x7ff448156b80 2024-09-11T22:19:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.825+0000 7ff446ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44806f910 0x7ff448158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff446ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44806f910 0x7ff448158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45236/0 (socket says 172.21.15.50:45236) 2024-09-11T22:19:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff446ffd640 1 -- 172.21.15.50:0/3631197228 learned_addr learned my addr 172.21.15.50:0/3631197228 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff4467fc640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4480b7060 0x7ff448159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff446ffd640 1 -- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff448156b80 msgr2=0x7ff4480b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff4477fe640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff448156b80 0x7ff4480b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff446ffd640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff448156b80 0x7ff4480b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff446ffd640 1 -- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4480b7060 msgr2=0x7ff448159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff446ffd640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4480b7060 0x7ff448159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff446ffd640 1 -- 172.21.15.50:0/3631197228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4481591f0 con 0x7ff44806f910 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff4467fc640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4480b7060 0x7ff448159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff446ffd640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44806f910 0x7ff448158b10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7ff440035040 tx=0x7ff4400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff43f7fe640 1 -- 172.21.15.50:0/3631197228 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440037040 con 0x7ff44806f910 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff43f7fe640 1 -- 172.21.15.50:0/3631197228 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff440004250 con 0x7ff44806f910 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff44d591640 1 -- 172.21.15.50:0/3631197228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4481594d0 con 0x7ff44806f910 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff43f7fe640 1 -- 172.21.15.50:0/3631197228 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440032e20 con 0x7ff44806f910 2024-09-11T22:19:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.826+0000 7ff44d591640 1 -- 172.21.15.50:0/3631197228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4480b0740 con 0x7ff44806f910 2024-09-11T22:19:58.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.827+0000 7ff44d591640 1 -- 172.21.15.50:0/3631197228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff44806fd30 con 0x7ff44806f910 2024-09-11T22:19:58.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.828+0000 7ff43f7fe640 1 -- 172.21.15.50:0/3631197228 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff440030770 con 0x7ff44806f910 2024-09-11T22:19:58.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.828+0000 7ff43f7fe640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff42806be30 0x7ff42806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.828+0000 7ff43f7fe640 1 -- 172.21.15.50:0/3631197228 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7ff4400ac2b0 con 0x7ff44806f910 2024-09-11T22:19:58.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.828+0000 7ff4467fc640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff42806be30 0x7ff42806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.829+0000 7ff4467fc640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff42806be30 0x7ff42806e2f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff4481571a0 tx=0x7ff430009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:58.833+0000 7ff43f7fe640 1 -- 172.21.15.50:0/3631197228 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff44007ad70 con 0x7ff44806f910 2024-09-11T22:19:59.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.005+0000 7ff44d591640 1 -- 172.21.15.50:0/3631197228 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff448160a40 con 0x7ff42806be30 2024-09-11T22:19:59.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.011+0000 7ff43f7fe640 1 -- 172.21.15.50:0/3631197228 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243829 (secure 0 0 0) 0x7ff448160a40 con 0x7ff42806be30 2024-09-11T22:19:59.014 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:59.016 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:19:59.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.014+0000 7ff44d591640 1 -- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff42806be30 msgr2=0x7ff42806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.014+0000 7ff44d591640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff42806be30 0x7ff42806e2f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff4481571a0 tx=0x7ff430009040 comp rx=0 tx=0).stop 2024-09-11T22:19:59.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.014+0000 7ff44d591640 1 -- 172.21.15.50:0/3631197228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44806f910 msgr2=0x7ff448158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.014+0000 7ff44d591640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44806f910 0x7ff448158b10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7ff440035040 tx=0x7ff4400046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.014+0000 7ff44d591640 1 -- 172.21.15.50:0/3631197228 shutdown_connections 2024-09-11T22:19:59.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.014+0000 7ff44d591640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff42806be30 0x7ff42806e2f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.014+0000 7ff44d591640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff448156b80 0x7ff4480b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.014+0000 7ff44d591640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4480b7060 0x7ff448159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.014+0000 7ff44d591640 1 --2- 172.21.15.50:0/3631197228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44806f910 0x7ff448158b10 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.014+0000 7ff44d591640 1 -- 172.21.15.50:0/3631197228 >> 172.21.15.50:0/3631197228 conn(0x7ff44806bd30 msgr2=0x7ff44815fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:59.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.014+0000 7ff44d591640 1 -- 172.21.15.50:0/3631197228 shutdown_connections 2024-09-11T22:19:59.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.014+0000 7ff44d591640 1 -- 172.21.15.50:0/3631197228 wait complete. 2024-09-11T22:19:59.026 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":405,"stamp":"2024-09-11T22:19:57.491360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591020,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":179,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":104,"acting":104,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":433836,"kb_used_data":14960,"kb_used_omap":12,"kb_used_meta":418675,"kb_avail":754540884,"statfs":{"total":773094113280,"available":772649865216,"internally_reserved":0,"allocated":15319040,"data_stored":7349834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":428723761},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":652,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.028511"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384059+0000","last_change":"2024-09-11T22:19:55.498360+0000","last_active":"2024-09-11T22:19:57.384059+0000","last_peered":"2024-09-11T22:19:57.384059+0000","last_clean":"2024-09-11T22:19:57.384059+0000","last_became_active":"2024-09-11T22:19:55.498102+0000","last_became_peered":"2024-09-11T22:19:55.498102+0000","last_unstale":"2024-09-11T22:19:57.384059+0000","last_undegraded":"2024-09-11T22:19:57.384059+0000","last_fullsized":"2024-09-11T22:19:57.384059+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:21.245925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383767+0000","last_change":"2024-09-11T22:19:55.505563+0000","last_active":"2024-09-11T22:19:57.383767+0000","last_peered":"2024-09-11T22:19:57.383767+0000","last_clean":"2024-09-11T22:19:57.383767+0000","last_became_active":"2024-09-11T22:19:55.504577+0000","last_became_peered":"2024-09-11T22:19:55.504577+0000","last_unstale":"2024-09-11T22:19:57.383767+0000","last_undegraded":"2024-09-11T22:19:57.383767+0000","last_fullsized":"2024-09-11T22:19:57.383767+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:01.707109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383643+0000","last_change":"2024-09-11T22:19:55.502428+0000","last_active":"2024-09-11T22:19:57.383643+0000","last_peered":"2024-09-11T22:19:57.383643+0000","last_clean":"2024-09-11T22:19:57.383643+0000","last_became_active":"2024-09-11T22:19:55.502180+0000","last_became_peered":"2024-09-11T22:19:55.502180+0000","last_unstale":"2024-09-11T22:19:57.383643+0000","last_undegraded":"2024-09-11T22:19:57.383643+0000","last_fullsized":"2024-09-11T22:19:57.383643+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:11.355696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.499189+0000","last_change":"2024-09-11T22:19:55.496357+0000","last_active":"2024-09-11T22:19:55.499189+0000","last_peered":"2024-09-11T22:19:55.499189+0000","last_clean":"2024-09-11T22:19:55.499189+0000","last_became_active":"2024-09-11T22:19:55.496083+0000","last_became_peered":"2024-09-11T22:19:55.496083+0000","last_unstale":"2024-09-11T22:19:55.499189+0000","last_undegraded":"2024-09-11T22:19:55.499189+0000","last_fullsized":"2024-09-11T22:19:55.499189+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:12.169198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384215+0000","last_change":"2024-09-11T22:19:55.496386+0000","last_active":"2024-09-11T22:19:57.384215+0000","last_peered":"2024-09-11T22:19:57.384215+0000","last_clean":"2024-09-11T22:19:57.384215+0000","last_became_active":"2024-09-11T22:19:55.495842+0000","last_became_peered":"2024-09-11T22:19:55.495842+0000","last_unstale":"2024-09-11T22:19:57.384215+0000","last_undegraded":"2024-09-11T22:19:57.384215+0000","last_fullsized":"2024-09-11T22:19:57.384215+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:47.251855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.490399+0000","last_change":"2024-09-11T22:19:55.489451+0000","last_active":"2024-09-11T22:19:55.490399+0000","last_peered":"2024-09-11T22:19:55.490399+0000","last_clean":"2024-09-11T22:19:55.490399+0000","last_became_active":"2024-09-11T22:19:55.489198+0000","last_became_peered":"2024-09-11T22:19:55.489198+0000","last_unstale":"2024-09-11T22:19:55.490399+0000","last_undegraded":"2024-09-11T22:19:55.490399+0000","last_fullsized":"2024-09-11T22:19:55.490399+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.715938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384249+0000","last_change":"2024-09-11T22:19:55.499103+0000","last_active":"2024-09-11T22:19:57.384249+0000","last_peered":"2024-09-11T22:19:57.384249+0000","last_clean":"2024-09-11T22:19:57.384249+0000","last_became_active":"2024-09-11T22:19:55.498817+0000","last_became_peered":"2024-09-11T22:19:55.498817+0000","last_unstale":"2024-09-11T22:19:57.384249+0000","last_undegraded":"2024-09-11T22:19:57.384249+0000","last_fullsized":"2024-09-11T22:19:57.384249+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:45.826396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383730+0000","last_change":"2024-09-11T22:19:55.501801+0000","last_active":"2024-09-11T22:19:57.383730+0000","last_peered":"2024-09-11T22:19:57.383730+0000","last_clean":"2024-09-11T22:19:57.383730+0000","last_became_active":"2024-09-11T22:19:55.501488+0000","last_became_peered":"2024-09-11T22:19:55.501488+0000","last_unstale":"2024-09-11T22:19:57.383730+0000","last_undegraded":"2024-09-11T22:19:57.383730+0000","last_fullsized":"2024-09-11T22:19:57.383730+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:56.830151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.502914+0000","last_change":"2024-09-11T22:19:55.499959+0000","last_active":"2024-09-11T22:19:55.502914+0000","last_peered":"2024-09-11T22:19:55.502914+0000","last_clean":"2024-09-11T22:19:55.502914+0000","last_became_active":"2024-09-11T22:19:55.499649+0000","last_became_peered":"2024-09-11T22:19:55.499649+0000","last_unstale":"2024-09-11T22:19:55.502914+0000","last_undegraded":"2024-09-11T22:19:55.502914+0000","last_fullsized":"2024-09-11T22:19:55.502914+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:28.378190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.508793+0000","last_change":"2024-09-11T22:19:55.507660+0000","last_active":"2024-09-11T22:19:55.508793+0000","last_peered":"2024-09-11T22:19:55.508793+0000","last_clean":"2024-09-11T22:19:55.508793+0000","last_became_active":"2024-09-11T22:19:55.507383+0000","last_became_peered":"2024-09-11T22:19:55.507383+0000","last_unstale":"2024-09-11T22:19:55.508793+0000","last_undegraded":"2024-09-11T22:19:55.508793+0000","last_fullsized":"2024-09-11T22:19:55.508793+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:29.715798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.499209+0000","last_change":"2024-09-11T22:19:55.494531+0000","last_active":"2024-09-11T22:19:55.499209+0000","last_peered":"2024-09-11T22:19:55.499209+0000","last_clean":"2024-09-11T22:19:55.499209+0000","last_became_active":"2024-09-11T22:19:55.491160+0000","last_became_peered":"2024-09-11T22:19:55.491160+0000","last_unstale":"2024-09-11T22:19:55.499209+0000","last_undegraded":"2024-09-11T22:19:55.499209+0000","last_fullsized":"2024-09-11T22:19:55.499209+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:02.052132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384151+0000","last_change":"2024-09-11T22:19:55.504254+0000","last_active":"2024-09-11T22:19:57.384151+0000","last_peered":"2024-09-11T22:19:57.384151+0000","last_clean":"2024-09-11T22:19:57.384151+0000","last_became_active":"2024-09-11T22:19:55.503807+0000","last_became_peered":"2024-09-11T22:19:55.503807+0000","last_unstale":"2024-09-11T22:19:57.384151+0000","last_undegraded":"2024-09-11T22:19:57.384151+0000","last_fullsized":"2024-09-11T22:19:57.384151+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:05.936518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"143'4","reported_seq":18,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384092+0000","last_change":"2024-09-11T22:19:54.477507+0000","last_active":"2024-09-11T22:19:57.384092+0000","last_peered":"2024-09-11T22:19:57.384092+0000","last_clean":"2024-09-11T22:19:57.384092+0000","last_became_active":"2024-09-11T22:19:54.477195+0000","last_became_peered":"2024-09-11T22:19:54.477195+0000","last_unstale":"2024-09-11T22:19:57.384092+0000","last_undegraded":"2024-09-11T22:19:57.384092+0000","last_fullsized":"2024-09-11T22:19:57.384092+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:53.923066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.465377+0000","last_change":"2024-09-11T22:19:53.465377+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.465377+0000","last_undegraded":"2024-09-11T22:19:53.465377+0000","last_fullsized":"2024-09-11T22:19:53.465377+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.468994+0000","last_change":"2024-09-11T22:19:53.468994+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.468994+0000","last_undegraded":"2024-09-11T22:19:53.468994+0000","last_fullsized":"2024-09-11T22:19:53.468994+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383952+0000","last_change":"2024-09-11T22:19:55.504793+0000","last_active":"2024-09-11T22:19:57.383952+0000","last_peered":"2024-09-11T22:19:57.383952+0000","last_clean":"2024-09-11T22:19:57.383952+0000","last_became_active":"2024-09-11T22:19:55.504439+0000","last_became_peered":"2024-09-11T22:19:55.504439+0000","last_unstale":"2024-09-11T22:19:57.383952+0000","last_undegraded":"2024-09-11T22:19:57.383952+0000","last_fullsized":"2024-09-11T22:19:57.383952+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:18.199474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.469023+0000","last_change":"2024-09-11T22:19:53.469023+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.469023+0000","last_undegraded":"2024-09-11T22:19:53.469023+0000","last_fullsized":"2024-09-11T22:19:53.469023+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"143'1","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.508433+0000","last_change":"2024-09-11T22:19:54.486151+0000","last_active":"2024-09-11T22:19:55.508433+0000","last_peered":"2024-09-11T22:19:55.508433+0000","last_clean":"2024-09-11T22:19:55.508433+0000","last_became_active":"2024-09-11T22:19:54.485525+0000","last_became_peered":"2024-09-11T22:19:54.485525+0000","last_unstale":"2024-09-11T22:19:55.508433+0000","last_undegraded":"2024-09-11T22:19:55.508433+0000","last_fullsized":"2024-09-11T22:19:55.508433+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:06.778567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.465232+0000","last_change":"2024-09-11T22:19:53.465232+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.465232+0000","last_undegraded":"2024-09-11T22:19:53.465232+0000","last_fullsized":"2024-09-11T22:19:53.465232+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.481838+0000","last_change":"2024-09-11T22:19:54.484169+0000","last_active":"2024-09-11T22:19:55.481838+0000","last_peered":"2024-09-11T22:19:55.481838+0000","last_clean":"2024-09-11T22:19:55.481838+0000","last_became_active":"2024-09-11T22:19:54.483844+0000","last_became_peered":"2024-09-11T22:19:54.483844+0000","last_unstale":"2024-09-11T22:19:55.481838+0000","last_undegraded":"2024-09-11T22:19:55.481838+0000","last_fullsized":"2024-09-11T22:19:55.481838+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:19.353179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.468769+0000","last_change":"2024-09-11T22:19:53.468769+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.468769+0000","last_undegraded":"2024-09-11T22:19:53.468769+0000","last_fullsized":"2024-09-11T22:19:53.468769+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.464775+0000","last_change":"2024-09-11T22:19:53.464775+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.464775+0000","last_undegraded":"2024-09-11T22:19:53.464775+0000","last_fullsized":"2024-09-11T22:19:53.464775+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384098+0000","last_change":"2024-09-11T22:19:55.496132+0000","last_active":"2024-09-11T22:19:57.384098+0000","last_peered":"2024-09-11T22:19:57.384098+0000","last_clean":"2024-09-11T22:19:57.384098+0000","last_became_active":"2024-09-11T22:19:55.495466+0000","last_became_peered":"2024-09-11T22:19:55.495466+0000","last_unstale":"2024-09-11T22:19:57.384098+0000","last_undegraded":"2024-09-11T22:19:57.384098+0000","last_fullsized":"2024-09-11T22:19:57.384098+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:07.378924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384287+0000","last_change":"2024-09-11T22:19:54.480915+0000","last_active":"2024-09-11T22:19:57.384287+0000","last_peered":"2024-09-11T22:19:57.384287+0000","last_clean":"2024-09-11T22:19:57.384287+0000","last_became_active":"2024-09-11T22:19:54.480633+0000","last_became_peered":"2024-09-11T22:19:54.480633+0000","last_unstale":"2024-09-11T22:19:57.384287+0000","last_undegraded":"2024-09-11T22:19:57.384287+0000","last_fullsized":"2024-09-11T22:19:57.384287+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:37.295459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.490098+0000","last_change":"2024-09-11T22:19:55.487749+0000","last_active":"2024-09-11T22:19:55.490098+0000","last_peered":"2024-09-11T22:19:55.490098+0000","last_clean":"2024-09-11T22:19:55.490098+0000","last_became_active":"2024-09-11T22:19:55.487462+0000","last_became_peered":"2024-09-11T22:19:55.487462+0000","last_unstale":"2024-09-11T22:19:55.490098+0000","last_undegraded":"2024-09-11T22:19:55.490098+0000","last_fullsized":"2024-09-11T22:19:55.490098+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:09.534990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.470427+0000","last_change":"2024-09-11T22:19:53.470427+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.470427+0000","last_undegraded":"2024-09-11T22:19:53.470427+0000","last_fullsized":"2024-09-11T22:19:53.470427+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467947+0000","last_change":"2024-09-11T22:19:53.467947+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467947+0000","last_undegraded":"2024-09-11T22:19:53.467947+0000","last_fullsized":"2024-09-11T22:19:53.467947+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467802+0000","last_change":"2024-09-11T22:19:53.467802+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467802+0000","last_undegraded":"2024-09-11T22:19:53.467802+0000","last_fullsized":"2024-09-11T22:19:53.467802+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467019+0000","last_change":"2024-09-11T22:19:53.467019+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467019+0000","last_undegraded":"2024-09-11T22:19:53.467019+0000","last_fullsized":"2024-09-11T22:19:53.467019+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"143'8","reported_seq":20,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.511146+0000","last_change":"2024-09-11T22:19:54.482849+0000","last_active":"2024-09-11T22:19:55.511146+0000","last_peered":"2024-09-11T22:19:55.511146+0000","last_clean":"2024-09-11T22:19:55.511146+0000","last_became_active":"2024-09-11T22:19:54.482552+0000","last_became_peered":"2024-09-11T22:19:54.482552+0000","last_unstale":"2024-09-11T22:19:55.511146+0000","last_undegraded":"2024-09-11T22:19:55.511146+0000","last_fullsized":"2024-09-11T22:19:55.511146+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:34.396451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384240+0000","last_change":"2024-09-11T22:19:55.496672+0000","last_active":"2024-09-11T22:19:57.384240+0000","last_peered":"2024-09-11T22:19:57.384240+0000","last_clean":"2024-09-11T22:19:57.384240+0000","last_became_active":"2024-09-11T22:19:55.496398+0000","last_became_peered":"2024-09-11T22:19:55.496398+0000","last_unstale":"2024-09-11T22:19:57.384240+0000","last_undegraded":"2024-09-11T22:19:57.384240+0000","last_fullsized":"2024-09-11T22:19:57.384240+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:54.264936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.465362+0000","last_change":"2024-09-11T22:19:53.465362+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.465362+0000","last_undegraded":"2024-09-11T22:19:53.465362+0000","last_fullsized":"2024-09-11T22:19:53.465362+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.502094+0000","last_change":"2024-09-11T22:19:55.498674+0000","last_active":"2024-09-11T22:19:55.502094+0000","last_peered":"2024-09-11T22:19:55.502094+0000","last_clean":"2024-09-11T22:19:55.502094+0000","last_became_active":"2024-09-11T22:19:55.498398+0000","last_became_peered":"2024-09-11T22:19:55.498398+0000","last_unstale":"2024-09-11T22:19:55.502094+0000","last_undegraded":"2024-09-11T22:19:55.502094+0000","last_fullsized":"2024-09-11T22:19:55.502094+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:05.560482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.464847+0000","last_change":"2024-09-11T22:19:53.464847+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.464847+0000","last_undegraded":"2024-09-11T22:19:53.464847+0000","last_fullsized":"2024-09-11T22:19:53.464847+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"143'1","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.508738+0000","last_change":"2024-09-11T22:19:54.484652+0000","last_active":"2024-09-11T22:19:55.508738+0000","last_peered":"2024-09-11T22:19:55.508738+0000","last_clean":"2024-09-11T22:19:55.508738+0000","last_became_active":"2024-09-11T22:19:54.484339+0000","last_became_peered":"2024-09-11T22:19:54.484339+0000","last_unstale":"2024-09-11T22:19:55.508738+0000","last_undegraded":"2024-09-11T22:19:55.508738+0000","last_fullsized":"2024-09-11T22:19:55.508738+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:26.988816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.465058+0000","last_change":"2024-09-11T22:19:53.465058+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.465058+0000","last_undegraded":"2024-09-11T22:19:53.465058+0000","last_fullsized":"2024-09-11T22:19:53.465058+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.470848+0000","last_change":"2024-09-11T22:19:53.470848+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.470848+0000","last_undegraded":"2024-09-11T22:19:53.470848+0000","last_fullsized":"2024-09-11T22:19:53.470848+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383886+0000","last_change":"2024-09-11T22:19:54.474277+0000","last_active":"2024-09-11T22:19:57.383886+0000","last_peered":"2024-09-11T22:19:57.383886+0000","last_clean":"2024-09-11T22:19:57.383886+0000","last_became_active":"2024-09-11T22:19:54.473990+0000","last_became_peered":"2024-09-11T22:19:54.473990+0000","last_unstale":"2024-09-11T22:19:57.383886+0000","last_undegraded":"2024-09-11T22:19:57.383886+0000","last_fullsized":"2024-09-11T22:19:57.383886+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:33.263881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383580+0000","last_change":"2024-09-11T22:19:54.475515+0000","last_active":"2024-09-11T22:19:57.383580+0000","last_peered":"2024-09-11T22:19:57.383580+0000","last_clean":"2024-09-11T22:19:57.383580+0000","last_became_active":"2024-09-11T22:19:54.475217+0000","last_became_peered":"2024-09-11T22:19:54.475217+0000","last_unstale":"2024-09-11T22:19:57.383580+0000","last_undegraded":"2024-09-11T22:19:57.383580+0000","last_fullsized":"2024-09-11T22:19:57.383580+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:57.756890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467819+0000","last_change":"2024-09-11T22:19:53.467819+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467819+0000","last_undegraded":"2024-09-11T22:19:53.467819+0000","last_fullsized":"2024-09-11T22:19:53.467819+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384243+0000","last_change":"2024-09-11T22:19:54.480155+0000","last_active":"2024-09-11T22:19:57.384243+0000","last_peered":"2024-09-11T22:19:57.384243+0000","last_clean":"2024-09-11T22:19:57.384243+0000","last_became_active":"2024-09-11T22:19:54.479875+0000","last_became_peered":"2024-09-11T22:19:54.479875+0000","last_unstale":"2024-09-11T22:19:57.384243+0000","last_undegraded":"2024-09-11T22:19:57.384243+0000","last_fullsized":"2024-09-11T22:19:57.384243+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:39:16.361022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467650+0000","last_change":"2024-09-11T22:19:53.467650+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467650+0000","last_undegraded":"2024-09-11T22:19:53.467650+0000","last_fullsized":"2024-09-11T22:19:53.467650+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467144+0000","last_change":"2024-09-11T22:19:53.467144+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467144+0000","last_undegraded":"2024-09-11T22:19:53.467144+0000","last_fullsized":"2024-09-11T22:19:53.467144+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467053+0000","last_change":"2024-09-11T22:19:53.467053+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467053+0000","last_undegraded":"2024-09-11T22:19:53.467053+0000","last_fullsized":"2024-09-11T22:19:53.467053+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.503074+0000","last_change":"2024-09-11T22:19:55.500191+0000","last_active":"2024-09-11T22:19:55.503074+0000","last_peered":"2024-09-11T22:19:55.503074+0000","last_clean":"2024-09-11T22:19:55.503074+0000","last_became_active":"2024-09-11T22:19:55.499703+0000","last_became_peered":"2024-09-11T22:19:55.499703+0000","last_unstale":"2024-09-11T22:19:55.503074+0000","last_undegraded":"2024-09-11T22:19:55.503074+0000","last_fullsized":"2024-09-11T22:19:55.503074+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:06.196494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.470360+0000","last_change":"2024-09-11T22:19:53.470360+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.470360+0000","last_undegraded":"2024-09-11T22:19:53.470360+0000","last_fullsized":"2024-09-11T22:19:53.470360+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383723+0000","last_change":"2024-09-11T22:19:54.482877+0000","last_active":"2024-09-11T22:19:57.383723+0000","last_peered":"2024-09-11T22:19:57.383723+0000","last_clean":"2024-09-11T22:19:57.383723+0000","last_became_active":"2024-09-11T22:19:54.482462+0000","last_became_peered":"2024-09-11T22:19:54.482462+0000","last_unstale":"2024-09-11T22:19:57.383723+0000","last_undegraded":"2024-09-11T22:19:57.383723+0000","last_fullsized":"2024-09-11T22:19:57.383723+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:50.629566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383704+0000","last_change":"2024-09-11T22:19:55.503903+0000","last_active":"2024-09-11T22:19:57.383704+0000","last_peered":"2024-09-11T22:19:57.383704+0000","last_clean":"2024-09-11T22:19:57.383704+0000","last_became_active":"2024-09-11T22:19:55.503606+0000","last_became_peered":"2024-09-11T22:19:55.503606+0000","last_unstale":"2024-09-11T22:19:57.383704+0000","last_undegraded":"2024-09-11T22:19:57.383704+0000","last_fullsized":"2024-09-11T22:19:57.383704+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:41.678234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.468264+0000","last_change":"2024-09-11T22:19:53.468264+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.468264+0000","last_undegraded":"2024-09-11T22:19:53.468264+0000","last_fullsized":"2024-09-11T22:19:53.468264+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.464772+0000","last_change":"2024-09-11T22:19:53.464772+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.464772+0000","last_undegraded":"2024-09-11T22:19:53.464772+0000","last_fullsized":"2024-09-11T22:19:53.464772+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.468023+0000","last_change":"2024-09-11T22:19:53.468023+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.468023+0000","last_undegraded":"2024-09-11T22:19:53.468023+0000","last_fullsized":"2024-09-11T22:19:53.468023+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":393,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383815+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:19:57.383815+0000","last_peered":"2024-09-11T22:19:57.383815+0000","last_clean":"2024-09-11T22:19:57.383815+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:19:57.383815+0000","last_undegraded":"2024-09-11T22:19:57.383815+0000","last_fullsized":"2024-09-11T22:19:57.383815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":38,"acting":38,"num_store_stats":2},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":652,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509551,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50952,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320888,"statfs":{"total":96636764160,"available":96584589312,"internally_reserved":0,"allocated":1757184,"data_stored":767583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509548,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46796,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325044,"statfs":{"total":96636764160,"available":96588845056,"internally_reserved":0,"allocated":1757184,"data_stored":767583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509550,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50956,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320884,"statfs":{"total":96636764160,"available":96584585216,"internally_reserved":0,"allocated":1757184,"data_stored":767583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509550,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59276,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312564,"statfs":{"total":96636764160,"available":96576065536,"internally_reserved":0,"allocated":1757184,"data_stored":767583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509550,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59276,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312564,"statfs":{"total":96636764160,"available":96576065536,"internally_reserved":0,"allocated":1757184,"data_stored":767583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509549,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55696,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316144,"statfs":{"total":96636764160,"available":96579731456,"internally_reserved":0,"allocated":2351104,"data_stored":1357951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51564,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320276,"statfs":{"total":96636764160,"available":96583962624,"internally_reserved":0,"allocated":2383872,"data_stored":1371653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59320,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312520,"statfs":{"total":96636764160,"available":96576020480,"internally_reserved":0,"allocated":1798144,"data_stored":782315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:19:59.030 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:19:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.168+0000 7fc61eed0640 1 Processor -- start 2024-09-11T22:19:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.168+0000 7fc61eed0640 1 -- start start 2024-09-11T22:19:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.169+0000 7fc61eed0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6180d05e0 0x7fc6180b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.169+0000 7fc61eed0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc6180b3e10 0x7fc6180ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.169+0000 7fc61eed0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6180b4f00 con 0x7fc61815c2c0 2024-09-11T22:19:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.169+0000 7fc61eed0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc6180b4360 con 0x7fc6180b3e10 2024-09-11T22:19:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.169+0000 7fc61eed0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6180b51c0 con 0x7fc6180d05e0 2024-09-11T22:19:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.169+0000 7fc61d46d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc6180b3e10 0x7fc6180ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.169+0000 7fc617fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6180d05e0 0x7fc6180b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.169+0000 7fc61cc6c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc61815c2c0 0x7fc6180cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:33860/0 (socket says 172.21.15.50:33860) 2024-09-11T22:19:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.169+0000 7fc61cc6c640 1 -- 172.21.15.50:0/1713591938 learned_addr learned my addr 172.21.15.50:0/1713591938 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:19:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.170+0000 7fc6177fe640 1 -- 172.21.15.50:0/1713591938 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1260916015 0 0) 0x7fc6180b4f00 con 0x7fc61815c2c0 2024-09-11T22:19:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.170+0000 7fc6177fe640 1 -- 172.21.15.50:0/1713591938 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc608003520 con 0x7fc61815c2c0 2024-09-11T22:19:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.170+0000 7fc61d46d640 1 -- 172.21.15.50:0/1713591938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6180d05e0 msgr2=0x7fc6180b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.170+0000 7fc61d46d640 1 --2- 172.21.15.50:0/1713591938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6180d05e0 0x7fc6180b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.170+0000 7fc61d46d640 1 -- 172.21.15.50:0/1713591938 >> v1:172.21.15.77:6789/0 conn(0x7fc61815c2c0 legacy=0x7fc6180cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.170+0000 7fc61d46d640 1 -- 172.21.15.50:0/1713591938 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6180b54a0 con 0x7fc6180b3e10 2024-09-11T22:19:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.170+0000 7fc617fff640 1 --2- 172.21.15.50:0/1713591938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6180d05e0 0x7fc6180b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:59.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.170+0000 7fc61d46d640 1 --2- 172.21.15.50:0/1713591938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6180b3e10 0x7fc6180ce790 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc610009d90 tx=0x7fc61002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3af548088efea54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:59.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.171+0000 7fc6177fe640 1 -- 172.21.15.50:0/1713591938 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610007740 con 0x7fc6180b3e10 2024-09-11T22:19:59.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.171+0000 7fc6177fe640 1 -- 172.21.15.50:0/1713591938 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6100078e0 con 0x7fc6180b3e10 2024-09-11T22:19:59.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.171+0000 7fc6177fe640 1 -- 172.21.15.50:0/1713591938 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610007c90 con 0x7fc6180b3e10 2024-09-11T22:19:59.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.171+0000 7fc61eed0640 1 -- 172.21.15.50:0/1713591938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6180b3e10 msgr2=0x7fc6180ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.171+0000 7fc61eed0640 1 --2- 172.21.15.50:0/1713591938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6180b3e10 0x7fc6180ce790 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc610009d90 tx=0x7fc61002a660 comp rx=0 tx=0).stop 2024-09-11T22:19:59.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.171+0000 7fc61eed0640 1 -- 172.21.15.50:0/1713591938 shutdown_connections 2024-09-11T22:19:59.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.171+0000 7fc61eed0640 1 --2- 172.21.15.50:0/1713591938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6180b3e10 0x7fc6180ce790 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.171+0000 7fc61eed0640 1 --2- 172.21.15.50:0/1713591938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6180d05e0 0x7fc6180b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.171+0000 7fc61eed0640 1 -- 172.21.15.50:0/1713591938 >> 172.21.15.50:0/1713591938 conn(0x7fc6180679c0 msgr2=0x7fc618067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:59.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.171+0000 7fc61eed0640 1 -- 172.21.15.50:0/1713591938 shutdown_connections 2024-09-11T22:19:59.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.171+0000 7fc61eed0640 1 -- 172.21.15.50:0/1713591938 wait complete. 2024-09-11T22:19:59.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.172+0000 7fc61eed0640 1 Processor -- start 2024-09-11T22:19:59.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.172+0000 7fc61eed0640 1 -- start start 2024-09-11T22:19:59.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.173+0000 7fc61eed0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6180b3e10 0x7fc61815f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.173+0000 7fc61eed0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180d05e0 0x7fc6181e6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.173+0000 7fc61eed0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc61815c2c0 0x7fc6181f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.173+0000 7fc61eed0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc61806d070 con 0x7fc6180d05e0 2024-09-11T22:19:59.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.173+0000 7fc61eed0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6180ce200 con 0x7fc6180b3e10 2024-09-11T22:19:59.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.173+0000 7fc61eed0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc61806d1f0 con 0x7fc61815c2c0 2024-09-11T22:19:59.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.173+0000 7fc617fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180d05e0 0x7fc6181e6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.173+0000 7fc617fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180d05e0 0x7fc6181e6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45240/0 (socket says 172.21.15.50:45240) 2024-09-11T22:19:59.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.173+0000 7fc617fff640 1 -- 172.21.15.50:0/287900572 learned_addr learned my addr 172.21.15.50:0/287900572 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:59.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.173+0000 7fc61d46d640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc61815c2c0 0x7fc6181f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.173+0000 7fc61cc6c640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6180b3e10 0x7fc61815f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.174+0000 7fc617fff640 1 -- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc61815c2c0 msgr2=0x7fc6181f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.174+0000 7fc617fff640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc61815c2c0 0x7fc6181f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.174+0000 7fc617fff640 1 -- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6180b3e10 msgr2=0x7fc61815f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.174+0000 7fc617fff640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6180b3e10 0x7fc61815f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.174+0000 7fc617fff640 1 -- 172.21.15.50:0/287900572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6181e6d60 con 0x7fc6180d05e0 2024-09-11T22:19:59.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.174+0000 7fc617fff640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180d05e0 0x7fc6181e6820 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fc60400ebe0 tx=0x7fc60400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:59.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.174+0000 7fc6157fa640 1 -- 172.21.15.50:0/287900572 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604017070 con 0x7fc6180d05e0 2024-09-11T22:19:59.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.174+0000 7fc6157fa640 1 -- 172.21.15.50:0/287900572 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60400cbd0 con 0x7fc6180d05e0 2024-09-11T22:19:59.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.174+0000 7fc61eed0640 1 -- 172.21.15.50:0/287900572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61815ffd0 con 0x7fc6180d05e0 2024-09-11T22:19:59.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.174+0000 7fc6157fa640 1 -- 172.21.15.50:0/287900572 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604013470 con 0x7fc6180d05e0 2024-09-11T22:19:59.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.174+0000 7fc61eed0640 1 -- 172.21.15.50:0/287900572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc618160590 con 0x7fc6180d05e0 2024-09-11T22:19:59.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.175+0000 7fc61eed0640 1 -- 172.21.15.50:0/287900572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc61815c6a0 con 0x7fc6180d05e0 2024-09-11T22:19:59.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.176+0000 7fc6157fa640 1 -- 172.21.15.50:0/287900572 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc60401a070 con 0x7fc6180d05e0 2024-09-11T22:19:59.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.176+0000 7fc6157fa640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc5fc06be30 0x7fc5fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.176+0000 7fc6157fa640 1 -- 172.21.15.50:0/287900572 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fc60408ae30 con 0x7fc6180d05e0 2024-09-11T22:19:59.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.177+0000 7fc61cc6c640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc5fc06be30 0x7fc5fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.177+0000 7fc61cc6c640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc5fc06be30 0x7fc5fc06e2f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc60c005880 tx=0x7fc60c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:59.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.180+0000 7fc6157fa640 1 -- 172.21.15.50:0/287900572 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc604059070 con 0x7fc6180d05e0 2024-09-11T22:19:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.354+0000 7fc61eed0640 1 -- 172.21.15.50:0/287900572 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6180b1d10 con 0x7fc5fc06be30 2024-09-11T22:19:59.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.360+0000 7fc6157fa640 1 -- 172.21.15.50:0/287900572 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243829 (secure 0 0 0) 0x7fc6180b1d10 con 0x7fc5fc06be30 2024-09-11T22:19:59.363 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:59.364 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:19:59.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.363+0000 7fc61eed0640 1 -- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc5fc06be30 msgr2=0x7fc5fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.363+0000 7fc61eed0640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc5fc06be30 0x7fc5fc06e2f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc60c005880 tx=0x7fc60c009040 comp rx=0 tx=0).stop 2024-09-11T22:19:59.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.363+0000 7fc61eed0640 1 -- 172.21.15.50:0/287900572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180d05e0 msgr2=0x7fc6181e6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.363+0000 7fc61eed0640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180d05e0 0x7fc6181e6820 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fc60400ebe0 tx=0x7fc60400c520 comp rx=0 tx=0).stop 2024-09-11T22:19:59.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.363+0000 7fc61eed0640 1 -- 172.21.15.50:0/287900572 shutdown_connections 2024-09-11T22:19:59.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.363+0000 7fc61eed0640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc5fc06be30 0x7fc5fc06e2f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.363+0000 7fc61eed0640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc61815c2c0 0x7fc6181f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.363+0000 7fc61eed0640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180d05e0 0x7fc6181e6820 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.363+0000 7fc61eed0640 1 --2- 172.21.15.50:0/287900572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6180b3e10 0x7fc61815f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.363+0000 7fc61eed0640 1 -- 172.21.15.50:0/287900572 >> 172.21.15.50:0/287900572 conn(0x7fc6180679c0 msgr2=0x7fc618154f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:59.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.363+0000 7fc61eed0640 1 -- 172.21.15.50:0/287900572 shutdown_connections 2024-09-11T22:19:59.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.363+0000 7fc61eed0640 1 -- 172.21.15.50:0/287900572 wait complete. 2024-09-11T22:19:59.376 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":405,"stamp":"2024-09-11T22:19:57.491360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591020,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":179,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":104,"acting":104,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":433836,"kb_used_data":14960,"kb_used_omap":12,"kb_used_meta":418675,"kb_avail":754540884,"statfs":{"total":773094113280,"available":772649865216,"internally_reserved":0,"allocated":15319040,"data_stored":7349834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":428723761},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":652,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.028511"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384059+0000","last_change":"2024-09-11T22:19:55.498360+0000","last_active":"2024-09-11T22:19:57.384059+0000","last_peered":"2024-09-11T22:19:57.384059+0000","last_clean":"2024-09-11T22:19:57.384059+0000","last_became_active":"2024-09-11T22:19:55.498102+0000","last_became_peered":"2024-09-11T22:19:55.498102+0000","last_unstale":"2024-09-11T22:19:57.384059+0000","last_undegraded":"2024-09-11T22:19:57.384059+0000","last_fullsized":"2024-09-11T22:19:57.384059+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:21.245925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383767+0000","last_change":"2024-09-11T22:19:55.505563+0000","last_active":"2024-09-11T22:19:57.383767+0000","last_peered":"2024-09-11T22:19:57.383767+0000","last_clean":"2024-09-11T22:19:57.383767+0000","last_became_active":"2024-09-11T22:19:55.504577+0000","last_became_peered":"2024-09-11T22:19:55.504577+0000","last_unstale":"2024-09-11T22:19:57.383767+0000","last_undegraded":"2024-09-11T22:19:57.383767+0000","last_fullsized":"2024-09-11T22:19:57.383767+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:01.707109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383643+0000","last_change":"2024-09-11T22:19:55.502428+0000","last_active":"2024-09-11T22:19:57.383643+0000","last_peered":"2024-09-11T22:19:57.383643+0000","last_clean":"2024-09-11T22:19:57.383643+0000","last_became_active":"2024-09-11T22:19:55.502180+0000","last_became_peered":"2024-09-11T22:19:55.502180+0000","last_unstale":"2024-09-11T22:19:57.383643+0000","last_undegraded":"2024-09-11T22:19:57.383643+0000","last_fullsized":"2024-09-11T22:19:57.383643+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:11.355696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.499189+0000","last_change":"2024-09-11T22:19:55.496357+0000","last_active":"2024-09-11T22:19:55.499189+0000","last_peered":"2024-09-11T22:19:55.499189+0000","last_clean":"2024-09-11T22:19:55.499189+0000","last_became_active":"2024-09-11T22:19:55.496083+0000","last_became_peered":"2024-09-11T22:19:55.496083+0000","last_unstale":"2024-09-11T22:19:55.499189+0000","last_undegraded":"2024-09-11T22:19:55.499189+0000","last_fullsized":"2024-09-11T22:19:55.499189+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:12.169198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384215+0000","last_change":"2024-09-11T22:19:55.496386+0000","last_active":"2024-09-11T22:19:57.384215+0000","last_peered":"2024-09-11T22:19:57.384215+0000","last_clean":"2024-09-11T22:19:57.384215+0000","last_became_active":"2024-09-11T22:19:55.495842+0000","last_became_peered":"2024-09-11T22:19:55.495842+0000","last_unstale":"2024-09-11T22:19:57.384215+0000","last_undegraded":"2024-09-11T22:19:57.384215+0000","last_fullsized":"2024-09-11T22:19:57.384215+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:47.251855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.490399+0000","last_change":"2024-09-11T22:19:55.489451+0000","last_active":"2024-09-11T22:19:55.490399+0000","last_peered":"2024-09-11T22:19:55.490399+0000","last_clean":"2024-09-11T22:19:55.490399+0000","last_became_active":"2024-09-11T22:19:55.489198+0000","last_became_peered":"2024-09-11T22:19:55.489198+0000","last_unstale":"2024-09-11T22:19:55.490399+0000","last_undegraded":"2024-09-11T22:19:55.490399+0000","last_fullsized":"2024-09-11T22:19:55.490399+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.715938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384249+0000","last_change":"2024-09-11T22:19:55.499103+0000","last_active":"2024-09-11T22:19:57.384249+0000","last_peered":"2024-09-11T22:19:57.384249+0000","last_clean":"2024-09-11T22:19:57.384249+0000","last_became_active":"2024-09-11T22:19:55.498817+0000","last_became_peered":"2024-09-11T22:19:55.498817+0000","last_unstale":"2024-09-11T22:19:57.384249+0000","last_undegraded":"2024-09-11T22:19:57.384249+0000","last_fullsized":"2024-09-11T22:19:57.384249+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:45.826396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383730+0000","last_change":"2024-09-11T22:19:55.501801+0000","last_active":"2024-09-11T22:19:57.383730+0000","last_peered":"2024-09-11T22:19:57.383730+0000","last_clean":"2024-09-11T22:19:57.383730+0000","last_became_active":"2024-09-11T22:19:55.501488+0000","last_became_peered":"2024-09-11T22:19:55.501488+0000","last_unstale":"2024-09-11T22:19:57.383730+0000","last_undegraded":"2024-09-11T22:19:57.383730+0000","last_fullsized":"2024-09-11T22:19:57.383730+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:56.830151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.502914+0000","last_change":"2024-09-11T22:19:55.499959+0000","last_active":"2024-09-11T22:19:55.502914+0000","last_peered":"2024-09-11T22:19:55.502914+0000","last_clean":"2024-09-11T22:19:55.502914+0000","last_became_active":"2024-09-11T22:19:55.499649+0000","last_became_peered":"2024-09-11T22:19:55.499649+0000","last_unstale":"2024-09-11T22:19:55.502914+0000","last_undegraded":"2024-09-11T22:19:55.502914+0000","last_fullsized":"2024-09-11T22:19:55.502914+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:28.378190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.508793+0000","last_change":"2024-09-11T22:19:55.507660+0000","last_active":"2024-09-11T22:19:55.508793+0000","last_peered":"2024-09-11T22:19:55.508793+0000","last_clean":"2024-09-11T22:19:55.508793+0000","last_became_active":"2024-09-11T22:19:55.507383+0000","last_became_peered":"2024-09-11T22:19:55.507383+0000","last_unstale":"2024-09-11T22:19:55.508793+0000","last_undegraded":"2024-09-11T22:19:55.508793+0000","last_fullsized":"2024-09-11T22:19:55.508793+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:29.715798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.499209+0000","last_change":"2024-09-11T22:19:55.494531+0000","last_active":"2024-09-11T22:19:55.499209+0000","last_peered":"2024-09-11T22:19:55.499209+0000","last_clean":"2024-09-11T22:19:55.499209+0000","last_became_active":"2024-09-11T22:19:55.491160+0000","last_became_peered":"2024-09-11T22:19:55.491160+0000","last_unstale":"2024-09-11T22:19:55.499209+0000","last_undegraded":"2024-09-11T22:19:55.499209+0000","last_fullsized":"2024-09-11T22:19:55.499209+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:02.052132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384151+0000","last_change":"2024-09-11T22:19:55.504254+0000","last_active":"2024-09-11T22:19:57.384151+0000","last_peered":"2024-09-11T22:19:57.384151+0000","last_clean":"2024-09-11T22:19:57.384151+0000","last_became_active":"2024-09-11T22:19:55.503807+0000","last_became_peered":"2024-09-11T22:19:55.503807+0000","last_unstale":"2024-09-11T22:19:57.384151+0000","last_undegraded":"2024-09-11T22:19:57.384151+0000","last_fullsized":"2024-09-11T22:19:57.384151+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:05.936518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"143'4","reported_seq":18,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384092+0000","last_change":"2024-09-11T22:19:54.477507+0000","last_active":"2024-09-11T22:19:57.384092+0000","last_peered":"2024-09-11T22:19:57.384092+0000","last_clean":"2024-09-11T22:19:57.384092+0000","last_became_active":"2024-09-11T22:19:54.477195+0000","last_became_peered":"2024-09-11T22:19:54.477195+0000","last_unstale":"2024-09-11T22:19:57.384092+0000","last_undegraded":"2024-09-11T22:19:57.384092+0000","last_fullsized":"2024-09-11T22:19:57.384092+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:53.923066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.465377+0000","last_change":"2024-09-11T22:19:53.465377+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.465377+0000","last_undegraded":"2024-09-11T22:19:53.465377+0000","last_fullsized":"2024-09-11T22:19:53.465377+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.468994+0000","last_change":"2024-09-11T22:19:53.468994+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.468994+0000","last_undegraded":"2024-09-11T22:19:53.468994+0000","last_fullsized":"2024-09-11T22:19:53.468994+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383952+0000","last_change":"2024-09-11T22:19:55.504793+0000","last_active":"2024-09-11T22:19:57.383952+0000","last_peered":"2024-09-11T22:19:57.383952+0000","last_clean":"2024-09-11T22:19:57.383952+0000","last_became_active":"2024-09-11T22:19:55.504439+0000","last_became_peered":"2024-09-11T22:19:55.504439+0000","last_unstale":"2024-09-11T22:19:57.383952+0000","last_undegraded":"2024-09-11T22:19:57.383952+0000","last_fullsized":"2024-09-11T22:19:57.383952+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:18.199474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.469023+0000","last_change":"2024-09-11T22:19:53.469023+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.469023+0000","last_undegraded":"2024-09-11T22:19:53.469023+0000","last_fullsized":"2024-09-11T22:19:53.469023+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"143'1","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.508433+0000","last_change":"2024-09-11T22:19:54.486151+0000","last_active":"2024-09-11T22:19:55.508433+0000","last_peered":"2024-09-11T22:19:55.508433+0000","last_clean":"2024-09-11T22:19:55.508433+0000","last_became_active":"2024-09-11T22:19:54.485525+0000","last_became_peered":"2024-09-11T22:19:54.485525+0000","last_unstale":"2024-09-11T22:19:55.508433+0000","last_undegraded":"2024-09-11T22:19:55.508433+0000","last_fullsized":"2024-09-11T22:19:55.508433+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:06.778567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.465232+0000","last_change":"2024-09-11T22:19:53.465232+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.465232+0000","last_undegraded":"2024-09-11T22:19:53.465232+0000","last_fullsized":"2024-09-11T22:19:53.465232+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.481838+0000","last_change":"2024-09-11T22:19:54.484169+0000","last_active":"2024-09-11T22:19:55.481838+0000","last_peered":"2024-09-11T22:19:55.481838+0000","last_clean":"2024-09-11T22:19:55.481838+0000","last_became_active":"2024-09-11T22:19:54.483844+0000","last_became_peered":"2024-09-11T22:19:54.483844+0000","last_unstale":"2024-09-11T22:19:55.481838+0000","last_undegraded":"2024-09-11T22:19:55.481838+0000","last_fullsized":"2024-09-11T22:19:55.481838+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:19.353179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.468769+0000","last_change":"2024-09-11T22:19:53.468769+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.468769+0000","last_undegraded":"2024-09-11T22:19:53.468769+0000","last_fullsized":"2024-09-11T22:19:53.468769+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.464775+0000","last_change":"2024-09-11T22:19:53.464775+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.464775+0000","last_undegraded":"2024-09-11T22:19:53.464775+0000","last_fullsized":"2024-09-11T22:19:53.464775+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384098+0000","last_change":"2024-09-11T22:19:55.496132+0000","last_active":"2024-09-11T22:19:57.384098+0000","last_peered":"2024-09-11T22:19:57.384098+0000","last_clean":"2024-09-11T22:19:57.384098+0000","last_became_active":"2024-09-11T22:19:55.495466+0000","last_became_peered":"2024-09-11T22:19:55.495466+0000","last_unstale":"2024-09-11T22:19:57.384098+0000","last_undegraded":"2024-09-11T22:19:57.384098+0000","last_fullsized":"2024-09-11T22:19:57.384098+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:07.378924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384287+0000","last_change":"2024-09-11T22:19:54.480915+0000","last_active":"2024-09-11T22:19:57.384287+0000","last_peered":"2024-09-11T22:19:57.384287+0000","last_clean":"2024-09-11T22:19:57.384287+0000","last_became_active":"2024-09-11T22:19:54.480633+0000","last_became_peered":"2024-09-11T22:19:54.480633+0000","last_unstale":"2024-09-11T22:19:57.384287+0000","last_undegraded":"2024-09-11T22:19:57.384287+0000","last_fullsized":"2024-09-11T22:19:57.384287+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:37.295459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.490098+0000","last_change":"2024-09-11T22:19:55.487749+0000","last_active":"2024-09-11T22:19:55.490098+0000","last_peered":"2024-09-11T22:19:55.490098+0000","last_clean":"2024-09-11T22:19:55.490098+0000","last_became_active":"2024-09-11T22:19:55.487462+0000","last_became_peered":"2024-09-11T22:19:55.487462+0000","last_unstale":"2024-09-11T22:19:55.490098+0000","last_undegraded":"2024-09-11T22:19:55.490098+0000","last_fullsized":"2024-09-11T22:19:55.490098+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:09.534990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.470427+0000","last_change":"2024-09-11T22:19:53.470427+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.470427+0000","last_undegraded":"2024-09-11T22:19:53.470427+0000","last_fullsized":"2024-09-11T22:19:53.470427+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467947+0000","last_change":"2024-09-11T22:19:53.467947+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467947+0000","last_undegraded":"2024-09-11T22:19:53.467947+0000","last_fullsized":"2024-09-11T22:19:53.467947+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467802+0000","last_change":"2024-09-11T22:19:53.467802+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467802+0000","last_undegraded":"2024-09-11T22:19:53.467802+0000","last_fullsized":"2024-09-11T22:19:53.467802+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467019+0000","last_change":"2024-09-11T22:19:53.467019+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467019+0000","last_undegraded":"2024-09-11T22:19:53.467019+0000","last_fullsized":"2024-09-11T22:19:53.467019+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"143'8","reported_seq":20,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.511146+0000","last_change":"2024-09-11T22:19:54.482849+0000","last_active":"2024-09-11T22:19:55.511146+0000","last_peered":"2024-09-11T22:19:55.511146+0000","last_clean":"2024-09-11T22:19:55.511146+0000","last_became_active":"2024-09-11T22:19:54.482552+0000","last_became_peered":"2024-09-11T22:19:54.482552+0000","last_unstale":"2024-09-11T22:19:55.511146+0000","last_undegraded":"2024-09-11T22:19:55.511146+0000","last_fullsized":"2024-09-11T22:19:55.511146+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:34.396451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384240+0000","last_change":"2024-09-11T22:19:55.496672+0000","last_active":"2024-09-11T22:19:57.384240+0000","last_peered":"2024-09-11T22:19:57.384240+0000","last_clean":"2024-09-11T22:19:57.384240+0000","last_became_active":"2024-09-11T22:19:55.496398+0000","last_became_peered":"2024-09-11T22:19:55.496398+0000","last_unstale":"2024-09-11T22:19:57.384240+0000","last_undegraded":"2024-09-11T22:19:57.384240+0000","last_fullsized":"2024-09-11T22:19:57.384240+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:54.264936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.465362+0000","last_change":"2024-09-11T22:19:53.465362+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.465362+0000","last_undegraded":"2024-09-11T22:19:53.465362+0000","last_fullsized":"2024-09-11T22:19:53.465362+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.502094+0000","last_change":"2024-09-11T22:19:55.498674+0000","last_active":"2024-09-11T22:19:55.502094+0000","last_peered":"2024-09-11T22:19:55.502094+0000","last_clean":"2024-09-11T22:19:55.502094+0000","last_became_active":"2024-09-11T22:19:55.498398+0000","last_became_peered":"2024-09-11T22:19:55.498398+0000","last_unstale":"2024-09-11T22:19:55.502094+0000","last_undegraded":"2024-09-11T22:19:55.502094+0000","last_fullsized":"2024-09-11T22:19:55.502094+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:05.560482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.464847+0000","last_change":"2024-09-11T22:19:53.464847+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.464847+0000","last_undegraded":"2024-09-11T22:19:53.464847+0000","last_fullsized":"2024-09-11T22:19:53.464847+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"143'1","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.508738+0000","last_change":"2024-09-11T22:19:54.484652+0000","last_active":"2024-09-11T22:19:55.508738+0000","last_peered":"2024-09-11T22:19:55.508738+0000","last_clean":"2024-09-11T22:19:55.508738+0000","last_became_active":"2024-09-11T22:19:54.484339+0000","last_became_peered":"2024-09-11T22:19:54.484339+0000","last_unstale":"2024-09-11T22:19:55.508738+0000","last_undegraded":"2024-09-11T22:19:55.508738+0000","last_fullsized":"2024-09-11T22:19:55.508738+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:26.988816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.465058+0000","last_change":"2024-09-11T22:19:53.465058+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.465058+0000","last_undegraded":"2024-09-11T22:19:53.465058+0000","last_fullsized":"2024-09-11T22:19:53.465058+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.470848+0000","last_change":"2024-09-11T22:19:53.470848+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.470848+0000","last_undegraded":"2024-09-11T22:19:53.470848+0000","last_fullsized":"2024-09-11T22:19:53.470848+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383886+0000","last_change":"2024-09-11T22:19:54.474277+0000","last_active":"2024-09-11T22:19:57.383886+0000","last_peered":"2024-09-11T22:19:57.383886+0000","last_clean":"2024-09-11T22:19:57.383886+0000","last_became_active":"2024-09-11T22:19:54.473990+0000","last_became_peered":"2024-09-11T22:19:54.473990+0000","last_unstale":"2024-09-11T22:19:57.383886+0000","last_undegraded":"2024-09-11T22:19:57.383886+0000","last_fullsized":"2024-09-11T22:19:57.383886+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:33.263881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383580+0000","last_change":"2024-09-11T22:19:54.475515+0000","last_active":"2024-09-11T22:19:57.383580+0000","last_peered":"2024-09-11T22:19:57.383580+0000","last_clean":"2024-09-11T22:19:57.383580+0000","last_became_active":"2024-09-11T22:19:54.475217+0000","last_became_peered":"2024-09-11T22:19:54.475217+0000","last_unstale":"2024-09-11T22:19:57.383580+0000","last_undegraded":"2024-09-11T22:19:57.383580+0000","last_fullsized":"2024-09-11T22:19:57.383580+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:57.756890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467819+0000","last_change":"2024-09-11T22:19:53.467819+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467819+0000","last_undegraded":"2024-09-11T22:19:53.467819+0000","last_fullsized":"2024-09-11T22:19:53.467819+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384243+0000","last_change":"2024-09-11T22:19:54.480155+0000","last_active":"2024-09-11T22:19:57.384243+0000","last_peered":"2024-09-11T22:19:57.384243+0000","last_clean":"2024-09-11T22:19:57.384243+0000","last_became_active":"2024-09-11T22:19:54.479875+0000","last_became_peered":"2024-09-11T22:19:54.479875+0000","last_unstale":"2024-09-11T22:19:57.384243+0000","last_undegraded":"2024-09-11T22:19:57.384243+0000","last_fullsized":"2024-09-11T22:19:57.384243+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:39:16.361022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467650+0000","last_change":"2024-09-11T22:19:53.467650+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467650+0000","last_undegraded":"2024-09-11T22:19:53.467650+0000","last_fullsized":"2024-09-11T22:19:53.467650+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467144+0000","last_change":"2024-09-11T22:19:53.467144+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467144+0000","last_undegraded":"2024-09-11T22:19:53.467144+0000","last_fullsized":"2024-09-11T22:19:53.467144+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.467053+0000","last_change":"2024-09-11T22:19:53.467053+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.467053+0000","last_undegraded":"2024-09-11T22:19:53.467053+0000","last_fullsized":"2024-09-11T22:19:53.467053+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.503074+0000","last_change":"2024-09-11T22:19:55.500191+0000","last_active":"2024-09-11T22:19:55.503074+0000","last_peered":"2024-09-11T22:19:55.503074+0000","last_clean":"2024-09-11T22:19:55.503074+0000","last_became_active":"2024-09-11T22:19:55.499703+0000","last_became_peered":"2024-09-11T22:19:55.499703+0000","last_unstale":"2024-09-11T22:19:55.503074+0000","last_undegraded":"2024-09-11T22:19:55.503074+0000","last_fullsized":"2024-09-11T22:19:55.503074+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:06.196494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.470360+0000","last_change":"2024-09-11T22:19:53.470360+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.470360+0000","last_undegraded":"2024-09-11T22:19:53.470360+0000","last_fullsized":"2024-09-11T22:19:53.470360+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383723+0000","last_change":"2024-09-11T22:19:54.482877+0000","last_active":"2024-09-11T22:19:57.383723+0000","last_peered":"2024-09-11T22:19:57.383723+0000","last_clean":"2024-09-11T22:19:57.383723+0000","last_became_active":"2024-09-11T22:19:54.482462+0000","last_became_peered":"2024-09-11T22:19:54.482462+0000","last_unstale":"2024-09-11T22:19:57.383723+0000","last_undegraded":"2024-09-11T22:19:57.383723+0000","last_fullsized":"2024-09-11T22:19:57.383723+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:50.629566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383704+0000","last_change":"2024-09-11T22:19:55.503903+0000","last_active":"2024-09-11T22:19:57.383704+0000","last_peered":"2024-09-11T22:19:57.383704+0000","last_clean":"2024-09-11T22:19:57.383704+0000","last_became_active":"2024-09-11T22:19:55.503606+0000","last_became_peered":"2024-09-11T22:19:55.503606+0000","last_unstale":"2024-09-11T22:19:57.383704+0000","last_undegraded":"2024-09-11T22:19:57.383704+0000","last_fullsized":"2024-09-11T22:19:57.383704+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:41.678234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.468264+0000","last_change":"2024-09-11T22:19:53.468264+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.468264+0000","last_undegraded":"2024-09-11T22:19:53.468264+0000","last_fullsized":"2024-09-11T22:19:53.468264+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.464772+0000","last_change":"2024-09-11T22:19:53.464772+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.464772+0000","last_undegraded":"2024-09-11T22:19:53.464772+0000","last_fullsized":"2024-09-11T22:19:53.464772+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:19:54.461141+0000","last_change":"2024-09-11T22:19:54.461141+0000","last_active":"2024-09-11T22:19:54.461141+0000","last_peered":"2024-09-11T22:19:54.461141+0000","last_clean":"2024-09-11T22:19:54.461141+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:54.461141+0000","last_undegraded":"2024-09-11T22:19:54.461141+0000","last_fullsized":"2024-09-11T22:19:54.461141+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-09-11T22:19:53.468023+0000","last_change":"2024-09-11T22:19:53.468023+0000","last_active":"2024-09-11T22:19:53.459363+0000","last_peered":"2024-09-11T22:19:53.459363+0000","last_clean":"2024-09-11T22:19:53.459363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:19:53.468023+0000","last_undegraded":"2024-09-11T22:19:53.468023+0000","last_fullsized":"2024-09-11T22:19:53.468023+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":393,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383815+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:19:57.383815+0000","last_peered":"2024-09-11T22:19:57.383815+0000","last_clean":"2024-09-11T22:19:57.383815+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:19:57.383815+0000","last_undegraded":"2024-09-11T22:19:57.383815+0000","last_fullsized":"2024-09-11T22:19:57.383815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":38,"acting":38,"num_store_stats":2},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":652,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509551,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50952,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320888,"statfs":{"total":96636764160,"available":96584589312,"internally_reserved":0,"allocated":1757184,"data_stored":767583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509548,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46796,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325044,"statfs":{"total":96636764160,"available":96588845056,"internally_reserved":0,"allocated":1757184,"data_stored":767583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509550,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50956,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320884,"statfs":{"total":96636764160,"available":96584585216,"internally_reserved":0,"allocated":1757184,"data_stored":767583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509550,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59276,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312564,"statfs":{"total":96636764160,"available":96576065536,"internally_reserved":0,"allocated":1757184,"data_stored":767583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509550,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59276,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312564,"statfs":{"total":96636764160,"available":96576065536,"internally_reserved":0,"allocated":1757184,"data_stored":767583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509549,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55696,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316144,"statfs":{"total":96636764160,"available":96579731456,"internally_reserved":0,"allocated":2351104,"data_stored":1357951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51564,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320276,"statfs":{"total":96636764160,"available":96583962624,"internally_reserved":0,"allocated":2383872,"data_stored":1371653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59320,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312520,"statfs":{"total":96636764160,"available":96576020480,"internally_reserved":0,"allocated":1798144,"data_stored":782315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:19:59.380 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:19:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.518+0000 7fa1b8df6640 1 Processor -- start 2024-09-11T22:19:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.518+0000 7fa1b8df6640 1 -- start start 2024-09-11T22:19:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.519+0000 7fa1b8df6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1b415e8e0 0x7fa1b40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.519+0000 7fa1b8df6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1b40d1580 0x7fa1b40d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.519+0000 7fa1b8df6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1b4162350 0x7fa1b4162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.519+0000 7fa1b8df6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b415ecc0 con 0x7fa1b4162350 2024-09-11T22:19:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.519+0000 7fa1b8df6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b40d2ad0 con 0x7fa1b415e8e0 2024-09-11T22:19:59.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.519+0000 7fa1b8df6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b40d3370 con 0x7fa1b40d1580 2024-09-11T22:19:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.519+0000 7fa1b2d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1b4162350 0x7fa1b4162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.519+0000 7fa1b2d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1b4162350 0x7fa1b4162800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45256/0 (socket says 172.21.15.50:45256) 2024-09-11T22:19:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.519+0000 7fa1b2d9d640 1 -- 172.21.15.50:0/1349490448 learned_addr learned my addr 172.21.15.50:0/1349490448 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.519+0000 7fa1b2d9d640 1 -- 172.21.15.50:0/1349490448 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1b40d1580 msgr2=0x7fa1b40d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.520+0000 7fa1b259c640 1 --2- 172.21.15.50:0/1349490448 >> v2:172.21.15.77:3300/0 conn(0x7fa1b415e8e0 0x7fa1b40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.520+0000 7fa1b1d9b640 1 --2- 172.21.15.50:0/1349490448 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1b40d1580 0x7fa1b40d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.520+0000 7fa1b2d9d640 1 --2- 172.21.15.50:0/1349490448 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1b40d1580 0x7fa1b40d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.520+0000 7fa1b2d9d640 1 -- 172.21.15.50:0/1349490448 >> v2:172.21.15.77:3300/0 conn(0x7fa1b415e8e0 msgr2=0x7fa1b40b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.520+0000 7fa1b2d9d640 1 --2- 172.21.15.50:0/1349490448 >> v2:172.21.15.77:3300/0 conn(0x7fa1b415e8e0 0x7fa1b40b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.520+0000 7fa1b2d9d640 1 -- 172.21.15.50:0/1349490448 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b40d1ee0 con 0x7fa1b4162350 2024-09-11T22:19:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.520+0000 7fa1b259c640 1 --2- 172.21.15.50:0/1349490448 >> v2:172.21.15.77:3300/0 conn(0x7fa1b415e8e0 0x7fa1b40b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.520+0000 7fa1b1d9b640 1 --2- 172.21.15.50:0/1349490448 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1b40d1580 0x7fa1b40d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:19:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.520+0000 7fa1b2d9d640 1 --2- 172.21.15.50:0/1349490448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1b4162350 0x7fa1b4162800 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fa1b408d630 tx=0x7fa1ac02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97de2fb298a4886b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.520+0000 7fa1b159a640 1 -- 172.21.15.50:0/1349490448 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac036070 con 0x7fa1b4162350 2024-09-11T22:19:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.521+0000 7fa1b159a640 1 -- 172.21.15.50:0/1349490448 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ac031600 con 0x7fa1b4162350 2024-09-11T22:19:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.521+0000 7fa1b159a640 1 -- 172.21.15.50:0/1349490448 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac0319d0 con 0x7fa1b4162350 2024-09-11T22:19:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.521+0000 7fa1b8df6640 1 -- 172.21.15.50:0/1349490448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1b4162350 msgr2=0x7fa1b4162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.521+0000 7fa1b8df6640 1 --2- 172.21.15.50:0/1349490448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1b4162350 0x7fa1b4162800 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fa1b408d630 tx=0x7fa1ac02a730 comp rx=0 tx=0).stop 2024-09-11T22:19:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.521+0000 7fa1b8df6640 1 -- 172.21.15.50:0/1349490448 shutdown_connections 2024-09-11T22:19:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.521+0000 7fa1b8df6640 1 --2- 172.21.15.50:0/1349490448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1b4162350 0x7fa1b4162800 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.521+0000 7fa1b8df6640 1 --2- 172.21.15.50:0/1349490448 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1b40d1580 0x7fa1b40d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.521+0000 7fa1b8df6640 1 --2- 172.21.15.50:0/1349490448 >> v2:172.21.15.77:3300/0 conn(0x7fa1b415e8e0 0x7fa1b40b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.521+0000 7fa1b8df6640 1 -- 172.21.15.50:0/1349490448 >> 172.21.15.50:0/1349490448 conn(0x7fa1b4067ba0 msgr2=0x7fa1b4067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.521+0000 7fa1b8df6640 1 -- 172.21.15.50:0/1349490448 shutdown_connections 2024-09-11T22:19:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.521+0000 7fa1b8df6640 1 -- 172.21.15.50:0/1349490448 wait complete. 2024-09-11T22:19:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.522+0000 7fa1b8df6640 1 Processor -- start 2024-09-11T22:19:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.523+0000 7fa1b8df6640 1 -- start start 2024-09-11T22:19:59.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.523+0000 7fa1b8df6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1b40d1580 0x7fa1b41551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.523+0000 7fa1b8df6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b415e8e0 0x7fa1b40d3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.523+0000 7fa1b8df6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1b4162350 0x7fa1b40d4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.523+0000 7fa1b8df6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b40d3000 con 0x7fa1b4162350 2024-09-11T22:19:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.523+0000 7fa1b8df6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b40d2d20 con 0x7fa1b415e8e0 2024-09-11T22:19:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.523+0000 7fa1b8df6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b4162d40 con 0x7fa1b40d1580 2024-09-11T22:19:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.523+0000 7fa1b2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1b4162350 0x7fa1b40d4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.523+0000 7fa1b2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1b4162350 0x7fa1b40d4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45266/0 (socket says 172.21.15.50:45266) 2024-09-11T22:19:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.523+0000 7fa1b2d9d640 1 -- 172.21.15.50:0/963148978 learned_addr learned my addr 172.21.15.50:0/963148978 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.523+0000 7fa1b259c640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1b40d1580 0x7fa1b41551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.523+0000 7fa1b1d9b640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b415e8e0 0x7fa1b40d3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.524+0000 7fa1b2d9d640 1 -- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1b40d1580 msgr2=0x7fa1b41551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.524+0000 7fa1b2d9d640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1b40d1580 0x7fa1b41551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.524+0000 7fa1b2d9d640 1 -- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b415e8e0 msgr2=0x7fa1b40d3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.524+0000 7fa1b2d9d640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b415e8e0 0x7fa1b40d3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.524+0000 7fa1b2d9d640 1 -- 172.21.15.50:0/963148978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b40cd9f0 con 0x7fa1b4162350 2024-09-11T22:19:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.524+0000 7fa1b1d9b640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b415e8e0 0x7fa1b40d3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.524+0000 7fa1b2d9d640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1b4162350 0x7fa1b40d4440 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac02ad20 tx=0x7fa1ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.524+0000 7fa1a2ffd640 1 -- 172.21.15.50:0/963148978 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac036050 con 0x7fa1b4162350 2024-09-11T22:19:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.524+0000 7fa1a2ffd640 1 -- 172.21.15.50:0/963148978 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ac042070 con 0x7fa1b4162350 2024-09-11T22:19:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.524+0000 7fa1b8df6640 1 -- 172.21.15.50:0/963148978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b40b4380 con 0x7fa1b4162350 2024-09-11T22:19:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.524+0000 7fa1a2ffd640 1 -- 172.21.15.50:0/963148978 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac009510 con 0x7fa1b4162350 2024-09-11T22:19:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.524+0000 7fa1b8df6640 1 -- 172.21.15.50:0/963148978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b40b4620 con 0x7fa1b4162350 2024-09-11T22:19:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.525+0000 7fa1b8df6640 1 -- 172.21.15.50:0/963148978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b40b7880 con 0x7fa1b4162350 2024-09-11T22:19:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.526+0000 7fa1a2ffd640 1 -- 172.21.15.50:0/963148978 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1ac007bf0 con 0x7fa1b4162350 2024-09-11T22:19:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.526+0000 7fa1a2ffd640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa19406be30 0x7fa19406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.526+0000 7fa1a2ffd640 1 -- 172.21.15.50:0/963148978 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fa1ac0abb60 con 0x7fa1b4162350 2024-09-11T22:19:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.526+0000 7fa1b259c640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa19406be30 0x7fa19406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.527+0000 7fa1b259c640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa19406be30 0x7fa19406e2f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400ab60 tx=0x7fa1a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.531+0000 7fa1a2ffd640 1 -- 172.21.15.50:0/963148978 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1ac079f50 con 0x7fa1b4162350 2024-09-11T22:19:59.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.703+0000 7fa1b8df6640 1 -- 172.21.15.50:0/963148978 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa1b4155720 con 0x7fa19406be30 2024-09-11T22:19:59.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.709+0000 7fa1a2ffd640 1 -- 172.21.15.50:0/963148978 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252479 (secure 0 0 0) 0x7fa1a400fa40 con 0x7fa19406be30 2024-09-11T22:19:59.713 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:19:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:19:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.712+0000 7fa1b8df6640 1 -- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa19406be30 msgr2=0x7fa19406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.712+0000 7fa1b8df6640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa19406be30 0x7fa19406e2f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400ab60 tx=0x7fa1a4008040 comp rx=0 tx=0).stop 2024-09-11T22:19:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.712+0000 7fa1b8df6640 1 -- 172.21.15.50:0/963148978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1b4162350 msgr2=0x7fa1b40d4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.712+0000 7fa1b8df6640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1b4162350 0x7fa1b40d4440 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac02ad20 tx=0x7fa1ac004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.712+0000 7fa1b8df6640 1 -- 172.21.15.50:0/963148978 shutdown_connections 2024-09-11T22:19:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.712+0000 7fa1b8df6640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa19406be30 0x7fa19406e2f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.712+0000 7fa1b8df6640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1b4162350 0x7fa1b40d4440 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.712+0000 7fa1b8df6640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b415e8e0 0x7fa1b40d3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.712+0000 7fa1b8df6640 1 --2- 172.21.15.50:0/963148978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1b40d1580 0x7fa1b41551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.712+0000 7fa1b8df6640 1 -- 172.21.15.50:0/963148978 >> 172.21.15.50:0/963148978 conn(0x7fa1b4067ba0 msgr2=0x7fa1b415ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.713+0000 7fa1b8df6640 1 -- 172.21.15.50:0/963148978 shutdown_connections 2024-09-11T22:19:59.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.713+0000 7fa1b8df6640 1 -- 172.21.15.50:0/963148978 wait complete. 2024-09-11T22:19:59.725 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-11T22:19:59.491894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":434092,"kb_used_data":15216,"kb_used_omap":12,"kb_used_meta":418675,"kb_avail":754540628,"statfs":{"total":773094113280,"available":772649603072,"internally_reserved":0,"allocated":15581184,"data_stored":7468420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":428723761},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001413"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488278+0000","last_change":"2024-09-11T22:19:55.497801+0000","last_active":"2024-09-11T22:19:56.488278+0000","last_peered":"2024-09-11T22:19:56.488278+0000","last_clean":"2024-09-11T22:19:56.488278+0000","last_became_active":"2024-09-11T22:19:55.495941+0000","last_became_peered":"2024-09-11T22:19:55.495941+0000","last_unstale":"2024-09-11T22:19:56.488278+0000","last_undegraded":"2024-09-11T22:19:56.488278+0000","last_fullsized":"2024-09-11T22:19:56.488278+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.189171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141363+0000","last_change":"2024-09-11T22:19:55.488456+0000","last_active":"2024-09-11T22:19:58.141363+0000","last_peered":"2024-09-11T22:19:58.141363+0000","last_clean":"2024-09-11T22:19:58.141363+0000","last_became_active":"2024-09-11T22:19:55.487771+0000","last_became_peered":"2024-09-11T22:19:55.487771+0000","last_unstale":"2024-09-11T22:19:58.141363+0000","last_undegraded":"2024-09-11T22:19:58.141363+0000","last_fullsized":"2024-09-11T22:19:58.141363+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:27.523574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.289017+0000","last_change":"2024-09-11T22:19:55.500016+0000","last_active":"2024-09-11T22:19:57.289017+0000","last_peered":"2024-09-11T22:19:57.289017+0000","last_clean":"2024-09-11T22:19:57.289017+0000","last_became_active":"2024-09-11T22:19:55.499052+0000","last_became_peered":"2024-09-11T22:19:55.499052+0000","last_unstale":"2024-09-11T22:19:57.289017+0000","last_undegraded":"2024-09-11T22:19:57.289017+0000","last_fullsized":"2024-09-11T22:19:57.289017+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.189171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491124+0000","last_change":"2024-09-11T22:19:55.497597+0000","last_active":"2024-09-11T22:19:56.491124+0000","last_peered":"2024-09-11T22:19:56.491124+0000","last_clean":"2024-09-11T22:19:56.491124+0000","last_became_active":"2024-09-11T22:19:55.497250+0000","last_became_peered":"2024-09-11T22:19:55.497250+0000","last_unstale":"2024-09-11T22:19:56.491124+0000","last_undegraded":"2024-09-11T22:19:56.491124+0000","last_fullsized":"2024-09-11T22:19:56.491124+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:01.548622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491118+0000","last_change":"2024-09-11T22:19:55.498292+0000","last_active":"2024-09-11T22:19:56.491118+0000","last_peered":"2024-09-11T22:19:56.491118+0000","last_clean":"2024-09-11T22:19:56.491118+0000","last_became_active":"2024-09-11T22:19:55.497218+0000","last_became_peered":"2024-09-11T22:19:55.497218+0000","last_unstale":"2024-09-11T22:19:56.491118+0000","last_undegraded":"2024-09-11T22:19:56.491118+0000","last_fullsized":"2024-09-11T22:19:56.491118+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:23.922387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487971+0000","last_change":"2024-09-11T22:19:55.496613+0000","last_active":"2024-09-11T22:19:56.487971+0000","last_peered":"2024-09-11T22:19:56.487971+0000","last_clean":"2024-09-11T22:19:56.487971+0000","last_became_active":"2024-09-11T22:19:55.496353+0000","last_became_peered":"2024-09-11T22:19:55.496353+0000","last_unstale":"2024-09-11T22:19:56.487971+0000","last_undegraded":"2024-09-11T22:19:56.487971+0000","last_fullsized":"2024-09-11T22:19:56.487971+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:08.530682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140645+0000","last_change":"2024-09-11T22:19:55.492627+0000","last_active":"2024-09-11T22:19:58.140645+0000","last_peered":"2024-09-11T22:19:58.140645+0000","last_clean":"2024-09-11T22:19:58.140645+0000","last_became_active":"2024-09-11T22:19:55.491897+0000","last_became_peered":"2024-09-11T22:19:55.491897+0000","last_unstale":"2024-09-11T22:19:58.140645+0000","last_undegraded":"2024-09-11T22:19:58.140645+0000","last_fullsized":"2024-09-11T22:19:58.140645+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:26.538537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487774+0000","last_change":"2024-09-11T22:19:55.492362+0000","last_active":"2024-09-11T22:19:56.487774+0000","last_peered":"2024-09-11T22:19:56.487774+0000","last_clean":"2024-09-11T22:19:56.487774+0000","last_became_active":"2024-09-11T22:19:55.491940+0000","last_became_peered":"2024-09-11T22:19:55.491940+0000","last_unstale":"2024-09-11T22:19:56.487774+0000","last_undegraded":"2024-09-11T22:19:56.487774+0000","last_fullsized":"2024-09-11T22:19:56.487774+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:41.636678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141189+0000","last_change":"2024-09-11T22:19:55.492631+0000","last_active":"2024-09-11T22:19:58.141189+0000","last_peered":"2024-09-11T22:19:58.141189+0000","last_clean":"2024-09-11T22:19:58.141189+0000","last_became_active":"2024-09-11T22:19:55.492345+0000","last_became_peered":"2024-09-11T22:19:55.492345+0000","last_unstale":"2024-09-11T22:19:58.141189+0000","last_undegraded":"2024-09-11T22:19:58.141189+0000","last_fullsized":"2024-09-11T22:19:58.141189+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:37.934511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384059+0000","last_change":"2024-09-11T22:19:55.498360+0000","last_active":"2024-09-11T22:19:57.384059+0000","last_peered":"2024-09-11T22:19:57.384059+0000","last_clean":"2024-09-11T22:19:57.384059+0000","last_became_active":"2024-09-11T22:19:55.498102+0000","last_became_peered":"2024-09-11T22:19:55.498102+0000","last_unstale":"2024-09-11T22:19:57.384059+0000","last_undegraded":"2024-09-11T22:19:57.384059+0000","last_fullsized":"2024-09-11T22:19:57.384059+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:21.245925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488107+0000","last_change":"2024-09-11T22:19:55.502131+0000","last_active":"2024-09-11T22:19:56.488107+0000","last_peered":"2024-09-11T22:19:56.488107+0000","last_clean":"2024-09-11T22:19:56.488107+0000","last_became_active":"2024-09-11T22:19:55.501541+0000","last_became_peered":"2024-09-11T22:19:55.501541+0000","last_unstale":"2024-09-11T22:19:56.488107+0000","last_undegraded":"2024-09-11T22:19:56.488107+0000","last_fullsized":"2024-09-11T22:19:56.488107+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:48.541584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383767+0000","last_change":"2024-09-11T22:19:55.505563+0000","last_active":"2024-09-11T22:19:57.383767+0000","last_peered":"2024-09-11T22:19:57.383767+0000","last_clean":"2024-09-11T22:19:57.383767+0000","last_became_active":"2024-09-11T22:19:55.504577+0000","last_became_peered":"2024-09-11T22:19:55.504577+0000","last_unstale":"2024-09-11T22:19:57.383767+0000","last_undegraded":"2024-09-11T22:19:57.383767+0000","last_fullsized":"2024-09-11T22:19:57.383767+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:01.707109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491282+0000","last_change":"2024-09-11T22:19:55.497465+0000","last_active":"2024-09-11T22:19:56.491282+0000","last_peered":"2024-09-11T22:19:56.491282+0000","last_clean":"2024-09-11T22:19:56.491282+0000","last_became_active":"2024-09-11T22:19:55.496884+0000","last_became_peered":"2024-09-11T22:19:55.496884+0000","last_unstale":"2024-09-11T22:19:56.491282+0000","last_undegraded":"2024-09-11T22:19:56.491282+0000","last_fullsized":"2024-09-11T22:19:56.491282+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:07.952832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490641+0000","last_change":"2024-09-11T22:19:55.493735+0000","last_active":"2024-09-11T22:19:56.490641+0000","last_peered":"2024-09-11T22:19:56.490641+0000","last_clean":"2024-09-11T22:19:56.490641+0000","last_became_active":"2024-09-11T22:19:55.493287+0000","last_became_peered":"2024-09-11T22:19:55.493287+0000","last_unstale":"2024-09-11T22:19:56.490641+0000","last_undegraded":"2024-09-11T22:19:56.490641+0000","last_fullsized":"2024-09-11T22:19:56.490641+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:23.106236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383643+0000","last_change":"2024-09-11T22:19:55.502428+0000","last_active":"2024-09-11T22:19:57.383643+0000","last_peered":"2024-09-11T22:19:57.383643+0000","last_clean":"2024-09-11T22:19:57.383643+0000","last_became_active":"2024-09-11T22:19:55.502180+0000","last_became_peered":"2024-09-11T22:19:55.502180+0000","last_unstale":"2024-09-11T22:19:57.383643+0000","last_undegraded":"2024-09-11T22:19:57.383643+0000","last_fullsized":"2024-09-11T22:19:57.383643+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:11.355696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.499189+0000","last_change":"2024-09-11T22:19:55.496357+0000","last_active":"2024-09-11T22:19:55.499189+0000","last_peered":"2024-09-11T22:19:55.499189+0000","last_clean":"2024-09-11T22:19:55.499189+0000","last_became_active":"2024-09-11T22:19:55.496083+0000","last_became_peered":"2024-09-11T22:19:55.496083+0000","last_unstale":"2024-09-11T22:19:55.499189+0000","last_undegraded":"2024-09-11T22:19:55.499189+0000","last_fullsized":"2024-09-11T22:19:55.499189+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:12.169198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384215+0000","last_change":"2024-09-11T22:19:55.496386+0000","last_active":"2024-09-11T22:19:57.384215+0000","last_peered":"2024-09-11T22:19:57.384215+0000","last_clean":"2024-09-11T22:19:57.384215+0000","last_became_active":"2024-09-11T22:19:55.495842+0000","last_became_peered":"2024-09-11T22:19:55.495842+0000","last_unstale":"2024-09-11T22:19:57.384215+0000","last_undegraded":"2024-09-11T22:19:57.384215+0000","last_fullsized":"2024-09-11T22:19:57.384215+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:47.251855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288947+0000","last_change":"2024-09-11T22:19:55.494110+0000","last_active":"2024-09-11T22:19:57.288947+0000","last_peered":"2024-09-11T22:19:57.288947+0000","last_clean":"2024-09-11T22:19:57.288947+0000","last_became_active":"2024-09-11T22:19:55.493859+0000","last_became_peered":"2024-09-11T22:19:55.493859+0000","last_unstale":"2024-09-11T22:19:57.288947+0000","last_undegraded":"2024-09-11T22:19:57.288947+0000","last_fullsized":"2024-09-11T22:19:57.288947+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:23.106236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488351+0000","last_change":"2024-09-11T22:19:55.502886+0000","last_active":"2024-09-11T22:19:56.488351+0000","last_peered":"2024-09-11T22:19:56.488351+0000","last_clean":"2024-09-11T22:19:56.488351+0000","last_became_active":"2024-09-11T22:19:55.495715+0000","last_became_peered":"2024-09-11T22:19:55.495715+0000","last_unstale":"2024-09-11T22:19:56.488351+0000","last_undegraded":"2024-09-11T22:19:56.488351+0000","last_fullsized":"2024-09-11T22:19:56.488351+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:16.795325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.490399+0000","last_change":"2024-09-11T22:19:55.489451+0000","last_active":"2024-09-11T22:19:55.490399+0000","last_peered":"2024-09-11T22:19:55.490399+0000","last_clean":"2024-09-11T22:19:55.490399+0000","last_became_active":"2024-09-11T22:19:55.489198+0000","last_became_peered":"2024-09-11T22:19:55.489198+0000","last_unstale":"2024-09-11T22:19:55.490399+0000","last_undegraded":"2024-09-11T22:19:55.490399+0000","last_fullsized":"2024-09-11T22:19:55.490399+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.715938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384249+0000","last_change":"2024-09-11T22:19:55.499103+0000","last_active":"2024-09-11T22:19:57.384249+0000","last_peered":"2024-09-11T22:19:57.384249+0000","last_clean":"2024-09-11T22:19:57.384249+0000","last_became_active":"2024-09-11T22:19:55.498817+0000","last_became_peered":"2024-09-11T22:19:55.498817+0000","last_unstale":"2024-09-11T22:19:57.384249+0000","last_undegraded":"2024-09-11T22:19:57.384249+0000","last_fullsized":"2024-09-11T22:19:57.384249+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:45.826396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490862+0000","last_change":"2024-09-11T22:19:55.492448+0000","last_active":"2024-09-11T22:19:56.490862+0000","last_peered":"2024-09-11T22:19:56.490862+0000","last_clean":"2024-09-11T22:19:56.490862+0000","last_became_active":"2024-09-11T22:19:55.491976+0000","last_became_peered":"2024-09-11T22:19:55.491976+0000","last_unstale":"2024-09-11T22:19:56.490862+0000","last_undegraded":"2024-09-11T22:19:56.490862+0000","last_fullsized":"2024-09-11T22:19:56.490862+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.189171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490767+0000","last_change":"2024-09-11T22:19:55.489318+0000","last_active":"2024-09-11T22:19:56.490767+0000","last_peered":"2024-09-11T22:19:56.490767+0000","last_clean":"2024-09-11T22:19:56.490767+0000","last_became_active":"2024-09-11T22:19:55.489045+0000","last_became_peered":"2024-09-11T22:19:55.489045+0000","last_unstale":"2024-09-11T22:19:56.490767+0000","last_undegraded":"2024-09-11T22:19:56.490767+0000","last_fullsized":"2024-09-11T22:19:56.490767+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.589766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383730+0000","last_change":"2024-09-11T22:19:55.501801+0000","last_active":"2024-09-11T22:19:57.383730+0000","last_peered":"2024-09-11T22:19:57.383730+0000","last_clean":"2024-09-11T22:19:57.383730+0000","last_became_active":"2024-09-11T22:19:55.501488+0000","last_became_peered":"2024-09-11T22:19:55.501488+0000","last_unstale":"2024-09-11T22:19:57.383730+0000","last_undegraded":"2024-09-11T22:19:57.383730+0000","last_fullsized":"2024-09-11T22:19:57.383730+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:56.830151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.502914+0000","last_change":"2024-09-11T22:19:55.499959+0000","last_active":"2024-09-11T22:19:55.502914+0000","last_peered":"2024-09-11T22:19:55.502914+0000","last_clean":"2024-09-11T22:19:55.502914+0000","last_became_active":"2024-09-11T22:19:55.499649+0000","last_became_peered":"2024-09-11T22:19:55.499649+0000","last_unstale":"2024-09-11T22:19:55.502914+0000","last_undegraded":"2024-09-11T22:19:55.502914+0000","last_fullsized":"2024-09-11T22:19:55.502914+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:28.378190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488115+0000","last_change":"2024-09-11T22:19:55.492128+0000","last_active":"2024-09-11T22:19:56.488115+0000","last_peered":"2024-09-11T22:19:56.488115+0000","last_clean":"2024-09-11T22:19:56.488115+0000","last_became_active":"2024-09-11T22:19:55.491752+0000","last_became_peered":"2024-09-11T22:19:55.491752+0000","last_unstale":"2024-09-11T22:19:56.488115+0000","last_undegraded":"2024-09-11T22:19:56.488115+0000","last_fullsized":"2024-09-11T22:19:56.488115+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:26.649106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.508793+0000","last_change":"2024-09-11T22:19:55.507660+0000","last_active":"2024-09-11T22:19:55.508793+0000","last_peered":"2024-09-11T22:19:55.508793+0000","last_clean":"2024-09-11T22:19:55.508793+0000","last_became_active":"2024-09-11T22:19:55.507383+0000","last_became_peered":"2024-09-11T22:19:55.507383+0000","last_unstale":"2024-09-11T22:19:55.508793+0000","last_undegraded":"2024-09-11T22:19:55.508793+0000","last_fullsized":"2024-09-11T22:19:55.508793+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:29.715798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140930+0000","last_change":"2024-09-11T22:19:55.494927+0000","last_active":"2024-09-11T22:19:58.140930+0000","last_peered":"2024-09-11T22:19:58.140930+0000","last_clean":"2024-09-11T22:19:58.140930+0000","last_became_active":"2024-09-11T22:19:55.494588+0000","last_became_peered":"2024-09-11T22:19:55.494588+0000","last_unstale":"2024-09-11T22:19:58.140930+0000","last_undegraded":"2024-09-11T22:19:58.140930+0000","last_fullsized":"2024-09-11T22:19:58.140930+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:18.667141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487852+0000","last_change":"2024-09-11T22:19:55.496473+0000","last_active":"2024-09-11T22:19:56.487852+0000","last_peered":"2024-09-11T22:19:56.487852+0000","last_clean":"2024-09-11T22:19:56.487852+0000","last_became_active":"2024-09-11T22:19:55.495733+0000","last_became_peered":"2024-09-11T22:19:55.495733+0000","last_unstale":"2024-09-11T22:19:56.487852+0000","last_undegraded":"2024-09-11T22:19:56.487852+0000","last_fullsized":"2024-09-11T22:19:56.487852+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:26.459071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491021+0000","last_change":"2024-09-11T22:19:55.497030+0000","last_active":"2024-09-11T22:19:56.491021+0000","last_peered":"2024-09-11T22:19:56.491021+0000","last_clean":"2024-09-11T22:19:56.491021+0000","last_became_active":"2024-09-11T22:19:55.496463+0000","last_became_peered":"2024-09-11T22:19:55.496463+0000","last_unstale":"2024-09-11T22:19:56.491021+0000","last_undegraded":"2024-09-11T22:19:56.491021+0000","last_fullsized":"2024-09-11T22:19:56.491021+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:46.193176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141160+0000","last_change":"2024-09-11T22:19:55.501904+0000","last_active":"2024-09-11T22:19:58.141160+0000","last_peered":"2024-09-11T22:19:58.141160+0000","last_clean":"2024-09-11T22:19:58.141160+0000","last_became_active":"2024-09-11T22:19:55.501549+0000","last_became_peered":"2024-09-11T22:19:55.501549+0000","last_unstale":"2024-09-11T22:19:58.141160+0000","last_undegraded":"2024-09-11T22:19:58.141160+0000","last_fullsized":"2024-09-11T22:19:58.141160+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:10.399156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.499209+0000","last_change":"2024-09-11T22:19:55.494531+0000","last_active":"2024-09-11T22:19:55.499209+0000","last_peered":"2024-09-11T22:19:55.499209+0000","last_clean":"2024-09-11T22:19:55.499209+0000","last_became_active":"2024-09-11T22:19:55.491160+0000","last_became_peered":"2024-09-11T22:19:55.491160+0000","last_unstale":"2024-09-11T22:19:55.499209+0000","last_undegraded":"2024-09-11T22:19:55.499209+0000","last_fullsized":"2024-09-11T22:19:55.499209+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:02.052132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384151+0000","last_change":"2024-09-11T22:19:55.504254+0000","last_active":"2024-09-11T22:19:57.384151+0000","last_peered":"2024-09-11T22:19:57.384151+0000","last_clean":"2024-09-11T22:19:57.384151+0000","last_became_active":"2024-09-11T22:19:55.503807+0000","last_became_peered":"2024-09-11T22:19:55.503807+0000","last_unstale":"2024-09-11T22:19:57.384151+0000","last_undegraded":"2024-09-11T22:19:57.384151+0000","last_fullsized":"2024-09-11T22:19:57.384151+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:05.936518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"143'4","reported_seq":18,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384092+0000","last_change":"2024-09-11T22:19:54.477507+0000","last_active":"2024-09-11T22:19:57.384092+0000","last_peered":"2024-09-11T22:19:57.384092+0000","last_clean":"2024-09-11T22:19:57.384092+0000","last_became_active":"2024-09-11T22:19:54.477195+0000","last_became_peered":"2024-09-11T22:19:54.477195+0000","last_unstale":"2024-09-11T22:19:57.384092+0000","last_undegraded":"2024-09-11T22:19:57.384092+0000","last_fullsized":"2024-09-11T22:19:57.384092+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:53.923066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141357+0000","last_change":"2024-09-11T22:19:55.488065+0000","last_active":"2024-09-11T22:19:58.141357+0000","last_peered":"2024-09-11T22:19:58.141357+0000","last_clean":"2024-09-11T22:19:58.141357+0000","last_became_active":"2024-09-11T22:19:55.487735+0000","last_became_peered":"2024-09-11T22:19:55.487735+0000","last_unstale":"2024-09-11T22:19:58.141357+0000","last_undegraded":"2024-09-11T22:19:58.141357+0000","last_fullsized":"2024-09-11T22:19:58.141357+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:48.758602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141343+0000","last_change":"2024-09-11T22:19:54.476633+0000","last_active":"2024-09-11T22:19:58.141343+0000","last_peered":"2024-09-11T22:19:58.141343+0000","last_clean":"2024-09-11T22:19:58.141343+0000","last_became_active":"2024-09-11T22:19:54.476047+0000","last_became_peered":"2024-09-11T22:19:54.476047+0000","last_unstale":"2024-09-11T22:19:58.141343+0000","last_undegraded":"2024-09-11T22:19:58.141343+0000","last_fullsized":"2024-09-11T22:19:58.141343+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:32.769254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487982+0000","last_change":"2024-09-11T22:19:55.493592+0000","last_active":"2024-09-11T22:19:56.487982+0000","last_peered":"2024-09-11T22:19:56.487982+0000","last_clean":"2024-09-11T22:19:56.487982+0000","last_became_active":"2024-09-11T22:19:55.493325+0000","last_became_peered":"2024-09-11T22:19:55.493325+0000","last_unstale":"2024-09-11T22:19:56.487982+0000","last_undegraded":"2024-09-11T22:19:56.487982+0000","last_fullsized":"2024-09-11T22:19:56.487982+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:41.997281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490402+0000","last_change":"2024-09-11T22:19:54.479267+0000","last_active":"2024-09-11T22:19:56.490402+0000","last_peered":"2024-09-11T22:19:56.490402+0000","last_clean":"2024-09-11T22:19:56.490402+0000","last_became_active":"2024-09-11T22:19:54.478991+0000","last_became_peered":"2024-09-11T22:19:54.478991+0000","last_unstale":"2024-09-11T22:19:56.490402+0000","last_undegraded":"2024-09-11T22:19:56.490402+0000","last_fullsized":"2024-09-11T22:19:56.490402+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:16.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383952+0000","last_change":"2024-09-11T22:19:55.504793+0000","last_active":"2024-09-11T22:19:57.383952+0000","last_peered":"2024-09-11T22:19:57.383952+0000","last_clean":"2024-09-11T22:19:57.383952+0000","last_became_active":"2024-09-11T22:19:55.504439+0000","last_became_peered":"2024-09-11T22:19:55.504439+0000","last_unstale":"2024-09-11T22:19:57.383952+0000","last_undegraded":"2024-09-11T22:19:57.383952+0000","last_fullsized":"2024-09-11T22:19:57.383952+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:18.199474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491187+0000","last_change":"2024-09-11T22:19:54.480234+0000","last_active":"2024-09-11T22:19:56.491187+0000","last_peered":"2024-09-11T22:19:56.491187+0000","last_clean":"2024-09-11T22:19:56.491187+0000","last_became_active":"2024-09-11T22:19:54.479962+0000","last_became_peered":"2024-09-11T22:19:54.479962+0000","last_unstale":"2024-09-11T22:19:56.491187+0000","last_undegraded":"2024-09-11T22:19:56.491187+0000","last_fullsized":"2024-09-11T22:19:56.491187+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:05.640856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140862+0000","last_change":"2024-09-11T22:19:55.495546+0000","last_active":"2024-09-11T22:19:58.140862+0000","last_peered":"2024-09-11T22:19:58.140862+0000","last_clean":"2024-09-11T22:19:58.140862+0000","last_became_active":"2024-09-11T22:19:55.495260+0000","last_became_peered":"2024-09-11T22:19:55.495260+0000","last_unstale":"2024-09-11T22:19:58.140862+0000","last_undegraded":"2024-09-11T22:19:58.140862+0000","last_fullsized":"2024-09-11T22:19:58.140862+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:18.667141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"143'1","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.508433+0000","last_change":"2024-09-11T22:19:54.486151+0000","last_active":"2024-09-11T22:19:55.508433+0000","last_peered":"2024-09-11T22:19:55.508433+0000","last_clean":"2024-09-11T22:19:55.508433+0000","last_became_active":"2024-09-11T22:19:54.485525+0000","last_became_peered":"2024-09-11T22:19:54.485525+0000","last_unstale":"2024-09-11T22:19:55.508433+0000","last_undegraded":"2024-09-11T22:19:55.508433+0000","last_fullsized":"2024-09-11T22:19:55.508433+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:06.778567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490878+0000","last_change":"2024-09-11T22:19:55.496145+0000","last_active":"2024-09-11T22:19:56.490878+0000","last_peered":"2024-09-11T22:19:56.490878+0000","last_clean":"2024-09-11T22:19:56.490878+0000","last_became_active":"2024-09-11T22:19:55.495816+0000","last_became_peered":"2024-09-11T22:19:55.495816+0000","last_unstale":"2024-09-11T22:19:56.490878+0000","last_undegraded":"2024-09-11T22:19:56.490878+0000","last_fullsized":"2024-09-11T22:19:56.490878+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:16.795325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490169+0000","last_change":"2024-09-11T22:19:54.478301+0000","last_active":"2024-09-11T22:19:56.490169+0000","last_peered":"2024-09-11T22:19:56.490169+0000","last_clean":"2024-09-11T22:19:56.490169+0000","last_became_active":"2024-09-11T22:19:54.478021+0000","last_became_peered":"2024-09-11T22:19:54.478021+0000","last_unstale":"2024-09-11T22:19:56.490169+0000","last_undegraded":"2024-09-11T22:19:56.490169+0000","last_fullsized":"2024-09-11T22:19:56.490169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:58.768201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140956+0000","last_change":"2024-09-11T22:19:55.489324+0000","last_active":"2024-09-11T22:19:58.140956+0000","last_peered":"2024-09-11T22:19:58.140956+0000","last_clean":"2024-09-11T22:19:58.140956+0000","last_became_active":"2024-09-11T22:19:55.488662+0000","last_became_peered":"2024-09-11T22:19:55.488662+0000","last_unstale":"2024-09-11T22:19:58.140956+0000","last_undegraded":"2024-09-11T22:19:58.140956+0000","last_fullsized":"2024-09-11T22:19:58.140956+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:30.847050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.481838+0000","last_change":"2024-09-11T22:19:54.484169+0000","last_active":"2024-09-11T22:19:55.481838+0000","last_peered":"2024-09-11T22:19:55.481838+0000","last_clean":"2024-09-11T22:19:55.481838+0000","last_became_active":"2024-09-11T22:19:54.483844+0000","last_became_peered":"2024-09-11T22:19:54.483844+0000","last_unstale":"2024-09-11T22:19:55.481838+0000","last_undegraded":"2024-09-11T22:19:55.481838+0000","last_fullsized":"2024-09-11T22:19:55.481838+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:19.353179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490586+0000","last_change":"2024-09-11T22:19:55.499899+0000","last_active":"2024-09-11T22:19:56.490586+0000","last_peered":"2024-09-11T22:19:56.490586+0000","last_clean":"2024-09-11T22:19:56.490586+0000","last_became_active":"2024-09-11T22:19:55.499393+0000","last_became_peered":"2024-09-11T22:19:55.499393+0000","last_unstale":"2024-09-11T22:19:56.490586+0000","last_undegraded":"2024-09-11T22:19:56.490586+0000","last_fullsized":"2024-09-11T22:19:56.490586+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:57.477233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490396+0000","last_change":"2024-09-11T22:19:54.483595+0000","last_active":"2024-09-11T22:19:56.490396+0000","last_peered":"2024-09-11T22:19:56.490396+0000","last_clean":"2024-09-11T22:19:56.490396+0000","last_became_active":"2024-09-11T22:19:54.483323+0000","last_became_peered":"2024-09-11T22:19:54.483323+0000","last_unstale":"2024-09-11T22:19:56.490396+0000","last_undegraded":"2024-09-11T22:19:56.490396+0000","last_fullsized":"2024-09-11T22:19:56.490396+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:28.593199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490783+0000","last_change":"2024-09-11T22:19:55.499707+0000","last_active":"2024-09-11T22:19:56.490783+0000","last_peered":"2024-09-11T22:19:56.490783+0000","last_clean":"2024-09-11T22:19:56.490783+0000","last_became_active":"2024-09-11T22:19:55.499444+0000","last_became_peered":"2024-09-11T22:19:55.499444+0000","last_unstale":"2024-09-11T22:19:56.490783+0000","last_undegraded":"2024-09-11T22:19:56.490783+0000","last_fullsized":"2024-09-11T22:19:56.490783+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:20.735423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141346+0000","last_change":"2024-09-11T22:19:54.477229+0000","last_active":"2024-09-11T22:19:58.141346+0000","last_peered":"2024-09-11T22:19:58.141346+0000","last_clean":"2024-09-11T22:19:58.141346+0000","last_became_active":"2024-09-11T22:19:54.476974+0000","last_became_peered":"2024-09-11T22:19:54.476974+0000","last_unstale":"2024-09-11T22:19:58.141346+0000","last_undegraded":"2024-09-11T22:19:58.141346+0000","last_fullsized":"2024-09-11T22:19:58.141346+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:22.872508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384098+0000","last_change":"2024-09-11T22:19:55.496132+0000","last_active":"2024-09-11T22:19:57.384098+0000","last_peered":"2024-09-11T22:19:57.384098+0000","last_clean":"2024-09-11T22:19:57.384098+0000","last_became_active":"2024-09-11T22:19:55.495466+0000","last_became_peered":"2024-09-11T22:19:55.495466+0000","last_unstale":"2024-09-11T22:19:57.384098+0000","last_undegraded":"2024-09-11T22:19:57.384098+0000","last_fullsized":"2024-09-11T22:19:57.384098+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:07.378924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384287+0000","last_change":"2024-09-11T22:19:54.480915+0000","last_active":"2024-09-11T22:19:57.384287+0000","last_peered":"2024-09-11T22:19:57.384287+0000","last_clean":"2024-09-11T22:19:57.384287+0000","last_became_active":"2024-09-11T22:19:54.480633+0000","last_became_peered":"2024-09-11T22:19:54.480633+0000","last_unstale":"2024-09-11T22:19:57.384287+0000","last_undegraded":"2024-09-11T22:19:57.384287+0000","last_fullsized":"2024-09-11T22:19:57.384287+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:37.295459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.490098+0000","last_change":"2024-09-11T22:19:55.487749+0000","last_active":"2024-09-11T22:19:55.490098+0000","last_peered":"2024-09-11T22:19:55.490098+0000","last_clean":"2024-09-11T22:19:55.490098+0000","last_became_active":"2024-09-11T22:19:55.487462+0000","last_became_peered":"2024-09-11T22:19:55.487462+0000","last_unstale":"2024-09-11T22:19:55.490098+0000","last_undegraded":"2024-09-11T22:19:55.490098+0000","last_fullsized":"2024-09-11T22:19:55.490098+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:09.534990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"143'6","reported_seq":20,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140984+0000","last_change":"2024-09-11T22:19:54.485607+0000","last_active":"2024-09-11T22:19:58.140984+0000","last_peered":"2024-09-11T22:19:58.140984+0000","last_clean":"2024-09-11T22:19:58.140984+0000","last_became_active":"2024-09-11T22:19:54.485311+0000","last_became_peered":"2024-09-11T22:19:54.485311+0000","last_unstale":"2024-09-11T22:19:58.140984+0000","last_undegraded":"2024-09-11T22:19:58.140984+0000","last_fullsized":"2024-09-11T22:19:58.140984+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:39.296943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288680+0000","last_change":"2024-09-11T22:19:55.497422+0000","last_active":"2024-09-11T22:19:57.288680+0000","last_peered":"2024-09-11T22:19:57.288680+0000","last_clean":"2024-09-11T22:19:57.288680+0000","last_became_active":"2024-09-11T22:19:55.496976+0000","last_became_peered":"2024-09-11T22:19:55.496976+0000","last_unstale":"2024-09-11T22:19:57.288680+0000","last_undegraded":"2024-09-11T22:19:57.288680+0000","last_fullsized":"2024-09-11T22:19:57.288680+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:48.541584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288902+0000","last_change":"2024-09-11T22:19:54.480430+0000","last_active":"2024-09-11T22:19:57.288902+0000","last_peered":"2024-09-11T22:19:57.288902+0000","last_clean":"2024-09-11T22:19:57.288902+0000","last_became_active":"2024-09-11T22:19:54.479673+0000","last_became_peered":"2024-09-11T22:19:54.479673+0000","last_unstale":"2024-09-11T22:19:57.288902+0000","last_undegraded":"2024-09-11T22:19:57.288902+0000","last_fullsized":"2024-09-11T22:19:57.288902+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:53.772625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141025+0000","last_change":"2024-09-11T22:19:55.488085+0000","last_active":"2024-09-11T22:19:58.141025+0000","last_peered":"2024-09-11T22:19:58.141025+0000","last_clean":"2024-09-11T22:19:58.141025+0000","last_became_active":"2024-09-11T22:19:55.487780+0000","last_became_peered":"2024-09-11T22:19:55.487780+0000","last_unstale":"2024-09-11T22:19:58.141025+0000","last_undegraded":"2024-09-11T22:19:58.141025+0000","last_fullsized":"2024-09-11T22:19:58.141025+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:05.989636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288656+0000","last_change":"2024-09-11T22:19:54.480065+0000","last_active":"2024-09-11T22:19:57.288656+0000","last_peered":"2024-09-11T22:19:57.288656+0000","last_clean":"2024-09-11T22:19:57.288656+0000","last_became_active":"2024-09-11T22:19:54.479802+0000","last_became_peered":"2024-09-11T22:19:54.479802+0000","last_unstale":"2024-09-11T22:19:57.288656+0000","last_undegraded":"2024-09-11T22:19:57.288656+0000","last_fullsized":"2024-09-11T22:19:57.288656+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:08.105367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490468+0000","last_change":"2024-09-11T22:19:55.494426+0000","last_active":"2024-09-11T22:19:56.490468+0000","last_peered":"2024-09-11T22:19:56.490468+0000","last_clean":"2024-09-11T22:19:56.490468+0000","last_became_active":"2024-09-11T22:19:55.494068+0000","last_became_peered":"2024-09-11T22:19:55.494068+0000","last_unstale":"2024-09-11T22:19:56.490468+0000","last_undegraded":"2024-09-11T22:19:56.490468+0000","last_fullsized":"2024-09-11T22:19:56.490468+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:19.853525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487683+0000","last_change":"2024-09-11T22:19:54.480462+0000","last_active":"2024-09-11T22:19:56.487683+0000","last_peered":"2024-09-11T22:19:56.487683+0000","last_clean":"2024-09-11T22:19:56.487683+0000","last_became_active":"2024-09-11T22:19:54.480164+0000","last_became_peered":"2024-09-11T22:19:54.480164+0000","last_unstale":"2024-09-11T22:19:56.487683+0000","last_undegraded":"2024-09-11T22:19:56.487683+0000","last_fullsized":"2024-09-11T22:19:56.487683+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:06.951053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288579+0000","last_change":"2024-09-11T22:19:55.508144+0000","last_active":"2024-09-11T22:19:57.288579+0000","last_peered":"2024-09-11T22:19:57.288579+0000","last_clean":"2024-09-11T22:19:57.288579+0000","last_became_active":"2024-09-11T22:19:55.506988+0000","last_became_peered":"2024-09-11T22:19:55.506988+0000","last_unstale":"2024-09-11T22:19:57.288579+0000","last_undegraded":"2024-09-11T22:19:57.288579+0000","last_fullsized":"2024-09-11T22:19:57.288579+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:41.997281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"143'8","reported_seq":20,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.511146+0000","last_change":"2024-09-11T22:19:54.482849+0000","last_active":"2024-09-11T22:19:55.511146+0000","last_peered":"2024-09-11T22:19:55.511146+0000","last_clean":"2024-09-11T22:19:55.511146+0000","last_became_active":"2024-09-11T22:19:54.482552+0000","last_became_peered":"2024-09-11T22:19:54.482552+0000","last_unstale":"2024-09-11T22:19:55.511146+0000","last_undegraded":"2024-09-11T22:19:55.511146+0000","last_fullsized":"2024-09-11T22:19:55.511146+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:34.396451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384240+0000","last_change":"2024-09-11T22:19:55.496672+0000","last_active":"2024-09-11T22:19:57.384240+0000","last_peered":"2024-09-11T22:19:57.384240+0000","last_clean":"2024-09-11T22:19:57.384240+0000","last_became_active":"2024-09-11T22:19:55.496398+0000","last_became_peered":"2024-09-11T22:19:55.496398+0000","last_unstale":"2024-09-11T22:19:57.384240+0000","last_undegraded":"2024-09-11T22:19:57.384240+0000","last_fullsized":"2024-09-11T22:19:57.384240+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:54.264936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490889+0000","last_change":"2024-09-11T22:19:54.481617+0000","last_active":"2024-09-11T22:19:56.490889+0000","last_peered":"2024-09-11T22:19:56.490889+0000","last_clean":"2024-09-11T22:19:56.490889+0000","last_became_active":"2024-09-11T22:19:54.480067+0000","last_became_peered":"2024-09-11T22:19:54.480067+0000","last_unstale":"2024-09-11T22:19:56.490889+0000","last_undegraded":"2024-09-11T22:19:56.490889+0000","last_fullsized":"2024-09-11T22:19:56.490889+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:32.541675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.502094+0000","last_change":"2024-09-11T22:19:55.498674+0000","last_active":"2024-09-11T22:19:55.502094+0000","last_peered":"2024-09-11T22:19:55.502094+0000","last_clean":"2024-09-11T22:19:55.502094+0000","last_became_active":"2024-09-11T22:19:55.498398+0000","last_became_peered":"2024-09-11T22:19:55.498398+0000","last_unstale":"2024-09-11T22:19:55.502094+0000","last_undegraded":"2024-09-11T22:19:55.502094+0000","last_fullsized":"2024-09-11T22:19:55.502094+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:05.560482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141421+0000","last_change":"2024-09-11T22:19:54.480708+0000","last_active":"2024-09-11T22:19:58.141421+0000","last_peered":"2024-09-11T22:19:58.141421+0000","last_clean":"2024-09-11T22:19:58.141421+0000","last_became_active":"2024-09-11T22:19:54.480362+0000","last_became_peered":"2024-09-11T22:19:54.480362+0000","last_unstale":"2024-09-11T22:19:58.141421+0000","last_undegraded":"2024-09-11T22:19:58.141421+0000","last_fullsized":"2024-09-11T22:19:58.141421+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:39.296943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.289001+0000","last_change":"2024-09-11T22:19:55.493922+0000","last_active":"2024-09-11T22:19:57.289001+0000","last_peered":"2024-09-11T22:19:57.289001+0000","last_clean":"2024-09-11T22:19:57.289001+0000","last_became_active":"2024-09-11T22:19:55.493643+0000","last_became_peered":"2024-09-11T22:19:55.493643+0000","last_unstale":"2024-09-11T22:19:57.289001+0000","last_undegraded":"2024-09-11T22:19:57.289001+0000","last_fullsized":"2024-09-11T22:19:57.289001+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.589766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"143'1","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.508738+0000","last_change":"2024-09-11T22:19:54.484652+0000","last_active":"2024-09-11T22:19:55.508738+0000","last_peered":"2024-09-11T22:19:55.508738+0000","last_clean":"2024-09-11T22:19:55.508738+0000","last_became_active":"2024-09-11T22:19:54.484339+0000","last_became_peered":"2024-09-11T22:19:54.484339+0000","last_unstale":"2024-09-11T22:19:55.508738+0000","last_undegraded":"2024-09-11T22:19:55.508738+0000","last_fullsized":"2024-09-11T22:19:55.508738+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:26.988816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488205+0000","last_change":"2024-09-11T22:19:55.501848+0000","last_active":"2024-09-11T22:19:56.488205+0000","last_peered":"2024-09-11T22:19:56.488205+0000","last_clean":"2024-09-11T22:19:56.488205+0000","last_became_active":"2024-09-11T22:19:55.501221+0000","last_became_peered":"2024-09-11T22:19:55.501221+0000","last_unstale":"2024-09-11T22:19:56.488205+0000","last_undegraded":"2024-09-11T22:19:56.488205+0000","last_fullsized":"2024-09-11T22:19:56.488205+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:23.106236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141343+0000","last_change":"2024-09-11T22:19:54.484664+0000","last_active":"2024-09-11T22:19:58.141343+0000","last_peered":"2024-09-11T22:19:58.141343+0000","last_clean":"2024-09-11T22:19:58.141343+0000","last_became_active":"2024-09-11T22:19:54.484352+0000","last_became_peered":"2024-09-11T22:19:54.484352+0000","last_unstale":"2024-09-11T22:19:58.141343+0000","last_undegraded":"2024-09-11T22:19:58.141343+0000","last_fullsized":"2024-09-11T22:19:58.141343+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:23.346017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491534+0000","last_change":"2024-09-11T22:19:55.496737+0000","last_active":"2024-09-11T22:19:56.491534+0000","last_peered":"2024-09-11T22:19:56.491534+0000","last_clean":"2024-09-11T22:19:56.491534+0000","last_became_active":"2024-09-11T22:19:55.496089+0000","last_became_peered":"2024-09-11T22:19:55.496089+0000","last_unstale":"2024-09-11T22:19:56.491534+0000","last_undegraded":"2024-09-11T22:19:56.491534+0000","last_fullsized":"2024-09-11T22:19:56.491534+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:37.230107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140832+0000","last_change":"2024-09-11T22:19:54.479734+0000","last_active":"2024-09-11T22:19:58.140832+0000","last_peered":"2024-09-11T22:19:58.140832+0000","last_clean":"2024-09-11T22:19:58.140832+0000","last_became_active":"2024-09-11T22:19:54.479446+0000","last_became_peered":"2024-09-11T22:19:54.479446+0000","last_unstale":"2024-09-11T22:19:58.140832+0000","last_undegraded":"2024-09-11T22:19:58.140832+0000","last_fullsized":"2024-09-11T22:19:58.140832+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:32.769254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140769+0000","last_change":"2024-09-11T22:19:55.491954+0000","last_active":"2024-09-11T22:19:58.140769+0000","last_peered":"2024-09-11T22:19:58.140769+0000","last_clean":"2024-09-11T22:19:58.140769+0000","last_became_active":"2024-09-11T22:19:55.491624+0000","last_became_peered":"2024-09-11T22:19:55.491624+0000","last_unstale":"2024-09-11T22:19:58.140769+0000","last_undegraded":"2024-09-11T22:19:58.140769+0000","last_fullsized":"2024-09-11T22:19:58.140769+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:45.119040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383886+0000","last_change":"2024-09-11T22:19:54.474277+0000","last_active":"2024-09-11T22:19:57.383886+0000","last_peered":"2024-09-11T22:19:57.383886+0000","last_clean":"2024-09-11T22:19:57.383886+0000","last_became_active":"2024-09-11T22:19:54.473990+0000","last_became_peered":"2024-09-11T22:19:54.473990+0000","last_unstale":"2024-09-11T22:19:57.383886+0000","last_undegraded":"2024-09-11T22:19:57.383886+0000","last_fullsized":"2024-09-11T22:19:57.383886+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:33.263881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490394+0000","last_change":"2024-09-11T22:19:55.484311+0000","last_active":"2024-09-11T22:19:56.490394+0000","last_peered":"2024-09-11T22:19:56.490394+0000","last_clean":"2024-09-11T22:19:56.490394+0000","last_became_active":"2024-09-11T22:19:55.484011+0000","last_became_peered":"2024-09-11T22:19:55.484011+0000","last_unstale":"2024-09-11T22:19:56.490394+0000","last_undegraded":"2024-09-11T22:19:56.490394+0000","last_fullsized":"2024-09-11T22:19:56.490394+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:26.649106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383580+0000","last_change":"2024-09-11T22:19:54.475515+0000","last_active":"2024-09-11T22:19:57.383580+0000","last_peered":"2024-09-11T22:19:57.383580+0000","last_clean":"2024-09-11T22:19:57.383580+0000","last_became_active":"2024-09-11T22:19:54.475217+0000","last_became_peered":"2024-09-11T22:19:54.475217+0000","last_unstale":"2024-09-11T22:19:57.383580+0000","last_undegraded":"2024-09-11T22:19:57.383580+0000","last_fullsized":"2024-09-11T22:19:57.383580+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:57.756890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140845+0000","last_change":"2024-09-11T22:19:55.492392+0000","last_active":"2024-09-11T22:19:58.140845+0000","last_peered":"2024-09-11T22:19:58.140845+0000","last_clean":"2024-09-11T22:19:58.140845+0000","last_became_active":"2024-09-11T22:19:55.491512+0000","last_became_peered":"2024-09-11T22:19:55.491512+0000","last_unstale":"2024-09-11T22:19:58.140845+0000","last_undegraded":"2024-09-11T22:19:58.140845+0000","last_fullsized":"2024-09-11T22:19:58.140845+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:43.655472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288392+0000","last_change":"2024-09-11T22:19:54.482424+0000","last_active":"2024-09-11T22:19:57.288392+0000","last_peered":"2024-09-11T22:19:57.288392+0000","last_clean":"2024-09-11T22:19:57.288392+0000","last_became_active":"2024-09-11T22:19:54.482063+0000","last_became_peered":"2024-09-11T22:19:54.482063+0000","last_unstale":"2024-09-11T22:19:57.288392+0000","last_undegraded":"2024-09-11T22:19:57.288392+0000","last_fullsized":"2024-09-11T22:19:57.288392+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:16.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490944+0000","last_change":"2024-09-11T22:19:55.496545+0000","last_active":"2024-09-11T22:19:56.490944+0000","last_peered":"2024-09-11T22:19:56.490944+0000","last_clean":"2024-09-11T22:19:56.490944+0000","last_became_active":"2024-09-11T22:19:55.496051+0000","last_became_peered":"2024-09-11T22:19:55.496051+0000","last_unstale":"2024-09-11T22:19:56.490944+0000","last_undegraded":"2024-09-11T22:19:56.490944+0000","last_fullsized":"2024-09-11T22:19:56.490944+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:35.195952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384243+0000","last_change":"2024-09-11T22:19:54.480155+0000","last_active":"2024-09-11T22:19:57.384243+0000","last_peered":"2024-09-11T22:19:57.384243+0000","last_clean":"2024-09-11T22:19:57.384243+0000","last_became_active":"2024-09-11T22:19:54.479875+0000","last_became_peered":"2024-09-11T22:19:54.479875+0000","last_unstale":"2024-09-11T22:19:57.384243+0000","last_undegraded":"2024-09-11T22:19:57.384243+0000","last_fullsized":"2024-09-11T22:19:57.384243+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:39:16.361022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288906+0000","last_change":"2024-09-11T22:19:55.501115+0000","last_active":"2024-09-11T22:19:57.288906+0000","last_peered":"2024-09-11T22:19:57.288906+0000","last_clean":"2024-09-11T22:19:57.288906+0000","last_became_active":"2024-09-11T22:19:55.500505+0000","last_became_peered":"2024-09-11T22:19:55.500505+0000","last_unstale":"2024-09-11T22:19:57.288906+0000","last_undegraded":"2024-09-11T22:19:57.288906+0000","last_fullsized":"2024-09-11T22:19:57.288906+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:26.649106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487997+0000","last_change":"2024-09-11T22:19:54.483996+0000","last_active":"2024-09-11T22:19:56.487997+0000","last_peered":"2024-09-11T22:19:56.487997+0000","last_clean":"2024-09-11T22:19:56.487997+0000","last_became_active":"2024-09-11T22:19:54.483682+0000","last_became_peered":"2024-09-11T22:19:54.483682+0000","last_unstale":"2024-09-11T22:19:56.487997+0000","last_undegraded":"2024-09-11T22:19:56.487997+0000","last_fullsized":"2024-09-11T22:19:56.487997+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:22.920609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141389+0000","last_change":"2024-09-11T22:19:55.493907+0000","last_active":"2024-09-11T22:19:58.141389+0000","last_peered":"2024-09-11T22:19:58.141389+0000","last_clean":"2024-09-11T22:19:58.141389+0000","last_became_active":"2024-09-11T22:19:55.493552+0000","last_became_peered":"2024-09-11T22:19:55.493552+0000","last_unstale":"2024-09-11T22:19:58.141389+0000","last_undegraded":"2024-09-11T22:19:58.141389+0000","last_fullsized":"2024-09-11T22:19:58.141389+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:48.038083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488308+0000","last_change":"2024-09-11T22:19:54.486850+0000","last_active":"2024-09-11T22:19:56.488308+0000","last_peered":"2024-09-11T22:19:56.488308+0000","last_clean":"2024-09-11T22:19:56.488308+0000","last_became_active":"2024-09-11T22:19:54.486160+0000","last_became_peered":"2024-09-11T22:19:54.486160+0000","last_unstale":"2024-09-11T22:19:56.488308+0000","last_undegraded":"2024-09-11T22:19:56.488308+0000","last_fullsized":"2024-09-11T22:19:56.488308+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:08.105367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488249+0000","last_change":"2024-09-11T22:19:55.496132+0000","last_active":"2024-09-11T22:19:56.488249+0000","last_peered":"2024-09-11T22:19:56.488249+0000","last_clean":"2024-09-11T22:19:56.488249+0000","last_became_active":"2024-09-11T22:19:55.495766+0000","last_became_peered":"2024-09-11T22:19:55.495766+0000","last_unstale":"2024-09-11T22:19:56.488249+0000","last_undegraded":"2024-09-11T22:19:56.488249+0000","last_fullsized":"2024-09-11T22:19:56.488249+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.589766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487870+0000","last_change":"2024-09-11T22:19:54.486505+0000","last_active":"2024-09-11T22:19:56.487870+0000","last_peered":"2024-09-11T22:19:56.487870+0000","last_clean":"2024-09-11T22:19:56.487870+0000","last_became_active":"2024-09-11T22:19:54.486071+0000","last_became_peered":"2024-09-11T22:19:54.486071+0000","last_unstale":"2024-09-11T22:19:56.487870+0000","last_undegraded":"2024-09-11T22:19:56.487870+0000","last_fullsized":"2024-09-11T22:19:56.487870+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:50.039730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.503074+0000","last_change":"2024-09-11T22:19:55.500191+0000","last_active":"2024-09-11T22:19:55.503074+0000","last_peered":"2024-09-11T22:19:55.503074+0000","last_clean":"2024-09-11T22:19:55.503074+0000","last_became_active":"2024-09-11T22:19:55.499703+0000","last_became_peered":"2024-09-11T22:19:55.499703+0000","last_unstale":"2024-09-11T22:19:55.503074+0000","last_undegraded":"2024-09-11T22:19:55.503074+0000","last_fullsized":"2024-09-11T22:19:55.503074+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:06.196494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140919+0000","last_change":"2024-09-11T22:19:54.478322+0000","last_active":"2024-09-11T22:19:58.140919+0000","last_peered":"2024-09-11T22:19:58.140919+0000","last_clean":"2024-09-11T22:19:58.140919+0000","last_became_active":"2024-09-11T22:19:54.478056+0000","last_became_peered":"2024-09-11T22:19:54.478056+0000","last_unstale":"2024-09-11T22:19:58.140919+0000","last_undegraded":"2024-09-11T22:19:58.140919+0000","last_fullsized":"2024-09-11T22:19:58.140919+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:22.872508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491352+0000","last_change":"2024-09-11T22:19:55.500816+0000","last_active":"2024-09-11T22:19:56.491352+0000","last_peered":"2024-09-11T22:19:56.491352+0000","last_clean":"2024-09-11T22:19:56.491352+0000","last_became_active":"2024-09-11T22:19:55.500559+0000","last_became_peered":"2024-09-11T22:19:55.500559+0000","last_unstale":"2024-09-11T22:19:56.491352+0000","last_undegraded":"2024-09-11T22:19:56.491352+0000","last_fullsized":"2024-09-11T22:19:56.491352+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:51.041508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383723+0000","last_change":"2024-09-11T22:19:54.482877+0000","last_active":"2024-09-11T22:19:57.383723+0000","last_peered":"2024-09-11T22:19:57.383723+0000","last_clean":"2024-09-11T22:19:57.383723+0000","last_became_active":"2024-09-11T22:19:54.482462+0000","last_became_peered":"2024-09-11T22:19:54.482462+0000","last_unstale":"2024-09-11T22:19:57.383723+0000","last_undegraded":"2024-09-11T22:19:57.383723+0000","last_fullsized":"2024-09-11T22:19:57.383723+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:50.629566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383704+0000","last_change":"2024-09-11T22:19:55.503903+0000","last_active":"2024-09-11T22:19:57.383704+0000","last_peered":"2024-09-11T22:19:57.383704+0000","last_clean":"2024-09-11T22:19:57.383704+0000","last_became_active":"2024-09-11T22:19:55.503606+0000","last_became_peered":"2024-09-11T22:19:55.503606+0000","last_unstale":"2024-09-11T22:19:57.383704+0000","last_undegraded":"2024-09-11T22:19:57.383704+0000","last_fullsized":"2024-09-11T22:19:57.383704+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:41.678234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288530+0000","last_change":"2024-09-11T22:19:54.480651+0000","last_active":"2024-09-11T22:19:57.288530+0000","last_peered":"2024-09-11T22:19:57.288530+0000","last_clean":"2024-09-11T22:19:57.288530+0000","last_became_active":"2024-09-11T22:19:54.480268+0000","last_became_peered":"2024-09-11T22:19:54.480268+0000","last_unstale":"2024-09-11T22:19:57.288530+0000","last_undegraded":"2024-09-11T22:19:57.288530+0000","last_fullsized":"2024-09-11T22:19:57.288530+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:28.593199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490440+0000","last_change":"2024-09-11T22:19:55.499655+0000","last_active":"2024-09-11T22:19:56.490440+0000","last_peered":"2024-09-11T22:19:56.490440+0000","last_clean":"2024-09-11T22:19:56.490440+0000","last_became_active":"2024-09-11T22:19:55.498978+0000","last_became_peered":"2024-09-11T22:19:55.498978+0000","last_unstale":"2024-09-11T22:19:56.490440+0000","last_undegraded":"2024-09-11T22:19:56.490440+0000","last_fullsized":"2024-09-11T22:19:56.490440+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.895923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141006+0000","last_change":"2024-09-11T22:19:54.472846+0000","last_active":"2024-09-11T22:19:58.141006+0000","last_peered":"2024-09-11T22:19:58.141006+0000","last_clean":"2024-09-11T22:19:58.141006+0000","last_became_active":"2024-09-11T22:19:54.472482+0000","last_became_peered":"2024-09-11T22:19:54.472482+0000","last_unstale":"2024-09-11T22:19:58.141006+0000","last_undegraded":"2024-09-11T22:19:58.141006+0000","last_fullsized":"2024-09-11T22:19:58.141006+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:10.691015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141057+0000","last_change":"2024-09-11T22:19:55.493295+0000","last_active":"2024-09-11T22:19:58.141057+0000","last_peered":"2024-09-11T22:19:58.141057+0000","last_clean":"2024-09-11T22:19:58.141057+0000","last_became_active":"2024-09-11T22:19:55.492963+0000","last_became_peered":"2024-09-11T22:19:55.492963+0000","last_unstale":"2024-09-11T22:19:58.141057+0000","last_undegraded":"2024-09-11T22:19:58.141057+0000","last_fullsized":"2024-09-11T22:19:58.141057+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:30.847050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"143'3","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288876+0000","last_change":"2024-09-11T22:19:54.480949+0000","last_active":"2024-09-11T22:19:57.288876+0000","last_peered":"2024-09-11T22:19:57.288876+0000","last_clean":"2024-09-11T22:19:57.288876+0000","last_became_active":"2024-09-11T22:19:54.480650+0000","last_became_peered":"2024-09-11T22:19:54.480650+0000","last_unstale":"2024-09-11T22:19:57.288876+0000","last_undegraded":"2024-09-11T22:19:57.288876+0000","last_fullsized":"2024-09-11T22:19:57.288876+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:40.197692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":393,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383815+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:19:57.383815+0000","last_peered":"2024-09-11T22:19:57.383815+0000","last_clean":"2024-09-11T22:19:57.383815+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:19:57.383815+0000","last_undegraded":"2024-09-11T22:19:57.383815+0000","last_fullsized":"2024-09-11T22:19:57.383815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509552,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51000,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320840,"statfs":{"total":96636764160,"available":96584540160,"internally_reserved":0,"allocated":1806336,"data_stored":787079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509549,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46840,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325000,"statfs":{"total":96636764160,"available":96588800000,"internally_reserved":0,"allocated":1798144,"data_stored":786955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50992,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1794048,"data_stored":786933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509551,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59312,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312528,"statfs":{"total":96636764160,"available":96576028672,"internally_reserved":0,"allocated":1798144,"data_stored":787023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509551,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59320,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312520,"statfs":{"total":96636764160,"available":96576020480,"internally_reserved":0,"allocated":1798144,"data_stored":787515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509550,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55744,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316096,"statfs":{"total":96636764160,"available":96579682304,"internally_reserved":0,"allocated":2404352,"data_stored":1378947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51564,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320276,"statfs":{"total":96636764160,"available":96583962624,"internally_reserved":0,"allocated":2383872,"data_stored":1371653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59320,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312520,"statfs":{"total":96636764160,"available":96576020480,"internally_reserved":0,"allocated":1798144,"data_stored":782315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:19:59.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:19:59.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.866+0000 7ff9983a8640 1 Processor -- start 2024-09-11T22:19:59.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.866+0000 7ff9983a8640 1 -- start start 2024-09-11T22:19:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.867+0000 7ff9983a8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff99015e840 0x7ff9900b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.867+0000 7ff9983a8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9900cdd50 0x7ff9900cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.867+0000 7ff9983a8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9900ce5f0 con 0x7ff9900cf3b0 2024-09-11T22:19:59.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.867+0000 7ff9983a8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff99006c240 con 0x7ff9900cdd50 2024-09-11T22:19:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.867+0000 7ff9983a8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff9900d0470 con 0x7ff99015e840 2024-09-11T22:19:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.867+0000 7ff995943640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9900cdd50 0x7ff9900cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.867+0000 7ff995943640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9900cdd50 0x7ff9900cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45278/0 (socket says 172.21.15.50:45278) 2024-09-11T22:19:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.867+0000 7ff995943640 1 -- 172.21.15.50:0/2012226967 learned_addr learned my addr 172.21.15.50:0/2012226967 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.867+0000 7ff996144640 1 --2- 172.21.15.50:0/2012226967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff99015e840 0x7ff9900b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.867+0000 7ff995943640 1 -- 172.21.15.50:0/2012226967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff99015e840 msgr2=0x7ff9900b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.867+0000 7ff995943640 1 --2- 172.21.15.50:0/2012226967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff99015e840 0x7ff9900b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.867+0000 7ff995943640 1 -- 172.21.15.50:0/2012226967 >> v1:172.21.15.77:6789/0 conn(0x7ff9900cf3b0 legacy=0x7ff9900d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.867+0000 7ff995943640 1 -- 172.21.15.50:0/2012226967 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9900ce310 con 0x7ff9900cdd50 2024-09-11T22:19:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.868+0000 7ff995943640 1 --2- 172.21.15.50:0/2012226967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9900cdd50 0x7ff9900cee70 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7ff9800098a0 tx=0x7ff98002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31190bea0256e54d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.868+0000 7ff995142640 1 -- 172.21.15.50:0/2012226967 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980037070 con 0x7ff9900cdd50 2024-09-11T22:19:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.868+0000 7ff995142640 1 -- 172.21.15.50:0/2012226967 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff980032440 con 0x7ff9900cdd50 2024-09-11T22:19:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.868+0000 7ff995142640 1 -- 172.21.15.50:0/2012226967 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980032810 con 0x7ff9900cdd50 2024-09-11T22:19:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.869+0000 7ff9983a8640 1 -- 172.21.15.50:0/2012226967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9900cdd50 msgr2=0x7ff9900cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.869+0000 7ff9983a8640 1 --2- 172.21.15.50:0/2012226967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9900cdd50 0x7ff9900cee70 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7ff9800098a0 tx=0x7ff98002a290 comp rx=0 tx=0).stop 2024-09-11T22:19:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.869+0000 7ff9983a8640 1 -- 172.21.15.50:0/2012226967 shutdown_connections 2024-09-11T22:19:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.869+0000 7ff9983a8640 1 --2- 172.21.15.50:0/2012226967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9900cdd50 0x7ff9900cee70 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.869+0000 7ff9983a8640 1 --2- 172.21.15.50:0/2012226967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff99015e840 0x7ff9900b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.869+0000 7ff9983a8640 1 -- 172.21.15.50:0/2012226967 >> 172.21.15.50:0/2012226967 conn(0x7ff9900b4150 msgr2=0x7ff9900b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.869+0000 7ff9983a8640 1 -- 172.21.15.50:0/2012226967 shutdown_connections 2024-09-11T22:19:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.869+0000 7ff9983a8640 1 -- 172.21.15.50:0/2012226967 wait complete. 2024-09-11T22:19:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.870+0000 7ff9983a8640 1 Processor -- start 2024-09-11T22:19:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.870+0000 7ff9983a8640 1 -- start start 2024-09-11T22:19:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff9983a8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9900cdd50 0x7ff9900caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff9983a8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9900cf3b0 0x7ff9900c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff9983a8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99015e840 0x7ff9900b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff9983a8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff99015ec20 con 0x7ff99015e840 2024-09-11T22:19:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff9983a8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff99006bed0 con 0x7ff9900cf3b0 2024-09-11T22:19:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff9983a8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff99015eda0 con 0x7ff9900cdd50 2024-09-11T22:19:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff996945640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99015e840 0x7ff9900b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff996945640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99015e840 0x7ff9900b6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45290/0 (socket says 172.21.15.50:45290) 2024-09-11T22:19:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff996945640 1 -- 172.21.15.50:0/372623364 learned_addr learned my addr 172.21.15.50:0/372623364 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:19:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff995943640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9900cf3b0 0x7ff9900c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff996144640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9900cdd50 0x7ff9900caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff996945640 1 -- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9900cdd50 msgr2=0x7ff9900caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff996945640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9900cdd50 0x7ff9900caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff996945640 1 -- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9900cf3b0 msgr2=0x7ff9900c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff996945640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9900cf3b0 0x7ff9900c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.871+0000 7ff996945640 1 -- 172.21.15.50:0/372623364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9901f5230 con 0x7ff99015e840 2024-09-11T22:19:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.872+0000 7ff996945640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99015e840 0x7ff9900b6e70 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7ff98800c7a0 tx=0x7ff98800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.872+0000 7ff986ffd640 1 -- 172.21.15.50:0/372623364 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988003b70 con 0x7ff99015e840 2024-09-11T22:19:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.872+0000 7ff986ffd640 1 -- 172.21.15.50:0/372623364 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff988003d30 con 0x7ff99015e840 2024-09-11T22:19:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.872+0000 7ff9983a8640 1 -- 172.21.15.50:0/372623364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9901f46b0 con 0x7ff99015e840 2024-09-11T22:19:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.872+0000 7ff986ffd640 1 -- 172.21.15.50:0/372623364 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98800aa90 con 0x7ff99015e840 2024-09-11T22:19:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.872+0000 7ff9983a8640 1 -- 172.21.15.50:0/372623364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9901f4f50 con 0x7ff99015e840 2024-09-11T22:19:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.873+0000 7ff9983a8640 1 -- 172.21.15.50:0/372623364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9901f4aa0 con 0x7ff99015e840 2024-09-11T22:19:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.873+0000 7ff986ffd640 1 -- 172.21.15.50:0/372623364 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff98800ac30 con 0x7ff99015e840 2024-09-11T22:19:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.874+0000 7ff986ffd640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff97406be30 0x7ff97406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.874+0000 7ff986ffd640 1 -- 172.21.15.50:0/372623364 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7ff98808abe0 con 0x7ff99015e840 2024-09-11T22:19:59.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.874+0000 7ff996144640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff97406be30 0x7ff97406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.874+0000 7ff996144640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff97406be30 0x7ff97406e2f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff9900b7a20 tx=0x7ff98c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:59.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:19:59.878+0000 7ff986ffd640 1 -- 172.21.15.50:0/372623364 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff988058fd0 con 0x7ff99015e840 2024-09-11T22:20:00.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.120+0000 7ff9983a8640 1 -- 172.21.15.50:0/372623364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff9900ccad0 con 0x7ff99015e840 2024-09-11T22:20:00.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.120+0000 7ff986ffd640 1 -- 172.21.15.50:0/372623364 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1479 (secure 0 0 0) 0x7ff98805d2d0 con 0x7ff99015e840 2024-09-11T22:20:00.121 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:00.121 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":548,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":444510208,"bytes_avail":772649603072,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8907}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-11T22:19:43.488615+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:20:00.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.122+0000 7ff9983a8640 1 -- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff97406be30 msgr2=0x7ff97406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:00.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.122+0000 7ff9983a8640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff97406be30 0x7ff97406e2f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff9900b7a20 tx=0x7ff98c009190 comp rx=0 tx=0).stop 2024-09-11T22:20:00.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.122+0000 7ff9983a8640 1 -- 172.21.15.50:0/372623364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99015e840 msgr2=0x7ff9900b6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:00.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.122+0000 7ff9983a8640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99015e840 0x7ff9900b6e70 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7ff98800c7a0 tx=0x7ff98800cc60 comp rx=0 tx=0).stop 2024-09-11T22:20:00.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.122+0000 7ff9983a8640 1 -- 172.21.15.50:0/372623364 shutdown_connections 2024-09-11T22:20:00.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.122+0000 7ff9983a8640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff97406be30 0x7ff97406e2f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.122+0000 7ff9983a8640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99015e840 0x7ff9900b6e70 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.122+0000 7ff9983a8640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9900cf3b0 0x7ff9900c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.122+0000 7ff9983a8640 1 --2- 172.21.15.50:0/372623364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9900cdd50 0x7ff9900caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.122+0000 7ff9983a8640 1 -- 172.21.15.50:0/372623364 >> 172.21.15.50:0/372623364 conn(0x7ff9900b4150 msgr2=0x7ff9900afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.122+0000 7ff9983a8640 1 -- 172.21.15.50:0/372623364 shutdown_connections 2024-09-11T22:20:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.122+0000 7ff9983a8640 1 -- 172.21.15.50:0/372623364 wait complete. 2024-09-11T22:20:00.134 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:20:00.134 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:20:00.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.237+0000 7f7798b78640 1 Processor -- start 2024-09-11T22:20:00.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.238+0000 7f7798b78640 1 -- start start 2024-09-11T22:20:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.238+0000 7f7798b78640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f77940d18a0 0x7f77940d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.238+0000 7f7798b78640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77940d3a30 0x7f77940b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.238+0000 7f7798b78640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77940cfa80 con 0x7f779415e870 2024-09-11T22:20:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.238+0000 7f7798b78640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f77940d3ea0 con 0x7f77940d18a0 2024-09-11T22:20:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.238+0000 7f7798b78640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f77940d40d0 con 0x7f77940d3a30 2024-09-11T22:20:00.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.239+0000 7f779259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f779415e870 0x7f77940d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50378/0 (socket says 172.21.15.50:50378) 2024-09-11T22:20:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.239+0000 7f779259c640 1 -- 172.21.15.50:0/1547747644 learned_addr learned my addr 172.21.15.50:0/1547747644 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.239+0000 7f7791d9b640 1 --2- 172.21.15.50:0/1547747644 >> v2:172.21.15.77:3300/0 conn(0x7f77940d18a0 0x7f77940d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.239+0000 7f7792d9d640 1 --2- 172.21.15.50:0/1547747644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77940d3a30 0x7f77940b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.239+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 347450663 0 0) 0x7f778c001490 con 0x7f779415e870 2024-09-11T22:20:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.239+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7780003520 con 0x7f779415e870 2024-09-11T22:20:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.239+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1897913660 0 0) 0x7f7780003520 con 0x7f779415e870 2024-09-11T22:20:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.239+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77940d3a30 msgr2=0x7f77940b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.239+0000 7f779159a640 1 --2- 172.21.15.50:0/1547747644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77940d3a30 0x7f77940b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.239+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 >> v2:172.21.15.77:3300/0 conn(0x7f77940d18a0 msgr2=0x7f77940d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.239+0000 7f779159a640 1 --2- 172.21.15.50:0/1547747644 >> v2:172.21.15.77:3300/0 conn(0x7f77940d18a0 0x7f77940d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.239+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77940d43b0 con 0x7f779415e870 2024-09-11T22:20:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.239+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f778c001be0 con 0x7f779415e870 2024-09-11T22:20:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 >> v1:172.21.15.50:6789/0 conn(0x7f779415e870 legacy=0x7f77940d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f779159a640 1 --2- 172.21.15.50:0/1547747644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77800039b0 0x7f7780003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f779159a640 1 --2- 172.21.15.50:0/1547747644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7780004800 0x7f7780004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f779159a640 1 --2- 172.21.15.50:0/1547747644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77940d3a30 0x7f77800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77940d40d0 con 0x7f7780004800 2024-09-11T22:20:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f778000b9c0 con 0x7f77800039b0 2024-09-11T22:20:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f778000bb40 con 0x7f77940d3a30 2024-09-11T22:20:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f7791d9b640 1 --2- 172.21.15.50:0/1547747644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7780004800 0x7f7780004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:00.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f779259c640 1 --2- 172.21.15.50:0/1547747644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77800039b0 0x7f7780003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:00.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f7792d9d640 1 --2- 172.21.15.50:0/1547747644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77940d3a30 0x7f77800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:00.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f7791d9b640 1 -- 172.21.15.50:0/1547747644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77940d3a30 msgr2=0x7f77800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:00.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f7791d9b640 1 --2- 172.21.15.50:0/1547747644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77940d3a30 0x7f77800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f7791d9b640 1 -- 172.21.15.50:0/1547747644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77800039b0 msgr2=0x7f7780003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:00.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f7791d9b640 1 --2- 172.21.15.50:0/1547747644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77800039b0 0x7f7780003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f7791d9b640 1 -- 172.21.15.50:0/1547747644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7780003520 con 0x7f7780004800 2024-09-11T22:20:00.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.240+0000 7f7792d9d640 1 --2- 172.21.15.50:0/1547747644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77940d3a30 0x7f77800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:00.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.241+0000 7f7791d9b640 1 --2- 172.21.15.50:0/1547747644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7780004800 0x7f7780004c80 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f777c009ac0 tx=0x7f7780005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61414fb688e0e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:00.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.241+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c036070 con 0x7f7780004800 2024-09-11T22:20:00.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.241+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f777c031400 con 0x7f7780004800 2024-09-11T22:20:00.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.241+0000 7f779159a640 1 -- 172.21.15.50:0/1547747644 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c009690 con 0x7f7780004800 2024-09-11T22:20:00.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.241+0000 7f7798b78640 1 -- 172.21.15.50:0/1547747644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7780004800 msgr2=0x7f7780004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:00.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.241+0000 7f7798b78640 1 --2- 172.21.15.50:0/1547747644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7780004800 0x7f7780004c80 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f777c009ac0 tx=0x7f7780005830 comp rx=0 tx=0).stop 2024-09-11T22:20:00.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.241+0000 7f7792d9d640 1 -- 172.21.15.50:0/1547747644 reap_dead start 2024-09-11T22:20:00.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.242+0000 7f7798b78640 1 -- 172.21.15.50:0/1547747644 shutdown_connections 2024-09-11T22:20:00.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.242+0000 7f7798b78640 1 -- 172.21.15.50:0/1547747644 >> 172.21.15.50:0/1547747644 conn(0x7f77940727a0 msgr2=0x7f77940679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:00.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.242+0000 7f7798b78640 1 -- 172.21.15.50:0/1547747644 shutdown_connections 2024-09-11T22:20:00.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.242+0000 7f7798b78640 1 -- 172.21.15.50:0/1547747644 wait complete. 2024-09-11T22:20:00.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.243+0000 7f7798b78640 1 Processor -- start 2024-09-11T22:20:00.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.243+0000 7f7798b78640 1 -- start start 2024-09-11T22:20:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f7798b78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7780004800 0x7f77941f86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f7798b78640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77941f4650 0x7f7794155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f7798b78640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940cc120 0x7f77940cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f7798b78640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f779415ec50 con 0x7f7780004800 2024-09-11T22:20:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f7798b78640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f77940b7ee0 con 0x7f77940cc120 2024-09-11T22:20:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f7798b78640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f77940b78b0 con 0x7f77941f4650 2024-09-11T22:20:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f779259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7780004800 0x7f77941f86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f779259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7780004800 0x7f77941f86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45312/0 (socket says 172.21.15.50:45312) 2024-09-11T22:20:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f779259c640 1 -- 172.21.15.50:0/3672224834 learned_addr learned my addr 172.21.15.50:0/3672224834 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f7792d9d640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940cc120 0x7f77940cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f779259c640 1 -- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77941f4650 msgr2=0x7f7794155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:00.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f7791d9b640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77941f4650 0x7f7794155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:00.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f779259c640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77941f4650 0x7f7794155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f779259c640 1 -- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940cc120 msgr2=0x7f77940cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:00.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f779259c640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940cc120 0x7f77940cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f779259c640 1 -- 172.21.15.50:0/3672224834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7794156020 con 0x7f7780004800 2024-09-11T22:20:00.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f7792d9d640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940cc120 0x7f77940cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:00.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f7791d9b640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77941f4650 0x7f7794155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:00.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f779259c640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7780004800 0x7f77941f86f0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f778c00ab40 tx=0x7f778c004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:00.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.244+0000 7f778affd640 1 -- 172.21.15.50:0/3672224834 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c007970 con 0x7f7780004800 2024-09-11T22:20:00.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.245+0000 7f778affd640 1 -- 172.21.15.50:0/3672224834 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778c018070 con 0x7f7780004800 2024-09-11T22:20:00.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.245+0000 7f7798b78640 1 -- 172.21.15.50:0/3672224834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77941f4dc0 con 0x7f7780004800 2024-09-11T22:20:00.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.245+0000 7f778affd640 1 -- 172.21.15.50:0/3672224834 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c013630 con 0x7f7780004800 2024-09-11T22:20:00.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.245+0000 7f7798b78640 1 -- 172.21.15.50:0/3672224834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77941f5380 con 0x7f7780004800 2024-09-11T22:20:00.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.246+0000 7f7798b78640 1 -- 172.21.15.50:0/3672224834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77940d34f0 con 0x7f7780004800 2024-09-11T22:20:00.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.246+0000 7f778affd640 1 -- 172.21.15.50:0/3672224834 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f778c0137d0 con 0x7f7780004800 2024-09-11T22:20:00.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.247+0000 7f778affd640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f777406be60 0x7f777406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:00.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.247+0000 7f778affd640 1 -- 172.21.15.50:0/3672224834 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f778c08b4f0 con 0x7f7780004800 2024-09-11T22:20:00.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.247+0000 7f7791d9b640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f777406be60 0x7f777406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:00.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.248+0000 7f7791d9b640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f777406be60 0x7f777406e320 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f777c033000 tx=0x7f777c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:00.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.251+0000 7f778affd640 1 -- 172.21.15.50:0/3672224834 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f77940cfa80 con 0x7f7780004800 2024-09-11T22:20:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.423+0000 7f7798b78640 1 -- 172.21.15.50:0/3672224834 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77941f55c0 con 0x7f777406be60 2024-09-11T22:20:00.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.429+0000 7f778affd640 1 -- 172.21.15.50:0/3672224834 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252479 (secure 0 0 0) 0x7f77941f55c0 con 0x7f777406be60 2024-09-11T22:20:00.433 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:00.434 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:20:00.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.432+0000 7f7798b78640 1 -- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f777406be60 msgr2=0x7f777406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:00.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.432+0000 7f7798b78640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f777406be60 0x7f777406e320 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f777c033000 tx=0x7f777c008030 comp rx=0 tx=0).stop 2024-09-11T22:20:00.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.432+0000 7f7798b78640 1 -- 172.21.15.50:0/3672224834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7780004800 msgr2=0x7f77941f86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.432+0000 7f7798b78640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7780004800 0x7f77941f86f0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f778c00ab40 tx=0x7f778c004f20 comp rx=0 tx=0).stop 2024-09-11T22:20:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.432+0000 7f7798b78640 1 -- 172.21.15.50:0/3672224834 shutdown_connections 2024-09-11T22:20:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.432+0000 7f7798b78640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f777406be60 0x7f777406e320 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.432+0000 7f7798b78640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77941f4650 0x7f7794155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.432+0000 7f7798b78640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940cc120 0x7f77940cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.432+0000 7f7798b78640 1 --2- 172.21.15.50:0/3672224834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7780004800 0x7f77941f86f0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.432+0000 7f7798b78640 1 -- 172.21.15.50:0/3672224834 >> 172.21.15.50:0/3672224834 conn(0x7f77940727a0 msgr2=0x7f77940b5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.432+0000 7f7798b78640 1 -- 172.21.15.50:0/3672224834 shutdown_connections 2024-09-11T22:20:00.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:00.432+0000 7f7798b78640 1 -- 172.21.15.50:0/3672224834 wait complete. 2024-09-11T22:20:00.444 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-11T22:19:59.491894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":434092,"kb_used_data":15216,"kb_used_omap":12,"kb_used_meta":418675,"kb_avail":754540628,"statfs":{"total":773094113280,"available":772649603072,"internally_reserved":0,"allocated":15581184,"data_stored":7468420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":428723761},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001413"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488278+0000","last_change":"2024-09-11T22:19:55.497801+0000","last_active":"2024-09-11T22:19:56.488278+0000","last_peered":"2024-09-11T22:19:56.488278+0000","last_clean":"2024-09-11T22:19:56.488278+0000","last_became_active":"2024-09-11T22:19:55.495941+0000","last_became_peered":"2024-09-11T22:19:55.495941+0000","last_unstale":"2024-09-11T22:19:56.488278+0000","last_undegraded":"2024-09-11T22:19:56.488278+0000","last_fullsized":"2024-09-11T22:19:56.488278+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.189171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141363+0000","last_change":"2024-09-11T22:19:55.488456+0000","last_active":"2024-09-11T22:19:58.141363+0000","last_peered":"2024-09-11T22:19:58.141363+0000","last_clean":"2024-09-11T22:19:58.141363+0000","last_became_active":"2024-09-11T22:19:55.487771+0000","last_became_peered":"2024-09-11T22:19:55.487771+0000","last_unstale":"2024-09-11T22:19:58.141363+0000","last_undegraded":"2024-09-11T22:19:58.141363+0000","last_fullsized":"2024-09-11T22:19:58.141363+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:27.523574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.289017+0000","last_change":"2024-09-11T22:19:55.500016+0000","last_active":"2024-09-11T22:19:57.289017+0000","last_peered":"2024-09-11T22:19:57.289017+0000","last_clean":"2024-09-11T22:19:57.289017+0000","last_became_active":"2024-09-11T22:19:55.499052+0000","last_became_peered":"2024-09-11T22:19:55.499052+0000","last_unstale":"2024-09-11T22:19:57.289017+0000","last_undegraded":"2024-09-11T22:19:57.289017+0000","last_fullsized":"2024-09-11T22:19:57.289017+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.189171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491124+0000","last_change":"2024-09-11T22:19:55.497597+0000","last_active":"2024-09-11T22:19:56.491124+0000","last_peered":"2024-09-11T22:19:56.491124+0000","last_clean":"2024-09-11T22:19:56.491124+0000","last_became_active":"2024-09-11T22:19:55.497250+0000","last_became_peered":"2024-09-11T22:19:55.497250+0000","last_unstale":"2024-09-11T22:19:56.491124+0000","last_undegraded":"2024-09-11T22:19:56.491124+0000","last_fullsized":"2024-09-11T22:19:56.491124+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:01.548622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491118+0000","last_change":"2024-09-11T22:19:55.498292+0000","last_active":"2024-09-11T22:19:56.491118+0000","last_peered":"2024-09-11T22:19:56.491118+0000","last_clean":"2024-09-11T22:19:56.491118+0000","last_became_active":"2024-09-11T22:19:55.497218+0000","last_became_peered":"2024-09-11T22:19:55.497218+0000","last_unstale":"2024-09-11T22:19:56.491118+0000","last_undegraded":"2024-09-11T22:19:56.491118+0000","last_fullsized":"2024-09-11T22:19:56.491118+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:23.922387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487971+0000","last_change":"2024-09-11T22:19:55.496613+0000","last_active":"2024-09-11T22:19:56.487971+0000","last_peered":"2024-09-11T22:19:56.487971+0000","last_clean":"2024-09-11T22:19:56.487971+0000","last_became_active":"2024-09-11T22:19:55.496353+0000","last_became_peered":"2024-09-11T22:19:55.496353+0000","last_unstale":"2024-09-11T22:19:56.487971+0000","last_undegraded":"2024-09-11T22:19:56.487971+0000","last_fullsized":"2024-09-11T22:19:56.487971+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:08.530682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140645+0000","last_change":"2024-09-11T22:19:55.492627+0000","last_active":"2024-09-11T22:19:58.140645+0000","last_peered":"2024-09-11T22:19:58.140645+0000","last_clean":"2024-09-11T22:19:58.140645+0000","last_became_active":"2024-09-11T22:19:55.491897+0000","last_became_peered":"2024-09-11T22:19:55.491897+0000","last_unstale":"2024-09-11T22:19:58.140645+0000","last_undegraded":"2024-09-11T22:19:58.140645+0000","last_fullsized":"2024-09-11T22:19:58.140645+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:26.538537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487774+0000","last_change":"2024-09-11T22:19:55.492362+0000","last_active":"2024-09-11T22:19:56.487774+0000","last_peered":"2024-09-11T22:19:56.487774+0000","last_clean":"2024-09-11T22:19:56.487774+0000","last_became_active":"2024-09-11T22:19:55.491940+0000","last_became_peered":"2024-09-11T22:19:55.491940+0000","last_unstale":"2024-09-11T22:19:56.487774+0000","last_undegraded":"2024-09-11T22:19:56.487774+0000","last_fullsized":"2024-09-11T22:19:56.487774+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:41.636678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141189+0000","last_change":"2024-09-11T22:19:55.492631+0000","last_active":"2024-09-11T22:19:58.141189+0000","last_peered":"2024-09-11T22:19:58.141189+0000","last_clean":"2024-09-11T22:19:58.141189+0000","last_became_active":"2024-09-11T22:19:55.492345+0000","last_became_peered":"2024-09-11T22:19:55.492345+0000","last_unstale":"2024-09-11T22:19:58.141189+0000","last_undegraded":"2024-09-11T22:19:58.141189+0000","last_fullsized":"2024-09-11T22:19:58.141189+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:37.934511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384059+0000","last_change":"2024-09-11T22:19:55.498360+0000","last_active":"2024-09-11T22:19:57.384059+0000","last_peered":"2024-09-11T22:19:57.384059+0000","last_clean":"2024-09-11T22:19:57.384059+0000","last_became_active":"2024-09-11T22:19:55.498102+0000","last_became_peered":"2024-09-11T22:19:55.498102+0000","last_unstale":"2024-09-11T22:19:57.384059+0000","last_undegraded":"2024-09-11T22:19:57.384059+0000","last_fullsized":"2024-09-11T22:19:57.384059+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:21.245925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488107+0000","last_change":"2024-09-11T22:19:55.502131+0000","last_active":"2024-09-11T22:19:56.488107+0000","last_peered":"2024-09-11T22:19:56.488107+0000","last_clean":"2024-09-11T22:19:56.488107+0000","last_became_active":"2024-09-11T22:19:55.501541+0000","last_became_peered":"2024-09-11T22:19:55.501541+0000","last_unstale":"2024-09-11T22:19:56.488107+0000","last_undegraded":"2024-09-11T22:19:56.488107+0000","last_fullsized":"2024-09-11T22:19:56.488107+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:48.541584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383767+0000","last_change":"2024-09-11T22:19:55.505563+0000","last_active":"2024-09-11T22:19:57.383767+0000","last_peered":"2024-09-11T22:19:57.383767+0000","last_clean":"2024-09-11T22:19:57.383767+0000","last_became_active":"2024-09-11T22:19:55.504577+0000","last_became_peered":"2024-09-11T22:19:55.504577+0000","last_unstale":"2024-09-11T22:19:57.383767+0000","last_undegraded":"2024-09-11T22:19:57.383767+0000","last_fullsized":"2024-09-11T22:19:57.383767+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:01.707109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491282+0000","last_change":"2024-09-11T22:19:55.497465+0000","last_active":"2024-09-11T22:19:56.491282+0000","last_peered":"2024-09-11T22:19:56.491282+0000","last_clean":"2024-09-11T22:19:56.491282+0000","last_became_active":"2024-09-11T22:19:55.496884+0000","last_became_peered":"2024-09-11T22:19:55.496884+0000","last_unstale":"2024-09-11T22:19:56.491282+0000","last_undegraded":"2024-09-11T22:19:56.491282+0000","last_fullsized":"2024-09-11T22:19:56.491282+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:07.952832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490641+0000","last_change":"2024-09-11T22:19:55.493735+0000","last_active":"2024-09-11T22:19:56.490641+0000","last_peered":"2024-09-11T22:19:56.490641+0000","last_clean":"2024-09-11T22:19:56.490641+0000","last_became_active":"2024-09-11T22:19:55.493287+0000","last_became_peered":"2024-09-11T22:19:55.493287+0000","last_unstale":"2024-09-11T22:19:56.490641+0000","last_undegraded":"2024-09-11T22:19:56.490641+0000","last_fullsized":"2024-09-11T22:19:56.490641+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:23.106236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383643+0000","last_change":"2024-09-11T22:19:55.502428+0000","last_active":"2024-09-11T22:19:57.383643+0000","last_peered":"2024-09-11T22:19:57.383643+0000","last_clean":"2024-09-11T22:19:57.383643+0000","last_became_active":"2024-09-11T22:19:55.502180+0000","last_became_peered":"2024-09-11T22:19:55.502180+0000","last_unstale":"2024-09-11T22:19:57.383643+0000","last_undegraded":"2024-09-11T22:19:57.383643+0000","last_fullsized":"2024-09-11T22:19:57.383643+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:11.355696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.499189+0000","last_change":"2024-09-11T22:19:55.496357+0000","last_active":"2024-09-11T22:19:55.499189+0000","last_peered":"2024-09-11T22:19:55.499189+0000","last_clean":"2024-09-11T22:19:55.499189+0000","last_became_active":"2024-09-11T22:19:55.496083+0000","last_became_peered":"2024-09-11T22:19:55.496083+0000","last_unstale":"2024-09-11T22:19:55.499189+0000","last_undegraded":"2024-09-11T22:19:55.499189+0000","last_fullsized":"2024-09-11T22:19:55.499189+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:12.169198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384215+0000","last_change":"2024-09-11T22:19:55.496386+0000","last_active":"2024-09-11T22:19:57.384215+0000","last_peered":"2024-09-11T22:19:57.384215+0000","last_clean":"2024-09-11T22:19:57.384215+0000","last_became_active":"2024-09-11T22:19:55.495842+0000","last_became_peered":"2024-09-11T22:19:55.495842+0000","last_unstale":"2024-09-11T22:19:57.384215+0000","last_undegraded":"2024-09-11T22:19:57.384215+0000","last_fullsized":"2024-09-11T22:19:57.384215+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:47.251855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288947+0000","last_change":"2024-09-11T22:19:55.494110+0000","last_active":"2024-09-11T22:19:57.288947+0000","last_peered":"2024-09-11T22:19:57.288947+0000","last_clean":"2024-09-11T22:19:57.288947+0000","last_became_active":"2024-09-11T22:19:55.493859+0000","last_became_peered":"2024-09-11T22:19:55.493859+0000","last_unstale":"2024-09-11T22:19:57.288947+0000","last_undegraded":"2024-09-11T22:19:57.288947+0000","last_fullsized":"2024-09-11T22:19:57.288947+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:23.106236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488351+0000","last_change":"2024-09-11T22:19:55.502886+0000","last_active":"2024-09-11T22:19:56.488351+0000","last_peered":"2024-09-11T22:19:56.488351+0000","last_clean":"2024-09-11T22:19:56.488351+0000","last_became_active":"2024-09-11T22:19:55.495715+0000","last_became_peered":"2024-09-11T22:19:55.495715+0000","last_unstale":"2024-09-11T22:19:56.488351+0000","last_undegraded":"2024-09-11T22:19:56.488351+0000","last_fullsized":"2024-09-11T22:19:56.488351+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:16.795325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.490399+0000","last_change":"2024-09-11T22:19:55.489451+0000","last_active":"2024-09-11T22:19:55.490399+0000","last_peered":"2024-09-11T22:19:55.490399+0000","last_clean":"2024-09-11T22:19:55.490399+0000","last_became_active":"2024-09-11T22:19:55.489198+0000","last_became_peered":"2024-09-11T22:19:55.489198+0000","last_unstale":"2024-09-11T22:19:55.490399+0000","last_undegraded":"2024-09-11T22:19:55.490399+0000","last_fullsized":"2024-09-11T22:19:55.490399+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.715938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384249+0000","last_change":"2024-09-11T22:19:55.499103+0000","last_active":"2024-09-11T22:19:57.384249+0000","last_peered":"2024-09-11T22:19:57.384249+0000","last_clean":"2024-09-11T22:19:57.384249+0000","last_became_active":"2024-09-11T22:19:55.498817+0000","last_became_peered":"2024-09-11T22:19:55.498817+0000","last_unstale":"2024-09-11T22:19:57.384249+0000","last_undegraded":"2024-09-11T22:19:57.384249+0000","last_fullsized":"2024-09-11T22:19:57.384249+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:45.826396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490862+0000","last_change":"2024-09-11T22:19:55.492448+0000","last_active":"2024-09-11T22:19:56.490862+0000","last_peered":"2024-09-11T22:19:56.490862+0000","last_clean":"2024-09-11T22:19:56.490862+0000","last_became_active":"2024-09-11T22:19:55.491976+0000","last_became_peered":"2024-09-11T22:19:55.491976+0000","last_unstale":"2024-09-11T22:19:56.490862+0000","last_undegraded":"2024-09-11T22:19:56.490862+0000","last_fullsized":"2024-09-11T22:19:56.490862+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.189171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490767+0000","last_change":"2024-09-11T22:19:55.489318+0000","last_active":"2024-09-11T22:19:56.490767+0000","last_peered":"2024-09-11T22:19:56.490767+0000","last_clean":"2024-09-11T22:19:56.490767+0000","last_became_active":"2024-09-11T22:19:55.489045+0000","last_became_peered":"2024-09-11T22:19:55.489045+0000","last_unstale":"2024-09-11T22:19:56.490767+0000","last_undegraded":"2024-09-11T22:19:56.490767+0000","last_fullsized":"2024-09-11T22:19:56.490767+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.589766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383730+0000","last_change":"2024-09-11T22:19:55.501801+0000","last_active":"2024-09-11T22:19:57.383730+0000","last_peered":"2024-09-11T22:19:57.383730+0000","last_clean":"2024-09-11T22:19:57.383730+0000","last_became_active":"2024-09-11T22:19:55.501488+0000","last_became_peered":"2024-09-11T22:19:55.501488+0000","last_unstale":"2024-09-11T22:19:57.383730+0000","last_undegraded":"2024-09-11T22:19:57.383730+0000","last_fullsized":"2024-09-11T22:19:57.383730+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:56.830151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.502914+0000","last_change":"2024-09-11T22:19:55.499959+0000","last_active":"2024-09-11T22:19:55.502914+0000","last_peered":"2024-09-11T22:19:55.502914+0000","last_clean":"2024-09-11T22:19:55.502914+0000","last_became_active":"2024-09-11T22:19:55.499649+0000","last_became_peered":"2024-09-11T22:19:55.499649+0000","last_unstale":"2024-09-11T22:19:55.502914+0000","last_undegraded":"2024-09-11T22:19:55.502914+0000","last_fullsized":"2024-09-11T22:19:55.502914+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:28.378190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488115+0000","last_change":"2024-09-11T22:19:55.492128+0000","last_active":"2024-09-11T22:19:56.488115+0000","last_peered":"2024-09-11T22:19:56.488115+0000","last_clean":"2024-09-11T22:19:56.488115+0000","last_became_active":"2024-09-11T22:19:55.491752+0000","last_became_peered":"2024-09-11T22:19:55.491752+0000","last_unstale":"2024-09-11T22:19:56.488115+0000","last_undegraded":"2024-09-11T22:19:56.488115+0000","last_fullsized":"2024-09-11T22:19:56.488115+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:26.649106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.508793+0000","last_change":"2024-09-11T22:19:55.507660+0000","last_active":"2024-09-11T22:19:55.508793+0000","last_peered":"2024-09-11T22:19:55.508793+0000","last_clean":"2024-09-11T22:19:55.508793+0000","last_became_active":"2024-09-11T22:19:55.507383+0000","last_became_peered":"2024-09-11T22:19:55.507383+0000","last_unstale":"2024-09-11T22:19:55.508793+0000","last_undegraded":"2024-09-11T22:19:55.508793+0000","last_fullsized":"2024-09-11T22:19:55.508793+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:29.715798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140930+0000","last_change":"2024-09-11T22:19:55.494927+0000","last_active":"2024-09-11T22:19:58.140930+0000","last_peered":"2024-09-11T22:19:58.140930+0000","last_clean":"2024-09-11T22:19:58.140930+0000","last_became_active":"2024-09-11T22:19:55.494588+0000","last_became_peered":"2024-09-11T22:19:55.494588+0000","last_unstale":"2024-09-11T22:19:58.140930+0000","last_undegraded":"2024-09-11T22:19:58.140930+0000","last_fullsized":"2024-09-11T22:19:58.140930+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:18.667141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487852+0000","last_change":"2024-09-11T22:19:55.496473+0000","last_active":"2024-09-11T22:19:56.487852+0000","last_peered":"2024-09-11T22:19:56.487852+0000","last_clean":"2024-09-11T22:19:56.487852+0000","last_became_active":"2024-09-11T22:19:55.495733+0000","last_became_peered":"2024-09-11T22:19:55.495733+0000","last_unstale":"2024-09-11T22:19:56.487852+0000","last_undegraded":"2024-09-11T22:19:56.487852+0000","last_fullsized":"2024-09-11T22:19:56.487852+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:26.459071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491021+0000","last_change":"2024-09-11T22:19:55.497030+0000","last_active":"2024-09-11T22:19:56.491021+0000","last_peered":"2024-09-11T22:19:56.491021+0000","last_clean":"2024-09-11T22:19:56.491021+0000","last_became_active":"2024-09-11T22:19:55.496463+0000","last_became_peered":"2024-09-11T22:19:55.496463+0000","last_unstale":"2024-09-11T22:19:56.491021+0000","last_undegraded":"2024-09-11T22:19:56.491021+0000","last_fullsized":"2024-09-11T22:19:56.491021+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:46.193176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141160+0000","last_change":"2024-09-11T22:19:55.501904+0000","last_active":"2024-09-11T22:19:58.141160+0000","last_peered":"2024-09-11T22:19:58.141160+0000","last_clean":"2024-09-11T22:19:58.141160+0000","last_became_active":"2024-09-11T22:19:55.501549+0000","last_became_peered":"2024-09-11T22:19:55.501549+0000","last_unstale":"2024-09-11T22:19:58.141160+0000","last_undegraded":"2024-09-11T22:19:58.141160+0000","last_fullsized":"2024-09-11T22:19:58.141160+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:10.399156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.499209+0000","last_change":"2024-09-11T22:19:55.494531+0000","last_active":"2024-09-11T22:19:55.499209+0000","last_peered":"2024-09-11T22:19:55.499209+0000","last_clean":"2024-09-11T22:19:55.499209+0000","last_became_active":"2024-09-11T22:19:55.491160+0000","last_became_peered":"2024-09-11T22:19:55.491160+0000","last_unstale":"2024-09-11T22:19:55.499209+0000","last_undegraded":"2024-09-11T22:19:55.499209+0000","last_fullsized":"2024-09-11T22:19:55.499209+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:02.052132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384151+0000","last_change":"2024-09-11T22:19:55.504254+0000","last_active":"2024-09-11T22:19:57.384151+0000","last_peered":"2024-09-11T22:19:57.384151+0000","last_clean":"2024-09-11T22:19:57.384151+0000","last_became_active":"2024-09-11T22:19:55.503807+0000","last_became_peered":"2024-09-11T22:19:55.503807+0000","last_unstale":"2024-09-11T22:19:57.384151+0000","last_undegraded":"2024-09-11T22:19:57.384151+0000","last_fullsized":"2024-09-11T22:19:57.384151+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:05.936518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"143'4","reported_seq":18,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384092+0000","last_change":"2024-09-11T22:19:54.477507+0000","last_active":"2024-09-11T22:19:57.384092+0000","last_peered":"2024-09-11T22:19:57.384092+0000","last_clean":"2024-09-11T22:19:57.384092+0000","last_became_active":"2024-09-11T22:19:54.477195+0000","last_became_peered":"2024-09-11T22:19:54.477195+0000","last_unstale":"2024-09-11T22:19:57.384092+0000","last_undegraded":"2024-09-11T22:19:57.384092+0000","last_fullsized":"2024-09-11T22:19:57.384092+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:53.923066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141357+0000","last_change":"2024-09-11T22:19:55.488065+0000","last_active":"2024-09-11T22:19:58.141357+0000","last_peered":"2024-09-11T22:19:58.141357+0000","last_clean":"2024-09-11T22:19:58.141357+0000","last_became_active":"2024-09-11T22:19:55.487735+0000","last_became_peered":"2024-09-11T22:19:55.487735+0000","last_unstale":"2024-09-11T22:19:58.141357+0000","last_undegraded":"2024-09-11T22:19:58.141357+0000","last_fullsized":"2024-09-11T22:19:58.141357+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:48.758602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141343+0000","last_change":"2024-09-11T22:19:54.476633+0000","last_active":"2024-09-11T22:19:58.141343+0000","last_peered":"2024-09-11T22:19:58.141343+0000","last_clean":"2024-09-11T22:19:58.141343+0000","last_became_active":"2024-09-11T22:19:54.476047+0000","last_became_peered":"2024-09-11T22:19:54.476047+0000","last_unstale":"2024-09-11T22:19:58.141343+0000","last_undegraded":"2024-09-11T22:19:58.141343+0000","last_fullsized":"2024-09-11T22:19:58.141343+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:32.769254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487982+0000","last_change":"2024-09-11T22:19:55.493592+0000","last_active":"2024-09-11T22:19:56.487982+0000","last_peered":"2024-09-11T22:19:56.487982+0000","last_clean":"2024-09-11T22:19:56.487982+0000","last_became_active":"2024-09-11T22:19:55.493325+0000","last_became_peered":"2024-09-11T22:19:55.493325+0000","last_unstale":"2024-09-11T22:19:56.487982+0000","last_undegraded":"2024-09-11T22:19:56.487982+0000","last_fullsized":"2024-09-11T22:19:56.487982+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:41.997281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490402+0000","last_change":"2024-09-11T22:19:54.479267+0000","last_active":"2024-09-11T22:19:56.490402+0000","last_peered":"2024-09-11T22:19:56.490402+0000","last_clean":"2024-09-11T22:19:56.490402+0000","last_became_active":"2024-09-11T22:19:54.478991+0000","last_became_peered":"2024-09-11T22:19:54.478991+0000","last_unstale":"2024-09-11T22:19:56.490402+0000","last_undegraded":"2024-09-11T22:19:56.490402+0000","last_fullsized":"2024-09-11T22:19:56.490402+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:16.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383952+0000","last_change":"2024-09-11T22:19:55.504793+0000","last_active":"2024-09-11T22:19:57.383952+0000","last_peered":"2024-09-11T22:19:57.383952+0000","last_clean":"2024-09-11T22:19:57.383952+0000","last_became_active":"2024-09-11T22:19:55.504439+0000","last_became_peered":"2024-09-11T22:19:55.504439+0000","last_unstale":"2024-09-11T22:19:57.383952+0000","last_undegraded":"2024-09-11T22:19:57.383952+0000","last_fullsized":"2024-09-11T22:19:57.383952+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:18.199474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491187+0000","last_change":"2024-09-11T22:19:54.480234+0000","last_active":"2024-09-11T22:19:56.491187+0000","last_peered":"2024-09-11T22:19:56.491187+0000","last_clean":"2024-09-11T22:19:56.491187+0000","last_became_active":"2024-09-11T22:19:54.479962+0000","last_became_peered":"2024-09-11T22:19:54.479962+0000","last_unstale":"2024-09-11T22:19:56.491187+0000","last_undegraded":"2024-09-11T22:19:56.491187+0000","last_fullsized":"2024-09-11T22:19:56.491187+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:05.640856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140862+0000","last_change":"2024-09-11T22:19:55.495546+0000","last_active":"2024-09-11T22:19:58.140862+0000","last_peered":"2024-09-11T22:19:58.140862+0000","last_clean":"2024-09-11T22:19:58.140862+0000","last_became_active":"2024-09-11T22:19:55.495260+0000","last_became_peered":"2024-09-11T22:19:55.495260+0000","last_unstale":"2024-09-11T22:19:58.140862+0000","last_undegraded":"2024-09-11T22:19:58.140862+0000","last_fullsized":"2024-09-11T22:19:58.140862+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:18.667141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"143'1","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.508433+0000","last_change":"2024-09-11T22:19:54.486151+0000","last_active":"2024-09-11T22:19:55.508433+0000","last_peered":"2024-09-11T22:19:55.508433+0000","last_clean":"2024-09-11T22:19:55.508433+0000","last_became_active":"2024-09-11T22:19:54.485525+0000","last_became_peered":"2024-09-11T22:19:54.485525+0000","last_unstale":"2024-09-11T22:19:55.508433+0000","last_undegraded":"2024-09-11T22:19:55.508433+0000","last_fullsized":"2024-09-11T22:19:55.508433+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:06.778567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490878+0000","last_change":"2024-09-11T22:19:55.496145+0000","last_active":"2024-09-11T22:19:56.490878+0000","last_peered":"2024-09-11T22:19:56.490878+0000","last_clean":"2024-09-11T22:19:56.490878+0000","last_became_active":"2024-09-11T22:19:55.495816+0000","last_became_peered":"2024-09-11T22:19:55.495816+0000","last_unstale":"2024-09-11T22:19:56.490878+0000","last_undegraded":"2024-09-11T22:19:56.490878+0000","last_fullsized":"2024-09-11T22:19:56.490878+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:16.795325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490169+0000","last_change":"2024-09-11T22:19:54.478301+0000","last_active":"2024-09-11T22:19:56.490169+0000","last_peered":"2024-09-11T22:19:56.490169+0000","last_clean":"2024-09-11T22:19:56.490169+0000","last_became_active":"2024-09-11T22:19:54.478021+0000","last_became_peered":"2024-09-11T22:19:54.478021+0000","last_unstale":"2024-09-11T22:19:56.490169+0000","last_undegraded":"2024-09-11T22:19:56.490169+0000","last_fullsized":"2024-09-11T22:19:56.490169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:58.768201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140956+0000","last_change":"2024-09-11T22:19:55.489324+0000","last_active":"2024-09-11T22:19:58.140956+0000","last_peered":"2024-09-11T22:19:58.140956+0000","last_clean":"2024-09-11T22:19:58.140956+0000","last_became_active":"2024-09-11T22:19:55.488662+0000","last_became_peered":"2024-09-11T22:19:55.488662+0000","last_unstale":"2024-09-11T22:19:58.140956+0000","last_undegraded":"2024-09-11T22:19:58.140956+0000","last_fullsized":"2024-09-11T22:19:58.140956+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:30.847050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.481838+0000","last_change":"2024-09-11T22:19:54.484169+0000","last_active":"2024-09-11T22:19:55.481838+0000","last_peered":"2024-09-11T22:19:55.481838+0000","last_clean":"2024-09-11T22:19:55.481838+0000","last_became_active":"2024-09-11T22:19:54.483844+0000","last_became_peered":"2024-09-11T22:19:54.483844+0000","last_unstale":"2024-09-11T22:19:55.481838+0000","last_undegraded":"2024-09-11T22:19:55.481838+0000","last_fullsized":"2024-09-11T22:19:55.481838+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:19.353179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490586+0000","last_change":"2024-09-11T22:19:55.499899+0000","last_active":"2024-09-11T22:19:56.490586+0000","last_peered":"2024-09-11T22:19:56.490586+0000","last_clean":"2024-09-11T22:19:56.490586+0000","last_became_active":"2024-09-11T22:19:55.499393+0000","last_became_peered":"2024-09-11T22:19:55.499393+0000","last_unstale":"2024-09-11T22:19:56.490586+0000","last_undegraded":"2024-09-11T22:19:56.490586+0000","last_fullsized":"2024-09-11T22:19:56.490586+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:57.477233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490396+0000","last_change":"2024-09-11T22:19:54.483595+0000","last_active":"2024-09-11T22:19:56.490396+0000","last_peered":"2024-09-11T22:19:56.490396+0000","last_clean":"2024-09-11T22:19:56.490396+0000","last_became_active":"2024-09-11T22:19:54.483323+0000","last_became_peered":"2024-09-11T22:19:54.483323+0000","last_unstale":"2024-09-11T22:19:56.490396+0000","last_undegraded":"2024-09-11T22:19:56.490396+0000","last_fullsized":"2024-09-11T22:19:56.490396+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:28.593199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490783+0000","last_change":"2024-09-11T22:19:55.499707+0000","last_active":"2024-09-11T22:19:56.490783+0000","last_peered":"2024-09-11T22:19:56.490783+0000","last_clean":"2024-09-11T22:19:56.490783+0000","last_became_active":"2024-09-11T22:19:55.499444+0000","last_became_peered":"2024-09-11T22:19:55.499444+0000","last_unstale":"2024-09-11T22:19:56.490783+0000","last_undegraded":"2024-09-11T22:19:56.490783+0000","last_fullsized":"2024-09-11T22:19:56.490783+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:20.735423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141346+0000","last_change":"2024-09-11T22:19:54.477229+0000","last_active":"2024-09-11T22:19:58.141346+0000","last_peered":"2024-09-11T22:19:58.141346+0000","last_clean":"2024-09-11T22:19:58.141346+0000","last_became_active":"2024-09-11T22:19:54.476974+0000","last_became_peered":"2024-09-11T22:19:54.476974+0000","last_unstale":"2024-09-11T22:19:58.141346+0000","last_undegraded":"2024-09-11T22:19:58.141346+0000","last_fullsized":"2024-09-11T22:19:58.141346+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:22.872508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384098+0000","last_change":"2024-09-11T22:19:55.496132+0000","last_active":"2024-09-11T22:19:57.384098+0000","last_peered":"2024-09-11T22:19:57.384098+0000","last_clean":"2024-09-11T22:19:57.384098+0000","last_became_active":"2024-09-11T22:19:55.495466+0000","last_became_peered":"2024-09-11T22:19:55.495466+0000","last_unstale":"2024-09-11T22:19:57.384098+0000","last_undegraded":"2024-09-11T22:19:57.384098+0000","last_fullsized":"2024-09-11T22:19:57.384098+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:07.378924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384287+0000","last_change":"2024-09-11T22:19:54.480915+0000","last_active":"2024-09-11T22:19:57.384287+0000","last_peered":"2024-09-11T22:19:57.384287+0000","last_clean":"2024-09-11T22:19:57.384287+0000","last_became_active":"2024-09-11T22:19:54.480633+0000","last_became_peered":"2024-09-11T22:19:54.480633+0000","last_unstale":"2024-09-11T22:19:57.384287+0000","last_undegraded":"2024-09-11T22:19:57.384287+0000","last_fullsized":"2024-09-11T22:19:57.384287+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:37.295459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.490098+0000","last_change":"2024-09-11T22:19:55.487749+0000","last_active":"2024-09-11T22:19:55.490098+0000","last_peered":"2024-09-11T22:19:55.490098+0000","last_clean":"2024-09-11T22:19:55.490098+0000","last_became_active":"2024-09-11T22:19:55.487462+0000","last_became_peered":"2024-09-11T22:19:55.487462+0000","last_unstale":"2024-09-11T22:19:55.490098+0000","last_undegraded":"2024-09-11T22:19:55.490098+0000","last_fullsized":"2024-09-11T22:19:55.490098+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:09.534990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"143'6","reported_seq":20,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140984+0000","last_change":"2024-09-11T22:19:54.485607+0000","last_active":"2024-09-11T22:19:58.140984+0000","last_peered":"2024-09-11T22:19:58.140984+0000","last_clean":"2024-09-11T22:19:58.140984+0000","last_became_active":"2024-09-11T22:19:54.485311+0000","last_became_peered":"2024-09-11T22:19:54.485311+0000","last_unstale":"2024-09-11T22:19:58.140984+0000","last_undegraded":"2024-09-11T22:19:58.140984+0000","last_fullsized":"2024-09-11T22:19:58.140984+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:39.296943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288680+0000","last_change":"2024-09-11T22:19:55.497422+0000","last_active":"2024-09-11T22:19:57.288680+0000","last_peered":"2024-09-11T22:19:57.288680+0000","last_clean":"2024-09-11T22:19:57.288680+0000","last_became_active":"2024-09-11T22:19:55.496976+0000","last_became_peered":"2024-09-11T22:19:55.496976+0000","last_unstale":"2024-09-11T22:19:57.288680+0000","last_undegraded":"2024-09-11T22:19:57.288680+0000","last_fullsized":"2024-09-11T22:19:57.288680+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:48.541584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288902+0000","last_change":"2024-09-11T22:19:54.480430+0000","last_active":"2024-09-11T22:19:57.288902+0000","last_peered":"2024-09-11T22:19:57.288902+0000","last_clean":"2024-09-11T22:19:57.288902+0000","last_became_active":"2024-09-11T22:19:54.479673+0000","last_became_peered":"2024-09-11T22:19:54.479673+0000","last_unstale":"2024-09-11T22:19:57.288902+0000","last_undegraded":"2024-09-11T22:19:57.288902+0000","last_fullsized":"2024-09-11T22:19:57.288902+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:53.772625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141025+0000","last_change":"2024-09-11T22:19:55.488085+0000","last_active":"2024-09-11T22:19:58.141025+0000","last_peered":"2024-09-11T22:19:58.141025+0000","last_clean":"2024-09-11T22:19:58.141025+0000","last_became_active":"2024-09-11T22:19:55.487780+0000","last_became_peered":"2024-09-11T22:19:55.487780+0000","last_unstale":"2024-09-11T22:19:58.141025+0000","last_undegraded":"2024-09-11T22:19:58.141025+0000","last_fullsized":"2024-09-11T22:19:58.141025+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:05.989636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288656+0000","last_change":"2024-09-11T22:19:54.480065+0000","last_active":"2024-09-11T22:19:57.288656+0000","last_peered":"2024-09-11T22:19:57.288656+0000","last_clean":"2024-09-11T22:19:57.288656+0000","last_became_active":"2024-09-11T22:19:54.479802+0000","last_became_peered":"2024-09-11T22:19:54.479802+0000","last_unstale":"2024-09-11T22:19:57.288656+0000","last_undegraded":"2024-09-11T22:19:57.288656+0000","last_fullsized":"2024-09-11T22:19:57.288656+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:08.105367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490468+0000","last_change":"2024-09-11T22:19:55.494426+0000","last_active":"2024-09-11T22:19:56.490468+0000","last_peered":"2024-09-11T22:19:56.490468+0000","last_clean":"2024-09-11T22:19:56.490468+0000","last_became_active":"2024-09-11T22:19:55.494068+0000","last_became_peered":"2024-09-11T22:19:55.494068+0000","last_unstale":"2024-09-11T22:19:56.490468+0000","last_undegraded":"2024-09-11T22:19:56.490468+0000","last_fullsized":"2024-09-11T22:19:56.490468+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:19.853525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487683+0000","last_change":"2024-09-11T22:19:54.480462+0000","last_active":"2024-09-11T22:19:56.487683+0000","last_peered":"2024-09-11T22:19:56.487683+0000","last_clean":"2024-09-11T22:19:56.487683+0000","last_became_active":"2024-09-11T22:19:54.480164+0000","last_became_peered":"2024-09-11T22:19:54.480164+0000","last_unstale":"2024-09-11T22:19:56.487683+0000","last_undegraded":"2024-09-11T22:19:56.487683+0000","last_fullsized":"2024-09-11T22:19:56.487683+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:06.951053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288579+0000","last_change":"2024-09-11T22:19:55.508144+0000","last_active":"2024-09-11T22:19:57.288579+0000","last_peered":"2024-09-11T22:19:57.288579+0000","last_clean":"2024-09-11T22:19:57.288579+0000","last_became_active":"2024-09-11T22:19:55.506988+0000","last_became_peered":"2024-09-11T22:19:55.506988+0000","last_unstale":"2024-09-11T22:19:57.288579+0000","last_undegraded":"2024-09-11T22:19:57.288579+0000","last_fullsized":"2024-09-11T22:19:57.288579+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:41.997281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"143'8","reported_seq":20,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.511146+0000","last_change":"2024-09-11T22:19:54.482849+0000","last_active":"2024-09-11T22:19:55.511146+0000","last_peered":"2024-09-11T22:19:55.511146+0000","last_clean":"2024-09-11T22:19:55.511146+0000","last_became_active":"2024-09-11T22:19:54.482552+0000","last_became_peered":"2024-09-11T22:19:54.482552+0000","last_unstale":"2024-09-11T22:19:55.511146+0000","last_undegraded":"2024-09-11T22:19:55.511146+0000","last_fullsized":"2024-09-11T22:19:55.511146+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:34.396451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384240+0000","last_change":"2024-09-11T22:19:55.496672+0000","last_active":"2024-09-11T22:19:57.384240+0000","last_peered":"2024-09-11T22:19:57.384240+0000","last_clean":"2024-09-11T22:19:57.384240+0000","last_became_active":"2024-09-11T22:19:55.496398+0000","last_became_peered":"2024-09-11T22:19:55.496398+0000","last_unstale":"2024-09-11T22:19:57.384240+0000","last_undegraded":"2024-09-11T22:19:57.384240+0000","last_fullsized":"2024-09-11T22:19:57.384240+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:54.264936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490889+0000","last_change":"2024-09-11T22:19:54.481617+0000","last_active":"2024-09-11T22:19:56.490889+0000","last_peered":"2024-09-11T22:19:56.490889+0000","last_clean":"2024-09-11T22:19:56.490889+0000","last_became_active":"2024-09-11T22:19:54.480067+0000","last_became_peered":"2024-09-11T22:19:54.480067+0000","last_unstale":"2024-09-11T22:19:56.490889+0000","last_undegraded":"2024-09-11T22:19:56.490889+0000","last_fullsized":"2024-09-11T22:19:56.490889+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:32.541675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.502094+0000","last_change":"2024-09-11T22:19:55.498674+0000","last_active":"2024-09-11T22:19:55.502094+0000","last_peered":"2024-09-11T22:19:55.502094+0000","last_clean":"2024-09-11T22:19:55.502094+0000","last_became_active":"2024-09-11T22:19:55.498398+0000","last_became_peered":"2024-09-11T22:19:55.498398+0000","last_unstale":"2024-09-11T22:19:55.502094+0000","last_undegraded":"2024-09-11T22:19:55.502094+0000","last_fullsized":"2024-09-11T22:19:55.502094+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:05.560482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141421+0000","last_change":"2024-09-11T22:19:54.480708+0000","last_active":"2024-09-11T22:19:58.141421+0000","last_peered":"2024-09-11T22:19:58.141421+0000","last_clean":"2024-09-11T22:19:58.141421+0000","last_became_active":"2024-09-11T22:19:54.480362+0000","last_became_peered":"2024-09-11T22:19:54.480362+0000","last_unstale":"2024-09-11T22:19:58.141421+0000","last_undegraded":"2024-09-11T22:19:58.141421+0000","last_fullsized":"2024-09-11T22:19:58.141421+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:39.296943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.289001+0000","last_change":"2024-09-11T22:19:55.493922+0000","last_active":"2024-09-11T22:19:57.289001+0000","last_peered":"2024-09-11T22:19:57.289001+0000","last_clean":"2024-09-11T22:19:57.289001+0000","last_became_active":"2024-09-11T22:19:55.493643+0000","last_became_peered":"2024-09-11T22:19:55.493643+0000","last_unstale":"2024-09-11T22:19:57.289001+0000","last_undegraded":"2024-09-11T22:19:57.289001+0000","last_fullsized":"2024-09-11T22:19:57.289001+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.589766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"143'1","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.508738+0000","last_change":"2024-09-11T22:19:54.484652+0000","last_active":"2024-09-11T22:19:55.508738+0000","last_peered":"2024-09-11T22:19:55.508738+0000","last_clean":"2024-09-11T22:19:55.508738+0000","last_became_active":"2024-09-11T22:19:54.484339+0000","last_became_peered":"2024-09-11T22:19:54.484339+0000","last_unstale":"2024-09-11T22:19:55.508738+0000","last_undegraded":"2024-09-11T22:19:55.508738+0000","last_fullsized":"2024-09-11T22:19:55.508738+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:26.988816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488205+0000","last_change":"2024-09-11T22:19:55.501848+0000","last_active":"2024-09-11T22:19:56.488205+0000","last_peered":"2024-09-11T22:19:56.488205+0000","last_clean":"2024-09-11T22:19:56.488205+0000","last_became_active":"2024-09-11T22:19:55.501221+0000","last_became_peered":"2024-09-11T22:19:55.501221+0000","last_unstale":"2024-09-11T22:19:56.488205+0000","last_undegraded":"2024-09-11T22:19:56.488205+0000","last_fullsized":"2024-09-11T22:19:56.488205+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:23.106236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141343+0000","last_change":"2024-09-11T22:19:54.484664+0000","last_active":"2024-09-11T22:19:58.141343+0000","last_peered":"2024-09-11T22:19:58.141343+0000","last_clean":"2024-09-11T22:19:58.141343+0000","last_became_active":"2024-09-11T22:19:54.484352+0000","last_became_peered":"2024-09-11T22:19:54.484352+0000","last_unstale":"2024-09-11T22:19:58.141343+0000","last_undegraded":"2024-09-11T22:19:58.141343+0000","last_fullsized":"2024-09-11T22:19:58.141343+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:23.346017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491534+0000","last_change":"2024-09-11T22:19:55.496737+0000","last_active":"2024-09-11T22:19:56.491534+0000","last_peered":"2024-09-11T22:19:56.491534+0000","last_clean":"2024-09-11T22:19:56.491534+0000","last_became_active":"2024-09-11T22:19:55.496089+0000","last_became_peered":"2024-09-11T22:19:55.496089+0000","last_unstale":"2024-09-11T22:19:56.491534+0000","last_undegraded":"2024-09-11T22:19:56.491534+0000","last_fullsized":"2024-09-11T22:19:56.491534+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:37.230107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140832+0000","last_change":"2024-09-11T22:19:54.479734+0000","last_active":"2024-09-11T22:19:58.140832+0000","last_peered":"2024-09-11T22:19:58.140832+0000","last_clean":"2024-09-11T22:19:58.140832+0000","last_became_active":"2024-09-11T22:19:54.479446+0000","last_became_peered":"2024-09-11T22:19:54.479446+0000","last_unstale":"2024-09-11T22:19:58.140832+0000","last_undegraded":"2024-09-11T22:19:58.140832+0000","last_fullsized":"2024-09-11T22:19:58.140832+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:32.769254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140769+0000","last_change":"2024-09-11T22:19:55.491954+0000","last_active":"2024-09-11T22:19:58.140769+0000","last_peered":"2024-09-11T22:19:58.140769+0000","last_clean":"2024-09-11T22:19:58.140769+0000","last_became_active":"2024-09-11T22:19:55.491624+0000","last_became_peered":"2024-09-11T22:19:55.491624+0000","last_unstale":"2024-09-11T22:19:58.140769+0000","last_undegraded":"2024-09-11T22:19:58.140769+0000","last_fullsized":"2024-09-11T22:19:58.140769+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:45.119040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383886+0000","last_change":"2024-09-11T22:19:54.474277+0000","last_active":"2024-09-11T22:19:57.383886+0000","last_peered":"2024-09-11T22:19:57.383886+0000","last_clean":"2024-09-11T22:19:57.383886+0000","last_became_active":"2024-09-11T22:19:54.473990+0000","last_became_peered":"2024-09-11T22:19:54.473990+0000","last_unstale":"2024-09-11T22:19:57.383886+0000","last_undegraded":"2024-09-11T22:19:57.383886+0000","last_fullsized":"2024-09-11T22:19:57.383886+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:33.263881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490394+0000","last_change":"2024-09-11T22:19:55.484311+0000","last_active":"2024-09-11T22:19:56.490394+0000","last_peered":"2024-09-11T22:19:56.490394+0000","last_clean":"2024-09-11T22:19:56.490394+0000","last_became_active":"2024-09-11T22:19:55.484011+0000","last_became_peered":"2024-09-11T22:19:55.484011+0000","last_unstale":"2024-09-11T22:19:56.490394+0000","last_undegraded":"2024-09-11T22:19:56.490394+0000","last_fullsized":"2024-09-11T22:19:56.490394+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:26.649106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383580+0000","last_change":"2024-09-11T22:19:54.475515+0000","last_active":"2024-09-11T22:19:57.383580+0000","last_peered":"2024-09-11T22:19:57.383580+0000","last_clean":"2024-09-11T22:19:57.383580+0000","last_became_active":"2024-09-11T22:19:54.475217+0000","last_became_peered":"2024-09-11T22:19:54.475217+0000","last_unstale":"2024-09-11T22:19:57.383580+0000","last_undegraded":"2024-09-11T22:19:57.383580+0000","last_fullsized":"2024-09-11T22:19:57.383580+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:57.756890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140845+0000","last_change":"2024-09-11T22:19:55.492392+0000","last_active":"2024-09-11T22:19:58.140845+0000","last_peered":"2024-09-11T22:19:58.140845+0000","last_clean":"2024-09-11T22:19:58.140845+0000","last_became_active":"2024-09-11T22:19:55.491512+0000","last_became_peered":"2024-09-11T22:19:55.491512+0000","last_unstale":"2024-09-11T22:19:58.140845+0000","last_undegraded":"2024-09-11T22:19:58.140845+0000","last_fullsized":"2024-09-11T22:19:58.140845+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:43.655472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288392+0000","last_change":"2024-09-11T22:19:54.482424+0000","last_active":"2024-09-11T22:19:57.288392+0000","last_peered":"2024-09-11T22:19:57.288392+0000","last_clean":"2024-09-11T22:19:57.288392+0000","last_became_active":"2024-09-11T22:19:54.482063+0000","last_became_peered":"2024-09-11T22:19:54.482063+0000","last_unstale":"2024-09-11T22:19:57.288392+0000","last_undegraded":"2024-09-11T22:19:57.288392+0000","last_fullsized":"2024-09-11T22:19:57.288392+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:16.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490944+0000","last_change":"2024-09-11T22:19:55.496545+0000","last_active":"2024-09-11T22:19:56.490944+0000","last_peered":"2024-09-11T22:19:56.490944+0000","last_clean":"2024-09-11T22:19:56.490944+0000","last_became_active":"2024-09-11T22:19:55.496051+0000","last_became_peered":"2024-09-11T22:19:55.496051+0000","last_unstale":"2024-09-11T22:19:56.490944+0000","last_undegraded":"2024-09-11T22:19:56.490944+0000","last_fullsized":"2024-09-11T22:19:56.490944+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:35.195952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384243+0000","last_change":"2024-09-11T22:19:54.480155+0000","last_active":"2024-09-11T22:19:57.384243+0000","last_peered":"2024-09-11T22:19:57.384243+0000","last_clean":"2024-09-11T22:19:57.384243+0000","last_became_active":"2024-09-11T22:19:54.479875+0000","last_became_peered":"2024-09-11T22:19:54.479875+0000","last_unstale":"2024-09-11T22:19:57.384243+0000","last_undegraded":"2024-09-11T22:19:57.384243+0000","last_fullsized":"2024-09-11T22:19:57.384243+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:39:16.361022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288906+0000","last_change":"2024-09-11T22:19:55.501115+0000","last_active":"2024-09-11T22:19:57.288906+0000","last_peered":"2024-09-11T22:19:57.288906+0000","last_clean":"2024-09-11T22:19:57.288906+0000","last_became_active":"2024-09-11T22:19:55.500505+0000","last_became_peered":"2024-09-11T22:19:55.500505+0000","last_unstale":"2024-09-11T22:19:57.288906+0000","last_undegraded":"2024-09-11T22:19:57.288906+0000","last_fullsized":"2024-09-11T22:19:57.288906+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:26.649106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487997+0000","last_change":"2024-09-11T22:19:54.483996+0000","last_active":"2024-09-11T22:19:56.487997+0000","last_peered":"2024-09-11T22:19:56.487997+0000","last_clean":"2024-09-11T22:19:56.487997+0000","last_became_active":"2024-09-11T22:19:54.483682+0000","last_became_peered":"2024-09-11T22:19:54.483682+0000","last_unstale":"2024-09-11T22:19:56.487997+0000","last_undegraded":"2024-09-11T22:19:56.487997+0000","last_fullsized":"2024-09-11T22:19:56.487997+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:22.920609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141389+0000","last_change":"2024-09-11T22:19:55.493907+0000","last_active":"2024-09-11T22:19:58.141389+0000","last_peered":"2024-09-11T22:19:58.141389+0000","last_clean":"2024-09-11T22:19:58.141389+0000","last_became_active":"2024-09-11T22:19:55.493552+0000","last_became_peered":"2024-09-11T22:19:55.493552+0000","last_unstale":"2024-09-11T22:19:58.141389+0000","last_undegraded":"2024-09-11T22:19:58.141389+0000","last_fullsized":"2024-09-11T22:19:58.141389+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:48.038083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488308+0000","last_change":"2024-09-11T22:19:54.486850+0000","last_active":"2024-09-11T22:19:56.488308+0000","last_peered":"2024-09-11T22:19:56.488308+0000","last_clean":"2024-09-11T22:19:56.488308+0000","last_became_active":"2024-09-11T22:19:54.486160+0000","last_became_peered":"2024-09-11T22:19:54.486160+0000","last_unstale":"2024-09-11T22:19:56.488308+0000","last_undegraded":"2024-09-11T22:19:56.488308+0000","last_fullsized":"2024-09-11T22:19:56.488308+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:08.105367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488249+0000","last_change":"2024-09-11T22:19:55.496132+0000","last_active":"2024-09-11T22:19:56.488249+0000","last_peered":"2024-09-11T22:19:56.488249+0000","last_clean":"2024-09-11T22:19:56.488249+0000","last_became_active":"2024-09-11T22:19:55.495766+0000","last_became_peered":"2024-09-11T22:19:55.495766+0000","last_unstale":"2024-09-11T22:19:56.488249+0000","last_undegraded":"2024-09-11T22:19:56.488249+0000","last_fullsized":"2024-09-11T22:19:56.488249+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.589766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487870+0000","last_change":"2024-09-11T22:19:54.486505+0000","last_active":"2024-09-11T22:19:56.487870+0000","last_peered":"2024-09-11T22:19:56.487870+0000","last_clean":"2024-09-11T22:19:56.487870+0000","last_became_active":"2024-09-11T22:19:54.486071+0000","last_became_peered":"2024-09-11T22:19:54.486071+0000","last_unstale":"2024-09-11T22:19:56.487870+0000","last_undegraded":"2024-09-11T22:19:56.487870+0000","last_fullsized":"2024-09-11T22:19:56.487870+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:50.039730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-11T22:19:55.503074+0000","last_change":"2024-09-11T22:19:55.500191+0000","last_active":"2024-09-11T22:19:55.503074+0000","last_peered":"2024-09-11T22:19:55.503074+0000","last_clean":"2024-09-11T22:19:55.503074+0000","last_became_active":"2024-09-11T22:19:55.499703+0000","last_became_peered":"2024-09-11T22:19:55.499703+0000","last_unstale":"2024-09-11T22:19:55.503074+0000","last_undegraded":"2024-09-11T22:19:55.503074+0000","last_fullsized":"2024-09-11T22:19:55.503074+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:06.196494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140919+0000","last_change":"2024-09-11T22:19:54.478322+0000","last_active":"2024-09-11T22:19:58.140919+0000","last_peered":"2024-09-11T22:19:58.140919+0000","last_clean":"2024-09-11T22:19:58.140919+0000","last_became_active":"2024-09-11T22:19:54.478056+0000","last_became_peered":"2024-09-11T22:19:54.478056+0000","last_unstale":"2024-09-11T22:19:58.140919+0000","last_undegraded":"2024-09-11T22:19:58.140919+0000","last_fullsized":"2024-09-11T22:19:58.140919+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:22.872508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491352+0000","last_change":"2024-09-11T22:19:55.500816+0000","last_active":"2024-09-11T22:19:56.491352+0000","last_peered":"2024-09-11T22:19:56.491352+0000","last_clean":"2024-09-11T22:19:56.491352+0000","last_became_active":"2024-09-11T22:19:55.500559+0000","last_became_peered":"2024-09-11T22:19:55.500559+0000","last_unstale":"2024-09-11T22:19:56.491352+0000","last_undegraded":"2024-09-11T22:19:56.491352+0000","last_fullsized":"2024-09-11T22:19:56.491352+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:51.041508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383723+0000","last_change":"2024-09-11T22:19:54.482877+0000","last_active":"2024-09-11T22:19:57.383723+0000","last_peered":"2024-09-11T22:19:57.383723+0000","last_clean":"2024-09-11T22:19:57.383723+0000","last_became_active":"2024-09-11T22:19:54.482462+0000","last_became_peered":"2024-09-11T22:19:54.482462+0000","last_unstale":"2024-09-11T22:19:57.383723+0000","last_undegraded":"2024-09-11T22:19:57.383723+0000","last_fullsized":"2024-09-11T22:19:57.383723+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:50.629566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383704+0000","last_change":"2024-09-11T22:19:55.503903+0000","last_active":"2024-09-11T22:19:57.383704+0000","last_peered":"2024-09-11T22:19:57.383704+0000","last_clean":"2024-09-11T22:19:57.383704+0000","last_became_active":"2024-09-11T22:19:55.503606+0000","last_became_peered":"2024-09-11T22:19:55.503606+0000","last_unstale":"2024-09-11T22:19:57.383704+0000","last_undegraded":"2024-09-11T22:19:57.383704+0000","last_fullsized":"2024-09-11T22:19:57.383704+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:41.678234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288530+0000","last_change":"2024-09-11T22:19:54.480651+0000","last_active":"2024-09-11T22:19:57.288530+0000","last_peered":"2024-09-11T22:19:57.288530+0000","last_clean":"2024-09-11T22:19:57.288530+0000","last_became_active":"2024-09-11T22:19:54.480268+0000","last_became_peered":"2024-09-11T22:19:54.480268+0000","last_unstale":"2024-09-11T22:19:57.288530+0000","last_undegraded":"2024-09-11T22:19:57.288530+0000","last_fullsized":"2024-09-11T22:19:57.288530+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:28.593199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490440+0000","last_change":"2024-09-11T22:19:55.499655+0000","last_active":"2024-09-11T22:19:56.490440+0000","last_peered":"2024-09-11T22:19:56.490440+0000","last_clean":"2024-09-11T22:19:56.490440+0000","last_became_active":"2024-09-11T22:19:55.498978+0000","last_became_peered":"2024-09-11T22:19:55.498978+0000","last_unstale":"2024-09-11T22:19:56.490440+0000","last_undegraded":"2024-09-11T22:19:56.490440+0000","last_fullsized":"2024-09-11T22:19:56.490440+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.895923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141006+0000","last_change":"2024-09-11T22:19:54.472846+0000","last_active":"2024-09-11T22:19:58.141006+0000","last_peered":"2024-09-11T22:19:58.141006+0000","last_clean":"2024-09-11T22:19:58.141006+0000","last_became_active":"2024-09-11T22:19:54.472482+0000","last_became_peered":"2024-09-11T22:19:54.472482+0000","last_unstale":"2024-09-11T22:19:58.141006+0000","last_undegraded":"2024-09-11T22:19:58.141006+0000","last_fullsized":"2024-09-11T22:19:58.141006+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:10.691015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141057+0000","last_change":"2024-09-11T22:19:55.493295+0000","last_active":"2024-09-11T22:19:58.141057+0000","last_peered":"2024-09-11T22:19:58.141057+0000","last_clean":"2024-09-11T22:19:58.141057+0000","last_became_active":"2024-09-11T22:19:55.492963+0000","last_became_peered":"2024-09-11T22:19:55.492963+0000","last_unstale":"2024-09-11T22:19:58.141057+0000","last_undegraded":"2024-09-11T22:19:58.141057+0000","last_fullsized":"2024-09-11T22:19:58.141057+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:30.847050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"143'3","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288876+0000","last_change":"2024-09-11T22:19:54.480949+0000","last_active":"2024-09-11T22:19:57.288876+0000","last_peered":"2024-09-11T22:19:57.288876+0000","last_clean":"2024-09-11T22:19:57.288876+0000","last_became_active":"2024-09-11T22:19:54.480650+0000","last_became_peered":"2024-09-11T22:19:54.480650+0000","last_unstale":"2024-09-11T22:19:57.288876+0000","last_undegraded":"2024-09-11T22:19:57.288876+0000","last_fullsized":"2024-09-11T22:19:57.288876+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:40.197692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":393,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383815+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:19:57.383815+0000","last_peered":"2024-09-11T22:19:57.383815+0000","last_clean":"2024-09-11T22:19:57.383815+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:19:57.383815+0000","last_undegraded":"2024-09-11T22:19:57.383815+0000","last_fullsized":"2024-09-11T22:19:57.383815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509552,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51000,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320840,"statfs":{"total":96636764160,"available":96584540160,"internally_reserved":0,"allocated":1806336,"data_stored":787079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509549,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46840,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325000,"statfs":{"total":96636764160,"available":96588800000,"internally_reserved":0,"allocated":1798144,"data_stored":786955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50992,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1794048,"data_stored":786933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509551,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59312,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312528,"statfs":{"total":96636764160,"available":96576028672,"internally_reserved":0,"allocated":1798144,"data_stored":787023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509551,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59320,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312520,"statfs":{"total":96636764160,"available":96576020480,"internally_reserved":0,"allocated":1798144,"data_stored":787515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509550,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55744,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316096,"statfs":{"total":96636764160,"available":96579682304,"internally_reserved":0,"allocated":2404352,"data_stored":1378947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51564,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320276,"statfs":{"total":96636764160,"available":96583962624,"internally_reserved":0,"allocated":2383872,"data_stored":1371653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59320,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312520,"statfs":{"total":96636764160,"available":96576020480,"internally_reserved":0,"allocated":1798144,"data_stored":782315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:20:03.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:20:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.568+0000 7f96ba86e640 1 Processor -- start 2024-09-11T22:20:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.568+0000 7f96ba86e640 1 -- start start 2024-09-11T22:20:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.569+0000 7f96ba86e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f96b415e870 0x7f96b40d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.569+0000 7f96ba86e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96b40d3c00 0x7f96b40b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.569+0000 7f96ba86e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b40cfa80 con 0x7f96b40d16d0 2024-09-11T22:20:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.569+0000 7f96ba86e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f96b40d1b40 con 0x7f96b40d3c00 2024-09-11T22:20:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.569+0000 7f96ba86e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f96b40d40d0 con 0x7f96b415e870 2024-09-11T22:20:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.569+0000 7f96b8e0b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96b40d3c00 0x7f96b40b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.569+0000 7f96b8e0b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96b40d3c00 0x7f96b40b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45322/0 (socket says 172.21.15.50:45322) 2024-09-11T22:20:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.569+0000 7f96b8e0b640 1 -- 172.21.15.50:0/2187604624 learned_addr learned my addr 172.21.15.50:0/2187604624 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.569+0000 7f96b3fff640 1 --2- 172.21.15.50:0/2187604624 >> v2:172.21.15.77:3300/0 conn(0x7f96b415e870 0x7f96b40d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:03.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.569+0000 7f96b8e0b640 1 -- 172.21.15.50:0/2187604624 >> v2:172.21.15.77:3300/0 conn(0x7f96b415e870 msgr2=0x7f96b40d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:03.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.569+0000 7f96b8e0b640 1 --2- 172.21.15.50:0/2187604624 >> v2:172.21.15.77:3300/0 conn(0x7f96b415e870 0x7f96b40d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.569+0000 7f96b8e0b640 1 -- 172.21.15.50:0/2187604624 >> v1:172.21.15.77:6789/0 conn(0x7f96b40d16d0 legacy=0x7f96b40d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:03.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.569+0000 7f96b8e0b640 1 -- 172.21.15.50:0/2187604624 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b40d43b0 con 0x7f96b40d3c00 2024-09-11T22:20:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.570+0000 7f96b8e0b640 1 --2- 172.21.15.50:0/2187604624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96b40d3c00 0x7f96b40b8400 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f96b40d57c0 tx=0x7f96ac02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b411a47f14494f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.570+0000 7f96b2ffd640 1 -- 172.21.15.50:0/2187604624 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac036070 con 0x7f96b40d3c00 2024-09-11T22:20:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.570+0000 7f96b2ffd640 1 -- 172.21.15.50:0/2187604624 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ac031600 con 0x7f96b40d3c00 2024-09-11T22:20:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.570+0000 7f96b2ffd640 1 -- 172.21.15.50:0/2187604624 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac0319d0 con 0x7f96b40d3c00 2024-09-11T22:20:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.571+0000 7f96ba86e640 1 -- 172.21.15.50:0/2187604624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96b40d3c00 msgr2=0x7f96b40b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.571+0000 7f96ba86e640 1 --2- 172.21.15.50:0/2187604624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96b40d3c00 0x7f96b40b8400 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f96b40d57c0 tx=0x7f96ac02a6f0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.571+0000 7f96ba86e640 1 -- 172.21.15.50:0/2187604624 shutdown_connections 2024-09-11T22:20:03.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.571+0000 7f96ba86e640 1 --2- 172.21.15.50:0/2187604624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96b40d3c00 0x7f96b40b8400 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.571+0000 7f96ba86e640 1 --2- 172.21.15.50:0/2187604624 >> v2:172.21.15.77:3300/0 conn(0x7f96b415e870 0x7f96b40d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.571+0000 7f96ba86e640 1 -- 172.21.15.50:0/2187604624 >> 172.21.15.50:0/2187604624 conn(0x7f96b40727a0 msgr2=0x7f96b40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:03.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.571+0000 7f96ba86e640 1 -- 172.21.15.50:0/2187604624 shutdown_connections 2024-09-11T22:20:03.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.571+0000 7f96ba86e640 1 -- 172.21.15.50:0/2187604624 wait complete. 2024-09-11T22:20:03.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.572+0000 7f96ba86e640 1 Processor -- start 2024-09-11T22:20:03.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.572+0000 7f96ba86e640 1 -- start start 2024-09-11T22:20:03.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96ba86e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96b40d16d0 0x7f96b415bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:03.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96ba86e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96b40d3c00 0x7f96b41e96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:03.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96ba86e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96b415e870 0x7f96b40ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:03.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96ba86e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96b415ec50 con 0x7f96b40d16d0 2024-09-11T22:20:03.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96ba86e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f96b40b7ee0 con 0x7f96b40d3c00 2024-09-11T22:20:03.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96ba86e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f96b40b78b0 con 0x7f96b415e870 2024-09-11T22:20:03.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96b3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96b40d16d0 0x7f96b415bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:03.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96b3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96b40d16d0 0x7f96b415bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45324/0 (socket says 172.21.15.50:45324) 2024-09-11T22:20:03.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96b3fff640 1 -- 172.21.15.50:0/995631967 learned_addr learned my addr 172.21.15.50:0/995631967 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:03.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96b37fe640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96b40d3c00 0x7f96b41e96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:03.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96b8e0b640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96b415e870 0x7f96b40ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:03.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96b3fff640 1 -- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96b415e870 msgr2=0x7f96b40ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:03.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96b3fff640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96b415e870 0x7f96b40ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96b3fff640 1 -- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96b40d3c00 msgr2=0x7f96b41e96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:03.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96b3fff640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96b40d3c00 0x7f96b41e96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.573+0000 7f96b3fff640 1 -- 172.21.15.50:0/995631967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b41e7d90 con 0x7f96b40d16d0 2024-09-11T22:20:03.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.574+0000 7f96b3fff640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96b40d16d0 0x7f96b415bad0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f96a400d800 tx=0x7f96a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:03.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.574+0000 7f96b0ff9640 1 -- 172.21.15.50:0/995631967 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a400b660 con 0x7f96b40d16d0 2024-09-11T22:20:03.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.574+0000 7f96b0ff9640 1 -- 172.21.15.50:0/995631967 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a4019070 con 0x7f96b40d16d0 2024-09-11T22:20:03.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.574+0000 7f96ba86e640 1 -- 172.21.15.50:0/995631967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b41e8070 con 0x7f96b40d16d0 2024-09-11T22:20:03.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.574+0000 7f96b0ff9640 1 -- 172.21.15.50:0/995631967 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a400ba20 con 0x7f96b40d16d0 2024-09-11T22:20:03.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.574+0000 7f96ba86e640 1 -- 172.21.15.50:0/995631967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b41e8630 con 0x7f96b40d16d0 2024-09-11T22:20:03.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.575+0000 7f96ba86e640 1 -- 172.21.15.50:0/995631967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b40d1190 con 0x7f96b40d16d0 2024-09-11T22:20:03.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.575+0000 7f96b0ff9640 1 -- 172.21.15.50:0/995631967 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96a400bbc0 con 0x7f96b40d16d0 2024-09-11T22:20:03.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.576+0000 7f96b0ff9640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96a006be30 0x7f96a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:03.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.576+0000 7f96b0ff9640 1 -- 172.21.15.50:0/995631967 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f96a408b180 con 0x7f96b40d16d0 2024-09-11T22:20:03.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.576+0000 7f96b37fe640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96a006be30 0x7f96a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:03.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.577+0000 7f96b37fe640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96a006be30 0x7f96a006e2f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f96b40b34a0 tx=0x7f96a8009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:03.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.581+0000 7f96b0ff9640 1 -- 172.21.15.50:0/995631967 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96a40594e0 con 0x7f96b40d16d0 2024-09-11T22:20:03.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.754+0000 7f96ba86e640 1 -- 172.21.15.50:0/995631967 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f96b40cc570 con 0x7f96a006be30 2024-09-11T22:20:03.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.760+0000 7f96b0ff9640 1 -- 172.21.15.50:0/995631967 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252464 (secure 0 0 0) 0x7f96b40cc570 con 0x7f96a006be30 2024-09-11T22:20:03.763 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:20:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.763+0000 7f96ba86e640 1 -- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96a006be30 msgr2=0x7f96a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.763+0000 7f96ba86e640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96a006be30 0x7f96a006e2f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f96b40b34a0 tx=0x7f96a8009060 comp rx=0 tx=0).stop 2024-09-11T22:20:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.763+0000 7f96ba86e640 1 -- 172.21.15.50:0/995631967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96b40d16d0 msgr2=0x7f96b415bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.763+0000 7f96ba86e640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96b40d16d0 0x7f96b415bad0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f96a400d800 tx=0x7f96a400dcc0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.764+0000 7f96ba86e640 1 -- 172.21.15.50:0/995631967 shutdown_connections 2024-09-11T22:20:03.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.764+0000 7f96ba86e640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96a006be30 0x7f96a006e2f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.764+0000 7f96ba86e640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96b415e870 0x7f96b40ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.764+0000 7f96ba86e640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96b40d3c00 0x7f96b41e96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.764+0000 7f96ba86e640 1 --2- 172.21.15.50:0/995631967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96b40d16d0 0x7f96b415bad0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.764+0000 7f96ba86e640 1 -- 172.21.15.50:0/995631967 >> 172.21.15.50:0/995631967 conn(0x7f96b40727a0 msgr2=0x7f96b40b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:03.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.764+0000 7f96ba86e640 1 -- 172.21.15.50:0/995631967 shutdown_connections 2024-09-11T22:20:03.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.764+0000 7f96ba86e640 1 -- 172.21.15.50:0/995631967 wait complete. 2024-09-11T22:20:03.776 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2024-09-11T22:20:03.492969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":434112,"kb_used_data":15240,"kb_used_omap":12,"kb_used_meta":418675,"kb_avail":754540608,"statfs":{"total":773094113280,"available":772649582592,"internally_reserved":0,"allocated":15605760,"data_stored":7481020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":428723761},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.015330"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488278+0000","last_change":"2024-09-11T22:19:55.497801+0000","last_active":"2024-09-11T22:19:56.488278+0000","last_peered":"2024-09-11T22:19:56.488278+0000","last_clean":"2024-09-11T22:19:56.488278+0000","last_became_active":"2024-09-11T22:19:55.495941+0000","last_became_peered":"2024-09-11T22:19:55.495941+0000","last_unstale":"2024-09-11T22:19:56.488278+0000","last_undegraded":"2024-09-11T22:19:56.488278+0000","last_fullsized":"2024-09-11T22:19:56.488278+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.189171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141363+0000","last_change":"2024-09-11T22:19:55.488456+0000","last_active":"2024-09-11T22:19:58.141363+0000","last_peered":"2024-09-11T22:19:58.141363+0000","last_clean":"2024-09-11T22:19:58.141363+0000","last_became_active":"2024-09-11T22:19:55.487771+0000","last_became_peered":"2024-09-11T22:19:55.487771+0000","last_unstale":"2024-09-11T22:19:58.141363+0000","last_undegraded":"2024-09-11T22:19:58.141363+0000","last_fullsized":"2024-09-11T22:19:58.141363+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:27.523574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.289017+0000","last_change":"2024-09-11T22:19:55.500016+0000","last_active":"2024-09-11T22:19:57.289017+0000","last_peered":"2024-09-11T22:19:57.289017+0000","last_clean":"2024-09-11T22:19:57.289017+0000","last_became_active":"2024-09-11T22:19:55.499052+0000","last_became_peered":"2024-09-11T22:19:55.499052+0000","last_unstale":"2024-09-11T22:19:57.289017+0000","last_undegraded":"2024-09-11T22:19:57.289017+0000","last_fullsized":"2024-09-11T22:19:57.289017+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.189171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491124+0000","last_change":"2024-09-11T22:19:55.497597+0000","last_active":"2024-09-11T22:19:56.491124+0000","last_peered":"2024-09-11T22:19:56.491124+0000","last_clean":"2024-09-11T22:19:56.491124+0000","last_became_active":"2024-09-11T22:19:55.497250+0000","last_became_peered":"2024-09-11T22:19:55.497250+0000","last_unstale":"2024-09-11T22:19:56.491124+0000","last_undegraded":"2024-09-11T22:19:56.491124+0000","last_fullsized":"2024-09-11T22:19:56.491124+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:01.548622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491118+0000","last_change":"2024-09-11T22:19:55.498292+0000","last_active":"2024-09-11T22:19:56.491118+0000","last_peered":"2024-09-11T22:19:56.491118+0000","last_clean":"2024-09-11T22:19:56.491118+0000","last_became_active":"2024-09-11T22:19:55.497218+0000","last_became_peered":"2024-09-11T22:19:55.497218+0000","last_unstale":"2024-09-11T22:19:56.491118+0000","last_undegraded":"2024-09-11T22:19:56.491118+0000","last_fullsized":"2024-09-11T22:19:56.491118+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:23.922387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487971+0000","last_change":"2024-09-11T22:19:55.496613+0000","last_active":"2024-09-11T22:19:56.487971+0000","last_peered":"2024-09-11T22:19:56.487971+0000","last_clean":"2024-09-11T22:19:56.487971+0000","last_became_active":"2024-09-11T22:19:55.496353+0000","last_became_peered":"2024-09-11T22:19:55.496353+0000","last_unstale":"2024-09-11T22:19:56.487971+0000","last_undegraded":"2024-09-11T22:19:56.487971+0000","last_fullsized":"2024-09-11T22:19:56.487971+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:08.530682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140645+0000","last_change":"2024-09-11T22:19:55.492627+0000","last_active":"2024-09-11T22:19:58.140645+0000","last_peered":"2024-09-11T22:19:58.140645+0000","last_clean":"2024-09-11T22:19:58.140645+0000","last_became_active":"2024-09-11T22:19:55.491897+0000","last_became_peered":"2024-09-11T22:19:55.491897+0000","last_unstale":"2024-09-11T22:19:58.140645+0000","last_undegraded":"2024-09-11T22:19:58.140645+0000","last_fullsized":"2024-09-11T22:19:58.140645+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:26.538537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487774+0000","last_change":"2024-09-11T22:19:55.492362+0000","last_active":"2024-09-11T22:19:56.487774+0000","last_peered":"2024-09-11T22:19:56.487774+0000","last_clean":"2024-09-11T22:19:56.487774+0000","last_became_active":"2024-09-11T22:19:55.491940+0000","last_became_peered":"2024-09-11T22:19:55.491940+0000","last_unstale":"2024-09-11T22:19:56.487774+0000","last_undegraded":"2024-09-11T22:19:56.487774+0000","last_fullsized":"2024-09-11T22:19:56.487774+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:41.636678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141189+0000","last_change":"2024-09-11T22:19:55.492631+0000","last_active":"2024-09-11T22:19:58.141189+0000","last_peered":"2024-09-11T22:19:58.141189+0000","last_clean":"2024-09-11T22:19:58.141189+0000","last_became_active":"2024-09-11T22:19:55.492345+0000","last_became_peered":"2024-09-11T22:19:55.492345+0000","last_unstale":"2024-09-11T22:19:58.141189+0000","last_undegraded":"2024-09-11T22:19:58.141189+0000","last_fullsized":"2024-09-11T22:19:58.141189+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:37.934511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384059+0000","last_change":"2024-09-11T22:19:55.498360+0000","last_active":"2024-09-11T22:19:57.384059+0000","last_peered":"2024-09-11T22:19:57.384059+0000","last_clean":"2024-09-11T22:19:57.384059+0000","last_became_active":"2024-09-11T22:19:55.498102+0000","last_became_peered":"2024-09-11T22:19:55.498102+0000","last_unstale":"2024-09-11T22:19:57.384059+0000","last_undegraded":"2024-09-11T22:19:57.384059+0000","last_fullsized":"2024-09-11T22:19:57.384059+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:21.245925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488107+0000","last_change":"2024-09-11T22:19:55.502131+0000","last_active":"2024-09-11T22:19:56.488107+0000","last_peered":"2024-09-11T22:19:56.488107+0000","last_clean":"2024-09-11T22:19:56.488107+0000","last_became_active":"2024-09-11T22:19:55.501541+0000","last_became_peered":"2024-09-11T22:19:55.501541+0000","last_unstale":"2024-09-11T22:19:56.488107+0000","last_undegraded":"2024-09-11T22:19:56.488107+0000","last_fullsized":"2024-09-11T22:19:56.488107+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:48.541584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383767+0000","last_change":"2024-09-11T22:19:55.505563+0000","last_active":"2024-09-11T22:19:57.383767+0000","last_peered":"2024-09-11T22:19:57.383767+0000","last_clean":"2024-09-11T22:19:57.383767+0000","last_became_active":"2024-09-11T22:19:55.504577+0000","last_became_peered":"2024-09-11T22:19:55.504577+0000","last_unstale":"2024-09-11T22:19:57.383767+0000","last_undegraded":"2024-09-11T22:19:57.383767+0000","last_fullsized":"2024-09-11T22:19:57.383767+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:01.707109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491282+0000","last_change":"2024-09-11T22:19:55.497465+0000","last_active":"2024-09-11T22:19:56.491282+0000","last_peered":"2024-09-11T22:19:56.491282+0000","last_clean":"2024-09-11T22:19:56.491282+0000","last_became_active":"2024-09-11T22:19:55.496884+0000","last_became_peered":"2024-09-11T22:19:55.496884+0000","last_unstale":"2024-09-11T22:19:56.491282+0000","last_undegraded":"2024-09-11T22:19:56.491282+0000","last_fullsized":"2024-09-11T22:19:56.491282+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:07.952832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490641+0000","last_change":"2024-09-11T22:19:55.493735+0000","last_active":"2024-09-11T22:19:56.490641+0000","last_peered":"2024-09-11T22:19:56.490641+0000","last_clean":"2024-09-11T22:19:56.490641+0000","last_became_active":"2024-09-11T22:19:55.493287+0000","last_became_peered":"2024-09-11T22:19:55.493287+0000","last_unstale":"2024-09-11T22:19:56.490641+0000","last_undegraded":"2024-09-11T22:19:56.490641+0000","last_fullsized":"2024-09-11T22:19:56.490641+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:23.106236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383643+0000","last_change":"2024-09-11T22:19:55.502428+0000","last_active":"2024-09-11T22:19:57.383643+0000","last_peered":"2024-09-11T22:19:57.383643+0000","last_clean":"2024-09-11T22:19:57.383643+0000","last_became_active":"2024-09-11T22:19:55.502180+0000","last_became_peered":"2024-09-11T22:19:55.502180+0000","last_unstale":"2024-09-11T22:19:57.383643+0000","last_undegraded":"2024-09-11T22:19:57.383643+0000","last_fullsized":"2024-09-11T22:19:57.383643+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:11.355696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.825657+0000","last_change":"2024-09-11T22:19:55.496357+0000","last_active":"2024-09-11T22:19:57.825657+0000","last_peered":"2024-09-11T22:19:57.825657+0000","last_clean":"2024-09-11T22:19:57.825657+0000","last_became_active":"2024-09-11T22:19:55.496083+0000","last_became_peered":"2024-09-11T22:19:55.496083+0000","last_unstale":"2024-09-11T22:19:57.825657+0000","last_undegraded":"2024-09-11T22:19:57.825657+0000","last_fullsized":"2024-09-11T22:19:57.825657+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:13.900029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384215+0000","last_change":"2024-09-11T22:19:55.496386+0000","last_active":"2024-09-11T22:19:57.384215+0000","last_peered":"2024-09-11T22:19:57.384215+0000","last_clean":"2024-09-11T22:19:57.384215+0000","last_became_active":"2024-09-11T22:19:55.495842+0000","last_became_peered":"2024-09-11T22:19:55.495842+0000","last_unstale":"2024-09-11T22:19:57.384215+0000","last_undegraded":"2024-09-11T22:19:57.384215+0000","last_fullsized":"2024-09-11T22:19:57.384215+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:47.251855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288947+0000","last_change":"2024-09-11T22:19:55.494110+0000","last_active":"2024-09-11T22:19:57.288947+0000","last_peered":"2024-09-11T22:19:57.288947+0000","last_clean":"2024-09-11T22:19:57.288947+0000","last_became_active":"2024-09-11T22:19:55.493859+0000","last_became_peered":"2024-09-11T22:19:55.493859+0000","last_unstale":"2024-09-11T22:19:57.288947+0000","last_undegraded":"2024-09-11T22:19:57.288947+0000","last_fullsized":"2024-09-11T22:19:57.288947+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:23.106236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488351+0000","last_change":"2024-09-11T22:19:55.502886+0000","last_active":"2024-09-11T22:19:56.488351+0000","last_peered":"2024-09-11T22:19:56.488351+0000","last_clean":"2024-09-11T22:19:56.488351+0000","last_became_active":"2024-09-11T22:19:55.495715+0000","last_became_peered":"2024-09-11T22:19:55.495715+0000","last_unstale":"2024-09-11T22:19:56.488351+0000","last_undegraded":"2024-09-11T22:19:56.488351+0000","last_fullsized":"2024-09-11T22:19:56.488351+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:16.795325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.825988+0000","last_change":"2024-09-11T22:19:55.489451+0000","last_active":"2024-09-11T22:19:57.825988+0000","last_peered":"2024-09-11T22:19:57.825988+0000","last_clean":"2024-09-11T22:19:57.825988+0000","last_became_active":"2024-09-11T22:19:55.489198+0000","last_became_peered":"2024-09-11T22:19:55.489198+0000","last_unstale":"2024-09-11T22:19:57.825988+0000","last_undegraded":"2024-09-11T22:19:57.825988+0000","last_fullsized":"2024-09-11T22:19:57.825988+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:12:07.593463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384249+0000","last_change":"2024-09-11T22:19:55.499103+0000","last_active":"2024-09-11T22:19:57.384249+0000","last_peered":"2024-09-11T22:19:57.384249+0000","last_clean":"2024-09-11T22:19:57.384249+0000","last_became_active":"2024-09-11T22:19:55.498817+0000","last_became_peered":"2024-09-11T22:19:55.498817+0000","last_unstale":"2024-09-11T22:19:57.384249+0000","last_undegraded":"2024-09-11T22:19:57.384249+0000","last_fullsized":"2024-09-11T22:19:57.384249+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:45.826396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490862+0000","last_change":"2024-09-11T22:19:55.492448+0000","last_active":"2024-09-11T22:19:56.490862+0000","last_peered":"2024-09-11T22:19:56.490862+0000","last_clean":"2024-09-11T22:19:56.490862+0000","last_became_active":"2024-09-11T22:19:55.491976+0000","last_became_peered":"2024-09-11T22:19:55.491976+0000","last_unstale":"2024-09-11T22:19:56.490862+0000","last_undegraded":"2024-09-11T22:19:56.490862+0000","last_fullsized":"2024-09-11T22:19:56.490862+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:40.189171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490767+0000","last_change":"2024-09-11T22:19:55.489318+0000","last_active":"2024-09-11T22:19:56.490767+0000","last_peered":"2024-09-11T22:19:56.490767+0000","last_clean":"2024-09-11T22:19:56.490767+0000","last_became_active":"2024-09-11T22:19:55.489045+0000","last_became_peered":"2024-09-11T22:19:55.489045+0000","last_unstale":"2024-09-11T22:19:56.490767+0000","last_undegraded":"2024-09-11T22:19:56.490767+0000","last_fullsized":"2024-09-11T22:19:56.490767+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.589766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383730+0000","last_change":"2024-09-11T22:19:55.501801+0000","last_active":"2024-09-11T22:19:57.383730+0000","last_peered":"2024-09-11T22:19:57.383730+0000","last_clean":"2024-09-11T22:19:57.383730+0000","last_became_active":"2024-09-11T22:19:55.501488+0000","last_became_peered":"2024-09-11T22:19:55.501488+0000","last_unstale":"2024-09-11T22:19:57.383730+0000","last_undegraded":"2024-09-11T22:19:57.383730+0000","last_fullsized":"2024-09-11T22:19:57.383730+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:56.830151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.825987+0000","last_change":"2024-09-11T22:19:55.499959+0000","last_active":"2024-09-11T22:19:57.825987+0000","last_peered":"2024-09-11T22:19:57.825987+0000","last_clean":"2024-09-11T22:19:57.825987+0000","last_became_active":"2024-09-11T22:19:55.499649+0000","last_became_peered":"2024-09-11T22:19:55.499649+0000","last_unstale":"2024-09-11T22:19:57.825987+0000","last_undegraded":"2024-09-11T22:19:57.825987+0000","last_fullsized":"2024-09-11T22:19:57.825987+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:00.500642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488115+0000","last_change":"2024-09-11T22:19:55.492128+0000","last_active":"2024-09-11T22:19:56.488115+0000","last_peered":"2024-09-11T22:19:56.488115+0000","last_clean":"2024-09-11T22:19:56.488115+0000","last_became_active":"2024-09-11T22:19:55.491752+0000","last_became_peered":"2024-09-11T22:19:55.491752+0000","last_unstale":"2024-09-11T22:19:56.488115+0000","last_undegraded":"2024-09-11T22:19:56.488115+0000","last_fullsized":"2024-09-11T22:19:56.488115+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:26.649106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.825864+0000","last_change":"2024-09-11T22:19:55.507660+0000","last_active":"2024-09-11T22:19:57.825864+0000","last_peered":"2024-09-11T22:19:57.825864+0000","last_clean":"2024-09-11T22:19:57.825864+0000","last_became_active":"2024-09-11T22:19:55.507383+0000","last_became_peered":"2024-09-11T22:19:55.507383+0000","last_unstale":"2024-09-11T22:19:57.825864+0000","last_undegraded":"2024-09-11T22:19:57.825864+0000","last_fullsized":"2024-09-11T22:19:57.825864+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:47.941797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140930+0000","last_change":"2024-09-11T22:19:55.494927+0000","last_active":"2024-09-11T22:19:58.140930+0000","last_peered":"2024-09-11T22:19:58.140930+0000","last_clean":"2024-09-11T22:19:58.140930+0000","last_became_active":"2024-09-11T22:19:55.494588+0000","last_became_peered":"2024-09-11T22:19:55.494588+0000","last_unstale":"2024-09-11T22:19:58.140930+0000","last_undegraded":"2024-09-11T22:19:58.140930+0000","last_fullsized":"2024-09-11T22:19:58.140930+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:18.667141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487852+0000","last_change":"2024-09-11T22:19:55.496473+0000","last_active":"2024-09-11T22:19:56.487852+0000","last_peered":"2024-09-11T22:19:56.487852+0000","last_clean":"2024-09-11T22:19:56.487852+0000","last_became_active":"2024-09-11T22:19:55.495733+0000","last_became_peered":"2024-09-11T22:19:55.495733+0000","last_unstale":"2024-09-11T22:19:56.487852+0000","last_undegraded":"2024-09-11T22:19:56.487852+0000","last_fullsized":"2024-09-11T22:19:56.487852+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:26.459071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491021+0000","last_change":"2024-09-11T22:19:55.497030+0000","last_active":"2024-09-11T22:19:56.491021+0000","last_peered":"2024-09-11T22:19:56.491021+0000","last_clean":"2024-09-11T22:19:56.491021+0000","last_became_active":"2024-09-11T22:19:55.496463+0000","last_became_peered":"2024-09-11T22:19:55.496463+0000","last_unstale":"2024-09-11T22:19:56.491021+0000","last_undegraded":"2024-09-11T22:19:56.491021+0000","last_fullsized":"2024-09-11T22:19:56.491021+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:46.193176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141160+0000","last_change":"2024-09-11T22:19:55.501904+0000","last_active":"2024-09-11T22:19:58.141160+0000","last_peered":"2024-09-11T22:19:58.141160+0000","last_clean":"2024-09-11T22:19:58.141160+0000","last_became_active":"2024-09-11T22:19:55.501549+0000","last_became_peered":"2024-09-11T22:19:55.501549+0000","last_unstale":"2024-09-11T22:19:58.141160+0000","last_undegraded":"2024-09-11T22:19:58.141160+0000","last_fullsized":"2024-09-11T22:19:58.141160+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:10.399156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.825698+0000","last_change":"2024-09-11T22:19:55.494531+0000","last_active":"2024-09-11T22:19:57.825698+0000","last_peered":"2024-09-11T22:19:57.825698+0000","last_clean":"2024-09-11T22:19:57.825698+0000","last_became_active":"2024-09-11T22:19:55.491160+0000","last_became_peered":"2024-09-11T22:19:55.491160+0000","last_unstale":"2024-09-11T22:19:57.825698+0000","last_undegraded":"2024-09-11T22:19:57.825698+0000","last_fullsized":"2024-09-11T22:19:57.825698+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:52.645868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384151+0000","last_change":"2024-09-11T22:19:55.504254+0000","last_active":"2024-09-11T22:19:57.384151+0000","last_peered":"2024-09-11T22:19:57.384151+0000","last_clean":"2024-09-11T22:19:57.384151+0000","last_became_active":"2024-09-11T22:19:55.503807+0000","last_became_peered":"2024-09-11T22:19:55.503807+0000","last_unstale":"2024-09-11T22:19:57.384151+0000","last_undegraded":"2024-09-11T22:19:57.384151+0000","last_fullsized":"2024-09-11T22:19:57.384151+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:05.936518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"143'4","reported_seq":18,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384092+0000","last_change":"2024-09-11T22:19:54.477507+0000","last_active":"2024-09-11T22:19:57.384092+0000","last_peered":"2024-09-11T22:19:57.384092+0000","last_clean":"2024-09-11T22:19:57.384092+0000","last_became_active":"2024-09-11T22:19:54.477195+0000","last_became_peered":"2024-09-11T22:19:54.477195+0000","last_unstale":"2024-09-11T22:19:57.384092+0000","last_undegraded":"2024-09-11T22:19:57.384092+0000","last_fullsized":"2024-09-11T22:19:57.384092+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:53.923066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141357+0000","last_change":"2024-09-11T22:19:55.488065+0000","last_active":"2024-09-11T22:19:58.141357+0000","last_peered":"2024-09-11T22:19:58.141357+0000","last_clean":"2024-09-11T22:19:58.141357+0000","last_became_active":"2024-09-11T22:19:55.487735+0000","last_became_peered":"2024-09-11T22:19:55.487735+0000","last_unstale":"2024-09-11T22:19:58.141357+0000","last_undegraded":"2024-09-11T22:19:58.141357+0000","last_fullsized":"2024-09-11T22:19:58.141357+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:48.758602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141343+0000","last_change":"2024-09-11T22:19:54.476633+0000","last_active":"2024-09-11T22:19:58.141343+0000","last_peered":"2024-09-11T22:19:58.141343+0000","last_clean":"2024-09-11T22:19:58.141343+0000","last_became_active":"2024-09-11T22:19:54.476047+0000","last_became_peered":"2024-09-11T22:19:54.476047+0000","last_unstale":"2024-09-11T22:19:58.141343+0000","last_undegraded":"2024-09-11T22:19:58.141343+0000","last_fullsized":"2024-09-11T22:19:58.141343+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:32.769254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487982+0000","last_change":"2024-09-11T22:19:55.493592+0000","last_active":"2024-09-11T22:19:56.487982+0000","last_peered":"2024-09-11T22:19:56.487982+0000","last_clean":"2024-09-11T22:19:56.487982+0000","last_became_active":"2024-09-11T22:19:55.493325+0000","last_became_peered":"2024-09-11T22:19:55.493325+0000","last_unstale":"2024-09-11T22:19:56.487982+0000","last_undegraded":"2024-09-11T22:19:56.487982+0000","last_fullsized":"2024-09-11T22:19:56.487982+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:41.997281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490402+0000","last_change":"2024-09-11T22:19:54.479267+0000","last_active":"2024-09-11T22:19:56.490402+0000","last_peered":"2024-09-11T22:19:56.490402+0000","last_clean":"2024-09-11T22:19:56.490402+0000","last_became_active":"2024-09-11T22:19:54.478991+0000","last_became_peered":"2024-09-11T22:19:54.478991+0000","last_unstale":"2024-09-11T22:19:56.490402+0000","last_undegraded":"2024-09-11T22:19:56.490402+0000","last_fullsized":"2024-09-11T22:19:56.490402+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:16.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383952+0000","last_change":"2024-09-11T22:19:55.504793+0000","last_active":"2024-09-11T22:19:57.383952+0000","last_peered":"2024-09-11T22:19:57.383952+0000","last_clean":"2024-09-11T22:19:57.383952+0000","last_became_active":"2024-09-11T22:19:55.504439+0000","last_became_peered":"2024-09-11T22:19:55.504439+0000","last_unstale":"2024-09-11T22:19:57.383952+0000","last_undegraded":"2024-09-11T22:19:57.383952+0000","last_fullsized":"2024-09-11T22:19:57.383952+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:18.199474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491187+0000","last_change":"2024-09-11T22:19:54.480234+0000","last_active":"2024-09-11T22:19:56.491187+0000","last_peered":"2024-09-11T22:19:56.491187+0000","last_clean":"2024-09-11T22:19:56.491187+0000","last_became_active":"2024-09-11T22:19:54.479962+0000","last_became_peered":"2024-09-11T22:19:54.479962+0000","last_unstale":"2024-09-11T22:19:56.491187+0000","last_undegraded":"2024-09-11T22:19:56.491187+0000","last_fullsized":"2024-09-11T22:19:56.491187+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:05.640856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140862+0000","last_change":"2024-09-11T22:19:55.495546+0000","last_active":"2024-09-11T22:19:58.140862+0000","last_peered":"2024-09-11T22:19:58.140862+0000","last_clean":"2024-09-11T22:19:58.140862+0000","last_became_active":"2024-09-11T22:19:55.495260+0000","last_became_peered":"2024-09-11T22:19:55.495260+0000","last_unstale":"2024-09-11T22:19:58.140862+0000","last_undegraded":"2024-09-11T22:19:58.140862+0000","last_fullsized":"2024-09-11T22:19:58.140862+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:18.667141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.825638+0000","last_change":"2024-09-11T22:19:54.486151+0000","last_active":"2024-09-11T22:19:57.825638+0000","last_peered":"2024-09-11T22:19:57.825638+0000","last_clean":"2024-09-11T22:19:57.825638+0000","last_became_active":"2024-09-11T22:19:54.485525+0000","last_became_peered":"2024-09-11T22:19:54.485525+0000","last_unstale":"2024-09-11T22:19:57.825638+0000","last_undegraded":"2024-09-11T22:19:57.825638+0000","last_fullsized":"2024-09-11T22:19:57.825638+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:06.778567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490878+0000","last_change":"2024-09-11T22:19:55.496145+0000","last_active":"2024-09-11T22:19:56.490878+0000","last_peered":"2024-09-11T22:19:56.490878+0000","last_clean":"2024-09-11T22:19:56.490878+0000","last_became_active":"2024-09-11T22:19:55.495816+0000","last_became_peered":"2024-09-11T22:19:55.495816+0000","last_unstale":"2024-09-11T22:19:56.490878+0000","last_undegraded":"2024-09-11T22:19:56.490878+0000","last_fullsized":"2024-09-11T22:19:56.490878+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:16.795325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490169+0000","last_change":"2024-09-11T22:19:54.478301+0000","last_active":"2024-09-11T22:19:56.490169+0000","last_peered":"2024-09-11T22:19:56.490169+0000","last_clean":"2024-09-11T22:19:56.490169+0000","last_became_active":"2024-09-11T22:19:54.478021+0000","last_became_peered":"2024-09-11T22:19:54.478021+0000","last_unstale":"2024-09-11T22:19:56.490169+0000","last_undegraded":"2024-09-11T22:19:56.490169+0000","last_fullsized":"2024-09-11T22:19:56.490169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:58.768201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140956+0000","last_change":"2024-09-11T22:19:55.489324+0000","last_active":"2024-09-11T22:19:58.140956+0000","last_peered":"2024-09-11T22:19:58.140956+0000","last_clean":"2024-09-11T22:19:58.140956+0000","last_became_active":"2024-09-11T22:19:55.488662+0000","last_became_peered":"2024-09-11T22:19:55.488662+0000","last_unstale":"2024-09-11T22:19:58.140956+0000","last_undegraded":"2024-09-11T22:19:58.140956+0000","last_fullsized":"2024-09-11T22:19:58.140956+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:30.847050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.825699+0000","last_change":"2024-09-11T22:19:54.484169+0000","last_active":"2024-09-11T22:19:57.825699+0000","last_peered":"2024-09-11T22:19:57.825699+0000","last_clean":"2024-09-11T22:19:57.825699+0000","last_became_active":"2024-09-11T22:19:54.483844+0000","last_became_peered":"2024-09-11T22:19:54.483844+0000","last_unstale":"2024-09-11T22:19:57.825699+0000","last_undegraded":"2024-09-11T22:19:57.825699+0000","last_fullsized":"2024-09-11T22:19:57.825699+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:19.353179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490586+0000","last_change":"2024-09-11T22:19:55.499899+0000","last_active":"2024-09-11T22:19:56.490586+0000","last_peered":"2024-09-11T22:19:56.490586+0000","last_clean":"2024-09-11T22:19:56.490586+0000","last_became_active":"2024-09-11T22:19:55.499393+0000","last_became_peered":"2024-09-11T22:19:55.499393+0000","last_unstale":"2024-09-11T22:19:56.490586+0000","last_undegraded":"2024-09-11T22:19:56.490586+0000","last_fullsized":"2024-09-11T22:19:56.490586+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:57.477233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490396+0000","last_change":"2024-09-11T22:19:54.483595+0000","last_active":"2024-09-11T22:19:56.490396+0000","last_peered":"2024-09-11T22:19:56.490396+0000","last_clean":"2024-09-11T22:19:56.490396+0000","last_became_active":"2024-09-11T22:19:54.483323+0000","last_became_peered":"2024-09-11T22:19:54.483323+0000","last_unstale":"2024-09-11T22:19:56.490396+0000","last_undegraded":"2024-09-11T22:19:56.490396+0000","last_fullsized":"2024-09-11T22:19:56.490396+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:28.593199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490783+0000","last_change":"2024-09-11T22:19:55.499707+0000","last_active":"2024-09-11T22:19:56.490783+0000","last_peered":"2024-09-11T22:19:56.490783+0000","last_clean":"2024-09-11T22:19:56.490783+0000","last_became_active":"2024-09-11T22:19:55.499444+0000","last_became_peered":"2024-09-11T22:19:55.499444+0000","last_unstale":"2024-09-11T22:19:56.490783+0000","last_undegraded":"2024-09-11T22:19:56.490783+0000","last_fullsized":"2024-09-11T22:19:56.490783+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:20.735423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141346+0000","last_change":"2024-09-11T22:19:54.477229+0000","last_active":"2024-09-11T22:19:58.141346+0000","last_peered":"2024-09-11T22:19:58.141346+0000","last_clean":"2024-09-11T22:19:58.141346+0000","last_became_active":"2024-09-11T22:19:54.476974+0000","last_became_peered":"2024-09-11T22:19:54.476974+0000","last_unstale":"2024-09-11T22:19:58.141346+0000","last_undegraded":"2024-09-11T22:19:58.141346+0000","last_fullsized":"2024-09-11T22:19:58.141346+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:22.872508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384098+0000","last_change":"2024-09-11T22:19:55.496132+0000","last_active":"2024-09-11T22:19:57.384098+0000","last_peered":"2024-09-11T22:19:57.384098+0000","last_clean":"2024-09-11T22:19:57.384098+0000","last_became_active":"2024-09-11T22:19:55.495466+0000","last_became_peered":"2024-09-11T22:19:55.495466+0000","last_unstale":"2024-09-11T22:19:57.384098+0000","last_undegraded":"2024-09-11T22:19:57.384098+0000","last_fullsized":"2024-09-11T22:19:57.384098+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:07.378924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384287+0000","last_change":"2024-09-11T22:19:54.480915+0000","last_active":"2024-09-11T22:19:57.384287+0000","last_peered":"2024-09-11T22:19:57.384287+0000","last_clean":"2024-09-11T22:19:57.384287+0000","last_became_active":"2024-09-11T22:19:54.480633+0000","last_became_peered":"2024-09-11T22:19:54.480633+0000","last_unstale":"2024-09-11T22:19:57.384287+0000","last_undegraded":"2024-09-11T22:19:57.384287+0000","last_fullsized":"2024-09-11T22:19:57.384287+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:37.295459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.825973+0000","last_change":"2024-09-11T22:19:55.487749+0000","last_active":"2024-09-11T22:19:57.825973+0000","last_peered":"2024-09-11T22:19:57.825973+0000","last_clean":"2024-09-11T22:19:57.825973+0000","last_became_active":"2024-09-11T22:19:55.487462+0000","last_became_peered":"2024-09-11T22:19:55.487462+0000","last_unstale":"2024-09-11T22:19:57.825973+0000","last_undegraded":"2024-09-11T22:19:57.825973+0000","last_fullsized":"2024-09-11T22:19:57.825973+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:20:59.948072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"143'6","reported_seq":20,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140984+0000","last_change":"2024-09-11T22:19:54.485607+0000","last_active":"2024-09-11T22:19:58.140984+0000","last_peered":"2024-09-11T22:19:58.140984+0000","last_clean":"2024-09-11T22:19:58.140984+0000","last_became_active":"2024-09-11T22:19:54.485311+0000","last_became_peered":"2024-09-11T22:19:54.485311+0000","last_unstale":"2024-09-11T22:19:58.140984+0000","last_undegraded":"2024-09-11T22:19:58.140984+0000","last_fullsized":"2024-09-11T22:19:58.140984+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:39.296943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288680+0000","last_change":"2024-09-11T22:19:55.497422+0000","last_active":"2024-09-11T22:19:57.288680+0000","last_peered":"2024-09-11T22:19:57.288680+0000","last_clean":"2024-09-11T22:19:57.288680+0000","last_became_active":"2024-09-11T22:19:55.496976+0000","last_became_peered":"2024-09-11T22:19:55.496976+0000","last_unstale":"2024-09-11T22:19:57.288680+0000","last_undegraded":"2024-09-11T22:19:57.288680+0000","last_fullsized":"2024-09-11T22:19:57.288680+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:48.541584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288902+0000","last_change":"2024-09-11T22:19:54.480430+0000","last_active":"2024-09-11T22:19:57.288902+0000","last_peered":"2024-09-11T22:19:57.288902+0000","last_clean":"2024-09-11T22:19:57.288902+0000","last_became_active":"2024-09-11T22:19:54.479673+0000","last_became_peered":"2024-09-11T22:19:54.479673+0000","last_unstale":"2024-09-11T22:19:57.288902+0000","last_undegraded":"2024-09-11T22:19:57.288902+0000","last_fullsized":"2024-09-11T22:19:57.288902+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:53.772625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141025+0000","last_change":"2024-09-11T22:19:55.488085+0000","last_active":"2024-09-11T22:19:58.141025+0000","last_peered":"2024-09-11T22:19:58.141025+0000","last_clean":"2024-09-11T22:19:58.141025+0000","last_became_active":"2024-09-11T22:19:55.487780+0000","last_became_peered":"2024-09-11T22:19:55.487780+0000","last_unstale":"2024-09-11T22:19:58.141025+0000","last_undegraded":"2024-09-11T22:19:58.141025+0000","last_fullsized":"2024-09-11T22:19:58.141025+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:05.989636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288656+0000","last_change":"2024-09-11T22:19:54.480065+0000","last_active":"2024-09-11T22:19:57.288656+0000","last_peered":"2024-09-11T22:19:57.288656+0000","last_clean":"2024-09-11T22:19:57.288656+0000","last_became_active":"2024-09-11T22:19:54.479802+0000","last_became_peered":"2024-09-11T22:19:54.479802+0000","last_unstale":"2024-09-11T22:19:57.288656+0000","last_undegraded":"2024-09-11T22:19:57.288656+0000","last_fullsized":"2024-09-11T22:19:57.288656+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:08.105367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490468+0000","last_change":"2024-09-11T22:19:55.494426+0000","last_active":"2024-09-11T22:19:56.490468+0000","last_peered":"2024-09-11T22:19:56.490468+0000","last_clean":"2024-09-11T22:19:56.490468+0000","last_became_active":"2024-09-11T22:19:55.494068+0000","last_became_peered":"2024-09-11T22:19:55.494068+0000","last_unstale":"2024-09-11T22:19:56.490468+0000","last_undegraded":"2024-09-11T22:19:56.490468+0000","last_fullsized":"2024-09-11T22:19:56.490468+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:19.853525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487683+0000","last_change":"2024-09-11T22:19:54.480462+0000","last_active":"2024-09-11T22:19:56.487683+0000","last_peered":"2024-09-11T22:19:56.487683+0000","last_clean":"2024-09-11T22:19:56.487683+0000","last_became_active":"2024-09-11T22:19:54.480164+0000","last_became_peered":"2024-09-11T22:19:54.480164+0000","last_unstale":"2024-09-11T22:19:56.487683+0000","last_undegraded":"2024-09-11T22:19:56.487683+0000","last_fullsized":"2024-09-11T22:19:56.487683+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:06.951053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288579+0000","last_change":"2024-09-11T22:19:55.508144+0000","last_active":"2024-09-11T22:19:57.288579+0000","last_peered":"2024-09-11T22:19:57.288579+0000","last_clean":"2024-09-11T22:19:57.288579+0000","last_became_active":"2024-09-11T22:19:55.506988+0000","last_became_peered":"2024-09-11T22:19:55.506988+0000","last_unstale":"2024-09-11T22:19:57.288579+0000","last_undegraded":"2024-09-11T22:19:57.288579+0000","last_fullsized":"2024-09-11T22:19:57.288579+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:41.997281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"143'8","reported_seq":22,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.825779+0000","last_change":"2024-09-11T22:19:54.482849+0000","last_active":"2024-09-11T22:19:57.825779+0000","last_peered":"2024-09-11T22:19:57.825779+0000","last_clean":"2024-09-11T22:19:57.825779+0000","last_became_active":"2024-09-11T22:19:54.482552+0000","last_became_peered":"2024-09-11T22:19:54.482552+0000","last_unstale":"2024-09-11T22:19:57.825779+0000","last_undegraded":"2024-09-11T22:19:57.825779+0000","last_fullsized":"2024-09-11T22:19:57.825779+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:34.396451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384240+0000","last_change":"2024-09-11T22:19:55.496672+0000","last_active":"2024-09-11T22:19:57.384240+0000","last_peered":"2024-09-11T22:19:57.384240+0000","last_clean":"2024-09-11T22:19:57.384240+0000","last_became_active":"2024-09-11T22:19:55.496398+0000","last_became_peered":"2024-09-11T22:19:55.496398+0000","last_unstale":"2024-09-11T22:19:57.384240+0000","last_undegraded":"2024-09-11T22:19:57.384240+0000","last_fullsized":"2024-09-11T22:19:57.384240+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:54.264936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490889+0000","last_change":"2024-09-11T22:19:54.481617+0000","last_active":"2024-09-11T22:19:56.490889+0000","last_peered":"2024-09-11T22:19:56.490889+0000","last_clean":"2024-09-11T22:19:56.490889+0000","last_became_active":"2024-09-11T22:19:54.480067+0000","last_became_peered":"2024-09-11T22:19:54.480067+0000","last_unstale":"2024-09-11T22:19:56.490889+0000","last_undegraded":"2024-09-11T22:19:56.490889+0000","last_fullsized":"2024-09-11T22:19:56.490889+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:32.541675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.826146+0000","last_change":"2024-09-11T22:19:55.498674+0000","last_active":"2024-09-11T22:19:57.826146+0000","last_peered":"2024-09-11T22:19:57.826146+0000","last_clean":"2024-09-11T22:19:57.826146+0000","last_became_active":"2024-09-11T22:19:55.498398+0000","last_became_peered":"2024-09-11T22:19:55.498398+0000","last_unstale":"2024-09-11T22:19:57.826146+0000","last_undegraded":"2024-09-11T22:19:57.826146+0000","last_fullsized":"2024-09-11T22:19:57.826146+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:03:43.085831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141421+0000","last_change":"2024-09-11T22:19:54.480708+0000","last_active":"2024-09-11T22:19:58.141421+0000","last_peered":"2024-09-11T22:19:58.141421+0000","last_clean":"2024-09-11T22:19:58.141421+0000","last_became_active":"2024-09-11T22:19:54.480362+0000","last_became_peered":"2024-09-11T22:19:54.480362+0000","last_unstale":"2024-09-11T22:19:58.141421+0000","last_undegraded":"2024-09-11T22:19:58.141421+0000","last_fullsized":"2024-09-11T22:19:58.141421+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:39.296943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.289001+0000","last_change":"2024-09-11T22:19:55.493922+0000","last_active":"2024-09-11T22:19:57.289001+0000","last_peered":"2024-09-11T22:19:57.289001+0000","last_clean":"2024-09-11T22:19:57.289001+0000","last_became_active":"2024-09-11T22:19:55.493643+0000","last_became_peered":"2024-09-11T22:19:55.493643+0000","last_unstale":"2024-09-11T22:19:57.289001+0000","last_undegraded":"2024-09-11T22:19:57.289001+0000","last_fullsized":"2024-09-11T22:19:57.289001+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.589766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.825974+0000","last_change":"2024-09-11T22:19:54.484652+0000","last_active":"2024-09-11T22:19:57.825974+0000","last_peered":"2024-09-11T22:19:57.825974+0000","last_clean":"2024-09-11T22:19:57.825974+0000","last_became_active":"2024-09-11T22:19:54.484339+0000","last_became_peered":"2024-09-11T22:19:54.484339+0000","last_unstale":"2024-09-11T22:19:57.825974+0000","last_undegraded":"2024-09-11T22:19:57.825974+0000","last_fullsized":"2024-09-11T22:19:57.825974+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:26.988816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488205+0000","last_change":"2024-09-11T22:19:55.501848+0000","last_active":"2024-09-11T22:19:56.488205+0000","last_peered":"2024-09-11T22:19:56.488205+0000","last_clean":"2024-09-11T22:19:56.488205+0000","last_became_active":"2024-09-11T22:19:55.501221+0000","last_became_peered":"2024-09-11T22:19:55.501221+0000","last_unstale":"2024-09-11T22:19:56.488205+0000","last_undegraded":"2024-09-11T22:19:56.488205+0000","last_fullsized":"2024-09-11T22:19:56.488205+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:23.106236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141343+0000","last_change":"2024-09-11T22:19:54.484664+0000","last_active":"2024-09-11T22:19:58.141343+0000","last_peered":"2024-09-11T22:19:58.141343+0000","last_clean":"2024-09-11T22:19:58.141343+0000","last_became_active":"2024-09-11T22:19:54.484352+0000","last_became_peered":"2024-09-11T22:19:54.484352+0000","last_unstale":"2024-09-11T22:19:58.141343+0000","last_undegraded":"2024-09-11T22:19:58.141343+0000","last_fullsized":"2024-09-11T22:19:58.141343+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:23.346017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491534+0000","last_change":"2024-09-11T22:19:55.496737+0000","last_active":"2024-09-11T22:19:56.491534+0000","last_peered":"2024-09-11T22:19:56.491534+0000","last_clean":"2024-09-11T22:19:56.491534+0000","last_became_active":"2024-09-11T22:19:55.496089+0000","last_became_peered":"2024-09-11T22:19:55.496089+0000","last_unstale":"2024-09-11T22:19:56.491534+0000","last_undegraded":"2024-09-11T22:19:56.491534+0000","last_fullsized":"2024-09-11T22:19:56.491534+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:37.230107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140832+0000","last_change":"2024-09-11T22:19:54.479734+0000","last_active":"2024-09-11T22:19:58.140832+0000","last_peered":"2024-09-11T22:19:58.140832+0000","last_clean":"2024-09-11T22:19:58.140832+0000","last_became_active":"2024-09-11T22:19:54.479446+0000","last_became_peered":"2024-09-11T22:19:54.479446+0000","last_unstale":"2024-09-11T22:19:58.140832+0000","last_undegraded":"2024-09-11T22:19:58.140832+0000","last_fullsized":"2024-09-11T22:19:58.140832+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:32.769254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140769+0000","last_change":"2024-09-11T22:19:55.491954+0000","last_active":"2024-09-11T22:19:58.140769+0000","last_peered":"2024-09-11T22:19:58.140769+0000","last_clean":"2024-09-11T22:19:58.140769+0000","last_became_active":"2024-09-11T22:19:55.491624+0000","last_became_peered":"2024-09-11T22:19:55.491624+0000","last_unstale":"2024-09-11T22:19:58.140769+0000","last_undegraded":"2024-09-11T22:19:58.140769+0000","last_fullsized":"2024-09-11T22:19:58.140769+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:45.119040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383886+0000","last_change":"2024-09-11T22:19:54.474277+0000","last_active":"2024-09-11T22:19:57.383886+0000","last_peered":"2024-09-11T22:19:57.383886+0000","last_clean":"2024-09-11T22:19:57.383886+0000","last_became_active":"2024-09-11T22:19:54.473990+0000","last_became_peered":"2024-09-11T22:19:54.473990+0000","last_unstale":"2024-09-11T22:19:57.383886+0000","last_undegraded":"2024-09-11T22:19:57.383886+0000","last_fullsized":"2024-09-11T22:19:57.383886+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:33.263881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490394+0000","last_change":"2024-09-11T22:19:55.484311+0000","last_active":"2024-09-11T22:19:56.490394+0000","last_peered":"2024-09-11T22:19:56.490394+0000","last_clean":"2024-09-11T22:19:56.490394+0000","last_became_active":"2024-09-11T22:19:55.484011+0000","last_became_peered":"2024-09-11T22:19:55.484011+0000","last_unstale":"2024-09-11T22:19:56.490394+0000","last_undegraded":"2024-09-11T22:19:56.490394+0000","last_fullsized":"2024-09-11T22:19:56.490394+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:26.649106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383580+0000","last_change":"2024-09-11T22:19:54.475515+0000","last_active":"2024-09-11T22:19:57.383580+0000","last_peered":"2024-09-11T22:19:57.383580+0000","last_clean":"2024-09-11T22:19:57.383580+0000","last_became_active":"2024-09-11T22:19:54.475217+0000","last_became_peered":"2024-09-11T22:19:54.475217+0000","last_unstale":"2024-09-11T22:19:57.383580+0000","last_undegraded":"2024-09-11T22:19:57.383580+0000","last_fullsized":"2024-09-11T22:19:57.383580+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:57.756890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140845+0000","last_change":"2024-09-11T22:19:55.492392+0000","last_active":"2024-09-11T22:19:58.140845+0000","last_peered":"2024-09-11T22:19:58.140845+0000","last_clean":"2024-09-11T22:19:58.140845+0000","last_became_active":"2024-09-11T22:19:55.491512+0000","last_became_peered":"2024-09-11T22:19:55.491512+0000","last_unstale":"2024-09-11T22:19:58.140845+0000","last_undegraded":"2024-09-11T22:19:58.140845+0000","last_fullsized":"2024-09-11T22:19:58.140845+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:43.655472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288392+0000","last_change":"2024-09-11T22:19:54.482424+0000","last_active":"2024-09-11T22:19:57.288392+0000","last_peered":"2024-09-11T22:19:57.288392+0000","last_clean":"2024-09-11T22:19:57.288392+0000","last_became_active":"2024-09-11T22:19:54.482063+0000","last_became_peered":"2024-09-11T22:19:54.482063+0000","last_unstale":"2024-09-11T22:19:57.288392+0000","last_undegraded":"2024-09-11T22:19:57.288392+0000","last_fullsized":"2024-09-11T22:19:57.288392+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:16.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490944+0000","last_change":"2024-09-11T22:19:55.496545+0000","last_active":"2024-09-11T22:19:56.490944+0000","last_peered":"2024-09-11T22:19:56.490944+0000","last_clean":"2024-09-11T22:19:56.490944+0000","last_became_active":"2024-09-11T22:19:55.496051+0000","last_became_peered":"2024-09-11T22:19:55.496051+0000","last_unstale":"2024-09-11T22:19:56.490944+0000","last_undegraded":"2024-09-11T22:19:56.490944+0000","last_fullsized":"2024-09-11T22:19:56.490944+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:35.195952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.384243+0000","last_change":"2024-09-11T22:19:54.480155+0000","last_active":"2024-09-11T22:19:57.384243+0000","last_peered":"2024-09-11T22:19:57.384243+0000","last_clean":"2024-09-11T22:19:57.384243+0000","last_became_active":"2024-09-11T22:19:54.479875+0000","last_became_peered":"2024-09-11T22:19:54.479875+0000","last_unstale":"2024-09-11T22:19:57.384243+0000","last_undegraded":"2024-09-11T22:19:57.384243+0000","last_fullsized":"2024-09-11T22:19:57.384243+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:39:16.361022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288906+0000","last_change":"2024-09-11T22:19:55.501115+0000","last_active":"2024-09-11T22:19:57.288906+0000","last_peered":"2024-09-11T22:19:57.288906+0000","last_clean":"2024-09-11T22:19:57.288906+0000","last_became_active":"2024-09-11T22:19:55.500505+0000","last_became_peered":"2024-09-11T22:19:55.500505+0000","last_unstale":"2024-09-11T22:19:57.288906+0000","last_undegraded":"2024-09-11T22:19:57.288906+0000","last_fullsized":"2024-09-11T22:19:57.288906+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:26.649106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487997+0000","last_change":"2024-09-11T22:19:54.483996+0000","last_active":"2024-09-11T22:19:56.487997+0000","last_peered":"2024-09-11T22:19:56.487997+0000","last_clean":"2024-09-11T22:19:56.487997+0000","last_became_active":"2024-09-11T22:19:54.483682+0000","last_became_peered":"2024-09-11T22:19:54.483682+0000","last_unstale":"2024-09-11T22:19:56.487997+0000","last_undegraded":"2024-09-11T22:19:56.487997+0000","last_fullsized":"2024-09-11T22:19:56.487997+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:22.920609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141389+0000","last_change":"2024-09-11T22:19:55.493907+0000","last_active":"2024-09-11T22:19:58.141389+0000","last_peered":"2024-09-11T22:19:58.141389+0000","last_clean":"2024-09-11T22:19:58.141389+0000","last_became_active":"2024-09-11T22:19:55.493552+0000","last_became_peered":"2024-09-11T22:19:55.493552+0000","last_unstale":"2024-09-11T22:19:58.141389+0000","last_undegraded":"2024-09-11T22:19:58.141389+0000","last_fullsized":"2024-09-11T22:19:58.141389+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:48.038083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488308+0000","last_change":"2024-09-11T22:19:54.486850+0000","last_active":"2024-09-11T22:19:56.488308+0000","last_peered":"2024-09-11T22:19:56.488308+0000","last_clean":"2024-09-11T22:19:56.488308+0000","last_became_active":"2024-09-11T22:19:54.486160+0000","last_became_peered":"2024-09-11T22:19:54.486160+0000","last_unstale":"2024-09-11T22:19:56.488308+0000","last_undegraded":"2024-09-11T22:19:56.488308+0000","last_fullsized":"2024-09-11T22:19:56.488308+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:08.105367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.488249+0000","last_change":"2024-09-11T22:19:55.496132+0000","last_active":"2024-09-11T22:19:56.488249+0000","last_peered":"2024-09-11T22:19:56.488249+0000","last_clean":"2024-09-11T22:19:56.488249+0000","last_became_active":"2024-09-11T22:19:55.495766+0000","last_became_peered":"2024-09-11T22:19:55.495766+0000","last_unstale":"2024-09-11T22:19:56.488249+0000","last_undegraded":"2024-09-11T22:19:56.488249+0000","last_fullsized":"2024-09-11T22:19:56.488249+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.589766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.487870+0000","last_change":"2024-09-11T22:19:54.486505+0000","last_active":"2024-09-11T22:19:56.487870+0000","last_peered":"2024-09-11T22:19:56.487870+0000","last_clean":"2024-09-11T22:19:56.487870+0000","last_became_active":"2024-09-11T22:19:54.486071+0000","last_became_peered":"2024-09-11T22:19:54.486071+0000","last_unstale":"2024-09-11T22:19:56.487870+0000","last_undegraded":"2024-09-11T22:19:56.487870+0000","last_fullsized":"2024-09-11T22:19:56.487870+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:50.039730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.826080+0000","last_change":"2024-09-11T22:19:55.500191+0000","last_active":"2024-09-11T22:19:57.826080+0000","last_peered":"2024-09-11T22:19:57.826080+0000","last_clean":"2024-09-11T22:19:57.826080+0000","last_became_active":"2024-09-11T22:19:55.499703+0000","last_became_peered":"2024-09-11T22:19:55.499703+0000","last_unstale":"2024-09-11T22:19:57.826080+0000","last_undegraded":"2024-09-11T22:19:57.826080+0000","last_fullsized":"2024-09-11T22:19:57.826080+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:29.495057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.140919+0000","last_change":"2024-09-11T22:19:54.478322+0000","last_active":"2024-09-11T22:19:58.140919+0000","last_peered":"2024-09-11T22:19:58.140919+0000","last_clean":"2024-09-11T22:19:58.140919+0000","last_became_active":"2024-09-11T22:19:54.478056+0000","last_became_peered":"2024-09-11T22:19:54.478056+0000","last_unstale":"2024-09-11T22:19:58.140919+0000","last_undegraded":"2024-09-11T22:19:58.140919+0000","last_fullsized":"2024-09-11T22:19:58.140919+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:22.872508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.491352+0000","last_change":"2024-09-11T22:19:55.500816+0000","last_active":"2024-09-11T22:19:56.491352+0000","last_peered":"2024-09-11T22:19:56.491352+0000","last_clean":"2024-09-11T22:19:56.491352+0000","last_became_active":"2024-09-11T22:19:55.500559+0000","last_became_peered":"2024-09-11T22:19:55.500559+0000","last_unstale":"2024-09-11T22:19:56.491352+0000","last_undegraded":"2024-09-11T22:19:56.491352+0000","last_fullsized":"2024-09-11T22:19:56.491352+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:51.041508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383723+0000","last_change":"2024-09-11T22:19:54.482877+0000","last_active":"2024-09-11T22:19:57.383723+0000","last_peered":"2024-09-11T22:19:57.383723+0000","last_clean":"2024-09-11T22:19:57.383723+0000","last_became_active":"2024-09-11T22:19:54.482462+0000","last_became_peered":"2024-09-11T22:19:54.482462+0000","last_unstale":"2024-09-11T22:19:57.383723+0000","last_undegraded":"2024-09-11T22:19:57.383723+0000","last_fullsized":"2024-09-11T22:19:57.383723+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:50.629566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383704+0000","last_change":"2024-09-11T22:19:55.503903+0000","last_active":"2024-09-11T22:19:57.383704+0000","last_peered":"2024-09-11T22:19:57.383704+0000","last_clean":"2024-09-11T22:19:57.383704+0000","last_became_active":"2024-09-11T22:19:55.503606+0000","last_became_peered":"2024-09-11T22:19:55.503606+0000","last_unstale":"2024-09-11T22:19:57.383704+0000","last_undegraded":"2024-09-11T22:19:57.383704+0000","last_fullsized":"2024-09-11T22:19:57.383704+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:41.678234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288530+0000","last_change":"2024-09-11T22:19:54.480651+0000","last_active":"2024-09-11T22:19:57.288530+0000","last_peered":"2024-09-11T22:19:57.288530+0000","last_clean":"2024-09-11T22:19:57.288530+0000","last_became_active":"2024-09-11T22:19:54.480268+0000","last_became_peered":"2024-09-11T22:19:54.480268+0000","last_unstale":"2024-09-11T22:19:57.288530+0000","last_undegraded":"2024-09-11T22:19:57.288530+0000","last_fullsized":"2024-09-11T22:19:57.288530+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:28.593199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:56.490440+0000","last_change":"2024-09-11T22:19:55.499655+0000","last_active":"2024-09-11T22:19:56.490440+0000","last_peered":"2024-09-11T22:19:56.490440+0000","last_clean":"2024-09-11T22:19:56.490440+0000","last_became_active":"2024-09-11T22:19:55.498978+0000","last_became_peered":"2024-09-11T22:19:55.498978+0000","last_unstale":"2024-09-11T22:19:56.490440+0000","last_undegraded":"2024-09-11T22:19:56.490440+0000","last_fullsized":"2024-09-11T22:19:56.490440+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:14.895923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141006+0000","last_change":"2024-09-11T22:19:54.472846+0000","last_active":"2024-09-11T22:19:58.141006+0000","last_peered":"2024-09-11T22:19:58.141006+0000","last_clean":"2024-09-11T22:19:58.141006+0000","last_became_active":"2024-09-11T22:19:54.472482+0000","last_became_peered":"2024-09-11T22:19:54.472482+0000","last_unstale":"2024-09-11T22:19:58.141006+0000","last_undegraded":"2024-09-11T22:19:58.141006+0000","last_fullsized":"2024-09-11T22:19:58.141006+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:10.691015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:58.141057+0000","last_change":"2024-09-11T22:19:55.493295+0000","last_active":"2024-09-11T22:19:58.141057+0000","last_peered":"2024-09-11T22:19:58.141057+0000","last_clean":"2024-09-11T22:19:58.141057+0000","last_became_active":"2024-09-11T22:19:55.492963+0000","last_became_peered":"2024-09-11T22:19:55.492963+0000","last_unstale":"2024-09-11T22:19:58.141057+0000","last_undegraded":"2024-09-11T22:19:58.141057+0000","last_fullsized":"2024-09-11T22:19:58.141057+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:54.461141+0000","last_clean_scrub_stamp":"2024-09-11T22:19:54.461141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:30.847050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"143'3","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.288876+0000","last_change":"2024-09-11T22:19:54.480949+0000","last_active":"2024-09-11T22:19:57.288876+0000","last_peered":"2024-09-11T22:19:57.288876+0000","last_clean":"2024-09-11T22:19:57.288876+0000","last_became_active":"2024-09-11T22:19:54.480650+0000","last_became_peered":"2024-09-11T22:19:54.480650+0000","last_unstale":"2024-09-11T22:19:57.288876+0000","last_undegraded":"2024-09-11T22:19:57.288876+0000","last_fullsized":"2024-09-11T22:19:57.288876+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:19:53.459363+0000","last_clean_scrub_stamp":"2024-09-11T22:19:53.459363+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:40.197692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":393,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-11T22:19:57.383815+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:19:57.383815+0000","last_peered":"2024-09-11T22:19:57.383815+0000","last_clean":"2024-09-11T22:19:57.383815+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:19:57.383815+0000","last_undegraded":"2024-09-11T22:19:57.383815+0000","last_fullsized":"2024-09-11T22:19:57.383815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509552,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51000,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320840,"statfs":{"total":96636764160,"available":96584540160,"internally_reserved":0,"allocated":1806336,"data_stored":787079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509549,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46840,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325000,"statfs":{"total":96636764160,"available":96588800000,"internally_reserved":0,"allocated":1798144,"data_stored":786955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50992,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1794048,"data_stored":786933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509551,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59312,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312528,"statfs":{"total":96636764160,"available":96576028672,"internally_reserved":0,"allocated":1798144,"data_stored":787023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509551,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59320,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312520,"statfs":{"total":96636764160,"available":96576020480,"internally_reserved":0,"allocated":1798144,"data_stored":787515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509550,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55744,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316096,"statfs":{"total":96636764160,"available":96579682304,"internally_reserved":0,"allocated":2404352,"data_stored":1378947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574959,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51580,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320260,"statfs":{"total":96636764160,"available":96583946240,"internally_reserved":0,"allocated":2396160,"data_stored":1377953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59324,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312516,"statfs":{"total":96636764160,"available":96576016384,"internally_reserved":0,"allocated":1810432,"data_stored":788615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:20:03.780 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:20:03.780 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T22:20:03.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.925+0000 7f905ecc3640 1 Processor -- start 2024-09-11T22:20:03.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.925+0000 7f905ecc3640 1 -- start start 2024-09-11T22:20:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f905ecc3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f90580cf790 0x7f90580b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f905ecc3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f90580d11d0 0x7f90580d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f905ecc3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9058162110 con 0x7f9058161d30 2024-09-11T22:20:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f905ecc3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f90580d3450 con 0x7f90580d11d0 2024-09-11T22:20:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f905ecc3640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f90580b7e30 con 0x7f90580cf790 2024-09-11T22:20:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f905d260640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f90580d11d0 0x7f90580d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f905ca5f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9058161d30 0x7f9058162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50394/0 (socket says 172.21.15.50:50394) 2024-09-11T22:20:03.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f905ca5f640 1 -- 172.21.15.50:0/2841301415 learned_addr learned my addr 172.21.15.50:0/2841301415 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:03.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f9057fff640 1 --2- 172.21.15.50:0/2841301415 >> v2:172.21.15.77:3300/0 conn(0x7f90580cf790 0x7f90580b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:03.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f905d260640 1 -- 172.21.15.50:0/2841301415 >> v2:172.21.15.77:3300/0 conn(0x7f90580cf790 msgr2=0x7f90580b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:03.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f905d260640 1 --2- 172.21.15.50:0/2841301415 >> v2:172.21.15.77:3300/0 conn(0x7f90580cf790 0x7f90580b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f905d260640 1 -- 172.21.15.50:0/2841301415 >> v1:172.21.15.50:6789/0 conn(0x7f9058161d30 legacy=0x7f9058162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:03.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f90577fe640 1 -- 172.21.15.50:0/2841301415 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112681003 0 0) 0x7f9058162110 con 0x7f9058161d30 2024-09-11T22:20:03.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.926+0000 7f905d260640 1 -- 172.21.15.50:0/2841301415 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90580cfd70 con 0x7f90580d11d0 2024-09-11T22:20:03.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.927+0000 7f905d260640 1 --2- 172.21.15.50:0/2841301415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90580d11d0 0x7f90580d1600 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f9058068730 tx=0x7f905002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b2d59154fda404 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:03.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.927+0000 7f90577fe640 1 -- 172.21.15.50:0/2841301415 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9050007740 con 0x7f90580d11d0 2024-09-11T22:20:03.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.927+0000 7f90577fe640 1 -- 172.21.15.50:0/2841301415 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90500078e0 con 0x7f90580d11d0 2024-09-11T22:20:03.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.927+0000 7f90577fe640 1 -- 172.21.15.50:0/2841301415 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9050007cb0 con 0x7f90580d11d0 2024-09-11T22:20:03.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.928+0000 7f905ecc3640 1 -- 172.21.15.50:0/2841301415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90580d11d0 msgr2=0x7f90580d1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:03.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.928+0000 7f905ecc3640 1 --2- 172.21.15.50:0/2841301415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90580d11d0 0x7f90580d1600 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f9058068730 tx=0x7f905002a680 comp rx=0 tx=0).stop 2024-09-11T22:20:03.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.928+0000 7f905ecc3640 1 -- 172.21.15.50:0/2841301415 shutdown_connections 2024-09-11T22:20:03.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.928+0000 7f905ecc3640 1 --2- 172.21.15.50:0/2841301415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90580d11d0 0x7f90580d1600 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.928+0000 7f905ecc3640 1 --2- 172.21.15.50:0/2841301415 >> v2:172.21.15.77:3300/0 conn(0x7f90580cf790 0x7f90580b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.928+0000 7f905ecc3640 1 -- 172.21.15.50:0/2841301415 >> 172.21.15.50:0/2841301415 conn(0x7f90580727a0 msgr2=0x7f90580679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:03.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.928+0000 7f905ecc3640 1 -- 172.21.15.50:0/2841301415 shutdown_connections 2024-09-11T22:20:03.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.928+0000 7f905ecc3640 1 -- 172.21.15.50:0/2841301415 wait complete. 2024-09-11T22:20:03.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.929+0000 7f905ecc3640 1 Processor -- start 2024-09-11T22:20:03.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.929+0000 7f905ecc3640 1 -- start start 2024-09-11T22:20:03.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ecc3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90580cf790 0x7f905815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:03.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ecc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580d11d0 0x7f90580ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:03.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ecc3640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9058161d30 0x7f90580ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:03.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ecc3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f90580d2e00 con 0x7f90580cf790 2024-09-11T22:20:03.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ecc3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f90580d1b40 con 0x7f90580d11d0 2024-09-11T22:20:03.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ecc3640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f90580d30e0 con 0x7f9058161d30 2024-09-11T22:20:03.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ca5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90580cf790 0x7f905815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ca5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90580cf790 0x7f905815dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45330/0 (socket says 172.21.15.50:45330) 2024-09-11T22:20:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ca5f640 1 -- 172.21.15.50:0/3962196583 learned_addr learned my addr 172.21.15.50:0/3962196583 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f9057fff640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580d11d0 0x7f90580ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905d260640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9058161d30 0x7f90580ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ca5f640 1 -- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9058161d30 msgr2=0x7f90580ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ca5f640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9058161d30 0x7f90580ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ca5f640 1 -- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580d11d0 msgr2=0x7f90580ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ca5f640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580d11d0 0x7f90580ac390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ca5f640 1 -- 172.21.15.50:0/3962196583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90580b65f0 con 0x7f90580cf790 2024-09-11T22:20:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905d260640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9058161d30 0x7f90580ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f905ca5f640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90580cf790 0x7f905815dd60 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c430 tx=0x7f904c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f90557fa640 1 -- 172.21.15.50:0/3962196583 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c0074e0 con 0x7f90580cf790 2024-09-11T22:20:03.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.930+0000 7f90557fa640 1 -- 172.21.15.50:0/3962196583 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904c0047e0 con 0x7f90580cf790 2024-09-11T22:20:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.931+0000 7f905ecc3640 1 -- 172.21.15.50:0/3962196583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90580b68d0 con 0x7f90580cf790 2024-09-11T22:20:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.931+0000 7f90557fa640 1 -- 172.21.15.50:0/3962196583 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c004bd0 con 0x7f90580cf790 2024-09-11T22:20:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.931+0000 7f905ecc3640 1 -- 172.21.15.50:0/3962196583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90580b6e90 con 0x7f90580cf790 2024-09-11T22:20:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.931+0000 7f905ecc3640 1 -- 172.21.15.50:0/3962196583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90580b78f0 con 0x7f90580cf790 2024-09-11T22:20:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.932+0000 7f90557fa640 1 -- 172.21.15.50:0/3962196583 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f904c011070 con 0x7f90580cf790 2024-09-11T22:20:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.932+0000 7f90557fa640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f903c06be30 0x7f903c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.933+0000 7f90557fa640 1 -- 172.21.15.50:0/3962196583 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f904c08aa90 con 0x7f90580cf790 2024-09-11T22:20:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.933+0000 7f9057fff640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f903c06be30 0x7f903c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:03.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.933+0000 7f9057fff640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f903c06be30 0x7f903c06e2f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f90580d05b0 tx=0x7f9044008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:03.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:03.937+0000 7f90557fa640 1 -- 172.21.15.50:0/3962196583 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f904c0593a0 con 0x7f90580cf790 2024-09-11T22:20:04.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.179+0000 7f905ecc3640 1 -- 172.21.15.50:0/3962196583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f90580cb330 con 0x7f90580cf790 2024-09-11T22:20:04.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.182+0000 7f90557fa640 1 -- 172.21.15.50:0/3962196583 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7f904c058ca0 con 0x7f90580cf790 2024-09-11T22:20:04.182 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:20:04.182 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:20:04.183 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-09-11T22:20:04.183 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-09-11T22:20:04.183 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T22:20:04.183 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-11T22:20:04.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.184+0000 7f905ecc3640 1 -- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f903c06be30 msgr2=0x7f903c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:04.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.184+0000 7f905ecc3640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f903c06be30 0x7f903c06e2f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f90580d05b0 tx=0x7f9044008040 comp rx=0 tx=0).stop 2024-09-11T22:20:04.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.184+0000 7f905ecc3640 1 -- 172.21.15.50:0/3962196583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90580cf790 msgr2=0x7f905815dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:04.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.184+0000 7f905ecc3640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90580cf790 0x7f905815dd60 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c430 tx=0x7f904c00c8f0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.184+0000 7f905ecc3640 1 -- 172.21.15.50:0/3962196583 shutdown_connections 2024-09-11T22:20:04.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.184+0000 7f905ecc3640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f903c06be30 0x7f903c06e2f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.184+0000 7f905ecc3640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9058161d30 0x7f90580ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.184+0000 7f905ecc3640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580d11d0 0x7f90580ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.184+0000 7f905ecc3640 1 --2- 172.21.15.50:0/3962196583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90580cf790 0x7f905815dd60 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.184+0000 7f905ecc3640 1 -- 172.21.15.50:0/3962196583 >> 172.21.15.50:0/3962196583 conn(0x7f90580727a0 msgr2=0x7f9058160070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:04.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.184+0000 7f905ecc3640 1 -- 172.21.15.50:0/3962196583 shutdown_connections 2024-09-11T22:20:04.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.184+0000 7f905ecc3640 1 -- 172.21.15.50:0/3962196583 wait complete. 2024-09-11T22:20:04.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.298+0000 7fd4f65c4640 1 Processor -- start 2024-09-11T22:20:04.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.298+0000 7fd4f65c4640 1 -- start start 2024-09-11T22:20:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.298+0000 7fd4f65c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4f015c3c0 0x7fd4f015fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:04.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.298+0000 7fd4f65c4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4f00680d0 0x7fd4f015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.298+0000 7fd4f65c4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f015f7f0 con 0x7fd4f015ec40 2024-09-11T22:20:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.298+0000 7fd4f65c4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f006e700 con 0x7fd4f015c3c0 2024-09-11T22:20:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.298+0000 7fd4f65c4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f015fad0 con 0x7fd4f00680d0 2024-09-11T22:20:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.299+0000 7fd4effff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4f015c3c0 0x7fd4f015fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.299+0000 7fd4effff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4f015c3c0 0x7fd4f015fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45332/0 (socket says 172.21.15.50:45332) 2024-09-11T22:20:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.299+0000 7fd4effff640 1 -- 172.21.15.50:0/2074450750 learned_addr learned my addr 172.21.15.50:0/2074450750 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.299+0000 7fd4f4b61640 1 --2- 172.21.15.50:0/2074450750 >> v2:172.21.15.77:3300/0 conn(0x7fd4f00680d0 0x7fd4f015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.299+0000 7fd4effff640 1 -- 172.21.15.50:0/2074450750 >> v2:172.21.15.77:3300/0 conn(0x7fd4f00680d0 msgr2=0x7fd4f015f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.299+0000 7fd4effff640 1 --2- 172.21.15.50:0/2074450750 >> v2:172.21.15.77:3300/0 conn(0x7fd4f00680d0 0x7fd4f015f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.299+0000 7fd4effff640 1 -- 172.21.15.50:0/2074450750 >> v1:172.21.15.77:6789/0 conn(0x7fd4f015ec40 legacy=0x7fd4f00679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:04.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.299+0000 7fd4effff640 1 -- 172.21.15.50:0/2074450750 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f006e950 con 0x7fd4f015c3c0 2024-09-11T22:20:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.299+0000 7fd4f4b61640 1 --2- 172.21.15.50:0/2074450750 >> v2:172.21.15.77:3300/0 conn(0x7fd4f00680d0 0x7fd4f015f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.300+0000 7fd4effff640 1 --2- 172.21.15.50:0/2074450750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f015c3c0 0x7fd4f015fe60 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00d0160 tx=0x7fd4e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f2bcaeb8ba2be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.300+0000 7fd4eeffd640 1 -- 172.21.15.50:0/2074450750 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0037070 con 0x7fd4f015c3c0 2024-09-11T22:20:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.300+0000 7fd4eeffd640 1 -- 172.21.15.50:0/2074450750 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e0032440 con 0x7fd4f015c3c0 2024-09-11T22:20:04.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.300+0000 7fd4eeffd640 1 -- 172.21.15.50:0/2074450750 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0032810 con 0x7fd4f015c3c0 2024-09-11T22:20:04.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.300+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2074450750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f015c3c0 msgr2=0x7fd4f015fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:04.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.300+0000 7fd4f65c4640 1 --2- 172.21.15.50:0/2074450750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f015c3c0 0x7fd4f015fe60 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00d0160 tx=0x7fd4e002a1e0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.300+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2074450750 shutdown_connections 2024-09-11T22:20:04.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.300+0000 7fd4f65c4640 1 --2- 172.21.15.50:0/2074450750 >> v2:172.21.15.77:3300/0 conn(0x7fd4f00680d0 0x7fd4f015f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.300+0000 7fd4f65c4640 1 --2- 172.21.15.50:0/2074450750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f015c3c0 0x7fd4f015fe60 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.300+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2074450750 >> 172.21.15.50:0/2074450750 conn(0x7fd4f0075060 msgr2=0x7fd4f006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:04.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.300+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2074450750 shutdown_connections 2024-09-11T22:20:04.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.300+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2074450750 wait complete. 2024-09-11T22:20:04.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.302+0000 7fd4f65c4640 1 Processor -- start 2024-09-11T22:20:04.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.302+0000 7fd4f65c4640 1 -- start start 2024-09-11T22:20:04.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.302+0000 7fd4f65c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f00680d0 0x7fd4f014df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:04.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.302+0000 7fd4f65c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f015c3c0 0x7fd4f00cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:04.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.302+0000 7fd4f65c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f015ec40 0x7fd4f01e9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:04.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.302+0000 7fd4f65c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f006f150 con 0x7fd4f015ec40 2024-09-11T22:20:04.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.302+0000 7fd4f65c4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f00d0940 con 0x7fd4f015c3c0 2024-09-11T22:20:04.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.302+0000 7fd4f65c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f006f2d0 con 0x7fd4f00680d0 2024-09-11T22:20:04.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4f4b61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f015ec40 0x7fd4f01e9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:04.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4f4b61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f015ec40 0x7fd4f01e9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45334/0 (socket says 172.21.15.50:45334) 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4f4b61640 1 -- 172.21.15.50:0/2649122815 learned_addr learned my addr 172.21.15.50:0/2649122815 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4effff640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f00680d0 0x7fd4f014df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4ef7fe640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f015c3c0 0x7fd4f00cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4f4b61640 1 -- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f00680d0 msgr2=0x7fd4f014df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4f4b61640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f00680d0 0x7fd4f014df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4f4b61640 1 -- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f015c3c0 msgr2=0x7fd4f00cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4f4b61640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f015c3c0 0x7fd4f00cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4f4b61640 1 -- 172.21.15.50:0/2649122815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f00cb4b0 con 0x7fd4f015ec40 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4effff640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f00680d0 0x7fd4f014df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4ef7fe640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f015c3c0 0x7fd4f00cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4f4b61640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f015ec40 0x7fd4f01e9aa0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8007ef0 tx=0x7fd4e800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4ecff9640 1 -- 172.21.15.50:0/2649122815 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e801a070 con 0x7fd4f015ec40 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4ecff9640 1 -- 172.21.15.50:0/2649122815 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e8003b90 con 0x7fd4f015ec40 2024-09-11T22:20:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2649122815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f00cb790 con 0x7fd4f015ec40 2024-09-11T22:20:04.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4ecff9640 1 -- 172.21.15.50:0/2649122815 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e800de80 con 0x7fd4f015ec40 2024-09-11T22:20:04.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.303+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2649122815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f00cc250 con 0x7fd4f015ec40 2024-09-11T22:20:04.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.304+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2649122815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f00b5860 con 0x7fd4f015ec40 2024-09-11T22:20:04.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.305+0000 7fd4ecff9640 1 -- 172.21.15.50:0/2649122815 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4e801d070 con 0x7fd4f015ec40 2024-09-11T22:20:04.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.305+0000 7fd4ecff9640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4dc06be30 0x7fd4dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:04.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.306+0000 7fd4ecff9640 1 -- 172.21.15.50:0/2649122815 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fd4e808b100 con 0x7fd4f015ec40 2024-09-11T22:20:04.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.306+0000 7fd4effff640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4dc06be30 0x7fd4dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:04.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.306+0000 7fd4effff640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4dc06be30 0x7fd4dc06e2f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0034000 tx=0x7fd4e002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:04.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.310+0000 7fd4ecff9640 1 -- 172.21.15.50:0/2649122815 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4f00b5860 con 0x7fd4f015ec40 2024-09-11T22:20:04.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.521+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2649122815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4f00b6530 con 0x7fd4f015ec40 2024-09-11T22:20:04.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.522+0000 7fd4ecff9640 1 -- 172.21.15.50:0/2649122815 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7fd4e8010070 con 0x7fd4f015ec40 2024-09-11T22:20:04.523 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:04.523 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:20:04.523 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:20:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.524+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4dc06be30 msgr2=0x7fd4dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.524+0000 7fd4f65c4640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4dc06be30 0x7fd4dc06e2f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0034000 tx=0x7fd4e002e000 comp rx=0 tx=0).stop 2024-09-11T22:20:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.524+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2649122815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f015ec40 msgr2=0x7fd4f01e9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.524+0000 7fd4f65c4640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f015ec40 0x7fd4f01e9aa0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8007ef0 tx=0x7fd4e800d4a0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.524+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2649122815 shutdown_connections 2024-09-11T22:20:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.524+0000 7fd4f65c4640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd4dc06be30 0x7fd4dc06e2f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.524+0000 7fd4f65c4640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4f015ec40 0x7fd4f01e9aa0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.524+0000 7fd4f65c4640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f015c3c0 0x7fd4f00cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.524+0000 7fd4f65c4640 1 --2- 172.21.15.50:0/2649122815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4f00680d0 0x7fd4f014df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.524+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2649122815 >> 172.21.15.50:0/2649122815 conn(0x7fd4f0075060 msgr2=0x7fd4f00d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.524+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2649122815 shutdown_connections 2024-09-11T22:20:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:04.524+0000 7fd4f65c4640 1 -- 172.21.15.50:0/2649122815 wait complete. 2024-09-11T22:20:04.937 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 101, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:19:54.830956+0000', 'modified': '2024-09-11T22:19:57.395118+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8907}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8907': {'gid': 8907, 'name': 'c', 'rank': 0, 'incarnation': 98, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/3729591942', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6833', 'nonce': 3729591942}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 3729591942}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8907, 'qdb_cluster': [8907]} 2024-09-11T22:20:04.938 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:20:04.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T22:20:05.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.049+0000 7fb179e23640 1 Processor -- start 2024-09-11T22:20:05.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.049+0000 7fb179e23640 1 -- start start 2024-09-11T22:20:05.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb179e23640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb17415b400 0x7fb17406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb179e23640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb174072e60 0x7fb17406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb179e23640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb17406df20 0x7fb1740b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb179e23640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb17415b7e0 con 0x7fb17415b400 2024-09-11T22:20:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb179e23640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb17415f140 con 0x7fb174072e60 2024-09-11T22:20:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb179e23640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb17415f420 con 0x7fb17406df20 2024-09-11T22:20:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb1737fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb17415b400 0x7fb17406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb1737fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb17415b400 0x7fb17406d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45340/0 (socket says 172.21.15.50:45340) 2024-09-11T22:20:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb1737fe640 1 -- 172.21.15.50:0/393592156 learned_addr learned my addr 172.21.15.50:0/393592156 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb172ffd640 1 --2- 172.21.15.50:0/393592156 >> v2:172.21.15.77:3300/0 conn(0x7fb174072e60 0x7fb17406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb173fff640 1 --2- 172.21.15.50:0/393592156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb17406df20 0x7fb1740b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb1737fe640 1 -- 172.21.15.50:0/393592156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb17406df20 msgr2=0x7fb1740b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb1737fe640 1 --2- 172.21.15.50:0/393592156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb17406df20 0x7fb1740b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb1737fe640 1 -- 172.21.15.50:0/393592156 >> v2:172.21.15.77:3300/0 conn(0x7fb174072e60 msgr2=0x7fb17406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb1737fe640 1 --2- 172.21.15.50:0/393592156 >> v2:172.21.15.77:3300/0 conn(0x7fb174072e60 0x7fb17406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.050+0000 7fb1737fe640 1 -- 172.21.15.50:0/393592156 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17415f700 con 0x7fb17415b400 2024-09-11T22:20:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.051+0000 7fb1737fe640 1 --2- 172.21.15.50:0/393592156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb17415b400 0x7fb17406d070 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fb1740b56b0 tx=0x7fb16402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43dcfff1b4dbdc84 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.051+0000 7fb1727fc640 1 -- 172.21.15.50:0/393592156 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164037070 con 0x7fb17415b400 2024-09-11T22:20:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.051+0000 7fb1727fc640 1 -- 172.21.15.50:0/393592156 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb164032440 con 0x7fb17415b400 2024-09-11T22:20:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.051+0000 7fb1727fc640 1 -- 172.21.15.50:0/393592156 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164032810 con 0x7fb17415b400 2024-09-11T22:20:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.052+0000 7fb179e23640 1 -- 172.21.15.50:0/393592156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb17415b400 msgr2=0x7fb17406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.052+0000 7fb179e23640 1 --2- 172.21.15.50:0/393592156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb17415b400 0x7fb17406d070 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fb1740b56b0 tx=0x7fb16402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.052+0000 7fb179e23640 1 -- 172.21.15.50:0/393592156 shutdown_connections 2024-09-11T22:20:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.052+0000 7fb179e23640 1 --2- 172.21.15.50:0/393592156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb17406df20 0x7fb1740b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.052+0000 7fb179e23640 1 --2- 172.21.15.50:0/393592156 >> v2:172.21.15.77:3300/0 conn(0x7fb174072e60 0x7fb17406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.052+0000 7fb179e23640 1 --2- 172.21.15.50:0/393592156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb17415b400 0x7fb17406d070 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.052+0000 7fb179e23640 1 -- 172.21.15.50:0/393592156 >> 172.21.15.50:0/393592156 conn(0x7fb1740679c0 msgr2=0x7fb174067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.052+0000 7fb179e23640 1 -- 172.21.15.50:0/393592156 shutdown_connections 2024-09-11T22:20:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.052+0000 7fb179e23640 1 -- 172.21.15.50:0/393592156 wait complete. 2024-09-11T22:20:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.053+0000 7fb179e23640 1 Processor -- start 2024-09-11T22:20:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.053+0000 7fb179e23640 1 -- start start 2024-09-11T22:20:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb179e23640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb17406df20 0x7fb174159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb179e23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb174072e60 0x7fb1740ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb179e23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb17415b400 0x7fb17414bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb179e23640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb1740b4b50 con 0x7fb17415b400 2024-09-11T22:20:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb179e23640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1740cfc50 con 0x7fb174072e60 2024-09-11T22:20:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb179e23640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb1740b4cd0 con 0x7fb17406df20 2024-09-11T22:20:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb173fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb17415b400 0x7fb17414bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb173fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb17415b400 0x7fb17414bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45342/0 (socket says 172.21.15.50:45342) 2024-09-11T22:20:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb173fff640 1 -- 172.21.15.50:0/198024755 learned_addr learned my addr 172.21.15.50:0/198024755 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb173fff640 1 -- 172.21.15.50:0/198024755 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb17406df20 msgr2=0x7fb174159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb173fff640 1 --2- 172.21.15.50:0/198024755 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb17406df20 0x7fb174159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb173fff640 1 -- 172.21.15.50:0/198024755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb174072e60 msgr2=0x7fb1740ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb172ffd640 1 --2- 172.21.15.50:0/198024755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb174072e60 0x7fb1740ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb173fff640 1 --2- 172.21.15.50:0/198024755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb174072e60 0x7fb1740ab610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.054+0000 7fb173fff640 1 -- 172.21.15.50:0/198024755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1740ae9b0 con 0x7fb17415b400 2024-09-11T22:20:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.055+0000 7fb173fff640 1 --2- 172.21.15.50:0/198024755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb17415b400 0x7fb17414bdc0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fb16c007e60 tx=0x7fb16c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.055+0000 7fb16bfff640 1 -- 172.21.15.50:0/198024755 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c014620 con 0x7fb17415b400 2024-09-11T22:20:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.055+0000 7fb16bfff640 1 -- 172.21.15.50:0/198024755 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb16c019070 con 0x7fb17415b400 2024-09-11T22:20:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.055+0000 7fb179e23640 1 -- 172.21.15.50:0/198024755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1740aec50 con 0x7fb17415b400 2024-09-11T22:20:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.055+0000 7fb16bfff640 1 -- 172.21.15.50:0/198024755 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c014a20 con 0x7fb17415b400 2024-09-11T22:20:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.055+0000 7fb179e23640 1 -- 172.21.15.50:0/198024755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1740af210 con 0x7fb17415b400 2024-09-11T22:20:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.057+0000 7fb16bfff640 1 -- 172.21.15.50:0/198024755 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb16c014bc0 con 0x7fb17415b400 2024-09-11T22:20:05.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.057+0000 7fb16bfff640 1 --2- 172.21.15.50:0/198024755 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb15406be30 0x7fb15406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.057+0000 7fb16bfff640 1 -- 172.21.15.50:0/198024755 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fb16c08b710 con 0x7fb17415b400 2024-09-11T22:20:05.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.057+0000 7fb1737fe640 1 --2- 172.21.15.50:0/198024755 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb15406be30 0x7fb15406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.058+0000 7fb1737fe640 1 --2- 172.21.15.50:0/198024755 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb15406be30 0x7fb15406e2f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb164034000 tx=0x7fb16402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.058+0000 7fb17cbbe740 1 Processor -- start 2024-09-11T22:20:05.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.058+0000 7fb17cbbe740 1 -- start start 2024-09-11T22:20:05.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.059+0000 7fb17cbbe740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee32c0 0x562de5f28a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.059+0000 7fb17cbbe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee0a80 0x562de5ee36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.059+0000 7fb17cbbe740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 0x562de5edd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.059+0000 7fb17cbbe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562de5e45520 con 0x562de5ee0a80 2024-09-11T22:20:05.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.059+0000 7fb17cbbe740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562de5ded3e0 con 0x562de5ee4a50 2024-09-11T22:20:05.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.059+0000 7fb17cbbe740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562de5e414e0 con 0x562de5ee32c0 2024-09-11T22:20:05.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.059+0000 7fb172ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee0a80 0x562de5ee36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.059+0000 7fb172ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee0a80 0x562de5ee36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45354/0 (socket says 172.21.15.50:45354) 2024-09-11T22:20:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.059+0000 7fb172ffd640 1 -- 172.21.15.50:0/2921105038 learned_addr learned my addr 172.21.15.50:0/2921105038 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.059+0000 7fb173fff640 1 --2- 172.21.15.50:0/2921105038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 0x562de5edd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.059+0000 7fb1737fe640 1 --2- 172.21.15.50:0/2921105038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee32c0 0x562de5f28a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.059+0000 7fb172ffd640 1 -- 172.21.15.50:0/2921105038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee32c0 msgr2=0x562de5f28a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.059+0000 7fb172ffd640 1 --2- 172.21.15.50:0/2921105038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee32c0 0x562de5f28a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.060+0000 7fb172ffd640 1 -- 172.21.15.50:0/2921105038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 msgr2=0x562de5edd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.060+0000 7fb172ffd640 1 --2- 172.21.15.50:0/2921105038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 0x562de5edd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.060+0000 7fb172ffd640 1 -- 172.21.15.50:0/2921105038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562de5e082f0 con 0x562de5ee0a80 2024-09-11T22:20:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.060+0000 7fb1737fe640 1 --2- 172.21.15.50:0/2921105038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee32c0 0x562de5f28a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.060+0000 7fb172ffd640 1 --2- 172.21.15.50:0/2921105038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee0a80 0x562de5ee36a0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009b90 tx=0x7fb15c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b22e3b0929b7cc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.060+0000 7fb1697fa640 1 -- 172.21.15.50:0/2921105038 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c018070 con 0x562de5ee0a80 2024-09-11T22:20:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.060+0000 7fb1697fa640 1 -- 172.21.15.50:0/2921105038 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15c010e60 con 0x562de5ee0a80 2024-09-11T22:20:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.060+0000 7fb1697fa640 1 -- 172.21.15.50:0/2921105038 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00f040 con 0x562de5ee0a80 2024-09-11T22:20:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.061+0000 7fb17cbbe740 1 -- 172.21.15.50:0/2921105038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee0a80 msgr2=0x562de5ee36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.061+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/2921105038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee0a80 0x562de5ee36a0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009b90 tx=0x7fb15c009190 comp rx=0 tx=0).stop 2024-09-11T22:20:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.061+0000 7fb17cbbe740 1 -- 172.21.15.50:0/2921105038 shutdown_connections 2024-09-11T22:20:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.061+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/2921105038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 0x562de5edd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.061+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/2921105038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee0a80 0x562de5ee36a0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.061+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/2921105038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee32c0 0x562de5f28a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.061+0000 7fb17cbbe740 1 -- 172.21.15.50:0/2921105038 >> 172.21.15.50:0/2921105038 conn(0x562de5edfa80 msgr2=0x562de5f27f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.061+0000 7fb17cbbe740 1 -- 172.21.15.50:0/2921105038 shutdown_connections 2024-09-11T22:20:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.061+0000 7fb17cbbe740 1 -- 172.21.15.50:0/2921105038 wait complete. 2024-09-11T22:20:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.061+0000 7fb17cbbe740 1 -- start start 2024-09-11T22:20:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.061+0000 7fb17cbbe740 1 Processor -- start 2024-09-11T22:20:05.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.062+0000 7fb17cbbe740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee32c0 0x562de5f0bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.062+0000 7fb17cbbe740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 0x562de5f25450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.062+0000 7fb17cbbe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 0x562de5ede040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.062+0000 7fb17cbbe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562de5edef20 con 0x562de5f03540 2024-09-11T22:20:05.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.062+0000 7fb17cbbe740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562de5dce450 con 0x562de5ee4a50 2024-09-11T22:20:05.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.062+0000 7fb17cbbe740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562de5f29290 con 0x562de5ee32c0 2024-09-11T22:20:05.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.062+0000 7fb17cbbe740 10 client.0 _ll_register_callbacks cb 0x562de5b57ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:05.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.062+0000 7fb173fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 0x562de5ede040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.062+0000 7fb173fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 0x562de5ede040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45356/0 (socket says 172.21.15.50:45356) 2024-09-11T22:20:05.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.062+0000 7fb173fff640 1 -- 172.21.15.50:0/1476884380 learned_addr learned my addr 172.21.15.50:0/1476884380 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.062+0000 7fb1737fe640 1 --2- 172.21.15.50:0/1476884380 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee32c0 0x562de5f0bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.062+0000 7fb172ffd640 1 --2- 172.21.15.50:0/1476884380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 0x562de5f25450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.063+0000 7fb173fff640 1 -- 172.21.15.50:0/1476884380 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee32c0 msgr2=0x562de5f0bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.063+0000 7fb173fff640 1 --2- 172.21.15.50:0/1476884380 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee32c0 0x562de5f0bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.063+0000 7fb173fff640 1 -- 172.21.15.50:0/1476884380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 msgr2=0x562de5f25450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.063+0000 7fb173fff640 1 --2- 172.21.15.50:0/1476884380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 0x562de5f25450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.063+0000 7fb173fff640 1 -- 172.21.15.50:0/1476884380 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562de5b582d0 con 0x562de5f03540 2024-09-11T22:20:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.063+0000 7fb173fff640 1 --2- 172.21.15.50:0/1476884380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 0x562de5ede040 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00e9b0 tx=0x7fb16c059b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c0a6e52d182280 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.063+0000 7fb1527fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.063+0000 7fb1527fc640 1 -- 172.21.15.50:0/1476884380 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c088060 con 0x562de5f03540 2024-09-11T22:20:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.063+0000 7fb1527fc640 1 -- 172.21.15.50:0/1476884380 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fb16c0898b0 con 0x562de5f03540 2024-09-11T22:20:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.063+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1476884380 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb15c010e60 con 0x562de5f03540 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.063+0000 7fb1527fc640 1 -- 172.21.15.50:0/1476884380 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7fb16c076050 con 0x562de5f03540 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.063+0000 7fb17cbbe740 10 client.9057 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.063+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1476884380 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x562de5c226b0 con 0x562de5f03540 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.066+0000 7fb1527fc640 1 -- 172.21.15.50:0/1476884380 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15c010e60 con 0x562de5f03540 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.066+0000 7fb1527fc640 1 -- 172.21.15.50:0/1476884380 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7fb16c059c20 con 0x562de5f03540 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.066+0000 7fb17cbbe740 10 client.9057 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.066+0000 7fb17cbbe740 10 client.9057 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.066+0000 7fb17cbbe740 20 client.9057 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.066+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1476884380 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562de5f3b5e0 0x562de5f3b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.066+0000 7fb17cbbe740 4 client.9057 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.066+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1476884380 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562de5e52c50 con 0x562de5f3b5e0 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.066+0000 7fb1737fe640 1 --2- 172.21.15.50:0/1476884380 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562de5f3b5e0 0x562de5f3b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.066+0000 7fb1737fe640 1 --2- 172.21.15.50:0/1476884380 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562de5f3b5e0 0x562de5f3b9c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=272e4b92840e7b56 server_cookie=c218062e661eaae0 in_seq=0 out_seq=0 2024-09-11T22:20:05.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.066+0000 7fb1527fc640 10 client.9057 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb1527fc640 1 -- 172.21.15.50:0/1476884380 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562de5e52c50 con 0x562de5f3b5e0 2024-09-11T22:20:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb1527fc640 10 client.9057 handle_command_reply: tid=0 2024-09-11T22:20:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb17cbbe740 1 client.9057 shutdown 2024-09-11T22:20:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1476884380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 msgr2=0x562de5ede040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1476884380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 0x562de5ede040 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00e9b0 tx=0x7fb16c059b00 comp rx=0 tx=0).stop 2024-09-11T22:20:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1476884380 shutdown_connections 2024-09-11T22:20:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1476884380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 0x562de5ede040 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1476884380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 0x562de5f25450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1476884380 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562de5f3b5e0 0x562de5f3b9c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1476884380 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee32c0 0x562de5f0bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb1527fc640 0 client.9057 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1476884380 >> 172.21.15.50:0/1476884380 conn(0x562de5ee0a80 msgr2=0x562de5f2b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1476884380 shutdown_connections 2024-09-11T22:20:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.067+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1476884380 wait complete. 2024-09-11T22:20:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.068+0000 7fb17cbbe740 20 client.9057 trim_cache size 0 max 16384 2024-09-11T22:20:05.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.086+0000 7fb17cbbe740 1 Processor -- start 2024-09-11T22:20:05.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.086+0000 7fb17cbbe740 1 -- start start 2024-09-11T22:20:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.086+0000 7fb17cbbe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee32c0 0x562de5f3a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.086+0000 7fb17cbbe740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 0x562de5f39f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.086+0000 7fb17cbbe740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5f03540 0x562de5ede210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.086+0000 7fb17cbbe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741589b0 con 0x562de5ee32c0 2024-09-11T22:20:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.086+0000 7fb17cbbe740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1740ab130 con 0x562de5ee4a50 2024-09-11T22:20:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.086+0000 7fb17cbbe740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb174158360 con 0x562de5f03540 2024-09-11T22:20:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb1737fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee32c0 0x562de5f3a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb1737fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee32c0 0x562de5f3a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45366/0 (socket says 172.21.15.50:45366) 2024-09-11T22:20:05.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb1737fe640 1 -- 172.21.15.50:0/1133647870 learned_addr learned my addr 172.21.15.50:0/1133647870 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:05.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb173fff640 1 --2- 172.21.15.50:0/1133647870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5f03540 0x562de5ede210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb172ffd640 1 --2- 172.21.15.50:0/1133647870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 0x562de5f39f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb1737fe640 1 -- 172.21.15.50:0/1133647870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5f03540 msgr2=0x562de5ede210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb1737fe640 1 --2- 172.21.15.50:0/1133647870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5f03540 0x562de5ede210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb1737fe640 1 -- 172.21.15.50:0/1133647870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 msgr2=0x562de5f39f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb1737fe640 1 --2- 172.21.15.50:0/1133647870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 0x562de5f39f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb1737fe640 1 -- 172.21.15.50:0/1133647870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562de5f0aca0 con 0x562de5ee32c0 2024-09-11T22:20:05.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb172ffd640 1 --2- 172.21.15.50:0/1133647870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 0x562de5f39f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb1737fe640 1 --2- 172.21.15.50:0/1133647870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee32c0 0x562de5f3a5e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fb164006da0 tx=0x7fb164008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c321e27c3eb4447d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb168ff9640 1 -- 172.21.15.50:0/1133647870 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164056070 con 0x562de5ee32c0 2024-09-11T22:20:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb168ff9640 1 -- 172.21.15.50:0/1133647870 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1640043c0 con 0x562de5ee32c0 2024-09-11T22:20:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.087+0000 7fb168ff9640 1 -- 172.21.15.50:0/1133647870 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164037040 con 0x562de5ee32c0 2024-09-11T22:20:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.088+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1133647870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee32c0 msgr2=0x562de5f3a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.088+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1133647870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee32c0 0x562de5f3a5e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fb164006da0 tx=0x7fb164008030 comp rx=0 tx=0).stop 2024-09-11T22:20:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.088+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1133647870 shutdown_connections 2024-09-11T22:20:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.088+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1133647870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5f03540 0x562de5ede210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.088+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1133647870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee4a50 0x562de5f39f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.088+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1133647870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5ee32c0 0x562de5f3a5e0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.088+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1133647870 >> 172.21.15.50:0/1133647870 conn(0x562de5ee0a80 msgr2=0x562de5ed9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.088+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1133647870 shutdown_connections 2024-09-11T22:20:05.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.088+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1133647870 wait complete. 2024-09-11T22:20:05.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.089+0000 7fb17cbbe740 1 -- start start 2024-09-11T22:20:05.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.089+0000 7fb17cbbe740 1 Processor -- start 2024-09-11T22:20:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.089+0000 7fb17cbbe740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee32c0 0x562de5f37210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.089+0000 7fb17cbbe740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee4a50 0x562de5ef77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.089+0000 7fb17cbbe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 0x562de5f08580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.089+0000 7fb17cbbe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562de5f259e0 con 0x562de5f03540 2024-09-11T22:20:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.089+0000 7fb17cbbe740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562de5f0c080 con 0x562de5ee32c0 2024-09-11T22:20:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.089+0000 7fb17cbbe740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562de5f05b40 con 0x562de5ee4a50 2024-09-11T22:20:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.089+0000 7fb17cbbe740 10 client.0 _ll_register_callbacks cb 0x7fb16c05a100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb173fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 0x562de5f08580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb173fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 0x562de5f08580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45382/0 (socket says 172.21.15.50:45382) 2024-09-11T22:20:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb173fff640 1 -- 172.21.15.50:0/1049236107 learned_addr learned my addr 172.21.15.50:0/1049236107 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb1737fe640 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee32c0 0x562de5f37210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb172ffd640 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee4a50 0x562de5ef77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb173fff640 1 -- 172.21.15.50:0/1049236107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee4a50 msgr2=0x562de5ef77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb173fff640 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee4a50 0x562de5ef77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb173fff640 1 -- 172.21.15.50:0/1049236107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee32c0 msgr2=0x562de5f37210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb173fff640 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee32c0 0x562de5f37210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb173fff640 1 -- 172.21.15.50:0/1049236107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562de5ef7020 con 0x562de5f03540 2024-09-11T22:20:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb172ffd640 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee4a50 0x562de5ef77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb173fff640 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 0x562de5f08580 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0596c0 tx=0x7fb16c020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef775ec9ce068c29 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb1527fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb1527fc640 1 -- 172.21.15.50:0/1049236107 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c059320 con 0x562de5f03540 2024-09-11T22:20:05.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb1527fc640 1 -- 172.21.15.50:0/1049236107 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fb16c062310 con 0x562de5f03540 2024-09-11T22:20:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1049236107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1640043c0 con 0x562de5f03540 2024-09-11T22:20:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb1527fc640 1 -- 172.21.15.50:0/1049236107 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7fb16c06a050 con 0x562de5f03540 2024-09-11T22:20:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb17cbbe740 10 client.9063 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1049236107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x562de5f36f20 con 0x562de5f03540 2024-09-11T22:20:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb1527fc640 1 -- 172.21.15.50:0/1049236107 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1640043c0 con 0x562de5f03540 2024-09-11T22:20:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb1527fc640 1 -- 172.21.15.50:0/1049236107 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7fb16c06d020 con 0x562de5f03540 2024-09-11T22:20:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb17cbbe740 10 client.9063 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb17cbbe740 10 client.9063 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:20:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb17cbbe740 20 client.9063 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.090+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562de5fa6440 0x562de5f39f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 4 client.9063 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:20:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1049236107 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "status"}) -- 0x562de5f056b0 con 0x562de5fa6440 2024-09-11T22:20:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb1737fe640 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562de5fa6440 0x562de5f39f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb1737fe640 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562de5fa6440 0x562de5f39f10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=631aab6ecb70c757 server_cookie=8ba50e4fd40b6de9 in_seq=0 out_seq=0 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb1527fc640 10 client.9063 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb1527fc640 1 -- 172.21.15.50:0/1049236107 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x562de5f056b0 con 0x562de5fa6440 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb1527fc640 10 client.9063 handle_command_reply: tid=0 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 1 client.9063 shutdown 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1049236107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 msgr2=0x562de5f08580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 0x562de5f08580 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0596c0 tx=0x7fb16c020070 comp rx=0 tx=0).stop 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1049236107 shutdown_connections 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562de5fa6440 0x562de5f39f10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562de5ee4a50 0x562de5ef77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562de5f03540 0x562de5f08580 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb1527fc640 0 client.9063 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 1 --2- 172.21.15.50:0/1049236107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562de5ee32c0 0x562de5f37210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1049236107 >> 172.21.15.50:0/1049236107 conn(0x562de5ee0a80 msgr2=0x562de5f29b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1049236107 shutdown_connections 2024-09-11T22:20:05.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 1 -- 172.21.15.50:0/1049236107 wait complete. 2024-09-11T22:20:05.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.091+0000 7fb17cbbe740 20 client.9063 trim_cache size 0 max 16384 2024-09-11T22:20:05.100 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:20:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:20:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:20:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 8907, 2024-09-11T22:20:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:20:05.100 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:20:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:20:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 9.6174352299999999, 2024-09-11T22:20:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 101, 2024-09-11T22:20:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 144, 2024-09-11T22:20:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 144, 2024-09-11T22:20:05.101 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 14.957000482 2024-09-11T22:20:05.101 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:20:05.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.092+0000 7fb179e23640 1 -- 172.21.15.50:0/198024755 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb15406be30 msgr2=0x7fb15406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.092+0000 7fb179e23640 1 --2- 172.21.15.50:0/198024755 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb15406be30 0x7fb15406e2f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb164034000 tx=0x7fb16402c000 comp rx=0 tx=0).stop 2024-09-11T22:20:05.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.092+0000 7fb179e23640 1 -- 172.21.15.50:0/198024755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb17415b400 msgr2=0x7fb17414bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.092+0000 7fb179e23640 1 --2- 172.21.15.50:0/198024755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb17415b400 0x7fb17414bdc0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fb16c007e60 tx=0x7fb16c00e4b0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.092+0000 7fb179e23640 1 -- 172.21.15.50:0/198024755 shutdown_connections 2024-09-11T22:20:05.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.092+0000 7fb179e23640 1 --2- 172.21.15.50:0/198024755 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb15406be30 0x7fb15406e2f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.092+0000 7fb179e23640 1 --2- 172.21.15.50:0/198024755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb17415b400 0x7fb17414bdc0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.092+0000 7fb179e23640 1 --2- 172.21.15.50:0/198024755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb174072e60 0x7fb1740ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.092+0000 7fb179e23640 1 --2- 172.21.15.50:0/198024755 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb17406df20 0x7fb174159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.092+0000 7fb179e23640 1 -- 172.21.15.50:0/198024755 >> 172.21.15.50:0/198024755 conn(0x7fb1740679c0 msgr2=0x7fb17406e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.092+0000 7fb179e23640 1 -- 172.21.15.50:0/198024755 shutdown_connections 2024-09-11T22:20:05.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.092+0000 7fb179e23640 1 -- 172.21.15.50:0/198024755 wait complete. 2024-09-11T22:20:05.105 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:20:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.207+0000 7fb952e2e640 1 Processor -- start 2024-09-11T22:20:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.207+0000 7fb952e2e640 1 -- start start 2024-09-11T22:20:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.207+0000 7fb952e2e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb94c0cdd50 0x7fb94c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.207+0000 7fb952e2e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb94c0ce5f0 con 0x7fb94c0cf580 2024-09-11T22:20:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.207+0000 7fb952e2e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb94c0ce310 con 0x7fb94c15e840 2024-09-11T22:20:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.207+0000 7fb952e2e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb94c06c240 con 0x7fb94c0cdd50 2024-09-11T22:20:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb94c0cf580 0x7fb94c06c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50400/0 (socket says 172.21.15.50:50400) 2024-09-11T22:20:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94bfff640 1 -- 172.21.15.50:0/935186099 learned_addr learned my addr 172.21.15.50:0/935186099 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb9513cb640 1 --2- 172.21.15.50:0/935186099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb94c0cdd50 0x7fb94c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3849879415 0 0) 0x7fb94c0ce5f0 con 0x7fb94c0cf580 2024-09-11T22:20:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb93c003520 con 0x7fb94c0cf580 2024-09-11T22:20:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579186252 0 0) 0x7fb94c0ce310 con 0x7fb94c15e840 2024-09-11T22:20:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb94c0ce5f0 con 0x7fb94c15e840 2024-09-11T22:20:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3414184306 0 0) 0x7fb93c003520 con 0x7fb94c0cf580 2024-09-11T22:20:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb94c0cdd50 msgr2=0x7fb94c0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 --2- 172.21.15.50:0/935186099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb94c0cdd50 0x7fb94c0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 >> v1:172.21.15.77:6789/0 conn(0x7fb94c15e840 legacy=0x7fb94c0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94c06bbf0 con 0x7fb94c0cf580 2024-09-11T22:20:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fb938001670 con 0x7fb94c0cf580 2024-09-11T22:20:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb9513cb640 1 --2- 172.21.15.50:0/935186099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb94c0cdd50 0x7fb94c0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 >> v1:172.21.15.50:6789/0 conn(0x7fb94c0cf580 legacy=0x7fb94c06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 --2- 172.21.15.50:0/935186099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb93c003b70 0x7fb93c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 --2- 172.21.15.50:0/935186099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb94c0cdd50 0x7fb93c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 --2- 172.21.15.50:0/935186099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c004d40 0x7fb93c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c06c240 con 0x7fb93c004d40 2024-09-11T22:20:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c00ba70 con 0x7fb93c003b70 2024-09-11T22:20:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb93c00bc20 con 0x7fb94c0cdd50 2024-09-11T22:20:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb9513cb640 1 --2- 172.21.15.50:0/935186099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c004d40 0x7fb93c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.208+0000 7fb950bca640 1 --2- 172.21.15.50:0/935186099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb93c003b70 0x7fb93c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.209+0000 7fb94bfff640 1 --2- 172.21.15.50:0/935186099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb94c0cdd50 0x7fb93c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.209+0000 7fb9513cb640 1 -- 172.21.15.50:0/935186099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb94c0cdd50 msgr2=0x7fb93c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.209+0000 7fb9513cb640 1 --2- 172.21.15.50:0/935186099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb94c0cdd50 0x7fb93c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.209+0000 7fb9513cb640 1 -- 172.21.15.50:0/935186099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb93c003b70 msgr2=0x7fb93c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.209+0000 7fb9513cb640 1 --2- 172.21.15.50:0/935186099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb93c003b70 0x7fb93c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.209+0000 7fb9513cb640 1 -- 172.21.15.50:0/935186099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c003520 con 0x7fb93c004d40 2024-09-11T22:20:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.209+0000 7fb9513cb640 1 --2- 172.21.15.50:0/935186099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c004d40 0x7fb93c0051c0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fb94400e350 tx=0x7fb93c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74aaebef302581a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.210+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944033070 con 0x7fb93c004d40 2024-09-11T22:20:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.210+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94402f660 con 0x7fb93c004d40 2024-09-11T22:20:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.210+0000 7fb94b7fe640 1 -- 172.21.15.50:0/935186099 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944009de0 con 0x7fb93c004d40 2024-09-11T22:20:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.210+0000 7fb952e2e640 1 -- 172.21.15.50:0/935186099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c004d40 msgr2=0x7fb93c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.210+0000 7fb952e2e640 1 --2- 172.21.15.50:0/935186099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c004d40 0x7fb93c0051c0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fb94400e350 tx=0x7fb93c005830 comp rx=0 tx=0).stop 2024-09-11T22:20:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.210+0000 7fb9513cb640 1 -- 172.21.15.50:0/935186099 reap_dead start 2024-09-11T22:20:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.210+0000 7fb952e2e640 1 -- 172.21.15.50:0/935186099 shutdown_connections 2024-09-11T22:20:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.210+0000 7fb952e2e640 1 -- 172.21.15.50:0/935186099 >> 172.21.15.50:0/935186099 conn(0x7fb94c0b4150 msgr2=0x7fb94c0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.210+0000 7fb952e2e640 1 -- 172.21.15.50:0/935186099 shutdown_connections 2024-09-11T22:20:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.210+0000 7fb952e2e640 1 -- 172.21.15.50:0/935186099 wait complete. 2024-09-11T22:20:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.211+0000 7fb952e2e640 1 Processor -- start 2024-09-11T22:20:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.212+0000 7fb952e2e640 1 -- start start 2024-09-11T22:20:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.212+0000 7fb952e2e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb93c004d40 0x7fb94c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.212+0000 7fb952e2e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb94c15cd50 0x7fb94c09d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.212+0000 7fb952e2e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c0c7930 0x7fb94c0b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.212+0000 7fb952e2e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c15ec20 con 0x7fb94c15cd50 2024-09-11T22:20:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.212+0000 7fb952e2e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c0d0470 con 0x7fb94c0c7930 2024-09-11T22:20:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.212+0000 7fb952e2e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb94c15eda0 con 0x7fb93c004d40 2024-09-11T22:20:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb94bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb94c15cd50 0x7fb94c09d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb94bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb94c15cd50 0x7fb94c09d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45408/0 (socket says 172.21.15.50:45408) 2024-09-11T22:20:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb94bfff640 1 -- 172.21.15.50:0/292059067 learned_addr learned my addr 172.21.15.50:0/292059067 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb9513cb640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c0c7930 0x7fb94c0b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb950bca640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb93c004d40 0x7fb94c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb94bfff640 1 -- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb93c004d40 msgr2=0x7fb94c15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb94bfff640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb93c004d40 0x7fb94c15d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb94bfff640 1 -- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c0c7930 msgr2=0x7fb94c0b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb94bfff640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c0c7930 0x7fb94c0b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb94bfff640 1 -- 172.21.15.50:0/292059067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94c15d1d0 con 0x7fb94c15cd50 2024-09-11T22:20:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb94bfff640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb94c15cd50 0x7fb94c09d480 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fb938007310 tx=0x7fb938007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb9497fa640 1 -- 172.21.15.50:0/292059067 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93800f8e0 con 0x7fb94c15cd50 2024-09-11T22:20:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb9497fa640 1 -- 172.21.15.50:0/292059067 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb938018070 con 0x7fb94c15cd50 2024-09-11T22:20:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb9497fa640 1 -- 172.21.15.50:0/292059067 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93800fd00 con 0x7fb94c15cd50 2024-09-11T22:20:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb952e2e640 1 -- 172.21.15.50:0/292059067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb94c0c72d0 con 0x7fb94c15cd50 2024-09-11T22:20:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.213+0000 7fb952e2e640 1 -- 172.21.15.50:0/292059067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb94c09f110 con 0x7fb94c15cd50 2024-09-11T22:20:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.214+0000 7fb952e2e640 1 -- 172.21.15.50:0/292059067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb94c0b4c70 con 0x7fb94c15cd50 2024-09-11T22:20:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.215+0000 7fb9497fa640 1 -- 172.21.15.50:0/292059067 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb93801d460 con 0x7fb94c15cd50 2024-09-11T22:20:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.215+0000 7fb9497fa640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb93006be30 0x7fb93006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.216+0000 7fb9497fa640 1 -- 172.21.15.50:0/292059067 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fb93808acb0 con 0x7fb94c15cd50 2024-09-11T22:20:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.216+0000 7fb950bca640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb93006be30 0x7fb93006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.216+0000 7fb950bca640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb93006be30 0x7fb93006e2f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb9400018d0 tx=0x7fb940009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.220+0000 7fb9497fa640 1 -- 172.21.15.50:0/292059067 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb938059650 con 0x7fb94c15cd50 2024-09-11T22:20:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.432+0000 7fb952e2e640 1 -- 172.21.15.50:0/292059067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb94c06d880 con 0x7fb94c15cd50 2024-09-11T22:20:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.432+0000 7fb9497fa640 1 -- 172.21.15.50:0/292059067 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v101) ==== 53+0+73 (secure 0 0 0) 0x7fb938058f50 con 0x7fb94c15cd50 2024-09-11T22:20:05.433 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:20:05.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.434+0000 7fb952e2e640 1 -- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb93006be30 msgr2=0x7fb93006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.434+0000 7fb952e2e640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb93006be30 0x7fb93006e2f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb9400018d0 tx=0x7fb940009040 comp rx=0 tx=0).stop 2024-09-11T22:20:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.434+0000 7fb952e2e640 1 -- 172.21.15.50:0/292059067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb94c15cd50 msgr2=0x7fb94c09d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.434+0000 7fb952e2e640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb94c15cd50 0x7fb94c09d480 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fb938007310 tx=0x7fb938007710 comp rx=0 tx=0).stop 2024-09-11T22:20:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.434+0000 7fb952e2e640 1 -- 172.21.15.50:0/292059067 shutdown_connections 2024-09-11T22:20:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.435+0000 7fb952e2e640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb93006be30 0x7fb93006e2f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.435+0000 7fb952e2e640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c0c7930 0x7fb94c0b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.435+0000 7fb952e2e640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb94c15cd50 0x7fb94c09d480 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.435+0000 7fb952e2e640 1 --2- 172.21.15.50:0/292059067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb93c004d40 0x7fb94c15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.435+0000 7fb952e2e640 1 -- 172.21.15.50:0/292059067 >> 172.21.15.50:0/292059067 conn(0x7fb94c0b4150 msgr2=0x7fb94c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.435+0000 7fb952e2e640 1 -- 172.21.15.50:0/292059067 shutdown_connections 2024-09-11T22:20:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05.435+0000 7fb952e2e640 1 -- 172.21.15.50:0/292059067 wait complete. 2024-09-11T22:20:05.446 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:20:05.446 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:20:05.446 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:20:05.446 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:20:05.447 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:20:05.447 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:20:05.447 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:20:05.447 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:20:05.447 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:20:05.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:05.447 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:20:05.464 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:20:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:20:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:20:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:20:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:05.464 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:20:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:05.464 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42190sec preferred_lft 42190sec 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:20:05.465 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:20:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:20:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:20:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:05.466 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:20:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:20:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:20:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:05.466 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:20:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:20:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:20:05.466 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:05.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:05.467 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:20:05.528 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:20:05.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:05.530 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:20:05.587 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:20:05.587 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:20:05.587 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:20:05.587 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:20:05.587 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:20:05.588 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:20:05.588 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:05.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:20:05.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:20:05.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:20:05.588 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:05.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:20:05.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:05.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:05.716 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:20:05.732 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:20:05.732 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:20:05.733 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:20:05.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:05.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:20:05.798 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:20:05.798 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:20:05.854 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:20:05.854 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:20:05.855 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:20:05.910 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:20:05.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:05.910 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:20:05.995 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:20:05.995 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:20:06.003 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:20:06.003 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:20:06.003 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:20:06.003 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:20:06.003 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:20:06.005 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:20:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:20:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:20:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:20:06.005 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:20:06.006 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:20:06.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:06.006 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:20:06.037 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:20:06.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:06.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:06.139 INFO:teuthology.orchestra.run.smithi050.stdout:client7346 2024-09-11T22:20:06.140 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:20:06.140 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:20:06.156 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:06.156 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:06.156 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.0 2024-09-11T22:20:06.156 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:06.157 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:06.157 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:06.157 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:06.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.266 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100463 s, 104 MB/s 2024-09-11T22:20:06.275 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.275 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.275 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793213 s, 132 MB/s 2024-09-11T22:20:06.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.285 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871946 s, 120 MB/s 2024-09-11T22:20:06.294 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.294 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.294 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712775 s, 147 MB/s 2024-09-11T22:20:06.303 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.304 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783078 s, 134 MB/s 2024-09-11T22:20:06.313 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.313 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.313 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776846 s, 135 MB/s 2024-09-11T22:20:06.322 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.322 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.322 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725703 s, 144 MB/s 2024-09-11T22:20:06.331 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.331 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.331 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716091 s, 146 MB/s 2024-09-11T22:20:06.339 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.339 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.340 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717729 s, 146 MB/s 2024-09-11T22:20:06.348 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.348 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.348 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722396 s, 145 MB/s 2024-09-11T22:20:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767915 s, 137 MB/s 2024-09-11T22:20:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688787 s, 152 MB/s 2024-09-11T22:20:06.375 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.375 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.375 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736502 s, 142 MB/s 2024-09-11T22:20:06.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.383 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660807 s, 159 MB/s 2024-09-11T22:20:06.392 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.392 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.392 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073707 s, 142 MB/s 2024-09-11T22:20:06.401 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.402 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.402 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007716 s, 136 MB/s 2024-09-11T22:20:06.411 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.411 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.411 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00806805 s, 130 MB/s 2024-09-11T22:20:06.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.420 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656072 s, 160 MB/s 2024-09-11T22:20:06.429 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.429 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.429 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076884 s, 136 MB/s 2024-09-11T22:20:06.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.438 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.438 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709049 s, 148 MB/s 2024-09-11T22:20:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864115 s, 121 MB/s 2024-09-11T22:20:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006641 s, 158 MB/s 2024-09-11T22:20:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671242 s, 156 MB/s 2024-09-11T22:20:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.475 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079963 s, 131 MB/s 2024-09-11T22:20:06.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.485 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789609 s, 133 MB/s 2024-09-11T22:20:06.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.494 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753439 s, 139 MB/s 2024-09-11T22:20:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071392 s, 147 MB/s 2024-09-11T22:20:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698532 s, 150 MB/s 2024-09-11T22:20:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.521 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.521 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672818 s, 156 MB/s 2024-09-11T22:20:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733521 s, 143 MB/s 2024-09-11T22:20:06.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.539 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644824 s, 163 MB/s 2024-09-11T22:20:06.549 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.549 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.549 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007697 s, 136 MB/s 2024-09-11T22:20:06.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:06.555 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:06.556 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:06.556 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.1 2024-09-11T22:20:06.556 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:06.556 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:06.556 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:06.556 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:06.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.617 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714175 s, 147 MB/s 2024-09-11T22:20:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.626 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705539 s, 149 MB/s 2024-09-11T22:20:06.635 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.635 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.636 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772189 s, 136 MB/s 2024-09-11T22:20:06.645 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.645 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.645 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772698 s, 136 MB/s 2024-09-11T22:20:06.654 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.654 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.654 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707006 s, 148 MB/s 2024-09-11T22:20:06.663 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.663 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.663 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077682 s, 135 MB/s 2024-09-11T22:20:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.672 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710189 s, 148 MB/s 2024-09-11T22:20:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817404 s, 128 MB/s 2024-09-11T22:20:06.691 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.691 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.691 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670901 s, 156 MB/s 2024-09-11T22:20:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772557 s, 136 MB/s 2024-09-11T22:20:06.709 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.709 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.709 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739757 s, 142 MB/s 2024-09-11T22:20:06.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.718 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724943 s, 145 MB/s 2024-09-11T22:20:06.727 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.727 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.727 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675329 s, 155 MB/s 2024-09-11T22:20:06.736 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.736 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.736 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076914 s, 136 MB/s 2024-09-11T22:20:06.746 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.746 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.746 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762704 s, 137 MB/s 2024-09-11T22:20:06.755 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.755 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.755 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772355 s, 136 MB/s 2024-09-11T22:20:06.764 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.764 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.765 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722756 s, 145 MB/s 2024-09-11T22:20:06.773 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.773 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.773 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694781 s, 151 MB/s 2024-09-11T22:20:06.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.783 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072665 s, 144 MB/s 2024-09-11T22:20:06.791 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.791 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.792 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650576 s, 161 MB/s 2024-09-11T22:20:06.800 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.801 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.801 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068737 s, 153 MB/s 2024-09-11T22:20:06.809 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.809 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.809 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065366 s, 160 MB/s 2024-09-11T22:20:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.818 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063377 s, 165 MB/s 2024-09-11T22:20:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733563 s, 143 MB/s 2024-09-11T22:20:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753263 s, 139 MB/s 2024-09-11T22:20:06.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.846 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709922 s, 148 MB/s 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907852 s, 116 MB/s 2024-09-11T22:20:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.867 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076312 s, 137 MB/s 2024-09-11T22:20:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668896 s, 157 MB/s 2024-09-11T22:20:06.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.884 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729069 s, 144 MB/s 2024-09-11T22:20:06.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.893 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749199 s, 140 MB/s 2024-09-11T22:20:06.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.902 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065106 s, 161 MB/s 2024-09-11T22:20:06.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:06.909 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:06.909 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:06.909 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.2 2024-09-11T22:20:06.909 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:06.909 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:06.909 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:06.909 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:06.969 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.969 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.969 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732561 s, 143 MB/s 2024-09-11T22:20:06.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.979 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749774 s, 140 MB/s 2024-09-11T22:20:06.989 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.989 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.989 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868488 s, 121 MB/s 2024-09-11T22:20:06.999 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:06.999 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:06.999 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779159 s, 135 MB/s 2024-09-11T22:20:07.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.009 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00819068 s, 128 MB/s 2024-09-11T22:20:07.018 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.018 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.018 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756151 s, 139 MB/s 2024-09-11T22:20:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664944 s, 158 MB/s 2024-09-11T22:20:07.036 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.037 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771092 s, 136 MB/s 2024-09-11T22:20:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640324 s, 164 MB/s 2024-09-11T22:20:07.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.055 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746362 s, 140 MB/s 2024-09-11T22:20:07.064 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.064 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.064 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073037 s, 144 MB/s 2024-09-11T22:20:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103876 s, 101 MB/s 2024-09-11T22:20:07.085 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.085 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.085 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697857 s, 150 MB/s 2024-09-11T22:20:07.095 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.095 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.095 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782314 s, 134 MB/s 2024-09-11T22:20:07.104 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.104 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.104 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688948 s, 152 MB/s 2024-09-11T22:20:07.114 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.114 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.114 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00805159 s, 130 MB/s 2024-09-11T22:20:07.122 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.122 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.122 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629197 s, 167 MB/s 2024-09-11T22:20:07.130 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.130 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.130 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626881 s, 167 MB/s 2024-09-11T22:20:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730807 s, 143 MB/s 2024-09-11T22:20:07.147 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.147 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.147 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652093 s, 161 MB/s 2024-09-11T22:20:07.156 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.156 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.156 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736724 s, 142 MB/s 2024-09-11T22:20:07.165 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.165 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.165 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749737 s, 140 MB/s 2024-09-11T22:20:07.173 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.173 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.174 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637673 s, 164 MB/s 2024-09-11T22:20:07.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.183 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731412 s, 143 MB/s 2024-09-11T22:20:07.192 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.192 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.192 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797614 s, 131 MB/s 2024-09-11T22:20:07.202 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.202 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.202 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758603 s, 138 MB/s 2024-09-11T22:20:07.210 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.210 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.210 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645172 s, 163 MB/s 2024-09-11T22:20:07.219 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.219 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.219 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729977 s, 144 MB/s 2024-09-11T22:20:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848397 s, 124 MB/s 2024-09-11T22:20:07.237 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.237 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.237 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615164 s, 170 MB/s 2024-09-11T22:20:07.246 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781232 s, 134 MB/s 2024-09-11T22:20:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649998 s, 161 MB/s 2024-09-11T22:20:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:07.262 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:07.262 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:07.262 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.3 2024-09-11T22:20:07.262 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:07.262 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:07.262 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:07.262 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:07.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:07.323 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.323 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.323 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074414 s, 141 MB/s 2024-09-11T22:20:07.332 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.333 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.333 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736074 s, 142 MB/s 2024-09-11T22:20:07.343 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.343 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.343 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858311 s, 122 MB/s 2024-09-11T22:20:07.352 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.352 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.352 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746682 s, 140 MB/s 2024-09-11T22:20:07.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.362 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838534 s, 125 MB/s 2024-09-11T22:20:07.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.372 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00829452 s, 126 MB/s 2024-09-11T22:20:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654155 s, 160 MB/s 2024-09-11T22:20:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700445 s, 150 MB/s 2024-09-11T22:20:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074021 s, 142 MB/s 2024-09-11T22:20:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072958 s, 144 MB/s 2024-09-11T22:20:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681655 s, 154 MB/s 2024-09-11T22:20:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644093 s, 163 MB/s 2024-09-11T22:20:07.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.432 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714575 s, 147 MB/s 2024-09-11T22:20:07.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.441 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640992 s, 164 MB/s 2024-09-11T22:20:07.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.450 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076152 s, 138 MB/s 2024-09-11T22:20:07.459 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.459 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.459 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744959 s, 141 MB/s 2024-09-11T22:20:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721011 s, 145 MB/s 2024-09-11T22:20:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646071 s, 162 MB/s 2024-09-11T22:20:07.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.485 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755792 s, 139 MB/s 2024-09-11T22:20:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747411 s, 140 MB/s 2024-09-11T22:20:07.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.503 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740685 s, 142 MB/s 2024-09-11T22:20:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706333 s, 148 MB/s 2024-09-11T22:20:07.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.521 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065099 s, 161 MB/s 2024-09-11T22:20:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738044 s, 142 MB/s 2024-09-11T22:20:07.538 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.538 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.538 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705621 s, 149 MB/s 2024-09-11T22:20:07.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858756 s, 122 MB/s 2024-09-11T22:20:07.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.558 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780203 s, 134 MB/s 2024-09-11T22:20:07.566 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.566 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.566 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650244 s, 161 MB/s 2024-09-11T22:20:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752957 s, 139 MB/s 2024-09-11T22:20:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779147 s, 135 MB/s 2024-09-11T22:20:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635722 s, 165 MB/s 2024-09-11T22:20:07.602 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.602 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.602 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753536 s, 139 MB/s 2024-09-11T22:20:07.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:07.609 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:07.609 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:07.609 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.4 2024-09-11T22:20:07.609 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:07.610 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:07.610 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:07.610 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722274 s, 145 MB/s 2024-09-11T22:20:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643147 s, 163 MB/s 2024-09-11T22:20:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.687 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730358 s, 144 MB/s 2024-09-11T22:20:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684541 s, 153 MB/s 2024-09-11T22:20:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864791 s, 121 MB/s 2024-09-11T22:20:07.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.714 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662362 s, 158 MB/s 2024-09-11T22:20:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643341 s, 163 MB/s 2024-09-11T22:20:07.731 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.731 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.731 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735541 s, 143 MB/s 2024-09-11T22:20:07.739 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.739 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.739 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686997 s, 153 MB/s 2024-09-11T22:20:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729099 s, 144 MB/s 2024-09-11T22:20:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733186 s, 143 MB/s 2024-09-11T22:20:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748112 s, 140 MB/s 2024-09-11T22:20:07.775 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.776 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738153 s, 142 MB/s 2024-09-11T22:20:07.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.785 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073865 s, 142 MB/s 2024-09-11T22:20:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.794 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722092 s, 145 MB/s 2024-09-11T22:20:07.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.803 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728523 s, 144 MB/s 2024-09-11T22:20:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758961 s, 138 MB/s 2024-09-11T22:20:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713007 s, 147 MB/s 2024-09-11T22:20:07.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701018 s, 150 MB/s 2024-09-11T22:20:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750147 s, 140 MB/s 2024-09-11T22:20:07.847 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.847 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.847 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733838 s, 143 MB/s 2024-09-11T22:20:07.856 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.857 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.857 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727414 s, 144 MB/s 2024-09-11T22:20:07.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.864 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618352 s, 170 MB/s 2024-09-11T22:20:07.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.975 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.975 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853033 s, 123 MB/s 2024-09-11T22:20:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747816 s, 140 MB/s 2024-09-11T22:20:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698854 s, 150 MB/s 2024-09-11T22:20:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718397 s, 146 MB/s 2024-09-11T22:20:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666095 s, 157 MB/s 2024-09-11T22:20:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756488 s, 139 MB/s 2024-09-11T22:20:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695178 s, 151 MB/s 2024-09-11T22:20:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659967 s, 159 MB/s 2024-09-11T22:20:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735239 s, 143 MB/s 2024-09-11T22:20:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:07.979 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:07.980 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:07.980 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.5 2024-09-11T22:20:07.980 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:07.980 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:07.980 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:07.980 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654729 s, 160 MB/s 2024-09-11T22:20:08.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.048 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064609 s, 162 MB/s 2024-09-11T22:20:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675646 s, 155 MB/s 2024-09-11T22:20:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763256 s, 137 MB/s 2024-09-11T22:20:08.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.073 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640061 s, 164 MB/s 2024-09-11T22:20:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723088 s, 145 MB/s 2024-09-11T22:20:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007385 s, 142 MB/s 2024-09-11T22:20:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762013 s, 138 MB/s 2024-09-11T22:20:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633508 s, 166 MB/s 2024-09-11T22:20:08.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.117 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613743 s, 171 MB/s 2024-09-11T22:20:08.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074006 s, 142 MB/s 2024-09-11T22:20:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759127 s, 138 MB/s 2024-09-11T22:20:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639443 s, 164 MB/s 2024-09-11T22:20:08.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.152 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745814 s, 141 MB/s 2024-09-11T22:20:08.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.161 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744953 s, 141 MB/s 2024-09-11T22:20:08.169 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.170 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685423 s, 153 MB/s 2024-09-11T22:20:08.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.179 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075003 s, 140 MB/s 2024-09-11T22:20:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729754 s, 144 MB/s 2024-09-11T22:20:08.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.197 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070944 s, 148 MB/s 2024-09-11T22:20:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730384 s, 144 MB/s 2024-09-11T22:20:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743754 s, 141 MB/s 2024-09-11T22:20:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720829 s, 145 MB/s 2024-09-11T22:20:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679273 s, 154 MB/s 2024-09-11T22:20:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734001 s, 143 MB/s 2024-09-11T22:20:08.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.250 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670084 s, 156 MB/s 2024-09-11T22:20:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739469 s, 142 MB/s 2024-09-11T22:20:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624466 s, 168 MB/s 2024-09-11T22:20:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076995 s, 136 MB/s 2024-09-11T22:20:08.286 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.286 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.286 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00831494 s, 126 MB/s 2024-09-11T22:20:08.294 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.294 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.294 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652169 s, 161 MB/s 2024-09-11T22:20:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072968 s, 144 MB/s 2024-09-11T22:20:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642928 s, 163 MB/s 2024-09-11T22:20:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:08.318 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:08.318 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:08.318 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.6 2024-09-11T22:20:08.318 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:08.318 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:08.318 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:08.319 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:08.379 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.379 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768176 s, 137 MB/s 2024-09-11T22:20:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656714 s, 160 MB/s 2024-09-11T22:20:08.395 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.396 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.396 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625997 s, 168 MB/s 2024-09-11T22:20:08.404 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.404 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.404 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652353 s, 161 MB/s 2024-09-11T22:20:08.413 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.413 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.413 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753082 s, 139 MB/s 2024-09-11T22:20:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762104 s, 138 MB/s 2024-09-11T22:20:08.431 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.431 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.431 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072873 s, 144 MB/s 2024-09-11T22:20:08.439 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.440 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.440 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696496 s, 151 MB/s 2024-09-11T22:20:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658318 s, 159 MB/s 2024-09-11T22:20:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738447 s, 142 MB/s 2024-09-11T22:20:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707037 s, 148 MB/s 2024-09-11T22:20:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.475 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729435 s, 144 MB/s 2024-09-11T22:20:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672252 s, 156 MB/s 2024-09-11T22:20:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836538 s, 125 MB/s 2024-09-11T22:20:08.502 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.502 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.502 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716976 s, 146 MB/s 2024-09-11T22:20:08.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.510 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623037 s, 168 MB/s 2024-09-11T22:20:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641047 s, 164 MB/s 2024-09-11T22:20:08.527 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.527 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.528 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798348 s, 131 MB/s 2024-09-11T22:20:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736122 s, 142 MB/s 2024-09-11T22:20:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742445 s, 141 MB/s 2024-09-11T22:20:08.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.554 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677267 s, 155 MB/s 2024-09-11T22:20:08.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.563 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731364 s, 143 MB/s 2024-09-11T22:20:08.571 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.571 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.571 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670952 s, 156 MB/s 2024-09-11T22:20:08.580 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.580 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.580 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722801 s, 145 MB/s 2024-09-11T22:20:08.588 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.588 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.589 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640378 s, 164 MB/s 2024-09-11T22:20:08.597 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.597 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.597 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749063 s, 140 MB/s 2024-09-11T22:20:08.606 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.607 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.607 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743999 s, 141 MB/s 2024-09-11T22:20:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651874 s, 161 MB/s 2024-09-11T22:20:08.623 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.624 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.624 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746658 s, 140 MB/s 2024-09-11T22:20:08.632 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.632 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.632 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699043 s, 150 MB/s 2024-09-11T22:20:08.642 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.642 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.642 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735725 s, 143 MB/s 2024-09-11T22:20:08.650 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.650 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.650 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632112 s, 166 MB/s 2024-09-11T22:20:08.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:08.656 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:08.656 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:08.656 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.7 2024-09-11T22:20:08.656 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:08.656 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:08.657 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:08.657 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:08.717 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.717 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.717 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736204 s, 142 MB/s 2024-09-11T22:20:08.725 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.725 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.725 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681565 s, 154 MB/s 2024-09-11T22:20:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649627 s, 161 MB/s 2024-09-11T22:20:08.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.742 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749854 s, 140 MB/s 2024-09-11T22:20:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729604 s, 144 MB/s 2024-09-11T22:20:08.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.760 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732711 s, 143 MB/s 2024-09-11T22:20:08.768 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.768 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.768 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632769 s, 166 MB/s 2024-09-11T22:20:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613644 s, 171 MB/s 2024-09-11T22:20:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745094 s, 141 MB/s 2024-09-11T22:20:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666763 s, 157 MB/s 2024-09-11T22:20:08.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.802 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074915 s, 140 MB/s 2024-09-11T22:20:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732067 s, 143 MB/s 2024-09-11T22:20:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073374 s, 143 MB/s 2024-09-11T22:20:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704467 s, 149 MB/s 2024-09-11T22:20:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729277 s, 144 MB/s 2024-09-11T22:20:08.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.846 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630999 s, 166 MB/s 2024-09-11T22:20:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742287 s, 141 MB/s 2024-09-11T22:20:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688769 s, 152 MB/s 2024-09-11T22:20:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.872 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682593 s, 154 MB/s 2024-09-11T22:20:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738591 s, 142 MB/s 2024-09-11T22:20:08.889 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651604 s, 161 MB/s 2024-09-11T22:20:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659552 s, 159 MB/s 2024-09-11T22:20:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771536 s, 136 MB/s 2024-09-11T22:20:08.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.916 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692252 s, 151 MB/s 2024-09-11T22:20:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771358 s, 136 MB/s 2024-09-11T22:20:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719385 s, 146 MB/s 2024-09-11T22:20:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638534 s, 164 MB/s 2024-09-11T22:20:08.951 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.951 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.951 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752597 s, 139 MB/s 2024-09-11T22:20:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728401 s, 144 MB/s 2024-09-11T22:20:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722567 s, 145 MB/s 2024-09-11T22:20:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735385 s, 143 MB/s 2024-09-11T22:20:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732139 s, 143 MB/s 2024-09-11T22:20:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:08.994 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:08.994 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:08.994 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.8 2024-09-11T22:20:08.994 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:08.994 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:08.994 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:08.994 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:09.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732569 s, 143 MB/s 2024-09-11T22:20:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760895 s, 138 MB/s 2024-09-11T22:20:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776732 s, 135 MB/s 2024-09-11T22:20:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075339 s, 139 MB/s 2024-09-11T22:20:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685986 s, 153 MB/s 2024-09-11T22:20:09.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.101 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734035 s, 143 MB/s 2024-09-11T22:20:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647443 s, 162 MB/s 2024-09-11T22:20:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074006 s, 142 MB/s 2024-09-11T22:20:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717768 s, 146 MB/s 2024-09-11T22:20:09.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.136 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.136 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670097 s, 156 MB/s 2024-09-11T22:20:09.144 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.145 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732691 s, 143 MB/s 2024-09-11T22:20:09.153 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.153 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.153 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642283 s, 163 MB/s 2024-09-11T22:20:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731769 s, 143 MB/s 2024-09-11T22:20:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641392 s, 163 MB/s 2024-09-11T22:20:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008341 s, 126 MB/s 2024-09-11T22:20:09.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.189 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722692 s, 145 MB/s 2024-09-11T22:20:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679773 s, 154 MB/s 2024-09-11T22:20:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077112 s, 136 MB/s 2024-09-11T22:20:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697574 s, 150 MB/s 2024-09-11T22:20:09.223 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.223 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.223 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653544 s, 160 MB/s 2024-09-11T22:20:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642188 s, 163 MB/s 2024-09-11T22:20:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638645 s, 164 MB/s 2024-09-11T22:20:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628955 s, 167 MB/s 2024-09-11T22:20:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841254 s, 125 MB/s 2024-09-11T22:20:09.265 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.265 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.265 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639685 s, 164 MB/s 2024-09-11T22:20:09.274 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.274 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.274 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767215 s, 137 MB/s 2024-09-11T22:20:09.283 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.283 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.283 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065979 s, 159 MB/s 2024-09-11T22:20:09.291 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.291 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.291 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700386 s, 150 MB/s 2024-09-11T22:20:09.300 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.300 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.300 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726197 s, 144 MB/s 2024-09-11T22:20:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845229 s, 124 MB/s 2024-09-11T22:20:09.318 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.318 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.318 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656574 s, 160 MB/s 2024-09-11T22:20:09.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.326 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627132 s, 167 MB/s 2024-09-11T22:20:09.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:09.333 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:09.333 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:09.333 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.9 2024-09-11T22:20:09.333 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:09.333 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:09.333 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:09.333 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:09.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.393 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682269 s, 154 MB/s 2024-09-11T22:20:09.402 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.402 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.402 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744169 s, 141 MB/s 2024-09-11T22:20:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741036 s, 142 MB/s 2024-09-11T22:20:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677762 s, 155 MB/s 2024-09-11T22:20:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661839 s, 158 MB/s 2024-09-11T22:20:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759757 s, 138 MB/s 2024-09-11T22:20:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.446 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729282 s, 144 MB/s 2024-09-11T22:20:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.455 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724494 s, 145 MB/s 2024-09-11T22:20:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647941 s, 162 MB/s 2024-09-11T22:20:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.473 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817176 s, 128 MB/s 2024-09-11T22:20:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766145 s, 137 MB/s 2024-09-11T22:20:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788552 s, 133 MB/s 2024-09-11T22:20:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077244 s, 136 MB/s 2024-09-11T22:20:09.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.510 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713382 s, 147 MB/s 2024-09-11T22:20:09.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.520 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771337 s, 136 MB/s 2024-09-11T22:20:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717141 s, 146 MB/s 2024-09-11T22:20:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870937 s, 120 MB/s 2024-09-11T22:20:09.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.548 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732069 s, 143 MB/s 2024-09-11T22:20:09.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.557 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732009 s, 143 MB/s 2024-09-11T22:20:09.566 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.566 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.566 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687305 s, 153 MB/s 2024-09-11T22:20:09.575 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.575 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.575 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731912 s, 143 MB/s 2024-09-11T22:20:09.585 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.585 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.585 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846853 s, 124 MB/s 2024-09-11T22:20:09.594 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.594 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.594 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708854 s, 148 MB/s 2024-09-11T22:20:09.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.603 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741243 s, 141 MB/s 2024-09-11T22:20:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742044 s, 141 MB/s 2024-09-11T22:20:09.620 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.620 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.620 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063377 s, 165 MB/s 2024-09-11T22:20:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744096 s, 141 MB/s 2024-09-11T22:20:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717821 s, 146 MB/s 2024-09-11T22:20:09.646 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.646 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.647 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676085 s, 155 MB/s 2024-09-11T22:20:09.656 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.656 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.656 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745224 s, 141 MB/s 2024-09-11T22:20:09.664 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.664 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.664 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664163 s, 158 MB/s 2024-09-11T22:20:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655685 s, 160 MB/s 2024-09-11T22:20:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:09.679 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:09.680 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:09.680 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.10 2024-09-11T22:20:09.680 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:09.680 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:09.680 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:09.680 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:09.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.740 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677149 s, 155 MB/s 2024-09-11T22:20:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.750 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771046 s, 136 MB/s 2024-09-11T22:20:09.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.759 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.759 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755057 s, 139 MB/s 2024-09-11T22:20:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073356 s, 143 MB/s 2024-09-11T22:20:09.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.776 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646994 s, 162 MB/s 2024-09-11T22:20:09.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.784 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719914 s, 146 MB/s 2024-09-11T22:20:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076136 s, 138 MB/s 2024-09-11T22:20:09.804 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.804 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.804 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716455 s, 146 MB/s 2024-09-11T22:20:09.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.812 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720669 s, 146 MB/s 2024-09-11T22:20:09.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.821 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719734 s, 146 MB/s 2024-09-11T22:20:09.830 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.830 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.830 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073453 s, 143 MB/s 2024-09-11T22:20:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762254 s, 138 MB/s 2024-09-11T22:20:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649111 s, 162 MB/s 2024-09-11T22:20:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659874 s, 159 MB/s 2024-09-11T22:20:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073391 s, 143 MB/s 2024-09-11T22:20:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006837 s, 153 MB/s 2024-09-11T22:20:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068325 s, 153 MB/s 2024-09-11T22:20:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710976 s, 147 MB/s 2024-09-11T22:20:09.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.899 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.899 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672698 s, 156 MB/s 2024-09-11T22:20:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723727 s, 145 MB/s 2024-09-11T22:20:09.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.916 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064597 s, 162 MB/s 2024-09-11T22:20:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737323 s, 142 MB/s 2024-09-11T22:20:09.933 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.933 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.933 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632801 s, 166 MB/s 2024-09-11T22:20:09.941 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735977 s, 142 MB/s 2024-09-11T22:20:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736041 s, 142 MB/s 2024-09-11T22:20:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.960 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722737 s, 145 MB/s 2024-09-11T22:20:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.969 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722687 s, 145 MB/s 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751537 s, 140 MB/s 2024-09-11T22:20:09.986 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.986 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.986 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692938 s, 151 MB/s 2024-09-11T22:20:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699631 s, 150 MB/s 2024-09-11T22:20:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733619 s, 143 MB/s 2024-09-11T22:20:10.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.013 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663612 s, 158 MB/s 2024-09-11T22:20:10.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:10.019 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:10.019 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:10.020 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.11 2024-09-11T22:20:10.020 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:10.020 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:10.020 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:10.020 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:10.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:10.081 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.081 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.081 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760863 s, 138 MB/s 2024-09-11T22:20:10.089 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.089 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.089 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682212 s, 154 MB/s 2024-09-11T22:20:10.097 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.097 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.097 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632763 s, 166 MB/s 2024-09-11T22:20:10.105 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.105 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.106 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679577 s, 154 MB/s 2024-09-11T22:20:10.113 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.113 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063826 s, 164 MB/s 2024-09-11T22:20:10.123 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.123 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.123 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0081217 s, 129 MB/s 2024-09-11T22:20:10.132 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.132 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.132 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729683 s, 144 MB/s 2024-09-11T22:20:10.142 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.142 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.142 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00831279 s, 126 MB/s 2024-09-11T22:20:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768057 s, 137 MB/s 2024-09-11T22:20:10.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.162 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.162 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798322 s, 131 MB/s 2024-09-11T22:20:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671492 s, 156 MB/s 2024-09-11T22:20:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700909 s, 150 MB/s 2024-09-11T22:20:10.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.189 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835723 s, 125 MB/s 2024-09-11T22:20:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689425 s, 152 MB/s 2024-09-11T22:20:10.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.208 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767619 s, 137 MB/s 2024-09-11T22:20:10.216 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.216 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.216 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730541 s, 144 MB/s 2024-09-11T22:20:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067208 s, 156 MB/s 2024-09-11T22:20:10.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.234 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744331 s, 141 MB/s 2024-09-11T22:20:10.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.242 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642905 s, 163 MB/s 2024-09-11T22:20:10.251 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.251 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.251 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738381 s, 142 MB/s 2024-09-11T22:20:10.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.262 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867022 s, 121 MB/s 2024-09-11T22:20:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725971 s, 144 MB/s 2024-09-11T22:20:10.279 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696374 s, 151 MB/s 2024-09-11T22:20:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.289 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726442 s, 144 MB/s 2024-09-11T22:20:10.296 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.297 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.297 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629303 s, 167 MB/s 2024-09-11T22:20:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736664 s, 142 MB/s 2024-09-11T22:20:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.314 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717604 s, 146 MB/s 2024-09-11T22:20:10.323 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.323 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.323 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729652 s, 144 MB/s 2024-09-11T22:20:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732072 s, 143 MB/s 2024-09-11T22:20:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.341 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645999 s, 162 MB/s 2024-09-11T22:20:10.349 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.349 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.349 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638063 s, 164 MB/s 2024-09-11T22:20:10.357 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.357 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.357 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064507 s, 163 MB/s 2024-09-11T22:20:10.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:10.363 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:10.364 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:10.364 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.12 2024-09-11T22:20:10.364 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:10.364 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:10.364 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:10.364 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:10.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710095 s, 148 MB/s 2024-09-11T22:20:10.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.433 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669251 s, 157 MB/s 2024-09-11T22:20:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630218 s, 166 MB/s 2024-09-11T22:20:10.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.450 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800492 s, 131 MB/s 2024-09-11T22:20:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641688 s, 163 MB/s 2024-09-11T22:20:10.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.466 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670397 s, 156 MB/s 2024-09-11T22:20:10.475 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.475 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.475 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724133 s, 145 MB/s 2024-09-11T22:20:10.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.484 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708461 s, 148 MB/s 2024-09-11T22:20:10.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.493 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006894 s, 152 MB/s 2024-09-11T22:20:10.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.501 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063073 s, 166 MB/s 2024-09-11T22:20:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759534 s, 138 MB/s 2024-09-11T22:20:10.519 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.519 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.519 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715797 s, 146 MB/s 2024-09-11T22:20:10.528 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.528 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.528 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760938 s, 138 MB/s 2024-09-11T22:20:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719994 s, 146 MB/s 2024-09-11T22:20:10.546 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.546 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.546 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771152 s, 136 MB/s 2024-09-11T22:20:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763435 s, 137 MB/s 2024-09-11T22:20:10.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.565 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740227 s, 142 MB/s 2024-09-11T22:20:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066878 s, 157 MB/s 2024-09-11T22:20:10.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.582 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743624 s, 141 MB/s 2024-09-11T22:20:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799911 s, 131 MB/s 2024-09-11T22:20:10.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.601 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665364 s, 158 MB/s 2024-09-11T22:20:10.608 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.608 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.608 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644087 s, 163 MB/s 2024-09-11T22:20:10.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.617 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714186 s, 147 MB/s 2024-09-11T22:20:10.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.626 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.626 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663057 s, 158 MB/s 2024-09-11T22:20:10.633 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.633 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.634 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641239 s, 164 MB/s 2024-09-11T22:20:10.641 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.641 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.641 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064725 s, 162 MB/s 2024-09-11T22:20:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767808 s, 137 MB/s 2024-09-11T22:20:10.658 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.658 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.658 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617616 s, 170 MB/s 2024-09-11T22:20:10.666 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.666 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.667 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646911 s, 162 MB/s 2024-09-11T22:20:10.676 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.676 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.676 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785935 s, 133 MB/s 2024-09-11T22:20:10.685 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.685 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.685 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726582 s, 144 MB/s 2024-09-11T22:20:10.693 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.693 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.693 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648179 s, 162 MB/s 2024-09-11T22:20:10.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:10.699 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:10.700 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:10.700 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.13 2024-09-11T22:20:10.700 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:10.700 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:10.700 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:10.700 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:10.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:10.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.760 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684695 s, 153 MB/s 2024-09-11T22:20:10.769 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.769 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.769 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725591 s, 145 MB/s 2024-09-11T22:20:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677062 s, 155 MB/s 2024-09-11T22:20:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.786 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654523 s, 160 MB/s 2024-09-11T22:20:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070715 s, 148 MB/s 2024-09-11T22:20:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706294 s, 148 MB/s 2024-09-11T22:20:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860138 s, 122 MB/s 2024-09-11T22:20:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.824 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.825 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731809 s, 143 MB/s 2024-09-11T22:20:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721082 s, 145 MB/s 2024-09-11T22:20:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755552 s, 139 MB/s 2024-09-11T22:20:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074513 s, 141 MB/s 2024-09-11T22:20:10.858 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.858 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.858 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668819 s, 157 MB/s 2024-09-11T22:20:10.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.867 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731159 s, 143 MB/s 2024-09-11T22:20:10.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.875 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622758 s, 168 MB/s 2024-09-11T22:20:10.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.884 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743442 s, 141 MB/s 2024-09-11T22:20:10.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.893 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709732 s, 148 MB/s 2024-09-11T22:20:10.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.901 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650192 s, 161 MB/s 2024-09-11T22:20:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729091 s, 144 MB/s 2024-09-11T22:20:10.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.918 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632797 s, 166 MB/s 2024-09-11T22:20:10.926 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.926 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.926 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711267 s, 147 MB/s 2024-09-11T22:20:10.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.936 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764722 s, 137 MB/s 2024-09-11T22:20:10.944 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.944 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.944 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064062 s, 164 MB/s 2024-09-11T22:20:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716985 s, 146 MB/s 2024-09-11T22:20:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697433 s, 150 MB/s 2024-09-11T22:20:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640638 s, 164 MB/s 2024-09-11T22:20:10.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.980 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737957 s, 142 MB/s 2024-09-11T22:20:10.989 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.989 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.989 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683215 s, 153 MB/s 2024-09-11T22:20:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698487 s, 150 MB/s 2024-09-11T22:20:11.008 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.008 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.008 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727978 s, 144 MB/s 2024-09-11T22:20:11.017 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.017 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.017 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740191 s, 142 MB/s 2024-09-11T22:20:11.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.027 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753349 s, 139 MB/s 2024-09-11T22:20:11.036 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.036 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.036 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720181 s, 146 MB/s 2024-09-11T22:20:11.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:11.043 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:11.043 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:11.043 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.14 2024-09-11T22:20:11.043 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:11.043 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:11.043 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:11.043 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728084 s, 144 MB/s 2024-09-11T22:20:11.113 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.113 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.113 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745519 s, 141 MB/s 2024-09-11T22:20:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.121 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654103 s, 160 MB/s 2024-09-11T22:20:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610859 s, 172 MB/s 2024-09-11T22:20:11.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.138 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787855 s, 133 MB/s 2024-09-11T22:20:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074593 s, 141 MB/s 2024-09-11T22:20:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065229 s, 161 MB/s 2024-09-11T22:20:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075465 s, 139 MB/s 2024-09-11T22:20:11.173 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.173 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.173 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673582 s, 156 MB/s 2024-09-11T22:20:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.181 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699253 s, 150 MB/s 2024-09-11T22:20:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075588 s, 139 MB/s 2024-09-11T22:20:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752543 s, 139 MB/s 2024-09-11T22:20:11.208 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.209 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.209 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690544 s, 152 MB/s 2024-09-11T22:20:11.217 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.217 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.217 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655933 s, 160 MB/s 2024-09-11T22:20:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694233 s, 151 MB/s 2024-09-11T22:20:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733542 s, 143 MB/s 2024-09-11T22:20:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632743 s, 166 MB/s 2024-09-11T22:20:11.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.251 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690345 s, 152 MB/s 2024-09-11T22:20:11.260 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.260 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.260 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751782 s, 139 MB/s 2024-09-11T22:20:11.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.268 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650512 s, 161 MB/s 2024-09-11T22:20:11.276 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.276 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.276 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646907 s, 162 MB/s 2024-09-11T22:20:11.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.285 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072178 s, 145 MB/s 2024-09-11T22:20:11.294 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.294 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.294 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712785 s, 147 MB/s 2024-09-11T22:20:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746602 s, 140 MB/s 2024-09-11T22:20:11.311 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.311 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.312 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680154 s, 154 MB/s 2024-09-11T22:20:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.320 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726592 s, 144 MB/s 2024-09-11T22:20:11.329 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.329 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.329 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654309 s, 160 MB/s 2024-09-11T22:20:11.337 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.338 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.338 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723712 s, 145 MB/s 2024-09-11T22:20:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722285 s, 145 MB/s 2024-09-11T22:20:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721062 s, 145 MB/s 2024-09-11T22:20:11.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.365 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727034 s, 144 MB/s 2024-09-11T22:20:11.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642566 s, 163 MB/s 2024-09-11T22:20:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:11.379 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:11.380 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:11.380 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.15 2024-09-11T22:20:11.380 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:11.380 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:11.380 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:11.380 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:11.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:11.440 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.440 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.440 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655646 s, 160 MB/s 2024-09-11T22:20:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741846 s, 141 MB/s 2024-09-11T22:20:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729662 s, 144 MB/s 2024-09-11T22:20:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667035 s, 157 MB/s 2024-09-11T22:20:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731726 s, 143 MB/s 2024-09-11T22:20:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.484 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758253 s, 138 MB/s 2024-09-11T22:20:11.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.494 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074409 s, 141 MB/s 2024-09-11T22:20:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751446 s, 140 MB/s 2024-09-11T22:20:11.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.512 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746287 s, 141 MB/s 2024-09-11T22:20:11.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.520 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636848 s, 165 MB/s 2024-09-11T22:20:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638373 s, 164 MB/s 2024-09-11T22:20:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786848 s, 133 MB/s 2024-09-11T22:20:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677292 s, 155 MB/s 2024-09-11T22:20:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665702 s, 158 MB/s 2024-09-11T22:20:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.565 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844125 s, 124 MB/s 2024-09-11T22:20:11.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.573 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691564 s, 152 MB/s 2024-09-11T22:20:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731216 s, 143 MB/s 2024-09-11T22:20:11.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.591 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721027 s, 145 MB/s 2024-09-11T22:20:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739108 s, 142 MB/s 2024-09-11T22:20:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695916 s, 151 MB/s 2024-09-11T22:20:11.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.617 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670139 s, 156 MB/s 2024-09-11T22:20:11.626 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.627 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.627 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774851 s, 135 MB/s 2024-09-11T22:20:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651809 s, 161 MB/s 2024-09-11T22:20:11.643 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723968 s, 145 MB/s 2024-09-11T22:20:11.652 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.653 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.653 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727103 s, 144 MB/s 2024-09-11T22:20:11.662 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.662 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.662 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748034 s, 140 MB/s 2024-09-11T22:20:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006827 s, 154 MB/s 2024-09-11T22:20:11.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.679 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657156 s, 160 MB/s 2024-09-11T22:20:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752773 s, 139 MB/s 2024-09-11T22:20:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656357 s, 160 MB/s 2024-09-11T22:20:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073964 s, 142 MB/s 2024-09-11T22:20:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740222 s, 142 MB/s 2024-09-11T22:20:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:11.721 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:11.721 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:11.721 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.16 2024-09-11T22:20:11.721 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:11.722 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:11.722 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:11.722 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634729 s, 165 MB/s 2024-09-11T22:20:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637471 s, 164 MB/s 2024-09-11T22:20:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638067 s, 164 MB/s 2024-09-11T22:20:11.805 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.805 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.805 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721392 s, 145 MB/s 2024-09-11T22:20:11.814 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.814 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.814 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718344 s, 146 MB/s 2024-09-11T22:20:11.823 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.823 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.823 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757552 s, 138 MB/s 2024-09-11T22:20:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733718 s, 143 MB/s 2024-09-11T22:20:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730297 s, 144 MB/s 2024-09-11T22:20:11.850 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.850 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.850 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685573 s, 153 MB/s 2024-09-11T22:20:11.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.859 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750662 s, 140 MB/s 2024-09-11T22:20:11.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.868 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657986 s, 159 MB/s 2024-09-11T22:20:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754682 s, 139 MB/s 2024-09-11T22:20:11.885 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.885 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.885 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062664 s, 167 MB/s 2024-09-11T22:20:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678357 s, 155 MB/s 2024-09-11T22:20:11.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.902 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738909 s, 142 MB/s 2024-09-11T22:20:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712949 s, 147 MB/s 2024-09-11T22:20:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710691 s, 148 MB/s 2024-09-11T22:20:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738688 s, 142 MB/s 2024-09-11T22:20:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063902 s, 164 MB/s 2024-09-11T22:20:11.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.945 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664523 s, 158 MB/s 2024-09-11T22:20:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646862 s, 162 MB/s 2024-09-11T22:20:11.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.963 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755674 s, 139 MB/s 2024-09-11T22:20:11.971 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.971 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.971 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068042 s, 154 MB/s 2024-09-11T22:20:11.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.980 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752624 s, 139 MB/s 2024-09-11T22:20:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.989 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693181 s, 151 MB/s 2024-09-11T22:20:11.996 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:11.997 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:11.997 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619167 s, 169 MB/s 2024-09-11T22:20:12.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.005 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671153 s, 156 MB/s 2024-09-11T22:20:12.013 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.013 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.014 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717553 s, 146 MB/s 2024-09-11T22:20:12.022 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.022 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.022 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703266 s, 149 MB/s 2024-09-11T22:20:12.031 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.032 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747491 s, 140 MB/s 2024-09-11T22:20:12.041 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.041 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.041 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733547 s, 143 MB/s 2024-09-11T22:20:12.049 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.050 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.050 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066187 s, 158 MB/s 2024-09-11T22:20:12.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:12.057 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:12.057 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:12.057 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.17 2024-09-11T22:20:12.057 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:12.057 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:12.057 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:12.057 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:12.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:12.118 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.118 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.118 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710024 s, 148 MB/s 2024-09-11T22:20:12.127 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.127 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.127 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704369 s, 149 MB/s 2024-09-11T22:20:12.136 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.136 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.136 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663013 s, 158 MB/s 2024-09-11T22:20:12.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.145 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676419 s, 155 MB/s 2024-09-11T22:20:12.155 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.155 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.155 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077246 s, 136 MB/s 2024-09-11T22:20:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.165 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761709 s, 138 MB/s 2024-09-11T22:20:12.174 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.174 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.174 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737345 s, 142 MB/s 2024-09-11T22:20:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704758 s, 149 MB/s 2024-09-11T22:20:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700329 s, 150 MB/s 2024-09-11T22:20:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00801098 s, 131 MB/s 2024-09-11T22:20:12.212 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.212 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.212 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742748 s, 141 MB/s 2024-09-11T22:20:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723546 s, 145 MB/s 2024-09-11T22:20:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723729 s, 145 MB/s 2024-09-11T22:20:12.238 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.239 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.239 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713113 s, 147 MB/s 2024-09-11T22:20:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.247 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659744 s, 159 MB/s 2024-09-11T22:20:12.254 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.255 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.255 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650104 s, 161 MB/s 2024-09-11T22:20:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726278 s, 144 MB/s 2024-09-11T22:20:12.272 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.272 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.272 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070276 s, 149 MB/s 2024-09-11T22:20:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762469 s, 138 MB/s 2024-09-11T22:20:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762155 s, 138 MB/s 2024-09-11T22:20:12.300 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.300 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.300 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748938 s, 140 MB/s 2024-09-11T22:20:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703939 s, 149 MB/s 2024-09-11T22:20:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072133 s, 145 MB/s 2024-09-11T22:20:12.327 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.327 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.327 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074845 s, 140 MB/s 2024-09-11T22:20:12.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.335 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666437 s, 157 MB/s 2024-09-11T22:20:12.344 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.344 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.344 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740499 s, 142 MB/s 2024-09-11T22:20:12.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.354 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.354 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712344 s, 147 MB/s 2024-09-11T22:20:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710989 s, 147 MB/s 2024-09-11T22:20:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657033 s, 160 MB/s 2024-09-11T22:20:12.378 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.378 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.378 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653965 s, 160 MB/s 2024-09-11T22:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076898 s, 136 MB/s 2024-09-11T22:20:12.402 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.403 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.403 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013231 s, 79.3 MB/s 2024-09-11T22:20:12.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:12.409 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:12.409 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:12.409 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.18 2024-09-11T22:20:12.410 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:12.410 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:12.410 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:12.410 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:12.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:12.471 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.471 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.471 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785186 s, 134 MB/s 2024-09-11T22:20:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073173 s, 143 MB/s 2024-09-11T22:20:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659833 s, 159 MB/s 2024-09-11T22:20:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714403 s, 147 MB/s 2024-09-11T22:20:12.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.506 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.506 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721573 s, 145 MB/s 2024-09-11T22:20:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638888 s, 164 MB/s 2024-09-11T22:20:12.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.522 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672968 s, 156 MB/s 2024-09-11T22:20:12.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.531 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064884 s, 162 MB/s 2024-09-11T22:20:12.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.539 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723085 s, 145 MB/s 2024-09-11T22:20:12.549 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.549 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.549 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857896 s, 122 MB/s 2024-09-11T22:20:12.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.558 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682537 s, 154 MB/s 2024-09-11T22:20:12.566 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.567 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.567 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713366 s, 147 MB/s 2024-09-11T22:20:12.576 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.576 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.576 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075755 s, 138 MB/s 2024-09-11T22:20:12.584 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.584 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.584 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633286 s, 166 MB/s 2024-09-11T22:20:12.592 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.592 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.592 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661198 s, 159 MB/s 2024-09-11T22:20:12.601 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.601 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.601 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721272 s, 145 MB/s 2024-09-11T22:20:12.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.609 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622631 s, 168 MB/s 2024-09-11T22:20:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063683 s, 165 MB/s 2024-09-11T22:20:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.626 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713258 s, 147 MB/s 2024-09-11T22:20:12.634 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.634 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.634 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713774 s, 147 MB/s 2024-09-11T22:20:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630487 s, 166 MB/s 2024-09-11T22:20:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663674 s, 158 MB/s 2024-09-11T22:20:12.660 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.660 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.661 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763935 s, 137 MB/s 2024-09-11T22:20:12.668 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.669 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.669 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688591 s, 152 MB/s 2024-09-11T22:20:12.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.677 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670983 s, 156 MB/s 2024-09-11T22:20:12.685 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.685 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.686 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719241 s, 146 MB/s 2024-09-11T22:20:12.694 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.694 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.695 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722284 s, 145 MB/s 2024-09-11T22:20:12.704 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.704 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.704 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745377 s, 141 MB/s 2024-09-11T22:20:12.713 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.713 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.713 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745674 s, 141 MB/s 2024-09-11T22:20:12.721 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.721 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.721 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063547 s, 165 MB/s 2024-09-11T22:20:12.729 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.729 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.729 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641565 s, 163 MB/s 2024-09-11T22:20:12.737 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.737 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.737 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069294 s, 151 MB/s 2024-09-11T22:20:12.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:12.744 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:12.744 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:12.744 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.19 2024-09-11T22:20:12.744 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:12.744 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:12.744 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:12.744 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706794 s, 148 MB/s 2024-09-11T22:20:12.813 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.813 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.813 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732827 s, 143 MB/s 2024-09-11T22:20:12.822 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.823 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.823 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783864 s, 134 MB/s 2024-09-11T22:20:12.831 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.831 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.831 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689226 s, 152 MB/s 2024-09-11T22:20:12.840 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.840 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.840 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728886 s, 144 MB/s 2024-09-11T22:20:12.849 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.850 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.850 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766709 s, 137 MB/s 2024-09-11T22:20:12.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.859 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740095 s, 142 MB/s 2024-09-11T22:20:12.869 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.869 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.869 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00813776 s, 129 MB/s 2024-09-11T22:20:12.879 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.879 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.879 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085161 s, 123 MB/s 2024-09-11T22:20:12.888 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.888 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.888 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735432 s, 143 MB/s 2024-09-11T22:20:12.896 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.896 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.897 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685017 s, 153 MB/s 2024-09-11T22:20:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071391 s, 147 MB/s 2024-09-11T22:20:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685702 s, 153 MB/s 2024-09-11T22:20:12.922 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.923 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.923 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711515 s, 147 MB/s 2024-09-11T22:20:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760759 s, 138 MB/s 2024-09-11T22:20:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637124 s, 165 MB/s 2024-09-11T22:20:12.948 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.948 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.949 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682894 s, 154 MB/s 2024-09-11T22:20:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072996 s, 144 MB/s 2024-09-11T22:20:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649617 s, 161 MB/s 2024-09-11T22:20:12.974 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.974 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.975 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733511 s, 143 MB/s 2024-09-11T22:20:12.984 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.984 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.984 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073516 s, 143 MB/s 2024-09-11T22:20:12.992 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:12.992 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:12.992 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648611 s, 162 MB/s 2024-09-11T22:20:13.001 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.001 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.001 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763286 s, 137 MB/s 2024-09-11T22:20:13.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.010 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074003 s, 142 MB/s 2024-09-11T22:20:13.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.019 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758869 s, 138 MB/s 2024-09-11T22:20:13.028 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.028 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.028 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729553 s, 144 MB/s 2024-09-11T22:20:13.038 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.038 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.038 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774435 s, 135 MB/s 2024-09-11T22:20:13.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.047 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732051 s, 143 MB/s 2024-09-11T22:20:13.056 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.056 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.056 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075296 s, 139 MB/s 2024-09-11T22:20:13.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.065 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745499 s, 141 MB/s 2024-09-11T22:20:13.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741322 s, 141 MB/s 2024-09-11T22:20:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851147 s, 123 MB/s 2024-09-11T22:20:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:13.091 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:13.091 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:13.091 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.20 2024-09-11T22:20:13.091 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:13.092 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:13.092 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:13.092 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:13.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654912 s, 160 MB/s 2024-09-11T22:20:13.160 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.161 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079655 s, 132 MB/s 2024-09-11T22:20:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.169 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652264 s, 161 MB/s 2024-09-11T22:20:13.178 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.178 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.178 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753394 s, 139 MB/s 2024-09-11T22:20:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647257 s, 162 MB/s 2024-09-11T22:20:13.195 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.195 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.195 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762142 s, 138 MB/s 2024-09-11T22:20:13.204 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.204 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.204 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072622 s, 144 MB/s 2024-09-11T22:20:13.213 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.213 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.213 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723631 s, 145 MB/s 2024-09-11T22:20:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727824 s, 144 MB/s 2024-09-11T22:20:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667101 s, 157 MB/s 2024-09-11T22:20:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837123 s, 125 MB/s 2024-09-11T22:20:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726207 s, 144 MB/s 2024-09-11T22:20:13.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.258 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649164 s, 162 MB/s 2024-09-11T22:20:13.265 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.265 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.265 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643339 s, 163 MB/s 2024-09-11T22:20:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.274 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731019 s, 143 MB/s 2024-09-11T22:20:13.283 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.283 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.283 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734196 s, 143 MB/s 2024-09-11T22:20:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.292 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690437 s, 152 MB/s 2024-09-11T22:20:13.300 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.300 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.301 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696921 s, 150 MB/s 2024-09-11T22:20:13.310 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.310 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.310 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764056 s, 137 MB/s 2024-09-11T22:20:13.319 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.319 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.319 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711162 s, 147 MB/s 2024-09-11T22:20:13.327 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.327 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.327 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664411 s, 158 MB/s 2024-09-11T22:20:13.336 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.336 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.336 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746416 s, 140 MB/s 2024-09-11T22:20:13.346 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.346 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.346 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809231 s, 130 MB/s 2024-09-11T22:20:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.357 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.357 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863178 s, 121 MB/s 2024-09-11T22:20:13.366 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.366 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.366 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800387 s, 131 MB/s 2024-09-11T22:20:13.375 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.375 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.375 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736971 s, 142 MB/s 2024-09-11T22:20:13.384 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.384 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.384 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720938 s, 145 MB/s 2024-09-11T22:20:13.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.393 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704372 s, 149 MB/s 2024-09-11T22:20:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648657 s, 162 MB/s 2024-09-11T22:20:13.410 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.410 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.410 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691252 s, 152 MB/s 2024-09-11T22:20:13.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.419 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744734 s, 141 MB/s 2024-09-11T22:20:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633967 s, 165 MB/s 2024-09-11T22:20:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:13.433 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:13.434 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:13.434 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.21 2024-09-11T22:20:13.434 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:13.434 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:13.434 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:13.434 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:13.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.494 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686873 s, 153 MB/s 2024-09-11T22:20:13.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.503 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074079 s, 142 MB/s 2024-09-11T22:20:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735787 s, 143 MB/s 2024-09-11T22:20:13.521 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.521 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.521 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713386 s, 147 MB/s 2024-09-11T22:20:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740624 s, 142 MB/s 2024-09-11T22:20:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728141 s, 144 MB/s 2024-09-11T22:20:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072989 s, 144 MB/s 2024-09-11T22:20:13.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.557 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695955 s, 151 MB/s 2024-09-11T22:20:13.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.565 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646679 s, 162 MB/s 2024-09-11T22:20:13.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.573 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063663 s, 165 MB/s 2024-09-11T22:20:13.581 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.582 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711013 s, 147 MB/s 2024-09-11T22:20:13.590 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.590 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.590 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681197 s, 154 MB/s 2024-09-11T22:20:13.598 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.598 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.599 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656228 s, 160 MB/s 2024-09-11T22:20:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676913 s, 155 MB/s 2024-09-11T22:20:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717535 s, 146 MB/s 2024-09-11T22:20:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759835 s, 138 MB/s 2024-09-11T22:20:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737015 s, 142 MB/s 2024-09-11T22:20:13.643 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.643 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.643 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661547 s, 159 MB/s 2024-09-11T22:20:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653416 s, 160 MB/s 2024-09-11T22:20:13.660 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.660 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.660 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681131 s, 154 MB/s 2024-09-11T22:20:13.669 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.669 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.669 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761879 s, 138 MB/s 2024-09-11T22:20:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736367 s, 142 MB/s 2024-09-11T22:20:13.687 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.688 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788209 s, 133 MB/s 2024-09-11T22:20:13.697 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.697 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.697 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761736 s, 138 MB/s 2024-09-11T22:20:13.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.705 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660935 s, 159 MB/s 2024-09-11T22:20:13.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.714 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.714 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709597 s, 148 MB/s 2024-09-11T22:20:13.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.724 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835452 s, 126 MB/s 2024-09-11T22:20:13.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.733 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751618 s, 140 MB/s 2024-09-11T22:20:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.741 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669726 s, 157 MB/s 2024-09-11T22:20:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073942 s, 142 MB/s 2024-09-11T22:20:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.760 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761277 s, 138 MB/s 2024-09-11T22:20:13.769 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.769 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.769 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764106 s, 137 MB/s 2024-09-11T22:20:13.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:13.776 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:13.776 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:13.776 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.22 2024-09-11T22:20:13.776 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:13.776 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:13.776 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:13.776 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:13.817 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:20:13.821 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:20:13.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:13.836 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.836 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.837 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074264 s, 141 MB/s 2024-09-11T22:20:13.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.846 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751522 s, 140 MB/s 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655983 s, 160 MB/s 2024-09-11T22:20:13.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.864 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672422 s, 156 MB/s 2024-09-11T22:20:13.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.873 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.873 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669749 s, 157 MB/s 2024-09-11T22:20:13.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.881 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.881 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709205 s, 148 MB/s 2024-09-11T22:20:13.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.891 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738586 s, 142 MB/s 2024-09-11T22:20:13.899 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646852 s, 162 MB/s 2024-09-11T22:20:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655018 s, 160 MB/s 2024-09-11T22:20:13.919 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.919 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.919 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869127 s, 121 MB/s 2024-09-11T22:20:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749749 s, 140 MB/s 2024-09-11T22:20:13.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.938 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686371 s, 153 MB/s 2024-09-11T22:20:13.946 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.946 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.946 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660962 s, 159 MB/s 2024-09-11T22:20:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.955 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670531 s, 156 MB/s 2024-09-11T22:20:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653568 s, 160 MB/s 2024-09-11T22:20:13.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.972 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727135 s, 144 MB/s 2024-09-11T22:20:13.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.980 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642561 s, 163 MB/s 2024-09-11T22:20:13.988 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.988 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.988 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663108 s, 158 MB/s 2024-09-11T22:20:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702494 s, 149 MB/s 2024-09-11T22:20:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630621 s, 166 MB/s 2024-09-11T22:20:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741372 s, 141 MB/s 2024-09-11T22:20:14.022 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.023 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.023 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720571 s, 146 MB/s 2024-09-11T22:20:14.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.033 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793266 s, 132 MB/s 2024-09-11T22:20:14.040 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.040 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.040 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006199 s, 169 MB/s 2024-09-11T22:20:14.049 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.049 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.049 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693032 s, 151 MB/s 2024-09-11T22:20:14.058 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.058 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.058 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742854 s, 141 MB/s 2024-09-11T22:20:14.068 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.068 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.068 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855463 s, 123 MB/s 2024-09-11T22:20:14.076 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.076 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.076 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631593 s, 166 MB/s 2024-09-11T22:20:14.085 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.085 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.085 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723015 s, 145 MB/s 2024-09-11T22:20:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842366 s, 124 MB/s 2024-09-11T22:20:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.105 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074586 s, 141 MB/s 2024-09-11T22:20:14.113 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.113 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.113 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699757 s, 150 MB/s 2024-09-11T22:20:14.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:14.120 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:14.120 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:14.120 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.23 2024-09-11T22:20:14.120 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:14.120 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:14.120 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:14.120 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:14.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:14.220 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.220 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.220 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643544 s, 163 MB/s 2024-09-11T22:20:14.229 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.229 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.229 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743564 s, 141 MB/s 2024-09-11T22:20:14.238 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.238 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.238 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701836 s, 149 MB/s 2024-09-11T22:20:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750659 s, 140 MB/s 2024-09-11T22:20:14.256 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.256 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.256 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702396 s, 149 MB/s 2024-09-11T22:20:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658631 s, 159 MB/s 2024-09-11T22:20:14.273 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.273 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.273 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763659 s, 137 MB/s 2024-09-11T22:20:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00794363 s, 132 MB/s 2024-09-11T22:20:14.292 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.292 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.292 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738936 s, 142 MB/s 2024-09-11T22:20:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720613 s, 146 MB/s 2024-09-11T22:20:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746819 s, 140 MB/s 2024-09-11T22:20:14.318 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.318 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.319 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661348 s, 159 MB/s 2024-09-11T22:20:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661172 s, 159 MB/s 2024-09-11T22:20:14.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.335 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693444 s, 151 MB/s 2024-09-11T22:20:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.344 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.344 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627482 s, 167 MB/s 2024-09-11T22:20:14.352 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.352 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.353 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747431 s, 140 MB/s 2024-09-11T22:20:14.361 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.362 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742918 s, 141 MB/s 2024-09-11T22:20:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.370 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672622 s, 156 MB/s 2024-09-11T22:20:14.379 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.379 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.379 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718475 s, 146 MB/s 2024-09-11T22:20:14.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.388 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747791 s, 140 MB/s 2024-09-11T22:20:14.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.398 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789408 s, 133 MB/s 2024-09-11T22:20:14.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.406 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697869 s, 150 MB/s 2024-09-11T22:20:14.414 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.414 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.415 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064441 s, 163 MB/s 2024-09-11T22:20:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663161 s, 158 MB/s 2024-09-11T22:20:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866421 s, 121 MB/s 2024-09-11T22:20:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674399 s, 155 MB/s 2024-09-11T22:20:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754143 s, 139 MB/s 2024-09-11T22:20:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649545 s, 161 MB/s 2024-09-11T22:20:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654764 s, 160 MB/s 2024-09-11T22:20:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840101 s, 125 MB/s 2024-09-11T22:20:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736449 s, 142 MB/s 2024-09-11T22:20:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754631 s, 139 MB/s 2024-09-11T22:20:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:14.502 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:14.502 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:14.503 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.24 2024-09-11T22:20:14.503 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:14.503 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:14.503 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:14.503 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:14.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006494 s, 161 MB/s 2024-09-11T22:20:14.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.572 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668106 s, 157 MB/s 2024-09-11T22:20:14.581 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.581 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.581 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675461 s, 155 MB/s 2024-09-11T22:20:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835874 s, 125 MB/s 2024-09-11T22:20:14.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.600 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636701 s, 165 MB/s 2024-09-11T22:20:14.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.609 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735953 s, 142 MB/s 2024-09-11T22:20:14.618 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.618 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.618 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688668 s, 152 MB/s 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625725 s, 168 MB/s 2024-09-11T22:20:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731325 s, 143 MB/s 2024-09-11T22:20:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650539 s, 161 MB/s 2024-09-11T22:20:14.652 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.652 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.652 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072909 s, 144 MB/s 2024-09-11T22:20:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724096 s, 145 MB/s 2024-09-11T22:20:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065207 s, 161 MB/s 2024-09-11T22:20:14.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.679 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710179 s, 148 MB/s 2024-09-11T22:20:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668582 s, 157 MB/s 2024-09-11T22:20:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714356 s, 147 MB/s 2024-09-11T22:20:14.706 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.706 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.706 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655924 s, 160 MB/s 2024-09-11T22:20:14.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.715 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750879 s, 140 MB/s 2024-09-11T22:20:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739947 s, 142 MB/s 2024-09-11T22:20:14.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.733 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727781 s, 144 MB/s 2024-09-11T22:20:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731897 s, 143 MB/s 2024-09-11T22:20:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663607 s, 158 MB/s 2024-09-11T22:20:14.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.758 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621726 s, 169 MB/s 2024-09-11T22:20:14.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.767 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729266 s, 144 MB/s 2024-09-11T22:20:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710686 s, 148 MB/s 2024-09-11T22:20:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075027 s, 140 MB/s 2024-09-11T22:20:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007023 s, 149 MB/s 2024-09-11T22:20:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654699 s, 160 MB/s 2024-09-11T22:20:14.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.811 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756648 s, 139 MB/s 2024-09-11T22:20:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763641 s, 137 MB/s 2024-09-11T22:20:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070809 s, 148 MB/s 2024-09-11T22:20:14.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.838 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703731 s, 149 MB/s 2024-09-11T22:20:14.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:14.845 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:14.845 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:14.845 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.25 2024-09-11T22:20:14.845 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:14.846 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:14.846 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:14.846 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:14.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:14.906 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.906 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.906 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748273 s, 140 MB/s 2024-09-11T22:20:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679887 s, 154 MB/s 2024-09-11T22:20:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762296 s, 138 MB/s 2024-09-11T22:20:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619744 s, 169 MB/s 2024-09-11T22:20:14.940 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.940 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.940 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719201 s, 146 MB/s 2024-09-11T22:20:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676983 s, 155 MB/s 2024-09-11T22:20:14.958 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.958 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.958 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770468 s, 136 MB/s 2024-09-11T22:20:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765301 s, 137 MB/s 2024-09-11T22:20:14.976 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.976 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.976 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720215 s, 146 MB/s 2024-09-11T22:20:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750345 s, 140 MB/s 2024-09-11T22:20:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713437 s, 147 MB/s 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862056 s, 122 MB/s 2024-09-11T22:20:15.014 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.014 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.014 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751503 s, 140 MB/s 2024-09-11T22:20:15.023 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.023 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.023 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745504 s, 141 MB/s 2024-09-11T22:20:15.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.032 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696093 s, 151 MB/s 2024-09-11T22:20:15.041 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.041 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.041 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722337 s, 145 MB/s 2024-09-11T22:20:15.049 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.049 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.049 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616183 s, 170 MB/s 2024-09-11T22:20:15.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.057 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070747 s, 148 MB/s 2024-09-11T22:20:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650785 s, 161 MB/s 2024-09-11T22:20:15.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.074 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698748 s, 150 MB/s 2024-09-11T22:20:15.082 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.083 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654522 s, 160 MB/s 2024-09-11T22:20:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075416 s, 139 MB/s 2024-09-11T22:20:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726606 s, 144 MB/s 2024-09-11T22:20:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073375 s, 143 MB/s 2024-09-11T22:20:15.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.119 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738796 s, 142 MB/s 2024-09-11T22:20:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701632 s, 149 MB/s 2024-09-11T22:20:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749315 s, 140 MB/s 2024-09-11T22:20:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731197 s, 143 MB/s 2024-09-11T22:20:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767839 s, 137 MB/s 2024-09-11T22:20:15.167 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.167 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.167 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851621 s, 123 MB/s 2024-09-11T22:20:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.176 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705356 s, 149 MB/s 2024-09-11T22:20:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747572 s, 140 MB/s 2024-09-11T22:20:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:15.192 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:15.192 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:15.192 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.26 2024-09-11T22:20:15.192 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:15.192 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:15.192 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:15.192 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:15.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.307 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750847 s, 140 MB/s 2024-09-11T22:20:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731281 s, 143 MB/s 2024-09-11T22:20:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706772 s, 148 MB/s 2024-09-11T22:20:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693939 s, 151 MB/s 2024-09-11T22:20:15.342 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.342 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.342 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652226 s, 161 MB/s 2024-09-11T22:20:15.350 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.351 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.351 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727794 s, 144 MB/s 2024-09-11T22:20:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.360 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745119 s, 141 MB/s 2024-09-11T22:20:15.368 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.368 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.368 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621407 s, 169 MB/s 2024-09-11T22:20:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724145 s, 145 MB/s 2024-09-11T22:20:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683627 s, 153 MB/s 2024-09-11T22:20:15.394 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.394 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.394 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752037 s, 139 MB/s 2024-09-11T22:20:15.403 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.403 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.403 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708106 s, 148 MB/s 2024-09-11T22:20:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749989 s, 140 MB/s 2024-09-11T22:20:15.421 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.421 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.421 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736479 s, 142 MB/s 2024-09-11T22:20:15.430 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.430 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.430 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693859 s, 151 MB/s 2024-09-11T22:20:15.439 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.439 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.439 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723263 s, 145 MB/s 2024-09-11T22:20:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723435 s, 145 MB/s 2024-09-11T22:20:15.457 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.457 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.457 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739882 s, 142 MB/s 2024-09-11T22:20:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728693 s, 144 MB/s 2024-09-11T22:20:15.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.475 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.475 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711683 s, 147 MB/s 2024-09-11T22:20:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076636 s, 137 MB/s 2024-09-11T22:20:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651162 s, 161 MB/s 2024-09-11T22:20:15.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787011 s, 133 MB/s 2024-09-11T22:20:15.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.510 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686631 s, 153 MB/s 2024-09-11T22:20:15.519 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.519 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.519 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730694 s, 144 MB/s 2024-09-11T22:20:15.528 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.528 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.528 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704816 s, 149 MB/s 2024-09-11T22:20:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749043 s, 140 MB/s 2024-09-11T22:20:15.546 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.546 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.546 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719368 s, 146 MB/s 2024-09-11T22:20:15.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.554 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645033 s, 163 MB/s 2024-09-11T22:20:15.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.564 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827261 s, 127 MB/s 2024-09-11T22:20:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612381 s, 171 MB/s 2024-09-11T22:20:15.579 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649714 s, 161 MB/s 2024-09-11T22:20:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:15.586 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:15.587 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:15.587 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.27 2024-09-11T22:20:15.587 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:15.587 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:15.587 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:15.587 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:15.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.647 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701692 s, 149 MB/s 2024-09-11T22:20:15.655 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.655 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.655 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676832 s, 155 MB/s 2024-09-11T22:20:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647966 s, 162 MB/s 2024-09-11T22:20:15.672 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.672 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.672 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721109 s, 145 MB/s 2024-09-11T22:20:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725002 s, 145 MB/s 2024-09-11T22:20:15.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.690 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762704 s, 137 MB/s 2024-09-11T22:20:15.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.699 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704513 s, 149 MB/s 2024-09-11T22:20:15.708 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.708 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.708 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072409 s, 145 MB/s 2024-09-11T22:20:15.717 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.717 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.717 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770096 s, 136 MB/s 2024-09-11T22:20:15.726 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.726 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.726 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728846 s, 144 MB/s 2024-09-11T22:20:15.734 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.734 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.734 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640987 s, 164 MB/s 2024-09-11T22:20:15.743 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.743 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.743 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712938 s, 147 MB/s 2024-09-11T22:20:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650447 s, 161 MB/s 2024-09-11T22:20:15.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.760 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688141 s, 152 MB/s 2024-09-11T22:20:15.769 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.769 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.769 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736158 s, 142 MB/s 2024-09-11T22:20:15.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.777 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644223 s, 163 MB/s 2024-09-11T22:20:15.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.786 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069833 s, 150 MB/s 2024-09-11T22:20:15.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.794 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065575 s, 160 MB/s 2024-09-11T22:20:15.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.802 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717961 s, 146 MB/s 2024-09-11T22:20:15.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.811 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713161 s, 147 MB/s 2024-09-11T22:20:15.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.820 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715654 s, 147 MB/s 2024-09-11T22:20:15.828 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.828 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.828 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657031 s, 160 MB/s 2024-09-11T22:20:15.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.838 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779421 s, 135 MB/s 2024-09-11T22:20:15.847 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.847 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.847 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723768 s, 145 MB/s 2024-09-11T22:20:15.856 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.856 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.856 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721107 s, 145 MB/s 2024-09-11T22:20:15.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.864 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684496 s, 153 MB/s 2024-09-11T22:20:15.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.874 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772232 s, 136 MB/s 2024-09-11T22:20:15.883 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.883 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.883 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778403 s, 135 MB/s 2024-09-11T22:20:15.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.891 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624317 s, 168 MB/s 2024-09-11T22:20:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006399 s, 164 MB/s 2024-09-11T22:20:15.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.908 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741608 s, 141 MB/s 2024-09-11T22:20:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.917 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.918 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747577 s, 140 MB/s 2024-09-11T22:20:15.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:15.924 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:15.924 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:15.924 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.28 2024-09-11T22:20:15.924 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:15.924 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:15.925 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:15.925 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759897 s, 138 MB/s 2024-09-11T22:20:15.994 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:15.994 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:15.994 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682349 s, 154 MB/s 2024-09-11T22:20:16.002 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.002 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.003 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719595 s, 146 MB/s 2024-09-11T22:20:16.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.011 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.011 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649437 s, 161 MB/s 2024-09-11T22:20:16.020 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.020 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.020 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751881 s, 139 MB/s 2024-09-11T22:20:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.029 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750421 s, 140 MB/s 2024-09-11T22:20:16.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.037 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641687 s, 163 MB/s 2024-09-11T22:20:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632082 s, 166 MB/s 2024-09-11T22:20:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698264 s, 150 MB/s 2024-09-11T22:20:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740264 s, 142 MB/s 2024-09-11T22:20:16.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.073 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724099 s, 145 MB/s 2024-09-11T22:20:16.082 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.082 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.082 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696503 s, 151 MB/s 2024-09-11T22:20:16.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.092 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723322 s, 145 MB/s 2024-09-11T22:20:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650816 s, 161 MB/s 2024-09-11T22:20:16.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.110 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.110 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692125 s, 152 MB/s 2024-09-11T22:20:16.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.119 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733679 s, 143 MB/s 2024-09-11T22:20:16.128 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.128 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.128 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720122 s, 146 MB/s 2024-09-11T22:20:16.136 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.136 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.136 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675658 s, 155 MB/s 2024-09-11T22:20:16.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.146 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772466 s, 136 MB/s 2024-09-11T22:20:16.154 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.154 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.154 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709557 s, 148 MB/s 2024-09-11T22:20:16.163 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.163 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.163 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737019 s, 142 MB/s 2024-09-11T22:20:16.172 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.172 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.172 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720591 s, 146 MB/s 2024-09-11T22:20:16.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.182 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758587 s, 138 MB/s 2024-09-11T22:20:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739334 s, 142 MB/s 2024-09-11T22:20:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670213 s, 156 MB/s 2024-09-11T22:20:16.208 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.208 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.208 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717738 s, 146 MB/s 2024-09-11T22:20:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.217 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659518 s, 159 MB/s 2024-09-11T22:20:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.226 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756595 s, 139 MB/s 2024-09-11T22:20:16.233 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.233 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.233 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615078 s, 170 MB/s 2024-09-11T22:20:16.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.243 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.243 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785813 s, 133 MB/s 2024-09-11T22:20:16.252 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.252 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.252 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740623 s, 142 MB/s 2024-09-11T22:20:16.260 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.261 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.261 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708884 s, 148 MB/s 2024-09-11T22:20:16.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:16.268 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:16.268 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:16.268 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.29 2024-09-11T22:20:16.268 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:16.269 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:16.269 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:16.269 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:16.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:16.328 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.328 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.329 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669788 s, 157 MB/s 2024-09-11T22:20:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667802 s, 157 MB/s 2024-09-11T22:20:16.345 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.345 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722277 s, 145 MB/s 2024-09-11T22:20:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662418 s, 158 MB/s 2024-09-11T22:20:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.363 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743186 s, 141 MB/s 2024-09-11T22:20:16.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.371 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677143 s, 155 MB/s 2024-09-11T22:20:16.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.380 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067921 s, 154 MB/s 2024-09-11T22:20:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733374 s, 143 MB/s 2024-09-11T22:20:16.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.397 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661049 s, 159 MB/s 2024-09-11T22:20:16.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.406 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733954 s, 143 MB/s 2024-09-11T22:20:16.414 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.414 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.414 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658164 s, 159 MB/s 2024-09-11T22:20:16.423 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.423 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.423 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723262 s, 145 MB/s 2024-09-11T22:20:16.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.432 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722785 s, 145 MB/s 2024-09-11T22:20:16.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.441 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697039 s, 150 MB/s 2024-09-11T22:20:16.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.450 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739275 s, 142 MB/s 2024-09-11T22:20:16.459 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.459 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.459 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724107 s, 145 MB/s 2024-09-11T22:20:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729186 s, 144 MB/s 2024-09-11T22:20:16.477 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.477 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.477 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759851 s, 138 MB/s 2024-09-11T22:20:16.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.485 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654391 s, 160 MB/s 2024-09-11T22:20:16.494 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761887 s, 138 MB/s 2024-09-11T22:20:16.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.503 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657703 s, 159 MB/s 2024-09-11T22:20:16.511 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.511 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710189 s, 148 MB/s 2024-09-11T22:20:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752448 s, 139 MB/s 2024-09-11T22:20:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746018 s, 141 MB/s 2024-09-11T22:20:16.538 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.538 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.538 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644912 s, 163 MB/s 2024-09-11T22:20:16.546 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.546 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.546 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645566 s, 162 MB/s 2024-09-11T22:20:16.555 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.555 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.555 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725204 s, 145 MB/s 2024-09-11T22:20:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741625 s, 141 MB/s 2024-09-11T22:20:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796036 s, 132 MB/s 2024-09-11T22:20:16.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.582 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064437 s, 163 MB/s 2024-09-11T22:20:16.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.591 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714781 s, 147 MB/s 2024-09-11T22:20:16.599 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.600 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717026 s, 146 MB/s 2024-09-11T22:20:16.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:16.606 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:16.606 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:16.606 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.30 2024-09-11T22:20:16.606 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:16.607 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:16.607 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:16.607 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:16.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748533 s, 140 MB/s 2024-09-11T22:20:16.676 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.676 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.676 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716323 s, 146 MB/s 2024-09-11T22:20:16.684 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.684 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.684 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667111 s, 157 MB/s 2024-09-11T22:20:16.693 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.693 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.693 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718728 s, 146 MB/s 2024-09-11T22:20:16.702 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.702 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.702 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734093 s, 143 MB/s 2024-09-11T22:20:16.711 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.711 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.711 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706558 s, 148 MB/s 2024-09-11T22:20:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.721 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.721 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773441 s, 136 MB/s 2024-09-11T22:20:16.729 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.730 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.730 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732359 s, 143 MB/s 2024-09-11T22:20:16.739 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.739 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.739 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747498 s, 140 MB/s 2024-09-11T22:20:16.747 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.747 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.747 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665915 s, 157 MB/s 2024-09-11T22:20:16.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.756 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711221 s, 147 MB/s 2024-09-11T22:20:16.764 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.764 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.764 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670801 s, 156 MB/s 2024-09-11T22:20:16.772 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.772 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.773 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662432 s, 158 MB/s 2024-09-11T22:20:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704493 s, 149 MB/s 2024-09-11T22:20:16.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.790 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698505 s, 150 MB/s 2024-09-11T22:20:16.800 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.800 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.800 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793569 s, 132 MB/s 2024-09-11T22:20:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765249 s, 137 MB/s 2024-09-11T22:20:16.818 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.818 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.818 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690083 s, 152 MB/s 2024-09-11T22:20:16.827 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.827 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.827 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714243 s, 147 MB/s 2024-09-11T22:20:16.836 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.836 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.836 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712231 s, 147 MB/s 2024-09-11T22:20:16.844 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.844 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.845 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681312 s, 154 MB/s 2024-09-11T22:20:16.853 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.854 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.854 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742467 s, 141 MB/s 2024-09-11T22:20:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661535 s, 159 MB/s 2024-09-11T22:20:16.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.872 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835745 s, 125 MB/s 2024-09-11T22:20:16.880 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.880 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.880 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635847 s, 165 MB/s 2024-09-11T22:20:16.889 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.889 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.889 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071836 s, 146 MB/s 2024-09-11T22:20:16.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.898 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.898 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775441 s, 135 MB/s 2024-09-11T22:20:16.906 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.906 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.907 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654615 s, 160 MB/s 2024-09-11T22:20:16.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.916 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766429 s, 137 MB/s 2024-09-11T22:20:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710159 s, 148 MB/s 2024-09-11T22:20:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855019 s, 123 MB/s 2024-09-11T22:20:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715728 s, 147 MB/s 2024-09-11T22:20:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:16.952 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:20:16.952 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:16.952 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.31 2024-09-11T22:20:16.952 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:20:16.952 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:20:16.952 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:20:16.952 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:17.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651687 s, 161 MB/s 2024-09-11T22:20:17.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.021 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651115 s, 161 MB/s 2024-09-11T22:20:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732529 s, 143 MB/s 2024-09-11T22:20:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717443 s, 146 MB/s 2024-09-11T22:20:17.049 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.049 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.049 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736018 s, 142 MB/s 2024-09-11T22:20:17.059 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.060 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.060 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0081388 s, 129 MB/s 2024-09-11T22:20:17.069 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.069 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.069 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685994 s, 153 MB/s 2024-09-11T22:20:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072203 s, 145 MB/s 2024-09-11T22:20:17.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.090 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999334 s, 105 MB/s 2024-09-11T22:20:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693149 s, 151 MB/s 2024-09-11T22:20:17.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.108 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672758 s, 156 MB/s 2024-09-11T22:20:17.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.117 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739671 s, 142 MB/s 2024-09-11T22:20:17.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.126 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659587 s, 159 MB/s 2024-09-11T22:20:17.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.135 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754035 s, 139 MB/s 2024-09-11T22:20:17.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723265 s, 145 MB/s 2024-09-11T22:20:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.152 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659107 s, 159 MB/s 2024-09-11T22:20:17.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.161 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718254 s, 146 MB/s 2024-09-11T22:20:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.170 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734218 s, 143 MB/s 2024-09-11T22:20:17.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.179 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741817 s, 141 MB/s 2024-09-11T22:20:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707307 s, 148 MB/s 2024-09-11T22:20:17.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.197 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720929 s, 145 MB/s 2024-09-11T22:20:17.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.206 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743719 s, 141 MB/s 2024-09-11T22:20:17.214 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.215 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721388 s, 145 MB/s 2024-09-11T22:20:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719508 s, 146 MB/s 2024-09-11T22:20:17.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.232 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655837 s, 160 MB/s 2024-09-11T22:20:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.241 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.241 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716245 s, 146 MB/s 2024-09-11T22:20:17.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.250 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718508 s, 146 MB/s 2024-09-11T22:20:17.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.258 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637013 s, 165 MB/s 2024-09-11T22:20:17.265 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.265 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.265 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627507 s, 167 MB/s 2024-09-11T22:20:17.274 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.274 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.274 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007403 s, 142 MB/s 2024-09-11T22:20:17.282 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.282 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.282 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644581 s, 163 MB/s 2024-09-11T22:20:17.290 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:20:17.290 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:20:17.291 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658957 s, 159 MB/s 2024-09-11T22:20:17.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:17.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:17.297 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub start /scrub_control_test_path recursive 2024-09-11T22:20:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.405+0000 7f06420dd640 1 Processor -- start 2024-09-11T22:20:17.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.405+0000 7f06420dd640 1 -- start start 2024-09-11T22:20:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.406+0000 7f06420dd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f063c15c300 0x7f063c0b0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.406+0000 7f06420dd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c0ce340 0x7f063c06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.406+0000 7f06420dd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f063c0b0710 con 0x7f063c0b1e80 2024-09-11T22:20:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.406+0000 7f06420dd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f063c0b6380 con 0x7f063c15c300 2024-09-11T22:20:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.406+0000 7f06420dd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f063c0b65d0 con 0x7f063c0ce340 2024-09-11T22:20:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.406+0000 7f063b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f063c15c300 0x7f063c0b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.406+0000 7f063b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f063c15c300 0x7f063c0b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48768/0 (socket says 172.21.15.50:48768) 2024-09-11T22:20:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.406+0000 7f063b7fe640 1 -- 172.21.15.50:0/1016595744 learned_addr learned my addr 172.21.15.50:0/1016595744 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.406+0000 7f063affd640 1 --2- 172.21.15.50:0/1016595744 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c0ce340 0x7f063c06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.407+0000 7f063b7fe640 1 -- 172.21.15.50:0/1016595744 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c0ce340 msgr2=0x7f063c06dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.407+0000 7f063b7fe640 1 --2- 172.21.15.50:0/1016595744 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c0ce340 0x7f063c06dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.407+0000 7f063b7fe640 1 -- 172.21.15.50:0/1016595744 >> v1:172.21.15.77:6789/0 conn(0x7f063c0b1e80 legacy=0x7f063c15cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.407+0000 7f063b7fe640 1 -- 172.21.15.50:0/1016595744 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c0b68b0 con 0x7f063c15c300 2024-09-11T22:20:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.407+0000 7f063b7fe640 1 --2- 172.21.15.50:0/1016595744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c15c300 0x7f063c0b0130 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f063c0b6500 tx=0x7f062c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f55323727555986 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.407+0000 7f063a7fc640 1 -- 172.21.15.50:0/1016595744 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c037070 con 0x7f063c15c300 2024-09-11T22:20:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.407+0000 7f063a7fc640 1 -- 172.21.15.50:0/1016595744 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c032440 con 0x7f063c15c300 2024-09-11T22:20:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.407+0000 7f063a7fc640 1 -- 172.21.15.50:0/1016595744 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c032810 con 0x7f063c15c300 2024-09-11T22:20:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.408+0000 7f06420dd640 1 -- 172.21.15.50:0/1016595744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c15c300 msgr2=0x7f063c0b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.408+0000 7f06420dd640 1 --2- 172.21.15.50:0/1016595744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c15c300 0x7f063c0b0130 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f063c0b6500 tx=0x7f062c02a250 comp rx=0 tx=0).stop 2024-09-11T22:20:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.408+0000 7f06420dd640 1 -- 172.21.15.50:0/1016595744 shutdown_connections 2024-09-11T22:20:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.408+0000 7f06420dd640 1 --2- 172.21.15.50:0/1016595744 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c0ce340 0x7f063c06dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.408+0000 7f06420dd640 1 --2- 172.21.15.50:0/1016595744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c15c300 0x7f063c0b0130 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.408+0000 7f06420dd640 1 -- 172.21.15.50:0/1016595744 >> 172.21.15.50:0/1016595744 conn(0x7f063c0b0a60 msgr2=0x7f063c073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.408+0000 7f06420dd640 1 -- 172.21.15.50:0/1016595744 shutdown_connections 2024-09-11T22:20:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.408+0000 7f06420dd640 1 -- 172.21.15.50:0/1016595744 wait complete. 2024-09-11T22:20:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.409+0000 7f06420dd640 1 Processor -- start 2024-09-11T22:20:17.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.410+0000 7f06420dd640 1 -- start start 2024-09-11T22:20:17.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.410+0000 7f06420dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063c0b1e80 0x7f063c13fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.410+0000 7f06420dd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c0ce340 0x7f063c13dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.410+0000 7f06420dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c15c300 0x7f063c13e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.410+0000 7f06420dd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f063c15c6e0 con 0x7f063c15c300 2024-09-11T22:20:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.410+0000 7f06420dd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f063c06e110 con 0x7f063c0b1e80 2024-09-11T22:20:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.410+0000 7f06420dd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f063c15c860 con 0x7f063c0ce340 2024-09-11T22:20:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.410+0000 7f063bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c15c300 0x7f063c13e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.410+0000 7f063b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063c0b1e80 0x7f063c13fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.410+0000 7f063affd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c0ce340 0x7f063c13dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.410+0000 7f063bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c15c300 0x7f063c13e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48780/0 (socket says 172.21.15.50:48780) 2024-09-11T22:20:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.410+0000 7f063bfff640 1 -- 172.21.15.50:0/1209208461 learned_addr learned my addr 172.21.15.50:0/1209208461 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.411+0000 7f063bfff640 1 -- 172.21.15.50:0/1209208461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c0ce340 msgr2=0x7f063c13dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.411+0000 7f063bfff640 1 --2- 172.21.15.50:0/1209208461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c0ce340 0x7f063c13dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.411+0000 7f063bfff640 1 -- 172.21.15.50:0/1209208461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063c0b1e80 msgr2=0x7f063c13fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.411+0000 7f063bfff640 1 --2- 172.21.15.50:0/1209208461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063c0b1e80 0x7f063c13fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.411+0000 7f063bfff640 1 -- 172.21.15.50:0/1209208461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c13ed60 con 0x7f063c15c300 2024-09-11T22:20:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.411+0000 7f063b7fe640 1 --2- 172.21.15.50:0/1209208461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063c0b1e80 0x7f063c13fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.411+0000 7f063bfff640 1 --2- 172.21.15.50:0/1209208461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c15c300 0x7f063c13e380 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f063400c7a0 tx=0x7f063400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.411+0000 7f0623fff640 1 -- 172.21.15.50:0/1209208461 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634003b70 con 0x7f063c15c300 2024-09-11T22:20:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.411+0000 7f0623fff640 1 -- 172.21.15.50:0/1209208461 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0634003d30 con 0x7f063c15c300 2024-09-11T22:20:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.411+0000 7f06420dd640 1 -- 172.21.15.50:0/1209208461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063c13f040 con 0x7f063c15c300 2024-09-11T22:20:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.411+0000 7f0623fff640 1 -- 172.21.15.50:0/1209208461 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063400aa90 con 0x7f063c15c300 2024-09-11T22:20:17.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.411+0000 7f06420dd640 1 -- 172.21.15.50:0/1209208461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063c13f600 con 0x7f063c15c300 2024-09-11T22:20:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.413+0000 7f0623fff640 1 -- 172.21.15.50:0/1209208461 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f063400ac30 con 0x7f063c15c300 2024-09-11T22:20:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.413+0000 7f0623fff640 1 --2- 172.21.15.50:0/1209208461 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062806be30 0x7f062806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.413+0000 7f0623fff640 1 -- 172.21.15.50:0/1209208461 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f063408ac30 con 0x7f063c15c300 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.413+0000 7f063b7fe640 1 --2- 172.21.15.50:0/1209208461 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062806be30 0x7f062806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.414+0000 7f063b7fe640 1 --2- 172.21.15.50:0/1209208461 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062806be30 0x7f062806e2f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f062c034000 tx=0x7f062c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.414+0000 7f0644e7c740 1 Processor -- start 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.414+0000 7f0644e7c740 1 -- start start 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f0644e7c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x5567387db700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f0644e7c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387dd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f0644e7c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387dd390 0x5567387ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f0644e7c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5567386fabc0 con 0x5567387ad330 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f0644e7c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5567386a2970 con 0x5567387acc00 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f0644e7c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5567386f6b80 con 0x5567387dd390 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f063affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387dd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f063affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387dd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48786/0 (socket says 172.21.15.50:48786) 2024-09-11T22:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f063affd640 1 -- 172.21.15.50:0/3898621709 learned_addr learned my addr 172.21.15.50:0/3898621709 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f063bfff640 1 --2- 172.21.15.50:0/3898621709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387dd390 0x5567387ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f063b7fe640 1 --2- 172.21.15.50:0/3898621709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x5567387db700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f063affd640 1 -- 172.21.15.50:0/3898621709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387dd390 msgr2=0x5567387ddeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f063affd640 1 --2- 172.21.15.50:0/3898621709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387dd390 0x5567387ddeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f063affd640 1 -- 172.21.15.50:0/3898621709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 msgr2=0x5567387db700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f063affd640 1 --2- 172.21.15.50:0/3898621709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x5567387db700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f063affd640 1 -- 172.21.15.50:0/3898621709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567384d9ba0 con 0x5567387ad330 2024-09-11T22:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.415+0000 7f063affd640 1 --2- 172.21.15.50:0/3898621709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387dd970 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f0630009b60 tx=0x7f0630011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab1727064de066c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.416+0000 7f06217fa640 1 -- 172.21.15.50:0/3898621709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630009e60 con 0x5567387ad330 2024-09-11T22:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.416+0000 7f06217fa640 1 -- 172.21.15.50:0/3898621709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0630004030 con 0x5567387ad330 2024-09-11T22:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.416+0000 7f06217fa640 1 -- 172.21.15.50:0/3898621709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06300043e0 con 0x5567387ad330 2024-09-11T22:20:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.416+0000 7f0644e7c740 1 -- 172.21.15.50:0/3898621709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 msgr2=0x5567387dd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.416+0000 7f0644e7c740 1 --2- 172.21.15.50:0/3898621709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387dd970 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f0630009b60 tx=0x7f0630011690 comp rx=0 tx=0).stop 2024-09-11T22:20:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.416+0000 7f0644e7c740 1 -- 172.21.15.50:0/3898621709 shutdown_connections 2024-09-11T22:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.416+0000 7f0644e7c740 1 --2- 172.21.15.50:0/3898621709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387dd390 0x5567387ddeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.416+0000 7f0644e7c740 1 --2- 172.21.15.50:0/3898621709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387dd970 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.416+0000 7f0644e7c740 1 --2- 172.21.15.50:0/3898621709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x5567387db700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.416+0000 7f0644e7c740 1 -- 172.21.15.50:0/3898621709 >> 172.21.15.50:0/3898621709 conn(0x556738793c20 msgr2=0x5567387dbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.416+0000 7f0644e7c740 1 -- 172.21.15.50:0/3898621709 shutdown_connections 2024-09-11T22:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.416+0000 7f0644e7c740 1 -- 172.21.15.50:0/3898621709 wait complete. 2024-09-11T22:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.417+0000 7f0644e7c740 1 -- start start 2024-09-11T22:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.417+0000 7f0644e7c740 1 Processor -- start 2024-09-11T22:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f0644e7c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f0644e7c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387dd390 0x5567387c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f0644e7c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387d40b0 0x5567387c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f0644e7c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5567387da660 con 0x5567387ad330 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f0644e7c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5567386b5d70 con 0x5567387dd390 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f0644e7c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5567387da940 con 0x5567387d40b0 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f0644e7c740 10 client.0 _ll_register_callbacks cb 0x55673840cf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f063b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f063b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387c2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48802/0 (socket says 172.21.15.50:48802) 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f063b7fe640 1 -- 172.21.15.50:0/2919933028 learned_addr learned my addr 172.21.15.50:0/2919933028 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f063affd640 1 --2- 172.21.15.50:0/2919933028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387dd390 0x5567387c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f063bfff640 1 --2- 172.21.15.50:0/2919933028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387d40b0 0x5567387c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f063b7fe640 1 -- 172.21.15.50:0/2919933028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387d40b0 msgr2=0x5567387c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f063b7fe640 1 --2- 172.21.15.50:0/2919933028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387d40b0 0x5567387c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f063b7fe640 1 -- 172.21.15.50:0/2919933028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387dd390 msgr2=0x5567387c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f063b7fe640 1 --2- 172.21.15.50:0/2919933028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387dd390 0x5567387c11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f063b7fe640 1 -- 172.21.15.50:0/2919933028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567383cd490 con 0x5567387ad330 2024-09-11T22:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f063b7fe640 1 --2- 172.21.15.50:0/2919933028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387c2360 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f062c000c00 tx=0x7f062c02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1eec3533d12df server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.418+0000 7f061a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f061a7fc640 1 -- 172.21.15.50:0/2919933028 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c037040 con 0x5567387ad330 2024-09-11T22:20:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f061a7fc640 1 -- 172.21.15.50:0/2919933028 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f062c03cb90 con 0x5567387ad330 2024-09-11T22:20:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f0644e7c740 1 -- 172.21.15.50:0/2919933028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0630004030 con 0x5567387ad330 2024-09-11T22:20:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f061a7fc640 1 -- 172.21.15.50:0/2919933028 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f062c03cd90 con 0x5567387ad330 2024-09-11T22:20:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f0644e7c740 10 client.9081 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f0644e7c740 1 -- 172.21.15.50:0/2919933028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x55673853a330 con 0x5567387ad330 2024-09-11T22:20:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f061a7fc640 1 -- 172.21.15.50:0/2919933028 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0630004030 con 0x5567387ad330 2024-09-11T22:20:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f061a7fc640 1 -- 172.21.15.50:0/2919933028 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f062c04a470 con 0x5567387ad330 2024-09-11T22:20:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f0644e7c740 10 client.9081 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f0644e7c740 10 client.9081 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f0644e7c740 20 client.9081 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f0644e7c740 1 --2- 172.21.15.50:0/2919933028 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5567387f3df0 0x5567387f4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f0644e7c740 4 client.9081 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f0644e7c740 1 -- 172.21.15.50:0/2919933028 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55673867fc80 con 0x5567387f3df0 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.419+0000 7f063affd640 1 --2- 172.21.15.50:0/2919933028 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5567387f3df0 0x5567387f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f061a7fc640 10 client.9081 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f063affd640 1 --2- 172.21.15.50:0/2919933028 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5567387f3df0 0x5567387f4230 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b3c2697472422e3 server_cookie=67e086736bb5aaaf in_seq=0 out_seq=0 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f061a7fc640 1 -- 172.21.15.50:0/2919933028 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55673867fc80 con 0x5567387f3df0 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f061a7fc640 10 client.9081 handle_command_reply: tid=0 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f0644e7c740 1 client.9081 shutdown 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f0644e7c740 1 -- 172.21.15.50:0/2919933028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 msgr2=0x5567387c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f0644e7c740 1 --2- 172.21.15.50:0/2919933028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387c2360 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f062c000c00 tx=0x7f062c02c070 comp rx=0 tx=0).stop 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f0644e7c740 1 -- 172.21.15.50:0/2919933028 shutdown_connections 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f0644e7c740 1 --2- 172.21.15.50:0/2919933028 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5567387f3df0 0x5567387f4230 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f0644e7c740 1 --2- 172.21.15.50:0/2919933028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387d40b0 0x5567387c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f0644e7c740 1 --2- 172.21.15.50:0/2919933028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387dd390 0x5567387c11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f0644e7c740 1 --2- 172.21.15.50:0/2919933028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387c2360 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f061a7fc640 0 client.9081 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f0644e7c740 1 -- 172.21.15.50:0/2919933028 >> 172.21.15.50:0/2919933028 conn(0x5567387acc00 msgr2=0x5567387909b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f0644e7c740 1 -- 172.21.15.50:0/2919933028 shutdown_connections 2024-09-11T22:20:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.420+0000 7f0644e7c740 1 -- 172.21.15.50:0/2919933028 wait complete. 2024-09-11T22:20:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.421+0000 7f0644e7c740 20 client.9081 trim_cache size 0 max 16384 2024-09-11T22:20:17.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.438+0000 7f0644e7c740 1 Processor -- start 2024-09-11T22:20:17.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.439+0000 7f0644e7c740 1 -- start start 2024-09-11T22:20:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.439+0000 7f0644e7c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x5567387c2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.439+0000 7f0644e7c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387fa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.439+0000 7f0644e7c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387d40b0 0x556738797390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.439+0000 7f0644e7c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f063c1fc990 con 0x5567387ad330 2024-09-11T22:20:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.439+0000 7f0644e7c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f063c1404f0 con 0x5567387acc00 2024-09-11T22:20:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.439+0000 7f0644e7c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f063c0b5560 con 0x5567387d40b0 2024-09-11T22:20:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.439+0000 7f063affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.440+0000 7f063affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387fa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48806/0 (socket says 172.21.15.50:48806) 2024-09-11T22:20:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.440+0000 7f063affd640 1 -- 172.21.15.50:0/2926812579 learned_addr learned my addr 172.21.15.50:0/2926812579 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.440+0000 7f063bfff640 1 --2- 172.21.15.50:0/2926812579 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387d40b0 0x556738797390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.440+0000 7f063b7fe640 1 --2- 172.21.15.50:0/2926812579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x5567387c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.440+0000 7f063affd640 1 -- 172.21.15.50:0/2926812579 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387d40b0 msgr2=0x556738797390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.440+0000 7f063affd640 1 --2- 172.21.15.50:0/2926812579 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387d40b0 0x556738797390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.440+0000 7f063affd640 1 -- 172.21.15.50:0/2926812579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 msgr2=0x5567387c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.440+0000 7f063affd640 1 --2- 172.21.15.50:0/2926812579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x5567387c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.440+0000 7f063affd640 1 -- 172.21.15.50:0/2926812579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567383a6550 con 0x5567387ad330 2024-09-11T22:20:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.440+0000 7f063affd640 1 --2- 172.21.15.50:0/2926812579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387fa410 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f0630009920 tx=0x7f0630008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac356b7d1d8ad4c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.440+0000 7f0620ff9640 1 -- 172.21.15.50:0/2926812579 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630003610 con 0x5567387ad330 2024-09-11T22:20:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.440+0000 7f0620ff9640 1 -- 172.21.15.50:0/2926812579 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06300037d0 con 0x5567387ad330 2024-09-11T22:20:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.440+0000 7f0620ff9640 1 -- 172.21.15.50:0/2926812579 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630003bc0 con 0x5567387ad330 2024-09-11T22:20:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.441+0000 7f0644e7c740 1 -- 172.21.15.50:0/2926812579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 msgr2=0x5567387fa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.441+0000 7f0644e7c740 1 --2- 172.21.15.50:0/2926812579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387fa410 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f0630009920 tx=0x7f0630008030 comp rx=0 tx=0).stop 2024-09-11T22:20:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.441+0000 7f0644e7c740 1 -- 172.21.15.50:0/2926812579 shutdown_connections 2024-09-11T22:20:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.441+0000 7f0644e7c740 1 --2- 172.21.15.50:0/2926812579 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387d40b0 0x556738797390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.441+0000 7f0644e7c740 1 --2- 172.21.15.50:0/2926812579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387ad330 0x5567387fa410 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.441+0000 7f0644e7c740 1 --2- 172.21.15.50:0/2926812579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x5567387c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.441+0000 7f0644e7c740 1 -- 172.21.15.50:0/2926812579 >> 172.21.15.50:0/2926812579 conn(0x556738790d20 msgr2=0x5567387df930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.441+0000 7f0644e7c740 1 -- 172.21.15.50:0/2926812579 shutdown_connections 2024-09-11T22:20:17.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.441+0000 7f0644e7c740 1 -- 172.21.15.50:0/2926812579 wait complete. 2024-09-11T22:20:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.441+0000 7f0644e7c740 1 -- start start 2024-09-11T22:20:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f0644e7c740 1 Processor -- start 2024-09-11T22:20:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f0644e7c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x55673885e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f0644e7c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387ad330 0x5567387915e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f0644e7c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387d40b0 0x556738791b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f0644e7c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5567387be0b0 con 0x5567387d40b0 2024-09-11T22:20:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f0644e7c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f063c0b5bb0 con 0x5567387acc00 2024-09-11T22:20:17.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f0644e7c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5567387b7b30 con 0x5567387ad330 2024-09-11T22:20:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f0644e7c740 10 client.0 _ll_register_callbacks cb 0x7f0630009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f063bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387d40b0 0x556738791b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f063b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x55673885e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f063b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x55673885e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:34276/0 (socket says 172.21.15.50:34276) 2024-09-11T22:20:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f063bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387d40b0 0x556738791b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48816/0 (socket says 172.21.15.50:48816) 2024-09-11T22:20:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f063b7fe640 1 -- 172.21.15.50:0/3604068036 learned_addr learned my addr 172.21.15.50:0/3604068036 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.442+0000 7f063affd640 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387ad330 0x5567387915e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f063b7fe640 1 -- 172.21.15.50:0/3604068036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387ad330 msgr2=0x5567387915e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f063b7fe640 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387ad330 0x5567387915e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f063b7fe640 1 -- 172.21.15.50:0/3604068036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387d40b0 msgr2=0x556738791b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f063b7fe640 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387d40b0 0x556738791b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f063b7fe640 1 -- 172.21.15.50:0/3604068036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556738804c30 con 0x5567387acc00 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f063affd640 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387ad330 0x5567387915e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f063bfff640 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387d40b0 0x556738791b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f063b7fe640 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x55673885e770 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f062c032fd0 tx=0x7f062c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69b751a0ddc4b039 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f061a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f061a7fc640 1 -- 172.21.15.50:0/3604068036 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c037040 con 0x5567387acc00 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f061a7fc640 1 -- 172.21.15.50:0/3604068036 <== mon.1 v2:172.21.15.77:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f062c04ad80 con 0x5567387acc00 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f0644e7c740 1 -- 172.21.15.50:0/3604068036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06300037d0 con 0x5567387acc00 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f061a7fc640 1 -- 172.21.15.50:0/3604068036 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f062c063050 con 0x5567387acc00 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f0644e7c740 10 client.8197 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f0644e7c740 1 -- 172.21.15.50:0/3604068036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x5567387d3090 con 0x5567387acc00 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.443+0000 7f061a7fc640 1 -- 172.21.15.50:0/3604068036 <== mon.1 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06300037d0 con 0x5567387acc00 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.444+0000 7f061a7fc640 1 -- 172.21.15.50:0/3604068036 <== mon.1 v2:172.21.15.77:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f062c05b480 con 0x5567387acc00 2024-09-11T22:20:17.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.444+0000 7f0644e7c740 10 client.8197 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.444+0000 7f0644e7c740 10 client.8197 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.444+0000 7f0644e7c740 20 client.8197 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.444+0000 7f0644e7c740 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5567387dd390 0x5567387c0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.444+0000 7f0644e7c740 4 client.8197 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-11T22:20:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.444+0000 7f0644e7c740 1 -- 172.21.15.50:0/3604068036 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x5567387082f0 con 0x5567387dd390 2024-09-11T22:20:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.444+0000 7f063affd640 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5567387dd390 0x5567387c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.444+0000 7f061a7fc640 10 client.8197 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.444+0000 7f063affd640 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5567387dd390 0x5567387c0840 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=783297e8a25de7e4 server_cookie=4c104238ce976273 in_seq=0 out_seq=0 2024-09-11T22:20:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.446+0000 7f061a7fc640 1 -- 172.21.15.50:0/3604068036 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5567387082f0 con 0x5567387dd390 2024-09-11T22:20:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.446+0000 7f061a7fc640 10 client.8197 handle_command_reply: tid=0 2024-09-11T22:20:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.446+0000 7f0644e7c740 1 client.8197 shutdown 2024-09-11T22:20:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.446+0000 7f0644e7c740 1 -- 172.21.15.50:0/3604068036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 msgr2=0x55673885e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.446+0000 7f0644e7c740 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x55673885e770 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f062c032fd0 tx=0x7f062c004730 comp rx=0 tx=0).stop 2024-09-11T22:20:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.446+0000 7f0644e7c740 1 -- 172.21.15.50:0/3604068036 shutdown_connections 2024-09-11T22:20:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.446+0000 7f0644e7c740 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5567387dd390 0x5567387c0840 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.446+0000 7f0644e7c740 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5567387ad330 0x5567387915e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.446+0000 7f0644e7c740 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567387d40b0 0x556738791b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.446+0000 7f061a7fc640 0 client.8197 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.446+0000 7f0644e7c740 1 --2- 172.21.15.50:0/3604068036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567387acc00 0x55673885e770 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.446+0000 7f0644e7c740 1 -- 172.21.15.50:0/3604068036 >> 172.21.15.50:0/3604068036 conn(0x556738790d20 msgr2=0x5567387c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f0644e7c740 1 -- 172.21.15.50:0/3604068036 shutdown_connections 2024-09-11T22:20:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f0644e7c740 1 -- 172.21.15.50:0/3604068036 wait complete. 2024-09-11T22:20:17.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f0644e7c740 20 client.8197 trim_cache size 0 max 16384 2024-09-11T22:20:17.452 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:20:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:20:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "8f24f16a-7509-4efa-9dbc-0bc708c1839b", 2024-09-11T22:20:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:20:17.453 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:20:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f06420dd640 1 -- 172.21.15.50:0/1209208461 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062806be30 msgr2=0x7f062806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f06420dd640 1 --2- 172.21.15.50:0/1209208461 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062806be30 0x7f062806e2f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f062c034000 tx=0x7f062c02e000 comp rx=0 tx=0).stop 2024-09-11T22:20:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f06420dd640 1 -- 172.21.15.50:0/1209208461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c15c300 msgr2=0x7f063c13e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f06420dd640 1 --2- 172.21.15.50:0/1209208461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c15c300 0x7f063c13e380 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f063400c7a0 tx=0x7f063400cc60 comp rx=0 tx=0).stop 2024-09-11T22:20:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f06420dd640 1 -- 172.21.15.50:0/1209208461 shutdown_connections 2024-09-11T22:20:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f06420dd640 1 --2- 172.21.15.50:0/1209208461 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062806be30 0x7f062806e2f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f06420dd640 1 --2- 172.21.15.50:0/1209208461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c0ce340 0x7f063c13dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f06420dd640 1 --2- 172.21.15.50:0/1209208461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c15c300 0x7f063c13e380 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f06420dd640 1 --2- 172.21.15.50:0/1209208461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063c0b1e80 0x7f063c13fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f06420dd640 1 -- 172.21.15.50:0/1209208461 >> 172.21.15.50:0/1209208461 conn(0x7f063c0b0a60 msgr2=0x7f063c15d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f06420dd640 1 -- 172.21.15.50:0/1209208461 shutdown_connections 2024-09-11T22:20:17.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.447+0000 7f06420dd640 1 -- 172.21.15.50:0/1209208461 wait complete. 2024-09-11T22:20:17.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:17.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub pause 2024-09-11T22:20:17.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.591+0000 7f90de65e640 1 Processor -- start 2024-09-11T22:20:17.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.591+0000 7f90de65e640 1 -- start start 2024-09-11T22:20:17.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.592+0000 7f90de65e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f90d80b3e10 0x7f90d80b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.592+0000 7f90de65e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d80b4f00 con 0x7f90d815c2c0 2024-09-11T22:20:17.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.592+0000 7f90de65e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d80b4360 con 0x7f90d80d05e0 2024-09-11T22:20:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.592+0000 7f90de65e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f90d80b51c0 con 0x7f90d80b3e10 2024-09-11T22:20:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.592+0000 7f90d7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f90d815c2c0 0x7f90d80cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53086/0 (socket says 172.21.15.50:53086) 2024-09-11T22:20:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.592+0000 7f90d7fff640 1 -- 172.21.15.50:0/1136510103 learned_addr learned my addr 172.21.15.50:0/1136510103 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.592+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/1136510103 >> v2:172.21.15.77:3300/0 conn(0x7f90d80b3e10 0x7f90d80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.592+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3317520146 0 0) 0x7f90d80b4f00 con 0x7f90d815c2c0 2024-09-11T22:20:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.592+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90c0003520 con 0x7f90d815c2c0 2024-09-11T22:20:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.592+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1843861853 0 0) 0x7f90c0003520 con 0x7f90d815c2c0 2024-09-11T22:20:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.592+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 >> v2:172.21.15.77:3300/0 conn(0x7f90d80b3e10 msgr2=0x7f90d80b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.592+0000 7f90d6ffd640 1 --2- 172.21.15.50:0/1136510103 >> v2:172.21.15.77:3300/0 conn(0x7f90d80b3e10 0x7f90d80b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.592+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 >> v1:172.21.15.77:6789/0 conn(0x7f90d80d05e0 legacy=0x7f90d80ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d80b54a0 con 0x7f90d815c2c0 2024-09-11T22:20:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f90c8001670 con 0x7f90d815c2c0 2024-09-11T22:20:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 >> v1:172.21.15.50:6789/0 conn(0x7f90d815c2c0 legacy=0x7f90d80cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90d6ffd640 1 --2- 172.21.15.50:0/1136510103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90c00039b0 0x7f90c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90d6ffd640 1 --2- 172.21.15.50:0/1136510103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90c0004800 0x7f90c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90d6ffd640 1 --2- 172.21.15.50:0/1136510103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c00051c0 0x7f90c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f90d80b51c0 con 0x7f90c00051c0 2024-09-11T22:20:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f90c000c060 con 0x7f90c00039b0 2024-09-11T22:20:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f90c000c260 con 0x7f90c0004800 2024-09-11T22:20:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/1136510103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c00051c0 0x7f90c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90d7fff640 1 --2- 172.21.15.50:0/1136510103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90c00039b0 0x7f90c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90d77fe640 1 --2- 172.21.15.50:0/1136510103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90c0004800 0x7f90c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90dcbfb640 1 -- 172.21.15.50:0/1136510103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90c0004800 msgr2=0x7f90c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/1136510103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90c0004800 0x7f90c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90dcbfb640 1 -- 172.21.15.50:0/1136510103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90c00039b0 msgr2=0x7f90c0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/1136510103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90c00039b0 0x7f90c0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.593+0000 7f90dcbfb640 1 -- 172.21.15.50:0/1136510103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c0003520 con 0x7f90c00051c0 2024-09-11T22:20:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.594+0000 7f90dcbfb640 1 -- 172.21.15.50:0/1136510103 reap_dead start 2024-09-11T22:20:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.594+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/1136510103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c00051c0 0x7f90c000b9c0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009fc0 tx=0x7f90c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b664ec5a5e2169f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.594+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0035020 con 0x7f90c00051c0 2024-09-11T22:20:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.594+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d0003bd0 con 0x7f90c00051c0 2024-09-11T22:20:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.594+0000 7f90d6ffd640 1 -- 172.21.15.50:0/1136510103 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0009c10 con 0x7f90c00051c0 2024-09-11T22:20:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.594+0000 7f90de65e640 1 -- 172.21.15.50:0/1136510103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c00051c0 msgr2=0x7f90c000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.594+0000 7f90de65e640 1 --2- 172.21.15.50:0/1136510103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c00051c0 0x7f90c000b9c0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009fc0 tx=0x7f90c0005830 comp rx=0 tx=0).stop 2024-09-11T22:20:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.595+0000 7f90de65e640 1 -- 172.21.15.50:0/1136510103 shutdown_connections 2024-09-11T22:20:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.595+0000 7f90de65e640 1 --2- 172.21.15.50:0/1136510103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c00051c0 0x7f90c000b9c0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.595+0000 7f90de65e640 1 -- 172.21.15.50:0/1136510103 >> 172.21.15.50:0/1136510103 conn(0x7f90d80679c0 msgr2=0x7f90d8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.595+0000 7f90de65e640 1 -- 172.21.15.50:0/1136510103 shutdown_connections 2024-09-11T22:20:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.595+0000 7f90de65e640 1 -- 172.21.15.50:0/1136510103 wait complete. 2024-09-11T22:20:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.596+0000 7f90de65e640 1 Processor -- start 2024-09-11T22:20:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.596+0000 7f90de65e640 1 -- start start 2024-09-11T22:20:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90de65e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90c00051c0 0x7f90d8149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90de65e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90d80cab00 0x7f90d80caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90de65e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d815ff80 0x7f90d8160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90de65e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f90d806d070 con 0x7f90d815ff80 2024-09-11T22:20:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90de65e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f90d80ce200 con 0x7f90c00051c0 2024-09-11T22:20:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90de65e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f90d806d1f0 con 0x7f90d80cab00 2024-09-11T22:20:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90dcbfb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d815ff80 0x7f90d8160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90c00051c0 0x7f90d8149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90dcbfb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d815ff80 0x7f90d8160400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57128/0 (socket says 172.21.15.50:57128) 2024-09-11T22:20:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90dcbfb640 1 -- 172.21.15.50:0/2145705925 learned_addr learned my addr 172.21.15.50:0/2145705925 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90d77fe640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90d80cab00 0x7f90d80caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90dcbfb640 1 -- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90d80cab00 msgr2=0x7f90d80caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90d80cab00 0x7f90d80caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90dcbfb640 1 -- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90c00051c0 msgr2=0x7f90d8149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90c00051c0 0x7f90d8149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90dcbfb640 1 -- 172.21.15.50:0/2145705925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d80c9780 con 0x7f90d815ff80 2024-09-11T22:20:17.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90d7fff640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90c00051c0 0x7f90d8149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:17.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90d77fe640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90d80cab00 0x7f90d80caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:17.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.597+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d815ff80 0x7f90d8160400 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f90d000e200 tx=0x7f90d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.598+0000 7f90d4ff9640 1 -- 172.21.15.50:0/2145705925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0035030 con 0x7f90d815ff80 2024-09-11T22:20:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.598+0000 7f90d4ff9640 1 -- 172.21.15.50:0/2145705925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d0043070 con 0x7f90d815ff80 2024-09-11T22:20:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.598+0000 7f90de65e640 1 -- 172.21.15.50:0/2145705925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d80c9a60 con 0x7f90d815ff80 2024-09-11T22:20:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.598+0000 7f90d4ff9640 1 -- 172.21.15.50:0/2145705925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d002d070 con 0x7f90d815ff80 2024-09-11T22:20:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.598+0000 7f90de65e640 1 -- 172.21.15.50:0/2145705925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d80ca020 con 0x7f90d815ff80 2024-09-11T22:20:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.599+0000 7f90d4ff9640 1 -- 172.21.15.50:0/2145705925 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f90d0005d10 con 0x7f90d815ff80 2024-09-11T22:20:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.600+0000 7f90d4ff9640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90c406be30 0x7f90c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.600+0000 7f90d4ff9640 1 -- 172.21.15.50:0/2145705925 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f90d00ab5f0 con 0x7f90d815ff80 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.600+0000 7f90d7fff640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90c406be30 0x7f90c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.600+0000 7f90e13fe740 1 Processor -- start 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.600+0000 7f90d7fff640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90c406be30 0x7f90c406e2f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f90c80017e0 tx=0x7f90c80078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.600+0000 7f90e13fe740 1 -- start start 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90e13fe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a95e0 0x56354d9a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90e13fe740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a6da0 0x56354d9a8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90e13fe740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9a7200 0x56354d989560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90e13fe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56354d8c58d0 con 0x56354d9a95e0 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90e13fe740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56354d86d620 con 0x56354d9a6da0 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90e13fe740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56354d8c1890 con 0x56354d9a7200 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a95e0 0x56354d9a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a95e0 0x56354d9a99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57138/0 (socket says 172.21.15.50:57138) 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90d7fff640 1 -- 172.21.15.50:0/2368612786 learned_addr learned my addr 172.21.15.50:0/2368612786 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90d77fe640 1 --2- 172.21.15.50:0/2368612786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a6da0 0x56354d9a8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/2368612786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9a7200 0x56354d989560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90d7fff640 1 -- 172.21.15.50:0/2368612786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9a7200 msgr2=0x56354d989560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90d7fff640 1 --2- 172.21.15.50:0/2368612786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9a7200 0x56354d989560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90d7fff640 1 -- 172.21.15.50:0/2368612786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a6da0 msgr2=0x56354d9a8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90d7fff640 1 --2- 172.21.15.50:0/2368612786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a6da0 0x56354d9a8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90d7fff640 1 -- 172.21.15.50:0/2368612786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56354d6a27d0 con 0x56354d9a95e0 2024-09-11T22:20:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/2368612786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9a7200 0x56354d989560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.601+0000 7f90d77fe640 1 --2- 172.21.15.50:0/2368612786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a6da0 0x56354d9a8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.602+0000 7f90d7fff640 1 --2- 172.21.15.50:0/2368612786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a95e0 0x56354d9a99c0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f90c8007ea0 tx=0x7f90c800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e51ed11afff1df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.602+0000 7f90bdffb640 1 -- 172.21.15.50:0/2368612786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8028070 con 0x56354d9a95e0 2024-09-11T22:20:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.602+0000 7f90bdffb640 1 -- 172.21.15.50:0/2368612786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c8015d50 con 0x56354d9a95e0 2024-09-11T22:20:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.602+0000 7f90bdffb640 1 -- 172.21.15.50:0/2368612786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c80215c0 con 0x56354d9a95e0 2024-09-11T22:20:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.602+0000 7f90e13fe740 1 -- 172.21.15.50:0/2368612786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a95e0 msgr2=0x56354d9a99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.602+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2368612786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a95e0 0x56354d9a99c0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f90c8007ea0 tx=0x7f90c800c000 comp rx=0 tx=0).stop 2024-09-11T22:20:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.602+0000 7f90e13fe740 1 -- 172.21.15.50:0/2368612786 shutdown_connections 2024-09-11T22:20:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.602+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2368612786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9a7200 0x56354d989560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.602+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2368612786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a6da0 0x56354d9a8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.602+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2368612786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a95e0 0x56354d9a99c0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.602+0000 7f90e13fe740 1 -- 172.21.15.50:0/2368612786 >> 172.21.15.50:0/2368612786 conn(0x56354d95f240 msgr2=0x56354d9a7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.602+0000 7f90e13fe740 1 -- 172.21.15.50:0/2368612786 shutdown_connections 2024-09-11T22:20:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.602+0000 7f90e13fe740 1 -- 172.21.15.50:0/2368612786 wait complete. 2024-09-11T22:20:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.603+0000 7f90e13fe740 1 -- start start 2024-09-11T22:20:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.603+0000 7f90e13fe740 1 Processor -- start 2024-09-11T22:20:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90e13fe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354d9b8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90e13fe740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a95e0 0x56354d9a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90e13fe740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9b8d60 0x56354d9a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90e13fe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56354d9a5d00 con 0x56354d9a7200 2024-09-11T22:20:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90e13fe740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56354d84e750 con 0x56354d9a95e0 2024-09-11T22:20:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90e13fe740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56354d9a5fe0 con 0x56354d9b8d60 2024-09-11T22:20:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90e13fe740 10 client.0 _ll_register_callbacks cb 0x56354d872780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354d9b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354d9b8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57146/0 (socket says 172.21.15.50:57146) 2024-09-11T22:20:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90d7fff640 1 -- 172.21.15.50:0/4266460437 learned_addr learned my addr 172.21.15.50:0/4266460437 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90d77fe640 1 --2- 172.21.15.50:0/4266460437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a95e0 0x56354d9a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/4266460437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9b8d60 0x56354d9a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90d7fff640 1 -- 172.21.15.50:0/4266460437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9b8d60 msgr2=0x56354d9a12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90d7fff640 1 --2- 172.21.15.50:0/4266460437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9b8d60 0x56354d9a12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90d7fff640 1 -- 172.21.15.50:0/4266460437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a95e0 msgr2=0x56354d9a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90d7fff640 1 --2- 172.21.15.50:0/4266460437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a95e0 0x56354d9a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.604+0000 7f90d7fff640 1 -- 172.21.15.50:0/4266460437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354d5980f0 con 0x56354d9a7200 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90d7fff640 1 --2- 172.21.15.50:0/4266460437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354d9b8820 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f90c8001050 tx=0x7f90d80b4530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c0ab10cd3c826c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90b6ffd640 1 -- 172.21.15.50:0/4266460437 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8032060 con 0x56354d9a7200 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90b6ffd640 1 -- 172.21.15.50:0/4266460437 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f90c8024bf0 con 0x56354d9a7200 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90e13fe740 1 -- 172.21.15.50:0/4266460437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90c8015d50 con 0x56354d9a7200 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90b6ffd640 1 -- 172.21.15.50:0/4266460437 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f90c8038050 con 0x56354d9a7200 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90e13fe740 10 client.9099 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90e13fe740 1 -- 172.21.15.50:0/4266460437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x56354d702f60 con 0x56354d9a7200 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90b6ffd640 1 -- 172.21.15.50:0/4266460437 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c8015d50 con 0x56354d9a7200 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90b6ffd640 1 -- 172.21.15.50:0/4266460437 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f90c803b020 con 0x56354d9a7200 2024-09-11T22:20:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90e13fe740 10 client.9099 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90e13fe740 10 client.9099 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90e13fe740 20 client.9099 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90e13fe740 1 --2- 172.21.15.50:0/4266460437 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x56354d9b7980 0x56354d9b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90e13fe740 4 client.9099 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90e13fe740 1 -- 172.21.15.50:0/4266460437 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56354d8d3000 con 0x56354d9b7980 2024-09-11T22:20:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.605+0000 7f90d77fe640 1 --2- 172.21.15.50:0/4266460437 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x56354d9b7980 0x56354d9b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.606+0000 7f90d77fe640 1 --2- 172.21.15.50:0/4266460437 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x56354d9b7980 0x56354d9b7da0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=471ae17bcf28afbb server_cookie=679249354bc0facd in_seq=0 out_seq=0 2024-09-11T22:20:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.606+0000 7f90b6ffd640 10 client.9099 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.606+0000 7f90b6ffd640 1 -- 172.21.15.50:0/4266460437 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56354d8d3000 con 0x56354d9b7980 2024-09-11T22:20:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.606+0000 7f90b6ffd640 10 client.9099 handle_command_reply: tid=0 2024-09-11T22:20:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.606+0000 7f90e13fe740 1 client.9099 shutdown 2024-09-11T22:20:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.606+0000 7f90e13fe740 1 -- 172.21.15.50:0/4266460437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 msgr2=0x56354d9b8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.606+0000 7f90e13fe740 1 --2- 172.21.15.50:0/4266460437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354d9b8820 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f90c8001050 tx=0x7f90d80b4530 comp rx=0 tx=0).stop 2024-09-11T22:20:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.607+0000 7f90e13fe740 1 -- 172.21.15.50:0/4266460437 shutdown_connections 2024-09-11T22:20:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.607+0000 7f90e13fe740 1 --2- 172.21.15.50:0/4266460437 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x56354d9b7980 0x56354d9b7da0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.607+0000 7f90e13fe740 1 --2- 172.21.15.50:0/4266460437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9b8d60 0x56354d9a12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.607+0000 7f90e13fe740 1 --2- 172.21.15.50:0/4266460437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a95e0 0x56354d9a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.607+0000 7f90b6ffd640 0 client.9099 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.607+0000 7f90e13fe740 1 --2- 172.21.15.50:0/4266460437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354d9b8820 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.607+0000 7f90e13fe740 1 -- 172.21.15.50:0/4266460437 >> 172.21.15.50:0/4266460437 conn(0x56354d9a6da0 msgr2=0x56354d9a7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.607+0000 7f90e13fe740 1 -- 172.21.15.50:0/4266460437 shutdown_connections 2024-09-11T22:20:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.607+0000 7f90e13fe740 1 -- 172.21.15.50:0/4266460437 wait complete. 2024-09-11T22:20:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.607+0000 7f90e13fe740 20 client.9099 trim_cache size 0 max 16384 2024-09-11T22:20:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.624+0000 7f90e13fe740 1 Processor -- start 2024-09-11T22:20:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.624+0000 7f90e13fe740 1 -- start start 2024-09-11T22:20:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90e13fe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354d964000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90e13fe740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9a95e0 0x56354d9a3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90e13fe740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9b8d60 0x56354d9a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90e13fe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f90d82013e0 con 0x56354d9a7200 2024-09-11T22:20:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90e13fe740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f90d8200420 con 0x56354d9b8d60 2024-09-11T22:20:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90e13fe740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f90d8072420 con 0x56354d9a95e0 2024-09-11T22:20:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354d964000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354d964000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57152/0 (socket says 172.21.15.50:57152) 2024-09-11T22:20:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90d7fff640 1 -- 172.21.15.50:0/2766857383 learned_addr learned my addr 172.21.15.50:0/2766857383 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90d77fe640 1 --2- 172.21.15.50:0/2766857383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9a95e0 0x56354d9a3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90d7fff640 1 -- 172.21.15.50:0/2766857383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9a95e0 msgr2=0x56354d9a3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90d7fff640 1 --2- 172.21.15.50:0/2766857383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9a95e0 0x56354d9a3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/2766857383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9b8d60 0x56354d9a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90d7fff640 1 -- 172.21.15.50:0/2766857383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9b8d60 msgr2=0x56354d9a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90d7fff640 1 --2- 172.21.15.50:0/2766857383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9b8d60 0x56354d9a0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90d7fff640 1 -- 172.21.15.50:0/2766857383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56354d5711b0 con 0x56354d9a7200 2024-09-11T22:20:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90d77fe640 1 --2- 172.21.15.50:0/2766857383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9a95e0 0x56354d9a3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/2766857383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9b8d60 0x56354d9a0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90d7fff640 1 --2- 172.21.15.50:0/2766857383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354d964000 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f90c8004db0 tx=0x7f90c802b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4207b8048966c921 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90bd7fa640 1 -- 172.21.15.50:0/2766857383 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8028040 con 0x56354d9a7200 2024-09-11T22:20:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90bd7fa640 1 -- 172.21.15.50:0/2766857383 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c8025ca0 con 0x56354d9a7200 2024-09-11T22:20:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.625+0000 7f90bd7fa640 1 -- 172.21.15.50:0/2766857383 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8022420 con 0x56354d9a7200 2024-09-11T22:20:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.626+0000 7f90e13fe740 1 -- 172.21.15.50:0/2766857383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 msgr2=0x56354d964000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.626+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2766857383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354d964000 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f90c8004db0 tx=0x7f90c802b000 comp rx=0 tx=0).stop 2024-09-11T22:20:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.626+0000 7f90e13fe740 1 -- 172.21.15.50:0/2766857383 shutdown_connections 2024-09-11T22:20:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.626+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2766857383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9a95e0 0x56354d9a3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.626+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2766857383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9b8d60 0x56354d9a0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.626+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2766857383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354d964000 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.626+0000 7f90e13fe740 1 -- 172.21.15.50:0/2766857383 >> 172.21.15.50:0/2766857383 conn(0x56354d9a6da0 msgr2=0x56354d9a88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.626+0000 7f90e13fe740 1 -- 172.21.15.50:0/2766857383 shutdown_connections 2024-09-11T22:20:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.626+0000 7f90e13fe740 1 -- 172.21.15.50:0/2766857383 wait complete. 2024-09-11T22:20:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.627+0000 7f90e13fe740 1 -- start start 2024-09-11T22:20:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.627+0000 7f90e13fe740 1 Processor -- start 2024-09-11T22:20:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90e13fe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354da24910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90e13fe740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a95e0 0x56354d9b9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90e13fe740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9b8d60 0x56354d97c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90e13fe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56354d8c7e00 con 0x56354d9a7200 2024-09-11T22:20:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90e13fe740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f90d81ffdd0 con 0x56354d9a95e0 2024-09-11T22:20:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90e13fe740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56354d8694f0 con 0x56354d9b8d60 2024-09-11T22:20:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90e13fe740 10 client.0 _ll_register_callbacks cb 0x7f90c8024770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354da24910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354da24910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57168/0 (socket says 172.21.15.50:57168) 2024-09-11T22:20:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90d7fff640 1 -- 172.21.15.50:0/2276728225 learned_addr learned my addr 172.21.15.50:0/2276728225 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90d77fe640 1 --2- 172.21.15.50:0/2276728225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a95e0 0x56354d9b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90dcbfb640 1 --2- 172.21.15.50:0/2276728225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9b8d60 0x56354d97c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90d7fff640 1 -- 172.21.15.50:0/2276728225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9b8d60 msgr2=0x56354d97c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90d7fff640 1 --2- 172.21.15.50:0/2276728225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9b8d60 0x56354d97c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90d7fff640 1 -- 172.21.15.50:0/2276728225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a95e0 msgr2=0x56354d9b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90d7fff640 1 --2- 172.21.15.50:0/2276728225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a95e0 0x56354d9b9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90d7fff640 1 -- 172.21.15.50:0/2276728225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354d99ede0 con 0x56354d9a7200 2024-09-11T22:20:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90d7fff640 1 --2- 172.21.15.50:0/2276728225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354da24910 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f90c8007500 tx=0x7f90c8006030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5987888c3f1805 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90b6ffd640 1 -- 172.21.15.50:0/2276728225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8028040 con 0x56354d9a7200 2024-09-11T22:20:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90b6ffd640 1 -- 172.21.15.50:0/2276728225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f90c8022420 con 0x56354d9a7200 2024-09-11T22:20:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.628+0000 7f90e13fe740 1 -- 172.21.15.50:0/2276728225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90c8025ca0 con 0x56354d9a7200 2024-09-11T22:20:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90b6ffd640 1 -- 172.21.15.50:0/2276728225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f90c8052050 con 0x56354d9a7200 2024-09-11T22:20:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90e13fe740 10 client.9105 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90e13fe740 1 -- 172.21.15.50:0/2276728225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x56354d99e920 con 0x56354d9a7200 2024-09-11T22:20:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90b6ffd640 1 -- 172.21.15.50:0/2276728225 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c8025ca0 con 0x56354d9a7200 2024-09-11T22:20:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90b6ffd640 1 -- 172.21.15.50:0/2276728225 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f90c8055020 con 0x56354d9a7200 2024-09-11T22:20:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90e13fe740 10 client.9105 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90e13fe740 10 client.9105 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90e13fe740 20 client.9105 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2276728225 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x56354d97ce60 0x56354d9a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90e13fe740 4 client.9105 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-11T22:20:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90e13fe740 1 -- 172.21.15.50:0/2276728225 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x56354d8cd350 con 0x56354d97ce60 2024-09-11T22:20:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90d77fe640 1 --2- 172.21.15.50:0/2276728225 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x56354d97ce60 0x56354d9a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90b6ffd640 10 client.9105 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.629+0000 7f90d77fe640 1 --2- 172.21.15.50:0/2276728225 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x56354d97ce60 0x56354d9a9fa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d21ef29a931ad9e server_cookie=89202ff21bd90a27 in_seq=0 out_seq=0 2024-09-11T22:20:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90b6ffd640 1 -- 172.21.15.50:0/2276728225 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56354d8cd350 con 0x56354d97ce60 2024-09-11T22:20:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90b6ffd640 10 client.9105 handle_command_reply: tid=0 2024-09-11T22:20:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90e13fe740 1 client.9105 shutdown 2024-09-11T22:20:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90e13fe740 1 -- 172.21.15.50:0/2276728225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 msgr2=0x56354da24910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2276728225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354da24910 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f90c8007500 tx=0x7f90c8006030 comp rx=0 tx=0).stop 2024-09-11T22:20:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90e13fe740 1 -- 172.21.15.50:0/2276728225 shutdown_connections 2024-09-11T22:20:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2276728225 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x56354d97ce60 0x56354d9a9fa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2276728225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56354d9b8d60 0x56354d97c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90b6ffd640 0 client.9105 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2276728225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56354d9a95e0 0x56354d9b9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90e13fe740 1 --2- 172.21.15.50:0/2276728225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56354d9a7200 0x56354da24910 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90e13fe740 1 -- 172.21.15.50:0/2276728225 >> 172.21.15.50:0/2276728225 conn(0x56354d9a6da0 msgr2=0x56354d9a0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90e13fe740 1 -- 172.21.15.50:0/2276728225 shutdown_connections 2024-09-11T22:20:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90e13fe740 1 -- 172.21.15.50:0/2276728225 wait complete. 2024-09-11T22:20:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90e13fe740 20 client.9105 trim_cache size 0 max 16384 2024-09-11T22:20:17.638 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:20:17.638 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:20:17.638 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:20:17.638 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:20:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90de65e640 1 -- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90c406be30 msgr2=0x7f90c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.630+0000 7f90de65e640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90c406be30 0x7f90c406e2f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f90c80017e0 tx=0x7f90c80078f0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.631+0000 7f90de65e640 1 -- 172.21.15.50:0/2145705925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d815ff80 msgr2=0x7f90d8160400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.631+0000 7f90de65e640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d815ff80 0x7f90d8160400 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f90d000e200 tx=0x7f90d0009750 comp rx=0 tx=0).stop 2024-09-11T22:20:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.631+0000 7f90de65e640 1 -- 172.21.15.50:0/2145705925 shutdown_connections 2024-09-11T22:20:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.631+0000 7f90de65e640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90c406be30 0x7f90c406e2f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.631+0000 7f90de65e640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90d80cab00 0x7f90d80caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.631+0000 7f90de65e640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d815ff80 0x7f90d8160400 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.631+0000 7f90de65e640 1 --2- 172.21.15.50:0/2145705925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90c00051c0 0x7f90d8149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.631+0000 7f90de65e640 1 -- 172.21.15.50:0/2145705925 >> 172.21.15.50:0/2145705925 conn(0x7f90d80679c0 msgr2=0x7f90d806d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.631+0000 7f90de65e640 1 -- 172.21.15.50:0/2145705925 shutdown_connections 2024-09-11T22:20:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.631+0000 7f90de65e640 1 -- 172.21.15.50:0/2145705925 wait complete. 2024-09-11T22:20:17.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:17.642 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-11T22:20:17.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.746+0000 7fec1952a640 1 Processor -- start 2024-09-11T22:20:17.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.746+0000 7fec1952a640 1 -- start start 2024-09-11T22:20:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.746+0000 7fec1952a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec1415c510 0x7fec1406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.747+0000 7fec1952a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fec140680d0 0x7fec1415c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.747+0000 7fec1952a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1406ec90 con 0x7fec1406e730 2024-09-11T22:20:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.747+0000 7fec1952a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fec1406ef70 con 0x7fec1415c510 2024-09-11T22:20:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.747+0000 7fec1952a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fec1406f250 con 0x7fec140680d0 2024-09-11T22:20:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.747+0000 7fec12ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fec1415c510 0x7fec1406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.747+0000 7fec0bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fec1406e730 0x7fec140679c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53102/0 (socket says 172.21.15.50:53102) 2024-09-11T22:20:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.747+0000 7fec0bfff640 1 -- 172.21.15.50:0/3208695110 learned_addr learned my addr 172.21.15.50:0/3208695110 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.747+0000 7fec137fe640 1 --2- 172.21.15.50:0/3208695110 >> v2:172.21.15.77:3300/0 conn(0x7fec140680d0 0x7fec1415c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.747+0000 7fec12ffd640 1 -- 172.21.15.50:0/3208695110 >> v2:172.21.15.77:3300/0 conn(0x7fec140680d0 msgr2=0x7fec1415c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.747+0000 7fec12ffd640 1 --2- 172.21.15.50:0/3208695110 >> v2:172.21.15.77:3300/0 conn(0x7fec140680d0 0x7fec1415c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.747+0000 7fec12ffd640 1 -- 172.21.15.50:0/3208695110 >> v1:172.21.15.50:6789/0 conn(0x7fec1406e730 legacy=0x7fec140679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.747+0000 7fec12ffd640 1 -- 172.21.15.50:0/3208695110 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1406f530 con 0x7fec1415c510 2024-09-11T22:20:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.747+0000 7fec127fc640 1 -- 172.21.15.50:0/3208695110 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3984505390 0 0) 0x7fec1406ec90 con 0x7fec1406e730 2024-09-11T22:20:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.748+0000 7fec12ffd640 1 --2- 172.21.15.50:0/3208695110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec1415c510 0x7fec1406e1f0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fec140b6e70 tx=0x7fec0402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5544f5a4efdaaf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.748+0000 7fec127fc640 1 -- 172.21.15.50:0/3208695110 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04037070 con 0x7fec1415c510 2024-09-11T22:20:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.748+0000 7fec127fc640 1 -- 172.21.15.50:0/3208695110 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec04032440 con 0x7fec1415c510 2024-09-11T22:20:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.748+0000 7fec127fc640 1 -- 172.21.15.50:0/3208695110 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04032810 con 0x7fec1415c510 2024-09-11T22:20:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.749+0000 7fec1952a640 1 -- 172.21.15.50:0/3208695110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec1415c510 msgr2=0x7fec1406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.749+0000 7fec1952a640 1 --2- 172.21.15.50:0/3208695110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec1415c510 0x7fec1406e1f0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fec140b6e70 tx=0x7fec0402a1a0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.749+0000 7fec1952a640 1 -- 172.21.15.50:0/3208695110 shutdown_connections 2024-09-11T22:20:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.749+0000 7fec1952a640 1 --2- 172.21.15.50:0/3208695110 >> v2:172.21.15.77:3300/0 conn(0x7fec140680d0 0x7fec1415c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.749+0000 7fec1952a640 1 --2- 172.21.15.50:0/3208695110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec1415c510 0x7fec1406e1f0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.749+0000 7fec1952a640 1 -- 172.21.15.50:0/3208695110 >> 172.21.15.50:0/3208695110 conn(0x7fec14075060 msgr2=0x7fec1406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.749+0000 7fec1952a640 1 -- 172.21.15.50:0/3208695110 shutdown_connections 2024-09-11T22:20:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.749+0000 7fec1952a640 1 -- 172.21.15.50:0/3208695110 wait complete. 2024-09-11T22:20:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.750+0000 7fec1952a640 1 Processor -- start 2024-09-11T22:20:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.750+0000 7fec1952a640 1 -- start start 2024-09-11T22:20:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec1952a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec140680d0 0x7fec1414d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec1952a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec1406e730 0x7fec141f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec1952a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec1415c510 0x7fec140b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec1952a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fec1406fd30 con 0x7fec1406e730 2024-09-11T22:20:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec1952a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fec1406c820 con 0x7fec1415c510 2024-09-11T22:20:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec1952a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fec1415ce30 con 0x7fec140680d0 2024-09-11T22:20:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec0bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec1406e730 0x7fec141f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec0bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec1406e730 0x7fec141f3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57182/0 (socket says 172.21.15.50:57182) 2024-09-11T22:20:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec0bfff640 1 -- 172.21.15.50:0/4141122935 learned_addr learned my addr 172.21.15.50:0/4141122935 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec12ffd640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec140680d0 0x7fec1414d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec137fe640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec1415c510 0x7fec140b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec0bfff640 1 -- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec140680d0 msgr2=0x7fec1414d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec0bfff640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec140680d0 0x7fec1414d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec0bfff640 1 -- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec1415c510 msgr2=0x7fec140b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec0bfff640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec1415c510 0x7fec140b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec0bfff640 1 -- 172.21.15.50:0/4141122935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec14155140 con 0x7fec1406e730 2024-09-11T22:20:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec12ffd640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec140680d0 0x7fec1414d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec137fe640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec1415c510 0x7fec140b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec0bfff640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec1406e730 0x7fec141f3320 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c500 tx=0x7febfc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec0b7fe640 1 -- 172.21.15.50:0/4141122935 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc018070 con 0x7fec1406e730 2024-09-11T22:20:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec0b7fe640 1 -- 172.21.15.50:0/4141122935 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febfc007580 con 0x7fec1406e730 2024-09-11T22:20:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec1952a640 1 -- 172.21.15.50:0/4141122935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec14155420 con 0x7fec1406e730 2024-09-11T22:20:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.751+0000 7fec0b7fe640 1 -- 172.21.15.50:0/4141122935 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc004a20 con 0x7fec1406e730 2024-09-11T22:20:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.752+0000 7fec1952a640 1 -- 172.21.15.50:0/4141122935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec141559e0 con 0x7fec1406e730 2024-09-11T22:20:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.753+0000 7fec0b7fe640 1 -- 172.21.15.50:0/4141122935 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febfc01b070 con 0x7fec1406e730 2024-09-11T22:20:17.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.753+0000 7fec0b7fe640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7febf406be60 0x7febf406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.754+0000 7fec0b7fe640 1 -- 172.21.15.50:0/4141122935 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7febfc08a0d0 con 0x7fec1406e730 2024-09-11T22:20:17.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.754+0000 7fec12ffd640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7febf406be60 0x7febf406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.754+0000 7fec12ffd640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7febf406be60 0x7febf406e320 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fec04034000 tx=0x7fec0402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.754+0000 7fec1c2c6740 1 Processor -- start 2024-09-11T22:20:17.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.754+0000 7fec1c2c6740 1 -- start start 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.755+0000 7fec1c2c6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f431920 0x561e7f4770c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.755+0000 7fec1c2c6740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f42f0e0 0x561e7f431d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.755+0000 7fec1c2c6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f4330b0 0x561e7f42c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.755+0000 7fec1c2c6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561e7f3946f0 con 0x561e7f431920 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.755+0000 7fec1c2c6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561e7f33c330 con 0x561e7f4330b0 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.755+0000 7fec1c2c6740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x561e7f3906b0 con 0x561e7f42f0e0 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.755+0000 7fec12ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f431920 0x561e7f4770c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.755+0000 7fec12ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f431920 0x561e7f4770c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57188/0 (socket says 172.21.15.50:57188) 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.755+0000 7fec12ffd640 1 -- 172.21.15.50:0/135877728 learned_addr learned my addr 172.21.15.50:0/135877728 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.755+0000 7fec0bfff640 1 --2- 172.21.15.50:0/135877728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f42f0e0 0x561e7f431d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.755+0000 7fec137fe640 1 --2- 172.21.15.50:0/135877728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f4330b0 0x561e7f42c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.756+0000 7fec0bfff640 1 -- 172.21.15.50:0/135877728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f4330b0 msgr2=0x561e7f42c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.756+0000 7fec0bfff640 1 --2- 172.21.15.50:0/135877728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f4330b0 0x561e7f42c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.756+0000 7fec0bfff640 1 -- 172.21.15.50:0/135877728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f431920 msgr2=0x561e7f4770c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.756+0000 7fec0bfff640 1 --2- 172.21.15.50:0/135877728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f431920 0x561e7f4770c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.756+0000 7fec0bfff640 1 -- 172.21.15.50:0/135877728 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e7f3620d0 con 0x561e7f42f0e0 2024-09-11T22:20:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.756+0000 7fec0bfff640 1 --2- 172.21.15.50:0/135877728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f42f0e0 0x561e7f431d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7febfc088660 tx=0x7febfc058410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=781854af2a600caa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.756+0000 7fec08ff9640 1 -- 172.21.15.50:0/135877728 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc056710 con 0x561e7f42f0e0 2024-09-11T22:20:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.756+0000 7fec08ff9640 1 -- 172.21.15.50:0/135877728 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febfc054a80 con 0x561e7f42f0e0 2024-09-11T22:20:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.756+0000 7fec08ff9640 1 -- 172.21.15.50:0/135877728 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc004dc0 con 0x561e7f42f0e0 2024-09-11T22:20:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.757+0000 7fec1c2c6740 1 -- 172.21.15.50:0/135877728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f42f0e0 msgr2=0x561e7f431d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.757+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/135877728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f42f0e0 0x561e7f431d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7febfc088660 tx=0x7febfc058410 comp rx=0 tx=0).stop 2024-09-11T22:20:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.757+0000 7fec1c2c6740 1 -- 172.21.15.50:0/135877728 shutdown_connections 2024-09-11T22:20:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.757+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/135877728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f42f0e0 0x561e7f431d00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.757+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/135877728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f4330b0 0x561e7f42c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.757+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/135877728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f431920 0x561e7f4770c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.757+0000 7fec1c2c6740 1 -- 172.21.15.50:0/135877728 >> 172.21.15.50:0/135877728 conn(0x561e7f42e370 msgr2=0x561e7f476590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.757+0000 7fec1c2c6740 1 -- 172.21.15.50:0/135877728 shutdown_connections 2024-09-11T22:20:17.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.757+0000 7fec1c2c6740 1 -- 172.21.15.50:0/135877728 wait complete. 2024-09-11T22:20:17.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.757+0000 7fec1c2c6740 1 -- start start 2024-09-11T22:20:17.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.757+0000 7fec1c2c6740 1 Processor -- start 2024-09-11T22:20:17.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.758+0000 7fec1c2c6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f431920 0x561e7f45a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.758+0000 7fec1c2c6740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f4330b0 0x561e7f45ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.758+0000 7fec1c2c6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 0x561e7f4530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.758+0000 7fec1c2c6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561e7f42d810 con 0x561e7f45bad0 2024-09-11T22:20:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.758+0000 7fec1c2c6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561e7f31d4f0 con 0x561e7f431920 2024-09-11T22:20:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.758+0000 7fec1c2c6740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x561e7f4778f0 con 0x561e7f4330b0 2024-09-11T22:20:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.758+0000 7fec1c2c6740 10 client.0 _ll_register_callbacks cb 0x561e7f33eb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.758+0000 7fec137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 0x561e7f4530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.758+0000 7fec137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 0x561e7f4530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57192/0 (socket says 172.21.15.50:57192) 2024-09-11T22:20:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.758+0000 7fec137fe640 1 -- 172.21.15.50:0/514612077 learned_addr learned my addr 172.21.15.50:0/514612077 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.758+0000 7fec12ffd640 1 --2- 172.21.15.50:0/514612077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f431920 0x561e7f45a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.758+0000 7fec0bfff640 1 --2- 172.21.15.50:0/514612077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f4330b0 0x561e7f45ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec137fe640 1 -- 172.21.15.50:0/514612077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f4330b0 msgr2=0x561e7f45ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec137fe640 1 --2- 172.21.15.50:0/514612077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f4330b0 0x561e7f45ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec137fe640 1 -- 172.21.15.50:0/514612077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f431920 msgr2=0x561e7f45a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec137fe640 1 --2- 172.21.15.50:0/514612077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f431920 0x561e7f45a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec137fe640 1 -- 172.21.15.50:0/514612077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e7f1717d0 con 0x561e7f45bad0 2024-09-11T22:20:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec137fe640 1 --2- 172.21.15.50:0/514612077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 0x561e7f4530b0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fec0c007d50 tx=0x7fec0c014690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44548f4985c5546f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7febf1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7febf1ffb640 1 -- 172.21.15.50:0/514612077 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c01c070 con 0x561e7f45bad0 2024-09-11T22:20:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7febf1ffb640 1 -- 172.21.15.50:0/514612077 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fec0c017440 con 0x561e7f45bad0 2024-09-11T22:20:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec1c2c6740 1 -- 172.21.15.50:0/514612077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febfc054a80 con 0x561e7f45bad0 2024-09-11T22:20:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7febf1ffb640 1 -- 172.21.15.50:0/514612077 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7fec0c027050 con 0x561e7f45bad0 2024-09-11T22:20:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec1c2c6740 10 client.9120 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec1c2c6740 1 -- 172.21.15.50:0/514612077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x561e7f0a73f0 con 0x561e7f45bad0 2024-09-11T22:20:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7febf1ffb640 1 -- 172.21.15.50:0/514612077 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febfc054a80 con 0x561e7f45bad0 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7febf1ffb640 1 -- 172.21.15.50:0/514612077 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7fec0c02a020 con 0x561e7f45bad0 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec1c2c6740 10 client.9120 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec1c2c6740 10 client.9120 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec1c2c6740 20 client.9120 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/514612077 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x561e7f470670 0x561e7f453ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec1c2c6740 4 client.9120 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.759+0000 7fec1c2c6740 1 -- 172.21.15.50:0/514612077 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e7f3a1e20 con 0x561e7f470670 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.760+0000 7fec12ffd640 1 --2- 172.21.15.50:0/514612077 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x561e7f470670 0x561e7f453ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.760+0000 7febf1ffb640 10 client.9120 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.760+0000 7fec12ffd640 1 --2- 172.21.15.50:0/514612077 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x561e7f470670 0x561e7f453ac0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d33c0a64c8b32d3 server_cookie=9c9d023d9d8acc1d in_seq=0 out_seq=0 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.760+0000 7febf1ffb640 1 -- 172.21.15.50:0/514612077 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e7f3a1e20 con 0x561e7f470670 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.760+0000 7febf1ffb640 10 client.9120 handle_command_reply: tid=0 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.760+0000 7fec1c2c6740 1 client.9120 shutdown 2024-09-11T22:20:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.761+0000 7fec1c2c6740 1 -- 172.21.15.50:0/514612077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 msgr2=0x561e7f4530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.761+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/514612077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 0x561e7f4530b0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fec0c007d50 tx=0x7fec0c014690 comp rx=0 tx=0).stop 2024-09-11T22:20:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.761+0000 7fec1c2c6740 1 -- 172.21.15.50:0/514612077 shutdown_connections 2024-09-11T22:20:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.761+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/514612077 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x561e7f470670 0x561e7f453ac0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.761+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/514612077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f4330b0 0x561e7f45ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.761+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/514612077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 0x561e7f4530b0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.761+0000 7febf1ffb640 0 client.9120 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.761+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/514612077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f431920 0x561e7f45a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.761+0000 7fec1c2c6740 1 -- 172.21.15.50:0/514612077 >> 172.21.15.50:0/514612077 conn(0x561e7f42f0e0 msgr2=0x561e7f4780f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.761+0000 7fec1c2c6740 1 -- 172.21.15.50:0/514612077 shutdown_connections 2024-09-11T22:20:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.761+0000 7fec1c2c6740 1 -- 172.21.15.50:0/514612077 wait complete. 2024-09-11T22:20:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.761+0000 7fec1c2c6740 20 client.9120 trim_cache size 0 max 16384 2024-09-11T22:20:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.778+0000 7fec1c2c6740 1 Processor -- start 2024-09-11T22:20:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.778+0000 7fec1c2c6740 1 -- start start 2024-09-11T22:20:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec1c2c6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f431920 0x561e7f458a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec1c2c6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f4330b0 0x561e7f459300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec1c2c6740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f45bad0 0x561e7f459840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec1c2c6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fec141fe810 con 0x561e7f431920 2024-09-11T22:20:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec1c2c6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fec141fd9a0 con 0x561e7f4330b0 2024-09-11T22:20:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec1c2c6740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fec14158390 con 0x561e7f45bad0 2024-09-11T22:20:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec12ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f431920 0x561e7f458a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec12ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f431920 0x561e7f458a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57194/0 (socket says 172.21.15.50:57194) 2024-09-11T22:20:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec12ffd640 1 -- 172.21.15.50:0/6828905 learned_addr learned my addr 172.21.15.50:0/6828905 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec12ffd640 1 -- 172.21.15.50:0/6828905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f45bad0 msgr2=0x561e7f459840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec137fe640 1 --2- 172.21.15.50:0/6828905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f45bad0 0x561e7f459840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec12ffd640 1 --2- 172.21.15.50:0/6828905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f45bad0 0x561e7f459840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec0bfff640 1 --2- 172.21.15.50:0/6828905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f4330b0 0x561e7f459300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec12ffd640 1 -- 172.21.15.50:0/6828905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f4330b0 msgr2=0x561e7f459300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec12ffd640 1 --2- 172.21.15.50:0/6828905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f4330b0 0x561e7f459300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec12ffd640 1 -- 172.21.15.50:0/6828905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e7f0670f0 con 0x561e7f431920 2024-09-11T22:20:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7fec12ffd640 1 --2- 172.21.15.50:0/6828905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f431920 0x561e7f458a80 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fec04000c00 tx=0x7fec0402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237869bfdeec3789 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7febf3fff640 1 -- 172.21.15.50:0/6828905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0405a070 con 0x561e7f431920 2024-09-11T22:20:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7febf3fff640 1 -- 172.21.15.50:0/6828905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec04038040 con 0x561e7f431920 2024-09-11T22:20:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.779+0000 7febf3fff640 1 -- 172.21.15.50:0/6828905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04037050 con 0x561e7f431920 2024-09-11T22:20:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.780+0000 7fec1c2c6740 1 -- 172.21.15.50:0/6828905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f431920 msgr2=0x561e7f458a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.780+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/6828905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f431920 0x561e7f458a80 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fec04000c00 tx=0x7fec0402c000 comp rx=0 tx=0).stop 2024-09-11T22:20:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.780+0000 7fec1c2c6740 1 -- 172.21.15.50:0/6828905 shutdown_connections 2024-09-11T22:20:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.780+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/6828905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f45bad0 0x561e7f459840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.780+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/6828905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f4330b0 0x561e7f459300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.780+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/6828905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f431920 0x561e7f458a80 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.780+0000 7fec1c2c6740 1 -- 172.21.15.50:0/6828905 >> 172.21.15.50:0/6828905 conn(0x561e7f42f0e0 msgr2=0x561e7f470bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.780+0000 7fec1c2c6740 1 -- 172.21.15.50:0/6828905 shutdown_connections 2024-09-11T22:20:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.780+0000 7fec1c2c6740 1 -- 172.21.15.50:0/6828905 wait complete. 2024-09-11T22:20:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.780+0000 7fec1c2c6740 1 -- start start 2024-09-11T22:20:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.781+0000 7fec1c2c6740 1 Processor -- start 2024-09-11T22:20:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.781+0000 7fec1c2c6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f431920 0x561e7f4f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.781+0000 7fec1c2c6740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f4330b0 0x561e7f4f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.781+0000 7fec1c2c6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 0x561e7f456eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.781+0000 7fec1c2c6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561e7f457750 con 0x561e7f45bad0 2024-09-11T22:20:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.781+0000 7fec1c2c6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fec141548d0 con 0x561e7f431920 2024-09-11T22:20:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.781+0000 7fec1c2c6740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x561e7f4712d0 con 0x561e7f4330b0 2024-09-11T22:20:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.781+0000 7fec1c2c6740 10 client.0 _ll_register_callbacks cb 0x7fec0c009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.781+0000 7fec137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 0x561e7f456eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7fec137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 0x561e7f456eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57208/0 (socket says 172.21.15.50:57208) 2024-09-11T22:20:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7fec137fe640 1 -- 172.21.15.50:0/969704040 learned_addr learned my addr 172.21.15.50:0/969704040 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7fec12ffd640 1 --2- 172.21.15.50:0/969704040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f431920 0x561e7f4f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7fec0bfff640 1 --2- 172.21.15.50:0/969704040 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f4330b0 0x561e7f4f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7fec137fe640 1 -- 172.21.15.50:0/969704040 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f4330b0 msgr2=0x561e7f4f4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7fec137fe640 1 --2- 172.21.15.50:0/969704040 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f4330b0 0x561e7f4f4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7fec137fe640 1 -- 172.21.15.50:0/969704040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f431920 msgr2=0x561e7f4f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7fec137fe640 1 --2- 172.21.15.50:0/969704040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f431920 0x561e7f4f5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7fec137fe640 1 -- 172.21.15.50:0/969704040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e7f4998f0 con 0x561e7f45bad0 2024-09-11T22:20:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7fec137fe640 1 --2- 172.21.15.50:0/969704040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 0x561e7f456eb0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00b010 tx=0x7fec0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d1661583c4d59e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7febf1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7febf1ffb640 1 -- 172.21.15.50:0/969704040 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c030060 con 0x561e7f45bad0 2024-09-11T22:20:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7febf1ffb640 1 -- 172.21.15.50:0/969704040 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fec0c021640 con 0x561e7f45bad0 2024-09-11T22:20:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7fec1c2c6740 1 -- 172.21.15.50:0/969704040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec04038040 con 0x561e7f45bad0 2024-09-11T22:20:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7febf1ffb640 1 -- 172.21.15.50:0/969704040 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7fec0c036050 con 0x561e7f45bad0 2024-09-11T22:20:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.782+0000 7fec1c2c6740 10 client.9126 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7fec1c2c6740 1 -- 172.21.15.50:0/969704040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x561e7f4f4f60 con 0x561e7f45bad0 2024-09-11T22:20:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7febf1ffb640 1 -- 172.21.15.50:0/969704040 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec04038040 con 0x561e7f45bad0 2024-09-11T22:20:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7febf1ffb640 1 -- 172.21.15.50:0/969704040 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7fec0c039020 con 0x561e7f45bad0 2024-09-11T22:20:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7fec1c2c6740 10 client.9126 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7fec1c2c6740 10 client.9126 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7fec1c2c6740 20 client.9126 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/969704040 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x561e7f47a070 0x561e7f498370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7fec1c2c6740 4 client.9126 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:20:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7fec1c2c6740 1 -- 172.21.15.50:0/969704040 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561e7f39c170 con 0x561e7f47a070 2024-09-11T22:20:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7fec12ffd640 1 --2- 172.21.15.50:0/969704040 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x561e7f47a070 0x561e7f498370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7fec12ffd640 1 --2- 172.21.15.50:0/969704040 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x561e7f47a070 0x561e7f498370 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b87af85640c782b server_cookie=61c3e92a02f390ab in_seq=0 out_seq=0 2024-09-11T22:20:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7febf1ffb640 10 client.9126 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7febf1ffb640 1 -- 172.21.15.50:0/969704040 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x561e7f39c170 con 0x561e7f47a070 2024-09-11T22:20:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7febf1ffb640 10 client.9126 handle_command_reply: tid=0 2024-09-11T22:20:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7fec1c2c6740 1 client.9126 shutdown 2024-09-11T22:20:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7fec1c2c6740 1 -- 172.21.15.50:0/969704040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 msgr2=0x561e7f456eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.783+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/969704040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 0x561e7f456eb0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00b010 tx=0x7fec0c004a40 comp rx=0 tx=0).stop 2024-09-11T22:20:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1c2c6740 1 -- 172.21.15.50:0/969704040 shutdown_connections 2024-09-11T22:20:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/969704040 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x561e7f47a070 0x561e7f498370 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/969704040 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e7f4330b0 0x561e7f4f4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/969704040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e7f45bad0 0x561e7f456eb0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7febf1ffb640 0 client.9126 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1c2c6740 1 --2- 172.21.15.50:0/969704040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e7f431920 0x561e7f4f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1c2c6740 1 -- 172.21.15.50:0/969704040 >> 172.21.15.50:0/969704040 conn(0x561e7f42f0e0 msgr2=0x561e7f459300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1c2c6740 1 -- 172.21.15.50:0/969704040 shutdown_connections 2024-09-11T22:20:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1c2c6740 1 -- 172.21.15.50:0/969704040 wait complete. 2024-09-11T22:20:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1c2c6740 20 client.9126 trim_cache size 0 max 16384 2024-09-11T22:20:17.792 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:20:17.792 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-11T22:20:17.792 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-11T22:20:17.792 INFO:teuthology.orchestra.run.smithi050.stdout: "8f24f16a-7509-4efa-9dbc-0bc708c1839b": { 2024-09-11T22:20:17.792 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/scrub_control_test_path", 2024-09-11T22:20:17.792 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "8f24f16a-7509-4efa-9dbc-0bc708c1839b", 2024-09-11T22:20:17.792 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive" 2024-09-11T22:20:17.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:17.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:17.793 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:20:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1952a640 1 -- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7febf406be60 msgr2=0x7febf406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1952a640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7febf406be60 0x7febf406e320 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fec04034000 tx=0x7fec0402e000 comp rx=0 tx=0).stop 2024-09-11T22:20:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1952a640 1 -- 172.21.15.50:0/4141122935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec1406e730 msgr2=0x7fec141f3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1952a640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec1406e730 0x7fec141f3320 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c500 tx=0x7febfc00c9c0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1952a640 1 -- 172.21.15.50:0/4141122935 shutdown_connections 2024-09-11T22:20:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1952a640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7febf406be60 0x7febf406e320 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1952a640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec1415c510 0x7fec140b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1952a640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec1406e730 0x7fec141f3320 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1952a640 1 --2- 172.21.15.50:0/4141122935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec140680d0 0x7fec1414d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1952a640 1 -- 172.21.15.50:0/4141122935 >> 172.21.15.50:0/4141122935 conn(0x7fec14075060 msgr2=0x7fec140b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1952a640 1 -- 172.21.15.50:0/4141122935 shutdown_connections 2024-09-11T22:20:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.784+0000 7fec1952a640 1 -- 172.21.15.50:0/4141122935 wait complete. 2024-09-11T22:20:17.796 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:17.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.898+0000 7f278f245640 1 Processor -- start 2024-09-11T22:20:17.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.898+0000 7f278f245640 1 -- start start 2024-09-11T22:20:17.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.898+0000 7f278f245640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f27880b0f60 0x7f27880b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.898+0000 7f278f245640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27881631a0 con 0x7f2788162d10 2024-09-11T22:20:17.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.898+0000 7f278f245640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2788163410 con 0x7f27880b1340 2024-09-11T22:20:17.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.898+0000 7f278f245640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f27880b17a0 con 0x7f27880b0f60 2024-09-11T22:20:17.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.899+0000 7f278d7e2640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2788162d10 0x7f27880af390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53114/0 (socket says 172.21.15.50:53114) 2024-09-11T22:20:17.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.899+0000 7f278d7e2640 1 -- 172.21.15.50:0/681851047 learned_addr learned my addr 172.21.15.50:0/681851047 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:17.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.899+0000 7f278cfe1640 1 --2- 172.21.15.50:0/681851047 >> v2:172.21.15.77:3300/0 conn(0x7f27880b0f60 0x7f27880b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.899+0000 7f27877fe640 1 -- 172.21.15.50:0/681851047 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4242295178 0 0) 0x7f27881631a0 con 0x7f2788162d10 2024-09-11T22:20:17.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.899+0000 7f27877fe640 1 -- 172.21.15.50:0/681851047 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2774003520 con 0x7f2788162d10 2024-09-11T22:20:17.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.899+0000 7f27877fe640 1 -- 172.21.15.50:0/681851047 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2358836552 0 0) 0x7f2788163410 con 0x7f27880b1340 2024-09-11T22:20:17.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.899+0000 7f27877fe640 1 -- 172.21.15.50:0/681851047 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27881631a0 con 0x7f27880b1340 2024-09-11T22:20:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.899+0000 7f278cfe1640 1 -- 172.21.15.50:0/681851047 >> v1:172.21.15.77:6789/0 conn(0x7f27880b1340 legacy=0x7f2788162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.899+0000 7f278cfe1640 1 -- 172.21.15.50:0/681851047 >> v1:172.21.15.50:6789/0 conn(0x7f2788162d10 legacy=0x7f27880af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.899+0000 7f278cfe1640 1 -- 172.21.15.50:0/681851047 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278806cc20 con 0x7f27880b0f60 2024-09-11T22:20:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.900+0000 7f278cfe1640 1 --2- 172.21.15.50:0/681851047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27880b0f60 0x7f27880b4bd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2778009d90 tx=0x7f277802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3bbffdc88488061 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.900+0000 7f27877fe640 1 -- 172.21.15.50:0/681851047 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778007740 con 0x7f27880b0f60 2024-09-11T22:20:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.900+0000 7f27877fe640 1 -- 172.21.15.50:0/681851047 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27780078e0 con 0x7f27880b0f60 2024-09-11T22:20:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.900+0000 7f27877fe640 1 -- 172.21.15.50:0/681851047 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778007cb0 con 0x7f27880b0f60 2024-09-11T22:20:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.901+0000 7f278f245640 1 -- 172.21.15.50:0/681851047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27880b0f60 msgr2=0x7f27880b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.901+0000 7f278f245640 1 --2- 172.21.15.50:0/681851047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27880b0f60 0x7f27880b4bd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2778009d90 tx=0x7f277802a6f0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.901+0000 7f278f245640 1 -- 172.21.15.50:0/681851047 shutdown_connections 2024-09-11T22:20:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.901+0000 7f278f245640 1 --2- 172.21.15.50:0/681851047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27880b0f60 0x7f27880b4bd0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.901+0000 7f278f245640 1 -- 172.21.15.50:0/681851047 >> 172.21.15.50:0/681851047 conn(0x7f27880b40b0 msgr2=0x7f27880b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.901+0000 7f278f245640 1 -- 172.21.15.50:0/681851047 shutdown_connections 2024-09-11T22:20:17.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.901+0000 7f278f245640 1 -- 172.21.15.50:0/681851047 wait complete. 2024-09-11T22:20:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.902+0000 7f278f245640 1 Processor -- start 2024-09-11T22:20:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.902+0000 7f278f245640 1 -- start start 2024-09-11T22:20:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278f245640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27880b0f60 0x7f27880b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278f245640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27880b1340 0x7f2788160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278f245640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788162d10 0x7f27880cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278f245640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f278806d1e0 con 0x7f2788162d10 2024-09-11T22:20:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278f245640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f278806d550 con 0x7f27880b1340 2024-09-11T22:20:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278f245640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f278806d9e0 con 0x7f27880b0f60 2024-09-11T22:20:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278d7e2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788162d10 0x7f27880cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278d7e2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788162d10 0x7f27880cab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57214/0 (socket says 172.21.15.50:57214) 2024-09-11T22:20:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278d7e2640 1 -- 172.21.15.50:0/1173052426 learned_addr learned my addr 172.21.15.50:0/1173052426 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278cfe1640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27880b0f60 0x7f27880b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f2787fff640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27880b1340 0x7f2788160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278d7e2640 1 -- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27880b0f60 msgr2=0x7f27880b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278d7e2640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27880b0f60 0x7f27880b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278d7e2640 1 -- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27880b1340 msgr2=0x7f2788160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278d7e2640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27880b1340 0x7f2788160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278d7e2640 1 -- 172.21.15.50:0/1173052426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27880b70e0 con 0x7f2788162d10 2024-09-11T22:20:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f278d7e2640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788162d10 0x7f27880cab20 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f278000c390 tx=0x7f278000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.903+0000 7f27857fa640 1 -- 172.21.15.50:0/1173052426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780017070 con 0x7f2788162d10 2024-09-11T22:20:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.904+0000 7f27857fa640 1 -- 172.21.15.50:0/1173052426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2780005ce0 con 0x7f2788162d10 2024-09-11T22:20:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.904+0000 7f27857fa640 1 -- 172.21.15.50:0/1173052426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780007310 con 0x7f2788162d10 2024-09-11T22:20:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.904+0000 7f278f245640 1 -- 172.21.15.50:0/1173052426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27880b73c0 con 0x7f2788162d10 2024-09-11T22:20:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.904+0000 7f278f245640 1 -- 172.21.15.50:0/1173052426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27880b7980 con 0x7f2788162d10 2024-09-11T22:20:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.905+0000 7f278f245640 1 -- 172.21.15.50:0/1173052426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27880b4bd0 con 0x7f2788162d10 2024-09-11T22:20:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.905+0000 7f27857fa640 1 -- 172.21.15.50:0/1173052426 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f278001a070 con 0x7f2788162d10 2024-09-11T22:20:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.906+0000 7f27857fa640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f276806be30 0x7f276806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.906+0000 7f27857fa640 1 -- 172.21.15.50:0/1173052426 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f278008a290 con 0x7f2788162d10 2024-09-11T22:20:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.906+0000 7f278cfe1640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f276806be30 0x7f276806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.906+0000 7f278cfe1640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f276806be30 0x7f276806e2f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2778034000 tx=0x7f277802f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:17.910+0000 7f27857fa640 1 -- 172.21.15.50:0/1173052426 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2780058c40 con 0x7f2788162d10 2024-09-11T22:20:18.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.122+0000 7f278f245640 1 -- 172.21.15.50:0/1173052426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27880c9270 con 0x7f2788162d10 2024-09-11T22:20:18.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.123+0000 7f27857fa640 1 -- 172.21.15.50:0/1173052426 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7f2780058540 con 0x7f2788162d10 2024-09-11T22:20:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:18.124 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:20:18.124 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:20:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.125+0000 7f278f245640 1 -- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f276806be30 msgr2=0x7f276806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.125+0000 7f278f245640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f276806be30 0x7f276806e2f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2778034000 tx=0x7f277802f000 comp rx=0 tx=0).stop 2024-09-11T22:20:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.125+0000 7f278f245640 1 -- 172.21.15.50:0/1173052426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788162d10 msgr2=0x7f27880cab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.125+0000 7f278f245640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788162d10 0x7f27880cab20 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f278000c390 tx=0x7f278000c850 comp rx=0 tx=0).stop 2024-09-11T22:20:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.125+0000 7f278f245640 1 -- 172.21.15.50:0/1173052426 shutdown_connections 2024-09-11T22:20:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.125+0000 7f278f245640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f276806be30 0x7f276806e2f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.125+0000 7f278f245640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2788162d10 0x7f27880cab20 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.125+0000 7f278f245640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27880b1340 0x7f2788160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.125+0000 7f278f245640 1 --2- 172.21.15.50:0/1173052426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27880b0f60 0x7f27880b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.125+0000 7f278f245640 1 -- 172.21.15.50:0/1173052426 >> 172.21.15.50:0/1173052426 conn(0x7f27880b40b0 msgr2=0x7f27880b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.125+0000 7f278f245640 1 -- 172.21.15.50:0/1173052426 shutdown_connections 2024-09-11T22:20:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.125+0000 7f278f245640 1 -- 172.21.15.50:0/1173052426 wait complete. 2024-09-11T22:20:18.137 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-11T22:20:18.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:20:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.238+0000 7f122927b640 1 Processor -- start 2024-09-11T22:20:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.238+0000 7f122927b640 1 -- start start 2024-09-11T22:20:18.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.239+0000 7f122927b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f122406e0f0 0x7f122406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.239+0000 7f122927b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122415b7e0 con 0x7f1224072e60 2024-09-11T22:20:18.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.239+0000 7f122927b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122415f140 con 0x7f122415b400 2024-09-11T22:20:18.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.239+0000 7f122927b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f122415f420 con 0x7f122406e0f0 2024-09-11T22:20:18.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.239+0000 7f12227fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f122406e0f0 0x7f122406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.239+0000 7f12237fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1224072e60 0x7f12240711c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53126/0 (socket says 172.21.15.50:53126) 2024-09-11T22:20:18.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.239+0000 7f12227fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f122406e0f0 0x7f122406d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57226/0 (socket says 172.21.15.50:57226) 2024-09-11T22:20:18.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.239+0000 7f12237fe640 1 -- 172.21.15.50:0/3793593531 learned_addr learned my addr 172.21.15.50:0/3793593531 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:18.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.240+0000 7f12227fc640 1 -- 172.21.15.50:0/3793593531 >> v1:172.21.15.77:6789/0 conn(0x7f122415b400 legacy=0x7f122406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.240+0000 7f12227fc640 1 -- 172.21.15.50:0/3793593531 >> v1:172.21.15.50:6789/0 conn(0x7f1224072e60 legacy=0x7f12240711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.240+0000 7f12227fc640 1 -- 172.21.15.50:0/3793593531 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122415f700 con 0x7f122406e0f0 2024-09-11T22:20:18.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.240+0000 7f1221ffb640 1 -- 172.21.15.50:0/3793593531 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2096669545 0 0) 0x7f122415f140 con 0x7f122415b400 2024-09-11T22:20:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.240+0000 7f12227fc640 1 --2- 172.21.15.50:0/3793593531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122406e0f0 0x7f122406d070 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f120c0097a0 tx=0x7f120c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57eb4a9751307713 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.240+0000 7f1221ffb640 1 -- 172.21.15.50:0/3793593531 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c037070 con 0x7f122406e0f0 2024-09-11T22:20:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.240+0000 7f1221ffb640 1 -- 172.21.15.50:0/3793593531 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120c032440 con 0x7f122406e0f0 2024-09-11T22:20:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.240+0000 7f1221ffb640 1 -- 172.21.15.50:0/3793593531 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c032810 con 0x7f122406e0f0 2024-09-11T22:20:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.241+0000 7f122927b640 1 -- 172.21.15.50:0/3793593531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122406e0f0 msgr2=0x7f122406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.241+0000 7f122927b640 1 --2- 172.21.15.50:0/3793593531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122406e0f0 0x7f122406d070 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f120c0097a0 tx=0x7f120c02a230 comp rx=0 tx=0).stop 2024-09-11T22:20:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.241+0000 7f122927b640 1 -- 172.21.15.50:0/3793593531 shutdown_connections 2024-09-11T22:20:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.241+0000 7f122927b640 1 --2- 172.21.15.50:0/3793593531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122406e0f0 0x7f122406d070 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.241+0000 7f122927b640 1 -- 172.21.15.50:0/3793593531 >> 172.21.15.50:0/3793593531 conn(0x7f12240679c0 msgr2=0x7f1224067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.241+0000 7f122927b640 1 -- 172.21.15.50:0/3793593531 shutdown_connections 2024-09-11T22:20:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.241+0000 7f122927b640 1 -- 172.21.15.50:0/3793593531 wait complete. 2024-09-11T22:20:18.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.242+0000 7f122927b640 1 Processor -- start 2024-09-11T22:20:18.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.242+0000 7f122927b640 1 -- start start 2024-09-11T22:20:18.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.243+0000 7f122927b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f122406e0f0 0x7f12241f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.243+0000 7f122927b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1224072e60 0x7f12240aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.243+0000 7f122927b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 0x7f122414ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.243+0000 7f122927b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f12240718d0 con 0x7f122415b400 2024-09-11T22:20:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.243+0000 7f122927b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f12240cfc50 con 0x7f122406e0f0 2024-09-11T22:20:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.243+0000 7f122927b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1224071a50 con 0x7f1224072e60 2024-09-11T22:20:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.243+0000 7f12237fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 0x7f122414ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.243+0000 7f12237fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 0x7f122414ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57236/0 (socket says 172.21.15.50:57236) 2024-09-11T22:20:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.243+0000 7f12237fe640 1 -- 172.21.15.50:0/527910513 learned_addr learned my addr 172.21.15.50:0/527910513 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.243+0000 7f1222ffd640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f122406e0f0 0x7f12241f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.243+0000 7f12227fc640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1224072e60 0x7f12240aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.244+0000 7f12237fe640 1 -- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1224072e60 msgr2=0x7f12240aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.244+0000 7f12237fe640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1224072e60 0x7f12240aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.244+0000 7f12237fe640 1 -- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f122406e0f0 msgr2=0x7f12241f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.244+0000 7f12237fe640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f122406e0f0 0x7f12241f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.244+0000 7f12237fe640 1 -- 172.21.15.50:0/527910513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12241f4f20 con 0x7f122415b400 2024-09-11T22:20:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.244+0000 7f12237fe640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 0x7f122414ba20 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f121c00c430 tx=0x7f121c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.244+0000 7f121b7fe640 1 -- 172.21.15.50:0/527910513 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c017070 con 0x7f122415b400 2024-09-11T22:20:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.244+0000 7f121b7fe640 1 -- 172.21.15.50:0/527910513 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f121c005ce0 con 0x7f122415b400 2024-09-11T22:20:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.244+0000 7f122927b640 1 -- 172.21.15.50:0/527910513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12240cf110 con 0x7f122415b400 2024-09-11T22:20:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.244+0000 7f121b7fe640 1 -- 172.21.15.50:0/527910513 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c0072d0 con 0x7f122415b400 2024-09-11T22:20:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.244+0000 7f122927b640 1 -- 172.21.15.50:0/527910513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12240ceb50 con 0x7f122415b400 2024-09-11T22:20:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.245+0000 7f122927b640 1 -- 172.21.15.50:0/527910513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f122406d070 con 0x7f122415b400 2024-09-11T22:20:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.246+0000 7f121b7fe640 1 -- 172.21.15.50:0/527910513 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f121c01a070 con 0x7f122415b400 2024-09-11T22:20:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.246+0000 7f121b7fe640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f120406be30 0x7f120406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.246+0000 7f121b7fe640 1 -- 172.21.15.50:0/527910513 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f121c08a050 con 0x7f122415b400 2024-09-11T22:20:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.246+0000 7f1222ffd640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f120406be30 0x7f120406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.247+0000 7f1222ffd640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f120406be30 0x7f120406e2f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f12140012e0 tx=0x7f1214009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.250+0000 7f121b7fe640 1 -- 172.21.15.50:0/527910513 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12241f4f20 con 0x7f122415b400 2024-09-11T22:20:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.499+0000 7f122927b640 1 -- 172.21.15.50:0/527910513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1224069f50 con 0x7f122415b400 2024-09-11T22:20:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.499+0000 7f121b7fe640 1 -- 172.21.15.50:0/527910513 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7f121c058440 con 0x7f122415b400 2024-09-11T22:20:18.500 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:18.500 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":567,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":849,"data_bytes":866452768,"bytes_used":2042015744,"bytes_avail":771052097536,"bytes_total":773094113280,"write_bytes_sec":72147072,"read_op_per_sec":0,"write_op_per_sec":70},"fsmap":{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8907}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-11T22:19:43.488615+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:20:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.501+0000 7f122927b640 1 -- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f120406be30 msgr2=0x7f120406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.501+0000 7f122927b640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f120406be30 0x7f120406e2f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f12140012e0 tx=0x7f1214009040 comp rx=0 tx=0).stop 2024-09-11T22:20:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.501+0000 7f122927b640 1 -- 172.21.15.50:0/527910513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 msgr2=0x7f122414ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.501+0000 7f122927b640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 0x7f122414ba20 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f121c00c430 tx=0x7f121c00c8f0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.501+0000 7f122927b640 1 -- 172.21.15.50:0/527910513 shutdown_connections 2024-09-11T22:20:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.501+0000 7f122927b640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f120406be30 0x7f120406e2f0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.501+0000 7f122927b640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1224072e60 0x7f12240aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.501+0000 7f122927b640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122415b400 0x7f122414ba20 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.501+0000 7f122927b640 1 --2- 172.21.15.50:0/527910513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f122406e0f0 0x7f12241f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.501+0000 7f122927b640 1 -- 172.21.15.50:0/527910513 >> 172.21.15.50:0/527910513 conn(0x7f12240679c0 msgr2=0x7f12241581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.501+0000 7f122927b640 1 -- 172.21.15.50:0/527910513 shutdown_connections 2024-09-11T22:20:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:18.501+0000 7f122927b640 1 -- 172.21.15.50:0/527910513 wait complete. 2024-09-11T22:20:18.513 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-11T22:20:19.513 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:19.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.627+0000 7f9b5d45e640 1 Processor -- start 2024-09-11T22:20:19.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.627+0000 7f9b5d45e640 1 -- start start 2024-09-11T22:20:19.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.628+0000 7f9b5d45e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9b58161fa0 0x7f9b580b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.628+0000 7f9b5d45e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 0x7f9b580cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.628+0000 7f9b5d45e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b580cfbd0 con 0x7f9b580cf440 2024-09-11T22:20:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.628+0000 7f9b5d45e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9b580cdce0 con 0x7f9b58161fa0 2024-09-11T22:20:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.628+0000 7f9b5d45e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9b580d1220 con 0x7f9b580b1600 2024-09-11T22:20:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.628+0000 7f9b577fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9b580cf440 0x7f9b5806bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53140/0 (socket says 172.21.15.50:53140) 2024-09-11T22:20:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.628+0000 7f9b577fe640 1 -- 172.21.15.50:0/2355622740 learned_addr learned my addr 172.21.15.50:0/2355622740 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.628+0000 7f9b567fc640 1 --2- 172.21.15.50:0/2355622740 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 0x7f9b580cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.628+0000 7f9b56ffd640 1 --2- 172.21.15.50:0/2355622740 >> v2:172.21.15.77:3300/0 conn(0x7f9b58161fa0 0x7f9b580b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.628+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 246743321 0 0) 0x7f9b580cfbd0 con 0x7f9b580cf440 2024-09-11T22:20:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.628+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b44003520 con 0x7f9b580cf440 2024-09-11T22:20:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3747653553 0 0) 0x7f9b44003520 con 0x7f9b580cf440 2024-09-11T22:20:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 msgr2=0x7f9b580cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 --2- 172.21.15.50:0/2355622740 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 0x7f9b580cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 >> v2:172.21.15.77:3300/0 conn(0x7f9b58161fa0 msgr2=0x7f9b580b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 --2- 172.21.15.50:0/2355622740 >> v2:172.21.15.77:3300/0 conn(0x7f9b58161fa0 0x7f9b580b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b580cfeb0 con 0x7f9b580cf440 2024-09-11T22:20:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f9b500019f0 con 0x7f9b580cf440 2024-09-11T22:20:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 >> v1:172.21.15.50:6789/0 conn(0x7f9b580cf440 legacy=0x7f9b5806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 --2- 172.21.15.50:0/2355622740 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 0x7f9b440039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 --2- 172.21.15.50:0/2355622740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b44003f30 0x7f9b44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 --2- 172.21.15.50:0/2355622740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b44004d40 0x7f9b440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9b580d1220 con 0x7f9b44004d40 2024-09-11T22:20:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4400b9c0 con 0x7f9b44003f30 2024-09-11T22:20:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9b4400bb40 con 0x7f9b580b1600 2024-09-11T22:20:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b577fe640 1 --2- 172.21.15.50:0/2355622740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b44004d40 0x7f9b440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b56ffd640 1 --2- 172.21.15.50:0/2355622740 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 0x7f9b440039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b567fc640 1 --2- 172.21.15.50:0/2355622740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b44003f30 0x7f9b44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b56ffd640 1 -- 172.21.15.50:0/2355622740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b44003f30 msgr2=0x7f9b44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:19.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b56ffd640 1 --2- 172.21.15.50:0/2355622740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b44003f30 0x7f9b44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b56ffd640 1 -- 172.21.15.50:0/2355622740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b44004d40 msgr2=0x7f9b440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:19.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b56ffd640 1 --2- 172.21.15.50:0/2355622740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b44004d40 0x7f9b440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b56ffd640 1 -- 172.21.15.50:0/2355622740 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b44003520 con 0x7f9b580b1600 2024-09-11T22:20:19.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.629+0000 7f9b577fe640 1 --2- 172.21.15.50:0/2355622740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b44004d40 0x7f9b440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:19.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.630+0000 7f9b56ffd640 1 --2- 172.21.15.50:0/2355622740 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 0x7f9b440039b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009ac0 tx=0x7f9b44005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64dfb99824a61da7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:19.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.630+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40036070 con 0x7f9b580b1600 2024-09-11T22:20:19.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.630+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b40031400 con 0x7f9b580b1600 2024-09-11T22:20:19.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.630+0000 7f9b55ffb640 1 -- 172.21.15.50:0/2355622740 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40009690 con 0x7f9b580b1600 2024-09-11T22:20:19.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.631+0000 7f9b5d45e640 1 -- 172.21.15.50:0/2355622740 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 msgr2=0x7f9b440039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.631+0000 7f9b5d45e640 1 --2- 172.21.15.50:0/2355622740 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 0x7f9b440039b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009ac0 tx=0x7f9b44005830 comp rx=0 tx=0).stop 2024-09-11T22:20:19.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.631+0000 7f9b577fe640 1 -- 172.21.15.50:0/2355622740 reap_dead start 2024-09-11T22:20:19.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.631+0000 7f9b5d45e640 1 -- 172.21.15.50:0/2355622740 shutdown_connections 2024-09-11T22:20:19.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.631+0000 7f9b5d45e640 1 -- 172.21.15.50:0/2355622740 >> 172.21.15.50:0/2355622740 conn(0x7f9b5809ba50 msgr2=0x7f9b580b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:19.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.631+0000 7f9b5d45e640 1 -- 172.21.15.50:0/2355622740 shutdown_connections 2024-09-11T22:20:19.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.631+0000 7f9b5d45e640 1 -- 172.21.15.50:0/2355622740 wait complete. 2024-09-11T22:20:19.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.632+0000 7f9b5d45e640 1 Processor -- start 2024-09-11T22:20:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.632+0000 7f9b5d45e640 1 -- start start 2024-09-11T22:20:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b5d45e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 0x7f9b580cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b5d45e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b58070c40 0x7f9b580ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b5d45e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b580ca6a0 0x7f9b581601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b5d45e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9b580cf8f0 con 0x7f9b58070c40 2024-09-11T22:20:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b5d45e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9b580d17e0 con 0x7f9b580ca6a0 2024-09-11T22:20:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b5d45e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9b58162380 con 0x7f9b580b1600 2024-09-11T22:20:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b567fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b58070c40 0x7f9b580ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b567fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b58070c40 0x7f9b580ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57242/0 (socket says 172.21.15.50:57242) 2024-09-11T22:20:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b567fc640 1 -- 172.21.15.50:0/249083282 learned_addr learned my addr 172.21.15.50:0/249083282 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b56ffd640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 0x7f9b580cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b577fe640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b580ca6a0 0x7f9b581601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b567fc640 1 -- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 msgr2=0x7f9b580cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b567fc640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 0x7f9b580cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b567fc640 1 -- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b580ca6a0 msgr2=0x7f9b581601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b567fc640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b580ca6a0 0x7f9b581601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b567fc640 1 -- 172.21.15.50:0/249083282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b580710c0 con 0x7f9b58070c40 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b577fe640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b580ca6a0 0x7f9b581601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.633+0000 7f9b56ffd640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 0x7f9b580cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.634+0000 7f9b567fc640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b58070c40 0x7f9b580ca160 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f9b48011990 tx=0x7f9b48011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.634+0000 7f9b4f7fe640 1 -- 172.21.15.50:0/249083282 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4800fa70 con 0x7f9b58070c40 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.634+0000 7f9b4f7fe640 1 -- 172.21.15.50:0/249083282 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b4800fc10 con 0x7f9b58070c40 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.634+0000 7f9b4f7fe640 1 -- 172.21.15.50:0/249083282 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b48014440 con 0x7f9b58070c40 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.634+0000 7f9b5d45e640 1 -- 172.21.15.50:0/249083282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b5815fed0 con 0x7f9b58070c40 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.634+0000 7f9b5d45e640 1 -- 172.21.15.50:0/249083282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b5815ee30 con 0x7f9b58070c40 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.635+0000 7f9b5d45e640 1 -- 172.21.15.50:0/249083282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b580d1c70 con 0x7f9b58070c40 2024-09-11T22:20:19.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.635+0000 7f9b4f7fe640 1 -- 172.21.15.50:0/249083282 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b48012040 con 0x7f9b58070c40 2024-09-11T22:20:19.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.636+0000 7f9b4f7fe640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b3806be60 0x7f9b3806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.636+0000 7f9b4f7fe640 1 -- 172.21.15.50:0/249083282 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f9b4808b3c0 con 0x7f9b58070c40 2024-09-11T22:20:19.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.636+0000 7f9b56ffd640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b3806be60 0x7f9b3806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.637+0000 7f9b56ffd640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b3806be60 0x7f9b3806e320 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9b40033000 tx=0x7f9b40008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:19.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.640+0000 7f9b4f7fe640 1 -- 172.21.15.50:0/249083282 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b48019030 con 0x7f9b58070c40 2024-09-11T22:20:19.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.853+0000 7f9b5d45e640 1 -- 172.21.15.50:0/249083282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b580a0830 con 0x7f9b58070c40 2024-09-11T22:20:19.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.854+0000 7f9b4f7fe640 1 -- 172.21.15.50:0/249083282 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7f9b480597b0 con 0x7f9b58070c40 2024-09-11T22:20:19.855 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:19.855 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:20:19.855 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:20:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.856+0000 7f9b5d45e640 1 -- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b3806be60 msgr2=0x7f9b3806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.856+0000 7f9b5d45e640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b3806be60 0x7f9b3806e320 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9b40033000 tx=0x7f9b40008030 comp rx=0 tx=0).stop 2024-09-11T22:20:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.856+0000 7f9b5d45e640 1 -- 172.21.15.50:0/249083282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b58070c40 msgr2=0x7f9b580ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.856+0000 7f9b5d45e640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b58070c40 0x7f9b580ca160 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f9b48011990 tx=0x7f9b48011e50 comp rx=0 tx=0).stop 2024-09-11T22:20:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.856+0000 7f9b5d45e640 1 -- 172.21.15.50:0/249083282 shutdown_connections 2024-09-11T22:20:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.856+0000 7f9b5d45e640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b3806be60 0x7f9b3806e320 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.856+0000 7f9b5d45e640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b580ca6a0 0x7f9b581601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.856+0000 7f9b5d45e640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b58070c40 0x7f9b580ca160 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.856+0000 7f9b5d45e640 1 --2- 172.21.15.50:0/249083282 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b580b1600 0x7f9b580cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.856+0000 7f9b5d45e640 1 -- 172.21.15.50:0/249083282 >> 172.21.15.50:0/249083282 conn(0x7f9b5809ba50 msgr2=0x7f9b580af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:19.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.856+0000 7f9b5d45e640 1 -- 172.21.15.50:0/249083282 shutdown_connections 2024-09-11T22:20:19.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.856+0000 7f9b5d45e640 1 -- 172.21.15.50:0/249083282 wait complete. 2024-09-11T22:20:19.868 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-11T22:20:19.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:20:19.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.967+0000 7fbba7f49640 1 Processor -- start 2024-09-11T22:20:19.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.968+0000 7fbba7f49640 1 -- start start 2024-09-11T22:20:19.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.968+0000 7fbba7f49640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbba015e870 0x7fbba00d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.968+0000 7fbba7f49640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbba00d16d0 0x7fbba00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.968+0000 7fbba7f49640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba00cfa80 con 0x7fbba00d3a30 2024-09-11T22:20:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.968+0000 7fbba7f49640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fbba00d3ea0 con 0x7fbba00d16d0 2024-09-11T22:20:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.968+0000 7fbba7f49640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbba00d1b10 con 0x7fbba015e870 2024-09-11T22:20:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.968+0000 7fbba54e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbba00d16d0 0x7fbba00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.969+0000 7fbba54e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbba00d16d0 0x7fbba00d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57244/0 (socket says 172.21.15.50:57244) 2024-09-11T22:20:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.969+0000 7fbba54e4640 1 -- 172.21.15.50:0/817527265 learned_addr learned my addr 172.21.15.50:0/817527265 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.969+0000 7fbba54e4640 1 -- 172.21.15.50:0/817527265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbba015e870 msgr2=0x7fbba00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.969+0000 7fbba5ce5640 1 --2- 172.21.15.50:0/817527265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbba015e870 0x7fbba00d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.969+0000 7fbba54e4640 1 --2- 172.21.15.50:0/817527265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbba015e870 0x7fbba00d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.969+0000 7fbba54e4640 1 -- 172.21.15.50:0/817527265 >> v1:172.21.15.77:6789/0 conn(0x7fbba00d3a30 legacy=0x7fbba00b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.969+0000 7fbba54e4640 1 -- 172.21.15.50:0/817527265 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba00d40d0 con 0x7fbba00d16d0 2024-09-11T22:20:19.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.969+0000 7fbba5ce5640 1 --2- 172.21.15.50:0/817527265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbba015e870 0x7fbba00d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:19.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.969+0000 7fbba54e4640 1 --2- 172.21.15.50:0/817527265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba00d16d0 0x7fbba00d34f0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009870 tx=0x7fbb9402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a65672c2549aaf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.970+0000 7fbba4ce3640 1 -- 172.21.15.50:0/817527265 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94037070 con 0x7fbba00d16d0 2024-09-11T22:20:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.970+0000 7fbba4ce3640 1 -- 172.21.15.50:0/817527265 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb94032440 con 0x7fbba00d16d0 2024-09-11T22:20:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.970+0000 7fbba4ce3640 1 -- 172.21.15.50:0/817527265 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94032810 con 0x7fbba00d16d0 2024-09-11T22:20:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.970+0000 7fbba7f49640 1 -- 172.21.15.50:0/817527265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba00d16d0 msgr2=0x7fbba00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.970+0000 7fbba7f49640 1 --2- 172.21.15.50:0/817527265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba00d16d0 0x7fbba00d34f0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009870 tx=0x7fbb9402a210 comp rx=0 tx=0).stop 2024-09-11T22:20:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.970+0000 7fbba7f49640 1 -- 172.21.15.50:0/817527265 shutdown_connections 2024-09-11T22:20:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.970+0000 7fbba7f49640 1 --2- 172.21.15.50:0/817527265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba00d16d0 0x7fbba00d34f0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.970+0000 7fbba7f49640 1 --2- 172.21.15.50:0/817527265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbba015e870 0x7fbba00d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.970+0000 7fbba7f49640 1 -- 172.21.15.50:0/817527265 >> 172.21.15.50:0/817527265 conn(0x7fbba00727a0 msgr2=0x7fbba00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.970+0000 7fbba7f49640 1 -- 172.21.15.50:0/817527265 shutdown_connections 2024-09-11T22:20:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.970+0000 7fbba7f49640 1 -- 172.21.15.50:0/817527265 wait complete. 2024-09-11T22:20:19.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.972+0000 7fbba7f49640 1 Processor -- start 2024-09-11T22:20:19.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.972+0000 7fbba7f49640 1 -- start start 2024-09-11T22:20:19.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.972+0000 7fbba7f49640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbba00d16d0 0x7fbba01f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.972+0000 7fbba7f49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba00d3a30 0x7fbba00cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.972+0000 7fbba7f49640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbba015e870 0x7fbba0154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.972+0000 7fbba7f49640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbba00b7ee0 con 0x7fbba00d3a30 2024-09-11T22:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.972+0000 7fbba7f49640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbba00b7c00 con 0x7fbba00d16d0 2024-09-11T22:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.972+0000 7fbba7f49640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbba015ec50 con 0x7fbba015e870 2024-09-11T22:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.972+0000 7fbba54e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba00d3a30 0x7fbba00cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.972+0000 7fbba54e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba00d3a30 0x7fbba00cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57256/0 (socket says 172.21.15.50:57256) 2024-09-11T22:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.972+0000 7fbba54e4640 1 -- 172.21.15.50:0/2066606556 learned_addr learned my addr 172.21.15.50:0/2066606556 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.972+0000 7fbba5ce5640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbba00d16d0 0x7fbba01f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.972+0000 7fbba64e6640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbba015e870 0x7fbba0154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.973+0000 7fbba54e4640 1 -- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbba015e870 msgr2=0x7fbba0154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.973+0000 7fbba54e4640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbba015e870 0x7fbba0154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.973+0000 7fbba54e4640 1 -- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbba00d16d0 msgr2=0x7fbba01f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.973+0000 7fbba54e4640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbba00d16d0 0x7fbba01f4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.973+0000 7fbba54e4640 1 -- 172.21.15.50:0/2066606556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba01575f0 con 0x7fbba00d3a30 2024-09-11T22:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.973+0000 7fbba54e4640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba00d3a30 0x7fbba00cb850 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009870 tx=0x7fbb940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.973+0000 7fbb9e7fc640 1 -- 172.21.15.50:0/2066606556 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94041020 con 0x7fbba00d3a30 2024-09-11T22:20:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.973+0000 7fbb9e7fc640 1 -- 172.21.15.50:0/2066606556 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb94030970 con 0x7fbba00d3a30 2024-09-11T22:20:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.973+0000 7fbb9e7fc640 1 -- 172.21.15.50:0/2066606556 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94037040 con 0x7fbba00d3a30 2024-09-11T22:20:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.973+0000 7fbba7f49640 1 -- 172.21.15.50:0/2066606556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba01578d0 con 0x7fbba00d3a30 2024-09-11T22:20:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.973+0000 7fbba7f49640 1 -- 172.21.15.50:0/2066606556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba0157bb0 con 0x7fbba00d3a30 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.974+0000 7fbba7f49640 1 -- 172.21.15.50:0/2066606556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba0075770 con 0x7fbba00d3a30 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.975+0000 7fbb9e7fc640 1 -- 172.21.15.50:0/2066606556 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb94044020 con 0x7fbba00d3a30 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.975+0000 7fbb9e7fc640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb8c06be30 0x7fbb8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.975+0000 7fbb9e7fc640 1 -- 172.21.15.50:0/2066606556 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fbb940ab6c0 con 0x7fbba00d3a30 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.976+0000 7fbba5ce5640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb8c06be30 0x7fbb8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.976+0000 7fbba5ce5640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb8c06be30 0x7fbb8c06e2f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000f500 tx=0x7fbb90007770 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:19.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:19.979+0000 7fbb9e7fc640 1 -- 172.21.15.50:0/2066606556 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb9404b030 con 0x7fbba00d3a30 2024-09-11T22:20:20.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.248+0000 7fbba7f49640 1 -- 172.21.15.50:0/2066606556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbba00b7940 con 0x7fbba00d3a30 2024-09-11T22:20:20.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.249+0000 7fbb9e7fc640 1 -- 172.21.15.50:0/2066606556 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1491 (secure 0 0 0) 0x7fbba00cfa80 con 0x7fbba00d3a30 2024-09-11T22:20:20.250 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:20.250 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":569,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1035,"data_bytes":1062515782,"bytes_used":2558943232,"bytes_avail":770535170048,"bytes_total":773094113280,"write_bytes_sec":86478096,"read_op_per_sec":0,"write_op_per_sec":85},"fsmap":{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8907}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-11T22:19:43.488615+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:20:20.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.251+0000 7fbba7f49640 1 -- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb8c06be30 msgr2=0x7fbb8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:20.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.251+0000 7fbba7f49640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb8c06be30 0x7fbb8c06e2f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000f500 tx=0x7fbb90007770 comp rx=0 tx=0).stop 2024-09-11T22:20:20.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.251+0000 7fbba7f49640 1 -- 172.21.15.50:0/2066606556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba00d3a30 msgr2=0x7fbba00cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:20.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.251+0000 7fbba7f49640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba00d3a30 0x7fbba00cb850 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009870 tx=0x7fbb940046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.251+0000 7fbba7f49640 1 -- 172.21.15.50:0/2066606556 shutdown_connections 2024-09-11T22:20:20.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.251+0000 7fbba7f49640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb8c06be30 0x7fbb8c06e2f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.251+0000 7fbba7f49640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbba015e870 0x7fbba0154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.251+0000 7fbba7f49640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbba00d3a30 0x7fbba00cb850 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.251+0000 7fbba7f49640 1 --2- 172.21.15.50:0/2066606556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbba00d16d0 0x7fbba01f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.251+0000 7fbba7f49640 1 -- 172.21.15.50:0/2066606556 >> 172.21.15.50:0/2066606556 conn(0x7fbba00727a0 msgr2=0x7fbba00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:20.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.251+0000 7fbba7f49640 1 -- 172.21.15.50:0/2066606556 shutdown_connections 2024-09-11T22:20:20.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:20.251+0000 7fbba7f49640 1 -- 172.21.15.50:0/2066606556 wait complete. 2024-09-11T22:20:20.262 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-11T22:20:21.264 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:21.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.379+0000 7f9c2d453640 1 Processor -- start 2024-09-11T22:20:21.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.379+0000 7f9c2d453640 1 -- start start 2024-09-11T22:20:21.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c2d453640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9c280af4c0 0x7f9c280b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c2d453640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c280b09e0 0x7f9c280b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c2d453640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c280af940 con 0x7f9c2815fd80 2024-09-11T22:20:21.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c2d453640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9c280d1500 con 0x7f9c280af4c0 2024-09-11T22:20:21.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c2d453640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9c280afc20 con 0x7f9c280b09e0 2024-09-11T22:20:21.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c1ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9c280af4c0 0x7f9c280b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c1ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9c280af4c0 0x7f9c280b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57266/0 (socket says 172.21.15.50:57266) 2024-09-11T22:20:21.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c1ffff640 1 -- 172.21.15.50:0/1663664081 learned_addr learned my addr 172.21.15.50:0/1663664081 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:21.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c277fe640 1 --2- 172.21.15.50:0/1663664081 >> v2:172.21.15.77:3300/0 conn(0x7f9c280b09e0 0x7f9c280b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c1ffff640 1 -- 172.21.15.50:0/1663664081 >> v2:172.21.15.77:3300/0 conn(0x7f9c280b09e0 msgr2=0x7f9c280b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:21.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c1ffff640 1 --2- 172.21.15.50:0/1663664081 >> v2:172.21.15.77:3300/0 conn(0x7f9c280b09e0 0x7f9c280b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c1ffff640 1 -- 172.21.15.50:0/1663664081 >> v1:172.21.15.77:6789/0 conn(0x7f9c2815fd80 legacy=0x7f9c280b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:21.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c1ffff640 1 -- 172.21.15.50:0/1663664081 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c280aff00 con 0x7f9c280af4c0 2024-09-11T22:20:21.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.380+0000 7f9c277fe640 1 --2- 172.21.15.50:0/1663664081 >> v2:172.21.15.77:3300/0 conn(0x7f9c280b09e0 0x7f9c280b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:21.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.381+0000 7f9c1ffff640 1 --2- 172.21.15.50:0/1663664081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c280af4c0 0x7f9c280b2600 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f9c280730b0 tx=0x7f9c1002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4977478f47b91a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:21.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.381+0000 7f9c267fc640 1 -- 172.21.15.50:0/1663664081 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10037070 con 0x7f9c280af4c0 2024-09-11T22:20:21.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.381+0000 7f9c267fc640 1 -- 172.21.15.50:0/1663664081 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c10032440 con 0x7f9c280af4c0 2024-09-11T22:20:21.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.381+0000 7f9c267fc640 1 -- 172.21.15.50:0/1663664081 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10032810 con 0x7f9c280af4c0 2024-09-11T22:20:21.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.382+0000 7f9c2d453640 1 -- 172.21.15.50:0/1663664081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c280af4c0 msgr2=0x7f9c280b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.382+0000 7f9c2d453640 1 --2- 172.21.15.50:0/1663664081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c280af4c0 0x7f9c280b2600 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f9c280730b0 tx=0x7f9c1002a1a0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.382+0000 7f9c2d453640 1 -- 172.21.15.50:0/1663664081 shutdown_connections 2024-09-11T22:20:21.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.382+0000 7f9c2d453640 1 --2- 172.21.15.50:0/1663664081 >> v2:172.21.15.77:3300/0 conn(0x7f9c280b09e0 0x7f9c280b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.382+0000 7f9c2d453640 1 --2- 172.21.15.50:0/1663664081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c280af4c0 0x7f9c280b2600 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.382+0000 7f9c2d453640 1 -- 172.21.15.50:0/1663664081 >> 172.21.15.50:0/1663664081 conn(0x7f9c2809ba50 msgr2=0x7f9c280b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:21.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.382+0000 7f9c2d453640 1 -- 172.21.15.50:0/1663664081 shutdown_connections 2024-09-11T22:20:21.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.382+0000 7f9c2d453640 1 -- 172.21.15.50:0/1663664081 wait complete. 2024-09-11T22:20:21.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.383+0000 7f9c2d453640 1 Processor -- start 2024-09-11T22:20:21.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.383+0000 7f9c2d453640 1 -- start start 2024-09-11T22:20:21.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c2d453640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c280af4c0 0x7f9c280b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c2d453640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c280b09e0 0x7f9c280b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c2d453640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c2815fd80 0x7f9c28154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c2d453640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c280b3ee0 con 0x7f9c2815fd80 2024-09-11T22:20:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c2d453640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9c280b04c0 con 0x7f9c280af4c0 2024-09-11T22:20:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c2d453640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9c28160160 con 0x7f9c280b09e0 2024-09-11T22:20:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c277fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c2815fd80 0x7f9c28154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c277fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c2815fd80 0x7f9c28154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57272/0 (socket says 172.21.15.50:57272) 2024-09-11T22:20:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c277fe640 1 -- 172.21.15.50:0/3086144925 learned_addr learned my addr 172.21.15.50:0/3086144925 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c26ffd640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c280af4c0 0x7f9c280b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c1ffff640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c280b09e0 0x7f9c280b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c277fe640 1 -- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c280b09e0 msgr2=0x7f9c280b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c277fe640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c280b09e0 0x7f9c280b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c277fe640 1 -- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c280af4c0 msgr2=0x7f9c280b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c277fe640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c280af4c0 0x7f9c280b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.384+0000 7f9c277fe640 1 -- 172.21.15.50:0/3086144925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c280b6800 con 0x7f9c2815fd80 2024-09-11T22:20:21.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.385+0000 7f9c277fe640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c2815fd80 0x7f9c28154aa0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000cef0 tx=0x7f9c2000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:21.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.385+0000 7f9c1f7fe640 1 -- 172.21.15.50:0/3086144925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2001a070 con 0x7f9c2815fd80 2024-09-11T22:20:21.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.385+0000 7f9c1f7fe640 1 -- 172.21.15.50:0/3086144925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2000d860 con 0x7f9c2815fd80 2024-09-11T22:20:21.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.385+0000 7f9c2d453640 1 -- 172.21.15.50:0/3086144925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c280b6ae0 con 0x7f9c2815fd80 2024-09-11T22:20:21.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.385+0000 7f9c1f7fe640 1 -- 172.21.15.50:0/3086144925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000dc50 con 0x7f9c2815fd80 2024-09-11T22:20:21.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.385+0000 7f9c2d453640 1 -- 172.21.15.50:0/3086144925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c280b70a0 con 0x7f9c2815fd80 2024-09-11T22:20:21.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.386+0000 7f9c2d453640 1 -- 172.21.15.50:0/3086144925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c280b0e50 con 0x7f9c2815fd80 2024-09-11T22:20:21.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.386+0000 7f9c1f7fe640 1 -- 172.21.15.50:0/3086144925 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c2001d070 con 0x7f9c2815fd80 2024-09-11T22:20:21.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.387+0000 7f9c1f7fe640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.387+0000 7f9c1f7fe640 1 -- 172.21.15.50:0/3086144925 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f9c2008b670 con 0x7f9c2815fd80 2024-09-11T22:20:21.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.387+0000 7f9c26ffd640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.387+0000 7f9c26ffd640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9c18006fd0 tx=0x7f9c18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:21.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.391+0000 7f9c1f7fe640 1 -- 172.21.15.50:0/3086144925 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c2005a170 con 0x7f9c2815fd80 2024-09-11T22:20:21.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.601+0000 7f9c2d453640 1 -- 172.21.15.50:0/3086144925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c28070d70 con 0x7f9c2815fd80 2024-09-11T22:20:21.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.602+0000 7f9c1f7fe640 1 -- 172.21.15.50:0/3086144925 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7f9c20059a70 con 0x7f9c2815fd80 2024-09-11T22:20:21.603 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:21.603 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:20:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:20:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.604+0000 7f9c2d453640 1 -- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 msgr2=0x7f9c0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.604+0000 7f9c2d453640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9c18006fd0 tx=0x7f9c18008040 comp rx=0 tx=0).stop 2024-09-11T22:20:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.604+0000 7f9c2d453640 1 -- 172.21.15.50:0/3086144925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c2815fd80 msgr2=0x7f9c28154aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.604+0000 7f9c2d453640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c2815fd80 0x7f9c28154aa0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000cef0 tx=0x7f9c2000a710 comp rx=0 tx=0).stop 2024-09-11T22:20:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.604+0000 7f9c2d453640 1 -- 172.21.15.50:0/3086144925 shutdown_connections 2024-09-11T22:20:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.604+0000 7f9c2d453640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.604+0000 7f9c2d453640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c280b09e0 0x7f9c280b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.604+0000 7f9c2d453640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c2815fd80 0x7f9c28154aa0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.604+0000 7f9c2d453640 1 --2- 172.21.15.50:0/3086144925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c280af4c0 0x7f9c280b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.604+0000 7f9c2d453640 1 -- 172.21.15.50:0/3086144925 >> 172.21.15.50:0/3086144925 conn(0x7f9c2809ba50 msgr2=0x7f9c280caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.604+0000 7f9c2d453640 1 -- 172.21.15.50:0/3086144925 shutdown_connections 2024-09-11T22:20:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.604+0000 7f9c2d453640 1 -- 172.21.15.50:0/3086144925 wait complete. 2024-09-11T22:20:21.615 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-11T22:20:21.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:20:21.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.716+0000 7fd1b3d86640 1 Processor -- start 2024-09-11T22:20:21.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.716+0000 7fd1b3d86640 1 -- start start 2024-09-11T22:20:21.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b3d86640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1ac0d1c90 0x7fd1ac0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b3d86640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1ac162350 0x7fd1ac1627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b3d86640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1ac163080 con 0x7fd1ac15e8e0 2024-09-11T22:20:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b3d86640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ac15ecc0 con 0x7fd1ac162350 2024-09-11T22:20:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b3d86640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ac0d2ad0 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b2323640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1ac162350 0x7fd1ac1627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b2323640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1ac162350 0x7fd1ac1627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57286/0 (socket says 172.21.15.50:57286) 2024-09-11T22:20:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b2323640 1 -- 172.21.15.50:0/424000140 learned_addr learned my addr 172.21.15.50:0/424000140 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b1321640 1 --2- 172.21.15.50:0/424000140 >> v2:172.21.15.77:3300/0 conn(0x7fd1ac0d1c90 0x7fd1ac0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b2323640 1 -- 172.21.15.50:0/424000140 >> v2:172.21.15.77:3300/0 conn(0x7fd1ac0d1c90 msgr2=0x7fd1ac0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b2323640 1 --2- 172.21.15.50:0/424000140 >> v2:172.21.15.77:3300/0 conn(0x7fd1ac0d1c90 0x7fd1ac0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b2323640 1 -- 172.21.15.50:0/424000140 >> v1:172.21.15.77:6789/0 conn(0x7fd1ac15e8e0 legacy=0x7fd1ac0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b2323640 1 -- 172.21.15.50:0/424000140 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac0d2d20 con 0x7fd1ac162350 2024-09-11T22:20:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.717+0000 7fd1b1321640 1 --2- 172.21.15.50:0/424000140 >> v2:172.21.15.77:3300/0 conn(0x7fd1ac0d1c90 0x7fd1ac0b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:21.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.718+0000 7fd1b2323640 1 --2- 172.21.15.50:0/424000140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac162350 0x7fd1ac1627a0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac1622b0 tx=0x7fd1a402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b4178f3c20c55f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:21.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.718+0000 7fd1b0b20640 1 -- 172.21.15.50:0/424000140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4036070 con 0x7fd1ac162350 2024-09-11T22:20:21.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.718+0000 7fd1b0b20640 1 -- 172.21.15.50:0/424000140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a4031600 con 0x7fd1ac162350 2024-09-11T22:20:21.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.718+0000 7fd1b0b20640 1 -- 172.21.15.50:0/424000140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40319f0 con 0x7fd1ac162350 2024-09-11T22:20:21.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.719+0000 7fd1b3d86640 1 -- 172.21.15.50:0/424000140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac162350 msgr2=0x7fd1ac1627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.719+0000 7fd1b3d86640 1 --2- 172.21.15.50:0/424000140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac162350 0x7fd1ac1627a0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac1622b0 tx=0x7fd1a402a7c0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.719+0000 7fd1b3d86640 1 -- 172.21.15.50:0/424000140 shutdown_connections 2024-09-11T22:20:21.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.719+0000 7fd1b3d86640 1 --2- 172.21.15.50:0/424000140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac162350 0x7fd1ac1627a0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.719+0000 7fd1b3d86640 1 --2- 172.21.15.50:0/424000140 >> v2:172.21.15.77:3300/0 conn(0x7fd1ac0d1c90 0x7fd1ac0b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.719+0000 7fd1b3d86640 1 -- 172.21.15.50:0/424000140 >> 172.21.15.50:0/424000140 conn(0x7fd1ac067ba0 msgr2=0x7fd1ac067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:21.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.719+0000 7fd1b3d86640 1 -- 172.21.15.50:0/424000140 shutdown_connections 2024-09-11T22:20:21.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.719+0000 7fd1b3d86640 1 -- 172.21.15.50:0/424000140 wait complete. 2024-09-11T22:20:21.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.720+0000 7fd1b3d86640 1 Processor -- start 2024-09-11T22:20:21.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.720+0000 7fd1b3d86640 1 -- start start 2024-09-11T22:20:21.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b3d86640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1c90 0x7fd1ac1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b3d86640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ac15e8e0 0x7fd1ac1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b3d86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ac162350 0x7fd1ac0b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b3d86640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac162ce0 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b3d86640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac0d3370 con 0x7fd1ac162350 2024-09-11T22:20:21.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b3d86640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ac162e60 con 0x7fd1ac15e8e0 2024-09-11T22:20:21.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b1b22640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1c90 0x7fd1ac1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b1b22640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1c90 0x7fd1ac1598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57292/0 (socket says 172.21.15.50:57292) 2024-09-11T22:20:21.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b1b22640 1 -- 172.21.15.50:0/1325883443 learned_addr learned my addr 172.21.15.50:0/1325883443 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:21.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b2323640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ac162350 0x7fd1ac0b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b1321640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ac15e8e0 0x7fd1ac1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b1b22640 1 -- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ac15e8e0 msgr2=0x7fd1ac1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b1b22640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ac15e8e0 0x7fd1ac1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b1b22640 1 -- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ac162350 msgr2=0x7fd1ac0b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b1b22640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ac162350 0x7fd1ac0b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b1b22640 1 -- 172.21.15.50:0/1325883443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac0cb960 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b2323640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ac162350 0x7fd1ac0b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1b1b22640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1c90 0x7fd1ac1598e0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fd1a800c430 tx=0x7fd1a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.721+0000 7fd1a27fc640 1 -- 172.21.15.50:0/1325883443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a80052d0 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.722+0000 7fd1a27fc640 1 -- 172.21.15.50:0/1325883443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a8005490 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.722+0000 7fd1b3d86640 1 -- 172.21.15.50:0/1325883443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ac0b6840 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.722+0000 7fd1a27fc640 1 -- 172.21.15.50:0/1325883443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8007260 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.722+0000 7fd1b3d86640 1 -- 172.21.15.50:0/1325883443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ac0cbee0 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.722+0000 7fd1b3d86640 1 -- 172.21.15.50:0/1325883443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ac0b7880 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.723+0000 7fd1a27fc640 1 -- 172.21.15.50:0/1325883443 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1a8007400 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.723+0000 7fd1a27fc640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd19006be30 0x7fd19006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.724+0000 7fd1a27fc640 1 -- 172.21.15.50:0/1325883443 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fd1a808a370 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.724+0000 7fd1b1321640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd19006be30 0x7fd19006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.724+0000 7fd1b1321640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd19006be30 0x7fd19006e2f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac161e50 tx=0x7fd19c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:21.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.728+0000 7fd1a27fc640 1 -- 172.21.15.50:0/1325883443 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1a8058d20 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.970+0000 7fd1b3d86640 1 -- 172.21.15.50:0/1325883443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd1ac0ba770 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.970+0000 7fd1a27fc640 1 -- 172.21.15.50:0/1325883443 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1491 (secure 0 0 0) 0x7fd1a8058620 con 0x7fd1ac0d1c90 2024-09-11T22:20:21.971 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:21.971 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":570,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1035,"data_bytes":1062515782,"bytes_used":2558943232,"bytes_avail":770535170048,"bytes_total":773094113280,"write_bytes_sec":86478096,"read_op_per_sec":0,"write_op_per_sec":85},"fsmap":{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8907}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-11T22:19:43.488615+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:20:21.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.973+0000 7fd1b3d86640 1 -- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd19006be30 msgr2=0x7fd19006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.973+0000 7fd1b3d86640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd19006be30 0x7fd19006e2f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac161e50 tx=0x7fd19c008040 comp rx=0 tx=0).stop 2024-09-11T22:20:21.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.973+0000 7fd1b3d86640 1 -- 172.21.15.50:0/1325883443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1c90 msgr2=0x7fd1ac1598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.973+0000 7fd1b3d86640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1c90 0x7fd1ac1598e0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fd1a800c430 tx=0x7fd1a800c8f0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.973+0000 7fd1b3d86640 1 -- 172.21.15.50:0/1325883443 shutdown_connections 2024-09-11T22:20:21.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.973+0000 7fd1b3d86640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd19006be30 0x7fd19006e2f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.973+0000 7fd1b3d86640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ac15e8e0 0x7fd1ac1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.973+0000 7fd1b3d86640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ac162350 0x7fd1ac0b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.973+0000 7fd1b3d86640 1 --2- 172.21.15.50:0/1325883443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ac0d1c90 0x7fd1ac1598e0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.973+0000 7fd1b3d86640 1 -- 172.21.15.50:0/1325883443 >> 172.21.15.50:0/1325883443 conn(0x7fd1ac067ba0 msgr2=0x7fd1ac0b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:21.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.973+0000 7fd1b3d86640 1 -- 172.21.15.50:0/1325883443 shutdown_connections 2024-09-11T22:20:21.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:21.973+0000 7fd1b3d86640 1 -- 172.21.15.50:0/1325883443 wait complete. 2024-09-11T22:20:21.984 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-11T22:20:22.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.100+0000 7f064758d640 1 Processor -- start 2024-09-11T22:20:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.100+0000 7f064758d640 1 -- start start 2024-09-11T22:20:23.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.101+0000 7f064758d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06400680d0 0x7f06401600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.101+0000 7f064758d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06401605f0 0x7f064006ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.101+0000 7f064758d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0640161030 con 0x7f064015c4a0 2024-09-11T22:20:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.101+0000 7f064758d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0640160d50 con 0x7f06401605f0 2024-09-11T22:20:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.101+0000 7f064758d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f064006e270 con 0x7f06400680d0 2024-09-11T22:20:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.101+0000 7f0645b2a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06401605f0 0x7f064006ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.101+0000 7f0645b2a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06401605f0 0x7f064006ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57300/0 (socket says 172.21.15.50:57300) 2024-09-11T22:20:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.101+0000 7f0645b2a640 1 -- 172.21.15.50:0/2863141231 learned_addr learned my addr 172.21.15.50:0/2863141231 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.101+0000 7f0644b28640 1 --2- 172.21.15.50:0/2863141231 >> v2:172.21.15.77:3300/0 conn(0x7f06400680d0 0x7f06401600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.102+0000 7f0645b2a640 1 -- 172.21.15.50:0/2863141231 >> v2:172.21.15.77:3300/0 conn(0x7f06400680d0 msgr2=0x7f06401600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.102+0000 7f0645b2a640 1 --2- 172.21.15.50:0/2863141231 >> v2:172.21.15.77:3300/0 conn(0x7f06400680d0 0x7f06401600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.102+0000 7f0645b2a640 1 -- 172.21.15.50:0/2863141231 >> v1:172.21.15.77:6789/0 conn(0x7f064015c4a0 legacy=0x7f06400679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.102+0000 7f0645b2a640 1 -- 172.21.15.50:0/2863141231 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064006e550 con 0x7f06401605f0 2024-09-11T22:20:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.102+0000 7f0644b28640 1 --2- 172.21.15.50:0/2863141231 >> v2:172.21.15.77:3300/0 conn(0x7f06400680d0 0x7f06401600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.102+0000 7f0645b2a640 1 --2- 172.21.15.50:0/2863141231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06401605f0 0x7f064006ed50 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f064006cb30 tx=0x7f063802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5092e256746fc2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.103+0000 7f0637fff640 1 -- 172.21.15.50:0/2863141231 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638036070 con 0x7f06401605f0 2024-09-11T22:20:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.103+0000 7f0637fff640 1 -- 172.21.15.50:0/2863141231 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0638031600 con 0x7f06401605f0 2024-09-11T22:20:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.103+0000 7f0637fff640 1 -- 172.21.15.50:0/2863141231 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06380319d0 con 0x7f06401605f0 2024-09-11T22:20:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.103+0000 7f064758d640 1 -- 172.21.15.50:0/2863141231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06401605f0 msgr2=0x7f064006ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.103+0000 7f064758d640 1 --2- 172.21.15.50:0/2863141231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06401605f0 0x7f064006ed50 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f064006cb30 tx=0x7f063802a730 comp rx=0 tx=0).stop 2024-09-11T22:20:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.103+0000 7f064758d640 1 -- 172.21.15.50:0/2863141231 shutdown_connections 2024-09-11T22:20:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.103+0000 7f064758d640 1 --2- 172.21.15.50:0/2863141231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06401605f0 0x7f064006ed50 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.103+0000 7f064758d640 1 --2- 172.21.15.50:0/2863141231 >> v2:172.21.15.77:3300/0 conn(0x7f06400680d0 0x7f06401600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.103+0000 7f064758d640 1 -- 172.21.15.50:0/2863141231 >> 172.21.15.50:0/2863141231 conn(0x7f0640075030 msgr2=0x7f064006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.103+0000 7f064758d640 1 -- 172.21.15.50:0/2863141231 shutdown_connections 2024-09-11T22:20:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.103+0000 7f064758d640 1 -- 172.21.15.50:0/2863141231 wait complete. 2024-09-11T22:20:23.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.105+0000 7f064758d640 1 Processor -- start 2024-09-11T22:20:23.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.105+0000 7f064758d640 1 -- start start 2024-09-11T22:20:23.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.105+0000 7f064758d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06400680d0 0x7f064014fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.105+0000 7f064758d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064015c4a0 0x7f064015f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.105+0000 7f064758d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06401605f0 0x7f0640147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.105+0000 7f064758d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f064015c880 con 0x7f064015c4a0 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.105+0000 7f064758d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0640160a60 con 0x7f06401605f0 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.105+0000 7f064758d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f064015ca00 con 0x7f06400680d0 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0644b28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064015c4a0 0x7f064015f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0644b28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064015c4a0 0x7f064015f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57302/0 (socket says 172.21.15.50:57302) 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0644b28640 1 -- 172.21.15.50:0/3782072076 learned_addr learned my addr 172.21.15.50:0/3782072076 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0645329640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06400680d0 0x7f064014fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0645b2a640 1 --2- 172.21.15.50:0/3782072076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06401605f0 0x7f0640147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0644b28640 1 -- 172.21.15.50:0/3782072076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06400680d0 msgr2=0x7f064014fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0644b28640 1 --2- 172.21.15.50:0/3782072076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06400680d0 0x7f064014fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0644b28640 1 -- 172.21.15.50:0/3782072076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06401605f0 msgr2=0x7f0640147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0644b28640 1 --2- 172.21.15.50:0/3782072076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06401605f0 0x7f0640147970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0644b28640 1 -- 172.21.15.50:0/3782072076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064015cf10 con 0x7f064015c4a0 2024-09-11T22:20:23.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0644b28640 1 --2- 172.21.15.50:0/3782072076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064015c4a0 0x7f064015f720 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f063000d800 tx=0x7f063000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0635ffb640 1 -- 172.21.15.50:0/3782072076 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630004030 con 0x7f064015c4a0 2024-09-11T22:20:23.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0635ffb640 1 -- 172.21.15.50:0/3782072076 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06300041d0 con 0x7f064015c4a0 2024-09-11T22:20:23.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f0635ffb640 1 -- 172.21.15.50:0/3782072076 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06300096a0 con 0x7f064015c4a0 2024-09-11T22:20:23.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.106+0000 7f064758d640 1 -- 172.21.15.50:0/3782072076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0640148270 con 0x7f064015c4a0 2024-09-11T22:20:23.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.107+0000 7f064758d640 1 -- 172.21.15.50:0/3782072076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0640150040 con 0x7f064015c4a0 2024-09-11T22:20:23.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.108+0000 7f064758d640 1 -- 172.21.15.50:0/3782072076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06401600b0 con 0x7f064015c4a0 2024-09-11T22:20:23.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.108+0000 7f0635ffb640 1 -- 172.21.15.50:0/3782072076 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0630009840 con 0x7f064015c4a0 2024-09-11T22:20:23.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.109+0000 7f0635ffb640 1 --2- 172.21.15.50:0/3782072076 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062406be30 0x7f062406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.109+0000 7f0635ffb640 1 -- 172.21.15.50:0/3782072076 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f063008afa0 con 0x7f064015c4a0 2024-09-11T22:20:23.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.109+0000 7f0645329640 1 --2- 172.21.15.50:0/3782072076 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062406be30 0x7f062406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.110+0000 7f0645329640 1 --2- 172.21.15.50:0/3782072076 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062406be30 0x7f062406e2f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f063c000f60 tx=0x7f063c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.113+0000 7f0635ffb640 1 -- 172.21.15.50:0/3782072076 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0630059300 con 0x7f064015c4a0 2024-09-11T22:20:23.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.327+0000 7f064758d640 1 -- 172.21.15.50:0/3782072076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f064015f500 con 0x7f064015c4a0 2024-09-11T22:20:23.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.328+0000 7f0635ffb640 1 -- 172.21.15.50:0/3782072076 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7f063005d600 con 0x7f064015c4a0 2024-09-11T22:20:23.329 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:23.329 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:20:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:20:23.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.330+0000 7f064758d640 1 -- 172.21.15.50:0/3782072076 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062406be30 msgr2=0x7f062406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.330+0000 7f064758d640 1 --2- 172.21.15.50:0/3782072076 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062406be30 0x7f062406e2f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f063c000f60 tx=0x7f063c009040 comp rx=0 tx=0).stop 2024-09-11T22:20:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.330+0000 7f064758d640 1 -- 172.21.15.50:0/3782072076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064015c4a0 msgr2=0x7f064015f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.330+0000 7f064758d640 1 --2- 172.21.15.50:0/3782072076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064015c4a0 0x7f064015f720 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f063000d800 tx=0x7f063000dcc0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.330+0000 7f064758d640 1 -- 172.21.15.50:0/3782072076 shutdown_connections 2024-09-11T22:20:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.330+0000 7f064758d640 1 --2- 172.21.15.50:0/3782072076 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062406be30 0x7f062406e2f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.330+0000 7f064758d640 1 --2- 172.21.15.50:0/3782072076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06401605f0 0x7f0640147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.330+0000 7f064758d640 1 --2- 172.21.15.50:0/3782072076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f064015c4a0 0x7f064015f720 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.330+0000 7f064758d640 1 --2- 172.21.15.50:0/3782072076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06400680d0 0x7f064014fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.330+0000 7f064758d640 1 -- 172.21.15.50:0/3782072076 >> 172.21.15.50:0/3782072076 conn(0x7f0640075030 msgr2=0x7f064014e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.330+0000 7f064758d640 1 -- 172.21.15.50:0/3782072076 shutdown_connections 2024-09-11T22:20:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.330+0000 7f064758d640 1 -- 172.21.15.50:0/3782072076 wait complete. 2024-09-11T22:20:23.341 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-11T22:20:23.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:20:23.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.442+0000 7fb2178d7640 1 Processor -- start 2024-09-11T22:20:23.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.442+0000 7fb2178d7640 1 -- start start 2024-09-11T22:20:23.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb2178d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb210161fa0 0x7fb2100b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb2178d7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb2100b1600 0x7fb2100cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb2178d7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2100cfbd0 con 0x7fb2100cf440 2024-09-11T22:20:23.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb2178d7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb2100cdce0 con 0x7fb2100b1600 2024-09-11T22:20:23.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb2178d7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb2100d1220 con 0x7fb210161fa0 2024-09-11T22:20:23.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb214e72640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb2100b1600 0x7fb2100cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb214e72640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb2100b1600 0x7fb2100cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57310/0 (socket says 172.21.15.50:57310) 2024-09-11T22:20:23.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb215e74640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb2100cf440 0x7fb21006bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53146/0 (socket says 172.21.15.50:53146) 2024-09-11T22:20:23.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb214e72640 1 -- 172.21.15.50:0/2090575221 learned_addr learned my addr 172.21.15.50:0/2090575221 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:23.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb215673640 1 --2- 172.21.15.50:0/2090575221 >> v2:172.21.15.77:3300/0 conn(0x7fb210161fa0 0x7fb2100b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb214e72640 1 -- 172.21.15.50:0/2090575221 >> v2:172.21.15.77:3300/0 conn(0x7fb210161fa0 msgr2=0x7fb2100b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb214e72640 1 --2- 172.21.15.50:0/2090575221 >> v2:172.21.15.77:3300/0 conn(0x7fb210161fa0 0x7fb2100b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb214e72640 1 -- 172.21.15.50:0/2090575221 >> v1:172.21.15.50:6789/0 conn(0x7fb2100cf440 legacy=0x7fb21006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.443+0000 7fb214e72640 1 -- 172.21.15.50:0/2090575221 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2100cfeb0 con 0x7fb2100b1600 2024-09-11T22:20:23.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.444+0000 7fb214e72640 1 --2- 172.21.15.50:0/2090575221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100b1600 0x7fb2100cef00 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fb210072960 tx=0x7fb20002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b8f8158e6e747d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.444+0000 7fb207fff640 1 -- 172.21.15.50:0/2090575221 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb200037070 con 0x7fb2100b1600 2024-09-11T22:20:23.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.444+0000 7fb207fff640 1 -- 172.21.15.50:0/2090575221 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb200032440 con 0x7fb2100b1600 2024-09-11T22:20:23.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.444+0000 7fb207fff640 1 -- 172.21.15.50:0/2090575221 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb200032810 con 0x7fb2100b1600 2024-09-11T22:20:23.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.445+0000 7fb2178d7640 1 -- 172.21.15.50:0/2090575221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100b1600 msgr2=0x7fb2100cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.445+0000 7fb2178d7640 1 --2- 172.21.15.50:0/2090575221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100b1600 0x7fb2100cef00 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fb210072960 tx=0x7fb20002a270 comp rx=0 tx=0).stop 2024-09-11T22:20:23.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.445+0000 7fb2178d7640 1 -- 172.21.15.50:0/2090575221 shutdown_connections 2024-09-11T22:20:23.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.445+0000 7fb2178d7640 1 --2- 172.21.15.50:0/2090575221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100b1600 0x7fb2100cef00 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.445+0000 7fb2178d7640 1 --2- 172.21.15.50:0/2090575221 >> v2:172.21.15.77:3300/0 conn(0x7fb210161fa0 0x7fb2100b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.445+0000 7fb2178d7640 1 -- 172.21.15.50:0/2090575221 >> 172.21.15.50:0/2090575221 conn(0x7fb21009ba50 msgr2=0x7fb2100b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.445+0000 7fb2178d7640 1 -- 172.21.15.50:0/2090575221 shutdown_connections 2024-09-11T22:20:23.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.445+0000 7fb2178d7640 1 -- 172.21.15.50:0/2090575221 wait complete. 2024-09-11T22:20:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.446+0000 7fb2178d7640 1 Processor -- start 2024-09-11T22:20:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.446+0000 7fb2178d7640 1 -- start start 2024-09-11T22:20:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb2178d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2100b1600 0x7fb2100cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb2178d7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2100cf440 0x7fb2101f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb2178d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb210161fa0 0x7fb2100b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb2178d7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb2100cf870 con 0x7fb210161fa0 2024-09-11T22:20:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb2178d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb2100d17e0 con 0x7fb2100b1600 2024-09-11T22:20:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb2178d7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb210162380 con 0x7fb2100cf440 2024-09-11T22:20:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb215e74640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb210161fa0 0x7fb2100b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb215e74640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb210161fa0 0x7fb2100b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57324/0 (socket says 172.21.15.50:57324) 2024-09-11T22:20:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb215e74640 1 -- 172.21.15.50:0/4038567573 learned_addr learned my addr 172.21.15.50:0/4038567573 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb214e72640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2100cf440 0x7fb2101f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb215673640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2100b1600 0x7fb2100cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb215e74640 1 -- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2100cf440 msgr2=0x7fb2101f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb215e74640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2100cf440 0x7fb2101f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb215e74640 1 -- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2100b1600 msgr2=0x7fb2100cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.447+0000 7fb215e74640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2100b1600 0x7fb2100cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.448+0000 7fb215e74640 1 -- 172.21.15.50:0/4038567573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2100c9ca0 con 0x7fb210161fa0 2024-09-11T22:20:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.448+0000 7fb215e74640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb210161fa0 0x7fb2100b36e0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fb20800c7b0 tx=0x7fb20800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.448+0000 7fb205ffb640 1 -- 172.21.15.50:0/4038567573 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208017070 con 0x7fb210161fa0 2024-09-11T22:20:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.448+0000 7fb205ffb640 1 -- 172.21.15.50:0/4038567573 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20800a5e0 con 0x7fb210161fa0 2024-09-11T22:20:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.448+0000 7fb2178d7640 1 -- 172.21.15.50:0/4038567573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2100cb660 con 0x7fb210161fa0 2024-09-11T22:20:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.448+0000 7fb205ffb640 1 -- 172.21.15.50:0/4038567573 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20800a990 con 0x7fb210161fa0 2024-09-11T22:20:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.448+0000 7fb2178d7640 1 -- 172.21.15.50:0/4038567573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2100cbc20 con 0x7fb210161fa0 2024-09-11T22:20:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.449+0000 7fb2178d7640 1 -- 172.21.15.50:0/4038567573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2100d1c70 con 0x7fb210161fa0 2024-09-11T22:20:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.450+0000 7fb205ffb640 1 -- 172.21.15.50:0/4038567573 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb20801a070 con 0x7fb210161fa0 2024-09-11T22:20:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.450+0000 7fb205ffb640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1f406be30 0x7fb1f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.450+0000 7fb205ffb640 1 -- 172.21.15.50:0/4038567573 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fb20808a350 con 0x7fb210161fa0 2024-09-11T22:20:23.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.450+0000 7fb215673640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1f406be30 0x7fb1f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.451+0000 7fb215673640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1f406be30 0x7fb1f406e2f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0079a0 tx=0x7fb20c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.455+0000 7fb205ffb640 1 -- 172.21.15.50:0/4038567573 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb2080586b0 con 0x7fb210161fa0 2024-09-11T22:20:23.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.701+0000 7fb2178d7640 1 -- 172.21.15.50:0/4038567573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb21015c320 con 0x7fb210161fa0 2024-09-11T22:20:23.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.701+0000 7fb205ffb640 1 -- 172.21.15.50:0/4038567573 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7fb20805c9b0 con 0x7fb210161fa0 2024-09-11T22:20:23.705 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:23.705 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":572,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076147270,"bytes_used":2586624000,"bytes_avail":770507489280,"bytes_total":773094113280,"write_bytes_sec":69788305,"read_op_per_sec":0,"write_op_per_sec":68},"fsmap":{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8907}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-11T22:20:21.496687+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:20:23.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.704+0000 7fb2178d7640 1 -- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1f406be30 msgr2=0x7fb1f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.704+0000 7fb2178d7640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1f406be30 0x7fb1f406e2f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0079a0 tx=0x7fb20c008040 comp rx=0 tx=0).stop 2024-09-11T22:20:23.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.704+0000 7fb2178d7640 1 -- 172.21.15.50:0/4038567573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb210161fa0 msgr2=0x7fb2100b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.704+0000 7fb2178d7640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb210161fa0 0x7fb2100b36e0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fb20800c7b0 tx=0x7fb20800cc70 comp rx=0 tx=0).stop 2024-09-11T22:20:23.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.704+0000 7fb2178d7640 1 -- 172.21.15.50:0/4038567573 shutdown_connections 2024-09-11T22:20:23.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.704+0000 7fb2178d7640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb1f406be30 0x7fb1f406e2f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.704+0000 7fb2178d7640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2100cf440 0x7fb2101f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.704+0000 7fb2178d7640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb210161fa0 0x7fb2100b36e0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.704+0000 7fb2178d7640 1 --2- 172.21.15.50:0/4038567573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2100b1600 0x7fb2100cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.704+0000 7fb2178d7640 1 -- 172.21.15.50:0/4038567573 >> 172.21.15.50:0/4038567573 conn(0x7fb21009ba50 msgr2=0x7fb2100cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.704+0000 7fb2178d7640 1 -- 172.21.15.50:0/4038567573 shutdown_connections 2024-09-11T22:20:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.704+0000 7fb2178d7640 1 -- 172.21.15.50:0/4038567573 wait complete. 2024-09-11T22:20:23.715 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-11T22:20:23.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:23.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub abort 2024-09-11T22:20:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.818+0000 7f5f0708c640 1 Processor -- start 2024-09-11T22:20:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.818+0000 7f5f0708c640 1 -- start start 2024-09-11T22:20:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.819+0000 7f5f0708c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f0006e0f0 0x7f5f0006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.819+0000 7f5f0708c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f0015b7e0 con 0x7f5f0015b400 2024-09-11T22:20:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.819+0000 7f5f0708c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f0015f140 con 0x7f5f00072e60 2024-09-11T22:20:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.819+0000 7f5f0708c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0015f420 con 0x7f5f0006e0f0 2024-09-11T22:20:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.819+0000 7f5f04e28640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5f0015b400 0x7f5f0006d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53162/0 (socket says 172.21.15.50:53162) 2024-09-11T22:20:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.819+0000 7f5f04e28640 1 -- 172.21.15.50:0/2919217813 learned_addr learned my addr 172.21.15.50:0/2919217813 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.819+0000 7f5efffff640 1 --2- 172.21.15.50:0/2919217813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f0006e0f0 0x7f5f0006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.820+0000 7f5eff7fe640 1 -- 172.21.15.50:0/2919217813 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3322630006 0 0) 0x7f5f0015b7e0 con 0x7f5f0015b400 2024-09-11T22:20:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.820+0000 7f5eff7fe640 1 -- 172.21.15.50:0/2919217813 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ee8003520 con 0x7f5f0015b400 2024-09-11T22:20:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.820+0000 7f5eff7fe640 1 -- 172.21.15.50:0/2919217813 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3277831588 0 0) 0x7f5f0015f140 con 0x7f5f00072e60 2024-09-11T22:20:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.820+0000 7f5eff7fe640 1 -- 172.21.15.50:0/2919217813 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f0015b7e0 con 0x7f5f00072e60 2024-09-11T22:20:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.820+0000 7f5eff7fe640 1 -- 172.21.15.50:0/2919217813 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1282187969 0 0) 0x7f5ee8003520 con 0x7f5f0015b400 2024-09-11T22:20:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.820+0000 7f5efffff640 1 -- 172.21.15.50:0/2919217813 >> v1:172.21.15.77:6789/0 conn(0x7f5f00072e60 legacy=0x7f5f000711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.820+0000 7f5efffff640 1 -- 172.21.15.50:0/2919217813 >> v1:172.21.15.50:6789/0 conn(0x7f5f0015b400 legacy=0x7f5f0006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.820+0000 7f5efffff640 1 -- 172.21.15.50:0/2919217813 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0015f700 con 0x7f5f0006e0f0 2024-09-11T22:20:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.821+0000 7f5efffff640 1 --2- 172.21.15.50:0/2919217813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f0006e0f0 0x7f5f0006d070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40097d0 tx=0x7f5ef402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2306a299051ff274 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.821+0000 7f5eff7fe640 1 -- 172.21.15.50:0/2919217813 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4037070 con 0x7f5f0006e0f0 2024-09-11T22:20:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.821+0000 7f5eff7fe640 1 -- 172.21.15.50:0/2919217813 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef402ac30 con 0x7f5f0006e0f0 2024-09-11T22:20:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.821+0000 7f5eff7fe640 1 -- 172.21.15.50:0/2919217813 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0001670 con 0x7f5f0006e0f0 2024-09-11T22:20:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.821+0000 7f5f0708c640 1 -- 172.21.15.50:0/2919217813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f0006e0f0 msgr2=0x7f5f0006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.821+0000 7f5f0708c640 1 --2- 172.21.15.50:0/2919217813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f0006e0f0 0x7f5f0006d070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40097d0 tx=0x7f5ef402a1a0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.821+0000 7f5f0708c640 1 -- 172.21.15.50:0/2919217813 shutdown_connections 2024-09-11T22:20:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.821+0000 7f5f0708c640 1 --2- 172.21.15.50:0/2919217813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f0006e0f0 0x7f5f0006d070 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.821+0000 7f5f0708c640 1 -- 172.21.15.50:0/2919217813 >> 172.21.15.50:0/2919217813 conn(0x7f5f000679c0 msgr2=0x7f5f00067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.821+0000 7f5f0708c640 1 -- 172.21.15.50:0/2919217813 shutdown_connections 2024-09-11T22:20:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.821+0000 7f5f0708c640 1 -- 172.21.15.50:0/2919217813 wait complete. 2024-09-11T22:20:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.822+0000 7f5f0708c640 1 Processor -- start 2024-09-11T22:20:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.823+0000 7f5f0708c640 1 -- start start 2024-09-11T22:20:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.823+0000 7f5f0708c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f0006e0f0 0x7f5f001489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.823+0000 7f5f0708c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f00072e60 0x7f5f000ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.823+0000 7f5f0708c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0015b400 0x7f5f000aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.823+0000 7f5f0708c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5f000718d0 con 0x7f5f00072e60 2024-09-11T22:20:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.823+0000 7f5f0708c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f000cfc50 con 0x7f5f0015b400 2024-09-11T22:20:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.823+0000 7f5f0708c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5f00071a50 con 0x7f5f0006e0f0 2024-09-11T22:20:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5efffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f00072e60 0x7f5f000ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5efffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f00072e60 0x7f5f000ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57334/0 (socket says 172.21.15.50:57334) 2024-09-11T22:20:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5efffff640 1 -- 172.21.15.50:0/1274084949 learned_addr learned my addr 172.21.15.50:0/1274084949 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5f04e28640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f0006e0f0 0x7f5f001489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5f05629640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0015b400 0x7f5f000aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5efffff640 1 -- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f0006e0f0 msgr2=0x7f5f001489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5efffff640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f0006e0f0 0x7f5f001489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5efffff640 1 -- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0015b400 msgr2=0x7f5f000aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5efffff640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0015b400 0x7f5f000aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5efffff640 1 -- 172.21.15.50:0/1274084949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f00148ef0 con 0x7f5f00072e60 2024-09-11T22:20:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5f04e28640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f0006e0f0 0x7f5f001489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5efffff640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f00072e60 0x7f5f000ae8c0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4035040 tx=0x7f5ef40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5efd7fa640 1 -- 172.21.15.50:0/1274084949 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4042020 con 0x7f5f00072e60 2024-09-11T22:20:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5f0708c640 1 -- 172.21.15.50:0/1274084949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f0014bf50 con 0x7f5f00072e60 2024-09-11T22:20:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5efd7fa640 1 -- 172.21.15.50:0/1274084949 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef4003c40 con 0x7f5f00072e60 2024-09-11T22:20:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5efd7fa640 1 -- 172.21.15.50:0/1274084949 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4037040 con 0x7f5f00072e60 2024-09-11T22:20:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.824+0000 7f5f0708c640 1 -- 172.21.15.50:0/1274084949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f00149650 con 0x7f5f00072e60 2024-09-11T22:20:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.826+0000 7f5efd7fa640 1 -- 172.21.15.50:0/1274084949 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ef4045020 con 0x7f5f00072e60 2024-09-11T22:20:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.827+0000 7f5efd7fa640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5eec06be30 0x7f5eec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.827+0000 7f5efd7fa640 1 -- 172.21.15.50:0/1274084949 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f5ef40ab080 con 0x7f5f00072e60 2024-09-11T22:20:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.827+0000 7f5f04e28640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5eec06be30 0x7f5eec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.828+0000 7f5f09e25740 1 Processor -- start 2024-09-11T22:20:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.828+0000 7f5f04e28640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5eec06be30 0x7f5eec06e2f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00017e0 tx=0x7f5ef0001610 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.828+0000 7f5f09e25740 1 -- start start 2024-09-11T22:20:23.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.828+0000 7f5f09e25740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 0x5627a74d39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.828+0000 7f5f09e25740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d0da0 0x5627a74d2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.828+0000 7f5f09e25740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74d1200 0x5627a74b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.828+0000 7f5f09e25740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5627a73ef8d0 con 0x5627a74d0da0 2024-09-11T22:20:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.828+0000 7f5f09e25740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5627a7397620 con 0x5627a74d35e0 2024-09-11T22:20:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.828+0000 7f5f09e25740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5627a73eb890 con 0x5627a74d1200 2024-09-11T22:20:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5efffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d0da0 0x5627a74d2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5efffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d0da0 0x5627a74d2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57338/0 (socket says 172.21.15.50:57338) 2024-09-11T22:20:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5efffff640 1 -- 172.21.15.50:0/2942442872 learned_addr learned my addr 172.21.15.50:0/2942442872 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5f05629640 1 --2- 172.21.15.50:0/2942442872 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74d1200 0x5627a74b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5f04e28640 1 --2- 172.21.15.50:0/2942442872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 0x5627a74d39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5efffff640 1 -- 172.21.15.50:0/2942442872 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74d1200 msgr2=0x5627a74b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5efffff640 1 --2- 172.21.15.50:0/2942442872 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74d1200 0x5627a74b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5efffff640 1 -- 172.21.15.50:0/2942442872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 msgr2=0x5627a74d39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5efffff640 1 --2- 172.21.15.50:0/2942442872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 0x5627a74d39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5efffff640 1 -- 172.21.15.50:0/2942442872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627a71cc7d0 con 0x5627a74d0da0 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5efffff640 1 --2- 172.21.15.50:0/2942442872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d0da0 0x5627a74d2930 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4081960 tx=0x7f5ef4078cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fd5144f9d6604 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5ee67fc640 1 -- 172.21.15.50:0/2942442872 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4079360 con 0x5627a74d0da0 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5ee67fc640 1 -- 172.21.15.50:0/2942442872 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef407d660 con 0x5627a74d0da0 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.829+0000 7f5ee67fc640 1 -- 172.21.15.50:0/2942442872 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4081e90 con 0x5627a74d0da0 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.830+0000 7f5f09e25740 1 -- 172.21.15.50:0/2942442872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d0da0 msgr2=0x5627a74d2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.830+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2942442872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d0da0 0x5627a74d2930 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4081960 tx=0x7f5ef4078cc0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.830+0000 7f5f09e25740 1 -- 172.21.15.50:0/2942442872 shutdown_connections 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.830+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2942442872 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74d1200 0x5627a74b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.830+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2942442872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d0da0 0x5627a74d2930 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.830+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2942442872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 0x5627a74d39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.830+0000 7f5f09e25740 1 -- 172.21.15.50:0/2942442872 >> 172.21.15.50:0/2942442872 conn(0x5627a7489240 msgr2=0x5627a74d1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.830+0000 7f5f09e25740 1 -- 172.21.15.50:0/2942442872 shutdown_connections 2024-09-11T22:20:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.830+0000 7f5f09e25740 1 -- 172.21.15.50:0/2942442872 wait complete. 2024-09-11T22:20:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.830+0000 7f5f09e25740 1 -- start start 2024-09-11T22:20:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.831+0000 7f5f09e25740 1 Processor -- start 2024-09-11T22:20:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.831+0000 7f5f09e25740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d1200 0x5627a74c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.831+0000 7f5f09e25740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d35e0 0x5627a74b1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.831+0000 7f5f09e25740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74b6b50 0x5627a74d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.831+0000 7f5f09e25740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5627a74cfd00 con 0x5627a74d35e0 2024-09-11T22:20:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.831+0000 7f5f09e25740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5627a7378750 con 0x5627a74d1200 2024-09-11T22:20:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.831+0000 7f5f09e25740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5627a74cffe0 con 0x5627a74b6b50 2024-09-11T22:20:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5f09e25740 10 client.0 _ll_register_callbacks cb 0x5627a739c780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5efffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d35e0 0x5627a74b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5efffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d35e0 0x5627a74b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57342/0 (socket says 172.21.15.50:57342) 2024-09-11T22:20:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5efffff640 1 -- 172.21.15.50:0/2155985722 learned_addr learned my addr 172.21.15.50:0/2155985722 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5f05629640 1 --2- 172.21.15.50:0/2155985722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74b6b50 0x5627a74d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5f04e28640 1 --2- 172.21.15.50:0/2155985722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d1200 0x5627a74c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5efffff640 1 -- 172.21.15.50:0/2155985722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74b6b50 msgr2=0x5627a74d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5efffff640 1 --2- 172.21.15.50:0/2155985722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74b6b50 0x5627a74d1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5efffff640 1 -- 172.21.15.50:0/2155985722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d1200 msgr2=0x5627a74c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5efffff640 1 --2- 172.21.15.50:0/2155985722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d1200 0x5627a74c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5efffff640 1 -- 172.21.15.50:0/2155985722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627a70c20f0 con 0x5627a74d35e0 2024-09-11T22:20:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5efffff640 1 --2- 172.21.15.50:0/2155985722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d35e0 0x5627a74b1030 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4079060 tx=0x7f5ef4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a7cc2d81fe0b81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5edf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5edf7fe640 1 -- 172.21.15.50:0/2155985722 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4079360 con 0x5627a74d35e0 2024-09-11T22:20:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5edf7fe640 1 -- 172.21.15.50:0/2155985722 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f5ef4081a00 con 0x5627a74d35e0 2024-09-11T22:20:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5f09e25740 1 -- 172.21.15.50:0/2155985722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ef407d660 con 0x5627a74d35e0 2024-09-11T22:20:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5edf7fe640 1 -- 172.21.15.50:0/2155985722 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f5ef4081e90 con 0x5627a74d35e0 2024-09-11T22:20:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5f09e25740 10 client.9192 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.832+0000 7f5f09e25740 1 -- 172.21.15.50:0/2155985722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x5627a722cf60 con 0x5627a74d35e0 2024-09-11T22:20:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.833+0000 7f5edf7fe640 1 -- 172.21.15.50:0/2155985722 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef407d660 con 0x5627a74d35e0 2024-09-11T22:20:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.833+0000 7f5edf7fe640 1 -- 172.21.15.50:0/2155985722 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f5ef40a9120 con 0x5627a74d35e0 2024-09-11T22:20:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.833+0000 7f5f09e25740 10 client.9192 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.833+0000 7f5f09e25740 10 client.9192 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.833+0000 7f5f09e25740 20 client.9192 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.833+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2155985722 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5627a74b4b00 0x5627a74b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.833+0000 7f5f09e25740 4 client.9192 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.833+0000 7f5f09e25740 1 -- 172.21.15.50:0/2155985722 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627a73fd000 con 0x5627a74b4b00 2024-09-11T22:20:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.833+0000 7f5f04e28640 1 --2- 172.21.15.50:0/2155985722 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5627a74b4b00 0x5627a74b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.833+0000 7f5f04e28640 1 --2- 172.21.15.50:0/2155985722 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5627a74b4b00 0x5627a74b4f10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aefbf795048990c0 server_cookie=e86945af8d1ab3c3 in_seq=0 out_seq=0 2024-09-11T22:20:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.833+0000 7f5edf7fe640 10 client.9192 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5edf7fe640 1 -- 172.21.15.50:0/2155985722 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5627a73fd000 con 0x5627a74b4b00 2024-09-11T22:20:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5edf7fe640 10 client.9192 handle_command_reply: tid=0 2024-09-11T22:20:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5f09e25740 1 client.9192 shutdown 2024-09-11T22:20:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5f09e25740 1 -- 172.21.15.50:0/2155985722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d35e0 msgr2=0x5627a74b1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2155985722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d35e0 0x5627a74b1030 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4079060 tx=0x7f5ef4009190 comp rx=0 tx=0).stop 2024-09-11T22:20:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5f09e25740 1 -- 172.21.15.50:0/2155985722 shutdown_connections 2024-09-11T22:20:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2155985722 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5627a74b4b00 0x5627a74b4f10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2155985722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74b6b50 0x5627a74d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2155985722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d35e0 0x5627a74b1030 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5edf7fe640 0 client.9192 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2155985722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d1200 0x5627a74c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5f09e25740 1 -- 172.21.15.50:0/2155985722 >> 172.21.15.50:0/2155985722 conn(0x5627a74d0da0 msgr2=0x5627a74b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5f09e25740 1 -- 172.21.15.50:0/2155985722 shutdown_connections 2024-09-11T22:20:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5f09e25740 1 -- 172.21.15.50:0/2155985722 wait complete. 2024-09-11T22:20:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.834+0000 7f5f09e25740 20 client.9192 trim_cache size 0 max 16384 2024-09-11T22:20:23.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.851+0000 7f5f09e25740 1 Processor -- start 2024-09-11T22:20:23.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.851+0000 7f5f09e25740 1 -- start start 2024-09-11T22:20:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f09e25740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74b6b50 0x5627a74b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f09e25740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74d1200 0x5627a74cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f09e25740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 0x5627a74f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f09e25740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5f00200bb0 con 0x5627a74b6b50 2024-09-11T22:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f09e25740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f000ce140 con 0x5627a74d35e0 2024-09-11T22:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f09e25740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5f000cd4a0 con 0x5627a74d1200 2024-09-11T22:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f04e28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74b6b50 0x5627a74b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f04e28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74b6b50 0x5627a74b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57352/0 (socket says 172.21.15.50:57352) 2024-09-11T22:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f04e28640 1 -- 172.21.15.50:0/2187238965 learned_addr learned my addr 172.21.15.50:0/2187238965 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f04e28640 1 -- 172.21.15.50:0/2187238965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74d1200 msgr2=0x5627a74cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f04e28640 1 --2- 172.21.15.50:0/2187238965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74d1200 0x5627a74cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f04e28640 1 -- 172.21.15.50:0/2187238965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 msgr2=0x5627a74f4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f04e28640 1 --2- 172.21.15.50:0/2187238965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 0x5627a74f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f04e28640 1 -- 172.21.15.50:0/2187238965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627a74d19c0 con 0x5627a74b6b50 2024-09-11T22:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.852+0000 7f5f04e28640 1 --2- 172.21.15.50:0/2187238965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74b6b50 0x5627a74b5e20 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0001eb0 tx=0x7f5ef000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b598369261ef854f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.853+0000 7f5ee5ffb640 1 -- 172.21.15.50:0/2187238965 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef002f070 con 0x5627a74b6b50 2024-09-11T22:20:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.853+0000 7f5ee5ffb640 1 -- 172.21.15.50:0/2187238965 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef0024190 con 0x5627a74b6b50 2024-09-11T22:20:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.853+0000 7f5ee5ffb640 1 -- 172.21.15.50:0/2187238965 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0024db0 con 0x5627a74b6b50 2024-09-11T22:20:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.853+0000 7f5f09e25740 1 -- 172.21.15.50:0/2187238965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74b6b50 msgr2=0x5627a74b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.853+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2187238965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74b6b50 0x5627a74b5e20 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0001eb0 tx=0x7f5ef000c000 comp rx=0 tx=0).stop 2024-09-11T22:20:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.853+0000 7f5f09e25740 1 -- 172.21.15.50:0/2187238965 shutdown_connections 2024-09-11T22:20:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.853+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2187238965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74d1200 0x5627a74cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.853+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2187238965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 0x5627a74f4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.853+0000 7f5f09e25740 1 --2- 172.21.15.50:0/2187238965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74b6b50 0x5627a74b5e20 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.853+0000 7f5f09e25740 1 -- 172.21.15.50:0/2187238965 >> 172.21.15.50:0/2187238965 conn(0x5627a74d0da0 msgr2=0x5627a74c84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.853+0000 7f5f09e25740 1 -- 172.21.15.50:0/2187238965 shutdown_connections 2024-09-11T22:20:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.853+0000 7f5f09e25740 1 -- 172.21.15.50:0/2187238965 wait complete. 2024-09-11T22:20:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.854+0000 7f5f09e25740 1 -- start start 2024-09-11T22:20:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.854+0000 7f5f09e25740 1 Processor -- start 2024-09-11T22:20:23.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5f09e25740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74b6b50 0x5627a7557f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5f09e25740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d1200 0x5627a74f5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5f09e25740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 0x5627a74b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5f09e25740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5627a74cec10 con 0x5627a74d1200 2024-09-11T22:20:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5f09e25740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f000cdaf0 con 0x5627a74d35e0 2024-09-11T22:20:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5f09e25740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5627a74d4e10 con 0x5627a74b6b50 2024-09-11T22:20:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5f09e25740 10 client.0 _ll_register_callbacks cb 0x7f5ef8001920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5efffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d1200 0x5627a74f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5efffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d1200 0x5627a74f5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57354/0 (socket says 172.21.15.50:57354) 2024-09-11T22:20:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5efffff640 1 -- 172.21.15.50:0/1191203726 learned_addr learned my addr 172.21.15.50:0/1191203726 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5f05629640 1 --2- 172.21.15.50:0/1191203726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 0x5627a74b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5f04e28640 1 --2- 172.21.15.50:0/1191203726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74b6b50 0x5627a7557f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5efffff640 1 -- 172.21.15.50:0/1191203726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74b6b50 msgr2=0x5627a7557f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5efffff640 1 --2- 172.21.15.50:0/1191203726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74b6b50 0x5627a7557f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5efffff640 1 -- 172.21.15.50:0/1191203726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 msgr2=0x5627a74b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5efffff640 1 --2- 172.21.15.50:0/1191203726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 0x5627a74b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5efffff640 1 -- 172.21.15.50:0/1191203726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627a709b1b0 con 0x5627a74d1200 2024-09-11T22:20:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5efffff640 1 --2- 172.21.15.50:0/1191203726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d1200 0x5627a74f5380 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f5ef402a1e0 tx=0x7f5ef40a9480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd702defa9f2ed7a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5edf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5edf7fe640 1 -- 172.21.15.50:0/1191203726 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef407d420 con 0x5627a74d1200 2024-09-11T22:20:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5edf7fe640 1 -- 172.21.15.50:0/1191203726 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f5ef40789c0 con 0x5627a74d1200 2024-09-11T22:20:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5f09e25740 1 -- 172.21.15.50:0/1191203726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ef0024190 con 0x5627a74d1200 2024-09-11T22:20:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.855+0000 7f5edf7fe640 1 -- 172.21.15.50:0/1191203726 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f5ef4081c50 con 0x5627a74d1200 2024-09-11T22:20:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5f09e25740 10 client.9198 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5f09e25740 1 -- 172.21.15.50:0/1191203726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x5627a74d5ad0 con 0x5627a74d1200 2024-09-11T22:20:23.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5edf7fe640 1 -- 172.21.15.50:0/1191203726 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef0024190 con 0x5627a74d1200 2024-09-11T22:20:23.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5edf7fe640 1 -- 172.21.15.50:0/1191203726 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f5ef40750b0 con 0x5627a74d1200 2024-09-11T22:20:23.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5f09e25740 10 client.9198 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:23.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5f09e25740 10 client.9198 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:23.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5f09e25740 20 client.9198 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:23.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5f09e25740 1 --2- 172.21.15.50:0/1191203726 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5627a74b3bf0 0x5627a74c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5f09e25740 4 client.9198 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-11T22:20:23.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5f09e25740 1 -- 172.21.15.50:0/1191203726 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x5627a73f7350 con 0x5627a74b3bf0 2024-09-11T22:20:23.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5f04e28640 1 --2- 172.21.15.50:0/1191203726 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5627a74b3bf0 0x5627a74c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5edf7fe640 10 client.9198 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:23.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5f04e28640 1 --2- 172.21.15.50:0/1191203726 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5627a74b3bf0 0x5627a74c6fb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=717fa1579e762675 server_cookie=6011270c0bf21841 in_seq=0 out_seq=0 2024-09-11T22:20:23.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5edf7fe640 1 -- 172.21.15.50:0/1191203726 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5627a73f7350 con 0x5627a74b3bf0 2024-09-11T22:20:23.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5edf7fe640 10 client.9198 handle_command_reply: tid=0 2024-09-11T22:20:23.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.856+0000 7f5f09e25740 1 client.9198 shutdown 2024-09-11T22:20:23.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f09e25740 1 -- 172.21.15.50:0/1191203726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d1200 msgr2=0x5627a74f5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f09e25740 1 --2- 172.21.15.50:0/1191203726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d1200 0x5627a74f5380 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f5ef402a1e0 tx=0x7f5ef40a9480 comp rx=0 tx=0).stop 2024-09-11T22:20:23.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f09e25740 1 -- 172.21.15.50:0/1191203726 shutdown_connections 2024-09-11T22:20:23.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f09e25740 1 --2- 172.21.15.50:0/1191203726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627a74d35e0 0x5627a74b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f09e25740 1 --2- 172.21.15.50:0/1191203726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627a74d1200 0x5627a74f5380 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f09e25740 1 --2- 172.21.15.50:0/1191203726 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5627a74b3bf0 0x5627a74c6fb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f09e25740 1 --2- 172.21.15.50:0/1191203726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5627a74b6b50 0x5627a7557f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5edf7fe640 0 client.9198 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:23.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f09e25740 1 -- 172.21.15.50:0/1191203726 >> 172.21.15.50:0/1191203726 conn(0x5627a74d0da0 msgr2=0x5627a74c84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f09e25740 1 -- 172.21.15.50:0/1191203726 shutdown_connections 2024-09-11T22:20:23.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f09e25740 1 -- 172.21.15.50:0/1191203726 wait complete. 2024-09-11T22:20:23.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f09e25740 20 client.9198 trim_cache size 0 max 16384 2024-09-11T22:20:23.868 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:20:23.868 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:20:23.868 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:20:23.868 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:20:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f0708c640 1 -- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5eec06be30 msgr2=0x7f5eec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f0708c640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5eec06be30 0x7f5eec06e2f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00017e0 tx=0x7f5ef0001610 comp rx=0 tx=0).stop 2024-09-11T22:20:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f0708c640 1 -- 172.21.15.50:0/1274084949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f00072e60 msgr2=0x7f5f000ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f0708c640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f00072e60 0x7f5f000ae8c0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4035040 tx=0x7f5ef40046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f0708c640 1 -- 172.21.15.50:0/1274084949 shutdown_connections 2024-09-11T22:20:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f0708c640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5eec06be30 0x7f5eec06e2f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f0708c640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0015b400 0x7f5f000aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f0708c640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f00072e60 0x7f5f000ae8c0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f0708c640 1 --2- 172.21.15.50:0/1274084949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f0006e0f0 0x7f5f001489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f0708c640 1 -- 172.21.15.50:0/1274084949 >> 172.21.15.50:0/1274084949 conn(0x7f5f000679c0 msgr2=0x7f5f000b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f0708c640 1 -- 172.21.15.50:0/1274084949 shutdown_connections 2024-09-11T22:20:23.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.857+0000 7f5f0708c640 1 -- 172.21.15.50:0/1274084949 wait complete. 2024-09-11T22:20:23.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:23.871 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-11T22:20:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.974+0000 7f4facbf1640 1 Processor -- start 2024-09-11T22:20:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.974+0000 7f4facbf1640 1 -- start start 2024-09-11T22:20:23.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.975+0000 7f4facbf1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4fa8161fa0 0x7f4fa80b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.975+0000 7f4facbf1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4fa80cf610 0x7f4fa80cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.975+0000 7f4facbf1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa80cfbd0 con 0x7f4fa80b1600 2024-09-11T22:20:23.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.975+0000 7f4facbf1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4fa80d1220 con 0x7f4fa80cf610 2024-09-11T22:20:23.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.975+0000 7f4facbf1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa80d17e0 con 0x7f4fa8161fa0 2024-09-11T22:20:23.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.976+0000 7f4fa5d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4fa80b1600 0x7f4fa80cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53172/0 (socket says 172.21.15.50:53172) 2024-09-11T22:20:23.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.976+0000 7f4fa5d9b640 1 -- 172.21.15.50:0/1514699054 learned_addr learned my addr 172.21.15.50:0/1514699054 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:23.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.976+0000 7f4fa659c640 1 --2- 172.21.15.50:0/1514699054 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4fa8161fa0 0x7f4fa80b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.976+0000 7f4fa6d9d640 1 --2- 172.21.15.50:0/1514699054 >> v2:172.21.15.77:3300/0 conn(0x7f4fa80cf610 0x7f4fa80cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.976+0000 7f4fa559a640 1 -- 172.21.15.50:0/1514699054 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517664822 0 0) 0x7f4fa80cfbd0 con 0x7f4fa80b1600 2024-09-11T22:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.976+0000 7f4fa559a640 1 -- 172.21.15.50:0/1514699054 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f94003520 con 0x7f4fa80b1600 2024-09-11T22:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.976+0000 7f4fa559a640 1 -- 172.21.15.50:0/1514699054 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3953354395 0 0) 0x7f4f94003520 con 0x7f4fa80b1600 2024-09-11T22:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.976+0000 7f4fa6d9d640 1 -- 172.21.15.50:0/1514699054 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4fa8161fa0 msgr2=0x7f4fa80b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.976+0000 7f4fa6d9d640 1 --2- 172.21.15.50:0/1514699054 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4fa8161fa0 0x7f4fa80b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.976+0000 7f4fa6d9d640 1 -- 172.21.15.50:0/1514699054 >> v1:172.21.15.50:6789/0 conn(0x7f4fa80b1600 legacy=0x7f4fa80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.976+0000 7f4fa6d9d640 1 -- 172.21.15.50:0/1514699054 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa80cfeb0 con 0x7f4fa80cf610 2024-09-11T22:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.976+0000 7f4fa659c640 1 --2- 172.21.15.50:0/1514699054 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4fa8161fa0 0x7f4fa80b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:23.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.977+0000 7f4fa6d9d640 1 --2- 172.21.15.50:0/1514699054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cf610 0x7f4fa80cccd0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009d90 tx=0x7f4f9802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba1027538ccde4ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.977+0000 7f4fa559a640 1 -- 172.21.15.50:0/1514699054 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90001670 con 0x7f4fa80cf610 2024-09-11T22:20:23.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.977+0000 7f4fa559a640 1 -- 172.21.15.50:0/1514699054 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f98007540 con 0x7f4fa80cf610 2024-09-11T22:20:23.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.977+0000 7f4fa559a640 1 -- 172.21.15.50:0/1514699054 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98007910 con 0x7f4fa80cf610 2024-09-11T22:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.978+0000 7f4facbf1640 1 -- 172.21.15.50:0/1514699054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cf610 msgr2=0x7f4fa80cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.978+0000 7f4facbf1640 1 --2- 172.21.15.50:0/1514699054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cf610 0x7f4fa80cccd0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009d90 tx=0x7f4f9802a5f0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.978+0000 7f4facbf1640 1 -- 172.21.15.50:0/1514699054 shutdown_connections 2024-09-11T22:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.978+0000 7f4facbf1640 1 --2- 172.21.15.50:0/1514699054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cf610 0x7f4fa80cccd0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.978+0000 7f4facbf1640 1 --2- 172.21.15.50:0/1514699054 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4fa8161fa0 0x7f4fa80b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.978+0000 7f4facbf1640 1 -- 172.21.15.50:0/1514699054 >> 172.21.15.50:0/1514699054 conn(0x7f4fa809ba50 msgr2=0x7f4fa80b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.978+0000 7f4facbf1640 1 -- 172.21.15.50:0/1514699054 shutdown_connections 2024-09-11T22:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.978+0000 7f4facbf1640 1 -- 172.21.15.50:0/1514699054 wait complete. 2024-09-11T22:20:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.979+0000 7f4facbf1640 1 Processor -- start 2024-09-11T22:20:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.979+0000 7f4facbf1640 1 -- start start 2024-09-11T22:20:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4facbf1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fa80b1600 0x7f4fa80b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4facbf1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cf610 0x7f4fa81603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4facbf1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4fa8161fa0 0x7f4fa815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4facbf1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa8162500 con 0x7f4fa80b1600 2024-09-11T22:20:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4facbf1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa8162380 con 0x7f4fa80cf610 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4facbf1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa80d1c70 con 0x7f4fa8161fa0 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4fa659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fa80b1600 0x7f4fa80b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4fa659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fa80b1600 0x7f4fa80b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57358/0 (socket says 172.21.15.50:57358) 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4fa659c640 1 -- 172.21.15.50:0/4087333212 learned_addr learned my addr 172.21.15.50:0/4087333212 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4fa6d9d640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4fa8161fa0 0x7f4fa815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4fa5d9b640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cf610 0x7f4fa81603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4fa659c640 1 -- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4fa8161fa0 msgr2=0x7f4fa815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4fa659c640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4fa8161fa0 0x7f4fa815b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4fa659c640 1 -- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cf610 msgr2=0x7f4fa81603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4fa659c640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cf610 0x7f4fa81603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4fa659c640 1 -- 172.21.15.50:0/4087333212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa815f0c0 con 0x7f4fa80b1600 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4fa5d9b640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cf610 0x7f4fa81603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.980+0000 7f4fa659c640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fa80b1600 0x7f4fa80b3300 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000ebe0 tx=0x7f4fa000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.981+0000 7f4f9effd640 1 -- 172.21.15.50:0/4087333212 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0017070 con 0x7f4fa80b1600 2024-09-11T22:20:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.981+0000 7f4facbf1640 1 -- 172.21.15.50:0/4087333212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa815f3a0 con 0x7f4fa80b1600 2024-09-11T22:20:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.981+0000 7f4f9effd640 1 -- 172.21.15.50:0/4087333212 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa000cc30 con 0x7f4fa80b1600 2024-09-11T22:20:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.981+0000 7f4f9effd640 1 -- 172.21.15.50:0/4087333212 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0013470 con 0x7f4fa80b1600 2024-09-11T22:20:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.981+0000 7f4facbf1640 1 -- 172.21.15.50:0/4087333212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa815f960 con 0x7f4fa80b1600 2024-09-11T22:20:23.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.983+0000 7f4f9effd640 1 -- 172.21.15.50:0/4087333212 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fa001a070 con 0x7f4fa80b1600 2024-09-11T22:20:23.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.983+0000 7f4f9effd640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4f8806be30 0x7f4f8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.983+0000 7f4f9effd640 1 -- 172.21.15.50:0/4087333212 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f4fa008b1c0 con 0x7f4fa80b1600 2024-09-11T22:20:23.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.983+0000 7f4fa5d9b640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4f8806be30 0x7f4f8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.984+0000 7f4fafa63740 1 Processor -- start 2024-09-11T22:20:23.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.984+0000 7f4fa5d9b640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4f8806be30 0x7f4f8806e2f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4f90001eb0 tx=0x7f4f90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.984+0000 7f4fafa63740 1 -- start start 2024-09-11T22:20:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fafa63740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d67459920 0x562d6749f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fafa63740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d674570e0 0x562d67459d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fafa63740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d6745b0b0 0x562d674541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fafa63740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562d673bc6f0 con 0x562d674570e0 2024-09-11T22:20:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fafa63740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562d67364330 con 0x562d67459920 2024-09-11T22:20:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fafa63740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562d673b86b0 con 0x562d6745b0b0 2024-09-11T22:20:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d674570e0 0x562d67459d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d674570e0 0x562d67459d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57366/0 (socket says 172.21.15.50:57366) 2024-09-11T22:20:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fa5d9b640 1 -- 172.21.15.50:0/1206907133 learned_addr learned my addr 172.21.15.50:0/1206907133 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fa659c640 1 --2- 172.21.15.50:0/1206907133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d67459920 0x562d6749f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fa6d9d640 1 --2- 172.21.15.50:0/1206907133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d6745b0b0 0x562d674541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fa659c640 1 -- 172.21.15.50:0/1206907133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d6745b0b0 msgr2=0x562d674541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fa659c640 1 --2- 172.21.15.50:0/1206907133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d6745b0b0 0x562d674541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fa659c640 1 -- 172.21.15.50:0/1206907133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d674570e0 msgr2=0x562d67459d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fa659c640 1 --2- 172.21.15.50:0/1206907133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d674570e0 0x562d67459d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fa659c640 1 -- 172.21.15.50:0/1206907133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d6738a0d0 con 0x562d67459920 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fa5d9b640 1 --2- 172.21.15.50:0/1206907133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d674570e0 0x562d67459d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.985+0000 7f4fa659c640 1 --2- 172.21.15.50:0/1206907133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d67459920 0x562d6749f0c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00896c0 tx=0x7f4fa0059af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ffff531fa7741fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.986+0000 7f4f87fff640 1 -- 172.21.15.50:0/1206907133 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0021070 con 0x562d67459920 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.986+0000 7f4f87fff640 1 -- 172.21.15.50:0/1206907133 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa005d7a0 con 0x562d67459920 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.986+0000 7f4f87fff640 1 -- 172.21.15.50:0/1206907133 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0061fd0 con 0x562d67459920 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.986+0000 7f4fafa63740 1 -- 172.21.15.50:0/1206907133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d67459920 msgr2=0x562d6749f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.986+0000 7f4fafa63740 1 --2- 172.21.15.50:0/1206907133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d67459920 0x562d6749f0c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00896c0 tx=0x7f4fa0059af0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.986+0000 7f4fafa63740 1 -- 172.21.15.50:0/1206907133 shutdown_connections 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.986+0000 7f4fafa63740 1 --2- 172.21.15.50:0/1206907133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d6745b0b0 0x562d674541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.986+0000 7f4fafa63740 1 --2- 172.21.15.50:0/1206907133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d674570e0 0x562d67459d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.986+0000 7f4fafa63740 1 --2- 172.21.15.50:0/1206907133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d67459920 0x562d6749f0c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.986+0000 7f4fafa63740 1 -- 172.21.15.50:0/1206907133 >> 172.21.15.50:0/1206907133 conn(0x562d67456370 msgr2=0x562d6749e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.986+0000 7f4fafa63740 1 -- 172.21.15.50:0/1206907133 shutdown_connections 2024-09-11T22:20:23.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.986+0000 7f4fafa63740 1 -- 172.21.15.50:0/1206907133 wait complete. 2024-09-11T22:20:23.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.987+0000 7f4fafa63740 1 -- start start 2024-09-11T22:20:23.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.987+0000 7f4fafa63740 1 Processor -- start 2024-09-11T22:20:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fafa63740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d67459920 0x562d67483d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fafa63740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 0x562d674a5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fafa63740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6747c840 0x562d67481a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fafa63740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562d67455810 con 0x562d6745b0b0 2024-09-11T22:20:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fafa63740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562d673454f0 con 0x562d6747c840 2024-09-11T22:20:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fafa63740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562d6749f8f0 con 0x562d67459920 2024-09-11T22:20:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fafa63740 10 client.0 _ll_register_callbacks cb 0x562d67366b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 0x562d674a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 0x562d674a5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57374/0 (socket says 172.21.15.50:57374) 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fa5d9b640 1 -- 172.21.15.50:0/1242830776 learned_addr learned my addr 172.21.15.50:0/1242830776 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fa659c640 1 --2- 172.21.15.50:0/1242830776 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d67459920 0x562d67483d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fa6d9d640 1 --2- 172.21.15.50:0/1242830776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6747c840 0x562d67481a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fa5d9b640 1 -- 172.21.15.50:0/1242830776 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d67459920 msgr2=0x562d67483d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fa5d9b640 1 --2- 172.21.15.50:0/1242830776 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d67459920 0x562d67483d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fa5d9b640 1 -- 172.21.15.50:0/1242830776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6747c840 msgr2=0x562d67481a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fa5d9b640 1 --2- 172.21.15.50:0/1242830776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6747c840 0x562d67481a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.988+0000 7f4fa5d9b640 1 -- 172.21.15.50:0/1242830776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d671997d0 con 0x562d6745b0b0 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4fa5d9b640 1 --2- 172.21.15.50:0/1242830776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 0x562d674a5380 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f4f900076e0 tx=0x7f4f90000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870134ad24501708 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4f857fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4f857fa640 1 -- 172.21.15.50:0/1242830776 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90026060 con 0x562d6745b0b0 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4f857fa640 1 -- 172.21.15.50:0/1242830776 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f4f90021aa0 con 0x562d6745b0b0 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4fafa63740 1 -- 172.21.15.50:0/1242830776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fa005d7a0 con 0x562d6745b0b0 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4f857fa640 1 -- 172.21.15.50:0/1242830776 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f4f90021ca0 con 0x562d6745b0b0 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4fafa63740 10 client.9210 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4fafa63740 1 -- 172.21.15.50:0/1242830776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x562d670cf3f0 con 0x562d6745b0b0 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4f857fa640 1 -- 172.21.15.50:0/1242830776 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa005d7a0 con 0x562d6745b0b0 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4f857fa640 1 -- 172.21.15.50:0/1242830776 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f4f90012620 con 0x562d6745b0b0 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4fafa63740 10 client.9210 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4fafa63740 10 client.9210 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4fafa63740 20 client.9210 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4fafa63740 1 --2- 172.21.15.50:0/1242830776 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562d674a3c30 0x562d674a4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4fafa63740 4 client.9210 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4fafa63740 1 -- 172.21.15.50:0/1242830776 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d673c9e20 con 0x562d674a3c30 2024-09-11T22:20:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.989+0000 7f4fa659c640 1 --2- 172.21.15.50:0/1242830776 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562d674a3c30 0x562d674a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4f857fa640 10 client.9210 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4fa659c640 1 --2- 172.21.15.50:0/1242830776 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562d674a3c30 0x562d674a4010 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51f5442fb2cb5ee5 server_cookie=d8bc10cee2fa37a4 in_seq=0 out_seq=0 2024-09-11T22:20:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4f857fa640 1 -- 172.21.15.50:0/1242830776 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d673c9e20 con 0x562d674a3c30 2024-09-11T22:20:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4f857fa640 10 client.9210 handle_command_reply: tid=0 2024-09-11T22:20:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4fafa63740 1 client.9210 shutdown 2024-09-11T22:20:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4fafa63740 1 -- 172.21.15.50:0/1242830776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 msgr2=0x562d674a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4fafa63740 1 --2- 172.21.15.50:0/1242830776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 0x562d674a5380 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f4f900076e0 tx=0x7f4f90000ed0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4fafa63740 1 -- 172.21.15.50:0/1242830776 shutdown_connections 2024-09-11T22:20:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4fafa63740 1 --2- 172.21.15.50:0/1242830776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6747c840 0x562d67481a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4fafa63740 1 --2- 172.21.15.50:0/1242830776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 0x562d674a5380 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4fafa63740 1 --2- 172.21.15.50:0/1242830776 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562d674a3c30 0x562d674a4010 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4fafa63740 1 --2- 172.21.15.50:0/1242830776 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d67459920 0x562d67483d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4fafa63740 1 -- 172.21.15.50:0/1242830776 >> 172.21.15.50:0/1242830776 conn(0x562d674570e0 msgr2=0x562d674a1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.990+0000 7f4f857fa640 0 client.9210 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.991+0000 7f4fafa63740 1 -- 172.21.15.50:0/1242830776 shutdown_connections 2024-09-11T22:20:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.991+0000 7f4fafa63740 1 -- 172.21.15.50:0/1242830776 wait complete. 2024-09-11T22:20:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:23.991+0000 7f4fafa63740 20 client.9210 trim_cache size 0 max 16384 2024-09-11T22:20:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.008+0000 7f4fafa63740 1 Processor -- start 2024-09-11T22:20:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.008+0000 7f4fafa63740 1 -- start start 2024-09-11T22:20:24.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fafa63740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d67459920 0x562d6749e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fafa63740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6745b0b0 0x562d674a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fafa63740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d6747c840 0x562d674a31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fafa63740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa8200b50 con 0x562d67459920 2024-09-11T22:20:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fafa63740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81ffbd0 con 0x562d6745b0b0 2024-09-11T22:20:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fafa63740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa80ca0c0 con 0x562d6747c840 2024-09-11T22:20:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fa659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d67459920 0x562d6749e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fa659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d67459920 0x562d6749e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57384/0 (socket says 172.21.15.50:57384) 2024-09-11T22:20:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fa659c640 1 -- 172.21.15.50:0/810309897 learned_addr learned my addr 172.21.15.50:0/810309897 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fa659c640 1 -- 172.21.15.50:0/810309897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d6747c840 msgr2=0x562d674a31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fa659c640 1 --2- 172.21.15.50:0/810309897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d6747c840 0x562d674a31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fa659c640 1 -- 172.21.15.50:0/810309897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6745b0b0 msgr2=0x562d674a2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fa659c640 1 --2- 172.21.15.50:0/810309897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6745b0b0 0x562d674a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fa659c640 1 -- 172.21.15.50:0/810309897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d6708f0f0 con 0x562d67459920 2024-09-11T22:20:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4fa659c640 1 --2- 172.21.15.50:0/810309897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d67459920 0x562d6749e750 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0059ca0 tx=0x7f4fa0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ca78288605395a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4f877fe640 1 -- 172.21.15.50:0/810309897 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00576f0 con 0x562d67459920 2024-09-11T22:20:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4f877fe640 1 -- 172.21.15.50:0/810309897 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa0055a60 con 0x562d67459920 2024-09-11T22:20:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.009+0000 7f4f877fe640 1 -- 172.21.15.50:0/810309897 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00713c0 con 0x562d67459920 2024-09-11T22:20:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.010+0000 7f4fafa63740 1 -- 172.21.15.50:0/810309897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d67459920 msgr2=0x562d6749e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.010+0000 7f4fafa63740 1 --2- 172.21.15.50:0/810309897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d67459920 0x562d6749e750 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0059ca0 tx=0x7f4fa0014000 comp rx=0 tx=0).stop 2024-09-11T22:20:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.010+0000 7f4fafa63740 1 -- 172.21.15.50:0/810309897 shutdown_connections 2024-09-11T22:20:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.010+0000 7f4fafa63740 1 --2- 172.21.15.50:0/810309897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d6747c840 0x562d674a31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.010+0000 7f4fafa63740 1 --2- 172.21.15.50:0/810309897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6745b0b0 0x562d674a2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.010+0000 7f4fafa63740 1 --2- 172.21.15.50:0/810309897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d67459920 0x562d6749e750 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.010+0000 7f4fafa63740 1 -- 172.21.15.50:0/810309897 >> 172.21.15.50:0/810309897 conn(0x562d674570e0 msgr2=0x562d674a11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.010+0000 7f4fafa63740 1 -- 172.21.15.50:0/810309897 shutdown_connections 2024-09-11T22:20:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.010+0000 7f4fafa63740 1 -- 172.21.15.50:0/810309897 wait complete. 2024-09-11T22:20:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.010+0000 7f4fafa63740 1 -- start start 2024-09-11T22:20:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.011+0000 7f4fafa63740 1 Processor -- start 2024-09-11T22:20:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.011+0000 7f4fafa63740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d67459920 0x562d67519280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.011+0000 7f4fafa63740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 0x562d674a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.011+0000 7f4fafa63740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6747c840 0x562d674a3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.011+0000 7f4fafa63740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562d674553e0 con 0x562d6745b0b0 2024-09-11T22:20:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.011+0000 7f4fafa63740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa80ca710 con 0x562d6747c840 2024-09-11T22:20:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.011+0000 7f4fafa63740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562d67458f70 con 0x562d67459920 2024-09-11T22:20:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fafa63740 10 client.0 _ll_register_callbacks cb 0x7f4f900058d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 0x562d674a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 0x562d674a2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57396/0 (socket says 172.21.15.50:57396) 2024-09-11T22:20:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fa5d9b640 1 -- 172.21.15.50:0/573114551 learned_addr learned my addr 172.21.15.50:0/573114551 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fa659c640 1 --2- 172.21.15.50:0/573114551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d67459920 0x562d67519280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fa6d9d640 1 --2- 172.21.15.50:0/573114551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6747c840 0x562d674a3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fa5d9b640 1 -- 172.21.15.50:0/573114551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d67459920 msgr2=0x562d67519280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fa5d9b640 1 --2- 172.21.15.50:0/573114551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d67459920 0x562d67519280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fa5d9b640 1 -- 172.21.15.50:0/573114551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6747c840 msgr2=0x562d674a3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fa5d9b640 1 --2- 172.21.15.50:0/573114551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6747c840 0x562d674a3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fa5d9b640 1 -- 172.21.15.50:0/573114551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d674a5670 con 0x562d6745b0b0 2024-09-11T22:20:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fa5d9b640 1 --2- 172.21.15.50:0/573114551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 0x562d674a2bd0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000d590 tx=0x7f4f90007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e781f532ec0db959 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4f857fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4f857fa640 1 -- 172.21.15.50:0/573114551 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90012bc0 con 0x562d6745b0b0 2024-09-11T22:20:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4f857fa640 1 -- 172.21.15.50:0/573114551 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f4f90012d60 con 0x562d6745b0b0 2024-09-11T22:20:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fafa63740 1 -- 172.21.15.50:0/573114551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fa0055a60 con 0x562d6745b0b0 2024-09-11T22:20:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4f857fa640 1 -- 172.21.15.50:0/573114551 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f4f9003d050 con 0x562d6745b0b0 2024-09-11T22:20:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fafa63740 10 client.9216 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.012+0000 7f4fafa63740 1 -- 172.21.15.50:0/573114551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x562d6751cdd0 con 0x562d6745b0b0 2024-09-11T22:20:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4f857fa640 1 -- 172.21.15.50:0/573114551 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa0055a60 con 0x562d6745b0b0 2024-09-11T22:20:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4f857fa640 1 -- 172.21.15.50:0/573114551 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f4f90040020 con 0x562d6745b0b0 2024-09-11T22:20:24.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4fafa63740 10 client.9216 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4fafa63740 10 client.9216 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4fafa63740 20 client.9216 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4fafa63740 1 --2- 172.21.15.50:0/573114551 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562d674530c0 0x562d6751beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4fafa63740 4 client.9216 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4fafa63740 1 -- 172.21.15.50:0/573114551 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562d674838d0 con 0x562d674530c0 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4fa659c640 1 --2- 172.21.15.50:0/573114551 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562d674530c0 0x562d6751beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4f857fa640 10 client.9216 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4fa659c640 1 --2- 172.21.15.50:0/573114551 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562d674530c0 0x562d6751beb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b993ea0ad58813ba server_cookie=7e08c1dce9bdea68 in_seq=0 out_seq=0 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4f857fa640 1 -- 172.21.15.50:0/573114551 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+69 (crc 0 0 0) 0x562d674838d0 con 0x562d674530c0 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4f857fa640 10 client.9216 handle_command_reply: tid=0 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.013+0000 7f4fafa63740 1 client.9216 shutdown 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4fafa63740 1 -- 172.21.15.50:0/573114551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 msgr2=0x562d674a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4fafa63740 1 --2- 172.21.15.50:0/573114551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 0x562d674a2bd0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000d590 tx=0x7f4f90007000 comp rx=0 tx=0).stop 2024-09-11T22:20:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4fafa63740 1 -- 172.21.15.50:0/573114551 shutdown_connections 2024-09-11T22:20:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4fafa63740 1 --2- 172.21.15.50:0/573114551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d6747c840 0x562d674a3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4fafa63740 1 --2- 172.21.15.50:0/573114551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6745b0b0 0x562d674a2bd0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4fafa63740 1 --2- 172.21.15.50:0/573114551 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x562d674530c0 0x562d6751beb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4fafa63740 1 --2- 172.21.15.50:0/573114551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562d67459920 0x562d67519280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4f857fa640 0 client.9216 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4fafa63740 1 -- 172.21.15.50:0/573114551 >> 172.21.15.50:0/573114551 conn(0x562d674570e0 msgr2=0x562d674a00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4fafa63740 1 -- 172.21.15.50:0/573114551 shutdown_connections 2024-09-11T22:20:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4fafa63740 1 -- 172.21.15.50:0/573114551 wait complete. 2024-09-11T22:20:24.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4fafa63740 20 client.9216 trim_cache size 0 max 16384 2024-09-11T22:20:24.020 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:20:24.021 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-11T22:20:24.021 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-11T22:20:24.021 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:20:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4facbf1640 1 -- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4f8806be30 msgr2=0x7f4f8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4facbf1640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4f8806be30 0x7f4f8806e2f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4f90001eb0 tx=0x7f4f90009040 comp rx=0 tx=0).stop 2024-09-11T22:20:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4facbf1640 1 -- 172.21.15.50:0/4087333212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fa80b1600 msgr2=0x7f4fa80b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4facbf1640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fa80b1600 0x7f4fa80b3300 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000ebe0 tx=0x7f4fa000c520 comp rx=0 tx=0).stop 2024-09-11T22:20:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4facbf1640 1 -- 172.21.15.50:0/4087333212 shutdown_connections 2024-09-11T22:20:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4facbf1640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4f8806be30 0x7f4f8806e2f0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4facbf1640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4fa8161fa0 0x7f4fa815b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4facbf1640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fa80cf610 0x7f4fa81603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4facbf1640 1 --2- 172.21.15.50:0/4087333212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fa80b1600 0x7f4fa80b3300 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4facbf1640 1 -- 172.21.15.50:0/4087333212 >> 172.21.15.50:0/4087333212 conn(0x7f4fa809ba50 msgr2=0x7f4fa80b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4facbf1640 1 -- 172.21.15.50:0/4087333212 shutdown_connections 2024-09-11T22:20:24.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.014+0000 7f4facbf1640 1 -- 172.21.15.50:0/4087333212 wait complete. 2024-09-11T22:20:24.026 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.128+0000 7f93f239f640 1 Processor -- start 2024-09-11T22:20:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.129+0000 7f93f239f640 1 -- start start 2024-09-11T22:20:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.129+0000 7f93f239f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f93ec0d1640 0x7f93ec162020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.129+0000 7f93f239f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93ec0d22a0 con 0x7f93ec0d0a10 2024-09-11T22:20:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.129+0000 7f93f239f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93ec0d0f90 con 0x7f93ec0d0630 2024-09-11T22:20:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.129+0000 7f93f239f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f93ec0d1270 con 0x7f93ec0d1640 2024-09-11T22:20:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.130+0000 7f93f1b9e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f93ec0d0a10 0x7f93ec06f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53176/0 (socket says 172.21.15.50:53176) 2024-09-11T22:20:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.130+0000 7f93f1b9e640 1 -- 172.21.15.50:0/838723903 learned_addr learned my addr 172.21.15.50:0/838723903 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.130+0000 7f93f0b9c640 1 --2- 172.21.15.50:0/838723903 >> v2:172.21.15.77:3300/0 conn(0x7f93ec0d1640 0x7f93ec162020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.130+0000 7f93e3fff640 1 -- 172.21.15.50:0/838723903 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3095821140 0 0) 0x7f93ec0d22a0 con 0x7f93ec0d0a10 2024-09-11T22:20:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.130+0000 7f93e3fff640 1 -- 172.21.15.50:0/838723903 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93d8003520 con 0x7f93ec0d0a10 2024-09-11T22:20:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.130+0000 7f93f0b9c640 1 -- 172.21.15.50:0/838723903 >> v1:172.21.15.77:6789/0 conn(0x7f93ec0d0630 legacy=0x7f93ec161910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.130+0000 7f93f0b9c640 1 -- 172.21.15.50:0/838723903 >> v1:172.21.15.50:6789/0 conn(0x7f93ec0d0a10 legacy=0x7f93ec06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.130+0000 7f93f0b9c640 1 -- 172.21.15.50:0/838723903 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec0cf7f0 con 0x7f93ec0d1640 2024-09-11T22:20:24.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.131+0000 7f93f0b9c640 1 --2- 172.21.15.50:0/838723903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ec0d1640 0x7f93ec162020 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0097a0 tx=0x7f93dc02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1d446cf679c1e9d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.131+0000 7f93e3fff640 1 -- 172.21.15.50:0/838723903 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc037070 con 0x7f93ec0d1640 2024-09-11T22:20:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.131+0000 7f93e3fff640 1 -- 172.21.15.50:0/838723903 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93dc032440 con 0x7f93ec0d1640 2024-09-11T22:20:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.131+0000 7f93e3fff640 1 -- 172.21.15.50:0/838723903 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc032810 con 0x7f93ec0d1640 2024-09-11T22:20:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.132+0000 7f93f239f640 1 -- 172.21.15.50:0/838723903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ec0d1640 msgr2=0x7f93ec162020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.132+0000 7f93f239f640 1 --2- 172.21.15.50:0/838723903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ec0d1640 0x7f93ec162020 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0097a0 tx=0x7f93dc02a1a0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.132+0000 7f93f239f640 1 -- 172.21.15.50:0/838723903 shutdown_connections 2024-09-11T22:20:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.132+0000 7f93f239f640 1 --2- 172.21.15.50:0/838723903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ec0d1640 0x7f93ec162020 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.132+0000 7f93f239f640 1 -- 172.21.15.50:0/838723903 >> 172.21.15.50:0/838723903 conn(0x7f93ec09ba50 msgr2=0x7f93ec0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.132+0000 7f93f239f640 1 -- 172.21.15.50:0/838723903 shutdown_connections 2024-09-11T22:20:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.132+0000 7f93f239f640 1 -- 172.21.15.50:0/838723903 wait complete. 2024-09-11T22:20:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.133+0000 7f93f239f640 1 Processor -- start 2024-09-11T22:20:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.133+0000 7f93f239f640 1 -- start start 2024-09-11T22:20:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f239f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ec0d0630 0x7f93ec1f73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f239f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ec0d0a10 0x7f93ec0c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f239f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93ec0d1640 0x7f93ec070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f239f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec0b4bf0 con 0x7f93ec0d1640 2024-09-11T22:20:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f239f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec0d2080 con 0x7f93ec0d0630 2024-09-11T22:20:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f239f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f93ec0b4d70 con 0x7f93ec0d0a10 2024-09-11T22:20:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f1b9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93ec0d1640 0x7f93ec070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f1b9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93ec0d1640 0x7f93ec070160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57400/0 (socket says 172.21.15.50:57400) 2024-09-11T22:20:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f1b9e640 1 -- 172.21.15.50:0/3923212331 learned_addr learned my addr 172.21.15.50:0/3923212331 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f139d640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ec0d0630 0x7f93ec1f73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f0b9c640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ec0d0a10 0x7f93ec0c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f1b9e640 1 -- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ec0d0a10 msgr2=0x7f93ec0c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f1b9e640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ec0d0a10 0x7f93ec0c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f1b9e640 1 -- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ec0d0630 msgr2=0x7f93ec1f73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f1b9e640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ec0d0630 0x7f93ec1f73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f1b9e640 1 -- 172.21.15.50:0/3923212331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec0c68f0 con 0x7f93ec0d1640 2024-09-11T22:20:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93f1b9e640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93ec0d1640 0x7f93ec070160 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f93e400cb40 tx=0x7f93e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.134+0000 7f93e1ffb640 1 -- 172.21.15.50:0/3923212331 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4017070 con 0x7f93ec0d1640 2024-09-11T22:20:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.135+0000 7f93e1ffb640 1 -- 172.21.15.50:0/3923212331 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e400aca0 con 0x7f93ec0d1640 2024-09-11T22:20:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.135+0000 7f93e1ffb640 1 -- 172.21.15.50:0/3923212331 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4012620 con 0x7f93ec0d1640 2024-09-11T22:20:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.135+0000 7f93f239f640 1 -- 172.21.15.50:0/3923212331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93ec0c6bd0 con 0x7f93ec0d1640 2024-09-11T22:20:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.135+0000 7f93f239f640 1 -- 172.21.15.50:0/3923212331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93ec0c7190 con 0x7f93ec0d1640 2024-09-11T22:20:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.136+0000 7f93f239f640 1 -- 172.21.15.50:0/3923212331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93ec06d3c0 con 0x7f93ec0d1640 2024-09-11T22:20:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.136+0000 7f93e1ffb640 1 -- 172.21.15.50:0/3923212331 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93e401a070 con 0x7f93ec0d1640 2024-09-11T22:20:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.137+0000 7f93e1ffb640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f93d006be30 0x7f93d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.137+0000 7f93e1ffb640 1 -- 172.21.15.50:0/3923212331 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f93e408ad60 con 0x7f93ec0d1640 2024-09-11T22:20:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.137+0000 7f93f139d640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f93d006be30 0x7f93d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.138+0000 7f93f139d640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f93d006be30 0x7f93d006e2f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f93e8007fd0 tx=0x7f93e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.141+0000 7f93e1ffb640 1 -- 172.21.15.50:0/3923212331 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93e4059690 con 0x7f93ec0d1640 2024-09-11T22:20:24.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.355+0000 7f93f239f640 1 -- 172.21.15.50:0/3923212331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93ec06fe60 con 0x7f93ec0d1640 2024-09-11T22:20:24.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.356+0000 7f93e1ffb640 1 -- 172.21.15.50:0/3923212331 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7f93e4058f90 con 0x7f93ec0d1640 2024-09-11T22:20:24.357 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:24.357 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:20:24.357 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:20:24.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.358+0000 7f93f239f640 1 -- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f93d006be30 msgr2=0x7f93d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.358+0000 7f93f239f640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f93d006be30 0x7f93d006e2f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f93e8007fd0 tx=0x7f93e8009040 comp rx=0 tx=0).stop 2024-09-11T22:20:24.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.358+0000 7f93f239f640 1 -- 172.21.15.50:0/3923212331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93ec0d1640 msgr2=0x7f93ec070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.358+0000 7f93f239f640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93ec0d1640 0x7f93ec070160 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f93e400cb40 tx=0x7f93e400a060 comp rx=0 tx=0).stop 2024-09-11T22:20:24.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.358+0000 7f93f239f640 1 -- 172.21.15.50:0/3923212331 shutdown_connections 2024-09-11T22:20:24.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.358+0000 7f93f239f640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f93d006be30 0x7f93d006e2f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.358+0000 7f93f239f640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ec0d0a10 0x7f93ec0c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.358+0000 7f93f239f640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93ec0d1640 0x7f93ec070160 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.358+0000 7f93f239f640 1 --2- 172.21.15.50:0/3923212331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ec0d0630 0x7f93ec1f73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.358+0000 7f93f239f640 1 -- 172.21.15.50:0/3923212331 >> 172.21.15.50:0/3923212331 conn(0x7f93ec09ba50 msgr2=0x7f93ec0d2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.358+0000 7f93f239f640 1 -- 172.21.15.50:0/3923212331 shutdown_connections 2024-09-11T22:20:24.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.358+0000 7f93f239f640 1 -- 172.21.15.50:0/3923212331 wait complete. 2024-09-11T22:20:24.371 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-11T22:20:24.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:20:24.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.473+0000 7f6fc653b640 1 Processor -- start 2024-09-11T22:20:24.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.473+0000 7f6fc653b640 1 -- start start 2024-09-11T22:20:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fc653b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6fc00cf610 0x7f6fc00b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fc653b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00b1600 0x7f6fc00cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fc653b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fc00cfbd0 con 0x7f6fc0161fa0 2024-09-11T22:20:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fc653b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6fc00d1220 con 0x7f6fc00cf610 2024-09-11T22:20:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fc653b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc00d17e0 con 0x7f6fc00b1600 2024-09-11T22:20:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fbffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6fc0161fa0 0x7f6fc00cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53188/0 (socket says 172.21.15.50:53188) 2024-09-11T22:20:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fbffff640 1 -- 172.21.15.50:0/1837885105 learned_addr learned my addr 172.21.15.50:0/1837885105 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fc4ad8640 1 --2- 172.21.15.50:0/1837885105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00b1600 0x7f6fc00cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 206479105 0 0) 0x7f6fc00cfbd0 con 0x7f6fc0161fa0 2024-09-11T22:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fa8003520 con 0x7f6fc0161fa0 2024-09-11T22:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fbf7fe640 1 --2- 172.21.15.50:0/1837885105 >> v2:172.21.15.77:3300/0 conn(0x7f6fc00cf610 0x7f6fc00b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3198648595 0 0) 0x7f6fa8003520 con 0x7f6fc0161fa0 2024-09-11T22:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00b1600 msgr2=0x7f6fc00cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fbeffd640 1 --2- 172.21.15.50:0/1837885105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00b1600 0x7f6fc00cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 >> v2:172.21.15.77:3300/0 conn(0x7f6fc00cf610 msgr2=0x7f6fc00b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fbeffd640 1 --2- 172.21.15.50:0/1837885105 >> v2:172.21.15.77:3300/0 conn(0x7f6fc00cf610 0x7f6fc00b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc00cfeb0 con 0x7f6fc0161fa0 2024-09-11T22:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f6fb0001670 con 0x7f6fc0161fa0 2024-09-11T22:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.474+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 >> v1:172.21.15.50:6789/0 conn(0x7f6fc0161fa0 legacy=0x7f6fc00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fbeffd640 1 --2- 172.21.15.50:0/1837885105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80039b0 0x7f6fa8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fbeffd640 1 --2- 172.21.15.50:0/1837885105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa8004800 0x7f6fa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fbeffd640 1 --2- 172.21.15.50:0/1837885105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00b1600 0x7f6fa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc00d1220 con 0x7f6fa80039b0 2024-09-11T22:20:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc00d17e0 con 0x7f6fa8004800 2024-09-11T22:20:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa800b9c0 con 0x7f6fc00b1600 2024-09-11T22:20:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fbffff640 1 --2- 172.21.15.50:0/1837885105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80039b0 0x7f6fa8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fbf7fe640 1 --2- 172.21.15.50:0/1837885105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa8004800 0x7f6fa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fc4ad8640 1 --2- 172.21.15.50:0/1837885105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00b1600 0x7f6fa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fbffff640 1 -- 172.21.15.50:0/1837885105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00b1600 msgr2=0x7f6fa80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fbffff640 1 --2- 172.21.15.50:0/1837885105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00b1600 0x7f6fa80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fbffff640 1 -- 172.21.15.50:0/1837885105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa8004800 msgr2=0x7f6fa8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fbffff640 1 --2- 172.21.15.50:0/1837885105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa8004800 0x7f6fa8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fbffff640 1 -- 172.21.15.50:0/1837885105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa8003520 con 0x7f6fa80039b0 2024-09-11T22:20:24.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.475+0000 7f6fc4ad8640 1 --2- 172.21.15.50:0/1837885105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00b1600 0x7f6fa80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:24.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.476+0000 7f6fbffff640 1 --2- 172.21.15.50:0/1837885105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80039b0 0x7f6fa8003dd0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0001050 tx=0x7f6fa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8677dd48b4e465ee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.476+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb002e070 con 0x7f6fa80039b0 2024-09-11T22:20:24.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.476+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb0005af0 con 0x7f6fa80039b0 2024-09-11T22:20:24.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.476+0000 7f6fbeffd640 1 -- 172.21.15.50:0/1837885105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0007d70 con 0x7f6fa80039b0 2024-09-11T22:20:24.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.476+0000 7f6fc653b640 1 -- 172.21.15.50:0/1837885105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80039b0 msgr2=0x7f6fa8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.476+0000 7f6fc653b640 1 --2- 172.21.15.50:0/1837885105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80039b0 0x7f6fa8003dd0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0001050 tx=0x7f6fa8005830 comp rx=0 tx=0).stop 2024-09-11T22:20:24.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.476+0000 7f6fc4ad8640 1 -- 172.21.15.50:0/1837885105 reap_dead start 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.476+0000 7f6fc653b640 1 -- 172.21.15.50:0/1837885105 shutdown_connections 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.476+0000 7f6fc653b640 1 -- 172.21.15.50:0/1837885105 >> 172.21.15.50:0/1837885105 conn(0x7f6fc009ba50 msgr2=0x7f6fc00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.476+0000 7f6fc653b640 1 -- 172.21.15.50:0/1837885105 shutdown_connections 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.476+0000 7f6fc653b640 1 -- 172.21.15.50:0/1837885105 wait complete. 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.478+0000 7f6fc653b640 1 Processor -- start 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.478+0000 7f6fc653b640 1 -- start start 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fc653b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80039b0 0x7f6fc015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fc653b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fc00b43b0 0x7f6fc00c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fc653b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00ca1f0 0x7f6fc00ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fc653b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc0162500 con 0x7f6fa80039b0 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fc653b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc0162380 con 0x7f6fc00b43b0 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fc653b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc00d1c70 con 0x7f6fc00ca1f0 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fbffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80039b0 0x7f6fc015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fbffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80039b0 0x7f6fc015bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57422/0 (socket says 172.21.15.50:57422) 2024-09-11T22:20:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fbffff640 1 -- 172.21.15.50:0/3504135441 learned_addr learned my addr 172.21.15.50:0/3504135441 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fbf7fe640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fc00b43b0 0x7f6fc00c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fc4ad8640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00ca1f0 0x7f6fc00ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fbffff640 1 -- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00ca1f0 msgr2=0x7f6fc00ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fbffff640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00ca1f0 0x7f6fc00ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fbffff640 1 -- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fc00b43b0 msgr2=0x7f6fc00c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fbffff640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fc00b43b0 0x7f6fc00c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fbffff640 1 -- 172.21.15.50:0/3504135441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc00b4120 con 0x7f6fa80039b0 2024-09-11T22:20:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fbffff640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80039b0 0x7f6fc015bc40 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0000c00 tx=0x7f6fb0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fbcff9640 1 -- 172.21.15.50:0/3504135441 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0042070 con 0x7f6fa80039b0 2024-09-11T22:20:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fbcff9640 1 -- 172.21.15.50:0/3504135441 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb00074a0 con 0x7f6fa80039b0 2024-09-11T22:20:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fc653b640 1 -- 172.21.15.50:0/3504135441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc00c97f0 con 0x7f6fa80039b0 2024-09-11T22:20:24.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fbcff9640 1 -- 172.21.15.50:0/3504135441 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0001cc0 con 0x7f6fa80039b0 2024-09-11T22:20:24.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.479+0000 7f6fc653b640 1 -- 172.21.15.50:0/3504135441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc015c180 con 0x7f6fa80039b0 2024-09-11T22:20:24.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.480+0000 7f6fc653b640 1 -- 172.21.15.50:0/3504135441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fc00b4d20 con 0x7f6fa80039b0 2024-09-11T22:20:24.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.481+0000 7f6fbcff9640 1 -- 172.21.15.50:0/3504135441 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6fb0045070 con 0x7f6fa80039b0 2024-09-11T22:20:24.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.482+0000 7f6fbcff9640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6fac06be60 0x7f6fac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.482+0000 7f6fbcff9640 1 -- 172.21.15.50:0/3504135441 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f6fb00ab6e0 con 0x7f6fa80039b0 2024-09-11T22:20:24.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.482+0000 7f6fbf7fe640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6fac06be60 0x7f6fac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.482+0000 7f6fbf7fe640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6fac06be60 0x7f6fac06e320 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00c9190 tx=0x7f6fb4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.486+0000 7f6fbcff9640 1 -- 172.21.15.50:0/3504135441 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6fb0005ac0 con 0x7f6fa80039b0 2024-09-11T22:20:24.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.734+0000 7f6fc653b640 1 -- 172.21.15.50:0/3504135441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6fc006d460 con 0x7f6fa80039b0 2024-09-11T22:20:24.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.735+0000 7f6fbcff9640 1 -- 172.21.15.50:0/3504135441 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f6fb0079b70 con 0x7f6fa80039b0 2024-09-11T22:20:24.736 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:24.736 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":573,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076147270,"bytes_used":2600255488,"bytes_avail":770493857792,"bytes_total":773094113280,"write_bytes_sec":64983551,"read_op_per_sec":0,"write_op_per_sec":63},"fsmap":{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8907}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-11T22:20:21.496687+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:20:24.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.737+0000 7f6fc653b640 1 -- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6fac06be60 msgr2=0x7f6fac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.737+0000 7f6fc653b640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6fac06be60 0x7f6fac06e320 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00c9190 tx=0x7f6fb4009190 comp rx=0 tx=0).stop 2024-09-11T22:20:24.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.737+0000 7f6fc653b640 1 -- 172.21.15.50:0/3504135441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80039b0 msgr2=0x7f6fc015bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.737+0000 7f6fc653b640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80039b0 0x7f6fc015bc40 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0000c00 tx=0x7f6fb0000fe0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.737+0000 7f6fc653b640 1 -- 172.21.15.50:0/3504135441 shutdown_connections 2024-09-11T22:20:24.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.737+0000 7f6fc653b640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6fac06be60 0x7f6fac06e320 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.737+0000 7f6fc653b640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6fc00ca1f0 0x7f6fc00ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.737+0000 7f6fc653b640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fc00b43b0 0x7f6fc00c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.737+0000 7f6fc653b640 1 --2- 172.21.15.50:0/3504135441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fa80039b0 0x7f6fc015bc40 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.737+0000 7f6fc653b640 1 -- 172.21.15.50:0/3504135441 >> 172.21.15.50:0/3504135441 conn(0x7f6fc009ba50 msgr2=0x7f6fc006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.737+0000 7f6fc653b640 1 -- 172.21.15.50:0/3504135441 shutdown_connections 2024-09-11T22:20:24.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.737+0000 7f6fc653b640 1 -- 172.21.15.50:0/3504135441 wait complete. 2024-09-11T22:20:24.749 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-11T22:20:24.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:24.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub resume 2024-09-11T22:20:24.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.852+0000 7f43d5931640 1 Processor -- start 2024-09-11T22:20:24.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.852+0000 7f43d5931640 1 -- start start 2024-09-11T22:20:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.853+0000 7f43d5931640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43d00b03a0 0x7f43d01677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.853+0000 7f43d5931640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43d00d1280 con 0x7f43d015ffb0 2024-09-11T22:20:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.853+0000 7f43d5931640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43d00b2890 con 0x7f43d00b3a40 2024-09-11T22:20:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.853+0000 7f43d5931640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43d00b2b70 con 0x7f43d00b03a0 2024-09-11T22:20:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.853+0000 7f43ceffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f43d015ffb0 0x7f43d00d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53194/0 (socket says 172.21.15.50:53194) 2024-09-11T22:20:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.853+0000 7f43ceffd640 1 -- 172.21.15.50:0/3688298828 learned_addr learned my addr 172.21.15.50:0/3688298828 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/3688298828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43d00b03a0 0x7f43d01677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781793225 0 0) 0x7f43d00d1280 con 0x7f43d015ffb0 2024-09-11T22:20:24.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43bc003520 con 0x7f43d015ffb0 2024-09-11T22:20:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3749559323 0 0) 0x7f43bc003520 con 0x7f43d015ffb0 2024-09-11T22:20:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43d00b03a0 msgr2=0x7f43d01677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 --2- 172.21.15.50:0/3688298828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43d00b03a0 0x7f43d01677a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 >> v1:172.21.15.77:6789/0 conn(0x7f43d00b3a40 legacy=0x7f43d00d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d00b2e50 con 0x7f43d015ffb0 2024-09-11T22:20:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f43c00019f0 con 0x7f43d015ffb0 2024-09-11T22:20:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 >> v1:172.21.15.50:6789/0 conn(0x7f43d015ffb0 legacy=0x7f43d00d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 --2- 172.21.15.50:0/3688298828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43bc0039e0 0x7f43bc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 --2- 172.21.15.50:0/3688298828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43d00b03a0 0x7f43bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 --2- 172.21.15.50:0/3688298828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43bc004d40 0x7f43bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43d00b2b70 con 0x7f43bc004d40 2024-09-11T22:20:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc00bb20 con 0x7f43bc0039e0 2024-09-11T22:20:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43bc00bd20 con 0x7f43d00b03a0 2024-09-11T22:20:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/3688298828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43bc004d40 0x7f43bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43ceffd640 1 --2- 172.21.15.50:0/3688298828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43bc0039e0 0x7f43bc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43ce7fc640 1 --2- 172.21.15.50:0/3688298828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43d00b03a0 0x7f43bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cf7fe640 1 -- 172.21.15.50:0/3688298828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43d00b03a0 msgr2=0x7f43bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/3688298828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43d00b03a0 0x7f43bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cf7fe640 1 -- 172.21.15.50:0/3688298828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43bc0039e0 msgr2=0x7f43bc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/3688298828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43bc0039e0 0x7f43bc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.854+0000 7f43cf7fe640 1 -- 172.21.15.50:0/3688298828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43bc003520 con 0x7f43bc004d40 2024-09-11T22:20:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.855+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/3688298828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43bc004d40 0x7f43bc0051c0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009ac0 tx=0x7f43bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6540b533e16f6b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.855+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8036070 con 0x7f43bc004d40 2024-09-11T22:20:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.855+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c8031400 con 0x7f43bc004d40 2024-09-11T22:20:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.855+0000 7f43cdffb640 1 -- 172.21.15.50:0/3688298828 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8009690 con 0x7f43bc004d40 2024-09-11T22:20:24.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.856+0000 7f43d5931640 1 -- 172.21.15.50:0/3688298828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43bc004d40 msgr2=0x7f43bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.856+0000 7f43d5931640 1 --2- 172.21.15.50:0/3688298828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43bc004d40 0x7f43bc0051c0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009ac0 tx=0x7f43bc005830 comp rx=0 tx=0).stop 2024-09-11T22:20:24.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.856+0000 7f43cf7fe640 1 -- 172.21.15.50:0/3688298828 reap_dead start 2024-09-11T22:20:24.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.856+0000 7f43d5931640 1 -- 172.21.15.50:0/3688298828 shutdown_connections 2024-09-11T22:20:24.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.856+0000 7f43d5931640 1 -- 172.21.15.50:0/3688298828 >> 172.21.15.50:0/3688298828 conn(0x7f43d00b40b0 msgr2=0x7f43d00b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.856+0000 7f43d5931640 1 -- 172.21.15.50:0/3688298828 shutdown_connections 2024-09-11T22:20:24.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.856+0000 7f43d5931640 1 -- 172.21.15.50:0/3688298828 wait complete. 2024-09-11T22:20:24.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.857+0000 7f43d5931640 1 Processor -- start 2024-09-11T22:20:24.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.857+0000 7f43d5931640 1 -- start start 2024-09-11T22:20:24.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43d5931640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43bc004d40 0x7f43d00b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43d5931640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43d015dcf0 0x7f43d01568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43d5931640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d006f970 0x7f43d006fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43d5931640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43d0165790 con 0x7f43d006f970 2024-09-11T22:20:24.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43d5931640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43d00d15c0 con 0x7f43d015dcf0 2024-09-11T22:20:24.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43d5931640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43d0165910 con 0x7f43bc004d40 2024-09-11T22:20:24.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43cf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d006f970 0x7f43d006fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43cf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d006f970 0x7f43d006fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57440/0 (socket says 172.21.15.50:57440) 2024-09-11T22:20:24.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43cf7fe640 1 -- 172.21.15.50:0/2084873539 learned_addr learned my addr 172.21.15.50:0/2084873539 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:24.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43cf7fe640 1 -- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43bc004d40 msgr2=0x7f43d00b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43ceffd640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43bc004d40 0x7f43d00b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43ce7fc640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43d015dcf0 0x7f43d01568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43bc004d40 0x7f43d00b7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43cf7fe640 1 -- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43d015dcf0 msgr2=0x7f43d01568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.858+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43d015dcf0 0x7f43d01568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.859+0000 7f43cf7fe640 1 -- 172.21.15.50:0/2084873539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d015e150 con 0x7f43d006f970 2024-09-11T22:20:24.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.859+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d006f970 0x7f43d006fdf0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f43c802abb0 tx=0x7f43c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.859+0000 7f43c7fff640 1 -- 172.21.15.50:0/2084873539 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8036040 con 0x7f43d006f970 2024-09-11T22:20:24.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.859+0000 7f43c7fff640 1 -- 172.21.15.50:0/2084873539 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c8041070 con 0x7f43d006f970 2024-09-11T22:20:24.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.859+0000 7f43d5931640 1 -- 172.21.15.50:0/2084873539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d0156e30 con 0x7f43d006f970 2024-09-11T22:20:24.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.859+0000 7f43c7fff640 1 -- 172.21.15.50:0/2084873539 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8009690 con 0x7f43d006f970 2024-09-11T22:20:24.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.859+0000 7f43d5931640 1 -- 172.21.15.50:0/2084873539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d00c9a90 con 0x7f43d006f970 2024-09-11T22:20:24.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.860+0000 7f43c7fff640 1 -- 172.21.15.50:0/2084873539 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43c8039070 con 0x7f43d006f970 2024-09-11T22:20:24.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.861+0000 7f43c7fff640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43b006be30 0x7f43b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.861+0000 7f43c7fff640 1 -- 172.21.15.50:0/2084873539 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f43c80aada0 con 0x7f43d006f970 2024-09-11T22:20:24.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.861+0000 7f43ceffd640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43b006be30 0x7f43b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.862+0000 7f43ceffd640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43b006be30 0x7f43b006e2f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f43c0000f80 tx=0x7f43c0006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.862+0000 7f43d86d0740 1 Processor -- start 2024-09-11T22:20:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.862+0000 7f43d86d0740 1 -- start start 2024-09-11T22:20:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43d86d0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f82780 0x5650b9f82b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43d86d0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f9d140 0x5650b9f9e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43d86d0740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f560e0 0x5650b9f9ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43d86d0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5650b9ebb6f0 con 0x5650b9f9d140 2024-09-11T22:20:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43d86d0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5650b9e63330 con 0x5650b9f82780 2024-09-11T22:20:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43d86d0740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5650b9eb76b0 con 0x5650b9f560e0 2024-09-11T22:20:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43ce7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f9d140 0x5650b9f9e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43ce7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f9d140 0x5650b9f9e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57446/0 (socket says 172.21.15.50:57446) 2024-09-11T22:20:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43ce7fc640 1 -- 172.21.15.50:0/2368666906 learned_addr learned my addr 172.21.15.50:0/2368666906 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43ceffd640 1 --2- 172.21.15.50:0/2368666906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f82780 0x5650b9f82b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/2368666906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f560e0 0x5650b9f9ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43ce7fc640 1 -- 172.21.15.50:0/2368666906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f560e0 msgr2=0x5650b9f9ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43ce7fc640 1 --2- 172.21.15.50:0/2368666906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f560e0 0x5650b9f9ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43ce7fc640 1 -- 172.21.15.50:0/2368666906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f82780 msgr2=0x5650b9f82b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43ce7fc640 1 --2- 172.21.15.50:0/2368666906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f82780 0x5650b9f82b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43ce7fc640 1 -- 172.21.15.50:0/2368666906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650b9e890d0 con 0x5650b9f9d140 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/2368666906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f560e0 0x5650b9f9ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43ceffd640 1 --2- 172.21.15.50:0/2368666906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f82780 0x5650b9f82b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.863+0000 7f43ce7fc640 1 --2- 172.21.15.50:0/2368666906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f9d140 0x5650b9f9e8f0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f43b80054d0 tx=0x7f43b8007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ad6757ce03a343 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.864+0000 7f43c57fa640 1 -- 172.21.15.50:0/2368666906 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b801a070 con 0x5650b9f9d140 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.864+0000 7f43c57fa640 1 -- 172.21.15.50:0/2368666906 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b80013b0 con 0x5650b9f9d140 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.864+0000 7f43c57fa640 1 -- 172.21.15.50:0/2368666906 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b80017a0 con 0x5650b9f9d140 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.864+0000 7f43d86d0740 1 -- 172.21.15.50:0/2368666906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f9d140 msgr2=0x5650b9f9e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.864+0000 7f43d86d0740 1 --2- 172.21.15.50:0/2368666906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f9d140 0x5650b9f9e8f0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f43b80054d0 tx=0x7f43b8007c80 comp rx=0 tx=0).stop 2024-09-11T22:20:24.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.864+0000 7f43d86d0740 1 -- 172.21.15.50:0/2368666906 shutdown_connections 2024-09-11T22:20:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.864+0000 7f43d86d0740 1 --2- 172.21.15.50:0/2368666906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f560e0 0x5650b9f9ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.864+0000 7f43d86d0740 1 --2- 172.21.15.50:0/2368666906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f9d140 0x5650b9f9e8f0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.864+0000 7f43d86d0740 1 --2- 172.21.15.50:0/2368666906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f82780 0x5650b9f82b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.864+0000 7f43d86d0740 1 -- 172.21.15.50:0/2368666906 >> 172.21.15.50:0/2368666906 conn(0x5650b9f55370 msgr2=0x5650b9f9d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.864+0000 7f43d86d0740 1 -- 172.21.15.50:0/2368666906 shutdown_connections 2024-09-11T22:20:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.864+0000 7f43d86d0740 1 -- 172.21.15.50:0/2368666906 wait complete. 2024-09-11T22:20:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.865+0000 7f43d86d0740 1 -- start start 2024-09-11T22:20:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.865+0000 7f43d86d0740 1 Processor -- start 2024-09-11T22:20:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43d86d0740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f82780 0x5650b9f7f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43d86d0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 0x5650b9f98790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43d86d0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 0x5650b9f9a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43d86d0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5650b9f83540 con 0x5650b9f99f10 2024-09-11T22:20:24.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43d86d0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5650b9e444f0 con 0x5650b9f9d140 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43d86d0740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5650b9f9ddd0 con 0x5650b9f82780 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43d86d0740 10 client.0 _ll_register_callbacks cb 0x5650b9e65b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43cf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 0x5650b9f9a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43cf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 0x5650b9f9a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57448/0 (socket says 172.21.15.50:57448) 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43cf7fe640 1 -- 172.21.15.50:0/840965828 learned_addr learned my addr 172.21.15.50:0/840965828 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43ce7fc640 1 --2- 172.21.15.50:0/840965828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 0x5650b9f98790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43cf7fe640 1 -- 172.21.15.50:0/840965828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f82780 msgr2=0x5650b9f7f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43ceffd640 1 --2- 172.21.15.50:0/840965828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f82780 0x5650b9f7f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/840965828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f82780 0x5650b9f7f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43cf7fe640 1 -- 172.21.15.50:0/840965828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 msgr2=0x5650b9f98790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/840965828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 0x5650b9f98790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43cf7fe640 1 -- 172.21.15.50:0/840965828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650b9c987d0 con 0x5650b9f99f10 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/840965828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 0x5650b9f9a390 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f43c8077040 tx=0x7f43c80796c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197c4d427977b884 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43ae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43ae7fc640 1 -- 172.21.15.50:0/840965828 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c807d370 con 0x5650b9f99f10 2024-09-11T22:20:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43ae7fc640 1 -- 172.21.15.50:0/840965828 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f43c8004270 con 0x5650b9f99f10 2024-09-11T22:20:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.866+0000 7f43d86d0740 1 -- 172.21.15.50:0/840965828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43b80013b0 con 0x5650b9f99f10 2024-09-11T22:20:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43ae7fc640 1 -- 172.21.15.50:0/840965828 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f43c8081c30 con 0x5650b9f99f10 2024-09-11T22:20:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43d86d0740 10 client.9240 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43d86d0740 1 -- 172.21.15.50:0/840965828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x5650b9bce3f0 con 0x5650b9f99f10 2024-09-11T22:20:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43ae7fc640 1 -- 172.21.15.50:0/840965828 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b80013b0 con 0x5650b9f99f10 2024-09-11T22:20:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43ae7fc640 1 -- 172.21.15.50:0/840965828 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f43c807b070 con 0x5650b9f99f10 2024-09-11T22:20:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43d86d0740 10 client.9240 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43d86d0740 10 client.9240 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43d86d0740 20 client.9240 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43d86d0740 1 --2- 172.21.15.50:0/840965828 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5650b9f86660 0x5650b9fb1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43d86d0740 4 client.9240 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43d86d0740 1 -- 172.21.15.50:0/840965828 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650b9ec8e20 con 0x5650b9f86660 2024-09-11T22:20:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43ceffd640 1 --2- 172.21.15.50:0/840965828 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5650b9f86660 0x5650b9fb1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43ceffd640 1 --2- 172.21.15.50:0/840965828 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5650b9f86660 0x5650b9fb1fe0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9613ca2f8264f2c server_cookie=3ff6530709b19b94 in_seq=0 out_seq=0 2024-09-11T22:20:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.867+0000 7f43ae7fc640 10 client.9240 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43ae7fc640 1 -- 172.21.15.50:0/840965828 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5650b9ec8e20 con 0x5650b9f86660 2024-09-11T22:20:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43ae7fc640 10 client.9240 handle_command_reply: tid=0 2024-09-11T22:20:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43d86d0740 1 client.9240 shutdown 2024-09-11T22:20:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43d86d0740 1 -- 172.21.15.50:0/840965828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 msgr2=0x5650b9f9a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43d86d0740 1 --2- 172.21.15.50:0/840965828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 0x5650b9f9a390 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f43c8077040 tx=0x7f43c80796c0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43d86d0740 1 -- 172.21.15.50:0/840965828 shutdown_connections 2024-09-11T22:20:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43d86d0740 1 --2- 172.21.15.50:0/840965828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 0x5650b9f9a390 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43d86d0740 1 --2- 172.21.15.50:0/840965828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 0x5650b9f98790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43d86d0740 1 --2- 172.21.15.50:0/840965828 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5650b9f86660 0x5650b9fb1fe0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43d86d0740 1 --2- 172.21.15.50:0/840965828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f82780 0x5650b9f7f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43ae7fc640 0 client.9240 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43d86d0740 1 -- 172.21.15.50:0/840965828 >> 172.21.15.50:0/840965828 conn(0x5650b9f560e0 msgr2=0x5650b9fa6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43d86d0740 1 -- 172.21.15.50:0/840965828 shutdown_connections 2024-09-11T22:20:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43d86d0740 1 -- 172.21.15.50:0/840965828 wait complete. 2024-09-11T22:20:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.868+0000 7f43d86d0740 20 client.9240 trim_cache size 0 max 16384 2024-09-11T22:20:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.885+0000 7f43d86d0740 1 Processor -- start 2024-09-11T22:20:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.885+0000 7f43d86d0740 1 -- start start 2024-09-11T22:20:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.886+0000 7f43d86d0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f82780 0x5650b9f80180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.886+0000 7f43d86d0740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f99f10 0x5650b9f589f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.886+0000 7f43d86d0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 0x5650b9f58f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.886+0000 7f43d86d0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43d01fd230 con 0x5650b9f82780 2024-09-11T22:20:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.886+0000 7f43d86d0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43d006cd60 con 0x5650b9f9d140 2024-09-11T22:20:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.886+0000 7f43d86d0740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43d00b6080 con 0x5650b9f99f10 2024-09-11T22:20:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.886+0000 7f43ceffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f82780 0x5650b9f80180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.886+0000 7f43ceffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f82780 0x5650b9f80180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57460/0 (socket says 172.21.15.50:57460) 2024-09-11T22:20:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.886+0000 7f43ceffd640 1 -- 172.21.15.50:0/3747346171 learned_addr learned my addr 172.21.15.50:0/3747346171 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.887+0000 7f43ceffd640 1 -- 172.21.15.50:0/3747346171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f99f10 msgr2=0x5650b9f589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.887+0000 7f43ceffd640 1 --2- 172.21.15.50:0/3747346171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f99f10 0x5650b9f589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.887+0000 7f43ceffd640 1 -- 172.21.15.50:0/3747346171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 msgr2=0x5650b9f58f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.887+0000 7f43ceffd640 1 --2- 172.21.15.50:0/3747346171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 0x5650b9f58f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.887+0000 7f43ceffd640 1 -- 172.21.15.50:0/3747346171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650b9f82ed0 con 0x5650b9f82780 2024-09-11T22:20:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.887+0000 7f43ceffd640 1 --2- 172.21.15.50:0/3747346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f82780 0x5650b9f80180 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f43c0007550 tx=0x7f43c000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a681411e49512e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.887+0000 7f43c4ff9640 1 -- 172.21.15.50:0/3747346171 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0016c70 con 0x5650b9f82780 2024-09-11T22:20:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.887+0000 7f43c4ff9640 1 -- 172.21.15.50:0/3747346171 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c001c040 con 0x5650b9f82780 2024-09-11T22:20:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.887+0000 7f43c4ff9640 1 -- 172.21.15.50:0/3747346171 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c002d410 con 0x5650b9f82780 2024-09-11T22:20:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.888+0000 7f43d86d0740 1 -- 172.21.15.50:0/3747346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f82780 msgr2=0x5650b9f80180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.888+0000 7f43d86d0740 1 --2- 172.21.15.50:0/3747346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f82780 0x5650b9f80180 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f43c0007550 tx=0x7f43c000c000 comp rx=0 tx=0).stop 2024-09-11T22:20:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.888+0000 7f43d86d0740 1 -- 172.21.15.50:0/3747346171 shutdown_connections 2024-09-11T22:20:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.888+0000 7f43d86d0740 1 --2- 172.21.15.50:0/3747346171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f99f10 0x5650b9f589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.888+0000 7f43d86d0740 1 --2- 172.21.15.50:0/3747346171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 0x5650b9f58f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.888+0000 7f43d86d0740 1 --2- 172.21.15.50:0/3747346171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f82780 0x5650b9f80180 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.888+0000 7f43d86d0740 1 -- 172.21.15.50:0/3747346171 >> 172.21.15.50:0/3747346171 conn(0x5650b9f560e0 msgr2=0x5650b9f9d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.888+0000 7f43d86d0740 1 -- 172.21.15.50:0/3747346171 shutdown_connections 2024-09-11T22:20:24.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.888+0000 7f43d86d0740 1 -- 172.21.15.50:0/3747346171 wait complete. 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.888+0000 7f43d86d0740 1 -- start start 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.888+0000 7f43d86d0740 1 Processor -- start 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43d86d0740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f82780 0x5650b9fc5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43d86d0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 0x5650b9fb4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43d86d0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 0x5650ba022840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43d86d0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5650b9f85f50 con 0x5650b9f99f10 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43d86d0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43d00cb190 con 0x5650b9f9d140 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43d86d0740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5650b9f7fb90 con 0x5650b9f82780 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43d86d0740 10 client.0 _ll_register_callbacks cb 0x7f43c8009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43ce7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 0x5650b9fb4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43ce7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 0x5650b9fb4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57470/0 (socket says 172.21.15.50:57470) 2024-09-11T22:20:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43ce7fc640 1 -- 172.21.15.50:0/2783966127 learned_addr learned my addr 172.21.15.50:0/2783966127 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 0x5650ba022840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43ceffd640 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f82780 0x5650b9fc5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43ce7fc640 1 -- 172.21.15.50:0/2783966127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f82780 msgr2=0x5650b9fc5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43ce7fc640 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f82780 0x5650b9fc5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43ce7fc640 1 -- 172.21.15.50:0/2783966127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 msgr2=0x5650ba022840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43ce7fc640 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 0x5650ba022840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43ce7fc640 1 -- 172.21.15.50:0/2783966127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650b9b8e0f0 con 0x5650b9f99f10 2024-09-11T22:20:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.889+0000 7f43cf7fe640 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 0x5650ba022840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43ce7fc640 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 0x5650b9fb4a30 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f43b8018040 tx=0x7f43b8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc215abc931611dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43ae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43ae7fc640 1 -- 172.21.15.50:0/2783966127 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8025060 con 0x5650b9f99f10 2024-09-11T22:20:24.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43ae7fc640 1 -- 172.21.15.50:0/2783966127 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f43b8020470 con 0x5650b9f99f10 2024-09-11T22:20:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43d86d0740 1 -- 172.21.15.50:0/2783966127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43c001c040 con 0x5650b9f99f10 2024-09-11T22:20:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43ae7fc640 1 -- 172.21.15.50:0/2783966127 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f43b802b050 con 0x5650b9f99f10 2024-09-11T22:20:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43d86d0740 10 client.9246 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43d86d0740 1 -- 172.21.15.50:0/2783966127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x5650b9fa10f0 con 0x5650b9f99f10 2024-09-11T22:20:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43ae7fc640 1 -- 172.21.15.50:0/2783966127 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c001c040 con 0x5650b9f99f10 2024-09-11T22:20:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43ae7fc640 1 -- 172.21.15.50:0/2783966127 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f43b802e020 con 0x5650b9f99f10 2024-09-11T22:20:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43d86d0740 10 client.9246 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43d86d0740 10 client.9246 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43d86d0740 20 client.9246 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43d86d0740 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5650b9f82150 0x5650b9f973c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43d86d0740 4 client.9246 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-11T22:20:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43d86d0740 1 -- 172.21.15.50:0/2783966127 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x5650b9f84f40 con 0x5650b9f82150 2024-09-11T22:20:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.890+0000 7f43ceffd640 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5650b9f82150 0x5650b9f973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43ae7fc640 10 client.9246 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43ceffd640 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5650b9f82150 0x5650b9f973c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=396a89c01d4a1157 server_cookie=192571ebee1f0daa in_seq=0 out_seq=0 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43ae7fc640 1 -- 172.21.15.50:0/2783966127 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5650b9f84f40 con 0x5650b9f82150 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43ae7fc640 10 client.9246 handle_command_reply: tid=0 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43d86d0740 1 client.9246 shutdown 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43d86d0740 1 -- 172.21.15.50:0/2783966127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 msgr2=0x5650b9fb4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43d86d0740 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 0x5650b9fb4a30 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f43b8018040 tx=0x7f43b8001120 comp rx=0 tx=0).stop 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43d86d0740 1 -- 172.21.15.50:0/2783966127 shutdown_connections 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43d86d0740 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650b9f9d140 0x5650ba022840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43d86d0740 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5650b9f99f10 0x5650b9fb4a30 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43d86d0740 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x5650b9f82150 0x5650b9f973c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43d86d0740 1 --2- 172.21.15.50:0/2783966127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5650b9f82780 0x5650b9fc5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43ae7fc640 0 client.9246 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:24.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43d86d0740 1 -- 172.21.15.50:0/2783966127 >> 172.21.15.50:0/2783966127 conn(0x5650b9f560e0 msgr2=0x5650b9f9ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43d86d0740 1 -- 172.21.15.50:0/2783966127 shutdown_connections 2024-09-11T22:20:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43d86d0740 1 -- 172.21.15.50:0/2783966127 wait complete. 2024-09-11T22:20:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.891+0000 7f43d86d0740 20 client.9246 trim_cache size 0 max 16384 2024-09-11T22:20:24.898 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:20:24.898 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:20:24.898 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:20:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.892+0000 7f43d5931640 1 -- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43b006be30 msgr2=0x7f43b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.892+0000 7f43d5931640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43b006be30 0x7f43b006e2f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f43c0000f80 tx=0x7f43c0006040 comp rx=0 tx=0).stop 2024-09-11T22:20:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.892+0000 7f43d5931640 1 -- 172.21.15.50:0/2084873539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d006f970 msgr2=0x7f43d006fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.892+0000 7f43d5931640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d006f970 0x7f43d006fdf0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f43c802abb0 tx=0x7f43c8004730 comp rx=0 tx=0).stop 2024-09-11T22:20:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.892+0000 7f43d5931640 1 -- 172.21.15.50:0/2084873539 shutdown_connections 2024-09-11T22:20:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.892+0000 7f43d5931640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43b006be30 0x7f43b006e2f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.892+0000 7f43d5931640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d006f970 0x7f43d006fdf0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.892+0000 7f43d5931640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43d015dcf0 0x7f43d01568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.892+0000 7f43d5931640 1 --2- 172.21.15.50:0/2084873539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43bc004d40 0x7f43d00b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.892+0000 7f43d5931640 1 -- 172.21.15.50:0/2084873539 >> 172.21.15.50:0/2084873539 conn(0x7f43d00b40b0 msgr2=0x7f43d0159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.892+0000 7f43d5931640 1 -- 172.21.15.50:0/2084873539 shutdown_connections 2024-09-11T22:20:24.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:24.892+0000 7f43d5931640 1 -- 172.21.15.50:0/2084873539 wait complete. 2024-09-11T22:20:24.903 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-11T22:20:24.904 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-11T22:20:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.007+0000 7f823694b640 1 Processor -- start 2024-09-11T22:20:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.007+0000 7f823694b640 1 -- start start 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.008+0000 7f823694b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f82300d1c90 0x7f82300b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.008+0000 7f823694b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8230162350 0x7f82301627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.008+0000 7f823694b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8230163080 con 0x7f823015e8e0 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.008+0000 7f823694b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f823015ecc0 con 0x7f8230162350 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.008+0000 7f823694b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f82300d2ad0 con 0x7f82300d1c90 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.008+0000 7f8234ee8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8230162350 0x7f82301627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.008+0000 7f8234ee8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8230162350 0x7f82301627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57478/0 (socket says 172.21.15.50:57478) 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.008+0000 7f8234ee8640 1 -- 172.21.15.50:0/3575917631 learned_addr learned my addr 172.21.15.50:0/3575917631 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.008+0000 7f822f7fe640 1 --2- 172.21.15.50:0/3575917631 >> v2:172.21.15.77:3300/0 conn(0x7f82300d1c90 0x7f82300b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.009+0000 7f8234ee8640 1 -- 172.21.15.50:0/3575917631 >> v2:172.21.15.77:3300/0 conn(0x7f82300d1c90 msgr2=0x7f82300b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.009+0000 7f8234ee8640 1 --2- 172.21.15.50:0/3575917631 >> v2:172.21.15.77:3300/0 conn(0x7f82300d1c90 0x7f82300b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.009+0000 7f8234ee8640 1 -- 172.21.15.50:0/3575917631 >> v1:172.21.15.77:6789/0 conn(0x7f823015e8e0 legacy=0x7f82300d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.009+0000 7f8234ee8640 1 -- 172.21.15.50:0/3575917631 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82300d2d20 con 0x7f8230162350 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.009+0000 7f8234ee8640 1 --2- 172.21.15.50:0/3575917631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8230162350 0x7f82301627a0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f82301622b0 tx=0x7f822802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81c063f8f501d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.009+0000 7f822effd640 1 -- 172.21.15.50:0/3575917631 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8228036070 con 0x7f8230162350 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.009+0000 7f822effd640 1 -- 172.21.15.50:0/3575917631 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8228031600 con 0x7f8230162350 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.009+0000 7f822effd640 1 -- 172.21.15.50:0/3575917631 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82280319f0 con 0x7f8230162350 2024-09-11T22:20:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.010+0000 7f823694b640 1 -- 172.21.15.50:0/3575917631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8230162350 msgr2=0x7f82301627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.010+0000 7f823694b640 1 --2- 172.21.15.50:0/3575917631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8230162350 0x7f82301627a0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f82301622b0 tx=0x7f822802a7c0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.010+0000 7f823694b640 1 -- 172.21.15.50:0/3575917631 shutdown_connections 2024-09-11T22:20:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.010+0000 7f823694b640 1 --2- 172.21.15.50:0/3575917631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8230162350 0x7f82301627a0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.010+0000 7f823694b640 1 --2- 172.21.15.50:0/3575917631 >> v2:172.21.15.77:3300/0 conn(0x7f82300d1c90 0x7f82300b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.010+0000 7f823694b640 1 -- 172.21.15.50:0/3575917631 >> 172.21.15.50:0/3575917631 conn(0x7f8230067ba0 msgr2=0x7f8230067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.010+0000 7f823694b640 1 -- 172.21.15.50:0/3575917631 shutdown_connections 2024-09-11T22:20:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.010+0000 7f823694b640 1 -- 172.21.15.50:0/3575917631 wait complete. 2024-09-11T22:20:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.011+0000 7f823694b640 1 Processor -- start 2024-09-11T22:20:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.011+0000 7f823694b640 1 -- start start 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.012+0000 7f823694b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82300d1c90 0x7f8230154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.012+0000 7f823694b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f823015e8e0 0x7f82300cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.012+0000 7f823694b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8230162350 0x7f82300cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.012+0000 7f823694b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8230162ce0 con 0x7f823015e8e0 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.012+0000 7f823694b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82300d3370 con 0x7f82300d1c90 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.012+0000 7f823694b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8230162e60 con 0x7f8230162350 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.012+0000 7f822f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f823015e8e0 0x7f82300cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.012+0000 7f822f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f823015e8e0 0x7f82300cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57488/0 (socket says 172.21.15.50:57488) 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.012+0000 7f822f7fe640 1 -- 172.21.15.50:0/1390261753 learned_addr learned my addr 172.21.15.50:0/1390261753 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.012+0000 7f822ffff640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82300d1c90 0x7f8230154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.012+0000 7f8234ee8640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8230162350 0x7f82300cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.013+0000 7f822f7fe640 1 -- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8230162350 msgr2=0x7f82300cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.013+0000 7f822f7fe640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8230162350 0x7f82300cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.013+0000 7f822f7fe640 1 -- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82300d1c90 msgr2=0x7f8230154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.013+0000 7f822f7fe640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82300d1c90 0x7f8230154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.013+0000 7f822f7fe640 1 -- 172.21.15.50:0/1390261753 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8230159840 con 0x7f823015e8e0 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.013+0000 7f822f7fe640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f823015e8e0 0x7f82300cbc70 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f822400e870 tx=0x7f822400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.013+0000 7f822cff9640 1 -- 172.21.15.50:0/1390261753 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224017070 con 0x7f823015e8e0 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.013+0000 7f822cff9640 1 -- 172.21.15.50:0/1390261753 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f822400c940 con 0x7f823015e8e0 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.013+0000 7f822cff9640 1 -- 172.21.15.50:0/1390261753 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822400cd30 con 0x7f823015e8e0 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.013+0000 7f823694b640 1 -- 172.21.15.50:0/1390261753 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8230159b20 con 0x7f823015e8e0 2024-09-11T22:20:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.013+0000 7f823694b640 1 -- 172.21.15.50:0/1390261753 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823015a0e0 con 0x7f823015e8e0 2024-09-11T22:20:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.014+0000 7f822cff9640 1 -- 172.21.15.50:0/1390261753 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f822401a070 con 0x7f823015e8e0 2024-09-11T22:20:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.015+0000 7f822cff9640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f821c06be60 0x7f821c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.015+0000 7f822cff9640 1 -- 172.21.15.50:0/1390261753 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f822408b030 con 0x7f823015e8e0 2024-09-11T22:20:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.015+0000 7f822ffff640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f821c06be60 0x7f821c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.016+0000 7f822ffff640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f821c06be60 0x7f821c06e320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8220001780 tx=0x7f8220009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.016+0000 7f82397c1740 1 Processor -- start 2024-09-11T22:20:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.016+0000 7f82397c1740 1 -- start start 2024-09-11T22:20:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f82397c1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb41920 0x55fd4cb870c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f82397c1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb3f0e0 0x55fd4cb41d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f82397c1740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb430b0 0x55fd4cb3c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f82397c1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fd4caa46f0 con 0x55fd4cb3f0e0 2024-09-11T22:20:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f82397c1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fd4ca4c330 con 0x55fd4cb41920 2024-09-11T22:20:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f82397c1740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fd4caa06b0 con 0x55fd4cb430b0 2024-09-11T22:20:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f822f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb3f0e0 0x55fd4cb41d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f822f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb3f0e0 0x55fd4cb41d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57500/0 (socket says 172.21.15.50:57500) 2024-09-11T22:20:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f822f7fe640 1 -- 172.21.15.50:0/3292515586 learned_addr learned my addr 172.21.15.50:0/3292515586 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f822ffff640 1 --2- 172.21.15.50:0/3292515586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb41920 0x55fd4cb870c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f8234ee8640 1 --2- 172.21.15.50:0/3292515586 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb430b0 0x55fd4cb3c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f822f7fe640 1 -- 172.21.15.50:0/3292515586 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb430b0 msgr2=0x55fd4cb3c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f822f7fe640 1 --2- 172.21.15.50:0/3292515586 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb430b0 0x55fd4cb3c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f822f7fe640 1 -- 172.21.15.50:0/3292515586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb41920 msgr2=0x55fd4cb870c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f822f7fe640 1 --2- 172.21.15.50:0/3292515586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb41920 0x55fd4cb870c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f822f7fe640 1 -- 172.21.15.50:0/3292515586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd4ca720d0 con 0x55fd4cb3f0e0 2024-09-11T22:20:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f822f7fe640 1 --2- 172.21.15.50:0/3292515586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb3f0e0 0x55fd4cb41d00 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f8224061910 tx=0x7f8224058f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517faa1262effb0b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f8215ffb640 1 -- 172.21.15.50:0/3292515586 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224021070 con 0x55fd4cb3f0e0 2024-09-11T22:20:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f8215ffb640 1 -- 172.21.15.50:0/3292515586 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8224061e40 con 0x55fd4cb3f0e0 2024-09-11T22:20:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.017+0000 7f8215ffb640 1 -- 172.21.15.50:0/3292515586 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224071170 con 0x55fd4cb3f0e0 2024-09-11T22:20:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.018+0000 7f82397c1740 1 -- 172.21.15.50:0/3292515586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb3f0e0 msgr2=0x55fd4cb41d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.018+0000 7f82397c1740 1 --2- 172.21.15.50:0/3292515586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb3f0e0 0x55fd4cb41d00 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f8224061910 tx=0x7f8224058f50 comp rx=0 tx=0).stop 2024-09-11T22:20:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.018+0000 7f82397c1740 1 -- 172.21.15.50:0/3292515586 shutdown_connections 2024-09-11T22:20:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.018+0000 7f82397c1740 1 --2- 172.21.15.50:0/3292515586 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb430b0 0x55fd4cb3c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.018+0000 7f82397c1740 1 --2- 172.21.15.50:0/3292515586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb3f0e0 0x55fd4cb41d00 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.018+0000 7f82397c1740 1 --2- 172.21.15.50:0/3292515586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb41920 0x55fd4cb870c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.018+0000 7f82397c1740 1 -- 172.21.15.50:0/3292515586 >> 172.21.15.50:0/3292515586 conn(0x55fd4cb3e370 msgr2=0x55fd4cb86590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.018+0000 7f82397c1740 1 -- 172.21.15.50:0/3292515586 shutdown_connections 2024-09-11T22:20:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.018+0000 7f82397c1740 1 -- 172.21.15.50:0/3292515586 wait complete. 2024-09-11T22:20:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.019+0000 7f82397c1740 1 -- start start 2024-09-11T22:20:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.019+0000 7f82397c1740 1 Processor -- start 2024-09-11T22:20:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f82397c1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 0x55fd4cb6bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f82397c1740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb430b0 0x55fd4cb962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f82397c1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb5b260 0x55fd4cb829a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f82397c1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fd4cb3d810 con 0x55fd4cb41920 2024-09-11T22:20:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f82397c1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fd4ca2d4f0 con 0x55fd4cb5b260 2024-09-11T22:20:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f82397c1740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fd4cb878f0 con 0x55fd4cb430b0 2024-09-11T22:20:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f82397c1740 10 client.0 _ll_register_callbacks cb 0x55fd4ca4eb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f822ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 0x55fd4cb6bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f822ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 0x55fd4cb6bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57506/0 (socket says 172.21.15.50:57506) 2024-09-11T22:20:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f822ffff640 1 -- 172.21.15.50:0/625836348 learned_addr learned my addr 172.21.15.50:0/625836348 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f822f7fe640 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb430b0 0x55fd4cb962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f8234ee8640 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb5b260 0x55fd4cb829a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f822ffff640 1 -- 172.21.15.50:0/625836348 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb430b0 msgr2=0x55fd4cb962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f822ffff640 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb430b0 0x55fd4cb962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f822ffff640 1 -- 172.21.15.50:0/625836348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb5b260 msgr2=0x55fd4cb829a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f822ffff640 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb5b260 0x55fd4cb829a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f822ffff640 1 -- 172.21.15.50:0/625836348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd4c8817d0 con 0x55fd4cb41920 2024-09-11T22:20:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f8234ee8640 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb5b260 0x55fd4cb829a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f822ffff640 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 0x55fd4cb6bd40 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f8220006ae0 tx=0x7f8220000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564d9230a43c72a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f820effd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f820effd640 1 -- 172.21.15.50:0/625836348 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220021410 con 0x55fd4cb41920 2024-09-11T22:20:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f820effd640 1 -- 172.21.15.50:0/625836348 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f82200215b0 con 0x55fd4cb41920 2024-09-11T22:20:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.020+0000 7f82397c1740 1 -- 172.21.15.50:0/625836348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8224061e40 con 0x55fd4cb41920 2024-09-11T22:20:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f820effd640 1 -- 172.21.15.50:0/625836348 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f822002e050 con 0x55fd4cb41920 2024-09-11T22:20:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f82397c1740 10 client.9258 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f82397c1740 1 -- 172.21.15.50:0/625836348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x55fd4c7b73f0 con 0x55fd4cb41920 2024-09-11T22:20:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f820effd640 1 -- 172.21.15.50:0/625836348 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8224061e40 con 0x55fd4cb41920 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f820effd640 1 -- 172.21.15.50:0/625836348 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f8220031020 con 0x55fd4cb41920 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f82397c1740 10 client.9258 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f82397c1740 10 client.9258 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f82397c1740 20 client.9258 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f82397c1740 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x55fd4cb80bc0 0x55fd4cb80fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f82397c1740 4 client.9258 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f82397c1740 1 -- 172.21.15.50:0/625836348 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd4cab1e20 con 0x55fd4cb80bc0 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f822f7fe640 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x55fd4cb80bc0 0x55fd4cb80fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f820effd640 10 client.9258 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.021+0000 7f822f7fe640 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x55fd4cb80bc0 0x55fd4cb80fd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ee59f7e0eff4e6b server_cookie=ec5822606b1515f6 in_seq=0 out_seq=0 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f820effd640 1 -- 172.21.15.50:0/625836348 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd4cab1e20 con 0x55fd4cb80bc0 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f820effd640 10 client.9258 handle_command_reply: tid=0 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f82397c1740 1 client.9258 shutdown 2024-09-11T22:20:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f82397c1740 1 -- 172.21.15.50:0/625836348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 msgr2=0x55fd4cb6bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f82397c1740 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 0x55fd4cb6bd40 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f8220006ae0 tx=0x7f8220000ed0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f82397c1740 1 -- 172.21.15.50:0/625836348 shutdown_connections 2024-09-11T22:20:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f82397c1740 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x55fd4cb80bc0 0x55fd4cb80fd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f82397c1740 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb430b0 0x55fd4cb962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f82397c1740 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb5b260 0x55fd4cb829a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f820effd640 0 client.9258 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f82397c1740 1 --2- 172.21.15.50:0/625836348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 0x55fd4cb6bd40 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f82397c1740 1 -- 172.21.15.50:0/625836348 >> 172.21.15.50:0/625836348 conn(0x55fd4cb3f0e0 msgr2=0x55fd4cb85b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f82397c1740 1 -- 172.21.15.50:0/625836348 shutdown_connections 2024-09-11T22:20:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f82397c1740 1 -- 172.21.15.50:0/625836348 wait complete. 2024-09-11T22:20:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.022+0000 7f82397c1740 20 client.9258 trim_cache size 0 max 16384 2024-09-11T22:20:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.040+0000 7f82397c1740 1 Processor -- start 2024-09-11T22:20:25.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.040+0000 7f82397c1740 1 -- start start 2024-09-11T22:20:25.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.040+0000 7f82397c1740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb41920 0x55fd4cb88510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.040+0000 7f82397c1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb430b0 0x55fd4cb823b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.040+0000 7f82397c1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb5b260 0x55fd4cb828f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.040+0000 7f82397c1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8230200d20 con 0x55fd4cb5b260 2024-09-11T22:20:25.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.040+0000 7f82397c1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82301e9540 con 0x55fd4cb430b0 2024-09-11T22:20:25.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.040+0000 7f82397c1740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f82301f8930 con 0x55fd4cb41920 2024-09-11T22:20:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.040+0000 7f8234ee8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb5b260 0x55fd4cb828f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.040+0000 7f8234ee8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb5b260 0x55fd4cb828f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57518/0 (socket says 172.21.15.50:57518) 2024-09-11T22:20:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.040+0000 7f8234ee8640 1 -- 172.21.15.50:0/81224511 learned_addr learned my addr 172.21.15.50:0/81224511 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.040+0000 7f822ffff640 1 --2- 172.21.15.50:0/81224511 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb41920 0x55fd4cb88510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.040+0000 7f822f7fe640 1 --2- 172.21.15.50:0/81224511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb430b0 0x55fd4cb823b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.041+0000 7f8234ee8640 1 -- 172.21.15.50:0/81224511 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb41920 msgr2=0x55fd4cb88510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.041+0000 7f8234ee8640 1 --2- 172.21.15.50:0/81224511 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb41920 0x55fd4cb88510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.041+0000 7f8234ee8640 1 -- 172.21.15.50:0/81224511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb430b0 msgr2=0x55fd4cb823b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.041+0000 7f8234ee8640 1 --2- 172.21.15.50:0/81224511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb430b0 0x55fd4cb823b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.041+0000 7f8234ee8640 1 -- 172.21.15.50:0/81224511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd4cb68460 con 0x55fd4cb5b260 2024-09-11T22:20:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.041+0000 7f822ffff640 1 --2- 172.21.15.50:0/81224511 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb41920 0x55fd4cb88510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.041+0000 7f8234ee8640 1 --2- 172.21.15.50:0/81224511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb5b260 0x55fd4cb828f0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f8228009f40 tx=0x7f822802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4711843b01bbb98d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.041+0000 7f82157fa640 1 -- 172.21.15.50:0/81224511 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8228036070 con 0x55fd4cb5b260 2024-09-11T22:20:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.041+0000 7f82157fa640 1 -- 172.21.15.50:0/81224511 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8228042070 con 0x55fd4cb5b260 2024-09-11T22:20:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.041+0000 7f82157fa640 1 -- 172.21.15.50:0/81224511 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8228004040 con 0x55fd4cb5b260 2024-09-11T22:20:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.041+0000 7f82397c1740 1 -- 172.21.15.50:0/81224511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb5b260 msgr2=0x55fd4cb828f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.041+0000 7f82397c1740 1 --2- 172.21.15.50:0/81224511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb5b260 0x55fd4cb828f0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f8228009f40 tx=0x7f822802e000 comp rx=0 tx=0).stop 2024-09-11T22:20:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.042+0000 7f82397c1740 1 -- 172.21.15.50:0/81224511 shutdown_connections 2024-09-11T22:20:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.042+0000 7f82397c1740 1 --2- 172.21.15.50:0/81224511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb5b260 0x55fd4cb828f0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.042+0000 7f82397c1740 1 --2- 172.21.15.50:0/81224511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb430b0 0x55fd4cb823b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.042+0000 7f82397c1740 1 --2- 172.21.15.50:0/81224511 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb41920 0x55fd4cb88510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.042+0000 7f82397c1740 1 -- 172.21.15.50:0/81224511 >> 172.21.15.50:0/81224511 conn(0x55fd4cb3f0e0 msgr2=0x55fd4cb85b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.042+0000 7f82397c1740 1 -- 172.21.15.50:0/81224511 shutdown_connections 2024-09-11T22:20:25.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.042+0000 7f82397c1740 1 -- 172.21.15.50:0/81224511 wait complete. 2024-09-11T22:20:25.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.042+0000 7f82397c1740 1 -- start start 2024-09-11T22:20:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.042+0000 7f82397c1740 1 Processor -- start 2024-09-11T22:20:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f82397c1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 0x55fd4cc076c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f82397c1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb430b0 0x55fd4cb823b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f82397c1740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb5b260 0x55fd4cb828f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f82397c1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fd4c91a940 con 0x55fd4cb41920 2024-09-11T22:20:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f82397c1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82301e8ef0 con 0x55fd4cb430b0 2024-09-11T22:20:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f82397c1740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fd4cb3e100 con 0x55fd4cb5b260 2024-09-11T22:20:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f82397c1740 10 client.0 _ll_register_callbacks cb 0x7f8220001420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f822ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 0x55fd4cc076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f822ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 0x55fd4cc076c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57522/0 (socket says 172.21.15.50:57522) 2024-09-11T22:20:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f822ffff640 1 -- 172.21.15.50:0/533082324 learned_addr learned my addr 172.21.15.50:0/533082324 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f8234ee8640 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb5b260 0x55fd4cb828f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f822ffff640 1 -- 172.21.15.50:0/533082324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb5b260 msgr2=0x55fd4cb828f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f822f7fe640 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb430b0 0x55fd4cb823b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f822ffff640 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb5b260 0x55fd4cb828f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.043+0000 7f822ffff640 1 -- 172.21.15.50:0/533082324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb430b0 msgr2=0x55fd4cb823b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f822ffff640 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb430b0 0x55fd4cb823b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f822ffff640 1 -- 172.21.15.50:0/533082324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd4c7770f0 con 0x55fd4cb41920 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f8234ee8640 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb5b260 0x55fd4cb828f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f822ffff640 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 0x55fd4cc076c0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f82200213a0 tx=0x7f8220013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3dde052c7f0bace server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f820effd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f820effd640 1 -- 172.21.15.50:0/533082324 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220021920 con 0x55fd4cb41920 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f820effd640 1 -- 172.21.15.50:0/533082324 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f82200325f0 con 0x55fd4cb41920 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f82397c1740 1 -- 172.21.15.50:0/533082324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8228042070 con 0x55fd4cb41920 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f820effd640 1 -- 172.21.15.50:0/533082324 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f8220042050 con 0x55fd4cb41920 2024-09-11T22:20:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f82397c1740 10 client.9264 fetch_fsmap learned FSMap version 101 2024-09-11T22:20:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f82397c1740 1 -- 172.21.15.50:0/533082324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x55fd4cb7fea0 con 0x55fd4cb41920 2024-09-11T22:20:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f820effd640 1 -- 172.21.15.50:0/533082324 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8228042070 con 0x55fd4cb41920 2024-09-11T22:20:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f820effd640 1 -- 172.21.15.50:0/533082324 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f8220031040 con 0x55fd4cb41920 2024-09-11T22:20:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f82397c1740 10 client.9264 fetch_fsmap finished waiting for FSMap version 101 2024-09-11T22:20:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f82397c1740 10 client.9264 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-11T22:20:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f82397c1740 20 client.9264 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f82397c1740 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x55fd4cb7f980 0x55fd4cbaa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f82397c1740 4 client.9264 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:20:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.044+0000 7f82397c1740 1 -- 172.21.15.50:0/533082324 --> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fd4cb85930 con 0x55fd4cb7f980 2024-09-11T22:20:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f822f7fe640 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x55fd4cb7f980 0x55fd4cbaa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f820effd640 10 client.9264 ms_handle_connect on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f822f7fe640 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x55fd4cb7f980 0x55fd4cbaa640 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9083349369d70cea server_cookie=30c900a4f56f5409 in_seq=0 out_seq=0 2024-09-11T22:20:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f820effd640 1 -- 172.21.15.50:0/533082324 <== mds.0 v2:172.21.15.50:6833/3729591942 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fd4cb85930 con 0x55fd4cb7f980 2024-09-11T22:20:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f820effd640 10 client.9264 handle_command_reply: tid=0 2024-09-11T22:20:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f82397c1740 1 client.9264 shutdown 2024-09-11T22:20:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f82397c1740 1 -- 172.21.15.50:0/533082324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 msgr2=0x55fd4cc076c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f82397c1740 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 0x55fd4cc076c0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f82200213a0 tx=0x7f8220013000 comp rx=0 tx=0).stop 2024-09-11T22:20:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f82397c1740 1 -- 172.21.15.50:0/533082324 shutdown_connections 2024-09-11T22:20:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f82397c1740 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.50:6833/3729591942,v1:172.21.15.50:6835/3729591942] conn(0x55fd4cb7f980 0x55fd4cbaa640 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f82397c1740 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fd4cb5b260 0x55fd4cb828f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f82397c1740 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd4cb430b0 0x55fd4cb823b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f820effd640 0 client.9264 ms_handle_reset on v2:172.21.15.50:6833/3729591942 2024-09-11T22:20:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f82397c1740 1 --2- 172.21.15.50:0/533082324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd4cb41920 0x55fd4cc076c0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f82397c1740 1 -- 172.21.15.50:0/533082324 >> 172.21.15.50:0/533082324 conn(0x55fd4cb3f0e0 msgr2=0x55fd4cb6ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f82397c1740 1 -- 172.21.15.50:0/533082324 shutdown_connections 2024-09-11T22:20:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f82397c1740 1 -- 172.21.15.50:0/533082324 wait complete. 2024-09-11T22:20:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.045+0000 7f82397c1740 20 client.9264 trim_cache size 0 max 16384 2024-09-11T22:20:25.053 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:20:25.053 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-11T22:20:25.053 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-11T22:20:25.053 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:20:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.046+0000 7f823694b640 1 -- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f821c06be60 msgr2=0x7f821c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.046+0000 7f823694b640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f821c06be60 0x7f821c06e320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8220001780 tx=0x7f8220009040 comp rx=0 tx=0).stop 2024-09-11T22:20:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.046+0000 7f823694b640 1 -- 172.21.15.50:0/1390261753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f823015e8e0 msgr2=0x7f82300cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.046+0000 7f823694b640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f823015e8e0 0x7f82300cbc70 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f822400e870 tx=0x7f822400ed30 comp rx=0 tx=0).stop 2024-09-11T22:20:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.046+0000 7f823694b640 1 -- 172.21.15.50:0/1390261753 shutdown_connections 2024-09-11T22:20:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.046+0000 7f823694b640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f821c06be60 0x7f821c06e320 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.046+0000 7f823694b640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8230162350 0x7f82300cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.046+0000 7f823694b640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f823015e8e0 0x7f82300cbc70 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.046+0000 7f823694b640 1 --2- 172.21.15.50:0/1390261753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82300d1c90 0x7f8230154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.046+0000 7f823694b640 1 -- 172.21.15.50:0/1390261753 >> 172.21.15.50:0/1390261753 conn(0x7f8230067ba0 msgr2=0x7f82300b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.046+0000 7f823694b640 1 -- 172.21.15.50:0/1390261753 shutdown_connections 2024-09-11T22:20:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.046+0000 7f823694b640 1 -- 172.21.15.50:0/1390261753 wait complete. 2024-09-11T22:20:25.057 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:20:25.058 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:25.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.160+0000 7fd1ad4d0640 1 Processor -- start 2024-09-11T22:20:25.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.160+0000 7fd1ad4d0640 1 -- start start 2024-09-11T22:20:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.161+0000 7fd1ad4d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1a8158f80 0x7fd1a8072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.161+0000 7fd1ad4d0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1a815c000 0x7fd1a80d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.161+0000 7fd1ad4d0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a815c910 con 0x7fd1a8072980 2024-09-11T22:20:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.161+0000 7fd1ad4d0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd1a8072dc0 con 0x7fd1a815c000 2024-09-11T22:20:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.161+0000 7fd1ad4d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a8159360 con 0x7fd1a8158f80 2024-09-11T22:20:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.161+0000 7fd1a6ffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1a8158f80 0x7fd1a8072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.161+0000 7fd1a77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1a815c000 0x7fd1a80d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.161+0000 7fd1a6ffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1a8158f80 0x7fd1a8072440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:37794/0 (socket says 172.21.15.50:37794) 2024-09-11T22:20:25.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.161+0000 7fd1a6ffd640 1 -- 172.21.15.50:0/3389439399 learned_addr learned my addr 172.21.15.50:0/3389439399 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:25.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.162+0000 7fd1a6ffd640 1 -- 172.21.15.50:0/3389439399 >> v2:172.21.15.77:3300/0 conn(0x7fd1a815c000 msgr2=0x7fd1a80d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.162+0000 7fd1a6ffd640 1 --2- 172.21.15.50:0/3389439399 >> v2:172.21.15.77:3300/0 conn(0x7fd1a815c000 0x7fd1a80d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.162+0000 7fd1a6ffd640 1 -- 172.21.15.50:0/3389439399 >> v1:172.21.15.77:6789/0 conn(0x7fd1a8072980 legacy=0x7fd1a815b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.162+0000 7fd1a6ffd640 1 -- 172.21.15.50:0/3389439399 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a815c630 con 0x7fd1a8158f80 2024-09-11T22:20:25.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.162+0000 7fd1a77fe640 1 --2- 172.21.15.50:0/3389439399 >> v2:172.21.15.77:3300/0 conn(0x7fd1a815c000 0x7fd1a80d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:25.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.163+0000 7fd1a6ffd640 1 --2- 172.21.15.50:0/3389439399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1a8158f80 0x7fd1a8072440 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009870 tx=0x7fd1a002c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb9547643cb7d48 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.163+0000 7fd1a5ffb640 1 -- 172.21.15.50:0/3389439399 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0038070 con 0x7fd1a8158f80 2024-09-11T22:20:25.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.163+0000 7fd1a5ffb640 1 -- 172.21.15.50:0/3389439399 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a0031710 con 0x7fd1a8158f80 2024-09-11T22:20:25.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.163+0000 7fd1a5ffb640 1 -- 172.21.15.50:0/3389439399 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0031ae0 con 0x7fd1a8158f80 2024-09-11T22:20:25.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.163+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/3389439399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1a8158f80 msgr2=0x7fd1a8072440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.163+0000 7fd1ad4d0640 1 --2- 172.21.15.50:0/3389439399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1a8158f80 0x7fd1a8072440 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009870 tx=0x7fd1a002c480 comp rx=0 tx=0).stop 2024-09-11T22:20:25.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.163+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/3389439399 shutdown_connections 2024-09-11T22:20:25.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.163+0000 7fd1ad4d0640 1 --2- 172.21.15.50:0/3389439399 >> v2:172.21.15.77:3300/0 conn(0x7fd1a815c000 0x7fd1a80d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.163+0000 7fd1ad4d0640 1 --2- 172.21.15.50:0/3389439399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1a8158f80 0x7fd1a8072440 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.163+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/3389439399 >> 172.21.15.50:0/3389439399 conn(0x7fd1a806bd30 msgr2=0x7fd1a806c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.163+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/3389439399 shutdown_connections 2024-09-11T22:20:25.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.163+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/3389439399 wait complete. 2024-09-11T22:20:25.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.165+0000 7fd1ad4d0640 1 Processor -- start 2024-09-11T22:20:25.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.165+0000 7fd1ad4d0640 1 -- start start 2024-09-11T22:20:25.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.165+0000 7fd1ad4d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a8072980 0x7fd1a8145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.165+0000 7fd1ad4d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1a8158f80 0x7fd1a8148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.165+0000 7fd1ad4d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1a815c000 0x7fd1a80b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.165+0000 7fd1ad4d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a80cfcc0 con 0x7fd1a8072980 2024-09-11T22:20:25.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.165+0000 7fd1ad4d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a80cf9e0 con 0x7fd1a815c000 2024-09-11T22:20:25.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.165+0000 7fd1ad4d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a80b4c10 con 0x7fd1a8158f80 2024-09-11T22:20:25.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd1a6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a8072980 0x7fd1a8145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd1a6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a8072980 0x7fd1a8145160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57524/0 (socket says 172.21.15.50:57524) 2024-09-11T22:20:25.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd1a6ffd640 1 -- 172.21.15.50:0/1879303353 learned_addr learned my addr 172.21.15.50:0/1879303353 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:25.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd1a77fe640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1a815c000 0x7fd1a80b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd1a67fc640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1a8158f80 0x7fd1a8148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd1a6ffd640 1 -- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1a8158f80 msgr2=0x7fd1a8148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd1a6ffd640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1a8158f80 0x7fd1a8148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd1a6ffd640 1 -- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1a815c000 msgr2=0x7fd1a80b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd1a6ffd640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1a815c000 0x7fd1a80b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd1a6ffd640 1 -- 172.21.15.50:0/1879303353 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a8154bc0 con 0x7fd1a8072980 2024-09-11T22:20:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd1a6ffd640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a8072980 0x7fd1a8145160 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0000c00 tx=0x7fd1a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd19f7fe640 1 -- 172.21.15.50:0/1879303353 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0038040 con 0x7fd1a8072980 2024-09-11T22:20:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd19f7fe640 1 -- 172.21.15.50:0/1879303353 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a0033830 con 0x7fd1a8072980 2024-09-11T22:20:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/1879303353 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a81488b0 con 0x7fd1a8072980 2024-09-11T22:20:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd19f7fe640 1 -- 172.21.15.50:0/1879303353 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0033c20 con 0x7fd1a8072980 2024-09-11T22:20:25.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.166+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/1879303353 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a80b2b60 con 0x7fd1a8072980 2024-09-11T22:20:25.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.167+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/1879303353 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1a8072440 con 0x7fd1a8072980 2024-09-11T22:20:25.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.168+0000 7fd19f7fe640 1 -- 172.21.15.50:0/1879303353 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1a003e430 con 0x7fd1a8072980 2024-09-11T22:20:25.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.168+0000 7fd19f7fe640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd18806be30 0x7fd18806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.168+0000 7fd19f7fe640 1 -- 172.21.15.50:0/1879303353 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fd1a00ab830 con 0x7fd1a8072980 2024-09-11T22:20:25.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.168+0000 7fd1a67fc640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd18806be30 0x7fd18806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.169+0000 7fd1a67fc640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd18806be30 0x7fd18806e2f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80af9b0 tx=0x7fd190009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.173+0000 7fd19f7fe640 1 -- 172.21.15.50:0/1879303353 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1a0079cb0 con 0x7fd1a8072980 2024-09-11T22:20:25.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.390+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/1879303353 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1a80b5d30 con 0x7fd1a8072980 2024-09-11T22:20:25.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.390+0000 7fd19f7fe640 1 -- 172.21.15.50:0/1879303353 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7fd1a007dfb0 con 0x7fd1a8072980 2024-09-11T22:20:25.392 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:25.392 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:20:25.392 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:20:25.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.393+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd18806be30 msgr2=0x7fd18806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.393+0000 7fd1ad4d0640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd18806be30 0x7fd18806e2f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80af9b0 tx=0x7fd190009040 comp rx=0 tx=0).stop 2024-09-11T22:20:25.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.393+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/1879303353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a8072980 msgr2=0x7fd1a8145160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.393+0000 7fd1ad4d0640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a8072980 0x7fd1a8145160 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0000c00 tx=0x7fd1a00046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.393+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/1879303353 shutdown_connections 2024-09-11T22:20:25.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.393+0000 7fd1ad4d0640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd18806be30 0x7fd18806e2f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.393+0000 7fd1ad4d0640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1a8158f80 0x7fd1a8148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.393+0000 7fd1ad4d0640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1a815c000 0x7fd1a80b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.393+0000 7fd1ad4d0640 1 --2- 172.21.15.50:0/1879303353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1a8072980 0x7fd1a8145160 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.393+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/1879303353 >> 172.21.15.50:0/1879303353 conn(0x7fd1a806bd30 msgr2=0x7fd1a80b6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.393+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/1879303353 shutdown_connections 2024-09-11T22:20:25.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.393+0000 7fd1ad4d0640 1 -- 172.21.15.50:0/1879303353 wait complete. 2024-09-11T22:20:25.405 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-11T22:20:25.405 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:20:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.507+0000 7f29ed65c640 1 Processor -- start 2024-09-11T22:20:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.507+0000 7f29ed65c640 1 -- start start 2024-09-11T22:20:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.508+0000 7f29ed65c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e815fd80 0x7f29e80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.508+0000 7f29ed65c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f29e80af4c0 0x7f29e80b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.508+0000 7f29ed65c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e80af940 con 0x7f29e80b2970 2024-09-11T22:20:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.508+0000 7f29ed65c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f29e80afc20 con 0x7f29e80af4c0 2024-09-11T22:20:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.508+0000 7f29ed65c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f29e80aff00 con 0x7f29e815fd80 2024-09-11T22:20:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.508+0000 7f29e77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f29e80b2970 0x7f29e80d04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53198/0 (socket says 172.21.15.50:53198) 2024-09-11T22:20:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.508+0000 7f29e77fe640 1 -- 172.21.15.50:0/851307106 learned_addr learned my addr 172.21.15.50:0/851307106 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.508+0000 7f29e6ffd640 1 --2- 172.21.15.50:0/851307106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e815fd80 0x7f29e80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.508+0000 7f29e67fc640 1 --2- 172.21.15.50:0/851307106 >> v2:172.21.15.77:3300/0 conn(0x7f29e80af4c0 0x7f29e80b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.508+0000 7f29e5ffb640 1 -- 172.21.15.50:0/851307106 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4057449299 0 0) 0x7f29e80af940 con 0x7f29e80b2970 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.509+0000 7f29e5ffb640 1 -- 172.21.15.50:0/851307106 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29d0003520 con 0x7f29e80b2970 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.509+0000 7f29e6ffd640 1 -- 172.21.15.50:0/851307106 >> v2:172.21.15.77:3300/0 conn(0x7f29e80af4c0 msgr2=0x7f29e80b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.509+0000 7f29e6ffd640 1 --2- 172.21.15.50:0/851307106 >> v2:172.21.15.77:3300/0 conn(0x7f29e80af4c0 0x7f29e80b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.509+0000 7f29e6ffd640 1 -- 172.21.15.50:0/851307106 >> v1:172.21.15.50:6789/0 conn(0x7f29e80b2970 legacy=0x7f29e80d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.509+0000 7f29e5ffb640 1 -- 172.21.15.50:0/851307106 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3975848455 0 0) 0x7f29d0003520 con 0x7f29e80b2970 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.509+0000 7f29e6ffd640 1 -- 172.21.15.50:0/851307106 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e80b01e0 con 0x7f29e815fd80 2024-09-11T22:20:25.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.510+0000 7f29e6ffd640 1 --2- 172.21.15.50:0/851307106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e815fd80 0x7f29e80b1ef0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f29d80097a0 tx=0x7f29d802a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f732d89ff9904df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.510+0000 7f29e5ffb640 1 -- 172.21.15.50:0/851307106 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8037070 con 0x7f29e815fd80 2024-09-11T22:20:25.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.510+0000 7f29e5ffb640 1 -- 172.21.15.50:0/851307106 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d802ab10 con 0x7f29e815fd80 2024-09-11T22:20:25.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.510+0000 7f29e5ffb640 1 -- 172.21.15.50:0/851307106 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e00019f0 con 0x7f29e815fd80 2024-09-11T22:20:25.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.510+0000 7f29ed65c640 1 -- 172.21.15.50:0/851307106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e815fd80 msgr2=0x7f29e80b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.510+0000 7f29ed65c640 1 --2- 172.21.15.50:0/851307106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e815fd80 0x7f29e80b1ef0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f29d80097a0 tx=0x7f29d802a080 comp rx=0 tx=0).stop 2024-09-11T22:20:25.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.510+0000 7f29ed65c640 1 -- 172.21.15.50:0/851307106 shutdown_connections 2024-09-11T22:20:25.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.510+0000 7f29ed65c640 1 --2- 172.21.15.50:0/851307106 >> v2:172.21.15.77:3300/0 conn(0x7f29e80af4c0 0x7f29e80b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.510+0000 7f29ed65c640 1 --2- 172.21.15.50:0/851307106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e815fd80 0x7f29e80b1ef0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.510+0000 7f29ed65c640 1 -- 172.21.15.50:0/851307106 >> 172.21.15.50:0/851307106 conn(0x7f29e809ba50 msgr2=0x7f29e80b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.510+0000 7f29ed65c640 1 -- 172.21.15.50:0/851307106 shutdown_connections 2024-09-11T22:20:25.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.510+0000 7f29ed65c640 1 -- 172.21.15.50:0/851307106 wait complete. 2024-09-11T22:20:25.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.512+0000 7f29ed65c640 1 Processor -- start 2024-09-11T22:20:25.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.512+0000 7f29ed65c640 1 -- start start 2024-09-11T22:20:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.512+0000 7f29ed65c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e80af4c0 0x7f29e81f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.512+0000 7f29ed65c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e80b2970 0x7f29e81589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.512+0000 7f29ed65c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e815fd80 0x7f29e815d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.512+0000 7f29ed65c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29e8160160 con 0x7f29e815fd80 2024-09-11T22:20:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.512+0000 7f29ed65c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29e80b3ee0 con 0x7f29e80b2970 2024-09-11T22:20:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.512+0000 7f29ed65c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f29e81602e0 con 0x7f29e80af4c0 2024-09-11T22:20:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29e77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e815fd80 0x7f29e815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29e77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e815fd80 0x7f29e815d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57530/0 (socket says 172.21.15.50:57530) 2024-09-11T22:20:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29e77fe640 1 -- 172.21.15.50:0/3350070382 learned_addr learned my addr 172.21.15.50:0/3350070382 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29e67fc640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e80b2970 0x7f29e81589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29e6ffd640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e80af4c0 0x7f29e81f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29e77fe640 1 -- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e80af4c0 msgr2=0x7f29e81f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29e77fe640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e80af4c0 0x7f29e81f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29e77fe640 1 -- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e80b2970 msgr2=0x7f29e81589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29e77fe640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e80b2970 0x7f29e81589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29e77fe640 1 -- 172.21.15.50:0/3350070382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e815e5c0 con 0x7f29e815fd80 2024-09-11T22:20:25.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29e77fe640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e815fd80 0x7f29e815d900 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f29e000cc30 tx=0x7f29e000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29cf7fe640 1 -- 172.21.15.50:0/3350070382 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0017070 con 0x7f29e815fd80 2024-09-11T22:20:25.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29cf7fe640 1 -- 172.21.15.50:0/3350070382 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e000ce40 con 0x7f29e815fd80 2024-09-11T22:20:25.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29ed65c640 1 -- 172.21.15.50:0/3350070382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e806bc80 con 0x7f29e815fd80 2024-09-11T22:20:25.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29cf7fe640 1 -- 172.21.15.50:0/3350070382 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0012600 con 0x7f29e815fd80 2024-09-11T22:20:25.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.513+0000 7f29ed65c640 1 -- 172.21.15.50:0/3350070382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e806bf20 con 0x7f29e815fd80 2024-09-11T22:20:25.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.514+0000 7f29ed65c640 1 -- 172.21.15.50:0/3350070382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e80b1ef0 con 0x7f29e815fd80 2024-09-11T22:20:25.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.515+0000 7f29cf7fe640 1 -- 172.21.15.50:0/3350070382 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29e001a070 con 0x7f29e815fd80 2024-09-11T22:20:25.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.515+0000 7f29cf7fe640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29d406be30 0x7f29d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.515+0000 7f29cf7fe640 1 -- 172.21.15.50:0/3350070382 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f29e008ab90 con 0x7f29e815fd80 2024-09-11T22:20:25.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.515+0000 7f29e6ffd640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29d406be30 0x7f29d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.516+0000 7f29e6ffd640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29d406be30 0x7f29d406e2f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f29d8034000 tx=0x7f29d802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.519+0000 7f29cf7fe640 1 -- 172.21.15.50:0/3350070382 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29e0058f80 con 0x7f29e815fd80 2024-09-11T22:20:25.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.763+0000 7f29ed65c640 1 -- 172.21.15.50:0/3350070382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f29e80cbf00 con 0x7f29e815fd80 2024-09-11T22:20:25.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.763+0000 7f29cf7fe640 1 -- 172.21.15.50:0/3350070382 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f29e005d280 con 0x7f29e815fd80 2024-09-11T22:20:25.764 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:25.765 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":574,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076147270,"bytes_used":2600255488,"bytes_avail":770493857792,"bytes_total":773094113280,"write_bytes_sec":64983551,"read_op_per_sec":0,"write_op_per_sec":63},"fsmap":{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8907}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-11T22:20:21.496687+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:20:25.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.766+0000 7f29ed65c640 1 -- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29d406be30 msgr2=0x7f29d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.766+0000 7f29ed65c640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29d406be30 0x7f29d406e2f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f29d8034000 tx=0x7f29d802e000 comp rx=0 tx=0).stop 2024-09-11T22:20:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.766+0000 7f29ed65c640 1 -- 172.21.15.50:0/3350070382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e815fd80 msgr2=0x7f29e815d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.766+0000 7f29ed65c640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e815fd80 0x7f29e815d900 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f29e000cc30 tx=0x7f29e000a430 comp rx=0 tx=0).stop 2024-09-11T22:20:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.766+0000 7f29ed65c640 1 -- 172.21.15.50:0/3350070382 shutdown_connections 2024-09-11T22:20:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.766+0000 7f29ed65c640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29d406be30 0x7f29d406e2f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.766+0000 7f29ed65c640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e815fd80 0x7f29e815d900 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.766+0000 7f29ed65c640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e80b2970 0x7f29e81589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.766+0000 7f29ed65c640 1 --2- 172.21.15.50:0/3350070382 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e80af4c0 0x7f29e81f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.766+0000 7f29ed65c640 1 -- 172.21.15.50:0/3350070382 >> 172.21.15.50:0/3350070382 conn(0x7f29e809ba50 msgr2=0x7f29e80c9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.766+0000 7f29ed65c640 1 -- 172.21.15.50:0/3350070382 shutdown_connections 2024-09-11T22:20:25.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:25.766+0000 7f29ed65c640 1 -- 172.21.15.50:0/3350070382 wait complete. 2024-09-11T22:20:25.778 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-11T22:20:26.778 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:26.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.894+0000 7f70b57d6640 1 Processor -- start 2024-09-11T22:20:26.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.895+0000 7f70b57d6640 1 -- start start 2024-09-11T22:20:26.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.895+0000 7f70b57d6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 0x7f70b00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:26.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.895+0000 7f70b57d6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f70b00d3a30 0x7f70b00b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:26.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.895+0000 7f70b57d6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70b00cfa80 con 0x7f70b015e870 2024-09-11T22:20:26.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.895+0000 7f70b57d6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f70b00d3ea0 con 0x7f70b00d3a30 2024-09-11T22:20:26.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.895+0000 7f70b57d6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f70b00d40d0 con 0x7f70b00d18a0 2024-09-11T22:20:26.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.896+0000 7f70af7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f70b00d3a30 0x7f70b00b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:26.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.896+0000 7f70ae7fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 0x7f70b00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:26.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.896+0000 7f70aeffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f70b015e870 0x7f70b00d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:34822/0 (socket says 172.21.15.50:34822) 2024-09-11T22:20:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.896+0000 7f70aeffd640 1 -- 172.21.15.50:0/3786558353 learned_addr learned my addr 172.21.15.50:0/3786558353 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.896+0000 7f70ae7fc640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 0x7f70b00d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:37828/0 (socket says 172.21.15.50:37828) 2024-09-11T22:20:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.896+0000 7f70af7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f70b00d3a30 0x7f70b00b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:57450/0 (socket says 172.21.15.50:57450) 2024-09-11T22:20:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.896+0000 7f70ae7fc640 1 -- 172.21.15.50:0/3786558353 >> v2:172.21.15.77:3300/0 conn(0x7f70b00d3a30 msgr2=0x7f70b00b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.896+0000 7f70ae7fc640 1 --2- 172.21.15.50:0/3786558353 >> v2:172.21.15.77:3300/0 conn(0x7f70b00d3a30 0x7f70b00b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.896+0000 7f70ae7fc640 1 -- 172.21.15.50:0/3786558353 >> v1:172.21.15.77:6789/0 conn(0x7f70b015e870 legacy=0x7f70b00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.896+0000 7f70ae7fc640 1 -- 172.21.15.50:0/3786558353 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b00d43b0 con 0x7f70b00d18a0 2024-09-11T22:20:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.896+0000 7f70af7fe640 1 --2- 172.21.15.50:0/3786558353 >> v2:172.21.15.77:3300/0 conn(0x7f70b00d3a30 0x7f70b00b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:26.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.897+0000 7f70ae7fc640 1 --2- 172.21.15.50:0/3786558353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 0x7f70b00d34f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f70980097a0 tx=0x7f709802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab1e6b7907ccb8b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:26.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.897+0000 7f70adffb640 1 -- 172.21.15.50:0/3786558353 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098037070 con 0x7f70b00d18a0 2024-09-11T22:20:26.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.897+0000 7f70adffb640 1 -- 172.21.15.50:0/3786558353 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7098032440 con 0x7f70b00d18a0 2024-09-11T22:20:26.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.897+0000 7f70adffb640 1 -- 172.21.15.50:0/3786558353 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098032810 con 0x7f70b00d18a0 2024-09-11T22:20:26.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.898+0000 7f70b57d6640 1 -- 172.21.15.50:0/3786558353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 msgr2=0x7f70b00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:26.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.898+0000 7f70b57d6640 1 --2- 172.21.15.50:0/3786558353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 0x7f70b00d34f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f70980097a0 tx=0x7f709802a180 comp rx=0 tx=0).stop 2024-09-11T22:20:26.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.898+0000 7f70b57d6640 1 -- 172.21.15.50:0/3786558353 shutdown_connections 2024-09-11T22:20:26.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.898+0000 7f70b57d6640 1 --2- 172.21.15.50:0/3786558353 >> v2:172.21.15.77:3300/0 conn(0x7f70b00d3a30 0x7f70b00b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.898+0000 7f70b57d6640 1 --2- 172.21.15.50:0/3786558353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 0x7f70b00d34f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.898+0000 7f70b57d6640 1 -- 172.21.15.50:0/3786558353 >> 172.21.15.50:0/3786558353 conn(0x7f70b00727a0 msgr2=0x7f70b00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:26.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.898+0000 7f70b57d6640 1 -- 172.21.15.50:0/3786558353 shutdown_connections 2024-09-11T22:20:26.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.898+0000 7f70b57d6640 1 -- 172.21.15.50:0/3786558353 wait complete. 2024-09-11T22:20:26.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.899+0000 7f70b57d6640 1 Processor -- start 2024-09-11T22:20:26.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.900+0000 7f70b57d6640 1 -- start start 2024-09-11T22:20:26.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.900+0000 7f70b57d6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 0x7f70b0154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:26.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.900+0000 7f70b57d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b00d3a30 0x7f70b00ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:26.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.900+0000 7f70b57d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b015e870 0x7f70b00aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:26.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.900+0000 7f70b57d6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f70b015ec50 con 0x7f70b015e870 2024-09-11T22:20:26.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.900+0000 7f70b57d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70b00b7ee0 con 0x7f70b00d3a30 2024-09-11T22:20:26.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.900+0000 7f70b57d6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f70b00b78b0 con 0x7f70b00d18a0 2024-09-11T22:20:26.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.900+0000 7f70aeffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 0x7f70b0154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:26.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.900+0000 7f70af7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b015e870 0x7f70b00aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:26.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.900+0000 7f70aeffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 0x7f70b0154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:37844/0 (socket says 172.21.15.50:37844) 2024-09-11T22:20:26.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.900+0000 7f70aeffd640 1 -- 172.21.15.50:0/2184422131 learned_addr learned my addr 172.21.15.50:0/2184422131 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:26.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.900+0000 7f70ae7fc640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b00d3a30 0x7f70b00ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:26.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.901+0000 7f70aeffd640 1 -- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b00d3a30 msgr2=0x7f70b00ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:26.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.901+0000 7f70aeffd640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b00d3a30 0x7f70b00ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.901+0000 7f70aeffd640 1 -- 172.21.15.50:0/2184422131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b015e870 msgr2=0x7f70b00aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:26.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.901+0000 7f70aeffd640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b015e870 0x7f70b00aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.901+0000 7f70aeffd640 1 -- 172.21.15.50:0/2184422131 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b00ce8f0 con 0x7f70b00d18a0 2024-09-11T22:20:26.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.901+0000 7f70af7fe640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b015e870 0x7f70b00aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:26.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.901+0000 7f70aeffd640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 0x7f70b0154bb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c400 tx=0x7f70a000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:26.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.901+0000 7f70a77fe640 1 -- 172.21.15.50:0/2184422131 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0017070 con 0x7f70b00d18a0 2024-09-11T22:20:26.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.901+0000 7f70a77fe640 1 -- 172.21.15.50:0/2184422131 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a0005ce0 con 0x7f70b00d18a0 2024-09-11T22:20:26.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.901+0000 7f70b57d6640 1 -- 172.21.15.50:0/2184422131 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b00ac410 con 0x7f70b00d18a0 2024-09-11T22:20:26.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.901+0000 7f70a77fe640 1 -- 172.21.15.50:0/2184422131 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a00072f0 con 0x7f70b00d18a0 2024-09-11T22:20:26.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.901+0000 7f70b57d6640 1 -- 172.21.15.50:0/2184422131 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b00ac9d0 con 0x7f70b00d18a0 2024-09-11T22:20:26.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.902+0000 7f70b57d6640 1 -- 172.21.15.50:0/2184422131 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b00d34f0 con 0x7f70b00d18a0 2024-09-11T22:20:26.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.903+0000 7f70a77fe640 1 -- 172.21.15.50:0/2184422131 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70a001a070 con 0x7f70b00d18a0 2024-09-11T22:20:26.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.903+0000 7f70a77fe640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f709006be60 0x7f709006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:26.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.904+0000 7f70a77fe640 1 -- 172.21.15.50:0/2184422131 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f70a008a1c0 con 0x7f70b00d18a0 2024-09-11T22:20:26.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.904+0000 7f70ae7fc640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f709006be60 0x7f709006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:26.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.904+0000 7f70ae7fc640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f709006be60 0x7f709006e320 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7098034000 tx=0x7f709802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:26.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:26.908+0000 7f70a77fe640 1 -- 172.21.15.50:0/2184422131 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70b00cfa80 con 0x7f70b00d18a0 2024-09-11T22:20:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.118+0000 7f70b57d6640 1 -- 172.21.15.50:0/2184422131 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70b00b3d60 con 0x7f70b00d18a0 2024-09-11T22:20:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.119+0000 7f70a77fe640 1 -- 172.21.15.50:0/2184422131 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7f70a0058440 con 0x7f70b00d18a0 2024-09-11T22:20:27.120 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:27.120 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:20:27.121 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:20:27.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.121+0000 7f70b57d6640 1 -- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f709006be60 msgr2=0x7f709006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.121+0000 7f70b57d6640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f709006be60 0x7f709006e320 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7098034000 tx=0x7f709802e000 comp rx=0 tx=0).stop 2024-09-11T22:20:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.121+0000 7f70b57d6640 1 -- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 msgr2=0x7f70b0154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.121+0000 7f70b57d6640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 0x7f70b0154bb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c400 tx=0x7f70a000c800 comp rx=0 tx=0).stop 2024-09-11T22:20:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.122+0000 7f70b57d6640 1 -- 172.21.15.50:0/2184422131 shutdown_connections 2024-09-11T22:20:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.122+0000 7f70b57d6640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f709006be60 0x7f709006e320 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.122+0000 7f70b57d6640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70b015e870 0x7f70b00aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.122+0000 7f70b57d6640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b00d3a30 0x7f70b00ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.122+0000 7f70b57d6640 1 --2- 172.21.15.50:0/2184422131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70b00d18a0 0x7f70b0154bb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.122+0000 7f70b57d6640 1 -- 172.21.15.50:0/2184422131 >> 172.21.15.50:0/2184422131 conn(0x7f70b00727a0 msgr2=0x7f70b015ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.122+0000 7f70b57d6640 1 -- 172.21.15.50:0/2184422131 shutdown_connections 2024-09-11T22:20:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.122+0000 7f70b57d6640 1 -- 172.21.15.50:0/2184422131 wait complete. 2024-09-11T22:20:27.133 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-11T22:20:27.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:20:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.233+0000 7f3890ae6640 1 Processor -- start 2024-09-11T22:20:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.233+0000 7f3890ae6640 1 -- start start 2024-09-11T22:20:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.234+0000 7f3890ae6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f388c0b1600 0x7f388c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.234+0000 7f3890ae6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f388c0cfbd0 con 0x7f388c0cf610 2024-09-11T22:20:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.234+0000 7f3890ae6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f388c0cfeb0 con 0x7f388c161fa0 2024-09-11T22:20:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.234+0000 7f3890ae6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f388c0d1220 con 0x7f388c0b1600 2024-09-11T22:20:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f3889d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f388c0cf610 0x7f388c0cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53208/0 (socket says 172.21.15.50:53208) 2024-09-11T22:20:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f3889d9b640 1 -- 172.21.15.50:0/4125978505 learned_addr learned my addr 172.21.15.50:0/4125978505 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1183110375 0 0) 0x7f388c0cfbd0 con 0x7f388c0cf610 2024-09-11T22:20:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388ad9d640 1 --2- 172.21.15.50:0/4125978505 >> v2:172.21.15.77:3300/0 conn(0x7f388c0b1600 0x7f388c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3874003520 con 0x7f388c0cf610 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3683008343 0 0) 0x7f3874003520 con 0x7f388c0cf610 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 >> v2:172.21.15.77:3300/0 conn(0x7f388c0b1600 msgr2=0x7f388c0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 --2- 172.21.15.50:0/4125978505 >> v2:172.21.15.77:3300/0 conn(0x7f388c0b1600 0x7f388c0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 >> v1:172.21.15.77:6789/0 conn(0x7f388c161fa0 legacy=0x7f388c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c0d1470 con 0x7f388c0cf610 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f3880001670 con 0x7f388c0cf610 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 >> v1:172.21.15.50:6789/0 conn(0x7f388c0cf610 legacy=0x7f388c0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 --2- 172.21.15.50:0/4125978505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38740039b0 0x7f3874003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 --2- 172.21.15.50:0/4125978505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3874004800 0x7f3874004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 --2- 172.21.15.50:0/4125978505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38740051c0 0x7f387400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f388c0d1220 con 0x7f38740039b0 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f387400c060 con 0x7f3874004800 2024-09-11T22:20:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f387400c260 con 0x7f38740051c0 2024-09-11T22:20:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f388a59c640 1 --2- 172.21.15.50:0/4125978505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38740039b0 0x7f3874003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.235+0000 7f3889d9b640 1 --2- 172.21.15.50:0/4125978505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3874004800 0x7f3874004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.236+0000 7f388ad9d640 1 --2- 172.21.15.50:0/4125978505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38740051c0 0x7f387400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.236+0000 7f388a59c640 1 -- 172.21.15.50:0/4125978505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38740051c0 msgr2=0x7f387400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.236+0000 7f388a59c640 1 --2- 172.21.15.50:0/4125978505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38740051c0 0x7f387400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.236+0000 7f388a59c640 1 -- 172.21.15.50:0/4125978505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3874004800 msgr2=0x7f3874004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.236+0000 7f388a59c640 1 --2- 172.21.15.50:0/4125978505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3874004800 0x7f3874004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.236+0000 7f388a59c640 1 -- 172.21.15.50:0/4125978505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3874003520 con 0x7f38740039b0 2024-09-11T22:20:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.236+0000 7f388ad9d640 1 -- 172.21.15.50:0/4125978505 reap_dead start 2024-09-11T22:20:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.236+0000 7f388a59c640 1 --2- 172.21.15.50:0/4125978505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38740039b0 0x7f3874003dd0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f387c001750 tx=0x7f3874005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8410395c7a0d3d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.237+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c001370 con 0x7f38740039b0 2024-09-11T22:20:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.237+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c0052d0 con 0x7f38740039b0 2024-09-11T22:20:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.237+0000 7f388959a640 1 -- 172.21.15.50:0/4125978505 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c02abe0 con 0x7f38740039b0 2024-09-11T22:20:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.237+0000 7f3890ae6640 1 -- 172.21.15.50:0/4125978505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38740039b0 msgr2=0x7f3874003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.237+0000 7f3890ae6640 1 --2- 172.21.15.50:0/4125978505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38740039b0 0x7f3874003dd0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f387c001750 tx=0x7f3874005830 comp rx=0 tx=0).stop 2024-09-11T22:20:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.237+0000 7f3890ae6640 1 -- 172.21.15.50:0/4125978505 shutdown_connections 2024-09-11T22:20:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.237+0000 7f3890ae6640 1 --2- 172.21.15.50:0/4125978505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38740039b0 0x7f3874003dd0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.237+0000 7f3890ae6640 1 -- 172.21.15.50:0/4125978505 >> 172.21.15.50:0/4125978505 conn(0x7f388c09ba50 msgr2=0x7f388c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.237+0000 7f3890ae6640 1 -- 172.21.15.50:0/4125978505 shutdown_connections 2024-09-11T22:20:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.237+0000 7f3890ae6640 1 -- 172.21.15.50:0/4125978505 wait complete. 2024-09-11T22:20:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.239+0000 7f3890ae6640 1 Processor -- start 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.239+0000 7f3890ae6640 1 -- start start 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.239+0000 7f3890ae6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38740039b0 0x7f388c15d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.239+0000 7f3890ae6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c154500 0x7f388c153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.239+0000 7f3890ae6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f388c0b31c0 0x7f388c0b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.239+0000 7f3890ae6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f388c0d1c70 con 0x7f388c154500 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.239+0000 7f3890ae6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f388c0d17e0 con 0x7f388c0b31c0 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.239+0000 7f3890ae6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f388c0d1df0 con 0x7f38740039b0 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.239+0000 7f3889d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c154500 0x7f388c153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.239+0000 7f3889d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c154500 0x7f388c153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57550/0 (socket says 172.21.15.50:57550) 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.239+0000 7f3889d9b640 1 -- 172.21.15.50:0/3154018114 learned_addr learned my addr 172.21.15.50:0/3154018114 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.239+0000 7f388a59c640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38740039b0 0x7f388c15d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.240+0000 7f388ad9d640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f388c0b31c0 0x7f388c0b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.240+0000 7f3889d9b640 1 -- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38740039b0 msgr2=0x7f388c15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.240+0000 7f3889d9b640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38740039b0 0x7f388c15d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.240+0000 7f3889d9b640 1 -- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f388c0b31c0 msgr2=0x7f388c0b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.240+0000 7f3889d9b640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f388c0b31c0 0x7f388c0b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.240+0000 7f3889d9b640 1 -- 172.21.15.50:0/3154018114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c15de80 con 0x7f388c154500 2024-09-11T22:20:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.240+0000 7f3889d9b640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c154500 0x7f388c153cc0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f38800072c0 tx=0x7f3880007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.240+0000 7f387affd640 1 -- 172.21.15.50:0/3154018114 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880001660 con 0x7f388c154500 2024-09-11T22:20:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.240+0000 7f387affd640 1 -- 172.21.15.50:0/3154018114 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3880018070 con 0x7f388c154500 2024-09-11T22:20:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.240+0000 7f3890ae6640 1 -- 172.21.15.50:0/3154018114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388c15e100 con 0x7f388c154500 2024-09-11T22:20:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.240+0000 7f387affd640 1 -- 172.21.15.50:0/3154018114 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388000fb80 con 0x7f388c154500 2024-09-11T22:20:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.240+0000 7f3890ae6640 1 -- 172.21.15.50:0/3154018114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f388c0c63b0 con 0x7f388c154500 2024-09-11T22:20:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.241+0000 7f3890ae6640 1 -- 172.21.15.50:0/3154018114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f388c0b4d20 con 0x7f388c154500 2024-09-11T22:20:27.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.242+0000 7f387affd640 1 -- 172.21.15.50:0/3154018114 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f388000fd20 con 0x7f388c154500 2024-09-11T22:20:27.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.242+0000 7f387affd640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f386c06c000 0x7f386c06e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.242+0000 7f387affd640 1 -- 172.21.15.50:0/3154018114 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f388008ad20 con 0x7f388c154500 2024-09-11T22:20:27.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.242+0000 7f388a59c640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f386c06c000 0x7f386c06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.243+0000 7f388a59c640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f386c06c000 0x7f386c06e4c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f387c032000 tx=0x7f387c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:27.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.246+0000 7f387affd640 1 -- 172.21.15.50:0/3154018114 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f388c15de80 con 0x7f388c154500 2024-09-11T22:20:27.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.489+0000 7f3890ae6640 1 -- 172.21.15.50:0/3154018114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f388c070c50 con 0x7f388c154500 2024-09-11T22:20:27.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.490+0000 7f387affd640 1 -- 172.21.15.50:0/3154018114 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f3880059080 con 0x7f388c154500 2024-09-11T22:20:27.491 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:27.491 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":576,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076563554,"bytes_used":2600673280,"bytes_avail":770493440000,"bytes_total":773094113280,"write_bytes_sec":57855060,"read_op_per_sec":0,"write_op_per_sec":57},"fsmap":{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8907}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-11T22:20:21.496687+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:20:27.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.492+0000 7f3890ae6640 1 -- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f386c06c000 msgr2=0x7f386c06e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.492+0000 7f3890ae6640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f386c06c000 0x7f386c06e4c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f387c032000 tx=0x7f387c02e000 comp rx=0 tx=0).stop 2024-09-11T22:20:27.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.492+0000 7f3890ae6640 1 -- 172.21.15.50:0/3154018114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c154500 msgr2=0x7f388c153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.492+0000 7f3890ae6640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c154500 0x7f388c153cc0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f38800072c0 tx=0x7f3880007780 comp rx=0 tx=0).stop 2024-09-11T22:20:27.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.492+0000 7f3890ae6640 1 -- 172.21.15.50:0/3154018114 shutdown_connections 2024-09-11T22:20:27.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.492+0000 7f3890ae6640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f386c06c000 0x7f386c06e4c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.492+0000 7f3890ae6640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f388c0b31c0 0x7f388c0b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.492+0000 7f3890ae6640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388c154500 0x7f388c153cc0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.492+0000 7f3890ae6640 1 --2- 172.21.15.50:0/3154018114 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38740039b0 0x7f388c15d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.492+0000 7f3890ae6640 1 -- 172.21.15.50:0/3154018114 >> 172.21.15.50:0/3154018114 conn(0x7f388c09ba50 msgr2=0x7f388c0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:27.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.492+0000 7f3890ae6640 1 -- 172.21.15.50:0/3154018114 shutdown_connections 2024-09-11T22:20:27.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:27.492+0000 7f3890ae6640 1 -- 172.21.15.50:0/3154018114 wait complete. 2024-09-11T22:20:27.504 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-11T22:20:28.505 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.620+0000 7fd5fffe8640 1 Processor -- start 2024-09-11T22:20:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.620+0000 7fd5fffe8640 1 -- start start 2024-09-11T22:20:28.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.621+0000 7fd5fffe8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5f815e8e0 0x7fd5f80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.621+0000 7fd5fffe8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5f80d1580 0x7fd5f80d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.621+0000 7fd5fffe8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f80d1ee0 con 0x7fd5f8162350 2024-09-11T22:20:28.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.621+0000 7fd5fffe8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f815ecc0 con 0x7fd5f815e8e0 2024-09-11T22:20:28.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.621+0000 7fd5fffe8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f80d2ad0 con 0x7fd5f80d1580 2024-09-11T22:20:28.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.621+0000 7fd5fdd84640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5f815e8e0 0x7fd5f80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:28.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.621+0000 7fd5fdd84640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5f815e8e0 0x7fd5f80b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55596/0 (socket says 172.21.15.50:55596) 2024-09-11T22:20:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.621+0000 7fd5fdd84640 1 -- 172.21.15.50:0/1307674894 learned_addr learned my addr 172.21.15.50:0/1307674894 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.621+0000 7fd5fd583640 1 --2- 172.21.15.50:0/1307674894 >> v2:172.21.15.77:3300/0 conn(0x7fd5f80d1580 0x7fd5f80d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.621+0000 7fd5fdd84640 1 -- 172.21.15.50:0/1307674894 >> v2:172.21.15.77:3300/0 conn(0x7fd5f80d1580 msgr2=0x7fd5f80d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.622+0000 7fd5fdd84640 1 --2- 172.21.15.50:0/1307674894 >> v2:172.21.15.77:3300/0 conn(0x7fd5f80d1580 0x7fd5f80d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.622+0000 7fd5fdd84640 1 -- 172.21.15.50:0/1307674894 >> v1:172.21.15.77:6789/0 conn(0x7fd5f8162350 legacy=0x7fd5f81627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.622+0000 7fd5fdd84640 1 -- 172.21.15.50:0/1307674894 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f8163080 con 0x7fd5f815e8e0 2024-09-11T22:20:28.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.622+0000 7fd5fdd84640 1 --2- 172.21.15.50:0/1307674894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f815e8e0 0x7fd5f80b7880 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fd5f81622b0 tx=0x7fd5f402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd70086656b254c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:28.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.622+0000 7fd5fcd82640 1 -- 172.21.15.50:0/1307674894 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4037070 con 0x7fd5f815e8e0 2024-09-11T22:20:28.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.622+0000 7fd5fcd82640 1 -- 172.21.15.50:0/1307674894 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f402ae50 con 0x7fd5f815e8e0 2024-09-11T22:20:28.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.622+0000 7fd5fcd82640 1 -- 172.21.15.50:0/1307674894 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4032860 con 0x7fd5f815e8e0 2024-09-11T22:20:28.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.623+0000 7fd5fffe8640 1 -- 172.21.15.50:0/1307674894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f815e8e0 msgr2=0x7fd5f80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:28.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.623+0000 7fd5fffe8640 1 --2- 172.21.15.50:0/1307674894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f815e8e0 0x7fd5f80b7880 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fd5f81622b0 tx=0x7fd5f402a300 comp rx=0 tx=0).stop 2024-09-11T22:20:28.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.623+0000 7fd5fffe8640 1 -- 172.21.15.50:0/1307674894 shutdown_connections 2024-09-11T22:20:28.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.623+0000 7fd5fffe8640 1 --2- 172.21.15.50:0/1307674894 >> v2:172.21.15.77:3300/0 conn(0x7fd5f80d1580 0x7fd5f80d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.623+0000 7fd5fffe8640 1 --2- 172.21.15.50:0/1307674894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f815e8e0 0x7fd5f80b7880 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.623+0000 7fd5fffe8640 1 -- 172.21.15.50:0/1307674894 >> 172.21.15.50:0/1307674894 conn(0x7fd5f8067ba0 msgr2=0x7fd5f8067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:28.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.623+0000 7fd5fffe8640 1 -- 172.21.15.50:0/1307674894 shutdown_connections 2024-09-11T22:20:28.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.623+0000 7fd5fffe8640 1 -- 172.21.15.50:0/1307674894 wait complete. 2024-09-11T22:20:28.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.624+0000 7fd5fffe8640 1 Processor -- start 2024-09-11T22:20:28.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.624+0000 7fd5fffe8640 1 -- start start 2024-09-11T22:20:28.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.625+0000 7fd5fffe8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f80d1580 0x7fd5f814eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.625+0000 7fd5fffe8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815e8e0 0x7fd5f80cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.625+0000 7fd5fffe8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8162350 0x7fd5f80cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.625+0000 7fd5fffe8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f80d3000 con 0x7fd5f8162350 2024-09-11T22:20:28.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.625+0000 7fd5fffe8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f80d3370 con 0x7fd5f80d1580 2024-09-11T22:20:28.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.625+0000 7fd5fffe8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f80d3800 con 0x7fd5f815e8e0 2024-09-11T22:20:28.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.625+0000 7fd5fe585640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8162350 0x7fd5f80cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:28.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.625+0000 7fd5fe585640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8162350 0x7fd5f80cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55598/0 (socket says 172.21.15.50:55598) 2024-09-11T22:20:28.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.625+0000 7fd5fe585640 1 -- 172.21.15.50:0/3249202450 learned_addr learned my addr 172.21.15.50:0/3249202450 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.625+0000 7fd5fdd84640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f80d1580 0x7fd5f814eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.625+0000 7fd5fd583640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815e8e0 0x7fd5f80cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.626+0000 7fd5fe585640 1 -- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815e8e0 msgr2=0x7fd5f80cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.626+0000 7fd5fe585640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815e8e0 0x7fd5f80cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.626+0000 7fd5fe585640 1 -- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f80d1580 msgr2=0x7fd5f814eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.626+0000 7fd5fe585640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f80d1580 0x7fd5f814eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.626+0000 7fd5fe585640 1 -- 172.21.15.50:0/3249202450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f80cc460 con 0x7fd5f8162350 2024-09-11T22:20:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.626+0000 7fd5fe585640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8162350 0x7fd5f80cbe00 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000c730 tx=0x7fd5f000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.626+0000 7fd5ee7fc640 1 -- 172.21.15.50:0/3249202450 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0016020 con 0x7fd5f8162350 2024-09-11T22:20:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.626+0000 7fd5ee7fc640 1 -- 172.21.15.50:0/3249202450 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f0006d50 con 0x7fd5f8162350 2024-09-11T22:20:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.626+0000 7fd5fffe8640 1 -- 172.21.15.50:0/3249202450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f80cc740 con 0x7fd5f8162350 2024-09-11T22:20:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.626+0000 7fd5ee7fc640 1 -- 172.21.15.50:0/3249202450 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0003bb0 con 0x7fd5f8162350 2024-09-11T22:20:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.626+0000 7fd5fffe8640 1 -- 172.21.15.50:0/3249202450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f814f040 con 0x7fd5f8162350 2024-09-11T22:20:28.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.627+0000 7fd5fffe8640 1 -- 172.21.15.50:0/3249202450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f80d19a0 con 0x7fd5f8162350 2024-09-11T22:20:28.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.628+0000 7fd5ee7fc640 1 -- 172.21.15.50:0/3249202450 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5f00050d0 con 0x7fd5f8162350 2024-09-11T22:20:28.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.628+0000 7fd5ee7fc640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5dc06be60 0x7fd5dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.628+0000 7fd5ee7fc640 1 -- 172.21.15.50:0/3249202450 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fd5f008a8b0 con 0x7fd5f8162350 2024-09-11T22:20:28.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.628+0000 7fd5fdd84640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5dc06be60 0x7fd5dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:28.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.629+0000 7fd5fdd84640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5dc06be60 0x7fd5dc06e320 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4034000 tx=0x7fd5f402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:28.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.632+0000 7fd5ee7fc640 1 -- 172.21.15.50:0/3249202450 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5f0020020 con 0x7fd5f8162350 2024-09-11T22:20:28.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.843+0000 7fd5fffe8640 1 -- 172.21.15.50:0/3249202450 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5f80ba770 con 0x7fd5f8162350 2024-09-11T22:20:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.844+0000 7fd5ee7fc640 1 -- 172.21.15.50:0/3249202450 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7fd5f0058ca0 con 0x7fd5f8162350 2024-09-11T22:20:28.846 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:28.846 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:20:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:20:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.846+0000 7fd5fffe8640 1 -- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5dc06be60 msgr2=0x7fd5dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.846+0000 7fd5fffe8640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5dc06be60 0x7fd5dc06e320 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4034000 tx=0x7fd5f402e000 comp rx=0 tx=0).stop 2024-09-11T22:20:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.846+0000 7fd5fffe8640 1 -- 172.21.15.50:0/3249202450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8162350 msgr2=0x7fd5f80cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:28.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.846+0000 7fd5fffe8640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8162350 0x7fd5f80cbe00 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000c730 tx=0x7fd5f000cb30 comp rx=0 tx=0).stop 2024-09-11T22:20:28.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.846+0000 7fd5fffe8640 1 -- 172.21.15.50:0/3249202450 shutdown_connections 2024-09-11T22:20:28.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.846+0000 7fd5fffe8640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5dc06be60 0x7fd5dc06e320 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.846+0000 7fd5fffe8640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815e8e0 0x7fd5f80cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.846+0000 7fd5fffe8640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f8162350 0x7fd5f80cbe00 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.846+0000 7fd5fffe8640 1 --2- 172.21.15.50:0/3249202450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f80d1580 0x7fd5f814eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.846+0000 7fd5fffe8640 1 -- 172.21.15.50:0/3249202450 >> 172.21.15.50:0/3249202450 conn(0x7fd5f8067ba0 msgr2=0x7fd5f815f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:28.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.846+0000 7fd5fffe8640 1 -- 172.21.15.50:0/3249202450 shutdown_connections 2024-09-11T22:20:28.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.846+0000 7fd5fffe8640 1 -- 172.21.15.50:0/3249202450 wait complete. 2024-09-11T22:20:28.857 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-11T22:20:28.858 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:20:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.958+0000 7f59018a5640 1 Processor -- start 2024-09-11T22:20:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.958+0000 7f59018a5640 1 -- start start 2024-09-11T22:20:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.959+0000 7f59018a5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58fc15e8e0 0x7f58fc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.959+0000 7f59018a5640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58fc0d1580 0x7f58fc0d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.959+0000 7f59018a5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58fc0d1ee0 con 0x7f58fc162350 2024-09-11T22:20:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.959+0000 7f59018a5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f58fc15ecc0 con 0x7f58fc15e8e0 2024-09-11T22:20:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.959+0000 7f59018a5640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f58fc0d2ad0 con 0x7f58fc0d1580 2024-09-11T22:20:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.959+0000 7f58faffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58fc15e8e0 0x7f58fc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.959+0000 7f58fb7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f58fc162350 0x7f58fc162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43092/0 (socket says 172.21.15.50:43092) 2024-09-11T22:20:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.959+0000 7f58fb7fe640 1 -- 172.21.15.50:0/3211989892 learned_addr learned my addr 172.21.15.50:0/3211989892 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.959+0000 7f58fa7fc640 1 --2- 172.21.15.50:0/3211989892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58fc0d1580 0x7f58fc0d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.959+0000 7f58faffd640 1 -- 172.21.15.50:0/3211989892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58fc0d1580 msgr2=0x7f58fc0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.959+0000 7f58faffd640 1 --2- 172.21.15.50:0/3211989892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58fc0d1580 0x7f58fc0d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.959+0000 7f58faffd640 1 -- 172.21.15.50:0/3211989892 >> v1:172.21.15.50:6789/0 conn(0x7f58fc162350 legacy=0x7f58fc162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.959+0000 7f58faffd640 1 -- 172.21.15.50:0/3211989892 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58fc163080 con 0x7f58fc15e8e0 2024-09-11T22:20:28.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.960+0000 7f58faffd640 1 --2- 172.21.15.50:0/3211989892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58fc15e8e0 0x7f58fc0b7880 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0097a0 tx=0x7f58ec02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad8ea3a829377da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:28.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.960+0000 7f58f9ffb640 1 -- 172.21.15.50:0/3211989892 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec037070 con 0x7f58fc15e8e0 2024-09-11T22:20:28.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.960+0000 7f58f9ffb640 1 -- 172.21.15.50:0/3211989892 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ec032440 con 0x7f58fc15e8e0 2024-09-11T22:20:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.960+0000 7f58f9ffb640 1 -- 172.21.15.50:0/3211989892 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec032810 con 0x7f58fc15e8e0 2024-09-11T22:20:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.961+0000 7f59018a5640 1 -- 172.21.15.50:0/3211989892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58fc15e8e0 msgr2=0x7f58fc0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.961+0000 7f59018a5640 1 --2- 172.21.15.50:0/3211989892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58fc15e8e0 0x7f58fc0b7880 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0097a0 tx=0x7f58ec02a210 comp rx=0 tx=0).stop 2024-09-11T22:20:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.961+0000 7f59018a5640 1 -- 172.21.15.50:0/3211989892 shutdown_connections 2024-09-11T22:20:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.961+0000 7f59018a5640 1 --2- 172.21.15.50:0/3211989892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58fc0d1580 0x7f58fc0d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.961+0000 7f59018a5640 1 --2- 172.21.15.50:0/3211989892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58fc15e8e0 0x7f58fc0b7880 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.961+0000 7f59018a5640 1 -- 172.21.15.50:0/3211989892 >> 172.21.15.50:0/3211989892 conn(0x7f58fc067ba0 msgr2=0x7f58fc067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.961+0000 7f59018a5640 1 -- 172.21.15.50:0/3211989892 shutdown_connections 2024-09-11T22:20:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.961+0000 7f59018a5640 1 -- 172.21.15.50:0/3211989892 wait complete. 2024-09-11T22:20:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.962+0000 7f59018a5640 1 Processor -- start 2024-09-11T22:20:28.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.962+0000 7f59018a5640 1 -- start start 2024-09-11T22:20:28.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f59018a5640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58fc0d1580 0x7f58fc0ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f59018a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58fc15e8e0 0x7f58fc14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f59018a5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58fc162350 0x7f58fc14f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f59018a5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc0d3000 con 0x7f58fc162350 2024-09-11T22:20:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f59018a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc0d3370 con 0x7f58fc15e8e0 2024-09-11T22:20:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f59018a5640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f58fc0d3800 con 0x7f58fc0d1580 2024-09-11T22:20:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f58fb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58fc162350 0x7f58fc14f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f58fb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58fc162350 0x7f58fc14f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55612/0 (socket says 172.21.15.50:55612) 2024-09-11T22:20:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f58fb7fe640 1 -- 172.21.15.50:0/2452780282 learned_addr learned my addr 172.21.15.50:0/2452780282 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f58fb7fe640 1 -- 172.21.15.50:0/2452780282 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58fc0d1580 msgr2=0x7f58fc0ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f58fb7fe640 1 --2- 172.21.15.50:0/2452780282 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58fc0d1580 0x7f58fc0ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f58fb7fe640 1 -- 172.21.15.50:0/2452780282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58fc15e8e0 msgr2=0x7f58fc14ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f58fb7fe640 1 --2- 172.21.15.50:0/2452780282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58fc15e8e0 0x7f58fc14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f58fb7fe640 1 -- 172.21.15.50:0/2452780282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58fc14f170 con 0x7f58fc162350 2024-09-11T22:20:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.963+0000 7f58fb7fe640 1 --2- 172.21.15.50:0/2452780282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58fc162350 0x7f58fc14f680 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f58f400ca80 tx=0x7f58f400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.964+0000 7f58e3fff640 1 -- 172.21.15.50:0/2452780282 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4017070 con 0x7f58fc162350 2024-09-11T22:20:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.964+0000 7f58e3fff640 1 -- 172.21.15.50:0/2452780282 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f400ac30 con 0x7f58fc162350 2024-09-11T22:20:28.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.964+0000 7f59018a5640 1 -- 172.21.15.50:0/2452780282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58fc0cd180 con 0x7f58fc162350 2024-09-11T22:20:28.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.964+0000 7f58e3fff640 1 -- 172.21.15.50:0/2452780282 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4012600 con 0x7f58fc162350 2024-09-11T22:20:28.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.964+0000 7f59018a5640 1 -- 172.21.15.50:0/2452780282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58fc0cd740 con 0x7f58fc162350 2024-09-11T22:20:28.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.965+0000 7f59018a5640 1 -- 172.21.15.50:0/2452780282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58fc0d19a0 con 0x7f58fc162350 2024-09-11T22:20:28.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.965+0000 7f58e3fff640 1 -- 172.21.15.50:0/2452780282 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58f401a070 con 0x7f58fc162350 2024-09-11T22:20:28.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.966+0000 7f58e3fff640 1 --2- 172.21.15.50:0/2452780282 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58e806be30 0x7f58e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.966+0000 7f58e3fff640 1 -- 172.21.15.50:0/2452780282 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f58f408aa10 con 0x7f58fc162350 2024-09-11T22:20:28.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.966+0000 7f58faffd640 1 --2- 172.21.15.50:0/2452780282 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58e806be30 0x7f58e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:28.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.967+0000 7f58faffd640 1 --2- 172.21.15.50:0/2452780282 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58e806be30 0x7f58e806e2f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f58ec034000 tx=0x7f58ec02c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:28.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:28.970+0000 7f58e3fff640 1 -- 172.21.15.50:0/2452780282 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58fc14f170 con 0x7f58fc162350 2024-09-11T22:20:29.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.213+0000 7f59018a5640 1 -- 172.21.15.50:0/2452780282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f58fc161960 con 0x7f58fc162350 2024-09-11T22:20:29.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.213+0000 7f58e3fff640 1 -- 172.21.15.50:0/2452780282 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7f58f400ae20 con 0x7f58fc162350 2024-09-11T22:20:29.214 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:29.214 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":578,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076563554,"bytes_used":2600677376,"bytes_avail":770493435904,"bytes_total":773094113280,"write_bytes_sec":29042841,"read_op_per_sec":0,"write_op_per_sec":29},"fsmap":{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8907}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-11T22:20:27.498010+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:20:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.215+0000 7f59018a5640 1 -- 172.21.15.50:0/2452780282 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58e806be30 msgr2=0x7f58e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.215+0000 7f59018a5640 1 --2- 172.21.15.50:0/2452780282 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58e806be30 0x7f58e806e2f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f58ec034000 tx=0x7f58ec02c000 comp rx=0 tx=0).stop 2024-09-11T22:20:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.215+0000 7f59018a5640 1 -- 172.21.15.50:0/2452780282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58fc162350 msgr2=0x7f58fc14f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.215+0000 7f59018a5640 1 --2- 172.21.15.50:0/2452780282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58fc162350 0x7f58fc14f680 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f58f400ca80 tx=0x7f58f400cf40 comp rx=0 tx=0).stop 2024-09-11T22:20:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.215+0000 7f59018a5640 1 -- 172.21.15.50:0/2452780282 shutdown_connections 2024-09-11T22:20:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.215+0000 7f59018a5640 1 --2- 172.21.15.50:0/2452780282 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58e806be30 0x7f58e806e2f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.215+0000 7f59018a5640 1 --2- 172.21.15.50:0/2452780282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58fc162350 0x7f58fc14f680 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.215+0000 7f59018a5640 1 --2- 172.21.15.50:0/2452780282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58fc15e8e0 0x7f58fc14ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.215+0000 7f59018a5640 1 --2- 172.21.15.50:0/2452780282 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58fc0d1580 0x7f58fc0ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.215+0000 7f59018a5640 1 -- 172.21.15.50:0/2452780282 >> 172.21.15.50:0/2452780282 conn(0x7f58fc067ba0 msgr2=0x7f58fc15f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.215+0000 7f59018a5640 1 -- 172.21.15.50:0/2452780282 shutdown_connections 2024-09-11T22:20:29.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.215+0000 7f59018a5640 1 -- 172.21.15.50:0/2452780282 wait complete. 2024-09-11T22:20:29.227 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-11T22:20:29.227 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:20:29.227 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:20:29.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:20:29.346 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:20:29.346 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:20:29.346 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:20:29.346 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:20:29.363 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:20:29.363 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:20:29.420 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:20:29.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.564+0000 7efd7cadd640 1 Processor -- start 2024-09-11T22:20:29.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.564+0000 7efd7cadd640 1 -- start start 2024-09-11T22:20:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7cadd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd78161fa0 0x7efd780b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7cadd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efd780cf610 0x7efd780cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7cadd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd780cfbd0 con 0x7efd780b1600 2024-09-11T22:20:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7cadd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efd780d1220 con 0x7efd780cf610 2024-09-11T22:20:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7cadd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efd780d17e0 con 0x7efd78161fa0 2024-09-11T22:20:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd75d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efd780b1600 0x7efd780cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43100/0 (socket says 172.21.15.50:43100) 2024-09-11T22:20:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd75d9b640 1 -- 172.21.15.50:0/2198549347 learned_addr learned my addr 172.21.15.50:0/2198549347 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd76d9d640 1 --2- 172.21.15.50:0/2198549347 >> v2:172.21.15.77:3300/0 conn(0x7efd780cf610 0x7efd780cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7659c640 1 --2- 172.21.15.50:0/2198549347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd78161fa0 0x7efd780b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2526275850 0 0) 0x7efd780cfbd0 con 0x7efd780b1600 2024-09-11T22:20:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd60003520 con 0x7efd780b1600 2024-09-11T22:20:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4202999307 0 0) 0x7efd60003520 con 0x7efd780b1600 2024-09-11T22:20:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd78161fa0 msgr2=0x7efd780b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 --2- 172.21.15.50:0/2198549347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd78161fa0 0x7efd780b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 >> v2:172.21.15.77:3300/0 conn(0x7efd780cf610 msgr2=0x7efd780cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 --2- 172.21.15.50:0/2198549347 >> v2:172.21.15.77:3300/0 conn(0x7efd780cf610 0x7efd780cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd780cfeb0 con 0x7efd780b1600 2024-09-11T22:20:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7efd6c001670 con 0x7efd780b1600 2024-09-11T22:20:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 >> v1:172.21.15.50:6789/0 conn(0x7efd780b1600 legacy=0x7efd780cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 --2- 172.21.15.50:0/2198549347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd600039b0 0x7efd60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 --2- 172.21.15.50:0/2198549347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd60004800 0x7efd60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 --2- 172.21.15.50:0/2198549347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd78161fa0 0x7efd600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efd780d1220 con 0x7efd600039b0 2024-09-11T22:20:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd780d17e0 con 0x7efd60004800 2024-09-11T22:20:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.565+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efd6000b9c0 con 0x7efd78161fa0 2024-09-11T22:20:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.566+0000 7efd7659c640 1 --2- 172.21.15.50:0/2198549347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd600039b0 0x7efd60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.566+0000 7efd76d9d640 1 --2- 172.21.15.50:0/2198549347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd78161fa0 0x7efd600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.566+0000 7efd75d9b640 1 --2- 172.21.15.50:0/2198549347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd60004800 0x7efd60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.566+0000 7efd7659c640 1 -- 172.21.15.50:0/2198549347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd78161fa0 msgr2=0x7efd600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.566+0000 7efd7659c640 1 --2- 172.21.15.50:0/2198549347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd78161fa0 0x7efd600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.566+0000 7efd7659c640 1 -- 172.21.15.50:0/2198549347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd60004800 msgr2=0x7efd60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.566+0000 7efd7659c640 1 --2- 172.21.15.50:0/2198549347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd60004800 0x7efd60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.566+0000 7efd7659c640 1 -- 172.21.15.50:0/2198549347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd60003520 con 0x7efd600039b0 2024-09-11T22:20:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.566+0000 7efd76d9d640 1 --2- 172.21.15.50:0/2198549347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd78161fa0 0x7efd600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.566+0000 7efd7659c640 1 --2- 172.21.15.50:0/2198549347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd600039b0 0x7efd60003dd0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7efd68009ac0 tx=0x7efd60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9540364300885e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.567+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68036070 con 0x7efd600039b0 2024-09-11T22:20:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.567+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd68031400 con 0x7efd600039b0 2024-09-11T22:20:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.567+0000 7efd7559a640 1 -- 172.21.15.50:0/2198549347 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68009690 con 0x7efd600039b0 2024-09-11T22:20:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.567+0000 7efd7cadd640 1 -- 172.21.15.50:0/2198549347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd600039b0 msgr2=0x7efd60003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.567+0000 7efd7cadd640 1 --2- 172.21.15.50:0/2198549347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd600039b0 0x7efd60003dd0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7efd68009ac0 tx=0x7efd60005830 comp rx=0 tx=0).stop 2024-09-11T22:20:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.567+0000 7efd76d9d640 1 -- 172.21.15.50:0/2198549347 reap_dead start 2024-09-11T22:20:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.567+0000 7efd7cadd640 1 -- 172.21.15.50:0/2198549347 shutdown_connections 2024-09-11T22:20:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.567+0000 7efd7cadd640 1 -- 172.21.15.50:0/2198549347 >> 172.21.15.50:0/2198549347 conn(0x7efd7809ba50 msgr2=0x7efd780b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.567+0000 7efd7cadd640 1 -- 172.21.15.50:0/2198549347 shutdown_connections 2024-09-11T22:20:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.567+0000 7efd7cadd640 1 -- 172.21.15.50:0/2198549347 wait complete. 2024-09-11T22:20:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.569+0000 7efd7cadd640 1 Processor -- start 2024-09-11T22:20:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.569+0000 7efd7cadd640 1 -- start start 2024-09-11T22:20:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.569+0000 7efd7cadd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd600039b0 0x7efd780ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.569+0000 7efd7cadd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd780b6290 0x7efd780b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.569+0000 7efd7cadd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd780b8230 0x7efd780ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.569+0000 7efd7cadd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efd78162500 con 0x7efd780b8230 2024-09-11T22:20:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.569+0000 7efd7cadd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd78162380 con 0x7efd600039b0 2024-09-11T22:20:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.569+0000 7efd7cadd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efd780d1c70 con 0x7efd780b6290 2024-09-11T22:20:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.569+0000 7efd76d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd780b8230 0x7efd780ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd76d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd780b8230 0x7efd780ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55620/0 (socket says 172.21.15.50:55620) 2024-09-11T22:20:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd76d9d640 1 -- 172.21.15.50:0/2556373697 learned_addr learned my addr 172.21.15.50:0/2556373697 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd75d9b640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd780b6290 0x7efd780b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd7659c640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd600039b0 0x7efd780ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd76d9d640 1 -- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd780b6290 msgr2=0x7efd780b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd76d9d640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd780b6290 0x7efd780b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd76d9d640 1 -- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd600039b0 msgr2=0x7efd780ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd76d9d640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd600039b0 0x7efd780ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd76d9d640 1 -- 172.21.15.50:0/2556373697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd781f55b0 con 0x7efd780b8230 2024-09-11T22:20:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd76d9d640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd780b8230 0x7efd780ce1a0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7efd780b2010 tx=0x7efd70009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd66ffd640 1 -- 172.21.15.50:0/2556373697 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70010e20 con 0x7efd780b8230 2024-09-11T22:20:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd66ffd640 1 -- 172.21.15.50:0/2556373697 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd70003990 con 0x7efd780b8230 2024-09-11T22:20:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd66ffd640 1 -- 172.21.15.50:0/2556373697 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70003dc0 con 0x7efd780b8230 2024-09-11T22:20:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd7cadd640 1 -- 172.21.15.50:0/2556373697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd780b5870 con 0x7efd780b8230 2024-09-11T22:20:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.570+0000 7efd7cadd640 1 -- 172.21.15.50:0/2556373697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd781f4c80 con 0x7efd780b8230 2024-09-11T22:20:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.571+0000 7efd7cadd640 1 -- 172.21.15.50:0/2556373697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd780b4d20 con 0x7efd780b8230 2024-09-11T22:20:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.572+0000 7efd66ffd640 1 -- 172.21.15.50:0/2556373697 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd7001e020 con 0x7efd780b8230 2024-09-11T22:20:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.572+0000 7efd66ffd640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efd5806be30 0x7efd5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.573+0000 7efd66ffd640 1 -- 172.21.15.50:0/2556373697 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7efd7008b3e0 con 0x7efd780b8230 2024-09-11T22:20:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.573+0000 7efd7659c640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efd5806be30 0x7efd5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.573+0000 7efd7659c640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efd5806be30 0x7efd5806e2f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7efd68033000 tx=0x7efd68008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.577+0000 7efd66ffd640 1 -- 172.21.15.50:0/2556373697 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd700596a0 con 0x7efd780b8230 2024-09-11T22:20:29.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.765+0000 7efd7cadd640 1 -- 172.21.15.50:0/2556373697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efd780ccb00 con 0x7efd780b8230 2024-09-11T22:20:29.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.765+0000 7efd66ffd640 1 -- 172.21.15.50:0/2556373697 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v144) ==== 80+0+0 (secure 0 0 0) 0x7efd7005d9a0 con 0x7efd780b8230 2024-09-11T22:20:29.766 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:20:29.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.767+0000 7efd7cadd640 1 -- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efd5806be30 msgr2=0x7efd5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.767+0000 7efd7cadd640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efd5806be30 0x7efd5806e2f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7efd68033000 tx=0x7efd68008030 comp rx=0 tx=0).stop 2024-09-11T22:20:29.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.767+0000 7efd7cadd640 1 -- 172.21.15.50:0/2556373697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd780b8230 msgr2=0x7efd780ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.767+0000 7efd7cadd640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd780b8230 0x7efd780ce1a0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7efd780b2010 tx=0x7efd70009f90 comp rx=0 tx=0).stop 2024-09-11T22:20:29.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.767+0000 7efd7cadd640 1 -- 172.21.15.50:0/2556373697 shutdown_connections 2024-09-11T22:20:29.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.767+0000 7efd7cadd640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efd5806be30 0x7efd5806e2f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.767+0000 7efd7cadd640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd780b6290 0x7efd780b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.767+0000 7efd7cadd640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd780b8230 0x7efd780ce1a0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.767+0000 7efd7cadd640 1 --2- 172.21.15.50:0/2556373697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd600039b0 0x7efd780ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.767+0000 7efd7cadd640 1 -- 172.21.15.50:0/2556373697 >> 172.21.15.50:0/2556373697 conn(0x7efd7809ba50 msgr2=0x7efd7806c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:29.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.767+0000 7efd7cadd640 1 -- 172.21.15.50:0/2556373697 shutdown_connections 2024-09-11T22:20:29.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:29.767+0000 7efd7cadd640 1 -- 172.21.15.50:0/2556373697 wait complete. 2024-09-11T22:20:29.779 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:20:29.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:29.780 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:20:30.387 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:20:30.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:30.388 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:20:30.410 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:20:30.410 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:20:30.411 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:20:30.428 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:20:30.428 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:20:30.429 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:20:30.429 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:20:30.470 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:20:30.470 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:20:30.470 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:20:30.470 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:20:30.487 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:20:30.488 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.613+0000 7fc57e54b640 1 Processor -- start 2024-09-11T22:20:30.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.613+0000 7fc57e54b640 1 -- start start 2024-09-11T22:20:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.613+0000 7fc57e54b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc578161fa0 0x7fc5780b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.613+0000 7fc57e54b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5780b1600 0x7fc5780cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.613+0000 7fc57e54b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5780cfbd0 con 0x7fc5780cf440 2024-09-11T22:20:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.613+0000 7fc57e54b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc5780cdce0 con 0x7fc5780b1600 2024-09-11T22:20:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.613+0000 7fc57e54b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc5780d1220 con 0x7fc578161fa0 2024-09-11T22:20:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.614+0000 7fc5777fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5780b1600 0x7fc5780cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.614+0000 7fc5777fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5780b1600 0x7fc5780cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55630/0 (socket says 172.21.15.50:55630) 2024-09-11T22:20:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.614+0000 7fc5777fe640 1 -- 172.21.15.50:0/1662500788 learned_addr learned my addr 172.21.15.50:0/1662500788 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.614+0000 7fc577fff640 1 --2- 172.21.15.50:0/1662500788 >> v2:172.21.15.77:3300/0 conn(0x7fc578161fa0 0x7fc5780b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.614+0000 7fc5777fe640 1 -- 172.21.15.50:0/1662500788 >> v2:172.21.15.77:3300/0 conn(0x7fc578161fa0 msgr2=0x7fc5780b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.614+0000 7fc5777fe640 1 --2- 172.21.15.50:0/1662500788 >> v2:172.21.15.77:3300/0 conn(0x7fc578161fa0 0x7fc5780b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.614+0000 7fc5777fe640 1 -- 172.21.15.50:0/1662500788 >> v1:172.21.15.77:6789/0 conn(0x7fc5780cf440 legacy=0x7fc57806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.614+0000 7fc5777fe640 1 -- 172.21.15.50:0/1662500788 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5780cfeb0 con 0x7fc5780b1600 2024-09-11T22:20:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.615+0000 7fc5777fe640 1 --2- 172.21.15.50:0/1662500788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5780b1600 0x7fc5780cef00 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fc578072960 tx=0x7fc56c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfd3a1d3ff35939 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.615+0000 7fc576ffd640 1 -- 172.21.15.50:0/1662500788 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c037070 con 0x7fc5780b1600 2024-09-11T22:20:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.615+0000 7fc576ffd640 1 -- 172.21.15.50:0/1662500788 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56c032440 con 0x7fc5780b1600 2024-09-11T22:20:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.615+0000 7fc576ffd640 1 -- 172.21.15.50:0/1662500788 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c032810 con 0x7fc5780b1600 2024-09-11T22:20:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.615+0000 7fc57e54b640 1 -- 172.21.15.50:0/1662500788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5780b1600 msgr2=0x7fc5780cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.615+0000 7fc57e54b640 1 --2- 172.21.15.50:0/1662500788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5780b1600 0x7fc5780cef00 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fc578072960 tx=0x7fc56c02a270 comp rx=0 tx=0).stop 2024-09-11T22:20:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.616+0000 7fc57e54b640 1 -- 172.21.15.50:0/1662500788 shutdown_connections 2024-09-11T22:20:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.616+0000 7fc57e54b640 1 --2- 172.21.15.50:0/1662500788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5780b1600 0x7fc5780cef00 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.616+0000 7fc57e54b640 1 --2- 172.21.15.50:0/1662500788 >> v2:172.21.15.77:3300/0 conn(0x7fc578161fa0 0x7fc5780b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.616+0000 7fc57e54b640 1 -- 172.21.15.50:0/1662500788 >> 172.21.15.50:0/1662500788 conn(0x7fc57809ba50 msgr2=0x7fc5780b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:30.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.616+0000 7fc57e54b640 1 -- 172.21.15.50:0/1662500788 shutdown_connections 2024-09-11T22:20:30.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.616+0000 7fc57e54b640 1 -- 172.21.15.50:0/1662500788 wait complete. 2024-09-11T22:20:30.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.617+0000 7fc57e54b640 1 Processor -- start 2024-09-11T22:20:30.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.617+0000 7fc57e54b640 1 -- start start 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57e54b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5780b1600 0x7fc5780cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57e54b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5780cf440 0x7fc5781f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57e54b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc578161fa0 0x7fc5780b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57e54b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc5780cf870 con 0x7fc578161fa0 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57e54b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc5780d17e0 con 0x7fc5780cf440 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57e54b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc578162380 con 0x7fc5780b1600 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57cae8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc578161fa0 0x7fc5780b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57cae8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc578161fa0 0x7fc5780b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55644/0 (socket says 172.21.15.50:55644) 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57cae8640 1 -- 172.21.15.50:0/2694185935 learned_addr learned my addr 172.21.15.50:0/2694185935 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc577fff640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5780b1600 0x7fc5780cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc5777fe640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5780cf440 0x7fc5781f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57cae8640 1 -- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5780b1600 msgr2=0x7fc5780cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57cae8640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5780b1600 0x7fc5780cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57cae8640 1 -- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5780cf440 msgr2=0x7fc5781f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57cae8640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5780cf440 0x7fc5781f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57cae8640 1 -- 172.21.15.50:0/2694185935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5780c9ca0 con 0x7fc578161fa0 2024-09-11T22:20:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.618+0000 7fc57cae8640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc578161fa0 0x7fc5780b36e0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c7d0 tx=0x7fc57000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.619+0000 7fc574ff9640 1 -- 172.21.15.50:0/2694185935 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570003b70 con 0x7fc578161fa0 2024-09-11T22:20:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.619+0000 7fc574ff9640 1 -- 172.21.15.50:0/2694185935 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc570003d30 con 0x7fc578161fa0 2024-09-11T22:20:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.619+0000 7fc57e54b640 1 -- 172.21.15.50:0/2694185935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5780cb660 con 0x7fc578161fa0 2024-09-11T22:20:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.619+0000 7fc574ff9640 1 -- 172.21.15.50:0/2694185935 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57000aa30 con 0x7fc578161fa0 2024-09-11T22:20:30.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.619+0000 7fc57e54b640 1 -- 172.21.15.50:0/2694185935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5780cbc20 con 0x7fc578161fa0 2024-09-11T22:20:30.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.620+0000 7fc57e54b640 1 -- 172.21.15.50:0/2694185935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5780d1c70 con 0x7fc578161fa0 2024-09-11T22:20:30.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.620+0000 7fc574ff9640 1 -- 172.21.15.50:0/2694185935 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc57000abd0 con 0x7fc578161fa0 2024-09-11T22:20:30.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.621+0000 7fc574ff9640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc56406be30 0x7fc56406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.621+0000 7fc574ff9640 1 -- 172.21.15.50:0/2694185935 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fc57008abb0 con 0x7fc578161fa0 2024-09-11T22:20:30.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.621+0000 7fc577fff640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc56406be30 0x7fc56406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.621+0000 7fc577fff640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc56406be30 0x7fc56406e2f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc568009aa0 tx=0x7fc568009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.625+0000 7fc574ff9640 1 -- 172.21.15.50:0/2694185935 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc570058f10 con 0x7fc578161fa0 2024-09-11T22:20:30.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.837+0000 7fc57e54b640 1 -- 172.21.15.50:0/2694185935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc57815c320 con 0x7fc578161fa0 2024-09-11T22:20:30.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.838+0000 7fc574ff9640 1 -- 172.21.15.50:0/2694185935 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7fc57005d210 con 0x7fc578161fa0 2024-09-11T22:20:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:30.839 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:20:30.839 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:20:30.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.840+0000 7fc57e54b640 1 -- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc56406be30 msgr2=0x7fc56406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.840+0000 7fc57e54b640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc56406be30 0x7fc56406e2f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc568009aa0 tx=0x7fc568009190 comp rx=0 tx=0).stop 2024-09-11T22:20:30.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.840+0000 7fc57e54b640 1 -- 172.21.15.50:0/2694185935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc578161fa0 msgr2=0x7fc5780b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.840+0000 7fc57e54b640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc578161fa0 0x7fc5780b36e0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c7d0 tx=0x7fc57000cc90 comp rx=0 tx=0).stop 2024-09-11T22:20:30.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.840+0000 7fc57e54b640 1 -- 172.21.15.50:0/2694185935 shutdown_connections 2024-09-11T22:20:30.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.840+0000 7fc57e54b640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc56406be30 0x7fc56406e2f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.840+0000 7fc57e54b640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc578161fa0 0x7fc5780b36e0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.840+0000 7fc57e54b640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5780cf440 0x7fc5781f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.840+0000 7fc57e54b640 1 --2- 172.21.15.50:0/2694185935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5780b1600 0x7fc5780cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.840+0000 7fc57e54b640 1 -- 172.21.15.50:0/2694185935 >> 172.21.15.50:0/2694185935 conn(0x7fc57809ba50 msgr2=0x7fc5780cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:30.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.840+0000 7fc57e54b640 1 -- 172.21.15.50:0/2694185935 shutdown_connections 2024-09-11T22:20:30.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.840+0000 7fc57e54b640 1 -- 172.21.15.50:0/2694185935 wait complete. 2024-09-11T22:20:30.852 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.954+0000 7f4a29a8b640 1 Processor -- start 2024-09-11T22:20:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.955+0000 7f4a29a8b640 1 -- start start 2024-09-11T22:20:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.955+0000 7f4a29a8b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2415e870 0x7f4a240d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.955+0000 7f4a29a8b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4a240d16d0 0x7f4a240d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.955+0000 7f4a29a8b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a240d3a30 0x7f4a240b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.955+0000 7f4a29a8b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4a240d3ea0 con 0x7f4a240d3a30 2024-09-11T22:20:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.955+0000 7f4a29a8b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4a240d1b10 con 0x7f4a240d16d0 2024-09-11T22:20:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.955+0000 7f4a29a8b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4a240cfa80 con 0x7f4a2415e870 2024-09-11T22:20:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.955+0000 7f4a23fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a240d3a30 0x7f4a240b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.956+0000 7f4a23fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a240d3a30 0x7f4a240b6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55656/0 (socket says 172.21.15.50:55656) 2024-09-11T22:20:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.956+0000 7f4a23fff640 1 -- 172.21.15.50:0/3086542190 learned_addr learned my addr 172.21.15.50:0/3086542190 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.956+0000 7f4a237fe640 1 --2- 172.21.15.50:0/3086542190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2415e870 0x7f4a240d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.956+0000 7f4a23fff640 1 -- 172.21.15.50:0/3086542190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2415e870 msgr2=0x7f4a240d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.956+0000 7f4a1affd640 1 --2- 172.21.15.50:0/3086542190 >> v2:172.21.15.77:3300/0 conn(0x7f4a240d16d0 0x7f4a240d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.956+0000 7f4a23fff640 1 --2- 172.21.15.50:0/3086542190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2415e870 0x7f4a240d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.956+0000 7f4a23fff640 1 -- 172.21.15.50:0/3086542190 >> v2:172.21.15.77:3300/0 conn(0x7f4a240d16d0 msgr2=0x7f4a240d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:30.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.956+0000 7f4a23fff640 1 --2- 172.21.15.50:0/3086542190 >> v2:172.21.15.77:3300/0 conn(0x7f4a240d16d0 0x7f4a240d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.956+0000 7f4a23fff640 1 -- 172.21.15.50:0/3086542190 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a240d40d0 con 0x7f4a240d3a30 2024-09-11T22:20:30.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.956+0000 7f4a1affd640 1 --2- 172.21.15.50:0/3086542190 >> v2:172.21.15.77:3300/0 conn(0x7f4a240d16d0 0x7f4a240d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:30.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.957+0000 7f4a23fff640 1 --2- 172.21.15.50:0/3086542190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240d3a30 0x7f4a240b6200 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f4a240cfc30 tx=0x7f4a1c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42efe6189c1857d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.957+0000 7f4a22ffd640 1 -- 172.21.15.50:0/3086542190 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c036070 con 0x7f4a240d3a30 2024-09-11T22:20:30.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.957+0000 7f4a22ffd640 1 -- 172.21.15.50:0/3086542190 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1c031600 con 0x7f4a240d3a30 2024-09-11T22:20:30.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.957+0000 7f4a22ffd640 1 -- 172.21.15.50:0/3086542190 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c0319d0 con 0x7f4a240d3a30 2024-09-11T22:20:30.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.957+0000 7f4a29a8b640 1 -- 172.21.15.50:0/3086542190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240d3a30 msgr2=0x7f4a240b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.957+0000 7f4a29a8b640 1 --2- 172.21.15.50:0/3086542190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240d3a30 0x7f4a240b6200 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f4a240cfc30 tx=0x7f4a1c02a680 comp rx=0 tx=0).stop 2024-09-11T22:20:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.957+0000 7f4a29a8b640 1 -- 172.21.15.50:0/3086542190 shutdown_connections 2024-09-11T22:20:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.957+0000 7f4a29a8b640 1 --2- 172.21.15.50:0/3086542190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240d3a30 0x7f4a240b6200 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.957+0000 7f4a29a8b640 1 --2- 172.21.15.50:0/3086542190 >> v2:172.21.15.77:3300/0 conn(0x7f4a240d16d0 0x7f4a240d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.957+0000 7f4a29a8b640 1 --2- 172.21.15.50:0/3086542190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2415e870 0x7f4a240d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.957+0000 7f4a29a8b640 1 -- 172.21.15.50:0/3086542190 >> 172.21.15.50:0/3086542190 conn(0x7f4a240727a0 msgr2=0x7f4a240679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.957+0000 7f4a29a8b640 1 -- 172.21.15.50:0/3086542190 shutdown_connections 2024-09-11T22:20:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.957+0000 7f4a29a8b640 1 -- 172.21.15.50:0/3086542190 wait complete. 2024-09-11T22:20:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.959+0000 7f4a29a8b640 1 Processor -- start 2024-09-11T22:20:30.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.959+0000 7f4a29a8b640 1 -- start start 2024-09-11T22:20:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a29a8b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a240d16d0 0x7f4a24156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a29a8b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240d3a30 0x7f4a24158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a29a8b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2415e870 0x7f4a24158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a29a8b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4a240b7ee0 con 0x7f4a240d3a30 2024-09-11T22:20:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a29a8b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4a240b7c00 con 0x7f4a240d16d0 2024-09-11T22:20:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a29a8b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4a2415ec50 con 0x7f4a2415e870 2024-09-11T22:20:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a1affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240d3a30 0x7f4a24158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a1affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240d3a30 0x7f4a24158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55666/0 (socket says 172.21.15.50:55666) 2024-09-11T22:20:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a1affd640 1 -- 172.21.15.50:0/928363241 learned_addr learned my addr 172.21.15.50:0/928363241 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a237fe640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a240d16d0 0x7f4a24156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a23fff640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2415e870 0x7f4a24158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a1affd640 1 -- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2415e870 msgr2=0x7f4a24158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a1affd640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2415e870 0x7f4a24158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a1affd640 1 -- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a240d16d0 msgr2=0x7f4a24156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a1affd640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a240d16d0 0x7f4a24156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a1affd640 1 -- 172.21.15.50:0/928363241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a240b5f70 con 0x7f4a240d3a30 2024-09-11T22:20:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a237fe640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a240d16d0 0x7f4a24156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a1affd640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240d3a30 0x7f4a24158730 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00c820 tx=0x7f4a0c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a20ff9640 1 -- 172.21.15.50:0/928363241 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c004230 con 0x7f4a240d3a30 2024-09-11T22:20:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a20ff9640 1 -- 172.21.15.50:0/928363241 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a0c0043f0 con 0x7f4a240d3a30 2024-09-11T22:20:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a20ff9640 1 -- 172.21.15.50:0/928363241 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c007a70 con 0x7f4a240d3a30 2024-09-11T22:20:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a29a8b640 1 -- 172.21.15.50:0/928363241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a240b6250 con 0x7f4a240d3a30 2024-09-11T22:20:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.960+0000 7f4a29a8b640 1 -- 172.21.15.50:0/928363241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a240b6810 con 0x7f4a240d3a30 2024-09-11T22:20:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.962+0000 7f4a29a8b640 1 -- 172.21.15.50:0/928363241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a240b78b0 con 0x7f4a240d3a30 2024-09-11T22:20:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.962+0000 7f4a20ff9640 1 -- 172.21.15.50:0/928363241 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a0c007c10 con 0x7f4a240d3a30 2024-09-11T22:20:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.962+0000 7f4a20ff9640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4a0406be30 0x7f4a0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.963+0000 7f4a20ff9640 1 -- 172.21.15.50:0/928363241 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f4a0c08af80 con 0x7f4a240d3a30 2024-09-11T22:20:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.963+0000 7f4a237fe640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4a0406be30 0x7f4a0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.963+0000 7f4a237fe640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4a0406be30 0x7f4a0406e2f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400b820 tx=0x7f4a14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:30.967+0000 7f4a20ff9640 1 -- 172.21.15.50:0/928363241 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a0c015020 con 0x7f4a240d3a30 2024-09-11T22:20:31.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.180+0000 7f4a29a8b640 1 -- 172.21.15.50:0/928363241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a24157260 con 0x7f4a240d3a30 2024-09-11T22:20:31.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.180+0000 7f4a20ff9640 1 -- 172.21.15.50:0/928363241 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7f4a0c059890 con 0x7f4a240d3a30 2024-09-11T22:20:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:31.182 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:20:31.182 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:20:31.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.183+0000 7f4a29a8b640 1 -- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4a0406be30 msgr2=0x7f4a0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.183+0000 7f4a29a8b640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4a0406be30 0x7f4a0406e2f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400b820 tx=0x7f4a14008040 comp rx=0 tx=0).stop 2024-09-11T22:20:31.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.183+0000 7f4a29a8b640 1 -- 172.21.15.50:0/928363241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240d3a30 msgr2=0x7f4a24158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.183+0000 7f4a29a8b640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240d3a30 0x7f4a24158730 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00c820 tx=0x7f4a0c00cce0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.183+0000 7f4a29a8b640 1 -- 172.21.15.50:0/928363241 shutdown_connections 2024-09-11T22:20:31.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.183+0000 7f4a29a8b640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4a0406be30 0x7f4a0406e2f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.183+0000 7f4a29a8b640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2415e870 0x7f4a24158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.183+0000 7f4a29a8b640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a240d3a30 0x7f4a24158730 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.183+0000 7f4a29a8b640 1 --2- 172.21.15.50:0/928363241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a240d16d0 0x7f4a24156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.183+0000 7f4a29a8b640 1 -- 172.21.15.50:0/928363241 >> 172.21.15.50:0/928363241 conn(0x7f4a240727a0 msgr2=0x7f4a240b9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:31.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.183+0000 7f4a29a8b640 1 -- 172.21.15.50:0/928363241 shutdown_connections 2024-09-11T22:20:31.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.183+0000 7f4a29a8b640 1 -- 172.21.15.50:0/928363241 wait complete. 2024-09-11T22:20:31.194 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:31.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.296+0000 7f97ced59640 1 Processor -- start 2024-09-11T22:20:31.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.296+0000 7f97ced59640 1 -- start start 2024-09-11T22:20:31.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97ced59640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97c80cf580 0x7f97c80b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97ced59640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97c80cdd50 0x7f97c806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97ced59640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97c80ce5f0 con 0x7f97c815e840 2024-09-11T22:20:31.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97ced59640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f97c806c240 con 0x7f97c80cf580 2024-09-11T22:20:31.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97ced59640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f97c80d0470 con 0x7f97c80cdd50 2024-09-11T22:20:31.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97c7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97c80cf580 0x7f97c80b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97ccaf5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f97c815e840 0x7f97c80cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43102/0 (socket says 172.21.15.50:43102) 2024-09-11T22:20:31.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97ccaf5640 1 -- 172.21.15.50:0/1353848521 learned_addr learned my addr 172.21.15.50:0/1353848521 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:31.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97cd2f6640 1 --2- 172.21.15.50:0/1353848521 >> v2:172.21.15.77:3300/0 conn(0x7f97c80cdd50 0x7f97c806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97c7fff640 1 -- 172.21.15.50:0/1353848521 >> v2:172.21.15.77:3300/0 conn(0x7f97c80cdd50 msgr2=0x7f97c806c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:31.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97c7fff640 1 --2- 172.21.15.50:0/1353848521 >> v2:172.21.15.77:3300/0 conn(0x7f97c80cdd50 0x7f97c806c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97c7fff640 1 -- 172.21.15.50:0/1353848521 >> v1:172.21.15.50:6789/0 conn(0x7f97c815e840 legacy=0x7f97c80cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97c7fff640 1 -- 172.21.15.50:0/1353848521 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c80ce310 con 0x7f97c80cf580 2024-09-11T22:20:31.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97c77fe640 1 -- 172.21.15.50:0/1353848521 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530761840 0 0) 0x7f97c80ce5f0 con 0x7f97c815e840 2024-09-11T22:20:31.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.297+0000 7f97cd2f6640 1 --2- 172.21.15.50:0/1353848521 >> v2:172.21.15.77:3300/0 conn(0x7f97c80cdd50 0x7f97c806c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:31.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.298+0000 7f97c7fff640 1 --2- 172.21.15.50:0/1353848521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c80cf580 0x7f97c80b4c70 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f97c80b1a30 tx=0x7f97bc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2961bec4fd19ee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.298+0000 7f97c77fe640 1 -- 172.21.15.50:0/1353848521 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc037070 con 0x7f97c80cf580 2024-09-11T22:20:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.298+0000 7f97c77fe640 1 -- 172.21.15.50:0/1353848521 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97bc032440 con 0x7f97c80cf580 2024-09-11T22:20:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.298+0000 7f97c77fe640 1 -- 172.21.15.50:0/1353848521 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc032810 con 0x7f97c80cf580 2024-09-11T22:20:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.299+0000 7f97ced59640 1 -- 172.21.15.50:0/1353848521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c80cf580 msgr2=0x7f97c80b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.299+0000 7f97ced59640 1 --2- 172.21.15.50:0/1353848521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c80cf580 0x7f97c80b4c70 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f97c80b1a30 tx=0x7f97bc02a1a0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.299+0000 7f97ced59640 1 -- 172.21.15.50:0/1353848521 shutdown_connections 2024-09-11T22:20:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.299+0000 7f97ced59640 1 --2- 172.21.15.50:0/1353848521 >> v2:172.21.15.77:3300/0 conn(0x7f97c80cdd50 0x7f97c806c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.299+0000 7f97ced59640 1 --2- 172.21.15.50:0/1353848521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c80cf580 0x7f97c80b4c70 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.299+0000 7f97ced59640 1 -- 172.21.15.50:0/1353848521 >> 172.21.15.50:0/1353848521 conn(0x7f97c80b4150 msgr2=0x7f97c80b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.299+0000 7f97ced59640 1 -- 172.21.15.50:0/1353848521 shutdown_connections 2024-09-11T22:20:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.299+0000 7f97ced59640 1 -- 172.21.15.50:0/1353848521 wait complete. 2024-09-11T22:20:31.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.300+0000 7f97ced59640 1 Processor -- start 2024-09-11T22:20:31.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.300+0000 7f97ced59640 1 -- start start 2024-09-11T22:20:31.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97ced59640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c80cdd50 0x7f97c81528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97ced59640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c80cf580 0x7f97c80b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97ced59640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c815e840 0x7f97c815cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97ced59640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f97c815ec20 con 0x7f97c80cf580 2024-09-11T22:20:31.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97ced59640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f97c806bed0 con 0x7f97c80cdd50 2024-09-11T22:20:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97ced59640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f97c815eda0 con 0x7f97c815e840 2024-09-11T22:20:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c80cf580 0x7f97c80b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c80cf580 0x7f97c80b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55692/0 (socket says 172.21.15.50:55692) 2024-09-11T22:20:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97c7fff640 1 -- 172.21.15.50:0/2915039373 learned_addr learned my addr 172.21.15.50:0/2915039373 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97cd2f6640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c815e840 0x7f97c815cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97ccaf5640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c80cdd50 0x7f97c81528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97c7fff640 1 -- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c815e840 msgr2=0x7f97c815cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97c7fff640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c815e840 0x7f97c815cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97c7fff640 1 -- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c80cdd50 msgr2=0x7f97c81528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97c7fff640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c80cdd50 0x7f97c81528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97c7fff640 1 -- 172.21.15.50:0/2915039373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c80b5f10 con 0x7f97c80cf580 2024-09-11T22:20:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.301+0000 7f97ccaf5640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c80cdd50 0x7f97c81528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.302+0000 7f97c7fff640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c80cf580 0x7f97c80b55e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f97bc000c00 tx=0x7f97bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.302+0000 7f97c57fa640 1 -- 172.21.15.50:0/2915039373 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc037040 con 0x7f97c80cf580 2024-09-11T22:20:31.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.302+0000 7f97c57fa640 1 -- 172.21.15.50:0/2915039373 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97bc042070 con 0x7f97c80cf580 2024-09-11T22:20:31.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.302+0000 7f97ced59640 1 -- 172.21.15.50:0/2915039373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c80b61f0 con 0x7f97c80cf580 2024-09-11T22:20:31.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.302+0000 7f97c57fa640 1 -- 172.21.15.50:0/2915039373 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc030a50 con 0x7f97c80cf580 2024-09-11T22:20:31.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.302+0000 7f97ced59640 1 -- 172.21.15.50:0/2915039373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c80b67b0 con 0x7f97c80cf580 2024-09-11T22:20:31.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.303+0000 7f97ced59640 1 -- 172.21.15.50:0/2915039373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c80b4c70 con 0x7f97c80cf580 2024-09-11T22:20:31.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.303+0000 7f97c57fa640 1 -- 172.21.15.50:0/2915039373 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97bc030bf0 con 0x7f97c80cf580 2024-09-11T22:20:31.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.304+0000 7f97c57fa640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97b406be30 0x7f97b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.304+0000 7f97c57fa640 1 -- 172.21.15.50:0/2915039373 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f97bc0ab930 con 0x7f97c80cf580 2024-09-11T22:20:31.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.304+0000 7f97ccaf5640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97b406be30 0x7f97b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.305+0000 7f97ccaf5640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97b406be30 0x7f97b406e2f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f97b8000f60 tx=0x7f97b8007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.308+0000 7f97c57fa640 1 -- 172.21.15.50:0/2915039373 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f97bc045360 con 0x7f97c80cf580 2024-09-11T22:20:31.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.485+0000 7f97ced59640 1 -- 172.21.15.50:0/2915039373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97c80b45d0 con 0x7f97c80cf580 2024-09-11T22:20:31.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.486+0000 7f97c57fa640 1 -- 172.21.15.50:0/2915039373 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+16703 (secure 0 0 0) 0x7f97bc07a2d0 con 0x7f97c80cf580 2024-09-11T22:20:31.487 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:31.487 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":144,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:19:56.485259+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:19:52.493103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-11T22:19:53.819282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:31.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.488+0000 7f97ced59640 1 -- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97b406be30 msgr2=0x7f97b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.488+0000 7f97ced59640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97b406be30 0x7f97b406e2f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f97b8000f60 tx=0x7f97b8007c10 comp rx=0 tx=0).stop 2024-09-11T22:20:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.488+0000 7f97ced59640 1 -- 172.21.15.50:0/2915039373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c80cf580 msgr2=0x7f97c80b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.488+0000 7f97ced59640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c80cf580 0x7f97c80b55e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f97bc000c00 tx=0x7f97bc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.488+0000 7f97ced59640 1 -- 172.21.15.50:0/2915039373 shutdown_connections 2024-09-11T22:20:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.488+0000 7f97ced59640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f97b406be30 0x7f97b406e2f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.488+0000 7f97ced59640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f97c815e840 0x7f97c815cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.488+0000 7f97ced59640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97c80cf580 0x7f97c80b55e0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.488+0000 7f97ced59640 1 --2- 172.21.15.50:0/2915039373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c80cdd50 0x7f97c81528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.488+0000 7f97ced59640 1 -- 172.21.15.50:0/2915039373 >> 172.21.15.50:0/2915039373 conn(0x7f97c80b4150 msgr2=0x7f97c8070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.488+0000 7f97ced59640 1 -- 172.21.15.50:0/2915039373 shutdown_connections 2024-09-11T22:20:31.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.488+0000 7f97ced59640 1 -- 172.21.15.50:0/2915039373 wait complete. 2024-09-11T22:20:31.500 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:20:31.500 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:31.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.602+0000 7fc0c781e640 1 Processor -- start 2024-09-11T22:20:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.602+0000 7fc0c781e640 1 -- start start 2024-09-11T22:20:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.603+0000 7fc0c781e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc0c00d18a0 0x7fc0c00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.603+0000 7fc0c781e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0c00cfa80 con 0x7fc0c015e870 2024-09-11T22:20:31.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.603+0000 7fc0c781e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0c00d40d0 con 0x7fc0c00d3a30 2024-09-11T22:20:31.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.603+0000 7fc0c781e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc0c00d3ea0 con 0x7fc0c00d18a0 2024-09-11T22:20:31.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.603+0000 7fc0c55ba640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc0c015e870 0x7fc0c00d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43114/0 (socket says 172.21.15.50:43114) 2024-09-11T22:20:31.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.603+0000 7fc0c55ba640 1 -- 172.21.15.50:0/4074987379 learned_addr learned my addr 172.21.15.50:0/4074987379 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:31.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.603+0000 7fc0c4db9640 1 --2- 172.21.15.50:0/4074987379 >> v2:172.21.15.77:3300/0 conn(0x7fc0c00d18a0 0x7fc0c00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.603+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1769178145 0 0) 0x7fc0bc001110 con 0x7fc0c015e870 2024-09-11T22:20:31.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.603+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0ac003520 con 0x7fc0c015e870 2024-09-11T22:20:31.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.603+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3571766617 0 0) 0x7fc0ac003520 con 0x7fc0c015e870 2024-09-11T22:20:31.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.603+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 >> v2:172.21.15.77:3300/0 conn(0x7fc0c00d18a0 msgr2=0x7fc0c00d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:31.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.603+0000 7fc0b7fff640 1 --2- 172.21.15.50:0/4074987379 >> v2:172.21.15.77:3300/0 conn(0x7fc0c00d18a0 0x7fc0c00d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.603+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 >> v1:172.21.15.77:6789/0 conn(0x7fc0c00d3a30 legacy=0x7fc0c00b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c00d43b0 con 0x7fc0c015e870 2024-09-11T22:20:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fc0bc001840 con 0x7fc0c015e870 2024-09-11T22:20:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 >> v1:172.21.15.50:6789/0 conn(0x7fc0c015e870 legacy=0x7fc0c00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0b7fff640 1 --2- 172.21.15.50:0/4074987379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0ac0039b0 0x7fc0ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0b7fff640 1 --2- 172.21.15.50:0/4074987379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0ac004800 0x7fc0ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0b7fff640 1 --2- 172.21.15.50:0/4074987379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0ac0051c0 0x7fc0ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac00c030 con 0x7fc0ac004800 2024-09-11T22:20:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac00c1e0 con 0x7fc0ac0051c0 2024-09-11T22:20:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc0ac00c3e0 con 0x7fc0ac0039b0 2024-09-11T22:20:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0c4db9640 1 --2- 172.21.15.50:0/4074987379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0ac004800 0x7fc0ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0c55ba640 1 --2- 172.21.15.50:0/4074987379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0ac0039b0 0x7fc0ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0c5dbb640 1 --2- 172.21.15.50:0/4074987379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0ac0051c0 0x7fc0ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0c4db9640 1 -- 172.21.15.50:0/4074987379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0ac0039b0 msgr2=0x7fc0ac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0c4db9640 1 --2- 172.21.15.50:0/4074987379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0ac0039b0 0x7fc0ac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0c4db9640 1 -- 172.21.15.50:0/4074987379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0ac0051c0 msgr2=0x7fc0ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0c4db9640 1 --2- 172.21.15.50:0/4074987379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0ac0051c0 0x7fc0ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0c4db9640 1 -- 172.21.15.50:0/4074987379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ac003520 con 0x7fc0ac004800 2024-09-11T22:20:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0c5dbb640 1 --2- 172.21.15.50:0/4074987379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0ac0051c0 0x7fc0ac00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.604+0000 7fc0c5dbb640 1 -- 172.21.15.50:0/4074987379 reap_dead start 2024-09-11T22:20:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.605+0000 7fc0c4db9640 1 --2- 172.21.15.50:0/4074987379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0ac004800 0x7fc0ac004c80 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009ac0 tx=0x7fc0ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd273df5c20f9a53 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.605+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0036070 con 0x7fc0ac004800 2024-09-11T22:20:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.605+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b0031400 con 0x7fc0ac004800 2024-09-11T22:20:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.605+0000 7fc0b7fff640 1 -- 172.21.15.50:0/4074987379 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0009690 con 0x7fc0ac004800 2024-09-11T22:20:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.605+0000 7fc0c781e640 1 -- 172.21.15.50:0/4074987379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0ac004800 msgr2=0x7fc0ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.605+0000 7fc0c781e640 1 --2- 172.21.15.50:0/4074987379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0ac004800 0x7fc0ac004c80 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009ac0 tx=0x7fc0ac005830 comp rx=0 tx=0).stop 2024-09-11T22:20:31.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.605+0000 7fc0c781e640 1 -- 172.21.15.50:0/4074987379 shutdown_connections 2024-09-11T22:20:31.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.605+0000 7fc0c781e640 1 --2- 172.21.15.50:0/4074987379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0ac004800 0x7fc0ac004c80 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.605+0000 7fc0c781e640 1 -- 172.21.15.50:0/4074987379 >> 172.21.15.50:0/4074987379 conn(0x7fc0c00727a0 msgr2=0x7fc0c00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:31.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.606+0000 7fc0c781e640 1 -- 172.21.15.50:0/4074987379 shutdown_connections 2024-09-11T22:20:31.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.606+0000 7fc0c781e640 1 -- 172.21.15.50:0/4074987379 wait complete. 2024-09-11T22:20:31.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.607+0000 7fc0c781e640 1 Processor -- start 2024-09-11T22:20:31.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.607+0000 7fc0c781e640 1 -- start start 2024-09-11T22:20:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.607+0000 7fc0c781e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0ac004800 0x7fc0c015ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.607+0000 7fc0c781e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c0152d10 0x7fc0c00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.607+0000 7fc0c781e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0c0152580 0x7fc0c00cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.607+0000 7fc0c781e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c015ec50 con 0x7fc0ac004800 2024-09-11T22:20:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.607+0000 7fc0c781e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c00b7ee0 con 0x7fc0c0152d10 2024-09-11T22:20:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.607+0000 7fc0c781e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c00b78b0 con 0x7fc0c0152580 2024-09-11T22:20:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0c55ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0ac004800 0x7fc0c015ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0c55ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0ac004800 0x7fc0c015ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55708/0 (socket says 172.21.15.50:55708) 2024-09-11T22:20:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0c55ba640 1 -- 172.21.15.50:0/2444545997 learned_addr learned my addr 172.21.15.50:0/2444545997 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0c4db9640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c0152d10 0x7fc0c00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0c5dbb640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0c0152580 0x7fc0c00cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0c55ba640 1 -- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0c0152580 msgr2=0x7fc0c00cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0c55ba640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0c0152580 0x7fc0c00cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0c55ba640 1 -- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c0152d10 msgr2=0x7fc0c00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0c55ba640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c0152d10 0x7fc0c00c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0c55ba640 1 -- 172.21.15.50:0/2444545997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c00c8c70 con 0x7fc0ac004800 2024-09-11T22:20:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0c55ba640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0ac004800 0x7fc0c015ba70 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0073e0 tx=0x7fc0bc0018f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0b5ffb640 1 -- 172.21.15.50:0/2444545997 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc00e8d0 con 0x7fc0ac004800 2024-09-11T22:20:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0b5ffb640 1 -- 172.21.15.50:0/2444545997 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0bc018070 con 0x7fc0ac004800 2024-09-11T22:20:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0c781e640 1 -- 172.21.15.50:0/2444545997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c00cacf0 con 0x7fc0ac004800 2024-09-11T22:20:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0b5ffb640 1 -- 172.21.15.50:0/2444545997 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc00ecd0 con 0x7fc0ac004800 2024-09-11T22:20:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.608+0000 7fc0c781e640 1 -- 172.21.15.50:0/2444545997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c00cb2b0 con 0x7fc0ac004800 2024-09-11T22:20:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.609+0000 7fc0c781e640 1 -- 172.21.15.50:0/2444545997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c00d34f0 con 0x7fc0ac004800 2024-09-11T22:20:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.610+0000 7fc0b5ffb640 1 -- 172.21.15.50:0/2444545997 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0bc01d460 con 0x7fc0ac004800 2024-09-11T22:20:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.610+0000 7fc0b5ffb640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc0a406be30 0x7fc0a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.610+0000 7fc0b5ffb640 1 -- 172.21.15.50:0/2444545997 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fc0bc08ada0 con 0x7fc0ac004800 2024-09-11T22:20:31.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.610+0000 7fc0c4db9640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc0a406be30 0x7fc0a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.611+0000 7fc0c4db9640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc0a406be30 0x7fc0a406e2f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0033000 tx=0x7fc0b0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.615+0000 7fc0b5ffb640 1 -- 172.21.15.50:0/2444545997 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc0c00cfa80 con 0x7fc0ac004800 2024-09-11T22:20:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.827+0000 7fc0c781e640 1 -- 172.21.15.50:0/2444545997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0c00b9610 con 0x7fc0ac004800 2024-09-11T22:20:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.828+0000 7fc0b5ffb640 1 -- 172.21.15.50:0/2444545997 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7fc0bc059750 con 0x7fc0ac004800 2024-09-11T22:20:31.829 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:31.829 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:20:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:20:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.830+0000 7fc0c781e640 1 -- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc0a406be30 msgr2=0x7fc0a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.830+0000 7fc0c781e640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc0a406be30 0x7fc0a406e2f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0033000 tx=0x7fc0b0008030 comp rx=0 tx=0).stop 2024-09-11T22:20:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.830+0000 7fc0c781e640 1 -- 172.21.15.50:0/2444545997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0ac004800 msgr2=0x7fc0c015ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.830+0000 7fc0c781e640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0ac004800 0x7fc0c015ba70 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0073e0 tx=0x7fc0bc0018f0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.830+0000 7fc0c781e640 1 -- 172.21.15.50:0/2444545997 shutdown_connections 2024-09-11T22:20:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.830+0000 7fc0c781e640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc0a406be30 0x7fc0a406e2f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.830+0000 7fc0c781e640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0c0152580 0x7fc0c00cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.830+0000 7fc0c781e640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c0152d10 0x7fc0c00c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.830+0000 7fc0c781e640 1 --2- 172.21.15.50:0/2444545997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0ac004800 0x7fc0c015ba70 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.830+0000 7fc0c781e640 1 -- 172.21.15.50:0/2444545997 >> 172.21.15.50:0/2444545997 conn(0x7fc0c00727a0 msgr2=0x7fc0c00b9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.830+0000 7fc0c781e640 1 -- 172.21.15.50:0/2444545997 shutdown_connections 2024-09-11T22:20:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.830+0000 7fc0c781e640 1 -- 172.21.15.50:0/2444545997 wait complete. 2024-09-11T22:20:31.841 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:31.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.943+0000 7f89b0123640 1 Processor -- start 2024-09-11T22:20:31.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.943+0000 7f89b0123640 1 -- start start 2024-09-11T22:20:31.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.944+0000 7f89b0123640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a8161fa0 0x7f89a80b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.944+0000 7f89b0123640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f89a80cf610 0x7f89a80cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.944+0000 7f89b0123640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a80cfbd0 con 0x7f89a80b1600 2024-09-11T22:20:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.944+0000 7f89b0123640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f89a80d1220 con 0x7f89a80cf610 2024-09-11T22:20:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.944+0000 7f89b0123640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f89a80d17e0 con 0x7f89a8161fa0 2024-09-11T22:20:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.944+0000 7f89adebf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a8161fa0 0x7f89a80b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.944+0000 7f89ad6be640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f89a80b1600 0x7f89a80cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:49090/0 (socket says 172.21.15.50:49090) 2024-09-11T22:20:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.944+0000 7f89ae6c0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f89a80cf610 0x7f89a80cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.944+0000 7f89ad6be640 1 -- 172.21.15.50:0/4291773975 learned_addr learned my addr 172.21.15.50:0/4291773975 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.945+0000 7f89acebd640 1 -- 172.21.15.50:0/4291773975 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550363972 0 0) 0x7f89a80cfbd0 con 0x7f89a80b1600 2024-09-11T22:20:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.945+0000 7f89acebd640 1 -- 172.21.15.50:0/4291773975 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8994003520 con 0x7f89a80b1600 2024-09-11T22:20:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.945+0000 7f89ae6c0640 1 -- 172.21.15.50:0/4291773975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a8161fa0 msgr2=0x7f89a80b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.945+0000 7f89ae6c0640 1 --2- 172.21.15.50:0/4291773975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a8161fa0 0x7f89a80b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.945+0000 7f89ae6c0640 1 -- 172.21.15.50:0/4291773975 >> v1:172.21.15.77:6789/0 conn(0x7f89a80b1600 legacy=0x7f89a80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.945+0000 7f89ae6c0640 1 -- 172.21.15.50:0/4291773975 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a80cfeb0 con 0x7f89a80cf610 2024-09-11T22:20:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.945+0000 7f89adebf640 1 --2- 172.21.15.50:0/4291773975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a8161fa0 0x7f89a80b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:31.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.946+0000 7f89ae6c0640 1 --2- 172.21.15.50:0/4291773975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a80cf610 0x7f89a80cccd0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009d90 tx=0x7f89a002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=674c1d5f4f09cca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.946+0000 7f89acebd640 1 -- 172.21.15.50:0/4291773975 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0007740 con 0x7f89a80cf610 2024-09-11T22:20:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.946+0000 7f89acebd640 1 -- 172.21.15.50:0/4291773975 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a00078e0 con 0x7f89a80cf610 2024-09-11T22:20:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.946+0000 7f89acebd640 1 -- 172.21.15.50:0/4291773975 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0007cb0 con 0x7f89a80cf610 2024-09-11T22:20:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.946+0000 7f89b0123640 1 -- 172.21.15.50:0/4291773975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a80cf610 msgr2=0x7f89a80cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.946+0000 7f89b0123640 1 --2- 172.21.15.50:0/4291773975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a80cf610 0x7f89a80cccd0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009d90 tx=0x7f89a002a660 comp rx=0 tx=0).stop 2024-09-11T22:20:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.946+0000 7f89b0123640 1 -- 172.21.15.50:0/4291773975 shutdown_connections 2024-09-11T22:20:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.946+0000 7f89b0123640 1 --2- 172.21.15.50:0/4291773975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a80cf610 0x7f89a80cccd0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.946+0000 7f89b0123640 1 --2- 172.21.15.50:0/4291773975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a8161fa0 0x7f89a80b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.946+0000 7f89b0123640 1 -- 172.21.15.50:0/4291773975 >> 172.21.15.50:0/4291773975 conn(0x7f89a809ba50 msgr2=0x7f89a80b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.946+0000 7f89b0123640 1 -- 172.21.15.50:0/4291773975 shutdown_connections 2024-09-11T22:20:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.946+0000 7f89b0123640 1 -- 172.21.15.50:0/4291773975 wait complete. 2024-09-11T22:20:31.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.947+0000 7f89b0123640 1 Processor -- start 2024-09-11T22:20:31.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.948+0000 7f89b0123640 1 -- start start 2024-09-11T22:20:31.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.948+0000 7f89b0123640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a80b1600 0x7f89a815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.948+0000 7f89b0123640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a80cf610 0x7f89a815d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.948+0000 7f89b0123640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a8161fa0 0x7f89a80b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.948+0000 7f89b0123640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f89a8162500 con 0x7f89a80b1600 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.948+0000 7f89b0123640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89a8162380 con 0x7f89a80cf610 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.948+0000 7f89b0123640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f89a80d1c70 con 0x7f89a8161fa0 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.948+0000 7f89adebf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a80b1600 0x7f89a815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.948+0000 7f89adebf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a80b1600 0x7f89a815b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55716/0 (socket says 172.21.15.50:55716) 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.948+0000 7f89adebf640 1 -- 172.21.15.50:0/264765197 learned_addr learned my addr 172.21.15.50:0/264765197 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.948+0000 7f89ae6c0640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a8161fa0 0x7f89a80b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.948+0000 7f89ad6be640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a80cf610 0x7f89a815d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.949+0000 7f89adebf640 1 -- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a8161fa0 msgr2=0x7f89a80b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.949+0000 7f89adebf640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a8161fa0 0x7f89a80b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.949+0000 7f89adebf640 1 -- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a80cf610 msgr2=0x7f89a815d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.949+0000 7f89adebf640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a80cf610 0x7f89a815d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.949+0000 7f89adebf640 1 -- 172.21.15.50:0/264765197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a80ca5f0 con 0x7f89a80b1600 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.949+0000 7f89adebf640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a80b1600 0x7f89a815b9f0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f89a400ebe0 tx=0x7f89a400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.949+0000 7f899e7fc640 1 -- 172.21.15.50:0/264765197 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4017070 con 0x7f89a80b1600 2024-09-11T22:20:31.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.949+0000 7f899e7fc640 1 -- 172.21.15.50:0/264765197 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a400cc30 con 0x7f89a80b1600 2024-09-11T22:20:31.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.949+0000 7f89b0123640 1 -- 172.21.15.50:0/264765197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a80ca8d0 con 0x7f89a80b1600 2024-09-11T22:20:31.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.949+0000 7f899e7fc640 1 -- 172.21.15.50:0/264765197 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4013470 con 0x7f89a80b1600 2024-09-11T22:20:31.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.949+0000 7f89b0123640 1 -- 172.21.15.50:0/264765197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a80cae90 con 0x7f89a80b1600 2024-09-11T22:20:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.950+0000 7f89b0123640 1 -- 172.21.15.50:0/264765197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a80b4d20 con 0x7f89a80b1600 2024-09-11T22:20:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.951+0000 7f899e7fc640 1 -- 172.21.15.50:0/264765197 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89a401a070 con 0x7f89a80b1600 2024-09-11T22:20:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.951+0000 7f899e7fc640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f898c06be60 0x7f898c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.951+0000 7f899e7fc640 1 -- 172.21.15.50:0/264765197 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f89a408b000 con 0x7f89a80b1600 2024-09-11T22:20:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.951+0000 7f89ad6be640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f898c06be60 0x7f898c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.952+0000 7f89ad6be640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f898c06be60 0x7f898c06e320 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f89a815c310 tx=0x7f8998009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:31.956+0000 7f899e7fc640 1 -- 172.21.15.50:0/264765197 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89a40593f0 con 0x7f89a80b1600 2024-09-11T22:20:32.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.167+0000 7f89b0123640 1 -- 172.21.15.50:0/264765197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89a80a0830 con 0x7f89a80b1600 2024-09-11T22:20:32.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.167+0000 7f899e7fc640 1 -- 172.21.15.50:0/264765197 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5226 (secure 0 0 0) 0x7f89a405d6f0 con 0x7f89a80b1600 2024-09-11T22:20:32.168 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:32.168 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":101,"btime":"2024-09-11T22:19:58:044437+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:19:54.830956+0000","modified":"2024-09-11T22:19:57.395118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3729591942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3729591942},{"type":"v1","addr":"172.21.15.50:6835","nonce":3729591942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8907,"qdb_cluster":[8907]},"id":10}]} 2024-09-11T22:20:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 101 2024-09-11T22:20:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.169+0000 7f89b0123640 1 -- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f898c06be60 msgr2=0x7f898c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.169+0000 7f89b0123640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f898c06be60 0x7f898c06e320 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f89a815c310 tx=0x7f8998009040 comp rx=0 tx=0).stop 2024-09-11T22:20:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.169+0000 7f89b0123640 1 -- 172.21.15.50:0/264765197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a80b1600 msgr2=0x7f89a815b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.169+0000 7f89b0123640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a80b1600 0x7f89a815b9f0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f89a400ebe0 tx=0x7f89a400c520 comp rx=0 tx=0).stop 2024-09-11T22:20:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.169+0000 7f89b0123640 1 -- 172.21.15.50:0/264765197 shutdown_connections 2024-09-11T22:20:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.169+0000 7f89b0123640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f898c06be60 0x7f898c06e320 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.169+0000 7f89b0123640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89a8161fa0 0x7f89a80b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.169+0000 7f89b0123640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89a80cf610 0x7f89a815d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.169+0000 7f89b0123640 1 --2- 172.21.15.50:0/264765197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89a80b1600 0x7f89a815b9f0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.169+0000 7f89b0123640 1 -- 172.21.15.50:0/264765197 >> 172.21.15.50:0/264765197 conn(0x7f89a809ba50 msgr2=0x7f89a80af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.169+0000 7f89b0123640 1 -- 172.21.15.50:0/264765197 shutdown_connections 2024-09-11T22:20:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.169+0000 7f89b0123640 1 -- 172.21.15.50:0/264765197 wait complete. 2024-09-11T22:20:32.181 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:32.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.283+0000 7f29d7931640 1 Processor -- start 2024-09-11T22:20:32.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.283+0000 7f29d7931640 1 -- start start 2024-09-11T22:20:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d7931640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29d015e8e0 0x7f29d00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d7931640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f29d00d1580 0x7f29d00d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d7931640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29d0162350 0x7f29d01627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d7931640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f29d015ecc0 con 0x7f29d015e8e0 2024-09-11T22:20:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d7931640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f29d00d2ad0 con 0x7f29d00d1580 2024-09-11T22:20:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d7931640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f29d00d3370 con 0x7f29d0162350 2024-09-11T22:20:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d56cd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29d015e8e0 0x7f29d00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d56cd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29d015e8e0 0x7f29d00b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55732/0 (socket says 172.21.15.50:55732) 2024-09-11T22:20:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d56cd640 1 -- 172.21.15.50:0/2047989910 learned_addr learned my addr 172.21.15.50:0/2047989910 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d5ece640 1 --2- 172.21.15.50:0/2047989910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29d0162350 0x7f29d01627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d4ecc640 1 --2- 172.21.15.50:0/2047989910 >> v2:172.21.15.77:3300/0 conn(0x7f29d00d1580 0x7f29d00d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d56cd640 1 -- 172.21.15.50:0/2047989910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29d0162350 msgr2=0x7f29d01627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d56cd640 1 --2- 172.21.15.50:0/2047989910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29d0162350 0x7f29d01627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d56cd640 1 -- 172.21.15.50:0/2047989910 >> v2:172.21.15.77:3300/0 conn(0x7f29d00d1580 msgr2=0x7f29d00d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d56cd640 1 --2- 172.21.15.50:0/2047989910 >> v2:172.21.15.77:3300/0 conn(0x7f29d00d1580 0x7f29d00d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.284+0000 7f29d56cd640 1 -- 172.21.15.50:0/2047989910 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d00d1ee0 con 0x7f29d015e8e0 2024-09-11T22:20:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.285+0000 7f29d56cd640 1 --2- 172.21.15.50:0/2047989910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29d015e8e0 0x7f29d00b7880 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f29d01622b0 tx=0x7f29cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5742905dc91f3547 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.285+0000 7f29c7fff640 1 -- 172.21.15.50:0/2047989910 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc037070 con 0x7f29d015e8e0 2024-09-11T22:20:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.285+0000 7f29c7fff640 1 -- 172.21.15.50:0/2047989910 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29cc032440 con 0x7f29d015e8e0 2024-09-11T22:20:32.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.285+0000 7f29c7fff640 1 -- 172.21.15.50:0/2047989910 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc032810 con 0x7f29d015e8e0 2024-09-11T22:20:32.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.285+0000 7f29d7931640 1 -- 172.21.15.50:0/2047989910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29d015e8e0 msgr2=0x7f29d00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.285+0000 7f29d7931640 1 --2- 172.21.15.50:0/2047989910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29d015e8e0 0x7f29d00b7880 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f29d01622b0 tx=0x7f29cc02a270 comp rx=0 tx=0).stop 2024-09-11T22:20:32.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.286+0000 7f29d7931640 1 -- 172.21.15.50:0/2047989910 shutdown_connections 2024-09-11T22:20:32.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.286+0000 7f29d7931640 1 --2- 172.21.15.50:0/2047989910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29d0162350 0x7f29d01627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.286+0000 7f29d7931640 1 --2- 172.21.15.50:0/2047989910 >> v2:172.21.15.77:3300/0 conn(0x7f29d00d1580 0x7f29d00d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.286+0000 7f29d7931640 1 --2- 172.21.15.50:0/2047989910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29d015e8e0 0x7f29d00b7880 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.286+0000 7f29d7931640 1 -- 172.21.15.50:0/2047989910 >> 172.21.15.50:0/2047989910 conn(0x7f29d0067ba0 msgr2=0x7f29d0067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.286+0000 7f29d7931640 1 -- 172.21.15.50:0/2047989910 shutdown_connections 2024-09-11T22:20:32.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.286+0000 7f29d7931640 1 -- 172.21.15.50:0/2047989910 wait complete. 2024-09-11T22:20:32.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.287+0000 7f29d7931640 1 Processor -- start 2024-09-11T22:20:32.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.287+0000 7f29d7931640 1 -- start start 2024-09-11T22:20:32.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d7931640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29d00d1580 0x7f29d0155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d7931640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29d015e8e0 0x7f29d00b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d7931640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29d0162350 0x7f29d0155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d7931640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29d00d3000 con 0x7f29d015e8e0 2024-09-11T22:20:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d7931640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29d00d2d20 con 0x7f29d0162350 2024-09-11T22:20:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d7931640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f29d0162d20 con 0x7f29d00d1580 2024-09-11T22:20:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d4ecc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29d015e8e0 0x7f29d00b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d4ecc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29d015e8e0 0x7f29d00b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55738/0 (socket says 172.21.15.50:55738) 2024-09-11T22:20:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d4ecc640 1 -- 172.21.15.50:0/2762773064 learned_addr learned my addr 172.21.15.50:0/2762773064 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d56cd640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29d00d1580 0x7f29d0155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d5ece640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29d0162350 0x7f29d0155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d4ecc640 1 -- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29d00d1580 msgr2=0x7f29d0155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d4ecc640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29d00d1580 0x7f29d0155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d4ecc640 1 -- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29d0162350 msgr2=0x7f29d0155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d4ecc640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29d0162350 0x7f29d0155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d4ecc640 1 -- 172.21.15.50:0/2762773064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d00b6560 con 0x7f29d015e8e0 2024-09-11T22:20:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29d4ecc640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29d015e8e0 0x7f29d00b5e10 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f29c000d800 tx=0x7f29c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.288+0000 7f29c5ffb640 1 -- 172.21.15.50:0/2762773064 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c0018020 con 0x7f29d015e8e0 2024-09-11T22:20:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.289+0000 7f29c5ffb640 1 -- 172.21.15.50:0/2762773064 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c00096a0 con 0x7f29d015e8e0 2024-09-11T22:20:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.289+0000 7f29d7931640 1 -- 172.21.15.50:0/2762773064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d00b6840 con 0x7f29d015e8e0 2024-09-11T22:20:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.289+0000 7f29c5ffb640 1 -- 172.21.15.50:0/2762773064 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c0009a70 con 0x7f29d015e8e0 2024-09-11T22:20:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.289+0000 7f29d7931640 1 -- 172.21.15.50:0/2762773064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d0155580 con 0x7f29d015e8e0 2024-09-11T22:20:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.290+0000 7f29d7931640 1 -- 172.21.15.50:0/2762773064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d00b7880 con 0x7f29d015e8e0 2024-09-11T22:20:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.290+0000 7f29c5ffb640 1 -- 172.21.15.50:0/2762773064 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29c001b020 con 0x7f29d015e8e0 2024-09-11T22:20:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.291+0000 7f29c5ffb640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29b406be30 0x7f29b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.291+0000 7f29c5ffb640 1 -- 172.21.15.50:0/2762773064 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7f29c008b1f0 con 0x7f29d015e8e0 2024-09-11T22:20:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.291+0000 7f29d56cd640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29b406be30 0x7f29b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.291+0000 7f29d56cd640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29b406be30 0x7f29b406e2f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f29cc034000 tx=0x7f29cc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.295+0000 7f29c5ffb640 1 -- 172.21.15.50:0/2762773064 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29c0022020 con 0x7f29d015e8e0 2024-09-11T22:20:32.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.473+0000 7f29d7931640 1 -- 172.21.15.50:0/2762773064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29d00ba770 con 0x7f29d015e8e0 2024-09-11T22:20:32.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.474+0000 7f29c5ffb640 1 -- 172.21.15.50:0/2762773064 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+16703 (secure 0 0 0) 0x7f29c00595e0 con 0x7f29d015e8e0 2024-09-11T22:20:32.475 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:32.476 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":144,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:19:56.485259+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:19:52.493103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-11T22:19:53.819282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.477+0000 7f29d7931640 1 -- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29b406be30 msgr2=0x7f29b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.477+0000 7f29d7931640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29b406be30 0x7f29b406e2f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f29cc034000 tx=0x7f29cc02e000 comp rx=0 tx=0).stop 2024-09-11T22:20:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.477+0000 7f29d7931640 1 -- 172.21.15.50:0/2762773064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29d015e8e0 msgr2=0x7f29d00b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.477+0000 7f29d7931640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29d015e8e0 0x7f29d00b5e10 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f29c000d800 tx=0x7f29c000dcc0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.477+0000 7f29d7931640 1 -- 172.21.15.50:0/2762773064 shutdown_connections 2024-09-11T22:20:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.477+0000 7f29d7931640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f29b406be30 0x7f29b406e2f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.477+0000 7f29d7931640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29d0162350 0x7f29d0155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.477+0000 7f29d7931640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29d015e8e0 0x7f29d00b5e10 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.477+0000 7f29d7931640 1 --2- 172.21.15.50:0/2762773064 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29d00d1580 0x7f29d0155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.477+0000 7f29d7931640 1 -- 172.21.15.50:0/2762773064 >> 172.21.15.50:0/2762773064 conn(0x7f29d0067ba0 msgr2=0x7f29d00d51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.477+0000 7f29d7931640 1 -- 172.21.15.50:0/2762773064 shutdown_connections 2024-09-11T22:20:32.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.477+0000 7f29d7931640 1 -- 172.21.15.50:0/2762773064 wait complete. 2024-09-11T22:20:32.489 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:20:32.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.592+0000 7fbdc6cf1640 1 Processor -- start 2024-09-11T22:20:32.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.592+0000 7fbdc6cf1640 1 -- start start 2024-09-11T22:20:32.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.593+0000 7fbdc6cf1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbdc015e840 0x7fbdc00b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.593+0000 7fbdc6cf1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdc00cf580 0x7fbdc006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.593+0000 7fbdc6cf1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc00ce5f0 con 0x7fbdc00cdd50 2024-09-11T22:20:32.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.593+0000 7fbdc6cf1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc006c240 con 0x7fbdc015e840 2024-09-11T22:20:32.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.593+0000 7fbdc6cf1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc00d0470 con 0x7fbdc00cf580 2024-09-11T22:20:32.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.593+0000 7fbdc4a8d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbdc015e840 0x7fbdc00b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.593+0000 7fbdc528e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdc00cf580 0x7fbdc006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.593+0000 7fbdc4a8d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbdc015e840 0x7fbdc00b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54616/0 (socket says 172.21.15.50:54616) 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.593+0000 7fbdbffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbdc00cdd50 0x7fbdc00cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:49100/0 (socket says 172.21.15.50:49100) 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.593+0000 7fbdc528e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdc00cf580 0x7fbdc006c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:36970/0 (socket says 172.21.15.50:36970) 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.593+0000 7fbdc4a8d640 1 -- 172.21.15.50:0/2910876861 learned_addr learned my addr 172.21.15.50:0/2910876861 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.594+0000 7fbdbf7fe640 1 -- 172.21.15.50:0/2910876861 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2120575960 0 0) 0x7fbdc00ce5f0 con 0x7fbdc00cdd50 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.594+0000 7fbdbf7fe640 1 -- 172.21.15.50:0/2910876861 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdb0003520 con 0x7fbdc00cdd50 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.594+0000 7fbdc528e640 1 -- 172.21.15.50:0/2910876861 >> v2:172.21.15.77:3300/0 conn(0x7fbdc015e840 msgr2=0x7fbdc00b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.594+0000 7fbdc528e640 1 --2- 172.21.15.50:0/2910876861 >> v2:172.21.15.77:3300/0 conn(0x7fbdc015e840 0x7fbdc00b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.594+0000 7fbdc528e640 1 -- 172.21.15.50:0/2910876861 >> v1:172.21.15.77:6789/0 conn(0x7fbdc00cdd50 legacy=0x7fbdc00cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.594+0000 7fbdc528e640 1 -- 172.21.15.50:0/2910876861 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc00ce310 con 0x7fbdc00cf580 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.594+0000 7fbdc4a8d640 1 --2- 172.21.15.50:0/2910876861 >> v2:172.21.15.77:3300/0 conn(0x7fbdc015e840 0x7fbdc00b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.594+0000 7fbdc528e640 1 --2- 172.21.15.50:0/2910876861 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdc00cf580 0x7fbdc006c6d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009d90 tx=0x7fbdb802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6367ee676b0b4cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.595+0000 7fbdbf7fe640 1 -- 172.21.15.50:0/2910876861 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8007740 con 0x7fbdc00cf580 2024-09-11T22:20:32.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.595+0000 7fbdbf7fe640 1 -- 172.21.15.50:0/2910876861 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb80078e0 con 0x7fbdc00cf580 2024-09-11T22:20:32.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.595+0000 7fbdbf7fe640 1 -- 172.21.15.50:0/2910876861 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8007c90 con 0x7fbdc00cf580 2024-09-11T22:20:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.595+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/2910876861 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdc00cf580 msgr2=0x7fbdc006c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.595+0000 7fbdc6cf1640 1 --2- 172.21.15.50:0/2910876861 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdc00cf580 0x7fbdc006c6d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009d90 tx=0x7fbdb802a660 comp rx=0 tx=0).stop 2024-09-11T22:20:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.595+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/2910876861 shutdown_connections 2024-09-11T22:20:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.595+0000 7fbdc6cf1640 1 --2- 172.21.15.50:0/2910876861 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdc00cf580 0x7fbdc006c6d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.595+0000 7fbdc6cf1640 1 --2- 172.21.15.50:0/2910876861 >> v2:172.21.15.77:3300/0 conn(0x7fbdc015e840 0x7fbdc00b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.595+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/2910876861 >> 172.21.15.50:0/2910876861 conn(0x7fbdc00b4150 msgr2=0x7fbdc00b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.595+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/2910876861 shutdown_connections 2024-09-11T22:20:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.595+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/2910876861 wait complete. 2024-09-11T22:20:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.596+0000 7fbdc6cf1640 1 Processor -- start 2024-09-11T22:20:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.597+0000 7fbdc6cf1640 1 -- start start 2024-09-11T22:20:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.597+0000 7fbdc6cf1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdc00cdd50 0x7fbdc009fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.597+0000 7fbdc6cf1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdc00cf580 0x7fbdc00b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.597+0000 7fbdc6cf1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdc015e840 0x7fbdc00c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.597+0000 7fbdc6cf1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc015ec20 con 0x7fbdc00cf580 2024-09-11T22:20:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.597+0000 7fbdc6cf1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc006bed0 con 0x7fbdc015e840 2024-09-11T22:20:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.597+0000 7fbdc6cf1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc015eda0 con 0x7fbdc00cdd50 2024-09-11T22:20:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdbffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdc00cf580 0x7fbdc00b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdbffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdc00cf580 0x7fbdc00b6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55752/0 (socket says 172.21.15.50:55752) 2024-09-11T22:20:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdbffff640 1 -- 172.21.15.50:0/197336832 learned_addr learned my addr 172.21.15.50:0/197336832 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdc4a8d640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdc00cdd50 0x7fbdc009fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdc528e640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdc015e840 0x7fbdc00c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdbffff640 1 -- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdc00cdd50 msgr2=0x7fbdc009fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdbffff640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdc00cdd50 0x7fbdc009fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdbffff640 1 -- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdc015e840 msgr2=0x7fbdc00c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdbffff640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdc015e840 0x7fbdc00c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdbffff640 1 -- 172.21.15.50:0/197336832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc00b76e0 con 0x7fbdc00cf580 2024-09-11T22:20:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdbffff640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdc00cf580 0x7fbdc00b6eb0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c390 tx=0x7fbdac00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdbd7fa640 1 -- 172.21.15.50:0/197336832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0074e0 con 0x7fbdc00cf580 2024-09-11T22:20:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdbd7fa640 1 -- 172.21.15.50:0/197336832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdac0047e0 con 0x7fbdc00cf580 2024-09-11T22:20:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/197336832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc00b79c0 con 0x7fbdc00cf580 2024-09-11T22:20:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdbd7fa640 1 -- 172.21.15.50:0/197336832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac004bd0 con 0x7fbdc00cf580 2024-09-11T22:20:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.598+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/197336832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc00a0180 con 0x7fbdc00cf580 2024-09-11T22:20:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.599+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/197336832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc00c6ba0 con 0x7fbdc00cf580 2024-09-11T22:20:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.600+0000 7fbdbd7fa640 1 -- 172.21.15.50:0/197336832 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbdac01a020 con 0x7fbdc00cf580 2024-09-11T22:20:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.600+0000 7fbdbd7fa640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbda406be60 0x7fbda406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.601+0000 7fbdbd7fa640 1 -- 172.21.15.50:0/197336832 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5709+0+0 (secure 0 0 0) 0x7fbdac08a570 con 0x7fbdc00cf580 2024-09-11T22:20:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.601+0000 7fbdc4a8d640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbda406be60 0x7fbda406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.601+0000 7fbdc4a8d640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbda406be60 0x7fbda406e320 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4006ca0 tx=0x7fbdb4009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.605+0000 7fbdbd7fa640 1 -- 172.21.15.50:0/197336832 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbdac058900 con 0x7fbdc00cf580 2024-09-11T22:20:32.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.816+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/197336832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbdc00b4c70 con 0x7fbdc00cf580 2024-09-11T22:20:32.817 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:20:32.817+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.818+0000 7fbdbd7fa640 1 -- 172.21.15.50:0/197336832 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v102) ==== 161+0+0 (secure 0 0 0) 0x7fbdac05cc00 con 0x7fbdc00cf580 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:20:32.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.821+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbda406be60 msgr2=0x7fbda406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.821+0000 7fbdc6cf1640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbda406be60 0x7fbda406e320 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4006ca0 tx=0x7fbdb4009240 comp rx=0 tx=0).stop 2024-09-11T22:20:32.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.821+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/197336832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdc00cf580 msgr2=0x7fbdc00b6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.821+0000 7fbdc6cf1640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdc00cf580 0x7fbdc00b6eb0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c390 tx=0x7fbdac00c850 comp rx=0 tx=0).stop 2024-09-11T22:20:32.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.821+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/197336832 shutdown_connections 2024-09-11T22:20:32.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.821+0000 7fbdc6cf1640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbda406be60 0x7fbda406e320 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.821+0000 7fbdc6cf1640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdc015e840 0x7fbdc00c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.821+0000 7fbdc6cf1640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdc00cf580 0x7fbdc00b6eb0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.821+0000 7fbdc6cf1640 1 --2- 172.21.15.50:0/197336832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdc00cdd50 0x7fbdc009fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.821+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/197336832 >> 172.21.15.50:0/197336832 conn(0x7fbdc00b4150 msgr2=0x7fbdc00d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.822+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/197336832 shutdown_connections 2024-09-11T22:20:32.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.822+0000 7fbdc6cf1640 1 -- 172.21.15.50:0/197336832 wait complete. 2024-09-11T22:20:32.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:20:32.861 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:20:32.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.939+0000 7f8fa1282640 1 Processor -- start 2024-09-11T22:20:32.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.939+0000 7f8fa1282640 1 -- start start 2024-09-11T22:20:32.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8fa1282640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8f9c15e9b0 0x7f8f9c15f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8fa1282640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8f9c06bb50 0x7f8f9c0af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8fa1282640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f9c0af900 0x7f8f9c0b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8fa1282640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8f9c0b6900 con 0x7f8f9c15e9b0 2024-09-11T22:20:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8fa1282640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8f9c0b5fd0 con 0x7f8f9c06bb50 2024-09-11T22:20:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8fa1282640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8f9c0b62b0 con 0x7f8f9c0af900 2024-09-11T22:20:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8f9affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8f9c15e9b0 0x7f8f9c15f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8f9affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8f9c15e9b0 0x7f8f9c15f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55772/0 (socket says 172.21.15.50:55772) 2024-09-11T22:20:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8f9affd640 1 -- 172.21.15.50:0/2209111679 learned_addr learned my addr 172.21.15.50:0/2209111679 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8f9a7fc640 1 --2- 172.21.15.50:0/2209111679 >> v2:172.21.15.77:3300/0 conn(0x7f8f9c06bb50 0x7f8f9c0af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8f9b7fe640 1 --2- 172.21.15.50:0/2209111679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f9c0af900 0x7f8f9c0b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8f9affd640 1 -- 172.21.15.50:0/2209111679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f9c0af900 msgr2=0x7f8f9c0b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8f9affd640 1 --2- 172.21.15.50:0/2209111679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f9c0af900 0x7f8f9c0b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8f9affd640 1 -- 172.21.15.50:0/2209111679 >> v2:172.21.15.77:3300/0 conn(0x7f8f9c06bb50 msgr2=0x7f8f9c0af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8f9affd640 1 --2- 172.21.15.50:0/2209111679 >> v2:172.21.15.77:3300/0 conn(0x7f8f9c06bb50 0x7f8f9c0af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8f9affd640 1 -- 172.21.15.50:0/2209111679 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9c0b6590 con 0x7f8f9c15e9b0 2024-09-11T22:20:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.940+0000 7f8f9b7fe640 1 --2- 172.21.15.50:0/2209111679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f9c0af900 0x7f8f9c0b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.941+0000 7f8f9affd640 1 --2- 172.21.15.50:0/2209111679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f9c15e9b0 0x7f8f9c15f820 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c06dd60 tx=0x7f8f8c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6df26efad8467e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.941+0000 7f8f99ffb640 1 -- 172.21.15.50:0/2209111679 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c037070 con 0x7f8f9c15e9b0 2024-09-11T22:20:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.941+0000 7f8f99ffb640 1 -- 172.21.15.50:0/2209111679 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8c032440 con 0x7f8f9c15e9b0 2024-09-11T22:20:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.941+0000 7f8f99ffb640 1 -- 172.21.15.50:0/2209111679 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c032810 con 0x7f8f9c15e9b0 2024-09-11T22:20:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.942+0000 7f8fa1282640 1 -- 172.21.15.50:0/2209111679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f9c15e9b0 msgr2=0x7f8f9c15f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.942+0000 7f8fa1282640 1 --2- 172.21.15.50:0/2209111679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f9c15e9b0 0x7f8f9c15f820 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c06dd60 tx=0x7f8f8c02a1e0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.942+0000 7f8fa1282640 1 -- 172.21.15.50:0/2209111679 shutdown_connections 2024-09-11T22:20:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.942+0000 7f8fa1282640 1 --2- 172.21.15.50:0/2209111679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f9c0af900 0x7f8f9c0b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.942+0000 7f8fa1282640 1 --2- 172.21.15.50:0/2209111679 >> v2:172.21.15.77:3300/0 conn(0x7f8f9c06bb50 0x7f8f9c0af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.942+0000 7f8fa1282640 1 --2- 172.21.15.50:0/2209111679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f9c15e9b0 0x7f8f9c15f820 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.942+0000 7f8fa1282640 1 -- 172.21.15.50:0/2209111679 >> 172.21.15.50:0/2209111679 conn(0x7f8f9c0b7940 msgr2=0x7f8f9c0b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.942+0000 7f8fa1282640 1 -- 172.21.15.50:0/2209111679 shutdown_connections 2024-09-11T22:20:32.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.942+0000 7f8fa1282640 1 -- 172.21.15.50:0/2209111679 wait complete. 2024-09-11T22:20:32.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.943+0000 7f8fa1282640 1 Processor -- start 2024-09-11T22:20:32.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.943+0000 7f8fa1282640 1 -- start start 2024-09-11T22:20:32.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8fa1282640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f9c06bb50 0x7f8f9c15ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8fa1282640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9c0af900 0x7f8f9c152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8fa1282640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f9c153310 0x7f8f9c161570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8fa1282640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c06d490 con 0x7f8f9c153310 2024-09-11T22:20:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8fa1282640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c06d310 con 0x7f8f9c0af900 2024-09-11T22:20:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8fa1282640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8f9c0b72d0 con 0x7f8f9c06bb50 2024-09-11T22:20:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8f9b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f9c153310 0x7f8f9c161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8f9b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f9c153310 0x7f8f9c161570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55774/0 (socket says 172.21.15.50:55774) 2024-09-11T22:20:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8f9b7fe640 1 -- 172.21.15.50:0/2744035091 learned_addr learned my addr 172.21.15.50:0/2744035091 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8f9affd640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f9c06bb50 0x7f8f9c15ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8f9a7fc640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9c0af900 0x7f8f9c152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8f9b7fe640 1 -- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f9c06bb50 msgr2=0x7f8f9c15ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8f9b7fe640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f9c06bb50 0x7f8f9c15ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8f9b7fe640 1 -- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9c0af900 msgr2=0x7f8f9c152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.944+0000 7f8f9b7fe640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9c0af900 0x7f8f9c152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.945+0000 7f8f9b7fe640 1 -- 172.21.15.50:0/2744035091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9c1538c0 con 0x7f8f9c153310 2024-09-11T22:20:32.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.945+0000 7f8f9b7fe640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f9c153310 0x7f8f9c161570 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400ce80 tx=0x7f8f9400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.945+0000 7f8f837fe640 1 -- 172.21.15.50:0/2744035091 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9401a070 con 0x7f8f9c153310 2024-09-11T22:20:32.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.945+0000 7f8f837fe640 1 -- 172.21.15.50:0/2744035091 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9400d880 con 0x7f8f9c153310 2024-09-11T22:20:32.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.945+0000 7f8fa1282640 1 -- 172.21.15.50:0/2744035091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9c15b180 con 0x7f8f9c153310 2024-09-11T22:20:32.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.945+0000 7f8f837fe640 1 -- 172.21.15.50:0/2744035091 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9400dc70 con 0x7f8f9c153310 2024-09-11T22:20:32.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.945+0000 7f8fa1282640 1 -- 172.21.15.50:0/2744035091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9c160a90 con 0x7f8f9c153310 2024-09-11T22:20:32.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.946+0000 7f8fa1282640 1 -- 172.21.15.50:0/2744035091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f9c069760 con 0x7f8f9c153310 2024-09-11T22:20:32.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.946+0000 7f8f837fe640 1 -- 172.21.15.50:0/2744035091 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f9401d070 con 0x7f8f9c153310 2024-09-11T22:20:32.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.947+0000 7f8f837fe640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f8806be30 0x7f8f8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.947+0000 7f8f837fe640 1 -- 172.21.15.50:0/2744035091 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5795+0+0 (secure 0 0 0) 0x7f8f9408b5f0 con 0x7f8f9c153310 2024-09-11T22:20:32.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.947+0000 7f8f9affd640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f8806be30 0x7f8f8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.948+0000 7f8f9affd640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f8806be30 0x7f8f8806e2f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c034000 tx=0x7f8f8c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:32.951+0000 7f8f837fe640 1 -- 172.21.15.50:0/2744035091 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f940598f0 con 0x7f8f9c153310 2024-09-11T22:20:33.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.167+0000 7f8fa1282640 1 -- 172.21.15.50:0/2744035091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8f9c0b27f0 con 0x7f8f9c153310 2024-09-11T22:20:33.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.820+0000 7f8f837fe640 1 -- 172.21.15.50:0/2744035091 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v103) ==== 104+0+0 (secure 0 0 0) 0x7f8f9405dbf0 con 0x7f8f9c153310 2024-09-11T22:20:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.822+0000 7f8fa1282640 1 -- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f8806be30 msgr2=0x7f8f8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.822+0000 7f8fa1282640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f8806be30 0x7f8f8806e2f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c034000 tx=0x7f8f8c02e000 comp rx=0 tx=0).stop 2024-09-11T22:20:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.822+0000 7f8fa1282640 1 -- 172.21.15.50:0/2744035091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f9c153310 msgr2=0x7f8f9c161570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.822+0000 7f8fa1282640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f9c153310 0x7f8f9c161570 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400ce80 tx=0x7f8f9400a710 comp rx=0 tx=0).stop 2024-09-11T22:20:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.822+0000 7f8fa1282640 1 -- 172.21.15.50:0/2744035091 shutdown_connections 2024-09-11T22:20:33.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.822+0000 7f8fa1282640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8f8806be30 0x7f8f8806e2f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.822+0000 7f8fa1282640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f9c153310 0x7f8f9c161570 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.822+0000 7f8fa1282640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9c0af900 0x7f8f9c152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.822+0000 7f8fa1282640 1 --2- 172.21.15.50:0/2744035091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f9c06bb50 0x7f8f9c15ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.822+0000 7f8fa1282640 1 -- 172.21.15.50:0/2744035091 >> 172.21.15.50:0/2744035091 conn(0x7f8f9c0b7940 msgr2=0x7f8f9c1599f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.822+0000 7f8fa1282640 1 -- 172.21.15.50:0/2744035091 shutdown_connections 2024-09-11T22:20:33.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.822+0000 7f8fa1282640 1 -- 172.21.15.50:0/2744035091 wait complete. 2024-09-11T22:20:33.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:20:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.990+0000 7fea5a015640 1 Processor -- start 2024-09-11T22:20:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.990+0000 7fea5a015640 1 -- start start 2024-09-11T22:20:33.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.991+0000 7fea5a015640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fea540b6730 0x7fea540b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:33.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.991+0000 7fea5a015640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea540b8150 0x7fea540b8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:33.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.991+0000 7fea5a015640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea540b7990 con 0x7fea54161d60 2024-09-11T22:20:33.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.991+0000 7fea5a015640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fea540b70e0 con 0x7fea540b8150 2024-09-11T22:20:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.991+0000 7fea5a015640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fea540d4530 con 0x7fea540b6730 2024-09-11T22:20:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.991+0000 7fea53fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea540b8150 0x7fea540b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.992+0000 7fea53fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea540b8150 0x7fea540b8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55776/0 (socket says 172.21.15.50:55776) 2024-09-11T22:20:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.992+0000 7fea53fff640 1 -- 172.21.15.50:0/1775847959 learned_addr learned my addr 172.21.15.50:0/1775847959 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.992+0000 7fea52ffd640 1 --2- 172.21.15.50:0/1775847959 >> v2:172.21.15.77:3300/0 conn(0x7fea540b6730 0x7fea540b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.992+0000 7fea53fff640 1 -- 172.21.15.50:0/1775847959 >> v2:172.21.15.77:3300/0 conn(0x7fea540b6730 msgr2=0x7fea540b6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.992+0000 7fea53fff640 1 --2- 172.21.15.50:0/1775847959 >> v2:172.21.15.77:3300/0 conn(0x7fea540b6730 0x7fea540b6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.992+0000 7fea53fff640 1 -- 172.21.15.50:0/1775847959 >> v1:172.21.15.77:6789/0 conn(0x7fea54161d60 legacy=0x7fea540d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.992+0000 7fea53fff640 1 -- 172.21.15.50:0/1775847959 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea540d3f70 con 0x7fea540b8150 2024-09-11T22:20:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.992+0000 7fea52ffd640 1 --2- 172.21.15.50:0/1775847959 >> v2:172.21.15.77:3300/0 conn(0x7fea540b6730 0x7fea540b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.993+0000 7fea53fff640 1 --2- 172.21.15.50:0/1775847959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea540b8150 0x7fea540b8580 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fea54072680 tx=0x7fea4c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f39981f3fa3c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.993+0000 7fea527fc640 1 -- 172.21.15.50:0/1775847959 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c036070 con 0x7fea540b8150 2024-09-11T22:20:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.993+0000 7fea527fc640 1 -- 172.21.15.50:0/1775847959 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4c031600 con 0x7fea540b8150 2024-09-11T22:20:33.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.993+0000 7fea527fc640 1 -- 172.21.15.50:0/1775847959 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0319d0 con 0x7fea540b8150 2024-09-11T22:20:33.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.993+0000 7fea5a015640 1 -- 172.21.15.50:0/1775847959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea540b8150 msgr2=0x7fea540b8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:33.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.993+0000 7fea5a015640 1 --2- 172.21.15.50:0/1775847959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea540b8150 0x7fea540b8580 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fea54072680 tx=0x7fea4c02a660 comp rx=0 tx=0).stop 2024-09-11T22:20:33.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.993+0000 7fea5a015640 1 -- 172.21.15.50:0/1775847959 shutdown_connections 2024-09-11T22:20:33.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.993+0000 7fea5a015640 1 --2- 172.21.15.50:0/1775847959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea540b8150 0x7fea540b8580 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:33.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.993+0000 7fea5a015640 1 --2- 172.21.15.50:0/1775847959 >> v2:172.21.15.77:3300/0 conn(0x7fea540b6730 0x7fea540b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:33.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.993+0000 7fea5a015640 1 -- 172.21.15.50:0/1775847959 >> 172.21.15.50:0/1775847959 conn(0x7fea54067db0 msgr2=0x7fea540681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:33.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.993+0000 7fea5a015640 1 -- 172.21.15.50:0/1775847959 shutdown_connections 2024-09-11T22:20:33.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.993+0000 7fea5a015640 1 -- 172.21.15.50:0/1775847959 wait complete. 2024-09-11T22:20:33.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.995+0000 7fea5a015640 1 Processor -- start 2024-09-11T22:20:33.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.995+0000 7fea5a015640 1 -- start start 2024-09-11T22:20:33.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.995+0000 7fea5a015640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea540b6730 0x7fea5415e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:33.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.995+0000 7fea5a015640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea540b8150 0x7fea540cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:33.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.995+0000 7fea5a015640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea54161d60 0x7fea540cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:33.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.995+0000 7fea5a015640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea540cf930 con 0x7fea540b8150 2024-09-11T22:20:33.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.995+0000 7fea5a015640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea540b7c30 con 0x7fea540b6730 2024-09-11T22:20:33.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.995+0000 7fea5a015640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fea540d3bc0 con 0x7fea54161d60 2024-09-11T22:20:33.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea52ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea540b8150 0x7fea540cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:33.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea52ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea540b8150 0x7fea540cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55784/0 (socket says 172.21.15.50:55784) 2024-09-11T22:20:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea52ffd640 1 -- 172.21.15.50:0/1398253762 learned_addr learned my addr 172.21.15.50:0/1398253762 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea537fe640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea540b6730 0x7fea5415e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea53fff640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea54161d60 0x7fea540cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea52ffd640 1 -- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea54161d60 msgr2=0x7fea540cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea52ffd640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea54161d60 0x7fea540cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea52ffd640 1 -- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea540b6730 msgr2=0x7fea5415e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea52ffd640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea540b6730 0x7fea5415e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea52ffd640 1 -- 172.21.15.50:0/1398253762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea540cc3a0 con 0x7fea540b8150 2024-09-11T22:20:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea537fe640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea540b6730 0x7fea5415e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea52ffd640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea540b8150 0x7fea540cb830 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fea4800c7f0 tx=0x7fea4800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea3bfff640 1 -- 172.21.15.50:0/1398253762 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48015070 con 0x7fea540b8150 2024-09-11T22:20:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea3bfff640 1 -- 172.21.15.50:0/1398253762 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea48007820 con 0x7fea540b8150 2024-09-11T22:20:33.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea3bfff640 1 -- 172.21.15.50:0/1398253762 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48007bd0 con 0x7fea540b8150 2024-09-11T22:20:34.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea5a015640 1 -- 172.21.15.50:0/1398253762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea540cc680 con 0x7fea540b8150 2024-09-11T22:20:34.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.996+0000 7fea5a015640 1 -- 172.21.15.50:0/1398253762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea540cd360 con 0x7fea540b8150 2024-09-11T22:20:34.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.997+0000 7fea5a015640 1 -- 172.21.15.50:0/1398253762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea540b6ba0 con 0x7fea540b8150 2024-09-11T22:20:34.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.998+0000 7fea3bfff640 1 -- 172.21.15.50:0/1398253762 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea48018070 con 0x7fea540b8150 2024-09-11T22:20:34.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.998+0000 7fea3bfff640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fea4006be30 0x7fea4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.999+0000 7fea3bfff640 1 -- 172.21.15.50:0/1398253762 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5795+0+0 (secure 0 0 0) 0x7fea4808af70 con 0x7fea540b8150 2024-09-11T22:20:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.999+0000 7fea537fe640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fea4006be30 0x7fea4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:34.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:33.999+0000 7fea537fe640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fea4006be30 0x7fea4006e2f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fea44003eb0 tx=0x7fea44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:34.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:34.003+0000 7fea3bfff640 1 -- 172.21.15.50:0/1398253762 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea48059950 con 0x7fea540b8150 2024-09-11T22:20:34.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:34.182+0000 7fea5a015640 1 -- 172.21.15.50:0/1398253762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fea54068330 con 0x7fea540b8150 2024-09-11T22:20:35.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.152+0000 7fea3bfff640 1 -- 172.21.15.50:0/1398253762 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v146) ==== 181+0+0 (secure 0 0 0) 0x7fea48059250 con 0x7fea540b8150 2024-09-11T22:20:35.153 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:20:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.156+0000 7fea5a015640 1 -- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fea4006be30 msgr2=0x7fea4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.156+0000 7fea5a015640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fea4006be30 0x7fea4006e2f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fea44003eb0 tx=0x7fea44009040 comp rx=0 tx=0).stop 2024-09-11T22:20:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.156+0000 7fea5a015640 1 -- 172.21.15.50:0/1398253762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea540b8150 msgr2=0x7fea540cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.156+0000 7fea5a015640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea540b8150 0x7fea540cb830 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fea4800c7f0 tx=0x7fea4800ccb0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.156+0000 7fea5a015640 1 -- 172.21.15.50:0/1398253762 shutdown_connections 2024-09-11T22:20:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.156+0000 7fea5a015640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fea4006be30 0x7fea4006e2f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.156+0000 7fea5a015640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea54161d60 0x7fea540cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.156+0000 7fea5a015640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea540b8150 0x7fea540cb830 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.156+0000 7fea5a015640 1 --2- 172.21.15.50:0/1398253762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea540b6730 0x7fea5415e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.156+0000 7fea5a015640 1 -- 172.21.15.50:0/1398253762 >> 172.21.15.50:0/1398253762 conn(0x7fea54067db0 msgr2=0x7fea540b9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.157+0000 7fea5a015640 1 -- 172.21.15.50:0/1398253762 shutdown_connections 2024-09-11T22:20:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.157+0000 7fea5a015640 1 -- 172.21.15.50:0/1398253762 wait complete. 2024-09-11T22:20:35.172 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:20:35.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.288+0000 7f1091ca6640 1 Processor -- start 2024-09-11T22:20:35.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.288+0000 7f1091ca6640 1 -- start start 2024-09-11T22:20:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f1091ca6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f108c161ea0 0x7f108c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f1091ca6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f108c06f300 0x7f108c06f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f1091ca6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f108c162280 con 0x7f108c06d7a0 2024-09-11T22:20:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f1091ca6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f108c06c700 con 0x7f108c161ea0 2024-09-11T22:20:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f1091ca6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f108c06c9e0 con 0x7f108c06f300 2024-09-11T22:20:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f108b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f108c161ea0 0x7f108c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f108bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f108c06d7a0 0x7f108c0af430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43130/0 (socket says 172.21.15.50:43130) 2024-09-11T22:20:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f108bfff640 1 -- 172.21.15.50:0/1854842183 learned_addr learned my addr 172.21.15.50:0/1854842183 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f108affd640 1 --2- 172.21.15.50:0/1854842183 >> v2:172.21.15.77:3300/0 conn(0x7f108c06f300 0x7f108c06f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f108b7fe640 1 -- 172.21.15.50:0/1854842183 >> v2:172.21.15.77:3300/0 conn(0x7f108c06f300 msgr2=0x7f108c06f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f108b7fe640 1 --2- 172.21.15.50:0/1854842183 >> v2:172.21.15.77:3300/0 conn(0x7f108c06f300 0x7f108c06f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f108b7fe640 1 -- 172.21.15.50:0/1854842183 >> v1:172.21.15.50:6789/0 conn(0x7f108c06d7a0 legacy=0x7f108c0af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f108b7fe640 1 -- 172.21.15.50:0/1854842183 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c06ccc0 con 0x7f108c161ea0 2024-09-11T22:20:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f108a7fc640 1 -- 172.21.15.50:0/1854842183 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2702547737 0 0) 0x7f108c162280 con 0x7f108c06d7a0 2024-09-11T22:20:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.289+0000 7f108affd640 1 --2- 172.21.15.50:0/1854842183 >> v2:172.21.15.77:3300/0 conn(0x7f108c06f300 0x7f108c06f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:35.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.290+0000 7f108b7fe640 1 --2- 172.21.15.50:0/1854842183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108c161ea0 0x7f108c0b4c70 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f108c071550 tx=0x7f107c02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4803d6a047f13ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:35.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.290+0000 7f108a7fc640 1 -- 172.21.15.50:0/1854842183 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c037070 con 0x7f108c161ea0 2024-09-11T22:20:35.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.290+0000 7f108a7fc640 1 -- 172.21.15.50:0/1854842183 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c02add0 con 0x7f108c161ea0 2024-09-11T22:20:35.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.290+0000 7f108a7fc640 1 -- 172.21.15.50:0/1854842183 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c032660 con 0x7f108c161ea0 2024-09-11T22:20:35.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.291+0000 7f1091ca6640 1 -- 172.21.15.50:0/1854842183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108c161ea0 msgr2=0x7f108c0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:35.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.291+0000 7f1091ca6640 1 --2- 172.21.15.50:0/1854842183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108c161ea0 0x7f108c0b4c70 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f108c071550 tx=0x7f107c02a080 comp rx=0 tx=0).stop 2024-09-11T22:20:35.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.291+0000 7f1091ca6640 1 -- 172.21.15.50:0/1854842183 shutdown_connections 2024-09-11T22:20:35.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.291+0000 7f1091ca6640 1 --2- 172.21.15.50:0/1854842183 >> v2:172.21.15.77:3300/0 conn(0x7f108c06f300 0x7f108c06f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.291+0000 7f1091ca6640 1 --2- 172.21.15.50:0/1854842183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108c161ea0 0x7f108c0b4c70 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.291+0000 7f1091ca6640 1 -- 172.21.15.50:0/1854842183 >> 172.21.15.50:0/1854842183 conn(0x7f108c0b4150 msgr2=0x7f108c0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:35.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.291+0000 7f1091ca6640 1 -- 172.21.15.50:0/1854842183 shutdown_connections 2024-09-11T22:20:35.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.291+0000 7f1091ca6640 1 -- 172.21.15.50:0/1854842183 wait complete. 2024-09-11T22:20:35.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.292+0000 7f1091ca6640 1 Processor -- start 2024-09-11T22:20:35.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.292+0000 7f1091ca6640 1 -- start start 2024-09-11T22:20:35.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.293+0000 7f1091ca6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108c06d7a0 0x7f108c1f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:35.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.293+0000 7f1091ca6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f108c06f300 0x7f108c15b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:35.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.293+0000 7f1091ca6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f108c161ea0 0x7f108c0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:35.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.293+0000 7f1091ca6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f108c06fde0 con 0x7f108c06d7a0 2024-09-11T22:20:35.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.293+0000 7f1091ca6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f108c06d280 con 0x7f108c161ea0 2024-09-11T22:20:35.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.293+0000 7f1091ca6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f108c06ff60 con 0x7f108c06f300 2024-09-11T22:20:35.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.293+0000 7f108b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108c06d7a0 0x7f108c1f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:35.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.293+0000 7f108b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108c06d7a0 0x7f108c1f48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55800/0 (socket says 172.21.15.50:55800) 2024-09-11T22:20:35.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.293+0000 7f108b7fe640 1 -- 172.21.15.50:0/3759386089 learned_addr learned my addr 172.21.15.50:0/3759386089 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:35.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.293+0000 7f108affd640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f108c06f300 0x7f108c15b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:35.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.293+0000 7f108bfff640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f108c161ea0 0x7f108c0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:35.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.294+0000 7f108b7fe640 1 -- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f108c06f300 msgr2=0x7f108c15b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.294+0000 7f108b7fe640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f108c06f300 0x7f108c15b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.294+0000 7f108b7fe640 1 -- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f108c161ea0 msgr2=0x7f108c0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.294+0000 7f108b7fe640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f108c161ea0 0x7f108c0c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.294+0000 7f108b7fe640 1 -- 172.21.15.50:0/3759386089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c0c81c0 con 0x7f108c06d7a0 2024-09-11T22:20:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.294+0000 7f108bfff640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f108c161ea0 0x7f108c0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.294+0000 7f108b7fe640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108c06d7a0 0x7f108c1f48c0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f107c000c00 tx=0x7f107c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.294+0000 7f1073fff640 1 -- 172.21.15.50:0/3759386089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c037050 con 0x7f108c06d7a0 2024-09-11T22:20:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.294+0000 7f1073fff640 1 -- 172.21.15.50:0/3759386089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c038040 con 0x7f108c06d7a0 2024-09-11T22:20:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.294+0000 7f1091ca6640 1 -- 172.21.15.50:0/3759386089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f108c0b54f0 con 0x7f108c06d7a0 2024-09-11T22:20:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.294+0000 7f1073fff640 1 -- 172.21.15.50:0/3759386089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c004270 con 0x7f108c06d7a0 2024-09-11T22:20:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.294+0000 7f1091ca6640 1 -- 172.21.15.50:0/3759386089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f108c0b5ab0 con 0x7f108c06d7a0 2024-09-11T22:20:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.295+0000 7f1091ca6640 1 -- 172.21.15.50:0/3759386089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f108c1615b0 con 0x7f108c06d7a0 2024-09-11T22:20:35.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.296+0000 7f1073fff640 1 -- 172.21.15.50:0/3759386089 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f107c003610 con 0x7f108c06d7a0 2024-09-11T22:20:35.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.296+0000 7f1073fff640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f107806be30 0x7f107806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:35.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.296+0000 7f1073fff640 1 -- 172.21.15.50:0/3759386089 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5357+0+0 (secure 0 0 0) 0x7f107c0ab410 con 0x7f108c06d7a0 2024-09-11T22:20:35.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.296+0000 7f108affd640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f107806be30 0x7f107806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:35.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.297+0000 7f108affd640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f107806be30 0x7f107806e2f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f108c15e920 tx=0x7f1080008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:35.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.300+0000 7f1073fff640 1 -- 172.21.15.50:0/3759386089 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f107c079f20 con 0x7f108c06d7a0 2024-09-11T22:20:35.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:35.477+0000 7f1091ca6640 1 -- 172.21.15.50:0/3759386089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f108c0b2280 con 0x7f108c06d7a0 2024-09-11T22:20:36.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.158+0000 7f1073fff640 1 -- 172.21.15.50:0/3759386089 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v147) ==== 169+0+0 (secure 0 0 0) 0x7f107c079820 con 0x7f108c06d7a0 2024-09-11T22:20:36.159 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:20:36.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.162+0000 7f1091ca6640 1 -- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f107806be30 msgr2=0x7f107806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:36.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.162+0000 7f1091ca6640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f107806be30 0x7f107806e2f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f108c15e920 tx=0x7f1080008040 comp rx=0 tx=0).stop 2024-09-11T22:20:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.162+0000 7f1091ca6640 1 -- 172.21.15.50:0/3759386089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108c06d7a0 msgr2=0x7f108c1f48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.162+0000 7f1091ca6640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108c06d7a0 0x7f108c1f48c0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f107c000c00 tx=0x7f107c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.162+0000 7f1091ca6640 1 -- 172.21.15.50:0/3759386089 shutdown_connections 2024-09-11T22:20:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.162+0000 7f1091ca6640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f107806be30 0x7f107806e2f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.162+0000 7f1091ca6640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f108c06f300 0x7f108c15b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.162+0000 7f1091ca6640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f108c161ea0 0x7f108c0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.162+0000 7f1091ca6640 1 --2- 172.21.15.50:0/3759386089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108c06d7a0 0x7f108c1f48c0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.162+0000 7f1091ca6640 1 -- 172.21.15.50:0/3759386089 >> 172.21.15.50:0/3759386089 conn(0x7f108c0b4150 msgr2=0x7f108c070320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.163+0000 7f1091ca6640 1 -- 172.21.15.50:0/3759386089 shutdown_connections 2024-09-11T22:20:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.163+0000 7f1091ca6640 1 -- 172.21.15.50:0/3759386089 wait complete. 2024-09-11T22:20:36.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T22:20:36.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.291+0000 7f9bfc6dd640 1 Processor -- start 2024-09-11T22:20:36.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.291+0000 7f9bfc6dd640 1 -- start start 2024-09-11T22:20:36.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.292+0000 7f9bfc6dd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9bf4162b40 0x7f9bf4167030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:36.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.292+0000 7f9bfc6dd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9bf4068510 0x7f9bf40d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:36.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.293+0000 7f9bfc6dd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf40cedd0 con 0x7f9bf40b75d0 2024-09-11T22:20:36.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.293+0000 7f9bfc6dd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf4162f20 con 0x7f9bf4162b40 2024-09-11T22:20:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.293+0000 7f9bfc6dd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf40d4230 con 0x7f9bf4068510 2024-09-11T22:20:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.294+0000 7f9bfac7a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9bf40b75d0 0x7f9bf40d28d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43132/0 (socket says 172.21.15.50:43132) 2024-09-11T22:20:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.294+0000 7f9bfac7a640 1 -- 172.21.15.50:0/2427878097 learned_addr learned my addr 172.21.15.50:0/2427878097 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.294+0000 7f9bf9c78640 1 --2- 172.21.15.50:0/2427878097 >> v2:172.21.15.77:3300/0 conn(0x7f9bf4068510 0x7f9bf40d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:36.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.295+0000 7f9bfa479640 1 --2- 172.21.15.50:0/2427878097 >> v2:172.21.15.50:3300/0 conn(0x7f9bf4162b40 0x7f9bf4167030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:36.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.295+0000 7f9bfa479640 1 -- 172.21.15.50:0/2427878097 >> v2:172.21.15.77:3300/0 conn(0x7f9bf4068510 msgr2=0x7f9bf40d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:36.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.295+0000 7f9bfa479640 1 --2- 172.21.15.50:0/2427878097 >> v2:172.21.15.77:3300/0 conn(0x7f9bf4068510 0x7f9bf40d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.295+0000 7f9bfa479640 1 -- 172.21.15.50:0/2427878097 >> v1:172.21.15.50:6789/0 conn(0x7f9bf40b75d0 legacy=0x7f9bf40d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:36.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.295+0000 7f9bfa479640 1 -- 172.21.15.50:0/2427878097 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf40cf090 con 0x7f9bf4162b40 2024-09-11T22:20:36.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.295+0000 7f9bf9c78640 1 --2- 172.21.15.50:0/2427878097 >> v2:172.21.15.77:3300/0 conn(0x7f9bf4068510 0x7f9bf40d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:36.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.298+0000 7f9bfa479640 1 --2- 172.21.15.50:0/2427878097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf4162b40 0x7f9bf4167030 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4068280 tx=0x7f9bf002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66682d3ce9453da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:36.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.299+0000 7f9bf9477640 1 -- 172.21.15.50:0/2427878097 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0036070 con 0x7f9bf4162b40 2024-09-11T22:20:36.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.299+0000 7f9bf9477640 1 -- 172.21.15.50:0/2427878097 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf0031600 con 0x7f9bf4162b40 2024-09-11T22:20:36.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.299+0000 7f9bf9477640 1 -- 172.21.15.50:0/2427878097 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0036070 con 0x7f9bf4162b40 2024-09-11T22:20:36.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.301+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/2427878097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf4162b40 msgr2=0x7f9bf4167030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:36.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.301+0000 7f9bfc6dd640 1 --2- 172.21.15.50:0/2427878097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf4162b40 0x7f9bf4167030 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4068280 tx=0x7f9bf002a420 comp rx=0 tx=0).stop 2024-09-11T22:20:36.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.304+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/2427878097 shutdown_connections 2024-09-11T22:20:36.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.304+0000 7f9bfc6dd640 1 --2- 172.21.15.50:0/2427878097 >> v2:172.21.15.77:3300/0 conn(0x7f9bf4068510 0x7f9bf40d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.304+0000 7f9bfc6dd640 1 --2- 172.21.15.50:0/2427878097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf4162b40 0x7f9bf4167030 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.304+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/2427878097 >> 172.21.15.50:0/2427878097 conn(0x7f9bf40727a0 msgr2=0x7f9bf40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:36.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.306+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/2427878097 shutdown_connections 2024-09-11T22:20:36.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.306+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/2427878097 wait complete. 2024-09-11T22:20:36.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.308+0000 7f9bfc6dd640 1 Processor -- start 2024-09-11T22:20:36.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.308+0000 7f9bfc6dd640 1 -- start start 2024-09-11T22:20:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.310+0000 7f9bfc6dd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bf4068510 0x7f9bf4164aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:36.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.310+0000 7f9bfc6dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf40b75d0 0x7f9bf40c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:36.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.310+0000 7f9bfc6dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bf4162b40 0x7f9bf40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:36.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.310+0000 7f9bf9c78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf40b75d0 0x7f9bf40c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:36.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.310+0000 7f9bf9c78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf40b75d0 0x7f9bf40c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55818/0 (socket says 172.21.15.50:55818) 2024-09-11T22:20:36.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.310+0000 7f9bf9c78640 1 -- 172.21.15.50:0/1269987427 learned_addr learned my addr 172.21.15.50:0/1269987427 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:36.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.310+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/1269987427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40cf7d0 con 0x7f9bf40b75d0 2024-09-11T22:20:36.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.310+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/1269987427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40cf650 con 0x7f9bf4162b40 2024-09-11T22:20:36.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.310+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/1269987427 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf40d16d0 con 0x7f9bf4068510 2024-09-11T22:20:36.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.311+0000 7f9bfac7a640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bf4162b40 0x7f9bf40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:36.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.311+0000 7f9bfa479640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bf4068510 0x7f9bf4164aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:36.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.311+0000 7f9bf9c78640 1 -- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bf4068510 msgr2=0x7f9bf4164aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.311+0000 7f9bf9c78640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bf4068510 0x7f9bf4164aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.311+0000 7f9bf9c78640 1 -- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bf4162b40 msgr2=0x7f9bf40b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.311+0000 7f9bf9c78640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bf4162b40 0x7f9bf40b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.311+0000 7f9bf9c78640 1 -- 172.21.15.50:0/1269987427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf40c7fa0 con 0x7f9bf40b75d0 2024-09-11T22:20:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.311+0000 7f9bfa479640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bf4068510 0x7f9bf4164aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.311+0000 7f9bf9c78640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf40b75d0 0x7f9bf40c9ac0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f9be400ebe0 tx=0x7f9be400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:36.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.312+0000 7f9beaffd640 1 -- 172.21.15.50:0/1269987427 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4017070 con 0x7f9bf40b75d0 2024-09-11T22:20:36.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.313+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/1269987427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf40c8240 con 0x7f9bf40b75d0 2024-09-11T22:20:36.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.313+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/1269987427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf40c8800 con 0x7f9bf40b75d0 2024-09-11T22:20:36.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.313+0000 7f9beaffd640 1 -- 172.21.15.50:0/1269987427 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be400cc30 con 0x7f9bf40b75d0 2024-09-11T22:20:36.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.313+0000 7f9beaffd640 1 -- 172.21.15.50:0/1269987427 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4013470 con 0x7f9bf40b75d0 2024-09-11T22:20:36.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.319+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/1269987427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bdc005290 con 0x7f9bf40b75d0 2024-09-11T22:20:36.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.320+0000 7f9beaffd640 1 -- 172.21.15.50:0/1269987427 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9be401a070 con 0x7f9bf40b75d0 2024-09-11T22:20:36.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.321+0000 7f9beaffd640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9bd806bf00 0x7f9bd806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:36.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.321+0000 7f9beaffd640 1 -- 172.21.15.50:0/1269987427 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 4943+0+0 (secure 0 0 0) 0x7f9be408a970 con 0x7f9bf40b75d0 2024-09-11T22:20:36.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.322+0000 7f9bfa479640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9bd806bf00 0x7f9bd806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:36.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.323+0000 7f9bfa479640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9bd806bf00 0x7f9bd806e3c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0033000 tx=0x7f9bf0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:36.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.328+0000 7f9beaffd640 1 -- 172.21.15.50:0/1269987427 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9be4059040 con 0x7f9bf40b75d0 2024-09-11T22:20:36.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.507+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/1269987427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f9bdc005d90 con 0x7f9bf40b75d0 2024-09-11T22:20:36.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.510+0000 7f9beaffd640 1 -- 172.21.15.50:0/1269987427 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v41) ==== 104+0+0 (secure 0 0 0) 0x7f9be405d340 con 0x7f9bf40b75d0 2024-09-11T22:20:36.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.512+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9bd806bf00 msgr2=0x7f9bd806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:36.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.512+0000 7f9bfc6dd640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9bd806bf00 0x7f9bd806e3c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0033000 tx=0x7f9bf0008030 comp rx=0 tx=0).stop 2024-09-11T22:20:36.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.512+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/1269987427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf40b75d0 msgr2=0x7f9bf40c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:36.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.512+0000 7f9bfc6dd640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf40b75d0 0x7f9bf40c9ac0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f9be400ebe0 tx=0x7f9be400c520 comp rx=0 tx=0).stop 2024-09-11T22:20:36.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.512+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/1269987427 shutdown_connections 2024-09-11T22:20:36.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.512+0000 7f9bfc6dd640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9bd806bf00 0x7f9bd806e3c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.512+0000 7f9bfc6dd640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bf4162b40 0x7f9bf40b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.512+0000 7f9bfc6dd640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bf40b75d0 0x7f9bf40c9ac0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.512+0000 7f9bfc6dd640 1 --2- 172.21.15.50:0/1269987427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bf4068510 0x7f9bf4164aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.512+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/1269987427 >> 172.21.15.50:0/1269987427 conn(0x7f9bf40727a0 msgr2=0x7f9bf4151630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:36.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.512+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/1269987427 shutdown_connections 2024-09-11T22:20:36.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.512+0000 7f9bfc6dd640 1 -- 172.21.15.50:0/1269987427 wait complete. 2024-09-11T22:20:36.524 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-11T22:20:36.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.626+0000 7eff1492a640 1 Processor -- start 2024-09-11T22:20:36.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.626+0000 7eff1492a640 1 -- start start 2024-09-11T22:20:36.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.627+0000 7eff1492a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff10161d30 0x7eff100cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:36.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.627+0000 7eff1492a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff100b78f0 0x7eff10162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:36.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.627+0000 7eff1492a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff101632e0 con 0x7eff100d11d0 2024-09-11T22:20:36.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.627+0000 7eff1492a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7eff100d3450 con 0x7eff100b78f0 2024-09-11T22:20:36.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.627+0000 7eff1492a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7eff10162110 con 0x7eff10161d30 2024-09-11T22:20:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.628+0000 7eff0e59c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff10161d30 0x7eff100cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.628+0000 7eff0dd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff100b78f0 0x7eff10162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.628+0000 7eff0e59c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff10161d30 0x7eff100cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:37032/0 (socket says 172.21.15.50:37032) 2024-09-11T22:20:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.628+0000 7eff0ed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7eff100d11d0 0x7eff100d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:49124/0 (socket says 172.21.15.50:49124) 2024-09-11T22:20:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.628+0000 7eff0e59c640 1 -- 172.21.15.50:0/2310330315 learned_addr learned my addr 172.21.15.50:0/2310330315 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.628+0000 7eff0e59c640 1 -- 172.21.15.50:0/2310330315 >> v2:172.21.15.77:3300/0 conn(0x7eff100b78f0 msgr2=0x7eff10162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.628+0000 7eff0e59c640 1 --2- 172.21.15.50:0/2310330315 >> v2:172.21.15.77:3300/0 conn(0x7eff100b78f0 0x7eff10162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.628+0000 7eff0e59c640 1 -- 172.21.15.50:0/2310330315 >> v1:172.21.15.77:6789/0 conn(0x7eff100d11d0 legacy=0x7eff100d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:36.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.628+0000 7eff0e59c640 1 -- 172.21.15.50:0/2310330315 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff100cfd70 con 0x7eff10161d30 2024-09-11T22:20:36.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.628+0000 7eff0dd9b640 1 --2- 172.21.15.50:0/2310330315 >> v2:172.21.15.77:3300/0 conn(0x7eff100b78f0 0x7eff10162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:36.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.629+0000 7eff0e59c640 1 --2- 172.21.15.50:0/2310330315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff10161d30 0x7eff100cf790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff00009e50 tx=0x7eff0002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b7957c9e9011268 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:36.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.629+0000 7eff0d59a640 1 -- 172.21.15.50:0/2310330315 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00036070 con 0x7eff10161d30 2024-09-11T22:20:36.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.629+0000 7eff0d59a640 1 -- 172.21.15.50:0/2310330315 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff00031600 con 0x7eff10161d30 2024-09-11T22:20:36.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.629+0000 7eff0d59a640 1 -- 172.21.15.50:0/2310330315 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff000319d0 con 0x7eff10161d30 2024-09-11T22:20:36.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.629+0000 7eff1492a640 1 -- 172.21.15.50:0/2310330315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff10161d30 msgr2=0x7eff100cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:36.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.629+0000 7eff1492a640 1 --2- 172.21.15.50:0/2310330315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff10161d30 0x7eff100cf790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff00009e50 tx=0x7eff0002a710 comp rx=0 tx=0).stop 2024-09-11T22:20:36.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.630+0000 7eff1492a640 1 -- 172.21.15.50:0/2310330315 shutdown_connections 2024-09-11T22:20:36.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.630+0000 7eff1492a640 1 --2- 172.21.15.50:0/2310330315 >> v2:172.21.15.77:3300/0 conn(0x7eff100b78f0 0x7eff10162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.630+0000 7eff1492a640 1 --2- 172.21.15.50:0/2310330315 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff10161d30 0x7eff100cf790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.630+0000 7eff1492a640 1 -- 172.21.15.50:0/2310330315 >> 172.21.15.50:0/2310330315 conn(0x7eff100727a0 msgr2=0x7eff100679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:36.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.630+0000 7eff1492a640 1 -- 172.21.15.50:0/2310330315 shutdown_connections 2024-09-11T22:20:36.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.630+0000 7eff1492a640 1 -- 172.21.15.50:0/2310330315 wait complete. 2024-09-11T22:20:36.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.631+0000 7eff1492a640 1 Processor -- start 2024-09-11T22:20:36.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.631+0000 7eff1492a640 1 -- start start 2024-09-11T22:20:36.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff1492a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff100b78f0 0x7eff1015be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:36.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff1492a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100d11d0 0x7eff100b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:36.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff1492a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff10161d30 0x7eff100b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:36.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff1492a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7eff100d30e0 con 0x7eff100d11d0 2024-09-11T22:20:36.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff1492a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7eff100d2e00 con 0x7eff10161d30 2024-09-11T22:20:36.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff1492a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7eff100b7d30 con 0x7eff100b78f0 2024-09-11T22:20:36.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff0dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100d11d0 0x7eff100b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:36.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff0dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100d11d0 0x7eff100b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55824/0 (socket says 172.21.15.50:55824) 2024-09-11T22:20:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff0dd9b640 1 -- 172.21.15.50:0/1569529367 learned_addr learned my addr 172.21.15.50:0/1569529367 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff0e59c640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff100b78f0 0x7eff1015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff0ed9d640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff10161d30 0x7eff100b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff0dd9b640 1 -- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff100b78f0 msgr2=0x7eff1015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff0dd9b640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff100b78f0 0x7eff1015be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff0dd9b640 1 -- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff10161d30 msgr2=0x7eff100b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff0dd9b640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff10161d30 0x7eff100b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff0dd9b640 1 -- 172.21.15.50:0/1569529367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff100b5560 con 0x7eff100d11d0 2024-09-11T22:20:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff0dd9b640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100d11d0 0x7eff100b64a0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7efef800ebb0 tx=0x7efef800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.632+0000 7eff06ffd640 1 -- 172.21.15.50:0/1569529367 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8017070 con 0x7eff100d11d0 2024-09-11T22:20:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.633+0000 7eff06ffd640 1 -- 172.21.15.50:0/1569529367 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef800cc30 con 0x7eff100d11d0 2024-09-11T22:20:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.633+0000 7eff1492a640 1 -- 172.21.15.50:0/1569529367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff100c8410 con 0x7eff100d11d0 2024-09-11T22:20:36.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.633+0000 7eff06ffd640 1 -- 172.21.15.50:0/1569529367 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8013470 con 0x7eff100d11d0 2024-09-11T22:20:36.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.633+0000 7eff1492a640 1 -- 172.21.15.50:0/1569529367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff100c89d0 con 0x7eff100d11d0 2024-09-11T22:20:36.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.634+0000 7eff1492a640 1 -- 172.21.15.50:0/1569529367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff10162da0 con 0x7eff100d11d0 2024-09-11T22:20:36.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.634+0000 7eff06ffd640 1 -- 172.21.15.50:0/1569529367 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efef801a070 con 0x7eff100d11d0 2024-09-11T22:20:36.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.635+0000 7eff06ffd640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efef006be60 0x7efef006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:36.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.635+0000 7eff06ffd640 1 -- 172.21.15.50:0/1569529367 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 4943+0+0 (secure 0 0 0) 0x7efef808ada0 con 0x7eff100d11d0 2024-09-11T22:20:36.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.635+0000 7eff0e59c640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efef006be60 0x7efef006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:36.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.635+0000 7eff0e59c640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efef006be60 0x7efef006e320 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7eff00033000 tx=0x7eff00009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:36.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.639+0000 7eff06ffd640 1 -- 172.21.15.50:0/1569529367 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efef8059ae0 con 0x7eff100d11d0 2024-09-11T22:20:36.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:36.885+0000 7eff1492a640 1 -- 172.21.15.50:0/1569529367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7eff100d4a50 con 0x7eff100d11d0 2024-09-11T22:20:37.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.159+0000 7eff06ffd640 1 -- 172.21.15.50:0/1569529367 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v458) ==== 166+0+0 (secure 0 0 0) 0x7efef80593e0 con 0x7eff100d11d0 2024-09-11T22:20:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.162+0000 7eff1492a640 1 -- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efef006be60 msgr2=0x7efef006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.162+0000 7eff1492a640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efef006be60 0x7efef006e320 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7eff00033000 tx=0x7eff00009000 comp rx=0 tx=0).stop 2024-09-11T22:20:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.162+0000 7eff1492a640 1 -- 172.21.15.50:0/1569529367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100d11d0 msgr2=0x7eff100b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.162+0000 7eff1492a640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100d11d0 0x7eff100b64a0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7efef800ebb0 tx=0x7efef800c520 comp rx=0 tx=0).stop 2024-09-11T22:20:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.162+0000 7eff1492a640 1 -- 172.21.15.50:0/1569529367 shutdown_connections 2024-09-11T22:20:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.162+0000 7eff1492a640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efef006be60 0x7efef006e320 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.162+0000 7eff1492a640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff10161d30 0x7eff100b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.162+0000 7eff1492a640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff100d11d0 0x7eff100b64a0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.162+0000 7eff1492a640 1 --2- 172.21.15.50:0/1569529367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff100b78f0 0x7eff1015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.162+0000 7eff1492a640 1 -- 172.21.15.50:0/1569529367 >> 172.21.15.50:0/1569529367 conn(0x7eff100727a0 msgr2=0x7eff100d38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:37.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.162+0000 7eff1492a640 1 -- 172.21.15.50:0/1569529367 shutdown_connections 2024-09-11T22:20:37.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.162+0000 7eff1492a640 1 -- 172.21.15.50:0/1569529367 wait complete. 2024-09-11T22:20:37.174 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-11T22:20:37.175 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-11T22:20:37.175 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:37.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.277+0000 7f90ac5f1640 1 Processor -- start 2024-09-11T22:20:37.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.277+0000 7f90ac5f1640 1 -- start start 2024-09-11T22:20:37.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90ac5f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a415e870 0x7f90a40d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90ac5f1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f90a40d16d0 0x7f90a40d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90ac5f1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90a40cfa80 con 0x7f90a40d3a30 2024-09-11T22:20:37.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90ac5f1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f90a40d3ea0 con 0x7f90a40d16d0 2024-09-11T22:20:37.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90ac5f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f90a40d1b10 con 0x7f90a415e870 2024-09-11T22:20:37.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90a9b8c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f90a40d16d0 0x7f90a40d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90a9b8c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f90a40d16d0 0x7f90a40d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55826/0 (socket says 172.21.15.50:55826) 2024-09-11T22:20:37.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90a9b8c640 1 -- 172.21.15.50:0/2653740833 learned_addr learned my addr 172.21.15.50:0/2653740833 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:37.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90aa38d640 1 --2- 172.21.15.50:0/2653740833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a415e870 0x7f90a40d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90a9b8c640 1 -- 172.21.15.50:0/2653740833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a415e870 msgr2=0x7f90a40d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:37.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90a9b8c640 1 --2- 172.21.15.50:0/2653740833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a415e870 0x7f90a40d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90a9b8c640 1 -- 172.21.15.50:0/2653740833 >> v1:172.21.15.50:6789/0 conn(0x7f90a40d3a30 legacy=0x7f90a40b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90a938b640 1 -- 172.21.15.50:0/2653740833 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 451262335 0 0) 0x7f9094001490 con 0x7f90a40d3a30 2024-09-11T22:20:37.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.278+0000 7f90a9b8c640 1 -- 172.21.15.50:0/2653740833 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a40d40d0 con 0x7f90a40d16d0 2024-09-11T22:20:37.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.279+0000 7f90a9b8c640 1 --2- 172.21.15.50:0/2653740833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a40d16d0 0x7f90a40d34f0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f9098009870 tx=0x7f909802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2844f6ceee3bf171 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.279+0000 7f90a938b640 1 -- 172.21.15.50:0/2653740833 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098037070 con 0x7f90a40d16d0 2024-09-11T22:20:37.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.279+0000 7f90a938b640 1 -- 172.21.15.50:0/2653740833 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9098032440 con 0x7f90a40d16d0 2024-09-11T22:20:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.279+0000 7f90a938b640 1 -- 172.21.15.50:0/2653740833 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098032810 con 0x7f90a40d16d0 2024-09-11T22:20:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.280+0000 7f90ac5f1640 1 -- 172.21.15.50:0/2653740833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a40d16d0 msgr2=0x7f90a40d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.280+0000 7f90ac5f1640 1 --2- 172.21.15.50:0/2653740833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a40d16d0 0x7f90a40d34f0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f9098009870 tx=0x7f909802a270 comp rx=0 tx=0).stop 2024-09-11T22:20:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.280+0000 7f90ac5f1640 1 -- 172.21.15.50:0/2653740833 shutdown_connections 2024-09-11T22:20:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.280+0000 7f90ac5f1640 1 --2- 172.21.15.50:0/2653740833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a40d16d0 0x7f90a40d34f0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.280+0000 7f90ac5f1640 1 --2- 172.21.15.50:0/2653740833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a415e870 0x7f90a40d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.280+0000 7f90ac5f1640 1 -- 172.21.15.50:0/2653740833 >> 172.21.15.50:0/2653740833 conn(0x7f90a40727a0 msgr2=0x7f90a40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.280+0000 7f90ac5f1640 1 -- 172.21.15.50:0/2653740833 shutdown_connections 2024-09-11T22:20:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.280+0000 7f90ac5f1640 1 -- 172.21.15.50:0/2653740833 wait complete. 2024-09-11T22:20:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.281+0000 7f90ac5f1640 1 Processor -- start 2024-09-11T22:20:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.281+0000 7f90ac5f1640 1 -- start start 2024-09-11T22:20:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90ac5f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a40d16d0 0x7f90a4158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90ac5f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a40d3a30 0x7f90a40b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90ac5f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a415e870 0x7f90a40b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90ac5f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f90a40b7ee0 con 0x7f90a40d16d0 2024-09-11T22:20:37.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90ac5f1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f90a40b7c00 con 0x7f90a40d3a30 2024-09-11T22:20:37.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90ac5f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f90a415ec50 con 0x7f90a415e870 2024-09-11T22:20:37.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90aa38d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a40d16d0 0x7f90a4158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90aa38d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a40d16d0 0x7f90a4158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55834/0 (socket says 172.21.15.50:55834) 2024-09-11T22:20:37.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90aa38d640 1 -- 172.21.15.50:0/206670162 learned_addr learned my addr 172.21.15.50:0/206670162 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:37.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90aa38d640 1 -- 172.21.15.50:0/206670162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a415e870 msgr2=0x7f90a40b6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90aa38d640 1 --2- 172.21.15.50:0/206670162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a415e870 0x7f90a40b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90aa38d640 1 -- 172.21.15.50:0/206670162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a40d3a30 msgr2=0x7f90a40b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90aa38d640 1 --2- 172.21.15.50:0/206670162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a40d3a30 0x7f90a40b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90aa38d640 1 -- 172.21.15.50:0/206670162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a41f4760 con 0x7f90a40d16d0 2024-09-11T22:20:37.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90aa38d640 1 --2- 172.21.15.50:0/206670162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a40d16d0 0x7f90a4158050 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f909c00e8a0 tx=0x7f909c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90a2ffd640 1 -- 172.21.15.50:0/206670162 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c017070 con 0x7f90a40d16d0 2024-09-11T22:20:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90a2ffd640 1 -- 172.21.15.50:0/206670162 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f909c00c940 con 0x7f90a40d16d0 2024-09-11T22:20:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90ac5f1640 1 -- 172.21.15.50:0/206670162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a41f4a40 con 0x7f90a40d16d0 2024-09-11T22:20:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90a2ffd640 1 -- 172.21.15.50:0/206670162 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c00cd30 con 0x7f90a40d16d0 2024-09-11T22:20:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.282+0000 7f90ac5f1640 1 -- 172.21.15.50:0/206670162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a41f5000 con 0x7f90a40d16d0 2024-09-11T22:20:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.284+0000 7f90ac5f1640 1 -- 172.21.15.50:0/206670162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a40b78b0 con 0x7f90a40d16d0 2024-09-11T22:20:37.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.284+0000 7f90a2ffd640 1 -- 172.21.15.50:0/206670162 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f909c01a070 con 0x7f90a40d16d0 2024-09-11T22:20:37.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.284+0000 7f90a2ffd640 1 --2- 172.21.15.50:0/206670162 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f909006be60 0x7f909006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.284+0000 7f90a2ffd640 1 -- 172.21.15.50:0/206670162 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 4943+0+0 (secure 0 0 0) 0x7f909c08aca0 con 0x7f90a40d16d0 2024-09-11T22:20:37.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.285+0000 7f90a9b8c640 1 --2- 172.21.15.50:0/206670162 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f909006be60 0x7f909006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.285+0000 7f90a9b8c640 1 --2- 172.21.15.50:0/206670162 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f909006be60 0x7f909006e320 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9098034000 tx=0x7f909802c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.289+0000 7f90a2ffd640 1 -- 172.21.15.50:0/206670162 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f909c0599e0 con 0x7f90a40d16d0 2024-09-11T22:20:37.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.467+0000 7f90ac5f1640 1 -- 172.21.15.50:0/206670162 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90a4067b50 con 0x7f90a40d16d0 2024-09-11T22:20:37.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.468+0000 7f90a2ffd640 1 -- 172.21.15.50:0/206670162 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) ==== 74+0+13006 (secure 0 0 0) 0x7f909c0592e0 con 0x7f90a40d16d0 2024-09-11T22:20:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:37.469 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":147,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:20:36.153918+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/3729591942":"2024-09-12T22:20:32.817789+0000","172.21.15.50:6833/3729591942":"2024-09-12T22:20:32.817789+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.470+0000 7f90ac5f1640 1 -- 172.21.15.50:0/206670162 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f909006be60 msgr2=0x7f909006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.470+0000 7f90ac5f1640 1 --2- 172.21.15.50:0/206670162 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f909006be60 0x7f909006e320 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9098034000 tx=0x7f909802c000 comp rx=0 tx=0).stop 2024-09-11T22:20:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.470+0000 7f90ac5f1640 1 -- 172.21.15.50:0/206670162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a40d16d0 msgr2=0x7f90a4158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.470+0000 7f90ac5f1640 1 --2- 172.21.15.50:0/206670162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a40d16d0 0x7f90a4158050 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f909c00e8a0 tx=0x7f909c00ed60 comp rx=0 tx=0).stop 2024-09-11T22:20:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.470+0000 7f90ac5f1640 1 -- 172.21.15.50:0/206670162 shutdown_connections 2024-09-11T22:20:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.470+0000 7f90ac5f1640 1 --2- 172.21.15.50:0/206670162 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f909006be60 0x7f909006e320 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.470+0000 7f90ac5f1640 1 --2- 172.21.15.50:0/206670162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a415e870 0x7f90a40b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.470+0000 7f90ac5f1640 1 --2- 172.21.15.50:0/206670162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a40d3a30 0x7f90a40b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.470+0000 7f90ac5f1640 1 --2- 172.21.15.50:0/206670162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a40d16d0 0x7f90a4158050 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.470+0000 7f90ac5f1640 1 -- 172.21.15.50:0/206670162 >> 172.21.15.50:0/206670162 conn(0x7f90a40727a0 msgr2=0x7f90a40b9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:37.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.470+0000 7f90ac5f1640 1 -- 172.21.15.50:0/206670162 shutdown_connections 2024-09-11T22:20:37.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.470+0000 7f90ac5f1640 1 -- 172.21.15.50:0/206670162 wait complete. 2024-09-11T22:20:37.482 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:11:03.407373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:20:37.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:20:37.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.586+0000 7fe9ce511640 1 Processor -- start 2024-09-11T22:20:37.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.586+0000 7fe9ce511640 1 -- start start 2024-09-11T22:20:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.587+0000 7fe9ce511640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9c815e870 0x7fe9c80d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.587+0000 7fe9ce511640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9c80d16d0 0x7fe9c80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.587+0000 7fe9ce511640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c80cfa80 con 0x7fe9c80d3a30 2024-09-11T22:20:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.587+0000 7fe9ce511640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c80d3ea0 con 0x7fe9c80d16d0 2024-09-11T22:20:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.587+0000 7fe9ce511640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c80d1b10 con 0x7fe9c815e870 2024-09-11T22:20:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.587+0000 7fe9c77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe9c80d16d0 0x7fe9c80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.587+0000 7fe9ccaae640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe9c80d3a30 0x7fe9c80b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54664/0 (socket says 172.21.15.50:54664) 2024-09-11T22:20:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.587+0000 7fe9ccaae640 1 -- 172.21.15.50:0/3830560806 learned_addr learned my addr 172.21.15.50:0/3830560806 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.588+0000 7fe9c7fff640 1 --2- 172.21.15.50:0/3830560806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9c815e870 0x7fe9c80d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.588+0000 7fe9c77fe640 1 -- 172.21.15.50:0/3830560806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9c815e870 msgr2=0x7fe9c80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.588+0000 7fe9c77fe640 1 --2- 172.21.15.50:0/3830560806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9c815e870 0x7fe9c80d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.588+0000 7fe9c77fe640 1 -- 172.21.15.50:0/3830560806 >> v1:172.21.15.50:6789/0 conn(0x7fe9c80d3a30 legacy=0x7fe9c80b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.588+0000 7fe9c77fe640 1 -- 172.21.15.50:0/3830560806 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c80d40d0 con 0x7fe9c80d16d0 2024-09-11T22:20:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.588+0000 7fe9c77fe640 1 --2- 172.21.15.50:0/3830560806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9c80d16d0 0x7fe9c80d34f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0097a0 tx=0x7fe9bc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a3780335abf5a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.589+0000 7fe9c6ffd640 1 -- 172.21.15.50:0/3830560806 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc037070 con 0x7fe9c80d16d0 2024-09-11T22:20:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.589+0000 7fe9c6ffd640 1 -- 172.21.15.50:0/3830560806 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9bc032440 con 0x7fe9c80d16d0 2024-09-11T22:20:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.589+0000 7fe9c6ffd640 1 -- 172.21.15.50:0/3830560806 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc032810 con 0x7fe9c80d16d0 2024-09-11T22:20:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.589+0000 7fe9ce511640 1 -- 172.21.15.50:0/3830560806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9c80d16d0 msgr2=0x7fe9c80d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.589+0000 7fe9ce511640 1 --2- 172.21.15.50:0/3830560806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9c80d16d0 0x7fe9c80d34f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0097a0 tx=0x7fe9bc02a180 comp rx=0 tx=0).stop 2024-09-11T22:20:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.589+0000 7fe9ce511640 1 -- 172.21.15.50:0/3830560806 shutdown_connections 2024-09-11T22:20:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.589+0000 7fe9ce511640 1 --2- 172.21.15.50:0/3830560806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9c80d16d0 0x7fe9c80d34f0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.589+0000 7fe9ce511640 1 --2- 172.21.15.50:0/3830560806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9c815e870 0x7fe9c80d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.589+0000 7fe9ce511640 1 -- 172.21.15.50:0/3830560806 >> 172.21.15.50:0/3830560806 conn(0x7fe9c80727a0 msgr2=0x7fe9c80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.589+0000 7fe9ce511640 1 -- 172.21.15.50:0/3830560806 shutdown_connections 2024-09-11T22:20:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.589+0000 7fe9ce511640 1 -- 172.21.15.50:0/3830560806 wait complete. 2024-09-11T22:20:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.590+0000 7fe9ce511640 1 Processor -- start 2024-09-11T22:20:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.591+0000 7fe9ce511640 1 -- start start 2024-09-11T22:20:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.591+0000 7fe9ce511640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9c80d16d0 0x7fe9c815dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.591+0000 7fe9ce511640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c80d3a30 0x7fe9c815d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.591+0000 7fe9ce511640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9c815e870 0x7fe9c81e89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.591+0000 7fe9ce511640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c80b7ee0 con 0x7fe9c815e870 2024-09-11T22:20:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.591+0000 7fe9ce511640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c80b7c00 con 0x7fe9c80d3a30 2024-09-11T22:20:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.591+0000 7fe9ce511640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c815ec50 con 0x7fe9c80d16d0 2024-09-11T22:20:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9ccaae640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9c815e870 0x7fe9c81e89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9ccaae640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9c815e870 0x7fe9c81e89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57944/0 (socket says 172.21.15.50:57944) 2024-09-11T22:20:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9ccaae640 1 -- 172.21.15.50:0/3160374881 learned_addr learned my addr 172.21.15.50:0/3160374881 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9c7fff640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9c80d16d0 0x7fe9c815dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9c77fe640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c80d3a30 0x7fe9c815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9ccaae640 1 -- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9c80d16d0 msgr2=0x7fe9c815dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9ccaae640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9c80d16d0 0x7fe9c815dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9ccaae640 1 -- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c80d3a30 msgr2=0x7fe9c815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9ccaae640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c80d3a30 0x7fe9c815d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9ccaae640 1 -- 172.21.15.50:0/3160374881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c80cc290 con 0x7fe9c815e870 2024-09-11T22:20:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9ccaae640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9c815e870 0x7fe9c81e89c0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000cbf0 tx=0x7fe9c000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9c4ff9640 1 -- 172.21.15.50:0/3160374881 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0017070 con 0x7fe9c815e870 2024-09-11T22:20:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9c4ff9640 1 -- 172.21.15.50:0/3160374881 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c000ad40 con 0x7fe9c815e870 2024-09-11T22:20:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9c4ff9640 1 -- 172.21.15.50:0/3160374881 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0012600 con 0x7fe9c815e870 2024-09-11T22:20:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9ce511640 1 -- 172.21.15.50:0/3160374881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c81e9210 con 0x7fe9c815e870 2024-09-11T22:20:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.592+0000 7fe9ce511640 1 -- 172.21.15.50:0/3160374881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c81e97d0 con 0x7fe9c815e870 2024-09-11T22:20:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.593+0000 7fe9ce511640 1 -- 172.21.15.50:0/3160374881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c8075770 con 0x7fe9c815e870 2024-09-11T22:20:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.594+0000 7fe9c4ff9640 1 -- 172.21.15.50:0/3160374881 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9c001a070 con 0x7fe9c815e870 2024-09-11T22:20:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.594+0000 7fe9c4ff9640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe9b406be30 0x7fe9b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.594+0000 7fe9c4ff9640 1 -- 172.21.15.50:0/3160374881 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 4943+0+0 (secure 0 0 0) 0x7fe9c008a730 con 0x7fe9c815e870 2024-09-11T22:20:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.594+0000 7fe9c7fff640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe9b406be30 0x7fe9b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.595+0000 7fe9c7fff640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe9b406be30 0x7fe9b406e2f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80ce950 tx=0x7fe9b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.599+0000 7fe9c4ff9640 1 -- 172.21.15.50:0/3160374881 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9c80cfa80 con 0x7fe9c815e870 2024-09-11T22:20:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.776+0000 7fe9ce511640 1 -- 172.21.15.50:0/3160374881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe9c80b7940 con 0x7fe9c815e870 2024-09-11T22:20:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.776+0000 7fe9c4ff9640 1 -- 172.21.15.50:0/3160374881 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v147) ==== 93+0+10 (secure 0 0 0) 0x7fe9c0058e20 con 0x7fe9c815e870 2024-09-11T22:20:37.777 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-11T22:20:37.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.778+0000 7fe9ce511640 1 -- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe9b406be30 msgr2=0x7fe9b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.778+0000 7fe9ce511640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe9b406be30 0x7fe9b406e2f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80ce950 tx=0x7fe9b8008040 comp rx=0 tx=0).stop 2024-09-11T22:20:37.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.778+0000 7fe9ce511640 1 -- 172.21.15.50:0/3160374881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9c815e870 msgr2=0x7fe9c81e89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.778+0000 7fe9ce511640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9c815e870 0x7fe9c81e89c0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000cbf0 tx=0x7fe9c000a430 comp rx=0 tx=0).stop 2024-09-11T22:20:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.778+0000 7fe9ce511640 1 -- 172.21.15.50:0/3160374881 shutdown_connections 2024-09-11T22:20:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.778+0000 7fe9ce511640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe9b406be30 0x7fe9b406e2f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.778+0000 7fe9ce511640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9c815e870 0x7fe9c81e89c0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.778+0000 7fe9ce511640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c80d3a30 0x7fe9c815d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.778+0000 7fe9ce511640 1 --2- 172.21.15.50:0/3160374881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9c80d16d0 0x7fe9c815dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.778+0000 7fe9ce511640 1 -- 172.21.15.50:0/3160374881 >> 172.21.15.50:0/3160374881 conn(0x7fe9c80727a0 msgr2=0x7fe9c81606e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.778+0000 7fe9ce511640 1 -- 172.21.15.50:0/3160374881 shutdown_connections 2024-09-11T22:20:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.778+0000 7fe9ce511640 1 -- 172.21.15.50:0/3160374881 wait complete. 2024-09-11T22:20:37.791 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-11T22:20:37.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.892+0000 7f6d25511640 1 Processor -- start 2024-09-11T22:20:37.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.892+0000 7f6d25511640 1 -- start start 2024-09-11T22:20:37.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.893+0000 7f6d25511640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d200d1c90 0x7f6d200b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.893+0000 7f6d25511640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6d20162350 0x7f6d201627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.893+0000 7f6d25511640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d20163080 con 0x7f6d2015e8e0 2024-09-11T22:20:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.893+0000 7f6d25511640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6d2015ecc0 con 0x7f6d20162350 2024-09-11T22:20:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.893+0000 7f6d25511640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6d200d2ad0 con 0x7f6d200d1c90 2024-09-11T22:20:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.893+0000 7f6d1effd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6d2015e8e0 0x7f6d200d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54680/0 (socket says 172.21.15.50:54680) 2024-09-11T22:20:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.893+0000 7f6d1effd640 1 -- 172.21.15.50:0/923852128 learned_addr learned my addr 172.21.15.50:0/923852128 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.893+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666751757 0 0) 0x7f6d20163080 con 0x7f6d2015e8e0 2024-09-11T22:20:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.893+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d0c003520 con 0x7f6d2015e8e0 2024-09-11T22:20:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.893+0000 7f6d1f7fe640 1 --2- 172.21.15.50:0/923852128 >> v2:172.21.15.77:3300/0 conn(0x7f6d20162350 0x7f6d201627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.893+0000 7f6d1e7fc640 1 --2- 172.21.15.50:0/923852128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d200d1c90 0x7f6d200b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1601279908 0 0) 0x7f6d0c003520 con 0x7f6d2015e8e0 2024-09-11T22:20:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d200d1c90 msgr2=0x7f6d200b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 --2- 172.21.15.50:0/923852128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d200d1c90 0x7f6d200b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 >> v2:172.21.15.77:3300/0 conn(0x7f6d20162350 msgr2=0x7f6d201627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 --2- 172.21.15.50:0/923852128 >> v2:172.21.15.77:3300/0 conn(0x7f6d20162350 0x7f6d201627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d200d2d20 con 0x7f6d2015e8e0 2024-09-11T22:20:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f6d100019f0 con 0x7f6d2015e8e0 2024-09-11T22:20:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 >> v1:172.21.15.50:6789/0 conn(0x7f6d2015e8e0 legacy=0x7f6d200d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 --2- 172.21.15.50:0/923852128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d0c0039b0 0x7f6d0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 --2- 172.21.15.50:0/923852128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d200d1c90 0x7f6d0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 --2- 172.21.15.50:0/923852128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c004d40 0x7f6d0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6d200d2ad0 con 0x7f6d0c004d40 2024-09-11T22:20:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c00b9c0 con 0x7f6d0c0039b0 2024-09-11T22:20:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0c00bbc0 con 0x7f6d200d1c90 2024-09-11T22:20:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1f7fe640 1 --2- 172.21.15.50:0/923852128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c004d40 0x7f6d0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1effd640 1 --2- 172.21.15.50:0/923852128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d0c0039b0 0x7f6d0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1e7fc640 1 --2- 172.21.15.50:0/923852128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d200d1c90 0x7f6d0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1f7fe640 1 -- 172.21.15.50:0/923852128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d200d1c90 msgr2=0x7f6d0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1f7fe640 1 --2- 172.21.15.50:0/923852128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d200d1c90 0x7f6d0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1f7fe640 1 -- 172.21.15.50:0/923852128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d0c0039b0 msgr2=0x7f6d0c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1f7fe640 1 --2- 172.21.15.50:0/923852128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d0c0039b0 0x7f6d0c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.894+0000 7f6d1f7fe640 1 -- 172.21.15.50:0/923852128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0c003520 con 0x7f6d0c004d40 2024-09-11T22:20:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.895+0000 7f6d1f7fe640 1 --2- 172.21.15.50:0/923852128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c004d40 0x7f6d0c0051c0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009ac0 tx=0x7f6d0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76c68b7fef03d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.895+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18036070 con 0x7f6d0c004d40 2024-09-11T22:20:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.895+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d18031400 con 0x7f6d0c004d40 2024-09-11T22:20:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.895+0000 7f6d1dffb640 1 -- 172.21.15.50:0/923852128 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18009690 con 0x7f6d0c004d40 2024-09-11T22:20:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.896+0000 7f6d25511640 1 -- 172.21.15.50:0/923852128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c004d40 msgr2=0x7f6d0c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.896+0000 7f6d25511640 1 --2- 172.21.15.50:0/923852128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d0c004d40 0x7f6d0c0051c0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009ac0 tx=0x7f6d0c005830 comp rx=0 tx=0).stop 2024-09-11T22:20:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.896+0000 7f6d1f7fe640 1 -- 172.21.15.50:0/923852128 reap_dead start 2024-09-11T22:20:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.896+0000 7f6d25511640 1 -- 172.21.15.50:0/923852128 shutdown_connections 2024-09-11T22:20:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.896+0000 7f6d25511640 1 -- 172.21.15.50:0/923852128 >> 172.21.15.50:0/923852128 conn(0x7f6d20067ba0 msgr2=0x7f6d20067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.896+0000 7f6d25511640 1 -- 172.21.15.50:0/923852128 shutdown_connections 2024-09-11T22:20:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.896+0000 7f6d25511640 1 -- 172.21.15.50:0/923852128 wait complete. 2024-09-11T22:20:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.897+0000 7f6d25511640 1 Processor -- start 2024-09-11T22:20:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.897+0000 7f6d25511640 1 -- start start 2024-09-11T22:20:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d25511640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d0c004d40 0x7f6d2015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d25511640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d2015fd10 0x7f6d200ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d25511640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d20158570 0x7f6d201589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d25511640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20162d20 con 0x7f6d20158570 2024-09-11T22:20:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d25511640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6d200d3370 con 0x7f6d2015fd10 2024-09-11T22:20:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d25511640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6d200b7880 con 0x7f6d0c004d40 2024-09-11T22:20:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d20158570 0x7f6d201589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d20158570 0x7f6d201589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57962/0 (socket says 172.21.15.50:57962) 2024-09-11T22:20:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d1f7fe640 1 -- 172.21.15.50:0/1130324883 learned_addr learned my addr 172.21.15.50:0/1130324883 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d1e7fc640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d2015fd10 0x7f6d200ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d1effd640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d0c004d40 0x7f6d2015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d1f7fe640 1 -- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d0c004d40 msgr2=0x7f6d2015b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d1f7fe640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d0c004d40 0x7f6d2015b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d1f7fe640 1 -- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d2015fd10 msgr2=0x7f6d200ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d1f7fe640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d2015fd10 0x7f6d200ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d1f7fe640 1 -- 172.21.15.50:0/1130324883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d20160190 con 0x7f6d20158570 2024-09-11T22:20:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d1e7fc640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d2015fd10 0x7f6d200ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d1f7fe640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d20158570 0x7f6d201589f0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009be0 tx=0x7f6d18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.898+0000 7f6d177fe640 1 -- 172.21.15.50:0/1130324883 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18036040 con 0x7f6d20158570 2024-09-11T22:20:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.899+0000 7f6d177fe640 1 -- 172.21.15.50:0/1130324883 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d18041070 con 0x7f6d20158570 2024-09-11T22:20:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.899+0000 7f6d25511640 1 -- 172.21.15.50:0/1130324883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d200ceb20 con 0x7f6d20158570 2024-09-11T22:20:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.899+0000 7f6d177fe640 1 -- 172.21.15.50:0/1130324883 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18009690 con 0x7f6d20158570 2024-09-11T22:20:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.899+0000 7f6d25511640 1 -- 172.21.15.50:0/1130324883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d201606f0 con 0x7f6d20158570 2024-09-11T22:20:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.899+0000 7f6d25511640 1 -- 172.21.15.50:0/1130324883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d200b7c10 con 0x7f6d20158570 2024-09-11T22:20:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.900+0000 7f6d177fe640 1 -- 172.21.15.50:0/1130324883 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d18039070 con 0x7f6d20158570 2024-09-11T22:20:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.900+0000 7f6d177fe640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6d0006be30 0x7f6d0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.901+0000 7f6d177fe640 1 -- 172.21.15.50:0/1130324883 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 4943+0+0 (secure 0 0 0) 0x7f6d180aa3f0 con 0x7f6d20158570 2024-09-11T22:20:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.901+0000 7f6d1effd640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6d0006be30 0x7f6d0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.901+0000 7f6d1effd640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6d0006be30 0x7f6d0006e2f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6d10001330 tx=0x7f6d10006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:37.905+0000 7f6d177fe640 1 -- 172.21.15.50:0/1130324883 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d1804a020 con 0x7f6d20158570 2024-09-11T22:20:38.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.146+0000 7f6d25511640 1 -- 172.21.15.50:0/1130324883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7f6d200ba770 con 0x7f6d20158570 2024-09-11T22:20:38.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.164+0000 7f6d177fe640 1 -- 172.21.15.50:0/1130324883 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v459) ==== 169+0+0 (secure 0 0 0) 0x7f6d200ceb20 con 0x7f6d20158570 2024-09-11T22:20:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.166+0000 7f6d25511640 1 -- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6d0006be30 msgr2=0x7f6d0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.166+0000 7f6d25511640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6d0006be30 0x7f6d0006e2f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6d10001330 tx=0x7f6d10006040 comp rx=0 tx=0).stop 2024-09-11T22:20:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.166+0000 7f6d25511640 1 -- 172.21.15.50:0/1130324883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d20158570 msgr2=0x7f6d201589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.166+0000 7f6d25511640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d20158570 0x7f6d201589f0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009be0 tx=0x7f6d18004730 comp rx=0 tx=0).stop 2024-09-11T22:20:38.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.166+0000 7f6d25511640 1 -- 172.21.15.50:0/1130324883 shutdown_connections 2024-09-11T22:20:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.166+0000 7f6d25511640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6d0006be30 0x7f6d0006e2f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.166+0000 7f6d25511640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d20158570 0x7f6d201589f0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.166+0000 7f6d25511640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d2015fd10 0x7f6d200ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.166+0000 7f6d25511640 1 --2- 172.21.15.50:0/1130324883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d0c004d40 0x7f6d2015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.166+0000 7f6d25511640 1 -- 172.21.15.50:0/1130324883 >> 172.21.15.50:0/1130324883 conn(0x7f6d20067ba0 msgr2=0x7f6d200d4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.166+0000 7f6d25511640 1 -- 172.21.15.50:0/1130324883 shutdown_connections 2024-09-11T22:20:38.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.166+0000 7f6d25511640 1 -- 172.21.15.50:0/1130324883 wait complete. 2024-09-11T22:20:38.179 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T22:20:38.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.283+0000 7fd600391640 1 Processor -- start 2024-09-11T22:20:38.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.283+0000 7fd600391640 1 -- start start 2024-09-11T22:20:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.284+0000 7fd600391640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815fb60 0x7fd5f80b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.284+0000 7fd600391640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5f80d0150 0x7fd5f80d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.284+0000 7fd600391640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f80d1290 con 0x7fd5f80d0e00 2024-09-11T22:20:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.284+0000 7fd600391640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f80cf510 con 0x7fd5f80d0150 2024-09-11T22:20:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.284+0000 7fd600391640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f80cfdb0 con 0x7fd5f815fb60 2024-09-11T22:20:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.284+0000 7fd5fd92c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5f80d0150 0x7fd5f80d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.284+0000 7fd5fd92c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5f80d0150 0x7fd5f80d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57974/0 (socket says 172.21.15.50:57974) 2024-09-11T22:20:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.284+0000 7fd5fd92c640 1 -- 172.21.15.50:0/3156042361 learned_addr learned my addr 172.21.15.50:0/3156042361 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.284+0000 7fd5fd92c640 1 -- 172.21.15.50:0/3156042361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815fb60 msgr2=0x7fd5f80b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.284+0000 7fd5fe12d640 1 --2- 172.21.15.50:0/3156042361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815fb60 0x7fd5f80b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.284+0000 7fd5fd92c640 1 --2- 172.21.15.50:0/3156042361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815fb60 0x7fd5f80b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.284+0000 7fd5fd92c640 1 -- 172.21.15.50:0/3156042361 >> v1:172.21.15.77:6789/0 conn(0x7fd5f80d0e00 legacy=0x7fd5f80cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.284+0000 7fd5fd92c640 1 -- 172.21.15.50:0/3156042361 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f815ff40 con 0x7fd5f80d0150 2024-09-11T22:20:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.285+0000 7fd5fd92c640 1 --2- 172.21.15.50:0/3156042361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f80d0150 0x7fd5f80d08c0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009870 tx=0x7fd5e802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2019214e273cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.285+0000 7fd5fd12b640 1 -- 172.21.15.50:0/3156042361 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8037070 con 0x7fd5f80d0150 2024-09-11T22:20:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.285+0000 7fd5fd12b640 1 -- 172.21.15.50:0/3156042361 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e8032440 con 0x7fd5f80d0150 2024-09-11T22:20:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.285+0000 7fd5fd12b640 1 -- 172.21.15.50:0/3156042361 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8032810 con 0x7fd5f80d0150 2024-09-11T22:20:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.286+0000 7fd600391640 1 -- 172.21.15.50:0/3156042361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f80d0150 msgr2=0x7fd5f80d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.286+0000 7fd600391640 1 --2- 172.21.15.50:0/3156042361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f80d0150 0x7fd5f80d08c0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009870 tx=0x7fd5e802a180 comp rx=0 tx=0).stop 2024-09-11T22:20:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.286+0000 7fd600391640 1 -- 172.21.15.50:0/3156042361 shutdown_connections 2024-09-11T22:20:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.286+0000 7fd600391640 1 --2- 172.21.15.50:0/3156042361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f80d0150 0x7fd5f80d08c0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.286+0000 7fd600391640 1 --2- 172.21.15.50:0/3156042361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815fb60 0x7fd5f80b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.286+0000 7fd600391640 1 -- 172.21.15.50:0/3156042361 >> 172.21.15.50:0/3156042361 conn(0x7fd5f80b4150 msgr2=0x7fd5f80b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:38.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.286+0000 7fd600391640 1 -- 172.21.15.50:0/3156042361 shutdown_connections 2024-09-11T22:20:38.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.286+0000 7fd600391640 1 -- 172.21.15.50:0/3156042361 wait complete. 2024-09-11T22:20:38.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.287+0000 7fd600391640 1 Processor -- start 2024-09-11T22:20:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.287+0000 7fd600391640 1 -- start start 2024-09-11T22:20:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd600391640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f80d0e00 0x7fd5f8158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd600391640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815fb60 0x7fd5f80b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd600391640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f80c87c0 0x7fd5f80c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd600391640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f80cfa40 con 0x7fd5f80d0e00 2024-09-11T22:20:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd600391640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f80cf760 con 0x7fd5f80c87c0 2024-09-11T22:20:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd600391640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f80b1930 con 0x7fd5f815fb60 2024-09-11T22:20:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd5fe12d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f80d0e00 0x7fd5f8158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd5fe12d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f80d0e00 0x7fd5f8158b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57990/0 (socket says 172.21.15.50:57990) 2024-09-11T22:20:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd5fe12d640 1 -- 172.21.15.50:0/3769566347 learned_addr learned my addr 172.21.15.50:0/3769566347 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd5fd92c640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815fb60 0x7fd5f80b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd5fe92e640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f80c87c0 0x7fd5f80c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd5fe12d640 1 -- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815fb60 msgr2=0x7fd5f80b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:38.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd5fe12d640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815fb60 0x7fd5f80b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd5fe12d640 1 -- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f80c87c0 msgr2=0x7fd5f80c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:38.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd5fe12d640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f80c87c0 0x7fd5f80c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd5fe12d640 1 -- 172.21.15.50:0/3769566347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f806bcf0 con 0x7fd5f80d0e00 2024-09-11T22:20:38.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd5fe92e640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f80c87c0 0x7fd5f80c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:38.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd5fe12d640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f80d0e00 0x7fd5f8158b80 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fd5f400c850 tx=0x7fd5f400cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:38.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.288+0000 7fd5eeffd640 1 -- 172.21.15.50:0/3769566347 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4015070 con 0x7fd5f80d0e00 2024-09-11T22:20:38.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.289+0000 7fd5eeffd640 1 -- 172.21.15.50:0/3769566347 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f4004020 con 0x7fd5f80d0e00 2024-09-11T22:20:38.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.289+0000 7fd600391640 1 -- 172.21.15.50:0/3769566347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f806bfd0 con 0x7fd5f80d0e00 2024-09-11T22:20:38.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.289+0000 7fd5eeffd640 1 -- 172.21.15.50:0/3769566347 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f40043f0 con 0x7fd5f80d0e00 2024-09-11T22:20:38.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.289+0000 7fd600391640 1 -- 172.21.15.50:0/3769566347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f80b7fa0 con 0x7fd5f80d0e00 2024-09-11T22:20:38.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.290+0000 7fd600391640 1 -- 172.21.15.50:0/3769566347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f80d08c0 con 0x7fd5f80d0e00 2024-09-11T22:20:38.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.290+0000 7fd5eeffd640 1 -- 172.21.15.50:0/3769566347 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5f40077d0 con 0x7fd5f80d0e00 2024-09-11T22:20:38.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.291+0000 7fd5eeffd640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5dc06be60 0x7fd5dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.291+0000 7fd5eeffd640 1 -- 172.21.15.50:0/3769566347 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 4943+0+0 (secure 0 0 0) 0x7fd5f408a900 con 0x7fd5f80d0e00 2024-09-11T22:20:38.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.291+0000 7fd5fd92c640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5dc06be60 0x7fd5dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.292+0000 7fd5fd92c640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5dc06be60 0x7fd5dc06e320 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8034000 tx=0x7fd5e802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:38.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.295+0000 7fd5eeffd640 1 -- 172.21.15.50:0/3769566347 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5f4059640 con 0x7fd5f80d0e00 2024-09-11T22:20:38.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.470+0000 7fd600391640 1 -- 172.21.15.50:0/3769566347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd5f8159210 con 0x7fd5f80d0e00 2024-09-11T22:20:38.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.473+0000 7fd5eeffd640 1 -- 172.21.15.50:0/3769566347 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7fd5f4058f40 con 0x7fd5f80d0e00 2024-09-11T22:20:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.475+0000 7fd600391640 1 -- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5dc06be60 msgr2=0x7fd5dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.475+0000 7fd600391640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5dc06be60 0x7fd5dc06e320 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8034000 tx=0x7fd5e802e000 comp rx=0 tx=0).stop 2024-09-11T22:20:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.475+0000 7fd600391640 1 -- 172.21.15.50:0/3769566347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f80d0e00 msgr2=0x7fd5f8158b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.475+0000 7fd600391640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f80d0e00 0x7fd5f8158b80 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fd5f400c850 tx=0x7fd5f400cd10 comp rx=0 tx=0).stop 2024-09-11T22:20:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.475+0000 7fd600391640 1 -- 172.21.15.50:0/3769566347 shutdown_connections 2024-09-11T22:20:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.475+0000 7fd600391640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd5dc06be60 0x7fd5dc06e320 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.475+0000 7fd600391640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5f815fb60 0x7fd5f80b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.475+0000 7fd600391640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f80c87c0 0x7fd5f80c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.475+0000 7fd600391640 1 --2- 172.21.15.50:0/3769566347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5f80d0e00 0x7fd5f8158b80 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.475+0000 7fd600391640 1 -- 172.21.15.50:0/3769566347 >> 172.21.15.50:0/3769566347 conn(0x7fd5f80b4150 msgr2=0x7fd5f80b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.475+0000 7fd600391640 1 -- 172.21.15.50:0/3769566347 shutdown_connections 2024-09-11T22:20:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.475+0000 7fd600391640 1 -- 172.21.15.50:0/3769566347 wait complete. 2024-09-11T22:20:38.486 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:20:38.487 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:20:38.535 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:20:38.575 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:20:38.575 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:20:38.575 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:20:38.591 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:20:38.643 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:20:38.643 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:20:38.662 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:20:38.663 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:20:38.663 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:20:38.679 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:20:38.679 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:20:38.679 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:20:38.721 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:20:38.721 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T22:20:38.722 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:38.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.823+0000 7f0d1bfb7640 1 Processor -- start 2024-09-11T22:20:38.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.823+0000 7f0d1bfb7640 1 -- start start 2024-09-11T22:20:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.824+0000 7f0d1bfb7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d1415b400 0x7f0d1406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.824+0000 7f0d1bfb7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d14072e60 0x7f0d1406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.824+0000 7f0d1bfb7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d1415b7e0 con 0x7f0d1406df20 2024-09-11T22:20:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.824+0000 7f0d1bfb7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0d1415f140 con 0x7f0d1415b400 2024-09-11T22:20:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.824+0000 7f0d1bfb7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0d1415f420 con 0x7f0d14072e60 2024-09-11T22:20:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.824+0000 7f0d19d53640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d1415b400 0x7f0d1406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.824+0000 7f0d19d53640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0d1415b400 0x7f0d1406d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57994/0 (socket says 172.21.15.50:57994) 2024-09-11T22:20:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.824+0000 7f0d19d53640 1 -- 172.21.15.50:0/1098358396 learned_addr learned my addr 172.21.15.50:0/1098358396 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.824+0000 7f0d19552640 1 --2- 172.21.15.50:0/1098358396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d14072e60 0x7f0d1406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.825+0000 7f0d19d53640 1 -- 172.21.15.50:0/1098358396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d14072e60 msgr2=0x7f0d1406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.825+0000 7f0d19d53640 1 --2- 172.21.15.50:0/1098358396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d14072e60 0x7f0d1406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.825+0000 7f0d19d53640 1 -- 172.21.15.50:0/1098358396 >> v1:172.21.15.77:6789/0 conn(0x7f0d1406df20 legacy=0x7f0d140b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.825+0000 7f0d19d53640 1 -- 172.21.15.50:0/1098358396 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1415f700 con 0x7f0d1415b400 2024-09-11T22:20:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.825+0000 7f0d19d53640 1 --2- 172.21.15.50:0/1098358396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d1415b400 0x7f0d1406d070 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000bb10 tx=0x7f0d1002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3035e6bd84d01f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.826+0000 7f0d18d51640 1 -- 172.21.15.50:0/1098358396 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d10036020 con 0x7f0d1415b400 2024-09-11T22:20:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.826+0000 7f0d18d51640 1 -- 172.21.15.50:0/1098358396 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d10032820 con 0x7f0d1415b400 2024-09-11T22:20:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.826+0000 7f0d18d51640 1 -- 172.21.15.50:0/1098358396 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d10032bf0 con 0x7f0d1415b400 2024-09-11T22:20:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.826+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/1098358396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d1415b400 msgr2=0x7f0d1406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.826+0000 7f0d1bfb7640 1 --2- 172.21.15.50:0/1098358396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d1415b400 0x7f0d1406d070 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000bb10 tx=0x7f0d1002c920 comp rx=0 tx=0).stop 2024-09-11T22:20:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.826+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/1098358396 shutdown_connections 2024-09-11T22:20:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.826+0000 7f0d1bfb7640 1 --2- 172.21.15.50:0/1098358396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d14072e60 0x7f0d1406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.826+0000 7f0d1bfb7640 1 --2- 172.21.15.50:0/1098358396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d1415b400 0x7f0d1406d070 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.826+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/1098358396 >> 172.21.15.50:0/1098358396 conn(0x7f0d140679c0 msgr2=0x7f0d14067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.826+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/1098358396 shutdown_connections 2024-09-11T22:20:38.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.826+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/1098358396 wait complete. 2024-09-11T22:20:38.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.828+0000 7f0d1bfb7640 1 Processor -- start 2024-09-11T22:20:38.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.828+0000 7f0d1bfb7640 1 -- start start 2024-09-11T22:20:38.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.828+0000 7f0d1bfb7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d1406df20 0x7f0d14158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.828+0000 7f0d1bfb7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d14072e60 0x7f0d14159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.828+0000 7f0d1bfb7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d1415b400 0x7f0d140aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.828+0000 7f0d1bfb7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0d140721d0 con 0x7f0d14072e60 2024-09-11T22:20:38.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.828+0000 7f0d1bfb7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d140cfc50 con 0x7f0d1415b400 2024-09-11T22:20:38.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.828+0000 7f0d1bfb7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0d14072350 con 0x7f0d1406df20 2024-09-11T22:20:38.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.828+0000 7f0d19552640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d14072e60 0x7f0d14159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d19552640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d14072e60 0x7f0d14159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58008/0 (socket says 172.21.15.50:58008) 2024-09-11T22:20:38.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d19552640 1 -- 172.21.15.50:0/2971132431 learned_addr learned my addr 172.21.15.50:0/2971132431 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:38.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d19d53640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d1406df20 0x7f0d14158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d1a554640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d1415b400 0x7f0d140aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d19552640 1 -- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d1406df20 msgr2=0x7f0d14158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d19552640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d1406df20 0x7f0d14158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d19552640 1 -- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d1415b400 msgr2=0x7f0d140aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d19552640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d1415b400 0x7f0d140aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d19552640 1 -- 172.21.15.50:0/2971132431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d14158d80 con 0x7f0d14072e60 2024-09-11T22:20:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d19552640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d14072e60 0x7f0d14159e20 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400e9b0 tx=0x7f0d0400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d0a7fc640 1 -- 172.21.15.50:0/2971132431 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04017070 con 0x7f0d14072e60 2024-09-11T22:20:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d0a7fc640 1 -- 172.21.15.50:0/2971132431 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0400c9a0 con 0x7f0d14072e60 2024-09-11T22:20:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/2971132431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d14159060 con 0x7f0d14072e60 2024-09-11T22:20:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d0a7fc640 1 -- 172.21.15.50:0/2971132431 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0400cd90 con 0x7f0d14072e60 2024-09-11T22:20:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.829+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/2971132431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d14159620 con 0x7f0d14072e60 2024-09-11T22:20:38.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.830+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/2971132431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d1406d9e0 con 0x7f0d14072e60 2024-09-11T22:20:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.831+0000 7f0d0a7fc640 1 -- 172.21.15.50:0/2971132431 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d0401a070 con 0x7f0d14072e60 2024-09-11T22:20:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.832+0000 7f0d0a7fc640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0cf806be30 0x7f0cf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.832+0000 7f0d0a7fc640 1 -- 172.21.15.50:0/2971132431 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 4943+0+0 (secure 0 0 0) 0x7f0d0408ada0 con 0x7f0d14072e60 2024-09-11T22:20:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.832+0000 7f0d19d53640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0cf806be30 0x7f0cf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.832+0000 7f0d19d53640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0cf806be30 0x7f0cf806e2f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0d10037000 tx=0x7f0d1003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:38.836+0000 7f0d0a7fc640 1 -- 172.21.15.50:0/2971132431 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d04059490 con 0x7f0d14072e60 2024-09-11T22:20:39.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.050+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/2971132431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d1415a9e0 con 0x7f0d14072e60 2024-09-11T22:20:39.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.050+0000 7f0d0a7fc640 1 -- 172.21.15.50:0/2971132431 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+3910 (secure 0 0 0) 0x7f0d0405d790 con 0x7f0d14072e60 2024-09-11T22:20:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:39.051 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":103,"btime":"2024-09-11T22:20:33:819307+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2814667881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2814667881},{"type":"v1","addr":"172.21.15.77:6836","nonce":2814667881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2424547562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2424547562},{"type":"v1","addr":"172.21.15.77:6837","nonce":2424547562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/864537905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":864537905},{"type":"v1","addr":"172.21.15.50:6834","nonce":864537905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":9348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4219456186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4219456186},{"type":"v1","addr":"172.21.15.50:6835","nonce":4219456186}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[]} 2024-09-11T22:20:39.052 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 103 2024-09-11T22:20:39.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.053+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0cf806be30 msgr2=0x7f0cf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.053+0000 7f0d1bfb7640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0cf806be30 0x7f0cf806e2f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0d10037000 tx=0x7f0d1003d040 comp rx=0 tx=0).stop 2024-09-11T22:20:39.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.053+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/2971132431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d14072e60 msgr2=0x7f0d14159e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.053+0000 7f0d1bfb7640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d14072e60 0x7f0d14159e20 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400e9b0 tx=0x7f0d0400ee70 comp rx=0 tx=0).stop 2024-09-11T22:20:39.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.053+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/2971132431 shutdown_connections 2024-09-11T22:20:39.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.053+0000 7f0d1bfb7640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0cf806be30 0x7f0cf806e2f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.053+0000 7f0d1bfb7640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d1415b400 0x7f0d140aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.053+0000 7f0d1bfb7640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d14072e60 0x7f0d14159e20 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.053+0000 7f0d1bfb7640 1 --2- 172.21.15.50:0/2971132431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d1406df20 0x7f0d14158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.053+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/2971132431 >> 172.21.15.50:0/2971132431 conn(0x7f0d140679c0 msgr2=0x7f0d140b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:39.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.053+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/2971132431 shutdown_connections 2024-09-11T22:20:39.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:39.053+0000 7f0d1bfb7640 1 -- 172.21.15.50:0/2971132431 wait complete. 2024-09-11T22:20:39.064 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:20:39.065 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T22:20:39.065 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:20:39.065 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:20:39.065 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:20:39.065 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T22:20:39.065 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:20:39.066 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:20:39.066 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:20:39.066 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T22:20:39.066 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:20:39.066 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:20:39.066 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:20:39.066 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T22:20:39.067 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:20:39.067 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:20:39.074 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:20:39.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:20:39.075 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:20:39.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:20:39.082 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:20:39.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:20:39.117 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:20:39.117 DEBUG:teuthology.parallel:result is None 2024-09-11T22:20:39.118 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:20:39.118 DEBUG:teuthology.parallel:result is None 2024-09-11T22:20:39.125 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:20:39.125 DEBUG:teuthology.parallel:result is None 2024-09-11T22:20:39.193 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:20:39.193 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:20:39.210 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:20:41.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-11T22:20:43.879 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:20:43.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:20:45.082 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:20:45.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:20:45.085 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:20:45.085 DEBUG:teuthology.parallel:result is None 2024-09-11T22:20:45.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T22:20:45.167 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:20:45.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.204+0000 7ffa1a5f8640 1 Processor -- start 2024-09-11T22:20:45.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.204+0000 7ffa1a5f8640 1 -- start start 2024-09-11T22:20:45.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.205+0000 7ffa1a5f8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffa14162a60 0x7ffa140b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.205+0000 7ffa1a5f8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa14163080 con 0x7ffa1415e8e0 2024-09-11T22:20:45.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.205+0000 7ffa1a5f8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa140d2d20 con 0x7ffa140d1c90 2024-09-11T22:20:45.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.205+0000 7ffa1a5f8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ffa1415ecc0 con 0x7ffa14162a60 2024-09-11T22:20:45.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.205+0000 7ffa13fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffa1415e8e0 0x7ffa140d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54702/0 (socket says 172.21.15.50:54702) 2024-09-11T22:20:45.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.205+0000 7ffa13fff640 1 -- 172.21.15.50:0/3214000730 learned_addr learned my addr 172.21.15.50:0/3214000730 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:45.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa18b95640 1 --2- 172.21.15.50:0/3214000730 >> v2:172.21.15.77:3300/0 conn(0x7ffa14162a60 0x7ffa140b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1727441423 0 0) 0x7ffa14163080 con 0x7ffa1415e8e0 2024-09-11T22:20:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9fc003520 con 0x7ffa1415e8e0 2024-09-11T22:20:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2776149132 0 0) 0x7ff9fc003520 con 0x7ffa1415e8e0 2024-09-11T22:20:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 >> v2:172.21.15.77:3300/0 conn(0x7ffa14162a60 msgr2=0x7ffa140b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 --2- 172.21.15.50:0/3214000730 >> v2:172.21.15.77:3300/0 conn(0x7ffa14162a60 0x7ffa140b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 >> v1:172.21.15.77:6789/0 conn(0x7ffa140d1c90 legacy=0x7ffa14162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa140d3000 con 0x7ffa1415e8e0 2024-09-11T22:20:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7ffa04001670 con 0x7ffa1415e8e0 2024-09-11T22:20:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 >> v1:172.21.15.50:6789/0 conn(0x7ffa1415e8e0 legacy=0x7ffa140d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 --2- 172.21.15.50:0/3214000730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc0039b0 0x7ff9fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 --2- 172.21.15.50:0/3214000730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc004800 0x7ff9fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 --2- 172.21.15.50:0/3214000730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9fc0051c0 0x7ff9fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc00c040 con 0x7ff9fc0039b0 2024-09-11T22:20:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc00c1f0 con 0x7ff9fc004800 2024-09-11T22:20:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff9fc00c3f0 con 0x7ff9fc0051c0 2024-09-11T22:20:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa13fff640 1 --2- 172.21.15.50:0/3214000730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc0039b0 0x7ff9fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa137fe640 1 --2- 172.21.15.50:0/3214000730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc004800 0x7ff9fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa18b95640 1 --2- 172.21.15.50:0/3214000730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9fc0051c0 0x7ff9fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa13fff640 1 -- 172.21.15.50:0/3214000730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9fc0051c0 msgr2=0x7ff9fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa13fff640 1 --2- 172.21.15.50:0/3214000730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9fc0051c0 0x7ff9fc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa13fff640 1 -- 172.21.15.50:0/3214000730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc004800 msgr2=0x7ff9fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa13fff640 1 --2- 172.21.15.50:0/3214000730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc004800 0x7ff9fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa13fff640 1 -- 172.21.15.50:0/3214000730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9fc003520 con 0x7ff9fc0039b0 2024-09-11T22:20:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.206+0000 7ffa18b95640 1 -- 172.21.15.50:0/3214000730 reap_dead start 2024-09-11T22:20:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.207+0000 7ffa13fff640 1 --2- 172.21.15.50:0/3214000730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc0039b0 0x7ff9fc003dd0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c240 tx=0x7ff9fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737afddcd1773795 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.207+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04007d10 con 0x7ff9fc0039b0 2024-09-11T22:20:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.207+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa04005ad0 con 0x7ff9fc0039b0 2024-09-11T22:20:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.207+0000 7ffa12ffd640 1 -- 172.21.15.50:0/3214000730 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04007070 con 0x7ff9fc0039b0 2024-09-11T22:20:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.208+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/3214000730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc0039b0 msgr2=0x7ff9fc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.208+0000 7ffa1a5f8640 1 --2- 172.21.15.50:0/3214000730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc0039b0 0x7ff9fc003dd0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c240 tx=0x7ff9fc005830 comp rx=0 tx=0).stop 2024-09-11T22:20:45.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.208+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/3214000730 shutdown_connections 2024-09-11T22:20:45.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.208+0000 7ffa1a5f8640 1 --2- 172.21.15.50:0/3214000730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9fc0039b0 0x7ff9fc003dd0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.208+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/3214000730 >> 172.21.15.50:0/3214000730 conn(0x7ffa14067ba0 msgr2=0x7ffa14067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:45.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.208+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/3214000730 shutdown_connections 2024-09-11T22:20:45.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.208+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/3214000730 wait complete. 2024-09-11T22:20:45.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.209+0000 7ffa1a5f8640 1 Processor -- start 2024-09-11T22:20:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.209+0000 7ffa1a5f8640 1 -- start start 2024-09-11T22:20:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.210+0000 7ffa1a5f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc0039b0 0x7ffa140ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.210+0000 7ffa1a5f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa141f4eb0 0x7ffa14160720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.210+0000 7ffa1a5f8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa141f4230 0x7ffa141f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.210+0000 7ffa1a5f8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffa140b7c10 con 0x7ffa141f4230 2024-09-11T22:20:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.210+0000 7ffa1a5f8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffa140b7a90 con 0x7ff9fc0039b0 2024-09-11T22:20:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.210+0000 7ffa1a5f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffa140d2ad0 con 0x7ffa141f4eb0 2024-09-11T22:20:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.210+0000 7ffa18b95640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa141f4230 0x7ffa141f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.210+0000 7ffa18b95640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa141f4230 0x7ffa141f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58054/0 (socket says 172.21.15.50:58054) 2024-09-11T22:20:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.210+0000 7ffa18b95640 1 -- 172.21.15.50:0/2367290572 learned_addr learned my addr 172.21.15.50:0/2367290572 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.210+0000 7ffa137fe640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa141f4eb0 0x7ffa14160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.210+0000 7ffa13fff640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc0039b0 0x7ffa140ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.211+0000 7ffa18b95640 1 -- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa141f4eb0 msgr2=0x7ffa14160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.211+0000 7ffa18b95640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa141f4eb0 0x7ffa14160720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.211+0000 7ffa18b95640 1 -- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc0039b0 msgr2=0x7ffa140ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.211+0000 7ffa18b95640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc0039b0 0x7ffa140ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.211+0000 7ffa18b95640 1 -- 172.21.15.50:0/2367290572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa141f4bf0 con 0x7ffa141f4230 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.211+0000 7ffa18b95640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa141f4230 0x7ffa141f46b0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7ffa140cedf0 tx=0x7ffa0c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.211+0000 7ffa10ff9640 1 -- 172.21.15.50:0/2367290572 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c00fdb0 con 0x7ffa141f4230 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.211+0000 7ffa10ff9640 1 -- 172.21.15.50:0/2367290572 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c01d070 con 0x7ffa141f4230 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.211+0000 7ffa10ff9640 1 -- 172.21.15.50:0/2367290572 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c015670 con 0x7ffa141f4230 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.211+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/2367290572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa140cec00 con 0x7ffa141f4230 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.211+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/2367290572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa14160f70 con 0x7ffa141f4230 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.212+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/2367290572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa14162350 con 0x7ffa141f4230 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.212+0000 7ffa10ff9640 1 -- 172.21.15.50:0/2367290572 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa0c015810 con 0x7ffa141f4230 2024-09-11T22:20:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.213+0000 7ffa10ff9640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffa0006be60 0x7ffa0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.213+0000 7ffa10ff9640 1 -- 172.21.15.50:0/2367290572 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 4943+0+0 (secure 0 0 0) 0x7ffa0c08b450 con 0x7ffa141f4230 2024-09-11T22:20:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.213+0000 7ffa13fff640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffa0006be60 0x7ffa0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.214+0000 7ffa13fff640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffa0006be60 0x7ffa0006e320 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ffa04032000 tx=0x7ffa0402d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.217+0000 7ffa10ff9640 1 -- 172.21.15.50:0/2367290572 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa0c027020 con 0x7ffa141f4230 2024-09-11T22:20:45.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:45.408+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/2367290572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ffa140ba770 con 0x7ffa141f4230 2024-09-11T22:20:46.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.200+0000 7ffa10ff9640 1 -- 172.21.15.50:0/2367290572 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v152) ==== 97+0+0 (secure 0 0 0) 0x7ffa141f4bf0 con 0x7ffa141f4230 2024-09-11T22:20:46.201 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-11T22:20:46.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.204+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffa0006be60 msgr2=0x7ffa0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.204+0000 7ffa1a5f8640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffa0006be60 0x7ffa0006e320 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ffa04032000 tx=0x7ffa0402d000 comp rx=0 tx=0).stop 2024-09-11T22:20:46.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.204+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/2367290572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa141f4230 msgr2=0x7ffa141f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.204+0000 7ffa1a5f8640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa141f4230 0x7ffa141f46b0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7ffa140cedf0 tx=0x7ffa0c00f580 comp rx=0 tx=0).stop 2024-09-11T22:20:46.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.204+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/2367290572 shutdown_connections 2024-09-11T22:20:46.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.204+0000 7ffa1a5f8640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffa0006be60 0x7ffa0006e320 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.204+0000 7ffa1a5f8640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa141f4eb0 0x7ffa14160720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.204+0000 7ffa1a5f8640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa141f4230 0x7ffa141f46b0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.204+0000 7ffa1a5f8640 1 --2- 172.21.15.50:0/2367290572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9fc0039b0 0x7ffa140ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.204+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/2367290572 >> 172.21.15.50:0/2367290572 conn(0x7ffa14067ba0 msgr2=0x7ffa140d1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.204+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/2367290572 shutdown_connections 2024-09-11T22:20:46.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.204+0000 7ffa1a5f8640 1 -- 172.21.15.50:0/2367290572 wait complete. 2024-09-11T22:20:46.219 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T22:20:46.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.327+0000 7f0e785fd640 1 Processor -- start 2024-09-11T22:20:46.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.327+0000 7f0e785fd640 1 -- start start 2024-09-11T22:20:46.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.328+0000 7f0e785fd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e7015c2c0 0x7f0e700b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.328+0000 7f0e785fd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e700b3e10 0x7f0e700cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.328+0000 7f0e785fd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0e700d0410 0x7f0e7015fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.328+0000 7f0e785fd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0e700d0840 con 0x7f0e7015c2c0 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.328+0000 7f0e785fd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0e700b4f00 con 0x7f0e700d0410 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.328+0000 7f0e785fd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0e700b4360 con 0x7f0e700b3e10 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.328+0000 7f0e76399640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e7015c2c0 0x7f0e700b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.328+0000 7f0e76399640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e7015c2c0 0x7f0e700b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58068/0 (socket says 172.21.15.50:58068) 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.328+0000 7f0e76399640 1 -- 172.21.15.50:0/1092867741 learned_addr learned my addr 172.21.15.50:0/1092867741 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.329+0000 7f0e76b9a640 1 --2- 172.21.15.50:0/1092867741 >> v2:172.21.15.77:3300/0 conn(0x7f0e700d0410 0x7f0e7015fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.329+0000 7f0e75b98640 1 --2- 172.21.15.50:0/1092867741 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e700b3e10 0x7f0e700cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.329+0000 7f0e76399640 1 -- 172.21.15.50:0/1092867741 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e700b3e10 msgr2=0x7f0e700cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.329+0000 7f0e76399640 1 --2- 172.21.15.50:0/1092867741 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e700b3e10 0x7f0e700cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.329+0000 7f0e76399640 1 -- 172.21.15.50:0/1092867741 >> v2:172.21.15.77:3300/0 conn(0x7f0e700d0410 msgr2=0x7f0e7015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.329+0000 7f0e76399640 1 --2- 172.21.15.50:0/1092867741 >> v2:172.21.15.77:3300/0 conn(0x7f0e700d0410 0x7f0e7015fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.329+0000 7f0e76399640 1 -- 172.21.15.50:0/1092867741 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e700b51c0 con 0x7f0e7015c2c0 2024-09-11T22:20:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.329+0000 7f0e75b98640 1 --2- 172.21.15.50:0/1092867741 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e700b3e10 0x7f0e700cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.329+0000 7f0e76399640 1 --2- 172.21.15.50:0/1092867741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e7015c2c0 0x7f0e700b46a0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f0e700d0f50 tx=0x7f0e6002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c515d2bb2348c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.330+0000 7f0e75397640 1 -- 172.21.15.50:0/1092867741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e60036070 con 0x7f0e7015c2c0 2024-09-11T22:20:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.330+0000 7f0e75397640 1 -- 172.21.15.50:0/1092867741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e60031600 con 0x7f0e7015c2c0 2024-09-11T22:20:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.330+0000 7f0e75397640 1 -- 172.21.15.50:0/1092867741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e600319d0 con 0x7f0e7015c2c0 2024-09-11T22:20:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.330+0000 7f0e785fd640 1 -- 172.21.15.50:0/1092867741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e7015c2c0 msgr2=0x7f0e700b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.330+0000 7f0e785fd640 1 --2- 172.21.15.50:0/1092867741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e7015c2c0 0x7f0e700b46a0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f0e700d0f50 tx=0x7f0e6002a610 comp rx=0 tx=0).stop 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.330+0000 7f0e785fd640 1 -- 172.21.15.50:0/1092867741 shutdown_connections 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.330+0000 7f0e785fd640 1 --2- 172.21.15.50:0/1092867741 >> v2:172.21.15.77:3300/0 conn(0x7f0e700d0410 0x7f0e7015fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.330+0000 7f0e785fd640 1 --2- 172.21.15.50:0/1092867741 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e700b3e10 0x7f0e700cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.330+0000 7f0e785fd640 1 --2- 172.21.15.50:0/1092867741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e7015c2c0 0x7f0e700b46a0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.330+0000 7f0e785fd640 1 -- 172.21.15.50:0/1092867741 >> 172.21.15.50:0/1092867741 conn(0x7f0e700679c0 msgr2=0x7f0e70067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.330+0000 7f0e785fd640 1 -- 172.21.15.50:0/1092867741 shutdown_connections 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.330+0000 7f0e785fd640 1 -- 172.21.15.50:0/1092867741 wait complete. 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.331+0000 7f0e785fd640 1 Processor -- start 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.331+0000 7f0e785fd640 1 -- start start 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.332+0000 7f0e785fd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e700b3e10 0x7f0e701f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.332+0000 7f0e785fd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e700d0410 0x7f0e7015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.332+0000 7f0e785fd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e7015c2c0 0x7f0e7014bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.332+0000 7f0e785fd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0e700ce200 con 0x7f0e7015c2c0 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.332+0000 7f0e785fd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0e700cfc10 con 0x7f0e700d0410 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.332+0000 7f0e785fd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0e7006d070 con 0x7f0e700b3e10 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.332+0000 7f0e76b9a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e7015c2c0 0x7f0e7014bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.332+0000 7f0e76b9a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e7015c2c0 0x7f0e7014bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58074/0 (socket says 172.21.15.50:58074) 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.332+0000 7f0e76b9a640 1 -- 172.21.15.50:0/3767578020 learned_addr learned my addr 172.21.15.50:0/3767578020 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.332+0000 7f0e75b98640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e700d0410 0x7f0e7015b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.332+0000 7f0e76399640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e700b3e10 0x7f0e701f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.333+0000 7f0e76b9a640 1 -- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e700b3e10 msgr2=0x7f0e701f4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.333+0000 7f0e76b9a640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e700b3e10 0x7f0e701f4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.333+0000 7f0e76b9a640 1 -- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e700d0410 msgr2=0x7f0e7015b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.333+0000 7f0e76b9a640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e700d0410 0x7f0e7015b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.333+0000 7f0e76b9a640 1 -- 172.21.15.50:0/3767578020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e7014c420 con 0x7f0e7015c2c0 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.333+0000 7f0e76b9a640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e7015c2c0 0x7f0e7014bee0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800d5d0 tx=0x7f0e6800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.333+0000 7f0e6effd640 1 -- 172.21.15.50:0/3767578020 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e680125f0 con 0x7f0e7015c2c0 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.333+0000 7f0e6effd640 1 -- 172.21.15.50:0/3767578020 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e68019070 con 0x7f0e7015c2c0 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.333+0000 7f0e6effd640 1 -- 172.21.15.50:0/3767578020 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e680129f0 con 0x7f0e7015c2c0 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.333+0000 7f0e785fd640 1 -- 172.21.15.50:0/3767578020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e701f4e60 con 0x7f0e7015c2c0 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.333+0000 7f0e785fd640 1 -- 172.21.15.50:0/3767578020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e701f5420 con 0x7f0e7015c2c0 2024-09-11T22:20:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.334+0000 7f0e785fd640 1 -- 172.21.15.50:0/3767578020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e7015c6a0 con 0x7f0e7015c2c0 2024-09-11T22:20:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.334+0000 7f0e6effd640 1 -- 172.21.15.50:0/3767578020 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e68012b90 con 0x7f0e7015c2c0 2024-09-11T22:20:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.335+0000 7f0e6effd640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e5c06be60 0x7f0e5c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.335+0000 7f0e6effd640 1 -- 172.21.15.50:0/3767578020 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 4857+0+0 (secure 0 0 0) 0x7f0e6808acf0 con 0x7f0e7015c2c0 2024-09-11T22:20:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.335+0000 7f0e76399640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e5c06be60 0x7f0e5c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.336+0000 7f0e76399640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e5c06be60 0x7f0e5c06e320 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0e60033000 tx=0x7f0e60009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.339+0000 7f0e6effd640 1 -- 172.21.15.50:0/3767578020 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e6808f070 con 0x7f0e7015c2c0 2024-09-11T22:20:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.579+0000 7f0e785fd640 1 -- 172.21.15.50:0/3767578020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0e701e73d0 con 0x7f0e7015c2c0 2024-09-11T22:20:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.580+0000 7f0e6effd640 1 -- 172.21.15.50:0/3767578020 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7f0e680593b0 con 0x7f0e7015c2c0 2024-09-11T22:20:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:46.581 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:20:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-11T22:20:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-11T22:20:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w==", 2024-09-11T22:20:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:20:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:20:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:20:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-11T22:20:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg==", 2024-09-11T22:20:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:20:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:20:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:20:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-11T22:20:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ==", 2024-09-11T22:20:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:20:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:20:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:20:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-11T22:20:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw==", 2024-09-11T22:20:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:20:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:20:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:20:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-11T22:20:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg==", 2024-09-11T22:20:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:20:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ==", 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-11T22:20:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg==", 2024-09-11T22:20:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:20:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:20:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-11T22:20:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg==", 2024-09-11T22:20:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:20:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:20:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-11T22:20:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A==", 2024-09-11T22:20:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:20:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:20:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-11T22:20:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw==", 2024-09-11T22:20:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:20:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:20:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-11T22:20:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A==", 2024-09-11T22:20:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:20:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:20:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-11T22:20:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw==", 2024-09-11T22:20:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:20:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:20:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-11T22:20:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew==", 2024-09-11T22:20:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:20:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-11T22:20:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T22:20:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-11T22:20:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw==", 2024-09-11T22:20:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:20:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:20:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:20:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:20:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-11T22:20:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg==", 2024-09-11T22:20:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:20:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:20:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw==", 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-11T22:20:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBFFeJmAq9+OBAAANc9KfDvm3+wt/uED7WCvA==", 2024-09-11T22:20:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:20:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:20:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:20:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-11T22:20:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g==", 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg==", 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:20:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.595 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.595 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-11T22:20:46.595 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:20:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.582+0000 7f0e785fd640 1 -- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e5c06be60 msgr2=0x7f0e5c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.582+0000 7f0e785fd640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e5c06be60 0x7f0e5c06e320 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0e60033000 tx=0x7f0e60009000 comp rx=0 tx=0).stop 2024-09-11T22:20:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.582+0000 7f0e785fd640 1 -- 172.21.15.50:0/3767578020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e7015c2c0 msgr2=0x7f0e7014bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.582+0000 7f0e785fd640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e7015c2c0 0x7f0e7014bee0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800d5d0 tx=0x7f0e6800da90 comp rx=0 tx=0).stop 2024-09-11T22:20:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.582+0000 7f0e785fd640 1 -- 172.21.15.50:0/3767578020 shutdown_connections 2024-09-11T22:20:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.582+0000 7f0e785fd640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e5c06be60 0x7f0e5c06e320 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.582+0000 7f0e785fd640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e7015c2c0 0x7f0e7014bee0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.582+0000 7f0e785fd640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e700d0410 0x7f0e7015b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.582+0000 7f0e785fd640 1 --2- 172.21.15.50:0/3767578020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e700b3e10 0x7f0e701f4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.582+0000 7f0e785fd640 1 -- 172.21.15.50:0/3767578020 >> 172.21.15.50:0/3767578020 conn(0x7f0e700679c0 msgr2=0x7f0e700ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.582+0000 7f0e785fd640 1 -- 172.21.15.50:0/3767578020 shutdown_connections 2024-09-11T22:20:46.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.582+0000 7f0e785fd640 1 -- 172.21.15.50:0/3767578020 wait complete. 2024-09-11T22:20:46.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:20:46.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.699+0000 7fce59711640 1 Processor -- start 2024-09-11T22:20:46.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.699+0000 7fce59711640 1 -- start start 2024-09-11T22:20:46.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.699+0000 7fce59711640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce540680d0 0x7fce5415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.699+0000 7fce59711640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce5415f7f0 con 0x7fce5415c3c0 2024-09-11T22:20:46.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce59711640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce5415fad0 con 0x7fce5415f350 2024-09-11T22:20:46.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce59711640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fce5406e700 con 0x7fce540680d0 2024-09-11T22:20:46.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce52ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fce5415c3c0 0x7fce5415ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54716/0 (socket says 172.21.15.50:54716) 2024-09-11T22:20:46.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce52ffd640 1 -- 172.21.15.50:0/51953673 learned_addr learned my addr 172.21.15.50:0/51953673 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:46.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce537fe640 1 --2- 172.21.15.50:0/51953673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce540680d0 0x7fce5415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 217455642 0 0) 0x7fce5415f7f0 con 0x7fce5415c3c0 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce3c003520 con 0x7fce5415c3c0 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2530817079 0 0) 0x7fce3c003520 con 0x7fce5415c3c0 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce540680d0 msgr2=0x7fce5415fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 --2- 172.21.15.50:0/51953673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce540680d0 0x7fce5415fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 >> v1:172.21.15.77:6789/0 conn(0x7fce5415f350 legacy=0x7fce540679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5406e950 con 0x7fce5415c3c0 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fce44001670 con 0x7fce5415c3c0 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 >> v1:172.21.15.50:6789/0 conn(0x7fce5415c3c0 legacy=0x7fce5415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 --2- 172.21.15.50:0/51953673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce3c0039e0 0x7fce3c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 --2- 172.21.15.50:0/51953673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce3c004390 0x7fce3c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 --2- 172.21.15.50:0/51953673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce540680d0 0x7fce3c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce5406e700 con 0x7fce3c0039e0 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c00bad0 con 0x7fce3c004390 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c00bcd0 con 0x7fce540680d0 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce52ffd640 1 --2- 172.21.15.50:0/51953673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce3c0039e0 0x7fce3c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.701+0000 7fce537fe640 1 --2- 172.21.15.50:0/51953673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce540680d0 0x7fce3c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.700+0000 7fce527fc640 1 --2- 172.21.15.50:0/51953673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce3c004390 0x7fce3c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.701+0000 7fce52ffd640 1 -- 172.21.15.50:0/51953673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce540680d0 msgr2=0x7fce3c005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.701+0000 7fce52ffd640 1 --2- 172.21.15.50:0/51953673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce540680d0 0x7fce3c005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.701+0000 7fce52ffd640 1 -- 172.21.15.50:0/51953673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce3c004390 msgr2=0x7fce3c004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.701+0000 7fce52ffd640 1 --2- 172.21.15.50:0/51953673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce3c004390 0x7fce3c004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.701+0000 7fce52ffd640 1 -- 172.21.15.50:0/51953673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c003520 con 0x7fce3c0039e0 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.701+0000 7fce52ffd640 1 --2- 172.21.15.50:0/51953673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce3c0039e0 0x7fce3c003dc0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fce4400c240 tx=0x7fce3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a32a8d0ff081bf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.702+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4402e070 con 0x7fce3c0039e0 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.702+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce44005af0 con 0x7fce3c0039e0 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.702+0000 7fce51ffb640 1 -- 172.21.15.50:0/51953673 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44007d30 con 0x7fce3c0039e0 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.702+0000 7fce59711640 1 -- 172.21.15.50:0/51953673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce3c0039e0 msgr2=0x7fce3c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.702+0000 7fce59711640 1 --2- 172.21.15.50:0/51953673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce3c0039e0 0x7fce3c003dc0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fce4400c240 tx=0x7fce3c005830 comp rx=0 tx=0).stop 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.702+0000 7fce537fe640 1 -- 172.21.15.50:0/51953673 reap_dead start 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.702+0000 7fce59711640 1 -- 172.21.15.50:0/51953673 shutdown_connections 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.702+0000 7fce59711640 1 -- 172.21.15.50:0/51953673 >> 172.21.15.50:0/51953673 conn(0x7fce54075060 msgr2=0x7fce5406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.702+0000 7fce59711640 1 -- 172.21.15.50:0/51953673 shutdown_connections 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.702+0000 7fce59711640 1 -- 172.21.15.50:0/51953673 wait complete. 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.704+0000 7fce59711640 1 Processor -- start 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.704+0000 7fce59711640 1 -- start start 2024-09-11T22:20:46.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.704+0000 7fce59711640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce3c0039e0 0x7fce540cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.704+0000 7fce59711640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce54152080 0x7fce540cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.704+0000 7fce59711640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce540cc730 0x7fce5414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.704+0000 7fce59711640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce5415fe60 con 0x7fce54152080 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.704+0000 7fce59711640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce540d0940 con 0x7fce3c0039e0 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.704+0000 7fce59711640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fce5415ffe0 con 0x7fce540cc730 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce527fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce54152080 0x7fce540cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce52ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce3c0039e0 0x7fce540cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce527fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce54152080 0x7fce540cc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58100/0 (socket says 172.21.15.50:58100) 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce527fc640 1 -- 172.21.15.50:0/3242599025 learned_addr learned my addr 172.21.15.50:0/3242599025 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce537fe640 1 --2- 172.21.15.50:0/3242599025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce540cc730 0x7fce5414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce527fc640 1 -- 172.21.15.50:0/3242599025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce540cc730 msgr2=0x7fce5414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce527fc640 1 --2- 172.21.15.50:0/3242599025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce540cc730 0x7fce5414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce527fc640 1 -- 172.21.15.50:0/3242599025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce3c0039e0 msgr2=0x7fce540cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce527fc640 1 --2- 172.21.15.50:0/3242599025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce3c0039e0 0x7fce540cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce527fc640 1 -- 172.21.15.50:0/3242599025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5415c940 con 0x7fce54152080 2024-09-11T22:20:46.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce527fc640 1 --2- 172.21.15.50:0/3242599025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce54152080 0x7fce540cc1f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fce4800f7c0 tx=0x7fce4800fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce3b7fe640 1 -- 172.21.15.50:0/3242599025 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4800fe70 con 0x7fce54152080 2024-09-11T22:20:46.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce3b7fe640 1 -- 172.21.15.50:0/3242599025 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce48018070 con 0x7fce54152080 2024-09-11T22:20:46.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce59711640 1 -- 172.21.15.50:0/3242599025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5415cbe0 con 0x7fce54152080 2024-09-11T22:20:46.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce3b7fe640 1 -- 172.21.15.50:0/3242599025 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4800d730 con 0x7fce54152080 2024-09-11T22:20:46.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.705+0000 7fce59711640 1 -- 172.21.15.50:0/3242599025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5415d1a0 con 0x7fce54152080 2024-09-11T22:20:46.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.706+0000 7fce59711640 1 -- 172.21.15.50:0/3242599025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce5406cae0 con 0x7fce54152080 2024-09-11T22:20:46.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.707+0000 7fce3b7fe640 1 -- 172.21.15.50:0/3242599025 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce4800d8d0 con 0x7fce54152080 2024-09-11T22:20:46.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.707+0000 7fce3b7fe640 1 --2- 172.21.15.50:0/3242599025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fce4006be30 0x7fce4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.707+0000 7fce3b7fe640 1 -- 172.21.15.50:0/3242599025 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 4857+0+0 (secure 0 0 0) 0x7fce4808a850 con 0x7fce54152080 2024-09-11T22:20:46.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.708+0000 7fce52ffd640 1 --2- 172.21.15.50:0/3242599025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fce4006be30 0x7fce4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.708+0000 7fce52ffd640 1 --2- 172.21.15.50:0/3242599025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fce4006be30 0x7fce4006e2f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fce44033000 tx=0x7fce4402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.712+0000 7fce3b7fe640 1 -- 172.21.15.50:0/3242599025 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce48058f90 con 0x7fce54152080 2024-09-11T22:20:46.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.889+0000 7fce59711640 1 -- 172.21.15.50:0/3242599025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fce54161ad0 con 0x7fce54152080 2024-09-11T22:20:46.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.889+0000 7fce3b7fe640 1 -- 172.21.15.50:0/3242599025 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v152) ==== 84+0+65 (secure 0 0 0) 0x7fce4805d290 con 0x7fce54152080 2024-09-11T22:20:46.890 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:46.890 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:20:46.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:20:46.891 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:20:46.891 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:20:46.891 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:20:46.892 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:20:46.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.891+0000 7fce59711640 1 -- 172.21.15.50:0/3242599025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fce4006be30 msgr2=0x7fce4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.891+0000 7fce59711640 1 --2- 172.21.15.50:0/3242599025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fce4006be30 0x7fce4006e2f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fce44033000 tx=0x7fce4402e000 comp rx=0 tx=0).stop 2024-09-11T22:20:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.891+0000 7fce59711640 1 -- 172.21.15.50:0/3242599025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce54152080 msgr2=0x7fce540cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.891+0000 7fce59711640 1 --2- 172.21.15.50:0/3242599025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce54152080 0x7fce540cc1f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fce4800f7c0 tx=0x7fce4800fc80 comp rx=0 tx=0).stop 2024-09-11T22:20:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.891+0000 7fce59711640 1 -- 172.21.15.50:0/3242599025 shutdown_connections 2024-09-11T22:20:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.891+0000 7fce59711640 1 --2- 172.21.15.50:0/3242599025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fce4006be30 0x7fce4006e2f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.891+0000 7fce59711640 1 --2- 172.21.15.50:0/3242599025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce540cc730 0x7fce5414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.891+0000 7fce59711640 1 --2- 172.21.15.50:0/3242599025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce54152080 0x7fce540cc1f0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.891+0000 7fce59711640 1 --2- 172.21.15.50:0/3242599025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce3c0039e0 0x7fce540cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.891+0000 7fce59711640 1 -- 172.21.15.50:0/3242599025 >> 172.21.15.50:0/3242599025 conn(0x7fce54075060 msgr2=0x7fce54160800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.891+0000 7fce59711640 1 -- 172.21.15.50:0/3242599025 shutdown_connections 2024-09-11T22:20:46.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:46.891+0000 7fce59711640 1 -- 172.21.15.50:0/3242599025 wait complete. 2024-09-11T22:20:46.903 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:20:46.904 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:20:47.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.010+0000 7f08d6882640 1 Processor -- start 2024-09-11T22:20:47.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.010+0000 7f08d6882640 1 -- start start 2024-09-11T22:20:47.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.010+0000 7f08d6882640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d006ff20 0x7f08d015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.010+0000 7f08d6882640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08d00afe10 0x7f08d00b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.011+0000 7f08d6882640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08d0159050 con 0x7f08d00b1e80 2024-09-11T22:20:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.011+0000 7f08d6882640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f08d0070300 con 0x7f08d00afe10 2024-09-11T22:20:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.011+0000 7f08d6882640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f08d00b0790 con 0x7f08d006ff20 2024-09-11T22:20:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.011+0000 7f08cf7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08d00afe10 0x7f08d00b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.011+0000 7f08cf7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08d00afe10 0x7f08d00b0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58106/0 (socket says 172.21.15.50:58106) 2024-09-11T22:20:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.011+0000 7f08cf7fe640 1 -- 172.21.15.50:0/2868748409 learned_addr learned my addr 172.21.15.50:0/2868748409 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.011+0000 7f08cffff640 1 --2- 172.21.15.50:0/2868748409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d006ff20 0x7f08d015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.011+0000 7f08cf7fe640 1 -- 172.21.15.50:0/2868748409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d006ff20 msgr2=0x7f08d015eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.011+0000 7f08cf7fe640 1 --2- 172.21.15.50:0/2868748409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d006ff20 0x7f08d015eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.011+0000 7f08cf7fe640 1 -- 172.21.15.50:0/2868748409 >> v1:172.21.15.77:6789/0 conn(0x7f08d00b1e80 legacy=0x7f08d0162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.011+0000 7f08cf7fe640 1 -- 172.21.15.50:0/2868748409 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d00ae8c0 con 0x7f08d00afe10 2024-09-11T22:20:47.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.012+0000 7f08cf7fe640 1 --2- 172.21.15.50:0/2868748409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d00afe10 0x7f08d00b0250 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009870 tx=0x7f08c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5a386870f6849 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.012+0000 7f08ceffd640 1 -- 172.21.15.50:0/2868748409 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c4037070 con 0x7f08d00afe10 2024-09-11T22:20:47.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.012+0000 7f08ceffd640 1 -- 172.21.15.50:0/2868748409 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c4032440 con 0x7f08d00afe10 2024-09-11T22:20:47.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.012+0000 7f08ceffd640 1 -- 172.21.15.50:0/2868748409 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c4032810 con 0x7f08d00afe10 2024-09-11T22:20:47.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.012+0000 7f08d6882640 1 -- 172.21.15.50:0/2868748409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d00afe10 msgr2=0x7f08d00b0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.012+0000 7f08d6882640 1 --2- 172.21.15.50:0/2868748409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d00afe10 0x7f08d00b0250 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009870 tx=0x7f08c402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:47.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.013+0000 7f08d6882640 1 -- 172.21.15.50:0/2868748409 shutdown_connections 2024-09-11T22:20:47.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.013+0000 7f08d6882640 1 --2- 172.21.15.50:0/2868748409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d00afe10 0x7f08d00b0250 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.013+0000 7f08d6882640 1 --2- 172.21.15.50:0/2868748409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d006ff20 0x7f08d015eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.013+0000 7f08d6882640 1 -- 172.21.15.50:0/2868748409 >> 172.21.15.50:0/2868748409 conn(0x7f08d00b0a60 msgr2=0x7f08d0073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.013+0000 7f08d6882640 1 -- 172.21.15.50:0/2868748409 shutdown_connections 2024-09-11T22:20:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.013+0000 7f08d6882640 1 -- 172.21.15.50:0/2868748409 wait complete. 2024-09-11T22:20:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.014+0000 7f08d6882640 1 Processor -- start 2024-09-11T22:20:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.014+0000 7f08d6882640 1 -- start start 2024-09-11T22:20:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08d6882640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d006ff20 0x7f08d00d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08d6882640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d00afe10 0x7f08d01486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08d6882640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d00b1e80 0x7f08d0154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08d6882640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f08d00af160 con 0x7f08d006ff20 2024-09-11T22:20:47.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08d6882640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f08d00aee80 con 0x7f08d00afe10 2024-09-11T22:20:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08d6882640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f08d00af440 con 0x7f08d00b1e80 2024-09-11T22:20:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08cffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d006ff20 0x7f08d00d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08cffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d006ff20 0x7f08d00d0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58112/0 (socket says 172.21.15.50:58112) 2024-09-11T22:20:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08cffff640 1 -- 172.21.15.50:0/1314513379 learned_addr learned my addr 172.21.15.50:0/1314513379 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08cf7fe640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d00afe10 0x7f08d01486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08d4e1f640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d00b1e80 0x7f08d0154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08cffff640 1 -- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d00b1e80 msgr2=0x7f08d0154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08cffff640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d00b1e80 0x7f08d0154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08cffff640 1 -- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d00afe10 msgr2=0x7f08d01486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08cffff640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d00afe10 0x7f08d01486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08cffff640 1 -- 172.21.15.50:0/1314513379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d0153480 con 0x7f08d006ff20 2024-09-11T22:20:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08cffff640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d006ff20 0x7f08d00d0150 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f08c000e870 tx=0x7f08c000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08ccff9640 1 -- 172.21.15.50:0/1314513379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c0017070 con 0x7f08d006ff20 2024-09-11T22:20:47.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08ccff9640 1 -- 172.21.15.50:0/1314513379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c000c940 con 0x7f08d006ff20 2024-09-11T22:20:47.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.015+0000 7f08d6882640 1 -- 172.21.15.50:0/1314513379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d0153760 con 0x7f08d006ff20 2024-09-11T22:20:47.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.016+0000 7f08ccff9640 1 -- 172.21.15.50:0/1314513379 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c000cd30 con 0x7f08d006ff20 2024-09-11T22:20:47.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.016+0000 7f08d6882640 1 -- 172.21.15.50:0/1314513379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d0153d20 con 0x7f08d006ff20 2024-09-11T22:20:47.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.017+0000 7f08d6882640 1 -- 172.21.15.50:0/1314513379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d015eb70 con 0x7f08d006ff20 2024-09-11T22:20:47.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.017+0000 7f08ccff9640 1 -- 172.21.15.50:0/1314513379 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08c001a070 con 0x7f08d006ff20 2024-09-11T22:20:47.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.018+0000 7f08ccff9640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08bc06be30 0x7f08bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.018+0000 7f08ccff9640 1 -- 172.21.15.50:0/1314513379 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 4857+0+0 (secure 0 0 0) 0x7f08c008acd0 con 0x7f08d006ff20 2024-09-11T22:20:47.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.018+0000 7f08cf7fe640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08bc06be30 0x7f08bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.018+0000 7f08cf7fe640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08bc06be30 0x7f08bc06e2f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f08c4034000 tx=0x7f08c402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.022+0000 7f08ccff9640 1 -- 172.21.15.50:0/1314513379 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f08c0059380 con 0x7f08d006ff20 2024-09-11T22:20:47.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.197+0000 7f08d6882640 1 -- 172.21.15.50:0/1314513379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f08d0074e20 con 0x7f08d006ff20 2024-09-11T22:20:47.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.280+0000 7f08ccff9640 1 -- 172.21.15.50:0/1314513379 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v153) ==== 138+0+0 (secure 0 0 0) 0x7f08c005d680 con 0x7f08d006ff20 2024-09-11T22:20:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:20:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.282+0000 7f08d6882640 1 -- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08bc06be30 msgr2=0x7f08bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.282+0000 7f08d6882640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08bc06be30 0x7f08bc06e2f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f08c4034000 tx=0x7f08c402e000 comp rx=0 tx=0).stop 2024-09-11T22:20:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.282+0000 7f08d6882640 1 -- 172.21.15.50:0/1314513379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d006ff20 msgr2=0x7f08d00d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.282+0000 7f08d6882640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d006ff20 0x7f08d00d0150 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f08c000e870 tx=0x7f08c000ed30 comp rx=0 tx=0).stop 2024-09-11T22:20:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.282+0000 7f08d6882640 1 -- 172.21.15.50:0/1314513379 shutdown_connections 2024-09-11T22:20:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.282+0000 7f08d6882640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08bc06be30 0x7f08bc06e2f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.282+0000 7f08d6882640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f08d00b1e80 0x7f08d0154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.282+0000 7f08d6882640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d00afe10 0x7f08d01486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.282+0000 7f08d6882640 1 --2- 172.21.15.50:0/1314513379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08d006ff20 0x7f08d00d0150 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.282+0000 7f08d6882640 1 -- 172.21.15.50:0/1314513379 >> 172.21.15.50:0/1314513379 conn(0x7f08d00b0a60 msgr2=0x7f08d0156570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.283+0000 7f08d6882640 1 -- 172.21.15.50:0/1314513379 shutdown_connections 2024-09-11T22:20:47.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.283+0000 7f08d6882640 1 -- 172.21.15.50:0/1314513379 wait complete. 2024-09-11T22:20:47.296 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:20:47.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.406+0000 7f2e82a27640 1 Processor -- start 2024-09-11T22:20:47.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.406+0000 7f2e82a27640 1 -- start start 2024-09-11T22:20:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e82a27640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e7c0d1c90 0x7f2e7c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e82a27640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e7c162350 0x7f2e7c1627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e82a27640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e7c163080 con 0x7f2e7c15e8e0 2024-09-11T22:20:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e82a27640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2e7c15ecc0 con 0x7f2e7c162350 2024-09-11T22:20:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e82a27640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2e7c0d2ad0 con 0x7f2e7c0d1c90 2024-09-11T22:20:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e80fc4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e7c162350 0x7f2e7c1627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e7bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2e7c15e8e0 0x7f2e7c0d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54724/0 (socket says 172.21.15.50:54724) 2024-09-11T22:20:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e7bfff640 1 -- 172.21.15.50:0/3082773852 learned_addr learned my addr 172.21.15.50:0/3082773852 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e80fc4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e7c162350 0x7f2e7c1627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58118/0 (socket says 172.21.15.50:58118) 2024-09-11T22:20:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e7b7fe640 1 --2- 172.21.15.50:0/3082773852 >> v2:172.21.15.77:3300/0 conn(0x7f2e7c0d1c90 0x7f2e7c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e80fc4640 1 -- 172.21.15.50:0/3082773852 >> v2:172.21.15.77:3300/0 conn(0x7f2e7c0d1c90 msgr2=0x7f2e7c0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e80fc4640 1 --2- 172.21.15.50:0/3082773852 >> v2:172.21.15.77:3300/0 conn(0x7f2e7c0d1c90 0x7f2e7c0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e80fc4640 1 -- 172.21.15.50:0/3082773852 >> v1:172.21.15.50:6789/0 conn(0x7f2e7c15e8e0 legacy=0x7f2e7c0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.407+0000 7f2e80fc4640 1 -- 172.21.15.50:0/3082773852 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c0d2d20 con 0x7f2e7c162350 2024-09-11T22:20:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.408+0000 7f2e80fc4640 1 --2- 172.21.15.50:0/3082773852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e7c162350 0x7f2e7c1627a0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c1622b0 tx=0x7f2e7402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f136e4c4d48ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.408+0000 7f2e7affd640 1 -- 172.21.15.50:0/3082773852 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74007740 con 0x7f2e7c162350 2024-09-11T22:20:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.408+0000 7f2e7affd640 1 -- 172.21.15.50:0/3082773852 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e740078e0 con 0x7f2e7c162350 2024-09-11T22:20:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.408+0000 7f2e7affd640 1 -- 172.21.15.50:0/3082773852 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74007cb0 con 0x7f2e7c162350 2024-09-11T22:20:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.408+0000 7f2e82a27640 1 -- 172.21.15.50:0/3082773852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e7c162350 msgr2=0x7f2e7c1627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.408+0000 7f2e82a27640 1 --2- 172.21.15.50:0/3082773852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e7c162350 0x7f2e7c1627a0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c1622b0 tx=0x7f2e7402a710 comp rx=0 tx=0).stop 2024-09-11T22:20:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.409+0000 7f2e82a27640 1 -- 172.21.15.50:0/3082773852 shutdown_connections 2024-09-11T22:20:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.409+0000 7f2e82a27640 1 --2- 172.21.15.50:0/3082773852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e7c162350 0x7f2e7c1627a0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.409+0000 7f2e82a27640 1 --2- 172.21.15.50:0/3082773852 >> v2:172.21.15.77:3300/0 conn(0x7f2e7c0d1c90 0x7f2e7c0b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.409+0000 7f2e82a27640 1 -- 172.21.15.50:0/3082773852 >> 172.21.15.50:0/3082773852 conn(0x7f2e7c067ba0 msgr2=0x7f2e7c067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.409+0000 7f2e82a27640 1 -- 172.21.15.50:0/3082773852 shutdown_connections 2024-09-11T22:20:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.409+0000 7f2e82a27640 1 -- 172.21.15.50:0/3082773852 wait complete. 2024-09-11T22:20:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.410+0000 7f2e82a27640 1 Processor -- start 2024-09-11T22:20:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.410+0000 7f2e82a27640 1 -- start start 2024-09-11T22:20:47.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e82a27640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e7c0d1c90 0x7f2e7c1f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e82a27640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c15e8e0 0x7f2e7c0cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e82a27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e7c162350 0x7f2e7c1f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e82a27640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c162ce0 con 0x7f2e7c162350 2024-09-11T22:20:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e82a27640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c0d3370 con 0x7f2e7c15e8e0 2024-09-11T22:20:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e82a27640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2e7c162e60 con 0x7f2e7c0d1c90 2024-09-11T22:20:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e80fc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e7c162350 0x7f2e7c1f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e80fc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e7c162350 0x7f2e7c1f49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58130/0 (socket says 172.21.15.50:58130) 2024-09-11T22:20:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e80fc4640 1 -- 172.21.15.50:0/2358387403 learned_addr learned my addr 172.21.15.50:0/2358387403 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e7b7fe640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c15e8e0 0x7f2e7c0cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e7bfff640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e7c0d1c90 0x7f2e7c1f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e80fc4640 1 -- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e7c0d1c90 msgr2=0x7f2e7c1f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e80fc4640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e7c0d1c90 0x7f2e7c1f7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e80fc4640 1 -- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c15e8e0 msgr2=0x7f2e7c0cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e80fc4640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c15e8e0 0x7f2e7c0cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e80fc4640 1 -- 172.21.15.50:0/2358387403 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c1f7ba0 con 0x7f2e7c162350 2024-09-11T22:20:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e80fc4640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e7c162350 0x7f2e7c1f49b0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f2e7402ad00 tx=0x7f2e74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.411+0000 7f2e78ff9640 1 -- 172.21.15.50:0/2358387403 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74040070 con 0x7f2e7c162350 2024-09-11T22:20:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.412+0000 7f2e78ff9640 1 -- 172.21.15.50:0/2358387403 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e74031bc0 con 0x7f2e7c162350 2024-09-11T22:20:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.412+0000 7f2e82a27640 1 -- 172.21.15.50:0/2358387403 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e7c0cce80 con 0x7f2e7c162350 2024-09-11T22:20:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.412+0000 7f2e78ff9640 1 -- 172.21.15.50:0/2358387403 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74045460 con 0x7f2e7c162350 2024-09-11T22:20:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.412+0000 7f2e82a27640 1 -- 172.21.15.50:0/2358387403 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e7c0cd440 con 0x7f2e7c162350 2024-09-11T22:20:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.412+0000 7f2e82a27640 1 -- 172.21.15.50:0/2358387403 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e7c0b7880 con 0x7f2e7c162350 2024-09-11T22:20:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.414+0000 7f2e78ff9640 1 -- 172.21.15.50:0/2358387403 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e74039040 con 0x7f2e7c162350 2024-09-11T22:20:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.414+0000 7f2e78ff9640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e6806be30 0x7f2e6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.414+0000 7f2e78ff9640 1 -- 172.21.15.50:0/2358387403 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5227+0+0 (secure 0 0 0) 0x7f2e740ac7c0 con 0x7f2e7c162350 2024-09-11T22:20:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.414+0000 7f2e7bfff640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e6806be30 0x7f2e6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.415+0000 7f2e7bfff640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e6806be30 0x7f2e6806e2f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c15e380 tx=0x7f2e6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.418+0000 7f2e78ff9640 1 -- 172.21.15.50:0/2358387403 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e7407b4c0 con 0x7f2e7c162350 2024-09-11T22:20:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:47.592+0000 7f2e82a27640 1 -- 172.21.15.50:0/2358387403 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2e7c0b4030 con 0x7f2e7c162350 2024-09-11T22:20:47.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-11T22:20:48.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.284+0000 7f2e78ff9640 1 -- 172.21.15.50:0/2358387403 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v154) ==== 170+0+0 (secure 0 0 0) 0x7f2e7407adc0 con 0x7f2e7c162350 2024-09-11T22:20:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:20:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.287+0000 7f2e82a27640 1 -- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e6806be30 msgr2=0x7f2e6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.287+0000 7f2e82a27640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e6806be30 0x7f2e6806e2f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c15e380 tx=0x7f2e6c009040 comp rx=0 tx=0).stop 2024-09-11T22:20:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.287+0000 7f2e82a27640 1 -- 172.21.15.50:0/2358387403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e7c162350 msgr2=0x7f2e7c1f49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.287+0000 7f2e82a27640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e7c162350 0x7f2e7c1f49b0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f2e7402ad00 tx=0x7f2e74004a40 comp rx=0 tx=0).stop 2024-09-11T22:20:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.288+0000 7f2e82a27640 1 -- 172.21.15.50:0/2358387403 shutdown_connections 2024-09-11T22:20:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.288+0000 7f2e82a27640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e6806be30 0x7f2e6806e2f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.288+0000 7f2e82a27640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e7c162350 0x7f2e7c1f49b0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.288+0000 7f2e82a27640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c15e8e0 0x7f2e7c0cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.288+0000 7f2e82a27640 1 --2- 172.21.15.50:0/2358387403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e7c0d1c90 0x7f2e7c1f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.288+0000 7f2e82a27640 1 -- 172.21.15.50:0/2358387403 >> 172.21.15.50:0/2358387403 conn(0x7f2e7c067ba0 msgr2=0x7f2e7c067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.288+0000 7f2e82a27640 1 -- 172.21.15.50:0/2358387403 shutdown_connections 2024-09-11T22:20:48.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.288+0000 7f2e82a27640 1 -- 172.21.15.50:0/2358387403 wait complete. 2024-09-11T22:20:48.315 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:20:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.425+0000 7f0c3096d640 1 Processor -- start 2024-09-11T22:20:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.425+0000 7f0c3096d640 1 -- start start 2024-09-11T22:20:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.426+0000 7f0c3096d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0c2c15c240 0x7f0c2c0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.426+0000 7f0c3096d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c0728e0 0x7f0c2c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.426+0000 7f0c3096d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2c073230 con 0x7f0c2c0735a0 2024-09-11T22:20:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.426+0000 7f0c3096d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2c15c620 con 0x7f0c2c15c240 2024-09-11T22:20:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.426+0000 7f0c3096d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c15f2b0 con 0x7f0c2c0728e0 2024-09-11T22:20:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.427+0000 7f0c29d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0c2c0735a0 0x7f0c2c15eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43768/0 (socket says 172.21.15.50:43768) 2024-09-11T22:20:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.427+0000 7f0c29d9b640 1 -- 172.21.15.50:0/3736336962 learned_addr learned my addr 172.21.15.50:0/3736336962 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.427+0000 7f0c2ad9d640 1 --2- 172.21.15.50:0/3736336962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c0728e0 0x7f0c2c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.427+0000 7f0c2a59c640 1 --2- 172.21.15.50:0/3736336962 >> v2:172.21.15.77:3300/0 conn(0x7f0c2c15c240 0x7f0c2c0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.427+0000 7f0c2959a640 1 -- 172.21.15.50:0/3736336962 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530748200 0 0) 0x7f0c14001110 con 0x7f0c2c0735a0 2024-09-11T22:20:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.427+0000 7f0c2959a640 1 -- 172.21.15.50:0/3736336962 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c18003520 con 0x7f0c2c0735a0 2024-09-11T22:20:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.427+0000 7f0c2ad9d640 1 -- 172.21.15.50:0/3736336962 >> v2:172.21.15.77:3300/0 conn(0x7f0c2c15c240 msgr2=0x7f0c2c0b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.427+0000 7f0c2ad9d640 1 --2- 172.21.15.50:0/3736336962 >> v2:172.21.15.77:3300/0 conn(0x7f0c2c15c240 0x7f0c2c0b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.427+0000 7f0c2ad9d640 1 -- 172.21.15.50:0/3736336962 >> v1:172.21.15.50:6789/0 conn(0x7f0c2c0735a0 legacy=0x7f0c2c15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.427+0000 7f0c2ad9d640 1 -- 172.21.15.50:0/3736336962 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c15f560 con 0x7f0c2c0728e0 2024-09-11T22:20:48.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.427+0000 7f0c2a59c640 1 --2- 172.21.15.50:0/3736336962 >> v2:172.21.15.77:3300/0 conn(0x7f0c2c15c240 0x7f0c2c0b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:48.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.428+0000 7f0c2ad9d640 1 --2- 172.21.15.50:0/3736336962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c0728e0 0x7f0c2c072cf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009d90 tx=0x7f0c1c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a33d8e51afa18cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.428+0000 7f0c2959a640 1 -- 172.21.15.50:0/3736336962 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c007740 con 0x7f0c2c0728e0 2024-09-11T22:20:48.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.428+0000 7f0c2959a640 1 -- 172.21.15.50:0/3736336962 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c0078e0 con 0x7f0c2c0728e0 2024-09-11T22:20:48.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.428+0000 7f0c2959a640 1 -- 172.21.15.50:0/3736336962 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c007cb0 con 0x7f0c2c0728e0 2024-09-11T22:20:48.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.429+0000 7f0c3096d640 1 -- 172.21.15.50:0/3736336962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c0728e0 msgr2=0x7f0c2c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.429+0000 7f0c3096d640 1 --2- 172.21.15.50:0/3736336962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c0728e0 0x7f0c2c072cf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009d90 tx=0x7f0c1c02a660 comp rx=0 tx=0).stop 2024-09-11T22:20:48.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.429+0000 7f0c3096d640 1 -- 172.21.15.50:0/3736336962 shutdown_connections 2024-09-11T22:20:48.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.429+0000 7f0c3096d640 1 --2- 172.21.15.50:0/3736336962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c0728e0 0x7f0c2c072cf0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.429+0000 7f0c3096d640 1 --2- 172.21.15.50:0/3736336962 >> v2:172.21.15.77:3300/0 conn(0x7f0c2c15c240 0x7f0c2c0b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.429+0000 7f0c3096d640 1 -- 172.21.15.50:0/3736336962 >> 172.21.15.50:0/3736336962 conn(0x7f0c2c0b2bd0 msgr2=0x7f0c2c0b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.429+0000 7f0c3096d640 1 -- 172.21.15.50:0/3736336962 shutdown_connections 2024-09-11T22:20:48.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.429+0000 7f0c3096d640 1 -- 172.21.15.50:0/3736336962 wait complete. 2024-09-11T22:20:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.430+0000 7f0c3096d640 1 Processor -- start 2024-09-11T22:20:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.430+0000 7f0c3096d640 1 -- start start 2024-09-11T22:20:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c3096d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c0728e0 0x7f0c2c0cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c3096d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c2c0735a0 0x7f0c2c0d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c3096d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c15c240 0x7f0c2c154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c3096d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c0b3f70 con 0x7f0c2c15c240 2024-09-11T22:20:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c3096d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c15fb20 con 0x7f0c2c0735a0 2024-09-11T22:20:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c3096d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c0b4250 con 0x7f0c2c0728e0 2024-09-11T22:20:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c2ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c15c240 0x7f0c2c154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c2ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c15c240 0x7f0c2c154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36806/0 (socket says 172.21.15.50:36806) 2024-09-11T22:20:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c2ad9d640 1 -- 172.21.15.50:0/1577124132 learned_addr learned my addr 172.21.15.50:0/1577124132 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c2a59c640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c0728e0 0x7f0c2c0cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c29d9b640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c2c0735a0 0x7f0c2c0d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c2ad9d640 1 -- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c0728e0 msgr2=0x7f0c2c0cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c2ad9d640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c0728e0 0x7f0c2c0cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c2ad9d640 1 -- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c2c0735a0 msgr2=0x7f0c2c0d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c2ad9d640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c2c0735a0 0x7f0c2c0d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.431+0000 7f0c2ad9d640 1 -- 172.21.15.50:0/1577124132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c1e90a0 con 0x7f0c2c15c240 2024-09-11T22:20:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.432+0000 7f0c2ad9d640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c15c240 0x7f0c2c154030 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009eb0 tx=0x7f0c1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.432+0000 7f0c22ffd640 1 -- 172.21.15.50:0/1577124132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c040070 con 0x7f0c2c15c240 2024-09-11T22:20:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.432+0000 7f0c22ffd640 1 -- 172.21.15.50:0/1577124132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c031bc0 con 0x7f0c2c15c240 2024-09-11T22:20:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.432+0000 7f0c3096d640 1 -- 172.21.15.50:0/1577124132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c1e9380 con 0x7f0c2c15c240 2024-09-11T22:20:48.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.432+0000 7f0c22ffd640 1 -- 172.21.15.50:0/1577124132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c009450 con 0x7f0c2c15c240 2024-09-11T22:20:48.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.432+0000 7f0c3096d640 1 -- 172.21.15.50:0/1577124132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c1e9940 con 0x7f0c2c15c240 2024-09-11T22:20:48.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.433+0000 7f0c3096d640 1 -- 172.21.15.50:0/1577124132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2c072cf0 con 0x7f0c2c15c240 2024-09-11T22:20:48.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.433+0000 7f0c22ffd640 1 -- 172.21.15.50:0/1577124132 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c1c039040 con 0x7f0c2c15c240 2024-09-11T22:20:48.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.434+0000 7f0c22ffd640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c0c06be30 0x7f0c0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.434+0000 7f0c22ffd640 1 -- 172.21.15.50:0/1577124132 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5609+0+0 (secure 0 0 0) 0x7f0c1c0ac480 con 0x7f0c2c15c240 2024-09-11T22:20:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.434+0000 7f0c2a59c640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c0c06be30 0x7f0c0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.435+0000 7f0c2a59c640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c0c06be30 0x7f0c0c06e2f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009560 tx=0x7f0c24009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.439+0000 7f0c22ffd640 1 -- 172.21.15.50:0/1577124132 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c1c07a960 con 0x7f0c2c15c240 2024-09-11T22:20:48.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:48.654+0000 7f0c3096d640 1 -- 172.21.15.50:0/1577124132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0c2c1e9b10 con 0x7f0c2c15c240 2024-09-11T22:20:49.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.286+0000 7f0c22ffd640 1 -- 172.21.15.50:0/1577124132 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v107) ==== 174+0+0 (secure 0 0 0) 0x7f0c1c07ec60 con 0x7f0c2c15c240 2024-09-11T22:20:49.287 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 22 and data pool 23 2024-09-11T22:20:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.290+0000 7f0c3096d640 1 -- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c0c06be30 msgr2=0x7f0c0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.290+0000 7f0c3096d640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c0c06be30 0x7f0c0c06e2f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009560 tx=0x7f0c24009190 comp rx=0 tx=0).stop 2024-09-11T22:20:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.290+0000 7f0c3096d640 1 -- 172.21.15.50:0/1577124132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c15c240 msgr2=0x7f0c2c154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.290+0000 7f0c3096d640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c15c240 0x7f0c2c154030 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009eb0 tx=0x7f0c1c004a40 comp rx=0 tx=0).stop 2024-09-11T22:20:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.290+0000 7f0c3096d640 1 -- 172.21.15.50:0/1577124132 shutdown_connections 2024-09-11T22:20:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.290+0000 7f0c3096d640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c0c06be30 0x7f0c0c06e2f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.290+0000 7f0c3096d640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c15c240 0x7f0c2c154030 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.290+0000 7f0c3096d640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c2c0735a0 0x7f0c2c0d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.290+0000 7f0c3096d640 1 --2- 172.21.15.50:0/1577124132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c0728e0 0x7f0c2c0cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.290+0000 7f0c3096d640 1 -- 172.21.15.50:0/1577124132 >> 172.21.15.50:0/1577124132 conn(0x7f0c2c0b2bd0 msgr2=0x7f0c2c15eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.290+0000 7f0c3096d640 1 -- 172.21.15.50:0/1577124132 shutdown_connections 2024-09-11T22:20:49.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.290+0000 7f0c3096d640 1 -- 172.21.15.50:0/1577124132 wait complete. 2024-09-11T22:20:49.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:49.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.417+0000 7ff72bed0640 1 Processor -- start 2024-09-11T22:20:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.417+0000 7ff72bed0640 1 -- start start 2024-09-11T22:20:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff72bed0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72415e840 0x7ff7240b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff72bed0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7240cdd50 0x7ff7240cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff72bed0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7240ce5f0 con 0x7ff7240cf3b0 2024-09-11T22:20:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff72bed0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff72406c240 con 0x7ff7240cdd50 2024-09-11T22:20:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff72bed0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff7240d0470 con 0x7ff72415e840 2024-09-11T22:20:49.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff729c6c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72415e840 0x7ff7240b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff72946b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7240cdd50 0x7ff7240cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff72946b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7240cdd50 0x7ff7240cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:53754/0 (socket says 172.21.15.50:53754) 2024-09-11T22:20:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff72946b640 1 -- 172.21.15.50:0/1032261791 learned_addr learned my addr 172.21.15.50:0/1032261791 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff72a46d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff7240cf3b0 0x7ff7240d0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:57966/0 (socket says 172.21.15.50:57966) 2024-09-11T22:20:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff729c6c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72415e840 0x7ff7240b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:53020/0 (socket says 172.21.15.50:53020) 2024-09-11T22:20:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff72946b640 1 -- 172.21.15.50:0/1032261791 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72415e840 msgr2=0x7ff7240b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff72946b640 1 --2- 172.21.15.50:0/1032261791 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72415e840 0x7ff7240b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff72946b640 1 -- 172.21.15.50:0/1032261791 >> v1:172.21.15.77:6789/0 conn(0x7ff7240cf3b0 legacy=0x7ff7240d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff72946b640 1 -- 172.21.15.50:0/1032261791 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7240ce310 con 0x7ff7240cdd50 2024-09-11T22:20:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.418+0000 7ff729c6c640 1 --2- 172.21.15.50:0/1032261791 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72415e840 0x7ff7240b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.419+0000 7ff72946b640 1 --2- 172.21.15.50:0/1032261791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7240cdd50 0x7ff7240cee70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff7180098a0 tx=0x7ff71802a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3891a217e00be043 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.419+0000 7ff728c6a640 1 -- 172.21.15.50:0/1032261791 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff718037070 con 0x7ff7240cdd50 2024-09-11T22:20:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.419+0000 7ff728c6a640 1 -- 172.21.15.50:0/1032261791 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff718032440 con 0x7ff7240cdd50 2024-09-11T22:20:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.419+0000 7ff728c6a640 1 -- 172.21.15.50:0/1032261791 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff718032810 con 0x7ff7240cdd50 2024-09-11T22:20:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.420+0000 7ff72bed0640 1 -- 172.21.15.50:0/1032261791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7240cdd50 msgr2=0x7ff7240cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.420+0000 7ff72bed0640 1 --2- 172.21.15.50:0/1032261791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7240cdd50 0x7ff7240cee70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff7180098a0 tx=0x7ff71802a290 comp rx=0 tx=0).stop 2024-09-11T22:20:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.420+0000 7ff72bed0640 1 -- 172.21.15.50:0/1032261791 shutdown_connections 2024-09-11T22:20:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.420+0000 7ff72bed0640 1 --2- 172.21.15.50:0/1032261791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7240cdd50 0x7ff7240cee70 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.420+0000 7ff72bed0640 1 --2- 172.21.15.50:0/1032261791 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72415e840 0x7ff7240b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.420+0000 7ff72bed0640 1 -- 172.21.15.50:0/1032261791 >> 172.21.15.50:0/1032261791 conn(0x7ff7240b4150 msgr2=0x7ff7240b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.420+0000 7ff72bed0640 1 -- 172.21.15.50:0/1032261791 shutdown_connections 2024-09-11T22:20:49.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.420+0000 7ff72bed0640 1 -- 172.21.15.50:0/1032261791 wait complete. 2024-09-11T22:20:49.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.421+0000 7ff72bed0640 1 Processor -- start 2024-09-11T22:20:49.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.421+0000 7ff72bed0640 1 -- start start 2024-09-11T22:20:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.422+0000 7ff72bed0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7240cdd50 0x7ff7240cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.422+0000 7ff72bed0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7240cf3b0 0x7ff72414a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.422+0000 7ff72bed0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72415e840 0x7ff7240c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.422+0000 7ff72bed0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff72415ec20 con 0x7ff72415e840 2024-09-11T22:20:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.422+0000 7ff72bed0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff72406bed0 con 0x7ff7240cf3b0 2024-09-11T22:20:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.422+0000 7ff72bed0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff72415eda0 con 0x7ff7240cdd50 2024-09-11T22:20:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.422+0000 7ff72a46d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72415e840 0x7ff7240c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.422+0000 7ff72a46d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72415e840 0x7ff7240c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36808/0 (socket says 172.21.15.50:36808) 2024-09-11T22:20:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.422+0000 7ff72a46d640 1 -- 172.21.15.50:0/1860834332 learned_addr learned my addr 172.21.15.50:0/1860834332 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.422+0000 7ff72946b640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7240cf3b0 0x7ff72414a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.422+0000 7ff729c6c640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7240cdd50 0x7ff7240cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.423+0000 7ff72a46d640 1 -- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7240cdd50 msgr2=0x7ff7240cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.423+0000 7ff72a46d640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7240cdd50 0x7ff7240cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.423+0000 7ff72a46d640 1 -- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7240cf3b0 msgr2=0x7ff72414a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.423+0000 7ff72a46d640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7240cf3b0 0x7ff72414a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.423+0000 7ff72a46d640 1 -- 172.21.15.50:0/1860834332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72414ad10 con 0x7ff72415e840 2024-09-11T22:20:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.423+0000 7ff72946b640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7240cf3b0 0x7ff72414a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.423+0000 7ff729c6c640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7240cdd50 0x7ff7240cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.423+0000 7ff72a46d640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72415e840 0x7ff7240c98c0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00c430 tx=0x7ff71c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.423+0000 7ff7227fc640 1 -- 172.21.15.50:0/1860834332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0074e0 con 0x7ff72415e840 2024-09-11T22:20:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.423+0000 7ff7227fc640 1 -- 172.21.15.50:0/1860834332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff71c007680 con 0x7ff72415e840 2024-09-11T22:20:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.423+0000 7ff72bed0640 1 -- 172.21.15.50:0/1860834332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7240cc490 con 0x7ff72415e840 2024-09-11T22:20:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.423+0000 7ff7227fc640 1 -- 172.21.15.50:0/1860834332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0049e0 con 0x7ff72415e840 2024-09-11T22:20:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.423+0000 7ff72bed0640 1 -- 172.21.15.50:0/1860834332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff72414afb0 con 0x7ff72415e840 2024-09-11T22:20:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.424+0000 7ff72bed0640 1 -- 172.21.15.50:0/1860834332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7240cee70 con 0x7ff72415e840 2024-09-11T22:20:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.425+0000 7ff7227fc640 1 -- 172.21.15.50:0/1860834332 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff71c01a020 con 0x7ff72415e840 2024-09-11T22:20:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.425+0000 7ff7227fc640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff71006be30 0x7ff71006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.426+0000 7ff7227fc640 1 -- 172.21.15.50:0/1860834332 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7ff71c08a6a0 con 0x7ff72415e840 2024-09-11T22:20:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.426+0000 7ff729c6c640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff71006be30 0x7ff71006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.426+0000 7ff729c6c640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff71006be30 0x7ff71006e2f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff714007520 tx=0x7ff71400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.430+0000 7ff7227fc640 1 -- 172.21.15.50:0/1860834332 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff71c059050 con 0x7ff72415e840 2024-09-11T22:20:49.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.605+0000 7ff72bed0640 1 -- 172.21.15.50:0/1860834332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7240ce8b0 con 0x7ff72415e840 2024-09-11T22:20:49.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.606+0000 7ff7227fc640 1 -- 172.21.15.50:0/1860834332 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+16708 (secure 0 0 0) 0x7ff71c058950 con 0x7ff72415e840 2024-09-11T22:20:49.607 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:49.608 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":155,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:20:48.656002+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:47.229269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:47.624749+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:49.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.609+0000 7ff72bed0640 1 -- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff71006be30 msgr2=0x7ff71006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.609+0000 7ff72bed0640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff71006be30 0x7ff71006e2f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff714007520 tx=0x7ff71400b040 comp rx=0 tx=0).stop 2024-09-11T22:20:49.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.609+0000 7ff72bed0640 1 -- 172.21.15.50:0/1860834332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72415e840 msgr2=0x7ff7240c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.609+0000 7ff72bed0640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72415e840 0x7ff7240c98c0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00c430 tx=0x7ff71c00c8f0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.609+0000 7ff72bed0640 1 -- 172.21.15.50:0/1860834332 shutdown_connections 2024-09-11T22:20:49.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.609+0000 7ff72bed0640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff71006be30 0x7ff71006e2f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.609+0000 7ff72bed0640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72415e840 0x7ff7240c98c0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.609+0000 7ff72bed0640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7240cf3b0 0x7ff72414a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.609+0000 7ff72bed0640 1 --2- 172.21.15.50:0/1860834332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7240cdd50 0x7ff7240cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.609+0000 7ff72bed0640 1 -- 172.21.15.50:0/1860834332 >> 172.21.15.50:0/1860834332 conn(0x7ff7240b4150 msgr2=0x7ff7240afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.609+0000 7ff72bed0640 1 -- 172.21.15.50:0/1860834332 shutdown_connections 2024-09-11T22:20:49.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.609+0000 7ff72bed0640 1 -- 172.21.15.50:0/1860834332 wait complete. 2024-09-11T22:20:49.621 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:49.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.723+0000 7eff1f2b7640 1 Processor -- start 2024-09-11T22:20:49.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.723+0000 7eff1f2b7640 1 -- start start 2024-09-11T22:20:49.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1f2b7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff1815e840 0x7eff180b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1f2b7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff180cdd50 0x7eff180cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1f2b7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff180cf3b0 0x7eff180d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1f2b7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7eff1806c240 con 0x7eff180cdd50 2024-09-11T22:20:49.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1f2b7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7eff180d0470 con 0x7eff180cf3b0 2024-09-11T22:20:49.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1f2b7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7eff180ce5f0 con 0x7eff1815e840 2024-09-11T22:20:49.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1c852640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff180cdd50 0x7eff180cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1c852640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff180cdd50 0x7eff180cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36814/0 (socket says 172.21.15.50:36814) 2024-09-11T22:20:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1c852640 1 -- 172.21.15.50:0/3664163540 learned_addr learned my addr 172.21.15.50:0/3664163540 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1c852640 1 -- 172.21.15.50:0/3664163540 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff1815e840 msgr2=0x7eff180b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1d053640 1 --2- 172.21.15.50:0/3664163540 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff1815e840 0x7eff180b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1d854640 1 --2- 172.21.15.50:0/3664163540 >> v2:172.21.15.77:3300/0 conn(0x7eff180cf3b0 0x7eff180d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1c852640 1 --2- 172.21.15.50:0/3664163540 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff1815e840 0x7eff180b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1c852640 1 -- 172.21.15.50:0/3664163540 >> v2:172.21.15.77:3300/0 conn(0x7eff180cf3b0 msgr2=0x7eff180d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1c852640 1 --2- 172.21.15.50:0/3664163540 >> v2:172.21.15.77:3300/0 conn(0x7eff180cf3b0 0x7eff180d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1c852640 1 -- 172.21.15.50:0/3664163540 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff180ce310 con 0x7eff180cdd50 2024-09-11T22:20:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1d854640 1 --2- 172.21.15.50:0/3664163540 >> v2:172.21.15.77:3300/0 conn(0x7eff180cf3b0 0x7eff180d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:49.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.724+0000 7eff1d053640 1 --2- 172.21.15.50:0/3664163540 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff1815e840 0x7eff180b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:49.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.725+0000 7eff1c852640 1 --2- 172.21.15.50:0/3664163540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff180cdd50 0x7eff180cee70 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7eff08009870 tx=0x7eff0802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b450667ac3b156b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.725+0000 7eff0ffff640 1 -- 172.21.15.50:0/3664163540 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08037070 con 0x7eff180cdd50 2024-09-11T22:20:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.725+0000 7eff0ffff640 1 -- 172.21.15.50:0/3664163540 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff08032440 con 0x7eff180cdd50 2024-09-11T22:20:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.725+0000 7eff0ffff640 1 -- 172.21.15.50:0/3664163540 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08032810 con 0x7eff180cdd50 2024-09-11T22:20:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.726+0000 7eff1f2b7640 1 -- 172.21.15.50:0/3664163540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff180cdd50 msgr2=0x7eff180cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.726+0000 7eff1f2b7640 1 --2- 172.21.15.50:0/3664163540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff180cdd50 0x7eff180cee70 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7eff08009870 tx=0x7eff0802a210 comp rx=0 tx=0).stop 2024-09-11T22:20:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.726+0000 7eff1f2b7640 1 -- 172.21.15.50:0/3664163540 shutdown_connections 2024-09-11T22:20:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.726+0000 7eff1f2b7640 1 --2- 172.21.15.50:0/3664163540 >> v2:172.21.15.77:3300/0 conn(0x7eff180cf3b0 0x7eff180d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.726+0000 7eff1f2b7640 1 --2- 172.21.15.50:0/3664163540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff180cdd50 0x7eff180cee70 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.726+0000 7eff1f2b7640 1 --2- 172.21.15.50:0/3664163540 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff1815e840 0x7eff180b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.726+0000 7eff1f2b7640 1 -- 172.21.15.50:0/3664163540 >> 172.21.15.50:0/3664163540 conn(0x7eff180b4150 msgr2=0x7eff180b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.726+0000 7eff1f2b7640 1 -- 172.21.15.50:0/3664163540 shutdown_connections 2024-09-11T22:20:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.726+0000 7eff1f2b7640 1 -- 172.21.15.50:0/3664163540 wait complete. 2024-09-11T22:20:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.727+0000 7eff1f2b7640 1 Processor -- start 2024-09-11T22:20:49.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.727+0000 7eff1f2b7640 1 -- start start 2024-09-11T22:20:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1f2b7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff180cdd50 0x7eff18155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1f2b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff180cf3b0 0x7eff18157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1f2b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff1815e840 0x7eff18157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1f2b7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7eff1815ec20 con 0x7eff180cf3b0 2024-09-11T22:20:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1f2b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7eff1806bed0 con 0x7eff1815e840 2024-09-11T22:20:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1f2b7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7eff1815eda0 con 0x7eff180cdd50 2024-09-11T22:20:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1c852640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff180cf3b0 0x7eff18157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1c852640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff180cf3b0 0x7eff18157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36824/0 (socket says 172.21.15.50:36824) 2024-09-11T22:20:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1c852640 1 -- 172.21.15.50:0/1944192066 learned_addr learned my addr 172.21.15.50:0/1944192066 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1d053640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff180cdd50 0x7eff18155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1d854640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff1815e840 0x7eff18157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1c852640 1 -- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff180cdd50 msgr2=0x7eff18155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1c852640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff180cdd50 0x7eff18155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1c852640 1 -- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff1815e840 msgr2=0x7eff18157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1c852640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff1815e840 0x7eff18157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1c852640 1 -- 172.21.15.50:0/1944192066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff18158530 con 0x7eff180cf3b0 2024-09-11T22:20:49.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1c852640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff180cf3b0 0x7eff18157590 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7eff0802a250 tx=0x7eff080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff0dffb640 1 -- 172.21.15.50:0/1944192066 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08037040 con 0x7eff180cf3b0 2024-09-11T22:20:49.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff0dffb640 1 -- 172.21.15.50:0/1944192066 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff08042070 con 0x7eff180cf3b0 2024-09-11T22:20:49.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff0dffb640 1 -- 172.21.15.50:0/1944192066 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08030bd0 con 0x7eff180cf3b0 2024-09-11T22:20:49.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.728+0000 7eff1f2b7640 1 -- 172.21.15.50:0/1944192066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff18158810 con 0x7eff180cf3b0 2024-09-11T22:20:49.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.729+0000 7eff1f2b7640 1 -- 172.21.15.50:0/1944192066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff18155560 con 0x7eff180cf3b0 2024-09-11T22:20:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.730+0000 7eff1f2b7640 1 -- 172.21.15.50:0/1944192066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff180cee70 con 0x7eff180cf3b0 2024-09-11T22:20:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.730+0000 7eff0dffb640 1 -- 172.21.15.50:0/1944192066 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff08047460 con 0x7eff180cf3b0 2024-09-11T22:20:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.731+0000 7eff0dffb640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efefc06be30 0x7efefc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.731+0000 7eff0dffb640 1 -- 172.21.15.50:0/1944192066 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7eff080aba40 con 0x7eff180cf3b0 2024-09-11T22:20:49.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.731+0000 7eff1d053640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efefc06be30 0x7efefc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.731+0000 7eff1d053640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efefc06be30 0x7efefc06e2f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7eff1815e060 tx=0x7eff14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.735+0000 7eff0dffb640 1 -- 172.21.15.50:0/1944192066 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff08045360 con 0x7eff180cf3b0 2024-09-11T22:20:49.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.913+0000 7eff1f2b7640 1 -- 172.21.15.50:0/1944192066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff180d11c0 con 0x7eff180cf3b0 2024-09-11T22:20:49.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.914+0000 7eff0dffb640 1 -- 172.21.15.50:0/1944192066 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+16708 (secure 0 0 0) 0x7eff080abe20 con 0x7eff180cf3b0 2024-09-11T22:20:49.916 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:49.916 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":155,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:20:48.656002+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:47.229269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:47.624749+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:49.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.916+0000 7eff1f2b7640 1 -- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efefc06be30 msgr2=0x7efefc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.916+0000 7eff1f2b7640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efefc06be30 0x7efefc06e2f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7eff1815e060 tx=0x7eff14008040 comp rx=0 tx=0).stop 2024-09-11T22:20:49.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.916+0000 7eff1f2b7640 1 -- 172.21.15.50:0/1944192066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff180cf3b0 msgr2=0x7eff18157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.916+0000 7eff1f2b7640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff180cf3b0 0x7eff18157590 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7eff0802a250 tx=0x7eff080046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.916+0000 7eff1f2b7640 1 -- 172.21.15.50:0/1944192066 shutdown_connections 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.916+0000 7eff1f2b7640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7efefc06be30 0x7efefc06e2f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.916+0000 7eff1f2b7640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff1815e840 0x7eff18157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.916+0000 7eff1f2b7640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff180cf3b0 0x7eff18157590 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.916+0000 7eff1f2b7640 1 --2- 172.21.15.50:0/1944192066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff180cdd50 0x7eff18155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.916+0000 7eff1f2b7640 1 -- 172.21.15.50:0/1944192066 >> 172.21.15.50:0/1944192066 conn(0x7eff180b4150 msgr2=0x7eff180d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.916+0000 7eff1f2b7640 1 -- 172.21.15.50:0/1944192066 shutdown_connections 2024-09-11T22:20:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:49.916+0000 7eff1f2b7640 1 -- 172.21.15.50:0/1944192066 wait complete. 2024-09-11T22:20:49.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:20:50.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.034+0000 7f3dc13bd640 1 Processor -- start 2024-09-11T22:20:50.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.034+0000 7f3dc13bd640 1 -- start start 2024-09-11T22:20:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3dc13bd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3dbc15b400 0x7f3dbc06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3dc13bd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3dbc06e0f0 0x7f3dbc0711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3dc13bd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dbc15b7e0 con 0x7f3dbc072e60 2024-09-11T22:20:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3dc13bd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f3dbc15f140 con 0x7f3dbc15b400 2024-09-11T22:20:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3dc13bd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3dbc15f420 con 0x7f3dbc06e0f0 2024-09-11T22:20:50.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3dbaffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3dbc15b400 0x7f3dbc06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3dba7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3dbc072e60 0x7f3dbc06d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43774/0 (socket says 172.21.15.50:43774) 2024-09-11T22:20:50.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3dba7fc640 1 -- 172.21.15.50:0/2631261070 learned_addr learned my addr 172.21.15.50:0/2631261070 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:50.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3dbb7fe640 1 --2- 172.21.15.50:0/2631261070 >> v2:172.21.15.77:3300/0 conn(0x7f3dbc06e0f0 0x7f3dbc0711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3dbaffd640 1 -- 172.21.15.50:0/2631261070 >> v2:172.21.15.77:3300/0 conn(0x7f3dbc06e0f0 msgr2=0x7f3dbc0711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:50.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3dbaffd640 1 --2- 172.21.15.50:0/2631261070 >> v2:172.21.15.77:3300/0 conn(0x7f3dbc06e0f0 0x7f3dbc0711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3dbaffd640 1 -- 172.21.15.50:0/2631261070 >> v1:172.21.15.50:6789/0 conn(0x7f3dbc072e60 legacy=0x7f3dbc06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3dbaffd640 1 -- 172.21.15.50:0/2631261070 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc15f700 con 0x7f3dbc15b400 2024-09-11T22:20:50.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.035+0000 7f3db9ffb640 1 -- 172.21.15.50:0/2631261070 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321640785 0 0) 0x7f3dbc15b7e0 con 0x7f3dbc072e60 2024-09-11T22:20:50.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.036+0000 7f3dbaffd640 1 --2- 172.21.15.50:0/2631261070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dbc15b400 0x7f3dbc06d070 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0b3490 tx=0x7f3dac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f63a40fcfc3678a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.036+0000 7f3db9ffb640 1 -- 172.21.15.50:0/2631261070 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac037070 con 0x7f3dbc15b400 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.036+0000 7f3db9ffb640 1 -- 172.21.15.50:0/2631261070 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac032440 con 0x7f3dbc15b400 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.036+0000 7f3db9ffb640 1 -- 172.21.15.50:0/2631261070 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac032810 con 0x7f3dbc15b400 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.037+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2631261070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dbc15b400 msgr2=0x7f3dbc06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.037+0000 7f3dc13bd640 1 --2- 172.21.15.50:0/2631261070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dbc15b400 0x7f3dbc06d070 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0b3490 tx=0x7f3dac02a1a0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.037+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2631261070 shutdown_connections 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.037+0000 7f3dc13bd640 1 --2- 172.21.15.50:0/2631261070 >> v2:172.21.15.77:3300/0 conn(0x7f3dbc06e0f0 0x7f3dbc0711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.037+0000 7f3dc13bd640 1 --2- 172.21.15.50:0/2631261070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dbc15b400 0x7f3dbc06d070 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.037+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2631261070 >> 172.21.15.50:0/2631261070 conn(0x7f3dbc0679c0 msgr2=0x7f3dbc067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.037+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2631261070 shutdown_connections 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.037+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2631261070 wait complete. 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.038+0000 7f3dc13bd640 1 Processor -- start 2024-09-11T22:20:50.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.038+0000 7f3dc13bd640 1 -- start start 2024-09-11T22:20:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dc13bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dbc06e0f0 0x7f3dbc14cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dc13bd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dbc072e60 0x7f3dbc15e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dc13bd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dbc15b400 0x7f3dbc1f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dc13bd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc071700 con 0x7f3dbc072e60 2024-09-11T22:20:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dc13bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc0cfc50 con 0x7f3dbc06e0f0 2024-09-11T22:20:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dc13bd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc071880 con 0x7f3dbc15b400 2024-09-11T22:20:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dba7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dbc072e60 0x7f3dbc15e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dba7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dbc072e60 0x7f3dbc15e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36846/0 (socket says 172.21.15.50:36846) 2024-09-11T22:20:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dba7fc640 1 -- 172.21.15.50:0/2191602962 learned_addr learned my addr 172.21.15.50:0/2191602962 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dbaffd640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dbc06e0f0 0x7f3dbc14cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dbb7fe640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dbc15b400 0x7f3dbc1f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dba7fc640 1 -- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dbc15b400 msgr2=0x7f3dbc1f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dba7fc640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dbc15b400 0x7f3dbc1f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dba7fc640 1 -- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dbc06e0f0 msgr2=0x7f3dbc14cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dba7fc640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dbc06e0f0 0x7f3dbc14cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dba7fc640 1 -- 172.21.15.50:0/2191602962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc14d250 con 0x7f3dbc072e60 2024-09-11T22:20:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dbb7fe640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dbc15b400 0x7f3dbc1f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.039+0000 7f3dba7fc640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dbc072e60 0x7f3dbc15e530 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f3db000c4d0 tx=0x7f3db000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.040+0000 7f3da37fe640 1 -- 172.21.15.50:0/2191602962 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0018070 con 0x7f3dbc072e60 2024-09-11T22:20:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.040+0000 7f3da37fe640 1 -- 172.21.15.50:0/2191602962 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db0007500 con 0x7f3dbc072e60 2024-09-11T22:20:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.040+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2191602962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dbc1592c0 con 0x7f3dbc072e60 2024-09-11T22:20:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.040+0000 7f3da37fe640 1 -- 172.21.15.50:0/2191602962 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0004a20 con 0x7f3dbc072e60 2024-09-11T22:20:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.040+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2191602962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dbc159880 con 0x7f3dbc072e60 2024-09-11T22:20:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.041+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2191602962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dbc0711c0 con 0x7f3dbc072e60 2024-09-11T22:20:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.041+0000 7f3da37fe640 1 -- 172.21.15.50:0/2191602962 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3db001b070 con 0x7f3dbc072e60 2024-09-11T22:20:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.042+0000 7f3da37fe640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3da806be30 0x7f3da806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.042+0000 7f3da37fe640 1 -- 172.21.15.50:0/2191602962 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7f3db008a070 con 0x7f3dbc072e60 2024-09-11T22:20:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.042+0000 7f3dbaffd640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3da806be30 0x7f3da806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.042+0000 7f3dbaffd640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3da806be30 0x7f3da806e2f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3dac034000 tx=0x7f3dac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.046+0000 7f3da37fe640 1 -- 172.21.15.50:0/2191602962 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3db0058460 con 0x7f3dbc072e60 2024-09-11T22:20:50.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.262+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2191602962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3dbc0ce910 con 0x7f3dbc072e60 2024-09-11T22:20:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.290+0000 7f3da37fe640 1 -- 172.21.15.50:0/2191602962 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v108) ==== 118+0+0 (secure 0 0 0) 0x7f3db005c760 con 0x7f3dbc072e60 2024-09-11T22:20:50.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.293+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3da806be30 msgr2=0x7f3da806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.293+0000 7f3dc13bd640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3da806be30 0x7f3da806e2f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3dac034000 tx=0x7f3dac02e000 comp rx=0 tx=0).stop 2024-09-11T22:20:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.293+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2191602962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dbc072e60 msgr2=0x7f3dbc15e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.293+0000 7f3dc13bd640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dbc072e60 0x7f3dbc15e530 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f3db000c4d0 tx=0x7f3db000c990 comp rx=0 tx=0).stop 2024-09-11T22:20:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.293+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2191602962 shutdown_connections 2024-09-11T22:20:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.293+0000 7f3dc13bd640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3da806be30 0x7f3da806e2f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.293+0000 7f3dc13bd640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dbc15b400 0x7f3dbc1f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.293+0000 7f3dc13bd640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dbc072e60 0x7f3dbc15e530 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.293+0000 7f3dc13bd640 1 --2- 172.21.15.50:0/2191602962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dbc06e0f0 0x7f3dbc14cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.293+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2191602962 >> 172.21.15.50:0/2191602962 conn(0x7f3dbc0679c0 msgr2=0x7f3dbc0b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.293+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2191602962 shutdown_connections 2024-09-11T22:20:50.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.293+0000 7f3dc13bd640 1 -- 172.21.15.50:0/2191602962 wait complete. 2024-09-11T22:20:50.305 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:20:50.305 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:20:50.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.409+0000 7f15f03f8640 1 Processor -- start 2024-09-11T22:20:50.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.409+0000 7f15f03f8640 1 -- start start 2024-09-11T22:20:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.410+0000 7f15f03f8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f15e80d1c90 0x7f15e80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.410+0000 7f15f03f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15e8162350 0x7f15e81627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.410+0000 7f15f03f8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15e8163080 con 0x7f15e815e8e0 2024-09-11T22:20:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.410+0000 7f15f03f8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f15e815ecc0 con 0x7f15e80d1c90 2024-09-11T22:20:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.410+0000 7f15f03f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f15e80d2ad0 con 0x7f15e8162350 2024-09-11T22:20:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.410+0000 7f15ee995640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15e8162350 0x7f15e81627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.410+0000 7f15ed993640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f15e80d1c90 0x7f15e80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.410+0000 7f15ee995640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15e8162350 0x7f15e81627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:53054/0 (socket says 172.21.15.50:53054) 2024-09-11T22:20:50.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.410+0000 7f15ee995640 1 -- 172.21.15.50:0/843707834 learned_addr learned my addr 172.21.15.50:0/843707834 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.411+0000 7f15ed192640 1 -- 172.21.15.50:0/843707834 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166362416 0 0) 0x7f15e8163080 con 0x7f15e815e8e0 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.411+0000 7f15ed192640 1 -- 172.21.15.50:0/843707834 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15d4003520 con 0x7f15e815e8e0 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.411+0000 7f15ee995640 1 -- 172.21.15.50:0/843707834 >> v2:172.21.15.77:3300/0 conn(0x7f15e80d1c90 msgr2=0x7f15e80b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.411+0000 7f15ee995640 1 --2- 172.21.15.50:0/843707834 >> v2:172.21.15.77:3300/0 conn(0x7f15e80d1c90 0x7f15e80b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.411+0000 7f15ee995640 1 -- 172.21.15.50:0/843707834 >> v1:172.21.15.77:6789/0 conn(0x7f15e815e8e0 legacy=0x7f15e80d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.411+0000 7f15ee995640 1 -- 172.21.15.50:0/843707834 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e80d2d20 con 0x7f15e8162350 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.411+0000 7f15ed993640 1 --2- 172.21.15.50:0/843707834 >> v2:172.21.15.77:3300/0 conn(0x7f15e80d1c90 0x7f15e80b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.411+0000 7f15ee995640 1 --2- 172.21.15.50:0/843707834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15e8162350 0x7f15e81627e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009e50 tx=0x7f15e002a7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c36f00d64b8718d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.412+0000 7f15ed192640 1 -- 172.21.15.50:0/843707834 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0036070 con 0x7f15e8162350 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.412+0000 7f15ed192640 1 -- 172.21.15.50:0/843707834 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e0031600 con 0x7f15e8162350 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.412+0000 7f15ed192640 1 -- 172.21.15.50:0/843707834 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e00319f0 con 0x7f15e8162350 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.412+0000 7f15f03f8640 1 -- 172.21.15.50:0/843707834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15e8162350 msgr2=0x7f15e81627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.412+0000 7f15f03f8640 1 --2- 172.21.15.50:0/843707834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15e8162350 0x7f15e81627e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009e50 tx=0x7f15e002a7c0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.412+0000 7f15f03f8640 1 -- 172.21.15.50:0/843707834 shutdown_connections 2024-09-11T22:20:50.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.412+0000 7f15f03f8640 1 --2- 172.21.15.50:0/843707834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15e8162350 0x7f15e81627e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.412+0000 7f15f03f8640 1 --2- 172.21.15.50:0/843707834 >> v2:172.21.15.77:3300/0 conn(0x7f15e80d1c90 0x7f15e80b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.412+0000 7f15f03f8640 1 -- 172.21.15.50:0/843707834 >> 172.21.15.50:0/843707834 conn(0x7f15e8067ba0 msgr2=0x7f15e8067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.412+0000 7f15f03f8640 1 -- 172.21.15.50:0/843707834 shutdown_connections 2024-09-11T22:20:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.412+0000 7f15f03f8640 1 -- 172.21.15.50:0/843707834 wait complete. 2024-09-11T22:20:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.413+0000 7f15f03f8640 1 Processor -- start 2024-09-11T22:20:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.413+0000 7f15f03f8640 1 -- start start 2024-09-11T22:20:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.414+0000 7f15f03f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15e80d1c90 0x7f15e814fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.414+0000 7f15f03f8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15e815e8e0 0x7f15e80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.414+0000 7f15f03f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e8162350 0x7f15e815f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.414+0000 7f15f03f8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f15e8162d20 con 0x7f15e815e8e0 2024-09-11T22:20:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.414+0000 7f15f03f8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f15e80d3370 con 0x7f15e8162350 2024-09-11T22:20:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.414+0000 7f15f03f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f15e80d3800 con 0x7f15e80d1c90 2024-09-11T22:20:50.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.414+0000 7f15ed993640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15e815e8e0 0x7f15e80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.414+0000 7f15ed993640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15e815e8e0 0x7f15e80b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36858/0 (socket says 172.21.15.50:36858) 2024-09-11T22:20:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.414+0000 7f15ed993640 1 -- 172.21.15.50:0/412296219 learned_addr learned my addr 172.21.15.50:0/412296219 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.414+0000 7f15ee194640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15e80d1c90 0x7f15e814fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.414+0000 7f15ee995640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e8162350 0x7f15e815f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.415+0000 7f15ed993640 1 -- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15e80d1c90 msgr2=0x7f15e814fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.415+0000 7f15ed993640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15e80d1c90 0x7f15e814fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.415+0000 7f15ed993640 1 -- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e8162350 msgr2=0x7f15e815f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.415+0000 7f15ed993640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e8162350 0x7f15e815f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.415+0000 7f15ed993640 1 -- 172.21.15.50:0/412296219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e80cbca0 con 0x7f15e815e8e0 2024-09-11T22:20:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.415+0000 7f15ed993640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15e815e8e0 0x7f15e80b6960 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f15d800ebe0 tx=0x7f15d800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.415+0000 7f15deffd640 1 -- 172.21.15.50:0/412296219 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8017070 con 0x7f15e815e8e0 2024-09-11T22:20:50.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.415+0000 7f15deffd640 1 -- 172.21.15.50:0/412296219 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d800cc30 con 0x7f15e815e8e0 2024-09-11T22:20:50.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.415+0000 7f15f03f8640 1 -- 172.21.15.50:0/412296219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e80cbf80 con 0x7f15e815e8e0 2024-09-11T22:20:50.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.415+0000 7f15deffd640 1 -- 172.21.15.50:0/412296219 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8013470 con 0x7f15e815e8e0 2024-09-11T22:20:50.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.415+0000 7f15f03f8640 1 -- 172.21.15.50:0/412296219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e80cc540 con 0x7f15e815e8e0 2024-09-11T22:20:50.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.416+0000 7f15f03f8640 1 -- 172.21.15.50:0/412296219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e80b7880 con 0x7f15e815e8e0 2024-09-11T22:20:50.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.417+0000 7f15deffd640 1 -- 172.21.15.50:0/412296219 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15d801a070 con 0x7f15e815e8e0 2024-09-11T22:20:50.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.417+0000 7f15deffd640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f15cc06be30 0x7f15cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.417+0000 7f15deffd640 1 -- 172.21.15.50:0/412296219 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f15d808b0d0 con 0x7f15e815e8e0 2024-09-11T22:20:50.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.417+0000 7f15ee194640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f15cc06be30 0x7f15cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.418+0000 7f15ee194640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f15cc06be30 0x7f15cc06e2f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f15e4007fd0 tx=0x7f15e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.422+0000 7f15deffd640 1 -- 172.21.15.50:0/412296219 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15d8059430 con 0x7f15e815e8e0 2024-09-11T22:20:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:50.636+0000 7f15f03f8640 1 -- 172.21.15.50:0/412296219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f15e80d25f0 con 0x7f15e815e8e0 2024-09-11T22:20:51.180 INFO:tasks.ceph.mds.a.smithi050.stderr:2024-09-11T22:20:51.179+0000 7fc1b0249640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:20:51.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.290+0000 7f15deffd640 1 -- 172.21.15.50:0/412296219 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v109) ==== 122+0+0 (secure 0 0 0) 0x7f15d805d730 con 0x7f15e815e8e0 2024-09-11T22:20:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.293+0000 7f15f03f8640 1 -- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f15cc06be30 msgr2=0x7f15cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.293+0000 7f15f03f8640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f15cc06be30 0x7f15cc06e2f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f15e4007fd0 tx=0x7f15e4009040 comp rx=0 tx=0).stop 2024-09-11T22:20:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.293+0000 7f15f03f8640 1 -- 172.21.15.50:0/412296219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15e815e8e0 msgr2=0x7f15e80b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.293+0000 7f15f03f8640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15e815e8e0 0x7f15e80b6960 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f15d800ebe0 tx=0x7f15d800c520 comp rx=0 tx=0).stop 2024-09-11T22:20:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.293+0000 7f15f03f8640 1 -- 172.21.15.50:0/412296219 shutdown_connections 2024-09-11T22:20:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.293+0000 7f15f03f8640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f15cc06be30 0x7f15cc06e2f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.293+0000 7f15f03f8640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e8162350 0x7f15e815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.293+0000 7f15f03f8640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15e815e8e0 0x7f15e80b6960 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.293+0000 7f15f03f8640 1 --2- 172.21.15.50:0/412296219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15e80d1c90 0x7f15e814fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.293+0000 7f15f03f8640 1 -- 172.21.15.50:0/412296219 >> 172.21.15.50:0/412296219 conn(0x7f15e8067ba0 msgr2=0x7f15e8161550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.294+0000 7f15f03f8640 1 -- 172.21.15.50:0/412296219 shutdown_connections 2024-09-11T22:20:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.294+0000 7f15f03f8640 1 -- 172.21.15.50:0/412296219 wait complete. 2024-09-11T22:20:51.308 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:20:51.309 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:51.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.414+0000 7f07a0b26640 1 Processor -- start 2024-09-11T22:20:51.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.414+0000 7f07a0b26640 1 -- start start 2024-09-11T22:20:51.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.415+0000 7f07a0b26640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f079c0cf610 0x7f079c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.415+0000 7f07a0b26640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f079c0cfbd0 con 0x7f079c0b1600 2024-09-11T22:20:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.415+0000 7f07a0b26640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f079c0cfeb0 con 0x7f079c161fa0 2024-09-11T22:20:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.415+0000 7f07a0b26640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f079c0d1220 con 0x7f079c0cf610 2024-09-11T22:20:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079ad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f079c0b1600 0x7f079c0cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43778/0 (socket says 172.21.15.50:43778) 2024-09-11T22:20:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079ad9d640 1 -- 172.21.15.50:0/2617733007 learned_addr learned my addr 172.21.15.50:0/2617733007 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f0799d9b640 1 --2- 172.21.15.50:0/2617733007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f079c0cf610 0x7f079c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1758966032 0 0) 0x7f079c0cfbd0 con 0x7f079c0b1600 2024-09-11T22:20:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0784003520 con 0x7f079c0b1600 2024-09-11T22:20:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1224088265 0 0) 0x7f0784003520 con 0x7f079c0b1600 2024-09-11T22:20:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f079c0cf610 msgr2=0x7f079c0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 --2- 172.21.15.50:0/2617733007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f079c0cf610 0x7f079c0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 >> v1:172.21.15.77:6789/0 conn(0x7f079c161fa0 legacy=0x7f079c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079c0d1470 con 0x7f079c0b1600 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f07940019f0 con 0x7f079c0b1600 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 >> v1:172.21.15.50:6789/0 conn(0x7f079c0b1600 legacy=0x7f079c0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 --2- 172.21.15.50:0/2617733007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07840039e0 0x7f0784003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 --2- 172.21.15.50:0/2617733007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f079c0cf610 0x7f0784004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 --2- 172.21.15.50:0/2617733007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0784004d40 0x7f07840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f079c0d1220 con 0x7f07840039e0 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f078400ba70 con 0x7f0784004d40 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f078400bc20 con 0x7f079c0cf610 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079a59c640 1 --2- 172.21.15.50:0/2617733007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07840039e0 0x7f0784003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f0799d9b640 1 --2- 172.21.15.50:0/2617733007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f079c0cf610 0x7f0784004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.416+0000 7f079ad9d640 1 --2- 172.21.15.50:0/2617733007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0784004d40 0x7f07840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.417+0000 7f079a59c640 1 -- 172.21.15.50:0/2617733007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f079c0cf610 msgr2=0x7f0784004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.417+0000 7f079a59c640 1 --2- 172.21.15.50:0/2617733007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f079c0cf610 0x7f0784004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.417+0000 7f079a59c640 1 -- 172.21.15.50:0/2617733007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0784004d40 msgr2=0x7f07840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.417+0000 7f079a59c640 1 --2- 172.21.15.50:0/2617733007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0784004d40 0x7f07840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.417+0000 7f079a59c640 1 -- 172.21.15.50:0/2617733007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0784003520 con 0x7f07840039e0 2024-09-11T22:20:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.417+0000 7f079a59c640 1 --2- 172.21.15.50:0/2617733007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07840039e0 0x7f0784003dc0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f078c001860 tx=0x7f0784005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4e153fad73ad47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.418+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c037070 con 0x7f07840039e0 2024-09-11T22:20:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.418+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078c02ac30 con 0x7f07840039e0 2024-09-11T22:20:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.418+0000 7f079959a640 1 -- 172.21.15.50:0/2617733007 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c001430 con 0x7f07840039e0 2024-09-11T22:20:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.418+0000 7f07a0b26640 1 -- 172.21.15.50:0/2617733007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07840039e0 msgr2=0x7f0784003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.418+0000 7f07a0b26640 1 --2- 172.21.15.50:0/2617733007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07840039e0 0x7f0784003dc0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f078c001860 tx=0x7f0784005830 comp rx=0 tx=0).stop 2024-09-11T22:20:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.418+0000 7f079ad9d640 1 -- 172.21.15.50:0/2617733007 reap_dead start 2024-09-11T22:20:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.418+0000 7f07a0b26640 1 -- 172.21.15.50:0/2617733007 shutdown_connections 2024-09-11T22:20:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.418+0000 7f07a0b26640 1 -- 172.21.15.50:0/2617733007 >> 172.21.15.50:0/2617733007 conn(0x7f079c09ba50 msgr2=0x7f079c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.418+0000 7f07a0b26640 1 -- 172.21.15.50:0/2617733007 shutdown_connections 2024-09-11T22:20:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.418+0000 7f07a0b26640 1 -- 172.21.15.50:0/2617733007 wait complete. 2024-09-11T22:20:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.420+0000 7f07a0b26640 1 Processor -- start 2024-09-11T22:20:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.420+0000 7f07a0b26640 1 -- start start 2024-09-11T22:20:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.420+0000 7f07a0b26640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07840039e0 0x7f079c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.420+0000 7f07a0b26640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f079c0b3b40 0x7f079c0ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.420+0000 7f07a0b26640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f079c160740 0x7f079c0caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f07a0b26640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f079c0d1c70 con 0x7f07840039e0 2024-09-11T22:20:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f07a0b26640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f079c0d17e0 con 0x7f079c160740 2024-09-11T22:20:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f07a0b26640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f079c0d1df0 con 0x7f079c0b3b40 2024-09-11T22:20:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f079a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07840039e0 0x7f079c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f079a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07840039e0 0x7f079c15bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36866/0 (socket says 172.21.15.50:36866) 2024-09-11T22:20:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f079a59c640 1 -- 172.21.15.50:0/765591152 learned_addr learned my addr 172.21.15.50:0/765591152 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f0799d9b640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f079c0b3b40 0x7f079c0ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f079ad9d640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f079c160740 0x7f079c0caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f079a59c640 1 -- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f079c0b3b40 msgr2=0x7f079c0ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f079a59c640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f079c0b3b40 0x7f079c0ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f079a59c640 1 -- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f079c160740 msgr2=0x7f079c0caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f079a59c640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f079c160740 0x7f079c0caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f079a59c640 1 -- 172.21.15.50:0/765591152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079c0b4090 con 0x7f07840039e0 2024-09-11T22:20:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f079ad9d640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f079c160740 0x7f079c0caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f079a59c640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07840039e0 0x7f079c15bc40 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f078c001950 tx=0x7f078c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f078affd640 1 -- 172.21.15.50:0/765591152 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c040020 con 0x7f07840039e0 2024-09-11T22:20:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f078affd640 1 -- 172.21.15.50:0/765591152 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078c005270 con 0x7f07840039e0 2024-09-11T22:20:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f07a0b26640 1 -- 172.21.15.50:0/765591152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f079c15fc60 con 0x7f07840039e0 2024-09-11T22:20:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f078affd640 1 -- 172.21.15.50:0/765591152 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c037040 con 0x7f07840039e0 2024-09-11T22:20:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.421+0000 7f07a0b26640 1 -- 172.21.15.50:0/765591152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f079c160220 con 0x7f07840039e0 2024-09-11T22:20:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.423+0000 7f07a0b26640 1 -- 172.21.15.50:0/765591152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f079c15fa80 con 0x7f07840039e0 2024-09-11T22:20:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.423+0000 7f078affd640 1 -- 172.21.15.50:0/765591152 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f078c043020 con 0x7f07840039e0 2024-09-11T22:20:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.423+0000 7f078affd640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f077c06be60 0x7f077c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.424+0000 7f078affd640 1 -- 172.21.15.50:0/765591152 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f078c0aada0 con 0x7f07840039e0 2024-09-11T22:20:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.424+0000 7f0799d9b640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f077c06be60 0x7f077c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.424+0000 7f0799d9b640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f077c06be60 0x7f077c06e320 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f079c0b0770 tx=0x7f0790009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.428+0000 7f078affd640 1 -- 172.21.15.50:0/765591152 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f079c15fa80 con 0x7f07840039e0 2024-09-11T22:20:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.638+0000 7f07a0b26640 1 -- 172.21.15.50:0/765591152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f079c0b4d20 con 0x7f07840039e0 2024-09-11T22:20:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.639+0000 7f078affd640 1 -- 172.21.15.50:0/765591152 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5233 (secure 0 0 0) 0x7f078c04a030 con 0x7f07840039e0 2024-09-11T22:20:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:51.641 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:20:50.638363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9426":{"gid":9426,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3562809701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3562809701},{"type":"v1","addr":"172.21.15.50:6835","nonce":3562809701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9426,"qdb_cluster":[9426]},"id":11}]} 2024-09-11T22:20:51.641 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 109 2024-09-11T22:20:51.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.641+0000 7f07a0b26640 1 -- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f077c06be60 msgr2=0x7f077c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.641+0000 7f07a0b26640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f077c06be60 0x7f077c06e320 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f079c0b0770 tx=0x7f0790009190 comp rx=0 tx=0).stop 2024-09-11T22:20:51.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.641+0000 7f07a0b26640 1 -- 172.21.15.50:0/765591152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07840039e0 msgr2=0x7f079c15bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.641+0000 7f07a0b26640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07840039e0 0x7f079c15bc40 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f078c001950 tx=0x7f078c001230 comp rx=0 tx=0).stop 2024-09-11T22:20:51.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.641+0000 7f07a0b26640 1 -- 172.21.15.50:0/765591152 shutdown_connections 2024-09-11T22:20:51.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.641+0000 7f07a0b26640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f077c06be60 0x7f077c06e320 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.641+0000 7f07a0b26640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f079c0b3b40 0x7f079c0ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.641+0000 7f07a0b26640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f079c160740 0x7f079c0caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.641+0000 7f07a0b26640 1 --2- 172.21.15.50:0/765591152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07840039e0 0x7f079c15bc40 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.641+0000 7f07a0b26640 1 -- 172.21.15.50:0/765591152 >> 172.21.15.50:0/765591152 conn(0x7f079c09ba50 msgr2=0x7f079c0af650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.641+0000 7f07a0b26640 1 -- 172.21.15.50:0/765591152 shutdown_connections 2024-09-11T22:20:51.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.641+0000 7f07a0b26640 1 -- 172.21.15.50:0/765591152 wait complete. 2024-09-11T22:20:51.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:51.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.755+0000 7f9b96277640 1 Processor -- start 2024-09-11T22:20:51.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.755+0000 7f9b96277640 1 -- start start 2024-09-11T22:20:51.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.755+0000 7f9b96277640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9b900d18a0 0x7f9b900d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.755+0000 7f9b96277640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b900d3a30 0x7f9b900b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.755+0000 7f9b96277640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b900cfa80 con 0x7f9b9015e870 2024-09-11T22:20:51.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.755+0000 7f9b96277640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9b900d3ea0 con 0x7f9b900d3a30 2024-09-11T22:20:51.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.755+0000 7f9b96277640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9b900d40d0 con 0x7f9b900d18a0 2024-09-11T22:20:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.756+0000 7f9b94814640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b900d3a30 0x7f9b900b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.756+0000 7f9b94814640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b900d3a30 0x7f9b900b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36876/0 (socket says 172.21.15.50:36876) 2024-09-11T22:20:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.756+0000 7f9b94814640 1 -- 172.21.15.50:0/2806473665 learned_addr learned my addr 172.21.15.50:0/2806473665 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.756+0000 7f9b87fff640 1 --2- 172.21.15.50:0/2806473665 >> v2:172.21.15.77:3300/0 conn(0x7f9b900d18a0 0x7f9b900d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.756+0000 7f9b94814640 1 -- 172.21.15.50:0/2806473665 >> v2:172.21.15.77:3300/0 conn(0x7f9b900d18a0 msgr2=0x7f9b900d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.756+0000 7f9b94814640 1 --2- 172.21.15.50:0/2806473665 >> v2:172.21.15.77:3300/0 conn(0x7f9b900d18a0 0x7f9b900d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.756+0000 7f9b94814640 1 -- 172.21.15.50:0/2806473665 >> v1:172.21.15.77:6789/0 conn(0x7f9b9015e870 legacy=0x7f9b900d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.756+0000 7f9b94814640 1 -- 172.21.15.50:0/2806473665 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b900d43b0 con 0x7f9b900d3a30 2024-09-11T22:20:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.757+0000 7f9b94814640 1 --2- 172.21.15.50:0/2806473665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b900d3a30 0x7f9b900b8400 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f9b9006c860 tx=0x7f9b8802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42da8e602a0992ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.757+0000 7f9b8f7fe640 1 -- 172.21.15.50:0/2806473665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88036070 con 0x7f9b900d3a30 2024-09-11T22:20:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.757+0000 7f9b8f7fe640 1 -- 172.21.15.50:0/2806473665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b88031600 con 0x7f9b900d3a30 2024-09-11T22:20:51.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.757+0000 7f9b8f7fe640 1 -- 172.21.15.50:0/2806473665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b880319d0 con 0x7f9b900d3a30 2024-09-11T22:20:51.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.757+0000 7f9b96277640 1 -- 172.21.15.50:0/2806473665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b900d3a30 msgr2=0x7f9b900b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.757+0000 7f9b96277640 1 --2- 172.21.15.50:0/2806473665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b900d3a30 0x7f9b900b8400 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f9b9006c860 tx=0x7f9b8802a6f0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.757+0000 7f9b96277640 1 -- 172.21.15.50:0/2806473665 shutdown_connections 2024-09-11T22:20:51.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.757+0000 7f9b96277640 1 --2- 172.21.15.50:0/2806473665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b900d3a30 0x7f9b900b8400 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.757+0000 7f9b96277640 1 --2- 172.21.15.50:0/2806473665 >> v2:172.21.15.77:3300/0 conn(0x7f9b900d18a0 0x7f9b900d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.757+0000 7f9b96277640 1 -- 172.21.15.50:0/2806473665 >> 172.21.15.50:0/2806473665 conn(0x7f9b900727a0 msgr2=0x7f9b900679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.758+0000 7f9b96277640 1 -- 172.21.15.50:0/2806473665 shutdown_connections 2024-09-11T22:20:51.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.758+0000 7f9b96277640 1 -- 172.21.15.50:0/2806473665 wait complete. 2024-09-11T22:20:51.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.759+0000 7f9b96277640 1 Processor -- start 2024-09-11T22:20:51.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.759+0000 7f9b96277640 1 -- start start 2024-09-11T22:20:51.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.759+0000 7f9b96277640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b900d18a0 0x7f9b90155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b96277640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b900d3a30 0x7f9b90155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b96277640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9015e870 0x7f9b901588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b96277640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9015ec50 con 0x7f9b900d3a30 2024-09-11T22:20:51.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b96277640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9b900b7ee0 con 0x7f9b900d18a0 2024-09-11T22:20:51.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b96277640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9b900b78b0 con 0x7f9b9015e870 2024-09-11T22:20:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b900d3a30 0x7f9b90155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b87fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b900d3a30 0x7f9b90155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36886/0 (socket says 172.21.15.50:36886) 2024-09-11T22:20:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b87fff640 1 -- 172.21.15.50:0/1208050180 learned_addr learned my addr 172.21.15.50:0/1208050180 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b94814640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9015e870 0x7f9b901588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b8ffff640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b900d18a0 0x7f9b90155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b87fff640 1 -- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9015e870 msgr2=0x7f9b901588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b87fff640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9015e870 0x7f9b901588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b87fff640 1 -- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b900d18a0 msgr2=0x7f9b90155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b87fff640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b900d18a0 0x7f9b90155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b87fff640 1 -- 172.21.15.50:0/1208050180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b901571d0 con 0x7f9b900d3a30 2024-09-11T22:20:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b8ffff640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b900d18a0 0x7f9b90155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b87fff640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b900d3a30 0x7f9b90155390 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800d620 tx=0x7f9b7800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b8d7fa640 1 -- 172.21.15.50:0/1208050180 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800b620 con 0x7f9b900d3a30 2024-09-11T22:20:51.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b8d7fa640 1 -- 172.21.15.50:0/1208050180 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b78019070 con 0x7f9b900d3a30 2024-09-11T22:20:51.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b96277640 1 -- 172.21.15.50:0/1208050180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b90160790 con 0x7f9b900d3a30 2024-09-11T22:20:51.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b8d7fa640 1 -- 172.21.15.50:0/1208050180 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800ba00 con 0x7f9b900d3a30 2024-09-11T22:20:51.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.760+0000 7f9b96277640 1 -- 172.21.15.50:0/1208050180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b90155be0 con 0x7f9b900d3a30 2024-09-11T22:20:51.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.761+0000 7f9b96277640 1 -- 172.21.15.50:0/1208050180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b900d34f0 con 0x7f9b900d3a30 2024-09-11T22:20:51.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.762+0000 7f9b8d7fa640 1 -- 172.21.15.50:0/1208050180 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b7800bba0 con 0x7f9b900d3a30 2024-09-11T22:20:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.762+0000 7f9b8d7fa640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b7006be30 0x7f9b7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.762+0000 7f9b8d7fa640 1 -- 172.21.15.50:0/1208050180 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f9b7808b1e0 con 0x7f9b900d3a30 2024-09-11T22:20:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.762+0000 7f9b8ffff640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b7006be30 0x7f9b7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.763+0000 7f9b8ffff640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b7006be30 0x7f9b7006e2f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9b80003eb0 tx=0x7f9b80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.766+0000 7f9b8d7fa640 1 -- 172.21.15.50:0/1208050180 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b78059c20 con 0x7f9b900d3a30 2024-09-11T22:20:51.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.943+0000 7f9b96277640 1 -- 172.21.15.50:0/1208050180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b90161dc0 con 0x7f9b900d3a30 2024-09-11T22:20:51.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.944+0000 7f9b8d7fa640 1 -- 172.21.15.50:0/1208050180 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) ==== 74+0+16695 (secure 0 0 0) 0x7f9b78059520 con 0x7f9b900d3a30 2024-09-11T22:20:51.946 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:51.946 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":156,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:20:50.238621+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:47.229269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:47.624749+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:51.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.946+0000 7f9b96277640 1 -- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b7006be30 msgr2=0x7f9b7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.946+0000 7f9b96277640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b7006be30 0x7f9b7006e2f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9b80003eb0 tx=0x7f9b80009040 comp rx=0 tx=0).stop 2024-09-11T22:20:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.946+0000 7f9b96277640 1 -- 172.21.15.50:0/1208050180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b900d3a30 msgr2=0x7f9b90155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.946+0000 7f9b96277640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b900d3a30 0x7f9b90155390 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800d620 tx=0x7f9b7800dae0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.946+0000 7f9b96277640 1 -- 172.21.15.50:0/1208050180 shutdown_connections 2024-09-11T22:20:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.946+0000 7f9b96277640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b7006be30 0x7f9b7006e2f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.946+0000 7f9b96277640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9015e870 0x7f9b901588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.946+0000 7f9b96277640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b900d3a30 0x7f9b90155390 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.946+0000 7f9b96277640 1 --2- 172.21.15.50:0/1208050180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b900d18a0 0x7f9b90155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.946+0000 7f9b96277640 1 -- 172.21.15.50:0/1208050180 >> 172.21.15.50:0/1208050180 conn(0x7f9b900727a0 msgr2=0x7f9b900b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.946+0000 7f9b96277640 1 -- 172.21.15.50:0/1208050180 shutdown_connections 2024-09-11T22:20:51.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:51.946+0000 7f9b96277640 1 -- 172.21.15.50:0/1208050180 wait complete. 2024-09-11T22:20:51.960 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:20:51.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:20:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.061+0000 7f26a6703640 1 Processor -- start 2024-09-11T22:20:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.061+0000 7f26a6703640 1 -- start start 2024-09-11T22:20:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.061+0000 7f26a6703640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f26a015e870 0x7f26a00d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.061+0000 7f26a6703640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26a00d16d0 0x7f26a00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.061+0000 7f26a6703640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26a00cfa80 con 0x7f26a00d3a30 2024-09-11T22:20:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.061+0000 7f26a6703640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f26a00d1b40 con 0x7f26a00d16d0 2024-09-11T22:20:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.061+0000 7f26a6703640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f26a00d3e50 con 0x7f26a015e870 2024-09-11T22:20:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.062+0000 7f269f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26a00d16d0 0x7f26a00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.062+0000 7f26a4ca0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f26a00d3a30 0x7f26a00b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43780/0 (socket says 172.21.15.50:43780) 2024-09-11T22:20:52.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.062+0000 7f269f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26a00d16d0 0x7f26a00d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36896/0 (socket says 172.21.15.50:36896) 2024-09-11T22:20:52.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.062+0000 7f26a4ca0640 1 -- 172.21.15.50:0/2512238472 learned_addr learned my addr 172.21.15.50:0/2512238472 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:52.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.062+0000 7f269ffff640 1 --2- 172.21.15.50:0/2512238472 >> v2:172.21.15.77:3300/0 conn(0x7f26a015e870 0x7f26a00d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.062+0000 7f269f7fe640 1 -- 172.21.15.50:0/2512238472 >> v2:172.21.15.77:3300/0 conn(0x7f26a015e870 msgr2=0x7f26a00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:52.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.062+0000 7f269f7fe640 1 --2- 172.21.15.50:0/2512238472 >> v2:172.21.15.77:3300/0 conn(0x7f26a015e870 0x7f26a00d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.062+0000 7f269f7fe640 1 -- 172.21.15.50:0/2512238472 >> v1:172.21.15.50:6789/0 conn(0x7f26a00d3a30 legacy=0x7f26a00b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.062+0000 7f269f7fe640 1 -- 172.21.15.50:0/2512238472 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a00d40d0 con 0x7f26a00d16d0 2024-09-11T22:20:52.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.063+0000 7f269f7fe640 1 --2- 172.21.15.50:0/2512238472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a00d16d0 0x7f26a00d34f0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f26a00d57c0 tx=0x7f269402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d2230374a9a718 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.063+0000 7f269effd640 1 -- 172.21.15.50:0/2512238472 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694037070 con 0x7f26a00d16d0 2024-09-11T22:20:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.063+0000 7f269effd640 1 -- 172.21.15.50:0/2512238472 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2694032440 con 0x7f26a00d16d0 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.063+0000 7f269effd640 1 -- 172.21.15.50:0/2512238472 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694032810 con 0x7f26a00d16d0 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.063+0000 7f26a6703640 1 -- 172.21.15.50:0/2512238472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a00d16d0 msgr2=0x7f26a00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.063+0000 7f26a6703640 1 --2- 172.21.15.50:0/2512238472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a00d16d0 0x7f26a00d34f0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f26a00d57c0 tx=0x7f269402a1a0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.063+0000 7f26a6703640 1 -- 172.21.15.50:0/2512238472 shutdown_connections 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.063+0000 7f26a6703640 1 --2- 172.21.15.50:0/2512238472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a00d16d0 0x7f26a00d34f0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.063+0000 7f26a6703640 1 --2- 172.21.15.50:0/2512238472 >> v2:172.21.15.77:3300/0 conn(0x7f26a015e870 0x7f26a00d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.063+0000 7f26a6703640 1 -- 172.21.15.50:0/2512238472 >> 172.21.15.50:0/2512238472 conn(0x7f26a00727a0 msgr2=0x7f26a00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.063+0000 7f26a6703640 1 -- 172.21.15.50:0/2512238472 shutdown_connections 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.063+0000 7f26a6703640 1 -- 172.21.15.50:0/2512238472 wait complete. 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.065+0000 7f26a6703640 1 Processor -- start 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.065+0000 7f26a6703640 1 -- start start 2024-09-11T22:20:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.065+0000 7f26a6703640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26a00d16d0 0x7f26a014db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.065+0000 7f26a6703640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a00d3a30 0x7f26a00c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a6703640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a015e870 0x7f26a00b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a6703640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26a00b7ee0 con 0x7f26a015e870 2024-09-11T22:20:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a6703640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f26a00b7c00 con 0x7f26a00d3a30 2024-09-11T22:20:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a6703640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f26a015ec50 con 0x7f26a00d16d0 2024-09-11T22:20:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a4ca0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a015e870 0x7f26a00b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a4ca0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a015e870 0x7f26a00b5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36908/0 (socket says 172.21.15.50:36908) 2024-09-11T22:20:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a4ca0640 1 -- 172.21.15.50:0/3864401109 learned_addr learned my addr 172.21.15.50:0/3864401109 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f269f7fe640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a00d3a30 0x7f26a00c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f269ffff640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26a00d16d0 0x7f26a014db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a4ca0640 1 -- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26a00d16d0 msgr2=0x7f26a014db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a4ca0640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26a00d16d0 0x7f26a014db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a4ca0640 1 -- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a00d3a30 msgr2=0x7f26a00c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a4ca0640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a00d3a30 0x7f26a00c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a4ca0640 1 -- 172.21.15.50:0/3864401109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a00ca280 con 0x7f26a015e870 2024-09-11T22:20:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a4ca0640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a015e870 0x7f26a00b5840 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f269800cbf0 tx=0x7f269800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f269cff9640 1 -- 172.21.15.50:0/3864401109 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698017070 con 0x7f26a015e870 2024-09-11T22:20:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f269cff9640 1 -- 172.21.15.50:0/3864401109 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f269800ad40 con 0x7f26a015e870 2024-09-11T22:20:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a6703640 1 -- 172.21.15.50:0/3864401109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a00ca560 con 0x7f26a015e870 2024-09-11T22:20:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f269cff9640 1 -- 172.21.15.50:0/3864401109 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698012600 con 0x7f26a015e870 2024-09-11T22:20:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.066+0000 7f26a6703640 1 -- 172.21.15.50:0/3864401109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a00cab20 con 0x7f26a015e870 2024-09-11T22:20:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.067+0000 7f26a6703640 1 -- 172.21.15.50:0/3864401109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26a0068600 con 0x7f26a015e870 2024-09-11T22:20:52.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.068+0000 7f269cff9640 1 -- 172.21.15.50:0/3864401109 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f269801a070 con 0x7f26a015e870 2024-09-11T22:20:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.069+0000 7f269cff9640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f268c06be60 0x7f268c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.069+0000 7f269cff9640 1 -- 172.21.15.50:0/3864401109 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f269808ab20 con 0x7f26a015e870 2024-09-11T22:20:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.069+0000 7f269ffff640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f268c06be60 0x7f268c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.069+0000 7f269ffff640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f268c06be60 0x7f268c06e320 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f26a00b64d0 tx=0x7f2690008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.073+0000 7f269cff9640 1 -- 172.21.15.50:0/3864401109 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26a0068600 con 0x7f26a015e870 2024-09-11T22:20:52.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.245+0000 7f26a6703640 1 -- 172.21.15.50:0/3864401109 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f26a00ba410 con 0x7f268c06be60 2024-09-11T22:20:52.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.252+0000 7f269cff9640 1 -- 172.21.15.50:0/3864401109 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251403 (secure 0 0 0) 0x7f26a00ba410 con 0x7f268c06be60 2024-09-11T22:20:52.257 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:20:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.254+0000 7f26a6703640 1 -- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f268c06be60 msgr2=0x7f268c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.254+0000 7f26a6703640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f268c06be60 0x7f268c06e320 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f26a00b64d0 tx=0x7f2690008040 comp rx=0 tx=0).stop 2024-09-11T22:20:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.254+0000 7f26a6703640 1 -- 172.21.15.50:0/3864401109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a015e870 msgr2=0x7f26a00b5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.254+0000 7f26a6703640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a015e870 0x7f26a00b5840 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f269800cbf0 tx=0x7f269800a430 comp rx=0 tx=0).stop 2024-09-11T22:20:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.254+0000 7f26a6703640 1 -- 172.21.15.50:0/3864401109 shutdown_connections 2024-09-11T22:20:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.254+0000 7f26a6703640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f268c06be60 0x7f268c06e320 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.254+0000 7f26a6703640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a015e870 0x7f26a00b5840 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.254+0000 7f26a6703640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26a00d3a30 0x7f26a00c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.254+0000 7f26a6703640 1 --2- 172.21.15.50:0/3864401109 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26a00d16d0 0x7f26a014db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.254+0000 7f26a6703640 1 -- 172.21.15.50:0/3864401109 >> 172.21.15.50:0/3864401109 conn(0x7f26a00727a0 msgr2=0x7f26a015eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.254+0000 7f26a6703640 1 -- 172.21.15.50:0/3864401109 shutdown_connections 2024-09-11T22:20:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.254+0000 7f26a6703640 1 -- 172.21.15.50:0/3864401109 wait complete. 2024-09-11T22:20:52.267 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2024-09-11T22:20:51.503673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592126,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":443424,"kb_used_data":16232,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754531296,"statfs":{"total":773094113280,"available":772640047104,"internally_reserved":0,"allocated":16621568,"data_stored":7929250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1758,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.216173"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:20:48.281278+0000","last_change":"2024-09-11T22:20:48.281278+0000","last_active":"2024-09-11T22:20:48.281278+0000","last_peered":"2024-09-11T22:20:48.281278+0000","last_clean":"2024-09-11T22:20:48.281278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:48.281278+0000","last_undegraded":"2024-09-11T22:20:48.281278+0000","last_fullsized":"2024-09-11T22:20:48.281278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.258256+0000","last_change":"2024-09-11T22:20:49.256687+0000","last_active":"2024-09-11T22:20:49.258256+0000","last_peered":"2024-09-11T22:20:49.258256+0000","last_clean":"2024-09-11T22:20:49.258256+0000","last_became_active":"2024-09-11T22:20:49.255413+0000","last_became_peered":"2024-09-11T22:20:49.255413+0000","last_unstale":"2024-09-11T22:20:49.258256+0000","last_undegraded":"2024-09-11T22:20:49.258256+0000","last_fullsized":"2024-09-11T22:20:49.258256+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:12.487278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261672+0000","last_change":"2024-09-11T22:20:49.259480+0000","last_active":"2024-09-11T22:20:49.261672+0000","last_peered":"2024-09-11T22:20:49.261672+0000","last_clean":"2024-09-11T22:20:49.261672+0000","last_became_active":"2024-09-11T22:20:49.259173+0000","last_became_peered":"2024-09-11T22:20:49.259173+0000","last_unstale":"2024-09-11T22:20:49.261672+0000","last_undegraded":"2024-09-11T22:20:49.261672+0000","last_fullsized":"2024-09-11T22:20:49.261672+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:18.167932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262191+0000","last_change":"2024-09-11T22:20:49.255277+0000","last_active":"2024-09-11T22:20:49.262191+0000","last_peered":"2024-09-11T22:20:49.262191+0000","last_clean":"2024-09-11T22:20:49.262191+0000","last_became_active":"2024-09-11T22:20:49.254171+0000","last_became_peered":"2024-09-11T22:20:49.254171+0000","last_unstale":"2024-09-11T22:20:49.262191+0000","last_undegraded":"2024-09-11T22:20:49.262191+0000","last_fullsized":"2024-09-11T22:20:49.262191+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:40:51.621945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.258094+0000","last_change":"2024-09-11T22:20:49.256296+0000","last_active":"2024-09-11T22:20:49.258094+0000","last_peered":"2024-09-11T22:20:49.258094+0000","last_clean":"2024-09-11T22:20:49.258094+0000","last_became_active":"2024-09-11T22:20:49.255999+0000","last_became_peered":"2024-09-11T22:20:49.255999+0000","last_unstale":"2024-09-11T22:20:49.258094+0000","last_undegraded":"2024-09-11T22:20:49.258094+0000","last_fullsized":"2024-09-11T22:20:49.258094+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:37.475609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433430+0000","last_change":"2024-09-11T22:20:49.257008+0000","last_active":"2024-09-11T22:20:50.433430+0000","last_peered":"2024-09-11T22:20:50.433430+0000","last_clean":"2024-09-11T22:20:50.433430+0000","last_became_active":"2024-09-11T22:20:49.256658+0000","last_became_peered":"2024-09-11T22:20:49.256658+0000","last_unstale":"2024-09-11T22:20:50.433430+0000","last_undegraded":"2024-09-11T22:20:50.433430+0000","last_fullsized":"2024-09-11T22:20:50.433430+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:38.632671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261461+0000","last_change":"2024-09-11T22:20:49.259937+0000","last_active":"2024-09-11T22:20:49.261461+0000","last_peered":"2024-09-11T22:20:49.261461+0000","last_clean":"2024-09-11T22:20:49.261461+0000","last_became_active":"2024-09-11T22:20:49.259497+0000","last_became_peered":"2024-09-11T22:20:49.259497+0000","last_unstale":"2024-09-11T22:20:49.261461+0000","last_undegraded":"2024-09-11T22:20:49.261461+0000","last_fullsized":"2024-09-11T22:20:49.261461+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:44.823149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257042+0000","last_change":"2024-09-11T22:20:49.254113+0000","last_active":"2024-09-11T22:20:49.257042+0000","last_peered":"2024-09-11T22:20:49.257042+0000","last_clean":"2024-09-11T22:20:49.257042+0000","last_became_active":"2024-09-11T22:20:49.253821+0000","last_became_peered":"2024-09-11T22:20:49.253821+0000","last_unstale":"2024-09-11T22:20:49.257042+0000","last_undegraded":"2024-09-11T22:20:49.257042+0000","last_fullsized":"2024-09-11T22:20:49.257042+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:08.830514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257641+0000","last_change":"2024-09-11T22:20:49.256195+0000","last_active":"2024-09-11T22:20:49.257641+0000","last_peered":"2024-09-11T22:20:49.257641+0000","last_clean":"2024-09-11T22:20:49.257641+0000","last_became_active":"2024-09-11T22:20:49.255711+0000","last_became_peered":"2024-09-11T22:20:49.255711+0000","last_unstale":"2024-09-11T22:20:49.257641+0000","last_undegraded":"2024-09-11T22:20:49.257641+0000","last_fullsized":"2024-09-11T22:20:49.257641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:38.939177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.252003+0000","last_change":"2024-09-11T22:20:49.249631+0000","last_active":"2024-09-11T22:20:49.252003+0000","last_peered":"2024-09-11T22:20:49.252003+0000","last_clean":"2024-09-11T22:20:49.252003+0000","last_became_active":"2024-09-11T22:20:49.249320+0000","last_became_peered":"2024-09-11T22:20:49.249320+0000","last_unstale":"2024-09-11T22:20:49.252003+0000","last_undegraded":"2024-09-11T22:20:49.252003+0000","last_fullsized":"2024-09-11T22:20:49.252003+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:26.278211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.258132+0000","last_change":"2024-09-11T22:20:49.257141+0000","last_active":"2024-09-11T22:20:49.258132+0000","last_peered":"2024-09-11T22:20:49.258132+0000","last_clean":"2024-09-11T22:20:49.258132+0000","last_became_active":"2024-09-11T22:20:49.256842+0000","last_became_peered":"2024-09-11T22:20:49.256842+0000","last_unstale":"2024-09-11T22:20:49.258132+0000","last_undegraded":"2024-09-11T22:20:49.258132+0000","last_fullsized":"2024-09-11T22:20:49.258132+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:24.667187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257576+0000","last_change":"2024-09-11T22:20:49.255216+0000","last_active":"2024-09-11T22:20:49.257576+0000","last_peered":"2024-09-11T22:20:49.257576+0000","last_clean":"2024-09-11T22:20:49.257576+0000","last_became_active":"2024-09-11T22:20:49.253715+0000","last_became_peered":"2024-09-11T22:20:49.253715+0000","last_unstale":"2024-09-11T22:20:49.257576+0000","last_undegraded":"2024-09-11T22:20:49.257576+0000","last_fullsized":"2024-09-11T22:20:49.257576+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:20.358674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256760+0000","last_change":"2024-09-11T22:20:49.252882+0000","last_active":"2024-09-11T22:20:49.256760+0000","last_peered":"2024-09-11T22:20:49.256760+0000","last_clean":"2024-09-11T22:20:49.256760+0000","last_became_active":"2024-09-11T22:20:49.252605+0000","last_became_peered":"2024-09-11T22:20:49.252605+0000","last_unstale":"2024-09-11T22:20:49.256760+0000","last_undegraded":"2024-09-11T22:20:49.256760+0000","last_fullsized":"2024-09-11T22:20:49.256760+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:34:50.130283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256719+0000","last_change":"2024-09-11T22:20:49.253678+0000","last_active":"2024-09-11T22:20:49.256719+0000","last_peered":"2024-09-11T22:20:49.256719+0000","last_clean":"2024-09-11T22:20:49.256719+0000","last_became_active":"2024-09-11T22:20:49.253341+0000","last_became_peered":"2024-09-11T22:20:49.253341+0000","last_unstale":"2024-09-11T22:20:49.256719+0000","last_undegraded":"2024-09-11T22:20:49.256719+0000","last_fullsized":"2024-09-11T22:20:49.256719+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.774600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:20:48.281278+0000","last_change":"2024-09-11T22:20:48.281278+0000","last_active":"2024-09-11T22:20:48.281278+0000","last_peered":"2024-09-11T22:20:48.281278+0000","last_clean":"2024-09-11T22:20:48.281278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:48.281278+0000","last_undegraded":"2024-09-11T22:20:48.281278+0000","last_fullsized":"2024-09-11T22:20:48.281278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261360+0000","last_change":"2024-09-11T22:20:49.260060+0000","last_active":"2024-09-11T22:20:49.261360+0000","last_peered":"2024-09-11T22:20:49.261360+0000","last_clean":"2024-09-11T22:20:49.261360+0000","last_became_active":"2024-09-11T22:20:49.259343+0000","last_became_peered":"2024-09-11T22:20:49.259343+0000","last_unstale":"2024-09-11T22:20:49.261360+0000","last_undegraded":"2024-09-11T22:20:49.261360+0000","last_fullsized":"2024-09-11T22:20:49.261360+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433734+0000","last_change":"2024-09-11T22:20:49.256020+0000","last_active":"2024-09-11T22:20:50.433734+0000","last_peered":"2024-09-11T22:20:50.433734+0000","last_clean":"2024-09-11T22:20:50.433734+0000","last_became_active":"2024-09-11T22:20:49.255719+0000","last_became_peered":"2024-09-11T22:20:49.255719+0000","last_unstale":"2024-09-11T22:20:50.433734+0000","last_undegraded":"2024-09-11T22:20:50.433734+0000","last_fullsized":"2024-09-11T22:20:50.433734+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:14.287208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255186+0000","last_change":"2024-09-11T22:20:49.252133+0000","last_active":"2024-09-11T22:20:49.255186+0000","last_peered":"2024-09-11T22:20:49.255186+0000","last_clean":"2024-09-11T22:20:49.255186+0000","last_became_active":"2024-09-11T22:20:49.251795+0000","last_became_peered":"2024-09-11T22:20:49.251795+0000","last_unstale":"2024-09-11T22:20:49.255186+0000","last_undegraded":"2024-09-11T22:20:49.255186+0000","last_fullsized":"2024-09-11T22:20:49.255186+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:59.356235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433641+0000","last_change":"2024-09-11T22:20:49.260981+0000","last_active":"2024-09-11T22:20:50.433641+0000","last_peered":"2024-09-11T22:20:50.433641+0000","last_clean":"2024-09-11T22:20:50.433641+0000","last_became_active":"2024-09-11T22:20:49.260597+0000","last_became_peered":"2024-09-11T22:20:49.260597+0000","last_unstale":"2024-09-11T22:20:50.433641+0000","last_undegraded":"2024-09-11T22:20:50.433641+0000","last_fullsized":"2024-09-11T22:20:50.433641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:36.018303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.260611+0000","last_change":"2024-09-11T22:20:49.254914+0000","last_active":"2024-09-11T22:20:49.260611+0000","last_peered":"2024-09-11T22:20:49.260611+0000","last_clean":"2024-09-11T22:20:49.260611+0000","last_became_active":"2024-09-11T22:20:49.254597+0000","last_became_peered":"2024-09-11T22:20:49.254597+0000","last_unstale":"2024-09-11T22:20:49.260611+0000","last_undegraded":"2024-09-11T22:20:49.260611+0000","last_fullsized":"2024-09-11T22:20:49.260611+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:43.034095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433366+0000","last_change":"2024-09-11T22:20:49.258117+0000","last_active":"2024-09-11T22:20:50.433366+0000","last_peered":"2024-09-11T22:20:50.433366+0000","last_clean":"2024-09-11T22:20:50.433366+0000","last_became_active":"2024-09-11T22:20:49.257806+0000","last_became_peered":"2024-09-11T22:20:49.257806+0000","last_unstale":"2024-09-11T22:20:50.433366+0000","last_undegraded":"2024-09-11T22:20:50.433366+0000","last_fullsized":"2024-09-11T22:20:50.433366+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:20.317862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255549+0000","last_change":"2024-09-11T22:20:49.251616+0000","last_active":"2024-09-11T22:20:49.255549+0000","last_peered":"2024-09-11T22:20:49.255549+0000","last_clean":"2024-09-11T22:20:49.255549+0000","last_became_active":"2024-09-11T22:20:49.250819+0000","last_became_peered":"2024-09-11T22:20:49.250819+0000","last_unstale":"2024-09-11T22:20:49.255549+0000","last_undegraded":"2024-09-11T22:20:49.255549+0000","last_fullsized":"2024-09-11T22:20:49.255549+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:06.751192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433478+0000","last_change":"2024-09-11T22:20:49.258445+0000","last_active":"2024-09-11T22:20:50.433478+0000","last_peered":"2024-09-11T22:20:50.433478+0000","last_clean":"2024-09-11T22:20:50.433478+0000","last_became_active":"2024-09-11T22:20:49.258097+0000","last_became_peered":"2024-09-11T22:20:49.258097+0000","last_unstale":"2024-09-11T22:20:50.433478+0000","last_undegraded":"2024-09-11T22:20:50.433478+0000","last_fullsized":"2024-09-11T22:20:50.433478+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:24.802538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.250639+0000","last_change":"2024-09-11T22:20:49.248979+0000","last_active":"2024-09-11T22:20:49.250639+0000","last_peered":"2024-09-11T22:20:49.250639+0000","last_clean":"2024-09-11T22:20:49.250639+0000","last_became_active":"2024-09-11T22:20:49.248650+0000","last_became_peered":"2024-09-11T22:20:49.248650+0000","last_unstale":"2024-09-11T22:20:49.250639+0000","last_undegraded":"2024-09-11T22:20:49.250639+0000","last_fullsized":"2024-09-11T22:20:49.250639+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:21.294375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261194+0000","last_change":"2024-09-11T22:20:49.257680+0000","last_active":"2024-09-11T22:20:49.261194+0000","last_peered":"2024-09-11T22:20:49.261194+0000","last_clean":"2024-09-11T22:20:49.261194+0000","last_became_active":"2024-09-11T22:20:49.257402+0000","last_became_peered":"2024-09-11T22:20:49.257402+0000","last_unstale":"2024-09-11T22:20:49.261194+0000","last_undegraded":"2024-09-11T22:20:49.261194+0000","last_fullsized":"2024-09-11T22:20:49.261194+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:04.776287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261300+0000","last_change":"2024-09-11T22:20:49.253221+0000","last_active":"2024-09-11T22:20:49.261300+0000","last_peered":"2024-09-11T22:20:49.261300+0000","last_clean":"2024-09-11T22:20:49.261300+0000","last_became_active":"2024-09-11T22:20:49.252517+0000","last_became_peered":"2024-09-11T22:20:49.252517+0000","last_unstale":"2024-09-11T22:20:49.261300+0000","last_undegraded":"2024-09-11T22:20:49.261300+0000","last_fullsized":"2024-09-11T22:20:49.261300+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:35.695376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.263489+0000","last_change":"2024-09-11T22:20:49.263087+0000","last_active":"2024-09-11T22:20:49.263489+0000","last_peered":"2024-09-11T22:20:49.263489+0000","last_clean":"2024-09-11T22:20:49.263489+0000","last_became_active":"2024-09-11T22:20:49.262855+0000","last_became_peered":"2024-09-11T22:20:49.262855+0000","last_unstale":"2024-09-11T22:20:49.263489+0000","last_undegraded":"2024-09-11T22:20:49.263489+0000","last_fullsized":"2024-09-11T22:20:49.263489+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:34.118858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262208+0000","last_change":"2024-09-11T22:20:49.257721+0000","last_active":"2024-09-11T22:20:49.262208+0000","last_peered":"2024-09-11T22:20:49.262208+0000","last_clean":"2024-09-11T22:20:49.262208+0000","last_became_active":"2024-09-11T22:20:49.257445+0000","last_became_peered":"2024-09-11T22:20:49.257445+0000","last_unstale":"2024-09-11T22:20:49.262208+0000","last_undegraded":"2024-09-11T22:20:49.262208+0000","last_fullsized":"2024-09-11T22:20:49.262208+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:19.202899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.247561+0000","last_change":"2024-09-11T22:20:49.246147+0000","last_active":"2024-09-11T22:20:49.247561+0000","last_peered":"2024-09-11T22:20:49.247561+0000","last_clean":"2024-09-11T22:20:49.247561+0000","last_became_active":"2024-09-11T22:20:49.245562+0000","last_became_peered":"2024-09-11T22:20:49.245562+0000","last_unstale":"2024-09-11T22:20:49.247561+0000","last_undegraded":"2024-09-11T22:20:49.247561+0000","last_fullsized":"2024-09-11T22:20:49.247561+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:10.816175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261176+0000","last_change":"2024-09-11T22:20:49.257292+0000","last_active":"2024-09-11T22:20:49.261176+0000","last_peered":"2024-09-11T22:20:49.261176+0000","last_clean":"2024-09-11T22:20:49.261176+0000","last_became_active":"2024-09-11T22:20:49.257017+0000","last_became_peered":"2024-09-11T22:20:49.257017+0000","last_unstale":"2024-09-11T22:20:49.261176+0000","last_undegraded":"2024-09-11T22:20:49.261176+0000","last_fullsized":"2024-09-11T22:20:49.261176+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:42.578739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261718+0000","last_change":"2024-09-11T22:20:49.260855+0000","last_active":"2024-09-11T22:20:49.261718+0000","last_peered":"2024-09-11T22:20:49.261718+0000","last_clean":"2024-09-11T22:20:49.261718+0000","last_became_active":"2024-09-11T22:20:49.260572+0000","last_became_peered":"2024-09-11T22:20:49.260572+0000","last_unstale":"2024-09-11T22:20:49.261718+0000","last_undegraded":"2024-09-11T22:20:49.261718+0000","last_fullsized":"2024-09-11T22:20:49.261718+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:21.343711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255735+0000","last_change":"2024-09-11T22:20:49.253506+0000","last_active":"2024-09-11T22:20:49.255735+0000","last_peered":"2024-09-11T22:20:49.255735+0000","last_clean":"2024-09-11T22:20:49.255735+0000","last_became_active":"2024-09-11T22:20:49.253215+0000","last_became_peered":"2024-09-11T22:20:49.253215+0000","last_unstale":"2024-09-11T22:20:49.255735+0000","last_undegraded":"2024-09-11T22:20:49.255735+0000","last_fullsized":"2024-09-11T22:20:49.255735+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:18.404645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261321+0000","last_change":"2024-09-11T22:20:49.253239+0000","last_active":"2024-09-11T22:20:49.261321+0000","last_peered":"2024-09-11T22:20:49.261321+0000","last_clean":"2024-09-11T22:20:49.261321+0000","last_became_active":"2024-09-11T22:20:49.252953+0000","last_became_peered":"2024-09-11T22:20:49.252953+0000","last_unstale":"2024-09-11T22:20:49.261321+0000","last_undegraded":"2024-09-11T22:20:49.261321+0000","last_fullsized":"2024-09-11T22:20:49.261321+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:57.132602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.289517+0000","last_change":"2024-09-11T22:20:47.289517+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.289517+0000","last_undegraded":"2024-09-11T22:20:47.289517+0000","last_fullsized":"2024-09-11T22:20:47.289517+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261197+0000","last_change":"2024-09-11T22:20:49.256402+0000","last_active":"2024-09-11T22:20:49.261197+0000","last_peered":"2024-09-11T22:20:49.261197+0000","last_clean":"2024-09-11T22:20:49.261197+0000","last_became_active":"2024-09-11T22:20:49.256119+0000","last_became_peered":"2024-09-11T22:20:49.256119+0000","last_unstale":"2024-09-11T22:20:49.261197+0000","last_undegraded":"2024-09-11T22:20:49.261197+0000","last_fullsized":"2024-09-11T22:20:49.261197+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:31.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296169+0000","last_change":"2024-09-11T22:20:48.301059+0000","last_active":"2024-09-11T22:20:49.296169+0000","last_peered":"2024-09-11T22:20:49.296169+0000","last_clean":"2024-09-11T22:20:49.296169+0000","last_became_active":"2024-09-11T22:20:48.300798+0000","last_became_peered":"2024-09-11T22:20:48.300798+0000","last_unstale":"2024-09-11T22:20:49.296169+0000","last_undegraded":"2024-09-11T22:20:49.296169+0000","last_fullsized":"2024-09-11T22:20:49.296169+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:58.807896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433340+0000","last_change":"2024-09-11T22:20:49.254064+0000","last_active":"2024-09-11T22:20:50.433340+0000","last_peered":"2024-09-11T22:20:50.433340+0000","last_clean":"2024-09-11T22:20:50.433340+0000","last_became_active":"2024-09-11T22:20:49.253755+0000","last_became_peered":"2024-09-11T22:20:49.253755+0000","last_unstale":"2024-09-11T22:20:50.433340+0000","last_undegraded":"2024-09-11T22:20:50.433340+0000","last_fullsized":"2024-09-11T22:20:50.433340+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:32.881230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.298275+0000","last_change":"2024-09-11T22:20:48.305983+0000","last_active":"2024-09-11T22:20:49.298275+0000","last_peered":"2024-09-11T22:20:49.298275+0000","last_clean":"2024-09-11T22:20:49.298275+0000","last_became_active":"2024-09-11T22:20:48.305565+0000","last_became_peered":"2024-09-11T22:20:48.305565+0000","last_unstale":"2024-09-11T22:20:49.298275+0000","last_undegraded":"2024-09-11T22:20:49.298275+0000","last_fullsized":"2024-09-11T22:20:49.298275+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.485401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261649+0000","last_change":"2024-09-11T22:20:49.258388+0000","last_active":"2024-09-11T22:20:49.261649+0000","last_peered":"2024-09-11T22:20:49.261649+0000","last_clean":"2024-09-11T22:20:49.261649+0000","last_became_active":"2024-09-11T22:20:49.258045+0000","last_became_peered":"2024-09-11T22:20:49.258045+0000","last_unstale":"2024-09-11T22:20:49.261649+0000","last_undegraded":"2024-09-11T22:20:49.261649+0000","last_fullsized":"2024-09-11T22:20:49.261649+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:32:05.512930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.299575+0000","last_change":"2024-09-11T22:20:48.307332+0000","last_active":"2024-09-11T22:20:49.299575+0000","last_peered":"2024-09-11T22:20:49.299575+0000","last_clean":"2024-09-11T22:20:49.299575+0000","last_became_active":"2024-09-11T22:20:48.306940+0000","last_became_peered":"2024-09-11T22:20:48.306940+0000","last_unstale":"2024-09-11T22:20:49.299575+0000","last_undegraded":"2024-09-11T22:20:49.299575+0000","last_fullsized":"2024-09-11T22:20:49.299575+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:03.217415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261796+0000","last_change":"2024-09-11T22:20:49.253030+0000","last_active":"2024-09-11T22:20:49.261796+0000","last_peered":"2024-09-11T22:20:49.261796+0000","last_clean":"2024-09-11T22:20:49.261796+0000","last_became_active":"2024-09-11T22:20:49.252290+0000","last_became_peered":"2024-09-11T22:20:49.252290+0000","last_unstale":"2024-09-11T22:20:49.261796+0000","last_undegraded":"2024-09-11T22:20:49.261796+0000","last_fullsized":"2024-09-11T22:20:49.261796+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:25.075906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296158+0000","last_change":"2024-09-11T22:20:48.297836+0000","last_active":"2024-09-11T22:20:49.296158+0000","last_peered":"2024-09-11T22:20:49.296158+0000","last_clean":"2024-09-11T22:20:49.296158+0000","last_became_active":"2024-09-11T22:20:48.297270+0000","last_became_peered":"2024-09-11T22:20:48.297270+0000","last_unstale":"2024-09-11T22:20:49.296158+0000","last_undegraded":"2024-09-11T22:20:49.296158+0000","last_fullsized":"2024-09-11T22:20:49.296158+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:26.844219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262374+0000","last_change":"2024-09-11T22:20:49.259041+0000","last_active":"2024-09-11T22:20:49.262374+0000","last_peered":"2024-09-11T22:20:49.262374+0000","last_clean":"2024-09-11T22:20:49.262374+0000","last_became_active":"2024-09-11T22:20:49.256041+0000","last_became_peered":"2024-09-11T22:20:49.256041+0000","last_unstale":"2024-09-11T22:20:49.262374+0000","last_undegraded":"2024-09-11T22:20:49.262374+0000","last_fullsized":"2024-09-11T22:20:49.262374+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:21.423018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296841+0000","last_change":"2024-09-11T22:20:48.302454+0000","last_active":"2024-09-11T22:20:49.296841+0000","last_peered":"2024-09-11T22:20:49.296841+0000","last_clean":"2024-09-11T22:20:49.296841+0000","last_became_active":"2024-09-11T22:20:48.302149+0000","last_became_peered":"2024-09-11T22:20:48.302149+0000","last_unstale":"2024-09-11T22:20:49.296841+0000","last_undegraded":"2024-09-11T22:20:49.296841+0000","last_fullsized":"2024-09-11T22:20:49.296841+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:23.665309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257311+0000","last_change":"2024-09-11T22:20:49.253425+0000","last_active":"2024-09-11T22:20:49.257311+0000","last_peered":"2024-09-11T22:20:49.257311+0000","last_clean":"2024-09-11T22:20:49.257311+0000","last_became_active":"2024-09-11T22:20:49.252711+0000","last_became_peered":"2024-09-11T22:20:49.252711+0000","last_unstale":"2024-09-11T22:20:49.257311+0000","last_undegraded":"2024-09-11T22:20:49.257311+0000","last_fullsized":"2024-09-11T22:20:49.257311+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:42.578739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.242628+0000","last_change":"2024-09-11T22:20:48.305247+0000","last_active":"2024-09-11T22:20:49.242628+0000","last_peered":"2024-09-11T22:20:49.242628+0000","last_clean":"2024-09-11T22:20:49.242628+0000","last_became_active":"2024-09-11T22:20:48.304920+0000","last_became_peered":"2024-09-11T22:20:48.304920+0000","last_unstale":"2024-09-11T22:20:49.242628+0000","last_undegraded":"2024-09-11T22:20:49.242628+0000","last_fullsized":"2024-09-11T22:20:49.242628+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:33.116980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433383+0000","last_change":"2024-09-11T22:20:49.257648+0000","last_active":"2024-09-11T22:20:50.433383+0000","last_peered":"2024-09-11T22:20:50.433383+0000","last_clean":"2024-09-11T22:20:50.433383+0000","last_became_active":"2024-09-11T22:20:49.257084+0000","last_became_peered":"2024-09-11T22:20:49.257084+0000","last_unstale":"2024-09-11T22:20:50.433383+0000","last_undegraded":"2024-09-11T22:20:50.433383+0000","last_fullsized":"2024-09-11T22:20:50.433383+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.426141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.245222+0000","last_change":"2024-09-11T22:20:48.295595+0000","last_active":"2024-09-11T22:20:49.245222+0000","last_peered":"2024-09-11T22:20:49.245222+0000","last_clean":"2024-09-11T22:20:49.245222+0000","last_became_active":"2024-09-11T22:20:48.295384+0000","last_became_peered":"2024-09-11T22:20:48.295384+0000","last_unstale":"2024-09-11T22:20:49.245222+0000","last_undegraded":"2024-09-11T22:20:49.245222+0000","last_fullsized":"2024-09-11T22:20:49.245222+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:30.293105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262154+0000","last_change":"2024-09-11T22:20:49.261199+0000","last_active":"2024-09-11T22:20:49.262154+0000","last_peered":"2024-09-11T22:20:49.262154+0000","last_clean":"2024-09-11T22:20:49.262154+0000","last_became_active":"2024-09-11T22:20:49.260923+0000","last_became_peered":"2024-09-11T22:20:49.260923+0000","last_unstale":"2024-09-11T22:20:49.262154+0000","last_undegraded":"2024-09-11T22:20:49.262154+0000","last_fullsized":"2024-09-11T22:20:49.262154+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:58.259369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433655+0000","last_change":"2024-09-11T22:20:48.301853+0000","last_active":"2024-09-11T22:20:50.433655+0000","last_peered":"2024-09-11T22:20:50.433655+0000","last_clean":"2024-09-11T22:20:50.433655+0000","last_became_active":"2024-09-11T22:20:48.301527+0000","last_became_peered":"2024-09-11T22:20:48.301527+0000","last_unstale":"2024-09-11T22:20:50.433655+0000","last_undegraded":"2024-09-11T22:20:50.433655+0000","last_fullsized":"2024-09-11T22:20:50.433655+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:58.041049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.254050+0000","last_change":"2024-09-11T22:20:49.251762+0000","last_active":"2024-09-11T22:20:49.254050+0000","last_peered":"2024-09-11T22:20:49.254050+0000","last_clean":"2024-09-11T22:20:49.254050+0000","last_became_active":"2024-09-11T22:20:49.251246+0000","last_became_peered":"2024-09-11T22:20:49.251246+0000","last_unstale":"2024-09-11T22:20:49.254050+0000","last_undegraded":"2024-09-11T22:20:49.254050+0000","last_fullsized":"2024-09-11T22:20:49.254050+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"155'3","reported_seq":17,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433653+0000","last_change":"2024-09-11T22:20:48.300620+0000","last_active":"2024-09-11T22:20:50.433653+0000","last_peered":"2024-09-11T22:20:50.433653+0000","last_clean":"2024-09-11T22:20:50.433653+0000","last_became_active":"2024-09-11T22:20:48.300324+0000","last_became_peered":"2024-09-11T22:20:48.300324+0000","last_unstale":"2024-09-11T22:20:50.433653+0000","last_undegraded":"2024-09-11T22:20:50.433653+0000","last_fullsized":"2024-09-11T22:20:50.433653+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:30.057922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255793+0000","last_change":"2024-09-11T22:20:49.254036+0000","last_active":"2024-09-11T22:20:49.255793+0000","last_peered":"2024-09-11T22:20:49.255793+0000","last_clean":"2024-09-11T22:20:49.255793+0000","last_became_active":"2024-09-11T22:20:49.253188+0000","last_became_peered":"2024-09-11T22:20:49.253188+0000","last_unstale":"2024-09-11T22:20:49.255793+0000","last_undegraded":"2024-09-11T22:20:49.255793+0000","last_fullsized":"2024-09-11T22:20:49.255793+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:24.667187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"155'6","reported_seq":18,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.301030+0000","last_change":"2024-09-11T22:20:48.298730+0000","last_active":"2024-09-11T22:20:49.301030+0000","last_peered":"2024-09-11T22:20:49.301030+0000","last_clean":"2024-09-11T22:20:49.301030+0000","last_became_active":"2024-09-11T22:20:48.297965+0000","last_became_peered":"2024-09-11T22:20:48.297965+0000","last_unstale":"2024-09-11T22:20:49.301030+0000","last_undegraded":"2024-09-11T22:20:49.301030+0000","last_fullsized":"2024-09-11T22:20:49.301030+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.485401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257021+0000","last_change":"2024-09-11T22:20:49.256099+0000","last_active":"2024-09-11T22:20:49.257021+0000","last_peered":"2024-09-11T22:20:49.257021+0000","last_clean":"2024-09-11T22:20:49.257021+0000","last_became_active":"2024-09-11T22:20:49.255825+0000","last_became_peered":"2024-09-11T22:20:49.255825+0000","last_unstale":"2024-09-11T22:20:49.257021+0000","last_undegraded":"2024-09-11T22:20:49.257021+0000","last_fullsized":"2024-09-11T22:20:49.257021+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:04.682427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296612+0000","last_change":"2024-09-11T22:20:48.301519+0000","last_active":"2024-09-11T22:20:49.296612+0000","last_peered":"2024-09-11T22:20:49.296612+0000","last_clean":"2024-09-11T22:20:49.296612+0000","last_became_active":"2024-09-11T22:20:48.301198+0000","last_became_peered":"2024-09-11T22:20:48.301198+0000","last_unstale":"2024-09-11T22:20:49.296612+0000","last_undegraded":"2024-09-11T22:20:49.296612+0000","last_fullsized":"2024-09-11T22:20:49.296612+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:37.937300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261131+0000","last_change":"2024-09-11T22:20:49.253407+0000","last_active":"2024-09-11T22:20:49.261131+0000","last_peered":"2024-09-11T22:20:49.261131+0000","last_clean":"2024-09-11T22:20:49.261131+0000","last_became_active":"2024-09-11T22:20:49.252632+0000","last_became_peered":"2024-09-11T22:20:49.252632+0000","last_unstale":"2024-09-11T22:20:49.261131+0000","last_undegraded":"2024-09-11T22:20:49.261131+0000","last_fullsized":"2024-09-11T22:20:49.261131+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:03.072860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.248005+0000","last_change":"2024-09-11T22:20:48.303180+0000","last_active":"2024-09-11T22:20:49.248005+0000","last_peered":"2024-09-11T22:20:49.248005+0000","last_clean":"2024-09-11T22:20:49.248005+0000","last_became_active":"2024-09-11T22:20:48.302900+0000","last_became_peered":"2024-09-11T22:20:48.302900+0000","last_unstale":"2024-09-11T22:20:49.248005+0000","last_undegraded":"2024-09-11T22:20:49.248005+0000","last_fullsized":"2024-09-11T22:20:49.248005+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:34.148358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262365+0000","last_change":"2024-09-11T22:20:49.253704+0000","last_active":"2024-09-11T22:20:49.262365+0000","last_peered":"2024-09-11T22:20:49.262365+0000","last_clean":"2024-09-11T22:20:49.262365+0000","last_became_active":"2024-09-11T22:20:49.253146+0000","last_became_peered":"2024-09-11T22:20:49.253146+0000","last_unstale":"2024-09-11T22:20:49.262365+0000","last_undegraded":"2024-09-11T22:20:49.262365+0000","last_fullsized":"2024-09-11T22:20:49.262365+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:21.343711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.240529+0000","last_change":"2024-09-11T22:20:48.303425+0000","last_active":"2024-09-11T22:20:49.240529+0000","last_peered":"2024-09-11T22:20:49.240529+0000","last_clean":"2024-09-11T22:20:49.240529+0000","last_became_active":"2024-09-11T22:20:48.303149+0000","last_became_peered":"2024-09-11T22:20:48.303149+0000","last_unstale":"2024-09-11T22:20:49.240529+0000","last_undegraded":"2024-09-11T22:20:49.240529+0000","last_fullsized":"2024-09-11T22:20:49.240529+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:07.828637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261428+0000","last_change":"2024-09-11T22:20:49.259624+0000","last_active":"2024-09-11T22:20:49.261428+0000","last_peered":"2024-09-11T22:20:49.261428+0000","last_clean":"2024-09-11T22:20:49.261428+0000","last_became_active":"2024-09-11T22:20:49.259313+0000","last_became_peered":"2024-09-11T22:20:49.259313+0000","last_unstale":"2024-09-11T22:20:49.261428+0000","last_undegraded":"2024-09-11T22:20:49.261428+0000","last_fullsized":"2024-09-11T22:20:49.261428+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.591169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"155'8","reported_seq":20,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.299630+0000","last_change":"2024-09-11T22:20:48.298368+0000","last_active":"2024-09-11T22:20:49.299630+0000","last_peered":"2024-09-11T22:20:49.299630+0000","last_clean":"2024-09-11T22:20:49.299630+0000","last_became_active":"2024-09-11T22:20:48.298080+0000","last_became_peered":"2024-09-11T22:20:48.298080+0000","last_unstale":"2024-09-11T22:20:49.299630+0000","last_undegraded":"2024-09-11T22:20:49.299630+0000","last_fullsized":"2024-09-11T22:20:49.299630+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:19.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257415+0000","last_change":"2024-09-11T22:20:49.253099+0000","last_active":"2024-09-11T22:20:49.257415+0000","last_peered":"2024-09-11T22:20:49.257415+0000","last_clean":"2024-09-11T22:20:49.257415+0000","last_became_active":"2024-09-11T22:20:49.252746+0000","last_became_peered":"2024-09-11T22:20:49.252746+0000","last_unstale":"2024-09-11T22:20:49.257415+0000","last_undegraded":"2024-09-11T22:20:49.257415+0000","last_fullsized":"2024-09-11T22:20:49.257415+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:31.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.297661+0000","last_change":"2024-09-11T22:20:48.303794+0000","last_active":"2024-09-11T22:20:49.297661+0000","last_peered":"2024-09-11T22:20:49.297661+0000","last_clean":"2024-09-11T22:20:49.297661+0000","last_became_active":"2024-09-11T22:20:48.303490+0000","last_became_peered":"2024-09-11T22:20:48.303490+0000","last_unstale":"2024-09-11T22:20:49.297661+0000","last_undegraded":"2024-09-11T22:20:49.297661+0000","last_fullsized":"2024-09-11T22:20:49.297661+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:45.138609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261362+0000","last_change":"2024-09-11T22:20:49.257754+0000","last_active":"2024-09-11T22:20:49.261362+0000","last_peered":"2024-09-11T22:20:49.261362+0000","last_clean":"2024-09-11T22:20:49.261362+0000","last_became_active":"2024-09-11T22:20:49.257472+0000","last_became_peered":"2024-09-11T22:20:49.257472+0000","last_unstale":"2024-09-11T22:20:49.261362+0000","last_undegraded":"2024-09-11T22:20:49.261362+0000","last_fullsized":"2024-09-11T22:20:49.261362+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:12.702105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.297285+0000","last_change":"2024-09-11T22:20:48.299954+0000","last_active":"2024-09-11T22:20:49.297285+0000","last_peered":"2024-09-11T22:20:49.297285+0000","last_clean":"2024-09-11T22:20:49.297285+0000","last_became_active":"2024-09-11T22:20:48.299637+0000","last_became_peered":"2024-09-11T22:20:48.299637+0000","last_unstale":"2024-09-11T22:20:49.297285+0000","last_undegraded":"2024-09-11T22:20:49.297285+0000","last_fullsized":"2024-09-11T22:20:49.297285+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:57.382973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262167+0000","last_change":"2024-09-11T22:20:49.253982+0000","last_active":"2024-09-11T22:20:49.262167+0000","last_peered":"2024-09-11T22:20:49.262167+0000","last_clean":"2024-09-11T22:20:49.262167+0000","last_became_active":"2024-09-11T22:20:49.253595+0000","last_became_peered":"2024-09-11T22:20:49.253595+0000","last_unstale":"2024-09-11T22:20:49.262167+0000","last_undegraded":"2024-09-11T22:20:49.262167+0000","last_fullsized":"2024-09-11T22:20:49.262167+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:41.858220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.289493+0000","last_change":"2024-09-11T22:20:47.289493+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.289493+0000","last_undegraded":"2024-09-11T22:20:47.289493+0000","last_fullsized":"2024-09-11T22:20:47.289493+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261211+0000","last_change":"2024-09-11T22:20:49.259683+0000","last_active":"2024-09-11T22:20:49.261211+0000","last_peered":"2024-09-11T22:20:49.261211+0000","last_clean":"2024-09-11T22:20:49.261211+0000","last_became_active":"2024-09-11T22:20:49.259311+0000","last_became_peered":"2024-09-11T22:20:49.259311+0000","last_unstale":"2024-09-11T22:20:49.261211+0000","last_undegraded":"2024-09-11T22:20:49.261211+0000","last_fullsized":"2024-09-11T22:20:49.261211+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:35.150235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.288563+0000","last_change":"2024-09-11T22:20:47.288563+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.288563+0000","last_undegraded":"2024-09-11T22:20:47.288563+0000","last_fullsized":"2024-09-11T22:20:47.288563+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256698+0000","last_change":"2024-09-11T22:20:49.252061+0000","last_active":"2024-09-11T22:20:49.256698+0000","last_peered":"2024-09-11T22:20:49.256698+0000","last_clean":"2024-09-11T22:20:49.256698+0000","last_became_active":"2024-09-11T22:20:49.251776+0000","last_became_peered":"2024-09-11T22:20:49.251776+0000","last_unstale":"2024-09-11T22:20:49.256698+0000","last_undegraded":"2024-09-11T22:20:49.256698+0000","last_fullsized":"2024-09-11T22:20:49.256698+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:42.720833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.298359+0000","last_change":"2024-09-11T22:20:48.305063+0000","last_active":"2024-09-11T22:20:49.298359+0000","last_peered":"2024-09-11T22:20:49.298359+0000","last_clean":"2024-09-11T22:20:49.298359+0000","last_became_active":"2024-09-11T22:20:48.304721+0000","last_became_peered":"2024-09-11T22:20:48.304721+0000","last_unstale":"2024-09-11T22:20:49.298359+0000","last_undegraded":"2024-09-11T22:20:49.298359+0000","last_fullsized":"2024-09-11T22:20:49.298359+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:36.473732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261175+0000","last_change":"2024-09-11T22:20:49.258542+0000","last_active":"2024-09-11T22:20:49.261175+0000","last_peered":"2024-09-11T22:20:49.261175+0000","last_clean":"2024-09-11T22:20:49.261175+0000","last_became_active":"2024-09-11T22:20:49.258256+0000","last_became_peered":"2024-09-11T22:20:49.258256+0000","last_unstale":"2024-09-11T22:20:49.261175+0000","last_undegraded":"2024-09-11T22:20:49.261175+0000","last_fullsized":"2024-09-11T22:20:49.261175+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.165270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.288534+0000","last_change":"2024-09-11T22:20:47.288534+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.288534+0000","last_undegraded":"2024-09-11T22:20:47.288534+0000","last_fullsized":"2024-09-11T22:20:47.288534+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:20:48.281278+0000","last_change":"2024-09-11T22:20:48.281278+0000","last_active":"2024-09-11T22:20:48.281278+0000","last_peered":"2024-09-11T22:20:48.281278+0000","last_clean":"2024-09-11T22:20:48.281278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:48.281278+0000","last_undegraded":"2024-09-11T22:20:48.281278+0000","last_fullsized":"2024-09-11T22:20:48.281278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.240672+0000","last_change":"2024-09-11T22:20:48.296080+0000","last_active":"2024-09-11T22:20:49.240672+0000","last_peered":"2024-09-11T22:20:49.240672+0000","last_clean":"2024-09-11T22:20:49.240672+0000","last_became_active":"2024-09-11T22:20:48.295806+0000","last_became_peered":"2024-09-11T22:20:48.295806+0000","last_unstale":"2024-09-11T22:20:49.240672+0000","last_undegraded":"2024-09-11T22:20:49.240672+0000","last_fullsized":"2024-09-11T22:20:49.240672+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:19.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433538+0000","last_change":"2024-09-11T22:20:49.257288+0000","last_active":"2024-09-11T22:20:50.433538+0000","last_peered":"2024-09-11T22:20:50.433538+0000","last_clean":"2024-09-11T22:20:50.433538+0000","last_became_active":"2024-09-11T22:20:49.256626+0000","last_became_peered":"2024-09-11T22:20:49.256626+0000","last_unstale":"2024-09-11T22:20:50.433538+0000","last_undegraded":"2024-09-11T22:20:50.433538+0000","last_fullsized":"2024-09-11T22:20:50.433538+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:53.953093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.288687+0000","last_change":"2024-09-11T22:20:47.288687+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.288687+0000","last_undegraded":"2024-09-11T22:20:47.288687+0000","last_fullsized":"2024-09-11T22:20:47.288687+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255201+0000","last_change":"2024-09-11T22:20:49.252744+0000","last_active":"2024-09-11T22:20:49.255201+0000","last_peered":"2024-09-11T22:20:49.255201+0000","last_clean":"2024-09-11T22:20:49.255201+0000","last_became_active":"2024-09-11T22:20:49.252458+0000","last_became_peered":"2024-09-11T22:20:49.252458+0000","last_unstale":"2024-09-11T22:20:49.255201+0000","last_undegraded":"2024-09-11T22:20:49.255201+0000","last_fullsized":"2024-09-11T22:20:49.255201+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:21.209058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.298270+0000","last_change":"2024-09-11T22:20:48.304158+0000","last_active":"2024-09-11T22:20:49.298270+0000","last_peered":"2024-09-11T22:20:49.298270+0000","last_clean":"2024-09-11T22:20:49.298270+0000","last_became_active":"2024-09-11T22:20:48.303869+0000","last_became_peered":"2024-09-11T22:20:48.303869+0000","last_unstale":"2024-09-11T22:20:49.298270+0000","last_undegraded":"2024-09-11T22:20:49.298270+0000","last_fullsized":"2024-09-11T22:20:49.298270+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:43.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.253562+0000","last_change":"2024-09-11T22:20:49.251765+0000","last_active":"2024-09-11T22:20:49.253562+0000","last_peered":"2024-09-11T22:20:49.253562+0000","last_clean":"2024-09-11T22:20:49.253562+0000","last_became_active":"2024-09-11T22:20:49.251469+0000","last_became_peered":"2024-09-11T22:20:49.251469+0000","last_unstale":"2024-09-11T22:20:49.253562+0000","last_undegraded":"2024-09-11T22:20:49.253562+0000","last_fullsized":"2024-09-11T22:20:49.253562+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:24.119485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.244047+0000","last_change":"2024-09-11T22:20:48.298375+0000","last_active":"2024-09-11T22:20:49.244047+0000","last_peered":"2024-09-11T22:20:49.244047+0000","last_clean":"2024-09-11T22:20:49.244047+0000","last_became_active":"2024-09-11T22:20:48.298114+0000","last_became_peered":"2024-09-11T22:20:48.298114+0000","last_unstale":"2024-09-11T22:20:49.244047+0000","last_undegraded":"2024-09-11T22:20:49.244047+0000","last_fullsized":"2024-09-11T22:20:49.244047+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:56.322627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433535+0000","last_change":"2024-09-11T22:20:49.259942+0000","last_active":"2024-09-11T22:20:50.433535+0000","last_peered":"2024-09-11T22:20:50.433535+0000","last_clean":"2024-09-11T22:20:50.433535+0000","last_became_active":"2024-09-11T22:20:49.259628+0000","last_became_peered":"2024-09-11T22:20:49.259628+0000","last_unstale":"2024-09-11T22:20:50.433535+0000","last_undegraded":"2024-09-11T22:20:50.433535+0000","last_fullsized":"2024-09-11T22:20:50.433535+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:12.697073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.244858+0000","last_change":"2024-09-11T22:20:48.303659+0000","last_active":"2024-09-11T22:20:49.244858+0000","last_peered":"2024-09-11T22:20:49.244858+0000","last_clean":"2024-09-11T22:20:49.244858+0000","last_became_active":"2024-09-11T22:20:48.303369+0000","last_became_peered":"2024-09-11T22:20:48.303369+0000","last_unstale":"2024-09-11T22:20:49.244858+0000","last_undegraded":"2024-09-11T22:20:49.244858+0000","last_fullsized":"2024-09-11T22:20:49.244858+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:51.679794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256985+0000","last_change":"2024-09-11T22:20:49.255571+0000","last_active":"2024-09-11T22:20:49.256985+0000","last_peered":"2024-09-11T22:20:49.256985+0000","last_clean":"2024-09-11T22:20:49.256985+0000","last_became_active":"2024-09-11T22:20:49.255282+0000","last_became_peered":"2024-09-11T22:20:49.255282+0000","last_unstale":"2024-09-11T22:20:49.256985+0000","last_undegraded":"2024-09-11T22:20:49.256985+0000","last_fullsized":"2024-09-11T22:20:49.256985+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:26:15.294230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.246751+0000","last_change":"2024-09-11T22:20:48.300370+0000","last_active":"2024-09-11T22:20:49.246751+0000","last_peered":"2024-09-11T22:20:49.246751+0000","last_clean":"2024-09-11T22:20:49.246751+0000","last_became_active":"2024-09-11T22:20:48.300068+0000","last_became_peered":"2024-09-11T22:20:48.300068+0000","last_unstale":"2024-09-11T22:20:49.246751+0000","last_undegraded":"2024-09-11T22:20:49.246751+0000","last_fullsized":"2024-09-11T22:20:49.246751+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:16.679941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262119+0000","last_change":"2024-09-11T22:20:49.260222+0000","last_active":"2024-09-11T22:20:49.262119+0000","last_peered":"2024-09-11T22:20:49.262119+0000","last_clean":"2024-09-11T22:20:49.262119+0000","last_became_active":"2024-09-11T22:20:49.258826+0000","last_became_peered":"2024-09-11T22:20:49.258826+0000","last_unstale":"2024-09-11T22:20:49.262119+0000","last_undegraded":"2024-09-11T22:20:49.262119+0000","last_fullsized":"2024-09-11T22:20:49.262119+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:48.356663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.253712+0000","last_change":"2024-09-11T22:20:48.296479+0000","last_active":"2024-09-11T22:20:49.253712+0000","last_peered":"2024-09-11T22:20:49.253712+0000","last_clean":"2024-09-11T22:20:49.253712+0000","last_became_active":"2024-09-11T22:20:48.296203+0000","last_became_peered":"2024-09-11T22:20:48.296203+0000","last_unstale":"2024-09-11T22:20:49.253712+0000","last_undegraded":"2024-09-11T22:20:49.253712+0000","last_fullsized":"2024-09-11T22:20:49.253712+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:36.473732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.264693+0000","last_change":"2024-09-11T22:20:49.264327+0000","last_active":"2024-09-11T22:20:49.264693+0000","last_peered":"2024-09-11T22:20:49.264693+0000","last_clean":"2024-09-11T22:20:49.264693+0000","last_became_active":"2024-09-11T22:20:49.264054+0000","last_became_peered":"2024-09-11T22:20:49.264054+0000","last_unstale":"2024-09-11T22:20:49.264693+0000","last_undegraded":"2024-09-11T22:20:49.264693+0000","last_fullsized":"2024-09-11T22:20:49.264693+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:41.858220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.241472+0000","last_change":"2024-09-11T22:20:48.307406+0000","last_active":"2024-09-11T22:20:49.241472+0000","last_peered":"2024-09-11T22:20:49.241472+0000","last_clean":"2024-09-11T22:20:49.241472+0000","last_became_active":"2024-09-11T22:20:48.306853+0000","last_became_peered":"2024-09-11T22:20:48.306853+0000","last_unstale":"2024-09-11T22:20:49.241472+0000","last_undegraded":"2024-09-11T22:20:49.241472+0000","last_fullsized":"2024-09-11T22:20:49.241472+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:58.807896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261340+0000","last_change":"2024-09-11T22:20:49.259551+0000","last_active":"2024-09-11T22:20:49.261340+0000","last_peered":"2024-09-11T22:20:49.261340+0000","last_clean":"2024-09-11T22:20:49.261340+0000","last_became_active":"2024-09-11T22:20:49.258914+0000","last_became_peered":"2024-09-11T22:20:49.258914+0000","last_unstale":"2024-09-11T22:20:49.261340+0000","last_undegraded":"2024-09-11T22:20:49.261340+0000","last_fullsized":"2024-09-11T22:20:49.261340+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:17.681818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.242779+0000","last_change":"2024-09-11T22:20:48.303303+0000","last_active":"2024-09-11T22:20:49.242779+0000","last_peered":"2024-09-11T22:20:49.242779+0000","last_clean":"2024-09-11T22:20:49.242779+0000","last_became_active":"2024-09-11T22:20:48.302954+0000","last_became_peered":"2024-09-11T22:20:48.302954+0000","last_unstale":"2024-09-11T22:20:49.242779+0000","last_undegraded":"2024-09-11T22:20:49.242779+0000","last_fullsized":"2024-09-11T22:20:49.242779+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:53.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261514+0000","last_change":"2024-09-11T22:20:49.260083+0000","last_active":"2024-09-11T22:20:49.261514+0000","last_peered":"2024-09-11T22:20:49.261514+0000","last_clean":"2024-09-11T22:20:49.261514+0000","last_became_active":"2024-09-11T22:20:49.259745+0000","last_became_peered":"2024-09-11T22:20:49.259745+0000","last_unstale":"2024-09-11T22:20:49.261514+0000","last_undegraded":"2024-09-11T22:20:49.261514+0000","last_fullsized":"2024-09-11T22:20:49.261514+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:17.694423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.253141+0000","last_change":"2024-09-11T22:20:48.300845+0000","last_active":"2024-09-11T22:20:49.253141+0000","last_peered":"2024-09-11T22:20:49.253141+0000","last_clean":"2024-09-11T22:20:49.253141+0000","last_became_active":"2024-09-11T22:20:48.298386+0000","last_became_peered":"2024-09-11T22:20:48.298386+0000","last_unstale":"2024-09-11T22:20:49.253141+0000","last_undegraded":"2024-09-11T22:20:49.253141+0000","last_fullsized":"2024-09-11T22:20:49.253141+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:37.937300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262848+0000","last_change":"2024-09-11T22:20:49.261945+0000","last_active":"2024-09-11T22:20:49.262848+0000","last_peered":"2024-09-11T22:20:49.262848+0000","last_clean":"2024-09-11T22:20:49.262848+0000","last_became_active":"2024-09-11T22:20:49.261653+0000","last_became_peered":"2024-09-11T22:20:49.261653+0000","last_unstale":"2024-09-11T22:20:49.262848+0000","last_undegraded":"2024-09-11T22:20:49.262848+0000","last_fullsized":"2024-09-11T22:20:49.262848+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:16.042772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.254831+0000","last_change":"2024-09-11T22:20:48.305326+0000","last_active":"2024-09-11T22:20:49.254831+0000","last_peered":"2024-09-11T22:20:49.254831+0000","last_clean":"2024-09-11T22:20:49.254831+0000","last_became_active":"2024-09-11T22:20:48.305080+0000","last_became_peered":"2024-09-11T22:20:48.305080+0000","last_unstale":"2024-09-11T22:20:49.254831+0000","last_undegraded":"2024-09-11T22:20:49.254831+0000","last_fullsized":"2024-09-11T22:20:49.254831+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:03.217415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":409,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T22:20:47.288350+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:20:47.288350+0000","last_peered":"2024-09-11T22:20:47.288350+0000","last_clean":"2024-09-11T22:20:47.288350+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:20:47.288350+0000","last_undegraded":"2024-09-11T22:20:47.288350+0000","last_fullsized":"2024-09-11T22:20:47.288350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":122,"acting":122,"num_store_stats":7},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":1758,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51124,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320716,"statfs":{"total":96636764160,"available":96584413184,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509559,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46956,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324884,"statfs":{"total":96636764160,"available":96588681216,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509561,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55304,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316536,"statfs":{"total":96636764160,"available":96580132864,"internally_reserved":0,"allocated":1953792,"data_stored":850830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59444,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312396,"statfs":{"total":96636764160,"available":96575893504,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63596,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308244,"statfs":{"total":96636764160,"available":96571641856,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509560,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55864,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315976,"statfs":{"total":96636764160,"available":96579559424,"internally_reserved":0,"allocated":2519040,"data_stored":1432741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51672,"kb_used_data":2436,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320168,"statfs":{"total":96636764160,"available":96583852032,"internally_reserved":0,"allocated":2494464,"data_stored":1420649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59464,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312376,"statfs":{"total":96636764160,"available":96575873024,"internally_reserved":0,"allocated":1953792,"data_stored":855538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:20:52.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:20:52.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.409+0000 7f5641001640 1 Processor -- start 2024-09-11T22:20:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.409+0000 7f5641001640 1 -- start start 2024-09-11T22:20:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.409+0000 7f5641001640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f563c15e7d0 0x7f563c0ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.409+0000 7f5641001640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f563c162ab0 0x7f563c0d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.409+0000 7f5641001640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f563c0cf380 con 0x7f563c162ed0 2024-09-11T22:20:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5641001640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f563c15ebb0 con 0x7f563c15e7d0 2024-09-11T22:20:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5641001640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f563c0d2730 con 0x7f563c162ab0 2024-09-11T22:20:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f563b59e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f563c162ed0 0x7f563c0d4670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43786/0 (socket says 172.21.15.50:43786) 2024-09-11T22:20:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f563b59e640 1 -- 172.21.15.50:0/2114655544 learned_addr learned my addr 172.21.15.50:0/2114655544 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f563ad9d640 1 --2- 172.21.15.50:0/2114655544 >> v2:172.21.15.77:3300/0 conn(0x7f563c15e7d0 0x7f563c0ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 542101460 0 0) 0x7f563c0cf380 con 0x7f563c162ed0 2024-09-11T22:20:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f563a59c640 1 --2- 172.21.15.50:0/2114655544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f563c162ab0 0x7f563c0d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5624003520 con 0x7f563c162ed0 2024-09-11T22:20:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 875536643 0 0) 0x7f5624003520 con 0x7f563c162ed0 2024-09-11T22:20:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f563c162ab0 msgr2=0x7f563c0d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 --2- 172.21.15.50:0/2114655544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f563c162ab0 0x7f563c0d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 >> v2:172.21.15.77:3300/0 conn(0x7f563c15e7d0 msgr2=0x7f563c0ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 --2- 172.21.15.50:0/2114655544 >> v2:172.21.15.77:3300/0 conn(0x7f563c15e7d0 0x7f563c0ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c0cf660 con 0x7f563c162ed0 2024-09-11T22:20:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f56340019f0 con 0x7f563c162ed0 2024-09-11T22:20:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 >> v1:172.21.15.50:6789/0 conn(0x7f563c162ed0 legacy=0x7f563c0d4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 --2- 172.21.15.50:0/2114655544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56240039b0 0x7f5624003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 --2- 172.21.15.50:0/2114655544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f563c162ab0 0x7f5624004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 --2- 172.21.15.50:0/2114655544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5624004d40 0x7f56240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f563c0d2730 con 0x7f56240039b0 2024-09-11T22:20:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f562400b9c0 con 0x7f5624004d40 2024-09-11T22:20:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.410+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f562400bb40 con 0x7f563c162ab0 2024-09-11T22:20:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.411+0000 7f563ad9d640 1 --2- 172.21.15.50:0/2114655544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56240039b0 0x7f5624003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.411+0000 7f563a59c640 1 --2- 172.21.15.50:0/2114655544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f563c162ab0 0x7f5624004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.411+0000 7f563b59e640 1 --2- 172.21.15.50:0/2114655544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5624004d40 0x7f56240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.411+0000 7f563ad9d640 1 -- 172.21.15.50:0/2114655544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f563c162ab0 msgr2=0x7f5624004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.411+0000 7f563ad9d640 1 --2- 172.21.15.50:0/2114655544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f563c162ab0 0x7f5624004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.411+0000 7f563ad9d640 1 -- 172.21.15.50:0/2114655544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5624004d40 msgr2=0x7f56240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.411+0000 7f563ad9d640 1 --2- 172.21.15.50:0/2114655544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5624004d40 0x7f56240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.411+0000 7f563ad9d640 1 -- 172.21.15.50:0/2114655544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5624003520 con 0x7f56240039b0 2024-09-11T22:20:52.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.411+0000 7f563b59e640 1 --2- 172.21.15.50:0/2114655544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5624004d40 0x7f56240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.412+0000 7f563ad9d640 1 --2- 172.21.15.50:0/2114655544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56240039b0 0x7f5624003dd0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f562c009ac0 tx=0x7f5624005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c345ca1d28c0830 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.412+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c036070 con 0x7f56240039b0 2024-09-11T22:20:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.412+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f562c031400 con 0x7f56240039b0 2024-09-11T22:20:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.412+0000 7f5639d9b640 1 -- 172.21.15.50:0/2114655544 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c009690 con 0x7f56240039b0 2024-09-11T22:20:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.412+0000 7f5641001640 1 -- 172.21.15.50:0/2114655544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56240039b0 msgr2=0x7f5624003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.412+0000 7f5641001640 1 --2- 172.21.15.50:0/2114655544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56240039b0 0x7f5624003dd0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f562c009ac0 tx=0x7f5624005830 comp rx=0 tx=0).stop 2024-09-11T22:20:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.412+0000 7f563b59e640 1 -- 172.21.15.50:0/2114655544 reap_dead start 2024-09-11T22:20:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.412+0000 7f5641001640 1 -- 172.21.15.50:0/2114655544 shutdown_connections 2024-09-11T22:20:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.412+0000 7f5641001640 1 -- 172.21.15.50:0/2114655544 >> 172.21.15.50:0/2114655544 conn(0x7f563c0723b0 msgr2=0x7f563c0727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.412+0000 7f5641001640 1 -- 172.21.15.50:0/2114655544 shutdown_connections 2024-09-11T22:20:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.412+0000 7f5641001640 1 -- 172.21.15.50:0/2114655544 wait complete. 2024-09-11T22:20:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.414+0000 7f5641001640 1 Processor -- start 2024-09-11T22:20:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.414+0000 7f5641001640 1 -- start start 2024-09-11T22:20:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.414+0000 7f5641001640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56240039b0 0x7f563c1f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.414+0000 7f5641001640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f563c1f4fc0 0x7f563c1613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.414+0000 7f5641001640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f563c161900 0x7f563c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.414+0000 7f5641001640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f563c0d3bd0 con 0x7f563c1f4fc0 2024-09-11T22:20:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.414+0000 7f5641001640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f563c0cfc20 con 0x7f563c161900 2024-09-11T22:20:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.414+0000 7f5641001640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f563c0d3d50 con 0x7f56240039b0 2024-09-11T22:20:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f563a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f563c1f4fc0 0x7f563c1613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f563a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f563c1f4fc0 0x7f563c1613c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36912/0 (socket says 172.21.15.50:36912) 2024-09-11T22:20:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f563a59c640 1 -- 172.21.15.50:0/690530746 learned_addr learned my addr 172.21.15.50:0/690530746 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f563ad9d640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56240039b0 0x7f563c1f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f563b59e640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f563c161900 0x7f563c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f563a59c640 1 -- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56240039b0 msgr2=0x7f563c1f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f563a59c640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56240039b0 0x7f563c1f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f563a59c640 1 -- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f563c161900 msgr2=0x7f563c0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f563a59c640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f563c161900 0x7f563c0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f563a59c640 1 -- 172.21.15.50:0/690530746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c0cb850 con 0x7f563c1f4fc0 2024-09-11T22:20:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f563a59c640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f563c1f4fc0 0x7f563c1613c0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f5630011910 tx=0x7f5630011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f56237fe640 1 -- 172.21.15.50:0/690530746 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563000fa30 con 0x7f563c1f4fc0 2024-09-11T22:20:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f56237fe640 1 -- 172.21.15.50:0/690530746 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563000fbd0 con 0x7f563c1f4fc0 2024-09-11T22:20:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f56237fe640 1 -- 172.21.15.50:0/690530746 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630014440 con 0x7f563c1f4fc0 2024-09-11T22:20:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f5641001640 1 -- 172.21.15.50:0/690530746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f563c0cbb30 con 0x7f563c1f4fc0 2024-09-11T22:20:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.415+0000 7f5641001640 1 -- 172.21.15.50:0/690530746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f563c0cc0f0 con 0x7f563c1f4fc0 2024-09-11T22:20:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.416+0000 7f5641001640 1 -- 172.21.15.50:0/690530746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f563c0ced30 con 0x7f563c1f4fc0 2024-09-11T22:20:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.417+0000 7f56237fe640 1 -- 172.21.15.50:0/690530746 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5630012040 con 0x7f563c1f4fc0 2024-09-11T22:20:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.417+0000 7f56237fe640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f562806be30 0x7f562806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.417+0000 7f56237fe640 1 -- 172.21.15.50:0/690530746 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f563008b420 con 0x7f563c1f4fc0 2024-09-11T22:20:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.418+0000 7f563ad9d640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f562806be30 0x7f562806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.418+0000 7f563ad9d640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f562806be30 0x7f562806e2f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f562c033000 tx=0x7f562c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.422+0000 7f56237fe640 1 -- 172.21.15.50:0/690530746 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5630019030 con 0x7f563c1f4fc0 2024-09-11T22:20:52.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.593+0000 7f5641001640 1 -- 172.21.15.50:0/690530746 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f563c0ba660 con 0x7f562806be30 2024-09-11T22:20:52.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.600+0000 7f56237fe640 1 -- 172.21.15.50:0/690530746 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251403 (secure 0 0 0) 0x7f563c0ba660 con 0x7f562806be30 2024-09-11T22:20:52.603 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:52.605 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:20:52.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.603+0000 7f5641001640 1 -- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f562806be30 msgr2=0x7f562806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.603+0000 7f5641001640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f562806be30 0x7f562806e2f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f562c033000 tx=0x7f562c008030 comp rx=0 tx=0).stop 2024-09-11T22:20:52.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.603+0000 7f5641001640 1 -- 172.21.15.50:0/690530746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f563c1f4fc0 msgr2=0x7f563c1613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.603+0000 7f5641001640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f563c1f4fc0 0x7f563c1613c0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f5630011910 tx=0x7f5630011d10 comp rx=0 tx=0).stop 2024-09-11T22:20:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.603+0000 7f5641001640 1 -- 172.21.15.50:0/690530746 shutdown_connections 2024-09-11T22:20:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.603+0000 7f5641001640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f562806be30 0x7f562806e2f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.603+0000 7f5641001640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f563c161900 0x7f563c0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.603+0000 7f5641001640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f563c1f4fc0 0x7f563c1613c0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.603+0000 7f5641001640 1 --2- 172.21.15.50:0/690530746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56240039b0 0x7f563c1f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.603+0000 7f5641001640 1 -- 172.21.15.50:0/690530746 >> 172.21.15.50:0/690530746 conn(0x7f563c0723b0 msgr2=0x7f563c0b8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.603+0000 7f5641001640 1 -- 172.21.15.50:0/690530746 shutdown_connections 2024-09-11T22:20:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.603+0000 7f5641001640 1 -- 172.21.15.50:0/690530746 wait complete. 2024-09-11T22:20:52.615 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2024-09-11T22:20:51.503673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592126,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":443424,"kb_used_data":16232,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754531296,"statfs":{"total":773094113280,"available":772640047104,"internally_reserved":0,"allocated":16621568,"data_stored":7929250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1758,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.216173"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:20:48.281278+0000","last_change":"2024-09-11T22:20:48.281278+0000","last_active":"2024-09-11T22:20:48.281278+0000","last_peered":"2024-09-11T22:20:48.281278+0000","last_clean":"2024-09-11T22:20:48.281278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:48.281278+0000","last_undegraded":"2024-09-11T22:20:48.281278+0000","last_fullsized":"2024-09-11T22:20:48.281278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.258256+0000","last_change":"2024-09-11T22:20:49.256687+0000","last_active":"2024-09-11T22:20:49.258256+0000","last_peered":"2024-09-11T22:20:49.258256+0000","last_clean":"2024-09-11T22:20:49.258256+0000","last_became_active":"2024-09-11T22:20:49.255413+0000","last_became_peered":"2024-09-11T22:20:49.255413+0000","last_unstale":"2024-09-11T22:20:49.258256+0000","last_undegraded":"2024-09-11T22:20:49.258256+0000","last_fullsized":"2024-09-11T22:20:49.258256+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:12.487278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261672+0000","last_change":"2024-09-11T22:20:49.259480+0000","last_active":"2024-09-11T22:20:49.261672+0000","last_peered":"2024-09-11T22:20:49.261672+0000","last_clean":"2024-09-11T22:20:49.261672+0000","last_became_active":"2024-09-11T22:20:49.259173+0000","last_became_peered":"2024-09-11T22:20:49.259173+0000","last_unstale":"2024-09-11T22:20:49.261672+0000","last_undegraded":"2024-09-11T22:20:49.261672+0000","last_fullsized":"2024-09-11T22:20:49.261672+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:18.167932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262191+0000","last_change":"2024-09-11T22:20:49.255277+0000","last_active":"2024-09-11T22:20:49.262191+0000","last_peered":"2024-09-11T22:20:49.262191+0000","last_clean":"2024-09-11T22:20:49.262191+0000","last_became_active":"2024-09-11T22:20:49.254171+0000","last_became_peered":"2024-09-11T22:20:49.254171+0000","last_unstale":"2024-09-11T22:20:49.262191+0000","last_undegraded":"2024-09-11T22:20:49.262191+0000","last_fullsized":"2024-09-11T22:20:49.262191+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:40:51.621945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.258094+0000","last_change":"2024-09-11T22:20:49.256296+0000","last_active":"2024-09-11T22:20:49.258094+0000","last_peered":"2024-09-11T22:20:49.258094+0000","last_clean":"2024-09-11T22:20:49.258094+0000","last_became_active":"2024-09-11T22:20:49.255999+0000","last_became_peered":"2024-09-11T22:20:49.255999+0000","last_unstale":"2024-09-11T22:20:49.258094+0000","last_undegraded":"2024-09-11T22:20:49.258094+0000","last_fullsized":"2024-09-11T22:20:49.258094+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:37.475609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433430+0000","last_change":"2024-09-11T22:20:49.257008+0000","last_active":"2024-09-11T22:20:50.433430+0000","last_peered":"2024-09-11T22:20:50.433430+0000","last_clean":"2024-09-11T22:20:50.433430+0000","last_became_active":"2024-09-11T22:20:49.256658+0000","last_became_peered":"2024-09-11T22:20:49.256658+0000","last_unstale":"2024-09-11T22:20:50.433430+0000","last_undegraded":"2024-09-11T22:20:50.433430+0000","last_fullsized":"2024-09-11T22:20:50.433430+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:38.632671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261461+0000","last_change":"2024-09-11T22:20:49.259937+0000","last_active":"2024-09-11T22:20:49.261461+0000","last_peered":"2024-09-11T22:20:49.261461+0000","last_clean":"2024-09-11T22:20:49.261461+0000","last_became_active":"2024-09-11T22:20:49.259497+0000","last_became_peered":"2024-09-11T22:20:49.259497+0000","last_unstale":"2024-09-11T22:20:49.261461+0000","last_undegraded":"2024-09-11T22:20:49.261461+0000","last_fullsized":"2024-09-11T22:20:49.261461+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:44.823149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257042+0000","last_change":"2024-09-11T22:20:49.254113+0000","last_active":"2024-09-11T22:20:49.257042+0000","last_peered":"2024-09-11T22:20:49.257042+0000","last_clean":"2024-09-11T22:20:49.257042+0000","last_became_active":"2024-09-11T22:20:49.253821+0000","last_became_peered":"2024-09-11T22:20:49.253821+0000","last_unstale":"2024-09-11T22:20:49.257042+0000","last_undegraded":"2024-09-11T22:20:49.257042+0000","last_fullsized":"2024-09-11T22:20:49.257042+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:08.830514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257641+0000","last_change":"2024-09-11T22:20:49.256195+0000","last_active":"2024-09-11T22:20:49.257641+0000","last_peered":"2024-09-11T22:20:49.257641+0000","last_clean":"2024-09-11T22:20:49.257641+0000","last_became_active":"2024-09-11T22:20:49.255711+0000","last_became_peered":"2024-09-11T22:20:49.255711+0000","last_unstale":"2024-09-11T22:20:49.257641+0000","last_undegraded":"2024-09-11T22:20:49.257641+0000","last_fullsized":"2024-09-11T22:20:49.257641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:38.939177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.252003+0000","last_change":"2024-09-11T22:20:49.249631+0000","last_active":"2024-09-11T22:20:49.252003+0000","last_peered":"2024-09-11T22:20:49.252003+0000","last_clean":"2024-09-11T22:20:49.252003+0000","last_became_active":"2024-09-11T22:20:49.249320+0000","last_became_peered":"2024-09-11T22:20:49.249320+0000","last_unstale":"2024-09-11T22:20:49.252003+0000","last_undegraded":"2024-09-11T22:20:49.252003+0000","last_fullsized":"2024-09-11T22:20:49.252003+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:26.278211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.258132+0000","last_change":"2024-09-11T22:20:49.257141+0000","last_active":"2024-09-11T22:20:49.258132+0000","last_peered":"2024-09-11T22:20:49.258132+0000","last_clean":"2024-09-11T22:20:49.258132+0000","last_became_active":"2024-09-11T22:20:49.256842+0000","last_became_peered":"2024-09-11T22:20:49.256842+0000","last_unstale":"2024-09-11T22:20:49.258132+0000","last_undegraded":"2024-09-11T22:20:49.258132+0000","last_fullsized":"2024-09-11T22:20:49.258132+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:24.667187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257576+0000","last_change":"2024-09-11T22:20:49.255216+0000","last_active":"2024-09-11T22:20:49.257576+0000","last_peered":"2024-09-11T22:20:49.257576+0000","last_clean":"2024-09-11T22:20:49.257576+0000","last_became_active":"2024-09-11T22:20:49.253715+0000","last_became_peered":"2024-09-11T22:20:49.253715+0000","last_unstale":"2024-09-11T22:20:49.257576+0000","last_undegraded":"2024-09-11T22:20:49.257576+0000","last_fullsized":"2024-09-11T22:20:49.257576+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:20.358674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256760+0000","last_change":"2024-09-11T22:20:49.252882+0000","last_active":"2024-09-11T22:20:49.256760+0000","last_peered":"2024-09-11T22:20:49.256760+0000","last_clean":"2024-09-11T22:20:49.256760+0000","last_became_active":"2024-09-11T22:20:49.252605+0000","last_became_peered":"2024-09-11T22:20:49.252605+0000","last_unstale":"2024-09-11T22:20:49.256760+0000","last_undegraded":"2024-09-11T22:20:49.256760+0000","last_fullsized":"2024-09-11T22:20:49.256760+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:34:50.130283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256719+0000","last_change":"2024-09-11T22:20:49.253678+0000","last_active":"2024-09-11T22:20:49.256719+0000","last_peered":"2024-09-11T22:20:49.256719+0000","last_clean":"2024-09-11T22:20:49.256719+0000","last_became_active":"2024-09-11T22:20:49.253341+0000","last_became_peered":"2024-09-11T22:20:49.253341+0000","last_unstale":"2024-09-11T22:20:49.256719+0000","last_undegraded":"2024-09-11T22:20:49.256719+0000","last_fullsized":"2024-09-11T22:20:49.256719+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.774600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:20:48.281278+0000","last_change":"2024-09-11T22:20:48.281278+0000","last_active":"2024-09-11T22:20:48.281278+0000","last_peered":"2024-09-11T22:20:48.281278+0000","last_clean":"2024-09-11T22:20:48.281278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:48.281278+0000","last_undegraded":"2024-09-11T22:20:48.281278+0000","last_fullsized":"2024-09-11T22:20:48.281278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261360+0000","last_change":"2024-09-11T22:20:49.260060+0000","last_active":"2024-09-11T22:20:49.261360+0000","last_peered":"2024-09-11T22:20:49.261360+0000","last_clean":"2024-09-11T22:20:49.261360+0000","last_became_active":"2024-09-11T22:20:49.259343+0000","last_became_peered":"2024-09-11T22:20:49.259343+0000","last_unstale":"2024-09-11T22:20:49.261360+0000","last_undegraded":"2024-09-11T22:20:49.261360+0000","last_fullsized":"2024-09-11T22:20:49.261360+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433734+0000","last_change":"2024-09-11T22:20:49.256020+0000","last_active":"2024-09-11T22:20:50.433734+0000","last_peered":"2024-09-11T22:20:50.433734+0000","last_clean":"2024-09-11T22:20:50.433734+0000","last_became_active":"2024-09-11T22:20:49.255719+0000","last_became_peered":"2024-09-11T22:20:49.255719+0000","last_unstale":"2024-09-11T22:20:50.433734+0000","last_undegraded":"2024-09-11T22:20:50.433734+0000","last_fullsized":"2024-09-11T22:20:50.433734+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:14.287208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255186+0000","last_change":"2024-09-11T22:20:49.252133+0000","last_active":"2024-09-11T22:20:49.255186+0000","last_peered":"2024-09-11T22:20:49.255186+0000","last_clean":"2024-09-11T22:20:49.255186+0000","last_became_active":"2024-09-11T22:20:49.251795+0000","last_became_peered":"2024-09-11T22:20:49.251795+0000","last_unstale":"2024-09-11T22:20:49.255186+0000","last_undegraded":"2024-09-11T22:20:49.255186+0000","last_fullsized":"2024-09-11T22:20:49.255186+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:59.356235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433641+0000","last_change":"2024-09-11T22:20:49.260981+0000","last_active":"2024-09-11T22:20:50.433641+0000","last_peered":"2024-09-11T22:20:50.433641+0000","last_clean":"2024-09-11T22:20:50.433641+0000","last_became_active":"2024-09-11T22:20:49.260597+0000","last_became_peered":"2024-09-11T22:20:49.260597+0000","last_unstale":"2024-09-11T22:20:50.433641+0000","last_undegraded":"2024-09-11T22:20:50.433641+0000","last_fullsized":"2024-09-11T22:20:50.433641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:36.018303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.260611+0000","last_change":"2024-09-11T22:20:49.254914+0000","last_active":"2024-09-11T22:20:49.260611+0000","last_peered":"2024-09-11T22:20:49.260611+0000","last_clean":"2024-09-11T22:20:49.260611+0000","last_became_active":"2024-09-11T22:20:49.254597+0000","last_became_peered":"2024-09-11T22:20:49.254597+0000","last_unstale":"2024-09-11T22:20:49.260611+0000","last_undegraded":"2024-09-11T22:20:49.260611+0000","last_fullsized":"2024-09-11T22:20:49.260611+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:43.034095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433366+0000","last_change":"2024-09-11T22:20:49.258117+0000","last_active":"2024-09-11T22:20:50.433366+0000","last_peered":"2024-09-11T22:20:50.433366+0000","last_clean":"2024-09-11T22:20:50.433366+0000","last_became_active":"2024-09-11T22:20:49.257806+0000","last_became_peered":"2024-09-11T22:20:49.257806+0000","last_unstale":"2024-09-11T22:20:50.433366+0000","last_undegraded":"2024-09-11T22:20:50.433366+0000","last_fullsized":"2024-09-11T22:20:50.433366+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:20.317862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255549+0000","last_change":"2024-09-11T22:20:49.251616+0000","last_active":"2024-09-11T22:20:49.255549+0000","last_peered":"2024-09-11T22:20:49.255549+0000","last_clean":"2024-09-11T22:20:49.255549+0000","last_became_active":"2024-09-11T22:20:49.250819+0000","last_became_peered":"2024-09-11T22:20:49.250819+0000","last_unstale":"2024-09-11T22:20:49.255549+0000","last_undegraded":"2024-09-11T22:20:49.255549+0000","last_fullsized":"2024-09-11T22:20:49.255549+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:06.751192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433478+0000","last_change":"2024-09-11T22:20:49.258445+0000","last_active":"2024-09-11T22:20:50.433478+0000","last_peered":"2024-09-11T22:20:50.433478+0000","last_clean":"2024-09-11T22:20:50.433478+0000","last_became_active":"2024-09-11T22:20:49.258097+0000","last_became_peered":"2024-09-11T22:20:49.258097+0000","last_unstale":"2024-09-11T22:20:50.433478+0000","last_undegraded":"2024-09-11T22:20:50.433478+0000","last_fullsized":"2024-09-11T22:20:50.433478+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:24.802538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.250639+0000","last_change":"2024-09-11T22:20:49.248979+0000","last_active":"2024-09-11T22:20:49.250639+0000","last_peered":"2024-09-11T22:20:49.250639+0000","last_clean":"2024-09-11T22:20:49.250639+0000","last_became_active":"2024-09-11T22:20:49.248650+0000","last_became_peered":"2024-09-11T22:20:49.248650+0000","last_unstale":"2024-09-11T22:20:49.250639+0000","last_undegraded":"2024-09-11T22:20:49.250639+0000","last_fullsized":"2024-09-11T22:20:49.250639+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:21.294375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261194+0000","last_change":"2024-09-11T22:20:49.257680+0000","last_active":"2024-09-11T22:20:49.261194+0000","last_peered":"2024-09-11T22:20:49.261194+0000","last_clean":"2024-09-11T22:20:49.261194+0000","last_became_active":"2024-09-11T22:20:49.257402+0000","last_became_peered":"2024-09-11T22:20:49.257402+0000","last_unstale":"2024-09-11T22:20:49.261194+0000","last_undegraded":"2024-09-11T22:20:49.261194+0000","last_fullsized":"2024-09-11T22:20:49.261194+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:04.776287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261300+0000","last_change":"2024-09-11T22:20:49.253221+0000","last_active":"2024-09-11T22:20:49.261300+0000","last_peered":"2024-09-11T22:20:49.261300+0000","last_clean":"2024-09-11T22:20:49.261300+0000","last_became_active":"2024-09-11T22:20:49.252517+0000","last_became_peered":"2024-09-11T22:20:49.252517+0000","last_unstale":"2024-09-11T22:20:49.261300+0000","last_undegraded":"2024-09-11T22:20:49.261300+0000","last_fullsized":"2024-09-11T22:20:49.261300+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:35.695376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.263489+0000","last_change":"2024-09-11T22:20:49.263087+0000","last_active":"2024-09-11T22:20:49.263489+0000","last_peered":"2024-09-11T22:20:49.263489+0000","last_clean":"2024-09-11T22:20:49.263489+0000","last_became_active":"2024-09-11T22:20:49.262855+0000","last_became_peered":"2024-09-11T22:20:49.262855+0000","last_unstale":"2024-09-11T22:20:49.263489+0000","last_undegraded":"2024-09-11T22:20:49.263489+0000","last_fullsized":"2024-09-11T22:20:49.263489+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:34.118858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262208+0000","last_change":"2024-09-11T22:20:49.257721+0000","last_active":"2024-09-11T22:20:49.262208+0000","last_peered":"2024-09-11T22:20:49.262208+0000","last_clean":"2024-09-11T22:20:49.262208+0000","last_became_active":"2024-09-11T22:20:49.257445+0000","last_became_peered":"2024-09-11T22:20:49.257445+0000","last_unstale":"2024-09-11T22:20:49.262208+0000","last_undegraded":"2024-09-11T22:20:49.262208+0000","last_fullsized":"2024-09-11T22:20:49.262208+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:19.202899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.247561+0000","last_change":"2024-09-11T22:20:49.246147+0000","last_active":"2024-09-11T22:20:49.247561+0000","last_peered":"2024-09-11T22:20:49.247561+0000","last_clean":"2024-09-11T22:20:49.247561+0000","last_became_active":"2024-09-11T22:20:49.245562+0000","last_became_peered":"2024-09-11T22:20:49.245562+0000","last_unstale":"2024-09-11T22:20:49.247561+0000","last_undegraded":"2024-09-11T22:20:49.247561+0000","last_fullsized":"2024-09-11T22:20:49.247561+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:10.816175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261176+0000","last_change":"2024-09-11T22:20:49.257292+0000","last_active":"2024-09-11T22:20:49.261176+0000","last_peered":"2024-09-11T22:20:49.261176+0000","last_clean":"2024-09-11T22:20:49.261176+0000","last_became_active":"2024-09-11T22:20:49.257017+0000","last_became_peered":"2024-09-11T22:20:49.257017+0000","last_unstale":"2024-09-11T22:20:49.261176+0000","last_undegraded":"2024-09-11T22:20:49.261176+0000","last_fullsized":"2024-09-11T22:20:49.261176+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:42.578739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261718+0000","last_change":"2024-09-11T22:20:49.260855+0000","last_active":"2024-09-11T22:20:49.261718+0000","last_peered":"2024-09-11T22:20:49.261718+0000","last_clean":"2024-09-11T22:20:49.261718+0000","last_became_active":"2024-09-11T22:20:49.260572+0000","last_became_peered":"2024-09-11T22:20:49.260572+0000","last_unstale":"2024-09-11T22:20:49.261718+0000","last_undegraded":"2024-09-11T22:20:49.261718+0000","last_fullsized":"2024-09-11T22:20:49.261718+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:21.343711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255735+0000","last_change":"2024-09-11T22:20:49.253506+0000","last_active":"2024-09-11T22:20:49.255735+0000","last_peered":"2024-09-11T22:20:49.255735+0000","last_clean":"2024-09-11T22:20:49.255735+0000","last_became_active":"2024-09-11T22:20:49.253215+0000","last_became_peered":"2024-09-11T22:20:49.253215+0000","last_unstale":"2024-09-11T22:20:49.255735+0000","last_undegraded":"2024-09-11T22:20:49.255735+0000","last_fullsized":"2024-09-11T22:20:49.255735+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:18.404645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261321+0000","last_change":"2024-09-11T22:20:49.253239+0000","last_active":"2024-09-11T22:20:49.261321+0000","last_peered":"2024-09-11T22:20:49.261321+0000","last_clean":"2024-09-11T22:20:49.261321+0000","last_became_active":"2024-09-11T22:20:49.252953+0000","last_became_peered":"2024-09-11T22:20:49.252953+0000","last_unstale":"2024-09-11T22:20:49.261321+0000","last_undegraded":"2024-09-11T22:20:49.261321+0000","last_fullsized":"2024-09-11T22:20:49.261321+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:57.132602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.289517+0000","last_change":"2024-09-11T22:20:47.289517+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.289517+0000","last_undegraded":"2024-09-11T22:20:47.289517+0000","last_fullsized":"2024-09-11T22:20:47.289517+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261197+0000","last_change":"2024-09-11T22:20:49.256402+0000","last_active":"2024-09-11T22:20:49.261197+0000","last_peered":"2024-09-11T22:20:49.261197+0000","last_clean":"2024-09-11T22:20:49.261197+0000","last_became_active":"2024-09-11T22:20:49.256119+0000","last_became_peered":"2024-09-11T22:20:49.256119+0000","last_unstale":"2024-09-11T22:20:49.261197+0000","last_undegraded":"2024-09-11T22:20:49.261197+0000","last_fullsized":"2024-09-11T22:20:49.261197+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:31.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296169+0000","last_change":"2024-09-11T22:20:48.301059+0000","last_active":"2024-09-11T22:20:49.296169+0000","last_peered":"2024-09-11T22:20:49.296169+0000","last_clean":"2024-09-11T22:20:49.296169+0000","last_became_active":"2024-09-11T22:20:48.300798+0000","last_became_peered":"2024-09-11T22:20:48.300798+0000","last_unstale":"2024-09-11T22:20:49.296169+0000","last_undegraded":"2024-09-11T22:20:49.296169+0000","last_fullsized":"2024-09-11T22:20:49.296169+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:58.807896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433340+0000","last_change":"2024-09-11T22:20:49.254064+0000","last_active":"2024-09-11T22:20:50.433340+0000","last_peered":"2024-09-11T22:20:50.433340+0000","last_clean":"2024-09-11T22:20:50.433340+0000","last_became_active":"2024-09-11T22:20:49.253755+0000","last_became_peered":"2024-09-11T22:20:49.253755+0000","last_unstale":"2024-09-11T22:20:50.433340+0000","last_undegraded":"2024-09-11T22:20:50.433340+0000","last_fullsized":"2024-09-11T22:20:50.433340+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:32.881230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.298275+0000","last_change":"2024-09-11T22:20:48.305983+0000","last_active":"2024-09-11T22:20:49.298275+0000","last_peered":"2024-09-11T22:20:49.298275+0000","last_clean":"2024-09-11T22:20:49.298275+0000","last_became_active":"2024-09-11T22:20:48.305565+0000","last_became_peered":"2024-09-11T22:20:48.305565+0000","last_unstale":"2024-09-11T22:20:49.298275+0000","last_undegraded":"2024-09-11T22:20:49.298275+0000","last_fullsized":"2024-09-11T22:20:49.298275+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.485401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261649+0000","last_change":"2024-09-11T22:20:49.258388+0000","last_active":"2024-09-11T22:20:49.261649+0000","last_peered":"2024-09-11T22:20:49.261649+0000","last_clean":"2024-09-11T22:20:49.261649+0000","last_became_active":"2024-09-11T22:20:49.258045+0000","last_became_peered":"2024-09-11T22:20:49.258045+0000","last_unstale":"2024-09-11T22:20:49.261649+0000","last_undegraded":"2024-09-11T22:20:49.261649+0000","last_fullsized":"2024-09-11T22:20:49.261649+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:32:05.512930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.299575+0000","last_change":"2024-09-11T22:20:48.307332+0000","last_active":"2024-09-11T22:20:49.299575+0000","last_peered":"2024-09-11T22:20:49.299575+0000","last_clean":"2024-09-11T22:20:49.299575+0000","last_became_active":"2024-09-11T22:20:48.306940+0000","last_became_peered":"2024-09-11T22:20:48.306940+0000","last_unstale":"2024-09-11T22:20:49.299575+0000","last_undegraded":"2024-09-11T22:20:49.299575+0000","last_fullsized":"2024-09-11T22:20:49.299575+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:03.217415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261796+0000","last_change":"2024-09-11T22:20:49.253030+0000","last_active":"2024-09-11T22:20:49.261796+0000","last_peered":"2024-09-11T22:20:49.261796+0000","last_clean":"2024-09-11T22:20:49.261796+0000","last_became_active":"2024-09-11T22:20:49.252290+0000","last_became_peered":"2024-09-11T22:20:49.252290+0000","last_unstale":"2024-09-11T22:20:49.261796+0000","last_undegraded":"2024-09-11T22:20:49.261796+0000","last_fullsized":"2024-09-11T22:20:49.261796+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:25.075906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296158+0000","last_change":"2024-09-11T22:20:48.297836+0000","last_active":"2024-09-11T22:20:49.296158+0000","last_peered":"2024-09-11T22:20:49.296158+0000","last_clean":"2024-09-11T22:20:49.296158+0000","last_became_active":"2024-09-11T22:20:48.297270+0000","last_became_peered":"2024-09-11T22:20:48.297270+0000","last_unstale":"2024-09-11T22:20:49.296158+0000","last_undegraded":"2024-09-11T22:20:49.296158+0000","last_fullsized":"2024-09-11T22:20:49.296158+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:26.844219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262374+0000","last_change":"2024-09-11T22:20:49.259041+0000","last_active":"2024-09-11T22:20:49.262374+0000","last_peered":"2024-09-11T22:20:49.262374+0000","last_clean":"2024-09-11T22:20:49.262374+0000","last_became_active":"2024-09-11T22:20:49.256041+0000","last_became_peered":"2024-09-11T22:20:49.256041+0000","last_unstale":"2024-09-11T22:20:49.262374+0000","last_undegraded":"2024-09-11T22:20:49.262374+0000","last_fullsized":"2024-09-11T22:20:49.262374+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:21.423018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296841+0000","last_change":"2024-09-11T22:20:48.302454+0000","last_active":"2024-09-11T22:20:49.296841+0000","last_peered":"2024-09-11T22:20:49.296841+0000","last_clean":"2024-09-11T22:20:49.296841+0000","last_became_active":"2024-09-11T22:20:48.302149+0000","last_became_peered":"2024-09-11T22:20:48.302149+0000","last_unstale":"2024-09-11T22:20:49.296841+0000","last_undegraded":"2024-09-11T22:20:49.296841+0000","last_fullsized":"2024-09-11T22:20:49.296841+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:23.665309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257311+0000","last_change":"2024-09-11T22:20:49.253425+0000","last_active":"2024-09-11T22:20:49.257311+0000","last_peered":"2024-09-11T22:20:49.257311+0000","last_clean":"2024-09-11T22:20:49.257311+0000","last_became_active":"2024-09-11T22:20:49.252711+0000","last_became_peered":"2024-09-11T22:20:49.252711+0000","last_unstale":"2024-09-11T22:20:49.257311+0000","last_undegraded":"2024-09-11T22:20:49.257311+0000","last_fullsized":"2024-09-11T22:20:49.257311+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:42.578739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.242628+0000","last_change":"2024-09-11T22:20:48.305247+0000","last_active":"2024-09-11T22:20:49.242628+0000","last_peered":"2024-09-11T22:20:49.242628+0000","last_clean":"2024-09-11T22:20:49.242628+0000","last_became_active":"2024-09-11T22:20:48.304920+0000","last_became_peered":"2024-09-11T22:20:48.304920+0000","last_unstale":"2024-09-11T22:20:49.242628+0000","last_undegraded":"2024-09-11T22:20:49.242628+0000","last_fullsized":"2024-09-11T22:20:49.242628+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:33.116980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433383+0000","last_change":"2024-09-11T22:20:49.257648+0000","last_active":"2024-09-11T22:20:50.433383+0000","last_peered":"2024-09-11T22:20:50.433383+0000","last_clean":"2024-09-11T22:20:50.433383+0000","last_became_active":"2024-09-11T22:20:49.257084+0000","last_became_peered":"2024-09-11T22:20:49.257084+0000","last_unstale":"2024-09-11T22:20:50.433383+0000","last_undegraded":"2024-09-11T22:20:50.433383+0000","last_fullsized":"2024-09-11T22:20:50.433383+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.426141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.245222+0000","last_change":"2024-09-11T22:20:48.295595+0000","last_active":"2024-09-11T22:20:49.245222+0000","last_peered":"2024-09-11T22:20:49.245222+0000","last_clean":"2024-09-11T22:20:49.245222+0000","last_became_active":"2024-09-11T22:20:48.295384+0000","last_became_peered":"2024-09-11T22:20:48.295384+0000","last_unstale":"2024-09-11T22:20:49.245222+0000","last_undegraded":"2024-09-11T22:20:49.245222+0000","last_fullsized":"2024-09-11T22:20:49.245222+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:30.293105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262154+0000","last_change":"2024-09-11T22:20:49.261199+0000","last_active":"2024-09-11T22:20:49.262154+0000","last_peered":"2024-09-11T22:20:49.262154+0000","last_clean":"2024-09-11T22:20:49.262154+0000","last_became_active":"2024-09-11T22:20:49.260923+0000","last_became_peered":"2024-09-11T22:20:49.260923+0000","last_unstale":"2024-09-11T22:20:49.262154+0000","last_undegraded":"2024-09-11T22:20:49.262154+0000","last_fullsized":"2024-09-11T22:20:49.262154+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:58.259369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433655+0000","last_change":"2024-09-11T22:20:48.301853+0000","last_active":"2024-09-11T22:20:50.433655+0000","last_peered":"2024-09-11T22:20:50.433655+0000","last_clean":"2024-09-11T22:20:50.433655+0000","last_became_active":"2024-09-11T22:20:48.301527+0000","last_became_peered":"2024-09-11T22:20:48.301527+0000","last_unstale":"2024-09-11T22:20:50.433655+0000","last_undegraded":"2024-09-11T22:20:50.433655+0000","last_fullsized":"2024-09-11T22:20:50.433655+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:58.041049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.254050+0000","last_change":"2024-09-11T22:20:49.251762+0000","last_active":"2024-09-11T22:20:49.254050+0000","last_peered":"2024-09-11T22:20:49.254050+0000","last_clean":"2024-09-11T22:20:49.254050+0000","last_became_active":"2024-09-11T22:20:49.251246+0000","last_became_peered":"2024-09-11T22:20:49.251246+0000","last_unstale":"2024-09-11T22:20:49.254050+0000","last_undegraded":"2024-09-11T22:20:49.254050+0000","last_fullsized":"2024-09-11T22:20:49.254050+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"155'3","reported_seq":17,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433653+0000","last_change":"2024-09-11T22:20:48.300620+0000","last_active":"2024-09-11T22:20:50.433653+0000","last_peered":"2024-09-11T22:20:50.433653+0000","last_clean":"2024-09-11T22:20:50.433653+0000","last_became_active":"2024-09-11T22:20:48.300324+0000","last_became_peered":"2024-09-11T22:20:48.300324+0000","last_unstale":"2024-09-11T22:20:50.433653+0000","last_undegraded":"2024-09-11T22:20:50.433653+0000","last_fullsized":"2024-09-11T22:20:50.433653+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:30.057922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255793+0000","last_change":"2024-09-11T22:20:49.254036+0000","last_active":"2024-09-11T22:20:49.255793+0000","last_peered":"2024-09-11T22:20:49.255793+0000","last_clean":"2024-09-11T22:20:49.255793+0000","last_became_active":"2024-09-11T22:20:49.253188+0000","last_became_peered":"2024-09-11T22:20:49.253188+0000","last_unstale":"2024-09-11T22:20:49.255793+0000","last_undegraded":"2024-09-11T22:20:49.255793+0000","last_fullsized":"2024-09-11T22:20:49.255793+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:24.667187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"155'6","reported_seq":18,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.301030+0000","last_change":"2024-09-11T22:20:48.298730+0000","last_active":"2024-09-11T22:20:49.301030+0000","last_peered":"2024-09-11T22:20:49.301030+0000","last_clean":"2024-09-11T22:20:49.301030+0000","last_became_active":"2024-09-11T22:20:48.297965+0000","last_became_peered":"2024-09-11T22:20:48.297965+0000","last_unstale":"2024-09-11T22:20:49.301030+0000","last_undegraded":"2024-09-11T22:20:49.301030+0000","last_fullsized":"2024-09-11T22:20:49.301030+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.485401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257021+0000","last_change":"2024-09-11T22:20:49.256099+0000","last_active":"2024-09-11T22:20:49.257021+0000","last_peered":"2024-09-11T22:20:49.257021+0000","last_clean":"2024-09-11T22:20:49.257021+0000","last_became_active":"2024-09-11T22:20:49.255825+0000","last_became_peered":"2024-09-11T22:20:49.255825+0000","last_unstale":"2024-09-11T22:20:49.257021+0000","last_undegraded":"2024-09-11T22:20:49.257021+0000","last_fullsized":"2024-09-11T22:20:49.257021+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:04.682427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296612+0000","last_change":"2024-09-11T22:20:48.301519+0000","last_active":"2024-09-11T22:20:49.296612+0000","last_peered":"2024-09-11T22:20:49.296612+0000","last_clean":"2024-09-11T22:20:49.296612+0000","last_became_active":"2024-09-11T22:20:48.301198+0000","last_became_peered":"2024-09-11T22:20:48.301198+0000","last_unstale":"2024-09-11T22:20:49.296612+0000","last_undegraded":"2024-09-11T22:20:49.296612+0000","last_fullsized":"2024-09-11T22:20:49.296612+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:37.937300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261131+0000","last_change":"2024-09-11T22:20:49.253407+0000","last_active":"2024-09-11T22:20:49.261131+0000","last_peered":"2024-09-11T22:20:49.261131+0000","last_clean":"2024-09-11T22:20:49.261131+0000","last_became_active":"2024-09-11T22:20:49.252632+0000","last_became_peered":"2024-09-11T22:20:49.252632+0000","last_unstale":"2024-09-11T22:20:49.261131+0000","last_undegraded":"2024-09-11T22:20:49.261131+0000","last_fullsized":"2024-09-11T22:20:49.261131+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:03.072860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.248005+0000","last_change":"2024-09-11T22:20:48.303180+0000","last_active":"2024-09-11T22:20:49.248005+0000","last_peered":"2024-09-11T22:20:49.248005+0000","last_clean":"2024-09-11T22:20:49.248005+0000","last_became_active":"2024-09-11T22:20:48.302900+0000","last_became_peered":"2024-09-11T22:20:48.302900+0000","last_unstale":"2024-09-11T22:20:49.248005+0000","last_undegraded":"2024-09-11T22:20:49.248005+0000","last_fullsized":"2024-09-11T22:20:49.248005+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:34.148358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262365+0000","last_change":"2024-09-11T22:20:49.253704+0000","last_active":"2024-09-11T22:20:49.262365+0000","last_peered":"2024-09-11T22:20:49.262365+0000","last_clean":"2024-09-11T22:20:49.262365+0000","last_became_active":"2024-09-11T22:20:49.253146+0000","last_became_peered":"2024-09-11T22:20:49.253146+0000","last_unstale":"2024-09-11T22:20:49.262365+0000","last_undegraded":"2024-09-11T22:20:49.262365+0000","last_fullsized":"2024-09-11T22:20:49.262365+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:21.343711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.240529+0000","last_change":"2024-09-11T22:20:48.303425+0000","last_active":"2024-09-11T22:20:49.240529+0000","last_peered":"2024-09-11T22:20:49.240529+0000","last_clean":"2024-09-11T22:20:49.240529+0000","last_became_active":"2024-09-11T22:20:48.303149+0000","last_became_peered":"2024-09-11T22:20:48.303149+0000","last_unstale":"2024-09-11T22:20:49.240529+0000","last_undegraded":"2024-09-11T22:20:49.240529+0000","last_fullsized":"2024-09-11T22:20:49.240529+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:07.828637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261428+0000","last_change":"2024-09-11T22:20:49.259624+0000","last_active":"2024-09-11T22:20:49.261428+0000","last_peered":"2024-09-11T22:20:49.261428+0000","last_clean":"2024-09-11T22:20:49.261428+0000","last_became_active":"2024-09-11T22:20:49.259313+0000","last_became_peered":"2024-09-11T22:20:49.259313+0000","last_unstale":"2024-09-11T22:20:49.261428+0000","last_undegraded":"2024-09-11T22:20:49.261428+0000","last_fullsized":"2024-09-11T22:20:49.261428+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.591169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"155'8","reported_seq":20,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.299630+0000","last_change":"2024-09-11T22:20:48.298368+0000","last_active":"2024-09-11T22:20:49.299630+0000","last_peered":"2024-09-11T22:20:49.299630+0000","last_clean":"2024-09-11T22:20:49.299630+0000","last_became_active":"2024-09-11T22:20:48.298080+0000","last_became_peered":"2024-09-11T22:20:48.298080+0000","last_unstale":"2024-09-11T22:20:49.299630+0000","last_undegraded":"2024-09-11T22:20:49.299630+0000","last_fullsized":"2024-09-11T22:20:49.299630+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:19.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257415+0000","last_change":"2024-09-11T22:20:49.253099+0000","last_active":"2024-09-11T22:20:49.257415+0000","last_peered":"2024-09-11T22:20:49.257415+0000","last_clean":"2024-09-11T22:20:49.257415+0000","last_became_active":"2024-09-11T22:20:49.252746+0000","last_became_peered":"2024-09-11T22:20:49.252746+0000","last_unstale":"2024-09-11T22:20:49.257415+0000","last_undegraded":"2024-09-11T22:20:49.257415+0000","last_fullsized":"2024-09-11T22:20:49.257415+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:31.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.297661+0000","last_change":"2024-09-11T22:20:48.303794+0000","last_active":"2024-09-11T22:20:49.297661+0000","last_peered":"2024-09-11T22:20:49.297661+0000","last_clean":"2024-09-11T22:20:49.297661+0000","last_became_active":"2024-09-11T22:20:48.303490+0000","last_became_peered":"2024-09-11T22:20:48.303490+0000","last_unstale":"2024-09-11T22:20:49.297661+0000","last_undegraded":"2024-09-11T22:20:49.297661+0000","last_fullsized":"2024-09-11T22:20:49.297661+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:45.138609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261362+0000","last_change":"2024-09-11T22:20:49.257754+0000","last_active":"2024-09-11T22:20:49.261362+0000","last_peered":"2024-09-11T22:20:49.261362+0000","last_clean":"2024-09-11T22:20:49.261362+0000","last_became_active":"2024-09-11T22:20:49.257472+0000","last_became_peered":"2024-09-11T22:20:49.257472+0000","last_unstale":"2024-09-11T22:20:49.261362+0000","last_undegraded":"2024-09-11T22:20:49.261362+0000","last_fullsized":"2024-09-11T22:20:49.261362+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:12.702105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.297285+0000","last_change":"2024-09-11T22:20:48.299954+0000","last_active":"2024-09-11T22:20:49.297285+0000","last_peered":"2024-09-11T22:20:49.297285+0000","last_clean":"2024-09-11T22:20:49.297285+0000","last_became_active":"2024-09-11T22:20:48.299637+0000","last_became_peered":"2024-09-11T22:20:48.299637+0000","last_unstale":"2024-09-11T22:20:49.297285+0000","last_undegraded":"2024-09-11T22:20:49.297285+0000","last_fullsized":"2024-09-11T22:20:49.297285+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:57.382973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262167+0000","last_change":"2024-09-11T22:20:49.253982+0000","last_active":"2024-09-11T22:20:49.262167+0000","last_peered":"2024-09-11T22:20:49.262167+0000","last_clean":"2024-09-11T22:20:49.262167+0000","last_became_active":"2024-09-11T22:20:49.253595+0000","last_became_peered":"2024-09-11T22:20:49.253595+0000","last_unstale":"2024-09-11T22:20:49.262167+0000","last_undegraded":"2024-09-11T22:20:49.262167+0000","last_fullsized":"2024-09-11T22:20:49.262167+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:41.858220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.289493+0000","last_change":"2024-09-11T22:20:47.289493+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.289493+0000","last_undegraded":"2024-09-11T22:20:47.289493+0000","last_fullsized":"2024-09-11T22:20:47.289493+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261211+0000","last_change":"2024-09-11T22:20:49.259683+0000","last_active":"2024-09-11T22:20:49.261211+0000","last_peered":"2024-09-11T22:20:49.261211+0000","last_clean":"2024-09-11T22:20:49.261211+0000","last_became_active":"2024-09-11T22:20:49.259311+0000","last_became_peered":"2024-09-11T22:20:49.259311+0000","last_unstale":"2024-09-11T22:20:49.261211+0000","last_undegraded":"2024-09-11T22:20:49.261211+0000","last_fullsized":"2024-09-11T22:20:49.261211+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:35.150235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.288563+0000","last_change":"2024-09-11T22:20:47.288563+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.288563+0000","last_undegraded":"2024-09-11T22:20:47.288563+0000","last_fullsized":"2024-09-11T22:20:47.288563+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256698+0000","last_change":"2024-09-11T22:20:49.252061+0000","last_active":"2024-09-11T22:20:49.256698+0000","last_peered":"2024-09-11T22:20:49.256698+0000","last_clean":"2024-09-11T22:20:49.256698+0000","last_became_active":"2024-09-11T22:20:49.251776+0000","last_became_peered":"2024-09-11T22:20:49.251776+0000","last_unstale":"2024-09-11T22:20:49.256698+0000","last_undegraded":"2024-09-11T22:20:49.256698+0000","last_fullsized":"2024-09-11T22:20:49.256698+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:42.720833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.298359+0000","last_change":"2024-09-11T22:20:48.305063+0000","last_active":"2024-09-11T22:20:49.298359+0000","last_peered":"2024-09-11T22:20:49.298359+0000","last_clean":"2024-09-11T22:20:49.298359+0000","last_became_active":"2024-09-11T22:20:48.304721+0000","last_became_peered":"2024-09-11T22:20:48.304721+0000","last_unstale":"2024-09-11T22:20:49.298359+0000","last_undegraded":"2024-09-11T22:20:49.298359+0000","last_fullsized":"2024-09-11T22:20:49.298359+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:36.473732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261175+0000","last_change":"2024-09-11T22:20:49.258542+0000","last_active":"2024-09-11T22:20:49.261175+0000","last_peered":"2024-09-11T22:20:49.261175+0000","last_clean":"2024-09-11T22:20:49.261175+0000","last_became_active":"2024-09-11T22:20:49.258256+0000","last_became_peered":"2024-09-11T22:20:49.258256+0000","last_unstale":"2024-09-11T22:20:49.261175+0000","last_undegraded":"2024-09-11T22:20:49.261175+0000","last_fullsized":"2024-09-11T22:20:49.261175+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.165270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.288534+0000","last_change":"2024-09-11T22:20:47.288534+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.288534+0000","last_undegraded":"2024-09-11T22:20:47.288534+0000","last_fullsized":"2024-09-11T22:20:47.288534+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:20:48.281278+0000","last_change":"2024-09-11T22:20:48.281278+0000","last_active":"2024-09-11T22:20:48.281278+0000","last_peered":"2024-09-11T22:20:48.281278+0000","last_clean":"2024-09-11T22:20:48.281278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:48.281278+0000","last_undegraded":"2024-09-11T22:20:48.281278+0000","last_fullsized":"2024-09-11T22:20:48.281278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.240672+0000","last_change":"2024-09-11T22:20:48.296080+0000","last_active":"2024-09-11T22:20:49.240672+0000","last_peered":"2024-09-11T22:20:49.240672+0000","last_clean":"2024-09-11T22:20:49.240672+0000","last_became_active":"2024-09-11T22:20:48.295806+0000","last_became_peered":"2024-09-11T22:20:48.295806+0000","last_unstale":"2024-09-11T22:20:49.240672+0000","last_undegraded":"2024-09-11T22:20:49.240672+0000","last_fullsized":"2024-09-11T22:20:49.240672+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:19.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433538+0000","last_change":"2024-09-11T22:20:49.257288+0000","last_active":"2024-09-11T22:20:50.433538+0000","last_peered":"2024-09-11T22:20:50.433538+0000","last_clean":"2024-09-11T22:20:50.433538+0000","last_became_active":"2024-09-11T22:20:49.256626+0000","last_became_peered":"2024-09-11T22:20:49.256626+0000","last_unstale":"2024-09-11T22:20:50.433538+0000","last_undegraded":"2024-09-11T22:20:50.433538+0000","last_fullsized":"2024-09-11T22:20:50.433538+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:53.953093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.288687+0000","last_change":"2024-09-11T22:20:47.288687+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.288687+0000","last_undegraded":"2024-09-11T22:20:47.288687+0000","last_fullsized":"2024-09-11T22:20:47.288687+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255201+0000","last_change":"2024-09-11T22:20:49.252744+0000","last_active":"2024-09-11T22:20:49.255201+0000","last_peered":"2024-09-11T22:20:49.255201+0000","last_clean":"2024-09-11T22:20:49.255201+0000","last_became_active":"2024-09-11T22:20:49.252458+0000","last_became_peered":"2024-09-11T22:20:49.252458+0000","last_unstale":"2024-09-11T22:20:49.255201+0000","last_undegraded":"2024-09-11T22:20:49.255201+0000","last_fullsized":"2024-09-11T22:20:49.255201+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:21.209058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.298270+0000","last_change":"2024-09-11T22:20:48.304158+0000","last_active":"2024-09-11T22:20:49.298270+0000","last_peered":"2024-09-11T22:20:49.298270+0000","last_clean":"2024-09-11T22:20:49.298270+0000","last_became_active":"2024-09-11T22:20:48.303869+0000","last_became_peered":"2024-09-11T22:20:48.303869+0000","last_unstale":"2024-09-11T22:20:49.298270+0000","last_undegraded":"2024-09-11T22:20:49.298270+0000","last_fullsized":"2024-09-11T22:20:49.298270+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:43.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.253562+0000","last_change":"2024-09-11T22:20:49.251765+0000","last_active":"2024-09-11T22:20:49.253562+0000","last_peered":"2024-09-11T22:20:49.253562+0000","last_clean":"2024-09-11T22:20:49.253562+0000","last_became_active":"2024-09-11T22:20:49.251469+0000","last_became_peered":"2024-09-11T22:20:49.251469+0000","last_unstale":"2024-09-11T22:20:49.253562+0000","last_undegraded":"2024-09-11T22:20:49.253562+0000","last_fullsized":"2024-09-11T22:20:49.253562+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:24.119485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.244047+0000","last_change":"2024-09-11T22:20:48.298375+0000","last_active":"2024-09-11T22:20:49.244047+0000","last_peered":"2024-09-11T22:20:49.244047+0000","last_clean":"2024-09-11T22:20:49.244047+0000","last_became_active":"2024-09-11T22:20:48.298114+0000","last_became_peered":"2024-09-11T22:20:48.298114+0000","last_unstale":"2024-09-11T22:20:49.244047+0000","last_undegraded":"2024-09-11T22:20:49.244047+0000","last_fullsized":"2024-09-11T22:20:49.244047+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:56.322627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433535+0000","last_change":"2024-09-11T22:20:49.259942+0000","last_active":"2024-09-11T22:20:50.433535+0000","last_peered":"2024-09-11T22:20:50.433535+0000","last_clean":"2024-09-11T22:20:50.433535+0000","last_became_active":"2024-09-11T22:20:49.259628+0000","last_became_peered":"2024-09-11T22:20:49.259628+0000","last_unstale":"2024-09-11T22:20:50.433535+0000","last_undegraded":"2024-09-11T22:20:50.433535+0000","last_fullsized":"2024-09-11T22:20:50.433535+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:12.697073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.244858+0000","last_change":"2024-09-11T22:20:48.303659+0000","last_active":"2024-09-11T22:20:49.244858+0000","last_peered":"2024-09-11T22:20:49.244858+0000","last_clean":"2024-09-11T22:20:49.244858+0000","last_became_active":"2024-09-11T22:20:48.303369+0000","last_became_peered":"2024-09-11T22:20:48.303369+0000","last_unstale":"2024-09-11T22:20:49.244858+0000","last_undegraded":"2024-09-11T22:20:49.244858+0000","last_fullsized":"2024-09-11T22:20:49.244858+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:51.679794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256985+0000","last_change":"2024-09-11T22:20:49.255571+0000","last_active":"2024-09-11T22:20:49.256985+0000","last_peered":"2024-09-11T22:20:49.256985+0000","last_clean":"2024-09-11T22:20:49.256985+0000","last_became_active":"2024-09-11T22:20:49.255282+0000","last_became_peered":"2024-09-11T22:20:49.255282+0000","last_unstale":"2024-09-11T22:20:49.256985+0000","last_undegraded":"2024-09-11T22:20:49.256985+0000","last_fullsized":"2024-09-11T22:20:49.256985+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:26:15.294230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.246751+0000","last_change":"2024-09-11T22:20:48.300370+0000","last_active":"2024-09-11T22:20:49.246751+0000","last_peered":"2024-09-11T22:20:49.246751+0000","last_clean":"2024-09-11T22:20:49.246751+0000","last_became_active":"2024-09-11T22:20:48.300068+0000","last_became_peered":"2024-09-11T22:20:48.300068+0000","last_unstale":"2024-09-11T22:20:49.246751+0000","last_undegraded":"2024-09-11T22:20:49.246751+0000","last_fullsized":"2024-09-11T22:20:49.246751+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:16.679941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262119+0000","last_change":"2024-09-11T22:20:49.260222+0000","last_active":"2024-09-11T22:20:49.262119+0000","last_peered":"2024-09-11T22:20:49.262119+0000","last_clean":"2024-09-11T22:20:49.262119+0000","last_became_active":"2024-09-11T22:20:49.258826+0000","last_became_peered":"2024-09-11T22:20:49.258826+0000","last_unstale":"2024-09-11T22:20:49.262119+0000","last_undegraded":"2024-09-11T22:20:49.262119+0000","last_fullsized":"2024-09-11T22:20:49.262119+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:48.356663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.253712+0000","last_change":"2024-09-11T22:20:48.296479+0000","last_active":"2024-09-11T22:20:49.253712+0000","last_peered":"2024-09-11T22:20:49.253712+0000","last_clean":"2024-09-11T22:20:49.253712+0000","last_became_active":"2024-09-11T22:20:48.296203+0000","last_became_peered":"2024-09-11T22:20:48.296203+0000","last_unstale":"2024-09-11T22:20:49.253712+0000","last_undegraded":"2024-09-11T22:20:49.253712+0000","last_fullsized":"2024-09-11T22:20:49.253712+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:36.473732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.264693+0000","last_change":"2024-09-11T22:20:49.264327+0000","last_active":"2024-09-11T22:20:49.264693+0000","last_peered":"2024-09-11T22:20:49.264693+0000","last_clean":"2024-09-11T22:20:49.264693+0000","last_became_active":"2024-09-11T22:20:49.264054+0000","last_became_peered":"2024-09-11T22:20:49.264054+0000","last_unstale":"2024-09-11T22:20:49.264693+0000","last_undegraded":"2024-09-11T22:20:49.264693+0000","last_fullsized":"2024-09-11T22:20:49.264693+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:41.858220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.241472+0000","last_change":"2024-09-11T22:20:48.307406+0000","last_active":"2024-09-11T22:20:49.241472+0000","last_peered":"2024-09-11T22:20:49.241472+0000","last_clean":"2024-09-11T22:20:49.241472+0000","last_became_active":"2024-09-11T22:20:48.306853+0000","last_became_peered":"2024-09-11T22:20:48.306853+0000","last_unstale":"2024-09-11T22:20:49.241472+0000","last_undegraded":"2024-09-11T22:20:49.241472+0000","last_fullsized":"2024-09-11T22:20:49.241472+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:58.807896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261340+0000","last_change":"2024-09-11T22:20:49.259551+0000","last_active":"2024-09-11T22:20:49.261340+0000","last_peered":"2024-09-11T22:20:49.261340+0000","last_clean":"2024-09-11T22:20:49.261340+0000","last_became_active":"2024-09-11T22:20:49.258914+0000","last_became_peered":"2024-09-11T22:20:49.258914+0000","last_unstale":"2024-09-11T22:20:49.261340+0000","last_undegraded":"2024-09-11T22:20:49.261340+0000","last_fullsized":"2024-09-11T22:20:49.261340+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:17.681818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.242779+0000","last_change":"2024-09-11T22:20:48.303303+0000","last_active":"2024-09-11T22:20:49.242779+0000","last_peered":"2024-09-11T22:20:49.242779+0000","last_clean":"2024-09-11T22:20:49.242779+0000","last_became_active":"2024-09-11T22:20:48.302954+0000","last_became_peered":"2024-09-11T22:20:48.302954+0000","last_unstale":"2024-09-11T22:20:49.242779+0000","last_undegraded":"2024-09-11T22:20:49.242779+0000","last_fullsized":"2024-09-11T22:20:49.242779+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:53.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261514+0000","last_change":"2024-09-11T22:20:49.260083+0000","last_active":"2024-09-11T22:20:49.261514+0000","last_peered":"2024-09-11T22:20:49.261514+0000","last_clean":"2024-09-11T22:20:49.261514+0000","last_became_active":"2024-09-11T22:20:49.259745+0000","last_became_peered":"2024-09-11T22:20:49.259745+0000","last_unstale":"2024-09-11T22:20:49.261514+0000","last_undegraded":"2024-09-11T22:20:49.261514+0000","last_fullsized":"2024-09-11T22:20:49.261514+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:17.694423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.253141+0000","last_change":"2024-09-11T22:20:48.300845+0000","last_active":"2024-09-11T22:20:49.253141+0000","last_peered":"2024-09-11T22:20:49.253141+0000","last_clean":"2024-09-11T22:20:49.253141+0000","last_became_active":"2024-09-11T22:20:48.298386+0000","last_became_peered":"2024-09-11T22:20:48.298386+0000","last_unstale":"2024-09-11T22:20:49.253141+0000","last_undegraded":"2024-09-11T22:20:49.253141+0000","last_fullsized":"2024-09-11T22:20:49.253141+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:37.937300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262848+0000","last_change":"2024-09-11T22:20:49.261945+0000","last_active":"2024-09-11T22:20:49.262848+0000","last_peered":"2024-09-11T22:20:49.262848+0000","last_clean":"2024-09-11T22:20:49.262848+0000","last_became_active":"2024-09-11T22:20:49.261653+0000","last_became_peered":"2024-09-11T22:20:49.261653+0000","last_unstale":"2024-09-11T22:20:49.262848+0000","last_undegraded":"2024-09-11T22:20:49.262848+0000","last_fullsized":"2024-09-11T22:20:49.262848+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:16.042772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.254831+0000","last_change":"2024-09-11T22:20:48.305326+0000","last_active":"2024-09-11T22:20:49.254831+0000","last_peered":"2024-09-11T22:20:49.254831+0000","last_clean":"2024-09-11T22:20:49.254831+0000","last_became_active":"2024-09-11T22:20:48.305080+0000","last_became_peered":"2024-09-11T22:20:48.305080+0000","last_unstale":"2024-09-11T22:20:49.254831+0000","last_undegraded":"2024-09-11T22:20:49.254831+0000","last_fullsized":"2024-09-11T22:20:49.254831+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:03.217415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":409,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T22:20:47.288350+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:20:47.288350+0000","last_peered":"2024-09-11T22:20:47.288350+0000","last_clean":"2024-09-11T22:20:47.288350+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:20:47.288350+0000","last_undegraded":"2024-09-11T22:20:47.288350+0000","last_fullsized":"2024-09-11T22:20:47.288350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":122,"acting":122,"num_store_stats":7},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":1758,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51124,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320716,"statfs":{"total":96636764160,"available":96584413184,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509559,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46956,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324884,"statfs":{"total":96636764160,"available":96588681216,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509561,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55304,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316536,"statfs":{"total":96636764160,"available":96580132864,"internally_reserved":0,"allocated":1953792,"data_stored":850830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59444,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312396,"statfs":{"total":96636764160,"available":96575893504,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63596,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308244,"statfs":{"total":96636764160,"available":96571641856,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509560,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55864,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315976,"statfs":{"total":96636764160,"available":96579559424,"internally_reserved":0,"allocated":2519040,"data_stored":1432741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51672,"kb_used_data":2436,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320168,"statfs":{"total":96636764160,"available":96583852032,"internally_reserved":0,"allocated":2494464,"data_stored":1420649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59464,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312376,"statfs":{"total":96636764160,"available":96575873024,"internally_reserved":0,"allocated":1953792,"data_stored":855538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:20:52.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:20:52.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.756+0000 7ffa3c1c4640 1 Processor -- start 2024-09-11T22:20:52.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.756+0000 7ffa3c1c4640 1 -- start start 2024-09-11T22:20:52.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa3c1c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffa3415e840 0x7ffa340b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa3c1c4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffa340cdd50 0x7ffa340cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa3c1c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa340cf3b0 0x7ffa340d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa3c1c4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ffa3406c240 con 0x7ffa3415e840 2024-09-11T22:20:52.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa3c1c4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ffa340d0470 con 0x7ffa340cdd50 2024-09-11T22:20:52.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa3c1c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffa340ce5f0 con 0x7ffa340cf3b0 2024-09-11T22:20:52.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa39f60640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffa3415e840 0x7ffa340b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa39f60640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffa3415e840 0x7ffa340b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36914/0 (socket says 172.21.15.50:36914) 2024-09-11T22:20:52.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa39f60640 1 -- 172.21.15.50:0/3574854190 learned_addr learned my addr 172.21.15.50:0/3574854190 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:52.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa3975f640 1 --2- 172.21.15.50:0/3574854190 >> v2:172.21.15.77:3300/0 conn(0x7ffa340cdd50 0x7ffa340cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa3a761640 1 --2- 172.21.15.50:0/3574854190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa340cf3b0 0x7ffa340d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa39f60640 1 -- 172.21.15.50:0/3574854190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa340cf3b0 msgr2=0x7ffa340d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:52.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa39f60640 1 --2- 172.21.15.50:0/3574854190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa340cf3b0 0x7ffa340d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa39f60640 1 -- 172.21.15.50:0/3574854190 >> v2:172.21.15.77:3300/0 conn(0x7ffa340cdd50 msgr2=0x7ffa340cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:52.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa39f60640 1 --2- 172.21.15.50:0/3574854190 >> v2:172.21.15.77:3300/0 conn(0x7ffa340cdd50 0x7ffa340cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa39f60640 1 -- 172.21.15.50:0/3574854190 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa340ce310 con 0x7ffa3415e840 2024-09-11T22:20:52.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa3975f640 1 --2- 172.21.15.50:0/3574854190 >> v2:172.21.15.77:3300/0 conn(0x7ffa340cdd50 0x7ffa340cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:52.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.757+0000 7ffa3a761640 1 --2- 172.21.15.50:0/3574854190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa340cf3b0 0x7ffa340d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.758+0000 7ffa39f60640 1 --2- 172.21.15.50:0/3574854190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa3415e840 0x7ffa340b4c70 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7ffa340731c0 tx=0x7ffa3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f5aeb57f6db0ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.758+0000 7ffa38f5e640 1 -- 172.21.15.50:0/3574854190 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30037070 con 0x7ffa3415e840 2024-09-11T22:20:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.758+0000 7ffa38f5e640 1 -- 172.21.15.50:0/3574854190 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa30032440 con 0x7ffa3415e840 2024-09-11T22:20:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.758+0000 7ffa38f5e640 1 -- 172.21.15.50:0/3574854190 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30032810 con 0x7ffa3415e840 2024-09-11T22:20:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.759+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3574854190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa3415e840 msgr2=0x7ffa340b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.759+0000 7ffa3c1c4640 1 --2- 172.21.15.50:0/3574854190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa3415e840 0x7ffa340b4c70 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7ffa340731c0 tx=0x7ffa3002a1e0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.759+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3574854190 shutdown_connections 2024-09-11T22:20:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.759+0000 7ffa3c1c4640 1 --2- 172.21.15.50:0/3574854190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa340cf3b0 0x7ffa340d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.759+0000 7ffa3c1c4640 1 --2- 172.21.15.50:0/3574854190 >> v2:172.21.15.77:3300/0 conn(0x7ffa340cdd50 0x7ffa340cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.759+0000 7ffa3c1c4640 1 --2- 172.21.15.50:0/3574854190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa3415e840 0x7ffa340b4c70 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.759+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3574854190 >> 172.21.15.50:0/3574854190 conn(0x7ffa340b4150 msgr2=0x7ffa340b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.759+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3574854190 shutdown_connections 2024-09-11T22:20:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.759+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3574854190 wait complete. 2024-09-11T22:20:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.760+0000 7ffa3c1c4640 1 Processor -- start 2024-09-11T22:20:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.760+0000 7ffa3c1c4640 1 -- start start 2024-09-11T22:20:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3c1c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa340cdd50 0x7ffa341f7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3c1c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa340cf3b0 0x7ffa3415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3c1c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa3415e840 0x7ffa341518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3c1c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3415ec20 con 0x7ffa340cf3b0 2024-09-11T22:20:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3c1c4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3406bed0 con 0x7ffa340cdd50 2024-09-11T22:20:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3c1c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffa3415eda0 con 0x7ffa3415e840 2024-09-11T22:20:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3975f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa340cf3b0 0x7ffa3415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3975f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa340cf3b0 0x7ffa3415a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36916/0 (socket says 172.21.15.50:36916) 2024-09-11T22:20:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3975f640 1 -- 172.21.15.50:0/3701308297 learned_addr learned my addr 172.21.15.50:0/3701308297 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa39f60640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa340cdd50 0x7ffa341f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3a761640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa3415e840 0x7ffa341518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3975f640 1 -- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa3415e840 msgr2=0x7ffa341518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3975f640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa3415e840 0x7ffa341518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3975f640 1 -- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa340cdd50 msgr2=0x7ffa341f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3975f640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa340cdd50 0x7ffa341f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3975f640 1 -- 172.21.15.50:0/3701308297 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa341f7b40 con 0x7ffa340cf3b0 2024-09-11T22:20:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa39f60640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa340cdd50 0x7ffa341f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa3975f640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa340cf3b0 0x7ffa3415a4d0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400e810 tx=0x7ffa2400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa2a7fc640 1 -- 172.21.15.50:0/3701308297 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2400f040 con 0x7ffa340cf3b0 2024-09-11T22:20:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.761+0000 7ffa2a7fc640 1 -- 172.21.15.50:0/3701308297 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa24004030 con 0x7ffa340cf3b0 2024-09-11T22:20:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.762+0000 7ffa2a7fc640 1 -- 172.21.15.50:0/3701308297 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24004400 con 0x7ffa340cf3b0 2024-09-11T22:20:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.762+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3701308297 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa341f7df0 con 0x7ffa340cf3b0 2024-09-11T22:20:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.762+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3701308297 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa341f83b0 con 0x7ffa340cf3b0 2024-09-11T22:20:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.762+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3701308297 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa340cee70 con 0x7ffa340cf3b0 2024-09-11T22:20:52.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.763+0000 7ffa2a7fc640 1 -- 172.21.15.50:0/3701308297 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa2400c6d0 con 0x7ffa340cf3b0 2024-09-11T22:20:52.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.764+0000 7ffa2a7fc640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffa1806be30 0x7ffa1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.764+0000 7ffa2a7fc640 1 -- 172.21.15.50:0/3701308297 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7ffa2408ab30 con 0x7ffa340cf3b0 2024-09-11T22:20:52.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.764+0000 7ffa39f60640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffa1806be30 0x7ffa1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.764+0000 7ffa39f60640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffa1806be30 0x7ffa1806e2f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ffa30034000 tx=0x7ffa3002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.768+0000 7ffa2a7fc640 1 -- 172.21.15.50:0/3701308297 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa24017020 con 0x7ffa340cf3b0 2024-09-11T22:20:52.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.939+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3701308297 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa3406e1d0 con 0x7ffa1806be30 2024-09-11T22:20:52.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.946+0000 7ffa2a7fc640 1 -- 172.21.15.50:0/3701308297 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251403 (secure 0 0 0) 0x7ffa3406e1d0 con 0x7ffa1806be30 2024-09-11T22:20:52.950 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:52.952 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:20:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.949+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffa1806be30 msgr2=0x7ffa1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.949+0000 7ffa3c1c4640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffa1806be30 0x7ffa1806e2f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ffa30034000 tx=0x7ffa3002e000 comp rx=0 tx=0).stop 2024-09-11T22:20:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.949+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3701308297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa340cf3b0 msgr2=0x7ffa3415a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.949+0000 7ffa3c1c4640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa340cf3b0 0x7ffa3415a4d0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400e810 tx=0x7ffa2400ecd0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.949+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3701308297 shutdown_connections 2024-09-11T22:20:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.949+0000 7ffa3c1c4640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffa1806be30 0x7ffa1806e2f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.949+0000 7ffa3c1c4640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa3415e840 0x7ffa341518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.949+0000 7ffa3c1c4640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa340cf3b0 0x7ffa3415a4d0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.949+0000 7ffa3c1c4640 1 --2- 172.21.15.50:0/3701308297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa340cdd50 0x7ffa341f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.949+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3701308297 >> 172.21.15.50:0/3701308297 conn(0x7ffa340b4150 msgr2=0x7ffa340704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.949+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3701308297 shutdown_connections 2024-09-11T22:20:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:52.949+0000 7ffa3c1c4640 1 -- 172.21.15.50:0/3701308297 wait complete. 2024-09-11T22:20:52.962 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2024-09-11T22:20:51.503673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592126,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":443424,"kb_used_data":16232,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754531296,"statfs":{"total":773094113280,"available":772640047104,"internally_reserved":0,"allocated":16621568,"data_stored":7929250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1758,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.216173"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:20:48.281278+0000","last_change":"2024-09-11T22:20:48.281278+0000","last_active":"2024-09-11T22:20:48.281278+0000","last_peered":"2024-09-11T22:20:48.281278+0000","last_clean":"2024-09-11T22:20:48.281278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:48.281278+0000","last_undegraded":"2024-09-11T22:20:48.281278+0000","last_fullsized":"2024-09-11T22:20:48.281278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.258256+0000","last_change":"2024-09-11T22:20:49.256687+0000","last_active":"2024-09-11T22:20:49.258256+0000","last_peered":"2024-09-11T22:20:49.258256+0000","last_clean":"2024-09-11T22:20:49.258256+0000","last_became_active":"2024-09-11T22:20:49.255413+0000","last_became_peered":"2024-09-11T22:20:49.255413+0000","last_unstale":"2024-09-11T22:20:49.258256+0000","last_undegraded":"2024-09-11T22:20:49.258256+0000","last_fullsized":"2024-09-11T22:20:49.258256+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:12.487278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261672+0000","last_change":"2024-09-11T22:20:49.259480+0000","last_active":"2024-09-11T22:20:49.261672+0000","last_peered":"2024-09-11T22:20:49.261672+0000","last_clean":"2024-09-11T22:20:49.261672+0000","last_became_active":"2024-09-11T22:20:49.259173+0000","last_became_peered":"2024-09-11T22:20:49.259173+0000","last_unstale":"2024-09-11T22:20:49.261672+0000","last_undegraded":"2024-09-11T22:20:49.261672+0000","last_fullsized":"2024-09-11T22:20:49.261672+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:18.167932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262191+0000","last_change":"2024-09-11T22:20:49.255277+0000","last_active":"2024-09-11T22:20:49.262191+0000","last_peered":"2024-09-11T22:20:49.262191+0000","last_clean":"2024-09-11T22:20:49.262191+0000","last_became_active":"2024-09-11T22:20:49.254171+0000","last_became_peered":"2024-09-11T22:20:49.254171+0000","last_unstale":"2024-09-11T22:20:49.262191+0000","last_undegraded":"2024-09-11T22:20:49.262191+0000","last_fullsized":"2024-09-11T22:20:49.262191+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:40:51.621945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.258094+0000","last_change":"2024-09-11T22:20:49.256296+0000","last_active":"2024-09-11T22:20:49.258094+0000","last_peered":"2024-09-11T22:20:49.258094+0000","last_clean":"2024-09-11T22:20:49.258094+0000","last_became_active":"2024-09-11T22:20:49.255999+0000","last_became_peered":"2024-09-11T22:20:49.255999+0000","last_unstale":"2024-09-11T22:20:49.258094+0000","last_undegraded":"2024-09-11T22:20:49.258094+0000","last_fullsized":"2024-09-11T22:20:49.258094+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:37.475609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433430+0000","last_change":"2024-09-11T22:20:49.257008+0000","last_active":"2024-09-11T22:20:50.433430+0000","last_peered":"2024-09-11T22:20:50.433430+0000","last_clean":"2024-09-11T22:20:50.433430+0000","last_became_active":"2024-09-11T22:20:49.256658+0000","last_became_peered":"2024-09-11T22:20:49.256658+0000","last_unstale":"2024-09-11T22:20:50.433430+0000","last_undegraded":"2024-09-11T22:20:50.433430+0000","last_fullsized":"2024-09-11T22:20:50.433430+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:38.632671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261461+0000","last_change":"2024-09-11T22:20:49.259937+0000","last_active":"2024-09-11T22:20:49.261461+0000","last_peered":"2024-09-11T22:20:49.261461+0000","last_clean":"2024-09-11T22:20:49.261461+0000","last_became_active":"2024-09-11T22:20:49.259497+0000","last_became_peered":"2024-09-11T22:20:49.259497+0000","last_unstale":"2024-09-11T22:20:49.261461+0000","last_undegraded":"2024-09-11T22:20:49.261461+0000","last_fullsized":"2024-09-11T22:20:49.261461+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:44.823149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257042+0000","last_change":"2024-09-11T22:20:49.254113+0000","last_active":"2024-09-11T22:20:49.257042+0000","last_peered":"2024-09-11T22:20:49.257042+0000","last_clean":"2024-09-11T22:20:49.257042+0000","last_became_active":"2024-09-11T22:20:49.253821+0000","last_became_peered":"2024-09-11T22:20:49.253821+0000","last_unstale":"2024-09-11T22:20:49.257042+0000","last_undegraded":"2024-09-11T22:20:49.257042+0000","last_fullsized":"2024-09-11T22:20:49.257042+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:08.830514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257641+0000","last_change":"2024-09-11T22:20:49.256195+0000","last_active":"2024-09-11T22:20:49.257641+0000","last_peered":"2024-09-11T22:20:49.257641+0000","last_clean":"2024-09-11T22:20:49.257641+0000","last_became_active":"2024-09-11T22:20:49.255711+0000","last_became_peered":"2024-09-11T22:20:49.255711+0000","last_unstale":"2024-09-11T22:20:49.257641+0000","last_undegraded":"2024-09-11T22:20:49.257641+0000","last_fullsized":"2024-09-11T22:20:49.257641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:38.939177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.252003+0000","last_change":"2024-09-11T22:20:49.249631+0000","last_active":"2024-09-11T22:20:49.252003+0000","last_peered":"2024-09-11T22:20:49.252003+0000","last_clean":"2024-09-11T22:20:49.252003+0000","last_became_active":"2024-09-11T22:20:49.249320+0000","last_became_peered":"2024-09-11T22:20:49.249320+0000","last_unstale":"2024-09-11T22:20:49.252003+0000","last_undegraded":"2024-09-11T22:20:49.252003+0000","last_fullsized":"2024-09-11T22:20:49.252003+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:26.278211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.258132+0000","last_change":"2024-09-11T22:20:49.257141+0000","last_active":"2024-09-11T22:20:49.258132+0000","last_peered":"2024-09-11T22:20:49.258132+0000","last_clean":"2024-09-11T22:20:49.258132+0000","last_became_active":"2024-09-11T22:20:49.256842+0000","last_became_peered":"2024-09-11T22:20:49.256842+0000","last_unstale":"2024-09-11T22:20:49.258132+0000","last_undegraded":"2024-09-11T22:20:49.258132+0000","last_fullsized":"2024-09-11T22:20:49.258132+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:24.667187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257576+0000","last_change":"2024-09-11T22:20:49.255216+0000","last_active":"2024-09-11T22:20:49.257576+0000","last_peered":"2024-09-11T22:20:49.257576+0000","last_clean":"2024-09-11T22:20:49.257576+0000","last_became_active":"2024-09-11T22:20:49.253715+0000","last_became_peered":"2024-09-11T22:20:49.253715+0000","last_unstale":"2024-09-11T22:20:49.257576+0000","last_undegraded":"2024-09-11T22:20:49.257576+0000","last_fullsized":"2024-09-11T22:20:49.257576+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:20.358674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256760+0000","last_change":"2024-09-11T22:20:49.252882+0000","last_active":"2024-09-11T22:20:49.256760+0000","last_peered":"2024-09-11T22:20:49.256760+0000","last_clean":"2024-09-11T22:20:49.256760+0000","last_became_active":"2024-09-11T22:20:49.252605+0000","last_became_peered":"2024-09-11T22:20:49.252605+0000","last_unstale":"2024-09-11T22:20:49.256760+0000","last_undegraded":"2024-09-11T22:20:49.256760+0000","last_fullsized":"2024-09-11T22:20:49.256760+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:34:50.130283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256719+0000","last_change":"2024-09-11T22:20:49.253678+0000","last_active":"2024-09-11T22:20:49.256719+0000","last_peered":"2024-09-11T22:20:49.256719+0000","last_clean":"2024-09-11T22:20:49.256719+0000","last_became_active":"2024-09-11T22:20:49.253341+0000","last_became_peered":"2024-09-11T22:20:49.253341+0000","last_unstale":"2024-09-11T22:20:49.256719+0000","last_undegraded":"2024-09-11T22:20:49.256719+0000","last_fullsized":"2024-09-11T22:20:49.256719+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.774600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:20:48.281278+0000","last_change":"2024-09-11T22:20:48.281278+0000","last_active":"2024-09-11T22:20:48.281278+0000","last_peered":"2024-09-11T22:20:48.281278+0000","last_clean":"2024-09-11T22:20:48.281278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:48.281278+0000","last_undegraded":"2024-09-11T22:20:48.281278+0000","last_fullsized":"2024-09-11T22:20:48.281278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261360+0000","last_change":"2024-09-11T22:20:49.260060+0000","last_active":"2024-09-11T22:20:49.261360+0000","last_peered":"2024-09-11T22:20:49.261360+0000","last_clean":"2024-09-11T22:20:49.261360+0000","last_became_active":"2024-09-11T22:20:49.259343+0000","last_became_peered":"2024-09-11T22:20:49.259343+0000","last_unstale":"2024-09-11T22:20:49.261360+0000","last_undegraded":"2024-09-11T22:20:49.261360+0000","last_fullsized":"2024-09-11T22:20:49.261360+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433734+0000","last_change":"2024-09-11T22:20:49.256020+0000","last_active":"2024-09-11T22:20:50.433734+0000","last_peered":"2024-09-11T22:20:50.433734+0000","last_clean":"2024-09-11T22:20:50.433734+0000","last_became_active":"2024-09-11T22:20:49.255719+0000","last_became_peered":"2024-09-11T22:20:49.255719+0000","last_unstale":"2024-09-11T22:20:50.433734+0000","last_undegraded":"2024-09-11T22:20:50.433734+0000","last_fullsized":"2024-09-11T22:20:50.433734+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:14.287208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255186+0000","last_change":"2024-09-11T22:20:49.252133+0000","last_active":"2024-09-11T22:20:49.255186+0000","last_peered":"2024-09-11T22:20:49.255186+0000","last_clean":"2024-09-11T22:20:49.255186+0000","last_became_active":"2024-09-11T22:20:49.251795+0000","last_became_peered":"2024-09-11T22:20:49.251795+0000","last_unstale":"2024-09-11T22:20:49.255186+0000","last_undegraded":"2024-09-11T22:20:49.255186+0000","last_fullsized":"2024-09-11T22:20:49.255186+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:59.356235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433641+0000","last_change":"2024-09-11T22:20:49.260981+0000","last_active":"2024-09-11T22:20:50.433641+0000","last_peered":"2024-09-11T22:20:50.433641+0000","last_clean":"2024-09-11T22:20:50.433641+0000","last_became_active":"2024-09-11T22:20:49.260597+0000","last_became_peered":"2024-09-11T22:20:49.260597+0000","last_unstale":"2024-09-11T22:20:50.433641+0000","last_undegraded":"2024-09-11T22:20:50.433641+0000","last_fullsized":"2024-09-11T22:20:50.433641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:36.018303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.260611+0000","last_change":"2024-09-11T22:20:49.254914+0000","last_active":"2024-09-11T22:20:49.260611+0000","last_peered":"2024-09-11T22:20:49.260611+0000","last_clean":"2024-09-11T22:20:49.260611+0000","last_became_active":"2024-09-11T22:20:49.254597+0000","last_became_peered":"2024-09-11T22:20:49.254597+0000","last_unstale":"2024-09-11T22:20:49.260611+0000","last_undegraded":"2024-09-11T22:20:49.260611+0000","last_fullsized":"2024-09-11T22:20:49.260611+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:43.034095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433366+0000","last_change":"2024-09-11T22:20:49.258117+0000","last_active":"2024-09-11T22:20:50.433366+0000","last_peered":"2024-09-11T22:20:50.433366+0000","last_clean":"2024-09-11T22:20:50.433366+0000","last_became_active":"2024-09-11T22:20:49.257806+0000","last_became_peered":"2024-09-11T22:20:49.257806+0000","last_unstale":"2024-09-11T22:20:50.433366+0000","last_undegraded":"2024-09-11T22:20:50.433366+0000","last_fullsized":"2024-09-11T22:20:50.433366+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:20.317862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255549+0000","last_change":"2024-09-11T22:20:49.251616+0000","last_active":"2024-09-11T22:20:49.255549+0000","last_peered":"2024-09-11T22:20:49.255549+0000","last_clean":"2024-09-11T22:20:49.255549+0000","last_became_active":"2024-09-11T22:20:49.250819+0000","last_became_peered":"2024-09-11T22:20:49.250819+0000","last_unstale":"2024-09-11T22:20:49.255549+0000","last_undegraded":"2024-09-11T22:20:49.255549+0000","last_fullsized":"2024-09-11T22:20:49.255549+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:06.751192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433478+0000","last_change":"2024-09-11T22:20:49.258445+0000","last_active":"2024-09-11T22:20:50.433478+0000","last_peered":"2024-09-11T22:20:50.433478+0000","last_clean":"2024-09-11T22:20:50.433478+0000","last_became_active":"2024-09-11T22:20:49.258097+0000","last_became_peered":"2024-09-11T22:20:49.258097+0000","last_unstale":"2024-09-11T22:20:50.433478+0000","last_undegraded":"2024-09-11T22:20:50.433478+0000","last_fullsized":"2024-09-11T22:20:50.433478+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:24.802538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.250639+0000","last_change":"2024-09-11T22:20:49.248979+0000","last_active":"2024-09-11T22:20:49.250639+0000","last_peered":"2024-09-11T22:20:49.250639+0000","last_clean":"2024-09-11T22:20:49.250639+0000","last_became_active":"2024-09-11T22:20:49.248650+0000","last_became_peered":"2024-09-11T22:20:49.248650+0000","last_unstale":"2024-09-11T22:20:49.250639+0000","last_undegraded":"2024-09-11T22:20:49.250639+0000","last_fullsized":"2024-09-11T22:20:49.250639+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:21.294375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261194+0000","last_change":"2024-09-11T22:20:49.257680+0000","last_active":"2024-09-11T22:20:49.261194+0000","last_peered":"2024-09-11T22:20:49.261194+0000","last_clean":"2024-09-11T22:20:49.261194+0000","last_became_active":"2024-09-11T22:20:49.257402+0000","last_became_peered":"2024-09-11T22:20:49.257402+0000","last_unstale":"2024-09-11T22:20:49.261194+0000","last_undegraded":"2024-09-11T22:20:49.261194+0000","last_fullsized":"2024-09-11T22:20:49.261194+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:04.776287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261300+0000","last_change":"2024-09-11T22:20:49.253221+0000","last_active":"2024-09-11T22:20:49.261300+0000","last_peered":"2024-09-11T22:20:49.261300+0000","last_clean":"2024-09-11T22:20:49.261300+0000","last_became_active":"2024-09-11T22:20:49.252517+0000","last_became_peered":"2024-09-11T22:20:49.252517+0000","last_unstale":"2024-09-11T22:20:49.261300+0000","last_undegraded":"2024-09-11T22:20:49.261300+0000","last_fullsized":"2024-09-11T22:20:49.261300+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:35.695376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.263489+0000","last_change":"2024-09-11T22:20:49.263087+0000","last_active":"2024-09-11T22:20:49.263489+0000","last_peered":"2024-09-11T22:20:49.263489+0000","last_clean":"2024-09-11T22:20:49.263489+0000","last_became_active":"2024-09-11T22:20:49.262855+0000","last_became_peered":"2024-09-11T22:20:49.262855+0000","last_unstale":"2024-09-11T22:20:49.263489+0000","last_undegraded":"2024-09-11T22:20:49.263489+0000","last_fullsized":"2024-09-11T22:20:49.263489+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:34.118858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262208+0000","last_change":"2024-09-11T22:20:49.257721+0000","last_active":"2024-09-11T22:20:49.262208+0000","last_peered":"2024-09-11T22:20:49.262208+0000","last_clean":"2024-09-11T22:20:49.262208+0000","last_became_active":"2024-09-11T22:20:49.257445+0000","last_became_peered":"2024-09-11T22:20:49.257445+0000","last_unstale":"2024-09-11T22:20:49.262208+0000","last_undegraded":"2024-09-11T22:20:49.262208+0000","last_fullsized":"2024-09-11T22:20:49.262208+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:19.202899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.247561+0000","last_change":"2024-09-11T22:20:49.246147+0000","last_active":"2024-09-11T22:20:49.247561+0000","last_peered":"2024-09-11T22:20:49.247561+0000","last_clean":"2024-09-11T22:20:49.247561+0000","last_became_active":"2024-09-11T22:20:49.245562+0000","last_became_peered":"2024-09-11T22:20:49.245562+0000","last_unstale":"2024-09-11T22:20:49.247561+0000","last_undegraded":"2024-09-11T22:20:49.247561+0000","last_fullsized":"2024-09-11T22:20:49.247561+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:10.816175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261176+0000","last_change":"2024-09-11T22:20:49.257292+0000","last_active":"2024-09-11T22:20:49.261176+0000","last_peered":"2024-09-11T22:20:49.261176+0000","last_clean":"2024-09-11T22:20:49.261176+0000","last_became_active":"2024-09-11T22:20:49.257017+0000","last_became_peered":"2024-09-11T22:20:49.257017+0000","last_unstale":"2024-09-11T22:20:49.261176+0000","last_undegraded":"2024-09-11T22:20:49.261176+0000","last_fullsized":"2024-09-11T22:20:49.261176+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:42.578739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261718+0000","last_change":"2024-09-11T22:20:49.260855+0000","last_active":"2024-09-11T22:20:49.261718+0000","last_peered":"2024-09-11T22:20:49.261718+0000","last_clean":"2024-09-11T22:20:49.261718+0000","last_became_active":"2024-09-11T22:20:49.260572+0000","last_became_peered":"2024-09-11T22:20:49.260572+0000","last_unstale":"2024-09-11T22:20:49.261718+0000","last_undegraded":"2024-09-11T22:20:49.261718+0000","last_fullsized":"2024-09-11T22:20:49.261718+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:21.343711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255735+0000","last_change":"2024-09-11T22:20:49.253506+0000","last_active":"2024-09-11T22:20:49.255735+0000","last_peered":"2024-09-11T22:20:49.255735+0000","last_clean":"2024-09-11T22:20:49.255735+0000","last_became_active":"2024-09-11T22:20:49.253215+0000","last_became_peered":"2024-09-11T22:20:49.253215+0000","last_unstale":"2024-09-11T22:20:49.255735+0000","last_undegraded":"2024-09-11T22:20:49.255735+0000","last_fullsized":"2024-09-11T22:20:49.255735+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:18.404645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261321+0000","last_change":"2024-09-11T22:20:49.253239+0000","last_active":"2024-09-11T22:20:49.261321+0000","last_peered":"2024-09-11T22:20:49.261321+0000","last_clean":"2024-09-11T22:20:49.261321+0000","last_became_active":"2024-09-11T22:20:49.252953+0000","last_became_peered":"2024-09-11T22:20:49.252953+0000","last_unstale":"2024-09-11T22:20:49.261321+0000","last_undegraded":"2024-09-11T22:20:49.261321+0000","last_fullsized":"2024-09-11T22:20:49.261321+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:57.132602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.289517+0000","last_change":"2024-09-11T22:20:47.289517+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.289517+0000","last_undegraded":"2024-09-11T22:20:47.289517+0000","last_fullsized":"2024-09-11T22:20:47.289517+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261197+0000","last_change":"2024-09-11T22:20:49.256402+0000","last_active":"2024-09-11T22:20:49.261197+0000","last_peered":"2024-09-11T22:20:49.261197+0000","last_clean":"2024-09-11T22:20:49.261197+0000","last_became_active":"2024-09-11T22:20:49.256119+0000","last_became_peered":"2024-09-11T22:20:49.256119+0000","last_unstale":"2024-09-11T22:20:49.261197+0000","last_undegraded":"2024-09-11T22:20:49.261197+0000","last_fullsized":"2024-09-11T22:20:49.261197+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:31.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296169+0000","last_change":"2024-09-11T22:20:48.301059+0000","last_active":"2024-09-11T22:20:49.296169+0000","last_peered":"2024-09-11T22:20:49.296169+0000","last_clean":"2024-09-11T22:20:49.296169+0000","last_became_active":"2024-09-11T22:20:48.300798+0000","last_became_peered":"2024-09-11T22:20:48.300798+0000","last_unstale":"2024-09-11T22:20:49.296169+0000","last_undegraded":"2024-09-11T22:20:49.296169+0000","last_fullsized":"2024-09-11T22:20:49.296169+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:58.807896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433340+0000","last_change":"2024-09-11T22:20:49.254064+0000","last_active":"2024-09-11T22:20:50.433340+0000","last_peered":"2024-09-11T22:20:50.433340+0000","last_clean":"2024-09-11T22:20:50.433340+0000","last_became_active":"2024-09-11T22:20:49.253755+0000","last_became_peered":"2024-09-11T22:20:49.253755+0000","last_unstale":"2024-09-11T22:20:50.433340+0000","last_undegraded":"2024-09-11T22:20:50.433340+0000","last_fullsized":"2024-09-11T22:20:50.433340+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:32.881230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.298275+0000","last_change":"2024-09-11T22:20:48.305983+0000","last_active":"2024-09-11T22:20:49.298275+0000","last_peered":"2024-09-11T22:20:49.298275+0000","last_clean":"2024-09-11T22:20:49.298275+0000","last_became_active":"2024-09-11T22:20:48.305565+0000","last_became_peered":"2024-09-11T22:20:48.305565+0000","last_unstale":"2024-09-11T22:20:49.298275+0000","last_undegraded":"2024-09-11T22:20:49.298275+0000","last_fullsized":"2024-09-11T22:20:49.298275+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.485401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261649+0000","last_change":"2024-09-11T22:20:49.258388+0000","last_active":"2024-09-11T22:20:49.261649+0000","last_peered":"2024-09-11T22:20:49.261649+0000","last_clean":"2024-09-11T22:20:49.261649+0000","last_became_active":"2024-09-11T22:20:49.258045+0000","last_became_peered":"2024-09-11T22:20:49.258045+0000","last_unstale":"2024-09-11T22:20:49.261649+0000","last_undegraded":"2024-09-11T22:20:49.261649+0000","last_fullsized":"2024-09-11T22:20:49.261649+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:32:05.512930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.299575+0000","last_change":"2024-09-11T22:20:48.307332+0000","last_active":"2024-09-11T22:20:49.299575+0000","last_peered":"2024-09-11T22:20:49.299575+0000","last_clean":"2024-09-11T22:20:49.299575+0000","last_became_active":"2024-09-11T22:20:48.306940+0000","last_became_peered":"2024-09-11T22:20:48.306940+0000","last_unstale":"2024-09-11T22:20:49.299575+0000","last_undegraded":"2024-09-11T22:20:49.299575+0000","last_fullsized":"2024-09-11T22:20:49.299575+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:03.217415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261796+0000","last_change":"2024-09-11T22:20:49.253030+0000","last_active":"2024-09-11T22:20:49.261796+0000","last_peered":"2024-09-11T22:20:49.261796+0000","last_clean":"2024-09-11T22:20:49.261796+0000","last_became_active":"2024-09-11T22:20:49.252290+0000","last_became_peered":"2024-09-11T22:20:49.252290+0000","last_unstale":"2024-09-11T22:20:49.261796+0000","last_undegraded":"2024-09-11T22:20:49.261796+0000","last_fullsized":"2024-09-11T22:20:49.261796+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:25.075906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296158+0000","last_change":"2024-09-11T22:20:48.297836+0000","last_active":"2024-09-11T22:20:49.296158+0000","last_peered":"2024-09-11T22:20:49.296158+0000","last_clean":"2024-09-11T22:20:49.296158+0000","last_became_active":"2024-09-11T22:20:48.297270+0000","last_became_peered":"2024-09-11T22:20:48.297270+0000","last_unstale":"2024-09-11T22:20:49.296158+0000","last_undegraded":"2024-09-11T22:20:49.296158+0000","last_fullsized":"2024-09-11T22:20:49.296158+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:26.844219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262374+0000","last_change":"2024-09-11T22:20:49.259041+0000","last_active":"2024-09-11T22:20:49.262374+0000","last_peered":"2024-09-11T22:20:49.262374+0000","last_clean":"2024-09-11T22:20:49.262374+0000","last_became_active":"2024-09-11T22:20:49.256041+0000","last_became_peered":"2024-09-11T22:20:49.256041+0000","last_unstale":"2024-09-11T22:20:49.262374+0000","last_undegraded":"2024-09-11T22:20:49.262374+0000","last_fullsized":"2024-09-11T22:20:49.262374+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:21.423018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296841+0000","last_change":"2024-09-11T22:20:48.302454+0000","last_active":"2024-09-11T22:20:49.296841+0000","last_peered":"2024-09-11T22:20:49.296841+0000","last_clean":"2024-09-11T22:20:49.296841+0000","last_became_active":"2024-09-11T22:20:48.302149+0000","last_became_peered":"2024-09-11T22:20:48.302149+0000","last_unstale":"2024-09-11T22:20:49.296841+0000","last_undegraded":"2024-09-11T22:20:49.296841+0000","last_fullsized":"2024-09-11T22:20:49.296841+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:23.665309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257311+0000","last_change":"2024-09-11T22:20:49.253425+0000","last_active":"2024-09-11T22:20:49.257311+0000","last_peered":"2024-09-11T22:20:49.257311+0000","last_clean":"2024-09-11T22:20:49.257311+0000","last_became_active":"2024-09-11T22:20:49.252711+0000","last_became_peered":"2024-09-11T22:20:49.252711+0000","last_unstale":"2024-09-11T22:20:49.257311+0000","last_undegraded":"2024-09-11T22:20:49.257311+0000","last_fullsized":"2024-09-11T22:20:49.257311+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:42.578739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.242628+0000","last_change":"2024-09-11T22:20:48.305247+0000","last_active":"2024-09-11T22:20:49.242628+0000","last_peered":"2024-09-11T22:20:49.242628+0000","last_clean":"2024-09-11T22:20:49.242628+0000","last_became_active":"2024-09-11T22:20:48.304920+0000","last_became_peered":"2024-09-11T22:20:48.304920+0000","last_unstale":"2024-09-11T22:20:49.242628+0000","last_undegraded":"2024-09-11T22:20:49.242628+0000","last_fullsized":"2024-09-11T22:20:49.242628+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:33.116980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433383+0000","last_change":"2024-09-11T22:20:49.257648+0000","last_active":"2024-09-11T22:20:50.433383+0000","last_peered":"2024-09-11T22:20:50.433383+0000","last_clean":"2024-09-11T22:20:50.433383+0000","last_became_active":"2024-09-11T22:20:49.257084+0000","last_became_peered":"2024-09-11T22:20:49.257084+0000","last_unstale":"2024-09-11T22:20:50.433383+0000","last_undegraded":"2024-09-11T22:20:50.433383+0000","last_fullsized":"2024-09-11T22:20:50.433383+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.426141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.245222+0000","last_change":"2024-09-11T22:20:48.295595+0000","last_active":"2024-09-11T22:20:49.245222+0000","last_peered":"2024-09-11T22:20:49.245222+0000","last_clean":"2024-09-11T22:20:49.245222+0000","last_became_active":"2024-09-11T22:20:48.295384+0000","last_became_peered":"2024-09-11T22:20:48.295384+0000","last_unstale":"2024-09-11T22:20:49.245222+0000","last_undegraded":"2024-09-11T22:20:49.245222+0000","last_fullsized":"2024-09-11T22:20:49.245222+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:30.293105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262154+0000","last_change":"2024-09-11T22:20:49.261199+0000","last_active":"2024-09-11T22:20:49.262154+0000","last_peered":"2024-09-11T22:20:49.262154+0000","last_clean":"2024-09-11T22:20:49.262154+0000","last_became_active":"2024-09-11T22:20:49.260923+0000","last_became_peered":"2024-09-11T22:20:49.260923+0000","last_unstale":"2024-09-11T22:20:49.262154+0000","last_undegraded":"2024-09-11T22:20:49.262154+0000","last_fullsized":"2024-09-11T22:20:49.262154+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:58.259369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433655+0000","last_change":"2024-09-11T22:20:48.301853+0000","last_active":"2024-09-11T22:20:50.433655+0000","last_peered":"2024-09-11T22:20:50.433655+0000","last_clean":"2024-09-11T22:20:50.433655+0000","last_became_active":"2024-09-11T22:20:48.301527+0000","last_became_peered":"2024-09-11T22:20:48.301527+0000","last_unstale":"2024-09-11T22:20:50.433655+0000","last_undegraded":"2024-09-11T22:20:50.433655+0000","last_fullsized":"2024-09-11T22:20:50.433655+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:58.041049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.254050+0000","last_change":"2024-09-11T22:20:49.251762+0000","last_active":"2024-09-11T22:20:49.254050+0000","last_peered":"2024-09-11T22:20:49.254050+0000","last_clean":"2024-09-11T22:20:49.254050+0000","last_became_active":"2024-09-11T22:20:49.251246+0000","last_became_peered":"2024-09-11T22:20:49.251246+0000","last_unstale":"2024-09-11T22:20:49.254050+0000","last_undegraded":"2024-09-11T22:20:49.254050+0000","last_fullsized":"2024-09-11T22:20:49.254050+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"155'3","reported_seq":17,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433653+0000","last_change":"2024-09-11T22:20:48.300620+0000","last_active":"2024-09-11T22:20:50.433653+0000","last_peered":"2024-09-11T22:20:50.433653+0000","last_clean":"2024-09-11T22:20:50.433653+0000","last_became_active":"2024-09-11T22:20:48.300324+0000","last_became_peered":"2024-09-11T22:20:48.300324+0000","last_unstale":"2024-09-11T22:20:50.433653+0000","last_undegraded":"2024-09-11T22:20:50.433653+0000","last_fullsized":"2024-09-11T22:20:50.433653+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:30.057922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255793+0000","last_change":"2024-09-11T22:20:49.254036+0000","last_active":"2024-09-11T22:20:49.255793+0000","last_peered":"2024-09-11T22:20:49.255793+0000","last_clean":"2024-09-11T22:20:49.255793+0000","last_became_active":"2024-09-11T22:20:49.253188+0000","last_became_peered":"2024-09-11T22:20:49.253188+0000","last_unstale":"2024-09-11T22:20:49.255793+0000","last_undegraded":"2024-09-11T22:20:49.255793+0000","last_fullsized":"2024-09-11T22:20:49.255793+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:24.667187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"155'6","reported_seq":18,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.301030+0000","last_change":"2024-09-11T22:20:48.298730+0000","last_active":"2024-09-11T22:20:49.301030+0000","last_peered":"2024-09-11T22:20:49.301030+0000","last_clean":"2024-09-11T22:20:49.301030+0000","last_became_active":"2024-09-11T22:20:48.297965+0000","last_became_peered":"2024-09-11T22:20:48.297965+0000","last_unstale":"2024-09-11T22:20:49.301030+0000","last_undegraded":"2024-09-11T22:20:49.301030+0000","last_fullsized":"2024-09-11T22:20:49.301030+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.485401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257021+0000","last_change":"2024-09-11T22:20:49.256099+0000","last_active":"2024-09-11T22:20:49.257021+0000","last_peered":"2024-09-11T22:20:49.257021+0000","last_clean":"2024-09-11T22:20:49.257021+0000","last_became_active":"2024-09-11T22:20:49.255825+0000","last_became_peered":"2024-09-11T22:20:49.255825+0000","last_unstale":"2024-09-11T22:20:49.257021+0000","last_undegraded":"2024-09-11T22:20:49.257021+0000","last_fullsized":"2024-09-11T22:20:49.257021+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:04.682427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296612+0000","last_change":"2024-09-11T22:20:48.301519+0000","last_active":"2024-09-11T22:20:49.296612+0000","last_peered":"2024-09-11T22:20:49.296612+0000","last_clean":"2024-09-11T22:20:49.296612+0000","last_became_active":"2024-09-11T22:20:48.301198+0000","last_became_peered":"2024-09-11T22:20:48.301198+0000","last_unstale":"2024-09-11T22:20:49.296612+0000","last_undegraded":"2024-09-11T22:20:49.296612+0000","last_fullsized":"2024-09-11T22:20:49.296612+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:37.937300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261131+0000","last_change":"2024-09-11T22:20:49.253407+0000","last_active":"2024-09-11T22:20:49.261131+0000","last_peered":"2024-09-11T22:20:49.261131+0000","last_clean":"2024-09-11T22:20:49.261131+0000","last_became_active":"2024-09-11T22:20:49.252632+0000","last_became_peered":"2024-09-11T22:20:49.252632+0000","last_unstale":"2024-09-11T22:20:49.261131+0000","last_undegraded":"2024-09-11T22:20:49.261131+0000","last_fullsized":"2024-09-11T22:20:49.261131+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:03.072860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.248005+0000","last_change":"2024-09-11T22:20:48.303180+0000","last_active":"2024-09-11T22:20:49.248005+0000","last_peered":"2024-09-11T22:20:49.248005+0000","last_clean":"2024-09-11T22:20:49.248005+0000","last_became_active":"2024-09-11T22:20:48.302900+0000","last_became_peered":"2024-09-11T22:20:48.302900+0000","last_unstale":"2024-09-11T22:20:49.248005+0000","last_undegraded":"2024-09-11T22:20:49.248005+0000","last_fullsized":"2024-09-11T22:20:49.248005+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:34.148358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262365+0000","last_change":"2024-09-11T22:20:49.253704+0000","last_active":"2024-09-11T22:20:49.262365+0000","last_peered":"2024-09-11T22:20:49.262365+0000","last_clean":"2024-09-11T22:20:49.262365+0000","last_became_active":"2024-09-11T22:20:49.253146+0000","last_became_peered":"2024-09-11T22:20:49.253146+0000","last_unstale":"2024-09-11T22:20:49.262365+0000","last_undegraded":"2024-09-11T22:20:49.262365+0000","last_fullsized":"2024-09-11T22:20:49.262365+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:21.343711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.240529+0000","last_change":"2024-09-11T22:20:48.303425+0000","last_active":"2024-09-11T22:20:49.240529+0000","last_peered":"2024-09-11T22:20:49.240529+0000","last_clean":"2024-09-11T22:20:49.240529+0000","last_became_active":"2024-09-11T22:20:48.303149+0000","last_became_peered":"2024-09-11T22:20:48.303149+0000","last_unstale":"2024-09-11T22:20:49.240529+0000","last_undegraded":"2024-09-11T22:20:49.240529+0000","last_fullsized":"2024-09-11T22:20:49.240529+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:07.828637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261428+0000","last_change":"2024-09-11T22:20:49.259624+0000","last_active":"2024-09-11T22:20:49.261428+0000","last_peered":"2024-09-11T22:20:49.261428+0000","last_clean":"2024-09-11T22:20:49.261428+0000","last_became_active":"2024-09-11T22:20:49.259313+0000","last_became_peered":"2024-09-11T22:20:49.259313+0000","last_unstale":"2024-09-11T22:20:49.261428+0000","last_undegraded":"2024-09-11T22:20:49.261428+0000","last_fullsized":"2024-09-11T22:20:49.261428+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.591169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"155'8","reported_seq":20,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.299630+0000","last_change":"2024-09-11T22:20:48.298368+0000","last_active":"2024-09-11T22:20:49.299630+0000","last_peered":"2024-09-11T22:20:49.299630+0000","last_clean":"2024-09-11T22:20:49.299630+0000","last_became_active":"2024-09-11T22:20:48.298080+0000","last_became_peered":"2024-09-11T22:20:48.298080+0000","last_unstale":"2024-09-11T22:20:49.299630+0000","last_undegraded":"2024-09-11T22:20:49.299630+0000","last_fullsized":"2024-09-11T22:20:49.299630+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:19.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257415+0000","last_change":"2024-09-11T22:20:49.253099+0000","last_active":"2024-09-11T22:20:49.257415+0000","last_peered":"2024-09-11T22:20:49.257415+0000","last_clean":"2024-09-11T22:20:49.257415+0000","last_became_active":"2024-09-11T22:20:49.252746+0000","last_became_peered":"2024-09-11T22:20:49.252746+0000","last_unstale":"2024-09-11T22:20:49.257415+0000","last_undegraded":"2024-09-11T22:20:49.257415+0000","last_fullsized":"2024-09-11T22:20:49.257415+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:31.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.297661+0000","last_change":"2024-09-11T22:20:48.303794+0000","last_active":"2024-09-11T22:20:49.297661+0000","last_peered":"2024-09-11T22:20:49.297661+0000","last_clean":"2024-09-11T22:20:49.297661+0000","last_became_active":"2024-09-11T22:20:48.303490+0000","last_became_peered":"2024-09-11T22:20:48.303490+0000","last_unstale":"2024-09-11T22:20:49.297661+0000","last_undegraded":"2024-09-11T22:20:49.297661+0000","last_fullsized":"2024-09-11T22:20:49.297661+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:45.138609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261362+0000","last_change":"2024-09-11T22:20:49.257754+0000","last_active":"2024-09-11T22:20:49.261362+0000","last_peered":"2024-09-11T22:20:49.261362+0000","last_clean":"2024-09-11T22:20:49.261362+0000","last_became_active":"2024-09-11T22:20:49.257472+0000","last_became_peered":"2024-09-11T22:20:49.257472+0000","last_unstale":"2024-09-11T22:20:49.261362+0000","last_undegraded":"2024-09-11T22:20:49.261362+0000","last_fullsized":"2024-09-11T22:20:49.261362+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:12.702105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.297285+0000","last_change":"2024-09-11T22:20:48.299954+0000","last_active":"2024-09-11T22:20:49.297285+0000","last_peered":"2024-09-11T22:20:49.297285+0000","last_clean":"2024-09-11T22:20:49.297285+0000","last_became_active":"2024-09-11T22:20:48.299637+0000","last_became_peered":"2024-09-11T22:20:48.299637+0000","last_unstale":"2024-09-11T22:20:49.297285+0000","last_undegraded":"2024-09-11T22:20:49.297285+0000","last_fullsized":"2024-09-11T22:20:49.297285+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:57.382973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262167+0000","last_change":"2024-09-11T22:20:49.253982+0000","last_active":"2024-09-11T22:20:49.262167+0000","last_peered":"2024-09-11T22:20:49.262167+0000","last_clean":"2024-09-11T22:20:49.262167+0000","last_became_active":"2024-09-11T22:20:49.253595+0000","last_became_peered":"2024-09-11T22:20:49.253595+0000","last_unstale":"2024-09-11T22:20:49.262167+0000","last_undegraded":"2024-09-11T22:20:49.262167+0000","last_fullsized":"2024-09-11T22:20:49.262167+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:41.858220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.289493+0000","last_change":"2024-09-11T22:20:47.289493+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.289493+0000","last_undegraded":"2024-09-11T22:20:47.289493+0000","last_fullsized":"2024-09-11T22:20:47.289493+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261211+0000","last_change":"2024-09-11T22:20:49.259683+0000","last_active":"2024-09-11T22:20:49.261211+0000","last_peered":"2024-09-11T22:20:49.261211+0000","last_clean":"2024-09-11T22:20:49.261211+0000","last_became_active":"2024-09-11T22:20:49.259311+0000","last_became_peered":"2024-09-11T22:20:49.259311+0000","last_unstale":"2024-09-11T22:20:49.261211+0000","last_undegraded":"2024-09-11T22:20:49.261211+0000","last_fullsized":"2024-09-11T22:20:49.261211+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:35.150235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.288563+0000","last_change":"2024-09-11T22:20:47.288563+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.288563+0000","last_undegraded":"2024-09-11T22:20:47.288563+0000","last_fullsized":"2024-09-11T22:20:47.288563+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256698+0000","last_change":"2024-09-11T22:20:49.252061+0000","last_active":"2024-09-11T22:20:49.256698+0000","last_peered":"2024-09-11T22:20:49.256698+0000","last_clean":"2024-09-11T22:20:49.256698+0000","last_became_active":"2024-09-11T22:20:49.251776+0000","last_became_peered":"2024-09-11T22:20:49.251776+0000","last_unstale":"2024-09-11T22:20:49.256698+0000","last_undegraded":"2024-09-11T22:20:49.256698+0000","last_fullsized":"2024-09-11T22:20:49.256698+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:42.720833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.298359+0000","last_change":"2024-09-11T22:20:48.305063+0000","last_active":"2024-09-11T22:20:49.298359+0000","last_peered":"2024-09-11T22:20:49.298359+0000","last_clean":"2024-09-11T22:20:49.298359+0000","last_became_active":"2024-09-11T22:20:48.304721+0000","last_became_peered":"2024-09-11T22:20:48.304721+0000","last_unstale":"2024-09-11T22:20:49.298359+0000","last_undegraded":"2024-09-11T22:20:49.298359+0000","last_fullsized":"2024-09-11T22:20:49.298359+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:36.473732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261175+0000","last_change":"2024-09-11T22:20:49.258542+0000","last_active":"2024-09-11T22:20:49.261175+0000","last_peered":"2024-09-11T22:20:49.261175+0000","last_clean":"2024-09-11T22:20:49.261175+0000","last_became_active":"2024-09-11T22:20:49.258256+0000","last_became_peered":"2024-09-11T22:20:49.258256+0000","last_unstale":"2024-09-11T22:20:49.261175+0000","last_undegraded":"2024-09-11T22:20:49.261175+0000","last_fullsized":"2024-09-11T22:20:49.261175+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.165270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.288534+0000","last_change":"2024-09-11T22:20:47.288534+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.288534+0000","last_undegraded":"2024-09-11T22:20:47.288534+0000","last_fullsized":"2024-09-11T22:20:47.288534+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:20:48.281278+0000","last_change":"2024-09-11T22:20:48.281278+0000","last_active":"2024-09-11T22:20:48.281278+0000","last_peered":"2024-09-11T22:20:48.281278+0000","last_clean":"2024-09-11T22:20:48.281278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:48.281278+0000","last_undegraded":"2024-09-11T22:20:48.281278+0000","last_fullsized":"2024-09-11T22:20:48.281278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.240672+0000","last_change":"2024-09-11T22:20:48.296080+0000","last_active":"2024-09-11T22:20:49.240672+0000","last_peered":"2024-09-11T22:20:49.240672+0000","last_clean":"2024-09-11T22:20:49.240672+0000","last_became_active":"2024-09-11T22:20:48.295806+0000","last_became_peered":"2024-09-11T22:20:48.295806+0000","last_unstale":"2024-09-11T22:20:49.240672+0000","last_undegraded":"2024-09-11T22:20:49.240672+0000","last_fullsized":"2024-09-11T22:20:49.240672+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:19.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433538+0000","last_change":"2024-09-11T22:20:49.257288+0000","last_active":"2024-09-11T22:20:50.433538+0000","last_peered":"2024-09-11T22:20:50.433538+0000","last_clean":"2024-09-11T22:20:50.433538+0000","last_became_active":"2024-09-11T22:20:49.256626+0000","last_became_peered":"2024-09-11T22:20:49.256626+0000","last_unstale":"2024-09-11T22:20:50.433538+0000","last_undegraded":"2024-09-11T22:20:50.433538+0000","last_fullsized":"2024-09-11T22:20:50.433538+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:53.953093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":153,"state":"creating+peering","last_fresh":"2024-09-11T22:20:47.288687+0000","last_change":"2024-09-11T22:20:47.288687+0000","last_active":"2024-09-11T22:20:47.279401+0000","last_peered":"2024-09-11T22:20:47.279401+0000","last_clean":"2024-09-11T22:20:47.279401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:47.288687+0000","last_undegraded":"2024-09-11T22:20:47.288687+0000","last_fullsized":"2024-09-11T22:20:47.288687+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255201+0000","last_change":"2024-09-11T22:20:49.252744+0000","last_active":"2024-09-11T22:20:49.255201+0000","last_peered":"2024-09-11T22:20:49.255201+0000","last_clean":"2024-09-11T22:20:49.255201+0000","last_became_active":"2024-09-11T22:20:49.252458+0000","last_became_peered":"2024-09-11T22:20:49.252458+0000","last_unstale":"2024-09-11T22:20:49.255201+0000","last_undegraded":"2024-09-11T22:20:49.255201+0000","last_fullsized":"2024-09-11T22:20:49.255201+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:21.209058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.298270+0000","last_change":"2024-09-11T22:20:48.304158+0000","last_active":"2024-09-11T22:20:49.298270+0000","last_peered":"2024-09-11T22:20:49.298270+0000","last_clean":"2024-09-11T22:20:49.298270+0000","last_became_active":"2024-09-11T22:20:48.303869+0000","last_became_peered":"2024-09-11T22:20:48.303869+0000","last_unstale":"2024-09-11T22:20:49.298270+0000","last_undegraded":"2024-09-11T22:20:49.298270+0000","last_fullsized":"2024-09-11T22:20:49.298270+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:43.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.253562+0000","last_change":"2024-09-11T22:20:49.251765+0000","last_active":"2024-09-11T22:20:49.253562+0000","last_peered":"2024-09-11T22:20:49.253562+0000","last_clean":"2024-09-11T22:20:49.253562+0000","last_became_active":"2024-09-11T22:20:49.251469+0000","last_became_peered":"2024-09-11T22:20:49.251469+0000","last_unstale":"2024-09-11T22:20:49.253562+0000","last_undegraded":"2024-09-11T22:20:49.253562+0000","last_fullsized":"2024-09-11T22:20:49.253562+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:24.119485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.244047+0000","last_change":"2024-09-11T22:20:48.298375+0000","last_active":"2024-09-11T22:20:49.244047+0000","last_peered":"2024-09-11T22:20:49.244047+0000","last_clean":"2024-09-11T22:20:49.244047+0000","last_became_active":"2024-09-11T22:20:48.298114+0000","last_became_peered":"2024-09-11T22:20:48.298114+0000","last_unstale":"2024-09-11T22:20:49.244047+0000","last_undegraded":"2024-09-11T22:20:49.244047+0000","last_fullsized":"2024-09-11T22:20:49.244047+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:56.322627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433535+0000","last_change":"2024-09-11T22:20:49.259942+0000","last_active":"2024-09-11T22:20:50.433535+0000","last_peered":"2024-09-11T22:20:50.433535+0000","last_clean":"2024-09-11T22:20:50.433535+0000","last_became_active":"2024-09-11T22:20:49.259628+0000","last_became_peered":"2024-09-11T22:20:49.259628+0000","last_unstale":"2024-09-11T22:20:50.433535+0000","last_undegraded":"2024-09-11T22:20:50.433535+0000","last_fullsized":"2024-09-11T22:20:50.433535+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:12.697073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.244858+0000","last_change":"2024-09-11T22:20:48.303659+0000","last_active":"2024-09-11T22:20:49.244858+0000","last_peered":"2024-09-11T22:20:49.244858+0000","last_clean":"2024-09-11T22:20:49.244858+0000","last_became_active":"2024-09-11T22:20:48.303369+0000","last_became_peered":"2024-09-11T22:20:48.303369+0000","last_unstale":"2024-09-11T22:20:49.244858+0000","last_undegraded":"2024-09-11T22:20:49.244858+0000","last_fullsized":"2024-09-11T22:20:49.244858+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:51.679794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256985+0000","last_change":"2024-09-11T22:20:49.255571+0000","last_active":"2024-09-11T22:20:49.256985+0000","last_peered":"2024-09-11T22:20:49.256985+0000","last_clean":"2024-09-11T22:20:49.256985+0000","last_became_active":"2024-09-11T22:20:49.255282+0000","last_became_peered":"2024-09-11T22:20:49.255282+0000","last_unstale":"2024-09-11T22:20:49.256985+0000","last_undegraded":"2024-09-11T22:20:49.256985+0000","last_fullsized":"2024-09-11T22:20:49.256985+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:26:15.294230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.246751+0000","last_change":"2024-09-11T22:20:48.300370+0000","last_active":"2024-09-11T22:20:49.246751+0000","last_peered":"2024-09-11T22:20:49.246751+0000","last_clean":"2024-09-11T22:20:49.246751+0000","last_became_active":"2024-09-11T22:20:48.300068+0000","last_became_peered":"2024-09-11T22:20:48.300068+0000","last_unstale":"2024-09-11T22:20:49.246751+0000","last_undegraded":"2024-09-11T22:20:49.246751+0000","last_fullsized":"2024-09-11T22:20:49.246751+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:16.679941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262119+0000","last_change":"2024-09-11T22:20:49.260222+0000","last_active":"2024-09-11T22:20:49.262119+0000","last_peered":"2024-09-11T22:20:49.262119+0000","last_clean":"2024-09-11T22:20:49.262119+0000","last_became_active":"2024-09-11T22:20:49.258826+0000","last_became_peered":"2024-09-11T22:20:49.258826+0000","last_unstale":"2024-09-11T22:20:49.262119+0000","last_undegraded":"2024-09-11T22:20:49.262119+0000","last_fullsized":"2024-09-11T22:20:49.262119+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:48.356663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.253712+0000","last_change":"2024-09-11T22:20:48.296479+0000","last_active":"2024-09-11T22:20:49.253712+0000","last_peered":"2024-09-11T22:20:49.253712+0000","last_clean":"2024-09-11T22:20:49.253712+0000","last_became_active":"2024-09-11T22:20:48.296203+0000","last_became_peered":"2024-09-11T22:20:48.296203+0000","last_unstale":"2024-09-11T22:20:49.253712+0000","last_undegraded":"2024-09-11T22:20:49.253712+0000","last_fullsized":"2024-09-11T22:20:49.253712+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:36.473732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.264693+0000","last_change":"2024-09-11T22:20:49.264327+0000","last_active":"2024-09-11T22:20:49.264693+0000","last_peered":"2024-09-11T22:20:49.264693+0000","last_clean":"2024-09-11T22:20:49.264693+0000","last_became_active":"2024-09-11T22:20:49.264054+0000","last_became_peered":"2024-09-11T22:20:49.264054+0000","last_unstale":"2024-09-11T22:20:49.264693+0000","last_undegraded":"2024-09-11T22:20:49.264693+0000","last_fullsized":"2024-09-11T22:20:49.264693+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:41.858220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.241472+0000","last_change":"2024-09-11T22:20:48.307406+0000","last_active":"2024-09-11T22:20:49.241472+0000","last_peered":"2024-09-11T22:20:49.241472+0000","last_clean":"2024-09-11T22:20:49.241472+0000","last_became_active":"2024-09-11T22:20:48.306853+0000","last_became_peered":"2024-09-11T22:20:48.306853+0000","last_unstale":"2024-09-11T22:20:49.241472+0000","last_undegraded":"2024-09-11T22:20:49.241472+0000","last_fullsized":"2024-09-11T22:20:49.241472+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:58.807896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261340+0000","last_change":"2024-09-11T22:20:49.259551+0000","last_active":"2024-09-11T22:20:49.261340+0000","last_peered":"2024-09-11T22:20:49.261340+0000","last_clean":"2024-09-11T22:20:49.261340+0000","last_became_active":"2024-09-11T22:20:49.258914+0000","last_became_peered":"2024-09-11T22:20:49.258914+0000","last_unstale":"2024-09-11T22:20:49.261340+0000","last_undegraded":"2024-09-11T22:20:49.261340+0000","last_fullsized":"2024-09-11T22:20:49.261340+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:17.681818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.242779+0000","last_change":"2024-09-11T22:20:48.303303+0000","last_active":"2024-09-11T22:20:49.242779+0000","last_peered":"2024-09-11T22:20:49.242779+0000","last_clean":"2024-09-11T22:20:49.242779+0000","last_became_active":"2024-09-11T22:20:48.302954+0000","last_became_peered":"2024-09-11T22:20:48.302954+0000","last_unstale":"2024-09-11T22:20:49.242779+0000","last_undegraded":"2024-09-11T22:20:49.242779+0000","last_fullsized":"2024-09-11T22:20:49.242779+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:53.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261514+0000","last_change":"2024-09-11T22:20:49.260083+0000","last_active":"2024-09-11T22:20:49.261514+0000","last_peered":"2024-09-11T22:20:49.261514+0000","last_clean":"2024-09-11T22:20:49.261514+0000","last_became_active":"2024-09-11T22:20:49.259745+0000","last_became_peered":"2024-09-11T22:20:49.259745+0000","last_unstale":"2024-09-11T22:20:49.261514+0000","last_undegraded":"2024-09-11T22:20:49.261514+0000","last_fullsized":"2024-09-11T22:20:49.261514+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:17.694423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.253141+0000","last_change":"2024-09-11T22:20:48.300845+0000","last_active":"2024-09-11T22:20:49.253141+0000","last_peered":"2024-09-11T22:20:49.253141+0000","last_clean":"2024-09-11T22:20:49.253141+0000","last_became_active":"2024-09-11T22:20:48.298386+0000","last_became_peered":"2024-09-11T22:20:48.298386+0000","last_unstale":"2024-09-11T22:20:49.253141+0000","last_undegraded":"2024-09-11T22:20:49.253141+0000","last_fullsized":"2024-09-11T22:20:49.253141+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:37.937300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262848+0000","last_change":"2024-09-11T22:20:49.261945+0000","last_active":"2024-09-11T22:20:49.262848+0000","last_peered":"2024-09-11T22:20:49.262848+0000","last_clean":"2024-09-11T22:20:49.262848+0000","last_became_active":"2024-09-11T22:20:49.261653+0000","last_became_peered":"2024-09-11T22:20:49.261653+0000","last_unstale":"2024-09-11T22:20:49.262848+0000","last_undegraded":"2024-09-11T22:20:49.262848+0000","last_fullsized":"2024-09-11T22:20:49.262848+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:16.042772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.254831+0000","last_change":"2024-09-11T22:20:48.305326+0000","last_active":"2024-09-11T22:20:49.254831+0000","last_peered":"2024-09-11T22:20:49.254831+0000","last_clean":"2024-09-11T22:20:49.254831+0000","last_became_active":"2024-09-11T22:20:48.305080+0000","last_became_peered":"2024-09-11T22:20:48.305080+0000","last_unstale":"2024-09-11T22:20:49.254831+0000","last_undegraded":"2024-09-11T22:20:49.254831+0000","last_fullsized":"2024-09-11T22:20:49.254831+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:03.217415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":409,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T22:20:47.288350+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:20:47.288350+0000","last_peered":"2024-09-11T22:20:47.288350+0000","last_clean":"2024-09-11T22:20:47.288350+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:20:47.288350+0000","last_undegraded":"2024-09-11T22:20:47.288350+0000","last_fullsized":"2024-09-11T22:20:47.288350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":122,"acting":122,"num_store_stats":7},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":1758,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51124,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320716,"statfs":{"total":96636764160,"available":96584413184,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509559,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46956,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324884,"statfs":{"total":96636764160,"available":96588681216,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509561,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55304,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316536,"statfs":{"total":96636764160,"available":96580132864,"internally_reserved":0,"allocated":1953792,"data_stored":850830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59444,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312396,"statfs":{"total":96636764160,"available":96575893504,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63596,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308244,"statfs":{"total":96636764160,"available":96571641856,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509560,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55864,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315976,"statfs":{"total":96636764160,"available":96579559424,"internally_reserved":0,"allocated":2519040,"data_stored":1432741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51672,"kb_used_data":2436,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320168,"statfs":{"total":96636764160,"available":96583852032,"internally_reserved":0,"allocated":2494464,"data_stored":1420649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59464,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312376,"statfs":{"total":96636764160,"available":96575873024,"internally_reserved":0,"allocated":1953792,"data_stored":855538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:20:52.966 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3f is not active+clean 2024-09-11T22:20:52.966 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:20:48.281278+0000', 'last_change': '2024-09-11T22:20:48.281278+0000', 'last_active': '2024-09-11T22:20:48.281278+0000', 'last_peered': '2024-09-11T22:20:48.281278+0000', 'last_clean': '2024-09-11T22:20:48.281278+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:20:48.281278+0000', 'last_undegraded': '2024-09-11T22:20:48.281278+0000', 'last_fullsized': '2024-09-11T22:20:48.281278+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:48.281278+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:48.281278+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:48.281278+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:20:52.966 INFO:tasks.ceph.ceph_manager.ceph:PG 23.31 is not active+clean 2024-09-11T22:20:52.966 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:20:48.281278+0000', 'last_change': '2024-09-11T22:20:48.281278+0000', 'last_active': '2024-09-11T22:20:48.281278+0000', 'last_peered': '2024-09-11T22:20:48.281278+0000', 'last_clean': '2024-09-11T22:20:48.281278+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:20:48.281278+0000', 'last_undegraded': '2024-09-11T22:20:48.281278+0000', 'last_fullsized': '2024-09-11T22:20:48.281278+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:48.281278+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:48.281278+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:48.281278+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:20:52.966 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1f is not active+clean 2024-09-11T22:20:52.966 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 153, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:20:47.289517+0000', 'last_change': '2024-09-11T22:20:47.289517+0000', 'last_active': '2024-09-11T22:20:47.279401+0000', 'last_peered': '2024-09-11T22:20:47.279401+0000', 'last_clean': '2024-09-11T22:20:47.279401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:20:47.289517+0000', 'last_undegraded': '2024-09-11T22:20:47.289517+0000', 'last_fullsized': '2024-09-11T22:20:47.289517+0000', 'mapping_epoch': 153, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 153, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:20:52.966 INFO:tasks.ceph.ceph_manager.ceph:PG 22.d is not active+clean 2024-09-11T22:20:52.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 153, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:20:47.289493+0000', 'last_change': '2024-09-11T22:20:47.289493+0000', 'last_active': '2024-09-11T22:20:47.279401+0000', 'last_peered': '2024-09-11T22:20:47.279401+0000', 'last_clean': '2024-09-11T22:20:47.279401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:20:47.289493+0000', 'last_undegraded': '2024-09-11T22:20:47.289493+0000', 'last_fullsized': '2024-09-11T22:20:47.289493+0000', 'mapping_epoch': 153, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 153, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:20:52.967 INFO:tasks.ceph.ceph_manager.ceph:PG 22.c is not active+clean 2024-09-11T22:20:52.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 153, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:20:47.288563+0000', 'last_change': '2024-09-11T22:20:47.288563+0000', 'last_active': '2024-09-11T22:20:47.279401+0000', 'last_peered': '2024-09-11T22:20:47.279401+0000', 'last_clean': '2024-09-11T22:20:47.279401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:20:47.288563+0000', 'last_undegraded': '2024-09-11T22:20:47.288563+0000', 'last_fullsized': '2024-09-11T22:20:47.288563+0000', 'mapping_epoch': 153, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 153, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:20:52.967 INFO:tasks.ceph.ceph_manager.ceph:PG 22.a is not active+clean 2024-09-11T22:20:52.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 153, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:20:47.288534+0000', 'last_change': '2024-09-11T22:20:47.288534+0000', 'last_active': '2024-09-11T22:20:47.279401+0000', 'last_peered': '2024-09-11T22:20:47.279401+0000', 'last_clean': '2024-09-11T22:20:47.279401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:20:47.288534+0000', 'last_undegraded': '2024-09-11T22:20:47.288534+0000', 'last_fullsized': '2024-09-11T22:20:47.288534+0000', 'mapping_epoch': 153, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 153, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:20:52.967 INFO:tasks.ceph.ceph_manager.ceph:PG 23.8 is not active+clean 2024-09-11T22:20:52.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:20:48.281278+0000', 'last_change': '2024-09-11T22:20:48.281278+0000', 'last_active': '2024-09-11T22:20:48.281278+0000', 'last_peered': '2024-09-11T22:20:48.281278+0000', 'last_clean': '2024-09-11T22:20:48.281278+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:20:48.281278+0000', 'last_undegraded': '2024-09-11T22:20:48.281278+0000', 'last_fullsized': '2024-09-11T22:20:48.281278+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:48.281278+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:48.281278+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:48.281278+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:20:52.967 INFO:tasks.ceph.ceph_manager.ceph:PG 22.8 is not active+clean 2024-09-11T22:20:52.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 153, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:20:47.288687+0000', 'last_change': '2024-09-11T22:20:47.288687+0000', 'last_active': '2024-09-11T22:20:47.279401+0000', 'last_peered': '2024-09-11T22:20:47.279401+0000', 'last_clean': '2024-09-11T22:20:47.279401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:20:47.288687+0000', 'last_undegraded': '2024-09-11T22:20:47.288687+0000', 'last_fullsized': '2024-09-11T22:20:47.288687+0000', 'mapping_epoch': 153, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 153, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:47.279401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T22:20:52.968 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:20:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.102+0000 7f950fb59640 1 Processor -- start 2024-09-11T22:20:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.102+0000 7f950fb59640 1 -- start start 2024-09-11T22:20:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.103+0000 7f950fb59640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9508162a60 0x7f95080b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.103+0000 7f950fb59640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9508163080 con 0x7f950815e8e0 2024-09-11T22:20:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.103+0000 7f950fb59640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95080d2d20 con 0x7f95080d1c90 2024-09-11T22:20:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.103+0000 7f950fb59640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f950815ecc0 con 0x7f9508162a60 2024-09-11T22:20:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.103+0000 7f950d8f5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f950815e8e0 0x7f95080d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43798/0 (socket says 172.21.15.50:43798) 2024-09-11T22:20:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.103+0000 7f950d8f5640 1 -- 172.21.15.50:0/1582542324 learned_addr learned my addr 172.21.15.50:0/1582542324 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.103+0000 7f950e0f6640 1 --2- 172.21.15.50:0/1582542324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9508162a60 0x7f95080b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.103+0000 7f950c8f3640 1 -- 172.21.15.50:0/1582542324 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2431176299 0 0) 0x7f9508163080 con 0x7f950815e8e0 2024-09-11T22:20:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.103+0000 7f950c8f3640 1 -- 172.21.15.50:0/1582542324 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94f4003520 con 0x7f950815e8e0 2024-09-11T22:20:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.103+0000 7f950c8f3640 1 -- 172.21.15.50:0/1582542324 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2484638316 0 0) 0x7f95080d2d20 con 0x7f95080d1c90 2024-09-11T22:20:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.103+0000 7f950c8f3640 1 -- 172.21.15.50:0/1582542324 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9508163080 con 0x7f95080d1c90 2024-09-11T22:20:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.103+0000 7f950e0f6640 1 -- 172.21.15.50:0/1582542324 >> v1:172.21.15.77:6789/0 conn(0x7f95080d1c90 legacy=0x7f9508162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.104+0000 7f950e0f6640 1 -- 172.21.15.50:0/1582542324 >> v1:172.21.15.50:6789/0 conn(0x7f950815e8e0 legacy=0x7f95080d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.104+0000 7f950c8f3640 1 -- 172.21.15.50:0/1582542324 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2897745265 0 0) 0x7f94f4003520 con 0x7f950815e8e0 2024-09-11T22:20:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.104+0000 7f950e0f6640 1 -- 172.21.15.50:0/1582542324 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95080d3000 con 0x7f9508162a60 2024-09-11T22:20:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.104+0000 7f950e0f6640 1 --2- 172.21.15.50:0/1582542324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9508162a60 0x7f95080b7880 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9500009dc0 tx=0x7f950002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3150282a45ba11ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.104+0000 7f950c8f3640 1 -- 172.21.15.50:0/1582542324 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504001670 con 0x7f9508162a60 2024-09-11T22:20:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.105+0000 7f950c8f3640 1 -- 172.21.15.50:0/1582542324 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950002ae50 con 0x7f9508162a60 2024-09-11T22:20:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.105+0000 7f950c8f3640 1 -- 172.21.15.50:0/1582542324 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500007760 con 0x7f9508162a60 2024-09-11T22:20:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.105+0000 7f950fb59640 1 -- 172.21.15.50:0/1582542324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9508162a60 msgr2=0x7f95080b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.105+0000 7f950fb59640 1 --2- 172.21.15.50:0/1582542324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9508162a60 0x7f95080b7880 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9500009dc0 tx=0x7f950002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.105+0000 7f950fb59640 1 -- 172.21.15.50:0/1582542324 shutdown_connections 2024-09-11T22:20:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.105+0000 7f950fb59640 1 --2- 172.21.15.50:0/1582542324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9508162a60 0x7f95080b7880 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.105+0000 7f950fb59640 1 -- 172.21.15.50:0/1582542324 >> 172.21.15.50:0/1582542324 conn(0x7f9508067ba0 msgr2=0x7f9508067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.105+0000 7f950fb59640 1 -- 172.21.15.50:0/1582542324 shutdown_connections 2024-09-11T22:20:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.105+0000 7f950fb59640 1 -- 172.21.15.50:0/1582542324 wait complete. 2024-09-11T22:20:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.106+0000 7f950fb59640 1 Processor -- start 2024-09-11T22:20:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.106+0000 7f950fb59640 1 -- start start 2024-09-11T22:20:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.107+0000 7f950fb59640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95080d1c90 0x7f95080ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.107+0000 7f950fb59640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f950815e8e0 0x7f950815b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.107+0000 7f950fb59640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9508162a60 0x7f95081f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.107+0000 7f950fb59640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f95080d3bd0 con 0x7f9508162a60 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.107+0000 7f950fb59640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f95080d3a50 con 0x7f95080d1c90 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.107+0000 7f950fb59640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f95080d3d50 con 0x7f950815e8e0 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.107+0000 7f950e0f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9508162a60 0x7f95081f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.107+0000 7f950e0f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9508162a60 0x7f95081f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36928/0 (socket says 172.21.15.50:36928) 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.107+0000 7f950e0f6640 1 -- 172.21.15.50:0/74780007 learned_addr learned my addr 172.21.15.50:0/74780007 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.107+0000 7f950d8f5640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95080d1c90 0x7f95080ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.107+0000 7f950d0f4640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f950815e8e0 0x7f950815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.108+0000 7f950e0f6640 1 -- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f950815e8e0 msgr2=0x7f950815b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.108+0000 7f950e0f6640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f950815e8e0 0x7f950815b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.108+0000 7f950e0f6640 1 -- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95080d1c90 msgr2=0x7f95080ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.108+0000 7f950e0f6640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95080d1c90 0x7f95080ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.108+0000 7f950e0f6640 1 -- 172.21.15.50:0/74780007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95080cace0 con 0x7f9508162a60 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.108+0000 7f950e0f6640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9508162a60 0x7f95081f4560 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f9500009ee0 tx=0x7f9500004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.108+0000 7f94fe7fc640 1 -- 172.21.15.50:0/74780007 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950003f070 con 0x7f9508162a60 2024-09-11T22:20:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.108+0000 7f94fe7fc640 1 -- 172.21.15.50:0/74780007 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950003b820 con 0x7f9508162a60 2024-09-11T22:20:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.108+0000 7f950fb59640 1 -- 172.21.15.50:0/74780007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950815a0e0 con 0x7f9508162a60 2024-09-11T22:20:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.108+0000 7f94fe7fc640 1 -- 172.21.15.50:0/74780007 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950003bbd0 con 0x7f9508162a60 2024-09-11T22:20:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.108+0000 7f950fb59640 1 -- 172.21.15.50:0/74780007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f950815a6a0 con 0x7f9508162a60 2024-09-11T22:20:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.109+0000 7f950fb59640 1 -- 172.21.15.50:0/74780007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95080b7880 con 0x7f9508162a60 2024-09-11T22:20:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.110+0000 7f94fe7fc640 1 -- 172.21.15.50:0/74780007 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9500044460 con 0x7f9508162a60 2024-09-11T22:20:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.110+0000 7f94fe7fc640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f94ec06be30 0x7f94ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.110+0000 7f94fe7fc640 1 -- 172.21.15.50:0/74780007 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f95000ac1a0 con 0x7f9508162a60 2024-09-11T22:20:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.110+0000 7f950d8f5640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f94ec06be30 0x7f94ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.111+0000 7f950d8f5640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f94ec06be30 0x7f94ec06e2f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f95040017e0 tx=0x7f9504001610 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:53.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.115+0000 7f94fe7fc640 1 -- 172.21.15.50:0/74780007 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f950007a620 con 0x7f9508162a60 2024-09-11T22:20:53.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.358+0000 7f950fb59640 1 -- 172.21.15.50:0/74780007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f95080d1620 con 0x7f9508162a60 2024-09-11T22:20:53.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.358+0000 7f94fe7fc640 1 -- 172.21.15.50:0/74780007 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1641 (secure 0 0 0) 0x7f950007e920 con 0x7f9508162a60 2024-09-11T22:20:53.360 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:53.360 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":602,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":156,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":89},{"state_name":"creating+peering","count":5},{"state_name":"unknown","count":3}],"num_pgs":97,"num_pools":3,"num_objects":20,"data_bytes":592126,"bytes_used":454066176,"bytes_avail":772640047104,"bytes_total":773094113280,"unknown_pgs_ratio":0.030927835032343864,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":2914,"read_op_per_sec":0,"write_op_per_sec":9},"fsmap":{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9426}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-11T22:20:33.499640+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:20:53.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.360+0000 7f950fb59640 1 -- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f94ec06be30 msgr2=0x7f94ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.360+0000 7f950fb59640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f94ec06be30 0x7f94ec06e2f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f95040017e0 tx=0x7f9504001610 comp rx=0 tx=0).stop 2024-09-11T22:20:53.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.360+0000 7f950fb59640 1 -- 172.21.15.50:0/74780007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9508162a60 msgr2=0x7f95081f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.360+0000 7f950fb59640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9508162a60 0x7f95081f4560 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f9500009ee0 tx=0x7f9500004a40 comp rx=0 tx=0).stop 2024-09-11T22:20:53.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.360+0000 7f950fb59640 1 -- 172.21.15.50:0/74780007 shutdown_connections 2024-09-11T22:20:53.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.360+0000 7f950fb59640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f94ec06be30 0x7f94ec06e2f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.360+0000 7f950fb59640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f950815e8e0 0x7f950815b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.360+0000 7f950fb59640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9508162a60 0x7f95081f4560 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.360+0000 7f950fb59640 1 --2- 172.21.15.50:0/74780007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95080d1c90 0x7f95080ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.360+0000 7f950fb59640 1 -- 172.21.15.50:0/74780007 >> 172.21.15.50:0/74780007 conn(0x7f9508067ba0 msgr2=0x7f9508067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:53.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.360+0000 7f950fb59640 1 -- 172.21.15.50:0/74780007 shutdown_connections 2024-09-11T22:20:53.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.360+0000 7f950fb59640 1 -- 172.21.15.50:0/74780007 wait complete. 2024-09-11T22:20:53.373 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:20:53.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:20:53.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.473+0000 7f5e030c9640 1 Processor -- start 2024-09-11T22:20:53.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.473+0000 7f5e030c9640 1 -- start start 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.474+0000 7f5e030c9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dfc161d30 0x7f5dfc0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.474+0000 7f5e030c9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dfc162110 con 0x7f5dfc0b78f0 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.474+0000 7f5e030c9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dfc0cfd70 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.474+0000 7f5e030c9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5dfc0d3450 con 0x7f5dfc161d30 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.474+0000 7f5dfbfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5dfc0b78f0 0x7f5dfc162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43814/0 (socket says 172.21.15.50:43814) 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.474+0000 7f5dfbfff640 1 -- 172.21.15.50:0/1080204892 learned_addr learned my addr 172.21.15.50:0/1080204892 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.475+0000 7f5e00e65640 1 --2- 172.21.15.50:0/1080204892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dfc161d30 0x7f5dfc0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.475+0000 7f5dfb7fe640 1 -- 172.21.15.50:0/1080204892 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4293770266 0 0) 0x7f5dfc162110 con 0x7f5dfc0b78f0 2024-09-11T22:20:53.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.475+0000 7f5dfb7fe640 1 -- 172.21.15.50:0/1080204892 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5de8003520 con 0x7f5dfc0b78f0 2024-09-11T22:20:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.475+0000 7f5dfb7fe640 1 -- 172.21.15.50:0/1080204892 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2482835285 0 0) 0x7f5dfc0cfd70 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.475+0000 7f5dfb7fe640 1 -- 172.21.15.50:0/1080204892 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dfc162110 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.475+0000 7f5e00e65640 1 -- 172.21.15.50:0/1080204892 >> v1:172.21.15.77:6789/0 conn(0x7f5dfc0d11d0 legacy=0x7f5dfc0d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.475+0000 7f5dfb7fe640 1 -- 172.21.15.50:0/1080204892 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2690631946 0 0) 0x7f5de8003520 con 0x7f5dfc0b78f0 2024-09-11T22:20:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.475+0000 7f5e00e65640 1 -- 172.21.15.50:0/1080204892 >> v1:172.21.15.50:6789/0 conn(0x7f5dfc0b78f0 legacy=0x7f5dfc162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.475+0000 7f5e00e65640 1 -- 172.21.15.50:0/1080204892 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc0d2b20 con 0x7f5dfc161d30 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.476+0000 7f5e00e65640 1 --2- 172.21.15.50:0/1080204892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dfc161d30 0x7f5dfc0cf790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0097d0 tx=0x7f5dec02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b73fc5a49aaa611 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.476+0000 7f5dfb7fe640 1 -- 172.21.15.50:0/1080204892 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec037070 con 0x7f5dfc161d30 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.476+0000 7f5dfb7fe640 1 -- 172.21.15.50:0/1080204892 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dec02ac30 con 0x7f5dfc161d30 2024-09-11T22:20:53.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.476+0000 7f5dfb7fe640 1 -- 172.21.15.50:0/1080204892 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4001670 con 0x7f5dfc161d30 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.476+0000 7f5e030c9640 1 -- 172.21.15.50:0/1080204892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dfc161d30 msgr2=0x7f5dfc0cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.476+0000 7f5e030c9640 1 --2- 172.21.15.50:0/1080204892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dfc161d30 0x7f5dfc0cf790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0097d0 tx=0x7f5dec02a1a0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.477+0000 7f5e030c9640 1 -- 172.21.15.50:0/1080204892 shutdown_connections 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.477+0000 7f5e030c9640 1 --2- 172.21.15.50:0/1080204892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dfc161d30 0x7f5dfc0cf790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.477+0000 7f5e030c9640 1 -- 172.21.15.50:0/1080204892 >> 172.21.15.50:0/1080204892 conn(0x7f5dfc0727a0 msgr2=0x7f5dfc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.477+0000 7f5e030c9640 1 -- 172.21.15.50:0/1080204892 shutdown_connections 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.477+0000 7f5e030c9640 1 -- 172.21.15.50:0/1080204892 wait complete. 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.478+0000 7f5e030c9640 1 Processor -- start 2024-09-11T22:20:53.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.478+0000 7f5e030c9640 1 -- start start 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5e030c9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dfc0b78f0 0x7f5dfc156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5e030c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0d11d0 0x7f5dfc0c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5e030c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dfc161d30 0x7f5dfc15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5e030c9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc0b7d30 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5e030c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc0d30e0 con 0x7f5dfc161d30 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5e030c9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5dfc0d1660 con 0x7f5dfc0b78f0 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0d11d0 0x7f5dfc0c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0d11d0 0x7f5dfc0c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36936/0 (socket says 172.21.15.50:36936) 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5dfbfff640 1 -- 172.21.15.50:0/4177071371 learned_addr learned my addr 172.21.15.50:0/4177071371 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5e00e65640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dfc0b78f0 0x7f5dfc156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5e01666640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dfc161d30 0x7f5dfc15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5dfbfff640 1 -- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dfc0b78f0 msgr2=0x7f5dfc156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5dfbfff640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dfc0b78f0 0x7f5dfc156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5dfbfff640 1 -- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dfc161d30 msgr2=0x7f5dfc15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5dfbfff640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dfc161d30 0x7f5dfc15a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5dfbfff640 1 -- 172.21.15.50:0/4177071371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc0ca950 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5dfbfff640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0d11d0 0x7f5dfc0c9f40 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f5de400c750 tx=0x7f5de400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.479+0000 7f5df97fa640 1 -- 172.21.15.50:0/4177071371 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4017070 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.480+0000 7f5e030c9640 1 -- 172.21.15.50:0/4177071371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dfc0cac30 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.480+0000 7f5df97fa640 1 -- 172.21.15.50:0/4177071371 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de4005ad0 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.480+0000 7f5df97fa640 1 -- 172.21.15.50:0/4177071371 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4007070 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.480+0000 7f5e030c9640 1 -- 172.21.15.50:0/4177071371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dfc0caf10 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.480+0000 7f5e030c9640 1 -- 172.21.15.50:0/4177071371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dfc0cfd70 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.481+0000 7f5df97fa640 1 -- 172.21.15.50:0/4177071371 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5de401a070 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.481+0000 7f5df97fa640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ddc06be60 0x7f5ddc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.482+0000 7f5df97fa640 1 -- 172.21.15.50:0/4177071371 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f5de408a260 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.482+0000 7f5e00e65640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ddc06be60 0x7f5ddc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:53.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.482+0000 7f5e00e65640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ddc06be60 0x7f5ddc06e320 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5dec034000 tx=0x7f5dec02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:53.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.486+0000 7f5df97fa640 1 -- 172.21.15.50:0/4177071371 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5de4058540 con 0x7f5dfc0d11d0 2024-09-11T22:20:53.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.659+0000 7f5e030c9640 1 -- 172.21.15.50:0/4177071371 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5dfc15ed70 con 0x7f5ddc06be60 2024-09-11T22:20:53.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.666+0000 7f5df97fa640 1 -- 172.21.15.50:0/4177071371 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252424 (secure 0 0 0) 0x7f5dfc15ed70 con 0x7f5ddc06be60 2024-09-11T22:20:53.670 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:53.671 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:20:53.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.669+0000 7f5e030c9640 1 -- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ddc06be60 msgr2=0x7f5ddc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.669+0000 7f5e030c9640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ddc06be60 0x7f5ddc06e320 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5dec034000 tx=0x7f5dec02e000 comp rx=0 tx=0).stop 2024-09-11T22:20:53.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.669+0000 7f5e030c9640 1 -- 172.21.15.50:0/4177071371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0d11d0 msgr2=0x7f5dfc0c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.669+0000 7f5e030c9640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0d11d0 0x7f5dfc0c9f40 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f5de400c750 tx=0x7f5de400cc10 comp rx=0 tx=0).stop 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.669+0000 7f5e030c9640 1 -- 172.21.15.50:0/4177071371 shutdown_connections 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.669+0000 7f5e030c9640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ddc06be60 0x7f5ddc06e320 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.669+0000 7f5e030c9640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dfc161d30 0x7f5dfc15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.669+0000 7f5e030c9640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5dfc0d11d0 0x7f5dfc0c9f40 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.669+0000 7f5e030c9640 1 --2- 172.21.15.50:0/4177071371 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dfc0b78f0 0x7f5dfc156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.669+0000 7f5e030c9640 1 -- 172.21.15.50:0/4177071371 >> 172.21.15.50:0/4177071371 conn(0x7f5dfc0727a0 msgr2=0x7f5dfc0cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.669+0000 7f5e030c9640 1 -- 172.21.15.50:0/4177071371 shutdown_connections 2024-09-11T22:20:53.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:53.669+0000 7f5e030c9640 1 -- 172.21.15.50:0/4177071371 wait complete. 2024-09-11T22:20:53.682 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2024-09-11T22:20:53.504186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":443500,"kb_used_data":16304,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754531220,"statfs":{"total":773094113280,"available":772639969280,"internally_reserved":0,"allocated":16695296,"data_stored":7956771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001700"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243131+0000","last_change":"2024-09-11T22:20:49.257219+0000","last_active":"2024-09-11T22:20:50.243131+0000","last_peered":"2024-09-11T22:20:50.243131+0000","last_clean":"2024-09-11T22:20:50.243131+0000","last_became_active":"2024-09-11T22:20:49.256714+0000","last_became_peered":"2024-09-11T22:20:49.256714+0000","last_unstale":"2024-09-11T22:20:50.243131+0000","last_undegraded":"2024-09-11T22:20:50.243131+0000","last_fullsized":"2024-09-11T22:20:50.243131+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:04.637609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.258256+0000","last_change":"2024-09-11T22:20:49.256687+0000","last_active":"2024-09-11T22:20:49.258256+0000","last_peered":"2024-09-11T22:20:49.258256+0000","last_clean":"2024-09-11T22:20:49.258256+0000","last_became_active":"2024-09-11T22:20:49.255413+0000","last_became_peered":"2024-09-11T22:20:49.255413+0000","last_unstale":"2024-09-11T22:20:49.258256+0000","last_undegraded":"2024-09-11T22:20:49.258256+0000","last_fullsized":"2024-09-11T22:20:49.258256+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:12.487278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261672+0000","last_change":"2024-09-11T22:20:49.259480+0000","last_active":"2024-09-11T22:20:49.261672+0000","last_peered":"2024-09-11T22:20:49.261672+0000","last_clean":"2024-09-11T22:20:49.261672+0000","last_became_active":"2024-09-11T22:20:49.259173+0000","last_became_peered":"2024-09-11T22:20:49.259173+0000","last_unstale":"2024-09-11T22:20:49.261672+0000","last_undegraded":"2024-09-11T22:20:49.261672+0000","last_fullsized":"2024-09-11T22:20:49.261672+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:18.167932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262191+0000","last_change":"2024-09-11T22:20:49.255277+0000","last_active":"2024-09-11T22:20:49.262191+0000","last_peered":"2024-09-11T22:20:49.262191+0000","last_clean":"2024-09-11T22:20:49.262191+0000","last_became_active":"2024-09-11T22:20:49.254171+0000","last_became_peered":"2024-09-11T22:20:49.254171+0000","last_unstale":"2024-09-11T22:20:49.262191+0000","last_undegraded":"2024-09-11T22:20:49.262191+0000","last_fullsized":"2024-09-11T22:20:49.262191+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:40:51.621945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.258094+0000","last_change":"2024-09-11T22:20:49.256296+0000","last_active":"2024-09-11T22:20:49.258094+0000","last_peered":"2024-09-11T22:20:49.258094+0000","last_clean":"2024-09-11T22:20:49.258094+0000","last_became_active":"2024-09-11T22:20:49.255999+0000","last_became_peered":"2024-09-11T22:20:49.255999+0000","last_unstale":"2024-09-11T22:20:49.258094+0000","last_undegraded":"2024-09-11T22:20:49.258094+0000","last_fullsized":"2024-09-11T22:20:49.258094+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:37.475609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433430+0000","last_change":"2024-09-11T22:20:49.257008+0000","last_active":"2024-09-11T22:20:50.433430+0000","last_peered":"2024-09-11T22:20:50.433430+0000","last_clean":"2024-09-11T22:20:50.433430+0000","last_became_active":"2024-09-11T22:20:49.256658+0000","last_became_peered":"2024-09-11T22:20:49.256658+0000","last_unstale":"2024-09-11T22:20:50.433430+0000","last_undegraded":"2024-09-11T22:20:50.433430+0000","last_fullsized":"2024-09-11T22:20:50.433430+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:38.632671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261461+0000","last_change":"2024-09-11T22:20:49.259937+0000","last_active":"2024-09-11T22:20:49.261461+0000","last_peered":"2024-09-11T22:20:49.261461+0000","last_clean":"2024-09-11T22:20:49.261461+0000","last_became_active":"2024-09-11T22:20:49.259497+0000","last_became_peered":"2024-09-11T22:20:49.259497+0000","last_unstale":"2024-09-11T22:20:49.261461+0000","last_undegraded":"2024-09-11T22:20:49.261461+0000","last_fullsized":"2024-09-11T22:20:49.261461+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:44.823149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257042+0000","last_change":"2024-09-11T22:20:49.254113+0000","last_active":"2024-09-11T22:20:49.257042+0000","last_peered":"2024-09-11T22:20:49.257042+0000","last_clean":"2024-09-11T22:20:49.257042+0000","last_became_active":"2024-09-11T22:20:49.253821+0000","last_became_peered":"2024-09-11T22:20:49.253821+0000","last_unstale":"2024-09-11T22:20:49.257042+0000","last_undegraded":"2024-09-11T22:20:49.257042+0000","last_fullsized":"2024-09-11T22:20:49.257042+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:08.830514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257641+0000","last_change":"2024-09-11T22:20:49.256195+0000","last_active":"2024-09-11T22:20:49.257641+0000","last_peered":"2024-09-11T22:20:49.257641+0000","last_clean":"2024-09-11T22:20:49.257641+0000","last_became_active":"2024-09-11T22:20:49.255711+0000","last_became_peered":"2024-09-11T22:20:49.255711+0000","last_unstale":"2024-09-11T22:20:49.257641+0000","last_undegraded":"2024-09-11T22:20:49.257641+0000","last_fullsized":"2024-09-11T22:20:49.257641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:38.939177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.252003+0000","last_change":"2024-09-11T22:20:49.249631+0000","last_active":"2024-09-11T22:20:49.252003+0000","last_peered":"2024-09-11T22:20:49.252003+0000","last_clean":"2024-09-11T22:20:49.252003+0000","last_became_active":"2024-09-11T22:20:49.249320+0000","last_became_peered":"2024-09-11T22:20:49.249320+0000","last_unstale":"2024-09-11T22:20:49.252003+0000","last_undegraded":"2024-09-11T22:20:49.252003+0000","last_fullsized":"2024-09-11T22:20:49.252003+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:26.278211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.258132+0000","last_change":"2024-09-11T22:20:49.257141+0000","last_active":"2024-09-11T22:20:49.258132+0000","last_peered":"2024-09-11T22:20:49.258132+0000","last_clean":"2024-09-11T22:20:49.258132+0000","last_became_active":"2024-09-11T22:20:49.256842+0000","last_became_peered":"2024-09-11T22:20:49.256842+0000","last_unstale":"2024-09-11T22:20:49.258132+0000","last_undegraded":"2024-09-11T22:20:49.258132+0000","last_fullsized":"2024-09-11T22:20:49.258132+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:24.667187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257576+0000","last_change":"2024-09-11T22:20:49.255216+0000","last_active":"2024-09-11T22:20:49.257576+0000","last_peered":"2024-09-11T22:20:49.257576+0000","last_clean":"2024-09-11T22:20:49.257576+0000","last_became_active":"2024-09-11T22:20:49.253715+0000","last_became_peered":"2024-09-11T22:20:49.253715+0000","last_unstale":"2024-09-11T22:20:49.257576+0000","last_undegraded":"2024-09-11T22:20:49.257576+0000","last_fullsized":"2024-09-11T22:20:49.257576+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:20.358674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256760+0000","last_change":"2024-09-11T22:20:49.252882+0000","last_active":"2024-09-11T22:20:49.256760+0000","last_peered":"2024-09-11T22:20:49.256760+0000","last_clean":"2024-09-11T22:20:49.256760+0000","last_became_active":"2024-09-11T22:20:49.252605+0000","last_became_peered":"2024-09-11T22:20:49.252605+0000","last_unstale":"2024-09-11T22:20:49.256760+0000","last_undegraded":"2024-09-11T22:20:49.256760+0000","last_fullsized":"2024-09-11T22:20:49.256760+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:34:50.130283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256719+0000","last_change":"2024-09-11T22:20:49.253678+0000","last_active":"2024-09-11T22:20:49.256719+0000","last_peered":"2024-09-11T22:20:49.256719+0000","last_clean":"2024-09-11T22:20:49.256719+0000","last_became_active":"2024-09-11T22:20:49.253341+0000","last_became_peered":"2024-09-11T22:20:49.253341+0000","last_unstale":"2024-09-11T22:20:49.256719+0000","last_undegraded":"2024-09-11T22:20:49.256719+0000","last_fullsized":"2024-09-11T22:20:49.256719+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.774600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242650+0000","last_change":"2024-09-11T22:20:49.259260+0000","last_active":"2024-09-11T22:20:50.242650+0000","last_peered":"2024-09-11T22:20:50.242650+0000","last_clean":"2024-09-11T22:20:50.242650+0000","last_became_active":"2024-09-11T22:20:49.258969+0000","last_became_peered":"2024-09-11T22:20:49.258969+0000","last_unstale":"2024-09-11T22:20:50.242650+0000","last_undegraded":"2024-09-11T22:20:50.242650+0000","last_fullsized":"2024-09-11T22:20:50.242650+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:44.575146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261360+0000","last_change":"2024-09-11T22:20:49.260060+0000","last_active":"2024-09-11T22:20:49.261360+0000","last_peered":"2024-09-11T22:20:49.261360+0000","last_clean":"2024-09-11T22:20:49.261360+0000","last_became_active":"2024-09-11T22:20:49.259343+0000","last_became_peered":"2024-09-11T22:20:49.259343+0000","last_unstale":"2024-09-11T22:20:49.261360+0000","last_undegraded":"2024-09-11T22:20:49.261360+0000","last_fullsized":"2024-09-11T22:20:49.261360+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433734+0000","last_change":"2024-09-11T22:20:49.256020+0000","last_active":"2024-09-11T22:20:50.433734+0000","last_peered":"2024-09-11T22:20:50.433734+0000","last_clean":"2024-09-11T22:20:50.433734+0000","last_became_active":"2024-09-11T22:20:49.255719+0000","last_became_peered":"2024-09-11T22:20:49.255719+0000","last_unstale":"2024-09-11T22:20:50.433734+0000","last_undegraded":"2024-09-11T22:20:50.433734+0000","last_fullsized":"2024-09-11T22:20:50.433734+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:14.287208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255186+0000","last_change":"2024-09-11T22:20:49.252133+0000","last_active":"2024-09-11T22:20:49.255186+0000","last_peered":"2024-09-11T22:20:49.255186+0000","last_clean":"2024-09-11T22:20:49.255186+0000","last_became_active":"2024-09-11T22:20:49.251795+0000","last_became_peered":"2024-09-11T22:20:49.251795+0000","last_unstale":"2024-09-11T22:20:49.255186+0000","last_undegraded":"2024-09-11T22:20:49.255186+0000","last_fullsized":"2024-09-11T22:20:49.255186+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:59.356235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433641+0000","last_change":"2024-09-11T22:20:49.260981+0000","last_active":"2024-09-11T22:20:50.433641+0000","last_peered":"2024-09-11T22:20:50.433641+0000","last_clean":"2024-09-11T22:20:50.433641+0000","last_became_active":"2024-09-11T22:20:49.260597+0000","last_became_peered":"2024-09-11T22:20:49.260597+0000","last_unstale":"2024-09-11T22:20:50.433641+0000","last_undegraded":"2024-09-11T22:20:50.433641+0000","last_fullsized":"2024-09-11T22:20:50.433641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:36.018303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.260611+0000","last_change":"2024-09-11T22:20:49.254914+0000","last_active":"2024-09-11T22:20:49.260611+0000","last_peered":"2024-09-11T22:20:49.260611+0000","last_clean":"2024-09-11T22:20:49.260611+0000","last_became_active":"2024-09-11T22:20:49.254597+0000","last_became_peered":"2024-09-11T22:20:49.254597+0000","last_unstale":"2024-09-11T22:20:49.260611+0000","last_undegraded":"2024-09-11T22:20:49.260611+0000","last_fullsized":"2024-09-11T22:20:49.260611+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:43.034095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433366+0000","last_change":"2024-09-11T22:20:49.258117+0000","last_active":"2024-09-11T22:20:50.433366+0000","last_peered":"2024-09-11T22:20:50.433366+0000","last_clean":"2024-09-11T22:20:50.433366+0000","last_became_active":"2024-09-11T22:20:49.257806+0000","last_became_peered":"2024-09-11T22:20:49.257806+0000","last_unstale":"2024-09-11T22:20:50.433366+0000","last_undegraded":"2024-09-11T22:20:50.433366+0000","last_fullsized":"2024-09-11T22:20:50.433366+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:20.317862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255549+0000","last_change":"2024-09-11T22:20:49.251616+0000","last_active":"2024-09-11T22:20:49.255549+0000","last_peered":"2024-09-11T22:20:49.255549+0000","last_clean":"2024-09-11T22:20:49.255549+0000","last_became_active":"2024-09-11T22:20:49.250819+0000","last_became_peered":"2024-09-11T22:20:49.250819+0000","last_unstale":"2024-09-11T22:20:49.255549+0000","last_undegraded":"2024-09-11T22:20:49.255549+0000","last_fullsized":"2024-09-11T22:20:49.255549+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:06.751192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433478+0000","last_change":"2024-09-11T22:20:49.258445+0000","last_active":"2024-09-11T22:20:50.433478+0000","last_peered":"2024-09-11T22:20:50.433478+0000","last_clean":"2024-09-11T22:20:50.433478+0000","last_became_active":"2024-09-11T22:20:49.258097+0000","last_became_peered":"2024-09-11T22:20:49.258097+0000","last_unstale":"2024-09-11T22:20:50.433478+0000","last_undegraded":"2024-09-11T22:20:50.433478+0000","last_fullsized":"2024-09-11T22:20:50.433478+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:24.802538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.250639+0000","last_change":"2024-09-11T22:20:49.248979+0000","last_active":"2024-09-11T22:20:49.250639+0000","last_peered":"2024-09-11T22:20:49.250639+0000","last_clean":"2024-09-11T22:20:49.250639+0000","last_became_active":"2024-09-11T22:20:49.248650+0000","last_became_peered":"2024-09-11T22:20:49.248650+0000","last_unstale":"2024-09-11T22:20:49.250639+0000","last_undegraded":"2024-09-11T22:20:49.250639+0000","last_fullsized":"2024-09-11T22:20:49.250639+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:21.294375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261194+0000","last_change":"2024-09-11T22:20:49.257680+0000","last_active":"2024-09-11T22:20:49.261194+0000","last_peered":"2024-09-11T22:20:49.261194+0000","last_clean":"2024-09-11T22:20:49.261194+0000","last_became_active":"2024-09-11T22:20:49.257402+0000","last_became_peered":"2024-09-11T22:20:49.257402+0000","last_unstale":"2024-09-11T22:20:49.261194+0000","last_undegraded":"2024-09-11T22:20:49.261194+0000","last_fullsized":"2024-09-11T22:20:49.261194+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:04.776287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261300+0000","last_change":"2024-09-11T22:20:49.253221+0000","last_active":"2024-09-11T22:20:49.261300+0000","last_peered":"2024-09-11T22:20:49.261300+0000","last_clean":"2024-09-11T22:20:49.261300+0000","last_became_active":"2024-09-11T22:20:49.252517+0000","last_became_peered":"2024-09-11T22:20:49.252517+0000","last_unstale":"2024-09-11T22:20:49.261300+0000","last_undegraded":"2024-09-11T22:20:49.261300+0000","last_fullsized":"2024-09-11T22:20:49.261300+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:35.695376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.263489+0000","last_change":"2024-09-11T22:20:49.263087+0000","last_active":"2024-09-11T22:20:49.263489+0000","last_peered":"2024-09-11T22:20:49.263489+0000","last_clean":"2024-09-11T22:20:49.263489+0000","last_became_active":"2024-09-11T22:20:49.262855+0000","last_became_peered":"2024-09-11T22:20:49.262855+0000","last_unstale":"2024-09-11T22:20:49.263489+0000","last_undegraded":"2024-09-11T22:20:49.263489+0000","last_fullsized":"2024-09-11T22:20:49.263489+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:34.118858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262208+0000","last_change":"2024-09-11T22:20:49.257721+0000","last_active":"2024-09-11T22:20:49.262208+0000","last_peered":"2024-09-11T22:20:49.262208+0000","last_clean":"2024-09-11T22:20:49.262208+0000","last_became_active":"2024-09-11T22:20:49.257445+0000","last_became_peered":"2024-09-11T22:20:49.257445+0000","last_unstale":"2024-09-11T22:20:49.262208+0000","last_undegraded":"2024-09-11T22:20:49.262208+0000","last_fullsized":"2024-09-11T22:20:49.262208+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:19.202899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.247561+0000","last_change":"2024-09-11T22:20:49.246147+0000","last_active":"2024-09-11T22:20:49.247561+0000","last_peered":"2024-09-11T22:20:49.247561+0000","last_clean":"2024-09-11T22:20:49.247561+0000","last_became_active":"2024-09-11T22:20:49.245562+0000","last_became_peered":"2024-09-11T22:20:49.245562+0000","last_unstale":"2024-09-11T22:20:49.247561+0000","last_undegraded":"2024-09-11T22:20:49.247561+0000","last_fullsized":"2024-09-11T22:20:49.247561+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:10.816175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261176+0000","last_change":"2024-09-11T22:20:49.257292+0000","last_active":"2024-09-11T22:20:49.261176+0000","last_peered":"2024-09-11T22:20:49.261176+0000","last_clean":"2024-09-11T22:20:49.261176+0000","last_became_active":"2024-09-11T22:20:49.257017+0000","last_became_peered":"2024-09-11T22:20:49.257017+0000","last_unstale":"2024-09-11T22:20:49.261176+0000","last_undegraded":"2024-09-11T22:20:49.261176+0000","last_fullsized":"2024-09-11T22:20:49.261176+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:42.578739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261718+0000","last_change":"2024-09-11T22:20:49.260855+0000","last_active":"2024-09-11T22:20:49.261718+0000","last_peered":"2024-09-11T22:20:49.261718+0000","last_clean":"2024-09-11T22:20:49.261718+0000","last_became_active":"2024-09-11T22:20:49.260572+0000","last_became_peered":"2024-09-11T22:20:49.260572+0000","last_unstale":"2024-09-11T22:20:49.261718+0000","last_undegraded":"2024-09-11T22:20:49.261718+0000","last_fullsized":"2024-09-11T22:20:49.261718+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:21.343711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255735+0000","last_change":"2024-09-11T22:20:49.253506+0000","last_active":"2024-09-11T22:20:49.255735+0000","last_peered":"2024-09-11T22:20:49.255735+0000","last_clean":"2024-09-11T22:20:49.255735+0000","last_became_active":"2024-09-11T22:20:49.253215+0000","last_became_peered":"2024-09-11T22:20:49.253215+0000","last_unstale":"2024-09-11T22:20:49.255735+0000","last_undegraded":"2024-09-11T22:20:49.255735+0000","last_fullsized":"2024-09-11T22:20:49.255735+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:18.404645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261321+0000","last_change":"2024-09-11T22:20:49.253239+0000","last_active":"2024-09-11T22:20:49.261321+0000","last_peered":"2024-09-11T22:20:49.261321+0000","last_clean":"2024-09-11T22:20:49.261321+0000","last_became_active":"2024-09-11T22:20:49.252953+0000","last_became_peered":"2024-09-11T22:20:49.252953+0000","last_unstale":"2024-09-11T22:20:49.261321+0000","last_undegraded":"2024-09-11T22:20:49.261321+0000","last_fullsized":"2024-09-11T22:20:49.261321+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:57.132602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"155'4","reported_seq":18,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243195+0000","last_change":"2024-09-11T22:20:48.301320+0000","last_active":"2024-09-11T22:20:50.243195+0000","last_peered":"2024-09-11T22:20:50.243195+0000","last_clean":"2024-09-11T22:20:50.243195+0000","last_became_active":"2024-09-11T22:20:48.299916+0000","last_became_peered":"2024-09-11T22:20:48.299916+0000","last_unstale":"2024-09-11T22:20:50.243195+0000","last_undegraded":"2024-09-11T22:20:50.243195+0000","last_fullsized":"2024-09-11T22:20:50.243195+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:16.928786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261197+0000","last_change":"2024-09-11T22:20:49.256402+0000","last_active":"2024-09-11T22:20:49.261197+0000","last_peered":"2024-09-11T22:20:49.261197+0000","last_clean":"2024-09-11T22:20:49.261197+0000","last_became_active":"2024-09-11T22:20:49.256119+0000","last_became_peered":"2024-09-11T22:20:49.256119+0000","last_unstale":"2024-09-11T22:20:49.261197+0000","last_undegraded":"2024-09-11T22:20:49.261197+0000","last_fullsized":"2024-09-11T22:20:49.261197+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:31.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296169+0000","last_change":"2024-09-11T22:20:48.301059+0000","last_active":"2024-09-11T22:20:49.296169+0000","last_peered":"2024-09-11T22:20:49.296169+0000","last_clean":"2024-09-11T22:20:49.296169+0000","last_became_active":"2024-09-11T22:20:48.300798+0000","last_became_peered":"2024-09-11T22:20:48.300798+0000","last_unstale":"2024-09-11T22:20:49.296169+0000","last_undegraded":"2024-09-11T22:20:49.296169+0000","last_fullsized":"2024-09-11T22:20:49.296169+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:58.807896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433340+0000","last_change":"2024-09-11T22:20:49.254064+0000","last_active":"2024-09-11T22:20:50.433340+0000","last_peered":"2024-09-11T22:20:50.433340+0000","last_clean":"2024-09-11T22:20:50.433340+0000","last_became_active":"2024-09-11T22:20:49.253755+0000","last_became_peered":"2024-09-11T22:20:49.253755+0000","last_unstale":"2024-09-11T22:20:50.433340+0000","last_undegraded":"2024-09-11T22:20:50.433340+0000","last_fullsized":"2024-09-11T22:20:50.433340+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:32.881230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.298275+0000","last_change":"2024-09-11T22:20:48.305983+0000","last_active":"2024-09-11T22:20:49.298275+0000","last_peered":"2024-09-11T22:20:49.298275+0000","last_clean":"2024-09-11T22:20:49.298275+0000","last_became_active":"2024-09-11T22:20:48.305565+0000","last_became_peered":"2024-09-11T22:20:48.305565+0000","last_unstale":"2024-09-11T22:20:49.298275+0000","last_undegraded":"2024-09-11T22:20:49.298275+0000","last_fullsized":"2024-09-11T22:20:49.298275+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.485401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261649+0000","last_change":"2024-09-11T22:20:49.258388+0000","last_active":"2024-09-11T22:20:49.261649+0000","last_peered":"2024-09-11T22:20:49.261649+0000","last_clean":"2024-09-11T22:20:49.261649+0000","last_became_active":"2024-09-11T22:20:49.258045+0000","last_became_peered":"2024-09-11T22:20:49.258045+0000","last_unstale":"2024-09-11T22:20:49.261649+0000","last_undegraded":"2024-09-11T22:20:49.261649+0000","last_fullsized":"2024-09-11T22:20:49.261649+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:32:05.512930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.299575+0000","last_change":"2024-09-11T22:20:48.307332+0000","last_active":"2024-09-11T22:20:49.299575+0000","last_peered":"2024-09-11T22:20:49.299575+0000","last_clean":"2024-09-11T22:20:49.299575+0000","last_became_active":"2024-09-11T22:20:48.306940+0000","last_became_peered":"2024-09-11T22:20:48.306940+0000","last_unstale":"2024-09-11T22:20:49.299575+0000","last_undegraded":"2024-09-11T22:20:49.299575+0000","last_fullsized":"2024-09-11T22:20:49.299575+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:03.217415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261796+0000","last_change":"2024-09-11T22:20:49.253030+0000","last_active":"2024-09-11T22:20:49.261796+0000","last_peered":"2024-09-11T22:20:49.261796+0000","last_clean":"2024-09-11T22:20:49.261796+0000","last_became_active":"2024-09-11T22:20:49.252290+0000","last_became_peered":"2024-09-11T22:20:49.252290+0000","last_unstale":"2024-09-11T22:20:49.261796+0000","last_undegraded":"2024-09-11T22:20:49.261796+0000","last_fullsized":"2024-09-11T22:20:49.261796+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:25.075906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296158+0000","last_change":"2024-09-11T22:20:48.297836+0000","last_active":"2024-09-11T22:20:49.296158+0000","last_peered":"2024-09-11T22:20:49.296158+0000","last_clean":"2024-09-11T22:20:49.296158+0000","last_became_active":"2024-09-11T22:20:48.297270+0000","last_became_peered":"2024-09-11T22:20:48.297270+0000","last_unstale":"2024-09-11T22:20:49.296158+0000","last_undegraded":"2024-09-11T22:20:49.296158+0000","last_fullsized":"2024-09-11T22:20:49.296158+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:26.844219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262374+0000","last_change":"2024-09-11T22:20:49.259041+0000","last_active":"2024-09-11T22:20:49.262374+0000","last_peered":"2024-09-11T22:20:49.262374+0000","last_clean":"2024-09-11T22:20:49.262374+0000","last_became_active":"2024-09-11T22:20:49.256041+0000","last_became_peered":"2024-09-11T22:20:49.256041+0000","last_unstale":"2024-09-11T22:20:49.262374+0000","last_undegraded":"2024-09-11T22:20:49.262374+0000","last_fullsized":"2024-09-11T22:20:49.262374+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:21.423018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296841+0000","last_change":"2024-09-11T22:20:48.302454+0000","last_active":"2024-09-11T22:20:49.296841+0000","last_peered":"2024-09-11T22:20:49.296841+0000","last_clean":"2024-09-11T22:20:49.296841+0000","last_became_active":"2024-09-11T22:20:48.302149+0000","last_became_peered":"2024-09-11T22:20:48.302149+0000","last_unstale":"2024-09-11T22:20:49.296841+0000","last_undegraded":"2024-09-11T22:20:49.296841+0000","last_fullsized":"2024-09-11T22:20:49.296841+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:23.665309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257311+0000","last_change":"2024-09-11T22:20:49.253425+0000","last_active":"2024-09-11T22:20:49.257311+0000","last_peered":"2024-09-11T22:20:49.257311+0000","last_clean":"2024-09-11T22:20:49.257311+0000","last_became_active":"2024-09-11T22:20:49.252711+0000","last_became_peered":"2024-09-11T22:20:49.252711+0000","last_unstale":"2024-09-11T22:20:49.257311+0000","last_undegraded":"2024-09-11T22:20:49.257311+0000","last_fullsized":"2024-09-11T22:20:49.257311+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:42.578739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.242628+0000","last_change":"2024-09-11T22:20:48.305247+0000","last_active":"2024-09-11T22:20:49.242628+0000","last_peered":"2024-09-11T22:20:49.242628+0000","last_clean":"2024-09-11T22:20:49.242628+0000","last_became_active":"2024-09-11T22:20:48.304920+0000","last_became_peered":"2024-09-11T22:20:48.304920+0000","last_unstale":"2024-09-11T22:20:49.242628+0000","last_undegraded":"2024-09-11T22:20:49.242628+0000","last_fullsized":"2024-09-11T22:20:49.242628+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:33.116980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433383+0000","last_change":"2024-09-11T22:20:49.257648+0000","last_active":"2024-09-11T22:20:50.433383+0000","last_peered":"2024-09-11T22:20:50.433383+0000","last_clean":"2024-09-11T22:20:50.433383+0000","last_became_active":"2024-09-11T22:20:49.257084+0000","last_became_peered":"2024-09-11T22:20:49.257084+0000","last_unstale":"2024-09-11T22:20:50.433383+0000","last_undegraded":"2024-09-11T22:20:50.433383+0000","last_fullsized":"2024-09-11T22:20:50.433383+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.426141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.245222+0000","last_change":"2024-09-11T22:20:48.295595+0000","last_active":"2024-09-11T22:20:49.245222+0000","last_peered":"2024-09-11T22:20:49.245222+0000","last_clean":"2024-09-11T22:20:49.245222+0000","last_became_active":"2024-09-11T22:20:48.295384+0000","last_became_peered":"2024-09-11T22:20:48.295384+0000","last_unstale":"2024-09-11T22:20:49.245222+0000","last_undegraded":"2024-09-11T22:20:49.245222+0000","last_fullsized":"2024-09-11T22:20:49.245222+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:30.293105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262154+0000","last_change":"2024-09-11T22:20:49.261199+0000","last_active":"2024-09-11T22:20:49.262154+0000","last_peered":"2024-09-11T22:20:49.262154+0000","last_clean":"2024-09-11T22:20:49.262154+0000","last_became_active":"2024-09-11T22:20:49.260923+0000","last_became_peered":"2024-09-11T22:20:49.260923+0000","last_unstale":"2024-09-11T22:20:49.262154+0000","last_undegraded":"2024-09-11T22:20:49.262154+0000","last_fullsized":"2024-09-11T22:20:49.262154+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:58.259369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433655+0000","last_change":"2024-09-11T22:20:48.301853+0000","last_active":"2024-09-11T22:20:50.433655+0000","last_peered":"2024-09-11T22:20:50.433655+0000","last_clean":"2024-09-11T22:20:50.433655+0000","last_became_active":"2024-09-11T22:20:48.301527+0000","last_became_peered":"2024-09-11T22:20:48.301527+0000","last_unstale":"2024-09-11T22:20:50.433655+0000","last_undegraded":"2024-09-11T22:20:50.433655+0000","last_fullsized":"2024-09-11T22:20:50.433655+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:58.041049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.254050+0000","last_change":"2024-09-11T22:20:49.251762+0000","last_active":"2024-09-11T22:20:49.254050+0000","last_peered":"2024-09-11T22:20:49.254050+0000","last_clean":"2024-09-11T22:20:49.254050+0000","last_became_active":"2024-09-11T22:20:49.251246+0000","last_became_peered":"2024-09-11T22:20:49.251246+0000","last_unstale":"2024-09-11T22:20:49.254050+0000","last_undegraded":"2024-09-11T22:20:49.254050+0000","last_fullsized":"2024-09-11T22:20:49.254050+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"155'3","reported_seq":17,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433653+0000","last_change":"2024-09-11T22:20:48.300620+0000","last_active":"2024-09-11T22:20:50.433653+0000","last_peered":"2024-09-11T22:20:50.433653+0000","last_clean":"2024-09-11T22:20:50.433653+0000","last_became_active":"2024-09-11T22:20:48.300324+0000","last_became_peered":"2024-09-11T22:20:48.300324+0000","last_unstale":"2024-09-11T22:20:50.433653+0000","last_undegraded":"2024-09-11T22:20:50.433653+0000","last_fullsized":"2024-09-11T22:20:50.433653+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:30.057922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255793+0000","last_change":"2024-09-11T22:20:49.254036+0000","last_active":"2024-09-11T22:20:49.255793+0000","last_peered":"2024-09-11T22:20:49.255793+0000","last_clean":"2024-09-11T22:20:49.255793+0000","last_became_active":"2024-09-11T22:20:49.253188+0000","last_became_peered":"2024-09-11T22:20:49.253188+0000","last_unstale":"2024-09-11T22:20:49.255793+0000","last_undegraded":"2024-09-11T22:20:49.255793+0000","last_fullsized":"2024-09-11T22:20:49.255793+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:24.667187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"155'6","reported_seq":18,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.301030+0000","last_change":"2024-09-11T22:20:48.298730+0000","last_active":"2024-09-11T22:20:49.301030+0000","last_peered":"2024-09-11T22:20:49.301030+0000","last_clean":"2024-09-11T22:20:49.301030+0000","last_became_active":"2024-09-11T22:20:48.297965+0000","last_became_peered":"2024-09-11T22:20:48.297965+0000","last_unstale":"2024-09-11T22:20:49.301030+0000","last_undegraded":"2024-09-11T22:20:49.301030+0000","last_fullsized":"2024-09-11T22:20:49.301030+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.485401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257021+0000","last_change":"2024-09-11T22:20:49.256099+0000","last_active":"2024-09-11T22:20:49.257021+0000","last_peered":"2024-09-11T22:20:49.257021+0000","last_clean":"2024-09-11T22:20:49.257021+0000","last_became_active":"2024-09-11T22:20:49.255825+0000","last_became_peered":"2024-09-11T22:20:49.255825+0000","last_unstale":"2024-09-11T22:20:49.257021+0000","last_undegraded":"2024-09-11T22:20:49.257021+0000","last_fullsized":"2024-09-11T22:20:49.257021+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:04.682427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.296612+0000","last_change":"2024-09-11T22:20:48.301519+0000","last_active":"2024-09-11T22:20:49.296612+0000","last_peered":"2024-09-11T22:20:49.296612+0000","last_clean":"2024-09-11T22:20:49.296612+0000","last_became_active":"2024-09-11T22:20:48.301198+0000","last_became_peered":"2024-09-11T22:20:48.301198+0000","last_unstale":"2024-09-11T22:20:49.296612+0000","last_undegraded":"2024-09-11T22:20:49.296612+0000","last_fullsized":"2024-09-11T22:20:49.296612+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:37.937300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261131+0000","last_change":"2024-09-11T22:20:49.253407+0000","last_active":"2024-09-11T22:20:49.261131+0000","last_peered":"2024-09-11T22:20:49.261131+0000","last_clean":"2024-09-11T22:20:49.261131+0000","last_became_active":"2024-09-11T22:20:49.252632+0000","last_became_peered":"2024-09-11T22:20:49.252632+0000","last_unstale":"2024-09-11T22:20:49.261131+0000","last_undegraded":"2024-09-11T22:20:49.261131+0000","last_fullsized":"2024-09-11T22:20:49.261131+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:03.072860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.248005+0000","last_change":"2024-09-11T22:20:48.303180+0000","last_active":"2024-09-11T22:20:49.248005+0000","last_peered":"2024-09-11T22:20:49.248005+0000","last_clean":"2024-09-11T22:20:49.248005+0000","last_became_active":"2024-09-11T22:20:48.302900+0000","last_became_peered":"2024-09-11T22:20:48.302900+0000","last_unstale":"2024-09-11T22:20:49.248005+0000","last_undegraded":"2024-09-11T22:20:49.248005+0000","last_fullsized":"2024-09-11T22:20:49.248005+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:34.148358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262365+0000","last_change":"2024-09-11T22:20:49.253704+0000","last_active":"2024-09-11T22:20:49.262365+0000","last_peered":"2024-09-11T22:20:49.262365+0000","last_clean":"2024-09-11T22:20:49.262365+0000","last_became_active":"2024-09-11T22:20:49.253146+0000","last_became_peered":"2024-09-11T22:20:49.253146+0000","last_unstale":"2024-09-11T22:20:49.262365+0000","last_undegraded":"2024-09-11T22:20:49.262365+0000","last_fullsized":"2024-09-11T22:20:49.262365+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:21.343711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.240529+0000","last_change":"2024-09-11T22:20:48.303425+0000","last_active":"2024-09-11T22:20:49.240529+0000","last_peered":"2024-09-11T22:20:49.240529+0000","last_clean":"2024-09-11T22:20:49.240529+0000","last_became_active":"2024-09-11T22:20:48.303149+0000","last_became_peered":"2024-09-11T22:20:48.303149+0000","last_unstale":"2024-09-11T22:20:49.240529+0000","last_undegraded":"2024-09-11T22:20:49.240529+0000","last_fullsized":"2024-09-11T22:20:49.240529+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:07.828637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261428+0000","last_change":"2024-09-11T22:20:49.259624+0000","last_active":"2024-09-11T22:20:49.261428+0000","last_peered":"2024-09-11T22:20:49.261428+0000","last_clean":"2024-09-11T22:20:49.261428+0000","last_became_active":"2024-09-11T22:20:49.259313+0000","last_became_peered":"2024-09-11T22:20:49.259313+0000","last_unstale":"2024-09-11T22:20:49.261428+0000","last_undegraded":"2024-09-11T22:20:49.261428+0000","last_fullsized":"2024-09-11T22:20:49.261428+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.591169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"155'8","reported_seq":20,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.299630+0000","last_change":"2024-09-11T22:20:48.298368+0000","last_active":"2024-09-11T22:20:49.299630+0000","last_peered":"2024-09-11T22:20:49.299630+0000","last_clean":"2024-09-11T22:20:49.299630+0000","last_became_active":"2024-09-11T22:20:48.298080+0000","last_became_peered":"2024-09-11T22:20:48.298080+0000","last_unstale":"2024-09-11T22:20:49.299630+0000","last_undegraded":"2024-09-11T22:20:49.299630+0000","last_fullsized":"2024-09-11T22:20:49.299630+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:19.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.257415+0000","last_change":"2024-09-11T22:20:49.253099+0000","last_active":"2024-09-11T22:20:49.257415+0000","last_peered":"2024-09-11T22:20:49.257415+0000","last_clean":"2024-09-11T22:20:49.257415+0000","last_became_active":"2024-09-11T22:20:49.252746+0000","last_became_peered":"2024-09-11T22:20:49.252746+0000","last_unstale":"2024-09-11T22:20:49.257415+0000","last_undegraded":"2024-09-11T22:20:49.257415+0000","last_fullsized":"2024-09-11T22:20:49.257415+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:31.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"155'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.297661+0000","last_change":"2024-09-11T22:20:48.303794+0000","last_active":"2024-09-11T22:20:49.297661+0000","last_peered":"2024-09-11T22:20:49.297661+0000","last_clean":"2024-09-11T22:20:49.297661+0000","last_became_active":"2024-09-11T22:20:48.303490+0000","last_became_peered":"2024-09-11T22:20:48.303490+0000","last_unstale":"2024-09-11T22:20:49.297661+0000","last_undegraded":"2024-09-11T22:20:49.297661+0000","last_fullsized":"2024-09-11T22:20:49.297661+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:45.138609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261362+0000","last_change":"2024-09-11T22:20:49.257754+0000","last_active":"2024-09-11T22:20:49.261362+0000","last_peered":"2024-09-11T22:20:49.261362+0000","last_clean":"2024-09-11T22:20:49.261362+0000","last_became_active":"2024-09-11T22:20:49.257472+0000","last_became_peered":"2024-09-11T22:20:49.257472+0000","last_unstale":"2024-09-11T22:20:49.261362+0000","last_undegraded":"2024-09-11T22:20:49.261362+0000","last_fullsized":"2024-09-11T22:20:49.261362+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:12.702105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.297285+0000","last_change":"2024-09-11T22:20:48.299954+0000","last_active":"2024-09-11T22:20:49.297285+0000","last_peered":"2024-09-11T22:20:49.297285+0000","last_clean":"2024-09-11T22:20:49.297285+0000","last_became_active":"2024-09-11T22:20:48.299637+0000","last_became_peered":"2024-09-11T22:20:48.299637+0000","last_unstale":"2024-09-11T22:20:49.297285+0000","last_undegraded":"2024-09-11T22:20:49.297285+0000","last_fullsized":"2024-09-11T22:20:49.297285+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:57.382973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262167+0000","last_change":"2024-09-11T22:20:49.253982+0000","last_active":"2024-09-11T22:20:49.262167+0000","last_peered":"2024-09-11T22:20:49.262167+0000","last_clean":"2024-09-11T22:20:49.262167+0000","last_became_active":"2024-09-11T22:20:49.253595+0000","last_became_peered":"2024-09-11T22:20:49.253595+0000","last_unstale":"2024-09-11T22:20:49.262167+0000","last_undegraded":"2024-09-11T22:20:49.262167+0000","last_fullsized":"2024-09-11T22:20:49.262167+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:41.858220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"155'1","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242927+0000","last_change":"2024-09-11T22:20:48.298737+0000","last_active":"2024-09-11T22:20:50.242927+0000","last_peered":"2024-09-11T22:20:50.242927+0000","last_clean":"2024-09-11T22:20:50.242927+0000","last_became_active":"2024-09-11T22:20:48.298403+0000","last_became_peered":"2024-09-11T22:20:48.298403+0000","last_unstale":"2024-09-11T22:20:50.242927+0000","last_undegraded":"2024-09-11T22:20:50.242927+0000","last_fullsized":"2024-09-11T22:20:50.242927+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:50.143982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261211+0000","last_change":"2024-09-11T22:20:49.259683+0000","last_active":"2024-09-11T22:20:49.261211+0000","last_peered":"2024-09-11T22:20:49.261211+0000","last_clean":"2024-09-11T22:20:49.261211+0000","last_became_active":"2024-09-11T22:20:49.259311+0000","last_became_peered":"2024-09-11T22:20:49.259311+0000","last_unstale":"2024-09-11T22:20:49.261211+0000","last_undegraded":"2024-09-11T22:20:49.261211+0000","last_fullsized":"2024-09-11T22:20:49.261211+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:35.150235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243216+0000","last_change":"2024-09-11T22:20:48.300937+0000","last_active":"2024-09-11T22:20:50.243216+0000","last_peered":"2024-09-11T22:20:50.243216+0000","last_clean":"2024-09-11T22:20:50.243216+0000","last_became_active":"2024-09-11T22:20:48.300427+0000","last_became_peered":"2024-09-11T22:20:48.300427+0000","last_unstale":"2024-09-11T22:20:50.243216+0000","last_undegraded":"2024-09-11T22:20:50.243216+0000","last_fullsized":"2024-09-11T22:20:50.243216+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:30.851712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256698+0000","last_change":"2024-09-11T22:20:49.252061+0000","last_active":"2024-09-11T22:20:49.256698+0000","last_peered":"2024-09-11T22:20:49.256698+0000","last_clean":"2024-09-11T22:20:49.256698+0000","last_became_active":"2024-09-11T22:20:49.251776+0000","last_became_peered":"2024-09-11T22:20:49.251776+0000","last_unstale":"2024-09-11T22:20:49.256698+0000","last_undegraded":"2024-09-11T22:20:49.256698+0000","last_fullsized":"2024-09-11T22:20:49.256698+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:42.720833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.298359+0000","last_change":"2024-09-11T22:20:48.305063+0000","last_active":"2024-09-11T22:20:49.298359+0000","last_peered":"2024-09-11T22:20:49.298359+0000","last_clean":"2024-09-11T22:20:49.298359+0000","last_became_active":"2024-09-11T22:20:48.304721+0000","last_became_peered":"2024-09-11T22:20:48.304721+0000","last_unstale":"2024-09-11T22:20:49.298359+0000","last_undegraded":"2024-09-11T22:20:49.298359+0000","last_fullsized":"2024-09-11T22:20:49.298359+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:36.473732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261175+0000","last_change":"2024-09-11T22:20:49.258542+0000","last_active":"2024-09-11T22:20:49.261175+0000","last_peered":"2024-09-11T22:20:49.261175+0000","last_clean":"2024-09-11T22:20:49.261175+0000","last_became_active":"2024-09-11T22:20:49.258256+0000","last_became_peered":"2024-09-11T22:20:49.258256+0000","last_unstale":"2024-09-11T22:20:49.261175+0000","last_undegraded":"2024-09-11T22:20:49.261175+0000","last_fullsized":"2024-09-11T22:20:49.261175+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:54.165270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242693+0000","last_change":"2024-09-11T22:20:48.303067+0000","last_active":"2024-09-11T22:20:50.242693+0000","last_peered":"2024-09-11T22:20:50.242693+0000","last_clean":"2024-09-11T22:20:50.242693+0000","last_became_active":"2024-09-11T22:20:48.302740+0000","last_became_peered":"2024-09-11T22:20:48.302740+0000","last_unstale":"2024-09-11T22:20:50.242693+0000","last_undegraded":"2024-09-11T22:20:50.242693+0000","last_fullsized":"2024-09-11T22:20:50.242693+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:32.436595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243026+0000","last_change":"2024-09-11T22:20:49.252086+0000","last_active":"2024-09-11T22:20:50.243026+0000","last_peered":"2024-09-11T22:20:50.243026+0000","last_clean":"2024-09-11T22:20:50.243026+0000","last_became_active":"2024-09-11T22:20:49.251793+0000","last_became_peered":"2024-09-11T22:20:49.251793+0000","last_unstale":"2024-09-11T22:20:50.243026+0000","last_undegraded":"2024-09-11T22:20:50.243026+0000","last_fullsized":"2024-09-11T22:20:50.243026+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:54:00.017396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.240672+0000","last_change":"2024-09-11T22:20:48.296080+0000","last_active":"2024-09-11T22:20:49.240672+0000","last_peered":"2024-09-11T22:20:49.240672+0000","last_clean":"2024-09-11T22:20:49.240672+0000","last_became_active":"2024-09-11T22:20:48.295806+0000","last_became_peered":"2024-09-11T22:20:48.295806+0000","last_unstale":"2024-09-11T22:20:49.240672+0000","last_undegraded":"2024-09-11T22:20:49.240672+0000","last_fullsized":"2024-09-11T22:20:49.240672+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:19.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433538+0000","last_change":"2024-09-11T22:20:49.257288+0000","last_active":"2024-09-11T22:20:50.433538+0000","last_peered":"2024-09-11T22:20:50.433538+0000","last_clean":"2024-09-11T22:20:50.433538+0000","last_became_active":"2024-09-11T22:20:49.256626+0000","last_became_peered":"2024-09-11T22:20:49.256626+0000","last_unstale":"2024-09-11T22:20:50.433538+0000","last_undegraded":"2024-09-11T22:20:50.433538+0000","last_fullsized":"2024-09-11T22:20:50.433538+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:53.953093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243302+0000","last_change":"2024-09-11T22:20:48.298834+0000","last_active":"2024-09-11T22:20:50.243302+0000","last_peered":"2024-09-11T22:20:50.243302+0000","last_clean":"2024-09-11T22:20:50.243302+0000","last_became_active":"2024-09-11T22:20:48.298547+0000","last_became_peered":"2024-09-11T22:20:48.298547+0000","last_unstale":"2024-09-11T22:20:50.243302+0000","last_undegraded":"2024-09-11T22:20:50.243302+0000","last_fullsized":"2024-09-11T22:20:50.243302+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:56.174907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.255201+0000","last_change":"2024-09-11T22:20:49.252744+0000","last_active":"2024-09-11T22:20:49.255201+0000","last_peered":"2024-09-11T22:20:49.255201+0000","last_clean":"2024-09-11T22:20:49.255201+0000","last_became_active":"2024-09-11T22:20:49.252458+0000","last_became_peered":"2024-09-11T22:20:49.252458+0000","last_unstale":"2024-09-11T22:20:49.255201+0000","last_undegraded":"2024-09-11T22:20:49.255201+0000","last_fullsized":"2024-09-11T22:20:49.255201+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:21.209058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"155'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.298270+0000","last_change":"2024-09-11T22:20:48.304158+0000","last_active":"2024-09-11T22:20:49.298270+0000","last_peered":"2024-09-11T22:20:49.298270+0000","last_clean":"2024-09-11T22:20:49.298270+0000","last_became_active":"2024-09-11T22:20:48.303869+0000","last_became_peered":"2024-09-11T22:20:48.303869+0000","last_unstale":"2024-09-11T22:20:49.298270+0000","last_undegraded":"2024-09-11T22:20:49.298270+0000","last_fullsized":"2024-09-11T22:20:49.298270+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:43.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.253562+0000","last_change":"2024-09-11T22:20:49.251765+0000","last_active":"2024-09-11T22:20:49.253562+0000","last_peered":"2024-09-11T22:20:49.253562+0000","last_clean":"2024-09-11T22:20:49.253562+0000","last_became_active":"2024-09-11T22:20:49.251469+0000","last_became_peered":"2024-09-11T22:20:49.251469+0000","last_unstale":"2024-09-11T22:20:49.253562+0000","last_undegraded":"2024-09-11T22:20:49.253562+0000","last_fullsized":"2024-09-11T22:20:49.253562+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:24.119485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.244047+0000","last_change":"2024-09-11T22:20:48.298375+0000","last_active":"2024-09-11T22:20:49.244047+0000","last_peered":"2024-09-11T22:20:49.244047+0000","last_clean":"2024-09-11T22:20:49.244047+0000","last_became_active":"2024-09-11T22:20:48.298114+0000","last_became_peered":"2024-09-11T22:20:48.298114+0000","last_unstale":"2024-09-11T22:20:49.244047+0000","last_undegraded":"2024-09-11T22:20:49.244047+0000","last_fullsized":"2024-09-11T22:20:49.244047+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:56.322627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433535+0000","last_change":"2024-09-11T22:20:49.259942+0000","last_active":"2024-09-11T22:20:50.433535+0000","last_peered":"2024-09-11T22:20:50.433535+0000","last_clean":"2024-09-11T22:20:50.433535+0000","last_became_active":"2024-09-11T22:20:49.259628+0000","last_became_peered":"2024-09-11T22:20:49.259628+0000","last_unstale":"2024-09-11T22:20:50.433535+0000","last_undegraded":"2024-09-11T22:20:50.433535+0000","last_fullsized":"2024-09-11T22:20:50.433535+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:12.697073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.244858+0000","last_change":"2024-09-11T22:20:48.303659+0000","last_active":"2024-09-11T22:20:49.244858+0000","last_peered":"2024-09-11T22:20:49.244858+0000","last_clean":"2024-09-11T22:20:49.244858+0000","last_became_active":"2024-09-11T22:20:48.303369+0000","last_became_peered":"2024-09-11T22:20:48.303369+0000","last_unstale":"2024-09-11T22:20:49.244858+0000","last_undegraded":"2024-09-11T22:20:49.244858+0000","last_fullsized":"2024-09-11T22:20:49.244858+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:51.679794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.256985+0000","last_change":"2024-09-11T22:20:49.255571+0000","last_active":"2024-09-11T22:20:49.256985+0000","last_peered":"2024-09-11T22:20:49.256985+0000","last_clean":"2024-09-11T22:20:49.256985+0000","last_became_active":"2024-09-11T22:20:49.255282+0000","last_became_peered":"2024-09-11T22:20:49.255282+0000","last_unstale":"2024-09-11T22:20:49.256985+0000","last_undegraded":"2024-09-11T22:20:49.256985+0000","last_fullsized":"2024-09-11T22:20:49.256985+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:26:15.294230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.246751+0000","last_change":"2024-09-11T22:20:48.300370+0000","last_active":"2024-09-11T22:20:49.246751+0000","last_peered":"2024-09-11T22:20:49.246751+0000","last_clean":"2024-09-11T22:20:49.246751+0000","last_became_active":"2024-09-11T22:20:48.300068+0000","last_became_peered":"2024-09-11T22:20:48.300068+0000","last_unstale":"2024-09-11T22:20:49.246751+0000","last_undegraded":"2024-09-11T22:20:49.246751+0000","last_fullsized":"2024-09-11T22:20:49.246751+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:16.679941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262119+0000","last_change":"2024-09-11T22:20:49.260222+0000","last_active":"2024-09-11T22:20:49.262119+0000","last_peered":"2024-09-11T22:20:49.262119+0000","last_clean":"2024-09-11T22:20:49.262119+0000","last_became_active":"2024-09-11T22:20:49.258826+0000","last_became_peered":"2024-09-11T22:20:49.258826+0000","last_unstale":"2024-09-11T22:20:49.262119+0000","last_undegraded":"2024-09-11T22:20:49.262119+0000","last_fullsized":"2024-09-11T22:20:49.262119+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:48.356663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.253712+0000","last_change":"2024-09-11T22:20:48.296479+0000","last_active":"2024-09-11T22:20:49.253712+0000","last_peered":"2024-09-11T22:20:49.253712+0000","last_clean":"2024-09-11T22:20:49.253712+0000","last_became_active":"2024-09-11T22:20:48.296203+0000","last_became_peered":"2024-09-11T22:20:48.296203+0000","last_unstale":"2024-09-11T22:20:49.253712+0000","last_undegraded":"2024-09-11T22:20:49.253712+0000","last_fullsized":"2024-09-11T22:20:49.253712+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:36.473732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.264693+0000","last_change":"2024-09-11T22:20:49.264327+0000","last_active":"2024-09-11T22:20:49.264693+0000","last_peered":"2024-09-11T22:20:49.264693+0000","last_clean":"2024-09-11T22:20:49.264693+0000","last_became_active":"2024-09-11T22:20:49.264054+0000","last_became_peered":"2024-09-11T22:20:49.264054+0000","last_unstale":"2024-09-11T22:20:49.264693+0000","last_undegraded":"2024-09-11T22:20:49.264693+0000","last_fullsized":"2024-09-11T22:20:49.264693+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:41.858220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.241472+0000","last_change":"2024-09-11T22:20:48.307406+0000","last_active":"2024-09-11T22:20:49.241472+0000","last_peered":"2024-09-11T22:20:49.241472+0000","last_clean":"2024-09-11T22:20:49.241472+0000","last_became_active":"2024-09-11T22:20:48.306853+0000","last_became_peered":"2024-09-11T22:20:48.306853+0000","last_unstale":"2024-09-11T22:20:49.241472+0000","last_undegraded":"2024-09-11T22:20:49.241472+0000","last_fullsized":"2024-09-11T22:20:49.241472+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:58.807896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261340+0000","last_change":"2024-09-11T22:20:49.259551+0000","last_active":"2024-09-11T22:20:49.261340+0000","last_peered":"2024-09-11T22:20:49.261340+0000","last_clean":"2024-09-11T22:20:49.261340+0000","last_became_active":"2024-09-11T22:20:49.258914+0000","last_became_peered":"2024-09-11T22:20:49.258914+0000","last_unstale":"2024-09-11T22:20:49.261340+0000","last_undegraded":"2024-09-11T22:20:49.261340+0000","last_fullsized":"2024-09-11T22:20:49.261340+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:17.681818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.242779+0000","last_change":"2024-09-11T22:20:48.303303+0000","last_active":"2024-09-11T22:20:49.242779+0000","last_peered":"2024-09-11T22:20:49.242779+0000","last_clean":"2024-09-11T22:20:49.242779+0000","last_became_active":"2024-09-11T22:20:48.302954+0000","last_became_peered":"2024-09-11T22:20:48.302954+0000","last_unstale":"2024-09-11T22:20:49.242779+0000","last_undegraded":"2024-09-11T22:20:49.242779+0000","last_fullsized":"2024-09-11T22:20:49.242779+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:53.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.261514+0000","last_change":"2024-09-11T22:20:49.260083+0000","last_active":"2024-09-11T22:20:49.261514+0000","last_peered":"2024-09-11T22:20:49.261514+0000","last_clean":"2024-09-11T22:20:49.261514+0000","last_became_active":"2024-09-11T22:20:49.259745+0000","last_became_peered":"2024-09-11T22:20:49.259745+0000","last_unstale":"2024-09-11T22:20:49.261514+0000","last_undegraded":"2024-09-11T22:20:49.261514+0000","last_fullsized":"2024-09-11T22:20:49.261514+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:17.694423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.253141+0000","last_change":"2024-09-11T22:20:48.300845+0000","last_active":"2024-09-11T22:20:49.253141+0000","last_peered":"2024-09-11T22:20:49.253141+0000","last_clean":"2024-09-11T22:20:49.253141+0000","last_became_active":"2024-09-11T22:20:48.298386+0000","last_became_peered":"2024-09-11T22:20:48.298386+0000","last_unstale":"2024-09-11T22:20:49.253141+0000","last_undegraded":"2024-09-11T22:20:49.253141+0000","last_fullsized":"2024-09-11T22:20:49.253141+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:37.937300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.262848+0000","last_change":"2024-09-11T22:20:49.261945+0000","last_active":"2024-09-11T22:20:49.262848+0000","last_peered":"2024-09-11T22:20:49.262848+0000","last_clean":"2024-09-11T22:20:49.262848+0000","last_became_active":"2024-09-11T22:20:49.261653+0000","last_became_peered":"2024-09-11T22:20:49.261653+0000","last_unstale":"2024-09-11T22:20:49.262848+0000","last_undegraded":"2024-09-11T22:20:49.262848+0000","last_fullsized":"2024-09-11T22:20:49.262848+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:16.042772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-11T22:20:49.254831+0000","last_change":"2024-09-11T22:20:48.305326+0000","last_active":"2024-09-11T22:20:49.254831+0000","last_peered":"2024-09-11T22:20:49.254831+0000","last_clean":"2024-09-11T22:20:49.254831+0000","last_became_active":"2024-09-11T22:20:48.305080+0000","last_became_peered":"2024-09-11T22:20:48.305080+0000","last_unstale":"2024-09-11T22:20:49.254831+0000","last_undegraded":"2024-09-11T22:20:49.254831+0000","last_fullsized":"2024-09-11T22:20:49.254831+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:03.217415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":415,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243115+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:20:50.243115+0000","last_peered":"2024-09-11T22:20:50.243115+0000","last_clean":"2024-09-11T22:20:50.243115+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:20:50.243115+0000","last_undegraded":"2024-09-11T22:20:50.243115+0000","last_fullsized":"2024-09-11T22:20:50.243115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51124,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320716,"statfs":{"total":96636764160,"available":96584413184,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509559,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46956,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324884,"statfs":{"total":96636764160,"available":96588681216,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509561,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55304,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316536,"statfs":{"total":96636764160,"available":96580132864,"internally_reserved":0,"allocated":1953792,"data_stored":850830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59444,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312396,"statfs":{"total":96636764160,"available":96575893504,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63596,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308244,"statfs":{"total":96636764160,"available":96571641856,"internally_reserved":0,"allocated":1925120,"data_stored":842373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509560,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55864,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315976,"statfs":{"total":96636764160,"available":96579559424,"internally_reserved":0,"allocated":2519040,"data_stored":1432741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51748,"kb_used_data":2508,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320092,"statfs":{"total":96636764160,"available":96583774208,"internally_reserved":0,"allocated":2568192,"data_stored":1448170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59464,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312376,"statfs":{"total":96636764160,"available":96575873024,"internally_reserved":0,"allocated":1953792,"data_stored":855538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:20:56.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:20:56.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.803+0000 7ff590e27640 1 Processor -- start 2024-09-11T22:20:56.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.803+0000 7ff590e27640 1 -- start start 2024-09-11T22:20:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.804+0000 7ff590e27640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff58c06e0f0 0x7ff58c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.804+0000 7ff590e27640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff58c072e60 0x7ff58c0711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.804+0000 7ff590e27640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff58c15b7e0 con 0x7ff58c15b400 2024-09-11T22:20:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.804+0000 7ff590e27640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff58c15f140 con 0x7ff58c06e0f0 2024-09-11T22:20:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.804+0000 7ff590e27640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff58c15f420 con 0x7ff58c072e60 2024-09-11T22:20:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.804+0000 7ff589d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff58c06e0f0 0x7ff58c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.804+0000 7ff589d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff58c06e0f0 0x7ff58c06d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36944/0 (socket says 172.21.15.50:36944) 2024-09-11T22:20:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.804+0000 7ff589d9b640 1 -- 172.21.15.50:0/1266003453 learned_addr learned my addr 172.21.15.50:0/1266003453 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.804+0000 7ff58ad9d640 1 --2- 172.21.15.50:0/1266003453 >> v2:172.21.15.77:3300/0 conn(0x7ff58c072e60 0x7ff58c0711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.804+0000 7ff589d9b640 1 -- 172.21.15.50:0/1266003453 >> v2:172.21.15.77:3300/0 conn(0x7ff58c072e60 msgr2=0x7ff58c0711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.804+0000 7ff589d9b640 1 --2- 172.21.15.50:0/1266003453 >> v2:172.21.15.77:3300/0 conn(0x7ff58c072e60 0x7ff58c0711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.804+0000 7ff589d9b640 1 -- 172.21.15.50:0/1266003453 >> v1:172.21.15.77:6789/0 conn(0x7ff58c15b400 legacy=0x7ff58c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:56.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.804+0000 7ff589d9b640 1 -- 172.21.15.50:0/1266003453 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58c15f700 con 0x7ff58c06e0f0 2024-09-11T22:20:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.805+0000 7ff589d9b640 1 --2- 172.21.15.50:0/1266003453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58c06e0f0 0x7ff58c06d070 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0b3490 tx=0x7ff58002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d46fc3289938040 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.805+0000 7ff58959a640 1 -- 172.21.15.50:0/1266003453 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580037070 con 0x7ff58c06e0f0 2024-09-11T22:20:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.805+0000 7ff58959a640 1 -- 172.21.15.50:0/1266003453 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff580032440 con 0x7ff58c06e0f0 2024-09-11T22:20:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.805+0000 7ff58959a640 1 -- 172.21.15.50:0/1266003453 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580032810 con 0x7ff58c06e0f0 2024-09-11T22:20:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.806+0000 7ff590e27640 1 -- 172.21.15.50:0/1266003453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58c06e0f0 msgr2=0x7ff58c06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.806+0000 7ff590e27640 1 --2- 172.21.15.50:0/1266003453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58c06e0f0 0x7ff58c06d070 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0b3490 tx=0x7ff58002a230 comp rx=0 tx=0).stop 2024-09-11T22:20:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.806+0000 7ff590e27640 1 -- 172.21.15.50:0/1266003453 shutdown_connections 2024-09-11T22:20:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.806+0000 7ff590e27640 1 --2- 172.21.15.50:0/1266003453 >> v2:172.21.15.77:3300/0 conn(0x7ff58c072e60 0x7ff58c0711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.806+0000 7ff590e27640 1 --2- 172.21.15.50:0/1266003453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58c06e0f0 0x7ff58c06d070 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.806+0000 7ff590e27640 1 -- 172.21.15.50:0/1266003453 >> 172.21.15.50:0/1266003453 conn(0x7ff58c0679c0 msgr2=0x7ff58c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.806+0000 7ff590e27640 1 -- 172.21.15.50:0/1266003453 shutdown_connections 2024-09-11T22:20:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.806+0000 7ff590e27640 1 -- 172.21.15.50:0/1266003453 wait complete. 2024-09-11T22:20:56.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.807+0000 7ff590e27640 1 Processor -- start 2024-09-11T22:20:56.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.807+0000 7ff590e27640 1 -- start start 2024-09-11T22:20:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.808+0000 7ff590e27640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff58c06e0f0 0x7ff58c1f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.808+0000 7ff590e27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58c072e60 0x7ff58c0b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.808+0000 7ff590e27640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff58c15b400 0x7ff58c1f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.808+0000 7ff590e27640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c071700 con 0x7ff58c072e60 2024-09-11T22:20:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.808+0000 7ff590e27640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c0cfc50 con 0x7ff58c15b400 2024-09-11T22:20:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.808+0000 7ff590e27640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff58c071880 con 0x7ff58c06e0f0 2024-09-11T22:20:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.808+0000 7ff589d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58c072e60 0x7ff58c0b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.808+0000 7ff589d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58c072e60 0x7ff58c0b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36960/0 (socket says 172.21.15.50:36960) 2024-09-11T22:20:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.808+0000 7ff589d9b640 1 -- 172.21.15.50:0/2455738922 learned_addr learned my addr 172.21.15.50:0/2455738922 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.808+0000 7ff58ad9d640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff58c15b400 0x7ff58c1f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.808+0000 7ff58a59c640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff58c06e0f0 0x7ff58c1f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.809+0000 7ff589d9b640 1 -- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff58c06e0f0 msgr2=0x7ff58c1f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.809+0000 7ff589d9b640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff58c06e0f0 0x7ff58c1f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.809+0000 7ff589d9b640 1 -- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff58c15b400 msgr2=0x7ff58c1f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.809+0000 7ff589d9b640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff58c15b400 0x7ff58c1f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.809+0000 7ff589d9b640 1 -- 172.21.15.50:0/2455738922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58c1f55b0 con 0x7ff58c072e60 2024-09-11T22:20:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.809+0000 7ff58a59c640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff58c06e0f0 0x7ff58c1f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.809+0000 7ff589d9b640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58c072e60 0x7ff58c0b1400 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7ff580000c00 tx=0x7ff5800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.809+0000 7ff57affd640 1 -- 172.21.15.50:0/2455738922 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580041020 con 0x7ff58c072e60 2024-09-11T22:20:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.809+0000 7ff57affd640 1 -- 172.21.15.50:0/2455738922 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5800306c0 con 0x7ff58c072e60 2024-09-11T22:20:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.809+0000 7ff590e27640 1 -- 172.21.15.50:0/2455738922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58c0b1940 con 0x7ff58c072e60 2024-09-11T22:20:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.809+0000 7ff57affd640 1 -- 172.21.15.50:0/2455738922 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580037040 con 0x7ff58c072e60 2024-09-11T22:20:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.809+0000 7ff590e27640 1 -- 172.21.15.50:0/2455738922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff58c1f8910 con 0x7ff58c072e60 2024-09-11T22:20:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.810+0000 7ff590e27640 1 -- 172.21.15.50:0/2455738922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff58c069f50 con 0x7ff58c072e60 2024-09-11T22:20:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.810+0000 7ff57affd640 1 -- 172.21.15.50:0/2455738922 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff580044020 con 0x7ff58c072e60 2024-09-11T22:20:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.811+0000 7ff57affd640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff56c06be30 0x7ff56c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.811+0000 7ff57affd640 1 -- 172.21.15.50:0/2455738922 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7ff5800ab230 con 0x7ff58c072e60 2024-09-11T22:20:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.811+0000 7ff58a59c640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff56c06be30 0x7ff56c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.812+0000 7ff58a59c640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff56c06be30 0x7ff56c06e2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff57c006fd0 tx=0x7ff57c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:56.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.815+0000 7ff57affd640 1 -- 172.21.15.50:0/2455738922 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff58004b070 con 0x7ff58c072e60 2024-09-11T22:20:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.986+0000 7ff590e27640 1 -- 172.21.15.50:0/2455738922 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff58c06c030 con 0x7ff56c06be30 2024-09-11T22:20:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.993+0000 7ff57affd640 1 -- 172.21.15.50:0/2455738922 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252409 (secure 0 0 0) 0x7ff58c06c030 con 0x7ff56c06be30 2024-09-11T22:20:56.996 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:56.997 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:20:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.995+0000 7ff590e27640 1 -- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff56c06be30 msgr2=0x7ff56c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.995+0000 7ff590e27640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff56c06be30 0x7ff56c06e2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff57c006fd0 tx=0x7ff57c008040 comp rx=0 tx=0).stop 2024-09-11T22:20:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.995+0000 7ff590e27640 1 -- 172.21.15.50:0/2455738922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58c072e60 msgr2=0x7ff58c0b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.995+0000 7ff590e27640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58c072e60 0x7ff58c0b1400 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7ff580000c00 tx=0x7ff5800046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.996+0000 7ff590e27640 1 -- 172.21.15.50:0/2455738922 shutdown_connections 2024-09-11T22:20:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.996+0000 7ff590e27640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff56c06be30 0x7ff56c06e2f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.996+0000 7ff590e27640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff58c15b400 0x7ff58c1f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.996+0000 7ff590e27640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff58c072e60 0x7ff58c0b1400 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.996+0000 7ff590e27640 1 --2- 172.21.15.50:0/2455738922 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff58c06e0f0 0x7ff58c1f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.996+0000 7ff590e27640 1 -- 172.21.15.50:0/2455738922 >> 172.21.15.50:0/2455738922 conn(0x7ff58c0679c0 msgr2=0x7ff58c0cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.996+0000 7ff590e27640 1 -- 172.21.15.50:0/2455738922 shutdown_connections 2024-09-11T22:20:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:56.996+0000 7ff590e27640 1 -- 172.21.15.50:0/2455738922 wait complete. 2024-09-11T22:20:57.007 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":446,"stamp":"2024-09-11T22:20:55.504791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":443656,"kb_used_data":16456,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754531064,"statfs":{"total":773094113280,"available":772639809536,"internally_reserved":0,"allocated":16850944,"data_stored":8029140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.217956"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243131+0000","last_change":"2024-09-11T22:20:49.257219+0000","last_active":"2024-09-11T22:20:50.243131+0000","last_peered":"2024-09-11T22:20:50.243131+0000","last_clean":"2024-09-11T22:20:50.243131+0000","last_became_active":"2024-09-11T22:20:49.256714+0000","last_became_peered":"2024-09-11T22:20:49.256714+0000","last_unstale":"2024-09-11T22:20:50.243131+0000","last_undegraded":"2024-09-11T22:20:50.243131+0000","last_fullsized":"2024-09-11T22:20:50.243131+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:04.637609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551731+0000","last_change":"2024-09-11T22:20:49.256687+0000","last_active":"2024-09-11T22:20:50.551731+0000","last_peered":"2024-09-11T22:20:50.551731+0000","last_clean":"2024-09-11T22:20:50.551731+0000","last_became_active":"2024-09-11T22:20:49.255413+0000","last_became_peered":"2024-09-11T22:20:49.255413+0000","last_unstale":"2024-09-11T22:20:50.551731+0000","last_undegraded":"2024-09-11T22:20:50.551731+0000","last_fullsized":"2024-09-11T22:20:50.551731+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:19.202899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242339+0000","last_change":"2024-09-11T22:20:49.259480+0000","last_active":"2024-09-11T22:20:50.242339+0000","last_peered":"2024-09-11T22:20:50.242339+0000","last_clean":"2024-09-11T22:20:50.242339+0000","last_became_active":"2024-09-11T22:20:49.259173+0000","last_became_peered":"2024-09-11T22:20:49.259173+0000","last_unstale":"2024-09-11T22:20:50.242339+0000","last_undegraded":"2024-09-11T22:20:50.242339+0000","last_fullsized":"2024-09-11T22:20:50.242339+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:52.681672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550661+0000","last_change":"2024-09-11T22:20:49.255277+0000","last_active":"2024-09-11T22:20:50.550661+0000","last_peered":"2024-09-11T22:20:50.550661+0000","last_clean":"2024-09-11T22:20:50.550661+0000","last_became_active":"2024-09-11T22:20:49.254171+0000","last_became_peered":"2024-09-11T22:20:49.254171+0000","last_unstale":"2024-09-11T22:20:50.550661+0000","last_undegraded":"2024-09-11T22:20:50.550661+0000","last_fullsized":"2024-09-11T22:20:50.550661+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:08.395272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551849+0000","last_change":"2024-09-11T22:20:49.256296+0000","last_active":"2024-09-11T22:20:50.551849+0000","last_peered":"2024-09-11T22:20:50.551849+0000","last_clean":"2024-09-11T22:20:50.551849+0000","last_became_active":"2024-09-11T22:20:49.255999+0000","last_became_peered":"2024-09-11T22:20:49.255999+0000","last_unstale":"2024-09-11T22:20:50.551849+0000","last_undegraded":"2024-09-11T22:20:50.551849+0000","last_fullsized":"2024-09-11T22:20:50.551849+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:21.423018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433430+0000","last_change":"2024-09-11T22:20:49.257008+0000","last_active":"2024-09-11T22:20:50.433430+0000","last_peered":"2024-09-11T22:20:50.433430+0000","last_clean":"2024-09-11T22:20:50.433430+0000","last_became_active":"2024-09-11T22:20:49.256658+0000","last_became_peered":"2024-09-11T22:20:49.256658+0000","last_unstale":"2024-09-11T22:20:50.433430+0000","last_undegraded":"2024-09-11T22:20:50.433430+0000","last_fullsized":"2024-09-11T22:20:50.433430+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:38.632671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.552092+0000","last_change":"2024-09-11T22:20:49.259937+0000","last_active":"2024-09-11T22:20:50.552092+0000","last_peered":"2024-09-11T22:20:50.552092+0000","last_clean":"2024-09-11T22:20:50.552092+0000","last_became_active":"2024-09-11T22:20:49.259497+0000","last_became_peered":"2024-09-11T22:20:49.259497+0000","last_unstale":"2024-09-11T22:20:50.552092+0000","last_undegraded":"2024-09-11T22:20:50.552092+0000","last_fullsized":"2024-09-11T22:20:50.552092+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:52:19.278264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550788+0000","last_change":"2024-09-11T22:20:49.254113+0000","last_active":"2024-09-11T22:20:50.550788+0000","last_peered":"2024-09-11T22:20:50.550788+0000","last_clean":"2024-09-11T22:20:50.550788+0000","last_became_active":"2024-09-11T22:20:49.253821+0000","last_became_peered":"2024-09-11T22:20:49.253821+0000","last_unstale":"2024-09-11T22:20:50.550788+0000","last_undegraded":"2024-09-11T22:20:50.550788+0000","last_fullsized":"2024-09-11T22:20:50.550788+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:59.809773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551363+0000","last_change":"2024-09-11T22:20:49.256195+0000","last_active":"2024-09-11T22:20:50.551363+0000","last_peered":"2024-09-11T22:20:50.551363+0000","last_clean":"2024-09-11T22:20:50.551363+0000","last_became_active":"2024-09-11T22:20:49.255711+0000","last_became_peered":"2024-09-11T22:20:49.255711+0000","last_unstale":"2024-09-11T22:20:50.551363+0000","last_undegraded":"2024-09-11T22:20:50.551363+0000","last_fullsized":"2024-09-11T22:20:50.551363+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:42.578739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551732+0000","last_change":"2024-09-11T22:20:49.249631+0000","last_active":"2024-09-11T22:20:50.551732+0000","last_peered":"2024-09-11T22:20:50.551732+0000","last_clean":"2024-09-11T22:20:50.551732+0000","last_became_active":"2024-09-11T22:20:49.249320+0000","last_became_peered":"2024-09-11T22:20:49.249320+0000","last_unstale":"2024-09-11T22:20:50.551732+0000","last_undegraded":"2024-09-11T22:20:50.551732+0000","last_fullsized":"2024-09-11T22:20:50.551732+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:40:51.621945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551597+0000","last_change":"2024-09-11T22:20:49.257141+0000","last_active":"2024-09-11T22:20:50.551597+0000","last_peered":"2024-09-11T22:20:50.551597+0000","last_clean":"2024-09-11T22:20:50.551597+0000","last_became_active":"2024-09-11T22:20:49.256842+0000","last_became_peered":"2024-09-11T22:20:49.256842+0000","last_unstale":"2024-09-11T22:20:50.551597+0000","last_undegraded":"2024-09-11T22:20:50.551597+0000","last_fullsized":"2024-09-11T22:20:50.551597+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:21.343711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551325+0000","last_change":"2024-09-11T22:20:49.255216+0000","last_active":"2024-09-11T22:20:50.551325+0000","last_peered":"2024-09-11T22:20:50.551325+0000","last_clean":"2024-09-11T22:20:50.551325+0000","last_became_active":"2024-09-11T22:20:49.253715+0000","last_became_peered":"2024-09-11T22:20:49.253715+0000","last_unstale":"2024-09-11T22:20:50.551325+0000","last_undegraded":"2024-09-11T22:20:50.551325+0000","last_fullsized":"2024-09-11T22:20:50.551325+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:31.754647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243416+0000","last_change":"2024-09-11T22:20:49.252882+0000","last_active":"2024-09-11T22:20:50.243416+0000","last_peered":"2024-09-11T22:20:50.243416+0000","last_clean":"2024-09-11T22:20:50.243416+0000","last_became_active":"2024-09-11T22:20:49.252605+0000","last_became_peered":"2024-09-11T22:20:49.252605+0000","last_unstale":"2024-09-11T22:20:50.243416+0000","last_undegraded":"2024-09-11T22:20:50.243416+0000","last_fullsized":"2024-09-11T22:20:50.243416+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:24.667187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242359+0000","last_change":"2024-09-11T22:20:49.253678+0000","last_active":"2024-09-11T22:20:50.242359+0000","last_peered":"2024-09-11T22:20:50.242359+0000","last_clean":"2024-09-11T22:20:50.242359+0000","last_became_active":"2024-09-11T22:20:49.253341+0000","last_became_peered":"2024-09-11T22:20:49.253341+0000","last_unstale":"2024-09-11T22:20:50.242359+0000","last_undegraded":"2024-09-11T22:20:50.242359+0000","last_fullsized":"2024-09-11T22:20:50.242359+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:08.830514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242650+0000","last_change":"2024-09-11T22:20:49.259260+0000","last_active":"2024-09-11T22:20:50.242650+0000","last_peered":"2024-09-11T22:20:50.242650+0000","last_clean":"2024-09-11T22:20:50.242650+0000","last_became_active":"2024-09-11T22:20:49.258969+0000","last_became_peered":"2024-09-11T22:20:49.258969+0000","last_unstale":"2024-09-11T22:20:50.242650+0000","last_undegraded":"2024-09-11T22:20:50.242650+0000","last_fullsized":"2024-09-11T22:20:50.242650+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:44.575146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550682+0000","last_change":"2024-09-11T22:20:49.260060+0000","last_active":"2024-09-11T22:20:50.550682+0000","last_peered":"2024-09-11T22:20:50.550682+0000","last_clean":"2024-09-11T22:20:50.550682+0000","last_became_active":"2024-09-11T22:20:49.259343+0000","last_became_peered":"2024-09-11T22:20:49.259343+0000","last_unstale":"2024-09-11T22:20:50.550682+0000","last_undegraded":"2024-09-11T22:20:50.550682+0000","last_fullsized":"2024-09-11T22:20:50.550682+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:59.356235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433734+0000","last_change":"2024-09-11T22:20:49.256020+0000","last_active":"2024-09-11T22:20:50.433734+0000","last_peered":"2024-09-11T22:20:50.433734+0000","last_clean":"2024-09-11T22:20:50.433734+0000","last_became_active":"2024-09-11T22:20:49.255719+0000","last_became_peered":"2024-09-11T22:20:49.255719+0000","last_unstale":"2024-09-11T22:20:50.433734+0000","last_undegraded":"2024-09-11T22:20:50.433734+0000","last_fullsized":"2024-09-11T22:20:50.433734+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:14.287208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.241626+0000","last_change":"2024-09-11T22:20:49.252133+0000","last_active":"2024-09-11T22:20:50.241626+0000","last_peered":"2024-09-11T22:20:50.241626+0000","last_clean":"2024-09-11T22:20:50.241626+0000","last_became_active":"2024-09-11T22:20:49.251795+0000","last_became_peered":"2024-09-11T22:20:49.251795+0000","last_unstale":"2024-09-11T22:20:50.241626+0000","last_undegraded":"2024-09-11T22:20:50.241626+0000","last_fullsized":"2024-09-11T22:20:50.241626+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:16:57.877607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433641+0000","last_change":"2024-09-11T22:20:49.260981+0000","last_active":"2024-09-11T22:20:50.433641+0000","last_peered":"2024-09-11T22:20:50.433641+0000","last_clean":"2024-09-11T22:20:50.433641+0000","last_became_active":"2024-09-11T22:20:49.260597+0000","last_became_peered":"2024-09-11T22:20:49.260597+0000","last_unstale":"2024-09-11T22:20:50.433641+0000","last_undegraded":"2024-09-11T22:20:50.433641+0000","last_fullsized":"2024-09-11T22:20:50.433641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:36.018303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242345+0000","last_change":"2024-09-11T22:20:49.254914+0000","last_active":"2024-09-11T22:20:50.242345+0000","last_peered":"2024-09-11T22:20:50.242345+0000","last_clean":"2024-09-11T22:20:50.242345+0000","last_became_active":"2024-09-11T22:20:49.254597+0000","last_became_peered":"2024-09-11T22:20:49.254597+0000","last_unstale":"2024-09-11T22:20:50.242345+0000","last_undegraded":"2024-09-11T22:20:50.242345+0000","last_fullsized":"2024-09-11T22:20:50.242345+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:21.294375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433366+0000","last_change":"2024-09-11T22:20:49.258117+0000","last_active":"2024-09-11T22:20:50.433366+0000","last_peered":"2024-09-11T22:20:50.433366+0000","last_clean":"2024-09-11T22:20:50.433366+0000","last_became_active":"2024-09-11T22:20:49.257806+0000","last_became_peered":"2024-09-11T22:20:49.257806+0000","last_unstale":"2024-09-11T22:20:50.433366+0000","last_undegraded":"2024-09-11T22:20:50.433366+0000","last_fullsized":"2024-09-11T22:20:50.433366+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:20.317862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551629+0000","last_change":"2024-09-11T22:20:49.251616+0000","last_active":"2024-09-11T22:20:50.551629+0000","last_peered":"2024-09-11T22:20:50.551629+0000","last_clean":"2024-09-11T22:20:50.551629+0000","last_became_active":"2024-09-11T22:20:49.250819+0000","last_became_peered":"2024-09-11T22:20:49.250819+0000","last_unstale":"2024-09-11T22:20:50.551629+0000","last_undegraded":"2024-09-11T22:20:50.551629+0000","last_fullsized":"2024-09-11T22:20:50.551629+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:41.858220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433478+0000","last_change":"2024-09-11T22:20:49.258445+0000","last_active":"2024-09-11T22:20:50.433478+0000","last_peered":"2024-09-11T22:20:50.433478+0000","last_clean":"2024-09-11T22:20:50.433478+0000","last_became_active":"2024-09-11T22:20:49.258097+0000","last_became_peered":"2024-09-11T22:20:49.258097+0000","last_unstale":"2024-09-11T22:20:50.433478+0000","last_undegraded":"2024-09-11T22:20:50.433478+0000","last_fullsized":"2024-09-11T22:20:50.433478+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:24.802538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551121+0000","last_change":"2024-09-11T22:20:49.248979+0000","last_active":"2024-09-11T22:20:50.551121+0000","last_peered":"2024-09-11T22:20:50.551121+0000","last_clean":"2024-09-11T22:20:50.551121+0000","last_became_active":"2024-09-11T22:20:49.248650+0000","last_became_peered":"2024-09-11T22:20:49.248650+0000","last_unstale":"2024-09-11T22:20:50.551121+0000","last_undegraded":"2024-09-11T22:20:50.551121+0000","last_fullsized":"2024-09-11T22:20:50.551121+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:04.219293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242563+0000","last_change":"2024-09-11T22:20:49.257680+0000","last_active":"2024-09-11T22:20:50.242563+0000","last_peered":"2024-09-11T22:20:50.242563+0000","last_clean":"2024-09-11T22:20:50.242563+0000","last_became_active":"2024-09-11T22:20:49.257402+0000","last_became_peered":"2024-09-11T22:20:49.257402+0000","last_unstale":"2024-09-11T22:20:50.242563+0000","last_undegraded":"2024-09-11T22:20:50.242563+0000","last_fullsized":"2024-09-11T22:20:50.242563+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:06.751192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551548+0000","last_change":"2024-09-11T22:20:49.253221+0000","last_active":"2024-09-11T22:20:50.551548+0000","last_peered":"2024-09-11T22:20:50.551548+0000","last_clean":"2024-09-11T22:20:50.551548+0000","last_became_active":"2024-09-11T22:20:49.252517+0000","last_became_peered":"2024-09-11T22:20:49.252517+0000","last_unstale":"2024-09-11T22:20:50.551548+0000","last_undegraded":"2024-09-11T22:20:50.551548+0000","last_fullsized":"2024-09-11T22:20:50.551548+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:12.702105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243346+0000","last_change":"2024-09-11T22:20:49.263087+0000","last_active":"2024-09-11T22:20:50.243346+0000","last_peered":"2024-09-11T22:20:50.243346+0000","last_clean":"2024-09-11T22:20:50.243346+0000","last_became_active":"2024-09-11T22:20:49.262855+0000","last_became_peered":"2024-09-11T22:20:49.262855+0000","last_unstale":"2024-09-11T22:20:50.243346+0000","last_undegraded":"2024-09-11T22:20:50.243346+0000","last_fullsized":"2024-09-11T22:20:50.243346+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:37.475609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550837+0000","last_change":"2024-09-11T22:20:49.257721+0000","last_active":"2024-09-11T22:20:50.550837+0000","last_peered":"2024-09-11T22:20:50.550837+0000","last_clean":"2024-09-11T22:20:50.550837+0000","last_became_active":"2024-09-11T22:20:49.257445+0000","last_became_peered":"2024-09-11T22:20:49.257445+0000","last_unstale":"2024-09-11T22:20:50.550837+0000","last_undegraded":"2024-09-11T22:20:50.550837+0000","last_fullsized":"2024-09-11T22:20:50.550837+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:39.767052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243587+0000","last_change":"2024-09-11T22:20:49.246147+0000","last_active":"2024-09-11T22:20:50.243587+0000","last_peered":"2024-09-11T22:20:50.243587+0000","last_clean":"2024-09-11T22:20:50.243587+0000","last_became_active":"2024-09-11T22:20:49.245562+0000","last_became_peered":"2024-09-11T22:20:49.245562+0000","last_unstale":"2024-09-11T22:20:50.243587+0000","last_undegraded":"2024-09-11T22:20:50.243587+0000","last_fullsized":"2024-09-11T22:20:50.243587+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:59.809773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550891+0000","last_change":"2024-09-11T22:20:49.257292+0000","last_active":"2024-09-11T22:20:50.550891+0000","last_peered":"2024-09-11T22:20:50.550891+0000","last_clean":"2024-09-11T22:20:50.550891+0000","last_became_active":"2024-09-11T22:20:49.257017+0000","last_became_peered":"2024-09-11T22:20:49.257017+0000","last_unstale":"2024-09-11T22:20:50.550891+0000","last_undegraded":"2024-09-11T22:20:50.550891+0000","last_fullsized":"2024-09-11T22:20:50.550891+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:19.202899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550775+0000","last_change":"2024-09-11T22:20:49.260855+0000","last_active":"2024-09-11T22:20:50.550775+0000","last_peered":"2024-09-11T22:20:50.550775+0000","last_clean":"2024-09-11T22:20:50.550775+0000","last_became_active":"2024-09-11T22:20:49.260572+0000","last_became_peered":"2024-09-11T22:20:49.260572+0000","last_unstale":"2024-09-11T22:20:50.550775+0000","last_undegraded":"2024-09-11T22:20:50.550775+0000","last_fullsized":"2024-09-11T22:20:50.550775+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:40:51.621945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.241170+0000","last_change":"2024-09-11T22:20:49.253506+0000","last_active":"2024-09-11T22:20:50.241170+0000","last_peered":"2024-09-11T22:20:50.241170+0000","last_clean":"2024-09-11T22:20:50.241170+0000","last_became_active":"2024-09-11T22:20:49.253215+0000","last_became_peered":"2024-09-11T22:20:49.253215+0000","last_unstale":"2024-09-11T22:20:50.241170+0000","last_undegraded":"2024-09-11T22:20:50.241170+0000","last_fullsized":"2024-09-11T22:20:50.241170+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:52:19.278264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551616+0000","last_change":"2024-09-11T22:20:49.253239+0000","last_active":"2024-09-11T22:20:50.551616+0000","last_peered":"2024-09-11T22:20:50.551616+0000","last_clean":"2024-09-11T22:20:50.551616+0000","last_became_active":"2024-09-11T22:20:49.252953+0000","last_became_peered":"2024-09-11T22:20:49.252953+0000","last_unstale":"2024-09-11T22:20:50.551616+0000","last_undegraded":"2024-09-11T22:20:50.551616+0000","last_fullsized":"2024-09-11T22:20:50.551616+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:48.356663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"155'4","reported_seq":18,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243195+0000","last_change":"2024-09-11T22:20:48.301320+0000","last_active":"2024-09-11T22:20:50.243195+0000","last_peered":"2024-09-11T22:20:50.243195+0000","last_clean":"2024-09-11T22:20:50.243195+0000","last_became_active":"2024-09-11T22:20:48.299916+0000","last_became_peered":"2024-09-11T22:20:48.299916+0000","last_unstale":"2024-09-11T22:20:50.243195+0000","last_undegraded":"2024-09-11T22:20:50.243195+0000","last_fullsized":"2024-09-11T22:20:50.243195+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:16.928786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551349+0000","last_change":"2024-09-11T22:20:49.256402+0000","last_active":"2024-09-11T22:20:50.551349+0000","last_peered":"2024-09-11T22:20:50.551349+0000","last_clean":"2024-09-11T22:20:50.551349+0000","last_became_active":"2024-09-11T22:20:49.256119+0000","last_became_peered":"2024-09-11T22:20:49.256119+0000","last_unstale":"2024-09-11T22:20:50.551349+0000","last_undegraded":"2024-09-11T22:20:50.551349+0000","last_fullsized":"2024-09-11T22:20:50.551349+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:42:14.156843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"155'1","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551075+0000","last_change":"2024-09-11T22:20:48.301059+0000","last_active":"2024-09-11T22:20:50.551075+0000","last_peered":"2024-09-11T22:20:50.551075+0000","last_clean":"2024-09-11T22:20:50.551075+0000","last_became_active":"2024-09-11T22:20:48.300798+0000","last_became_peered":"2024-09-11T22:20:48.300798+0000","last_unstale":"2024-09-11T22:20:50.551075+0000","last_undegraded":"2024-09-11T22:20:50.551075+0000","last_fullsized":"2024-09-11T22:20:50.551075+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:58.807896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433340+0000","last_change":"2024-09-11T22:20:49.254064+0000","last_active":"2024-09-11T22:20:50.433340+0000","last_peered":"2024-09-11T22:20:50.433340+0000","last_clean":"2024-09-11T22:20:50.433340+0000","last_became_active":"2024-09-11T22:20:49.253755+0000","last_became_peered":"2024-09-11T22:20:49.253755+0000","last_unstale":"2024-09-11T22:20:50.433340+0000","last_undegraded":"2024-09-11T22:20:50.433340+0000","last_fullsized":"2024-09-11T22:20:50.433340+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:32.881230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"155'2","reported_seq":16,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550659+0000","last_change":"2024-09-11T22:20:48.305983+0000","last_active":"2024-09-11T22:20:50.550659+0000","last_peered":"2024-09-11T22:20:50.550659+0000","last_clean":"2024-09-11T22:20:50.550659+0000","last_became_active":"2024-09-11T22:20:48.305565+0000","last_became_peered":"2024-09-11T22:20:48.305565+0000","last_unstale":"2024-09-11T22:20:50.550659+0000","last_undegraded":"2024-09-11T22:20:50.550659+0000","last_fullsized":"2024-09-11T22:20:50.550659+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.485401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243090+0000","last_change":"2024-09-11T22:20:49.258388+0000","last_active":"2024-09-11T22:20:50.243090+0000","last_peered":"2024-09-11T22:20:50.243090+0000","last_clean":"2024-09-11T22:20:50.243090+0000","last_became_active":"2024-09-11T22:20:49.258045+0000","last_became_peered":"2024-09-11T22:20:49.258045+0000","last_unstale":"2024-09-11T22:20:50.243090+0000","last_undegraded":"2024-09-11T22:20:50.243090+0000","last_fullsized":"2024-09-11T22:20:50.243090+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:20.358674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"155'2","reported_seq":16,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551085+0000","last_change":"2024-09-11T22:20:48.307332+0000","last_active":"2024-09-11T22:20:50.551085+0000","last_peered":"2024-09-11T22:20:50.551085+0000","last_clean":"2024-09-11T22:20:50.551085+0000","last_became_active":"2024-09-11T22:20:48.306940+0000","last_became_peered":"2024-09-11T22:20:48.306940+0000","last_unstale":"2024-09-11T22:20:50.551085+0000","last_undegraded":"2024-09-11T22:20:50.551085+0000","last_fullsized":"2024-09-11T22:20:50.551085+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:03.217415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551435+0000","last_change":"2024-09-11T22:20:49.253030+0000","last_active":"2024-09-11T22:20:50.551435+0000","last_peered":"2024-09-11T22:20:50.551435+0000","last_clean":"2024-09-11T22:20:50.551435+0000","last_became_active":"2024-09-11T22:20:49.252290+0000","last_became_peered":"2024-09-11T22:20:49.252290+0000","last_unstale":"2024-09-11T22:20:50.551435+0000","last_undegraded":"2024-09-11T22:20:50.551435+0000","last_fullsized":"2024-09-11T22:20:50.551435+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:04.682427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"155'1","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243690+0000","last_change":"2024-09-11T22:20:48.297836+0000","last_active":"2024-09-11T22:20:50.243690+0000","last_peered":"2024-09-11T22:20:50.243690+0000","last_clean":"2024-09-11T22:20:50.243690+0000","last_became_active":"2024-09-11T22:20:48.297270+0000","last_became_peered":"2024-09-11T22:20:48.297270+0000","last_unstale":"2024-09-11T22:20:50.243690+0000","last_undegraded":"2024-09-11T22:20:50.243690+0000","last_fullsized":"2024-09-11T22:20:50.243690+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:26.844219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550564+0000","last_change":"2024-09-11T22:20:49.259041+0000","last_active":"2024-09-11T22:20:50.550564+0000","last_peered":"2024-09-11T22:20:50.550564+0000","last_clean":"2024-09-11T22:20:50.550564+0000","last_became_active":"2024-09-11T22:20:49.256041+0000","last_became_peered":"2024-09-11T22:20:49.256041+0000","last_unstale":"2024-09-11T22:20:50.550564+0000","last_undegraded":"2024-09-11T22:20:50.550564+0000","last_fullsized":"2024-09-11T22:20:50.550564+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:44.650185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"155'1","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550359+0000","last_change":"2024-09-11T22:20:48.302454+0000","last_active":"2024-09-11T22:20:50.550359+0000","last_peered":"2024-09-11T22:20:50.550359+0000","last_clean":"2024-09-11T22:20:50.550359+0000","last_became_active":"2024-09-11T22:20:48.302149+0000","last_became_peered":"2024-09-11T22:20:48.302149+0000","last_unstale":"2024-09-11T22:20:50.550359+0000","last_undegraded":"2024-09-11T22:20:50.550359+0000","last_fullsized":"2024-09-11T22:20:50.550359+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:23.665309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550347+0000","last_change":"2024-09-11T22:20:49.253425+0000","last_active":"2024-09-11T22:20:50.550347+0000","last_peered":"2024-09-11T22:20:50.550347+0000","last_clean":"2024-09-11T22:20:50.550347+0000","last_became_active":"2024-09-11T22:20:49.252711+0000","last_became_peered":"2024-09-11T22:20:49.252711+0000","last_unstale":"2024-09-11T22:20:50.550347+0000","last_undegraded":"2024-09-11T22:20:50.550347+0000","last_fullsized":"2024-09-11T22:20:50.550347+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:13.642454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551391+0000","last_change":"2024-09-11T22:20:48.305247+0000","last_active":"2024-09-11T22:20:50.551391+0000","last_peered":"2024-09-11T22:20:50.551391+0000","last_clean":"2024-09-11T22:20:50.551391+0000","last_became_active":"2024-09-11T22:20:48.304920+0000","last_became_peered":"2024-09-11T22:20:48.304920+0000","last_unstale":"2024-09-11T22:20:50.551391+0000","last_undegraded":"2024-09-11T22:20:50.551391+0000","last_fullsized":"2024-09-11T22:20:50.551391+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:33.116980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433383+0000","last_change":"2024-09-11T22:20:49.257648+0000","last_active":"2024-09-11T22:20:50.433383+0000","last_peered":"2024-09-11T22:20:50.433383+0000","last_clean":"2024-09-11T22:20:50.433383+0000","last_became_active":"2024-09-11T22:20:49.257084+0000","last_became_peered":"2024-09-11T22:20:49.257084+0000","last_unstale":"2024-09-11T22:20:50.433383+0000","last_undegraded":"2024-09-11T22:20:50.433383+0000","last_fullsized":"2024-09-11T22:20:50.433383+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.426141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550981+0000","last_change":"2024-09-11T22:20:48.295595+0000","last_active":"2024-09-11T22:20:50.550981+0000","last_peered":"2024-09-11T22:20:50.550981+0000","last_clean":"2024-09-11T22:20:50.550981+0000","last_became_active":"2024-09-11T22:20:48.295384+0000","last_became_peered":"2024-09-11T22:20:48.295384+0000","last_unstale":"2024-09-11T22:20:50.550981+0000","last_undegraded":"2024-09-11T22:20:50.550981+0000","last_fullsized":"2024-09-11T22:20:50.550981+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:30.293105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.241445+0000","last_change":"2024-09-11T22:20:49.261199+0000","last_active":"2024-09-11T22:20:50.241445+0000","last_peered":"2024-09-11T22:20:50.241445+0000","last_clean":"2024-09-11T22:20:50.241445+0000","last_became_active":"2024-09-11T22:20:49.260923+0000","last_became_peered":"2024-09-11T22:20:49.260923+0000","last_unstale":"2024-09-11T22:20:50.241445+0000","last_undegraded":"2024-09-11T22:20:50.241445+0000","last_fullsized":"2024-09-11T22:20:50.241445+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:44.639461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433655+0000","last_change":"2024-09-11T22:20:48.301853+0000","last_active":"2024-09-11T22:20:50.433655+0000","last_peered":"2024-09-11T22:20:50.433655+0000","last_clean":"2024-09-11T22:20:50.433655+0000","last_became_active":"2024-09-11T22:20:48.301527+0000","last_became_peered":"2024-09-11T22:20:48.301527+0000","last_unstale":"2024-09-11T22:20:50.433655+0000","last_undegraded":"2024-09-11T22:20:50.433655+0000","last_fullsized":"2024-09-11T22:20:50.433655+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:58.041049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.241423+0000","last_change":"2024-09-11T22:20:49.251762+0000","last_active":"2024-09-11T22:20:50.241423+0000","last_peered":"2024-09-11T22:20:50.241423+0000","last_clean":"2024-09-11T22:20:50.241423+0000","last_became_active":"2024-09-11T22:20:49.251246+0000","last_became_peered":"2024-09-11T22:20:49.251246+0000","last_unstale":"2024-09-11T22:20:50.241423+0000","last_undegraded":"2024-09-11T22:20:50.241423+0000","last_fullsized":"2024-09-11T22:20:50.241423+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:41.918357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"155'3","reported_seq":17,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433653+0000","last_change":"2024-09-11T22:20:48.300620+0000","last_active":"2024-09-11T22:20:50.433653+0000","last_peered":"2024-09-11T22:20:50.433653+0000","last_clean":"2024-09-11T22:20:50.433653+0000","last_became_active":"2024-09-11T22:20:48.300324+0000","last_became_peered":"2024-09-11T22:20:48.300324+0000","last_unstale":"2024-09-11T22:20:50.433653+0000","last_undegraded":"2024-09-11T22:20:50.433653+0000","last_fullsized":"2024-09-11T22:20:50.433653+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:30.057922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551582+0000","last_change":"2024-09-11T22:20:49.254036+0000","last_active":"2024-09-11T22:20:50.551582+0000","last_peered":"2024-09-11T22:20:50.551582+0000","last_clean":"2024-09-11T22:20:50.551582+0000","last_became_active":"2024-09-11T22:20:49.253188+0000","last_became_peered":"2024-09-11T22:20:49.253188+0000","last_unstale":"2024-09-11T22:20:50.551582+0000","last_undegraded":"2024-09-11T22:20:50.551582+0000","last_fullsized":"2024-09-11T22:20:50.551582+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:13.642454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"155'6","reported_seq":20,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551185+0000","last_change":"2024-09-11T22:20:48.298730+0000","last_active":"2024-09-11T22:20:50.551185+0000","last_peered":"2024-09-11T22:20:50.551185+0000","last_clean":"2024-09-11T22:20:50.551185+0000","last_became_active":"2024-09-11T22:20:48.297965+0000","last_became_peered":"2024-09-11T22:20:48.297965+0000","last_unstale":"2024-09-11T22:20:50.551185+0000","last_undegraded":"2024-09-11T22:20:50.551185+0000","last_fullsized":"2024-09-11T22:20:50.551185+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:11.485401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.241289+0000","last_change":"2024-09-11T22:20:49.256099+0000","last_active":"2024-09-11T22:20:50.241289+0000","last_peered":"2024-09-11T22:20:50.241289+0000","last_clean":"2024-09-11T22:20:50.241289+0000","last_became_active":"2024-09-11T22:20:49.255825+0000","last_became_peered":"2024-09-11T22:20:49.255825+0000","last_unstale":"2024-09-11T22:20:50.241289+0000","last_undegraded":"2024-09-11T22:20:50.241289+0000","last_fullsized":"2024-09-11T22:20:50.241289+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:31.401109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"155'2","reported_seq":16,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550663+0000","last_change":"2024-09-11T22:20:48.301519+0000","last_active":"2024-09-11T22:20:50.550663+0000","last_peered":"2024-09-11T22:20:50.550663+0000","last_clean":"2024-09-11T22:20:50.550663+0000","last_became_active":"2024-09-11T22:20:48.301198+0000","last_became_peered":"2024-09-11T22:20:48.301198+0000","last_unstale":"2024-09-11T22:20:50.550663+0000","last_undegraded":"2024-09-11T22:20:50.550663+0000","last_fullsized":"2024-09-11T22:20:50.550663+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:37.937300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551819+0000","last_change":"2024-09-11T22:20:49.253407+0000","last_active":"2024-09-11T22:20:50.551819+0000","last_peered":"2024-09-11T22:20:50.551819+0000","last_clean":"2024-09-11T22:20:50.551819+0000","last_became_active":"2024-09-11T22:20:49.252632+0000","last_became_peered":"2024-09-11T22:20:49.252632+0000","last_unstale":"2024-09-11T22:20:50.551819+0000","last_undegraded":"2024-09-11T22:20:50.551819+0000","last_fullsized":"2024-09-11T22:20:50.551819+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:58.259369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.241551+0000","last_change":"2024-09-11T22:20:48.303180+0000","last_active":"2024-09-11T22:20:50.241551+0000","last_peered":"2024-09-11T22:20:50.241551+0000","last_clean":"2024-09-11T22:20:50.241551+0000","last_became_active":"2024-09-11T22:20:48.302900+0000","last_became_peered":"2024-09-11T22:20:48.302900+0000","last_unstale":"2024-09-11T22:20:50.241551+0000","last_undegraded":"2024-09-11T22:20:50.241551+0000","last_fullsized":"2024-09-11T22:20:50.241551+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:34.148358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550392+0000","last_change":"2024-09-11T22:20:49.253704+0000","last_active":"2024-09-11T22:20:50.550392+0000","last_peered":"2024-09-11T22:20:50.550392+0000","last_clean":"2024-09-11T22:20:50.550392+0000","last_became_active":"2024-09-11T22:20:49.253146+0000","last_became_peered":"2024-09-11T22:20:49.253146+0000","last_unstale":"2024-09-11T22:20:50.550392+0000","last_undegraded":"2024-09-11T22:20:50.550392+0000","last_fullsized":"2024-09-11T22:20:50.550392+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:23.272023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550388+0000","last_change":"2024-09-11T22:20:48.303425+0000","last_active":"2024-09-11T22:20:50.550388+0000","last_peered":"2024-09-11T22:20:50.550388+0000","last_clean":"2024-09-11T22:20:50.550388+0000","last_became_active":"2024-09-11T22:20:48.303149+0000","last_became_peered":"2024-09-11T22:20:48.303149+0000","last_unstale":"2024-09-11T22:20:50.550388+0000","last_undegraded":"2024-09-11T22:20:50.550388+0000","last_fullsized":"2024-09-11T22:20:50.550388+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:07.828637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243343+0000","last_change":"2024-09-11T22:20:49.259624+0000","last_active":"2024-09-11T22:20:50.243343+0000","last_peered":"2024-09-11T22:20:50.243343+0000","last_clean":"2024-09-11T22:20:50.243343+0000","last_became_active":"2024-09-11T22:20:49.259313+0000","last_became_peered":"2024-09-11T22:20:49.259313+0000","last_unstale":"2024-09-11T22:20:50.243343+0000","last_undegraded":"2024-09-11T22:20:50.243343+0000","last_fullsized":"2024-09-11T22:20:50.243343+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:38.939177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"155'8","reported_seq":22,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550803+0000","last_change":"2024-09-11T22:20:48.298368+0000","last_active":"2024-09-11T22:20:50.550803+0000","last_peered":"2024-09-11T22:20:50.550803+0000","last_clean":"2024-09-11T22:20:50.550803+0000","last_became_active":"2024-09-11T22:20:48.298080+0000","last_became_peered":"2024-09-11T22:20:48.298080+0000","last_unstale":"2024-09-11T22:20:50.550803+0000","last_undegraded":"2024-09-11T22:20:50.550803+0000","last_fullsized":"2024-09-11T22:20:50.550803+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:19.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550981+0000","last_change":"2024-09-11T22:20:49.253099+0000","last_active":"2024-09-11T22:20:50.550981+0000","last_peered":"2024-09-11T22:20:50.550981+0000","last_clean":"2024-09-11T22:20:50.550981+0000","last_became_active":"2024-09-11T22:20:49.252746+0000","last_became_peered":"2024-09-11T22:20:49.252746+0000","last_unstale":"2024-09-11T22:20:50.550981+0000","last_undegraded":"2024-09-11T22:20:50.550981+0000","last_fullsized":"2024-09-11T22:20:50.550981+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:01.881837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"155'1","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242543+0000","last_change":"2024-09-11T22:20:48.303794+0000","last_active":"2024-09-11T22:20:50.242543+0000","last_peered":"2024-09-11T22:20:50.242543+0000","last_clean":"2024-09-11T22:20:50.242543+0000","last_became_active":"2024-09-11T22:20:48.303490+0000","last_became_peered":"2024-09-11T22:20:48.303490+0000","last_unstale":"2024-09-11T22:20:50.242543+0000","last_undegraded":"2024-09-11T22:20:50.242543+0000","last_fullsized":"2024-09-11T22:20:50.242543+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:45.138609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.241594+0000","last_change":"2024-09-11T22:20:49.257754+0000","last_active":"2024-09-11T22:20:50.241594+0000","last_peered":"2024-09-11T22:20:50.241594+0000","last_clean":"2024-09-11T22:20:50.241594+0000","last_became_active":"2024-09-11T22:20:49.257472+0000","last_became_peered":"2024-09-11T22:20:49.257472+0000","last_unstale":"2024-09-11T22:20:50.241594+0000","last_undegraded":"2024-09-11T22:20:50.241594+0000","last_fullsized":"2024-09-11T22:20:50.241594+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:04.753434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"155'2","reported_seq":16,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242730+0000","last_change":"2024-09-11T22:20:48.299954+0000","last_active":"2024-09-11T22:20:50.242730+0000","last_peered":"2024-09-11T22:20:50.242730+0000","last_clean":"2024-09-11T22:20:50.242730+0000","last_became_active":"2024-09-11T22:20:48.299637+0000","last_became_peered":"2024-09-11T22:20:48.299637+0000","last_unstale":"2024-09-11T22:20:50.242730+0000","last_undegraded":"2024-09-11T22:20:50.242730+0000","last_fullsized":"2024-09-11T22:20:50.242730+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:57.382973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550992+0000","last_change":"2024-09-11T22:20:49.253982+0000","last_active":"2024-09-11T22:20:50.550992+0000","last_peered":"2024-09-11T22:20:50.550992+0000","last_clean":"2024-09-11T22:20:50.550992+0000","last_became_active":"2024-09-11T22:20:49.253595+0000","last_became_peered":"2024-09-11T22:20:49.253595+0000","last_unstale":"2024-09-11T22:20:50.550992+0000","last_undegraded":"2024-09-11T22:20:50.550992+0000","last_fullsized":"2024-09-11T22:20:50.550992+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:38.281905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"155'1","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242927+0000","last_change":"2024-09-11T22:20:48.298737+0000","last_active":"2024-09-11T22:20:50.242927+0000","last_peered":"2024-09-11T22:20:50.242927+0000","last_clean":"2024-09-11T22:20:50.242927+0000","last_became_active":"2024-09-11T22:20:48.298403+0000","last_became_peered":"2024-09-11T22:20:48.298403+0000","last_unstale":"2024-09-11T22:20:50.242927+0000","last_undegraded":"2024-09-11T22:20:50.242927+0000","last_fullsized":"2024-09-11T22:20:50.242927+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:50.143982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551186+0000","last_change":"2024-09-11T22:20:49.259683+0000","last_active":"2024-09-11T22:20:50.551186+0000","last_peered":"2024-09-11T22:20:50.551186+0000","last_clean":"2024-09-11T22:20:50.551186+0000","last_became_active":"2024-09-11T22:20:49.259311+0000","last_became_peered":"2024-09-11T22:20:49.259311+0000","last_unstale":"2024-09-11T22:20:50.551186+0000","last_undegraded":"2024-09-11T22:20:50.551186+0000","last_fullsized":"2024-09-11T22:20:50.551186+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:18.404645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243216+0000","last_change":"2024-09-11T22:20:48.300937+0000","last_active":"2024-09-11T22:20:50.243216+0000","last_peered":"2024-09-11T22:20:50.243216+0000","last_clean":"2024-09-11T22:20:50.243216+0000","last_became_active":"2024-09-11T22:20:48.300427+0000","last_became_peered":"2024-09-11T22:20:48.300427+0000","last_unstale":"2024-09-11T22:20:50.243216+0000","last_undegraded":"2024-09-11T22:20:50.243216+0000","last_fullsized":"2024-09-11T22:20:50.243216+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:30.851712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242257+0000","last_change":"2024-09-11T22:20:49.252061+0000","last_active":"2024-09-11T22:20:50.242257+0000","last_peered":"2024-09-11T22:20:50.242257+0000","last_clean":"2024-09-11T22:20:50.242257+0000","last_became_active":"2024-09-11T22:20:49.251776+0000","last_became_peered":"2024-09-11T22:20:49.251776+0000","last_unstale":"2024-09-11T22:20:50.242257+0000","last_undegraded":"2024-09-11T22:20:50.242257+0000","last_fullsized":"2024-09-11T22:20:50.242257+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:12.487278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"155'2","reported_seq":16,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550765+0000","last_change":"2024-09-11T22:20:48.305063+0000","last_active":"2024-09-11T22:20:50.550765+0000","last_peered":"2024-09-11T22:20:50.550765+0000","last_clean":"2024-09-11T22:20:50.550765+0000","last_became_active":"2024-09-11T22:20:48.304721+0000","last_became_peered":"2024-09-11T22:20:48.304721+0000","last_unstale":"2024-09-11T22:20:50.550765+0000","last_undegraded":"2024-09-11T22:20:50.550765+0000","last_fullsized":"2024-09-11T22:20:50.550765+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:36.473732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551894+0000","last_change":"2024-09-11T22:20:49.258542+0000","last_active":"2024-09-11T22:20:50.551894+0000","last_peered":"2024-09-11T22:20:50.551894+0000","last_clean":"2024-09-11T22:20:50.551894+0000","last_became_active":"2024-09-11T22:20:49.258256+0000","last_became_peered":"2024-09-11T22:20:49.258256+0000","last_unstale":"2024-09-11T22:20:50.551894+0000","last_undegraded":"2024-09-11T22:20:50.551894+0000","last_fullsized":"2024-09-11T22:20:50.551894+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:16.042772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242693+0000","last_change":"2024-09-11T22:20:48.303067+0000","last_active":"2024-09-11T22:20:50.242693+0000","last_peered":"2024-09-11T22:20:50.242693+0000","last_clean":"2024-09-11T22:20:50.242693+0000","last_became_active":"2024-09-11T22:20:48.302740+0000","last_became_peered":"2024-09-11T22:20:48.302740+0000","last_unstale":"2024-09-11T22:20:50.242693+0000","last_undegraded":"2024-09-11T22:20:50.242693+0000","last_fullsized":"2024-09-11T22:20:50.242693+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:32.436595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243026+0000","last_change":"2024-09-11T22:20:49.252086+0000","last_active":"2024-09-11T22:20:50.243026+0000","last_peered":"2024-09-11T22:20:50.243026+0000","last_clean":"2024-09-11T22:20:50.243026+0000","last_became_active":"2024-09-11T22:20:49.251793+0000","last_became_peered":"2024-09-11T22:20:49.251793+0000","last_unstale":"2024-09-11T22:20:50.243026+0000","last_undegraded":"2024-09-11T22:20:50.243026+0000","last_fullsized":"2024-09-11T22:20:50.243026+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:54:00.017396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550392+0000","last_change":"2024-09-11T22:20:48.296080+0000","last_active":"2024-09-11T22:20:50.550392+0000","last_peered":"2024-09-11T22:20:50.550392+0000","last_clean":"2024-09-11T22:20:50.550392+0000","last_became_active":"2024-09-11T22:20:48.295806+0000","last_became_peered":"2024-09-11T22:20:48.295806+0000","last_unstale":"2024-09-11T22:20:50.550392+0000","last_undegraded":"2024-09-11T22:20:50.550392+0000","last_fullsized":"2024-09-11T22:20:50.550392+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:19.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433538+0000","last_change":"2024-09-11T22:20:49.257288+0000","last_active":"2024-09-11T22:20:50.433538+0000","last_peered":"2024-09-11T22:20:50.433538+0000","last_clean":"2024-09-11T22:20:50.433538+0000","last_became_active":"2024-09-11T22:20:49.256626+0000","last_became_peered":"2024-09-11T22:20:49.256626+0000","last_unstale":"2024-09-11T22:20:50.433538+0000","last_undegraded":"2024-09-11T22:20:50.433538+0000","last_fullsized":"2024-09-11T22:20:50.433538+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:53.953093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243302+0000","last_change":"2024-09-11T22:20:48.298834+0000","last_active":"2024-09-11T22:20:50.243302+0000","last_peered":"2024-09-11T22:20:50.243302+0000","last_clean":"2024-09-11T22:20:50.243302+0000","last_became_active":"2024-09-11T22:20:48.298547+0000","last_became_peered":"2024-09-11T22:20:48.298547+0000","last_unstale":"2024-09-11T22:20:50.243302+0000","last_undegraded":"2024-09-11T22:20:50.243302+0000","last_fullsized":"2024-09-11T22:20:50.243302+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:56.174907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.241777+0000","last_change":"2024-09-11T22:20:49.252744+0000","last_active":"2024-09-11T22:20:50.241777+0000","last_peered":"2024-09-11T22:20:50.241777+0000","last_clean":"2024-09-11T22:20:50.241777+0000","last_became_active":"2024-09-11T22:20:49.252458+0000","last_became_peered":"2024-09-11T22:20:49.252458+0000","last_unstale":"2024-09-11T22:20:50.241777+0000","last_undegraded":"2024-09-11T22:20:50.241777+0000","last_fullsized":"2024-09-11T22:20:50.241777+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.754081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"155'2","reported_seq":16,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.241611+0000","last_change":"2024-09-11T22:20:48.304158+0000","last_active":"2024-09-11T22:20:50.241611+0000","last_peered":"2024-09-11T22:20:50.241611+0000","last_clean":"2024-09-11T22:20:50.241611+0000","last_became_active":"2024-09-11T22:20:48.303869+0000","last_became_peered":"2024-09-11T22:20:48.303869+0000","last_unstale":"2024-09-11T22:20:50.241611+0000","last_undegraded":"2024-09-11T22:20:50.241611+0000","last_fullsized":"2024-09-11T22:20:50.241611+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:43.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551277+0000","last_change":"2024-09-11T22:20:49.251765+0000","last_active":"2024-09-11T22:20:50.551277+0000","last_peered":"2024-09-11T22:20:50.551277+0000","last_clean":"2024-09-11T22:20:50.551277+0000","last_became_active":"2024-09-11T22:20:49.251469+0000","last_became_peered":"2024-09-11T22:20:49.251469+0000","last_unstale":"2024-09-11T22:20:50.551277+0000","last_undegraded":"2024-09-11T22:20:50.551277+0000","last_fullsized":"2024-09-11T22:20:50.551277+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:26:15.294230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"156'1","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242895+0000","last_change":"2024-09-11T22:20:48.298375+0000","last_active":"2024-09-11T22:20:50.242895+0000","last_peered":"2024-09-11T22:20:50.242895+0000","last_clean":"2024-09-11T22:20:50.242895+0000","last_became_active":"2024-09-11T22:20:48.298114+0000","last_became_peered":"2024-09-11T22:20:48.298114+0000","last_unstale":"2024-09-11T22:20:50.242895+0000","last_undegraded":"2024-09-11T22:20:50.242895+0000","last_fullsized":"2024-09-11T22:20:50.242895+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:56.322627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.433535+0000","last_change":"2024-09-11T22:20:49.259942+0000","last_active":"2024-09-11T22:20:50.433535+0000","last_peered":"2024-09-11T22:20:50.433535+0000","last_clean":"2024-09-11T22:20:50.433535+0000","last_became_active":"2024-09-11T22:20:49.259628+0000","last_became_peered":"2024-09-11T22:20:49.259628+0000","last_unstale":"2024-09-11T22:20:50.433535+0000","last_undegraded":"2024-09-11T22:20:50.433535+0000","last_fullsized":"2024-09-11T22:20:50.433535+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:12.697073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551417+0000","last_change":"2024-09-11T22:20:48.303659+0000","last_active":"2024-09-11T22:20:50.551417+0000","last_peered":"2024-09-11T22:20:50.551417+0000","last_clean":"2024-09-11T22:20:50.551417+0000","last_became_active":"2024-09-11T22:20:48.303369+0000","last_became_peered":"2024-09-11T22:20:48.303369+0000","last_unstale":"2024-09-11T22:20:50.551417+0000","last_undegraded":"2024-09-11T22:20:50.551417+0000","last_fullsized":"2024-09-11T22:20:50.551417+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:51.679794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.241437+0000","last_change":"2024-09-11T22:20:49.255571+0000","last_active":"2024-09-11T22:20:50.241437+0000","last_peered":"2024-09-11T22:20:50.241437+0000","last_clean":"2024-09-11T22:20:50.241437+0000","last_became_active":"2024-09-11T22:20:49.255282+0000","last_became_peered":"2024-09-11T22:20:49.255282+0000","last_unstale":"2024-09-11T22:20:50.241437+0000","last_undegraded":"2024-09-11T22:20:50.241437+0000","last_fullsized":"2024-09-11T22:20:50.241437+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:06.391854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.241487+0000","last_change":"2024-09-11T22:20:48.300370+0000","last_active":"2024-09-11T22:20:50.241487+0000","last_peered":"2024-09-11T22:20:50.241487+0000","last_clean":"2024-09-11T22:20:50.241487+0000","last_became_active":"2024-09-11T22:20:48.300068+0000","last_became_peered":"2024-09-11T22:20:48.300068+0000","last_unstale":"2024-09-11T22:20:50.241487+0000","last_undegraded":"2024-09-11T22:20:50.241487+0000","last_fullsized":"2024-09-11T22:20:50.241487+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:16.679941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.241437+0000","last_change":"2024-09-11T22:20:49.260222+0000","last_active":"2024-09-11T22:20:50.241437+0000","last_peered":"2024-09-11T22:20:50.241437+0000","last_clean":"2024-09-11T22:20:50.241437+0000","last_became_active":"2024-09-11T22:20:49.258826+0000","last_became_peered":"2024-09-11T22:20:49.258826+0000","last_unstale":"2024-09-11T22:20:50.241437+0000","last_undegraded":"2024-09-11T22:20:50.241437+0000","last_fullsized":"2024-09-11T22:20:50.241437+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:32:38.287244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551083+0000","last_change":"2024-09-11T22:20:48.296479+0000","last_active":"2024-09-11T22:20:50.551083+0000","last_peered":"2024-09-11T22:20:50.551083+0000","last_clean":"2024-09-11T22:20:50.551083+0000","last_became_active":"2024-09-11T22:20:48.296203+0000","last_became_peered":"2024-09-11T22:20:48.296203+0000","last_unstale":"2024-09-11T22:20:50.551083+0000","last_undegraded":"2024-09-11T22:20:50.551083+0000","last_fullsized":"2024-09-11T22:20:50.551083+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:36.473732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550978+0000","last_change":"2024-09-11T22:20:49.264327+0000","last_active":"2024-09-11T22:20:50.550978+0000","last_peered":"2024-09-11T22:20:50.550978+0000","last_clean":"2024-09-11T22:20:50.550978+0000","last_became_active":"2024-09-11T22:20:49.264054+0000","last_became_peered":"2024-09-11T22:20:49.264054+0000","last_unstale":"2024-09-11T22:20:50.550978+0000","last_undegraded":"2024-09-11T22:20:50.550978+0000","last_fullsized":"2024-09-11T22:20:50.550978+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:21.423018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550484+0000","last_change":"2024-09-11T22:20:48.307406+0000","last_active":"2024-09-11T22:20:50.550484+0000","last_peered":"2024-09-11T22:20:50.550484+0000","last_clean":"2024-09-11T22:20:50.550484+0000","last_became_active":"2024-09-11T22:20:48.306853+0000","last_became_peered":"2024-09-11T22:20:48.306853+0000","last_unstale":"2024-09-11T22:20:50.550484+0000","last_undegraded":"2024-09-11T22:20:50.550484+0000","last_fullsized":"2024-09-11T22:20:50.550484+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:58.807896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550830+0000","last_change":"2024-09-11T22:20:49.259551+0000","last_active":"2024-09-11T22:20:50.550830+0000","last_peered":"2024-09-11T22:20:50.550830+0000","last_clean":"2024-09-11T22:20:50.550830+0000","last_became_active":"2024-09-11T22:20:49.258914+0000","last_became_peered":"2024-09-11T22:20:49.258914+0000","last_unstale":"2024-09-11T22:20:50.550830+0000","last_undegraded":"2024-09-11T22:20:50.550830+0000","last_fullsized":"2024-09-11T22:20:50.550830+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:21.209058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551585+0000","last_change":"2024-09-11T22:20:48.303303+0000","last_active":"2024-09-11T22:20:50.551585+0000","last_peered":"2024-09-11T22:20:50.551585+0000","last_clean":"2024-09-11T22:20:50.551585+0000","last_became_active":"2024-09-11T22:20:48.302954+0000","last_became_peered":"2024-09-11T22:20:48.302954+0000","last_unstale":"2024-09-11T22:20:50.551585+0000","last_undegraded":"2024-09-11T22:20:50.551585+0000","last_fullsized":"2024-09-11T22:20:50.551585+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:53.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.242358+0000","last_change":"2024-09-11T22:20:49.260083+0000","last_active":"2024-09-11T22:20:50.242358+0000","last_peered":"2024-09-11T22:20:50.242358+0000","last_clean":"2024-09-11T22:20:50.242358+0000","last_became_active":"2024-09-11T22:20:49.259745+0000","last_became_peered":"2024-09-11T22:20:49.259745+0000","last_unstale":"2024-09-11T22:20:50.242358+0000","last_undegraded":"2024-09-11T22:20:50.242358+0000","last_fullsized":"2024-09-11T22:20:50.242358+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:26.278211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.550883+0000","last_change":"2024-09-11T22:20:48.300845+0000","last_active":"2024-09-11T22:20:50.550883+0000","last_peered":"2024-09-11T22:20:50.550883+0000","last_clean":"2024-09-11T22:20:50.550883+0000","last_became_active":"2024-09-11T22:20:48.298386+0000","last_became_peered":"2024-09-11T22:20:48.298386+0000","last_unstale":"2024-09-11T22:20:50.550883+0000","last_undegraded":"2024-09-11T22:20:50.550883+0000","last_fullsized":"2024-09-11T22:20:50.550883+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:37.937300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.241663+0000","last_change":"2024-09-11T22:20:49.261945+0000","last_active":"2024-09-11T22:20:50.241663+0000","last_peered":"2024-09-11T22:20:50.241663+0000","last_clean":"2024-09-11T22:20:50.241663+0000","last_became_active":"2024-09-11T22:20:49.261653+0000","last_became_peered":"2024-09-11T22:20:49.261653+0000","last_unstale":"2024-09-11T22:20:50.241663+0000","last_undegraded":"2024-09-11T22:20:50.241663+0000","last_fullsized":"2024-09-11T22:20:50.241663+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:48.281278+0000","last_clean_scrub_stamp":"2024-09-11T22:20:48.281278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:51.887803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.551458+0000","last_change":"2024-09-11T22:20:48.305326+0000","last_active":"2024-09-11T22:20:50.551458+0000","last_peered":"2024-09-11T22:20:50.551458+0000","last_clean":"2024-09-11T22:20:50.551458+0000","last_became_active":"2024-09-11T22:20:48.305080+0000","last_became_peered":"2024-09-11T22:20:48.305080+0000","last_unstale":"2024-09-11T22:20:50.551458+0000","last_undegraded":"2024-09-11T22:20:50.551458+0000","last_fullsized":"2024-09-11T22:20:50.551458+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:47.279401+0000","last_clean_scrub_stamp":"2024-09-11T22:20:47.279401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:03.217415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":415,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-11T22:20:50.243115+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:20:50.243115+0000","last_peered":"2024-09-11T22:20:50.243115+0000","last_clean":"2024-09-11T22:20:50.243115+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:20:50.243115+0000","last_undegraded":"2024-09-11T22:20:50.243115+0000","last_fullsized":"2024-09-11T22:20:50.243115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509563,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51144,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320696,"statfs":{"total":96636764160,"available":96584392704,"internally_reserved":0,"allocated":1953792,"data_stored":855470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509560,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46996,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324844,"statfs":{"total":96636764160,"available":96588640256,"internally_reserved":0,"allocated":1957888,"data_stored":856052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509562,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55320,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316520,"statfs":{"total":96636764160,"available":96580116480,"internally_reserved":0,"allocated":1966080,"data_stored":857130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509562,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59468,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312372,"statfs":{"total":96636764160,"available":96575868928,"internally_reserved":0,"allocated":1953792,"data_stored":855482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509562,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63632,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308208,"statfs":{"total":96636764160,"available":96571604992,"internally_reserved":0,"allocated":1953792,"data_stored":855482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509561,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55884,"kb_used_data":2484,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315956,"statfs":{"total":96636764160,"available":96579538944,"internally_reserved":0,"allocated":2543616,"data_stored":1445816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51748,"kb_used_data":2508,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320092,"statfs":{"total":96636764160,"available":96583774208,"internally_reserved":0,"allocated":2568192,"data_stored":1448170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59464,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312376,"statfs":{"total":96636764160,"available":96575873024,"internally_reserved":0,"allocated":1953792,"data_stored":855538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:20:57.011 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:20:57.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T22:20:57.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.156+0000 7fafc0549640 1 Processor -- start 2024-09-11T22:20:57.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.156+0000 7fafc0549640 1 -- start start 2024-09-11T22:20:57.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.157+0000 7fafc0549640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fafb815e8e0 0x7fafb80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:57.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.157+0000 7fafc0549640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fafb80d1580 0x7fafb80d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:57.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.157+0000 7fafc0549640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb80d1ee0 con 0x7fafb8162350 2024-09-11T22:20:57.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.157+0000 7fafc0549640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fafb815ecc0 con 0x7fafb815e8e0 2024-09-11T22:20:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.157+0000 7fafc0549640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fafb80d2ad0 con 0x7fafb80d1580 2024-09-11T22:20:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.157+0000 7fafbe2e5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fafb815e8e0 0x7fafb80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.157+0000 7fafbe2e5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fafb815e8e0 0x7fafb80b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36976/0 (socket says 172.21.15.50:36976) 2024-09-11T22:20:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.157+0000 7fafbe2e5640 1 -- 172.21.15.50:0/1894904239 learned_addr learned my addr 172.21.15.50:0/1894904239 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.157+0000 7fafbdae4640 1 --2- 172.21.15.50:0/1894904239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fafb80d1580 0x7fafb80d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.157+0000 7fafbe2e5640 1 -- 172.21.15.50:0/1894904239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fafb80d1580 msgr2=0x7fafb80d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.157+0000 7fafbe2e5640 1 --2- 172.21.15.50:0/1894904239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fafb80d1580 0x7fafb80d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.157+0000 7fafbe2e5640 1 -- 172.21.15.50:0/1894904239 >> v1:172.21.15.77:6789/0 conn(0x7fafb8162350 legacy=0x7fafb8162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:57.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.157+0000 7fafbe2e5640 1 -- 172.21.15.50:0/1894904239 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb8163080 con 0x7fafb815e8e0 2024-09-11T22:20:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.158+0000 7fafbe2e5640 1 --2- 172.21.15.50:0/1894904239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb815e8e0 0x7fafb80b7880 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fafac009870 tx=0x7fafac02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d456bdcbc435ab44 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.158+0000 7fafbd2e3640 1 -- 172.21.15.50:0/1894904239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac037070 con 0x7fafb815e8e0 2024-09-11T22:20:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.158+0000 7fafbd2e3640 1 -- 172.21.15.50:0/1894904239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafac02ae50 con 0x7fafb815e8e0 2024-09-11T22:20:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.158+0000 7fafbd2e3640 1 -- 172.21.15.50:0/1894904239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac032860 con 0x7fafb815e8e0 2024-09-11T22:20:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.159+0000 7fafc0549640 1 -- 172.21.15.50:0/1894904239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb815e8e0 msgr2=0x7fafb80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.159+0000 7fafc0549640 1 --2- 172.21.15.50:0/1894904239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb815e8e0 0x7fafb80b7880 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fafac009870 tx=0x7fafac02a300 comp rx=0 tx=0).stop 2024-09-11T22:20:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.159+0000 7fafc0549640 1 -- 172.21.15.50:0/1894904239 shutdown_connections 2024-09-11T22:20:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.159+0000 7fafc0549640 1 --2- 172.21.15.50:0/1894904239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fafb80d1580 0x7fafb80d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.159+0000 7fafc0549640 1 --2- 172.21.15.50:0/1894904239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb815e8e0 0x7fafb80b7880 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.159+0000 7fafc0549640 1 -- 172.21.15.50:0/1894904239 >> 172.21.15.50:0/1894904239 conn(0x7fafb8067ba0 msgr2=0x7fafb8067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.159+0000 7fafc0549640 1 -- 172.21.15.50:0/1894904239 shutdown_connections 2024-09-11T22:20:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.159+0000 7fafc0549640 1 -- 172.21.15.50:0/1894904239 wait complete. 2024-09-11T22:20:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.160+0000 7fafc0549640 1 Processor -- start 2024-09-11T22:20:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.160+0000 7fafc0549640 1 -- start start 2024-09-11T22:20:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafc0549640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafb80d1580 0x7fafb8148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafc0549640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb815e8e0 0x7fafb80b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafc0549640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fafb8162350 0x7fafb8145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafc0549640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80d3000 con 0x7fafb815e8e0 2024-09-11T22:20:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafc0549640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80d3370 con 0x7fafb80d1580 2024-09-11T22:20:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafc0549640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fafb80d3800 con 0x7fafb8162350 2024-09-11T22:20:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafbdae4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb815e8e0 0x7fafb80b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafbdae4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb815e8e0 0x7fafb80b66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36992/0 (socket says 172.21.15.50:36992) 2024-09-11T22:20:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafbdae4640 1 -- 172.21.15.50:0/3804295808 learned_addr learned my addr 172.21.15.50:0/3804295808 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafbe2e5640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafb80d1580 0x7fafb8148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafbeae6640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fafb8162350 0x7fafb8145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafbdae4640 1 -- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fafb8162350 msgr2=0x7fafb8145750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafbdae4640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fafb8162350 0x7fafb8145750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafbdae4640 1 -- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafb80d1580 msgr2=0x7fafb8148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafbdae4640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafb80d1580 0x7fafb8148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.161+0000 7fafbdae4640 1 -- 172.21.15.50:0/3804295808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb80cb8c0 con 0x7fafb815e8e0 2024-09-11T22:20:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.162+0000 7fafbdae4640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb815e8e0 0x7fafb80b66d0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fafb400d7d0 tx=0x7fafb400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.162+0000 7fafaaffd640 1 -- 172.21.15.50:0/3804295808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb400b6c0 con 0x7fafb815e8e0 2024-09-11T22:20:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.162+0000 7fafaaffd640 1 -- 172.21.15.50:0/3804295808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb4019070 con 0x7fafb815e8e0 2024-09-11T22:20:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.162+0000 7fafc0549640 1 -- 172.21.15.50:0/3804295808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb80b6f00 con 0x7fafb815e8e0 2024-09-11T22:20:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.162+0000 7fafaaffd640 1 -- 172.21.15.50:0/3804295808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb400bac0 con 0x7fafb815e8e0 2024-09-11T22:20:57.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.162+0000 7fafc0549640 1 -- 172.21.15.50:0/3804295808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb81465d0 con 0x7fafb815e8e0 2024-09-11T22:20:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.163+0000 7fafc0549640 1 -- 172.21.15.50:0/3804295808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb80d19a0 con 0x7fafb815e8e0 2024-09-11T22:20:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.163+0000 7fafaaffd640 1 -- 172.21.15.50:0/3804295808 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafb400bc60 con 0x7fafb815e8e0 2024-09-11T22:20:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.164+0000 7fafaaffd640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faf9c06be60 0x7faf9c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:57.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.164+0000 7fafaaffd640 1 -- 172.21.15.50:0/3804295808 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7fafb408b150 con 0x7fafb815e8e0 2024-09-11T22:20:57.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.164+0000 7fafbe2e5640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faf9c06be60 0x7faf9c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:57.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.165+0000 7fafbe2e5640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faf9c06be60 0x7faf9c06e320 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fafac034000 tx=0x7fafac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:57.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.168+0000 7fafaaffd640 1 -- 172.21.15.50:0/3804295808 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fafb80cb8c0 con 0x7fafb815e8e0 2024-09-11T22:20:57.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.412+0000 7fafc0549640 1 -- 172.21.15.50:0/3804295808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fafb80ba770 con 0x7fafb815e8e0 2024-09-11T22:20:57.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.414+0000 7fafaaffd640 1 -- 172.21.15.50:0/3804295808 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7fafb40594b0 con 0x7fafb815e8e0 2024-09-11T22:20:57.415 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:20:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:20:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-09-11T22:20:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-09-11T22:20:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T22:20:57.416 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-11T22:20:57.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.416+0000 7fafc0549640 1 -- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faf9c06be60 msgr2=0x7faf9c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.416+0000 7fafc0549640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faf9c06be60 0x7faf9c06e320 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fafac034000 tx=0x7fafac02e000 comp rx=0 tx=0).stop 2024-09-11T22:20:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.416+0000 7fafc0549640 1 -- 172.21.15.50:0/3804295808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb815e8e0 msgr2=0x7fafb80b66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.416+0000 7fafc0549640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb815e8e0 0x7fafb80b66d0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fafb400d7d0 tx=0x7fafb400dc90 comp rx=0 tx=0).stop 2024-09-11T22:20:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.416+0000 7fafc0549640 1 -- 172.21.15.50:0/3804295808 shutdown_connections 2024-09-11T22:20:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.416+0000 7fafc0549640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faf9c06be60 0x7faf9c06e320 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.416+0000 7fafc0549640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fafb8162350 0x7fafb8145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.416+0000 7fafc0549640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb815e8e0 0x7fafb80b66d0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.416+0000 7fafc0549640 1 --2- 172.21.15.50:0/3804295808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafb80d1580 0x7fafb8148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.416+0000 7fafc0549640 1 -- 172.21.15.50:0/3804295808 >> 172.21.15.50:0/3804295808 conn(0x7fafb8067ba0 msgr2=0x7fafb80b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.417+0000 7fafc0549640 1 -- 172.21.15.50:0/3804295808 shutdown_connections 2024-09-11T22:20:57.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.417+0000 7fafc0549640 1 -- 172.21.15.50:0/3804295808 wait complete. 2024-09-11T22:20:57.428 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.530+0000 7f1e3f8e4640 1 Processor -- start 2024-09-11T22:20:57.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.530+0000 7f1e3f8e4640 1 -- start start 2024-09-11T22:20:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.531+0000 7f1e3f8e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e38161fa0 0x7f1e380b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.531+0000 7f1e3f8e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e380cf610 0x7f1e380cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.531+0000 7f1e3f8e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e380cfbd0 con 0x7f1e380b1600 2024-09-11T22:20:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.531+0000 7f1e3f8e4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1e380d1220 con 0x7f1e380cf610 2024-09-11T22:20:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.531+0000 7f1e3f8e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1e380d17e0 con 0x7f1e38161fa0 2024-09-11T22:20:57.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.531+0000 7f1e3de81640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e380cf610 0x7f1e380cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:57.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.531+0000 7f1e3de81640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e380cf610 0x7f1e380cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50322/0 (socket says 172.21.15.50:50322) 2024-09-11T22:20:57.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.531+0000 7f1e3de81640 1 -- 172.21.15.50:0/3732625769 learned_addr learned my addr 172.21.15.50:0/3732625769 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:57.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.531+0000 7f1e3de81640 1 -- 172.21.15.50:0/3732625769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e38161fa0 msgr2=0x7f1e380b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:57.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.531+0000 7f1e3de81640 1 --2- 172.21.15.50:0/3732625769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e38161fa0 0x7f1e380b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.531+0000 7f1e3de81640 1 -- 172.21.15.50:0/3732625769 >> v1:172.21.15.77:6789/0 conn(0x7f1e380b1600 legacy=0x7f1e380cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:57.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.531+0000 7f1e3de81640 1 -- 172.21.15.50:0/3732625769 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e380cfeb0 con 0x7f1e380cf610 2024-09-11T22:20:57.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.532+0000 7f1e3de81640 1 --2- 172.21.15.50:0/3732625769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e380cf610 0x7f1e380cccd0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009e50 tx=0x7f1e3002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa5ce8afea03de3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:57.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.532+0000 7f1e2ffff640 1 -- 172.21.15.50:0/3732625769 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30036070 con 0x7f1e380cf610 2024-09-11T22:20:57.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.532+0000 7f1e2ffff640 1 -- 172.21.15.50:0/3732625769 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e30031600 con 0x7f1e380cf610 2024-09-11T22:20:57.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.532+0000 7f1e2ffff640 1 -- 172.21.15.50:0/3732625769 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e300319d0 con 0x7f1e380cf610 2024-09-11T22:20:57.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.533+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3732625769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e380cf610 msgr2=0x7f1e380cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:57.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.533+0000 7f1e3f8e4640 1 --2- 172.21.15.50:0/3732625769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e380cf610 0x7f1e380cccd0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009e50 tx=0x7f1e3002a6c0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.533+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3732625769 shutdown_connections 2024-09-11T22:20:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.533+0000 7f1e3f8e4640 1 --2- 172.21.15.50:0/3732625769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e380cf610 0x7f1e380cccd0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.533+0000 7f1e3f8e4640 1 --2- 172.21.15.50:0/3732625769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e38161fa0 0x7f1e380b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.533+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3732625769 >> 172.21.15.50:0/3732625769 conn(0x7f1e3809ba50 msgr2=0x7f1e380b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.533+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3732625769 shutdown_connections 2024-09-11T22:20:57.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.533+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3732625769 wait complete. 2024-09-11T22:20:57.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.534+0000 7f1e3f8e4640 1 Processor -- start 2024-09-11T22:20:57.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.534+0000 7f1e3f8e4640 1 -- start start 2024-09-11T22:20:57.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3f8e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e380b1600 0x7f1e38154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:57.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3f8e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e380cf610 0x7f1e380b8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:57.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3f8e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e38161fa0 0x7f1e381f4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:57.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3f8e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1e38162500 con 0x7f1e38161fa0 2024-09-11T22:20:57.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3f8e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1e38162380 con 0x7f1e380cf610 2024-09-11T22:20:57.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3f8e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1e380d1c70 con 0x7f1e380b1600 2024-09-11T22:20:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3de81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e38161fa0 0x7f1e381f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3de81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e38161fa0 0x7f1e381f4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50338/0 (socket says 172.21.15.50:50338) 2024-09-11T22:20:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3de81640 1 -- 172.21.15.50:0/3761242026 learned_addr learned my addr 172.21.15.50:0/3761242026 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3ce7f640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e380cf610 0x7f1e380b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3d680640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e380b1600 0x7f1e38154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3de81640 1 -- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e380b1600 msgr2=0x7f1e38154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3de81640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e380b1600 0x7f1e38154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3de81640 1 -- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e380cf610 msgr2=0x7f1e380b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3de81640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e380cf610 0x7f1e380b8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3de81640 1 -- 172.21.15.50:0/3761242026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e380ca8f0 con 0x7f1e38161fa0 2024-09-11T22:20:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.535+0000 7f1e3ce7f640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e380cf610 0x7f1e380b8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.536+0000 7f1e3de81640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e38161fa0 0x7f1e381f4850 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f1e30034040 tx=0x7f1e30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:57.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.536+0000 7f1e2dffb640 1 -- 172.21.15.50:0/3761242026 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30041020 con 0x7f1e38161fa0 2024-09-11T22:20:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.536+0000 7f1e2dffb640 1 -- 172.21.15.50:0/3761242026 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e300077a0 con 0x7f1e38161fa0 2024-09-11T22:20:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.536+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3761242026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e380cabd0 con 0x7f1e38161fa0 2024-09-11T22:20:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.536+0000 7f1e2dffb640 1 -- 172.21.15.50:0/3761242026 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30036040 con 0x7f1e38161fa0 2024-09-11T22:20:57.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.536+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3761242026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e380cb190 con 0x7f1e38161fa0 2024-09-11T22:20:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.537+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3761242026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e380b4d20 con 0x7f1e38161fa0 2024-09-11T22:20:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.537+0000 7f1e2dffb640 1 -- 172.21.15.50:0/3761242026 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e30044020 con 0x7f1e38161fa0 2024-09-11T22:20:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.538+0000 7f1e2dffb640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e1c06be30 0x7f1e1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.538+0000 7f1e2dffb640 1 -- 172.21.15.50:0/3761242026 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f1e300abce0 con 0x7f1e38161fa0 2024-09-11T22:20:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.538+0000 7f1e3d680640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e1c06be30 0x7f1e1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:57.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.538+0000 7f1e3d680640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e1c06be30 0x7f1e1c06e2f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009890 tx=0x7f1e34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:57.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.542+0000 7f1e2dffb640 1 -- 172.21.15.50:0/3761242026 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e3004b030 con 0x7f1e38161fa0 2024-09-11T22:20:57.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.758+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3761242026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e380af560 con 0x7f1e38161fa0 2024-09-11T22:20:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.759+0000 7f1e2dffb640 1 -- 172.21.15.50:0/3761242026 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5233 (secure 0 0 0) 0x7f1e3007a690 con 0x7f1e38161fa0 2024-09-11T22:20:57.760 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:57.760 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:20:50.638363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9426":{"gid":9426,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3562809701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3562809701},{"type":"v1","addr":"172.21.15.50:6835","nonce":3562809701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9426,"qdb_cluster":[9426]},"id":11}]} 2024-09-11T22:20:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 109 2024-09-11T22:20:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.761+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e1c06be30 msgr2=0x7f1e1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.761+0000 7f1e3f8e4640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e1c06be30 0x7f1e1c06e2f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009890 tx=0x7f1e34008040 comp rx=0 tx=0).stop 2024-09-11T22:20:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.761+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3761242026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e38161fa0 msgr2=0x7f1e381f4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.761+0000 7f1e3f8e4640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e38161fa0 0x7f1e381f4850 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f1e30034040 tx=0x7f1e30004a40 comp rx=0 tx=0).stop 2024-09-11T22:20:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.761+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3761242026 shutdown_connections 2024-09-11T22:20:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.761+0000 7f1e3f8e4640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e1c06be30 0x7f1e1c06e2f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.761+0000 7f1e3f8e4640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e38161fa0 0x7f1e381f4850 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.761+0000 7f1e3f8e4640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e380cf610 0x7f1e380b8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.761+0000 7f1e3f8e4640 1 --2- 172.21.15.50:0/3761242026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e380b1600 0x7f1e38154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.761+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3761242026 >> 172.21.15.50:0/3761242026 conn(0x7f1e3809ba50 msgr2=0x7f1e380aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.761+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3761242026 shutdown_connections 2024-09-11T22:20:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:57.761+0000 7f1e3f8e4640 1 -- 172.21.15.50:0/3761242026 wait complete. 2024-09-11T22:20:58.176 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 109, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:20:48.656304+0000', 'modified': '2024-09-11T22:20:50.638363+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9426}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9426': {'gid': 9426, 'name': 'a', 'rank': 0, 'incarnation': 107, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6835/3562809701', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6833', 'nonce': 3562809701}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 3562809701}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9426, 'qdb_cluster': [9426]} 2024-09-11T22:20:58.176 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:20:58.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T22:20:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.282+0000 7f0a3c22c640 1 Processor -- start 2024-09-11T22:20:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.282+0000 7f0a3c22c640 1 -- start start 2024-09-11T22:20:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.283+0000 7f0a3c22c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a340cf790 0x7f0a340b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.283+0000 7f0a3c22c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a34162110 con 0x7f0a34161d30 2024-09-11T22:20:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.283+0000 7f0a3c22c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a340cfd70 con 0x7f0a340d11d0 2024-09-11T22:20:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.283+0000 7f0a3c22c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0a340d3450 con 0x7f0a340cf790 2024-09-11T22:20:58.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.283+0000 7f0a397c7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a340cf790 0x7f0a340b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.283+0000 7f0a39fc8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0a34161d30 0x7f0a34162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54328/0 (socket says 172.21.15.50:54328) 2024-09-11T22:20:58.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.283+0000 7f0a39fc8640 1 -- 172.21.15.50:0/1758242182 learned_addr learned my addr 172.21.15.50:0/1758242182 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.283+0000 7f0a397c7640 1 -- 172.21.15.50:0/1758242182 >> v1:172.21.15.77:6789/0 conn(0x7f0a340d11d0 legacy=0x7f0a340d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.283+0000 7f0a397c7640 1 -- 172.21.15.50:0/1758242182 >> v1:172.21.15.50:6789/0 conn(0x7f0a34161d30 legacy=0x7f0a34162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.283+0000 7f0a397c7640 1 -- 172.21.15.50:0/1758242182 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a340d2b20 con 0x7f0a340cf790 2024-09-11T22:20:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.283+0000 7f0a38fc6640 1 -- 172.21.15.50:0/1758242182 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 211108041 0 0) 0x7f0a34162110 con 0x7f0a34161d30 2024-09-11T22:20:58.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.284+0000 7f0a397c7640 1 --2- 172.21.15.50:0/1758242182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a340cf790 0x7f0a340b78f0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f0a240097a0 tx=0x7f0a2402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567d365d9304eed7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.284+0000 7f0a38fc6640 1 -- 172.21.15.50:0/1758242182 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24037070 con 0x7f0a340cf790 2024-09-11T22:20:58.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.284+0000 7f0a38fc6640 1 -- 172.21.15.50:0/1758242182 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a24032440 con 0x7f0a340cf790 2024-09-11T22:20:58.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.284+0000 7f0a38fc6640 1 -- 172.21.15.50:0/1758242182 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24032810 con 0x7f0a340cf790 2024-09-11T22:20:58.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.284+0000 7f0a3c22c640 1 -- 172.21.15.50:0/1758242182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a340cf790 msgr2=0x7f0a340b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.284+0000 7f0a3c22c640 1 --2- 172.21.15.50:0/1758242182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a340cf790 0x7f0a340b78f0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f0a240097a0 tx=0x7f0a2402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.285+0000 7f0a3c22c640 1 -- 172.21.15.50:0/1758242182 shutdown_connections 2024-09-11T22:20:58.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.285+0000 7f0a3c22c640 1 --2- 172.21.15.50:0/1758242182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a340cf790 0x7f0a340b78f0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.285+0000 7f0a3c22c640 1 -- 172.21.15.50:0/1758242182 >> 172.21.15.50:0/1758242182 conn(0x7f0a340727a0 msgr2=0x7f0a340679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.285+0000 7f0a3c22c640 1 -- 172.21.15.50:0/1758242182 shutdown_connections 2024-09-11T22:20:58.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.285+0000 7f0a3c22c640 1 -- 172.21.15.50:0/1758242182 wait complete. 2024-09-11T22:20:58.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.286+0000 7f0a3c22c640 1 Processor -- start 2024-09-11T22:20:58.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.286+0000 7f0a3c22c640 1 -- start start 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3c22c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a340cf790 0x7f0a3415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3c22c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a340d11d0 0x7f0a340c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3c22c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a34161d30 0x7f0a34151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3c22c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0a340d30e0 con 0x7f0a34161d30 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3c22c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0a340b7e30 con 0x7f0a340d11d0 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3c22c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0a340d1600 con 0x7f0a340cf790 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3a7c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a34161d30 0x7f0a34151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3a7c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a34161d30 0x7f0a34151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50348/0 (socket says 172.21.15.50:50348) 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3a7c9640 1 -- 172.21.15.50:0/2491493973 learned_addr learned my addr 172.21.15.50:0/2491493973 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a397c7640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a340d11d0 0x7f0a340c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a39fc8640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a340cf790 0x7f0a3415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3a7c9640 1 -- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a340cf790 msgr2=0x7f0a3415e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3a7c9640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a340cf790 0x7f0a3415e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3a7c9640 1 -- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a340d11d0 msgr2=0x7f0a340c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3a7c9640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a340d11d0 0x7f0a340c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3a7c9640 1 -- 172.21.15.50:0/2491493973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a34152100 con 0x7f0a34161d30 2024-09-11T22:20:58.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3a7c9640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a34161d30 0x7f0a34151bc0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00c780 tx=0x7f0a2c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a2a7fc640 1 -- 172.21.15.50:0/2491493973 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c004b60 con 0x7f0a34161d30 2024-09-11T22:20:58.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a2a7fc640 1 -- 172.21.15.50:0/2491493973 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c004d00 con 0x7f0a34161d30 2024-09-11T22:20:58.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a2a7fc640 1 -- 172.21.15.50:0/2491493973 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c00aa90 con 0x7f0a34161d30 2024-09-11T22:20:58.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3c22c640 1 -- 172.21.15.50:0/2491493973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a340ca1d0 con 0x7f0a34161d30 2024-09-11T22:20:58.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.287+0000 7f0a3c22c640 1 -- 172.21.15.50:0/2491493973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a340ca790 con 0x7f0a34161d30 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.289+0000 7f0a2a7fc640 1 -- 172.21.15.50:0/2491493973 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a2c00ac30 con 0x7f0a34161d30 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.289+0000 7f0a2a7fc640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0a1806be30 0x7f0a1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.290+0000 7f0a2a7fc640 1 -- 172.21.15.50:0/2491493973 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f0a2c08b100 con 0x7f0a34161d30 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.290+0000 7f0a39fc8640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0a1806be30 0x7f0a1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.290+0000 7f0a39fc8640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0a1806be30 0x7f0a1806e2f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0a30000f60 tx=0x7f0a30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.291+0000 7f0a3efbf740 1 Processor -- start 2024-09-11T22:20:58.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.291+0000 7f0a3efbf740 1 -- start start 2024-09-11T22:20:58.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.291+0000 7f0a3efbf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 0x56324d475a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.291+0000 7f0a3efbf740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d42da80 0x56324d4306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.291+0000 7f0a3efbf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d42a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.291+0000 7f0a3efbf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56324d392520 con 0x56324d4302c0 2024-09-11T22:20:58.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.291+0000 7f0a3efbf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56324d33a3e0 con 0x56324d431a50 2024-09-11T22:20:58.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.291+0000 7f0a3efbf740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56324d38e4e0 con 0x56324d42da80 2024-09-11T22:20:58.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a39fc8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 0x56324d475a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a39fc8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 0x56324d475a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50354/0 (socket says 172.21.15.50:50354) 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a39fc8640 1 -- 172.21.15.50:0/320962912 learned_addr learned my addr 172.21.15.50:0/320962912 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a3a7c9640 1 --2- 172.21.15.50:0/320962912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d42a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a397c7640 1 --2- 172.21.15.50:0/320962912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d42da80 0x56324d4306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a39fc8640 1 -- 172.21.15.50:0/320962912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d42da80 msgr2=0x56324d4306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a39fc8640 1 --2- 172.21.15.50:0/320962912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d42da80 0x56324d4306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a39fc8640 1 -- 172.21.15.50:0/320962912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 msgr2=0x56324d42a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a39fc8640 1 --2- 172.21.15.50:0/320962912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d42a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a39fc8640 1 -- 172.21.15.50:0/320962912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324d3552f0 con 0x56324d4302c0 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a3a7c9640 1 --2- 172.21.15.50:0/320962912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d42a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a39fc8640 1 --2- 172.21.15.50:0/320962912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 0x56324d475a60 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f0a300074f0 tx=0x7f0a30010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe937eaf107a4480 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a177fe640 1 -- 172.21.15.50:0/320962912 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3000da70 con 0x56324d4302c0 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a177fe640 1 -- 172.21.15.50:0/320962912 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3000dc10 con 0x56324d4302c0 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.292+0000 7f0a177fe640 1 -- 172.21.15.50:0/320962912 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30020450 con 0x56324d4302c0 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.293+0000 7f0a3efbf740 1 -- 172.21.15.50:0/320962912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 msgr2=0x56324d475a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.293+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/320962912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 0x56324d475a60 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f0a300074f0 tx=0x7f0a30010000 comp rx=0 tx=0).stop 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.293+0000 7f0a3efbf740 1 -- 172.21.15.50:0/320962912 shutdown_connections 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.293+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/320962912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d42da80 0x56324d4306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.293+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/320962912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d42a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.293+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/320962912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 0x56324d475a60 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.293+0000 7f0a3efbf740 1 -- 172.21.15.50:0/320962912 >> 172.21.15.50:0/320962912 conn(0x56324d42ca80 msgr2=0x56324d474f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.293+0000 7f0a3efbf740 1 -- 172.21.15.50:0/320962912 shutdown_connections 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.293+0000 7f0a3efbf740 1 -- 172.21.15.50:0/320962912 wait complete. 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.293+0000 7f0a3efbf740 1 -- start start 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.294+0000 7f0a3efbf740 1 Processor -- start 2024-09-11T22:20:58.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.294+0000 7f0a3efbf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 0x56324d451480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a3efbf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d488ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a3efbf740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d4519c0 0x56324d489220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a3efbf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56324d42bf20 con 0x56324d4302c0 2024-09-11T22:20:58.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a3efbf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56324d31b450 con 0x56324d431a50 2024-09-11T22:20:58.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a3efbf740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56324d476290 con 0x56324d4519c0 2024-09-11T22:20:58.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a3efbf740 10 client.0 _ll_register_callbacks cb 0x56324d0a4ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:58.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a39fc8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 0x56324d451480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a39fc8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 0x56324d451480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50368/0 (socket says 172.21.15.50:50368) 2024-09-11T22:20:58.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a39fc8640 1 -- 172.21.15.50:0/1528035360 learned_addr learned my addr 172.21.15.50:0/1528035360 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:58.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a39fc8640 1 -- 172.21.15.50:0/1528035360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d4519c0 msgr2=0x56324d489220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a39fc8640 1 --2- 172.21.15.50:0/1528035360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d4519c0 0x56324d489220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a39fc8640 1 -- 172.21.15.50:0/1528035360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 msgr2=0x56324d488ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a39fc8640 1 --2- 172.21.15.50:0/1528035360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d488ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a39fc8640 1 -- 172.21.15.50:0/1528035360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324d0a52d0 con 0x56324d4302c0 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a39fc8640 1 --2- 172.21.15.50:0/1528035360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 0x56324d451480 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f0a30005f90 tx=0x7f0a30012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791d05275c087865 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a14ff9640 1 -- 172.21.15.50:0/1528035360 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30020660 con 0x56324d4302c0 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1528035360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a3000dc10 con 0x56324d4302c0 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a14ff9640 1 -- 172.21.15.50:0/1528035360 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f0a30020800 con 0x56324d4302c0 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a14ff9640 1 -- 172.21.15.50:0/1528035360 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) ==== 24+0+0 (secure 0 0 0) 0x7f0a30034050 con 0x56324d4302c0 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a3efbf740 10 client.9573 fetch_fsmap learned FSMap version 109 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.295+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1528035360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) -- 0x56324d16f6b0 con 0x56324d4302c0 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.296+0000 7f0a14ff9640 1 -- 172.21.15.50:0/1528035360 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3000dc10 con 0x56324d4302c0 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.296+0000 7f0a14ff9640 1 -- 172.21.15.50:0/1528035360 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 109) ==== 3502+0+0 (secure 0 0 0) 0x7f0a30037020 con 0x56324d4302c0 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.296+0000 7f0a3efbf740 10 client.9573 fetch_fsmap finished waiting for FSMap version 109 2024-09-11T22:20:58.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.296+0000 7f0a3efbf740 10 client.9573 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.296+0000 7f0a3efbf740 20 client.9573 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.296+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/1528035360 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x56324d440cc0 0x56324d4410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.296+0000 7f0a3efbf740 4 client.9573 mds_command: new command op to 9426 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.296+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1528035360 --> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56324d39fc50 con 0x56324d440cc0 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.296+0000 7f0a397c7640 1 --2- 172.21.15.50:0/1528035360 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x56324d440cc0 0x56324d4410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.296+0000 7f0a397c7640 1 --2- 172.21.15.50:0/1528035360 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x56324d440cc0 0x56324d4410a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2049c5891568d905 server_cookie=36633a0cff6429d8 in_seq=0 out_seq=0 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.296+0000 7f0a14ff9640 10 client.9573 ms_handle_connect on v2:172.21.15.50:6833/3562809701 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a14ff9640 1 -- 172.21.15.50:0/1528035360 <== mds.0 v2:172.21.15.50:6833/3562809701 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56324d39fc50 con 0x56324d440cc0 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a14ff9640 10 client.9573 handle_command_reply: tid=0 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a3efbf740 1 client.9573 shutdown 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1528035360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 msgr2=0x56324d451480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/1528035360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 0x56324d451480 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f0a30005f90 tx=0x7f0a30012000 comp rx=0 tx=0).stop 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1528035360 shutdown_connections 2024-09-11T22:20:58.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/1528035360 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x56324d440cc0 0x56324d4410a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/1528035360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d4519c0 0x56324d489220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a14ff9640 0 client.9573 ms_handle_reset on v2:172.21.15.50:6833/3562809701 2024-09-11T22:20:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/1528035360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d488ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/1528035360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4302c0 0x56324d451480 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1528035360 >> 172.21.15.50:0/1528035360 conn(0x56324d42da80 msgr2=0x56324d478440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1528035360 shutdown_connections 2024-09-11T22:20:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1528035360 wait complete. 2024-09-11T22:20:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.297+0000 7f0a3efbf740 20 client.9573 trim_cache size 0 max 16384 2024-09-11T22:20:58.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.316+0000 7f0a3efbf740 1 Processor -- start 2024-09-11T22:20:58.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.316+0000 7f0a3efbf740 1 -- start start 2024-09-11T22:20:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.316+0000 7f0a3efbf740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d4302c0 0x56324d4442d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.316+0000 7f0a3efbf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d478440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.316+0000 7f0a3efbf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 0x56324d478980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.316+0000 7f0a3efbf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0a341ffc20 con 0x56324d4519c0 2024-09-11T22:20:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.316+0000 7f0a3efbf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0a341fef60 con 0x56324d431a50 2024-09-11T22:20:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.316+0000 7f0a3efbf740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0a341ff5b0 con 0x56324d4302c0 2024-09-11T22:20:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.317+0000 7f0a3a7c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 0x56324d478980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.317+0000 7f0a3a7c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 0x56324d478980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50374/0 (socket says 172.21.15.50:50374) 2024-09-11T22:20:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.317+0000 7f0a3a7c9640 1 -- 172.21.15.50:0/443552104 learned_addr learned my addr 172.21.15.50:0/443552104 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.317+0000 7f0a3a7c9640 1 -- 172.21.15.50:0/443552104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d4302c0 msgr2=0x56324d4442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.317+0000 7f0a3a7c9640 1 --2- 172.21.15.50:0/443552104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d4302c0 0x56324d4442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.317+0000 7f0a3a7c9640 1 -- 172.21.15.50:0/443552104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 msgr2=0x56324d478440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.317+0000 7f0a3a7c9640 1 --2- 172.21.15.50:0/443552104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d478440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.317+0000 7f0a3a7c9640 1 -- 172.21.15.50:0/443552104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324d489430 con 0x56324d4519c0 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.317+0000 7f0a3a7c9640 1 --2- 172.21.15.50:0/443552104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 0x56324d478980 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c089590 tx=0x7f0a2c0592a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3b5f8e2111a368 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.317+0000 7f0a16ffd640 1 -- 172.21.15.50:0/443552104 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c071020 con 0x56324d4519c0 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.317+0000 7f0a16ffd640 1 -- 172.21.15.50:0/443552104 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c05d750 con 0x56324d4519c0 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.317+0000 7f0a16ffd640 1 -- 172.21.15.50:0/443552104 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c061f80 con 0x56324d4519c0 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.318+0000 7f0a3efbf740 1 -- 172.21.15.50:0/443552104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 msgr2=0x56324d478980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.318+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/443552104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 0x56324d478980 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c089590 tx=0x7f0a2c0592a0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.318+0000 7f0a3efbf740 1 -- 172.21.15.50:0/443552104 shutdown_connections 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.318+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/443552104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 0x56324d478980 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.318+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/443552104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d478440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.318+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/443552104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d4302c0 0x56324d4442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.318+0000 7f0a3efbf740 1 -- 172.21.15.50:0/443552104 >> 172.21.15.50:0/443552104 conn(0x56324d42da80 msgr2=0x56324d4560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.318+0000 7f0a3efbf740 1 -- 172.21.15.50:0/443552104 shutdown_connections 2024-09-11T22:20:58.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.318+0000 7f0a3efbf740 1 -- 172.21.15.50:0/443552104 wait complete. 2024-09-11T22:20:58.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.318+0000 7f0a3efbf740 1 -- start start 2024-09-11T22:20:58.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.318+0000 7f0a3efbf740 1 Processor -- start 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.319+0000 7f0a3efbf740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d4302c0 0x56324d497e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.319+0000 7f0a3efbf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d4f3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.319+0000 7f0a3efbf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 0x56324d4f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.319+0000 7f0a3efbf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56324d42afc0 con 0x56324d4519c0 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.319+0000 7f0a3efbf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56324d42bf20 con 0x56324d431a50 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.319+0000 7f0a3efbf740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56324d42a460 con 0x56324d4302c0 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.319+0000 7f0a3efbf740 10 client.0 _ll_register_callbacks cb 0x7f0a30007360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.319+0000 7f0a3a7c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 0x56324d4f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.319+0000 7f0a3a7c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 0x56324d4f3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50390/0 (socket says 172.21.15.50:50390) 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.319+0000 7f0a3a7c9640 1 -- 172.21.15.50:0/1498083662 learned_addr learned my addr 172.21.15.50:0/1498083662 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.319+0000 7f0a397c7640 1 --2- 172.21.15.50:0/1498083662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d4f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.319+0000 7f0a39fc8640 1 --2- 172.21.15.50:0/1498083662 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d4302c0 0x56324d497e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3a7c9640 1 -- 172.21.15.50:0/1498083662 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d4302c0 msgr2=0x56324d497e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3a7c9640 1 --2- 172.21.15.50:0/1498083662 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d4302c0 0x56324d497e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3a7c9640 1 -- 172.21.15.50:0/1498083662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 msgr2=0x56324d4f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3a7c9640 1 --2- 172.21.15.50:0/1498083662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d4f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3a7c9640 1 -- 172.21.15.50:0/1498083662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324d498660 con 0x56324d4519c0 2024-09-11T22:20:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3a7c9640 1 --2- 172.21.15.50:0/1498083662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 0x56324d4f3ab0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c061a50 tx=0x7f0a2c003e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9baa02527e574e90 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:20:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a14ff9640 1 -- 172.21.15.50:0/1498083662 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c075070 con 0x56324d4519c0 2024-09-11T22:20:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a14ff9640 1 -- 172.21.15.50:0/1498083662 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f0a2c057440 con 0x56324d4519c0 2024-09-11T22:20:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1498083662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a2c05d750 con 0x56324d4519c0 2024-09-11T22:20:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a14ff9640 1 -- 172.21.15.50:0/1498083662 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) ==== 24+0+0 (secure 0 0 0) 0x7f0a2c078360 con 0x56324d4519c0 2024-09-11T22:20:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3efbf740 10 client.9579 fetch_fsmap learned FSMap version 109 2024-09-11T22:20:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1498083662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) -- 0x56324d4f8220 con 0x56324d4519c0 2024-09-11T22:20:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a14ff9640 1 -- 172.21.15.50:0/1498083662 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c05d750 con 0x56324d4519c0 2024-09-11T22:20:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a14ff9640 1 -- 172.21.15.50:0/1498083662 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 109) ==== 3502+0+0 (secure 0 0 0) 0x7f0a2c055a10 con 0x56324d4519c0 2024-09-11T22:20:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3efbf740 10 client.9579 fetch_fsmap finished waiting for FSMap version 109 2024-09-11T22:20:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3efbf740 10 client.9579 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:20:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3efbf740 20 client.9579 populate_metadata read hostname 'smithi050' 2024-09-11T22:20:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/1498083662 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x56324d4f7620 0x56324d4f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3efbf740 4 client.9579 mds_command: new command op to 9426 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:20:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.320+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1498083662 --> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] -- command(tid 0: {"prefix": "status"}) -- 0x56324d450ff0 con 0x56324d4f7620 2024-09-11T22:20:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a39fc8640 1 --2- 172.21.15.50:0/1498083662 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x56324d4f7620 0x56324d4f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a14ff9640 10 client.9579 ms_handle_connect on v2:172.21.15.50:6833/3562809701 2024-09-11T22:20:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a39fc8640 1 --2- 172.21.15.50:0/1498083662 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x56324d4f7620 0x56324d4f7a00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a692a24b2f7202bb server_cookie=ae3814b20ecfd159 in_seq=0 out_seq=0 2024-09-11T22:20:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a14ff9640 1 -- 172.21.15.50:0/1498083662 <== mds.0 v2:172.21.15.50:6833/3562809701 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x56324d450ff0 con 0x56324d4f7620 2024-09-11T22:20:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a14ff9640 10 client.9579 handle_command_reply: tid=0 2024-09-11T22:20:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a3efbf740 1 client.9579 shutdown 2024-09-11T22:20:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1498083662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 msgr2=0x56324d4f3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/1498083662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 0x56324d4f3ab0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c061a50 tx=0x7f0a2c003e50 comp rx=0 tx=0).stop 2024-09-11T22:20:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1498083662 shutdown_connections 2024-09-11T22:20:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/1498083662 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x56324d4f7620 0x56324d4f7a00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/1498083662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56324d4519c0 0x56324d4f3ab0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a14ff9640 0 client.9579 ms_handle_reset on v2:172.21.15.50:6833/3562809701 2024-09-11T22:20:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/1498083662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56324d431a50 0x56324d4f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a3efbf740 1 --2- 172.21.15.50:0/1498083662 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56324d4302c0 0x56324d497e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1498083662 >> 172.21.15.50:0/1498083662 conn(0x56324d42da80 msgr2=0x56324d459fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1498083662 shutdown_connections 2024-09-11T22:20:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.321+0000 7f0a3efbf740 1 -- 172.21.15.50:0/1498083662 wait complete. 2024-09-11T22:20:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.322+0000 7f0a3efbf740 20 client.9579 trim_cache size 0 max 16384 2024-09-11T22:20:58.328 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:20:58.328 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 9426, 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 9.0343998190000008, 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 109, 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 156, 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 156, 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 19.127145558999999 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.322+0000 7f0a3c22c640 1 -- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0a1806be30 msgr2=0x7f0a1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.322+0000 7f0a3c22c640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0a1806be30 0x7f0a1806e2f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0a30000f60 tx=0x7f0a30009040 comp rx=0 tx=0).stop 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.322+0000 7f0a3c22c640 1 -- 172.21.15.50:0/2491493973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a34161d30 msgr2=0x7f0a34151bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.322+0000 7f0a3c22c640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a34161d30 0x7f0a34151bc0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00c780 tx=0x7f0a2c00cc40 comp rx=0 tx=0).stop 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.322+0000 7f0a3c22c640 1 -- 172.21.15.50:0/2491493973 shutdown_connections 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.322+0000 7f0a3c22c640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0a1806be30 0x7f0a1806e2f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.322+0000 7f0a3c22c640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a34161d30 0x7f0a34151bc0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.322+0000 7f0a3c22c640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a340d11d0 0x7f0a340c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.322+0000 7f0a3c22c640 1 --2- 172.21.15.50:0/2491493973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a340cf790 0x7f0a3415e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.322+0000 7f0a3c22c640 1 -- 172.21.15.50:0/2491493973 >> 172.21.15.50:0/2491493973 conn(0x7f0a340727a0 msgr2=0x7f0a340cb890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.322+0000 7f0a3c22c640 1 -- 172.21.15.50:0/2491493973 shutdown_connections 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.322+0000 7f0a3c22c640 1 -- 172.21.15.50:0/2491493973 wait complete. 2024-09-11T22:20:58.334 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:20:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.436+0000 7fc61d1e8640 1 Processor -- start 2024-09-11T22:20:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.436+0000 7fc61d1e8640 1 -- start start 2024-09-11T22:20:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.437+0000 7fc61d1e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc618161fa0 0x7fc6180b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.437+0000 7fc61d1e8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6180b1600 0x7fc6180cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.437+0000 7fc61d1e8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6180cfbd0 con 0x7fc6180cf440 2024-09-11T22:20:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.437+0000 7fc61d1e8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc6180cdce0 con 0x7fc6180b1600 2024-09-11T22:20:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.437+0000 7fc61d1e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6180d1220 con 0x7fc618161fa0 2024-09-11T22:20:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.437+0000 7fc61659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6180b1600 0x7fc6180cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.437+0000 7fc61659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6180b1600 0x7fc6180cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50406/0 (socket says 172.21.15.50:50406) 2024-09-11T22:20:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.437+0000 7fc61659c640 1 -- 172.21.15.50:0/2877284862 learned_addr learned my addr 172.21.15.50:0/2877284862 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.437+0000 7fc61659c640 1 -- 172.21.15.50:0/2877284862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc618161fa0 msgr2=0x7fc6180b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.437+0000 7fc61659c640 1 --2- 172.21.15.50:0/2877284862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc618161fa0 0x7fc6180b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.437+0000 7fc61659c640 1 -- 172.21.15.50:0/2877284862 >> v1:172.21.15.77:6789/0 conn(0x7fc6180cf440 legacy=0x7fc61806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.437+0000 7fc61659c640 1 -- 172.21.15.50:0/2877284862 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6180cfeb0 con 0x7fc6180b1600 2024-09-11T22:20:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.438+0000 7fc61659c640 1 --2- 172.21.15.50:0/2877284862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180b1600 0x7fc6180cef00 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009870 tx=0x7fc60c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5119a73711fcd4af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.438+0000 7fc615d9b640 1 -- 172.21.15.50:0/2877284862 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c037070 con 0x7fc6180b1600 2024-09-11T22:20:58.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.438+0000 7fc615d9b640 1 -- 172.21.15.50:0/2877284862 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60c032440 con 0x7fc6180b1600 2024-09-11T22:20:58.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.438+0000 7fc615d9b640 1 -- 172.21.15.50:0/2877284862 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c032810 con 0x7fc6180b1600 2024-09-11T22:20:58.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.439+0000 7fc61d1e8640 1 -- 172.21.15.50:0/2877284862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180b1600 msgr2=0x7fc6180cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.439+0000 7fc61d1e8640 1 --2- 172.21.15.50:0/2877284862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180b1600 0x7fc6180cef00 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009870 tx=0x7fc60c02a210 comp rx=0 tx=0).stop 2024-09-11T22:20:58.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.439+0000 7fc61d1e8640 1 -- 172.21.15.50:0/2877284862 shutdown_connections 2024-09-11T22:20:58.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.439+0000 7fc61d1e8640 1 --2- 172.21.15.50:0/2877284862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180b1600 0x7fc6180cef00 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.439+0000 7fc61d1e8640 1 --2- 172.21.15.50:0/2877284862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc618161fa0 0x7fc6180b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.439+0000 7fc61d1e8640 1 -- 172.21.15.50:0/2877284862 >> 172.21.15.50:0/2877284862 conn(0x7fc61809ba50 msgr2=0x7fc6180b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.439+0000 7fc61d1e8640 1 -- 172.21.15.50:0/2877284862 shutdown_connections 2024-09-11T22:20:58.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.439+0000 7fc61d1e8640 1 -- 172.21.15.50:0/2877284862 wait complete. 2024-09-11T22:20:58.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.440+0000 7fc61d1e8640 1 Processor -- start 2024-09-11T22:20:58.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.440+0000 7fc61d1e8640 1 -- start start 2024-09-11T22:20:58.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc61d1e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180b1600 0x7fc6180caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc61d1e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6180cf440 0x7fc6180cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc61d1e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc618161fa0 0x7fc6180cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc61d1e8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc6180cf8f0 con 0x7fc6180b1600 2024-09-11T22:20:58.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc61d1e8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6180d17e0 con 0x7fc618161fa0 2024-09-11T22:20:58.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc61d1e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc618162380 con 0x7fc6180cf440 2024-09-11T22:20:58.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc616d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180b1600 0x7fc6180caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc616d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180b1600 0x7fc6180caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50416/0 (socket says 172.21.15.50:50416) 2024-09-11T22:20:58.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc616d9d640 1 -- 172.21.15.50:0/1331283547 learned_addr learned my addr 172.21.15.50:0/1331283547 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:58.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc61759e640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc618161fa0 0x7fc6180cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc61659c640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6180cf440 0x7fc6180cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc616d9d640 1 -- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6180cf440 msgr2=0x7fc6180cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc616d9d640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6180cf440 0x7fc6180cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc616d9d640 1 -- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc618161fa0 msgr2=0x7fc6180cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc616d9d640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc618161fa0 0x7fc6180cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc616d9d640 1 -- 172.21.15.50:0/1331283547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6180b2040 con 0x7fc6180b1600 2024-09-11T22:20:58.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.441+0000 7fc61659c640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6180cf440 0x7fc6180cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:58.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.442+0000 7fc616d9d640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180b1600 0x7fc6180caf10 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fc60800b4d0 tx=0x7fc60800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.442+0000 7fc5ff7fe640 1 -- 172.21.15.50:0/1331283547 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608014070 con 0x7fc6180b1600 2024-09-11T22:20:58.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.442+0000 7fc5ff7fe640 1 -- 172.21.15.50:0/1331283547 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc608010870 con 0x7fc6180b1600 2024-09-11T22:20:58.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.442+0000 7fc61d1e8640 1 -- 172.21.15.50:0/1331283547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6180cc1b0 con 0x7fc6180b1600 2024-09-11T22:20:58.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.442+0000 7fc5ff7fe640 1 -- 172.21.15.50:0/1331283547 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608010c60 con 0x7fc6180b1600 2024-09-11T22:20:58.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.442+0000 7fc61d1e8640 1 -- 172.21.15.50:0/1331283547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6181f4d00 con 0x7fc6180b1600 2024-09-11T22:20:58.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.443+0000 7fc61d1e8640 1 -- 172.21.15.50:0/1331283547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6180d1c50 con 0x7fc6180b1600 2024-09-11T22:20:58.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.443+0000 7fc5ff7fe640 1 -- 172.21.15.50:0/1331283547 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc608017070 con 0x7fc6180b1600 2024-09-11T22:20:58.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.444+0000 7fc5ff7fe640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc60406be30 0x7fc60406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.444+0000 7fc5ff7fe640 1 -- 172.21.15.50:0/1331283547 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7fc60808ac50 con 0x7fc6180b1600 2024-09-11T22:20:58.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.444+0000 7fc61659c640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc60406be30 0x7fc60406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.444+0000 7fc61659c640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc60406be30 0x7fc60406e2f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc60c034000 tx=0x7fc60c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.448+0000 7fc5ff7fe640 1 -- 172.21.15.50:0/1331283547 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc608090020 con 0x7fc6180b1600 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.660+0000 7fc61d1e8640 1 -- 172.21.15.50:0/1331283547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc61806c920 con 0x7fc6180b1600 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.661+0000 7fc5ff7fe640 1 -- 172.21.15.50:0/1331283547 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v109) ==== 53+0+73 (secure 0 0 0) 0x7fc6180b2040 con 0x7fc6180b1600 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:20:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.663+0000 7fc61d1e8640 1 -- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc60406be30 msgr2=0x7fc60406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.663+0000 7fc61d1e8640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc60406be30 0x7fc60406e2f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc60c034000 tx=0x7fc60c02e000 comp rx=0 tx=0).stop 2024-09-11T22:20:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.663+0000 7fc61d1e8640 1 -- 172.21.15.50:0/1331283547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180b1600 msgr2=0x7fc6180caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.663+0000 7fc61d1e8640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180b1600 0x7fc6180caf10 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fc60800b4d0 tx=0x7fc60800b990 comp rx=0 tx=0).stop 2024-09-11T22:20:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.663+0000 7fc61d1e8640 1 -- 172.21.15.50:0/1331283547 shutdown_connections 2024-09-11T22:20:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.663+0000 7fc61d1e8640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc60406be30 0x7fc60406e2f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.663+0000 7fc61d1e8640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6180cf440 0x7fc6180cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.663+0000 7fc61d1e8640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc618161fa0 0x7fc6180cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.663+0000 7fc61d1e8640 1 --2- 172.21.15.50:0/1331283547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6180b1600 0x7fc6180caf10 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.663+0000 7fc61d1e8640 1 -- 172.21.15.50:0/1331283547 >> 172.21.15.50:0/1331283547 conn(0x7fc61809ba50 msgr2=0x7fc61806fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.663+0000 7fc61d1e8640 1 -- 172.21.15.50:0/1331283547 shutdown_connections 2024-09-11T22:20:58.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58.663+0000 7fc61d1e8640 1 -- 172.21.15.50:0/1331283547 wait complete. 2024-09-11T22:20:58.675 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:20:58.675 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:20:58.675 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:20:58.675 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:20:58.675 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:20:58.675 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:20:58.675 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:20:58.675 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:20:58.675 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:20:58.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:58.676 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:20:58.692 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:20:58.692 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:20:58.692 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:20:58.692 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:58.692 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:20:58.692 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:58.692 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:20:58.692 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:20:58.693 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:20:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:20:58.693 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:20:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:20:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:20:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42137sec preferred_lft 42137sec 2024-09-11T22:20:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:20:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:58.693 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:20:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:20:58.694 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:20:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:20:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:20:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:58.694 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:20:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:20:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:20:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:58.694 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:20:58.695 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:20:58.695 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:20:58.695 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:58.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:58.695 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:20:58.756 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:20:58.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:58.758 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:20:58.815 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:20:58.815 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:20:58.815 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:20:58.816 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:20:58.816 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:20:58.816 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:20:58.816 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:20:58.816 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:20:58.816 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:20:58.816 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:20:58.816 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:20:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:20:58.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:58.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:58.944 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:20:58.960 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:20:58.960 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:20:58.960 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:20:58.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:58.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:20:59.026 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:20:59.026 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:20:59.082 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:20:59.160 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:20:59.160 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:20:59.176 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:20:59.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:59.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:20:59.260 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:20:59.260 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:20:59.268 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:20:59.268 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:20:59.269 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:20:59.269 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:20:59.269 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:20:59.269 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:20:59.269 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:20:59.269 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:20:59.269 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:20:59.270 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:20:59.271 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:20:59.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:59.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:20:59.297 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:20:59.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:59.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:59.401 INFO:teuthology.orchestra.run.smithi050.stdout:client8644 2024-09-11T22:20:59.401 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:20:59.401 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:20:59.418 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:59.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.561+0000 7fe3e105e640 1 Processor -- start 2024-09-11T22:20:59.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.561+0000 7fe3e105e640 1 -- start start 2024-09-11T22:20:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.562+0000 7fe3e105e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3dc15e870 0x7fe3dc0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.562+0000 7fe3e105e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3dc0d16d0 0x7fe3dc0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.562+0000 7fe3e105e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3dc0cfa80 con 0x7fe3dc0d3a30 2024-09-11T22:20:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.562+0000 7fe3e105e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe3dc0d1b40 con 0x7fe3dc15e870 2024-09-11T22:20:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.562+0000 7fe3e105e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe3dc0d3e50 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.562+0000 7fe3dad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3dc15e870 0x7fe3dc0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.562+0000 7fe3dad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3dc15e870 0x7fe3dc0d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50418/0 (socket says 172.21.15.50:50418) 2024-09-11T22:20:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.562+0000 7fe3dad9d640 1 -- 172.21.15.50:0/710014209 learned_addr learned my addr 172.21.15.50:0/710014209 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.562+0000 7fe3da59c640 1 --2- 172.21.15.50:0/710014209 >> v2:172.21.15.77:3300/0 conn(0x7fe3dc0d16d0 0x7fe3dc0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.562+0000 7fe3dad9d640 1 -- 172.21.15.50:0/710014209 >> v2:172.21.15.77:3300/0 conn(0x7fe3dc0d16d0 msgr2=0x7fe3dc0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.562+0000 7fe3dad9d640 1 --2- 172.21.15.50:0/710014209 >> v2:172.21.15.77:3300/0 conn(0x7fe3dc0d16d0 0x7fe3dc0d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.562+0000 7fe3dad9d640 1 -- 172.21.15.50:0/710014209 >> v1:172.21.15.77:6789/0 conn(0x7fe3dc0d3a30 legacy=0x7fe3dc0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.563+0000 7fe3dad9d640 1 -- 172.21.15.50:0/710014209 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3dc0d40d0 con 0x7fe3dc15e870 2024-09-11T22:20:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.563+0000 7fe3dad9d640 1 --2- 172.21.15.50:0/710014209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc15e870 0x7fe3dc0d1190 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc06c830 tx=0x7fe3cc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70d6f4689d6aaf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.563+0000 7fe3d9d9b640 1 -- 172.21.15.50:0/710014209 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc037070 con 0x7fe3dc15e870 2024-09-11T22:20:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.564+0000 7fe3d9d9b640 1 -- 172.21.15.50:0/710014209 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3cc032440 con 0x7fe3dc15e870 2024-09-11T22:20:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.564+0000 7fe3d9d9b640 1 -- 172.21.15.50:0/710014209 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc032810 con 0x7fe3dc15e870 2024-09-11T22:20:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.564+0000 7fe3e105e640 1 -- 172.21.15.50:0/710014209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc15e870 msgr2=0x7fe3dc0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.564+0000 7fe3e105e640 1 --2- 172.21.15.50:0/710014209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc15e870 0x7fe3dc0d1190 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc06c830 tx=0x7fe3cc02a230 comp rx=0 tx=0).stop 2024-09-11T22:20:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.564+0000 7fe3e105e640 1 -- 172.21.15.50:0/710014209 shutdown_connections 2024-09-11T22:20:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.564+0000 7fe3e105e640 1 --2- 172.21.15.50:0/710014209 >> v2:172.21.15.77:3300/0 conn(0x7fe3dc0d16d0 0x7fe3dc0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.564+0000 7fe3e105e640 1 --2- 172.21.15.50:0/710014209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc15e870 0x7fe3dc0d1190 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.564+0000 7fe3e105e640 1 -- 172.21.15.50:0/710014209 >> 172.21.15.50:0/710014209 conn(0x7fe3dc0727a0 msgr2=0x7fe3dc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.564+0000 7fe3e105e640 1 -- 172.21.15.50:0/710014209 shutdown_connections 2024-09-11T22:20:59.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.564+0000 7fe3e105e640 1 -- 172.21.15.50:0/710014209 wait complete. 2024-09-11T22:20:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.566+0000 7fe3e105e640 1 Processor -- start 2024-09-11T22:20:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.566+0000 7fe3e105e640 1 -- start start 2024-09-11T22:20:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.566+0000 7fe3e105e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0d16d0 0x7fe3dc152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.566+0000 7fe3e105e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3dc0d3a30 0x7fe3dc0b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.566+0000 7fe3e105e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3dc15e870 0x7fe3dc153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.566+0000 7fe3e105e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc0b7ee0 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.566+0000 7fe3e105e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc0b7c00 con 0x7fe3dc15e870 2024-09-11T22:20:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.566+0000 7fe3e105e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe3dc15ec50 con 0x7fe3dc0d3a30 2024-09-11T22:20:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3dad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0d16d0 0x7fe3dc152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3dad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0d16d0 0x7fe3dc152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50426/0 (socket says 172.21.15.50:50426) 2024-09-11T22:20:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3dad9d640 1 -- 172.21.15.50:0/1858130429 learned_addr learned my addr 172.21.15.50:0/1858130429 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3db59e640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3dc15e870 0x7fe3dc153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3da59c640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3dc0d3a30 0x7fe3dc0b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3dad9d640 1 -- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3dc0d3a30 msgr2=0x7fe3dc0b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3dad9d640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3dc0d3a30 0x7fe3dc0b65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3dad9d640 1 -- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3dc15e870 msgr2=0x7fe3dc153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3dad9d640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3dc15e870 0x7fe3dc153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3dad9d640 1 -- 172.21.15.50:0/1858130429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3dc1534f0 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3dad9d640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0d16d0 0x7fe3dc152fb0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc000c00 tx=0x7fe3cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3c37fe640 1 -- 172.21.15.50:0/1858130429 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc041020 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3c37fe640 1 -- 172.21.15.50:0/1858130429 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3cc0306c0 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3e105e640 1 -- 172.21.15.50:0/1858130429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3dc154f90 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3c37fe640 1 -- 172.21.15.50:0/1858130429 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc037040 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.567+0000 7fe3e105e640 1 -- 172.21.15.50:0/1858130429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3dc1549d0 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.568+0000 7fe3e105e640 1 -- 172.21.15.50:0/1858130429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3dc156560 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.569+0000 7fe3c37fe640 1 -- 172.21.15.50:0/1858130429 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3cc044020 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.569+0000 7fe3c37fe640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe3c806be30 0x7fe3c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.569+0000 7fe3c37fe640 1 -- 172.21.15.50:0/1858130429 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7fe3cc0ab6b0 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.570+0000 7fe3da59c640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe3c806be30 0x7fe3c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.570+0000 7fe3da59c640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe3c806be30 0x7fe3c806e2f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0006fd0 tx=0x7fe3d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:59.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.574+0000 7fe3c37fe640 1 -- 172.21.15.50:0/1858130429 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe3cc04b030 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.784+0000 7fe3e105e640 1 -- 172.21.15.50:0/1858130429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3dc0b78b0 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.785+0000 7fe3c37fe640 1 -- 172.21.15.50:0/1858130429 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5233 (secure 0 0 0) 0x7fe3dc0cfa80 con 0x7fe3dc0d16d0 2024-09-11T22:20:59.785 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:20:59.786 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:20:50.638363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9426":{"gid":9426,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3562809701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3562809701},{"type":"v1","addr":"172.21.15.50:6835","nonce":3562809701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9426,"qdb_cluster":[9426]},"id":11}]} 2024-09-11T22:20:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 109 2024-09-11T22:20:59.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.786+0000 7fe3e105e640 1 -- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe3c806be30 msgr2=0x7fe3c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:59.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.786+0000 7fe3e105e640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe3c806be30 0x7fe3c806e2f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0006fd0 tx=0x7fe3d0008040 comp rx=0 tx=0).stop 2024-09-11T22:20:59.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.786+0000 7fe3e105e640 1 -- 172.21.15.50:0/1858130429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0d16d0 msgr2=0x7fe3dc152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:59.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.786+0000 7fe3e105e640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0d16d0 0x7fe3dc152fb0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc000c00 tx=0x7fe3cc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.786+0000 7fe3e105e640 1 -- 172.21.15.50:0/1858130429 shutdown_connections 2024-09-11T22:20:59.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.786+0000 7fe3e105e640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe3c806be30 0x7fe3c806e2f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.786+0000 7fe3e105e640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3dc0d3a30 0x7fe3dc0b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.786+0000 7fe3e105e640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3dc15e870 0x7fe3dc153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.786+0000 7fe3e105e640 1 --2- 172.21.15.50:0/1858130429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3dc0d16d0 0x7fe3dc152fb0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.786+0000 7fe3e105e640 1 -- 172.21.15.50:0/1858130429 >> 172.21.15.50:0/1858130429 conn(0x7fe3dc0727a0 msgr2=0x7fe3dc161570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:59.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.787+0000 7fe3e105e640 1 -- 172.21.15.50:0/1858130429 shutdown_connections 2024-09-11T22:20:59.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.787+0000 7fe3e105e640 1 -- 172.21.15.50:0/1858130429 wait complete. 2024-09-11T22:20:59.799 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.900+0000 7fbb75882640 1 Processor -- start 2024-09-11T22:20:59.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.900+0000 7fbb75882640 1 -- start start 2024-09-11T22:20:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.901+0000 7fbb75882640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015e8e0 0x7fbb700b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.901+0000 7fbb75882640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb70163080 con 0x7fbb70162350 2024-09-11T22:20:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.901+0000 7fbb75882640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb700d2d20 con 0x7fbb700d1580 2024-09-11T22:20:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.901+0000 7fbb75882640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbb7015ecc0 con 0x7fbb7015e8e0 2024-09-11T22:20:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.901+0000 7fbb6f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbb70162350 0x7fbb70162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54334/0 (socket says 172.21.15.50:54334) 2024-09-11T22:20:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.901+0000 7fbb6f7fe640 1 -- 172.21.15.50:0/197331034 learned_addr learned my addr 172.21.15.50:0/197331034 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:20:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.901+0000 7fbb6effd640 1 --2- 172.21.15.50:0/197331034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015e8e0 0x7fbb700b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.901+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452923118 0 0) 0x7fbb70163080 con 0x7fbb70162350 2024-09-11T22:20:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.901+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb58003520 con 0x7fbb70162350 2024-09-11T22:20:59.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2414967254 0 0) 0x7fbb58003520 con 0x7fbb70162350 2024-09-11T22:20:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015e8e0 msgr2=0x7fbb700b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6dffb640 1 --2- 172.21.15.50:0/197331034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015e8e0 0x7fbb700b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 >> v1:172.21.15.77:6789/0 conn(0x7fbb700d1580 legacy=0x7fbb700d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb700d3000 con 0x7fbb70162350 2024-09-11T22:20:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fbb680019f0 con 0x7fbb70162350 2024-09-11T22:20:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 >> v1:172.21.15.50:6789/0 conn(0x7fbb70162350 legacy=0x7fbb70162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6dffb640 1 --2- 172.21.15.50:0/197331034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb580039e0 0x7fbb58003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6dffb640 1 --2- 172.21.15.50:0/197331034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015e8e0 0x7fbb58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6dffb640 1 --2- 172.21.15.50:0/197331034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb58004d40 0x7fbb580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5800b9c0 con 0x7fbb580039e0 2024-09-11T22:20:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5800bb40 con 0x7fbb58004d40 2024-09-11T22:20:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5800bd40 con 0x7fbb7015e8e0 2024-09-11T22:20:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6effd640 1 --2- 172.21.15.50:0/197331034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb580039e0 0x7fbb58003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6e7fc640 1 --2- 172.21.15.50:0/197331034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015e8e0 0x7fbb58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6f7fe640 1 --2- 172.21.15.50:0/197331034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb58004d40 0x7fbb580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6effd640 1 -- 172.21.15.50:0/197331034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015e8e0 msgr2=0x7fbb58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6effd640 1 --2- 172.21.15.50:0/197331034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015e8e0 0x7fbb58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6effd640 1 -- 172.21.15.50:0/197331034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb58004d40 msgr2=0x7fbb580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6effd640 1 --2- 172.21.15.50:0/197331034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb58004d40 0x7fbb580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.902+0000 7fbb6effd640 1 -- 172.21.15.50:0/197331034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb58003520 con 0x7fbb580039e0 2024-09-11T22:20:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.903+0000 7fbb6effd640 1 --2- 172.21.15.50:0/197331034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb580039e0 0x7fbb58003dc0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009ac0 tx=0x7fbb58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba635be4b8cc50d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.903+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60036070 con 0x7fbb580039e0 2024-09-11T22:20:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.903+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb60031400 con 0x7fbb580039e0 2024-09-11T22:20:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.903+0000 7fbb6dffb640 1 -- 172.21.15.50:0/197331034 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60009690 con 0x7fbb580039e0 2024-09-11T22:20:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.904+0000 7fbb75882640 1 -- 172.21.15.50:0/197331034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb580039e0 msgr2=0x7fbb58003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.904+0000 7fbb75882640 1 --2- 172.21.15.50:0/197331034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb580039e0 0x7fbb58003dc0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009ac0 tx=0x7fbb58005830 comp rx=0 tx=0).stop 2024-09-11T22:20:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.904+0000 7fbb6f7fe640 1 -- 172.21.15.50:0/197331034 reap_dead start 2024-09-11T22:20:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.904+0000 7fbb75882640 1 -- 172.21.15.50:0/197331034 shutdown_connections 2024-09-11T22:20:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.904+0000 7fbb75882640 1 -- 172.21.15.50:0/197331034 >> 172.21.15.50:0/197331034 conn(0x7fbb70067ba0 msgr2=0x7fbb70067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.904+0000 7fbb75882640 1 -- 172.21.15.50:0/197331034 shutdown_connections 2024-09-11T22:20:59.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.904+0000 7fbb75882640 1 -- 172.21.15.50:0/197331034 wait complete. 2024-09-11T22:20:59.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.905+0000 7fbb75882640 1 Processor -- start 2024-09-11T22:20:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.905+0000 7fbb75882640 1 -- start start 2024-09-11T22:20:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb75882640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb580039e0 0x7fbb700b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb75882640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb700ce200 0x7fbb700ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb75882640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015fe40 0x7fbb701602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb75882640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb700b7c10 con 0x7fbb580039e0 2024-09-11T22:20:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb75882640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb700b7a90 con 0x7fbb700ce200 2024-09-11T22:20:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb75882640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbb700d2ad0 con 0x7fbb7015fe40 2024-09-11T22:20:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb6effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb580039e0 0x7fbb700b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb6effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb580039e0 0x7fbb700b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50440/0 (socket says 172.21.15.50:50440) 2024-09-11T22:20:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb6effd640 1 -- 172.21.15.50:0/4275676729 learned_addr learned my addr 172.21.15.50:0/4275676729 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:20:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb6e7fc640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb700ce200 0x7fbb700ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb6f7fe640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015fe40 0x7fbb701602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb6effd640 1 -- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015fe40 msgr2=0x7fbb701602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb6effd640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015fe40 0x7fbb701602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb6effd640 1 -- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb700ce200 msgr2=0x7fbb700ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb6effd640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb700ce200 0x7fbb700ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb6effd640 1 -- 172.21.15.50:0/4275676729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb70160a50 con 0x7fbb580039e0 2024-09-11T22:20:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.906+0000 7fbb6f7fe640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015fe40 0x7fbb701602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.907+0000 7fbb6effd640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb580039e0 0x7fbb700b2df0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fbb60000c00 tx=0x7fbb60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.907+0000 7fbb57fff640 1 -- 172.21.15.50:0/4275676729 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60040020 con 0x7fbb580039e0 2024-09-11T22:20:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.907+0000 7fbb57fff640 1 -- 172.21.15.50:0/4275676729 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb60003a40 con 0x7fbb580039e0 2024-09-11T22:20:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.907+0000 7fbb75882640 1 -- 172.21.15.50:0/4275676729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb70160d30 con 0x7fbb580039e0 2024-09-11T22:20:59.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.907+0000 7fbb57fff640 1 -- 172.21.15.50:0/4275676729 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60036040 con 0x7fbb580039e0 2024-09-11T22:20:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.907+0000 7fbb75882640 1 -- 172.21.15.50:0/4275676729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb701612f0 con 0x7fbb580039e0 2024-09-11T22:20:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.908+0000 7fbb75882640 1 -- 172.21.15.50:0/4275676729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb700d19a0 con 0x7fbb580039e0 2024-09-11T22:20:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.908+0000 7fbb57fff640 1 -- 172.21.15.50:0/4275676729 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb60043020 con 0x7fbb580039e0 2024-09-11T22:20:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.909+0000 7fbb57fff640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb5c06be30 0x7fbb5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.909+0000 7fbb57fff640 1 -- 172.21.15.50:0/4275676729 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7fbb600aae90 con 0x7fbb580039e0 2024-09-11T22:20:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.909+0000 7fbb6e7fc640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb5c06be30 0x7fbb5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.910+0000 7fbb6e7fc640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb5c06be30 0x7fbb5c06e2f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fbb701622b0 tx=0x7fbb64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:20:59.913+0000 7fbb57fff640 1 -- 172.21.15.50:0/4275676729 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb6004a070 con 0x7fbb580039e0 2024-09-11T22:21:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.124+0000 7fbb75882640 1 -- 172.21.15.50:0/4275676729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb700ba770 con 0x7fbb580039e0 2024-09-11T22:21:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.124+0000 7fbb57fff640 1 -- 172.21.15.50:0/4275676729 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5233 (secure 0 0 0) 0x7fbb600798d0 con 0x7fbb580039e0 2024-09-11T22:21:00.125 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:00.125 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:20:50.638363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9426":{"gid":9426,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3562809701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3562809701},{"type":"v1","addr":"172.21.15.50:6835","nonce":3562809701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9426,"qdb_cluster":[9426]},"id":11}]} 2024-09-11T22:21:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 109 2024-09-11T22:21:00.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.126+0000 7fbb75882640 1 -- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb5c06be30 msgr2=0x7fbb5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.126+0000 7fbb75882640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb5c06be30 0x7fbb5c06e2f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fbb701622b0 tx=0x7fbb64009040 comp rx=0 tx=0).stop 2024-09-11T22:21:00.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.126+0000 7fbb75882640 1 -- 172.21.15.50:0/4275676729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb580039e0 msgr2=0x7fbb700b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.126+0000 7fbb75882640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb580039e0 0x7fbb700b2df0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fbb60000c00 tx=0x7fbb60004730 comp rx=0 tx=0).stop 2024-09-11T22:21:00.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.126+0000 7fbb75882640 1 -- 172.21.15.50:0/4275676729 shutdown_connections 2024-09-11T22:21:00.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.126+0000 7fbb75882640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbb5c06be30 0x7fbb5c06e2f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.126+0000 7fbb75882640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb7015fe40 0x7fbb701602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.126+0000 7fbb75882640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb700ce200 0x7fbb700ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.126+0000 7fbb75882640 1 --2- 172.21.15.50:0/4275676729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb580039e0 0x7fbb700b2df0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.126+0000 7fbb75882640 1 -- 172.21.15.50:0/4275676729 >> 172.21.15.50:0/4275676729 conn(0x7fbb70067ba0 msgr2=0x7fbb70069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:00.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.126+0000 7fbb75882640 1 -- 172.21.15.50:0/4275676729 shutdown_connections 2024-09-11T22:21:00.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00.126+0000 7fbb75882640 1 -- 172.21.15.50:0/4275676729 wait complete. 2024-09-11T22:21:00.138 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:00.138 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:00.138 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.0 2024-09-11T22:21:00.138 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:00.138 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:00.139 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:00.139 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:00.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979022 s, 107 MB/s 2024-09-11T22:21:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854677 s, 123 MB/s 2024-09-11T22:21:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.228 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.228 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748844 s, 140 MB/s 2024-09-11T22:21:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735845 s, 142 MB/s 2024-09-11T22:21:00.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.247 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846005 s, 124 MB/s 2024-09-11T22:21:00.256 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.257 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00822815 s, 127 MB/s 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693282 s, 151 MB/s 2024-09-11T22:21:00.275 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.275 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.275 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785926 s, 133 MB/s 2024-09-11T22:21:00.284 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.284 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.284 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764363 s, 137 MB/s 2024-09-11T22:21:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709129 s, 148 MB/s 2024-09-11T22:21:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.302 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073409 s, 143 MB/s 2024-09-11T22:21:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758918 s, 138 MB/s 2024-09-11T22:21:00.319 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.319 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.319 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668012 s, 157 MB/s 2024-09-11T22:21:00.328 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.328 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.329 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771328 s, 136 MB/s 2024-09-11T22:21:00.338 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.338 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.338 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768412 s, 136 MB/s 2024-09-11T22:21:00.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.347 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739148 s, 142 MB/s 2024-09-11T22:21:00.356 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.356 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.356 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761445 s, 138 MB/s 2024-09-11T22:21:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.365 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075099 s, 140 MB/s 2024-09-11T22:21:00.374 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.374 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.374 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694174 s, 151 MB/s 2024-09-11T22:21:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681388 s, 154 MB/s 2024-09-11T22:21:00.391 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.392 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.392 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080342 s, 131 MB/s 2024-09-11T22:21:00.400 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.400 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.400 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710742 s, 148 MB/s 2024-09-11T22:21:00.409 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.409 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.409 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681966 s, 154 MB/s 2024-09-11T22:21:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751535 s, 140 MB/s 2024-09-11T22:21:00.426 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.426 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.427 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648431 s, 162 MB/s 2024-09-11T22:21:00.435 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.435 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.435 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751091 s, 140 MB/s 2024-09-11T22:21:00.443 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.443 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.444 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648858 s, 162 MB/s 2024-09-11T22:21:00.452 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.452 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.452 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670076 s, 156 MB/s 2024-09-11T22:21:00.462 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.462 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.462 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855908 s, 123 MB/s 2024-09-11T22:21:00.471 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.471 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.471 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748099 s, 140 MB/s 2024-09-11T22:21:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770803 s, 136 MB/s 2024-09-11T22:21:00.489 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715001 s, 147 MB/s 2024-09-11T22:21:00.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:00.496 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:00.497 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:00.497 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.1 2024-09-11T22:21:00.497 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:00.497 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:00.497 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:00.497 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:00.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:00.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.558 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743588 s, 141 MB/s 2024-09-11T22:21:00.567 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.567 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.567 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781478 s, 134 MB/s 2024-09-11T22:21:00.576 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.576 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.576 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678463 s, 155 MB/s 2024-09-11T22:21:00.584 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.585 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.585 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701353 s, 150 MB/s 2024-09-11T22:21:00.592 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.592 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.592 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624815 s, 168 MB/s 2024-09-11T22:21:00.601 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.601 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.601 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072961 s, 144 MB/s 2024-09-11T22:21:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758771 s, 138 MB/s 2024-09-11T22:21:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707482 s, 148 MB/s 2024-09-11T22:21:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761527 s, 138 MB/s 2024-09-11T22:21:00.637 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.637 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.638 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667739 s, 157 MB/s 2024-09-11T22:21:00.646 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.647 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682415 s, 154 MB/s 2024-09-11T22:21:00.656 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.657 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.657 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764556 s, 137 MB/s 2024-09-11T22:21:00.665 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.665 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.665 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658459 s, 159 MB/s 2024-09-11T22:21:00.675 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.675 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.675 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833172 s, 126 MB/s 2024-09-11T22:21:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.684 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724569 s, 145 MB/s 2024-09-11T22:21:00.694 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.694 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.694 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00819382 s, 128 MB/s 2024-09-11T22:21:00.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.703 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071591 s, 146 MB/s 2024-09-11T22:21:00.711 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.711 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.711 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670776 s, 156 MB/s 2024-09-11T22:21:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676906 s, 155 MB/s 2024-09-11T22:21:00.729 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.729 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.729 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757494 s, 138 MB/s 2024-09-11T22:21:00.738 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.738 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.738 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695523 s, 151 MB/s 2024-09-11T22:21:00.747 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.747 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.747 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728443 s, 144 MB/s 2024-09-11T22:21:00.757 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.757 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.757 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719816 s, 146 MB/s 2024-09-11T22:21:00.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.766 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075873 s, 138 MB/s 2024-09-11T22:21:00.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.776 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068728 s, 153 MB/s 2024-09-11T22:21:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754714 s, 139 MB/s 2024-09-11T22:21:00.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.794 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739563 s, 142 MB/s 2024-09-11T22:21:00.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.803 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650521 s, 161 MB/s 2024-09-11T22:21:00.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.811 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064114 s, 164 MB/s 2024-09-11T22:21:00.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.821 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759799 s, 138 MB/s 2024-09-11T22:21:00.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.829 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649658 s, 161 MB/s 2024-09-11T22:21:00.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.837 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680969 s, 154 MB/s 2024-09-11T22:21:00.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:00.845 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:00.845 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:00.845 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.2 2024-09-11T22:21:00.845 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:00.845 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:00.845 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:00.845 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:00.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:00.905 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.905 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.905 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737137 s, 142 MB/s 2024-09-11T22:21:00.914 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.914 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.914 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733958 s, 143 MB/s 2024-09-11T22:21:00.924 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.924 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.924 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00791529 s, 132 MB/s 2024-09-11T22:21:00.933 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.933 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.933 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075821 s, 138 MB/s 2024-09-11T22:21:00.942 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.942 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.942 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700744 s, 150 MB/s 2024-09-11T22:21:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721883 s, 145 MB/s 2024-09-11T22:21:00.960 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.960 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.960 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725626 s, 145 MB/s 2024-09-11T22:21:00.969 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.969 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.969 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747122 s, 140 MB/s 2024-09-11T22:21:00.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.980 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700092 s, 150 MB/s 2024-09-11T22:21:00.987 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.987 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.987 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764643 s, 137 MB/s 2024-09-11T22:21:00.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:00.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:00.995 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657975 s, 159 MB/s 2024-09-11T22:21:01.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.005 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763932 s, 137 MB/s 2024-09-11T22:21:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741796 s, 141 MB/s 2024-09-11T22:21:01.023 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.023 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.023 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726926 s, 144 MB/s 2024-09-11T22:21:01.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.032 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706992 s, 148 MB/s 2024-09-11T22:21:01.041 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.041 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.042 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736272 s, 142 MB/s 2024-09-11T22:21:01.052 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.052 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.052 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803402 s, 131 MB/s 2024-09-11T22:21:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661129 s, 159 MB/s 2024-09-11T22:21:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073242 s, 143 MB/s 2024-09-11T22:21:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.078 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635677 s, 165 MB/s 2024-09-11T22:21:01.086 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.087 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066309 s, 158 MB/s 2024-09-11T22:21:01.095 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.096 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.096 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734378 s, 143 MB/s 2024-09-11T22:21:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.104 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721384 s, 145 MB/s 2024-09-11T22:21:01.113 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.113 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.113 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680751 s, 154 MB/s 2024-09-11T22:21:01.123 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.123 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.123 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726401 s, 144 MB/s 2024-09-11T22:21:01.133 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.133 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.133 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797425 s, 131 MB/s 2024-09-11T22:21:01.141 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.141 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.141 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628659 s, 167 MB/s 2024-09-11T22:21:01.150 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.150 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.150 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691523 s, 152 MB/s 2024-09-11T22:21:01.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.161 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867656 s, 121 MB/s 2024-09-11T22:21:01.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.171 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767611 s, 137 MB/s 2024-09-11T22:21:01.184 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.184 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.184 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864874 s, 121 MB/s 2024-09-11T22:21:01.190 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.190 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.190 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665658 s, 158 MB/s 2024-09-11T22:21:01.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:01.196 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:01.196 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:01.197 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.3 2024-09-11T22:21:01.197 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:01.197 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:01.197 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:01.197 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:01.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738042 s, 142 MB/s 2024-09-11T22:21:01.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.266 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716469 s, 146 MB/s 2024-09-11T22:21:01.275 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.275 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.275 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733747 s, 143 MB/s 2024-09-11T22:21:01.284 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.285 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790245 s, 133 MB/s 2024-09-11T22:21:01.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.295 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085349 s, 123 MB/s 2024-09-11T22:21:01.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.304 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070827 s, 148 MB/s 2024-09-11T22:21:01.312 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.312 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.312 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677712 s, 155 MB/s 2024-09-11T22:21:01.321 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.321 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.321 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664758 s, 158 MB/s 2024-09-11T22:21:01.330 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.330 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.330 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747145 s, 140 MB/s 2024-09-11T22:21:01.339 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.339 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.339 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704042 s, 149 MB/s 2024-09-11T22:21:01.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.347 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721598 s, 145 MB/s 2024-09-11T22:21:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783133 s, 134 MB/s 2024-09-11T22:21:01.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.365 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629956 s, 166 MB/s 2024-09-11T22:21:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.374 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726787 s, 144 MB/s 2024-09-11T22:21:01.382 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.382 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.382 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677932 s, 155 MB/s 2024-09-11T22:21:01.392 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.392 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.392 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817995 s, 128 MB/s 2024-09-11T22:21:01.401 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.401 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.401 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738368 s, 142 MB/s 2024-09-11T22:21:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.410 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709677 s, 148 MB/s 2024-09-11T22:21:01.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.420 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763704 s, 137 MB/s 2024-09-11T22:21:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704174 s, 149 MB/s 2024-09-11T22:21:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720817 s, 145 MB/s 2024-09-11T22:21:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071198 s, 147 MB/s 2024-09-11T22:21:01.455 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.455 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.455 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071372 s, 147 MB/s 2024-09-11T22:21:01.464 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.465 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.465 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803633 s, 130 MB/s 2024-09-11T22:21:01.473 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.473 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.473 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068155 s, 154 MB/s 2024-09-11T22:21:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00826226 s, 127 MB/s 2024-09-11T22:21:01.492 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.493 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784611 s, 134 MB/s 2024-09-11T22:21:01.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.501 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064496 s, 163 MB/s 2024-09-11T22:21:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.510 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729519 s, 144 MB/s 2024-09-11T22:21:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718807 s, 146 MB/s 2024-09-11T22:21:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759558 s, 138 MB/s 2024-09-11T22:21:01.536 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.537 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708513 s, 148 MB/s 2024-09-11T22:21:01.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:01.543 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:01.544 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:01.544 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.4 2024-09-11T22:21:01.544 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:01.544 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:01.544 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:01.544 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:01.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:01.604 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.605 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.605 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671864 s, 156 MB/s 2024-09-11T22:21:01.613 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.613 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.613 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632883 s, 166 MB/s 2024-09-11T22:21:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734467 s, 143 MB/s 2024-09-11T22:21:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712647 s, 147 MB/s 2024-09-11T22:21:01.641 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.641 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.641 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709294 s, 148 MB/s 2024-09-11T22:21:01.649 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.649 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.649 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652061 s, 161 MB/s 2024-09-11T22:21:01.658 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.658 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.658 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699068 s, 150 MB/s 2024-09-11T22:21:01.667 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.667 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.668 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703233 s, 149 MB/s 2024-09-11T22:21:01.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.677 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679443 s, 154 MB/s 2024-09-11T22:21:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.686 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068824 s, 152 MB/s 2024-09-11T22:21:01.694 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.694 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.694 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632354 s, 166 MB/s 2024-09-11T22:21:01.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.704 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.704 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755676 s, 139 MB/s 2024-09-11T22:21:01.712 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.712 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.712 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624911 s, 168 MB/s 2024-09-11T22:21:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740441 s, 142 MB/s 2024-09-11T22:21:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719439 s, 146 MB/s 2024-09-11T22:21:01.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.740 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713038 s, 147 MB/s 2024-09-11T22:21:01.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.749 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705211 s, 149 MB/s 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.758 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642789 s, 163 MB/s 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.767 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715017 s, 147 MB/s 2024-09-11T22:21:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.777 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755093 s, 139 MB/s 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636795 s, 165 MB/s 2024-09-11T22:21:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717471 s, 146 MB/s 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.804 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078125 s, 134 MB/s 2024-09-11T22:21:01.814 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.814 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.814 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774959 s, 135 MB/s 2024-09-11T22:21:01.823 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.823 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.823 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661759 s, 158 MB/s 2024-09-11T22:21:01.832 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.832 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.832 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690545 s, 152 MB/s 2024-09-11T22:21:01.841 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.841 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.841 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675426 s, 155 MB/s 2024-09-11T22:21:01.850 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.850 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.850 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689181 s, 152 MB/s 2024-09-11T22:21:01.860 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.860 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.860 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761012 s, 138 MB/s 2024-09-11T22:21:01.869 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.869 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.869 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741347 s, 141 MB/s 2024-09-11T22:21:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075003 s, 140 MB/s 2024-09-11T22:21:01.887 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.887 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.888 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635699 s, 165 MB/s 2024-09-11T22:21:01.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:01.894 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:01.894 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:01.895 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.5 2024-09-11T22:21:01.895 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:01.895 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:01.895 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:01.895 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:01.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:01.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.957 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781336 s, 134 MB/s 2024-09-11T22:21:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071908 s, 146 MB/s 2024-09-11T22:21:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.976 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.976 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072318 s, 145 MB/s 2024-09-11T22:21:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722907 s, 145 MB/s 2024-09-11T22:21:01.994 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:01.994 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:01.994 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737058 s, 142 MB/s 2024-09-11T22:21:02.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.005 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00832085 s, 126 MB/s 2024-09-11T22:21:02.014 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.014 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.014 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715242 s, 147 MB/s 2024-09-11T22:21:02.023 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.023 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.023 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694315 s, 151 MB/s 2024-09-11T22:21:02.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.033 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722322 s, 145 MB/s 2024-09-11T22:21:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066068 s, 159 MB/s 2024-09-11T22:21:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.051 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695646 s, 151 MB/s 2024-09-11T22:21:02.061 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.061 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.061 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00801207 s, 131 MB/s 2024-09-11T22:21:02.069 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.069 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.069 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655932 s, 160 MB/s 2024-09-11T22:21:02.078 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.078 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.078 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673768 s, 156 MB/s 2024-09-11T22:21:02.088 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.088 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.088 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728831 s, 144 MB/s 2024-09-11T22:21:02.096 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.096 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.097 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656507 s, 160 MB/s 2024-09-11T22:21:02.106 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.106 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.106 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769868 s, 136 MB/s 2024-09-11T22:21:02.115 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.115 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.115 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683677 s, 153 MB/s 2024-09-11T22:21:02.124 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.124 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.124 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703347 s, 149 MB/s 2024-09-11T22:21:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662411 s, 158 MB/s 2024-09-11T22:21:02.141 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699154 s, 150 MB/s 2024-09-11T22:21:02.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.151 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728896 s, 144 MB/s 2024-09-11T22:21:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743983 s, 141 MB/s 2024-09-11T22:21:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639812 s, 164 MB/s 2024-09-11T22:21:02.178 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.178 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.178 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850664 s, 123 MB/s 2024-09-11T22:21:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696402 s, 151 MB/s 2024-09-11T22:21:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670428 s, 156 MB/s 2024-09-11T22:21:02.205 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.205 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.205 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845875 s, 124 MB/s 2024-09-11T22:21:02.214 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.214 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.214 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685748 s, 153 MB/s 2024-09-11T22:21:02.222 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.222 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.222 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006969 s, 150 MB/s 2024-09-11T22:21:02.231 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.231 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.231 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671466 s, 156 MB/s 2024-09-11T22:21:02.239 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.239 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.239 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629462 s, 167 MB/s 2024-09-11T22:21:02.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:02.245 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:02.246 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:02.246 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.6 2024-09-11T22:21:02.246 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:02.246 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:02.246 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:02.246 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:02.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:02.306 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.307 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714534 s, 147 MB/s 2024-09-11T22:21:02.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.316 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773133 s, 136 MB/s 2024-09-11T22:21:02.324 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.324 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.324 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644796 s, 163 MB/s 2024-09-11T22:21:02.332 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.333 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.333 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702269 s, 149 MB/s 2024-09-11T22:21:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740637 s, 142 MB/s 2024-09-11T22:21:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720943 s, 145 MB/s 2024-09-11T22:21:02.359 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.359 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.359 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062375 s, 168 MB/s 2024-09-11T22:21:02.366 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.366 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.367 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625644 s, 168 MB/s 2024-09-11T22:21:02.376 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.376 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.376 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799264 s, 131 MB/s 2024-09-11T22:21:02.385 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.385 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.385 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720388 s, 146 MB/s 2024-09-11T22:21:02.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.393 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646864 s, 162 MB/s 2024-09-11T22:21:02.401 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.401 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.401 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675805 s, 155 MB/s 2024-09-11T22:21:02.410 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.410 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.410 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733875 s, 143 MB/s 2024-09-11T22:21:02.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.419 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741309 s, 141 MB/s 2024-09-11T22:21:02.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.428 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693839 s, 151 MB/s 2024-09-11T22:21:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772369 s, 136 MB/s 2024-09-11T22:21:02.445 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.445 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.445 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635331 s, 165 MB/s 2024-09-11T22:21:02.455 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.455 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.455 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00832471 s, 126 MB/s 2024-09-11T22:21:02.464 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.465 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.465 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745095 s, 141 MB/s 2024-09-11T22:21:02.473 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.474 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074657 s, 140 MB/s 2024-09-11T22:21:02.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.482 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670886 s, 156 MB/s 2024-09-11T22:21:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741406 s, 141 MB/s 2024-09-11T22:21:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694954 s, 151 MB/s 2024-09-11T22:21:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684625 s, 153 MB/s 2024-09-11T22:21:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067483 s, 155 MB/s 2024-09-11T22:21:02.526 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.526 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.526 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743203 s, 141 MB/s 2024-09-11T22:21:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748113 s, 140 MB/s 2024-09-11T22:21:02.543 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.543 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688847 s, 152 MB/s 2024-09-11T22:21:02.553 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.553 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.553 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074233 s, 141 MB/s 2024-09-11T22:21:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727052 s, 144 MB/s 2024-09-11T22:21:02.570 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.570 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.571 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724094 s, 145 MB/s 2024-09-11T22:21:02.579 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.579 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.579 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673505 s, 156 MB/s 2024-09-11T22:21:02.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:02.586 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:02.586 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:02.586 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.7 2024-09-11T22:21:02.586 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:02.586 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:02.586 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:02.586 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:02.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:02.646 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.646 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.646 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006882 s, 152 MB/s 2024-09-11T22:21:02.655 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.655 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.655 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768285 s, 136 MB/s 2024-09-11T22:21:02.664 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.664 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.664 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070842 s, 148 MB/s 2024-09-11T22:21:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070368 s, 149 MB/s 2024-09-11T22:21:02.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.681 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067486 s, 155 MB/s 2024-09-11T22:21:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.691 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077083 s, 136 MB/s 2024-09-11T22:21:02.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.699 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648038 s, 162 MB/s 2024-09-11T22:21:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760443 s, 138 MB/s 2024-09-11T22:21:02.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.718 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842581 s, 124 MB/s 2024-09-11T22:21:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.726 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644384 s, 163 MB/s 2024-09-11T22:21:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.736 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777786 s, 135 MB/s 2024-09-11T22:21:02.744 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.744 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.744 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718742 s, 146 MB/s 2024-09-11T22:21:02.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.753 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711844 s, 147 MB/s 2024-09-11T22:21:02.762 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.762 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.762 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067791 s, 155 MB/s 2024-09-11T22:21:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.770 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688416 s, 152 MB/s 2024-09-11T22:21:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776886 s, 135 MB/s 2024-09-11T22:21:02.788 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.788 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.788 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666904 s, 157 MB/s 2024-09-11T22:21:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.797 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683511 s, 153 MB/s 2024-09-11T22:21:02.805 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.805 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.805 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695196 s, 151 MB/s 2024-09-11T22:21:02.814 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.814 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.814 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728872 s, 144 MB/s 2024-09-11T22:21:02.823 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.823 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.823 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670924 s, 156 MB/s 2024-09-11T22:21:02.831 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.831 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.831 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691162 s, 152 MB/s 2024-09-11T22:21:02.840 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.840 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.841 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073091 s, 143 MB/s 2024-09-11T22:21:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.849 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.850 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722015 s, 145 MB/s 2024-09-11T22:21:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.858 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.859 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736633 s, 142 MB/s 2024-09-11T22:21:02.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.867 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724606 s, 145 MB/s 2024-09-11T22:21:02.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.875 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634882 s, 165 MB/s 2024-09-11T22:21:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062498 s, 168 MB/s 2024-09-11T22:21:02.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685065 s, 153 MB/s 2024-09-11T22:21:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676696 s, 155 MB/s 2024-09-11T22:21:02.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.909 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.909 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675967 s, 155 MB/s 2024-09-11T22:21:02.917 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.917 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.918 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730469 s, 144 MB/s 2024-09-11T22:21:02.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:02.924 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:02.925 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:02.925 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.8 2024-09-11T22:21:02.925 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:02.925 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:02.925 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:02.925 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:02.986 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.986 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.986 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742082 s, 141 MB/s 2024-09-11T22:21:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732724 s, 143 MB/s 2024-09-11T22:21:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765758 s, 137 MB/s 2024-09-11T22:21:03.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.012 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667901 s, 157 MB/s 2024-09-11T22:21:03.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.021 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692726 s, 151 MB/s 2024-09-11T22:21:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722874 s, 145 MB/s 2024-09-11T22:21:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.039 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739272 s, 142 MB/s 2024-09-11T22:21:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.048 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680208 s, 154 MB/s 2024-09-11T22:21:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.058 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745925 s, 141 MB/s 2024-09-11T22:21:03.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.066 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637726 s, 164 MB/s 2024-09-11T22:21:03.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.075 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778814 s, 135 MB/s 2024-09-11T22:21:03.084 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.084 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.084 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667067 s, 157 MB/s 2024-09-11T22:21:03.093 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.093 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.094 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749697 s, 140 MB/s 2024-09-11T22:21:03.102 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.102 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.102 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723732 s, 145 MB/s 2024-09-11T22:21:03.110 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.111 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.111 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651263 s, 161 MB/s 2024-09-11T22:21:03.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.120 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697433 s, 150 MB/s 2024-09-11T22:21:03.127 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.128 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.128 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633681 s, 165 MB/s 2024-09-11T22:21:03.136 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.136 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.136 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735373 s, 143 MB/s 2024-09-11T22:21:03.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.145 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720024 s, 146 MB/s 2024-09-11T22:21:03.154 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.155 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.155 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746853 s, 140 MB/s 2024-09-11T22:21:03.163 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.164 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.164 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681662 s, 154 MB/s 2024-09-11T22:21:03.173 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.173 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.173 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733181 s, 143 MB/s 2024-09-11T22:21:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.182 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687391 s, 153 MB/s 2024-09-11T22:21:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.191 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724059 s, 145 MB/s 2024-09-11T22:21:03.199 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.199 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.200 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060507 s, 173 MB/s 2024-09-11T22:21:03.209 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.209 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.209 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737772 s, 142 MB/s 2024-09-11T22:21:03.218 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.218 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.218 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692622 s, 151 MB/s 2024-09-11T22:21:03.226 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.226 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.226 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064757 s, 162 MB/s 2024-09-11T22:21:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843443 s, 124 MB/s 2024-09-11T22:21:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.245 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722538 s, 145 MB/s 2024-09-11T22:21:03.254 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.254 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.254 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743166 s, 141 MB/s 2024-09-11T22:21:03.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.263 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681099 s, 154 MB/s 2024-09-11T22:21:03.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:03.270 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:03.270 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:03.270 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.9 2024-09-11T22:21:03.270 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:03.271 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:03.271 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:03.271 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:03.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:03.331 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.331 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.331 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703773 s, 149 MB/s 2024-09-11T22:21:03.340 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.341 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.341 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072472 s, 145 MB/s 2024-09-11T22:21:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.350 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731484 s, 143 MB/s 2024-09-11T22:21:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751273 s, 140 MB/s 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706308 s, 148 MB/s 2024-09-11T22:21:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697591 s, 150 MB/s 2024-09-11T22:21:03.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.388 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.388 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762954 s, 137 MB/s 2024-09-11T22:21:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.398 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758696 s, 138 MB/s 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.408 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00815958 s, 129 MB/s 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716178 s, 146 MB/s 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.426 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708485 s, 148 MB/s 2024-09-11T22:21:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774807 s, 135 MB/s 2024-09-11T22:21:03.445 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.446 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.446 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716879 s, 146 MB/s 2024-09-11T22:21:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722116 s, 145 MB/s 2024-09-11T22:21:03.463 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707436 s, 148 MB/s 2024-09-11T22:21:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.473 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.474 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787942 s, 133 MB/s 2024-09-11T22:21:03.481 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.481 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.481 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649113 s, 162 MB/s 2024-09-11T22:21:03.490 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.490 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.490 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747181 s, 140 MB/s 2024-09-11T22:21:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.499 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721954 s, 145 MB/s 2024-09-11T22:21:03.508 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.508 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.508 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680753 s, 154 MB/s 2024-09-11T22:21:03.515 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624929 s, 168 MB/s 2024-09-11T22:21:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714862 s, 147 MB/s 2024-09-11T22:21:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.534 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720937 s, 145 MB/s 2024-09-11T22:21:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744472 s, 141 MB/s 2024-09-11T22:21:03.551 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.551 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.551 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700852 s, 150 MB/s 2024-09-11T22:21:03.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.560 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681046 s, 154 MB/s 2024-09-11T22:21:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726209 s, 144 MB/s 2024-09-11T22:21:03.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.577 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642336 s, 163 MB/s 2024-09-11T22:21:03.585 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.586 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687485 s, 153 MB/s 2024-09-11T22:21:03.596 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.596 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.596 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843092 s, 124 MB/s 2024-09-11T22:21:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.605 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727799 s, 144 MB/s 2024-09-11T22:21:03.613 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.613 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.613 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656827 s, 160 MB/s 2024-09-11T22:21:03.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:03.620 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:03.620 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:03.620 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.10 2024-09-11T22:21:03.620 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:03.620 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:03.620 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:03.620 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.680 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.680 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652539 s, 161 MB/s 2024-09-11T22:21:03.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.688 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.688 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705726 s, 149 MB/s 2024-09-11T22:21:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.696 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650026 s, 161 MB/s 2024-09-11T22:21:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.705 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702176 s, 149 MB/s 2024-09-11T22:21:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856184 s, 122 MB/s 2024-09-11T22:21:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067827 s, 155 MB/s 2024-09-11T22:21:03.732 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.733 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716129 s, 146 MB/s 2024-09-11T22:21:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.742 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749341 s, 140 MB/s 2024-09-11T22:21:03.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.751 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072319 s, 145 MB/s 2024-09-11T22:21:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.760 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700537 s, 150 MB/s 2024-09-11T22:21:03.768 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.768 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.768 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006824 s, 154 MB/s 2024-09-11T22:21:03.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.777 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714453 s, 147 MB/s 2024-09-11T22:21:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.786 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717694 s, 146 MB/s 2024-09-11T22:21:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.794 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670066 s, 156 MB/s 2024-09-11T22:21:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752587 s, 139 MB/s 2024-09-11T22:21:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665071 s, 158 MB/s 2024-09-11T22:21:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.820 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692328 s, 151 MB/s 2024-09-11T22:21:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747461 s, 140 MB/s 2024-09-11T22:21:03.839 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.839 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.839 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774822 s, 135 MB/s 2024-09-11T22:21:03.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.848 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739693 s, 142 MB/s 2024-09-11T22:21:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723752 s, 145 MB/s 2024-09-11T22:21:03.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.866 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765589 s, 137 MB/s 2024-09-11T22:21:03.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.875 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075165 s, 140 MB/s 2024-09-11T22:21:03.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.884 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736958 s, 142 MB/s 2024-09-11T22:21:03.894 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.894 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.894 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00834134 s, 126 MB/s 2024-09-11T22:21:03.903 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.903 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.903 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653849 s, 160 MB/s 2024-09-11T22:21:03.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.912 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.912 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747557 s, 140 MB/s 2024-09-11T22:21:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.921 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734283 s, 143 MB/s 2024-09-11T22:21:03.929 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.929 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.929 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641028 s, 164 MB/s 2024-09-11T22:21:03.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.937 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668806 s, 157 MB/s 2024-09-11T22:21:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634706 s, 165 MB/s 2024-09-11T22:21:03.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:03.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:03.954 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692373 s, 151 MB/s 2024-09-11T22:21:03.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:03.960 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:03.960 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:03.961 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.11 2024-09-11T22:21:03.961 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:03.961 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:03.961 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:03.961 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:04.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:04.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.021 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647318 s, 162 MB/s 2024-09-11T22:21:04.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.030 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729155 s, 144 MB/s 2024-09-11T22:21:04.039 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.039 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.039 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671282 s, 156 MB/s 2024-09-11T22:21:04.048 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.048 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.048 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698107 s, 150 MB/s 2024-09-11T22:21:04.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.057 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681847 s, 154 MB/s 2024-09-11T22:21:04.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.066 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.066 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657483 s, 159 MB/s 2024-09-11T22:21:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723092 s, 145 MB/s 2024-09-11T22:21:04.084 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.084 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.084 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734048 s, 143 MB/s 2024-09-11T22:21:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741557 s, 141 MB/s 2024-09-11T22:21:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00806478 s, 130 MB/s 2024-09-11T22:21:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728403 s, 144 MB/s 2024-09-11T22:21:04.122 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.122 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658002 s, 159 MB/s 2024-09-11T22:21:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00821458 s, 128 MB/s 2024-09-11T22:21:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.143 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00791128 s, 133 MB/s 2024-09-11T22:21:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.152 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713574 s, 147 MB/s 2024-09-11T22:21:04.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.162 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.162 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728109 s, 144 MB/s 2024-09-11T22:21:04.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.171 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760666 s, 138 MB/s 2024-09-11T22:21:04.180 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.181 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.181 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718254 s, 146 MB/s 2024-09-11T22:21:04.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.190 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.190 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732992 s, 143 MB/s 2024-09-11T22:21:04.199 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.199 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.199 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758552 s, 138 MB/s 2024-09-11T22:21:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.208 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681021 s, 154 MB/s 2024-09-11T22:21:04.216 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.216 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.216 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727436 s, 144 MB/s 2024-09-11T22:21:04.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.226 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.226 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749147 s, 140 MB/s 2024-09-11T22:21:04.238 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.238 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.239 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106658 s, 98.3 MB/s 2024-09-11T22:21:04.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.249 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861933 s, 122 MB/s 2024-09-11T22:21:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738801 s, 142 MB/s 2024-09-11T22:21:04.267 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.267 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.267 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732712 s, 143 MB/s 2024-09-11T22:21:04.276 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.276 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.276 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734122 s, 143 MB/s 2024-09-11T22:21:04.286 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.286 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.286 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073432 s, 143 MB/s 2024-09-11T22:21:04.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.295 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725731 s, 144 MB/s 2024-09-11T22:21:04.306 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.307 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091746 s, 114 MB/s 2024-09-11T22:21:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700652 s, 150 MB/s 2024-09-11T22:21:04.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:04.323 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:04.323 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:04.323 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.12 2024-09-11T22:21:04.323 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:04.323 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:04.323 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:04.323 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:04.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:04.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.383 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665365 s, 158 MB/s 2024-09-11T22:21:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.393 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858642 s, 122 MB/s 2024-09-11T22:21:04.402 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.402 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.402 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752208 s, 139 MB/s 2024-09-11T22:21:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719872 s, 146 MB/s 2024-09-11T22:21:04.420 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.420 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.420 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676991 s, 155 MB/s 2024-09-11T22:21:04.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.428 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643234 s, 163 MB/s 2024-09-11T22:21:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.438 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878282 s, 119 MB/s 2024-09-11T22:21:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.448 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720807 s, 145 MB/s 2024-09-11T22:21:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.456 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695922 s, 151 MB/s 2024-09-11T22:21:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.463 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622328 s, 168 MB/s 2024-09-11T22:21:04.472 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.473 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.473 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751086 s, 140 MB/s 2024-09-11T22:21:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669314 s, 157 MB/s 2024-09-11T22:21:04.489 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682296 s, 154 MB/s 2024-09-11T22:21:04.498 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.499 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717115 s, 146 MB/s 2024-09-11T22:21:04.507 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.507 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.507 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674475 s, 155 MB/s 2024-09-11T22:21:04.516 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.516 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.516 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730151 s, 144 MB/s 2024-09-11T22:21:04.524 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688332 s, 152 MB/s 2024-09-11T22:21:04.532 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.532 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.533 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006182 s, 170 MB/s 2024-09-11T22:21:04.540 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.540 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.541 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006311 s, 166 MB/s 2024-09-11T22:21:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.549 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.550 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726977 s, 144 MB/s 2024-09-11T22:21:04.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728642 s, 144 MB/s 2024-09-11T22:21:04.569 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.569 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.569 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769084 s, 136 MB/s 2024-09-11T22:21:04.578 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.578 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.578 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742576 s, 141 MB/s 2024-09-11T22:21:04.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.587 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658853 s, 159 MB/s 2024-09-11T22:21:04.595 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.595 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.595 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664682 s, 158 MB/s 2024-09-11T22:21:04.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.603 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670058 s, 156 MB/s 2024-09-11T22:21:04.612 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.612 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.612 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072141 s, 145 MB/s 2024-09-11T22:21:04.621 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.621 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.621 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069782 s, 150 MB/s 2024-09-11T22:21:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.630 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717363 s, 146 MB/s 2024-09-11T22:21:04.639 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.639 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.639 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753372 s, 139 MB/s 2024-09-11T22:21:04.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.648 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.648 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701446 s, 149 MB/s 2024-09-11T22:21:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850217 s, 123 MB/s 2024-09-11T22:21:04.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:04.665 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:04.665 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:04.665 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.13 2024-09-11T22:21:04.665 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:04.665 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:04.665 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:04.665 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:04.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:04.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.725 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.725 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634354 s, 165 MB/s 2024-09-11T22:21:04.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076005 s, 138 MB/s 2024-09-11T22:21:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.743 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722997 s, 145 MB/s 2024-09-11T22:21:04.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.752 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706774 s, 148 MB/s 2024-09-11T22:21:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657979 s, 159 MB/s 2024-09-11T22:21:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719494 s, 146 MB/s 2024-09-11T22:21:04.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.777 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712782 s, 147 MB/s 2024-09-11T22:21:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.786 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696743 s, 150 MB/s 2024-09-11T22:21:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719626 s, 146 MB/s 2024-09-11T22:21:04.804 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.805 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.805 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723851 s, 145 MB/s 2024-09-11T22:21:04.813 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.813 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.813 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658017 s, 159 MB/s 2024-09-11T22:21:04.822 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.822 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.822 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659593 s, 159 MB/s 2024-09-11T22:21:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072685 s, 144 MB/s 2024-09-11T22:21:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671971 s, 156 MB/s 2024-09-11T22:21:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748947 s, 140 MB/s 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.859 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839293 s, 125 MB/s 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733312 s, 143 MB/s 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.876 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626232 s, 167 MB/s 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.884 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688452 s, 152 MB/s 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.893 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671828 s, 156 MB/s 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722085 s, 145 MB/s 2024-09-11T22:21:04.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.911 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736794 s, 142 MB/s 2024-09-11T22:21:04.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.921 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804266 s, 130 MB/s 2024-09-11T22:21:04.929 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.929 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.929 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664205 s, 158 MB/s 2024-09-11T22:21:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.937 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631472 s, 166 MB/s 2024-09-11T22:21:04.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.945 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673184 s, 156 MB/s 2024-09-11T22:21:04.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.954 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708605 s, 148 MB/s 2024-09-11T22:21:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653263 s, 161 MB/s 2024-09-11T22:21:04.971 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.972 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745354 s, 141 MB/s 2024-09-11T22:21:04.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.980 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708663 s, 148 MB/s 2024-09-11T22:21:04.989 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.989 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.989 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729299 s, 144 MB/s 2024-09-11T22:21:04.998 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:04.998 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:04.998 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741679 s, 141 MB/s 2024-09-11T22:21:04.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:05.005 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:05.005 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:05.005 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.14 2024-09-11T22:21:05.005 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:05.005 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:05.005 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:05.005 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741847 s, 141 MB/s 2024-09-11T22:21:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766932 s, 137 MB/s 2024-09-11T22:21:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.083 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635675 s, 165 MB/s 2024-09-11T22:21:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.091 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640188 s, 164 MB/s 2024-09-11T22:21:05.100 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.100 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.100 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724623 s, 145 MB/s 2024-09-11T22:21:05.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.108 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656677 s, 160 MB/s 2024-09-11T22:21:05.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.117 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734221 s, 143 MB/s 2024-09-11T22:21:05.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.125 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684028 s, 153 MB/s 2024-09-11T22:21:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765291 s, 137 MB/s 2024-09-11T22:21:05.144 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.144 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.144 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073353 s, 143 MB/s 2024-09-11T22:21:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731764 s, 143 MB/s 2024-09-11T22:21:05.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727051 s, 144 MB/s 2024-09-11T22:21:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073506 s, 143 MB/s 2024-09-11T22:21:05.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.179 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713133 s, 147 MB/s 2024-09-11T22:21:05.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.189 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735163 s, 143 MB/s 2024-09-11T22:21:05.196 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.197 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636267 s, 165 MB/s 2024-09-11T22:21:05.205 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.205 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.205 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664385 s, 158 MB/s 2024-09-11T22:21:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844398 s, 124 MB/s 2024-09-11T22:21:05.223 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.223 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.224 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679186 s, 154 MB/s 2024-09-11T22:21:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.232 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683287 s, 153 MB/s 2024-09-11T22:21:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709256 s, 148 MB/s 2024-09-11T22:21:05.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.250 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720931 s, 145 MB/s 2024-09-11T22:21:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.260 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828417 s, 127 MB/s 2024-09-11T22:21:05.269 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.269 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.269 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720195 s, 146 MB/s 2024-09-11T22:21:05.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.277 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636709 s, 165 MB/s 2024-09-11T22:21:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.286 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731489 s, 143 MB/s 2024-09-11T22:21:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.295 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719425 s, 146 MB/s 2024-09-11T22:21:05.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.304 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753052 s, 139 MB/s 2024-09-11T22:21:05.313 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.313 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.313 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733027 s, 143 MB/s 2024-09-11T22:21:05.322 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.322 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.322 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711995 s, 147 MB/s 2024-09-11T22:21:05.332 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.332 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.332 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00829654 s, 126 MB/s 2024-09-11T22:21:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825163 s, 127 MB/s 2024-09-11T22:21:05.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:05.349 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:05.349 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:05.349 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.15 2024-09-11T22:21:05.349 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:05.349 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:05.349 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:05.349 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:05.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:05.409 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.409 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.409 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731083 s, 143 MB/s 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00816491 s, 128 MB/s 2024-09-11T22:21:05.429 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.429 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.429 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854944 s, 123 MB/s 2024-09-11T22:21:05.438 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.438 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.438 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710278 s, 148 MB/s 2024-09-11T22:21:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846364 s, 124 MB/s 2024-09-11T22:21:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072264 s, 145 MB/s 2024-09-11T22:21:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707105 s, 148 MB/s 2024-09-11T22:21:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068908 s, 152 MB/s 2024-09-11T22:21:05.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.485 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00819888 s, 128 MB/s 2024-09-11T22:21:05.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.493 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702372 s, 149 MB/s 2024-09-11T22:21:05.502 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.502 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.502 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684656 s, 153 MB/s 2024-09-11T22:21:05.511 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.511 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.511 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730994 s, 143 MB/s 2024-09-11T22:21:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721789 s, 145 MB/s 2024-09-11T22:21:05.528 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.528 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692979 s, 151 MB/s 2024-09-11T22:21:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653442 s, 160 MB/s 2024-09-11T22:21:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064401 s, 163 MB/s 2024-09-11T22:21:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744087 s, 141 MB/s 2024-09-11T22:21:05.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.563 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712609 s, 147 MB/s 2024-09-11T22:21:05.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.572 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726613 s, 144 MB/s 2024-09-11T22:21:05.580 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.580 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.580 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654626 s, 160 MB/s 2024-09-11T22:21:05.588 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.588 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.588 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063561 s, 165 MB/s 2024-09-11T22:21:05.597 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.597 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.597 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718008 s, 146 MB/s 2024-09-11T22:21:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754425 s, 139 MB/s 2024-09-11T22:21:05.615 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.615 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.615 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749922 s, 140 MB/s 2024-09-11T22:21:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721917 s, 145 MB/s 2024-09-11T22:21:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734725 s, 143 MB/s 2024-09-11T22:21:05.642 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.642 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.642 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729913 s, 144 MB/s 2024-09-11T22:21:05.650 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.650 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.650 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645032 s, 163 MB/s 2024-09-11T22:21:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706833 s, 148 MB/s 2024-09-11T22:21:05.668 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.668 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.668 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751975 s, 139 MB/s 2024-09-11T22:21:05.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.677 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695715 s, 151 MB/s 2024-09-11T22:21:05.687 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.687 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.687 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824675 s, 127 MB/s 2024-09-11T22:21:05.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:05.693 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:05.694 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:05.694 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.16 2024-09-11T22:21:05.694 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:05.694 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:05.694 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:05.694 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:05.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:05.754 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.754 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.754 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689674 s, 152 MB/s 2024-09-11T22:21:05.763 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.764 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.764 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00816119 s, 128 MB/s 2024-09-11T22:21:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752921 s, 139 MB/s 2024-09-11T22:21:05.782 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.782 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.782 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723107 s, 145 MB/s 2024-09-11T22:21:05.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.790 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065128 s, 161 MB/s 2024-09-11T22:21:05.798 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.798 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.798 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684623 s, 153 MB/s 2024-09-11T22:21:05.807 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.807 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.807 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728472 s, 144 MB/s 2024-09-11T22:21:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712236 s, 147 MB/s 2024-09-11T22:21:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847653 s, 124 MB/s 2024-09-11T22:21:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.835 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662061 s, 158 MB/s 2024-09-11T22:21:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772699 s, 136 MB/s 2024-09-11T22:21:05.853 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.853 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.853 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793582 s, 132 MB/s 2024-09-11T22:21:05.862 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.862 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.862 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641052 s, 164 MB/s 2024-09-11T22:21:05.869 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.869 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.870 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634163 s, 165 MB/s 2024-09-11T22:21:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692834 s, 151 MB/s 2024-09-11T22:21:05.887 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.887 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.887 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709694 s, 148 MB/s 2024-09-11T22:21:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069958 s, 150 MB/s 2024-09-11T22:21:05.909 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.909 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.909 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121433 s, 86.3 MB/s 2024-09-11T22:21:05.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.918 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723287 s, 145 MB/s 2024-09-11T22:21:05.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.927 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744168 s, 141 MB/s 2024-09-11T22:21:05.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.937 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733627 s, 143 MB/s 2024-09-11T22:21:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.945 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723316 s, 145 MB/s 2024-09-11T22:21:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719791 s, 146 MB/s 2024-09-11T22:21:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682937 s, 154 MB/s 2024-09-11T22:21:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.972 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749143 s, 140 MB/s 2024-09-11T22:21:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643016 s, 163 MB/s 2024-09-11T22:21:05.989 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.989 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.989 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719432 s, 146 MB/s 2024-09-11T22:21:05.997 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:05.997 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:05.998 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693439 s, 151 MB/s 2024-09-11T22:21:06.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.005 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626746 s, 167 MB/s 2024-09-11T22:21:06.014 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.014 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.014 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708154 s, 148 MB/s 2024-09-11T22:21:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754817 s, 139 MB/s 2024-09-11T22:21:06.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.032 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069205 s, 152 MB/s 2024-09-11T22:21:06.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:06.039 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:06.039 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:06.039 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.17 2024-09-11T22:21:06.039 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:06.039 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:06.039 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:06.039 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:06.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730806 s, 143 MB/s 2024-09-11T22:21:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070454 s, 149 MB/s 2024-09-11T22:21:06.116 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708362 s, 148 MB/s 2024-09-11T22:21:06.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.126 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729113 s, 144 MB/s 2024-09-11T22:21:06.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.134 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067833 s, 155 MB/s 2024-09-11T22:21:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754874 s, 139 MB/s 2024-09-11T22:21:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720056 s, 146 MB/s 2024-09-11T22:21:06.162 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.162 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.162 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792208 s, 132 MB/s 2024-09-11T22:21:06.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.171 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741403 s, 141 MB/s 2024-09-11T22:21:06.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.179 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682375 s, 154 MB/s 2024-09-11T22:21:06.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.188 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653431 s, 160 MB/s 2024-09-11T22:21:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.197 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673971 s, 156 MB/s 2024-09-11T22:21:06.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.206 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724239 s, 145 MB/s 2024-09-11T22:21:06.217 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.217 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.217 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874405 s, 120 MB/s 2024-09-11T22:21:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712227 s, 147 MB/s 2024-09-11T22:21:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675118 s, 155 MB/s 2024-09-11T22:21:06.244 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.244 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730106 s, 144 MB/s 2024-09-11T22:21:06.254 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.254 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.254 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709298 s, 148 MB/s 2024-09-11T22:21:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070449 s, 149 MB/s 2024-09-11T22:21:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729181 s, 144 MB/s 2024-09-11T22:21:06.281 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.281 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.281 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663094 s, 158 MB/s 2024-09-11T22:21:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673962 s, 156 MB/s 2024-09-11T22:21:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691331 s, 152 MB/s 2024-09-11T22:21:06.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.308 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665532 s, 158 MB/s 2024-09-11T22:21:06.317 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.317 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.317 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710035 s, 148 MB/s 2024-09-11T22:21:06.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.326 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745987 s, 141 MB/s 2024-09-11T22:21:06.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.336 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.336 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715427 s, 147 MB/s 2024-09-11T22:21:06.344 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.344 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.344 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629189 s, 167 MB/s 2024-09-11T22:21:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735637 s, 143 MB/s 2024-09-11T22:21:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674483 s, 155 MB/s 2024-09-11T22:21:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743571 s, 141 MB/s 2024-09-11T22:21:06.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.380 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00815471 s, 129 MB/s 2024-09-11T22:21:06.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:06.386 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:06.386 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:06.387 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.18 2024-09-11T22:21:06.387 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:06.387 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:06.387 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:06.387 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731024 s, 143 MB/s 2024-09-11T22:21:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680111 s, 154 MB/s 2024-09-11T22:21:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782086 s, 134 MB/s 2024-09-11T22:21:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735523 s, 143 MB/s 2024-09-11T22:21:06.483 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.483 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.483 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706932 s, 148 MB/s 2024-09-11T22:21:06.492 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.492 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.492 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739692 s, 142 MB/s 2024-09-11T22:21:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839875 s, 125 MB/s 2024-09-11T22:21:06.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.511 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658146 s, 159 MB/s 2024-09-11T22:21:06.519 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699324 s, 150 MB/s 2024-09-11T22:21:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860718 s, 122 MB/s 2024-09-11T22:21:06.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.539 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684331 s, 153 MB/s 2024-09-11T22:21:06.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.549 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.549 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083317 s, 126 MB/s 2024-09-11T22:21:06.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.558 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691587 s, 152 MB/s 2024-09-11T22:21:06.566 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.566 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.566 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073727 s, 142 MB/s 2024-09-11T22:21:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764565 s, 137 MB/s 2024-09-11T22:21:06.584 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.584 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.584 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064073 s, 164 MB/s 2024-09-11T22:21:06.593 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.593 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.593 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00816622 s, 128 MB/s 2024-09-11T22:21:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638683 s, 164 MB/s 2024-09-11T22:21:06.610 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.610 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.610 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071607 s, 146 MB/s 2024-09-11T22:21:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771063 s, 136 MB/s 2024-09-11T22:21:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.628 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714553 s, 147 MB/s 2024-09-11T22:21:06.637 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.637 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.637 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729617 s, 144 MB/s 2024-09-11T22:21:06.646 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.646 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.646 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706633 s, 148 MB/s 2024-09-11T22:21:06.654 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.654 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.654 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634894 s, 165 MB/s 2024-09-11T22:21:06.662 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.663 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.663 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662517 s, 158 MB/s 2024-09-11T22:21:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.671 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730858 s, 143 MB/s 2024-09-11T22:21:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742861 s, 141 MB/s 2024-09-11T22:21:06.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741277 s, 141 MB/s 2024-09-11T22:21:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675734 s, 155 MB/s 2024-09-11T22:21:06.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.707 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679649 s, 154 MB/s 2024-09-11T22:21:06.716 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.717 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.717 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778303 s, 135 MB/s 2024-09-11T22:21:06.725 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.725 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.725 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068869 s, 152 MB/s 2024-09-11T22:21:06.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:06.732 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:06.732 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:06.732 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.19 2024-09-11T22:21:06.732 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:06.732 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:06.732 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:06.732 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:06.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:06.792 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.792 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.792 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696965 s, 150 MB/s 2024-09-11T22:21:06.801 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.801 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.801 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711238 s, 147 MB/s 2024-09-11T22:21:06.810 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.810 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.810 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744461 s, 141 MB/s 2024-09-11T22:21:06.818 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.818 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.818 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656492 s, 160 MB/s 2024-09-11T22:21:06.827 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727188 s, 144 MB/s 2024-09-11T22:21:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.837 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767362 s, 137 MB/s 2024-09-11T22:21:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.847 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729989 s, 144 MB/s 2024-09-11T22:21:06.856 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.856 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.856 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706801 s, 148 MB/s 2024-09-11T22:21:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729644 s, 144 MB/s 2024-09-11T22:21:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657937 s, 159 MB/s 2024-09-11T22:21:06.882 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.882 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.882 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640443 s, 164 MB/s 2024-09-11T22:21:06.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.891 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072262 s, 145 MB/s 2024-09-11T22:21:06.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.901 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730659 s, 144 MB/s 2024-09-11T22:21:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071834 s, 146 MB/s 2024-09-11T22:21:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711818 s, 147 MB/s 2024-09-11T22:21:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675973 s, 155 MB/s 2024-09-11T22:21:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757469 s, 138 MB/s 2024-09-11T22:21:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745673 s, 141 MB/s 2024-09-11T22:21:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.957 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690917 s, 152 MB/s 2024-09-11T22:21:06.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.966 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699211 s, 150 MB/s 2024-09-11T22:21:06.976 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.976 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.976 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768062 s, 137 MB/s 2024-09-11T22:21:06.985 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.985 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.985 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735491 s, 143 MB/s 2024-09-11T22:21:06.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:06.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:06.995 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767653 s, 137 MB/s 2024-09-11T22:21:07.004 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.004 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.004 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670592 s, 156 MB/s 2024-09-11T22:21:07.014 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.014 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.014 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775776 s, 135 MB/s 2024-09-11T22:21:07.023 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.024 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.024 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069467 s, 151 MB/s 2024-09-11T22:21:07.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.032 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691418 s, 152 MB/s 2024-09-11T22:21:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072915 s, 144 MB/s 2024-09-11T22:21:07.051 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.051 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.051 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690013 s, 152 MB/s 2024-09-11T22:21:07.060 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.060 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.061 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748008 s, 140 MB/s 2024-09-11T22:21:07.069 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.069 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.069 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668191 s, 157 MB/s 2024-09-11T22:21:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668946 s, 157 MB/s 2024-09-11T22:21:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:07.085 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:07.085 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:07.085 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.20 2024-09-11T22:21:07.085 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:07.085 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:07.085 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:07.085 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:07.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:07.144 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.145 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670912 s, 156 MB/s 2024-09-11T22:21:07.153 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.153 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.153 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678828 s, 154 MB/s 2024-09-11T22:21:07.162 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.162 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.162 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756474 s, 139 MB/s 2024-09-11T22:21:07.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.171 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744068 s, 141 MB/s 2024-09-11T22:21:07.180 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.180 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.180 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681577 s, 154 MB/s 2024-09-11T22:21:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.189 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667243 s, 157 MB/s 2024-09-11T22:21:07.198 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.198 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.198 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703298 s, 149 MB/s 2024-09-11T22:21:07.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.207 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670167 s, 156 MB/s 2024-09-11T22:21:07.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.215 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658481 s, 159 MB/s 2024-09-11T22:21:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728263 s, 144 MB/s 2024-09-11T22:21:07.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.232 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696097 s, 151 MB/s 2024-09-11T22:21:07.241 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.242 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748518 s, 140 MB/s 2024-09-11T22:21:07.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.250 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698765 s, 150 MB/s 2024-09-11T22:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755393 s, 139 MB/s 2024-09-11T22:21:07.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.268 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661697 s, 158 MB/s 2024-09-11T22:21:07.276 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.276 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.276 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714929 s, 147 MB/s 2024-09-11T22:21:07.284 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630398 s, 166 MB/s 2024-09-11T22:21:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630726 s, 166 MB/s 2024-09-11T22:21:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746691 s, 140 MB/s 2024-09-11T22:21:07.310 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.310 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.310 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748923 s, 140 MB/s 2024-09-11T22:21:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663287 s, 158 MB/s 2024-09-11T22:21:07.327 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.327 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.327 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710746 s, 148 MB/s 2024-09-11T22:21:07.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.336 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.336 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065392 s, 160 MB/s 2024-09-11T22:21:07.344 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.345 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.345 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724323 s, 145 MB/s 2024-09-11T22:21:07.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.353 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675971 s, 155 MB/s 2024-09-11T22:21:07.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.362 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744202 s, 141 MB/s 2024-09-11T22:21:07.370 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710222 s, 148 MB/s 2024-09-11T22:21:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761224 s, 138 MB/s 2024-09-11T22:21:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721943 s, 145 MB/s 2024-09-11T22:21:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728696 s, 144 MB/s 2024-09-11T22:21:07.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.406 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652973 s, 161 MB/s 2024-09-11T22:21:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755839 s, 139 MB/s 2024-09-11T22:21:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:07.422 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:07.422 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:07.422 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.21 2024-09-11T22:21:07.422 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:07.422 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:07.422 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:07.422 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660114 s, 159 MB/s 2024-09-11T22:21:07.490 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.491 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.491 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697916 s, 150 MB/s 2024-09-11T22:21:07.500 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.500 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.500 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725033 s, 145 MB/s 2024-09-11T22:21:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752384 s, 139 MB/s 2024-09-11T22:21:07.517 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.517 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.518 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689464 s, 152 MB/s 2024-09-11T22:21:07.526 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.527 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.527 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737891 s, 142 MB/s 2024-09-11T22:21:07.536 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.536 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.536 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742672 s, 141 MB/s 2024-09-11T22:21:07.543 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.544 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.544 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627073 s, 167 MB/s 2024-09-11T22:21:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664913 s, 158 MB/s 2024-09-11T22:21:07.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.562 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853157 s, 123 MB/s 2024-09-11T22:21:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066094 s, 159 MB/s 2024-09-11T22:21:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.580 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.580 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749332 s, 140 MB/s 2024-09-11T22:21:07.588 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739328 s, 142 MB/s 2024-09-11T22:21:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642761 s, 163 MB/s 2024-09-11T22:21:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718154 s, 146 MB/s 2024-09-11T22:21:07.616 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.616 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.616 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859111 s, 122 MB/s 2024-09-11T22:21:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.625 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070204 s, 149 MB/s 2024-09-11T22:21:07.634 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.634 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.634 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757371 s, 138 MB/s 2024-09-11T22:21:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755801 s, 139 MB/s 2024-09-11T22:21:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738606 s, 142 MB/s 2024-09-11T22:21:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694349 s, 151 MB/s 2024-09-11T22:21:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750378 s, 140 MB/s 2024-09-11T22:21:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629763 s, 167 MB/s 2024-09-11T22:21:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065346 s, 160 MB/s 2024-09-11T22:21:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691088 s, 152 MB/s 2024-09-11T22:21:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.703 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620532 s, 169 MB/s 2024-09-11T22:21:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.711 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.711 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630373 s, 166 MB/s 2024-09-11T22:21:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.720 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758762 s, 138 MB/s 2024-09-11T22:21:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622209 s, 169 MB/s 2024-09-11T22:21:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690124 s, 152 MB/s 2024-09-11T22:21:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743832 s, 141 MB/s 2024-09-11T22:21:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704851 s, 149 MB/s 2024-09-11T22:21:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:07.761 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:07.761 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:07.761 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.22 2024-09-11T22:21:07.761 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:07.761 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:07.761 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:07.761 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:07.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761238 s, 138 MB/s 2024-09-11T22:21:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676139 s, 155 MB/s 2024-09-11T22:21:07.840 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.840 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.840 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076638 s, 137 MB/s 2024-09-11T22:21:07.849 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.849 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.849 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756192 s, 139 MB/s 2024-09-11T22:21:07.858 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.858 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.858 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071456 s, 147 MB/s 2024-09-11T22:21:07.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.867 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711395 s, 147 MB/s 2024-09-11T22:21:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686506 s, 153 MB/s 2024-09-11T22:21:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707966 s, 148 MB/s 2024-09-11T22:21:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633945 s, 165 MB/s 2024-09-11T22:21:07.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070854 s, 148 MB/s 2024-09-11T22:21:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701576 s, 149 MB/s 2024-09-11T22:21:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751758 s, 139 MB/s 2024-09-11T22:21:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732895 s, 143 MB/s 2024-09-11T22:21:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653366 s, 160 MB/s 2024-09-11T22:21:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075973 s, 138 MB/s 2024-09-11T22:21:07.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.956 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744169 s, 141 MB/s 2024-09-11T22:21:07.965 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.965 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.965 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007425 s, 141 MB/s 2024-09-11T22:21:07.974 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.975 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.975 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729831 s, 144 MB/s 2024-09-11T22:21:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072524 s, 145 MB/s 2024-09-11T22:21:07.992 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:07.993 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:07.993 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739489 s, 142 MB/s 2024-09-11T22:21:08.001 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.001 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.001 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674549 s, 155 MB/s 2024-09-11T22:21:08.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.010 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658196 s, 159 MB/s 2024-09-11T22:21:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646666 s, 162 MB/s 2024-09-11T22:21:08.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.027 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727547 s, 144 MB/s 2024-09-11T22:21:08.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.037 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825481 s, 127 MB/s 2024-09-11T22:21:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675812 s, 155 MB/s 2024-09-11T22:21:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071648 s, 146 MB/s 2024-09-11T22:21:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650052 s, 161 MB/s 2024-09-11T22:21:08.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.073 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723861 s, 145 MB/s 2024-09-11T22:21:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703574 s, 149 MB/s 2024-09-11T22:21:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682609 s, 154 MB/s 2024-09-11T22:21:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705375 s, 149 MB/s 2024-09-11T22:21:08.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:08.106 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:08.106 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:08.107 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.23 2024-09-11T22:21:08.107 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:08.107 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:08.107 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:08.107 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:08.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:08.167 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.167 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.167 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718884 s, 146 MB/s 2024-09-11T22:21:08.176 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.177 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.177 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722509 s, 145 MB/s 2024-09-11T22:21:08.185 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.185 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.185 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066359 s, 158 MB/s 2024-09-11T22:21:08.194 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.194 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.194 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690226 s, 152 MB/s 2024-09-11T22:21:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670012 s, 157 MB/s 2024-09-11T22:21:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648312 s, 162 MB/s 2024-09-11T22:21:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737975 s, 142 MB/s 2024-09-11T22:21:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683747 s, 153 MB/s 2024-09-11T22:21:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718131 s, 146 MB/s 2024-09-11T22:21:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734354 s, 143 MB/s 2024-09-11T22:21:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679173 s, 154 MB/s 2024-09-11T22:21:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714334 s, 147 MB/s 2024-09-11T22:21:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733611 s, 143 MB/s 2024-09-11T22:21:08.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.285 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651871 s, 161 MB/s 2024-09-11T22:21:08.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.295 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846821 s, 124 MB/s 2024-09-11T22:21:08.305 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.305 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.305 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714025 s, 147 MB/s 2024-09-11T22:21:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730558 s, 144 MB/s 2024-09-11T22:21:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739414 s, 142 MB/s 2024-09-11T22:21:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688122 s, 152 MB/s 2024-09-11T22:21:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677224 s, 155 MB/s 2024-09-11T22:21:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711453 s, 147 MB/s 2024-09-11T22:21:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.358 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.359 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674366 s, 155 MB/s 2024-09-11T22:21:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742173 s, 141 MB/s 2024-09-11T22:21:08.376 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.376 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.377 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627288 s, 167 MB/s 2024-09-11T22:21:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.386 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.386 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741353 s, 141 MB/s 2024-09-11T22:21:08.396 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.396 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.396 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00815351 s, 129 MB/s 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675138 s, 155 MB/s 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.414 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667542 s, 157 MB/s 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619957 s, 169 MB/s 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.432 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828506 s, 127 MB/s 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.441 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692141 s, 151 MB/s 2024-09-11T22:21:08.452 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.452 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.452 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868658 s, 121 MB/s 2024-09-11T22:21:08.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:08.459 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:08.459 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:08.459 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.24 2024-09-11T22:21:08.459 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:08.459 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:08.459 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:08.459 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:08.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856653 s, 122 MB/s 2024-09-11T22:21:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681265 s, 154 MB/s 2024-09-11T22:21:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704684 s, 149 MB/s 2024-09-11T22:21:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723033 s, 145 MB/s 2024-09-11T22:21:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738001 s, 142 MB/s 2024-09-11T22:21:08.568 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.568 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.568 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716472 s, 146 MB/s 2024-09-11T22:21:08.576 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.576 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.576 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668279 s, 157 MB/s 2024-09-11T22:21:08.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.586 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771413 s, 136 MB/s 2024-09-11T22:21:08.595 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.595 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.595 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760545 s, 138 MB/s 2024-09-11T22:21:08.604 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.604 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.604 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733005 s, 143 MB/s 2024-09-11T22:21:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718101 s, 146 MB/s 2024-09-11T22:21:08.622 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.622 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.622 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076241 s, 138 MB/s 2024-09-11T22:21:08.631 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.631 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.631 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678883 s, 154 MB/s 2024-09-11T22:21:08.640 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.640 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.640 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734638 s, 143 MB/s 2024-09-11T22:21:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665653 s, 158 MB/s 2024-09-11T22:21:08.656 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.656 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.656 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644262 s, 163 MB/s 2024-09-11T22:21:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732399 s, 143 MB/s 2024-09-11T22:21:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616128 s, 170 MB/s 2024-09-11T22:21:08.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.681 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704486 s, 149 MB/s 2024-09-11T22:21:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729481 s, 144 MB/s 2024-09-11T22:21:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656987 s, 160 MB/s 2024-09-11T22:21:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651692 s, 161 MB/s 2024-09-11T22:21:08.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.715 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650672 s, 161 MB/s 2024-09-11T22:21:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709695 s, 148 MB/s 2024-09-11T22:21:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682315 s, 154 MB/s 2024-09-11T22:21:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842476 s, 124 MB/s 2024-09-11T22:21:08.752 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.752 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.752 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673897 s, 156 MB/s 2024-09-11T22:21:08.761 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.761 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.761 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674815 s, 155 MB/s 2024-09-11T22:21:08.770 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.770 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.770 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679129 s, 154 MB/s 2024-09-11T22:21:08.779 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.780 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.780 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743795 s, 141 MB/s 2024-09-11T22:21:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758342 s, 138 MB/s 2024-09-11T22:21:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745441 s, 141 MB/s 2024-09-11T22:21:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:08.805 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:08.806 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:08.806 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.25 2024-09-11T22:21:08.806 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:08.806 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:08.806 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:08.806 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738654 s, 142 MB/s 2024-09-11T22:21:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620373 s, 169 MB/s 2024-09-11T22:21:08.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.884 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065206 s, 161 MB/s 2024-09-11T22:21:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702437 s, 149 MB/s 2024-09-11T22:21:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.902 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679639 s, 154 MB/s 2024-09-11T22:21:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732979 s, 143 MB/s 2024-09-11T22:21:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680031 s, 154 MB/s 2024-09-11T22:21:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648249 s, 162 MB/s 2024-09-11T22:21:08.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.936 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.936 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731481 s, 143 MB/s 2024-09-11T22:21:08.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.945 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071838 s, 146 MB/s 2024-09-11T22:21:08.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.955 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.955 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780151 s, 134 MB/s 2024-09-11T22:21:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727265 s, 144 MB/s 2024-09-11T22:21:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696591 s, 151 MB/s 2024-09-11T22:21:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769648 s, 136 MB/s 2024-09-11T22:21:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649741 s, 161 MB/s 2024-09-11T22:21:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086391 s, 121 MB/s 2024-09-11T22:21:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694977 s, 151 MB/s 2024-09-11T22:21:09.018 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.019 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073051 s, 144 MB/s 2024-09-11T22:21:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693459 s, 151 MB/s 2024-09-11T22:21:09.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.037 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732843 s, 143 MB/s 2024-09-11T22:21:09.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.047 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750286 s, 140 MB/s 2024-09-11T22:21:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00834403 s, 126 MB/s 2024-09-11T22:21:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804808 s, 130 MB/s 2024-09-11T22:21:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672894 s, 156 MB/s 2024-09-11T22:21:09.084 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757587 s, 138 MB/s 2024-09-11T22:21:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712827 s, 147 MB/s 2024-09-11T22:21:09.102 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.103 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.103 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723157 s, 145 MB/s 2024-09-11T22:21:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705589 s, 149 MB/s 2024-09-11T22:21:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744549 s, 141 MB/s 2024-09-11T22:21:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668037 s, 157 MB/s 2024-09-11T22:21:09.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.138 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688589 s, 152 MB/s 2024-09-11T22:21:09.148 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.148 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.148 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718296 s, 146 MB/s 2024-09-11T22:21:09.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:09.154 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:09.154 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:09.154 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.26 2024-09-11T22:21:09.154 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:09.154 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:09.154 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:09.155 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:09.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719764 s, 146 MB/s 2024-09-11T22:21:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709263 s, 148 MB/s 2024-09-11T22:21:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705279 s, 149 MB/s 2024-09-11T22:21:09.367 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.367 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.367 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668138 s, 157 MB/s 2024-09-11T22:21:09.376 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.376 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.376 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753647 s, 139 MB/s 2024-09-11T22:21:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684518 s, 153 MB/s 2024-09-11T22:21:09.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.393 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656618 s, 160 MB/s 2024-09-11T22:21:09.400 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.400 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.401 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632806 s, 166 MB/s 2024-09-11T22:21:09.409 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.409 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.409 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719863 s, 146 MB/s 2024-09-11T22:21:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.418 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730188 s, 144 MB/s 2024-09-11T22:21:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727486 s, 144 MB/s 2024-09-11T22:21:09.436 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.436 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729973 s, 144 MB/s 2024-09-11T22:21:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.447 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859258 s, 122 MB/s 2024-09-11T22:21:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737595 s, 142 MB/s 2024-09-11T22:21:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714478 s, 147 MB/s 2024-09-11T22:21:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.474 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747267 s, 140 MB/s 2024-09-11T22:21:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067592 s, 155 MB/s 2024-09-11T22:21:09.491 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.491 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.491 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072655 s, 144 MB/s 2024-09-11T22:21:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844336 s, 124 MB/s 2024-09-11T22:21:09.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.510 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748163 s, 140 MB/s 2024-09-11T22:21:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.519 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071449 s, 147 MB/s 2024-09-11T22:21:09.528 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.528 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.528 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732738 s, 143 MB/s 2024-09-11T22:21:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727559 s, 144 MB/s 2024-09-11T22:21:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677798 s, 155 MB/s 2024-09-11T22:21:09.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.554 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705886 s, 149 MB/s 2024-09-11T22:21:09.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.563 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693371 s, 151 MB/s 2024-09-11T22:21:09.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.572 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724811 s, 145 MB/s 2024-09-11T22:21:09.581 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.581 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.581 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074518 s, 141 MB/s 2024-09-11T22:21:09.590 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.590 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.590 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741643 s, 141 MB/s 2024-09-11T22:21:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639892 s, 164 MB/s 2024-09-11T22:21:09.607 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.607 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.607 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703678 s, 149 MB/s 2024-09-11T22:21:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064567 s, 162 MB/s 2024-09-11T22:21:09.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:09.622 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:09.622 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:09.622 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.27 2024-09-11T22:21:09.622 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:09.622 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:09.622 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:09.622 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072746 s, 144 MB/s 2024-09-11T22:21:09.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.690 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622154 s, 169 MB/s 2024-09-11T22:21:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711572 s, 147 MB/s 2024-09-11T22:21:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642511 s, 163 MB/s 2024-09-11T22:21:09.716 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.716 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.716 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710072 s, 148 MB/s 2024-09-11T22:21:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664732 s, 158 MB/s 2024-09-11T22:21:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733022 s, 143 MB/s 2024-09-11T22:21:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741063 s, 141 MB/s 2024-09-11T22:21:09.752 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.752 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.752 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067816 s, 155 MB/s 2024-09-11T22:21:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074622 s, 141 MB/s 2024-09-11T22:21:09.770 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.770 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.771 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631568 s, 166 MB/s 2024-09-11T22:21:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721471 s, 145 MB/s 2024-09-11T22:21:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725128 s, 145 MB/s 2024-09-11T22:21:09.797 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.797 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.797 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687007 s, 153 MB/s 2024-09-11T22:21:09.805 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.805 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.805 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651055 s, 161 MB/s 2024-09-11T22:21:09.814 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.814 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.814 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689042 s, 152 MB/s 2024-09-11T22:21:09.822 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.822 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.822 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640119 s, 164 MB/s 2024-09-11T22:21:09.830 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.830 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.830 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662315 s, 158 MB/s 2024-09-11T22:21:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683005 s, 154 MB/s 2024-09-11T22:21:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707243 s, 148 MB/s 2024-09-11T22:21:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681246 s, 154 MB/s 2024-09-11T22:21:09.865 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.865 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.865 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731895 s, 143 MB/s 2024-09-11T22:21:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.874 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685058 s, 153 MB/s 2024-09-11T22:21:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706092 s, 149 MB/s 2024-09-11T22:21:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673918 s, 156 MB/s 2024-09-11T22:21:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753545 s, 139 MB/s 2024-09-11T22:21:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630289 s, 166 MB/s 2024-09-11T22:21:09.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.916 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661512 s, 159 MB/s 2024-09-11T22:21:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739752 s, 142 MB/s 2024-09-11T22:21:09.934 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.934 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.934 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720358 s, 146 MB/s 2024-09-11T22:21:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626525 s, 167 MB/s 2024-09-11T22:21:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00807323 s, 130 MB/s 2024-09-11T22:21:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:09.958 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:09.958 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:09.958 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.28 2024-09-11T22:21:09.958 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:09.958 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:09.959 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:09.959 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:10.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751117 s, 140 MB/s 2024-09-11T22:21:10.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.028 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695074 s, 151 MB/s 2024-09-11T22:21:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648337 s, 162 MB/s 2024-09-11T22:21:10.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.045 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714764 s, 147 MB/s 2024-09-11T22:21:10.054 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.054 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.054 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731657 s, 143 MB/s 2024-09-11T22:21:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656723 s, 160 MB/s 2024-09-11T22:21:10.070 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.070 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.070 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668348 s, 157 MB/s 2024-09-11T22:21:10.078 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.078 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.079 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691799 s, 152 MB/s 2024-09-11T22:21:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.087 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616304 s, 170 MB/s 2024-09-11T22:21:10.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.095 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064964 s, 161 MB/s 2024-09-11T22:21:10.103 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.103 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.103 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713366 s, 147 MB/s 2024-09-11T22:21:10.112 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.112 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.112 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687664 s, 152 MB/s 2024-09-11T22:21:10.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.120 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687808 s, 152 MB/s 2024-09-11T22:21:10.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.129 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746613 s, 140 MB/s 2024-09-11T22:21:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683693 s, 153 MB/s 2024-09-11T22:21:10.147 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.148 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.148 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752545 s, 139 MB/s 2024-09-11T22:21:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629912 s, 166 MB/s 2024-09-11T22:21:10.164 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.164 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.164 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672112 s, 156 MB/s 2024-09-11T22:21:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790197 s, 133 MB/s 2024-09-11T22:21:10.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.182 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.183 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735115 s, 143 MB/s 2024-09-11T22:21:10.192 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.192 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.192 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734075 s, 143 MB/s 2024-09-11T22:21:10.201 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.201 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.201 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074173 s, 141 MB/s 2024-09-11T22:21:10.210 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.210 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.210 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773668 s, 136 MB/s 2024-09-11T22:21:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759015 s, 138 MB/s 2024-09-11T22:21:10.228 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.229 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.229 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651802 s, 161 MB/s 2024-09-11T22:21:10.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.236 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067852 s, 155 MB/s 2024-09-11T22:21:10.245 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.245 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.245 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710546 s, 148 MB/s 2024-09-11T22:21:10.254 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.254 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.254 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716392 s, 146 MB/s 2024-09-11T22:21:10.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.262 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693596 s, 151 MB/s 2024-09-11T22:21:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747212 s, 140 MB/s 2024-09-11T22:21:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710694 s, 148 MB/s 2024-09-11T22:21:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.289 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638903 s, 164 MB/s 2024-09-11T22:21:10.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:10.295 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:10.295 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:10.296 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.29 2024-09-11T22:21:10.296 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:10.296 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:10.296 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:10.296 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:10.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:10.356 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.356 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.357 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760744 s, 138 MB/s 2024-09-11T22:21:10.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.366 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740796 s, 142 MB/s 2024-09-11T22:21:10.374 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.374 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.374 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730506 s, 144 MB/s 2024-09-11T22:21:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689117 s, 152 MB/s 2024-09-11T22:21:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680381 s, 154 MB/s 2024-09-11T22:21:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654207 s, 160 MB/s 2024-09-11T22:21:10.407 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.408 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.408 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616469 s, 170 MB/s 2024-09-11T22:21:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685953 s, 153 MB/s 2024-09-11T22:21:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710565 s, 148 MB/s 2024-09-11T22:21:10.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.433 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660778 s, 159 MB/s 2024-09-11T22:21:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744577 s, 141 MB/s 2024-09-11T22:21:10.451 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.451 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.451 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737549 s, 142 MB/s 2024-09-11T22:21:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809517 s, 130 MB/s 2024-09-11T22:21:10.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.469 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682978 s, 154 MB/s 2024-09-11T22:21:10.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.478 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694658 s, 151 MB/s 2024-09-11T22:21:10.487 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.487 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.487 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074312 s, 141 MB/s 2024-09-11T22:21:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725367 s, 145 MB/s 2024-09-11T22:21:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068685 s, 153 MB/s 2024-09-11T22:21:10.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.514 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725272 s, 145 MB/s 2024-09-11T22:21:10.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.523 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.523 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071398 s, 147 MB/s 2024-09-11T22:21:10.532 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.532 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.532 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730534 s, 144 MB/s 2024-09-11T22:21:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066199 s, 158 MB/s 2024-09-11T22:21:10.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.548 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677405 s, 155 MB/s 2024-09-11T22:21:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740226 s, 142 MB/s 2024-09-11T22:21:10.566 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.566 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.566 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729409 s, 144 MB/s 2024-09-11T22:21:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760377 s, 138 MB/s 2024-09-11T22:21:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848898 s, 124 MB/s 2024-09-11T22:21:10.595 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.595 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.596 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784097 s, 134 MB/s 2024-09-11T22:21:10.604 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.604 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.604 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632528 s, 166 MB/s 2024-09-11T22:21:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707976 s, 148 MB/s 2024-09-11T22:21:10.621 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.621 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.621 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681795 s, 154 MB/s 2024-09-11T22:21:10.630 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.630 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.630 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738824 s, 142 MB/s 2024-09-11T22:21:10.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:10.637 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:10.637 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:10.637 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.30 2024-09-11T22:21:10.637 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:10.637 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:10.637 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:10.637 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:10.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00815015 s, 129 MB/s 2024-09-11T22:21:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723226 s, 145 MB/s 2024-09-11T22:21:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715135 s, 147 MB/s 2024-09-11T22:21:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723608 s, 145 MB/s 2024-09-11T22:21:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.735 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703887 s, 149 MB/s 2024-09-11T22:21:10.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.742 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.742 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661654 s, 158 MB/s 2024-09-11T22:21:10.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.751 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728368 s, 144 MB/s 2024-09-11T22:21:10.759 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.759 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.759 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711092 s, 147 MB/s 2024-09-11T22:21:10.768 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.768 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.768 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072762 s, 144 MB/s 2024-09-11T22:21:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.777 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731888 s, 143 MB/s 2024-09-11T22:21:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.787 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760501 s, 138 MB/s 2024-09-11T22:21:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690591 s, 152 MB/s 2024-09-11T22:21:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649576 s, 161 MB/s 2024-09-11T22:21:10.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.812 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067116 s, 156 MB/s 2024-09-11T22:21:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635522 s, 165 MB/s 2024-09-11T22:21:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732944 s, 143 MB/s 2024-09-11T22:21:10.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.837 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676854 s, 155 MB/s 2024-09-11T22:21:10.845 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650177 s, 161 MB/s 2024-09-11T22:21:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658219 s, 159 MB/s 2024-09-11T22:21:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.862 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711178 s, 147 MB/s 2024-09-11T22:21:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065191 s, 161 MB/s 2024-09-11T22:21:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064866 s, 162 MB/s 2024-09-11T22:21:10.887 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.887 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.887 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686057 s, 153 MB/s 2024-09-11T22:21:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735671 s, 143 MB/s 2024-09-11T22:21:10.904 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.904 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.905 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668345 s, 157 MB/s 2024-09-11T22:21:10.913 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.913 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.913 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668982 s, 157 MB/s 2024-09-11T22:21:10.921 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.921 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.921 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070044 s, 150 MB/s 2024-09-11T22:21:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067389 s, 156 MB/s 2024-09-11T22:21:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735759 s, 143 MB/s 2024-09-11T22:21:10.947 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689513 s, 152 MB/s 2024-09-11T22:21:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066016 s, 159 MB/s 2024-09-11T22:21:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637334 s, 165 MB/s 2024-09-11T22:21:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:10.970 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:21:10.971 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:21:10.971 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.31 2024-09-11T22:21:10.971 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:21:10.971 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:21:10.971 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:21:10.971 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:21:11.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:21:11.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.032 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.032 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776458 s, 135 MB/s 2024-09-11T22:21:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.041 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067774 s, 155 MB/s 2024-09-11T22:21:11.048 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.048 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.049 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645372 s, 162 MB/s 2024-09-11T22:21:11.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.057 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.057 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680985 s, 154 MB/s 2024-09-11T22:21:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686609 s, 153 MB/s 2024-09-11T22:21:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743367 s, 141 MB/s 2024-09-11T22:21:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.084 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737108 s, 142 MB/s 2024-09-11T22:21:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686878 s, 153 MB/s 2024-09-11T22:21:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734998 s, 143 MB/s 2024-09-11T22:21:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.110 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641565 s, 163 MB/s 2024-09-11T22:21:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659116 s, 159 MB/s 2024-09-11T22:21:11.126 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.126 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.126 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739433 s, 142 MB/s 2024-09-11T22:21:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757812 s, 138 MB/s 2024-09-11T22:21:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.145 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736143 s, 142 MB/s 2024-09-11T22:21:11.154 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.154 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.154 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747964 s, 140 MB/s 2024-09-11T22:21:11.162 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.162 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.162 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068403 s, 153 MB/s 2024-09-11T22:21:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628374 s, 167 MB/s 2024-09-11T22:21:11.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.179 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734427 s, 143 MB/s 2024-09-11T22:21:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656326 s, 160 MB/s 2024-09-11T22:21:11.195 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.195 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.196 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669124 s, 157 MB/s 2024-09-11T22:21:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732103 s, 143 MB/s 2024-09-11T22:21:11.213 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.213 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.213 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653634 s, 160 MB/s 2024-09-11T22:21:11.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.221 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688762 s, 152 MB/s 2024-09-11T22:21:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709509 s, 148 MB/s 2024-09-11T22:21:11.238 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.239 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.239 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690603 s, 152 MB/s 2024-09-11T22:21:11.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.247 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667528 s, 157 MB/s 2024-09-11T22:21:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685611 s, 153 MB/s 2024-09-11T22:21:11.264 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.264 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.264 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662424 s, 158 MB/s 2024-09-11T22:21:11.273 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.273 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.273 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707472 s, 148 MB/s 2024-09-11T22:21:11.281 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.281 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.281 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697165 s, 150 MB/s 2024-09-11T22:21:11.291 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.291 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.291 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747896 s, 140 MB/s 2024-09-11T22:21:11.300 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:21:11.300 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:21:11.300 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736195 s, 142 MB/s 2024-09-11T22:21:11.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:11.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:21:11.307 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub start /scrub_control_test_path recursive 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.412+0000 7f55688f8640 1 Processor -- start 2024-09-11T22:21:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.412+0000 7f55688f8640 1 -- start start 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.413+0000 7f55688f8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f55640b3b70 0x7f556406d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.413+0000 7f55688f8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556406dc70 con 0x7f55640b5550 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.413+0000 7f55688f8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556406df50 con 0x7f55640afbb0 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.413+0000 7f55688f8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f55640b2610 con 0x7f55640b3b70 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.413+0000 7f556259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f55640b5550 0x7f55640b5930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34226/0 (socket says 172.21.15.50:34226) 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.413+0000 7f556259c640 1 -- 172.21.15.50:0/3108078910 learned_addr learned my addr 172.21.15.50:0/3108078910 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.413+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3377586603 0 0) 0x7f556406dc70 con 0x7f55640b5550 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.413+0000 7f5562d9d640 1 --2- 172.21.15.50:0/3108078910 >> v2:172.21.15.77:3300/0 conn(0x7f55640b3b70 0x7f556406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.413+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5550003520 con 0x7f55640b5550 2024-09-11T22:21:11.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 147781141 0 0) 0x7f5550003520 con 0x7f55640b5550 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 >> v2:172.21.15.77:3300/0 conn(0x7f55640b3b70 msgr2=0x7f556406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556159a640 1 --2- 172.21.15.50:0/3108078910 >> v2:172.21.15.77:3300/0 conn(0x7f55640b3b70 0x7f556406d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 >> v1:172.21.15.77:6789/0 conn(0x7f55640afbb0 legacy=0x7f5564166300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556406e230 con 0x7f55640b5550 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f555c0019f0 con 0x7f55640b5550 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 >> v1:172.21.15.50:6789/0 conn(0x7f55640b5550 legacy=0x7f55640b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556159a640 1 --2- 172.21.15.50:0/3108078910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55500039b0 0x7f5550003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556159a640 1 --2- 172.21.15.50:0/3108078910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5550004800 0x7f5550004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556159a640 1 --2- 172.21.15.50:0/3108078910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55500051c0 0x7f555000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f55640b2610 con 0x7f55500051c0 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f555000c060 con 0x7f5550004800 2024-09-11T22:21:11.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f555000c260 con 0x7f55500039b0 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f5561d9b640 1 --2- 172.21.15.50:0/3108078910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5550004800 0x7f5550004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f556259c640 1 --2- 172.21.15.50:0/3108078910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55500039b0 0x7f5550003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f5562d9d640 1 --2- 172.21.15.50:0/3108078910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55500051c0 0x7f555000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f5561d9b640 1 -- 172.21.15.50:0/3108078910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55500039b0 msgr2=0x7f5550003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f5561d9b640 1 --2- 172.21.15.50:0/3108078910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55500039b0 0x7f5550003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f5561d9b640 1 -- 172.21.15.50:0/3108078910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55500051c0 msgr2=0x7f555000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f5561d9b640 1 --2- 172.21.15.50:0/3108078910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55500051c0 0x7f555000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f5561d9b640 1 -- 172.21.15.50:0/3108078910 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5550003520 con 0x7f5550004800 2024-09-11T22:21:11.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.414+0000 7f5562d9d640 1 -- 172.21.15.50:0/3108078910 reap_dead start 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.415+0000 7f5561d9b640 1 --2- 172.21.15.50:0/3108078910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5550004800 0x7f5550004c80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f554c001750 tx=0x7f5550005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bec0322b7d4e3f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.415+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c001370 con 0x7f5550004800 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.415+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f554c0052d0 con 0x7f5550004800 2024-09-11T22:21:11.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.415+0000 7f556159a640 1 -- 172.21.15.50:0/3108078910 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c02abc0 con 0x7f5550004800 2024-09-11T22:21:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.416+0000 7f55688f8640 1 -- 172.21.15.50:0/3108078910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5550004800 msgr2=0x7f5550004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.416+0000 7f55688f8640 1 --2- 172.21.15.50:0/3108078910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5550004800 0x7f5550004c80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f554c001750 tx=0x7f5550005830 comp rx=0 tx=0).stop 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.416+0000 7f55688f8640 1 -- 172.21.15.50:0/3108078910 shutdown_connections 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.416+0000 7f55688f8640 1 --2- 172.21.15.50:0/3108078910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5550004800 0x7f5550004c80 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.416+0000 7f55688f8640 1 -- 172.21.15.50:0/3108078910 >> 172.21.15.50:0/3108078910 conn(0x7f55640b07e0 msgr2=0x7f55640b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.416+0000 7f55688f8640 1 -- 172.21.15.50:0/3108078910 shutdown_connections 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.416+0000 7f55688f8640 1 -- 172.21.15.50:0/3108078910 wait complete. 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.417+0000 7f55688f8640 1 Processor -- start 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.417+0000 7f55688f8640 1 -- start start 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f55688f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5550004800 0x7f5564150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f55688f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55640cfe00 0x7f55640cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f55688f8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d0280 0x7f55640cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f55688f8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f556406d570 con 0x7f55640d0280 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f55688f8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f556406e7f0 con 0x7f5550004800 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f55688f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f556406d6f0 con 0x7f55640cfe00 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f5562d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d0280 0x7f55640cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f5562d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d0280 0x7f55640cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54108/0 (socket says 172.21.15.50:54108) 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f5562d9d640 1 -- 172.21.15.50:0/1855550099 learned_addr learned my addr 172.21.15.50:0/1855550099 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f5561d9b640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55640cfe00 0x7f55640cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f556259c640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5550004800 0x7f5564150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f5562d9d640 1 -- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55640cfe00 msgr2=0x7f55640cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f5562d9d640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55640cfe00 0x7f55640cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f5562d9d640 1 -- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5550004800 msgr2=0x7f5564150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f5562d9d640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5550004800 0x7f5564150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f5562d9d640 1 -- 172.21.15.50:0/1855550099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55640ce1d0 con 0x7f55640d0280 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f5561d9b640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55640cfe00 0x7f55640cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.418+0000 7f556259c640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5550004800 0x7f5564150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.419+0000 7f5562d9d640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d0280 0x7f55640cd990 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f55640689f0 tx=0x7f5554011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.419+0000 7f555affd640 1 -- 172.21.15.50:0/1855550099 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554019020 con 0x7f55640d0280 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.419+0000 7f555affd640 1 -- 172.21.15.50:0/1855550099 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5554004030 con 0x7f55640d0280 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.419+0000 7f55688f8640 1 -- 172.21.15.50:0/1855550099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55640ce4b0 con 0x7f55640d0280 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.419+0000 7f555affd640 1 -- 172.21.15.50:0/1855550099 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554004420 con 0x7f55640d0280 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.419+0000 7f55688f8640 1 -- 172.21.15.50:0/1855550099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55640cea70 con 0x7f55640d0280 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.420+0000 7f555affd640 1 -- 172.21.15.50:0/1855550099 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f555401c020 con 0x7f55640d0280 2024-09-11T22:21:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.421+0000 7f555affd640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f554406be30 0x7f554406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.421+0000 7f555affd640 1 -- 172.21.15.50:0/1855550099 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f555408b1a0 con 0x7f55640d0280 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.421+0000 7f556259c640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f554406be30 0x7f554406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.422+0000 7f556b697740 1 Processor -- start 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.422+0000 7f556259c640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f554406be30 0x7f554406e2f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f555c004c20 tx=0x7f555c006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.422+0000 7f556b697740 1 -- start start 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.422+0000 7f556b697740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb6f7a70 0x55e5eb6f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.422+0000 7f556b697740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6de1f0 0x55e5eb6dca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.422+0000 7f556b697740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb728420 0x55e5eb728970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.422+0000 7f556b697740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e5eb645bc0 con 0x55e5eb6f7a70 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.422+0000 7f556b697740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e5eb5ed970 con 0x55e5eb6de1f0 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.422+0000 7f556b697740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e5eb641b80 con 0x55e5eb728420 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f556259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb6f7a70 0x55e5eb6f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f5562d9d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb728420 0x55e5eb728970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f5561d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6de1f0 0x55e5eb6dca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f556259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb6f7a70 0x55e5eb6f7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54118/0 (socket says 172.21.15.50:54118) 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f556259c640 1 -- 172.21.15.50:0/1295514406 learned_addr learned my addr 172.21.15.50:0/1295514406 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f5562d9d640 1 -- 172.21.15.50:0/1295514406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6de1f0 msgr2=0x55e5eb6dca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f5562d9d640 1 --2- 172.21.15.50:0/1295514406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6de1f0 0x55e5eb6dca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f5562d9d640 1 -- 172.21.15.50:0/1295514406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb6f7a70 msgr2=0x55e5eb6f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f5562d9d640 1 --2- 172.21.15.50:0/1295514406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb6f7a70 0x55e5eb6f7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f5562d9d640 1 -- 172.21.15.50:0/1295514406 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5eb424ba0 con 0x55e5eb728420 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f5562d9d640 1 --2- 172.21.15.50:0/1295514406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb728420 0x55e5eb728970 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5554089730 tx=0x7f5554059620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc14d123050d31d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f5543fff640 1 -- 172.21.15.50:0/1295514406 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55540577e0 con 0x55e5eb728420 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f5543fff640 1 -- 172.21.15.50:0/1295514406 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5554055b50 con 0x55e5eb728420 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.423+0000 7f5543fff640 1 -- 172.21.15.50:0/1295514406 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554061e30 con 0x55e5eb728420 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.424+0000 7f556b697740 1 -- 172.21.15.50:0/1295514406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb728420 msgr2=0x55e5eb728970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.424+0000 7f556b697740 1 --2- 172.21.15.50:0/1295514406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb728420 0x55e5eb728970 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5554089730 tx=0x7f5554059620 comp rx=0 tx=0).stop 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.424+0000 7f556b697740 1 -- 172.21.15.50:0/1295514406 shutdown_connections 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.424+0000 7f556b697740 1 --2- 172.21.15.50:0/1295514406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb728420 0x55e5eb728970 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.424+0000 7f556b697740 1 --2- 172.21.15.50:0/1295514406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6de1f0 0x55e5eb6dca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.424+0000 7f556b697740 1 --2- 172.21.15.50:0/1295514406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb6f7a70 0x55e5eb6f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.424+0000 7f556b697740 1 -- 172.21.15.50:0/1295514406 >> 172.21.15.50:0/1295514406 conn(0x55e5eb6dec20 msgr2=0x55e5eb726fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.424+0000 7f556b697740 1 -- 172.21.15.50:0/1295514406 shutdown_connections 2024-09-11T22:21:11.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.424+0000 7f556b697740 1 -- 172.21.15.50:0/1295514406 wait complete. 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.425+0000 7f556b697740 1 -- start start 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.425+0000 7f556b697740 1 Processor -- start 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f556b697740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6f7a70 0x55e5eb71f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f556b697740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb728420 0x55e5eb70bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f556b697740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 0x55e5eb7256c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f556b697740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e5eb6dd150 con 0x55e5eb725240 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f556b697740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e5eb600d70 con 0x55e5eb6f7a70 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f556b697740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e5eb6dd430 con 0x55e5eb728420 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f556b697740 10 client.0 _ll_register_callbacks cb 0x55e5eb357f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f5562d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 0x55e5eb7256c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f5562d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 0x55e5eb7256c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54124/0 (socket says 172.21.15.50:54124) 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f5562d9d640 1 -- 172.21.15.50:0/1856928759 learned_addr learned my addr 172.21.15.50:0/1856928759 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f5561d9b640 1 --2- 172.21.15.50:0/1856928759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb728420 0x55e5eb70bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f556259c640 1 --2- 172.21.15.50:0/1856928759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6f7a70 0x55e5eb71f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f5562d9d640 1 -- 172.21.15.50:0/1856928759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb728420 msgr2=0x55e5eb70bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f5562d9d640 1 --2- 172.21.15.50:0/1856928759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb728420 0x55e5eb70bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f5562d9d640 1 -- 172.21.15.50:0/1856928759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6f7a70 msgr2=0x55e5eb71f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f5562d9d640 1 --2- 172.21.15.50:0/1856928759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6f7a70 0x55e5eb71f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f5562d9d640 1 -- 172.21.15.50:0/1856928759 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5eb318490 con 0x55e5eb725240 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f5562d9d640 1 --2- 172.21.15.50:0/1856928759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 0x55e5eb7256c0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f555405d040 tx=0x7f5554006d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775d801fd9992bef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f55417fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f55417fa640 1 -- 172.21.15.50:0/1856928759 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554089300 con 0x55e5eb725240 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f55417fa640 1 -- 172.21.15.50:0/1856928759 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f5554086070 con 0x55e5eb725240 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f556b697740 1 -- 172.21.15.50:0/1856928759 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5554055b50 con 0x55e5eb725240 2024-09-11T22:21:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f55417fa640 1 -- 172.21.15.50:0/1856928759 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) ==== 24+0+0 (secure 0 0 0) 0x7f55540782b0 con 0x55e5eb725240 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f556b697740 10 client.9609 fetch_fsmap learned FSMap version 109 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.426+0000 7f556b697740 1 -- 172.21.15.50:0/1856928759 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) -- 0x55e5eb485330 con 0x55e5eb725240 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.427+0000 7f55417fa640 1 -- 172.21.15.50:0/1856928759 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5554055b50 con 0x55e5eb725240 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.427+0000 7f55417fa640 1 -- 172.21.15.50:0/1856928759 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 109) ==== 3502+0+0 (secure 0 0 0) 0x7f5554058930 con 0x55e5eb725240 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.427+0000 7f556b697740 10 client.9609 fetch_fsmap finished waiting for FSMap version 109 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.427+0000 7f556b697740 10 client.9609 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.427+0000 7f556b697740 20 client.9609 populate_metadata read hostname 'smithi050' 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.427+0000 7f556b697740 1 --2- 172.21.15.50:0/1856928759 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55e5eb73a910 0x55e5eb73ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.427+0000 7f556b697740 4 client.9609 mds_command: new command op to 9426 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.427+0000 7f556b697740 1 -- 172.21.15.50:0/1856928759 --> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5eb5cac80 con 0x55e5eb73a910 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.427+0000 7f556259c640 1 --2- 172.21.15.50:0/1856928759 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55e5eb73a910 0x55e5eb73ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.427+0000 7f55417fa640 10 client.9609 ms_handle_connect on v2:172.21.15.50:6833/3562809701 2024-09-11T22:21:11.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.427+0000 7f556259c640 1 --2- 172.21.15.50:0/1856928759 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55e5eb73a910 0x55e5eb73ad20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5320a127ba127e6 server_cookie=d2979243efac7c29 in_seq=0 out_seq=0 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f55417fa640 1 -- 172.21.15.50:0/1856928759 <== mds.0 v2:172.21.15.50:6833/3562809701 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5eb5cac80 con 0x55e5eb73a910 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f55417fa640 10 client.9609 handle_command_reply: tid=0 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f556b697740 1 client.9609 shutdown 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f556b697740 1 -- 172.21.15.50:0/1856928759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 msgr2=0x55e5eb7256c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f556b697740 1 --2- 172.21.15.50:0/1856928759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 0x55e5eb7256c0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f555405d040 tx=0x7f5554006d10 comp rx=0 tx=0).stop 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f556b697740 1 -- 172.21.15.50:0/1856928759 shutdown_connections 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f556b697740 1 --2- 172.21.15.50:0/1856928759 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55e5eb73a910 0x55e5eb73ad20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f556b697740 1 --2- 172.21.15.50:0/1856928759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb728420 0x55e5eb70bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f556b697740 1 --2- 172.21.15.50:0/1856928759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 0x55e5eb7256c0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f556b697740 1 --2- 172.21.15.50:0/1856928759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6f7a70 0x55e5eb71f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f55417fa640 0 client.9609 ms_handle_reset on v2:172.21.15.50:6833/3562809701 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f556b697740 1 -- 172.21.15.50:0/1856928759 >> 172.21.15.50:0/1856928759 conn(0x55e5eb6de1f0 msgr2=0x55e5eb726fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f556b697740 1 -- 172.21.15.50:0/1856928759 shutdown_connections 2024-09-11T22:21:11.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f556b697740 1 -- 172.21.15.50:0/1856928759 wait complete. 2024-09-11T22:21:11.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.428+0000 7f556b697740 20 client.9609 trim_cache size 0 max 16384 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.446+0000 7f556b697740 1 Processor -- start 2024-09-11T22:21:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.446+0000 7f556b697740 1 -- start start 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f556b697740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6f7a70 0x55e5eb6e2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f556b697740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb725240 0x55e5eb7498f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f556b697740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb728420 0x55e5eb70ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f556b697740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5564201550 con 0x55e5eb728420 2024-09-11T22:21:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f556b697740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5564200550 con 0x55e5eb6f7a70 2024-09-11T22:21:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f556b697740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5564160590 con 0x55e5eb725240 2024-09-11T22:21:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f5562d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb728420 0x55e5eb70ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f5562d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb728420 0x55e5eb70ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54138/0 (socket says 172.21.15.50:54138) 2024-09-11T22:21:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f5562d9d640 1 -- 172.21.15.50:0/1451624620 learned_addr learned my addr 172.21.15.50:0/1451624620 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f5562d9d640 1 -- 172.21.15.50:0/1451624620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb725240 msgr2=0x55e5eb7498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f5562d9d640 1 --2- 172.21.15.50:0/1451624620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb725240 0x55e5eb7498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f556259c640 1 --2- 172.21.15.50:0/1451624620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6f7a70 0x55e5eb6e2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f5562d9d640 1 -- 172.21.15.50:0/1451624620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6f7a70 msgr2=0x55e5eb6e2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f5562d9d640 1 --2- 172.21.15.50:0/1451624620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6f7a70 0x55e5eb6e2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f5562d9d640 1 -- 172.21.15.50:0/1451624620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5eb2f1550 con 0x55e5eb728420 2024-09-11T22:21:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.447+0000 7f5562d9d640 1 --2- 172.21.15.50:0/1451624620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb728420 0x55e5eb70ced0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f5554006da0 tx=0x7f5554086000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811b545f4e15506f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.448+0000 7f55437fe640 1 -- 172.21.15.50:0/1451624620 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554055780 con 0x55e5eb728420 2024-09-11T22:21:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.448+0000 7f55437fe640 1 -- 172.21.15.50:0/1451624620 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5554055b50 con 0x55e5eb728420 2024-09-11T22:21:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.448+0000 7f55437fe640 1 -- 172.21.15.50:0/1451624620 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554059be0 con 0x55e5eb728420 2024-09-11T22:21:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.448+0000 7f556b697740 1 -- 172.21.15.50:0/1451624620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb728420 msgr2=0x55e5eb70ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.448+0000 7f556b697740 1 --2- 172.21.15.50:0/1451624620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb728420 0x55e5eb70ced0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f5554006da0 tx=0x7f5554086000 comp rx=0 tx=0).stop 2024-09-11T22:21:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.448+0000 7f556b697740 1 -- 172.21.15.50:0/1451624620 shutdown_connections 2024-09-11T22:21:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.448+0000 7f556b697740 1 --2- 172.21.15.50:0/1451624620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb725240 0x55e5eb7498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.448+0000 7f556b697740 1 --2- 172.21.15.50:0/1451624620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb728420 0x55e5eb70ced0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.448+0000 7f556b697740 1 --2- 172.21.15.50:0/1451624620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb6f7a70 0x55e5eb6e2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.448+0000 7f556b697740 1 -- 172.21.15.50:0/1451624620 >> 172.21.15.50:0/1451624620 conn(0x55e5eb6de1f0 msgr2=0x55e5eb725d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.448+0000 7f556b697740 1 -- 172.21.15.50:0/1451624620 shutdown_connections 2024-09-11T22:21:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.448+0000 7f556b697740 1 -- 172.21.15.50:0/1451624620 wait complete. 2024-09-11T22:21:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.449+0000 7f556b697740 1 -- start start 2024-09-11T22:21:11.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.449+0000 7f556b697740 1 Processor -- start 2024-09-11T22:21:11.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f556b697740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb6f7a70 0x55e5eb72ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f556b697740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 0x55e5eb71cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f556b697740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb728420 0x55e5eb79b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f556b697740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f55641fff00 con 0x55e5eb725240 2024-09-11T22:21:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f556b697740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e5eb720040 con 0x55e5eb728420 2024-09-11T22:21:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f556b697740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e5eb721f80 con 0x55e5eb6f7a70 2024-09-11T22:21:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f556b697740 10 client.0 _ll_register_callbacks cb 0x7f5554070070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:21:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f5561d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 0x55e5eb71cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f5561d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 0x55e5eb71cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54152/0 (socket says 172.21.15.50:54152) 2024-09-11T22:21:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f5561d9b640 1 -- 172.21.15.50:0/2058552520 learned_addr learned my addr 172.21.15.50:0/2058552520 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f556259c640 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb6f7a70 0x55e5eb72ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f5562d9d640 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb728420 0x55e5eb79b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f5561d9b640 1 -- 172.21.15.50:0/2058552520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb6f7a70 msgr2=0x55e5eb72ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f5561d9b640 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb6f7a70 0x55e5eb72ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f5561d9b640 1 -- 172.21.15.50:0/2058552520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb728420 msgr2=0x55e5eb79b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f5561d9b640 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb728420 0x55e5eb79b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f5561d9b640 1 -- 172.21.15.50:0/2058552520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5eb739b30 con 0x55e5eb725240 2024-09-11T22:21:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f556259c640 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb6f7a70 0x55e5eb72ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f5561d9b640 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 0x55e5eb71cd00 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f554c02a570 tx=0x7f554c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c049f2656cce89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f55417fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:21:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f55417fa640 1 -- 172.21.15.50:0/2058552520 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c02a980 con 0x55e5eb725240 2024-09-11T22:21:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f55417fa640 1 -- 172.21.15.50:0/2058552520 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f554c02ab20 con 0x55e5eb725240 2024-09-11T22:21:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.450+0000 7f556b697740 1 -- 172.21.15.50:0/2058552520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5554055b50 con 0x55e5eb725240 2024-09-11T22:21:11.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f55417fa640 1 -- 172.21.15.50:0/2058552520 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) ==== 24+0+0 (secure 0 0 0) 0x7f554c04c050 con 0x55e5eb725240 2024-09-11T22:21:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f556b697740 10 client.9615 fetch_fsmap learned FSMap version 109 2024-09-11T22:21:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f556b697740 1 -- 172.21.15.50:0/2058552520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) -- 0x55e5eb721cc0 con 0x55e5eb725240 2024-09-11T22:21:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f55417fa640 1 -- 172.21.15.50:0/2058552520 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5554055b50 con 0x55e5eb725240 2024-09-11T22:21:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f55417fa640 1 -- 172.21.15.50:0/2058552520 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 109) ==== 3502+0+0 (secure 0 0 0) 0x7f554c04f020 con 0x55e5eb725240 2024-09-11T22:21:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f556b697740 10 client.9615 fetch_fsmap finished waiting for FSMap version 109 2024-09-11T22:21:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f556b697740 10 client.9615 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-11T22:21:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f556b697740 20 client.9615 populate_metadata read hostname 'smithi050' 2024-09-11T22:21:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f556b697740 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55e5eb7211f0 0x55e5eb7215d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f556b697740 4 client.9615 mds_command: new command op to 9426 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-11T22:21:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f556b697740 1 -- 172.21.15.50:0/2058552520 --> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55e5eb6532f0 con 0x55e5eb7211f0 2024-09-11T22:21:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f556259c640 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55e5eb7211f0 0x55e5eb7215d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f55417fa640 10 client.9615 ms_handle_connect on v2:172.21.15.50:6833/3562809701 2024-09-11T22:21:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.451+0000 7f556259c640 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55e5eb7211f0 0x55e5eb7215d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6530b4da2ca1850e server_cookie=2a12eaabd78e4687 in_seq=0 out_seq=0 2024-09-11T22:21:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f55417fa640 1 -- 172.21.15.50:0/2058552520 <== mds.0 v2:172.21.15.50:6833/3562809701 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e5eb6532f0 con 0x55e5eb7211f0 2024-09-11T22:21:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f55417fa640 10 client.9615 handle_command_reply: tid=0 2024-09-11T22:21:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f556b697740 1 client.9615 shutdown 2024-09-11T22:21:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f556b697740 1 -- 172.21.15.50:0/2058552520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 msgr2=0x55e5eb71cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f556b697740 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 0x55e5eb71cd00 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f554c02a570 tx=0x7f554c001120 comp rx=0 tx=0).stop 2024-09-11T22:21:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f556b697740 1 -- 172.21.15.50:0/2058552520 shutdown_connections 2024-09-11T22:21:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f556b697740 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55e5eb7211f0 0x55e5eb7215d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f556b697740 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5eb728420 0x55e5eb79b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f556b697740 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5eb725240 0x55e5eb71cd00 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f556b697740 1 --2- 172.21.15.50:0/2058552520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5eb6f7a70 0x55e5eb72ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f55417fa640 0 client.9615 ms_handle_reset on v2:172.21.15.50:6833/3562809701 2024-09-11T22:21:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f556b697740 1 -- 172.21.15.50:0/2058552520 >> 172.21.15.50:0/2058552520 conn(0x55e5eb6de1f0 msgr2=0x55e5eb6e3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f556b697740 1 -- 172.21.15.50:0/2058552520 shutdown_connections 2024-09-11T22:21:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f556b697740 1 -- 172.21.15.50:0/2058552520 wait complete. 2024-09-11T22:21:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.454+0000 7f556b697740 20 client.9615 trim_cache size 0 max 16384 2024-09-11T22:21:11.461 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:21:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:21:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "8624626e-8204-4760-b305-796b37769896", 2024-09-11T22:21:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:21:11.461 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:21:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.455+0000 7f55688f8640 1 -- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f554406be30 msgr2=0x7f554406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.455+0000 7f55688f8640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f554406be30 0x7f554406e2f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f555c004c20 tx=0x7f555c006040 comp rx=0 tx=0).stop 2024-09-11T22:21:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.455+0000 7f55688f8640 1 -- 172.21.15.50:0/1855550099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d0280 msgr2=0x7f55640cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.455+0000 7f55688f8640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d0280 0x7f55640cd990 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f55640689f0 tx=0x7f5554011cf0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.455+0000 7f55688f8640 1 -- 172.21.15.50:0/1855550099 shutdown_connections 2024-09-11T22:21:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.455+0000 7f55688f8640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f554406be30 0x7f554406e2f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.455+0000 7f55688f8640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55640cfe00 0x7f55640cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.455+0000 7f55688f8640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55640d0280 0x7f55640cd990 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.455+0000 7f55688f8640 1 --2- 172.21.15.50:0/1855550099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5550004800 0x7f5564150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.455+0000 7f55688f8640 1 -- 172.21.15.50:0/1855550099 >> 172.21.15.50:0/1855550099 conn(0x7f55640b07e0 msgr2=0x7f55640aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.455+0000 7f55688f8640 1 -- 172.21.15.50:0/1855550099 shutdown_connections 2024-09-11T22:21:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.455+0000 7f55688f8640 1 -- 172.21.15.50:0/1855550099 wait complete. 2024-09-11T22:21:11.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:21:11.470 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub pause 2024-09-11T22:21:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.599+0000 7f8a589d6640 1 Processor -- start 2024-09-11T22:21:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.600+0000 7f8a589d6640 1 -- start start 2024-09-11T22:21:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a589d6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a5406d780 0x7f8a54072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a589d6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a540b5020 con 0x7f8a5415bb00 2024-09-11T22:21:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a589d6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5415aeb0 con 0x7f8a5415aad0 2024-09-11T22:21:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a589d6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8a540714d0 con 0x7f8a5406d780 2024-09-11T22:21:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a52d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8a5415bb00 0x7f8a540b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34230/0 (socket says 172.21.15.50:34230) 2024-09-11T22:21:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a52d9d640 1 -- 172.21.15.50:0/1148145056 learned_addr learned my addr 172.21.15.50:0/1148145056 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a51d9b640 1 --2- 172.21.15.50:0/1148145056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a5406d780 0x7f8a54072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a5159a640 1 -- 172.21.15.50:0/1148145056 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1995663613 0 0) 0x7f8a540b5020 con 0x7f8a5415bb00 2024-09-11T22:21:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a5159a640 1 -- 172.21.15.50:0/1148145056 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a3c003520 con 0x7f8a5415bb00 2024-09-11T22:21:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a5159a640 1 -- 172.21.15.50:0/1148145056 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3857764328 0 0) 0x7f8a5415aeb0 con 0x7f8a5415aad0 2024-09-11T22:21:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a5159a640 1 -- 172.21.15.50:0/1148145056 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a540b5020 con 0x7f8a5415aad0 2024-09-11T22:21:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a51d9b640 1 -- 172.21.15.50:0/1148145056 >> v1:172.21.15.77:6789/0 conn(0x7f8a5415aad0 legacy=0x7f8a5406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a51d9b640 1 -- 172.21.15.50:0/1148145056 >> v1:172.21.15.50:6789/0 conn(0x7f8a5415bb00 legacy=0x7f8a540b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.601+0000 7f8a51d9b640 1 -- 172.21.15.50:0/1148145056 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a540717b0 con 0x7f8a5406d780 2024-09-11T22:21:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.602+0000 7f8a51d9b640 1 --2- 172.21.15.50:0/1148145056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a5406d780 0x7f8a54072cb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8a480097d0 tx=0x7f8a4802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=793a2ce0cfc9e0a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.602+0000 7f8a5159a640 1 -- 172.21.15.50:0/1148145056 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48037070 con 0x7f8a5406d780 2024-09-11T22:21:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.602+0000 7f8a5159a640 1 -- 172.21.15.50:0/1148145056 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a48032440 con 0x7f8a5406d780 2024-09-11T22:21:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.602+0000 7f8a5159a640 1 -- 172.21.15.50:0/1148145056 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a480327f0 con 0x7f8a5406d780 2024-09-11T22:21:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.603+0000 7f8a589d6640 1 -- 172.21.15.50:0/1148145056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a5406d780 msgr2=0x7f8a54072cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.603+0000 7f8a589d6640 1 --2- 172.21.15.50:0/1148145056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a5406d780 0x7f8a54072cb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8a480097d0 tx=0x7f8a4802a210 comp rx=0 tx=0).stop 2024-09-11T22:21:11.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.603+0000 7f8a589d6640 1 -- 172.21.15.50:0/1148145056 shutdown_connections 2024-09-11T22:21:11.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.603+0000 7f8a589d6640 1 --2- 172.21.15.50:0/1148145056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a5406d780 0x7f8a54072cb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.603+0000 7f8a589d6640 1 -- 172.21.15.50:0/1148145056 >> 172.21.15.50:0/1148145056 conn(0x7f8a540679c0 msgr2=0x7f8a54067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.603+0000 7f8a589d6640 1 -- 172.21.15.50:0/1148145056 shutdown_connections 2024-09-11T22:21:11.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.603+0000 7f8a589d6640 1 -- 172.21.15.50:0/1148145056 wait complete. 2024-09-11T22:21:11.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.604+0000 7f8a589d6640 1 Processor -- start 2024-09-11T22:21:11.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.604+0000 7f8a589d6640 1 -- start start 2024-09-11T22:21:11.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a589d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a5406d780 0x7f8a540c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a589d6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a5415aad0 0x7f8a540ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a589d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5415bb00 0x7f8a540cf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a589d6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a54072290 con 0x7f8a5415bb00 2024-09-11T22:21:11.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a589d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a54071d70 con 0x7f8a5406d780 2024-09-11T22:21:11.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a589d6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5415bf40 con 0x7f8a5415aad0 2024-09-11T22:21:11.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a52d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5415bb00 0x7f8a540cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a52d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5415bb00 0x7f8a540cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54162/0 (socket says 172.21.15.50:54162) 2024-09-11T22:21:11.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a52d9d640 1 -- 172.21.15.50:0/3123093692 learned_addr learned my addr 172.21.15.50:0/3123093692 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a51d9b640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a5415aad0 0x7f8a540ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a5259c640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a5406d780 0x7f8a540c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a52d9d640 1 -- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a5415aad0 msgr2=0x7f8a540ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a52d9d640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a5415aad0 0x7f8a540ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a52d9d640 1 -- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a5406d780 msgr2=0x7f8a540c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a52d9d640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a5406d780 0x7f8a540c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a52d9d640 1 -- 172.21.15.50:0/3123093692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a540c9510 con 0x7f8a5415bb00 2024-09-11T22:21:11.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.605+0000 7f8a5259c640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a5406d780 0x7f8a540c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:11.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.606+0000 7f8a52d9d640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5415bb00 0x7f8a540cf040 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00caf0 tx=0x7f8a4c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.606+0000 7f8a42ffd640 1 -- 172.21.15.50:0/3123093692 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c017070 con 0x7f8a5415bb00 2024-09-11T22:21:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.606+0000 7f8a42ffd640 1 -- 172.21.15.50:0/3123093692 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4c00aca0 con 0x7f8a5415bb00 2024-09-11T22:21:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.606+0000 7f8a589d6640 1 -- 172.21.15.50:0/3123093692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a540c97f0 con 0x7f8a5415bb00 2024-09-11T22:21:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.606+0000 7f8a42ffd640 1 -- 172.21.15.50:0/3123093692 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c012620 con 0x7f8a5415bb00 2024-09-11T22:21:11.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.606+0000 7f8a589d6640 1 -- 172.21.15.50:0/3123093692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a540c9db0 con 0x7f8a5415bb00 2024-09-11T22:21:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.608+0000 7f8a42ffd640 1 -- 172.21.15.50:0/3123093692 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a4c01a070 con 0x7f8a5415bb00 2024-09-11T22:21:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.608+0000 7f8a42ffd640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a3406be30 0x7f8a3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.608+0000 7f8a42ffd640 1 -- 172.21.15.50:0/3123093692 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f8a4c08ab50 con 0x7f8a5415bb00 2024-09-11T22:21:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.608+0000 7f8a5259c640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a3406be30 0x7f8a3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.609+0000 7f8a5259c640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a3406be30 0x7f8a3406e2f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8a44001710 tx=0x7f8a44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.609+0000 7f8a5b851740 1 Processor -- start 2024-09-11T22:21:11.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.609+0000 7f8a5b851740 1 -- start start 2024-09-11T22:21:11.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5b851740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce807e0 0x55895ce9e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5b851740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce80bc0 0x55895ce9d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5b851740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce9fdd0 0x55895cea02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5b851740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55895cdbc8d0 con 0x55895ce807e0 2024-09-11T22:21:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5b851740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55895cd64620 con 0x55895ce9fdd0 2024-09-11T22:21:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5b851740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55895cdb8890 con 0x55895ce80bc0 2024-09-11T22:21:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce807e0 0x55895ce9e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce807e0 0x55895ce9e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54164/0 (socket says 172.21.15.50:54164) 2024-09-11T22:21:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5259c640 1 -- 172.21.15.50:0/3803885365 learned_addr learned my addr 172.21.15.50:0/3803885365 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a51d9b640 1 --2- 172.21.15.50:0/3803885365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce80bc0 0x55895ce9d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a52d9d640 1 --2- 172.21.15.50:0/3803885365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce9fdd0 0x55895cea02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5259c640 1 -- 172.21.15.50:0/3803885365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce80bc0 msgr2=0x55895ce9d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5259c640 1 --2- 172.21.15.50:0/3803885365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce80bc0 0x55895ce9d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5259c640 1 -- 172.21.15.50:0/3803885365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce9fdd0 msgr2=0x55895cea02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5259c640 1 --2- 172.21.15.50:0/3803885365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce9fdd0 0x55895cea02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5259c640 1 -- 172.21.15.50:0/3803885365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55895cb997d0 con 0x55895ce807e0 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a5259c640 1 --2- 172.21.15.50:0/3803885365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce807e0 0x55895ce9e100 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f8a44005130 tx=0x7f8a44011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1336e222a3955ad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.610+0000 7f8a33fff640 1 -- 172.21.15.50:0/3803885365 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a440035f0 con 0x55895ce807e0 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.611+0000 7f8a33fff640 1 -- 172.21.15.50:0/3803885365 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44003790 con 0x55895ce807e0 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.611+0000 7f8a33fff640 1 -- 172.21.15.50:0/3803885365 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44003b40 con 0x55895ce807e0 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.611+0000 7f8a5b851740 1 -- 172.21.15.50:0/3803885365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce807e0 msgr2=0x55895ce9e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.611+0000 7f8a5b851740 1 --2- 172.21.15.50:0/3803885365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce807e0 0x55895ce9e100 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f8a44005130 tx=0x7f8a44011000 comp rx=0 tx=0).stop 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.611+0000 7f8a5b851740 1 -- 172.21.15.50:0/3803885365 shutdown_connections 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.611+0000 7f8a5b851740 1 --2- 172.21.15.50:0/3803885365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce80bc0 0x55895ce9d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.611+0000 7f8a5b851740 1 --2- 172.21.15.50:0/3803885365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce9fdd0 0x55895cea02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.611+0000 7f8a5b851740 1 --2- 172.21.15.50:0/3803885365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce807e0 0x55895ce9e100 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.611+0000 7f8a5b851740 1 -- 172.21.15.50:0/3803885365 >> 172.21.15.50:0/3803885365 conn(0x55895ce56240 msgr2=0x55895ce9e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.611+0000 7f8a5b851740 1 -- 172.21.15.50:0/3803885365 shutdown_connections 2024-09-11T22:21:11.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.611+0000 7f8a5b851740 1 -- 172.21.15.50:0/3803885365 wait complete. 2024-09-11T22:21:11.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.612+0000 7f8a5b851740 1 -- start start 2024-09-11T22:21:11.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.612+0000 7f8a5b851740 1 Processor -- start 2024-09-11T22:21:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5b851740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce80bc0 0x55895ce826d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5b851740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce9fdd0 0x55895ce7d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5b851740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce99390 0x55895ce99810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5b851740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55895ce9f7a0 con 0x55895ce80bc0 2024-09-11T22:21:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5b851740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55895cd45750 con 0x55895ce9fdd0 2024-09-11T22:21:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5b851740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55895ce9fa80 con 0x55895ce99390 2024-09-11T22:21:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5b851740 10 client.0 _ll_register_callbacks cb 0x55895cd69780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:21:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce80bc0 0x55895ce826d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce80bc0 0x55895ce826d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54176/0 (socket says 172.21.15.50:54176) 2024-09-11T22:21:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5259c640 1 -- 172.21.15.50:0/1698687841 learned_addr learned my addr 172.21.15.50:0/1698687841 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a52d9d640 1 --2- 172.21.15.50:0/1698687841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce99390 0x55895ce99810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a51d9b640 1 --2- 172.21.15.50:0/1698687841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce9fdd0 0x55895ce7d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5259c640 1 -- 172.21.15.50:0/1698687841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce99390 msgr2=0x55895ce99810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5259c640 1 --2- 172.21.15.50:0/1698687841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce99390 0x55895ce99810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5259c640 1 -- 172.21.15.50:0/1698687841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce9fdd0 msgr2=0x55895ce7d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5259c640 1 --2- 172.21.15.50:0/1698687841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce9fdd0 0x55895ce7d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5259c640 1 -- 172.21.15.50:0/1698687841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55895ca8f0f0 con 0x55895ce80bc0 2024-09-11T22:21:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a5259c640 1 --2- 172.21.15.50:0/1698687841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce80bc0 0x55895ce826d0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400ebb0 tx=0x7f8a44000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4798234b8c33693 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.613+0000 7f8a317fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:21:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a317fa640 1 -- 172.21.15.50:0/1698687841 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44026070 con 0x55895ce80bc0 2024-09-11T22:21:11.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a317fa640 1 -- 172.21.15.50:0/1698687841 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f8a44021860 con 0x55895ce80bc0 2024-09-11T22:21:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a5b851740 1 -- 172.21.15.50:0/1698687841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a44003790 con 0x55895ce80bc0 2024-09-11T22:21:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a317fa640 1 -- 172.21.15.50:0/1698687841 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) ==== 24+0+0 (secure 0 0 0) 0x7f8a44033050 con 0x55895ce80bc0 2024-09-11T22:21:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a5b851740 10 client.9627 fetch_fsmap learned FSMap version 109 2024-09-11T22:21:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a5b851740 1 -- 172.21.15.50:0/1698687841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) -- 0x55895cbf9f60 con 0x55895ce80bc0 2024-09-11T22:21:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a317fa640 1 -- 172.21.15.50:0/1698687841 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44003790 con 0x55895ce80bc0 2024-09-11T22:21:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a317fa640 1 -- 172.21.15.50:0/1698687841 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 109) ==== 3502+0+0 (secure 0 0 0) 0x7f8a44036020 con 0x55895ce80bc0 2024-09-11T22:21:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a5b851740 10 client.9627 fetch_fsmap finished waiting for FSMap version 109 2024-09-11T22:21:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a5b851740 10 client.9627 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-11T22:21:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a5b851740 20 client.9627 populate_metadata read hostname 'smithi050' 2024-09-11T22:21:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a5b851740 1 --2- 172.21.15.50:0/1698687841 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55895ce58ff0 0x55895ceb5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a5b851740 4 client.9627 mds_command: new command op to 9426 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:21:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a5b851740 1 -- 172.21.15.50:0/1698687841 --> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55895cdca000 con 0x55895ce58ff0 2024-09-11T22:21:11.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a51d9b640 1 --2- 172.21.15.50:0/1698687841 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55895ce58ff0 0x55895ceb5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a51d9b640 1 --2- 172.21.15.50:0/1698687841 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55895ce58ff0 0x55895ceb5fd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bed2a134f163060 server_cookie=75725e6a79618b00 in_seq=0 out_seq=0 2024-09-11T22:21:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.614+0000 7f8a317fa640 10 client.9627 ms_handle_connect on v2:172.21.15.50:6833/3562809701 2024-09-11T22:21:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a317fa640 1 -- 172.21.15.50:0/1698687841 <== mds.0 v2:172.21.15.50:6833/3562809701 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55895cdca000 con 0x55895ce58ff0 2024-09-11T22:21:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a317fa640 10 client.9627 handle_command_reply: tid=0 2024-09-11T22:21:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a5b851740 1 client.9627 shutdown 2024-09-11T22:21:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a5b851740 1 -- 172.21.15.50:0/1698687841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce80bc0 msgr2=0x55895ce826d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a5b851740 1 --2- 172.21.15.50:0/1698687841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce80bc0 0x55895ce826d0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400ebb0 tx=0x7f8a44000bc0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a5b851740 1 -- 172.21.15.50:0/1698687841 shutdown_connections 2024-09-11T22:21:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a5b851740 1 --2- 172.21.15.50:0/1698687841 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55895ce58ff0 0x55895ceb5fd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a5b851740 1 --2- 172.21.15.50:0/1698687841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce99390 0x55895ce99810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a5b851740 1 --2- 172.21.15.50:0/1698687841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce9fdd0 0x55895ce7d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a5b851740 1 --2- 172.21.15.50:0/1698687841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce80bc0 0x55895ce826d0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a317fa640 0 client.9627 ms_handle_reset on v2:172.21.15.50:6833/3562809701 2024-09-11T22:21:11.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a5b851740 1 -- 172.21.15.50:0/1698687841 >> 172.21.15.50:0/1698687841 conn(0x55895ce807e0 msgr2=0x55895ce9cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a5b851740 1 -- 172.21.15.50:0/1698687841 shutdown_connections 2024-09-11T22:21:11.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a5b851740 1 -- 172.21.15.50:0/1698687841 wait complete. 2024-09-11T22:21:11.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.615+0000 7f8a5b851740 20 client.9627 trim_cache size 0 max 16384 2024-09-11T22:21:11.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.633+0000 7f8a5b851740 1 Processor -- start 2024-09-11T22:21:11.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.633+0000 7f8a5b851740 1 -- start start 2024-09-11T22:21:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.633+0000 7f8a5b851740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 0x55895ce59de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.633+0000 7f8a5b851740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce807e0 0x55895cea01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.633+0000 7f8a5b851740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce80bc0 0x55895cea06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.633+0000 7f8a5b851740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5414b870 con 0x55895ce81310 2024-09-11T22:21:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.633+0000 7f8a5b851740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5416b7c0 con 0x55895ce80bc0 2024-09-11T22:21:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.633+0000 7f8a5b851740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5416ab20 con 0x55895ce807e0 2024-09-11T22:21:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a5259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 0x55895ce59de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a5259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 0x55895ce59de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54184/0 (socket says 172.21.15.50:54184) 2024-09-11T22:21:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a5259c640 1 -- 172.21.15.50:0/2353495694 learned_addr learned my addr 172.21.15.50:0/2353495694 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a52d9d640 1 --2- 172.21.15.50:0/2353495694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce80bc0 0x55895cea06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a51d9b640 1 --2- 172.21.15.50:0/2353495694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce807e0 0x55895cea01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a5259c640 1 -- 172.21.15.50:0/2353495694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce807e0 msgr2=0x55895cea01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a5259c640 1 --2- 172.21.15.50:0/2353495694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce807e0 0x55895cea01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a5259c640 1 -- 172.21.15.50:0/2353495694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce80bc0 msgr2=0x55895cea06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a5259c640 1 --2- 172.21.15.50:0/2353495694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce80bc0 0x55895cea06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a5259c640 1 -- 172.21.15.50:0/2353495694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55895ca681b0 con 0x55895ce81310 2024-09-11T22:21:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a5259c640 1 --2- 172.21.15.50:0/2353495694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 0x55895ce59de0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f8a440038a0 tx=0x7f8a44026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7283c6bc8902868 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a337fe640 1 -- 172.21.15.50:0/2353495694 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44021d80 con 0x55895ce81310 2024-09-11T22:21:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a337fe640 1 -- 172.21.15.50:0/2353495694 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44003e20 con 0x55895ce81310 2024-09-11T22:21:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.634+0000 7f8a337fe640 1 -- 172.21.15.50:0/2353495694 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a440218a0 con 0x55895ce81310 2024-09-11T22:21:11.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.635+0000 7f8a5b851740 1 -- 172.21.15.50:0/2353495694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 msgr2=0x55895ce59de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.635+0000 7f8a5b851740 1 --2- 172.21.15.50:0/2353495694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 0x55895ce59de0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f8a440038a0 tx=0x7f8a44026000 comp rx=0 tx=0).stop 2024-09-11T22:21:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.635+0000 7f8a5b851740 1 -- 172.21.15.50:0/2353495694 shutdown_connections 2024-09-11T22:21:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.635+0000 7f8a5b851740 1 --2- 172.21.15.50:0/2353495694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce807e0 0x55895cea01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.635+0000 7f8a5b851740 1 --2- 172.21.15.50:0/2353495694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce80bc0 0x55895cea06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.635+0000 7f8a5b851740 1 --2- 172.21.15.50:0/2353495694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 0x55895ce59de0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.635+0000 7f8a5b851740 1 -- 172.21.15.50:0/2353495694 >> 172.21.15.50:0/2353495694 conn(0x55895ce5b3d0 msgr2=0x55895cea1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.635+0000 7f8a5b851740 1 -- 172.21.15.50:0/2353495694 shutdown_connections 2024-09-11T22:21:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.635+0000 7f8a5b851740 1 -- 172.21.15.50:0/2353495694 wait complete. 2024-09-11T22:21:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.635+0000 7f8a5b851740 1 -- start start 2024-09-11T22:21:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.635+0000 7f8a5b851740 1 Processor -- start 2024-09-11T22:21:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.636+0000 7f8a5b851740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce807e0 0x55895cf09d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.636+0000 7f8a5b851740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce80bc0 0x55895ce7f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.636+0000 7f8a5b851740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 0x55895ce55000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.636+0000 7f8a5b851740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5416b170 con 0x55895ce81310 2024-09-11T22:21:11.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.636+0000 7f8a5b851740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55895cf21f00 con 0x55895ce807e0 2024-09-11T22:21:11.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.636+0000 7f8a5b851740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55895ce57900 con 0x55895ce80bc0 2024-09-11T22:21:11.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.636+0000 7f8a5b851740 10 client.0 _ll_register_callbacks cb 0x7f8a44001dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:21:11.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.636+0000 7f8a52d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 0x55895ce55000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.636+0000 7f8a5259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce807e0 0x55895cf09d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.636+0000 7f8a52d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 0x55895ce55000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54192/0 (socket says 172.21.15.50:54192) 2024-09-11T22:21:11.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.636+0000 7f8a52d9d640 1 -- 172.21.15.50:0/176586430 learned_addr learned my addr 172.21.15.50:0/176586430 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.636+0000 7f8a51d9b640 1 --2- 172.21.15.50:0/176586430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce80bc0 0x55895ce7f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a52d9d640 1 -- 172.21.15.50:0/176586430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce80bc0 msgr2=0x55895ce7f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a52d9d640 1 --2- 172.21.15.50:0/176586430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce80bc0 0x55895ce7f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a52d9d640 1 -- 172.21.15.50:0/176586430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce807e0 msgr2=0x55895cf09d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a52d9d640 1 --2- 172.21.15.50:0/176586430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce807e0 0x55895cf09d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a52d9d640 1 -- 172.21.15.50:0/176586430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55895cf0a2d0 con 0x55895ce81310 2024-09-11T22:21:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a52d9d640 1 --2- 172.21.15.50:0/176586430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 0x55895ce55000 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c055310 tx=0x7f8a4c061b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6520af91f54c262e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a317fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:21:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a317fa640 1 -- 172.21.15.50:0/176586430 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c004d60 con 0x55895ce81310 2024-09-11T22:21:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a317fa640 1 -- 172.21.15.50:0/176586430 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f8a4c058300 con 0x55895ce81310 2024-09-11T22:21:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a5b851740 1 -- 172.21.15.50:0/176586430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a44003e20 con 0x55895ce81310 2024-09-11T22:21:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a317fa640 1 -- 172.21.15.50:0/176586430 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) ==== 24+0+0 (secure 0 0 0) 0x7f8a4c058500 con 0x55895ce81310 2024-09-11T22:21:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a5b851740 10 client.9633 fetch_fsmap learned FSMap version 109 2024-09-11T22:21:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a5b851740 1 -- 172.21.15.50:0/176586430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) -- 0x55895cf21ca0 con 0x55895ce81310 2024-09-11T22:21:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a317fa640 1 -- 172.21.15.50:0/176586430 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44003e20 con 0x55895ce81310 2024-09-11T22:21:11.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a317fa640 1 -- 172.21.15.50:0/176586430 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 109) ==== 3502+0+0 (secure 0 0 0) 0x7f8a4c05f3b0 con 0x55895ce81310 2024-09-11T22:21:11.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a5b851740 10 client.9633 fetch_fsmap finished waiting for FSMap version 109 2024-09-11T22:21:11.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a5b851740 10 client.9633 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-11T22:21:11.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a5b851740 20 client.9633 populate_metadata read hostname 'smithi050' 2024-09-11T22:21:11.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a5b851740 1 --2- 172.21.15.50:0/176586430 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55895ce99390 0x55895ce55540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a5b851740 4 client.9633 mds_command: new command op to 9426 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-11T22:21:11.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.637+0000 7f8a5b851740 1 -- 172.21.15.50:0/176586430 --> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55895cdc4350 con 0x55895ce99390 2024-09-11T22:21:11.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a5259c640 1 --2- 172.21.15.50:0/176586430 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55895ce99390 0x55895ce55540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a317fa640 10 client.9633 ms_handle_connect on v2:172.21.15.50:6833/3562809701 2024-09-11T22:21:11.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a5259c640 1 --2- 172.21.15.50:0/176586430 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55895ce99390 0x55895ce55540 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50a9c52230f4bb2a server_cookie=1e0c9552200cc1d3 in_seq=0 out_seq=0 2024-09-11T22:21:11.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a317fa640 1 -- 172.21.15.50:0/176586430 <== mds.0 v2:172.21.15.50:6833/3562809701 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55895cdc4350 con 0x55895ce99390 2024-09-11T22:21:11.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a317fa640 10 client.9633 handle_command_reply: tid=0 2024-09-11T22:21:11.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a5b851740 1 client.9633 shutdown 2024-09-11T22:21:11.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a5b851740 1 -- 172.21.15.50:0/176586430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 msgr2=0x55895ce55000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a5b851740 1 --2- 172.21.15.50:0/176586430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 0x55895ce55000 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c055310 tx=0x7f8a4c061b20 comp rx=0 tx=0).stop 2024-09-11T22:21:11.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a5b851740 1 -- 172.21.15.50:0/176586430 shutdown_connections 2024-09-11T22:21:11.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a5b851740 1 --2- 172.21.15.50:0/176586430 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55895ce99390 0x55895ce55540 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a5b851740 1 --2- 172.21.15.50:0/176586430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55895ce80bc0 0x55895ce7f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a5b851740 1 --2- 172.21.15.50:0/176586430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55895ce81310 0x55895ce55000 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a5b851740 1 --2- 172.21.15.50:0/176586430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55895ce807e0 0x55895cf09d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a5b851740 1 -- 172.21.15.50:0/176586430 >> 172.21.15.50:0/176586430 conn(0x55895ce5b3d0 msgr2=0x55895cea01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a317fa640 0 client.9633 ms_handle_reset on v2:172.21.15.50:6833/3562809701 2024-09-11T22:21:11.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a5b851740 1 -- 172.21.15.50:0/176586430 shutdown_connections 2024-09-11T22:21:11.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.638+0000 7f8a5b851740 1 -- 172.21.15.50:0/176586430 wait complete. 2024-09-11T22:21:11.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.639+0000 7f8a5b851740 20 client.9633 trim_cache size 0 max 16384 2024-09-11T22:21:11.647 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:21:11.647 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2024-09-11T22:21:11.647 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0 2024-09-11T22:21:11.647 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:21:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.639+0000 7f8a589d6640 1 -- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a3406be30 msgr2=0x7f8a3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.639+0000 7f8a589d6640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a3406be30 0x7f8a3406e2f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8a44001710 tx=0x7f8a44009040 comp rx=0 tx=0).stop 2024-09-11T22:21:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.639+0000 7f8a589d6640 1 -- 172.21.15.50:0/3123093692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5415bb00 msgr2=0x7f8a540cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.639+0000 7f8a589d6640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5415bb00 0x7f8a540cf040 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00caf0 tx=0x7f8a4c00a060 comp rx=0 tx=0).stop 2024-09-11T22:21:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.639+0000 7f8a589d6640 1 -- 172.21.15.50:0/3123093692 shutdown_connections 2024-09-11T22:21:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.639+0000 7f8a589d6640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a3406be30 0x7f8a3406e2f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.639+0000 7f8a589d6640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a5415aad0 0x7f8a540ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.639+0000 7f8a589d6640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a5415bb00 0x7f8a540cf040 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.639+0000 7f8a589d6640 1 --2- 172.21.15.50:0/3123093692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a5406d780 0x7f8a540c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.639+0000 7f8a589d6640 1 -- 172.21.15.50:0/3123093692 >> 172.21.15.50:0/3123093692 conn(0x7f8a540679c0 msgr2=0x7f8a540cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.639+0000 7f8a589d6640 1 -- 172.21.15.50:0/3123093692 shutdown_connections 2024-09-11T22:21:11.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.639+0000 7f8a589d6640 1 -- 172.21.15.50:0/3123093692 wait complete. 2024-09-11T22:21:11.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:21:11.651 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub status 2024-09-11T22:21:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.753+0000 7f6a508af640 1 Processor -- start 2024-09-11T22:21:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.754+0000 7f6a508af640 1 -- start start 2024-09-11T22:21:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.754+0000 7f6a508af640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a4c0d18a0 0x7f6a4c0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a508af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a4c0d3a30 0x7f6a4c0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a508af640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a4c0cfa80 con 0x7f6a4c15e870 2024-09-11T22:21:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a508af640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6a4c0d3ea0 con 0x7f6a4c0d18a0 2024-09-11T22:21:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a508af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4c0d40d0 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a4ad9d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a4c0d3a30 0x7f6a4c0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a49d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a4c0d18a0 0x7f6a4c0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a4a59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6a4c15e870 0x7f6a4c0d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:59724/0 (socket says 172.21.15.50:59724) 2024-09-11T22:21:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a4a59c640 1 -- 172.21.15.50:0/4240991508 learned_addr learned my addr 172.21.15.50:0/4240991508 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a49d9b640 1 --2- 172.21.15.50:0/4240991508 >> v2:172.21.15.77:3300/0 conn(0x7f6a4c0d18a0 0x7f6a4c0d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:35392/0 (socket says 172.21.15.50:35392) 2024-09-11T22:21:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a4ad9d640 1 --2- 172.21.15.50:0/4240991508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a4c0d3a30 0x7f6a4c0b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:51288/0 (socket says 172.21.15.50:51288) 2024-09-11T22:21:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a4ad9d640 1 -- 172.21.15.50:0/4240991508 >> v2:172.21.15.77:3300/0 conn(0x7f6a4c0d18a0 msgr2=0x7f6a4c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a4959a640 1 -- 172.21.15.50:0/4240991508 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1962873213 0 0) 0x7f6a3c001490 con 0x7f6a4c15e870 2024-09-11T22:21:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a4ad9d640 1 --2- 172.21.15.50:0/4240991508 >> v2:172.21.15.77:3300/0 conn(0x7f6a4c0d18a0 0x7f6a4c0d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a4ad9d640 1 -- 172.21.15.50:0/4240991508 >> v1:172.21.15.77:6789/0 conn(0x7f6a4c15e870 legacy=0x7f6a4c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.755+0000 7f6a4ad9d640 1 -- 172.21.15.50:0/4240991508 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4c0d43b0 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.756+0000 7f6a4ad9d640 1 --2- 172.21.15.50:0/4240991508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a4c0d3a30 0x7f6a4c0b8400 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6a440097a0 tx=0x7f6a4402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=657c273eddfa03e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.756+0000 7f6a4959a640 1 -- 172.21.15.50:0/4240991508 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44037070 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.756+0000 7f6a4959a640 1 -- 172.21.15.50:0/4240991508 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44032440 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.756+0000 7f6a4959a640 1 -- 172.21.15.50:0/4240991508 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44032810 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.757+0000 7f6a508af640 1 -- 172.21.15.50:0/4240991508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a4c0d3a30 msgr2=0x7f6a4c0b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.757+0000 7f6a508af640 1 --2- 172.21.15.50:0/4240991508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a4c0d3a30 0x7f6a4c0b8400 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6a440097a0 tx=0x7f6a4402a180 comp rx=0 tx=0).stop 2024-09-11T22:21:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.757+0000 7f6a508af640 1 -- 172.21.15.50:0/4240991508 shutdown_connections 2024-09-11T22:21:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.757+0000 7f6a508af640 1 --2- 172.21.15.50:0/4240991508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a4c0d3a30 0x7f6a4c0b8400 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.757+0000 7f6a508af640 1 --2- 172.21.15.50:0/4240991508 >> v2:172.21.15.77:3300/0 conn(0x7f6a4c0d18a0 0x7f6a4c0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.757+0000 7f6a508af640 1 -- 172.21.15.50:0/4240991508 >> 172.21.15.50:0/4240991508 conn(0x7f6a4c0727a0 msgr2=0x7f6a4c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.757+0000 7f6a508af640 1 -- 172.21.15.50:0/4240991508 shutdown_connections 2024-09-11T22:21:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.757+0000 7f6a508af640 1 -- 172.21.15.50:0/4240991508 wait complete. 2024-09-11T22:21:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.758+0000 7f6a508af640 1 Processor -- start 2024-09-11T22:21:11.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.758+0000 7f6a508af640 1 -- start start 2024-09-11T22:21:11.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a508af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a4c0d18a0 0x7f6a4c0ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a508af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a4c0d3a30 0x7f6a4c0ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a508af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c15e870 0x7f6a4c151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a508af640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c15ec50 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a508af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c0b7ee0 con 0x7f6a4c15e870 2024-09-11T22:21:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a508af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4c0b78b0 con 0x7f6a4c0d18a0 2024-09-11T22:21:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a49d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a4c0d3a30 0x7f6a4c0ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a49d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a4c0d3a30 0x7f6a4c0ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54194/0 (socket says 172.21.15.50:54194) 2024-09-11T22:21:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a49d9b640 1 -- 172.21.15.50:0/3306056631 learned_addr learned my addr 172.21.15.50:0/3306056631 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a4a59c640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a4c0d18a0 0x7f6a4c0ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a4ad9d640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c15e870 0x7f6a4c151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a49d9b640 1 -- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a4c0d18a0 msgr2=0x7f6a4c0ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a49d9b640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a4c0d18a0 0x7f6a4c0ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a49d9b640 1 -- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c15e870 msgr2=0x7f6a4c151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a49d9b640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c15e870 0x7f6a4c151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a49d9b640 1 -- 172.21.15.50:0/3306056631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4c0ce1d0 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.759+0000 7f6a49d9b640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a4c0d3a30 0x7f6a4c0ab4d0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400e870 tx=0x7f6a3400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.760+0000 7f6a42ffd640 1 -- 172.21.15.50:0/3306056631 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34017070 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.760+0000 7f6a42ffd640 1 -- 172.21.15.50:0/3306056631 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3400c940 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.760+0000 7f6a42ffd640 1 -- 172.21.15.50:0/3306056631 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400cd30 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.760+0000 7f6a508af640 1 -- 172.21.15.50:0/3306056631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4c0ce4b0 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.760+0000 7f6a508af640 1 -- 172.21.15.50:0/3306056631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4c0ca930 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.761+0000 7f6a42ffd640 1 -- 172.21.15.50:0/3306056631 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a3401a070 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.762+0000 7f6a42ffd640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a2c06be30 0x7f6a2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.762+0000 7f6a42ffd640 1 -- 172.21.15.50:0/3306056631 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f6a3408aff0 con 0x7f6a4c0d3a30 2024-09-11T22:21:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.762+0000 7f6a4a59c640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a2c06be30 0x7f6a2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.762+0000 7f6a4a59c640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a2c06be30 0x7f6a2c06e2f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c001730 tx=0x7f6a3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.762+0000 7f6a53641740 1 Processor -- start 2024-09-11T22:21:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.763+0000 7f6a53641740 1 -- start start 2024-09-11T22:21:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.763+0000 7f6a53641740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d519920 0x55c79d55f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.763+0000 7f6a53641740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d5170e0 0x55c79d519d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.763+0000 7f6a53641740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d51b0b0 0x55c79d5141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.763+0000 7f6a53641740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c79d47c6f0 con 0x55c79d51b0b0 2024-09-11T22:21:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.763+0000 7f6a53641740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c79d424330 con 0x55c79d519920 2024-09-11T22:21:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.763+0000 7f6a53641740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c79d4786b0 con 0x55c79d5170e0 2024-09-11T22:21:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.763+0000 7f6a4ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d51b0b0 0x55c79d5141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.763+0000 7f6a4a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d519920 0x55c79d55f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.764+0000 7f6a49d9b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d5170e0 0x55c79d519d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.764+0000 7f6a4ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d51b0b0 0x55c79d5141a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54200/0 (socket says 172.21.15.50:54200) 2024-09-11T22:21:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.764+0000 7f6a4a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d519920 0x55c79d55f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:35412/0 (socket says 172.21.15.50:35412) 2024-09-11T22:21:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.764+0000 7f6a4ad9d640 1 -- 172.21.15.50:0/2135358427 learned_addr learned my addr 172.21.15.50:0/2135358427 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.764+0000 7f6a4ad9d640 1 -- 172.21.15.50:0/2135358427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d5170e0 msgr2=0x55c79d519d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.764+0000 7f6a4ad9d640 1 --2- 172.21.15.50:0/2135358427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d5170e0 0x55c79d519d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.764+0000 7f6a4ad9d640 1 -- 172.21.15.50:0/2135358427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d519920 msgr2=0x55c79d55f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.764+0000 7f6a4ad9d640 1 --2- 172.21.15.50:0/2135358427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d519920 0x55c79d55f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.764+0000 7f6a4ad9d640 1 -- 172.21.15.50:0/2135358427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c79d44a0d0 con 0x55c79d51b0b0 2024-09-11T22:21:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.764+0000 7f6a4ad9d640 1 --2- 172.21.15.50:0/2135358427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d51b0b0 0x55c79d5141a0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f6a440098c0 tx=0x7f6a4402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202a9ca51a7a5afd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.764+0000 7f6a2bfff640 1 -- 172.21.15.50:0/2135358427 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44037070 con 0x55c79d51b0b0 2024-09-11T22:21:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.764+0000 7f6a2bfff640 1 -- 172.21.15.50:0/2135358427 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44043070 con 0x55c79d51b0b0 2024-09-11T22:21:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.764+0000 7f6a2bfff640 1 -- 172.21.15.50:0/2135358427 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44004440 con 0x55c79d51b0b0 2024-09-11T22:21:11.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.765+0000 7f6a53641740 1 -- 172.21.15.50:0/2135358427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d51b0b0 msgr2=0x55c79d5141a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.765+0000 7f6a53641740 1 --2- 172.21.15.50:0/2135358427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d51b0b0 0x55c79d5141a0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f6a440098c0 tx=0x7f6a4402c000 comp rx=0 tx=0).stop 2024-09-11T22:21:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.765+0000 7f6a53641740 1 -- 172.21.15.50:0/2135358427 shutdown_connections 2024-09-11T22:21:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.765+0000 7f6a53641740 1 --2- 172.21.15.50:0/2135358427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d5170e0 0x55c79d519d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.765+0000 7f6a53641740 1 --2- 172.21.15.50:0/2135358427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d51b0b0 0x55c79d5141a0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.765+0000 7f6a53641740 1 --2- 172.21.15.50:0/2135358427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d519920 0x55c79d55f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.765+0000 7f6a53641740 1 -- 172.21.15.50:0/2135358427 >> 172.21.15.50:0/2135358427 conn(0x55c79d516370 msgr2=0x55c79d55e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.765+0000 7f6a53641740 1 -- 172.21.15.50:0/2135358427 shutdown_connections 2024-09-11T22:21:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.765+0000 7f6a53641740 1 -- 172.21.15.50:0/2135358427 wait complete. 2024-09-11T22:21:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.765+0000 7f6a53641740 1 -- start start 2024-09-11T22:21:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.766+0000 7f6a53641740 1 Processor -- start 2024-09-11T22:21:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.766+0000 7f6a53641740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 0x55c79d543fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.766+0000 7f6a53641740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d51b0b0 0x55c79d53a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.766+0000 7f6a53641740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d53c590 0x55c79d53cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.766+0000 7f6a53641740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c79d515810 con 0x55c79d519920 2024-09-11T22:21:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.766+0000 7f6a53641740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c79d4054f0 con 0x55c79d51b0b0 2024-09-11T22:21:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.766+0000 7f6a53641740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c79d55f8f0 con 0x55c79d53c590 2024-09-11T22:21:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.766+0000 7f6a53641740 10 client.0 _ll_register_callbacks cb 0x55c79d426b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:21:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a4a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 0x55c79d543fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a4a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 0x55c79d543fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54204/0 (socket says 172.21.15.50:54204) 2024-09-11T22:21:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a4a59c640 1 -- 172.21.15.50:0/1410338045 learned_addr learned my addr 172.21.15.50:0/1410338045 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a4ad9d640 1 --2- 172.21.15.50:0/1410338045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d53c590 0x55c79d53cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a49d9b640 1 --2- 172.21.15.50:0/1410338045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d51b0b0 0x55c79d53a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a4a59c640 1 -- 172.21.15.50:0/1410338045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d53c590 msgr2=0x55c79d53cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a4a59c640 1 --2- 172.21.15.50:0/1410338045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d53c590 0x55c79d53cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a4a59c640 1 -- 172.21.15.50:0/1410338045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d51b0b0 msgr2=0x55c79d53a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a4a59c640 1 --2- 172.21.15.50:0/1410338045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d51b0b0 0x55c79d53a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a4a59c640 1 -- 172.21.15.50:0/1410338045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c79d2597d0 con 0x55c79d519920 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a4a59c640 1 --2- 172.21.15.50:0/1410338045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 0x55c79d543fa0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0073b0 tx=0x7f6a3c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2341420295cf53b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a297fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a297fa640 1 -- 172.21.15.50:0/1410338045 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c027060 con 0x55c79d519920 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a297fa640 1 -- 172.21.15.50:0/1410338045 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f6a3c010040 con 0x55c79d519920 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a53641740 1 -- 172.21.15.50:0/1410338045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a44043070 con 0x55c79d519920 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a297fa640 1 -- 172.21.15.50:0/1410338045 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) ==== 24+0+0 (secure 0 0 0) 0x7f6a3c02d050 con 0x55c79d519920 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a53641740 10 client.9642 fetch_fsmap learned FSMap version 109 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.767+0000 7f6a53641740 1 -- 172.21.15.50:0/1410338045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) -- 0x55c79d18f3f0 con 0x55c79d519920 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.768+0000 7f6a297fa640 1 -- 172.21.15.50:0/1410338045 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44043070 con 0x55c79d519920 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.768+0000 7f6a297fa640 1 -- 172.21.15.50:0/1410338045 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 109) ==== 3502+0+0 (secure 0 0 0) 0x7f6a3c030020 con 0x55c79d519920 2024-09-11T22:21:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.768+0000 7f6a53641740 10 client.9642 fetch_fsmap finished waiting for FSMap version 109 2024-09-11T22:21:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.768+0000 7f6a53641740 10 client.9642 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-11T22:21:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.768+0000 7f6a53641740 20 client.9642 populate_metadata read hostname 'smithi050' 2024-09-11T22:21:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.768+0000 7f6a53641740 1 --2- 172.21.15.50:0/1410338045 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55c79d541300 0x55c79d541740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.768+0000 7f6a53641740 4 client.9642 mds_command: new command op to 9426 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:21:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.768+0000 7f6a53641740 1 -- 172.21.15.50:0/1410338045 --> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c79d489e20 con 0x55c79d541300 2024-09-11T22:21:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.768+0000 7f6a49d9b640 1 --2- 172.21.15.50:0/1410338045 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55c79d541300 0x55c79d541740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.768+0000 7f6a297fa640 10 client.9642 ms_handle_connect on v2:172.21.15.50:6833/3562809701 2024-09-11T22:21:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.768+0000 7f6a49d9b640 1 --2- 172.21.15.50:0/1410338045 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55c79d541300 0x55c79d541740 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ae49828bff25aaf server_cookie=e207e5e3e0ef983f in_seq=0 out_seq=0 2024-09-11T22:21:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a297fa640 1 -- 172.21.15.50:0/1410338045 <== mds.0 v2:172.21.15.50:6833/3562809701 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c79d489e20 con 0x55c79d541300 2024-09-11T22:21:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a297fa640 10 client.9642 handle_command_reply: tid=0 2024-09-11T22:21:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a53641740 1 client.9642 shutdown 2024-09-11T22:21:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a53641740 1 -- 172.21.15.50:0/1410338045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 msgr2=0x55c79d543fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a53641740 1 --2- 172.21.15.50:0/1410338045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 0x55c79d543fa0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0073b0 tx=0x7f6a3c001250 comp rx=0 tx=0).stop 2024-09-11T22:21:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a53641740 1 -- 172.21.15.50:0/1410338045 shutdown_connections 2024-09-11T22:21:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a53641740 1 --2- 172.21.15.50:0/1410338045 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55c79d541300 0x55c79d541740 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a53641740 1 --2- 172.21.15.50:0/1410338045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d53c590 0x55c79d53cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a53641740 1 --2- 172.21.15.50:0/1410338045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d51b0b0 0x55c79d53a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a297fa640 0 client.9642 ms_handle_reset on v2:172.21.15.50:6833/3562809701 2024-09-11T22:21:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a53641740 1 --2- 172.21.15.50:0/1410338045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 0x55c79d543fa0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a53641740 1 -- 172.21.15.50:0/1410338045 >> 172.21.15.50:0/1410338045 conn(0x55c79d5170e0 msgr2=0x55c79d55c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a53641740 1 -- 172.21.15.50:0/1410338045 shutdown_connections 2024-09-11T22:21:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a53641740 1 -- 172.21.15.50:0/1410338045 wait complete. 2024-09-11T22:21:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.769+0000 7f6a53641740 20 client.9642 trim_cache size 0 max 16384 2024-09-11T22:21:11.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.786+0000 7f6a53641740 1 Processor -- start 2024-09-11T22:21:11.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.786+0000 7f6a53641740 1 -- start start 2024-09-11T22:21:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a53641740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 0x55c79d5d5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a53641740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d51b0b0 0x55c79d55e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a53641740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d53c590 0x55c79d55ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a53641740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c200ed0 con 0x55c79d519920 2024-09-11T22:21:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a53641740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c1ffff0 con 0x55c79d53c590 2024-09-11T22:21:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a53641740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4c0cbac0 con 0x55c79d51b0b0 2024-09-11T22:21:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a4a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 0x55c79d5d5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a4a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 0x55c79d5d5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54214/0 (socket says 172.21.15.50:54214) 2024-09-11T22:21:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a4a59c640 1 -- 172.21.15.50:0/974158480 learned_addr learned my addr 172.21.15.50:0/974158480 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a4a59c640 1 -- 172.21.15.50:0/974158480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d51b0b0 msgr2=0x55c79d55e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a4a59c640 1 --2- 172.21.15.50:0/974158480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d51b0b0 0x55c79d55e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a4a59c640 1 -- 172.21.15.50:0/974158480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d53c590 msgr2=0x55c79d55ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a4a59c640 1 --2- 172.21.15.50:0/974158480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d53c590 0x55c79d55ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.787+0000 7f6a4a59c640 1 -- 172.21.15.50:0/974158480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c79d14f0f0 con 0x55c79d519920 2024-09-11T22:21:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.788+0000 7f6a4a59c640 1 --2- 172.21.15.50:0/974158480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 0x55c79d5d5fc0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00eed0 tx=0x7f6a3c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398f1c54dede6de9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.788+0000 7f6a2b7fe640 1 -- 172.21.15.50:0/974158480 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c036070 con 0x55c79d519920 2024-09-11T22:21:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.788+0000 7f6a2b7fe640 1 -- 172.21.15.50:0/974158480 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3c019070 con 0x55c79d519920 2024-09-11T22:21:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.788+0000 7f6a2b7fe640 1 -- 172.21.15.50:0/974158480 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c022450 con 0x55c79d519920 2024-09-11T22:21:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.788+0000 7f6a53641740 1 -- 172.21.15.50:0/974158480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 msgr2=0x55c79d5d5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.788+0000 7f6a53641740 1 --2- 172.21.15.50:0/974158480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 0x55c79d5d5fc0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00eed0 tx=0x7f6a3c01d000 comp rx=0 tx=0).stop 2024-09-11T22:21:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.788+0000 7f6a53641740 1 -- 172.21.15.50:0/974158480 shutdown_connections 2024-09-11T22:21:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.788+0000 7f6a53641740 1 --2- 172.21.15.50:0/974158480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d51b0b0 0x55c79d55e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.788+0000 7f6a53641740 1 --2- 172.21.15.50:0/974158480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d53c590 0x55c79d55ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.788+0000 7f6a53641740 1 --2- 172.21.15.50:0/974158480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d519920 0x55c79d5d5fc0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.788+0000 7f6a53641740 1 -- 172.21.15.50:0/974158480 >> 172.21.15.50:0/974158480 conn(0x55c79d5170e0 msgr2=0x55c79d55c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.788+0000 7f6a53641740 1 -- 172.21.15.50:0/974158480 shutdown_connections 2024-09-11T22:21:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.788+0000 7f6a53641740 1 -- 172.21.15.50:0/974158480 wait complete. 2024-09-11T22:21:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.789+0000 7f6a53641740 1 -- start start 2024-09-11T22:21:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.789+0000 7f6a53641740 1 Processor -- start 2024-09-11T22:21:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a53641740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d519920 0x55c79d5d4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a53641740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d51b0b0 0x55c79d5d51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a53641740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d53c590 0x55c79d55e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a53641740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c79d5424e0 con 0x55c79d53c590 2024-09-11T22:21:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a53641740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c0cc110 con 0x55c79d51b0b0 2024-09-11T22:21:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a53641740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c79d55f200 con 0x55c79d519920 2024-09-11T22:21:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a53641740 10 client.0 _ll_register_callbacks cb 0x7f6a3c00ed60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:21:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a4ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d53c590 0x55c79d55e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a4ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d53c590 0x55c79d55e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54222/0 (socket says 172.21.15.50:54222) 2024-09-11T22:21:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a4ad9d640 1 -- 172.21.15.50:0/1226104337 learned_addr learned my addr 172.21.15.50:0/1226104337 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a4a59c640 1 --2- 172.21.15.50:0/1226104337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d519920 0x55c79d5d4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a49d9b640 1 --2- 172.21.15.50:0/1226104337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d51b0b0 0x55c79d5d51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a4ad9d640 1 -- 172.21.15.50:0/1226104337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d519920 msgr2=0x55c79d5d4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a4ad9d640 1 --2- 172.21.15.50:0/1226104337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d519920 0x55c79d5d4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a4ad9d640 1 -- 172.21.15.50:0/1226104337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d51b0b0 msgr2=0x55c79d5d51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a4ad9d640 1 --2- 172.21.15.50:0/1226104337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d51b0b0 0x55c79d5d51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.790+0000 7f6a4ad9d640 1 -- 172.21.15.50:0/1226104337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c79d5d2d80 con 0x55c79d53c590 2024-09-11T22:21:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a4ad9d640 1 --2- 172.21.15.50:0/1226104337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d53c590 0x55c79d55e030 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f6a4402a770 tx=0x7f6a44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895537734e0438a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a297fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:21:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a297fa640 1 -- 172.21.15.50:0/1226104337 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4404b070 con 0x55c79d53c590 2024-09-11T22:21:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a297fa640 1 -- 172.21.15.50:0/1226104337 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f6a44005b90 con 0x55c79d53c590 2024-09-11T22:21:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a53641740 1 -- 172.21.15.50:0/1226104337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a3c019070 con 0x55c79d53c590 2024-09-11T22:21:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a297fa640 1 -- 172.21.15.50:0/1226104337 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) ==== 24+0+0 (secure 0 0 0) 0x7f6a44056050 con 0x55c79d53c590 2024-09-11T22:21:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a53641740 10 client.9648 fetch_fsmap learned FSMap version 109 2024-09-11T22:21:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a53641740 1 -- 172.21.15.50:0/1226104337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) -- 0x55c79d560c80 con 0x55c79d53c590 2024-09-11T22:21:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a297fa640 1 -- 172.21.15.50:0/1226104337 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3c019070 con 0x55c79d53c590 2024-09-11T22:21:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a297fa640 1 -- 172.21.15.50:0/1226104337 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 109) ==== 3502+0+0 (secure 0 0 0) 0x7f6a44059020 con 0x55c79d53c590 2024-09-11T22:21:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a53641740 10 client.9648 fetch_fsmap finished waiting for FSMap version 109 2024-09-11T22:21:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a53641740 10 client.9648 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-11T22:21:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a53641740 20 client.9648 populate_metadata read hostname 'smithi050' 2024-09-11T22:21:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a53641740 1 --2- 172.21.15.50:0/1226104337 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55c79d5d02f0 0x55c79d55e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a53641740 4 client.9648 mds_command: new command op to 9426 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:21:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a53641740 1 -- 172.21.15.50:0/1226104337 --> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c79d484170 con 0x55c79d5d02f0 2024-09-11T22:21:11.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.791+0000 7f6a4a59c640 1 --2- 172.21.15.50:0/1226104337 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55c79d5d02f0 0x55c79d55e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a297fa640 10 client.9648 ms_handle_connect on v2:172.21.15.50:6833/3562809701 2024-09-11T22:21:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a4a59c640 1 --2- 172.21.15.50:0/1226104337 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55c79d5d02f0 0x55c79d55e570 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fe48e46ece4967 server_cookie=cb83b36f38e70c54 in_seq=0 out_seq=0 2024-09-11T22:21:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a297fa640 1 -- 172.21.15.50:0/1226104337 <== mds.0 v2:172.21.15.50:6833/3562809701 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x55c79d484170 con 0x55c79d5d02f0 2024-09-11T22:21:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a297fa640 10 client.9648 handle_command_reply: tid=0 2024-09-11T22:21:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a53641740 1 client.9648 shutdown 2024-09-11T22:21:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a53641740 1 -- 172.21.15.50:0/1226104337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d53c590 msgr2=0x55c79d55e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a53641740 1 --2- 172.21.15.50:0/1226104337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d53c590 0x55c79d55e030 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f6a4402a770 tx=0x7f6a44004730 comp rx=0 tx=0).stop 2024-09-11T22:21:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a53641740 1 -- 172.21.15.50:0/1226104337 shutdown_connections 2024-09-11T22:21:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a53641740 1 --2- 172.21.15.50:0/1226104337 >> [v2:172.21.15.50:6833/3562809701,v1:172.21.15.50:6835/3562809701] conn(0x55c79d5d02f0 0x55c79d55e570 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a53641740 1 --2- 172.21.15.50:0/1226104337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c79d53c590 0x55c79d55e030 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a53641740 1 --2- 172.21.15.50:0/1226104337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c79d51b0b0 0x55c79d5d51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a53641740 1 --2- 172.21.15.50:0/1226104337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c79d519920 0x55c79d5d4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a297fa640 0 client.9648 ms_handle_reset on v2:172.21.15.50:6833/3562809701 2024-09-11T22:21:11.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a53641740 1 -- 172.21.15.50:0/1226104337 >> 172.21.15.50:0/1226104337 conn(0x55c79d5170e0 msgr2=0x55c79d542660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a53641740 1 -- 172.21.15.50:0/1226104337 shutdown_connections 2024-09-11T22:21:11.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a53641740 1 -- 172.21.15.50:0/1226104337 wait complete. 2024-09-11T22:21:11.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.792+0000 7f6a53641740 20 client.9648 trim_cache size 0 max 16384 2024-09-11T22:21:11.799 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:21:11.799 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-11T22:21:11.799 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-11T22:21:11.799 INFO:teuthology.orchestra.run.smithi050.stdout: "8624626e-8204-4760-b305-796b37769896": { 2024-09-11T22:21:11.799 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/scrub_control_test_path", 2024-09-11T22:21:11.799 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "8624626e-8204-4760-b305-796b37769896", 2024-09-11T22:21:11.800 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive" 2024-09-11T22:21:11.800 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:11.800 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:11.800 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:21:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.793+0000 7f6a508af640 1 -- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a2c06be30 msgr2=0x7f6a2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.793+0000 7f6a508af640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a2c06be30 0x7f6a2c06e2f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c001730 tx=0x7f6a3c009040 comp rx=0 tx=0).stop 2024-09-11T22:21:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.793+0000 7f6a508af640 1 -- 172.21.15.50:0/3306056631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a4c0d3a30 msgr2=0x7f6a4c0ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.793+0000 7f6a508af640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a4c0d3a30 0x7f6a4c0ab4d0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400e870 tx=0x7f6a3400ed30 comp rx=0 tx=0).stop 2024-09-11T22:21:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.793+0000 7f6a508af640 1 -- 172.21.15.50:0/3306056631 shutdown_connections 2024-09-11T22:21:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.793+0000 7f6a508af640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6a2c06be30 0x7f6a2c06e2f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.793+0000 7f6a508af640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c15e870 0x7f6a4c151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.793+0000 7f6a508af640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a4c0d3a30 0x7f6a4c0ab4d0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.793+0000 7f6a508af640 1 --2- 172.21.15.50:0/3306056631 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a4c0d18a0 0x7f6a4c0ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.793+0000 7f6a508af640 1 -- 172.21.15.50:0/3306056631 >> 172.21.15.50:0/3306056631 conn(0x7f6a4c0727a0 msgr2=0x7f6a4c0b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.793+0000 7f6a508af640 1 -- 172.21.15.50:0/3306056631 shutdown_connections 2024-09-11T22:21:11.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.793+0000 7f6a508af640 1 -- 172.21.15.50:0/3306056631 wait complete. 2024-09-11T22:21:11.804 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:11.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.905+0000 7fb03d342640 1 Processor -- start 2024-09-11T22:21:11.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.905+0000 7fb03d342640 1 -- start start 2024-09-11T22:21:11.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.905+0000 7fb03d342640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0380d05e0 0x7fb0380b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.905+0000 7fb03d342640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0380b4f00 con 0x7fb0380b3e10 2024-09-11T22:21:11.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.906+0000 7fb03d342640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0380b4360 con 0x7fb03815c2c0 2024-09-11T22:21:11.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.906+0000 7fb03d342640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb0380b51c0 con 0x7fb0380d05e0 2024-09-11T22:21:11.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.906+0000 7fb0377fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb0380b3e10 0x7fb0380ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34242/0 (socket says 172.21.15.50:34242) 2024-09-11T22:21:11.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.906+0000 7fb0377fe640 1 -- 172.21.15.50:0/1812639688 learned_addr learned my addr 172.21.15.50:0/1812639688 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:11.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.906+0000 7fb0367fc640 1 --2- 172.21.15.50:0/1812639688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0380d05e0 0x7fb0380b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.906+0000 7fb035ffb640 1 -- 172.21.15.50:0/1812639688 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172682494 0 0) 0x7fb0380b4f00 con 0x7fb0380b3e10 2024-09-11T22:21:11.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.906+0000 7fb035ffb640 1 -- 172.21.15.50:0/1812639688 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb020003520 con 0x7fb0380b3e10 2024-09-11T22:21:11.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.906+0000 7fb035ffb640 1 -- 172.21.15.50:0/1812639688 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1698055577 0 0) 0x7fb0380b4360 con 0x7fb03815c2c0 2024-09-11T22:21:11.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.906+0000 7fb035ffb640 1 -- 172.21.15.50:0/1812639688 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0380b4f00 con 0x7fb03815c2c0 2024-09-11T22:21:11.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.906+0000 7fb035ffb640 1 -- 172.21.15.50:0/1812639688 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3759038477 0 0) 0x7fb020003520 con 0x7fb0380b3e10 2024-09-11T22:21:11.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.906+0000 7fb0367fc640 1 -- 172.21.15.50:0/1812639688 >> v1:172.21.15.77:6789/0 conn(0x7fb03815c2c0 legacy=0x7fb0380cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.906+0000 7fb0367fc640 1 -- 172.21.15.50:0/1812639688 >> v1:172.21.15.50:6789/0 conn(0x7fb0380b3e10 legacy=0x7fb0380ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.906+0000 7fb0367fc640 1 -- 172.21.15.50:0/1812639688 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0380b54a0 con 0x7fb0380d05e0 2024-09-11T22:21:11.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.907+0000 7fb0367fc640 1 --2- 172.21.15.50:0/1812639688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0380d05e0 0x7fb0380b46a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0097d0 tx=0x7fb02c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc249b6a1e20410f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.907+0000 7fb035ffb640 1 -- 172.21.15.50:0/1812639688 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c037070 con 0x7fb0380d05e0 2024-09-11T22:21:11.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.907+0000 7fb035ffb640 1 -- 172.21.15.50:0/1812639688 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb02c02ac30 con 0x7fb0380d05e0 2024-09-11T22:21:11.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.907+0000 7fb035ffb640 1 -- 172.21.15.50:0/1812639688 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030001670 con 0x7fb0380d05e0 2024-09-11T22:21:11.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.908+0000 7fb03d342640 1 -- 172.21.15.50:0/1812639688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0380d05e0 msgr2=0x7fb0380b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.908+0000 7fb03d342640 1 --2- 172.21.15.50:0/1812639688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0380d05e0 0x7fb0380b46a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0097d0 tx=0x7fb02c02a1a0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.908+0000 7fb03d342640 1 -- 172.21.15.50:0/1812639688 shutdown_connections 2024-09-11T22:21:11.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.908+0000 7fb03d342640 1 --2- 172.21.15.50:0/1812639688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0380d05e0 0x7fb0380b46a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.908+0000 7fb03d342640 1 -- 172.21.15.50:0/1812639688 >> 172.21.15.50:0/1812639688 conn(0x7fb0380679c0 msgr2=0x7fb038067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.908+0000 7fb03d342640 1 -- 172.21.15.50:0/1812639688 shutdown_connections 2024-09-11T22:21:11.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.908+0000 7fb03d342640 1 -- 172.21.15.50:0/1812639688 wait complete. 2024-09-11T22:21:11.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.909+0000 7fb03d342640 1 Processor -- start 2024-09-11T22:21:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.909+0000 7fb03d342640 1 -- start start 2024-09-11T22:21:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb03d342640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0380b3e10 0x7fb0380b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb03d342640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0380d05e0 0x7fb038152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb03d342640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03815c2c0 0x7fb0380aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb03d342640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb03806d070 con 0x7fb03815c2c0 2024-09-11T22:21:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb03d342640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0380ce200 con 0x7fb0380b3e10 2024-09-11T22:21:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb03d342640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb03806d1f0 con 0x7fb0380d05e0 2024-09-11T22:21:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb0377fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03815c2c0 0x7fb0380aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb0377fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03815c2c0 0x7fb0380aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54236/0 (socket says 172.21.15.50:54236) 2024-09-11T22:21:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb0377fe640 1 -- 172.21.15.50:0/4120358167 learned_addr learned my addr 172.21.15.50:0/4120358167 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb0367fc640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0380d05e0 0x7fb038152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb036ffd640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0380b3e10 0x7fb0380b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb0377fe640 1 -- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0380d05e0 msgr2=0x7fb038152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb0377fe640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0380d05e0 0x7fb038152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb0377fe640 1 -- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0380b3e10 msgr2=0x7fb0380b0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb0377fe640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0380b3e10 0x7fb0380b0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb0377fe640 1 -- 172.21.15.50:0/4120358167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb038153690 con 0x7fb03815c2c0 2024-09-11T22:21:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb0367fc640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0380d05e0 0x7fb038152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.910+0000 7fb036ffd640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0380b3e10 0x7fb0380b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.911+0000 7fb0377fe640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03815c2c0 0x7fb0380aeb30 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fb03000c7b0 tx=0x7fb03000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.911+0000 7fb01f7fe640 1 -- 172.21.15.50:0/4120358167 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030017070 con 0x7fb03815c2c0 2024-09-11T22:21:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.911+0000 7fb01f7fe640 1 -- 172.21.15.50:0/4120358167 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb030005af0 con 0x7fb03815c2c0 2024-09-11T22:21:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.911+0000 7fb03d342640 1 -- 172.21.15.50:0/4120358167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb038153970 con 0x7fb03815c2c0 2024-09-11T22:21:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.911+0000 7fb01f7fe640 1 -- 172.21.15.50:0/4120358167 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030007070 con 0x7fb03815c2c0 2024-09-11T22:21:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.911+0000 7fb03d342640 1 -- 172.21.15.50:0/4120358167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb038153f30 con 0x7fb03815c2c0 2024-09-11T22:21:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.912+0000 7fb03d342640 1 -- 172.21.15.50:0/4120358167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb03815c6a0 con 0x7fb03815c2c0 2024-09-11T22:21:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.912+0000 7fb01f7fe640 1 -- 172.21.15.50:0/4120358167 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb03001a070 con 0x7fb03815c2c0 2024-09-11T22:21:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.913+0000 7fb01f7fe640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb02406be30 0x7fb02406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.913+0000 7fb01f7fe640 1 -- 172.21.15.50:0/4120358167 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7fb03008a4c0 con 0x7fb03815c2c0 2024-09-11T22:21:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.913+0000 7fb036ffd640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb02406be30 0x7fb02406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.913+0000 7fb036ffd640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb02406be30 0x7fb02406e2f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb028001d40 tx=0x7fb028009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:11.917+0000 7fb01f7fe640 1 -- 172.21.15.50:0/4120358167 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb030058d40 con 0x7fb03815c2c0 2024-09-11T22:21:12.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.127+0000 7fb03d342640 1 -- 172.21.15.50:0/4120358167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb03815a2c0 con 0x7fb03815c2c0 2024-09-11T22:21:12.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.128+0000 7fb01f7fe640 1 -- 172.21.15.50:0/4120358167 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5233 (secure 0 0 0) 0x7fb030058640 con 0x7fb03815c2c0 2024-09-11T22:21:12.128 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:12.129 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:20:50.638363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9426":{"gid":9426,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3562809701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3562809701},{"type":"v1","addr":"172.21.15.50:6835","nonce":3562809701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9426,"qdb_cluster":[9426]},"id":11}]} 2024-09-11T22:21:12.129 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 109 2024-09-11T22:21:12.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.129+0000 7fb03d342640 1 -- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb02406be30 msgr2=0x7fb02406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.129+0000 7fb03d342640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb02406be30 0x7fb02406e2f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb028001d40 tx=0x7fb028009040 comp rx=0 tx=0).stop 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.129+0000 7fb03d342640 1 -- 172.21.15.50:0/4120358167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03815c2c0 msgr2=0x7fb0380aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.129+0000 7fb03d342640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03815c2c0 0x7fb0380aeb30 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fb03000c7b0 tx=0x7fb03000cc70 comp rx=0 tx=0).stop 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.129+0000 7fb03d342640 1 -- 172.21.15.50:0/4120358167 shutdown_connections 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.129+0000 7fb03d342640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb02406be30 0x7fb02406e2f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.129+0000 7fb03d342640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0380d05e0 0x7fb038152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.129+0000 7fb03d342640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb03815c2c0 0x7fb0380aeb30 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.129+0000 7fb03d342640 1 --2- 172.21.15.50:0/4120358167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0380b3e10 0x7fb0380b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.129+0000 7fb03d342640 1 -- 172.21.15.50:0/4120358167 >> 172.21.15.50:0/4120358167 conn(0x7fb0380679c0 msgr2=0x7fb03815ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.130+0000 7fb03d342640 1 -- 172.21.15.50:0/4120358167 shutdown_connections 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.130+0000 7fb03d342640 1 -- 172.21.15.50:0/4120358167 wait complete. 2024-09-11T22:21:12.141 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-11T22:21:12.141 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:21:12.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.242+0000 7f091e677640 1 Processor -- start 2024-09-11T22:21:12.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.242+0000 7f091e677640 1 -- start start 2024-09-11T22:21:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.242+0000 7f091e677640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f091815e870 0x7f09180d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.242+0000 7f091e677640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09180d3c00 0x7f09180b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.242+0000 7f091e677640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09180cfa80 con 0x7f09180d16d0 2024-09-11T22:21:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.242+0000 7f091e677640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f09180d1b40 con 0x7f091815e870 2024-09-11T22:21:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.242+0000 7f091e677640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f09180d40d0 con 0x7f09180d3c00 2024-09-11T22:21:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.243+0000 7f0917fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f091815e870 0x7f09180d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.243+0000 7f0917fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f091815e870 0x7f09180d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54244/0 (socket says 172.21.15.50:54244) 2024-09-11T22:21:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.243+0000 7f0917fff640 1 -- 172.21.15.50:0/757278612 learned_addr learned my addr 172.21.15.50:0/757278612 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.243+0000 7f091cc14640 1 --2- 172.21.15.50:0/757278612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09180d3c00 0x7f09180b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.243+0000 7f0917fff640 1 -- 172.21.15.50:0/757278612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09180d3c00 msgr2=0x7f09180b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.243+0000 7f0917fff640 1 --2- 172.21.15.50:0/757278612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09180d3c00 0x7f09180b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.243+0000 7f0917fff640 1 -- 172.21.15.50:0/757278612 >> v1:172.21.15.77:6789/0 conn(0x7f09180d16d0 legacy=0x7f09180d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:12.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.243+0000 7f0917fff640 1 -- 172.21.15.50:0/757278612 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09180d43b0 con 0x7f091815e870 2024-09-11T22:21:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.244+0000 7f0917fff640 1 --2- 172.21.15.50:0/757278612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091815e870 0x7f09180d1190 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f09180d57c0 tx=0x7f090802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f259ba13f96802 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.244+0000 7f09177fe640 1 -- 172.21.15.50:0/757278612 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908037070 con 0x7f091815e870 2024-09-11T22:21:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.244+0000 7f09177fe640 1 -- 172.21.15.50:0/757278612 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0908032440 con 0x7f091815e870 2024-09-11T22:21:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.244+0000 7f09177fe640 1 -- 172.21.15.50:0/757278612 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908032810 con 0x7f091815e870 2024-09-11T22:21:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.244+0000 7f091e677640 1 -- 172.21.15.50:0/757278612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091815e870 msgr2=0x7f09180d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.244+0000 7f091e677640 1 --2- 172.21.15.50:0/757278612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091815e870 0x7f09180d1190 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f09180d57c0 tx=0x7f090802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.244+0000 7f091e677640 1 -- 172.21.15.50:0/757278612 shutdown_connections 2024-09-11T22:21:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.244+0000 7f091e677640 1 --2- 172.21.15.50:0/757278612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09180d3c00 0x7f09180b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.244+0000 7f091e677640 1 --2- 172.21.15.50:0/757278612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091815e870 0x7f09180d1190 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.244+0000 7f091e677640 1 -- 172.21.15.50:0/757278612 >> 172.21.15.50:0/757278612 conn(0x7f09180727a0 msgr2=0x7f09180679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.245+0000 7f091e677640 1 -- 172.21.15.50:0/757278612 shutdown_connections 2024-09-11T22:21:12.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.245+0000 7f091e677640 1 -- 172.21.15.50:0/757278612 wait complete. 2024-09-11T22:21:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.246+0000 7f091e677640 1 Processor -- start 2024-09-11T22:21:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.246+0000 7f091e677640 1 -- start start 2024-09-11T22:21:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.246+0000 7f091e677640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09180d16d0 0x7f0918157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.246+0000 7f091e677640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09180d3c00 0x7f09181f7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091e677640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091815e870 0x7f09181e6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091e677640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f091815ec50 con 0x7f091815e870 2024-09-11T22:21:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091e677640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f09180b7ee0 con 0x7f09180d16d0 2024-09-11T22:21:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091e677640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f09180b78b0 con 0x7f09180d3c00 2024-09-11T22:21:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091cc14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091815e870 0x7f09181e6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091cc14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091815e870 0x7f09181e6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54250/0 (socket says 172.21.15.50:54250) 2024-09-11T22:21:12.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091cc14640 1 -- 172.21.15.50:0/71281534 learned_addr learned my addr 172.21.15.50:0/71281534 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f0917fff640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09180d16d0 0x7f0918157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f090ffff640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09180d3c00 0x7f09181f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091cc14640 1 -- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09180d3c00 msgr2=0x7f09181f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091cc14640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09180d3c00 0x7f09181f7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091cc14640 1 -- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09180d16d0 msgr2=0x7f0918157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091cc14640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09180d16d0 0x7f0918157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091cc14640 1 -- 172.21.15.50:0/71281534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0918156d70 con 0x7f091815e870 2024-09-11T22:21:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091cc14640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091815e870 0x7f09181e6e30 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f0910007e30 tx=0x7f091000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f09157fa640 1 -- 172.21.15.50:0/71281534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0910014620 con 0x7f091815e870 2024-09-11T22:21:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f09157fa640 1 -- 172.21.15.50:0/71281534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0910019070 con 0x7f091815e870 2024-09-11T22:21:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f09157fa640 1 -- 172.21.15.50:0/71281534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0910014a00 con 0x7f091815e870 2024-09-11T22:21:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091e677640 1 -- 172.21.15.50:0/71281534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0918157050 con 0x7f091815e870 2024-09-11T22:21:12.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.247+0000 7f091e677640 1 -- 172.21.15.50:0/71281534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0918157610 con 0x7f091815e870 2024-09-11T22:21:12.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.248+0000 7f091e677640 1 -- 172.21.15.50:0/71281534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09180d1190 con 0x7f091815e870 2024-09-11T22:21:12.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.249+0000 7f09157fa640 1 -- 172.21.15.50:0/71281534 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0910014ba0 con 0x7f091815e870 2024-09-11T22:21:12.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.249+0000 7f09157fa640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08f806be30 0x7f08f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.250+0000 7f09157fa640 1 -- 172.21.15.50:0/71281534 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f091008b570 con 0x7f091815e870 2024-09-11T22:21:12.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.250+0000 7f0917fff640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08f806be30 0x7f08f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.250+0000 7f0917fff640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08f806be30 0x7f08f806e2f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0908034000 tx=0x7f090802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.254+0000 7f09157fa640 1 -- 172.21.15.50:0/71281534 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0910059960 con 0x7f091815e870 2024-09-11T22:21:12.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.500+0000 7f091e677640 1 -- 172.21.15.50:0/71281534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f091815d980 con 0x7f091815e870 2024-09-11T22:21:12.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.500+0000 7f09157fa640 1 -- 172.21.15.50:0/71281534 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7f091005dc60 con 0x7f091815e870 2024-09-11T22:21:12.501 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:12.501 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":621,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":156,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":902,"data_bytes":923053120,"bytes_used":2136281088,"bytes_avail":770957832192,"bytes_total":773094113280,"write_bytes_sec":76863583,"read_op_per_sec":0,"write_op_per_sec":75},"fsmap":{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9426}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-11T22:20:33.499640+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:21:12.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.502+0000 7f091e677640 1 -- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08f806be30 msgr2=0x7f08f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.502+0000 7f091e677640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08f806be30 0x7f08f806e2f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0908034000 tx=0x7f090802e000 comp rx=0 tx=0).stop 2024-09-11T22:21:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.502+0000 7f091e677640 1 -- 172.21.15.50:0/71281534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091815e870 msgr2=0x7f09181e6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.502+0000 7f091e677640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091815e870 0x7f09181e6e30 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f0910007e30 tx=0x7f091000e4b0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.502+0000 7f091e677640 1 -- 172.21.15.50:0/71281534 shutdown_connections 2024-09-11T22:21:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.502+0000 7f091e677640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f08f806be30 0x7f08f806e2f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.502+0000 7f091e677640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09180d3c00 0x7f09181f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.502+0000 7f091e677640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f091815e870 0x7f09181e6e30 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.502+0000 7f091e677640 1 --2- 172.21.15.50:0/71281534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09180d16d0 0x7f0918157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.503+0000 7f091e677640 1 -- 172.21.15.50:0/71281534 >> 172.21.15.50:0/71281534 conn(0x7f09180727a0 msgr2=0x7f09180d2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.503+0000 7f091e677640 1 -- 172.21.15.50:0/71281534 shutdown_connections 2024-09-11T22:21:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:12.503+0000 7f091e677640 1 -- 172.21.15.50:0/71281534 wait complete. 2024-09-11T22:21:12.514 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-11T22:21:13.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:13.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.631+0000 7f68f88ac640 1 Processor -- start 2024-09-11T22:21:13.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.631+0000 7f68f88ac640 1 -- start start 2024-09-11T22:21:13.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.632+0000 7f68f88ac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f68f4162a60 0x7f68f40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:13.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.632+0000 7f68f88ac640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f4163080 con 0x7f68f40d1c90 2024-09-11T22:21:13.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.632+0000 7f68f88ac640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f40d2d20 con 0x7f68f415e8e0 2024-09-11T22:21:13.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.632+0000 7f68f88ac640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f68f415ecc0 con 0x7f68f4162a60 2024-09-11T22:21:13.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.632+0000 7f68f2d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f68f4162a60 0x7f68f40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:13.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.632+0000 7f68f1d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f68f40d1c90 0x7f68f4162350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34244/0 (socket says 172.21.15.50:34244) 2024-09-11T22:21:13.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.632+0000 7f68f1d9b640 1 -- 172.21.15.50:0/288244377 learned_addr learned my addr 172.21.15.50:0/288244377 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.633+0000 7f68f2d9d640 1 -- 172.21.15.50:0/288244377 >> v1:172.21.15.77:6789/0 conn(0x7f68f415e8e0 legacy=0x7f68f40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.633+0000 7f68f2d9d640 1 -- 172.21.15.50:0/288244377 >> v1:172.21.15.50:6789/0 conn(0x7f68f40d1c90 legacy=0x7f68f4162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.633+0000 7f68f2d9d640 1 -- 172.21.15.50:0/288244377 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f40d3000 con 0x7f68f4162a60 2024-09-11T22:21:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.633+0000 7f68f159a640 1 -- 172.21.15.50:0/288244377 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433087379 0 0) 0x7f68f4163080 con 0x7f68f40d1c90 2024-09-11T22:21:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.633+0000 7f68f2d9d640 1 --2- 172.21.15.50:0/288244377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f4162a60 0x7f68f40b7880 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009d90 tx=0x7f68ec02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51afed74a35f609 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:13.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.634+0000 7f68f159a640 1 -- 172.21.15.50:0/288244377 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec007740 con 0x7f68f4162a60 2024-09-11T22:21:13.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.634+0000 7f68f159a640 1 -- 172.21.15.50:0/288244377 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ec0078e0 con 0x7f68f4162a60 2024-09-11T22:21:13.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.634+0000 7f68f159a640 1 -- 172.21.15.50:0/288244377 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec007cb0 con 0x7f68f4162a60 2024-09-11T22:21:13.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.634+0000 7f68f88ac640 1 -- 172.21.15.50:0/288244377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f4162a60 msgr2=0x7f68f40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:13.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.634+0000 7f68f88ac640 1 --2- 172.21.15.50:0/288244377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f4162a60 0x7f68f40b7880 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009d90 tx=0x7f68ec02a730 comp rx=0 tx=0).stop 2024-09-11T22:21:13.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.634+0000 7f68f88ac640 1 -- 172.21.15.50:0/288244377 shutdown_connections 2024-09-11T22:21:13.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.634+0000 7f68f88ac640 1 --2- 172.21.15.50:0/288244377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f4162a60 0x7f68f40b7880 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.634+0000 7f68f88ac640 1 -- 172.21.15.50:0/288244377 >> 172.21.15.50:0/288244377 conn(0x7f68f4067ba0 msgr2=0x7f68f4067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:13.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.634+0000 7f68f88ac640 1 -- 172.21.15.50:0/288244377 shutdown_connections 2024-09-11T22:21:13.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.634+0000 7f68f88ac640 1 -- 172.21.15.50:0/288244377 wait complete. 2024-09-11T22:21:13.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.636+0000 7f68f88ac640 1 Processor -- start 2024-09-11T22:21:13.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.636+0000 7f68f88ac640 1 -- start start 2024-09-11T22:21:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.636+0000 7f68f88ac640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68f40d1c90 0x7f68f41f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.636+0000 7f68f88ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f415e8e0 0x7f68f40b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.636+0000 7f68f88ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f4162a60 0x7f68f40abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.636+0000 7f68f88ac640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f68f40d3c10 con 0x7f68f4162a60 2024-09-11T22:21:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.636+0000 7f68f88ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f68f40d3a90 con 0x7f68f415e8e0 2024-09-11T22:21:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.636+0000 7f68f88ac640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f68f40d3d90 con 0x7f68f40d1c90 2024-09-11T22:21:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68f2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f4162a60 0x7f68f40abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68f2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f4162a60 0x7f68f40abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54270/0 (socket says 172.21.15.50:54270) 2024-09-11T22:21:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68f2d9d640 1 -- 172.21.15.50:0/3288060406 learned_addr learned my addr 172.21.15.50:0/3288060406 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68f259c640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68f40d1c90 0x7f68f41f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68f1d9b640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f415e8e0 0x7f68f40b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68f2d9d640 1 -- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68f40d1c90 msgr2=0x7f68f41f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68f2d9d640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68f40d1c90 0x7f68f41f4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68f2d9d640 1 -- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f415e8e0 msgr2=0x7f68f40b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68f2d9d640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f415e8e0 0x7f68f40b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68f2d9d640 1 -- 172.21.15.50:0/3288060406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f40cc7b0 con 0x7f68f4162a60 2024-09-11T22:21:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68f2d9d640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f4162a60 0x7f68f40abb10 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009eb0 tx=0x7f68ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68e2ffd640 1 -- 172.21.15.50:0/3288060406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec040070 con 0x7f68f4162a60 2024-09-11T22:21:13.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68e2ffd640 1 -- 172.21.15.50:0/3288060406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ec031c90 con 0x7f68f4162a60 2024-09-11T22:21:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68f88ac640 1 -- 172.21.15.50:0/3288060406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f40cd170 con 0x7f68f4162a60 2024-09-11T22:21:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68e2ffd640 1 -- 172.21.15.50:0/3288060406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec045680 con 0x7f68f4162a60 2024-09-11T22:21:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.637+0000 7f68f88ac640 1 -- 172.21.15.50:0/3288060406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f40cda10 con 0x7f68f4162a60 2024-09-11T22:21:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.638+0000 7f68f88ac640 1 -- 172.21.15.50:0/3288060406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f40cd340 con 0x7f68f4162a60 2024-09-11T22:21:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.639+0000 7f68e2ffd640 1 -- 172.21.15.50:0/3288060406 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f68ec039040 con 0x7f68f4162a60 2024-09-11T22:21:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.639+0000 7f68e2ffd640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f68d406be30 0x7f68d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.639+0000 7f68e2ffd640 1 -- 172.21.15.50:0/3288060406 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f68ec0ac6d0 con 0x7f68f4162a60 2024-09-11T22:21:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.640+0000 7f68f259c640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f68d406be30 0x7f68d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.640+0000 7f68f259c640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f68d406be30 0x7f68d406e2f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f68e4004f60 tx=0x7f68e4007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:13.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.644+0000 7f68e2ffd640 1 -- 172.21.15.50:0/3288060406 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f68ec07aaf0 con 0x7f68f4162a60 2024-09-11T22:21:13.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.853+0000 7f68f88ac640 1 -- 172.21.15.50:0/3288060406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68f40b7880 con 0x7f68f4162a60 2024-09-11T22:21:13.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.854+0000 7f68e2ffd640 1 -- 172.21.15.50:0/3288060406 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5233 (secure 0 0 0) 0x7f68ec07edf0 con 0x7f68f4162a60 2024-09-11T22:21:13.855 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:13.855 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:20:50.638363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9426":{"gid":9426,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3562809701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3562809701},{"type":"v1","addr":"172.21.15.50:6835","nonce":3562809701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9426,"qdb_cluster":[9426]},"id":11}]} 2024-09-11T22:21:13.855 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 109 2024-09-11T22:21:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.856+0000 7f68f88ac640 1 -- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f68d406be30 msgr2=0x7f68d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.856+0000 7f68f88ac640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f68d406be30 0x7f68d406e2f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f68e4004f60 tx=0x7f68e4007e30 comp rx=0 tx=0).stop 2024-09-11T22:21:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.856+0000 7f68f88ac640 1 -- 172.21.15.50:0/3288060406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f4162a60 msgr2=0x7f68f40abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.856+0000 7f68f88ac640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f4162a60 0x7f68f40abb10 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009eb0 tx=0x7f68ec004a40 comp rx=0 tx=0).stop 2024-09-11T22:21:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.856+0000 7f68f88ac640 1 -- 172.21.15.50:0/3288060406 shutdown_connections 2024-09-11T22:21:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.856+0000 7f68f88ac640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f68d406be30 0x7f68d406e2f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.856+0000 7f68f88ac640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68f4162a60 0x7f68f40abb10 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.856+0000 7f68f88ac640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f415e8e0 0x7f68f40b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.856+0000 7f68f88ac640 1 --2- 172.21.15.50:0/3288060406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68f40d1c90 0x7f68f41f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.856+0000 7f68f88ac640 1 -- 172.21.15.50:0/3288060406 >> 172.21.15.50:0/3288060406 conn(0x7f68f4067ba0 msgr2=0x7f68f4067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.856+0000 7f68f88ac640 1 -- 172.21.15.50:0/3288060406 shutdown_connections 2024-09-11T22:21:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.856+0000 7f68f88ac640 1 -- 172.21.15.50:0/3288060406 wait complete. 2024-09-11T22:21:13.867 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-11T22:21:13.867 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:21:13.940 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:21:13.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:21:13.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.968+0000 7fd18fc23640 1 Processor -- start 2024-09-11T22:21:13.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.968+0000 7fd18fc23640 1 -- start start 2024-09-11T22:21:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18fc23640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1880b3340 0x7fd188072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18fc23640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd18806ef00 0x7fd1880b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18fc23640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1880cec80 0x7fd1880679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18fc23640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd1880b3c60 con 0x7fd1880cec80 2024-09-11T22:21:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18fc23640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd188072e10 con 0x7fd18806ef00 2024-09-11T22:21:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18fc23640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd18806e140 con 0x7fd1880b3340 2024-09-11T22:21:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18e1c0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1880cec80 0x7fd1880679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18e1c0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1880cec80 0x7fd1880679c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54272/0 (socket says 172.21.15.50:54272) 2024-09-11T22:21:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18e1c0640 1 -- 172.21.15.50:0/2761816991 learned_addr learned my addr 172.21.15.50:0/2761816991 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18d1be640 1 --2- 172.21.15.50:0/2761816991 >> v2:172.21.15.77:3300/0 conn(0x7fd18806ef00 0x7fd1880b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18d9bf640 1 --2- 172.21.15.50:0/2761816991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1880b3340 0x7fd188072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18e1c0640 1 -- 172.21.15.50:0/2761816991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1880b3340 msgr2=0x7fd188072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18e1c0640 1 --2- 172.21.15.50:0/2761816991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1880b3340 0x7fd188072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18e1c0640 1 -- 172.21.15.50:0/2761816991 >> v2:172.21.15.77:3300/0 conn(0x7fd18806ef00 msgr2=0x7fd1880b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18e1c0640 1 --2- 172.21.15.50:0/2761816991 >> v2:172.21.15.77:3300/0 conn(0x7fd18806ef00 0x7fd1880b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18e1c0640 1 -- 172.21.15.50:0/2761816991 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18806e420 con 0x7fd1880cec80 2024-09-11T22:21:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18d1be640 1 --2- 172.21.15.50:0/2761816991 >> v2:172.21.15.77:3300/0 conn(0x7fd18806ef00 0x7fd1880b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:13.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.969+0000 7fd18d9bf640 1 --2- 172.21.15.50:0/2761816991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1880b3340 0x7fd188072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:13.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.970+0000 7fd18e1c0640 1 --2- 172.21.15.50:0/2761816991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880cec80 0x7fd1880679c0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fd1880b3f40 tx=0x7fd18002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07b818156fbc837 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:13.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.970+0000 7fd18c9bd640 1 -- 172.21.15.50:0/2761816991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180036070 con 0x7fd1880cec80 2024-09-11T22:21:13.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.970+0000 7fd18c9bd640 1 -- 172.21.15.50:0/2761816991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd180031600 con 0x7fd1880cec80 2024-09-11T22:21:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.970+0000 7fd18c9bd640 1 -- 172.21.15.50:0/2761816991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1800319d0 con 0x7fd1880cec80 2024-09-11T22:21:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.971+0000 7fd18fc23640 1 -- 172.21.15.50:0/2761816991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880cec80 msgr2=0x7fd1880679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.971+0000 7fd18fc23640 1 --2- 172.21.15.50:0/2761816991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880cec80 0x7fd1880679c0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fd1880b3f40 tx=0x7fd18002a6a0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.971+0000 7fd18fc23640 1 -- 172.21.15.50:0/2761816991 shutdown_connections 2024-09-11T22:21:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.971+0000 7fd18fc23640 1 --2- 172.21.15.50:0/2761816991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880cec80 0x7fd1880679c0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.971+0000 7fd18fc23640 1 --2- 172.21.15.50:0/2761816991 >> v2:172.21.15.77:3300/0 conn(0x7fd18806ef00 0x7fd1880b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.971+0000 7fd18fc23640 1 --2- 172.21.15.50:0/2761816991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1880b3340 0x7fd188072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.971+0000 7fd18fc23640 1 -- 172.21.15.50:0/2761816991 >> 172.21.15.50:0/2761816991 conn(0x7fd188074c40 msgr2=0x7fd188075020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.971+0000 7fd18fc23640 1 -- 172.21.15.50:0/2761816991 shutdown_connections 2024-09-11T22:21:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.971+0000 7fd18fc23640 1 -- 172.21.15.50:0/2761816991 wait complete. 2024-09-11T22:21:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.972+0000 7fd18fc23640 1 Processor -- start 2024-09-11T22:21:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.972+0000 7fd18fc23640 1 -- start start 2024-09-11T22:21:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18fc23640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd18806ef00 0x7fd18813d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18fc23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880b3340 0x7fd18815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18fc23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1880cec80 0x7fd1880afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18fc23640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1881462c0 con 0x7fd1880b3340 2024-09-11T22:21:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18fc23640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd18806e9e0 con 0x7fd1880cec80 2024-09-11T22:21:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18fc23640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1880cf110 con 0x7fd18806ef00 2024-09-11T22:21:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18d1be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880b3340 0x7fd18815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18d1be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880b3340 0x7fd18815bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54274/0 (socket says 172.21.15.50:54274) 2024-09-11T22:21:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18d1be640 1 -- 172.21.15.50:0/2007377760 learned_addr learned my addr 172.21.15.50:0/2007377760 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18e1c0640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1880cec80 0x7fd1880afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18d9bf640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd18806ef00 0x7fd18813d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18d1be640 1 -- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd18806ef00 msgr2=0x7fd18813d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18d1be640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd18806ef00 0x7fd18813d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18d1be640 1 -- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1880cec80 msgr2=0x7fd1880afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:13.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18d1be640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1880cec80 0x7fd1880afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:13.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18d1be640 1 -- 172.21.15.50:0/2007377760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1881f4690 con 0x7fd1880b3340 2024-09-11T22:21:13.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18d9bf640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd18806ef00 0x7fd18813d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:13.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.973+0000 7fd18d1be640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880b3340 0x7fd18815bd50 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fd17800e7e0 tx=0x7fd17800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:13.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.974+0000 7fd17e7fc640 1 -- 172.21.15.50:0/2007377760 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178017070 con 0x7fd1880b3340 2024-09-11T22:21:13.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.974+0000 7fd17e7fc640 1 -- 172.21.15.50:0/2007377760 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17800c6d0 con 0x7fd1880b3340 2024-09-11T22:21:13.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.974+0000 7fd17e7fc640 1 -- 172.21.15.50:0/2007377760 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17800f040 con 0x7fd1880b3340 2024-09-11T22:21:13.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.974+0000 7fd18fc23640 1 -- 172.21.15.50:0/2007377760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1881f4970 con 0x7fd1880b3340 2024-09-11T22:21:13.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.974+0000 7fd18fc23640 1 -- 172.21.15.50:0/2007377760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1881f4f30 con 0x7fd1880b3340 2024-09-11T22:21:13.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.975+0000 7fd18fc23640 1 -- 172.21.15.50:0/2007377760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd18806cb60 con 0x7fd1880b3340 2024-09-11T22:21:13.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.975+0000 7fd17e7fc640 1 -- 172.21.15.50:0/2007377760 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd17801a070 con 0x7fd1880b3340 2024-09-11T22:21:13.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.975+0000 7fd17e7fc640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd16c06be30 0x7fd16c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:13.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.976+0000 7fd17e7fc640 1 -- 172.21.15.50:0/2007377760 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7fd17808aa40 con 0x7fd1880b3340 2024-09-11T22:21:13.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.976+0000 7fd18d9bf640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd16c06be30 0x7fd16c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:13.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.976+0000 7fd18d9bf640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd16c06be30 0x7fd16c06e2f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd184006fd0 tx=0x7fd184008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:13.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:13.980+0000 7fd17e7fc640 1 -- 172.21.15.50:0/2007377760 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd178058d90 con 0x7fd1880b3340 2024-09-11T22:21:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.240+0000 7fd18fc23640 1 -- 172.21.15.50:0/2007377760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd1880b3720 con 0x7fd1880b3340 2024-09-11T22:21:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.240+0000 7fd17e7fc640 1 -- 172.21.15.50:0/2007377760 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7fd17805d090 con 0x7fd1880b3340 2024-09-11T22:21:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:14.241 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":623,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":156,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":916,"data_bytes":937733184,"bytes_used":2242142208,"bytes_avail":770851971072,"bytes_total":773094113280,"write_bytes_sec":76952616,"read_op_per_sec":0,"write_op_per_sec":75},"fsmap":{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9426}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-11T22:20:33.499640+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:21:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.242+0000 7fd18fc23640 1 -- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd16c06be30 msgr2=0x7fd16c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.242+0000 7fd18fc23640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd16c06be30 0x7fd16c06e2f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd184006fd0 tx=0x7fd184008040 comp rx=0 tx=0).stop 2024-09-11T22:21:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.242+0000 7fd18fc23640 1 -- 172.21.15.50:0/2007377760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880b3340 msgr2=0x7fd18815bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.242+0000 7fd18fc23640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880b3340 0x7fd18815bd50 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fd17800e7e0 tx=0x7fd17800eca0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.243+0000 7fd18fc23640 1 -- 172.21.15.50:0/2007377760 shutdown_connections 2024-09-11T22:21:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.243+0000 7fd18fc23640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd16c06be30 0x7fd16c06e2f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.243+0000 7fd18fc23640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1880cec80 0x7fd1880afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.243+0000 7fd18fc23640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880b3340 0x7fd18815bd50 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.243+0000 7fd18fc23640 1 --2- 172.21.15.50:0/2007377760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd18806ef00 0x7fd18813d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.243+0000 7fd18fc23640 1 -- 172.21.15.50:0/2007377760 >> 172.21.15.50:0/2007377760 conn(0x7fd188074c40 msgr2=0x7fd1880679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.243+0000 7fd18fc23640 1 -- 172.21.15.50:0/2007377760 shutdown_connections 2024-09-11T22:21:14.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:14.243+0000 7fd18fc23640 1 -- 172.21.15.50:0/2007377760 wait complete. 2024-09-11T22:21:14.254 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-11T22:21:15.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.370+0000 7fb4abbf6640 1 Processor -- start 2024-09-11T22:21:15.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.370+0000 7fb4abbf6640 1 -- start start 2024-09-11T22:21:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.371+0000 7fb4abbf6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4a40d05e0 0x7fb4a40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.371+0000 7fb4abbf6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4a40b3e10 0x7fb4a40ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.371+0000 7fb4abbf6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a40b4f00 con 0x7fb4a415c2c0 2024-09-11T22:21:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.371+0000 7fb4abbf6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb4a40b4360 con 0x7fb4a40d05e0 2024-09-11T22:21:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.371+0000 7fb4abbf6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb4a40b51c0 con 0x7fb4a40b3e10 2024-09-11T22:21:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.371+0000 7fb4a9191640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4a40d05e0 0x7fb4a40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.371+0000 7fb4a9191640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4a40d05e0 0x7fb4a40b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54280/0 (socket says 172.21.15.50:54280) 2024-09-11T22:21:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.371+0000 7fb4a9191640 1 -- 172.21.15.50:0/300297792 learned_addr learned my addr 172.21.15.50:0/300297792 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.371+0000 7fb4aa193640 1 --2- 172.21.15.50:0/300297792 >> v2:172.21.15.77:3300/0 conn(0x7fb4a40b3e10 0x7fb4a40ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.372+0000 7fb4a9191640 1 -- 172.21.15.50:0/300297792 >> v2:172.21.15.77:3300/0 conn(0x7fb4a40b3e10 msgr2=0x7fb4a40ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.372+0000 7fb4a9191640 1 --2- 172.21.15.50:0/300297792 >> v2:172.21.15.77:3300/0 conn(0x7fb4a40b3e10 0x7fb4a40ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.372+0000 7fb4a9191640 1 -- 172.21.15.50:0/300297792 >> v1:172.21.15.77:6789/0 conn(0x7fb4a415c2c0 legacy=0x7fb4a40cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.372+0000 7fb4a9191640 1 -- 172.21.15.50:0/300297792 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a40b54a0 con 0x7fb4a40d05e0 2024-09-11T22:21:15.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.372+0000 7fb4a9191640 1 --2- 172.21.15.50:0/300297792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40d05e0 0x7fb4a40b46a0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40b5780 tx=0x7fb49802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf2e35c9e911ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:15.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.373+0000 7fb4a8990640 1 -- 172.21.15.50:0/300297792 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498037070 con 0x7fb4a40d05e0 2024-09-11T22:21:15.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.373+0000 7fb4a8990640 1 -- 172.21.15.50:0/300297792 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb498032440 con 0x7fb4a40d05e0 2024-09-11T22:21:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.373+0000 7fb4a8990640 1 -- 172.21.15.50:0/300297792 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498032810 con 0x7fb4a40d05e0 2024-09-11T22:21:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.373+0000 7fb4abbf6640 1 -- 172.21.15.50:0/300297792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40d05e0 msgr2=0x7fb4a40b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.373+0000 7fb4abbf6640 1 --2- 172.21.15.50:0/300297792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40d05e0 0x7fb4a40b46a0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40b5780 tx=0x7fb49802a270 comp rx=0 tx=0).stop 2024-09-11T22:21:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.373+0000 7fb4abbf6640 1 -- 172.21.15.50:0/300297792 shutdown_connections 2024-09-11T22:21:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.373+0000 7fb4abbf6640 1 --2- 172.21.15.50:0/300297792 >> v2:172.21.15.77:3300/0 conn(0x7fb4a40b3e10 0x7fb4a40ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.373+0000 7fb4abbf6640 1 --2- 172.21.15.50:0/300297792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40d05e0 0x7fb4a40b46a0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.373+0000 7fb4abbf6640 1 -- 172.21.15.50:0/300297792 >> 172.21.15.50:0/300297792 conn(0x7fb4a40679c0 msgr2=0x7fb4a4067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.373+0000 7fb4abbf6640 1 -- 172.21.15.50:0/300297792 shutdown_connections 2024-09-11T22:21:15.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.373+0000 7fb4abbf6640 1 -- 172.21.15.50:0/300297792 wait complete. 2024-09-11T22:21:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.374+0000 7fb4abbf6640 1 Processor -- start 2024-09-11T22:21:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.375+0000 7fb4abbf6640 1 -- start start 2024-09-11T22:21:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.375+0000 7fb4abbf6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40b3e10 0x7fb4a41521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.375+0000 7fb4abbf6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4a40d05e0 0x7fb4a414ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.375+0000 7fb4abbf6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4a415c2c0 0x7fb4a41fb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.375+0000 7fb4abbf6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a406d070 con 0x7fb4a40b3e10 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.375+0000 7fb4abbf6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a40ce200 con 0x7fb4a415c2c0 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.375+0000 7fb4abbf6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a406d1f0 con 0x7fb4a40d05e0 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.375+0000 7fb4a9992640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40b3e10 0x7fb4a41521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.375+0000 7fb4a9992640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40b3e10 0x7fb4a41521b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54286/0 (socket says 172.21.15.50:54286) 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.375+0000 7fb4a9992640 1 -- 172.21.15.50:0/2840184241 learned_addr learned my addr 172.21.15.50:0/2840184241 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.375+0000 7fb4a9191640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4a40d05e0 0x7fb4a414ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.376+0000 7fb4aa193640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4a415c2c0 0x7fb4a41fb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.376+0000 7fb4a9992640 1 -- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4a40d05e0 msgr2=0x7fb4a414ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.376+0000 7fb4a9992640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4a40d05e0 0x7fb4a414ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.376+0000 7fb4a9992640 1 -- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4a415c2c0 msgr2=0x7fb4a41fb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.376+0000 7fb4a9992640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4a415c2c0 0x7fb4a41fb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.376+0000 7fb4a9992640 1 -- 172.21.15.50:0/2840184241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a4152840 con 0x7fb4a40b3e10 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.376+0000 7fb4a9992640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40b3e10 0x7fb4a41521b0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fb49400c3f0 tx=0x7fb49400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:15.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.376+0000 7fb4a27fc640 1 -- 172.21.15.50:0/2840184241 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4940052d0 con 0x7fb4a40b3e10 2024-09-11T22:21:15.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.376+0000 7fb4a27fc640 1 -- 172.21.15.50:0/2840184241 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb494005490 con 0x7fb4a40b3e10 2024-09-11T22:21:15.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.376+0000 7fb4abbf6640 1 -- 172.21.15.50:0/2840184241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a4152b20 con 0x7fb4a40b3e10 2024-09-11T22:21:15.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.376+0000 7fb4a27fc640 1 -- 172.21.15.50:0/2840184241 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb494007260 con 0x7fb4a40b3e10 2024-09-11T22:21:15.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.376+0000 7fb4abbf6640 1 -- 172.21.15.50:0/2840184241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a40713b0 con 0x7fb4a40b3e10 2024-09-11T22:21:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.377+0000 7fb4abbf6640 1 -- 172.21.15.50:0/2840184241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4a415c6a0 con 0x7fb4a40b3e10 2024-09-11T22:21:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.378+0000 7fb4a27fc640 1 -- 172.21.15.50:0/2840184241 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb494007400 con 0x7fb4a40b3e10 2024-09-11T22:21:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.378+0000 7fb4a27fc640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb49006be30 0x7fb49006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.379+0000 7fb4a27fc640 1 -- 172.21.15.50:0/2840184241 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7fb49408a290 con 0x7fb4a40b3e10 2024-09-11T22:21:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.379+0000 7fb4a9191640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb49006be30 0x7fb49006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.379+0000 7fb4a9191640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb49006be30 0x7fb49006e2f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb498034000 tx=0x7fb49802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.383+0000 7fb4a27fc640 1 -- 172.21.15.50:0/2840184241 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4940585e0 con 0x7fb4a40b3e10 2024-09-11T22:21:15.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.596+0000 7fb4abbf6640 1 -- 172.21.15.50:0/2840184241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4a4067fb0 con 0x7fb4a40b3e10 2024-09-11T22:21:15.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.596+0000 7fb4a27fc640 1 -- 172.21.15.50:0/2840184241 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5233 (secure 0 0 0) 0x7fb49405c8e0 con 0x7fb4a40b3e10 2024-09-11T22:21:15.597 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:15.597 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:20:50.638363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9426":{"gid":9426,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3562809701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3562809701},{"type":"v1","addr":"172.21.15.50:6835","nonce":3562809701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9426,"qdb_cluster":[9426]},"id":11}]} 2024-09-11T22:21:15.598 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 109 2024-09-11T22:21:15.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.598+0000 7fb4abbf6640 1 -- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb49006be30 msgr2=0x7fb49006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.598+0000 7fb4abbf6640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb49006be30 0x7fb49006e2f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb498034000 tx=0x7fb49802e000 comp rx=0 tx=0).stop 2024-09-11T22:21:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.598+0000 7fb4abbf6640 1 -- 172.21.15.50:0/2840184241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40b3e10 msgr2=0x7fb4a41521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.598+0000 7fb4abbf6640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40b3e10 0x7fb4a41521b0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fb49400c3f0 tx=0x7fb49400c8b0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.598+0000 7fb4abbf6640 1 -- 172.21.15.50:0/2840184241 shutdown_connections 2024-09-11T22:21:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.598+0000 7fb4abbf6640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb49006be30 0x7fb49006e2f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.598+0000 7fb4abbf6640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4a40d05e0 0x7fb4a414ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.598+0000 7fb4abbf6640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4a415c2c0 0x7fb4a41fb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.598+0000 7fb4abbf6640 1 --2- 172.21.15.50:0/2840184241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4a40b3e10 0x7fb4a41521b0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.598+0000 7fb4abbf6640 1 -- 172.21.15.50:0/2840184241 >> 172.21.15.50:0/2840184241 conn(0x7fb4a40679c0 msgr2=0x7fb4a40b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.598+0000 7fb4abbf6640 1 -- 172.21.15.50:0/2840184241 shutdown_connections 2024-09-11T22:21:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.598+0000 7fb4abbf6640 1 -- 172.21.15.50:0/2840184241 wait complete. 2024-09-11T22:21:15.610 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-11T22:21:15.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:21:15.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.710+0000 7f54e43be640 1 Processor -- start 2024-09-11T22:21:15.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.710+0000 7f54e43be640 1 -- start start 2024-09-11T22:21:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.711+0000 7f54e43be640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54dc15e870 0x7f54dc0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.711+0000 7f54e43be640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f54dc0d16d0 0x7f54dc0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.711+0000 7f54e43be640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54dc0cfa80 con 0x7f54dc0d3a30 2024-09-11T22:21:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.711+0000 7f54e43be640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f54dc0d3ea0 con 0x7f54dc0d16d0 2024-09-11T22:21:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.711+0000 7f54e43be640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f54dc0d1b10 con 0x7f54dc15e870 2024-09-11T22:21:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.711+0000 7f54e295b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f54dc0d3a30 0x7f54dc0b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34256/0 (socket says 172.21.15.50:34256) 2024-09-11T22:21:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.711+0000 7f54e295b640 1 -- 172.21.15.50:0/3755578275 learned_addr learned my addr 172.21.15.50:0/3755578275 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.712+0000 7f54e215a640 1 --2- 172.21.15.50:0/3755578275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54dc15e870 0x7f54dc0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.712+0000 7f54e1959640 1 --2- 172.21.15.50:0/3755578275 >> v2:172.21.15.77:3300/0 conn(0x7f54dc0d16d0 0x7f54dc0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.712+0000 7f54e1158640 1 -- 172.21.15.50:0/3755578275 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188801483 0 0) 0x7f54cc001490 con 0x7f54dc0d3a30 2024-09-11T22:21:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.712+0000 7f54e1158640 1 -- 172.21.15.50:0/3755578275 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54c4003520 con 0x7f54dc0d3a30 2024-09-11T22:21:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.712+0000 7f54e1158640 1 -- 172.21.15.50:0/3755578275 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 558471756 0 0) 0x7f54c4003520 con 0x7f54dc0d3a30 2024-09-11T22:21:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.712+0000 7f54e215a640 1 -- 172.21.15.50:0/3755578275 >> v2:172.21.15.77:3300/0 conn(0x7f54dc0d16d0 msgr2=0x7f54dc0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.712+0000 7f54e215a640 1 --2- 172.21.15.50:0/3755578275 >> v2:172.21.15.77:3300/0 conn(0x7f54dc0d16d0 0x7f54dc0d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.712+0000 7f54e215a640 1 -- 172.21.15.50:0/3755578275 >> v1:172.21.15.50:6789/0 conn(0x7f54dc0d3a30 legacy=0x7f54dc0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.712+0000 7f54e215a640 1 -- 172.21.15.50:0/3755578275 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc0d40d0 con 0x7f54dc15e870 2024-09-11T22:21:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.712+0000 7f54e1959640 1 --2- 172.21.15.50:0/3755578275 >> v2:172.21.15.77:3300/0 conn(0x7f54dc0d16d0 0x7f54dc0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.713+0000 7f54e215a640 1 --2- 172.21.15.50:0/3755578275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54dc15e870 0x7f54dc0d1190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f54d40097a0 tx=0x7f54d402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43c2f06fd763dad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.713+0000 7f54e1158640 1 -- 172.21.15.50:0/3755578275 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4037070 con 0x7f54dc15e870 2024-09-11T22:21:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.713+0000 7f54e1158640 1 -- 172.21.15.50:0/3755578275 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d402aba0 con 0x7f54dc15e870 2024-09-11T22:21:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.713+0000 7f54e1158640 1 -- 172.21.15.50:0/3755578275 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc001bc0 con 0x7f54dc15e870 2024-09-11T22:21:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.713+0000 7f54e43be640 1 -- 172.21.15.50:0/3755578275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54dc15e870 msgr2=0x7f54dc0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.713+0000 7f54e43be640 1 --2- 172.21.15.50:0/3755578275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54dc15e870 0x7f54dc0d1190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f54d40097a0 tx=0x7f54d402a110 comp rx=0 tx=0).stop 2024-09-11T22:21:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.714+0000 7f54e43be640 1 -- 172.21.15.50:0/3755578275 shutdown_connections 2024-09-11T22:21:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.714+0000 7f54e43be640 1 --2- 172.21.15.50:0/3755578275 >> v2:172.21.15.77:3300/0 conn(0x7f54dc0d16d0 0x7f54dc0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.714+0000 7f54e43be640 1 --2- 172.21.15.50:0/3755578275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54dc15e870 0x7f54dc0d1190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.714+0000 7f54e43be640 1 -- 172.21.15.50:0/3755578275 >> 172.21.15.50:0/3755578275 conn(0x7f54dc0727a0 msgr2=0x7f54dc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.714+0000 7f54e43be640 1 -- 172.21.15.50:0/3755578275 shutdown_connections 2024-09-11T22:21:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.714+0000 7f54e43be640 1 -- 172.21.15.50:0/3755578275 wait complete. 2024-09-11T22:21:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.715+0000 7f54e43be640 1 Processor -- start 2024-09-11T22:21:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.715+0000 7f54e43be640 1 -- start start 2024-09-11T22:21:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e43be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54dc0d16d0 0x7f54dc0b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e43be640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54dc0d3a30 0x7f54dc15cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e43be640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54dc15e870 0x7f54dc0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e43be640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc0b7ee0 con 0x7f54dc0d16d0 2024-09-11T22:21:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e43be640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc0b7c00 con 0x7f54dc15e870 2024-09-11T22:21:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e43be640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f54dc15ec50 con 0x7f54dc0d3a30 2024-09-11T22:21:15.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e215a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54dc0d16d0 0x7f54dc0b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e215a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54dc0d16d0 0x7f54dc0b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54294/0 (socket says 172.21.15.50:54294) 2024-09-11T22:21:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e215a640 1 -- 172.21.15.50:0/1047157723 learned_addr learned my addr 172.21.15.50:0/1047157723 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e1959640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54dc0d3a30 0x7f54dc15cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e215a640 1 -- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54dc0d3a30 msgr2=0x7f54dc15cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e215a640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54dc0d3a30 0x7f54dc15cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e295b640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54dc15e870 0x7f54dc0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e215a640 1 -- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54dc15e870 msgr2=0x7f54dc0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e215a640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54dc15e870 0x7f54dc0cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e215a640 1 -- 172.21.15.50:0/1047157723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc0af4a0 con 0x7f54dc0d16d0 2024-09-11T22:21:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e295b640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54dc15e870 0x7f54dc0cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e215a640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54dc0d16d0 0x7f54dc0b0d60 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f54d4035040 tx=0x7f54d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54daffd640 1 -- 172.21.15.50:0/1047157723 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4037050 con 0x7f54dc0d16d0 2024-09-11T22:21:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54daffd640 1 -- 172.21.15.50:0/1047157723 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d4043070 con 0x7f54dc0d16d0 2024-09-11T22:21:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54daffd640 1 -- 172.21.15.50:0/1047157723 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4006e10 con 0x7f54dc0d16d0 2024-09-11T22:21:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e43be640 1 -- 172.21.15.50:0/1047157723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54dc0af780 con 0x7f54dc0d16d0 2024-09-11T22:21:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.716+0000 7f54e43be640 1 -- 172.21.15.50:0/1047157723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54dc0ac740 con 0x7f54dc0d16d0 2024-09-11T22:21:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.717+0000 7f54e43be640 1 -- 172.21.15.50:0/1047157723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54dc0b78b0 con 0x7f54dc0d16d0 2024-09-11T22:21:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.718+0000 7f54daffd640 1 -- 172.21.15.50:0/1047157723 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54d403ca10 con 0x7f54dc0d16d0 2024-09-11T22:21:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.719+0000 7f54daffd640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f54c806be30 0x7f54c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.719+0000 7f54daffd640 1 -- 172.21.15.50:0/1047157723 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f54d40ab9c0 con 0x7f54dc0d16d0 2024-09-11T22:21:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.719+0000 7f54e1959640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f54c806be30 0x7f54c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.719+0000 7f54e1959640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f54c806be30 0x7f54c806e2f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009560 tx=0x7f54d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:15.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.723+0000 7f54daffd640 1 -- 172.21.15.50:0/1047157723 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54d40ade20 con 0x7f54dc0d16d0 2024-09-11T22:21:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.965+0000 7f54e43be640 1 -- 172.21.15.50:0/1047157723 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f54dc0b3880 con 0x7f54dc0d16d0 2024-09-11T22:21:15.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.965+0000 7f54daffd640 1 -- 172.21.15.50:0/1047157723 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1491 (secure 0 0 0) 0x7f54d4030e20 con 0x7f54dc0d16d0 2024-09-11T22:21:15.966 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:15.966 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":624,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":156,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076561500,"bytes_used":2572509184,"bytes_avail":770521604096,"bytes_total":773094113280,"write_bytes_sec":87910111,"read_op_per_sec":0,"write_op_per_sec":86},"fsmap":{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9426}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-11T22:20:33.499640+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:21:15.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.967+0000 7f54e43be640 1 -- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f54c806be30 msgr2=0x7f54c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.967+0000 7f54e43be640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f54c806be30 0x7f54c806e2f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009560 tx=0x7f54d0008040 comp rx=0 tx=0).stop 2024-09-11T22:21:15.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.967+0000 7f54e43be640 1 -- 172.21.15.50:0/1047157723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54dc0d16d0 msgr2=0x7f54dc0b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.967+0000 7f54e43be640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54dc0d16d0 0x7f54dc0b0d60 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f54d4035040 tx=0x7f54d40046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.967+0000 7f54e43be640 1 -- 172.21.15.50:0/1047157723 shutdown_connections 2024-09-11T22:21:15.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.967+0000 7f54e43be640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f54c806be30 0x7f54c806e2f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.967+0000 7f54e43be640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54dc0d3a30 0x7f54dc15cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.967+0000 7f54e43be640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54dc15e870 0x7f54dc0cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.967+0000 7f54e43be640 1 --2- 172.21.15.50:0/1047157723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54dc0d16d0 0x7f54dc0b0d60 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.967+0000 7f54e43be640 1 -- 172.21.15.50:0/1047157723 >> 172.21.15.50:0/1047157723 conn(0x7f54dc0727a0 msgr2=0x7f54dc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:15.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.967+0000 7f54e43be640 1 -- 172.21.15.50:0/1047157723 shutdown_connections 2024-09-11T22:21:15.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:15.967+0000 7f54e43be640 1 -- 172.21.15.50:0/1047157723 wait complete. 2024-09-11T22:21:15.978 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-11T22:21:16.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:17.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.094+0000 7fbe08de8640 1 Processor -- start 2024-09-11T22:21:17.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.094+0000 7fbe08de8640 1 -- start start 2024-09-11T22:21:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.095+0000 7fbe08de8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbe040d3c00 0x7fbe04169420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.095+0000 7fbe08de8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe040cfa80 con 0x7fbe0415e870 2024-09-11T22:21:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.095+0000 7fbe08de8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe040d40d0 con 0x7fbe040d18a0 2024-09-11T22:21:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.095+0000 7fbe08de8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbe040d43b0 con 0x7fbe040d3c00 2024-09-11T22:21:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.096+0000 7fbe0259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbe0415e870 0x7fbe040d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34262/0 (socket says 172.21.15.50:34262) 2024-09-11T22:21:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.096+0000 7fbe0259c640 1 -- 172.21.15.50:0/122451381 learned_addr learned my addr 172.21.15.50:0/122451381 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.096+0000 7fbe02d9d640 1 --2- 172.21.15.50:0/122451381 >> v2:172.21.15.77:3300/0 conn(0x7fbe040d3c00 0x7fbe04169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.096+0000 7fbe0159a640 1 -- 172.21.15.50:0/122451381 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781185692 0 0) 0x7fbdf4001490 con 0x7fbe0415e870 2024-09-11T22:21:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.096+0000 7fbe0159a640 1 -- 172.21.15.50:0/122451381 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdec003520 con 0x7fbe0415e870 2024-09-11T22:21:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.096+0000 7fbe02d9d640 1 -- 172.21.15.50:0/122451381 >> v1:172.21.15.77:6789/0 conn(0x7fbe040d18a0 legacy=0x7fbe040d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.096+0000 7fbe02d9d640 1 -- 172.21.15.50:0/122451381 >> v1:172.21.15.50:6789/0 conn(0x7fbe0415e870 legacy=0x7fbe040d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.096+0000 7fbe02d9d640 1 -- 172.21.15.50:0/122451381 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe040b7c00 con 0x7fbe040d3c00 2024-09-11T22:21:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.097+0000 7fbe02d9d640 1 --2- 172.21.15.50:0/122451381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe040d3c00 0x7fbe04169420 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0097a0 tx=0x7fbdfc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29bfc338b25505f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.097+0000 7fbe0159a640 1 -- 172.21.15.50:0/122451381 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc037070 con 0x7fbe040d3c00 2024-09-11T22:21:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.097+0000 7fbe0159a640 1 -- 172.21.15.50:0/122451381 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdfc032440 con 0x7fbe040d3c00 2024-09-11T22:21:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.097+0000 7fbe0159a640 1 -- 172.21.15.50:0/122451381 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc0327f0 con 0x7fbe040d3c00 2024-09-11T22:21:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.098+0000 7fbe08de8640 1 -- 172.21.15.50:0/122451381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe040d3c00 msgr2=0x7fbe04169420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.098+0000 7fbe08de8640 1 --2- 172.21.15.50:0/122451381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe040d3c00 0x7fbe04169420 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0097a0 tx=0x7fbdfc02a230 comp rx=0 tx=0).stop 2024-09-11T22:21:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.098+0000 7fbe08de8640 1 -- 172.21.15.50:0/122451381 shutdown_connections 2024-09-11T22:21:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.098+0000 7fbe08de8640 1 --2- 172.21.15.50:0/122451381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe040d3c00 0x7fbe04169420 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.098+0000 7fbe08de8640 1 -- 172.21.15.50:0/122451381 >> 172.21.15.50:0/122451381 conn(0x7fbe040727a0 msgr2=0x7fbe040679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.098+0000 7fbe08de8640 1 -- 172.21.15.50:0/122451381 shutdown_connections 2024-09-11T22:21:17.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.098+0000 7fbe08de8640 1 -- 172.21.15.50:0/122451381 wait complete. 2024-09-11T22:21:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.099+0000 7fbe08de8640 1 Processor -- start 2024-09-11T22:21:17.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.099+0000 7fbe08de8640 1 -- start start 2024-09-11T22:21:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe08de8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe040d18a0 0x7fbe04159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe08de8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe040d3c00 0x7fbe04158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe08de8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0415e870 0x7fbe041f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe08de8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe040b78b0 con 0x7fbe0415e870 2024-09-11T22:21:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe08de8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0415ec50 con 0x7fbe040d18a0 2024-09-11T22:21:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe08de8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbe040b9410 con 0x7fbe040d3c00 2024-09-11T22:21:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe02d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0415e870 0x7fbe041f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe02d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0415e870 0x7fbe041f75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54308/0 (socket says 172.21.15.50:54308) 2024-09-11T22:21:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe02d9d640 1 -- 172.21.15.50:0/2943904991 learned_addr learned my addr 172.21.15.50:0/2943904991 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe0259c640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe040d18a0 0x7fbe04159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe01d9b640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe040d3c00 0x7fbe04158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe02d9d640 1 -- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe040d3c00 msgr2=0x7fbe04158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe02d9d640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe040d3c00 0x7fbe04158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe02d9d640 1 -- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe040d18a0 msgr2=0x7fbe04159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.100+0000 7fbe02d9d640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe040d18a0 0x7fbe04159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.101+0000 7fbe02d9d640 1 -- 172.21.15.50:0/2943904991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0415aa70 con 0x7fbe0415e870 2024-09-11T22:21:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.101+0000 7fbe02d9d640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0415e870 0x7fbe041f75f0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc035040 tx=0x7fbdfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.101+0000 7fbdf2ffd640 1 -- 172.21.15.50:0/2943904991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc037050 con 0x7fbe0415e870 2024-09-11T22:21:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.101+0000 7fbdf2ffd640 1 -- 172.21.15.50:0/2943904991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdfc038040 con 0x7fbe0415e870 2024-09-11T22:21:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.101+0000 7fbe08de8640 1 -- 172.21.15.50:0/2943904991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe041599d0 con 0x7fbe0415e870 2024-09-11T22:21:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.101+0000 7fbdf2ffd640 1 -- 172.21.15.50:0/2943904991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc004450 con 0x7fbe0415e870 2024-09-11T22:21:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.101+0000 7fbe08de8640 1 -- 172.21.15.50:0/2943904991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe04159f90 con 0x7fbe0415e870 2024-09-11T22:21:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.102+0000 7fbe08de8640 1 -- 172.21.15.50:0/2943904991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe040d34f0 con 0x7fbe0415e870 2024-09-11T22:21:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.103+0000 7fbdf2ffd640 1 -- 172.21.15.50:0/2943904991 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbdfc03c6d0 con 0x7fbe0415e870 2024-09-11T22:21:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.103+0000 7fbdf2ffd640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbde406be30 0x7fbde406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.103+0000 7fbdf2ffd640 1 -- 172.21.15.50:0/2943904991 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7fbdfc0ab6e0 con 0x7fbe0415e870 2024-09-11T22:21:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.103+0000 7fbe0259c640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbde406be30 0x7fbde406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.104+0000 7fbe0259c640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbde406be30 0x7fbde406e2f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4001630 tx=0x7fbdf4001a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:17.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.108+0000 7fbdf2ffd640 1 -- 172.21.15.50:0/2943904991 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbdfc079a40 con 0x7fbe0415e870 2024-09-11T22:21:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.318+0000 7fbe08de8640 1 -- 172.21.15.50:0/2943904991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe0415c2c0 con 0x7fbe0415e870 2024-09-11T22:21:17.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.319+0000 7fbdf2ffd640 1 -- 172.21.15.50:0/2943904991 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5233 (secure 0 0 0) 0x7fbdfc07dd40 con 0x7fbe0415e870 2024-09-11T22:21:17.320 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:17.320 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:20:50.638363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9426":{"gid":9426,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3562809701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3562809701},{"type":"v1","addr":"172.21.15.50:6835","nonce":3562809701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9426,"qdb_cluster":[9426]},"id":11}]} 2024-09-11T22:21:17.320 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 109 2024-09-11T22:21:17.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.321+0000 7fbe08de8640 1 -- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbde406be30 msgr2=0x7fbde406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.321+0000 7fbe08de8640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbde406be30 0x7fbde406e2f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4001630 tx=0x7fbdf4001a00 comp rx=0 tx=0).stop 2024-09-11T22:21:17.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.321+0000 7fbe08de8640 1 -- 172.21.15.50:0/2943904991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0415e870 msgr2=0x7fbe041f75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.321+0000 7fbe08de8640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0415e870 0x7fbe041f75f0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc035040 tx=0x7fbdfc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.321+0000 7fbe08de8640 1 -- 172.21.15.50:0/2943904991 shutdown_connections 2024-09-11T22:21:17.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.321+0000 7fbe08de8640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbde406be30 0x7fbde406e2f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.321+0000 7fbe08de8640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe040d3c00 0x7fbe04158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.321+0000 7fbe08de8640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe0415e870 0x7fbe041f75f0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.321+0000 7fbe08de8640 1 --2- 172.21.15.50:0/2943904991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe040d18a0 0x7fbe04159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.321+0000 7fbe08de8640 1 -- 172.21.15.50:0/2943904991 >> 172.21.15.50:0/2943904991 conn(0x7fbe040727a0 msgr2=0x7fbe040b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:17.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.321+0000 7fbe08de8640 1 -- 172.21.15.50:0/2943904991 shutdown_connections 2024-09-11T22:21:17.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.321+0000 7fbe08de8640 1 -- 172.21.15.50:0/2943904991 wait complete. 2024-09-11T22:21:17.332 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-11T22:21:17.333 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:21:17.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.433+0000 7fbb01435640 1 Processor -- start 2024-09-11T22:21:17.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.433+0000 7fbb01435640 1 -- start start 2024-09-11T22:21:17.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.433+0000 7fbb01435640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbafc15c3c0 0x7fbafc15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbb01435640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbafc15f7f0 con 0x7fbafc15ec40 2024-09-11T22:21:17.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbb01435640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbafc15fad0 con 0x7fbafc0680d0 2024-09-11T22:21:17.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbb01435640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbafc06e700 con 0x7fbafc15c3c0 2024-09-11T22:21:17.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbafa7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbafc15ec40 0x7fbafc0679c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34268/0 (socket says 172.21.15.50:34268) 2024-09-11T22:21:17.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbafa7fc640 1 -- 172.21.15.50:0/329373405 learned_addr learned my addr 172.21.15.50:0/329373405 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:17.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbafaffd640 1 --2- 172.21.15.50:0/329373405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbafc15c3c0 0x7fbafc15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbaf9ffb640 1 -- 172.21.15.50:0/329373405 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301012062 0 0) 0x7fbafc15f7f0 con 0x7fbafc15ec40 2024-09-11T22:21:17.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbaf9ffb640 1 -- 172.21.15.50:0/329373405 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbae4003520 con 0x7fbafc15ec40 2024-09-11T22:21:17.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbaf9ffb640 1 -- 172.21.15.50:0/329373405 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1412555463 0 0) 0x7fbafc15fad0 con 0x7fbafc0680d0 2024-09-11T22:21:17.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbaf9ffb640 1 -- 172.21.15.50:0/329373405 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbafc15f7f0 con 0x7fbafc0680d0 2024-09-11T22:21:17.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbafaffd640 1 -- 172.21.15.50:0/329373405 >> v1:172.21.15.77:6789/0 conn(0x7fbafc0680d0 legacy=0x7fbafc06f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbaf9ffb640 1 -- 172.21.15.50:0/329373405 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4140363269 0 0) 0x7fbae4003520 con 0x7fbafc15ec40 2024-09-11T22:21:17.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbafaffd640 1 -- 172.21.15.50:0/329373405 >> v1:172.21.15.50:6789/0 conn(0x7fbafc15ec40 legacy=0x7fbafc0679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.434+0000 7fbafaffd640 1 -- 172.21.15.50:0/329373405 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc06e950 con 0x7fbafc15c3c0 2024-09-11T22:21:17.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.435+0000 7fbafaffd640 1 --2- 172.21.15.50:0/329373405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbafc15c3c0 0x7fbafc15fe60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0097d0 tx=0x7fbaec02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2ea68de4b6f4298 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:17.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.435+0000 7fbaf9ffb640 1 -- 172.21.15.50:0/329373405 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec037070 con 0x7fbafc15c3c0 2024-09-11T22:21:17.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.435+0000 7fbaf9ffb640 1 -- 172.21.15.50:0/329373405 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaec02ab90 con 0x7fbafc15c3c0 2024-09-11T22:21:17.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.435+0000 7fbaf9ffb640 1 -- 172.21.15.50:0/329373405 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0001670 con 0x7fbafc15c3c0 2024-09-11T22:21:17.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.436+0000 7fbb01435640 1 -- 172.21.15.50:0/329373405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbafc15c3c0 msgr2=0x7fbafc15fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.436+0000 7fbb01435640 1 --2- 172.21.15.50:0/329373405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbafc15c3c0 0x7fbafc15fe60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0097d0 tx=0x7fbaec02a100 comp rx=0 tx=0).stop 2024-09-11T22:21:17.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.436+0000 7fbb01435640 1 -- 172.21.15.50:0/329373405 shutdown_connections 2024-09-11T22:21:17.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.436+0000 7fbb01435640 1 --2- 172.21.15.50:0/329373405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbafc15c3c0 0x7fbafc15fe60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.436+0000 7fbb01435640 1 -- 172.21.15.50:0/329373405 >> 172.21.15.50:0/329373405 conn(0x7fbafc075060 msgr2=0x7fbafc06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:17.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.436+0000 7fbb01435640 1 -- 172.21.15.50:0/329373405 shutdown_connections 2024-09-11T22:21:17.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.436+0000 7fbb01435640 1 -- 172.21.15.50:0/329373405 wait complete. 2024-09-11T22:21:17.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.437+0000 7fbb01435640 1 Processor -- start 2024-09-11T22:21:17.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.437+0000 7fbb01435640 1 -- start start 2024-09-11T22:21:17.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbb01435640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbafc0680d0 0x7fbafc0ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbb01435640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbafc15c3c0 0x7fbafc0cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbb01435640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc15ec40 0x7fbafc0aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbb01435640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc15f080 con 0x7fbafc15ec40 2024-09-11T22:21:17.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbb01435640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc0d0940 con 0x7fbafc15c3c0 2024-09-11T22:21:17.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbb01435640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbafc15f200 con 0x7fbafc0680d0 2024-09-11T22:21:17.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbafb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc15ec40 0x7fbafc0aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbafb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc15ec40 0x7fbafc0aaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54312/0 (socket says 172.21.15.50:54312) 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbafb7fe640 1 -- 172.21.15.50:0/2292183261 learned_addr learned my addr 172.21.15.50:0/2292183261 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbafaffd640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbafc0680d0 0x7fbafc0ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbafa7fc640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbafc15c3c0 0x7fbafc0cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbafb7fe640 1 -- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbafc0680d0 msgr2=0x7fbafc0ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbafb7fe640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbafc0680d0 0x7fbafc0ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbafb7fe640 1 -- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbafc15c3c0 msgr2=0x7fbafc0cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbafb7fe640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbafc15c3c0 0x7fbafc0cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.438+0000 7fbafb7fe640 1 -- 172.21.15.50:0/2292183261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc0ce1e0 con 0x7fbafc15ec40 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.439+0000 7fbafb7fe640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc15ec40 0x7fbafc0aaf70 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400c7c0 tx=0x7fbaf400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.439+0000 7fbae37fe640 1 -- 172.21.15.50:0/2292183261 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4003b70 con 0x7fbafc15ec40 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.439+0000 7fbae37fe640 1 -- 172.21.15.50:0/2292183261 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf4003d10 con 0x7fbafc15ec40 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.439+0000 7fbae37fe640 1 -- 172.21.15.50:0/2292183261 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400aa50 con 0x7fbafc15ec40 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.439+0000 7fbb01435640 1 -- 172.21.15.50:0/2292183261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbafc0ce4c0 con 0x7fbafc15ec40 2024-09-11T22:21:17.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.439+0000 7fbb01435640 1 -- 172.21.15.50:0/2292183261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbafc0aaa50 con 0x7fbafc15ec40 2024-09-11T22:21:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.440+0000 7fbb01435640 1 -- 172.21.15.50:0/2292183261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbafc0aac50 con 0x7fbafc15ec40 2024-09-11T22:21:17.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.440+0000 7fbae37fe640 1 -- 172.21.15.50:0/2292183261 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbaf400abf0 con 0x7fbafc15ec40 2024-09-11T22:21:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.441+0000 7fbae37fe640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbae806be30 0x7fbae806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.441+0000 7fbae37fe640 1 -- 172.21.15.50:0/2292183261 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7fbaf408adc0 con 0x7fbafc15ec40 2024-09-11T22:21:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.441+0000 7fbafaffd640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbae806be30 0x7fbae806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.442+0000 7fbafaffd640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbae806be30 0x7fbae806e2f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbaec034000 tx=0x7fbaec02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:17.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.445+0000 7fbae37fe640 1 -- 172.21.15.50:0/2292183261 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbafc0aac50 con 0x7fbafc15ec40 2024-09-11T22:21:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.692+0000 7fbb01435640 1 -- 172.21.15.50:0/2292183261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbafc0aa560 con 0x7fbafc15ec40 2024-09-11T22:21:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.693+0000 7fbae37fe640 1 -- 172.21.15.50:0/2292183261 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1643 (secure 0 0 0) 0x7fbaf4059770 con 0x7fbafc15ec40 2024-09-11T22:21:17.693 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:17.694 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":626,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":156,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076561500,"bytes_used":2584457216,"bytes_avail":770509656064,"bytes_total":773094113280,"write_bytes_sec":59357310,"read_op_per_sec":0,"write_op_per_sec":58},"fsmap":{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9426}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-09-11T22:21:17.510040+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:21:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.695+0000 7fbb01435640 1 -- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbae806be30 msgr2=0x7fbae806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.695+0000 7fbb01435640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbae806be30 0x7fbae806e2f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbaec034000 tx=0x7fbaec02e000 comp rx=0 tx=0).stop 2024-09-11T22:21:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.695+0000 7fbb01435640 1 -- 172.21.15.50:0/2292183261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc15ec40 msgr2=0x7fbafc0aaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.695+0000 7fbb01435640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc15ec40 0x7fbafc0aaf70 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400c7c0 tx=0x7fbaf400cc80 comp rx=0 tx=0).stop 2024-09-11T22:21:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.695+0000 7fbb01435640 1 -- 172.21.15.50:0/2292183261 shutdown_connections 2024-09-11T22:21:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.695+0000 7fbb01435640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbae806be30 0x7fbae806e2f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.695+0000 7fbb01435640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc15ec40 0x7fbafc0aaf70 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.695+0000 7fbb01435640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbafc15c3c0 0x7fbafc0cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.695+0000 7fbb01435640 1 --2- 172.21.15.50:0/2292183261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbafc0680d0 0x7fbafc0ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.695+0000 7fbb01435640 1 -- 172.21.15.50:0/2292183261 >> 172.21.15.50:0/2292183261 conn(0x7fbafc075060 msgr2=0x7fbafc0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:17.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.695+0000 7fbb01435640 1 -- 172.21.15.50:0/2292183261 shutdown_connections 2024-09-11T22:21:17.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.695+0000 7fbb01435640 1 -- 172.21.15.50:0/2292183261 wait complete. 2024-09-11T22:21:17.707 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused'} 2024-09-11T22:21:17.707 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:21:17.707 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:21:17.717 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:21:17.717 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'d', 'c', 'b'} 2024-09-11T22:21:17.718 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-09-11T22:21:17.867 INFO:teuthology.orchestra.run.smithi050.stdout:{"mds_beacon_grace":"15.000000"} 2024-09-11T22:21:17.868 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-09-11T22:21:17.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.969+0000 7f093461e640 1 Processor -- start 2024-09-11T22:21:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.969+0000 7f093461e640 1 -- start start 2024-09-11T22:21:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f093461e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f092c15e870 0x7f092c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f093461e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f092c0d16d0 0x7f092c0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f093461e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f092c0cfa80 con 0x7f092c0d3a30 2024-09-11T22:21:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f093461e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f092c0d3ea0 con 0x7f092c0d16d0 2024-09-11T22:21:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f093461e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f092c0d1b10 con 0x7f092c15e870 2024-09-11T22:21:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f0931bb9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f092c0d16d0 0x7f092c0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f0931bb9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f092c0d16d0 0x7f092c0d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56212/0 (socket says 172.21.15.50:56212) 2024-09-11T22:21:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f0931bb9640 1 -- 172.21.15.50:0/490623778 learned_addr learned my addr 172.21.15.50:0/490623778 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f09323ba640 1 --2- 172.21.15.50:0/490623778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f092c15e870 0x7f092c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f0931bb9640 1 -- 172.21.15.50:0/490623778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f092c15e870 msgr2=0x7f092c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f0931bb9640 1 --2- 172.21.15.50:0/490623778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f092c15e870 0x7f092c0d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f0931bb9640 1 -- 172.21.15.50:0/490623778 >> v1:172.21.15.77:6789/0 conn(0x7f092c0d3a30 legacy=0x7f092c0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f0931bb9640 1 -- 172.21.15.50:0/490623778 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092c0d40d0 con 0x7f092c0d16d0 2024-09-11T22:21:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.970+0000 7f09323ba640 1 --2- 172.21.15.50:0/490623778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f092c15e870 0x7f092c0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.971+0000 7f0931bb9640 1 --2- 172.21.15.50:0/490623778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092c0d16d0 0x7f092c0d34f0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f091c009870 tx=0x7f091c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6010e24168aa5492 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.971+0000 7f09313b8640 1 -- 172.21.15.50:0/490623778 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c037070 con 0x7f092c0d16d0 2024-09-11T22:21:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.971+0000 7f09313b8640 1 -- 172.21.15.50:0/490623778 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f091c032440 con 0x7f092c0d16d0 2024-09-11T22:21:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.971+0000 7f09313b8640 1 -- 172.21.15.50:0/490623778 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c032810 con 0x7f092c0d16d0 2024-09-11T22:21:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.972+0000 7f093461e640 1 -- 172.21.15.50:0/490623778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092c0d16d0 msgr2=0x7f092c0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.972+0000 7f093461e640 1 --2- 172.21.15.50:0/490623778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092c0d16d0 0x7f092c0d34f0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f091c009870 tx=0x7f091c02a210 comp rx=0 tx=0).stop 2024-09-11T22:21:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.972+0000 7f093461e640 1 -- 172.21.15.50:0/490623778 shutdown_connections 2024-09-11T22:21:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.972+0000 7f093461e640 1 --2- 172.21.15.50:0/490623778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092c0d16d0 0x7f092c0d34f0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.972+0000 7f093461e640 1 --2- 172.21.15.50:0/490623778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f092c15e870 0x7f092c0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.972+0000 7f093461e640 1 -- 172.21.15.50:0/490623778 >> 172.21.15.50:0/490623778 conn(0x7f092c0727a0 msgr2=0x7f092c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.972+0000 7f093461e640 1 -- 172.21.15.50:0/490623778 shutdown_connections 2024-09-11T22:21:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.972+0000 7f093461e640 1 -- 172.21.15.50:0/490623778 wait complete. 2024-09-11T22:21:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.973+0000 7f093461e640 1 Processor -- start 2024-09-11T22:21:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.973+0000 7f093461e640 1 -- start start 2024-09-11T22:21:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f093461e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f092c0d16d0 0x7f092c1f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f093461e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f092c0d3a30 0x7f092c0cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f093461e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092c15e870 0x7f092c154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f093461e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f092c0b7ee0 con 0x7f092c15e870 2024-09-11T22:21:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f093461e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f092c0b7c00 con 0x7f092c0d16d0 2024-09-11T22:21:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f093461e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f092c15ec50 con 0x7f092c0d3a30 2024-09-11T22:21:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f0932bbb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092c15e870 0x7f092c154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f0932bbb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092c15e870 0x7f092c154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56224/0 (socket says 172.21.15.50:56224) 2024-09-11T22:21:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f0932bbb640 1 -- 172.21.15.50:0/2783528011 learned_addr learned my addr 172.21.15.50:0/2783528011 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f09323ba640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f092c0d16d0 0x7f092c1f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f0931bb9640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f092c0d3a30 0x7f092c0cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f0932bbb640 1 -- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f092c0d3a30 msgr2=0x7f092c0cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f0932bbb640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f092c0d3a30 0x7f092c0cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f0932bbb640 1 -- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f092c0d16d0 msgr2=0x7f092c1f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f0932bbb640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f092c0d16d0 0x7f092c1f4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f0932bbb640 1 -- 172.21.15.50:0/2783528011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092c1575f0 con 0x7f092c15e870 2024-09-11T22:21:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f0931bb9640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f092c0d3a30 0x7f092c0cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.974+0000 7f0932bbb640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092c15e870 0x7f092c154230 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f092400c780 tx=0x7f092400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.975+0000 7f0922ffd640 1 -- 172.21.15.50:0/2783528011 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0924004b60 con 0x7f092c15e870 2024-09-11T22:21:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.975+0000 7f0922ffd640 1 -- 172.21.15.50:0/2783528011 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0924004d00 con 0x7f092c15e870 2024-09-11T22:21:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.975+0000 7f093461e640 1 -- 172.21.15.50:0/2783528011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f092c1578d0 con 0x7f092c15e870 2024-09-11T22:21:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.975+0000 7f0922ffd640 1 -- 172.21.15.50:0/2783528011 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092400aa30 con 0x7f092c15e870 2024-09-11T22:21:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.975+0000 7f093461e640 1 -- 172.21.15.50:0/2783528011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f092c157bb0 con 0x7f092c15e870 2024-09-11T22:21:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.976+0000 7f093461e640 1 -- 172.21.15.50:0/2783528011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f092c075770 con 0x7f092c15e870 2024-09-11T22:21:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.976+0000 7f0922ffd640 1 -- 172.21.15.50:0/2783528011 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f092400abd0 con 0x7f092c15e870 2024-09-11T22:21:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.977+0000 7f0922ffd640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f091006be30 0x7f091006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.977+0000 7f0922ffd640 1 -- 172.21.15.50:0/2783528011 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f092408b3f0 con 0x7f092c15e870 2024-09-11T22:21:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.977+0000 7f09323ba640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f091006be30 0x7f091006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.977+0000 7f09323ba640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f091006be30 0x7f091006e2f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f092800a950 tx=0x7f0928008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:17.981+0000 7f0922ffd640 1 -- 172.21.15.50:0/2783528011 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0924059da0 con 0x7f092c15e870 2024-09-11T22:21:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.193+0000 7f093461e640 1 -- 172.21.15.50:0/2783528011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f092c050040 con 0x7f092c15e870 2024-09-11T22:21:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.193+0000 7f0922ffd640 1 -- 172.21.15.50:0/2783528011 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5233 (secure 0 0 0) 0x7f09240596a0 con 0x7f092c15e870 2024-09-11T22:21:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:18.194 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:20:50.638363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9426":{"gid":9426,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3562809701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3562809701},{"type":"v1","addr":"172.21.15.50:6835","nonce":3562809701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9426,"qdb_cluster":[9426]},"id":11}]} 2024-09-11T22:21:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 109 2024-09-11T22:21:18.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.195+0000 7f093461e640 1 -- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f091006be30 msgr2=0x7f091006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:18.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.195+0000 7f093461e640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f091006be30 0x7f091006e2f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f092800a950 tx=0x7f0928008040 comp rx=0 tx=0).stop 2024-09-11T22:21:18.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.195+0000 7f093461e640 1 -- 172.21.15.50:0/2783528011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092c15e870 msgr2=0x7f092c154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:18.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.195+0000 7f093461e640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092c15e870 0x7f092c154230 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f092400c780 tx=0x7f092400cc40 comp rx=0 tx=0).stop 2024-09-11T22:21:18.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.195+0000 7f093461e640 1 -- 172.21.15.50:0/2783528011 shutdown_connections 2024-09-11T22:21:18.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.195+0000 7f093461e640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f091006be30 0x7f091006e2f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.195+0000 7f093461e640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f092c0d3a30 0x7f092c0cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.195+0000 7f093461e640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f092c15e870 0x7f092c154230 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.195+0000 7f093461e640 1 --2- 172.21.15.50:0/2783528011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f092c0d16d0 0x7f092c1f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.195+0000 7f093461e640 1 -- 172.21.15.50:0/2783528011 >> 172.21.15.50:0/2783528011 conn(0x7f092c0727a0 msgr2=0x7f092c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:18.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.195+0000 7f093461e640 1 -- 172.21.15.50:0/2783528011 shutdown_connections 2024-09-11T22:21:18.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:18.195+0000 7f093461e640 1 -- 172.21.15.50:0/2783528011 wait complete. 2024-09-11T22:21:18.207 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-11T22:21:23.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.323+0000 7f376dab7640 1 Processor -- start 2024-09-11T22:21:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.323+0000 7f376dab7640 1 -- start start 2024-09-11T22:21:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.324+0000 7f376dab7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3768162a60 0x7f37680b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.324+0000 7f376dab7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3768163080 con 0x7f37680d1c90 2024-09-11T22:21:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.324+0000 7f376dab7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37680d2d20 con 0x7f376815e8e0 2024-09-11T22:21:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.324+0000 7f376dab7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f376815ecc0 con 0x7f3768162a60 2024-09-11T22:21:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.324+0000 7f3766ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f37680d1c90 0x7f3768162350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40950/0 (socket says 172.21.15.50:40950) 2024-09-11T22:21:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.324+0000 7f3766ffd640 1 -- 172.21.15.50:0/1739928255 learned_addr learned my addr 172.21.15.50:0/1739928255 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.324+0000 7f3767fff640 1 --2- 172.21.15.50:0/1739928255 >> v2:172.21.15.77:3300/0 conn(0x7f3768162a60 0x7f37680b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.324+0000 7f37667fc640 1 -- 172.21.15.50:0/1739928255 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1209983607 0 0) 0x7f3768163080 con 0x7f37680d1c90 2024-09-11T22:21:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.324+0000 7f37667fc640 1 -- 172.21.15.50:0/1739928255 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3750003520 con 0x7f37680d1c90 2024-09-11T22:21:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.325+0000 7f3767fff640 1 -- 172.21.15.50:0/1739928255 >> v1:172.21.15.77:6789/0 conn(0x7f376815e8e0 legacy=0x7f37680d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.325+0000 7f3767fff640 1 -- 172.21.15.50:0/1739928255 >> v1:172.21.15.50:6789/0 conn(0x7f37680d1c90 legacy=0x7f3768162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:23.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.325+0000 7f3767fff640 1 -- 172.21.15.50:0/1739928255 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37680d3000 con 0x7f3768162a60 2024-09-11T22:21:23.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.325+0000 7f3767fff640 1 --2- 172.21.15.50:0/1739928255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3768162a60 0x7f37680b7880 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3760009d90 tx=0x7f376002a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16ee520314db970a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:23.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.326+0000 7f37667fc640 1 -- 172.21.15.50:0/1739928255 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760037070 con 0x7f3768162a60 2024-09-11T22:21:23.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.326+0000 7f37667fc640 1 -- 172.21.15.50:0/1739928255 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3760007740 con 0x7f3768162a60 2024-09-11T22:21:23.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.326+0000 7f37667fc640 1 -- 172.21.15.50:0/1739928255 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760007af0 con 0x7f3768162a60 2024-09-11T22:21:23.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.326+0000 7f376dab7640 1 -- 172.21.15.50:0/1739928255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3768162a60 msgr2=0x7f37680b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:23.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.326+0000 7f376dab7640 1 --2- 172.21.15.50:0/1739928255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3768162a60 0x7f37680b7880 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3760009d90 tx=0x7f376002a780 comp rx=0 tx=0).stop 2024-09-11T22:21:23.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.326+0000 7f376dab7640 1 -- 172.21.15.50:0/1739928255 shutdown_connections 2024-09-11T22:21:23.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.326+0000 7f376dab7640 1 --2- 172.21.15.50:0/1739928255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3768162a60 0x7f37680b7880 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.326+0000 7f376dab7640 1 -- 172.21.15.50:0/1739928255 >> 172.21.15.50:0/1739928255 conn(0x7f3768067ba0 msgr2=0x7f3768067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.326+0000 7f376dab7640 1 -- 172.21.15.50:0/1739928255 shutdown_connections 2024-09-11T22:21:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.326+0000 7f376dab7640 1 -- 172.21.15.50:0/1739928255 wait complete. 2024-09-11T22:21:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.327+0000 7f376dab7640 1 Processor -- start 2024-09-11T22:21:23.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.328+0000 7f376dab7640 1 -- start start 2024-09-11T22:21:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.328+0000 7f376dab7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37680d1c90 0x7f37680ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.328+0000 7f376dab7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f376815e8e0 0x7f376815de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.328+0000 7f376dab7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3768162a60 0x7f37680abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.328+0000 7f376dab7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f37680d3c10 con 0x7f376815e8e0 2024-09-11T22:21:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.328+0000 7f376dab7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f37680d3a90 con 0x7f3768162a60 2024-09-11T22:21:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.328+0000 7f376dab7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f37680d3d90 con 0x7f37680d1c90 2024-09-11T22:21:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f3766ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f376815e8e0 0x7f376815de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f3766ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f376815e8e0 0x7f376815de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56226/0 (socket says 172.21.15.50:56226) 2024-09-11T22:21:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f3766ffd640 1 -- 172.21.15.50:0/2538078724 learned_addr learned my addr 172.21.15.50:0/2538078724 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f37677fe640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37680d1c90 0x7f37680ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f3767fff640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3768162a60 0x7f37680abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f3766ffd640 1 -- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37680d1c90 msgr2=0x7f37680ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f3766ffd640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37680d1c90 0x7f37680ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f3766ffd640 1 -- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3768162a60 msgr2=0x7f37680abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f3766ffd640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3768162a60 0x7f37680abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f3766ffd640 1 -- 172.21.15.50:0/2538078724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37680ae0a0 con 0x7f376815e8e0 2024-09-11T22:21:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f3766ffd640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f376815e8e0 0x7f376815de20 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f375c00c500 tx=0x7f375c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f374ffff640 1 -- 172.21.15.50:0/2538078724 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c017070 con 0x7f376815e8e0 2024-09-11T22:21:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f374ffff640 1 -- 172.21.15.50:0/2538078724 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c005ce0 con 0x7f376815e8e0 2024-09-11T22:21:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f376dab7640 1 -- 172.21.15.50:0/2538078724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37680ae380 con 0x7f376815e8e0 2024-09-11T22:21:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f374ffff640 1 -- 172.21.15.50:0/2538078724 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c007330 con 0x7f376815e8e0 2024-09-11T22:21:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.329+0000 7f376dab7640 1 -- 172.21.15.50:0/2538078724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37680ae940 con 0x7f376815e8e0 2024-09-11T22:21:23.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.330+0000 7f376dab7640 1 -- 172.21.15.50:0/2538078724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37680b5430 con 0x7f376815e8e0 2024-09-11T22:21:23.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.331+0000 7f374ffff640 1 -- 172.21.15.50:0/2538078724 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f375c01a070 con 0x7f376815e8e0 2024-09-11T22:21:23.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.331+0000 7f374ffff640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f375406be30 0x7f375406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:23.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.331+0000 7f374ffff640 1 -- 172.21.15.50:0/2538078724 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f375c08a1a0 con 0x7f376815e8e0 2024-09-11T22:21:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.332+0000 7f37677fe640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f375406be30 0x7f375406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.332+0000 7f37677fe640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f375406be30 0x7f375406e2f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3758001780 tx=0x7f3758009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.336+0000 7f374ffff640 1 -- 172.21.15.50:0/2538078724 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f375c058650 con 0x7f376815e8e0 2024-09-11T22:21:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.546+0000 7f376dab7640 1 -- 172.21.15.50:0/2538078724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37680b7880 con 0x7f376815e8e0 2024-09-11T22:21:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.547+0000 7f374ffff640 1 -- 172.21.15.50:0/2538078724 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5233 (secure 0 0 0) 0x7f375c05c950 con 0x7f376815e8e0 2024-09-11T22:21:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:23.548 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:20:50.638363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9426":{"gid":9426,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3562809701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3562809701},{"type":"v1","addr":"172.21.15.50:6835","nonce":3562809701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9426,"qdb_cluster":[9426]},"id":11}]} 2024-09-11T22:21:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 109 2024-09-11T22:21:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.549+0000 7f376dab7640 1 -- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f375406be30 msgr2=0x7f375406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.549+0000 7f376dab7640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f375406be30 0x7f375406e2f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3758001780 tx=0x7f3758009040 comp rx=0 tx=0).stop 2024-09-11T22:21:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.549+0000 7f376dab7640 1 -- 172.21.15.50:0/2538078724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f376815e8e0 msgr2=0x7f376815de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.549+0000 7f376dab7640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f376815e8e0 0x7f376815de20 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f375c00c500 tx=0x7f375c00c9c0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.549+0000 7f376dab7640 1 -- 172.21.15.50:0/2538078724 shutdown_connections 2024-09-11T22:21:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.549+0000 7f376dab7640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f375406be30 0x7f375406e2f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.549+0000 7f376dab7640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3768162a60 0x7f37680abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.549+0000 7f376dab7640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f376815e8e0 0x7f376815de20 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.549+0000 7f376dab7640 1 --2- 172.21.15.50:0/2538078724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37680d1c90 0x7f37680ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.549+0000 7f376dab7640 1 -- 172.21.15.50:0/2538078724 >> 172.21.15.50:0/2538078724 conn(0x7f3768067ba0 msgr2=0x7f37680d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.549+0000 7f376dab7640 1 -- 172.21.15.50:0/2538078724 shutdown_connections 2024-09-11T22:21:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:23.549+0000 7f376dab7640 1 -- 172.21.15.50:0/2538078724 wait complete. 2024-09-11T22:21:23.561 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-11T22:21:28.562 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:28.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.677+0000 7f96dfa0a640 1 Processor -- start 2024-09-11T22:21:28.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.678+0000 7f96dfa0a640 1 -- start start 2024-09-11T22:21:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.678+0000 7f96dfa0a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96d80d18a0 0x7f96d80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.678+0000 7f96dfa0a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96d80d3a30 0x7f96d80b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.678+0000 7f96dfa0a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d80cfa80 con 0x7f96d815e870 2024-09-11T22:21:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.678+0000 7f96dfa0a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f96d80d3ea0 con 0x7f96d80d18a0 2024-09-11T22:21:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.678+0000 7f96dfa0a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f96d80d40d0 con 0x7f96d80d3a30 2024-09-11T22:21:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.679+0000 7f96dcfa5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96d80d18a0 0x7f96d80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.679+0000 7f96dcfa5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96d80d18a0 0x7f96d80d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39466/0 (socket says 172.21.15.50:39466) 2024-09-11T22:21:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.679+0000 7f96dcfa5640 1 -- 172.21.15.50:0/3023602939 learned_addr learned my addr 172.21.15.50:0/3023602939 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.679+0000 7f96ddfa7640 1 --2- 172.21.15.50:0/3023602939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96d80d3a30 0x7f96d80b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:28.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.679+0000 7f96dcfa5640 1 -- 172.21.15.50:0/3023602939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96d80d3a30 msgr2=0x7f96d80b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:28.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.679+0000 7f96dcfa5640 1 --2- 172.21.15.50:0/3023602939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96d80d3a30 0x7f96d80b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.679+0000 7f96dcfa5640 1 -- 172.21.15.50:0/3023602939 >> v1:172.21.15.77:6789/0 conn(0x7f96d815e870 legacy=0x7f96d80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:28.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.679+0000 7f96dcfa5640 1 -- 172.21.15.50:0/3023602939 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d80d43b0 con 0x7f96d80d18a0 2024-09-11T22:21:28.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.679+0000 7f96ddfa7640 1 --2- 172.21.15.50:0/3023602939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96d80d3a30 0x7f96d80b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:28.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.680+0000 7f96dcfa5640 1 --2- 172.21.15.50:0/3023602939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80d18a0 0x7f96d80d34f0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009870 tx=0x7f96c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d43332f789fd28d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:28.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.680+0000 7f96cffff640 1 -- 172.21.15.50:0/3023602939 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8037070 con 0x7f96d80d18a0 2024-09-11T22:21:28.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.680+0000 7f96cffff640 1 -- 172.21.15.50:0/3023602939 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c8032440 con 0x7f96d80d18a0 2024-09-11T22:21:28.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.680+0000 7f96cffff640 1 -- 172.21.15.50:0/3023602939 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8032810 con 0x7f96d80d18a0 2024-09-11T22:21:28.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.680+0000 7f96dfa0a640 1 -- 172.21.15.50:0/3023602939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80d18a0 msgr2=0x7f96d80d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.680+0000 7f96dfa0a640 1 --2- 172.21.15.50:0/3023602939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80d18a0 0x7f96d80d34f0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009870 tx=0x7f96c802a270 comp rx=0 tx=0).stop 2024-09-11T22:21:28.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.681+0000 7f96dfa0a640 1 -- 172.21.15.50:0/3023602939 shutdown_connections 2024-09-11T22:21:28.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.681+0000 7f96dfa0a640 1 --2- 172.21.15.50:0/3023602939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96d80d3a30 0x7f96d80b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.681+0000 7f96dfa0a640 1 --2- 172.21.15.50:0/3023602939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80d18a0 0x7f96d80d34f0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.681+0000 7f96dfa0a640 1 -- 172.21.15.50:0/3023602939 >> 172.21.15.50:0/3023602939 conn(0x7f96d80727a0 msgr2=0x7f96d80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:28.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.681+0000 7f96dfa0a640 1 -- 172.21.15.50:0/3023602939 shutdown_connections 2024-09-11T22:21:28.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.681+0000 7f96dfa0a640 1 -- 172.21.15.50:0/3023602939 wait complete. 2024-09-11T22:21:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.682+0000 7f96dfa0a640 1 Processor -- start 2024-09-11T22:21:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.682+0000 7f96dfa0a640 1 -- start start 2024-09-11T22:21:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dfa0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96d80d18a0 0x7f96d80cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dfa0a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80d3a30 0x7f96d80cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dfa0a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96d815e870 0x7f96d81f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dfa0a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96d815ec50 con 0x7f96d80d3a30 2024-09-11T22:21:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dfa0a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f96d80b7ee0 con 0x7f96d80d18a0 2024-09-11T22:21:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dfa0a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f96d80b78b0 con 0x7f96d815e870 2024-09-11T22:21:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dcfa5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80d3a30 0x7f96d80cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dcfa5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80d3a30 0x7f96d80cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39474/0 (socket says 172.21.15.50:39474) 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dcfa5640 1 -- 172.21.15.50:0/1433352707 learned_addr learned my addr 172.21.15.50:0/1433352707 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dd7a6640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96d80d18a0 0x7f96d80cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96ddfa7640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96d815e870 0x7f96d81f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dcfa5640 1 -- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96d815e870 msgr2=0x7f96d81f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dcfa5640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96d815e870 0x7f96d81f4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dcfa5640 1 -- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96d80d18a0 msgr2=0x7f96d80cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dcfa5640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96d80d18a0 0x7f96d80cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dcfa5640 1 -- 172.21.15.50:0/1433352707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d80cd5f0 con 0x7f96d80d3a30 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96dcfa5640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80d3a30 0x7f96d80cc880 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f96c8000c00 tx=0x7f96c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.683+0000 7f96cdffb640 1 -- 172.21.15.50:0/1433352707 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8037040 con 0x7f96d80d3a30 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.684+0000 7f96cdffb640 1 -- 172.21.15.50:0/1433352707 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c8042070 con 0x7f96d80d3a30 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.684+0000 7f96dfa0a640 1 -- 172.21.15.50:0/1433352707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d80cd8d0 con 0x7f96d80d3a30 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.684+0000 7f96cdffb640 1 -- 172.21.15.50:0/1433352707 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8030bd0 con 0x7f96d80d3a30 2024-09-11T22:21:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.684+0000 7f96dfa0a640 1 -- 172.21.15.50:0/1433352707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d80cde90 con 0x7f96d80d3a30 2024-09-11T22:21:28.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.685+0000 7f96dfa0a640 1 -- 172.21.15.50:0/1433352707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d80d34f0 con 0x7f96d80d3a30 2024-09-11T22:21:28.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.685+0000 7f96cdffb640 1 -- 172.21.15.50:0/1433352707 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96c8047460 con 0x7f96d80d3a30 2024-09-11T22:21:28.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.686+0000 7f96cdffb640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96bc06be30 0x7f96bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.686+0000 7f96cdffb640 1 -- 172.21.15.50:0/1433352707 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f96c80ab9f0 con 0x7f96d80d3a30 2024-09-11T22:21:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.686+0000 7f96dd7a6640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96bc06be30 0x7f96bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.687+0000 7f96dd7a6640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96bc06be30 0x7f96bc06e2f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f96d4000f60 tx=0x7f96d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:28.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.690+0000 7f96cdffb640 1 -- 172.21.15.50:0/1433352707 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96c8079cd0 con 0x7f96d80d3a30 2024-09-11T22:21:28.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.901+0000 7f96dfa0a640 1 -- 172.21.15.50:0/1433352707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96d8067a60 con 0x7f96d80d3a30 2024-09-11T22:21:28.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.901+0000 7f96cdffb640 1 -- 172.21.15.50:0/1433352707 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5233 (secure 0 0 0) 0x7f96c807dfd0 con 0x7f96d80d3a30 2024-09-11T22:21:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:28.902 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:20:50.638363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9426":{"gid":9426,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3562809701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3562809701},{"type":"v1","addr":"172.21.15.50:6835","nonce":3562809701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9426,"qdb_cluster":[9426]},"id":11}]} 2024-09-11T22:21:28.902 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 109 2024-09-11T22:21:28.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.903+0000 7f96dfa0a640 1 -- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96bc06be30 msgr2=0x7f96bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.903+0000 7f96dfa0a640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96bc06be30 0x7f96bc06e2f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f96d4000f60 tx=0x7f96d4009040 comp rx=0 tx=0).stop 2024-09-11T22:21:28.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.903+0000 7f96dfa0a640 1 -- 172.21.15.50:0/1433352707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80d3a30 msgr2=0x7f96d80cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.903+0000 7f96dfa0a640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80d3a30 0x7f96d80cc880 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f96c8000c00 tx=0x7f96c80046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.903+0000 7f96dfa0a640 1 -- 172.21.15.50:0/1433352707 shutdown_connections 2024-09-11T22:21:28.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.903+0000 7f96dfa0a640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f96bc06be30 0x7f96bc06e2f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.903+0000 7f96dfa0a640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96d815e870 0x7f96d81f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.903+0000 7f96dfa0a640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80d3a30 0x7f96d80cc880 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.903+0000 7f96dfa0a640 1 --2- 172.21.15.50:0/1433352707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96d80d18a0 0x7f96d80cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.903+0000 7f96dfa0a640 1 -- 172.21.15.50:0/1433352707 >> 172.21.15.50:0/1433352707 conn(0x7f96d80727a0 msgr2=0x7f96d80b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:28.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.903+0000 7f96dfa0a640 1 -- 172.21.15.50:0/1433352707 shutdown_connections 2024-09-11T22:21:28.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:28.903+0000 7f96dfa0a640 1 -- 172.21.15.50:0/1433352707 wait complete. 2024-09-11T22:21:28.915 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-11T22:21:33.916 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:34.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.030+0000 7f4ac905c640 1 Processor -- start 2024-09-11T22:21:34.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.030+0000 7f4ac905c640 1 -- start start 2024-09-11T22:21:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.031+0000 7f4ac905c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac415e870 0x7f4ac40d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.031+0000 7f4ac905c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac40cfa80 con 0x7f4ac40d16d0 2024-09-11T22:21:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.031+0000 7f4ac905c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac40d40d0 con 0x7f4ac40d3c00 2024-09-11T22:21:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.031+0000 7f4ac905c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac40d1b10 con 0x7f4ac415e870 2024-09-11T22:21:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.031+0000 7f4ac259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4ac40d16d0 0x7f4ac40d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:48590/0 (socket says 172.21.15.50:48590) 2024-09-11T22:21:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.031+0000 7f4ac259c640 1 -- 172.21.15.50:0/1995573539 learned_addr learned my addr 172.21.15.50:0/1995573539 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.032+0000 7f4ac2d9d640 1 --2- 172.21.15.50:0/1995573539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac415e870 0x7f4ac40d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.032+0000 7f4ac1d9b640 1 -- 172.21.15.50:0/1995573539 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806267600 0 0) 0x7f4ab8001110 con 0x7f4ac40d16d0 2024-09-11T22:21:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.032+0000 7f4ac1d9b640 1 -- 172.21.15.50:0/1995573539 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aac003520 con 0x7f4ac40d16d0 2024-09-11T22:21:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.032+0000 7f4ac1d9b640 1 -- 172.21.15.50:0/1995573539 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 684280656 0 0) 0x7f4ac40d40d0 con 0x7f4ac40d3c00 2024-09-11T22:21:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.032+0000 7f4ac1d9b640 1 -- 172.21.15.50:0/1995573539 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ab8001110 con 0x7f4ac40d3c00 2024-09-11T22:21:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.032+0000 7f4ac2d9d640 1 -- 172.21.15.50:0/1995573539 >> v1:172.21.15.77:6789/0 conn(0x7f4ac40d3c00 legacy=0x7f4ac40b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.032+0000 7f4ac2d9d640 1 -- 172.21.15.50:0/1995573539 >> v1:172.21.15.50:6789/0 conn(0x7f4ac40d16d0 legacy=0x7f4ac40d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.032+0000 7f4ac1d9b640 1 -- 172.21.15.50:0/1995573539 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 772156889 0 0) 0x7f4aac003520 con 0x7f4ac40d16d0 2024-09-11T22:21:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.032+0000 7f4ac2d9d640 1 -- 172.21.15.50:0/1995573539 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac40d43b0 con 0x7f4ac415e870 2024-09-11T22:21:34.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.033+0000 7f4ac2d9d640 1 --2- 172.21.15.50:0/1995573539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac415e870 0x7f4ac40d1190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40097d0 tx=0x7f4ab402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9847cc6fc260d01f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:34.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.033+0000 7f4ac1d9b640 1 -- 172.21.15.50:0/1995573539 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4037070 con 0x7f4ac415e870 2024-09-11T22:21:34.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.033+0000 7f4ac1d9b640 1 -- 172.21.15.50:0/1995573539 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab402ac30 con 0x7f4ac415e870 2024-09-11T22:21:34.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.033+0000 7f4ac1d9b640 1 -- 172.21.15.50:0/1995573539 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8001860 con 0x7f4ac415e870 2024-09-11T22:21:34.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.034+0000 7f4ac905c640 1 -- 172.21.15.50:0/1995573539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac415e870 msgr2=0x7f4ac40d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.034+0000 7f4ac905c640 1 --2- 172.21.15.50:0/1995573539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac415e870 0x7f4ac40d1190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40097d0 tx=0x7f4ab402a1a0 comp rx=0 tx=0).stop 2024-09-11T22:21:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.034+0000 7f4ac905c640 1 -- 172.21.15.50:0/1995573539 shutdown_connections 2024-09-11T22:21:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.034+0000 7f4ac905c640 1 --2- 172.21.15.50:0/1995573539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac415e870 0x7f4ac40d1190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.034+0000 7f4ac905c640 1 -- 172.21.15.50:0/1995573539 >> 172.21.15.50:0/1995573539 conn(0x7f4ac40727a0 msgr2=0x7f4ac40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.034+0000 7f4ac905c640 1 -- 172.21.15.50:0/1995573539 shutdown_connections 2024-09-11T22:21:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.034+0000 7f4ac905c640 1 -- 172.21.15.50:0/1995573539 wait complete. 2024-09-11T22:21:34.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.035+0000 7f4ac905c640 1 Processor -- start 2024-09-11T22:21:34.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.035+0000 7f4ac905c640 1 -- start start 2024-09-11T22:21:34.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.036+0000 7f4ac905c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac40d16d0 0x7f4ac40cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:34.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.036+0000 7f4ac905c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac40d3c00 0x7f4ac40abb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:34.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.036+0000 7f4ac905c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac415e870 0x7f4ac40af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:34.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.036+0000 7f4ac905c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac415ec50 con 0x7f4ac415e870 2024-09-11T22:21:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.036+0000 7f4ac905c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac40b7ee0 con 0x7f4ac40d16d0 2024-09-11T22:21:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.036+0000 7f4ac905c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac40b78b0 con 0x7f4ac40d3c00 2024-09-11T22:21:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.036+0000 7f4ac359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac415e870 0x7f4ac40af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.036+0000 7f4ac359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac415e870 0x7f4ac40af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39484/0 (socket says 172.21.15.50:39484) 2024-09-11T22:21:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.036+0000 7f4ac359e640 1 -- 172.21.15.50:0/4224346033 learned_addr learned my addr 172.21.15.50:0/4224346033 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.036+0000 7f4ac2d9d640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac40d16d0 0x7f4ac40cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.036+0000 7f4ac259c640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac40d3c00 0x7f4ac40abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.037+0000 7f4ac359e640 1 -- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac40d3c00 msgr2=0x7f4ac40abb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.037+0000 7f4ac359e640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac40d3c00 0x7f4ac40abb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.037+0000 7f4ac359e640 1 -- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac40d16d0 msgr2=0x7f4ac40cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.037+0000 7f4ac359e640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac40d16d0 0x7f4ac40cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.037+0000 7f4ac359e640 1 -- 172.21.15.50:0/4224346033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac40cf380 con 0x7f4ac415e870 2024-09-11T22:21:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.037+0000 7f4ac2d9d640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac40d16d0 0x7f4ac40cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.037+0000 7f4ac359e640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac415e870 0x7f4ac40af200 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00c7c0 tx=0x7f4abc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.037+0000 7f4aab7fe640 1 -- 172.21.15.50:0/4224346033 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc003b70 con 0x7f4ac415e870 2024-09-11T22:21:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.037+0000 7f4aab7fe640 1 -- 172.21.15.50:0/4224346033 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4abc003d10 con 0x7f4ac415e870 2024-09-11T22:21:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.037+0000 7f4ac905c640 1 -- 172.21.15.50:0/4224346033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac40cc8a0 con 0x7f4ac415e870 2024-09-11T22:21:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.037+0000 7f4aab7fe640 1 -- 172.21.15.50:0/4224346033 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc00aa50 con 0x7f4ac415e870 2024-09-11T22:21:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.037+0000 7f4ac905c640 1 -- 172.21.15.50:0/4224346033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac40cce60 con 0x7f4ac415e870 2024-09-11T22:21:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.038+0000 7f4ac905c640 1 -- 172.21.15.50:0/4224346033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac40d1190 con 0x7f4ac415e870 2024-09-11T22:21:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.039+0000 7f4aab7fe640 1 -- 172.21.15.50:0/4224346033 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4abc00abf0 con 0x7f4ac415e870 2024-09-11T22:21:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.039+0000 7f4aab7fe640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ab006be30 0x7f4ab006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.039+0000 7f4aab7fe640 1 -- 172.21.15.50:0/4224346033 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f4abc08ad00 con 0x7f4ac415e870 2024-09-11T22:21:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.039+0000 7f4ac2d9d640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ab006be30 0x7f4ab006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:34.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.040+0000 7f4ac2d9d640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ab006be30 0x7f4ab006e2f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4034000 tx=0x7f4ab402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:34.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.044+0000 7f4aab7fe640 1 -- 172.21.15.50:0/4224346033 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ac40cf380 con 0x7f4ac415e870 2024-09-11T22:21:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.256+0000 7f4ac905c640 1 -- 172.21.15.50:0/4224346033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ac40b58e0 con 0x7f4ac415e870 2024-09-11T22:21:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.257+0000 7f4aab7fe640 1 -- 172.21.15.50:0/4224346033 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5233 (secure 0 0 0) 0x7f4abc059740 con 0x7f4ac415e870 2024-09-11T22:21:34.258 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:34.258 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":109,"btime":"2024-09-11T22:20:51:291496+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:20:50.638363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9426":{"gid":9426,"name":"a","rank":0,"incarnation":107,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3562809701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3562809701},{"type":"v1","addr":"172.21.15.50:6835","nonce":3562809701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9426,"qdb_cluster":[9426]},"id":11}]} 2024-09-11T22:21:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 109 2024-09-11T22:21:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.258+0000 7f4ac905c640 1 -- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ab006be30 msgr2=0x7f4ab006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.258+0000 7f4ac905c640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ab006be30 0x7f4ab006e2f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4034000 tx=0x7f4ab402e000 comp rx=0 tx=0).stop 2024-09-11T22:21:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.259+0000 7f4ac905c640 1 -- 172.21.15.50:0/4224346033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac415e870 msgr2=0x7f4ac40af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.259+0000 7f4ac905c640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac415e870 0x7f4ac40af200 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00c7c0 tx=0x7f4abc00cc80 comp rx=0 tx=0).stop 2024-09-11T22:21:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.259+0000 7f4ac905c640 1 -- 172.21.15.50:0/4224346033 shutdown_connections 2024-09-11T22:21:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.259+0000 7f4ac905c640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ab006be30 0x7f4ab006e2f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.259+0000 7f4ac905c640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ac40d3c00 0x7f4ac40abb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.259+0000 7f4ac905c640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac415e870 0x7f4ac40af200 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.259+0000 7f4ac905c640 1 --2- 172.21.15.50:0/4224346033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ac40d16d0 0x7f4ac40cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.259+0000 7f4ac905c640 1 -- 172.21.15.50:0/4224346033 >> 172.21.15.50:0/4224346033 conn(0x7f4ac40727a0 msgr2=0x7f4ac40b62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.259+0000 7f4ac905c640 1 -- 172.21.15.50:0/4224346033 shutdown_connections 2024-09-11T22:21:34.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:34.259+0000 7f4ac905c640 1 -- 172.21.15.50:0/4224346033 wait complete. 2024-09-11T22:21:34.271 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-11T22:21:39.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:39.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.378+0000 7f61eaf8d640 1 Processor -- start 2024-09-11T22:21:39.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.378+0000 7f61eaf8d640 1 -- start start 2024-09-11T22:21:39.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.379+0000 7f61eaf8d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61e40d18a0 0x7f61e40d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.379+0000 7f61eaf8d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61e40d3a30 0x7f61e40b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.379+0000 7f61eaf8d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e40cfa80 con 0x7f61e415e870 2024-09-11T22:21:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.379+0000 7f61eaf8d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f61e40d3ea0 con 0x7f61e40d3a30 2024-09-11T22:21:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.379+0000 7f61eaf8d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f61e40d40d0 con 0x7f61e40d18a0 2024-09-11T22:21:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.379+0000 7f61e952a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61e40d3a30 0x7f61e40b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.379+0000 7f61e952a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61e40d3a30 0x7f61e40b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39274/0 (socket says 172.21.15.50:39274) 2024-09-11T22:21:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.379+0000 7f61e952a640 1 -- 172.21.15.50:0/1825222952 learned_addr learned my addr 172.21.15.50:0/1825222952 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.379+0000 7f61e8d29640 1 --1- 172.21.15.50:0/1825222952 >> v1:172.21.15.50:6789/0 conn(0x7f61e415e870 0x7f61e40d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46018/0 (socket says 172.21.15.50:46018) 2024-09-11T22:21:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.380+0000 7f61e3fff640 1 --2- 172.21.15.50:0/1825222952 >> v2:172.21.15.77:3300/0 conn(0x7f61e40d18a0 0x7f61e40d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.380+0000 7f61e952a640 1 -- 172.21.15.50:0/1825222952 >> v2:172.21.15.77:3300/0 conn(0x7f61e40d18a0 msgr2=0x7f61e40d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:39.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.380+0000 7f61e952a640 1 --2- 172.21.15.50:0/1825222952 >> v2:172.21.15.77:3300/0 conn(0x7f61e40d18a0 0x7f61e40d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.380+0000 7f61e952a640 1 -- 172.21.15.50:0/1825222952 >> v1:172.21.15.50:6789/0 conn(0x7f61e415e870 legacy=0x7f61e40d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:39.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.380+0000 7f61e37fe640 1 -- 172.21.15.50:0/1825222952 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 304971845 0 0) 0x7f61cc001110 con 0x7f61e415e870 2024-09-11T22:21:39.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.380+0000 7f61e952a640 1 -- 172.21.15.50:0/1825222952 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e40d43b0 con 0x7f61e40d3a30 2024-09-11T22:21:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.381+0000 7f61e952a640 1 --2- 172.21.15.50:0/1825222952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40d3a30 0x7f61e40b8400 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f61e406c860 tx=0x7f61dc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffaabd3c464f2cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.381+0000 7f61e37fe640 1 -- 172.21.15.50:0/1825222952 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc036070 con 0x7f61e40d3a30 2024-09-11T22:21:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.381+0000 7f61e37fe640 1 -- 172.21.15.50:0/1825222952 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61dc031600 con 0x7f61e40d3a30 2024-09-11T22:21:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.381+0000 7f61e37fe640 1 -- 172.21.15.50:0/1825222952 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc0319d0 con 0x7f61e40d3a30 2024-09-11T22:21:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.381+0000 7f61eaf8d640 1 -- 172.21.15.50:0/1825222952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40d3a30 msgr2=0x7f61e40b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.381+0000 7f61eaf8d640 1 --2- 172.21.15.50:0/1825222952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40d3a30 0x7f61e40b8400 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f61e406c860 tx=0x7f61dc02a730 comp rx=0 tx=0).stop 2024-09-11T22:21:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.381+0000 7f61eaf8d640 1 -- 172.21.15.50:0/1825222952 shutdown_connections 2024-09-11T22:21:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.381+0000 7f61eaf8d640 1 --2- 172.21.15.50:0/1825222952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40d3a30 0x7f61e40b8400 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.381+0000 7f61eaf8d640 1 --2- 172.21.15.50:0/1825222952 >> v2:172.21.15.77:3300/0 conn(0x7f61e40d18a0 0x7f61e40d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.381+0000 7f61eaf8d640 1 -- 172.21.15.50:0/1825222952 >> 172.21.15.50:0/1825222952 conn(0x7f61e40727a0 msgr2=0x7f61e40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.381+0000 7f61eaf8d640 1 -- 172.21.15.50:0/1825222952 shutdown_connections 2024-09-11T22:21:39.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.381+0000 7f61eaf8d640 1 -- 172.21.15.50:0/1825222952 wait complete. 2024-09-11T22:21:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.383+0000 7f61eaf8d640 1 Processor -- start 2024-09-11T22:21:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.383+0000 7f61eaf8d640 1 -- start start 2024-09-11T22:21:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61eaf8d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40d18a0 0x7f61e41555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61eaf8d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61e40d3a30 0x7f61e4156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61eaf8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61e415e870 0x7f61e4159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61eaf8d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61e415ec50 con 0x7f61e40d18a0 2024-09-11T22:21:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61eaf8d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f61e40b7ee0 con 0x7f61e415e870 2024-09-11T22:21:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61eaf8d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f61e40b78b0 con 0x7f61e40d3a30 2024-09-11T22:21:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e8d29640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40d18a0 0x7f61e41555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e8d29640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40d18a0 0x7f61e41555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39284/0 (socket says 172.21.15.50:39284) 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e8d29640 1 -- 172.21.15.50:0/3032399650 learned_addr learned my addr 172.21.15.50:0/3032399650 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e3fff640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61e40d3a30 0x7f61e4156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e952a640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61e415e870 0x7f61e4159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e8d29640 1 -- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61e40d3a30 msgr2=0x7f61e4156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e8d29640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61e40d3a30 0x7f61e4156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e8d29640 1 -- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61e415e870 msgr2=0x7f61e4159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e8d29640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61e415e870 0x7f61e4159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e8d29640 1 -- 172.21.15.50:0/3032399650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e4159ac0 con 0x7f61e40d18a0 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e8d29640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40d18a0 0x7f61e41555b0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00c7b0 tx=0x7f61cc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e17fa640 1 -- 172.21.15.50:0/3032399650 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc018070 con 0x7f61e40d18a0 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e17fa640 1 -- 172.21.15.50:0/3032399650 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61cc0072d0 con 0x7f61e40d18a0 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61eaf8d640 1 -- 172.21.15.50:0/3032399650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e4156fb0 con 0x7f61e40d18a0 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.384+0000 7f61e17fa640 1 -- 172.21.15.50:0/3032399650 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0047e0 con 0x7f61e40d18a0 2024-09-11T22:21:39.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.385+0000 7f61eaf8d640 1 -- 172.21.15.50:0/3032399650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e4157570 con 0x7f61e40d18a0 2024-09-11T22:21:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.385+0000 7f61eaf8d640 1 -- 172.21.15.50:0/3032399650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e40d34f0 con 0x7f61e40d18a0 2024-09-11T22:21:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.386+0000 7f61e17fa640 1 -- 172.21.15.50:0/3032399650 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61cc01b070 con 0x7f61e40d18a0 2024-09-11T22:21:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.387+0000 7f61e17fa640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f61c406be30 0x7f61c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.387+0000 7f61e17fa640 1 -- 172.21.15.50:0/3032399650 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5795+0+0 (secure 0 0 0) 0x7f61cc08a0d0 con 0x7f61e40d18a0 2024-09-11T22:21:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.387+0000 7f61e3fff640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f61c406be30 0x7f61c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.388+0000 7f61e3fff640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f61c406be30 0x7f61c406e2f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f61e415c0d0 tx=0x7f61d4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:39.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.391+0000 7f61e17fa640 1 -- 172.21.15.50:0/3032399650 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61e40cfa80 con 0x7f61e40d18a0 2024-09-11T22:21:39.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.667+0000 7f61eaf8d640 1 -- 172.21.15.50:0/3032399650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61e40d1290 con 0x7f61e40d18a0 2024-09-11T22:21:39.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.668+0000 7f61e17fa640 1 -- 172.21.15.50:0/3032399650 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+4410 (secure 0 0 0) 0x7f61cc007d00 con 0x7f61e40d18a0 2024-09-11T22:21:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:39.669 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":113,"btime":"2024-09-11T22:21:39:065639+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:21:39.065632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":157,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9423":{"gid":9423,"name":"c","rank":0,"incarnation":110,"state":"up:active","state_seq":18,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9423,"qdb_cluster":[9423]},"id":11}]} 2024-09-11T22:21:39.669 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 113 2024-09-11T22:21:39.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.670+0000 7f61eaf8d640 1 -- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f61c406be30 msgr2=0x7f61c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:39.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.670+0000 7f61eaf8d640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f61c406be30 0x7f61c406e2f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f61e415c0d0 tx=0x7f61d4009190 comp rx=0 tx=0).stop 2024-09-11T22:21:39.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.670+0000 7f61eaf8d640 1 -- 172.21.15.50:0/3032399650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40d18a0 msgr2=0x7f61e41555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:39.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.670+0000 7f61eaf8d640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40d18a0 0x7f61e41555b0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00c7b0 tx=0x7f61cc00cc70 comp rx=0 tx=0).stop 2024-09-11T22:21:39.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.670+0000 7f61eaf8d640 1 -- 172.21.15.50:0/3032399650 shutdown_connections 2024-09-11T22:21:39.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.670+0000 7f61eaf8d640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f61c406be30 0x7f61c406e2f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.670+0000 7f61eaf8d640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61e40d3a30 0x7f61e4156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.670+0000 7f61eaf8d640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61e415e870 0x7f61e4159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.670+0000 7f61eaf8d640 1 --2- 172.21.15.50:0/3032399650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40d18a0 0x7f61e41555b0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.670+0000 7f61eaf8d640 1 -- 172.21.15.50:0/3032399650 >> 172.21.15.50:0/3032399650 conn(0x7f61e40727a0 msgr2=0x7f61e415d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:39.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.670+0000 7f61eaf8d640 1 -- 172.21.15.50:0/3032399650 shutdown_connections 2024-09-11T22:21:39.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.670+0000 7f61eaf8d640 1 -- 172.21.15.50:0/3032399650 wait complete. 2024-09-11T22:21:39.686 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-09-11T22:21:39.686 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:39.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.799+0000 7ff03e25c640 1 Processor -- start 2024-09-11T22:21:39.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.799+0000 7ff03e25c640 1 -- start start 2024-09-11T22:21:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.800+0000 7ff03e25c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0380d18a0 0x7ff0380d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.800+0000 7ff03e25c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0380cfa80 con 0x7ff03815e870 2024-09-11T22:21:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.800+0000 7ff03e25c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0380d40d0 con 0x7ff0380d3a30 2024-09-11T22:21:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.800+0000 7ff03e25c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff0380d3ea0 con 0x7ff0380d18a0 2024-09-11T22:21:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.800+0000 7ff0377fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff03815e870 0x7ff0380d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46026/0 (socket says 172.21.15.50:46026) 2024-09-11T22:21:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.800+0000 7ff0377fe640 1 -- 172.21.15.50:0/2401003431 learned_addr learned my addr 172.21.15.50:0/2401003431 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff02effd640 1 --2- 172.21.15.50:0/2401003431 >> v2:172.21.15.77:3300/0 conn(0x7ff0380d18a0 0x7ff0380d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3414908000 0 0) 0x7ff028001110 con 0x7ff03815e870 2024-09-11T22:21:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff024003520 con 0x7ff03815e870 2024-09-11T22:21:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3613368068 0 0) 0x7ff0380d40d0 con 0x7ff0380d3a30 2024-09-11T22:21:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff028001110 con 0x7ff0380d3a30 2024-09-11T22:21:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 849130989 0 0) 0x7ff024003520 con 0x7ff03815e870 2024-09-11T22:21:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 >> v2:172.21.15.77:3300/0 conn(0x7ff0380d18a0 msgr2=0x7ff0380d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 --2- 172.21.15.50:0/2401003431 >> v2:172.21.15.77:3300/0 conn(0x7ff0380d18a0 0x7ff0380d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 >> v1:172.21.15.77:6789/0 conn(0x7ff0380d3a30 legacy=0x7ff0380b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0380d43b0 con 0x7ff03815e870 2024-09-11T22:21:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7ff028001840 con 0x7ff03815e870 2024-09-11T22:21:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 >> v1:172.21.15.50:6789/0 conn(0x7ff03815e870 legacy=0x7ff0380d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 --2- 172.21.15.50:0/2401003431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff024003b90 0x7ff024003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 --2- 172.21.15.50:0/2401003431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff024004800 0x7ff024004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 --2- 172.21.15.50:0/2401003431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff024005210 0x7ff02400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff02400c110 con 0x7ff024003b90 2024-09-11T22:21:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff02400c2c0 con 0x7ff024004800 2024-09-11T22:21:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff02400c4c0 con 0x7ff024005210 2024-09-11T22:21:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff0377fe640 1 --2- 172.21.15.50:0/2401003431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff024003b90 0x7ff024003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.801+0000 7ff037fff640 1 --2- 172.21.15.50:0/2401003431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff024005210 0x7ff02400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.802+0000 7ff02effd640 1 --2- 172.21.15.50:0/2401003431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff024004800 0x7ff024004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.802+0000 7ff0377fe640 1 -- 172.21.15.50:0/2401003431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff024005210 msgr2=0x7ff02400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.802+0000 7ff0377fe640 1 --2- 172.21.15.50:0/2401003431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff024005210 0x7ff02400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.802+0000 7ff0377fe640 1 -- 172.21.15.50:0/2401003431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff024004800 msgr2=0x7ff024004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.802+0000 7ff0377fe640 1 --2- 172.21.15.50:0/2401003431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff024004800 0x7ff024004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.802+0000 7ff0377fe640 1 -- 172.21.15.50:0/2401003431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff024003520 con 0x7ff024003b90 2024-09-11T22:21:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.802+0000 7ff037fff640 1 -- 172.21.15.50:0/2401003431 reap_dead start 2024-09-11T22:21:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.802+0000 7ff02effd640 1 --2- 172.21.15.50:0/2401003431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff024004800 0x7ff024004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.803+0000 7ff0377fe640 1 --2- 172.21.15.50:0/2401003431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff024003b90 0x7ff024003f90 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7ff02800c2f0 tx=0x7ff024005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b88c276710b37a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.803+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028007dd0 con 0x7ff024003b90 2024-09-11T22:21:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.803+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff028005af0 con 0x7ff024003b90 2024-09-11T22:21:39.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.803+0000 7ff036ffd640 1 -- 172.21.15.50:0/2401003431 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028007070 con 0x7ff024003b90 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.804+0000 7ff03e25c640 1 -- 172.21.15.50:0/2401003431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff024003b90 msgr2=0x7ff024003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.804+0000 7ff03e25c640 1 --2- 172.21.15.50:0/2401003431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff024003b90 0x7ff024003f90 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7ff02800c2f0 tx=0x7ff024005830 comp rx=0 tx=0).stop 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.804+0000 7ff03e25c640 1 -- 172.21.15.50:0/2401003431 shutdown_connections 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.804+0000 7ff03e25c640 1 --2- 172.21.15.50:0/2401003431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff024003b90 0x7ff024003f90 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.804+0000 7ff03e25c640 1 -- 172.21.15.50:0/2401003431 >> 172.21.15.50:0/2401003431 conn(0x7ff0380727a0 msgr2=0x7ff0380679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.804+0000 7ff03e25c640 1 -- 172.21.15.50:0/2401003431 shutdown_connections 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.804+0000 7ff03e25c640 1 -- 172.21.15.50:0/2401003431 wait complete. 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.805+0000 7ff03e25c640 1 Processor -- start 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.805+0000 7ff03e25c640 1 -- start start 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.806+0000 7ff03e25c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff024003b90 0x7ff03815b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.806+0000 7ff03e25c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff038158850 0x7ff0380ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.806+0000 7ff03e25c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff03814f100 0x7ff0380cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.806+0000 7ff03e25c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff03815ec50 con 0x7ff038158850 2024-09-11T22:21:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.806+0000 7ff03e25c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0380b7ee0 con 0x7ff03814f100 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.806+0000 7ff03e25c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff0380b78b0 con 0x7ff024003b90 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.806+0000 7ff02effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff038158850 0x7ff0380ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.806+0000 7ff02effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff038158850 0x7ff0380ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39310/0 (socket says 172.21.15.50:39310) 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.806+0000 7ff02effd640 1 -- 172.21.15.50:0/1108277674 learned_addr learned my addr 172.21.15.50:0/1108277674 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.806+0000 7ff0377fe640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff024003b90 0x7ff03815b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.806+0000 7ff037fff640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff03814f100 0x7ff0380cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.807+0000 7ff02effd640 1 -- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff024003b90 msgr2=0x7ff03815b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.807+0000 7ff02effd640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff024003b90 0x7ff03815b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.807+0000 7ff02effd640 1 -- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff03814f100 msgr2=0x7ff0380cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.807+0000 7ff02effd640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff03814f100 0x7ff0380cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.807+0000 7ff02effd640 1 -- 172.21.15.50:0/1108277674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03814d670 con 0x7ff038158850 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.807+0000 7ff02effd640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff038158850 0x7ff0380ca610 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7ff02000e590 tx=0x7ff02000ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.807+0000 7ff034ff9640 1 -- 172.21.15.50:0/1108277674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020017070 con 0x7ff038158850 2024-09-11T22:21:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.807+0000 7ff034ff9640 1 -- 172.21.15.50:0/1108277674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff020013610 con 0x7ff038158850 2024-09-11T22:21:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.807+0000 7ff034ff9640 1 -- 172.21.15.50:0/1108277674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02000f040 con 0x7ff038158850 2024-09-11T22:21:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.807+0000 7ff03e25c640 1 -- 172.21.15.50:0/1108277674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03814d950 con 0x7ff038158850 2024-09-11T22:21:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.807+0000 7ff03e25c640 1 -- 172.21.15.50:0/1108277674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0380cab50 con 0x7ff038158850 2024-09-11T22:21:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.808+0000 7ff03e25c640 1 -- 172.21.15.50:0/1108277674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0380d34f0 con 0x7ff038158850 2024-09-11T22:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.809+0000 7ff034ff9640 1 -- 172.21.15.50:0/1108277674 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff02001a070 con 0x7ff038158850 2024-09-11T22:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.810+0000 7ff034ff9640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff01806be30 0x7ff01806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.810+0000 7ff034ff9640 1 -- 172.21.15.50:0/1108277674 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5795+0+0 (secure 0 0 0) 0x7ff02008a9d0 con 0x7ff038158850 2024-09-11T22:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.810+0000 7ff0377fe640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff01806be30 0x7ff01806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.811+0000 7ff0377fe640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff01806be30 0x7ff01806e2f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff028033000 tx=0x7ff02802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:39.816+0000 7ff034ff9640 1 -- 172.21.15.50:0/1108277674 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff020058c40 con 0x7ff038158850 2024-09-11T22:21:40.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.067+0000 7ff03e25c640 1 -- 172.21.15.50:0/1108277674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff03815d360 con 0x7ff038158850 2024-09-11T22:21:40.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.068+0000 7ff034ff9640 1 -- 172.21.15.50:0/1108277674 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+4410 (secure 0 0 0) 0x7ff02005cf40 con 0x7ff038158850 2024-09-11T22:21:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:40.069 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":113,"btime":"2024-09-11T22:21:39:065639+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:21:39.065632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":157,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9423":{"gid":9423,"name":"c","rank":0,"incarnation":110,"state":"up:active","state_seq":18,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9423,"qdb_cluster":[9423]},"id":11}]} 2024-09-11T22:21:40.069 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 113 2024-09-11T22:21:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.071+0000 7ff03e25c640 1 -- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff01806be30 msgr2=0x7ff01806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.071+0000 7ff03e25c640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff01806be30 0x7ff01806e2f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff028033000 tx=0x7ff02802e000 comp rx=0 tx=0).stop 2024-09-11T22:21:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.071+0000 7ff03e25c640 1 -- 172.21.15.50:0/1108277674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff038158850 msgr2=0x7ff0380ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.071+0000 7ff03e25c640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff038158850 0x7ff0380ca610 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7ff02000e590 tx=0x7ff02000ea50 comp rx=0 tx=0).stop 2024-09-11T22:21:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.071+0000 7ff03e25c640 1 -- 172.21.15.50:0/1108277674 shutdown_connections 2024-09-11T22:21:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.071+0000 7ff03e25c640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff01806be30 0x7ff01806e2f0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.071+0000 7ff03e25c640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff03814f100 0x7ff0380cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.071+0000 7ff03e25c640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff038158850 0x7ff0380ca610 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.071+0000 7ff03e25c640 1 --2- 172.21.15.50:0/1108277674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff024003b90 0x7ff03815b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.071+0000 7ff03e25c640 1 -- 172.21.15.50:0/1108277674 >> 172.21.15.50:0/1108277674 conn(0x7ff0380727a0 msgr2=0x7ff0380b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:40.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.071+0000 7ff03e25c640 1 -- 172.21.15.50:0/1108277674 shutdown_connections 2024-09-11T22:21:40.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.071+0000 7ff03e25c640 1 -- 172.21.15.50:0/1108277674 wait complete. 2024-09-11T22:21:40.083 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-11T22:21:40.083 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:21:40.182 INFO:tasks.ceph.mds.c.smithi050.stderr:2024-09-11T22:21:40.182+0000 7fcd34fc1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:21:40.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.185+0000 7f17c53c4640 1 Processor -- start 2024-09-11T22:21:40.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.185+0000 7f17c53c4640 1 -- start start 2024-09-11T22:21:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.185+0000 7f17c53c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17c015e8e0 0x7f17c00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17c53c4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f17c0162350 0x7f17c0162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17c53c4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17c0163080 con 0x7f17c00d1580 2024-09-11T22:21:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17c53c4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f17c015ecc0 con 0x7f17c0162350 2024-09-11T22:21:40.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17c53c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f17c00d2ad0 con 0x7f17c015e8e0 2024-09-11T22:21:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17b7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f17c00d1580 0x7f17c00d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46036/0 (socket says 172.21.15.50:46036) 2024-09-11T22:21:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17b7fff640 1 -- 172.21.15.50:0/1994682943 learned_addr learned my addr 172.21.15.50:0/1994682943 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17bf7fe640 1 --2- 172.21.15.50:0/1994682943 >> v2:172.21.15.77:3300/0 conn(0x7f17c0162350 0x7f17c0162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17beffd640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17c015e8e0 0x7f17c00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785957090 0 0) 0x7f17c0163080 con 0x7f17c00d1580 2024-09-11T22:21:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17ac003520 con 0x7f17c00d1580 2024-09-11T22:21:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1436065409 0 0) 0x7f17ac003520 con 0x7f17c00d1580 2024-09-11T22:21:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17c015e8e0 msgr2=0x7f17c00b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17c015e8e0 0x7f17c00b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 >> v2:172.21.15.77:3300/0 conn(0x7f17c0162350 msgr2=0x7f17c0162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 --2- 172.21.15.50:0/1994682943 >> v2:172.21.15.77:3300/0 conn(0x7f17c0162350 0x7f17c0162800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c00d2d20 con 0x7f17c00d1580 2024-09-11T22:21:40.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f17a8001670 con 0x7f17c00d1580 2024-09-11T22:21:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17bf7fe640 1 --2- 172.21.15.50:0/1994682943 >> v2:172.21.15.77:3300/0 conn(0x7f17c0162350 0x7f17c0162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17beffd640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17c015e8e0 0x7f17c00b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 >> v1:172.21.15.50:6789/0 conn(0x7f17c00d1580 legacy=0x7f17c00d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ac0039b0 0x7f17ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17ac004800 0x7f17ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17c015e8e0 0x7f17ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.186+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f17c00d2ad0 con 0x7f17ac004800 2024-09-11T22:21:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.187+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac00b9c0 con 0x7f17ac0039b0 2024-09-11T22:21:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.187+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f17ac00bb40 con 0x7f17c015e8e0 2024-09-11T22:21:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.187+0000 7f17b7fff640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17ac004800 0x7f17ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.187+0000 7f17beffd640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ac0039b0 0x7f17ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.187+0000 7f17bf7fe640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17c015e8e0 0x7f17ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.187+0000 7f17b7fff640 1 -- 172.21.15.50:0/1994682943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17c015e8e0 msgr2=0x7f17ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:40.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.187+0000 7f17b7fff640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17c015e8e0 0x7f17ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.187+0000 7f17b7fff640 1 -- 172.21.15.50:0/1994682943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ac0039b0 msgr2=0x7f17ac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:40.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.187+0000 7f17b7fff640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ac0039b0 0x7f17ac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.187+0000 7f17b7fff640 1 -- 172.21.15.50:0/1994682943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ac003520 con 0x7f17ac004800 2024-09-11T22:21:40.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.187+0000 7f17beffd640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ac0039b0 0x7f17ac003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:40.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.188+0000 7f17b7fff640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17ac004800 0x7f17ac004c80 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f17a8007fd0 tx=0x7f17ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c38a234e361c9fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:40.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.188+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a8007d50 con 0x7f17ac004800 2024-09-11T22:21:40.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.188+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a8005ad0 con 0x7f17ac004800 2024-09-11T22:21:40.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.188+0000 7f17be7fc640 1 -- 172.21.15.50:0/1994682943 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a8007070 con 0x7f17ac004800 2024-09-11T22:21:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.188+0000 7f17c53c4640 1 -- 172.21.15.50:0/1994682943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17ac004800 msgr2=0x7f17ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.188+0000 7f17c53c4640 1 --2- 172.21.15.50:0/1994682943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17ac004800 0x7f17ac004c80 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f17a8007fd0 tx=0x7f17ac005830 comp rx=0 tx=0).stop 2024-09-11T22:21:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.188+0000 7f17bf7fe640 1 -- 172.21.15.50:0/1994682943 reap_dead start 2024-09-11T22:21:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.188+0000 7f17c53c4640 1 -- 172.21.15.50:0/1994682943 shutdown_connections 2024-09-11T22:21:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.188+0000 7f17c53c4640 1 -- 172.21.15.50:0/1994682943 >> 172.21.15.50:0/1994682943 conn(0x7f17c0067ba0 msgr2=0x7f17c0067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.188+0000 7f17c53c4640 1 -- 172.21.15.50:0/1994682943 shutdown_connections 2024-09-11T22:21:40.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.188+0000 7f17c53c4640 1 -- 172.21.15.50:0/1994682943 wait complete. 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.190+0000 7f17c53c4640 1 Processor -- start 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.190+0000 7f17c53c4640 1 -- start start 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.190+0000 7f17c53c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ac004800 0x7f17c0161240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.190+0000 7f17c53c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c015fd10 0x7f17c015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.190+0000 7f17c53c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17c015b660 0x7f17c0158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.190+0000 7f17c53c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f17c0162d40 con 0x7f17c015fd10 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.190+0000 7f17c53c4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17c00d3370 con 0x7f17c015b660 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.190+0000 7f17c53c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f17c00b7880 con 0x7f17ac004800 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17b7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c015fd10 0x7f17c015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17b7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c015fd10 0x7f17c015b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39334/0 (socket says 172.21.15.50:39334) 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17b7fff640 1 -- 172.21.15.50:0/3196255110 learned_addr learned my addr 172.21.15.50:0/3196255110 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17beffd640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ac004800 0x7f17c0161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17bf7fe640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17c015b660 0x7f17c0158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17b7fff640 1 -- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ac004800 msgr2=0x7f17c0161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17b7fff640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ac004800 0x7f17c0161240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17b7fff640 1 -- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17c015b660 msgr2=0x7f17c0158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17b7fff640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17c015b660 0x7f17c0158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17b7fff640 1 -- 172.21.15.50:0/3196255110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c01601a0 con 0x7f17c015fd10 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17b7fff640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c015fd10 0x7f17c015b120 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f17a8001970 tx=0x7f17c00b77d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17b77fe640 1 -- 172.21.15.50:0/3196255110 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a8001430 con 0x7f17c015fd10 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17b77fe640 1 -- 172.21.15.50:0/3196255110 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a8042070 con 0x7f17c015fd10 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17b77fe640 1 -- 172.21.15.50:0/3196255110 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a80047e0 con 0x7f17c015fd10 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17c53c4640 1 -- 172.21.15.50:0/3196255110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c0160480 con 0x7f17c015fd10 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.191+0000 7f17c53c4640 1 -- 172.21.15.50:0/3196255110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c0160a40 con 0x7f17c015fd10 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.192+0000 7f17c53c4640 1 -- 172.21.15.50:0/3196255110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c00b7c10 con 0x7f17c015fd10 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.193+0000 7f17b77fe640 1 -- 172.21.15.50:0/3196255110 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f17a803b070 con 0x7f17c015fd10 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.193+0000 7f17b77fe640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f17a006be30 0x7f17a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.194+0000 7f17b77fe640 1 -- 172.21.15.50:0/3196255110 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5795+0+0 (secure 0 0 0) 0x7f17a80aa5b0 con 0x7f17c015fd10 2024-09-11T22:21:40.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.194+0000 7f17beffd640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f17a006be30 0x7f17a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.194+0000 7f17beffd640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f17a006be30 0x7f17a006e2f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009560 tx=0x7f17b0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:40.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.198+0000 7f17b77fe640 1 -- 172.21.15.50:0/3196255110 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f17a8078f90 con 0x7f17c015fd10 2024-09-11T22:21:40.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.444+0000 7f17c53c4640 1 -- 172.21.15.50:0/3196255110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f17c00ba770 con 0x7f17c015fd10 2024-09-11T22:21:40.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.444+0000 7f17b77fe640 1 -- 172.21.15.50:0/3196255110 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1513 (secure 0 0 0) 0x7f17a8078890 con 0x7f17c015fd10 2024-09-11T22:21:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:40.445 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":649,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":157,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077219659,"bytes_used":2584993792,"bytes_avail":770509119488,"bytes_total":773094113280,"read_bytes_sec":231465,"write_bytes_sec":113122,"read_op_per_sec":1,"write_op_per_sec":54},"fsmap":{"epoch":113,"btime":"2024-09-11T22:21:39:065639+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9423}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-09-11T22:21:37.515355+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:21:40.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.446+0000 7f17c53c4640 1 -- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f17a006be30 msgr2=0x7f17a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.446+0000 7f17c53c4640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f17a006be30 0x7f17a006e2f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009560 tx=0x7f17b0009190 comp rx=0 tx=0).stop 2024-09-11T22:21:40.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.446+0000 7f17c53c4640 1 -- 172.21.15.50:0/3196255110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c015fd10 msgr2=0x7f17c015b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.446+0000 7f17c53c4640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c015fd10 0x7f17c015b120 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f17a8001970 tx=0x7f17c00b77d0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.446+0000 7f17c53c4640 1 -- 172.21.15.50:0/3196255110 shutdown_connections 2024-09-11T22:21:40.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.446+0000 7f17c53c4640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f17a006be30 0x7f17a006e2f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.446+0000 7f17c53c4640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17c015b660 0x7f17c0158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.446+0000 7f17c53c4640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c015fd10 0x7f17c015b120 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.446+0000 7f17c53c4640 1 --2- 172.21.15.50:0/3196255110 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ac004800 0x7f17c0161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.446+0000 7f17c53c4640 1 -- 172.21.15.50:0/3196255110 >> 172.21.15.50:0/3196255110 conn(0x7f17c0067ba0 msgr2=0x7f17c0067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:40.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.446+0000 7f17c53c4640 1 -- 172.21.15.50:0/3196255110 shutdown_connections 2024-09-11T22:21:40.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.446+0000 7f17c53c4640 1 -- 172.21.15.50:0/3196255110 wait complete. 2024-09-11T22:21:40.458 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-11T22:21:40.458 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:21:40.458 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:21:40.503 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:21:40.547 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:21:40.547 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:21:40.547 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:21:40.547 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:21:40.564 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:21:40.564 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:21:40.621 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:21:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.764+0000 7f17a8253640 1 Processor -- start 2024-09-11T22:21:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.764+0000 7f17a8253640 1 -- start start 2024-09-11T22:21:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.765+0000 7f17a8253640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17a0162a60 0x7f17a00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.765+0000 7f17a8253640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a0163080 con 0x7f17a00d1c90 2024-09-11T22:21:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.765+0000 7f17a8253640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a00d2d20 con 0x7f17a015e8e0 2024-09-11T22:21:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.765+0000 7f17a8253640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f17a015ecc0 con 0x7f17a0162a60 2024-09-11T22:21:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.765+0000 7f17a57ee640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f17a00d1c90 0x7f17a0162350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46044/0 (socket says 172.21.15.50:46044) 2024-09-11T22:21:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.765+0000 7f17a57ee640 1 -- 172.21.15.50:0/852562512 learned_addr learned my addr 172.21.15.50:0/852562512 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:40.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.765+0000 7f17a67f0640 1 --2- 172.21.15.50:0/852562512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17a0162a60 0x7f17a00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.765+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 341834111 0 0) 0x7f17a0163080 con 0x7f17a00d1c90 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.765+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f178c003520 con 0x7f17a00d1c90 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 375034220 0 0) 0x7f178c003520 con 0x7f17a00d1c90 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17a0162a60 msgr2=0x7f17a00b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a4fed640 1 --2- 172.21.15.50:0/852562512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17a0162a60 0x7f17a00b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 >> v1:172.21.15.77:6789/0 conn(0x7f17a015e8e0 legacy=0x7f17a00d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a00d3000 con 0x7f17a00d1c90 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f1790001670 con 0x7f17a00d1c90 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 >> v1:172.21.15.50:6789/0 conn(0x7f17a00d1c90 legacy=0x7f17a0162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a4fed640 1 --2- 172.21.15.50:0/852562512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17a0162a60 0x7f178c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a4fed640 1 --2- 172.21.15.50:0/852562512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f178c003f20 0x7f178c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a4fed640 1 --2- 172.21.15.50:0/852562512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178c004d40 0x7f178c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f178c00b9f0 con 0x7f178c003f20 2024-09-11T22:21:40.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f178c00bba0 con 0x7f178c004d40 2024-09-11T22:21:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f178c00bda0 con 0x7f17a0162a60 2024-09-11T22:21:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a57ee640 1 --2- 172.21.15.50:0/852562512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f178c003f20 0x7f178c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a5fef640 1 --2- 172.21.15.50:0/852562512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17a0162a60 0x7f178c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a67f0640 1 --2- 172.21.15.50:0/852562512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178c004d40 0x7f178c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a57ee640 1 -- 172.21.15.50:0/852562512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17a0162a60 msgr2=0x7f178c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a57ee640 1 --2- 172.21.15.50:0/852562512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17a0162a60 0x7f178c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a57ee640 1 -- 172.21.15.50:0/852562512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178c004d40 msgr2=0x7f178c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a57ee640 1 --2- 172.21.15.50:0/852562512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178c004d40 0x7f178c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.766+0000 7f17a57ee640 1 -- 172.21.15.50:0/852562512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178c003520 con 0x7f178c003f20 2024-09-11T22:21:40.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.767+0000 7f17a57ee640 1 --2- 172.21.15.50:0/852562512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f178c003f20 0x7f178c004800 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f179000c210 tx=0x7f178c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195b93fdb1341d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.767+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1790007ce0 con 0x7f178c003f20 2024-09-11T22:21:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.767+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1790005af0 con 0x7f178c003f20 2024-09-11T22:21:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.767+0000 7f17a4fed640 1 -- 172.21.15.50:0/852562512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1790007070 con 0x7f178c003f20 2024-09-11T22:21:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.768+0000 7f17a8253640 1 -- 172.21.15.50:0/852562512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f178c003f20 msgr2=0x7f178c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.768+0000 7f17a8253640 1 --2- 172.21.15.50:0/852562512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f178c003f20 0x7f178c004800 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f179000c210 tx=0x7f178c005830 comp rx=0 tx=0).stop 2024-09-11T22:21:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.768+0000 7f17a67f0640 1 -- 172.21.15.50:0/852562512 reap_dead start 2024-09-11T22:21:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.768+0000 7f17a8253640 1 -- 172.21.15.50:0/852562512 shutdown_connections 2024-09-11T22:21:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.768+0000 7f17a8253640 1 -- 172.21.15.50:0/852562512 >> 172.21.15.50:0/852562512 conn(0x7f17a0067ba0 msgr2=0x7f17a0067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.768+0000 7f17a8253640 1 -- 172.21.15.50:0/852562512 shutdown_connections 2024-09-11T22:21:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.768+0000 7f17a8253640 1 -- 172.21.15.50:0/852562512 wait complete. 2024-09-11T22:21:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.769+0000 7f17a8253640 1 Processor -- start 2024-09-11T22:21:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.769+0000 7f17a8253640 1 -- start start 2024-09-11T22:21:40.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a8253640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178c003f20 0x7f17a01f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a8253640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17a015fd10 0x7f17a01f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a8253640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17a01f4d30 0x7f17a00b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a8253640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f17a00b7c50 con 0x7f17a015fd10 2024-09-11T22:21:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a8253640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17a00b7ad0 con 0x7f178c003f20 2024-09-11T22:21:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a8253640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f17a00d2ad0 con 0x7f17a01f4d30 2024-09-11T22:21:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a57ee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17a015fd10 0x7f17a01f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a57ee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17a015fd10 0x7f17a01f7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39356/0 (socket says 172.21.15.50:39356) 2024-09-11T22:21:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a57ee640 1 -- 172.21.15.50:0/3383539128 learned_addr learned my addr 172.21.15.50:0/3383539128 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a5fef640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178c003f20 0x7f17a01f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a67f0640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17a01f4d30 0x7f17a00b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a57ee640 1 -- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17a01f4d30 msgr2=0x7f17a00b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a57ee640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17a01f4d30 0x7f17a00b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a57ee640 1 -- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178c003f20 msgr2=0x7f17a01f5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a57ee640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178c003f20 0x7f17a01f5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a57ee640 1 -- 172.21.15.50:0/3383539128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a01601d0 con 0x7f17a015fd10 2024-09-11T22:21:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.770+0000 7f17a57ee640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17a015fd10 0x7f17a01f7130 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f179002acf0 tx=0x7f17a00b77d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.771+0000 7f17967fc640 1 -- 172.21.15.50:0/3383539128 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1790001430 con 0x7f17a015fd10 2024-09-11T22:21:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.771+0000 7f17967fc640 1 -- 172.21.15.50:0/3383539128 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1790038040 con 0x7f17a015fd10 2024-09-11T22:21:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.771+0000 7f17967fc640 1 -- 172.21.15.50:0/3383539128 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1790007070 con 0x7f17a015fd10 2024-09-11T22:21:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.771+0000 7f17a8253640 1 -- 172.21.15.50:0/3383539128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a01604b0 con 0x7f17a015fd10 2024-09-11T22:21:40.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.771+0000 7f17a8253640 1 -- 172.21.15.50:0/3383539128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a0160a70 con 0x7f17a015fd10 2024-09-11T22:21:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.772+0000 7f17a8253640 1 -- 172.21.15.50:0/3383539128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a0162350 con 0x7f17a015fd10 2024-09-11T22:21:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.772+0000 7f17967fc640 1 -- 172.21.15.50:0/3383539128 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1790044030 con 0x7f17a015fd10 2024-09-11T22:21:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.773+0000 7f17967fc640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f178406be60 0x7f178406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.773+0000 7f17967fc640 1 -- 172.21.15.50:0/3383539128 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5795+0+0 (secure 0 0 0) 0x7f17900aa8e0 con 0x7f17a015fd10 2024-09-11T22:21:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.773+0000 7f17a5fef640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f178406be60 0x7f178406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.773+0000 7f17a5fef640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f178406be60 0x7f178406e320 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f17a015e2d0 tx=0x7f179c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:40.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.777+0000 7f17967fc640 1 -- 172.21.15.50:0/3383539128 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f179004b020 con 0x7f17a015fd10 2024-09-11T22:21:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.963+0000 7f17a8253640 1 -- 172.21.15.50:0/3383539128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f17a00ba770 con 0x7f17a015fd10 2024-09-11T22:21:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.963+0000 7f17967fc640 1 -- 172.21.15.50:0/3383539128 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v157) ==== 80+0+122 (secure 0 0 0) 0x7f1790078bd0 con 0x7f17a015fd10 2024-09-11T22:21:40.964 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6835/3562809701 2024-09-12T22:21:36.057947+0000 2024-09-11T22:21:40.964 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6833/3562809701 2024-09-12T22:21:36.057947+0000 2024-09-11T22:21:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:listed 2 entries 2024-09-11T22:21:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.965+0000 7f17a8253640 1 -- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f178406be60 msgr2=0x7f178406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.965+0000 7f17a8253640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f178406be60 0x7f178406e320 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f17a015e2d0 tx=0x7f179c009040 comp rx=0 tx=0).stop 2024-09-11T22:21:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.965+0000 7f17a8253640 1 -- 172.21.15.50:0/3383539128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17a015fd10 msgr2=0x7f17a01f7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.965+0000 7f17a8253640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17a015fd10 0x7f17a01f7130 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f179002acf0 tx=0x7f17a00b77d0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.965+0000 7f17a8253640 1 -- 172.21.15.50:0/3383539128 shutdown_connections 2024-09-11T22:21:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.965+0000 7f17a8253640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f178406be60 0x7f178406e320 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.965+0000 7f17a8253640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17a01f4d30 0x7f17a00b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.965+0000 7f17a8253640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17a015fd10 0x7f17a01f7130 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.965+0000 7f17a8253640 1 --2- 172.21.15.50:0/3383539128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178c003f20 0x7f17a01f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.965+0000 7f17a8253640 1 -- 172.21.15.50:0/3383539128 >> 172.21.15.50:0/3383539128 conn(0x7f17a0067ba0 msgr2=0x7f17a00b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.965+0000 7f17a8253640 1 -- 172.21.15.50:0/3383539128 shutdown_connections 2024-09-11T22:21:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:40.965+0000 7f17a8253640 1 -- 172.21.15.50:0/3383539128 wait complete. 2024-09-11T22:21:40.977 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:21:40.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:21:40.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:21:41.039 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:21:41.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:21:41.039 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:21:41.055 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:21:41.055 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:21:41.055 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:21:41.074 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:21:41.074 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:21:41.074 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:21:41.074 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:21:41.112 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:21:41.112 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:21:41.112 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:21:41.112 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:21:41.133 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:21:41.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:41.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.254+0000 7f3430718640 1 Processor -- start 2024-09-11T22:21:41.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.254+0000 7f3430718640 1 -- start start 2024-09-11T22:21:41.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.255+0000 7f3430718640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f342815b400 0x7f342806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.255+0000 7f3430718640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3428072e60 0x7f342806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.255+0000 7f3430718640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342815b7e0 con 0x7f342806df20 2024-09-11T22:21:41.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.255+0000 7f3430718640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f342815f140 con 0x7f342815b400 2024-09-11T22:21:41.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.255+0000 7f3430718640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f342815f420 con 0x7f3428072e60 2024-09-11T22:21:41.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.255+0000 7f342e4b4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f342815b400 0x7f342806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.255+0000 7f342ecb5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f342806df20 0x7f34280b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46050/0 (socket says 172.21.15.50:46050) 2024-09-11T22:21:41.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.255+0000 7f342ecb5640 1 -- 172.21.15.50:0/2602522046 learned_addr learned my addr 172.21.15.50:0/2602522046 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:41.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.255+0000 7f342dcb3640 1 --2- 172.21.15.50:0/2602522046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3428072e60 0x7f342806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.255+0000 7f342e4b4640 1 -- 172.21.15.50:0/2602522046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3428072e60 msgr2=0x7f342806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:41.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.255+0000 7f342e4b4640 1 --2- 172.21.15.50:0/2602522046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3428072e60 0x7f342806d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.256+0000 7f342e4b4640 1 -- 172.21.15.50:0/2602522046 >> v1:172.21.15.50:6789/0 conn(0x7f342806df20 legacy=0x7f34280b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.256+0000 7f342e4b4640 1 -- 172.21.15.50:0/2602522046 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342815f700 con 0x7f342815b400 2024-09-11T22:21:41.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.256+0000 7f342d4b2640 1 -- 172.21.15.50:0/2602522046 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2436333824 0 0) 0x7f342815b7e0 con 0x7f342806df20 2024-09-11T22:21:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.256+0000 7f342e4b4640 1 --2- 172.21.15.50:0/2602522046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f342815b400 0x7f342806d070 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f342000ba40 tx=0x7f342002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa14e431db048c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.256+0000 7f342d4b2640 1 -- 172.21.15.50:0/2602522046 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420032750 con 0x7f342815b400 2024-09-11T22:21:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.256+0000 7f342d4b2640 1 -- 172.21.15.50:0/2602522046 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3420030050 con 0x7f342815b400 2024-09-11T22:21:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.256+0000 7f342d4b2640 1 -- 172.21.15.50:0/2602522046 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420032b10 con 0x7f342815b400 2024-09-11T22:21:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.257+0000 7f3430718640 1 -- 172.21.15.50:0/2602522046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f342815b400 msgr2=0x7f342806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.257+0000 7f3430718640 1 --2- 172.21.15.50:0/2602522046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f342815b400 0x7f342806d070 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f342000ba40 tx=0x7f342002c850 comp rx=0 tx=0).stop 2024-09-11T22:21:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.257+0000 7f3430718640 1 -- 172.21.15.50:0/2602522046 shutdown_connections 2024-09-11T22:21:41.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.257+0000 7f3430718640 1 --2- 172.21.15.50:0/2602522046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3428072e60 0x7f342806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.257+0000 7f3430718640 1 --2- 172.21.15.50:0/2602522046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f342815b400 0x7f342806d070 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.257+0000 7f3430718640 1 -- 172.21.15.50:0/2602522046 >> 172.21.15.50:0/2602522046 conn(0x7f34280679c0 msgr2=0x7f3428067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:41.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.257+0000 7f3430718640 1 -- 172.21.15.50:0/2602522046 shutdown_connections 2024-09-11T22:21:41.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.257+0000 7f3430718640 1 -- 172.21.15.50:0/2602522046 wait complete. 2024-09-11T22:21:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.258+0000 7f3430718640 1 Processor -- start 2024-09-11T22:21:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.258+0000 7f3430718640 1 -- start start 2024-09-11T22:21:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f3430718640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f342806df20 0x7f34281454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f3430718640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3428072e60 0x7f34280ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f3430718640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f342815b400 0x7f34280aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f3430718640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f34280721d0 con 0x7f342815b400 2024-09-11T22:21:41.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f3430718640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f34280cfc50 con 0x7f3428072e60 2024-09-11T22:21:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f3430718640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3428072350 con 0x7f342806df20 2024-09-11T22:21:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f342ecb5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f342815b400 0x7f34280aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f342ecb5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f342815b400 0x7f34280aee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39378/0 (socket says 172.21.15.50:39378) 2024-09-11T22:21:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f342ecb5640 1 -- 172.21.15.50:0/3765456365 learned_addr learned my addr 172.21.15.50:0/3765456365 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f342e4b4640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f342806df20 0x7f34281454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f342dcb3640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3428072e60 0x7f34280ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f342ecb5640 1 -- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f342806df20 msgr2=0x7f34281454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f342ecb5640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f342806df20 0x7f34281454e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f342ecb5640 1 -- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3428072e60 msgr2=0x7f34280ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f342ecb5640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3428072e60 0x7f34280ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f342ecb5640 1 -- 172.21.15.50:0/3765456365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34281590b0 con 0x7f342815b400 2024-09-11T22:21:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.259+0000 7f342dcb3640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3428072e60 0x7f34280ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:41.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.260+0000 7f342ecb5640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f342815b400 0x7f34280aee00 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f341800c700 tx=0x7f341800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:41.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.260+0000 7f3426ffd640 1 -- 172.21.15.50:0/3765456365 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418018070 con 0x7f342815b400 2024-09-11T22:21:41.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.260+0000 7f3426ffd640 1 -- 172.21.15.50:0/3765456365 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f341800ce10 con 0x7f342815b400 2024-09-11T22:21:41.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.260+0000 7f3426ffd640 1 -- 172.21.15.50:0/3765456365 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341800a860 con 0x7f342815b400 2024-09-11T22:21:41.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.260+0000 7f3430718640 1 -- 172.21.15.50:0/3765456365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34281489d0 con 0x7f342815b400 2024-09-11T22:21:41.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.260+0000 7f3430718640 1 -- 172.21.15.50:0/3765456365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3428159630 con 0x7f342815b400 2024-09-11T22:21:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.261+0000 7f3430718640 1 -- 172.21.15.50:0/3765456365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342806d9e0 con 0x7f342815b400 2024-09-11T22:21:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.261+0000 7f3426ffd640 1 -- 172.21.15.50:0/3765456365 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f341800aa00 con 0x7f342815b400 2024-09-11T22:21:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.262+0000 7f3426ffd640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f341406be60 0x7f341406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.262+0000 7f3426ffd640 1 -- 172.21.15.50:0/3765456365 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5795+0+0 (secure 0 0 0) 0x7f341808a330 con 0x7f342815b400 2024-09-11T22:21:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.262+0000 7f342e4b4640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f341406be60 0x7f341406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.263+0000 7f342e4b4640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f341406be60 0x7f341406e320 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3420037000 tx=0x7f3420032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:41.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.266+0000 7f3426ffd640 1 -- 172.21.15.50:0/3765456365 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3418058c80 con 0x7f342815b400 2024-09-11T22:21:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.479+0000 7f3430718640 1 -- 172.21.15.50:0/3765456365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f342815ecd0 con 0x7f342815b400 2024-09-11T22:21:41.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.480+0000 7f3426ffd640 1 -- 172.21.15.50:0/3765456365 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+4410 (secure 0 0 0) 0x7f3418058580 con 0x7f342815b400 2024-09-11T22:21:41.481 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:41.481 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":113,"btime":"2024-09-11T22:21:39:065639+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:21:39.065632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":157,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9423":{"gid":9423,"name":"c","rank":0,"incarnation":110,"state":"up:active","state_seq":18,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9423,"qdb_cluster":[9423]},"id":11}]} 2024-09-11T22:21:41.481 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 113 2024-09-11T22:21:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.482+0000 7f3430718640 1 -- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f341406be60 msgr2=0x7f341406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.482+0000 7f3430718640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f341406be60 0x7f341406e320 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3420037000 tx=0x7f3420032000 comp rx=0 tx=0).stop 2024-09-11T22:21:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.482+0000 7f3430718640 1 -- 172.21.15.50:0/3765456365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f342815b400 msgr2=0x7f34280aee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.482+0000 7f3430718640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f342815b400 0x7f34280aee00 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f341800c700 tx=0x7f341800cbc0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.482+0000 7f3430718640 1 -- 172.21.15.50:0/3765456365 shutdown_connections 2024-09-11T22:21:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.482+0000 7f3430718640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f341406be60 0x7f341406e320 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.482+0000 7f3430718640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f342815b400 0x7f34280aee00 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.482+0000 7f3430718640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3428072e60 0x7f34280ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.482+0000 7f3430718640 1 --2- 172.21.15.50:0/3765456365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f342806df20 0x7f34281454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.482+0000 7f3430718640 1 -- 172.21.15.50:0/3765456365 >> 172.21.15.50:0/3765456365 conn(0x7f34280679c0 msgr2=0x7f34280b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.482+0000 7f3430718640 1 -- 172.21.15.50:0/3765456365 shutdown_connections 2024-09-11T22:21:41.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.482+0000 7f3430718640 1 -- 172.21.15.50:0/3765456365 wait complete. 2024-09-11T22:21:41.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:41.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.595+0000 7fee5367b640 1 Processor -- start 2024-09-11T22:21:41.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.596+0000 7fee5367b640 1 -- start start 2024-09-11T22:21:41.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee5367b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fee4c15f350 0x7fee4c15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee5367b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee4c0679c0 0x7fee4c067e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee5367b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee4c15f7f0 con 0x7fee4c15c3c0 2024-09-11T22:21:41.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee5367b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fee4c06e700 con 0x7fee4c15f350 2024-09-11T22:21:41.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee5367b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fee4c15fad0 con 0x7fee4c0679c0 2024-09-11T22:21:41.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee51c18640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee4c0679c0 0x7fee4c067e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee50c16640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fee4c15f350 0x7fee4c15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee51417640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fee4c15c3c0 0x7fee4c15ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:49900/0 (socket says 172.21.15.50:49900) 2024-09-11T22:21:41.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee51417640 1 -- 172.21.15.50:0/2281906427 learned_addr learned my addr 172.21.15.50:0/2281906427 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:41.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee4bfff640 1 -- 172.21.15.50:0/2281906427 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990636264 0 0) 0x7fee4c15f7f0 con 0x7fee4c15c3c0 2024-09-11T22:21:41.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee4bfff640 1 -- 172.21.15.50:0/2281906427 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee34003520 con 0x7fee4c15c3c0 2024-09-11T22:21:41.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee51c18640 1 -- 172.21.15.50:0/2281906427 >> v2:172.21.15.77:3300/0 conn(0x7fee4c15f350 msgr2=0x7fee4c15fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:41.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee51c18640 1 --2- 172.21.15.50:0/2281906427 >> v2:172.21.15.77:3300/0 conn(0x7fee4c15f350 0x7fee4c15fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee51c18640 1 -- 172.21.15.50:0/2281906427 >> v1:172.21.15.77:6789/0 conn(0x7fee4c15c3c0 legacy=0x7fee4c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee51c18640 1 -- 172.21.15.50:0/2281906427 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4c06e950 con 0x7fee4c0679c0 2024-09-11T22:21:41.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.597+0000 7fee50c16640 1 --2- 172.21.15.50:0/2281906427 >> v2:172.21.15.77:3300/0 conn(0x7fee4c15f350 0x7fee4c15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:41.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.598+0000 7fee51c18640 1 --2- 172.21.15.50:0/2281906427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee4c0679c0 0x7fee4c067e50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009d90 tx=0x7fee3c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=105db3abae070483 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:41.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.598+0000 7fee4bfff640 1 -- 172.21.15.50:0/2281906427 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c031600 con 0x7fee4c0679c0 2024-09-11T22:21:41.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.598+0000 7fee4bfff640 1 -- 172.21.15.50:0/2281906427 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee3c0317a0 con 0x7fee4c0679c0 2024-09-11T22:21:41.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.598+0000 7fee4bfff640 1 -- 172.21.15.50:0/2281906427 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c031b50 con 0x7fee4c0679c0 2024-09-11T22:21:41.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.599+0000 7fee5367b640 1 -- 172.21.15.50:0/2281906427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee4c0679c0 msgr2=0x7fee4c067e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.599+0000 7fee5367b640 1 --2- 172.21.15.50:0/2281906427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee4c0679c0 0x7fee4c067e50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009d90 tx=0x7fee3c02a5d0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.599+0000 7fee5367b640 1 -- 172.21.15.50:0/2281906427 shutdown_connections 2024-09-11T22:21:41.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.599+0000 7fee5367b640 1 --2- 172.21.15.50:0/2281906427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee4c0679c0 0x7fee4c067e50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.599+0000 7fee5367b640 1 --2- 172.21.15.50:0/2281906427 >> v2:172.21.15.77:3300/0 conn(0x7fee4c15f350 0x7fee4c15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.599+0000 7fee5367b640 1 -- 172.21.15.50:0/2281906427 >> 172.21.15.50:0/2281906427 conn(0x7fee4c075060 msgr2=0x7fee4c06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:41.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.599+0000 7fee5367b640 1 -- 172.21.15.50:0/2281906427 shutdown_connections 2024-09-11T22:21:41.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.599+0000 7fee5367b640 1 -- 172.21.15.50:0/2281906427 wait complete. 2024-09-11T22:21:41.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.600+0000 7fee5367b640 1 Processor -- start 2024-09-11T22:21:41.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.600+0000 7fee5367b640 1 -- start start 2024-09-11T22:21:41.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee5367b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee4c0679c0 0x7fee4c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee5367b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee4c15c3c0 0x7fee4c14e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee5367b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee4c15f350 0x7fee4c0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee5367b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c06f150 con 0x7fee4c15c3c0 2024-09-11T22:21:41.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee5367b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c0d0940 con 0x7fee4c15f350 2024-09-11T22:21:41.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee5367b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fee4c06f2d0 con 0x7fee4c0679c0 2024-09-11T22:21:41.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee50c16640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee4c15c3c0 0x7fee4c14e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee50c16640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee4c15c3c0 0x7fee4c14e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39388/0 (socket says 172.21.15.50:39388) 2024-09-11T22:21:41.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee50c16640 1 -- 172.21.15.50:0/3560897768 learned_addr learned my addr 172.21.15.50:0/3560897768 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:41.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee51c18640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee4c15f350 0x7fee4c0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee51417640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee4c0679c0 0x7fee4c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee50c16640 1 -- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee4c0679c0 msgr2=0x7fee4c0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee50c16640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee4c0679c0 0x7fee4c0cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee50c16640 1 -- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee4c15f350 msgr2=0x7fee4c0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee50c16640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee4c15f350 0x7fee4c0aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.601+0000 7fee50c16640 1 -- 172.21.15.50:0/3560897768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4c14f4a0 con 0x7fee4c15c3c0 2024-09-11T22:21:41.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.602+0000 7fee50c16640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee4c15c3c0 0x7fee4c14e510 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fee4000e900 tx=0x7fee4000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:41.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.602+0000 7fee49ffb640 1 -- 172.21.15.50:0/3560897768 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40017070 con 0x7fee4c15c3c0 2024-09-11T22:21:41.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.602+0000 7fee49ffb640 1 -- 172.21.15.50:0/3560897768 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee4000ca00 con 0x7fee4c15c3c0 2024-09-11T22:21:41.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.602+0000 7fee5367b640 1 -- 172.21.15.50:0/3560897768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4c0cbc50 con 0x7fee4c15c3c0 2024-09-11T22:21:41.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.602+0000 7fee49ffb640 1 -- 172.21.15.50:0/3560897768 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4000cdf0 con 0x7fee4c15c3c0 2024-09-11T22:21:41.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.602+0000 7fee5367b640 1 -- 172.21.15.50:0/3560897768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee4c0cc210 con 0x7fee4c15c3c0 2024-09-11T22:21:41.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.603+0000 7fee5367b640 1 -- 172.21.15.50:0/3560897768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee4c15fe60 con 0x7fee4c15c3c0 2024-09-11T22:21:41.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.604+0000 7fee49ffb640 1 -- 172.21.15.50:0/3560897768 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee4001a070 con 0x7fee4c15c3c0 2024-09-11T22:21:41.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.604+0000 7fee49ffb640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee3806be30 0x7fee3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.604+0000 7fee49ffb640 1 -- 172.21.15.50:0/3560897768 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5795+0+0 (secure 0 0 0) 0x7fee4008acb0 con 0x7fee4c15c3c0 2024-09-11T22:21:41.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.604+0000 7fee51417640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee3806be30 0x7fee3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.605+0000 7fee51417640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee3806be30 0x7fee3806e2f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fee440011e0 tx=0x7fee44007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:41.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.608+0000 7fee49ffb640 1 -- 172.21.15.50:0/3560897768 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee40059040 con 0x7fee4c15c3c0 2024-09-11T22:21:41.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.820+0000 7fee5367b640 1 -- 172.21.15.50:0/3560897768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee4c06bcf0 con 0x7fee4c15c3c0 2024-09-11T22:21:41.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.820+0000 7fee49ffb640 1 -- 172.21.15.50:0/3560897768 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+4410 (secure 0 0 0) 0x7fee4005d340 con 0x7fee4c15c3c0 2024-09-11T22:21:41.821 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:41.821 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":113,"btime":"2024-09-11T22:21:39:065639+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:21:39.065632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":157,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9423":{"gid":9423,"name":"c","rank":0,"incarnation":110,"state":"up:active","state_seq":18,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9423,"qdb_cluster":[9423]},"id":11}]} 2024-09-11T22:21:41.821 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 113 2024-09-11T22:21:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.822+0000 7fee5367b640 1 -- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee3806be30 msgr2=0x7fee3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.822+0000 7fee5367b640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee3806be30 0x7fee3806e2f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fee440011e0 tx=0x7fee44007d30 comp rx=0 tx=0).stop 2024-09-11T22:21:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.822+0000 7fee5367b640 1 -- 172.21.15.50:0/3560897768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee4c15c3c0 msgr2=0x7fee4c14e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.822+0000 7fee5367b640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee4c15c3c0 0x7fee4c14e510 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fee4000e900 tx=0x7fee4000edc0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.822+0000 7fee5367b640 1 -- 172.21.15.50:0/3560897768 shutdown_connections 2024-09-11T22:21:41.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.822+0000 7fee5367b640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fee3806be30 0x7fee3806e2f0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.822+0000 7fee5367b640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee4c15f350 0x7fee4c0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.822+0000 7fee5367b640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee4c15c3c0 0x7fee4c14e510 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.822+0000 7fee5367b640 1 --2- 172.21.15.50:0/3560897768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee4c0679c0 0x7fee4c0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.822+0000 7fee5367b640 1 -- 172.21.15.50:0/3560897768 >> 172.21.15.50:0/3560897768 conn(0x7fee4c075060 msgr2=0x7fee4c15e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:41.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.822+0000 7fee5367b640 1 -- 172.21.15.50:0/3560897768 shutdown_connections 2024-09-11T22:21:41.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.822+0000 7fee5367b640 1 -- 172.21.15.50:0/3560897768 wait complete. 2024-09-11T22:21:41.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:21:41.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.935+0000 7f889db66640 1 Processor -- start 2024-09-11T22:21:41.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.935+0000 7f889db66640 1 -- start start 2024-09-11T22:21:41.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.936+0000 7f889db66640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f889815c3c0 0x7f889815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.936+0000 7f889db66640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88980680d0 0x7f889815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.936+0000 7f889db66640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889815f7f0 con 0x7f889815ec40 2024-09-11T22:21:41.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.936+0000 7f889db66640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f889806e700 con 0x7f88980680d0 2024-09-11T22:21:41.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.936+0000 7f889db66640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f889815fad0 con 0x7f889815c3c0 2024-09-11T22:21:41.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.936+0000 7f8897fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88980680d0 0x7f889815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.936+0000 7f8897fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88980680d0 0x7f889815f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39398/0 (socket says 172.21.15.50:39398) 2024-09-11T22:21:41.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.936+0000 7f8897fff640 1 -- 172.21.15.50:0/1421914796 learned_addr learned my addr 172.21.15.50:0/1421914796 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:41.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.936+0000 7f8897fff640 1 -- 172.21.15.50:0/1421914796 >> v2:172.21.15.77:3300/0 conn(0x7f889815c3c0 msgr2=0x7f889815fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:41.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.936+0000 7f88977fe640 1 --2- 172.21.15.50:0/1421914796 >> v2:172.21.15.77:3300/0 conn(0x7f889815c3c0 0x7f889815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.936+0000 7f8897fff640 1 --2- 172.21.15.50:0/1421914796 >> v2:172.21.15.77:3300/0 conn(0x7f889815c3c0 0x7f889815fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.936+0000 7f8897fff640 1 -- 172.21.15.50:0/1421914796 >> v1:172.21.15.77:6789/0 conn(0x7f889815ec40 legacy=0x7f88980679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:41.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.936+0000 7f8897fff640 1 -- 172.21.15.50:0/1421914796 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889806e950 con 0x7f88980680d0 2024-09-11T22:21:41.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.937+0000 7f88977fe640 1 --2- 172.21.15.50:0/1421914796 >> v2:172.21.15.77:3300/0 conn(0x7f889815c3c0 0x7f889815fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:41.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.937+0000 7f8897fff640 1 --2- 172.21.15.50:0/1421914796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88980680d0 0x7f889815f0b0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f8898071b10 tx=0x7f889002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fb258708d1d49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:41.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.937+0000 7f88967fc640 1 -- 172.21.15.50:0/1421914796 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890036070 con 0x7f88980680d0 2024-09-11T22:21:41.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.937+0000 7f88967fc640 1 -- 172.21.15.50:0/1421914796 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8890031600 con 0x7f88980680d0 2024-09-11T22:21:41.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.937+0000 7f88967fc640 1 -- 172.21.15.50:0/1421914796 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88900319d0 con 0x7f88980680d0 2024-09-11T22:21:41.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.938+0000 7f889db66640 1 -- 172.21.15.50:0/1421914796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88980680d0 msgr2=0x7f889815f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.938+0000 7f889db66640 1 --2- 172.21.15.50:0/1421914796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88980680d0 0x7f889815f0b0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f8898071b10 tx=0x7f889002a660 comp rx=0 tx=0).stop 2024-09-11T22:21:41.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.938+0000 7f889db66640 1 -- 172.21.15.50:0/1421914796 shutdown_connections 2024-09-11T22:21:41.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.938+0000 7f889db66640 1 --2- 172.21.15.50:0/1421914796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88980680d0 0x7f889815f0b0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.938+0000 7f889db66640 1 --2- 172.21.15.50:0/1421914796 >> v2:172.21.15.77:3300/0 conn(0x7f889815c3c0 0x7f889815fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.938+0000 7f889db66640 1 -- 172.21.15.50:0/1421914796 >> 172.21.15.50:0/1421914796 conn(0x7f8898075060 msgr2=0x7f889806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:41.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.938+0000 7f889db66640 1 -- 172.21.15.50:0/1421914796 shutdown_connections 2024-09-11T22:21:41.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.938+0000 7f889db66640 1 -- 172.21.15.50:0/1421914796 wait complete. 2024-09-11T22:21:41.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.939+0000 7f889db66640 1 Processor -- start 2024-09-11T22:21:41.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.939+0000 7f889db66640 1 -- start start 2024-09-11T22:21:41.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.940+0000 7f889db66640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88980680d0 0x7f8898147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.940+0000 7f889db66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f889815c3c0 0x7f8898159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.940+0000 7f889db66640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889815ec40 0x7f88981598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.940+0000 7f889db66640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f889806f150 con 0x7f889815c3c0 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.940+0000 7f889db66640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88980d0940 con 0x7f889815ec40 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.940+0000 7f889db66640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f889806f2d0 con 0x7f88980680d0 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.940+0000 7f8896ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f889815c3c0 0x7f8898159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.940+0000 7f8896ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f889815c3c0 0x7f8898159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39408/0 (socket says 172.21.15.50:39408) 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.940+0000 7f8896ffd640 1 -- 172.21.15.50:0/3838494595 learned_addr learned my addr 172.21.15.50:0/3838494595 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.940+0000 7f8897fff640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889815ec40 0x7f88981598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.940+0000 7f88977fe640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88980680d0 0x7f8898147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.941+0000 7f8896ffd640 1 -- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88980680d0 msgr2=0x7f8898147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.941+0000 7f8896ffd640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88980680d0 0x7f8898147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.941+0000 7f8896ffd640 1 -- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889815ec40 msgr2=0x7f88981598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.941+0000 7f8896ffd640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889815ec40 0x7f88981598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.941+0000 7f8896ffd640 1 -- 172.21.15.50:0/3838494595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88980cc120 con 0x7f889815c3c0 2024-09-11T22:21:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.941+0000 7f8896ffd640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f889815c3c0 0x7f8898159360 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f888c00b420 tx=0x7f888c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.941+0000 7f887ffff640 1 -- 172.21.15.50:0/3838494595 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c011830 con 0x7f889815c3c0 2024-09-11T22:21:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.941+0000 7f887ffff640 1 -- 172.21.15.50:0/3838494595 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888c016070 con 0x7f889815c3c0 2024-09-11T22:21:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.941+0000 7f889db66640 1 -- 172.21.15.50:0/3838494595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88980cb8e0 con 0x7f889815c3c0 2024-09-11T22:21:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.941+0000 7f887ffff640 1 -- 172.21.15.50:0/3838494595 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c011c10 con 0x7f889815c3c0 2024-09-11T22:21:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.941+0000 7f889db66640 1 -- 172.21.15.50:0/3838494595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8898148dd0 con 0x7f889815c3c0 2024-09-11T22:21:41.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.942+0000 7f889db66640 1 -- 172.21.15.50:0/3838494595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889815fe60 con 0x7f889815c3c0 2024-09-11T22:21:41.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.943+0000 7f887ffff640 1 -- 172.21.15.50:0/3838494595 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f888c01b460 con 0x7f889815c3c0 2024-09-11T22:21:41.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.943+0000 7f887ffff640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f888406be60 0x7f888406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:41.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.943+0000 7f887ffff640 1 -- 172.21.15.50:0/3838494595 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5795+0+0 (secure 0 0 0) 0x7f888c08a9a0 con 0x7f889815c3c0 2024-09-11T22:21:41.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.943+0000 7f88977fe640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f888406be60 0x7f888406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:41.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.944+0000 7f88977fe640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f888406be60 0x7f888406e320 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f888800ab60 tx=0x7f8888008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:41.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:41.948+0000 7f887ffff640 1 -- 172.21.15.50:0/3838494595 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88980cc120 con 0x7f889815c3c0 2024-09-11T22:21:42.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.124+0000 7f889db66640 1 -- 172.21.15.50:0/3838494595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f889806f700 con 0x7f889815c3c0 2024-09-11T22:21:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.125+0000 7f887ffff640 1 -- 172.21.15.50:0/3838494595 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) ==== 74+0+16824 (secure 0 0 0) 0x7f888c058ca0 con 0x7f889815c3c0 2024-09-11T22:21:42.126 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:42.126 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":157,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:21:36.057999+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:47.229269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:47.624749+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/3562809701":"2024-09-12T22:21:36.057947+0000","172.21.15.50:6833/3562809701":"2024-09-12T22:21:36.057947+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:21:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.127+0000 7f889db66640 1 -- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f888406be60 msgr2=0x7f888406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.127+0000 7f889db66640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f888406be60 0x7f888406e320 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f888800ab60 tx=0x7f8888008040 comp rx=0 tx=0).stop 2024-09-11T22:21:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.127+0000 7f889db66640 1 -- 172.21.15.50:0/3838494595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f889815c3c0 msgr2=0x7f8898159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.127+0000 7f889db66640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f889815c3c0 0x7f8898159360 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f888c00b420 tx=0x7f888c00b8e0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.127+0000 7f889db66640 1 -- 172.21.15.50:0/3838494595 shutdown_connections 2024-09-11T22:21:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.127+0000 7f889db66640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f888406be60 0x7f888406e320 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.127+0000 7f889db66640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f889815ec40 0x7f88981598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.127+0000 7f889db66640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f889815c3c0 0x7f8898159360 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.127+0000 7f889db66640 1 --2- 172.21.15.50:0/3838494595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88980680d0 0x7f8898147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.127+0000 7f889db66640 1 -- 172.21.15.50:0/3838494595 >> 172.21.15.50:0/3838494595 conn(0x7f8898075060 msgr2=0x7f88980d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:42.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.127+0000 7f889db66640 1 -- 172.21.15.50:0/3838494595 shutdown_connections 2024-09-11T22:21:42.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.127+0000 7f889db66640 1 -- 172.21.15.50:0/3838494595 wait complete. 2024-09-11T22:21:42.139 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:21:42.139 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:42.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.240+0000 7f90d5dfd640 1 Processor -- start 2024-09-11T22:21:42.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.240+0000 7f90d5dfd640 1 -- start start 2024-09-11T22:21:42.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.241+0000 7f90d5dfd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f90d00cf610 0x7f90d00b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.241+0000 7f90d5dfd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d00cfbd0 con 0x7f90d0161fa0 2024-09-11T22:21:42.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.241+0000 7f90d5dfd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d00cfeb0 con 0x7f90d00b1600 2024-09-11T22:21:42.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.241+0000 7f90d5dfd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f90d00d1220 con 0x7f90d00cf610 2024-09-11T22:21:42.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.241+0000 7f90cf7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f90d0161fa0 0x7f90d00cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46054/0 (socket says 172.21.15.50:46054) 2024-09-11T22:21:42.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.241+0000 7f90cf7fe640 1 -- 172.21.15.50:0/2562225670 learned_addr learned my addr 172.21.15.50:0/2562225670 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:42.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.241+0000 7f90ceffd640 1 --2- 172.21.15.50:0/2562225670 >> v2:172.21.15.50:3300/0 conn(0x7f90d00cf610 0x7f90d00b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.241+0000 7f90ce7fc640 1 -- 172.21.15.50:0/2562225670 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136420740 0 0) 0x7f90d00cfbd0 con 0x7f90d0161fa0 2024-09-11T22:21:42.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.241+0000 7f90ceffd640 1 -- 172.21.15.50:0/2562225670 >> v1:172.21.15.77:6789/0 conn(0x7f90d00b1600 legacy=0x7f90d00cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:42.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.241+0000 7f90ceffd640 1 -- 172.21.15.50:0/2562225670 >> v1:172.21.15.50:6789/0 conn(0x7f90d0161fa0 legacy=0x7f90d00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.241+0000 7f90ceffd640 1 -- 172.21.15.50:0/2562225670 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d00d1470 con 0x7f90d00cf610 2024-09-11T22:21:42.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.242+0000 7f90ceffd640 1 --2- 172.21.15.50:0/2562225670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d00cf610 0x7f90d00b4d20 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f90c40097a0 tx=0x7f90c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f2ddf9c7cb7489 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:42.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.242+0000 7f90ce7fc640 1 -- 172.21.15.50:0/2562225670 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c4037070 con 0x7f90d00cf610 2024-09-11T22:21:42.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.242+0000 7f90ce7fc640 1 -- 172.21.15.50:0/2562225670 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c4032440 con 0x7f90d00cf610 2024-09-11T22:21:42.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.242+0000 7f90ce7fc640 1 -- 172.21.15.50:0/2562225670 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c4032810 con 0x7f90d00cf610 2024-09-11T22:21:42.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.243+0000 7f90d5dfd640 1 -- 172.21.15.50:0/2562225670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d00cf610 msgr2=0x7f90d00b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.243+0000 7f90d5dfd640 1 --2- 172.21.15.50:0/2562225670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d00cf610 0x7f90d00b4d20 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f90c40097a0 tx=0x7f90c402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.243+0000 7f90d5dfd640 1 -- 172.21.15.50:0/2562225670 shutdown_connections 2024-09-11T22:21:42.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.243+0000 7f90d5dfd640 1 --2- 172.21.15.50:0/2562225670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d00cf610 0x7f90d00b4d20 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.243+0000 7f90d5dfd640 1 -- 172.21.15.50:0/2562225670 >> 172.21.15.50:0/2562225670 conn(0x7f90d009ba50 msgr2=0x7f90d00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:42.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.243+0000 7f90d5dfd640 1 -- 172.21.15.50:0/2562225670 shutdown_connections 2024-09-11T22:21:42.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.243+0000 7f90d5dfd640 1 -- 172.21.15.50:0/2562225670 wait complete. 2024-09-11T22:21:42.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.244+0000 7f90d5dfd640 1 Processor -- start 2024-09-11T22:21:42.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.244+0000 7f90d5dfd640 1 -- start start 2024-09-11T22:21:42.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.245+0000 7f90d5dfd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90d00b1600 0x7f90d00b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.245+0000 7f90d5dfd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90d00cf610 0x7f90d00ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.245+0000 7f90d5dfd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d0161fa0 0x7f90d015b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.245+0000 7f90d5dfd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f90d00d1c70 con 0x7f90d0161fa0 2024-09-11T22:21:42.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.245+0000 7f90d5dfd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f90d00d17e0 con 0x7f90d00cf610 2024-09-11T22:21:42.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.245+0000 7f90d5dfd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f90d00d1df0 con 0x7f90d00b1600 2024-09-11T22:21:42.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.245+0000 7f90cffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d0161fa0 0x7f90d015b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.245+0000 7f90cffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d0161fa0 0x7f90d015b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39416/0 (socket says 172.21.15.50:39416) 2024-09-11T22:21:42.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.245+0000 7f90cffff640 1 -- 172.21.15.50:0/1347540896 learned_addr learned my addr 172.21.15.50:0/1347540896 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.245+0000 7f90ceffd640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90d00cf610 0x7f90d00ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.246+0000 7f90cf7fe640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90d00b1600 0x7f90d00b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.246+0000 7f90cffff640 1 -- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90d00b1600 msgr2=0x7f90d00b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.246+0000 7f90cffff640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90d00b1600 0x7f90d00b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.246+0000 7f90cffff640 1 -- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90d00cf610 msgr2=0x7f90d00ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.246+0000 7f90cffff640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90d00cf610 0x7f90d00ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.246+0000 7f90cffff640 1 -- 172.21.15.50:0/1347540896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d00ca840 con 0x7f90d0161fa0 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.246+0000 7f90ceffd640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90d00cf610 0x7f90d00ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.246+0000 7f90cffff640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d0161fa0 0x7f90d015b6b0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f90c800b970 tx=0x7f90c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.246+0000 7f90b7fff640 1 -- 172.21.15.50:0/1347540896 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8019070 con 0x7f90d0161fa0 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.246+0000 7f90b7fff640 1 -- 172.21.15.50:0/1347540896 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c800cb40 con 0x7f90d0161fa0 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.246+0000 7f90d5dfd640 1 -- 172.21.15.50:0/1347540896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d00cab20 con 0x7f90d0161fa0 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.246+0000 7f90b7fff640 1 -- 172.21.15.50:0/1347540896 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8014440 con 0x7f90d0161fa0 2024-09-11T22:21:42.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.246+0000 7f90d5dfd640 1 -- 172.21.15.50:0/1347540896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d00cb0e0 con 0x7f90d0161fa0 2024-09-11T22:21:42.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.247+0000 7f90d5dfd640 1 -- 172.21.15.50:0/1347540896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90d00ceab0 con 0x7f90d0161fa0 2024-09-11T22:21:42.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.248+0000 7f90b7fff640 1 -- 172.21.15.50:0/1347540896 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f90c801c070 con 0x7f90d0161fa0 2024-09-11T22:21:42.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.248+0000 7f90b7fff640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90bc06be30 0x7f90bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.248+0000 7f90b7fff640 1 -- 172.21.15.50:0/1347540896 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5795+0+0 (secure 0 0 0) 0x7f90c808abd0 con 0x7f90d0161fa0 2024-09-11T22:21:42.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.248+0000 7f90cf7fe640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90bc06be30 0x7f90bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.249+0000 7f90cf7fe640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90bc06be30 0x7f90bc06e2f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f90c0000f60 tx=0x7f90c0007b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.252+0000 7f90b7fff640 1 -- 172.21.15.50:0/1347540896 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90c8059520 con 0x7f90d0161fa0 2024-09-11T22:21:42.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.466+0000 7f90d5dfd640 1 -- 172.21.15.50:0/1347540896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90d006c820 con 0x7f90d0161fa0 2024-09-11T22:21:42.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.466+0000 7f90b7fff640 1 -- 172.21.15.50:0/1347540896 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+4410 (secure 0 0 0) 0x7f90c8058e20 con 0x7f90d0161fa0 2024-09-11T22:21:42.467 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:42.467 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":113,"btime":"2024-09-11T22:21:39:065639+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:21:39.065632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":157,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9423":{"gid":9423,"name":"c","rank":0,"incarnation":110,"state":"up:active","state_seq":18,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9423,"qdb_cluster":[9423]},"id":11}]} 2024-09-11T22:21:42.468 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 113 2024-09-11T22:21:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.468+0000 7f90d5dfd640 1 -- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90bc06be30 msgr2=0x7f90bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.468+0000 7f90d5dfd640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90bc06be30 0x7f90bc06e2f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f90c0000f60 tx=0x7f90c0007b70 comp rx=0 tx=0).stop 2024-09-11T22:21:42.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.468+0000 7f90d5dfd640 1 -- 172.21.15.50:0/1347540896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d0161fa0 msgr2=0x7f90d015b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.468+0000 7f90d5dfd640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d0161fa0 0x7f90d015b6b0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f90c800b970 tx=0x7f90c800be30 comp rx=0 tx=0).stop 2024-09-11T22:21:42.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.468+0000 7f90d5dfd640 1 -- 172.21.15.50:0/1347540896 shutdown_connections 2024-09-11T22:21:42.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.468+0000 7f90d5dfd640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f90bc06be30 0x7f90bc06e2f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.468+0000 7f90d5dfd640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90d0161fa0 0x7f90d015b6b0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.468+0000 7f90d5dfd640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90d00cf610 0x7f90d00ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.468+0000 7f90d5dfd640 1 --2- 172.21.15.50:0/1347540896 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90d00b1600 0x7f90d00b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.468+0000 7f90d5dfd640 1 -- 172.21.15.50:0/1347540896 >> 172.21.15.50:0/1347540896 conn(0x7f90d009ba50 msgr2=0x7f90d00cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:42.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.469+0000 7f90d5dfd640 1 -- 172.21.15.50:0/1347540896 shutdown_connections 2024-09-11T22:21:42.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.469+0000 7f90d5dfd640 1 -- 172.21.15.50:0/1347540896 wait complete. 2024-09-11T22:21:42.480 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:42.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.582+0000 7fc697711640 1 Processor -- start 2024-09-11T22:21:42.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.582+0000 7fc697711640 1 -- start start 2024-09-11T22:21:42.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc697711640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6900d05e0 0x7fc6900b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc697711640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6900b3e10 0x7fc6900ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc697711640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6900b4f00 con 0x7fc69015c2c0 2024-09-11T22:21:42.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc697711640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc6900b4360 con 0x7fc6900b3e10 2024-09-11T22:21:42.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc697711640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6900b51c0 con 0x7fc6900d05e0 2024-09-11T22:21:42.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc6954ad640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc69015c2c0 0x7fc6900cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46066/0 (socket says 172.21.15.50:46066) 2024-09-11T22:21:42.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc6954ad640 1 -- 172.21.15.50:0/3931357995 learned_addr learned my addr 172.21.15.50:0/3931357995 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc695cae640 1 --2- 172.21.15.50:0/3931357995 >> v2:172.21.15.50:3300/0 conn(0x7fc6900b3e10 0x7fc6900ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc694cac640 1 --2- 172.21.15.50:0/3931357995 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6900d05e0 0x7fc6900b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc687fff640 1 -- 172.21.15.50:0/3931357995 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639575745 0 0) 0x7fc6900b4f00 con 0x7fc69015c2c0 2024-09-11T22:21:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc687fff640 1 -- 172.21.15.50:0/3931357995 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc67c003520 con 0x7fc69015c2c0 2024-09-11T22:21:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc695cae640 1 -- 172.21.15.50:0/3931357995 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6900d05e0 msgr2=0x7fc6900b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc695cae640 1 --2- 172.21.15.50:0/3931357995 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6900d05e0 0x7fc6900b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc695cae640 1 -- 172.21.15.50:0/3931357995 >> v1:172.21.15.50:6789/0 conn(0x7fc69015c2c0 legacy=0x7fc6900cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.583+0000 7fc695cae640 1 -- 172.21.15.50:0/3931357995 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6900b54a0 con 0x7fc6900b3e10 2024-09-11T22:21:42.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.584+0000 7fc695cae640 1 --2- 172.21.15.50:0/3931357995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6900b3e10 0x7fc6900ce790 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fc688009d90 tx=0x7fc68802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fbd74c87fc2af0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:42.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.584+0000 7fc687fff640 1 -- 172.21.15.50:0/3931357995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688007740 con 0x7fc6900b3e10 2024-09-11T22:21:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.584+0000 7fc687fff640 1 -- 172.21.15.50:0/3931357995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6880078e0 con 0x7fc6900b3e10 2024-09-11T22:21:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.584+0000 7fc687fff640 1 -- 172.21.15.50:0/3931357995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688007cb0 con 0x7fc6900b3e10 2024-09-11T22:21:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.585+0000 7fc697711640 1 -- 172.21.15.50:0/3931357995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6900b3e10 msgr2=0x7fc6900ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.585+0000 7fc697711640 1 --2- 172.21.15.50:0/3931357995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6900b3e10 0x7fc6900ce790 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fc688009d90 tx=0x7fc68802a660 comp rx=0 tx=0).stop 2024-09-11T22:21:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.585+0000 7fc697711640 1 -- 172.21.15.50:0/3931357995 shutdown_connections 2024-09-11T22:21:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.585+0000 7fc697711640 1 --2- 172.21.15.50:0/3931357995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6900b3e10 0x7fc6900ce790 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.585+0000 7fc697711640 1 --2- 172.21.15.50:0/3931357995 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6900d05e0 0x7fc6900b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.585+0000 7fc697711640 1 -- 172.21.15.50:0/3931357995 >> 172.21.15.50:0/3931357995 conn(0x7fc6900679c0 msgr2=0x7fc690067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.585+0000 7fc697711640 1 -- 172.21.15.50:0/3931357995 shutdown_connections 2024-09-11T22:21:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.585+0000 7fc697711640 1 -- 172.21.15.50:0/3931357995 wait complete. 2024-09-11T22:21:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.586+0000 7fc697711640 1 Processor -- start 2024-09-11T22:21:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.586+0000 7fc697711640 1 -- start start 2024-09-11T22:21:42.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc697711640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6900b3e10 0x7fc6901502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc697711640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6900d05e0 0x7fc690150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc697711640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc69015c2c0 0x7fc6900ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc697711640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc69006d070 con 0x7fc69015c2c0 2024-09-11T22:21:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc697711640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6900ce200 con 0x7fc6900d05e0 2024-09-11T22:21:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc697711640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc69006d1f0 con 0x7fc6900b3e10 2024-09-11T22:21:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc695cae640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc69015c2c0 0x7fc6900ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc695cae640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc69015c2c0 0x7fc6900ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39432/0 (socket says 172.21.15.50:39432) 2024-09-11T22:21:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc695cae640 1 -- 172.21.15.50:0/3025226712 learned_addr learned my addr 172.21.15.50:0/3025226712 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc694cac640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6900d05e0 0x7fc690150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc6954ad640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6900b3e10 0x7fc6901502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc695cae640 1 -- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6900b3e10 msgr2=0x7fc6901502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc695cae640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6900b3e10 0x7fc6901502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc695cae640 1 -- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6900d05e0 msgr2=0x7fc690150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc695cae640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6900d05e0 0x7fc690150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc695cae640 1 -- 172.21.15.50:0/3025226712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc690159950 con 0x7fc69015c2c0 2024-09-11T22:21:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc6954ad640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6900b3e10 0x7fc6901502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.587+0000 7fc695cae640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc69015c2c0 0x7fc6900ae8c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fc688009eb0 tx=0x7fc688004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.588+0000 7fc685ffb640 1 -- 172.21.15.50:0/3025226712 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688040070 con 0x7fc69015c2c0 2024-09-11T22:21:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.588+0000 7fc685ffb640 1 -- 172.21.15.50:0/3025226712 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc688031bc0 con 0x7fc69015c2c0 2024-09-11T22:21:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.588+0000 7fc685ffb640 1 -- 172.21.15.50:0/3025226712 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688009450 con 0x7fc69015c2c0 2024-09-11T22:21:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.588+0000 7fc697711640 1 -- 172.21.15.50:0/3025226712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc690159c30 con 0x7fc69015c2c0 2024-09-11T22:21:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.588+0000 7fc697711640 1 -- 172.21.15.50:0/3025226712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69015a1f0 con 0x7fc69015c2c0 2024-09-11T22:21:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.589+0000 7fc697711640 1 -- 172.21.15.50:0/3025226712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc69015c6a0 con 0x7fc69015c2c0 2024-09-11T22:21:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.589+0000 7fc685ffb640 1 -- 172.21.15.50:0/3025226712 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc688039040 con 0x7fc69015c2c0 2024-09-11T22:21:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.590+0000 7fc685ffb640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc67406be30 0x7fc67406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.590+0000 7fc685ffb640 1 -- 172.21.15.50:0/3025226712 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5795+0+0 (secure 0 0 0) 0x7fc6880ac750 con 0x7fc69015c2c0 2024-09-11T22:21:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.590+0000 7fc6954ad640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc67406be30 0x7fc67406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.591+0000 7fc6954ad640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc67406be30 0x7fc67406e2f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc68c005880 tx=0x7fc68c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:42.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.594+0000 7fc685ffb640 1 -- 172.21.15.50:0/3025226712 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc68807b0a0 con 0x7fc69015c2c0 2024-09-11T22:21:42.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.808+0000 7fc697711640 1 -- 172.21.15.50:0/3025226712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6900b19d0 con 0x7fc69015c2c0 2024-09-11T22:21:42.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.809+0000 7fc685ffb640 1 -- 172.21.15.50:0/3025226712 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+4410 (secure 0 0 0) 0x7fc68807a9a0 con 0x7fc69015c2c0 2024-09-11T22:21:42.809 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:42.810 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":113,"btime":"2024-09-11T22:21:39:065639+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:48.656304+0000","modified":"2024-09-11T22:21:39.065632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":157,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9423":{"gid":9423,"name":"c","rank":0,"incarnation":110,"state":"up:active","state_seq":18,"addr":"172.21.15.50:6834/1490732484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1490732484},{"type":"v1","addr":"172.21.15.50:6834","nonce":1490732484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9423,"qdb_cluster":[9423]},"id":11}]} 2024-09-11T22:21:42.810 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 113 2024-09-11T22:21:42.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.811+0000 7fc697711640 1 -- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc67406be30 msgr2=0x7fc67406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.811+0000 7fc697711640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc67406be30 0x7fc67406e2f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc68c005880 tx=0x7fc68c009040 comp rx=0 tx=0).stop 2024-09-11T22:21:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.811+0000 7fc697711640 1 -- 172.21.15.50:0/3025226712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc69015c2c0 msgr2=0x7fc6900ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.811+0000 7fc697711640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc69015c2c0 0x7fc6900ae8c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fc688009eb0 tx=0x7fc688004a40 comp rx=0 tx=0).stop 2024-09-11T22:21:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.811+0000 7fc697711640 1 -- 172.21.15.50:0/3025226712 shutdown_connections 2024-09-11T22:21:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.811+0000 7fc697711640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc67406be30 0x7fc67406e2f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.811+0000 7fc697711640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc69015c2c0 0x7fc6900ae8c0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.811+0000 7fc697711640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6900d05e0 0x7fc690150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.811+0000 7fc697711640 1 --2- 172.21.15.50:0/3025226712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6900b3e10 0x7fc6901502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.811+0000 7fc697711640 1 -- 172.21.15.50:0/3025226712 >> 172.21.15.50:0/3025226712 conn(0x7fc6900679c0 msgr2=0x7fc6900b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.811+0000 7fc697711640 1 -- 172.21.15.50:0/3025226712 shutdown_connections 2024-09-11T22:21:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.811+0000 7fc697711640 1 -- 172.21.15.50:0/3025226712 wait complete. 2024-09-11T22:21:42.822 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:21:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.924+0000 7f5b14c65640 1 Processor -- start 2024-09-11T22:21:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.924+0000 7f5b14c65640 1 -- start start 2024-09-11T22:21:42.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.924+0000 7f5b14c65640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b1015e840 0x7f5b100b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.924+0000 7f5b14c65640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b100cdd50 0x7f5b100cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b14c65640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b100ce5f0 con 0x7f5b100cf3b0 2024-09-11T22:21:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b14c65640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5b1006c240 con 0x7f5b100cdd50 2024-09-11T22:21:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b14c65640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5b100d0470 con 0x7f5b1015e840 2024-09-11T22:21:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b0dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b100cdd50 0x7f5b100cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b0ed9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5b100cf3b0 0x7f5b100d0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46070/0 (socket says 172.21.15.50:46070) 2024-09-11T22:21:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b0dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b100cdd50 0x7f5b100cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39444/0 (socket says 172.21.15.50:39444) 2024-09-11T22:21:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b0ed9d640 1 -- 172.21.15.50:0/1234567059 learned_addr learned my addr 172.21.15.50:0/1234567059 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b0e59c640 1 --2- 172.21.15.50:0/1234567059 >> v2:172.21.15.77:3300/0 conn(0x7f5b1015e840 0x7f5b100b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b0dd9b640 1 -- 172.21.15.50:0/1234567059 >> v2:172.21.15.77:3300/0 conn(0x7f5b1015e840 msgr2=0x7f5b100b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b0dd9b640 1 --2- 172.21.15.50:0/1234567059 >> v2:172.21.15.77:3300/0 conn(0x7f5b1015e840 0x7f5b100b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b0dd9b640 1 -- 172.21.15.50:0/1234567059 >> v1:172.21.15.50:6789/0 conn(0x7f5b100cf3b0 legacy=0x7f5b100d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b0dd9b640 1 -- 172.21.15.50:0/1234567059 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b100ce310 con 0x7f5b100cdd50 2024-09-11T22:21:42.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b0d59a640 1 -- 172.21.15.50:0/1234567059 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256948843 0 0) 0x7f5b100ce5f0 con 0x7f5b100cf3b0 2024-09-11T22:21:42.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.925+0000 7f5b0e59c640 1 --2- 172.21.15.50:0/1234567059 >> v2:172.21.15.77:3300/0 conn(0x7f5b1015e840 0x7f5b100b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:42.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.926+0000 7f5b0dd9b640 1 --2- 172.21.15.50:0/1234567059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b100cdd50 0x7f5b100cee70 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f5b100694b0 tx=0x7f5af802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46092591ecdfe0a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:42.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.926+0000 7f5b0d59a640 1 -- 172.21.15.50:0/1234567059 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8037070 con 0x7f5b100cdd50 2024-09-11T22:21:42.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.926+0000 7f5b0d59a640 1 -- 172.21.15.50:0/1234567059 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af8032440 con 0x7f5b100cdd50 2024-09-11T22:21:42.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.926+0000 7f5b0d59a640 1 -- 172.21.15.50:0/1234567059 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8032810 con 0x7f5b100cdd50 2024-09-11T22:21:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.926+0000 7f5b14c65640 1 -- 172.21.15.50:0/1234567059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b100cdd50 msgr2=0x7f5b100cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.926+0000 7f5b14c65640 1 --2- 172.21.15.50:0/1234567059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b100cdd50 0x7f5b100cee70 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f5b100694b0 tx=0x7f5af802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.927+0000 7f5b14c65640 1 -- 172.21.15.50:0/1234567059 shutdown_connections 2024-09-11T22:21:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.927+0000 7f5b14c65640 1 --2- 172.21.15.50:0/1234567059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b100cdd50 0x7f5b100cee70 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.927+0000 7f5b14c65640 1 --2- 172.21.15.50:0/1234567059 >> v2:172.21.15.77:3300/0 conn(0x7f5b1015e840 0x7f5b100b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.927+0000 7f5b14c65640 1 -- 172.21.15.50:0/1234567059 >> 172.21.15.50:0/1234567059 conn(0x7f5b100b4150 msgr2=0x7f5b100b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.927+0000 7f5b14c65640 1 -- 172.21.15.50:0/1234567059 shutdown_connections 2024-09-11T22:21:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.927+0000 7f5b14c65640 1 -- 172.21.15.50:0/1234567059 wait complete. 2024-09-11T22:21:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.928+0000 7f5b14c65640 1 Processor -- start 2024-09-11T22:21:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.928+0000 7f5b14c65640 1 -- start start 2024-09-11T22:21:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b14c65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b100cdd50 0x7f5b100cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b14c65640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b100cf3b0 0x7f5b100b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b14c65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b1015e840 0x7f5b1015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b14c65640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1015ec20 con 0x7f5b1015e840 2024-09-11T22:21:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b14c65640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1006bed0 con 0x7f5b100cdd50 2024-09-11T22:21:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b14c65640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1015eda0 con 0x7f5b100cf3b0 2024-09-11T22:21:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b0ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b1015e840 0x7f5b1015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b0ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b1015e840 0x7f5b1015aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39450/0 (socket says 172.21.15.50:39450) 2024-09-11T22:21:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b0ed9d640 1 -- 172.21.15.50:0/1349889743 learned_addr learned my addr 172.21.15.50:0/1349889743 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b0e59c640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b100cdd50 0x7f5b100cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b0dd9b640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b100cf3b0 0x7f5b100b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b0ed9d640 1 -- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b100cf3b0 msgr2=0x7f5b100b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b0ed9d640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b100cf3b0 0x7f5b100b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b0ed9d640 1 -- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b100cdd50 msgr2=0x7f5b100cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b0ed9d640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b100cdd50 0x7f5b100cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b0ed9d640 1 -- 172.21.15.50:0/1349889743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b100b7530 con 0x7f5b1015e840 2024-09-11T22:21:42.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b0e59c640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b100cdd50 0x7f5b100cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:42.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b0ed9d640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b1015e840 0x7f5b1015aba0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c450 tx=0x7f5b0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:42.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b06ffd640 1 -- 172.21.15.50:0/1349889743 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08018070 con 0x7f5b1015e840 2024-09-11T22:21:42.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b06ffd640 1 -- 172.21.15.50:0/1349889743 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b08007500 con 0x7f5b1015e840 2024-09-11T22:21:42.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.929+0000 7f5b14c65640 1 -- 172.21.15.50:0/1349889743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1015b0e0 con 0x7f5b1015e840 2024-09-11T22:21:42.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.930+0000 7f5b06ffd640 1 -- 172.21.15.50:0/1349889743 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08004a20 con 0x7f5b1015e840 2024-09-11T22:21:42.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.930+0000 7f5b14c65640 1 -- 172.21.15.50:0/1349889743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b100b7a90 con 0x7f5b1015e840 2024-09-11T22:21:42.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.930+0000 7f5b14c65640 1 -- 172.21.15.50:0/1349889743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b100b4530 con 0x7f5b1015e840 2024-09-11T22:21:42.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.931+0000 7f5b06ffd640 1 -- 172.21.15.50:0/1349889743 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b0801b070 con 0x7f5b1015e840 2024-09-11T22:21:42.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.931+0000 7f5b06ffd640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5af006be60 0x7f5af006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:42.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.932+0000 7f5b06ffd640 1 -- 172.21.15.50:0/1349889743 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5795+0+0 (secure 0 0 0) 0x7f5b0808a140 con 0x7f5b1015e840 2024-09-11T22:21:42.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.932+0000 7f5b0e59c640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5af006be60 0x7f5af006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:42.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.932+0000 7f5b0e59c640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5af006be60 0x7f5af006e320 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5b101e9f10 tx=0x7f5b00007640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:42.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:42.936+0000 7f5b06ffd640 1 -- 172.21.15.50:0/1349889743 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b100b4530 con 0x7f5b1015e840 2024-09-11T22:21:43.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.115+0000 7f5b14c65640 1 -- 172.21.15.50:0/1349889743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b100b4fe0 con 0x7f5b1015e840 2024-09-11T22:21:43.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.116+0000 7f5b06ffd640 1 -- 172.21.15.50:0/1349889743 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) ==== 74+0+16824 (secure 0 0 0) 0x7f5b100b4fe0 con 0x7f5b1015e840 2024-09-11T22:21:43.117 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:43.117 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":157,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:21:36.057999+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:47.229269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:47.624749+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/3562809701":"2024-09-12T22:21:36.057947+0000","172.21.15.50:6833/3562809701":"2024-09-12T22:21:36.057947+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:21:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.118+0000 7f5b14c65640 1 -- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5af006be60 msgr2=0x7f5af006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.118+0000 7f5b14c65640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5af006be60 0x7f5af006e320 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5b101e9f10 tx=0x7f5b00007640 comp rx=0 tx=0).stop 2024-09-11T22:21:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.118+0000 7f5b14c65640 1 -- 172.21.15.50:0/1349889743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b1015e840 msgr2=0x7f5b1015aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.118+0000 7f5b14c65640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b1015e840 0x7f5b1015aba0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c450 tx=0x7f5b0800c910 comp rx=0 tx=0).stop 2024-09-11T22:21:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.118+0000 7f5b14c65640 1 -- 172.21.15.50:0/1349889743 shutdown_connections 2024-09-11T22:21:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.118+0000 7f5b14c65640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5af006be60 0x7f5af006e320 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.118+0000 7f5b14c65640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b100cf3b0 0x7f5b100b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.118+0000 7f5b14c65640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b1015e840 0x7f5b1015aba0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.118+0000 7f5b14c65640 1 --2- 172.21.15.50:0/1349889743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b100cdd50 0x7f5b100cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.118+0000 7f5b14c65640 1 -- 172.21.15.50:0/1349889743 >> 172.21.15.50:0/1349889743 conn(0x7f5b100b4150 msgr2=0x7f5b100d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.118+0000 7f5b14c65640 1 -- 172.21.15.50:0/1349889743 shutdown_connections 2024-09-11T22:21:43.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.118+0000 7f5b14c65640 1 -- 172.21.15.50:0/1349889743 wait complete. 2024-09-11T22:21:43.130 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:21:43.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.232+0000 7fd04ecf8640 1 Processor -- start 2024-09-11T22:21:43.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.232+0000 7fd04ecf8640 1 -- start start 2024-09-11T22:21:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.233+0000 7fd04ecf8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd048067e30 0x7fd04815d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.233+0000 7fd04ecf8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04806ec90 con 0x7fd0480679c0 2024-09-11T22:21:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.233+0000 7fd04ecf8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04806ef70 con 0x7fd04815c510 2024-09-11T22:21:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.233+0000 7fd04ecf8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd04806f250 con 0x7fd048067e30 2024-09-11T22:21:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.233+0000 7fd04d295640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd048067e30 0x7fd04815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.233+0000 7fd04d295640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd048067e30 0x7fd04815d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39462/0 (socket says 172.21.15.50:39462) 2024-09-11T22:21:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.233+0000 7fd04d295640 1 -- 172.21.15.50:0/2861861309 learned_addr learned my addr 172.21.15.50:0/2861861309 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.233+0000 7fd047fff640 1 --1- 172.21.15.50:0/2861861309 >> v1:172.21.15.50:6789/0 conn(0x7fd0480679c0 0x7fd04815c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46078/0 (socket says 172.21.15.50:46078) 2024-09-11T22:21:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.233+0000 7fd04d295640 1 -- 172.21.15.50:0/2861861309 >> v1:172.21.15.77:6789/0 conn(0x7fd04815c510 legacy=0x7fd04806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.233+0000 7fd04d295640 1 -- 172.21.15.50:0/2861861309 >> v1:172.21.15.50:6789/0 conn(0x7fd0480679c0 legacy=0x7fd04815c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.233+0000 7fd04d295640 1 -- 172.21.15.50:0/2861861309 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04806f530 con 0x7fd048067e30 2024-09-11T22:21:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.233+0000 7fd0477fe640 1 -- 172.21.15.50:0/2861861309 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3206645800 0 0) 0x7fd04806ec90 con 0x7fd0480679c0 2024-09-11T22:21:43.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.234+0000 7fd04d295640 1 --2- 172.21.15.50:0/2861861309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd048067e30 0x7fd04815d000 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fd040009870 tx=0x7fd04002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e897bcc2e19dcc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:43.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.234+0000 7fd0477fe640 1 -- 172.21.15.50:0/2861861309 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040037070 con 0x7fd048067e30 2024-09-11T22:21:43.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.234+0000 7fd0477fe640 1 -- 172.21.15.50:0/2861861309 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd040032440 con 0x7fd048067e30 2024-09-11T22:21:43.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.234+0000 7fd0477fe640 1 -- 172.21.15.50:0/2861861309 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040032810 con 0x7fd048067e30 2024-09-11T22:21:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.235+0000 7fd04ecf8640 1 -- 172.21.15.50:0/2861861309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd048067e30 msgr2=0x7fd04815d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.235+0000 7fd04ecf8640 1 --2- 172.21.15.50:0/2861861309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd048067e30 0x7fd04815d000 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fd040009870 tx=0x7fd04002a2a0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.235+0000 7fd04ecf8640 1 -- 172.21.15.50:0/2861861309 shutdown_connections 2024-09-11T22:21:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.235+0000 7fd04ecf8640 1 --2- 172.21.15.50:0/2861861309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd048067e30 0x7fd04815d000 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.235+0000 7fd04ecf8640 1 -- 172.21.15.50:0/2861861309 >> 172.21.15.50:0/2861861309 conn(0x7fd048075060 msgr2=0x7fd04806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.235+0000 7fd04ecf8640 1 -- 172.21.15.50:0/2861861309 shutdown_connections 2024-09-11T22:21:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.235+0000 7fd04ecf8640 1 -- 172.21.15.50:0/2861861309 wait complete. 2024-09-11T22:21:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.236+0000 7fd04ecf8640 1 Processor -- start 2024-09-11T22:21:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.236+0000 7fd04ecf8640 1 -- start start 2024-09-11T22:21:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.237+0000 7fd04ecf8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0480679c0 0x7fd0481e5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.237+0000 7fd04ecf8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd048067e30 0x7fd048157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.237+0000 7fd04ecf8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd04815c510 0x7fd0481598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.237+0000 7fd04ecf8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd04806c820 con 0x7fd048067e30 2024-09-11T22:21:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.237+0000 7fd04ecf8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd0480682a0 con 0x7fd04815c510 2024-09-11T22:21:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.237+0000 7fd04ecf8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd04806fd30 con 0x7fd0480679c0 2024-09-11T22:21:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.237+0000 7fd047fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd048067e30 0x7fd048157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.237+0000 7fd047fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd048067e30 0x7fd048157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39468/0 (socket says 172.21.15.50:39468) 2024-09-11T22:21:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.237+0000 7fd047fff640 1 -- 172.21.15.50:0/804789671 learned_addr learned my addr 172.21.15.50:0/804789671 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.237+0000 7fd04d295640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd04815c510 0x7fd0481598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.237+0000 7fd04ca94640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0480679c0 0x7fd0481e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.237+0000 7fd047fff640 1 -- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0480679c0 msgr2=0x7fd0481e5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.237+0000 7fd047fff640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0480679c0 0x7fd0481e5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.238+0000 7fd047fff640 1 -- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd04815c510 msgr2=0x7fd0481598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.238+0000 7fd047fff640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd04815c510 0x7fd0481598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.238+0000 7fd047fff640 1 -- 172.21.15.50:0/804789671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd048157fe0 con 0x7fd048067e30 2024-09-11T22:21:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.238+0000 7fd04ca94640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0480679c0 0x7fd0481e5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.238+0000 7fd047fff640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd048067e30 0x7fd048157590 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c890 tx=0x7fd03000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.238+0000 7fd0457fa640 1 -- 172.21.15.50:0/804789671 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030018070 con 0x7fd048067e30 2024-09-11T22:21:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.238+0000 7fd0457fa640 1 -- 172.21.15.50:0/804789671 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd03000a640 con 0x7fd048067e30 2024-09-11T22:21:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.238+0000 7fd0457fa640 1 -- 172.21.15.50:0/804789671 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03000aa30 con 0x7fd048067e30 2024-09-11T22:21:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.238+0000 7fd04ecf8640 1 -- 172.21.15.50:0/804789671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0481582c0 con 0x7fd048067e30 2024-09-11T22:21:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.238+0000 7fd04ecf8640 1 -- 172.21.15.50:0/804789671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd048158b60 con 0x7fd048067e30 2024-09-11T22:21:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.239+0000 7fd04ecf8640 1 -- 172.21.15.50:0/804789671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04806e1f0 con 0x7fd048067e30 2024-09-11T22:21:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.239+0000 7fd0457fa640 1 -- 172.21.15.50:0/804789671 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd03001b070 con 0x7fd048067e30 2024-09-11T22:21:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.240+0000 7fd0457fa640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd02806be30 0x7fd02806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.240+0000 7fd0457fa640 1 -- 172.21.15.50:0/804789671 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5795+0+0 (secure 0 0 0) 0x7fd03008a5f0 con 0x7fd048067e30 2024-09-11T22:21:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.240+0000 7fd04ca94640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd02806be30 0x7fd02806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.241+0000 7fd04ca94640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd02806be30 0x7fd02806e2f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd038006fd0 tx=0x7fd038008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.244+0000 7fd0457fa640 1 -- 172.21.15.50:0/804789671 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd030058850 con 0x7fd048067e30 2024-09-11T22:21:43.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.458+0000 7fd04ecf8640 1 -- 172.21.15.50:0/804789671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd0480b2760 con 0x7fd048067e30 2024-09-11T22:21:43.459 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:21:43.458+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:21:43.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.460+0000 7fd0457fa640 1 -- 172.21.15.50:0/804789671 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v114) ==== 161+0+0 (secure 0 0 0) 0x7fd03005cb50 con 0x7fd048067e30 2024-09-11T22:21:43.460 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:21:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.463+0000 7fd04ecf8640 1 -- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd02806be30 msgr2=0x7fd02806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.463+0000 7fd04ecf8640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd02806be30 0x7fd02806e2f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd038006fd0 tx=0x7fd038008040 comp rx=0 tx=0).stop 2024-09-11T22:21:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.463+0000 7fd04ecf8640 1 -- 172.21.15.50:0/804789671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd048067e30 msgr2=0x7fd048157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.463+0000 7fd04ecf8640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd048067e30 0x7fd048157590 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c890 tx=0x7fd03000cd50 comp rx=0 tx=0).stop 2024-09-11T22:21:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.463+0000 7fd04ecf8640 1 -- 172.21.15.50:0/804789671 shutdown_connections 2024-09-11T22:21:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.463+0000 7fd04ecf8640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd02806be30 0x7fd02806e2f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.463+0000 7fd04ecf8640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd04815c510 0x7fd0481598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.463+0000 7fd04ecf8640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd048067e30 0x7fd048157590 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.463+0000 7fd04ecf8640 1 --2- 172.21.15.50:0/804789671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0480679c0 0x7fd0481e5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.463+0000 7fd04ecf8640 1 -- 172.21.15.50:0/804789671 >> 172.21.15.50:0/804789671 conn(0x7fd048075060 msgr2=0x7fd0480b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.463+0000 7fd04ecf8640 1 -- 172.21.15.50:0/804789671 shutdown_connections 2024-09-11T22:21:43.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.463+0000 7fd04ecf8640 1 -- 172.21.15.50:0/804789671 wait complete. 2024-09-11T22:21:43.467 INFO:tasks.ceph.mds.c.smithi050.stderr: -8836> 2024-09-11T22:21:40.182+0000 7fcd34fc1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:21:43.476 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:21:43.502 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:21:43.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.580+0000 7f48d616d640 1 Processor -- start 2024-09-11T22:21:43.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.581+0000 7f48d616d640 1 -- start start 2024-09-11T22:21:43.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.581+0000 7f48d616d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00d3c00 0x7f48d0169420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:43.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.581+0000 7f48d616d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d00cfa80 con 0x7f48d015e870 2024-09-11T22:21:43.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.581+0000 7f48d616d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d00d40d0 con 0x7f48d00d18a0 2024-09-11T22:21:43.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.581+0000 7f48d616d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f48d00d43b0 con 0x7f48d00d3c00 2024-09-11T22:21:43.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.582+0000 7f48cf7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f48d015e870 0x7f48d00d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46100/0 (socket says 172.21.15.50:46100) 2024-09-11T22:21:43.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.582+0000 7f48cf7fe640 1 -- 172.21.15.50:0/1325826003 learned_addr learned my addr 172.21.15.50:0/1325826003 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:43.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.582+0000 7f48cffff640 1 --2- 172.21.15.50:0/1325826003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00d3c00 0x7f48d0169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:43.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.582+0000 7f48ce7fc640 1 -- 172.21.15.50:0/1325826003 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3401746705 0 0) 0x7f48c0001110 con 0x7f48d015e870 2024-09-11T22:21:43.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.582+0000 7f48ce7fc640 1 -- 172.21.15.50:0/1325826003 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48b8003520 con 0x7f48d015e870 2024-09-11T22:21:43.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.582+0000 7f48ce7fc640 1 -- 172.21.15.50:0/1325826003 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3747825175 0 0) 0x7f48d00d40d0 con 0x7f48d00d18a0 2024-09-11T22:21:43.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.582+0000 7f48ce7fc640 1 -- 172.21.15.50:0/1325826003 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c0001110 con 0x7f48d00d18a0 2024-09-11T22:21:43.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.582+0000 7f48cffff640 1 -- 172.21.15.50:0/1325826003 >> v1:172.21.15.77:6789/0 conn(0x7f48d00d18a0 legacy=0x7f48d00d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:43.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.582+0000 7f48cffff640 1 -- 172.21.15.50:0/1325826003 >> v1:172.21.15.50:6789/0 conn(0x7f48d015e870 legacy=0x7f48d00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:43.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.582+0000 7f48cffff640 1 -- 172.21.15.50:0/1325826003 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d00b7c00 con 0x7f48d00d3c00 2024-09-11T22:21:43.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.583+0000 7f48cffff640 1 --2- 172.21.15.50:0/1325826003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00d3c00 0x7f48d0169420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009dc0 tx=0x7f48c802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=719a6f5c5da24303 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:43.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.583+0000 7f48ce7fc640 1 -- 172.21.15.50:0/1325826003 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8007740 con 0x7f48d00d3c00 2024-09-11T22:21:43.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.583+0000 7f48ce7fc640 1 -- 172.21.15.50:0/1325826003 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c80078e0 con 0x7f48d00d3c00 2024-09-11T22:21:43.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.583+0000 7f48ce7fc640 1 -- 172.21.15.50:0/1325826003 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8007cb0 con 0x7f48d00d3c00 2024-09-11T22:21:43.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.584+0000 7f48d616d640 1 -- 172.21.15.50:0/1325826003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00d3c00 msgr2=0x7f48d0169420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:43.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.584+0000 7f48d616d640 1 --2- 172.21.15.50:0/1325826003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00d3c00 0x7f48d0169420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009dc0 tx=0x7f48c802a6d0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.584+0000 7f48d616d640 1 -- 172.21.15.50:0/1325826003 shutdown_connections 2024-09-11T22:21:43.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.584+0000 7f48d616d640 1 --2- 172.21.15.50:0/1325826003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00d3c00 0x7f48d0169420 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.584+0000 7f48d616d640 1 -- 172.21.15.50:0/1325826003 >> 172.21.15.50:0/1325826003 conn(0x7f48d00727a0 msgr2=0x7f48d00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:43.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.584+0000 7f48d616d640 1 -- 172.21.15.50:0/1325826003 shutdown_connections 2024-09-11T22:21:43.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.584+0000 7f48d616d640 1 -- 172.21.15.50:0/1325826003 wait complete. 2024-09-11T22:21:43.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.585+0000 7f48d616d640 1 Processor -- start 2024-09-11T22:21:43.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.585+0000 7f48d616d640 1 -- start start 2024-09-11T22:21:43.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48d616d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00d18a0 0x7f48d00c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:43.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48d616d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48d00d3c00 0x7f48d014ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:43.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48d616d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d015e870 0x7f48d00cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:43.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48d616d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f48d00b78b0 con 0x7f48d015e870 2024-09-11T22:21:43.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48d616d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f48d015ec50 con 0x7f48d00d3c00 2024-09-11T22:21:43.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48d616d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f48d00b9410 con 0x7f48d00d18a0 2024-09-11T22:21:43.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48cffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d015e870 0x7f48d00cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:43.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48cffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d015e870 0x7f48d00cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39512/0 (socket says 172.21.15.50:39512) 2024-09-11T22:21:43.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48cffff640 1 -- 172.21.15.50:0/2107871807 learned_addr learned my addr 172.21.15.50:0/2107871807 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:43.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48ceffd640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48d00d3c00 0x7f48d014ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:43.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48cf7fe640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00d18a0 0x7f48d00c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:43.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48cffff640 1 -- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00d18a0 msgr2=0x7f48d00c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:43.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48cffff640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00d18a0 0x7f48d00c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48cffff640 1 -- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48d00d3c00 msgr2=0x7f48d014ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:43.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48cffff640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48d00d3c00 0x7f48d014ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:43.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48cffff640 1 -- 172.21.15.50:0/2107871807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d00ca6d0 con 0x7f48d015e870 2024-09-11T22:21:43.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48ceffd640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48d00d3c00 0x7f48d014ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:43.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.586+0000 7f48cffff640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d015e870 0x7f48d00cae10 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009ee0 tx=0x7f48c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:43.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.587+0000 7f48b7fff640 1 -- 172.21.15.50:0/2107871807 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8040070 con 0x7f48d015e870 2024-09-11T22:21:43.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.587+0000 7f48b7fff640 1 -- 172.21.15.50:0/2107871807 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c8031bc0 con 0x7f48d015e870 2024-09-11T22:21:43.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.587+0000 7f48d616d640 1 -- 172.21.15.50:0/2107871807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d00ca9b0 con 0x7f48d015e870 2024-09-11T22:21:43.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.587+0000 7f48b7fff640 1 -- 172.21.15.50:0/2107871807 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8009450 con 0x7f48d015e870 2024-09-11T22:21:43.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.587+0000 7f48d616d640 1 -- 172.21.15.50:0/2107871807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d00c8d50 con 0x7f48d015e870 2024-09-11T22:21:43.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.588+0000 7f48d616d640 1 -- 172.21.15.50:0/2107871807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d00d34f0 con 0x7f48d015e870 2024-09-11T22:21:43.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.588+0000 7f48b7fff640 1 -- 172.21.15.50:0/2107871807 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48c8039040 con 0x7f48d015e870 2024-09-11T22:21:43.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.589+0000 7f48b7fff640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f48bc06be30 0x7f48bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:43.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.589+0000 7f48b7fff640 1 -- 172.21.15.50:0/2107871807 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5881+0+0 (secure 0 0 0) 0x7f48c80ac670 con 0x7f48d015e870 2024-09-11T22:21:43.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.589+0000 7f48cf7fe640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f48bc06be30 0x7f48bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:43.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.589+0000 7f48cf7fe640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f48bc06be30 0x7f48bc06e2f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f48c0000f60 tx=0x7f48c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:43.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.593+0000 7f48b7fff640 1 -- 172.21.15.50:0/2107871807 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f48c807af70 con 0x7f48d015e870 2024-09-11T22:21:43.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:43.811+0000 7f48d616d640 1 -- 172.21.15.50:0/2107871807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f48d00ba0e0 con 0x7f48d015e870 2024-09-11T22:21:44.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:21:44.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:21:44.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.465+0000 7f48b7fff640 1 -- 172.21.15.50:0/2107871807 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v115) ==== 104+0+0 (secure 0 0 0) 0x7f48c807a870 con 0x7f48d015e870 2024-09-11T22:21:44.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.468+0000 7f48d616d640 1 -- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f48bc06be30 msgr2=0x7f48bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:44.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.468+0000 7f48d616d640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f48bc06be30 0x7f48bc06e2f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f48c0000f60 tx=0x7f48c0009040 comp rx=0 tx=0).stop 2024-09-11T22:21:44.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.468+0000 7f48d616d640 1 -- 172.21.15.50:0/2107871807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d015e870 msgr2=0x7f48d00cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:44.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.468+0000 7f48d616d640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d015e870 0x7f48d00cae10 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009ee0 tx=0x7f48c8004a40 comp rx=0 tx=0).stop 2024-09-11T22:21:44.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.468+0000 7f48d616d640 1 -- 172.21.15.50:0/2107871807 shutdown_connections 2024-09-11T22:21:44.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.468+0000 7f48d616d640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f48bc06be30 0x7f48bc06e2f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:44.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.468+0000 7f48d616d640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48d015e870 0x7f48d00cae10 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:44.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.468+0000 7f48d616d640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48d00d3c00 0x7f48d014ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:44.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.468+0000 7f48d616d640 1 --2- 172.21.15.50:0/2107871807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48d00d18a0 0x7f48d00c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:44.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.468+0000 7f48d616d640 1 -- 172.21.15.50:0/2107871807 >> 172.21.15.50:0/2107871807 conn(0x7f48d00727a0 msgr2=0x7f48d00d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:44.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.468+0000 7f48d616d640 1 -- 172.21.15.50:0/2107871807 shutdown_connections 2024-09-11T22:21:44.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.468+0000 7f48d616d640 1 -- 172.21.15.50:0/2107871807 wait complete. 2024-09-11T22:21:44.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:21:44.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.591+0000 7fa303c0e640 1 Processor -- start 2024-09-11T22:21:44.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.591+0000 7fa303c0e640 1 -- start start 2024-09-11T22:21:44.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.592+0000 7fa303c0e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2fc06ff20 0x7fa2fc15eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:44.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.592+0000 7fa303c0e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa2fc0b2590 0x7fa2fc0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:44.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.592+0000 7fa303c0e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2fc159050 con 0x7fa2fc0afe10 2024-09-11T22:21:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.592+0000 7fa303c0e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa2fc0b07c0 con 0x7fa2fc06ff20 2024-09-11T22:21:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.592+0000 7fa303c0e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa2fc070300 con 0x7fa2fc0b2590 2024-09-11T22:21:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.592+0000 7fa3019aa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2fc06ff20 0x7fa2fc15eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.592+0000 7fa3011a9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa2fc0afe10 0x7fa2fc0b1e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46112/0 (socket says 172.21.15.50:46112) 2024-09-11T22:21:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.592+0000 7fa3011a9640 1 -- 172.21.15.50:0/1092635979 learned_addr learned my addr 172.21.15.50:0/1092635979 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.593+0000 7fa3021ab640 1 --2- 172.21.15.50:0/1092635979 >> v2:172.21.15.77:3300/0 conn(0x7fa2fc0b2590 0x7fa2fc0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.593+0000 7fa3019aa640 1 -- 172.21.15.50:0/1092635979 >> v2:172.21.15.77:3300/0 conn(0x7fa2fc0b2590 msgr2=0x7fa2fc0b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.593+0000 7fa3019aa640 1 --2- 172.21.15.50:0/1092635979 >> v2:172.21.15.77:3300/0 conn(0x7fa2fc0b2590 0x7fa2fc0b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.593+0000 7fa3019aa640 1 -- 172.21.15.50:0/1092635979 >> v1:172.21.15.50:6789/0 conn(0x7fa2fc0afe10 legacy=0x7fa2fc0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.593+0000 7fa3019aa640 1 -- 172.21.15.50:0/1092635979 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2fc0ae8c0 con 0x7fa2fc06ff20 2024-09-11T22:21:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.593+0000 7fa3009a8640 1 -- 172.21.15.50:0/1092635979 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540776649 0 0) 0x7fa2f0001110 con 0x7fa2fc0afe10 2024-09-11T22:21:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.593+0000 7fa3019aa640 1 --2- 172.21.15.50:0/1092635979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2fc06ff20 0x7fa2fc15eb70 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009dc0 tx=0x7fa2ec02a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9fe5b176c3a27e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.593+0000 7fa3009a8640 1 -- 172.21.15.50:0/1092635979 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec007740 con 0x7fa2fc06ff20 2024-09-11T22:21:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.593+0000 7fa3009a8640 1 -- 172.21.15.50:0/1092635979 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ec0078e0 con 0x7fa2fc06ff20 2024-09-11T22:21:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.594+0000 7fa3009a8640 1 -- 172.21.15.50:0/1092635979 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec007cb0 con 0x7fa2fc06ff20 2024-09-11T22:21:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.594+0000 7fa303c0e640 1 -- 172.21.15.50:0/1092635979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2fc06ff20 msgr2=0x7fa2fc15eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.594+0000 7fa303c0e640 1 --2- 172.21.15.50:0/1092635979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2fc06ff20 0x7fa2fc15eb70 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009dc0 tx=0x7fa2ec02a640 comp rx=0 tx=0).stop 2024-09-11T22:21:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.594+0000 7fa303c0e640 1 -- 172.21.15.50:0/1092635979 shutdown_connections 2024-09-11T22:21:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.594+0000 7fa303c0e640 1 --2- 172.21.15.50:0/1092635979 >> v2:172.21.15.77:3300/0 conn(0x7fa2fc0b2590 0x7fa2fc0b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.594+0000 7fa303c0e640 1 --2- 172.21.15.50:0/1092635979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2fc06ff20 0x7fa2fc15eb70 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.594+0000 7fa303c0e640 1 -- 172.21.15.50:0/1092635979 >> 172.21.15.50:0/1092635979 conn(0x7fa2fc0b0a60 msgr2=0x7fa2fc073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.594+0000 7fa303c0e640 1 -- 172.21.15.50:0/1092635979 shutdown_connections 2024-09-11T22:21:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.594+0000 7fa303c0e640 1 -- 172.21.15.50:0/1092635979 wait complete. 2024-09-11T22:21:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.595+0000 7fa303c0e640 1 Processor -- start 2024-09-11T22:21:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.595+0000 7fa303c0e640 1 -- start start 2024-09-11T22:21:44.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.596+0000 7fa303c0e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2fc06ff20 0x7fa2fc143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:44.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.596+0000 7fa303c0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2fc0afe10 0x7fa2fc0cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:44.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.596+0000 7fa303c0e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2fc0b2590 0x7fa2fc1535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.596+0000 7fa303c0e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc0af160 con 0x7fa2fc06ff20 2024-09-11T22:21:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.596+0000 7fa303c0e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc0aee80 con 0x7fa2fc0afe10 2024-09-11T22:21:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.596+0000 7fa303c0e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa2fc0af440 con 0x7fa2fc0b2590 2024-09-11T22:21:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.596+0000 7fa3019aa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2fc06ff20 0x7fa2fc143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.596+0000 7fa3019aa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2fc06ff20 0x7fa2fc143520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39522/0 (socket says 172.21.15.50:39522) 2024-09-11T22:21:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.596+0000 7fa3019aa640 1 -- 172.21.15.50:0/3050604946 learned_addr learned my addr 172.21.15.50:0/3050604946 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.596+0000 7fa3011a9640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2fc0afe10 0x7fa2fc0cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.596+0000 7fa3021ab640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2fc0b2590 0x7fa2fc1535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.597+0000 7fa3019aa640 1 -- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2fc0b2590 msgr2=0x7fa2fc1535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.597+0000 7fa3019aa640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2fc0b2590 0x7fa2fc1535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.597+0000 7fa3019aa640 1 -- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2fc0afe10 msgr2=0x7fa2fc0cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.597+0000 7fa3019aa640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2fc0afe10 0x7fa2fc0cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.597+0000 7fa3019aa640 1 -- 172.21.15.50:0/3050604946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2fc150c20 con 0x7fa2fc06ff20 2024-09-11T22:21:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.597+0000 7fa3021ab640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2fc0b2590 0x7fa2fc1535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.597+0000 7fa3011a9640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2fc0afe10 0x7fa2fc0cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.597+0000 7fa3019aa640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2fc06ff20 0x7fa2fc143520 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec000f80 tx=0x7fa2ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.597+0000 7fa2fa7fc640 1 -- 172.21.15.50:0/3050604946 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec040070 con 0x7fa2fc06ff20 2024-09-11T22:21:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.597+0000 7fa2fa7fc640 1 -- 172.21.15.50:0/3050604946 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ec031c40 con 0x7fa2fc06ff20 2024-09-11T22:21:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.597+0000 7fa303c0e640 1 -- 172.21.15.50:0/3050604946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2fc150ec0 con 0x7fa2fc06ff20 2024-09-11T22:21:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.597+0000 7fa2fa7fc640 1 -- 172.21.15.50:0/3050604946 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec009450 con 0x7fa2fc06ff20 2024-09-11T22:21:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.597+0000 7fa303c0e640 1 -- 172.21.15.50:0/3050604946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2fc0cfe90 con 0x7fa2fc06ff20 2024-09-11T22:21:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.598+0000 7fa303c0e640 1 -- 172.21.15.50:0/3050604946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2fc151090 con 0x7fa2fc06ff20 2024-09-11T22:21:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.598+0000 7fa2fa7fc640 1 -- 172.21.15.50:0/3050604946 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2ec039040 con 0x7fa2fc06ff20 2024-09-11T22:21:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.599+0000 7fa2fa7fc640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa2e806be30 0x7fa2e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.599+0000 7fa2fa7fc640 1 -- 172.21.15.50:0/3050604946 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5881+0+0 (secure 0 0 0) 0x7fa2ec0ac450 con 0x7fa2fc06ff20 2024-09-11T22:21:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.599+0000 7fa3011a9640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa2e806be30 0x7fa2e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.600+0000 7fa3011a9640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa2e806be30 0x7fa2e806e2f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0d0380 tx=0x7fa2f0007a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:44.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.603+0000 7fa2fa7fc640 1 -- 172.21.15.50:0/3050604946 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa2ec02ae20 con 0x7fa2fc06ff20 2024-09-11T22:21:44.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:44.779+0000 7fa303c0e640 1 -- 172.21.15.50:0/3050604946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa2fc15eb70 con 0x7fa2fc06ff20 2024-09-11T22:21:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.467+0000 7fa2fa7fc640 1 -- 172.21.15.50:0/3050604946 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v159) ==== 181+0+0 (secure 0 0 0) 0x7fa2ec07ae10 con 0x7fa2fc06ff20 2024-09-11T22:21:45.468 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:21:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.470+0000 7fa303c0e640 1 -- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa2e806be30 msgr2=0x7fa2e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:45.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.470+0000 7fa303c0e640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa2e806be30 0x7fa2e806e2f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0d0380 tx=0x7fa2f0007a10 comp rx=0 tx=0).stop 2024-09-11T22:21:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.470+0000 7fa303c0e640 1 -- 172.21.15.50:0/3050604946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2fc06ff20 msgr2=0x7fa2fc143520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.470+0000 7fa303c0e640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2fc06ff20 0x7fa2fc143520 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec000f80 tx=0x7fa2ec004a40 comp rx=0 tx=0).stop 2024-09-11T22:21:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.470+0000 7fa303c0e640 1 -- 172.21.15.50:0/3050604946 shutdown_connections 2024-09-11T22:21:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.470+0000 7fa303c0e640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa2e806be30 0x7fa2e806e2f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.470+0000 7fa303c0e640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2fc0b2590 0x7fa2fc1535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.470+0000 7fa303c0e640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2fc0afe10 0x7fa2fc0cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.470+0000 7fa303c0e640 1 --2- 172.21.15.50:0/3050604946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2fc06ff20 0x7fa2fc143520 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.470+0000 7fa303c0e640 1 -- 172.21.15.50:0/3050604946 >> 172.21.15.50:0/3050604946 conn(0x7fa2fc0b0a60 msgr2=0x7fa2fc160f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.470+0000 7fa303c0e640 1 -- 172.21.15.50:0/3050604946 shutdown_connections 2024-09-11T22:21:45.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.471+0000 7fa303c0e640 1 -- 172.21.15.50:0/3050604946 wait complete. 2024-09-11T22:21:45.485 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:21:45.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.596+0000 7f26bcc96640 1 Processor -- start 2024-09-11T22:21:45.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.596+0000 7f26bcc96640 1 -- start start 2024-09-11T22:21:45.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.597+0000 7f26bcc96640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f26b815e8e0 0x7f26b80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:45.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.597+0000 7f26bcc96640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26b8162350 0x7f26b81627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:45.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.597+0000 7f26bcc96640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b8163080 con 0x7f26b80d1580 2024-09-11T22:21:45.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.597+0000 7f26bcc96640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f26b815ecc0 con 0x7f26b8162350 2024-09-11T22:21:45.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.597+0000 7f26bcc96640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f26b80d2ad0 con 0x7f26b815e8e0 2024-09-11T22:21:45.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.597+0000 7f26b6d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26b8162350 0x7f26b81627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:45.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.597+0000 7f26b6d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26b8162350 0x7f26b81627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39524/0 (socket says 172.21.15.50:39524) 2024-09-11T22:21:45.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.597+0000 7f26b6d9d640 1 -- 172.21.15.50:0/2330543843 learned_addr learned my addr 172.21.15.50:0/2330543843 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:45.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.597+0000 7f26b659c640 1 --2- 172.21.15.50:0/2330543843 >> v2:172.21.15.77:3300/0 conn(0x7f26b815e8e0 0x7f26b80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:45.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.598+0000 7f26b6d9d640 1 -- 172.21.15.50:0/2330543843 >> v2:172.21.15.77:3300/0 conn(0x7f26b815e8e0 msgr2=0x7f26b80b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:45.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.598+0000 7f26b6d9d640 1 --2- 172.21.15.50:0/2330543843 >> v2:172.21.15.77:3300/0 conn(0x7f26b815e8e0 0x7f26b80b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:45.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.598+0000 7f26b6d9d640 1 -- 172.21.15.50:0/2330543843 >> v1:172.21.15.77:6789/0 conn(0x7f26b80d1580 legacy=0x7f26b80d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:45.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.598+0000 7f26b6d9d640 1 -- 172.21.15.50:0/2330543843 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b80d2d20 con 0x7f26b8162350 2024-09-11T22:21:45.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.598+0000 7f26b6d9d640 1 --2- 172.21.15.50:0/2330543843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b8162350 0x7f26b81627a0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f26b808d630 tx=0x7f26b002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6815a34728fb912 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.599+0000 7f26b559a640 1 -- 172.21.15.50:0/2330543843 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0037070 con 0x7f26b8162350 2024-09-11T22:21:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.599+0000 7f26b559a640 1 -- 172.21.15.50:0/2330543843 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b002ae50 con 0x7f26b8162350 2024-09-11T22:21:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.599+0000 7f26b559a640 1 -- 172.21.15.50:0/2330543843 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0032860 con 0x7f26b8162350 2024-09-11T22:21:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.599+0000 7f26bcc96640 1 -- 172.21.15.50:0/2330543843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b8162350 msgr2=0x7f26b81627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.599+0000 7f26bcc96640 1 --2- 172.21.15.50:0/2330543843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b8162350 0x7f26b81627a0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f26b808d630 tx=0x7f26b002a300 comp rx=0 tx=0).stop 2024-09-11T22:21:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.599+0000 7f26bcc96640 1 -- 172.21.15.50:0/2330543843 shutdown_connections 2024-09-11T22:21:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.599+0000 7f26bcc96640 1 --2- 172.21.15.50:0/2330543843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b8162350 0x7f26b81627a0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.599+0000 7f26bcc96640 1 --2- 172.21.15.50:0/2330543843 >> v2:172.21.15.77:3300/0 conn(0x7f26b815e8e0 0x7f26b80b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.599+0000 7f26bcc96640 1 -- 172.21.15.50:0/2330543843 >> 172.21.15.50:0/2330543843 conn(0x7f26b8067ba0 msgr2=0x7f26b8067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.599+0000 7f26bcc96640 1 -- 172.21.15.50:0/2330543843 shutdown_connections 2024-09-11T22:21:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.599+0000 7f26bcc96640 1 -- 172.21.15.50:0/2330543843 wait complete. 2024-09-11T22:21:45.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.601+0000 7f26bcc96640 1 Processor -- start 2024-09-11T22:21:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.601+0000 7f26bcc96640 1 -- start start 2024-09-11T22:21:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.601+0000 7f26bcc96640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b80d1580 0x7f26b80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.601+0000 7f26bcc96640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26b815e8e0 0x7f26b814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.601+0000 7f26bcc96640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26b8162350 0x7f26b815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.601+0000 7f26bcc96640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26b8162ce0 con 0x7f26b80d1580 2024-09-11T22:21:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.601+0000 7f26bcc96640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f26b80d3370 con 0x7f26b8162350 2024-09-11T22:21:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.601+0000 7f26bcc96640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f26b8162e60 con 0x7f26b815e8e0 2024-09-11T22:21:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.601+0000 7f26b659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b80d1580 0x7f26b80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.601+0000 7f26b659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b80d1580 0x7f26b80ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39532/0 (socket says 172.21.15.50:39532) 2024-09-11T22:21:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.601+0000 7f26b659c640 1 -- 172.21.15.50:0/1816844194 learned_addr learned my addr 172.21.15.50:0/1816844194 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.602+0000 7f26b6d9d640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26b8162350 0x7f26b815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.602+0000 7f26b5d9b640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26b815e8e0 0x7f26b814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.602+0000 7f26b659c640 1 -- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26b815e8e0 msgr2=0x7f26b814bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.602+0000 7f26b659c640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26b815e8e0 0x7f26b814bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.602+0000 7f26b659c640 1 -- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26b8162350 msgr2=0x7f26b815bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.602+0000 7f26b659c640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26b8162350 0x7f26b815bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.602+0000 7f26b659c640 1 -- 172.21.15.50:0/1816844194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b80cea50 con 0x7f26b80d1580 2024-09-11T22:21:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.602+0000 7f26b659c640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b80d1580 0x7f26b80ce370 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f26a800efc0 tx=0x7f26a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:45.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.602+0000 7f26aeffd640 1 -- 172.21.15.50:0/1816844194 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8018020 con 0x7f26b80d1580 2024-09-11T22:21:45.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.602+0000 7f26aeffd640 1 -- 172.21.15.50:0/1816844194 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a8014480 con 0x7f26b80d1580 2024-09-11T22:21:45.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.602+0000 7f26bcc96640 1 -- 172.21.15.50:0/1816844194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b80b55d0 con 0x7f26b80d1580 2024-09-11T22:21:45.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.602+0000 7f26aeffd640 1 -- 172.21.15.50:0/1816844194 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8014850 con 0x7f26b80d1580 2024-09-11T22:21:45.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.602+0000 7f26bcc96640 1 -- 172.21.15.50:0/1816844194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b80b5b90 con 0x7f26b80d1580 2024-09-11T22:21:45.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.603+0000 7f26bcc96640 1 -- 172.21.15.50:0/1816844194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b80b53e0 con 0x7f26b80d1580 2024-09-11T22:21:45.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.604+0000 7f26aeffd640 1 -- 172.21.15.50:0/1816844194 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26a8005d10 con 0x7f26b80d1580 2024-09-11T22:21:45.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.604+0000 7f26aeffd640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f269806be60 0x7f269806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:45.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.604+0000 7f26aeffd640 1 -- 172.21.15.50:0/1816844194 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5443+0+0 (secure 0 0 0) 0x7f26a808b6d0 con 0x7f26b80d1580 2024-09-11T22:21:45.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.605+0000 7f26b5d9b640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f269806be60 0x7f269806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:45.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.605+0000 7f26b5d9b640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f269806be60 0x7f269806e320 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f26b815ce00 tx=0x7f26a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:45.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.609+0000 7f26aeffd640 1 -- 172.21.15.50:0/1816844194 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26a8022070 con 0x7f26b80d1580 2024-09-11T22:21:45.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:45.785+0000 7f26bcc96640 1 -- 172.21.15.50:0/1816844194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f26b80b7880 con 0x7f26b80d1580 2024-09-11T22:21:46.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.472+0000 7f26aeffd640 1 -- 172.21.15.50:0/1816844194 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v160) ==== 169+0+0 (secure 0 0 0) 0x7f26a8010040 con 0x7f26b80d1580 2024-09-11T22:21:46.473 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:21:46.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.476+0000 7f26bcc96640 1 -- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f269806be60 msgr2=0x7f269806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.476+0000 7f26bcc96640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f269806be60 0x7f269806e320 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f26b815ce00 tx=0x7f26a0009040 comp rx=0 tx=0).stop 2024-09-11T22:21:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.476+0000 7f26bcc96640 1 -- 172.21.15.50:0/1816844194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b80d1580 msgr2=0x7f26b80ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.476+0000 7f26bcc96640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b80d1580 0x7f26b80ce370 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f26a800efc0 tx=0x7f26a800c490 comp rx=0 tx=0).stop 2024-09-11T22:21:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.476+0000 7f26bcc96640 1 -- 172.21.15.50:0/1816844194 shutdown_connections 2024-09-11T22:21:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.476+0000 7f26bcc96640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f269806be60 0x7f269806e320 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.476+0000 7f26bcc96640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26b815e8e0 0x7f26b814bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.476+0000 7f26bcc96640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26b8162350 0x7f26b815bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.476+0000 7f26bcc96640 1 --2- 172.21.15.50:0/1816844194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26b80d1580 0x7f26b80ce370 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.476+0000 7f26bcc96640 1 -- 172.21.15.50:0/1816844194 >> 172.21.15.50:0/1816844194 conn(0x7f26b8067ba0 msgr2=0x7f26b80b9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.477+0000 7f26bcc96640 1 -- 172.21.15.50:0/1816844194 shutdown_connections 2024-09-11T22:21:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.477+0000 7f26bcc96640 1 -- 172.21.15.50:0/1816844194 wait complete. 2024-09-11T22:21:46.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T22:21:46.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.605+0000 7f1369313640 1 Processor -- start 2024-09-11T22:21:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.605+0000 7f1369313640 1 -- start start 2024-09-11T22:21:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1369313640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f136415fd80 0x7f13640b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1369313640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13640af4c0 0x7f13640b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1369313640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f13640b2970 0x7f13640d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1369313640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f13640af940 con 0x7f136415fd80 2024-09-11T22:21:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1369313640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f13640afc20 con 0x7f13640b2970 2024-09-11T22:21:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1369313640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f13640aff00 con 0x7f13640af4c0 2024-09-11T22:21:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1362ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f136415fd80 0x7f13640b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1362ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f136415fd80 0x7f13640b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39540/0 (socket says 172.21.15.50:39540) 2024-09-11T22:21:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1362ffd640 1 -- 172.21.15.50:0/345626904 learned_addr learned my addr 172.21.15.50:0/345626904 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f13627fc640 1 --2- 172.21.15.50:0/345626904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13640af4c0 0x7f13640b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f13637fe640 1 --2- 172.21.15.50:0/345626904 >> v2:172.21.15.77:3300/0 conn(0x7f13640b2970 0x7f13640d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1362ffd640 1 -- 172.21.15.50:0/345626904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13640af4c0 msgr2=0x7f13640b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1362ffd640 1 --2- 172.21.15.50:0/345626904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13640af4c0 0x7f13640b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1362ffd640 1 -- 172.21.15.50:0/345626904 >> v2:172.21.15.77:3300/0 conn(0x7f13640b2970 msgr2=0x7f13640d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1362ffd640 1 --2- 172.21.15.50:0/345626904 >> v2:172.21.15.77:3300/0 conn(0x7f13640b2970 0x7f13640d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f1362ffd640 1 -- 172.21.15.50:0/345626904 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13640b01e0 con 0x7f136415fd80 2024-09-11T22:21:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f13627fc640 1 --2- 172.21.15.50:0/345626904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13640af4c0 0x7f13640b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.606+0000 7f13637fe640 1 --2- 172.21.15.50:0/345626904 >> v2:172.21.15.77:3300/0 conn(0x7f13640b2970 0x7f13640d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.607+0000 7f1362ffd640 1 --2- 172.21.15.50:0/345626904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f136415fd80 0x7f13640b1ef0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f13640731f0 tx=0x7f135402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3397ac43888183 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.607+0000 7f1361ffb640 1 -- 172.21.15.50:0/345626904 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354037070 con 0x7f136415fd80 2024-09-11T22:21:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.607+0000 7f1361ffb640 1 -- 172.21.15.50:0/345626904 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1354032440 con 0x7f136415fd80 2024-09-11T22:21:46.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.607+0000 7f1361ffb640 1 -- 172.21.15.50:0/345626904 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354032810 con 0x7f136415fd80 2024-09-11T22:21:46.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.608+0000 7f1369313640 1 -- 172.21.15.50:0/345626904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f136415fd80 msgr2=0x7f13640b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.608+0000 7f1369313640 1 --2- 172.21.15.50:0/345626904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f136415fd80 0x7f13640b1ef0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f13640731f0 tx=0x7f135402a140 comp rx=0 tx=0).stop 2024-09-11T22:21:46.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.608+0000 7f1369313640 1 -- 172.21.15.50:0/345626904 shutdown_connections 2024-09-11T22:21:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.608+0000 7f1369313640 1 --2- 172.21.15.50:0/345626904 >> v2:172.21.15.77:3300/0 conn(0x7f13640b2970 0x7f13640d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.608+0000 7f1369313640 1 --2- 172.21.15.50:0/345626904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13640af4c0 0x7f13640b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.608+0000 7f1369313640 1 --2- 172.21.15.50:0/345626904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f136415fd80 0x7f13640b1ef0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.608+0000 7f1369313640 1 -- 172.21.15.50:0/345626904 >> 172.21.15.50:0/345626904 conn(0x7f136409ba50 msgr2=0x7f13640b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.608+0000 7f1369313640 1 -- 172.21.15.50:0/345626904 shutdown_connections 2024-09-11T22:21:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.608+0000 7f1369313640 1 -- 172.21.15.50:0/345626904 wait complete. 2024-09-11T22:21:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.609+0000 7f1369313640 1 Processor -- start 2024-09-11T22:21:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.609+0000 7f1369313640 1 -- start start 2024-09-11T22:21:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1369313640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13640af4c0 0x7f13641579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1369313640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13640b2970 0x7f13641f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1369313640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136415fd80 0x7f136406cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1369313640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1364160160 con 0x7f13640af4c0 2024-09-11T22:21:46.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1369313640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f13640b3ee0 con 0x7f136415fd80 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1369313640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f13641602e0 con 0x7f13640b2970 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1362ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13640af4c0 0x7f13641579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1362ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13640af4c0 0x7f13641579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39554/0 (socket says 172.21.15.50:39554) 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1362ffd640 1 -- 172.21.15.50:0/763954263 learned_addr learned my addr 172.21.15.50:0/763954263 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f13637fe640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136415fd80 0x7f136406cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f13627fc640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13640b2970 0x7f13641f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1362ffd640 1 -- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13640b2970 msgr2=0x7f13641f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1362ffd640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13640b2970 0x7f13641f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1362ffd640 1 -- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136415fd80 msgr2=0x7f136406cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1362ffd640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136415fd80 0x7f136406cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1362ffd640 1 -- 172.21.15.50:0/763954263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13641f5870 con 0x7f13640af4c0 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f13637fe640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136415fd80 0x7f136406cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f13627fc640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13640b2970 0x7f13641f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:46.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.610+0000 7f1362ffd640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13640af4c0 0x7f13641579b0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f1354000c00 tx=0x7f13540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.611+0000 7f134b7fe640 1 -- 172.21.15.50:0/763954263 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354041070 con 0x7f13640af4c0 2024-09-11T22:21:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.611+0000 7f134b7fe640 1 -- 172.21.15.50:0/763954263 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f135403c870 con 0x7f13640af4c0 2024-09-11T22:21:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.611+0000 7f1369313640 1 -- 172.21.15.50:0/763954263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1364159400 con 0x7f13640af4c0 2024-09-11T22:21:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.611+0000 7f134b7fe640 1 -- 172.21.15.50:0/763954263 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354037040 con 0x7f13640af4c0 2024-09-11T22:21:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.611+0000 7f1369313640 1 -- 172.21.15.50:0/763954263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f136415ccf0 con 0x7f13640af4c0 2024-09-11T22:21:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.612+0000 7f1369313640 1 -- 172.21.15.50:0/763954263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13640b1ef0 con 0x7f13640af4c0 2024-09-11T22:21:46.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.612+0000 7f134b7fe640 1 -- 172.21.15.50:0/763954263 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1354044070 con 0x7f13640af4c0 2024-09-11T22:21:46.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.613+0000 7f134b7fe640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f135006be30 0x7f135006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.613+0000 7f134b7fe640 1 -- 172.21.15.50:0/763954263 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5029+0+0 (secure 0 0 0) 0x7f13540ab860 con 0x7f13640af4c0 2024-09-11T22:21:46.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.613+0000 7f13627fc640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f135006be30 0x7f135006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.614+0000 7f13627fc640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f135006be30 0x7f135006e2f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1358006fd0 tx=0x7f1358008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:46.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.617+0000 7f134b7fe640 1 -- 172.21.15.50:0/763954263 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f13641f5870 con 0x7f13640af4c0 2024-09-11T22:21:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.810+0000 7f1369313640 1 -- 172.21.15.50:0/763954263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f136406fe80 con 0x7f13640af4c0 2024-09-11T22:21:46.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.813+0000 7f134b7fe640 1 -- 172.21.15.50:0/763954263 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7f135407a5d0 con 0x7f13640af4c0 2024-09-11T22:21:46.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.815+0000 7f1369313640 1 -- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f135006be30 msgr2=0x7f135006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.815+0000 7f1369313640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f135006be30 0x7f135006e2f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1358006fd0 tx=0x7f1358008040 comp rx=0 tx=0).stop 2024-09-11T22:21:46.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.815+0000 7f1369313640 1 -- 172.21.15.50:0/763954263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13640af4c0 msgr2=0x7f13641579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.815+0000 7f1369313640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13640af4c0 0x7f13641579b0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f1354000c00 tx=0x7f13540046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.815+0000 7f1369313640 1 -- 172.21.15.50:0/763954263 shutdown_connections 2024-09-11T22:21:46.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.815+0000 7f1369313640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f135006be30 0x7f135006e2f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.815+0000 7f1369313640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13640b2970 0x7f13641f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.815+0000 7f1369313640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136415fd80 0x7f136406cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.815+0000 7f1369313640 1 --2- 172.21.15.50:0/763954263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13640af4c0 0x7f13641579b0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.815+0000 7f1369313640 1 -- 172.21.15.50:0/763954263 >> 172.21.15.50:0/763954263 conn(0x7f136409ba50 msgr2=0x7f13640b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:46.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.815+0000 7f1369313640 1 -- 172.21.15.50:0/763954263 shutdown_connections 2024-09-11T22:21:46.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.815+0000 7f1369313640 1 -- 172.21.15.50:0/763954263 wait complete. 2024-09-11T22:21:46.827 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-11T22:21:46.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.929+0000 7fa57e4a6640 1 Processor -- start 2024-09-11T22:21:46.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.929+0000 7fa57e4a6640 1 -- start start 2024-09-11T22:21:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa57e4a6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa57815c3c0 0x7fa57815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa57e4a6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57815ec40 0x7fa57815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa57e4a6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa57815f7f0 con 0x7fa5780679c0 2024-09-11T22:21:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa57e4a6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa57806e700 con 0x7fa57815c3c0 2024-09-11T22:21:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa57e4a6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa57815fad0 con 0x7fa57815ec40 2024-09-11T22:21:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa577fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa57815c3c0 0x7fa57815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa57ca43640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa5780679c0 0x7fa57806f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46118/0 (socket says 172.21.15.50:46118) 2024-09-11T22:21:46.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa577fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa57815c3c0 0x7fa57815fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39566/0 (socket says 172.21.15.50:39566) 2024-09-11T22:21:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa57ca43640 1 -- 172.21.15.50:0/3898180400 learned_addr learned my addr 172.21.15.50:0/3898180400 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa5777fe640 1 --2- 172.21.15.50:0/3898180400 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57815ec40 0x7fa57815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa577fff640 1 -- 172.21.15.50:0/3898180400 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57815ec40 msgr2=0x7fa57815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa577fff640 1 --2- 172.21.15.50:0/3898180400 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57815ec40 0x7fa57815f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa577fff640 1 -- 172.21.15.50:0/3898180400 >> v1:172.21.15.50:6789/0 conn(0x7fa5780679c0 legacy=0x7fa57806f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa577fff640 1 -- 172.21.15.50:0/3898180400 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57806e950 con 0x7fa57815c3c0 2024-09-11T22:21:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa576ffd640 1 -- 172.21.15.50:0/3898180400 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4053323616 0 0) 0x7fa57815f7f0 con 0x7fa5780679c0 2024-09-11T22:21:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.930+0000 7fa5777fe640 1 --2- 172.21.15.50:0/3898180400 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57815ec40 0x7fa57815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.931+0000 7fa577fff640 1 --2- 172.21.15.50:0/3898180400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa57815c3c0 0x7fa57815fe60 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fa5680097a0 tx=0x7fa56802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e0010cb14d11a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.931+0000 7fa576ffd640 1 -- 172.21.15.50:0/3898180400 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568037070 con 0x7fa57815c3c0 2024-09-11T22:21:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.931+0000 7fa576ffd640 1 -- 172.21.15.50:0/3898180400 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa56802ae50 con 0x7fa57815c3c0 2024-09-11T22:21:46.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.931+0000 7fa576ffd640 1 -- 172.21.15.50:0/3898180400 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568032660 con 0x7fa57815c3c0 2024-09-11T22:21:46.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.932+0000 7fa57e4a6640 1 -- 172.21.15.50:0/3898180400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa57815c3c0 msgr2=0x7fa57815fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.932+0000 7fa57e4a6640 1 --2- 172.21.15.50:0/3898180400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa57815c3c0 0x7fa57815fe60 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fa5680097a0 tx=0x7fa56802a100 comp rx=0 tx=0).stop 2024-09-11T22:21:46.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.932+0000 7fa57e4a6640 1 -- 172.21.15.50:0/3898180400 shutdown_connections 2024-09-11T22:21:46.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.932+0000 7fa57e4a6640 1 --2- 172.21.15.50:0/3898180400 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57815ec40 0x7fa57815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.932+0000 7fa57e4a6640 1 --2- 172.21.15.50:0/3898180400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa57815c3c0 0x7fa57815fe60 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.932+0000 7fa57e4a6640 1 -- 172.21.15.50:0/3898180400 >> 172.21.15.50:0/3898180400 conn(0x7fa578075060 msgr2=0x7fa57806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.932+0000 7fa57e4a6640 1 -- 172.21.15.50:0/3898180400 shutdown_connections 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.932+0000 7fa57e4a6640 1 -- 172.21.15.50:0/3898180400 wait complete. 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.933+0000 7fa57e4a6640 1 Processor -- start 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.933+0000 7fa57e4a6640 1 -- start start 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.934+0000 7fa57e4a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5780679c0 0x7fa578140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.934+0000 7fa57e4a6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57815c3c0 0x7fa57815a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.934+0000 7fa57e4a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa57815ec40 0x7fa578155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.934+0000 7fa57e4a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa578067e30 con 0x7fa5780679c0 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.934+0000 7fa57e4a6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa5780d0940 con 0x7fa57815ec40 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.934+0000 7fa57e4a6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa578067fb0 con 0x7fa57815c3c0 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.934+0000 7fa577fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5780679c0 0x7fa578140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.934+0000 7fa577fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5780679c0 0x7fa578140970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39568/0 (socket says 172.21.15.50:39568) 2024-09-11T22:21:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.934+0000 7fa577fff640 1 -- 172.21.15.50:0/1728090755 learned_addr learned my addr 172.21.15.50:0/1728090755 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.935+0000 7fa577fff640 1 -- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57815c3c0 msgr2=0x7fa57815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.935+0000 7fa577fff640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57815c3c0 0x7fa57815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.935+0000 7fa577fff640 1 -- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa57815ec40 msgr2=0x7fa578155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.935+0000 7fa57ca43640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa57815ec40 0x7fa578155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.935+0000 7fa577fff640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa57815ec40 0x7fa578155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.935+0000 7fa577fff640 1 -- 172.21.15.50:0/1728090755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa578150490 con 0x7fa5780679c0 2024-09-11T22:21:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.935+0000 7fa57ca43640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa57815ec40 0x7fa578155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.935+0000 7fa577fff640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5780679c0 0x7fa578140970 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fa5680097a0 tx=0x7fa5680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.935+0000 7fa574ff9640 1 -- 172.21.15.50:0/1728090755 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568037040 con 0x7fa5780679c0 2024-09-11T22:21:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.935+0000 7fa574ff9640 1 -- 172.21.15.50:0/1728090755 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa568004250 con 0x7fa5780679c0 2024-09-11T22:21:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.935+0000 7fa57e4a6640 1 -- 172.21.15.50:0/1728090755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa578159570 con 0x7fa5780679c0 2024-09-11T22:21:46.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.935+0000 7fa574ff9640 1 -- 172.21.15.50:0/1728090755 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568003610 con 0x7fa5780679c0 2024-09-11T22:21:46.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.935+0000 7fa57e4a6640 1 -- 172.21.15.50:0/1728090755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa578159b30 con 0x7fa5780679c0 2024-09-11T22:21:46.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.936+0000 7fa57e4a6640 1 -- 172.21.15.50:0/1728090755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa57815fe60 con 0x7fa5780679c0 2024-09-11T22:21:46.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.937+0000 7fa574ff9640 1 -- 172.21.15.50:0/1728090755 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa5680037b0 con 0x7fa5780679c0 2024-09-11T22:21:46.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.937+0000 7fa574ff9640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa56406be30 0x7fa56406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.937+0000 7fa574ff9640 1 -- 172.21.15.50:0/1728090755 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5029+0+0 (secure 0 0 0) 0x7fa5680aba40 con 0x7fa5780679c0 2024-09-11T22:21:46.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.937+0000 7fa5777fe640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa56406be30 0x7fa56406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.938+0000 7fa5777fe640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa56406be30 0x7fa56406e2f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa56c006fd0 tx=0x7fa56c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:46.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:46.941+0000 7fa574ff9640 1 -- 172.21.15.50:0/1728090755 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa578150490 con 0x7fa5780679c0 2024-09-11T22:21:47.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.204+0000 7fa57e4a6640 1 -- 172.21.15.50:0/1728090755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7fa5780b6030 con 0x7fa5780679c0 2024-09-11T22:21:47.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.473+0000 7fa574ff9640 1 -- 172.21.15.50:0/1728090755 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v510) ==== 166+0+0 (secure 0 0 0) 0x7fa56807a840 con 0x7fa5780679c0 2024-09-11T22:21:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.475+0000 7fa57e4a6640 1 -- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa56406be30 msgr2=0x7fa56406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.475+0000 7fa57e4a6640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa56406be30 0x7fa56406e2f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa56c006fd0 tx=0x7fa56c008040 comp rx=0 tx=0).stop 2024-09-11T22:21:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.475+0000 7fa57e4a6640 1 -- 172.21.15.50:0/1728090755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5780679c0 msgr2=0x7fa578140970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:47.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.475+0000 7fa57e4a6640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5780679c0 0x7fa578140970 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fa5680097a0 tx=0x7fa5680046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.475+0000 7fa57e4a6640 1 -- 172.21.15.50:0/1728090755 shutdown_connections 2024-09-11T22:21:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.475+0000 7fa57e4a6640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa56406be30 0x7fa56406e2f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.475+0000 7fa57e4a6640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57815c3c0 0x7fa57815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.475+0000 7fa57e4a6640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa57815ec40 0x7fa578155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.475+0000 7fa57e4a6640 1 --2- 172.21.15.50:0/1728090755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5780679c0 0x7fa578140970 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.475+0000 7fa57e4a6640 1 -- 172.21.15.50:0/1728090755 >> 172.21.15.50:0/1728090755 conn(0x7fa578075060 msgr2=0x7fa57806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.476+0000 7fa57e4a6640 1 -- 172.21.15.50:0/1728090755 shutdown_connections 2024-09-11T22:21:47.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.476+0000 7fa57e4a6640 1 -- 172.21.15.50:0/1728090755 wait complete. 2024-09-11T22:21:47.489 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-11T22:21:47.489 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-11T22:21:47.489 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:21:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.592+0000 7f140e54b640 1 Processor -- start 2024-09-11T22:21:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.592+0000 7f140e54b640 1 -- start start 2024-09-11T22:21:47.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.593+0000 7f140e54b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140815e8e0 0x7f14080b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.593+0000 7f140e54b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f14080d1580 0x7f14080d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.593+0000 7f140e54b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14080d1ee0 con 0x7f1408162350 2024-09-11T22:21:47.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.593+0000 7f140e54b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f140815ecc0 con 0x7f14080d1580 2024-09-11T22:21:47.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.593+0000 7f140e54b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f14080d2ad0 con 0x7f140815e8e0 2024-09-11T22:21:47.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.593+0000 7f140cae8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1408162350 0x7f1408162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54784/0 (socket says 172.21.15.50:54784) 2024-09-11T22:21:47.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.593+0000 7f140cae8640 1 -- 172.21.15.50:0/3501370737 learned_addr learned my addr 172.21.15.50:0/3501370737 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:47.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f14077fe640 1 --2- 172.21.15.50:0/3501370737 >> v2:172.21.15.77:3300/0 conn(0x7f14080d1580 0x7f14080d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773208850 0 0) 0x7f14080d1ee0 con 0x7f1408162350 2024-09-11T22:21:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1407fff640 1 --2- 172.21.15.50:0/3501370737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140815e8e0 0x7f14080b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13f0003520 con 0x7f1408162350 2024-09-11T22:21:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 312019205 0 0) 0x7f13f0003520 con 0x7f1408162350 2024-09-11T22:21:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140815e8e0 msgr2=0x7f14080b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 --2- 172.21.15.50:0/3501370737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140815e8e0 0x7f14080b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 >> v2:172.21.15.77:3300/0 conn(0x7f14080d1580 msgr2=0x7f14080d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 --2- 172.21.15.50:0/3501370737 >> v2:172.21.15.77:3300/0 conn(0x7f14080d1580 0x7f14080d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1408163080 con 0x7f1408162350 2024-09-11T22:21:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f14000019f0 con 0x7f1408162350 2024-09-11T22:21:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 >> v1:172.21.15.50:6789/0 conn(0x7f1408162350 legacy=0x7f1408162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 --2- 172.21.15.50:0/3501370737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13f00039b0 0x7f13f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 --2- 172.21.15.50:0/3501370737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f0004800 0x7f13f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 --2- 172.21.15.50:0/3501370737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140815e8e0 0x7f13f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f14080d2ad0 con 0x7f13f0004800 2024-09-11T22:21:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f13f000b9c0 con 0x7f13f00039b0 2024-09-11T22:21:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f13f000bb40 con 0x7f140815e8e0 2024-09-11T22:21:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f14077fe640 1 --2- 172.21.15.50:0/3501370737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f0004800 0x7f13f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f1407fff640 1 --2- 172.21.15.50:0/3501370737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13f00039b0 0x7f13f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f140cae8640 1 --2- 172.21.15.50:0/3501370737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140815e8e0 0x7f13f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f14077fe640 1 -- 172.21.15.50:0/3501370737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140815e8e0 msgr2=0x7f13f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f14077fe640 1 --2- 172.21.15.50:0/3501370737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140815e8e0 0x7f13f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f14077fe640 1 -- 172.21.15.50:0/3501370737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13f00039b0 msgr2=0x7f13f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f14077fe640 1 --2- 172.21.15.50:0/3501370737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13f00039b0 0x7f13f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.594+0000 7f14077fe640 1 -- 172.21.15.50:0/3501370737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f0003520 con 0x7f13f0004800 2024-09-11T22:21:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.595+0000 7f14077fe640 1 --2- 172.21.15.50:0/3501370737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f0004800 0x7f13f0004c80 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009a90 tx=0x7f13f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d86346f15a251cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.595+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc036070 con 0x7f13f0004800 2024-09-11T22:21:47.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.595+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc031400 con 0x7f13f0004800 2024-09-11T22:21:47.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.595+0000 7f1406ffd640 1 -- 172.21.15.50:0/3501370737 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc009690 con 0x7f13f0004800 2024-09-11T22:21:47.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.596+0000 7f140e54b640 1 -- 172.21.15.50:0/3501370737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f0004800 msgr2=0x7f13f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.596+0000 7f140e54b640 1 --2- 172.21.15.50:0/3501370737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13f0004800 0x7f13f0004c80 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009a90 tx=0x7f13f0005830 comp rx=0 tx=0).stop 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.596+0000 7f140cae8640 1 -- 172.21.15.50:0/3501370737 reap_dead start 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.596+0000 7f140e54b640 1 -- 172.21.15.50:0/3501370737 shutdown_connections 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.596+0000 7f140e54b640 1 -- 172.21.15.50:0/3501370737 >> 172.21.15.50:0/3501370737 conn(0x7f1408067ba0 msgr2=0x7f1408067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.596+0000 7f140e54b640 1 -- 172.21.15.50:0/3501370737 shutdown_connections 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.596+0000 7f140e54b640 1 -- 172.21.15.50:0/3501370737 wait complete. 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.597+0000 7f140e54b640 1 Processor -- start 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.597+0000 7f140e54b640 1 -- start start 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140e54b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13f0004800 0x7f14080ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140e54b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14080b6270 0x7f140815f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140e54b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14080b66d0 0x7f140815fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140e54b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f14080d3000 con 0x7f14080b66d0 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140e54b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f14080d3370 con 0x7f14080b6270 2024-09-11T22:21:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140e54b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f14080b7880 con 0x7f13f0004800 2024-09-11T22:21:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140cae8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14080b66d0 0x7f140815fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f1407fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13f0004800 0x7f14080ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140cae8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14080b66d0 0x7f140815fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59670/0 (socket says 172.21.15.50:59670) 2024-09-11T22:21:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f1407fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13f0004800 0x7f14080ca810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:40134/0 (socket says 172.21.15.50:40134) 2024-09-11T22:21:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140cae8640 1 -- 172.21.15.50:0/1118980967 learned_addr learned my addr 172.21.15.50:0/1118980967 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f14077fe640 1 --2- 172.21.15.50:0/1118980967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14080b6270 0x7f140815f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140cae8640 1 -- 172.21.15.50:0/1118980967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13f0004800 msgr2=0x7f14080ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140cae8640 1 --2- 172.21.15.50:0/1118980967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13f0004800 0x7f14080ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140cae8640 1 -- 172.21.15.50:0/1118980967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14080b6270 msgr2=0x7f140815f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140cae8640 1 --2- 172.21.15.50:0/1118980967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14080b6270 0x7f140815f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.598+0000 7f140cae8640 1 -- 172.21.15.50:0/1118980967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14080cd990 con 0x7f14080b66d0 2024-09-11T22:21:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.599+0000 7f140cae8640 1 --2- 172.21.15.50:0/1118980967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14080b66d0 0x7f140815fe40 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f14080d0ff0 tx=0x7f1400007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.599+0000 7f1404ff9640 1 -- 172.21.15.50:0/1118980967 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140000ab50 con 0x7f14080b66d0 2024-09-11T22:21:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.599+0000 7f1404ff9640 1 -- 172.21.15.50:0/1118980967 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1400018070 con 0x7f14080b66d0 2024-09-11T22:21:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.599+0000 7f140e54b640 1 -- 172.21.15.50:0/1118980967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14080cdc70 con 0x7f14080b66d0 2024-09-11T22:21:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.599+0000 7f1404ff9640 1 -- 172.21.15.50:0/1118980967 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14000133f0 con 0x7f14080b66d0 2024-09-11T22:21:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.599+0000 7f140e54b640 1 -- 172.21.15.50:0/1118980967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14080ce230 con 0x7f14080b66d0 2024-09-11T22:21:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.600+0000 7f140e54b640 1 -- 172.21.15.50:0/1118980967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14080b7c10 con 0x7f14080b66d0 2024-09-11T22:21:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.600+0000 7f1404ff9640 1 -- 172.21.15.50:0/1118980967 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1400013590 con 0x7f14080b66d0 2024-09-11T22:21:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.601+0000 7f1404ff9640 1 --2- 172.21.15.50:0/1118980967 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f13f406be60 0x7f13f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.601+0000 7f1404ff9640 1 -- 172.21.15.50:0/1118980967 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5029+0+0 (secure 0 0 0) 0x7f140008b0c0 con 0x7f14080b66d0 2024-09-11T22:21:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.601+0000 7f1407fff640 1 --2- 172.21.15.50:0/1118980967 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f13f406be60 0x7f13f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.602+0000 7f1407fff640 1 --2- 172.21.15.50:0/1118980967 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f13f406be60 0x7f13f406e320 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009ae0 tx=0x7f13f8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:47.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.605+0000 7f1404ff9640 1 -- 172.21.15.50:0/1118980967 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1400059c80 con 0x7f14080b66d0 2024-09-11T22:21:47.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.780+0000 7f140e54b640 1 -- 172.21.15.50:0/1118980967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14080cfe50 con 0x7f14080b66d0 2024-09-11T22:21:47.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.781+0000 7f1404ff9640 1 -- 172.21.15.50:0/1118980967 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) ==== 74+0+13136 (secure 0 0 0) 0x7f1400059580 con 0x7f14080b66d0 2024-09-11T22:21:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:47.782 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":160,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:21:46.468506+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6834/1490732484":"2024-09-12T22:21:43.459312+0000","172.21.15.50:6832/1490732484":"2024-09-12T22:21:43.459312+0000","172.21.15.50:6835/3562809701":"2024-09-12T22:21:36.057947+0000","172.21.15.50:6833/3562809701":"2024-09-12T22:21:36.057947+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:21:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.783+0000 7f140e54b640 1 -- 172.21.15.50:0/1118980967 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f13f406be60 msgr2=0x7f13f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.783+0000 7f140e54b640 1 --2- 172.21.15.50:0/1118980967 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f13f406be60 0x7f13f406e320 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009ae0 tx=0x7f13f8009190 comp rx=0 tx=0).stop 2024-09-11T22:21:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.783+0000 7f140e54b640 1 -- 172.21.15.50:0/1118980967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14080b66d0 msgr2=0x7f140815fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.783+0000 7f140e54b640 1 --2- 172.21.15.50:0/1118980967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14080b66d0 0x7f140815fe40 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f14080d0ff0 tx=0x7f1400007a20 comp rx=0 tx=0).stop 2024-09-11T22:21:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.783+0000 7f140e54b640 1 -- 172.21.15.50:0/1118980967 shutdown_connections 2024-09-11T22:21:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.783+0000 7f140e54b640 1 --2- 172.21.15.50:0/1118980967 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f13f406be60 0x7f13f406e320 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.783+0000 7f140e54b640 1 --2- 172.21.15.50:0/1118980967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14080b66d0 0x7f140815fe40 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.783+0000 7f140e54b640 1 --2- 172.21.15.50:0/1118980967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14080b6270 0x7f140815f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.783+0000 7f140e54b640 1 --2- 172.21.15.50:0/1118980967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13f0004800 0x7f14080ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.783+0000 7f140e54b640 1 -- 172.21.15.50:0/1118980967 >> 172.21.15.50:0/1118980967 conn(0x7f1408067ba0 msgr2=0x7f1408069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.784+0000 7f140e54b640 1 -- 172.21.15.50:0/1118980967 shutdown_connections 2024-09-11T22:21:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.784+0000 7f140e54b640 1 -- 172.21.15.50:0/1118980967 wait complete. 2024-09-11T22:21:47.796 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:11:03.407373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:21:47.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:21:47.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.902+0000 7fb4e76c9640 1 Processor -- start 2024-09-11T22:21:47.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.902+0000 7fb4e76c9640 1 -- start start 2024-09-11T22:21:47.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.903+0000 7fb4e76c9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4e00cf610 0x7fb4e00b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.903+0000 7fb4e76c9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb4e00b1600 0x7fb4e00cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.903+0000 7fb4e76c9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e00cfbd0 con 0x7fb4e0161fa0 2024-09-11T22:21:47.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.903+0000 7fb4e76c9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb4e00d1220 con 0x7fb4e00b1600 2024-09-11T22:21:47.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.903+0000 7fb4e76c9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e00d17e0 con 0x7fb4e00cf610 2024-09-11T22:21:47.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.903+0000 7fb4e5465640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb4e0161fa0 0x7fb4e00cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54792/0 (socket says 172.21.15.50:54792) 2024-09-11T22:21:47.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.903+0000 7fb4e5465640 1 -- 172.21.15.50:0/2485876513 learned_addr learned my addr 172.21.15.50:0/2485876513 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:47.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.903+0000 7fb4e5c66640 1 --2- 172.21.15.50:0/2485876513 >> v2:172.21.15.50:3300/0 conn(0x7fb4e00b1600 0x7fb4e00cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.903+0000 7fb4e4c64640 1 --2- 172.21.15.50:0/2485876513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4e00cf610 0x7fb4e00b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.903+0000 7fb4e5c66640 1 -- 172.21.15.50:0/2485876513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4e00cf610 msgr2=0x7fb4e00b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:47.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.903+0000 7fb4e5c66640 1 --2- 172.21.15.50:0/2485876513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4e00cf610 0x7fb4e00b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.903+0000 7fb4e5c66640 1 -- 172.21.15.50:0/2485876513 >> v1:172.21.15.50:6789/0 conn(0x7fb4e0161fa0 legacy=0x7fb4e00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:47.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.903+0000 7fb4e5c66640 1 -- 172.21.15.50:0/2485876513 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e00cfeb0 con 0x7fb4e00b1600 2024-09-11T22:21:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.904+0000 7fb4e5c66640 1 --2- 172.21.15.50:0/2485876513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e00b1600 0x7fb4e00cccd0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009d90 tx=0x7fb4d802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e3de0a3a7f9fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.904+0000 7fb4d7fff640 1 -- 172.21.15.50:0/2485876513 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8007740 con 0x7fb4e00b1600 2024-09-11T22:21:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.904+0000 7fb4d7fff640 1 -- 172.21.15.50:0/2485876513 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d80078e0 con 0x7fb4e00b1600 2024-09-11T22:21:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.904+0000 7fb4d7fff640 1 -- 172.21.15.50:0/2485876513 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8007cb0 con 0x7fb4e00b1600 2024-09-11T22:21:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.905+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2485876513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e00b1600 msgr2=0x7fb4e00cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.905+0000 7fb4e76c9640 1 --2- 172.21.15.50:0/2485876513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e00b1600 0x7fb4e00cccd0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009d90 tx=0x7fb4d802a660 comp rx=0 tx=0).stop 2024-09-11T22:21:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.905+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2485876513 shutdown_connections 2024-09-11T22:21:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.905+0000 7fb4e76c9640 1 --2- 172.21.15.50:0/2485876513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e00b1600 0x7fb4e00cccd0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.905+0000 7fb4e76c9640 1 --2- 172.21.15.50:0/2485876513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4e00cf610 0x7fb4e00b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.905+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2485876513 >> 172.21.15.50:0/2485876513 conn(0x7fb4e009ba50 msgr2=0x7fb4e00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:47.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.905+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2485876513 shutdown_connections 2024-09-11T22:21:47.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.905+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2485876513 wait complete. 2024-09-11T22:21:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.906+0000 7fb4e76c9640 1 Processor -- start 2024-09-11T22:21:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.906+0000 7fb4e76c9640 1 -- start start 2024-09-11T22:21:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e76c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e00b1600 0x7fb4e00b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e76c9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4e00cf610 0x7fb4e01f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e76c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e0161fa0 0x7fb4e00b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e76c9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e0162500 con 0x7fb4e0161fa0 2024-09-11T22:21:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e76c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e0162380 con 0x7fb4e00b1600 2024-09-11T22:21:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e76c9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e00d1c70 con 0x7fb4e00cf610 2024-09-11T22:21:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e5c66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e0161fa0 0x7fb4e00b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e5c66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e0161fa0 0x7fb4e00b7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59686/0 (socket says 172.21.15.50:59686) 2024-09-11T22:21:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e5c66640 1 -- 172.21.15.50:0/2214528223 learned_addr learned my addr 172.21.15.50:0/2214528223 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:47.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e5465640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e00b1600 0x7fb4e00b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e4c64640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4e00cf610 0x7fb4e01f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e5c66640 1 -- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4e00cf610 msgr2=0x7fb4e01f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:47.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e5c66640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4e00cf610 0x7fb4e01f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e5c66640 1 -- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e00b1600 msgr2=0x7fb4e00b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:47.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e5c66640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e00b1600 0x7fb4e00b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:47.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e5c66640 1 -- 172.21.15.50:0/2214528223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e01f4870 con 0x7fb4e0161fa0 2024-09-11T22:21:47.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e5465640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e00b1600 0x7fb4e00b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:47.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e4c64640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4e00cf610 0x7fb4e01f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:47.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e5c66640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e0161fa0 0x7fb4e00b7b50 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009eb0 tx=0x7fb4d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:47.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4d5ffb640 1 -- 172.21.15.50:0/2214528223 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d803f070 con 0x7fb4e0161fa0 2024-09-11T22:21:47.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4d5ffb640 1 -- 172.21.15.50:0/2214528223 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d8031bc0 con 0x7fb4e0161fa0 2024-09-11T22:21:47.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4d5ffb640 1 -- 172.21.15.50:0/2214528223 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8044460 con 0x7fb4e0161fa0 2024-09-11T22:21:47.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.907+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2214528223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e01f4af0 con 0x7fb4e0161fa0 2024-09-11T22:21:47.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.908+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2214528223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e01f50b0 con 0x7fb4e0161fa0 2024-09-11T22:21:47.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.909+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2214528223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e00b4d20 con 0x7fb4e0161fa0 2024-09-11T22:21:47.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.909+0000 7fb4d5ffb640 1 -- 172.21.15.50:0/2214528223 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4d8007790 con 0x7fb4e0161fa0 2024-09-11T22:21:47.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.909+0000 7fb4d5ffb640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb4c406be30 0x7fb4c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:47.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.910+0000 7fb4d5ffb640 1 -- 172.21.15.50:0/2214528223 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5029+0+0 (secure 0 0 0) 0x7fb4d80ac3c0 con 0x7fb4e0161fa0 2024-09-11T22:21:47.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.910+0000 7fb4e5465640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb4c406be30 0x7fb4c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:47.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.910+0000 7fb4e5465640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb4c406be30 0x7fb4c406e2f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc000f60 tx=0x7fb4dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:47.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:47.914+0000 7fb4d5ffb640 1 -- 172.21.15.50:0/2214528223 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4e01f4870 con 0x7fb4e0161fa0 2024-09-11T22:21:48.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.089+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2214528223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb4e00d0f00 con 0x7fb4e0161fa0 2024-09-11T22:21:48.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.089+0000 7fb4d5ffb640 1 -- 172.21.15.50:0/2214528223 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v160) ==== 93+0+10 (secure 0 0 0) 0x7fb4d804c350 con 0x7fb4e0161fa0 2024-09-11T22:21:48.090 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-11T22:21:48.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.091+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb4c406be30 msgr2=0x7fb4c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.091+0000 7fb4e76c9640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb4c406be30 0x7fb4c406e2f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc000f60 tx=0x7fb4dc009040 comp rx=0 tx=0).stop 2024-09-11T22:21:48.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.091+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2214528223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e0161fa0 msgr2=0x7fb4e00b7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.091+0000 7fb4e76c9640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e0161fa0 0x7fb4e00b7b50 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009eb0 tx=0x7fb4d8004a40 comp rx=0 tx=0).stop 2024-09-11T22:21:48.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.091+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2214528223 shutdown_connections 2024-09-11T22:21:48.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.091+0000 7fb4e76c9640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb4c406be30 0x7fb4c406e2f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.091+0000 7fb4e76c9640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4e00cf610 0x7fb4e01f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.091+0000 7fb4e76c9640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4e0161fa0 0x7fb4e00b7b50 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.091+0000 7fb4e76c9640 1 --2- 172.21.15.50:0/2214528223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e00b1600 0x7fb4e00b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.091+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2214528223 >> 172.21.15.50:0/2214528223 conn(0x7fb4e009ba50 msgr2=0x7fb4e00af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:48.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.092+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2214528223 shutdown_connections 2024-09-11T22:21:48.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.092+0000 7fb4e76c9640 1 -- 172.21.15.50:0/2214528223 wait complete. 2024-09-11T22:21:48.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-11T22:21:48.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.205+0000 7ff7329d8640 1 Processor -- start 2024-09-11T22:21:48.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.205+0000 7ff7329d8640 1 -- start start 2024-09-11T22:21:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.206+0000 7ff7329d8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72c0b5440 0x7ff72c0b5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.206+0000 7ff7329d8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff72c072cb0 0x7ff72c15fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.206+0000 7ff7329d8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72c06ebd0 con 0x7ff72c15ff50 2024-09-11T22:21:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.206+0000 7ff7329d8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff72c06f7a0 con 0x7ff72c072cb0 2024-09-11T22:21:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.206+0000 7ff7329d8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff72c0b5d60 con 0x7ff72c0b5440 2024-09-11T22:21:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.206+0000 7ff72b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff72c072cb0 0x7ff72c15fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.206+0000 7ff72b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff72c072cb0 0x7ff72c15fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59692/0 (socket says 172.21.15.50:59692) 2024-09-11T22:21:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.206+0000 7ff72b7fe640 1 -- 172.21.15.50:0/3207427492 learned_addr learned my addr 172.21.15.50:0/3207427492 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.206+0000 7ff72bfff640 1 --2- 172.21.15.50:0/3207427492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72c0b5440 0x7ff72c0b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.206+0000 7ff72b7fe640 1 -- 172.21.15.50:0/3207427492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72c0b5440 msgr2=0x7ff72c0b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.206+0000 7ff72b7fe640 1 --2- 172.21.15.50:0/3207427492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72c0b5440 0x7ff72c0b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.206+0000 7ff72b7fe640 1 -- 172.21.15.50:0/3207427492 >> v1:172.21.15.77:6789/0 conn(0x7ff72c15ff50 legacy=0x7ff72c162530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.206+0000 7ff72b7fe640 1 -- 172.21.15.50:0/3207427492 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72c06ee70 con 0x7ff72c072cb0 2024-09-11T22:21:48.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.207+0000 7ff72b7fe640 1 --2- 172.21.15.50:0/3207427492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72c072cb0 0x7ff72c15fa10 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7ff720009870 tx=0x7ff72002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a224b22e25cbbece server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:48.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.207+0000 7ff72affd640 1 -- 172.21.15.50:0/3207427492 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff720037070 con 0x7ff72c072cb0 2024-09-11T22:21:48.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.207+0000 7ff72affd640 1 -- 172.21.15.50:0/3207427492 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff720032440 con 0x7ff72c072cb0 2024-09-11T22:21:48.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.207+0000 7ff72affd640 1 -- 172.21.15.50:0/3207427492 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff720032810 con 0x7ff72c072cb0 2024-09-11T22:21:48.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.208+0000 7ff7329d8640 1 -- 172.21.15.50:0/3207427492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72c072cb0 msgr2=0x7ff72c15fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.208+0000 7ff7329d8640 1 --2- 172.21.15.50:0/3207427492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72c072cb0 0x7ff72c15fa10 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7ff720009870 tx=0x7ff72002a270 comp rx=0 tx=0).stop 2024-09-11T22:21:48.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.208+0000 7ff7329d8640 1 -- 172.21.15.50:0/3207427492 shutdown_connections 2024-09-11T22:21:48.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.208+0000 7ff7329d8640 1 --2- 172.21.15.50:0/3207427492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72c072cb0 0x7ff72c15fa10 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.208+0000 7ff7329d8640 1 --2- 172.21.15.50:0/3207427492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72c0b5440 0x7ff72c0b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.208+0000 7ff7329d8640 1 -- 172.21.15.50:0/3207427492 >> 172.21.15.50:0/3207427492 conn(0x7ff72c068240 msgr2=0x7ff72c0b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:48.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.208+0000 7ff7329d8640 1 -- 172.21.15.50:0/3207427492 shutdown_connections 2024-09-11T22:21:48.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.208+0000 7ff7329d8640 1 -- 172.21.15.50:0/3207427492 wait complete. 2024-09-11T22:21:48.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.209+0000 7ff7329d8640 1 Processor -- start 2024-09-11T22:21:48.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.209+0000 7ff7329d8640 1 -- start start 2024-09-11T22:21:48.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff7329d8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72c072cb0 0x7ff72c15f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff7329d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff72c0b5440 0x7ff72c140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff7329d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72c15ff50 0x7ff72c1409c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff7329d8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff72c1485f0 con 0x7ff72c15ff50 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff7329d8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff72c06f430 con 0x7ff72c0b5440 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff7329d8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff72c148770 con 0x7ff72c072cb0 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff730f75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72c15ff50 0x7ff72c1409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff72b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff72c0b5440 0x7ff72c140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff730f75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72c15ff50 0x7ff72c1409c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59706/0 (socket says 172.21.15.50:59706) 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff730f75640 1 -- 172.21.15.50:0/2573133838 learned_addr learned my addr 172.21.15.50:0/2573133838 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff72bfff640 1 --2- 172.21.15.50:0/2573133838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72c072cb0 0x7ff72c15f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff730f75640 1 -- 172.21.15.50:0/2573133838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72c072cb0 msgr2=0x7ff72c15f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff730f75640 1 --2- 172.21.15.50:0/2573133838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72c072cb0 0x7ff72c15f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff730f75640 1 -- 172.21.15.50:0/2573133838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff72c0b5440 msgr2=0x7ff72c140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff730f75640 1 --2- 172.21.15.50:0/2573133838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff72c0b5440 0x7ff72c140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff730f75640 1 -- 172.21.15.50:0/2573133838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72c15fa10 con 0x7ff72c15ff50 2024-09-11T22:21:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.210+0000 7ff730f75640 1 --2- 172.21.15.50:0/2573133838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72c15ff50 0x7ff72c1409c0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c6e0 tx=0x7ff72400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.211+0000 7ff728ff9640 1 -- 172.21.15.50:0/2573133838 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724003b70 con 0x7ff72c15ff50 2024-09-11T22:21:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.211+0000 7ff728ff9640 1 -- 172.21.15.50:0/2573133838 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff724003d30 con 0x7ff72c15ff50 2024-09-11T22:21:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.211+0000 7ff7329d8640 1 -- 172.21.15.50:0/2573133838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff72c0af640 con 0x7ff72c15ff50 2024-09-11T22:21:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.211+0000 7ff728ff9640 1 -- 172.21.15.50:0/2573133838 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724005310 con 0x7ff72c15ff50 2024-09-11T22:21:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.211+0000 7ff7329d8640 1 -- 172.21.15.50:0/2573133838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff72c0afc00 con 0x7ff72c15ff50 2024-09-11T22:21:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.212+0000 7ff7329d8640 1 -- 172.21.15.50:0/2573133838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff72c06fc30 con 0x7ff72c15ff50 2024-09-11T22:21:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.212+0000 7ff728ff9640 1 -- 172.21.15.50:0/2573133838 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7240054b0 con 0x7ff72c15ff50 2024-09-11T22:21:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.213+0000 7ff728ff9640 1 --2- 172.21.15.50:0/2573133838 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff71806be30 0x7ff71806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.213+0000 7ff728ff9640 1 -- 172.21.15.50:0/2573133838 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5029+0+0 (secure 0 0 0) 0x7ff72408a830 con 0x7ff72c15ff50 2024-09-11T22:21:48.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.213+0000 7ff72bfff640 1 --2- 172.21.15.50:0/2573133838 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff71806be30 0x7ff71806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.213+0000 7ff72bfff640 1 --2- 172.21.15.50:0/2573133838 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff71806be30 0x7ff71806e2f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff71c006fd0 tx=0x7ff71c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:48.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.217+0000 7ff728ff9640 1 -- 172.21.15.50:0/2573133838 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff72c15fa10 con 0x7ff72c15ff50 2024-09-11T22:21:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.459+0000 7ff7329d8640 1 -- 172.21.15.50:0/2573133838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7ff72c147a40 con 0x7ff72c15ff50 2024-09-11T22:21:48.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.478+0000 7ff728ff9640 1 -- 172.21.15.50:0/2573133838 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v511) ==== 162+0+0 (secure 0 0 0) 0x7ff724058ec0 con 0x7ff72c15ff50 2024-09-11T22:21:48.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.480+0000 7ff7329d8640 1 -- 172.21.15.50:0/2573133838 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff71806be30 msgr2=0x7ff71806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.480+0000 7ff7329d8640 1 --2- 172.21.15.50:0/2573133838 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff71806be30 0x7ff71806e2f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff71c006fd0 tx=0x7ff71c008040 comp rx=0 tx=0).stop 2024-09-11T22:21:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.480+0000 7ff7329d8640 1 -- 172.21.15.50:0/2573133838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72c15ff50 msgr2=0x7ff72c1409c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.480+0000 7ff7329d8640 1 --2- 172.21.15.50:0/2573133838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72c15ff50 0x7ff72c1409c0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c6e0 tx=0x7ff72400cba0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.480+0000 7ff7329d8640 1 -- 172.21.15.50:0/2573133838 shutdown_connections 2024-09-11T22:21:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.480+0000 7ff7329d8640 1 --2- 172.21.15.50:0/2573133838 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff71806be30 0x7ff71806e2f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.480+0000 7ff7329d8640 1 --2- 172.21.15.50:0/2573133838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff72c15ff50 0x7ff72c1409c0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.480+0000 7ff7329d8640 1 --2- 172.21.15.50:0/2573133838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff72c0b5440 0x7ff72c140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.480+0000 7ff7329d8640 1 --2- 172.21.15.50:0/2573133838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff72c072cb0 0x7ff72c15f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.480+0000 7ff7329d8640 1 -- 172.21.15.50:0/2573133838 >> 172.21.15.50:0/2573133838 conn(0x7ff72c068240 msgr2=0x7ff72c146630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.480+0000 7ff7329d8640 1 -- 172.21.15.50:0/2573133838 shutdown_connections 2024-09-11T22:21:48.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.480+0000 7ff7329d8640 1 -- 172.21.15.50:0/2573133838 wait complete. 2024-09-11T22:21:48.492 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T22:21:48.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.596+0000 7fbcbb731640 1 Processor -- start 2024-09-11T22:21:48.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.597+0000 7fbcbb731640 1 -- start start 2024-09-11T22:21:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.597+0000 7fbcbb731640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcb40b0f60 0x7fbcb40b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.597+0000 7fbcbb731640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbcb40b1340 0x7fbcb4162600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.597+0000 7fbcbb731640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbcb4162b40 0x7fbcb40d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.597+0000 7fbcbb731640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb40b17a0 con 0x7fbcb4162b40 2024-09-11T22:21:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.597+0000 7fbcbb731640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb406d550 con 0x7fbcb40b1340 2024-09-11T22:21:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.597+0000 7fbcbb731640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb4163410 con 0x7fbcb40b0f60 2024-09-11T22:21:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.598+0000 7fbcb9cce640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbcb4162b40 0x7fbcb40d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.598+0000 7fbcb9cce640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbcb4162b40 0x7fbcb40d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59708/0 (socket says 172.21.15.50:59708) 2024-09-11T22:21:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.598+0000 7fbcb9cce640 1 -- 172.21.15.50:0/2148487322 learned_addr learned my addr 172.21.15.50:0/2148487322 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.598+0000 7fbcb94cd640 1 --2- 172.21.15.50:0/2148487322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcb40b0f60 0x7fbcb40b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.598+0000 7fbcb8ccc640 1 --2- 172.21.15.50:0/2148487322 >> v2:172.21.15.77:3300/0 conn(0x7fbcb40b1340 0x7fbcb4162600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.598+0000 7fbcb9cce640 1 -- 172.21.15.50:0/2148487322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcb40b0f60 msgr2=0x7fbcb40b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.598+0000 7fbcb9cce640 1 --2- 172.21.15.50:0/2148487322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcb40b0f60 0x7fbcb40b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.598+0000 7fbcb9cce640 1 -- 172.21.15.50:0/2148487322 >> v2:172.21.15.77:3300/0 conn(0x7fbcb40b1340 msgr2=0x7fbcb4162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.598+0000 7fbcb9cce640 1 --2- 172.21.15.50:0/2148487322 >> v2:172.21.15.77:3300/0 conn(0x7fbcb40b1340 0x7fbcb4162600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.598+0000 7fbcb9cce640 1 -- 172.21.15.50:0/2148487322 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb406cc20 con 0x7fbcb4162b40 2024-09-11T22:21:48.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.599+0000 7fbcb9cce640 1 --2- 172.21.15.50:0/2148487322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcb4162b40 0x7fbcb40d0460 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4072a40 tx=0x7fbcac02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fa6ab2feffdcb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:48.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.599+0000 7fbcabfff640 1 -- 172.21.15.50:0/2148487322 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac036070 con 0x7fbcb4162b40 2024-09-11T22:21:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.599+0000 7fbcabfff640 1 -- 172.21.15.50:0/2148487322 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcac031600 con 0x7fbcb4162b40 2024-09-11T22:21:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.599+0000 7fbcabfff640 1 -- 172.21.15.50:0/2148487322 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac0319d0 con 0x7fbcb4162b40 2024-09-11T22:21:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.599+0000 7fbcbb731640 1 -- 172.21.15.50:0/2148487322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcb4162b40 msgr2=0x7fbcb40d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.599+0000 7fbcbb731640 1 --2- 172.21.15.50:0/2148487322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcb4162b40 0x7fbcb40d0460 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4072a40 tx=0x7fbcac02a6a0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.599+0000 7fbcbb731640 1 -- 172.21.15.50:0/2148487322 shutdown_connections 2024-09-11T22:21:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.599+0000 7fbcbb731640 1 --2- 172.21.15.50:0/2148487322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcb4162b40 0x7fbcb40d0460 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.599+0000 7fbcbb731640 1 --2- 172.21.15.50:0/2148487322 >> v2:172.21.15.77:3300/0 conn(0x7fbcb40b1340 0x7fbcb4162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.599+0000 7fbcbb731640 1 --2- 172.21.15.50:0/2148487322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcb40b0f60 0x7fbcb40b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.599+0000 7fbcbb731640 1 -- 172.21.15.50:0/2148487322 >> 172.21.15.50:0/2148487322 conn(0x7fbcb40b40b0 msgr2=0x7fbcb40b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.599+0000 7fbcbb731640 1 -- 172.21.15.50:0/2148487322 shutdown_connections 2024-09-11T22:21:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.599+0000 7fbcbb731640 1 -- 172.21.15.50:0/2148487322 wait complete. 2024-09-11T22:21:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.601+0000 7fbcbb731640 1 Processor -- start 2024-09-11T22:21:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.601+0000 7fbcbb731640 1 -- start start 2024-09-11T22:21:48.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.601+0000 7fbcbb731640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcb40b0f60 0x7fbcb40c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.601+0000 7fbcbb731640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcb40b1340 0x7fbcb41ea640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.601+0000 7fbcbb731640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcb4162b40 0x7fbcb41e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.601+0000 7fbcbb731640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb406d9e0 con 0x7fbcb4162b40 2024-09-11T22:21:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.601+0000 7fbcbb731640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb406d1e0 con 0x7fbcb40b1340 2024-09-11T22:21:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.601+0000 7fbcbb731640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb406db60 con 0x7fbcb40b0f60 2024-09-11T22:21:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.601+0000 7fbcb9cce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcb4162b40 0x7fbcb41e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbcb9cce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcb4162b40 0x7fbcb41e8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59710/0 (socket says 172.21.15.50:59710) 2024-09-11T22:21:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbcb9cce640 1 -- 172.21.15.50:0/4090823497 learned_addr learned my addr 172.21.15.50:0/4090823497 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbcb94cd640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcb40b0f60 0x7fbcb40c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbcb8ccc640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcb40b1340 0x7fbcb41ea640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbcb9cce640 1 -- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcb40b0f60 msgr2=0x7fbcb40c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbcb9cce640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcb40b0f60 0x7fbcb40c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbcb9cce640 1 -- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcb40b1340 msgr2=0x7fbcb41ea640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbcb9cce640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcb40b1340 0x7fbcb41ea640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbcb9cce640 1 -- 172.21.15.50:0/4090823497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb41ead00 con 0x7fbcb4162b40 2024-09-11T22:21:48.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbcb9cce640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcb4162b40 0x7fbcb41e8610 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009f40 tx=0x7fbcac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:48.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbca9ffb640 1 -- 172.21.15.50:0/4090823497 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac041070 con 0x7fbcb4162b40 2024-09-11T22:21:48.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbca9ffb640 1 -- 172.21.15.50:0/4090823497 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcac03c650 con 0x7fbcb4162b40 2024-09-11T22:21:48.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbcbb731640 1 -- 172.21.15.50:0/4090823497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb41eafe0 con 0x7fbcb4162b40 2024-09-11T22:21:48.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbca9ffb640 1 -- 172.21.15.50:0/4090823497 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac036040 con 0x7fbcb4162b40 2024-09-11T22:21:48.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.602+0000 7fbcbb731640 1 -- 172.21.15.50:0/4090823497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb40b5cd0 con 0x7fbcb4162b40 2024-09-11T22:21:48.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.603+0000 7fbcbb731640 1 -- 172.21.15.50:0/4090823497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb40c9270 con 0x7fbcb4162b40 2024-09-11T22:21:48.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.604+0000 7fbca9ffb640 1 -- 172.21.15.50:0/4090823497 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcac044070 con 0x7fbcb4162b40 2024-09-11T22:21:48.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.604+0000 7fbca9ffb640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc9806be30 0x7fbc9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.604+0000 7fbca9ffb640 1 -- 172.21.15.50:0/4090823497 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5029+0+0 (secure 0 0 0) 0x7fbcac0ab620 con 0x7fbcb4162b40 2024-09-11T22:21:48.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.605+0000 7fbcb94cd640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc9806be30 0x7fbc9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.605+0000 7fbcb94cd640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc9806be30 0x7fbc9806e2f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0003610 tx=0x7fbcb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:48.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.609+0000 7fbca9ffb640 1 -- 172.21.15.50:0/4090823497 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbcac079c10 con 0x7fbcb4162b40 2024-09-11T22:21:48.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.784+0000 7fbcbb731640 1 -- 172.21.15.50:0/4090823497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbcb40cfef0 con 0x7fbcb4162b40 2024-09-11T22:21:48.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.787+0000 7fbca9ffb640 1 -- 172.21.15.50:0/4090823497 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v44)=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7fbcac07df10 con 0x7fbcb4162b40 2024-09-11T22:21:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.790+0000 7fbcbb731640 1 -- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc9806be30 msgr2=0x7fbc9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.790+0000 7fbcbb731640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc9806be30 0x7fbc9806e2f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0003610 tx=0x7fbcb0008040 comp rx=0 tx=0).stop 2024-09-11T22:21:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.790+0000 7fbcbb731640 1 -- 172.21.15.50:0/4090823497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcb4162b40 msgr2=0x7fbcb41e8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.790+0000 7fbcbb731640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcb4162b40 0x7fbcb41e8610 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009f40 tx=0x7fbcac004a40 comp rx=0 tx=0).stop 2024-09-11T22:21:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.790+0000 7fbcbb731640 1 -- 172.21.15.50:0/4090823497 shutdown_connections 2024-09-11T22:21:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.790+0000 7fbcbb731640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbc9806be30 0x7fbc9806e2f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.790+0000 7fbcbb731640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcb4162b40 0x7fbcb41e8610 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.790+0000 7fbcbb731640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcb40b1340 0x7fbcb41ea640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.790+0000 7fbcbb731640 1 --2- 172.21.15.50:0/4090823497 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcb40b0f60 0x7fbcb40c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.790+0000 7fbcbb731640 1 -- 172.21.15.50:0/4090823497 >> 172.21.15.50:0/4090823497 conn(0x7fbcb40b40b0 msgr2=0x7fbcb41614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:48.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.790+0000 7fbcbb731640 1 -- 172.21.15.50:0/4090823497 shutdown_connections 2024-09-11T22:21:48.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:48.790+0000 7fbcbb731640 1 -- 172.21.15.50:0/4090823497 wait complete. 2024-09-11T22:21:48.802 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:21:48.802 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:21:48.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:21:48.888 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:21:48.888 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:21:48.888 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:21:48.904 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:21:48.905 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:21:48.905 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:21:48.923 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:21:48.923 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:21:48.923 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:21:48.961 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:21:48.961 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:21:48.962 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:21:48.980 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:21:48.981 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T22:21:48.981 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:49.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.102+0000 7fb5fca9b640 1 Processor -- start 2024-09-11T22:21:49.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.102+0000 7fb5fca9b640 1 -- start start 2024-09-11T22:21:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.103+0000 7fb5fca9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5f815e870 0x7fb5f80d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.103+0000 7fb5fca9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb5f80d16d0 0x7fb5f80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.103+0000 7fb5fca9b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f80cfa80 con 0x7fb5f80d3a30 2024-09-11T22:21:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.103+0000 7fb5fca9b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f80d1b40 con 0x7fb5f815e870 2024-09-11T22:21:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.103+0000 7fb5fca9b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f80d3e50 con 0x7fb5f80d16d0 2024-09-11T22:21:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.104+0000 7fb5f659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5f815e870 0x7fb5f80d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.104+0000 7fb5f6d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb5f80d3a30 0x7fb5f80b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54796/0 (socket says 172.21.15.50:54796) 2024-09-11T22:21:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.104+0000 7fb5f6d9d640 1 -- 172.21.15.50:0/4192203422 learned_addr learned my addr 172.21.15.50:0/4192203422 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.104+0000 7fb5f5d9b640 1 --2- 172.21.15.50:0/4192203422 >> v2:172.21.15.77:3300/0 conn(0x7fb5f80d16d0 0x7fb5f80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.104+0000 7fb5f659c640 1 -- 172.21.15.50:0/4192203422 >> v2:172.21.15.77:3300/0 conn(0x7fb5f80d16d0 msgr2=0x7fb5f80d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:49.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.104+0000 7fb5f659c640 1 --2- 172.21.15.50:0/4192203422 >> v2:172.21.15.77:3300/0 conn(0x7fb5f80d16d0 0x7fb5f80d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.104+0000 7fb5f659c640 1 -- 172.21.15.50:0/4192203422 >> v1:172.21.15.50:6789/0 conn(0x7fb5f80d3a30 legacy=0x7fb5f80b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.104+0000 7fb5f659c640 1 -- 172.21.15.50:0/4192203422 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f80d40d0 con 0x7fb5f815e870 2024-09-11T22:21:49.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.104+0000 7fb5f5d9b640 1 --2- 172.21.15.50:0/4192203422 >> v2:172.21.15.77:3300/0 conn(0x7fb5f80d16d0 0x7fb5f80d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:49.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.104+0000 7fb5f559a640 1 -- 172.21.15.50:0/4192203422 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4262255219 0 0) 0x7fb5f0001110 con 0x7fb5f80d3a30 2024-09-11T22:21:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.105+0000 7fb5f659c640 1 --2- 172.21.15.50:0/4192203422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5f815e870 0x7fb5f80d1190 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fb5f806c830 tx=0x7fb5e802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206ad9820c310a21 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.105+0000 7fb5f559a640 1 -- 172.21.15.50:0/4192203422 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8007740 con 0x7fb5f815e870 2024-09-11T22:21:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.105+0000 7fb5f559a640 1 -- 172.21.15.50:0/4192203422 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e80078e0 con 0x7fb5f815e870 2024-09-11T22:21:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.105+0000 7fb5f559a640 1 -- 172.21.15.50:0/4192203422 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8007cb0 con 0x7fb5f815e870 2024-09-11T22:21:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.105+0000 7fb5fca9b640 1 -- 172.21.15.50:0/4192203422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5f815e870 msgr2=0x7fb5f80d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.105+0000 7fb5fca9b640 1 --2- 172.21.15.50:0/4192203422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5f815e870 0x7fb5f80d1190 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fb5f806c830 tx=0x7fb5e802a680 comp rx=0 tx=0).stop 2024-09-11T22:21:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.105+0000 7fb5fca9b640 1 -- 172.21.15.50:0/4192203422 shutdown_connections 2024-09-11T22:21:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.105+0000 7fb5fca9b640 1 --2- 172.21.15.50:0/4192203422 >> v2:172.21.15.77:3300/0 conn(0x7fb5f80d16d0 0x7fb5f80d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.105+0000 7fb5fca9b640 1 --2- 172.21.15.50:0/4192203422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5f815e870 0x7fb5f80d1190 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.105+0000 7fb5fca9b640 1 -- 172.21.15.50:0/4192203422 >> 172.21.15.50:0/4192203422 conn(0x7fb5f80727a0 msgr2=0x7fb5f80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.105+0000 7fb5fca9b640 1 -- 172.21.15.50:0/4192203422 shutdown_connections 2024-09-11T22:21:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.105+0000 7fb5fca9b640 1 -- 172.21.15.50:0/4192203422 wait complete. 2024-09-11T22:21:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.107+0000 7fb5fca9b640 1 Processor -- start 2024-09-11T22:21:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.107+0000 7fb5fca9b640 1 -- start start 2024-09-11T22:21:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.107+0000 7fb5fca9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5f80d16d0 0x7fb5f80b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.107+0000 7fb5fca9b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5f80d3a30 0x7fb5f80b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.107+0000 7fb5fca9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5f815e870 0x7fb5f81f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.107+0000 7fb5fca9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f80b7ee0 con 0x7fb5f80d16d0 2024-09-11T22:21:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.107+0000 7fb5fca9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f80b7c00 con 0x7fb5f815e870 2024-09-11T22:21:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.107+0000 7fb5fca9b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f815ec50 con 0x7fb5f80d3a30 2024-09-11T22:21:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5f659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5f80d16d0 0x7fb5f80b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5f659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5f80d16d0 0x7fb5f80b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59736/0 (socket says 172.21.15.50:59736) 2024-09-11T22:21:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5f659c640 1 -- 172.21.15.50:0/2358352794 learned_addr learned my addr 172.21.15.50:0/2358352794 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5f6d9d640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5f815e870 0x7fb5f81f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5f5d9b640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5f80d3a30 0x7fb5f80b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5f659c640 1 -- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5f80d3a30 msgr2=0x7fb5f80b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5f659c640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5f80d3a30 0x7fb5f80b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5f659c640 1 -- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5f815e870 msgr2=0x7fb5f81f8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5f659c640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5f815e870 0x7fb5f81f8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5f659c640 1 -- 172.21.15.50:0/2358352794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f80ab570 con 0x7fb5f80d16d0 2024-09-11T22:21:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5f5d9b640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5f80d3a30 0x7fb5f80b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5f659c640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5f80d16d0 0x7fb5f80b3040 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8000f80 tx=0x7fb5e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5eeffd640 1 -- 172.21.15.50:0/2358352794 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e803f070 con 0x7fb5f80d16d0 2024-09-11T22:21:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5eeffd640 1 -- 172.21.15.50:0/2358352794 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e8031c40 con 0x7fb5f80d16d0 2024-09-11T22:21:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5fca9b640 1 -- 172.21.15.50:0/2358352794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f815b3b0 con 0x7fb5f80d16d0 2024-09-11T22:21:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5eeffd640 1 -- 172.21.15.50:0/2358352794 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8009450 con 0x7fb5f80d16d0 2024-09-11T22:21:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.108+0000 7fb5fca9b640 1 -- 172.21.15.50:0/2358352794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f815b970 con 0x7fb5f80d16d0 2024-09-11T22:21:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.109+0000 7fb5fca9b640 1 -- 172.21.15.50:0/2358352794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f80b78b0 con 0x7fb5f80d16d0 2024-09-11T22:21:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.110+0000 7fb5eeffd640 1 -- 172.21.15.50:0/2358352794 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5e8003990 con 0x7fb5f80d16d0 2024-09-11T22:21:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.110+0000 7fb5eeffd640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5d806be30 0x7fb5d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.110+0000 7fb5eeffd640 1 -- 172.21.15.50:0/2358352794 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5029+0+0 (secure 0 0 0) 0x7fb5e80abdd0 con 0x7fb5f80d16d0 2024-09-11T22:21:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.111+0000 7fb5f5d9b640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5d806be30 0x7fb5d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.111+0000 7fb5f5d9b640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5d806be30 0x7fb5d806e2f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0006fd0 tx=0x7fb5e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.115+0000 7fb5eeffd640 1 -- 172.21.15.50:0/2358352794 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5e807aa20 con 0x7fb5f80d16d0 2024-09-11T22:21:49.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.325+0000 7fb5fca9b640 1 -- 172.21.15.50:0/2358352794 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5f80b7060 con 0x7fb5f80d16d0 2024-09-11T22:21:49.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.325+0000 7fb5eeffd640 1 -- 172.21.15.50:0/2358352794 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+3090 (secure 0 0 0) 0x7fb5e807a320 con 0x7fb5f80d16d0 2024-09-11T22:21:49.326 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:49.326 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":115,"btime":"2024-09-11T22:21:44:461336+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3242736179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3242736179},{"type":"v1","addr":"172.21.15.77:6835","nonce":3242736179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8512,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2651520424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2651520424},{"type":"v1","addr":"172.21.15.77:6837","nonce":2651520424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":9813,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1501756605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1501756605},{"type":"v1","addr":"172.21.15.50:6833","nonce":1501756605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[]} 2024-09-11T22:21:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 115 2024-09-11T22:21:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.328+0000 7fb5fca9b640 1 -- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5d806be30 msgr2=0x7fb5d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.328+0000 7fb5fca9b640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5d806be30 0x7fb5d806e2f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0006fd0 tx=0x7fb5e0008040 comp rx=0 tx=0).stop 2024-09-11T22:21:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.328+0000 7fb5fca9b640 1 -- 172.21.15.50:0/2358352794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5f80d16d0 msgr2=0x7fb5f80b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.328+0000 7fb5fca9b640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5f80d16d0 0x7fb5f80b3040 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8000f80 tx=0x7fb5e8004a40 comp rx=0 tx=0).stop 2024-09-11T22:21:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.328+0000 7fb5fca9b640 1 -- 172.21.15.50:0/2358352794 shutdown_connections 2024-09-11T22:21:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.328+0000 7fb5fca9b640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb5d806be30 0x7fb5d806e2f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.328+0000 7fb5fca9b640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5f80d3a30 0x7fb5f80b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.328+0000 7fb5fca9b640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5f815e870 0x7fb5f81f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.328+0000 7fb5fca9b640 1 --2- 172.21.15.50:0/2358352794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5f80d16d0 0x7fb5f80b3040 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.328+0000 7fb5fca9b640 1 -- 172.21.15.50:0/2358352794 >> 172.21.15.50:0/2358352794 conn(0x7fb5f80727a0 msgr2=0x7fb5f80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.328+0000 7fb5fca9b640 1 -- 172.21.15.50:0/2358352794 shutdown_connections 2024-09-11T22:21:49.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.328+0000 7fb5fca9b640 1 -- 172.21.15.50:0/2358352794 wait complete. 2024-09-11T22:21:49.340 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:21:49.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:21:49.341 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:21:49.341 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T22:21:49.341 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:21:49.341 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:21:49.341 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:21:49.341 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T22:21:49.342 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:21:49.342 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:21:49.342 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:21:49.342 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T22:21:49.342 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:21:49.342 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:21:49.350 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:21:49.350 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:21:49.350 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:21:49.351 DEBUG:teuthology.parallel:result is None 2024-09-11T22:21:49.354 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:21:49.354 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:21:49.355 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:21:49.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:21:49.394 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:21:49.394 DEBUG:teuthology.parallel:result is None 2024-09-11T22:21:49.397 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:21:49.397 DEBUG:teuthology.parallel:result is None 2024-09-11T22:21:49.397 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:21:49.397 DEBUG:teuthology.parallel:result is None 2024-09-11T22:21:49.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T22:21:49.427 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:21:49.475 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:21:49.484 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:21:49.484 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:21:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.506+0000 7f47f599f640 1 Processor -- start 2024-09-11T22:21:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.506+0000 7f47f599f640 1 -- start start 2024-09-11T22:21:49.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.507+0000 7f47f599f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47f015e870 0x7f47f00d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.507+0000 7f47f599f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47f00d16d0 0x7f47f00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.507+0000 7f47f599f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f00cfa80 con 0x7f47f00d3a30 2024-09-11T22:21:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.507+0000 7f47f599f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f47f00d1b10 con 0x7f47f015e870 2024-09-11T22:21:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.507+0000 7f47f599f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f47f00d3e80 con 0x7f47f00d16d0 2024-09-11T22:21:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.507+0000 7f47e7fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47f00d16d0 0x7f47f00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.507+0000 7f47eeffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47f015e870 0x7f47f00d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.507+0000 7f47ef7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f47f00d3a30 0x7f47f00b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:56320/0 (socket says 172.21.15.50:56320) 2024-09-11T22:21:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.507+0000 7f47ef7fe640 1 -- 172.21.15.50:0/525497944 learned_addr learned my addr 172.21.15.50:0/525497944 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.508+0000 7f47e7fff640 1 -- 172.21.15.50:0/525497944 >> v2:172.21.15.77:3300/0 conn(0x7f47f015e870 msgr2=0x7f47f00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.508+0000 7f47e7fff640 1 --2- 172.21.15.50:0/525497944 >> v2:172.21.15.77:3300/0 conn(0x7f47f015e870 0x7f47f00d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.508+0000 7f47e7fff640 1 -- 172.21.15.50:0/525497944 >> v1:172.21.15.77:6789/0 conn(0x7f47f00d3a30 legacy=0x7f47f00b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.508+0000 7f47ee7fc640 1 -- 172.21.15.50:0/525497944 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502348436 0 0) 0x7f47e8001490 con 0x7f47f00d3a30 2024-09-11T22:21:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.508+0000 7f47e7fff640 1 -- 172.21.15.50:0/525497944 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f00d40d0 con 0x7f47f00d16d0 2024-09-11T22:21:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.508+0000 7f47eeffd640 1 --2- 172.21.15.50:0/525497944 >> v2:172.21.15.77:3300/0 conn(0x7f47f015e870 0x7f47f00d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:49.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.509+0000 7f47e7fff640 1 --2- 172.21.15.50:0/525497944 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47f00d16d0 0x7f47f00d34f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47d80097a0 tx=0x7f47d802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80c5e7a37ebfef65 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.509+0000 7f47ee7fc640 1 -- 172.21.15.50:0/525497944 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8037070 con 0x7f47f00d16d0 2024-09-11T22:21:49.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.509+0000 7f47ee7fc640 1 -- 172.21.15.50:0/525497944 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d8032440 con 0x7f47f00d16d0 2024-09-11T22:21:49.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.509+0000 7f47ee7fc640 1 -- 172.21.15.50:0/525497944 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8032810 con 0x7f47f00d16d0 2024-09-11T22:21:49.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.509+0000 7f47f599f640 1 -- 172.21.15.50:0/525497944 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47f00d16d0 msgr2=0x7f47f00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.509+0000 7f47f599f640 1 --2- 172.21.15.50:0/525497944 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47f00d16d0 0x7f47f00d34f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47d80097a0 tx=0x7f47d802a180 comp rx=0 tx=0).stop 2024-09-11T22:21:49.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.509+0000 7f47f599f640 1 -- 172.21.15.50:0/525497944 shutdown_connections 2024-09-11T22:21:49.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.509+0000 7f47f599f640 1 --2- 172.21.15.50:0/525497944 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47f00d16d0 0x7f47f00d34f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.509+0000 7f47f599f640 1 --2- 172.21.15.50:0/525497944 >> v2:172.21.15.77:3300/0 conn(0x7f47f015e870 0x7f47f00d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.509+0000 7f47f599f640 1 -- 172.21.15.50:0/525497944 >> 172.21.15.50:0/525497944 conn(0x7f47f00727a0 msgr2=0x7f47f00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:49.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.510+0000 7f47f599f640 1 -- 172.21.15.50:0/525497944 shutdown_connections 2024-09-11T22:21:49.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.510+0000 7f47f599f640 1 -- 172.21.15.50:0/525497944 wait complete. 2024-09-11T22:21:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.511+0000 7f47f599f640 1 Processor -- start 2024-09-11T22:21:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.511+0000 7f47f599f640 1 -- start start 2024-09-11T22:21:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.511+0000 7f47f599f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f00d16d0 0x7f47f00ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.511+0000 7f47f599f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47f00d3a30 0x7f47f00cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.511+0000 7f47f599f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47f015e870 0x7f47f01557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.511+0000 7f47f599f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f47f00b7ee0 con 0x7f47f015e870 2024-09-11T22:21:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.511+0000 7f47f599f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f47f00b7c00 con 0x7f47f00d16d0 2024-09-11T22:21:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.511+0000 7f47f599f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f47f015ec50 con 0x7f47f00d3a30 2024-09-11T22:21:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47ef7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47f015e870 0x7f47f01557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47ef7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47f015e870 0x7f47f01557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59800/0 (socket says 172.21.15.50:59800) 2024-09-11T22:21:49.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47ef7fe640 1 -- 172.21.15.50:0/3356479220 learned_addr learned my addr 172.21.15.50:0/3356479220 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47e7fff640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47f00d3a30 0x7f47f00cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47eeffd640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f00d16d0 0x7f47f00ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47ef7fe640 1 -- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47f00d3a30 msgr2=0x7f47f00cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47ef7fe640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47f00d3a30 0x7f47f00cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47ef7fe640 1 -- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f00d16d0 msgr2=0x7f47f00ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47ef7fe640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f00d16d0 0x7f47f00ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47ef7fe640 1 -- 172.21.15.50:0/3356479220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f00caca0 con 0x7f47f015e870 2024-09-11T22:21:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47ef7fe640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47f015e870 0x7f47f01557e0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f47e800c820 tx=0x7f47e800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47ecff9640 1 -- 172.21.15.50:0/3356479220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8018070 con 0x7f47f015e870 2024-09-11T22:21:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47ecff9640 1 -- 172.21.15.50:0/3356479220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e800a5e0 con 0x7f47f015e870 2024-09-11T22:21:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47f599f640 1 -- 172.21.15.50:0/3356479220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f00cb1f0 con 0x7f47f015e870 2024-09-11T22:21:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47ecff9640 1 -- 172.21.15.50:0/3356479220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e800a9d0 con 0x7f47f015e870 2024-09-11T22:21:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.512+0000 7f47f599f640 1 -- 172.21.15.50:0/3356479220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f00caf10 con 0x7f47f015e870 2024-09-11T22:21:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.513+0000 7f47f599f640 1 -- 172.21.15.50:0/3356479220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f00b78b0 con 0x7f47f015e870 2024-09-11T22:21:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.514+0000 7f47ecff9640 1 -- 172.21.15.50:0/3356479220 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47e801b070 con 0x7f47f015e870 2024-09-11T22:21:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.515+0000 7f47ecff9640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f47d006be30 0x7f47d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.515+0000 7f47ecff9640 1 -- 172.21.15.50:0/3356479220 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 5029+0+0 (secure 0 0 0) 0x7f47e808a0a0 con 0x7f47f015e870 2024-09-11T22:21:49.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.515+0000 7f47eeffd640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f47d006be30 0x7f47d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.515+0000 7f47eeffd640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f47d006be30 0x7f47d006e2f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009560 tx=0x7f47e0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.519+0000 7f47ecff9640 1 -- 172.21.15.50:0/3356479220 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47f00cfa80 con 0x7f47f015e870 2024-09-11T22:21:49.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:49.706+0000 7f47f599f640 1 -- 172.21.15.50:0/3356479220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f47f0067c10 con 0x7f47f015e870 2024-09-11T22:21:50.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.485+0000 7f47ecff9640 1 -- 172.21.15.50:0/3356479220 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v163) ==== 97+0+0 (secure 0 0 0) 0x7f47e80586a0 con 0x7f47f015e870 2024-09-11T22:21:50.486 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-11T22:21:50.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.489+0000 7f47f599f640 1 -- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f47d006be30 msgr2=0x7f47d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.489+0000 7f47f599f640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f47d006be30 0x7f47d006e2f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009560 tx=0x7f47e0009190 comp rx=0 tx=0).stop 2024-09-11T22:21:50.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.489+0000 7f47f599f640 1 -- 172.21.15.50:0/3356479220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47f015e870 msgr2=0x7f47f01557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.489+0000 7f47f599f640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47f015e870 0x7f47f01557e0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f47e800c820 tx=0x7f47e800cce0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.489+0000 7f47f599f640 1 -- 172.21.15.50:0/3356479220 shutdown_connections 2024-09-11T22:21:50.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.489+0000 7f47f599f640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f47d006be30 0x7f47d006e2f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.489+0000 7f47f599f640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47f00d3a30 0x7f47f00cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.489+0000 7f47f599f640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47f015e870 0x7f47f01557e0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.489+0000 7f47f599f640 1 --2- 172.21.15.50:0/3356479220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f00d16d0 0x7f47f00ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.489+0000 7f47f599f640 1 -- 172.21.15.50:0/3356479220 >> 172.21.15.50:0/3356479220 conn(0x7f47f00727a0 msgr2=0x7f47f015d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:50.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.489+0000 7f47f599f640 1 -- 172.21.15.50:0/3356479220 shutdown_connections 2024-09-11T22:21:50.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.489+0000 7f47f599f640 1 -- 172.21.15.50:0/3356479220 wait complete. 2024-09-11T22:21:50.504 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T22:21:50.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.656+0000 7f6cbb533640 1 Processor -- start 2024-09-11T22:21:50.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.656+0000 7f6cbb533640 1 -- start start 2024-09-11T22:21:50.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cbb533640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cb415e840 0x7f6cb40b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cbb533640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cb40cf580 0x7f6cb406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cbb533640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cb40ce5f0 con 0x7f6cb40cdd50 2024-09-11T22:21:50.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cbb533640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6cb406c240 con 0x7f6cb40cf580 2024-09-11T22:21:50.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cbb533640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6cb40d0470 con 0x7f6cb415e840 2024-09-11T22:21:50.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cb9ad0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6cb40cf580 0x7f6cb406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cb8ace640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6cb40cdd50 0x7f6cb40cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54818/0 (socket says 172.21.15.50:54818) 2024-09-11T22:21:50.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cb8ace640 1 -- 172.21.15.50:0/728589244 learned_addr learned my addr 172.21.15.50:0/728589244 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:50.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cb92cf640 1 --2- 172.21.15.50:0/728589244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cb415e840 0x7f6cb40b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cb9ad0640 1 -- 172.21.15.50:0/728589244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cb415e840 msgr2=0x7f6cb40b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:50.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cb9ad0640 1 --2- 172.21.15.50:0/728589244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cb415e840 0x7f6cb40b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cb9ad0640 1 -- 172.21.15.50:0/728589244 >> v1:172.21.15.50:6789/0 conn(0x7f6cb40cdd50 legacy=0x7f6cb40cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cabfff640 1 -- 172.21.15.50:0/728589244 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4250037160 0 0) 0x7f6cb40ce5f0 con 0x7f6cb40cdd50 2024-09-11T22:21:50.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.657+0000 7f6cb9ad0640 1 -- 172.21.15.50:0/728589244 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb40ce310 con 0x7f6cb40cf580 2024-09-11T22:21:50.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.658+0000 7f6cb92cf640 1 --2- 172.21.15.50:0/728589244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cb415e840 0x7f6cb40b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:50.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.658+0000 7f6cb9ad0640 1 --2- 172.21.15.50:0/728589244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cb40cf580 0x7f6cb406c6d0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009d90 tx=0x7f6cac02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372aee38ea50c35d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:50.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.658+0000 7f6cabfff640 1 -- 172.21.15.50:0/728589244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac007740 con 0x7f6cb40cf580 2024-09-11T22:21:50.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.658+0000 7f6cabfff640 1 -- 172.21.15.50:0/728589244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cac0078e0 con 0x7f6cb40cf580 2024-09-11T22:21:50.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.658+0000 7f6cabfff640 1 -- 172.21.15.50:0/728589244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac007cb0 con 0x7f6cb40cf580 2024-09-11T22:21:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.659+0000 7f6cbb533640 1 -- 172.21.15.50:0/728589244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cb40cf580 msgr2=0x7f6cb406c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.659+0000 7f6cbb533640 1 --2- 172.21.15.50:0/728589244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cb40cf580 0x7f6cb406c6d0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009d90 tx=0x7f6cac02a660 comp rx=0 tx=0).stop 2024-09-11T22:21:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.659+0000 7f6cbb533640 1 -- 172.21.15.50:0/728589244 shutdown_connections 2024-09-11T22:21:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.659+0000 7f6cbb533640 1 --2- 172.21.15.50:0/728589244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cb40cf580 0x7f6cb406c6d0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.659+0000 7f6cbb533640 1 --2- 172.21.15.50:0/728589244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cb415e840 0x7f6cb40b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.659+0000 7f6cbb533640 1 -- 172.21.15.50:0/728589244 >> 172.21.15.50:0/728589244 conn(0x7f6cb40b4150 msgr2=0x7f6cb40b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.659+0000 7f6cbb533640 1 -- 172.21.15.50:0/728589244 shutdown_connections 2024-09-11T22:21:50.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.659+0000 7f6cbb533640 1 -- 172.21.15.50:0/728589244 wait complete. 2024-09-11T22:21:50.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.660+0000 7f6cbb533640 1 Processor -- start 2024-09-11T22:21:50.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.660+0000 7f6cbb533640 1 -- start start 2024-09-11T22:21:50.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.661+0000 7f6cbb533640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cb40cdd50 0x7f6cb41f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.661+0000 7f6cbb533640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cb40cf580 0x7f6cb406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.661+0000 7f6cbb533640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cb415e840 0x7f6cb40b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.661+0000 7f6cbb533640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb415ec20 con 0x7f6cb40cdd50 2024-09-11T22:21:50.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.661+0000 7f6cbb533640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb406bed0 con 0x7f6cb40cf580 2024-09-11T22:21:50.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.661+0000 7f6cbb533640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6cb415eda0 con 0x7f6cb415e840 2024-09-11T22:21:50.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.661+0000 7f6cb92cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cb40cdd50 0x7f6cb41f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.661+0000 7f6cb92cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cb40cdd50 0x7f6cb41f5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59826/0 (socket says 172.21.15.50:59826) 2024-09-11T22:21:50.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.661+0000 7f6cb92cf640 1 -- 172.21.15.50:0/367688772 learned_addr learned my addr 172.21.15.50:0/367688772 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:50.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.661+0000 7f6cb8ace640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cb40cf580 0x7f6cb406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.661+0000 7f6cb9ad0640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cb415e840 0x7f6cb40b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.662+0000 7f6cb92cf640 1 -- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cb415e840 msgr2=0x7f6cb40b7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.662+0000 7f6cb92cf640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cb415e840 0x7f6cb40b7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.662+0000 7f6cb92cf640 1 -- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cb40cf580 msgr2=0x7f6cb406c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.662+0000 7f6cb92cf640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cb40cf580 0x7f6cb406c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.662+0000 7f6cb92cf640 1 -- 172.21.15.50:0/367688772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb41f47b0 con 0x7f6cb40cdd50 2024-09-11T22:21:50.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.662+0000 7f6cb92cf640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cb40cdd50 0x7f6cb41f5470 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c7f0 tx=0x7f6cb000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:50.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.662+0000 7f6ca9ffb640 1 -- 172.21.15.50:0/367688772 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0015070 con 0x7f6cb40cdd50 2024-09-11T22:21:50.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.662+0000 7f6ca9ffb640 1 -- 172.21.15.50:0/367688772 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb0007a30 con 0x7f6cb40cdd50 2024-09-11T22:21:50.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.662+0000 7f6cbb533640 1 -- 172.21.15.50:0/367688772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb41f4a90 con 0x7f6cb40cdd50 2024-09-11T22:21:50.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.662+0000 7f6ca9ffb640 1 -- 172.21.15.50:0/367688772 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0007e00 con 0x7f6cb40cdd50 2024-09-11T22:21:50.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.662+0000 7f6cbb533640 1 -- 172.21.15.50:0/367688772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb41f5050 con 0x7f6cb40cdd50 2024-09-11T22:21:50.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.663+0000 7f6cbb533640 1 -- 172.21.15.50:0/367688772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb40b0fa0 con 0x7f6cb40cdd50 2024-09-11T22:21:50.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.663+0000 7f6ca9ffb640 1 -- 172.21.15.50:0/367688772 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6cb0018070 con 0x7f6cb40cdd50 2024-09-11T22:21:50.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.664+0000 7f6ca9ffb640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c9806be30 0x7f6c9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.664+0000 7f6ca9ffb640 1 -- 172.21.15.50:0/367688772 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 4857+0+0 (secure 0 0 0) 0x7f6cb008aa70 con 0x7f6cb40cdd50 2024-09-11T22:21:50.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.664+0000 7f6cb8ace640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c9806be30 0x7f6c9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.665+0000 7f6cb8ace640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c9806be30 0x7f6c9806e2f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6cb415d7b0 tx=0x7f6ca4007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:50.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.668+0000 7f6ca9ffb640 1 -- 172.21.15.50:0/367688772 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6cb40b0fa0 con 0x7f6cb40cdd50 2024-09-11T22:21:50.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.910+0000 7f6cbb533640 1 -- 172.21.15.50:0/367688772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6cb406f880 con 0x7f6cb40cdd50 2024-09-11T22:21:50.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.911+0000 7f6ca9ffb640 1 -- 172.21.15.50:0/367688772 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7f6cb0059800 con 0x7f6cb40cdd50 2024-09-11T22:21:50.911 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:50.911 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:21:50.912 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-11T22:21:50.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.912 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-11T22:21:50.912 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w==", 2024-09-11T22:21:50.912 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.912 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:21:50.912 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:21:50.912 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:21:50.912 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.912 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.913 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-11T22:21:50.913 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg==", 2024-09-11T22:21:50.913 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.913 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:21:50.913 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:21:50.913 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:21:50.913 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.913 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.913 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ==", 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw==", 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:21:50.914 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg==", 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-11T22:21:50.915 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ==", 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg==", 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.916 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg==", 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A==", 2024-09-11T22:21:50.917 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:21:50.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:21:50.918 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.918 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-11T22:21:50.918 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw==", 2024-09-11T22:21:50.918 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:21:50.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:21:50.918 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A==", 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw==", 2024-09-11T22:21:50.919 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.920 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:21:50.920 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:21:50.920 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.920 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.920 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-11T22:21:50.920 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew==", 2024-09-11T22:21:50.920 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.920 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:21:50.920 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-11T22:21:50.920 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T22:21:50.920 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.921 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-11T22:21:50.921 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw==", 2024-09-11T22:21:50.921 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.921 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:21:50.921 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:21:50.921 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:21:50.921 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:21:50.921 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.922 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-11T22:21:50.922 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg==", 2024-09-11T22:21:50.922 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.922 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:21:50.922 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:21:50.922 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:21:50.922 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:21:50.922 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.922 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-11T22:21:50.922 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw==", 2024-09-11T22:21:50.922 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.923 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:21:50.923 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:21:50.923 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:21:50.923 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:21:50.923 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.923 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-11T22:21:50.923 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBFFeJmAq9+OBAAANc9KfDvm3+wt/uED7WCvA==", 2024-09-11T22:21:50.923 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.924 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:21:50.924 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:21:50.924 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:21:50.924 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.924 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-11T22:21:50.924 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g==", 2024-09-11T22:21:50.924 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.924 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:21:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:21:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:21:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-11T22:21:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg==", 2024-09-11T22:21:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:21:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:21:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:21:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:21:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.925 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:50.926 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-11T22:21:50.926 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:21:50.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.913+0000 7f6cbb533640 1 -- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c9806be30 msgr2=0x7f6c9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.913+0000 7f6cbb533640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c9806be30 0x7f6c9806e2f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6cb415d7b0 tx=0x7f6ca4007c00 comp rx=0 tx=0).stop 2024-09-11T22:21:50.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.913+0000 7f6cbb533640 1 -- 172.21.15.50:0/367688772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cb40cdd50 msgr2=0x7f6cb41f5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.913+0000 7f6cbb533640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cb40cdd50 0x7f6cb41f5470 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c7f0 tx=0x7f6cb000cbf0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.913+0000 7f6cbb533640 1 -- 172.21.15.50:0/367688772 shutdown_connections 2024-09-11T22:21:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.913+0000 7f6cbb533640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c9806be30 0x7f6c9806e2f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.913+0000 7f6cbb533640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cb415e840 0x7f6cb40b7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.913+0000 7f6cbb533640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cb40cf580 0x7f6cb406c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.913+0000 7f6cbb533640 1 --2- 172.21.15.50:0/367688772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cb40cdd50 0x7f6cb41f5470 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.913+0000 7f6cbb533640 1 -- 172.21.15.50:0/367688772 >> 172.21.15.50:0/367688772 conn(0x7f6cb40b4150 msgr2=0x7f6cb40b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.913+0000 7f6cbb533640 1 -- 172.21.15.50:0/367688772 shutdown_connections 2024-09-11T22:21:50.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:50.913+0000 7f6cbb533640 1 -- 172.21.15.50:0/367688772 wait complete. 2024-09-11T22:21:50.929 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:21:51.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.030+0000 7f7d415e4640 1 Processor -- start 2024-09-11T22:21:51.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.031+0000 7f7d415e4640 1 -- start start 2024-09-11T22:21:51.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.031+0000 7f7d415e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7d3c06e0f0 0x7f7d3c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.031+0000 7f7d415e4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d3c15b7e0 con 0x7f7d3c072e60 2024-09-11T22:21:51.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.031+0000 7f7d415e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d3c15f140 con 0x7f7d3c15b400 2024-09-11T22:21:51.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.031+0000 7f7d415e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7d3c15f420 con 0x7f7d3c06e0f0 2024-09-11T22:21:51.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d3b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7d3c072e60 0x7f7d3c0711c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54828/0 (socket says 172.21.15.50:54828) 2024-09-11T22:21:51.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d3b7fe640 1 -- 172.21.15.50:0/1690063020 learned_addr learned my addr 172.21.15.50:0/1690063020 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:51.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d3a7fc640 1 --2- 172.21.15.50:0/1690063020 >> v2:172.21.15.77:3300/0 conn(0x7f7d3c06e0f0 0x7f7d3c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1956606903 0 0) 0x7f7d3c15b7e0 con 0x7f7d3c072e60 2024-09-11T22:21:51.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d24003520 con 0x7f7d3c072e60 2024-09-11T22:21:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4050774126 0 0) 0x7f7d24003520 con 0x7f7d3c072e60 2024-09-11T22:21:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 >> v2:172.21.15.77:3300/0 conn(0x7f7d3c06e0f0 msgr2=0x7f7d3c06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 --2- 172.21.15.50:0/1690063020 >> v2:172.21.15.77:3300/0 conn(0x7f7d3c06e0f0 0x7f7d3c06d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 >> v1:172.21.15.77:6789/0 conn(0x7f7d3c15b400 legacy=0x7f7d3c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c15f700 con 0x7f7d3c072e60 2024-09-11T22:21:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f7d340019f0 con 0x7f7d3c072e60 2024-09-11T22:21:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 >> v1:172.21.15.50:6789/0 conn(0x7f7d3c072e60 legacy=0x7f7d3c0711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 --2- 172.21.15.50:0/1690063020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d240039b0 0x7f7d24003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 --2- 172.21.15.50:0/1690063020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d24004800 0x7f7d24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 --2- 172.21.15.50:0/1690063020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d240051c0 0x7f7d2400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c15f420 con 0x7f7d240039b0 2024-09-11T22:21:51.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2400c060 con 0x7f7d240051c0 2024-09-11T22:21:51.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2400c260 con 0x7f7d24004800 2024-09-11T22:21:51.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d3affd640 1 --2- 172.21.15.50:0/1690063020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d240039b0 0x7f7d24003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d3a7fc640 1 --2- 172.21.15.50:0/1690063020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d24004800 0x7f7d24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.032+0000 7f7d3b7fe640 1 --2- 172.21.15.50:0/1690063020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d240051c0 0x7f7d2400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.033+0000 7f7d3affd640 1 -- 172.21.15.50:0/1690063020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d24004800 msgr2=0x7f7d24004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:51.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.033+0000 7f7d3affd640 1 --2- 172.21.15.50:0/1690063020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d24004800 0x7f7d24004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.033+0000 7f7d3affd640 1 -- 172.21.15.50:0/1690063020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d240051c0 msgr2=0x7f7d2400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:51.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.033+0000 7f7d3affd640 1 --2- 172.21.15.50:0/1690063020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d240051c0 0x7f7d2400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.033+0000 7f7d3b7fe640 1 -- 172.21.15.50:0/1690063020 reap_dead start 2024-09-11T22:21:51.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.033+0000 7f7d3affd640 1 -- 172.21.15.50:0/1690063020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d24003520 con 0x7f7d240039b0 2024-09-11T22:21:51.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.033+0000 7f7d3affd640 1 --2- 172.21.15.50:0/1690063020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d240039b0 0x7f7d24003dd0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c001750 tx=0x7f7d24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221263ee4274530b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:51.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.033+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c001370 con 0x7f7d240039b0 2024-09-11T22:21:51.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.033+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2c0052d0 con 0x7f7d240039b0 2024-09-11T22:21:51.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.033+0000 7f7d39ffb640 1 -- 172.21.15.50:0/1690063020 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c02abc0 con 0x7f7d240039b0 2024-09-11T22:21:51.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.034+0000 7f7d415e4640 1 -- 172.21.15.50:0/1690063020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d240039b0 msgr2=0x7f7d24003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:51.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.034+0000 7f7d415e4640 1 --2- 172.21.15.50:0/1690063020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d240039b0 0x7f7d24003dd0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c001750 tx=0x7f7d24005830 comp rx=0 tx=0).stop 2024-09-11T22:21:51.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.034+0000 7f7d415e4640 1 -- 172.21.15.50:0/1690063020 shutdown_connections 2024-09-11T22:21:51.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.034+0000 7f7d415e4640 1 --2- 172.21.15.50:0/1690063020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d240039b0 0x7f7d24003dd0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.034+0000 7f7d415e4640 1 -- 172.21.15.50:0/1690063020 >> 172.21.15.50:0/1690063020 conn(0x7f7d3c0679c0 msgr2=0x7f7d3c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:51.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.034+0000 7f7d415e4640 1 -- 172.21.15.50:0/1690063020 shutdown_connections 2024-09-11T22:21:51.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.034+0000 7f7d415e4640 1 -- 172.21.15.50:0/1690063020 wait complete. 2024-09-11T22:21:51.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.035+0000 7f7d415e4640 1 Processor -- start 2024-09-11T22:21:51.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.035+0000 7f7d415e4640 1 -- start start 2024-09-11T22:21:51.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.036+0000 7f7d415e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d240039b0 0x7f7d3c1f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.036+0000 7f7d415e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d3c1f3ea0 0x7f7d3c159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.036+0000 7f7d415e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d3c159fe0 0x7f7d3c1f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.036+0000 7f7d415e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c06d070 con 0x7f7d3c1f3ea0 2024-09-11T22:21:51.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.036+0000 7f7d415e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c0cfc50 con 0x7f7d240039b0 2024-09-11T22:21:51.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.036+0000 7f7d415e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7d3c06d1f0 con 0x7f7d3c159fe0 2024-09-11T22:21:51.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.036+0000 7f7d3a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d3c1f3ea0 0x7f7d3c159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.036+0000 7f7d3a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d3c1f3ea0 0x7f7d3c159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59846/0 (socket says 172.21.15.50:59846) 2024-09-11T22:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.036+0000 7f7d3a7fc640 1 -- 172.21.15.50:0/956386883 learned_addr learned my addr 172.21.15.50:0/956386883 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.037+0000 7f7d3affd640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d240039b0 0x7f7d3c1f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.037+0000 7f7d3b7fe640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d3c159fe0 0x7f7d3c1f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.037+0000 7f7d3a7fc640 1 -- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d3c159fe0 msgr2=0x7f7d3c1f12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.037+0000 7f7d3a7fc640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d3c159fe0 0x7f7d3c1f12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.037+0000 7f7d3a7fc640 1 -- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d240039b0 msgr2=0x7f7d3c1f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.037+0000 7f7d3a7fc640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d240039b0 0x7f7d3c1f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.037+0000 7f7d3a7fc640 1 -- 172.21.15.50:0/956386883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c157830 con 0x7f7d3c1f3ea0 2024-09-11T22:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.037+0000 7f7d3a7fc640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d3c1f3ea0 0x7f7d3c159aa0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f7d30011aa0 tx=0x7f7d30011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.037+0000 7f7d237fe640 1 -- 172.21.15.50:0/956386883 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000fb80 con 0x7f7d3c1f3ea0 2024-09-11T22:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.037+0000 7f7d237fe640 1 -- 172.21.15.50:0/956386883 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3000fd20 con 0x7f7d3c1f3ea0 2024-09-11T22:21:51.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.037+0000 7f7d415e4640 1 -- 172.21.15.50:0/956386883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3c157b10 con 0x7f7d3c1f3ea0 2024-09-11T22:21:51.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.037+0000 7f7d237fe640 1 -- 172.21.15.50:0/956386883 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30014660 con 0x7f7d3c1f3ea0 2024-09-11T22:21:51.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.037+0000 7f7d415e4640 1 -- 172.21.15.50:0/956386883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d3c1f27b0 con 0x7f7d3c1f3ea0 2024-09-11T22:21:51.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.038+0000 7f7d415e4640 1 -- 172.21.15.50:0/956386883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d3c15a3f0 con 0x7f7d3c1f3ea0 2024-09-11T22:21:51.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.039+0000 7f7d237fe640 1 -- 172.21.15.50:0/956386883 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d30012040 con 0x7f7d3c1f3ea0 2024-09-11T22:21:51.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.039+0000 7f7d237fe640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7d2806be30 0x7f7d2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.039+0000 7f7d237fe640 1 -- 172.21.15.50:0/956386883 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 4857+0+0 (secure 0 0 0) 0x7f7d3008b1e0 con 0x7f7d3c1f3ea0 2024-09-11T22:21:51.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.040+0000 7f7d3affd640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7d2806be30 0x7f7d2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.040+0000 7f7d3affd640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7d2806be30 0x7f7d2806e2f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c032000 tx=0x7f7d2c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:51.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.044+0000 7f7d237fe640 1 -- 172.21.15.50:0/956386883 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d3c15a3f0 con 0x7f7d3c1f3ea0 2024-09-11T22:21:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.224+0000 7f7d415e4640 1 -- 172.21.15.50:0/956386883 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7d3c06d9e0 con 0x7f7d3c1f3ea0 2024-09-11T22:21:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.224+0000 7f7d237fe640 1 -- 172.21.15.50:0/956386883 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v163) ==== 84+0+65 (secure 0 0 0) 0x7f7d30019030 con 0x7f7d3c1f3ea0 2024-09-11T22:21:51.225 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:51.225 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:21:51.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:21:51.225 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:21:51.225 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:21:51.225 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:21:51.226 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:21:51.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.226+0000 7f7d415e4640 1 -- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7d2806be30 msgr2=0x7f7d2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:51.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.226+0000 7f7d415e4640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7d2806be30 0x7f7d2806e2f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c032000 tx=0x7f7d2c02e000 comp rx=0 tx=0).stop 2024-09-11T22:21:51.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.226+0000 7f7d415e4640 1 -- 172.21.15.50:0/956386883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d3c1f3ea0 msgr2=0x7f7d3c159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:51.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.226+0000 7f7d415e4640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d3c1f3ea0 0x7f7d3c159aa0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f7d30011aa0 tx=0x7f7d30011f60 comp rx=0 tx=0).stop 2024-09-11T22:21:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.226+0000 7f7d415e4640 1 -- 172.21.15.50:0/956386883 shutdown_connections 2024-09-11T22:21:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.226+0000 7f7d415e4640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7d2806be30 0x7f7d2806e2f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.226+0000 7f7d415e4640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d3c159fe0 0x7f7d3c1f12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.226+0000 7f7d415e4640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d3c1f3ea0 0x7f7d3c159aa0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.226+0000 7f7d415e4640 1 --2- 172.21.15.50:0/956386883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d240039b0 0x7f7d3c1f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.226+0000 7f7d415e4640 1 -- 172.21.15.50:0/956386883 >> 172.21.15.50:0/956386883 conn(0x7f7d3c0679c0 msgr2=0x7f7d3c0b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.227+0000 7f7d415e4640 1 -- 172.21.15.50:0/956386883 shutdown_connections 2024-09-11T22:21:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.227+0000 7f7d415e4640 1 -- 172.21.15.50:0/956386883 wait complete. 2024-09-11T22:21:51.238 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:21:51.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:21:51.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.344+0000 7f484678d640 1 Processor -- start 2024-09-11T22:21:51.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.344+0000 7f484678d640 1 -- start start 2024-09-11T22:21:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.345+0000 7f484678d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48400b2d90 0x7f4840141400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.345+0000 7f484678d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4840140b70 0x7f484006e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.345+0000 7f484678d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4840141940 con 0x7f484006e6a0 2024-09-11T22:21:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.345+0000 7f484678d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f48400b4950 con 0x7f4840140b70 2024-09-11T22:21:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.345+0000 7f484678d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f48400b4ba0 con 0x7f48400b2d90 2024-09-11T22:21:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.345+0000 7f4844d2a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f484006e6a0 0x7f48400cf490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54834/0 (socket says 172.21.15.50:54834) 2024-09-11T22:21:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.345+0000 7f4837fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4840140b70 0x7f484006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.345+0000 7f4844d2a640 1 -- 172.21.15.50:0/2612259851 learned_addr learned my addr 172.21.15.50:0/2612259851 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.346+0000 7f483ffff640 1 --2- 172.21.15.50:0/2612259851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48400b2d90 0x7f4840141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.346+0000 7f4837fff640 1 -- 172.21.15.50:0/2612259851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48400b2d90 msgr2=0x7f4840141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.346+0000 7f4837fff640 1 --2- 172.21.15.50:0/2612259851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48400b2d90 0x7f4840141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.346+0000 7f4837fff640 1 -- 172.21.15.50:0/2612259851 >> v1:172.21.15.50:6789/0 conn(0x7f484006e6a0 legacy=0x7f48400cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.346+0000 7f483f7fe640 1 -- 172.21.15.50:0/2612259851 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768203283 0 0) 0x7f4838001490 con 0x7f484006e6a0 2024-09-11T22:21:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.346+0000 7f4837fff640 1 -- 172.21.15.50:0/2612259851 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48400b4e80 con 0x7f4840140b70 2024-09-11T22:21:51.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.346+0000 7f4837fff640 1 --2- 172.21.15.50:0/2612259851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840140b70 0x7f484006e160 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f48280097a0 tx=0x7f482802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0b3e24260f10af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.347+0000 7f483f7fe640 1 -- 172.21.15.50:0/2612259851 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828037070 con 0x7f4840140b70 2024-09-11T22:21:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.347+0000 7f483f7fe640 1 -- 172.21.15.50:0/2612259851 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4828032440 con 0x7f4840140b70 2024-09-11T22:21:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.347+0000 7f483f7fe640 1 -- 172.21.15.50:0/2612259851 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828032810 con 0x7f4840140b70 2024-09-11T22:21:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.347+0000 7f484678d640 1 -- 172.21.15.50:0/2612259851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840140b70 msgr2=0x7f484006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.347+0000 7f484678d640 1 --2- 172.21.15.50:0/2612259851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840140b70 0x7f484006e160 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f48280097a0 tx=0x7f482802a180 comp rx=0 tx=0).stop 2024-09-11T22:21:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.347+0000 7f484678d640 1 -- 172.21.15.50:0/2612259851 shutdown_connections 2024-09-11T22:21:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.347+0000 7f484678d640 1 --2- 172.21.15.50:0/2612259851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840140b70 0x7f484006e160 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.347+0000 7f484678d640 1 --2- 172.21.15.50:0/2612259851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48400b2d90 0x7f4840141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.347+0000 7f484678d640 1 -- 172.21.15.50:0/2612259851 >> 172.21.15.50:0/2612259851 conn(0x7f4840075270 msgr2=0x7f48400679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.347+0000 7f484678d640 1 -- 172.21.15.50:0/2612259851 shutdown_connections 2024-09-11T22:21:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.347+0000 7f484678d640 1 -- 172.21.15.50:0/2612259851 wait complete. 2024-09-11T22:21:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.348+0000 7f484678d640 1 Processor -- start 2024-09-11T22:21:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.349+0000 7f484678d640 1 -- start start 2024-09-11T22:21:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.349+0000 7f484678d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f484006e6a0 0x7f4840153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.349+0000 7f484678d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48400b2d90 0x7f4840151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.349+0000 7f484678d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840140b70 0x7f48401f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.349+0000 7f484678d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f48400b5720 con 0x7f4840140b70 2024-09-11T22:21:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.349+0000 7f484678d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f48400b5440 con 0x7f484006e6a0 2024-09-11T22:21:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.349+0000 7f484678d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f48400b3170 con 0x7f48400b2d90 2024-09-11T22:21:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.349+0000 7f4844d2a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840140b70 0x7f48401f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.349+0000 7f4844d2a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840140b70 0x7f48401f7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59868/0 (socket says 172.21.15.50:59868) 2024-09-11T22:21:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.349+0000 7f4844d2a640 1 -- 172.21.15.50:0/3899725661 learned_addr learned my addr 172.21.15.50:0/3899725661 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.349+0000 7f4837fff640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48400b2d90 0x7f4840151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.349+0000 7f483ffff640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f484006e6a0 0x7f4840153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.350+0000 7f4844d2a640 1 -- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48400b2d90 msgr2=0x7f4840151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.350+0000 7f4844d2a640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48400b2d90 0x7f4840151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.350+0000 7f4844d2a640 1 -- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f484006e6a0 msgr2=0x7f4840153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.350+0000 7f4844d2a640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f484006e6a0 0x7f4840153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.350+0000 7f4844d2a640 1 -- 172.21.15.50:0/3899725661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4840153370 con 0x7f4840140b70 2024-09-11T22:21:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.350+0000 7f4844d2a640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840140b70 0x7f48401f7690 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f483800c820 tx=0x7f483800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.350+0000 7f483d7fa640 1 -- 172.21.15.50:0/3899725661 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838018070 con 0x7f4840140b70 2024-09-11T22:21:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.350+0000 7f483d7fa640 1 -- 172.21.15.50:0/3899725661 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f483800a5e0 con 0x7f4840140b70 2024-09-11T22:21:51.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.350+0000 7f484678d640 1 -- 172.21.15.50:0/3899725661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48401f81e0 con 0x7f4840140b70 2024-09-11T22:21:51.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.350+0000 7f483d7fa640 1 -- 172.21.15.50:0/3899725661 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483800a9d0 con 0x7f4840140b70 2024-09-11T22:21:51.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.350+0000 7f484678d640 1 -- 172.21.15.50:0/3899725661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f484013cca0 con 0x7f4840140b70 2024-09-11T22:21:51.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.351+0000 7f484678d640 1 -- 172.21.15.50:0/3899725661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4840141400 con 0x7f4840140b70 2024-09-11T22:21:51.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.352+0000 7f483d7fa640 1 -- 172.21.15.50:0/3899725661 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f483801b070 con 0x7f4840140b70 2024-09-11T22:21:51.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.352+0000 7f483d7fa640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482006be30 0x7f482006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:51.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.352+0000 7f483d7fa640 1 -- 172.21.15.50:0/3899725661 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 4857+0+0 (secure 0 0 0) 0x7f483808a060 con 0x7f4840140b70 2024-09-11T22:21:51.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.352+0000 7f483ffff640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482006be30 0x7f482006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.353+0000 7f483ffff640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482006be30 0x7f482006e2f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4830006fd0 tx=0x7f4830008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:51.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.356+0000 7f483d7fa640 1 -- 172.21.15.50:0/3899725661 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4840141940 con 0x7f4840140b70 2024-09-11T22:21:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:51.532+0000 7f484678d640 1 -- 172.21.15.50:0/3899725661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f484006c180 con 0x7f4840140b70 2024-09-11T22:21:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.491+0000 7f483d7fa640 1 -- 172.21.15.50:0/3899725661 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v164) ==== 138+0+0 (secure 0 0 0) 0x7f48380587a0 con 0x7f4840140b70 2024-09-11T22:21:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:21:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.494+0000 7f484678d640 1 -- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482006be30 msgr2=0x7f482006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.494+0000 7f484678d640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482006be30 0x7f482006e2f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4830006fd0 tx=0x7f4830008040 comp rx=0 tx=0).stop 2024-09-11T22:21:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.494+0000 7f484678d640 1 -- 172.21.15.50:0/3899725661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840140b70 msgr2=0x7f48401f7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.494+0000 7f484678d640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840140b70 0x7f48401f7690 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f483800c820 tx=0x7f483800cce0 comp rx=0 tx=0).stop 2024-09-11T22:21:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.495+0000 7f484678d640 1 -- 172.21.15.50:0/3899725661 shutdown_connections 2024-09-11T22:21:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.495+0000 7f484678d640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f482006be30 0x7f482006e2f0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.495+0000 7f484678d640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48400b2d90 0x7f4840151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.495+0000 7f484678d640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4840140b70 0x7f48401f7690 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.495+0000 7f484678d640 1 --2- 172.21.15.50:0/3899725661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f484006e6a0 0x7f4840153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.495+0000 7f484678d640 1 -- 172.21.15.50:0/3899725661 >> 172.21.15.50:0/3899725661 conn(0x7f4840075270 msgr2=0x7f484015be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.495+0000 7f484678d640 1 -- 172.21.15.50:0/3899725661 shutdown_connections 2024-09-11T22:21:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.495+0000 7f484678d640 1 -- 172.21.15.50:0/3899725661 wait complete. 2024-09-11T22:21:52.513 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:21:52.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.629+0000 7f2e195bd640 1 Processor -- start 2024-09-11T22:21:52.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.629+0000 7f2e195bd640 1 -- start start 2024-09-11T22:21:52.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.630+0000 7f2e195bd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e140cf580 0x7f2e140b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.630+0000 7f2e195bd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e140cdd50 0x7f2e1406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.630+0000 7f2e195bd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e140ce5f0 con 0x7f2e1415e840 2024-09-11T22:21:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.630+0000 7f2e195bd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2e1406c240 con 0x7f2e140cdd50 2024-09-11T22:21:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.630+0000 7f2e195bd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2e140d0470 con 0x7f2e140cf580 2024-09-11T22:21:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.630+0000 7f2e12ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2e1415e840 0x7f2e140cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54842/0 (socket says 172.21.15.50:54842) 2024-09-11T22:21:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.630+0000 7f2e12ffd640 1 -- 172.21.15.50:0/600419359 learned_addr learned my addr 172.21.15.50:0/600419359 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.630+0000 7f2e137fe640 1 --2- 172.21.15.50:0/600419359 >> v2:172.21.15.77:3300/0 conn(0x7f2e140cdd50 0x7f2e1406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.630+0000 7f2e127fc640 1 --2- 172.21.15.50:0/600419359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e140cf580 0x7f2e140b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.630+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3928525668 0 0) 0x7f2e140ce5f0 con 0x7f2e1415e840 2024-09-11T22:21:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.630+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dfc003520 con 0x7f2e1415e840 2024-09-11T22:21:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3600197722 0 0) 0x7f2dfc003520 con 0x7f2e1415e840 2024-09-11T22:21:52.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e140cf580 msgr2=0x7f2e140b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 --2- 172.21.15.50:0/600419359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e140cf580 0x7f2e140b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 >> v2:172.21.15.77:3300/0 conn(0x7f2e140cdd50 msgr2=0x7f2e1406c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 --2- 172.21.15.50:0/600419359 >> v2:172.21.15.77:3300/0 conn(0x7f2e140cdd50 0x7f2e1406c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e140ce310 con 0x7f2e1415e840 2024-09-11T22:21:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f2e04001670 con 0x7f2e1415e840 2024-09-11T22:21:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 >> v1:172.21.15.50:6789/0 conn(0x7f2e1415e840 legacy=0x7f2e140cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 --2- 172.21.15.50:0/600419359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dfc0039b0 0x7f2dfc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 --2- 172.21.15.50:0/600419359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e140cf580 0x7f2dfc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 --2- 172.21.15.50:0/600419359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc004d40 0x7f2dfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1406c240 con 0x7f2dfc004d40 2024-09-11T22:21:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2e140d0470 con 0x7f2dfc0039b0 2024-09-11T22:21:52.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2dfc00b9c0 con 0x7f2e140cf580 2024-09-11T22:21:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e137fe640 1 --2- 172.21.15.50:0/600419359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc004d40 0x7f2dfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e12ffd640 1 --2- 172.21.15.50:0/600419359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dfc0039b0 0x7f2dfc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e127fc640 1 --2- 172.21.15.50:0/600419359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e140cf580 0x7f2dfc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e137fe640 1 -- 172.21.15.50:0/600419359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e140cf580 msgr2=0x7f2dfc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e137fe640 1 --2- 172.21.15.50:0/600419359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e140cf580 0x7f2dfc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e137fe640 1 -- 172.21.15.50:0/600419359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dfc0039b0 msgr2=0x7f2dfc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e137fe640 1 --2- 172.21.15.50:0/600419359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dfc0039b0 0x7f2dfc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e137fe640 1 -- 172.21.15.50:0/600419359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dfc003520 con 0x7f2dfc004d40 2024-09-11T22:21:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.631+0000 7f2e12ffd640 1 --2- 172.21.15.50:0/600419359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dfc0039b0 0x7f2dfc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.632+0000 7f2e137fe640 1 --2- 172.21.15.50:0/600419359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc004d40 0x7f2dfc0051c0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00e170 tx=0x7f2dfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865c2714fea5606f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.632+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c034020 con 0x7f2dfc004d40 2024-09-11T22:21:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.632+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c030430 con 0x7f2dfc004d40 2024-09-11T22:21:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.632+0000 7f2e11ffb640 1 -- 172.21.15.50:0/600419359 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c009c10 con 0x7f2dfc004d40 2024-09-11T22:21:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.633+0000 7f2e195bd640 1 -- 172.21.15.50:0/600419359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc004d40 msgr2=0x7f2dfc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.633+0000 7f2e195bd640 1 --2- 172.21.15.50:0/600419359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc004d40 0x7f2dfc0051c0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00e170 tx=0x7f2dfc005830 comp rx=0 tx=0).stop 2024-09-11T22:21:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.633+0000 7f2e137fe640 1 -- 172.21.15.50:0/600419359 reap_dead start 2024-09-11T22:21:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.633+0000 7f2e195bd640 1 -- 172.21.15.50:0/600419359 shutdown_connections 2024-09-11T22:21:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.633+0000 7f2e195bd640 1 -- 172.21.15.50:0/600419359 >> 172.21.15.50:0/600419359 conn(0x7f2e140b4150 msgr2=0x7f2e140b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.633+0000 7f2e195bd640 1 -- 172.21.15.50:0/600419359 shutdown_connections 2024-09-11T22:21:52.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.633+0000 7f2e195bd640 1 -- 172.21.15.50:0/600419359 wait complete. 2024-09-11T22:21:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.634+0000 7f2e195bd640 1 Processor -- start 2024-09-11T22:21:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.634+0000 7f2e195bd640 1 -- start start 2024-09-11T22:21:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e195bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dfc004d40 0x7f2e140b7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e195bd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e141f3c40 0x7f2e140b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e195bd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e14153b40 0x7f2e14160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e195bd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1415ec20 con 0x7f2e141f3c40 2024-09-11T22:21:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e195bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1406bed0 con 0x7f2dfc004d40 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e195bd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1415eda0 con 0x7f2e14153b40 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e127fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e141f3c40 0x7f2e140b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e127fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e141f3c40 0x7f2e140b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59880/0 (socket says 172.21.15.50:59880) 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e12ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dfc004d40 0x7f2e140b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e127fc640 1 -- 172.21.15.50:0/3502236200 learned_addr learned my addr 172.21.15.50:0/3502236200 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e137fe640 1 --2- 172.21.15.50:0/3502236200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e14153b40 0x7f2e14160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e127fc640 1 -- 172.21.15.50:0/3502236200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e14153b40 msgr2=0x7f2e14160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e127fc640 1 --2- 172.21.15.50:0/3502236200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e14153b40 0x7f2e14160ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e127fc640 1 -- 172.21.15.50:0/3502236200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dfc004d40 msgr2=0x7f2e140b7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e127fc640 1 --2- 172.21.15.50:0/3502236200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dfc004d40 0x7f2e140b7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.635+0000 7f2e127fc640 1 -- 172.21.15.50:0/3502236200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e140b0c30 con 0x7f2e141f3c40 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.636+0000 7f2e127fc640 1 --2- 172.21.15.50:0/3502236200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e141f3c40 0x7f2e140b7b60 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f2e080119c0 tx=0x7f2e08011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.636+0000 7f2dfb7fe640 1 -- 172.21.15.50:0/3502236200 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08019070 con 0x7f2e141f3c40 2024-09-11T22:21:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.636+0000 7f2dfb7fe640 1 -- 172.21.15.50:0/3502236200 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e08004300 con 0x7f2e141f3c40 2024-09-11T22:21:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.636+0000 7f2dfb7fe640 1 -- 172.21.15.50:0/3502236200 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0800fa80 con 0x7f2e141f3c40 2024-09-11T22:21:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.636+0000 7f2e195bd640 1 -- 172.21.15.50:0/3502236200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e140c97f0 con 0x7f2e141f3c40 2024-09-11T22:21:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.636+0000 7f2e195bd640 1 -- 172.21.15.50:0/3502236200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e141535f0 con 0x7f2e141f3c40 2024-09-11T22:21:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.637+0000 7f2e195bd640 1 -- 172.21.15.50:0/3502236200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e140b4c70 con 0x7f2e141f3c40 2024-09-11T22:21:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.637+0000 7f2dfb7fe640 1 -- 172.21.15.50:0/3502236200 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e0801c070 con 0x7f2e141f3c40 2024-09-11T22:21:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.638+0000 7f2dfb7fe640 1 --2- 172.21.15.50:0/3502236200 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e0006be60 0x7f2e0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.638+0000 7f2dfb7fe640 1 -- 172.21.15.50:0/3502236200 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5227+0+0 (secure 0 0 0) 0x7f2e0808aef0 con 0x7f2e141f3c40 2024-09-11T22:21:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.638+0000 7f2e12ffd640 1 --2- 172.21.15.50:0/3502236200 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e0006be60 0x7f2e0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:52.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.639+0000 7f2e12ffd640 1 --2- 172.21.15.50:0/3502236200 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e0006be60 0x7f2e0006e320 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2e040016d0 tx=0x7f2e040078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:52.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.642+0000 7f2dfb7fe640 1 -- 172.21.15.50:0/3502236200 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e08059430 con 0x7f2e141f3c40 2024-09-11T22:21:52.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:52.819+0000 7f2e195bd640 1 -- 172.21.15.50:0/3502236200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2e14153880 con 0x7f2e141f3c40 2024-09-11T22:21:53.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.497+0000 7f2dfb7fe640 1 -- 172.21.15.50:0/3502236200 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v165) ==== 170+0+0 (secure 0 0 0) 0x7f2e0805d730 con 0x7f2e141f3c40 2024-09-11T22:21:53.498 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:21:53.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.501+0000 7f2e195bd640 1 -- 172.21.15.50:0/3502236200 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e0006be60 msgr2=0x7f2e0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:53.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.501+0000 7f2e195bd640 1 --2- 172.21.15.50:0/3502236200 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e0006be60 0x7f2e0006e320 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2e040016d0 tx=0x7f2e040078f0 comp rx=0 tx=0).stop 2024-09-11T22:21:53.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.501+0000 7f2e195bd640 1 -- 172.21.15.50:0/3502236200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e141f3c40 msgr2=0x7f2e140b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:53.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.501+0000 7f2e195bd640 1 --2- 172.21.15.50:0/3502236200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e141f3c40 0x7f2e140b7b60 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f2e080119c0 tx=0x7f2e08011e80 comp rx=0 tx=0).stop 2024-09-11T22:21:53.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.501+0000 7f2e195bd640 1 -- 172.21.15.50:0/3502236200 shutdown_connections 2024-09-11T22:21:53.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.501+0000 7f2e195bd640 1 --2- 172.21.15.50:0/3502236200 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2e0006be60 0x7f2e0006e320 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:53.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.501+0000 7f2e195bd640 1 --2- 172.21.15.50:0/3502236200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e14153b40 0x7f2e14160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:53.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.501+0000 7f2e195bd640 1 --2- 172.21.15.50:0/3502236200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e141f3c40 0x7f2e140b7b60 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:53.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.501+0000 7f2e195bd640 1 --2- 172.21.15.50:0/3502236200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dfc004d40 0x7f2e140b7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:53.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.501+0000 7f2e195bd640 1 -- 172.21.15.50:0/3502236200 >> 172.21.15.50:0/3502236200 conn(0x7f2e140b4150 msgr2=0x7f2e140d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:53.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.501+0000 7f2e195bd640 1 -- 172.21.15.50:0/3502236200 shutdown_connections 2024-09-11T22:21:53.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.502+0000 7f2e195bd640 1 -- 172.21.15.50:0/3502236200 wait complete. 2024-09-11T22:21:53.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:21:53.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.642+0000 7f4d62f59640 1 Processor -- start 2024-09-11T22:21:53.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.642+0000 7f4d62f59640 1 -- start start 2024-09-11T22:21:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.643+0000 7f4d62f59640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d5c06e0f0 0x7f4d5c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.643+0000 7f4d62f59640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5c072e60 0x7f4d5c0711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.643+0000 7f4d62f59640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d5c15b7e0 con 0x7f4d5c15b400 2024-09-11T22:21:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.643+0000 7f4d62f59640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4d5c15f140 con 0x7f4d5c06e0f0 2024-09-11T22:21:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.643+0000 7f4d62f59640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d5c15f420 con 0x7f4d5c072e60 2024-09-11T22:21:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.643+0000 7f4d5bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d5c06e0f0 0x7f4d5c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.643+0000 7f4d60cf5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4d5c15b400 0x7f4d5c06d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54852/0 (socket says 172.21.15.50:54852) 2024-09-11T22:21:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.643+0000 7f4d60cf5640 1 -- 172.21.15.50:0/1408990947 learned_addr learned my addr 172.21.15.50:0/1408990947 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.643+0000 7f4d5bfff640 1 -- 172.21.15.50:0/1408990947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5c072e60 msgr2=0x7f4d5c0711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.643+0000 7f4d5bfff640 1 --2- 172.21.15.50:0/1408990947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5c072e60 0x7f4d5c0711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:53.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.643+0000 7f4d5bfff640 1 -- 172.21.15.50:0/1408990947 >> v1:172.21.15.50:6789/0 conn(0x7f4d5c15b400 legacy=0x7f4d5c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:53.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.643+0000 7f4d5bfff640 1 -- 172.21.15.50:0/1408990947 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5c15f700 con 0x7f4d5c06e0f0 2024-09-11T22:21:53.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.643+0000 7f4d5b7fe640 1 -- 172.21.15.50:0/1408990947 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 629544693 0 0) 0x7f4d5c15b7e0 con 0x7f4d5c15b400 2024-09-11T22:21:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.644+0000 7f4d5bfff640 1 --2- 172.21.15.50:0/1408990947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5c06e0f0 0x7f4d5c06d070 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f4d480097a0 tx=0x7f4d4802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857148ba0af88830 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.644+0000 7f4d5b7fe640 1 -- 172.21.15.50:0/1408990947 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48037070 con 0x7f4d5c06e0f0 2024-09-11T22:21:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.644+0000 7f4d5b7fe640 1 -- 172.21.15.50:0/1408990947 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d48032440 con 0x7f4d5c06e0f0 2024-09-11T22:21:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.644+0000 7f4d5b7fe640 1 -- 172.21.15.50:0/1408990947 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48032810 con 0x7f4d5c06e0f0 2024-09-11T22:21:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.644+0000 7f4d62f59640 1 -- 172.21.15.50:0/1408990947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5c06e0f0 msgr2=0x7f4d5c06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:53.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.644+0000 7f4d62f59640 1 --2- 172.21.15.50:0/1408990947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5c06e0f0 0x7f4d5c06d070 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f4d480097a0 tx=0x7f4d4802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:21:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.645+0000 7f4d62f59640 1 -- 172.21.15.50:0/1408990947 shutdown_connections 2024-09-11T22:21:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.645+0000 7f4d62f59640 1 --2- 172.21.15.50:0/1408990947 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5c072e60 0x7f4d5c0711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.645+0000 7f4d62f59640 1 --2- 172.21.15.50:0/1408990947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5c06e0f0 0x7f4d5c06d070 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.645+0000 7f4d62f59640 1 -- 172.21.15.50:0/1408990947 >> 172.21.15.50:0/1408990947 conn(0x7f4d5c0679c0 msgr2=0x7f4d5c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.645+0000 7f4d62f59640 1 -- 172.21.15.50:0/1408990947 shutdown_connections 2024-09-11T22:21:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.645+0000 7f4d62f59640 1 -- 172.21.15.50:0/1408990947 wait complete. 2024-09-11T22:21:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.646+0000 7f4d62f59640 1 Processor -- start 2024-09-11T22:21:53.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.646+0000 7f4d62f59640 1 -- start start 2024-09-11T22:21:53.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d62f59640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d5c06e0f0 0x7f4d5c149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:53.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d62f59640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5c072e60 0x7f4d5c1f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:53.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d62f59640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5c15b400 0x7f4d5c0ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:53.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d62f59640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c071700 con 0x7f4d5c15b400 2024-09-11T22:21:53.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d62f59640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c0cfc50 con 0x7f4d5c06e0f0 2024-09-11T22:21:53.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d62f59640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d5c071880 con 0x7f4d5c072e60 2024-09-11T22:21:53.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d614f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5c15b400 0x7f4d5c0ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:53.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d614f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5c15b400 0x7f4d5c0ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59900/0 (socket says 172.21.15.50:59900) 2024-09-11T22:21:53.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d614f6640 1 -- 172.21.15.50:0/4039103639 learned_addr learned my addr 172.21.15.50:0/4039103639 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:53.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d60cf5640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d5c06e0f0 0x7f4d5c149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:53.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d5bfff640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5c072e60 0x7f4d5c1f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:53.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d614f6640 1 -- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5c072e60 msgr2=0x7f4d5c1f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:53.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d614f6640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5c072e60 0x7f4d5c1f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:53.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d614f6640 1 -- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d5c06e0f0 msgr2=0x7f4d5c149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:53.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d614f6640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d5c06e0f0 0x7f4d5c149f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:53.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d614f6640 1 -- 172.21.15.50:0/4039103639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5c1f55b0 con 0x7f4d5c15b400 2024-09-11T22:21:53.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d60cf5640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d5c06e0f0 0x7f4d5c149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:53.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d5bfff640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5c072e60 0x7f4d5c1f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:53.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.647+0000 7f4d614f6640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5c15b400 0x7f4d5c0ae8c0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400ba10 tx=0x7f4d5400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:53.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.648+0000 7f4d597fa640 1 -- 172.21.15.50:0/4039103639 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54019070 con 0x7f4d5c15b400 2024-09-11T22:21:53.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.648+0000 7f4d597fa640 1 -- 172.21.15.50:0/4039103639 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5400cb40 con 0x7f4d5c15b400 2024-09-11T22:21:53.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.648+0000 7f4d597fa640 1 -- 172.21.15.50:0/4039103639 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54014440 con 0x7f4d5c15b400 2024-09-11T22:21:53.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.648+0000 7f4d62f59640 1 -- 172.21.15.50:0/4039103639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d5c0cd5f0 con 0x7f4d5c15b400 2024-09-11T22:21:53.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.648+0000 7f4d62f59640 1 -- 172.21.15.50:0/4039103639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d5c0cdbb0 con 0x7f4d5c15b400 2024-09-11T22:21:53.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.649+0000 7f4d62f59640 1 -- 172.21.15.50:0/4039103639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d5c0711c0 con 0x7f4d5c15b400 2024-09-11T22:21:53.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.649+0000 7f4d597fa640 1 -- 172.21.15.50:0/4039103639 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d5401c070 con 0x7f4d5c15b400 2024-09-11T22:21:53.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.650+0000 7f4d597fa640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d4006be30 0x7f4d4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:53.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.650+0000 7f4d597fa640 1 -- 172.21.15.50:0/4039103639 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5609+0+0 (secure 0 0 0) 0x7f4d5408ab40 con 0x7f4d5c15b400 2024-09-11T22:21:53.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.650+0000 7f4d60cf5640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d4006be30 0x7f4d4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:53.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.650+0000 7f4d60cf5640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d4006be30 0x7f4d4006e2f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4d50000f60 tx=0x7f4d50007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:53.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.654+0000 7f4d597fa640 1 -- 172.21.15.50:0/4039103639 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d5c1f55b0 con 0x7f4d5c15b400 2024-09-11T22:21:53.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:53.867+0000 7f4d62f59640 1 -- 172.21.15.50:0/4039103639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4d5c0b4a00 con 0x7f4d5c15b400 2024-09-11T22:21:54.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.499+0000 7f4d597fa640 1 -- 172.21.15.50:0/4039103639 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v118) ==== 174+0+0 (secure 0 0 0) 0x7f4d540594c0 con 0x7f4d5c15b400 2024-09-11T22:21:54.500 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 24 and data pool 25 2024-09-11T22:21:54.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.503+0000 7f4d62f59640 1 -- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d4006be30 msgr2=0x7f4d4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.503+0000 7f4d62f59640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d4006be30 0x7f4d4006e2f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4d50000f60 tx=0x7f4d50007ca0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.503+0000 7f4d62f59640 1 -- 172.21.15.50:0/4039103639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5c15b400 msgr2=0x7f4d5c0ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.504+0000 7f4d62f59640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5c15b400 0x7f4d5c0ae8c0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400ba10 tx=0x7f4d5400bed0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.504+0000 7f4d62f59640 1 -- 172.21.15.50:0/4039103639 shutdown_connections 2024-09-11T22:21:54.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.504+0000 7f4d62f59640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d4006be30 0x7f4d4006e2f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.504+0000 7f4d62f59640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d5c072e60 0x7f4d5c1f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.504+0000 7f4d62f59640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5c15b400 0x7f4d5c0ae8c0 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.504+0000 7f4d62f59640 1 --2- 172.21.15.50:0/4039103639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d5c06e0f0 0x7f4d5c149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.504+0000 7f4d62f59640 1 -- 172.21.15.50:0/4039103639 >> 172.21.15.50:0/4039103639 conn(0x7f4d5c0679c0 msgr2=0x7f4d5c0b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:54.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.510+0000 7f4d62f59640 1 -- 172.21.15.50:0/4039103639 shutdown_connections 2024-09-11T22:21:54.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.519+0000 7f4d62f59640 1 -- 172.21.15.50:0/4039103639 wait complete. 2024-09-11T22:21:54.540 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:21:54.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.646+0000 7fd2f53c4640 1 Processor -- start 2024-09-11T22:21:54.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.646+0000 7fd2f53c4640 1 -- start start 2024-09-11T22:21:54.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.647+0000 7fd2f53c4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd2f00d05e0 0x7fd2f00b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.647+0000 7fd2f53c4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f00b4f00 con 0x7fd2f00b3e10 2024-09-11T22:21:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.647+0000 7fd2f53c4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f00b4360 con 0x7fd2f015c2c0 2024-09-11T22:21:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.647+0000 7fd2f53c4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f00b51c0 con 0x7fd2f00d05e0 2024-09-11T22:21:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.647+0000 7fd2ef7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd2f00b3e10 0x7fd2f00ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54856/0 (socket says 172.21.15.50:54856) 2024-09-11T22:21:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.647+0000 7fd2ef7fe640 1 -- 172.21.15.50:0/4182096912 learned_addr learned my addr 172.21.15.50:0/4182096912 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.647+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 759124816 0 0) 0x7fd2f00b4f00 con 0x7fd2f00b3e10 2024-09-11T22:21:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.647+0000 7fd2ee7fc640 1 --2- 172.21.15.50:0/4182096912 >> v2:172.21.15.77:3300/0 conn(0x7fd2f00d05e0 0x7fd2f00b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.647+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2dc003520 con 0x7fd2f00b3e10 2024-09-11T22:21:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 140259510 0 0) 0x7fd2dc003520 con 0x7fd2f00b3e10 2024-09-11T22:21:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 >> v2:172.21.15.77:3300/0 conn(0x7fd2f00d05e0 msgr2=0x7fd2f00b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2edffb640 1 --2- 172.21.15.50:0/4182096912 >> v2:172.21.15.77:3300/0 conn(0x7fd2f00d05e0 0x7fd2f00b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 >> v1:172.21.15.77:6789/0 conn(0x7fd2f015c2c0 legacy=0x7fd2f00cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f00b54a0 con 0x7fd2f00b3e10 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fd2e00019f0 con 0x7fd2f00b3e10 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 >> v1:172.21.15.50:6789/0 conn(0x7fd2f00b3e10 legacy=0x7fd2f00ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2edffb640 1 --2- 172.21.15.50:0/4182096912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2dc0039b0 0x7fd2dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2edffb640 1 --2- 172.21.15.50:0/4182096912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2dc004800 0x7fd2dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2edffb640 1 --2- 172.21.15.50:0/4182096912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2dc0051c0 0x7fd2dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f00b51c0 con 0x7fd2dc004800 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc00c060 con 0x7fd2dc0051c0 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd2dc00c260 con 0x7fd2dc0039b0 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2ee7fc640 1 --2- 172.21.15.50:0/4182096912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2dc004800 0x7fd2dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2eeffd640 1 --2- 172.21.15.50:0/4182096912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2dc0039b0 0x7fd2dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2ef7fe640 1 --2- 172.21.15.50:0/4182096912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2dc0051c0 0x7fd2dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2ee7fc640 1 -- 172.21.15.50:0/4182096912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2dc0039b0 msgr2=0x7fd2dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2ee7fc640 1 --2- 172.21.15.50:0/4182096912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2dc0039b0 0x7fd2dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2ee7fc640 1 -- 172.21.15.50:0/4182096912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2dc0051c0 msgr2=0x7fd2dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:54.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2ee7fc640 1 --2- 172.21.15.50:0/4182096912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2dc0051c0 0x7fd2dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2ee7fc640 1 -- 172.21.15.50:0/4182096912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2dc003520 con 0x7fd2dc004800 2024-09-11T22:21:54.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.648+0000 7fd2ef7fe640 1 -- 172.21.15.50:0/4182096912 reap_dead start 2024-09-11T22:21:54.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.649+0000 7fd2ee7fc640 1 --2- 172.21.15.50:0/4182096912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2dc004800 0x7fd2dc004c80 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009ac0 tx=0x7fd2dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8a99660c90de98 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:54.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.649+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8036070 con 0x7fd2dc004800 2024-09-11T22:21:54.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.649+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d8031400 con 0x7fd2dc004800 2024-09-11T22:21:54.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.649+0000 7fd2edffb640 1 -- 172.21.15.50:0/4182096912 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8009690 con 0x7fd2dc004800 2024-09-11T22:21:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.650+0000 7fd2f53c4640 1 -- 172.21.15.50:0/4182096912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2dc004800 msgr2=0x7fd2dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.650+0000 7fd2f53c4640 1 --2- 172.21.15.50:0/4182096912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2dc004800 0x7fd2dc004c80 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009ac0 tx=0x7fd2dc005830 comp rx=0 tx=0).stop 2024-09-11T22:21:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.650+0000 7fd2f53c4640 1 -- 172.21.15.50:0/4182096912 shutdown_connections 2024-09-11T22:21:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.650+0000 7fd2f53c4640 1 --2- 172.21.15.50:0/4182096912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2dc004800 0x7fd2dc004c80 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.650+0000 7fd2f53c4640 1 -- 172.21.15.50:0/4182096912 >> 172.21.15.50:0/4182096912 conn(0x7fd2f00679c0 msgr2=0x7fd2f0067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.650+0000 7fd2f53c4640 1 -- 172.21.15.50:0/4182096912 shutdown_connections 2024-09-11T22:21:54.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.650+0000 7fd2f53c4640 1 -- 172.21.15.50:0/4182096912 wait complete. 2024-09-11T22:21:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.651+0000 7fd2f53c4640 1 Processor -- start 2024-09-11T22:21:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.651+0000 7fd2f53c4640 1 -- start start 2024-09-11T22:21:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2f53c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2dc004800 0x7fd2f014bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2f53c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2f0148340 0x7fd2f00ce650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2f53c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2f014d8c0 0x7fd2f00ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2f53c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f006d070 con 0x7fd2f014d8c0 2024-09-11T22:21:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2f53c4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f00ce200 con 0x7fd2f0148340 2024-09-11T22:21:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2f53c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f006d1f0 con 0x7fd2dc004800 2024-09-11T22:21:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2ef7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2f014d8c0 0x7fd2f00ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2ef7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2f014d8c0 0x7fd2f00ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59908/0 (socket says 172.21.15.50:59908) 2024-09-11T22:21:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2ef7fe640 1 -- 172.21.15.50:0/758869762 learned_addr learned my addr 172.21.15.50:0/758869762 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2ee7fc640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2f0148340 0x7fd2f00ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2eeffd640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2dc004800 0x7fd2f014bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2ef7fe640 1 -- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2dc004800 msgr2=0x7fd2f014bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2ef7fe640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2dc004800 0x7fd2f014bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2ef7fe640 1 -- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2f0148340 msgr2=0x7fd2f00ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2ef7fe640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2f0148340 0x7fd2f00ce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2ef7fe640 1 -- 172.21.15.50:0/758869762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f014b7e0 con 0x7fd2f014d8c0 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.652+0000 7fd2ef7fe640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2f014d8c0 0x7fd2f00ceb90 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00d1430 tx=0x7fd2e0007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.653+0000 7fd2e77fe640 1 -- 172.21.15.50:0/758869762 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000aa70 con 0x7fd2f014d8c0 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.653+0000 7fd2e77fe640 1 -- 172.21.15.50:0/758869762 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e0018070 con 0x7fd2f014d8c0 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.653+0000 7fd2f53c4640 1 -- 172.21.15.50:0/758869762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f014c440 con 0x7fd2f014d8c0 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.653+0000 7fd2e77fe640 1 -- 172.21.15.50:0/758869762 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000ae50 con 0x7fd2f014d8c0 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.653+0000 7fd2f53c4640 1 -- 172.21.15.50:0/758869762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f014ca00 con 0x7fd2f014d8c0 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.654+0000 7fd2f53c4640 1 -- 172.21.15.50:0/758869762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f015c6a0 con 0x7fd2f014d8c0 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.654+0000 7fd2e77fe640 1 -- 172.21.15.50:0/758869762 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2e001d460 con 0x7fd2f014d8c0 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.655+0000 7fd2e77fe640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2d006bfd0 0x7fd2d006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.655+0000 7fd2e77fe640 1 -- 172.21.15.50:0/758869762 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7fd2e008b080 con 0x7fd2f014d8c0 2024-09-11T22:21:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.655+0000 7fd2eeffd640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2d006bfd0 0x7fd2d006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.655+0000 7fd2eeffd640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2d006bfd0 0x7fd2d006e490 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0152a90 tx=0x7fd2e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:54.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.659+0000 7fd2e77fe640 1 -- 172.21.15.50:0/758869762 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2e0059470 con 0x7fd2f014d8c0 2024-09-11T22:21:54.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.834+0000 7fd2f53c4640 1 -- 172.21.15.50:0/758869762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2f006ed00 con 0x7fd2f014d8c0 2024-09-11T22:21:54.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.835+0000 7fd2e77fe640 1 -- 172.21.15.50:0/758869762 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16716 (secure 0 0 0) 0x7fd2e005d770 con 0x7fd2f014d8c0 2024-09-11T22:21:54.836 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:54.836 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":166,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:21:53.868555+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:21:51.564535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-11T22:21:52.850719+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:21:54.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.837+0000 7fd2f53c4640 1 -- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2d006bfd0 msgr2=0x7fd2d006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.837+0000 7fd2f53c4640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2d006bfd0 0x7fd2d006e490 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0152a90 tx=0x7fd2e8009040 comp rx=0 tx=0).stop 2024-09-11T22:21:54.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.837+0000 7fd2f53c4640 1 -- 172.21.15.50:0/758869762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2f014d8c0 msgr2=0x7fd2f00ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.837+0000 7fd2f53c4640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2f014d8c0 0x7fd2f00ceb90 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00d1430 tx=0x7fd2e0007a90 comp rx=0 tx=0).stop 2024-09-11T22:21:54.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.837+0000 7fd2f53c4640 1 -- 172.21.15.50:0/758869762 shutdown_connections 2024-09-11T22:21:54.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.837+0000 7fd2f53c4640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd2d006bfd0 0x7fd2d006e490 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.837+0000 7fd2f53c4640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2f014d8c0 0x7fd2f00ceb90 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.837+0000 7fd2f53c4640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2f0148340 0x7fd2f00ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.837+0000 7fd2f53c4640 1 --2- 172.21.15.50:0/758869762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2dc004800 0x7fd2f014bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.837+0000 7fd2f53c4640 1 -- 172.21.15.50:0/758869762 >> 172.21.15.50:0/758869762 conn(0x7fd2f00679c0 msgr2=0x7fd2f00b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:54.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.837+0000 7fd2f53c4640 1 -- 172.21.15.50:0/758869762 shutdown_connections 2024-09-11T22:21:54.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.837+0000 7fd2f53c4640 1 -- 172.21.15.50:0/758869762 wait complete. 2024-09-11T22:21:54.849 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:21:54.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.950+0000 7f7eee25e640 1 Processor -- start 2024-09-11T22:21:54.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.950+0000 7f7eee25e640 1 -- start start 2024-09-11T22:21:54.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.951+0000 7f7eee25e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b1600 0x7f7ee80b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.951+0000 7f7eee25e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ee80cfbd0 con 0x7f7ee80cf610 2024-09-11T22:21:54.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.951+0000 7f7eee25e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ee80cfeb0 con 0x7f7ee8161fa0 2024-09-11T22:21:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.951+0000 7f7eee25e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee80d1220 con 0x7f7ee80b1600 2024-09-11T22:21:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.951+0000 7f7edeffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7ee80cf610 0x7f7ee80cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54866/0 (socket says 172.21.15.50:54866) 2024-09-11T22:21:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.951+0000 7f7edeffd640 1 -- 172.21.15.50:0/2083176803 learned_addr learned my addr 172.21.15.50:0/2083176803 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.951+0000 7f7ee7fff640 1 --2- 172.21.15.50:0/2083176803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b1600 0x7f7ee80b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 789886705 0 0) 0x7f7ee80cfbd0 con 0x7f7ee80cf610 2024-09-11T22:21:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ed4003520 con 0x7f7ee80cf610 2024-09-11T22:21:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3850686217 0 0) 0x7f7ee80cfeb0 con 0x7f7ee8161fa0 2024-09-11T22:21:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ee80cfbd0 con 0x7f7ee8161fa0 2024-09-11T22:21:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 447132643 0 0) 0x7f7ed4003520 con 0x7f7ee80cf610 2024-09-11T22:21:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b1600 msgr2=0x7f7ee80b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 --2- 172.21.15.50:0/2083176803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b1600 0x7f7ee80b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 >> v1:172.21.15.77:6789/0 conn(0x7f7ee8161fa0 legacy=0x7f7ee80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee80d1470 con 0x7f7ee80cf610 2024-09-11T22:21:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f7ed0001670 con 0x7f7ee80cf610 2024-09-11T22:21:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee7fff640 1 --2- 172.21.15.50:0/2083176803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b1600 0x7f7ee80b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 >> v1:172.21.15.50:6789/0 conn(0x7f7ee80cf610 legacy=0x7f7ee80cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 --2- 172.21.15.50:0/2083176803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b1600 0x7f7ed4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 --2- 172.21.15.50:0/2083176803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed40040b0 0x7f7ed4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 --2- 172.21.15.50:0/2083176803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed4004d40 0x7f7ed40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee80d1220 con 0x7f7ed40040b0 2024-09-11T22:21:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed400ba70 con 0x7f7ed4004d40 2024-09-11T22:21:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed400bc70 con 0x7f7ee80b1600 2024-09-11T22:21:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7edeffd640 1 --2- 172.21.15.50:0/2083176803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed40040b0 0x7f7ed4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee77fe640 1 --2- 172.21.15.50:0/2083176803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b1600 0x7f7ed4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7ee7fff640 1 --2- 172.21.15.50:0/2083176803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed4004d40 0x7f7ed40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7edeffd640 1 -- 172.21.15.50:0/2083176803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b1600 msgr2=0x7f7ed4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:54.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7edeffd640 1 --2- 172.21.15.50:0/2083176803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b1600 0x7f7ed4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7edeffd640 1 -- 172.21.15.50:0/2083176803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed4004d40 msgr2=0x7f7ed40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:54.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7edeffd640 1 --2- 172.21.15.50:0/2083176803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed4004d40 0x7f7ed40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.952+0000 7f7edeffd640 1 -- 172.21.15.50:0/2083176803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed4003520 con 0x7f7ed40040b0 2024-09-11T22:21:54.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.953+0000 7f7edeffd640 1 --2- 172.21.15.50:0/2083176803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed40040b0 0x7f7ed4004800 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000c1c0 tx=0x7f7ed4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e368c4b05c9752 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:54.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.953+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0007cc0 con 0x7f7ed40040b0 2024-09-11T22:21:54.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.953+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed0005ad0 con 0x7f7ed40040b0 2024-09-11T22:21:54.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.953+0000 7f7ee6ffd640 1 -- 172.21.15.50:0/2083176803 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0007070 con 0x7f7ed40040b0 2024-09-11T22:21:54.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.954+0000 7f7eee25e640 1 -- 172.21.15.50:0/2083176803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed40040b0 msgr2=0x7f7ed4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.954+0000 7f7eee25e640 1 --2- 172.21.15.50:0/2083176803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed40040b0 0x7f7ed4004800 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000c1c0 tx=0x7f7ed4005830 comp rx=0 tx=0).stop 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.954+0000 7f7ee7fff640 1 -- 172.21.15.50:0/2083176803 reap_dead start 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.954+0000 7f7eee25e640 1 -- 172.21.15.50:0/2083176803 shutdown_connections 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.954+0000 7f7eee25e640 1 -- 172.21.15.50:0/2083176803 >> 172.21.15.50:0/2083176803 conn(0x7f7ee809ba50 msgr2=0x7f7ee80b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.954+0000 7f7eee25e640 1 -- 172.21.15.50:0/2083176803 shutdown_connections 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.954+0000 7f7eee25e640 1 -- 172.21.15.50:0/2083176803 wait complete. 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.955+0000 7f7eee25e640 1 Processor -- start 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.955+0000 7f7eee25e640 1 -- start start 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7eee25e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed40040b0 0x7f7ee80b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7eee25e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee80b2480 0x7f7ee80c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7eee25e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b2900 0x7f7ee80c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7eee25e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee80d1c70 con 0x7f7ee80b2480 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7eee25e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee80d17e0 con 0x7f7ed40040b0 2024-09-11T22:21:54.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7eee25e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee80d1df0 con 0x7f7ee80b2900 2024-09-11T22:21:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7edeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee80b2480 0x7f7ee80c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7edeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee80b2480 0x7f7ee80c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59920/0 (socket says 172.21.15.50:59920) 2024-09-11T22:21:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7edeffd640 1 -- 172.21.15.50:0/4051018166 learned_addr learned my addr 172.21.15.50:0/4051018166 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7ee77fe640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed40040b0 0x7f7ee80b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7ee7fff640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b2900 0x7f7ee80c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7edeffd640 1 -- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b2900 msgr2=0x7f7ee80c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7edeffd640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b2900 0x7f7ee80c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7edeffd640 1 -- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed40040b0 msgr2=0x7f7ee80b7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.956+0000 7f7edeffd640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed40040b0 0x7f7ee80b7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.957+0000 7f7edeffd640 1 -- 172.21.15.50:0/4051018166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee80b82f0 con 0x7f7ee80b2480 2024-09-11T22:21:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.957+0000 7f7edeffd640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee80b2480 0x7f7ee80c6220 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f7ed002ada0 tx=0x7f7ed00019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.957+0000 7f7ee4ff9640 1 -- 172.21.15.50:0/4051018166 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0001670 con 0x7f7ee80b2480 2024-09-11T22:21:54.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.957+0000 7f7ee4ff9640 1 -- 172.21.15.50:0/4051018166 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed0042070 con 0x7f7ee80b2480 2024-09-11T22:21:54.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.957+0000 7f7eee25e640 1 -- 172.21.15.50:0/4051018166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee80b2e60 con 0x7f7ee80b2480 2024-09-11T22:21:54.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.957+0000 7f7ee4ff9640 1 -- 172.21.15.50:0/4051018166 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00072b0 con 0x7f7ee80b2480 2024-09-11T22:21:54.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.957+0000 7f7eee25e640 1 -- 172.21.15.50:0/4051018166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee80b3420 con 0x7f7ee80b2480 2024-09-11T22:21:54.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.958+0000 7f7eee25e640 1 -- 172.21.15.50:0/4051018166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ee80b4d20 con 0x7f7ee80b2480 2024-09-11T22:21:54.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.958+0000 7f7ee4ff9640 1 -- 172.21.15.50:0/4051018166 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ed0007450 con 0x7f7ee80b2480 2024-09-11T22:21:54.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.959+0000 7f7ee4ff9640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7ec806be60 0x7f7ec806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.959+0000 7f7ee4ff9640 1 -- 172.21.15.50:0/4051018166 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f7ed00aadb0 con 0x7f7ee80b2480 2024-09-11T22:21:54.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.959+0000 7f7ee77fe640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7ec806be60 0x7f7ec806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.960+0000 7f7ee77fe640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7ec806be60 0x7f7ec806e320 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8005530 tx=0x7f7ed8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:54.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:54.963+0000 7f7ee4ff9640 1 -- 172.21.15.50:0/4051018166 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ed00af070 con 0x7f7ee80b2480 2024-09-11T22:21:55.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.139+0000 7f7eee25e640 1 -- 172.21.15.50:0/4051018166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ee80b0000 con 0x7f7ee80b2480 2024-09-11T22:21:55.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.140+0000 7f7ee4ff9640 1 -- 172.21.15.50:0/4051018166 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16716 (secure 0 0 0) 0x7f7ed0079750 con 0x7f7ee80b2480 2024-09-11T22:21:55.144 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:55.145 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":166,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:21:53.868555+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:21:51.564535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-11T22:21:52.850719+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:21:55.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.142+0000 7f7eee25e640 1 -- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7ec806be60 msgr2=0x7f7ec806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:55.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.142+0000 7f7eee25e640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7ec806be60 0x7f7ec806e320 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8005530 tx=0x7f7ed8009040 comp rx=0 tx=0).stop 2024-09-11T22:21:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.142+0000 7f7eee25e640 1 -- 172.21.15.50:0/4051018166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee80b2480 msgr2=0x7f7ee80c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.142+0000 7f7eee25e640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee80b2480 0x7f7ee80c6220 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f7ed002ada0 tx=0x7f7ed00019c0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.142+0000 7f7eee25e640 1 -- 172.21.15.50:0/4051018166 shutdown_connections 2024-09-11T22:21:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.142+0000 7f7eee25e640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7ec806be60 0x7f7ec806e320 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.142+0000 7f7eee25e640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ee80b2900 0x7f7ee80c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.142+0000 7f7eee25e640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ee80b2480 0x7f7ee80c6220 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.142+0000 7f7eee25e640 1 --2- 172.21.15.50:0/4051018166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed40040b0 0x7f7ee80b7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.142+0000 7f7eee25e640 1 -- 172.21.15.50:0/4051018166 >> 172.21.15.50:0/4051018166 conn(0x7f7ee809ba50 msgr2=0x7f7ee80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.142+0000 7f7eee25e640 1 -- 172.21.15.50:0/4051018166 shutdown_connections 2024-09-11T22:21:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.142+0000 7f7eee25e640 1 -- 172.21.15.50:0/4051018166 wait complete. 2024-09-11T22:21:55.154 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:21:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.259+0000 7f92df2ba640 1 Processor -- start 2024-09-11T22:21:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.259+0000 7f92df2ba640 1 -- start start 2024-09-11T22:21:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.260+0000 7f92df2ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d80d05e0 0x7f92d80b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.260+0000 7f92df2ba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f92d80b3e10 0x7f92d80ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.260+0000 7f92df2ba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d80b4f00 con 0x7f92d815c2c0 2024-09-11T22:21:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.260+0000 7f92df2ba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f92d80b4360 con 0x7f92d80b3e10 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.260+0000 7f92df2ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f92d80b51c0 con 0x7f92d80d05e0 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.260+0000 7f92dd056640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f92d815c2c0 0x7f92d80cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54870/0 (socket says 172.21.15.50:54870) 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.260+0000 7f92dd056640 1 -- 172.21.15.50:0/2315808356 learned_addr learned my addr 172.21.15.50:0/2315808356 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.260+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1184793996 0 0) 0x7f92d80b4f00 con 0x7f92d815c2c0 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.260+0000 7f92dd857640 1 --2- 172.21.15.50:0/2315808356 >> v2:172.21.15.77:3300/0 conn(0x7f92d80b3e10 0x7f92d80ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.260+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92c0003520 con 0x7f92d815c2c0 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.260+0000 7f92dc855640 1 --2- 172.21.15.50:0/2315808356 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d80d05e0 0x7f92d80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3323500959 0 0) 0x7f92c0003520 con 0x7f92d815c2c0 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d80d05e0 msgr2=0x7f92d80b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 --2- 172.21.15.50:0/2315808356 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d80d05e0 0x7f92d80b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 >> v2:172.21.15.77:3300/0 conn(0x7f92d80b3e10 msgr2=0x7f92d80ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 --2- 172.21.15.50:0/2315808356 >> v2:172.21.15.77:3300/0 conn(0x7f92d80b3e10 0x7f92d80ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d80b54a0 con 0x7f92d815c2c0 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f92d0001670 con 0x7f92d815c2c0 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 >> v1:172.21.15.50:6789/0 conn(0x7f92d815c2c0 legacy=0x7f92d80cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 --2- 172.21.15.50:0/2315808356 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d80d05e0 0x7f92c00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 --2- 172.21.15.50:0/2315808356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92c0003f30 0x7f92c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 --2- 172.21.15.50:0/2315808356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92c0004d40 0x7f92c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f92d80b4360 con 0x7f92c0003f30 2024-09-11T22:21:55.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f92d80b51c0 con 0x7f92c0004d40 2024-09-11T22:21:55.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f92c000b9c0 con 0x7f92d80d05e0 2024-09-11T22:21:55.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92dc855640 1 --2- 172.21.15.50:0/2315808356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92c0003f30 0x7f92c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92dd056640 1 --2- 172.21.15.50:0/2315808356 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d80d05e0 0x7f92c00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92dd857640 1 --2- 172.21.15.50:0/2315808356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92c0004d40 0x7f92c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92dc855640 1 -- 172.21.15.50:0/2315808356 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d80d05e0 msgr2=0x7f92c00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:55.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92dc855640 1 --2- 172.21.15.50:0/2315808356 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d80d05e0 0x7f92c00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92dc855640 1 -- 172.21.15.50:0/2315808356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92c0004d40 msgr2=0x7f92c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:55.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92dc855640 1 --2- 172.21.15.50:0/2315808356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92c0004d40 0x7f92c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.261+0000 7f92dc855640 1 -- 172.21.15.50:0/2315808356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c0003520 con 0x7f92c0003f30 2024-09-11T22:21:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.262+0000 7f92dc855640 1 --2- 172.21.15.50:0/2315808356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92c0003f30 0x7f92c0004800 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009ac0 tx=0x7f92c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d51268600524a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.262+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc036070 con 0x7f92c0003f30 2024-09-11T22:21:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.262+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92cc031400 con 0x7f92c0003f30 2024-09-11T22:21:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.262+0000 7f92d7fff640 1 -- 172.21.15.50:0/2315808356 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc009690 con 0x7f92c0003f30 2024-09-11T22:21:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.263+0000 7f92df2ba640 1 -- 172.21.15.50:0/2315808356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92c0003f30 msgr2=0x7f92c0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.263+0000 7f92df2ba640 1 --2- 172.21.15.50:0/2315808356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92c0003f30 0x7f92c0004800 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009ac0 tx=0x7f92c0005830 comp rx=0 tx=0).stop 2024-09-11T22:21:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.263+0000 7f92dd857640 1 -- 172.21.15.50:0/2315808356 reap_dead start 2024-09-11T22:21:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.263+0000 7f92df2ba640 1 -- 172.21.15.50:0/2315808356 shutdown_connections 2024-09-11T22:21:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.263+0000 7f92df2ba640 1 -- 172.21.15.50:0/2315808356 >> 172.21.15.50:0/2315808356 conn(0x7f92d80679c0 msgr2=0x7f92d8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.263+0000 7f92df2ba640 1 -- 172.21.15.50:0/2315808356 shutdown_connections 2024-09-11T22:21:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.263+0000 7f92df2ba640 1 -- 172.21.15.50:0/2315808356 wait complete. 2024-09-11T22:21:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.264+0000 7f92df2ba640 1 Processor -- start 2024-09-11T22:21:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.264+0000 7f92df2ba640 1 -- start start 2024-09-11T22:21:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92df2ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92c0003f30 0x7f92d81ef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92df2ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d80b0f00 0x7f92d80b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92df2ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92d81f20e0 0x7f92d81f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92df2ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f92d806d070 con 0x7f92c0003f30 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92df2ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f92d80ce200 con 0x7f92d81f20e0 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92df2ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f92d806d1f0 con 0x7f92d80b0f00 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92dd056640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92c0003f30 0x7f92d81ef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92dd056640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92c0003f30 0x7f92d81ef5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59930/0 (socket says 172.21.15.50:59930) 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92dd056640 1 -- 172.21.15.50:0/904685451 learned_addr learned my addr 172.21.15.50:0/904685451 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92dc855640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d80b0f00 0x7f92d80b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92dd857640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92d81f20e0 0x7f92d81f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92dd056640 1 -- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d80b0f00 msgr2=0x7f92d80b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92dd056640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d80b0f00 0x7f92d80b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92dd056640 1 -- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92d81f20e0 msgr2=0x7f92d81f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92dd056640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92d81f20e0 0x7f92d81f2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92dd056640 1 -- 172.21.15.50:0/904685451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d81f2eb0 con 0x7f92c0003f30 2024-09-11T22:21:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.265+0000 7f92dd056640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92c0003f30 0x7f92d81ef5d0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f92d0007340 tx=0x7f92d0007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.266+0000 7f92d5ffb640 1 -- 172.21.15.50:0/904685451 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d000f940 con 0x7f92c0003f30 2024-09-11T22:21:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.266+0000 7f92d5ffb640 1 -- 172.21.15.50:0/904685451 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d0018070 con 0x7f92c0003f30 2024-09-11T22:21:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.266+0000 7f92d5ffb640 1 -- 172.21.15.50:0/904685451 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d000fd20 con 0x7f92c0003f30 2024-09-11T22:21:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.266+0000 7f92df2ba640 1 -- 172.21.15.50:0/904685451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d81f3490 con 0x7f92c0003f30 2024-09-11T22:21:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.266+0000 7f92df2ba640 1 -- 172.21.15.50:0/904685451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d81efb10 con 0x7f92c0003f30 2024-09-11T22:21:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.267+0000 7f92df2ba640 1 -- 172.21.15.50:0/904685451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d815c6a0 con 0x7f92c0003f30 2024-09-11T22:21:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.267+0000 7f92d5ffb640 1 -- 172.21.15.50:0/904685451 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92d001d460 con 0x7f92c0003f30 2024-09-11T22:21:55.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.268+0000 7f92d5ffb640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92c406be30 0x7f92c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.268+0000 7f92d5ffb640 1 -- 172.21.15.50:0/904685451 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f92d008ae10 con 0x7f92c0003f30 2024-09-11T22:21:55.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.268+0000 7f92dc855640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92c406be30 0x7f92c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.268+0000 7f92dc855640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92c406be30 0x7f92c406e2f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f92cc033000 tx=0x7f92cc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:55.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.272+0000 7f92d5ffb640 1 -- 172.21.15.50:0/904685451 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92d0059200 con 0x7f92c0003f30 2024-09-11T22:21:55.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.483+0000 7f92df2ba640 1 -- 172.21.15.50:0/904685451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f92d806d660 con 0x7f92c0003f30 2024-09-11T22:21:55.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.516+0000 7f92d5ffb640 1 -- 172.21.15.50:0/904685451 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v119) ==== 118+0+0 (secure 0 0 0) 0x7f92d005d500 con 0x7f92c0003f30 2024-09-11T22:21:55.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.518+0000 7f92df2ba640 1 -- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92c406be30 msgr2=0x7f92c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:55.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.518+0000 7f92df2ba640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92c406be30 0x7f92c406e2f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f92cc033000 tx=0x7f92cc008030 comp rx=0 tx=0).stop 2024-09-11T22:21:55.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.518+0000 7f92df2ba640 1 -- 172.21.15.50:0/904685451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92c0003f30 msgr2=0x7f92d81ef5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:55.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.518+0000 7f92df2ba640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92c0003f30 0x7f92d81ef5d0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f92d0007340 tx=0x7f92d0007800 comp rx=0 tx=0).stop 2024-09-11T22:21:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.518+0000 7f92df2ba640 1 -- 172.21.15.50:0/904685451 shutdown_connections 2024-09-11T22:21:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.518+0000 7f92df2ba640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92c406be30 0x7f92c406e2f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.518+0000 7f92df2ba640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d80b0f00 0x7f92d80b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.518+0000 7f92df2ba640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92d81f20e0 0x7f92d81f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.518+0000 7f92df2ba640 1 --2- 172.21.15.50:0/904685451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92c0003f30 0x7f92d81ef5d0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.519+0000 7f92df2ba640 1 -- 172.21.15.50:0/904685451 >> 172.21.15.50:0/904685451 conn(0x7f92d80679c0 msgr2=0x7f92d81590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.519+0000 7f92df2ba640 1 -- 172.21.15.50:0/904685451 shutdown_connections 2024-09-11T22:21:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.519+0000 7f92df2ba640 1 -- 172.21.15.50:0/904685451 wait complete. 2024-09-11T22:21:55.531 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:21:55.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:21:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.636+0000 7f9ba47bd640 1 Processor -- start 2024-09-11T22:21:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.636+0000 7f9ba47bd640 1 -- start start 2024-09-11T22:21:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.637+0000 7f9ba47bd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9b9c15e870 0x7f9b9c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.637+0000 7f9ba47bd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b9c0d16d0 0x7f9b9c0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.637+0000 7f9ba47bd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b9c0cfa80 con 0x7f9b9c0d3a30 2024-09-11T22:21:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.637+0000 7f9ba47bd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9b9c0d1b40 con 0x7f9b9c0d16d0 2024-09-11T22:21:55.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.637+0000 7f9ba47bd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9b9c0d3e50 con 0x7f9b9c15e870 2024-09-11T22:21:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.637+0000 7f9ba1d58640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b9c0d16d0 0x7f9b9c0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.637+0000 7f9ba1d58640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b9c0d16d0 0x7f9b9c0d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59938/0 (socket says 172.21.15.50:59938) 2024-09-11T22:21:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.637+0000 7f9ba1d58640 1 -- 172.21.15.50:0/2310601148 learned_addr learned my addr 172.21.15.50:0/2310601148 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.637+0000 7f9ba2559640 1 --2- 172.21.15.50:0/2310601148 >> v2:172.21.15.77:3300/0 conn(0x7f9b9c15e870 0x7f9b9c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.637+0000 7f9ba1d58640 1 -- 172.21.15.50:0/2310601148 >> v2:172.21.15.77:3300/0 conn(0x7f9b9c15e870 msgr2=0x7f9b9c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.638+0000 7f9ba1d58640 1 --2- 172.21.15.50:0/2310601148 >> v2:172.21.15.77:3300/0 conn(0x7f9b9c15e870 0x7f9b9c0d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.638+0000 7f9ba1d58640 1 -- 172.21.15.50:0/2310601148 >> v1:172.21.15.77:6789/0 conn(0x7f9b9c0d3a30 legacy=0x7f9b9c0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.638+0000 7f9ba1d58640 1 -- 172.21.15.50:0/2310601148 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9c0d40d0 con 0x7f9b9c0d16d0 2024-09-11T22:21:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.638+0000 7f9ba2559640 1 --2- 172.21.15.50:0/2310601148 >> v2:172.21.15.77:3300/0 conn(0x7f9b9c15e870 0x7f9b9c0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:55.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.638+0000 7f9ba1d58640 1 --2- 172.21.15.50:0/2310601148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b9c0d16d0 0x7f9b9c0d34f0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0d57c0 tx=0x7f9b8c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b5ae745ecd874a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.638+0000 7f9ba1557640 1 -- 172.21.15.50:0/2310601148 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c037070 con 0x7f9b9c0d16d0 2024-09-11T22:21:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.638+0000 7f9ba1557640 1 -- 172.21.15.50:0/2310601148 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8c032440 con 0x7f9b9c0d16d0 2024-09-11T22:21:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.639+0000 7f9ba1557640 1 -- 172.21.15.50:0/2310601148 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c032810 con 0x7f9b9c0d16d0 2024-09-11T22:21:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.639+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2310601148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b9c0d16d0 msgr2=0x7f9b9c0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.639+0000 7f9ba47bd640 1 --2- 172.21.15.50:0/2310601148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b9c0d16d0 0x7f9b9c0d34f0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0d57c0 tx=0x7f9b8c02a230 comp rx=0 tx=0).stop 2024-09-11T22:21:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.639+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2310601148 shutdown_connections 2024-09-11T22:21:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.639+0000 7f9ba47bd640 1 --2- 172.21.15.50:0/2310601148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b9c0d16d0 0x7f9b9c0d34f0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.639+0000 7f9ba47bd640 1 --2- 172.21.15.50:0/2310601148 >> v2:172.21.15.77:3300/0 conn(0x7f9b9c15e870 0x7f9b9c0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.639+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2310601148 >> 172.21.15.50:0/2310601148 conn(0x7f9b9c0727a0 msgr2=0x7f9b9c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:55.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.639+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2310601148 shutdown_connections 2024-09-11T22:21:55.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.639+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2310601148 wait complete. 2024-09-11T22:21:55.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.640+0000 7f9ba47bd640 1 Processor -- start 2024-09-11T22:21:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.640+0000 7f9ba47bd640 1 -- start start 2024-09-11T22:21:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.641+0000 7f9ba47bd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9c0d16d0 0x7f9b9c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.641+0000 7f9ba47bd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b9c0d3a30 0x7f9b9c1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.641+0000 7f9ba47bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b9c15e870 0x7f9b9c158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.641+0000 7f9ba47bd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9c0b7ee0 con 0x7f9b9c0d3a30 2024-09-11T22:21:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.641+0000 7f9ba47bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9c0b7c00 con 0x7f9b9c15e870 2024-09-11T22:21:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.641+0000 7f9ba47bd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9b9c15ec50 con 0x7f9b9c0d16d0 2024-09-11T22:21:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.641+0000 7f9ba1d58640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b9c0d3a30 0x7f9b9c1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.641+0000 7f9ba1d58640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b9c0d3a30 0x7f9b9c1557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59954/0 (socket says 172.21.15.50:59954) 2024-09-11T22:21:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.641+0000 7f9ba1d58640 1 -- 172.21.15.50:0/2544216932 learned_addr learned my addr 172.21.15.50:0/2544216932 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:55.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.641+0000 7f9ba2d5a640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b9c15e870 0x7f9b9c158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.641+0000 7f9ba2559640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9c0d16d0 0x7f9b9c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.642+0000 7f9ba1d58640 1 -- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9c0d16d0 msgr2=0x7f9b9c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.642+0000 7f9ba1d58640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9c0d16d0 0x7f9b9c15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.642+0000 7f9ba1d58640 1 -- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b9c15e870 msgr2=0x7f9b9c158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.642+0000 7f9ba1d58640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b9c15e870 0x7f9b9c158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.642+0000 7f9ba1d58640 1 -- 172.21.15.50:0/2544216932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9c15a160 con 0x7f9b9c0d3a30 2024-09-11T22:21:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.642+0000 7f9ba2d5a640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b9c15e870 0x7f9b9c158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.642+0000 7f9ba1d58640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b9c0d3a30 0x7f9b9c1557e0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c000c00 tx=0x7f9b8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.642+0000 7f9b92ffd640 1 -- 172.21.15.50:0/2544216932 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c041020 con 0x7f9b9c0d3a30 2024-09-11T22:21:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.642+0000 7f9b92ffd640 1 -- 172.21.15.50:0/2544216932 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8c030970 con 0x7f9b9c0d3a30 2024-09-11T22:21:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.642+0000 7f9b92ffd640 1 -- 172.21.15.50:0/2544216932 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c037040 con 0x7f9b9c0d3a30 2024-09-11T22:21:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.642+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2544216932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b9c15a440 con 0x7f9b9c0d3a30 2024-09-11T22:21:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.642+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2544216932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b9c15aa00 con 0x7f9b9c0d3a30 2024-09-11T22:21:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.643+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2544216932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b9c0b78b0 con 0x7f9b9c0d3a30 2024-09-11T22:21:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.644+0000 7f9b92ffd640 1 -- 172.21.15.50:0/2544216932 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b8c044020 con 0x7f9b9c0d3a30 2024-09-11T22:21:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.644+0000 7f9b92ffd640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b8006be30 0x7f9b8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.644+0000 7f9b92ffd640 1 -- 172.21.15.50:0/2544216932 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f9b8c0ab810 con 0x7f9b9c0d3a30 2024-09-11T22:21:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.645+0000 7f9ba2559640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b8006be30 0x7f9b8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:55.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.645+0000 7f9ba2559640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b8006be30 0x7f9b8006e2f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0ce540 tx=0x7f9b98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:55.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.649+0000 7f9b92ffd640 1 -- 172.21.15.50:0/2544216932 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b8c04b030 con 0x7f9b9c0d3a30 2024-09-11T22:21:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:55.863+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2544216932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9b9c0cf840 con 0x7f9b9c0d3a30 2024-09-11T22:21:56.489 INFO:tasks.ceph.mds.b.smithi077.stderr:2024-09-11T22:21:56.488+0000 7ffb3e28d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:21:56.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.525+0000 7f9b92ffd640 1 -- 172.21.15.50:0/2544216932 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v120) ==== 122+0+0 (secure 0 0 0) 0x7f9b9c0cfa80 con 0x7f9b9c0d3a30 2024-09-11T22:21:56.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.527+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b8006be30 msgr2=0x7f9b8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:56.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.527+0000 7f9ba47bd640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b8006be30 0x7f9b8006e2f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0ce540 tx=0x7f9b98008040 comp rx=0 tx=0).stop 2024-09-11T22:21:56.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.527+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2544216932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b9c0d3a30 msgr2=0x7f9b9c1557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:56.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.527+0000 7f9ba47bd640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b9c0d3a30 0x7f9b9c1557e0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c000c00 tx=0x7f9b8c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.527+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2544216932 shutdown_connections 2024-09-11T22:21:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.527+0000 7f9ba47bd640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b8006be30 0x7f9b8006e2f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.527+0000 7f9ba47bd640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b9c15e870 0x7f9b9c158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.527+0000 7f9ba47bd640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b9c0d3a30 0x7f9b9c1557e0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.527+0000 7f9ba47bd640 1 --2- 172.21.15.50:0/2544216932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9c0d16d0 0x7f9b9c15b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.527+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2544216932 >> 172.21.15.50:0/2544216932 conn(0x7f9b9c0727a0 msgr2=0x7f9b9c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.527+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2544216932 shutdown_connections 2024-09-11T22:21:56.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.528+0000 7f9ba47bd640 1 -- 172.21.15.50:0/2544216932 wait complete. 2024-09-11T22:21:56.541 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:21:56.541 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:56.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.648+0000 7f1d48623640 1 Processor -- start 2024-09-11T22:21:56.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.648+0000 7f1d48623640 1 -- start start 2024-09-11T22:21:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.649+0000 7f1d48623640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d400d05e0 0x7f1d400b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.649+0000 7f1d48623640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1d400b3e10 0x7f1d400ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.649+0000 7f1d48623640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d400b4f00 con 0x7f1d4015c2c0 2024-09-11T22:21:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.649+0000 7f1d48623640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1d400b4360 con 0x7f1d400b3e10 2024-09-11T22:21:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.649+0000 7f1d48623640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1d400b51c0 con 0x7f1d400d05e0 2024-09-11T22:21:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.649+0000 7f1d46bc0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1d400b3e10 0x7f1d400ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.649+0000 7f1d45bbe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d400d05e0 0x7f1d400b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.649+0000 7f1d463bf640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1d4015c2c0 0x7f1d400cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:56374/0 (socket says 172.21.15.50:56374) 2024-09-11T22:21:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.649+0000 7f1d463bf640 1 -- 172.21.15.50:0/2241687393 learned_addr learned my addr 172.21.15.50:0/2241687393 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.649+0000 7f1d46bc0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1d400b3e10 0x7f1d400ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54030/0 (socket says 172.21.15.50:54030) 2024-09-11T22:21:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.650+0000 7f1d45bbe640 1 -- 172.21.15.50:0/2241687393 >> v2:172.21.15.77:3300/0 conn(0x7f1d400b3e10 msgr2=0x7f1d400ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.650+0000 7f1d45bbe640 1 --2- 172.21.15.50:0/2241687393 >> v2:172.21.15.77:3300/0 conn(0x7f1d400b3e10 0x7f1d400ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.650+0000 7f1d45bbe640 1 -- 172.21.15.50:0/2241687393 >> v1:172.21.15.77:6789/0 conn(0x7f1d4015c2c0 legacy=0x7f1d400cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.650+0000 7f1d45bbe640 1 -- 172.21.15.50:0/2241687393 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d400b54a0 con 0x7f1d400d05e0 2024-09-11T22:21:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.650+0000 7f1d453bd640 1 -- 172.21.15.50:0/2241687393 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1645179756 0 0) 0x7f1d400b4f00 con 0x7f1d4015c2c0 2024-09-11T22:21:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.650+0000 7f1d46bc0640 1 --2- 172.21.15.50:0/2241687393 >> v2:172.21.15.77:3300/0 conn(0x7f1d400b3e10 0x7f1d400ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.651+0000 7f1d45bbe640 1 --2- 172.21.15.50:0/2241687393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d400d05e0 0x7f1d400b46a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1d340097a0 tx=0x7f1d3402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4248e150f45e9d5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.651+0000 7f1d453bd640 1 -- 172.21.15.50:0/2241687393 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34037070 con 0x7f1d400d05e0 2024-09-11T22:21:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.651+0000 7f1d453bd640 1 -- 172.21.15.50:0/2241687393 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d34032440 con 0x7f1d400d05e0 2024-09-11T22:21:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.651+0000 7f1d453bd640 1 -- 172.21.15.50:0/2241687393 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34032810 con 0x7f1d400d05e0 2024-09-11T22:21:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.651+0000 7f1d48623640 1 -- 172.21.15.50:0/2241687393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d400d05e0 msgr2=0x7f1d400b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.651+0000 7f1d48623640 1 --2- 172.21.15.50:0/2241687393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d400d05e0 0x7f1d400b46a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1d340097a0 tx=0x7f1d3402a180 comp rx=0 tx=0).stop 2024-09-11T22:21:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.651+0000 7f1d48623640 1 -- 172.21.15.50:0/2241687393 shutdown_connections 2024-09-11T22:21:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.651+0000 7f1d48623640 1 --2- 172.21.15.50:0/2241687393 >> v2:172.21.15.77:3300/0 conn(0x7f1d400b3e10 0x7f1d400ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.651+0000 7f1d48623640 1 --2- 172.21.15.50:0/2241687393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d400d05e0 0x7f1d400b46a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.651+0000 7f1d48623640 1 -- 172.21.15.50:0/2241687393 >> 172.21.15.50:0/2241687393 conn(0x7f1d400679c0 msgr2=0x7f1d40067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.651+0000 7f1d48623640 1 -- 172.21.15.50:0/2241687393 shutdown_connections 2024-09-11T22:21:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.651+0000 7f1d48623640 1 -- 172.21.15.50:0/2241687393 wait complete. 2024-09-11T22:21:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.653+0000 7f1d48623640 1 Processor -- start 2024-09-11T22:21:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.653+0000 7f1d48623640 1 -- start start 2024-09-11T22:21:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.653+0000 7f1d48623640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d400b3e10 0x7f1d401524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.653+0000 7f1d48623640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d400d05e0 0x7f1d4014d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.653+0000 7f1d48623640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4015c2c0 0x7f1d400ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.653+0000 7f1d48623640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4006d070 con 0x7f1d4015c2c0 2024-09-11T22:21:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.653+0000 7f1d48623640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1d400ce200 con 0x7f1d400d05e0 2024-09-11T22:21:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.653+0000 7f1d48623640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4006d1f0 con 0x7f1d400b3e10 2024-09-11T22:21:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.653+0000 7f1d46bc0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4015c2c0 0x7f1d400ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d46bc0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4015c2c0 0x7f1d400ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59956/0 (socket says 172.21.15.50:59956) 2024-09-11T22:21:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d46bc0640 1 -- 172.21.15.50:0/1114091166 learned_addr learned my addr 172.21.15.50:0/1114091166 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d45bbe640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d400d05e0 0x7f1d4014d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d463bf640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d400b3e10 0x7f1d401524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d46bc0640 1 -- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d400b3e10 msgr2=0x7f1d401524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d46bc0640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d400b3e10 0x7f1d401524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d46bc0640 1 -- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d400d05e0 msgr2=0x7f1d4014d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d46bc0640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d400d05e0 0x7f1d4014d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d46bc0640 1 -- 172.21.15.50:0/1114091166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d400711d0 con 0x7f1d4015c2c0 2024-09-11T22:21:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d46bc0640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4015c2c0 0x7f1d400ae8c0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800e960 tx=0x7f1d3800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d3effd640 1 -- 172.21.15.50:0/1114091166 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38017070 con 0x7f1d4015c2c0 2024-09-11T22:21:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d3effd640 1 -- 172.21.15.50:0/1114091166 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d38004020 con 0x7f1d4015c2c0 2024-09-11T22:21:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d48623640 1 -- 172.21.15.50:0/1114091166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d40071470 con 0x7f1d4015c2c0 2024-09-11T22:21:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d3effd640 1 -- 172.21.15.50:0/1114091166 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380043f0 con 0x7f1d4015c2c0 2024-09-11T22:21:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.654+0000 7f1d48623640 1 -- 172.21.15.50:0/1114091166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d40071a30 con 0x7f1d4015c2c0 2024-09-11T22:21:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.655+0000 7f1d48623640 1 -- 172.21.15.50:0/1114091166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d40069e60 con 0x7f1d4015c2c0 2024-09-11T22:21:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.656+0000 7f1d3effd640 1 -- 172.21.15.50:0/1114091166 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d3800ca00 con 0x7f1d4015c2c0 2024-09-11T22:21:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.656+0000 7f1d3effd640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d2c06be30 0x7f1d2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.657+0000 7f1d3effd640 1 -- 172.21.15.50:0/1114091166 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f1d3808ac80 con 0x7f1d4015c2c0 2024-09-11T22:21:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.657+0000 7f1d463bf640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d2c06be30 0x7f1d2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.657+0000 7f1d463bf640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d2c06be30 0x7f1d2c06e2f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1d300012e0 tx=0x7f1d30001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.661+0000 7f1d3effd640 1 -- 172.21.15.50:0/1114091166 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d38058fe0 con 0x7f1d4015c2c0 2024-09-11T22:21:56.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.876+0000 7f1d48623640 1 -- 172.21.15.50:0/1114091166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d400ccb60 con 0x7f1d4015c2c0 2024-09-11T22:21:56.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.876+0000 7f1d3effd640 1 -- 172.21.15.50:0/1114091166 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5230 (secure 0 0 0) 0x7f1d3805d2e0 con 0x7f1d4015c2c0 2024-09-11T22:21:56.877 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:56.878 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":120,"btime":"2024-09-11T22:21:56:521160+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/521086958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":521086958},{"type":"v1","addr":"172.21.15.77:6835","nonce":521086958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9891,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2783375669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2783375669},{"type":"v1","addr":"172.21.15.50:6833","nonce":2783375669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2009878103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2009878103},{"type":"v1","addr":"172.21.15.50:6835","nonce":2009878103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:21:53.868957+0000","modified":"2024-09-11T22:21:55.865022+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9915":{"gid":9915,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2937331670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2937331670},{"type":"v1","addr":"172.21.15.77:6837","nonce":2937331670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9915,"qdb_cluster":[9915]},"id":12}]} 2024-09-11T22:21:56.878 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 120 2024-09-11T22:21:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.879+0000 7f1d48623640 1 -- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d2c06be30 msgr2=0x7f1d2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.879+0000 7f1d48623640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d2c06be30 0x7f1d2c06e2f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1d300012e0 tx=0x7f1d30001630 comp rx=0 tx=0).stop 2024-09-11T22:21:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.879+0000 7f1d48623640 1 -- 172.21.15.50:0/1114091166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4015c2c0 msgr2=0x7f1d400ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.879+0000 7f1d48623640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4015c2c0 0x7f1d400ae8c0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800e960 tx=0x7f1d3800ee20 comp rx=0 tx=0).stop 2024-09-11T22:21:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.879+0000 7f1d48623640 1 -- 172.21.15.50:0/1114091166 shutdown_connections 2024-09-11T22:21:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.879+0000 7f1d48623640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1d2c06be30 0x7f1d2c06e2f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.879+0000 7f1d48623640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d4015c2c0 0x7f1d400ae8c0 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.879+0000 7f1d48623640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d400d05e0 0x7f1d4014d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.879+0000 7f1d48623640 1 --2- 172.21.15.50:0/1114091166 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d400b3e10 0x7f1d401524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.879+0000 7f1d48623640 1 -- 172.21.15.50:0/1114091166 >> 172.21.15.50:0/1114091166 conn(0x7f1d400679c0 msgr2=0x7f1d400ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.879+0000 7f1d48623640 1 -- 172.21.15.50:0/1114091166 shutdown_connections 2024-09-11T22:21:56.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.879+0000 7f1d48623640 1 -- 172.21.15.50:0/1114091166 wait complete. 2024-09-11T22:21:56.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:21:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.992+0000 7f8471703640 1 Processor -- start 2024-09-11T22:21:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.992+0000 7f8471703640 1 -- start start 2024-09-11T22:21:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.993+0000 7f8471703640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f846c0cf580 0x7f846c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.993+0000 7f8471703640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f846c0ce5f0 con 0x7f846c0cdd50 2024-09-11T22:21:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.993+0000 7f8471703640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f846c0ce310 con 0x7f846c15e840 2024-09-11T22:21:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.993+0000 7f8471703640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f846c06c240 con 0x7f846c0cf580 2024-09-11T22:21:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.993+0000 7f846a7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f846c0cf580 0x7f846c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.993+0000 7f846b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f846c0cdd50 0x7f846c06c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54884/0 (socket says 172.21.15.50:54884) 2024-09-11T22:21:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.993+0000 7f846b7fe640 1 -- 172.21.15.50:0/1023266569 learned_addr learned my addr 172.21.15.50:0/1023266569 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.993+0000 7f846a7fc640 1 -- 172.21.15.50:0/1023266569 >> v1:172.21.15.77:6789/0 conn(0x7f846c15e840 legacy=0x7f846c0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.993+0000 7f846a7fc640 1 -- 172.21.15.50:0/1023266569 >> v1:172.21.15.50:6789/0 conn(0x7f846c0cdd50 legacy=0x7f846c06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.993+0000 7f846a7fc640 1 -- 172.21.15.50:0/1023266569 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846c06bbf0 con 0x7f846c0cf580 2024-09-11T22:21:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.993+0000 7f8469ffb640 1 -- 172.21.15.50:0/1023266569 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441922038 0 0) 0x7f846c0ce5f0 con 0x7f846c0cdd50 2024-09-11T22:21:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.994+0000 7f846a7fc640 1 --2- 172.21.15.50:0/1023266569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f846c0cf580 0x7f846c0b4c70 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f84600097a0 tx=0x7f846002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1d3f438bd52abc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.994+0000 7f8469ffb640 1 -- 172.21.15.50:0/1023266569 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460037070 con 0x7f846c0cf580 2024-09-11T22:21:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.994+0000 7f8469ffb640 1 -- 172.21.15.50:0/1023266569 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8460032440 con 0x7f846c0cf580 2024-09-11T22:21:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.994+0000 7f8469ffb640 1 -- 172.21.15.50:0/1023266569 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460032810 con 0x7f846c0cf580 2024-09-11T22:21:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.995+0000 7f8471703640 1 -- 172.21.15.50:0/1023266569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f846c0cf580 msgr2=0x7f846c0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.995+0000 7f8471703640 1 --2- 172.21.15.50:0/1023266569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f846c0cf580 0x7f846c0b4c70 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f84600097a0 tx=0x7f846002a230 comp rx=0 tx=0).stop 2024-09-11T22:21:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.995+0000 7f8471703640 1 -- 172.21.15.50:0/1023266569 shutdown_connections 2024-09-11T22:21:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.995+0000 7f8471703640 1 --2- 172.21.15.50:0/1023266569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f846c0cf580 0x7f846c0b4c70 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.995+0000 7f8471703640 1 -- 172.21.15.50:0/1023266569 >> 172.21.15.50:0/1023266569 conn(0x7f846c0b4150 msgr2=0x7f846c0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:56.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.995+0000 7f8471703640 1 -- 172.21.15.50:0/1023266569 shutdown_connections 2024-09-11T22:21:56.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.995+0000 7f8471703640 1 -- 172.21.15.50:0/1023266569 wait complete. 2024-09-11T22:21:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.996+0000 7f8471703640 1 Processor -- start 2024-09-11T22:21:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.996+0000 7f8471703640 1 -- start start 2024-09-11T22:21:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f8471703640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f846c0cdd50 0x7f846c158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f8471703640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f846c0cf580 0x7f846c0b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f8471703640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f846c15e840 0x7f846c0cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f8471703640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f846c15ec20 con 0x7f846c0cf580 2024-09-11T22:21:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f8471703640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f846c0d0470 con 0x7f846c15e840 2024-09-11T22:21:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f8471703640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f846c15eda0 con 0x7f846c0cdd50 2024-09-11T22:21:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f846a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f846c0cf580 0x7f846c0b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f846a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f846c0cf580 0x7f846c0b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59968/0 (socket says 172.21.15.50:59968) 2024-09-11T22:21:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f846a7fc640 1 -- 172.21.15.50:0/4256692035 learned_addr learned my addr 172.21.15.50:0/4256692035 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:56.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f846b7fe640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f846c15e840 0x7f846c0cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f846affd640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f846c0cdd50 0x7f846c158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f846a7fc640 1 -- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f846c0cdd50 msgr2=0x7f846c158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f846a7fc640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f846c0cdd50 0x7f846c158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f846a7fc640 1 -- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f846c15e840 msgr2=0x7f846c0cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f846a7fc640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f846c15e840 0x7f846c0cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f846a7fc640 1 -- 172.21.15.50:0/4256692035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846c0b6cb0 con 0x7f846c0cf580 2024-09-11T22:21:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.997+0000 7f846affd640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f846c0cdd50 0x7f846c158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.998+0000 7f846a7fc640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f846c0cf580 0x7f846c0b1a80 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f8460035040 tx=0x7f84600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.998+0000 7f84537fe640 1 -- 172.21.15.50:0/4256692035 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460037040 con 0x7f846c0cf580 2024-09-11T22:21:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.998+0000 7f84537fe640 1 -- 172.21.15.50:0/4256692035 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8460030770 con 0x7f846c0cf580 2024-09-11T22:21:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.998+0000 7f84537fe640 1 -- 172.21.15.50:0/4256692035 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460030b80 con 0x7f846c0cf580 2024-09-11T22:21:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.998+0000 7f8471703640 1 -- 172.21.15.50:0/4256692035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846c0b6410 con 0x7f846c0cf580 2024-09-11T22:21:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.998+0000 7f8471703640 1 -- 172.21.15.50:0/4256692035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f846c0b69d0 con 0x7f846c0cf580 2024-09-11T22:21:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.999+0000 7f8471703640 1 -- 172.21.15.50:0/4256692035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f846c075770 con 0x7f846c0cf580 2024-09-11T22:21:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:56.999+0000 7f84537fe640 1 -- 172.21.15.50:0/4256692035 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8460044020 con 0x7f846c0cf580 2024-09-11T22:21:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.000+0000 7f84537fe640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f845806be30 0x7f845806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.000+0000 7f84537fe640 1 -- 172.21.15.50:0/4256692035 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f84600ab3f0 con 0x7f846c0cf580 2024-09-11T22:21:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.000+0000 7f846affd640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f845806be30 0x7f845806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.001+0000 7f846affd640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f845806be30 0x7f845806e2f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f846c159ad0 tx=0x7f845c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:57.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.004+0000 7f84537fe640 1 -- 172.21.15.50:0/4256692035 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8460032e20 con 0x7f846c0cf580 2024-09-11T22:21:57.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.182+0000 7f8471703640 1 -- 172.21.15.50:0/4256692035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f846c0ce5f0 con 0x7f846c0cf580 2024-09-11T22:21:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.183+0000 7f84537fe640 1 -- 172.21.15.50:0/4256692035 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+16703 (secure 0 0 0) 0x7f8460079da0 con 0x7f846c0cf580 2024-09-11T22:21:57.184 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:57.184 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":167,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:21:55.500323+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:21:51.564535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-11T22:21:52.850719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:21:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.185+0000 7f8471703640 1 -- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f845806be30 msgr2=0x7f845806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.185+0000 7f8471703640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f845806be30 0x7f845806e2f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f846c159ad0 tx=0x7f845c009040 comp rx=0 tx=0).stop 2024-09-11T22:21:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.185+0000 7f8471703640 1 -- 172.21.15.50:0/4256692035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f846c0cf580 msgr2=0x7f846c0b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.185+0000 7f8471703640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f846c0cf580 0x7f846c0b1a80 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f8460035040 tx=0x7f84600046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.185+0000 7f8471703640 1 -- 172.21.15.50:0/4256692035 shutdown_connections 2024-09-11T22:21:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.185+0000 7f8471703640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f845806be30 0x7f845806e2f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.185+0000 7f8471703640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f846c15e840 0x7f846c0cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.185+0000 7f8471703640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f846c0cf580 0x7f846c0b1a80 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.185+0000 7f8471703640 1 --2- 172.21.15.50:0/4256692035 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f846c0cdd50 0x7f846c158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.185+0000 7f8471703640 1 -- 172.21.15.50:0/4256692035 >> 172.21.15.50:0/4256692035 conn(0x7f846c0b4150 msgr2=0x7f846c070ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.185+0000 7f8471703640 1 -- 172.21.15.50:0/4256692035 shutdown_connections 2024-09-11T22:21:57.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.185+0000 7f8471703640 1 -- 172.21.15.50:0/4256692035 wait complete. 2024-09-11T22:21:57.197 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:21:57.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:21:57.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.299+0000 7f1ae3dc4640 1 Processor -- start 2024-09-11T22:21:57.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.299+0000 7f1ae3dc4640 1 -- start start 2024-09-11T22:21:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.300+0000 7f1ae3dc4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1adc15e840 0x7f1adc0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.300+0000 7f1ae3dc4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1adc0cdd50 0x7f1adc0cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.300+0000 7f1ae3dc4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1adc0cf3b0 0x7f1adc0d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.300+0000 7f1ae3dc4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1adc06c240 con 0x7f1adc0cf3b0 2024-09-11T22:21:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.300+0000 7f1ae3dc4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1adc0d0470 con 0x7f1adc15e840 2024-09-11T22:21:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.300+0000 7f1ae3dc4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1adc0ce5f0 con 0x7f1adc0cdd50 2024-09-11T22:21:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.300+0000 7f1ae2361640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1adc0cf3b0 0x7f1adc0d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.300+0000 7f1ae2361640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1adc0cf3b0 0x7f1adc0d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59970/0 (socket says 172.21.15.50:59970) 2024-09-11T22:21:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.300+0000 7f1ae2361640 1 -- 172.21.15.50:0/2460243735 learned_addr learned my addr 172.21.15.50:0/2460243735 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.300+0000 7f1ae1b60640 1 --2- 172.21.15.50:0/2460243735 >> v2:172.21.15.77:3300/0 conn(0x7f1adc15e840 0x7f1adc0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.300+0000 7f1ae135f640 1 --2- 172.21.15.50:0/2460243735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1adc0cdd50 0x7f1adc0cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.301+0000 7f1ae2361640 1 -- 172.21.15.50:0/2460243735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1adc0cdd50 msgr2=0x7f1adc0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.301+0000 7f1ae2361640 1 --2- 172.21.15.50:0/2460243735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1adc0cdd50 0x7f1adc0cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.301+0000 7f1ae2361640 1 -- 172.21.15.50:0/2460243735 >> v2:172.21.15.77:3300/0 conn(0x7f1adc15e840 msgr2=0x7f1adc0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.301+0000 7f1ae2361640 1 --2- 172.21.15.50:0/2460243735 >> v2:172.21.15.77:3300/0 conn(0x7f1adc15e840 0x7f1adc0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.301+0000 7f1ae2361640 1 -- 172.21.15.50:0/2460243735 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc0ce310 con 0x7f1adc0cf3b0 2024-09-11T22:21:57.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.301+0000 7f1ae2361640 1 --2- 172.21.15.50:0/2460243735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc0cf3b0 0x7f1adc0d0710 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009870 tx=0x7f1ad402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef101450d50f19c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:57.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.301+0000 7f1ae0b5e640 1 -- 172.21.15.50:0/2460243735 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4037070 con 0x7f1adc0cf3b0 2024-09-11T22:21:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.301+0000 7f1ae0b5e640 1 -- 172.21.15.50:0/2460243735 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad4032440 con 0x7f1adc0cf3b0 2024-09-11T22:21:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.302+0000 7f1ae0b5e640 1 -- 172.21.15.50:0/2460243735 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4032810 con 0x7f1adc0cf3b0 2024-09-11T22:21:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.302+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/2460243735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc0cf3b0 msgr2=0x7f1adc0d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.302+0000 7f1ae3dc4640 1 --2- 172.21.15.50:0/2460243735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc0cf3b0 0x7f1adc0d0710 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009870 tx=0x7f1ad402a210 comp rx=0 tx=0).stop 2024-09-11T22:21:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.302+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/2460243735 shutdown_connections 2024-09-11T22:21:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.302+0000 7f1ae3dc4640 1 --2- 172.21.15.50:0/2460243735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc0cf3b0 0x7f1adc0d0710 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.302+0000 7f1ae3dc4640 1 --2- 172.21.15.50:0/2460243735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1adc0cdd50 0x7f1adc0cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.302+0000 7f1ae3dc4640 1 --2- 172.21.15.50:0/2460243735 >> v2:172.21.15.77:3300/0 conn(0x7f1adc15e840 0x7f1adc0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.302+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/2460243735 >> 172.21.15.50:0/2460243735 conn(0x7f1adc0b4150 msgr2=0x7f1adc0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.302+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/2460243735 shutdown_connections 2024-09-11T22:21:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.302+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/2460243735 wait complete. 2024-09-11T22:21:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.303+0000 7f1ae3dc4640 1 Processor -- start 2024-09-11T22:21:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.303+0000 7f1ae3dc4640 1 -- start start 2024-09-11T22:21:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.304+0000 7f1ae3dc4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc0cdd50 0x7f1adc14c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.304+0000 7f1ae3dc4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1adc0cf3b0 0x7f1adc0b7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.304+0000 7f1ae3dc4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1adc15e840 0x7f1adc15bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.304+0000 7f1ae3dc4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc15ec20 con 0x7f1adc0cdd50 2024-09-11T22:21:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.304+0000 7f1ae3dc4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc06bed0 con 0x7f1adc0cf3b0 2024-09-11T22:21:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.304+0000 7f1ae3dc4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1adc15eda0 con 0x7f1adc15e840 2024-09-11T22:21:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.304+0000 7f1ae1b60640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc0cdd50 0x7f1adc14c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.304+0000 7f1ae1b60640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc0cdd50 0x7f1adc14c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59972/0 (socket says 172.21.15.50:59972) 2024-09-11T22:21:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.304+0000 7f1ae1b60640 1 -- 172.21.15.50:0/419365073 learned_addr learned my addr 172.21.15.50:0/419365073 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.305+0000 7f1ae2361640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1adc15e840 0x7f1adc15bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.304+0000 7f1ae1b60640 1 -- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1adc15e840 msgr2=0x7f1adc15bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.305+0000 7f1ae135f640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1adc0cf3b0 0x7f1adc0b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.305+0000 7f1ae1b60640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1adc15e840 0x7f1adc15bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.305+0000 7f1ae1b60640 1 -- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1adc0cf3b0 msgr2=0x7f1adc0b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.305+0000 7f1ae1b60640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1adc0cf3b0 0x7f1adc0b7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.305+0000 7f1ae1b60640 1 -- 172.21.15.50:0/419365073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc14cf00 con 0x7f1adc0cdd50 2024-09-11T22:21:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.305+0000 7f1ae1b60640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc0cdd50 0x7f1adc14c9c0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800efc0 tx=0x7f1ad800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.305+0000 7f1ad27fc640 1 -- 172.21.15.50:0/419365073 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8018020 con 0x7f1adc0cdd50 2024-09-11T22:21:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.305+0000 7f1ad27fc640 1 -- 172.21.15.50:0/419365073 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad8014480 con 0x7f1adc0cdd50 2024-09-11T22:21:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.305+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/419365073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc0b7b60 con 0x7f1adc0cdd50 2024-09-11T22:21:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.305+0000 7f1ad27fc640 1 -- 172.21.15.50:0/419365073 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8014850 con 0x7f1adc0cdd50 2024-09-11T22:21:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.305+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/419365073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc14d1e0 con 0x7f1adc0cdd50 2024-09-11T22:21:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.306+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/419365073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1adc0cee70 con 0x7f1adc0cdd50 2024-09-11T22:21:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.307+0000 7f1ad27fc640 1 -- 172.21.15.50:0/419365073 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ad8005d10 con 0x7f1adc0cdd50 2024-09-11T22:21:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.307+0000 7f1ad27fc640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ac006be30 0x7f1ac006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.307+0000 7f1ad27fc640 1 -- 172.21.15.50:0/419365073 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f1ad808b9d0 con 0x7f1adc0cdd50 2024-09-11T22:21:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.307+0000 7f1ae135f640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ac006be30 0x7f1ac006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.308+0000 7f1ae135f640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ac006be30 0x7f1ac006e2f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1adc06d3c0 tx=0x7f1acc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:57.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.312+0000 7f1ad27fc640 1 -- 172.21.15.50:0/419365073 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ad8022070 con 0x7f1adc0cdd50 2024-09-11T22:21:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.483+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/419365073 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1adc0b7850 con 0x7f1ac006be30 2024-09-11T22:21:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.489+0000 7f1ad27fc640 1 -- 172.21.15.50:0/419365073 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244275 (secure 0 0 0) 0x7f1adc0b7850 con 0x7f1ac006be30 2024-09-11T22:21:57.493 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:21:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.492+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ac006be30 msgr2=0x7f1ac006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.492+0000 7f1ae3dc4640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ac006be30 0x7f1ac006e2f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1adc06d3c0 tx=0x7f1acc008040 comp rx=0 tx=0).stop 2024-09-11T22:21:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.492+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/419365073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc0cdd50 msgr2=0x7f1adc14c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.492+0000 7f1ae3dc4640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc0cdd50 0x7f1adc14c9c0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800efc0 tx=0x7f1ad800c490 comp rx=0 tx=0).stop 2024-09-11T22:21:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.492+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/419365073 shutdown_connections 2024-09-11T22:21:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.492+0000 7f1ae3dc4640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1ac006be30 0x7f1ac006e2f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.492+0000 7f1ae3dc4640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1adc15e840 0x7f1adc15bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.492+0000 7f1ae3dc4640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1adc0cf3b0 0x7f1adc0b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.492+0000 7f1ae3dc4640 1 --2- 172.21.15.50:0/419365073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc0cdd50 0x7f1adc14c9c0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.492+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/419365073 >> 172.21.15.50:0/419365073 conn(0x7f1adc0b4150 msgr2=0x7f1adc0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.492+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/419365073 shutdown_connections 2024-09-11T22:21:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.492+0000 7f1ae3dc4640 1 -- 172.21.15.50:0/419365073 wait complete. 2024-09-11T22:21:57.503 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-09-11T22:21:55.518898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":144,"acting":144,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":431952,"kb_used_data":17236,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754542768,"statfs":{"total":773094113280,"available":772651794432,"internally_reserved":0,"allocated":17649664,"data_stored":8398393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":424463921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000701"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:53.492779+0000","last_change":"2024-09-11T22:21:53.492779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.492779+0000","last_undegraded":"2024-09-11T22:21:53.492779+0000","last_fullsized":"2024-09-11T22:21:53.492779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507816+0000","last_change":"2024-09-11T22:21:53.507816+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507816+0000","last_undegraded":"2024-09-11T22:21:53.507816+0000","last_fullsized":"2024-09-11T22:21:53.507816+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.509597+0000","last_change":"2024-09-11T22:21:53.509597+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.509597+0000","last_undegraded":"2024-09-11T22:21:53.509597+0000","last_fullsized":"2024-09-11T22:21:53.509597+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507367+0000","last_change":"2024-09-11T22:21:53.507367+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507367+0000","last_undegraded":"2024-09-11T22:21:53.507367+0000","last_fullsized":"2024-09-11T22:21:53.507367+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:53.492779+0000","last_change":"2024-09-11T22:21:53.492779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.492779+0000","last_undegraded":"2024-09-11T22:21:53.492779+0000","last_fullsized":"2024-09-11T22:21:53.492779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.509168+0000","last_change":"2024-09-11T22:21:53.509168+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.509168+0000","last_undegraded":"2024-09-11T22:21:53.509168+0000","last_fullsized":"2024-09-11T22:21:53.509168+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501927+0000","last_change":"2024-09-11T22:21:53.501927+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501927+0000","last_undegraded":"2024-09-11T22:21:53.501927+0000","last_fullsized":"2024-09-11T22:21:53.501927+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506479+0000","last_change":"2024-09-11T22:21:53.506479+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506479+0000","last_undegraded":"2024-09-11T22:21:53.506479+0000","last_fullsized":"2024-09-11T22:21:53.506479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502071+0000","last_change":"2024-09-11T22:21:53.502071+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502071+0000","last_undegraded":"2024-09-11T22:21:53.502071+0000","last_fullsized":"2024-09-11T22:21:53.502071+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506510+0000","last_change":"2024-09-11T22:21:53.506510+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506510+0000","last_undegraded":"2024-09-11T22:21:53.506510+0000","last_fullsized":"2024-09-11T22:21:53.506510+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502130+0000","last_change":"2024-09-11T22:21:53.502130+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502130+0000","last_undegraded":"2024-09-11T22:21:53.502130+0000","last_fullsized":"2024-09-11T22:21:53.502130+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506958+0000","last_change":"2024-09-11T22:21:53.506958+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506958+0000","last_undegraded":"2024-09-11T22:21:53.506958+0000","last_fullsized":"2024-09-11T22:21:53.506958+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505523+0000","last_change":"2024-09-11T22:21:53.505523+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505523+0000","last_undegraded":"2024-09-11T22:21:53.505523+0000","last_fullsized":"2024-09-11T22:21:53.505523+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504093+0000","last_change":"2024-09-11T22:21:53.504093+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504093+0000","last_undegraded":"2024-09-11T22:21:53.504093+0000","last_fullsized":"2024-09-11T22:21:53.504093+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506839+0000","last_change":"2024-09-11T22:21:53.506839+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506839+0000","last_undegraded":"2024-09-11T22:21:53.506839+0000","last_fullsized":"2024-09-11T22:21:53.506839+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505949+0000","last_change":"2024-09-11T22:21:53.505949+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505949+0000","last_undegraded":"2024-09-11T22:21:53.505949+0000","last_fullsized":"2024-09-11T22:21:53.505949+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:53.492779+0000","last_change":"2024-09-11T22:21:53.492779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.492779+0000","last_undegraded":"2024-09-11T22:21:53.492779+0000","last_fullsized":"2024-09-11T22:21:53.492779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:53.492779+0000","last_change":"2024-09-11T22:21:53.492779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.492779+0000","last_undegraded":"2024-09-11T22:21:53.492779+0000","last_fullsized":"2024-09-11T22:21:53.492779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507045+0000","last_change":"2024-09-11T22:21:53.507045+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507045+0000","last_undegraded":"2024-09-11T22:21:53.507045+0000","last_fullsized":"2024-09-11T22:21:53.507045+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:53.492779+0000","last_change":"2024-09-11T22:21:53.492779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.492779+0000","last_undegraded":"2024-09-11T22:21:53.492779+0000","last_fullsized":"2024-09-11T22:21:53.492779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:53.492779+0000","last_change":"2024-09-11T22:21:53.492779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.492779+0000","last_undegraded":"2024-09-11T22:21:53.492779+0000","last_fullsized":"2024-09-11T22:21:53.492779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507747+0000","last_change":"2024-09-11T22:21:53.507747+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507747+0000","last_undegraded":"2024-09-11T22:21:53.507747+0000","last_fullsized":"2024-09-11T22:21:53.507747+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.508697+0000","last_change":"2024-09-11T22:21:53.508697+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.508697+0000","last_undegraded":"2024-09-11T22:21:53.508697+0000","last_fullsized":"2024-09-11T22:21:53.508697+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505388+0000","last_change":"2024-09-11T22:21:53.505388+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505388+0000","last_undegraded":"2024-09-11T22:21:53.505388+0000","last_fullsized":"2024-09-11T22:21:53.505388+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504874+0000","last_change":"2024-09-11T22:21:53.504874+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504874+0000","last_undegraded":"2024-09-11T22:21:53.504874+0000","last_fullsized":"2024-09-11T22:21:53.504874+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501814+0000","last_change":"2024-09-11T22:21:53.501814+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501814+0000","last_undegraded":"2024-09-11T22:21:53.501814+0000","last_fullsized":"2024-09-11T22:21:53.501814+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.508195+0000","last_change":"2024-09-11T22:21:53.508195+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.508195+0000","last_undegraded":"2024-09-11T22:21:53.508195+0000","last_fullsized":"2024-09-11T22:21:53.508195+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:53.492779+0000","last_change":"2024-09-11T22:21:53.492779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.492779+0000","last_undegraded":"2024-09-11T22:21:53.492779+0000","last_fullsized":"2024-09-11T22:21:53.492779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504891+0000","last_change":"2024-09-11T22:21:53.504891+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504891+0000","last_undegraded":"2024-09-11T22:21:53.504891+0000","last_fullsized":"2024-09-11T22:21:53.504891+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503691+0000","last_change":"2024-09-11T22:21:53.503691+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503691+0000","last_undegraded":"2024-09-11T22:21:53.503691+0000","last_fullsized":"2024-09-11T22:21:53.503691+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507644+0000","last_change":"2024-09-11T22:21:53.507644+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507644+0000","last_undegraded":"2024-09-11T22:21:53.507644+0000","last_fullsized":"2024-09-11T22:21:53.507644+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:53.492779+0000","last_change":"2024-09-11T22:21:53.492779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.492779+0000","last_undegraded":"2024-09-11T22:21:53.492779+0000","last_fullsized":"2024-09-11T22:21:53.492779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505391+0000","last_change":"2024-09-11T22:21:53.505391+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505391+0000","last_undegraded":"2024-09-11T22:21:53.505391+0000","last_fullsized":"2024-09-11T22:21:53.505391+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:52.487001+0000","last_change":"2024-09-11T22:21:52.487001+0000","last_active":"2024-09-11T22:21:52.487001+0000","last_peered":"2024-09-11T22:21:52.487001+0000","last_clean":"2024-09-11T22:21:52.487001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:52.487001+0000","last_undegraded":"2024-09-11T22:21:52.487001+0000","last_fullsized":"2024-09-11T22:21:52.487001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505972+0000","last_change":"2024-09-11T22:21:53.505972+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505972+0000","last_undegraded":"2024-09-11T22:21:53.505972+0000","last_fullsized":"2024-09-11T22:21:53.505972+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.514976+0000","last_change":"2024-09-11T22:21:53.513909+0000","last_active":"2024-09-11T22:21:53.514976+0000","last_peered":"2024-09-11T22:21:53.514976+0000","last_clean":"2024-09-11T22:21:53.514976+0000","last_became_active":"2024-09-11T22:21:53.513485+0000","last_became_peered":"2024-09-11T22:21:53.513485+0000","last_unstale":"2024-09-11T22:21:53.514976+0000","last_undegraded":"2024-09-11T22:21:53.514976+0000","last_fullsized":"2024-09-11T22:21:53.514976+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:21.887542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503309+0000","last_change":"2024-09-11T22:21:53.503309+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503309+0000","last_undegraded":"2024-09-11T22:21:53.503309+0000","last_fullsized":"2024-09-11T22:21:53.503309+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.522546+0000","last_change":"2024-09-11T22:21:53.521872+0000","last_active":"2024-09-11T22:21:53.522546+0000","last_peered":"2024-09-11T22:21:53.522546+0000","last_clean":"2024-09-11T22:21:53.522546+0000","last_became_active":"2024-09-11T22:21:53.520880+0000","last_became_peered":"2024-09-11T22:21:53.520880+0000","last_unstale":"2024-09-11T22:21:53.522546+0000","last_undegraded":"2024-09-11T22:21:53.522546+0000","last_fullsized":"2024-09-11T22:21:53.522546+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:05:35.606832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501517+0000","last_change":"2024-09-11T22:21:53.501517+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501517+0000","last_undegraded":"2024-09-11T22:21:53.501517+0000","last_fullsized":"2024-09-11T22:21:53.501517+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.515650+0000","last_change":"2024-09-11T22:21:53.515134+0000","last_active":"2024-09-11T22:21:53.515650+0000","last_peered":"2024-09-11T22:21:53.515650+0000","last_clean":"2024-09-11T22:21:53.515650+0000","last_became_active":"2024-09-11T22:21:53.514736+0000","last_became_peered":"2024-09-11T22:21:53.514736+0000","last_unstale":"2024-09-11T22:21:53.515650+0000","last_undegraded":"2024-09-11T22:21:53.515650+0000","last_fullsized":"2024-09-11T22:21:53.515650+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:03.561959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507027+0000","last_change":"2024-09-11T22:21:53.507027+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507027+0000","last_undegraded":"2024-09-11T22:21:53.507027+0000","last_fullsized":"2024-09-11T22:21:53.507027+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:52.487001+0000","last_change":"2024-09-11T22:21:52.487001+0000","last_active":"2024-09-11T22:21:52.487001+0000","last_peered":"2024-09-11T22:21:52.487001+0000","last_clean":"2024-09-11T22:21:52.487001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:52.487001+0000","last_undegraded":"2024-09-11T22:21:52.487001+0000","last_fullsized":"2024-09-11T22:21:52.487001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503779+0000","last_change":"2024-09-11T22:21:53.503779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503779+0000","last_undegraded":"2024-09-11T22:21:53.503779+0000","last_fullsized":"2024-09-11T22:21:53.503779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.512839+0000","last_change":"2024-09-11T22:21:53.511743+0000","last_active":"2024-09-11T22:21:53.512839+0000","last_peered":"2024-09-11T22:21:53.512839+0000","last_clean":"2024-09-11T22:21:53.512839+0000","last_became_active":"2024-09-11T22:21:53.511450+0000","last_became_peered":"2024-09-11T22:21:53.511450+0000","last_unstale":"2024-09-11T22:21:53.512839+0000","last_undegraded":"2024-09-11T22:21:53.512839+0000","last_fullsized":"2024-09-11T22:21:53.512839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:39.080926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501342+0000","last_change":"2024-09-11T22:21:53.501342+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501342+0000","last_undegraded":"2024-09-11T22:21:53.501342+0000","last_fullsized":"2024-09-11T22:21:53.501342+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:52.487001+0000","last_change":"2024-09-11T22:21:52.487001+0000","last_active":"2024-09-11T22:21:52.487001+0000","last_peered":"2024-09-11T22:21:52.487001+0000","last_clean":"2024-09-11T22:21:52.487001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:52.487001+0000","last_undegraded":"2024-09-11T22:21:52.487001+0000","last_fullsized":"2024-09-11T22:21:52.487001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507605+0000","last_change":"2024-09-11T22:21:53.507605+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507605+0000","last_undegraded":"2024-09-11T22:21:53.507605+0000","last_fullsized":"2024-09-11T22:21:53.507605+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.509960+0000","last_change":"2024-09-11T22:21:53.507631+0000","last_active":"2024-09-11T22:21:53.509960+0000","last_peered":"2024-09-11T22:21:53.509960+0000","last_clean":"2024-09-11T22:21:53.509960+0000","last_became_active":"2024-09-11T22:21:53.507356+0000","last_became_peered":"2024-09-11T22:21:53.507356+0000","last_unstale":"2024-09-11T22:21:53.509960+0000","last_undegraded":"2024-09-11T22:21:53.509960+0000","last_fullsized":"2024-09-11T22:21:53.509960+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:11.081873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504179+0000","last_change":"2024-09-11T22:21:53.504179+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504179+0000","last_undegraded":"2024-09-11T22:21:53.504179+0000","last_fullsized":"2024-09-11T22:21:53.504179+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:52.487001+0000","last_change":"2024-09-11T22:21:52.487001+0000","last_active":"2024-09-11T22:21:52.487001+0000","last_peered":"2024-09-11T22:21:52.487001+0000","last_clean":"2024-09-11T22:21:52.487001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:52.487001+0000","last_undegraded":"2024-09-11T22:21:52.487001+0000","last_fullsized":"2024-09-11T22:21:52.487001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502888+0000","last_change":"2024-09-11T22:21:53.502888+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502888+0000","last_undegraded":"2024-09-11T22:21:53.502888+0000","last_fullsized":"2024-09-11T22:21:53.502888+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:52.487001+0000","last_change":"2024-09-11T22:21:52.487001+0000","last_active":"2024-09-11T22:21:52.487001+0000","last_peered":"2024-09-11T22:21:52.487001+0000","last_clean":"2024-09-11T22:21:52.487001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:52.487001+0000","last_undegraded":"2024-09-11T22:21:52.487001+0000","last_fullsized":"2024-09-11T22:21:52.487001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506454+0000","last_change":"2024-09-11T22:21:53.506454+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506454+0000","last_undegraded":"2024-09-11T22:21:53.506454+0000","last_fullsized":"2024-09-11T22:21:53.506454+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.515735+0000","last_change":"2024-09-11T22:21:53.514233+0000","last_active":"2024-09-11T22:21:53.515735+0000","last_peered":"2024-09-11T22:21:53.515735+0000","last_clean":"2024-09-11T22:21:53.515735+0000","last_became_active":"2024-09-11T22:21:53.512269+0000","last_became_peered":"2024-09-11T22:21:53.512269+0000","last_unstale":"2024-09-11T22:21:53.515735+0000","last_undegraded":"2024-09-11T22:21:53.515735+0000","last_fullsized":"2024-09-11T22:21:53.515735+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:52.562386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507601+0000","last_change":"2024-09-11T22:21:53.507601+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507601+0000","last_undegraded":"2024-09-11T22:21:53.507601+0000","last_fullsized":"2024-09-11T22:21:53.507601+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:52.487001+0000","last_change":"2024-09-11T22:21:52.487001+0000","last_active":"2024-09-11T22:21:52.487001+0000","last_peered":"2024-09-11T22:21:52.487001+0000","last_clean":"2024-09-11T22:21:52.487001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:52.487001+0000","last_undegraded":"2024-09-11T22:21:52.487001+0000","last_fullsized":"2024-09-11T22:21:52.487001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502957+0000","last_change":"2024-09-11T22:21:53.502957+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502957+0000","last_undegraded":"2024-09-11T22:21:53.502957+0000","last_fullsized":"2024-09-11T22:21:53.502957+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.521489+0000","last_change":"2024-09-11T22:21:53.517900+0000","last_active":"2024-09-11T22:21:53.521489+0000","last_peered":"2024-09-11T22:21:53.521489+0000","last_clean":"2024-09-11T22:21:53.521489+0000","last_became_active":"2024-09-11T22:21:53.517606+0000","last_became_peered":"2024-09-11T22:21:53.517606+0000","last_unstale":"2024-09-11T22:21:53.521489+0000","last_undegraded":"2024-09-11T22:21:53.521489+0000","last_fullsized":"2024-09-11T22:21:53.521489+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:49.422032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503384+0000","last_change":"2024-09-11T22:21:53.503384+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503384+0000","last_undegraded":"2024-09-11T22:21:53.503384+0000","last_fullsized":"2024-09-11T22:21:53.503384+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.512802+0000","last_change":"2024-09-11T22:21:53.511206+0000","last_active":"2024-09-11T22:21:53.512802+0000","last_peered":"2024-09-11T22:21:53.512802+0000","last_clean":"2024-09-11T22:21:53.512802+0000","last_became_active":"2024-09-11T22:21:53.510917+0000","last_became_peered":"2024-09-11T22:21:53.510917+0000","last_unstale":"2024-09-11T22:21:53.512802+0000","last_undegraded":"2024-09-11T22:21:53.512802+0000","last_fullsized":"2024-09-11T22:21:53.512802+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:33.324721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506421+0000","last_change":"2024-09-11T22:21:53.506421+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506421+0000","last_undegraded":"2024-09-11T22:21:53.506421+0000","last_fullsized":"2024-09-11T22:21:53.506421+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:52.487001+0000","last_change":"2024-09-11T22:21:52.487001+0000","last_active":"2024-09-11T22:21:52.487001+0000","last_peered":"2024-09-11T22:21:52.487001+0000","last_clean":"2024-09-11T22:21:52.487001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:52.487001+0000","last_undegraded":"2024-09-11T22:21:52.487001+0000","last_fullsized":"2024-09-11T22:21:52.487001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505255+0000","last_change":"2024-09-11T22:21:53.505255+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505255+0000","last_undegraded":"2024-09-11T22:21:53.505255+0000","last_fullsized":"2024-09-11T22:21:53.505255+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:52.487001+0000","last_change":"2024-09-11T22:21:52.487001+0000","last_active":"2024-09-11T22:21:52.487001+0000","last_peered":"2024-09-11T22:21:52.487001+0000","last_clean":"2024-09-11T22:21:52.487001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:52.487001+0000","last_undegraded":"2024-09-11T22:21:52.487001+0000","last_fullsized":"2024-09-11T22:21:52.487001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501498+0000","last_change":"2024-09-11T22:21:53.501498+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501498+0000","last_undegraded":"2024-09-11T22:21:53.501498+0000","last_fullsized":"2024-09-11T22:21:53.501498+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.510561+0000","last_change":"2024-09-11T22:21:53.509336+0000","last_active":"2024-09-11T22:21:53.510561+0000","last_peered":"2024-09-11T22:21:53.510561+0000","last_clean":"2024-09-11T22:21:53.510561+0000","last_became_active":"2024-09-11T22:21:53.509033+0000","last_became_peered":"2024-09-11T22:21:53.509033+0000","last_unstale":"2024-09-11T22:21:53.510561+0000","last_undegraded":"2024-09-11T22:21:53.510561+0000","last_fullsized":"2024-09-11T22:21:53.510561+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:37.593441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502623+0000","last_change":"2024-09-11T22:21:53.502623+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502623+0000","last_undegraded":"2024-09-11T22:21:53.502623+0000","last_fullsized":"2024-09-11T22:21:53.502623+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:52.487001+0000","last_change":"2024-09-11T22:21:52.487001+0000","last_active":"2024-09-11T22:21:52.487001+0000","last_peered":"2024-09-11T22:21:52.487001+0000","last_clean":"2024-09-11T22:21:52.487001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:52.487001+0000","last_undegraded":"2024-09-11T22:21:52.487001+0000","last_fullsized":"2024-09-11T22:21:52.487001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504846+0000","last_change":"2024-09-11T22:21:53.504846+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504846+0000","last_undegraded":"2024-09-11T22:21:53.504846+0000","last_fullsized":"2024-09-11T22:21:53.504846+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.509932+0000","last_change":"2024-09-11T22:21:53.508764+0000","last_active":"2024-09-11T22:21:53.509932+0000","last_peered":"2024-09-11T22:21:53.509932+0000","last_clean":"2024-09-11T22:21:53.509932+0000","last_became_active":"2024-09-11T22:21:53.508451+0000","last_became_peered":"2024-09-11T22:21:53.508451+0000","last_unstale":"2024-09-11T22:21:53.509932+0000","last_undegraded":"2024-09-11T22:21:53.509932+0000","last_fullsized":"2024-09-11T22:21:53.509932+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:03.561959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506479+0000","last_change":"2024-09-11T22:21:53.506479+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506479+0000","last_undegraded":"2024-09-11T22:21:53.506479+0000","last_fullsized":"2024-09-11T22:21:53.506479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.522052+0000","last_change":"2024-09-11T22:21:53.520041+0000","last_active":"2024-09-11T22:21:53.522052+0000","last_peered":"2024-09-11T22:21:53.522052+0000","last_clean":"2024-09-11T22:21:53.522052+0000","last_became_active":"2024-09-11T22:21:53.519719+0000","last_became_peered":"2024-09-11T22:21:53.519719+0000","last_unstale":"2024-09-11T22:21:53.522052+0000","last_undegraded":"2024-09-11T22:21:53.522052+0000","last_fullsized":"2024-09-11T22:21:53.522052+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:53:23.483987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502414+0000","last_change":"2024-09-11T22:21:53.502414+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502414+0000","last_undegraded":"2024-09-11T22:21:53.502414+0000","last_fullsized":"2024-09-11T22:21:53.502414+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:52.487001+0000","last_change":"2024-09-11T22:21:52.487001+0000","last_active":"2024-09-11T22:21:52.487001+0000","last_peered":"2024-09-11T22:21:52.487001+0000","last_clean":"2024-09-11T22:21:52.487001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:52.487001+0000","last_undegraded":"2024-09-11T22:21:52.487001+0000","last_fullsized":"2024-09-11T22:21:52.487001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506542+0000","last_change":"2024-09-11T22:21:53.506542+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506542+0000","last_undegraded":"2024-09-11T22:21:53.506542+0000","last_fullsized":"2024-09-11T22:21:53.506542+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.518914+0000","last_change":"2024-09-11T22:21:53.518061+0000","last_active":"2024-09-11T22:21:53.518914+0000","last_peered":"2024-09-11T22:21:53.518914+0000","last_clean":"2024-09-11T22:21:53.518914+0000","last_became_active":"2024-09-11T22:21:53.517766+0000","last_became_peered":"2024-09-11T22:21:53.517766+0000","last_unstale":"2024-09-11T22:21:53.518914+0000","last_undegraded":"2024-09-11T22:21:53.518914+0000","last_fullsized":"2024-09-11T22:21:53.518914+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:02.465092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:53.492779+0000","last_change":"2024-09-11T22:21:53.492779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.492779+0000","last_undegraded":"2024-09-11T22:21:53.492779+0000","last_fullsized":"2024-09-11T22:21:53.492779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.511857+0000","last_change":"2024-09-11T22:21:53.510553+0000","last_active":"2024-09-11T22:21:53.511857+0000","last_peered":"2024-09-11T22:21:53.511857+0000","last_clean":"2024-09-11T22:21:53.511857+0000","last_became_active":"2024-09-11T22:21:53.510274+0000","last_became_peered":"2024-09-11T22:21:53.510274+0000","last_unstale":"2024-09-11T22:21:53.511857+0000","last_undegraded":"2024-09-11T22:21:53.511857+0000","last_fullsized":"2024-09-11T22:21:53.511857+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:07.278583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:53.492779+0000","last_change":"2024-09-11T22:21:53.492779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.492779+0000","last_undegraded":"2024-09-11T22:21:53.492779+0000","last_fullsized":"2024-09-11T22:21:53.492779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:52.487001+0000","last_change":"2024-09-11T22:21:52.487001+0000","last_active":"2024-09-11T22:21:52.487001+0000","last_peered":"2024-09-11T22:21:52.487001+0000","last_clean":"2024-09-11T22:21:52.487001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:52.487001+0000","last_undegraded":"2024-09-11T22:21:52.487001+0000","last_fullsized":"2024-09-11T22:21:52.487001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504365+0000","last_change":"2024-09-11T22:21:53.504365+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504365+0000","last_undegraded":"2024-09-11T22:21:53.504365+0000","last_fullsized":"2024-09-11T22:21:53.504365+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.520671+0000","last_change":"2024-09-11T22:21:53.518479+0000","last_active":"2024-09-11T22:21:53.520671+0000","last_peered":"2024-09-11T22:21:53.520671+0000","last_clean":"2024-09-11T22:21:53.520671+0000","last_became_active":"2024-09-11T22:21:53.518194+0000","last_became_peered":"2024-09-11T22:21:53.518194+0000","last_unstale":"2024-09-11T22:21:53.520671+0000","last_undegraded":"2024-09-11T22:21:53.520671+0000","last_fullsized":"2024-09-11T22:21:53.520671+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:01.768074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504806+0000","last_change":"2024-09-11T22:21:53.504806+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504806+0000","last_undegraded":"2024-09-11T22:21:53.504806+0000","last_fullsized":"2024-09-11T22:21:53.504806+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.520631+0000","last_change":"2024-09-11T22:21:53.519158+0000","last_active":"2024-09-11T22:21:53.520631+0000","last_peered":"2024-09-11T22:21:53.520631+0000","last_clean":"2024-09-11T22:21:53.520631+0000","last_became_active":"2024-09-11T22:21:53.518027+0000","last_became_peered":"2024-09-11T22:21:53.518027+0000","last_unstale":"2024-09-11T22:21:53.520631+0000","last_undegraded":"2024-09-11T22:21:53.520631+0000","last_fullsized":"2024-09-11T22:21:53.520631+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:18.276100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504426+0000","last_change":"2024-09-11T22:21:53.504426+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504426+0000","last_undegraded":"2024-09-11T22:21:53.504426+0000","last_fullsized":"2024-09-11T22:21:53.504426+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.510524+0000","last_change":"2024-09-11T22:21:53.508001+0000","last_active":"2024-09-11T22:21:53.510524+0000","last_peered":"2024-09-11T22:21:53.510524+0000","last_clean":"2024-09-11T22:21:53.510524+0000","last_became_active":"2024-09-11T22:21:53.507189+0000","last_became_peered":"2024-09-11T22:21:53.507189+0000","last_unstale":"2024-09-11T22:21:53.510524+0000","last_undegraded":"2024-09-11T22:21:53.510524+0000","last_fullsized":"2024-09-11T22:21:53.510524+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:29.484597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:53.492779+0000","last_change":"2024-09-11T22:21:53.492779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.492779+0000","last_undegraded":"2024-09-11T22:21:53.492779+0000","last_fullsized":"2024-09-11T22:21:53.492779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.513022+0000","last_change":"2024-09-11T22:21:53.510639+0000","last_active":"2024-09-11T22:21:53.513022+0000","last_peered":"2024-09-11T22:21:53.513022+0000","last_clean":"2024-09-11T22:21:53.513022+0000","last_became_active":"2024-09-11T22:21:53.510362+0000","last_became_peered":"2024-09-11T22:21:53.510362+0000","last_unstale":"2024-09-11T22:21:53.513022+0000","last_undegraded":"2024-09-11T22:21:53.513022+0000","last_fullsized":"2024-09-11T22:21:53.513022+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:58.370993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:53.492779+0000","last_change":"2024-09-11T22:21:53.492779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.492779+0000","last_undegraded":"2024-09-11T22:21:53.492779+0000","last_fullsized":"2024-09-11T22:21:53.492779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.508910+0000","last_change":"2024-09-11T22:21:53.507391+0000","last_active":"2024-09-11T22:21:53.508910+0000","last_peered":"2024-09-11T22:21:53.508910+0000","last_clean":"2024-09-11T22:21:53.508910+0000","last_became_active":"2024-09-11T22:21:53.507076+0000","last_became_peered":"2024-09-11T22:21:53.507076+0000","last_unstale":"2024-09-11T22:21:53.508910+0000","last_undegraded":"2024-09-11T22:21:53.508910+0000","last_fullsized":"2024-09-11T22:21:53.508910+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:01.338325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506132+0000","last_change":"2024-09-11T22:21:53.506132+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506132+0000","last_undegraded":"2024-09-11T22:21:53.506132+0000","last_fullsized":"2024-09-11T22:21:53.506132+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.513642+0000","last_change":"2024-09-11T22:21:53.513015+0000","last_active":"2024-09-11T22:21:53.513642+0000","last_peered":"2024-09-11T22:21:53.513642+0000","last_clean":"2024-09-11T22:21:53.513642+0000","last_became_active":"2024-09-11T22:21:53.511892+0000","last_became_peered":"2024-09-11T22:21:53.511892+0000","last_unstale":"2024-09-11T22:21:53.513642+0000","last_undegraded":"2024-09-11T22:21:53.513642+0000","last_fullsized":"2024-09-11T22:21:53.513642+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:11.081873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:53.492779+0000","last_change":"2024-09-11T22:21:53.492779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.492779+0000","last_undegraded":"2024-09-11T22:21:53.492779+0000","last_fullsized":"2024-09-11T22:21:53.492779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.519466+0000","last_change":"2024-09-11T22:21:53.518211+0000","last_active":"2024-09-11T22:21:53.519466+0000","last_peered":"2024-09-11T22:21:53.519466+0000","last_clean":"2024-09-11T22:21:53.519466+0000","last_became_active":"2024-09-11T22:21:53.517362+0000","last_became_peered":"2024-09-11T22:21:53.517362+0000","last_unstale":"2024-09-11T22:21:53.519466+0000","last_undegraded":"2024-09-11T22:21:53.519466+0000","last_fullsized":"2024-09-11T22:21:53.519466+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:20.248496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506231+0000","last_change":"2024-09-11T22:21:53.506231+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506231+0000","last_undegraded":"2024-09-11T22:21:53.506231+0000","last_fullsized":"2024-09-11T22:21:53.506231+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:21:52.487001+0000","last_change":"2024-09-11T22:21:52.487001+0000","last_active":"2024-09-11T22:21:52.487001+0000","last_peered":"2024-09-11T22:21:52.487001+0000","last_clean":"2024-09-11T22:21:52.487001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:52.487001+0000","last_undegraded":"2024-09-11T22:21:52.487001+0000","last_fullsized":"2024-09-11T22:21:52.487001+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":427,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-11T22:21:50.397969+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:21:50.397969+0000","last_peered":"2024-09-11T22:21:50.397969+0000","last_clean":"2024-09-11T22:21:50.397969+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:21:50.397969+0000","last_undegraded":"2024-09-11T22:21:50.397969+0000","last_fullsized":"2024-09-11T22:21:50.397969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":102,"acting":102,"num_store_stats":6},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509575,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51256,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320584,"statfs":{"total":96636764160,"available":96584278016,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51260,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320580,"statfs":{"total":96636764160,"available":96584273920,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509574,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509574,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47100,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324740,"statfs":{"total":96636764160,"available":96588533760,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509573,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60160,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311680,"statfs":{"total":96636764160,"available":96575160320,"internally_reserved":0,"allocated":2662400,"data_stored":1497551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574981,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55964,"kb_used_data":2564,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315876,"statfs":{"total":96636764160,"available":96579457024,"internally_reserved":0,"allocated":2625536,"data_stored":1480262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47052,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324788,"statfs":{"total":96636764160,"available":96588582912,"internally_reserved":0,"allocated":2019328,"data_stored":884665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:21:57.508 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:21:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.645+0000 7fca2bbbd640 1 Processor -- start 2024-09-11T22:21:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.646+0000 7fca2bbbd640 1 -- start start 2024-09-11T22:21:57.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca2bbbd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca2415e870 0x7fca240d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca2bbbd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca240cfa80 con 0x7fca240d16d0 2024-09-11T22:21:57.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca2bbbd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca240d40d0 con 0x7fca240d3c00 2024-09-11T22:21:57.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca2bbbd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fca240d1b10 con 0x7fca2415e870 2024-09-11T22:21:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca29158640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fca240d16d0 0x7fca240d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51424/0 (socket says 172.21.15.50:51424) 2024-09-11T22:21:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca29158640 1 -- 172.21.15.50:0/2692411572 learned_addr learned my addr 172.21.15.50:0/2692411572 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca29959640 1 --2- 172.21.15.50:0/2692411572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca2415e870 0x7fca240d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884978263 0 0) 0x7fca18001110 con 0x7fca240d16d0 2024-09-11T22:21:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca10003520 con 0x7fca240d16d0 2024-09-11T22:21:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31183777 0 0) 0x7fca240d40d0 con 0x7fca240d3c00 2024-09-11T22:21:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca18001110 con 0x7fca240d3c00 2024-09-11T22:21:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2396708133 0 0) 0x7fca10003520 con 0x7fca240d16d0 2024-09-11T22:21:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca2415e870 msgr2=0x7fca240d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 --2- 172.21.15.50:0/2692411572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca2415e870 0x7fca240d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 >> v1:172.21.15.77:6789/0 conn(0x7fca240d3c00 legacy=0x7fca240b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca240d43b0 con 0x7fca240d16d0 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fca18001860 con 0x7fca240d16d0 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 >> v1:172.21.15.50:6789/0 conn(0x7fca240d16d0 legacy=0x7fca240d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 --2- 172.21.15.50:0/2692411572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca10003b70 0x7fca10003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 --2- 172.21.15.50:0/2692411572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca2415e870 0x7fca10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 --2- 172.21.15.50:0/2692411572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca10004d40 0x7fca100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca240d1b10 con 0x7fca10004d40 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca1000ba70 con 0x7fca10003b70 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.647+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fca1000bc20 con 0x7fca2415e870 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.648+0000 7fca2a15a640 1 --2- 172.21.15.50:0/2692411572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca10004d40 0x7fca100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.648+0000 7fca29959640 1 --2- 172.21.15.50:0/2692411572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca10003b70 0x7fca10003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.648+0000 7fca29158640 1 --2- 172.21.15.50:0/2692411572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca2415e870 0x7fca10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.648+0000 7fca2a15a640 1 -- 172.21.15.50:0/2692411572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca2415e870 msgr2=0x7fca10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.648+0000 7fca2a15a640 1 --2- 172.21.15.50:0/2692411572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca2415e870 0x7fca10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.648+0000 7fca2a15a640 1 -- 172.21.15.50:0/2692411572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca10003b70 msgr2=0x7fca10003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.648+0000 7fca2a15a640 1 --2- 172.21.15.50:0/2692411572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca10003b70 0x7fca10003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.648+0000 7fca2a15a640 1 -- 172.21.15.50:0/2692411572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca10003520 con 0x7fca10004d40 2024-09-11T22:21:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.649+0000 7fca2a15a640 1 --2- 172.21.15.50:0/2692411572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca10004d40 0x7fca100051c0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fca1c001fd0 tx=0x7fca10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d7534515ddbb58 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.649+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c001bf0 con 0x7fca10004d40 2024-09-11T22:21:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.649+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1c003b70 con 0x7fca10004d40 2024-09-11T22:21:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.649+0000 7fca28957640 1 -- 172.21.15.50:0/2692411572 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0050d0 con 0x7fca10004d40 2024-09-11T22:21:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.649+0000 7fca2bbbd640 1 -- 172.21.15.50:0/2692411572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca10004d40 msgr2=0x7fca100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.649+0000 7fca2bbbd640 1 --2- 172.21.15.50:0/2692411572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca10004d40 0x7fca100051c0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fca1c001fd0 tx=0x7fca10005830 comp rx=0 tx=0).stop 2024-09-11T22:21:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.649+0000 7fca2a15a640 1 -- 172.21.15.50:0/2692411572 reap_dead start 2024-09-11T22:21:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.649+0000 7fca2bbbd640 1 -- 172.21.15.50:0/2692411572 shutdown_connections 2024-09-11T22:21:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.649+0000 7fca2bbbd640 1 -- 172.21.15.50:0/2692411572 >> 172.21.15.50:0/2692411572 conn(0x7fca240727a0 msgr2=0x7fca240679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.649+0000 7fca2bbbd640 1 -- 172.21.15.50:0/2692411572 shutdown_connections 2024-09-11T22:21:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.649+0000 7fca2bbbd640 1 -- 172.21.15.50:0/2692411572 wait complete. 2024-09-11T22:21:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.651+0000 7fca2bbbd640 1 Processor -- start 2024-09-11T22:21:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.651+0000 7fca2bbbd640 1 -- start start 2024-09-11T22:21:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.651+0000 7fca2bbbd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca10004d40 0x7fca24155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.651+0000 7fca2bbbd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca24159e20 0x7fca2415a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.651+0000 7fca2bbbd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca24154860 0x7fca24154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.651+0000 7fca2bbbd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca2415ec50 con 0x7fca24159e20 2024-09-11T22:21:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.651+0000 7fca2bbbd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca240b7ee0 con 0x7fca24154860 2024-09-11T22:21:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.651+0000 7fca2bbbd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fca240b78b0 con 0x7fca10004d40 2024-09-11T22:21:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.651+0000 7fca29158640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca24159e20 0x7fca2415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca29158640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca24159e20 0x7fca2415a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48418/0 (socket says 172.21.15.50:48418) 2024-09-11T22:21:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca29158640 1 -- 172.21.15.50:0/1689302297 learned_addr learned my addr 172.21.15.50:0/1689302297 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca29959640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca10004d40 0x7fca24155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca2a15a640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca24154860 0x7fca24154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca29158640 1 -- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca10004d40 msgr2=0x7fca24155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca29158640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca10004d40 0x7fca24155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca29158640 1 -- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca24154860 msgr2=0x7fca24154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca29158640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca24154860 0x7fca24154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca29158640 1 -- 172.21.15.50:0/1689302297 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2415a9a0 con 0x7fca24159e20 2024-09-11T22:21:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca29158640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca24159e20 0x7fca2415a280 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fca18007310 tx=0x7fca18007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca167fc640 1 -- 172.21.15.50:0/1689302297 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1800f9c0 con 0x7fca24159e20 2024-09-11T22:21:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca167fc640 1 -- 172.21.15.50:0/1689302297 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca18018070 con 0x7fca24159e20 2024-09-11T22:21:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca2bbbd640 1 -- 172.21.15.50:0/1689302297 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2415ac80 con 0x7fca24159e20 2024-09-11T22:21:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca167fc640 1 -- 172.21.15.50:0/1689302297 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1800fde0 con 0x7fca24159e20 2024-09-11T22:21:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.652+0000 7fca2bbbd640 1 -- 172.21.15.50:0/1689302297 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2415b240 con 0x7fca24159e20 2024-09-11T22:21:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.653+0000 7fca2bbbd640 1 -- 172.21.15.50:0/1689302297 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca240d1190 con 0x7fca24159e20 2024-09-11T22:21:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.654+0000 7fca167fc640 1 -- 172.21.15.50:0/1689302297 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca1801d460 con 0x7fca24159e20 2024-09-11T22:21:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.654+0000 7fca167fc640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fca0806be30 0x7fca0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.654+0000 7fca167fc640 1 -- 172.21.15.50:0/1689302297 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7fca1808afa0 con 0x7fca24159e20 2024-09-11T22:21:57.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.654+0000 7fca29959640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fca0806be30 0x7fca0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.655+0000 7fca29959640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fca0806be30 0x7fca0806e2f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fca20009bc0 tx=0x7fca20009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:57.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.658+0000 7fca167fc640 1 -- 172.21.15.50:0/1689302297 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca240cfa80 con 0x7fca24159e20 2024-09-11T22:21:57.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.830+0000 7fca2bbbd640 1 -- 172.21.15.50:0/1689302297 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca2415de20 con 0x7fca0806be30 2024-09-11T22:21:57.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.836+0000 7fca167fc640 1 -- 172.21.15.50:0/1689302297 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248228 (secure 0 0 0) 0x7fca2415de20 con 0x7fca0806be30 2024-09-11T22:21:57.839 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:57.840 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:21:57.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.839+0000 7fca2bbbd640 1 -- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fca0806be30 msgr2=0x7fca0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.839+0000 7fca2bbbd640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fca0806be30 0x7fca0806e2f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fca20009bc0 tx=0x7fca20009190 comp rx=0 tx=0).stop 2024-09-11T22:21:57.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.839+0000 7fca2bbbd640 1 -- 172.21.15.50:0/1689302297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca24159e20 msgr2=0x7fca2415a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.839+0000 7fca2bbbd640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca24159e20 0x7fca2415a280 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fca18007310 tx=0x7fca18007710 comp rx=0 tx=0).stop 2024-09-11T22:21:57.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.839+0000 7fca2bbbd640 1 -- 172.21.15.50:0/1689302297 shutdown_connections 2024-09-11T22:21:57.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.839+0000 7fca2bbbd640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fca0806be30 0x7fca0806e2f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.839+0000 7fca2bbbd640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca24154860 0x7fca24154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.839+0000 7fca2bbbd640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca24159e20 0x7fca2415a280 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.839+0000 7fca2bbbd640 1 --2- 172.21.15.50:0/1689302297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca10004d40 0x7fca24155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.839+0000 7fca2bbbd640 1 -- 172.21.15.50:0/1689302297 >> 172.21.15.50:0/1689302297 conn(0x7fca240727a0 msgr2=0x7fca240b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:57.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.839+0000 7fca2bbbd640 1 -- 172.21.15.50:0/1689302297 shutdown_connections 2024-09-11T22:21:57.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.839+0000 7fca2bbbd640 1 -- 172.21.15.50:0/1689302297 wait complete. 2024-09-11T22:21:57.851 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":488,"stamp":"2024-09-11T22:21:57.519343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":432104,"kb_used_data":17388,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754542616,"statfs":{"total":773094113280,"available":772651638784,"internally_reserved":0,"allocated":17805312,"data_stored":8465148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":424463921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.025318"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661419+0000","last_change":"2024-09-11T22:21:54.528415+0000","last_active":"2024-09-11T22:21:55.661419+0000","last_peered":"2024-09-11T22:21:55.661419+0000","last_clean":"2024-09-11T22:21:55.661419+0000","last_became_active":"2024-09-11T22:21:54.527822+0000","last_became_peered":"2024-09-11T22:21:54.527822+0000","last_unstale":"2024-09-11T22:21:55.661419+0000","last_undegraded":"2024-09-11T22:21:55.661419+0000","last_fullsized":"2024-09-11T22:21:55.661419+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:49.445914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507816+0000","last_change":"2024-09-11T22:21:53.507816+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507816+0000","last_undegraded":"2024-09-11T22:21:53.507816+0000","last_fullsized":"2024-09-11T22:21:53.507816+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.509597+0000","last_change":"2024-09-11T22:21:53.509597+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.509597+0000","last_undegraded":"2024-09-11T22:21:53.509597+0000","last_fullsized":"2024-09-11T22:21:53.509597+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507367+0000","last_change":"2024-09-11T22:21:53.507367+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507367+0000","last_undegraded":"2024-09-11T22:21:53.507367+0000","last_fullsized":"2024-09-11T22:21:53.507367+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662155+0000","last_change":"2024-09-11T22:21:54.508029+0000","last_active":"2024-09-11T22:21:55.662155+0000","last_peered":"2024-09-11T22:21:55.662155+0000","last_clean":"2024-09-11T22:21:55.662155+0000","last_became_active":"2024-09-11T22:21:54.507700+0000","last_became_peered":"2024-09-11T22:21:54.507700+0000","last_unstale":"2024-09-11T22:21:55.662155+0000","last_undegraded":"2024-09-11T22:21:55.662155+0000","last_fullsized":"2024-09-11T22:21:55.662155+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:40.629965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.509168+0000","last_change":"2024-09-11T22:21:53.509168+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.509168+0000","last_undegraded":"2024-09-11T22:21:53.509168+0000","last_fullsized":"2024-09-11T22:21:53.509168+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501927+0000","last_change":"2024-09-11T22:21:53.501927+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501927+0000","last_undegraded":"2024-09-11T22:21:53.501927+0000","last_fullsized":"2024-09-11T22:21:53.501927+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506479+0000","last_change":"2024-09-11T22:21:53.506479+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506479+0000","last_undegraded":"2024-09-11T22:21:53.506479+0000","last_fullsized":"2024-09-11T22:21:53.506479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502071+0000","last_change":"2024-09-11T22:21:53.502071+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502071+0000","last_undegraded":"2024-09-11T22:21:53.502071+0000","last_fullsized":"2024-09-11T22:21:53.502071+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506510+0000","last_change":"2024-09-11T22:21:53.506510+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506510+0000","last_undegraded":"2024-09-11T22:21:53.506510+0000","last_fullsized":"2024-09-11T22:21:53.506510+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502130+0000","last_change":"2024-09-11T22:21:53.502130+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502130+0000","last_undegraded":"2024-09-11T22:21:53.502130+0000","last_fullsized":"2024-09-11T22:21:53.502130+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506958+0000","last_change":"2024-09-11T22:21:53.506958+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506958+0000","last_undegraded":"2024-09-11T22:21:53.506958+0000","last_fullsized":"2024-09-11T22:21:53.506958+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505523+0000","last_change":"2024-09-11T22:21:53.505523+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505523+0000","last_undegraded":"2024-09-11T22:21:53.505523+0000","last_fullsized":"2024-09-11T22:21:53.505523+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504093+0000","last_change":"2024-09-11T22:21:53.504093+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504093+0000","last_undegraded":"2024-09-11T22:21:53.504093+0000","last_fullsized":"2024-09-11T22:21:53.504093+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506839+0000","last_change":"2024-09-11T22:21:53.506839+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506839+0000","last_undegraded":"2024-09-11T22:21:53.506839+0000","last_fullsized":"2024-09-11T22:21:53.506839+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505949+0000","last_change":"2024-09-11T22:21:53.505949+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505949+0000","last_undegraded":"2024-09-11T22:21:53.505949+0000","last_fullsized":"2024-09-11T22:21:53.505949+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662501+0000","last_change":"2024-09-11T22:21:54.514748+0000","last_active":"2024-09-11T22:21:55.662501+0000","last_peered":"2024-09-11T22:21:55.662501+0000","last_clean":"2024-09-11T22:21:55.662501+0000","last_became_active":"2024-09-11T22:21:54.513842+0000","last_became_peered":"2024-09-11T22:21:54.513842+0000","last_unstale":"2024-09-11T22:21:55.662501+0000","last_undegraded":"2024-09-11T22:21:55.662501+0000","last_fullsized":"2024-09-11T22:21:55.662501+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:12.924567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661317+0000","last_change":"2024-09-11T22:21:54.520984+0000","last_active":"2024-09-11T22:21:55.661317+0000","last_peered":"2024-09-11T22:21:55.661317+0000","last_clean":"2024-09-11T22:21:55.661317+0000","last_became_active":"2024-09-11T22:21:54.520709+0000","last_became_peered":"2024-09-11T22:21:54.520709+0000","last_unstale":"2024-09-11T22:21:55.661317+0000","last_undegraded":"2024-09-11T22:21:55.661317+0000","last_fullsized":"2024-09-11T22:21:55.661317+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:25.359697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507045+0000","last_change":"2024-09-11T22:21:53.507045+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507045+0000","last_undegraded":"2024-09-11T22:21:53.507045+0000","last_fullsized":"2024-09-11T22:21:53.507045+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661330+0000","last_change":"2024-09-11T22:21:54.515669+0000","last_active":"2024-09-11T22:21:55.661330+0000","last_peered":"2024-09-11T22:21:55.661330+0000","last_clean":"2024-09-11T22:21:55.661330+0000","last_became_active":"2024-09-11T22:21:54.515148+0000","last_became_peered":"2024-09-11T22:21:54.515148+0000","last_unstale":"2024-09-11T22:21:55.661330+0000","last_undegraded":"2024-09-11T22:21:55.661330+0000","last_fullsized":"2024-09-11T22:21:55.661330+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:04.614538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662272+0000","last_change":"2024-09-11T22:21:54.508697+0000","last_active":"2024-09-11T22:21:55.662272+0000","last_peered":"2024-09-11T22:21:55.662272+0000","last_clean":"2024-09-11T22:21:55.662272+0000","last_became_active":"2024-09-11T22:21:54.508434+0000","last_became_peered":"2024-09-11T22:21:54.508434+0000","last_unstale":"2024-09-11T22:21:55.662272+0000","last_undegraded":"2024-09-11T22:21:55.662272+0000","last_fullsized":"2024-09-11T22:21:55.662272+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:27.764226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507747+0000","last_change":"2024-09-11T22:21:53.507747+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507747+0000","last_undegraded":"2024-09-11T22:21:53.507747+0000","last_fullsized":"2024-09-11T22:21:53.507747+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.508697+0000","last_change":"2024-09-11T22:21:53.508697+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.508697+0000","last_undegraded":"2024-09-11T22:21:53.508697+0000","last_fullsized":"2024-09-11T22:21:53.508697+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505388+0000","last_change":"2024-09-11T22:21:53.505388+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505388+0000","last_undegraded":"2024-09-11T22:21:53.505388+0000","last_fullsized":"2024-09-11T22:21:53.505388+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504874+0000","last_change":"2024-09-11T22:21:53.504874+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504874+0000","last_undegraded":"2024-09-11T22:21:53.504874+0000","last_fullsized":"2024-09-11T22:21:53.504874+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501814+0000","last_change":"2024-09-11T22:21:53.501814+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501814+0000","last_undegraded":"2024-09-11T22:21:53.501814+0000","last_fullsized":"2024-09-11T22:21:53.501814+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.508195+0000","last_change":"2024-09-11T22:21:53.508195+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.508195+0000","last_undegraded":"2024-09-11T22:21:53.508195+0000","last_fullsized":"2024-09-11T22:21:53.508195+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661468+0000","last_change":"2024-09-11T22:21:54.525452+0000","last_active":"2024-09-11T22:21:55.661468+0000","last_peered":"2024-09-11T22:21:55.661468+0000","last_clean":"2024-09-11T22:21:55.661468+0000","last_became_active":"2024-09-11T22:21:54.525190+0000","last_became_peered":"2024-09-11T22:21:54.525190+0000","last_unstale":"2024-09-11T22:21:55.661468+0000","last_undegraded":"2024-09-11T22:21:55.661468+0000","last_fullsized":"2024-09-11T22:21:55.661468+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:34.452375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504891+0000","last_change":"2024-09-11T22:21:53.504891+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504891+0000","last_undegraded":"2024-09-11T22:21:53.504891+0000","last_fullsized":"2024-09-11T22:21:53.504891+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503691+0000","last_change":"2024-09-11T22:21:53.503691+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503691+0000","last_undegraded":"2024-09-11T22:21:53.503691+0000","last_fullsized":"2024-09-11T22:21:53.503691+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507644+0000","last_change":"2024-09-11T22:21:53.507644+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507644+0000","last_undegraded":"2024-09-11T22:21:53.507644+0000","last_fullsized":"2024-09-11T22:21:53.507644+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660471+0000","last_change":"2024-09-11T22:21:54.516160+0000","last_active":"2024-09-11T22:21:55.660471+0000","last_peered":"2024-09-11T22:21:55.660471+0000","last_clean":"2024-09-11T22:21:55.660471+0000","last_became_active":"2024-09-11T22:21:54.515856+0000","last_became_peered":"2024-09-11T22:21:54.515856+0000","last_unstale":"2024-09-11T22:21:55.660471+0000","last_undegraded":"2024-09-11T22:21:55.660471+0000","last_fullsized":"2024-09-11T22:21:55.660471+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:14.951034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505391+0000","last_change":"2024-09-11T22:21:53.505391+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505391+0000","last_undegraded":"2024-09-11T22:21:53.505391+0000","last_fullsized":"2024-09-11T22:21:53.505391+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"166'4","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662460+0000","last_change":"2024-09-11T22:21:53.517954+0000","last_active":"2024-09-11T22:21:55.662460+0000","last_peered":"2024-09-11T22:21:55.662460+0000","last_clean":"2024-09-11T22:21:55.662460+0000","last_became_active":"2024-09-11T22:21:53.517676+0000","last_became_peered":"2024-09-11T22:21:53.517676+0000","last_unstale":"2024-09-11T22:21:55.662460+0000","last_undegraded":"2024-09-11T22:21:55.662460+0000","last_fullsized":"2024-09-11T22:21:55.662460+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:45.277715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505972+0000","last_change":"2024-09-11T22:21:53.505972+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505972+0000","last_undegraded":"2024-09-11T22:21:53.505972+0000","last_fullsized":"2024-09-11T22:21:53.505972+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.514976+0000","last_change":"2024-09-11T22:21:53.513909+0000","last_active":"2024-09-11T22:21:53.514976+0000","last_peered":"2024-09-11T22:21:53.514976+0000","last_clean":"2024-09-11T22:21:53.514976+0000","last_became_active":"2024-09-11T22:21:53.513485+0000","last_became_peered":"2024-09-11T22:21:53.513485+0000","last_unstale":"2024-09-11T22:21:53.514976+0000","last_undegraded":"2024-09-11T22:21:53.514976+0000","last_fullsized":"2024-09-11T22:21:53.514976+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:21.887542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503309+0000","last_change":"2024-09-11T22:21:53.503309+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503309+0000","last_undegraded":"2024-09-11T22:21:53.503309+0000","last_fullsized":"2024-09-11T22:21:53.503309+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.522546+0000","last_change":"2024-09-11T22:21:53.521872+0000","last_active":"2024-09-11T22:21:53.522546+0000","last_peered":"2024-09-11T22:21:53.522546+0000","last_clean":"2024-09-11T22:21:53.522546+0000","last_became_active":"2024-09-11T22:21:53.520880+0000","last_became_peered":"2024-09-11T22:21:53.520880+0000","last_unstale":"2024-09-11T22:21:53.522546+0000","last_undegraded":"2024-09-11T22:21:53.522546+0000","last_fullsized":"2024-09-11T22:21:53.522546+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:05:35.606832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501517+0000","last_change":"2024-09-11T22:21:53.501517+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501517+0000","last_undegraded":"2024-09-11T22:21:53.501517+0000","last_fullsized":"2024-09-11T22:21:53.501517+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.515650+0000","last_change":"2024-09-11T22:21:53.515134+0000","last_active":"2024-09-11T22:21:53.515650+0000","last_peered":"2024-09-11T22:21:53.515650+0000","last_clean":"2024-09-11T22:21:53.515650+0000","last_became_active":"2024-09-11T22:21:53.514736+0000","last_became_peered":"2024-09-11T22:21:53.514736+0000","last_unstale":"2024-09-11T22:21:53.515650+0000","last_undegraded":"2024-09-11T22:21:53.515650+0000","last_fullsized":"2024-09-11T22:21:53.515650+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:03.561959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507027+0000","last_change":"2024-09-11T22:21:53.507027+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507027+0000","last_undegraded":"2024-09-11T22:21:53.507027+0000","last_fullsized":"2024-09-11T22:21:53.507027+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662211+0000","last_change":"2024-09-11T22:21:53.520007+0000","last_active":"2024-09-11T22:21:55.662211+0000","last_peered":"2024-09-11T22:21:55.662211+0000","last_clean":"2024-09-11T22:21:55.662211+0000","last_became_active":"2024-09-11T22:21:53.519448+0000","last_became_peered":"2024-09-11T22:21:53.519448+0000","last_unstale":"2024-09-11T22:21:55.662211+0000","last_undegraded":"2024-09-11T22:21:55.662211+0000","last_fullsized":"2024-09-11T22:21:55.662211+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:52.290796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503779+0000","last_change":"2024-09-11T22:21:53.503779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503779+0000","last_undegraded":"2024-09-11T22:21:53.503779+0000","last_fullsized":"2024-09-11T22:21:53.503779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.512839+0000","last_change":"2024-09-11T22:21:53.511743+0000","last_active":"2024-09-11T22:21:53.512839+0000","last_peered":"2024-09-11T22:21:53.512839+0000","last_clean":"2024-09-11T22:21:53.512839+0000","last_became_active":"2024-09-11T22:21:53.511450+0000","last_became_peered":"2024-09-11T22:21:53.511450+0000","last_unstale":"2024-09-11T22:21:53.512839+0000","last_undegraded":"2024-09-11T22:21:53.512839+0000","last_fullsized":"2024-09-11T22:21:53.512839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:39.080926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501342+0000","last_change":"2024-09-11T22:21:53.501342+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501342+0000","last_undegraded":"2024-09-11T22:21:53.501342+0000","last_fullsized":"2024-09-11T22:21:53.501342+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660883+0000","last_change":"2024-09-11T22:21:53.520690+0000","last_active":"2024-09-11T22:21:55.660883+0000","last_peered":"2024-09-11T22:21:55.660883+0000","last_clean":"2024-09-11T22:21:55.660883+0000","last_became_active":"2024-09-11T22:21:53.520402+0000","last_became_peered":"2024-09-11T22:21:53.520402+0000","last_unstale":"2024-09-11T22:21:55.660883+0000","last_undegraded":"2024-09-11T22:21:55.660883+0000","last_fullsized":"2024-09-11T22:21:55.660883+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:05.650500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507605+0000","last_change":"2024-09-11T22:21:53.507605+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507605+0000","last_undegraded":"2024-09-11T22:21:53.507605+0000","last_fullsized":"2024-09-11T22:21:53.507605+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.509960+0000","last_change":"2024-09-11T22:21:53.507631+0000","last_active":"2024-09-11T22:21:53.509960+0000","last_peered":"2024-09-11T22:21:53.509960+0000","last_clean":"2024-09-11T22:21:53.509960+0000","last_became_active":"2024-09-11T22:21:53.507356+0000","last_became_peered":"2024-09-11T22:21:53.507356+0000","last_unstale":"2024-09-11T22:21:53.509960+0000","last_undegraded":"2024-09-11T22:21:53.509960+0000","last_fullsized":"2024-09-11T22:21:53.509960+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:11.081873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504179+0000","last_change":"2024-09-11T22:21:53.504179+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504179+0000","last_undegraded":"2024-09-11T22:21:53.504179+0000","last_fullsized":"2024-09-11T22:21:53.504179+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662272+0000","last_change":"2024-09-11T22:21:53.516194+0000","last_active":"2024-09-11T22:21:55.662272+0000","last_peered":"2024-09-11T22:21:55.662272+0000","last_clean":"2024-09-11T22:21:55.662272+0000","last_became_active":"2024-09-11T22:21:53.515797+0000","last_became_peered":"2024-09-11T22:21:53.515797+0000","last_unstale":"2024-09-11T22:21:55.662272+0000","last_undegraded":"2024-09-11T22:21:55.662272+0000","last_fullsized":"2024-09-11T22:21:55.662272+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:03.962378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502888+0000","last_change":"2024-09-11T22:21:53.502888+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502888+0000","last_undegraded":"2024-09-11T22:21:53.502888+0000","last_fullsized":"2024-09-11T22:21:53.502888+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"166'3","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660472+0000","last_change":"2024-09-11T22:21:53.521712+0000","last_active":"2024-09-11T22:21:55.660472+0000","last_peered":"2024-09-11T22:21:55.660472+0000","last_clean":"2024-09-11T22:21:55.660472+0000","last_became_active":"2024-09-11T22:21:53.521403+0000","last_became_peered":"2024-09-11T22:21:53.521403+0000","last_unstale":"2024-09-11T22:21:55.660472+0000","last_undegraded":"2024-09-11T22:21:55.660472+0000","last_fullsized":"2024-09-11T22:21:55.660472+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:05.404784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506454+0000","last_change":"2024-09-11T22:21:53.506454+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506454+0000","last_undegraded":"2024-09-11T22:21:53.506454+0000","last_fullsized":"2024-09-11T22:21:53.506454+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.515735+0000","last_change":"2024-09-11T22:21:53.514233+0000","last_active":"2024-09-11T22:21:53.515735+0000","last_peered":"2024-09-11T22:21:53.515735+0000","last_clean":"2024-09-11T22:21:53.515735+0000","last_became_active":"2024-09-11T22:21:53.512269+0000","last_became_peered":"2024-09-11T22:21:53.512269+0000","last_unstale":"2024-09-11T22:21:53.515735+0000","last_undegraded":"2024-09-11T22:21:53.515735+0000","last_fullsized":"2024-09-11T22:21:53.515735+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:52.562386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507601+0000","last_change":"2024-09-11T22:21:53.507601+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507601+0000","last_undegraded":"2024-09-11T22:21:53.507601+0000","last_fullsized":"2024-09-11T22:21:53.507601+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"166'2","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661732+0000","last_change":"2024-09-11T22:21:53.522915+0000","last_active":"2024-09-11T22:21:55.661732+0000","last_peered":"2024-09-11T22:21:55.661732+0000","last_clean":"2024-09-11T22:21:55.661732+0000","last_became_active":"2024-09-11T22:21:53.522686+0000","last_became_peered":"2024-09-11T22:21:53.522686+0000","last_unstale":"2024-09-11T22:21:55.661732+0000","last_undegraded":"2024-09-11T22:21:55.661732+0000","last_fullsized":"2024-09-11T22:21:55.661732+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:34.088877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502957+0000","last_change":"2024-09-11T22:21:53.502957+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502957+0000","last_undegraded":"2024-09-11T22:21:53.502957+0000","last_fullsized":"2024-09-11T22:21:53.502957+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.521489+0000","last_change":"2024-09-11T22:21:53.517900+0000","last_active":"2024-09-11T22:21:53.521489+0000","last_peered":"2024-09-11T22:21:53.521489+0000","last_clean":"2024-09-11T22:21:53.521489+0000","last_became_active":"2024-09-11T22:21:53.517606+0000","last_became_peered":"2024-09-11T22:21:53.517606+0000","last_unstale":"2024-09-11T22:21:53.521489+0000","last_undegraded":"2024-09-11T22:21:53.521489+0000","last_fullsized":"2024-09-11T22:21:53.521489+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:49.422032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503384+0000","last_change":"2024-09-11T22:21:53.503384+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503384+0000","last_undegraded":"2024-09-11T22:21:53.503384+0000","last_fullsized":"2024-09-11T22:21:53.503384+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.512802+0000","last_change":"2024-09-11T22:21:53.511206+0000","last_active":"2024-09-11T22:21:53.512802+0000","last_peered":"2024-09-11T22:21:53.512802+0000","last_clean":"2024-09-11T22:21:53.512802+0000","last_became_active":"2024-09-11T22:21:53.510917+0000","last_became_peered":"2024-09-11T22:21:53.510917+0000","last_unstale":"2024-09-11T22:21:53.512802+0000","last_undegraded":"2024-09-11T22:21:53.512802+0000","last_fullsized":"2024-09-11T22:21:53.512802+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:33.324721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506421+0000","last_change":"2024-09-11T22:21:53.506421+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506421+0000","last_undegraded":"2024-09-11T22:21:53.506421+0000","last_fullsized":"2024-09-11T22:21:53.506421+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"166'8","reported_seq":22,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660994+0000","last_change":"2024-09-11T22:21:53.520671+0000","last_active":"2024-09-11T22:21:55.660994+0000","last_peered":"2024-09-11T22:21:55.660994+0000","last_clean":"2024-09-11T22:21:55.660994+0000","last_became_active":"2024-09-11T22:21:53.520444+0000","last_became_peered":"2024-09-11T22:21:53.520444+0000","last_unstale":"2024-09-11T22:21:55.660994+0000","last_undegraded":"2024-09-11T22:21:55.660994+0000","last_fullsized":"2024-09-11T22:21:55.660994+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:46.184129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505255+0000","last_change":"2024-09-11T22:21:53.505255+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505255+0000","last_undegraded":"2024-09-11T22:21:53.505255+0000","last_fullsized":"2024-09-11T22:21:53.505255+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662544+0000","last_change":"2024-09-11T22:21:53.514629+0000","last_active":"2024-09-11T22:21:55.662544+0000","last_peered":"2024-09-11T22:21:55.662544+0000","last_clean":"2024-09-11T22:21:55.662544+0000","last_became_active":"2024-09-11T22:21:53.514304+0000","last_became_peered":"2024-09-11T22:21:53.514304+0000","last_unstale":"2024-09-11T22:21:55.662544+0000","last_undegraded":"2024-09-11T22:21:55.662544+0000","last_fullsized":"2024-09-11T22:21:55.662544+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:43.852256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501498+0000","last_change":"2024-09-11T22:21:53.501498+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501498+0000","last_undegraded":"2024-09-11T22:21:53.501498+0000","last_fullsized":"2024-09-11T22:21:53.501498+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.510561+0000","last_change":"2024-09-11T22:21:53.509336+0000","last_active":"2024-09-11T22:21:53.510561+0000","last_peered":"2024-09-11T22:21:53.510561+0000","last_clean":"2024-09-11T22:21:53.510561+0000","last_became_active":"2024-09-11T22:21:53.509033+0000","last_became_peered":"2024-09-11T22:21:53.509033+0000","last_unstale":"2024-09-11T22:21:53.510561+0000","last_undegraded":"2024-09-11T22:21:53.510561+0000","last_fullsized":"2024-09-11T22:21:53.510561+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:37.593441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502623+0000","last_change":"2024-09-11T22:21:53.502623+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502623+0000","last_undegraded":"2024-09-11T22:21:53.502623+0000","last_fullsized":"2024-09-11T22:21:53.502623+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661647+0000","last_change":"2024-09-11T22:21:53.520425+0000","last_active":"2024-09-11T22:21:55.661647+0000","last_peered":"2024-09-11T22:21:55.661647+0000","last_clean":"2024-09-11T22:21:55.661647+0000","last_became_active":"2024-09-11T22:21:53.520189+0000","last_became_peered":"2024-09-11T22:21:53.520189+0000","last_unstale":"2024-09-11T22:21:55.661647+0000","last_undegraded":"2024-09-11T22:21:55.661647+0000","last_fullsized":"2024-09-11T22:21:55.661647+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:22.352739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504846+0000","last_change":"2024-09-11T22:21:53.504846+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504846+0000","last_undegraded":"2024-09-11T22:21:53.504846+0000","last_fullsized":"2024-09-11T22:21:53.504846+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.509932+0000","last_change":"2024-09-11T22:21:53.508764+0000","last_active":"2024-09-11T22:21:53.509932+0000","last_peered":"2024-09-11T22:21:53.509932+0000","last_clean":"2024-09-11T22:21:53.509932+0000","last_became_active":"2024-09-11T22:21:53.508451+0000","last_became_peered":"2024-09-11T22:21:53.508451+0000","last_unstale":"2024-09-11T22:21:53.509932+0000","last_undegraded":"2024-09-11T22:21:53.509932+0000","last_fullsized":"2024-09-11T22:21:53.509932+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:03.561959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506479+0000","last_change":"2024-09-11T22:21:53.506479+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506479+0000","last_undegraded":"2024-09-11T22:21:53.506479+0000","last_fullsized":"2024-09-11T22:21:53.506479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.522052+0000","last_change":"2024-09-11T22:21:53.520041+0000","last_active":"2024-09-11T22:21:53.522052+0000","last_peered":"2024-09-11T22:21:53.522052+0000","last_clean":"2024-09-11T22:21:53.522052+0000","last_became_active":"2024-09-11T22:21:53.519719+0000","last_became_peered":"2024-09-11T22:21:53.519719+0000","last_unstale":"2024-09-11T22:21:53.522052+0000","last_undegraded":"2024-09-11T22:21:53.522052+0000","last_fullsized":"2024-09-11T22:21:53.522052+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:53:23.483987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502414+0000","last_change":"2024-09-11T22:21:53.502414+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502414+0000","last_undegraded":"2024-09-11T22:21:53.502414+0000","last_fullsized":"2024-09-11T22:21:53.502414+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661095+0000","last_change":"2024-09-11T22:21:53.515176+0000","last_active":"2024-09-11T22:21:55.661095+0000","last_peered":"2024-09-11T22:21:55.661095+0000","last_clean":"2024-09-11T22:21:55.661095+0000","last_became_active":"2024-09-11T22:21:53.513869+0000","last_became_peered":"2024-09-11T22:21:53.513869+0000","last_unstale":"2024-09-11T22:21:55.661095+0000","last_undegraded":"2024-09-11T22:21:55.661095+0000","last_fullsized":"2024-09-11T22:21:55.661095+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:19.271785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506542+0000","last_change":"2024-09-11T22:21:53.506542+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506542+0000","last_undegraded":"2024-09-11T22:21:53.506542+0000","last_fullsized":"2024-09-11T22:21:53.506542+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.518914+0000","last_change":"2024-09-11T22:21:53.518061+0000","last_active":"2024-09-11T22:21:53.518914+0000","last_peered":"2024-09-11T22:21:53.518914+0000","last_clean":"2024-09-11T22:21:53.518914+0000","last_became_active":"2024-09-11T22:21:53.517766+0000","last_became_peered":"2024-09-11T22:21:53.517766+0000","last_unstale":"2024-09-11T22:21:53.518914+0000","last_undegraded":"2024-09-11T22:21:53.518914+0000","last_fullsized":"2024-09-11T22:21:53.518914+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:02.465092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661344+0000","last_change":"2024-09-11T22:21:54.512265+0000","last_active":"2024-09-11T22:21:55.661344+0000","last_peered":"2024-09-11T22:21:55.661344+0000","last_clean":"2024-09-11T22:21:55.661344+0000","last_became_active":"2024-09-11T22:21:54.511981+0000","last_became_peered":"2024-09-11T22:21:54.511981+0000","last_unstale":"2024-09-11T22:21:55.661344+0000","last_undegraded":"2024-09-11T22:21:55.661344+0000","last_fullsized":"2024-09-11T22:21:55.661344+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:19.038748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.511857+0000","last_change":"2024-09-11T22:21:53.510553+0000","last_active":"2024-09-11T22:21:53.511857+0000","last_peered":"2024-09-11T22:21:53.511857+0000","last_clean":"2024-09-11T22:21:53.511857+0000","last_became_active":"2024-09-11T22:21:53.510274+0000","last_became_peered":"2024-09-11T22:21:53.510274+0000","last_unstale":"2024-09-11T22:21:53.511857+0000","last_undegraded":"2024-09-11T22:21:53.511857+0000","last_fullsized":"2024-09-11T22:21:53.511857+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:07.278583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662247+0000","last_change":"2024-09-11T22:21:54.513344+0000","last_active":"2024-09-11T22:21:55.662247+0000","last_peered":"2024-09-11T22:21:55.662247+0000","last_clean":"2024-09-11T22:21:55.662247+0000","last_became_active":"2024-09-11T22:21:54.513063+0000","last_became_peered":"2024-09-11T22:21:54.513063+0000","last_unstale":"2024-09-11T22:21:55.662247+0000","last_undegraded":"2024-09-11T22:21:55.662247+0000","last_fullsized":"2024-09-11T22:21:55.662247+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:36.252373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"166'2","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661705+0000","last_change":"2024-09-11T22:21:53.521697+0000","last_active":"2024-09-11T22:21:55.661705+0000","last_peered":"2024-09-11T22:21:55.661705+0000","last_clean":"2024-09-11T22:21:55.661705+0000","last_became_active":"2024-09-11T22:21:53.521436+0000","last_became_peered":"2024-09-11T22:21:53.521436+0000","last_unstale":"2024-09-11T22:21:55.661705+0000","last_undegraded":"2024-09-11T22:21:55.661705+0000","last_fullsized":"2024-09-11T22:21:55.661705+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:32:22.006810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504365+0000","last_change":"2024-09-11T22:21:53.504365+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504365+0000","last_undegraded":"2024-09-11T22:21:53.504365+0000","last_fullsized":"2024-09-11T22:21:53.504365+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.520671+0000","last_change":"2024-09-11T22:21:53.518479+0000","last_active":"2024-09-11T22:21:53.520671+0000","last_peered":"2024-09-11T22:21:53.520671+0000","last_clean":"2024-09-11T22:21:53.520671+0000","last_became_active":"2024-09-11T22:21:53.518194+0000","last_became_peered":"2024-09-11T22:21:53.518194+0000","last_unstale":"2024-09-11T22:21:53.520671+0000","last_undegraded":"2024-09-11T22:21:53.520671+0000","last_fullsized":"2024-09-11T22:21:53.520671+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:01.768074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504806+0000","last_change":"2024-09-11T22:21:53.504806+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504806+0000","last_undegraded":"2024-09-11T22:21:53.504806+0000","last_fullsized":"2024-09-11T22:21:53.504806+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.520631+0000","last_change":"2024-09-11T22:21:53.519158+0000","last_active":"2024-09-11T22:21:53.520631+0000","last_peered":"2024-09-11T22:21:53.520631+0000","last_clean":"2024-09-11T22:21:53.520631+0000","last_became_active":"2024-09-11T22:21:53.518027+0000","last_became_peered":"2024-09-11T22:21:53.518027+0000","last_unstale":"2024-09-11T22:21:53.520631+0000","last_undegraded":"2024-09-11T22:21:53.520631+0000","last_fullsized":"2024-09-11T22:21:53.520631+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:18.276100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504426+0000","last_change":"2024-09-11T22:21:53.504426+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504426+0000","last_undegraded":"2024-09-11T22:21:53.504426+0000","last_fullsized":"2024-09-11T22:21:53.504426+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.510524+0000","last_change":"2024-09-11T22:21:53.508001+0000","last_active":"2024-09-11T22:21:53.510524+0000","last_peered":"2024-09-11T22:21:53.510524+0000","last_clean":"2024-09-11T22:21:53.510524+0000","last_became_active":"2024-09-11T22:21:53.507189+0000","last_became_peered":"2024-09-11T22:21:53.507189+0000","last_unstale":"2024-09-11T22:21:53.510524+0000","last_undegraded":"2024-09-11T22:21:53.510524+0000","last_fullsized":"2024-09-11T22:21:53.510524+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:29.484597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661479+0000","last_change":"2024-09-11T22:21:54.523677+0000","last_active":"2024-09-11T22:21:55.661479+0000","last_peered":"2024-09-11T22:21:55.661479+0000","last_clean":"2024-09-11T22:21:55.661479+0000","last_became_active":"2024-09-11T22:21:54.523304+0000","last_became_peered":"2024-09-11T22:21:54.523304+0000","last_unstale":"2024-09-11T22:21:55.661479+0000","last_undegraded":"2024-09-11T22:21:55.661479+0000","last_fullsized":"2024-09-11T22:21:55.661479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:08.351084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.513022+0000","last_change":"2024-09-11T22:21:53.510639+0000","last_active":"2024-09-11T22:21:53.513022+0000","last_peered":"2024-09-11T22:21:53.513022+0000","last_clean":"2024-09-11T22:21:53.513022+0000","last_became_active":"2024-09-11T22:21:53.510362+0000","last_became_peered":"2024-09-11T22:21:53.510362+0000","last_unstale":"2024-09-11T22:21:53.513022+0000","last_undegraded":"2024-09-11T22:21:53.513022+0000","last_fullsized":"2024-09-11T22:21:53.513022+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:58.370993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661714+0000","last_change":"2024-09-11T22:21:54.527134+0000","last_active":"2024-09-11T22:21:55.661714+0000","last_peered":"2024-09-11T22:21:55.661714+0000","last_clean":"2024-09-11T22:21:55.661714+0000","last_became_active":"2024-09-11T22:21:54.526844+0000","last_became_peered":"2024-09-11T22:21:54.526844+0000","last_unstale":"2024-09-11T22:21:55.661714+0000","last_undegraded":"2024-09-11T22:21:55.661714+0000","last_fullsized":"2024-09-11T22:21:55.661714+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:34.259306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.508910+0000","last_change":"2024-09-11T22:21:53.507391+0000","last_active":"2024-09-11T22:21:53.508910+0000","last_peered":"2024-09-11T22:21:53.508910+0000","last_clean":"2024-09-11T22:21:53.508910+0000","last_became_active":"2024-09-11T22:21:53.507076+0000","last_became_peered":"2024-09-11T22:21:53.507076+0000","last_unstale":"2024-09-11T22:21:53.508910+0000","last_undegraded":"2024-09-11T22:21:53.508910+0000","last_fullsized":"2024-09-11T22:21:53.508910+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:01.338325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506132+0000","last_change":"2024-09-11T22:21:53.506132+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506132+0000","last_undegraded":"2024-09-11T22:21:53.506132+0000","last_fullsized":"2024-09-11T22:21:53.506132+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.513642+0000","last_change":"2024-09-11T22:21:53.513015+0000","last_active":"2024-09-11T22:21:53.513642+0000","last_peered":"2024-09-11T22:21:53.513642+0000","last_clean":"2024-09-11T22:21:53.513642+0000","last_became_active":"2024-09-11T22:21:53.511892+0000","last_became_peered":"2024-09-11T22:21:53.511892+0000","last_unstale":"2024-09-11T22:21:53.513642+0000","last_undegraded":"2024-09-11T22:21:53.513642+0000","last_fullsized":"2024-09-11T22:21:53.513642+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:11.081873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661492+0000","last_change":"2024-09-11T22:21:54.516765+0000","last_active":"2024-09-11T22:21:55.661492+0000","last_peered":"2024-09-11T22:21:55.661492+0000","last_clean":"2024-09-11T22:21:55.661492+0000","last_became_active":"2024-09-11T22:21:54.516472+0000","last_became_peered":"2024-09-11T22:21:54.516472+0000","last_unstale":"2024-09-11T22:21:55.661492+0000","last_undegraded":"2024-09-11T22:21:55.661492+0000","last_fullsized":"2024-09-11T22:21:55.661492+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:03.343797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.519466+0000","last_change":"2024-09-11T22:21:53.518211+0000","last_active":"2024-09-11T22:21:53.519466+0000","last_peered":"2024-09-11T22:21:53.519466+0000","last_clean":"2024-09-11T22:21:53.519466+0000","last_became_active":"2024-09-11T22:21:53.517362+0000","last_became_peered":"2024-09-11T22:21:53.517362+0000","last_unstale":"2024-09-11T22:21:53.519466+0000","last_undegraded":"2024-09-11T22:21:53.519466+0000","last_fullsized":"2024-09-11T22:21:53.519466+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:20.248496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506231+0000","last_change":"2024-09-11T22:21:53.506231+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506231+0000","last_undegraded":"2024-09-11T22:21:53.506231+0000","last_fullsized":"2024-09-11T22:21:53.506231+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661259+0000","last_change":"2024-09-11T22:21:53.514489+0000","last_active":"2024-09-11T22:21:55.661259+0000","last_peered":"2024-09-11T22:21:55.661259+0000","last_clean":"2024-09-11T22:21:55.661259+0000","last_became_active":"2024-09-11T22:21:53.514203+0000","last_became_peered":"2024-09-11T22:21:53.514203+0000","last_unstale":"2024-09-11T22:21:55.661259+0000","last_undegraded":"2024-09-11T22:21:55.661259+0000","last_fullsized":"2024-09-11T22:21:55.661259+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:49.890240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":436,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661047+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:21:55.661047+0000","last_peered":"2024-09-11T22:21:55.661047+0000","last_clean":"2024-09-11T22:21:55.661047+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:21:55.661047+0000","last_undegraded":"2024-09-11T22:21:55.661047+0000","last_fullsized":"2024-09-11T22:21:55.661047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509575,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51256,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320584,"statfs":{"total":96636764160,"available":96584278016,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51260,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320580,"statfs":{"total":96636764160,"available":96584273920,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509574,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509574,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47100,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324740,"statfs":{"total":96636764160,"available":96588533760,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509573,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60160,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311680,"statfs":{"total":96636764160,"available":96575160320,"internally_reserved":0,"allocated":2662400,"data_stored":1497551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56028,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315812,"statfs":{"total":96636764160,"available":96579391488,"internally_reserved":0,"allocated":2695168,"data_stored":1510730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574981,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47140,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324700,"statfs":{"total":96636764160,"available":96588492800,"internally_reserved":0,"allocated":2105344,"data_stored":920952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:21:57.855 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:21:57.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.992+0000 7fe865b3a640 1 Processor -- start 2024-09-11T22:21:57.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.993+0000 7fe865b3a640 1 -- start start 2024-09-11T22:21:57.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.993+0000 7fe865b3a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe86015c240 0x7fe8600b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.993+0000 7fe865b3a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8600728e0 0x7fe860072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.993+0000 7fe865b3a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe860073230 con 0x7fe8600735a0 2024-09-11T22:21:57.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.993+0000 7fe865b3a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe86015c620 con 0x7fe8600728e0 2024-09-11T22:21:57.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.993+0000 7fe865b3a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe86015f2b0 con 0x7fe86015c240 2024-09-11T22:21:57.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.994+0000 7fe85ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8600728e0 0x7fe860072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.994+0000 7fe85effd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe8600735a0 0x7fe86015eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51434/0 (socket says 172.21.15.50:51434) 2024-09-11T22:21:57.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.994+0000 7fe85effd640 1 -- 172.21.15.50:0/425804394 learned_addr learned my addr 172.21.15.50:0/425804394 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:57.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.994+0000 7fe85f7fe640 1 --2- 172.21.15.50:0/425804394 >> v2:172.21.15.77:3300/0 conn(0x7fe86015c240 0x7fe8600b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.994+0000 7fe85e7fc640 1 -- 172.21.15.50:0/425804394 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3645610144 0 0) 0x7fe854001110 con 0x7fe8600735a0 2024-09-11T22:21:57.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.994+0000 7fe85e7fc640 1 -- 172.21.15.50:0/425804394 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe848003520 con 0x7fe8600735a0 2024-09-11T22:21:57.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.994+0000 7fe85ffff640 1 -- 172.21.15.50:0/425804394 >> v2:172.21.15.77:3300/0 conn(0x7fe86015c240 msgr2=0x7fe8600b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:57.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.994+0000 7fe85ffff640 1 --2- 172.21.15.50:0/425804394 >> v2:172.21.15.77:3300/0 conn(0x7fe86015c240 0x7fe8600b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.994+0000 7fe85ffff640 1 -- 172.21.15.50:0/425804394 >> v1:172.21.15.50:6789/0 conn(0x7fe8600735a0 legacy=0x7fe86015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.994+0000 7fe85ffff640 1 -- 172.21.15.50:0/425804394 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86015f560 con 0x7fe8600728e0 2024-09-11T22:21:57.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.995+0000 7fe85ffff640 1 --2- 172.21.15.50:0/425804394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8600728e0 0x7fe860072cf0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fe860069480 tx=0x7fe85802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cf346d21ba3aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:57.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.995+0000 7fe85e7fc640 1 -- 172.21.15.50:0/425804394 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858007740 con 0x7fe8600728e0 2024-09-11T22:21:57.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.995+0000 7fe85e7fc640 1 -- 172.21.15.50:0/425804394 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8580078e0 con 0x7fe8600728e0 2024-09-11T22:21:57.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.995+0000 7fe85e7fc640 1 -- 172.21.15.50:0/425804394 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858007cb0 con 0x7fe8600728e0 2024-09-11T22:21:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.995+0000 7fe865b3a640 1 -- 172.21.15.50:0/425804394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8600728e0 msgr2=0x7fe860072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.995+0000 7fe865b3a640 1 --2- 172.21.15.50:0/425804394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8600728e0 0x7fe860072cf0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fe860069480 tx=0x7fe85802a680 comp rx=0 tx=0).stop 2024-09-11T22:21:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.995+0000 7fe865b3a640 1 -- 172.21.15.50:0/425804394 shutdown_connections 2024-09-11T22:21:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.995+0000 7fe865b3a640 1 --2- 172.21.15.50:0/425804394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8600728e0 0x7fe860072cf0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.995+0000 7fe865b3a640 1 --2- 172.21.15.50:0/425804394 >> v2:172.21.15.77:3300/0 conn(0x7fe86015c240 0x7fe8600b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.995+0000 7fe865b3a640 1 -- 172.21.15.50:0/425804394 >> 172.21.15.50:0/425804394 conn(0x7fe8600b2bd0 msgr2=0x7fe8600b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.995+0000 7fe865b3a640 1 -- 172.21.15.50:0/425804394 shutdown_connections 2024-09-11T22:21:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.995+0000 7fe865b3a640 1 -- 172.21.15.50:0/425804394 wait complete. 2024-09-11T22:21:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.997+0000 7fe865b3a640 1 Processor -- start 2024-09-11T22:21:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.997+0000 7fe865b3a640 1 -- start start 2024-09-11T22:21:58.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.997+0000 7fe865b3a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8600728e0 0x7fe860141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.997+0000 7fe865b3a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8600735a0 0x7fe860159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.997+0000 7fe865b3a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe86015c240 0x7fe860159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.997+0000 7fe865b3a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe8600b3f70 con 0x7fe86015c240 2024-09-11T22:21:58.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.997+0000 7fe865b3a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe86015fb20 con 0x7fe8600728e0 2024-09-11T22:21:58.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.997+0000 7fe865b3a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe8600b4250 con 0x7fe8600735a0 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe85ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe86015c240 0x7fe860159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe85ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe86015c240 0x7fe860159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48434/0 (socket says 172.21.15.50:48434) 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe85ffff640 1 -- 172.21.15.50:0/3885270870 learned_addr learned my addr 172.21.15.50:0/3885270870 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe85f7fe640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8600728e0 0x7fe860141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe85effd640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8600735a0 0x7fe860159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe85ffff640 1 -- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8600735a0 msgr2=0x7fe860159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe85ffff640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8600735a0 0x7fe860159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe85ffff640 1 -- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8600728e0 msgr2=0x7fe860141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe85ffff640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8600728e0 0x7fe860141760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe85ffff640 1 -- 172.21.15.50:0/3885270870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8600cd820 con 0x7fe86015c240 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe85ffff640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe86015c240 0x7fe860159590 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fe85802ac70 tx=0x7fe858004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe847fff640 1 -- 172.21.15.50:0/3885270870 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858040070 con 0x7fe86015c240 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe847fff640 1 -- 172.21.15.50:0/3885270870 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe858031bc0 con 0x7fe86015c240 2024-09-11T22:21:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe865b3a640 1 -- 172.21.15.50:0/3885270870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8600cdac0 con 0x7fe86015c240 2024-09-11T22:21:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe847fff640 1 -- 172.21.15.50:0/3885270870 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858009450 con 0x7fe86015c240 2024-09-11T22:21:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.998+0000 7fe865b3a640 1 -- 172.21.15.50:0/3885270870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8600ce080 con 0x7fe86015c240 2024-09-11T22:21:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:57.999+0000 7fe865b3a640 1 -- 172.21.15.50:0/3885270870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe860072cf0 con 0x7fe86015c240 2024-09-11T22:21:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.000+0000 7fe847fff640 1 -- 172.21.15.50:0/3885270870 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe858039040 con 0x7fe86015c240 2024-09-11T22:21:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.000+0000 7fe847fff640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe84c06be60 0x7fe84c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.000+0000 7fe847fff640 1 -- 172.21.15.50:0/3885270870 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7fe8580ac4e0 con 0x7fe86015c240 2024-09-11T22:21:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.000+0000 7fe85f7fe640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe84c06be60 0x7fe84c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.001+0000 7fe85f7fe640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe84c06be60 0x7fe84c06e320 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe850009aa0 tx=0x7fe850009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.004+0000 7fe847fff640 1 -- 172.21.15.50:0/3885270870 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe85807a8c0 con 0x7fe86015c240 2024-09-11T22:21:58.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.174+0000 7fe865b3a640 1 -- 172.21.15.50:0/3885270870 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe8600b0b40 con 0x7fe84c06be60 2024-09-11T22:21:58.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.181+0000 7fe847fff640 1 -- 172.21.15.50:0/3885270870 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248228 (secure 0 0 0) 0x7fe8600b0b40 con 0x7fe84c06be60 2024-09-11T22:21:58.184 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:21:58.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.184+0000 7fe865b3a640 1 -- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe84c06be60 msgr2=0x7fe84c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.184+0000 7fe865b3a640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe84c06be60 0x7fe84c06e320 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe850009aa0 tx=0x7fe850009190 comp rx=0 tx=0).stop 2024-09-11T22:21:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.184+0000 7fe865b3a640 1 -- 172.21.15.50:0/3885270870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe86015c240 msgr2=0x7fe860159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.184+0000 7fe865b3a640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe86015c240 0x7fe860159590 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fe85802ac70 tx=0x7fe858004a40 comp rx=0 tx=0).stop 2024-09-11T22:21:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.184+0000 7fe865b3a640 1 -- 172.21.15.50:0/3885270870 shutdown_connections 2024-09-11T22:21:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.184+0000 7fe865b3a640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe84c06be60 0x7fe84c06e320 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.184+0000 7fe865b3a640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8600735a0 0x7fe860159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.184+0000 7fe865b3a640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe86015c240 0x7fe860159590 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.184+0000 7fe865b3a640 1 --2- 172.21.15.50:0/3885270870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8600728e0 0x7fe860141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.184+0000 7fe865b3a640 1 -- 172.21.15.50:0/3885270870 >> 172.21.15.50:0/3885270870 conn(0x7fe8600b2bd0 msgr2=0x7fe86015eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.184+0000 7fe865b3a640 1 -- 172.21.15.50:0/3885270870 shutdown_connections 2024-09-11T22:21:58.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.184+0000 7fe865b3a640 1 -- 172.21.15.50:0/3885270870 wait complete. 2024-09-11T22:21:58.196 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":488,"stamp":"2024-09-11T22:21:57.519343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":432104,"kb_used_data":17388,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754542616,"statfs":{"total":773094113280,"available":772651638784,"internally_reserved":0,"allocated":17805312,"data_stored":8465148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":424463921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.025318"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661419+0000","last_change":"2024-09-11T22:21:54.528415+0000","last_active":"2024-09-11T22:21:55.661419+0000","last_peered":"2024-09-11T22:21:55.661419+0000","last_clean":"2024-09-11T22:21:55.661419+0000","last_became_active":"2024-09-11T22:21:54.527822+0000","last_became_peered":"2024-09-11T22:21:54.527822+0000","last_unstale":"2024-09-11T22:21:55.661419+0000","last_undegraded":"2024-09-11T22:21:55.661419+0000","last_fullsized":"2024-09-11T22:21:55.661419+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:49.445914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507816+0000","last_change":"2024-09-11T22:21:53.507816+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507816+0000","last_undegraded":"2024-09-11T22:21:53.507816+0000","last_fullsized":"2024-09-11T22:21:53.507816+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.509597+0000","last_change":"2024-09-11T22:21:53.509597+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.509597+0000","last_undegraded":"2024-09-11T22:21:53.509597+0000","last_fullsized":"2024-09-11T22:21:53.509597+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507367+0000","last_change":"2024-09-11T22:21:53.507367+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507367+0000","last_undegraded":"2024-09-11T22:21:53.507367+0000","last_fullsized":"2024-09-11T22:21:53.507367+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662155+0000","last_change":"2024-09-11T22:21:54.508029+0000","last_active":"2024-09-11T22:21:55.662155+0000","last_peered":"2024-09-11T22:21:55.662155+0000","last_clean":"2024-09-11T22:21:55.662155+0000","last_became_active":"2024-09-11T22:21:54.507700+0000","last_became_peered":"2024-09-11T22:21:54.507700+0000","last_unstale":"2024-09-11T22:21:55.662155+0000","last_undegraded":"2024-09-11T22:21:55.662155+0000","last_fullsized":"2024-09-11T22:21:55.662155+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:40.629965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.509168+0000","last_change":"2024-09-11T22:21:53.509168+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.509168+0000","last_undegraded":"2024-09-11T22:21:53.509168+0000","last_fullsized":"2024-09-11T22:21:53.509168+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501927+0000","last_change":"2024-09-11T22:21:53.501927+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501927+0000","last_undegraded":"2024-09-11T22:21:53.501927+0000","last_fullsized":"2024-09-11T22:21:53.501927+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506479+0000","last_change":"2024-09-11T22:21:53.506479+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506479+0000","last_undegraded":"2024-09-11T22:21:53.506479+0000","last_fullsized":"2024-09-11T22:21:53.506479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502071+0000","last_change":"2024-09-11T22:21:53.502071+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502071+0000","last_undegraded":"2024-09-11T22:21:53.502071+0000","last_fullsized":"2024-09-11T22:21:53.502071+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506510+0000","last_change":"2024-09-11T22:21:53.506510+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506510+0000","last_undegraded":"2024-09-11T22:21:53.506510+0000","last_fullsized":"2024-09-11T22:21:53.506510+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502130+0000","last_change":"2024-09-11T22:21:53.502130+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502130+0000","last_undegraded":"2024-09-11T22:21:53.502130+0000","last_fullsized":"2024-09-11T22:21:53.502130+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506958+0000","last_change":"2024-09-11T22:21:53.506958+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506958+0000","last_undegraded":"2024-09-11T22:21:53.506958+0000","last_fullsized":"2024-09-11T22:21:53.506958+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505523+0000","last_change":"2024-09-11T22:21:53.505523+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505523+0000","last_undegraded":"2024-09-11T22:21:53.505523+0000","last_fullsized":"2024-09-11T22:21:53.505523+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504093+0000","last_change":"2024-09-11T22:21:53.504093+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504093+0000","last_undegraded":"2024-09-11T22:21:53.504093+0000","last_fullsized":"2024-09-11T22:21:53.504093+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506839+0000","last_change":"2024-09-11T22:21:53.506839+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506839+0000","last_undegraded":"2024-09-11T22:21:53.506839+0000","last_fullsized":"2024-09-11T22:21:53.506839+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505949+0000","last_change":"2024-09-11T22:21:53.505949+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505949+0000","last_undegraded":"2024-09-11T22:21:53.505949+0000","last_fullsized":"2024-09-11T22:21:53.505949+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662501+0000","last_change":"2024-09-11T22:21:54.514748+0000","last_active":"2024-09-11T22:21:55.662501+0000","last_peered":"2024-09-11T22:21:55.662501+0000","last_clean":"2024-09-11T22:21:55.662501+0000","last_became_active":"2024-09-11T22:21:54.513842+0000","last_became_peered":"2024-09-11T22:21:54.513842+0000","last_unstale":"2024-09-11T22:21:55.662501+0000","last_undegraded":"2024-09-11T22:21:55.662501+0000","last_fullsized":"2024-09-11T22:21:55.662501+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:12.924567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661317+0000","last_change":"2024-09-11T22:21:54.520984+0000","last_active":"2024-09-11T22:21:55.661317+0000","last_peered":"2024-09-11T22:21:55.661317+0000","last_clean":"2024-09-11T22:21:55.661317+0000","last_became_active":"2024-09-11T22:21:54.520709+0000","last_became_peered":"2024-09-11T22:21:54.520709+0000","last_unstale":"2024-09-11T22:21:55.661317+0000","last_undegraded":"2024-09-11T22:21:55.661317+0000","last_fullsized":"2024-09-11T22:21:55.661317+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:25.359697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507045+0000","last_change":"2024-09-11T22:21:53.507045+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507045+0000","last_undegraded":"2024-09-11T22:21:53.507045+0000","last_fullsized":"2024-09-11T22:21:53.507045+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661330+0000","last_change":"2024-09-11T22:21:54.515669+0000","last_active":"2024-09-11T22:21:55.661330+0000","last_peered":"2024-09-11T22:21:55.661330+0000","last_clean":"2024-09-11T22:21:55.661330+0000","last_became_active":"2024-09-11T22:21:54.515148+0000","last_became_peered":"2024-09-11T22:21:54.515148+0000","last_unstale":"2024-09-11T22:21:55.661330+0000","last_undegraded":"2024-09-11T22:21:55.661330+0000","last_fullsized":"2024-09-11T22:21:55.661330+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:04.614538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662272+0000","last_change":"2024-09-11T22:21:54.508697+0000","last_active":"2024-09-11T22:21:55.662272+0000","last_peered":"2024-09-11T22:21:55.662272+0000","last_clean":"2024-09-11T22:21:55.662272+0000","last_became_active":"2024-09-11T22:21:54.508434+0000","last_became_peered":"2024-09-11T22:21:54.508434+0000","last_unstale":"2024-09-11T22:21:55.662272+0000","last_undegraded":"2024-09-11T22:21:55.662272+0000","last_fullsized":"2024-09-11T22:21:55.662272+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:27.764226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507747+0000","last_change":"2024-09-11T22:21:53.507747+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507747+0000","last_undegraded":"2024-09-11T22:21:53.507747+0000","last_fullsized":"2024-09-11T22:21:53.507747+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.508697+0000","last_change":"2024-09-11T22:21:53.508697+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.508697+0000","last_undegraded":"2024-09-11T22:21:53.508697+0000","last_fullsized":"2024-09-11T22:21:53.508697+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505388+0000","last_change":"2024-09-11T22:21:53.505388+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505388+0000","last_undegraded":"2024-09-11T22:21:53.505388+0000","last_fullsized":"2024-09-11T22:21:53.505388+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504874+0000","last_change":"2024-09-11T22:21:53.504874+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504874+0000","last_undegraded":"2024-09-11T22:21:53.504874+0000","last_fullsized":"2024-09-11T22:21:53.504874+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501814+0000","last_change":"2024-09-11T22:21:53.501814+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501814+0000","last_undegraded":"2024-09-11T22:21:53.501814+0000","last_fullsized":"2024-09-11T22:21:53.501814+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.508195+0000","last_change":"2024-09-11T22:21:53.508195+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.508195+0000","last_undegraded":"2024-09-11T22:21:53.508195+0000","last_fullsized":"2024-09-11T22:21:53.508195+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661468+0000","last_change":"2024-09-11T22:21:54.525452+0000","last_active":"2024-09-11T22:21:55.661468+0000","last_peered":"2024-09-11T22:21:55.661468+0000","last_clean":"2024-09-11T22:21:55.661468+0000","last_became_active":"2024-09-11T22:21:54.525190+0000","last_became_peered":"2024-09-11T22:21:54.525190+0000","last_unstale":"2024-09-11T22:21:55.661468+0000","last_undegraded":"2024-09-11T22:21:55.661468+0000","last_fullsized":"2024-09-11T22:21:55.661468+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:34.452375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504891+0000","last_change":"2024-09-11T22:21:53.504891+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504891+0000","last_undegraded":"2024-09-11T22:21:53.504891+0000","last_fullsized":"2024-09-11T22:21:53.504891+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503691+0000","last_change":"2024-09-11T22:21:53.503691+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503691+0000","last_undegraded":"2024-09-11T22:21:53.503691+0000","last_fullsized":"2024-09-11T22:21:53.503691+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507644+0000","last_change":"2024-09-11T22:21:53.507644+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507644+0000","last_undegraded":"2024-09-11T22:21:53.507644+0000","last_fullsized":"2024-09-11T22:21:53.507644+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660471+0000","last_change":"2024-09-11T22:21:54.516160+0000","last_active":"2024-09-11T22:21:55.660471+0000","last_peered":"2024-09-11T22:21:55.660471+0000","last_clean":"2024-09-11T22:21:55.660471+0000","last_became_active":"2024-09-11T22:21:54.515856+0000","last_became_peered":"2024-09-11T22:21:54.515856+0000","last_unstale":"2024-09-11T22:21:55.660471+0000","last_undegraded":"2024-09-11T22:21:55.660471+0000","last_fullsized":"2024-09-11T22:21:55.660471+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:14.951034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505391+0000","last_change":"2024-09-11T22:21:53.505391+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505391+0000","last_undegraded":"2024-09-11T22:21:53.505391+0000","last_fullsized":"2024-09-11T22:21:53.505391+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"166'4","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662460+0000","last_change":"2024-09-11T22:21:53.517954+0000","last_active":"2024-09-11T22:21:55.662460+0000","last_peered":"2024-09-11T22:21:55.662460+0000","last_clean":"2024-09-11T22:21:55.662460+0000","last_became_active":"2024-09-11T22:21:53.517676+0000","last_became_peered":"2024-09-11T22:21:53.517676+0000","last_unstale":"2024-09-11T22:21:55.662460+0000","last_undegraded":"2024-09-11T22:21:55.662460+0000","last_fullsized":"2024-09-11T22:21:55.662460+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:45.277715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505972+0000","last_change":"2024-09-11T22:21:53.505972+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505972+0000","last_undegraded":"2024-09-11T22:21:53.505972+0000","last_fullsized":"2024-09-11T22:21:53.505972+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.514976+0000","last_change":"2024-09-11T22:21:53.513909+0000","last_active":"2024-09-11T22:21:53.514976+0000","last_peered":"2024-09-11T22:21:53.514976+0000","last_clean":"2024-09-11T22:21:53.514976+0000","last_became_active":"2024-09-11T22:21:53.513485+0000","last_became_peered":"2024-09-11T22:21:53.513485+0000","last_unstale":"2024-09-11T22:21:53.514976+0000","last_undegraded":"2024-09-11T22:21:53.514976+0000","last_fullsized":"2024-09-11T22:21:53.514976+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:21.887542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503309+0000","last_change":"2024-09-11T22:21:53.503309+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503309+0000","last_undegraded":"2024-09-11T22:21:53.503309+0000","last_fullsized":"2024-09-11T22:21:53.503309+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.522546+0000","last_change":"2024-09-11T22:21:53.521872+0000","last_active":"2024-09-11T22:21:53.522546+0000","last_peered":"2024-09-11T22:21:53.522546+0000","last_clean":"2024-09-11T22:21:53.522546+0000","last_became_active":"2024-09-11T22:21:53.520880+0000","last_became_peered":"2024-09-11T22:21:53.520880+0000","last_unstale":"2024-09-11T22:21:53.522546+0000","last_undegraded":"2024-09-11T22:21:53.522546+0000","last_fullsized":"2024-09-11T22:21:53.522546+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:05:35.606832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501517+0000","last_change":"2024-09-11T22:21:53.501517+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501517+0000","last_undegraded":"2024-09-11T22:21:53.501517+0000","last_fullsized":"2024-09-11T22:21:53.501517+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.515650+0000","last_change":"2024-09-11T22:21:53.515134+0000","last_active":"2024-09-11T22:21:53.515650+0000","last_peered":"2024-09-11T22:21:53.515650+0000","last_clean":"2024-09-11T22:21:53.515650+0000","last_became_active":"2024-09-11T22:21:53.514736+0000","last_became_peered":"2024-09-11T22:21:53.514736+0000","last_unstale":"2024-09-11T22:21:53.515650+0000","last_undegraded":"2024-09-11T22:21:53.515650+0000","last_fullsized":"2024-09-11T22:21:53.515650+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:03.561959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507027+0000","last_change":"2024-09-11T22:21:53.507027+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507027+0000","last_undegraded":"2024-09-11T22:21:53.507027+0000","last_fullsized":"2024-09-11T22:21:53.507027+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662211+0000","last_change":"2024-09-11T22:21:53.520007+0000","last_active":"2024-09-11T22:21:55.662211+0000","last_peered":"2024-09-11T22:21:55.662211+0000","last_clean":"2024-09-11T22:21:55.662211+0000","last_became_active":"2024-09-11T22:21:53.519448+0000","last_became_peered":"2024-09-11T22:21:53.519448+0000","last_unstale":"2024-09-11T22:21:55.662211+0000","last_undegraded":"2024-09-11T22:21:55.662211+0000","last_fullsized":"2024-09-11T22:21:55.662211+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:52.290796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503779+0000","last_change":"2024-09-11T22:21:53.503779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503779+0000","last_undegraded":"2024-09-11T22:21:53.503779+0000","last_fullsized":"2024-09-11T22:21:53.503779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.512839+0000","last_change":"2024-09-11T22:21:53.511743+0000","last_active":"2024-09-11T22:21:53.512839+0000","last_peered":"2024-09-11T22:21:53.512839+0000","last_clean":"2024-09-11T22:21:53.512839+0000","last_became_active":"2024-09-11T22:21:53.511450+0000","last_became_peered":"2024-09-11T22:21:53.511450+0000","last_unstale":"2024-09-11T22:21:53.512839+0000","last_undegraded":"2024-09-11T22:21:53.512839+0000","last_fullsized":"2024-09-11T22:21:53.512839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:39.080926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501342+0000","last_change":"2024-09-11T22:21:53.501342+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501342+0000","last_undegraded":"2024-09-11T22:21:53.501342+0000","last_fullsized":"2024-09-11T22:21:53.501342+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660883+0000","last_change":"2024-09-11T22:21:53.520690+0000","last_active":"2024-09-11T22:21:55.660883+0000","last_peered":"2024-09-11T22:21:55.660883+0000","last_clean":"2024-09-11T22:21:55.660883+0000","last_became_active":"2024-09-11T22:21:53.520402+0000","last_became_peered":"2024-09-11T22:21:53.520402+0000","last_unstale":"2024-09-11T22:21:55.660883+0000","last_undegraded":"2024-09-11T22:21:55.660883+0000","last_fullsized":"2024-09-11T22:21:55.660883+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:05.650500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507605+0000","last_change":"2024-09-11T22:21:53.507605+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507605+0000","last_undegraded":"2024-09-11T22:21:53.507605+0000","last_fullsized":"2024-09-11T22:21:53.507605+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.509960+0000","last_change":"2024-09-11T22:21:53.507631+0000","last_active":"2024-09-11T22:21:53.509960+0000","last_peered":"2024-09-11T22:21:53.509960+0000","last_clean":"2024-09-11T22:21:53.509960+0000","last_became_active":"2024-09-11T22:21:53.507356+0000","last_became_peered":"2024-09-11T22:21:53.507356+0000","last_unstale":"2024-09-11T22:21:53.509960+0000","last_undegraded":"2024-09-11T22:21:53.509960+0000","last_fullsized":"2024-09-11T22:21:53.509960+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:11.081873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504179+0000","last_change":"2024-09-11T22:21:53.504179+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504179+0000","last_undegraded":"2024-09-11T22:21:53.504179+0000","last_fullsized":"2024-09-11T22:21:53.504179+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662272+0000","last_change":"2024-09-11T22:21:53.516194+0000","last_active":"2024-09-11T22:21:55.662272+0000","last_peered":"2024-09-11T22:21:55.662272+0000","last_clean":"2024-09-11T22:21:55.662272+0000","last_became_active":"2024-09-11T22:21:53.515797+0000","last_became_peered":"2024-09-11T22:21:53.515797+0000","last_unstale":"2024-09-11T22:21:55.662272+0000","last_undegraded":"2024-09-11T22:21:55.662272+0000","last_fullsized":"2024-09-11T22:21:55.662272+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:03.962378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502888+0000","last_change":"2024-09-11T22:21:53.502888+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502888+0000","last_undegraded":"2024-09-11T22:21:53.502888+0000","last_fullsized":"2024-09-11T22:21:53.502888+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"166'3","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660472+0000","last_change":"2024-09-11T22:21:53.521712+0000","last_active":"2024-09-11T22:21:55.660472+0000","last_peered":"2024-09-11T22:21:55.660472+0000","last_clean":"2024-09-11T22:21:55.660472+0000","last_became_active":"2024-09-11T22:21:53.521403+0000","last_became_peered":"2024-09-11T22:21:53.521403+0000","last_unstale":"2024-09-11T22:21:55.660472+0000","last_undegraded":"2024-09-11T22:21:55.660472+0000","last_fullsized":"2024-09-11T22:21:55.660472+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:05.404784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506454+0000","last_change":"2024-09-11T22:21:53.506454+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506454+0000","last_undegraded":"2024-09-11T22:21:53.506454+0000","last_fullsized":"2024-09-11T22:21:53.506454+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.515735+0000","last_change":"2024-09-11T22:21:53.514233+0000","last_active":"2024-09-11T22:21:53.515735+0000","last_peered":"2024-09-11T22:21:53.515735+0000","last_clean":"2024-09-11T22:21:53.515735+0000","last_became_active":"2024-09-11T22:21:53.512269+0000","last_became_peered":"2024-09-11T22:21:53.512269+0000","last_unstale":"2024-09-11T22:21:53.515735+0000","last_undegraded":"2024-09-11T22:21:53.515735+0000","last_fullsized":"2024-09-11T22:21:53.515735+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:52.562386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507601+0000","last_change":"2024-09-11T22:21:53.507601+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507601+0000","last_undegraded":"2024-09-11T22:21:53.507601+0000","last_fullsized":"2024-09-11T22:21:53.507601+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"166'2","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661732+0000","last_change":"2024-09-11T22:21:53.522915+0000","last_active":"2024-09-11T22:21:55.661732+0000","last_peered":"2024-09-11T22:21:55.661732+0000","last_clean":"2024-09-11T22:21:55.661732+0000","last_became_active":"2024-09-11T22:21:53.522686+0000","last_became_peered":"2024-09-11T22:21:53.522686+0000","last_unstale":"2024-09-11T22:21:55.661732+0000","last_undegraded":"2024-09-11T22:21:55.661732+0000","last_fullsized":"2024-09-11T22:21:55.661732+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:34.088877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502957+0000","last_change":"2024-09-11T22:21:53.502957+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502957+0000","last_undegraded":"2024-09-11T22:21:53.502957+0000","last_fullsized":"2024-09-11T22:21:53.502957+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.521489+0000","last_change":"2024-09-11T22:21:53.517900+0000","last_active":"2024-09-11T22:21:53.521489+0000","last_peered":"2024-09-11T22:21:53.521489+0000","last_clean":"2024-09-11T22:21:53.521489+0000","last_became_active":"2024-09-11T22:21:53.517606+0000","last_became_peered":"2024-09-11T22:21:53.517606+0000","last_unstale":"2024-09-11T22:21:53.521489+0000","last_undegraded":"2024-09-11T22:21:53.521489+0000","last_fullsized":"2024-09-11T22:21:53.521489+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:49.422032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503384+0000","last_change":"2024-09-11T22:21:53.503384+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503384+0000","last_undegraded":"2024-09-11T22:21:53.503384+0000","last_fullsized":"2024-09-11T22:21:53.503384+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.512802+0000","last_change":"2024-09-11T22:21:53.511206+0000","last_active":"2024-09-11T22:21:53.512802+0000","last_peered":"2024-09-11T22:21:53.512802+0000","last_clean":"2024-09-11T22:21:53.512802+0000","last_became_active":"2024-09-11T22:21:53.510917+0000","last_became_peered":"2024-09-11T22:21:53.510917+0000","last_unstale":"2024-09-11T22:21:53.512802+0000","last_undegraded":"2024-09-11T22:21:53.512802+0000","last_fullsized":"2024-09-11T22:21:53.512802+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:33.324721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506421+0000","last_change":"2024-09-11T22:21:53.506421+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506421+0000","last_undegraded":"2024-09-11T22:21:53.506421+0000","last_fullsized":"2024-09-11T22:21:53.506421+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"166'8","reported_seq":22,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660994+0000","last_change":"2024-09-11T22:21:53.520671+0000","last_active":"2024-09-11T22:21:55.660994+0000","last_peered":"2024-09-11T22:21:55.660994+0000","last_clean":"2024-09-11T22:21:55.660994+0000","last_became_active":"2024-09-11T22:21:53.520444+0000","last_became_peered":"2024-09-11T22:21:53.520444+0000","last_unstale":"2024-09-11T22:21:55.660994+0000","last_undegraded":"2024-09-11T22:21:55.660994+0000","last_fullsized":"2024-09-11T22:21:55.660994+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:46.184129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505255+0000","last_change":"2024-09-11T22:21:53.505255+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505255+0000","last_undegraded":"2024-09-11T22:21:53.505255+0000","last_fullsized":"2024-09-11T22:21:53.505255+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662544+0000","last_change":"2024-09-11T22:21:53.514629+0000","last_active":"2024-09-11T22:21:55.662544+0000","last_peered":"2024-09-11T22:21:55.662544+0000","last_clean":"2024-09-11T22:21:55.662544+0000","last_became_active":"2024-09-11T22:21:53.514304+0000","last_became_peered":"2024-09-11T22:21:53.514304+0000","last_unstale":"2024-09-11T22:21:55.662544+0000","last_undegraded":"2024-09-11T22:21:55.662544+0000","last_fullsized":"2024-09-11T22:21:55.662544+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:43.852256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501498+0000","last_change":"2024-09-11T22:21:53.501498+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501498+0000","last_undegraded":"2024-09-11T22:21:53.501498+0000","last_fullsized":"2024-09-11T22:21:53.501498+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.510561+0000","last_change":"2024-09-11T22:21:53.509336+0000","last_active":"2024-09-11T22:21:53.510561+0000","last_peered":"2024-09-11T22:21:53.510561+0000","last_clean":"2024-09-11T22:21:53.510561+0000","last_became_active":"2024-09-11T22:21:53.509033+0000","last_became_peered":"2024-09-11T22:21:53.509033+0000","last_unstale":"2024-09-11T22:21:53.510561+0000","last_undegraded":"2024-09-11T22:21:53.510561+0000","last_fullsized":"2024-09-11T22:21:53.510561+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:37.593441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502623+0000","last_change":"2024-09-11T22:21:53.502623+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502623+0000","last_undegraded":"2024-09-11T22:21:53.502623+0000","last_fullsized":"2024-09-11T22:21:53.502623+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661647+0000","last_change":"2024-09-11T22:21:53.520425+0000","last_active":"2024-09-11T22:21:55.661647+0000","last_peered":"2024-09-11T22:21:55.661647+0000","last_clean":"2024-09-11T22:21:55.661647+0000","last_became_active":"2024-09-11T22:21:53.520189+0000","last_became_peered":"2024-09-11T22:21:53.520189+0000","last_unstale":"2024-09-11T22:21:55.661647+0000","last_undegraded":"2024-09-11T22:21:55.661647+0000","last_fullsized":"2024-09-11T22:21:55.661647+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:22.352739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504846+0000","last_change":"2024-09-11T22:21:53.504846+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504846+0000","last_undegraded":"2024-09-11T22:21:53.504846+0000","last_fullsized":"2024-09-11T22:21:53.504846+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.509932+0000","last_change":"2024-09-11T22:21:53.508764+0000","last_active":"2024-09-11T22:21:53.509932+0000","last_peered":"2024-09-11T22:21:53.509932+0000","last_clean":"2024-09-11T22:21:53.509932+0000","last_became_active":"2024-09-11T22:21:53.508451+0000","last_became_peered":"2024-09-11T22:21:53.508451+0000","last_unstale":"2024-09-11T22:21:53.509932+0000","last_undegraded":"2024-09-11T22:21:53.509932+0000","last_fullsized":"2024-09-11T22:21:53.509932+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:03.561959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506479+0000","last_change":"2024-09-11T22:21:53.506479+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506479+0000","last_undegraded":"2024-09-11T22:21:53.506479+0000","last_fullsized":"2024-09-11T22:21:53.506479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.522052+0000","last_change":"2024-09-11T22:21:53.520041+0000","last_active":"2024-09-11T22:21:53.522052+0000","last_peered":"2024-09-11T22:21:53.522052+0000","last_clean":"2024-09-11T22:21:53.522052+0000","last_became_active":"2024-09-11T22:21:53.519719+0000","last_became_peered":"2024-09-11T22:21:53.519719+0000","last_unstale":"2024-09-11T22:21:53.522052+0000","last_undegraded":"2024-09-11T22:21:53.522052+0000","last_fullsized":"2024-09-11T22:21:53.522052+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:53:23.483987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502414+0000","last_change":"2024-09-11T22:21:53.502414+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502414+0000","last_undegraded":"2024-09-11T22:21:53.502414+0000","last_fullsized":"2024-09-11T22:21:53.502414+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661095+0000","last_change":"2024-09-11T22:21:53.515176+0000","last_active":"2024-09-11T22:21:55.661095+0000","last_peered":"2024-09-11T22:21:55.661095+0000","last_clean":"2024-09-11T22:21:55.661095+0000","last_became_active":"2024-09-11T22:21:53.513869+0000","last_became_peered":"2024-09-11T22:21:53.513869+0000","last_unstale":"2024-09-11T22:21:55.661095+0000","last_undegraded":"2024-09-11T22:21:55.661095+0000","last_fullsized":"2024-09-11T22:21:55.661095+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:19.271785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506542+0000","last_change":"2024-09-11T22:21:53.506542+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506542+0000","last_undegraded":"2024-09-11T22:21:53.506542+0000","last_fullsized":"2024-09-11T22:21:53.506542+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.518914+0000","last_change":"2024-09-11T22:21:53.518061+0000","last_active":"2024-09-11T22:21:53.518914+0000","last_peered":"2024-09-11T22:21:53.518914+0000","last_clean":"2024-09-11T22:21:53.518914+0000","last_became_active":"2024-09-11T22:21:53.517766+0000","last_became_peered":"2024-09-11T22:21:53.517766+0000","last_unstale":"2024-09-11T22:21:53.518914+0000","last_undegraded":"2024-09-11T22:21:53.518914+0000","last_fullsized":"2024-09-11T22:21:53.518914+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:02.465092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661344+0000","last_change":"2024-09-11T22:21:54.512265+0000","last_active":"2024-09-11T22:21:55.661344+0000","last_peered":"2024-09-11T22:21:55.661344+0000","last_clean":"2024-09-11T22:21:55.661344+0000","last_became_active":"2024-09-11T22:21:54.511981+0000","last_became_peered":"2024-09-11T22:21:54.511981+0000","last_unstale":"2024-09-11T22:21:55.661344+0000","last_undegraded":"2024-09-11T22:21:55.661344+0000","last_fullsized":"2024-09-11T22:21:55.661344+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:19.038748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.511857+0000","last_change":"2024-09-11T22:21:53.510553+0000","last_active":"2024-09-11T22:21:53.511857+0000","last_peered":"2024-09-11T22:21:53.511857+0000","last_clean":"2024-09-11T22:21:53.511857+0000","last_became_active":"2024-09-11T22:21:53.510274+0000","last_became_peered":"2024-09-11T22:21:53.510274+0000","last_unstale":"2024-09-11T22:21:53.511857+0000","last_undegraded":"2024-09-11T22:21:53.511857+0000","last_fullsized":"2024-09-11T22:21:53.511857+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:07.278583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662247+0000","last_change":"2024-09-11T22:21:54.513344+0000","last_active":"2024-09-11T22:21:55.662247+0000","last_peered":"2024-09-11T22:21:55.662247+0000","last_clean":"2024-09-11T22:21:55.662247+0000","last_became_active":"2024-09-11T22:21:54.513063+0000","last_became_peered":"2024-09-11T22:21:54.513063+0000","last_unstale":"2024-09-11T22:21:55.662247+0000","last_undegraded":"2024-09-11T22:21:55.662247+0000","last_fullsized":"2024-09-11T22:21:55.662247+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:36.252373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"166'2","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661705+0000","last_change":"2024-09-11T22:21:53.521697+0000","last_active":"2024-09-11T22:21:55.661705+0000","last_peered":"2024-09-11T22:21:55.661705+0000","last_clean":"2024-09-11T22:21:55.661705+0000","last_became_active":"2024-09-11T22:21:53.521436+0000","last_became_peered":"2024-09-11T22:21:53.521436+0000","last_unstale":"2024-09-11T22:21:55.661705+0000","last_undegraded":"2024-09-11T22:21:55.661705+0000","last_fullsized":"2024-09-11T22:21:55.661705+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:32:22.006810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504365+0000","last_change":"2024-09-11T22:21:53.504365+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504365+0000","last_undegraded":"2024-09-11T22:21:53.504365+0000","last_fullsized":"2024-09-11T22:21:53.504365+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.520671+0000","last_change":"2024-09-11T22:21:53.518479+0000","last_active":"2024-09-11T22:21:53.520671+0000","last_peered":"2024-09-11T22:21:53.520671+0000","last_clean":"2024-09-11T22:21:53.520671+0000","last_became_active":"2024-09-11T22:21:53.518194+0000","last_became_peered":"2024-09-11T22:21:53.518194+0000","last_unstale":"2024-09-11T22:21:53.520671+0000","last_undegraded":"2024-09-11T22:21:53.520671+0000","last_fullsized":"2024-09-11T22:21:53.520671+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:01.768074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504806+0000","last_change":"2024-09-11T22:21:53.504806+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504806+0000","last_undegraded":"2024-09-11T22:21:53.504806+0000","last_fullsized":"2024-09-11T22:21:53.504806+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.520631+0000","last_change":"2024-09-11T22:21:53.519158+0000","last_active":"2024-09-11T22:21:53.520631+0000","last_peered":"2024-09-11T22:21:53.520631+0000","last_clean":"2024-09-11T22:21:53.520631+0000","last_became_active":"2024-09-11T22:21:53.518027+0000","last_became_peered":"2024-09-11T22:21:53.518027+0000","last_unstale":"2024-09-11T22:21:53.520631+0000","last_undegraded":"2024-09-11T22:21:53.520631+0000","last_fullsized":"2024-09-11T22:21:53.520631+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:18.276100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504426+0000","last_change":"2024-09-11T22:21:53.504426+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504426+0000","last_undegraded":"2024-09-11T22:21:53.504426+0000","last_fullsized":"2024-09-11T22:21:53.504426+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.510524+0000","last_change":"2024-09-11T22:21:53.508001+0000","last_active":"2024-09-11T22:21:53.510524+0000","last_peered":"2024-09-11T22:21:53.510524+0000","last_clean":"2024-09-11T22:21:53.510524+0000","last_became_active":"2024-09-11T22:21:53.507189+0000","last_became_peered":"2024-09-11T22:21:53.507189+0000","last_unstale":"2024-09-11T22:21:53.510524+0000","last_undegraded":"2024-09-11T22:21:53.510524+0000","last_fullsized":"2024-09-11T22:21:53.510524+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:29.484597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661479+0000","last_change":"2024-09-11T22:21:54.523677+0000","last_active":"2024-09-11T22:21:55.661479+0000","last_peered":"2024-09-11T22:21:55.661479+0000","last_clean":"2024-09-11T22:21:55.661479+0000","last_became_active":"2024-09-11T22:21:54.523304+0000","last_became_peered":"2024-09-11T22:21:54.523304+0000","last_unstale":"2024-09-11T22:21:55.661479+0000","last_undegraded":"2024-09-11T22:21:55.661479+0000","last_fullsized":"2024-09-11T22:21:55.661479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:08.351084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.513022+0000","last_change":"2024-09-11T22:21:53.510639+0000","last_active":"2024-09-11T22:21:53.513022+0000","last_peered":"2024-09-11T22:21:53.513022+0000","last_clean":"2024-09-11T22:21:53.513022+0000","last_became_active":"2024-09-11T22:21:53.510362+0000","last_became_peered":"2024-09-11T22:21:53.510362+0000","last_unstale":"2024-09-11T22:21:53.513022+0000","last_undegraded":"2024-09-11T22:21:53.513022+0000","last_fullsized":"2024-09-11T22:21:53.513022+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:58.370993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661714+0000","last_change":"2024-09-11T22:21:54.527134+0000","last_active":"2024-09-11T22:21:55.661714+0000","last_peered":"2024-09-11T22:21:55.661714+0000","last_clean":"2024-09-11T22:21:55.661714+0000","last_became_active":"2024-09-11T22:21:54.526844+0000","last_became_peered":"2024-09-11T22:21:54.526844+0000","last_unstale":"2024-09-11T22:21:55.661714+0000","last_undegraded":"2024-09-11T22:21:55.661714+0000","last_fullsized":"2024-09-11T22:21:55.661714+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:34.259306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.508910+0000","last_change":"2024-09-11T22:21:53.507391+0000","last_active":"2024-09-11T22:21:53.508910+0000","last_peered":"2024-09-11T22:21:53.508910+0000","last_clean":"2024-09-11T22:21:53.508910+0000","last_became_active":"2024-09-11T22:21:53.507076+0000","last_became_peered":"2024-09-11T22:21:53.507076+0000","last_unstale":"2024-09-11T22:21:53.508910+0000","last_undegraded":"2024-09-11T22:21:53.508910+0000","last_fullsized":"2024-09-11T22:21:53.508910+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:01.338325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506132+0000","last_change":"2024-09-11T22:21:53.506132+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506132+0000","last_undegraded":"2024-09-11T22:21:53.506132+0000","last_fullsized":"2024-09-11T22:21:53.506132+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.513642+0000","last_change":"2024-09-11T22:21:53.513015+0000","last_active":"2024-09-11T22:21:53.513642+0000","last_peered":"2024-09-11T22:21:53.513642+0000","last_clean":"2024-09-11T22:21:53.513642+0000","last_became_active":"2024-09-11T22:21:53.511892+0000","last_became_peered":"2024-09-11T22:21:53.511892+0000","last_unstale":"2024-09-11T22:21:53.513642+0000","last_undegraded":"2024-09-11T22:21:53.513642+0000","last_fullsized":"2024-09-11T22:21:53.513642+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:11.081873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661492+0000","last_change":"2024-09-11T22:21:54.516765+0000","last_active":"2024-09-11T22:21:55.661492+0000","last_peered":"2024-09-11T22:21:55.661492+0000","last_clean":"2024-09-11T22:21:55.661492+0000","last_became_active":"2024-09-11T22:21:54.516472+0000","last_became_peered":"2024-09-11T22:21:54.516472+0000","last_unstale":"2024-09-11T22:21:55.661492+0000","last_undegraded":"2024-09-11T22:21:55.661492+0000","last_fullsized":"2024-09-11T22:21:55.661492+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:03.343797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.519466+0000","last_change":"2024-09-11T22:21:53.518211+0000","last_active":"2024-09-11T22:21:53.519466+0000","last_peered":"2024-09-11T22:21:53.519466+0000","last_clean":"2024-09-11T22:21:53.519466+0000","last_became_active":"2024-09-11T22:21:53.517362+0000","last_became_peered":"2024-09-11T22:21:53.517362+0000","last_unstale":"2024-09-11T22:21:53.519466+0000","last_undegraded":"2024-09-11T22:21:53.519466+0000","last_fullsized":"2024-09-11T22:21:53.519466+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:20.248496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506231+0000","last_change":"2024-09-11T22:21:53.506231+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506231+0000","last_undegraded":"2024-09-11T22:21:53.506231+0000","last_fullsized":"2024-09-11T22:21:53.506231+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661259+0000","last_change":"2024-09-11T22:21:53.514489+0000","last_active":"2024-09-11T22:21:55.661259+0000","last_peered":"2024-09-11T22:21:55.661259+0000","last_clean":"2024-09-11T22:21:55.661259+0000","last_became_active":"2024-09-11T22:21:53.514203+0000","last_became_peered":"2024-09-11T22:21:53.514203+0000","last_unstale":"2024-09-11T22:21:55.661259+0000","last_undegraded":"2024-09-11T22:21:55.661259+0000","last_fullsized":"2024-09-11T22:21:55.661259+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:49.890240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":436,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661047+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:21:55.661047+0000","last_peered":"2024-09-11T22:21:55.661047+0000","last_clean":"2024-09-11T22:21:55.661047+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:21:55.661047+0000","last_undegraded":"2024-09-11T22:21:55.661047+0000","last_fullsized":"2024-09-11T22:21:55.661047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509575,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51256,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320584,"statfs":{"total":96636764160,"available":96584278016,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51260,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320580,"statfs":{"total":96636764160,"available":96584273920,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509574,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509574,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47100,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324740,"statfs":{"total":96636764160,"available":96588533760,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509573,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60160,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311680,"statfs":{"total":96636764160,"available":96575160320,"internally_reserved":0,"allocated":2662400,"data_stored":1497551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56028,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315812,"statfs":{"total":96636764160,"available":96579391488,"internally_reserved":0,"allocated":2695168,"data_stored":1510730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574981,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47140,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324700,"statfs":{"total":96636764160,"available":96588492800,"internally_reserved":0,"allocated":2105344,"data_stored":920952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:21:58.199 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3e is not active+clean 2024-09-11T22:21:58.200 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.507816+0000', 'last_change': '2024-09-11T22:21:53.507816+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.507816+0000', 'last_undegraded': '2024-09-11T22:21:53.507816+0000', 'last_fullsized': '2024-09-11T22:21:53.507816+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:21:58.200 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3d is not active+clean 2024-09-11T22:21:58.200 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.509597+0000', 'last_change': '2024-09-11T22:21:53.509597+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.509597+0000', 'last_undegraded': '2024-09-11T22:21:53.509597+0000', 'last_fullsized': '2024-09-11T22:21:53.509597+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:21:58.200 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3c is not active+clean 2024-09-11T22:21:58.200 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.507367+0000', 'last_change': '2024-09-11T22:21:53.507367+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.507367+0000', 'last_undegraded': '2024-09-11T22:21:53.507367+0000', 'last_fullsized': '2024-09-11T22:21:53.507367+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:21:58.200 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3a is not active+clean 2024-09-11T22:21:58.200 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.509168+0000', 'last_change': '2024-09-11T22:21:53.509168+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.509168+0000', 'last_undegraded': '2024-09-11T22:21:53.509168+0000', 'last_fullsized': '2024-09-11T22:21:53.509168+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:21:58.200 INFO:tasks.ceph.ceph_manager.ceph:PG 25.39 is not active+clean 2024-09-11T22:21:58.200 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.501927+0000', 'last_change': '2024-09-11T22:21:53.501927+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.501927+0000', 'last_undegraded': '2024-09-11T22:21:53.501927+0000', 'last_fullsized': '2024-09-11T22:21:53.501927+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:21:58.201 INFO:tasks.ceph.ceph_manager.ceph:PG 25.38 is not active+clean 2024-09-11T22:21:58.201 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.506479+0000', 'last_change': '2024-09-11T22:21:53.506479+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.506479+0000', 'last_undegraded': '2024-09-11T22:21:53.506479+0000', 'last_fullsized': '2024-09-11T22:21:53.506479+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:21:58.201 INFO:tasks.ceph.ceph_manager.ceph:PG 25.37 is not active+clean 2024-09-11T22:21:58.201 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.502071+0000', 'last_change': '2024-09-11T22:21:53.502071+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.502071+0000', 'last_undegraded': '2024-09-11T22:21:53.502071+0000', 'last_fullsized': '2024-09-11T22:21:53.502071+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:21:58.201 INFO:tasks.ceph.ceph_manager.ceph:PG 25.36 is not active+clean 2024-09-11T22:21:58.201 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.506510+0000', 'last_change': '2024-09-11T22:21:53.506510+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.506510+0000', 'last_undegraded': '2024-09-11T22:21:53.506510+0000', 'last_fullsized': '2024-09-11T22:21:53.506510+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:58.201 INFO:tasks.ceph.ceph_manager.ceph:PG 25.35 is not active+clean 2024-09-11T22:21:58.201 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.502130+0000', 'last_change': '2024-09-11T22:21:53.502130+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.502130+0000', 'last_undegraded': '2024-09-11T22:21:53.502130+0000', 'last_fullsized': '2024-09-11T22:21:53.502130+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:21:58.201 INFO:tasks.ceph.ceph_manager.ceph:PG 25.34 is not active+clean 2024-09-11T22:21:58.201 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.506958+0000', 'last_change': '2024-09-11T22:21:53.506958+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.506958+0000', 'last_undegraded': '2024-09-11T22:21:53.506958+0000', 'last_fullsized': '2024-09-11T22:21:53.506958+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:21:58.201 INFO:tasks.ceph.ceph_manager.ceph:PG 25.33 is not active+clean 2024-09-11T22:21:58.201 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.505523+0000', 'last_change': '2024-09-11T22:21:53.505523+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.505523+0000', 'last_undegraded': '2024-09-11T22:21:53.505523+0000', 'last_fullsized': '2024-09-11T22:21:53.505523+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:21:58.204 INFO:tasks.ceph.ceph_manager.ceph:PG 25.32 is not active+clean 2024-09-11T22:21:58.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.504093+0000', 'last_change': '2024-09-11T22:21:53.504093+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.504093+0000', 'last_undegraded': '2024-09-11T22:21:53.504093+0000', 'last_fullsized': '2024-09-11T22:21:53.504093+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:21:58.204 INFO:tasks.ceph.ceph_manager.ceph:PG 25.31 is not active+clean 2024-09-11T22:21:58.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.506839+0000', 'last_change': '2024-09-11T22:21:53.506839+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.506839+0000', 'last_undegraded': '2024-09-11T22:21:53.506839+0000', 'last_fullsized': '2024-09-11T22:21:53.506839+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:21:58.204 INFO:tasks.ceph.ceph_manager.ceph:PG 25.30 is not active+clean 2024-09-11T22:21:58.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.505949+0000', 'last_change': '2024-09-11T22:21:53.505949+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.505949+0000', 'last_undegraded': '2024-09-11T22:21:53.505949+0000', 'last_fullsized': '2024-09-11T22:21:53.505949+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:21:58.204 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2d is not active+clean 2024-09-11T22:21:58.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.507045+0000', 'last_change': '2024-09-11T22:21:53.507045+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.507045+0000', 'last_undegraded': '2024-09-11T22:21:53.507045+0000', 'last_fullsized': '2024-09-11T22:21:53.507045+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:58.205 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2a is not active+clean 2024-09-11T22:21:58.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.507747+0000', 'last_change': '2024-09-11T22:21:53.507747+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.507747+0000', 'last_undegraded': '2024-09-11T22:21:53.507747+0000', 'last_fullsized': '2024-09-11T22:21:53.507747+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:58.205 INFO:tasks.ceph.ceph_manager.ceph:PG 25.29 is not active+clean 2024-09-11T22:21:58.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.508697+0000', 'last_change': '2024-09-11T22:21:53.508697+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.508697+0000', 'last_undegraded': '2024-09-11T22:21:53.508697+0000', 'last_fullsized': '2024-09-11T22:21:53.508697+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:21:58.205 INFO:tasks.ceph.ceph_manager.ceph:PG 25.28 is not active+clean 2024-09-11T22:21:58.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.505388+0000', 'last_change': '2024-09-11T22:21:53.505388+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.505388+0000', 'last_undegraded': '2024-09-11T22:21:53.505388+0000', 'last_fullsized': '2024-09-11T22:21:53.505388+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:21:58.205 INFO:tasks.ceph.ceph_manager.ceph:PG 25.27 is not active+clean 2024-09-11T22:21:58.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.504874+0000', 'last_change': '2024-09-11T22:21:53.504874+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.504874+0000', 'last_undegraded': '2024-09-11T22:21:53.504874+0000', 'last_fullsized': '2024-09-11T22:21:53.504874+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:21:58.205 INFO:tasks.ceph.ceph_manager.ceph:PG 25.26 is not active+clean 2024-09-11T22:21:58.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.501814+0000', 'last_change': '2024-09-11T22:21:53.501814+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.501814+0000', 'last_undegraded': '2024-09-11T22:21:53.501814+0000', 'last_fullsized': '2024-09-11T22:21:53.501814+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:21:58.206 INFO:tasks.ceph.ceph_manager.ceph:PG 25.25 is not active+clean 2024-09-11T22:21:58.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.508195+0000', 'last_change': '2024-09-11T22:21:53.508195+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.508195+0000', 'last_undegraded': '2024-09-11T22:21:53.508195+0000', 'last_fullsized': '2024-09-11T22:21:53.508195+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:21:58.206 INFO:tasks.ceph.ceph_manager.ceph:PG 25.23 is not active+clean 2024-09-11T22:21:58.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.504891+0000', 'last_change': '2024-09-11T22:21:53.504891+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.504891+0000', 'last_undegraded': '2024-09-11T22:21:53.504891+0000', 'last_fullsized': '2024-09-11T22:21:53.504891+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:21:58.206 INFO:tasks.ceph.ceph_manager.ceph:PG 25.22 is not active+clean 2024-09-11T22:21:58.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.503691+0000', 'last_change': '2024-09-11T22:21:53.503691+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.503691+0000', 'last_undegraded': '2024-09-11T22:21:53.503691+0000', 'last_fullsized': '2024-09-11T22:21:53.503691+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:21:58.206 INFO:tasks.ceph.ceph_manager.ceph:PG 25.21 is not active+clean 2024-09-11T22:21:58.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.507644+0000', 'last_change': '2024-09-11T22:21:53.507644+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.507644+0000', 'last_undegraded': '2024-09-11T22:21:53.507644+0000', 'last_fullsized': '2024-09-11T22:21:53.507644+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:21:58.206 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1e is not active+clean 2024-09-11T22:21:58.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.505391+0000', 'last_change': '2024-09-11T22:21:53.505391+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.505391+0000', 'last_undegraded': '2024-09-11T22:21:53.505391+0000', 'last_fullsized': '2024-09-11T22:21:53.505391+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:21:58.206 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1f is not active+clean 2024-09-11T22:21:58.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.505972+0000', 'last_change': '2024-09-11T22:21:53.505972+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.505972+0000', 'last_undegraded': '2024-09-11T22:21:53.505972+0000', 'last_fullsized': '2024-09-11T22:21:53.505972+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:58.207 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1c is not active+clean 2024-09-11T22:21:58.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.503309+0000', 'last_change': '2024-09-11T22:21:53.503309+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.503309+0000', 'last_undegraded': '2024-09-11T22:21:53.503309+0000', 'last_fullsized': '2024-09-11T22:21:53.503309+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:21:58.207 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1d is not active+clean 2024-09-11T22:21:58.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.501517+0000', 'last_change': '2024-09-11T22:21:53.501517+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.501517+0000', 'last_undegraded': '2024-09-11T22:21:53.501517+0000', 'last_fullsized': '2024-09-11T22:21:53.501517+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:21:58.207 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1a is not active+clean 2024-09-11T22:21:58.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.507027+0000', 'last_change': '2024-09-11T22:21:53.507027+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.507027+0000', 'last_undegraded': '2024-09-11T22:21:53.507027+0000', 'last_fullsized': '2024-09-11T22:21:53.507027+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:58.207 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1b is not active+clean 2024-09-11T22:21:58.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.503779+0000', 'last_change': '2024-09-11T22:21:53.503779+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.503779+0000', 'last_undegraded': '2024-09-11T22:21:53.503779+0000', 'last_fullsized': '2024-09-11T22:21:53.503779+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:21:58.207 INFO:tasks.ceph.ceph_manager.ceph:PG 25.19 is not active+clean 2024-09-11T22:21:58.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.501342+0000', 'last_change': '2024-09-11T22:21:53.501342+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.501342+0000', 'last_undegraded': '2024-09-11T22:21:53.501342+0000', 'last_fullsized': '2024-09-11T22:21:53.501342+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:21:58.207 INFO:tasks.ceph.ceph_manager.ceph:PG 25.16 is not active+clean 2024-09-11T22:21:58.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.507605+0000', 'last_change': '2024-09-11T22:21:53.507605+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.507605+0000', 'last_undegraded': '2024-09-11T22:21:53.507605+0000', 'last_fullsized': '2024-09-11T22:21:53.507605+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:21:58.208 INFO:tasks.ceph.ceph_manager.ceph:PG 25.17 is not active+clean 2024-09-11T22:21:58.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.504179+0000', 'last_change': '2024-09-11T22:21:53.504179+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.504179+0000', 'last_undegraded': '2024-09-11T22:21:53.504179+0000', 'last_fullsized': '2024-09-11T22:21:53.504179+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:21:58.208 INFO:tasks.ceph.ceph_manager.ceph:PG 25.14 is not active+clean 2024-09-11T22:21:58.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.502888+0000', 'last_change': '2024-09-11T22:21:53.502888+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.502888+0000', 'last_undegraded': '2024-09-11T22:21:53.502888+0000', 'last_fullsized': '2024-09-11T22:21:53.502888+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:21:58.208 INFO:tasks.ceph.ceph_manager.ceph:PG 25.15 is not active+clean 2024-09-11T22:21:58.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.506454+0000', 'last_change': '2024-09-11T22:21:53.506454+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.506454+0000', 'last_undegraded': '2024-09-11T22:21:53.506454+0000', 'last_fullsized': '2024-09-11T22:21:53.506454+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:58.208 INFO:tasks.ceph.ceph_manager.ceph:PG 25.12 is not active+clean 2024-09-11T22:21:58.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.507601+0000', 'last_change': '2024-09-11T22:21:53.507601+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.507601+0000', 'last_undegraded': '2024-09-11T22:21:53.507601+0000', 'last_fullsized': '2024-09-11T22:21:53.507601+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:21:58.208 INFO:tasks.ceph.ceph_manager.ceph:PG 25.13 is not active+clean 2024-09-11T22:21:58.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.502957+0000', 'last_change': '2024-09-11T22:21:53.502957+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.502957+0000', 'last_undegraded': '2024-09-11T22:21:53.502957+0000', 'last_fullsized': '2024-09-11T22:21:53.502957+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:21:58.209 INFO:tasks.ceph.ceph_manager.ceph:PG 25.10 is not active+clean 2024-09-11T22:21:58.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.503384+0000', 'last_change': '2024-09-11T22:21:53.503384+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.503384+0000', 'last_undegraded': '2024-09-11T22:21:53.503384+0000', 'last_fullsized': '2024-09-11T22:21:53.503384+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:21:58.209 INFO:tasks.ceph.ceph_manager.ceph:PG 25.11 is not active+clean 2024-09-11T22:21:58.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.506421+0000', 'last_change': '2024-09-11T22:21:53.506421+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.506421+0000', 'last_undegraded': '2024-09-11T22:21:53.506421+0000', 'last_fullsized': '2024-09-11T22:21:53.506421+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:58.209 INFO:tasks.ceph.ceph_manager.ceph:PG 25.e is not active+clean 2024-09-11T22:21:58.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.505255+0000', 'last_change': '2024-09-11T22:21:53.505255+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.505255+0000', 'last_undegraded': '2024-09-11T22:21:53.505255+0000', 'last_fullsized': '2024-09-11T22:21:53.505255+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:58.209 INFO:tasks.ceph.ceph_manager.ceph:PG 25.f is not active+clean 2024-09-11T22:21:58.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.501498+0000', 'last_change': '2024-09-11T22:21:53.501498+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.501498+0000', 'last_undegraded': '2024-09-11T22:21:53.501498+0000', 'last_fullsized': '2024-09-11T22:21:53.501498+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:21:58.209 INFO:tasks.ceph.ceph_manager.ceph:PG 25.c is not active+clean 2024-09-11T22:21:58.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.502623+0000', 'last_change': '2024-09-11T22:21:53.502623+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.502623+0000', 'last_undegraded': '2024-09-11T22:21:53.502623+0000', 'last_fullsized': '2024-09-11T22:21:53.502623+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:21:58.209 INFO:tasks.ceph.ceph_manager.ceph:PG 25.d is not active+clean 2024-09-11T22:21:58.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.504846+0000', 'last_change': '2024-09-11T22:21:53.504846+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.504846+0000', 'last_undegraded': '2024-09-11T22:21:53.504846+0000', 'last_fullsized': '2024-09-11T22:21:53.504846+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:21:58.210 INFO:tasks.ceph.ceph_manager.ceph:PG 25.a is not active+clean 2024-09-11T22:21:58.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.506479+0000', 'last_change': '2024-09-11T22:21:53.506479+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.506479+0000', 'last_undegraded': '2024-09-11T22:21:53.506479+0000', 'last_fullsized': '2024-09-11T22:21:53.506479+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:58.210 INFO:tasks.ceph.ceph_manager.ceph:PG 25.b is not active+clean 2024-09-11T22:21:58.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.502414+0000', 'last_change': '2024-09-11T22:21:53.502414+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.502414+0000', 'last_undegraded': '2024-09-11T22:21:53.502414+0000', 'last_fullsized': '2024-09-11T22:21:53.502414+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:21:58.210 INFO:tasks.ceph.ceph_manager.ceph:PG 25.8 is not active+clean 2024-09-11T22:21:58.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.506542+0000', 'last_change': '2024-09-11T22:21:53.506542+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.506542+0000', 'last_undegraded': '2024-09-11T22:21:53.506542+0000', 'last_fullsized': '2024-09-11T22:21:53.506542+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:21:58.210 INFO:tasks.ceph.ceph_manager.ceph:PG 25.7 is not active+clean 2024-09-11T22:21:58.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.504365+0000', 'last_change': '2024-09-11T22:21:53.504365+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.504365+0000', 'last_undegraded': '2024-09-11T22:21:53.504365+0000', 'last_fullsized': '2024-09-11T22:21:53.504365+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:58.210 INFO:tasks.ceph.ceph_manager.ceph:PG 25.4 is not active+clean 2024-09-11T22:21:58.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.504806+0000', 'last_change': '2024-09-11T22:21:53.504806+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.504806+0000', 'last_undegraded': '2024-09-11T22:21:53.504806+0000', 'last_fullsized': '2024-09-11T22:21:53.504806+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:21:58.211 INFO:tasks.ceph.ceph_manager.ceph:PG 25.5 is not active+clean 2024-09-11T22:21:58.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.504426+0000', 'last_change': '2024-09-11T22:21:53.504426+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.504426+0000', 'last_undegraded': '2024-09-11T22:21:53.504426+0000', 'last_fullsized': '2024-09-11T22:21:53.504426+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:21:58.211 INFO:tasks.ceph.ceph_manager.ceph:PG 25.0 is not active+clean 2024-09-11T22:21:58.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.506132+0000', 'last_change': '2024-09-11T22:21:53.506132+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.506132+0000', 'last_undegraded': '2024-09-11T22:21:53.506132+0000', 'last_fullsized': '2024-09-11T22:21:53.506132+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:21:58.211 INFO:tasks.ceph.ceph_manager.ceph:PG 25.18 is not active+clean 2024-09-11T22:21:58.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:21:53.506231+0000', 'last_change': '2024-09-11T22:21:53.506231+0000', 'last_active': '2024-09-11T22:21:53.492779+0000', 'last_peered': '2024-09-11T22:21:53.492779+0000', 'last_clean': '2024-09-11T22:21:53.492779+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:21:53.506231+0000', 'last_undegraded': '2024-09-11T22:21:53.506231+0000', 'last_fullsized': '2024-09-11T22:21:53.506231+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'last_clean_scrub_stamp': '2024-09-11T22:21:53.492779+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:58.212 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:21:58.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.337+0000 7f0bc8e42640 1 Processor -- start 2024-09-11T22:21:58.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.337+0000 7f0bc8e42640 1 -- start start 2024-09-11T22:21:58.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc8e42640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0bc40d1c90 0x7f0bc40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc8e42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bc4162350 0x7f0bc41627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc8e42640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc4163080 con 0x7f0bc415e8e0 2024-09-11T22:21:58.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc8e42640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc415ecc0 con 0x7f0bc40d1c90 2024-09-11T22:21:58.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc8e42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc40d2ad0 con 0x7f0bc4162350 2024-09-11T22:21:58.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc259c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0bc415e8e0 0x7f0bc40d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51448/0 (socket says 172.21.15.50:51448) 2024-09-11T22:21:58.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc259c640 1 -- 172.21.15.50:0/4146571888 learned_addr learned my addr 172.21.15.50:0/4146571888 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:58.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc1d9b640 1 --2- 172.21.15.50:0/4146571888 >> v2:172.21.15.77:3300/0 conn(0x7f0bc40d1c90 0x7f0bc40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc2d9d640 1 --2- 172.21.15.50:0/4146571888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bc4162350 0x7f0bc41627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc159a640 1 -- 172.21.15.50:0/4146571888 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627139291 0 0) 0x7f0bc4163080 con 0x7f0bc415e8e0 2024-09-11T22:21:58.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc159a640 1 -- 172.21.15.50:0/4146571888 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bac003520 con 0x7f0bc415e8e0 2024-09-11T22:21:58.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc159a640 1 -- 172.21.15.50:0/4146571888 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2647552278 0 0) 0x7f0bac003520 con 0x7f0bc415e8e0 2024-09-11T22:21:58.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc1d9b640 1 -- 172.21.15.50:0/4146571888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bc4162350 msgr2=0x7f0bc41627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:58.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc1d9b640 1 --2- 172.21.15.50:0/4146571888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bc4162350 0x7f0bc41627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc1d9b640 1 -- 172.21.15.50:0/4146571888 >> v1:172.21.15.50:6789/0 conn(0x7f0bc415e8e0 legacy=0x7f0bc40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.338+0000 7f0bc1d9b640 1 -- 172.21.15.50:0/4146571888 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc40d2d20 con 0x7f0bc40d1c90 2024-09-11T22:21:58.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.339+0000 7f0bc1d9b640 1 --2- 172.21.15.50:0/4146571888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bc40d1c90 0x7f0bc40b7880 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0bb80097a0 tx=0x7f0bb802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47fb3e5a5f8b71b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:58.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.339+0000 7f0bc159a640 1 -- 172.21.15.50:0/4146571888 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8037070 con 0x7f0bc40d1c90 2024-09-11T22:21:58.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.339+0000 7f0bc159a640 1 -- 172.21.15.50:0/4146571888 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb802ac30 con 0x7f0bc40d1c90 2024-09-11T22:21:58.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.339+0000 7f0bc159a640 1 -- 172.21.15.50:0/4146571888 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4001670 con 0x7f0bc40d1c90 2024-09-11T22:21:58.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.340+0000 7f0bc8e42640 1 -- 172.21.15.50:0/4146571888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bc40d1c90 msgr2=0x7f0bc40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.340+0000 7f0bc8e42640 1 --2- 172.21.15.50:0/4146571888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bc40d1c90 0x7f0bc40b7880 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0bb80097a0 tx=0x7f0bb802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.340+0000 7f0bc8e42640 1 -- 172.21.15.50:0/4146571888 shutdown_connections 2024-09-11T22:21:58.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.340+0000 7f0bc8e42640 1 --2- 172.21.15.50:0/4146571888 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bc4162350 0x7f0bc41627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.340+0000 7f0bc8e42640 1 --2- 172.21.15.50:0/4146571888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bc40d1c90 0x7f0bc40b7880 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.340+0000 7f0bc8e42640 1 -- 172.21.15.50:0/4146571888 >> 172.21.15.50:0/4146571888 conn(0x7f0bc4067ba0 msgr2=0x7f0bc4067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:58.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.340+0000 7f0bc8e42640 1 -- 172.21.15.50:0/4146571888 shutdown_connections 2024-09-11T22:21:58.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.340+0000 7f0bc8e42640 1 -- 172.21.15.50:0/4146571888 wait complete. 2024-09-11T22:21:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.341+0000 7f0bc8e42640 1 Processor -- start 2024-09-11T22:21:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.341+0000 7f0bc8e42640 1 -- start start 2024-09-11T22:21:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.342+0000 7f0bc8e42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bc40d1c90 0x7f0bc41f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.342+0000 7f0bc8e42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc415e8e0 0x7f0bc41f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.342+0000 7f0bc8e42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bc4162350 0x7f0bc41f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.342+0000 7f0bc8e42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc4162d20 con 0x7f0bc415e8e0 2024-09-11T22:21:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.342+0000 7f0bc8e42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc40d3370 con 0x7f0bc40d1c90 2024-09-11T22:21:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.342+0000 7f0bc8e42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc40d3800 con 0x7f0bc4162350 2024-09-11T22:21:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.342+0000 7f0bc1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc415e8e0 0x7f0bc41f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.342+0000 7f0bc1d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc415e8e0 0x7f0bc41f7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48436/0 (socket says 172.21.15.50:48436) 2024-09-11T22:21:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.342+0000 7f0bc1d9b640 1 -- 172.21.15.50:0/2368733310 learned_addr learned my addr 172.21.15.50:0/2368733310 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.342+0000 7f0bc259c640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bc40d1c90 0x7f0bc41f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.342+0000 7f0bc2d9d640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bc4162350 0x7f0bc41f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.343+0000 7f0bc1d9b640 1 -- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bc4162350 msgr2=0x7f0bc41f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.343+0000 7f0bc1d9b640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bc4162350 0x7f0bc41f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.343+0000 7f0bc1d9b640 1 -- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bc40d1c90 msgr2=0x7f0bc41f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.343+0000 7f0bc1d9b640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bc40d1c90 0x7f0bc41f5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.343+0000 7f0bc1d9b640 1 -- 172.21.15.50:0/2368733310 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc41f5a30 con 0x7f0bc415e8e0 2024-09-11T22:21:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.343+0000 7f0bc259c640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bc40d1c90 0x7f0bc41f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.343+0000 7f0bc1d9b640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc415e8e0 0x7f0bc41f7970 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8035040 tx=0x7f0bb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.343+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/2368733310 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8037050 con 0x7f0bc415e8e0 2024-09-11T22:21:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.343+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/2368733310 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb8043070 con 0x7f0bc415e8e0 2024-09-11T22:21:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.343+0000 7f0bc8e42640 1 -- 172.21.15.50:0/2368733310 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc40b4380 con 0x7f0bc415e8e0 2024-09-11T22:21:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.343+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/2368733310 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8006e10 con 0x7f0bc415e8e0 2024-09-11T22:21:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.343+0000 7f0bc8e42640 1 -- 172.21.15.50:0/2368733310 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc40b6bb0 con 0x7f0bc415e8e0 2024-09-11T22:21:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.344+0000 7f0bc8e42640 1 -- 172.21.15.50:0/2368733310 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc40b7880 con 0x7f0bc415e8e0 2024-09-11T22:21:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.345+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/2368733310 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0bb803ca10 con 0x7f0bc415e8e0 2024-09-11T22:21:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.345+0000 7f0bb2ffd640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ba406be30 0x7f0ba406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.345+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/2368733310 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f0bb80ab8f0 con 0x7f0bc415e8e0 2024-09-11T22:21:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.345+0000 7f0bc259c640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ba406be30 0x7f0ba406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.346+0000 7f0bc259c640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ba406be30 0x7f0ba406e2f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4005880 tx=0x7f0bb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:58.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.350+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/2368733310 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0bc41f5a30 con 0x7f0bc415e8e0 2024-09-11T22:21:58.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.594+0000 7f0bc8e42640 1 -- 172.21.15.50:0/2368733310 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0bc40ba770 con 0x7f0bc415e8e0 2024-09-11T22:21:58.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.594+0000 7f0bb2ffd640 1 -- 172.21.15.50:0/2368733310 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1307 (secure 0 0 0) 0x7f0bb807a450 con 0x7f0bc415e8e0 2024-09-11T22:21:58.595 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:58.595 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":667,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":167,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":51},{"state_name":"active+clean","count":46}],"num_pgs":97,"num_pools":3,"num_objects":15,"data_bytes":591166,"bytes_used":442474496,"bytes_avail":772651638784,"bytes_total":773094113280,"inactive_pgs_ratio":0.52577316761016846,"write_bytes_sec":2241,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":120,"btime":"2024-09-11T22:21:56:521160+0000","id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"b","status":"up:active","gid":9915}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":31,"modified":"2024-09-11T22:21:45.517121+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:21:58.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.596+0000 7f0bc8e42640 1 -- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ba406be30 msgr2=0x7f0ba406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.596+0000 7f0bc8e42640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ba406be30 0x7f0ba406e2f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4005880 tx=0x7f0bb4009040 comp rx=0 tx=0).stop 2024-09-11T22:21:58.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.596+0000 7f0bc8e42640 1 -- 172.21.15.50:0/2368733310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc415e8e0 msgr2=0x7f0bc41f7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.596+0000 7f0bc8e42640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc415e8e0 0x7f0bc41f7970 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8035040 tx=0x7f0bb80046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.596+0000 7f0bc8e42640 1 -- 172.21.15.50:0/2368733310 shutdown_connections 2024-09-11T22:21:58.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.596+0000 7f0bc8e42640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ba406be30 0x7f0ba406e2f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.596+0000 7f0bc8e42640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bc4162350 0x7f0bc41f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.596+0000 7f0bc8e42640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bc415e8e0 0x7f0bc41f7970 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.596+0000 7f0bc8e42640 1 --2- 172.21.15.50:0/2368733310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bc40d1c90 0x7f0bc41f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.596+0000 7f0bc8e42640 1 -- 172.21.15.50:0/2368733310 >> 172.21.15.50:0/2368733310 conn(0x7f0bc4067ba0 msgr2=0x7f0bc40b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.596+0000 7f0bc8e42640 1 -- 172.21.15.50:0/2368733310 shutdown_connections 2024-09-11T22:21:58.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.596+0000 7f0bc8e42640 1 -- 172.21.15.50:0/2368733310 wait complete. 2024-09-11T22:21:58.608 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:21:58.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:21:58.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.710+0000 7f8b549d6640 1 Processor -- start 2024-09-11T22:21:58.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.710+0000 7f8b549d6640 1 -- start start 2024-09-11T22:21:58.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.711+0000 7f8b549d6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b500cf580 0x7f8b500b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.711+0000 7f8b549d6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b500ce5f0 con 0x7f8b5015e840 2024-09-11T22:21:58.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.711+0000 7f8b549d6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b500ce310 con 0x7f8b500cdd50 2024-09-11T22:21:58.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.711+0000 7f8b549d6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8b5006c240 con 0x7f8b500cf580 2024-09-11T22:21:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.711+0000 7f8b4e59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8b5015e840 0x7f8b500cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51454/0 (socket says 172.21.15.50:51454) 2024-09-11T22:21:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.711+0000 7f8b4e59c640 1 -- 172.21.15.50:0/1646357784 learned_addr learned my addr 172.21.15.50:0/1646357784 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:21:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.711+0000 7f8b47fff640 1 --2- 172.21.15.50:0/1646357784 >> v2:172.21.15.77:3300/0 conn(0x7f8b500cf580 0x7f8b500b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.711+0000 7f8b4dd9b640 1 -- 172.21.15.50:0/1646357784 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3025542232 0 0) 0x7f8b500ce5f0 con 0x7f8b5015e840 2024-09-11T22:21:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.711+0000 7f8b4dd9b640 1 -- 172.21.15.50:0/1646357784 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b3c003520 con 0x7f8b5015e840 2024-09-11T22:21:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.711+0000 7f8b4dd9b640 1 -- 172.21.15.50:0/1646357784 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878367976 0 0) 0x7f8b500ce310 con 0x7f8b500cdd50 2024-09-11T22:21:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.711+0000 7f8b4dd9b640 1 -- 172.21.15.50:0/1646357784 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b500ce5f0 con 0x7f8b500cdd50 2024-09-11T22:21:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.712+0000 7f8b47fff640 1 -- 172.21.15.50:0/1646357784 >> v1:172.21.15.77:6789/0 conn(0x7f8b500cdd50 legacy=0x7f8b5006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.712+0000 7f8b47fff640 1 -- 172.21.15.50:0/1646357784 >> v1:172.21.15.50:6789/0 conn(0x7f8b5015e840 legacy=0x7f8b500cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.712+0000 7f8b4dd9b640 1 -- 172.21.15.50:0/1646357784 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3901923219 0 0) 0x7f8b3c003520 con 0x7f8b5015e840 2024-09-11T22:21:58.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.712+0000 7f8b47fff640 1 -- 172.21.15.50:0/1646357784 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5006bbf0 con 0x7f8b500cf580 2024-09-11T22:21:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.712+0000 7f8b47fff640 1 --2- 172.21.15.50:0/1646357784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b500cf580 0x7f8b500b4c70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8b380097a0 tx=0x7f8b3802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a5edbfe2a00365d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.713+0000 7f8b4dd9b640 1 -- 172.21.15.50:0/1646357784 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38037070 con 0x7f8b500cf580 2024-09-11T22:21:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.713+0000 7f8b4dd9b640 1 -- 172.21.15.50:0/1646357784 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3802ac50 con 0x7f8b500cf580 2024-09-11T22:21:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.713+0000 7f8b4dd9b640 1 -- 172.21.15.50:0/1646357784 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40001670 con 0x7f8b500cf580 2024-09-11T22:21:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.713+0000 7f8b549d6640 1 -- 172.21.15.50:0/1646357784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b500cf580 msgr2=0x7f8b500b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.713+0000 7f8b549d6640 1 --2- 172.21.15.50:0/1646357784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b500cf580 0x7f8b500b4c70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8b380097a0 tx=0x7f8b3802a1c0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.713+0000 7f8b549d6640 1 -- 172.21.15.50:0/1646357784 shutdown_connections 2024-09-11T22:21:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.713+0000 7f8b549d6640 1 --2- 172.21.15.50:0/1646357784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b500cf580 0x7f8b500b4c70 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.713+0000 7f8b549d6640 1 -- 172.21.15.50:0/1646357784 >> 172.21.15.50:0/1646357784 conn(0x7f8b500b4150 msgr2=0x7f8b500b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.713+0000 7f8b549d6640 1 -- 172.21.15.50:0/1646357784 shutdown_connections 2024-09-11T22:21:58.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.713+0000 7f8b549d6640 1 -- 172.21.15.50:0/1646357784 wait complete. 2024-09-11T22:21:58.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.714+0000 7f8b549d6640 1 Processor -- start 2024-09-11T22:21:58.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.715+0000 7f8b549d6640 1 -- start start 2024-09-11T22:21:58.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.715+0000 7f8b549d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b500cdd50 0x7f8b501f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.715+0000 7f8b549d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b500cf580 0x7f8b500b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.715+0000 7f8b549d6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b5015e840 0x7f8b500b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.715+0000 7f8b549d6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5015ec20 con 0x7f8b500cf580 2024-09-11T22:21:58.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.715+0000 7f8b549d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8b500d0470 con 0x7f8b500cdd50 2024-09-11T22:21:58.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.715+0000 7f8b549d6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5015eda0 con 0x7f8b5015e840 2024-09-11T22:21:58.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.715+0000 7f8b47fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b500cf580 0x7f8b500b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.715+0000 7f8b47fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b500cf580 0x7f8b500b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48448/0 (socket says 172.21.15.50:48448) 2024-09-11T22:21:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.715+0000 7f8b47fff640 1 -- 172.21.15.50:0/2682521489 learned_addr learned my addr 172.21.15.50:0/2682521489 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:21:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.716+0000 7f8b4e59c640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b500cdd50 0x7f8b501f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.716+0000 7f8b4ed9d640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b5015e840 0x7f8b500b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.716+0000 7f8b47fff640 1 -- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b5015e840 msgr2=0x7f8b500b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.716+0000 7f8b47fff640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b5015e840 0x7f8b500b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.716+0000 7f8b47fff640 1 -- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b500cdd50 msgr2=0x7f8b501f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.716+0000 7f8b47fff640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b500cdd50 0x7f8b501f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.716+0000 7f8b47fff640 1 -- 172.21.15.50:0/2682521489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b500b3b80 con 0x7f8b500cf580 2024-09-11T22:21:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.716+0000 7f8b47fff640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b500cf580 0x7f8b500b5450 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f8b380098c0 tx=0x7f8b380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.716+0000 7f8b46ffd640 1 -- 172.21.15.50:0/2682521489 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38041020 con 0x7f8b500cf580 2024-09-11T22:21:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.716+0000 7f8b46ffd640 1 -- 172.21.15.50:0/2682521489 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3803d420 con 0x7f8b500cf580 2024-09-11T22:21:58.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.716+0000 7f8b549d6640 1 -- 172.21.15.50:0/2682521489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b501f7c70 con 0x7f8b500cf580 2024-09-11T22:21:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.716+0000 7f8b46ffd640 1 -- 172.21.15.50:0/2682521489 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38037040 con 0x7f8b500cf580 2024-09-11T22:21:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.716+0000 7f8b549d6640 1 -- 172.21.15.50:0/2682521489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b501f8230 con 0x7f8b500cf580 2024-09-11T22:21:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.717+0000 7f8b549d6640 1 -- 172.21.15.50:0/2682521489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b500b4c70 con 0x7f8b500cf580 2024-09-11T22:21:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.718+0000 7f8b46ffd640 1 -- 172.21.15.50:0/2682521489 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b38044020 con 0x7f8b500cf580 2024-09-11T22:21:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.718+0000 7f8b46ffd640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b3006be30 0x7f8b3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.718+0000 7f8b46ffd640 1 -- 172.21.15.50:0/2682521489 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f8b380aadf0 con 0x7f8b500cf580 2024-09-11T22:21:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.718+0000 7f8b4e59c640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b3006be30 0x7f8b3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:58.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.719+0000 7f8b4e59c640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b3006be30 0x7f8b3006e2f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8b400011e0 tx=0x7f8b40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:58.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.722+0000 7f8b46ffd640 1 -- 172.21.15.50:0/2682521489 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b3804b070 con 0x7f8b500cf580 2024-09-11T22:21:58.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.893+0000 7f8b549d6640 1 -- 172.21.15.50:0/2682521489 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b500700d0 con 0x7f8b3006be30 2024-09-11T22:21:58.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.899+0000 7f8b46ffd640 1 -- 172.21.15.50:0/2682521489 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248228 (secure 0 0 0) 0x7f8b500700d0 con 0x7f8b3006be30 2024-09-11T22:21:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:21:58.904 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:21:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.902+0000 7f8b549d6640 1 -- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b3006be30 msgr2=0x7f8b3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.902+0000 7f8b549d6640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b3006be30 0x7f8b3006e2f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8b400011e0 tx=0x7f8b40009040 comp rx=0 tx=0).stop 2024-09-11T22:21:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.902+0000 7f8b549d6640 1 -- 172.21.15.50:0/2682521489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b500cf580 msgr2=0x7f8b500b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:58.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.902+0000 7f8b549d6640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b500cf580 0x7f8b500b5450 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f8b380098c0 tx=0x7f8b380046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.902+0000 7f8b549d6640 1 -- 172.21.15.50:0/2682521489 shutdown_connections 2024-09-11T22:21:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.902+0000 7f8b549d6640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8b3006be30 0x7f8b3006e2f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.902+0000 7f8b549d6640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b5015e840 0x7f8b500b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.902+0000 7f8b549d6640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b500cf580 0x7f8b500b5450 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.902+0000 7f8b549d6640 1 --2- 172.21.15.50:0/2682521489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b500cdd50 0x7f8b501f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.902+0000 7f8b549d6640 1 -- 172.21.15.50:0/2682521489 >> 172.21.15.50:0/2682521489 conn(0x7f8b500b4150 msgr2=0x7f8b500d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.902+0000 7f8b549d6640 1 -- 172.21.15.50:0/2682521489 shutdown_connections 2024-09-11T22:21:58.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:21:58.902+0000 7f8b549d6640 1 -- 172.21.15.50:0/2682521489 wait complete. 2024-09-11T22:21:58.914 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":488,"stamp":"2024-09-11T22:21:57.519343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":432104,"kb_used_data":17388,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754542616,"statfs":{"total":773094113280,"available":772651638784,"internally_reserved":0,"allocated":17805312,"data_stored":8465148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":424463921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.025318"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661419+0000","last_change":"2024-09-11T22:21:54.528415+0000","last_active":"2024-09-11T22:21:55.661419+0000","last_peered":"2024-09-11T22:21:55.661419+0000","last_clean":"2024-09-11T22:21:55.661419+0000","last_became_active":"2024-09-11T22:21:54.527822+0000","last_became_peered":"2024-09-11T22:21:54.527822+0000","last_unstale":"2024-09-11T22:21:55.661419+0000","last_undegraded":"2024-09-11T22:21:55.661419+0000","last_fullsized":"2024-09-11T22:21:55.661419+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:49.445914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507816+0000","last_change":"2024-09-11T22:21:53.507816+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507816+0000","last_undegraded":"2024-09-11T22:21:53.507816+0000","last_fullsized":"2024-09-11T22:21:53.507816+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.509597+0000","last_change":"2024-09-11T22:21:53.509597+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.509597+0000","last_undegraded":"2024-09-11T22:21:53.509597+0000","last_fullsized":"2024-09-11T22:21:53.509597+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507367+0000","last_change":"2024-09-11T22:21:53.507367+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507367+0000","last_undegraded":"2024-09-11T22:21:53.507367+0000","last_fullsized":"2024-09-11T22:21:53.507367+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662155+0000","last_change":"2024-09-11T22:21:54.508029+0000","last_active":"2024-09-11T22:21:55.662155+0000","last_peered":"2024-09-11T22:21:55.662155+0000","last_clean":"2024-09-11T22:21:55.662155+0000","last_became_active":"2024-09-11T22:21:54.507700+0000","last_became_peered":"2024-09-11T22:21:54.507700+0000","last_unstale":"2024-09-11T22:21:55.662155+0000","last_undegraded":"2024-09-11T22:21:55.662155+0000","last_fullsized":"2024-09-11T22:21:55.662155+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:40.629965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.509168+0000","last_change":"2024-09-11T22:21:53.509168+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.509168+0000","last_undegraded":"2024-09-11T22:21:53.509168+0000","last_fullsized":"2024-09-11T22:21:53.509168+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501927+0000","last_change":"2024-09-11T22:21:53.501927+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501927+0000","last_undegraded":"2024-09-11T22:21:53.501927+0000","last_fullsized":"2024-09-11T22:21:53.501927+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506479+0000","last_change":"2024-09-11T22:21:53.506479+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506479+0000","last_undegraded":"2024-09-11T22:21:53.506479+0000","last_fullsized":"2024-09-11T22:21:53.506479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502071+0000","last_change":"2024-09-11T22:21:53.502071+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502071+0000","last_undegraded":"2024-09-11T22:21:53.502071+0000","last_fullsized":"2024-09-11T22:21:53.502071+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506510+0000","last_change":"2024-09-11T22:21:53.506510+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506510+0000","last_undegraded":"2024-09-11T22:21:53.506510+0000","last_fullsized":"2024-09-11T22:21:53.506510+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502130+0000","last_change":"2024-09-11T22:21:53.502130+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502130+0000","last_undegraded":"2024-09-11T22:21:53.502130+0000","last_fullsized":"2024-09-11T22:21:53.502130+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506958+0000","last_change":"2024-09-11T22:21:53.506958+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506958+0000","last_undegraded":"2024-09-11T22:21:53.506958+0000","last_fullsized":"2024-09-11T22:21:53.506958+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505523+0000","last_change":"2024-09-11T22:21:53.505523+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505523+0000","last_undegraded":"2024-09-11T22:21:53.505523+0000","last_fullsized":"2024-09-11T22:21:53.505523+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504093+0000","last_change":"2024-09-11T22:21:53.504093+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504093+0000","last_undegraded":"2024-09-11T22:21:53.504093+0000","last_fullsized":"2024-09-11T22:21:53.504093+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506839+0000","last_change":"2024-09-11T22:21:53.506839+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506839+0000","last_undegraded":"2024-09-11T22:21:53.506839+0000","last_fullsized":"2024-09-11T22:21:53.506839+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505949+0000","last_change":"2024-09-11T22:21:53.505949+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505949+0000","last_undegraded":"2024-09-11T22:21:53.505949+0000","last_fullsized":"2024-09-11T22:21:53.505949+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662501+0000","last_change":"2024-09-11T22:21:54.514748+0000","last_active":"2024-09-11T22:21:55.662501+0000","last_peered":"2024-09-11T22:21:55.662501+0000","last_clean":"2024-09-11T22:21:55.662501+0000","last_became_active":"2024-09-11T22:21:54.513842+0000","last_became_peered":"2024-09-11T22:21:54.513842+0000","last_unstale":"2024-09-11T22:21:55.662501+0000","last_undegraded":"2024-09-11T22:21:55.662501+0000","last_fullsized":"2024-09-11T22:21:55.662501+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:12.924567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661317+0000","last_change":"2024-09-11T22:21:54.520984+0000","last_active":"2024-09-11T22:21:55.661317+0000","last_peered":"2024-09-11T22:21:55.661317+0000","last_clean":"2024-09-11T22:21:55.661317+0000","last_became_active":"2024-09-11T22:21:54.520709+0000","last_became_peered":"2024-09-11T22:21:54.520709+0000","last_unstale":"2024-09-11T22:21:55.661317+0000","last_undegraded":"2024-09-11T22:21:55.661317+0000","last_fullsized":"2024-09-11T22:21:55.661317+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:25.359697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507045+0000","last_change":"2024-09-11T22:21:53.507045+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507045+0000","last_undegraded":"2024-09-11T22:21:53.507045+0000","last_fullsized":"2024-09-11T22:21:53.507045+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661330+0000","last_change":"2024-09-11T22:21:54.515669+0000","last_active":"2024-09-11T22:21:55.661330+0000","last_peered":"2024-09-11T22:21:55.661330+0000","last_clean":"2024-09-11T22:21:55.661330+0000","last_became_active":"2024-09-11T22:21:54.515148+0000","last_became_peered":"2024-09-11T22:21:54.515148+0000","last_unstale":"2024-09-11T22:21:55.661330+0000","last_undegraded":"2024-09-11T22:21:55.661330+0000","last_fullsized":"2024-09-11T22:21:55.661330+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:04.614538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662272+0000","last_change":"2024-09-11T22:21:54.508697+0000","last_active":"2024-09-11T22:21:55.662272+0000","last_peered":"2024-09-11T22:21:55.662272+0000","last_clean":"2024-09-11T22:21:55.662272+0000","last_became_active":"2024-09-11T22:21:54.508434+0000","last_became_peered":"2024-09-11T22:21:54.508434+0000","last_unstale":"2024-09-11T22:21:55.662272+0000","last_undegraded":"2024-09-11T22:21:55.662272+0000","last_fullsized":"2024-09-11T22:21:55.662272+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:27.764226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507747+0000","last_change":"2024-09-11T22:21:53.507747+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507747+0000","last_undegraded":"2024-09-11T22:21:53.507747+0000","last_fullsized":"2024-09-11T22:21:53.507747+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.508697+0000","last_change":"2024-09-11T22:21:53.508697+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.508697+0000","last_undegraded":"2024-09-11T22:21:53.508697+0000","last_fullsized":"2024-09-11T22:21:53.508697+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505388+0000","last_change":"2024-09-11T22:21:53.505388+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505388+0000","last_undegraded":"2024-09-11T22:21:53.505388+0000","last_fullsized":"2024-09-11T22:21:53.505388+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504874+0000","last_change":"2024-09-11T22:21:53.504874+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504874+0000","last_undegraded":"2024-09-11T22:21:53.504874+0000","last_fullsized":"2024-09-11T22:21:53.504874+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501814+0000","last_change":"2024-09-11T22:21:53.501814+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501814+0000","last_undegraded":"2024-09-11T22:21:53.501814+0000","last_fullsized":"2024-09-11T22:21:53.501814+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.508195+0000","last_change":"2024-09-11T22:21:53.508195+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.508195+0000","last_undegraded":"2024-09-11T22:21:53.508195+0000","last_fullsized":"2024-09-11T22:21:53.508195+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661468+0000","last_change":"2024-09-11T22:21:54.525452+0000","last_active":"2024-09-11T22:21:55.661468+0000","last_peered":"2024-09-11T22:21:55.661468+0000","last_clean":"2024-09-11T22:21:55.661468+0000","last_became_active":"2024-09-11T22:21:54.525190+0000","last_became_peered":"2024-09-11T22:21:54.525190+0000","last_unstale":"2024-09-11T22:21:55.661468+0000","last_undegraded":"2024-09-11T22:21:55.661468+0000","last_fullsized":"2024-09-11T22:21:55.661468+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:34.452375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504891+0000","last_change":"2024-09-11T22:21:53.504891+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504891+0000","last_undegraded":"2024-09-11T22:21:53.504891+0000","last_fullsized":"2024-09-11T22:21:53.504891+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503691+0000","last_change":"2024-09-11T22:21:53.503691+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503691+0000","last_undegraded":"2024-09-11T22:21:53.503691+0000","last_fullsized":"2024-09-11T22:21:53.503691+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507644+0000","last_change":"2024-09-11T22:21:53.507644+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507644+0000","last_undegraded":"2024-09-11T22:21:53.507644+0000","last_fullsized":"2024-09-11T22:21:53.507644+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660471+0000","last_change":"2024-09-11T22:21:54.516160+0000","last_active":"2024-09-11T22:21:55.660471+0000","last_peered":"2024-09-11T22:21:55.660471+0000","last_clean":"2024-09-11T22:21:55.660471+0000","last_became_active":"2024-09-11T22:21:54.515856+0000","last_became_peered":"2024-09-11T22:21:54.515856+0000","last_unstale":"2024-09-11T22:21:55.660471+0000","last_undegraded":"2024-09-11T22:21:55.660471+0000","last_fullsized":"2024-09-11T22:21:55.660471+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:14.951034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505391+0000","last_change":"2024-09-11T22:21:53.505391+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505391+0000","last_undegraded":"2024-09-11T22:21:53.505391+0000","last_fullsized":"2024-09-11T22:21:53.505391+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"166'4","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662460+0000","last_change":"2024-09-11T22:21:53.517954+0000","last_active":"2024-09-11T22:21:55.662460+0000","last_peered":"2024-09-11T22:21:55.662460+0000","last_clean":"2024-09-11T22:21:55.662460+0000","last_became_active":"2024-09-11T22:21:53.517676+0000","last_became_peered":"2024-09-11T22:21:53.517676+0000","last_unstale":"2024-09-11T22:21:55.662460+0000","last_undegraded":"2024-09-11T22:21:55.662460+0000","last_fullsized":"2024-09-11T22:21:55.662460+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:45.277715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505972+0000","last_change":"2024-09-11T22:21:53.505972+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505972+0000","last_undegraded":"2024-09-11T22:21:53.505972+0000","last_fullsized":"2024-09-11T22:21:53.505972+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.514976+0000","last_change":"2024-09-11T22:21:53.513909+0000","last_active":"2024-09-11T22:21:53.514976+0000","last_peered":"2024-09-11T22:21:53.514976+0000","last_clean":"2024-09-11T22:21:53.514976+0000","last_became_active":"2024-09-11T22:21:53.513485+0000","last_became_peered":"2024-09-11T22:21:53.513485+0000","last_unstale":"2024-09-11T22:21:53.514976+0000","last_undegraded":"2024-09-11T22:21:53.514976+0000","last_fullsized":"2024-09-11T22:21:53.514976+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:21.887542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503309+0000","last_change":"2024-09-11T22:21:53.503309+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503309+0000","last_undegraded":"2024-09-11T22:21:53.503309+0000","last_fullsized":"2024-09-11T22:21:53.503309+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.522546+0000","last_change":"2024-09-11T22:21:53.521872+0000","last_active":"2024-09-11T22:21:53.522546+0000","last_peered":"2024-09-11T22:21:53.522546+0000","last_clean":"2024-09-11T22:21:53.522546+0000","last_became_active":"2024-09-11T22:21:53.520880+0000","last_became_peered":"2024-09-11T22:21:53.520880+0000","last_unstale":"2024-09-11T22:21:53.522546+0000","last_undegraded":"2024-09-11T22:21:53.522546+0000","last_fullsized":"2024-09-11T22:21:53.522546+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:05:35.606832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501517+0000","last_change":"2024-09-11T22:21:53.501517+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501517+0000","last_undegraded":"2024-09-11T22:21:53.501517+0000","last_fullsized":"2024-09-11T22:21:53.501517+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.515650+0000","last_change":"2024-09-11T22:21:53.515134+0000","last_active":"2024-09-11T22:21:53.515650+0000","last_peered":"2024-09-11T22:21:53.515650+0000","last_clean":"2024-09-11T22:21:53.515650+0000","last_became_active":"2024-09-11T22:21:53.514736+0000","last_became_peered":"2024-09-11T22:21:53.514736+0000","last_unstale":"2024-09-11T22:21:53.515650+0000","last_undegraded":"2024-09-11T22:21:53.515650+0000","last_fullsized":"2024-09-11T22:21:53.515650+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:03.561959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507027+0000","last_change":"2024-09-11T22:21:53.507027+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507027+0000","last_undegraded":"2024-09-11T22:21:53.507027+0000","last_fullsized":"2024-09-11T22:21:53.507027+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662211+0000","last_change":"2024-09-11T22:21:53.520007+0000","last_active":"2024-09-11T22:21:55.662211+0000","last_peered":"2024-09-11T22:21:55.662211+0000","last_clean":"2024-09-11T22:21:55.662211+0000","last_became_active":"2024-09-11T22:21:53.519448+0000","last_became_peered":"2024-09-11T22:21:53.519448+0000","last_unstale":"2024-09-11T22:21:55.662211+0000","last_undegraded":"2024-09-11T22:21:55.662211+0000","last_fullsized":"2024-09-11T22:21:55.662211+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:52.290796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503779+0000","last_change":"2024-09-11T22:21:53.503779+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503779+0000","last_undegraded":"2024-09-11T22:21:53.503779+0000","last_fullsized":"2024-09-11T22:21:53.503779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.512839+0000","last_change":"2024-09-11T22:21:53.511743+0000","last_active":"2024-09-11T22:21:53.512839+0000","last_peered":"2024-09-11T22:21:53.512839+0000","last_clean":"2024-09-11T22:21:53.512839+0000","last_became_active":"2024-09-11T22:21:53.511450+0000","last_became_peered":"2024-09-11T22:21:53.511450+0000","last_unstale":"2024-09-11T22:21:53.512839+0000","last_undegraded":"2024-09-11T22:21:53.512839+0000","last_fullsized":"2024-09-11T22:21:53.512839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:39.080926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501342+0000","last_change":"2024-09-11T22:21:53.501342+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501342+0000","last_undegraded":"2024-09-11T22:21:53.501342+0000","last_fullsized":"2024-09-11T22:21:53.501342+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660883+0000","last_change":"2024-09-11T22:21:53.520690+0000","last_active":"2024-09-11T22:21:55.660883+0000","last_peered":"2024-09-11T22:21:55.660883+0000","last_clean":"2024-09-11T22:21:55.660883+0000","last_became_active":"2024-09-11T22:21:53.520402+0000","last_became_peered":"2024-09-11T22:21:53.520402+0000","last_unstale":"2024-09-11T22:21:55.660883+0000","last_undegraded":"2024-09-11T22:21:55.660883+0000","last_fullsized":"2024-09-11T22:21:55.660883+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:05.650500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507605+0000","last_change":"2024-09-11T22:21:53.507605+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507605+0000","last_undegraded":"2024-09-11T22:21:53.507605+0000","last_fullsized":"2024-09-11T22:21:53.507605+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.509960+0000","last_change":"2024-09-11T22:21:53.507631+0000","last_active":"2024-09-11T22:21:53.509960+0000","last_peered":"2024-09-11T22:21:53.509960+0000","last_clean":"2024-09-11T22:21:53.509960+0000","last_became_active":"2024-09-11T22:21:53.507356+0000","last_became_peered":"2024-09-11T22:21:53.507356+0000","last_unstale":"2024-09-11T22:21:53.509960+0000","last_undegraded":"2024-09-11T22:21:53.509960+0000","last_fullsized":"2024-09-11T22:21:53.509960+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:11.081873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504179+0000","last_change":"2024-09-11T22:21:53.504179+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504179+0000","last_undegraded":"2024-09-11T22:21:53.504179+0000","last_fullsized":"2024-09-11T22:21:53.504179+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662272+0000","last_change":"2024-09-11T22:21:53.516194+0000","last_active":"2024-09-11T22:21:55.662272+0000","last_peered":"2024-09-11T22:21:55.662272+0000","last_clean":"2024-09-11T22:21:55.662272+0000","last_became_active":"2024-09-11T22:21:53.515797+0000","last_became_peered":"2024-09-11T22:21:53.515797+0000","last_unstale":"2024-09-11T22:21:55.662272+0000","last_undegraded":"2024-09-11T22:21:55.662272+0000","last_fullsized":"2024-09-11T22:21:55.662272+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:03.962378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502888+0000","last_change":"2024-09-11T22:21:53.502888+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502888+0000","last_undegraded":"2024-09-11T22:21:53.502888+0000","last_fullsized":"2024-09-11T22:21:53.502888+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"166'3","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660472+0000","last_change":"2024-09-11T22:21:53.521712+0000","last_active":"2024-09-11T22:21:55.660472+0000","last_peered":"2024-09-11T22:21:55.660472+0000","last_clean":"2024-09-11T22:21:55.660472+0000","last_became_active":"2024-09-11T22:21:53.521403+0000","last_became_peered":"2024-09-11T22:21:53.521403+0000","last_unstale":"2024-09-11T22:21:55.660472+0000","last_undegraded":"2024-09-11T22:21:55.660472+0000","last_fullsized":"2024-09-11T22:21:55.660472+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:05.404784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506454+0000","last_change":"2024-09-11T22:21:53.506454+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506454+0000","last_undegraded":"2024-09-11T22:21:53.506454+0000","last_fullsized":"2024-09-11T22:21:53.506454+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.515735+0000","last_change":"2024-09-11T22:21:53.514233+0000","last_active":"2024-09-11T22:21:53.515735+0000","last_peered":"2024-09-11T22:21:53.515735+0000","last_clean":"2024-09-11T22:21:53.515735+0000","last_became_active":"2024-09-11T22:21:53.512269+0000","last_became_peered":"2024-09-11T22:21:53.512269+0000","last_unstale":"2024-09-11T22:21:53.515735+0000","last_undegraded":"2024-09-11T22:21:53.515735+0000","last_fullsized":"2024-09-11T22:21:53.515735+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:52.562386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.507601+0000","last_change":"2024-09-11T22:21:53.507601+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.507601+0000","last_undegraded":"2024-09-11T22:21:53.507601+0000","last_fullsized":"2024-09-11T22:21:53.507601+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"166'2","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661732+0000","last_change":"2024-09-11T22:21:53.522915+0000","last_active":"2024-09-11T22:21:55.661732+0000","last_peered":"2024-09-11T22:21:55.661732+0000","last_clean":"2024-09-11T22:21:55.661732+0000","last_became_active":"2024-09-11T22:21:53.522686+0000","last_became_peered":"2024-09-11T22:21:53.522686+0000","last_unstale":"2024-09-11T22:21:55.661732+0000","last_undegraded":"2024-09-11T22:21:55.661732+0000","last_fullsized":"2024-09-11T22:21:55.661732+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:34.088877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502957+0000","last_change":"2024-09-11T22:21:53.502957+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502957+0000","last_undegraded":"2024-09-11T22:21:53.502957+0000","last_fullsized":"2024-09-11T22:21:53.502957+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.521489+0000","last_change":"2024-09-11T22:21:53.517900+0000","last_active":"2024-09-11T22:21:53.521489+0000","last_peered":"2024-09-11T22:21:53.521489+0000","last_clean":"2024-09-11T22:21:53.521489+0000","last_became_active":"2024-09-11T22:21:53.517606+0000","last_became_peered":"2024-09-11T22:21:53.517606+0000","last_unstale":"2024-09-11T22:21:53.521489+0000","last_undegraded":"2024-09-11T22:21:53.521489+0000","last_fullsized":"2024-09-11T22:21:53.521489+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:49.422032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.503384+0000","last_change":"2024-09-11T22:21:53.503384+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.503384+0000","last_undegraded":"2024-09-11T22:21:53.503384+0000","last_fullsized":"2024-09-11T22:21:53.503384+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.512802+0000","last_change":"2024-09-11T22:21:53.511206+0000","last_active":"2024-09-11T22:21:53.512802+0000","last_peered":"2024-09-11T22:21:53.512802+0000","last_clean":"2024-09-11T22:21:53.512802+0000","last_became_active":"2024-09-11T22:21:53.510917+0000","last_became_peered":"2024-09-11T22:21:53.510917+0000","last_unstale":"2024-09-11T22:21:53.512802+0000","last_undegraded":"2024-09-11T22:21:53.512802+0000","last_fullsized":"2024-09-11T22:21:53.512802+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:33.324721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506421+0000","last_change":"2024-09-11T22:21:53.506421+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506421+0000","last_undegraded":"2024-09-11T22:21:53.506421+0000","last_fullsized":"2024-09-11T22:21:53.506421+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"166'8","reported_seq":22,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660994+0000","last_change":"2024-09-11T22:21:53.520671+0000","last_active":"2024-09-11T22:21:55.660994+0000","last_peered":"2024-09-11T22:21:55.660994+0000","last_clean":"2024-09-11T22:21:55.660994+0000","last_became_active":"2024-09-11T22:21:53.520444+0000","last_became_peered":"2024-09-11T22:21:53.520444+0000","last_unstale":"2024-09-11T22:21:55.660994+0000","last_undegraded":"2024-09-11T22:21:55.660994+0000","last_fullsized":"2024-09-11T22:21:55.660994+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:46.184129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.505255+0000","last_change":"2024-09-11T22:21:53.505255+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.505255+0000","last_undegraded":"2024-09-11T22:21:53.505255+0000","last_fullsized":"2024-09-11T22:21:53.505255+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662544+0000","last_change":"2024-09-11T22:21:53.514629+0000","last_active":"2024-09-11T22:21:55.662544+0000","last_peered":"2024-09-11T22:21:55.662544+0000","last_clean":"2024-09-11T22:21:55.662544+0000","last_became_active":"2024-09-11T22:21:53.514304+0000","last_became_peered":"2024-09-11T22:21:53.514304+0000","last_unstale":"2024-09-11T22:21:55.662544+0000","last_undegraded":"2024-09-11T22:21:55.662544+0000","last_fullsized":"2024-09-11T22:21:55.662544+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:43.852256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.501498+0000","last_change":"2024-09-11T22:21:53.501498+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.501498+0000","last_undegraded":"2024-09-11T22:21:53.501498+0000","last_fullsized":"2024-09-11T22:21:53.501498+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.510561+0000","last_change":"2024-09-11T22:21:53.509336+0000","last_active":"2024-09-11T22:21:53.510561+0000","last_peered":"2024-09-11T22:21:53.510561+0000","last_clean":"2024-09-11T22:21:53.510561+0000","last_became_active":"2024-09-11T22:21:53.509033+0000","last_became_peered":"2024-09-11T22:21:53.509033+0000","last_unstale":"2024-09-11T22:21:53.510561+0000","last_undegraded":"2024-09-11T22:21:53.510561+0000","last_fullsized":"2024-09-11T22:21:53.510561+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:37.593441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502623+0000","last_change":"2024-09-11T22:21:53.502623+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502623+0000","last_undegraded":"2024-09-11T22:21:53.502623+0000","last_fullsized":"2024-09-11T22:21:53.502623+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661647+0000","last_change":"2024-09-11T22:21:53.520425+0000","last_active":"2024-09-11T22:21:55.661647+0000","last_peered":"2024-09-11T22:21:55.661647+0000","last_clean":"2024-09-11T22:21:55.661647+0000","last_became_active":"2024-09-11T22:21:53.520189+0000","last_became_peered":"2024-09-11T22:21:53.520189+0000","last_unstale":"2024-09-11T22:21:55.661647+0000","last_undegraded":"2024-09-11T22:21:55.661647+0000","last_fullsized":"2024-09-11T22:21:55.661647+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:22.352739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504846+0000","last_change":"2024-09-11T22:21:53.504846+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504846+0000","last_undegraded":"2024-09-11T22:21:53.504846+0000","last_fullsized":"2024-09-11T22:21:53.504846+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.509932+0000","last_change":"2024-09-11T22:21:53.508764+0000","last_active":"2024-09-11T22:21:53.509932+0000","last_peered":"2024-09-11T22:21:53.509932+0000","last_clean":"2024-09-11T22:21:53.509932+0000","last_became_active":"2024-09-11T22:21:53.508451+0000","last_became_peered":"2024-09-11T22:21:53.508451+0000","last_unstale":"2024-09-11T22:21:53.509932+0000","last_undegraded":"2024-09-11T22:21:53.509932+0000","last_fullsized":"2024-09-11T22:21:53.509932+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:03.561959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506479+0000","last_change":"2024-09-11T22:21:53.506479+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506479+0000","last_undegraded":"2024-09-11T22:21:53.506479+0000","last_fullsized":"2024-09-11T22:21:53.506479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.522052+0000","last_change":"2024-09-11T22:21:53.520041+0000","last_active":"2024-09-11T22:21:53.522052+0000","last_peered":"2024-09-11T22:21:53.522052+0000","last_clean":"2024-09-11T22:21:53.522052+0000","last_became_active":"2024-09-11T22:21:53.519719+0000","last_became_peered":"2024-09-11T22:21:53.519719+0000","last_unstale":"2024-09-11T22:21:53.522052+0000","last_undegraded":"2024-09-11T22:21:53.522052+0000","last_fullsized":"2024-09-11T22:21:53.522052+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:53:23.483987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.502414+0000","last_change":"2024-09-11T22:21:53.502414+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.502414+0000","last_undegraded":"2024-09-11T22:21:53.502414+0000","last_fullsized":"2024-09-11T22:21:53.502414+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661095+0000","last_change":"2024-09-11T22:21:53.515176+0000","last_active":"2024-09-11T22:21:55.661095+0000","last_peered":"2024-09-11T22:21:55.661095+0000","last_clean":"2024-09-11T22:21:55.661095+0000","last_became_active":"2024-09-11T22:21:53.513869+0000","last_became_peered":"2024-09-11T22:21:53.513869+0000","last_unstale":"2024-09-11T22:21:55.661095+0000","last_undegraded":"2024-09-11T22:21:55.661095+0000","last_fullsized":"2024-09-11T22:21:55.661095+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:19.271785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506542+0000","last_change":"2024-09-11T22:21:53.506542+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506542+0000","last_undegraded":"2024-09-11T22:21:53.506542+0000","last_fullsized":"2024-09-11T22:21:53.506542+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.518914+0000","last_change":"2024-09-11T22:21:53.518061+0000","last_active":"2024-09-11T22:21:53.518914+0000","last_peered":"2024-09-11T22:21:53.518914+0000","last_clean":"2024-09-11T22:21:53.518914+0000","last_became_active":"2024-09-11T22:21:53.517766+0000","last_became_peered":"2024-09-11T22:21:53.517766+0000","last_unstale":"2024-09-11T22:21:53.518914+0000","last_undegraded":"2024-09-11T22:21:53.518914+0000","last_fullsized":"2024-09-11T22:21:53.518914+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:02.465092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661344+0000","last_change":"2024-09-11T22:21:54.512265+0000","last_active":"2024-09-11T22:21:55.661344+0000","last_peered":"2024-09-11T22:21:55.661344+0000","last_clean":"2024-09-11T22:21:55.661344+0000","last_became_active":"2024-09-11T22:21:54.511981+0000","last_became_peered":"2024-09-11T22:21:54.511981+0000","last_unstale":"2024-09-11T22:21:55.661344+0000","last_undegraded":"2024-09-11T22:21:55.661344+0000","last_fullsized":"2024-09-11T22:21:55.661344+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:19.038748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.511857+0000","last_change":"2024-09-11T22:21:53.510553+0000","last_active":"2024-09-11T22:21:53.511857+0000","last_peered":"2024-09-11T22:21:53.511857+0000","last_clean":"2024-09-11T22:21:53.511857+0000","last_became_active":"2024-09-11T22:21:53.510274+0000","last_became_peered":"2024-09-11T22:21:53.510274+0000","last_unstale":"2024-09-11T22:21:53.511857+0000","last_undegraded":"2024-09-11T22:21:53.511857+0000","last_fullsized":"2024-09-11T22:21:53.511857+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:07.278583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662247+0000","last_change":"2024-09-11T22:21:54.513344+0000","last_active":"2024-09-11T22:21:55.662247+0000","last_peered":"2024-09-11T22:21:55.662247+0000","last_clean":"2024-09-11T22:21:55.662247+0000","last_became_active":"2024-09-11T22:21:54.513063+0000","last_became_peered":"2024-09-11T22:21:54.513063+0000","last_unstale":"2024-09-11T22:21:55.662247+0000","last_undegraded":"2024-09-11T22:21:55.662247+0000","last_fullsized":"2024-09-11T22:21:55.662247+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:36.252373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"166'2","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661705+0000","last_change":"2024-09-11T22:21:53.521697+0000","last_active":"2024-09-11T22:21:55.661705+0000","last_peered":"2024-09-11T22:21:55.661705+0000","last_clean":"2024-09-11T22:21:55.661705+0000","last_became_active":"2024-09-11T22:21:53.521436+0000","last_became_peered":"2024-09-11T22:21:53.521436+0000","last_unstale":"2024-09-11T22:21:55.661705+0000","last_undegraded":"2024-09-11T22:21:55.661705+0000","last_fullsized":"2024-09-11T22:21:55.661705+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:32:22.006810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504365+0000","last_change":"2024-09-11T22:21:53.504365+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504365+0000","last_undegraded":"2024-09-11T22:21:53.504365+0000","last_fullsized":"2024-09-11T22:21:53.504365+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.520671+0000","last_change":"2024-09-11T22:21:53.518479+0000","last_active":"2024-09-11T22:21:53.520671+0000","last_peered":"2024-09-11T22:21:53.520671+0000","last_clean":"2024-09-11T22:21:53.520671+0000","last_became_active":"2024-09-11T22:21:53.518194+0000","last_became_peered":"2024-09-11T22:21:53.518194+0000","last_unstale":"2024-09-11T22:21:53.520671+0000","last_undegraded":"2024-09-11T22:21:53.520671+0000","last_fullsized":"2024-09-11T22:21:53.520671+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:01.768074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504806+0000","last_change":"2024-09-11T22:21:53.504806+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504806+0000","last_undegraded":"2024-09-11T22:21:53.504806+0000","last_fullsized":"2024-09-11T22:21:53.504806+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.520631+0000","last_change":"2024-09-11T22:21:53.519158+0000","last_active":"2024-09-11T22:21:53.520631+0000","last_peered":"2024-09-11T22:21:53.520631+0000","last_clean":"2024-09-11T22:21:53.520631+0000","last_became_active":"2024-09-11T22:21:53.518027+0000","last_became_peered":"2024-09-11T22:21:53.518027+0000","last_unstale":"2024-09-11T22:21:53.520631+0000","last_undegraded":"2024-09-11T22:21:53.520631+0000","last_fullsized":"2024-09-11T22:21:53.520631+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:18.276100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.504426+0000","last_change":"2024-09-11T22:21:53.504426+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.504426+0000","last_undegraded":"2024-09-11T22:21:53.504426+0000","last_fullsized":"2024-09-11T22:21:53.504426+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.510524+0000","last_change":"2024-09-11T22:21:53.508001+0000","last_active":"2024-09-11T22:21:53.510524+0000","last_peered":"2024-09-11T22:21:53.510524+0000","last_clean":"2024-09-11T22:21:53.510524+0000","last_became_active":"2024-09-11T22:21:53.507189+0000","last_became_peered":"2024-09-11T22:21:53.507189+0000","last_unstale":"2024-09-11T22:21:53.510524+0000","last_undegraded":"2024-09-11T22:21:53.510524+0000","last_fullsized":"2024-09-11T22:21:53.510524+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:29.484597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661479+0000","last_change":"2024-09-11T22:21:54.523677+0000","last_active":"2024-09-11T22:21:55.661479+0000","last_peered":"2024-09-11T22:21:55.661479+0000","last_clean":"2024-09-11T22:21:55.661479+0000","last_became_active":"2024-09-11T22:21:54.523304+0000","last_became_peered":"2024-09-11T22:21:54.523304+0000","last_unstale":"2024-09-11T22:21:55.661479+0000","last_undegraded":"2024-09-11T22:21:55.661479+0000","last_fullsized":"2024-09-11T22:21:55.661479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:08.351084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.513022+0000","last_change":"2024-09-11T22:21:53.510639+0000","last_active":"2024-09-11T22:21:53.513022+0000","last_peered":"2024-09-11T22:21:53.513022+0000","last_clean":"2024-09-11T22:21:53.513022+0000","last_became_active":"2024-09-11T22:21:53.510362+0000","last_became_peered":"2024-09-11T22:21:53.510362+0000","last_unstale":"2024-09-11T22:21:53.513022+0000","last_undegraded":"2024-09-11T22:21:53.513022+0000","last_fullsized":"2024-09-11T22:21:53.513022+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:58.370993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661714+0000","last_change":"2024-09-11T22:21:54.527134+0000","last_active":"2024-09-11T22:21:55.661714+0000","last_peered":"2024-09-11T22:21:55.661714+0000","last_clean":"2024-09-11T22:21:55.661714+0000","last_became_active":"2024-09-11T22:21:54.526844+0000","last_became_peered":"2024-09-11T22:21:54.526844+0000","last_unstale":"2024-09-11T22:21:55.661714+0000","last_undegraded":"2024-09-11T22:21:55.661714+0000","last_fullsized":"2024-09-11T22:21:55.661714+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:34.259306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.508910+0000","last_change":"2024-09-11T22:21:53.507391+0000","last_active":"2024-09-11T22:21:53.508910+0000","last_peered":"2024-09-11T22:21:53.508910+0000","last_clean":"2024-09-11T22:21:53.508910+0000","last_became_active":"2024-09-11T22:21:53.507076+0000","last_became_peered":"2024-09-11T22:21:53.507076+0000","last_unstale":"2024-09-11T22:21:53.508910+0000","last_undegraded":"2024-09-11T22:21:53.508910+0000","last_fullsized":"2024-09-11T22:21:53.508910+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:01.338325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506132+0000","last_change":"2024-09-11T22:21:53.506132+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506132+0000","last_undegraded":"2024-09-11T22:21:53.506132+0000","last_fullsized":"2024-09-11T22:21:53.506132+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.513642+0000","last_change":"2024-09-11T22:21:53.513015+0000","last_active":"2024-09-11T22:21:53.513642+0000","last_peered":"2024-09-11T22:21:53.513642+0000","last_clean":"2024-09-11T22:21:53.513642+0000","last_became_active":"2024-09-11T22:21:53.511892+0000","last_became_peered":"2024-09-11T22:21:53.511892+0000","last_unstale":"2024-09-11T22:21:53.513642+0000","last_undegraded":"2024-09-11T22:21:53.513642+0000","last_fullsized":"2024-09-11T22:21:53.513642+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:11.081873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661492+0000","last_change":"2024-09-11T22:21:54.516765+0000","last_active":"2024-09-11T22:21:55.661492+0000","last_peered":"2024-09-11T22:21:55.661492+0000","last_clean":"2024-09-11T22:21:55.661492+0000","last_became_active":"2024-09-11T22:21:54.516472+0000","last_became_peered":"2024-09-11T22:21:54.516472+0000","last_unstale":"2024-09-11T22:21:55.661492+0000","last_undegraded":"2024-09-11T22:21:55.661492+0000","last_fullsized":"2024-09-11T22:21:55.661492+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:03.343797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T22:21:53.519466+0000","last_change":"2024-09-11T22:21:53.518211+0000","last_active":"2024-09-11T22:21:53.519466+0000","last_peered":"2024-09-11T22:21:53.519466+0000","last_clean":"2024-09-11T22:21:53.519466+0000","last_became_active":"2024-09-11T22:21:53.517362+0000","last_became_peered":"2024-09-11T22:21:53.517362+0000","last_unstale":"2024-09-11T22:21:53.519466+0000","last_undegraded":"2024-09-11T22:21:53.519466+0000","last_fullsized":"2024-09-11T22:21:53.519466+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:20.248496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-11T22:21:53.506231+0000","last_change":"2024-09-11T22:21:53.506231+0000","last_active":"2024-09-11T22:21:53.492779+0000","last_peered":"2024-09-11T22:21:53.492779+0000","last_clean":"2024-09-11T22:21:53.492779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:21:53.506231+0000","last_undegraded":"2024-09-11T22:21:53.506231+0000","last_fullsized":"2024-09-11T22:21:53.506231+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661259+0000","last_change":"2024-09-11T22:21:53.514489+0000","last_active":"2024-09-11T22:21:55.661259+0000","last_peered":"2024-09-11T22:21:55.661259+0000","last_clean":"2024-09-11T22:21:55.661259+0000","last_became_active":"2024-09-11T22:21:53.514203+0000","last_became_peered":"2024-09-11T22:21:53.514203+0000","last_unstale":"2024-09-11T22:21:55.661259+0000","last_undegraded":"2024-09-11T22:21:55.661259+0000","last_fullsized":"2024-09-11T22:21:55.661259+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:49.890240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":436,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661047+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:21:55.661047+0000","last_peered":"2024-09-11T22:21:55.661047+0000","last_clean":"2024-09-11T22:21:55.661047+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:21:55.661047+0000","last_undegraded":"2024-09-11T22:21:55.661047+0000","last_fullsized":"2024-09-11T22:21:55.661047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509575,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51256,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320584,"statfs":{"total":96636764160,"available":96584278016,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51260,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320580,"statfs":{"total":96636764160,"available":96584273920,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509574,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509574,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47100,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324740,"statfs":{"total":96636764160,"available":96588533760,"internally_reserved":0,"allocated":2068480,"data_stored":907183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509573,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60160,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311680,"statfs":{"total":96636764160,"available":96575160320,"internally_reserved":0,"allocated":2662400,"data_stored":1497551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56028,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315812,"statfs":{"total":96636764160,"available":96579391488,"internally_reserved":0,"allocated":2695168,"data_stored":1510730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574981,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47140,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324700,"statfs":{"total":96636764160,"available":96588492800,"internally_reserved":0,"allocated":2105344,"data_stored":920952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:22:01.922 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:22:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.036+0000 7f73066ac640 1 Processor -- start 2024-09-11T22:22:02.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.037+0000 7f73066ac640 1 -- start start 2024-09-11T22:22:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.037+0000 7f73066ac640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f73000d18a0 0x7f73000d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.037+0000 7f73066ac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73000d3a30 0x7f73000b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.037+0000 7f73066ac640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73000cfa80 con 0x7f730015e870 2024-09-11T22:22:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.037+0000 7f73066ac640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f73000d3ea0 con 0x7f73000d3a30 2024-09-11T22:22:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.037+0000 7f73066ac640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f73000d40d0 con 0x7f73000d18a0 2024-09-11T22:22:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.038+0000 7f7304c49640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73000d3a30 0x7f73000b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.038+0000 7f7304c49640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f73000d3a30 0x7f73000b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48460/0 (socket says 172.21.15.50:48460) 2024-09-11T22:22:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.038+0000 7f7304c49640 1 -- 172.21.15.50:0/1280177821 learned_addr learned my addr 172.21.15.50:0/1280177821 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.038+0000 7f72ff7fe640 1 --2- 172.21.15.50:0/1280177821 >> v2:172.21.15.77:3300/0 conn(0x7f73000d18a0 0x7f73000d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.038+0000 7f7304c49640 1 -- 172.21.15.50:0/1280177821 >> v2:172.21.15.77:3300/0 conn(0x7f73000d18a0 msgr2=0x7f73000d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.038+0000 7f7304c49640 1 --2- 172.21.15.50:0/1280177821 >> v2:172.21.15.77:3300/0 conn(0x7f73000d18a0 0x7f73000d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.038+0000 7f7304c49640 1 -- 172.21.15.50:0/1280177821 >> v1:172.21.15.77:6789/0 conn(0x7f730015e870 legacy=0x7f73000d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.038+0000 7f7304c49640 1 -- 172.21.15.50:0/1280177821 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73000d43b0 con 0x7f73000d3a30 2024-09-11T22:22:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.039+0000 7f7304c49640 1 --2- 172.21.15.50:0/1280177821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73000d3a30 0x7f73000b8400 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f730006c860 tx=0x7f72f802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fc83f44686ba08 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.039+0000 7f72feffd640 1 -- 172.21.15.50:0/1280177821 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8036070 con 0x7f73000d3a30 2024-09-11T22:22:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.039+0000 7f72feffd640 1 -- 172.21.15.50:0/1280177821 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f8031600 con 0x7f73000d3a30 2024-09-11T22:22:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.039+0000 7f72feffd640 1 -- 172.21.15.50:0/1280177821 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f80319d0 con 0x7f73000d3a30 2024-09-11T22:22:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.039+0000 7f73066ac640 1 -- 172.21.15.50:0/1280177821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73000d3a30 msgr2=0x7f73000b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.039+0000 7f73066ac640 1 --2- 172.21.15.50:0/1280177821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73000d3a30 0x7f73000b8400 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f730006c860 tx=0x7f72f802a730 comp rx=0 tx=0).stop 2024-09-11T22:22:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.039+0000 7f73066ac640 1 -- 172.21.15.50:0/1280177821 shutdown_connections 2024-09-11T22:22:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.039+0000 7f73066ac640 1 --2- 172.21.15.50:0/1280177821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73000d3a30 0x7f73000b8400 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.039+0000 7f73066ac640 1 --2- 172.21.15.50:0/1280177821 >> v2:172.21.15.77:3300/0 conn(0x7f73000d18a0 0x7f73000d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.039+0000 7f73066ac640 1 -- 172.21.15.50:0/1280177821 >> 172.21.15.50:0/1280177821 conn(0x7f73000727a0 msgr2=0x7f73000679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.040+0000 7f73066ac640 1 -- 172.21.15.50:0/1280177821 shutdown_connections 2024-09-11T22:22:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.040+0000 7f73066ac640 1 -- 172.21.15.50:0/1280177821 wait complete. 2024-09-11T22:22:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.041+0000 7f73066ac640 1 Processor -- start 2024-09-11T22:22:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.041+0000 7f73066ac640 1 -- start start 2024-09-11T22:22:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f73066ac640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73000d18a0 0x7f7300156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f73066ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73000d3a30 0x7f73000c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f73066ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f730015e870 0x7f73000c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f73066ac640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f730015ec50 con 0x7f73000d3a30 2024-09-11T22:22:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f73066ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73000b7ee0 con 0x7f730015e870 2024-09-11T22:22:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f73066ac640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f73000b78b0 con 0x7f73000d18a0 2024-09-11T22:22:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f72ff7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73000d3a30 0x7f73000c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f72ff7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73000d3a30 0x7f73000c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48476/0 (socket says 172.21.15.50:48476) 2024-09-11T22:22:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f72ff7fe640 1 -- 172.21.15.50:0/1319421085 learned_addr learned my addr 172.21.15.50:0/1319421085 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f7304c49640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f730015e870 0x7f73000c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f72fffff640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73000d18a0 0x7f7300156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f72ff7fe640 1 -- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73000d18a0 msgr2=0x7f7300156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f72ff7fe640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73000d18a0 0x7f7300156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f72ff7fe640 1 -- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f730015e870 msgr2=0x7f73000c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f72ff7fe640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f730015e870 0x7f73000c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f72ff7fe640 1 -- 172.21.15.50:0/1319421085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73000cb1f0 con 0x7f73000d3a30 2024-09-11T22:22:02.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f72fffff640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73000d18a0 0x7f7300156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:02.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.042+0000 7f72ff7fe640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73000d3a30 0x7f73000c9560 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f72f400d5d0 tx=0x7f72f400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:02.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.043+0000 7f72fcff9640 1 -- 172.21.15.50:0/1319421085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f40125f0 con 0x7f73000d3a30 2024-09-11T22:22:02.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.043+0000 7f72fcff9640 1 -- 172.21.15.50:0/1319421085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f4019070 con 0x7f73000d3a30 2024-09-11T22:22:02.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.043+0000 7f73066ac640 1 -- 172.21.15.50:0/1319421085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7300155470 con 0x7f73000d3a30 2024-09-11T22:22:02.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.043+0000 7f72fcff9640 1 -- 172.21.15.50:0/1319421085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f40129f0 con 0x7f73000d3a30 2024-09-11T22:22:02.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.043+0000 7f73066ac640 1 -- 172.21.15.50:0/1319421085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7300155a30 con 0x7f73000d3a30 2024-09-11T22:22:02.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.044+0000 7f73066ac640 1 -- 172.21.15.50:0/1319421085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73000d34f0 con 0x7f73000d3a30 2024-09-11T22:22:02.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.044+0000 7f72fcff9640 1 -- 172.21.15.50:0/1319421085 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72f4012b90 con 0x7f73000d3a30 2024-09-11T22:22:02.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.045+0000 7f72fcff9640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f72ec06be60 0x7f72ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.045+0000 7f72fcff9640 1 -- 172.21.15.50:0/1319421085 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f72f408b0d0 con 0x7f73000d3a30 2024-09-11T22:22:02.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.045+0000 7f72fffff640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f72ec06be60 0x7f72ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.046+0000 7f72fffff640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f72ec06be60 0x7f72ec06e320 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7300154450 tx=0x7f72f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.049+0000 7f72fcff9640 1 -- 172.21.15.50:0/1319421085 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72f4059b10 con 0x7f73000d3a30 2024-09-11T22:22:02.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.222+0000 7f73066ac640 1 -- 172.21.15.50:0/1319421085 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7300067e90 con 0x7f72ec06be60 2024-09-11T22:22:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.228+0000 7f72fcff9640 1 -- 172.21.15.50:0/1319421085 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252473 (secure 0 0 0) 0x7f7300067e90 con 0x7f72ec06be60 2024-09-11T22:22:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:02.232 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:22:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.231+0000 7f73066ac640 1 -- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f72ec06be60 msgr2=0x7f72ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.231+0000 7f73066ac640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f72ec06be60 0x7f72ec06e320 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7300154450 tx=0x7f72f0009040 comp rx=0 tx=0).stop 2024-09-11T22:22:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.231+0000 7f73066ac640 1 -- 172.21.15.50:0/1319421085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73000d3a30 msgr2=0x7f73000c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.231+0000 7f73066ac640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73000d3a30 0x7f73000c9560 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f72f400d5d0 tx=0x7f72f400da90 comp rx=0 tx=0).stop 2024-09-11T22:22:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.231+0000 7f73066ac640 1 -- 172.21.15.50:0/1319421085 shutdown_connections 2024-09-11T22:22:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.231+0000 7f73066ac640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f72ec06be60 0x7f72ec06e320 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.231+0000 7f73066ac640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f730015e870 0x7f73000c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.231+0000 7f73066ac640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73000d3a30 0x7f73000c9560 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.231+0000 7f73066ac640 1 --2- 172.21.15.50:0/1319421085 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73000d18a0 0x7f7300156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.231+0000 7f73066ac640 1 -- 172.21.15.50:0/1319421085 >> 172.21.15.50:0/1319421085 conn(0x7f73000727a0 msgr2=0x7f730015d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.231+0000 7f73066ac640 1 -- 172.21.15.50:0/1319421085 shutdown_connections 2024-09-11T22:22:02.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.231+0000 7f73066ac640 1 -- 172.21.15.50:0/1319421085 wait complete. 2024-09-11T22:22:02.243 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":490,"stamp":"2024-09-11T22:22:01.520507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":432284,"kb_used_data":17576,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754542436,"statfs":{"total":773094113280,"available":772651454464,"internally_reserved":0,"allocated":17997824,"data_stored":8547620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":424463921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001935"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661419+0000","last_change":"2024-09-11T22:21:54.528415+0000","last_active":"2024-09-11T22:21:55.661419+0000","last_peered":"2024-09-11T22:21:55.661419+0000","last_clean":"2024-09-11T22:21:55.661419+0000","last_became_active":"2024-09-11T22:21:54.527822+0000","last_became_peered":"2024-09-11T22:21:54.527822+0000","last_unstale":"2024-09-11T22:21:55.661419+0000","last_undegraded":"2024-09-11T22:21:55.661419+0000","last_fullsized":"2024-09-11T22:21:55.661419+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:49.445914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509631+0000","last_change":"2024-09-11T22:21:54.522283+0000","last_active":"2024-09-11T22:21:55.509631+0000","last_peered":"2024-09-11T22:21:55.509631+0000","last_clean":"2024-09-11T22:21:55.509631+0000","last_became_active":"2024-09-11T22:21:54.521562+0000","last_became_peered":"2024-09-11T22:21:54.521562+0000","last_unstale":"2024-09-11T22:21:55.509631+0000","last_undegraded":"2024-09-11T22:21:55.509631+0000","last_fullsized":"2024-09-11T22:21:55.509631+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:35.803770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.503720+0000","last_change":"2024-09-11T22:21:54.517104+0000","last_active":"2024-09-11T22:21:55.503720+0000","last_peered":"2024-09-11T22:21:55.503720+0000","last_clean":"2024-09-11T22:21:55.503720+0000","last_became_active":"2024-09-11T22:21:54.516798+0000","last_became_peered":"2024-09-11T22:21:54.516798+0000","last_unstale":"2024-09-11T22:21:55.503720+0000","last_undegraded":"2024-09-11T22:21:55.503720+0000","last_fullsized":"2024-09-11T22:21:55.503720+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:14.055634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509113+0000","last_change":"2024-09-11T22:21:54.522642+0000","last_active":"2024-09-11T22:21:55.509113+0000","last_peered":"2024-09-11T22:21:55.509113+0000","last_clean":"2024-09-11T22:21:55.509113+0000","last_became_active":"2024-09-11T22:21:54.522345+0000","last_became_peered":"2024-09-11T22:21:54.522345+0000","last_unstale":"2024-09-11T22:21:55.509113+0000","last_undegraded":"2024-09-11T22:21:55.509113+0000","last_fullsized":"2024-09-11T22:21:55.509113+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:09.964935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662155+0000","last_change":"2024-09-11T22:21:54.508029+0000","last_active":"2024-09-11T22:21:55.662155+0000","last_peered":"2024-09-11T22:21:55.662155+0000","last_clean":"2024-09-11T22:21:55.662155+0000","last_became_active":"2024-09-11T22:21:54.507700+0000","last_became_peered":"2024-09-11T22:21:54.507700+0000","last_unstale":"2024-09-11T22:21:55.662155+0000","last_undegraded":"2024-09-11T22:21:55.662155+0000","last_fullsized":"2024-09-11T22:21:55.662155+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:40.629965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.503479+0000","last_change":"2024-09-11T22:21:54.527750+0000","last_active":"2024-09-11T22:21:55.503479+0000","last_peered":"2024-09-11T22:21:55.503479+0000","last_clean":"2024-09-11T22:21:55.503479+0000","last_became_active":"2024-09-11T22:21:54.527444+0000","last_became_peered":"2024-09-11T22:21:54.527444+0000","last_unstale":"2024-09-11T22:21:55.503479+0000","last_undegraded":"2024-09-11T22:21:55.503479+0000","last_fullsized":"2024-09-11T22:21:55.503479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:25.470963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660849+0000","last_change":"2024-09-11T22:21:54.518199+0000","last_active":"2024-09-11T22:21:55.660849+0000","last_peered":"2024-09-11T22:21:55.660849+0000","last_clean":"2024-09-11T22:21:55.660849+0000","last_became_active":"2024-09-11T22:21:54.517926+0000","last_became_peered":"2024-09-11T22:21:54.517926+0000","last_unstale":"2024-09-11T22:21:55.660849+0000","last_undegraded":"2024-09-11T22:21:55.660849+0000","last_fullsized":"2024-09-11T22:21:55.660849+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:11.603355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660775+0000","last_change":"2024-09-11T22:21:54.513419+0000","last_active":"2024-09-11T22:21:55.660775+0000","last_peered":"2024-09-11T22:21:55.660775+0000","last_clean":"2024-09-11T22:21:55.660775+0000","last_became_active":"2024-09-11T22:21:54.513110+0000","last_became_peered":"2024-09-11T22:21:54.513110+0000","last_unstale":"2024-09-11T22:21:55.660775+0000","last_undegraded":"2024-09-11T22:21:55.660775+0000","last_fullsized":"2024-09-11T22:21:55.660775+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:52:13.997108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509859+0000","last_change":"2024-09-11T22:21:54.513893+0000","last_active":"2024-09-11T22:21:55.509859+0000","last_peered":"2024-09-11T22:21:55.509859+0000","last_clean":"2024-09-11T22:21:55.509859+0000","last_became_active":"2024-09-11T22:21:54.513594+0000","last_became_peered":"2024-09-11T22:21:54.513594+0000","last_unstale":"2024-09-11T22:21:55.509859+0000","last_undegraded":"2024-09-11T22:21:55.509859+0000","last_fullsized":"2024-09-11T22:21:55.509859+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:53:24.489765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660958+0000","last_change":"2024-09-11T22:21:54.523561+0000","last_active":"2024-09-11T22:21:55.660958+0000","last_peered":"2024-09-11T22:21:55.660958+0000","last_clean":"2024-09-11T22:21:55.660958+0000","last_became_active":"2024-09-11T22:21:54.523163+0000","last_became_peered":"2024-09-11T22:21:54.523163+0000","last_unstale":"2024-09-11T22:21:55.660958+0000","last_undegraded":"2024-09-11T22:21:55.660958+0000","last_fullsized":"2024-09-11T22:21:55.660958+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:14.276587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661301+0000","last_change":"2024-09-11T22:21:54.519889+0000","last_active":"2024-09-11T22:21:55.661301+0000","last_peered":"2024-09-11T22:21:55.661301+0000","last_clean":"2024-09-11T22:21:55.661301+0000","last_became_active":"2024-09-11T22:21:54.519613+0000","last_became_peered":"2024-09-11T22:21:54.519613+0000","last_unstale":"2024-09-11T22:21:55.661301+0000","last_undegraded":"2024-09-11T22:21:55.661301+0000","last_fullsized":"2024-09-11T22:21:55.661301+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:59.965583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509540+0000","last_change":"2024-09-11T22:21:54.518572+0000","last_active":"2024-09-11T22:21:55.509540+0000","last_peered":"2024-09-11T22:21:55.509540+0000","last_clean":"2024-09-11T22:21:55.509540+0000","last_became_active":"2024-09-11T22:21:54.518174+0000","last_became_peered":"2024-09-11T22:21:54.518174+0000","last_unstale":"2024-09-11T22:21:55.509540+0000","last_undegraded":"2024-09-11T22:21:55.509540+0000","last_fullsized":"2024-09-11T22:21:55.509540+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:40.112988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509127+0000","last_change":"2024-09-11T22:21:54.517210+0000","last_active":"2024-09-11T22:21:55.509127+0000","last_peered":"2024-09-11T22:21:55.509127+0000","last_clean":"2024-09-11T22:21:55.509127+0000","last_became_active":"2024-09-11T22:21:54.516606+0000","last_became_peered":"2024-09-11T22:21:54.516606+0000","last_unstale":"2024-09-11T22:21:55.509127+0000","last_undegraded":"2024-09-11T22:21:55.509127+0000","last_fullsized":"2024-09-11T22:21:55.509127+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:18:03.089109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.510341+0000","last_change":"2024-09-11T22:21:54.523358+0000","last_active":"2024-09-11T22:21:55.510341+0000","last_peered":"2024-09-11T22:21:55.510341+0000","last_clean":"2024-09-11T22:21:55.510341+0000","last_became_active":"2024-09-11T22:21:54.523080+0000","last_became_peered":"2024-09-11T22:21:54.523080+0000","last_unstale":"2024-09-11T22:21:55.510341+0000","last_undegraded":"2024-09-11T22:21:55.510341+0000","last_fullsized":"2024-09-11T22:21:55.510341+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:11.603355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509793+0000","last_change":"2024-09-11T22:21:54.528247+0000","last_active":"2024-09-11T22:21:55.509793+0000","last_peered":"2024-09-11T22:21:55.509793+0000","last_clean":"2024-09-11T22:21:55.509793+0000","last_became_active":"2024-09-11T22:21:54.527933+0000","last_became_peered":"2024-09-11T22:21:54.527933+0000","last_unstale":"2024-09-11T22:21:55.509793+0000","last_undegraded":"2024-09-11T22:21:55.509793+0000","last_fullsized":"2024-09-11T22:21:55.509793+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:32:10.679382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660927+0000","last_change":"2024-09-11T22:21:54.517176+0000","last_active":"2024-09-11T22:21:55.660927+0000","last_peered":"2024-09-11T22:21:55.660927+0000","last_clean":"2024-09-11T22:21:55.660927+0000","last_became_active":"2024-09-11T22:21:54.516832+0000","last_became_peered":"2024-09-11T22:21:54.516832+0000","last_unstale":"2024-09-11T22:21:55.660927+0000","last_undegraded":"2024-09-11T22:21:55.660927+0000","last_fullsized":"2024-09-11T22:21:55.660927+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:28.626597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662501+0000","last_change":"2024-09-11T22:21:54.514748+0000","last_active":"2024-09-11T22:21:55.662501+0000","last_peered":"2024-09-11T22:21:55.662501+0000","last_clean":"2024-09-11T22:21:55.662501+0000","last_became_active":"2024-09-11T22:21:54.513842+0000","last_became_peered":"2024-09-11T22:21:54.513842+0000","last_unstale":"2024-09-11T22:21:55.662501+0000","last_undegraded":"2024-09-11T22:21:55.662501+0000","last_fullsized":"2024-09-11T22:21:55.662501+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:12.924567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661317+0000","last_change":"2024-09-11T22:21:54.520984+0000","last_active":"2024-09-11T22:21:55.661317+0000","last_peered":"2024-09-11T22:21:55.661317+0000","last_clean":"2024-09-11T22:21:55.661317+0000","last_became_active":"2024-09-11T22:21:54.520709+0000","last_became_peered":"2024-09-11T22:21:54.520709+0000","last_unstale":"2024-09-11T22:21:55.661317+0000","last_undegraded":"2024-09-11T22:21:55.661317+0000","last_fullsized":"2024-09-11T22:21:55.661317+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:25.359697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660592+0000","last_change":"2024-09-11T22:21:54.523931+0000","last_active":"2024-09-11T22:21:55.660592+0000","last_peered":"2024-09-11T22:21:55.660592+0000","last_clean":"2024-09-11T22:21:55.660592+0000","last_became_active":"2024-09-11T22:21:54.523399+0000","last_became_peered":"2024-09-11T22:21:54.523399+0000","last_unstale":"2024-09-11T22:21:55.660592+0000","last_undegraded":"2024-09-11T22:21:55.660592+0000","last_fullsized":"2024-09-11T22:21:55.660592+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:28.825913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661330+0000","last_change":"2024-09-11T22:21:54.515669+0000","last_active":"2024-09-11T22:21:55.661330+0000","last_peered":"2024-09-11T22:21:55.661330+0000","last_clean":"2024-09-11T22:21:55.661330+0000","last_became_active":"2024-09-11T22:21:54.515148+0000","last_became_peered":"2024-09-11T22:21:54.515148+0000","last_unstale":"2024-09-11T22:21:55.661330+0000","last_undegraded":"2024-09-11T22:21:55.661330+0000","last_fullsized":"2024-09-11T22:21:55.661330+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:04.614538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662272+0000","last_change":"2024-09-11T22:21:54.508697+0000","last_active":"2024-09-11T22:21:55.662272+0000","last_peered":"2024-09-11T22:21:55.662272+0000","last_clean":"2024-09-11T22:21:55.662272+0000","last_became_active":"2024-09-11T22:21:54.508434+0000","last_became_peered":"2024-09-11T22:21:54.508434+0000","last_unstale":"2024-09-11T22:21:55.662272+0000","last_undegraded":"2024-09-11T22:21:55.662272+0000","last_fullsized":"2024-09-11T22:21:55.662272+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:27.764226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660749+0000","last_change":"2024-09-11T22:21:54.528295+0000","last_active":"2024-09-11T22:21:55.660749+0000","last_peered":"2024-09-11T22:21:55.660749+0000","last_clean":"2024-09-11T22:21:55.660749+0000","last_became_active":"2024-09-11T22:21:54.527221+0000","last_became_peered":"2024-09-11T22:21:54.527221+0000","last_unstale":"2024-09-11T22:21:55.660749+0000","last_undegraded":"2024-09-11T22:21:55.660749+0000","last_fullsized":"2024-09-11T22:21:55.660749+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:23.114293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.503419+0000","last_change":"2024-09-11T22:21:54.528423+0000","last_active":"2024-09-11T22:21:55.503419+0000","last_peered":"2024-09-11T22:21:55.503419+0000","last_clean":"2024-09-11T22:21:55.503419+0000","last_became_active":"2024-09-11T22:21:54.528146+0000","last_became_peered":"2024-09-11T22:21:54.528146+0000","last_unstale":"2024-09-11T22:21:55.503419+0000","last_undegraded":"2024-09-11T22:21:55.503419+0000","last_fullsized":"2024-09-11T22:21:55.503419+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:27.527066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661068+0000","last_change":"2024-09-11T22:21:54.512778+0000","last_active":"2024-09-11T22:21:55.661068+0000","last_peered":"2024-09-11T22:21:55.661068+0000","last_clean":"2024-09-11T22:21:55.661068+0000","last_became_active":"2024-09-11T22:21:54.512496+0000","last_became_peered":"2024-09-11T22:21:54.512496+0000","last_unstale":"2024-09-11T22:21:55.661068+0000","last_undegraded":"2024-09-11T22:21:55.661068+0000","last_fullsized":"2024-09-11T22:21:55.661068+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:23.278201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509432+0000","last_change":"2024-09-11T22:21:54.525934+0000","last_active":"2024-09-11T22:21:55.509432+0000","last_peered":"2024-09-11T22:21:55.509432+0000","last_clean":"2024-09-11T22:21:55.509432+0000","last_became_active":"2024-09-11T22:21:54.525515+0000","last_became_peered":"2024-09-11T22:21:54.525515+0000","last_unstale":"2024-09-11T22:21:55.509432+0000","last_undegraded":"2024-09-11T22:21:55.509432+0000","last_fullsized":"2024-09-11T22:21:55.509432+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:33.884774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661138+0000","last_change":"2024-09-11T22:21:54.522161+0000","last_active":"2024-09-11T22:21:55.661138+0000","last_peered":"2024-09-11T22:21:55.661138+0000","last_clean":"2024-09-11T22:21:55.661138+0000","last_became_active":"2024-09-11T22:21:54.521881+0000","last_became_peered":"2024-09-11T22:21:54.521881+0000","last_unstale":"2024-09-11T22:21:55.661138+0000","last_undegraded":"2024-09-11T22:21:55.661138+0000","last_fullsized":"2024-09-11T22:21:55.661138+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:57.099304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.503751+0000","last_change":"2024-09-11T22:21:54.517485+0000","last_active":"2024-09-11T22:21:55.503751+0000","last_peered":"2024-09-11T22:21:55.503751+0000","last_clean":"2024-09-11T22:21:55.503751+0000","last_became_active":"2024-09-11T22:21:54.516610+0000","last_became_peered":"2024-09-11T22:21:54.516610+0000","last_unstale":"2024-09-11T22:21:55.503751+0000","last_undegraded":"2024-09-11T22:21:55.503751+0000","last_fullsized":"2024-09-11T22:21:55.503751+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:12.339900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661468+0000","last_change":"2024-09-11T22:21:54.525452+0000","last_active":"2024-09-11T22:21:55.661468+0000","last_peered":"2024-09-11T22:21:55.661468+0000","last_clean":"2024-09-11T22:21:55.661468+0000","last_became_active":"2024-09-11T22:21:54.525190+0000","last_became_peered":"2024-09-11T22:21:54.525190+0000","last_unstale":"2024-09-11T22:21:55.661468+0000","last_undegraded":"2024-09-11T22:21:55.661468+0000","last_fullsized":"2024-09-11T22:21:55.661468+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:34.452375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509380+0000","last_change":"2024-09-11T22:21:54.517416+0000","last_active":"2024-09-11T22:21:55.509380+0000","last_peered":"2024-09-11T22:21:55.509380+0000","last_clean":"2024-09-11T22:21:55.509380+0000","last_became_active":"2024-09-11T22:21:54.516950+0000","last_became_peered":"2024-09-11T22:21:54.516950+0000","last_unstale":"2024-09-11T22:21:55.509380+0000","last_undegraded":"2024-09-11T22:21:55.509380+0000","last_fullsized":"2024-09-11T22:21:55.509380+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:59.965583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.510018+0000","last_change":"2024-09-11T22:21:54.518016+0000","last_active":"2024-09-11T22:21:55.510018+0000","last_peered":"2024-09-11T22:21:55.510018+0000","last_clean":"2024-09-11T22:21:55.510018+0000","last_became_active":"2024-09-11T22:21:54.517738+0000","last_became_peered":"2024-09-11T22:21:54.517738+0000","last_unstale":"2024-09-11T22:21:55.510018+0000","last_undegraded":"2024-09-11T22:21:55.510018+0000","last_fullsized":"2024-09-11T22:21:55.510018+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:47.129858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.503490+0000","last_change":"2024-09-11T22:21:54.515853+0000","last_active":"2024-09-11T22:21:55.503490+0000","last_peered":"2024-09-11T22:21:55.503490+0000","last_clean":"2024-09-11T22:21:55.503490+0000","last_became_active":"2024-09-11T22:21:54.515578+0000","last_became_peered":"2024-09-11T22:21:54.515578+0000","last_unstale":"2024-09-11T22:21:55.503490+0000","last_undegraded":"2024-09-11T22:21:55.503490+0000","last_fullsized":"2024-09-11T22:21:55.503490+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:33.411078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660471+0000","last_change":"2024-09-11T22:21:54.516160+0000","last_active":"2024-09-11T22:21:55.660471+0000","last_peered":"2024-09-11T22:21:55.660471+0000","last_clean":"2024-09-11T22:21:55.660471+0000","last_became_active":"2024-09-11T22:21:54.515856+0000","last_became_peered":"2024-09-11T22:21:54.515856+0000","last_unstale":"2024-09-11T22:21:55.660471+0000","last_undegraded":"2024-09-11T22:21:55.660471+0000","last_fullsized":"2024-09-11T22:21:55.660471+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:14.951034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661898+0000","last_change":"2024-09-11T22:21:54.525594+0000","last_active":"2024-09-11T22:21:55.661898+0000","last_peered":"2024-09-11T22:21:55.661898+0000","last_clean":"2024-09-11T22:21:55.661898+0000","last_became_active":"2024-09-11T22:21:54.525279+0000","last_became_peered":"2024-09-11T22:21:54.525279+0000","last_unstale":"2024-09-11T22:21:55.661898+0000","last_undegraded":"2024-09-11T22:21:55.661898+0000","last_fullsized":"2024-09-11T22:21:55.661898+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:52.358111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"166'4","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662460+0000","last_change":"2024-09-11T22:21:53.517954+0000","last_active":"2024-09-11T22:21:55.662460+0000","last_peered":"2024-09-11T22:21:55.662460+0000","last_clean":"2024-09-11T22:21:55.662460+0000","last_became_active":"2024-09-11T22:21:53.517676+0000","last_became_peered":"2024-09-11T22:21:53.517676+0000","last_unstale":"2024-09-11T22:21:55.662460+0000","last_undegraded":"2024-09-11T22:21:55.662460+0000","last_fullsized":"2024-09-11T22:21:55.662460+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:45.277715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661761+0000","last_change":"2024-09-11T22:21:54.524069+0000","last_active":"2024-09-11T22:21:55.661761+0000","last_peered":"2024-09-11T22:21:55.661761+0000","last_clean":"2024-09-11T22:21:55.661761+0000","last_became_active":"2024-09-11T22:21:54.523517+0000","last_became_peered":"2024-09-11T22:21:54.523517+0000","last_unstale":"2024-09-11T22:21:55.661761+0000","last_undegraded":"2024-09-11T22:21:55.661761+0000","last_fullsized":"2024-09-11T22:21:55.661761+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:28.490607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.510153+0000","last_change":"2024-09-11T22:21:53.513909+0000","last_active":"2024-09-11T22:21:55.510153+0000","last_peered":"2024-09-11T22:21:55.510153+0000","last_clean":"2024-09-11T22:21:55.510153+0000","last_became_active":"2024-09-11T22:21:53.513485+0000","last_became_peered":"2024-09-11T22:21:53.513485+0000","last_unstale":"2024-09-11T22:21:55.510153+0000","last_undegraded":"2024-09-11T22:21:55.510153+0000","last_fullsized":"2024-09-11T22:21:55.510153+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:24:49.028872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661125+0000","last_change":"2024-09-11T22:21:54.516510+0000","last_active":"2024-09-11T22:21:55.661125+0000","last_peered":"2024-09-11T22:21:55.661125+0000","last_clean":"2024-09-11T22:21:55.661125+0000","last_became_active":"2024-09-11T22:21:54.516234+0000","last_became_peered":"2024-09-11T22:21:54.516234+0000","last_unstale":"2024-09-11T22:21:55.661125+0000","last_undegraded":"2024-09-11T22:21:55.661125+0000","last_fullsized":"2024-09-11T22:21:55.661125+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:18:03.089109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"166'2","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.503819+0000","last_change":"2024-09-11T22:21:53.521872+0000","last_active":"2024-09-11T22:21:55.503819+0000","last_peered":"2024-09-11T22:21:55.503819+0000","last_clean":"2024-09-11T22:21:55.503819+0000","last_became_active":"2024-09-11T22:21:53.520880+0000","last_became_peered":"2024-09-11T22:21:53.520880+0000","last_unstale":"2024-09-11T22:21:55.503819+0000","last_undegraded":"2024-09-11T22:21:55.503819+0000","last_fullsized":"2024-09-11T22:21:55.503819+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:10.597577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.510488+0000","last_change":"2024-09-11T22:21:54.511708+0000","last_active":"2024-09-11T22:21:55.510488+0000","last_peered":"2024-09-11T22:21:55.510488+0000","last_clean":"2024-09-11T22:21:55.510488+0000","last_became_active":"2024-09-11T22:21:54.511443+0000","last_became_peered":"2024-09-11T22:21:54.511443+0000","last_unstale":"2024-09-11T22:21:55.510488+0000","last_undegraded":"2024-09-11T22:21:55.510488+0000","last_fullsized":"2024-09-11T22:21:55.510488+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:43.498745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"166'2","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509382+0000","last_change":"2024-09-11T22:21:53.515134+0000","last_active":"2024-09-11T22:21:55.509382+0000","last_peered":"2024-09-11T22:21:55.509382+0000","last_clean":"2024-09-11T22:21:55.509382+0000","last_became_active":"2024-09-11T22:21:53.514736+0000","last_became_peered":"2024-09-11T22:21:53.514736+0000","last_unstale":"2024-09-11T22:21:55.509382+0000","last_undegraded":"2024-09-11T22:21:55.509382+0000","last_fullsized":"2024-09-11T22:21:55.509382+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:25.414781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661117+0000","last_change":"2024-09-11T22:21:54.528564+0000","last_active":"2024-09-11T22:21:55.661117+0000","last_peered":"2024-09-11T22:21:55.661117+0000","last_clean":"2024-09-11T22:21:55.661117+0000","last_became_active":"2024-09-11T22:21:54.527823+0000","last_became_peered":"2024-09-11T22:21:54.527823+0000","last_unstale":"2024-09-11T22:21:55.661117+0000","last_undegraded":"2024-09-11T22:21:55.661117+0000","last_fullsized":"2024-09-11T22:21:55.661117+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:09.643465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662211+0000","last_change":"2024-09-11T22:21:53.520007+0000","last_active":"2024-09-11T22:21:55.662211+0000","last_peered":"2024-09-11T22:21:55.662211+0000","last_clean":"2024-09-11T22:21:55.662211+0000","last_became_active":"2024-09-11T22:21:53.519448+0000","last_became_peered":"2024-09-11T22:21:53.519448+0000","last_unstale":"2024-09-11T22:21:55.662211+0000","last_undegraded":"2024-09-11T22:21:55.662211+0000","last_fullsized":"2024-09-11T22:21:55.662211+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:52.290796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661080+0000","last_change":"2024-09-11T22:21:54.517899+0000","last_active":"2024-09-11T22:21:55.661080+0000","last_peered":"2024-09-11T22:21:55.661080+0000","last_clean":"2024-09-11T22:21:55.661080+0000","last_became_active":"2024-09-11T22:21:54.517606+0000","last_became_peered":"2024-09-11T22:21:54.517606+0000","last_unstale":"2024-09-11T22:21:55.661080+0000","last_undegraded":"2024-09-11T22:21:55.661080+0000","last_fullsized":"2024-09-11T22:21:55.661080+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:55.347696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662111+0000","last_change":"2024-09-11T22:21:53.511743+0000","last_active":"2024-09-11T22:21:55.662111+0000","last_peered":"2024-09-11T22:21:55.662111+0000","last_clean":"2024-09-11T22:21:55.662111+0000","last_became_active":"2024-09-11T22:21:53.511450+0000","last_became_peered":"2024-09-11T22:21:53.511450+0000","last_unstale":"2024-09-11T22:21:55.662111+0000","last_undegraded":"2024-09-11T22:21:55.662111+0000","last_fullsized":"2024-09-11T22:21:55.662111+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:27.820135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660837+0000","last_change":"2024-09-11T22:21:54.518745+0000","last_active":"2024-09-11T22:21:55.660837+0000","last_peered":"2024-09-11T22:21:55.660837+0000","last_clean":"2024-09-11T22:21:55.660837+0000","last_became_active":"2024-09-11T22:21:54.518432+0000","last_became_peered":"2024-09-11T22:21:54.518432+0000","last_unstale":"2024-09-11T22:21:55.660837+0000","last_undegraded":"2024-09-11T22:21:55.660837+0000","last_fullsized":"2024-09-11T22:21:55.660837+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:49.850962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660883+0000","last_change":"2024-09-11T22:21:53.520690+0000","last_active":"2024-09-11T22:21:55.660883+0000","last_peered":"2024-09-11T22:21:55.660883+0000","last_clean":"2024-09-11T22:21:55.660883+0000","last_became_active":"2024-09-11T22:21:53.520402+0000","last_became_peered":"2024-09-11T22:21:53.520402+0000","last_unstale":"2024-09-11T22:21:55.660883+0000","last_undegraded":"2024-09-11T22:21:55.660883+0000","last_fullsized":"2024-09-11T22:21:55.660883+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:05.650500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.503841+0000","last_change":"2024-09-11T22:21:54.517755+0000","last_active":"2024-09-11T22:21:55.503841+0000","last_peered":"2024-09-11T22:21:55.503841+0000","last_clean":"2024-09-11T22:21:55.503841+0000","last_became_active":"2024-09-11T22:21:54.517448+0000","last_became_peered":"2024-09-11T22:21:54.517448+0000","last_unstale":"2024-09-11T22:21:55.503841+0000","last_undegraded":"2024-09-11T22:21:55.503841+0000","last_fullsized":"2024-09-11T22:21:55.503841+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:29.952949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661038+0000","last_change":"2024-09-11T22:21:53.507631+0000","last_active":"2024-09-11T22:21:55.661038+0000","last_peered":"2024-09-11T22:21:55.661038+0000","last_clean":"2024-09-11T22:21:55.661038+0000","last_became_active":"2024-09-11T22:21:53.507356+0000","last_became_peered":"2024-09-11T22:21:53.507356+0000","last_unstale":"2024-09-11T22:21:55.661038+0000","last_undegraded":"2024-09-11T22:21:55.661038+0000","last_fullsized":"2024-09-11T22:21:55.661038+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:22.610368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661229+0000","last_change":"2024-09-11T22:21:54.529458+0000","last_active":"2024-09-11T22:21:55.661229+0000","last_peered":"2024-09-11T22:21:55.661229+0000","last_clean":"2024-09-11T22:21:55.661229+0000","last_became_active":"2024-09-11T22:21:54.529177+0000","last_became_peered":"2024-09-11T22:21:54.529177+0000","last_unstale":"2024-09-11T22:21:55.661229+0000","last_undegraded":"2024-09-11T22:21:55.661229+0000","last_fullsized":"2024-09-11T22:21:55.661229+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:54.415695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662272+0000","last_change":"2024-09-11T22:21:53.516194+0000","last_active":"2024-09-11T22:21:55.662272+0000","last_peered":"2024-09-11T22:21:55.662272+0000","last_clean":"2024-09-11T22:21:55.662272+0000","last_became_active":"2024-09-11T22:21:53.515797+0000","last_became_peered":"2024-09-11T22:21:53.515797+0000","last_unstale":"2024-09-11T22:21:55.662272+0000","last_undegraded":"2024-09-11T22:21:55.662272+0000","last_fullsized":"2024-09-11T22:21:55.662272+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:03.962378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661302+0000","last_change":"2024-09-11T22:21:54.512404+0000","last_active":"2024-09-11T22:21:55.661302+0000","last_peered":"2024-09-11T22:21:55.661302+0000","last_clean":"2024-09-11T22:21:55.661302+0000","last_became_active":"2024-09-11T22:21:54.511574+0000","last_became_peered":"2024-09-11T22:21:54.511574+0000","last_unstale":"2024-09-11T22:21:55.661302+0000","last_undegraded":"2024-09-11T22:21:55.661302+0000","last_fullsized":"2024-09-11T22:21:55.661302+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:33.884774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"166'3","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660472+0000","last_change":"2024-09-11T22:21:53.521712+0000","last_active":"2024-09-11T22:21:55.660472+0000","last_peered":"2024-09-11T22:21:55.660472+0000","last_clean":"2024-09-11T22:21:55.660472+0000","last_became_active":"2024-09-11T22:21:53.521403+0000","last_became_peered":"2024-09-11T22:21:53.521403+0000","last_unstale":"2024-09-11T22:21:55.660472+0000","last_undegraded":"2024-09-11T22:21:55.660472+0000","last_fullsized":"2024-09-11T22:21:55.660472+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:05.404784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661118+0000","last_change":"2024-09-11T22:21:54.526232+0000","last_active":"2024-09-11T22:21:55.661118+0000","last_peered":"2024-09-11T22:21:55.661118+0000","last_clean":"2024-09-11T22:21:55.661118+0000","last_became_active":"2024-09-11T22:21:54.525958+0000","last_became_peered":"2024-09-11T22:21:54.525958+0000","last_unstale":"2024-09-11T22:21:55.661118+0000","last_undegraded":"2024-09-11T22:21:55.661118+0000","last_fullsized":"2024-09-11T22:21:55.661118+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:42.778498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"166'6","reported_seq":20,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.503618+0000","last_change":"2024-09-11T22:21:53.514233+0000","last_active":"2024-09-11T22:21:55.503618+0000","last_peered":"2024-09-11T22:21:55.503618+0000","last_clean":"2024-09-11T22:21:55.503618+0000","last_became_active":"2024-09-11T22:21:53.512269+0000","last_became_peered":"2024-09-11T22:21:53.512269+0000","last_unstale":"2024-09-11T22:21:55.503618+0000","last_undegraded":"2024-09-11T22:21:55.503618+0000","last_fullsized":"2024-09-11T22:21:55.503618+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.959158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.503471+0000","last_change":"2024-09-11T22:21:54.530410+0000","last_active":"2024-09-11T22:21:55.503471+0000","last_peered":"2024-09-11T22:21:55.503471+0000","last_clean":"2024-09-11T22:21:55.503471+0000","last_became_active":"2024-09-11T22:21:54.530134+0000","last_became_peered":"2024-09-11T22:21:54.530134+0000","last_unstale":"2024-09-11T22:21:55.503471+0000","last_undegraded":"2024-09-11T22:21:55.503471+0000","last_fullsized":"2024-09-11T22:21:55.503471+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:44.655073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"166'2","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661732+0000","last_change":"2024-09-11T22:21:53.522915+0000","last_active":"2024-09-11T22:21:55.661732+0000","last_peered":"2024-09-11T22:21:55.661732+0000","last_clean":"2024-09-11T22:21:55.661732+0000","last_became_active":"2024-09-11T22:21:53.522686+0000","last_became_peered":"2024-09-11T22:21:53.522686+0000","last_unstale":"2024-09-11T22:21:55.661732+0000","last_undegraded":"2024-09-11T22:21:55.661732+0000","last_fullsized":"2024-09-11T22:21:55.661732+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:34.088877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660922+0000","last_change":"2024-09-11T22:21:54.524174+0000","last_active":"2024-09-11T22:21:55.660922+0000","last_peered":"2024-09-11T22:21:55.660922+0000","last_clean":"2024-09-11T22:21:55.660922+0000","last_became_active":"2024-09-11T22:21:54.523657+0000","last_became_peered":"2024-09-11T22:21:54.523657+0000","last_unstale":"2024-09-11T22:21:55.660922+0000","last_undegraded":"2024-09-11T22:21:55.660922+0000","last_fullsized":"2024-09-11T22:21:55.660922+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:43.498745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661027+0000","last_change":"2024-09-11T22:21:53.517900+0000","last_active":"2024-09-11T22:21:55.661027+0000","last_peered":"2024-09-11T22:21:55.661027+0000","last_clean":"2024-09-11T22:21:55.661027+0000","last_became_active":"2024-09-11T22:21:53.517606+0000","last_became_peered":"2024-09-11T22:21:53.517606+0000","last_unstale":"2024-09-11T22:21:55.661027+0000","last_undegraded":"2024-09-11T22:21:55.661027+0000","last_fullsized":"2024-09-11T22:21:55.661027+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:28.254170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509738+0000","last_change":"2024-09-11T22:21:54.529514+0000","last_active":"2024-09-11T22:21:55.509738+0000","last_peered":"2024-09-11T22:21:55.509738+0000","last_clean":"2024-09-11T22:21:55.509738+0000","last_became_active":"2024-09-11T22:21:54.529115+0000","last_became_peered":"2024-09-11T22:21:54.529115+0000","last_unstale":"2024-09-11T22:21:55.509738+0000","last_undegraded":"2024-09-11T22:21:55.509738+0000","last_fullsized":"2024-09-11T22:21:55.509738+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:21.254274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660765+0000","last_change":"2024-09-11T22:21:53.511206+0000","last_active":"2024-09-11T22:21:55.660765+0000","last_peered":"2024-09-11T22:21:55.660765+0000","last_clean":"2024-09-11T22:21:55.660765+0000","last_became_active":"2024-09-11T22:21:53.510917+0000","last_became_peered":"2024-09-11T22:21:53.510917+0000","last_unstale":"2024-09-11T22:21:55.660765+0000","last_undegraded":"2024-09-11T22:21:55.660765+0000","last_fullsized":"2024-09-11T22:21:55.660765+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:39.797525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660681+0000","last_change":"2024-09-11T22:21:54.525286+0000","last_active":"2024-09-11T22:21:55.660681+0000","last_peered":"2024-09-11T22:21:55.660681+0000","last_clean":"2024-09-11T22:21:55.660681+0000","last_became_active":"2024-09-11T22:21:54.524881+0000","last_became_peered":"2024-09-11T22:21:54.524881+0000","last_unstale":"2024-09-11T22:21:55.660681+0000","last_undegraded":"2024-09-11T22:21:55.660681+0000","last_fullsized":"2024-09-11T22:21:55.660681+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:37.665301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"166'8","reported_seq":22,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660994+0000","last_change":"2024-09-11T22:21:53.520671+0000","last_active":"2024-09-11T22:21:55.660994+0000","last_peered":"2024-09-11T22:21:55.660994+0000","last_clean":"2024-09-11T22:21:55.660994+0000","last_became_active":"2024-09-11T22:21:53.520444+0000","last_became_peered":"2024-09-11T22:21:53.520444+0000","last_unstale":"2024-09-11T22:21:55.660994+0000","last_undegraded":"2024-09-11T22:21:55.660994+0000","last_fullsized":"2024-09-11T22:21:55.660994+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:46.184129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661328+0000","last_change":"2024-09-11T22:21:54.523135+0000","last_active":"2024-09-11T22:21:55.661328+0000","last_peered":"2024-09-11T22:21:55.661328+0000","last_clean":"2024-09-11T22:21:55.661328+0000","last_became_active":"2024-09-11T22:21:54.522756+0000","last_became_peered":"2024-09-11T22:21:54.522756+0000","last_unstale":"2024-09-11T22:21:55.661328+0000","last_undegraded":"2024-09-11T22:21:55.661328+0000","last_fullsized":"2024-09-11T22:21:55.661328+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:34.839422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662544+0000","last_change":"2024-09-11T22:21:53.514629+0000","last_active":"2024-09-11T22:21:55.662544+0000","last_peered":"2024-09-11T22:21:55.662544+0000","last_clean":"2024-09-11T22:21:55.662544+0000","last_became_active":"2024-09-11T22:21:53.514304+0000","last_became_peered":"2024-09-11T22:21:53.514304+0000","last_unstale":"2024-09-11T22:21:55.662544+0000","last_undegraded":"2024-09-11T22:21:55.662544+0000","last_fullsized":"2024-09-11T22:21:55.662544+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:43.852256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.510228+0000","last_change":"2024-09-11T22:21:54.514969+0000","last_active":"2024-09-11T22:21:55.510228+0000","last_peered":"2024-09-11T22:21:55.510228+0000","last_clean":"2024-09-11T22:21:55.510228+0000","last_became_active":"2024-09-11T22:21:54.514696+0000","last_became_peered":"2024-09-11T22:21:54.514696+0000","last_unstale":"2024-09-11T22:21:55.510228+0000","last_undegraded":"2024-09-11T22:21:55.510228+0000","last_fullsized":"2024-09-11T22:21:55.510228+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:49.850962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"166'2","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661990+0000","last_change":"2024-09-11T22:21:53.509336+0000","last_active":"2024-09-11T22:21:55.661990+0000","last_peered":"2024-09-11T22:21:55.661990+0000","last_clean":"2024-09-11T22:21:55.661990+0000","last_became_active":"2024-09-11T22:21:53.509033+0000","last_became_peered":"2024-09-11T22:21:53.509033+0000","last_unstale":"2024-09-11T22:21:55.661990+0000","last_undegraded":"2024-09-11T22:21:55.661990+0000","last_fullsized":"2024-09-11T22:21:55.661990+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:19.472901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509936+0000","last_change":"2024-09-11T22:21:54.518712+0000","last_active":"2024-09-11T22:21:55.509936+0000","last_peered":"2024-09-11T22:21:55.509936+0000","last_clean":"2024-09-11T22:21:55.509936+0000","last_became_active":"2024-09-11T22:21:54.517702+0000","last_became_peered":"2024-09-11T22:21:54.517702+0000","last_unstale":"2024-09-11T22:21:55.509936+0000","last_undegraded":"2024-09-11T22:21:55.509936+0000","last_fullsized":"2024-09-11T22:21:55.509936+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:05:36.612610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"166'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661647+0000","last_change":"2024-09-11T22:21:53.520425+0000","last_active":"2024-09-11T22:21:55.661647+0000","last_peered":"2024-09-11T22:21:55.661647+0000","last_clean":"2024-09-11T22:21:55.661647+0000","last_became_active":"2024-09-11T22:21:53.520189+0000","last_became_peered":"2024-09-11T22:21:53.520189+0000","last_unstale":"2024-09-11T22:21:55.661647+0000","last_undegraded":"2024-09-11T22:21:55.661647+0000","last_fullsized":"2024-09-11T22:21:55.661647+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:22.352739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509246+0000","last_change":"2024-09-11T22:21:54.517853+0000","last_active":"2024-09-11T22:21:55.509246+0000","last_peered":"2024-09-11T22:21:55.509246+0000","last_clean":"2024-09-11T22:21:55.509246+0000","last_became_active":"2024-09-11T22:21:54.517588+0000","last_became_peered":"2024-09-11T22:21:54.517588+0000","last_unstale":"2024-09-11T22:21:55.509246+0000","last_undegraded":"2024-09-11T22:21:55.509246+0000","last_fullsized":"2024-09-11T22:21:55.509246+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:57.099304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661408+0000","last_change":"2024-09-11T22:21:53.508764+0000","last_active":"2024-09-11T22:21:55.661408+0000","last_peered":"2024-09-11T22:21:55.661408+0000","last_clean":"2024-09-11T22:21:55.661408+0000","last_became_active":"2024-09-11T22:21:53.508451+0000","last_became_peered":"2024-09-11T22:21:53.508451+0000","last_unstale":"2024-09-11T22:21:55.661408+0000","last_undegraded":"2024-09-11T22:21:55.661408+0000","last_fullsized":"2024-09-11T22:21:55.661408+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:25.414781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660928+0000","last_change":"2024-09-11T22:21:54.524375+0000","last_active":"2024-09-11T22:21:55.660928+0000","last_peered":"2024-09-11T22:21:55.660928+0000","last_clean":"2024-09-11T22:21:55.660928+0000","last_became_active":"2024-09-11T22:21:54.524004+0000","last_became_peered":"2024-09-11T22:21:54.524004+0000","last_unstale":"2024-09-11T22:21:55.660928+0000","last_undegraded":"2024-09-11T22:21:55.660928+0000","last_fullsized":"2024-09-11T22:21:55.660928+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:02.860219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"166'2","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.503454+0000","last_change":"2024-09-11T22:21:53.520041+0000","last_active":"2024-09-11T22:21:55.503454+0000","last_peered":"2024-09-11T22:21:55.503454+0000","last_clean":"2024-09-11T22:21:55.503454+0000","last_became_active":"2024-09-11T22:21:53.519719+0000","last_became_peered":"2024-09-11T22:21:53.519719+0000","last_unstale":"2024-09-11T22:21:55.503454+0000","last_undegraded":"2024-09-11T22:21:55.503454+0000","last_fullsized":"2024-09-11T22:21:55.503454+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:48.845184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660948+0000","last_change":"2024-09-11T22:21:54.511741+0000","last_active":"2024-09-11T22:21:55.660948+0000","last_peered":"2024-09-11T22:21:55.660948+0000","last_clean":"2024-09-11T22:21:55.660948+0000","last_became_active":"2024-09-11T22:21:54.511315+0000","last_became_peered":"2024-09-11T22:21:54.511315+0000","last_unstale":"2024-09-11T22:21:55.660948+0000","last_undegraded":"2024-09-11T22:21:55.660948+0000","last_fullsized":"2024-09-11T22:21:55.660948+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:09.964935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661095+0000","last_change":"2024-09-11T22:21:53.515176+0000","last_active":"2024-09-11T22:21:55.661095+0000","last_peered":"2024-09-11T22:21:55.661095+0000","last_clean":"2024-09-11T22:21:55.661095+0000","last_became_active":"2024-09-11T22:21:53.513869+0000","last_became_peered":"2024-09-11T22:21:53.513869+0000","last_unstale":"2024-09-11T22:21:55.661095+0000","last_undegraded":"2024-09-11T22:21:55.661095+0000","last_fullsized":"2024-09-11T22:21:55.661095+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:19.271785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.508962+0000","last_change":"2024-09-11T22:21:54.520679+0000","last_active":"2024-09-11T22:21:55.508962+0000","last_peered":"2024-09-11T22:21:55.508962+0000","last_clean":"2024-09-11T22:21:55.508962+0000","last_became_active":"2024-09-11T22:21:54.520250+0000","last_became_peered":"2024-09-11T22:21:54.520250+0000","last_unstale":"2024-09-11T22:21:55.508962+0000","last_undegraded":"2024-09-11T22:21:55.508962+0000","last_fullsized":"2024-09-11T22:21:55.508962+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:11.603355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.503528+0000","last_change":"2024-09-11T22:21:53.518061+0000","last_active":"2024-09-11T22:21:55.503528+0000","last_peered":"2024-09-11T22:21:55.503528+0000","last_clean":"2024-09-11T22:21:55.503528+0000","last_became_active":"2024-09-11T22:21:53.517766+0000","last_became_peered":"2024-09-11T22:21:53.517766+0000","last_unstale":"2024-09-11T22:21:55.503528+0000","last_undegraded":"2024-09-11T22:21:55.503528+0000","last_fullsized":"2024-09-11T22:21:55.503528+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:42.492968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661344+0000","last_change":"2024-09-11T22:21:54.512265+0000","last_active":"2024-09-11T22:21:55.661344+0000","last_peered":"2024-09-11T22:21:55.661344+0000","last_clean":"2024-09-11T22:21:55.661344+0000","last_became_active":"2024-09-11T22:21:54.511981+0000","last_became_peered":"2024-09-11T22:21:54.511981+0000","last_unstale":"2024-09-11T22:21:55.661344+0000","last_undegraded":"2024-09-11T22:21:55.661344+0000","last_fullsized":"2024-09-11T22:21:55.661344+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:19.038748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509847+0000","last_change":"2024-09-11T22:21:53.510553+0000","last_active":"2024-09-11T22:21:55.509847+0000","last_peered":"2024-09-11T22:21:55.509847+0000","last_clean":"2024-09-11T22:21:55.509847+0000","last_became_active":"2024-09-11T22:21:53.510274+0000","last_became_peered":"2024-09-11T22:21:53.510274+0000","last_unstale":"2024-09-11T22:21:55.509847+0000","last_undegraded":"2024-09-11T22:21:55.509847+0000","last_fullsized":"2024-09-11T22:21:55.509847+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:39.355959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.662247+0000","last_change":"2024-09-11T22:21:54.513344+0000","last_active":"2024-09-11T22:21:55.662247+0000","last_peered":"2024-09-11T22:21:55.662247+0000","last_clean":"2024-09-11T22:21:55.662247+0000","last_became_active":"2024-09-11T22:21:54.513063+0000","last_became_peered":"2024-09-11T22:21:54.513063+0000","last_unstale":"2024-09-11T22:21:55.662247+0000","last_undegraded":"2024-09-11T22:21:55.662247+0000","last_fullsized":"2024-09-11T22:21:55.662247+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:36.252373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"166'2","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661705+0000","last_change":"2024-09-11T22:21:53.521697+0000","last_active":"2024-09-11T22:21:55.661705+0000","last_peered":"2024-09-11T22:21:55.661705+0000","last_clean":"2024-09-11T22:21:55.661705+0000","last_became_active":"2024-09-11T22:21:53.521436+0000","last_became_peered":"2024-09-11T22:21:53.521436+0000","last_unstale":"2024-09-11T22:21:55.661705+0000","last_undegraded":"2024-09-11T22:21:55.661705+0000","last_fullsized":"2024-09-11T22:21:55.661705+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:32:22.006810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661779+0000","last_change":"2024-09-11T22:21:54.523820+0000","last_active":"2024-09-11T22:21:55.661779+0000","last_peered":"2024-09-11T22:21:55.661779+0000","last_clean":"2024-09-11T22:21:55.661779+0000","last_became_active":"2024-09-11T22:21:54.522784+0000","last_became_peered":"2024-09-11T22:21:54.522784+0000","last_unstale":"2024-09-11T22:21:55.661779+0000","last_undegraded":"2024-09-11T22:21:55.661779+0000","last_fullsized":"2024-09-11T22:21:55.661779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:19.238668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"167'1","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661516+0000","last_change":"2024-09-11T22:21:53.518479+0000","last_active":"2024-09-11T22:21:55.661516+0000","last_peered":"2024-09-11T22:21:55.661516+0000","last_clean":"2024-09-11T22:21:55.661516+0000","last_became_active":"2024-09-11T22:21:53.518194+0000","last_became_peered":"2024-09-11T22:21:53.518194+0000","last_unstale":"2024-09-11T22:21:55.661516+0000","last_undegraded":"2024-09-11T22:21:55.661516+0000","last_fullsized":"2024-09-11T22:21:55.661516+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:49.497417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661453+0000","last_change":"2024-09-11T22:21:54.512693+0000","last_active":"2024-09-11T22:21:55.661453+0000","last_peered":"2024-09-11T22:21:55.661453+0000","last_clean":"2024-09-11T22:21:55.661453+0000","last_became_active":"2024-09-11T22:21:54.512367+0000","last_became_peered":"2024-09-11T22:21:54.512367+0000","last_unstale":"2024-09-11T22:21:55.661453+0000","last_undegraded":"2024-09-11T22:21:55.661453+0000","last_fullsized":"2024-09-11T22:21:55.661453+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:56.980081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661158+0000","last_change":"2024-09-11T22:21:53.519158+0000","last_active":"2024-09-11T22:21:55.661158+0000","last_peered":"2024-09-11T22:21:55.661158+0000","last_clean":"2024-09-11T22:21:55.661158+0000","last_became_active":"2024-09-11T22:21:53.518027+0000","last_became_peered":"2024-09-11T22:21:53.518027+0000","last_unstale":"2024-09-11T22:21:55.661158+0000","last_undegraded":"2024-09-11T22:21:55.661158+0000","last_fullsized":"2024-09-11T22:21:55.661158+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:53:26.188881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660772+0000","last_change":"2024-09-11T22:21:54.518607+0000","last_active":"2024-09-11T22:21:55.660772+0000","last_peered":"2024-09-11T22:21:55.660772+0000","last_clean":"2024-09-11T22:21:55.660772+0000","last_became_active":"2024-09-11T22:21:54.518298+0000","last_became_peered":"2024-09-11T22:21:54.518298+0000","last_unstale":"2024-09-11T22:21:55.660772+0000","last_undegraded":"2024-09-11T22:21:55.660772+0000","last_fullsized":"2024-09-11T22:21:55.660772+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:58.412665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661552+0000","last_change":"2024-09-11T22:21:53.508001+0000","last_active":"2024-09-11T22:21:55.661552+0000","last_peered":"2024-09-11T22:21:55.661552+0000","last_clean":"2024-09-11T22:21:55.661552+0000","last_became_active":"2024-09-11T22:21:53.507189+0000","last_became_peered":"2024-09-11T22:21:53.507189+0000","last_unstale":"2024-09-11T22:21:55.661552+0000","last_undegraded":"2024-09-11T22:21:55.661552+0000","last_fullsized":"2024-09-11T22:21:55.661552+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:22.108515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661479+0000","last_change":"2024-09-11T22:21:54.523677+0000","last_active":"2024-09-11T22:21:55.661479+0000","last_peered":"2024-09-11T22:21:55.661479+0000","last_clean":"2024-09-11T22:21:55.661479+0000","last_became_active":"2024-09-11T22:21:54.523304+0000","last_became_peered":"2024-09-11T22:21:54.523304+0000","last_unstale":"2024-09-11T22:21:55.661479+0000","last_undegraded":"2024-09-11T22:21:55.661479+0000","last_fullsized":"2024-09-11T22:21:55.661479+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:08.351084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.510352+0000","last_change":"2024-09-11T22:21:53.510639+0000","last_active":"2024-09-11T22:21:55.510352+0000","last_peered":"2024-09-11T22:21:55.510352+0000","last_clean":"2024-09-11T22:21:55.510352+0000","last_became_active":"2024-09-11T22:21:53.510362+0000","last_became_peered":"2024-09-11T22:21:53.510362+0000","last_unstale":"2024-09-11T22:21:55.510352+0000","last_undegraded":"2024-09-11T22:21:55.510352+0000","last_fullsized":"2024-09-11T22:21:55.510352+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:03.561959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661714+0000","last_change":"2024-09-11T22:21:54.527134+0000","last_active":"2024-09-11T22:21:55.661714+0000","last_peered":"2024-09-11T22:21:55.661714+0000","last_clean":"2024-09-11T22:21:55.661714+0000","last_became_active":"2024-09-11T22:21:54.526844+0000","last_became_peered":"2024-09-11T22:21:54.526844+0000","last_unstale":"2024-09-11T22:21:55.661714+0000","last_undegraded":"2024-09-11T22:21:55.661714+0000","last_fullsized":"2024-09-11T22:21:55.661714+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:34.259306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.510108+0000","last_change":"2024-09-11T22:21:53.507391+0000","last_active":"2024-09-11T22:21:55.510108+0000","last_peered":"2024-09-11T22:21:55.510108+0000","last_clean":"2024-09-11T22:21:55.510108+0000","last_became_active":"2024-09-11T22:21:53.507076+0000","last_became_peered":"2024-09-11T22:21:53.507076+0000","last_unstale":"2024-09-11T22:21:55.510108+0000","last_undegraded":"2024-09-11T22:21:55.510108+0000","last_fullsized":"2024-09-11T22:21:55.510108+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:11.081873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509043+0000","last_change":"2024-09-11T22:21:54.512998+0000","last_active":"2024-09-11T22:21:55.509043+0000","last_peered":"2024-09-11T22:21:55.509043+0000","last_clean":"2024-09-11T22:21:55.509043+0000","last_became_active":"2024-09-11T22:21:54.512715+0000","last_became_peered":"2024-09-11T22:21:54.512715+0000","last_unstale":"2024-09-11T22:21:55.509043+0000","last_undegraded":"2024-09-11T22:21:55.509043+0000","last_fullsized":"2024-09-11T22:21:55.509043+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:43.498745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.509887+0000","last_change":"2024-09-11T22:21:53.513015+0000","last_active":"2024-09-11T22:21:55.509887+0000","last_peered":"2024-09-11T22:21:55.509887+0000","last_clean":"2024-09-11T22:21:55.509887+0000","last_became_active":"2024-09-11T22:21:53.511892+0000","last_became_peered":"2024-09-11T22:21:53.511892+0000","last_unstale":"2024-09-11T22:21:55.509887+0000","last_undegraded":"2024-09-11T22:21:55.509887+0000","last_fullsized":"2024-09-11T22:21:55.509887+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:22.610368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661492+0000","last_change":"2024-09-11T22:21:54.516765+0000","last_active":"2024-09-11T22:21:55.661492+0000","last_peered":"2024-09-11T22:21:55.661492+0000","last_clean":"2024-09-11T22:21:55.661492+0000","last_became_active":"2024-09-11T22:21:54.516472+0000","last_became_peered":"2024-09-11T22:21:54.516472+0000","last_unstale":"2024-09-11T22:21:55.661492+0000","last_undegraded":"2024-09-11T22:21:55.661492+0000","last_fullsized":"2024-09-11T22:21:55.661492+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:03.343797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.503379+0000","last_change":"2024-09-11T22:21:53.518211+0000","last_active":"2024-09-11T22:21:55.503379+0000","last_peered":"2024-09-11T22:21:55.503379+0000","last_clean":"2024-09-11T22:21:55.503379+0000","last_became_active":"2024-09-11T22:21:53.517362+0000","last_became_peered":"2024-09-11T22:21:53.517362+0000","last_unstale":"2024-09-11T22:21:55.503379+0000","last_undegraded":"2024-09-11T22:21:55.503379+0000","last_fullsized":"2024-09-11T22:21:55.503379+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:46.124081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.660540+0000","last_change":"2024-09-11T22:21:54.528179+0000","last_active":"2024-09-11T22:21:55.660540+0000","last_peered":"2024-09-11T22:21:55.660540+0000","last_clean":"2024-09-11T22:21:55.660540+0000","last_became_active":"2024-09-11T22:21:54.526929+0000","last_became_peered":"2024-09-11T22:21:54.526929+0000","last_unstale":"2024-09-11T22:21:55.660540+0000","last_undegraded":"2024-09-11T22:21:55.660540+0000","last_fullsized":"2024-09-11T22:21:55.660540+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:53.492779+0000","last_clean_scrub_stamp":"2024-09-11T22:21:53.492779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:20.478678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661259+0000","last_change":"2024-09-11T22:21:53.514489+0000","last_active":"2024-09-11T22:21:55.661259+0000","last_peered":"2024-09-11T22:21:55.661259+0000","last_clean":"2024-09-11T22:21:55.661259+0000","last_became_active":"2024-09-11T22:21:53.514203+0000","last_became_peered":"2024-09-11T22:21:53.514203+0000","last_unstale":"2024-09-11T22:21:55.661259+0000","last_undegraded":"2024-09-11T22:21:55.661259+0000","last_fullsized":"2024-09-11T22:21:55.661259+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:21:52.487001+0000","last_clean_scrub_stamp":"2024-09-11T22:21:52.487001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:49.890240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":436,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T22:21:55.661047+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:21:55.661047+0000","last_peered":"2024-09-11T22:21:55.661047+0000","last_clean":"2024-09-11T22:21:55.661047+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:21:55.661047+0000","last_undegraded":"2024-09-11T22:21:55.661047+0000","last_fullsized":"2024-09-11T22:21:55.661047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509576,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51288,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320552,"statfs":{"total":96636764160,"available":96584245248,"internally_reserved":0,"allocated":2093056,"data_stored":920258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509573,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51280,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320560,"statfs":{"total":96636764160,"available":96584253440,"internally_reserved":0,"allocated":2093056,"data_stored":920258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509575,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59616,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312224,"statfs":{"total":96636764160,"available":96575717376,"internally_reserved":0,"allocated":2109440,"data_stored":922452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59612,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312228,"statfs":{"total":96636764160,"available":96575721472,"internally_reserved":0,"allocated":2105344,"data_stored":920452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509575,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47136,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324704,"statfs":{"total":96636764160,"available":96588496896,"internally_reserved":0,"allocated":2105344,"data_stored":921870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509574,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60184,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311656,"statfs":{"total":96636764160,"available":96575135744,"internally_reserved":0,"allocated":2691072,"data_stored":1510648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56028,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315812,"statfs":{"total":96636764160,"available":96579391488,"internally_reserved":0,"allocated":2695168,"data_stored":1510730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47140,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324700,"statfs":{"total":96636764160,"available":96588492800,"internally_reserved":0,"allocated":2105344,"data_stored":920952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:22:02.247 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:22:02.247 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T22:22:02.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.392+0000 7f45792c0640 1 Processor -- start 2024-09-11T22:22:02.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.393+0000 7f45792c0640 1 -- start start 2024-09-11T22:22:02.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.393+0000 7f45792c0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f457415c2c0 0x7f45740b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.393+0000 7f45792c0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f45740b3e10 0x7f45740cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.393+0000 7f45792c0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45740b4f00 con 0x7f45740d0410 2024-09-11T22:22:02.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.393+0000 7f45792c0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f45740cf7a0 con 0x7f45740b3e10 2024-09-11T22:22:02.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.393+0000 7f45792c0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f45740d0840 con 0x7f457415c2c0 2024-09-11T22:22:02.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.394+0000 7f45737fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f45740d0410 0x7f457415fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:54802/0 (socket says 172.21.15.50:54802) 2024-09-11T22:22:02.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.394+0000 7f45737fe640 1 -- 172.21.15.50:0/181455102 learned_addr learned my addr 172.21.15.50:0/181455102 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:02.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.394+0000 7f4572ffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f457415c2c0 0x7f45740b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.394+0000 7f45727fc640 1 --2- 172.21.15.50:0/181455102 >> v2:172.21.15.77:3300/0 conn(0x7f45740b3e10 0x7f45740cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.394+0000 7f4571ffb640 1 -- 172.21.15.50:0/181455102 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3668949907 0 0) 0x7f45740b4f00 con 0x7f45740d0410 2024-09-11T22:22:02.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.394+0000 7f4571ffb640 1 -- 172.21.15.50:0/181455102 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f455c003520 con 0x7f45740d0410 2024-09-11T22:22:02.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.394+0000 7f45727fc640 1 -- 172.21.15.50:0/181455102 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f457415c2c0 msgr2=0x7f45740b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:02.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.394+0000 7f45727fc640 1 --2- 172.21.15.50:0/181455102 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f457415c2c0 0x7f45740b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.394+0000 7f45727fc640 1 -- 172.21.15.50:0/181455102 >> v1:172.21.15.77:6789/0 conn(0x7f45740d0410 legacy=0x7f457415fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.394+0000 7f45727fc640 1 -- 172.21.15.50:0/181455102 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45740b4360 con 0x7f45740b3e10 2024-09-11T22:22:02.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.394+0000 7f4572ffd640 1 --2- 172.21.15.50:0/181455102 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f457415c2c0 0x7f45740b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:02.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.395+0000 7f45727fc640 1 --2- 172.21.15.50:0/181455102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45740b3e10 0x7f45740cfed0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f45680097a0 tx=0x7f456802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a475c142cbf19a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:02.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.395+0000 7f4571ffb640 1 -- 172.21.15.50:0/181455102 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568037070 con 0x7f45740b3e10 2024-09-11T22:22:02.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.395+0000 7f4571ffb640 1 -- 172.21.15.50:0/181455102 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f456802ae50 con 0x7f45740b3e10 2024-09-11T22:22:02.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.395+0000 7f4571ffb640 1 -- 172.21.15.50:0/181455102 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568032640 con 0x7f45740b3e10 2024-09-11T22:22:02.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.396+0000 7f45792c0640 1 -- 172.21.15.50:0/181455102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45740b3e10 msgr2=0x7f45740cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.396+0000 7f45792c0640 1 --2- 172.21.15.50:0/181455102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45740b3e10 0x7f45740cfed0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f45680097a0 tx=0x7f456802a100 comp rx=0 tx=0).stop 2024-09-11T22:22:02.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.396+0000 7f45792c0640 1 -- 172.21.15.50:0/181455102 shutdown_connections 2024-09-11T22:22:02.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.396+0000 7f45792c0640 1 --2- 172.21.15.50:0/181455102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45740b3e10 0x7f45740cfed0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.396+0000 7f45792c0640 1 --2- 172.21.15.50:0/181455102 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f457415c2c0 0x7f45740b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.396+0000 7f45792c0640 1 -- 172.21.15.50:0/181455102 >> 172.21.15.50:0/181455102 conn(0x7f45740679c0 msgr2=0x7f4574067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:02.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.396+0000 7f45792c0640 1 -- 172.21.15.50:0/181455102 shutdown_connections 2024-09-11T22:22:02.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.396+0000 7f45792c0640 1 -- 172.21.15.50:0/181455102 wait complete. 2024-09-11T22:22:02.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.397+0000 7f45792c0640 1 Processor -- start 2024-09-11T22:22:02.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.397+0000 7f45792c0640 1 -- start start 2024-09-11T22:22:02.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f45792c0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45740b3e10 0x7f45741f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f45792c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45740d0410 0x7f457415c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f45792c0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f457415c2c0 0x7f4574150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f45792c0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f45740cfc10 con 0x7f45740b3e10 2024-09-11T22:22:02.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f45792c0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f45740b54a0 con 0x7f45740d0410 2024-09-11T22:22:02.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f45792c0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f45740ce200 con 0x7f457415c2c0 2024-09-11T22:22:02.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f4572ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45740b3e10 0x7f45741f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f4572ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45740b3e10 0x7f45741f60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48480/0 (socket says 172.21.15.50:48480) 2024-09-11T22:22:02.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f4572ffd640 1 -- 172.21.15.50:0/643025272 learned_addr learned my addr 172.21.15.50:0/643025272 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:02.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f4572ffd640 1 -- 172.21.15.50:0/643025272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f457415c2c0 msgr2=0x7f4574150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f4572ffd640 1 --2- 172.21.15.50:0/643025272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f457415c2c0 0x7f4574150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f4572ffd640 1 -- 172.21.15.50:0/643025272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45740d0410 msgr2=0x7f457415c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f4572ffd640 1 --2- 172.21.15.50:0/643025272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45740d0410 0x7f457415c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f4572ffd640 1 -- 172.21.15.50:0/643025272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457415cfb0 con 0x7f45740b3e10 2024-09-11T22:22:02.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f4572ffd640 1 --2- 172.21.15.50:0/643025272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45740b3e10 0x7f45741f60e0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f456400ebe0 tx=0x7f456400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:02.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.398+0000 7f455b7fe640 1 -- 172.21.15.50:0/643025272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4564017070 con 0x7f45740b3e10 2024-09-11T22:22:02.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.399+0000 7f455b7fe640 1 -- 172.21.15.50:0/643025272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f456400cc30 con 0x7f45740b3e10 2024-09-11T22:22:02.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.399+0000 7f45792c0640 1 -- 172.21.15.50:0/643025272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f457415d290 con 0x7f45740b3e10 2024-09-11T22:22:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.399+0000 7f455b7fe640 1 -- 172.21.15.50:0/643025272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4564013470 con 0x7f45740b3e10 2024-09-11T22:22:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.399+0000 7f45792c0640 1 -- 172.21.15.50:0/643025272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f457415ec80 con 0x7f45740b3e10 2024-09-11T22:22:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.400+0000 7f45792c0640 1 -- 172.21.15.50:0/643025272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f457406d070 con 0x7f45740b3e10 2024-09-11T22:22:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.400+0000 7f455b7fe640 1 -- 172.21.15.50:0/643025272 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f456401a070 con 0x7f45740b3e10 2024-09-11T22:22:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.401+0000 7f455b7fe640 1 --2- 172.21.15.50:0/643025272 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f456006be30 0x7f456006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.401+0000 7f455b7fe640 1 -- 172.21.15.50:0/643025272 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f456408b0f0 con 0x7f45740b3e10 2024-09-11T22:22:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.401+0000 7f45727fc640 1 --2- 172.21.15.50:0/643025272 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f456006be30 0x7f456006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.402+0000 7f45727fc640 1 --2- 172.21.15.50:0/643025272 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f456006be30 0x7f456006e2f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4568034000 tx=0x7f456802c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:02.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.405+0000 7f455b7fe640 1 -- 172.21.15.50:0/643025272 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4564059b30 con 0x7f45740b3e10 2024-09-11T22:22:02.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.653+0000 7f45792c0640 1 -- 172.21.15.50:0/643025272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f457406ec80 con 0x7f45740b3e10 2024-09-11T22:22:02.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.655+0000 7f455b7fe640 1 -- 172.21.15.50:0/643025272 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7f4564059430 con 0x7f45740b3e10 2024-09-11T22:22:02.656 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:22:02.656 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:22:02.656 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-09-11T22:22:02.656 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-09-11T22:22:02.656 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T22:22:02.657 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-11T22:22:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.657+0000 7f45792c0640 1 -- 172.21.15.50:0/643025272 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f456006be30 msgr2=0x7f456006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.657+0000 7f45792c0640 1 --2- 172.21.15.50:0/643025272 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f456006be30 0x7f456006e2f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4568034000 tx=0x7f456802c000 comp rx=0 tx=0).stop 2024-09-11T22:22:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.657+0000 7f45792c0640 1 -- 172.21.15.50:0/643025272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45740b3e10 msgr2=0x7f45741f60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.657+0000 7f45792c0640 1 --2- 172.21.15.50:0/643025272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45740b3e10 0x7f45741f60e0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f456400ebe0 tx=0x7f456400c520 comp rx=0 tx=0).stop 2024-09-11T22:22:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.658+0000 7f45792c0640 1 -- 172.21.15.50:0/643025272 shutdown_connections 2024-09-11T22:22:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.658+0000 7f45792c0640 1 --2- 172.21.15.50:0/643025272 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f456006be30 0x7f456006e2f0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.658+0000 7f45792c0640 1 --2- 172.21.15.50:0/643025272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f457415c2c0 0x7f4574150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.658+0000 7f45792c0640 1 --2- 172.21.15.50:0/643025272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45740d0410 0x7f457415c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.658+0000 7f45792c0640 1 --2- 172.21.15.50:0/643025272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45740b3e10 0x7f45741f60e0 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.658+0000 7f45792c0640 1 -- 172.21.15.50:0/643025272 >> 172.21.15.50:0/643025272 conn(0x7f45740679c0 msgr2=0x7f4574158590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.658+0000 7f45792c0640 1 -- 172.21.15.50:0/643025272 shutdown_connections 2024-09-11T22:22:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.658+0000 7f45792c0640 1 -- 172.21.15.50:0/643025272 wait complete. 2024-09-11T22:22:02.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:22:02.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.771+0000 7f507f2d0640 1 Processor -- start 2024-09-11T22:22:02.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.771+0000 7f507f2d0640 1 -- start start 2024-09-11T22:22:02.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.772+0000 7f507f2d0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f507815fb60 0x7f50780b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.772+0000 7f507f2d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50780d0fd0 0x7f50780af670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.772+0000 7f507f2d0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f507815ff40 con 0x7f50780d0150 2024-09-11T22:22:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.772+0000 7f507f2d0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f50780cf510 con 0x7f507815fb60 2024-09-11T22:22:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.772+0000 7f507f2d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f50780cfdb0 con 0x7f50780d0fd0 2024-09-11T22:22:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.773+0000 7f507d06c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f507815fb60 0x7f50780b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.773+0000 7f507d86d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50780d0fd0 0x7f50780af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.773+0000 7f507d06c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f507815fb60 0x7f50780b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:46540/0 (socket says 172.21.15.50:46540) 2024-09-11T22:22:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.773+0000 7f507d06c640 1 -- 172.21.15.50:0/3914746562 learned_addr learned my addr 172.21.15.50:0/3914746562 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.773+0000 7f507c86b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f50780d0150 0x7f50780d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:54816/0 (socket says 172.21.15.50:54816) 2024-09-11T22:22:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.773+0000 7f507d06c640 1 -- 172.21.15.50:0/3914746562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50780d0fd0 msgr2=0x7f50780af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.773+0000 7f507d06c640 1 --2- 172.21.15.50:0/3914746562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50780d0fd0 0x7f50780af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.773+0000 7f507d06c640 1 -- 172.21.15.50:0/3914746562 >> v1:172.21.15.77:6789/0 conn(0x7f50780d0150 legacy=0x7f50780d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.773+0000 7f507d06c640 1 -- 172.21.15.50:0/3914746562 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50780d05e0 con 0x7f507815fb60 2024-09-11T22:22:02.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.774+0000 7f507d06c640 1 --2- 172.21.15.50:0/3914746562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f507815fb60 0x7f50780b4c70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5070009870 tx=0x7f507002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa3efd5a71dd477b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.774+0000 7f5077fff640 1 -- 172.21.15.50:0/3914746562 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5070037070 con 0x7f507815fb60 2024-09-11T22:22:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.774+0000 7f5077fff640 1 -- 172.21.15.50:0/3914746562 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5070032440 con 0x7f507815fb60 2024-09-11T22:22:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.774+0000 7f5077fff640 1 -- 172.21.15.50:0/3914746562 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5070032810 con 0x7f507815fb60 2024-09-11T22:22:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.774+0000 7f507f2d0640 1 -- 172.21.15.50:0/3914746562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f507815fb60 msgr2=0x7f50780b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.774+0000 7f507f2d0640 1 --2- 172.21.15.50:0/3914746562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f507815fb60 0x7f50780b4c70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5070009870 tx=0x7f507002a1c0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.774+0000 7f507f2d0640 1 -- 172.21.15.50:0/3914746562 shutdown_connections 2024-09-11T22:22:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.774+0000 7f507f2d0640 1 --2- 172.21.15.50:0/3914746562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50780d0fd0 0x7f50780af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.774+0000 7f507f2d0640 1 --2- 172.21.15.50:0/3914746562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f507815fb60 0x7f50780b4c70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.774+0000 7f507f2d0640 1 -- 172.21.15.50:0/3914746562 >> 172.21.15.50:0/3914746562 conn(0x7f50780b4150 msgr2=0x7f50780b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.775+0000 7f507f2d0640 1 -- 172.21.15.50:0/3914746562 shutdown_connections 2024-09-11T22:22:02.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.775+0000 7f507f2d0640 1 -- 172.21.15.50:0/3914746562 wait complete. 2024-09-11T22:22:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.776+0000 7f507f2d0640 1 Processor -- start 2024-09-11T22:22:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.776+0000 7f507f2d0640 1 -- start start 2024-09-11T22:22:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.776+0000 7f507f2d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50780d0fd0 0x7f50780b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.776+0000 7f507f2d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f507815fb60 0x7f50781559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.776+0000 7f507f2d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50780cbe00 0x7f50780cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.776+0000 7f507f2d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f50780b1930 con 0x7f50780cbe00 2024-09-11T22:22:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.776+0000 7f507f2d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f50780cfa40 con 0x7f50780d0fd0 2024-09-11T22:22:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.776+0000 7f507f2d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f50780b1ab0 con 0x7f507815fb60 2024-09-11T22:22:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f507d86d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50780cbe00 0x7f50780cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f507d86d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50780cbe00 0x7f50780cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48488/0 (socket says 172.21.15.50:48488) 2024-09-11T22:22:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f507d86d640 1 -- 172.21.15.50:0/1033479599 learned_addr learned my addr 172.21.15.50:0/1033479599 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f507d06c640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50780d0fd0 0x7f50780b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f507c86b640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f507815fb60 0x7f50781559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f507d86d640 1 -- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f507815fb60 msgr2=0x7f50781559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f507d86d640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f507815fb60 0x7f50781559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f507d86d640 1 -- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50780d0fd0 msgr2=0x7f50780b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f507d86d640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50780d0fd0 0x7f50780b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f507d86d640 1 -- 172.21.15.50:0/1033479599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50781595c0 con 0x7f50780cbe00 2024-09-11T22:22:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f507c86b640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f507815fb60 0x7f50781559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f507d86d640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50780cbe00 0x7f50780cc270 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f506800efc0 tx=0x7f506800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f5075ffb640 1 -- 172.21.15.50:0/1033479599 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068018020 con 0x7f50780cbe00 2024-09-11T22:22:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f5075ffb640 1 -- 172.21.15.50:0/1033479599 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5068014480 con 0x7f50780cbe00 2024-09-11T22:22:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f507f2d0640 1 -- 172.21.15.50:0/1033479599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5078159d10 con 0x7f50780cbe00 2024-09-11T22:22:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.777+0000 7f5075ffb640 1 -- 172.21.15.50:0/1033479599 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068014870 con 0x7f50780cbe00 2024-09-11T22:22:02.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.778+0000 7f507f2d0640 1 -- 172.21.15.50:0/1033479599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f507815a2d0 con 0x7f50780cbe00 2024-09-11T22:22:02.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.778+0000 7f507f2d0640 1 -- 172.21.15.50:0/1033479599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50780b4c70 con 0x7f50780cbe00 2024-09-11T22:22:02.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.779+0000 7f5075ffb640 1 -- 172.21.15.50:0/1033479599 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5068005d10 con 0x7f50780cbe00 2024-09-11T22:22:02.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.779+0000 7f5075ffb640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f506406be30 0x7f506406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:02.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.780+0000 7f5075ffb640 1 -- 172.21.15.50:0/1033479599 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f506808b8b0 con 0x7f50780cbe00 2024-09-11T22:22:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.780+0000 7f507d06c640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f506406be30 0x7f506406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.780+0000 7f507d06c640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f506406be30 0x7f506406e2f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5070034000 tx=0x7f507002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.784+0000 7f5075ffb640 1 -- 172.21.15.50:0/1033479599 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5068022070 con 0x7f50780cbe00 2024-09-11T22:22:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.994+0000 7f507f2d0640 1 -- 172.21.15.50:0/1033479599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50780cf2f0 con 0x7f50780cbe00 2024-09-11T22:22:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.995+0000 7f5075ffb640 1 -- 172.21.15.50:0/1033479599 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5230 (secure 0 0 0) 0x7f5068010040 con 0x7f50780cbe00 2024-09-11T22:22:02.996 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:02.996 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":120,"btime":"2024-09-11T22:21:56:521160+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/521086958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":521086958},{"type":"v1","addr":"172.21.15.77:6835","nonce":521086958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9891,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2783375669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2783375669},{"type":"v1","addr":"172.21.15.50:6833","nonce":2783375669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2009878103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2009878103},{"type":"v1","addr":"172.21.15.50:6835","nonce":2009878103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:21:53.868957+0000","modified":"2024-09-11T22:21:55.865022+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9915":{"gid":9915,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2937331670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2937331670},{"type":"v1","addr":"172.21.15.77:6837","nonce":2937331670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9915,"qdb_cluster":[9915]},"id":12}]} 2024-09-11T22:22:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 120 2024-09-11T22:22:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.997+0000 7f507f2d0640 1 -- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f506406be30 msgr2=0x7f506406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.997+0000 7f507f2d0640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f506406be30 0x7f506406e2f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5070034000 tx=0x7f507002e000 comp rx=0 tx=0).stop 2024-09-11T22:22:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.997+0000 7f507f2d0640 1 -- 172.21.15.50:0/1033479599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50780cbe00 msgr2=0x7f50780cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.997+0000 7f507f2d0640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50780cbe00 0x7f50780cc270 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f506800efc0 tx=0x7f506800c490 comp rx=0 tx=0).stop 2024-09-11T22:22:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.997+0000 7f507f2d0640 1 -- 172.21.15.50:0/1033479599 shutdown_connections 2024-09-11T22:22:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.997+0000 7f507f2d0640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f506406be30 0x7f506406e2f0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.997+0000 7f507f2d0640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f507815fb60 0x7f50781559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.997+0000 7f507f2d0640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50780cbe00 0x7f50780cc270 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.997+0000 7f507f2d0640 1 --2- 172.21.15.50:0/1033479599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50780d0fd0 0x7f50780b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.997+0000 7f507f2d0640 1 -- 172.21.15.50:0/1033479599 >> 172.21.15.50:0/1033479599 conn(0x7f50780b4150 msgr2=0x7f507806fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.997+0000 7f507f2d0640 1 -- 172.21.15.50:0/1033479599 shutdown_connections 2024-09-11T22:22:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:02.997+0000 7f507f2d0640 1 -- 172.21.15.50:0/1033479599 wait complete. 2024-09-11T22:22:03.413 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 120, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:21:53.868957+0000', 'modified': '2024-09-11T22:21:55.865022+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9915}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9915': {'gid': 9915, 'name': 'b', 'rank': 0, 'incarnation': 118, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6837/2937331670', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6836', 'nonce': 2937331670}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 2937331670}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9915, 'qdb_cluster': [9915]} 2024-09-11T22:22:03.413 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:22:03.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T22:22:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.519+0000 7f6784b11640 1 Processor -- start 2024-09-11T22:22:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.519+0000 7f6784b11640 1 -- start start 2024-09-11T22:22:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.520+0000 7f6784b11640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f678015e840 0x7f67800b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.520+0000 7f6784b11640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67800cdd50 0x7f67800cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.520+0000 7f6784b11640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f67800cf3b0 0x7f67800d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.520+0000 7f6784b11640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f678006c240 con 0x7f678015e840 2024-09-11T22:22:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.520+0000 7f6784b11640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f67800d0470 con 0x7f67800cf3b0 2024-09-11T22:22:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.520+0000 7f6784b11640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f67800ce5f0 con 0x7f67800cdd50 2024-09-11T22:22:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.520+0000 7f677e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f678015e840 0x7f67800b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.520+0000 7f677e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f678015e840 0x7f67800b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48494/0 (socket says 172.21.15.50:48494) 2024-09-11T22:22:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.520+0000 7f677e59c640 1 -- 172.21.15.50:0/2426099697 learned_addr learned my addr 172.21.15.50:0/2426099697 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.520+0000 7f677dd9b640 1 --2- 172.21.15.50:0/2426099697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67800cdd50 0x7f67800cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.520+0000 7f677ed9d640 1 --2- 172.21.15.50:0/2426099697 >> v2:172.21.15.77:3300/0 conn(0x7f67800cf3b0 0x7f67800d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.521+0000 7f677e59c640 1 -- 172.21.15.50:0/2426099697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67800cdd50 msgr2=0x7f67800cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.521+0000 7f677e59c640 1 --2- 172.21.15.50:0/2426099697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67800cdd50 0x7f67800cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.521+0000 7f677e59c640 1 -- 172.21.15.50:0/2426099697 >> v2:172.21.15.77:3300/0 conn(0x7f67800cf3b0 msgr2=0x7f67800d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.521+0000 7f677e59c640 1 --2- 172.21.15.50:0/2426099697 >> v2:172.21.15.77:3300/0 conn(0x7f67800cf3b0 0x7f67800d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.521+0000 7f677e59c640 1 -- 172.21.15.50:0/2426099697 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67800ce310 con 0x7f678015e840 2024-09-11T22:22:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.521+0000 7f677e59c640 1 --2- 172.21.15.50:0/2426099697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f678015e840 0x7f67800b4c70 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f6770009870 tx=0x7f677002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf1b42e1715b790 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.521+0000 7f677d59a640 1 -- 172.21.15.50:0/2426099697 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6770037070 con 0x7f678015e840 2024-09-11T22:22:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.522+0000 7f677d59a640 1 -- 172.21.15.50:0/2426099697 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6770032440 con 0x7f678015e840 2024-09-11T22:22:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.522+0000 7f677d59a640 1 -- 172.21.15.50:0/2426099697 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6770032810 con 0x7f678015e840 2024-09-11T22:22:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.522+0000 7f6784b11640 1 -- 172.21.15.50:0/2426099697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f678015e840 msgr2=0x7f67800b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.522+0000 7f6784b11640 1 --2- 172.21.15.50:0/2426099697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f678015e840 0x7f67800b4c70 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f6770009870 tx=0x7f677002a210 comp rx=0 tx=0).stop 2024-09-11T22:22:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.522+0000 7f6784b11640 1 -- 172.21.15.50:0/2426099697 shutdown_connections 2024-09-11T22:22:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.522+0000 7f6784b11640 1 --2- 172.21.15.50:0/2426099697 >> v2:172.21.15.77:3300/0 conn(0x7f67800cf3b0 0x7f67800d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.522+0000 7f6784b11640 1 --2- 172.21.15.50:0/2426099697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67800cdd50 0x7f67800cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.522+0000 7f6784b11640 1 --2- 172.21.15.50:0/2426099697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f678015e840 0x7f67800b4c70 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.522+0000 7f6784b11640 1 -- 172.21.15.50:0/2426099697 >> 172.21.15.50:0/2426099697 conn(0x7f67800b4150 msgr2=0x7f67800b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.522+0000 7f6784b11640 1 -- 172.21.15.50:0/2426099697 shutdown_connections 2024-09-11T22:22:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.522+0000 7f6784b11640 1 -- 172.21.15.50:0/2426099697 wait complete. 2024-09-11T22:22:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.523+0000 7f6784b11640 1 Processor -- start 2024-09-11T22:22:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.524+0000 7f6784b11640 1 -- start start 2024-09-11T22:22:03.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.524+0000 7f6784b11640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67800cdd50 0x7f6780155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.524+0000 7f6784b11640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67800cf3b0 0x7f67800b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.524+0000 7f6784b11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f678015e840 0x7f67800c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.524+0000 7f6784b11640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f678015ec20 con 0x7f67800cf3b0 2024-09-11T22:22:03.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.524+0000 7f6784b11640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f678006bed0 con 0x7f678015e840 2024-09-11T22:22:03.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.524+0000 7f6784b11640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f678015eda0 con 0x7f67800cdd50 2024-09-11T22:22:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.524+0000 7f677dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67800cf3b0 0x7f67800b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.524+0000 7f677dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67800cf3b0 0x7f67800b7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48510/0 (socket says 172.21.15.50:48510) 2024-09-11T22:22:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.524+0000 7f677dd9b640 1 -- 172.21.15.50:0/1541349619 learned_addr learned my addr 172.21.15.50:0/1541349619 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.524+0000 7f677e59c640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67800cdd50 0x7f6780155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.524+0000 7f677ed9d640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f678015e840 0x7f67800c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.525+0000 7f677dd9b640 1 -- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67800cdd50 msgr2=0x7f6780155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.525+0000 7f677dd9b640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67800cdd50 0x7f6780155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.525+0000 7f677dd9b640 1 -- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f678015e840 msgr2=0x7f67800c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.525+0000 7f677dd9b640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f678015e840 0x7f67800c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.525+0000 7f677dd9b640 1 -- 172.21.15.50:0/1541349619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67800c6a30 con 0x7f67800cf3b0 2024-09-11T22:22:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.525+0000 7f677dd9b640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67800cf3b0 0x7f67800b7e60 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f677400e890 tx=0x7f677400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.525+0000 7f676effd640 1 -- 172.21.15.50:0/1541349619 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774017070 con 0x7f67800cf3b0 2024-09-11T22:22:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.525+0000 7f676effd640 1 -- 172.21.15.50:0/1541349619 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677400c940 con 0x7f67800cf3b0 2024-09-11T22:22:03.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.525+0000 7f6784b11640 1 -- 172.21.15.50:0/1541349619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67800c6d10 con 0x7f67800cf3b0 2024-09-11T22:22:03.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.525+0000 7f676effd640 1 -- 172.21.15.50:0/1541349619 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677400cd10 con 0x7f67800cf3b0 2024-09-11T22:22:03.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.525+0000 7f6784b11640 1 -- 172.21.15.50:0/1541349619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67800c72d0 con 0x7f67800cf3b0 2024-09-11T22:22:03.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.527+0000 7f676effd640 1 -- 172.21.15.50:0/1541349619 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f677401a070 con 0x7f67800cf3b0 2024-09-11T22:22:03.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.527+0000 7f676effd640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f676006be30 0x7f676006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.527+0000 7f676effd640 1 -- 172.21.15.50:0/1541349619 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f677408b0e0 con 0x7f67800cf3b0 2024-09-11T22:22:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.527+0000 7f677e59c640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f676006be30 0x7f676006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.528+0000 7f677e59c640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f676006be30 0x7f676006e2f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6770034000 tx=0x7f677002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.528+0000 7f67878a7740 1 Processor -- start 2024-09-11T22:22:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.528+0000 7f67878a7740 1 -- start start 2024-09-11T22:22:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f67878a7740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2ba2c0 0x56340c2ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f67878a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2b7a80 0x56340c2ba6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f67878a7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2bba50 0x56340c2b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f67878a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56340c21c520 con 0x56340c2b7a80 2024-09-11T22:22:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f67878a7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56340c1c43e0 con 0x56340c2bba50 2024-09-11T22:22:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f67878a7740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56340c2184e0 con 0x56340c2ba2c0 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f677dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2b7a80 0x56340c2ba6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f677dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2b7a80 0x56340c2ba6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48514/0 (socket says 172.21.15.50:48514) 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f677dd9b640 1 -- 172.21.15.50:0/1807303028 learned_addr learned my addr 172.21.15.50:0/1807303028 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f677e59c640 1 --2- 172.21.15.50:0/1807303028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2ba2c0 0x56340c2ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f677ed9d640 1 --2- 172.21.15.50:0/1807303028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2bba50 0x56340c2b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f677dd9b640 1 -- 172.21.15.50:0/1807303028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2ba2c0 msgr2=0x56340c2ffa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f677dd9b640 1 --2- 172.21.15.50:0/1807303028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2ba2c0 0x56340c2ffa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f677dd9b640 1 -- 172.21.15.50:0/1807303028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2bba50 msgr2=0x56340c2b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f677dd9b640 1 --2- 172.21.15.50:0/1807303028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2bba50 0x56340c2b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.529+0000 7f677dd9b640 1 -- 172.21.15.50:0/1807303028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56340c1df2f0 con 0x56340c2b7a80 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.530+0000 7f677dd9b640 1 --2- 172.21.15.50:0/1807303028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2b7a80 0x56340c2ba6a0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f6774009720 tx=0x7f6774059440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cd20f9d92ddd85 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.530+0000 7f675ffff640 1 -- 172.21.15.50:0/1807303028 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774021030 con 0x56340c2b7a80 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.530+0000 7f675ffff640 1 -- 172.21.15.50:0/1807303028 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6774057740 con 0x56340c2b7a80 2024-09-11T22:22:03.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.530+0000 7f675ffff640 1 -- 172.21.15.50:0/1807303028 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774071170 con 0x56340c2b7a80 2024-09-11T22:22:03.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.530+0000 7f67878a7740 1 -- 172.21.15.50:0/1807303028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2b7a80 msgr2=0x56340c2ba6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.530+0000 7f67878a7740 1 --2- 172.21.15.50:0/1807303028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2b7a80 0x56340c2ba6a0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f6774009720 tx=0x7f6774059440 comp rx=0 tx=0).stop 2024-09-11T22:22:03.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.530+0000 7f67878a7740 1 -- 172.21.15.50:0/1807303028 shutdown_connections 2024-09-11T22:22:03.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.530+0000 7f67878a7740 1 --2- 172.21.15.50:0/1807303028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2bba50 0x56340c2b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.530+0000 7f67878a7740 1 --2- 172.21.15.50:0/1807303028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2b7a80 0x56340c2ba6a0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.530+0000 7f67878a7740 1 --2- 172.21.15.50:0/1807303028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2ba2c0 0x56340c2ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.530+0000 7f67878a7740 1 -- 172.21.15.50:0/1807303028 >> 172.21.15.50:0/1807303028 conn(0x56340c2b6a80 msgr2=0x56340c2fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:03.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.531+0000 7f67878a7740 1 -- 172.21.15.50:0/1807303028 shutdown_connections 2024-09-11T22:22:03.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.531+0000 7f67878a7740 1 -- 172.21.15.50:0/1807303028 wait complete. 2024-09-11T22:22:03.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.531+0000 7f67878a7740 1 -- start start 2024-09-11T22:22:03.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.531+0000 7f67878a7740 1 Processor -- start 2024-09-11T22:22:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.532+0000 7f67878a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2ba2c0 0x56340c2dcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.532+0000 7f67878a7740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2bba50 0x56340c2e5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.532+0000 7f67878a7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2fc6e0 0x56340c2e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.532+0000 7f67878a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56340c2b5f20 con 0x56340c2ba2c0 2024-09-11T22:22:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.532+0000 7f67878a7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56340c1a5450 con 0x56340c2fc6e0 2024-09-11T22:22:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.532+0000 7f67878a7740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56340c300290 con 0x56340c2bba50 2024-09-11T22:22:03.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.532+0000 7f67878a7740 10 client.0 _ll_register_callbacks cb 0x56340bf2eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.532+0000 7f677e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2ba2c0 0x56340c2dcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.532+0000 7f677e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2ba2c0 0x56340c2dcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48526/0 (socket says 172.21.15.50:48526) 2024-09-11T22:22:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.532+0000 7f677e59c640 1 -- 172.21.15.50:0/2667963311 learned_addr learned my addr 172.21.15.50:0/2667963311 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.532+0000 7f677ed9d640 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2fc6e0 0x56340c2e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.532+0000 7f677dd9b640 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2bba50 0x56340c2e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f677e59c640 1 -- 172.21.15.50:0/2667963311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2bba50 msgr2=0x56340c2e5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f677e59c640 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2bba50 0x56340c2e5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f677e59c640 1 -- 172.21.15.50:0/2667963311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2fc6e0 msgr2=0x56340c2e5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f677e59c640 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2fc6e0 0x56340c2e5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f677e59c640 1 -- 172.21.15.50:0/2667963311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56340bf2f2d0 con 0x56340c2ba2c0 2024-09-11T22:22:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f677dd9b640 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2bba50 0x56340c2e5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f677e59c640 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2ba2c0 0x56340c2dcdd0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f677003e040 tx=0x7f6770004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9420032f358814 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:03.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f675d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f675d7fa640 1 -- 172.21.15.50:0/2667963311 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677004e070 con 0x56340c2ba2c0 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f675d7fa640 1 -- 172.21.15.50:0/2667963311 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f677003c640 con 0x56340c2ba2c0 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f67878a7740 1 -- 172.21.15.50:0/2667963311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6774057740 con 0x56340c2ba2c0 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f675d7fa640 1 -- 172.21.15.50:0/2667963311 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f6770037040 con 0x56340c2ba2c0 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f67878a7740 10 client.10050 fetch_fsmap learned FSMap version 120 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f67878a7740 1 -- 172.21.15.50:0/2667963311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x56340bff96b0 con 0x56340c2ba2c0 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f675d7fa640 1 -- 172.21.15.50:0/2667963311 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6774057740 con 0x56340c2ba2c0 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f675d7fa640 1 -- 172.21.15.50:0/2667963311 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7f6770046040 con 0x56340c2ba2c0 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f67878a7740 10 client.10050 fetch_fsmap finished waiting for FSMap version 120 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f67878a7740 10 client.10050 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f67878a7740 20 client.10050 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f67878a7740 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x56340c3126c0 0x56340c312aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f67878a7740 4 client.10050 mds_command: new command op to 9915 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:22:03.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.533+0000 7f67878a7740 1 -- 172.21.15.50:0/2667963311 --> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56340c229c50 con 0x56340c3126c0 2024-09-11T22:22:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.534+0000 7f677dd9b640 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x56340c3126c0 0x56340c312aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.534+0000 7f675d7fa640 10 client.10050 ms_handle_connect on v2:172.21.15.77:6836/2937331670 2024-09-11T22:22:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.534+0000 7f677dd9b640 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x56340c3126c0 0x56340c312aa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96f575ddbe471290 server_cookie=abc420ca837bd76a in_seq=0 out_seq=0 2024-09-11T22:22:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f675d7fa640 1 -- 172.21.15.50:0/2667963311 <== mds.0 v2:172.21.15.77:6836/2937331670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56340c229c50 con 0x56340c3126c0 2024-09-11T22:22:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f675d7fa640 10 client.10050 handle_command_reply: tid=0 2024-09-11T22:22:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f67878a7740 1 client.10050 shutdown 2024-09-11T22:22:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f67878a7740 1 -- 172.21.15.50:0/2667963311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2ba2c0 msgr2=0x56340c2dcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f67878a7740 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2ba2c0 0x56340c2dcdd0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f677003e040 tx=0x7f6770004730 comp rx=0 tx=0).stop 2024-09-11T22:22:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f67878a7740 1 -- 172.21.15.50:0/2667963311 shutdown_connections 2024-09-11T22:22:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f67878a7740 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x56340c3126c0 0x56340c312aa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f67878a7740 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2bba50 0x56340c2e5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f67878a7740 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2fc6e0 0x56340c2e5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f67878a7740 1 --2- 172.21.15.50:0/2667963311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2ba2c0 0x56340c2dcdd0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f675d7fa640 0 client.10050 ms_handle_reset on v2:172.21.15.77:6836/2937331670 2024-09-11T22:22:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f67878a7740 1 -- 172.21.15.50:0/2667963311 >> 172.21.15.50:0/2667963311 conn(0x56340c2b7a80 msgr2=0x56340c2fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f67878a7740 1 -- 172.21.15.50:0/2667963311 shutdown_connections 2024-09-11T22:22:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f67878a7740 1 -- 172.21.15.50:0/2667963311 wait complete. 2024-09-11T22:22:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.535+0000 7f67878a7740 20 client.10050 trim_cache size 0 max 16384 2024-09-11T22:22:03.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.553+0000 7f67878a7740 1 Processor -- start 2024-09-11T22:22:03.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.554+0000 7f67878a7740 1 -- start start 2024-09-11T22:22:03.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.554+0000 7f67878a7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2ba2c0 0x56340c30e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.554+0000 7f67878a7740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2bba50 0x56340c2fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.554+0000 7f67878a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2fc6e0 0x56340c2fe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.554+0000 7f67878a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f67801ffd70 con 0x56340c2fc6e0 2024-09-11T22:22:03.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.554+0000 7f67878a7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f67800b6760 con 0x56340c2ba2c0 2024-09-11T22:22:03.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.554+0000 7f67878a7740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f67801ff720 con 0x56340c2bba50 2024-09-11T22:22:03.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.554+0000 7f677ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2fc6e0 0x56340c2fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.554+0000 7f677ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2fc6e0 0x56340c2fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48540/0 (socket says 172.21.15.50:48540) 2024-09-11T22:22:03.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.554+0000 7f677ed9d640 1 -- 172.21.15.50:0/312284440 learned_addr learned my addr 172.21.15.50:0/312284440 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:03.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.555+0000 7f677ed9d640 1 -- 172.21.15.50:0/312284440 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2bba50 msgr2=0x56340c2fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:03.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.555+0000 7f677ed9d640 1 --2- 172.21.15.50:0/312284440 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2bba50 0x56340c2fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.555+0000 7f677e59c640 1 --2- 172.21.15.50:0/312284440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2ba2c0 0x56340c30e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.555+0000 7f677ed9d640 1 -- 172.21.15.50:0/312284440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2ba2c0 msgr2=0x56340c30e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:03.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.555+0000 7f677ed9d640 1 --2- 172.21.15.50:0/312284440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2ba2c0 0x56340c30e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.555+0000 7f677ed9d640 1 -- 172.21.15.50:0/312284440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56340c2b5810 con 0x56340c2fc6e0 2024-09-11T22:22:03.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.555+0000 7f677ed9d640 1 --2- 172.21.15.50:0/312284440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2fc6e0 0x56340c2fe140 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f6778003cd0 tx=0x7f6778009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ec6b517b430968 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:03.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.555+0000 7f675f7fe640 1 -- 172.21.15.50:0/312284440 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6778020470 con 0x56340c2fc6e0 2024-09-11T22:22:03.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.555+0000 7f675f7fe640 1 -- 172.21.15.50:0/312284440 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677801b070 con 0x56340c2fc6e0 2024-09-11T22:22:03.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.555+0000 7f675f7fe640 1 -- 172.21.15.50:0/312284440 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6778020870 con 0x56340c2fc6e0 2024-09-11T22:22:03.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.556+0000 7f67878a7740 1 -- 172.21.15.50:0/312284440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2fc6e0 msgr2=0x56340c2fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.556+0000 7f67878a7740 1 --2- 172.21.15.50:0/312284440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2fc6e0 0x56340c2fe140 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f6778003cd0 tx=0x7f6778009750 comp rx=0 tx=0).stop 2024-09-11T22:22:03.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.556+0000 7f67878a7740 1 -- 172.21.15.50:0/312284440 shutdown_connections 2024-09-11T22:22:03.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.556+0000 7f67878a7740 1 --2- 172.21.15.50:0/312284440 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2bba50 0x56340c2fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.556+0000 7f67878a7740 1 --2- 172.21.15.50:0/312284440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2fc6e0 0x56340c2fe140 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.556+0000 7f67878a7740 1 --2- 172.21.15.50:0/312284440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2ba2c0 0x56340c30e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.556+0000 7f67878a7740 1 -- 172.21.15.50:0/312284440 >> 172.21.15.50:0/312284440 conn(0x56340c2b7a80 msgr2=0x56340c2fbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:03.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.556+0000 7f67878a7740 1 -- 172.21.15.50:0/312284440 shutdown_connections 2024-09-11T22:22:03.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.556+0000 7f67878a7740 1 -- 172.21.15.50:0/312284440 wait complete. 2024-09-11T22:22:03.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.556+0000 7f67878a7740 1 -- start start 2024-09-11T22:22:03.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.556+0000 7f67878a7740 1 Processor -- start 2024-09-11T22:22:03.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.557+0000 7f67878a7740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2ba2c0 0x56340c37f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.557+0000 7f67878a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2bba50 0x56340c310e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.557+0000 7f67878a7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2fc6e0 0x56340c311380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.557+0000 7f67878a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56340c310680 con 0x56340c2bba50 2024-09-11T22:22:03.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.557+0000 7f67878a7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56340c2b42b0 con 0x56340c2fc6e0 2024-09-11T22:22:03.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.557+0000 7f67878a7740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56340c2b4de0 con 0x56340c2ba2c0 2024-09-11T22:22:03.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.557+0000 7f67878a7740 10 client.0 _ll_register_callbacks cb 0x7f6774009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:03.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.557+0000 7f677dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2bba50 0x56340c310e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.557+0000 7f677dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2bba50 0x56340c310e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48556/0 (socket says 172.21.15.50:48556) 2024-09-11T22:22:03.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.557+0000 7f677dd9b640 1 -- 172.21.15.50:0/219575099 learned_addr learned my addr 172.21.15.50:0/219575099 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:03.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.557+0000 7f677e59c640 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2ba2c0 0x56340c37f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.557+0000 7f677ed9d640 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2fc6e0 0x56340c311380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f677dd9b640 1 -- 172.21.15.50:0/219575099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2ba2c0 msgr2=0x56340c37f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:03.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f677dd9b640 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2ba2c0 0x56340c37f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f677dd9b640 1 -- 172.21.15.50:0/219575099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2fc6e0 msgr2=0x56340c311380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:03.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f677dd9b640 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2fc6e0 0x56340c311380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f677dd9b640 1 -- 172.21.15.50:0/219575099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56340c2b6290 con 0x56340c2bba50 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f677ed9d640 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2fc6e0 0x56340c311380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f677dd9b640 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2bba50 0x56340c310e40 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f6774009720 tx=0x7f67740894e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47ce676b60c9bca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f675d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f675d7fa640 1 -- 172.21.15.50:0/219575099 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774089060 con 0x56340c2bba50 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f675d7fa640 1 -- 172.21.15.50:0/219575099 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f6774055ab0 con 0x56340c2bba50 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f67878a7740 1 -- 172.21.15.50:0/219575099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f677801b070 con 0x56340c2bba50 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f675d7fa640 1 -- 172.21.15.50:0/219575099 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f6774077050 con 0x56340c2bba50 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f67878a7740 10 client.10056 fetch_fsmap learned FSMap version 120 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f67878a7740 1 -- 172.21.15.50:0/219575099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x56340c319500 con 0x56340c2bba50 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f675d7fa640 1 -- 172.21.15.50:0/219575099 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677801b070 con 0x56340c2bba50 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f675d7fa640 1 -- 172.21.15.50:0/219575099 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7f6774078240 con 0x56340c2bba50 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f67878a7740 10 client.10056 fetch_fsmap finished waiting for FSMap version 120 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f67878a7740 10 client.10056 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:22:03.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f67878a7740 20 client.10056 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f67878a7740 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x56340c363920 0x56340c363d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f67878a7740 4 client.10056 mds_command: new command op to 9915 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:22:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.558+0000 7f67878a7740 1 -- 172.21.15.50:0/219575099 --> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] -- command(tid 0: {"prefix": "status"}) -- 0x56340c223fa0 con 0x56340c363920 2024-09-11T22:22:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f677e59c640 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x56340c363920 0x56340c363d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f677e59c640 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x56340c363920 0x56340c363d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0f2a0602e362e08 server_cookie=44b19ffdc03844d6 in_seq=0 out_seq=0 2024-09-11T22:22:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f675d7fa640 10 client.10056 ms_handle_connect on v2:172.21.15.77:6836/2937331670 2024-09-11T22:22:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f675d7fa640 1 -- 172.21.15.50:0/219575099 <== mds.0 v2:172.21.15.77:6836/2937331670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x56340c223fa0 con 0x56340c363920 2024-09-11T22:22:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f675d7fa640 10 client.10056 handle_command_reply: tid=0 2024-09-11T22:22:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f67878a7740 1 client.10056 shutdown 2024-09-11T22:22:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f67878a7740 1 -- 172.21.15.50:0/219575099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2bba50 msgr2=0x56340c310e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f67878a7740 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2bba50 0x56340c310e40 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f6774009720 tx=0x7f67740894e0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f67878a7740 1 -- 172.21.15.50:0/219575099 shutdown_connections 2024-09-11T22:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f67878a7740 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56340c2fc6e0 0x56340c311380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f67878a7740 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56340c2bba50 0x56340c310e40 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f67878a7740 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x56340c363920 0x56340c363d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f67878a7740 1 --2- 172.21.15.50:0/219575099 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56340c2ba2c0 0x56340c37f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f67878a7740 1 -- 172.21.15.50:0/219575099 >> 172.21.15.50:0/219575099 conn(0x56340c2b7a80 msgr2=0x56340c2de250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f675d7fa640 0 client.10056 ms_handle_reset on v2:172.21.15.77:6836/2937331670 2024-09-11T22:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.559+0000 7f67878a7740 1 -- 172.21.15.50:0/219575099 shutdown_connections 2024-09-11T22:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f67878a7740 1 -- 172.21.15.50:0/219575099 wait complete. 2024-09-11T22:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f67878a7740 20 client.10056 trim_cache size 0 max 16384 2024-09-11T22:22:03.566 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:22:03.567 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:22:03.567 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:22:03.567 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 9915, 2024-09-11T22:22:03.567 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:22:03.567 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:22:03.567 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:22:03.567 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 9.0593182129999992, 2024-09-11T22:22:03.567 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 120, 2024-09-11T22:22:03.567 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 167, 2024-09-11T22:22:03.567 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 167, 2024-09-11T22:22:03.567 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 14.071788442000001 2024-09-11T22:22:03.567 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f6784b11640 1 -- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f676006be30 msgr2=0x7f676006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f6784b11640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f676006be30 0x7f676006e2f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6770034000 tx=0x7f677002e000 comp rx=0 tx=0).stop 2024-09-11T22:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f6784b11640 1 -- 172.21.15.50:0/1541349619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67800cf3b0 msgr2=0x7f67800b7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f6784b11640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67800cf3b0 0x7f67800b7e60 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f677400e890 tx=0x7f677400ed50 comp rx=0 tx=0).stop 2024-09-11T22:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f6784b11640 1 -- 172.21.15.50:0/1541349619 shutdown_connections 2024-09-11T22:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f6784b11640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f676006be30 0x7f676006e2f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f6784b11640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f678015e840 0x7f67800c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f6784b11640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67800cf3b0 0x7f67800b7e60 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f6784b11640 1 --2- 172.21.15.50:0/1541349619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67800cdd50 0x7f6780155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f6784b11640 1 -- 172.21.15.50:0/1541349619 >> 172.21.15.50:0/1541349619 conn(0x7f67800b4150 msgr2=0x7f67800afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f6784b11640 1 -- 172.21.15.50:0/1541349619 shutdown_connections 2024-09-11T22:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.560+0000 7f6784b11640 1 -- 172.21.15.50:0/1541349619 wait complete. 2024-09-11T22:22:03.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:22:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.674+0000 7fc21fc5c640 1 Processor -- start 2024-09-11T22:22:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.674+0000 7fc21fc5c640 1 -- start start 2024-09-11T22:22:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.675+0000 7fc21fc5c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc21815e8e0 0x7fc2180b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.675+0000 7fc21fc5c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc218162350 0x7fc2181627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.675+0000 7fc21fc5c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc218163080 con 0x7fc2180d1580 2024-09-11T22:22:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.675+0000 7fc21fc5c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc21815ecc0 con 0x7fc21815e8e0 2024-09-11T22:22:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.675+0000 7fc21fc5c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc2180d2ad0 con 0x7fc218162350 2024-09-11T22:22:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.675+0000 7fc21d9f8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc21815e8e0 0x7fc2180b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.675+0000 7fc21d9f8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc21815e8e0 0x7fc2180b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48572/0 (socket says 172.21.15.50:48572) 2024-09-11T22:22:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.675+0000 7fc21d9f8640 1 -- 172.21.15.50:0/3397786674 learned_addr learned my addr 172.21.15.50:0/3397786674 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.676+0000 7fc21e1f9640 1 --2- 172.21.15.50:0/3397786674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc218162350 0x7fc2181627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.676+0000 7fc21d9f8640 1 -- 172.21.15.50:0/3397786674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc218162350 msgr2=0x7fc2181627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.676+0000 7fc21d9f8640 1 --2- 172.21.15.50:0/3397786674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc218162350 0x7fc2181627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.676+0000 7fc21d9f8640 1 -- 172.21.15.50:0/3397786674 >> v1:172.21.15.77:6789/0 conn(0x7fc2180d1580 legacy=0x7fc2180d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.676+0000 7fc21d9f8640 1 -- 172.21.15.50:0/3397786674 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2180d2d20 con 0x7fc21815e8e0 2024-09-11T22:22:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.676+0000 7fc21e1f9640 1 --2- 172.21.15.50:0/3397786674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc218162350 0x7fc2181627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.676+0000 7fc21d9f8640 1 --2- 172.21.15.50:0/3397786674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21815e8e0 0x7fc2180b7880 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fc214009870 tx=0x7fc21402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70b872dcf856cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.677+0000 7fc21c9f6640 1 -- 172.21.15.50:0/3397786674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214037070 con 0x7fc21815e8e0 2024-09-11T22:22:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.677+0000 7fc21c9f6640 1 -- 172.21.15.50:0/3397786674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21402ae50 con 0x7fc21815e8e0 2024-09-11T22:22:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.677+0000 7fc21c9f6640 1 -- 172.21.15.50:0/3397786674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214032860 con 0x7fc21815e8e0 2024-09-11T22:22:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.677+0000 7fc21fc5c640 1 -- 172.21.15.50:0/3397786674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21815e8e0 msgr2=0x7fc2180b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.677+0000 7fc21fc5c640 1 --2- 172.21.15.50:0/3397786674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21815e8e0 0x7fc2180b7880 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fc214009870 tx=0x7fc21402a300 comp rx=0 tx=0).stop 2024-09-11T22:22:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.677+0000 7fc21fc5c640 1 -- 172.21.15.50:0/3397786674 shutdown_connections 2024-09-11T22:22:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.677+0000 7fc21fc5c640 1 --2- 172.21.15.50:0/3397786674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc218162350 0x7fc2181627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.677+0000 7fc21fc5c640 1 --2- 172.21.15.50:0/3397786674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21815e8e0 0x7fc2180b7880 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.677+0000 7fc21fc5c640 1 -- 172.21.15.50:0/3397786674 >> 172.21.15.50:0/3397786674 conn(0x7fc218067ba0 msgr2=0x7fc218067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.677+0000 7fc21fc5c640 1 -- 172.21.15.50:0/3397786674 shutdown_connections 2024-09-11T22:22:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.677+0000 7fc21fc5c640 1 -- 172.21.15.50:0/3397786674 wait complete. 2024-09-11T22:22:03.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.678+0000 7fc21fc5c640 1 Processor -- start 2024-09-11T22:22:03.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.679+0000 7fc21fc5c640 1 -- start start 2024-09-11T22:22:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.679+0000 7fc21fc5c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2180d1580 0x7fc2181f5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.679+0000 7fc21fc5c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc21815e8e0 0x7fc2180b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.679+0000 7fc21fc5c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc218162350 0x7fc21815f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.679+0000 7fc21fc5c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc218162d20 con 0x7fc218162350 2024-09-11T22:22:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.679+0000 7fc21fc5c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc2180d3370 con 0x7fc2180d1580 2024-09-11T22:22:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.679+0000 7fc21fc5c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc2180d3800 con 0x7fc21815e8e0 2024-09-11T22:22:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.679+0000 7fc21e1f9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc218162350 0x7fc21815f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.679+0000 7fc21e1f9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc218162350 0x7fc21815f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48578/0 (socket says 172.21.15.50:48578) 2024-09-11T22:22:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.679+0000 7fc21e1f9640 1 -- 172.21.15.50:0/754531362 learned_addr learned my addr 172.21.15.50:0/754531362 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.679+0000 7fc21d9f8640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2180d1580 0x7fc2181f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.679+0000 7fc21d1f7640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc21815e8e0 0x7fc2180b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.680+0000 7fc21e1f9640 1 -- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc21815e8e0 msgr2=0x7fc2180b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.680+0000 7fc21e1f9640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc21815e8e0 0x7fc2180b5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.680+0000 7fc21e1f9640 1 -- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2180d1580 msgr2=0x7fc2181f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.680+0000 7fc21e1f9640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2180d1580 0x7fc2181f5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.680+0000 7fc21e1f9640 1 -- 172.21.15.50:0/754531362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2181f5ac0 con 0x7fc218162350 2024-09-11T22:22:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.680+0000 7fc21e1f9640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc218162350 0x7fc21815f4a0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fc210007e20 tx=0x7fc21000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.680+0000 7fc20e7fc640 1 -- 172.21.15.50:0/754531362 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21001a070 con 0x7fc218162350 2024-09-11T22:22:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.680+0000 7fc20e7fc640 1 -- 172.21.15.50:0/754531362 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc210003b90 con 0x7fc218162350 2024-09-11T22:22:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.680+0000 7fc21fc5c640 1 -- 172.21.15.50:0/754531362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc218158c50 con 0x7fc218162350 2024-09-11T22:22:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.680+0000 7fc20e7fc640 1 -- 172.21.15.50:0/754531362 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21000de80 con 0x7fc218162350 2024-09-11T22:22:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.680+0000 7fc21fc5c640 1 -- 172.21.15.50:0/754531362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2181591d0 con 0x7fc218162350 2024-09-11T22:22:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.681+0000 7fc21fc5c640 1 -- 172.21.15.50:0/754531362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2180b7880 con 0x7fc218162350 2024-09-11T22:22:03.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.681+0000 7fc20e7fc640 1 -- 172.21.15.50:0/754531362 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc21001d070 con 0x7fc218162350 2024-09-11T22:22:03.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.682+0000 7fc20e7fc640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc1fc06be30 0x7fc1fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:03.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.682+0000 7fc20e7fc640 1 -- 172.21.15.50:0/754531362 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7fc21008b020 con 0x7fc218162350 2024-09-11T22:22:03.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.682+0000 7fc21d9f8640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc1fc06be30 0x7fc1fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:03.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.683+0000 7fc21d9f8640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc1fc06be30 0x7fc1fc06e2f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc214034000 tx=0x7fc21402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:03.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.686+0000 7fc20e7fc640 1 -- 172.21.15.50:0/754531362 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2181f5ac0 con 0x7fc218162350 2024-09-11T22:22:03.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.897+0000 7fc21fc5c640 1 -- 172.21.15.50:0/754531362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc21815f130 con 0x7fc218162350 2024-09-11T22:22:03.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.897+0000 7fc20e7fc640 1 -- 172.21.15.50:0/754531362 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v120) ==== 53+0+73 (secure 0 0 0) 0x7fc210010070 con 0x7fc218162350 2024-09-11T22:22:03.898 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:22:03.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.899+0000 7fc21fc5c640 1 -- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc1fc06be30 msgr2=0x7fc1fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.899+0000 7fc21fc5c640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc1fc06be30 0x7fc1fc06e2f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc214034000 tx=0x7fc21402e000 comp rx=0 tx=0).stop 2024-09-11T22:22:03.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.899+0000 7fc21fc5c640 1 -- 172.21.15.50:0/754531362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc218162350 msgr2=0x7fc21815f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:03.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.899+0000 7fc21fc5c640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc218162350 0x7fc21815f4a0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fc210007e20 tx=0x7fc21000d4a0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.899+0000 7fc21fc5c640 1 -- 172.21.15.50:0/754531362 shutdown_connections 2024-09-11T22:22:03.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.899+0000 7fc21fc5c640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc1fc06be30 0x7fc1fc06e2f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.899+0000 7fc21fc5c640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc21815e8e0 0x7fc2180b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.899+0000 7fc21fc5c640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc218162350 0x7fc21815f4a0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.899+0000 7fc21fc5c640 1 --2- 172.21.15.50:0/754531362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2180d1580 0x7fc2181f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:03.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.899+0000 7fc21fc5c640 1 -- 172.21.15.50:0/754531362 >> 172.21.15.50:0/754531362 conn(0x7fc218067ba0 msgr2=0x7fc218067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:03.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.899+0000 7fc21fc5c640 1 -- 172.21.15.50:0/754531362 shutdown_connections 2024-09-11T22:22:03.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:03.899+0000 7fc21fc5c640 1 -- 172.21.15.50:0/754531362 wait complete. 2024-09-11T22:22:03.911 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:22:03.911 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:22:03.911 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:22:03.911 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:22:03.911 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:22:03.911 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:22:03.911 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:22:03.911 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:22:03.911 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:22:03.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:03.912 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:22:03.928 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:22:03.928 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:22:03.928 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:22:03.928 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:03.928 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:22:03.928 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:03.928 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:22:03.928 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42071sec preferred_lft 42071sec 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:22:03.929 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:22:03.930 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:22:03.930 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:22:03.930 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:22:03.930 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:03.930 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:22:03.930 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:03.930 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:22:03.930 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:22:03.930 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:22:03.930 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:03.930 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:22:03.930 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:22:03.930 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:22:03.931 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:03.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:03.931 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:22:03.992 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:22:03.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:03.995 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:22:04.051 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:22:04.051 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:22:04.051 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:22:04.051 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:22:04.051 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:22:04.051 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:22:04.051 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:04.051 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:22:04.052 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:22:04.052 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:22:04.052 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:04.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:22:04.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:04.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:04.181 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:22:04.197 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:22:04.197 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:22:04.197 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:22:04.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:04.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:22:04.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:22:04.263 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:22:04.319 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:22:04.319 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:22:04.319 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:22:04.374 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:22:04.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:04.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:22:04.459 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:22:04.459 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:22:04.467 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:22:04.467 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:22:04.467 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:22:04.467 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:22:04.467 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:22:04.467 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:22:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:22:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:22:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:22:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:22:04.469 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:22:04.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:04.470 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:22:04.496 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:22:04.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:04.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:04.601 INFO:teuthology.orchestra.run.smithi050.stdout:client7988 2024-09-11T22:22:04.601 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:22:04.601 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:22:04.618 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:04.618 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:04.618 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.0 2024-09-11T22:22:04.618 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:04.618 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:04.618 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:04.618 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:04.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:04.731 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.731 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.731 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848796 s, 124 MB/s 2024-09-11T22:22:04.741 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.741 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.741 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776552 s, 135 MB/s 2024-09-11T22:22:04.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.751 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837677 s, 125 MB/s 2024-09-11T22:22:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666091 s, 157 MB/s 2024-09-11T22:22:04.770 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.770 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.771 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00822886 s, 127 MB/s 2024-09-11T22:22:04.780 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.780 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.780 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778815 s, 135 MB/s 2024-09-11T22:22:04.791 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.791 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.791 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838802 s, 125 MB/s 2024-09-11T22:22:04.801 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.801 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.801 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078103 s, 134 MB/s 2024-09-11T22:22:04.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.812 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00892669 s, 117 MB/s 2024-09-11T22:22:04.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.822 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.822 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075296 s, 139 MB/s 2024-09-11T22:22:04.830 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.830 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.831 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676939 s, 155 MB/s 2024-09-11T22:22:04.841 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.841 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.841 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776492 s, 135 MB/s 2024-09-11T22:22:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694634 s, 151 MB/s 2024-09-11T22:22:04.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.860 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727667 s, 144 MB/s 2024-09-11T22:22:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700055 s, 150 MB/s 2024-09-11T22:22:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739302 s, 142 MB/s 2024-09-11T22:22:04.889 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.889 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.889 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00816005 s, 129 MB/s 2024-09-11T22:22:04.899 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.899 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.899 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810463 s, 129 MB/s 2024-09-11T22:22:04.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.908 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730253 s, 144 MB/s 2024-09-11T22:22:04.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.918 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767984 s, 137 MB/s 2024-09-11T22:22:04.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.928 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698649 s, 150 MB/s 2024-09-11T22:22:04.939 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.939 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.939 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920266 s, 114 MB/s 2024-09-11T22:22:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.948 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727712 s, 144 MB/s 2024-09-11T22:22:04.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.957 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070382 s, 149 MB/s 2024-09-11T22:22:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656641 s, 160 MB/s 2024-09-11T22:22:04.975 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.975 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.975 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758222 s, 138 MB/s 2024-09-11T22:22:04.985 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.985 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.985 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765479 s, 137 MB/s 2024-09-11T22:22:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664977 s, 158 MB/s 2024-09-11T22:22:05.003 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.003 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.003 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800162 s, 131 MB/s 2024-09-11T22:22:05.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.012 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696744 s, 150 MB/s 2024-09-11T22:22:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685871 s, 153 MB/s 2024-09-11T22:22:05.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.030 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712805 s, 147 MB/s 2024-09-11T22:22:05.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:05.037 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:05.037 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:05.037 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.1 2024-09-11T22:22:05.037 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:05.037 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:05.037 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:05.037 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.099 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753225 s, 139 MB/s 2024-09-11T22:22:05.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.108 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775044 s, 135 MB/s 2024-09-11T22:22:05.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.117 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724028 s, 145 MB/s 2024-09-11T22:22:05.126 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.126 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.127 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743664 s, 141 MB/s 2024-09-11T22:22:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731139 s, 143 MB/s 2024-09-11T22:22:05.144 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.144 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.144 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686384 s, 153 MB/s 2024-09-11T22:22:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.153 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711362 s, 147 MB/s 2024-09-11T22:22:05.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.162 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658897 s, 159 MB/s 2024-09-11T22:22:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.171 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735266 s, 143 MB/s 2024-09-11T22:22:05.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.180 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720336 s, 146 MB/s 2024-09-11T22:22:05.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.188 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673067 s, 156 MB/s 2024-09-11T22:22:05.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.197 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728943 s, 144 MB/s 2024-09-11T22:22:05.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749645 s, 140 MB/s 2024-09-11T22:22:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719229 s, 146 MB/s 2024-09-11T22:22:05.224 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.224 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.225 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743091 s, 141 MB/s 2024-09-11T22:22:05.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.235 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.235 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784803 s, 134 MB/s 2024-09-11T22:22:05.243 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746127 s, 141 MB/s 2024-09-11T22:22:05.253 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.253 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.253 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747008 s, 140 MB/s 2024-09-11T22:22:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.263 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796353 s, 132 MB/s 2024-09-11T22:22:05.272 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.272 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.272 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752215 s, 139 MB/s 2024-09-11T22:22:05.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.281 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.281 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697871 s, 150 MB/s 2024-09-11T22:22:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.290 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737467 s, 142 MB/s 2024-09-11T22:22:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.299 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724575 s, 145 MB/s 2024-09-11T22:22:05.308 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.308 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.308 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073837 s, 142 MB/s 2024-09-11T22:22:05.317 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.317 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.317 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749172 s, 140 MB/s 2024-09-11T22:22:05.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.326 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.326 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711127 s, 147 MB/s 2024-09-11T22:22:05.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.335 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702026 s, 149 MB/s 2024-09-11T22:22:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.345 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750642 s, 140 MB/s 2024-09-11T22:22:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682092 s, 154 MB/s 2024-09-11T22:22:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724363 s, 145 MB/s 2024-09-11T22:22:05.370 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.371 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663851 s, 158 MB/s 2024-09-11T22:22:05.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.380 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745757 s, 141 MB/s 2024-09-11T22:22:05.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:05.387 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:05.387 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:05.387 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.2 2024-09-11T22:22:05.387 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:05.387 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:05.387 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:05.387 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:05.447 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.447 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.447 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067282 s, 156 MB/s 2024-09-11T22:22:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741067 s, 141 MB/s 2024-09-11T22:22:05.465 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.465 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.465 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693277 s, 151 MB/s 2024-09-11T22:22:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066331 s, 158 MB/s 2024-09-11T22:22:05.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.484 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.484 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749988 s, 140 MB/s 2024-09-11T22:22:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.492 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664053 s, 158 MB/s 2024-09-11T22:22:05.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.501 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.501 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749078 s, 140 MB/s 2024-09-11T22:22:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.511 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710628 s, 148 MB/s 2024-09-11T22:22:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745126 s, 141 MB/s 2024-09-11T22:22:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731788 s, 143 MB/s 2024-09-11T22:22:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658264 s, 159 MB/s 2024-09-11T22:22:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886691 s, 118 MB/s 2024-09-11T22:22:05.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.557 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.557 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753618 s, 139 MB/s 2024-09-11T22:22:05.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680032 s, 154 MB/s 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672316 s, 156 MB/s 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658781 s, 159 MB/s 2024-09-11T22:22:05.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.591 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677853 s, 155 MB/s 2024-09-11T22:22:05.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.600 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725365 s, 145 MB/s 2024-09-11T22:22:05.610 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.610 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.610 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835562 s, 125 MB/s 2024-09-11T22:22:05.619 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.619 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.619 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071625 s, 146 MB/s 2024-09-11T22:22:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676359 s, 155 MB/s 2024-09-11T22:22:05.636 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.636 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.636 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068378 s, 153 MB/s 2024-09-11T22:22:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869213 s, 121 MB/s 2024-09-11T22:22:05.656 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.656 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.656 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730324 s, 144 MB/s 2024-09-11T22:22:05.665 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.665 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.665 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720015 s, 146 MB/s 2024-09-11T22:22:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690645 s, 152 MB/s 2024-09-11T22:22:05.683 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.683 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.683 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073787 s, 142 MB/s 2024-09-11T22:22:05.692 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.692 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.692 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684796 s, 153 MB/s 2024-09-11T22:22:05.701 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.701 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.701 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740204 s, 142 MB/s 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694613 s, 151 MB/s 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682375 s, 154 MB/s 2024-09-11T22:22:05.727 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.728 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.728 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744057 s, 141 MB/s 2024-09-11T22:22:05.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:05.735 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:05.735 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:05.735 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.3 2024-09-11T22:22:05.735 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:05.735 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:05.735 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:05.735 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:05.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:05.796 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.797 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.797 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767205 s, 137 MB/s 2024-09-11T22:22:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779721 s, 134 MB/s 2024-09-11T22:22:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747625 s, 140 MB/s 2024-09-11T22:22:05.824 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731138 s, 143 MB/s 2024-09-11T22:22:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747559 s, 140 MB/s 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731735 s, 143 MB/s 2024-09-11T22:22:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640445 s, 164 MB/s 2024-09-11T22:22:05.861 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.861 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.861 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00829693 s, 126 MB/s 2024-09-11T22:22:05.869 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.869 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.869 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006556 s, 160 MB/s 2024-09-11T22:22:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724438 s, 145 MB/s 2024-09-11T22:22:05.886 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.887 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.887 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655823 s, 160 MB/s 2024-09-11T22:22:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670197 s, 156 MB/s 2024-09-11T22:22:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732884 s, 143 MB/s 2024-09-11T22:22:05.913 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.913 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.913 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076314 s, 137 MB/s 2024-09-11T22:22:05.922 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.922 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.922 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067061 s, 156 MB/s 2024-09-11T22:22:05.931 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.931 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.931 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720238 s, 146 MB/s 2024-09-11T22:22:05.940 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.940 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.940 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740973 s, 142 MB/s 2024-09-11T22:22:05.949 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.952 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.953 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769707 s, 136 MB/s 2024-09-11T22:22:05.959 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.959 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.959 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746526 s, 140 MB/s 2024-09-11T22:22:05.968 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.968 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.968 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731486 s, 143 MB/s 2024-09-11T22:22:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731156 s, 143 MB/s 2024-09-11T22:22:05.986 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.986 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.986 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710149 s, 148 MB/s 2024-09-11T22:22:05.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:05.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:05.995 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726655 s, 144 MB/s 2024-09-11T22:22:06.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.005 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.005 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836429 s, 125 MB/s 2024-09-11T22:22:06.015 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.015 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.015 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735932 s, 142 MB/s 2024-09-11T22:22:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.023 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686999 s, 153 MB/s 2024-09-11T22:22:06.033 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.033 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.033 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777048 s, 135 MB/s 2024-09-11T22:22:06.041 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.041 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068895 s, 152 MB/s 2024-09-11T22:22:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655996 s, 160 MB/s 2024-09-11T22:22:06.059 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.059 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.059 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688355 s, 152 MB/s 2024-09-11T22:22:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623777 s, 168 MB/s 2024-09-11T22:22:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661142 s, 159 MB/s 2024-09-11T22:22:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:06.082 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:06.082 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:06.082 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.4 2024-09-11T22:22:06.082 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:06.082 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:06.083 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:06.083 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:06.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737862 s, 142 MB/s 2024-09-11T22:22:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.153 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072717 s, 144 MB/s 2024-09-11T22:22:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663784 s, 158 MB/s 2024-09-11T22:22:06.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.170 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073225 s, 143 MB/s 2024-09-11T22:22:06.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.179 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.179 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676385 s, 155 MB/s 2024-09-11T22:22:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.188 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.188 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681701 s, 154 MB/s 2024-09-11T22:22:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675564 s, 155 MB/s 2024-09-11T22:22:06.204 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.204 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.204 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685212 s, 153 MB/s 2024-09-11T22:22:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.214 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.214 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756188 s, 139 MB/s 2024-09-11T22:22:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713202 s, 147 MB/s 2024-09-11T22:22:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766641 s, 137 MB/s 2024-09-11T22:22:06.240 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.240 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.240 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662004 s, 158 MB/s 2024-09-11T22:22:06.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.249 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706808 s, 148 MB/s 2024-09-11T22:22:06.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642677 s, 163 MB/s 2024-09-11T22:22:06.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.266 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721633 s, 145 MB/s 2024-09-11T22:22:06.275 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.275 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.275 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726386 s, 144 MB/s 2024-09-11T22:22:06.284 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.284 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.284 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711773 s, 147 MB/s 2024-09-11T22:22:06.293 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.293 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.294 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730475 s, 144 MB/s 2024-09-11T22:22:06.302 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.302 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.302 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667425 s, 157 MB/s 2024-09-11T22:22:06.311 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.312 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.312 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00820252 s, 128 MB/s 2024-09-11T22:22:06.320 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.320 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.320 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633529 s, 166 MB/s 2024-09-11T22:22:06.328 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.328 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.328 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678789 s, 154 MB/s 2024-09-11T22:22:06.337 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.338 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.338 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739211 s, 142 MB/s 2024-09-11T22:22:06.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.347 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748521 s, 140 MB/s 2024-09-11T22:22:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672836 s, 156 MB/s 2024-09-11T22:22:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640043 s, 164 MB/s 2024-09-11T22:22:06.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.372 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683842 s, 153 MB/s 2024-09-11T22:22:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715512 s, 147 MB/s 2024-09-11T22:22:06.390 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.390 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.390 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754103 s, 139 MB/s 2024-09-11T22:22:06.399 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.399 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.399 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752509 s, 139 MB/s 2024-09-11T22:22:06.409 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.409 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.409 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746195 s, 141 MB/s 2024-09-11T22:22:06.417 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.417 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.417 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065566 s, 160 MB/s 2024-09-11T22:22:06.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:06.424 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:06.424 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:06.424 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.5 2024-09-11T22:22:06.424 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:06.424 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:06.424 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:06.425 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:06.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.485 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067847 s, 155 MB/s 2024-09-11T22:22:06.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.493 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668617 s, 157 MB/s 2024-09-11T22:22:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724905 s, 145 MB/s 2024-09-11T22:22:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.512 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827819 s, 127 MB/s 2024-09-11T22:22:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.520 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066334 s, 158 MB/s 2024-09-11T22:22:06.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.529 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742043 s, 141 MB/s 2024-09-11T22:22:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724321 s, 145 MB/s 2024-09-11T22:22:06.547 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.547 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.547 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713634 s, 147 MB/s 2024-09-11T22:22:06.556 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.556 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.556 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663401 s, 158 MB/s 2024-09-11T22:22:06.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.565 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732853 s, 143 MB/s 2024-09-11T22:22:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00823663 s, 127 MB/s 2024-09-11T22:22:06.584 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.584 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.585 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741998 s, 141 MB/s 2024-09-11T22:22:06.593 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.594 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.594 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731988 s, 143 MB/s 2024-09-11T22:22:06.601 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.602 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.602 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640403 s, 164 MB/s 2024-09-11T22:22:06.610 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.610 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.610 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704135 s, 149 MB/s 2024-09-11T22:22:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.619 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726806 s, 144 MB/s 2024-09-11T22:22:06.629 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.629 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.629 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752876 s, 139 MB/s 2024-09-11T22:22:06.637 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.637 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.637 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064891 s, 162 MB/s 2024-09-11T22:22:06.646 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.646 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.647 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752305 s, 139 MB/s 2024-09-11T22:22:06.655 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.655 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.655 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715701 s, 147 MB/s 2024-09-11T22:22:06.664 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.665 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.665 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725449 s, 145 MB/s 2024-09-11T22:22:06.674 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.674 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.674 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738285 s, 142 MB/s 2024-09-11T22:22:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069682 s, 150 MB/s 2024-09-11T22:22:06.691 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.691 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.691 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651184 s, 161 MB/s 2024-09-11T22:22:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738125 s, 142 MB/s 2024-09-11T22:22:06.709 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.709 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.709 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691211 s, 152 MB/s 2024-09-11T22:22:06.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.718 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711777 s, 147 MB/s 2024-09-11T22:22:06.727 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.727 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.728 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787889 s, 133 MB/s 2024-09-11T22:22:06.736 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.736 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.736 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662381 s, 158 MB/s 2024-09-11T22:22:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.745 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726236 s, 144 MB/s 2024-09-11T22:22:06.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.753 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665799 s, 157 MB/s 2024-09-11T22:22:06.761 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.761 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.761 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648584 s, 162 MB/s 2024-09-11T22:22:06.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:06.768 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:06.768 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:06.768 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.6 2024-09-11T22:22:06.769 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:06.769 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:06.769 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:06.769 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:06.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:06.830 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785829 s, 133 MB/s 2024-09-11T22:22:06.839 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.839 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.839 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737353 s, 142 MB/s 2024-09-11T22:22:06.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.848 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694378 s, 151 MB/s 2024-09-11T22:22:06.856 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.857 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.857 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672197 s, 156 MB/s 2024-09-11T22:22:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757345 s, 138 MB/s 2024-09-11T22:22:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665534 s, 158 MB/s 2024-09-11T22:22:06.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.884 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788735 s, 133 MB/s 2024-09-11T22:22:06.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.893 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723386 s, 145 MB/s 2024-09-11T22:22:06.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.902 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681717 s, 154 MB/s 2024-09-11T22:22:06.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.911 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777477 s, 135 MB/s 2024-09-11T22:22:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653716 s, 160 MB/s 2024-09-11T22:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694538 s, 151 MB/s 2024-09-11T22:22:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688741 s, 152 MB/s 2024-09-11T22:22:06.946 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.946 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.946 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077329 s, 136 MB/s 2024-09-11T22:22:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667826 s, 157 MB/s 2024-09-11T22:22:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677751 s, 155 MB/s 2024-09-11T22:22:06.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.973 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.973 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743814 s, 141 MB/s 2024-09-11T22:22:06.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.981 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693672 s, 151 MB/s 2024-09-11T22:22:06.992 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.992 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.993 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757603 s, 138 MB/s 2024-09-11T22:22:06.999 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:06.999 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:06.999 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728715 s, 144 MB/s 2024-09-11T22:22:07.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.009 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760956 s, 138 MB/s 2024-09-11T22:22:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817711 s, 128 MB/s 2024-09-11T22:22:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.027 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676769 s, 155 MB/s 2024-09-11T22:22:07.036 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.037 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744815 s, 141 MB/s 2024-09-11T22:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677883 s, 155 MB/s 2024-09-11T22:22:07.054 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.054 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.054 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706495 s, 148 MB/s 2024-09-11T22:22:07.063 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.063 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.063 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741879 s, 141 MB/s 2024-09-11T22:22:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00811008 s, 129 MB/s 2024-09-11T22:22:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.082 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707153 s, 148 MB/s 2024-09-11T22:22:07.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.091 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724785 s, 145 MB/s 2024-09-11T22:22:07.099 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.099 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.099 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069347 s, 151 MB/s 2024-09-11T22:22:07.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.109 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749398 s, 140 MB/s 2024-09-11T22:22:07.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:07.115 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:07.115 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:07.116 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.7 2024-09-11T22:22:07.116 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:07.116 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:07.116 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:07.116 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:07.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:07.176 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.176 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.176 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690833 s, 152 MB/s 2024-09-11T22:22:07.184 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.185 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.185 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717934 s, 146 MB/s 2024-09-11T22:22:07.193 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.193 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.193 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690688 s, 152 MB/s 2024-09-11T22:22:07.202 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.202 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.202 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725573 s, 145 MB/s 2024-09-11T22:22:07.211 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.211 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.212 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701289 s, 150 MB/s 2024-09-11T22:22:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714917 s, 147 MB/s 2024-09-11T22:22:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.230 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747449 s, 140 MB/s 2024-09-11T22:22:07.238 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.238 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.238 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660414 s, 159 MB/s 2024-09-11T22:22:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761776 s, 138 MB/s 2024-09-11T22:22:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.257 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738271 s, 142 MB/s 2024-09-11T22:22:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.266 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073414 s, 143 MB/s 2024-09-11T22:22:07.276 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.276 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.276 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864958 s, 121 MB/s 2024-09-11T22:22:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.286 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742085 s, 141 MB/s 2024-09-11T22:22:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700118 s, 150 MB/s 2024-09-11T22:22:07.303 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.303 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.303 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684979 s, 153 MB/s 2024-09-11T22:22:07.312 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.312 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.312 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741203 s, 141 MB/s 2024-09-11T22:22:07.321 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.321 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.321 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726312 s, 144 MB/s 2024-09-11T22:22:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693655 s, 151 MB/s 2024-09-11T22:22:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.339 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006956 s, 151 MB/s 2024-09-11T22:22:07.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.347 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.348 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665893 s, 157 MB/s 2024-09-11T22:22:07.358 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.358 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.358 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873513 s, 120 MB/s 2024-09-11T22:22:07.366 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.367 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.367 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067378 s, 156 MB/s 2024-09-11T22:22:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.376 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728067 s, 144 MB/s 2024-09-11T22:22:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748504 s, 140 MB/s 2024-09-11T22:22:07.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.393 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678315 s, 155 MB/s 2024-09-11T22:22:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744452 s, 141 MB/s 2024-09-11T22:22:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675432 s, 155 MB/s 2024-09-11T22:22:07.419 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666533 s, 157 MB/s 2024-09-11T22:22:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.429 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072615 s, 144 MB/s 2024-09-11T22:22:07.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.437 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708577 s, 148 MB/s 2024-09-11T22:22:07.446 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.446 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.446 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684209 s, 153 MB/s 2024-09-11T22:22:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694925 s, 151 MB/s 2024-09-11T22:22:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:07.462 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:07.462 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:07.463 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.8 2024-09-11T22:22:07.463 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:07.463 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:07.463 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:07.463 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:07.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:07.524 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.524 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.524 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756201 s, 139 MB/s 2024-09-11T22:22:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761821 s, 138 MB/s 2024-09-11T22:22:07.544 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.544 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.544 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825536 s, 127 MB/s 2024-09-11T22:22:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633757 s, 165 MB/s 2024-09-11T22:22:07.560 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.560 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.560 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708291 s, 148 MB/s 2024-09-11T22:22:07.569 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748729 s, 140 MB/s 2024-09-11T22:22:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700434 s, 150 MB/s 2024-09-11T22:22:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675578 s, 155 MB/s 2024-09-11T22:22:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715981 s, 146 MB/s 2024-09-11T22:22:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750844 s, 140 MB/s 2024-09-11T22:22:07.614 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.614 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.614 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739513 s, 142 MB/s 2024-09-11T22:22:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678551 s, 155 MB/s 2024-09-11T22:22:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733762 s, 143 MB/s 2024-09-11T22:22:07.641 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.641 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.641 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718136 s, 146 MB/s 2024-09-11T22:22:07.650 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.650 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.650 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697027 s, 150 MB/s 2024-09-11T22:22:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075618 s, 139 MB/s 2024-09-11T22:22:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877437 s, 120 MB/s 2024-09-11T22:22:07.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.680 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750771 s, 140 MB/s 2024-09-11T22:22:07.689 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.689 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.689 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727963 s, 144 MB/s 2024-09-11T22:22:07.697 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.698 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.698 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708733 s, 148 MB/s 2024-09-11T22:22:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704348 s, 149 MB/s 2024-09-11T22:22:07.716 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.716 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.716 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755275 s, 139 MB/s 2024-09-11T22:22:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738962 s, 142 MB/s 2024-09-11T22:22:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707365 s, 148 MB/s 2024-09-11T22:22:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759404 s, 138 MB/s 2024-09-11T22:22:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842897 s, 124 MB/s 2024-09-11T22:22:07.763 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850766 s, 123 MB/s 2024-09-11T22:22:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733378 s, 143 MB/s 2024-09-11T22:22:07.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.782 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.782 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072955 s, 144 MB/s 2024-09-11T22:22:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689698 s, 152 MB/s 2024-09-11T22:22:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.800 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.800 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777707 s, 135 MB/s 2024-09-11T22:22:07.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676066 s, 155 MB/s 2024-09-11T22:22:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:07.815 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:07.815 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:07.815 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.9 2024-09-11T22:22:07.816 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:07.816 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:07.816 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:07.816 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:07.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668185 s, 157 MB/s 2024-09-11T22:22:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742053 s, 141 MB/s 2024-09-11T22:22:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739049 s, 142 MB/s 2024-09-11T22:22:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695304 s, 151 MB/s 2024-09-11T22:22:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694286 s, 151 MB/s 2024-09-11T22:22:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686657 s, 153 MB/s 2024-09-11T22:22:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664584 s, 158 MB/s 2024-09-11T22:22:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752848 s, 139 MB/s 2024-09-11T22:22:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748144 s, 140 MB/s 2024-09-11T22:22:07.955 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.956 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717167 s, 146 MB/s 2024-09-11T22:22:07.964 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.964 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.965 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717474 s, 146 MB/s 2024-09-11T22:22:07.973 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.973 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.973 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659823 s, 159 MB/s 2024-09-11T22:22:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690012 s, 152 MB/s 2024-09-11T22:22:07.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.991 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730158 s, 144 MB/s 2024-09-11T22:22:07.999 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:07.999 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:07.999 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723859 s, 145 MB/s 2024-09-11T22:22:08.008 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.008 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.008 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697883 s, 150 MB/s 2024-09-11T22:22:08.017 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.017 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.017 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677194 s, 155 MB/s 2024-09-11T22:22:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717723 s, 146 MB/s 2024-09-11T22:22:08.034 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.034 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.034 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066894 s, 157 MB/s 2024-09-11T22:22:08.043 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.043 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714637 s, 147 MB/s 2024-09-11T22:22:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725215 s, 145 MB/s 2024-09-11T22:22:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749775 s, 140 MB/s 2024-09-11T22:22:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762385 s, 138 MB/s 2024-09-11T22:22:08.080 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.080 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.080 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703209 s, 149 MB/s 2024-09-11T22:22:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740754 s, 142 MB/s 2024-09-11T22:22:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674958 s, 155 MB/s 2024-09-11T22:22:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772394 s, 136 MB/s 2024-09-11T22:22:08.116 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.116 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.116 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651816 s, 161 MB/s 2024-09-11T22:22:08.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.125 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770806 s, 136 MB/s 2024-09-11T22:22:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748826 s, 140 MB/s 2024-09-11T22:22:08.142 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638578 s, 164 MB/s 2024-09-11T22:22:08.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.152 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730738 s, 143 MB/s 2024-09-11T22:22:08.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:08.158 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:08.158 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:08.158 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.10 2024-09-11T22:22:08.158 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:08.159 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:08.159 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:08.159 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:08.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065096 s, 161 MB/s 2024-09-11T22:22:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695317 s, 151 MB/s 2024-09-11T22:22:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714377 s, 147 MB/s 2024-09-11T22:22:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749444 s, 140 MB/s 2024-09-11T22:22:08.254 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.254 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.254 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656156 s, 160 MB/s 2024-09-11T22:22:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629736 s, 167 MB/s 2024-09-11T22:22:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732934 s, 143 MB/s 2024-09-11T22:22:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696554 s, 151 MB/s 2024-09-11T22:22:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713201 s, 147 MB/s 2024-09-11T22:22:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746603 s, 140 MB/s 2024-09-11T22:22:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684164 s, 153 MB/s 2024-09-11T22:22:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726261 s, 144 MB/s 2024-09-11T22:22:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684798 s, 153 MB/s 2024-09-11T22:22:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738903 s, 142 MB/s 2024-09-11T22:22:08.343 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.343 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.343 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076033 s, 138 MB/s 2024-09-11T22:22:08.352 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.352 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.352 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669827 s, 157 MB/s 2024-09-11T22:22:08.360 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.360 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.360 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688523 s, 152 MB/s 2024-09-11T22:22:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625973 s, 168 MB/s 2024-09-11T22:22:08.377 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.377 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.377 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072222 s, 145 MB/s 2024-09-11T22:22:08.386 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.386 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.386 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728262 s, 144 MB/s 2024-09-11T22:22:08.395 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.395 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.395 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681176 s, 154 MB/s 2024-09-11T22:22:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675843 s, 155 MB/s 2024-09-11T22:22:08.413 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.413 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.413 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741489 s, 141 MB/s 2024-09-11T22:22:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744095 s, 141 MB/s 2024-09-11T22:22:08.431 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.431 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.431 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741676 s, 141 MB/s 2024-09-11T22:22:08.439 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.439 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.439 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639007 s, 164 MB/s 2024-09-11T22:22:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673938 s, 156 MB/s 2024-09-11T22:22:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720766 s, 145 MB/s 2024-09-11T22:22:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076495 s, 137 MB/s 2024-09-11T22:22:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650098 s, 161 MB/s 2024-09-11T22:22:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685246 s, 153 MB/s 2024-09-11T22:22:08.491 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.491 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.491 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657884 s, 159 MB/s 2024-09-11T22:22:08.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:08.497 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:08.498 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:08.498 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.11 2024-09-11T22:22:08.498 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:08.498 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:08.498 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:08.498 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642525 s, 163 MB/s 2024-09-11T22:22:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657587 s, 159 MB/s 2024-09-11T22:22:08.575 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.575 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.575 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069765 s, 150 MB/s 2024-09-11T22:22:08.583 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.583 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.583 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642201 s, 163 MB/s 2024-09-11T22:22:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.592 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727671 s, 144 MB/s 2024-09-11T22:22:08.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.600 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652233 s, 161 MB/s 2024-09-11T22:22:08.608 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.608 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.608 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646886 s, 162 MB/s 2024-09-11T22:22:08.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.618 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.618 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769282 s, 136 MB/s 2024-09-11T22:22:08.627 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.627 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.627 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754294 s, 139 MB/s 2024-09-11T22:22:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651375 s, 161 MB/s 2024-09-11T22:22:08.645 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.645 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.645 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764232 s, 137 MB/s 2024-09-11T22:22:08.653 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.653 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.653 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667103 s, 157 MB/s 2024-09-11T22:22:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777223 s, 135 MB/s 2024-09-11T22:22:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763094 s, 137 MB/s 2024-09-11T22:22:08.682 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.682 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.682 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780321 s, 134 MB/s 2024-09-11T22:22:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732013 s, 143 MB/s 2024-09-11T22:22:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.699 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682536 s, 154 MB/s 2024-09-11T22:22:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074084 s, 142 MB/s 2024-09-11T22:22:08.717 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.718 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679602 s, 154 MB/s 2024-09-11T22:22:08.727 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.727 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.727 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786641 s, 133 MB/s 2024-09-11T22:22:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.737 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817828 s, 128 MB/s 2024-09-11T22:22:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.746 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706274 s, 148 MB/s 2024-09-11T22:22:08.755 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.755 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.755 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679542 s, 154 MB/s 2024-09-11T22:22:08.763 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.763 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.763 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657914 s, 159 MB/s 2024-09-11T22:22:08.772 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.772 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.772 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718255 s, 146 MB/s 2024-09-11T22:22:08.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.781 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.781 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759783 s, 138 MB/s 2024-09-11T22:22:08.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.790 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.790 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723785 s, 145 MB/s 2024-09-11T22:22:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691477 s, 152 MB/s 2024-09-11T22:22:08.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.808 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.808 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070428 s, 149 MB/s 2024-09-11T22:22:08.817 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.817 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.817 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00805941 s, 130 MB/s 2024-09-11T22:22:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714292 s, 147 MB/s 2024-09-11T22:22:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618062 s, 170 MB/s 2024-09-11T22:22:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:08.841 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:08.841 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:08.841 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.12 2024-09-11T22:22:08.841 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:08.841 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:08.841 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:08.841 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:08.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.902 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660235 s, 159 MB/s 2024-09-11T22:22:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708129 s, 148 MB/s 2024-09-11T22:22:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725068 s, 145 MB/s 2024-09-11T22:22:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733207 s, 143 MB/s 2024-09-11T22:22:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655272 s, 160 MB/s 2024-09-11T22:22:08.946 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.946 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.946 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744778 s, 141 MB/s 2024-09-11T22:22:08.955 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.955 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.955 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688982 s, 152 MB/s 2024-09-11T22:22:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669642 s, 157 MB/s 2024-09-11T22:22:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758628 s, 138 MB/s 2024-09-11T22:22:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649035 s, 162 MB/s 2024-09-11T22:22:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769386 s, 136 MB/s 2024-09-11T22:22:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765056 s, 137 MB/s 2024-09-11T22:22:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691862 s, 152 MB/s 2024-09-11T22:22:09.018 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.018 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.018 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734984 s, 143 MB/s 2024-09-11T22:22:09.026 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.026 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.027 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658875 s, 159 MB/s 2024-09-11T22:22:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.035 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688784 s, 152 MB/s 2024-09-11T22:22:09.044 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.044 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.044 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750401 s, 140 MB/s 2024-09-11T22:22:09.054 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.054 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.054 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764767 s, 137 MB/s 2024-09-11T22:22:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067755 s, 155 MB/s 2024-09-11T22:22:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.071 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683829 s, 153 MB/s 2024-09-11T22:22:09.080 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.080 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.080 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732993 s, 143 MB/s 2024-09-11T22:22:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662568 s, 158 MB/s 2024-09-11T22:22:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721188 s, 145 MB/s 2024-09-11T22:22:09.106 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.107 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.107 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731385 s, 143 MB/s 2024-09-11T22:22:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835143 s, 126 MB/s 2024-09-11T22:22:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727152 s, 144 MB/s 2024-09-11T22:22:09.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.134 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700516 s, 150 MB/s 2024-09-11T22:22:09.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.144 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.144 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741426 s, 141 MB/s 2024-09-11T22:22:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644129 s, 163 MB/s 2024-09-11T22:22:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725118 s, 145 MB/s 2024-09-11T22:22:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680183 s, 154 MB/s 2024-09-11T22:22:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722176 s, 145 MB/s 2024-09-11T22:22:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:09.185 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:09.185 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:09.185 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.13 2024-09-11T22:22:09.186 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:09.186 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:09.186 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:09.186 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656298 s, 160 MB/s 2024-09-11T22:22:09.253 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.253 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.253 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623966 s, 168 MB/s 2024-09-11T22:22:09.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.262 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732791 s, 143 MB/s 2024-09-11T22:22:09.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.272 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.272 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072046 s, 146 MB/s 2024-09-11T22:22:09.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.280 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709817 s, 148 MB/s 2024-09-11T22:22:09.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.290 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.290 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759824 s, 138 MB/s 2024-09-11T22:22:09.298 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.298 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.298 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065513 s, 160 MB/s 2024-09-11T22:22:09.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.307 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758836 s, 138 MB/s 2024-09-11T22:22:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674764 s, 155 MB/s 2024-09-11T22:22:09.325 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.325 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.325 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079183 s, 132 MB/s 2024-09-11T22:22:09.334 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.334 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.334 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668717 s, 157 MB/s 2024-09-11T22:22:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717995 s, 146 MB/s 2024-09-11T22:22:09.352 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.352 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.352 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744755 s, 141 MB/s 2024-09-11T22:22:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770217 s, 136 MB/s 2024-09-11T22:22:09.370 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072132 s, 145 MB/s 2024-09-11T22:22:09.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776465 s, 135 MB/s 2024-09-11T22:22:09.395 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.395 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.395 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125208 s, 83.7 MB/s 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661292 s, 159 MB/s 2024-09-11T22:22:09.412 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.412 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.412 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738172 s, 142 MB/s 2024-09-11T22:22:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836436 s, 125 MB/s 2024-09-11T22:22:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670648 s, 156 MB/s 2024-09-11T22:22:09.440 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.440 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.440 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748658 s, 140 MB/s 2024-09-11T22:22:09.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.448 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.449 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661822 s, 158 MB/s 2024-09-11T22:22:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662869 s, 158 MB/s 2024-09-11T22:22:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737001 s, 142 MB/s 2024-09-11T22:22:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778645 s, 135 MB/s 2024-09-11T22:22:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817501 s, 128 MB/s 2024-09-11T22:22:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663384 s, 158 MB/s 2024-09-11T22:22:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723197 s, 145 MB/s 2024-09-11T22:22:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828356 s, 127 MB/s 2024-09-11T22:22:09.523 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.523 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.523 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771888 s, 136 MB/s 2024-09-11T22:22:09.531 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.532 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.532 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674515 s, 155 MB/s 2024-09-11T22:22:09.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:09.538 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:09.538 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:09.539 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.14 2024-09-11T22:22:09.539 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:09.539 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:09.539 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:09.539 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:09.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:09.610 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.610 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.610 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648973 s, 162 MB/s 2024-09-11T22:22:09.618 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.618 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.619 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703177 s, 149 MB/s 2024-09-11T22:22:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675055 s, 155 MB/s 2024-09-11T22:22:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078493 s, 134 MB/s 2024-09-11T22:22:09.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873129 s, 120 MB/s 2024-09-11T22:22:09.656 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.656 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.656 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673495 s, 156 MB/s 2024-09-11T22:22:09.664 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.664 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.664 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678701 s, 154 MB/s 2024-09-11T22:22:09.673 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.673 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.673 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681892 s, 154 MB/s 2024-09-11T22:22:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.682 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676905 s, 155 MB/s 2024-09-11T22:22:09.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.690 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671989 s, 156 MB/s 2024-09-11T22:22:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.701 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858325 s, 122 MB/s 2024-09-11T22:22:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683397 s, 153 MB/s 2024-09-11T22:22:09.717 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.718 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.718 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690967 s, 152 MB/s 2024-09-11T22:22:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715593 s, 147 MB/s 2024-09-11T22:22:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737942 s, 142 MB/s 2024-09-11T22:22:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721254 s, 145 MB/s 2024-09-11T22:22:09.754 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.754 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.754 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717766 s, 146 MB/s 2024-09-11T22:22:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724022 s, 145 MB/s 2024-09-11T22:22:09.772 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.772 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.772 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659103 s, 159 MB/s 2024-09-11T22:22:09.782 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.782 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.782 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843022 s, 124 MB/s 2024-09-11T22:22:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748438 s, 140 MB/s 2024-09-11T22:22:09.801 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.801 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.801 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779934 s, 134 MB/s 2024-09-11T22:22:09.810 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.811 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747265 s, 140 MB/s 2024-09-11T22:22:09.819 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.819 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.819 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694123 s, 151 MB/s 2024-09-11T22:22:09.828 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.829 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735558 s, 143 MB/s 2024-09-11T22:22:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.837 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065904 s, 159 MB/s 2024-09-11T22:22:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636736 s, 165 MB/s 2024-09-11T22:22:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754181 s, 139 MB/s 2024-09-11T22:22:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726734 s, 144 MB/s 2024-09-11T22:22:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064616 s, 162 MB/s 2024-09-11T22:22:09.879 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713557 s, 147 MB/s 2024-09-11T22:22:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715617 s, 147 MB/s 2024-09-11T22:22:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:09.895 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:09.895 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:09.895 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.15 2024-09-11T22:22:09.895 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:09.895 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:09.896 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:09.896 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:09.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:09.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.956 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.956 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742026 s, 141 MB/s 2024-09-11T22:22:09.964 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.964 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.964 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631048 s, 166 MB/s 2024-09-11T22:22:09.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.973 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.973 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664888 s, 158 MB/s 2024-09-11T22:22:09.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.982 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734796 s, 143 MB/s 2024-09-11T22:22:09.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:09.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:09.990 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718691 s, 146 MB/s 2024-09-11T22:22:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.001 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899454 s, 117 MB/s 2024-09-11T22:22:10.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.010 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731267 s, 143 MB/s 2024-09-11T22:22:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731376 s, 143 MB/s 2024-09-11T22:22:10.028 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.029 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.029 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741244 s, 141 MB/s 2024-09-11T22:22:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703041 s, 149 MB/s 2024-09-11T22:22:10.046 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.047 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756714 s, 139 MB/s 2024-09-11T22:22:10.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.056 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.056 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722014 s, 145 MB/s 2024-09-11T22:22:10.064 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.065 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740485 s, 142 MB/s 2024-09-11T22:22:10.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.074 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785016 s, 134 MB/s 2024-09-11T22:22:10.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.083 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073964 s, 142 MB/s 2024-09-11T22:22:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663799 s, 158 MB/s 2024-09-11T22:22:10.100 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714913 s, 147 MB/s 2024-09-11T22:22:10.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705019 s, 149 MB/s 2024-09-11T22:22:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.119 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768524 s, 136 MB/s 2024-09-11T22:22:10.127 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.127 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.127 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623577 s, 168 MB/s 2024-09-11T22:22:10.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.135 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666438 s, 157 MB/s 2024-09-11T22:22:10.144 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.144 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.144 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724017 s, 145 MB/s 2024-09-11T22:22:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617438 s, 170 MB/s 2024-09-11T22:22:10.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.161 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770381 s, 136 MB/s 2024-09-11T22:22:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665486 s, 158 MB/s 2024-09-11T22:22:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679336 s, 154 MB/s 2024-09-11T22:22:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717201 s, 146 MB/s 2024-09-11T22:22:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751262 s, 140 MB/s 2024-09-11T22:22:10.205 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.205 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686795 s, 153 MB/s 2024-09-11T22:22:10.214 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.214 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.215 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710098 s, 148 MB/s 2024-09-11T22:22:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693096 s, 151 MB/s 2024-09-11T22:22:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078831 s, 133 MB/s 2024-09-11T22:22:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:10.239 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:10.240 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:10.240 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.16 2024-09-11T22:22:10.240 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:10.240 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:10.240 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:10.240 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:10.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:10.300 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.300 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.300 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669285 s, 157 MB/s 2024-09-11T22:22:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735503 s, 143 MB/s 2024-09-11T22:22:10.317 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674029 s, 156 MB/s 2024-09-11T22:22:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.327 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736835 s, 142 MB/s 2024-09-11T22:22:10.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.335 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.335 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665602 s, 158 MB/s 2024-09-11T22:22:10.344 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.344 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.344 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738233 s, 142 MB/s 2024-09-11T22:22:10.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.353 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717863 s, 146 MB/s 2024-09-11T22:22:10.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.363 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.363 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767198 s, 137 MB/s 2024-09-11T22:22:10.373 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.373 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.373 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876301 s, 120 MB/s 2024-09-11T22:22:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766609 s, 137 MB/s 2024-09-11T22:22:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635143 s, 165 MB/s 2024-09-11T22:22:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693066 s, 151 MB/s 2024-09-11T22:22:10.407 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.407 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.408 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655505 s, 160 MB/s 2024-09-11T22:22:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672033 s, 156 MB/s 2024-09-11T22:22:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735008 s, 143 MB/s 2024-09-11T22:22:10.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.433 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.433 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667565 s, 157 MB/s 2024-09-11T22:22:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00881989 s, 119 MB/s 2024-09-11T22:22:10.452 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.452 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.453 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639007 s, 164 MB/s 2024-09-11T22:22:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628051 s, 167 MB/s 2024-09-11T22:22:10.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.470 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745919 s, 141 MB/s 2024-09-11T22:22:10.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.478 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708558 s, 148 MB/s 2024-09-11T22:22:10.487 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.487 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.487 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074283 s, 141 MB/s 2024-09-11T22:22:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692005 s, 152 MB/s 2024-09-11T22:22:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664775 s, 158 MB/s 2024-09-11T22:22:10.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.514 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735134 s, 143 MB/s 2024-09-11T22:22:10.523 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.523 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.524 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775079 s, 135 MB/s 2024-09-11T22:22:10.533 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.533 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.533 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078448 s, 134 MB/s 2024-09-11T22:22:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729423 s, 144 MB/s 2024-09-11T22:22:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00815891 s, 129 MB/s 2024-09-11T22:22:10.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.561 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.561 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674524 s, 155 MB/s 2024-09-11T22:22:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758368 s, 138 MB/s 2024-09-11T22:22:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707037 s, 148 MB/s 2024-09-11T22:22:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:10.586 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:10.587 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:10.587 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.17 2024-09-11T22:22:10.587 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:10.587 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:10.587 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:10.587 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:10.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:10.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.647 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.647 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723448 s, 145 MB/s 2024-09-11T22:22:10.657 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.657 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.657 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00811514 s, 129 MB/s 2024-09-11T22:22:10.667 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.667 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.667 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772107 s, 136 MB/s 2024-09-11T22:22:10.676 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.676 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.676 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078518 s, 134 MB/s 2024-09-11T22:22:10.686 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.686 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.686 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775702 s, 135 MB/s 2024-09-11T22:22:10.695 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.695 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.695 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695583 s, 151 MB/s 2024-09-11T22:22:10.704 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.704 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.705 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736191 s, 142 MB/s 2024-09-11T22:22:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726303 s, 144 MB/s 2024-09-11T22:22:10.722 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.722 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.722 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745043 s, 141 MB/s 2024-09-11T22:22:10.730 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.730 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.730 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635573 s, 165 MB/s 2024-09-11T22:22:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.740 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783209 s, 134 MB/s 2024-09-11T22:22:10.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.749 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736647 s, 142 MB/s 2024-09-11T22:22:10.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.758 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070274 s, 149 MB/s 2024-09-11T22:22:10.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.767 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.767 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734969 s, 143 MB/s 2024-09-11T22:22:10.775 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.775 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.775 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659967 s, 159 MB/s 2024-09-11T22:22:10.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.784 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.784 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678324 s, 155 MB/s 2024-09-11T22:22:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713397 s, 147 MB/s 2024-09-11T22:22:10.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.802 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726286 s, 144 MB/s 2024-09-11T22:22:10.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.812 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723921 s, 145 MB/s 2024-09-11T22:22:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641241 s, 164 MB/s 2024-09-11T22:22:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758839 s, 138 MB/s 2024-09-11T22:22:10.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.837 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.838 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726603 s, 144 MB/s 2024-09-11T22:22:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.846 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695839 s, 151 MB/s 2024-09-11T22:22:10.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.856 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.856 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753273 s, 139 MB/s 2024-09-11T22:22:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769502 s, 136 MB/s 2024-09-11T22:22:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748424 s, 140 MB/s 2024-09-11T22:22:10.883 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.884 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.884 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742864 s, 141 MB/s 2024-09-11T22:22:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.893 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.893 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741739 s, 141 MB/s 2024-09-11T22:22:10.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.902 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721399 s, 145 MB/s 2024-09-11T22:22:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.911 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700365 s, 150 MB/s 2024-09-11T22:22:10.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.918 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062482 s, 168 MB/s 2024-09-11T22:22:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.927 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693355 s, 151 MB/s 2024-09-11T22:22:10.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:10.934 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:10.934 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:10.934 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.18 2024-09-11T22:22:10.934 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:10.934 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:10.934 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:10.935 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:10.994 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:10.995 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:10.995 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699016 s, 150 MB/s 2024-09-11T22:22:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660583 s, 159 MB/s 2024-09-11T22:22:11.011 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.012 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.012 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675331 s, 155 MB/s 2024-09-11T22:22:11.020 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.020 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.020 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703761 s, 149 MB/s 2024-09-11T22:22:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737185 s, 142 MB/s 2024-09-11T22:22:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685659 s, 153 MB/s 2024-09-11T22:22:11.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.047 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073398 s, 143 MB/s 2024-09-11T22:22:11.056 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.056 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.056 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692632 s, 151 MB/s 2024-09-11T22:22:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717547 s, 146 MB/s 2024-09-11T22:22:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746498 s, 140 MB/s 2024-09-11T22:22:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.083 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682199 s, 154 MB/s 2024-09-11T22:22:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726936 s, 144 MB/s 2024-09-11T22:22:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.101 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659767 s, 159 MB/s 2024-09-11T22:22:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.109 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653427 s, 160 MB/s 2024-09-11T22:22:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666274 s, 157 MB/s 2024-09-11T22:22:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630223 s, 166 MB/s 2024-09-11T22:22:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744161 s, 141 MB/s 2024-09-11T22:22:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725332 s, 145 MB/s 2024-09-11T22:22:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.153 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.153 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726819 s, 144 MB/s 2024-09-11T22:22:11.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.161 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735084 s, 143 MB/s 2024-09-11T22:22:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725914 s, 144 MB/s 2024-09-11T22:22:11.180 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.180 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.180 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756406 s, 139 MB/s 2024-09-11T22:22:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750438 s, 140 MB/s 2024-09-11T22:22:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742887 s, 141 MB/s 2024-09-11T22:22:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650511 s, 161 MB/s 2024-09-11T22:22:11.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.215 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.215 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708444 s, 148 MB/s 2024-09-11T22:22:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073515 s, 143 MB/s 2024-09-11T22:22:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697141 s, 150 MB/s 2024-09-11T22:22:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677107 s, 155 MB/s 2024-09-11T22:22:11.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.250 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.251 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662914 s, 158 MB/s 2024-09-11T22:22:11.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.259 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674855 s, 155 MB/s 2024-09-11T22:22:11.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.269 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.269 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761576 s, 138 MB/s 2024-09-11T22:22:11.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:11.275 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:11.275 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:11.276 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.19 2024-09-11T22:22:11.276 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:11.276 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:11.276 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:11.276 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:11.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:11.337 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.337 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.337 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731538 s, 143 MB/s 2024-09-11T22:22:11.346 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.346 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.346 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739543 s, 142 MB/s 2024-09-11T22:22:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746016 s, 141 MB/s 2024-09-11T22:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673278 s, 156 MB/s 2024-09-11T22:22:11.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.372 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667164 s, 157 MB/s 2024-09-11T22:22:11.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.380 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648724 s, 162 MB/s 2024-09-11T22:22:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733945 s, 143 MB/s 2024-09-11T22:22:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724088 s, 145 MB/s 2024-09-11T22:22:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657936 s, 159 MB/s 2024-09-11T22:22:11.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.416 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.416 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775127 s, 135 MB/s 2024-09-11T22:22:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.425 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712782 s, 147 MB/s 2024-09-11T22:22:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.435 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760698 s, 138 MB/s 2024-09-11T22:22:11.443 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.443 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.443 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689484 s, 152 MB/s 2024-09-11T22:22:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.453 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743115 s, 141 MB/s 2024-09-11T22:22:11.461 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.461 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704538 s, 149 MB/s 2024-09-11T22:22:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631512 s, 166 MB/s 2024-09-11T22:22:11.478 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709151 s, 148 MB/s 2024-09-11T22:22:11.488 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.488 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.488 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732221 s, 143 MB/s 2024-09-11T22:22:11.497 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.497 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.497 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719538 s, 146 MB/s 2024-09-11T22:22:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693554 s, 151 MB/s 2024-09-11T22:22:11.515 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.515 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.515 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809965 s, 129 MB/s 2024-09-11T22:22:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748505 s, 140 MB/s 2024-09-11T22:22:11.533 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.533 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.534 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725456 s, 145 MB/s 2024-09-11T22:22:11.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.541 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667092 s, 157 MB/s 2024-09-11T22:22:11.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.550 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745958 s, 141 MB/s 2024-09-11T22:22:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704661 s, 149 MB/s 2024-09-11T22:22:11.567 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.568 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.568 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654002 s, 160 MB/s 2024-09-11T22:22:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747017 s, 140 MB/s 2024-09-11T22:22:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651231 s, 161 MB/s 2024-09-11T22:22:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708214 s, 148 MB/s 2024-09-11T22:22:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070268 s, 149 MB/s 2024-09-11T22:22:11.611 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.611 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.611 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634756 s, 165 MB/s 2024-09-11T22:22:11.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:11.618 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:11.618 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:11.618 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.20 2024-09-11T22:22:11.619 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:11.619 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:11.619 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:11.619 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:11.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.682 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.682 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712264 s, 147 MB/s 2024-09-11T22:22:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700545 s, 150 MB/s 2024-09-11T22:22:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068797 s, 152 MB/s 2024-09-11T22:22:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646664 s, 162 MB/s 2024-09-11T22:22:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640996 s, 164 MB/s 2024-09-11T22:22:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688913 s, 152 MB/s 2024-09-11T22:22:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732748 s, 143 MB/s 2024-09-11T22:22:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679418 s, 154 MB/s 2024-09-11T22:22:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664635 s, 158 MB/s 2024-09-11T22:22:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.759 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753627 s, 139 MB/s 2024-09-11T22:22:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068257 s, 154 MB/s 2024-09-11T22:22:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664953 s, 158 MB/s 2024-09-11T22:22:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072743 s, 144 MB/s 2024-09-11T22:22:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715941 s, 146 MB/s 2024-09-11T22:22:11.802 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.803 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065346 s, 160 MB/s 2024-09-11T22:22:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.812 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740507 s, 142 MB/s 2024-09-11T22:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742414 s, 141 MB/s 2024-09-11T22:22:11.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.829 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665062 s, 158 MB/s 2024-09-11T22:22:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746782 s, 140 MB/s 2024-09-11T22:22:11.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.848 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731476 s, 143 MB/s 2024-09-11T22:22:11.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.855 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630064 s, 166 MB/s 2024-09-11T22:22:11.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.864 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.864 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665532 s, 158 MB/s 2024-09-11T22:22:11.871 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.872 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.872 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619929 s, 169 MB/s 2024-09-11T22:22:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.880 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670016 s, 157 MB/s 2024-09-11T22:22:11.890 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.890 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.890 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777082 s, 135 MB/s 2024-09-11T22:22:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749173 s, 140 MB/s 2024-09-11T22:22:11.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.908 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.908 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074362 s, 141 MB/s 2024-09-11T22:22:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644375 s, 163 MB/s 2024-09-11T22:22:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730957 s, 143 MB/s 2024-09-11T22:22:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700618 s, 150 MB/s 2024-09-11T22:22:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712343 s, 147 MB/s 2024-09-11T22:22:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:11.954 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:11.954 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836318 s, 125 MB/s 2024-09-11T22:22:11.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:11.960 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:11.960 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:11.960 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.21 2024-09-11T22:22:11.960 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:11.960 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:11.960 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:11.960 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:12.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:12.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.021 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.021 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743293 s, 141 MB/s 2024-09-11T22:22:12.029 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.029 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.029 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631915 s, 166 MB/s 2024-09-11T22:22:12.038 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.038 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.038 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767081 s, 137 MB/s 2024-09-11T22:22:12.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.047 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.047 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652437 s, 161 MB/s 2024-09-11T22:22:12.055 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.056 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.056 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710905 s, 147 MB/s 2024-09-11T22:22:12.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.065 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.065 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076105 s, 138 MB/s 2024-09-11T22:22:12.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.073 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.074 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663723 s, 158 MB/s 2024-09-11T22:22:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.083 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731854 s, 143 MB/s 2024-09-11T22:22:12.091 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.092 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.092 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724893 s, 145 MB/s 2024-09-11T22:22:12.100 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.101 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.101 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728948 s, 144 MB/s 2024-09-11T22:22:12.109 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.110 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.110 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732099 s, 143 MB/s 2024-09-11T22:22:12.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.120 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660366 s, 159 MB/s 2024-09-11T22:22:12.126 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.126 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.126 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063519 s, 165 MB/s 2024-09-11T22:22:12.135 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.136 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.136 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737562 s, 142 MB/s 2024-09-11T22:22:12.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.145 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.145 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729169 s, 144 MB/s 2024-09-11T22:22:12.154 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.154 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.154 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744299 s, 141 MB/s 2024-09-11T22:22:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.163 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684863 s, 153 MB/s 2024-09-11T22:22:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069756 s, 150 MB/s 2024-09-11T22:22:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070096 s, 150 MB/s 2024-09-11T22:22:12.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.189 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.189 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708096 s, 148 MB/s 2024-09-11T22:22:12.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.197 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.197 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665272 s, 158 MB/s 2024-09-11T22:22:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761712 s, 138 MB/s 2024-09-11T22:22:12.216 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.216 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.216 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752178 s, 139 MB/s 2024-09-11T22:22:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673428 s, 156 MB/s 2024-09-11T22:22:12.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.234 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.234 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784519 s, 134 MB/s 2024-09-11T22:22:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742456 s, 141 MB/s 2024-09-11T22:22:12.253 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.253 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.253 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754044 s, 139 MB/s 2024-09-11T22:22:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084086 s, 125 MB/s 2024-09-11T22:22:12.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.271 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637053 s, 165 MB/s 2024-09-11T22:22:12.279 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.279 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.279 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671568 s, 156 MB/s 2024-09-11T22:22:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.289 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737339 s, 142 MB/s 2024-09-11T22:22:12.297 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.298 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.298 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731866 s, 143 MB/s 2024-09-11T22:22:12.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:12.304 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:12.304 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:12.305 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.22 2024-09-11T22:22:12.305 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:12.305 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:12.305 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:12.305 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:12.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007409 s, 142 MB/s 2024-09-11T22:22:12.375 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.376 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.376 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838054 s, 125 MB/s 2024-09-11T22:22:12.384 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.384 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.384 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699285 s, 150 MB/s 2024-09-11T22:22:12.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.393 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.393 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705424 s, 149 MB/s 2024-09-11T22:22:12.401 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.401 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.401 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654948 s, 160 MB/s 2024-09-11T22:22:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.410 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692968 s, 151 MB/s 2024-09-11T22:22:12.418 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.418 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.419 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692038 s, 152 MB/s 2024-09-11T22:22:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731754 s, 143 MB/s 2024-09-11T22:22:12.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.437 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.437 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747791 s, 140 MB/s 2024-09-11T22:22:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065688 s, 160 MB/s 2024-09-11T22:22:12.453 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.453 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.454 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672101 s, 156 MB/s 2024-09-11T22:22:12.464 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.464 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.464 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00885999 s, 118 MB/s 2024-09-11T22:22:12.473 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.473 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.473 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072323 s, 145 MB/s 2024-09-11T22:22:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733179 s, 143 MB/s 2024-09-11T22:22:12.490 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.490 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.490 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660211 s, 159 MB/s 2024-09-11T22:22:12.498 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.499 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.499 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006636 s, 158 MB/s 2024-09-11T22:22:12.508 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.508 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.508 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00821758 s, 128 MB/s 2024-09-11T22:22:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683395 s, 153 MB/s 2024-09-11T22:22:12.525 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.526 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.526 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070434 s, 149 MB/s 2024-09-11T22:22:12.534 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.534 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.534 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677415 s, 155 MB/s 2024-09-11T22:22:12.543 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.543 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.544 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743882 s, 141 MB/s 2024-09-11T22:22:12.553 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.553 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.553 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732695 s, 143 MB/s 2024-09-11T22:22:12.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.562 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.562 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774517 s, 135 MB/s 2024-09-11T22:22:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772271 s, 136 MB/s 2024-09-11T22:22:12.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.582 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827981 s, 127 MB/s 2024-09-11T22:22:12.590 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.590 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.590 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647606 s, 162 MB/s 2024-09-11T22:22:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747874 s, 140 MB/s 2024-09-11T22:22:12.607 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.607 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.608 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679281 s, 154 MB/s 2024-09-11T22:22:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672187 s, 156 MB/s 2024-09-11T22:22:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682369 s, 154 MB/s 2024-09-11T22:22:12.633 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.633 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.633 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676629 s, 155 MB/s 2024-09-11T22:22:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753984 s, 139 MB/s 2024-09-11T22:22:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:12.650 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:12.650 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:12.650 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.23 2024-09-11T22:22:12.650 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:12.650 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:12.651 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:12.651 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:12.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:12.712 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.712 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.712 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733206 s, 143 MB/s 2024-09-11T22:22:12.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.720 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691702 s, 152 MB/s 2024-09-11T22:22:12.730 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.730 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.730 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00808317 s, 130 MB/s 2024-09-11T22:22:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736905 s, 142 MB/s 2024-09-11T22:22:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738369 s, 142 MB/s 2024-09-11T22:22:12.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.758 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.758 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728034 s, 144 MB/s 2024-09-11T22:22:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.766 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.767 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682772 s, 154 MB/s 2024-09-11T22:22:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776436 s, 135 MB/s 2024-09-11T22:22:12.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.785 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.785 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688878 s, 152 MB/s 2024-09-11T22:22:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726994 s, 144 MB/s 2024-09-11T22:22:12.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.803 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.803 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738538 s, 142 MB/s 2024-09-11T22:22:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657943 s, 159 MB/s 2024-09-11T22:22:12.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.821 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730334 s, 144 MB/s 2024-09-11T22:22:12.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.829 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674883 s, 155 MB/s 2024-09-11T22:22:12.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.838 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071365 s, 147 MB/s 2024-09-11T22:22:12.847 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.847 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.848 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074276 s, 141 MB/s 2024-09-11T22:22:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714156 s, 147 MB/s 2024-09-11T22:22:12.865 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.865 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.865 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686491 s, 153 MB/s 2024-09-11T22:22:12.873 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.874 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.874 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670054 s, 156 MB/s 2024-09-11T22:22:12.882 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.882 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.882 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677859 s, 155 MB/s 2024-09-11T22:22:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749784 s, 140 MB/s 2024-09-11T22:22:12.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.901 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752715 s, 139 MB/s 2024-09-11T22:22:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633383 s, 166 MB/s 2024-09-11T22:22:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727985 s, 144 MB/s 2024-09-11T22:22:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701622 s, 149 MB/s 2024-09-11T22:22:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685819 s, 153 MB/s 2024-09-11T22:22:12.944 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.945 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.945 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738502 s, 142 MB/s 2024-09-11T22:22:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670621 s, 156 MB/s 2024-09-11T22:22:12.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.962 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721884 s, 145 MB/s 2024-09-11T22:22:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.972 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758195 s, 138 MB/s 2024-09-11T22:22:12.980 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.981 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.981 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704233 s, 149 MB/s 2024-09-11T22:22:12.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:12.990 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:12.990 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751418 s, 140 MB/s 2024-09-11T22:22:12.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:12.997 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:12.998 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:12.998 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.24 2024-09-11T22:22:12.998 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:12.998 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:12.998 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:12.998 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:13.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:13.058 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.059 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.059 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672608 s, 156 MB/s 2024-09-11T22:22:13.067 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730531 s, 144 MB/s 2024-09-11T22:22:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657946 s, 159 MB/s 2024-09-11T22:22:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737869 s, 142 MB/s 2024-09-11T22:22:13.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.094 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.094 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667408 s, 157 MB/s 2024-09-11T22:22:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696539 s, 151 MB/s 2024-09-11T22:22:13.111 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.111 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.112 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735163 s, 143 MB/s 2024-09-11T22:22:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660905 s, 159 MB/s 2024-09-11T22:22:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.129 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765712 s, 137 MB/s 2024-09-11T22:22:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731727 s, 143 MB/s 2024-09-11T22:22:13.148 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.148 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.148 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744195 s, 141 MB/s 2024-09-11T22:22:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.157 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.157 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732922 s, 143 MB/s 2024-09-11T22:22:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752183 s, 139 MB/s 2024-09-11T22:22:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762423 s, 138 MB/s 2024-09-11T22:22:13.184 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.184 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.184 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066631 s, 157 MB/s 2024-09-11T22:22:13.192 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.192 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.192 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636332 s, 165 MB/s 2024-09-11T22:22:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615065 s, 170 MB/s 2024-09-11T22:22:13.208 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.208 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.208 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695765 s, 151 MB/s 2024-09-11T22:22:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755896 s, 139 MB/s 2024-09-11T22:22:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709048 s, 148 MB/s 2024-09-11T22:22:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064326 s, 163 MB/s 2024-09-11T22:22:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653774 s, 160 MB/s 2024-09-11T22:22:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653063 s, 161 MB/s 2024-09-11T22:22:13.259 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682439 s, 154 MB/s 2024-09-11T22:22:13.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.268 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.268 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670967 s, 156 MB/s 2024-09-11T22:22:13.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.277 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.277 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714773 s, 147 MB/s 2024-09-11T22:22:13.286 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.286 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.286 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680639 s, 154 MB/s 2024-09-11T22:22:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.295 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685816 s, 153 MB/s 2024-09-11T22:22:13.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.304 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.304 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725791 s, 144 MB/s 2024-09-11T22:22:13.312 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.313 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.313 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685479 s, 153 MB/s 2024-09-11T22:22:13.321 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.321 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.321 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667716 s, 157 MB/s 2024-09-11T22:22:13.329 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.330 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.330 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676304 s, 155 MB/s 2024-09-11T22:22:13.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:13.336 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:13.336 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:13.337 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.25 2024-09-11T22:22:13.337 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:13.337 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:13.337 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:13.337 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:13.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:13.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.397 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.397 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726611 s, 144 MB/s 2024-09-11T22:22:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709178 s, 148 MB/s 2024-09-11T22:22:13.414 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.415 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.415 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633947 s, 165 MB/s 2024-09-11T22:22:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669788 s, 157 MB/s 2024-09-11T22:22:13.431 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.432 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.432 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714496 s, 147 MB/s 2024-09-11T22:22:13.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.441 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.441 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777597 s, 135 MB/s 2024-09-11T22:22:13.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.450 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652979 s, 161 MB/s 2024-09-11T22:22:13.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.458 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.458 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692999 s, 151 MB/s 2024-09-11T22:22:13.468 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.469 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.469 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840483 s, 125 MB/s 2024-09-11T22:22:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.477 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717284 s, 146 MB/s 2024-09-11T22:22:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070853 s, 148 MB/s 2024-09-11T22:22:13.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.496 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.496 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827357 s, 127 MB/s 2024-09-11T22:22:13.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.505 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.505 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682999 s, 154 MB/s 2024-09-11T22:22:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687151 s, 153 MB/s 2024-09-11T22:22:13.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.522 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.522 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678413 s, 155 MB/s 2024-09-11T22:22:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700805 s, 150 MB/s 2024-09-11T22:22:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779877 s, 134 MB/s 2024-09-11T22:22:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728065 s, 144 MB/s 2024-09-11T22:22:13.558 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.559 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.559 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687989 s, 152 MB/s 2024-09-11T22:22:13.568 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.568 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.568 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742518 s, 141 MB/s 2024-09-11T22:22:13.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.577 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.577 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735055 s, 143 MB/s 2024-09-11T22:22:13.587 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.587 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.587 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852475 s, 123 MB/s 2024-09-11T22:22:13.596 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.596 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.596 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660704 s, 159 MB/s 2024-09-11T22:22:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759692 s, 138 MB/s 2024-09-11T22:22:13.613 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.614 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.614 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666392 s, 157 MB/s 2024-09-11T22:22:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731077 s, 143 MB/s 2024-09-11T22:22:13.632 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.632 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.632 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739997 s, 142 MB/s 2024-09-11T22:22:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.641 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728736 s, 144 MB/s 2024-09-11T22:22:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667111 s, 157 MB/s 2024-09-11T22:22:13.658 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.659 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.659 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074153 s, 141 MB/s 2024-09-11T22:22:13.668 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.668 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.668 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760425 s, 138 MB/s 2024-09-11T22:22:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738652 s, 142 MB/s 2024-09-11T22:22:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:13.684 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:13.684 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:13.684 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.26 2024-09-11T22:22:13.684 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:13.684 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:13.684 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:13.685 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:13.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:13.745 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.745 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.745 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682751 s, 154 MB/s 2024-09-11T22:22:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.756 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697025 s, 150 MB/s 2024-09-11T22:22:13.762 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.763 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.763 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073779 s, 142 MB/s 2024-09-11T22:22:13.771 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.771 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.771 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678837 s, 154 MB/s 2024-09-11T22:22:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748614 s, 140 MB/s 2024-09-11T22:22:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739754 s, 142 MB/s 2024-09-11T22:22:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684826 s, 153 MB/s 2024-09-11T22:22:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694828 s, 151 MB/s 2024-09-11T22:22:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064438 s, 163 MB/s 2024-09-11T22:22:13.824 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.824 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.824 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741434 s, 141 MB/s 2024-09-11T22:22:13.833 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.833 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.833 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730036 s, 144 MB/s 2024-09-11T22:22:13.842 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.842 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.842 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735357 s, 143 MB/s 2024-09-11T22:22:13.851 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.851 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.851 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676657 s, 155 MB/s 2024-09-11T22:22:13.860 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.860 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.860 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743035 s, 141 MB/s 2024-09-11T22:22:13.869 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.869 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.869 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740659 s, 142 MB/s 2024-09-11T22:22:13.878 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.878 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.878 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695469 s, 151 MB/s 2024-09-11T22:22:13.887 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.887 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.887 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740437 s, 142 MB/s 2024-09-11T22:22:13.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.896 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065414 s, 160 MB/s 2024-09-11T22:22:13.904 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.904 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.904 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714202 s, 147 MB/s 2024-09-11T22:22:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788992 s, 133 MB/s 2024-09-11T22:22:13.923 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.923 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.923 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072329 s, 145 MB/s 2024-09-11T22:22:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682098 s, 154 MB/s 2024-09-11T22:22:13.940 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.940 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.940 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653925 s, 160 MB/s 2024-09-11T22:22:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.949 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712529 s, 147 MB/s 2024-09-11T22:22:13.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.957 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650975 s, 161 MB/s 2024-09-11T22:22:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681501 s, 154 MB/s 2024-09-11T22:22:13.974 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.975 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072008 s, 146 MB/s 2024-09-11T22:22:13.984 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.984 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.985 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754549 s, 139 MB/s 2024-09-11T22:22:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644088 s, 163 MB/s 2024-09-11T22:22:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666471 s, 157 MB/s 2024-09-11T22:22:14.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.010 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078363 s, 134 MB/s 2024-09-11T22:22:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006995 s, 150 MB/s 2024-09-11T22:22:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:14.025 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:14.025 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:14.026 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.27 2024-09-11T22:22:14.026 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:14.026 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:14.026 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:14.026 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:14.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:14.086 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.086 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.086 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673755 s, 156 MB/s 2024-09-11T22:22:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720145 s, 146 MB/s 2024-09-11T22:22:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710614 s, 148 MB/s 2024-09-11T22:22:14.114 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.114 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.114 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840072 s, 125 MB/s 2024-09-11T22:22:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726645 s, 144 MB/s 2024-09-11T22:22:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786159 s, 133 MB/s 2024-09-11T22:22:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674797 s, 155 MB/s 2024-09-11T22:22:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066523 s, 158 MB/s 2024-09-11T22:22:14.159 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.159 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.159 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753446 s, 139 MB/s 2024-09-11T22:22:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742048 s, 141 MB/s 2024-09-11T22:22:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626619 s, 167 MB/s 2024-09-11T22:22:14.185 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.185 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.185 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736877 s, 142 MB/s 2024-09-11T22:22:14.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:22:14.194 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.194 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.195 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720686 s, 145 MB/s 2024-09-11T22:22:14.196 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:22:14.203 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.203 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.203 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779885 s, 134 MB/s 2024-09-11T22:22:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.211 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.212 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064647 s, 162 MB/s 2024-09-11T22:22:14.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.221 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753573 s, 139 MB/s 2024-09-11T22:22:14.231 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.231 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.231 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851762 s, 123 MB/s 2024-09-11T22:22:14.240 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.241 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735562 s, 143 MB/s 2024-09-11T22:22:14.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.249 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.249 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668764 s, 157 MB/s 2024-09-11T22:22:14.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.257 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693965 s, 151 MB/s 2024-09-11T22:22:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673919 s, 156 MB/s 2024-09-11T22:22:14.274 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685209 s, 153 MB/s 2024-09-11T22:22:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765943 s, 137 MB/s 2024-09-11T22:22:14.293 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.293 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.293 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714677 s, 147 MB/s 2024-09-11T22:22:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666542 s, 157 MB/s 2024-09-11T22:22:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729092 s, 144 MB/s 2024-09-11T22:22:14.319 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.319 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737197 s, 142 MB/s 2024-09-11T22:22:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783193 s, 134 MB/s 2024-09-11T22:22:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.338 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679699 s, 154 MB/s 2024-09-11T22:22:14.346 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.346 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.347 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733886 s, 143 MB/s 2024-09-11T22:22:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664566 s, 158 MB/s 2024-09-11T22:22:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686944 s, 153 MB/s 2024-09-11T22:22:14.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:14.372 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:14.372 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:14.372 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.28 2024-09-11T22:22:14.372 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:14.372 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:14.372 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:14.372 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687186 s, 153 MB/s 2024-09-11T22:22:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675452 s, 155 MB/s 2024-09-11T22:22:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738227 s, 142 MB/s 2024-09-11T22:22:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672575 s, 156 MB/s 2024-09-11T22:22:14.509 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.509 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.509 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744158 s, 141 MB/s 2024-09-11T22:22:14.518 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.518 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.518 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732835 s, 143 MB/s 2024-09-11T22:22:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747913 s, 140 MB/s 2024-09-11T22:22:14.536 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.536 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.536 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739329 s, 142 MB/s 2024-09-11T22:22:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072591 s, 144 MB/s 2024-09-11T22:22:14.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.554 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.554 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072294 s, 145 MB/s 2024-09-11T22:22:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007014 s, 149 MB/s 2024-09-11T22:22:14.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.572 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.572 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773629 s, 136 MB/s 2024-09-11T22:22:14.581 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744932 s, 141 MB/s 2024-09-11T22:22:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657142 s, 160 MB/s 2024-09-11T22:22:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072727 s, 144 MB/s 2024-09-11T22:22:14.608 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.608 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.608 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076815 s, 137 MB/s 2024-09-11T22:22:14.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.618 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.618 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752187 s, 139 MB/s 2024-09-11T22:22:14.627 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.627 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.627 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754261 s, 139 MB/s 2024-09-11T22:22:14.635 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679153 s, 154 MB/s 2024-09-11T22:22:14.645 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.645 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.645 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740749 s, 142 MB/s 2024-09-11T22:22:14.654 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.654 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.654 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759628 s, 138 MB/s 2024-09-11T22:22:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740558 s, 142 MB/s 2024-09-11T22:22:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714511 s, 147 MB/s 2024-09-11T22:22:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742717 s, 141 MB/s 2024-09-11T22:22:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684915 s, 153 MB/s 2024-09-11T22:22:14.699 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796175 s, 132 MB/s 2024-09-11T22:22:14.708 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.708 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.709 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636909 s, 165 MB/s 2024-09-11T22:22:14.717 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.717 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.717 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743468 s, 141 MB/s 2024-09-11T22:22:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677176 s, 155 MB/s 2024-09-11T22:22:14.734 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.734 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.734 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663907 s, 158 MB/s 2024-09-11T22:22:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674486 s, 155 MB/s 2024-09-11T22:22:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733792 s, 143 MB/s 2024-09-11T22:22:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:14.759 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:14.759 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:14.759 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.29 2024-09-11T22:22:14.760 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:14.760 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:14.760 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:14.760 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:14.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731858 s, 143 MB/s 2024-09-11T22:22:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661197 s, 159 MB/s 2024-09-11T22:22:14.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.838 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.839 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733875 s, 143 MB/s 2024-09-11T22:22:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862054 s, 122 MB/s 2024-09-11T22:22:14.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.859 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.859 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870163 s, 121 MB/s 2024-09-11T22:22:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745266 s, 141 MB/s 2024-09-11T22:22:14.877 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.877 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.877 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703808 s, 149 MB/s 2024-09-11T22:22:14.886 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.886 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.886 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682794 s, 154 MB/s 2024-09-11T22:22:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745017 s, 141 MB/s 2024-09-11T22:22:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740579 s, 142 MB/s 2024-09-11T22:22:14.913 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.913 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727631 s, 144 MB/s 2024-09-11T22:22:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673522 s, 156 MB/s 2024-09-11T22:22:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716589 s, 146 MB/s 2024-09-11T22:22:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713449 s, 147 MB/s 2024-09-11T22:22:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646505 s, 162 MB/s 2024-09-11T22:22:14.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.957 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.957 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744851 s, 141 MB/s 2024-09-11T22:22:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730754 s, 143 MB/s 2024-09-11T22:22:14.974 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.974 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.974 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693241 s, 151 MB/s 2024-09-11T22:22:14.982 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647209 s, 162 MB/s 2024-09-11T22:22:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715663 s, 147 MB/s 2024-09-11T22:22:15.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.000 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.000 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712748 s, 147 MB/s 2024-09-11T22:22:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733877 s, 143 MB/s 2024-09-11T22:22:15.018 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.019 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.019 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713034 s, 147 MB/s 2024-09-11T22:22:15.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.027 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.027 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722995 s, 145 MB/s 2024-09-11T22:22:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718908 s, 146 MB/s 2024-09-11T22:22:15.044 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.044 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.044 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666088 s, 157 MB/s 2024-09-11T22:22:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.053 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.054 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070451 s, 149 MB/s 2024-09-11T22:22:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084304 s, 124 MB/s 2024-09-11T22:22:15.072 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.072 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.072 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667638 s, 157 MB/s 2024-09-11T22:22:15.081 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.081 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.081 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683865 s, 153 MB/s 2024-09-11T22:22:15.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.090 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.090 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703891 s, 149 MB/s 2024-09-11T22:22:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651687 s, 161 MB/s 2024-09-11T22:22:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:15.105 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:15.105 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:15.105 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.30 2024-09-11T22:22:15.105 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:15.105 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:15.105 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:15.105 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:15.166 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.166 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.166 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692963 s, 151 MB/s 2024-09-11T22:22:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747714 s, 140 MB/s 2024-09-11T22:22:15.184 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.184 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.184 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718417 s, 146 MB/s 2024-09-11T22:22:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680372 s, 154 MB/s 2024-09-11T22:22:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675205 s, 155 MB/s 2024-09-11T22:22:15.209 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.209 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.209 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633706 s, 165 MB/s 2024-09-11T22:22:15.218 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.218 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.218 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708763 s, 148 MB/s 2024-09-11T22:22:15.227 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.227 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.227 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650206 s, 161 MB/s 2024-09-11T22:22:15.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.236 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.236 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071268 s, 147 MB/s 2024-09-11T22:22:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669195 s, 157 MB/s 2024-09-11T22:22:15.252 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.253 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.253 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666268 s, 157 MB/s 2024-09-11T22:22:15.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.262 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.262 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768896 s, 136 MB/s 2024-09-11T22:22:15.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.271 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.271 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754739 s, 139 MB/s 2024-09-11T22:22:15.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.280 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.280 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718066 s, 146 MB/s 2024-09-11T22:22:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709047 s, 148 MB/s 2024-09-11T22:22:15.299 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.299 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.299 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741887 s, 141 MB/s 2024-09-11T22:22:15.307 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.308 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.308 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711732 s, 147 MB/s 2024-09-11T22:22:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708901 s, 148 MB/s 2024-09-11T22:22:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722933 s, 145 MB/s 2024-09-11T22:22:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722942 s, 145 MB/s 2024-09-11T22:22:15.343 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.344 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.344 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749863 s, 140 MB/s 2024-09-11T22:22:15.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.353 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.353 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732293 s, 143 MB/s 2024-09-11T22:22:15.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.362 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.362 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686739 s, 153 MB/s 2024-09-11T22:22:15.370 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.370 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.370 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689954 s, 152 MB/s 2024-09-11T22:22:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880005 s, 119 MB/s 2024-09-11T22:22:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741225 s, 141 MB/s 2024-09-11T22:22:15.399 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.399 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.399 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743272 s, 141 MB/s 2024-09-11T22:22:15.408 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.408 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.408 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721521 s, 145 MB/s 2024-09-11T22:22:15.417 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.417 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.417 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715191 s, 147 MB/s 2024-09-11T22:22:15.425 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.426 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.426 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715233 s, 147 MB/s 2024-09-11T22:22:15.435 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.435 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.435 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760871 s, 138 MB/s 2024-09-11T22:22:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720205 s, 146 MB/s 2024-09-11T22:22:15.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:15.451 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-11T22:22:15.451 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:15.451 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p scrub_control_test_path/dir.31 2024-09-11T22:22:15.451 DEBUG:teuthology.orchestra.run.smithi050:> for ((i = 0; i < 32; i++)); do 2024-09-11T22:22:15.451 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-11T22:22:15.451 DEBUG:teuthology.orchestra.run.smithi050:> done 2024-09-11T22:22:15.451 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:15.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:15.511 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.511 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.511 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688442 s, 152 MB/s 2024-09-11T22:22:15.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.520 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747852 s, 140 MB/s 2024-09-11T22:22:15.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.529 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.529 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685909 s, 153 MB/s 2024-09-11T22:22:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.538 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.538 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722013 s, 145 MB/s 2024-09-11T22:22:15.547 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.547 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.547 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753236 s, 139 MB/s 2024-09-11T22:22:15.555 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.556 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.556 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070007 s, 150 MB/s 2024-09-11T22:22:15.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.565 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.565 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739556 s, 142 MB/s 2024-09-11T22:22:15.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.573 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.573 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649046 s, 162 MB/s 2024-09-11T22:22:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.582 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714719 s, 147 MB/s 2024-09-11T22:22:15.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.591 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.591 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750979 s, 140 MB/s 2024-09-11T22:22:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.600 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069125 s, 152 MB/s 2024-09-11T22:22:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.609 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074082 s, 142 MB/s 2024-09-11T22:22:15.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.617 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.617 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651453 s, 161 MB/s 2024-09-11T22:22:15.625 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.626 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.626 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652658 s, 161 MB/s 2024-09-11T22:22:15.634 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.634 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694201 s, 151 MB/s 2024-09-11T22:22:15.643 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.644 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.644 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722378 s, 145 MB/s 2024-09-11T22:22:15.652 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.652 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.652 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693672 s, 151 MB/s 2024-09-11T22:22:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729721 s, 144 MB/s 2024-09-11T22:22:15.670 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.670 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.670 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675832 s, 155 MB/s 2024-09-11T22:22:15.678 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689399 s, 152 MB/s 2024-09-11T22:22:15.687 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.687 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.687 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659158 s, 159 MB/s 2024-09-11T22:22:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641199 s, 164 MB/s 2024-09-11T22:22:15.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.703 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.703 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661755 s, 158 MB/s 2024-09-11T22:22:15.712 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.712 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.712 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069739 s, 150 MB/s 2024-09-11T22:22:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652741 s, 161 MB/s 2024-09-11T22:22:15.729 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.729 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.729 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692631 s, 151 MB/s 2024-09-11T22:22:15.738 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.738 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.738 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740963 s, 142 MB/s 2024-09-11T22:22:15.747 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.747 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.747 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749715 s, 140 MB/s 2024-09-11T22:22:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730096 s, 144 MB/s 2024-09-11T22:22:15.765 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.765 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.765 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699016 s, 150 MB/s 2024-09-11T22:22:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658631 s, 159 MB/s 2024-09-11T22:22:15.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-11T22:22:15.783 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-11T22:22:15.783 INFO:teuthology.orchestra.run.smithi050.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770553 s, 136 MB/s 2024-09-11T22:22:15.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:15.790 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-09-11T22:22:15.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.893+0000 7f52f7c5c640 1 Processor -- start 2024-09-11T22:22:15.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.893+0000 7f52f7c5c640 1 -- start start 2024-09-11T22:22:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.894+0000 7f52f7c5c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f00b5440 0x7f52f00b5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.894+0000 7f52f7c5c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f006ebd0 con 0x7f52f0072cb0 2024-09-11T22:22:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.894+0000 7f52f7c5c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f00b5d60 con 0x7f52f00b3990 2024-09-11T22:22:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.894+0000 7f52f7c5c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52f006f7a0 con 0x7f52f00b5440 2024-09-11T22:22:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.894+0000 7f52f51f7640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f52f0072cb0 0x7f52f015fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56036/0 (socket says 172.21.15.50:56036) 2024-09-11T22:22:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.894+0000 7f52f51f7640 1 -- 172.21.15.50:0/2599913279 learned_addr learned my addr 172.21.15.50:0/2599913279 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:15.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f59f8640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f00b5440 0x7f52f00b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1423299188 0 0) 0x7f52f006ebd0 con 0x7f52f0072cb0 2024-09-11T22:22:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52d8003520 con 0x7f52f0072cb0 2024-09-11T22:22:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 524489997 0 0) 0x7f52f00b5d60 con 0x7f52f00b3990 2024-09-11T22:22:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52f006ebd0 con 0x7f52f00b3990 2024-09-11T22:22:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2392676058 0 0) 0x7f52d8003520 con 0x7f52f0072cb0 2024-09-11T22:22:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f00b5440 msgr2=0x7f52f00b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f00b5440 0x7f52f00b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 >> v1:172.21.15.77:6789/0 conn(0x7f52f00b3990 legacy=0x7f52f00b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f0160120 con 0x7f52f0072cb0 2024-09-11T22:22:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f52e4001670 con 0x7f52f0072cb0 2024-09-11T22:22:15.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 >> v1:172.21.15.50:6789/0 conn(0x7f52f0072cb0 legacy=0x7f52f015fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52d8003b70 0x7f52d8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d8004800 0x7f52d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d80051c0 0x7f52d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f52f006f7a0 con 0x7f52d80051c0 2024-09-11T22:22:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52d800bfe0 con 0x7f52d8004800 2024-09-11T22:22:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52d800c1e0 con 0x7f52d8003b70 2024-09-11T22:22:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f59f8640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f00b5440 0x7f52f00b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f61f9640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d80051c0 0x7f52d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f51f7640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d8004800 0x7f52d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.895+0000 7f52f59f8640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52d8003b70 0x7f52d8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.896+0000 7f52f61f9640 1 -- 172.21.15.50:0/2599913279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52d8003b70 msgr2=0x7f52d8003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:15.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.896+0000 7f52f61f9640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52d8003b70 0x7f52d8003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.896+0000 7f52f61f9640 1 -- 172.21.15.50:0/2599913279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d8004800 msgr2=0x7f52d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.896+0000 7f52f61f9640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d8004800 0x7f52d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.896+0000 7f52f61f9640 1 -- 172.21.15.50:0/2599913279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d8003520 con 0x7f52d80051c0 2024-09-11T22:22:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.896+0000 7f52f51f7640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d8004800 0x7f52d8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.896+0000 7f52f61f9640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d80051c0 0x7f52d800b9c0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f52e0001fa0 tx=0x7f52d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34eedd12082cd6cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.896+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e0001bf0 con 0x7f52d80051c0 2024-09-11T22:22:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.896+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e0003b70 con 0x7f52d80051c0 2024-09-11T22:22:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.896+0000 7f52f49f6640 1 -- 172.21.15.50:0/2599913279 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e00050d0 con 0x7f52d80051c0 2024-09-11T22:22:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.897+0000 7f52f7c5c640 1 -- 172.21.15.50:0/2599913279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d80051c0 msgr2=0x7f52d800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.897+0000 7f52f7c5c640 1 --2- 172.21.15.50:0/2599913279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52d80051c0 0x7f52d800b9c0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f52e0001fa0 tx=0x7f52d8005830 comp rx=0 tx=0).stop 2024-09-11T22:22:15.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.897+0000 7f52f61f9640 1 -- 172.21.15.50:0/2599913279 reap_dead start 2024-09-11T22:22:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.897+0000 7f52f7c5c640 1 -- 172.21.15.50:0/2599913279 shutdown_connections 2024-09-11T22:22:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.897+0000 7f52f7c5c640 1 -- 172.21.15.50:0/2599913279 >> 172.21.15.50:0/2599913279 conn(0x7f52f0068240 msgr2=0x7f52f00b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.897+0000 7f52f7c5c640 1 -- 172.21.15.50:0/2599913279 shutdown_connections 2024-09-11T22:22:15.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.897+0000 7f52f7c5c640 1 -- 172.21.15.50:0/2599913279 wait complete. 2024-09-11T22:22:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.898+0000 7f52f7c5c640 1 Processor -- start 2024-09-11T22:22:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.898+0000 7f52f7c5c640 1 -- start start 2024-09-11T22:22:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f7c5c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d80051c0 0x7f52f00ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f7c5c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f013db20 0x7f52f013c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f7c5c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f0139ca0 0x7f52f013f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f7c5c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f52f006f430 con 0x7f52f0139ca0 2024-09-11T22:22:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f7c5c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52f006f150 con 0x7f52d80051c0 2024-09-11T22:22:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f7c5c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52f01485f0 con 0x7f52f013db20 2024-09-11T22:22:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f61f9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f0139ca0 0x7f52f013f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f61f9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f0139ca0 0x7f52f013f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46592/0 (socket says 172.21.15.50:46592) 2024-09-11T22:22:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f61f9640 1 -- 172.21.15.50:0/696446949 learned_addr learned my addr 172.21.15.50:0/696446949 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f59f8640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d80051c0 0x7f52f00ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f51f7640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f013db20 0x7f52f013c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f61f9640 1 -- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f013db20 msgr2=0x7f52f013c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f61f9640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f013db20 0x7f52f013c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f61f9640 1 -- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d80051c0 msgr2=0x7f52f00ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f61f9640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d80051c0 0x7f52f00ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f61f9640 1 -- 172.21.15.50:0/696446949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f013dfb0 con 0x7f52f0139ca0 2024-09-11T22:22:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f59f8640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d80051c0 0x7f52f00ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.899+0000 7f52f51f7640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f013db20 0x7f52f013c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.900+0000 7f52f61f9640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f0139ca0 0x7f52f013f030 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f52e0033040 tx=0x7f52e0001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.900+0000 7f52ee7fc640 1 -- 172.21.15.50:0/696446949 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e4007ce0 con 0x7f52f0139ca0 2024-09-11T22:22:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.900+0000 7f52ee7fc640 1 -- 172.21.15.50:0/696446949 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e0043070 con 0x7f52f0139ca0 2024-09-11T22:22:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.900+0000 7f52f7c5c640 1 -- 172.21.15.50:0/696446949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f013e290 con 0x7f52f0139ca0 2024-09-11T22:22:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.900+0000 7f52ee7fc640 1 -- 172.21.15.50:0/696446949 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e0001bf0 con 0x7f52f0139ca0 2024-09-11T22:22:15.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.900+0000 7f52f7c5c640 1 -- 172.21.15.50:0/696446949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f013e850 con 0x7f52f0139ca0 2024-09-11T22:22:15.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.901+0000 7f52f7c5c640 1 -- 172.21.15.50:0/696446949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f006fc30 con 0x7f52f0139ca0 2024-09-11T22:22:15.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.901+0000 7f52ee7fc640 1 -- 172.21.15.50:0/696446949 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52e003a040 con 0x7f52f0139ca0 2024-09-11T22:22:15.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.902+0000 7f52ee7fc640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52dc06be30 0x7f52dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:15.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.902+0000 7f52ee7fc640 1 -- 172.21.15.50:0/696446949 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f52e00ab120 con 0x7f52f0139ca0 2024-09-11T22:22:15.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.902+0000 7f52f59f8640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52dc06be30 0x7f52dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:15.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.903+0000 7f52f59f8640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52dc06be30 0x7f52dc06e2f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f52f0148930 tx=0x7f52e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:15.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:15.906+0000 7f52ee7fc640 1 -- 172.21.15.50:0/696446949 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52e0079bf0 con 0x7f52f0139ca0 2024-09-11T22:22:16.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.118+0000 7f52f7c5c640 1 -- 172.21.15.50:0/696446949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f52f01e9150 con 0x7f52f0139ca0 2024-09-11T22:22:16.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.678+0000 7f52ee7fc640 1 -- 172.21.15.50:0/696446949 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v121) ==== 105+0+0 (secure 0 0 0) 0x7f52e00794f0 con 0x7f52f0139ca0 2024-09-11T22:22:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.681+0000 7f52f7c5c640 1 -- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52dc06be30 msgr2=0x7f52dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.681+0000 7f52f7c5c640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52dc06be30 0x7f52dc06e2f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f52f0148930 tx=0x7f52e8008040 comp rx=0 tx=0).stop 2024-09-11T22:22:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.681+0000 7f52f7c5c640 1 -- 172.21.15.50:0/696446949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f0139ca0 msgr2=0x7f52f013f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.681+0000 7f52f7c5c640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f0139ca0 0x7f52f013f030 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f52e0033040 tx=0x7f52e0001650 comp rx=0 tx=0).stop 2024-09-11T22:22:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.681+0000 7f52f7c5c640 1 -- 172.21.15.50:0/696446949 shutdown_connections 2024-09-11T22:22:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.681+0000 7f52f7c5c640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f52dc06be30 0x7f52dc06e2f0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.681+0000 7f52f7c5c640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f013db20 0x7f52f013c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.681+0000 7f52f7c5c640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52f0139ca0 0x7f52f013f030 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:16.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.681+0000 7f52f7c5c640 1 --2- 172.21.15.50:0/696446949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d80051c0 0x7f52f00ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:16.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.681+0000 7f52f7c5c640 1 -- 172.21.15.50:0/696446949 >> 172.21.15.50:0/696446949 conn(0x7f52f0068240 msgr2=0x7f52f01454c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:16.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.681+0000 7f52f7c5c640 1 -- 172.21.15.50:0/696446949 shutdown_connections 2024-09-11T22:22:16.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.681+0000 7f52f7c5c640 1 -- 172.21.15.50:0/696446949 wait complete. 2024-09-11T22:22:16.694 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-11T22:22:16.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.802+0000 7f8bbde27640 1 Processor -- start 2024-09-11T22:22:16.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.802+0000 7f8bbde27640 1 -- start start 2024-09-11T22:22:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.803+0000 7f8bbde27640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8bb80b1600 0x7f8bb80b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.803+0000 7f8bbde27640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb80cfbd0 con 0x7f8bb8161fa0 2024-09-11T22:22:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.803+0000 7f8bbde27640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb80cfeb0 con 0x7f8bb80cf610 2024-09-11T22:22:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.803+0000 7f8bbde27640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb80d1220 con 0x7f8bb80b1600 2024-09-11T22:22:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.803+0000 7f8bb7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8bb80b1600 0x7f8bb80b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.803+0000 7f8bb77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8bb8161fa0 0x7f8bb80cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56038/0 (socket says 172.21.15.50:56038) 2024-09-11T22:22:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.803+0000 7f8bb77fe640 1 -- 172.21.15.50:0/3774132047 learned_addr learned my addr 172.21.15.50:0/3774132047 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:16.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.803+0000 7f8bb7fff640 1 -- 172.21.15.50:0/3774132047 >> v1:172.21.15.77:6789/0 conn(0x7f8bb80cf610 legacy=0x7f8bb80cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:16.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.803+0000 7f8bb7fff640 1 -- 172.21.15.50:0/3774132047 >> v1:172.21.15.50:6789/0 conn(0x7f8bb8161fa0 legacy=0x7f8bb80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:16.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.803+0000 7f8bb7fff640 1 -- 172.21.15.50:0/3774132047 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb80d1470 con 0x7f8bb80b1600 2024-09-11T22:22:16.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.803+0000 7f8bb67fc640 1 -- 172.21.15.50:0/3774132047 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3746912577 0 0) 0x7f8bb80cfbd0 con 0x7f8bb8161fa0 2024-09-11T22:22:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.804+0000 7f8bb7fff640 1 --2- 172.21.15.50:0/3774132047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb80b1600 0x7f8bb80b4d20 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009d90 tx=0x7f8bb002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd34811b2f4cce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.804+0000 7f8bb67fc640 1 -- 172.21.15.50:0/3774132047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0007740 con 0x7f8bb80b1600 2024-09-11T22:22:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.804+0000 7f8bb67fc640 1 -- 172.21.15.50:0/3774132047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb00078e0 con 0x7f8bb80b1600 2024-09-11T22:22:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.804+0000 7f8bb67fc640 1 -- 172.21.15.50:0/3774132047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0007cb0 con 0x7f8bb80b1600 2024-09-11T22:22:16.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.805+0000 7f8bbde27640 1 -- 172.21.15.50:0/3774132047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb80b1600 msgr2=0x7f8bb80b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.805+0000 7f8bbde27640 1 --2- 172.21.15.50:0/3774132047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb80b1600 0x7f8bb80b4d20 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009d90 tx=0x7f8bb002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:22:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.805+0000 7f8bbde27640 1 -- 172.21.15.50:0/3774132047 shutdown_connections 2024-09-11T22:22:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.805+0000 7f8bbde27640 1 --2- 172.21.15.50:0/3774132047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb80b1600 0x7f8bb80b4d20 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.805+0000 7f8bbde27640 1 -- 172.21.15.50:0/3774132047 >> 172.21.15.50:0/3774132047 conn(0x7f8bb809ba50 msgr2=0x7f8bb80b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.805+0000 7f8bbde27640 1 -- 172.21.15.50:0/3774132047 shutdown_connections 2024-09-11T22:22:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.805+0000 7f8bbde27640 1 -- 172.21.15.50:0/3774132047 wait complete. 2024-09-11T22:22:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.806+0000 7f8bbde27640 1 Processor -- start 2024-09-11T22:22:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.806+0000 7f8bbde27640 1 -- start start 2024-09-11T22:22:16.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bbde27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb80b1600 0x7f8bb80b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bbde27640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bb80cf610 0x7f8bb8153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bbde27640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bb8161fa0 0x7f8bb8153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bbde27640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb80d1c70 con 0x7f8bb80b1600 2024-09-11T22:22:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bbde27640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb80d17e0 con 0x7f8bb8161fa0 2024-09-11T22:22:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bbde27640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb80d1df0 con 0x7f8bb80cf610 2024-09-11T22:22:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb80b1600 0x7f8bb80b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb80b1600 0x7f8bb80b6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46604/0 (socket says 172.21.15.50:46604) 2024-09-11T22:22:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bb77fe640 1 -- 172.21.15.50:0/243136640 learned_addr learned my addr 172.21.15.50:0/243136640 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bb7fff640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bb8161fa0 0x7f8bb8153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bb6ffd640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bb80cf610 0x7f8bb8153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bb77fe640 1 -- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bb80cf610 msgr2=0x7f8bb8153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:16.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bb77fe640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bb80cf610 0x7f8bb8153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bb77fe640 1 -- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bb8161fa0 msgr2=0x7f8bb8153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bb77fe640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bb8161fa0 0x7f8bb8153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bb77fe640 1 -- 172.21.15.50:0/243136640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb80b7520 con 0x7f8bb80b1600 2024-09-11T22:22:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.807+0000 7f8bb6ffd640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bb80cf610 0x7f8bb8153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.808+0000 7f8bb77fe640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb80b1600 0x7f8bb80b6bd0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800c4a0 tx=0x7f8ba800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.808+0000 7f8b9ffff640 1 -- 172.21.15.50:0/243136640 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8018070 con 0x7f8bb80b1600 2024-09-11T22:22:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.808+0000 7f8b9ffff640 1 -- 172.21.15.50:0/243136640 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba80074e0 con 0x7f8bb80b1600 2024-09-11T22:22:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.808+0000 7f8bbde27640 1 -- 172.21.15.50:0/243136640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb80b7800 con 0x7f8bb80b1600 2024-09-11T22:22:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.808+0000 7f8b9ffff640 1 -- 172.21.15.50:0/243136640 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8004a20 con 0x7f8bb80b1600 2024-09-11T22:22:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.808+0000 7f8bbde27640 1 -- 172.21.15.50:0/243136640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb80b7dc0 con 0x7f8bb80b1600 2024-09-11T22:22:16.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.809+0000 7f8bbde27640 1 -- 172.21.15.50:0/243136640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb80b0070 con 0x7f8bb80b1600 2024-09-11T22:22:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.809+0000 7f8b9ffff640 1 -- 172.21.15.50:0/243136640 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ba801b070 con 0x7f8bb80b1600 2024-09-11T22:22:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.810+0000 7f8b9ffff640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8ba406be30 0x7f8ba406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.810+0000 7f8b9ffff640 1 -- 172.21.15.50:0/243136640 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f8ba808a1d0 con 0x7f8bb80b1600 2024-09-11T22:22:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.810+0000 7f8bb6ffd640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8ba406be30 0x7f8ba406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:16.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.811+0000 7f8bb6ffd640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8ba406be30 0x7f8ba406e2f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80b0c70 tx=0x7f8bac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:16.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:16.814+0000 7f8b9ffff640 1 -- 172.21.15.50:0/243136640 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ba8058b80 con 0x7f8bb80b1600 2024-09-11T22:22:17.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.025+0000 7f8bbde27640 1 -- 172.21.15.50:0/243136640 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f8bb80b4d20 con 0x7f8bb80b1600 2024-09-11T22:22:17.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.688+0000 7f8b9ffff640 1 -- 172.21.15.50:0/243136640 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v122) ==== 121+0+0 (secure 0 0 0) 0x7f8ba8058480 con 0x7f8bb80b1600 2024-09-11T22:22:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.691+0000 7f8bbde27640 1 -- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8ba406be30 msgr2=0x7f8ba406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.691+0000 7f8bbde27640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8ba406be30 0x7f8ba406e2f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80b0c70 tx=0x7f8bac009040 comp rx=0 tx=0).stop 2024-09-11T22:22:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.691+0000 7f8bbde27640 1 -- 172.21.15.50:0/243136640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb80b1600 msgr2=0x7f8bb80b6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.691+0000 7f8bbde27640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb80b1600 0x7f8bb80b6bd0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800c4a0 tx=0x7f8ba800c960 comp rx=0 tx=0).stop 2024-09-11T22:22:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.691+0000 7f8bbde27640 1 -- 172.21.15.50:0/243136640 shutdown_connections 2024-09-11T22:22:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.691+0000 7f8bbde27640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8ba406be30 0x7f8ba406e2f0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.691+0000 7f8bbde27640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bb80cf610 0x7f8bb8153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.691+0000 7f8bbde27640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bb8161fa0 0x7f8bb8153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.691+0000 7f8bbde27640 1 --2- 172.21.15.50:0/243136640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb80b1600 0x7f8bb80b6bd0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.691+0000 7f8bbde27640 1 -- 172.21.15.50:0/243136640 >> 172.21.15.50:0/243136640 conn(0x7f8bb809ba50 msgr2=0x7f8bb806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.691+0000 7f8bbde27640 1 -- 172.21.15.50:0/243136640 shutdown_connections 2024-09-11T22:22:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.691+0000 7f8bbde27640 1 -- 172.21.15.50:0/243136640 wait complete. 2024-09-11T22:22:17.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:22:17.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.815+0000 7f99c4566640 1 Processor -- start 2024-09-11T22:22:17.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.815+0000 7f99c4566640 1 -- start start 2024-09-11T22:22:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.816+0000 7f99c4566640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99bc161fa0 0x7f99bc0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.816+0000 7f99c4566640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f99bc0b1600 0x7f99bc0cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.816+0000 7f99c4566640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99bc0cfbd0 con 0x7f99bc0cf440 2024-09-11T22:22:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.816+0000 7f99c4566640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f99bc0cdce0 con 0x7f99bc161fa0 2024-09-11T22:22:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.816+0000 7f99c4566640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f99bc0d1220 con 0x7f99bc0b1600 2024-09-11T22:22:17.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.816+0000 7f99c2b03640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f99bc0cf440 0x7f99bc06bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53730/0 (socket says 172.21.15.50:53730) 2024-09-11T22:22:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.816+0000 7f99c2302640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99bc161fa0 0x7f99bc0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.816+0000 7f99c2b03640 1 -- 172.21.15.50:0/4072363596 learned_addr learned my addr 172.21.15.50:0/4072363596 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.816+0000 7f99c1b01640 1 --2- 172.21.15.50:0/4072363596 >> v2:172.21.15.77:3300/0 conn(0x7f99bc0b1600 0x7f99bc0cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.816+0000 7f99c2302640 1 -- 172.21.15.50:0/4072363596 >> v2:172.21.15.77:3300/0 conn(0x7f99bc0b1600 msgr2=0x7f99bc0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.816+0000 7f99c2302640 1 --2- 172.21.15.50:0/4072363596 >> v2:172.21.15.77:3300/0 conn(0x7f99bc0b1600 0x7f99bc0cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.816+0000 7f99c2302640 1 -- 172.21.15.50:0/4072363596 >> v1:172.21.15.50:6789/0 conn(0x7f99bc0cf440 legacy=0x7f99bc06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.817+0000 7f99c1300640 1 -- 172.21.15.50:0/4072363596 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3689740790 0 0) 0x7f99bc0cfbd0 con 0x7f99bc0cf440 2024-09-11T22:22:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.817+0000 7f99c2302640 1 -- 172.21.15.50:0/4072363596 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99bc0cfeb0 con 0x7f99bc161fa0 2024-09-11T22:22:17.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.817+0000 7f99c2302640 1 --2- 172.21.15.50:0/4072363596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99bc161fa0 0x7f99bc0b4d20 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f99bc09c280 tx=0x7f99b802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71aed18f51c6bed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:17.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.817+0000 7f99c1300640 1 -- 172.21.15.50:0/4072363596 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8037070 con 0x7f99bc161fa0 2024-09-11T22:22:17.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.817+0000 7f99c1300640 1 -- 172.21.15.50:0/4072363596 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b8032440 con 0x7f99bc161fa0 2024-09-11T22:22:17.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.817+0000 7f99c1300640 1 -- 172.21.15.50:0/4072363596 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8032810 con 0x7f99bc161fa0 2024-09-11T22:22:17.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.818+0000 7f99c4566640 1 -- 172.21.15.50:0/4072363596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99bc161fa0 msgr2=0x7f99bc0b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:17.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.818+0000 7f99c4566640 1 --2- 172.21.15.50:0/4072363596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99bc161fa0 0x7f99bc0b4d20 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f99bc09c280 tx=0x7f99b802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:22:17.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.818+0000 7f99c4566640 1 -- 172.21.15.50:0/4072363596 shutdown_connections 2024-09-11T22:22:17.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.818+0000 7f99c4566640 1 --2- 172.21.15.50:0/4072363596 >> v2:172.21.15.77:3300/0 conn(0x7f99bc0b1600 0x7f99bc0cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:17.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.818+0000 7f99c4566640 1 --2- 172.21.15.50:0/4072363596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99bc161fa0 0x7f99bc0b4d20 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:17.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.818+0000 7f99c4566640 1 -- 172.21.15.50:0/4072363596 >> 172.21.15.50:0/4072363596 conn(0x7f99bc09ba50 msgr2=0x7f99bc0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:17.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.818+0000 7f99c4566640 1 -- 172.21.15.50:0/4072363596 shutdown_connections 2024-09-11T22:22:17.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.818+0000 7f99c4566640 1 -- 172.21.15.50:0/4072363596 wait complete. 2024-09-11T22:22:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.819+0000 7f99c4566640 1 Processor -- start 2024-09-11T22:22:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.819+0000 7f99c4566640 1 -- start start 2024-09-11T22:22:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c4566640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99bc0b1600 0x7f99bc0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c4566640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99bc0cf440 0x7f99bc0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c4566640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99bc161fa0 0x7f99bc0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c4566640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc0cf870 con 0x7f99bc0cf440 2024-09-11T22:22:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c4566640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc0d17e0 con 0x7f99bc161fa0 2024-09-11T22:22:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c4566640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f99bc162380 con 0x7f99bc0b1600 2024-09-11T22:22:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c1b01640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99bc0cf440 0x7f99bc0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c1b01640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99bc0cf440 0x7f99bc0b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36152/0 (socket says 172.21.15.50:36152) 2024-09-11T22:22:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c1b01640 1 -- 172.21.15.50:0/3783150808 learned_addr learned my addr 172.21.15.50:0/3783150808 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c2b03640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99bc161fa0 0x7f99bc0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c2302640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99bc0b1600 0x7f99bc0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c1b01640 1 -- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99bc0b1600 msgr2=0x7f99bc0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c1b01640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99bc0b1600 0x7f99bc0b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c1b01640 1 -- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99bc161fa0 msgr2=0x7f99bc0b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c1b01640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99bc161fa0 0x7f99bc0b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.820+0000 7f99c1b01640 1 -- 172.21.15.50:0/3783150808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99bc0b2890 con 0x7f99bc0cf440 2024-09-11T22:22:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.821+0000 7f99c2302640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99bc0b1600 0x7f99bc0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.821+0000 7f99c2b03640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99bc161fa0 0x7f99bc0b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.821+0000 7f99c1b01640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99bc0cf440 0x7f99bc0b2040 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00d800 tx=0x7f99ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.821+0000 7f99b2ffd640 1 -- 172.21.15.50:0/3783150808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00b660 con 0x7f99bc0cf440 2024-09-11T22:22:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.821+0000 7f99b2ffd640 1 -- 172.21.15.50:0/3783150808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ac019070 con 0x7f99bc0cf440 2024-09-11T22:22:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.821+0000 7f99b2ffd640 1 -- 172.21.15.50:0/3783150808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00ba20 con 0x7f99bc0cf440 2024-09-11T22:22:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.821+0000 7f99c4566640 1 -- 172.21.15.50:0/3783150808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99bc0b2b70 con 0x7f99bc0cf440 2024-09-11T22:22:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.821+0000 7f99c4566640 1 -- 172.21.15.50:0/3783150808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99bc0cb490 con 0x7f99bc0cf440 2024-09-11T22:22:17.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.822+0000 7f99c4566640 1 -- 172.21.15.50:0/3783150808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99bc0d1c50 con 0x7f99bc0cf440 2024-09-11T22:22:17.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.822+0000 7f99b2ffd640 1 -- 172.21.15.50:0/3783150808 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99ac00bbc0 con 0x7f99bc0cf440 2024-09-11T22:22:17.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.823+0000 7f99b2ffd640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f99a006be30 0x7f99a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:17.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.823+0000 7f99b2ffd640 1 -- 172.21.15.50:0/3783150808 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f99ac08b2f0 con 0x7f99bc0cf440 2024-09-11T22:22:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.823+0000 7f99c2302640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f99a006be30 0x7f99a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.824+0000 7f99c2302640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f99a006be30 0x7f99a006e2f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f99b8034000 tx=0x7f99b802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:17.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:17.827+0000 7f99b2ffd640 1 -- 172.21.15.50:0/3783150808 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99ac01c360 con 0x7f99bc0cf440 2024-09-11T22:22:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.038+0000 7f99c4566640 1 -- 172.21.15.50:0/3783150808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99bc070c40 con 0x7f99bc0cf440 2024-09-11T22:22:18.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.039+0000 7f99b2ffd640 1 -- 172.21.15.50:0/3783150808 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5236 (secure 0 0 0) 0x7f99ac059ca0 con 0x7f99bc0cf440 2024-09-11T22:22:18.040 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:18.040 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":123,"btime":"2024-09-11T22:22:17:691701+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/521086958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":521086958},{"type":"v1","addr":"172.21.15.77:6835","nonce":521086958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9891,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2783375669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2783375669},{"type":"v1","addr":"172.21.15.50:6833","nonce":2783375669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":123,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:21:53.868957+0000","modified":"2024-09-11T22:22:17.691684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9900":{"gid":9900,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2009878103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2009878103},{"type":"v1","addr":"172.21.15.50:6835","nonce":2009878103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9915":{"gid":9915,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2937331670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2937331670},{"type":"v1","addr":"172.21.15.77:6837","nonce":2937331670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9915,"qdb_cluster":[9915]},"id":12}]} 2024-09-11T22:22:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 123 2024-09-11T22:22:18.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.041+0000 7f99c4566640 1 -- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f99a006be30 msgr2=0x7f99a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.041+0000 7f99c4566640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f99a006be30 0x7f99a006e2f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f99b8034000 tx=0x7f99b802e000 comp rx=0 tx=0).stop 2024-09-11T22:22:18.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.041+0000 7f99c4566640 1 -- 172.21.15.50:0/3783150808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99bc0cf440 msgr2=0x7f99bc0b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.041+0000 7f99c4566640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99bc0cf440 0x7f99bc0b2040 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00d800 tx=0x7f99ac00dcc0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.041+0000 7f99c4566640 1 -- 172.21.15.50:0/3783150808 shutdown_connections 2024-09-11T22:22:18.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.041+0000 7f99c4566640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f99a006be30 0x7f99a006e2f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.041+0000 7f99c4566640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99bc161fa0 0x7f99bc0b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.041+0000 7f99c4566640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99bc0cf440 0x7f99bc0b2040 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.041+0000 7f99c4566640 1 --2- 172.21.15.50:0/3783150808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99bc0b1600 0x7f99bc0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.041+0000 7f99c4566640 1 -- 172.21.15.50:0/3783150808 >> 172.21.15.50:0/3783150808 conn(0x7f99bc09ba50 msgr2=0x7f99bc070020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.041+0000 7f99c4566640 1 -- 172.21.15.50:0/3783150808 shutdown_connections 2024-09-11T22:22:18.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.041+0000 7f99c4566640 1 -- 172.21.15.50:0/3783150808 wait complete. 2024-09-11T22:22:18.456 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 123, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T22:21:53.868957+0000', 'modified': '2024-09-11T22:22:17.691684+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9915}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9900': {'gid': 9900, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.50:6835/2009878103', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 2009878103}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 2009878103}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_9915': {'gid': 9915, 'name': 'b', 'rank': 0, 'incarnation': 118, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6837/2937331670', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6836', 'nonce': 2937331670}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 2937331670}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9915, 'qdb_cluster': [9915]} 2024-09-11T22:22:18.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:22:18.457 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T22:22:18.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.567+0000 7f8f06f9a640 1 Processor -- start 2024-09-11T22:22:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.567+0000 7f8f06f9a640 1 -- start start 2024-09-11T22:22:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8f06f9a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f000d1c90 0x7f8f000b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8f06f9a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f00163080 con 0x7f8f00162350 2024-09-11T22:22:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8f06f9a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f000d2d20 con 0x7f8f0015e8e0 2024-09-11T22:22:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8f06f9a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8f0015ecc0 con 0x7f8f000d1c90 2024-09-11T22:22:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8f05537640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8f00162350 0x7f8f001627e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53746/0 (socket says 172.21.15.50:53746) 2024-09-11T22:22:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8f05537640 1 -- 172.21.15.50:0/2859675467 learned_addr learned my addr 172.21.15.50:0/2859675467 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8efffff640 1 --2- 172.21.15.50:0/2859675467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f000d1c90 0x7f8f000b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8eff7fe640 1 -- 172.21.15.50:0/2859675467 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716718091 0 0) 0x7f8f00163080 con 0x7f8f00162350 2024-09-11T22:22:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8eff7fe640 1 -- 172.21.15.50:0/2859675467 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ef0003520 con 0x7f8f00162350 2024-09-11T22:22:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8eff7fe640 1 -- 172.21.15.50:0/2859675467 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970531173 0 0) 0x7f8f000d2d20 con 0x7f8f0015e8e0 2024-09-11T22:22:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8eff7fe640 1 -- 172.21.15.50:0/2859675467 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f00163080 con 0x7f8f0015e8e0 2024-09-11T22:22:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8eff7fe640 1 -- 172.21.15.50:0/2859675467 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3991027596 0 0) 0x7f8ef0003520 con 0x7f8f00162350 2024-09-11T22:22:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8efffff640 1 -- 172.21.15.50:0/2859675467 >> v1:172.21.15.77:6789/0 conn(0x7f8f0015e8e0 legacy=0x7f8f000d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8efffff640 1 -- 172.21.15.50:0/2859675467 >> v1:172.21.15.50:6789/0 conn(0x7f8f00162350 legacy=0x7f8f001627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.568+0000 7f8efffff640 1 -- 172.21.15.50:0/2859675467 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f000d3000 con 0x7f8f000d1c90 2024-09-11T22:22:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.569+0000 7f8efffff640 1 --2- 172.21.15.50:0/2859675467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f000d1c90 0x7f8f000b7880 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0097d0 tx=0x7f8eec02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=881a07092921fac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.569+0000 7f8eff7fe640 1 -- 172.21.15.50:0/2859675467 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec037070 con 0x7f8f000d1c90 2024-09-11T22:22:18.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.569+0000 7f8eff7fe640 1 -- 172.21.15.50:0/2859675467 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eec02acc0 con 0x7f8f000d1c90 2024-09-11T22:22:18.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.569+0000 7f8eff7fe640 1 -- 172.21.15.50:0/2859675467 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8001970 con 0x7f8f000d1c90 2024-09-11T22:22:18.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.570+0000 7f8f06f9a640 1 -- 172.21.15.50:0/2859675467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f000d1c90 msgr2=0x7f8f000b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.570+0000 7f8f06f9a640 1 --2- 172.21.15.50:0/2859675467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f000d1c90 0x7f8f000b7880 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0097d0 tx=0x7f8eec02a230 comp rx=0 tx=0).stop 2024-09-11T22:22:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.570+0000 7f8f06f9a640 1 -- 172.21.15.50:0/2859675467 shutdown_connections 2024-09-11T22:22:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.570+0000 7f8f06f9a640 1 --2- 172.21.15.50:0/2859675467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f000d1c90 0x7f8f000b7880 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.570+0000 7f8f06f9a640 1 -- 172.21.15.50:0/2859675467 >> 172.21.15.50:0/2859675467 conn(0x7f8f00067ba0 msgr2=0x7f8f00067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.570+0000 7f8f06f9a640 1 -- 172.21.15.50:0/2859675467 shutdown_connections 2024-09-11T22:22:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.570+0000 7f8f06f9a640 1 -- 172.21.15.50:0/2859675467 wait complete. 2024-09-11T22:22:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.571+0000 7f8f06f9a640 1 Processor -- start 2024-09-11T22:22:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.571+0000 7f8f06f9a640 1 -- start start 2024-09-11T22:22:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.572+0000 7f8f06f9a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f000d1c90 0x7f8f000abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.572+0000 7f8f06f9a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0015e8e0 0x7f8f0015bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.572+0000 7f8f06f9a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f00162350 0x7f8f0015d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.572+0000 7f8f06f9a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f000d3b90 con 0x7f8f0015e8e0 2024-09-11T22:22:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.572+0000 7f8f06f9a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8f000d3a10 con 0x7f8f00162350 2024-09-11T22:22:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.572+0000 7f8f06f9a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8f000d3d10 con 0x7f8f000d1c90 2024-09-11T22:22:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.572+0000 7f8efffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0015e8e0 0x7f8f0015bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.572+0000 7f8efffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0015e8e0 0x7f8f0015bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36154/0 (socket says 172.21.15.50:36154) 2024-09-11T22:22:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.572+0000 7f8efffff640 1 -- 172.21.15.50:0/3692757539 learned_addr learned my addr 172.21.15.50:0/3692757539 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.572+0000 7f8f04d36640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f000d1c90 0x7f8f000abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.572+0000 7f8f05537640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f00162350 0x7f8f0015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.573+0000 7f8efffff640 1 -- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f000d1c90 msgr2=0x7f8f000abc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.573+0000 7f8efffff640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f000d1c90 0x7f8f000abc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.573+0000 7f8efffff640 1 -- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f00162350 msgr2=0x7f8f0015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.573+0000 7f8efffff640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f00162350 0x7f8f0015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.573+0000 7f8efffff640 1 -- 172.21.15.50:0/3692757539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0015c450 con 0x7f8f0015e8e0 2024-09-11T22:22:18.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.573+0000 7f8efffff640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0015e8e0 0x7f8f0015bf10 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0097d0 tx=0x7f8eec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.573+0000 7f8efd7fa640 1 -- 172.21.15.50:0/3692757539 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec037050 con 0x7f8f0015e8e0 2024-09-11T22:22:18.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.573+0000 7f8efd7fa640 1 -- 172.21.15.50:0/3692757539 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eec038040 con 0x7f8f0015e8e0 2024-09-11T22:22:18.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.573+0000 7f8f06f9a640 1 -- 172.21.15.50:0/3692757539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f000ad060 con 0x7f8f0015e8e0 2024-09-11T22:22:18.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.573+0000 7f8efd7fa640 1 -- 172.21.15.50:0/3692757539 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec006e10 con 0x7f8f0015e8e0 2024-09-11T22:22:18.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.573+0000 7f8f06f9a640 1 -- 172.21.15.50:0/3692757539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f000ac6c0 con 0x7f8f0015e8e0 2024-09-11T22:22:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.575+0000 7f8efd7fa640 1 -- 172.21.15.50:0/3692757539 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8eec045020 con 0x7f8f0015e8e0 2024-09-11T22:22:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.575+0000 7f8efd7fa640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8ee406be30 0x7f8ee406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.575+0000 7f8efd7fa640 1 -- 172.21.15.50:0/3692757539 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f8eec0aae60 con 0x7f8f0015e8e0 2024-09-11T22:22:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.575+0000 7f8f04d36640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8ee406be30 0x7f8ee406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.576+0000 7f8f04d36640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8ee406be30 0x7f8ee406e2f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40010e0 tx=0x7f8ef4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.576+0000 7f8f09e0e740 1 Processor -- start 2024-09-11T22:22:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.576+0000 7f8f09e0e740 1 -- start start 2024-09-11T22:22:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f09e0e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4692c0 0x55e14b4aea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f09e0e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b466a80 0x55e14b4696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f09e0e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 0x55e14b4638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f09e0e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e14b3cb520 con 0x55e14b4692c0 2024-09-11T22:22:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f09e0e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e14b3733e0 con 0x55e14b466a80 2024-09-11T22:22:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f09e0e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e14b3c74e0 con 0x55e14b46aa50 2024-09-11T22:22:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f04d36640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4692c0 0x55e14b4aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f04d36640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4692c0 0x55e14b4aea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36168/0 (socket says 172.21.15.50:36168) 2024-09-11T22:22:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f04d36640 1 -- 172.21.15.50:0/367090024 learned_addr learned my addr 172.21.15.50:0/367090024 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8efffff640 1 --2- 172.21.15.50:0/367090024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b466a80 0x55e14b4696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f05537640 1 --2- 172.21.15.50:0/367090024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 0x55e14b4638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f04d36640 1 -- 172.21.15.50:0/367090024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 msgr2=0x55e14b4638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f04d36640 1 --2- 172.21.15.50:0/367090024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 0x55e14b4638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f04d36640 1 -- 172.21.15.50:0/367090024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b466a80 msgr2=0x55e14b4696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f04d36640 1 --2- 172.21.15.50:0/367090024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b466a80 0x55e14b4696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f04d36640 1 -- 172.21.15.50:0/367090024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e14b38e2f0 con 0x55e14b4692c0 2024-09-11T22:22:18.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f05537640 1 --2- 172.21.15.50:0/367090024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 0x55e14b4638b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:18.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.577+0000 7f8f04d36640 1 --2- 172.21.15.50:0/367090024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4692c0 0x55e14b4aea60 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4005130 tx=0x7f8ef4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e34f47e3491ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.578+0000 7f8eea7fc640 1 -- 172.21.15.50:0/367090024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40035f0 con 0x55e14b4692c0 2024-09-11T22:22:18.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.578+0000 7f8eea7fc640 1 -- 172.21.15.50:0/367090024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef4003790 con 0x55e14b4692c0 2024-09-11T22:22:18.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.578+0000 7f8eea7fc640 1 -- 172.21.15.50:0/367090024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4003b40 con 0x55e14b4692c0 2024-09-11T22:22:18.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.578+0000 7f8f09e0e740 1 -- 172.21.15.50:0/367090024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4692c0 msgr2=0x55e14b4aea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.578+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/367090024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4692c0 0x55e14b4aea60 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4005130 tx=0x7f8ef4011000 comp rx=0 tx=0).stop 2024-09-11T22:22:18.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.578+0000 7f8f09e0e740 1 -- 172.21.15.50:0/367090024 shutdown_connections 2024-09-11T22:22:18.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.578+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/367090024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 0x55e14b4638b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.578+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/367090024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b466a80 0x55e14b4696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.578+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/367090024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4692c0 0x55e14b4aea60 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.578+0000 7f8f09e0e740 1 -- 172.21.15.50:0/367090024 >> 172.21.15.50:0/367090024 conn(0x55e14b465a80 msgr2=0x55e14b4adf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.578+0000 7f8f09e0e740 1 -- 172.21.15.50:0/367090024 shutdown_connections 2024-09-11T22:22:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.578+0000 7f8f09e0e740 1 -- 172.21.15.50:0/367090024 wait complete. 2024-09-11T22:22:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.579+0000 7f8f09e0e740 1 -- start start 2024-09-11T22:22:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.579+0000 7f8f09e0e740 1 Processor -- start 2024-09-11T22:22:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.580+0000 7f8f09e0e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b4692c0 0x55e14b4892b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.580+0000 7f8f09e0e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b46aa50 0x55e14b4bbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.580+0000 7f8f09e0e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b4bec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.580+0000 7f8f09e0e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e14b464f20 con 0x55e14b4be7e0 2024-09-11T22:22:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.580+0000 7f8f09e0e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e14b354450 con 0x55e14b46aa50 2024-09-11T22:22:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.580+0000 7f8f09e0e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e14b4af290 con 0x55e14b4692c0 2024-09-11T22:22:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.580+0000 7f8f09e0e740 10 client.0 _ll_register_callbacks cb 0x55e14b0ddac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.580+0000 7f8f05537640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b4bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.580+0000 7f8f04d36640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b4692c0 0x55e14b4892b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.580+0000 7f8f04d36640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b4692c0 0x55e14b4892b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:57938/0 (socket says 172.21.15.50:57938) 2024-09-11T22:22:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.580+0000 7f8f05537640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b4bec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36176/0 (socket says 172.21.15.50:36176) 2024-09-11T22:22:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.580+0000 7f8f04d36640 1 -- 172.21.15.50:0/1938130675 learned_addr learned my addr 172.21.15.50:0/1938130675 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.580+0000 7f8efffff640 1 --2- 172.21.15.50:0/1938130675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b46aa50 0x55e14b4bbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f05537640 1 -- 172.21.15.50:0/1938130675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b4692c0 msgr2=0x55e14b4892b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f05537640 1 --2- 172.21.15.50:0/1938130675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b4692c0 0x55e14b4892b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f05537640 1 -- 172.21.15.50:0/1938130675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b46aa50 msgr2=0x55e14b4bbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f05537640 1 --2- 172.21.15.50:0/1938130675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b46aa50 0x55e14b4bbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f05537640 1 -- 172.21.15.50:0/1938130675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e14b0de2d0 con 0x55e14b4be7e0 2024-09-11T22:22:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f05537640 1 --2- 172.21.15.50:0/1938130675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b4bec60 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8005c00 tx=0x7f8ef8007a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1321c430cf281e71 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8edf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8edf7fe640 1 -- 172.21.15.50:0/1938130675 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8018020 con 0x55e14b4be7e0 2024-09-11T22:22:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8edf7fe640 1 -- 172.21.15.50:0/1938130675 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f8ef8010c10 con 0x55e14b4be7e0 2024-09-11T22:22:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f09e0e740 1 -- 172.21.15.50:0/1938130675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ef4003790 con 0x55e14b4be7e0 2024-09-11T22:22:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8edf7fe640 1 -- 172.21.15.50:0/1938130675 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f8ef8022050 con 0x55e14b4be7e0 2024-09-11T22:22:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f09e0e740 10 client.10098 fetch_fsmap learned FSMap version 123 2024-09-11T22:22:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f09e0e740 1 -- 172.21.15.50:0/1938130675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x55e14b1a86b0 con 0x55e14b4be7e0 2024-09-11T22:22:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8edf7fe640 1 -- 172.21.15.50:0/1938130675 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef4003790 con 0x55e14b4be7e0 2024-09-11T22:22:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8edf7fe640 1 -- 172.21.15.50:0/1938130675 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 123) ==== 3490+0+0 (secure 0 0 0) 0x7f8ef8025020 con 0x55e14b4be7e0 2024-09-11T22:22:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f09e0e740 10 client.10098 fetch_fsmap finished waiting for FSMap version 123 2024-09-11T22:22:18.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f09e0e740 10 client.10098 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:22:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f09e0e740 20 client.10098 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/1938130675 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x55e14b4686f0 0x55e14b487660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f09e0e740 4 client.10098 mds_command: new command op to 9915 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:22:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.581+0000 7f8f09e0e740 1 -- 172.21.15.50:0/1938130675 --> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e14b3d8c50 con 0x55e14b4686f0 2024-09-11T22:22:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.582+0000 7f8f04d36640 1 --2- 172.21.15.50:0/1938130675 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x55e14b4686f0 0x55e14b487660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.582+0000 7f8f04d36640 1 --2- 172.21.15.50:0/1938130675 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x55e14b4686f0 0x55e14b487660 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eda4bf3dff8944d server_cookie=cb5535a9611aa08e in_seq=0 out_seq=0 2024-09-11T22:22:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.582+0000 7f8edf7fe640 10 client.10098 ms_handle_connect on v2:172.21.15.77:6836/2937331670 2024-09-11T22:22:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8edf7fe640 1 -- 172.21.15.50:0/1938130675 <== mds.0 v2:172.21.15.77:6836/2937331670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e14b3d8c50 con 0x55e14b4686f0 2024-09-11T22:22:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8edf7fe640 10 client.10098 handle_command_reply: tid=0 2024-09-11T22:22:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8f09e0e740 1 client.10098 shutdown 2024-09-11T22:22:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8f09e0e740 1 -- 172.21.15.50:0/1938130675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 msgr2=0x55e14b4bec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/1938130675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b4bec60 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8005c00 tx=0x7f8ef8007a60 comp rx=0 tx=0).stop 2024-09-11T22:22:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8f09e0e740 1 -- 172.21.15.50:0/1938130675 shutdown_connections 2024-09-11T22:22:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/1938130675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b4bec60 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/1938130675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b46aa50 0x55e14b4bbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/1938130675 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x55e14b4686f0 0x55e14b487660 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/1938130675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b4692c0 0x55e14b4892b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8edf7fe640 0 client.10098 ms_handle_reset on v2:172.21.15.77:6836/2937331670 2024-09-11T22:22:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8f09e0e740 1 -- 172.21.15.50:0/1938130675 >> 172.21.15.50:0/1938130675 conn(0x55e14b466a80 msgr2=0x55e14b4abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8f09e0e740 1 -- 172.21.15.50:0/1938130675 shutdown_connections 2024-09-11T22:22:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8f09e0e740 1 -- 172.21.15.50:0/1938130675 wait complete. 2024-09-11T22:22:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.583+0000 7f8f09e0e740 20 client.10098 trim_cache size 0 max 16384 2024-09-11T22:22:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.601+0000 7f8f09e0e740 1 Processor -- start 2024-09-11T22:22:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.601+0000 7f8f09e0e740 1 -- start start 2024-09-11T22:22:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.601+0000 7f8f09e0e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b4692c0 0x55e14b4ae320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.601+0000 7f8f09e0e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 0x55e14b490520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.601+0000 7f8f09e0e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b463f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.601+0000 7f8f09e0e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f00200bd0 con 0x55e14b4be7e0 2024-09-11T22:22:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.601+0000 7f8f09e0e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001f50a0 con 0x55e14b4692c0 2024-09-11T22:22:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.601+0000 7f8f09e0e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8f001f56f0 con 0x55e14b46aa50 2024-09-11T22:22:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8f05537640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b463f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8f05537640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b463f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36180/0 (socket says 172.21.15.50:36180) 2024-09-11T22:22:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8f05537640 1 -- 172.21.15.50:0/1825822762 learned_addr learned my addr 172.21.15.50:0/1825822762 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8efffff640 1 --2- 172.21.15.50:0/1825822762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 0x55e14b490520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8f04d36640 1 --2- 172.21.15.50:0/1825822762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b4692c0 0x55e14b4ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8f05537640 1 -- 172.21.15.50:0/1825822762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 msgr2=0x55e14b490520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8f05537640 1 --2- 172.21.15.50:0/1825822762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 0x55e14b490520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8f05537640 1 -- 172.21.15.50:0/1825822762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b4692c0 msgr2=0x55e14b4ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8f05537640 1 --2- 172.21.15.50:0/1825822762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b4692c0 0x55e14b4ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8f05537640 1 -- 172.21.15.50:0/1825822762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e14b4af390 con 0x55e14b4be7e0 2024-09-11T22:22:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8f05537640 1 --2- 172.21.15.50:0/1825822762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b463f50 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8001a50 tx=0x7f8ef800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7accd6dbd12a75cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8ee9ffb640 1 -- 172.21.15.50:0/1825822762 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef802b070 con 0x55e14b4be7e0 2024-09-11T22:22:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8ee9ffb640 1 -- 172.21.15.50:0/1825822762 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef8010c30 con 0x55e14b4be7e0 2024-09-11T22:22:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.602+0000 7f8ee9ffb640 1 -- 172.21.15.50:0/1825822762 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8018070 con 0x55e14b4be7e0 2024-09-11T22:22:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.603+0000 7f8f09e0e740 1 -- 172.21.15.50:0/1825822762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 msgr2=0x55e14b463f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.603+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/1825822762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b463f50 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8001a50 tx=0x7f8ef800c000 comp rx=0 tx=0).stop 2024-09-11T22:22:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.603+0000 7f8f09e0e740 1 -- 172.21.15.50:0/1825822762 shutdown_connections 2024-09-11T22:22:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.603+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/1825822762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 0x55e14b490520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.603+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/1825822762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b463f50 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.603+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/1825822762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b4692c0 0x55e14b4ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.603+0000 7f8f09e0e740 1 -- 172.21.15.50:0/1825822762 >> 172.21.15.50:0/1825822762 conn(0x55e14b466a80 msgr2=0x55e14b4abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.603+0000 7f8f09e0e740 1 -- 172.21.15.50:0/1825822762 shutdown_connections 2024-09-11T22:22:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.603+0000 7f8f09e0e740 1 -- 172.21.15.50:0/1825822762 wait complete. 2024-09-11T22:22:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.603+0000 7f8f09e0e740 1 -- start start 2024-09-11T22:22:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.604+0000 7f8f09e0e740 1 Processor -- start 2024-09-11T22:22:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.604+0000 7f8f09e0e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b4692c0 0x55e14b529d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.604+0000 7f8f09e0e740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 0x55e14b462d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.604+0000 7f8f09e0e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b463260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.604+0000 7f8f09e0e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e14b468570 con 0x55e14b4be7e0 2024-09-11T22:22:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.604+0000 7f8f09e0e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e14b488df0 con 0x55e14b4692c0 2024-09-11T22:22:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.604+0000 7f8f09e0e740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e14b492a80 con 0x55e14b46aa50 2024-09-11T22:22:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.604+0000 7f8f09e0e740 10 client.0 _ll_register_callbacks cb 0x7f8ef8001b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.604+0000 7f8f05537640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b463260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.604+0000 7f8f05537640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b463260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36190/0 (socket says 172.21.15.50:36190) 2024-09-11T22:22:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.604+0000 7f8f05537640 1 -- 172.21.15.50:0/2282341791 learned_addr learned my addr 172.21.15.50:0/2282341791 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.604+0000 7f8f04d36640 1 --2- 172.21.15.50:0/2282341791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b4692c0 0x55e14b529d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.604+0000 7f8efffff640 1 --2- 172.21.15.50:0/2282341791 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 0x55e14b462d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8f05537640 1 -- 172.21.15.50:0/2282341791 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 msgr2=0x55e14b462d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8f05537640 1 --2- 172.21.15.50:0/2282341791 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 0x55e14b462d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8f05537640 1 -- 172.21.15.50:0/2282341791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b4692c0 msgr2=0x55e14b529d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8f05537640 1 --2- 172.21.15.50:0/2282341791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b4692c0 0x55e14b529d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8f05537640 1 -- 172.21.15.50:0/2282341791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e14b48e8b0 con 0x55e14b4be7e0 2024-09-11T22:22:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8f05537640 1 --2- 172.21.15.50:0/2282341791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b463260 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8005c00 tx=0x7f8ef8005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191bb952f1d96666 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8edf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8edf7fe640 1 -- 172.21.15.50:0/2282341791 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef802b040 con 0x55e14b4be7e0 2024-09-11T22:22:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8edf7fe640 1 -- 172.21.15.50:0/2282341791 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f8ef8010de0 con 0x55e14b4be7e0 2024-09-11T22:22:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8f09e0e740 1 -- 172.21.15.50:0/2282341791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ef8010c30 con 0x55e14b4be7e0 2024-09-11T22:22:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8edf7fe640 1 -- 172.21.15.50:0/2282341791 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f8ef803c050 con 0x55e14b4be7e0 2024-09-11T22:22:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8f09e0e740 10 client.10104 fetch_fsmap learned FSMap version 123 2024-09-11T22:22:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8f09e0e740 1 -- 172.21.15.50:0/2282341791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x55e14b5303b0 con 0x55e14b4be7e0 2024-09-11T22:22:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8edf7fe640 1 -- 172.21.15.50:0/2282341791 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef8010c30 con 0x55e14b4be7e0 2024-09-11T22:22:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.605+0000 7f8edf7fe640 1 -- 172.21.15.50:0/2282341791 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 123) ==== 3490+0+0 (secure 0 0 0) 0x7f8ef803f020 con 0x55e14b4be7e0 2024-09-11T22:22:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8f09e0e740 10 client.10104 fetch_fsmap finished waiting for FSMap version 123 2024-09-11T22:22:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8f09e0e740 10 client.10104 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:22:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8f09e0e740 20 client.10104 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/2282341791 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x55e14b464260 0x55e14b467020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8f09e0e740 4 client.10104 mds_command: new command op to 9915 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:22:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8f09e0e740 1 -- 172.21.15.50:0/2282341791 --> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] -- command(tid 0: {"prefix": "status"}) -- 0x55e14b3d2fa0 con 0x55e14b464260 2024-09-11T22:22:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8f04d36640 1 --2- 172.21.15.50:0/2282341791 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x55e14b464260 0x55e14b467020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8f04d36640 1 --2- 172.21.15.50:0/2282341791 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x55e14b464260 0x55e14b467020 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72df3afb6fb77d46 server_cookie=84aced90578faf42 in_seq=0 out_seq=0 2024-09-11T22:22:18.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8edf7fe640 10 client.10104 ms_handle_connect on v2:172.21.15.77:6836/2937331670 2024-09-11T22:22:18.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8edf7fe640 1 -- 172.21.15.50:0/2282341791 <== mds.0 v2:172.21.15.77:6836/2937331670 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55e14b3d2fa0 con 0x55e14b464260 2024-09-11T22:22:18.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8edf7fe640 10 client.10104 handle_command_reply: tid=0 2024-09-11T22:22:18.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8f09e0e740 1 client.10104 shutdown 2024-09-11T22:22:18.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8f09e0e740 1 -- 172.21.15.50:0/2282341791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 msgr2=0x55e14b463260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.606+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/2282341791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b463260 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8005c00 tx=0x7f8ef8005b70 comp rx=0 tx=0).stop 2024-09-11T22:22:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f09e0e740 1 -- 172.21.15.50:0/2282341791 shutdown_connections 2024-09-11T22:22:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/2282341791 >> [v2:172.21.15.77:6836/2937331670,v1:172.21.15.77:6837/2937331670] conn(0x55e14b464260 0x55e14b467020 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/2282341791 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e14b46aa50 0x55e14b462d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/2282341791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e14b4be7e0 0x55e14b463260 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8edf7fe640 0 client.10104 ms_handle_reset on v2:172.21.15.77:6836/2937331670 2024-09-11T22:22:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f09e0e740 1 --2- 172.21.15.50:0/2282341791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e14b4692c0 0x55e14b529d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f09e0e740 1 -- 172.21.15.50:0/2282341791 >> 172.21.15.50:0/2282341791 conn(0x55e14b466a80 msgr2=0x55e14b4bbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f09e0e740 1 -- 172.21.15.50:0/2282341791 shutdown_connections 2024-09-11T22:22:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f09e0e740 1 -- 172.21.15.50:0/2282341791 wait complete. 2024-09-11T22:22:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f09e0e740 20 client.10104 trim_cache size 0 max 16384 2024-09-11T22:22:18.615 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:22:18.615 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:22:18.616 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:22:18.616 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 9915, 2024-09-11T22:22:18.616 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:22:18.616 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:22:18.616 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:22:18.616 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 24.106407778000001, 2024-09-11T22:22:18.616 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 123, 2024-09-11T22:22:18.616 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 167, 2024-09-11T22:22:18.616 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 167, 2024-09-11T22:22:18.616 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 29.118878416000001 2024-09-11T22:22:18.616 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:22:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f06f9a640 1 -- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8ee406be30 msgr2=0x7f8ee406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f06f9a640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8ee406be30 0x7f8ee406e2f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40010e0 tx=0x7f8ef4009040 comp rx=0 tx=0).stop 2024-09-11T22:22:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f06f9a640 1 -- 172.21.15.50:0/3692757539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0015e8e0 msgr2=0x7f8f0015bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f06f9a640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0015e8e0 0x7f8f0015bf10 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0097d0 tx=0x7f8eec0046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f06f9a640 1 -- 172.21.15.50:0/3692757539 shutdown_connections 2024-09-11T22:22:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f06f9a640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8ee406be30 0x7f8ee406e2f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f06f9a640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f00162350 0x7f8f0015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f06f9a640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0015e8e0 0x7f8f0015bf10 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f06f9a640 1 --2- 172.21.15.50:0/3692757539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f000d1c90 0x7f8f000abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f06f9a640 1 -- 172.21.15.50:0/3692757539 >> 172.21.15.50:0/3692757539 conn(0x7f8f00067ba0 msgr2=0x7f8f000caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f06f9a640 1 -- 172.21.15.50:0/3692757539 shutdown_connections 2024-09-11T22:22:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.607+0000 7f8f06f9a640 1 -- 172.21.15.50:0/3692757539 wait complete. 2024-09-11T22:22:18.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub start /scrub_control_test_path recursive 2024-09-11T22:22:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.725+0000 7f9885806640 1 Processor -- start 2024-09-11T22:22:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.725+0000 7f9885806640 1 -- start start 2024-09-11T22:22:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f9885806640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f988015e8e0 0x7f98800b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f9885806640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98800d1580 0x7f98800d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f9885806640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9880162350 0x7f9880162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f9885806640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f988015ecc0 con 0x7f98800d1580 2024-09-11T22:22:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f9885806640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f98800d2ad0 con 0x7f9880162350 2024-09-11T22:22:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f9885806640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f98800d3370 con 0x7f988015e8e0 2024-09-11T22:22:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f987e7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98800d1580 0x7f98800d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f987e7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98800d1580 0x7f98800d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36196/0 (socket says 172.21.15.50:36196) 2024-09-11T22:22:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f987e7fc640 1 -- 172.21.15.50:0/484674405 learned_addr learned my addr 172.21.15.50:0/484674405 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f987effd640 1 --2- 172.21.15.50:0/484674405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f988015e8e0 0x7f98800b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f987f7fe640 1 --2- 172.21.15.50:0/484674405 >> v2:172.21.15.77:3300/0 conn(0x7f9880162350 0x7f9880162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f987e7fc640 1 -- 172.21.15.50:0/484674405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f988015e8e0 msgr2=0x7f98800b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f987e7fc640 1 --2- 172.21.15.50:0/484674405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f988015e8e0 0x7f98800b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f987e7fc640 1 -- 172.21.15.50:0/484674405 >> v2:172.21.15.77:3300/0 conn(0x7f9880162350 msgr2=0x7f9880162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f987e7fc640 1 --2- 172.21.15.50:0/484674405 >> v2:172.21.15.77:3300/0 conn(0x7f9880162350 0x7f9880162800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f987e7fc640 1 -- 172.21.15.50:0/484674405 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98800d1ee0 con 0x7f98800d1580 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f987f7fe640 1 --2- 172.21.15.50:0/484674405 >> v2:172.21.15.77:3300/0 conn(0x7f9880162350 0x7f9880162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.726+0000 7f987effd640 1 --2- 172.21.15.50:0/484674405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f988015e8e0 0x7f98800b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.727+0000 7f987e7fc640 1 --2- 172.21.15.50:0/484674405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98800d1580 0x7f98800d19a0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f98800b76d0 tx=0x7f986802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aeecc11db768d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.727+0000 7f987dffb640 1 -- 172.21.15.50:0/484674405 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868037070 con 0x7f98800d1580 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.727+0000 7f987dffb640 1 -- 172.21.15.50:0/484674405 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9868032440 con 0x7f98800d1580 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.727+0000 7f987dffb640 1 -- 172.21.15.50:0/484674405 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868032810 con 0x7f98800d1580 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.728+0000 7f9885806640 1 -- 172.21.15.50:0/484674405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98800d1580 msgr2=0x7f98800d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.728+0000 7f9885806640 1 --2- 172.21.15.50:0/484674405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98800d1580 0x7f98800d19a0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f98800b76d0 tx=0x7f986802a270 comp rx=0 tx=0).stop 2024-09-11T22:22:18.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.728+0000 7f9885806640 1 -- 172.21.15.50:0/484674405 shutdown_connections 2024-09-11T22:22:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.728+0000 7f9885806640 1 --2- 172.21.15.50:0/484674405 >> v2:172.21.15.77:3300/0 conn(0x7f9880162350 0x7f9880162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.728+0000 7f9885806640 1 --2- 172.21.15.50:0/484674405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98800d1580 0x7f98800d19a0 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.728+0000 7f9885806640 1 --2- 172.21.15.50:0/484674405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f988015e8e0 0x7f98800b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.728+0000 7f9885806640 1 -- 172.21.15.50:0/484674405 >> 172.21.15.50:0/484674405 conn(0x7f9880067ba0 msgr2=0x7f9880067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.728+0000 7f9885806640 1 -- 172.21.15.50:0/484674405 shutdown_connections 2024-09-11T22:22:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.728+0000 7f9885806640 1 -- 172.21.15.50:0/484674405 wait complete. 2024-09-11T22:22:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.729+0000 7f9885806640 1 Processor -- start 2024-09-11T22:22:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.729+0000 7f9885806640 1 -- start start 2024-09-11T22:22:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.730+0000 7f9885806640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98800d1580 0x7f98801f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.730+0000 7f9885806640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f988015e8e0 0x7f988015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.730+0000 7f9885806640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9880162350 0x7f98800ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.730+0000 7f9885806640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98800d3000 con 0x7f98800d1580 2024-09-11T22:22:18.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.730+0000 7f9885806640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f98800d2d20 con 0x7f988015e8e0 2024-09-11T22:22:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.730+0000 7f9885806640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9880162d40 con 0x7f9880162350 2024-09-11T22:22:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.730+0000 7f987effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98800d1580 0x7f98801f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.730+0000 7f987effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98800d1580 0x7f98801f4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36204/0 (socket says 172.21.15.50:36204) 2024-09-11T22:22:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.730+0000 7f987effd640 1 -- 172.21.15.50:0/2944708002 learned_addr learned my addr 172.21.15.50:0/2944708002 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.730+0000 7f987e7fc640 1 --2- 172.21.15.50:0/2944708002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f988015e8e0 0x7f988015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.730+0000 7f987f7fe640 1 --2- 172.21.15.50:0/2944708002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9880162350 0x7f98800ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.731+0000 7f987effd640 1 -- 172.21.15.50:0/2944708002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9880162350 msgr2=0x7f98800ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.731+0000 7f987effd640 1 --2- 172.21.15.50:0/2944708002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9880162350 0x7f98800ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.731+0000 7f987effd640 1 -- 172.21.15.50:0/2944708002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f988015e8e0 msgr2=0x7f988015dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.731+0000 7f987effd640 1 --2- 172.21.15.50:0/2944708002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f988015e8e0 0x7f988015dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.731+0000 7f987effd640 1 -- 172.21.15.50:0/2944708002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98801f5130 con 0x7f98800d1580 2024-09-11T22:22:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.731+0000 7f987e7fc640 1 --2- 172.21.15.50:0/2944708002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f988015e8e0 0x7f988015dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.731+0000 7f987f7fe640 1 --2- 172.21.15.50:0/2944708002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9880162350 0x7f98800ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.731+0000 7f987effd640 1 --2- 172.21.15.50:0/2944708002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98800d1580 0x7f98801f4bf0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f987000cee0 tx=0x7f987000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.731+0000 7f9877fff640 1 -- 172.21.15.50:0/2944708002 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987001a070 con 0x7f98800d1580 2024-09-11T22:22:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.731+0000 7f9877fff640 1 -- 172.21.15.50:0/2944708002 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f987000d840 con 0x7f98800d1580 2024-09-11T22:22:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.731+0000 7f9885806640 1 -- 172.21.15.50:0/2944708002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98800ab5e0 con 0x7f98800d1580 2024-09-11T22:22:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.731+0000 7f9877fff640 1 -- 172.21.15.50:0/2944708002 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987000dc10 con 0x7f98800d1580 2024-09-11T22:22:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.731+0000 7f9885806640 1 -- 172.21.15.50:0/2944708002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98800abba0 con 0x7f98800d1580 2024-09-11T22:22:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.733+0000 7f9877fff640 1 -- 172.21.15.50:0/2944708002 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f987001d070 con 0x7f98800d1580 2024-09-11T22:22:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.733+0000 7f9877fff640 1 --2- 172.21.15.50:0/2944708002 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f986006be30 0x7f986006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.733+0000 7f9877fff640 1 -- 172.21.15.50:0/2944708002 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f987008b5b0 con 0x7f98800d1580 2024-09-11T22:22:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.734+0000 7f987e7fc640 1 --2- 172.21.15.50:0/2944708002 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f986006be30 0x7f986006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.734+0000 7f987e7fc640 1 --2- 172.21.15.50:0/2944708002 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f986006be30 0x7f986006e2f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9868034000 tx=0x7f986802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.734+0000 7f9888682740 1 Processor -- start 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.734+0000 7f9888682740 1 -- start start 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f9888682740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a6b40 0x560b470ec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f9888682740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a4300 0x560b470a6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f9888682740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470a82d0 0x560b470a1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f9888682740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560b470688a0 con 0x560b470a6b40 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f9888682740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560b47009960 con 0x560b470a82d0 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f9888682740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560b46fb1650 con 0x560b470a4300 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f987effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a6b40 0x560b470ec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f987effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a6b40 0x560b470ec2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36212/0 (socket says 172.21.15.50:36212) 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f987effd640 1 -- 172.21.15.50:0/2484119716 learned_addr learned my addr 172.21.15.50:0/2484119716 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f987e7fc640 1 --2- 172.21.15.50:0/2484119716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a4300 0x560b470a6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f987f7fe640 1 --2- 172.21.15.50:0/2484119716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470a82d0 0x560b470a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f987effd640 1 -- 172.21.15.50:0/2484119716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a4300 msgr2=0x560b470a6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f987effd640 1 --2- 172.21.15.50:0/2484119716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a4300 0x560b470a6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f987effd640 1 -- 172.21.15.50:0/2484119716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470a82d0 msgr2=0x560b470a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f987effd640 1 --2- 172.21.15.50:0/2484119716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470a82d0 0x560b470a1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.735+0000 7f987effd640 1 -- 172.21.15.50:0/2484119716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b46de8940 con 0x560b470a6b40 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.736+0000 7f987e7fc640 1 --2- 172.21.15.50:0/2484119716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a4300 0x560b470a6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.736+0000 7f987effd640 1 --2- 172.21.15.50:0/2484119716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a6b40 0x560b470ec2e0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f9870089a50 tx=0x7f9870055c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8aecc3cd517d08 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.736+0000 7f98757fa640 1 -- 172.21.15.50:0/2484119716 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98700600d0 con 0x560b470a6b40 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.736+0000 7f98757fa640 1 -- 172.21.15.50:0/2484119716 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f987000ddb0 con 0x560b470a6b40 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.736+0000 7f98757fa640 1 -- 172.21.15.50:0/2484119716 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870055f80 con 0x560b470a6b40 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.736+0000 7f9888682740 1 -- 172.21.15.50:0/2484119716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a6b40 msgr2=0x560b470ec2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.736+0000 7f9888682740 1 --2- 172.21.15.50:0/2484119716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a6b40 0x560b470ec2e0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f9870089a50 tx=0x7f9870055c60 comp rx=0 tx=0).stop 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.737+0000 7f9888682740 1 -- 172.21.15.50:0/2484119716 shutdown_connections 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.737+0000 7f9888682740 1 --2- 172.21.15.50:0/2484119716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a4300 0x560b470a6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.737+0000 7f9888682740 1 --2- 172.21.15.50:0/2484119716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470a82d0 0x560b470a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.737+0000 7f9888682740 1 --2- 172.21.15.50:0/2484119716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a6b40 0x560b470ec2e0 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.737+0000 7f9888682740 1 -- 172.21.15.50:0/2484119716 >> 172.21.15.50:0/2484119716 conn(0x560b470a3300 msgr2=0x560b470eb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.737+0000 7f9888682740 1 -- 172.21.15.50:0/2484119716 shutdown_connections 2024-09-11T22:22:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.737+0000 7f9888682740 1 -- 172.21.15.50:0/2484119716 wait complete. 2024-09-11T22:22:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.737+0000 7f9888682740 1 -- start start 2024-09-11T22:22:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.737+0000 7f9888682740 1 Processor -- start 2024-09-11T22:22:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f9888682740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a6b40 0x560b470c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f9888682740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b470e8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f9888682740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470b7270 0x560b470ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f9888682740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560b46f92650 con 0x560b470a82d0 2024-09-11T22:22:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f9888682740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560b47005920 con 0x560b470b7270 2024-09-11T22:22:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f9888682740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560b470a27a0 con 0x560b470a6b40 2024-09-11T22:22:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f9888682740 10 client.0 _ll_register_callbacks cb 0x560b46d1bd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f987e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b470e8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f987e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b470e8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36214/0 (socket says 172.21.15.50:36214) 2024-09-11T22:22:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f987e7fc640 1 -- 172.21.15.50:0/4011507601 learned_addr learned my addr 172.21.15.50:0/4011507601 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f987effd640 1 --2- 172.21.15.50:0/4011507601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a6b40 0x560b470c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f987f7fe640 1 --2- 172.21.15.50:0/4011507601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470b7270 0x560b470ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f987e7fc640 1 -- 172.21.15.50:0/4011507601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a6b40 msgr2=0x560b470c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f987e7fc640 1 --2- 172.21.15.50:0/4011507601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a6b40 0x560b470c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f987e7fc640 1 -- 172.21.15.50:0/4011507601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470b7270 msgr2=0x560b470ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f987e7fc640 1 --2- 172.21.15.50:0/4011507601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470b7270 0x560b470ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.738+0000 7f987e7fc640 1 -- 172.21.15.50:0/4011507601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b46e490d0 con 0x560b470a82d0 2024-09-11T22:22:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f987e7fc640 1 --2- 172.21.15.50:0/4011507601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b470e8ec0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f986802a860 tx=0x7f986802c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65466d17502ffdc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f985e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f985e7fc640 1 -- 172.21.15.50:0/4011507601 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986804d060 con 0x560b470a82d0 2024-09-11T22:22:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f985e7fc640 1 -- 172.21.15.50:0/4011507601 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f986803edc0 con 0x560b470a82d0 2024-09-11T22:22:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f9888682740 1 -- 172.21.15.50:0/4011507601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f987000ddb0 con 0x560b470a82d0 2024-09-11T22:22:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f985e7fc640 1 -- 172.21.15.50:0/4011507601 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f9868053050 con 0x560b470a82d0 2024-09-11T22:22:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f9888682740 10 client.10116 fetch_fsmap learned FSMap version 123 2024-09-11T22:22:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f9888682740 1 -- 172.21.15.50:0/4011507601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x560b46cdc230 con 0x560b470a82d0 2024-09-11T22:22:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f985e7fc640 1 -- 172.21.15.50:0/4011507601 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f987000ddb0 con 0x560b470a82d0 2024-09-11T22:22:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f985e7fc640 1 -- 172.21.15.50:0/4011507601 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 123) ==== 3490+0+0 (secure 0 0 0) 0x7f9868056020 con 0x560b470a82d0 2024-09-11T22:22:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f9888682740 10 client.10116 fetch_fsmap finished waiting for FSMap version 123 2024-09-11T22:22:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f9888682740 10 client.10116 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:22:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f9888682740 20 client.10116 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f9888682740 1 --2- 172.21.15.50:0/4011507601 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x560b470c5f00 0x560b470c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f9888682740 4 client.10116 mds_command: new command op to 9900 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:22:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f9888682740 1 -- 172.21.15.50:0/4011507601 --> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b47017090 con 0x560b470c5f00 2024-09-11T22:22:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.739+0000 7f987effd640 1 --2- 172.21.15.50:0/4011507601 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x560b470c5f00 0x560b470c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.740+0000 7f987effd640 1 --2- 172.21.15.50:0/4011507601 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x560b470c5f00 0x560b470c62e0 crc :-1 s=READY pgs=8 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9900 client_cookie=1da7b1966259b913 server_cookie=d2ad7827aaa45a82 in_seq=0 out_seq=0 2024-09-11T22:22:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.740+0000 7f985e7fc640 10 client.10116 ms_handle_connect on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.740+0000 7f985e7fc640 1 -- 172.21.15.50:0/4011507601 <== mds.9900 v2:172.21.15.50:6834/2009878103 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560b47017090 con 0x560b470c5f00 2024-09-11T22:22:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.740+0000 7f985e7fc640 10 client.10116 handle_command_reply: tid=0 2024-09-11T22:22:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.740+0000 7f9888682740 1 client.10116 shutdown 2024-09-11T22:22:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.740+0000 7f9888682740 1 -- 172.21.15.50:0/4011507601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 msgr2=0x560b470e8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.740+0000 7f9888682740 1 --2- 172.21.15.50:0/4011507601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b470e8ec0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f986802a860 tx=0x7f986802c070 comp rx=0 tx=0).stop 2024-09-11T22:22:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.740+0000 7f9888682740 1 -- 172.21.15.50:0/4011507601 shutdown_connections 2024-09-11T22:22:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.740+0000 7f9888682740 1 --2- 172.21.15.50:0/4011507601 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x560b470c5f00 0x560b470c62e0 crc :-1 s=READY pgs=8 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.740+0000 7f9888682740 1 --2- 172.21.15.50:0/4011507601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470b7270 0x560b470ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.740+0000 7f985e7fc640 0 client.10116 ms_handle_reset on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.740+0000 7f9888682740 1 --2- 172.21.15.50:0/4011507601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b470e8ec0 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.740+0000 7f9888682740 1 --2- 172.21.15.50:0/4011507601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a6b40 0x560b470c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.741+0000 7f9888682740 1 -- 172.21.15.50:0/4011507601 >> 172.21.15.50:0/4011507601 conn(0x560b470a4300 msgr2=0x560b470e9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.741+0000 7f9888682740 1 -- 172.21.15.50:0/4011507601 shutdown_connections 2024-09-11T22:22:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.741+0000 7f9888682740 1 -- 172.21.15.50:0/4011507601 wait complete. 2024-09-11T22:22:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.741+0000 7f9888682740 20 client.10116 trim_cache size 0 max 16384 2024-09-11T22:22:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.758+0000 7f9888682740 1 Processor -- start 2024-09-11T22:22:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.758+0000 7f9888682740 1 -- start start 2024-09-11T22:22:18.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f9888682740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470a6b40 0x560b470e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f9888682740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b470e9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f9888682740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470b7270 0x560b470e9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f9888682740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9880200a90 con 0x560b470a82d0 2024-09-11T22:22:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f9888682740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f98800cc660 con 0x560b470a6b40 2024-09-11T22:22:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f9888682740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f98801f8240 con 0x560b470b7270 2024-09-11T22:22:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f987e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b470e9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f987e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b470e9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36222/0 (socket says 172.21.15.50:36222) 2024-09-11T22:22:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f987e7fc640 1 -- 172.21.15.50:0/2832549214 learned_addr learned my addr 172.21.15.50:0/2832549214 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f987e7fc640 1 -- 172.21.15.50:0/2832549214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470b7270 msgr2=0x560b470e9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f987e7fc640 1 --2- 172.21.15.50:0/2832549214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470b7270 0x560b470e9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f987e7fc640 1 -- 172.21.15.50:0/2832549214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470a6b40 msgr2=0x560b470e8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f987e7fc640 1 --2- 172.21.15.50:0/2832549214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470a6b40 0x560b470e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.759+0000 7f987e7fc640 1 -- 172.21.15.50:0/2832549214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b470e8a80 con 0x560b470a82d0 2024-09-11T22:22:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.760+0000 7f987e7fc640 1 --2- 172.21.15.50:0/2832549214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b470e9830 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f9868032c10 tx=0x7f986803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b2c72c6b9bae13 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.760+0000 7f9874ff9640 1 -- 172.21.15.50:0/2832549214 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986805c070 con 0x560b470a82d0 2024-09-11T22:22:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.760+0000 7f9874ff9640 1 -- 172.21.15.50:0/2832549214 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986803ebc0 con 0x560b470a82d0 2024-09-11T22:22:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.760+0000 7f9874ff9640 1 -- 172.21.15.50:0/2832549214 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868037040 con 0x560b470a82d0 2024-09-11T22:22:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.760+0000 7f9888682740 1 -- 172.21.15.50:0/2832549214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 msgr2=0x560b470e9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.760+0000 7f9888682740 1 --2- 172.21.15.50:0/2832549214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b470e9830 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f9868032c10 tx=0x7f986803b000 comp rx=0 tx=0).stop 2024-09-11T22:22:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.760+0000 7f9888682740 1 -- 172.21.15.50:0/2832549214 shutdown_connections 2024-09-11T22:22:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.760+0000 7f9888682740 1 --2- 172.21.15.50:0/2832549214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470b7270 0x560b470e9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.760+0000 7f9888682740 1 --2- 172.21.15.50:0/2832549214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b470e9830 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.760+0000 7f9888682740 1 --2- 172.21.15.50:0/2832549214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470a6b40 0x560b470e8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.760+0000 7f9888682740 1 -- 172.21.15.50:0/2832549214 >> 172.21.15.50:0/2832549214 conn(0x560b470a4300 msgr2=0x560b470b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.760+0000 7f9888682740 1 -- 172.21.15.50:0/2832549214 shutdown_connections 2024-09-11T22:22:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.760+0000 7f9888682740 1 -- 172.21.15.50:0/2832549214 wait complete. 2024-09-11T22:22:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.761+0000 7f9888682740 1 -- start start 2024-09-11T22:22:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.761+0000 7f9888682740 1 Processor -- start 2024-09-11T22:22:18.768 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T22:22:18.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f9888682740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a6b40 0x560b4716aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f9888682740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b47164a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f9888682740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470b7270 0x560b470ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f9888682740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560b470b54a0 con 0x560b470a82d0 2024-09-11T22:22:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f9888682740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560b470b7ce0 con 0x560b470b7270 2024-09-11T22:22:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f9888682740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560b470d0d90 con 0x560b470a6b40 2024-09-11T22:22:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f9888682740 10 client.0 _ll_register_callbacks cb 0x7f9868035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f987e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b47164a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f987e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b47164a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36238/0 (socket says 172.21.15.50:36238) 2024-09-11T22:22:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f987e7fc640 1 -- 172.21.15.50:0/1994068432 learned_addr learned my addr 172.21.15.50:0/1994068432 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f987effd640 1 --2- 172.21.15.50:0/1994068432 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a6b40 0x560b4716aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f987f7fe640 1 --2- 172.21.15.50:0/1994068432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470b7270 0x560b470ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f987e7fc640 1 -- 172.21.15.50:0/1994068432 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a6b40 msgr2=0x560b4716aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f987e7fc640 1 --2- 172.21.15.50:0/1994068432 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a6b40 0x560b4716aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f987e7fc640 1 -- 172.21.15.50:0/1994068432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470b7270 msgr2=0x560b470ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f987e7fc640 1 --2- 172.21.15.50:0/1994068432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470b7270 0x560b470ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f987e7fc640 1 -- 172.21.15.50:0/1994068432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b470c5190 con 0x560b470a82d0 2024-09-11T22:22:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f987e7fc640 1 --2- 172.21.15.50:0/1994068432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b47164a60 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f9868032690 tx=0x7f9868004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e8cfaaaf929795 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.762+0000 7f985e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f985e7fc640 1 -- 172.21.15.50:0/1994068432 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986805c070 con 0x560b470a82d0 2024-09-11T22:22:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f985e7fc640 1 -- 172.21.15.50:0/1994068432 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f9868062440 con 0x560b470a82d0 2024-09-11T22:22:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f9888682740 1 -- 172.21.15.50:0/1994068432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f986803ebc0 con 0x560b470a82d0 2024-09-11T22:22:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f985e7fc640 1 -- 172.21.15.50:0/1994068432 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f986806c050 con 0x560b470a82d0 2024-09-11T22:22:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f9888682740 10 client.10122 fetch_fsmap learned FSMap version 123 2024-09-11T22:22:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f9888682740 1 -- 172.21.15.50:0/1994068432 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x560b4716af90 con 0x560b470a82d0 2024-09-11T22:22:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f985e7fc640 1 -- 172.21.15.50:0/1994068432 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986803ebc0 con 0x560b470a82d0 2024-09-11T22:22:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f985e7fc640 1 -- 172.21.15.50:0/1994068432 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 123) ==== 3490+0+0 (secure 0 0 0) 0x7f9868050070 con 0x560b470a82d0 2024-09-11T22:22:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f9888682740 10 client.10122 fetch_fsmap finished waiting for FSMap version 123 2024-09-11T22:22:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f9888682740 10 client.10122 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:22:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f9888682740 20 client.10122 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f9888682740 1 --2- 172.21.15.50:0/1994068432 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x560b470ef130 0x560b470ea700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f9888682740 4 client.10122 mds_command: new command op to 9900 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-11T22:22:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f9888682740 1 -- 172.21.15.50:0/1994068432 --> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x560b470113e0 con 0x560b470ef130 2024-09-11T22:22:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f987effd640 1 --2- 172.21.15.50:0/1994068432 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x560b470ef130 0x560b470ea700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f987effd640 1 --2- 172.21.15.50:0/1994068432 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x560b470ef130 0x560b470ea700 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9900 client_cookie=6c459959e9991952 server_cookie=bfc1525ddb0abb0e in_seq=0 out_seq=0 2024-09-11T22:22:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.763+0000 7f985e7fc640 10 client.10122 ms_handle_connect on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f985e7fc640 1 -- 172.21.15.50:0/1994068432 <== mds.9900 v2:172.21.15.50:6834/2009878103 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x560b470113e0 con 0x560b470ef130 2024-09-11T22:22:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f985e7fc640 10 client.10122 handle_command_reply: tid=0 2024-09-11T22:22:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f9888682740 1 client.10122 shutdown 2024-09-11T22:22:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f9888682740 1 -- 172.21.15.50:0/1994068432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 msgr2=0x560b47164a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f9888682740 1 --2- 172.21.15.50:0/1994068432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b47164a60 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f9868032690 tx=0x7f9868004730 comp rx=0 tx=0).stop 2024-09-11T22:22:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f9888682740 1 -- 172.21.15.50:0/1994068432 shutdown_connections 2024-09-11T22:22:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f9888682740 1 --2- 172.21.15.50:0/1994068432 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x560b470ef130 0x560b470ea700 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f9888682740 1 --2- 172.21.15.50:0/1994068432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b470b7270 0x560b470ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f985e7fc640 0 client.10122 ms_handle_reset on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f9888682740 1 --2- 172.21.15.50:0/1994068432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b470a82d0 0x560b47164a60 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f9888682740 1 --2- 172.21.15.50:0/1994068432 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560b470a6b40 0x560b4716aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f9888682740 1 -- 172.21.15.50:0/1994068432 >> 172.21.15.50:0/1994068432 conn(0x560b470a4300 msgr2=0x560b470b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f9888682740 1 -- 172.21.15.50:0/1994068432 shutdown_connections 2024-09-11T22:22:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f9888682740 1 -- 172.21.15.50:0/1994068432 wait complete. 2024-09-11T22:22:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.764+0000 7f9888682740 20 client.10122 trim_cache size 0 max 16384 2024-09-11T22:22:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:Error EINVAL: MDS is not active 2024-09-11T22:22:18.773 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub pause 2024-09-11T22:22:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.876+0000 7f38626ac640 1 Processor -- start 2024-09-11T22:22:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.876+0000 7f38626ac640 1 -- start start 2024-09-11T22:22:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.877+0000 7f38626ac640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f385c161fa0 0x7f385c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.877+0000 7f38626ac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f385c0b1600 0x7f385c0cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.877+0000 7f38626ac640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f385c0cfbd0 con 0x7f385c0cf440 2024-09-11T22:22:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.877+0000 7f38626ac640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f385c0cdce0 con 0x7f385c0b1600 2024-09-11T22:22:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.877+0000 7f38626ac640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f385c0d1220 con 0x7f385c161fa0 2024-09-11T22:22:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.877+0000 7f385b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f385c0b1600 0x7f385c0cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.877+0000 7f385b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f385c0b1600 0x7f385c0cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36244/0 (socket says 172.21.15.50:36244) 2024-09-11T22:22:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.877+0000 7f385b7fe640 1 -- 172.21.15.50:0/2694232283 learned_addr learned my addr 172.21.15.50:0/2694232283 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.877+0000 7f385bfff640 1 --2- 172.21.15.50:0/2694232283 >> v2:172.21.15.77:3300/0 conn(0x7f385c161fa0 0x7f385c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.877+0000 7f385b7fe640 1 -- 172.21.15.50:0/2694232283 >> v2:172.21.15.77:3300/0 conn(0x7f385c161fa0 msgr2=0x7f385c0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.877+0000 7f385b7fe640 1 --2- 172.21.15.50:0/2694232283 >> v2:172.21.15.77:3300/0 conn(0x7f385c161fa0 0x7f385c0b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.877+0000 7f385b7fe640 1 -- 172.21.15.50:0/2694232283 >> v1:172.21.15.77:6789/0 conn(0x7f385c0cf440 legacy=0x7f385c06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.877+0000 7f385b7fe640 1 -- 172.21.15.50:0/2694232283 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385c0cfeb0 con 0x7f385c0b1600 2024-09-11T22:22:18.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.878+0000 7f385b7fe640 1 --2- 172.21.15.50:0/2694232283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f385c0b1600 0x7f385c0cef00 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f385c072960 tx=0x7f385002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba1d0460a5dda7b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.878+0000 7f385affd640 1 -- 172.21.15.50:0/2694232283 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850037070 con 0x7f385c0b1600 2024-09-11T22:22:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.878+0000 7f385affd640 1 -- 172.21.15.50:0/2694232283 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3850032440 con 0x7f385c0b1600 2024-09-11T22:22:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.878+0000 7f385affd640 1 -- 172.21.15.50:0/2694232283 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850032810 con 0x7f385c0b1600 2024-09-11T22:22:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.879+0000 7f38626ac640 1 -- 172.21.15.50:0/2694232283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f385c0b1600 msgr2=0x7f385c0cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.879+0000 7f38626ac640 1 --2- 172.21.15.50:0/2694232283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f385c0b1600 0x7f385c0cef00 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f385c072960 tx=0x7f385002a230 comp rx=0 tx=0).stop 2024-09-11T22:22:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.879+0000 7f38626ac640 1 -- 172.21.15.50:0/2694232283 shutdown_connections 2024-09-11T22:22:18.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.879+0000 7f38626ac640 1 --2- 172.21.15.50:0/2694232283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f385c0b1600 0x7f385c0cef00 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.879+0000 7f38626ac640 1 --2- 172.21.15.50:0/2694232283 >> v2:172.21.15.77:3300/0 conn(0x7f385c161fa0 0x7f385c0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.879+0000 7f38626ac640 1 -- 172.21.15.50:0/2694232283 >> 172.21.15.50:0/2694232283 conn(0x7f385c09ba50 msgr2=0x7f385c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.879+0000 7f38626ac640 1 -- 172.21.15.50:0/2694232283 shutdown_connections 2024-09-11T22:22:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.879+0000 7f38626ac640 1 -- 172.21.15.50:0/2694232283 wait complete. 2024-09-11T22:22:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.880+0000 7f38626ac640 1 Processor -- start 2024-09-11T22:22:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.880+0000 7f38626ac640 1 -- start start 2024-09-11T22:22:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f38626ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f385c0b1600 0x7f385c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f38626ac640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f385c0cf440 0x7f385c0b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f38626ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f385c161fa0 0x7f385c0cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f38626ac640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f385c0cf870 con 0x7f385c0b1600 2024-09-11T22:22:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f38626ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f385c0d17e0 con 0x7f385c161fa0 2024-09-11T22:22:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f38626ac640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f385c162380 con 0x7f385c0cf440 2024-09-11T22:22:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f385bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f385c0b1600 0x7f385c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f385bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f385c0b1600 0x7f385c1549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36256/0 (socket says 172.21.15.50:36256) 2024-09-11T22:22:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f385bfff640 1 -- 172.21.15.50:0/2781114197 learned_addr learned my addr 172.21.15.50:0/2781114197 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f385b7fe640 1 --2- 172.21.15.50:0/2781114197 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f385c0cf440 0x7f385c0b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f3860c49640 1 --2- 172.21.15.50:0/2781114197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f385c161fa0 0x7f385c0cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f385bfff640 1 -- 172.21.15.50:0/2781114197 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f385c0cf440 msgr2=0x7f385c0b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f385bfff640 1 --2- 172.21.15.50:0/2781114197 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f385c0cf440 0x7f385c0b7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f385bfff640 1 -- 172.21.15.50:0/2781114197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f385c161fa0 msgr2=0x7f385c0cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f385bfff640 1 --2- 172.21.15.50:0/2781114197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f385c161fa0 0x7f385c0cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f385bfff640 1 -- 172.21.15.50:0/2781114197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385c154ee0 con 0x7f385c0b1600 2024-09-11T22:22:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.881+0000 7f3860c49640 1 --2- 172.21.15.50:0/2781114197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f385c161fa0 0x7f385c0cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.882+0000 7f385bfff640 1 --2- 172.21.15.50:0/2781114197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f385c0b1600 0x7f385c1549a0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f384c00c7f0 tx=0x7f384c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.882+0000 7f3858ff9640 1 -- 172.21.15.50:0/2781114197 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c015070 con 0x7f385c0b1600 2024-09-11T22:22:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.882+0000 7f3858ff9640 1 -- 172.21.15.50:0/2781114197 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f384c004220 con 0x7f385c0b1600 2024-09-11T22:22:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.882+0000 7f3858ff9640 1 -- 172.21.15.50:0/2781114197 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c007620 con 0x7f385c0b1600 2024-09-11T22:22:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.882+0000 7f38626ac640 1 -- 172.21.15.50:0/2781114197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385c0cad00 con 0x7f385c0b1600 2024-09-11T22:22:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.882+0000 7f38626ac640 1 -- 172.21.15.50:0/2781114197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f385c0cb2c0 con 0x7f385c0b1600 2024-09-11T22:22:18.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.883+0000 7f3858ff9640 1 -- 172.21.15.50:0/2781114197 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f384c0079d0 con 0x7f385c0b1600 2024-09-11T22:22:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.884+0000 7f3858ff9640 1 --2- 172.21.15.50:0/2781114197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f384806be30 0x7f384806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.884+0000 7f3858ff9640 1 -- 172.21.15.50:0/2781114197 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f384c08b180 con 0x7f385c0b1600 2024-09-11T22:22:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.884+0000 7f385b7fe640 1 --2- 172.21.15.50:0/2781114197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f384806be30 0x7f384806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.885+0000 7f385b7fe640 1 --2- 172.21.15.50:0/2781114197 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f384806be30 0x7f384806e2f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3850034000 tx=0x7f385002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.885+0000 7f386544a740 1 Processor -- start 2024-09-11T22:22:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.885+0000 7f386544a740 1 -- start start 2024-09-11T22:22:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f386544a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42ac5800 0x564d42ac5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f386544a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac2fc0 0x564d42ac4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f386544a740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42ac3420 0x564d42aa5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f386544a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564d429e18a0 con 0x564d42ac2fc0 2024-09-11T22:22:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f386544a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564d429895f0 con 0x564d42ac5800 2024-09-11T22:22:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f386544a740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564d429dd860 con 0x564d42ac3420 2024-09-11T22:22:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f385b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac2fc0 0x564d42ac4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f385b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac2fc0 0x564d42ac4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36270/0 (socket says 172.21.15.50:36270) 2024-09-11T22:22:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f385b7fe640 1 -- 172.21.15.50:0/2554285958 learned_addr learned my addr 172.21.15.50:0/2554285958 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f385bfff640 1 --2- 172.21.15.50:0/2554285958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42ac5800 0x564d42ac5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f3860c49640 1 --2- 172.21.15.50:0/2554285958 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42ac3420 0x564d42aa5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f385b7fe640 1 -- 172.21.15.50:0/2554285958 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42ac3420 msgr2=0x564d42aa5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f385b7fe640 1 --2- 172.21.15.50:0/2554285958 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42ac3420 0x564d42aa5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f385b7fe640 1 -- 172.21.15.50:0/2554285958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42ac5800 msgr2=0x564d42ac5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f385b7fe640 1 --2- 172.21.15.50:0/2554285958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42ac5800 0x564d42ac5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f385b7fe640 1 -- 172.21.15.50:0/2554285958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d426d8120 con 0x564d42ac2fc0 2024-09-11T22:22:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.886+0000 7f385b7fe640 1 --2- 172.21.15.50:0/2554285958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac2fc0 0x564d42ac4b50 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f3850035040 tx=0x7f385002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca8e533f61fb255 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.887+0000 7f38427fc640 1 -- 172.21.15.50:0/2554285958 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385004d070 con 0x564d42ac2fc0 2024-09-11T22:22:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.887+0000 7f38427fc640 1 -- 172.21.15.50:0/2554285958 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3850032e20 con 0x564d42ac2fc0 2024-09-11T22:22:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.887+0000 7f38427fc640 1 -- 172.21.15.50:0/2554285958 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850037040 con 0x564d42ac2fc0 2024-09-11T22:22:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.887+0000 7f386544a740 1 -- 172.21.15.50:0/2554285958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac2fc0 msgr2=0x564d42ac4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.887+0000 7f386544a740 1 --2- 172.21.15.50:0/2554285958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac2fc0 0x564d42ac4b50 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f3850035040 tx=0x7f385002c000 comp rx=0 tx=0).stop 2024-09-11T22:22:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.887+0000 7f386544a740 1 -- 172.21.15.50:0/2554285958 shutdown_connections 2024-09-11T22:22:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.887+0000 7f386544a740 1 --2- 172.21.15.50:0/2554285958 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42ac3420 0x564d42aa5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.887+0000 7f386544a740 1 --2- 172.21.15.50:0/2554285958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac2fc0 0x564d42ac4b50 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.887+0000 7f386544a740 1 --2- 172.21.15.50:0/2554285958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42ac5800 0x564d42ac5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.887+0000 7f386544a740 1 -- 172.21.15.50:0/2554285958 >> 172.21.15.50:0/2554285958 conn(0x564d42a7b6f0 msgr2=0x564d42ac3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.887+0000 7f386544a740 1 -- 172.21.15.50:0/2554285958 shutdown_connections 2024-09-11T22:22:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.887+0000 7f386544a740 1 -- 172.21.15.50:0/2554285958 wait complete. 2024-09-11T22:22:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.888+0000 7f386544a740 1 -- start start 2024-09-11T22:22:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.888+0000 7f386544a740 1 Processor -- start 2024-09-11T22:22:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f386544a740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42ac3420 0x564d42a7df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f386544a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac5800 0x564d42aa2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f386544a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42a7f4f0 0x564d42aa8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f386544a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564d42ac1f20 con 0x564d42ac5800 2024-09-11T22:22:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f386544a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564d4296a3f0 con 0x564d42a7f4f0 2024-09-11T22:22:18.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f386544a740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564d42ac2200 con 0x564d42ac3420 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f386544a740 10 client.0 _ll_register_callbacks cb 0x564d426f3910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f385b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac5800 0x564d42aa2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f385b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac5800 0x564d42aa2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36278/0 (socket says 172.21.15.50:36278) 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f385b7fe640 1 -- 172.21.15.50:0/1730988615 learned_addr learned my addr 172.21.15.50:0/1730988615 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f385bfff640 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42ac3420 0x564d42a7df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f3860c49640 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42a7f4f0 0x564d42aa8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f385b7fe640 1 -- 172.21.15.50:0/1730988615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42ac3420 msgr2=0x564d42a7df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f385b7fe640 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42ac3420 0x564d42a7df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f385b7fe640 1 -- 172.21.15.50:0/1730988615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42a7f4f0 msgr2=0x564d42aa8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f385b7fe640 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42a7f4f0 0x564d42aa8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f385b7fe640 1 -- 172.21.15.50:0/1730988615 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d427be500 con 0x564d42ac5800 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f385bfff640 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42ac3420 0x564d42a7df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f385b7fe640 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac5800 0x564d42aa2d00 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f3850009630 tx=0x7f3850004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e3e6fa87155b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f383affd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f383affd640 1 -- 172.21.15.50:0/1730988615 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385004d070 con 0x564d42ac5800 2024-09-11T22:22:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f383affd640 1 -- 172.21.15.50:0/1730988615 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f3850003610 con 0x564d42ac5800 2024-09-11T22:22:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.889+0000 7f386544a740 1 -- 172.21.15.50:0/1730988615 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3850032e20 con 0x564d42ac5800 2024-09-11T22:22:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f383affd640 1 -- 172.21.15.50:0/1730988615 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f385005a050 con 0x564d42ac5800 2024-09-11T22:22:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f386544a740 10 client.10134 fetch_fsmap learned FSMap version 123 2024-09-11T22:22:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f386544a740 1 -- 172.21.15.50:0/1730988615 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x564d4281ec90 con 0x564d42ac5800 2024-09-11T22:22:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f383affd640 1 -- 172.21.15.50:0/1730988615 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3850032e20 con 0x564d42ac5800 2024-09-11T22:22:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f383affd640 1 -- 172.21.15.50:0/1730988615 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 123) ==== 3490+0+0 (secure 0 0 0) 0x7f385005d020 con 0x564d42ac5800 2024-09-11T22:22:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f386544a740 10 client.10134 fetch_fsmap finished waiting for FSMap version 123 2024-09-11T22:22:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f386544a740 10 client.10134 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:22:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f386544a740 20 client.10134 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f386544a740 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x564d42abbbc0 0x564d42aa6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f386544a740 4 client.10134 mds_command: new command op to 9900 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:22:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f386544a740 1 -- 172.21.15.50:0/1730988615 --> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d429eefd0 con 0x564d42abbbc0 2024-09-11T22:22:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f385bfff640 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x564d42abbbc0 0x564d42aa6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f383affd640 10 client.10134 ms_handle_connect on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.890+0000 7f385bfff640 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x564d42abbbc0 0x564d42aa6c60 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9900 client_cookie=7034624abd72445f server_cookie=e32ad42a14f68d4b in_seq=0 out_seq=0 2024-09-11T22:22:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f383affd640 1 -- 172.21.15.50:0/1730988615 <== mds.9900 v2:172.21.15.50:6834/2009878103 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d429eefd0 con 0x564d42abbbc0 2024-09-11T22:22:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f383affd640 10 client.10134 handle_command_reply: tid=0 2024-09-11T22:22:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f386544a740 1 client.10134 shutdown 2024-09-11T22:22:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f386544a740 1 -- 172.21.15.50:0/1730988615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac5800 msgr2=0x564d42aa2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f386544a740 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac5800 0x564d42aa2d00 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f3850009630 tx=0x7f3850004730 comp rx=0 tx=0).stop 2024-09-11T22:22:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f386544a740 1 -- 172.21.15.50:0/1730988615 shutdown_connections 2024-09-11T22:22:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f386544a740 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x564d42abbbc0 0x564d42aa6c60 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f383affd640 0 client.10134 ms_handle_reset on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:18.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f386544a740 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42a7f4f0 0x564d42aa8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f386544a740 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac5800 0x564d42aa2d00 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f386544a740 1 --2- 172.21.15.50:0/1730988615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42ac3420 0x564d42a7df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f386544a740 1 -- 172.21.15.50:0/1730988615 >> 172.21.15.50:0/1730988615 conn(0x564d42ac2fc0 msgr2=0x564d42aa5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f386544a740 1 -- 172.21.15.50:0/1730988615 shutdown_connections 2024-09-11T22:22:18.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f386544a740 1 -- 172.21.15.50:0/1730988615 wait complete. 2024-09-11T22:22:18.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.891+0000 7f386544a740 20 client.10134 trim_cache size 0 max 16384 2024-09-11T22:22:18.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.909+0000 7f386544a740 1 Processor -- start 2024-09-11T22:22:18.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.909+0000 7f386544a740 1 -- start start 2024-09-11T22:22:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.909+0000 7f386544a740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42a7f4f0 0x564d42aa2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.909+0000 7f386544a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42abbbc0 0x564d42ab9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.909+0000 7f386544a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 0x564d42ae8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.909+0000 7f386544a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f385c200ab0 con 0x564d42ac3420 2024-09-11T22:22:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.909+0000 7f386544a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f385c1fee90 con 0x564d42abbbc0 2024-09-11T22:22:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.909+0000 7f386544a740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f385c1ff4e0 con 0x564d42a7f4f0 2024-09-11T22:22:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.909+0000 7f3860c49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 0x564d42ae8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.909+0000 7f3860c49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 0x564d42ae8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36280/0 (socket says 172.21.15.50:36280) 2024-09-11T22:22:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.909+0000 7f3860c49640 1 -- 172.21.15.50:0/729999509 learned_addr learned my addr 172.21.15.50:0/729999509 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.910+0000 7f385bfff640 1 --2- 172.21.15.50:0/729999509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42a7f4f0 0x564d42aa2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.910+0000 7f385b7fe640 1 --2- 172.21.15.50:0/729999509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42abbbc0 0x564d42ab9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.910+0000 7f3860c49640 1 -- 172.21.15.50:0/729999509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42a7f4f0 msgr2=0x564d42aa2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.910+0000 7f3860c49640 1 --2- 172.21.15.50:0/729999509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42a7f4f0 0x564d42aa2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.910+0000 7f3860c49640 1 -- 172.21.15.50:0/729999509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42abbbc0 msgr2=0x564d42ab9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.910+0000 7f3860c49640 1 --2- 172.21.15.50:0/729999509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42abbbc0 0x564d42ab9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.910+0000 7f3860c49640 1 -- 172.21.15.50:0/729999509 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d426b3e20 con 0x564d42ac3420 2024-09-11T22:22:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.910+0000 7f3860c49640 1 --2- 172.21.15.50:0/729999509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 0x564d42ae8110 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f38540056c0 tx=0x7f3854013700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbbff5b22051915 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.910+0000 7f3841ffb640 1 -- 172.21.15.50:0/729999509 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854006d50 con 0x564d42ac3420 2024-09-11T22:22:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.910+0000 7f3841ffb640 1 -- 172.21.15.50:0/729999509 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3854007030 con 0x564d42ac3420 2024-09-11T22:22:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.910+0000 7f3841ffb640 1 -- 172.21.15.50:0/729999509 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854007420 con 0x564d42ac3420 2024-09-11T22:22:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.910+0000 7f386544a740 1 -- 172.21.15.50:0/729999509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 msgr2=0x564d42ae8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.910+0000 7f386544a740 1 --2- 172.21.15.50:0/729999509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 0x564d42ae8110 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f38540056c0 tx=0x7f3854013700 comp rx=0 tx=0).stop 2024-09-11T22:22:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.911+0000 7f386544a740 1 -- 172.21.15.50:0/729999509 shutdown_connections 2024-09-11T22:22:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.911+0000 7f386544a740 1 --2- 172.21.15.50:0/729999509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 0x564d42ae8110 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.911+0000 7f386544a740 1 --2- 172.21.15.50:0/729999509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42abbbc0 0x564d42ab9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.911+0000 7f386544a740 1 --2- 172.21.15.50:0/729999509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42a7f4f0 0x564d42aa2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.911+0000 7f386544a740 1 -- 172.21.15.50:0/729999509 >> 172.21.15.50:0/729999509 conn(0x564d42ac2fc0 msgr2=0x564d42ac3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.911+0000 7f386544a740 1 -- 172.21.15.50:0/729999509 shutdown_connections 2024-09-11T22:22:18.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.911+0000 7f386544a740 1 -- 172.21.15.50:0/729999509 wait complete. 2024-09-11T22:22:18.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.911+0000 7f386544a740 1 -- start start 2024-09-11T22:22:18.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.911+0000 7f386544a740 1 Processor -- start 2024-09-11T22:22:18.918 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T22:22:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f386544a740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42a7f4f0 0x564d42ae8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f386544a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42abbbc0 0x564d42b417a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f386544a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 0x564d42aa3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f386544a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564d42aa3b10 con 0x564d42ac3420 2024-09-11T22:22:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f386544a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564d42aa7f90 con 0x564d42abbbc0 2024-09-11T22:22:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f386544a740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564d42abbfc0 con 0x564d42a7f4f0 2024-09-11T22:22:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f386544a740 10 client.0 _ll_register_callbacks cb 0x7f385004b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f3860c49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 0x564d42aa3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f3860c49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 0x564d42aa3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36296/0 (socket says 172.21.15.50:36296) 2024-09-11T22:22:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f3860c49640 1 -- 172.21.15.50:0/3578844050 learned_addr learned my addr 172.21.15.50:0/3578844050 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:18.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f385bfff640 1 --2- 172.21.15.50:0/3578844050 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42a7f4f0 0x564d42ae8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f385b7fe640 1 --2- 172.21.15.50:0/3578844050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42abbbc0 0x564d42b417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f3860c49640 1 -- 172.21.15.50:0/3578844050 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42a7f4f0 msgr2=0x564d42ae8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f3860c49640 1 --2- 172.21.15.50:0/3578844050 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42a7f4f0 0x564d42ae8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f3860c49640 1 -- 172.21.15.50:0/3578844050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42abbbc0 msgr2=0x564d42b417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:18.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f3860c49640 1 --2- 172.21.15.50:0/3578844050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42abbbc0 0x564d42b417a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.912+0000 7f3860c49640 1 -- 172.21.15.50:0/3578844050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d42ac4b10 con 0x564d42ac3420 2024-09-11T22:22:18.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f3860c49640 1 --2- 172.21.15.50:0/3578844050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 0x564d42aa3fd0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f3854005400 tx=0x7f3854003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1855129211186ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:18.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f383affd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:18.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f383affd640 1 -- 172.21.15.50:0/3578844050 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854007470 con 0x564d42ac3420 2024-09-11T22:22:18.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f383affd640 1 -- 172.21.15.50:0/3578844050 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f3854007610 con 0x564d42ac3420 2024-09-11T22:22:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f386544a740 1 -- 172.21.15.50:0/3578844050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3854007030 con 0x564d42ac3420 2024-09-11T22:22:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f383affd640 1 -- 172.21.15.50:0/3578844050 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f3854007810 con 0x564d42ac3420 2024-09-11T22:22:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f386544a740 10 client.10140 fetch_fsmap learned FSMap version 123 2024-09-11T22:22:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f386544a740 1 -- 172.21.15.50:0/3578844050 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x564d42aa8ae0 con 0x564d42ac3420 2024-09-11T22:22:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f383affd640 1 -- 172.21.15.50:0/3578844050 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3854007030 con 0x564d42ac3420 2024-09-11T22:22:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f383affd640 1 -- 172.21.15.50:0/3578844050 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 123) ==== 3490+0+0 (secure 0 0 0) 0x7f3854035080 con 0x564d42ac3420 2024-09-11T22:22:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f386544a740 10 client.10140 fetch_fsmap finished waiting for FSMap version 123 2024-09-11T22:22:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f386544a740 10 client.10140 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:22:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f386544a740 20 client.10140 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f386544a740 1 --2- 172.21.15.50:0/3578844050 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x564d42ac5800 0x564d42a7eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f386544a740 4 client.10140 mds_command: new command op to 9900 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-11T22:22:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f386544a740 1 -- 172.21.15.50:0/3578844050 --> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x564d429e9320 con 0x564d42ac5800 2024-09-11T22:22:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.913+0000 7f385bfff640 1 --2- 172.21.15.50:0/3578844050 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x564d42ac5800 0x564d42a7eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:18.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f385bfff640 1 --2- 172.21.15.50:0/3578844050 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x564d42ac5800 0x564d42a7eba0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9900 client_cookie=d701d5df96fc9e23 server_cookie=3f785f64f19d0699 in_seq=0 out_seq=0 2024-09-11T22:22:18.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f383affd640 10 client.10140 ms_handle_connect on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:18.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f383affd640 1 -- 172.21.15.50:0/3578844050 <== mds.9900 v2:172.21.15.50:6834/2009878103 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x564d429e9320 con 0x564d42ac5800 2024-09-11T22:22:18.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f383affd640 10 client.10140 handle_command_reply: tid=0 2024-09-11T22:22:18.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f386544a740 1 client.10140 shutdown 2024-09-11T22:22:18.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f386544a740 1 -- 172.21.15.50:0/3578844050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 msgr2=0x564d42aa3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:18.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f386544a740 1 --2- 172.21.15.50:0/3578844050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 0x564d42aa3fd0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f3854005400 tx=0x7f3854003a70 comp rx=0 tx=0).stop 2024-09-11T22:22:18.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f386544a740 1 -- 172.21.15.50:0/3578844050 shutdown_connections 2024-09-11T22:22:18.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f386544a740 1 --2- 172.21.15.50:0/3578844050 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x564d42ac5800 0x564d42a7eba0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f386544a740 1 --2- 172.21.15.50:0/3578844050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d42ac3420 0x564d42aa3fd0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f386544a740 1 --2- 172.21.15.50:0/3578844050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d42abbbc0 0x564d42b417a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f386544a740 1 --2- 172.21.15.50:0/3578844050 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564d42a7f4f0 0x564d42ae8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:18.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f383affd640 0 client.10140 ms_handle_reset on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:18.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f386544a740 1 -- 172.21.15.50:0/3578844050 >> 172.21.15.50:0/3578844050 conn(0x564d42ac2fc0 msgr2=0x564d42aa27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:18.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f386544a740 1 -- 172.21.15.50:0/3578844050 shutdown_connections 2024-09-11T22:22:18.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f386544a740 1 -- 172.21.15.50:0/3578844050 wait complete. 2024-09-11T22:22:18.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:18.914+0000 7f386544a740 20 client.10140 trim_cache size 0 max 16384 2024-09-11T22:22:18.923 INFO:teuthology.orchestra.run.smithi050.stderr:Error EINVAL: MDS is not active 2024-09-11T22:22:18.924 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub abort 2024-09-11T22:22:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.027+0000 7f1e4a477640 1 Processor -- start 2024-09-11T22:22:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.028+0000 7f1e4a477640 1 -- start start 2024-09-11T22:22:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.028+0000 7f1e4a477640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e4415c000 0x7f1e4406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.028+0000 7f1e4a477640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1e4415c3e0 0x7f1e440679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.028+0000 7f1e4a477640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e44067f00 0x7f1e4415fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.028+0000 7f1e4a477640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1e44068370 con 0x7f1e44067f00 2024-09-11T22:22:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.028+0000 7f1e4a477640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1e441631b0 con 0x7f1e4415c3e0 2024-09-11T22:22:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.028+0000 7f1e4a477640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1e44162ed0 con 0x7f1e4415c000 2024-09-11T22:22:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.029+0000 7f1e48a14640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e44067f00 0x7f1e4415fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.029+0000 7f1e48a14640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e44067f00 0x7f1e4415fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36302/0 (socket says 172.21.15.50:36302) 2024-09-11T22:22:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.029+0000 7f1e48a14640 1 -- 172.21.15.50:0/1062975747 learned_addr learned my addr 172.21.15.50:0/1062975747 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.029+0000 7f1e43fff640 1 --2- 172.21.15.50:0/1062975747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e4415c000 0x7f1e4406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.029+0000 7f1e437fe640 1 --2- 172.21.15.50:0/1062975747 >> v2:172.21.15.77:3300/0 conn(0x7f1e4415c3e0 0x7f1e440679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.029+0000 7f1e48a14640 1 -- 172.21.15.50:0/1062975747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e4415c000 msgr2=0x7f1e4406ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.029+0000 7f1e48a14640 1 --2- 172.21.15.50:0/1062975747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e4415c000 0x7f1e4406ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.029+0000 7f1e48a14640 1 -- 172.21.15.50:0/1062975747 >> v2:172.21.15.77:3300/0 conn(0x7f1e4415c3e0 msgr2=0x7f1e440679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.029+0000 7f1e48a14640 1 --2- 172.21.15.50:0/1062975747 >> v2:172.21.15.77:3300/0 conn(0x7f1e4415c3e0 0x7f1e440679c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.029+0000 7f1e48a14640 1 -- 172.21.15.50:0/1062975747 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4406e290 con 0x7f1e44067f00 2024-09-11T22:22:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.029+0000 7f1e43fff640 1 --2- 172.21.15.50:0/1062975747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e4415c000 0x7f1e4406ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.029+0000 7f1e437fe640 1 --2- 172.21.15.50:0/1062975747 >> v2:172.21.15.77:3300/0 conn(0x7f1e4415c3e0 0x7f1e440679c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.030+0000 7f1e48a14640 1 --2- 172.21.15.50:0/1062975747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e44067f00 0x7f1e4415fde0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f1e44068680 tx=0x7f1e3c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e4ab3837b97b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.030+0000 7f1e42ffd640 1 -- 172.21.15.50:0/1062975747 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c036070 con 0x7f1e44067f00 2024-09-11T22:22:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.030+0000 7f1e42ffd640 1 -- 172.21.15.50:0/1062975747 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c031600 con 0x7f1e44067f00 2024-09-11T22:22:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.030+0000 7f1e42ffd640 1 -- 172.21.15.50:0/1062975747 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0319d0 con 0x7f1e44067f00 2024-09-11T22:22:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.030+0000 7f1e4a477640 1 -- 172.21.15.50:0/1062975747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e44067f00 msgr2=0x7f1e4415fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.030+0000 7f1e4a477640 1 --2- 172.21.15.50:0/1062975747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e44067f00 0x7f1e4415fde0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f1e44068680 tx=0x7f1e3c02a610 comp rx=0 tx=0).stop 2024-09-11T22:22:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.030+0000 7f1e4a477640 1 -- 172.21.15.50:0/1062975747 shutdown_connections 2024-09-11T22:22:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.030+0000 7f1e4a477640 1 --2- 172.21.15.50:0/1062975747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e44067f00 0x7f1e4415fde0 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.030+0000 7f1e4a477640 1 --2- 172.21.15.50:0/1062975747 >> v2:172.21.15.77:3300/0 conn(0x7f1e4415c3e0 0x7f1e440679c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.030+0000 7f1e4a477640 1 --2- 172.21.15.50:0/1062975747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e4415c000 0x7f1e4406ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.030+0000 7f1e4a477640 1 -- 172.21.15.50:0/1062975747 >> 172.21.15.50:0/1062975747 conn(0x7f1e44075030 msgr2=0x7f1e4406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.030+0000 7f1e4a477640 1 -- 172.21.15.50:0/1062975747 shutdown_connections 2024-09-11T22:22:19.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.030+0000 7f1e4a477640 1 -- 172.21.15.50:0/1062975747 wait complete. 2024-09-11T22:22:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.032+0000 7f1e4a477640 1 Processor -- start 2024-09-11T22:22:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.032+0000 7f1e4a477640 1 -- start start 2024-09-11T22:22:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e4a477640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e44067f00 0x7f1e4414a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e4a477640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e4415c000 0x7f1e44154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e4a477640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e4415c3e0 0x7f1e44161400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e4a477640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4406f2b0 con 0x7f1e4415c3e0 2024-09-11T22:22:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e4a477640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4406e850 con 0x7f1e4415c000 2024-09-11T22:22:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e4a477640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4406f430 con 0x7f1e44067f00 2024-09-11T22:22:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e48a14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e4415c3e0 0x7f1e44161400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e48a14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e4415c3e0 0x7f1e44161400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36312/0 (socket says 172.21.15.50:36312) 2024-09-11T22:22:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e48a14640 1 -- 172.21.15.50:0/2237325363 learned_addr learned my addr 172.21.15.50:0/2237325363 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e43fff640 1 --2- 172.21.15.50:0/2237325363 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e44067f00 0x7f1e4414a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e437fe640 1 --2- 172.21.15.50:0/2237325363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e4415c000 0x7f1e44154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e48a14640 1 -- 172.21.15.50:0/2237325363 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e44067f00 msgr2=0x7f1e4414a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e48a14640 1 --2- 172.21.15.50:0/2237325363 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e44067f00 0x7f1e4414a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e48a14640 1 -- 172.21.15.50:0/2237325363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e4415c000 msgr2=0x7f1e44154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e48a14640 1 --2- 172.21.15.50:0/2237325363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e4415c000 0x7f1e44154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e48a14640 1 -- 172.21.15.50:0/2237325363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e44155ba0 con 0x7f1e4415c3e0 2024-09-11T22:22:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e437fe640 1 --2- 172.21.15.50:0/2237325363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e4415c000 0x7f1e44154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e48a14640 1 --2- 172.21.15.50:0/2237325363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e4415c3e0 0x7f1e44161400 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c02ac00 tx=0x7f1e3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e40ff9640 1 -- 172.21.15.50:0/2237325363 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c03f020 con 0x7f1e4415c3e0 2024-09-11T22:22:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e40ff9640 1 -- 172.21.15.50:0/2237325363 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c037040 con 0x7f1e4415c3e0 2024-09-11T22:22:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.033+0000 7f1e40ff9640 1 -- 172.21.15.50:0/2237325363 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c036070 con 0x7f1e4415c3e0 2024-09-11T22:22:19.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.034+0000 7f1e4a477640 1 -- 172.21.15.50:0/2237325363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e441555e0 con 0x7f1e4415c3e0 2024-09-11T22:22:19.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.034+0000 7f1e4a477640 1 -- 172.21.15.50:0/2237325363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e441565a0 con 0x7f1e4415c3e0 2024-09-11T22:22:19.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.036+0000 7f1e40ff9640 1 -- 172.21.15.50:0/2237325363 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e3c042020 con 0x7f1e4415c3e0 2024-09-11T22:22:19.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.036+0000 7f1e40ff9640 1 --2- 172.21.15.50:0/2237325363 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e3006be30 0x7f1e3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.036+0000 7f1e40ff9640 1 -- 172.21.15.50:0/2237325363 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f1e3c0ab2d0 con 0x7f1e4415c3e0 2024-09-11T22:22:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.036+0000 7f1e43fff640 1 --2- 172.21.15.50:0/2237325363 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e3006be30 0x7f1e3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.037+0000 7f1e4d212740 1 Processor -- start 2024-09-11T22:22:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.037+0000 7f1e43fff640 1 --2- 172.21.15.50:0/2237325363 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1e3006be30 0x7f1e3006e2f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1e34006fd0 tx=0x7f1e34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.037+0000 7f1e4d212740 1 -- start start 2024-09-11T22:22:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.037+0000 7f1e4d212740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d844800 0x55f37d844be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.037+0000 7f1e4d212740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d841fc0 0x55f37d843b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.037+0000 7f1e4d212740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d842420 0x55f37d824780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.037+0000 7f1e4d212740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f37d7608a0 con 0x55f37d841fc0 2024-09-11T22:22:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.037+0000 7f1e4d212740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f37d7085f0 con 0x55f37d844800 2024-09-11T22:22:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.037+0000 7f1e4d212740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f37d75c860 con 0x55f37d842420 2024-09-11T22:22:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e437fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d841fc0 0x55f37d843b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e437fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d841fc0 0x55f37d843b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36320/0 (socket says 172.21.15.50:36320) 2024-09-11T22:22:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e437fe640 1 -- 172.21.15.50:0/1779931770 learned_addr learned my addr 172.21.15.50:0/1779931770 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e43fff640 1 --2- 172.21.15.50:0/1779931770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d844800 0x55f37d844be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e48a14640 1 --2- 172.21.15.50:0/1779931770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d842420 0x55f37d824780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e437fe640 1 -- 172.21.15.50:0/1779931770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d842420 msgr2=0x55f37d824780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e437fe640 1 --2- 172.21.15.50:0/1779931770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d842420 0x55f37d824780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e437fe640 1 -- 172.21.15.50:0/1779931770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d844800 msgr2=0x55f37d844be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e437fe640 1 --2- 172.21.15.50:0/1779931770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d844800 0x55f37d844be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e437fe640 1 -- 172.21.15.50:0/1779931770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37d457120 con 0x55f37d841fc0 2024-09-11T22:22:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e437fe640 1 --2- 172.21.15.50:0/1779931770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d841fc0 0x55f37d843b50 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009950 tx=0x7f1e38009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c875d8d6400c1e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e29ffb640 1 -- 172.21.15.50:0/1779931770 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e38017020 con 0x55f37d841fc0 2024-09-11T22:22:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e29ffb640 1 -- 172.21.15.50:0/1779931770 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3800ea10 con 0x55f37d841fc0 2024-09-11T22:22:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.038+0000 7f1e29ffb640 1 -- 172.21.15.50:0/1779931770 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3800f040 con 0x55f37d841fc0 2024-09-11T22:22:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.039+0000 7f1e4d212740 1 -- 172.21.15.50:0/1779931770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d841fc0 msgr2=0x55f37d843b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.039+0000 7f1e4d212740 1 --2- 172.21.15.50:0/1779931770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d841fc0 0x55f37d843b50 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009950 tx=0x7f1e38009e10 comp rx=0 tx=0).stop 2024-09-11T22:22:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.039+0000 7f1e4d212740 1 -- 172.21.15.50:0/1779931770 shutdown_connections 2024-09-11T22:22:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.039+0000 7f1e4d212740 1 --2- 172.21.15.50:0/1779931770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d842420 0x55f37d824780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.039+0000 7f1e4d212740 1 --2- 172.21.15.50:0/1779931770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d841fc0 0x55f37d843b50 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.039+0000 7f1e4d212740 1 --2- 172.21.15.50:0/1779931770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d844800 0x55f37d844be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.039+0000 7f1e4d212740 1 -- 172.21.15.50:0/1779931770 >> 172.21.15.50:0/1779931770 conn(0x55f37d7fa6f0 msgr2=0x55f37d842870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.039+0000 7f1e4d212740 1 -- 172.21.15.50:0/1779931770 shutdown_connections 2024-09-11T22:22:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.039+0000 7f1e4d212740 1 -- 172.21.15.50:0/1779931770 wait complete. 2024-09-11T22:22:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.039+0000 7f1e4d212740 1 -- start start 2024-09-11T22:22:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.040+0000 7f1e4d212740 1 Processor -- start 2024-09-11T22:22:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.040+0000 7f1e4d212740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d842420 0x55f37d827bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.040+0000 7f1e4d212740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d844800 0x55f37d81ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.040+0000 7f1e4d212740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d83ce60 0x55f37d83f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.040+0000 7f1e4d212740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f37d840f20 con 0x55f37d83ce60 2024-09-11T22:22:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.040+0000 7f1e4d212740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f37d6e93f0 con 0x55f37d842420 2024-09-11T22:22:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.040+0000 7f1e4d212740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f37d841200 con 0x55f37d844800 2024-09-11T22:22:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.040+0000 7f1e4d212740 10 client.0 _ll_register_callbacks cb 0x55f37d472910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e48a14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d83ce60 0x55f37d83f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e48a14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d83ce60 0x55f37d83f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36328/0 (socket says 172.21.15.50:36328) 2024-09-11T22:22:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e43fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d842420 0x55f37d827bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e48a14640 1 -- 172.21.15.50:0/4109278172 learned_addr learned my addr 172.21.15.50:0/4109278172 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e437fe640 1 --2- 172.21.15.50:0/4109278172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d844800 0x55f37d81ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e48a14640 1 -- 172.21.15.50:0/4109278172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d844800 msgr2=0x55f37d81ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e48a14640 1 --2- 172.21.15.50:0/4109278172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d844800 0x55f37d81ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e48a14640 1 -- 172.21.15.50:0/4109278172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d842420 msgr2=0x55f37d827bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e48a14640 1 --2- 172.21.15.50:0/4109278172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d842420 0x55f37d827bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e48a14640 1 -- 172.21.15.50:0/4109278172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37d53d500 con 0x55f37d83ce60 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e48a14640 1 --2- 172.21.15.50:0/4109278172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d83ce60 0x55f37d83f170 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c079310 tx=0x7f1e3c031600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6ca9abbe3d7312 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e22ffd640 1 -- 172.21.15.50:0/4109278172 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c079610 con 0x55f37d83ce60 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e22ffd640 1 -- 172.21.15.50:0/4109278172 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f1e3c077910 con 0x55f37d83ce60 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e4d212740 1 -- 172.21.15.50:0/4109278172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e3800ea10 con 0x55f37d83ce60 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e22ffd640 1 -- 172.21.15.50:0/4109278172 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f1e3c07d9c0 con 0x55f37d83ce60 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e4d212740 10 client.10152 fetch_fsmap learned FSMap version 123 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e4d212740 1 -- 172.21.15.50:0/4109278172 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x55f37d59dc90 con 0x55f37d83ce60 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e22ffd640 1 -- 172.21.15.50:0/4109278172 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3800ea10 con 0x55f37d83ce60 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.041+0000 7f1e22ffd640 1 -- 172.21.15.50:0/4109278172 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 123) ==== 3490+0+0 (secure 0 0 0) 0x7f1e3c07eb50 con 0x55f37d83ce60 2024-09-11T22:22:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.042+0000 7f1e4d212740 10 client.10152 fetch_fsmap finished waiting for FSMap version 123 2024-09-11T22:22:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.042+0000 7f1e4d212740 10 client.10152 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:22:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.042+0000 7f1e4d212740 20 client.10152 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.042+0000 7f1e4d212740 1 --2- 172.21.15.50:0/4109278172 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55f37d825850 0x55f37d825c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.042+0000 7f1e4d212740 4 client.10152 mds_command: new command op to 9900 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:22:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.042+0000 7f1e4d212740 1 -- 172.21.15.50:0/4109278172 --> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f37d76dfd0 con 0x55f37d825850 2024-09-11T22:22:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.042+0000 7f1e43fff640 1 --2- 172.21.15.50:0/4109278172 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55f37d825850 0x55f37d825c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.042+0000 7f1e22ffd640 10 client.10152 ms_handle_connect on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.042+0000 7f1e43fff640 1 --2- 172.21.15.50:0/4109278172 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55f37d825850 0x55f37d825c30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9900 client_cookie=b5b7c5d911600350 server_cookie=cf00c0ca38e27d36 in_seq=0 out_seq=0 2024-09-11T22:22:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e22ffd640 1 -- 172.21.15.50:0/4109278172 <== mds.9900 v2:172.21.15.50:6834/2009878103 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f37d76dfd0 con 0x55f37d825850 2024-09-11T22:22:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e22ffd640 10 client.10152 handle_command_reply: tid=0 2024-09-11T22:22:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e4d212740 1 client.10152 shutdown 2024-09-11T22:22:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e4d212740 1 -- 172.21.15.50:0/4109278172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d83ce60 msgr2=0x55f37d83f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e4d212740 1 --2- 172.21.15.50:0/4109278172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d83ce60 0x55f37d83f170 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c079310 tx=0x7f1e3c031600 comp rx=0 tx=0).stop 2024-09-11T22:22:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e4d212740 1 -- 172.21.15.50:0/4109278172 shutdown_connections 2024-09-11T22:22:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e4d212740 1 --2- 172.21.15.50:0/4109278172 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55f37d825850 0x55f37d825c30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e4d212740 1 --2- 172.21.15.50:0/4109278172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d844800 0x55f37d81ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e4d212740 1 --2- 172.21.15.50:0/4109278172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d83ce60 0x55f37d83f170 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e4d212740 1 --2- 172.21.15.50:0/4109278172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d842420 0x55f37d827bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e4d212740 1 -- 172.21.15.50:0/4109278172 >> 172.21.15.50:0/4109278172 conn(0x55f37d841fc0 msgr2=0x55f37d824d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e22ffd640 0 client.10152 ms_handle_reset on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e4d212740 1 -- 172.21.15.50:0/4109278172 shutdown_connections 2024-09-11T22:22:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e4d212740 1 -- 172.21.15.50:0/4109278172 wait complete. 2024-09-11T22:22:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.043+0000 7f1e4d212740 20 client.10152 trim_cache size 0 max 16384 2024-09-11T22:22:19.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.060+0000 7f1e4d212740 1 Processor -- start 2024-09-11T22:22:19.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.060+0000 7f1e4d212740 1 -- start start 2024-09-11T22:22:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.061+0000 7f1e4d212740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d83ce60 0x55f37d846270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.061+0000 7f1e4d212740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d842420 0x55f37d8216a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.061+0000 7f1e4d212740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d844800 0x55f37d843970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.061+0000 7f1e4d212740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1e44200cb0 con 0x55f37d844800 2024-09-11T22:22:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.061+0000 7f1e4d212740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1e440ce910 con 0x55f37d842420 2024-09-11T22:22:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.061+0000 7f1e4d212740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1e44157ab0 con 0x55f37d83ce60 2024-09-11T22:22:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.061+0000 7f1e48a14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d844800 0x55f37d843970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.061+0000 7f1e48a14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d844800 0x55f37d843970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36334/0 (socket says 172.21.15.50:36334) 2024-09-11T22:22:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.061+0000 7f1e48a14640 1 -- 172.21.15.50:0/3884792200 learned_addr learned my addr 172.21.15.50:0/3884792200 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.061+0000 7f1e43fff640 1 --2- 172.21.15.50:0/3884792200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d83ce60 0x55f37d846270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.061+0000 7f1e437fe640 1 --2- 172.21.15.50:0/3884792200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d842420 0x55f37d8216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e48a14640 1 -- 172.21.15.50:0/3884792200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d83ce60 msgr2=0x55f37d846270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e48a14640 1 --2- 172.21.15.50:0/3884792200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d83ce60 0x55f37d846270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e48a14640 1 -- 172.21.15.50:0/3884792200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d842420 msgr2=0x55f37d8216a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e48a14640 1 --2- 172.21.15.50:0/3884792200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d842420 0x55f37d8216a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e48a14640 1 -- 172.21.15.50:0/3884792200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37d432e20 con 0x55f37d844800 2024-09-11T22:22:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e43fff640 1 --2- 172.21.15.50:0/3884792200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d83ce60 0x55f37d846270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e48a14640 1 --2- 172.21.15.50:0/3884792200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d844800 0x55f37d843970 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c075f90 tx=0x7f1e3c07c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f52a5553880a820 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e297fa640 1 -- 172.21.15.50:0/3884792200 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c079610 con 0x55f37d844800 2024-09-11T22:22:19.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e297fa640 1 -- 172.21.15.50:0/3884792200 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c0776b0 con 0x55f37d844800 2024-09-11T22:22:19.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e297fa640 1 -- 172.21.15.50:0/3884792200 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c07eb50 con 0x55f37d844800 2024-09-11T22:22:19.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e4d212740 1 -- 172.21.15.50:0/3884792200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d844800 msgr2=0x55f37d843970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e4d212740 1 --2- 172.21.15.50:0/3884792200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d844800 0x55f37d843970 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c075f90 tx=0x7f1e3c07c000 comp rx=0 tx=0).stop 2024-09-11T22:22:19.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e4d212740 1 -- 172.21.15.50:0/3884792200 shutdown_connections 2024-09-11T22:22:19.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e4d212740 1 --2- 172.21.15.50:0/3884792200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d844800 0x55f37d843970 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e4d212740 1 --2- 172.21.15.50:0/3884792200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d842420 0x55f37d8216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e4d212740 1 --2- 172.21.15.50:0/3884792200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d83ce60 0x55f37d846270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.062+0000 7f1e4d212740 1 -- 172.21.15.50:0/3884792200 >> 172.21.15.50:0/3884792200 conn(0x55f37d841fc0 msgr2=0x55f37d843160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:19.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.063+0000 7f1e4d212740 1 -- 172.21.15.50:0/3884792200 shutdown_connections 2024-09-11T22:22:19.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.063+0000 7f1e4d212740 1 -- 172.21.15.50:0/3884792200 wait complete. 2024-09-11T22:22:19.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.063+0000 7f1e4d212740 1 -- start start 2024-09-11T22:22:19.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.063+0000 7f1e4d212740 1 Processor -- start 2024-09-11T22:22:19.072 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T22:22:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e4d212740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d83ce60 0x55f37d8c1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e4d212740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d842420 0x55f37d827130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e4d212740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d844800 0x55f37d827670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e4d212740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f37d840f20 con 0x55f37d842420 2024-09-11T22:22:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e4d212740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f37d6e93f0 con 0x55f37d83ce60 2024-09-11T22:22:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e4d212740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f37d83a250 con 0x55f37d844800 2024-09-11T22:22:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e4d212740 10 client.0 _ll_register_callbacks cb 0x7f1e3c0793e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e437fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d842420 0x55f37d827130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e437fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d842420 0x55f37d827130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36346/0 (socket says 172.21.15.50:36346) 2024-09-11T22:22:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e437fe640 1 -- 172.21.15.50:0/1256218912 learned_addr learned my addr 172.21.15.50:0/1256218912 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e43fff640 1 --2- 172.21.15.50:0/1256218912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d83ce60 0x55f37d8c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e48a14640 1 --2- 172.21.15.50:0/1256218912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d844800 0x55f37d827670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e437fe640 1 -- 172.21.15.50:0/1256218912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d844800 msgr2=0x55f37d827670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e437fe640 1 --2- 172.21.15.50:0/1256218912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d844800 0x55f37d827670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e437fe640 1 -- 172.21.15.50:0/1256218912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d83ce60 msgr2=0x55f37d8c1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e437fe640 1 --2- 172.21.15.50:0/1256218912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d83ce60 0x55f37d8c1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.064+0000 7f1e437fe640 1 -- 172.21.15.50:0/1256218912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37d8556c0 con 0x55f37d842420 2024-09-11T22:22:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e437fe640 1 --2- 172.21.15.50:0/1256218912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d842420 0x55f37d827130 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f1e38000c00 tx=0x7f1e38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe74e9c0e194a9d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e22ffd640 1 -- 172.21.15.50:0/1256218912 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e38017040 con 0x55f37d842420 2024-09-11T22:22:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e22ffd640 1 -- 172.21.15.50:0/1256218912 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f1e3800ec20 con 0x55f37d842420 2024-09-11T22:22:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e4d212740 1 -- 172.21.15.50:0/1256218912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e3c0776b0 con 0x55f37d842420 2024-09-11T22:22:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e22ffd640 1 -- 172.21.15.50:0/1256218912 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f1e3800ee20 con 0x55f37d842420 2024-09-11T22:22:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e4d212740 10 client.10158 fetch_fsmap learned FSMap version 123 2024-09-11T22:22:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e4d212740 1 -- 172.21.15.50:0/1256218912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x55f37d81ea20 con 0x55f37d842420 2024-09-11T22:22:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e22ffd640 1 -- 172.21.15.50:0/1256218912 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c0776b0 con 0x55f37d842420 2024-09-11T22:22:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e22ffd640 1 -- 172.21.15.50:0/1256218912 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 123) ==== 3490+0+0 (secure 0 0 0) 0x7f1e38012050 con 0x55f37d842420 2024-09-11T22:22:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e4d212740 10 client.10158 fetch_fsmap finished waiting for FSMap version 123 2024-09-11T22:22:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e4d212740 10 client.10158 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:22:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e4d212740 20 client.10158 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e4d212740 1 --2- 172.21.15.50:0/1256218912 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55f37d826580 0x55f37d7fda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e4d212740 4 client.10158 mds_command: new command op to 9900 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-11T22:22:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e4d212740 1 -- 172.21.15.50:0/1256218912 --> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55f37d768320 con 0x55f37d826580 2024-09-11T22:22:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.065+0000 7f1e43fff640 1 --2- 172.21.15.50:0/1256218912 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55f37d826580 0x55f37d7fda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e22ffd640 10 client.10158 ms_handle_connect on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e43fff640 1 --2- 172.21.15.50:0/1256218912 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55f37d826580 0x55f37d7fda10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9900 client_cookie=1c00cadb000912ae server_cookie=9911eae86a67568 in_seq=0 out_seq=0 2024-09-11T22:22:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e22ffd640 1 -- 172.21.15.50:0/1256218912 <== mds.9900 v2:172.21.15.50:6834/2009878103 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55f37d768320 con 0x55f37d826580 2024-09-11T22:22:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e22ffd640 10 client.10158 handle_command_reply: tid=0 2024-09-11T22:22:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e4d212740 1 client.10158 shutdown 2024-09-11T22:22:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e4d212740 1 -- 172.21.15.50:0/1256218912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d842420 msgr2=0x55f37d827130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e4d212740 1 --2- 172.21.15.50:0/1256218912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d842420 0x55f37d827130 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f1e38000c00 tx=0x7f1e38004730 comp rx=0 tx=0).stop 2024-09-11T22:22:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e4d212740 1 -- 172.21.15.50:0/1256218912 shutdown_connections 2024-09-11T22:22:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e4d212740 1 --2- 172.21.15.50:0/1256218912 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55f37d826580 0x55f37d7fda10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e4d212740 1 --2- 172.21.15.50:0/1256218912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f37d844800 0x55f37d827670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e4d212740 1 --2- 172.21.15.50:0/1256218912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f37d842420 0x55f37d827130 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e22ffd640 0 client.10158 ms_handle_reset on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e4d212740 1 --2- 172.21.15.50:0/1256218912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f37d83ce60 0x55f37d8c1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e4d212740 1 -- 172.21.15.50:0/1256218912 >> 172.21.15.50:0/1256218912 conn(0x55f37d841fc0 msgr2=0x55f37d8460a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e4d212740 1 -- 172.21.15.50:0/1256218912 shutdown_connections 2024-09-11T22:22:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e4d212740 1 -- 172.21.15.50:0/1256218912 wait complete. 2024-09-11T22:22:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.066+0000 7f1e4d212740 20 client.10158 trim_cache size 0 max 16384 2024-09-11T22:22:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:Error EINVAL: MDS is not active 2024-09-11T22:22:19.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub resume 2024-09-11T22:22:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.181+0000 7ff1ce786640 1 Processor -- start 2024-09-11T22:22:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.181+0000 7ff1ce786640 1 -- start start 2024-09-11T22:22:19.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1ce786640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c815e840 0x7ff1c80b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1ce786640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1c80cdd50 0x7ff1c80cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1ce786640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff1c80cf3b0 0x7ff1c80d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1ce786640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c806c240 con 0x7ff1c80cdd50 2024-09-11T22:22:19.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1ce786640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c80d0470 con 0x7ff1c80cf3b0 2024-09-11T22:22:19.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1ce786640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c80ce5f0 con 0x7ff1c815e840 2024-09-11T22:22:19.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1c77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1c80cdd50 0x7ff1c80cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1c77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1c80cdd50 0x7ff1c80cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36348/0 (socket says 172.21.15.50:36348) 2024-09-11T22:22:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1c77fe640 1 -- 172.21.15.50:0/1147658452 learned_addr learned my addr 172.21.15.50:0/1147658452 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/1147658452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c815e840 0x7ff1c80b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1ccd23640 1 --2- 172.21.15.50:0/1147658452 >> v2:172.21.15.77:3300/0 conn(0x7ff1c80cf3b0 0x7ff1c80d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1c77fe640 1 -- 172.21.15.50:0/1147658452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c815e840 msgr2=0x7ff1c80b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1c77fe640 1 --2- 172.21.15.50:0/1147658452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c815e840 0x7ff1c80b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1c77fe640 1 -- 172.21.15.50:0/1147658452 >> v2:172.21.15.77:3300/0 conn(0x7ff1c80cf3b0 msgr2=0x7ff1c80d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1c77fe640 1 --2- 172.21.15.50:0/1147658452 >> v2:172.21.15.77:3300/0 conn(0x7ff1c80cf3b0 0x7ff1c80d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.182+0000 7ff1c77fe640 1 -- 172.21.15.50:0/1147658452 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c80ce310 con 0x7ff1c80cdd50 2024-09-11T22:22:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.183+0000 7ff1c77fe640 1 --2- 172.21.15.50:0/1147658452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80cdd50 0x7ff1c80cee70 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009870 tx=0x7ff1bc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8c99c7df5791c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.183+0000 7ff1c6ffd640 1 -- 172.21.15.50:0/1147658452 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc037070 con 0x7ff1c80cdd50 2024-09-11T22:22:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.183+0000 7ff1c6ffd640 1 -- 172.21.15.50:0/1147658452 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc032440 con 0x7ff1c80cdd50 2024-09-11T22:22:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.183+0000 7ff1c6ffd640 1 -- 172.21.15.50:0/1147658452 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc032810 con 0x7ff1c80cdd50 2024-09-11T22:22:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.184+0000 7ff1ce786640 1 -- 172.21.15.50:0/1147658452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80cdd50 msgr2=0x7ff1c80cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.184+0000 7ff1ce786640 1 --2- 172.21.15.50:0/1147658452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80cdd50 0x7ff1c80cee70 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009870 tx=0x7ff1bc02a210 comp rx=0 tx=0).stop 2024-09-11T22:22:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.184+0000 7ff1ce786640 1 -- 172.21.15.50:0/1147658452 shutdown_connections 2024-09-11T22:22:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.184+0000 7ff1ce786640 1 --2- 172.21.15.50:0/1147658452 >> v2:172.21.15.77:3300/0 conn(0x7ff1c80cf3b0 0x7ff1c80d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.184+0000 7ff1ce786640 1 --2- 172.21.15.50:0/1147658452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80cdd50 0x7ff1c80cee70 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.184+0000 7ff1ce786640 1 --2- 172.21.15.50:0/1147658452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c815e840 0x7ff1c80b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.184+0000 7ff1ce786640 1 -- 172.21.15.50:0/1147658452 >> 172.21.15.50:0/1147658452 conn(0x7ff1c80b4150 msgr2=0x7ff1c80b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.184+0000 7ff1ce786640 1 -- 172.21.15.50:0/1147658452 shutdown_connections 2024-09-11T22:22:19.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.184+0000 7ff1ce786640 1 -- 172.21.15.50:0/1147658452 wait complete. 2024-09-11T22:22:19.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.185+0000 7ff1ce786640 1 Processor -- start 2024-09-11T22:22:19.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.185+0000 7ff1ce786640 1 -- start start 2024-09-11T22:22:19.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1ce786640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c80cdd50 0x7ff1c8156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1ce786640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80cf3b0 0x7ff1c80d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1ce786640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c815e840 0x7ff1c80d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1ce786640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c815ec20 con 0x7ff1c80cf3b0 2024-09-11T22:22:19.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1ce786640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c806bed0 con 0x7ff1c815e840 2024-09-11T22:22:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1ce786640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c815eda0 con 0x7ff1c80cdd50 2024-09-11T22:22:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1c77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80cf3b0 0x7ff1c80d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1c77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80cf3b0 0x7ff1c80d05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36360/0 (socket says 172.21.15.50:36360) 2024-09-11T22:22:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1c77fe640 1 -- 172.21.15.50:0/1749852508 learned_addr learned my addr 172.21.15.50:0/1749852508 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/1749852508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c80cdd50 0x7ff1c8156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1ccd23640 1 --2- 172.21.15.50:0/1749852508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c815e840 0x7ff1c80d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1c77fe640 1 -- 172.21.15.50:0/1749852508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c80cdd50 msgr2=0x7ff1c8156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1c77fe640 1 --2- 172.21.15.50:0/1749852508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c80cdd50 0x7ff1c8156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1c77fe640 1 -- 172.21.15.50:0/1749852508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c815e840 msgr2=0x7ff1c80d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.186+0000 7ff1c77fe640 1 --2- 172.21.15.50:0/1749852508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c815e840 0x7ff1c80d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.187+0000 7ff1c77fe640 1 -- 172.21.15.50:0/1749852508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c80c9b80 con 0x7ff1c80cf3b0 2024-09-11T22:22:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.187+0000 7ff1ccd23640 1 --2- 172.21.15.50:0/1749852508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c815e840 0x7ff1c80d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.187+0000 7ff1c77fe640 1 --2- 172.21.15.50:0/1749852508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c80cf3b0 0x7ff1c80d05f0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc02a250 tx=0x7ff1bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.187+0000 7ff1c4ff9640 1 -- 172.21.15.50:0/1749852508 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc041020 con 0x7ff1c80cf3b0 2024-09-11T22:22:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.187+0000 7ff1c4ff9640 1 -- 172.21.15.50:0/1749852508 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc0306c0 con 0x7ff1c80cf3b0 2024-09-11T22:22:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.187+0000 7ff1ce786640 1 -- 172.21.15.50:0/1749852508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c80b5660 con 0x7ff1c80cf3b0 2024-09-11T22:22:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.187+0000 7ff1c4ff9640 1 -- 172.21.15.50:0/1749852508 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc037040 con 0x7ff1c80cf3b0 2024-09-11T22:22:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.187+0000 7ff1ce786640 1 -- 172.21.15.50:0/1749852508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c80c9650 con 0x7ff1c80cf3b0 2024-09-11T22:22:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.189+0000 7ff1c4ff9640 1 -- 172.21.15.50:0/1749852508 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1bc044020 con 0x7ff1c80cf3b0 2024-09-11T22:22:19.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.189+0000 7ff1c4ff9640 1 --2- 172.21.15.50:0/1749852508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff1b406be30 0x7ff1b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.189+0000 7ff1c4ff9640 1 -- 172.21.15.50:0/1749852508 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7ff1bc0ab630 con 0x7ff1c80cf3b0 2024-09-11T22:22:19.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.189+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/1749852508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff1b406be30 0x7ff1b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.190+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/1749852508 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff1b406be30 0x7ff1b406e2f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80079a0 tx=0x7ff1b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.190+0000 7ff1d15fa740 1 Processor -- start 2024-09-11T22:22:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.190+0000 7ff1d15fa740 1 -- start start 2024-09-11T22:22:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1d15fa740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5d5e0 0x55c4f2f5d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1d15fa740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5ada0 0x55c4f2f5c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1d15fa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f5b200 0x55c4f2f3d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1d15fa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c4f2e798d0 con 0x55c4f2f5b200 2024-09-11T22:22:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1d15fa740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c4f2e21620 con 0x55c4f2f5ada0 2024-09-11T22:22:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1d15fa740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c4f2e75890 con 0x55c4f2f5d5e0 2024-09-11T22:22:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1ccd23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f5b200 0x55c4f2f3d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1ccd23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f5b200 0x55c4f2f3d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36368/0 (socket says 172.21.15.50:36368) 2024-09-11T22:22:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1ccd23640 1 -- 172.21.15.50:0/3066463316 learned_addr learned my addr 172.21.15.50:0/3066463316 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1c77fe640 1 --2- 172.21.15.50:0/3066463316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5ada0 0x55c4f2f5c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/3066463316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5d5e0 0x55c4f2f5d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1ccd23640 1 -- 172.21.15.50:0/3066463316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5d5e0 msgr2=0x55c4f2f5d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1ccd23640 1 --2- 172.21.15.50:0/3066463316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5d5e0 0x55c4f2f5d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1ccd23640 1 -- 172.21.15.50:0/3066463316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5ada0 msgr2=0x55c4f2f5c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1ccd23640 1 --2- 172.21.15.50:0/3066463316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5ada0 0x55c4f2f5c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1ccd23640 1 -- 172.21.15.50:0/3066463316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4f2c567d0 con 0x55c4f2f5b200 2024-09-11T22:22:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1ccd23640 1 --2- 172.21.15.50:0/3066463316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f5b200 0x55c4f2f3d560 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0007430 tx=0x7ff1c0007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87a98776f78f9a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.191+0000 7ff1adffb640 1 -- 172.21.15.50:0/3066463316 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c00147e0 con 0x55c4f2f5b200 2024-09-11T22:22:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.192+0000 7ff1adffb640 1 -- 172.21.15.50:0/3066463316 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c001a070 con 0x55c4f2f5b200 2024-09-11T22:22:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.192+0000 7ff1adffb640 1 -- 172.21.15.50:0/3066463316 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0014bc0 con 0x55c4f2f5b200 2024-09-11T22:22:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.192+0000 7ff1d15fa740 1 -- 172.21.15.50:0/3066463316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f5b200 msgr2=0x55c4f2f3d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.192+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/3066463316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f5b200 0x55c4f2f3d560 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0007430 tx=0x7ff1c0007830 comp rx=0 tx=0).stop 2024-09-11T22:22:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.192+0000 7ff1d15fa740 1 -- 172.21.15.50:0/3066463316 shutdown_connections 2024-09-11T22:22:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.192+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/3066463316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f5b200 0x55c4f2f3d560 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.192+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/3066463316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5ada0 0x55c4f2f5c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.192+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/3066463316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5d5e0 0x55c4f2f5d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.192+0000 7ff1d15fa740 1 -- 172.21.15.50:0/3066463316 >> 172.21.15.50:0/3066463316 conn(0x55c4f2f13240 msgr2=0x55c4f2f5b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.192+0000 7ff1d15fa740 1 -- 172.21.15.50:0/3066463316 shutdown_connections 2024-09-11T22:22:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.192+0000 7ff1d15fa740 1 -- 172.21.15.50:0/3066463316 wait complete. 2024-09-11T22:22:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.193+0000 7ff1d15fa740 1 -- start start 2024-09-11T22:22:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.193+0000 7ff1d15fa740 1 Processor -- start 2024-09-11T22:22:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1d15fa740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 0x55c4f2f3bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1d15fa740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 0x55c4f2f570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1d15fa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f54e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1d15fa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c4f2f59d00 con 0x55c4f2f3fee0 2024-09-11T22:22:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1d15fa740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c4f2e02750 con 0x55c4f2f5d5e0 2024-09-11T22:22:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1d15fa740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c4f2f59fe0 con 0x55c4f2f5b200 2024-09-11T22:22:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1d15fa740 10 client.0 _ll_register_callbacks cb 0x55c4f2e26780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1ccd23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f54e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1ccd23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f54e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36380/0 (socket says 172.21.15.50:36380) 2024-09-11T22:22:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1ccd23640 1 -- 172.21.15.50:0/3379648447 learned_addr learned my addr 172.21.15.50:0/3379648447 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/3379648447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 0x55c4f2f3bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1c77fe640 1 --2- 172.21.15.50:0/3379648447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 0x55c4f2f570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1ccd23640 1 -- 172.21.15.50:0/3379648447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 msgr2=0x55c4f2f3bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1ccd23640 1 --2- 172.21.15.50:0/3379648447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 0x55c4f2f3bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1ccd23640 1 -- 172.21.15.50:0/3379648447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 msgr2=0x55c4f2f570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1ccd23640 1 --2- 172.21.15.50:0/3379648447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 0x55c4f2f570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1ccd23640 1 -- 172.21.15.50:0/3379648447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4f2b4c0f0 con 0x55c4f2f3fee0 2024-09-11T22:22:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1ccd23640 1 --2- 172.21.15.50:0/3379648447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f54e20 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x55c4f2f52480 tx=0x7ff1c0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7776d81b58f24d3c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.194+0000 7ff1a6ffd640 1 -- 172.21.15.50:0/3379648447 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0014da0 con 0x55c4f2f3fee0 2024-09-11T22:22:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1a6ffd640 1 -- 172.21.15.50:0/3379648447 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7ff1c0015470 con 0x55c4f2f3fee0 2024-09-11T22:22:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1d15fa740 1 -- 172.21.15.50:0/3379648447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1c001a070 con 0x55c4f2f3fee0 2024-09-11T22:22:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1a6ffd640 1 -- 172.21.15.50:0/3379648447 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7ff1c0031050 con 0x55c4f2f3fee0 2024-09-11T22:22:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1d15fa740 10 client.10170 fetch_fsmap learned FSMap version 123 2024-09-11T22:22:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1d15fa740 1 -- 172.21.15.50:0/3379648447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x55c4f2cb6f60 con 0x55c4f2f3fee0 2024-09-11T22:22:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1a6ffd640 1 -- 172.21.15.50:0/3379648447 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c001a070 con 0x55c4f2f3fee0 2024-09-11T22:22:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1a6ffd640 1 -- 172.21.15.50:0/3379648447 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 123) ==== 3490+0+0 (secure 0 0 0) 0x7ff1c0034020 con 0x55c4f2f3fee0 2024-09-11T22:22:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1d15fa740 10 client.10170 fetch_fsmap finished waiting for FSMap version 123 2024-09-11T22:22:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1d15fa740 10 client.10170 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:22:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1d15fa740 20 client.10170 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/3379648447 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55c4f2f772f0 0x55c4f2f796e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1d15fa740 4 client.10170 mds_command: new command op to 9900 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:22:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1d15fa740 1 -- 172.21.15.50:0/3379648447 --> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4f2e87000 con 0x55c4f2f772f0 2024-09-11T22:22:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/3379648447 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55c4f2f772f0 0x55c4f2f796e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/3379648447 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55c4f2f772f0 0x55c4f2f796e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9900 client_cookie=d153b69ed8a98e2b server_cookie=c5552d6a20dfb98b in_seq=0 out_seq=0 2024-09-11T22:22:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.195+0000 7ff1a6ffd640 10 client.10170 ms_handle_connect on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1a6ffd640 1 -- 172.21.15.50:0/3379648447 <== mds.9900 v2:172.21.15.50:6834/2009878103 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4f2e87000 con 0x55c4f2f772f0 2024-09-11T22:22:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1a6ffd640 10 client.10170 handle_command_reply: tid=0 2024-09-11T22:22:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1d15fa740 1 client.10170 shutdown 2024-09-11T22:22:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1d15fa740 1 -- 172.21.15.50:0/3379648447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 msgr2=0x55c4f2f54e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/3379648447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f54e20 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x55c4f2f52480 tx=0x7ff1c0004ab0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1d15fa740 1 -- 172.21.15.50:0/3379648447 shutdown_connections 2024-09-11T22:22:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/3379648447 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55c4f2f772f0 0x55c4f2f796e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/3379648447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f54e20 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/3379648447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 0x55c4f2f570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1a6ffd640 0 client.10170 ms_handle_reset on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:19.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/3379648447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 0x55c4f2f3bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1d15fa740 1 -- 172.21.15.50:0/3379648447 >> 172.21.15.50:0/3379648447 conn(0x55c4f2f5ada0 msgr2=0x55c4f2f5eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:19.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1d15fa740 1 -- 172.21.15.50:0/3379648447 shutdown_connections 2024-09-11T22:22:19.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1d15fa740 1 -- 172.21.15.50:0/3379648447 wait complete. 2024-09-11T22:22:19.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.196+0000 7ff1d15fa740 20 client.10170 trim_cache size 0 max 16384 2024-09-11T22:22:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.213+0000 7ff1d15fa740 1 Processor -- start 2024-09-11T22:22:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.214+0000 7ff1d15fa740 1 -- start start 2024-09-11T22:22:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.214+0000 7ff1d15fa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f16d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.214+0000 7ff1d15fa740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 0x55c4f2f5f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.214+0000 7ff1d15fa740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 0x55c4f2f0fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.214+0000 7ff1d15fa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c8200d80 con 0x55c4f2f3fee0 2024-09-11T22:22:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.214+0000 7ff1d15fa740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c80cc4c0 con 0x55c4f2f5d5e0 2024-09-11T22:22:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.214+0000 7ff1d15fa740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c80ccb10 con 0x55c4f2f5b200 2024-09-11T22:22:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.214+0000 7ff1c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f16d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.214+0000 7ff1c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f16d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36388/0 (socket says 172.21.15.50:36388) 2024-09-11T22:22:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.214+0000 7ff1c7fff640 1 -- 172.21.15.50:0/2507717053 learned_addr learned my addr 172.21.15.50:0/2507717053 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.214+0000 7ff1ccd23640 1 --2- 172.21.15.50:0/2507717053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 0x55c4f2f0fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.214+0000 7ff1c77fe640 1 --2- 172.21.15.50:0/2507717053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 0x55c4f2f5f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1c7fff640 1 -- 172.21.15.50:0/2507717053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 msgr2=0x55c4f2f5f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/2507717053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 0x55c4f2f5f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1c7fff640 1 -- 172.21.15.50:0/2507717053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 msgr2=0x55c4f2f0fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/2507717053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 0x55c4f2f0fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1c7fff640 1 -- 172.21.15.50:0/2507717053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4f2b251b0 con 0x55c4f2f3fee0 2024-09-11T22:22:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/2507717053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f16d10 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x55c4f2f3c720 tx=0x7ff1b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789bddc69f8cb47c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1ad7fa640 1 -- 172.21.15.50:0/2507717053 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b801c040 con 0x55c4f2f3fee0 2024-09-11T22:22:19.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1ad7fa640 1 -- 172.21.15.50:0/2507717053 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b8016e50 con 0x55c4f2f3fee0 2024-09-11T22:22:19.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1ad7fa640 1 -- 172.21.15.50:0/2507717053 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8010df0 con 0x55c4f2f3fee0 2024-09-11T22:22:19.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1d15fa740 1 -- 172.21.15.50:0/2507717053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 msgr2=0x55c4f2f16d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/2507717053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f16d10 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x55c4f2f3c720 tx=0x7ff1b8016000 comp rx=0 tx=0).stop 2024-09-11T22:22:19.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1d15fa740 1 -- 172.21.15.50:0/2507717053 shutdown_connections 2024-09-11T22:22:19.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/2507717053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 0x55c4f2f5f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/2507717053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 0x55c4f2f0fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/2507717053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f16d10 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.215+0000 7ff1d15fa740 1 -- 172.21.15.50:0/2507717053 >> 172.21.15.50:0/2507717053 conn(0x55c4f2f5ada0 msgr2=0x55c4f2f5d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:19.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.216+0000 7ff1d15fa740 1 -- 172.21.15.50:0/2507717053 shutdown_connections 2024-09-11T22:22:19.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.216+0000 7ff1d15fa740 1 -- 172.21.15.50:0/2507717053 wait complete. 2024-09-11T22:22:19.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.216+0000 7ff1d15fa740 1 -- start start 2024-09-11T22:22:19.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.216+0000 7ff1d15fa740 1 Processor -- start 2024-09-11T22:22:19.223 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T22:22:19.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1d15fa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f3ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1d15fa740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 0x55c4f2fd9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1d15fa740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 0x55c4f2f3e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1d15fa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c4f2f3c5a0 con 0x55c4f2f3fee0 2024-09-11T22:22:19.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1d15fa740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c4f2f3f770 con 0x55c4f2f5d5e0 2024-09-11T22:22:19.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1d15fa740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c4f2f57700 con 0x55c4f2f5b200 2024-09-11T22:22:19.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1d15fa740 10 client.0 _ll_register_callbacks cb 0x7ff1c0009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:19.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f3ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f3ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36400/0 (socket says 172.21.15.50:36400) 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1c7fff640 1 -- 172.21.15.50:0/1538369378 learned_addr learned my addr 172.21.15.50:0/1538369378 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1c77fe640 1 --2- 172.21.15.50:0/1538369378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 0x55c4f2fd9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1ccd23640 1 --2- 172.21.15.50:0/1538369378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 0x55c4f2f3e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1c7fff640 1 -- 172.21.15.50:0/1538369378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 msgr2=0x55c4f2fd9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/1538369378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 0x55c4f2fd9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1c7fff640 1 -- 172.21.15.50:0/1538369378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 msgr2=0x55c4f2f3e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/1538369378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 0x55c4f2f3e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.217+0000 7ff1c7fff640 1 -- 172.21.15.50:0/1538369378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4f2f3f020 con 0x55c4f2f3fee0 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1c7fff640 1 --2- 172.21.15.50:0/1538369378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f3ae10 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8010620 tx=0x7ff1b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc46a5fe9383aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1a6ffd640 1 -- 172.21.15.50:0/1538369378 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8039060 con 0x55c4f2f3fee0 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1a6ffd640 1 -- 172.21.15.50:0/1538369378 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7ff1b802b4d0 con 0x55c4f2f3fee0 2024-09-11T22:22:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1d15fa740 1 -- 172.21.15.50:0/1538369378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1b8016e50 con 0x55c4f2f3fee0 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1a6ffd640 1 -- 172.21.15.50:0/1538369378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7ff1b803f050 con 0x55c4f2f3fee0 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1d15fa740 10 client.10176 fetch_fsmap learned FSMap version 123 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1d15fa740 1 -- 172.21.15.50:0/1538369378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x55c4f2f40b80 con 0x55c4f2f3fee0 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1a6ffd640 1 -- 172.21.15.50:0/1538369378 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b8016e50 con 0x55c4f2f3fee0 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1a6ffd640 1 -- 172.21.15.50:0/1538369378 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 123) ==== 3490+0+0 (secure 0 0 0) 0x7ff1b8042020 con 0x55c4f2f3fee0 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1d15fa740 10 client.10176 fetch_fsmap finished waiting for FSMap version 123 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1d15fa740 10 client.10176 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1d15fa740 20 client.10176 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/1538369378 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55c4f2f69b70 0x55c4f2f69f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1d15fa740 4 client.10176 mds_command: new command op to 9900 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1d15fa740 1 -- 172.21.15.50:0/1538369378 --> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55c4f2e81350 con 0x55c4f2f69b70 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.218+0000 7ff1c77fe640 1 --2- 172.21.15.50:0/1538369378 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55c4f2f69b70 0x55c4f2f69f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1a6ffd640 10 client.10176 ms_handle_connect on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1c77fe640 1 --2- 172.21.15.50:0/1538369378 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55c4f2f69b70 0x55c4f2f69f50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9900 client_cookie=bf239b4c78c5dadd server_cookie=6f2e23683f762e59 in_seq=0 out_seq=0 2024-09-11T22:22:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1a6ffd640 1 -- 172.21.15.50:0/1538369378 <== mds.9900 v2:172.21.15.50:6834/2009878103 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55c4f2e81350 con 0x55c4f2f69b70 2024-09-11T22:22:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1a6ffd640 10 client.10176 handle_command_reply: tid=0 2024-09-11T22:22:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1d15fa740 1 client.10176 shutdown 2024-09-11T22:22:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1d15fa740 1 -- 172.21.15.50:0/1538369378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 msgr2=0x55c4f2f3ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/1538369378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f3ae10 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8010620 tx=0x7ff1b8004730 comp rx=0 tx=0).stop 2024-09-11T22:22:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1d15fa740 1 -- 172.21.15.50:0/1538369378 shutdown_connections 2024-09-11T22:22:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/1538369378 >> [v2:172.21.15.50:6834/2009878103,v1:172.21.15.50:6835/2009878103] conn(0x55c4f2f69b70 0x55c4f2f69f50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/1538369378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4f2f5b200 0x55c4f2fd9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/1538369378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4f2f5d5e0 0x55c4f2f3e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1a6ffd640 0 client.10176 ms_handle_reset on v2:172.21.15.50:6834/2009878103 2024-09-11T22:22:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1d15fa740 1 --2- 172.21.15.50:0/1538369378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c4f2f3fee0 0x55c4f2f3ae10 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1d15fa740 1 -- 172.21.15.50:0/1538369378 >> 172.21.15.50:0/1538369378 conn(0x55c4f2f5ada0 msgr2=0x55c4f2f16d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1d15fa740 1 -- 172.21.15.50:0/1538369378 shutdown_connections 2024-09-11T22:22:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1d15fa740 1 -- 172.21.15.50:0/1538369378 wait complete. 2024-09-11T22:22:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.219+0000 7ff1d15fa740 20 client.10176 trim_cache size 0 max 16384 2024-09-11T22:22:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:Error EINVAL: MDS is not active 2024-09-11T22:22:19.228 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:22:19.228 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:22:19.268 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:22:19.307 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:22:19.307 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:22:19.307 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:22:19.307 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:22:19.325 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:22:19.325 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:22:19.381 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:22:19.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.524+0000 7f07068e4640 1 Processor -- start 2024-09-11T22:22:19.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.525+0000 7f07068e4640 1 -- start start 2024-09-11T22:22:19.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.525+0000 7f07068e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f070015e900 0x7f07000b8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.525+0000 7f07068e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07000cfb60 0x7f07000d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.525+0000 7f07068e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07000b8a50 con 0x7f07000ba1a0 2024-09-11T22:22:19.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.525+0000 7f07068e4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f07000b8d30 con 0x7f07000cfb60 2024-09-11T22:22:19.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.525+0000 7f07068e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f07000b9010 con 0x7f070015e900 2024-09-11T22:22:19.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.526+0000 7f0704e81640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07000cfb60 0x7f07000d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.526+0000 7f0704e81640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07000cfb60 0x7f07000d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36410/0 (socket says 172.21.15.50:36410) 2024-09-11T22:22:19.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.526+0000 7f0704e81640 1 -- 172.21.15.50:0/1568673530 learned_addr learned my addr 172.21.15.50:0/1568673530 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.526+0000 7f06fffff640 1 --2- 172.21.15.50:0/1568673530 >> v2:172.21.15.77:3300/0 conn(0x7f070015e900 0x7f07000b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.526+0000 7f0704e81640 1 -- 172.21.15.50:0/1568673530 >> v2:172.21.15.77:3300/0 conn(0x7f070015e900 msgr2=0x7f07000b8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:19.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.526+0000 7f0704e81640 1 --2- 172.21.15.50:0/1568673530 >> v2:172.21.15.77:3300/0 conn(0x7f070015e900 0x7f07000b8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.526+0000 7f0704e81640 1 -- 172.21.15.50:0/1568673530 >> v1:172.21.15.77:6789/0 conn(0x7f07000ba1a0 legacy=0x7f07000cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.526+0000 7f0704e81640 1 -- 172.21.15.50:0/1568673530 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07000b92f0 con 0x7f07000cfb60 2024-09-11T22:22:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.527+0000 7f0704e81640 1 --2- 172.21.15.50:0/1568673530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07000cfb60 0x7f07000d2a60 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f07000cfff0 tx=0x7f06f802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6d52cc46fb249 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.527+0000 7f06feffd640 1 -- 172.21.15.50:0/1568673530 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8036070 con 0x7f07000cfb60 2024-09-11T22:22:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.527+0000 7f06feffd640 1 -- 172.21.15.50:0/1568673530 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f8031600 con 0x7f07000cfb60 2024-09-11T22:22:19.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.527+0000 7f06feffd640 1 -- 172.21.15.50:0/1568673530 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f80319d0 con 0x7f07000cfb60 2024-09-11T22:22:19.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.527+0000 7f07068e4640 1 -- 172.21.15.50:0/1568673530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07000cfb60 msgr2=0x7f07000d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.527+0000 7f07068e4640 1 --2- 172.21.15.50:0/1568673530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07000cfb60 0x7f07000d2a60 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f07000cfff0 tx=0x7f06f802a730 comp rx=0 tx=0).stop 2024-09-11T22:22:19.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.527+0000 7f07068e4640 1 -- 172.21.15.50:0/1568673530 shutdown_connections 2024-09-11T22:22:19.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.527+0000 7f07068e4640 1 --2- 172.21.15.50:0/1568673530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07000cfb60 0x7f07000d2a60 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.527+0000 7f07068e4640 1 --2- 172.21.15.50:0/1568673530 >> v2:172.21.15.77:3300/0 conn(0x7f070015e900 0x7f07000b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.527+0000 7f07068e4640 1 -- 172.21.15.50:0/1568673530 >> 172.21.15.50:0/1568673530 conn(0x7f0700072590 msgr2=0x7f07000729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:19.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.527+0000 7f07068e4640 1 -- 172.21.15.50:0/1568673530 shutdown_connections 2024-09-11T22:22:19.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.527+0000 7f07068e4640 1 -- 172.21.15.50:0/1568673530 wait complete. 2024-09-11T22:22:19.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.529+0000 7f07068e4640 1 Processor -- start 2024-09-11T22:22:19.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.529+0000 7f07068e4640 1 -- start start 2024-09-11T22:22:19.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f07068e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07000ba1a0 0x7f07000b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f07068e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07000cfb60 0x7f07000cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f07068e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f070015e900 0x7f0700161340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f07068e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07000b9af0 con 0x7f070015e900 2024-09-11T22:22:19.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f07068e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f07000ba5e0 con 0x7f07000cfb60 2024-09-11T22:22:19.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f07068e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f07000cb850 con 0x7f07000ba1a0 2024-09-11T22:22:19.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f0704e81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f070015e900 0x7f0700161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f0704e81640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f070015e900 0x7f0700161340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36418/0 (socket says 172.21.15.50:36418) 2024-09-11T22:22:19.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f0704e81640 1 -- 172.21.15.50:0/3694510026 learned_addr learned my addr 172.21.15.50:0/3694510026 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:19.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f06fffff640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07000ba1a0 0x7f07000b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f06ff7fe640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07000cfb60 0x7f07000cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f0704e81640 1 -- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07000ba1a0 msgr2=0x7f07000b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f0704e81640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07000ba1a0 0x7f07000b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f0704e81640 1 -- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07000cfb60 msgr2=0x7f07000cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f0704e81640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07000cfb60 0x7f07000cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f0704e81640 1 -- 172.21.15.50:0/3694510026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07000cd510 con 0x7f070015e900 2024-09-11T22:22:19.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f0704e81640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f070015e900 0x7f0700161340 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f06f8034040 tx=0x7f06f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f06fcff9640 1 -- 172.21.15.50:0/3694510026 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8036050 con 0x7f070015e900 2024-09-11T22:22:19.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f06fcff9640 1 -- 172.21.15.50:0/3694510026 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f8042070 con 0x7f070015e900 2024-09-11T22:22:19.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f07068e4640 1 -- 172.21.15.50:0/3694510026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07000cd7f0 con 0x7f070015e900 2024-09-11T22:22:19.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f06fcff9640 1 -- 172.21.15.50:0/3694510026 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8009510 con 0x7f070015e900 2024-09-11T22:22:19.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.530+0000 7f07068e4640 1 -- 172.21.15.50:0/3694510026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07000b65f0 con 0x7f070015e900 2024-09-11T22:22:19.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.531+0000 7f07068e4640 1 -- 172.21.15.50:0/3694510026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f070015fe60 con 0x7f070015e900 2024-09-11T22:22:19.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.532+0000 7f06fcff9640 1 -- 172.21.15.50:0/3694510026 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06f8007bf0 con 0x7f070015e900 2024-09-11T22:22:19.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.532+0000 7f06fcff9640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f06ec06be30 0x7f06ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.532+0000 7f06fcff9640 1 -- 172.21.15.50:0/3694510026 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f06f80abb70 con 0x7f070015e900 2024-09-11T22:22:19.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.532+0000 7f06fffff640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f06ec06be30 0x7f06ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.533+0000 7f06fffff640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f06ec06be30 0x7f06ec06e2f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009ad0 tx=0x7f06f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.536+0000 7f06fcff9640 1 -- 172.21.15.50:0/3694510026 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f06f807a6d0 con 0x7f070015e900 2024-09-11T22:22:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.726+0000 7f07068e4640 1 -- 172.21.15.50:0/3694510026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f07000c9270 con 0x7f070015e900 2024-09-11T22:22:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.726+0000 7f06fcff9640 1 -- 172.21.15.50:0/3694510026 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v167) ==== 80+0+0 (secure 0 0 0) 0x7f06f8079fd0 con 0x7f070015e900 2024-09-11T22:22:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:22:19.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.728+0000 7f07068e4640 1 -- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f06ec06be30 msgr2=0x7f06ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.728+0000 7f07068e4640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f06ec06be30 0x7f06ec06e2f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009ad0 tx=0x7f06f0008040 comp rx=0 tx=0).stop 2024-09-11T22:22:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.728+0000 7f07068e4640 1 -- 172.21.15.50:0/3694510026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f070015e900 msgr2=0x7f0700161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.728+0000 7f07068e4640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f070015e900 0x7f0700161340 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f06f8034040 tx=0x7f06f8004a40 comp rx=0 tx=0).stop 2024-09-11T22:22:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.729+0000 7f07068e4640 1 -- 172.21.15.50:0/3694510026 shutdown_connections 2024-09-11T22:22:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.729+0000 7f07068e4640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f06ec06be30 0x7f06ec06e2f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.729+0000 7f07068e4640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f070015e900 0x7f0700161340 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.729+0000 7f07068e4640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07000cfb60 0x7f07000cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.729+0000 7f07068e4640 1 --2- 172.21.15.50:0/3694510026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07000ba1a0 0x7f07000b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.729+0000 7f07068e4640 1 -- 172.21.15.50:0/3694510026 >> 172.21.15.50:0/3694510026 conn(0x7f0700072590 msgr2=0x7f07000d4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.729+0000 7f07068e4640 1 -- 172.21.15.50:0/3694510026 shutdown_connections 2024-09-11T22:22:19.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:19.729+0000 7f07068e4640 1 -- 172.21.15.50:0/3694510026 wait complete. 2024-09-11T22:22:19.740 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:22:19.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:19.740 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:22:20.408 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:22:20.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:20.408 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:22:20.424 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:22:20.424 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:22:20.424 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:22:20.440 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:22:20.440 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:22:20.440 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:22:20.441 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:22:20.480 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:22:20.480 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:22:20.480 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:22:20.481 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:22:20.496 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:22:20.496 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:22:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.622+0000 7fe4ca7b9640 1 Processor -- start 2024-09-11T22:22:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.622+0000 7fe4ca7b9640 1 -- start start 2024-09-11T22:22:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.623+0000 7fe4ca7b9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4c4161fa0 0x7fe4c40b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.623+0000 7fe4ca7b9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c40cfbd0 con 0x7fe4c40b1600 2024-09-11T22:22:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.623+0000 7fe4ca7b9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c40cfeb0 con 0x7fe4c40cf610 2024-09-11T22:22:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.623+0000 7fe4ca7b9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c40d1220 con 0x7fe4c4161fa0 2024-09-11T22:22:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.623+0000 7fe4c3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4c4161fa0 0x7fe4c40b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.623+0000 7fe4c37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe4c40b1600 0x7fe4c40cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53758/0 (socket says 172.21.15.50:53758) 2024-09-11T22:22:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.623+0000 7fe4c37fe640 1 -- 172.21.15.50:0/479357168 learned_addr learned my addr 172.21.15.50:0/479357168 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.624+0000 7fe4c3fff640 1 -- 172.21.15.50:0/479357168 >> v1:172.21.15.77:6789/0 conn(0x7fe4c40cf610 legacy=0x7fe4c40cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.624+0000 7fe4c3fff640 1 -- 172.21.15.50:0/479357168 >> v1:172.21.15.50:6789/0 conn(0x7fe4c40b1600 legacy=0x7fe4c40cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.624+0000 7fe4c3fff640 1 -- 172.21.15.50:0/479357168 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c40d1470 con 0x7fe4c4161fa0 2024-09-11T22:22:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.624+0000 7fe4c2ffd640 1 -- 172.21.15.50:0/479357168 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940858301 0 0) 0x7fe4c40cfbd0 con 0x7fe4c40b1600 2024-09-11T22:22:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.624+0000 7fe4c3fff640 1 --2- 172.21.15.50:0/479357168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4c4161fa0 0x7fe4c40b4d20 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40097a0 tx=0x7fe4b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8f4e41147aa30f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.624+0000 7fe4c2ffd640 1 -- 172.21.15.50:0/479357168 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4037070 con 0x7fe4c4161fa0 2024-09-11T22:22:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.625+0000 7fe4c2ffd640 1 -- 172.21.15.50:0/479357168 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b4032440 con 0x7fe4c4161fa0 2024-09-11T22:22:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.625+0000 7fe4c2ffd640 1 -- 172.21.15.50:0/479357168 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4032810 con 0x7fe4c4161fa0 2024-09-11T22:22:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.625+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/479357168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4c4161fa0 msgr2=0x7fe4c40b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.625+0000 7fe4ca7b9640 1 --2- 172.21.15.50:0/479357168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4c4161fa0 0x7fe4c40b4d20 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40097a0 tx=0x7fe4b402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.625+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/479357168 shutdown_connections 2024-09-11T22:22:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.625+0000 7fe4ca7b9640 1 --2- 172.21.15.50:0/479357168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4c4161fa0 0x7fe4c40b4d20 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.625+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/479357168 >> 172.21.15.50:0/479357168 conn(0x7fe4c409ba50 msgr2=0x7fe4c40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.625+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/479357168 shutdown_connections 2024-09-11T22:22:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.625+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/479357168 wait complete. 2024-09-11T22:22:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.626+0000 7fe4ca7b9640 1 Processor -- start 2024-09-11T22:22:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.626+0000 7fe4ca7b9640 1 -- start start 2024-09-11T22:22:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.627+0000 7fe4ca7b9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4c40b1600 0x7fe4c4153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.627+0000 7fe4ca7b9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4c40cf610 0x7fe4c40cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.627+0000 7fe4ca7b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4c4161fa0 0x7fe4c40b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.627+0000 7fe4ca7b9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c40d1c70 con 0x7fe4c40cf610 2024-09-11T22:22:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.627+0000 7fe4ca7b9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c40d17e0 con 0x7fe4c4161fa0 2024-09-11T22:22:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.627+0000 7fe4ca7b9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c40d1df0 con 0x7fe4c40b1600 2024-09-11T22:22:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.627+0000 7fe4c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4c40cf610 0x7fe4c40cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.627+0000 7fe4c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4c40cf610 0x7fe4c40cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36448/0 (socket says 172.21.15.50:36448) 2024-09-11T22:22:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.627+0000 7fe4c37fe640 1 -- 172.21.15.50:0/2002480533 learned_addr learned my addr 172.21.15.50:0/2002480533 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.627+0000 7fe4c8d56640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4c4161fa0 0x7fe4c40b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.627+0000 7fe4c3fff640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4c40b1600 0x7fe4c4153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.628+0000 7fe4c37fe640 1 -- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4c40b1600 msgr2=0x7fe4c4153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.628+0000 7fe4c37fe640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4c40b1600 0x7fe4c4153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.628+0000 7fe4c37fe640 1 -- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4c4161fa0 msgr2=0x7fe4c40b70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.628+0000 7fe4c37fe640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4c4161fa0 0x7fe4c40b70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.628+0000 7fe4c37fe640 1 -- 172.21.15.50:0/2002480533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c415d440 con 0x7fe4c40cf610 2024-09-11T22:22:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.628+0000 7fe4c37fe640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4c40cf610 0x7fe4c40cc020 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c430 tx=0x7fe4b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.628+0000 7fe4c0ff9640 1 -- 172.21.15.50:0/2002480533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80074e0 con 0x7fe4c40cf610 2024-09-11T22:22:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.628+0000 7fe4c0ff9640 1 -- 172.21.15.50:0/2002480533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b80047e0 con 0x7fe4c40cf610 2024-09-11T22:22:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.628+0000 7fe4c0ff9640 1 -- 172.21.15.50:0/2002480533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8004bd0 con 0x7fe4c40cf610 2024-09-11T22:22:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.628+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/2002480533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c40cc560 con 0x7fe4c40cf610 2024-09-11T22:22:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.628+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/2002480533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c40b3280 con 0x7fe4c40cf610 2024-09-11T22:22:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.629+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/2002480533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c40b4d20 con 0x7fe4c40cf610 2024-09-11T22:22:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.630+0000 7fe4c0ff9640 1 -- 172.21.15.50:0/2002480533 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe4b8011070 con 0x7fe4c40cf610 2024-09-11T22:22:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.630+0000 7fe4c0ff9640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe4b006be30 0x7fe4b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.630+0000 7fe4c0ff9640 1 -- 172.21.15.50:0/2002480533 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7fe4b808a9a0 con 0x7fe4c40cf610 2024-09-11T22:22:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.630+0000 7fe4c3fff640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe4b006be30 0x7fe4b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.631+0000 7fe4c3fff640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe4b006be30 0x7fe4b006e2f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4034000 tx=0x7fe4b402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:20.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.634+0000 7fe4c0ff9640 1 -- 172.21.15.50:0/2002480533 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe4b8058d00 con 0x7fe4c40cf610 2024-09-11T22:22:20.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.845+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/2002480533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4c406f9f0 con 0x7fe4c40cf610 2024-09-11T22:22:20.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.846+0000 7fe4c0ff9640 1 -- 172.21.15.50:0/2002480533 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5236 (secure 0 0 0) 0x7fe4b805d000 con 0x7fe4c40cf610 2024-09-11T22:22:20.846 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:20.847 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":123,"btime":"2024-09-11T22:22:17:691701+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/521086958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":521086958},{"type":"v1","addr":"172.21.15.77:6835","nonce":521086958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9891,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2783375669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2783375669},{"type":"v1","addr":"172.21.15.50:6833","nonce":2783375669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":123,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:21:53.868957+0000","modified":"2024-09-11T22:22:17.691684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9900":{"gid":9900,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2009878103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2009878103},{"type":"v1","addr":"172.21.15.50:6835","nonce":2009878103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9915":{"gid":9915,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2937331670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2937331670},{"type":"v1","addr":"172.21.15.77:6837","nonce":2937331670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9915,"qdb_cluster":[9915]},"id":12}]} 2024-09-11T22:22:20.847 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 123 2024-09-11T22:22:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.848+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe4b006be30 msgr2=0x7fe4b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.848+0000 7fe4ca7b9640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe4b006be30 0x7fe4b006e2f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4034000 tx=0x7fe4b402e000 comp rx=0 tx=0).stop 2024-09-11T22:22:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.848+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/2002480533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4c40cf610 msgr2=0x7fe4c40cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.848+0000 7fe4ca7b9640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4c40cf610 0x7fe4c40cc020 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c430 tx=0x7fe4b800c8f0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.848+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/2002480533 shutdown_connections 2024-09-11T22:22:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.848+0000 7fe4ca7b9640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe4b006be30 0x7fe4b006e2f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.848+0000 7fe4ca7b9640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4c4161fa0 0x7fe4c40b70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.848+0000 7fe4ca7b9640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4c40cf610 0x7fe4c40cc020 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.848+0000 7fe4ca7b9640 1 --2- 172.21.15.50:0/2002480533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4c40b1600 0x7fe4c4153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.848+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/2002480533 >> 172.21.15.50:0/2002480533 conn(0x7fe4c409ba50 msgr2=0x7fe4c40b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.848+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/2002480533 shutdown_connections 2024-09-11T22:22:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.848+0000 7fe4ca7b9640 1 -- 172.21.15.50:0/2002480533 wait complete. 2024-09-11T22:22:20.860 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:22:20.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.962+0000 7fd0fa5e4640 1 Processor -- start 2024-09-11T22:22:20.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.962+0000 7fd0fa5e4640 1 -- start start 2024-09-11T22:22:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.963+0000 7fd0fa5e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0f4162a60 0x7fd0f40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.963+0000 7fd0fa5e4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0f4163080 con 0x7fd0f415e8e0 2024-09-11T22:22:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.963+0000 7fd0fa5e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0f40d2d20 con 0x7fd0f40d1c90 2024-09-11T22:22:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.963+0000 7fd0fa5e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd0f415ecc0 con 0x7fd0f4162a60 2024-09-11T22:22:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.963+0000 7fd0f3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd0f415e8e0 0x7fd0f40d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53772/0 (socket says 172.21.15.50:53772) 2024-09-11T22:22:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.963+0000 7fd0f3fff640 1 -- 172.21.15.50:0/2948343353 learned_addr learned my addr 172.21.15.50:0/2948343353 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.963+0000 7fd0f8b81640 1 --2- 172.21.15.50:0/2948343353 >> v2:172.21.15.77:3300/0 conn(0x7fd0f4162a60 0x7fd0f40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.963+0000 7fd0f2ffd640 1 -- 172.21.15.50:0/2948343353 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 889692858 0 0) 0x7fd0f4163080 con 0x7fd0f415e8e0 2024-09-11T22:22:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.963+0000 7fd0f2ffd640 1 -- 172.21.15.50:0/2948343353 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0dc003520 con 0x7fd0f415e8e0 2024-09-11T22:22:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.964+0000 7fd0f8b81640 1 -- 172.21.15.50:0/2948343353 >> v1:172.21.15.77:6789/0 conn(0x7fd0f40d1c90 legacy=0x7fd0f4162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.964+0000 7fd0f2ffd640 1 -- 172.21.15.50:0/2948343353 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 350604645 0 0) 0x7fd0f40d2d20 con 0x7fd0f40d1c90 2024-09-11T22:22:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.964+0000 7fd0f8b81640 1 -- 172.21.15.50:0/2948343353 >> v1:172.21.15.50:6789/0 conn(0x7fd0f415e8e0 legacy=0x7fd0f40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.964+0000 7fd0f8b81640 1 -- 172.21.15.50:0/2948343353 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f40d3000 con 0x7fd0f4162a60 2024-09-11T22:22:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.964+0000 7fd0f8b81640 1 --2- 172.21.15.50:0/2948343353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f4162a60 0x7fd0f40b7880 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009d90 tx=0x7fd0ec02a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67f02f41f39e21f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:20.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.965+0000 7fd0f2ffd640 1 -- 172.21.15.50:0/2948343353 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec037070 con 0x7fd0f4162a60 2024-09-11T22:22:20.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.965+0000 7fd0f2ffd640 1 -- 172.21.15.50:0/2948343353 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0ec007740 con 0x7fd0f4162a60 2024-09-11T22:22:20.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.965+0000 7fd0f2ffd640 1 -- 172.21.15.50:0/2948343353 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec007af0 con 0x7fd0f4162a60 2024-09-11T22:22:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.965+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/2948343353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f4162a60 msgr2=0x7fd0f40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.965+0000 7fd0fa5e4640 1 --2- 172.21.15.50:0/2948343353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f4162a60 0x7fd0f40b7880 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009d90 tx=0x7fd0ec02a780 comp rx=0 tx=0).stop 2024-09-11T22:22:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.965+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/2948343353 shutdown_connections 2024-09-11T22:22:20.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.965+0000 7fd0fa5e4640 1 --2- 172.21.15.50:0/2948343353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f4162a60 0x7fd0f40b7880 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.965+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/2948343353 >> 172.21.15.50:0/2948343353 conn(0x7fd0f4067ba0 msgr2=0x7fd0f4067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:20.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.965+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/2948343353 shutdown_connections 2024-09-11T22:22:20.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.965+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/2948343353 wait complete. 2024-09-11T22:22:20.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.966+0000 7fd0fa5e4640 1 Processor -- start 2024-09-11T22:22:20.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.967+0000 7fd0fa5e4640 1 -- start start 2024-09-11T22:22:20.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.967+0000 7fd0fa5e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f40d1c90 0x7fd0f40cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.967+0000 7fd0fa5e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f415e8e0 0x7fd0f40cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.967+0000 7fd0fa5e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0f4162a60 0x7fd0f4145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.967+0000 7fd0fa5e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f40d3c10 con 0x7fd0f40d1c90 2024-09-11T22:22:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.967+0000 7fd0fa5e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f40d3a90 con 0x7fd0f415e8e0 2024-09-11T22:22:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.967+0000 7fd0fa5e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd0f40d3d90 con 0x7fd0f4162a60 2024-09-11T22:22:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.967+0000 7fd0f3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f40d1c90 0x7fd0f40cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.967+0000 7fd0f3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f40d1c90 0x7fd0f40cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36464/0 (socket says 172.21.15.50:36464) 2024-09-11T22:22:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.967+0000 7fd0f3fff640 1 -- 172.21.15.50:0/1972106439 learned_addr learned my addr 172.21.15.50:0/1972106439 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.968+0000 7fd0f37fe640 1 --2- 172.21.15.50:0/1972106439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f415e8e0 0x7fd0f40cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.968+0000 7fd0f3fff640 1 -- 172.21.15.50:0/1972106439 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0f4162a60 msgr2=0x7fd0f4145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.968+0000 7fd0f3fff640 1 --2- 172.21.15.50:0/1972106439 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0f4162a60 0x7fd0f4145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.968+0000 7fd0f3fff640 1 -- 172.21.15.50:0/1972106439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f415e8e0 msgr2=0x7fd0f40cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.968+0000 7fd0f3fff640 1 --2- 172.21.15.50:0/1972106439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f415e8e0 0x7fd0f40cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.968+0000 7fd0f3fff640 1 -- 172.21.15.50:0/1972106439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f4146370 con 0x7fd0f40d1c90 2024-09-11T22:22:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.968+0000 7fd0f3fff640 1 --2- 172.21.15.50:0/1972106439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f40d1c90 0x7fd0f40cb8c0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400c430 tx=0x7fd0e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.968+0000 7fd0f0ff9640 1 -- 172.21.15.50:0/1972106439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4017070 con 0x7fd0f40d1c90 2024-09-11T22:22:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.968+0000 7fd0f0ff9640 1 -- 172.21.15.50:0/1972106439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e4005ce0 con 0x7fd0f40d1c90 2024-09-11T22:22:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.968+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/1972106439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0f41f8240 con 0x7fd0f40d1c90 2024-09-11T22:22:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.968+0000 7fd0f0ff9640 1 -- 172.21.15.50:0/1972106439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40072f0 con 0x7fd0f40d1c90 2024-09-11T22:22:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.968+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/1972106439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0f41f7910 con 0x7fd0f40d1c90 2024-09-11T22:22:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.969+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/1972106439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0f40b7880 con 0x7fd0f40d1c90 2024-09-11T22:22:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.969+0000 7fd0f0ff9640 1 -- 172.21.15.50:0/1972106439 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0e401a070 con 0x7fd0f40d1c90 2024-09-11T22:22:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.970+0000 7fd0f0ff9640 1 --2- 172.21.15.50:0/1972106439 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd0e006be30 0x7fd0e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.970+0000 7fd0f0ff9640 1 -- 172.21.15.50:0/1972106439 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7fd0e408a3e0 con 0x7fd0f40d1c90 2024-09-11T22:22:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.970+0000 7fd0f37fe640 1 --2- 172.21.15.50:0/1972106439 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd0e006be30 0x7fd0e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.971+0000 7fd0f37fe640 1 --2- 172.21.15.50:0/1972106439 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd0e006be30 0x7fd0e006e2f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40b93f0 tx=0x7fd0e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:20.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:20.974+0000 7fd0f0ff9640 1 -- 172.21.15.50:0/1972106439 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0f4146370 con 0x7fd0f40d1c90 2024-09-11T22:22:21.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.185+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/1972106439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0f40ba770 con 0x7fd0f40d1c90 2024-09-11T22:22:21.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.186+0000 7fd0f0ff9640 1 -- 172.21.15.50:0/1972106439 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5236 (secure 0 0 0) 0x7fd0e4058d10 con 0x7fd0f40d1c90 2024-09-11T22:22:21.186 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:21.186 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":123,"btime":"2024-09-11T22:22:17:691701+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/521086958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":521086958},{"type":"v1","addr":"172.21.15.77:6835","nonce":521086958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9891,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2783375669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2783375669},{"type":"v1","addr":"172.21.15.50:6833","nonce":2783375669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":123,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:21:53.868957+0000","modified":"2024-09-11T22:22:17.691684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9900":{"gid":9900,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2009878103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2009878103},{"type":"v1","addr":"172.21.15.50:6835","nonce":2009878103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9915":{"gid":9915,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2937331670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2937331670},{"type":"v1","addr":"172.21.15.77:6837","nonce":2937331670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9915,"qdb_cluster":[9915]},"id":12}]} 2024-09-11T22:22:21.187 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 123 2024-09-11T22:22:21.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.188+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/1972106439 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd0e006be30 msgr2=0x7fd0e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.188+0000 7fd0fa5e4640 1 --2- 172.21.15.50:0/1972106439 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd0e006be30 0x7fd0e006e2f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40b93f0 tx=0x7fd0e8009040 comp rx=0 tx=0).stop 2024-09-11T22:22:21.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.188+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/1972106439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f40d1c90 msgr2=0x7fd0f40cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.188+0000 7fd0fa5e4640 1 --2- 172.21.15.50:0/1972106439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f40d1c90 0x7fd0f40cb8c0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400c430 tx=0x7fd0e400c8f0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.188+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/1972106439 shutdown_connections 2024-09-11T22:22:21.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.188+0000 7fd0fa5e4640 1 --2- 172.21.15.50:0/1972106439 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd0e006be30 0x7fd0e006e2f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.188+0000 7fd0fa5e4640 1 --2- 172.21.15.50:0/1972106439 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0f4162a60 0x7fd0f4145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.188+0000 7fd0fa5e4640 1 --2- 172.21.15.50:0/1972106439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f415e8e0 0x7fd0f40cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.188+0000 7fd0fa5e4640 1 --2- 172.21.15.50:0/1972106439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0f40d1c90 0x7fd0f40cb8c0 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.188+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/1972106439 >> 172.21.15.50:0/1972106439 conn(0x7fd0f4067ba0 msgr2=0x7fd0f4067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:21.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.188+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/1972106439 shutdown_connections 2024-09-11T22:22:21.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.188+0000 7fd0fa5e4640 1 -- 172.21.15.50:0/1972106439 wait complete. 2024-09-11T22:22:21.200 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:22:21.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.301+0000 7f3ebd047640 1 Processor -- start 2024-09-11T22:22:21.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.301+0000 7f3ebd047640 1 -- start start 2024-09-11T22:22:21.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.302+0000 7f3ebd047640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3eb80d5260 0x7f3eb80b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.302+0000 7f3ebd047640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3eb80b6cd0 0x7f3eb80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.302+0000 7f3ebd047640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb815ec60 con 0x7f3eb815e880 2024-09-11T22:22:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.302+0000 7f3ebd047640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb80d4dd0 con 0x7f3eb80b6cd0 2024-09-11T22:22:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.302+0000 7f3ebd047640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb80cf700 con 0x7f3eb80d5260 2024-09-11T22:22:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.302+0000 7f3eb759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3eb80b6cd0 0x7f3eb80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.302+0000 7f3eb759e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3eb80b6cd0 0x7f3eb80b7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36474/0 (socket says 172.21.15.50:36474) 2024-09-11T22:22:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.302+0000 7f3eb759e640 1 -- 172.21.15.50:0/757073251 learned_addr learned my addr 172.21.15.50:0/757073251 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.302+0000 7f3eb659c640 1 --2- 172.21.15.50:0/757073251 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3eb80d5260 0x7f3eb80b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.302+0000 7f3eb759e640 1 -- 172.21.15.50:0/757073251 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3eb80d5260 msgr2=0x7f3eb80b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.302+0000 7f3eb759e640 1 --2- 172.21.15.50:0/757073251 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3eb80d5260 0x7f3eb80b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.302+0000 7f3eb759e640 1 -- 172.21.15.50:0/757073251 >> v1:172.21.15.77:6789/0 conn(0x7f3eb815e880 legacy=0x7f3eb80ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.302+0000 7f3eb759e640 1 -- 172.21.15.50:0/757073251 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb80cf9d0 con 0x7f3eb80b6cd0 2024-09-11T22:22:21.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.303+0000 7f3eb759e640 1 --2- 172.21.15.50:0/757073251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80b6cd0 0x7f3eb80b7820 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009e50 tx=0x7f3eb002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96243cebf1e06b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.303+0000 7f3eb5d9b640 1 -- 172.21.15.50:0/757073251 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0036070 con 0x7f3eb80b6cd0 2024-09-11T22:22:21.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.303+0000 7f3eb5d9b640 1 -- 172.21.15.50:0/757073251 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb0031600 con 0x7f3eb80b6cd0 2024-09-11T22:22:21.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.303+0000 7f3eb5d9b640 1 -- 172.21.15.50:0/757073251 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00319d0 con 0x7f3eb80b6cd0 2024-09-11T22:22:21.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.304+0000 7f3ebd047640 1 -- 172.21.15.50:0/757073251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80b6cd0 msgr2=0x7f3eb80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.304+0000 7f3ebd047640 1 --2- 172.21.15.50:0/757073251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80b6cd0 0x7f3eb80b7820 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009e50 tx=0x7f3eb002a710 comp rx=0 tx=0).stop 2024-09-11T22:22:21.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.304+0000 7f3ebd047640 1 -- 172.21.15.50:0/757073251 shutdown_connections 2024-09-11T22:22:21.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.304+0000 7f3ebd047640 1 --2- 172.21.15.50:0/757073251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80b6cd0 0x7f3eb80b7820 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.304+0000 7f3ebd047640 1 --2- 172.21.15.50:0/757073251 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3eb80d5260 0x7f3eb80b6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.304+0000 7f3ebd047640 1 -- 172.21.15.50:0/757073251 >> 172.21.15.50:0/757073251 conn(0x7f3eb80723b0 msgr2=0x7f3eb80727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:21.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.304+0000 7f3ebd047640 1 -- 172.21.15.50:0/757073251 shutdown_connections 2024-09-11T22:22:21.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.304+0000 7f3ebd047640 1 -- 172.21.15.50:0/757073251 wait complete. 2024-09-11T22:22:21.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.305+0000 7f3ebd047640 1 Processor -- start 2024-09-11T22:22:21.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.305+0000 7f3ebd047640 1 -- start start 2024-09-11T22:22:21.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.306+0000 7f3ebd047640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3eb80b6cd0 0x7f3eb81e7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.306+0000 7f3ebd047640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80d5260 0x7f3eb80d2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.306+0000 7f3ebd047640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3eb815e880 0x7f3eb80cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.306+0000 7f3ebd047640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb80d4a60 con 0x7f3eb80d5260 2024-09-11T22:22:21.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.306+0000 7f3ebd047640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb80d4780 con 0x7f3eb80b6cd0 2024-09-11T22:22:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.306+0000 7f3ebd047640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb80d24b0 con 0x7f3eb815e880 2024-09-11T22:22:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.306+0000 7f3eb659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80d5260 0x7f3eb80d2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.306+0000 7f3eb659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80d5260 0x7f3eb80d2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36486/0 (socket says 172.21.15.50:36486) 2024-09-11T22:22:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.306+0000 7f3eb659c640 1 -- 172.21.15.50:0/4180395538 learned_addr learned my addr 172.21.15.50:0/4180395538 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.306+0000 7f3eb6d9d640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3eb80b6cd0 0x7f3eb81e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.306+0000 7f3eb759e640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3eb815e880 0x7f3eb80cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.307+0000 7f3eb659c640 1 -- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3eb815e880 msgr2=0x7f3eb80cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.307+0000 7f3eb659c640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3eb815e880 0x7f3eb80cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.307+0000 7f3eb659c640 1 -- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3eb80b6cd0 msgr2=0x7f3eb81e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.307+0000 7f3eb659c640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3eb80b6cd0 0x7f3eb81e7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.307+0000 7f3eb659c640 1 -- 172.21.15.50:0/4180395538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb8156180 con 0x7f3eb80d5260 2024-09-11T22:22:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.307+0000 7f3eb659c640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80d5260 0x7f3eb80d2f90 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00e9b0 tx=0x7f3eac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.307+0000 7f3e9f7fe640 1 -- 172.21.15.50:0/4180395538 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac017070 con 0x7f3eb80d5260 2024-09-11T22:22:21.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.307+0000 7f3e9f7fe640 1 -- 172.21.15.50:0/4180395538 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eac00c9a0 con 0x7f3eb80d5260 2024-09-11T22:22:21.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.307+0000 7f3ebd047640 1 -- 172.21.15.50:0/4180395538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb81e7780 con 0x7f3eb80d5260 2024-09-11T22:22:21.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.307+0000 7f3e9f7fe640 1 -- 172.21.15.50:0/4180395538 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac00cd70 con 0x7f3eb80d5260 2024-09-11T22:22:21.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.307+0000 7f3ebd047640 1 -- 172.21.15.50:0/4180395538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb815f600 con 0x7f3eb80d5260 2024-09-11T22:22:21.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.308+0000 7f3ebd047640 1 -- 172.21.15.50:0/4180395538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb80b6770 con 0x7f3eb80d5260 2024-09-11T22:22:21.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.309+0000 7f3e9f7fe640 1 -- 172.21.15.50:0/4180395538 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3eac01a070 con 0x7f3eb80d5260 2024-09-11T22:22:21.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.309+0000 7f3e9f7fe640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3ea406be30 0x7f3ea406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.309+0000 7f3e9f7fe640 1 -- 172.21.15.50:0/4180395538 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f3eac08ade0 con 0x7f3eb80d5260 2024-09-11T22:22:21.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.309+0000 7f3eb6d9d640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3ea406be30 0x7f3ea406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.310+0000 7f3eb6d9d640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3ea406be30 0x7f3ea406e2f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3eb80d39b0 tx=0x7f3ea8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.313+0000 7f3e9f7fe640 1 -- 172.21.15.50:0/4180395538 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3eac059140 con 0x7f3eb80d5260 2024-09-11T22:22:21.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.489+0000 7f3ebd047640 1 -- 172.21.15.50:0/4180395538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3eb80b5320 con 0x7f3eb80d5260 2024-09-11T22:22:21.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.490+0000 7f3e9f7fe640 1 -- 172.21.15.50:0/4180395538 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+16703 (secure 0 0 0) 0x7f3eac05d440 con 0x7f3eb80d5260 2024-09-11T22:22:21.491 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:21.491 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":167,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:21:55.500323+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:21:51.564535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-11T22:21:52.850719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:22:21.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.492+0000 7f3ebd047640 1 -- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3ea406be30 msgr2=0x7f3ea406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.492+0000 7f3ebd047640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3ea406be30 0x7f3ea406e2f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3eb80d39b0 tx=0x7f3ea8009040 comp rx=0 tx=0).stop 2024-09-11T22:22:21.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.492+0000 7f3ebd047640 1 -- 172.21.15.50:0/4180395538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80d5260 msgr2=0x7f3eb80d2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.492+0000 7f3ebd047640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80d5260 0x7f3eb80d2f90 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00e9b0 tx=0x7f3eac00ee70 comp rx=0 tx=0).stop 2024-09-11T22:22:21.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.492+0000 7f3ebd047640 1 -- 172.21.15.50:0/4180395538 shutdown_connections 2024-09-11T22:22:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.492+0000 7f3ebd047640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3ea406be30 0x7f3ea406e2f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.492+0000 7f3ebd047640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3eb815e880 0x7f3eb80cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.492+0000 7f3ebd047640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3eb80d5260 0x7f3eb80d2f90 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.492+0000 7f3ebd047640 1 --2- 172.21.15.50:0/4180395538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3eb80b6cd0 0x7f3eb81e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.492+0000 7f3ebd047640 1 -- 172.21.15.50:0/4180395538 >> 172.21.15.50:0/4180395538 conn(0x7f3eb80723b0 msgr2=0x7f3eb8072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.492+0000 7f3ebd047640 1 -- 172.21.15.50:0/4180395538 shutdown_connections 2024-09-11T22:22:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.492+0000 7f3ebd047640 1 -- 172.21.15.50:0/4180395538 wait complete. 2024-09-11T22:22:21.504 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:22:21.504 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:22:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.607+0000 7f05d29e8640 1 Processor -- start 2024-09-11T22:22:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.607+0000 7f05d29e8640 1 -- start start 2024-09-11T22:22:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.607+0000 7f05d29e8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05cc15e870 0x7f05cc0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.607+0000 7f05d29e8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05cc0cfa80 con 0x7f05cc0d16d0 2024-09-11T22:22:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.607+0000 7f05d29e8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05cc0d40d0 con 0x7f05cc0d3c00 2024-09-11T22:22:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.607+0000 7f05d29e8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f05cc0d1b40 con 0x7f05cc15e870 2024-09-11T22:22:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.608+0000 7f05cb7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f05cc0d16d0 0x7f05cc0d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53782/0 (socket says 172.21.15.50:53782) 2024-09-11T22:22:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.608+0000 7f05cb7fe640 1 -- 172.21.15.50:0/3884428362 learned_addr learned my addr 172.21.15.50:0/3884428362 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:21.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.608+0000 7f05cbfff640 1 --2- 172.21.15.50:0/3884428362 >> v2:172.21.15.77:3300/0 conn(0x7f05cc15e870 0x7f05cc0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.608+0000 7f05caffd640 1 -- 172.21.15.50:0/3884428362 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1303305896 0 0) 0x7f05c0001110 con 0x7f05cc0d16d0 2024-09-11T22:22:21.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.608+0000 7f05caffd640 1 -- 172.21.15.50:0/3884428362 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05b4003520 con 0x7f05cc0d16d0 2024-09-11T22:22:21.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.608+0000 7f05caffd640 1 -- 172.21.15.50:0/3884428362 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3587289612 0 0) 0x7f05b4003520 con 0x7f05cc0d16d0 2024-09-11T22:22:21.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.608+0000 7f05cbfff640 1 -- 172.21.15.50:0/3884428362 >> v1:172.21.15.77:6789/0 conn(0x7f05cc0d3c00 legacy=0x7f05cc0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.608+0000 7f05cbfff640 1 -- 172.21.15.50:0/3884428362 >> v1:172.21.15.50:6789/0 conn(0x7f05cc0d16d0 legacy=0x7f05cc0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.608+0000 7f05cbfff640 1 -- 172.21.15.50:0/3884428362 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc0d43b0 con 0x7f05cc15e870 2024-09-11T22:22:21.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.609+0000 7f05cbfff640 1 --2- 172.21.15.50:0/3884428362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05cc15e870 0x7f05cc0d1190 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0097a0 tx=0x7f05bc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=466c6aafd5eff410 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.609+0000 7f05caffd640 1 -- 172.21.15.50:0/3884428362 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc037070 con 0x7f05cc15e870 2024-09-11T22:22:21.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.609+0000 7f05caffd640 1 -- 172.21.15.50:0/3884428362 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05bc02ac50 con 0x7f05cc15e870 2024-09-11T22:22:21.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.609+0000 7f05caffd640 1 -- 172.21.15.50:0/3884428362 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0001840 con 0x7f05cc15e870 2024-09-11T22:22:21.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.609+0000 7f05d29e8640 1 -- 172.21.15.50:0/3884428362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05cc15e870 msgr2=0x7f05cc0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.609+0000 7f05d29e8640 1 --2- 172.21.15.50:0/3884428362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05cc15e870 0x7f05cc0d1190 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0097a0 tx=0x7f05bc02a1c0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.610+0000 7f05d29e8640 1 -- 172.21.15.50:0/3884428362 shutdown_connections 2024-09-11T22:22:21.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.610+0000 7f05d29e8640 1 --2- 172.21.15.50:0/3884428362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05cc15e870 0x7f05cc0d1190 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.610+0000 7f05d29e8640 1 -- 172.21.15.50:0/3884428362 >> 172.21.15.50:0/3884428362 conn(0x7f05cc0727a0 msgr2=0x7f05cc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:21.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.610+0000 7f05d29e8640 1 -- 172.21.15.50:0/3884428362 shutdown_connections 2024-09-11T22:22:21.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.610+0000 7f05d29e8640 1 -- 172.21.15.50:0/3884428362 wait complete. 2024-09-11T22:22:21.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.611+0000 7f05d29e8640 1 Processor -- start 2024-09-11T22:22:21.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.611+0000 7f05d29e8640 1 -- start start 2024-09-11T22:22:21.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05d29e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05cc0d16d0 0x7f05cc0cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05d29e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05cc0d3c00 0x7f05cc1f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05d29e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05cc15e870 0x7f05cc154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05d29e8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc15ec50 con 0x7f05cc0d3c00 2024-09-11T22:22:21.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05d29e8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc0b7ee0 con 0x7f05cc15e870 2024-09-11T22:22:21.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05d29e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f05cc0b78b0 con 0x7f05cc0d16d0 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05cb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05cc0d3c00 0x7f05cc1f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05cb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05cc0d3c00 0x7f05cc1f81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36490/0 (socket says 172.21.15.50:36490) 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05cb7fe640 1 -- 172.21.15.50:0/2126253369 learned_addr learned my addr 172.21.15.50:0/2126253369 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05cb7fe640 1 -- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05cc0d16d0 msgr2=0x7f05cc0cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05cb7fe640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05cc0d16d0 0x7f05cc0cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05cb7fe640 1 -- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05cc15e870 msgr2=0x7f05cc154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05d0f85640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05cc15e870 0x7f05cc154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05cb7fe640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05cc15e870 0x7f05cc154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05cb7fe640 1 -- 172.21.15.50:0/2126253369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc0ccdc0 con 0x7f05cc0d3c00 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05d0f85640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05cc15e870 0x7f05cc154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05cb7fe640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05cc0d3c00 0x7f05cc1f81c0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c4e0 tx=0x7f05c000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05c8ff9640 1 -- 172.21.15.50:0/2126253369 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0017070 con 0x7f05cc0d3c00 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05c8ff9640 1 -- 172.21.15.50:0/2126253369 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c0005ce0 con 0x7f05cc0d3c00 2024-09-11T22:22:21.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05d29e8640 1 -- 172.21.15.50:0/2126253369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05cc0cd0a0 con 0x7f05cc0d3c00 2024-09-11T22:22:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05c8ff9640 1 -- 172.21.15.50:0/2126253369 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c00072b0 con 0x7f05cc0d3c00 2024-09-11T22:22:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.612+0000 7f05d29e8640 1 -- 172.21.15.50:0/2126253369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05cc0cd660 con 0x7f05cc0d3c00 2024-09-11T22:22:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.613+0000 7f05d29e8640 1 -- 172.21.15.50:0/2126253369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05cc0d1190 con 0x7f05cc0d3c00 2024-09-11T22:22:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.614+0000 7f05c8ff9640 1 -- 172.21.15.50:0/2126253369 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05c001a070 con 0x7f05cc0d3c00 2024-09-11T22:22:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.614+0000 7f05c8ff9640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05b806be30 0x7f05b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.614+0000 7f05c8ff9640 1 -- 172.21.15.50:0/2126253369 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f05c008a2e0 con 0x7f05cc0d3c00 2024-09-11T22:22:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.615+0000 7f05cbfff640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05b806be30 0x7f05b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.615+0000 7f05cbfff640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05b806be30 0x7f05b806e2f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f05bc034000 tx=0x7f05bc02c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.619+0000 7f05c8ff9640 1 -- 172.21.15.50:0/2126253369 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05cc0cfa80 con 0x7f05cc0d3c00 2024-09-11T22:22:21.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.830+0000 7f05d29e8640 1 -- 172.21.15.50:0/2126253369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05cc0b9f80 con 0x7f05cc0d3c00 2024-09-11T22:22:21.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.831+0000 7f05c8ff9640 1 -- 172.21.15.50:0/2126253369 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5236 (secure 0 0 0) 0x7f05c0058c80 con 0x7f05cc0d3c00 2024-09-11T22:22:21.832 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:21.832 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":123,"btime":"2024-09-11T22:22:17:691701+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/521086958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":521086958},{"type":"v1","addr":"172.21.15.77:6835","nonce":521086958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9891,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2783375669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2783375669},{"type":"v1","addr":"172.21.15.50:6833","nonce":2783375669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":123,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:21:53.868957+0000","modified":"2024-09-11T22:22:17.691684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9900":{"gid":9900,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2009878103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2009878103},{"type":"v1","addr":"172.21.15.50:6835","nonce":2009878103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9915":{"gid":9915,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2937331670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2937331670},{"type":"v1","addr":"172.21.15.77:6837","nonce":2937331670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9915,"qdb_cluster":[9915]},"id":12}]} 2024-09-11T22:22:21.832 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 123 2024-09-11T22:22:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.833+0000 7f05d29e8640 1 -- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05b806be30 msgr2=0x7f05b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.833+0000 7f05d29e8640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05b806be30 0x7f05b806e2f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f05bc034000 tx=0x7f05bc02c000 comp rx=0 tx=0).stop 2024-09-11T22:22:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.833+0000 7f05d29e8640 1 -- 172.21.15.50:0/2126253369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05cc0d3c00 msgr2=0x7f05cc1f81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.833+0000 7f05d29e8640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05cc0d3c00 0x7f05cc1f81c0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c4e0 tx=0x7f05c000c9a0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.833+0000 7f05d29e8640 1 -- 172.21.15.50:0/2126253369 shutdown_connections 2024-09-11T22:22:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.833+0000 7f05d29e8640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05b806be30 0x7f05b806e2f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.833+0000 7f05d29e8640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05cc15e870 0x7f05cc154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.833+0000 7f05d29e8640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05cc0d3c00 0x7f05cc1f81c0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.833+0000 7f05d29e8640 1 --2- 172.21.15.50:0/2126253369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05cc0d16d0 0x7f05cc0cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.833+0000 7f05d29e8640 1 -- 172.21.15.50:0/2126253369 >> 172.21.15.50:0/2126253369 conn(0x7f05cc0727a0 msgr2=0x7f05cc0b8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.833+0000 7f05d29e8640 1 -- 172.21.15.50:0/2126253369 shutdown_connections 2024-09-11T22:22:21.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.833+0000 7f05d29e8640 1 -- 172.21.15.50:0/2126253369 wait complete. 2024-09-11T22:22:21.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:22:21.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.947+0000 7ff609728640 1 Processor -- start 2024-09-11T22:22:21.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.947+0000 7ff609728640 1 -- start start 2024-09-11T22:22:21.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff609728640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff6040d05e0 0x7ff6040b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff609728640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6040b3e10 0x7ff6040ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff609728640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6040b4f00 con 0x7ff60415c2c0 2024-09-11T22:22:21.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff609728640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff6040b4360 con 0x7ff6040d05e0 2024-09-11T22:22:21.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff609728640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff6040b51c0 con 0x7ff6040b3e10 2024-09-11T22:22:21.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff6027fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff6040d05e0 0x7ff6040b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff6037fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6040b3e10 0x7ff6040ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff6037fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6040b3e10 0x7ff6040ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:58232/0 (socket says 172.21.15.50:58232) 2024-09-11T22:22:21.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff602ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff60415c2c0 0x7ff6040cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:53666/0 (socket says 172.21.15.50:53666) 2024-09-11T22:22:21.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff6037fe640 1 -- 172.21.15.50:0/3060411847 learned_addr learned my addr 172.21.15.50:0/3060411847 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:21.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff601ffb640 1 -- 172.21.15.50:0/3060411847 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2085277678 0 0) 0x7ff6040b4f00 con 0x7ff60415c2c0 2024-09-11T22:22:21.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff601ffb640 1 -- 172.21.15.50:0/3060411847 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5ec003520 con 0x7ff60415c2c0 2024-09-11T22:22:21.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff6027fc640 1 -- 172.21.15.50:0/3060411847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6040b3e10 msgr2=0x7ff6040ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:21.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff6027fc640 1 --2- 172.21.15.50:0/3060411847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6040b3e10 0x7ff6040ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff6027fc640 1 -- 172.21.15.50:0/3060411847 >> v1:172.21.15.77:6789/0 conn(0x7ff60415c2c0 legacy=0x7ff6040cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff6027fc640 1 -- 172.21.15.50:0/3060411847 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6040b54a0 con 0x7ff6040d05e0 2024-09-11T22:22:21.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.948+0000 7ff6037fe640 1 --2- 172.21.15.50:0/3060411847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6040b3e10 0x7ff6040ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:21.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.949+0000 7ff6027fc640 1 --2- 172.21.15.50:0/3060411847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6040d05e0 0x7ff6040b46a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80097a0 tx=0x7ff5f802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44647e2e319f500c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.949+0000 7ff601ffb640 1 -- 172.21.15.50:0/3060411847 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8037070 con 0x7ff6040d05e0 2024-09-11T22:22:21.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.949+0000 7ff601ffb640 1 -- 172.21.15.50:0/3060411847 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f8032440 con 0x7ff6040d05e0 2024-09-11T22:22:21.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.949+0000 7ff601ffb640 1 -- 172.21.15.50:0/3060411847 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8032810 con 0x7ff6040d05e0 2024-09-11T22:22:21.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.950+0000 7ff609728640 1 -- 172.21.15.50:0/3060411847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6040d05e0 msgr2=0x7ff6040b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.950+0000 7ff609728640 1 --2- 172.21.15.50:0/3060411847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6040d05e0 0x7ff6040b46a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80097a0 tx=0x7ff5f802a180 comp rx=0 tx=0).stop 2024-09-11T22:22:21.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.950+0000 7ff609728640 1 -- 172.21.15.50:0/3060411847 shutdown_connections 2024-09-11T22:22:21.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.950+0000 7ff609728640 1 --2- 172.21.15.50:0/3060411847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6040b3e10 0x7ff6040ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.950+0000 7ff609728640 1 --2- 172.21.15.50:0/3060411847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6040d05e0 0x7ff6040b46a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.950+0000 7ff609728640 1 -- 172.21.15.50:0/3060411847 >> 172.21.15.50:0/3060411847 conn(0x7ff6040679c0 msgr2=0x7ff604067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:21.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.950+0000 7ff609728640 1 -- 172.21.15.50:0/3060411847 shutdown_connections 2024-09-11T22:22:21.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.950+0000 7ff609728640 1 -- 172.21.15.50:0/3060411847 wait complete. 2024-09-11T22:22:21.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.951+0000 7ff609728640 1 Processor -- start 2024-09-11T22:22:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.951+0000 7ff609728640 1 -- start start 2024-09-11T22:22:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff609728640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6040b3e10 0x7ff60414e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff609728640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6040d05e0 0x7ff604156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff609728640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60415c2c0 0x7ff604157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff609728640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff60406d070 con 0x7ff6040d05e0 2024-09-11T22:22:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff609728640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff6040ce200 con 0x7ff60415c2c0 2024-09-11T22:22:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff609728640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff60406d1f0 con 0x7ff6040b3e10 2024-09-11T22:22:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff6027fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6040d05e0 0x7ff604156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff6027fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6040d05e0 0x7ff604156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36502/0 (socket says 172.21.15.50:36502) 2024-09-11T22:22:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff6027fc640 1 -- 172.21.15.50:0/730775039 learned_addr learned my addr 172.21.15.50:0/730775039 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff6037fe640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60415c2c0 0x7ff604157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff602ffd640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6040b3e10 0x7ff60414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff6027fc640 1 -- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6040b3e10 msgr2=0x7ff60414e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff6027fc640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6040b3e10 0x7ff60414e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff6027fc640 1 -- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60415c2c0 msgr2=0x7ff604157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff6027fc640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60415c2c0 0x7ff604157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.952+0000 7ff6027fc640 1 -- 172.21.15.50:0/730775039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff604152e50 con 0x7ff6040d05e0 2024-09-11T22:22:21.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.953+0000 7ff6027fc640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6040d05e0 0x7ff604156b30 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8035040 tx=0x7ff5f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.953+0000 7ff5eb7fe640 1 -- 172.21.15.50:0/730775039 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8041030 con 0x7ff6040d05e0 2024-09-11T22:22:21.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.953+0000 7ff5eb7fe640 1 -- 172.21.15.50:0/730775039 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f803d4e0 con 0x7ff6040d05e0 2024-09-11T22:22:21.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.953+0000 7ff609728640 1 -- 172.21.15.50:0/730775039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff604153130 con 0x7ff6040d05e0 2024-09-11T22:22:21.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.953+0000 7ff5eb7fe640 1 -- 172.21.15.50:0/730775039 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8037040 con 0x7ff6040d05e0 2024-09-11T22:22:21.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.953+0000 7ff609728640 1 -- 172.21.15.50:0/730775039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6041536f0 con 0x7ff6040d05e0 2024-09-11T22:22:21.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.954+0000 7ff609728640 1 -- 172.21.15.50:0/730775039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff60415c6a0 con 0x7ff6040d05e0 2024-09-11T22:22:21.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.954+0000 7ff5eb7fe640 1 -- 172.21.15.50:0/730775039 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5f8044070 con 0x7ff6040d05e0 2024-09-11T22:22:21.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.955+0000 7ff5eb7fe640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff5f006be60 0x7ff5f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.955+0000 7ff5eb7fe640 1 -- 172.21.15.50:0/730775039 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7ff5f80ab360 con 0x7ff6040d05e0 2024-09-11T22:22:21.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.955+0000 7ff602ffd640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff5f006be60 0x7ff5f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.955+0000 7ff602ffd640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff5f006be60 0x7ff5f006e320 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff6041e7f20 tx=0x7ff5f4007cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:21.959+0000 7ff5eb7fe640 1 -- 172.21.15.50:0/730775039 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5f80796d0 con 0x7ff6040d05e0 2024-09-11T22:22:22.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.170+0000 7ff609728640 1 -- 172.21.15.50:0/730775039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff60406f270 con 0x7ff6040d05e0 2024-09-11T22:22:22.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.171+0000 7ff5eb7fe640 1 -- 172.21.15.50:0/730775039 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5236 (secure 0 0 0) 0x7ff5f807d9d0 con 0x7ff6040d05e0 2024-09-11T22:22:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:22.172 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":123,"btime":"2024-09-11T22:22:17:691701+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/521086958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":521086958},{"type":"v1","addr":"172.21.15.77:6835","nonce":521086958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9891,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2783375669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2783375669},{"type":"v1","addr":"172.21.15.50:6833","nonce":2783375669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":123,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:21:53.868957+0000","modified":"2024-09-11T22:22:17.691684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9900":{"gid":9900,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2009878103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2009878103},{"type":"v1","addr":"172.21.15.50:6835","nonce":2009878103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9915":{"gid":9915,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2937331670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2937331670},{"type":"v1","addr":"172.21.15.77:6837","nonce":2937331670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9915,"qdb_cluster":[9915]},"id":12}]} 2024-09-11T22:22:22.172 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 123 2024-09-11T22:22:22.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.173+0000 7ff609728640 1 -- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff5f006be60 msgr2=0x7ff5f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.173+0000 7ff609728640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff5f006be60 0x7ff5f006e320 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff6041e7f20 tx=0x7ff5f4007cf0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.173+0000 7ff609728640 1 -- 172.21.15.50:0/730775039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6040d05e0 msgr2=0x7ff604156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.173+0000 7ff609728640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6040d05e0 0x7ff604156b30 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8035040 tx=0x7ff5f80046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.173+0000 7ff609728640 1 -- 172.21.15.50:0/730775039 shutdown_connections 2024-09-11T22:22:22.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.173+0000 7ff609728640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff5f006be60 0x7ff5f006e320 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.173+0000 7ff609728640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60415c2c0 0x7ff604157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.173+0000 7ff609728640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6040d05e0 0x7ff604156b30 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.173+0000 7ff609728640 1 --2- 172.21.15.50:0/730775039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6040b3e10 0x7ff60414e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.173+0000 7ff609728640 1 -- 172.21.15.50:0/730775039 >> 172.21.15.50:0/730775039 conn(0x7ff6040679c0 msgr2=0x7ff604067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:22.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.173+0000 7ff609728640 1 -- 172.21.15.50:0/730775039 shutdown_connections 2024-09-11T22:22:22.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.173+0000 7ff609728640 1 -- 172.21.15.50:0/730775039 wait complete. 2024-09-11T22:22:22.185 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:22:22.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.286+0000 7f305e9f8640 1 Processor -- start 2024-09-11T22:22:22.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.287+0000 7f305e9f8640 1 -- start start 2024-09-11T22:22:22.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.287+0000 7f305e9f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30580d18a0 0x7f30580d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.287+0000 7f305e9f8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30580d3a30 0x7f30580b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.287+0000 7f305e9f8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30580cfa80 con 0x7f305815e870 2024-09-11T22:22:22.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.287+0000 7f305e9f8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f30580d3ea0 con 0x7f30580d3a30 2024-09-11T22:22:22.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.287+0000 7f305e9f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f30580d40d0 con 0x7f30580d18a0 2024-09-11T22:22:22.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3057fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f305815e870 0x7f30580d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53786/0 (socket says 172.21.15.50:53786) 2024-09-11T22:22:22.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3057fff640 1 -- 172.21.15.50:0/3587709094 learned_addr learned my addr 172.21.15.50:0/3587709094 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:22.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f305cf95640 1 --2- 172.21.15.50:0/3587709094 >> v2:172.21.15.77:3300/0 conn(0x7f30580d3a30 0x7f30580b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f30577fe640 1 --2- 172.21.15.50:0/3587709094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30580d18a0 0x7f30580d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1533043141 0 0) 0x7f3048001110 con 0x7f305815e870 2024-09-11T22:22:22.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3040003520 con 0x7f305815e870 2024-09-11T22:22:22.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2684728873 0 0) 0x7f3040003520 con 0x7f305815e870 2024-09-11T22:22:22.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30580d18a0 msgr2=0x7f30580d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:22.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 --2- 172.21.15.50:0/3587709094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30580d18a0 0x7f30580d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 >> v2:172.21.15.77:3300/0 conn(0x7f30580d3a30 msgr2=0x7f30580b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:22.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 --2- 172.21.15.50:0/3587709094 >> v2:172.21.15.77:3300/0 conn(0x7f30580d3a30 0x7f30580b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30580d43b0 con 0x7f305815e870 2024-09-11T22:22:22.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f305cf95640 1 --2- 172.21.15.50:0/3587709094 >> v2:172.21.15.77:3300/0 conn(0x7f30580d3a30 0x7f30580b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:22.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f3048001840 con 0x7f305815e870 2024-09-11T22:22:22.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 >> v1:172.21.15.50:6789/0 conn(0x7f305815e870 legacy=0x7f30580d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 --2- 172.21.15.50:0/3587709094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400039b0 0x7f3040003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 --2- 172.21.15.50:0/3587709094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30580d18a0 0x7f3040004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 --2- 172.21.15.50:0/3587709094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3040004d40 0x7f30400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f30580d40d0 con 0x7f3040004d40 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f304000b9c0 con 0x7f30400039b0 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f304000bb40 con 0x7f30580d18a0 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f305cf95640 1 --2- 172.21.15.50:0/3587709094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3040004d40 0x7f30400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f3057fff640 1 --2- 172.21.15.50:0/3587709094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400039b0 0x7f3040003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.288+0000 7f30577fe640 1 --2- 172.21.15.50:0/3587709094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30580d18a0 0x7f3040004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.289+0000 7f305cf95640 1 -- 172.21.15.50:0/3587709094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30580d18a0 msgr2=0x7f3040004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.289+0000 7f305cf95640 1 --2- 172.21.15.50:0/3587709094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30580d18a0 0x7f3040004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.289+0000 7f305cf95640 1 -- 172.21.15.50:0/3587709094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400039b0 msgr2=0x7f3040003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.289+0000 7f305cf95640 1 --2- 172.21.15.50:0/3587709094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400039b0 0x7f3040003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.289+0000 7f305cf95640 1 -- 172.21.15.50:0/3587709094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3040003520 con 0x7f3040004d40 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.289+0000 7f305cf95640 1 --2- 172.21.15.50:0/3587709094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3040004d40 0x7f30400051c0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f305000e380 tx=0x7f3040005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184c8a2ab0d44c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.290+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3050009de0 con 0x7f3040004d40 2024-09-11T22:22:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.290+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305002c620 con 0x7f3040004d40 2024-09-11T22:22:22.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.290+0000 7f3056ffd640 1 -- 172.21.15.50:0/3587709094 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305002c9d0 con 0x7f3040004d40 2024-09-11T22:22:22.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.290+0000 7f305e9f8640 1 -- 172.21.15.50:0/3587709094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3040004d40 msgr2=0x7f30400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.290+0000 7f305e9f8640 1 --2- 172.21.15.50:0/3587709094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3040004d40 0x7f30400051c0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f305000e380 tx=0x7f3040005830 comp rx=0 tx=0).stop 2024-09-11T22:22:22.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.290+0000 7f305cf95640 1 -- 172.21.15.50:0/3587709094 reap_dead start 2024-09-11T22:22:22.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.290+0000 7f305e9f8640 1 -- 172.21.15.50:0/3587709094 shutdown_connections 2024-09-11T22:22:22.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.290+0000 7f305e9f8640 1 -- 172.21.15.50:0/3587709094 >> 172.21.15.50:0/3587709094 conn(0x7f30580727a0 msgr2=0x7f30580679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:22.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.290+0000 7f305e9f8640 1 -- 172.21.15.50:0/3587709094 shutdown_connections 2024-09-11T22:22:22.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.290+0000 7f305e9f8640 1 -- 172.21.15.50:0/3587709094 wait complete. 2024-09-11T22:22:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.291+0000 7f305e9f8640 1 Processor -- start 2024-09-11T22:22:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.292+0000 7f305e9f8640 1 -- start start 2024-09-11T22:22:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.292+0000 7f305e9f8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3040004d40 0x7f305814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.292+0000 7f305e9f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f305815fe20 0x7f305814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.292+0000 7f305e9f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3058161460 0x7f30580ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.292+0000 7f305e9f8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f305815ec50 con 0x7f3040004d40 2024-09-11T22:22:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.292+0000 7f305e9f8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f30580b7ee0 con 0x7f3058161460 2024-09-11T22:22:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.292+0000 7f305e9f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f30580b78b0 con 0x7f305815fe20 2024-09-11T22:22:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.292+0000 7f3057fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3040004d40 0x7f305814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.292+0000 7f3057fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3040004d40 0x7f305814f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36522/0 (socket says 172.21.15.50:36522) 2024-09-11T22:22:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.292+0000 7f3057fff640 1 -- 172.21.15.50:0/2867848973 learned_addr learned my addr 172.21.15.50:0/2867848973 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f30577fe640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f305815fe20 0x7f305814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f305cf95640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3058161460 0x7f30580ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f3057fff640 1 -- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f305815fe20 msgr2=0x7f305814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f3057fff640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f305815fe20 0x7f305814fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f3057fff640 1 -- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3058161460 msgr2=0x7f30580ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f3057fff640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3058161460 0x7f30580ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f3057fff640 1 -- 172.21.15.50:0/2867848973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3058150860 con 0x7f3040004d40 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f305cf95640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3058161460 0x7f30580ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f3057fff640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3040004d40 0x7f305814f990 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f3048007340 tx=0x7f3048007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f3054ff9640 1 -- 172.21.15.50:0/2867848973 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304800f9c0 con 0x7f3040004d40 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f3054ff9640 1 -- 172.21.15.50:0/2867848973 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3048018070 con 0x7f3040004d40 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f305e9f8640 1 -- 172.21.15.50:0/2867848973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30581603c0 con 0x7f3040004d40 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f3054ff9640 1 -- 172.21.15.50:0/2867848973 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304800fdc0 con 0x7f3040004d40 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.293+0000 7f305e9f8640 1 -- 172.21.15.50:0/2867848973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3058160980 con 0x7f3040004d40 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.294+0000 7f305e9f8640 1 -- 172.21.15.50:0/2867848973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30580d34f0 con 0x7f3040004d40 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.295+0000 7f3054ff9640 1 -- 172.21.15.50:0/2867848973 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f304801d460 con 0x7f3040004d40 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.295+0000 7f3054ff9640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f304406be30 0x7f304406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.295+0000 7f3054ff9640 1 -- 172.21.15.50:0/2867848973 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f304808aee0 con 0x7f3040004d40 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.295+0000 7f30577fe640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f304406be30 0x7f304406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.296+0000 7f30577fe640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f304406be30 0x7f304406e2f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f30580cc090 tx=0x7f304c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.299+0000 7f3054ff9640 1 -- 172.21.15.50:0/2867848973 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3058150860 con 0x7f3040004d40 2024-09-11T22:22:22.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.476+0000 7f305e9f8640 1 -- 172.21.15.50:0/2867848973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30580b9930 con 0x7f3040004d40 2024-09-11T22:22:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.477+0000 7f3054ff9640 1 -- 172.21.15.50:0/2867848973 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+16703 (secure 0 0 0) 0x7f30580cfa80 con 0x7f3040004d40 2024-09-11T22:22:22.478 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:22.478 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":167,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:21:55.500323+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:21:51.564535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-11T22:21:52.850719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:22:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.479+0000 7f305e9f8640 1 -- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f304406be30 msgr2=0x7f304406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.479+0000 7f305e9f8640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f304406be30 0x7f304406e2f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f30580cc090 tx=0x7f304c009190 comp rx=0 tx=0).stop 2024-09-11T22:22:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.479+0000 7f305e9f8640 1 -- 172.21.15.50:0/2867848973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3040004d40 msgr2=0x7f305814f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.479+0000 7f305e9f8640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3040004d40 0x7f305814f990 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f3048007340 tx=0x7f3048007740 comp rx=0 tx=0).stop 2024-09-11T22:22:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.479+0000 7f305e9f8640 1 -- 172.21.15.50:0/2867848973 shutdown_connections 2024-09-11T22:22:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.479+0000 7f305e9f8640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f304406be30 0x7f304406e2f0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.479+0000 7f305e9f8640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f305815fe20 0x7f305814fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.479+0000 7f305e9f8640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3058161460 0x7f30580ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.479+0000 7f305e9f8640 1 --2- 172.21.15.50:0/2867848973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3040004d40 0x7f305814f990 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.479+0000 7f305e9f8640 1 -- 172.21.15.50:0/2867848973 >> 172.21.15.50:0/2867848973 conn(0x7f30580727a0 msgr2=0x7f30580b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.479+0000 7f305e9f8640 1 -- 172.21.15.50:0/2867848973 shutdown_connections 2024-09-11T22:22:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.479+0000 7f305e9f8640 1 -- 172.21.15.50:0/2867848973 wait complete. 2024-09-11T22:22:22.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:22:22.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.594+0000 7f6483186640 1 Processor -- start 2024-09-11T22:22:22.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.594+0000 7f6483186640 1 -- start start 2024-09-11T22:22:22.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f6483186640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f647c0b1600 0x7f647c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f6483186640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647c0cfbd0 con 0x7f647c0cf610 2024-09-11T22:22:22.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f6483186640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647c0cfeb0 con 0x7f647c161fa0 2024-09-11T22:22:22.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f6483186640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f647c0d1220 con 0x7f647c0b1600 2024-09-11T22:22:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f6473fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f647c0cf610 0x7f647c0cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53802/0 (socket says 172.21.15.50:53802) 2024-09-11T22:22:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f6473fff640 1 -- 172.21.15.50:0/1209211107 learned_addr learned my addr 172.21.15.50:0/1209211107 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f6481723640 1 --2- 172.21.15.50:0/1209211107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f647c0b1600 0x7f647c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f64737fe640 1 -- 172.21.15.50:0/1209211107 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4260061373 0 0) 0x7f647c0cfbd0 con 0x7f647c0cf610 2024-09-11T22:22:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f64737fe640 1 -- 172.21.15.50:0/1209211107 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6464003520 con 0x7f647c0cf610 2024-09-11T22:22:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f64737fe640 1 -- 172.21.15.50:0/1209211107 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893742685 0 0) 0x7f647c0cfeb0 con 0x7f647c161fa0 2024-09-11T22:22:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f64737fe640 1 -- 172.21.15.50:0/1209211107 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f647c0cfbd0 con 0x7f647c161fa0 2024-09-11T22:22:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f64737fe640 1 -- 172.21.15.50:0/1209211107 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2959065436 0 0) 0x7f6464003520 con 0x7f647c0cf610 2024-09-11T22:22:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f6481723640 1 -- 172.21.15.50:0/1209211107 >> v1:172.21.15.77:6789/0 conn(0x7f647c161fa0 legacy=0x7f647c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f6481723640 1 -- 172.21.15.50:0/1209211107 >> v1:172.21.15.50:6789/0 conn(0x7f647c0cf610 legacy=0x7f647c0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.595+0000 7f6481723640 1 -- 172.21.15.50:0/1209211107 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c0d1470 con 0x7f647c0b1600 2024-09-11T22:22:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.596+0000 7f6481723640 1 --2- 172.21.15.50:0/1209211107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f647c0b1600 0x7f647c0b4d20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6474009dc0 tx=0x7f647402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e5567eb78def3ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.596+0000 7f64737fe640 1 -- 172.21.15.50:0/1209211107 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c001670 con 0x7f647c0b1600 2024-09-11T22:22:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.596+0000 7f64737fe640 1 -- 172.21.15.50:0/1209211107 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6474007540 con 0x7f647c0b1600 2024-09-11T22:22:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.596+0000 7f64737fe640 1 -- 172.21.15.50:0/1209211107 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474007910 con 0x7f647c0b1600 2024-09-11T22:22:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.597+0000 7f6483186640 1 -- 172.21.15.50:0/1209211107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f647c0b1600 msgr2=0x7f647c0b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.597+0000 7f6483186640 1 --2- 172.21.15.50:0/1209211107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f647c0b1600 0x7f647c0b4d20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6474009dc0 tx=0x7f647402a660 comp rx=0 tx=0).stop 2024-09-11T22:22:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.597+0000 7f6483186640 1 -- 172.21.15.50:0/1209211107 shutdown_connections 2024-09-11T22:22:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.597+0000 7f6483186640 1 --2- 172.21.15.50:0/1209211107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f647c0b1600 0x7f647c0b4d20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.597+0000 7f6483186640 1 -- 172.21.15.50:0/1209211107 >> 172.21.15.50:0/1209211107 conn(0x7f647c09ba50 msgr2=0x7f647c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.597+0000 7f6483186640 1 -- 172.21.15.50:0/1209211107 shutdown_connections 2024-09-11T22:22:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.597+0000 7f6483186640 1 -- 172.21.15.50:0/1209211107 wait complete. 2024-09-11T22:22:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.598+0000 7f6483186640 1 Processor -- start 2024-09-11T22:22:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.598+0000 7f6483186640 1 -- start start 2024-09-11T22:22:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.599+0000 7f6483186640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f647c0b1600 0x7f647c152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.599+0000 7f6483186640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c0cf610 0x7f647c0b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.599+0000 7f6483186640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f647c161fa0 0x7f647c160000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.599+0000 7f6483186640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0d1c70 con 0x7f647c161fa0 2024-09-11T22:22:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.599+0000 7f6483186640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0d17e0 con 0x7f647c0cf610 2024-09-11T22:22:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.599+0000 7f6483186640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f647c0d1df0 con 0x7f647c0b1600 2024-09-11T22:22:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.599+0000 7f6481723640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f647c161fa0 0x7f647c160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.599+0000 7f6481723640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f647c161fa0 0x7f647c160000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36534/0 (socket says 172.21.15.50:36534) 2024-09-11T22:22:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.599+0000 7f6481723640 1 -- 172.21.15.50:0/3377811106 learned_addr learned my addr 172.21.15.50:0/3377811106 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.599+0000 7f6473fff640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c0cf610 0x7f647c0b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.599+0000 7f6480f22640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f647c0b1600 0x7f647c152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.600+0000 7f6481723640 1 -- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f647c0b1600 msgr2=0x7f647c152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.600+0000 7f6481723640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f647c0b1600 0x7f647c152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.600+0000 7f6481723640 1 -- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c0cf610 msgr2=0x7f647c0b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.600+0000 7f6481723640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c0cf610 0x7f647c0b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.600+0000 7f6481723640 1 -- 172.21.15.50:0/3377811106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c153060 con 0x7f647c161fa0 2024-09-11T22:22:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.600+0000 7f6481723640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f647c161fa0 0x7f647c160000 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f6474009ee0 tx=0x7f6474004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.600+0000 7f64717fa640 1 -- 172.21.15.50:0/3377811106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647403f070 con 0x7f647c161fa0 2024-09-11T22:22:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.600+0000 7f64717fa640 1 -- 172.21.15.50:0/3377811106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6474031bc0 con 0x7f647c161fa0 2024-09-11T22:22:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.600+0000 7f6483186640 1 -- 172.21.15.50:0/3377811106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c0ca660 con 0x7f647c161fa0 2024-09-11T22:22:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.600+0000 7f64717fa640 1 -- 172.21.15.50:0/3377811106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474009450 con 0x7f647c161fa0 2024-09-11T22:22:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.600+0000 7f6483186640 1 -- 172.21.15.50:0/3377811106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c0cac20 con 0x7f647c161fa0 2024-09-11T22:22:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.601+0000 7f6483186640 1 -- 172.21.15.50:0/3377811106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c071130 con 0x7f647c161fa0 2024-09-11T22:22:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.602+0000 7f64717fa640 1 -- 172.21.15.50:0/3377811106 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6474044460 con 0x7f647c161fa0 2024-09-11T22:22:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.602+0000 7f64717fa640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f646806be30 0x7f646806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.602+0000 7f64717fa640 1 -- 172.21.15.50:0/3377811106 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f64740ac3e0 con 0x7f647c161fa0 2024-09-11T22:22:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.602+0000 7f6480f22640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f646806be30 0x7f646806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.603+0000 7f6480f22640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f646806be30 0x7f646806e2f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6478007fd0 tx=0x7f6478009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.606+0000 7f64717fa640 1 -- 172.21.15.50:0/3377811106 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f647c153060 con 0x7f647c161fa0 2024-09-11T22:22:22.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.819+0000 7f6483186640 1 -- 172.21.15.50:0/3377811106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f647c06c960 con 0x7f647c161fa0 2024-09-11T22:22:22.820 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:22:22.820+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:22:22.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.821+0000 7f64717fa640 1 -- 172.21.15.50:0/3377811106 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v124) ==== 161+0+0 (secure 0 0 0) 0x7f647407a740 con 0x7f647c161fa0 2024-09-11T22:22:22.822 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:22:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.825+0000 7f6483186640 1 -- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f646806be30 msgr2=0x7f646806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.825+0000 7f6483186640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f646806be30 0x7f646806e2f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6478007fd0 tx=0x7f6478009040 comp rx=0 tx=0).stop 2024-09-11T22:22:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.825+0000 7f6483186640 1 -- 172.21.15.50:0/3377811106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f647c161fa0 msgr2=0x7f647c160000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.825+0000 7f6483186640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f647c161fa0 0x7f647c160000 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f6474009ee0 tx=0x7f6474004a40 comp rx=0 tx=0).stop 2024-09-11T22:22:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.825+0000 7f6483186640 1 -- 172.21.15.50:0/3377811106 shutdown_connections 2024-09-11T22:22:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.825+0000 7f6483186640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f646806be30 0x7f646806e2f0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.825+0000 7f6483186640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f647c161fa0 0x7f647c160000 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.825+0000 7f6483186640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c0cf610 0x7f647c0b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.825+0000 7f6483186640 1 --2- 172.21.15.50:0/3377811106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f647c0b1600 0x7f647c152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.825+0000 7f6483186640 1 -- 172.21.15.50:0/3377811106 >> 172.21.15.50:0/3377811106 conn(0x7f647c09ba50 msgr2=0x7f647c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.825+0000 7f6483186640 1 -- 172.21.15.50:0/3377811106 shutdown_connections 2024-09-11T22:22:22.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.825+0000 7f6483186640 1 -- 172.21.15.50:0/3377811106 wait complete. 2024-09-11T22:22:22.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:22:22.862 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:22:22.865 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:22:22.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.942+0000 7fcb09f8d640 1 Processor -- start 2024-09-11T22:22:22.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.942+0000 7fcb09f8d640 1 -- start start 2024-09-11T22:22:22.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.943+0000 7fcb09f8d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb040b1600 0x7fcb040b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.943+0000 7fcb09f8d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb040cfbd0 con 0x7fcb04161fa0 2024-09-11T22:22:22.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.943+0000 7fcb09f8d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb040cfeb0 con 0x7fcb040cf610 2024-09-11T22:22:22.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.943+0000 7fcb09f8d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fcb040d1220 con 0x7fcb040b1600 2024-09-11T22:22:22.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.943+0000 7fcb03fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb040b1600 0x7fcb040b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.943+0000 7fcb03fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb040b1600 0x7fcb040b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36554/0 (socket says 172.21.15.50:36554) 2024-09-11T22:22:22.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.943+0000 7fcb03fff640 1 -- 172.21.15.50:0/1518827950 learned_addr learned my addr 172.21.15.50:0/1518827950 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:22.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.943+0000 7fcb037fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcb04161fa0 0x7fcb040cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53814/0 (socket says 172.21.15.50:53814) 2024-09-11T22:22:22.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.943+0000 7fcb03fff640 1 -- 172.21.15.50:0/1518827950 >> v1:172.21.15.77:6789/0 conn(0x7fcb040cf610 legacy=0x7fcb040cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.943+0000 7fcb03fff640 1 -- 172.21.15.50:0/1518827950 >> v1:172.21.15.50:6789/0 conn(0x7fcb04161fa0 legacy=0x7fcb040cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.943+0000 7fcb03fff640 1 -- 172.21.15.50:0/1518827950 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb040d1470 con 0x7fcb040b1600 2024-09-11T22:22:22.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.943+0000 7fcb027fc640 1 -- 172.21.15.50:0/1518827950 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3849293351 0 0) 0x7fcb040cfbd0 con 0x7fcb04161fa0 2024-09-11T22:22:22.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.944+0000 7fcb03fff640 1 --2- 172.21.15.50:0/1518827950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb040b1600 0x7fcb040b4d20 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009e50 tx=0x7fcafc02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c16b1665b576ba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:22.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.944+0000 7fcb027fc640 1 -- 172.21.15.50:0/1518827950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc036070 con 0x7fcb040b1600 2024-09-11T22:22:22.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.944+0000 7fcb027fc640 1 -- 172.21.15.50:0/1518827950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcafc031600 con 0x7fcb040b1600 2024-09-11T22:22:22.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.944+0000 7fcb027fc640 1 -- 172.21.15.50:0/1518827950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc0319f0 con 0x7fcb040b1600 2024-09-11T22:22:22.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.945+0000 7fcb09f8d640 1 -- 172.21.15.50:0/1518827950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb040b1600 msgr2=0x7fcb040b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.945+0000 7fcb09f8d640 1 --2- 172.21.15.50:0/1518827950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb040b1600 0x7fcb040b4d20 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009e50 tx=0x7fcafc02a7c0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.945+0000 7fcb09f8d640 1 -- 172.21.15.50:0/1518827950 shutdown_connections 2024-09-11T22:22:22.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.945+0000 7fcb09f8d640 1 --2- 172.21.15.50:0/1518827950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb040b1600 0x7fcb040b4d20 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.945+0000 7fcb09f8d640 1 -- 172.21.15.50:0/1518827950 >> 172.21.15.50:0/1518827950 conn(0x7fcb0409ba50 msgr2=0x7fcb040b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:22.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.945+0000 7fcb09f8d640 1 -- 172.21.15.50:0/1518827950 shutdown_connections 2024-09-11T22:22:22.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.945+0000 7fcb09f8d640 1 -- 172.21.15.50:0/1518827950 wait complete. 2024-09-11T22:22:22.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.946+0000 7fcb09f8d640 1 Processor -- start 2024-09-11T22:22:22.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.946+0000 7fcb09f8d640 1 -- start start 2024-09-11T22:22:22.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.947+0000 7fcb09f8d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb040b1600 0x7fcb0415fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.947+0000 7fcb09f8d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb040cf610 0x7fcb040cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.947+0000 7fcb09f8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb04161fa0 0x7fcb040cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.947+0000 7fcb09f8d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb040d1c70 con 0x7fcb040cf610 2024-09-11T22:22:22.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.947+0000 7fcb09f8d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb040d17e0 con 0x7fcb04161fa0 2024-09-11T22:22:22.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.947+0000 7fcb09f8d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcb040d1df0 con 0x7fcb040b1600 2024-09-11T22:22:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.947+0000 7fcb02ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb040cf610 0x7fcb040cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.947+0000 7fcb02ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb040cf610 0x7fcb040cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36556/0 (socket says 172.21.15.50:36556) 2024-09-11T22:22:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.947+0000 7fcb02ffd640 1 -- 172.21.15.50:0/2543677167 learned_addr learned my addr 172.21.15.50:0/2543677167 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.947+0000 7fcb037fe640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb040b1600 0x7fcb0415fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.947+0000 7fcb03fff640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb04161fa0 0x7fcb040cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.948+0000 7fcb02ffd640 1 -- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb040b1600 msgr2=0x7fcb0415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.948+0000 7fcb02ffd640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb040b1600 0x7fcb0415fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.948+0000 7fcb02ffd640 1 -- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb04161fa0 msgr2=0x7fcb040cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.948+0000 7fcb02ffd640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb04161fa0 0x7fcb040cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.948+0000 7fcb02ffd640 1 -- 172.21.15.50:0/2543677167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb041f5300 con 0x7fcb040cf610 2024-09-11T22:22:22.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.948+0000 7fcb02ffd640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb040cf610 0x7fcb040cad90 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c450 tx=0x7fcaf800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:22.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.948+0000 7fcaebfff640 1 -- 172.21.15.50:0/2543677167 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80052d0 con 0x7fcb040cf610 2024-09-11T22:22:22.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.948+0000 7fcaebfff640 1 -- 172.21.15.50:0/2543677167 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf8005470 con 0x7fcb040cf610 2024-09-11T22:22:22.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.948+0000 7fcaebfff640 1 -- 172.21.15.50:0/2543677167 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8012870 con 0x7fcb040cf610 2024-09-11T22:22:22.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.948+0000 7fcb09f8d640 1 -- 172.21.15.50:0/2543677167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb041f5020 con 0x7fcb040cf610 2024-09-11T22:22:22.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.948+0000 7fcb09f8d640 1 -- 172.21.15.50:0/2543677167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb0415f430 con 0x7fcb040cf610 2024-09-11T22:22:22.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.949+0000 7fcb09f8d640 1 -- 172.21.15.50:0/2543677167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb0409bf50 con 0x7fcb040cf610 2024-09-11T22:22:22.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.950+0000 7fcaebfff640 1 -- 172.21.15.50:0/2543677167 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcaf8012a10 con 0x7fcb040cf610 2024-09-11T22:22:22.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.950+0000 7fcaebfff640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcaf006be30 0x7fcaf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:22.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.950+0000 7fcaebfff640 1 -- 172.21.15.50:0/2543677167 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5795+0+0 (secure 0 0 0) 0x7fcaf808a8e0 con 0x7fcb040cf610 2024-09-11T22:22:22.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.950+0000 7fcb037fe640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcaf006be30 0x7fcaf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:22.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.951+0000 7fcb037fe640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcaf006be30 0x7fcaf006e2f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4007f70 tx=0x7fcaf4007f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:22.954+0000 7fcaebfff640 1 -- 172.21.15.50:0/2543677167 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb0409bf50 con 0x7fcb040cf610 2024-09-11T22:22:23.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.168+0000 7fcb09f8d640 1 -- 172.21.15.50:0/2543677167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcb0406f640 con 0x7fcb040cf610 2024-09-11T22:22:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.827+0000 7fcaebfff640 1 -- 172.21.15.50:0/2543677167 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v125) ==== 104+0+0 (secure 0 0 0) 0x7fcaf8058c70 con 0x7fcb040cf610 2024-09-11T22:22:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.829+0000 7fcb09f8d640 1 -- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcaf006be30 msgr2=0x7fcaf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.829+0000 7fcb09f8d640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcaf006be30 0x7fcaf006e2f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4007f70 tx=0x7fcaf4007f00 comp rx=0 tx=0).stop 2024-09-11T22:22:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.829+0000 7fcb09f8d640 1 -- 172.21.15.50:0/2543677167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb040cf610 msgr2=0x7fcb040cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.829+0000 7fcb09f8d640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb040cf610 0x7fcb040cad90 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c450 tx=0x7fcaf800c910 comp rx=0 tx=0).stop 2024-09-11T22:22:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.829+0000 7fcb09f8d640 1 -- 172.21.15.50:0/2543677167 shutdown_connections 2024-09-11T22:22:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.829+0000 7fcb09f8d640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcaf006be30 0x7fcaf006e2f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.829+0000 7fcb09f8d640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb04161fa0 0x7fcb040cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.829+0000 7fcb09f8d640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb040cf610 0x7fcb040cad90 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.830+0000 7fcb09f8d640 1 --2- 172.21.15.50:0/2543677167 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb040b1600 0x7fcb0415fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.830+0000 7fcb09f8d640 1 -- 172.21.15.50:0/2543677167 >> 172.21.15.50:0/2543677167 conn(0x7fcb0409ba50 msgr2=0x7fcb040b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.830+0000 7fcb09f8d640 1 -- 172.21.15.50:0/2543677167 shutdown_connections 2024-09-11T22:22:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:23.830+0000 7fcb09f8d640 1 -- 172.21.15.50:0/2543677167 wait complete. 2024-09-11T22:22:23.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:22:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.003+0000 7fd1f119f640 1 Processor -- start 2024-09-11T22:22:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.003+0000 7fd1f119f640 1 -- start start 2024-09-11T22:22:24.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.004+0000 7fd1f119f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1ec15e900 0x7fd1ec0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:24.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.004+0000 7fd1f119f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ec0d4090 0x7fd1ec0d4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.004+0000 7fd1f119f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1ec15ece0 con 0x7fd1ec0d4ad0 2024-09-11T22:22:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.004+0000 7fd1f119f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ec0b77a0 con 0x7fd1ec15e900 2024-09-11T22:22:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.004+0000 7fd1f119f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ec0d3580 con 0x7fd1ec0d4090 2024-09-11T22:22:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.004+0000 7fd1f099e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd1ec0d4ad0 0x7fd1ec0b6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53818/0 (socket says 172.21.15.50:53818) 2024-09-11T22:22:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.004+0000 7fd1f099e640 1 -- 172.21.15.50:0/4250957438 learned_addr learned my addr 172.21.15.50:0/4250957438 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.004+0000 7fd1e3fff640 1 --2- 172.21.15.50:0/4250957438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ec0d4090 0x7fd1ec0d4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.004+0000 7fd1ebfff640 1 --2- 172.21.15.50:0/4250957438 >> v2:172.21.15.77:3300/0 conn(0x7fd1ec15e900 0x7fd1ec0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:24.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.005+0000 7fd1eb7fe640 1 -- 172.21.15.50:0/4250957438 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 603372081 0 0) 0x7fd1ec15ece0 con 0x7fd1ec0d4ad0 2024-09-11T22:22:24.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.005+0000 7fd1eb7fe640 1 -- 172.21.15.50:0/4250957438 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1d8003520 con 0x7fd1ec0d4ad0 2024-09-11T22:22:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.005+0000 7fd1e3fff640 1 -- 172.21.15.50:0/4250957438 >> v2:172.21.15.77:3300/0 conn(0x7fd1ec15e900 msgr2=0x7fd1ec0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.005+0000 7fd1e3fff640 1 --2- 172.21.15.50:0/4250957438 >> v2:172.21.15.77:3300/0 conn(0x7fd1ec15e900 0x7fd1ec0cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.005+0000 7fd1e3fff640 1 -- 172.21.15.50:0/4250957438 >> v1:172.21.15.50:6789/0 conn(0x7fd1ec0d4ad0 legacy=0x7fd1ec0b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.005+0000 7fd1e3fff640 1 -- 172.21.15.50:0/4250957438 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ec0d3860 con 0x7fd1ec0d4090 2024-09-11T22:22:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.005+0000 7fd1ebfff640 1 --2- 172.21.15.50:0/4250957438 >> v2:172.21.15.77:3300/0 conn(0x7fd1ec15e900 0x7fd1ec0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.006+0000 7fd1e3fff640 1 --2- 172.21.15.50:0/4250957438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ec0d4090 0x7fd1ec0d4590 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009790 tx=0x7fd1d402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38a3a0ad9a85f80c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.006+0000 7fd1eb7fe640 1 -- 172.21.15.50:0/4250957438 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4037070 con 0x7fd1ec0d4090 2024-09-11T22:22:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.006+0000 7fd1eb7fe640 1 -- 172.21.15.50:0/4250957438 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d4032440 con 0x7fd1ec0d4090 2024-09-11T22:22:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.006+0000 7fd1eb7fe640 1 -- 172.21.15.50:0/4250957438 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4032810 con 0x7fd1ec0d4090 2024-09-11T22:22:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.006+0000 7fd1f119f640 1 -- 172.21.15.50:0/4250957438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ec0d4090 msgr2=0x7fd1ec0d4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.006+0000 7fd1f119f640 1 --2- 172.21.15.50:0/4250957438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ec0d4090 0x7fd1ec0d4590 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009790 tx=0x7fd1d402a180 comp rx=0 tx=0).stop 2024-09-11T22:22:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.006+0000 7fd1f119f640 1 -- 172.21.15.50:0/4250957438 shutdown_connections 2024-09-11T22:22:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.006+0000 7fd1f119f640 1 --2- 172.21.15.50:0/4250957438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ec0d4090 0x7fd1ec0d4590 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.006+0000 7fd1f119f640 1 --2- 172.21.15.50:0/4250957438 >> v2:172.21.15.77:3300/0 conn(0x7fd1ec15e900 0x7fd1ec0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.006+0000 7fd1f119f640 1 -- 172.21.15.50:0/4250957438 >> 172.21.15.50:0/4250957438 conn(0x7fd1ec072590 msgr2=0x7fd1ec0729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.007+0000 7fd1f119f640 1 -- 172.21.15.50:0/4250957438 shutdown_connections 2024-09-11T22:22:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.007+0000 7fd1f119f640 1 -- 172.21.15.50:0/4250957438 wait complete. 2024-09-11T22:22:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.008+0000 7fd1f119f640 1 Processor -- start 2024-09-11T22:22:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.008+0000 7fd1f119f640 1 -- start start 2024-09-11T22:22:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.008+0000 7fd1f119f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ec0d4090 0x7fd1ec14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.008+0000 7fd1f119f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ec0d4ad0 0x7fd1ec1f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.008+0000 7fd1f119f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ec15e900 0x7fd1ec15d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.008+0000 7fd1f119f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec0cfb90 con 0x7fd1ec0d4090 2024-09-11T22:22:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.008+0000 7fd1f119f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec0cfa10 con 0x7fd1ec15e900 2024-09-11T22:22:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.008+0000 7fd1f119f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ec0b8c20 con 0x7fd1ec0d4ad0 2024-09-11T22:22:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1ebfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ec0d4090 0x7fd1ec14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1ebfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ec0d4090 0x7fd1ec14ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36564/0 (socket says 172.21.15.50:36564) 2024-09-11T22:22:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1ebfff640 1 -- 172.21.15.50:0/666894651 learned_addr learned my addr 172.21.15.50:0/666894651 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1e3fff640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ec0d4ad0 0x7fd1ec1f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1f099e640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ec15e900 0x7fd1ec15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1ebfff640 1 -- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ec0d4ad0 msgr2=0x7fd1ec1f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1ebfff640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ec0d4ad0 0x7fd1ec1f4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1ebfff640 1 -- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ec15e900 msgr2=0x7fd1ec15d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1ebfff640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ec15e900 0x7fd1ec15d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1ebfff640 1 -- 172.21.15.50:0/666894651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ec14f100 con 0x7fd1ec0d4090 2024-09-11T22:22:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1f099e640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ec15e900 0x7fd1ec15d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1ebfff640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ec0d4090 0x7fd1ec14ebc0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00e960 tx=0x7fd1dc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1e97fa640 1 -- 172.21.15.50:0/666894651 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc017070 con 0x7fd1ec0d4090 2024-09-11T22:22:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1e97fa640 1 -- 172.21.15.50:0/666894651 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1dc00ca00 con 0x7fd1ec0d4090 2024-09-11T22:22:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1f119f640 1 -- 172.21.15.50:0/666894651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ec15a500 con 0x7fd1ec0d4090 2024-09-11T22:22:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1e97fa640 1 -- 172.21.15.50:0/666894651 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc00cdd0 con 0x7fd1ec0d4090 2024-09-11T22:22:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.009+0000 7fd1f119f640 1 -- 172.21.15.50:0/666894651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ec15aac0 con 0x7fd1ec0d4090 2024-09-11T22:22:24.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.010+0000 7fd1f119f640 1 -- 172.21.15.50:0/666894651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ec0d5750 con 0x7fd1ec0d4090 2024-09-11T22:22:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.011+0000 7fd1e97fa640 1 -- 172.21.15.50:0/666894651 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1dc01a070 con 0x7fd1ec0d4090 2024-09-11T22:22:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.011+0000 7fd1e97fa640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd1cc06be30 0x7fd1cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.012+0000 7fd1e97fa640 1 -- 172.21.15.50:0/666894651 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5795+0+0 (secure 0 0 0) 0x7fd1dc08ace0 con 0x7fd1ec0d4090 2024-09-11T22:22:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.012+0000 7fd1e3fff640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd1cc06be30 0x7fd1cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:24.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.012+0000 7fd1e3fff640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd1cc06be30 0x7fd1cc06e2f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4034000 tx=0x7fd1d402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:24.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.016+0000 7fd1e97fa640 1 -- 172.21.15.50:0/666894651 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1ec0d5750 con 0x7fd1ec0d4090 2024-09-11T22:22:24.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.191+0000 7fd1f119f640 1 -- 172.21.15.50:0/666894651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd1ec072bc0 con 0x7fd1ec0d4090 2024-09-11T22:22:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.828+0000 7fd1e97fa640 1 -- 172.21.15.50:0/666894651 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v169) ==== 181+0+0 (secure 0 0 0) 0x7fd1dc058ff0 con 0x7fd1ec0d4090 2024-09-11T22:22:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:22:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.832+0000 7fd1f119f640 1 -- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd1cc06be30 msgr2=0x7fd1cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.832+0000 7fd1f119f640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd1cc06be30 0x7fd1cc06e2f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4034000 tx=0x7fd1d402e000 comp rx=0 tx=0).stop 2024-09-11T22:22:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.832+0000 7fd1f119f640 1 -- 172.21.15.50:0/666894651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ec0d4090 msgr2=0x7fd1ec14ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.832+0000 7fd1f119f640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ec0d4090 0x7fd1ec14ebc0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00e960 tx=0x7fd1dc00ee20 comp rx=0 tx=0).stop 2024-09-11T22:22:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.832+0000 7fd1f119f640 1 -- 172.21.15.50:0/666894651 shutdown_connections 2024-09-11T22:22:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.832+0000 7fd1f119f640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd1cc06be30 0x7fd1cc06e2f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.832+0000 7fd1f119f640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1ec0d4ad0 0x7fd1ec1f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.832+0000 7fd1f119f640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1ec15e900 0x7fd1ec15d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.832+0000 7fd1f119f640 1 --2- 172.21.15.50:0/666894651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1ec0d4090 0x7fd1ec14ebc0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.832+0000 7fd1f119f640 1 -- 172.21.15.50:0/666894651 >> 172.21.15.50:0/666894651 conn(0x7fd1ec072590 msgr2=0x7fd1ec0b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.832+0000 7fd1f119f640 1 -- 172.21.15.50:0/666894651 shutdown_connections 2024-09-11T22:22:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.832+0000 7fd1f119f640 1 -- 172.21.15.50:0/666894651 wait complete. 2024-09-11T22:22:24.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:22:24.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.962+0000 7f031625e640 1 Processor -- start 2024-09-11T22:22:24.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.962+0000 7f031625e640 1 -- start start 2024-09-11T22:22:24.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.962+0000 7f031625e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0310161d60 0x7f03100d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.962+0000 7f031625e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f03100d39f0 0x7f03100b6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.962+0000 7f031625e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03100b7990 con 0x7f03100b6c70 2024-09-11T22:22:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.962+0000 7f031625e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f03100b70a0 con 0x7f0310161d60 2024-09-11T22:22:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.962+0000 7f031625e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f03100d4530 con 0x7f03100d39f0 2024-09-11T22:22:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.963+0000 7f030f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0310161d60 0x7f03100d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.963+0000 7f030f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0310161d60 0x7f03100d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36574/0 (socket says 172.21.15.50:36574) 2024-09-11T22:22:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.963+0000 7f030ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f03100b6c70 0x7f03100d1170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53822/0 (socket says 172.21.15.50:53822) 2024-09-11T22:22:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.963+0000 7f030f7fe640 1 -- 172.21.15.50:0/3996716538 learned_addr learned my addr 172.21.15.50:0/3996716538 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.963+0000 7f030effd640 1 --2- 172.21.15.50:0/3996716538 >> v2:172.21.15.77:3300/0 conn(0x7f03100d39f0 0x7f03100b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.963+0000 7f030f7fe640 1 -- 172.21.15.50:0/3996716538 >> v2:172.21.15.77:3300/0 conn(0x7f03100d39f0 msgr2=0x7f03100b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.963+0000 7f030f7fe640 1 --2- 172.21.15.50:0/3996716538 >> v2:172.21.15.77:3300/0 conn(0x7f03100d39f0 0x7f03100b6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.963+0000 7f030f7fe640 1 -- 172.21.15.50:0/3996716538 >> v1:172.21.15.50:6789/0 conn(0x7f03100b6c70 legacy=0x7f03100d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:24.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.963+0000 7f030e7fc640 1 -- 172.21.15.50:0/3996716538 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987474690 0 0) 0x7f03100b7990 con 0x7f03100b6c70 2024-09-11T22:22:24.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.963+0000 7f030f7fe640 1 -- 172.21.15.50:0/3996716538 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03100d3f70 con 0x7f0310161d60 2024-09-11T22:22:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.964+0000 7f030f7fe640 1 --2- 172.21.15.50:0/3996716538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0310161d60 0x7f03100d34b0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f0310072680 tx=0x7f030002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6671bdf2d115b0ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.964+0000 7f030e7fc640 1 -- 172.21.15.50:0/3996716538 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300037070 con 0x7f0310161d60 2024-09-11T22:22:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.964+0000 7f030e7fc640 1 -- 172.21.15.50:0/3996716538 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0300032440 con 0x7f0310161d60 2024-09-11T22:22:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.964+0000 7f030e7fc640 1 -- 172.21.15.50:0/3996716538 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300032810 con 0x7f0310161d60 2024-09-11T22:22:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.964+0000 7f031625e640 1 -- 172.21.15.50:0/3996716538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0310161d60 msgr2=0x7f03100d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.964+0000 7f031625e640 1 --2- 172.21.15.50:0/3996716538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0310161d60 0x7f03100d34b0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f0310072680 tx=0x7f030002a270 comp rx=0 tx=0).stop 2024-09-11T22:22:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.964+0000 7f031625e640 1 -- 172.21.15.50:0/3996716538 shutdown_connections 2024-09-11T22:22:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.964+0000 7f031625e640 1 --2- 172.21.15.50:0/3996716538 >> v2:172.21.15.77:3300/0 conn(0x7f03100d39f0 0x7f03100b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.964+0000 7f031625e640 1 --2- 172.21.15.50:0/3996716538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0310161d60 0x7f03100d34b0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.965+0000 7f031625e640 1 -- 172.21.15.50:0/3996716538 >> 172.21.15.50:0/3996716538 conn(0x7f0310067db0 msgr2=0x7f03100681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.965+0000 7f031625e640 1 -- 172.21.15.50:0/3996716538 shutdown_connections 2024-09-11T22:22:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.965+0000 7f031625e640 1 -- 172.21.15.50:0/3996716538 wait complete. 2024-09-11T22:22:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.966+0000 7f031625e640 1 Processor -- start 2024-09-11T22:22:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.966+0000 7f031625e640 1 -- start start 2024-09-11T22:22:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f031625e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03100b6c70 0x7f031015ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f031625e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03100d39f0 0x7f03100ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f031625e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0310161d60 0x7f031014ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f031625e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f03100cf930 con 0x7f0310161d60 2024-09-11T22:22:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f031625e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f03100b7c30 con 0x7f03100d39f0 2024-09-11T22:22:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f031625e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f03100b9160 con 0x7f03100b6c70 2024-09-11T22:22:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f030ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0310161d60 0x7f031014ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f030ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0310161d60 0x7f031014ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36586/0 (socket says 172.21.15.50:36586) 2024-09-11T22:22:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f030ffff640 1 -- 172.21.15.50:0/4167016757 learned_addr learned my addr 172.21.15.50:0/4167016757 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f030effd640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03100d39f0 0x7f03100ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f030f7fe640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03100b6c70 0x7f031015ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f030ffff640 1 -- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03100b6c70 msgr2=0x7f031015ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f030ffff640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03100b6c70 0x7f031015ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f030ffff640 1 -- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03100d39f0 msgr2=0x7f03100ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f030ffff640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03100d39f0 0x7f03100ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f030ffff640 1 -- 172.21.15.50:0/4167016757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031015d540 con 0x7f0310161d60 2024-09-11T22:22:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f030effd640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03100d39f0 0x7f03100ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f030ffff640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0310161d60 0x7f031014ec30 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f030800c7a0 tx=0x7f030800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.967+0000 7f02f7fff640 1 -- 172.21.15.50:0/4167016757 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308018070 con 0x7f0310161d60 2024-09-11T22:22:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.968+0000 7f02f7fff640 1 -- 172.21.15.50:0/4167016757 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f030800a640 con 0x7f0310161d60 2024-09-11T22:22:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.968+0000 7f02f7fff640 1 -- 172.21.15.50:0/4167016757 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030800aab0 con 0x7f0310161d60 2024-09-11T22:22:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.968+0000 7f031625e640 1 -- 172.21.15.50:0/4167016757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031015d820 con 0x7f0310161d60 2024-09-11T22:22:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.968+0000 7f031625e640 1 -- 172.21.15.50:0/4167016757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f031015dde0 con 0x7f0310161d60 2024-09-11T22:22:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.969+0000 7f031625e640 1 -- 172.21.15.50:0/4167016757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0310075770 con 0x7f0310161d60 2024-09-11T22:22:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.969+0000 7f02f7fff640 1 -- 172.21.15.50:0/4167016757 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f030801b070 con 0x7f0310161d60 2024-09-11T22:22:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.969+0000 7f02f7fff640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02fc06be30 0x7f02fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.970+0000 7f02f7fff640 1 -- 172.21.15.50:0/4167016757 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5357+0+0 (secure 0 0 0) 0x7f030808a280 con 0x7f0310161d60 2024-09-11T22:22:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.970+0000 7f030f7fe640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02fc06be30 0x7f02fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.970+0000 7f030f7fe640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02fc06be30 0x7f02fc06e2f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0300034000 tx=0x7f030002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:24.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:24.974+0000 7f02f7fff640 1 -- 172.21.15.50:0/4167016757 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0310075770 con 0x7f0310161d60 2024-09-11T22:22:25.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.149+0000 7f031625e640 1 -- 172.21.15.50:0/4167016757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f03100b6730 con 0x7f0310161d60 2024-09-11T22:22:25.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.834+0000 7f02f7fff640 1 -- 172.21.15.50:0/4167016757 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v170) ==== 169+0+0 (secure 0 0 0) 0x7f0308058e20 con 0x7f0310161d60 2024-09-11T22:22:25.834 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:22:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.838+0000 7f031625e640 1 -- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02fc06be30 msgr2=0x7f02fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.838+0000 7f031625e640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02fc06be30 0x7f02fc06e2f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0300034000 tx=0x7f030002e000 comp rx=0 tx=0).stop 2024-09-11T22:22:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.838+0000 7f031625e640 1 -- 172.21.15.50:0/4167016757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0310161d60 msgr2=0x7f031014ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.838+0000 7f031625e640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0310161d60 0x7f031014ec30 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f030800c7a0 tx=0x7f030800cc60 comp rx=0 tx=0).stop 2024-09-11T22:22:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.838+0000 7f031625e640 1 -- 172.21.15.50:0/4167016757 shutdown_connections 2024-09-11T22:22:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.838+0000 7f031625e640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f02fc06be30 0x7f02fc06e2f0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.838+0000 7f031625e640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0310161d60 0x7f031014ec30 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.838+0000 7f031625e640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03100d39f0 0x7f03100ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.838+0000 7f031625e640 1 --2- 172.21.15.50:0/4167016757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03100b6c70 0x7f031015ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.838+0000 7f031625e640 1 -- 172.21.15.50:0/4167016757 >> 172.21.15.50:0/4167016757 conn(0x7f0310067db0 msgr2=0x7f03100b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.839+0000 7f031625e640 1 -- 172.21.15.50:0/4167016757 shutdown_connections 2024-09-11T22:22:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.839+0000 7f031625e640 1 -- 172.21.15.50:0/4167016757 wait complete. 2024-09-11T22:22:25.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T22:22:25.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.970+0000 7fc5263d6640 1 Processor -- start 2024-09-11T22:22:25.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.970+0000 7fc5263d6640 1 -- start start 2024-09-11T22:22:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.971+0000 7fc5263d6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc52015e8e0 0x7fc5200b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:25.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.971+0000 7fc5263d6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5200d1580 0x7fc5200d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.971+0000 7fc5263d6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5200d1ee0 con 0x7fc520162350 2024-09-11T22:22:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.971+0000 7fc5263d6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc52015ecc0 con 0x7fc52015e8e0 2024-09-11T22:22:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.971+0000 7fc5263d6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc5200d2ad0 con 0x7fc5200d1580 2024-09-11T22:22:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.971+0000 7fc524973640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc520162350 0x7fc520162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53830/0 (socket says 172.21.15.50:53830) 2024-09-11T22:22:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.971+0000 7fc524973640 1 -- 172.21.15.50:0/1704306127 learned_addr learned my addr 172.21.15.50:0/1704306127 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.971+0000 7fc51f7fe640 1 --2- 172.21.15.50:0/1704306127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5200d1580 0x7fc5200d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.971+0000 7fc51ffff640 1 --2- 172.21.15.50:0/1704306127 >> v2:172.21.15.77:3300/0 conn(0x7fc52015e8e0 0x7fc5200b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.972+0000 7fc51effd640 1 -- 172.21.15.50:0/1704306127 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2179635700 0 0) 0x7fc5200d1ee0 con 0x7fc520162350 2024-09-11T22:22:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.972+0000 7fc51effd640 1 -- 172.21.15.50:0/1704306127 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc508003520 con 0x7fc520162350 2024-09-11T22:22:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.972+0000 7fc51f7fe640 1 -- 172.21.15.50:0/1704306127 >> v2:172.21.15.77:3300/0 conn(0x7fc52015e8e0 msgr2=0x7fc5200b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.972+0000 7fc51f7fe640 1 --2- 172.21.15.50:0/1704306127 >> v2:172.21.15.77:3300/0 conn(0x7fc52015e8e0 0x7fc5200b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.972+0000 7fc51f7fe640 1 -- 172.21.15.50:0/1704306127 >> v1:172.21.15.50:6789/0 conn(0x7fc520162350 legacy=0x7fc520162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:25.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.972+0000 7fc51f7fe640 1 -- 172.21.15.50:0/1704306127 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc520163080 con 0x7fc5200d1580 2024-09-11T22:22:25.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.973+0000 7fc51f7fe640 1 --2- 172.21.15.50:0/1704306127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5200d1580 0x7fc5200d19a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc5140097a0 tx=0x7fc51402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=618e0039dd2b296e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.973+0000 7fc51effd640 1 -- 172.21.15.50:0/1704306127 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc514037070 con 0x7fc5200d1580 2024-09-11T22:22:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.973+0000 7fc51effd640 1 -- 172.21.15.50:0/1704306127 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc514032440 con 0x7fc5200d1580 2024-09-11T22:22:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.973+0000 7fc51effd640 1 -- 172.21.15.50:0/1704306127 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc514032810 con 0x7fc5200d1580 2024-09-11T22:22:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.973+0000 7fc5263d6640 1 -- 172.21.15.50:0/1704306127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5200d1580 msgr2=0x7fc5200d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.973+0000 7fc5263d6640 1 --2- 172.21.15.50:0/1704306127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5200d1580 0x7fc5200d19a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc5140097a0 tx=0x7fc51402a210 comp rx=0 tx=0).stop 2024-09-11T22:22:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.973+0000 7fc5263d6640 1 -- 172.21.15.50:0/1704306127 shutdown_connections 2024-09-11T22:22:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.973+0000 7fc5263d6640 1 --2- 172.21.15.50:0/1704306127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5200d1580 0x7fc5200d19a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.973+0000 7fc5263d6640 1 --2- 172.21.15.50:0/1704306127 >> v2:172.21.15.77:3300/0 conn(0x7fc52015e8e0 0x7fc5200b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.973+0000 7fc5263d6640 1 -- 172.21.15.50:0/1704306127 >> 172.21.15.50:0/1704306127 conn(0x7fc520067ba0 msgr2=0x7fc520067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.973+0000 7fc5263d6640 1 -- 172.21.15.50:0/1704306127 shutdown_connections 2024-09-11T22:22:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.973+0000 7fc5263d6640 1 -- 172.21.15.50:0/1704306127 wait complete. 2024-09-11T22:22:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.975+0000 7fc5263d6640 1 Processor -- start 2024-09-11T22:22:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.975+0000 7fc5263d6640 1 -- start start 2024-09-11T22:22:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.975+0000 7fc5263d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5200d1580 0x7fc520152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.975+0000 7fc5263d6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc52015e8e0 0x7fc5200b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.975+0000 7fc5263d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520162350 0x7fc5200b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.975+0000 7fc5263d6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc5200d3000 con 0x7fc520162350 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.975+0000 7fc5263d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc5200d3370 con 0x7fc5200d1580 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.975+0000 7fc5263d6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc5200d3800 con 0x7fc52015e8e0 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc524973640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520162350 0x7fc5200b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc524973640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520162350 0x7fc5200b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36598/0 (socket says 172.21.15.50:36598) 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc524973640 1 -- 172.21.15.50:0/4030234935 learned_addr learned my addr 172.21.15.50:0/4030234935 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc51f7fe640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc52015e8e0 0x7fc5200b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc51ffff640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5200d1580 0x7fc520152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc524973640 1 -- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc52015e8e0 msgr2=0x7fc5200b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc524973640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc52015e8e0 0x7fc5200b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc524973640 1 -- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5200d1580 msgr2=0x7fc520152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc524973640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5200d1580 0x7fc520152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc524973640 1 -- 172.21.15.50:0/4030234935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5200b4dc0 con 0x7fc520162350 2024-09-11T22:22:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc524973640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520162350 0x7fc5200b4790 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7fc51800caa0 tx=0x7fc51800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc51cff9640 1 -- 172.21.15.50:0/4030234935 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518017070 con 0x7fc520162350 2024-09-11T22:22:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc51cff9640 1 -- 172.21.15.50:0/4030234935 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc51800ac00 con 0x7fc520162350 2024-09-11T22:22:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc5263d6640 1 -- 172.21.15.50:0/4030234935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5200b50a0 con 0x7fc520162350 2024-09-11T22:22:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc51cff9640 1 -- 172.21.15.50:0/4030234935 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518012400 con 0x7fc520162350 2024-09-11T22:22:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.976+0000 7fc5263d6640 1 -- 172.21.15.50:0/4030234935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5200b5940 con 0x7fc520162350 2024-09-11T22:22:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.977+0000 7fc5263d6640 1 -- 172.21.15.50:0/4030234935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5200b5490 con 0x7fc520162350 2024-09-11T22:22:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.978+0000 7fc51cff9640 1 -- 172.21.15.50:0/4030234935 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc51801a070 con 0x7fc520162350 2024-09-11T22:22:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.978+0000 7fc51cff9640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc50c06be30 0x7fc50c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.978+0000 7fc51cff9640 1 -- 172.21.15.50:0/4030234935 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 4943+0+0 (secure 0 0 0) 0x7fc51808a9c0 con 0x7fc520162350 2024-09-11T22:22:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.978+0000 7fc51ffff640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc50c06be30 0x7fc50c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.979+0000 7fc51ffff640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc50c06be30 0x7fc50c06e2f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc510009b40 tx=0x7fc510009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:25.982+0000 7fc51cff9640 1 -- 172.21.15.50:0/4030234935 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc518058f00 con 0x7fc520162350 2024-09-11T22:22:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.156+0000 7fc5263d6640 1 -- 172.21.15.50:0/4030234935 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc5200b7880 con 0x7fc520162350 2024-09-11T22:22:26.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.160+0000 7fc51cff9640 1 -- 172.21.15.50:0/4030234935 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v45) ==== 104+0+0 (secure 0 0 0) 0x7fc51805d200 con 0x7fc520162350 2024-09-11T22:22:26.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.162+0000 7fc5263d6640 1 -- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc50c06be30 msgr2=0x7fc50c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:26.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.162+0000 7fc5263d6640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc50c06be30 0x7fc50c06e2f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc510009b40 tx=0x7fc510009190 comp rx=0 tx=0).stop 2024-09-11T22:22:26.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.162+0000 7fc5263d6640 1 -- 172.21.15.50:0/4030234935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520162350 msgr2=0x7fc5200b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:26.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.162+0000 7fc5263d6640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520162350 0x7fc5200b4790 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7fc51800caa0 tx=0x7fc51800cf60 comp rx=0 tx=0).stop 2024-09-11T22:22:26.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.162+0000 7fc5263d6640 1 -- 172.21.15.50:0/4030234935 shutdown_connections 2024-09-11T22:22:26.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.162+0000 7fc5263d6640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc50c06be30 0x7fc50c06e2f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:26.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.162+0000 7fc5263d6640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc52015e8e0 0x7fc5200b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:26.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.162+0000 7fc5263d6640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520162350 0x7fc5200b4790 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:26.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.162+0000 7fc5263d6640 1 --2- 172.21.15.50:0/4030234935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5200d1580 0x7fc520152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:26.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.162+0000 7fc5263d6640 1 -- 172.21.15.50:0/4030234935 >> 172.21.15.50:0/4030234935 conn(0x7fc520067ba0 msgr2=0x7fc52015f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:26.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.162+0000 7fc5263d6640 1 -- 172.21.15.50:0/4030234935 shutdown_connections 2024-09-11T22:22:26.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.162+0000 7fc5263d6640 1 -- 172.21.15.50:0/4030234935 wait complete. 2024-09-11T22:22:26.636 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-11T22:22:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.738+0000 7f68070a4640 1 Processor -- start 2024-09-11T22:22:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.738+0000 7f68070a4640 1 -- start start 2024-09-11T22:22:26.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.739+0000 7f68070a4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68000d18a0 0x7f68000d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:26.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.739+0000 7f68070a4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68000cfa80 con 0x7f680015e870 2024-09-11T22:22:26.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.739+0000 7f68070a4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68000d40d0 con 0x7f68000d3a30 2024-09-11T22:22:26.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.739+0000 7f68070a4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f68000d3ea0 con 0x7f68000d18a0 2024-09-11T22:22:26.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.739+0000 7f6804e40640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f680015e870 0x7f68000d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53840/0 (socket says 172.21.15.50:53840) 2024-09-11T22:22:26.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.739+0000 7f6804e40640 1 -- 172.21.15.50:0/2457289600 learned_addr learned my addr 172.21.15.50:0/2457289600 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:26.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538000012 0 0) 0x7f67f0001110 con 0x7f680015e870 2024-09-11T22:22:26.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67e8003520 con 0x7f680015e870 2024-09-11T22:22:26.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67fffff640 1 --2- 172.21.15.50:0/2457289600 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68000d18a0 0x7f68000d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1606284433 0 0) 0x7f67e8003520 con 0x7f680015e870 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68000d18a0 msgr2=0x7f68000d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 --2- 172.21.15.50:0/2457289600 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68000d18a0 0x7f68000d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 >> v1:172.21.15.77:6789/0 conn(0x7f68000d3a30 legacy=0x7f68000b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68000d43b0 con 0x7f680015e870 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f67f0001840 con 0x7f680015e870 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 >> v1:172.21.15.50:6789/0 conn(0x7f680015e870 legacy=0x7f68000d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 --2- 172.21.15.50:0/2457289600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e80039e0 0x7f67e8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 --2- 172.21.15.50:0/2457289600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67e8004800 0x7f67e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 --2- 172.21.15.50:0/2457289600 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68000d18a0 0x7f67e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f67e800ba70 con 0x7f67e80039e0 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f67e800bc20 con 0x7f67e8004800 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f67e800be20 con 0x7f68000d18a0 2024-09-11T22:22:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f6804e40640 1 --2- 172.21.15.50:0/2457289600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e80039e0 0x7f67e8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f67fffff640 1 --2- 172.21.15.50:0/2457289600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67e8004800 0x7f67e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f6805641640 1 --2- 172.21.15.50:0/2457289600 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68000d18a0 0x7f67e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f6804e40640 1 -- 172.21.15.50:0/2457289600 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68000d18a0 msgr2=0x7f67e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f6804e40640 1 --2- 172.21.15.50:0/2457289600 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68000d18a0 0x7f67e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f6804e40640 1 -- 172.21.15.50:0/2457289600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67e8004800 msgr2=0x7f67e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f6804e40640 1 --2- 172.21.15.50:0/2457289600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67e8004800 0x7f67e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.740+0000 7f6804e40640 1 -- 172.21.15.50:0/2457289600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e8003520 con 0x7f67e80039e0 2024-09-11T22:22:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.741+0000 7f6804e40640 1 --2- 172.21.15.50:0/2457289600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e80039e0 0x7f67e8003e00 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f67f000c490 tx=0x7f67e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0132461f14124a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.741+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f000c0e0 con 0x7f67e80039e0 2024-09-11T22:22:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.741+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f0034070 con 0x7f67e80039e0 2024-09-11T22:22:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.741+0000 7f67ff7fe640 1 -- 172.21.15.50:0/2457289600 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0005d30 con 0x7f67e80039e0 2024-09-11T22:22:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.742+0000 7f68070a4640 1 -- 172.21.15.50:0/2457289600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e80039e0 msgr2=0x7f67e8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.742+0000 7f68070a4640 1 --2- 172.21.15.50:0/2457289600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e80039e0 0x7f67e8003e00 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f67f000c490 tx=0x7f67e8005830 comp rx=0 tx=0).stop 2024-09-11T22:22:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.742+0000 7f6805641640 1 -- 172.21.15.50:0/2457289600 reap_dead start 2024-09-11T22:22:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.742+0000 7f68070a4640 1 -- 172.21.15.50:0/2457289600 shutdown_connections 2024-09-11T22:22:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.742+0000 7f68070a4640 1 -- 172.21.15.50:0/2457289600 >> 172.21.15.50:0/2457289600 conn(0x7f68000727a0 msgr2=0x7f68000679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.742+0000 7f68070a4640 1 -- 172.21.15.50:0/2457289600 shutdown_connections 2024-09-11T22:22:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.742+0000 7f68070a4640 1 -- 172.21.15.50:0/2457289600 wait complete. 2024-09-11T22:22:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.743+0000 7f68070a4640 1 Processor -- start 2024-09-11T22:22:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.743+0000 7f68070a4640 1 -- start start 2024-09-11T22:22:26.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f68070a4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e80039e0 0x7f68001547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f68070a4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68001f8b20 0x7f6800158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f68070a4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68001f7f60 0x7f68001f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f68070a4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f680015ec50 con 0x7f67e80039e0 2024-09-11T22:22:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f68070a4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f68000b7ee0 con 0x7f68001f7f60 2024-09-11T22:22:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f68070a4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f68000b78b0 con 0x7f68001f8b20 2024-09-11T22:22:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f6804e40640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e80039e0 0x7f68001547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f6804e40640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e80039e0 0x7f68001547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36614/0 (socket says 172.21.15.50:36614) 2024-09-11T22:22:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f6804e40640 1 -- 172.21.15.50:0/1289401775 learned_addr learned my addr 172.21.15.50:0/1289401775 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f67fffff640 1 --2- 172.21.15.50:0/1289401775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68001f8b20 0x7f6800158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f6804e40640 1 -- 172.21.15.50:0/1289401775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68001f8b20 msgr2=0x7f6800158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f6804e40640 1 --2- 172.21.15.50:0/1289401775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68001f8b20 0x7f6800158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f6804e40640 1 -- 172.21.15.50:0/1289401775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68001f7f60 msgr2=0x7f68001f83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:26.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f6804e40640 1 --2- 172.21.15.50:0/1289401775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68001f7f60 0x7f68001f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f6804e40640 1 -- 172.21.15.50:0/1289401775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6800158e90 con 0x7f67e80039e0 2024-09-11T22:22:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.744+0000 7f6804e40640 1 --2- 172.21.15.50:0/1289401775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e80039e0 0x7f68001547d0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f67f0031040 tx=0x7f68000d4580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.745+0000 7f67fd7fa640 1 -- 172.21.15.50:0/1289401775 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0007070 con 0x7f67e80039e0 2024-09-11T22:22:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.745+0000 7f67fd7fa640 1 -- 172.21.15.50:0/1289401775 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f0007210 con 0x7f67e80039e0 2024-09-11T22:22:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.745+0000 7f68070a4640 1 -- 172.21.15.50:0/1289401775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68001562f0 con 0x7f67e80039e0 2024-09-11T22:22:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.745+0000 7f67fd7fa640 1 -- 172.21.15.50:0/1289401775 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0007600 con 0x7f67e80039e0 2024-09-11T22:22:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.745+0000 7f68070a4640 1 -- 172.21.15.50:0/1289401775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68001568a0 con 0x7f67e80039e0 2024-09-11T22:22:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.746+0000 7f68070a4640 1 -- 172.21.15.50:0/1289401775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68000d34f0 con 0x7f67e80039e0 2024-09-11T22:22:26.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.746+0000 7f67fd7fa640 1 -- 172.21.15.50:0/1289401775 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67f002e070 con 0x7f67e80039e0 2024-09-11T22:22:26.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.747+0000 7f67fd7fa640 1 --2- 172.21.15.50:0/1289401775 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67ec06be60 0x7f67ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:26.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.747+0000 7f67fd7fa640 1 -- 172.21.15.50:0/1289401775 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 4943+0+0 (secure 0 0 0) 0x7f67f00ab520 con 0x7f67e80039e0 2024-09-11T22:22:26.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.747+0000 7f67fffff640 1 --2- 172.21.15.50:0/1289401775 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67ec06be60 0x7f67ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:26.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.748+0000 7f67fffff640 1 --2- 172.21.15.50:0/1289401775 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67ec06be60 0x7f67ec06e320 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f68001f8fd0 tx=0x7f67f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.751+0000 7f67fd7fa640 1 -- 172.21.15.50:0/1289401775 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67f002c040 con 0x7f67e80039e0 2024-09-11T22:22:26.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:26.997+0000 7f68070a4640 1 -- 172.21.15.50:0/1289401775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7f680015f5a0 con 0x7f67e80039e0 2024-09-11T22:22:27.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.837+0000 7f67fd7fa640 1 -- 172.21.15.50:0/1289401775 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v542) ==== 159+0+0 (secure 0 0 0) 0x7f68000cfa80 con 0x7f67e80039e0 2024-09-11T22:22:27.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.839+0000 7f68070a4640 1 -- 172.21.15.50:0/1289401775 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67ec06be60 msgr2=0x7f67ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.839+0000 7f68070a4640 1 --2- 172.21.15.50:0/1289401775 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67ec06be60 0x7f67ec06e320 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f68001f8fd0 tx=0x7f67f4008040 comp rx=0 tx=0).stop 2024-09-11T22:22:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.839+0000 7f68070a4640 1 -- 172.21.15.50:0/1289401775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e80039e0 msgr2=0x7f68001547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.839+0000 7f68070a4640 1 --2- 172.21.15.50:0/1289401775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e80039e0 0x7f68001547d0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f67f0031040 tx=0x7f68000d4580 comp rx=0 tx=0).stop 2024-09-11T22:22:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.840+0000 7f68070a4640 1 -- 172.21.15.50:0/1289401775 shutdown_connections 2024-09-11T22:22:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.840+0000 7f68070a4640 1 --2- 172.21.15.50:0/1289401775 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f67ec06be60 0x7f67ec06e320 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.840+0000 7f68070a4640 1 --2- 172.21.15.50:0/1289401775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68001f8b20 0x7f6800158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.840+0000 7f68070a4640 1 --2- 172.21.15.50:0/1289401775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68001f7f60 0x7f68001f83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.840+0000 7f68070a4640 1 --2- 172.21.15.50:0/1289401775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e80039e0 0x7f68001547d0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.840+0000 7f68070a4640 1 -- 172.21.15.50:0/1289401775 >> 172.21.15.50:0/1289401775 conn(0x7f68000727a0 msgr2=0x7f68000d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.840+0000 7f68070a4640 1 -- 172.21.15.50:0/1289401775 shutdown_connections 2024-09-11T22:22:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.840+0000 7f68070a4640 1 -- 172.21.15.50:0/1289401775 wait complete. 2024-09-11T22:22:27.854 INFO:tasks.cephfs_test_runner:test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-11T22:22:27.855 INFO:tasks.cephfs_test_runner:Starting test: test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-11T22:22:27.855 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:22:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.963+0000 7fcf571c4640 1 Processor -- start 2024-09-11T22:22:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.963+0000 7fcf571c4640 1 -- start start 2024-09-11T22:22:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.964+0000 7fcf571c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcf500cf790 0x7fcf500b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.964+0000 7fcf571c4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf50162110 con 0x7fcf500d11d0 2024-09-11T22:22:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.964+0000 7fcf571c4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf500cfd70 con 0x7fcf50161d30 2024-09-11T22:22:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.964+0000 7fcf571c4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fcf500d3450 con 0x7fcf500cf790 2024-09-11T22:22:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.964+0000 7fcf4ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcf500cf790 0x7fcf500b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.964+0000 7fcf55761640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcf500d11d0 0x7fcf500d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39224/0 (socket says 172.21.15.50:39224) 2024-09-11T22:22:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.964+0000 7fcf4ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcf500cf790 0x7fcf500b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47746/0 (socket says 172.21.15.50:47746) 2024-09-11T22:22:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.964+0000 7fcf55761640 1 -- 172.21.15.50:0/522845026 learned_addr learned my addr 172.21.15.50:0/522845026 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.965+0000 7fcf4ffff640 1 -- 172.21.15.50:0/522845026 >> v1:172.21.15.77:6789/0 conn(0x7fcf50161d30 legacy=0x7fcf50162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.965+0000 7fcf4ffff640 1 -- 172.21.15.50:0/522845026 >> v1:172.21.15.50:6789/0 conn(0x7fcf500d11d0 legacy=0x7fcf500d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.965+0000 7fcf4ffff640 1 -- 172.21.15.50:0/522845026 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf500d2b20 con 0x7fcf500cf790 2024-09-11T22:22:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.965+0000 7fcf4f7fe640 1 -- 172.21.15.50:0/522845026 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200060528 0 0) 0x7fcf50162110 con 0x7fcf500d11d0 2024-09-11T22:22:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.965+0000 7fcf4ffff640 1 --2- 172.21.15.50:0/522845026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf500cf790 0x7fcf500b78f0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fcf440097a0 tx=0x7fcf4402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307110915c29f38c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.966+0000 7fcf4f7fe640 1 -- 172.21.15.50:0/522845026 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44037070 con 0x7fcf500cf790 2024-09-11T22:22:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.966+0000 7fcf4f7fe640 1 -- 172.21.15.50:0/522845026 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf44032440 con 0x7fcf500cf790 2024-09-11T22:22:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.966+0000 7fcf4f7fe640 1 -- 172.21.15.50:0/522845026 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44032810 con 0x7fcf500cf790 2024-09-11T22:22:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.966+0000 7fcf571c4640 1 -- 172.21.15.50:0/522845026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf500cf790 msgr2=0x7fcf500b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.966+0000 7fcf571c4640 1 --2- 172.21.15.50:0/522845026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf500cf790 0x7fcf500b78f0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fcf440097a0 tx=0x7fcf4402a230 comp rx=0 tx=0).stop 2024-09-11T22:22:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.966+0000 7fcf571c4640 1 -- 172.21.15.50:0/522845026 shutdown_connections 2024-09-11T22:22:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.966+0000 7fcf571c4640 1 --2- 172.21.15.50:0/522845026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf500cf790 0x7fcf500b78f0 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.966+0000 7fcf571c4640 1 -- 172.21.15.50:0/522845026 >> 172.21.15.50:0/522845026 conn(0x7fcf500727a0 msgr2=0x7fcf500679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.966+0000 7fcf571c4640 1 -- 172.21.15.50:0/522845026 shutdown_connections 2024-09-11T22:22:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.966+0000 7fcf571c4640 1 -- 172.21.15.50:0/522845026 wait complete. 2024-09-11T22:22:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.967+0000 7fcf571c4640 1 Processor -- start 2024-09-11T22:22:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.967+0000 7fcf571c4640 1 -- start start 2024-09-11T22:22:27.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.968+0000 7fcf571c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf500cf790 0x7fcf5015fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:27.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.968+0000 7fcf571c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf500d11d0 0x7fcf500b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:27.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.968+0000 7fcf571c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf50161d30 0x7fcf500ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:27.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.968+0000 7fcf571c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcf500d30e0 con 0x7fcf50161d30 2024-09-11T22:22:27.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.968+0000 7fcf571c4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcf500b7e30 con 0x7fcf500cf790 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.968+0000 7fcf571c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcf500d1600 con 0x7fcf500d11d0 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.968+0000 7fcf55761640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf50161d30 0x7fcf500ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.968+0000 7fcf55761640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf50161d30 0x7fcf500ad4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47748/0 (socket says 172.21.15.50:47748) 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.968+0000 7fcf55761640 1 -- 172.21.15.50:0/1086479281 learned_addr learned my addr 172.21.15.50:0/1086479281 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf4ffff640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf500d11d0 0x7fcf500b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf54f60640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf500cf790 0x7fcf5015fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf55761640 1 -- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf500d11d0 msgr2=0x7fcf500b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf55761640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf500d11d0 0x7fcf500b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf55761640 1 -- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf500cf790 msgr2=0x7fcf5015fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf55761640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf500cf790 0x7fcf5015fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf55761640 1 -- 172.21.15.50:0/1086479281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf500b43c0 con 0x7fcf50161d30 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf4ffff640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf500d11d0 0x7fcf500b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf54f60640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf500cf790 0x7fcf5015fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf55761640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf50161d30 0x7fcf500ad4b0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c7a0 tx=0x7fcf4800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf4d7fa640 1 -- 172.21.15.50:0/1086479281 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48018070 con 0x7fcf50161d30 2024-09-11T22:22:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf4d7fa640 1 -- 172.21.15.50:0/1086479281 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4800a640 con 0x7fcf50161d30 2024-09-11T22:22:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf571c4640 1 -- 172.21.15.50:0/1086479281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf500b46a0 con 0x7fcf50161d30 2024-09-11T22:22:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf4d7fa640 1 -- 172.21.15.50:0/1086479281 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800aa70 con 0x7fcf50161d30 2024-09-11T22:22:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.969+0000 7fcf571c4640 1 -- 172.21.15.50:0/1086479281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf500b4c60 con 0x7fcf50161d30 2024-09-11T22:22:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.970+0000 7fcf571c4640 1 -- 172.21.15.50:0/1086479281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf500d1900 con 0x7fcf50161d30 2024-09-11T22:22:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.971+0000 7fcf4d7fa640 1 -- 172.21.15.50:0/1086479281 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf4801b070 con 0x7fcf50161d30 2024-09-11T22:22:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.971+0000 7fcf4d7fa640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcf3c06be30 0x7fcf3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.971+0000 7fcf4d7fa640 1 -- 172.21.15.50:0/1086479281 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 4943+0+0 (secure 0 0 0) 0x7fcf4808a130 con 0x7fcf50161d30 2024-09-11T22:22:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.971+0000 7fcf54f60640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcf3c06be30 0x7fcf3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:27.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.972+0000 7fcf54f60640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcf3c06be30 0x7fcf3c06e2f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcf40007fd0 tx=0x7fcf40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:27.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:27.976+0000 7fcf4d7fa640 1 -- 172.21.15.50:0/1086479281 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf48058e70 con 0x7fcf50161d30 2024-09-11T22:22:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.152+0000 7fcf571c4640 1 -- 172.21.15.50:0/1086479281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf500d2490 con 0x7fcf50161d30 2024-09-11T22:22:28.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.153+0000 7fcf4d7fa640 1 -- 172.21.15.50:0/1086479281 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) ==== 74+0+13006 (secure 0 0 0) 0x7fcf48058770 con 0x7fcf50161d30 2024-09-11T22:22:28.154 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:28.154 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":170,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:22:25.829601+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6837/2937331670":"2024-09-12T22:22:22.821062+0000","172.21.15.77:6836/2937331670":"2024-09-12T22:22:22.821062+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:22:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.155+0000 7fcf571c4640 1 -- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcf3c06be30 msgr2=0x7fcf3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.155+0000 7fcf571c4640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcf3c06be30 0x7fcf3c06e2f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcf40007fd0 tx=0x7fcf40009040 comp rx=0 tx=0).stop 2024-09-11T22:22:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.155+0000 7fcf571c4640 1 -- 172.21.15.50:0/1086479281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf50161d30 msgr2=0x7fcf500ad4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.155+0000 7fcf571c4640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf50161d30 0x7fcf500ad4b0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c7a0 tx=0x7fcf4800cc60 comp rx=0 tx=0).stop 2024-09-11T22:22:28.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.155+0000 7fcf571c4640 1 -- 172.21.15.50:0/1086479281 shutdown_connections 2024-09-11T22:22:28.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.155+0000 7fcf571c4640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcf3c06be30 0x7fcf3c06e2f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.155+0000 7fcf571c4640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf500d11d0 0x7fcf500b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.155+0000 7fcf571c4640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf50161d30 0x7fcf500ad4b0 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.155+0000 7fcf571c4640 1 --2- 172.21.15.50:0/1086479281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf500cf790 0x7fcf5015fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.155+0000 7fcf571c4640 1 -- 172.21.15.50:0/1086479281 >> 172.21.15.50:0/1086479281 conn(0x7fcf500727a0 msgr2=0x7fcf500ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:28.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.156+0000 7fcf571c4640 1 -- 172.21.15.50:0/1086479281 shutdown_connections 2024-09-11T22:22:28.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.156+0000 7fcf571c4640 1 -- 172.21.15.50:0/1086479281 wait complete. 2024-09-11T22:22:28.167 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:11:03.407373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:22:28.168 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:22:28.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.273+0000 7f4564df1640 1 Processor -- start 2024-09-11T22:22:28.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.273+0000 7f4564df1640 1 -- start start 2024-09-11T22:22:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.274+0000 7f4564df1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4560161fa0 0x7f45600b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.274+0000 7f4564df1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f45600cf610 0x7f45600cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.274+0000 7f4564df1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45600cfbd0 con 0x7f45600b1600 2024-09-11T22:22:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.274+0000 7f4564df1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f45600d1220 con 0x7f45600cf610 2024-09-11T22:22:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.274+0000 7f4564df1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f45600d17e0 con 0x7f4560161fa0 2024-09-11T22:22:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.274+0000 7f455ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f45600cf610 0x7f45600cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.274+0000 7f455dd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f45600b1600 0x7f45600cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39226/0 (socket says 172.21.15.50:39226) 2024-09-11T22:22:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.274+0000 7f455dd9b640 1 -- 172.21.15.50:0/1180880854 learned_addr learned my addr 172.21.15.50:0/1180880854 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.274+0000 7f455ed9d640 1 --2- 172.21.15.50:0/1180880854 >> v2:172.21.15.50:3300/0 conn(0x7f45600cf610 0x7f45600cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47754/0 (socket says 172.21.15.50:47754) 2024-09-11T22:22:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.275+0000 7f455e59c640 1 --2- 172.21.15.50:0/1180880854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4560161fa0 0x7f45600b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.275+0000 7f455ed9d640 1 -- 172.21.15.50:0/1180880854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4560161fa0 msgr2=0x7f45600b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.275+0000 7f455ed9d640 1 --2- 172.21.15.50:0/1180880854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4560161fa0 0x7f45600b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.275+0000 7f455ed9d640 1 -- 172.21.15.50:0/1180880854 >> v1:172.21.15.50:6789/0 conn(0x7f45600b1600 legacy=0x7f45600cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.275+0000 7f455ed9d640 1 -- 172.21.15.50:0/1180880854 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45600cfeb0 con 0x7f45600cf610 2024-09-11T22:22:28.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.275+0000 7f455d59a640 1 -- 172.21.15.50:0/1180880854 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277915069 0 0) 0x7f45600cfbd0 con 0x7f45600b1600 2024-09-11T22:22:28.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.275+0000 7f455ed9d640 1 --2- 172.21.15.50:0/1180880854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45600cf610 0x7f45600cccd0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f4558009d90 tx=0x7f455802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4105cb0ec49a1a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.276+0000 7f455d59a640 1 -- 172.21.15.50:0/1180880854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558007740 con 0x7f45600cf610 2024-09-11T22:22:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.276+0000 7f455d59a640 1 -- 172.21.15.50:0/1180880854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45580078e0 con 0x7f45600cf610 2024-09-11T22:22:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.276+0000 7f455d59a640 1 -- 172.21.15.50:0/1180880854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558007cb0 con 0x7f45600cf610 2024-09-11T22:22:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.276+0000 7f4564df1640 1 -- 172.21.15.50:0/1180880854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45600cf610 msgr2=0x7f45600cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.276+0000 7f4564df1640 1 --2- 172.21.15.50:0/1180880854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45600cf610 0x7f45600cccd0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f4558009d90 tx=0x7f455802a660 comp rx=0 tx=0).stop 2024-09-11T22:22:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.276+0000 7f4564df1640 1 -- 172.21.15.50:0/1180880854 shutdown_connections 2024-09-11T22:22:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.276+0000 7f4564df1640 1 --2- 172.21.15.50:0/1180880854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45600cf610 0x7f45600cccd0 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.276+0000 7f4564df1640 1 --2- 172.21.15.50:0/1180880854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4560161fa0 0x7f45600b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.276+0000 7f4564df1640 1 -- 172.21.15.50:0/1180880854 >> 172.21.15.50:0/1180880854 conn(0x7f456009ba50 msgr2=0x7f45600b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.276+0000 7f4564df1640 1 -- 172.21.15.50:0/1180880854 shutdown_connections 2024-09-11T22:22:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.276+0000 7f4564df1640 1 -- 172.21.15.50:0/1180880854 wait complete. 2024-09-11T22:22:28.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.278+0000 7f4564df1640 1 Processor -- start 2024-09-11T22:22:28.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.278+0000 7f4564df1640 1 -- start start 2024-09-11T22:22:28.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.278+0000 7f4564df1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45600b1600 0x7f456014b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.278+0000 7f4564df1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45600cf610 0x7f45600707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.278+0000 7f4564df1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4560161fa0 0x7f4560070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.278+0000 7f4564df1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4560162500 con 0x7f45600cf610 2024-09-11T22:22:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.278+0000 7f4564df1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4560162380 con 0x7f4560161fa0 2024-09-11T22:22:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.278+0000 7f4564df1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f45600d1c70 con 0x7f45600b1600 2024-09-11T22:22:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.278+0000 7f455dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45600cf610 0x7f45600707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.278+0000 7f455dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45600cf610 0x7f45600707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47766/0 (socket says 172.21.15.50:47766) 2024-09-11T22:22:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.278+0000 7f455dd9b640 1 -- 172.21.15.50:0/3445772320 learned_addr learned my addr 172.21.15.50:0/3445772320 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.279+0000 7f455e59c640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45600b1600 0x7f456014b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.279+0000 7f455ed9d640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4560161fa0 0x7f4560070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.279+0000 7f455dd9b640 1 -- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45600b1600 msgr2=0x7f456014b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.279+0000 7f455dd9b640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45600b1600 0x7f456014b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.279+0000 7f455dd9b640 1 -- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4560161fa0 msgr2=0x7f4560070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.279+0000 7f455dd9b640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4560161fa0 0x7f4560070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.279+0000 7f455dd9b640 1 -- 172.21.15.50:0/3445772320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4560161010 con 0x7f45600cf610 2024-09-11T22:22:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.279+0000 7f455dd9b640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45600cf610 0x7f45600707f0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f455400c410 tx=0x7f455400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.279+0000 7f454effd640 1 -- 172.21.15.50:0/3445772320 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45540074e0 con 0x7f45600cf610 2024-09-11T22:22:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.279+0000 7f454effd640 1 -- 172.21.15.50:0/3445772320 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45540047e0 con 0x7f45600cf610 2024-09-11T22:22:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.279+0000 7f4564df1640 1 -- 172.21.15.50:0/3445772320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45600c97f0 con 0x7f45600cf610 2024-09-11T22:22:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.279+0000 7f454effd640 1 -- 172.21.15.50:0/3445772320 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554004bd0 con 0x7f45600cf610 2024-09-11T22:22:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.279+0000 7f4564df1640 1 -- 172.21.15.50:0/3445772320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45600c9db0 con 0x7f45600cf610 2024-09-11T22:22:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.280+0000 7f4564df1640 1 -- 172.21.15.50:0/3445772320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45600c9fb0 con 0x7f45600cf610 2024-09-11T22:22:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.281+0000 7f454effd640 1 -- 172.21.15.50:0/3445772320 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4554011070 con 0x7f45600cf610 2024-09-11T22:22:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.281+0000 7f454effd640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f454006be30 0x7f454006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.281+0000 7f454effd640 1 -- 172.21.15.50:0/3445772320 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 4943+0+0 (secure 0 0 0) 0x7f455408a5b0 con 0x7f45600cf610 2024-09-11T22:22:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.281+0000 7f455e59c640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f454006be30 0x7f454006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.282+0000 7f455e59c640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f454006be30 0x7f454006e2f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4550006fd0 tx=0x7f4550008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.285+0000 7f454effd640 1 -- 172.21.15.50:0/3445772320 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f45600c9fb0 con 0x7f45600cf610 2024-09-11T22:22:28.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.459+0000 7f4564df1640 1 -- 172.21.15.50:0/3445772320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f456006ca30 con 0x7f45600cf610 2024-09-11T22:22:28.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.460+0000 7f454effd640 1 -- 172.21.15.50:0/3445772320 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v170) ==== 93+0+10 (secure 0 0 0) 0x7f4554058ca0 con 0x7f45600cf610 2024-09-11T22:22:28.461 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-11T22:22:28.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.462+0000 7f4564df1640 1 -- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f454006be30 msgr2=0x7f454006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.462+0000 7f4564df1640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f454006be30 0x7f454006e2f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4550006fd0 tx=0x7f4550008040 comp rx=0 tx=0).stop 2024-09-11T22:22:28.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.462+0000 7f4564df1640 1 -- 172.21.15.50:0/3445772320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45600cf610 msgr2=0x7f45600707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.462+0000 7f4564df1640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45600cf610 0x7f45600707f0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f455400c410 tx=0x7f455400c8d0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.462+0000 7f4564df1640 1 -- 172.21.15.50:0/3445772320 shutdown_connections 2024-09-11T22:22:28.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.462+0000 7f4564df1640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f454006be30 0x7f454006e2f0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.462+0000 7f4564df1640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4560161fa0 0x7f4560070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.462+0000 7f4564df1640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45600cf610 0x7f45600707f0 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.462+0000 7f4564df1640 1 --2- 172.21.15.50:0/3445772320 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45600b1600 0x7f456014b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.462+0000 7f4564df1640 1 -- 172.21.15.50:0/3445772320 >> 172.21.15.50:0/3445772320 conn(0x7f456009ba50 msgr2=0x7f456006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.462+0000 7f4564df1640 1 -- 172.21.15.50:0/3445772320 shutdown_connections 2024-09-11T22:22:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.462+0000 7f4564df1640 1 -- 172.21.15.50:0/3445772320 wait complete. 2024-09-11T22:22:28.474 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-11T22:22:28.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.576+0000 7f375c159640 1 Processor -- start 2024-09-11T22:22:28.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.576+0000 7f375c159640 1 -- start start 2024-09-11T22:22:28.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375c159640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f375415c2c0 0x7f37540b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375c159640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37540b3e10 0x7f37540cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375c159640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37540d0410 0x7f375415fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375c159640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f37540d0840 con 0x7f37540d0410 2024-09-11T22:22:28.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375c159640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f37540b4f00 con 0x7f375415c2c0 2024-09-11T22:22:28.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375c159640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f37540b4360 con 0x7f37540b3e10 2024-09-11T22:22:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375a6f6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37540d0410 0x7f375415fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375a6f6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37540d0410 0x7f375415fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47770/0 (socket says 172.21.15.50:47770) 2024-09-11T22:22:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375a6f6640 1 -- 172.21.15.50:0/1353322484 learned_addr learned my addr 172.21.15.50:0/1353322484 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f3759ef5640 1 --2- 172.21.15.50:0/1353322484 >> v2:172.21.15.77:3300/0 conn(0x7f375415c2c0 0x7f37540b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f37596f4640 1 --2- 172.21.15.50:0/1353322484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37540b3e10 0x7f37540cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375a6f6640 1 -- 172.21.15.50:0/1353322484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37540b3e10 msgr2=0x7f37540cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375a6f6640 1 --2- 172.21.15.50:0/1353322484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37540b3e10 0x7f37540cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375a6f6640 1 -- 172.21.15.50:0/1353322484 >> v2:172.21.15.77:3300/0 conn(0x7f375415c2c0 msgr2=0x7f37540b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375a6f6640 1 --2- 172.21.15.50:0/1353322484 >> v2:172.21.15.77:3300/0 conn(0x7f375415c2c0 0x7f37540b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.577+0000 7f375a6f6640 1 -- 172.21.15.50:0/1353322484 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37540b51c0 con 0x7f37540d0410 2024-09-11T22:22:28.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.578+0000 7f375a6f6640 1 --2- 172.21.15.50:0/1353322484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37540d0410 0x7f375415fff0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f375406cdb0 tx=0x7f374c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaa496e18ce8b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.578+0000 7f3758ef3640 1 -- 172.21.15.50:0/1353322484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c036070 con 0x7f37540d0410 2024-09-11T22:22:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.578+0000 7f3758ef3640 1 -- 172.21.15.50:0/1353322484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f374c031600 con 0x7f37540d0410 2024-09-11T22:22:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.578+0000 7f3758ef3640 1 -- 172.21.15.50:0/1353322484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c0319d0 con 0x7f37540d0410 2024-09-11T22:22:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.579+0000 7f375c159640 1 -- 172.21.15.50:0/1353322484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37540d0410 msgr2=0x7f375415fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.579+0000 7f375c159640 1 --2- 172.21.15.50:0/1353322484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37540d0410 0x7f375415fff0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f375406cdb0 tx=0x7f374c02a610 comp rx=0 tx=0).stop 2024-09-11T22:22:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.579+0000 7f375c159640 1 -- 172.21.15.50:0/1353322484 shutdown_connections 2024-09-11T22:22:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.579+0000 7f375c159640 1 --2- 172.21.15.50:0/1353322484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37540d0410 0x7f375415fff0 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.579+0000 7f375c159640 1 --2- 172.21.15.50:0/1353322484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37540b3e10 0x7f37540cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.579+0000 7f375c159640 1 --2- 172.21.15.50:0/1353322484 >> v2:172.21.15.77:3300/0 conn(0x7f375415c2c0 0x7f37540b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.579+0000 7f375c159640 1 -- 172.21.15.50:0/1353322484 >> 172.21.15.50:0/1353322484 conn(0x7f37540679c0 msgr2=0x7f3754067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.579+0000 7f375c159640 1 -- 172.21.15.50:0/1353322484 shutdown_connections 2024-09-11T22:22:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.579+0000 7f375c159640 1 -- 172.21.15.50:0/1353322484 wait complete. 2024-09-11T22:22:28.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.580+0000 7f375c159640 1 Processor -- start 2024-09-11T22:22:28.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.580+0000 7f375c159640 1 -- start start 2024-09-11T22:22:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f375c159640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37540b3e10 0x7f37540b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f375c159640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37540d0410 0x7f375414ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f375c159640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f375415c2c0 0x7f375414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f375c159640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f37540ce200 con 0x7f37540b3e10 2024-09-11T22:22:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f375c159640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f37540cfc10 con 0x7f37540d0410 2024-09-11T22:22:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f375c159640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f375406d070 con 0x7f375415c2c0 2024-09-11T22:22:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f3759ef5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37540b3e10 0x7f37540b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f3759ef5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37540b3e10 0x7f37540b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47784/0 (socket says 172.21.15.50:47784) 2024-09-11T22:22:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f3759ef5640 1 -- 172.21.15.50:0/434823558 learned_addr learned my addr 172.21.15.50:0/434823558 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f375a6f6640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f375415c2c0 0x7f375414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f37596f4640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37540d0410 0x7f375414ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f3759ef5640 1 -- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f375415c2c0 msgr2=0x7f375414fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f3759ef5640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f375415c2c0 0x7f375414fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f3759ef5640 1 -- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37540d0410 msgr2=0x7f375414ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f3759ef5640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37540d0410 0x7f375414ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f3759ef5640 1 -- 172.21.15.50:0/434823558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37540b0cb0 con 0x7f37540b3e10 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f37596f4640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37540d0410 0x7f375414ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f375a6f6640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f375415c2c0 0x7f375414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f3759ef5640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37540b3e10 0x7f37540b0560 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f375000c820 tx=0x7f375000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f374a7fc640 1 -- 172.21.15.50:0/434823558 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750015070 con 0x7f37540b3e10 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f374a7fc640 1 -- 172.21.15.50:0/434823558 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3750004240 con 0x7f37540b3e10 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f375c159640 1 -- 172.21.15.50:0/434823558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37540b0f90 con 0x7f37540b3e10 2024-09-11T22:22:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f374a7fc640 1 -- 172.21.15.50:0/434823558 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375000ce10 con 0x7f37540b3e10 2024-09-11T22:22:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.581+0000 7f375c159640 1 -- 172.21.15.50:0/434823558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37540b1550 con 0x7f37540b3e10 2024-09-11T22:22:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.582+0000 7f375c159640 1 -- 172.21.15.50:0/434823558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f375415c6a0 con 0x7f37540b3e10 2024-09-11T22:22:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.583+0000 7f374a7fc640 1 -- 172.21.15.50:0/434823558 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3750007830 con 0x7f37540b3e10 2024-09-11T22:22:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.583+0000 7f374a7fc640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f373806be30 0x7f373806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.583+0000 7f374a7fc640 1 -- 172.21.15.50:0/434823558 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 4943+0+0 (secure 0 0 0) 0x7f375008a960 con 0x7f37540b3e10 2024-09-11T22:22:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.584+0000 7f37596f4640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f373806be30 0x7f373806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.584+0000 7f37596f4640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f373806be30 0x7f373806e2f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3744006fd0 tx=0x7f3744008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:28.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.588+0000 7f374a7fc640 1 -- 172.21.15.50:0/434823558 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37500596a0 con 0x7f37540b3e10 2024-09-11T22:22:28.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.829+0000 7f375c159640 1 -- 172.21.15.50:0/434823558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f37540b4640 con 0x7f37540b3e10 2024-09-11T22:22:28.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.838+0000 7f374a7fc640 1 -- 172.21.15.50:0/434823558 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v543) ==== 143+0+0 (secure 0 0 0) 0x7f3750058fa0 con 0x7f37540b3e10 2024-09-11T22:22:28.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.840+0000 7f375c159640 1 -- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f373806be30 msgr2=0x7f373806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.840+0000 7f375c159640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f373806be30 0x7f373806e2f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3744006fd0 tx=0x7f3744008040 comp rx=0 tx=0).stop 2024-09-11T22:22:28.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.840+0000 7f375c159640 1 -- 172.21.15.50:0/434823558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37540b3e10 msgr2=0x7f37540b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.840+0000 7f375c159640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37540b3e10 0x7f37540b0560 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f375000c820 tx=0x7f375000cce0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.840+0000 7f375c159640 1 -- 172.21.15.50:0/434823558 shutdown_connections 2024-09-11T22:22:28.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.840+0000 7f375c159640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f373806be30 0x7f373806e2f0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.840+0000 7f375c159640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f375415c2c0 0x7f375414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.840+0000 7f375c159640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37540d0410 0x7f375414ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.840+0000 7f375c159640 1 --2- 172.21.15.50:0/434823558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37540b3e10 0x7f37540b0560 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.840+0000 7f375c159640 1 -- 172.21.15.50:0/434823558 >> 172.21.15.50:0/434823558 conn(0x7f37540679c0 msgr2=0x7f375415ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:28.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.840+0000 7f375c159640 1 -- 172.21.15.50:0/434823558 shutdown_connections 2024-09-11T22:22:28.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.840+0000 7f375c159640 1 -- 172.21.15.50:0/434823558 wait complete. 2024-09-11T22:22:28.851 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T22:22:28.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.956+0000 7f1f886d7640 1 Processor -- start 2024-09-11T22:22:28.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.956+0000 7f1f886d7640 1 -- start start 2024-09-11T22:22:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.957+0000 7f1f886d7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1f800d18a0 0x7f1f800d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.957+0000 7f1f886d7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f800d3a30 0x7f1f800b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.957+0000 7f1f886d7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f800cfa80 con 0x7f1f8015e870 2024-09-11T22:22:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.957+0000 7f1f886d7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1f800d3ea0 con 0x7f1f800d18a0 2024-09-11T22:22:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.957+0000 7f1f886d7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1f800d40d0 con 0x7f1f800d3a30 2024-09-11T22:22:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.957+0000 7f1f85c72640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1f800d18a0 0x7f1f800d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.957+0000 7f1f85c72640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1f800d18a0 0x7f1f800d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47796/0 (socket says 172.21.15.50:47796) 2024-09-11T22:22:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.958+0000 7f1f85c72640 1 -- 172.21.15.50:0/1837902960 learned_addr learned my addr 172.21.15.50:0/1837902960 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.958+0000 7f1f86c74640 1 --2- 172.21.15.50:0/1837902960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f800d3a30 0x7f1f800b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.958+0000 7f1f85c72640 1 -- 172.21.15.50:0/1837902960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f800d3a30 msgr2=0x7f1f800b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.958+0000 7f1f85c72640 1 --2- 172.21.15.50:0/1837902960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f800d3a30 0x7f1f800b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.958+0000 7f1f85c72640 1 -- 172.21.15.50:0/1837902960 >> v1:172.21.15.77:6789/0 conn(0x7f1f8015e870 legacy=0x7f1f800d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.958+0000 7f1f85c72640 1 -- 172.21.15.50:0/1837902960 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f800d43b0 con 0x7f1f800d18a0 2024-09-11T22:22:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.959+0000 7f1f85c72640 1 --2- 172.21.15.50:0/1837902960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f800d18a0 0x7f1f800d34f0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009870 tx=0x7f1f7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170624da4ca2cfee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.959+0000 7f1f85471640 1 -- 172.21.15.50:0/1837902960 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f74037070 con 0x7f1f800d18a0 2024-09-11T22:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.959+0000 7f1f85471640 1 -- 172.21.15.50:0/1837902960 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f74032440 con 0x7f1f800d18a0 2024-09-11T22:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.959+0000 7f1f85471640 1 -- 172.21.15.50:0/1837902960 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f74032810 con 0x7f1f800d18a0 2024-09-11T22:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.959+0000 7f1f886d7640 1 -- 172.21.15.50:0/1837902960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f800d18a0 msgr2=0x7f1f800d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.959+0000 7f1f886d7640 1 --2- 172.21.15.50:0/1837902960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f800d18a0 0x7f1f800d34f0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009870 tx=0x7f1f7402a270 comp rx=0 tx=0).stop 2024-09-11T22:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.959+0000 7f1f886d7640 1 -- 172.21.15.50:0/1837902960 shutdown_connections 2024-09-11T22:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.959+0000 7f1f886d7640 1 --2- 172.21.15.50:0/1837902960 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f800d3a30 0x7f1f800b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.959+0000 7f1f886d7640 1 --2- 172.21.15.50:0/1837902960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f800d18a0 0x7f1f800d34f0 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.959+0000 7f1f886d7640 1 -- 172.21.15.50:0/1837902960 >> 172.21.15.50:0/1837902960 conn(0x7f1f800727a0 msgr2=0x7f1f800679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.959+0000 7f1f886d7640 1 -- 172.21.15.50:0/1837902960 shutdown_connections 2024-09-11T22:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.959+0000 7f1f886d7640 1 -- 172.21.15.50:0/1837902960 wait complete. 2024-09-11T22:22:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.961+0000 7f1f886d7640 1 Processor -- start 2024-09-11T22:22:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.961+0000 7f1f886d7640 1 -- start start 2024-09-11T22:22:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.961+0000 7f1f886d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f800d18a0 0x7f1f800cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.961+0000 7f1f886d7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f800d3a30 0x7f1f800cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.961+0000 7f1f886d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f8015e870 0x7f1f800b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.961+0000 7f1f886d7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8015ec50 con 0x7f1f8015e870 2024-09-11T22:22:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.961+0000 7f1f886d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1f800b7ee0 con 0x7f1f800d18a0 2024-09-11T22:22:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.961+0000 7f1f886d7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1f800b78b0 con 0x7f1f800d3a30 2024-09-11T22:22:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.961+0000 7f1f86c74640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f8015e870 0x7f1f800b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.961+0000 7f1f86c74640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f8015e870 0x7f1f800b8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47812/0 (socket says 172.21.15.50:47812) 2024-09-11T22:22:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.961+0000 7f1f86c74640 1 -- 172.21.15.50:0/4219307183 learned_addr learned my addr 172.21.15.50:0/4219307183 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f85c72640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f800d3a30 0x7f1f800cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f86473640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f800d18a0 0x7f1f800cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f86c74640 1 -- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f800d3a30 msgr2=0x7f1f800cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f86c74640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f800d3a30 0x7f1f800cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f86c74640 1 -- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f800d18a0 msgr2=0x7f1f800cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f86c74640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f800d18a0 0x7f1f800cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f86c74640 1 -- 172.21.15.50:0/4219307183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f801f56d0 con 0x7f1f8015e870 2024-09-11T22:22:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f85c72640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f800d3a30 0x7f1f800cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:28.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f86c74640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f8015e870 0x7f1f800b8ba0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800e930 tx=0x7f1f7800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:28.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f7effd640 1 -- 172.21.15.50:0/4219307183 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f78017070 con 0x7f1f8015e870 2024-09-11T22:22:28.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f7effd640 1 -- 172.21.15.50:0/4219307183 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7800c980 con 0x7f1f8015e870 2024-09-11T22:22:28.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f886d7640 1 -- 172.21.15.50:0/4219307183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f800ca770 con 0x7f1f8015e870 2024-09-11T22:22:28.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f7effd640 1 -- 172.21.15.50:0/4219307183 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800cd70 con 0x7f1f8015e870 2024-09-11T22:22:28.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.962+0000 7f1f886d7640 1 -- 172.21.15.50:0/4219307183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f800cad30 con 0x7f1f8015e870 2024-09-11T22:22:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.963+0000 7f1f886d7640 1 -- 172.21.15.50:0/4219307183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f800ca560 con 0x7f1f8015e870 2024-09-11T22:22:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.964+0000 7f1f7effd640 1 -- 172.21.15.50:0/4219307183 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f7801a070 con 0x7f1f8015e870 2024-09-11T22:22:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.964+0000 7f1f7effd640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1f6c06be60 0x7f1f6c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.964+0000 7f1f7effd640 1 -- 172.21.15.50:0/4219307183 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 4943+0+0 (secure 0 0 0) 0x7f1f7808ae40 con 0x7f1f8015e870 2024-09-11T22:22:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.964+0000 7f1f86473640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1f6c06be60 0x7f1f6c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.965+0000 7f1f86473640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1f6c06be60 0x7f1f6c06e320 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1f700012e0 tx=0x7f1f70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:28.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:28.968+0000 7f1f7effd640 1 -- 172.21.15.50:0/4219307183 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f78059560 con 0x7f1f8015e870 2024-09-11T22:22:29.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.143+0000 7f1f886d7640 1 -- 172.21.15.50:0/4219307183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1f800d34f0 con 0x7f1f8015e870 2024-09-11T22:22:29.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.146+0000 7f1f7effd640 1 -- 172.21.15.50:0/4219307183 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7f1f7805d860 con 0x7f1f8015e870 2024-09-11T22:22:29.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.148+0000 7f1f886d7640 1 -- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1f6c06be60 msgr2=0x7f1f6c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:29.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.148+0000 7f1f886d7640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1f6c06be60 0x7f1f6c06e320 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1f700012e0 tx=0x7f1f70009040 comp rx=0 tx=0).stop 2024-09-11T22:22:29.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.148+0000 7f1f886d7640 1 -- 172.21.15.50:0/4219307183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f8015e870 msgr2=0x7f1f800b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:29.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.148+0000 7f1f886d7640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f8015e870 0x7f1f800b8ba0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800e930 tx=0x7f1f7800edf0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.148+0000 7f1f886d7640 1 -- 172.21.15.50:0/4219307183 shutdown_connections 2024-09-11T22:22:29.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.148+0000 7f1f886d7640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1f6c06be60 0x7f1f6c06e320 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.148+0000 7f1f886d7640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f800d3a30 0x7f1f800cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.148+0000 7f1f886d7640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f8015e870 0x7f1f800b8ba0 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.148+0000 7f1f886d7640 1 --2- 172.21.15.50:0/4219307183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f800d18a0 0x7f1f800cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.148+0000 7f1f886d7640 1 -- 172.21.15.50:0/4219307183 >> 172.21.15.50:0/4219307183 conn(0x7f1f800727a0 msgr2=0x7f1f80157b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.148+0000 7f1f886d7640 1 -- 172.21.15.50:0/4219307183 shutdown_connections 2024-09-11T22:22:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.148+0000 7f1f886d7640 1 -- 172.21.15.50:0/4219307183 wait complete. 2024-09-11T22:22:29.160 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:22:29.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:22:29.205 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:22:29.247 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:22:29.247 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:22:29.247 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:22:29.263 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:22:29.263 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:22:29.264 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:22:29.305 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:22:29.305 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:22:29.306 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:22:29.322 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:22:29.322 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:22:29.322 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:22:29.363 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:22:29.363 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T22:22:29.363 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:22:29.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.465+0000 7fda01e27640 1 Processor -- start 2024-09-11T22:22:29.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.465+0000 7fda01e27640 1 -- start start 2024-09-11T22:22:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.466+0000 7fda01e27640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9fc0d1c90 0x7fd9fc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.466+0000 7fda01e27640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd9fc162350 0x7fd9fc1627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.466+0000 7fda01e27640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9fc163080 con 0x7fd9fc15e8e0 2024-09-11T22:22:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.466+0000 7fda01e27640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd9fc15ecc0 con 0x7fd9fc162350 2024-09-11T22:22:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.466+0000 7fda01e27640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd9fc0d2ad0 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.466+0000 7fd9fbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd9fc162350 0x7fd9fc1627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.466+0000 7fd9fbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd9fc162350 0x7fd9fc1627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47820/0 (socket says 172.21.15.50:47820) 2024-09-11T22:22:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.466+0000 7fd9fbfff640 1 -- 172.21.15.50:0/65050133 learned_addr learned my addr 172.21.15.50:0/65050133 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.466+0000 7fd9faffd640 1 --2- 172.21.15.50:0/65050133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9fc0d1c90 0x7fd9fc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.466+0000 7fd9fbfff640 1 -- 172.21.15.50:0/65050133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9fc0d1c90 msgr2=0x7fd9fc0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:29.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.466+0000 7fd9fbfff640 1 --2- 172.21.15.50:0/65050133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9fc0d1c90 0x7fd9fc0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.466+0000 7fd9fbfff640 1 -- 172.21.15.50:0/65050133 >> v1:172.21.15.77:6789/0 conn(0x7fd9fc15e8e0 legacy=0x7fd9fc0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:29.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.466+0000 7fd9fbfff640 1 -- 172.21.15.50:0/65050133 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc0d2d20 con 0x7fd9fc162350 2024-09-11T22:22:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.467+0000 7fd9fbfff640 1 --2- 172.21.15.50:0/65050133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9fc162350 0x7fd9fc1627e0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009e50 tx=0x7fd9f402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51dd893a077e2b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.467+0000 7fd9fa7fc640 1 -- 172.21.15.50:0/65050133 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4036070 con 0x7fd9fc162350 2024-09-11T22:22:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.467+0000 7fd9fa7fc640 1 -- 172.21.15.50:0/65050133 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f4031600 con 0x7fd9fc162350 2024-09-11T22:22:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.467+0000 7fd9fa7fc640 1 -- 172.21.15.50:0/65050133 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f40319d0 con 0x7fd9fc162350 2024-09-11T22:22:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.468+0000 7fda01e27640 1 -- 172.21.15.50:0/65050133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9fc162350 msgr2=0x7fd9fc1627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.468+0000 7fda01e27640 1 --2- 172.21.15.50:0/65050133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9fc162350 0x7fd9fc1627e0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009e50 tx=0x7fd9f402a7a0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.468+0000 7fda01e27640 1 -- 172.21.15.50:0/65050133 shutdown_connections 2024-09-11T22:22:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.468+0000 7fda01e27640 1 --2- 172.21.15.50:0/65050133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9fc162350 0x7fd9fc1627e0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.468+0000 7fda01e27640 1 --2- 172.21.15.50:0/65050133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9fc0d1c90 0x7fd9fc0b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.468+0000 7fda01e27640 1 -- 172.21.15.50:0/65050133 >> 172.21.15.50:0/65050133 conn(0x7fd9fc067ba0 msgr2=0x7fd9fc067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.468+0000 7fda01e27640 1 -- 172.21.15.50:0/65050133 shutdown_connections 2024-09-11T22:22:29.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.468+0000 7fda01e27640 1 -- 172.21.15.50:0/65050133 wait complete. 2024-09-11T22:22:29.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.469+0000 7fda01e27640 1 Processor -- start 2024-09-11T22:22:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.469+0000 7fda01e27640 1 -- start start 2024-09-11T22:22:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fda01e27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9fc0d1c90 0x7fd9fc0b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fda01e27640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9fc15e8e0 0x7fd9fc0ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fda01e27640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9fc162350 0x7fd9fc153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fda01e27640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc162d20 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fda01e27640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc0d3370 con 0x7fd9fc15e8e0 2024-09-11T22:22:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fda01e27640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd9fc0d3800 con 0x7fd9fc162350 2024-09-11T22:22:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9fb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9fc0d1c90 0x7fd9fc0b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9fb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9fc0d1c90 0x7fd9fc0b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47828/0 (socket says 172.21.15.50:47828) 2024-09-11T22:22:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9fb7fe640 1 -- 172.21.15.50:0/270196948 learned_addr learned my addr 172.21.15.50:0/270196948 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9faffd640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9fc15e8e0 0x7fd9fc0ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:29.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9fbfff640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9fc162350 0x7fd9fc153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9fb7fe640 1 -- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9fc162350 msgr2=0x7fd9fc153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9fb7fe640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9fc162350 0x7fd9fc153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9fb7fe640 1 -- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9fc15e8e0 msgr2=0x7fd9fc0ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9fb7fe640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9fc15e8e0 0x7fd9fc0ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9fb7fe640 1 -- 172.21.15.50:0/270196948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc0cd450 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9fb7fe640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9fc0d1c90 0x7fd9fc0b5a80 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00c430 tx=0x7fd9ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9e3fff640 1 -- 172.21.15.50:0/270196948 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec0052d0 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9e3fff640 1 -- 172.21.15.50:0/270196948 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9ec005490 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fda01e27640 1 -- 172.21.15.50:0/270196948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9fc0cd730 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.470+0000 7fd9e3fff640 1 -- 172.21.15.50:0/270196948 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec007260 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.471+0000 7fda01e27640 1 -- 172.21.15.50:0/270196948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9fc0cdcf0 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.471+0000 7fda01e27640 1 -- 172.21.15.50:0/270196948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9fc0b7880 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.472+0000 7fd9e3fff640 1 -- 172.21.15.50:0/270196948 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9ec007400 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.472+0000 7fd9e3fff640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd9e806be30 0x7fd9e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:29.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.472+0000 7fd9e3fff640 1 -- 172.21.15.50:0/270196948 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 4943+0+0 (secure 0 0 0) 0x7fd9ec08a070 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.473+0000 7fd9faffd640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd9e806be30 0x7fd9e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:29.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.473+0000 7fd9faffd640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd9e806be30 0x7fd9e806e2f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc15cba0 tx=0x7fd9f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:29.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.477+0000 7fd9e3fff640 1 -- 172.21.15.50:0/270196948 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd9ec058630 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.688+0000 7fda01e27640 1 -- 172.21.15.50:0/270196948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9fc068f60 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.689+0000 7fd9e3fff640 1 -- 172.21.15.50:0/270196948 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+3907 (secure 0 0 0) 0x7fd9ec05c930 con 0x7fd9fc0d1c90 2024-09-11T22:22:29.690 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:29.690 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":125,"btime":"2024-09-11T22:22:23:823026+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4026099123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4026099123},{"type":"v1","addr":"172.21.15.50:6835","nonce":4026099123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":125},{"gid":8108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/91406696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":91406696},{"type":"v1","addr":"172.21.15.77:6837","nonce":91406696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":125},{"gid":8890,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/521086958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":521086958},{"type":"v1","addr":"172.21.15.77:6835","nonce":521086958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9891,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2783375669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2783375669},{"type":"v1","addr":"172.21.15.50:6833","nonce":2783375669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[]} 2024-09-11T22:22:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 125 2024-09-11T22:22:29.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.691+0000 7fda01e27640 1 -- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd9e806be30 msgr2=0x7fd9e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:29.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.691+0000 7fda01e27640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd9e806be30 0x7fd9e806e2f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc15cba0 tx=0x7fd9f0008040 comp rx=0 tx=0).stop 2024-09-11T22:22:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.691+0000 7fda01e27640 1 -- 172.21.15.50:0/270196948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9fc0d1c90 msgr2=0x7fd9fc0b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.691+0000 7fda01e27640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9fc0d1c90 0x7fd9fc0b5a80 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00c430 tx=0x7fd9ec00c8f0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.691+0000 7fda01e27640 1 -- 172.21.15.50:0/270196948 shutdown_connections 2024-09-11T22:22:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.691+0000 7fda01e27640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd9e806be30 0x7fd9e806e2f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.691+0000 7fda01e27640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9fc162350 0x7fd9fc153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.691+0000 7fda01e27640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9fc15e8e0 0x7fd9fc0ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.691+0000 7fda01e27640 1 --2- 172.21.15.50:0/270196948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9fc0d1c90 0x7fd9fc0b5a80 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.691+0000 7fda01e27640 1 -- 172.21.15.50:0/270196948 >> 172.21.15.50:0/270196948 conn(0x7fd9fc067ba0 msgr2=0x7fd9fc067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.691+0000 7fda01e27640 1 -- 172.21.15.50:0/270196948 shutdown_connections 2024-09-11T22:22:29.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.691+0000 7fda01e27640 1 -- 172.21.15.50:0/270196948 wait complete. 2024-09-11T22:22:29.704 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:22:29.704 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T22:22:29.704 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:22:29.704 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:22:29.704 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:22:29.704 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T22:22:29.704 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:22:29.705 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:22:29.705 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:22:29.705 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T22:22:29.705 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:22:29.705 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:22:29.705 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:22:29.705 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T22:22:29.707 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:22:29.707 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:22:29.713 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:22:29.713 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:22:29.714 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:22:29.714 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:22:29.717 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:22:29.718 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:22:29.719 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:22:29.720 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:22:29.756 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:22:29.756 DEBUG:teuthology.parallel:result is None 2024-09-11T22:22:29.757 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:22:29.757 DEBUG:teuthology.parallel:result is None 2024-09-11T22:22:29.761 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:22:29.761 DEBUG:teuthology.parallel:result is None 2024-09-11T22:22:29.762 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:22:29.763 DEBUG:teuthology.parallel:result is None 2024-09-11T22:22:29.763 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T22:22:29.833 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:22:29.835 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:22:29.853 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:22:29.853 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:22:29.854 INFO:tasks.ceph.mds.b.smithi077.stderr:2024-09-11T22:22:29.853+0000 7f117de57640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-11T22:22:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.873+0000 7fa1cb5cf640 1 Processor -- start 2024-09-11T22:22:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.873+0000 7fa1cb5cf640 1 -- start start 2024-09-11T22:22:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.874+0000 7fa1cb5cf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1c415e870 0x7fa1c40d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.874+0000 7fa1cb5cf640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1c40d16d0 0x7fa1c40d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.874+0000 7fa1cb5cf640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1c40cfa80 con 0x7fa1c40d3a30 2024-09-11T22:22:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.874+0000 7fa1cb5cf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa1c40d1b40 con 0x7fa1c415e870 2024-09-11T22:22:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.874+0000 7fa1cb5cf640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa1c40d3e50 con 0x7fa1c40d16d0 2024-09-11T22:22:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.874+0000 7fa1c936b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1c415e870 0x7fa1c40d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.874+0000 7fa1c936b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1c415e870 0x7fa1c40d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47852/0 (socket says 172.21.15.50:47852) 2024-09-11T22:22:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.874+0000 7fa1c936b640 1 -- 172.21.15.50:0/4237865674 learned_addr learned my addr 172.21.15.50:0/4237865674 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.874+0000 7fa1c8b6a640 1 --2- 172.21.15.50:0/4237865674 >> v2:172.21.15.77:3300/0 conn(0x7fa1c40d16d0 0x7fa1c40d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.874+0000 7fa1c936b640 1 -- 172.21.15.50:0/4237865674 >> v2:172.21.15.77:3300/0 conn(0x7fa1c40d16d0 msgr2=0x7fa1c40d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.875+0000 7fa1c936b640 1 --2- 172.21.15.50:0/4237865674 >> v2:172.21.15.77:3300/0 conn(0x7fa1c40d16d0 0x7fa1c40d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.875+0000 7fa1c936b640 1 -- 172.21.15.50:0/4237865674 >> v1:172.21.15.77:6789/0 conn(0x7fa1c40d3a30 legacy=0x7fa1c40b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.875+0000 7fa1c936b640 1 -- 172.21.15.50:0/4237865674 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c40d40d0 con 0x7fa1c415e870 2024-09-11T22:22:29.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.875+0000 7fa1c936b640 1 --2- 172.21.15.50:0/4237865674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c415e870 0x7fa1c40d1190 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fa1c406c830 tx=0x7fa1c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6ae21b7e9ccf98 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:29.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.875+0000 7fa1bbfff640 1 -- 172.21.15.50:0/4237865674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0037070 con 0x7fa1c415e870 2024-09-11T22:22:29.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.876+0000 7fa1bbfff640 1 -- 172.21.15.50:0/4237865674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c0032440 con 0x7fa1c415e870 2024-09-11T22:22:29.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.876+0000 7fa1bbfff640 1 -- 172.21.15.50:0/4237865674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0032810 con 0x7fa1c415e870 2024-09-11T22:22:29.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.876+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/4237865674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c415e870 msgr2=0x7fa1c40d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:29.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.876+0000 7fa1cb5cf640 1 --2- 172.21.15.50:0/4237865674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c415e870 0x7fa1c40d1190 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fa1c406c830 tx=0x7fa1c002a270 comp rx=0 tx=0).stop 2024-09-11T22:22:29.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.876+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/4237865674 shutdown_connections 2024-09-11T22:22:29.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.876+0000 7fa1cb5cf640 1 --2- 172.21.15.50:0/4237865674 >> v2:172.21.15.77:3300/0 conn(0x7fa1c40d16d0 0x7fa1c40d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.876+0000 7fa1cb5cf640 1 --2- 172.21.15.50:0/4237865674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c415e870 0x7fa1c40d1190 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.876+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/4237865674 >> 172.21.15.50:0/4237865674 conn(0x7fa1c40727a0 msgr2=0x7fa1c40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:29.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.876+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/4237865674 shutdown_connections 2024-09-11T22:22:29.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.876+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/4237865674 wait complete. 2024-09-11T22:22:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.877+0000 7fa1cb5cf640 1 Processor -- start 2024-09-11T22:22:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.877+0000 7fa1cb5cf640 1 -- start start 2024-09-11T22:22:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.878+0000 7fa1cb5cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c40d16d0 0x7fa1c4157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.878+0000 7fa1cb5cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1c40d3a30 0x7fa1c40ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.878+0000 7fa1cb5cf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1c415e870 0x7fa1c4159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.878+0000 7fa1cb5cf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c40b7ee0 con 0x7fa1c40d16d0 2024-09-11T22:22:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.878+0000 7fa1cb5cf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c40b7c00 con 0x7fa1c40d3a30 2024-09-11T22:22:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.878+0000 7fa1cb5cf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c415ec50 con 0x7fa1c415e870 2024-09-11T22:22:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.878+0000 7fa1c936b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c40d16d0 0x7fa1c4157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.878+0000 7fa1c936b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c40d16d0 0x7fa1c4157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47864/0 (socket says 172.21.15.50:47864) 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.878+0000 7fa1c936b640 1 -- 172.21.15.50:0/2146668386 learned_addr learned my addr 172.21.15.50:0/2146668386 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.878+0000 7fa1c9b6c640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1c415e870 0x7fa1c4159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.878+0000 7fa1c8b6a640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1c40d3a30 0x7fa1c40ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.879+0000 7fa1c936b640 1 -- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1c415e870 msgr2=0x7fa1c4159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.879+0000 7fa1c936b640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1c415e870 0x7fa1c4159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.879+0000 7fa1c936b640 1 -- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1c40d3a30 msgr2=0x7fa1c40ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.879+0000 7fa1c936b640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1c40d3a30 0x7fa1c40ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.879+0000 7fa1c936b640 1 -- 172.21.15.50:0/2146668386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c40cb8f0 con 0x7fa1c40d16d0 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.879+0000 7fa1c936b640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c40d16d0 0x7fa1c4157c50 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fa1c002a2b0 tx=0x7fa1c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.879+0000 7fa1b9ffb640 1 -- 172.21.15.50:0/2146668386 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0041020 con 0x7fa1c40d16d0 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.879+0000 7fa1b9ffb640 1 -- 172.21.15.50:0/2146668386 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c00306c0 con 0x7fa1c40d16d0 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.879+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/2146668386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c40cbbd0 con 0x7fa1c40d16d0 2024-09-11T22:22:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.879+0000 7fa1b9ffb640 1 -- 172.21.15.50:0/2146668386 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0037040 con 0x7fa1c40d16d0 2024-09-11T22:22:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.879+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/2146668386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c40cc190 con 0x7fa1c40d16d0 2024-09-11T22:22:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.880+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/2146668386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c40b78b0 con 0x7fa1c40d16d0 2024-09-11T22:22:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.881+0000 7fa1b9ffb640 1 -- 172.21.15.50:0/2146668386 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1c0044020 con 0x7fa1c40d16d0 2024-09-11T22:22:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.881+0000 7fa1b9ffb640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa1a806be30 0x7fa1a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:29.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.882+0000 7fa1b9ffb640 1 -- 172.21.15.50:0/2146668386 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 4943+0+0 (secure 0 0 0) 0x7fa1c00ab310 con 0x7fa1c40d16d0 2024-09-11T22:22:29.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.882+0000 7fa1c8b6a640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa1a806be30 0x7fa1a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:29.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.882+0000 7fa1c8b6a640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa1a806be30 0x7fa1a806e2f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4006fd0 tx=0x7fa1b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:29.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:29.886+0000 7fa1b9ffb640 1 -- 172.21.15.50:0/2146668386 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1c004b030 con 0x7fa1c40d16d0 2024-09-11T22:22:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.075+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/2146668386 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa1c40b9720 con 0x7fa1c40d16d0 2024-09-11T22:22:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.160+0000 7fa1b9ffb640 1 -- 172.21.15.50:0/2146668386 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v174) ==== 97+0+0 (secure 0 0 0) 0x7fa1c00798d0 con 0x7fa1c40d16d0 2024-09-11T22:22:30.161 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-11T22:22:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.163+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa1a806be30 msgr2=0x7fa1a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.163+0000 7fa1cb5cf640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa1a806be30 0x7fa1a806e2f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4006fd0 tx=0x7fa1b4008040 comp rx=0 tx=0).stop 2024-09-11T22:22:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.163+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/2146668386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c40d16d0 msgr2=0x7fa1c4157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.163+0000 7fa1cb5cf640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c40d16d0 0x7fa1c4157c50 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fa1c002a2b0 tx=0x7fa1c00046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.163+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/2146668386 shutdown_connections 2024-09-11T22:22:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.163+0000 7fa1cb5cf640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa1a806be30 0x7fa1a806e2f0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.163+0000 7fa1cb5cf640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1c415e870 0x7fa1c4159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.163+0000 7fa1cb5cf640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1c40d3a30 0x7fa1c40ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.163+0000 7fa1cb5cf640 1 --2- 172.21.15.50:0/2146668386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1c40d16d0 0x7fa1c4157c50 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.163+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/2146668386 >> 172.21.15.50:0/2146668386 conn(0x7fa1c40727a0 msgr2=0x7fa1c40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.163+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/2146668386 shutdown_connections 2024-09-11T22:22:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.163+0000 7fa1cb5cf640 1 -- 172.21.15.50:0/2146668386 wait complete. 2024-09-11T22:22:30.175 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T22:22:30.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.276+0000 7fa11e853640 1 Processor -- start 2024-09-11T22:22:30.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.276+0000 7fa11e853640 1 -- start start 2024-09-11T22:22:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.277+0000 7fa11e853640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa11815e8e0 0x7fa1180b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.277+0000 7fa11e853640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa118162350 0x7fa1181627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.277+0000 7fa11e853640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa118163080 con 0x7fa1180d1580 2024-09-11T22:22:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.277+0000 7fa11e853640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fa11815ecc0 con 0x7fa118162350 2024-09-11T22:22:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.277+0000 7fa11e853640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa1180d2ad0 con 0x7fa11815e8e0 2024-09-11T22:22:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.277+0000 7fa11cdf0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa118162350 0x7fa1181627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.278+0000 7fa11cdf0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa118162350 0x7fa1181627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47874/0 (socket says 172.21.15.50:47874) 2024-09-11T22:22:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.278+0000 7fa11cdf0640 1 -- 172.21.15.50:0/3443000025 learned_addr learned my addr 172.21.15.50:0/3443000025 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.278+0000 7fa117fff640 1 --2- 172.21.15.50:0/3443000025 >> v2:172.21.15.77:3300/0 conn(0x7fa11815e8e0 0x7fa1180b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.278+0000 7fa11cdf0640 1 -- 172.21.15.50:0/3443000025 >> v2:172.21.15.77:3300/0 conn(0x7fa11815e8e0 msgr2=0x7fa1180b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.278+0000 7fa11cdf0640 1 --2- 172.21.15.50:0/3443000025 >> v2:172.21.15.77:3300/0 conn(0x7fa11815e8e0 0x7fa1180b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.278+0000 7fa11cdf0640 1 -- 172.21.15.50:0/3443000025 >> v1:172.21.15.77:6789/0 conn(0x7fa1180d1580 legacy=0x7fa1180d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.278+0000 7fa11cdf0640 1 -- 172.21.15.50:0/3443000025 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1180d2d20 con 0x7fa118162350 2024-09-11T22:22:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.279+0000 7fa11cdf0640 1 --2- 172.21.15.50:0/3443000025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa118162350 0x7fa1181627a0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fa11808d630 tx=0x7fa11002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fc8e83b7f133f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.279+0000 7fa116ffd640 1 -- 172.21.15.50:0/3443000025 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110036070 con 0x7fa118162350 2024-09-11T22:22:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.279+0000 7fa116ffd640 1 -- 172.21.15.50:0/3443000025 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa110031600 con 0x7fa118162350 2024-09-11T22:22:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.279+0000 7fa116ffd640 1 -- 172.21.15.50:0/3443000025 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1100319d0 con 0x7fa118162350 2024-09-11T22:22:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.279+0000 7fa11e853640 1 -- 172.21.15.50:0/3443000025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa118162350 msgr2=0x7fa1181627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.279+0000 7fa11e853640 1 --2- 172.21.15.50:0/3443000025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa118162350 0x7fa1181627a0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fa11808d630 tx=0x7fa11002a780 comp rx=0 tx=0).stop 2024-09-11T22:22:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.279+0000 7fa11e853640 1 -- 172.21.15.50:0/3443000025 shutdown_connections 2024-09-11T22:22:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.279+0000 7fa11e853640 1 --2- 172.21.15.50:0/3443000025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa118162350 0x7fa1181627a0 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.279+0000 7fa11e853640 1 --2- 172.21.15.50:0/3443000025 >> v2:172.21.15.77:3300/0 conn(0x7fa11815e8e0 0x7fa1180b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.279+0000 7fa11e853640 1 -- 172.21.15.50:0/3443000025 >> 172.21.15.50:0/3443000025 conn(0x7fa118067ba0 msgr2=0x7fa118067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.279+0000 7fa11e853640 1 -- 172.21.15.50:0/3443000025 shutdown_connections 2024-09-11T22:22:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.279+0000 7fa11e853640 1 -- 172.21.15.50:0/3443000025 wait complete. 2024-09-11T22:22:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.281+0000 7fa11e853640 1 Processor -- start 2024-09-11T22:22:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.281+0000 7fa11e853640 1 -- start start 2024-09-11T22:22:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa11e853640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1180d1580 0x7fa1180cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa11e853640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa11815e8e0 0x7fa1180b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa11e853640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa118162350 0x7fa1181574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa11e853640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa118162ce0 con 0x7fa1180d1580 2024-09-11T22:22:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa11e853640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa1180d3370 con 0x7fa118162350 2024-09-11T22:22:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa11e853640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa118162e60 con 0x7fa11815e8e0 2024-09-11T22:22:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa117fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1180d1580 0x7fa1180cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa117fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1180d1580 0x7fa1180cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47888/0 (socket says 172.21.15.50:47888) 2024-09-11T22:22:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa117fff640 1 -- 172.21.15.50:0/253289905 learned_addr learned my addr 172.21.15.50:0/253289905 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa1177fe640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa11815e8e0 0x7fa1180b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa11cdf0640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa118162350 0x7fa1181574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa117fff640 1 -- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa11815e8e0 msgr2=0x7fa1180b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa117fff640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa11815e8e0 0x7fa1180b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa117fff640 1 -- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa118162350 msgr2=0x7fa1181574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa117fff640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa118162350 0x7fa1181574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa117fff640 1 -- 172.21.15.50:0/253289905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1180cebe0 con 0x7fa1180d1580 2024-09-11T22:22:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa1177fe640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa11815e8e0 0x7fa1180b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa117fff640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1180d1580 0x7fa1180cc260 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7fa10800c7f0 tx=0x7fa10800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa114ff9640 1 -- 172.21.15.50:0/253289905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108015070 con 0x7fa1180d1580 2024-09-11T22:22:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa114ff9640 1 -- 172.21.15.50:0/253289905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa108004240 con 0x7fa1180d1580 2024-09-11T22:22:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa114ff9640 1 -- 172.21.15.50:0/253289905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108007620 con 0x7fa1180d1580 2024-09-11T22:22:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.282+0000 7fa11e853640 1 -- 172.21.15.50:0/253289905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1180ce2b0 con 0x7fa1180d1580 2024-09-11T22:22:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.283+0000 7fa11e853640 1 -- 172.21.15.50:0/253289905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1180cc7a0 con 0x7fa1180d1580 2024-09-11T22:22:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.283+0000 7fa11e853640 1 -- 172.21.15.50:0/253289905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1180b7880 con 0x7fa1180d1580 2024-09-11T22:22:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.284+0000 7fa114ff9640 1 -- 172.21.15.50:0/253289905 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1080079d0 con 0x7fa1180d1580 2024-09-11T22:22:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.285+0000 7fa114ff9640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa10406be30 0x7fa10406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.285+0000 7fa114ff9640 1 -- 172.21.15.50:0/253289905 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4857+0+0 (secure 0 0 0) 0x7fa10808af10 con 0x7fa1180d1580 2024-09-11T22:22:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.285+0000 7fa1177fe640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa10406be30 0x7fa10406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.285+0000 7fa1177fe640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa10406be30 0x7fa10406e2f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa10c006fd0 tx=0x7fa10c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:30.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.289+0000 7fa114ff9640 1 -- 172.21.15.50:0/253289905 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1080595b0 con 0x7fa1180d1580 2024-09-11T22:22:30.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.532+0000 7fa11e853640 1 -- 172.21.15.50:0/253289905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa1180d27e0 con 0x7fa1180d1580 2024-09-11T22:22:30.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.533+0000 7fa114ff9640 1 -- 172.21.15.50:0/253289905 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7fa10805d8b0 con 0x7fa1180d1580 2024-09-11T22:22:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:30.534 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:22:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-11T22:22:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-11T22:22:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w==", 2024-09-11T22:22:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:22:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:22:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:22:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-11T22:22:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg==", 2024-09-11T22:22:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:22:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:22:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:22:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-11T22:22:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ==", 2024-09-11T22:22:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:22:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:22:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:22:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-11T22:22:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw==", 2024-09-11T22:22:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:22:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:22:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:22:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-11T22:22:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg==", 2024-09-11T22:22:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:22:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:22:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-11T22:22:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ==", 2024-09-11T22:22:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:22:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:22:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-11T22:22:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg==", 2024-09-11T22:22:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:22:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:22:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-11T22:22:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg==", 2024-09-11T22:22:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:22:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:22:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-11T22:22:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A==", 2024-09-11T22:22:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw==", 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A==", 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw==", 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:22:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:22:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-11T22:22:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew==", 2024-09-11T22:22:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:22:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-11T22:22:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T22:22:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-11T22:22:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw==", 2024-09-11T22:22:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:22:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:22:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:22:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:22:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg==", 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw==", 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:22:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:22:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:22:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:22:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-11T22:22:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBFFeJmAq9+OBAAANc9KfDvm3+wt/uED7WCvA==", 2024-09-11T22:22:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:22:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:22:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:22:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-11T22:22:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g==", 2024-09-11T22:22:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:22:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:22:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:22:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-11T22:22:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg==", 2024-09-11T22:22:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:22:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:22:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:22:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:22:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-11T22:22:30.550 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:22:30.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.535+0000 7fa11e853640 1 -- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa10406be30 msgr2=0x7fa10406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.535+0000 7fa11e853640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa10406be30 0x7fa10406e2f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa10c006fd0 tx=0x7fa10c008040 comp rx=0 tx=0).stop 2024-09-11T22:22:30.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.535+0000 7fa11e853640 1 -- 172.21.15.50:0/253289905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1180d1580 msgr2=0x7fa1180cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.535+0000 7fa11e853640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1180d1580 0x7fa1180cc260 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7fa10800c7f0 tx=0x7fa10800ccb0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.535+0000 7fa11e853640 1 -- 172.21.15.50:0/253289905 shutdown_connections 2024-09-11T22:22:30.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.535+0000 7fa11e853640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa10406be30 0x7fa10406e2f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.535+0000 7fa11e853640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa11815e8e0 0x7fa1180b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.535+0000 7fa11e853640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa118162350 0x7fa1181574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.535+0000 7fa11e853640 1 --2- 172.21.15.50:0/253289905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1180d1580 0x7fa1180cc260 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.535+0000 7fa11e853640 1 -- 172.21.15.50:0/253289905 >> 172.21.15.50:0/253289905 conn(0x7fa118067ba0 msgr2=0x7fa118067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:30.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.535+0000 7fa11e853640 1 -- 172.21.15.50:0/253289905 shutdown_connections 2024-09-11T22:22:30.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.535+0000 7fa11e853640 1 -- 172.21.15.50:0/253289905 wait complete. 2024-09-11T22:22:30.554 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:22:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.655+0000 7fc19df8f640 1 Processor -- start 2024-09-11T22:22:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.655+0000 7fc19df8f640 1 -- start start 2024-09-11T22:22:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.656+0000 7fc19df8f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc19815e8e0 0x7fc1980b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.656+0000 7fc19df8f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc1980d1580 0x7fc1980d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.656+0000 7fc19df8f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1980d1ee0 con 0x7fc198162350 2024-09-11T22:22:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.656+0000 7fc19df8f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fc19815ecc0 con 0x7fc19815e8e0 2024-09-11T22:22:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.656+0000 7fc19df8f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc1980d2ad0 con 0x7fc1980d1580 2024-09-11T22:22:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.656+0000 7fc1977fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc19815e8e0 0x7fc1980b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.656+0000 7fc1977fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc19815e8e0 0x7fc1980b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47894/0 (socket says 172.21.15.50:47894) 2024-09-11T22:22:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.656+0000 7fc1977fe640 1 -- 172.21.15.50:0/1209587594 learned_addr learned my addr 172.21.15.50:0/1209587594 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.656+0000 7fc196ffd640 1 --2- 172.21.15.50:0/1209587594 >> v2:172.21.15.77:3300/0 conn(0x7fc1980d1580 0x7fc1980d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.656+0000 7fc1977fe640 1 -- 172.21.15.50:0/1209587594 >> v2:172.21.15.77:3300/0 conn(0x7fc1980d1580 msgr2=0x7fc1980d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.656+0000 7fc1977fe640 1 --2- 172.21.15.50:0/1209587594 >> v2:172.21.15.77:3300/0 conn(0x7fc1980d1580 0x7fc1980d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.656+0000 7fc1977fe640 1 -- 172.21.15.50:0/1209587594 >> v1:172.21.15.77:6789/0 conn(0x7fc198162350 legacy=0x7fc1981627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.656+0000 7fc1977fe640 1 -- 172.21.15.50:0/1209587594 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc198163080 con 0x7fc19815e8e0 2024-09-11T22:22:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.657+0000 7fc1977fe640 1 --2- 172.21.15.50:0/1209587594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc19815e8e0 0x7fc1980b7880 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7fc1981622b0 tx=0x7fc18802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cd5cc625d8d76b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.657+0000 7fc1967fc640 1 -- 172.21.15.50:0/1209587594 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188037070 con 0x7fc19815e8e0 2024-09-11T22:22:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.657+0000 7fc1967fc640 1 -- 172.21.15.50:0/1209587594 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc188032440 con 0x7fc19815e8e0 2024-09-11T22:22:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.657+0000 7fc1967fc640 1 -- 172.21.15.50:0/1209587594 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188032810 con 0x7fc19815e8e0 2024-09-11T22:22:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.658+0000 7fc19df8f640 1 -- 172.21.15.50:0/1209587594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc19815e8e0 msgr2=0x7fc1980b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.658+0000 7fc19df8f640 1 --2- 172.21.15.50:0/1209587594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc19815e8e0 0x7fc1980b7880 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7fc1981622b0 tx=0x7fc18802a2c0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.658+0000 7fc19df8f640 1 -- 172.21.15.50:0/1209587594 shutdown_connections 2024-09-11T22:22:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.658+0000 7fc19df8f640 1 --2- 172.21.15.50:0/1209587594 >> v2:172.21.15.77:3300/0 conn(0x7fc1980d1580 0x7fc1980d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.658+0000 7fc19df8f640 1 --2- 172.21.15.50:0/1209587594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc19815e8e0 0x7fc1980b7880 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.658+0000 7fc19df8f640 1 -- 172.21.15.50:0/1209587594 >> 172.21.15.50:0/1209587594 conn(0x7fc198067ba0 msgr2=0x7fc198067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.658+0000 7fc19df8f640 1 -- 172.21.15.50:0/1209587594 shutdown_connections 2024-09-11T22:22:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.658+0000 7fc19df8f640 1 -- 172.21.15.50:0/1209587594 wait complete. 2024-09-11T22:22:30.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.659+0000 7fc19df8f640 1 Processor -- start 2024-09-11T22:22:30.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.659+0000 7fc19df8f640 1 -- start start 2024-09-11T22:22:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc19df8f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1980d1580 0x7fc1980b9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc19df8f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc19815e8e0 0x7fc1980b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc19df8f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc198162350 0x7fc198154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc19df8f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc1980d3000 con 0x7fc1980d1580 2024-09-11T22:22:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc19df8f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc1980d3370 con 0x7fc198162350 2024-09-11T22:22:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc19df8f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc1980d3800 con 0x7fc19815e8e0 2024-09-11T22:22:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc1977fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1980d1580 0x7fc1980b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc1977fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1980d1580 0x7fc1980b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47902/0 (socket says 172.21.15.50:47902) 2024-09-11T22:22:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc1977fe640 1 -- 172.21.15.50:0/2001196458 learned_addr learned my addr 172.21.15.50:0/2001196458 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc197fff640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc198162350 0x7fc198154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc196ffd640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc19815e8e0 0x7fc1980b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc1977fe640 1 -- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc19815e8e0 msgr2=0x7fc1980b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc1977fe640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc19815e8e0 0x7fc1980b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc1977fe640 1 -- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc198162350 msgr2=0x7fc198154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc1977fe640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc198162350 0x7fc198154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.660+0000 7fc1977fe640 1 -- 172.21.15.50:0/2001196458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1980b4a80 con 0x7fc1980d1580 2024-09-11T22:22:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.661+0000 7fc1977fe640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1980d1580 0x7fc1980b9180 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7fc188000c00 tx=0x7fc1880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.661+0000 7fc17ffff640 1 -- 172.21.15.50:0/2001196458 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188041020 con 0x7fc1980d1580 2024-09-11T22:22:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.661+0000 7fc17ffff640 1 -- 172.21.15.50:0/2001196458 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1880306c0 con 0x7fc1980d1580 2024-09-11T22:22:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.661+0000 7fc19df8f640 1 -- 172.21.15.50:0/2001196458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1980b4d60 con 0x7fc1980d1580 2024-09-11T22:22:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.661+0000 7fc17ffff640 1 -- 172.21.15.50:0/2001196458 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188037040 con 0x7fc1980d1580 2024-09-11T22:22:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.661+0000 7fc19df8f640 1 -- 172.21.15.50:0/2001196458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1980b96c0 con 0x7fc1980d1580 2024-09-11T22:22:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.662+0000 7fc19df8f640 1 -- 172.21.15.50:0/2001196458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1980d19a0 con 0x7fc1980d1580 2024-09-11T22:22:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.662+0000 7fc17ffff640 1 -- 172.21.15.50:0/2001196458 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc188044020 con 0x7fc1980d1580 2024-09-11T22:22:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.663+0000 7fc17ffff640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc18406be30 0x7fc18406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.663+0000 7fc17ffff640 1 -- 172.21.15.50:0/2001196458 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4857+0+0 (secure 0 0 0) 0x7fc1880ab340 con 0x7fc1980d1580 2024-09-11T22:22:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.663+0000 7fc196ffd640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc18406be30 0x7fc18406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.664+0000 7fc196ffd640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc18406be30 0x7fc18406e2f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc1980d5530 tx=0x7fc18c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.667+0000 7fc17ffff640 1 -- 172.21.15.50:0/2001196458 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc18804b030 con 0x7fc1980d1580 2024-09-11T22:22:30.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.843+0000 7fc19df8f640 1 -- 172.21.15.50:0/2001196458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc1980b50f0 con 0x7fc1980d1580 2024-09-11T22:22:30.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.843+0000 7fc17ffff640 1 -- 172.21.15.50:0/2001196458 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v174) ==== 84+0+65 (secure 0 0 0) 0x7fc188079fb0 con 0x7fc1980d1580 2024-09-11T22:22:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:30.844 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:22:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:22:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:22:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:22:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:30.846 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:22:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.845+0000 7fc19df8f640 1 -- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc18406be30 msgr2=0x7fc18406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.845+0000 7fc19df8f640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc18406be30 0x7fc18406e2f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc1980d5530 tx=0x7fc18c008040 comp rx=0 tx=0).stop 2024-09-11T22:22:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.845+0000 7fc19df8f640 1 -- 172.21.15.50:0/2001196458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1980d1580 msgr2=0x7fc1980b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.845+0000 7fc19df8f640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1980d1580 0x7fc1980b9180 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7fc188000c00 tx=0x7fc1880046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.845+0000 7fc19df8f640 1 -- 172.21.15.50:0/2001196458 shutdown_connections 2024-09-11T22:22:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.845+0000 7fc19df8f640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc18406be30 0x7fc18406e2f0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.845+0000 7fc19df8f640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc19815e8e0 0x7fc1980b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.845+0000 7fc19df8f640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc198162350 0x7fc198154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.845+0000 7fc19df8f640 1 --2- 172.21.15.50:0/2001196458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1980d1580 0x7fc1980b9180 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.845+0000 7fc19df8f640 1 -- 172.21.15.50:0/2001196458 >> 172.21.15.50:0/2001196458 conn(0x7fc198067ba0 msgr2=0x7fc198067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.845+0000 7fc19df8f640 1 -- 172.21.15.50:0/2001196458 shutdown_connections 2024-09-11T22:22:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.845+0000 7fc19df8f640 1 -- 172.21.15.50:0/2001196458 wait complete. 2024-09-11T22:22:30.857 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:22:30.857 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:22:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.963+0000 7fd84d9e4640 1 Processor -- start 2024-09-11T22:22:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.963+0000 7fd84d9e4640 1 -- start start 2024-09-11T22:22:30.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.964+0000 7fd84d9e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd84815e8e0 0x7fd8480b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.964+0000 7fd84d9e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8480d1580 0x7fd8480d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.964+0000 7fd84d9e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8480d1ee0 con 0x7fd848162350 2024-09-11T22:22:30.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.964+0000 7fd84d9e4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd84815ecc0 con 0x7fd84815e8e0 2024-09-11T22:22:30.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.964+0000 7fd84d9e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd8480d2ad0 con 0x7fd8480d1580 2024-09-11T22:22:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.964+0000 7fd846ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd84815e8e0 0x7fd8480b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.964+0000 7fd846ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd84815e8e0 0x7fd8480b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47916/0 (socket says 172.21.15.50:47916) 2024-09-11T22:22:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.964+0000 7fd846ffd640 1 -- 172.21.15.50:0/1308817011 learned_addr learned my addr 172.21.15.50:0/1308817011 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.964+0000 7fd8467fc640 1 --2- 172.21.15.50:0/1308817011 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8480d1580 0x7fd8480d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.964+0000 7fd846ffd640 1 -- 172.21.15.50:0/1308817011 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8480d1580 msgr2=0x7fd8480d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.964+0000 7fd846ffd640 1 --2- 172.21.15.50:0/1308817011 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8480d1580 0x7fd8480d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.964+0000 7fd846ffd640 1 -- 172.21.15.50:0/1308817011 >> v1:172.21.15.77:6789/0 conn(0x7fd848162350 legacy=0x7fd848162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.964+0000 7fd846ffd640 1 -- 172.21.15.50:0/1308817011 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd848163080 con 0x7fd84815e8e0 2024-09-11T22:22:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.965+0000 7fd846ffd640 1 --2- 172.21.15.50:0/1308817011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84815e8e0 0x7fd8480b7880 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7fd838009870 tx=0x7fd83802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6f5facb6278dd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.965+0000 7fd845ffb640 1 -- 172.21.15.50:0/1308817011 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd838037070 con 0x7fd84815e8e0 2024-09-11T22:22:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.965+0000 7fd845ffb640 1 -- 172.21.15.50:0/1308817011 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd83802ae50 con 0x7fd84815e8e0 2024-09-11T22:22:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.965+0000 7fd845ffb640 1 -- 172.21.15.50:0/1308817011 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd838032860 con 0x7fd84815e8e0 2024-09-11T22:22:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.966+0000 7fd84d9e4640 1 -- 172.21.15.50:0/1308817011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84815e8e0 msgr2=0x7fd8480b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.966+0000 7fd84d9e4640 1 --2- 172.21.15.50:0/1308817011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84815e8e0 0x7fd8480b7880 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7fd838009870 tx=0x7fd83802a300 comp rx=0 tx=0).stop 2024-09-11T22:22:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.966+0000 7fd84d9e4640 1 -- 172.21.15.50:0/1308817011 shutdown_connections 2024-09-11T22:22:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.966+0000 7fd84d9e4640 1 --2- 172.21.15.50:0/1308817011 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8480d1580 0x7fd8480d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.966+0000 7fd84d9e4640 1 --2- 172.21.15.50:0/1308817011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84815e8e0 0x7fd8480b7880 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.966+0000 7fd84d9e4640 1 -- 172.21.15.50:0/1308817011 >> 172.21.15.50:0/1308817011 conn(0x7fd848067ba0 msgr2=0x7fd848067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.966+0000 7fd84d9e4640 1 -- 172.21.15.50:0/1308817011 shutdown_connections 2024-09-11T22:22:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.966+0000 7fd84d9e4640 1 -- 172.21.15.50:0/1308817011 wait complete. 2024-09-11T22:22:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.967+0000 7fd84d9e4640 1 Processor -- start 2024-09-11T22:22:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.967+0000 7fd84d9e4640 1 -- start start 2024-09-11T22:22:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd84d9e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8480d1580 0x7fd84815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd84d9e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd84815e8e0 0x7fd8480cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd84d9e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd848162350 0x7fd8480b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd84d9e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd8480d3000 con 0x7fd848162350 2024-09-11T22:22:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd84d9e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd8480d3370 con 0x7fd8480d1580 2024-09-11T22:22:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd84d9e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd8480d3800 con 0x7fd84815e8e0 2024-09-11T22:22:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd8477fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd848162350 0x7fd8480b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd8477fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd848162350 0x7fd8480b6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47928/0 (socket says 172.21.15.50:47928) 2024-09-11T22:22:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd8477fe640 1 -- 172.21.15.50:0/2054960433 learned_addr learned my addr 172.21.15.50:0/2054960433 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd846ffd640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8480d1580 0x7fd84815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd8467fc640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd84815e8e0 0x7fd8480cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd8477fe640 1 -- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd84815e8e0 msgr2=0x7fd8480cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd8477fe640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd84815e8e0 0x7fd8480cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd8477fe640 1 -- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8480d1580 msgr2=0x7fd84815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd8477fe640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8480d1580 0x7fd84815b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd8477fe640 1 -- 172.21.15.50:0/2054960433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8480b53b0 con 0x7fd848162350 2024-09-11T22:22:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd8467fc640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd84815e8e0 0x7fd8480cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.968+0000 7fd8477fe640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd848162350 0x7fd8480b6450 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7fd84000c760 tx=0x7fd84000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.969+0000 7fd82ffff640 1 -- 172.21.15.50:0/2054960433 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840016020 con 0x7fd848162350 2024-09-11T22:22:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.969+0000 7fd82ffff640 1 -- 172.21.15.50:0/2054960433 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd840006d50 con 0x7fd848162350 2024-09-11T22:22:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.969+0000 7fd84d9e4640 1 -- 172.21.15.50:0/2054960433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8480b5690 con 0x7fd848162350 2024-09-11T22:22:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.969+0000 7fd82ffff640 1 -- 172.21.15.50:0/2054960433 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840003bb0 con 0x7fd848162350 2024-09-11T22:22:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.969+0000 7fd84d9e4640 1 -- 172.21.15.50:0/2054960433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8480b5c50 con 0x7fd848162350 2024-09-11T22:22:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.970+0000 7fd84d9e4640 1 -- 172.21.15.50:0/2054960433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8480d19a0 con 0x7fd848162350 2024-09-11T22:22:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.970+0000 7fd82ffff640 1 -- 172.21.15.50:0/2054960433 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8400050d0 con 0x7fd848162350 2024-09-11T22:22:30.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.971+0000 7fd82ffff640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd83406be30 0x7fd83406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:30.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.971+0000 7fd82ffff640 1 -- 172.21.15.50:0/2054960433 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4857+0+0 (secure 0 0 0) 0x7fd84008a5d0 con 0x7fd848162350 2024-09-11T22:22:30.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.971+0000 7fd846ffd640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd83406be30 0x7fd83406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:30.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.971+0000 7fd846ffd640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd83406be30 0x7fd83406e2f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd838034000 tx=0x7fd83802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:30.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:30.975+0000 7fd82ffff640 1 -- 172.21.15.50:0/2054960433 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd840020020 con 0x7fd848162350 2024-09-11T22:22:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.150+0000 7fd84d9e4640 1 -- 172.21.15.50:0/2054960433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd848161880 con 0x7fd848162350 2024-09-11T22:22:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.847+0000 7fd82ffff640 1 -- 172.21.15.50:0/2054960433 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v175) ==== 138+0+0 (secure 0 0 0) 0x7fd840059360 con 0x7fd848162350 2024-09-11T22:22:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:22:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.851+0000 7fd84d9e4640 1 -- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd83406be30 msgr2=0x7fd83406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.851+0000 7fd84d9e4640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd83406be30 0x7fd83406e2f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd838034000 tx=0x7fd83802e000 comp rx=0 tx=0).stop 2024-09-11T22:22:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.851+0000 7fd84d9e4640 1 -- 172.21.15.50:0/2054960433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd848162350 msgr2=0x7fd8480b6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.851+0000 7fd84d9e4640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd848162350 0x7fd8480b6450 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7fd84000c760 tx=0x7fd84000cb60 comp rx=0 tx=0).stop 2024-09-11T22:22:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.851+0000 7fd84d9e4640 1 -- 172.21.15.50:0/2054960433 shutdown_connections 2024-09-11T22:22:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.851+0000 7fd84d9e4640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd83406be30 0x7fd83406e2f0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.851+0000 7fd84d9e4640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd84815e8e0 0x7fd8480cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.851+0000 7fd84d9e4640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd848162350 0x7fd8480b6450 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.851+0000 7fd84d9e4640 1 --2- 172.21.15.50:0/2054960433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8480d1580 0x7fd84815b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.851+0000 7fd84d9e4640 1 -- 172.21.15.50:0/2054960433 >> 172.21.15.50:0/2054960433 conn(0x7fd848067ba0 msgr2=0x7fd84815fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.851+0000 7fd84d9e4640 1 -- 172.21.15.50:0/2054960433 shutdown_connections 2024-09-11T22:22:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.851+0000 7fd84d9e4640 1 -- 172.21.15.50:0/2054960433 wait complete. 2024-09-11T22:22:31.870 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:22:31.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.986+0000 7f6406d52640 1 Processor -- start 2024-09-11T22:22:31.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.987+0000 7f6406d52640 1 -- start start 2024-09-11T22:22:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.987+0000 7f6406d52640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f640015e870 0x7f64000d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.987+0000 7f6406d52640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f64000d16d0 0x7f64000d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.987+0000 7f6406d52640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64000cfa80 con 0x7f64000d3a30 2024-09-11T22:22:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.987+0000 7f6406d52640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f64000d1b40 con 0x7f640015e870 2024-09-11T22:22:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.987+0000 7f6406d52640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f64000d3e50 con 0x7f64000d16d0 2024-09-11T22:22:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.987+0000 7f6404aee640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f640015e870 0x7f64000d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.988+0000 7f6404aee640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f640015e870 0x7f64000d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47940/0 (socket says 172.21.15.50:47940) 2024-09-11T22:22:31.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.988+0000 7f6404aee640 1 -- 172.21.15.50:0/3888540077 learned_addr learned my addr 172.21.15.50:0/3888540077 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:31.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.988+0000 7f63fffff640 1 --2- 172.21.15.50:0/3888540077 >> v2:172.21.15.77:3300/0 conn(0x7f64000d16d0 0x7f64000d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:31.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.988+0000 7f6404aee640 1 -- 172.21.15.50:0/3888540077 >> v2:172.21.15.77:3300/0 conn(0x7f64000d16d0 msgr2=0x7f64000d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:31.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.988+0000 7f6404aee640 1 --2- 172.21.15.50:0/3888540077 >> v2:172.21.15.77:3300/0 conn(0x7f64000d16d0 0x7f64000d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:31.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.988+0000 7f6404aee640 1 -- 172.21.15.50:0/3888540077 >> v1:172.21.15.77:6789/0 conn(0x7f64000d3a30 legacy=0x7f64000b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:31.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.988+0000 7f6404aee640 1 -- 172.21.15.50:0/3888540077 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64000d40d0 con 0x7f640015e870 2024-09-11T22:22:31.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.989+0000 7f6404aee640 1 --2- 172.21.15.50:0/3888540077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f640015e870 0x7f64000d1190 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f640006c830 tx=0x7f63f002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977c054840900763 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:31.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.989+0000 7f63ff7fe640 1 -- 172.21.15.50:0/3888540077 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0037070 con 0x7f640015e870 2024-09-11T22:22:31.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.989+0000 7f63ff7fe640 1 -- 172.21.15.50:0/3888540077 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f0032440 con 0x7f640015e870 2024-09-11T22:22:31.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.989+0000 7f63ff7fe640 1 -- 172.21.15.50:0/3888540077 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0032810 con 0x7f640015e870 2024-09-11T22:22:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.989+0000 7f6406d52640 1 -- 172.21.15.50:0/3888540077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f640015e870 msgr2=0x7f64000d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.989+0000 7f6406d52640 1 --2- 172.21.15.50:0/3888540077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f640015e870 0x7f64000d1190 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f640006c830 tx=0x7f63f002a230 comp rx=0 tx=0).stop 2024-09-11T22:22:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.989+0000 7f6406d52640 1 -- 172.21.15.50:0/3888540077 shutdown_connections 2024-09-11T22:22:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.989+0000 7f6406d52640 1 --2- 172.21.15.50:0/3888540077 >> v2:172.21.15.77:3300/0 conn(0x7f64000d16d0 0x7f64000d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.989+0000 7f6406d52640 1 --2- 172.21.15.50:0/3888540077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f640015e870 0x7f64000d1190 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.989+0000 7f6406d52640 1 -- 172.21.15.50:0/3888540077 >> 172.21.15.50:0/3888540077 conn(0x7f64000727a0 msgr2=0x7f64000679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.989+0000 7f6406d52640 1 -- 172.21.15.50:0/3888540077 shutdown_connections 2024-09-11T22:22:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.989+0000 7f6406d52640 1 -- 172.21.15.50:0/3888540077 wait complete. 2024-09-11T22:22:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.991+0000 7f6406d52640 1 Processor -- start 2024-09-11T22:22:31.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.991+0000 7f6406d52640 1 -- start start 2024-09-11T22:22:31.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6406d52640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000d16d0 0x7f6400152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6406d52640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64000d3a30 0x7f6400154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6406d52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f640015e870 0x7f64000cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6406d52640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f64000b7ee0 con 0x7f64000d16d0 2024-09-11T22:22:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6406d52640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f64000b7c00 con 0x7f640015e870 2024-09-11T22:22:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6406d52640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f640015ec50 con 0x7f64000d3a30 2024-09-11T22:22:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6404aee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000d16d0 0x7f6400152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6404aee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000d16d0 0x7f6400152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47954/0 (socket says 172.21.15.50:47954) 2024-09-11T22:22:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6404aee640 1 -- 172.21.15.50:0/512547816 learned_addr learned my addr 172.21.15.50:0/512547816 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f63fffff640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64000d3a30 0x7f6400154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f64052ef640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f640015e870 0x7f64000cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6404aee640 1 -- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64000d3a30 msgr2=0x7f6400154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6404aee640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64000d3a30 0x7f6400154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6404aee640 1 -- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f640015e870 msgr2=0x7f64000cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6404aee640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f640015e870 0x7f64000cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6404aee640 1 -- 172.21.15.50:0/512547816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64001550d0 con 0x7f64000d16d0 2024-09-11T22:22:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f6404aee640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000d16d0 0x7f6400152760 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f63f0000c00 tx=0x7f63f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f63fd7fa640 1 -- 172.21.15.50:0/512547816 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0041020 con 0x7f64000d16d0 2024-09-11T22:22:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.992+0000 7f63fd7fa640 1 -- 172.21.15.50:0/512547816 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f0030970 con 0x7f64000d16d0 2024-09-11T22:22:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.993+0000 7f63fd7fa640 1 -- 172.21.15.50:0/512547816 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0037040 con 0x7f64000d16d0 2024-09-11T22:22:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.993+0000 7f6406d52640 1 -- 172.21.15.50:0/512547816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64001553b0 con 0x7f64000d16d0 2024-09-11T22:22:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.993+0000 7f6406d52640 1 -- 172.21.15.50:0/512547816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64000b1f10 con 0x7f64000d16d0 2024-09-11T22:22:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.994+0000 7f6406d52640 1 -- 172.21.15.50:0/512547816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64000b78b0 con 0x7f64000d16d0 2024-09-11T22:22:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.994+0000 7f63fd7fa640 1 -- 172.21.15.50:0/512547816 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63f0044020 con 0x7f64000d16d0 2024-09-11T22:22:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.995+0000 7f63fd7fa640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f63ec06be60 0x7f63ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.995+0000 7f63fd7fa640 1 -- 172.21.15.50:0/512547816 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5227+0+0 (secure 0 0 0) 0x7f63f00ab6b0 con 0x7f64000d16d0 2024-09-11T22:22:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.995+0000 7f63fffff640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f63ec06be60 0x7f63ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.995+0000 7f63fffff640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f63ec06be60 0x7f63ec06e320 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f64000afa70 tx=0x7f63f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:31.999+0000 7f63fd7fa640 1 -- 172.21.15.50:0/512547816 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63f004b030 con 0x7f64000d16d0 2024-09-11T22:22:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.176+0000 7f6406d52640 1 -- 172.21.15.50:0/512547816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6400152ca0 con 0x7f64000d16d0 2024-09-11T22:22:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.854+0000 7f63fd7fa640 1 -- 172.21.15.50:0/512547816 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v176) ==== 170+0+0 (secure 0 0 0) 0x7f64000cfa80 con 0x7f64000d16d0 2024-09-11T22:22:32.855 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:22:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.857+0000 7f6406d52640 1 -- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f63ec06be60 msgr2=0x7f63ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:32.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.857+0000 7f6406d52640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f63ec06be60 0x7f63ec06e320 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f64000afa70 tx=0x7f63f4008040 comp rx=0 tx=0).stop 2024-09-11T22:22:32.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.857+0000 7f6406d52640 1 -- 172.21.15.50:0/512547816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000d16d0 msgr2=0x7f6400152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:32.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.857+0000 7f6406d52640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000d16d0 0x7f6400152760 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f63f0000c00 tx=0x7f63f00046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:32.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.857+0000 7f6406d52640 1 -- 172.21.15.50:0/512547816 shutdown_connections 2024-09-11T22:22:32.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.857+0000 7f6406d52640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f63ec06be60 0x7f63ec06e320 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:32.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.857+0000 7f6406d52640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64000d3a30 0x7f6400154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:32.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.857+0000 7f6406d52640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f640015e870 0x7f64000cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:32.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.857+0000 7f6406d52640 1 --2- 172.21.15.50:0/512547816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64000d16d0 0x7f6400152760 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:32.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.857+0000 7f6406d52640 1 -- 172.21.15.50:0/512547816 >> 172.21.15.50:0/512547816 conn(0x7f64000727a0 msgr2=0x7f64000679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.860+0000 7f6406d52640 1 -- 172.21.15.50:0/512547816 shutdown_connections 2024-09-11T22:22:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.863+0000 7f6406d52640 1 -- 172.21.15.50:0/512547816 wait complete. 2024-09-11T22:22:32.885 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:22:32.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.992+0000 7fe83f4d2640 1 Processor -- start 2024-09-11T22:22:32.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.993+0000 7fe83f4d2640 1 -- start start 2024-09-11T22:22:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.993+0000 7fe83f4d2640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe838148340 0x7fe8380b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.993+0000 7fe83f4d2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8380afc20 0x7fe83815ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.993+0000 7fe83f4d2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe83806eaf0 con 0x7fe838072490 2024-09-11T22:22:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.993+0000 7fe83f4d2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe8380b4b30 con 0x7fe8380afc20 2024-09-11T22:22:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.993+0000 7fe83f4d2640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe8380b4290 con 0x7fe838148340 2024-09-11T22:22:32.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.994+0000 7fe83d26e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe838148340 0x7fe8380b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:32.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.994+0000 7fe83ca6d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8380afc20 0x7fe83815ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:32.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.994+0000 7fe83da6f640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe838072490 0x7fe83806f2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:48628/0 (socket says 172.21.15.50:48628) 2024-09-11T22:22:32.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.994+0000 7fe83da6f640 1 -- 172.21.15.50:0/3128798146 learned_addr learned my addr 172.21.15.50:0/3128798146 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:32.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.994+0000 7fe83ca6d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8380afc20 0x7fe83815ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:37478/0 (socket says 172.21.15.50:37478) 2024-09-11T22:22:32.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.994+0000 7fe82ffff640 1 -- 172.21.15.50:0/3128798146 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284866793 0 0) 0x7fe83806eaf0 con 0x7fe838072490 2024-09-11T22:22:32.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.994+0000 7fe82ffff640 1 -- 172.21.15.50:0/3128798146 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe824003520 con 0x7fe838072490 2024-09-11T22:22:32.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.994+0000 7fe83d26e640 1 -- 172.21.15.50:0/3128798146 >> v2:172.21.15.77:3300/0 conn(0x7fe8380afc20 msgr2=0x7fe83815ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:32.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.994+0000 7fe83d26e640 1 --2- 172.21.15.50:0/3128798146 >> v2:172.21.15.77:3300/0 conn(0x7fe8380afc20 0x7fe83815ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:32.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.994+0000 7fe83d26e640 1 -- 172.21.15.50:0/3128798146 >> v1:172.21.15.77:6789/0 conn(0x7fe838072490 legacy=0x7fe83806f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:32.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.994+0000 7fe83d26e640 1 -- 172.21.15.50:0/3128798146 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8380b4570 con 0x7fe838148340 2024-09-11T22:22:32.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.994+0000 7fe83ca6d640 1 --2- 172.21.15.50:0/3128798146 >> v2:172.21.15.77:3300/0 conn(0x7fe8380afc20 0x7fe83815ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:32.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.995+0000 7fe83d26e640 1 --2- 172.21.15.50:0/3128798146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe838148340 0x7fe8380b3990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe8340097a0 tx=0x7fe83402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e2a33ddf0be4ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:32.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.995+0000 7fe82ffff640 1 -- 172.21.15.50:0/3128798146 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe834037070 con 0x7fe838148340 2024-09-11T22:22:32.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.995+0000 7fe82ffff640 1 -- 172.21.15.50:0/3128798146 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe834032440 con 0x7fe838148340 2024-09-11T22:22:32.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.995+0000 7fe82ffff640 1 -- 172.21.15.50:0/3128798146 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8340327f0 con 0x7fe838148340 2024-09-11T22:22:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.996+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3128798146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe838148340 msgr2=0x7fe8380b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.996+0000 7fe83f4d2640 1 --2- 172.21.15.50:0/3128798146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe838148340 0x7fe8380b3990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe8340097a0 tx=0x7fe83402a180 comp rx=0 tx=0).stop 2024-09-11T22:22:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.996+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3128798146 shutdown_connections 2024-09-11T22:22:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.996+0000 7fe83f4d2640 1 --2- 172.21.15.50:0/3128798146 >> v2:172.21.15.77:3300/0 conn(0x7fe8380afc20 0x7fe83815ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.996+0000 7fe83f4d2640 1 --2- 172.21.15.50:0/3128798146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe838148340 0x7fe8380b3990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.996+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3128798146 >> 172.21.15.50:0/3128798146 conn(0x7fe838068240 msgr2=0x7fe8380b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:32.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.996+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3128798146 shutdown_connections 2024-09-11T22:22:33.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.996+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3128798146 wait complete. 2024-09-11T22:22:33.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.997+0000 7fe83f4d2640 1 Processor -- start 2024-09-11T22:22:33.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.997+0000 7fe83f4d2640 1 -- start start 2024-09-11T22:22:33.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.998+0000 7fe83f4d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe838072490 0x7fe83813fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:33.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.998+0000 7fe83f4d2640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8380afc20 0x7fe83813d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.998+0000 7fe83f4d2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe838148340 0x7fe838142f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.998+0000 7fe83f4d2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe8380b3ed0 con 0x7fe838072490 2024-09-11T22:22:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.998+0000 7fe83f4d2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe83806ed90 con 0x7fe838148340 2024-09-11T22:22:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.998+0000 7fe83f4d2640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe8380b4050 con 0x7fe8380afc20 2024-09-11T22:22:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.998+0000 7fe83d26e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe838072490 0x7fe83813fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.998+0000 7fe83d26e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe838072490 0x7fe83813fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47958/0 (socket says 172.21.15.50:47958) 2024-09-11T22:22:33.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.998+0000 7fe83d26e640 1 -- 172.21.15.50:0/3560357552 learned_addr learned my addr 172.21.15.50:0/3560357552 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.998+0000 7fe83ca6d640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8380afc20 0x7fe83813d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.998+0000 7fe83da6f640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe838148340 0x7fe838142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.999+0000 7fe83d26e640 1 -- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8380afc20 msgr2=0x7fe83813d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.999+0000 7fe83d26e640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8380afc20 0x7fe83813d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.999+0000 7fe83d26e640 1 -- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe838148340 msgr2=0x7fe838142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.999+0000 7fe83d26e640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe838148340 0x7fe838142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.999+0000 7fe83d26e640 1 -- 172.21.15.50:0/3560357552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe83815dec0 con 0x7fe838072490 2024-09-11T22:22:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.999+0000 7fe83d26e640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe838072490 0x7fe83813fef0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7fe834000c00 tx=0x7fe8340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.999+0000 7fe82dffb640 1 -- 172.21.15.50:0/3560357552 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe834041020 con 0x7fe838072490 2024-09-11T22:22:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.999+0000 7fe82dffb640 1 -- 172.21.15.50:0/3560357552 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe83403d620 con 0x7fe838072490 2024-09-11T22:22:33.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.999+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3560357552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe83815e1a0 con 0x7fe838072490 2024-09-11T22:22:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.999+0000 7fe82dffb640 1 -- 172.21.15.50:0/3560357552 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe834037040 con 0x7fe838072490 2024-09-11T22:22:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:32.999+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3560357552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe838142700 con 0x7fe838072490 2024-09-11T22:22:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.000+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3560357552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe838075770 con 0x7fe838072490 2024-09-11T22:22:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.001+0000 7fe82dffb640 1 -- 172.21.15.50:0/3560357552 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe834044020 con 0x7fe838072490 2024-09-11T22:22:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.001+0000 7fe82dffb640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe81c06be60 0x7fe81c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:33.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.001+0000 7fe82dffb640 1 -- 172.21.15.50:0/3560357552 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5609+0+0 (secure 0 0 0) 0x7fe8340ab450 con 0x7fe838072490 2024-09-11T22:22:33.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.002+0000 7fe83ca6d640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe81c06be60 0x7fe81c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:33.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.002+0000 7fe83ca6d640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe81c06be60 0x7fe81c06e320 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe828009560 tx=0x7fe828009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:33.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.006+0000 7fe82dffb640 1 -- 172.21.15.50:0/3560357552 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe838075770 con 0x7fe838072490 2024-09-11T22:22:33.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.218+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3560357552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe8380b5b80 con 0x7fe838072490 2024-09-11T22:22:33.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.870+0000 7fe82dffb640 1 -- 172.21.15.50:0/3560357552 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v128) ==== 174+0+0 (secure 0 0 0) 0x7fe83404b030 con 0x7fe838072490 2024-09-11T22:22:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 26 and data pool 27 2024-09-11T22:22:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.888+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe81c06be60 msgr2=0x7fe81c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.888+0000 7fe83f4d2640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe81c06be60 0x7fe81c06e320 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe828009560 tx=0x7fe828009190 comp rx=0 tx=0).stop 2024-09-11T22:22:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.888+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3560357552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe838072490 msgr2=0x7fe83813fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.888+0000 7fe83f4d2640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe838072490 0x7fe83813fef0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7fe834000c00 tx=0x7fe8340046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:33.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.889+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3560357552 shutdown_connections 2024-09-11T22:22:33.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.889+0000 7fe83f4d2640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe81c06be60 0x7fe81c06e320 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:33.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.889+0000 7fe83f4d2640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8380afc20 0x7fe83813d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:33.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.889+0000 7fe83f4d2640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe838148340 0x7fe838142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:33.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.889+0000 7fe83f4d2640 1 --2- 172.21.15.50:0/3560357552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe838072490 0x7fe83813fef0 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:33.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.889+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3560357552 >> 172.21.15.50:0/3560357552 conn(0x7fe838068240 msgr2=0x7fe8380cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:33.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.889+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3560357552 shutdown_connections 2024-09-11T22:22:33.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:33.889+0000 7fe83f4d2640 1 -- 172.21.15.50:0/3560357552 wait complete. 2024-09-11T22:22:33.904 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:22:34.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.011+0000 7fe6c8ee6640 1 Processor -- start 2024-09-11T22:22:34.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.011+0000 7fe6c8ee6640 1 -- start start 2024-09-11T22:22:34.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.012+0000 7fe6c8ee6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe6c40d1c90 0x7fe6c40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.012+0000 7fe6c8ee6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6c4162350 0x7fe6c41627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.012+0000 7fe6c8ee6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6c4163080 con 0x7fe6c415e8e0 2024-09-11T22:22:34.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.012+0000 7fe6c8ee6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c415ecc0 con 0x7fe6c4162350 2024-09-11T22:22:34.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.012+0000 7fe6c8ee6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c40d2ad0 con 0x7fe6c40d1c90 2024-09-11T22:22:34.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.012+0000 7fe6c2d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6c4162350 0x7fe6c41627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.012+0000 7fe6c2d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe6c4162350 0x7fe6c41627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47968/0 (socket says 172.21.15.50:47968) 2024-09-11T22:22:34.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.012+0000 7fe6c2d9d640 1 -- 172.21.15.50:0/113156261 learned_addr learned my addr 172.21.15.50:0/113156261 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:34.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.013+0000 7fe6c1d9b640 1 --2- 172.21.15.50:0/113156261 >> v2:172.21.15.77:3300/0 conn(0x7fe6c40d1c90 0x7fe6c40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.013+0000 7fe6c2d9d640 1 -- 172.21.15.50:0/113156261 >> v2:172.21.15.77:3300/0 conn(0x7fe6c40d1c90 msgr2=0x7fe6c40b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:34.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.013+0000 7fe6c2d9d640 1 --2- 172.21.15.50:0/113156261 >> v2:172.21.15.77:3300/0 conn(0x7fe6c40d1c90 0x7fe6c40b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.013+0000 7fe6c2d9d640 1 -- 172.21.15.50:0/113156261 >> v1:172.21.15.77:6789/0 conn(0x7fe6c415e8e0 legacy=0x7fe6c40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:34.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.013+0000 7fe6c2d9d640 1 -- 172.21.15.50:0/113156261 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c40d2d20 con 0x7fe6c4162350 2024-09-11T22:22:34.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.013+0000 7fe6c2d9d640 1 --2- 172.21.15.50:0/113156261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c4162350 0x7fe6c41627a0 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fe6c41622b0 tx=0x7fe6bc02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1451066f55de3bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:34.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.014+0000 7fe6c159a640 1 -- 172.21.15.50:0/113156261 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc037070 con 0x7fe6c4162350 2024-09-11T22:22:34.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.014+0000 7fe6c159a640 1 -- 172.21.15.50:0/113156261 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6bc032440 con 0x7fe6c4162350 2024-09-11T22:22:34.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.014+0000 7fe6c159a640 1 -- 172.21.15.50:0/113156261 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc032810 con 0x7fe6c4162350 2024-09-11T22:22:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.014+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/113156261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c4162350 msgr2=0x7fe6c41627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.014+0000 7fe6c8ee6640 1 --2- 172.21.15.50:0/113156261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c4162350 0x7fe6c41627a0 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fe6c41622b0 tx=0x7fe6bc02a2c0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.014+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/113156261 shutdown_connections 2024-09-11T22:22:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.014+0000 7fe6c8ee6640 1 --2- 172.21.15.50:0/113156261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c4162350 0x7fe6c41627a0 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.014+0000 7fe6c8ee6640 1 --2- 172.21.15.50:0/113156261 >> v2:172.21.15.77:3300/0 conn(0x7fe6c40d1c90 0x7fe6c40b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.014+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/113156261 >> 172.21.15.50:0/113156261 conn(0x7fe6c4067ba0 msgr2=0x7fe6c4067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.014+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/113156261 shutdown_connections 2024-09-11T22:22:34.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.014+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/113156261 wait complete. 2024-09-11T22:22:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.016+0000 7fe6c8ee6640 1 Processor -- start 2024-09-11T22:22:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.016+0000 7fe6c8ee6640 1 -- start start 2024-09-11T22:22:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.016+0000 7fe6c8ee6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c40d1c90 0x7fe6c415c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.016+0000 7fe6c8ee6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c415e8e0 0x7fe6c40ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.016+0000 7fe6c8ee6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6c4162350 0x7fe6c415ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.016+0000 7fe6c8ee6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c4162ce0 con 0x7fe6c40d1c90 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.016+0000 7fe6c8ee6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c40d3370 con 0x7fe6c415e8e0 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.016+0000 7fe6c8ee6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c4162e60 con 0x7fe6c4162350 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.016+0000 7fe6c259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c40d1c90 0x7fe6c415c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.016+0000 7fe6c259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c40d1c90 0x7fe6c415c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47984/0 (socket says 172.21.15.50:47984) 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.016+0000 7fe6c259c640 1 -- 172.21.15.50:0/2383962533 learned_addr learned my addr 172.21.15.50:0/2383962533 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6c1d9b640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c415e8e0 0x7fe6c40ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6c2d9d640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6c4162350 0x7fe6c415ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6c259c640 1 -- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6c4162350 msgr2=0x7fe6c415ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6c259c640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6c4162350 0x7fe6c415ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6c259c640 1 -- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c415e8e0 msgr2=0x7fe6c40ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6c259c640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c415e8e0 0x7fe6c40ab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6c259c640 1 -- 172.21.15.50:0/2383962533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c40cb8c0 con 0x7fe6c40d1c90 2024-09-11T22:22:34.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6c1d9b640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c415e8e0 0x7fe6c40ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6c2d9d640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6c4162350 0x7fe6c415ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6c259c640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c40d1c90 0x7fe6c415c830 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400c7f0 tx=0x7fe6b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6b2ffd640 1 -- 172.21.15.50:0/2383962533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4016020 con 0x7fe6c40d1c90 2024-09-11T22:22:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6b2ffd640 1 -- 172.21.15.50:0/2383962533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b400aa50 con 0x7fe6c40d1c90 2024-09-11T22:22:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/2383962533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c40cbb60 con 0x7fe6c40d1c90 2024-09-11T22:22:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6b2ffd640 1 -- 172.21.15.50:0/2383962533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400ae40 con 0x7fe6c40d1c90 2024-09-11T22:22:34.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.017+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/2383962533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c40cc120 con 0x7fe6c40d1c90 2024-09-11T22:22:34.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.018+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/2383962533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c40b7880 con 0x7fe6c40d1c90 2024-09-11T22:22:34.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.019+0000 7fe6b2ffd640 1 -- 172.21.15.50:0/2383962533 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6b4019020 con 0x7fe6c40d1c90 2024-09-11T22:22:34.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.019+0000 7fe6b2ffd640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6a406be30 0x7fe6a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.019+0000 7fe6b2ffd640 1 -- 172.21.15.50:0/2383962533 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7fe6b408ab10 con 0x7fe6c40d1c90 2024-09-11T22:22:34.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.019+0000 7fe6c1d9b640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6a406be30 0x7fe6a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.020+0000 7fe6c1d9b640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6a406be30 0x7fe6a406e2f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8006fd0 tx=0x7fe6b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:34.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.024+0000 7fe6b2ffd640 1 -- 172.21.15.50:0/2383962533 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6b4020070 con 0x7fe6c40d1c90 2024-09-11T22:22:34.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.201+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/2383962533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6c40b8f10 con 0x7fe6c40d1c90 2024-09-11T22:22:34.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.203+0000 7fe6b2ffd640 1 -- 172.21.15.50:0/2383962533 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) ==== 74+0+16720 (secure 0 0 0) 0x7fe6b4059550 con 0x7fe6c40d1c90 2024-09-11T22:22:34.204 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:34.204 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":177,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:22:33.219473+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:22:31.181552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-11T22:22:32.207726+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:22:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.205+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6a406be30 msgr2=0x7fe6a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.205+0000 7fe6c8ee6640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6a406be30 0x7fe6a406e2f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8006fd0 tx=0x7fe6b8008040 comp rx=0 tx=0).stop 2024-09-11T22:22:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.205+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/2383962533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c40d1c90 msgr2=0x7fe6c415c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.205+0000 7fe6c8ee6640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c40d1c90 0x7fe6c415c830 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400c7f0 tx=0x7fe6b400ccb0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.205+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/2383962533 shutdown_connections 2024-09-11T22:22:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.205+0000 7fe6c8ee6640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe6a406be30 0x7fe6a406e2f0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.205+0000 7fe6c8ee6640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6c4162350 0x7fe6c415ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.205+0000 7fe6c8ee6640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c415e8e0 0x7fe6c40ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.205+0000 7fe6c8ee6640 1 --2- 172.21.15.50:0/2383962533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6c40d1c90 0x7fe6c415c830 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.205+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/2383962533 >> 172.21.15.50:0/2383962533 conn(0x7fe6c4067ba0 msgr2=0x7fe6c4067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.205+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/2383962533 shutdown_connections 2024-09-11T22:22:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.205+0000 7fe6c8ee6640 1 -- 172.21.15.50:0/2383962533 wait complete. 2024-09-11T22:22:34.217 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:22:34.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.318+0000 7fad0f25c640 1 Processor -- start 2024-09-11T22:22:34.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.318+0000 7fad0f25c640 1 -- start start 2024-09-11T22:22:34.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.319+0000 7fad0f25c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0815c2c0 0x7fad080b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.319+0000 7fad0f25c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fad080b3e10 0x7fad080cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.319+0000 7fad0f25c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad080b4f00 con 0x7fad080d0410 2024-09-11T22:22:34.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.319+0000 7fad0f25c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fad080cf7a0 con 0x7fad080b3e10 2024-09-11T22:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.319+0000 7fad0f25c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fad080d0840 con 0x7fad0815c2c0 2024-09-11T22:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.319+0000 7fad0cff8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0815c2c0 0x7fad080b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.319+0000 7fad07fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fad080b3e10 0x7fad080cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.319+0000 7fad0cff8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0815c2c0 0x7fad080b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:36776/0 (socket says 172.21.15.50:36776) 2024-09-11T22:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.319+0000 7fad0cff8640 1 -- 172.21.15.50:0/3632091082 learned_addr learned my addr 172.21.15.50:0/3632091082 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.319+0000 7fad0d7f9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fad080d0410 0x7fad0815fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:48658/0 (socket says 172.21.15.50:48658) 2024-09-11T22:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.319+0000 7fad07fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fad080b3e10 0x7fad080cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:37508/0 (socket says 172.21.15.50:37508) 2024-09-11T22:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.320+0000 7fad077fe640 1 -- 172.21.15.50:0/3632091082 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419689406 0 0) 0x7fad080b4f00 con 0x7fad080d0410 2024-09-11T22:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.320+0000 7fad077fe640 1 -- 172.21.15.50:0/3632091082 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf0003520 con 0x7fad080d0410 2024-09-11T22:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.320+0000 7fad0cff8640 1 -- 172.21.15.50:0/3632091082 >> v2:172.21.15.77:3300/0 conn(0x7fad080b3e10 msgr2=0x7fad080cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.320+0000 7fad0cff8640 1 --2- 172.21.15.50:0/3632091082 >> v2:172.21.15.77:3300/0 conn(0x7fad080b3e10 0x7fad080cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.320+0000 7fad0cff8640 1 -- 172.21.15.50:0/3632091082 >> v1:172.21.15.77:6789/0 conn(0x7fad080d0410 legacy=0x7fad0815fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.320+0000 7fad0cff8640 1 -- 172.21.15.50:0/3632091082 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad080b4360 con 0x7fad0815c2c0 2024-09-11T22:22:34.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.320+0000 7fad07fff640 1 --2- 172.21.15.50:0/3632091082 >> v2:172.21.15.77:3300/0 conn(0x7fad080b3e10 0x7fad080cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:34.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.321+0000 7fad0cff8640 1 --2- 172.21.15.50:0/3632091082 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0815c2c0 0x7fad080b46a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7facf8009870 tx=0x7facf802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=942e0c6665aa6cab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:34.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.321+0000 7fad077fe640 1 -- 172.21.15.50:0/3632091082 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8037070 con 0x7fad0815c2c0 2024-09-11T22:22:34.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.321+0000 7fad077fe640 1 -- 172.21.15.50:0/3632091082 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf8032440 con 0x7fad0815c2c0 2024-09-11T22:22:34.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.321+0000 7fad077fe640 1 -- 172.21.15.50:0/3632091082 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf80327f0 con 0x7fad0815c2c0 2024-09-11T22:22:34.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.321+0000 7fad0f25c640 1 -- 172.21.15.50:0/3632091082 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0815c2c0 msgr2=0x7fad080b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.321+0000 7fad0f25c640 1 --2- 172.21.15.50:0/3632091082 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0815c2c0 0x7fad080b46a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7facf8009870 tx=0x7facf802a1c0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.321+0000 7fad0f25c640 1 -- 172.21.15.50:0/3632091082 shutdown_connections 2024-09-11T22:22:34.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.321+0000 7fad0f25c640 1 --2- 172.21.15.50:0/3632091082 >> v2:172.21.15.77:3300/0 conn(0x7fad080b3e10 0x7fad080cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.321+0000 7fad0f25c640 1 --2- 172.21.15.50:0/3632091082 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0815c2c0 0x7fad080b46a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.321+0000 7fad0f25c640 1 -- 172.21.15.50:0/3632091082 >> 172.21.15.50:0/3632091082 conn(0x7fad080679c0 msgr2=0x7fad08067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:34.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.321+0000 7fad0f25c640 1 -- 172.21.15.50:0/3632091082 shutdown_connections 2024-09-11T22:22:34.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.321+0000 7fad0f25c640 1 -- 172.21.15.50:0/3632091082 wait complete. 2024-09-11T22:22:34.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.322+0000 7fad0f25c640 1 Processor -- start 2024-09-11T22:22:34.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.323+0000 7fad0f25c640 1 -- start start 2024-09-11T22:22:34.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.323+0000 7fad0f25c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad080b3e10 0x7fad0814c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.323+0000 7fad0f25c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad080d0410 0x7fad08144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.323+0000 7fad0f25c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0815c2c0 0x7fad081589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.323+0000 7fad0f25c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fad080cfc10 con 0x7fad080d0410 2024-09-11T22:22:34.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.323+0000 7fad0f25c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad080b54a0 con 0x7fad080b3e10 2024-09-11T22:22:34.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.323+0000 7fad0f25c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fad080ce200 con 0x7fad0815c2c0 2024-09-11T22:22:34.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad07fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad080d0410 0x7fad08144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad07fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad080d0410 0x7fad08144740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47992/0 (socket says 172.21.15.50:47992) 2024-09-11T22:22:34.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad07fff640 1 -- 172.21.15.50:0/2076787619 learned_addr learned my addr 172.21.15.50:0/2076787619 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:34.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad0d7f9640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0815c2c0 0x7fad081589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad0cff8640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad080b3e10 0x7fad0814c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad07fff640 1 -- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0815c2c0 msgr2=0x7fad081589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad07fff640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0815c2c0 0x7fad081589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad07fff640 1 -- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad080b3e10 msgr2=0x7fad0814c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad07fff640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad080b3e10 0x7fad0814c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad07fff640 1 -- 172.21.15.50:0/2076787619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad08144c80 con 0x7fad080d0410 2024-09-11T22:22:34.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad07fff640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad080d0410 0x7fad08144740 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7facfc00e960 tx=0x7facfc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:34.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad057fa640 1 -- 172.21.15.50:0/2076787619 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc017070 con 0x7fad080d0410 2024-09-11T22:22:34.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad057fa640 1 -- 172.21.15.50:0/2076787619 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facfc00ca00 con 0x7fad080d0410 2024-09-11T22:22:34.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad0f25c640 1 -- 172.21.15.50:0/2076787619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad081593e0 con 0x7fad080d0410 2024-09-11T22:22:34.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad057fa640 1 -- 172.21.15.50:0/2076787619 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc00cdd0 con 0x7fad080d0410 2024-09-11T22:22:34.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.324+0000 7fad0f25c640 1 -- 172.21.15.50:0/2076787619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0814c030 con 0x7fad080d0410 2024-09-11T22:22:34.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.325+0000 7fad0f25c640 1 -- 172.21.15.50:0/2076787619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0806d830 con 0x7fad080d0410 2024-09-11T22:22:34.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.326+0000 7fad057fa640 1 -- 172.21.15.50:0/2076787619 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7facfc01a070 con 0x7fad080d0410 2024-09-11T22:22:34.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.326+0000 7fad057fa640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7facf406be60 0x7facf406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.326+0000 7fad057fa640 1 -- 172.21.15.50:0/2076787619 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7facfc08ab90 con 0x7fad080d0410 2024-09-11T22:22:34.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.327+0000 7fad0cff8640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7facf406be60 0x7facf406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.327+0000 7fad0cff8640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7facf406be60 0x7facf406e320 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7facf8034000 tx=0x7facf802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:34.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.331+0000 7fad057fa640 1 -- 172.21.15.50:0/2076787619 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7facfc058f80 con 0x7fad080d0410 2024-09-11T22:22:34.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.506+0000 7fad0f25c640 1 -- 172.21.15.50:0/2076787619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad080b04a0 con 0x7fad080d0410 2024-09-11T22:22:34.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.507+0000 7fad057fa640 1 -- 172.21.15.50:0/2076787619 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) ==== 74+0+16720 (secure 0 0 0) 0x7facfc05d280 con 0x7fad080d0410 2024-09-11T22:22:34.508 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:34.508 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":177,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:22:33.219473+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:22:31.181552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-11T22:22:32.207726+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:22:34.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.509+0000 7fad0f25c640 1 -- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7facf406be60 msgr2=0x7facf406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.509+0000 7fad0f25c640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7facf406be60 0x7facf406e320 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7facf8034000 tx=0x7facf802e000 comp rx=0 tx=0).stop 2024-09-11T22:22:34.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.509+0000 7fad0f25c640 1 -- 172.21.15.50:0/2076787619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad080d0410 msgr2=0x7fad08144740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.509+0000 7fad0f25c640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad080d0410 0x7fad08144740 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7facfc00e960 tx=0x7facfc00ee20 comp rx=0 tx=0).stop 2024-09-11T22:22:34.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.509+0000 7fad0f25c640 1 -- 172.21.15.50:0/2076787619 shutdown_connections 2024-09-11T22:22:34.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.509+0000 7fad0f25c640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7facf406be60 0x7facf406e320 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.509+0000 7fad0f25c640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0815c2c0 0x7fad081589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.509+0000 7fad0f25c640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad080d0410 0x7fad08144740 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.509+0000 7fad0f25c640 1 --2- 172.21.15.50:0/2076787619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad080b3e10 0x7fad0814c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.509+0000 7fad0f25c640 1 -- 172.21.15.50:0/2076787619 >> 172.21.15.50:0/2076787619 conn(0x7fad080679c0 msgr2=0x7fad0806dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:34.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.509+0000 7fad0f25c640 1 -- 172.21.15.50:0/2076787619 shutdown_connections 2024-09-11T22:22:34.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.509+0000 7fad0f25c640 1 -- 172.21.15.50:0/2076787619 wait complete. 2024-09-11T22:22:34.521 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:22:34.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.627+0000 7f4d5d5d8640 1 Processor -- start 2024-09-11T22:22:34.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.627+0000 7f4d5d5d8640 1 -- start start 2024-09-11T22:22:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.627+0000 7f4d5d5d8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d58162a60 0x7f4d580b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.628+0000 7f4d5d5d8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d58163080 con 0x7f4d580d1c90 2024-09-11T22:22:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.628+0000 7f4d5d5d8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d580d2d20 con 0x7f4d5815e8e0 2024-09-11T22:22:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.628+0000 7f4d5d5d8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4d5815ecc0 con 0x7f4d58162a60 2024-09-11T22:22:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.628+0000 7f4d577fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d58162a60 0x7f4d580b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.628+0000 7f4d577fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d58162a60 0x7f4d580b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48006/0 (socket says 172.21.15.50:48006) 2024-09-11T22:22:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.628+0000 7f4d567fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4d580d1c90 0x7f4d58162350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39254/0 (socket says 172.21.15.50:39254) 2024-09-11T22:22:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.628+0000 7f4d577fe640 1 -- 172.21.15.50:0/3971267625 learned_addr learned my addr 172.21.15.50:0/3971267625 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.628+0000 7f4d577fe640 1 -- 172.21.15.50:0/3971267625 >> v1:172.21.15.77:6789/0 conn(0x7f4d5815e8e0 legacy=0x7f4d580d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.628+0000 7f4d577fe640 1 -- 172.21.15.50:0/3971267625 >> v1:172.21.15.50:6789/0 conn(0x7f4d580d1c90 legacy=0x7f4d58162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.628+0000 7f4d577fe640 1 -- 172.21.15.50:0/3971267625 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d580d3000 con 0x7f4d58162a60 2024-09-11T22:22:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.629+0000 7f4d577fe640 1 --2- 172.21.15.50:0/3971267625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d58162a60 0x7f4d580b7880 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009e50 tx=0x7f4d5002a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d801e64c696925ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.629+0000 7f4d55ffb640 1 -- 172.21.15.50:0/3971267625 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d50033610 con 0x7f4d58162a60 2024-09-11T22:22:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.629+0000 7f4d55ffb640 1 -- 172.21.15.50:0/3971267625 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5002f070 con 0x7f4d58162a60 2024-09-11T22:22:34.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.629+0000 7f4d55ffb640 1 -- 172.21.15.50:0/3971267625 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d500339d0 con 0x7f4d58162a60 2024-09-11T22:22:34.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.629+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/3971267625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d58162a60 msgr2=0x7f4d580b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.629+0000 7f4d5d5d8640 1 --2- 172.21.15.50:0/3971267625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d58162a60 0x7f4d580b7880 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009e50 tx=0x7f4d5002a810 comp rx=0 tx=0).stop 2024-09-11T22:22:34.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.629+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/3971267625 shutdown_connections 2024-09-11T22:22:34.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.629+0000 7f4d5d5d8640 1 --2- 172.21.15.50:0/3971267625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d58162a60 0x7f4d580b7880 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.629+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/3971267625 >> 172.21.15.50:0/3971267625 conn(0x7f4d58067ba0 msgr2=0x7f4d58067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:34.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.629+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/3971267625 shutdown_connections 2024-09-11T22:22:34.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.629+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/3971267625 wait complete. 2024-09-11T22:22:34.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.631+0000 7f4d5d5d8640 1 Processor -- start 2024-09-11T22:22:34.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.631+0000 7f4d5d5d8640 1 -- start start 2024-09-11T22:22:34.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d5d5d8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d580d1c90 0x7f4d5815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d5d5d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5815e8e0 0x7f4d580ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d5d5d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d58162a60 0x7f4d580acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d5d5d8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d580d3c10 con 0x7f4d5815e8e0 2024-09-11T22:22:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d5d5d8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d580d3a90 con 0x7f4d58162a60 2024-09-11T22:22:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d5d5d8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d580d3d90 con 0x7f4d580d1c90 2024-09-11T22:22:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d567fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5815e8e0 0x7f4d580ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d567fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5815e8e0 0x7f4d580ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48008/0 (socket says 172.21.15.50:48008) 2024-09-11T22:22:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d567fc640 1 -- 172.21.15.50:0/4293186716 learned_addr learned my addr 172.21.15.50:0/4293186716 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d56ffd640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d580d1c90 0x7f4d5815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d577fe640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d58162a60 0x7f4d580acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d567fc640 1 -- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d580d1c90 msgr2=0x7f4d5815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d567fc640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d580d1c90 0x7f4d5815c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d567fc640 1 -- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d58162a60 msgr2=0x7f4d580acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d567fc640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d58162a60 0x7f4d580acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d567fc640 1 -- 172.21.15.50:0/4293186716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d580cb8c0 con 0x7f4d5815e8e0 2024-09-11T22:22:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d577fe640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d58162a60 0x7f4d580acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d567fc640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5815e8e0 0x7f4d580ccc40 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00c400 tx=0x7f4d4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d3f7fe640 1 -- 172.21.15.50:0/4293186716 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c0074e0 con 0x7f4d5815e8e0 2024-09-11T22:22:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d3f7fe640 1 -- 172.21.15.50:0/4293186716 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4c007680 con 0x7f4d5815e8e0 2024-09-11T22:22:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d3f7fe640 1 -- 172.21.15.50:0/4293186716 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c004a00 con 0x7f4d5815e8e0 2024-09-11T22:22:34.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.632+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/4293186716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d580cbba0 con 0x7f4d5815e8e0 2024-09-11T22:22:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.633+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/4293186716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d580cc160 con 0x7f4d5815e8e0 2024-09-11T22:22:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.634+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/4293186716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d580b7880 con 0x7f4d5815e8e0 2024-09-11T22:22:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.634+0000 7f4d3f7fe640 1 -- 172.21.15.50:0/4293186716 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d4c01a020 con 0x7f4d5815e8e0 2024-09-11T22:22:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.635+0000 7f4d3f7fe640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d4406be30 0x7f4d4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.635+0000 7f4d3f7fe640 1 -- 172.21.15.50:0/4293186716 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7f4d4c08a6c0 con 0x7f4d5815e8e0 2024-09-11T22:22:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.635+0000 7f4d56ffd640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d4406be30 0x7f4d4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.636+0000 7f4d56ffd640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d4406be30 0x7f4d4406e2f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4d48007fd0 tx=0x7f4d48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:34.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.639+0000 7f4d3f7fe640 1 -- 172.21.15.50:0/4293186716 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d4c059070 con 0x7f4d5815e8e0 2024-09-11T22:22:34.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.848+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/4293186716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4d580ba770 con 0x7f4d5815e8e0 2024-09-11T22:22:34.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.870+0000 7f4d3f7fe640 1 -- 172.21.15.50:0/4293186716 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v129) ==== 118+0+0 (secure 0 0 0) 0x7f4d4c058970 con 0x7f4d5815e8e0 2024-09-11T22:22:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.872+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d4406be30 msgr2=0x7f4d4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.872+0000 7f4d5d5d8640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d4406be30 0x7f4d4406e2f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4d48007fd0 tx=0x7f4d48009040 comp rx=0 tx=0).stop 2024-09-11T22:22:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.872+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/4293186716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5815e8e0 msgr2=0x7f4d580ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.872+0000 7f4d5d5d8640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5815e8e0 0x7f4d580ccc40 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00c400 tx=0x7f4d4c00c8c0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.872+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/4293186716 shutdown_connections 2024-09-11T22:22:34.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.872+0000 7f4d5d5d8640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4d4406be30 0x7f4d4406e2f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.872+0000 7f4d5d5d8640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d58162a60 0x7f4d580acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.872+0000 7f4d5d5d8640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d5815e8e0 0x7f4d580ccc40 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.872+0000 7f4d5d5d8640 1 --2- 172.21.15.50:0/4293186716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d580d1c90 0x7f4d5815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.872+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/4293186716 >> 172.21.15.50:0/4293186716 conn(0x7f4d58067ba0 msgr2=0x7f4d5815fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:34.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.872+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/4293186716 shutdown_connections 2024-09-11T22:22:34.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.872+0000 7f4d5d5d8640 1 -- 172.21.15.50:0/4293186716 wait complete. 2024-09-11T22:22:34.884 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:22:34.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:22:34.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.988+0000 7fac0878d640 1 Processor -- start 2024-09-11T22:22:34.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.988+0000 7fac0878d640 1 -- start start 2024-09-11T22:22:34.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.989+0000 7fac0878d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac0015b400 0x7fac0006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.989+0000 7fac0878d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac0015b7e0 con 0x7fac00072e60 2024-09-11T22:22:34.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.989+0000 7fac0878d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac0015f140 con 0x7fac0006e0f0 2024-09-11T22:22:34.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.989+0000 7fac0878d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fac0015f420 con 0x7fac0015b400 2024-09-11T22:22:34.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.989+0000 7fac06529640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac0015b400 0x7fac0006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.989+0000 7fac06529640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac0015b400 0x7fac0006d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48024/0 (socket says 172.21.15.50:48024) 2024-09-11T22:22:34.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.989+0000 7fac05d28640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fac00072e60 0x7fac0006d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39270/0 (socket says 172.21.15.50:39270) 2024-09-11T22:22:34.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.989+0000 7fac06529640 1 -- 172.21.15.50:0/3097441998 learned_addr learned my addr 172.21.15.50:0/3097441998 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:34.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.990+0000 7fac06529640 1 -- 172.21.15.50:0/3097441998 >> v1:172.21.15.77:6789/0 conn(0x7fac0006e0f0 legacy=0x7fac000711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:34.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.990+0000 7fac06529640 1 -- 172.21.15.50:0/3097441998 >> v1:172.21.15.50:6789/0 conn(0x7fac00072e60 legacy=0x7fac0006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.990+0000 7fac06529640 1 -- 172.21.15.50:0/3097441998 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0015f700 con 0x7fac0015b400 2024-09-11T22:22:34.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.990+0000 7fac05527640 1 -- 172.21.15.50:0/3097441998 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4080061828 0 0) 0x7fac0015b7e0 con 0x7fac00072e60 2024-09-11T22:22:34.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.990+0000 7fac06529640 1 --2- 172.21.15.50:0/3097441998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0015b400 0x7fac0006d070 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009870 tx=0x7fabf802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5213dc86e3982ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:34.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.990+0000 7fac05527640 1 -- 172.21.15.50:0/3097441998 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8037070 con 0x7fac0015b400 2024-09-11T22:22:34.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.990+0000 7fac05527640 1 -- 172.21.15.50:0/3097441998 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf8032440 con 0x7fac0015b400 2024-09-11T22:22:34.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.990+0000 7fac05527640 1 -- 172.21.15.50:0/3097441998 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8032810 con 0x7fac0015b400 2024-09-11T22:22:34.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.991+0000 7fac0878d640 1 -- 172.21.15.50:0/3097441998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0015b400 msgr2=0x7fac0006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.991+0000 7fac0878d640 1 --2- 172.21.15.50:0/3097441998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0015b400 0x7fac0006d070 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009870 tx=0x7fabf802a2a0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.991+0000 7fac0878d640 1 -- 172.21.15.50:0/3097441998 shutdown_connections 2024-09-11T22:22:34.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.991+0000 7fac0878d640 1 --2- 172.21.15.50:0/3097441998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0015b400 0x7fac0006d070 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.991+0000 7fac0878d640 1 -- 172.21.15.50:0/3097441998 >> 172.21.15.50:0/3097441998 conn(0x7fac000679c0 msgr2=0x7fac00067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:34.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.991+0000 7fac0878d640 1 -- 172.21.15.50:0/3097441998 shutdown_connections 2024-09-11T22:22:34.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.991+0000 7fac0878d640 1 -- 172.21.15.50:0/3097441998 wait complete. 2024-09-11T22:22:34.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.992+0000 7fac0878d640 1 Processor -- start 2024-09-11T22:22:34.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.992+0000 7fac0878d640 1 -- start start 2024-09-11T22:22:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.993+0000 7fac0878d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0006e0f0 0x7fac000aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.993+0000 7fac0878d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac00072e60 0x7fac00148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.993+0000 7fac0878d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac0015b400 0x7fac000b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.993+0000 7fac0878d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fac000718d0 con 0x7fac0006e0f0 2024-09-11T22:22:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.993+0000 7fac0878d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fac000cfc50 con 0x7fac00072e60 2024-09-11T22:22:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.993+0000 7fac0878d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fac00071a50 con 0x7fac0015b400 2024-09-11T22:22:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.993+0000 7fac06529640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0006e0f0 0x7fac000aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.993+0000 7fac06529640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0006e0f0 0x7fac000aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48032/0 (socket says 172.21.15.50:48032) 2024-09-11T22:22:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.993+0000 7fac06529640 1 -- 172.21.15.50:0/2937772283 learned_addr learned my addr 172.21.15.50:0/2937772283 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.993+0000 7fac05d28640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac00072e60 0x7fac00148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.994+0000 7fac06d2a640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac0015b400 0x7fac000b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.994+0000 7fac06529640 1 -- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac0015b400 msgr2=0x7fac000b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.994+0000 7fac06529640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac0015b400 0x7fac000b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.994+0000 7fac06529640 1 -- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac00072e60 msgr2=0x7fac00148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.994+0000 7fac06529640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac00072e60 0x7fac00148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.994+0000 7fac06529640 1 -- 172.21.15.50:0/2937772283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac000adf20 con 0x7fac0006e0f0 2024-09-11T22:22:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.994+0000 7fac06d2a640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac0015b400 0x7fac000b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.994+0000 7fac06529640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0006e0f0 0x7fac000aef60 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fabf8000c00 tx=0x7fabf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.994+0000 7fabfeffd640 1 -- 172.21.15.50:0/2937772283 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8041070 con 0x7fac0006e0f0 2024-09-11T22:22:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.994+0000 7fabfeffd640 1 -- 172.21.15.50:0/2937772283 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf803c870 con 0x7fac0006e0f0 2024-09-11T22:22:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.994+0000 7fac0878d640 1 -- 172.21.15.50:0/2937772283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac00149340 con 0x7fac0006e0f0 2024-09-11T22:22:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.994+0000 7fabfeffd640 1 -- 172.21.15.50:0/2937772283 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8037040 con 0x7fac0006e0f0 2024-09-11T22:22:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.994+0000 7fac0878d640 1 -- 172.21.15.50:0/2937772283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac000ae480 con 0x7fac0006e0f0 2024-09-11T22:22:34.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.995+0000 7fac0878d640 1 -- 172.21.15.50:0/2937772283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac000afc80 con 0x7fac0006e0f0 2024-09-11T22:22:34.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.996+0000 7fabfeffd640 1 -- 172.21.15.50:0/2937772283 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fabf8044070 con 0x7fac0006e0f0 2024-09-11T22:22:34.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.996+0000 7fabfeffd640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fabec06be30 0x7fabec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:34.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.996+0000 7fabfeffd640 1 -- 172.21.15.50:0/2937772283 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7fabf80ab8e0 con 0x7fac0006e0f0 2024-09-11T22:22:34.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.996+0000 7fac05d28640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fabec06be30 0x7fabec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:34.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:34.997+0000 7fac05d28640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fabec06be30 0x7fabec06e2f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fac0014c7b0 tx=0x7fabf4007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:35.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.001+0000 7fabfeffd640 1 -- 172.21.15.50:0/2937772283 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac000afc80 con 0x7fac0006e0f0 2024-09-11T22:22:35.161 INFO:tasks.ceph.mds.c.smithi050.stderr:2024-09-11T22:22:35.160+0000 7f99d3ab9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:22:35.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.215+0000 7fac0878d640 1 -- 172.21.15.50:0/2937772283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fac000ccd10 con 0x7fac0006e0f0 2024-09-11T22:22:35.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.875+0000 7fabfeffd640 1 -- 172.21.15.50:0/2937772283 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v130) ==== 122+0+0 (secure 0 0 0) 0x7fac00149340 con 0x7fac0006e0f0 2024-09-11T22:22:35.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.878+0000 7fac0878d640 1 -- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fabec06be30 msgr2=0x7fabec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:35.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.878+0000 7fac0878d640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fabec06be30 0x7fabec06e2f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fac0014c7b0 tx=0x7fabf4007b50 comp rx=0 tx=0).stop 2024-09-11T22:22:35.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.878+0000 7fac0878d640 1 -- 172.21.15.50:0/2937772283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0006e0f0 msgr2=0x7fac000aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:35.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.878+0000 7fac0878d640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0006e0f0 0x7fac000aef60 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fabf8000c00 tx=0x7fabf80046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:35.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.878+0000 7fac0878d640 1 -- 172.21.15.50:0/2937772283 shutdown_connections 2024-09-11T22:22:35.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.878+0000 7fac0878d640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fabec06be30 0x7fabec06e2f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:35.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.878+0000 7fac0878d640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac0015b400 0x7fac000b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:35.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.878+0000 7fac0878d640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac00072e60 0x7fac00148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:35.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.878+0000 7fac0878d640 1 --2- 172.21.15.50:0/2937772283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac0006e0f0 0x7fac000aef60 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:35.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.878+0000 7fac0878d640 1 -- 172.21.15.50:0/2937772283 >> 172.21.15.50:0/2937772283 conn(0x7fac000679c0 msgr2=0x7fac001597a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:35.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.878+0000 7fac0878d640 1 -- 172.21.15.50:0/2937772283 shutdown_connections 2024-09-11T22:22:35.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:35.878+0000 7fac0878d640 1 -- 172.21.15.50:0/2937772283 wait complete. 2024-09-11T22:22:35.892 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:22:35.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:22:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.001+0000 7f6ac2b31640 1 Processor -- start 2024-09-11T22:22:36.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.001+0000 7f6ac2b31640 1 -- start start 2024-09-11T22:22:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.002+0000 7f6ac2b31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6abc161d30 0x7f6abc0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.002+0000 7f6ac2b31640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6abc0b78f0 0x7f6abc162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.002+0000 7f6ac2b31640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc1632e0 con 0x7f6abc0d11d0 2024-09-11T22:22:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.002+0000 7f6ac2b31640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6abc0d3450 con 0x7f6abc0b78f0 2024-09-11T22:22:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.002+0000 7f6ac2b31640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6abc162110 con 0x7f6abc161d30 2024-09-11T22:22:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.002+0000 7f6ac10ce640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6abc0d11d0 0x7f6abc0d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39280/0 (socket says 172.21.15.50:39280) 2024-09-11T22:22:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.002+0000 7f6ac10ce640 1 -- 172.21.15.50:0/662402936 learned_addr learned my addr 172.21.15.50:0/662402936 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.002+0000 7f6ac08cd640 1 --2- 172.21.15.50:0/662402936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6abc161d30 0x7f6abc0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.002+0000 7f6abbfff640 1 --2- 172.21.15.50:0/662402936 >> v2:172.21.15.77:3300/0 conn(0x7f6abc0b78f0 0x7f6abc162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.003+0000 7f6abb7fe640 1 -- 172.21.15.50:0/662402936 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697401250 0 0) 0x7f6abc1632e0 con 0x7f6abc0d11d0 2024-09-11T22:22:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.003+0000 7f6abb7fe640 1 -- 172.21.15.50:0/662402936 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa4003520 con 0x7f6abc0d11d0 2024-09-11T22:22:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.003+0000 7f6abbfff640 1 -- 172.21.15.50:0/662402936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6abc161d30 msgr2=0x7f6abc0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.003+0000 7f6abbfff640 1 --2- 172.21.15.50:0/662402936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6abc161d30 0x7f6abc0cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.003+0000 7f6abbfff640 1 -- 172.21.15.50:0/662402936 >> v1:172.21.15.50:6789/0 conn(0x7f6abc0d11d0 legacy=0x7f6abc0d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.003+0000 7f6abbfff640 1 -- 172.21.15.50:0/662402936 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc0cfd70 con 0x7f6abc0b78f0 2024-09-11T22:22:36.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.003+0000 7f6ac08cd640 1 --2- 172.21.15.50:0/662402936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6abc161d30 0x7f6abc0cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.004+0000 7f6abbfff640 1 --2- 172.21.15.50:0/662402936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6abc0b78f0 0x7f6abc162da0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00097a0 tx=0x7f6ab002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=378487cbddcd6137 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.004+0000 7f6abb7fe640 1 -- 172.21.15.50:0/662402936 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0037070 con 0x7f6abc0b78f0 2024-09-11T22:22:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.004+0000 7f6abb7fe640 1 -- 172.21.15.50:0/662402936 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab0032440 con 0x7f6abc0b78f0 2024-09-11T22:22:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.004+0000 7f6abb7fe640 1 -- 172.21.15.50:0/662402936 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00327f0 con 0x7f6abc0b78f0 2024-09-11T22:22:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.004+0000 7f6ac2b31640 1 -- 172.21.15.50:0/662402936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6abc0b78f0 msgr2=0x7f6abc162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.004+0000 7f6ac2b31640 1 --2- 172.21.15.50:0/662402936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6abc0b78f0 0x7f6abc162da0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00097a0 tx=0x7f6ab002a180 comp rx=0 tx=0).stop 2024-09-11T22:22:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.004+0000 7f6ac2b31640 1 -- 172.21.15.50:0/662402936 shutdown_connections 2024-09-11T22:22:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.004+0000 7f6ac2b31640 1 --2- 172.21.15.50:0/662402936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6abc0b78f0 0x7f6abc162da0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.004+0000 7f6ac2b31640 1 --2- 172.21.15.50:0/662402936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6abc161d30 0x7f6abc0cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.004+0000 7f6ac2b31640 1 -- 172.21.15.50:0/662402936 >> 172.21.15.50:0/662402936 conn(0x7f6abc0727a0 msgr2=0x7f6abc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.004+0000 7f6ac2b31640 1 -- 172.21.15.50:0/662402936 shutdown_connections 2024-09-11T22:22:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.004+0000 7f6ac2b31640 1 -- 172.21.15.50:0/662402936 wait complete. 2024-09-11T22:22:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.005+0000 7f6ac2b31640 1 Processor -- start 2024-09-11T22:22:36.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.005+0000 7f6ac2b31640 1 -- start start 2024-09-11T22:22:36.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.006+0000 7f6ac2b31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0b78f0 0x7f6abc15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.006+0000 7f6ac2b31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6abc0d11d0 0x7f6abc1f7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.006+0000 7f6ac2b31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6abc161d30 0x7f6abc1f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.006+0000 7f6ac2b31640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc0d30e0 con 0x7f6abc0b78f0 2024-09-11T22:22:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.006+0000 7f6ac2b31640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc0d2e00 con 0x7f6abc0d11d0 2024-09-11T22:22:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.006+0000 7f6ac2b31640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6abc0b7d30 con 0x7f6abc161d30 2024-09-11T22:22:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.006+0000 7f6ac08cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0b78f0 0x7f6abc15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ac08cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0b78f0 0x7f6abc15bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48042/0 (socket says 172.21.15.50:48042) 2024-09-11T22:22:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ac08cd640 1 -- 172.21.15.50:0/2889619735 learned_addr learned my addr 172.21.15.50:0/2889619735 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6abbfff640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6abc0d11d0 0x7f6abc1f7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ac10ce640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6abc161d30 0x7f6abc1f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ac08cd640 1 -- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6abc161d30 msgr2=0x7f6abc1f82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ac08cd640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6abc161d30 0x7f6abc1f82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ac08cd640 1 -- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6abc0d11d0 msgr2=0x7f6abc1f7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ac08cd640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6abc0d11d0 0x7f6abc1f7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ac08cd640 1 -- 172.21.15.50:0/2889619735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc0b52f0 con 0x7f6abc0b78f0 2024-09-11T22:22:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ac08cd640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0b78f0 0x7f6abc15bef0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00e960 tx=0x7f6aac00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ab97fa640 1 -- 172.21.15.50:0/2889619735 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac017070 con 0x7f6abc0b78f0 2024-09-11T22:22:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ab97fa640 1 -- 172.21.15.50:0/2889619735 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aac00ca00 con 0x7f6abc0b78f0 2024-09-11T22:22:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ab97fa640 1 -- 172.21.15.50:0/2889619735 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac00cdd0 con 0x7f6abc0b78f0 2024-09-11T22:22:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ac2b31640 1 -- 172.21.15.50:0/2889619735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6abc0b55d0 con 0x7f6abc0b78f0 2024-09-11T22:22:36.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.007+0000 7f6ac2b31640 1 -- 172.21.15.50:0/2889619735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6abc0b5b90 con 0x7f6abc0b78f0 2024-09-11T22:22:36.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.008+0000 7f6ac2b31640 1 -- 172.21.15.50:0/2889619735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6abc0cf790 con 0x7f6abc0b78f0 2024-09-11T22:22:36.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.009+0000 7f6ab97fa640 1 -- 172.21.15.50:0/2889619735 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6aac01a070 con 0x7f6abc0b78f0 2024-09-11T22:22:36.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.009+0000 7f6ab97fa640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6aa806be30 0x7f6aa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.009+0000 7f6ab97fa640 1 -- 172.21.15.50:0/2889619735 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f6aac08b0c0 con 0x7f6abc0b78f0 2024-09-11T22:22:36.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.010+0000 7f6abbfff640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6aa806be30 0x7f6aa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.010+0000 7f6abbfff640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6aa806be30 0x7f6aa806e2f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0034000 tx=0x7f6ab002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:36.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.014+0000 7f6ab97fa640 1 -- 172.21.15.50:0/2889619735 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6aac059380 con 0x7f6abc0b78f0 2024-09-11T22:22:36.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.224+0000 7f6ac2b31640 1 -- 172.21.15.50:0/2889619735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6abc0d2900 con 0x7f6abc0b78f0 2024-09-11T22:22:36.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.224+0000 7f6ab97fa640 1 -- 172.21.15.50:0/2889619735 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+5239 (secure 0 0 0) 0x7f6aac05d680 con 0x7f6abc0b78f0 2024-09-11T22:22:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:36.225 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":130,"btime":"2024-09-11T22:22:35:871475+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2188519592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2188519592},{"type":"v1","addr":"172.21.15.77:6836","nonce":2188519592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8165,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3754154405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3754154405},{"type":"v1","addr":"172.21.15.77:6837","nonce":3754154405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":127},{"gid":10317,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1024203584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1024203584},{"type":"v1","addr":"172.21.15.50:6833","nonce":1024203584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:22:33.219787+0000","modified":"2024-09-11T22:22:35.216759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10320":{"gid":10320,"name":"c","rank":0,"incarnation":128,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4092595783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4092595783},{"type":"v1","addr":"172.21.15.50:6835","nonce":4092595783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10320,"qdb_cluster":[10320]},"id":13}]} 2024-09-11T22:22:36.225 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 130 2024-09-11T22:22:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.226+0000 7f6ac2b31640 1 -- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6aa806be30 msgr2=0x7f6aa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.226+0000 7f6ac2b31640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6aa806be30 0x7f6aa806e2f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0034000 tx=0x7f6ab002e000 comp rx=0 tx=0).stop 2024-09-11T22:22:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.226+0000 7f6ac2b31640 1 -- 172.21.15.50:0/2889619735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0b78f0 msgr2=0x7f6abc15bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.226+0000 7f6ac2b31640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0b78f0 0x7f6abc15bef0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00e960 tx=0x7f6aac00ee20 comp rx=0 tx=0).stop 2024-09-11T22:22:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.226+0000 7f6ac2b31640 1 -- 172.21.15.50:0/2889619735 shutdown_connections 2024-09-11T22:22:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.226+0000 7f6ac2b31640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6aa806be30 0x7f6aa806e2f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.226+0000 7f6ac2b31640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6abc161d30 0x7f6abc1f82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.226+0000 7f6ac2b31640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6abc0d11d0 0x7f6abc1f7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.226+0000 7f6ac2b31640 1 --2- 172.21.15.50:0/2889619735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0b78f0 0x7f6abc15bef0 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.226+0000 7f6ac2b31640 1 -- 172.21.15.50:0/2889619735 >> 172.21.15.50:0/2889619735 conn(0x7f6abc0727a0 msgr2=0x7f6abc0b9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.226+0000 7f6ac2b31640 1 -- 172.21.15.50:0/2889619735 shutdown_connections 2024-09-11T22:22:36.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.226+0000 7f6ac2b31640 1 -- 172.21.15.50:0/2889619735 wait complete. 2024-09-11T22:22:36.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:22:36.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.340+0000 7f3ff27e4640 1 Processor -- start 2024-09-11T22:22:36.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.340+0000 7f3ff27e4640 1 -- start start 2024-09-11T22:22:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.340+0000 7f3ff27e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3fec15e870 0x7f3fec0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.340+0000 7f3ff27e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3fec0d16d0 0x7f3fec0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.340+0000 7f3ff27e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3fec0d3a30 0x7f3fec0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.340+0000 7f3ff27e4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f3fec0d3ea0 con 0x7f3fec0d3a30 2024-09-11T22:22:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.340+0000 7f3ff27e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3fec0d1b10 con 0x7f3fec0d16d0 2024-09-11T22:22:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.340+0000 7f3ff27e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3fec0cfa80 con 0x7f3fec15e870 2024-09-11T22:22:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.341+0000 7f3ff0d81640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3fec0d3a30 0x7f3fec0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.341+0000 7f3ff0d81640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3fec0d3a30 0x7f3fec0b6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48058/0 (socket says 172.21.15.50:48058) 2024-09-11T22:22:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.341+0000 7f3ff0d81640 1 -- 172.21.15.50:0/3410689202 learned_addr learned my addr 172.21.15.50:0/3410689202 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.341+0000 7f3febfff640 1 --2- 172.21.15.50:0/3410689202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3fec15e870 0x7f3fec0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.341+0000 7f3feb7fe640 1 --2- 172.21.15.50:0/3410689202 >> v2:172.21.15.77:3300/0 conn(0x7f3fec0d16d0 0x7f3fec0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.341+0000 7f3ff0d81640 1 -- 172.21.15.50:0/3410689202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3fec15e870 msgr2=0x7f3fec0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.341+0000 7f3ff0d81640 1 --2- 172.21.15.50:0/3410689202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3fec15e870 0x7f3fec0d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.341+0000 7f3ff0d81640 1 -- 172.21.15.50:0/3410689202 >> v2:172.21.15.77:3300/0 conn(0x7f3fec0d16d0 msgr2=0x7f3fec0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.341+0000 7f3ff0d81640 1 --2- 172.21.15.50:0/3410689202 >> v2:172.21.15.77:3300/0 conn(0x7f3fec0d16d0 0x7f3fec0d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.341+0000 7f3ff0d81640 1 -- 172.21.15.50:0/3410689202 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fec0d40d0 con 0x7f3fec0d3a30 2024-09-11T22:22:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.342+0000 7f3ff0d81640 1 --2- 172.21.15.50:0/3410689202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0d3a30 0x7f3fec0b6200 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0cfc30 tx=0x7f3fe402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86bf1b1cbe561f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.342+0000 7f3feaffd640 1 -- 172.21.15.50:0/3410689202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4036070 con 0x7f3fec0d3a30 2024-09-11T22:22:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.342+0000 7f3feaffd640 1 -- 172.21.15.50:0/3410689202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe4031600 con 0x7f3fec0d3a30 2024-09-11T22:22:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.342+0000 7f3feaffd640 1 -- 172.21.15.50:0/3410689202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40319d0 con 0x7f3fec0d3a30 2024-09-11T22:22:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.342+0000 7f3ff27e4640 1 -- 172.21.15.50:0/3410689202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0d3a30 msgr2=0x7f3fec0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.342+0000 7f3ff27e4640 1 --2- 172.21.15.50:0/3410689202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0d3a30 0x7f3fec0b6200 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0cfc30 tx=0x7f3fe402a680 comp rx=0 tx=0).stop 2024-09-11T22:22:36.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.342+0000 7f3ff27e4640 1 -- 172.21.15.50:0/3410689202 shutdown_connections 2024-09-11T22:22:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.342+0000 7f3ff27e4640 1 --2- 172.21.15.50:0/3410689202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0d3a30 0x7f3fec0b6200 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.342+0000 7f3ff27e4640 1 --2- 172.21.15.50:0/3410689202 >> v2:172.21.15.77:3300/0 conn(0x7f3fec0d16d0 0x7f3fec0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.342+0000 7f3ff27e4640 1 --2- 172.21.15.50:0/3410689202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3fec15e870 0x7f3fec0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.342+0000 7f3ff27e4640 1 -- 172.21.15.50:0/3410689202 >> 172.21.15.50:0/3410689202 conn(0x7f3fec0727a0 msgr2=0x7f3fec0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.342+0000 7f3ff27e4640 1 -- 172.21.15.50:0/3410689202 shutdown_connections 2024-09-11T22:22:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.342+0000 7f3ff27e4640 1 -- 172.21.15.50:0/3410689202 wait complete. 2024-09-11T22:22:36.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.344+0000 7f3ff27e4640 1 Processor -- start 2024-09-11T22:22:36.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.344+0000 7f3ff27e4640 1 -- start start 2024-09-11T22:22:36.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3ff27e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec0d16d0 0x7f3fec0ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3ff27e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0d3a30 0x7f3fec1f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3ff27e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3fec15e870 0x7f3fec0ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3ff27e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec0b7ee0 con 0x7f3fec0d3a30 2024-09-11T22:22:36.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3ff27e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec0b7c00 con 0x7f3fec0d16d0 2024-09-11T22:22:36.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3ff27e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3fec15ec50 con 0x7f3fec15e870 2024-09-11T22:22:36.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3feb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0d3a30 0x7f3fec1f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3feb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0d3a30 0x7f3fec1f7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48062/0 (socket says 172.21.15.50:48062) 2024-09-11T22:22:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3feb7fe640 1 -- 172.21.15.50:0/680895988 learned_addr learned my addr 172.21.15.50:0/680895988 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3febfff640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec0d16d0 0x7f3fec0ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3ff0d81640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3fec15e870 0x7f3fec0ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3feb7fe640 1 -- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3fec15e870 msgr2=0x7f3fec0ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3feb7fe640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3fec15e870 0x7f3fec0ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3feb7fe640 1 -- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec0d16d0 msgr2=0x7f3fec0ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3feb7fe640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec0d16d0 0x7f3fec0ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3feb7fe640 1 -- 172.21.15.50:0/680895988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fec1f8360 con 0x7f3fec0d3a30 2024-09-11T22:22:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3feb7fe640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0d3a30 0x7f3fec1f7e20 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000d800 tx=0x7f3fe000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3fe8ff9640 1 -- 172.21.15.50:0/680895988 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0018030 con 0x7f3fec0d3a30 2024-09-11T22:22:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3fe8ff9640 1 -- 172.21.15.50:0/680895988 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe0004020 con 0x7f3fec0d3a30 2024-09-11T22:22:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3ff27e4640 1 -- 172.21.15.50:0/680895988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fec1f8600 con 0x7f3fec0d3a30 2024-09-11T22:22:36.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.345+0000 7f3fe8ff9640 1 -- 172.21.15.50:0/680895988 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00041f0 con 0x7f3fec0d3a30 2024-09-11T22:22:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.346+0000 7f3ff27e4640 1 -- 172.21.15.50:0/680895988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fec1f8bc0 con 0x7f3fec0d3a30 2024-09-11T22:22:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.347+0000 7f3ff27e4640 1 -- 172.21.15.50:0/680895988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fec0b78b0 con 0x7f3fec0d3a30 2024-09-11T22:22:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.347+0000 7f3fe8ff9640 1 -- 172.21.15.50:0/680895988 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3fe001b070 con 0x7f3fec0d3a30 2024-09-11T22:22:36.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.347+0000 7f3fe8ff9640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3fd806be60 0x7f3fd806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.347+0000 7f3fe8ff9640 1 -- 172.21.15.50:0/680895988 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f3fe008ae50 con 0x7f3fec0d3a30 2024-09-11T22:22:36.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.348+0000 7f3febfff640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3fd806be60 0x7f3fd806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.348+0000 7f3febfff640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3fd806be60 0x7f3fd806e320 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0079a0 tx=0x7f3fdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:36.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.352+0000 7f3fe8ff9640 1 -- 172.21.15.50:0/680895988 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3fe00591b0 con 0x7f3fec0d3a30 2024-09-11T22:22:36.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.529+0000 7f3ff27e4640 1 -- 172.21.15.50:0/680895988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fec0b9520 con 0x7f3fec0d3a30 2024-09-11T22:22:36.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.530+0000 7f3fe8ff9640 1 -- 172.21.15.50:0/680895988 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) ==== 74+0+16707 (secure 0 0 0) 0x7f3fe005d4b0 con 0x7f3fec0d3a30 2024-09-11T22:22:36.531 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:36.532 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":178,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:22:34.856834+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:22:31.181552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-11T22:22:32.207726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:22:36.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.532+0000 7f3ff27e4640 1 -- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3fd806be60 msgr2=0x7f3fd806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.533+0000 7f3ff27e4640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3fd806be60 0x7f3fd806e320 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0079a0 tx=0x7f3fdc008040 comp rx=0 tx=0).stop 2024-09-11T22:22:36.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.533+0000 7f3ff27e4640 1 -- 172.21.15.50:0/680895988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0d3a30 msgr2=0x7f3fec1f7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.533+0000 7f3ff27e4640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0d3a30 0x7f3fec1f7e20 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000d800 tx=0x7f3fe000dcc0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.533+0000 7f3ff27e4640 1 -- 172.21.15.50:0/680895988 shutdown_connections 2024-09-11T22:22:36.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.533+0000 7f3ff27e4640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3fd806be60 0x7f3fd806e320 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.533+0000 7f3ff27e4640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3fec15e870 0x7f3fec0ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.533+0000 7f3ff27e4640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fec0d3a30 0x7f3fec1f7e20 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.533+0000 7f3ff27e4640 1 --2- 172.21.15.50:0/680895988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fec0d16d0 0x7f3fec0ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.533+0000 7f3ff27e4640 1 -- 172.21.15.50:0/680895988 >> 172.21.15.50:0/680895988 conn(0x7f3fec0727a0 msgr2=0x7f3fec0b9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:36.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.533+0000 7f3ff27e4640 1 -- 172.21.15.50:0/680895988 shutdown_connections 2024-09-11T22:22:36.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.533+0000 7f3ff27e4640 1 -- 172.21.15.50:0/680895988 wait complete. 2024-09-11T22:22:36.545 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:22:36.545 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:22:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.647+0000 7f8a85fd6640 1 Processor -- start 2024-09-11T22:22:36.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.647+0000 7f8a85fd6640 1 -- start start 2024-09-11T22:22:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a85fd6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a800d1c90 0x7f8a800b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a85fd6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8a80162350 0x7f8a801627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a85fd6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a80163080 con 0x7f8a8015e8e0 2024-09-11T22:22:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a85fd6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f8a8015ecc0 con 0x7f8a800d1c90 2024-09-11T22:22:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a85fd6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8a800d2ad0 con 0x7f8a80162350 2024-09-11T22:22:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a7effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a800d1c90 0x7f8a800b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a7effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a800d1c90 0x7f8a800b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48078/0 (socket says 172.21.15.50:48078) 2024-09-11T22:22:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a7effd640 1 -- 172.21.15.50:0/1922886096 learned_addr learned my addr 172.21.15.50:0/1922886096 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a7ffff640 1 --2- 172.21.15.50:0/1922886096 >> v2:172.21.15.77:3300/0 conn(0x7f8a80162350 0x7f8a801627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a7effd640 1 -- 172.21.15.50:0/1922886096 >> v2:172.21.15.77:3300/0 conn(0x7f8a80162350 msgr2=0x7f8a801627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a7effd640 1 --2- 172.21.15.50:0/1922886096 >> v2:172.21.15.77:3300/0 conn(0x7f8a80162350 0x7f8a801627a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a7effd640 1 -- 172.21.15.50:0/1922886096 >> v1:172.21.15.77:6789/0 conn(0x7f8a8015e8e0 legacy=0x7f8a800d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a7effd640 1 -- 172.21.15.50:0/1922886096 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a800d2d20 con 0x7f8a800d1c90 2024-09-11T22:22:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.648+0000 7f8a7ffff640 1 --2- 172.21.15.50:0/1922886096 >> v2:172.21.15.77:3300/0 conn(0x7f8a80162350 0x7f8a801627a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.649+0000 7f8a7effd640 1 --2- 172.21.15.50:0/1922886096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a800d1c90 0x7f8a800b7880 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f8a800d1220 tx=0x7f8a7402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a2c0a0299f3ebf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.649+0000 7f8a7e7fc640 1 -- 172.21.15.50:0/1922886096 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74037070 con 0x7f8a800d1c90 2024-09-11T22:22:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.649+0000 7f8a7e7fc640 1 -- 172.21.15.50:0/1922886096 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a74032440 con 0x7f8a800d1c90 2024-09-11T22:22:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.649+0000 7f8a7e7fc640 1 -- 172.21.15.50:0/1922886096 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74032810 con 0x7f8a800d1c90 2024-09-11T22:22:36.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.649+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1922886096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a800d1c90 msgr2=0x7f8a800b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.649+0000 7f8a85fd6640 1 --2- 172.21.15.50:0/1922886096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a800d1c90 0x7f8a800b7880 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f8a800d1220 tx=0x7f8a7402a2c0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.650+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1922886096 shutdown_connections 2024-09-11T22:22:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.650+0000 7f8a85fd6640 1 --2- 172.21.15.50:0/1922886096 >> v2:172.21.15.77:3300/0 conn(0x7f8a80162350 0x7f8a801627a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.650+0000 7f8a85fd6640 1 --2- 172.21.15.50:0/1922886096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a800d1c90 0x7f8a800b7880 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.650+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1922886096 >> 172.21.15.50:0/1922886096 conn(0x7f8a80067ba0 msgr2=0x7f8a80067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.650+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1922886096 shutdown_connections 2024-09-11T22:22:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.650+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1922886096 wait complete. 2024-09-11T22:22:36.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.651+0000 7f8a85fd6640 1 Processor -- start 2024-09-11T22:22:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.651+0000 7f8a85fd6640 1 -- start start 2024-09-11T22:22:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a85fd6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a800d1c90 0x7f8a801f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a85fd6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8015e8e0 0x7f8a800cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a85fd6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a80162350 0x7f8a800abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a85fd6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a80162ce0 con 0x7f8a8015e8e0 2024-09-11T22:22:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a85fd6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a800d3370 con 0x7f8a800d1c90 2024-09-11T22:22:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a85fd6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8a80162e60 con 0x7f8a80162350 2024-09-11T22:22:36.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a7effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8015e8e0 0x7f8a800cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a7effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8015e8e0 0x7f8a800cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48090/0 (socket says 172.21.15.50:48090) 2024-09-11T22:22:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a7effd640 1 -- 172.21.15.50:0/1194809163 learned_addr learned my addr 172.21.15.50:0/1194809163 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a7f7fe640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a800d1c90 0x7f8a801f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a7ffff640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a80162350 0x7f8a800abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a7effd640 1 -- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a80162350 msgr2=0x7f8a800abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a7effd640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a80162350 0x7f8a800abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a7effd640 1 -- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a800d1c90 msgr2=0x7f8a801f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a7effd640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a800d1c90 0x7f8a801f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a7effd640 1 -- 172.21.15.50:0/1194809163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a800ac1e0 con 0x7f8a8015e8e0 2024-09-11T22:22:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a7ffff640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a80162350 0x7f8a800abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.652+0000 7f8a7effd640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8015e8e0 0x7f8a800cc2d0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f8a74000c00 tx=0x7f8a740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.653+0000 7f8a67fff640 1 -- 172.21.15.50:0/1194809163 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74041020 con 0x7f8a8015e8e0 2024-09-11T22:22:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.653+0000 7f8a67fff640 1 -- 172.21.15.50:0/1194809163 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a74030970 con 0x7f8a8015e8e0 2024-09-11T22:22:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.653+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1194809163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a800cc9d0 con 0x7f8a8015e8e0 2024-09-11T22:22:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.653+0000 7f8a67fff640 1 -- 172.21.15.50:0/1194809163 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74037040 con 0x7f8a8015e8e0 2024-09-11T22:22:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.653+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1194809163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a800cd290 con 0x7f8a8015e8e0 2024-09-11T22:22:36.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.654+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1194809163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a800b7880 con 0x7f8a8015e8e0 2024-09-11T22:22:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.654+0000 7f8a67fff640 1 -- 172.21.15.50:0/1194809163 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a74044020 con 0x7f8a8015e8e0 2024-09-11T22:22:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.655+0000 7f8a67fff640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a6c06be30 0x7f8a6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.655+0000 7f8a67fff640 1 -- 172.21.15.50:0/1194809163 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f8a740ab7e0 con 0x7f8a8015e8e0 2024-09-11T22:22:36.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.655+0000 7f8a7f7fe640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a6c06be30 0x7f8a6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:36.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.655+0000 7f8a7f7fe640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a6c06be30 0x7f8a6c06e2f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f8a8015e640 tx=0x7f8a70007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:36.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.659+0000 7f8a67fff640 1 -- 172.21.15.50:0/1194809163 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a7404b030 con 0x7f8a8015e8e0 2024-09-11T22:22:36.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.834+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1194809163 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a800b4030 con 0x7f8a6c06be30 2024-09-11T22:22:36.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.840+0000 7f8a67fff640 1 -- 172.21.15.50:0/1194809163 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249007 (secure 0 0 0) 0x7f8a800b4030 con 0x7f8a6c06be30 2024-09-11T22:22:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:36.845 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:22:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.843+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a6c06be30 msgr2=0x7f8a6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.843+0000 7f8a85fd6640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a6c06be30 0x7f8a6c06e2f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f8a8015e640 tx=0x7f8a70007e30 comp rx=0 tx=0).stop 2024-09-11T22:22:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.843+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1194809163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8015e8e0 msgr2=0x7f8a800cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.843+0000 7f8a85fd6640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8015e8e0 0x7f8a800cc2d0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f8a74000c00 tx=0x7f8a740046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.843+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1194809163 shutdown_connections 2024-09-11T22:22:36.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.843+0000 7f8a85fd6640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f8a6c06be30 0x7f8a6c06e2f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.843+0000 7f8a85fd6640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a80162350 0x7f8a800abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.843+0000 7f8a85fd6640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a8015e8e0 0x7f8a800cc2d0 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.843+0000 7f8a85fd6640 1 --2- 172.21.15.50:0/1194809163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a800d1c90 0x7f8a801f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:36.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.843+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1194809163 >> 172.21.15.50:0/1194809163 conn(0x7f8a80067ba0 msgr2=0x7f8a800d4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:36.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.843+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1194809163 shutdown_connections 2024-09-11T22:22:36.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.843+0000 7f8a85fd6640 1 -- 172.21.15.50:0/1194809163 wait complete. 2024-09-11T22:22:36.855 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":518,"stamp":"2024-09-11T22:22:35.527814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":176,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":154,"acting":154,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":429044,"kb_used_data":18484,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754545676,"statfs":{"total":773094113280,"available":772654772224,"internally_reserved":0,"allocated":18927616,"data_stored":8950628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":420204081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000857"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875080+0000","last_change":"2024-09-11T22:22:33.873367+0000","last_active":"2024-09-11T22:22:33.875080+0000","last_peered":"2024-09-11T22:22:33.875080+0000","last_clean":"2024-09-11T22:22:33.875080+0000","last_became_active":"2024-09-11T22:22:33.873099+0000","last_became_peered":"2024-09-11T22:22:33.873099+0000","last_unstale":"2024-09-11T22:22:33.875080+0000","last_undegraded":"2024-09-11T22:22:33.875080+0000","last_fullsized":"2024-09-11T22:22:33.875080+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:21.856111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870192+0000","last_change":"2024-09-11T22:22:33.866561+0000","last_active":"2024-09-11T22:22:33.870192+0000","last_peered":"2024-09-11T22:22:33.870192+0000","last_clean":"2024-09-11T22:22:33.870192+0000","last_became_active":"2024-09-11T22:22:33.866301+0000","last_became_peered":"2024-09-11T22:22:33.866301+0000","last_unstale":"2024-09-11T22:22:33.870192+0000","last_undegraded":"2024-09-11T22:22:33.870192+0000","last_fullsized":"2024-09-11T22:22:33.870192+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:06.549937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886331+0000","last_change":"2024-09-11T22:22:33.884861+0000","last_active":"2024-09-11T22:22:33.886331+0000","last_peered":"2024-09-11T22:22:33.886331+0000","last_clean":"2024-09-11T22:22:33.886331+0000","last_became_active":"2024-09-11T22:22:33.884592+0000","last_became_peered":"2024-09-11T22:22:33.884592+0000","last_unstale":"2024-09-11T22:22:33.886331+0000","last_undegraded":"2024-09-11T22:22:33.886331+0000","last_fullsized":"2024-09-11T22:22:33.886331+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:07.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877696+0000","last_change":"2024-09-11T22:22:33.874296+0000","last_active":"2024-09-11T22:22:33.877696+0000","last_peered":"2024-09-11T22:22:33.877696+0000","last_clean":"2024-09-11T22:22:33.877696+0000","last_became_active":"2024-09-11T22:22:33.873767+0000","last_became_peered":"2024-09-11T22:22:33.873767+0000","last_unstale":"2024-09-11T22:22:33.877696+0000","last_undegraded":"2024-09-11T22:22:33.877696+0000","last_fullsized":"2024-09-11T22:22:33.877696+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:52:53.352386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872845+0000","last_change":"2024-09-11T22:22:33.871884+0000","last_active":"2024-09-11T22:22:33.872845+0000","last_peered":"2024-09-11T22:22:33.872845+0000","last_clean":"2024-09-11T22:22:33.872845+0000","last_became_active":"2024-09-11T22:22:33.871465+0000","last_became_peered":"2024-09-11T22:22:33.871465+0000","last_unstale":"2024-09-11T22:22:33.872845+0000","last_undegraded":"2024-09-11T22:22:33.872845+0000","last_fullsized":"2024-09-11T22:22:33.872845+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:19.002541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876905+0000","last_change":"2024-09-11T22:22:33.872124+0000","last_active":"2024-09-11T22:22:33.876905+0000","last_peered":"2024-09-11T22:22:33.876905+0000","last_clean":"2024-09-11T22:22:33.876905+0000","last_became_active":"2024-09-11T22:22:33.871835+0000","last_became_peered":"2024-09-11T22:22:33.871835+0000","last_unstale":"2024-09-11T22:22:33.876905+0000","last_undegraded":"2024-09-11T22:22:33.876905+0000","last_fullsized":"2024-09-11T22:22:33.876905+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:07.845885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870861+0000","last_change":"2024-09-11T22:22:33.869901+0000","last_active":"2024-09-11T22:22:33.870861+0000","last_peered":"2024-09-11T22:22:33.870861+0000","last_clean":"2024-09-11T22:22:33.870861+0000","last_became_active":"2024-09-11T22:22:33.869519+0000","last_became_peered":"2024-09-11T22:22:33.869519+0000","last_unstale":"2024-09-11T22:22:33.870861+0000","last_undegraded":"2024-09-11T22:22:33.870861+0000","last_fullsized":"2024-09-11T22:22:33.870861+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:34.311452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892605+0000","last_change":"2024-09-11T22:22:33.891761+0000","last_active":"2024-09-11T22:22:33.892605+0000","last_peered":"2024-09-11T22:22:33.892605+0000","last_clean":"2024-09-11T22:22:33.892605+0000","last_became_active":"2024-09-11T22:22:33.891431+0000","last_became_peered":"2024-09-11T22:22:33.891431+0000","last_unstale":"2024-09-11T22:22:33.892605+0000","last_undegraded":"2024-09-11T22:22:33.892605+0000","last_fullsized":"2024-09-11T22:22:33.892605+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:41.584550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875604+0000","last_change":"2024-09-11T22:22:33.873332+0000","last_active":"2024-09-11T22:22:33.875604+0000","last_peered":"2024-09-11T22:22:33.875604+0000","last_clean":"2024-09-11T22:22:33.875604+0000","last_became_active":"2024-09-11T22:22:33.873063+0000","last_became_peered":"2024-09-11T22:22:33.873063+0000","last_unstale":"2024-09-11T22:22:33.875604+0000","last_undegraded":"2024-09-11T22:22:33.875604+0000","last_fullsized":"2024-09-11T22:22:33.875604+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:19.441983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875867+0000","last_change":"2024-09-11T22:22:33.872546+0000","last_active":"2024-09-11T22:22:33.875867+0000","last_peered":"2024-09-11T22:22:33.875867+0000","last_clean":"2024-09-11T22:22:33.875867+0000","last_became_active":"2024-09-11T22:22:33.871688+0000","last_became_peered":"2024-09-11T22:22:33.871688+0000","last_unstale":"2024-09-11T22:22:33.875867+0000","last_undegraded":"2024-09-11T22:22:33.875867+0000","last_fullsized":"2024-09-11T22:22:33.875867+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:13.685778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890673+0000","last_change":"2024-09-11T22:22:33.882001+0000","last_active":"2024-09-11T22:22:33.890673+0000","last_peered":"2024-09-11T22:22:33.890673+0000","last_clean":"2024-09-11T22:22:33.890673+0000","last_became_active":"2024-09-11T22:22:33.881567+0000","last_became_peered":"2024-09-11T22:22:33.881567+0000","last_unstale":"2024-09-11T22:22:33.890673+0000","last_undegraded":"2024-09-11T22:22:33.890673+0000","last_fullsized":"2024-09-11T22:22:33.890673+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:41:23.986542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890531+0000","last_change":"2024-09-11T22:22:33.883282+0000","last_active":"2024-09-11T22:22:33.890531+0000","last_peered":"2024-09-11T22:22:33.890531+0000","last_clean":"2024-09-11T22:22:33.890531+0000","last_became_active":"2024-09-11T22:22:33.882864+0000","last_became_peered":"2024-09-11T22:22:33.882864+0000","last_unstale":"2024-09-11T22:22:33.890531+0000","last_undegraded":"2024-09-11T22:22:33.890531+0000","last_fullsized":"2024-09-11T22:22:33.890531+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:54.323577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889383+0000","last_change":"2024-09-11T22:22:33.887311+0000","last_active":"2024-09-11T22:22:33.889383+0000","last_peered":"2024-09-11T22:22:33.889383+0000","last_clean":"2024-09-11T22:22:33.889383+0000","last_became_active":"2024-09-11T22:22:33.881922+0000","last_became_peered":"2024-09-11T22:22:33.881922+0000","last_unstale":"2024-09-11T22:22:33.889383+0000","last_undegraded":"2024-09-11T22:22:33.889383+0000","last_fullsized":"2024-09-11T22:22:33.889383+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:59.243443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877418+0000","last_change":"2024-09-11T22:22:33.876445+0000","last_active":"2024-09-11T22:22:33.877418+0000","last_peered":"2024-09-11T22:22:33.877418+0000","last_clean":"2024-09-11T22:22:33.877418+0000","last_became_active":"2024-09-11T22:22:33.876147+0000","last_became_peered":"2024-09-11T22:22:33.876147+0000","last_unstale":"2024-09-11T22:22:33.877418+0000","last_undegraded":"2024-09-11T22:22:33.877418+0000","last_fullsized":"2024-09-11T22:22:33.877418+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:03.175064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889328+0000","last_change":"2024-09-11T22:22:33.883306+0000","last_active":"2024-09-11T22:22:33.889328+0000","last_peered":"2024-09-11T22:22:33.889328+0000","last_clean":"2024-09-11T22:22:33.889328+0000","last_became_active":"2024-09-11T22:22:33.882092+0000","last_became_peered":"2024-09-11T22:22:33.882092+0000","last_unstale":"2024-09-11T22:22:33.889328+0000","last_undegraded":"2024-09-11T22:22:33.889328+0000","last_fullsized":"2024-09-11T22:22:33.889328+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:54.323577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890411+0000","last_change":"2024-09-11T22:22:33.883694+0000","last_active":"2024-09-11T22:22:33.890411+0000","last_peered":"2024-09-11T22:22:33.890411+0000","last_clean":"2024-09-11T22:22:33.890411+0000","last_became_active":"2024-09-11T22:22:33.883401+0000","last_became_peered":"2024-09-11T22:22:33.883401+0000","last_unstale":"2024-09-11T22:22:33.890411+0000","last_undegraded":"2024-09-11T22:22:33.890411+0000","last_fullsized":"2024-09-11T22:22:33.890411+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:48:06.450712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886164+0000","last_change":"2024-09-11T22:22:33.884828+0000","last_active":"2024-09-11T22:22:33.886164+0000","last_peered":"2024-09-11T22:22:33.886164+0000","last_clean":"2024-09-11T22:22:33.886164+0000","last_became_active":"2024-09-11T22:22:33.884077+0000","last_became_peered":"2024-09-11T22:22:33.884077+0000","last_unstale":"2024-09-11T22:22:33.886164+0000","last_undegraded":"2024-09-11T22:22:33.886164+0000","last_fullsized":"2024-09-11T22:22:33.886164+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:37.767944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.887017+0000","last_change":"2024-09-11T22:22:33.886316+0000","last_active":"2024-09-11T22:22:33.887017+0000","last_peered":"2024-09-11T22:22:33.887017+0000","last_clean":"2024-09-11T22:22:33.887017+0000","last_became_active":"2024-09-11T22:22:33.886001+0000","last_became_peered":"2024-09-11T22:22:33.886001+0000","last_unstale":"2024-09-11T22:22:33.887017+0000","last_undegraded":"2024-09-11T22:22:33.887017+0000","last_fullsized":"2024-09-11T22:22:33.887017+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:20.158581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877317+0000","last_change":"2024-09-11T22:22:33.876492+0000","last_active":"2024-09-11T22:22:33.877317+0000","last_peered":"2024-09-11T22:22:33.877317+0000","last_clean":"2024-09-11T22:22:33.877317+0000","last_became_active":"2024-09-11T22:22:33.876047+0000","last_became_peered":"2024-09-11T22:22:33.876047+0000","last_unstale":"2024-09-11T22:22:33.877317+0000","last_undegraded":"2024-09-11T22:22:33.877317+0000","last_fullsized":"2024-09-11T22:22:33.877317+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:19.441983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.884787+0000","last_change":"2024-09-11T22:22:33.884369+0000","last_active":"2024-09-11T22:22:33.884787+0000","last_peered":"2024-09-11T22:22:33.884787+0000","last_clean":"2024-09-11T22:22:33.884787+0000","last_became_active":"2024-09-11T22:22:33.884089+0000","last_became_peered":"2024-09-11T22:22:33.884089+0000","last_unstale":"2024-09-11T22:22:33.884787+0000","last_undegraded":"2024-09-11T22:22:33.884787+0000","last_fullsized":"2024-09-11T22:22:33.884787+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:17.954497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872119+0000","last_change":"2024-09-11T22:22:33.870192+0000","last_active":"2024-09-11T22:22:33.872119+0000","last_peered":"2024-09-11T22:22:33.872119+0000","last_clean":"2024-09-11T22:22:33.872119+0000","last_became_active":"2024-09-11T22:22:33.869842+0000","last_became_peered":"2024-09-11T22:22:33.869842+0000","last_unstale":"2024-09-11T22:22:33.872119+0000","last_undegraded":"2024-09-11T22:22:33.872119+0000","last_fullsized":"2024-09-11T22:22:33.872119+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:04.924074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876355+0000","last_change":"2024-09-11T22:22:33.874097+0000","last_active":"2024-09-11T22:22:33.876355+0000","last_peered":"2024-09-11T22:22:33.876355+0000","last_clean":"2024-09-11T22:22:33.876355+0000","last_became_active":"2024-09-11T22:22:33.873815+0000","last_became_peered":"2024-09-11T22:22:33.873815+0000","last_unstale":"2024-09-11T22:22:33.876355+0000","last_undegraded":"2024-09-11T22:22:33.876355+0000","last_fullsized":"2024-09-11T22:22:33.876355+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:20.158581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875889+0000","last_change":"2024-09-11T22:22:33.873410+0000","last_active":"2024-09-11T22:22:33.875889+0000","last_peered":"2024-09-11T22:22:33.875889+0000","last_clean":"2024-09-11T22:22:33.875889+0000","last_became_active":"2024-09-11T22:22:33.873139+0000","last_became_peered":"2024-09-11T22:22:33.873139+0000","last_unstale":"2024-09-11T22:22:33.875889+0000","last_undegraded":"2024-09-11T22:22:33.875889+0000","last_fullsized":"2024-09-11T22:22:33.875889+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:21.561002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877236+0000","last_change":"2024-09-11T22:22:33.875556+0000","last_active":"2024-09-11T22:22:33.877236+0000","last_peered":"2024-09-11T22:22:33.877236+0000","last_clean":"2024-09-11T22:22:33.877236+0000","last_became_active":"2024-09-11T22:22:33.875271+0000","last_became_peered":"2024-09-11T22:22:33.875271+0000","last_unstale":"2024-09-11T22:22:33.877236+0000","last_undegraded":"2024-09-11T22:22:33.877236+0000","last_fullsized":"2024-09-11T22:22:33.877236+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:57.213641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872059+0000","last_change":"2024-09-11T22:22:33.871266+0000","last_active":"2024-09-11T22:22:33.872059+0000","last_peered":"2024-09-11T22:22:33.872059+0000","last_clean":"2024-09-11T22:22:33.872059+0000","last_became_active":"2024-09-11T22:22:33.870953+0000","last_became_peered":"2024-09-11T22:22:33.870953+0000","last_unstale":"2024-09-11T22:22:33.872059+0000","last_undegraded":"2024-09-11T22:22:33.872059+0000","last_fullsized":"2024-09-11T22:22:33.872059+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.051705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890511+0000","last_change":"2024-09-11T22:22:33.881317+0000","last_active":"2024-09-11T22:22:33.890511+0000","last_peered":"2024-09-11T22:22:33.890511+0000","last_clean":"2024-09-11T22:22:33.890511+0000","last_became_active":"2024-09-11T22:22:33.880855+0000","last_became_peered":"2024-09-11T22:22:33.880855+0000","last_unstale":"2024-09-11T22:22:33.890511+0000","last_undegraded":"2024-09-11T22:22:33.890511+0000","last_fullsized":"2024-09-11T22:22:33.890511+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:19.325750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876547+0000","last_change":"2024-09-11T22:22:33.874494+0000","last_active":"2024-09-11T22:22:33.876547+0000","last_peered":"2024-09-11T22:22:33.876547+0000","last_clean":"2024-09-11T22:22:33.876547+0000","last_became_active":"2024-09-11T22:22:33.874228+0000","last_became_peered":"2024-09-11T22:22:33.874228+0000","last_unstale":"2024-09-11T22:22:33.876547+0000","last_undegraded":"2024-09-11T22:22:33.876547+0000","last_fullsized":"2024-09-11T22:22:33.876547+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:51.735057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"177'4","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.888895+0000","last_change":"2024-09-11T22:22:32.875504+0000","last_active":"2024-09-11T22:22:33.888895+0000","last_peered":"2024-09-11T22:22:33.888895+0000","last_clean":"2024-09-11T22:22:33.888895+0000","last_became_active":"2024-09-11T22:22:32.875253+0000","last_became_peered":"2024-09-11T22:22:32.875253+0000","last_unstale":"2024-09-11T22:22:33.888895+0000","last_undegraded":"2024-09-11T22:22:33.888895+0000","last_fullsized":"2024-09-11T22:22:33.888895+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:56.207572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877216+0000","last_change":"2024-09-11T22:22:33.875788+0000","last_active":"2024-09-11T22:22:33.877216+0000","last_peered":"2024-09-11T22:22:33.877216+0000","last_clean":"2024-09-11T22:22:33.877216+0000","last_became_active":"2024-09-11T22:22:33.875491+0000","last_became_peered":"2024-09-11T22:22:33.875491+0000","last_unstale":"2024-09-11T22:22:33.877216+0000","last_undegraded":"2024-09-11T22:22:33.877216+0000","last_fullsized":"2024-09-11T22:22:33.877216+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:13.685778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.888708+0000","last_change":"2024-09-11T22:22:32.872040+0000","last_active":"2024-09-11T22:22:33.888708+0000","last_peered":"2024-09-11T22:22:33.888708+0000","last_clean":"2024-09-11T22:22:33.888708+0000","last_became_active":"2024-09-11T22:22:32.871733+0000","last_became_peered":"2024-09-11T22:22:32.871733+0000","last_unstale":"2024-09-11T22:22:33.888708+0000","last_undegraded":"2024-09-11T22:22:33.888708+0000","last_fullsized":"2024-09-11T22:22:33.888708+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:57.631086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872137+0000","last_change":"2024-09-11T22:22:33.871433+0000","last_active":"2024-09-11T22:22:33.872137+0000","last_peered":"2024-09-11T22:22:33.872137+0000","last_clean":"2024-09-11T22:22:33.872137+0000","last_became_active":"2024-09-11T22:22:33.871134+0000","last_became_peered":"2024-09-11T22:22:33.871134+0000","last_unstale":"2024-09-11T22:22:33.872137+0000","last_undegraded":"2024-09-11T22:22:33.872137+0000","last_fullsized":"2024-09-11T22:22:33.872137+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:52.234618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:31.841988+0000","last_change":"2024-09-11T22:22:31.841988+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.841988+0000","last_undegraded":"2024-09-11T22:22:31.841988+0000","last_fullsized":"2024-09-11T22:22:31.841988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890443+0000","last_change":"2024-09-11T22:22:33.885084+0000","last_active":"2024-09-11T22:22:33.890443+0000","last_peered":"2024-09-11T22:22:33.890443+0000","last_clean":"2024-09-11T22:22:33.890443+0000","last_became_active":"2024-09-11T22:22:33.884682+0000","last_became_peered":"2024-09-11T22:22:33.884682+0000","last_unstale":"2024-09-11T22:22:33.890443+0000","last_undegraded":"2024-09-11T22:22:33.890443+0000","last_fullsized":"2024-09-11T22:22:33.890443+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:44.490870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2024-09-11T22:22:31.855888+0000","last_change":"2024-09-11T22:22:31.855888+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.855888+0000","last_undegraded":"2024-09-11T22:22:31.855888+0000","last_fullsized":"2024-09-11T22:22:31.855888+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890199+0000","last_change":"2024-09-11T22:22:32.876739+0000","last_active":"2024-09-11T22:22:33.890199+0000","last_peered":"2024-09-11T22:22:33.890199+0000","last_clean":"2024-09-11T22:22:33.890199+0000","last_became_active":"2024-09-11T22:22:32.876472+0000","last_became_peered":"2024-09-11T22:22:32.876472+0000","last_unstale":"2024-09-11T22:22:33.890199+0000","last_undegraded":"2024-09-11T22:22:33.890199+0000","last_fullsized":"2024-09-11T22:22:33.890199+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:47.992674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876928+0000","last_change":"2024-09-11T22:22:33.872839+0000","last_active":"2024-09-11T22:22:33.876928+0000","last_peered":"2024-09-11T22:22:33.876928+0000","last_clean":"2024-09-11T22:22:33.876928+0000","last_became_active":"2024-09-11T22:22:33.872541+0000","last_became_peered":"2024-09-11T22:22:33.872541+0000","last_unstale":"2024-09-11T22:22:33.876928+0000","last_undegraded":"2024-09-11T22:22:33.876928+0000","last_fullsized":"2024-09-11T22:22:33.876928+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:58.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867063+0000","last_change":"2024-09-11T22:22:32.868319+0000","last_active":"2024-09-11T22:22:33.867063+0000","last_peered":"2024-09-11T22:22:33.867063+0000","last_clean":"2024-09-11T22:22:33.867063+0000","last_became_active":"2024-09-11T22:22:32.868050+0000","last_became_peered":"2024-09-11T22:22:32.868050+0000","last_unstale":"2024-09-11T22:22:33.867063+0000","last_undegraded":"2024-09-11T22:22:33.867063+0000","last_fullsized":"2024-09-11T22:22:33.867063+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:01.463502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865009+0000","last_change":"2024-09-11T22:22:32.876471+0000","last_active":"2024-09-11T22:22:33.865009+0000","last_peered":"2024-09-11T22:22:33.865009+0000","last_clean":"2024-09-11T22:22:33.865009+0000","last_became_active":"2024-09-11T22:22:32.876165+0000","last_became_peered":"2024-09-11T22:22:32.876165+0000","last_unstale":"2024-09-11T22:22:33.865009+0000","last_undegraded":"2024-09-11T22:22:33.865009+0000","last_fullsized":"2024-09-11T22:22:33.865009+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:59.849409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867438+0000","last_change":"2024-09-11T22:22:32.868187+0000","last_active":"2024-09-11T22:22:33.867438+0000","last_peered":"2024-09-11T22:22:33.867438+0000","last_clean":"2024-09-11T22:22:33.867438+0000","last_became_active":"2024-09-11T22:22:32.867873+0000","last_became_peered":"2024-09-11T22:22:32.867873+0000","last_unstale":"2024-09-11T22:22:33.867438+0000","last_undegraded":"2024-09-11T22:22:33.867438+0000","last_fullsized":"2024-09-11T22:22:33.867438+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:16.014510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865676+0000","last_change":"2024-09-11T22:22:32.871536+0000","last_active":"2024-09-11T22:22:33.865676+0000","last_peered":"2024-09-11T22:22:33.865676+0000","last_clean":"2024-09-11T22:22:33.865676+0000","last_became_active":"2024-09-11T22:22:32.870670+0000","last_became_peered":"2024-09-11T22:22:32.870670+0000","last_unstale":"2024-09-11T22:22:33.865676+0000","last_undegraded":"2024-09-11T22:22:33.865676+0000","last_fullsized":"2024-09-11T22:22:33.865676+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:50.728988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"177'3","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892700+0000","last_change":"2024-09-11T22:22:32.874858+0000","last_active":"2024-09-11T22:22:33.892700+0000","last_peered":"2024-09-11T22:22:33.892700+0000","last_clean":"2024-09-11T22:22:33.892700+0000","last_became_active":"2024-09-11T22:22:32.874556+0000","last_became_peered":"2024-09-11T22:22:32.874556+0000","last_unstale":"2024-09-11T22:22:33.892700+0000","last_undegraded":"2024-09-11T22:22:33.892700+0000","last_fullsized":"2024-09-11T22:22:33.892700+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:41.633829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890387+0000","last_change":"2024-09-11T22:22:33.880424+0000","last_active":"2024-09-11T22:22:33.890387+0000","last_peered":"2024-09-11T22:22:33.890387+0000","last_clean":"2024-09-11T22:22:33.890387+0000","last_became_active":"2024-09-11T22:22:33.880082+0000","last_became_peered":"2024-09-11T22:22:33.880082+0000","last_unstale":"2024-09-11T22:22:33.890387+0000","last_undegraded":"2024-09-11T22:22:33.890387+0000","last_fullsized":"2024-09-11T22:22:33.890387+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:51.419145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2024-09-11T22:22:31.854954+0000","last_change":"2024-09-11T22:22:31.854954+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.854954+0000","last_undegraded":"2024-09-11T22:22:31.854954+0000","last_fullsized":"2024-09-11T22:22:31.854954+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886309+0000","last_change":"2024-09-11T22:22:33.885274+0000","last_active":"2024-09-11T22:22:33.886309+0000","last_peered":"2024-09-11T22:22:33.886309+0000","last_clean":"2024-09-11T22:22:33.886309+0000","last_became_active":"2024-09-11T22:22:33.884990+0000","last_became_peered":"2024-09-11T22:22:33.884990+0000","last_unstale":"2024-09-11T22:22:33.886309+0000","last_undegraded":"2024-09-11T22:22:33.886309+0000","last_fullsized":"2024-09-11T22:22:33.886309+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.633479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"177'2","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886978+0000","last_change":"2024-09-11T22:22:32.872106+0000","last_active":"2024-09-11T22:22:33.886978+0000","last_peered":"2024-09-11T22:22:33.886978+0000","last_clean":"2024-09-11T22:22:33.886978+0000","last_became_active":"2024-09-11T22:22:32.871772+0000","last_became_peered":"2024-09-11T22:22:32.871772+0000","last_unstale":"2024-09-11T22:22:33.886978+0000","last_undegraded":"2024-09-11T22:22:33.886978+0000","last_fullsized":"2024-09-11T22:22:33.886978+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.839583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889321+0000","last_change":"2024-09-11T22:22:33.882949+0000","last_active":"2024-09-11T22:22:33.889321+0000","last_peered":"2024-09-11T22:22:33.889321+0000","last_clean":"2024-09-11T22:22:33.889321+0000","last_became_active":"2024-09-11T22:22:33.882659+0000","last_became_peered":"2024-09-11T22:22:33.882659+0000","last_unstale":"2024-09-11T22:22:33.889321+0000","last_undegraded":"2024-09-11T22:22:33.889321+0000","last_fullsized":"2024-09-11T22:22:33.889321+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:41:23.986542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865728+0000","last_change":"2024-09-11T22:22:32.869908+0000","last_active":"2024-09-11T22:22:33.865728+0000","last_peered":"2024-09-11T22:22:33.865728+0000","last_clean":"2024-09-11T22:22:33.865728+0000","last_became_active":"2024-09-11T22:22:32.869622+0000","last_became_peered":"2024-09-11T22:22:32.869622+0000","last_unstale":"2024-09-11T22:22:33.865728+0000","last_undegraded":"2024-09-11T22:22:33.865728+0000","last_fullsized":"2024-09-11T22:22:33.865728+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:26.942462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872544+0000","last_change":"2024-09-11T22:22:32.874747+0000","last_active":"2024-09-11T22:22:33.872544+0000","last_peered":"2024-09-11T22:22:33.872544+0000","last_clean":"2024-09-11T22:22:33.872544+0000","last_became_active":"2024-09-11T22:22:32.874454+0000","last_became_peered":"2024-09-11T22:22:32.874454+0000","last_unstale":"2024-09-11T22:22:33.872544+0000","last_undegraded":"2024-09-11T22:22:33.872544+0000","last_fullsized":"2024-09-11T22:22:33.872544+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:20.850041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872183+0000","last_change":"2024-09-11T22:22:33.871139+0000","last_active":"2024-09-11T22:22:33.872183+0000","last_peered":"2024-09-11T22:22:33.872183+0000","last_clean":"2024-09-11T22:22:33.872183+0000","last_became_active":"2024-09-11T22:22:33.870706+0000","last_became_peered":"2024-09-11T22:22:33.870706+0000","last_unstale":"2024-09-11T22:22:33.872183+0000","last_undegraded":"2024-09-11T22:22:33.872183+0000","last_fullsized":"2024-09-11T22:22:33.872183+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:06.718551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:31.841988+0000","last_change":"2024-09-11T22:22:31.841988+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.841988+0000","last_undegraded":"2024-09-11T22:22:31.841988+0000","last_fullsized":"2024-09-11T22:22:31.841988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.871584+0000","last_change":"2024-09-11T22:22:33.869366+0000","last_active":"2024-09-11T22:22:33.871584+0000","last_peered":"2024-09-11T22:22:33.871584+0000","last_clean":"2024-09-11T22:22:33.871584+0000","last_became_active":"2024-09-11T22:22:33.869095+0000","last_became_peered":"2024-09-11T22:22:33.869095+0000","last_unstale":"2024-09-11T22:22:33.871584+0000","last_undegraded":"2024-09-11T22:22:33.871584+0000","last_fullsized":"2024-09-11T22:22:33.871584+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:08.615227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.891842+0000","last_change":"2024-09-11T22:22:32.869194+0000","last_active":"2024-09-11T22:22:33.891842+0000","last_peered":"2024-09-11T22:22:33.891842+0000","last_clean":"2024-09-11T22:22:33.891842+0000","last_became_active":"2024-09-11T22:22:32.868931+0000","last_became_peered":"2024-09-11T22:22:32.868931+0000","last_unstale":"2024-09-11T22:22:33.891842+0000","last_undegraded":"2024-09-11T22:22:33.891842+0000","last_fullsized":"2024-09-11T22:22:33.891842+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:41.209428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.884771+0000","last_change":"2024-09-11T22:22:33.884363+0000","last_active":"2024-09-11T22:22:33.884771+0000","last_peered":"2024-09-11T22:22:33.884771+0000","last_clean":"2024-09-11T22:22:33.884771+0000","last_became_active":"2024-09-11T22:22:33.884103+0000","last_became_peered":"2024-09-11T22:22:33.884103+0000","last_unstale":"2024-09-11T22:22:33.884771+0000","last_undegraded":"2024-09-11T22:22:33.884771+0000","last_fullsized":"2024-09-11T22:22:33.884771+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:09.845653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"177'2","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892467+0000","last_change":"2024-09-11T22:22:32.875435+0000","last_active":"2024-09-11T22:22:33.892467+0000","last_peered":"2024-09-11T22:22:33.892467+0000","last_clean":"2024-09-11T22:22:33.892467+0000","last_became_active":"2024-09-11T22:22:32.875176+0000","last_became_peered":"2024-09-11T22:22:32.875176+0000","last_unstale":"2024-09-11T22:22:33.892467+0000","last_undegraded":"2024-09-11T22:22:33.892467+0000","last_fullsized":"2024-09-11T22:22:33.892467+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:28.777018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.891285+0000","last_change":"2024-09-11T22:22:32.873935+0000","last_active":"2024-09-11T22:22:33.891285+0000","last_peered":"2024-09-11T22:22:33.891285+0000","last_clean":"2024-09-11T22:22:33.891285+0000","last_became_active":"2024-09-11T22:22:32.872709+0000","last_became_peered":"2024-09-11T22:22:32.872709+0000","last_unstale":"2024-09-11T22:22:33.891285+0000","last_undegraded":"2024-09-11T22:22:33.891285+0000","last_fullsized":"2024-09-11T22:22:33.891285+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:50.413075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.888390+0000","last_change":"2024-09-11T22:22:33.879571+0000","last_active":"2024-09-11T22:22:33.888390+0000","last_peered":"2024-09-11T22:22:33.888390+0000","last_clean":"2024-09-11T22:22:33.888390+0000","last_became_active":"2024-09-11T22:22:33.879288+0000","last_became_peered":"2024-09-11T22:22:33.879288+0000","last_unstale":"2024-09-11T22:22:33.888390+0000","last_undegraded":"2024-09-11T22:22:33.888390+0000","last_fullsized":"2024-09-11T22:22:33.888390+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:19.325750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:31.841988+0000","last_change":"2024-09-11T22:22:31.841988+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.841988+0000","last_undegraded":"2024-09-11T22:22:31.841988+0000","last_fullsized":"2024-09-11T22:22:31.841988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889301+0000","last_change":"2024-09-11T22:22:33.882673+0000","last_active":"2024-09-11T22:22:33.889301+0000","last_peered":"2024-09-11T22:22:33.889301+0000","last_clean":"2024-09-11T22:22:33.889301+0000","last_became_active":"2024-09-11T22:22:33.881961+0000","last_became_peered":"2024-09-11T22:22:33.881961+0000","last_unstale":"2024-09-11T22:22:33.889301+0000","last_undegraded":"2024-09-11T22:22:33.889301+0000","last_fullsized":"2024-09-11T22:22:33.889301+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:40.704844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"177'2","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892004+0000","last_change":"2024-09-11T22:22:32.871013+0000","last_active":"2024-09-11T22:22:33.892004+0000","last_peered":"2024-09-11T22:22:33.892004+0000","last_clean":"2024-09-11T22:22:33.892004+0000","last_became_active":"2024-09-11T22:22:32.869592+0000","last_became_peered":"2024-09-11T22:22:32.869592+0000","last_unstale":"2024-09-11T22:22:33.892004+0000","last_undegraded":"2024-09-11T22:22:33.892004+0000","last_fullsized":"2024-09-11T22:22:33.892004+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:02.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870436+0000","last_change":"2024-09-11T22:22:32.868236+0000","last_active":"2024-09-11T22:22:33.870436+0000","last_peered":"2024-09-11T22:22:33.870436+0000","last_clean":"2024-09-11T22:22:33.870436+0000","last_became_active":"2024-09-11T22:22:32.867876+0000","last_became_peered":"2024-09-11T22:22:32.867876+0000","last_unstale":"2024-09-11T22:22:33.870436+0000","last_undegraded":"2024-09-11T22:22:33.870436+0000","last_fullsized":"2024-09-11T22:22:33.870436+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:51.010593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870299+0000","last_change":"2024-09-11T22:22:33.866913+0000","last_active":"2024-09-11T22:22:33.870299+0000","last_peered":"2024-09-11T22:22:33.870299+0000","last_clean":"2024-09-11T22:22:33.870299+0000","last_became_active":"2024-09-11T22:22:33.866628+0000","last_became_peered":"2024-09-11T22:22:33.866628+0000","last_unstale":"2024-09-11T22:22:33.870299+0000","last_undegraded":"2024-09-11T22:22:33.870299+0000","last_fullsized":"2024-09-11T22:22:33.870299+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:29.858473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867015+0000","last_change":"2024-09-11T22:22:32.872329+0000","last_active":"2024-09-11T22:22:33.867015+0000","last_peered":"2024-09-11T22:22:33.867015+0000","last_clean":"2024-09-11T22:22:33.867015+0000","last_became_active":"2024-09-11T22:22:32.871836+0000","last_became_peered":"2024-09-11T22:22:32.871836+0000","last_unstale":"2024-09-11T22:22:33.867015+0000","last_undegraded":"2024-09-11T22:22:33.867015+0000","last_fullsized":"2024-09-11T22:22:33.867015+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:16.999557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877594+0000","last_change":"2024-09-11T22:22:33.876747+0000","last_active":"2024-09-11T22:22:33.877594+0000","last_peered":"2024-09-11T22:22:33.877594+0000","last_clean":"2024-09-11T22:22:33.877594+0000","last_became_active":"2024-09-11T22:22:33.876137+0000","last_became_peered":"2024-09-11T22:22:33.876137+0000","last_unstale":"2024-09-11T22:22:33.877594+0000","last_undegraded":"2024-09-11T22:22:33.877594+0000","last_fullsized":"2024-09-11T22:22:33.877594+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:21.561002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867731+0000","last_change":"2024-09-11T22:22:32.873479+0000","last_active":"2024-09-11T22:22:33.867731+0000","last_peered":"2024-09-11T22:22:33.867731+0000","last_clean":"2024-09-11T22:22:33.867731+0000","last_became_active":"2024-09-11T22:22:32.873187+0000","last_became_peered":"2024-09-11T22:22:32.873187+0000","last_unstale":"2024-09-11T22:22:33.867731+0000","last_undegraded":"2024-09-11T22:22:33.867731+0000","last_fullsized":"2024-09-11T22:22:33.867731+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:52.625796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.883423+0000","last_change":"2024-09-11T22:22:33.882379+0000","last_active":"2024-09-11T22:22:33.883423+0000","last_peered":"2024-09-11T22:22:33.883423+0000","last_clean":"2024-09-11T22:22:33.883423+0000","last_became_active":"2024-09-11T22:22:33.882098+0000","last_became_peered":"2024-09-11T22:22:33.882098+0000","last_unstale":"2024-09-11T22:22:33.883423+0000","last_undegraded":"2024-09-11T22:22:33.883423+0000","last_fullsized":"2024-09-11T22:22:33.883423+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:59.833957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:31.841988+0000","last_change":"2024-09-11T22:22:31.841988+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.841988+0000","last_undegraded":"2024-09-11T22:22:31.841988+0000","last_fullsized":"2024-09-11T22:22:31.841988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890546+0000","last_change":"2024-09-11T22:22:33.880882+0000","last_active":"2024-09-11T22:22:33.890546+0000","last_peered":"2024-09-11T22:22:33.890546+0000","last_clean":"2024-09-11T22:22:33.890546+0000","last_became_active":"2024-09-11T22:22:33.880577+0000","last_became_peered":"2024-09-11T22:22:33.880577+0000","last_unstale":"2024-09-11T22:22:33.890546+0000","last_undegraded":"2024-09-11T22:22:33.890546+0000","last_fullsized":"2024-09-11T22:22:33.890546+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:42.639899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2024-09-11T22:22:31.854949+0000","last_change":"2024-09-11T22:22:31.854949+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.854949+0000","last_undegraded":"2024-09-11T22:22:31.854949+0000","last_fullsized":"2024-09-11T22:22:31.854949+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877067+0000","last_change":"2024-09-11T22:22:33.875215+0000","last_active":"2024-09-11T22:22:33.877067+0000","last_peered":"2024-09-11T22:22:33.877067+0000","last_clean":"2024-09-11T22:22:33.877067+0000","last_became_active":"2024-09-11T22:22:33.874961+0000","last_became_peered":"2024-09-11T22:22:33.874961+0000","last_unstale":"2024-09-11T22:22:33.877067+0000","last_undegraded":"2024-09-11T22:22:33.877067+0000","last_fullsized":"2024-09-11T22:22:33.877067+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:27.948531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.869538+0000","last_change":"2024-09-11T22:22:32.867763+0000","last_active":"2024-09-11T22:22:33.869538+0000","last_peered":"2024-09-11T22:22:33.869538+0000","last_clean":"2024-09-11T22:22:33.869538+0000","last_became_active":"2024-09-11T22:22:32.867493+0000","last_became_peered":"2024-09-11T22:22:32.867493+0000","last_unstale":"2024-09-11T22:22:33.869538+0000","last_undegraded":"2024-09-11T22:22:33.869538+0000","last_fullsized":"2024-09-11T22:22:33.869538+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:13.188631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.873056+0000","last_change":"2024-09-11T22:22:33.871871+0000","last_active":"2024-09-11T22:22:33.873056+0000","last_peered":"2024-09-11T22:22:33.873056+0000","last_clean":"2024-09-11T22:22:33.873056+0000","last_became_active":"2024-09-11T22:22:33.871567+0000","last_became_peered":"2024-09-11T22:22:33.871567+0000","last_unstale":"2024-09-11T22:22:33.873056+0000","last_undegraded":"2024-09-11T22:22:33.873056+0000","last_fullsized":"2024-09-11T22:22:33.873056+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:17.954497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:31.841988+0000","last_change":"2024-09-11T22:22:31.841988+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.841988+0000","last_undegraded":"2024-09-11T22:22:31.841988+0000","last_fullsized":"2024-09-11T22:22:31.841988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875021+0000","last_change":"2024-09-11T22:22:33.872648+0000","last_active":"2024-09-11T22:22:33.875021+0000","last_peered":"2024-09-11T22:22:33.875021+0000","last_clean":"2024-09-11T22:22:33.875021+0000","last_became_active":"2024-09-11T22:22:33.872364+0000","last_became_peered":"2024-09-11T22:22:33.872364+0000","last_unstale":"2024-09-11T22:22:33.875021+0000","last_undegraded":"2024-09-11T22:22:33.875021+0000","last_fullsized":"2024-09-11T22:22:33.875021+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.051705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2024-09-11T22:22:31.854990+0000","last_change":"2024-09-11T22:22:31.854990+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.854990+0000","last_undegraded":"2024-09-11T22:22:31.854990+0000","last_fullsized":"2024-09-11T22:22:31.854990+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.882948+0000","last_change":"2024-09-11T22:22:33.882413+0000","last_active":"2024-09-11T22:22:33.882948+0000","last_peered":"2024-09-11T22:22:33.882948+0000","last_clean":"2024-09-11T22:22:33.882948+0000","last_became_active":"2024-09-11T22:22:33.882153+0000","last_became_peered":"2024-09-11T22:22:33.882153+0000","last_unstale":"2024-09-11T22:22:33.882948+0000","last_undegraded":"2024-09-11T22:22:33.882948+0000","last_fullsized":"2024-09-11T22:22:33.882948+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:08.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867928+0000","last_change":"2024-09-11T22:22:32.876657+0000","last_active":"2024-09-11T22:22:33.867928+0000","last_peered":"2024-09-11T22:22:33.867928+0000","last_clean":"2024-09-11T22:22:33.867928+0000","last_became_active":"2024-09-11T22:22:32.876140+0000","last_became_peered":"2024-09-11T22:22:32.876140+0000","last_unstale":"2024-09-11T22:22:33.867928+0000","last_undegraded":"2024-09-11T22:22:33.867928+0000","last_fullsized":"2024-09-11T22:22:33.867928+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:21.127707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865883+0000","last_change":"2024-09-11T22:22:32.874909+0000","last_active":"2024-09-11T22:22:33.865883+0000","last_peered":"2024-09-11T22:22:33.865883+0000","last_clean":"2024-09-11T22:22:33.865883+0000","last_became_active":"2024-09-11T22:22:32.874627+0000","last_became_peered":"2024-09-11T22:22:32.874627+0000","last_unstale":"2024-09-11T22:22:33.865883+0000","last_undegraded":"2024-09-11T22:22:33.865883+0000","last_fullsized":"2024-09-11T22:22:33.865883+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:56.207572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875724+0000","last_change":"2024-09-11T22:22:33.871239+0000","last_active":"2024-09-11T22:22:33.875724+0000","last_peered":"2024-09-11T22:22:33.875724+0000","last_clean":"2024-09-11T22:22:33.875724+0000","last_became_active":"2024-09-11T22:22:33.870917+0000","last_became_peered":"2024-09-11T22:22:33.870917+0000","last_unstale":"2024-09-11T22:22:33.875724+0000","last_undegraded":"2024-09-11T22:22:33.875724+0000","last_fullsized":"2024-09-11T22:22:33.875724+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:00.855479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.862829+0000","last_change":"2024-09-11T22:22:32.876591+0000","last_active":"2024-09-11T22:22:33.862829+0000","last_peered":"2024-09-11T22:22:33.862829+0000","last_clean":"2024-09-11T22:22:33.862829+0000","last_became_active":"2024-09-11T22:22:32.876343+0000","last_became_peered":"2024-09-11T22:22:32.876343+0000","last_unstale":"2024-09-11T22:22:33.862829+0000","last_undegraded":"2024-09-11T22:22:33.862829+0000","last_fullsized":"2024-09-11T22:22:33.862829+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.839583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890564+0000","last_change":"2024-09-11T22:22:33.881708+0000","last_active":"2024-09-11T22:22:33.890564+0000","last_peered":"2024-09-11T22:22:33.890564+0000","last_clean":"2024-09-11T22:22:33.890564+0000","last_became_active":"2024-09-11T22:22:33.880955+0000","last_became_peered":"2024-09-11T22:22:33.880955+0000","last_unstale":"2024-09-11T22:22:33.890564+0000","last_undegraded":"2024-09-11T22:22:33.890564+0000","last_fullsized":"2024-09-11T22:22:33.890564+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:40.704844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.891456+0000","last_change":"2024-09-11T22:22:32.876390+0000","last_active":"2024-09-11T22:22:33.891456+0000","last_peered":"2024-09-11T22:22:33.891456+0000","last_clean":"2024-09-11T22:22:33.891456+0000","last_became_active":"2024-09-11T22:22:32.876077+0000","last_became_peered":"2024-09-11T22:22:32.876077+0000","last_unstale":"2024-09-11T22:22:33.891456+0000","last_undegraded":"2024-09-11T22:22:33.891456+0000","last_fullsized":"2024-09-11T22:22:33.891456+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:16.948428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":449,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-11T22:22:31.855715+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:22:31.855715+0000","last_peered":"2024-09-11T22:22:31.855715+0000","last_clean":"2024-09-11T22:22:31.855715+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:22:31.855715+0000","last_undegraded":"2024-09-11T22:22:31.855715+0000","last_fullsized":"2024-09-11T22:22:31.855715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":54,"acting":54,"num_store_stats":7},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509583,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55576,"kb_used_data":2176,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316264,"statfs":{"total":96636764160,"available":96579854336,"internally_reserved":0,"allocated":2228224,"data_stored":977912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509580,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51400,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320440,"statfs":{"total":96636764160,"available":96584130560,"internally_reserved":0,"allocated":2211840,"data_stored":970555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509582,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63916,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307924,"statfs":{"total":96636764160,"available":96571314176,"internally_reserved":0,"allocated":2244608,"data_stored":979046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509582,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47268,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324572,"statfs":{"total":96636764160,"available":96588361728,"internally_reserved":0,"allocated":2236416,"data_stored":977512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509582,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47256,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324584,"statfs":{"total":96636764160,"available":96588374016,"internally_reserved":0,"allocated":2232320,"data_stored":977386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509581,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60300,"kb_used_data":2740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311540,"statfs":{"total":96636764160,"available":96575016960,"internally_reserved":0,"allocated":2805760,"data_stored":1560923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574989,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56116,"kb_used_data":2716,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315724,"statfs":{"total":96636764160,"available":96579301376,"internally_reserved":0,"allocated":2781184,"data_stored":1548831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47212,"kb_used_data":2136,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324628,"statfs":{"total":96636764160,"available":96588419072,"internally_reserved":0,"allocated":2187264,"data_stored":958463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:22:36.859 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:22:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.997+0000 7ff666453640 1 Processor -- start 2024-09-11T22:22:36.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.997+0000 7ff666453640 1 -- start start 2024-09-11T22:22:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff666453640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff660161d30 0x7ff6600cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff666453640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6600d11d0 0x7ff6600d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff666453640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff660162110 con 0x7ff6600b78f0 2024-09-11T22:22:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff666453640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff6600d1b80 con 0x7ff660161d30 2024-09-11T22:22:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff666453640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff6600d3450 con 0x7ff6600d11d0 2024-09-11T22:22:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff65f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff6600b78f0 0x7ff660162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39296/0 (socket says 172.21.15.50:39296) 2024-09-11T22:22:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff65f7fe640 1 -- 172.21.15.50:0/3326169632 learned_addr learned my addr 172.21.15.50:0/3326169632 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff65ffff640 1 --2- 172.21.15.50:0/3326169632 >> v2:172.21.15.77:3300/0 conn(0x7ff660161d30 0x7ff6600cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff6649f0640 1 --2- 172.21.15.50:0/3326169632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6600d11d0 0x7ff6600d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3359618476 0 0) 0x7ff660162110 con 0x7ff6600b78f0 2024-09-11T22:22:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff648003520 con 0x7ff6600b78f0 2024-09-11T22:22:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2411312634 0 0) 0x7ff648003520 con 0x7ff6600b78f0 2024-09-11T22:22:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6600d11d0 msgr2=0x7ff6600d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff65effd640 1 --2- 172.21.15.50:0/3326169632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6600d11d0 0x7ff6600d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 >> v2:172.21.15.77:3300/0 conn(0x7ff660161d30 msgr2=0x7ff6600cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff65effd640 1 --2- 172.21.15.50:0/3326169632 >> v2:172.21.15.77:3300/0 conn(0x7ff660161d30 0x7ff6600cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6600cfd70 con 0x7ff6600b78f0 2024-09-11T22:22:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.998+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7ff654001670 con 0x7ff6600b78f0 2024-09-11T22:22:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 >> v1:172.21.15.50:6789/0 conn(0x7ff6600b78f0 legacy=0x7ff660162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65effd640 1 --2- 172.21.15.50:0/3326169632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6480039b0 0x7ff648003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65effd640 1 --2- 172.21.15.50:0/3326169632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff648004800 0x7ff648004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65effd640 1 --2- 172.21.15.50:0/3326169632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6600d11d0 0x7ff6480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff6600d1b80 con 0x7ff6480039b0 2024-09-11T22:22:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff6600d3450 con 0x7ff648004800 2024-09-11T22:22:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff64800b9c0 con 0x7ff6600d11d0 2024-09-11T22:22:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65ffff640 1 --2- 172.21.15.50:0/3326169632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6480039b0 0x7ff648003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65f7fe640 1 --2- 172.21.15.50:0/3326169632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff648004800 0x7ff648004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff6649f0640 1 --2- 172.21.15.50:0/3326169632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6600d11d0 0x7ff6480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65ffff640 1 -- 172.21.15.50:0/3326169632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6600d11d0 msgr2=0x7ff6480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65ffff640 1 --2- 172.21.15.50:0/3326169632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6600d11d0 0x7ff6480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65ffff640 1 -- 172.21.15.50:0/3326169632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff648004800 msgr2=0x7ff648004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65ffff640 1 --2- 172.21.15.50:0/3326169632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff648004800 0x7ff648004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff65ffff640 1 -- 172.21.15.50:0/3326169632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff648003520 con 0x7ff6480039b0 2024-09-11T22:22:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:36.999+0000 7ff6649f0640 1 --2- 172.21.15.50:0/3326169632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6600d11d0 0x7ff6480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.000+0000 7ff65ffff640 1 --2- 172.21.15.50:0/3326169632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6480039b0 0x7ff648003dd0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7ff650009ac0 tx=0x7ff648005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f02bbea7d1d8fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.000+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650036070 con 0x7ff6480039b0 2024-09-11T22:22:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.000+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff650031400 con 0x7ff6480039b0 2024-09-11T22:22:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.000+0000 7ff65effd640 1 -- 172.21.15.50:0/3326169632 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650009690 con 0x7ff6480039b0 2024-09-11T22:22:37.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.000+0000 7ff666453640 1 -- 172.21.15.50:0/3326169632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6480039b0 msgr2=0x7ff648003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.000+0000 7ff666453640 1 --2- 172.21.15.50:0/3326169632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6480039b0 0x7ff648003dd0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7ff650009ac0 tx=0x7ff648005830 comp rx=0 tx=0).stop 2024-09-11T22:22:37.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.000+0000 7ff6649f0640 1 -- 172.21.15.50:0/3326169632 reap_dead start 2024-09-11T22:22:37.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.000+0000 7ff666453640 1 -- 172.21.15.50:0/3326169632 shutdown_connections 2024-09-11T22:22:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.000+0000 7ff666453640 1 -- 172.21.15.50:0/3326169632 >> 172.21.15.50:0/3326169632 conn(0x7ff6600727a0 msgr2=0x7ff6600679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.001+0000 7ff666453640 1 -- 172.21.15.50:0/3326169632 shutdown_connections 2024-09-11T22:22:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.001+0000 7ff666453640 1 -- 172.21.15.50:0/3326169632 wait complete. 2024-09-11T22:22:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.002+0000 7ff666453640 1 Processor -- start 2024-09-11T22:22:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.002+0000 7ff666453640 1 -- start start 2024-09-11T22:22:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff666453640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6480039b0 0x7ff6600b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff666453640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6600b5ac0 0x7ff6600cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff666453640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff660159270 0x7ff660159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff666453640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff6600d30e0 con 0x7ff6600b5ac0 2024-09-11T22:22:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff666453640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff6600d2e00 con 0x7ff6480039b0 2024-09-11T22:22:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff666453640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff6600b7d60 con 0x7ff660159270 2024-09-11T22:22:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff65f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6600b5ac0 0x7ff6600cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff65f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6600b5ac0 0x7ff6600cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48108/0 (socket says 172.21.15.50:48108) 2024-09-11T22:22:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff65f7fe640 1 -- 172.21.15.50:0/759471329 learned_addr learned my addr 172.21.15.50:0/759471329 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff6649f0640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff660159270 0x7ff660159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff65ffff640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6480039b0 0x7ff6600b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff65f7fe640 1 -- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff660159270 msgr2=0x7ff660159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff65f7fe640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff660159270 0x7ff660159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff65f7fe640 1 -- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6480039b0 msgr2=0x7ff6600b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff65f7fe640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6480039b0 0x7ff6600b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff65f7fe640 1 -- 172.21.15.50:0/759471329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6600cb2c0 con 0x7ff6600b5ac0 2024-09-11T22:22:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff6649f0640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff660159270 0x7ff660159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff65f7fe640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6600b5ac0 0x7ff6600cad80 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7ff654007310 tx=0x7ff6540077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff65cff9640 1 -- 172.21.15.50:0/759471329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65400f960 con 0x7ff6600b5ac0 2024-09-11T22:22:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff65cff9640 1 -- 172.21.15.50:0/759471329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff654018070 con 0x7ff6600b5ac0 2024-09-11T22:22:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff666453640 1 -- 172.21.15.50:0/759471329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6600b4a20 con 0x7ff6600b5ac0 2024-09-11T22:22:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.003+0000 7ff65cff9640 1 -- 172.21.15.50:0/759471329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65400fd60 con 0x7ff6600b5ac0 2024-09-11T22:22:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.004+0000 7ff666453640 1 -- 172.21.15.50:0/759471329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6600b4fe0 con 0x7ff6600b5ac0 2024-09-11T22:22:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.005+0000 7ff666453640 1 -- 172.21.15.50:0/759471329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6600cf790 con 0x7ff6600b5ac0 2024-09-11T22:22:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.005+0000 7ff65cff9640 1 -- 172.21.15.50:0/759471329 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff65401d460 con 0x7ff6600b5ac0 2024-09-11T22:22:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.006+0000 7ff65cff9640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff64c06be30 0x7ff64c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.006+0000 7ff65cff9640 1 -- 172.21.15.50:0/759471329 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7ff65408af20 con 0x7ff6600b5ac0 2024-09-11T22:22:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.006+0000 7ff65ffff640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff64c06be30 0x7ff64c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.007+0000 7ff65ffff640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff64c06be30 0x7ff64c06e2f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff650033000 tx=0x7ff650008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:37.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.010+0000 7ff65cff9640 1 -- 172.21.15.50:0/759471329 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff654059960 con 0x7ff6600b5ac0 2024-09-11T22:22:37.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.180+0000 7ff666453640 1 -- 172.21.15.50:0/759471329 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6600d2900 con 0x7ff64c06be30 2024-09-11T22:22:37.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.186+0000 7ff65cff9640 1 -- 172.21.15.50:0/759471329 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249007 (secure 0 0 0) 0x7ff6600d2900 con 0x7ff64c06be30 2024-09-11T22:22:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:37.191 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:22:37.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.190+0000 7ff666453640 1 -- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff64c06be30 msgr2=0x7ff64c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.190+0000 7ff666453640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff64c06be30 0x7ff64c06e2f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff650033000 tx=0x7ff650008030 comp rx=0 tx=0).stop 2024-09-11T22:22:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.190+0000 7ff666453640 1 -- 172.21.15.50:0/759471329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6600b5ac0 msgr2=0x7ff6600cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.190+0000 7ff666453640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6600b5ac0 0x7ff6600cad80 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7ff654007310 tx=0x7ff6540077d0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.190+0000 7ff666453640 1 -- 172.21.15.50:0/759471329 shutdown_connections 2024-09-11T22:22:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.190+0000 7ff666453640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff64c06be30 0x7ff64c06e2f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.190+0000 7ff666453640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff660159270 0x7ff660159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.190+0000 7ff666453640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6600b5ac0 0x7ff6600cad80 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.190+0000 7ff666453640 1 --2- 172.21.15.50:0/759471329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6480039b0 0x7ff6600b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.190+0000 7ff666453640 1 -- 172.21.15.50:0/759471329 >> 172.21.15.50:0/759471329 conn(0x7ff6600727a0 msgr2=0x7ff6600cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.190+0000 7ff666453640 1 -- 172.21.15.50:0/759471329 shutdown_connections 2024-09-11T22:22:37.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.190+0000 7ff666453640 1 -- 172.21.15.50:0/759471329 wait complete. 2024-09-11T22:22:37.201 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":518,"stamp":"2024-09-11T22:22:35.527814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":176,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":154,"acting":154,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":429044,"kb_used_data":18484,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754545676,"statfs":{"total":773094113280,"available":772654772224,"internally_reserved":0,"allocated":18927616,"data_stored":8950628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":420204081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000857"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875080+0000","last_change":"2024-09-11T22:22:33.873367+0000","last_active":"2024-09-11T22:22:33.875080+0000","last_peered":"2024-09-11T22:22:33.875080+0000","last_clean":"2024-09-11T22:22:33.875080+0000","last_became_active":"2024-09-11T22:22:33.873099+0000","last_became_peered":"2024-09-11T22:22:33.873099+0000","last_unstale":"2024-09-11T22:22:33.875080+0000","last_undegraded":"2024-09-11T22:22:33.875080+0000","last_fullsized":"2024-09-11T22:22:33.875080+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:21.856111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870192+0000","last_change":"2024-09-11T22:22:33.866561+0000","last_active":"2024-09-11T22:22:33.870192+0000","last_peered":"2024-09-11T22:22:33.870192+0000","last_clean":"2024-09-11T22:22:33.870192+0000","last_became_active":"2024-09-11T22:22:33.866301+0000","last_became_peered":"2024-09-11T22:22:33.866301+0000","last_unstale":"2024-09-11T22:22:33.870192+0000","last_undegraded":"2024-09-11T22:22:33.870192+0000","last_fullsized":"2024-09-11T22:22:33.870192+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:06.549937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886331+0000","last_change":"2024-09-11T22:22:33.884861+0000","last_active":"2024-09-11T22:22:33.886331+0000","last_peered":"2024-09-11T22:22:33.886331+0000","last_clean":"2024-09-11T22:22:33.886331+0000","last_became_active":"2024-09-11T22:22:33.884592+0000","last_became_peered":"2024-09-11T22:22:33.884592+0000","last_unstale":"2024-09-11T22:22:33.886331+0000","last_undegraded":"2024-09-11T22:22:33.886331+0000","last_fullsized":"2024-09-11T22:22:33.886331+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:07.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877696+0000","last_change":"2024-09-11T22:22:33.874296+0000","last_active":"2024-09-11T22:22:33.877696+0000","last_peered":"2024-09-11T22:22:33.877696+0000","last_clean":"2024-09-11T22:22:33.877696+0000","last_became_active":"2024-09-11T22:22:33.873767+0000","last_became_peered":"2024-09-11T22:22:33.873767+0000","last_unstale":"2024-09-11T22:22:33.877696+0000","last_undegraded":"2024-09-11T22:22:33.877696+0000","last_fullsized":"2024-09-11T22:22:33.877696+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:52:53.352386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872845+0000","last_change":"2024-09-11T22:22:33.871884+0000","last_active":"2024-09-11T22:22:33.872845+0000","last_peered":"2024-09-11T22:22:33.872845+0000","last_clean":"2024-09-11T22:22:33.872845+0000","last_became_active":"2024-09-11T22:22:33.871465+0000","last_became_peered":"2024-09-11T22:22:33.871465+0000","last_unstale":"2024-09-11T22:22:33.872845+0000","last_undegraded":"2024-09-11T22:22:33.872845+0000","last_fullsized":"2024-09-11T22:22:33.872845+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:19.002541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876905+0000","last_change":"2024-09-11T22:22:33.872124+0000","last_active":"2024-09-11T22:22:33.876905+0000","last_peered":"2024-09-11T22:22:33.876905+0000","last_clean":"2024-09-11T22:22:33.876905+0000","last_became_active":"2024-09-11T22:22:33.871835+0000","last_became_peered":"2024-09-11T22:22:33.871835+0000","last_unstale":"2024-09-11T22:22:33.876905+0000","last_undegraded":"2024-09-11T22:22:33.876905+0000","last_fullsized":"2024-09-11T22:22:33.876905+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:07.845885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870861+0000","last_change":"2024-09-11T22:22:33.869901+0000","last_active":"2024-09-11T22:22:33.870861+0000","last_peered":"2024-09-11T22:22:33.870861+0000","last_clean":"2024-09-11T22:22:33.870861+0000","last_became_active":"2024-09-11T22:22:33.869519+0000","last_became_peered":"2024-09-11T22:22:33.869519+0000","last_unstale":"2024-09-11T22:22:33.870861+0000","last_undegraded":"2024-09-11T22:22:33.870861+0000","last_fullsized":"2024-09-11T22:22:33.870861+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:34.311452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892605+0000","last_change":"2024-09-11T22:22:33.891761+0000","last_active":"2024-09-11T22:22:33.892605+0000","last_peered":"2024-09-11T22:22:33.892605+0000","last_clean":"2024-09-11T22:22:33.892605+0000","last_became_active":"2024-09-11T22:22:33.891431+0000","last_became_peered":"2024-09-11T22:22:33.891431+0000","last_unstale":"2024-09-11T22:22:33.892605+0000","last_undegraded":"2024-09-11T22:22:33.892605+0000","last_fullsized":"2024-09-11T22:22:33.892605+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:41.584550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875604+0000","last_change":"2024-09-11T22:22:33.873332+0000","last_active":"2024-09-11T22:22:33.875604+0000","last_peered":"2024-09-11T22:22:33.875604+0000","last_clean":"2024-09-11T22:22:33.875604+0000","last_became_active":"2024-09-11T22:22:33.873063+0000","last_became_peered":"2024-09-11T22:22:33.873063+0000","last_unstale":"2024-09-11T22:22:33.875604+0000","last_undegraded":"2024-09-11T22:22:33.875604+0000","last_fullsized":"2024-09-11T22:22:33.875604+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:19.441983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875867+0000","last_change":"2024-09-11T22:22:33.872546+0000","last_active":"2024-09-11T22:22:33.875867+0000","last_peered":"2024-09-11T22:22:33.875867+0000","last_clean":"2024-09-11T22:22:33.875867+0000","last_became_active":"2024-09-11T22:22:33.871688+0000","last_became_peered":"2024-09-11T22:22:33.871688+0000","last_unstale":"2024-09-11T22:22:33.875867+0000","last_undegraded":"2024-09-11T22:22:33.875867+0000","last_fullsized":"2024-09-11T22:22:33.875867+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:13.685778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890673+0000","last_change":"2024-09-11T22:22:33.882001+0000","last_active":"2024-09-11T22:22:33.890673+0000","last_peered":"2024-09-11T22:22:33.890673+0000","last_clean":"2024-09-11T22:22:33.890673+0000","last_became_active":"2024-09-11T22:22:33.881567+0000","last_became_peered":"2024-09-11T22:22:33.881567+0000","last_unstale":"2024-09-11T22:22:33.890673+0000","last_undegraded":"2024-09-11T22:22:33.890673+0000","last_fullsized":"2024-09-11T22:22:33.890673+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:41:23.986542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890531+0000","last_change":"2024-09-11T22:22:33.883282+0000","last_active":"2024-09-11T22:22:33.890531+0000","last_peered":"2024-09-11T22:22:33.890531+0000","last_clean":"2024-09-11T22:22:33.890531+0000","last_became_active":"2024-09-11T22:22:33.882864+0000","last_became_peered":"2024-09-11T22:22:33.882864+0000","last_unstale":"2024-09-11T22:22:33.890531+0000","last_undegraded":"2024-09-11T22:22:33.890531+0000","last_fullsized":"2024-09-11T22:22:33.890531+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:54.323577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889383+0000","last_change":"2024-09-11T22:22:33.887311+0000","last_active":"2024-09-11T22:22:33.889383+0000","last_peered":"2024-09-11T22:22:33.889383+0000","last_clean":"2024-09-11T22:22:33.889383+0000","last_became_active":"2024-09-11T22:22:33.881922+0000","last_became_peered":"2024-09-11T22:22:33.881922+0000","last_unstale":"2024-09-11T22:22:33.889383+0000","last_undegraded":"2024-09-11T22:22:33.889383+0000","last_fullsized":"2024-09-11T22:22:33.889383+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:59.243443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877418+0000","last_change":"2024-09-11T22:22:33.876445+0000","last_active":"2024-09-11T22:22:33.877418+0000","last_peered":"2024-09-11T22:22:33.877418+0000","last_clean":"2024-09-11T22:22:33.877418+0000","last_became_active":"2024-09-11T22:22:33.876147+0000","last_became_peered":"2024-09-11T22:22:33.876147+0000","last_unstale":"2024-09-11T22:22:33.877418+0000","last_undegraded":"2024-09-11T22:22:33.877418+0000","last_fullsized":"2024-09-11T22:22:33.877418+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:03.175064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889328+0000","last_change":"2024-09-11T22:22:33.883306+0000","last_active":"2024-09-11T22:22:33.889328+0000","last_peered":"2024-09-11T22:22:33.889328+0000","last_clean":"2024-09-11T22:22:33.889328+0000","last_became_active":"2024-09-11T22:22:33.882092+0000","last_became_peered":"2024-09-11T22:22:33.882092+0000","last_unstale":"2024-09-11T22:22:33.889328+0000","last_undegraded":"2024-09-11T22:22:33.889328+0000","last_fullsized":"2024-09-11T22:22:33.889328+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:54.323577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890411+0000","last_change":"2024-09-11T22:22:33.883694+0000","last_active":"2024-09-11T22:22:33.890411+0000","last_peered":"2024-09-11T22:22:33.890411+0000","last_clean":"2024-09-11T22:22:33.890411+0000","last_became_active":"2024-09-11T22:22:33.883401+0000","last_became_peered":"2024-09-11T22:22:33.883401+0000","last_unstale":"2024-09-11T22:22:33.890411+0000","last_undegraded":"2024-09-11T22:22:33.890411+0000","last_fullsized":"2024-09-11T22:22:33.890411+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:48:06.450712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886164+0000","last_change":"2024-09-11T22:22:33.884828+0000","last_active":"2024-09-11T22:22:33.886164+0000","last_peered":"2024-09-11T22:22:33.886164+0000","last_clean":"2024-09-11T22:22:33.886164+0000","last_became_active":"2024-09-11T22:22:33.884077+0000","last_became_peered":"2024-09-11T22:22:33.884077+0000","last_unstale":"2024-09-11T22:22:33.886164+0000","last_undegraded":"2024-09-11T22:22:33.886164+0000","last_fullsized":"2024-09-11T22:22:33.886164+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:37.767944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.887017+0000","last_change":"2024-09-11T22:22:33.886316+0000","last_active":"2024-09-11T22:22:33.887017+0000","last_peered":"2024-09-11T22:22:33.887017+0000","last_clean":"2024-09-11T22:22:33.887017+0000","last_became_active":"2024-09-11T22:22:33.886001+0000","last_became_peered":"2024-09-11T22:22:33.886001+0000","last_unstale":"2024-09-11T22:22:33.887017+0000","last_undegraded":"2024-09-11T22:22:33.887017+0000","last_fullsized":"2024-09-11T22:22:33.887017+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:20.158581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877317+0000","last_change":"2024-09-11T22:22:33.876492+0000","last_active":"2024-09-11T22:22:33.877317+0000","last_peered":"2024-09-11T22:22:33.877317+0000","last_clean":"2024-09-11T22:22:33.877317+0000","last_became_active":"2024-09-11T22:22:33.876047+0000","last_became_peered":"2024-09-11T22:22:33.876047+0000","last_unstale":"2024-09-11T22:22:33.877317+0000","last_undegraded":"2024-09-11T22:22:33.877317+0000","last_fullsized":"2024-09-11T22:22:33.877317+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:19.441983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.884787+0000","last_change":"2024-09-11T22:22:33.884369+0000","last_active":"2024-09-11T22:22:33.884787+0000","last_peered":"2024-09-11T22:22:33.884787+0000","last_clean":"2024-09-11T22:22:33.884787+0000","last_became_active":"2024-09-11T22:22:33.884089+0000","last_became_peered":"2024-09-11T22:22:33.884089+0000","last_unstale":"2024-09-11T22:22:33.884787+0000","last_undegraded":"2024-09-11T22:22:33.884787+0000","last_fullsized":"2024-09-11T22:22:33.884787+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:17.954497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872119+0000","last_change":"2024-09-11T22:22:33.870192+0000","last_active":"2024-09-11T22:22:33.872119+0000","last_peered":"2024-09-11T22:22:33.872119+0000","last_clean":"2024-09-11T22:22:33.872119+0000","last_became_active":"2024-09-11T22:22:33.869842+0000","last_became_peered":"2024-09-11T22:22:33.869842+0000","last_unstale":"2024-09-11T22:22:33.872119+0000","last_undegraded":"2024-09-11T22:22:33.872119+0000","last_fullsized":"2024-09-11T22:22:33.872119+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:04.924074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876355+0000","last_change":"2024-09-11T22:22:33.874097+0000","last_active":"2024-09-11T22:22:33.876355+0000","last_peered":"2024-09-11T22:22:33.876355+0000","last_clean":"2024-09-11T22:22:33.876355+0000","last_became_active":"2024-09-11T22:22:33.873815+0000","last_became_peered":"2024-09-11T22:22:33.873815+0000","last_unstale":"2024-09-11T22:22:33.876355+0000","last_undegraded":"2024-09-11T22:22:33.876355+0000","last_fullsized":"2024-09-11T22:22:33.876355+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:20.158581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875889+0000","last_change":"2024-09-11T22:22:33.873410+0000","last_active":"2024-09-11T22:22:33.875889+0000","last_peered":"2024-09-11T22:22:33.875889+0000","last_clean":"2024-09-11T22:22:33.875889+0000","last_became_active":"2024-09-11T22:22:33.873139+0000","last_became_peered":"2024-09-11T22:22:33.873139+0000","last_unstale":"2024-09-11T22:22:33.875889+0000","last_undegraded":"2024-09-11T22:22:33.875889+0000","last_fullsized":"2024-09-11T22:22:33.875889+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:21.561002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877236+0000","last_change":"2024-09-11T22:22:33.875556+0000","last_active":"2024-09-11T22:22:33.877236+0000","last_peered":"2024-09-11T22:22:33.877236+0000","last_clean":"2024-09-11T22:22:33.877236+0000","last_became_active":"2024-09-11T22:22:33.875271+0000","last_became_peered":"2024-09-11T22:22:33.875271+0000","last_unstale":"2024-09-11T22:22:33.877236+0000","last_undegraded":"2024-09-11T22:22:33.877236+0000","last_fullsized":"2024-09-11T22:22:33.877236+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:57.213641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872059+0000","last_change":"2024-09-11T22:22:33.871266+0000","last_active":"2024-09-11T22:22:33.872059+0000","last_peered":"2024-09-11T22:22:33.872059+0000","last_clean":"2024-09-11T22:22:33.872059+0000","last_became_active":"2024-09-11T22:22:33.870953+0000","last_became_peered":"2024-09-11T22:22:33.870953+0000","last_unstale":"2024-09-11T22:22:33.872059+0000","last_undegraded":"2024-09-11T22:22:33.872059+0000","last_fullsized":"2024-09-11T22:22:33.872059+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.051705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890511+0000","last_change":"2024-09-11T22:22:33.881317+0000","last_active":"2024-09-11T22:22:33.890511+0000","last_peered":"2024-09-11T22:22:33.890511+0000","last_clean":"2024-09-11T22:22:33.890511+0000","last_became_active":"2024-09-11T22:22:33.880855+0000","last_became_peered":"2024-09-11T22:22:33.880855+0000","last_unstale":"2024-09-11T22:22:33.890511+0000","last_undegraded":"2024-09-11T22:22:33.890511+0000","last_fullsized":"2024-09-11T22:22:33.890511+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:19.325750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876547+0000","last_change":"2024-09-11T22:22:33.874494+0000","last_active":"2024-09-11T22:22:33.876547+0000","last_peered":"2024-09-11T22:22:33.876547+0000","last_clean":"2024-09-11T22:22:33.876547+0000","last_became_active":"2024-09-11T22:22:33.874228+0000","last_became_peered":"2024-09-11T22:22:33.874228+0000","last_unstale":"2024-09-11T22:22:33.876547+0000","last_undegraded":"2024-09-11T22:22:33.876547+0000","last_fullsized":"2024-09-11T22:22:33.876547+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:51.735057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"177'4","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.888895+0000","last_change":"2024-09-11T22:22:32.875504+0000","last_active":"2024-09-11T22:22:33.888895+0000","last_peered":"2024-09-11T22:22:33.888895+0000","last_clean":"2024-09-11T22:22:33.888895+0000","last_became_active":"2024-09-11T22:22:32.875253+0000","last_became_peered":"2024-09-11T22:22:32.875253+0000","last_unstale":"2024-09-11T22:22:33.888895+0000","last_undegraded":"2024-09-11T22:22:33.888895+0000","last_fullsized":"2024-09-11T22:22:33.888895+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:56.207572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877216+0000","last_change":"2024-09-11T22:22:33.875788+0000","last_active":"2024-09-11T22:22:33.877216+0000","last_peered":"2024-09-11T22:22:33.877216+0000","last_clean":"2024-09-11T22:22:33.877216+0000","last_became_active":"2024-09-11T22:22:33.875491+0000","last_became_peered":"2024-09-11T22:22:33.875491+0000","last_unstale":"2024-09-11T22:22:33.877216+0000","last_undegraded":"2024-09-11T22:22:33.877216+0000","last_fullsized":"2024-09-11T22:22:33.877216+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:13.685778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.888708+0000","last_change":"2024-09-11T22:22:32.872040+0000","last_active":"2024-09-11T22:22:33.888708+0000","last_peered":"2024-09-11T22:22:33.888708+0000","last_clean":"2024-09-11T22:22:33.888708+0000","last_became_active":"2024-09-11T22:22:32.871733+0000","last_became_peered":"2024-09-11T22:22:32.871733+0000","last_unstale":"2024-09-11T22:22:33.888708+0000","last_undegraded":"2024-09-11T22:22:33.888708+0000","last_fullsized":"2024-09-11T22:22:33.888708+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:57.631086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872137+0000","last_change":"2024-09-11T22:22:33.871433+0000","last_active":"2024-09-11T22:22:33.872137+0000","last_peered":"2024-09-11T22:22:33.872137+0000","last_clean":"2024-09-11T22:22:33.872137+0000","last_became_active":"2024-09-11T22:22:33.871134+0000","last_became_peered":"2024-09-11T22:22:33.871134+0000","last_unstale":"2024-09-11T22:22:33.872137+0000","last_undegraded":"2024-09-11T22:22:33.872137+0000","last_fullsized":"2024-09-11T22:22:33.872137+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:52.234618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:31.841988+0000","last_change":"2024-09-11T22:22:31.841988+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.841988+0000","last_undegraded":"2024-09-11T22:22:31.841988+0000","last_fullsized":"2024-09-11T22:22:31.841988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890443+0000","last_change":"2024-09-11T22:22:33.885084+0000","last_active":"2024-09-11T22:22:33.890443+0000","last_peered":"2024-09-11T22:22:33.890443+0000","last_clean":"2024-09-11T22:22:33.890443+0000","last_became_active":"2024-09-11T22:22:33.884682+0000","last_became_peered":"2024-09-11T22:22:33.884682+0000","last_unstale":"2024-09-11T22:22:33.890443+0000","last_undegraded":"2024-09-11T22:22:33.890443+0000","last_fullsized":"2024-09-11T22:22:33.890443+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:44.490870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2024-09-11T22:22:31.855888+0000","last_change":"2024-09-11T22:22:31.855888+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.855888+0000","last_undegraded":"2024-09-11T22:22:31.855888+0000","last_fullsized":"2024-09-11T22:22:31.855888+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890199+0000","last_change":"2024-09-11T22:22:32.876739+0000","last_active":"2024-09-11T22:22:33.890199+0000","last_peered":"2024-09-11T22:22:33.890199+0000","last_clean":"2024-09-11T22:22:33.890199+0000","last_became_active":"2024-09-11T22:22:32.876472+0000","last_became_peered":"2024-09-11T22:22:32.876472+0000","last_unstale":"2024-09-11T22:22:33.890199+0000","last_undegraded":"2024-09-11T22:22:33.890199+0000","last_fullsized":"2024-09-11T22:22:33.890199+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:47.992674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876928+0000","last_change":"2024-09-11T22:22:33.872839+0000","last_active":"2024-09-11T22:22:33.876928+0000","last_peered":"2024-09-11T22:22:33.876928+0000","last_clean":"2024-09-11T22:22:33.876928+0000","last_became_active":"2024-09-11T22:22:33.872541+0000","last_became_peered":"2024-09-11T22:22:33.872541+0000","last_unstale":"2024-09-11T22:22:33.876928+0000","last_undegraded":"2024-09-11T22:22:33.876928+0000","last_fullsized":"2024-09-11T22:22:33.876928+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:58.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867063+0000","last_change":"2024-09-11T22:22:32.868319+0000","last_active":"2024-09-11T22:22:33.867063+0000","last_peered":"2024-09-11T22:22:33.867063+0000","last_clean":"2024-09-11T22:22:33.867063+0000","last_became_active":"2024-09-11T22:22:32.868050+0000","last_became_peered":"2024-09-11T22:22:32.868050+0000","last_unstale":"2024-09-11T22:22:33.867063+0000","last_undegraded":"2024-09-11T22:22:33.867063+0000","last_fullsized":"2024-09-11T22:22:33.867063+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:01.463502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865009+0000","last_change":"2024-09-11T22:22:32.876471+0000","last_active":"2024-09-11T22:22:33.865009+0000","last_peered":"2024-09-11T22:22:33.865009+0000","last_clean":"2024-09-11T22:22:33.865009+0000","last_became_active":"2024-09-11T22:22:32.876165+0000","last_became_peered":"2024-09-11T22:22:32.876165+0000","last_unstale":"2024-09-11T22:22:33.865009+0000","last_undegraded":"2024-09-11T22:22:33.865009+0000","last_fullsized":"2024-09-11T22:22:33.865009+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:59.849409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867438+0000","last_change":"2024-09-11T22:22:32.868187+0000","last_active":"2024-09-11T22:22:33.867438+0000","last_peered":"2024-09-11T22:22:33.867438+0000","last_clean":"2024-09-11T22:22:33.867438+0000","last_became_active":"2024-09-11T22:22:32.867873+0000","last_became_peered":"2024-09-11T22:22:32.867873+0000","last_unstale":"2024-09-11T22:22:33.867438+0000","last_undegraded":"2024-09-11T22:22:33.867438+0000","last_fullsized":"2024-09-11T22:22:33.867438+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:16.014510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865676+0000","last_change":"2024-09-11T22:22:32.871536+0000","last_active":"2024-09-11T22:22:33.865676+0000","last_peered":"2024-09-11T22:22:33.865676+0000","last_clean":"2024-09-11T22:22:33.865676+0000","last_became_active":"2024-09-11T22:22:32.870670+0000","last_became_peered":"2024-09-11T22:22:32.870670+0000","last_unstale":"2024-09-11T22:22:33.865676+0000","last_undegraded":"2024-09-11T22:22:33.865676+0000","last_fullsized":"2024-09-11T22:22:33.865676+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:50.728988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"177'3","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892700+0000","last_change":"2024-09-11T22:22:32.874858+0000","last_active":"2024-09-11T22:22:33.892700+0000","last_peered":"2024-09-11T22:22:33.892700+0000","last_clean":"2024-09-11T22:22:33.892700+0000","last_became_active":"2024-09-11T22:22:32.874556+0000","last_became_peered":"2024-09-11T22:22:32.874556+0000","last_unstale":"2024-09-11T22:22:33.892700+0000","last_undegraded":"2024-09-11T22:22:33.892700+0000","last_fullsized":"2024-09-11T22:22:33.892700+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:41.633829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890387+0000","last_change":"2024-09-11T22:22:33.880424+0000","last_active":"2024-09-11T22:22:33.890387+0000","last_peered":"2024-09-11T22:22:33.890387+0000","last_clean":"2024-09-11T22:22:33.890387+0000","last_became_active":"2024-09-11T22:22:33.880082+0000","last_became_peered":"2024-09-11T22:22:33.880082+0000","last_unstale":"2024-09-11T22:22:33.890387+0000","last_undegraded":"2024-09-11T22:22:33.890387+0000","last_fullsized":"2024-09-11T22:22:33.890387+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:51.419145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2024-09-11T22:22:31.854954+0000","last_change":"2024-09-11T22:22:31.854954+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.854954+0000","last_undegraded":"2024-09-11T22:22:31.854954+0000","last_fullsized":"2024-09-11T22:22:31.854954+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886309+0000","last_change":"2024-09-11T22:22:33.885274+0000","last_active":"2024-09-11T22:22:33.886309+0000","last_peered":"2024-09-11T22:22:33.886309+0000","last_clean":"2024-09-11T22:22:33.886309+0000","last_became_active":"2024-09-11T22:22:33.884990+0000","last_became_peered":"2024-09-11T22:22:33.884990+0000","last_unstale":"2024-09-11T22:22:33.886309+0000","last_undegraded":"2024-09-11T22:22:33.886309+0000","last_fullsized":"2024-09-11T22:22:33.886309+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.633479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"177'2","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886978+0000","last_change":"2024-09-11T22:22:32.872106+0000","last_active":"2024-09-11T22:22:33.886978+0000","last_peered":"2024-09-11T22:22:33.886978+0000","last_clean":"2024-09-11T22:22:33.886978+0000","last_became_active":"2024-09-11T22:22:32.871772+0000","last_became_peered":"2024-09-11T22:22:32.871772+0000","last_unstale":"2024-09-11T22:22:33.886978+0000","last_undegraded":"2024-09-11T22:22:33.886978+0000","last_fullsized":"2024-09-11T22:22:33.886978+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.839583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889321+0000","last_change":"2024-09-11T22:22:33.882949+0000","last_active":"2024-09-11T22:22:33.889321+0000","last_peered":"2024-09-11T22:22:33.889321+0000","last_clean":"2024-09-11T22:22:33.889321+0000","last_became_active":"2024-09-11T22:22:33.882659+0000","last_became_peered":"2024-09-11T22:22:33.882659+0000","last_unstale":"2024-09-11T22:22:33.889321+0000","last_undegraded":"2024-09-11T22:22:33.889321+0000","last_fullsized":"2024-09-11T22:22:33.889321+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:41:23.986542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865728+0000","last_change":"2024-09-11T22:22:32.869908+0000","last_active":"2024-09-11T22:22:33.865728+0000","last_peered":"2024-09-11T22:22:33.865728+0000","last_clean":"2024-09-11T22:22:33.865728+0000","last_became_active":"2024-09-11T22:22:32.869622+0000","last_became_peered":"2024-09-11T22:22:32.869622+0000","last_unstale":"2024-09-11T22:22:33.865728+0000","last_undegraded":"2024-09-11T22:22:33.865728+0000","last_fullsized":"2024-09-11T22:22:33.865728+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:26.942462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872544+0000","last_change":"2024-09-11T22:22:32.874747+0000","last_active":"2024-09-11T22:22:33.872544+0000","last_peered":"2024-09-11T22:22:33.872544+0000","last_clean":"2024-09-11T22:22:33.872544+0000","last_became_active":"2024-09-11T22:22:32.874454+0000","last_became_peered":"2024-09-11T22:22:32.874454+0000","last_unstale":"2024-09-11T22:22:33.872544+0000","last_undegraded":"2024-09-11T22:22:33.872544+0000","last_fullsized":"2024-09-11T22:22:33.872544+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:20.850041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872183+0000","last_change":"2024-09-11T22:22:33.871139+0000","last_active":"2024-09-11T22:22:33.872183+0000","last_peered":"2024-09-11T22:22:33.872183+0000","last_clean":"2024-09-11T22:22:33.872183+0000","last_became_active":"2024-09-11T22:22:33.870706+0000","last_became_peered":"2024-09-11T22:22:33.870706+0000","last_unstale":"2024-09-11T22:22:33.872183+0000","last_undegraded":"2024-09-11T22:22:33.872183+0000","last_fullsized":"2024-09-11T22:22:33.872183+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:06.718551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:31.841988+0000","last_change":"2024-09-11T22:22:31.841988+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.841988+0000","last_undegraded":"2024-09-11T22:22:31.841988+0000","last_fullsized":"2024-09-11T22:22:31.841988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.871584+0000","last_change":"2024-09-11T22:22:33.869366+0000","last_active":"2024-09-11T22:22:33.871584+0000","last_peered":"2024-09-11T22:22:33.871584+0000","last_clean":"2024-09-11T22:22:33.871584+0000","last_became_active":"2024-09-11T22:22:33.869095+0000","last_became_peered":"2024-09-11T22:22:33.869095+0000","last_unstale":"2024-09-11T22:22:33.871584+0000","last_undegraded":"2024-09-11T22:22:33.871584+0000","last_fullsized":"2024-09-11T22:22:33.871584+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:08.615227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.891842+0000","last_change":"2024-09-11T22:22:32.869194+0000","last_active":"2024-09-11T22:22:33.891842+0000","last_peered":"2024-09-11T22:22:33.891842+0000","last_clean":"2024-09-11T22:22:33.891842+0000","last_became_active":"2024-09-11T22:22:32.868931+0000","last_became_peered":"2024-09-11T22:22:32.868931+0000","last_unstale":"2024-09-11T22:22:33.891842+0000","last_undegraded":"2024-09-11T22:22:33.891842+0000","last_fullsized":"2024-09-11T22:22:33.891842+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:41.209428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.884771+0000","last_change":"2024-09-11T22:22:33.884363+0000","last_active":"2024-09-11T22:22:33.884771+0000","last_peered":"2024-09-11T22:22:33.884771+0000","last_clean":"2024-09-11T22:22:33.884771+0000","last_became_active":"2024-09-11T22:22:33.884103+0000","last_became_peered":"2024-09-11T22:22:33.884103+0000","last_unstale":"2024-09-11T22:22:33.884771+0000","last_undegraded":"2024-09-11T22:22:33.884771+0000","last_fullsized":"2024-09-11T22:22:33.884771+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:09.845653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"177'2","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892467+0000","last_change":"2024-09-11T22:22:32.875435+0000","last_active":"2024-09-11T22:22:33.892467+0000","last_peered":"2024-09-11T22:22:33.892467+0000","last_clean":"2024-09-11T22:22:33.892467+0000","last_became_active":"2024-09-11T22:22:32.875176+0000","last_became_peered":"2024-09-11T22:22:32.875176+0000","last_unstale":"2024-09-11T22:22:33.892467+0000","last_undegraded":"2024-09-11T22:22:33.892467+0000","last_fullsized":"2024-09-11T22:22:33.892467+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:28.777018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.891285+0000","last_change":"2024-09-11T22:22:32.873935+0000","last_active":"2024-09-11T22:22:33.891285+0000","last_peered":"2024-09-11T22:22:33.891285+0000","last_clean":"2024-09-11T22:22:33.891285+0000","last_became_active":"2024-09-11T22:22:32.872709+0000","last_became_peered":"2024-09-11T22:22:32.872709+0000","last_unstale":"2024-09-11T22:22:33.891285+0000","last_undegraded":"2024-09-11T22:22:33.891285+0000","last_fullsized":"2024-09-11T22:22:33.891285+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:50.413075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.888390+0000","last_change":"2024-09-11T22:22:33.879571+0000","last_active":"2024-09-11T22:22:33.888390+0000","last_peered":"2024-09-11T22:22:33.888390+0000","last_clean":"2024-09-11T22:22:33.888390+0000","last_became_active":"2024-09-11T22:22:33.879288+0000","last_became_peered":"2024-09-11T22:22:33.879288+0000","last_unstale":"2024-09-11T22:22:33.888390+0000","last_undegraded":"2024-09-11T22:22:33.888390+0000","last_fullsized":"2024-09-11T22:22:33.888390+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:19.325750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:31.841988+0000","last_change":"2024-09-11T22:22:31.841988+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.841988+0000","last_undegraded":"2024-09-11T22:22:31.841988+0000","last_fullsized":"2024-09-11T22:22:31.841988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889301+0000","last_change":"2024-09-11T22:22:33.882673+0000","last_active":"2024-09-11T22:22:33.889301+0000","last_peered":"2024-09-11T22:22:33.889301+0000","last_clean":"2024-09-11T22:22:33.889301+0000","last_became_active":"2024-09-11T22:22:33.881961+0000","last_became_peered":"2024-09-11T22:22:33.881961+0000","last_unstale":"2024-09-11T22:22:33.889301+0000","last_undegraded":"2024-09-11T22:22:33.889301+0000","last_fullsized":"2024-09-11T22:22:33.889301+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:40.704844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"177'2","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892004+0000","last_change":"2024-09-11T22:22:32.871013+0000","last_active":"2024-09-11T22:22:33.892004+0000","last_peered":"2024-09-11T22:22:33.892004+0000","last_clean":"2024-09-11T22:22:33.892004+0000","last_became_active":"2024-09-11T22:22:32.869592+0000","last_became_peered":"2024-09-11T22:22:32.869592+0000","last_unstale":"2024-09-11T22:22:33.892004+0000","last_undegraded":"2024-09-11T22:22:33.892004+0000","last_fullsized":"2024-09-11T22:22:33.892004+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:02.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870436+0000","last_change":"2024-09-11T22:22:32.868236+0000","last_active":"2024-09-11T22:22:33.870436+0000","last_peered":"2024-09-11T22:22:33.870436+0000","last_clean":"2024-09-11T22:22:33.870436+0000","last_became_active":"2024-09-11T22:22:32.867876+0000","last_became_peered":"2024-09-11T22:22:32.867876+0000","last_unstale":"2024-09-11T22:22:33.870436+0000","last_undegraded":"2024-09-11T22:22:33.870436+0000","last_fullsized":"2024-09-11T22:22:33.870436+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:51.010593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870299+0000","last_change":"2024-09-11T22:22:33.866913+0000","last_active":"2024-09-11T22:22:33.870299+0000","last_peered":"2024-09-11T22:22:33.870299+0000","last_clean":"2024-09-11T22:22:33.870299+0000","last_became_active":"2024-09-11T22:22:33.866628+0000","last_became_peered":"2024-09-11T22:22:33.866628+0000","last_unstale":"2024-09-11T22:22:33.870299+0000","last_undegraded":"2024-09-11T22:22:33.870299+0000","last_fullsized":"2024-09-11T22:22:33.870299+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:29.858473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867015+0000","last_change":"2024-09-11T22:22:32.872329+0000","last_active":"2024-09-11T22:22:33.867015+0000","last_peered":"2024-09-11T22:22:33.867015+0000","last_clean":"2024-09-11T22:22:33.867015+0000","last_became_active":"2024-09-11T22:22:32.871836+0000","last_became_peered":"2024-09-11T22:22:32.871836+0000","last_unstale":"2024-09-11T22:22:33.867015+0000","last_undegraded":"2024-09-11T22:22:33.867015+0000","last_fullsized":"2024-09-11T22:22:33.867015+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:16.999557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877594+0000","last_change":"2024-09-11T22:22:33.876747+0000","last_active":"2024-09-11T22:22:33.877594+0000","last_peered":"2024-09-11T22:22:33.877594+0000","last_clean":"2024-09-11T22:22:33.877594+0000","last_became_active":"2024-09-11T22:22:33.876137+0000","last_became_peered":"2024-09-11T22:22:33.876137+0000","last_unstale":"2024-09-11T22:22:33.877594+0000","last_undegraded":"2024-09-11T22:22:33.877594+0000","last_fullsized":"2024-09-11T22:22:33.877594+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:21.561002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867731+0000","last_change":"2024-09-11T22:22:32.873479+0000","last_active":"2024-09-11T22:22:33.867731+0000","last_peered":"2024-09-11T22:22:33.867731+0000","last_clean":"2024-09-11T22:22:33.867731+0000","last_became_active":"2024-09-11T22:22:32.873187+0000","last_became_peered":"2024-09-11T22:22:32.873187+0000","last_unstale":"2024-09-11T22:22:33.867731+0000","last_undegraded":"2024-09-11T22:22:33.867731+0000","last_fullsized":"2024-09-11T22:22:33.867731+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:52.625796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.883423+0000","last_change":"2024-09-11T22:22:33.882379+0000","last_active":"2024-09-11T22:22:33.883423+0000","last_peered":"2024-09-11T22:22:33.883423+0000","last_clean":"2024-09-11T22:22:33.883423+0000","last_became_active":"2024-09-11T22:22:33.882098+0000","last_became_peered":"2024-09-11T22:22:33.882098+0000","last_unstale":"2024-09-11T22:22:33.883423+0000","last_undegraded":"2024-09-11T22:22:33.883423+0000","last_fullsized":"2024-09-11T22:22:33.883423+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:59.833957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:31.841988+0000","last_change":"2024-09-11T22:22:31.841988+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.841988+0000","last_undegraded":"2024-09-11T22:22:31.841988+0000","last_fullsized":"2024-09-11T22:22:31.841988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890546+0000","last_change":"2024-09-11T22:22:33.880882+0000","last_active":"2024-09-11T22:22:33.890546+0000","last_peered":"2024-09-11T22:22:33.890546+0000","last_clean":"2024-09-11T22:22:33.890546+0000","last_became_active":"2024-09-11T22:22:33.880577+0000","last_became_peered":"2024-09-11T22:22:33.880577+0000","last_unstale":"2024-09-11T22:22:33.890546+0000","last_undegraded":"2024-09-11T22:22:33.890546+0000","last_fullsized":"2024-09-11T22:22:33.890546+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:42.639899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2024-09-11T22:22:31.854949+0000","last_change":"2024-09-11T22:22:31.854949+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.854949+0000","last_undegraded":"2024-09-11T22:22:31.854949+0000","last_fullsized":"2024-09-11T22:22:31.854949+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877067+0000","last_change":"2024-09-11T22:22:33.875215+0000","last_active":"2024-09-11T22:22:33.877067+0000","last_peered":"2024-09-11T22:22:33.877067+0000","last_clean":"2024-09-11T22:22:33.877067+0000","last_became_active":"2024-09-11T22:22:33.874961+0000","last_became_peered":"2024-09-11T22:22:33.874961+0000","last_unstale":"2024-09-11T22:22:33.877067+0000","last_undegraded":"2024-09-11T22:22:33.877067+0000","last_fullsized":"2024-09-11T22:22:33.877067+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:27.948531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.869538+0000","last_change":"2024-09-11T22:22:32.867763+0000","last_active":"2024-09-11T22:22:33.869538+0000","last_peered":"2024-09-11T22:22:33.869538+0000","last_clean":"2024-09-11T22:22:33.869538+0000","last_became_active":"2024-09-11T22:22:32.867493+0000","last_became_peered":"2024-09-11T22:22:32.867493+0000","last_unstale":"2024-09-11T22:22:33.869538+0000","last_undegraded":"2024-09-11T22:22:33.869538+0000","last_fullsized":"2024-09-11T22:22:33.869538+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:13.188631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.873056+0000","last_change":"2024-09-11T22:22:33.871871+0000","last_active":"2024-09-11T22:22:33.873056+0000","last_peered":"2024-09-11T22:22:33.873056+0000","last_clean":"2024-09-11T22:22:33.873056+0000","last_became_active":"2024-09-11T22:22:33.871567+0000","last_became_peered":"2024-09-11T22:22:33.871567+0000","last_unstale":"2024-09-11T22:22:33.873056+0000","last_undegraded":"2024-09-11T22:22:33.873056+0000","last_fullsized":"2024-09-11T22:22:33.873056+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:17.954497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:31.841988+0000","last_change":"2024-09-11T22:22:31.841988+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.841988+0000","last_undegraded":"2024-09-11T22:22:31.841988+0000","last_fullsized":"2024-09-11T22:22:31.841988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875021+0000","last_change":"2024-09-11T22:22:33.872648+0000","last_active":"2024-09-11T22:22:33.875021+0000","last_peered":"2024-09-11T22:22:33.875021+0000","last_clean":"2024-09-11T22:22:33.875021+0000","last_became_active":"2024-09-11T22:22:33.872364+0000","last_became_peered":"2024-09-11T22:22:33.872364+0000","last_unstale":"2024-09-11T22:22:33.875021+0000","last_undegraded":"2024-09-11T22:22:33.875021+0000","last_fullsized":"2024-09-11T22:22:33.875021+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.051705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":1,"reported_epoch":175,"state":"creating+peering","last_fresh":"2024-09-11T22:22:31.854990+0000","last_change":"2024-09-11T22:22:31.854990+0000","last_active":"2024-09-11T22:22:31.841988+0000","last_peered":"2024-09-11T22:22:31.841988+0000","last_clean":"2024-09-11T22:22:31.841988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:31.854990+0000","last_undegraded":"2024-09-11T22:22:31.854990+0000","last_fullsized":"2024-09-11T22:22:31.854990+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.882948+0000","last_change":"2024-09-11T22:22:33.882413+0000","last_active":"2024-09-11T22:22:33.882948+0000","last_peered":"2024-09-11T22:22:33.882948+0000","last_clean":"2024-09-11T22:22:33.882948+0000","last_became_active":"2024-09-11T22:22:33.882153+0000","last_became_peered":"2024-09-11T22:22:33.882153+0000","last_unstale":"2024-09-11T22:22:33.882948+0000","last_undegraded":"2024-09-11T22:22:33.882948+0000","last_fullsized":"2024-09-11T22:22:33.882948+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:08.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867928+0000","last_change":"2024-09-11T22:22:32.876657+0000","last_active":"2024-09-11T22:22:33.867928+0000","last_peered":"2024-09-11T22:22:33.867928+0000","last_clean":"2024-09-11T22:22:33.867928+0000","last_became_active":"2024-09-11T22:22:32.876140+0000","last_became_peered":"2024-09-11T22:22:32.876140+0000","last_unstale":"2024-09-11T22:22:33.867928+0000","last_undegraded":"2024-09-11T22:22:33.867928+0000","last_fullsized":"2024-09-11T22:22:33.867928+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:21.127707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:22:32.848058+0000","last_change":"2024-09-11T22:22:32.848058+0000","last_active":"2024-09-11T22:22:32.848058+0000","last_peered":"2024-09-11T22:22:32.848058+0000","last_clean":"2024-09-11T22:22:32.848058+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:22:32.848058+0000","last_undegraded":"2024-09-11T22:22:32.848058+0000","last_fullsized":"2024-09-11T22:22:32.848058+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865883+0000","last_change":"2024-09-11T22:22:32.874909+0000","last_active":"2024-09-11T22:22:33.865883+0000","last_peered":"2024-09-11T22:22:33.865883+0000","last_clean":"2024-09-11T22:22:33.865883+0000","last_became_active":"2024-09-11T22:22:32.874627+0000","last_became_peered":"2024-09-11T22:22:32.874627+0000","last_unstale":"2024-09-11T22:22:33.865883+0000","last_undegraded":"2024-09-11T22:22:33.865883+0000","last_fullsized":"2024-09-11T22:22:33.865883+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:56.207572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875724+0000","last_change":"2024-09-11T22:22:33.871239+0000","last_active":"2024-09-11T22:22:33.875724+0000","last_peered":"2024-09-11T22:22:33.875724+0000","last_clean":"2024-09-11T22:22:33.875724+0000","last_became_active":"2024-09-11T22:22:33.870917+0000","last_became_peered":"2024-09-11T22:22:33.870917+0000","last_unstale":"2024-09-11T22:22:33.875724+0000","last_undegraded":"2024-09-11T22:22:33.875724+0000","last_fullsized":"2024-09-11T22:22:33.875724+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:00.855479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.862829+0000","last_change":"2024-09-11T22:22:32.876591+0000","last_active":"2024-09-11T22:22:33.862829+0000","last_peered":"2024-09-11T22:22:33.862829+0000","last_clean":"2024-09-11T22:22:33.862829+0000","last_became_active":"2024-09-11T22:22:32.876343+0000","last_became_peered":"2024-09-11T22:22:32.876343+0000","last_unstale":"2024-09-11T22:22:33.862829+0000","last_undegraded":"2024-09-11T22:22:33.862829+0000","last_fullsized":"2024-09-11T22:22:33.862829+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.839583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890564+0000","last_change":"2024-09-11T22:22:33.881708+0000","last_active":"2024-09-11T22:22:33.890564+0000","last_peered":"2024-09-11T22:22:33.890564+0000","last_clean":"2024-09-11T22:22:33.890564+0000","last_became_active":"2024-09-11T22:22:33.880955+0000","last_became_peered":"2024-09-11T22:22:33.880955+0000","last_unstale":"2024-09-11T22:22:33.890564+0000","last_undegraded":"2024-09-11T22:22:33.890564+0000","last_fullsized":"2024-09-11T22:22:33.890564+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:40.704844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.891456+0000","last_change":"2024-09-11T22:22:32.876390+0000","last_active":"2024-09-11T22:22:33.891456+0000","last_peered":"2024-09-11T22:22:33.891456+0000","last_clean":"2024-09-11T22:22:33.891456+0000","last_became_active":"2024-09-11T22:22:32.876077+0000","last_became_peered":"2024-09-11T22:22:32.876077+0000","last_unstale":"2024-09-11T22:22:33.891456+0000","last_undegraded":"2024-09-11T22:22:33.891456+0000","last_fullsized":"2024-09-11T22:22:33.891456+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:16.948428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":449,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-11T22:22:31.855715+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:22:31.855715+0000","last_peered":"2024-09-11T22:22:31.855715+0000","last_clean":"2024-09-11T22:22:31.855715+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:22:31.855715+0000","last_undegraded":"2024-09-11T22:22:31.855715+0000","last_fullsized":"2024-09-11T22:22:31.855715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":54,"acting":54,"num_store_stats":7},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509583,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55576,"kb_used_data":2176,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316264,"statfs":{"total":96636764160,"available":96579854336,"internally_reserved":0,"allocated":2228224,"data_stored":977912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509580,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51400,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320440,"statfs":{"total":96636764160,"available":96584130560,"internally_reserved":0,"allocated":2211840,"data_stored":970555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509582,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63916,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307924,"statfs":{"total":96636764160,"available":96571314176,"internally_reserved":0,"allocated":2244608,"data_stored":979046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509582,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47268,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324572,"statfs":{"total":96636764160,"available":96588361728,"internally_reserved":0,"allocated":2236416,"data_stored":977512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509582,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47256,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324584,"statfs":{"total":96636764160,"available":96588374016,"internally_reserved":0,"allocated":2232320,"data_stored":977386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509581,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60300,"kb_used_data":2740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311540,"statfs":{"total":96636764160,"available":96575016960,"internally_reserved":0,"allocated":2805760,"data_stored":1560923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574989,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56116,"kb_used_data":2716,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315724,"statfs":{"total":96636764160,"available":96579301376,"internally_reserved":0,"allocated":2781184,"data_stored":1548831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47212,"kb_used_data":2136,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324628,"statfs":{"total":96636764160,"available":96588419072,"internally_reserved":0,"allocated":2187264,"data_stored":958463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:22:37.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:22:37.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.344+0000 7f43f01e8640 1 Processor -- start 2024-09-11T22:22:37.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.344+0000 7f43f01e8640 1 -- start start 2024-09-11T22:22:37.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43f01e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80d05e0 0x7f43e80b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43f01e8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43e80b3e10 0x7f43e80ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43f01e8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e80b4f00 con 0x7f43e815c2c0 2024-09-11T22:22:37.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43f01e8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f43e80b4360 con 0x7f43e80b3e10 2024-09-11T22:22:37.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43f01e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43e80b51c0 con 0x7f43e80d05e0 2024-09-11T22:22:37.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43ee785640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43e80b3e10 0x7f43e80ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43edf84640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f43e815c2c0 0x7f43e80cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39310/0 (socket says 172.21.15.50:39310) 2024-09-11T22:22:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43edf84640 1 -- 172.21.15.50:0/4288289104 learned_addr learned my addr 172.21.15.50:0/4288289104 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43ee785640 1 -- 172.21.15.50:0/4288289104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80d05e0 msgr2=0x7f43e80b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43ed783640 1 --2- 172.21.15.50:0/4288289104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80d05e0 0x7f43e80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43ee785640 1 --2- 172.21.15.50:0/4288289104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80d05e0 0x7f43e80b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43ee785640 1 -- 172.21.15.50:0/4288289104 >> v1:172.21.15.50:6789/0 conn(0x7f43e815c2c0 legacy=0x7f43e80cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43ee785640 1 -- 172.21.15.50:0/4288289104 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e80b54a0 con 0x7f43e80b3e10 2024-09-11T22:22:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43ecf82640 1 -- 172.21.15.50:0/4288289104 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 969965787 0 0) 0x7f43e80b4f00 con 0x7f43e815c2c0 2024-09-11T22:22:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.345+0000 7f43ed783640 1 --2- 172.21.15.50:0/4288289104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80d05e0 0x7f43e80b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.346+0000 7f43ee785640 1 --2- 172.21.15.50:0/4288289104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e80b3e10 0x7f43e80ce790 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009d90 tx=0x7f43e002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=961fb8d420c24ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.346+0000 7f43ecf82640 1 -- 172.21.15.50:0/4288289104 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0007740 con 0x7f43e80b3e10 2024-09-11T22:22:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.346+0000 7f43ecf82640 1 -- 172.21.15.50:0/4288289104 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e00078e0 con 0x7f43e80b3e10 2024-09-11T22:22:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.346+0000 7f43ecf82640 1 -- 172.21.15.50:0/4288289104 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0007cb0 con 0x7f43e80b3e10 2024-09-11T22:22:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.347+0000 7f43f01e8640 1 -- 172.21.15.50:0/4288289104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e80b3e10 msgr2=0x7f43e80ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.347+0000 7f43f01e8640 1 --2- 172.21.15.50:0/4288289104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e80b3e10 0x7f43e80ce790 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009d90 tx=0x7f43e002a660 comp rx=0 tx=0).stop 2024-09-11T22:22:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.347+0000 7f43f01e8640 1 -- 172.21.15.50:0/4288289104 shutdown_connections 2024-09-11T22:22:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.347+0000 7f43f01e8640 1 --2- 172.21.15.50:0/4288289104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e80b3e10 0x7f43e80ce790 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.347+0000 7f43f01e8640 1 --2- 172.21.15.50:0/4288289104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80d05e0 0x7f43e80b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.347+0000 7f43f01e8640 1 -- 172.21.15.50:0/4288289104 >> 172.21.15.50:0/4288289104 conn(0x7f43e80679c0 msgr2=0x7f43e8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:37.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.347+0000 7f43f01e8640 1 -- 172.21.15.50:0/4288289104 shutdown_connections 2024-09-11T22:22:37.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.347+0000 7f43f01e8640 1 -- 172.21.15.50:0/4288289104 wait complete. 2024-09-11T22:22:37.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.348+0000 7f43f01e8640 1 Processor -- start 2024-09-11T22:22:37.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.348+0000 7f43f01e8640 1 -- start start 2024-09-11T22:22:37.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43f01e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80b3e10 0x7f43e8150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43f01e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e80d05e0 0x7f43e8151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43f01e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815c2c0 0x7f43e81f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43f01e8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43e806d070 con 0x7f43e815c2c0 2024-09-11T22:22:37.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43f01e8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43e80ce200 con 0x7f43e80d05e0 2024-09-11T22:22:37.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43f01e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43e806d1f0 con 0x7f43e80b3e10 2024-09-11T22:22:37.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43ee785640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815c2c0 0x7f43e81f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43ee785640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815c2c0 0x7f43e81f3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48122/0 (socket says 172.21.15.50:48122) 2024-09-11T22:22:37.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43ee785640 1 -- 172.21.15.50:0/3778047629 learned_addr learned my addr 172.21.15.50:0/3778047629 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:37.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43edf84640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80b3e10 0x7f43e8150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43ed783640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e80d05e0 0x7f43e8151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43ee785640 1 -- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80b3e10 msgr2=0x7f43e8150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43ee785640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80b3e10 0x7f43e8150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43ee785640 1 -- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e80d05e0 msgr2=0x7f43e8151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43ee785640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e80d05e0 0x7f43e8151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43ee785640 1 -- 172.21.15.50:0/3778047629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e81511d0 con 0x7f43e815c2c0 2024-09-11T22:22:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43edf84640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80b3e10 0x7f43e8150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43ed783640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e80d05e0 0x7f43e8151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.349+0000 7f43ee785640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815c2c0 0x7f43e81f3100 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f43e002ac50 tx=0x7f43e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.350+0000 7f43de7fc640 1 -- 172.21.15.50:0/3778047629 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0040070 con 0x7f43e815c2c0 2024-09-11T22:22:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.350+0000 7f43de7fc640 1 -- 172.21.15.50:0/3778047629 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e0031c90 con 0x7f43e815c2c0 2024-09-11T22:22:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.350+0000 7f43de7fc640 1 -- 172.21.15.50:0/3778047629 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0045680 con 0x7f43e815c2c0 2024-09-11T22:22:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.350+0000 7f43f01e8640 1 -- 172.21.15.50:0/3778047629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e814fbf0 con 0x7f43e815c2c0 2024-09-11T22:22:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.350+0000 7f43f01e8640 1 -- 172.21.15.50:0/3778047629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e81501b0 con 0x7f43e815c2c0 2024-09-11T22:22:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.351+0000 7f43f01e8640 1 -- 172.21.15.50:0/3778047629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e815c6a0 con 0x7f43e815c2c0 2024-09-11T22:22:37.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.351+0000 7f43de7fc640 1 -- 172.21.15.50:0/3778047629 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43e0039040 con 0x7f43e815c2c0 2024-09-11T22:22:37.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.352+0000 7f43de7fc640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43cc06be60 0x7f43cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.352+0000 7f43de7fc640 1 -- 172.21.15.50:0/3778047629 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f43e00ac4f0 con 0x7f43e815c2c0 2024-09-11T22:22:37.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.352+0000 7f43edf84640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43cc06be60 0x7f43cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.352+0000 7f43edf84640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43cc06be60 0x7f43cc06e320 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f43e4000f60 tx=0x7f43e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:37.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.356+0000 7f43de7fc640 1 -- 172.21.15.50:0/3778047629 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43e004c030 con 0x7f43e815c2c0 2024-09-11T22:22:37.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.527+0000 7f43f01e8640 1 -- 172.21.15.50:0/3778047629 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43e806ee60 con 0x7f43cc06be60 2024-09-11T22:22:37.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.534+0000 7f43de7fc640 1 -- 172.21.15.50:0/3778047629 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252439 (secure 0 0 0) 0x7f43e806ee60 con 0x7f43cc06be60 2024-09-11T22:22:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:37.538 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:22:37.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.536+0000 7f43f01e8640 1 -- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43cc06be60 msgr2=0x7f43cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.536+0000 7f43f01e8640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43cc06be60 0x7f43cc06e320 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f43e4000f60 tx=0x7f43e4009040 comp rx=0 tx=0).stop 2024-09-11T22:22:37.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.536+0000 7f43f01e8640 1 -- 172.21.15.50:0/3778047629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815c2c0 msgr2=0x7f43e81f3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.536+0000 7f43f01e8640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815c2c0 0x7f43e81f3100 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f43e002ac50 tx=0x7f43e0004a40 comp rx=0 tx=0).stop 2024-09-11T22:22:37.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.536+0000 7f43f01e8640 1 -- 172.21.15.50:0/3778047629 shutdown_connections 2024-09-11T22:22:37.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.536+0000 7f43f01e8640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f43cc06be60 0x7f43cc06e320 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.536+0000 7f43f01e8640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43e815c2c0 0x7f43e81f3100 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.536+0000 7f43f01e8640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e80d05e0 0x7f43e8151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.536+0000 7f43f01e8640 1 --2- 172.21.15.50:0/3778047629 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e80b3e10 0x7f43e8150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.536+0000 7f43f01e8640 1 -- 172.21.15.50:0/3778047629 >> 172.21.15.50:0/3778047629 conn(0x7f43e80679c0 msgr2=0x7f43e80cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:37.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.537+0000 7f43f01e8640 1 -- 172.21.15.50:0/3778047629 shutdown_connections 2024-09-11T22:22:37.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.537+0000 7f43f01e8640 1 -- 172.21.15.50:0/3778047629 wait complete. 2024-09-11T22:22:37.548 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":519,"stamp":"2024-09-11T22:22:37.528236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":429148,"kb_used_data":18592,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754545572,"statfs":{"total":773094113280,"available":772654665728,"internally_reserved":0,"allocated":19038208,"data_stored":9002574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":420204081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.677491"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875080+0000","last_change":"2024-09-11T22:22:33.873367+0000","last_active":"2024-09-11T22:22:33.875080+0000","last_peered":"2024-09-11T22:22:33.875080+0000","last_clean":"2024-09-11T22:22:33.875080+0000","last_became_active":"2024-09-11T22:22:33.873099+0000","last_became_peered":"2024-09-11T22:22:33.873099+0000","last_unstale":"2024-09-11T22:22:33.875080+0000","last_undegraded":"2024-09-11T22:22:33.875080+0000","last_fullsized":"2024-09-11T22:22:33.875080+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:21.856111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870192+0000","last_change":"2024-09-11T22:22:33.866561+0000","last_active":"2024-09-11T22:22:33.870192+0000","last_peered":"2024-09-11T22:22:33.870192+0000","last_clean":"2024-09-11T22:22:33.870192+0000","last_became_active":"2024-09-11T22:22:33.866301+0000","last_became_peered":"2024-09-11T22:22:33.866301+0000","last_unstale":"2024-09-11T22:22:33.870192+0000","last_undegraded":"2024-09-11T22:22:33.870192+0000","last_fullsized":"2024-09-11T22:22:33.870192+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:06.549937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104734+0000","last_change":"2024-09-11T22:22:33.868962+0000","last_active":"2024-09-11T22:22:35.104734+0000","last_peered":"2024-09-11T22:22:35.104734+0000","last_clean":"2024-09-11T22:22:35.104734+0000","last_became_active":"2024-09-11T22:22:33.868653+0000","last_became_peered":"2024-09-11T22:22:33.868653+0000","last_unstale":"2024-09-11T22:22:35.104734+0000","last_undegraded":"2024-09-11T22:22:35.104734+0000","last_fullsized":"2024-09-11T22:22:35.104734+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:33.447406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879550+0000","last_change":"2024-09-11T22:22:33.873473+0000","last_active":"2024-09-11T22:22:34.879550+0000","last_peered":"2024-09-11T22:22:34.879550+0000","last_clean":"2024-09-11T22:22:34.879550+0000","last_became_active":"2024-09-11T22:22:33.873210+0000","last_became_peered":"2024-09-11T22:22:33.873210+0000","last_unstale":"2024-09-11T22:22:34.879550+0000","last_undegraded":"2024-09-11T22:22:34.879550+0000","last_fullsized":"2024-09-11T22:22:34.879550+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:45:28.677309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886331+0000","last_change":"2024-09-11T22:22:33.884861+0000","last_active":"2024-09-11T22:22:33.886331+0000","last_peered":"2024-09-11T22:22:33.886331+0000","last_clean":"2024-09-11T22:22:33.886331+0000","last_became_active":"2024-09-11T22:22:33.884592+0000","last_became_peered":"2024-09-11T22:22:33.884592+0000","last_unstale":"2024-09-11T22:22:33.886331+0000","last_undegraded":"2024-09-11T22:22:33.886331+0000","last_fullsized":"2024-09-11T22:22:33.886331+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:07.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877696+0000","last_change":"2024-09-11T22:22:33.874296+0000","last_active":"2024-09-11T22:22:33.877696+0000","last_peered":"2024-09-11T22:22:33.877696+0000","last_clean":"2024-09-11T22:22:33.877696+0000","last_became_active":"2024-09-11T22:22:33.873767+0000","last_became_peered":"2024-09-11T22:22:33.873767+0000","last_unstale":"2024-09-11T22:22:33.877696+0000","last_undegraded":"2024-09-11T22:22:33.877696+0000","last_fullsized":"2024-09-11T22:22:33.877696+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:52:53.352386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872845+0000","last_change":"2024-09-11T22:22:33.871884+0000","last_active":"2024-09-11T22:22:33.872845+0000","last_peered":"2024-09-11T22:22:33.872845+0000","last_clean":"2024-09-11T22:22:33.872845+0000","last_became_active":"2024-09-11T22:22:33.871465+0000","last_became_peered":"2024-09-11T22:22:33.871465+0000","last_unstale":"2024-09-11T22:22:33.872845+0000","last_undegraded":"2024-09-11T22:22:33.872845+0000","last_fullsized":"2024-09-11T22:22:33.872845+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:19.002541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876905+0000","last_change":"2024-09-11T22:22:33.872124+0000","last_active":"2024-09-11T22:22:33.876905+0000","last_peered":"2024-09-11T22:22:33.876905+0000","last_clean":"2024-09-11T22:22:33.876905+0000","last_became_active":"2024-09-11T22:22:33.871835+0000","last_became_peered":"2024-09-11T22:22:33.871835+0000","last_unstale":"2024-09-11T22:22:33.876905+0000","last_undegraded":"2024-09-11T22:22:33.876905+0000","last_fullsized":"2024-09-11T22:22:33.876905+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:07.845885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870861+0000","last_change":"2024-09-11T22:22:33.869901+0000","last_active":"2024-09-11T22:22:33.870861+0000","last_peered":"2024-09-11T22:22:33.870861+0000","last_clean":"2024-09-11T22:22:33.870861+0000","last_became_active":"2024-09-11T22:22:33.869519+0000","last_became_peered":"2024-09-11T22:22:33.869519+0000","last_unstale":"2024-09-11T22:22:33.870861+0000","last_undegraded":"2024-09-11T22:22:33.870861+0000","last_fullsized":"2024-09-11T22:22:33.870861+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:34.311452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892605+0000","last_change":"2024-09-11T22:22:33.891761+0000","last_active":"2024-09-11T22:22:33.892605+0000","last_peered":"2024-09-11T22:22:33.892605+0000","last_clean":"2024-09-11T22:22:33.892605+0000","last_became_active":"2024-09-11T22:22:33.891431+0000","last_became_peered":"2024-09-11T22:22:33.891431+0000","last_unstale":"2024-09-11T22:22:33.892605+0000","last_undegraded":"2024-09-11T22:22:33.892605+0000","last_fullsized":"2024-09-11T22:22:33.892605+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:41.584550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104945+0000","last_change":"2024-09-11T22:22:33.871995+0000","last_active":"2024-09-11T22:22:35.104945+0000","last_peered":"2024-09-11T22:22:35.104945+0000","last_clean":"2024-09-11T22:22:35.104945+0000","last_became_active":"2024-09-11T22:22:33.870641+0000","last_became_peered":"2024-09-11T22:22:33.870641+0000","last_unstale":"2024-09-11T22:22:35.104945+0000","last_undegraded":"2024-09-11T22:22:35.104945+0000","last_fullsized":"2024-09-11T22:22:35.104945+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:53.922070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875604+0000","last_change":"2024-09-11T22:22:33.873332+0000","last_active":"2024-09-11T22:22:33.875604+0000","last_peered":"2024-09-11T22:22:33.875604+0000","last_clean":"2024-09-11T22:22:33.875604+0000","last_became_active":"2024-09-11T22:22:33.873063+0000","last_became_peered":"2024-09-11T22:22:33.873063+0000","last_unstale":"2024-09-11T22:22:33.875604+0000","last_undegraded":"2024-09-11T22:22:33.875604+0000","last_fullsized":"2024-09-11T22:22:33.875604+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:19.441983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875867+0000","last_change":"2024-09-11T22:22:33.872546+0000","last_active":"2024-09-11T22:22:33.875867+0000","last_peered":"2024-09-11T22:22:33.875867+0000","last_clean":"2024-09-11T22:22:33.875867+0000","last_became_active":"2024-09-11T22:22:33.871688+0000","last_became_peered":"2024-09-11T22:22:33.871688+0000","last_unstale":"2024-09-11T22:22:33.875867+0000","last_undegraded":"2024-09-11T22:22:33.875867+0000","last_fullsized":"2024-09-11T22:22:33.875867+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:13.685778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890673+0000","last_change":"2024-09-11T22:22:33.882001+0000","last_active":"2024-09-11T22:22:33.890673+0000","last_peered":"2024-09-11T22:22:33.890673+0000","last_clean":"2024-09-11T22:22:33.890673+0000","last_became_active":"2024-09-11T22:22:33.881567+0000","last_became_peered":"2024-09-11T22:22:33.881567+0000","last_unstale":"2024-09-11T22:22:33.890673+0000","last_undegraded":"2024-09-11T22:22:33.890673+0000","last_fullsized":"2024-09-11T22:22:33.890673+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:41:23.986542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890531+0000","last_change":"2024-09-11T22:22:33.883282+0000","last_active":"2024-09-11T22:22:33.890531+0000","last_peered":"2024-09-11T22:22:33.890531+0000","last_clean":"2024-09-11T22:22:33.890531+0000","last_became_active":"2024-09-11T22:22:33.882864+0000","last_became_peered":"2024-09-11T22:22:33.882864+0000","last_unstale":"2024-09-11T22:22:33.890531+0000","last_undegraded":"2024-09-11T22:22:33.890531+0000","last_fullsized":"2024-09-11T22:22:33.890531+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:54.323577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889383+0000","last_change":"2024-09-11T22:22:33.887311+0000","last_active":"2024-09-11T22:22:33.889383+0000","last_peered":"2024-09-11T22:22:33.889383+0000","last_clean":"2024-09-11T22:22:33.889383+0000","last_became_active":"2024-09-11T22:22:33.881922+0000","last_became_peered":"2024-09-11T22:22:33.881922+0000","last_unstale":"2024-09-11T22:22:33.889383+0000","last_undegraded":"2024-09-11T22:22:33.889383+0000","last_fullsized":"2024-09-11T22:22:33.889383+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:59.243443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877418+0000","last_change":"2024-09-11T22:22:33.876445+0000","last_active":"2024-09-11T22:22:33.877418+0000","last_peered":"2024-09-11T22:22:33.877418+0000","last_clean":"2024-09-11T22:22:33.877418+0000","last_became_active":"2024-09-11T22:22:33.876147+0000","last_became_peered":"2024-09-11T22:22:33.876147+0000","last_unstale":"2024-09-11T22:22:33.877418+0000","last_undegraded":"2024-09-11T22:22:33.877418+0000","last_fullsized":"2024-09-11T22:22:33.877418+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:03.175064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889328+0000","last_change":"2024-09-11T22:22:33.883306+0000","last_active":"2024-09-11T22:22:33.889328+0000","last_peered":"2024-09-11T22:22:33.889328+0000","last_clean":"2024-09-11T22:22:33.889328+0000","last_became_active":"2024-09-11T22:22:33.882092+0000","last_became_peered":"2024-09-11T22:22:33.882092+0000","last_unstale":"2024-09-11T22:22:33.889328+0000","last_undegraded":"2024-09-11T22:22:33.889328+0000","last_fullsized":"2024-09-11T22:22:33.889328+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:54.323577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890411+0000","last_change":"2024-09-11T22:22:33.883694+0000","last_active":"2024-09-11T22:22:33.890411+0000","last_peered":"2024-09-11T22:22:33.890411+0000","last_clean":"2024-09-11T22:22:33.890411+0000","last_became_active":"2024-09-11T22:22:33.883401+0000","last_became_peered":"2024-09-11T22:22:33.883401+0000","last_unstale":"2024-09-11T22:22:33.890411+0000","last_undegraded":"2024-09-11T22:22:33.890411+0000","last_fullsized":"2024-09-11T22:22:33.890411+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:48:06.450712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886164+0000","last_change":"2024-09-11T22:22:33.884828+0000","last_active":"2024-09-11T22:22:33.886164+0000","last_peered":"2024-09-11T22:22:33.886164+0000","last_clean":"2024-09-11T22:22:33.886164+0000","last_became_active":"2024-09-11T22:22:33.884077+0000","last_became_peered":"2024-09-11T22:22:33.884077+0000","last_unstale":"2024-09-11T22:22:33.886164+0000","last_undegraded":"2024-09-11T22:22:33.886164+0000","last_fullsized":"2024-09-11T22:22:33.886164+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:37.767944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879371+0000","last_change":"2024-09-11T22:22:33.882845+0000","last_active":"2024-09-11T22:22:34.879371+0000","last_peered":"2024-09-11T22:22:34.879371+0000","last_clean":"2024-09-11T22:22:34.879371+0000","last_became_active":"2024-09-11T22:22:33.882459+0000","last_became_peered":"2024-09-11T22:22:33.882459+0000","last_unstale":"2024-09-11T22:22:34.879371+0000","last_undegraded":"2024-09-11T22:22:34.879371+0000","last_fullsized":"2024-09-11T22:22:34.879371+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:54.725640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.887017+0000","last_change":"2024-09-11T22:22:33.886316+0000","last_active":"2024-09-11T22:22:33.887017+0000","last_peered":"2024-09-11T22:22:33.887017+0000","last_clean":"2024-09-11T22:22:33.887017+0000","last_became_active":"2024-09-11T22:22:33.886001+0000","last_became_peered":"2024-09-11T22:22:33.886001+0000","last_unstale":"2024-09-11T22:22:33.887017+0000","last_undegraded":"2024-09-11T22:22:33.887017+0000","last_fullsized":"2024-09-11T22:22:33.887017+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:20.158581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877317+0000","last_change":"2024-09-11T22:22:33.876492+0000","last_active":"2024-09-11T22:22:33.877317+0000","last_peered":"2024-09-11T22:22:33.877317+0000","last_clean":"2024-09-11T22:22:33.877317+0000","last_became_active":"2024-09-11T22:22:33.876047+0000","last_became_peered":"2024-09-11T22:22:33.876047+0000","last_unstale":"2024-09-11T22:22:33.877317+0000","last_undegraded":"2024-09-11T22:22:33.877317+0000","last_fullsized":"2024-09-11T22:22:33.877317+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:19.441983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879400+0000","last_change":"2024-09-11T22:22:33.872959+0000","last_active":"2024-09-11T22:22:34.879400+0000","last_peered":"2024-09-11T22:22:34.879400+0000","last_clean":"2024-09-11T22:22:34.879400+0000","last_became_active":"2024-09-11T22:22:33.872676+0000","last_became_peered":"2024-09-11T22:22:33.872676+0000","last_unstale":"2024-09-11T22:22:34.879400+0000","last_undegraded":"2024-09-11T22:22:34.879400+0000","last_fullsized":"2024-09-11T22:22:34.879400+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.461678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.884787+0000","last_change":"2024-09-11T22:22:33.884369+0000","last_active":"2024-09-11T22:22:33.884787+0000","last_peered":"2024-09-11T22:22:33.884787+0000","last_clean":"2024-09-11T22:22:33.884787+0000","last_became_active":"2024-09-11T22:22:33.884089+0000","last_became_peered":"2024-09-11T22:22:33.884089+0000","last_unstale":"2024-09-11T22:22:33.884787+0000","last_undegraded":"2024-09-11T22:22:33.884787+0000","last_fullsized":"2024-09-11T22:22:33.884787+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:17.954497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872119+0000","last_change":"2024-09-11T22:22:33.870192+0000","last_active":"2024-09-11T22:22:33.872119+0000","last_peered":"2024-09-11T22:22:33.872119+0000","last_clean":"2024-09-11T22:22:33.872119+0000","last_became_active":"2024-09-11T22:22:33.869842+0000","last_became_peered":"2024-09-11T22:22:33.869842+0000","last_unstale":"2024-09-11T22:22:33.872119+0000","last_undegraded":"2024-09-11T22:22:33.872119+0000","last_fullsized":"2024-09-11T22:22:33.872119+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:04.924074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876355+0000","last_change":"2024-09-11T22:22:33.874097+0000","last_active":"2024-09-11T22:22:33.876355+0000","last_peered":"2024-09-11T22:22:33.876355+0000","last_clean":"2024-09-11T22:22:33.876355+0000","last_became_active":"2024-09-11T22:22:33.873815+0000","last_became_peered":"2024-09-11T22:22:33.873815+0000","last_unstale":"2024-09-11T22:22:33.876355+0000","last_undegraded":"2024-09-11T22:22:33.876355+0000","last_fullsized":"2024-09-11T22:22:33.876355+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:20.158581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104578+0000","last_change":"2024-09-11T22:22:33.878017+0000","last_active":"2024-09-11T22:22:35.104578+0000","last_peered":"2024-09-11T22:22:35.104578+0000","last_clean":"2024-09-11T22:22:35.104578+0000","last_became_active":"2024-09-11T22:22:33.877721+0000","last_became_peered":"2024-09-11T22:22:33.877721+0000","last_unstale":"2024-09-11T22:22:35.104578+0000","last_undegraded":"2024-09-11T22:22:35.104578+0000","last_fullsized":"2024-09-11T22:22:35.104578+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:50.188912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875889+0000","last_change":"2024-09-11T22:22:33.873410+0000","last_active":"2024-09-11T22:22:33.875889+0000","last_peered":"2024-09-11T22:22:33.875889+0000","last_clean":"2024-09-11T22:22:33.875889+0000","last_became_active":"2024-09-11T22:22:33.873139+0000","last_became_peered":"2024-09-11T22:22:33.873139+0000","last_unstale":"2024-09-11T22:22:33.875889+0000","last_undegraded":"2024-09-11T22:22:33.875889+0000","last_fullsized":"2024-09-11T22:22:33.875889+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:21.561002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877236+0000","last_change":"2024-09-11T22:22:33.875556+0000","last_active":"2024-09-11T22:22:33.877236+0000","last_peered":"2024-09-11T22:22:33.877236+0000","last_clean":"2024-09-11T22:22:33.877236+0000","last_became_active":"2024-09-11T22:22:33.875271+0000","last_became_peered":"2024-09-11T22:22:33.875271+0000","last_unstale":"2024-09-11T22:22:33.877236+0000","last_undegraded":"2024-09-11T22:22:33.877236+0000","last_fullsized":"2024-09-11T22:22:33.877236+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:57.213641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872059+0000","last_change":"2024-09-11T22:22:33.871266+0000","last_active":"2024-09-11T22:22:33.872059+0000","last_peered":"2024-09-11T22:22:33.872059+0000","last_clean":"2024-09-11T22:22:33.872059+0000","last_became_active":"2024-09-11T22:22:33.870953+0000","last_became_peered":"2024-09-11T22:22:33.870953+0000","last_unstale":"2024-09-11T22:22:33.872059+0000","last_undegraded":"2024-09-11T22:22:33.872059+0000","last_fullsized":"2024-09-11T22:22:33.872059+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.051705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890511+0000","last_change":"2024-09-11T22:22:33.881317+0000","last_active":"2024-09-11T22:22:33.890511+0000","last_peered":"2024-09-11T22:22:33.890511+0000","last_clean":"2024-09-11T22:22:33.890511+0000","last_became_active":"2024-09-11T22:22:33.880855+0000","last_became_peered":"2024-09-11T22:22:33.880855+0000","last_unstale":"2024-09-11T22:22:33.890511+0000","last_undegraded":"2024-09-11T22:22:33.890511+0000","last_fullsized":"2024-09-11T22:22:33.890511+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:19.325750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876547+0000","last_change":"2024-09-11T22:22:33.874494+0000","last_active":"2024-09-11T22:22:33.876547+0000","last_peered":"2024-09-11T22:22:33.876547+0000","last_clean":"2024-09-11T22:22:33.876547+0000","last_became_active":"2024-09-11T22:22:33.874228+0000","last_became_peered":"2024-09-11T22:22:33.874228+0000","last_unstale":"2024-09-11T22:22:33.876547+0000","last_undegraded":"2024-09-11T22:22:33.876547+0000","last_fullsized":"2024-09-11T22:22:33.876547+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:51.735057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"177'4","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.888895+0000","last_change":"2024-09-11T22:22:32.875504+0000","last_active":"2024-09-11T22:22:33.888895+0000","last_peered":"2024-09-11T22:22:33.888895+0000","last_clean":"2024-09-11T22:22:33.888895+0000","last_became_active":"2024-09-11T22:22:32.875253+0000","last_became_peered":"2024-09-11T22:22:32.875253+0000","last_unstale":"2024-09-11T22:22:33.888895+0000","last_undegraded":"2024-09-11T22:22:33.888895+0000","last_fullsized":"2024-09-11T22:22:33.888895+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:56.207572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877216+0000","last_change":"2024-09-11T22:22:33.875788+0000","last_active":"2024-09-11T22:22:33.877216+0000","last_peered":"2024-09-11T22:22:33.877216+0000","last_clean":"2024-09-11T22:22:33.877216+0000","last_became_active":"2024-09-11T22:22:33.875491+0000","last_became_peered":"2024-09-11T22:22:33.875491+0000","last_unstale":"2024-09-11T22:22:33.877216+0000","last_undegraded":"2024-09-11T22:22:33.877216+0000","last_fullsized":"2024-09-11T22:22:33.877216+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:13.685778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.888708+0000","last_change":"2024-09-11T22:22:32.872040+0000","last_active":"2024-09-11T22:22:33.888708+0000","last_peered":"2024-09-11T22:22:33.888708+0000","last_clean":"2024-09-11T22:22:33.888708+0000","last_became_active":"2024-09-11T22:22:32.871733+0000","last_became_peered":"2024-09-11T22:22:32.871733+0000","last_unstale":"2024-09-11T22:22:33.888708+0000","last_undegraded":"2024-09-11T22:22:33.888708+0000","last_fullsized":"2024-09-11T22:22:33.888708+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:57.631086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872137+0000","last_change":"2024-09-11T22:22:33.871433+0000","last_active":"2024-09-11T22:22:33.872137+0000","last_peered":"2024-09-11T22:22:33.872137+0000","last_clean":"2024-09-11T22:22:33.872137+0000","last_became_active":"2024-09-11T22:22:33.871134+0000","last_became_peered":"2024-09-11T22:22:33.871134+0000","last_unstale":"2024-09-11T22:22:33.872137+0000","last_undegraded":"2024-09-11T22:22:33.872137+0000","last_fullsized":"2024-09-11T22:22:33.872137+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:52.234618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"177'2","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105046+0000","last_change":"2024-09-11T22:22:32.871683+0000","last_active":"2024-09-11T22:22:35.105046+0000","last_peered":"2024-09-11T22:22:35.105046+0000","last_clean":"2024-09-11T22:22:35.105046+0000","last_became_active":"2024-09-11T22:22:32.871394+0000","last_became_peered":"2024-09-11T22:22:32.871394+0000","last_unstale":"2024-09-11T22:22:35.105046+0000","last_undegraded":"2024-09-11T22:22:35.105046+0000","last_fullsized":"2024-09-11T22:22:35.105046+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:25.624911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890443+0000","last_change":"2024-09-11T22:22:33.885084+0000","last_active":"2024-09-11T22:22:33.890443+0000","last_peered":"2024-09-11T22:22:33.890443+0000","last_clean":"2024-09-11T22:22:33.890443+0000","last_became_active":"2024-09-11T22:22:33.884682+0000","last_became_peered":"2024-09-11T22:22:33.884682+0000","last_unstale":"2024-09-11T22:22:33.890443+0000","last_undegraded":"2024-09-11T22:22:33.890443+0000","last_fullsized":"2024-09-11T22:22:33.890443+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:44.490870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"177'2","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879612+0000","last_change":"2024-09-11T22:22:32.873503+0000","last_active":"2024-09-11T22:22:34.879612+0000","last_peered":"2024-09-11T22:22:34.879612+0000","last_clean":"2024-09-11T22:22:34.879612+0000","last_became_active":"2024-09-11T22:22:32.873227+0000","last_became_peered":"2024-09-11T22:22:32.873227+0000","last_unstale":"2024-09-11T22:22:34.879612+0000","last_undegraded":"2024-09-11T22:22:34.879612+0000","last_fullsized":"2024-09-11T22:22:34.879612+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:09.224692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879392+0000","last_change":"2024-09-11T22:22:33.874211+0000","last_active":"2024-09-11T22:22:34.879392+0000","last_peered":"2024-09-11T22:22:34.879392+0000","last_clean":"2024-09-11T22:22:34.879392+0000","last_became_active":"2024-09-11T22:22:33.873948+0000","last_became_peered":"2024-09-11T22:22:33.873948+0000","last_unstale":"2024-09-11T22:22:34.879392+0000","last_undegraded":"2024-09-11T22:22:34.879392+0000","last_fullsized":"2024-09-11T22:22:34.879392+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.466819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890199+0000","last_change":"2024-09-11T22:22:32.876739+0000","last_active":"2024-09-11T22:22:33.890199+0000","last_peered":"2024-09-11T22:22:33.890199+0000","last_clean":"2024-09-11T22:22:33.890199+0000","last_became_active":"2024-09-11T22:22:32.876472+0000","last_became_peered":"2024-09-11T22:22:32.876472+0000","last_unstale":"2024-09-11T22:22:33.890199+0000","last_undegraded":"2024-09-11T22:22:33.890199+0000","last_fullsized":"2024-09-11T22:22:33.890199+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:47.992674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876928+0000","last_change":"2024-09-11T22:22:33.872839+0000","last_active":"2024-09-11T22:22:33.876928+0000","last_peered":"2024-09-11T22:22:33.876928+0000","last_clean":"2024-09-11T22:22:33.876928+0000","last_became_active":"2024-09-11T22:22:33.872541+0000","last_became_peered":"2024-09-11T22:22:33.872541+0000","last_unstale":"2024-09-11T22:22:33.876928+0000","last_undegraded":"2024-09-11T22:22:33.876928+0000","last_fullsized":"2024-09-11T22:22:33.876928+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:58.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867063+0000","last_change":"2024-09-11T22:22:32.868319+0000","last_active":"2024-09-11T22:22:33.867063+0000","last_peered":"2024-09-11T22:22:33.867063+0000","last_clean":"2024-09-11T22:22:33.867063+0000","last_became_active":"2024-09-11T22:22:32.868050+0000","last_became_peered":"2024-09-11T22:22:32.868050+0000","last_unstale":"2024-09-11T22:22:33.867063+0000","last_undegraded":"2024-09-11T22:22:33.867063+0000","last_fullsized":"2024-09-11T22:22:33.867063+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:01.463502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879439+0000","last_change":"2024-09-11T22:22:33.875498+0000","last_active":"2024-09-11T22:22:34.879439+0000","last_peered":"2024-09-11T22:22:34.879439+0000","last_clean":"2024-09-11T22:22:34.879439+0000","last_became_active":"2024-09-11T22:22:33.874795+0000","last_became_peered":"2024-09-11T22:22:33.874795+0000","last_unstale":"2024-09-11T22:22:34.879439+0000","last_undegraded":"2024-09-11T22:22:34.879439+0000","last_fullsized":"2024-09-11T22:22:34.879439+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:40.227649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865009+0000","last_change":"2024-09-11T22:22:32.876471+0000","last_active":"2024-09-11T22:22:33.865009+0000","last_peered":"2024-09-11T22:22:33.865009+0000","last_clean":"2024-09-11T22:22:33.865009+0000","last_became_active":"2024-09-11T22:22:32.876165+0000","last_became_peered":"2024-09-11T22:22:32.876165+0000","last_unstale":"2024-09-11T22:22:33.865009+0000","last_undegraded":"2024-09-11T22:22:33.865009+0000","last_fullsized":"2024-09-11T22:22:33.865009+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:59.849409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879663+0000","last_change":"2024-09-11T22:22:33.871288+0000","last_active":"2024-09-11T22:22:34.879663+0000","last_peered":"2024-09-11T22:22:34.879663+0000","last_clean":"2024-09-11T22:22:34.879663+0000","last_became_active":"2024-09-11T22:22:33.870994+0000","last_became_peered":"2024-09-11T22:22:33.870994+0000","last_unstale":"2024-09-11T22:22:34.879663+0000","last_undegraded":"2024-09-11T22:22:34.879663+0000","last_fullsized":"2024-09-11T22:22:34.879663+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:08.940215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867438+0000","last_change":"2024-09-11T22:22:32.868187+0000","last_active":"2024-09-11T22:22:33.867438+0000","last_peered":"2024-09-11T22:22:33.867438+0000","last_clean":"2024-09-11T22:22:33.867438+0000","last_became_active":"2024-09-11T22:22:32.867873+0000","last_became_peered":"2024-09-11T22:22:32.867873+0000","last_unstale":"2024-09-11T22:22:33.867438+0000","last_undegraded":"2024-09-11T22:22:33.867438+0000","last_fullsized":"2024-09-11T22:22:33.867438+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:16.014510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105316+0000","last_change":"2024-09-11T22:22:33.876012+0000","last_active":"2024-09-11T22:22:35.105316+0000","last_peered":"2024-09-11T22:22:35.105316+0000","last_clean":"2024-09-11T22:22:35.105316+0000","last_became_active":"2024-09-11T22:22:33.875720+0000","last_became_peered":"2024-09-11T22:22:33.875720+0000","last_unstale":"2024-09-11T22:22:35.105316+0000","last_undegraded":"2024-09-11T22:22:35.105316+0000","last_fullsized":"2024-09-11T22:22:35.105316+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:33.761223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865676+0000","last_change":"2024-09-11T22:22:32.871536+0000","last_active":"2024-09-11T22:22:33.865676+0000","last_peered":"2024-09-11T22:22:33.865676+0000","last_clean":"2024-09-11T22:22:33.865676+0000","last_became_active":"2024-09-11T22:22:32.870670+0000","last_became_peered":"2024-09-11T22:22:32.870670+0000","last_unstale":"2024-09-11T22:22:33.865676+0000","last_undegraded":"2024-09-11T22:22:33.865676+0000","last_fullsized":"2024-09-11T22:22:33.865676+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:50.728988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879583+0000","last_change":"2024-09-11T22:22:33.871247+0000","last_active":"2024-09-11T22:22:34.879583+0000","last_peered":"2024-09-11T22:22:34.879583+0000","last_clean":"2024-09-11T22:22:34.879583+0000","last_became_active":"2024-09-11T22:22:33.870952+0000","last_became_peered":"2024-09-11T22:22:33.870952+0000","last_unstale":"2024-09-11T22:22:34.879583+0000","last_undegraded":"2024-09-11T22:22:34.879583+0000","last_fullsized":"2024-09-11T22:22:34.879583+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:08.678884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"177'3","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892700+0000","last_change":"2024-09-11T22:22:32.874858+0000","last_active":"2024-09-11T22:22:33.892700+0000","last_peered":"2024-09-11T22:22:33.892700+0000","last_clean":"2024-09-11T22:22:33.892700+0000","last_became_active":"2024-09-11T22:22:32.874556+0000","last_became_peered":"2024-09-11T22:22:32.874556+0000","last_unstale":"2024-09-11T22:22:33.892700+0000","last_undegraded":"2024-09-11T22:22:33.892700+0000","last_fullsized":"2024-09-11T22:22:33.892700+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:41.633829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890387+0000","last_change":"2024-09-11T22:22:33.880424+0000","last_active":"2024-09-11T22:22:33.890387+0000","last_peered":"2024-09-11T22:22:33.890387+0000","last_clean":"2024-09-11T22:22:33.890387+0000","last_became_active":"2024-09-11T22:22:33.880082+0000","last_became_peered":"2024-09-11T22:22:33.880082+0000","last_unstale":"2024-09-11T22:22:33.890387+0000","last_undegraded":"2024-09-11T22:22:33.890387+0000","last_fullsized":"2024-09-11T22:22:33.890387+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:51.419145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"177'6","reported_seq":20,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879631+0000","last_change":"2024-09-11T22:22:32.874281+0000","last_active":"2024-09-11T22:22:34.879631+0000","last_peered":"2024-09-11T22:22:34.879631+0000","last_clean":"2024-09-11T22:22:34.879631+0000","last_became_active":"2024-09-11T22:22:32.873683+0000","last_became_peered":"2024-09-11T22:22:32.873683+0000","last_unstale":"2024-09-11T22:22:34.879631+0000","last_undegraded":"2024-09-11T22:22:34.879631+0000","last_fullsized":"2024-09-11T22:22:34.879631+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:04.618180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886309+0000","last_change":"2024-09-11T22:22:33.885274+0000","last_active":"2024-09-11T22:22:33.886309+0000","last_peered":"2024-09-11T22:22:33.886309+0000","last_clean":"2024-09-11T22:22:33.886309+0000","last_became_active":"2024-09-11T22:22:33.884990+0000","last_became_peered":"2024-09-11T22:22:33.884990+0000","last_unstale":"2024-09-11T22:22:33.886309+0000","last_undegraded":"2024-09-11T22:22:33.886309+0000","last_fullsized":"2024-09-11T22:22:33.886309+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.633479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"177'2","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886978+0000","last_change":"2024-09-11T22:22:32.872106+0000","last_active":"2024-09-11T22:22:33.886978+0000","last_peered":"2024-09-11T22:22:33.886978+0000","last_clean":"2024-09-11T22:22:33.886978+0000","last_became_active":"2024-09-11T22:22:32.871772+0000","last_became_peered":"2024-09-11T22:22:32.871772+0000","last_unstale":"2024-09-11T22:22:33.886978+0000","last_undegraded":"2024-09-11T22:22:33.886978+0000","last_fullsized":"2024-09-11T22:22:33.886978+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.839583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889321+0000","last_change":"2024-09-11T22:22:33.882949+0000","last_active":"2024-09-11T22:22:33.889321+0000","last_peered":"2024-09-11T22:22:33.889321+0000","last_clean":"2024-09-11T22:22:33.889321+0000","last_became_active":"2024-09-11T22:22:33.882659+0000","last_became_peered":"2024-09-11T22:22:33.882659+0000","last_unstale":"2024-09-11T22:22:33.889321+0000","last_undegraded":"2024-09-11T22:22:33.889321+0000","last_fullsized":"2024-09-11T22:22:33.889321+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:41:23.986542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865728+0000","last_change":"2024-09-11T22:22:32.869908+0000","last_active":"2024-09-11T22:22:33.865728+0000","last_peered":"2024-09-11T22:22:33.865728+0000","last_clean":"2024-09-11T22:22:33.865728+0000","last_became_active":"2024-09-11T22:22:32.869622+0000","last_became_peered":"2024-09-11T22:22:32.869622+0000","last_unstale":"2024-09-11T22:22:33.865728+0000","last_undegraded":"2024-09-11T22:22:33.865728+0000","last_fullsized":"2024-09-11T22:22:33.865728+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:26.942462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105608+0000","last_change":"2024-09-11T22:22:33.873149+0000","last_active":"2024-09-11T22:22:35.105608+0000","last_peered":"2024-09-11T22:22:35.105608+0000","last_clean":"2024-09-11T22:22:35.105608+0000","last_became_active":"2024-09-11T22:22:33.870569+0000","last_became_peered":"2024-09-11T22:22:33.870569+0000","last_unstale":"2024-09-11T22:22:35.105608+0000","last_undegraded":"2024-09-11T22:22:35.105608+0000","last_fullsized":"2024-09-11T22:22:35.105608+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:30.251297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872544+0000","last_change":"2024-09-11T22:22:32.874747+0000","last_active":"2024-09-11T22:22:33.872544+0000","last_peered":"2024-09-11T22:22:33.872544+0000","last_clean":"2024-09-11T22:22:33.872544+0000","last_became_active":"2024-09-11T22:22:32.874454+0000","last_became_peered":"2024-09-11T22:22:32.874454+0000","last_unstale":"2024-09-11T22:22:33.872544+0000","last_undegraded":"2024-09-11T22:22:33.872544+0000","last_fullsized":"2024-09-11T22:22:33.872544+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:20.850041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872183+0000","last_change":"2024-09-11T22:22:33.871139+0000","last_active":"2024-09-11T22:22:33.872183+0000","last_peered":"2024-09-11T22:22:33.872183+0000","last_clean":"2024-09-11T22:22:33.872183+0000","last_became_active":"2024-09-11T22:22:33.870706+0000","last_became_peered":"2024-09-11T22:22:33.870706+0000","last_unstale":"2024-09-11T22:22:33.872183+0000","last_undegraded":"2024-09-11T22:22:33.872183+0000","last_fullsized":"2024-09-11T22:22:33.872183+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:06.718551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"177'8","reported_seq":22,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105633+0000","last_change":"2024-09-11T22:22:32.870819+0000","last_active":"2024-09-11T22:22:35.105633+0000","last_peered":"2024-09-11T22:22:35.105633+0000","last_clean":"2024-09-11T22:22:35.105633+0000","last_became_active":"2024-09-11T22:22:32.870541+0000","last_became_peered":"2024-09-11T22:22:32.870541+0000","last_unstale":"2024-09-11T22:22:35.105633+0000","last_undegraded":"2024-09-11T22:22:35.105633+0000","last_fullsized":"2024-09-11T22:22:35.105633+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:40.741597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.871584+0000","last_change":"2024-09-11T22:22:33.869366+0000","last_active":"2024-09-11T22:22:33.871584+0000","last_peered":"2024-09-11T22:22:33.871584+0000","last_clean":"2024-09-11T22:22:33.871584+0000","last_became_active":"2024-09-11T22:22:33.869095+0000","last_became_peered":"2024-09-11T22:22:33.869095+0000","last_unstale":"2024-09-11T22:22:33.871584+0000","last_undegraded":"2024-09-11T22:22:33.871584+0000","last_fullsized":"2024-09-11T22:22:33.871584+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:08.615227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.891842+0000","last_change":"2024-09-11T22:22:32.869194+0000","last_active":"2024-09-11T22:22:33.891842+0000","last_peered":"2024-09-11T22:22:33.891842+0000","last_clean":"2024-09-11T22:22:33.891842+0000","last_became_active":"2024-09-11T22:22:32.868931+0000","last_became_peered":"2024-09-11T22:22:32.868931+0000","last_unstale":"2024-09-11T22:22:33.891842+0000","last_undegraded":"2024-09-11T22:22:33.891842+0000","last_fullsized":"2024-09-11T22:22:33.891842+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:41.209428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.884771+0000","last_change":"2024-09-11T22:22:33.884363+0000","last_active":"2024-09-11T22:22:33.884771+0000","last_peered":"2024-09-11T22:22:33.884771+0000","last_clean":"2024-09-11T22:22:33.884771+0000","last_became_active":"2024-09-11T22:22:33.884103+0000","last_became_peered":"2024-09-11T22:22:33.884103+0000","last_unstale":"2024-09-11T22:22:33.884771+0000","last_undegraded":"2024-09-11T22:22:33.884771+0000","last_fullsized":"2024-09-11T22:22:33.884771+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:09.845653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"177'2","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892467+0000","last_change":"2024-09-11T22:22:32.875435+0000","last_active":"2024-09-11T22:22:33.892467+0000","last_peered":"2024-09-11T22:22:33.892467+0000","last_clean":"2024-09-11T22:22:33.892467+0000","last_became_active":"2024-09-11T22:22:32.875176+0000","last_became_peered":"2024-09-11T22:22:32.875176+0000","last_unstale":"2024-09-11T22:22:33.892467+0000","last_undegraded":"2024-09-11T22:22:33.892467+0000","last_fullsized":"2024-09-11T22:22:33.892467+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:28.777018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105584+0000","last_change":"2024-09-11T22:22:33.863470+0000","last_active":"2024-09-11T22:22:35.105584+0000","last_peered":"2024-09-11T22:22:35.105584+0000","last_clean":"2024-09-11T22:22:35.105584+0000","last_became_active":"2024-09-11T22:22:33.863138+0000","last_became_peered":"2024-09-11T22:22:33.863138+0000","last_unstale":"2024-09-11T22:22:35.105584+0000","last_undegraded":"2024-09-11T22:22:35.105584+0000","last_fullsized":"2024-09-11T22:22:35.105584+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:23.571456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.891285+0000","last_change":"2024-09-11T22:22:32.873935+0000","last_active":"2024-09-11T22:22:33.891285+0000","last_peered":"2024-09-11T22:22:33.891285+0000","last_clean":"2024-09-11T22:22:33.891285+0000","last_became_active":"2024-09-11T22:22:32.872709+0000","last_became_peered":"2024-09-11T22:22:32.872709+0000","last_unstale":"2024-09-11T22:22:33.891285+0000","last_undegraded":"2024-09-11T22:22:33.891285+0000","last_fullsized":"2024-09-11T22:22:33.891285+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:50.413075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.888390+0000","last_change":"2024-09-11T22:22:33.879571+0000","last_active":"2024-09-11T22:22:33.888390+0000","last_peered":"2024-09-11T22:22:33.888390+0000","last_clean":"2024-09-11T22:22:33.888390+0000","last_became_active":"2024-09-11T22:22:33.879288+0000","last_became_peered":"2024-09-11T22:22:33.879288+0000","last_unstale":"2024-09-11T22:22:33.888390+0000","last_undegraded":"2024-09-11T22:22:33.888390+0000","last_fullsized":"2024-09-11T22:22:33.888390+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:19.325750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104718+0000","last_change":"2024-09-11T22:22:32.869179+0000","last_active":"2024-09-11T22:22:35.104718+0000","last_peered":"2024-09-11T22:22:35.104718+0000","last_clean":"2024-09-11T22:22:35.104718+0000","last_became_active":"2024-09-11T22:22:32.868874+0000","last_became_peered":"2024-09-11T22:22:32.868874+0000","last_unstale":"2024-09-11T22:22:35.104718+0000","last_undegraded":"2024-09-11T22:22:35.104718+0000","last_fullsized":"2024-09-11T22:22:35.104718+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:05.433343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889301+0000","last_change":"2024-09-11T22:22:33.882673+0000","last_active":"2024-09-11T22:22:33.889301+0000","last_peered":"2024-09-11T22:22:33.889301+0000","last_clean":"2024-09-11T22:22:33.889301+0000","last_became_active":"2024-09-11T22:22:33.881961+0000","last_became_peered":"2024-09-11T22:22:33.881961+0000","last_unstale":"2024-09-11T22:22:33.889301+0000","last_undegraded":"2024-09-11T22:22:33.889301+0000","last_fullsized":"2024-09-11T22:22:33.889301+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:40.704844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"177'2","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892004+0000","last_change":"2024-09-11T22:22:32.871013+0000","last_active":"2024-09-11T22:22:33.892004+0000","last_peered":"2024-09-11T22:22:33.892004+0000","last_clean":"2024-09-11T22:22:33.892004+0000","last_became_active":"2024-09-11T22:22:32.869592+0000","last_became_peered":"2024-09-11T22:22:32.869592+0000","last_unstale":"2024-09-11T22:22:33.892004+0000","last_undegraded":"2024-09-11T22:22:33.892004+0000","last_fullsized":"2024-09-11T22:22:33.892004+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:02.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105642+0000","last_change":"2024-09-11T22:22:33.874000+0000","last_active":"2024-09-11T22:22:35.105642+0000","last_peered":"2024-09-11T22:22:35.105642+0000","last_clean":"2024-09-11T22:22:35.105642+0000","last_became_active":"2024-09-11T22:22:33.873677+0000","last_became_peered":"2024-09-11T22:22:33.873677+0000","last_unstale":"2024-09-11T22:22:35.105642+0000","last_undegraded":"2024-09-11T22:22:35.105642+0000","last_fullsized":"2024-09-11T22:22:35.105642+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:02.713795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870436+0000","last_change":"2024-09-11T22:22:32.868236+0000","last_active":"2024-09-11T22:22:33.870436+0000","last_peered":"2024-09-11T22:22:33.870436+0000","last_clean":"2024-09-11T22:22:33.870436+0000","last_became_active":"2024-09-11T22:22:32.867876+0000","last_became_peered":"2024-09-11T22:22:32.867876+0000","last_unstale":"2024-09-11T22:22:33.870436+0000","last_undegraded":"2024-09-11T22:22:33.870436+0000","last_fullsized":"2024-09-11T22:22:33.870436+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:51.010593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870299+0000","last_change":"2024-09-11T22:22:33.866913+0000","last_active":"2024-09-11T22:22:33.870299+0000","last_peered":"2024-09-11T22:22:33.870299+0000","last_clean":"2024-09-11T22:22:33.870299+0000","last_became_active":"2024-09-11T22:22:33.866628+0000","last_became_peered":"2024-09-11T22:22:33.866628+0000","last_unstale":"2024-09-11T22:22:33.870299+0000","last_undegraded":"2024-09-11T22:22:33.870299+0000","last_fullsized":"2024-09-11T22:22:33.870299+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:29.858473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867015+0000","last_change":"2024-09-11T22:22:32.872329+0000","last_active":"2024-09-11T22:22:33.867015+0000","last_peered":"2024-09-11T22:22:33.867015+0000","last_clean":"2024-09-11T22:22:33.867015+0000","last_became_active":"2024-09-11T22:22:32.871836+0000","last_became_peered":"2024-09-11T22:22:32.871836+0000","last_unstale":"2024-09-11T22:22:33.867015+0000","last_undegraded":"2024-09-11T22:22:33.867015+0000","last_fullsized":"2024-09-11T22:22:33.867015+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:16.999557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877594+0000","last_change":"2024-09-11T22:22:33.876747+0000","last_active":"2024-09-11T22:22:33.877594+0000","last_peered":"2024-09-11T22:22:33.877594+0000","last_clean":"2024-09-11T22:22:33.877594+0000","last_became_active":"2024-09-11T22:22:33.876137+0000","last_became_peered":"2024-09-11T22:22:33.876137+0000","last_unstale":"2024-09-11T22:22:33.877594+0000","last_undegraded":"2024-09-11T22:22:33.877594+0000","last_fullsized":"2024-09-11T22:22:33.877594+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:21.561002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867731+0000","last_change":"2024-09-11T22:22:32.873479+0000","last_active":"2024-09-11T22:22:33.867731+0000","last_peered":"2024-09-11T22:22:33.867731+0000","last_clean":"2024-09-11T22:22:33.867731+0000","last_became_active":"2024-09-11T22:22:32.873187+0000","last_became_peered":"2024-09-11T22:22:32.873187+0000","last_unstale":"2024-09-11T22:22:33.867731+0000","last_undegraded":"2024-09-11T22:22:33.867731+0000","last_fullsized":"2024-09-11T22:22:33.867731+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:52.625796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.883423+0000","last_change":"2024-09-11T22:22:33.882379+0000","last_active":"2024-09-11T22:22:33.883423+0000","last_peered":"2024-09-11T22:22:33.883423+0000","last_clean":"2024-09-11T22:22:33.883423+0000","last_became_active":"2024-09-11T22:22:33.882098+0000","last_became_peered":"2024-09-11T22:22:33.882098+0000","last_unstale":"2024-09-11T22:22:33.883423+0000","last_undegraded":"2024-09-11T22:22:33.883423+0000","last_fullsized":"2024-09-11T22:22:33.883423+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:59.833957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"177'2","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105419+0000","last_change":"2024-09-11T22:22:32.873658+0000","last_active":"2024-09-11T22:22:35.105419+0000","last_peered":"2024-09-11T22:22:35.105419+0000","last_clean":"2024-09-11T22:22:35.105419+0000","last_became_active":"2024-09-11T22:22:32.872822+0000","last_became_peered":"2024-09-11T22:22:32.872822+0000","last_unstale":"2024-09-11T22:22:35.105419+0000","last_undegraded":"2024-09-11T22:22:35.105419+0000","last_fullsized":"2024-09-11T22:22:35.105419+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:54.311584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890546+0000","last_change":"2024-09-11T22:22:33.880882+0000","last_active":"2024-09-11T22:22:33.890546+0000","last_peered":"2024-09-11T22:22:33.890546+0000","last_clean":"2024-09-11T22:22:33.890546+0000","last_became_active":"2024-09-11T22:22:33.880577+0000","last_became_peered":"2024-09-11T22:22:33.880577+0000","last_unstale":"2024-09-11T22:22:33.890546+0000","last_undegraded":"2024-09-11T22:22:33.890546+0000","last_fullsized":"2024-09-11T22:22:33.890546+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:42.639899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"178'1","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879669+0000","last_change":"2024-09-11T22:22:32.875400+0000","last_active":"2024-09-11T22:22:34.879669+0000","last_peered":"2024-09-11T22:22:34.879669+0000","last_clean":"2024-09-11T22:22:34.879669+0000","last_became_active":"2024-09-11T22:22:32.875056+0000","last_became_peered":"2024-09-11T22:22:32.875056+0000","last_unstale":"2024-09-11T22:22:34.879669+0000","last_undegraded":"2024-09-11T22:22:34.879669+0000","last_fullsized":"2024-09-11T22:22:34.879669+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:51.454702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877067+0000","last_change":"2024-09-11T22:22:33.875215+0000","last_active":"2024-09-11T22:22:33.877067+0000","last_peered":"2024-09-11T22:22:33.877067+0000","last_clean":"2024-09-11T22:22:33.877067+0000","last_became_active":"2024-09-11T22:22:33.874961+0000","last_became_peered":"2024-09-11T22:22:33.874961+0000","last_unstale":"2024-09-11T22:22:33.877067+0000","last_undegraded":"2024-09-11T22:22:33.877067+0000","last_fullsized":"2024-09-11T22:22:33.877067+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:27.948531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.869538+0000","last_change":"2024-09-11T22:22:32.867763+0000","last_active":"2024-09-11T22:22:33.869538+0000","last_peered":"2024-09-11T22:22:33.869538+0000","last_clean":"2024-09-11T22:22:33.869538+0000","last_became_active":"2024-09-11T22:22:32.867493+0000","last_became_peered":"2024-09-11T22:22:32.867493+0000","last_unstale":"2024-09-11T22:22:33.869538+0000","last_undegraded":"2024-09-11T22:22:33.869538+0000","last_fullsized":"2024-09-11T22:22:33.869538+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:13.188631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.873056+0000","last_change":"2024-09-11T22:22:33.871871+0000","last_active":"2024-09-11T22:22:33.873056+0000","last_peered":"2024-09-11T22:22:33.873056+0000","last_clean":"2024-09-11T22:22:33.873056+0000","last_became_active":"2024-09-11T22:22:33.871567+0000","last_became_peered":"2024-09-11T22:22:33.871567+0000","last_unstale":"2024-09-11T22:22:33.873056+0000","last_undegraded":"2024-09-11T22:22:33.873056+0000","last_fullsized":"2024-09-11T22:22:33.873056+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:17.954497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104811+0000","last_change":"2024-09-11T22:22:32.875098+0000","last_active":"2024-09-11T22:22:35.104811+0000","last_peered":"2024-09-11T22:22:35.104811+0000","last_clean":"2024-09-11T22:22:35.104811+0000","last_became_active":"2024-09-11T22:22:32.872807+0000","last_became_peered":"2024-09-11T22:22:32.872807+0000","last_unstale":"2024-09-11T22:22:35.104811+0000","last_undegraded":"2024-09-11T22:22:35.104811+0000","last_fullsized":"2024-09-11T22:22:35.104811+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:06.287546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875021+0000","last_change":"2024-09-11T22:22:33.872648+0000","last_active":"2024-09-11T22:22:33.875021+0000","last_peered":"2024-09-11T22:22:33.875021+0000","last_clean":"2024-09-11T22:22:33.875021+0000","last_became_active":"2024-09-11T22:22:33.872364+0000","last_became_peered":"2024-09-11T22:22:33.872364+0000","last_unstale":"2024-09-11T22:22:33.875021+0000","last_undegraded":"2024-09-11T22:22:33.875021+0000","last_fullsized":"2024-09-11T22:22:33.875021+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.051705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879438+0000","last_change":"2024-09-11T22:22:32.877875+0000","last_active":"2024-09-11T22:22:34.879438+0000","last_peered":"2024-09-11T22:22:34.879438+0000","last_clean":"2024-09-11T22:22:34.879438+0000","last_became_active":"2024-09-11T22:22:32.877559+0000","last_became_peered":"2024-09-11T22:22:32.877559+0000","last_unstale":"2024-09-11T22:22:34.879438+0000","last_undegraded":"2024-09-11T22:22:34.879438+0000","last_fullsized":"2024-09-11T22:22:34.879438+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:05.308567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.882948+0000","last_change":"2024-09-11T22:22:33.882413+0000","last_active":"2024-09-11T22:22:33.882948+0000","last_peered":"2024-09-11T22:22:33.882948+0000","last_clean":"2024-09-11T22:22:33.882948+0000","last_became_active":"2024-09-11T22:22:33.882153+0000","last_became_peered":"2024-09-11T22:22:33.882153+0000","last_unstale":"2024-09-11T22:22:33.882948+0000","last_undegraded":"2024-09-11T22:22:33.882948+0000","last_fullsized":"2024-09-11T22:22:33.882948+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:08.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867928+0000","last_change":"2024-09-11T22:22:32.876657+0000","last_active":"2024-09-11T22:22:33.867928+0000","last_peered":"2024-09-11T22:22:33.867928+0000","last_clean":"2024-09-11T22:22:33.867928+0000","last_became_active":"2024-09-11T22:22:32.876140+0000","last_became_peered":"2024-09-11T22:22:32.876140+0000","last_unstale":"2024-09-11T22:22:33.867928+0000","last_undegraded":"2024-09-11T22:22:33.867928+0000","last_fullsized":"2024-09-11T22:22:33.867928+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:21.127707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105514+0000","last_change":"2024-09-11T22:22:33.873842+0000","last_active":"2024-09-11T22:22:35.105514+0000","last_peered":"2024-09-11T22:22:35.105514+0000","last_clean":"2024-09-11T22:22:35.105514+0000","last_became_active":"2024-09-11T22:22:33.873564+0000","last_became_peered":"2024-09-11T22:22:33.873564+0000","last_unstale":"2024-09-11T22:22:35.105514+0000","last_undegraded":"2024-09-11T22:22:35.105514+0000","last_fullsized":"2024-09-11T22:22:35.105514+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:37:42.342912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865883+0000","last_change":"2024-09-11T22:22:32.874909+0000","last_active":"2024-09-11T22:22:33.865883+0000","last_peered":"2024-09-11T22:22:33.865883+0000","last_clean":"2024-09-11T22:22:33.865883+0000","last_became_active":"2024-09-11T22:22:32.874627+0000","last_became_peered":"2024-09-11T22:22:32.874627+0000","last_unstale":"2024-09-11T22:22:33.865883+0000","last_undegraded":"2024-09-11T22:22:33.865883+0000","last_fullsized":"2024-09-11T22:22:33.865883+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:56.207572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875724+0000","last_change":"2024-09-11T22:22:33.871239+0000","last_active":"2024-09-11T22:22:33.875724+0000","last_peered":"2024-09-11T22:22:33.875724+0000","last_clean":"2024-09-11T22:22:33.875724+0000","last_became_active":"2024-09-11T22:22:33.870917+0000","last_became_peered":"2024-09-11T22:22:33.870917+0000","last_unstale":"2024-09-11T22:22:33.875724+0000","last_undegraded":"2024-09-11T22:22:33.875724+0000","last_fullsized":"2024-09-11T22:22:33.875724+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:00.855479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.862829+0000","last_change":"2024-09-11T22:22:32.876591+0000","last_active":"2024-09-11T22:22:33.862829+0000","last_peered":"2024-09-11T22:22:33.862829+0000","last_clean":"2024-09-11T22:22:33.862829+0000","last_became_active":"2024-09-11T22:22:32.876343+0000","last_became_peered":"2024-09-11T22:22:32.876343+0000","last_unstale":"2024-09-11T22:22:33.862829+0000","last_undegraded":"2024-09-11T22:22:33.862829+0000","last_fullsized":"2024-09-11T22:22:33.862829+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.839583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890564+0000","last_change":"2024-09-11T22:22:33.881708+0000","last_active":"2024-09-11T22:22:33.890564+0000","last_peered":"2024-09-11T22:22:33.890564+0000","last_clean":"2024-09-11T22:22:33.890564+0000","last_became_active":"2024-09-11T22:22:33.880955+0000","last_became_peered":"2024-09-11T22:22:33.880955+0000","last_unstale":"2024-09-11T22:22:33.890564+0000","last_undegraded":"2024-09-11T22:22:33.890564+0000","last_fullsized":"2024-09-11T22:22:33.890564+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:40.704844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.891456+0000","last_change":"2024-09-11T22:22:32.876390+0000","last_active":"2024-09-11T22:22:33.891456+0000","last_peered":"2024-09-11T22:22:33.891456+0000","last_clean":"2024-09-11T22:22:33.891456+0000","last_became_active":"2024-09-11T22:22:32.876077+0000","last_became_peered":"2024-09-11T22:22:32.876077+0000","last_unstale":"2024-09-11T22:22:33.891456+0000","last_undegraded":"2024-09-11T22:22:33.891456+0000","last_fullsized":"2024-09-11T22:22:33.891456+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:16.948428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":455,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879265+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:22:34.879265+0000","last_peered":"2024-09-11T22:22:34.879265+0000","last_clean":"2024-09-11T22:22:34.879265+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:22:34.879265+0000","last_undegraded":"2024-09-11T22:22:34.879265+0000","last_fullsized":"2024-09-11T22:22:34.879265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509583,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55576,"kb_used_data":2176,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316264,"statfs":{"total":96636764160,"available":96579854336,"internally_reserved":0,"allocated":2228224,"data_stored":977912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509580,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51400,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320440,"statfs":{"total":96636764160,"available":96584130560,"internally_reserved":0,"allocated":2211840,"data_stored":970555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509582,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63916,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307924,"statfs":{"total":96636764160,"available":96571314176,"internally_reserved":0,"allocated":2244608,"data_stored":979046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509582,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47268,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324572,"statfs":{"total":96636764160,"available":96588361728,"internally_reserved":0,"allocated":2236416,"data_stored":977512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509582,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47256,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324584,"statfs":{"total":96636764160,"available":96588374016,"internally_reserved":0,"allocated":2232320,"data_stored":977386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509581,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60300,"kb_used_data":2740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311540,"statfs":{"total":96636764160,"available":96575016960,"internally_reserved":0,"allocated":2805760,"data_stored":1560923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56172,"kb_used_data":2776,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315668,"statfs":{"total":96636764160,"available":96579244032,"internally_reserved":0,"allocated":2842624,"data_stored":1575610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574989,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47260,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324580,"statfs":{"total":96636764160,"available":96588369920,"internally_reserved":0,"allocated":2236416,"data_stored":983630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:22:37.552 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:22:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.689+0000 7f9ee2dfd640 1 Processor -- start 2024-09-11T22:22:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.689+0000 7f9ee2dfd640 1 -- start start 2024-09-11T22:22:37.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.690+0000 7f9ee2dfd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9edc15e870 0x7f9edc0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.690+0000 7f9ee2dfd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9edc0d16d0 0x7f9edc0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.690+0000 7f9ee2dfd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9edc0d3a30 0x7f9edc0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.690+0000 7f9ee2dfd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9edc0d1b40 con 0x7f9edc0d16d0 2024-09-11T22:22:37.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.690+0000 7f9ee2dfd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9edc0cfa80 con 0x7f9edc15e870 2024-09-11T22:22:37.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.690+0000 7f9ee2dfd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc0d3e50 con 0x7f9edc0d3a30 2024-09-11T22:22:37.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.690+0000 7f9edbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9edc0d16d0 0x7f9edc0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.690+0000 7f9edbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9edc0d16d0 0x7f9edc0d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45604/0 (socket says 172.21.15.50:45604) 2024-09-11T22:22:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.690+0000 7f9edbfff640 1 -- 172.21.15.50:0/2406433091 learned_addr learned my addr 172.21.15.50:0/2406433091 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.691+0000 7f9ee139a640 1 --2- 172.21.15.50:0/2406433091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9edc0d3a30 0x7f9edc0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.691+0000 7f9ee0b99640 1 --2- 172.21.15.50:0/2406433091 >> v2:172.21.15.77:3300/0 conn(0x7f9edc15e870 0x7f9edc0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.691+0000 7f9edbfff640 1 -- 172.21.15.50:0/2406433091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9edc0d3a30 msgr2=0x7f9edc0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.691+0000 7f9edbfff640 1 --2- 172.21.15.50:0/2406433091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9edc0d3a30 0x7f9edc0b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.691+0000 7f9edbfff640 1 -- 172.21.15.50:0/2406433091 >> v2:172.21.15.77:3300/0 conn(0x7f9edc15e870 msgr2=0x7f9edc0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.691+0000 7f9edbfff640 1 --2- 172.21.15.50:0/2406433091 >> v2:172.21.15.77:3300/0 conn(0x7f9edc15e870 0x7f9edc0d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.691+0000 7f9edbfff640 1 -- 172.21.15.50:0/2406433091 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc0d40d0 con 0x7f9edc0d16d0 2024-09-11T22:22:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.691+0000 7f9edbfff640 1 --2- 172.21.15.50:0/2406433091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9edc0d16d0 0x7f9edc0d34f0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0d4000 tx=0x7f9ecc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60633613215b059b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.692+0000 7f9edb7fe640 1 -- 172.21.15.50:0/2406433091 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc036070 con 0x7f9edc0d16d0 2024-09-11T22:22:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.692+0000 7f9edb7fe640 1 -- 172.21.15.50:0/2406433091 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ecc031600 con 0x7f9edc0d16d0 2024-09-11T22:22:37.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.692+0000 7f9edb7fe640 1 -- 172.21.15.50:0/2406433091 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0319d0 con 0x7f9edc0d16d0 2024-09-11T22:22:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.692+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/2406433091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9edc0d16d0 msgr2=0x7f9edc0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.692+0000 7f9ee2dfd640 1 --2- 172.21.15.50:0/2406433091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9edc0d16d0 0x7f9edc0d34f0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0d4000 tx=0x7f9ecc02a680 comp rx=0 tx=0).stop 2024-09-11T22:22:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.692+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/2406433091 shutdown_connections 2024-09-11T22:22:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.692+0000 7f9ee2dfd640 1 --2- 172.21.15.50:0/2406433091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9edc0d3a30 0x7f9edc0b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.692+0000 7f9ee2dfd640 1 --2- 172.21.15.50:0/2406433091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9edc0d16d0 0x7f9edc0d34f0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.692+0000 7f9ee2dfd640 1 --2- 172.21.15.50:0/2406433091 >> v2:172.21.15.77:3300/0 conn(0x7f9edc15e870 0x7f9edc0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.692+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/2406433091 >> 172.21.15.50:0/2406433091 conn(0x7f9edc0727a0 msgr2=0x7f9edc0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.692+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/2406433091 shutdown_connections 2024-09-11T22:22:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.692+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/2406433091 wait complete. 2024-09-11T22:22:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.693+0000 7f9ee2dfd640 1 Processor -- start 2024-09-11T22:22:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.693+0000 7f9ee2dfd640 1 -- start start 2024-09-11T22:22:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.694+0000 7f9ee2dfd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9edc0d16d0 0x7f9edc14cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.694+0000 7f9ee2dfd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9edc0d3a30 0x7f9edc14d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.694+0000 7f9ee2dfd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9edc15e870 0x7f9edc14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.694+0000 7f9ee2dfd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc0b7ee0 con 0x7f9edc15e870 2024-09-11T22:22:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.694+0000 7f9ee2dfd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc0b7c00 con 0x7f9edc0d3a30 2024-09-11T22:22:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.694+0000 7f9ee2dfd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc15ec50 con 0x7f9edc0d16d0 2024-09-11T22:22:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.694+0000 7f9ee139a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9edc15e870 0x7f9edc14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.694+0000 7f9ee139a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9edc15e870 0x7f9edc14b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45606/0 (socket says 172.21.15.50:45606) 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.694+0000 7f9ee139a640 1 -- 172.21.15.50:0/1142918258 learned_addr learned my addr 172.21.15.50:0/1142918258 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.695+0000 7f9edbfff640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9edc0d3a30 0x7f9edc14d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.695+0000 7f9ee0b99640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9edc0d16d0 0x7f9edc14cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.695+0000 7f9ee139a640 1 -- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9edc0d16d0 msgr2=0x7f9edc14cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.695+0000 7f9ee139a640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9edc0d16d0 0x7f9edc14cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.695+0000 7f9ee139a640 1 -- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9edc0d3a30 msgr2=0x7f9edc14d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.695+0000 7f9ee139a640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9edc0d3a30 0x7f9edc14d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.695+0000 7f9ee139a640 1 -- 172.21.15.50:0/1142918258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc1eaab0 con 0x7f9edc15e870 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.695+0000 7f9ee139a640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9edc15e870 0x7f9edc14b640 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400d830 tx=0x7f9ec400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.695+0000 7f9ed97fa640 1 -- 172.21.15.50:0/1142918258 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4018020 con 0x7f9edc15e870 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.695+0000 7f9ed97fa640 1 -- 172.21.15.50:0/1142918258 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec40096c0 con 0x7f9edc15e870 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.695+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/1142918258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc14ab60 con 0x7f9edc15e870 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.695+0000 7f9ed97fa640 1 -- 172.21.15.50:0/1142918258 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4009a90 con 0x7f9edc15e870 2024-09-11T22:22:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.695+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/1142918258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc14d7b0 con 0x7f9edc15e870 2024-09-11T22:22:37.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.696+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/1142918258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc0b78b0 con 0x7f9edc15e870 2024-09-11T22:22:37.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.696+0000 7f9ed97fa640 1 -- 172.21.15.50:0/1142918258 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ec401b020 con 0x7f9edc15e870 2024-09-11T22:22:37.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.697+0000 7f9ed97fa640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9ebc06be60 0x7f9ebc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:37.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.697+0000 7f9ed97fa640 1 -- 172.21.15.50:0/1142918258 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f9ec408aee0 con 0x7f9edc15e870 2024-09-11T22:22:37.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.697+0000 7f9ee0b99640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9ebc06be60 0x7f9ebc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.698+0000 7f9ee0b99640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9ebc06be60 0x7f9ebc06e320 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9edc15e5d0 tx=0x7f9ed4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.701+0000 7f9ed97fa640 1 -- 172.21.15.50:0/1142918258 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ec4022030 con 0x7f9edc15e870 2024-09-11T22:22:37.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.944+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/1142918258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9edc06bf50 con 0x7f9edc15e870 2024-09-11T22:22:37.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.944+0000 7f9ed97fa640 1 -- 172.21.15.50:0/1142918258 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1351 (secure 0 0 0) 0x7f9ec40592d0 con 0x7f9edc15e870 2024-09-11T22:22:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:37.945 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":706,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":178,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":439447552,"bytes_avail":772654665728,"bytes_total":773094113280,"write_bytes_sec":2525,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":130,"btime":"2024-09-11T22:22:35:871475+0000","id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"c","status":"up:active","gid":10320}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":32,"modified":"2024-09-11T22:22:23.525304+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:22:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.946+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9ebc06be60 msgr2=0x7f9ebc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.946+0000 7f9ee2dfd640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9ebc06be60 0x7f9ebc06e320 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9edc15e5d0 tx=0x7f9ed4008040 comp rx=0 tx=0).stop 2024-09-11T22:22:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.946+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/1142918258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9edc15e870 msgr2=0x7f9edc14b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.946+0000 7f9ee2dfd640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9edc15e870 0x7f9edc14b640 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400d830 tx=0x7f9ec400dcf0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.946+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/1142918258 shutdown_connections 2024-09-11T22:22:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.946+0000 7f9ee2dfd640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9ebc06be60 0x7f9ebc06e320 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.946+0000 7f9ee2dfd640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9edc15e870 0x7f9edc14b640 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.946+0000 7f9ee2dfd640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9edc0d3a30 0x7f9edc14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.946+0000 7f9ee2dfd640 1 --2- 172.21.15.50:0/1142918258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9edc0d16d0 0x7f9edc14cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.946+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/1142918258 >> 172.21.15.50:0/1142918258 conn(0x7f9edc0727a0 msgr2=0x7f9edc0b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.946+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/1142918258 shutdown_connections 2024-09-11T22:22:37.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:37.946+0000 7f9ee2dfd640 1 -- 172.21.15.50:0/1142918258 wait complete. 2024-09-11T22:22:37.958 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:22:37.958 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:22:38.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.059+0000 7fc5a3d42640 1 Processor -- start 2024-09-11T22:22:38.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.059+0000 7fc5a3d42640 1 -- start start 2024-09-11T22:22:38.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a3d42640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc59c15e8e0 0x7fc59c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:38.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a3d42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c162350 0x7fc59c1627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:38.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a3d42640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc59c163080 con 0x7fc59c0d1580 2024-09-11T22:22:38.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a3d42640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc59c15ecc0 con 0x7fc59c15e8e0 2024-09-11T22:22:38.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a3d42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc59c0d2ad0 con 0x7fc59c162350 2024-09-11T22:22:38.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a12dd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc59c0d1580 0x7fc59c0d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59888/0 (socket says 172.21.15.50:59888) 2024-09-11T22:22:38.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a12dd640 1 -- 172.21.15.50:0/1057752253 learned_addr learned my addr 172.21.15.50:0/1057752253 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:38.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 791098269 0 0) 0x7fc59c163080 con 0x7fc59c0d1580 2024-09-11T22:22:38.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a22df640 1 --2- 172.21.15.50:0/1057752253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c162350 0x7fc59c1627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:38.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a1ade640 1 --2- 172.21.15.50:0/1057752253 >> v2:172.21.15.77:3300/0 conn(0x7fc59c15e8e0 0x7fc59c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:38.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc588003520 con 0x7fc59c0d1580 2024-09-11T22:22:38.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 397821505 0 0) 0x7fc588003520 con 0x7fc59c0d1580 2024-09-11T22:22:38.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c162350 msgr2=0x7fc59c1627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:38.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 --2- 172.21.15.50:0/1057752253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c162350 0x7fc59c1627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:38.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 >> v2:172.21.15.77:3300/0 conn(0x7fc59c15e8e0 msgr2=0x7fc59c0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:38.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 --2- 172.21.15.50:0/1057752253 >> v2:172.21.15.77:3300/0 conn(0x7fc59c15e8e0 0x7fc59c0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:38.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59c0d2d20 con 0x7fc59c0d1580 2024-09-11T22:22:38.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fc58c001670 con 0x7fc59c0d1580 2024-09-11T22:22:38.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a22df640 1 --2- 172.21.15.50:0/1057752253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c162350 0x7fc59c1627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:38.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 >> v1:172.21.15.50:6789/0 conn(0x7fc59c0d1580 legacy=0x7fc59c0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:38.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 --2- 172.21.15.50:0/1057752253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5880039b0 0x7fc588003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:38.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 --2- 172.21.15.50:0/1057752253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c162350 0x7fc588004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:38.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 --2- 172.21.15.50:0/1057752253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc588004d40 0x7fc5880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:38.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc59c0d2ad0 con 0x7fc588004d40 2024-09-11T22:22:38.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc58800ba50 con 0x7fc5880039b0 2024-09-11T22:22:38.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.060+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc58800bc50 con 0x7fc59c162350 2024-09-11T22:22:38.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.061+0000 7fc5a22df640 1 --2- 172.21.15.50:0/1057752253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc588004d40 0x7fc5880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:38.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.061+0000 7fc5a12dd640 1 --2- 172.21.15.50:0/1057752253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c162350 0x7fc588004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:38.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.061+0000 7fc5a1ade640 1 --2- 172.21.15.50:0/1057752253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5880039b0 0x7fc588003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:38.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.061+0000 7fc5a22df640 1 -- 172.21.15.50:0/1057752253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c162350 msgr2=0x7fc588004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:38.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.061+0000 7fc5a22df640 1 --2- 172.21.15.50:0/1057752253 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c162350 0x7fc588004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:38.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.061+0000 7fc5a22df640 1 -- 172.21.15.50:0/1057752253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5880039b0 msgr2=0x7fc588003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:38.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.061+0000 7fc5a22df640 1 --2- 172.21.15.50:0/1057752253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5880039b0 0x7fc588003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:38.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.061+0000 7fc5a22df640 1 -- 172.21.15.50:0/1057752253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc588003520 con 0x7fc588004d40 2024-09-11T22:22:38.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.062+0000 7fc5a22df640 1 --2- 172.21.15.50:0/1057752253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc588004d40 0x7fc5880051c0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fc5940073e0 tx=0x7fc588005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7579e71556aaa90 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:38.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.062+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc594009c80 con 0x7fc588004d40 2024-09-11T22:22:38.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.062+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc59402e660 con 0x7fc588004d40 2024-09-11T22:22:38.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.062+0000 7fc5a0adc640 1 -- 172.21.15.50:0/1057752253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59402ea10 con 0x7fc588004d40 2024-09-11T22:22:38.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.062+0000 7fc5a3d42640 1 -- 172.21.15.50:0/1057752253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc588004d40 msgr2=0x7fc5880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:38.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.062+0000 7fc5a3d42640 1 --2- 172.21.15.50:0/1057752253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc588004d40 0x7fc5880051c0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fc5940073e0 tx=0x7fc588005830 comp rx=0 tx=0).stop 2024-09-11T22:22:38.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.062+0000 7fc5a22df640 1 -- 172.21.15.50:0/1057752253 reap_dead start 2024-09-11T22:22:38.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.062+0000 7fc5a3d42640 1 -- 172.21.15.50:0/1057752253 shutdown_connections 2024-09-11T22:22:38.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.062+0000 7fc5a3d42640 1 -- 172.21.15.50:0/1057752253 >> 172.21.15.50:0/1057752253 conn(0x7fc59c067ba0 msgr2=0x7fc59c067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:38.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.062+0000 7fc5a3d42640 1 -- 172.21.15.50:0/1057752253 shutdown_connections 2024-09-11T22:22:38.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.062+0000 7fc5a3d42640 1 -- 172.21.15.50:0/1057752253 wait complete. 2024-09-11T22:22:38.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.064+0000 7fc5a3d42640 1 Processor -- start 2024-09-11T22:22:38.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.064+0000 7fc5a3d42640 1 -- start start 2024-09-11T22:22:38.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.064+0000 7fc5a3d42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc588004d40 0x7fc59c1f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:38.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.064+0000 7fc5a3d42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc59c157870 0x7fc59c0cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:38.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.064+0000 7fc5a3d42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c157cf0 0x7fc59c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:38.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.064+0000 7fc5a3d42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc59c1627e0 con 0x7fc59c157870 2024-09-11T22:22:38.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.064+0000 7fc5a3d42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc59c0d3370 con 0x7fc588004d40 2024-09-11T22:22:38.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.064+0000 7fc5a3d42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc59c162960 con 0x7fc59c157cf0 2024-09-11T22:22:38.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.064+0000 7fc5a12dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc59c157870 0x7fc59c0cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:38.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.064+0000 7fc5a12dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc59c157870 0x7fc59c0cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45626/0 (socket says 172.21.15.50:45626) 2024-09-11T22:22:38.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.064+0000 7fc5a12dd640 1 -- 172.21.15.50:0/2360097786 learned_addr learned my addr 172.21.15.50:0/2360097786 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:38.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.065+0000 7fc5a22df640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c157cf0 0x7fc59c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:38.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.065+0000 7fc5a1ade640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc588004d40 0x7fc59c1f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:38.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.065+0000 7fc5a12dd640 1 -- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c157cf0 msgr2=0x7fc59c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:38.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.065+0000 7fc5a12dd640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c157cf0 0x7fc59c0cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:38.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.065+0000 7fc5a12dd640 1 -- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc588004d40 msgr2=0x7fc59c1f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:38.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.065+0000 7fc5a12dd640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc588004d40 0x7fc59c1f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:38.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.065+0000 7fc5a12dd640 1 -- 172.21.15.50:0/2360097786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59c15f770 con 0x7fc59c157870 2024-09-11T22:22:38.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.065+0000 7fc5a12dd640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc59c157870 0x7fc59c0cb8c0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fc58c007340 tx=0x7fc58c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:38.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.065+0000 7fc5927fc640 1 -- 172.21.15.50:0/2360097786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58c01a070 con 0x7fc59c157870 2024-09-11T22:22:38.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.065+0000 7fc5927fc640 1 -- 172.21.15.50:0/2360097786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58c00f9e0 con 0x7fc59c157870 2024-09-11T22:22:38.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.065+0000 7fc5a3d42640 1 -- 172.21.15.50:0/2360097786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc59c1ea950 con 0x7fc59c157870 2024-09-11T22:22:38.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.065+0000 7fc5927fc640 1 -- 172.21.15.50:0/2360097786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58c00fdd0 con 0x7fc59c157870 2024-09-11T22:22:38.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.065+0000 7fc5a3d42640 1 -- 172.21.15.50:0/2360097786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc59c15fd10 con 0x7fc59c157870 2024-09-11T22:22:38.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.066+0000 7fc5a3d42640 1 -- 172.21.15.50:0/2360097786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc59c162cf0 con 0x7fc59c157870 2024-09-11T22:22:38.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.067+0000 7fc5927fc640 1 -- 172.21.15.50:0/2360097786 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc58c01d070 con 0x7fc59c157870 2024-09-11T22:22:38.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.067+0000 7fc5927fc640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc58006be30 0x7fc58006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:38.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.067+0000 7fc5927fc640 1 -- 172.21.15.50:0/2360097786 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7fc58c08a960 con 0x7fc59c157870 2024-09-11T22:22:38.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.067+0000 7fc5a1ade640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc58006be30 0x7fc58006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:38.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.068+0000 7fc5a1ade640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc58006be30 0x7fc58006e2f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc598006fd0 tx=0x7fc598008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:38.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.071+0000 7fc5927fc640 1 -- 172.21.15.50:0/2360097786 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc58c059310 con 0x7fc59c157870 2024-09-11T22:22:38.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.243+0000 7fc5a3d42640 1 -- 172.21.15.50:0/2360097786 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc59c0ba770 con 0x7fc58006be30 2024-09-11T22:22:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.250+0000 7fc5927fc640 1 -- 172.21.15.50:0/2360097786 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252439 (secure 0 0 0) 0x7fc59c0ba770 con 0x7fc58006be30 2024-09-11T22:22:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:22:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.253+0000 7fc5a3d42640 1 -- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc58006be30 msgr2=0x7fc58006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.253+0000 7fc5a3d42640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc58006be30 0x7fc58006e2f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc598006fd0 tx=0x7fc598008040 comp rx=0 tx=0).stop 2024-09-11T22:22:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.253+0000 7fc5a3d42640 1 -- 172.21.15.50:0/2360097786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc59c157870 msgr2=0x7fc59c0cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.253+0000 7fc5a3d42640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc59c157870 0x7fc59c0cb8c0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fc58c007340 tx=0x7fc58c007800 comp rx=0 tx=0).stop 2024-09-11T22:22:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.253+0000 7fc5a3d42640 1 -- 172.21.15.50:0/2360097786 shutdown_connections 2024-09-11T22:22:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.253+0000 7fc5a3d42640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc58006be30 0x7fc58006e2f0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.253+0000 7fc5a3d42640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59c157cf0 0x7fc59c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.253+0000 7fc5a3d42640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc59c157870 0x7fc59c0cb8c0 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.253+0000 7fc5a3d42640 1 --2- 172.21.15.50:0/2360097786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc588004d40 0x7fc59c1f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.253+0000 7fc5a3d42640 1 -- 172.21.15.50:0/2360097786 >> 172.21.15.50:0/2360097786 conn(0x7fc59c067ba0 msgr2=0x7fc59c0d5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.253+0000 7fc5a3d42640 1 -- 172.21.15.50:0/2360097786 shutdown_connections 2024-09-11T22:22:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:38.253+0000 7fc5a3d42640 1 -- 172.21.15.50:0/2360097786 wait complete. 2024-09-11T22:22:38.265 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":519,"stamp":"2024-09-11T22:22:37.528236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":429148,"kb_used_data":18592,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754545572,"statfs":{"total":773094113280,"available":772654665728,"internally_reserved":0,"allocated":19038208,"data_stored":9002574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":420204081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.677491"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875080+0000","last_change":"2024-09-11T22:22:33.873367+0000","last_active":"2024-09-11T22:22:33.875080+0000","last_peered":"2024-09-11T22:22:33.875080+0000","last_clean":"2024-09-11T22:22:33.875080+0000","last_became_active":"2024-09-11T22:22:33.873099+0000","last_became_peered":"2024-09-11T22:22:33.873099+0000","last_unstale":"2024-09-11T22:22:33.875080+0000","last_undegraded":"2024-09-11T22:22:33.875080+0000","last_fullsized":"2024-09-11T22:22:33.875080+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:21.856111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870192+0000","last_change":"2024-09-11T22:22:33.866561+0000","last_active":"2024-09-11T22:22:33.870192+0000","last_peered":"2024-09-11T22:22:33.870192+0000","last_clean":"2024-09-11T22:22:33.870192+0000","last_became_active":"2024-09-11T22:22:33.866301+0000","last_became_peered":"2024-09-11T22:22:33.866301+0000","last_unstale":"2024-09-11T22:22:33.870192+0000","last_undegraded":"2024-09-11T22:22:33.870192+0000","last_fullsized":"2024-09-11T22:22:33.870192+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:06.549937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104734+0000","last_change":"2024-09-11T22:22:33.868962+0000","last_active":"2024-09-11T22:22:35.104734+0000","last_peered":"2024-09-11T22:22:35.104734+0000","last_clean":"2024-09-11T22:22:35.104734+0000","last_became_active":"2024-09-11T22:22:33.868653+0000","last_became_peered":"2024-09-11T22:22:33.868653+0000","last_unstale":"2024-09-11T22:22:35.104734+0000","last_undegraded":"2024-09-11T22:22:35.104734+0000","last_fullsized":"2024-09-11T22:22:35.104734+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:33.447406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879550+0000","last_change":"2024-09-11T22:22:33.873473+0000","last_active":"2024-09-11T22:22:34.879550+0000","last_peered":"2024-09-11T22:22:34.879550+0000","last_clean":"2024-09-11T22:22:34.879550+0000","last_became_active":"2024-09-11T22:22:33.873210+0000","last_became_peered":"2024-09-11T22:22:33.873210+0000","last_unstale":"2024-09-11T22:22:34.879550+0000","last_undegraded":"2024-09-11T22:22:34.879550+0000","last_fullsized":"2024-09-11T22:22:34.879550+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:45:28.677309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886331+0000","last_change":"2024-09-11T22:22:33.884861+0000","last_active":"2024-09-11T22:22:33.886331+0000","last_peered":"2024-09-11T22:22:33.886331+0000","last_clean":"2024-09-11T22:22:33.886331+0000","last_became_active":"2024-09-11T22:22:33.884592+0000","last_became_peered":"2024-09-11T22:22:33.884592+0000","last_unstale":"2024-09-11T22:22:33.886331+0000","last_undegraded":"2024-09-11T22:22:33.886331+0000","last_fullsized":"2024-09-11T22:22:33.886331+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:07.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877696+0000","last_change":"2024-09-11T22:22:33.874296+0000","last_active":"2024-09-11T22:22:33.877696+0000","last_peered":"2024-09-11T22:22:33.877696+0000","last_clean":"2024-09-11T22:22:33.877696+0000","last_became_active":"2024-09-11T22:22:33.873767+0000","last_became_peered":"2024-09-11T22:22:33.873767+0000","last_unstale":"2024-09-11T22:22:33.877696+0000","last_undegraded":"2024-09-11T22:22:33.877696+0000","last_fullsized":"2024-09-11T22:22:33.877696+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:52:53.352386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872845+0000","last_change":"2024-09-11T22:22:33.871884+0000","last_active":"2024-09-11T22:22:33.872845+0000","last_peered":"2024-09-11T22:22:33.872845+0000","last_clean":"2024-09-11T22:22:33.872845+0000","last_became_active":"2024-09-11T22:22:33.871465+0000","last_became_peered":"2024-09-11T22:22:33.871465+0000","last_unstale":"2024-09-11T22:22:33.872845+0000","last_undegraded":"2024-09-11T22:22:33.872845+0000","last_fullsized":"2024-09-11T22:22:33.872845+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:06:19.002541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876905+0000","last_change":"2024-09-11T22:22:33.872124+0000","last_active":"2024-09-11T22:22:33.876905+0000","last_peered":"2024-09-11T22:22:33.876905+0000","last_clean":"2024-09-11T22:22:33.876905+0000","last_became_active":"2024-09-11T22:22:33.871835+0000","last_became_peered":"2024-09-11T22:22:33.871835+0000","last_unstale":"2024-09-11T22:22:33.876905+0000","last_undegraded":"2024-09-11T22:22:33.876905+0000","last_fullsized":"2024-09-11T22:22:33.876905+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:07.845885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870861+0000","last_change":"2024-09-11T22:22:33.869901+0000","last_active":"2024-09-11T22:22:33.870861+0000","last_peered":"2024-09-11T22:22:33.870861+0000","last_clean":"2024-09-11T22:22:33.870861+0000","last_became_active":"2024-09-11T22:22:33.869519+0000","last_became_peered":"2024-09-11T22:22:33.869519+0000","last_unstale":"2024-09-11T22:22:33.870861+0000","last_undegraded":"2024-09-11T22:22:33.870861+0000","last_fullsized":"2024-09-11T22:22:33.870861+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:34.311452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892605+0000","last_change":"2024-09-11T22:22:33.891761+0000","last_active":"2024-09-11T22:22:33.892605+0000","last_peered":"2024-09-11T22:22:33.892605+0000","last_clean":"2024-09-11T22:22:33.892605+0000","last_became_active":"2024-09-11T22:22:33.891431+0000","last_became_peered":"2024-09-11T22:22:33.891431+0000","last_unstale":"2024-09-11T22:22:33.892605+0000","last_undegraded":"2024-09-11T22:22:33.892605+0000","last_fullsized":"2024-09-11T22:22:33.892605+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:41.584550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104945+0000","last_change":"2024-09-11T22:22:33.871995+0000","last_active":"2024-09-11T22:22:35.104945+0000","last_peered":"2024-09-11T22:22:35.104945+0000","last_clean":"2024-09-11T22:22:35.104945+0000","last_became_active":"2024-09-11T22:22:33.870641+0000","last_became_peered":"2024-09-11T22:22:33.870641+0000","last_unstale":"2024-09-11T22:22:35.104945+0000","last_undegraded":"2024-09-11T22:22:35.104945+0000","last_fullsized":"2024-09-11T22:22:35.104945+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:53.922070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875604+0000","last_change":"2024-09-11T22:22:33.873332+0000","last_active":"2024-09-11T22:22:33.875604+0000","last_peered":"2024-09-11T22:22:33.875604+0000","last_clean":"2024-09-11T22:22:33.875604+0000","last_became_active":"2024-09-11T22:22:33.873063+0000","last_became_peered":"2024-09-11T22:22:33.873063+0000","last_unstale":"2024-09-11T22:22:33.875604+0000","last_undegraded":"2024-09-11T22:22:33.875604+0000","last_fullsized":"2024-09-11T22:22:33.875604+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:19.441983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875867+0000","last_change":"2024-09-11T22:22:33.872546+0000","last_active":"2024-09-11T22:22:33.875867+0000","last_peered":"2024-09-11T22:22:33.875867+0000","last_clean":"2024-09-11T22:22:33.875867+0000","last_became_active":"2024-09-11T22:22:33.871688+0000","last_became_peered":"2024-09-11T22:22:33.871688+0000","last_unstale":"2024-09-11T22:22:33.875867+0000","last_undegraded":"2024-09-11T22:22:33.875867+0000","last_fullsized":"2024-09-11T22:22:33.875867+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:13.685778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890673+0000","last_change":"2024-09-11T22:22:33.882001+0000","last_active":"2024-09-11T22:22:33.890673+0000","last_peered":"2024-09-11T22:22:33.890673+0000","last_clean":"2024-09-11T22:22:33.890673+0000","last_became_active":"2024-09-11T22:22:33.881567+0000","last_became_peered":"2024-09-11T22:22:33.881567+0000","last_unstale":"2024-09-11T22:22:33.890673+0000","last_undegraded":"2024-09-11T22:22:33.890673+0000","last_fullsized":"2024-09-11T22:22:33.890673+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:41:23.986542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890531+0000","last_change":"2024-09-11T22:22:33.883282+0000","last_active":"2024-09-11T22:22:33.890531+0000","last_peered":"2024-09-11T22:22:33.890531+0000","last_clean":"2024-09-11T22:22:33.890531+0000","last_became_active":"2024-09-11T22:22:33.882864+0000","last_became_peered":"2024-09-11T22:22:33.882864+0000","last_unstale":"2024-09-11T22:22:33.890531+0000","last_undegraded":"2024-09-11T22:22:33.890531+0000","last_fullsized":"2024-09-11T22:22:33.890531+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:54.323577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889383+0000","last_change":"2024-09-11T22:22:33.887311+0000","last_active":"2024-09-11T22:22:33.889383+0000","last_peered":"2024-09-11T22:22:33.889383+0000","last_clean":"2024-09-11T22:22:33.889383+0000","last_became_active":"2024-09-11T22:22:33.881922+0000","last_became_peered":"2024-09-11T22:22:33.881922+0000","last_unstale":"2024-09-11T22:22:33.889383+0000","last_undegraded":"2024-09-11T22:22:33.889383+0000","last_fullsized":"2024-09-11T22:22:33.889383+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:59.243443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877418+0000","last_change":"2024-09-11T22:22:33.876445+0000","last_active":"2024-09-11T22:22:33.877418+0000","last_peered":"2024-09-11T22:22:33.877418+0000","last_clean":"2024-09-11T22:22:33.877418+0000","last_became_active":"2024-09-11T22:22:33.876147+0000","last_became_peered":"2024-09-11T22:22:33.876147+0000","last_unstale":"2024-09-11T22:22:33.877418+0000","last_undegraded":"2024-09-11T22:22:33.877418+0000","last_fullsized":"2024-09-11T22:22:33.877418+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:03.175064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889328+0000","last_change":"2024-09-11T22:22:33.883306+0000","last_active":"2024-09-11T22:22:33.889328+0000","last_peered":"2024-09-11T22:22:33.889328+0000","last_clean":"2024-09-11T22:22:33.889328+0000","last_became_active":"2024-09-11T22:22:33.882092+0000","last_became_peered":"2024-09-11T22:22:33.882092+0000","last_unstale":"2024-09-11T22:22:33.889328+0000","last_undegraded":"2024-09-11T22:22:33.889328+0000","last_fullsized":"2024-09-11T22:22:33.889328+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:54.323577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890411+0000","last_change":"2024-09-11T22:22:33.883694+0000","last_active":"2024-09-11T22:22:33.890411+0000","last_peered":"2024-09-11T22:22:33.890411+0000","last_clean":"2024-09-11T22:22:33.890411+0000","last_became_active":"2024-09-11T22:22:33.883401+0000","last_became_peered":"2024-09-11T22:22:33.883401+0000","last_unstale":"2024-09-11T22:22:33.890411+0000","last_undegraded":"2024-09-11T22:22:33.890411+0000","last_fullsized":"2024-09-11T22:22:33.890411+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:48:06.450712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886164+0000","last_change":"2024-09-11T22:22:33.884828+0000","last_active":"2024-09-11T22:22:33.886164+0000","last_peered":"2024-09-11T22:22:33.886164+0000","last_clean":"2024-09-11T22:22:33.886164+0000","last_became_active":"2024-09-11T22:22:33.884077+0000","last_became_peered":"2024-09-11T22:22:33.884077+0000","last_unstale":"2024-09-11T22:22:33.886164+0000","last_undegraded":"2024-09-11T22:22:33.886164+0000","last_fullsized":"2024-09-11T22:22:33.886164+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:37.767944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879371+0000","last_change":"2024-09-11T22:22:33.882845+0000","last_active":"2024-09-11T22:22:34.879371+0000","last_peered":"2024-09-11T22:22:34.879371+0000","last_clean":"2024-09-11T22:22:34.879371+0000","last_became_active":"2024-09-11T22:22:33.882459+0000","last_became_peered":"2024-09-11T22:22:33.882459+0000","last_unstale":"2024-09-11T22:22:34.879371+0000","last_undegraded":"2024-09-11T22:22:34.879371+0000","last_fullsized":"2024-09-11T22:22:34.879371+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:54.725640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.887017+0000","last_change":"2024-09-11T22:22:33.886316+0000","last_active":"2024-09-11T22:22:33.887017+0000","last_peered":"2024-09-11T22:22:33.887017+0000","last_clean":"2024-09-11T22:22:33.887017+0000","last_became_active":"2024-09-11T22:22:33.886001+0000","last_became_peered":"2024-09-11T22:22:33.886001+0000","last_unstale":"2024-09-11T22:22:33.887017+0000","last_undegraded":"2024-09-11T22:22:33.887017+0000","last_fullsized":"2024-09-11T22:22:33.887017+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:20.158581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877317+0000","last_change":"2024-09-11T22:22:33.876492+0000","last_active":"2024-09-11T22:22:33.877317+0000","last_peered":"2024-09-11T22:22:33.877317+0000","last_clean":"2024-09-11T22:22:33.877317+0000","last_became_active":"2024-09-11T22:22:33.876047+0000","last_became_peered":"2024-09-11T22:22:33.876047+0000","last_unstale":"2024-09-11T22:22:33.877317+0000","last_undegraded":"2024-09-11T22:22:33.877317+0000","last_fullsized":"2024-09-11T22:22:33.877317+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:19.441983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879400+0000","last_change":"2024-09-11T22:22:33.872959+0000","last_active":"2024-09-11T22:22:34.879400+0000","last_peered":"2024-09-11T22:22:34.879400+0000","last_clean":"2024-09-11T22:22:34.879400+0000","last_became_active":"2024-09-11T22:22:33.872676+0000","last_became_peered":"2024-09-11T22:22:33.872676+0000","last_unstale":"2024-09-11T22:22:34.879400+0000","last_undegraded":"2024-09-11T22:22:34.879400+0000","last_fullsized":"2024-09-11T22:22:34.879400+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.461678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.884787+0000","last_change":"2024-09-11T22:22:33.884369+0000","last_active":"2024-09-11T22:22:33.884787+0000","last_peered":"2024-09-11T22:22:33.884787+0000","last_clean":"2024-09-11T22:22:33.884787+0000","last_became_active":"2024-09-11T22:22:33.884089+0000","last_became_peered":"2024-09-11T22:22:33.884089+0000","last_unstale":"2024-09-11T22:22:33.884787+0000","last_undegraded":"2024-09-11T22:22:33.884787+0000","last_fullsized":"2024-09-11T22:22:33.884787+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:17.954497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872119+0000","last_change":"2024-09-11T22:22:33.870192+0000","last_active":"2024-09-11T22:22:33.872119+0000","last_peered":"2024-09-11T22:22:33.872119+0000","last_clean":"2024-09-11T22:22:33.872119+0000","last_became_active":"2024-09-11T22:22:33.869842+0000","last_became_peered":"2024-09-11T22:22:33.869842+0000","last_unstale":"2024-09-11T22:22:33.872119+0000","last_undegraded":"2024-09-11T22:22:33.872119+0000","last_fullsized":"2024-09-11T22:22:33.872119+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:04.924074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876355+0000","last_change":"2024-09-11T22:22:33.874097+0000","last_active":"2024-09-11T22:22:33.876355+0000","last_peered":"2024-09-11T22:22:33.876355+0000","last_clean":"2024-09-11T22:22:33.876355+0000","last_became_active":"2024-09-11T22:22:33.873815+0000","last_became_peered":"2024-09-11T22:22:33.873815+0000","last_unstale":"2024-09-11T22:22:33.876355+0000","last_undegraded":"2024-09-11T22:22:33.876355+0000","last_fullsized":"2024-09-11T22:22:33.876355+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:20.158581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104578+0000","last_change":"2024-09-11T22:22:33.878017+0000","last_active":"2024-09-11T22:22:35.104578+0000","last_peered":"2024-09-11T22:22:35.104578+0000","last_clean":"2024-09-11T22:22:35.104578+0000","last_became_active":"2024-09-11T22:22:33.877721+0000","last_became_peered":"2024-09-11T22:22:33.877721+0000","last_unstale":"2024-09-11T22:22:35.104578+0000","last_undegraded":"2024-09-11T22:22:35.104578+0000","last_fullsized":"2024-09-11T22:22:35.104578+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:50.188912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875889+0000","last_change":"2024-09-11T22:22:33.873410+0000","last_active":"2024-09-11T22:22:33.875889+0000","last_peered":"2024-09-11T22:22:33.875889+0000","last_clean":"2024-09-11T22:22:33.875889+0000","last_became_active":"2024-09-11T22:22:33.873139+0000","last_became_peered":"2024-09-11T22:22:33.873139+0000","last_unstale":"2024-09-11T22:22:33.875889+0000","last_undegraded":"2024-09-11T22:22:33.875889+0000","last_fullsized":"2024-09-11T22:22:33.875889+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:21.561002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877236+0000","last_change":"2024-09-11T22:22:33.875556+0000","last_active":"2024-09-11T22:22:33.877236+0000","last_peered":"2024-09-11T22:22:33.877236+0000","last_clean":"2024-09-11T22:22:33.877236+0000","last_became_active":"2024-09-11T22:22:33.875271+0000","last_became_peered":"2024-09-11T22:22:33.875271+0000","last_unstale":"2024-09-11T22:22:33.877236+0000","last_undegraded":"2024-09-11T22:22:33.877236+0000","last_fullsized":"2024-09-11T22:22:33.877236+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:57.213641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872059+0000","last_change":"2024-09-11T22:22:33.871266+0000","last_active":"2024-09-11T22:22:33.872059+0000","last_peered":"2024-09-11T22:22:33.872059+0000","last_clean":"2024-09-11T22:22:33.872059+0000","last_became_active":"2024-09-11T22:22:33.870953+0000","last_became_peered":"2024-09-11T22:22:33.870953+0000","last_unstale":"2024-09-11T22:22:33.872059+0000","last_undegraded":"2024-09-11T22:22:33.872059+0000","last_fullsized":"2024-09-11T22:22:33.872059+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.051705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890511+0000","last_change":"2024-09-11T22:22:33.881317+0000","last_active":"2024-09-11T22:22:33.890511+0000","last_peered":"2024-09-11T22:22:33.890511+0000","last_clean":"2024-09-11T22:22:33.890511+0000","last_became_active":"2024-09-11T22:22:33.880855+0000","last_became_peered":"2024-09-11T22:22:33.880855+0000","last_unstale":"2024-09-11T22:22:33.890511+0000","last_undegraded":"2024-09-11T22:22:33.890511+0000","last_fullsized":"2024-09-11T22:22:33.890511+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:19.325750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876547+0000","last_change":"2024-09-11T22:22:33.874494+0000","last_active":"2024-09-11T22:22:33.876547+0000","last_peered":"2024-09-11T22:22:33.876547+0000","last_clean":"2024-09-11T22:22:33.876547+0000","last_became_active":"2024-09-11T22:22:33.874228+0000","last_became_peered":"2024-09-11T22:22:33.874228+0000","last_unstale":"2024-09-11T22:22:33.876547+0000","last_undegraded":"2024-09-11T22:22:33.876547+0000","last_fullsized":"2024-09-11T22:22:33.876547+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:51.735057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"177'4","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.888895+0000","last_change":"2024-09-11T22:22:32.875504+0000","last_active":"2024-09-11T22:22:33.888895+0000","last_peered":"2024-09-11T22:22:33.888895+0000","last_clean":"2024-09-11T22:22:33.888895+0000","last_became_active":"2024-09-11T22:22:32.875253+0000","last_became_peered":"2024-09-11T22:22:32.875253+0000","last_unstale":"2024-09-11T22:22:33.888895+0000","last_undegraded":"2024-09-11T22:22:33.888895+0000","last_fullsized":"2024-09-11T22:22:33.888895+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:56.207572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877216+0000","last_change":"2024-09-11T22:22:33.875788+0000","last_active":"2024-09-11T22:22:33.877216+0000","last_peered":"2024-09-11T22:22:33.877216+0000","last_clean":"2024-09-11T22:22:33.877216+0000","last_became_active":"2024-09-11T22:22:33.875491+0000","last_became_peered":"2024-09-11T22:22:33.875491+0000","last_unstale":"2024-09-11T22:22:33.877216+0000","last_undegraded":"2024-09-11T22:22:33.877216+0000","last_fullsized":"2024-09-11T22:22:33.877216+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:13.685778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.888708+0000","last_change":"2024-09-11T22:22:32.872040+0000","last_active":"2024-09-11T22:22:33.888708+0000","last_peered":"2024-09-11T22:22:33.888708+0000","last_clean":"2024-09-11T22:22:33.888708+0000","last_became_active":"2024-09-11T22:22:32.871733+0000","last_became_peered":"2024-09-11T22:22:32.871733+0000","last_unstale":"2024-09-11T22:22:33.888708+0000","last_undegraded":"2024-09-11T22:22:33.888708+0000","last_fullsized":"2024-09-11T22:22:33.888708+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:57.631086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872137+0000","last_change":"2024-09-11T22:22:33.871433+0000","last_active":"2024-09-11T22:22:33.872137+0000","last_peered":"2024-09-11T22:22:33.872137+0000","last_clean":"2024-09-11T22:22:33.872137+0000","last_became_active":"2024-09-11T22:22:33.871134+0000","last_became_peered":"2024-09-11T22:22:33.871134+0000","last_unstale":"2024-09-11T22:22:33.872137+0000","last_undegraded":"2024-09-11T22:22:33.872137+0000","last_fullsized":"2024-09-11T22:22:33.872137+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:52.234618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"177'2","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105046+0000","last_change":"2024-09-11T22:22:32.871683+0000","last_active":"2024-09-11T22:22:35.105046+0000","last_peered":"2024-09-11T22:22:35.105046+0000","last_clean":"2024-09-11T22:22:35.105046+0000","last_became_active":"2024-09-11T22:22:32.871394+0000","last_became_peered":"2024-09-11T22:22:32.871394+0000","last_unstale":"2024-09-11T22:22:35.105046+0000","last_undegraded":"2024-09-11T22:22:35.105046+0000","last_fullsized":"2024-09-11T22:22:35.105046+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:25.624911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890443+0000","last_change":"2024-09-11T22:22:33.885084+0000","last_active":"2024-09-11T22:22:33.890443+0000","last_peered":"2024-09-11T22:22:33.890443+0000","last_clean":"2024-09-11T22:22:33.890443+0000","last_became_active":"2024-09-11T22:22:33.884682+0000","last_became_peered":"2024-09-11T22:22:33.884682+0000","last_unstale":"2024-09-11T22:22:33.890443+0000","last_undegraded":"2024-09-11T22:22:33.890443+0000","last_fullsized":"2024-09-11T22:22:33.890443+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:44.490870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"177'2","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879612+0000","last_change":"2024-09-11T22:22:32.873503+0000","last_active":"2024-09-11T22:22:34.879612+0000","last_peered":"2024-09-11T22:22:34.879612+0000","last_clean":"2024-09-11T22:22:34.879612+0000","last_became_active":"2024-09-11T22:22:32.873227+0000","last_became_peered":"2024-09-11T22:22:32.873227+0000","last_unstale":"2024-09-11T22:22:34.879612+0000","last_undegraded":"2024-09-11T22:22:34.879612+0000","last_fullsized":"2024-09-11T22:22:34.879612+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:09.224692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879392+0000","last_change":"2024-09-11T22:22:33.874211+0000","last_active":"2024-09-11T22:22:34.879392+0000","last_peered":"2024-09-11T22:22:34.879392+0000","last_clean":"2024-09-11T22:22:34.879392+0000","last_became_active":"2024-09-11T22:22:33.873948+0000","last_became_peered":"2024-09-11T22:22:33.873948+0000","last_unstale":"2024-09-11T22:22:34.879392+0000","last_undegraded":"2024-09-11T22:22:34.879392+0000","last_fullsized":"2024-09-11T22:22:34.879392+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.466819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890199+0000","last_change":"2024-09-11T22:22:32.876739+0000","last_active":"2024-09-11T22:22:33.890199+0000","last_peered":"2024-09-11T22:22:33.890199+0000","last_clean":"2024-09-11T22:22:33.890199+0000","last_became_active":"2024-09-11T22:22:32.876472+0000","last_became_peered":"2024-09-11T22:22:32.876472+0000","last_unstale":"2024-09-11T22:22:33.890199+0000","last_undegraded":"2024-09-11T22:22:33.890199+0000","last_fullsized":"2024-09-11T22:22:33.890199+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:47.992674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.876928+0000","last_change":"2024-09-11T22:22:33.872839+0000","last_active":"2024-09-11T22:22:33.876928+0000","last_peered":"2024-09-11T22:22:33.876928+0000","last_clean":"2024-09-11T22:22:33.876928+0000","last_became_active":"2024-09-11T22:22:33.872541+0000","last_became_peered":"2024-09-11T22:22:33.872541+0000","last_unstale":"2024-09-11T22:22:33.876928+0000","last_undegraded":"2024-09-11T22:22:33.876928+0000","last_fullsized":"2024-09-11T22:22:33.876928+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:58.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867063+0000","last_change":"2024-09-11T22:22:32.868319+0000","last_active":"2024-09-11T22:22:33.867063+0000","last_peered":"2024-09-11T22:22:33.867063+0000","last_clean":"2024-09-11T22:22:33.867063+0000","last_became_active":"2024-09-11T22:22:32.868050+0000","last_became_peered":"2024-09-11T22:22:32.868050+0000","last_unstale":"2024-09-11T22:22:33.867063+0000","last_undegraded":"2024-09-11T22:22:33.867063+0000","last_fullsized":"2024-09-11T22:22:33.867063+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:01.463502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879439+0000","last_change":"2024-09-11T22:22:33.875498+0000","last_active":"2024-09-11T22:22:34.879439+0000","last_peered":"2024-09-11T22:22:34.879439+0000","last_clean":"2024-09-11T22:22:34.879439+0000","last_became_active":"2024-09-11T22:22:33.874795+0000","last_became_peered":"2024-09-11T22:22:33.874795+0000","last_unstale":"2024-09-11T22:22:34.879439+0000","last_undegraded":"2024-09-11T22:22:34.879439+0000","last_fullsized":"2024-09-11T22:22:34.879439+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:40.227649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865009+0000","last_change":"2024-09-11T22:22:32.876471+0000","last_active":"2024-09-11T22:22:33.865009+0000","last_peered":"2024-09-11T22:22:33.865009+0000","last_clean":"2024-09-11T22:22:33.865009+0000","last_became_active":"2024-09-11T22:22:32.876165+0000","last_became_peered":"2024-09-11T22:22:32.876165+0000","last_unstale":"2024-09-11T22:22:33.865009+0000","last_undegraded":"2024-09-11T22:22:33.865009+0000","last_fullsized":"2024-09-11T22:22:33.865009+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:59.849409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879663+0000","last_change":"2024-09-11T22:22:33.871288+0000","last_active":"2024-09-11T22:22:34.879663+0000","last_peered":"2024-09-11T22:22:34.879663+0000","last_clean":"2024-09-11T22:22:34.879663+0000","last_became_active":"2024-09-11T22:22:33.870994+0000","last_became_peered":"2024-09-11T22:22:33.870994+0000","last_unstale":"2024-09-11T22:22:34.879663+0000","last_undegraded":"2024-09-11T22:22:34.879663+0000","last_fullsized":"2024-09-11T22:22:34.879663+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:08.940215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867438+0000","last_change":"2024-09-11T22:22:32.868187+0000","last_active":"2024-09-11T22:22:33.867438+0000","last_peered":"2024-09-11T22:22:33.867438+0000","last_clean":"2024-09-11T22:22:33.867438+0000","last_became_active":"2024-09-11T22:22:32.867873+0000","last_became_peered":"2024-09-11T22:22:32.867873+0000","last_unstale":"2024-09-11T22:22:33.867438+0000","last_undegraded":"2024-09-11T22:22:33.867438+0000","last_fullsized":"2024-09-11T22:22:33.867438+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:16.014510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105316+0000","last_change":"2024-09-11T22:22:33.876012+0000","last_active":"2024-09-11T22:22:35.105316+0000","last_peered":"2024-09-11T22:22:35.105316+0000","last_clean":"2024-09-11T22:22:35.105316+0000","last_became_active":"2024-09-11T22:22:33.875720+0000","last_became_peered":"2024-09-11T22:22:33.875720+0000","last_unstale":"2024-09-11T22:22:35.105316+0000","last_undegraded":"2024-09-11T22:22:35.105316+0000","last_fullsized":"2024-09-11T22:22:35.105316+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:33.761223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865676+0000","last_change":"2024-09-11T22:22:32.871536+0000","last_active":"2024-09-11T22:22:33.865676+0000","last_peered":"2024-09-11T22:22:33.865676+0000","last_clean":"2024-09-11T22:22:33.865676+0000","last_became_active":"2024-09-11T22:22:32.870670+0000","last_became_peered":"2024-09-11T22:22:32.870670+0000","last_unstale":"2024-09-11T22:22:33.865676+0000","last_undegraded":"2024-09-11T22:22:33.865676+0000","last_fullsized":"2024-09-11T22:22:33.865676+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:50.728988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879583+0000","last_change":"2024-09-11T22:22:33.871247+0000","last_active":"2024-09-11T22:22:34.879583+0000","last_peered":"2024-09-11T22:22:34.879583+0000","last_clean":"2024-09-11T22:22:34.879583+0000","last_became_active":"2024-09-11T22:22:33.870952+0000","last_became_peered":"2024-09-11T22:22:33.870952+0000","last_unstale":"2024-09-11T22:22:34.879583+0000","last_undegraded":"2024-09-11T22:22:34.879583+0000","last_fullsized":"2024-09-11T22:22:34.879583+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:08.678884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"177'3","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892700+0000","last_change":"2024-09-11T22:22:32.874858+0000","last_active":"2024-09-11T22:22:33.892700+0000","last_peered":"2024-09-11T22:22:33.892700+0000","last_clean":"2024-09-11T22:22:33.892700+0000","last_became_active":"2024-09-11T22:22:32.874556+0000","last_became_peered":"2024-09-11T22:22:32.874556+0000","last_unstale":"2024-09-11T22:22:33.892700+0000","last_undegraded":"2024-09-11T22:22:33.892700+0000","last_fullsized":"2024-09-11T22:22:33.892700+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:41.633829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890387+0000","last_change":"2024-09-11T22:22:33.880424+0000","last_active":"2024-09-11T22:22:33.890387+0000","last_peered":"2024-09-11T22:22:33.890387+0000","last_clean":"2024-09-11T22:22:33.890387+0000","last_became_active":"2024-09-11T22:22:33.880082+0000","last_became_peered":"2024-09-11T22:22:33.880082+0000","last_unstale":"2024-09-11T22:22:33.890387+0000","last_undegraded":"2024-09-11T22:22:33.890387+0000","last_fullsized":"2024-09-11T22:22:33.890387+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:51.419145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"177'6","reported_seq":20,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879631+0000","last_change":"2024-09-11T22:22:32.874281+0000","last_active":"2024-09-11T22:22:34.879631+0000","last_peered":"2024-09-11T22:22:34.879631+0000","last_clean":"2024-09-11T22:22:34.879631+0000","last_became_active":"2024-09-11T22:22:32.873683+0000","last_became_peered":"2024-09-11T22:22:32.873683+0000","last_unstale":"2024-09-11T22:22:34.879631+0000","last_undegraded":"2024-09-11T22:22:34.879631+0000","last_fullsized":"2024-09-11T22:22:34.879631+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:04.618180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886309+0000","last_change":"2024-09-11T22:22:33.885274+0000","last_active":"2024-09-11T22:22:33.886309+0000","last_peered":"2024-09-11T22:22:33.886309+0000","last_clean":"2024-09-11T22:22:33.886309+0000","last_became_active":"2024-09-11T22:22:33.884990+0000","last_became_peered":"2024-09-11T22:22:33.884990+0000","last_unstale":"2024-09-11T22:22:33.886309+0000","last_undegraded":"2024-09-11T22:22:33.886309+0000","last_fullsized":"2024-09-11T22:22:33.886309+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:02.633479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"177'2","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.886978+0000","last_change":"2024-09-11T22:22:32.872106+0000","last_active":"2024-09-11T22:22:33.886978+0000","last_peered":"2024-09-11T22:22:33.886978+0000","last_clean":"2024-09-11T22:22:33.886978+0000","last_became_active":"2024-09-11T22:22:32.871772+0000","last_became_peered":"2024-09-11T22:22:32.871772+0000","last_unstale":"2024-09-11T22:22:33.886978+0000","last_undegraded":"2024-09-11T22:22:33.886978+0000","last_fullsized":"2024-09-11T22:22:33.886978+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.839583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889321+0000","last_change":"2024-09-11T22:22:33.882949+0000","last_active":"2024-09-11T22:22:33.889321+0000","last_peered":"2024-09-11T22:22:33.889321+0000","last_clean":"2024-09-11T22:22:33.889321+0000","last_became_active":"2024-09-11T22:22:33.882659+0000","last_became_peered":"2024-09-11T22:22:33.882659+0000","last_unstale":"2024-09-11T22:22:33.889321+0000","last_undegraded":"2024-09-11T22:22:33.889321+0000","last_fullsized":"2024-09-11T22:22:33.889321+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:41:23.986542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865728+0000","last_change":"2024-09-11T22:22:32.869908+0000","last_active":"2024-09-11T22:22:33.865728+0000","last_peered":"2024-09-11T22:22:33.865728+0000","last_clean":"2024-09-11T22:22:33.865728+0000","last_became_active":"2024-09-11T22:22:32.869622+0000","last_became_peered":"2024-09-11T22:22:32.869622+0000","last_unstale":"2024-09-11T22:22:33.865728+0000","last_undegraded":"2024-09-11T22:22:33.865728+0000","last_fullsized":"2024-09-11T22:22:33.865728+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:26.942462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105608+0000","last_change":"2024-09-11T22:22:33.873149+0000","last_active":"2024-09-11T22:22:35.105608+0000","last_peered":"2024-09-11T22:22:35.105608+0000","last_clean":"2024-09-11T22:22:35.105608+0000","last_became_active":"2024-09-11T22:22:33.870569+0000","last_became_peered":"2024-09-11T22:22:33.870569+0000","last_unstale":"2024-09-11T22:22:35.105608+0000","last_undegraded":"2024-09-11T22:22:35.105608+0000","last_fullsized":"2024-09-11T22:22:35.105608+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:30.251297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872544+0000","last_change":"2024-09-11T22:22:32.874747+0000","last_active":"2024-09-11T22:22:33.872544+0000","last_peered":"2024-09-11T22:22:33.872544+0000","last_clean":"2024-09-11T22:22:33.872544+0000","last_became_active":"2024-09-11T22:22:32.874454+0000","last_became_peered":"2024-09-11T22:22:32.874454+0000","last_unstale":"2024-09-11T22:22:33.872544+0000","last_undegraded":"2024-09-11T22:22:33.872544+0000","last_fullsized":"2024-09-11T22:22:33.872544+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:20.850041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.872183+0000","last_change":"2024-09-11T22:22:33.871139+0000","last_active":"2024-09-11T22:22:33.872183+0000","last_peered":"2024-09-11T22:22:33.872183+0000","last_clean":"2024-09-11T22:22:33.872183+0000","last_became_active":"2024-09-11T22:22:33.870706+0000","last_became_peered":"2024-09-11T22:22:33.870706+0000","last_unstale":"2024-09-11T22:22:33.872183+0000","last_undegraded":"2024-09-11T22:22:33.872183+0000","last_fullsized":"2024-09-11T22:22:33.872183+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:06.718551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"177'8","reported_seq":22,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105633+0000","last_change":"2024-09-11T22:22:32.870819+0000","last_active":"2024-09-11T22:22:35.105633+0000","last_peered":"2024-09-11T22:22:35.105633+0000","last_clean":"2024-09-11T22:22:35.105633+0000","last_became_active":"2024-09-11T22:22:32.870541+0000","last_became_peered":"2024-09-11T22:22:32.870541+0000","last_unstale":"2024-09-11T22:22:35.105633+0000","last_undegraded":"2024-09-11T22:22:35.105633+0000","last_fullsized":"2024-09-11T22:22:35.105633+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:40.741597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.871584+0000","last_change":"2024-09-11T22:22:33.869366+0000","last_active":"2024-09-11T22:22:33.871584+0000","last_peered":"2024-09-11T22:22:33.871584+0000","last_clean":"2024-09-11T22:22:33.871584+0000","last_became_active":"2024-09-11T22:22:33.869095+0000","last_became_peered":"2024-09-11T22:22:33.869095+0000","last_unstale":"2024-09-11T22:22:33.871584+0000","last_undegraded":"2024-09-11T22:22:33.871584+0000","last_fullsized":"2024-09-11T22:22:33.871584+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:08.615227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.891842+0000","last_change":"2024-09-11T22:22:32.869194+0000","last_active":"2024-09-11T22:22:33.891842+0000","last_peered":"2024-09-11T22:22:33.891842+0000","last_clean":"2024-09-11T22:22:33.891842+0000","last_became_active":"2024-09-11T22:22:32.868931+0000","last_became_peered":"2024-09-11T22:22:32.868931+0000","last_unstale":"2024-09-11T22:22:33.891842+0000","last_undegraded":"2024-09-11T22:22:33.891842+0000","last_fullsized":"2024-09-11T22:22:33.891842+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:41.209428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.884771+0000","last_change":"2024-09-11T22:22:33.884363+0000","last_active":"2024-09-11T22:22:33.884771+0000","last_peered":"2024-09-11T22:22:33.884771+0000","last_clean":"2024-09-11T22:22:33.884771+0000","last_became_active":"2024-09-11T22:22:33.884103+0000","last_became_peered":"2024-09-11T22:22:33.884103+0000","last_unstale":"2024-09-11T22:22:33.884771+0000","last_undegraded":"2024-09-11T22:22:33.884771+0000","last_fullsized":"2024-09-11T22:22:33.884771+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:09.845653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"177'2","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892467+0000","last_change":"2024-09-11T22:22:32.875435+0000","last_active":"2024-09-11T22:22:33.892467+0000","last_peered":"2024-09-11T22:22:33.892467+0000","last_clean":"2024-09-11T22:22:33.892467+0000","last_became_active":"2024-09-11T22:22:32.875176+0000","last_became_peered":"2024-09-11T22:22:32.875176+0000","last_unstale":"2024-09-11T22:22:33.892467+0000","last_undegraded":"2024-09-11T22:22:33.892467+0000","last_fullsized":"2024-09-11T22:22:33.892467+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:28.777018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105584+0000","last_change":"2024-09-11T22:22:33.863470+0000","last_active":"2024-09-11T22:22:35.105584+0000","last_peered":"2024-09-11T22:22:35.105584+0000","last_clean":"2024-09-11T22:22:35.105584+0000","last_became_active":"2024-09-11T22:22:33.863138+0000","last_became_peered":"2024-09-11T22:22:33.863138+0000","last_unstale":"2024-09-11T22:22:35.105584+0000","last_undegraded":"2024-09-11T22:22:35.105584+0000","last_fullsized":"2024-09-11T22:22:35.105584+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:23.571456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.891285+0000","last_change":"2024-09-11T22:22:32.873935+0000","last_active":"2024-09-11T22:22:33.891285+0000","last_peered":"2024-09-11T22:22:33.891285+0000","last_clean":"2024-09-11T22:22:33.891285+0000","last_became_active":"2024-09-11T22:22:32.872709+0000","last_became_peered":"2024-09-11T22:22:32.872709+0000","last_unstale":"2024-09-11T22:22:33.891285+0000","last_undegraded":"2024-09-11T22:22:33.891285+0000","last_fullsized":"2024-09-11T22:22:33.891285+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:50.413075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.888390+0000","last_change":"2024-09-11T22:22:33.879571+0000","last_active":"2024-09-11T22:22:33.888390+0000","last_peered":"2024-09-11T22:22:33.888390+0000","last_clean":"2024-09-11T22:22:33.888390+0000","last_became_active":"2024-09-11T22:22:33.879288+0000","last_became_peered":"2024-09-11T22:22:33.879288+0000","last_unstale":"2024-09-11T22:22:33.888390+0000","last_undegraded":"2024-09-11T22:22:33.888390+0000","last_fullsized":"2024-09-11T22:22:33.888390+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:19.325750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104718+0000","last_change":"2024-09-11T22:22:32.869179+0000","last_active":"2024-09-11T22:22:35.104718+0000","last_peered":"2024-09-11T22:22:35.104718+0000","last_clean":"2024-09-11T22:22:35.104718+0000","last_became_active":"2024-09-11T22:22:32.868874+0000","last_became_peered":"2024-09-11T22:22:32.868874+0000","last_unstale":"2024-09-11T22:22:35.104718+0000","last_undegraded":"2024-09-11T22:22:35.104718+0000","last_fullsized":"2024-09-11T22:22:35.104718+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:05.433343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.889301+0000","last_change":"2024-09-11T22:22:33.882673+0000","last_active":"2024-09-11T22:22:33.889301+0000","last_peered":"2024-09-11T22:22:33.889301+0000","last_clean":"2024-09-11T22:22:33.889301+0000","last_became_active":"2024-09-11T22:22:33.881961+0000","last_became_peered":"2024-09-11T22:22:33.881961+0000","last_unstale":"2024-09-11T22:22:33.889301+0000","last_undegraded":"2024-09-11T22:22:33.889301+0000","last_fullsized":"2024-09-11T22:22:33.889301+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:40.704844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"177'2","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.892004+0000","last_change":"2024-09-11T22:22:32.871013+0000","last_active":"2024-09-11T22:22:33.892004+0000","last_peered":"2024-09-11T22:22:33.892004+0000","last_clean":"2024-09-11T22:22:33.892004+0000","last_became_active":"2024-09-11T22:22:32.869592+0000","last_became_peered":"2024-09-11T22:22:32.869592+0000","last_unstale":"2024-09-11T22:22:33.892004+0000","last_undegraded":"2024-09-11T22:22:33.892004+0000","last_fullsized":"2024-09-11T22:22:33.892004+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:02.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105642+0000","last_change":"2024-09-11T22:22:33.874000+0000","last_active":"2024-09-11T22:22:35.105642+0000","last_peered":"2024-09-11T22:22:35.105642+0000","last_clean":"2024-09-11T22:22:35.105642+0000","last_became_active":"2024-09-11T22:22:33.873677+0000","last_became_peered":"2024-09-11T22:22:33.873677+0000","last_unstale":"2024-09-11T22:22:35.105642+0000","last_undegraded":"2024-09-11T22:22:35.105642+0000","last_fullsized":"2024-09-11T22:22:35.105642+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:02.713795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870436+0000","last_change":"2024-09-11T22:22:32.868236+0000","last_active":"2024-09-11T22:22:33.870436+0000","last_peered":"2024-09-11T22:22:33.870436+0000","last_clean":"2024-09-11T22:22:33.870436+0000","last_became_active":"2024-09-11T22:22:32.867876+0000","last_became_peered":"2024-09-11T22:22:32.867876+0000","last_unstale":"2024-09-11T22:22:33.870436+0000","last_undegraded":"2024-09-11T22:22:33.870436+0000","last_fullsized":"2024-09-11T22:22:33.870436+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:51.010593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.870299+0000","last_change":"2024-09-11T22:22:33.866913+0000","last_active":"2024-09-11T22:22:33.870299+0000","last_peered":"2024-09-11T22:22:33.870299+0000","last_clean":"2024-09-11T22:22:33.870299+0000","last_became_active":"2024-09-11T22:22:33.866628+0000","last_became_peered":"2024-09-11T22:22:33.866628+0000","last_unstale":"2024-09-11T22:22:33.870299+0000","last_undegraded":"2024-09-11T22:22:33.870299+0000","last_fullsized":"2024-09-11T22:22:33.870299+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:29.858473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867015+0000","last_change":"2024-09-11T22:22:32.872329+0000","last_active":"2024-09-11T22:22:33.867015+0000","last_peered":"2024-09-11T22:22:33.867015+0000","last_clean":"2024-09-11T22:22:33.867015+0000","last_became_active":"2024-09-11T22:22:32.871836+0000","last_became_peered":"2024-09-11T22:22:32.871836+0000","last_unstale":"2024-09-11T22:22:33.867015+0000","last_undegraded":"2024-09-11T22:22:33.867015+0000","last_fullsized":"2024-09-11T22:22:33.867015+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:16.999557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877594+0000","last_change":"2024-09-11T22:22:33.876747+0000","last_active":"2024-09-11T22:22:33.877594+0000","last_peered":"2024-09-11T22:22:33.877594+0000","last_clean":"2024-09-11T22:22:33.877594+0000","last_became_active":"2024-09-11T22:22:33.876137+0000","last_became_peered":"2024-09-11T22:22:33.876137+0000","last_unstale":"2024-09-11T22:22:33.877594+0000","last_undegraded":"2024-09-11T22:22:33.877594+0000","last_fullsized":"2024-09-11T22:22:33.877594+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:21.561002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867731+0000","last_change":"2024-09-11T22:22:32.873479+0000","last_active":"2024-09-11T22:22:33.867731+0000","last_peered":"2024-09-11T22:22:33.867731+0000","last_clean":"2024-09-11T22:22:33.867731+0000","last_became_active":"2024-09-11T22:22:32.873187+0000","last_became_peered":"2024-09-11T22:22:32.873187+0000","last_unstale":"2024-09-11T22:22:33.867731+0000","last_undegraded":"2024-09-11T22:22:33.867731+0000","last_fullsized":"2024-09-11T22:22:33.867731+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:52.625796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.883423+0000","last_change":"2024-09-11T22:22:33.882379+0000","last_active":"2024-09-11T22:22:33.883423+0000","last_peered":"2024-09-11T22:22:33.883423+0000","last_clean":"2024-09-11T22:22:33.883423+0000","last_became_active":"2024-09-11T22:22:33.882098+0000","last_became_peered":"2024-09-11T22:22:33.882098+0000","last_unstale":"2024-09-11T22:22:33.883423+0000","last_undegraded":"2024-09-11T22:22:33.883423+0000","last_fullsized":"2024-09-11T22:22:33.883423+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:59.833957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"177'2","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105419+0000","last_change":"2024-09-11T22:22:32.873658+0000","last_active":"2024-09-11T22:22:35.105419+0000","last_peered":"2024-09-11T22:22:35.105419+0000","last_clean":"2024-09-11T22:22:35.105419+0000","last_became_active":"2024-09-11T22:22:32.872822+0000","last_became_peered":"2024-09-11T22:22:32.872822+0000","last_unstale":"2024-09-11T22:22:35.105419+0000","last_undegraded":"2024-09-11T22:22:35.105419+0000","last_fullsized":"2024-09-11T22:22:35.105419+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:54.311584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890546+0000","last_change":"2024-09-11T22:22:33.880882+0000","last_active":"2024-09-11T22:22:33.890546+0000","last_peered":"2024-09-11T22:22:33.890546+0000","last_clean":"2024-09-11T22:22:33.890546+0000","last_became_active":"2024-09-11T22:22:33.880577+0000","last_became_peered":"2024-09-11T22:22:33.880577+0000","last_unstale":"2024-09-11T22:22:33.890546+0000","last_undegraded":"2024-09-11T22:22:33.890546+0000","last_fullsized":"2024-09-11T22:22:33.890546+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:42.639899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"178'1","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879669+0000","last_change":"2024-09-11T22:22:32.875400+0000","last_active":"2024-09-11T22:22:34.879669+0000","last_peered":"2024-09-11T22:22:34.879669+0000","last_clean":"2024-09-11T22:22:34.879669+0000","last_became_active":"2024-09-11T22:22:32.875056+0000","last_became_peered":"2024-09-11T22:22:32.875056+0000","last_unstale":"2024-09-11T22:22:34.879669+0000","last_undegraded":"2024-09-11T22:22:34.879669+0000","last_fullsized":"2024-09-11T22:22:34.879669+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:51.454702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.877067+0000","last_change":"2024-09-11T22:22:33.875215+0000","last_active":"2024-09-11T22:22:33.877067+0000","last_peered":"2024-09-11T22:22:33.877067+0000","last_clean":"2024-09-11T22:22:33.877067+0000","last_became_active":"2024-09-11T22:22:33.874961+0000","last_became_peered":"2024-09-11T22:22:33.874961+0000","last_unstale":"2024-09-11T22:22:33.877067+0000","last_undegraded":"2024-09-11T22:22:33.877067+0000","last_fullsized":"2024-09-11T22:22:33.877067+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:27.948531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.869538+0000","last_change":"2024-09-11T22:22:32.867763+0000","last_active":"2024-09-11T22:22:33.869538+0000","last_peered":"2024-09-11T22:22:33.869538+0000","last_clean":"2024-09-11T22:22:33.869538+0000","last_became_active":"2024-09-11T22:22:32.867493+0000","last_became_peered":"2024-09-11T22:22:32.867493+0000","last_unstale":"2024-09-11T22:22:33.869538+0000","last_undegraded":"2024-09-11T22:22:33.869538+0000","last_fullsized":"2024-09-11T22:22:33.869538+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:13.188631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.873056+0000","last_change":"2024-09-11T22:22:33.871871+0000","last_active":"2024-09-11T22:22:33.873056+0000","last_peered":"2024-09-11T22:22:33.873056+0000","last_clean":"2024-09-11T22:22:33.873056+0000","last_became_active":"2024-09-11T22:22:33.871567+0000","last_became_peered":"2024-09-11T22:22:33.871567+0000","last_unstale":"2024-09-11T22:22:33.873056+0000","last_undegraded":"2024-09-11T22:22:33.873056+0000","last_fullsized":"2024-09-11T22:22:33.873056+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:17.954497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104811+0000","last_change":"2024-09-11T22:22:32.875098+0000","last_active":"2024-09-11T22:22:35.104811+0000","last_peered":"2024-09-11T22:22:35.104811+0000","last_clean":"2024-09-11T22:22:35.104811+0000","last_became_active":"2024-09-11T22:22:32.872807+0000","last_became_peered":"2024-09-11T22:22:32.872807+0000","last_unstale":"2024-09-11T22:22:35.104811+0000","last_undegraded":"2024-09-11T22:22:35.104811+0000","last_fullsized":"2024-09-11T22:22:35.104811+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:06.287546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875021+0000","last_change":"2024-09-11T22:22:33.872648+0000","last_active":"2024-09-11T22:22:33.875021+0000","last_peered":"2024-09-11T22:22:33.875021+0000","last_clean":"2024-09-11T22:22:33.875021+0000","last_became_active":"2024-09-11T22:22:33.872364+0000","last_became_peered":"2024-09-11T22:22:33.872364+0000","last_unstale":"2024-09-11T22:22:33.875021+0000","last_undegraded":"2024-09-11T22:22:33.875021+0000","last_fullsized":"2024-09-11T22:22:33.875021+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:42.051705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879438+0000","last_change":"2024-09-11T22:22:32.877875+0000","last_active":"2024-09-11T22:22:34.879438+0000","last_peered":"2024-09-11T22:22:34.879438+0000","last_clean":"2024-09-11T22:22:34.879438+0000","last_became_active":"2024-09-11T22:22:32.877559+0000","last_became_peered":"2024-09-11T22:22:32.877559+0000","last_unstale":"2024-09-11T22:22:34.879438+0000","last_undegraded":"2024-09-11T22:22:34.879438+0000","last_fullsized":"2024-09-11T22:22:34.879438+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:05.308567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.882948+0000","last_change":"2024-09-11T22:22:33.882413+0000","last_active":"2024-09-11T22:22:33.882948+0000","last_peered":"2024-09-11T22:22:33.882948+0000","last_clean":"2024-09-11T22:22:33.882948+0000","last_became_active":"2024-09-11T22:22:33.882153+0000","last_became_peered":"2024-09-11T22:22:33.882153+0000","last_unstale":"2024-09-11T22:22:33.882948+0000","last_undegraded":"2024-09-11T22:22:33.882948+0000","last_fullsized":"2024-09-11T22:22:33.882948+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:08.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.867928+0000","last_change":"2024-09-11T22:22:32.876657+0000","last_active":"2024-09-11T22:22:33.867928+0000","last_peered":"2024-09-11T22:22:33.867928+0000","last_clean":"2024-09-11T22:22:33.867928+0000","last_became_active":"2024-09-11T22:22:32.876140+0000","last_became_peered":"2024-09-11T22:22:32.876140+0000","last_unstale":"2024-09-11T22:22:33.867928+0000","last_undegraded":"2024-09-11T22:22:33.867928+0000","last_fullsized":"2024-09-11T22:22:33.867928+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:21.127707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105514+0000","last_change":"2024-09-11T22:22:33.873842+0000","last_active":"2024-09-11T22:22:35.105514+0000","last_peered":"2024-09-11T22:22:35.105514+0000","last_clean":"2024-09-11T22:22:35.105514+0000","last_became_active":"2024-09-11T22:22:33.873564+0000","last_became_peered":"2024-09-11T22:22:33.873564+0000","last_unstale":"2024-09-11T22:22:35.105514+0000","last_undegraded":"2024-09-11T22:22:35.105514+0000","last_fullsized":"2024-09-11T22:22:35.105514+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:37:42.342912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.865883+0000","last_change":"2024-09-11T22:22:32.874909+0000","last_active":"2024-09-11T22:22:33.865883+0000","last_peered":"2024-09-11T22:22:33.865883+0000","last_clean":"2024-09-11T22:22:33.865883+0000","last_became_active":"2024-09-11T22:22:32.874627+0000","last_became_peered":"2024-09-11T22:22:32.874627+0000","last_unstale":"2024-09-11T22:22:33.865883+0000","last_undegraded":"2024-09-11T22:22:33.865883+0000","last_fullsized":"2024-09-11T22:22:33.865883+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:56.207572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.875724+0000","last_change":"2024-09-11T22:22:33.871239+0000","last_active":"2024-09-11T22:22:33.875724+0000","last_peered":"2024-09-11T22:22:33.875724+0000","last_clean":"2024-09-11T22:22:33.875724+0000","last_became_active":"2024-09-11T22:22:33.870917+0000","last_became_peered":"2024-09-11T22:22:33.870917+0000","last_unstale":"2024-09-11T22:22:33.875724+0000","last_undegraded":"2024-09-11T22:22:33.875724+0000","last_fullsized":"2024-09-11T22:22:33.875724+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:00.855479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.862829+0000","last_change":"2024-09-11T22:22:32.876591+0000","last_active":"2024-09-11T22:22:33.862829+0000","last_peered":"2024-09-11T22:22:33.862829+0000","last_clean":"2024-09-11T22:22:33.862829+0000","last_became_active":"2024-09-11T22:22:32.876343+0000","last_became_peered":"2024-09-11T22:22:32.876343+0000","last_unstale":"2024-09-11T22:22:33.862829+0000","last_undegraded":"2024-09-11T22:22:33.862829+0000","last_fullsized":"2024-09-11T22:22:33.862829+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.839583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.890564+0000","last_change":"2024-09-11T22:22:33.881708+0000","last_active":"2024-09-11T22:22:33.890564+0000","last_peered":"2024-09-11T22:22:33.890564+0000","last_clean":"2024-09-11T22:22:33.890564+0000","last_became_active":"2024-09-11T22:22:33.880955+0000","last_became_peered":"2024-09-11T22:22:33.880955+0000","last_unstale":"2024-09-11T22:22:33.890564+0000","last_undegraded":"2024-09-11T22:22:33.890564+0000","last_fullsized":"2024-09-11T22:22:33.890564+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:40.704844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"177'1","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-11T22:22:33.891456+0000","last_change":"2024-09-11T22:22:32.876390+0000","last_active":"2024-09-11T22:22:33.891456+0000","last_peered":"2024-09-11T22:22:33.891456+0000","last_clean":"2024-09-11T22:22:33.891456+0000","last_became_active":"2024-09-11T22:22:32.876077+0000","last_became_peered":"2024-09-11T22:22:32.876077+0000","last_unstale":"2024-09-11T22:22:33.891456+0000","last_undegraded":"2024-09-11T22:22:33.891456+0000","last_fullsized":"2024-09-11T22:22:33.891456+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:16.948428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":455,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879265+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:22:34.879265+0000","last_peered":"2024-09-11T22:22:34.879265+0000","last_clean":"2024-09-11T22:22:34.879265+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:22:34.879265+0000","last_undegraded":"2024-09-11T22:22:34.879265+0000","last_fullsized":"2024-09-11T22:22:34.879265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509583,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55576,"kb_used_data":2176,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316264,"statfs":{"total":96636764160,"available":96579854336,"internally_reserved":0,"allocated":2228224,"data_stored":977912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509580,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51400,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320440,"statfs":{"total":96636764160,"available":96584130560,"internally_reserved":0,"allocated":2211840,"data_stored":970555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509582,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63916,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307924,"statfs":{"total":96636764160,"available":96571314176,"internally_reserved":0,"allocated":2244608,"data_stored":979046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509582,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47268,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324572,"statfs":{"total":96636764160,"available":96588361728,"internally_reserved":0,"allocated":2236416,"data_stored":977512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509582,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47256,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324584,"statfs":{"total":96636764160,"available":96588374016,"internally_reserved":0,"allocated":2232320,"data_stored":977386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509581,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60300,"kb_used_data":2740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311540,"statfs":{"total":96636764160,"available":96575016960,"internally_reserved":0,"allocated":2805760,"data_stored":1560923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56172,"kb_used_data":2776,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315668,"statfs":{"total":96636764160,"available":96579244032,"internally_reserved":0,"allocated":2842624,"data_stored":1575610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574989,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47260,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324580,"statfs":{"total":96636764160,"available":96588369920,"internally_reserved":0,"allocated":2236416,"data_stored":983630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:22:41.270 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:22:41.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.384+0000 7f7c7d8ba640 1 Processor -- start 2024-09-11T22:22:41.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.384+0000 7f7c7d8ba640 1 -- start start 2024-09-11T22:22:41.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.385+0000 7f7c7d8ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c7815f350 0x7f7c7815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.385+0000 7f7c7d8ba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7c780679c0 0x7f7c78067e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.385+0000 7f7c7d8ba640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c7815f7f0 con 0x7f7c7815c3c0 2024-09-11T22:22:41.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.385+0000 7f7c7d8ba640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f7c7806e700 con 0x7f7c7815f350 2024-09-11T22:22:41.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.385+0000 7f7c7d8ba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7c7815fad0 con 0x7f7c780679c0 2024-09-11T22:22:41.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.385+0000 7f7c767fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c7815f350 0x7f7c7815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.385+0000 7f7c76ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7c7815c3c0 0x7f7c7815ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59890/0 (socket says 172.21.15.50:59890) 2024-09-11T22:22:41.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.385+0000 7f7c76ffd640 1 -- 172.21.15.50:0/1919216581 learned_addr learned my addr 172.21.15.50:0/1919216581 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:41.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.385+0000 7f7c777fe640 1 --2- 172.21.15.50:0/1919216581 >> v2:172.21.15.77:3300/0 conn(0x7f7c780679c0 0x7f7c78067e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.386+0000 7f7c767fc640 1 -- 172.21.15.50:0/1919216581 >> v2:172.21.15.77:3300/0 conn(0x7f7c780679c0 msgr2=0x7f7c78067e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:41.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.386+0000 7f7c767fc640 1 --2- 172.21.15.50:0/1919216581 >> v2:172.21.15.77:3300/0 conn(0x7f7c780679c0 0x7f7c78067e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.386+0000 7f7c767fc640 1 -- 172.21.15.50:0/1919216581 >> v1:172.21.15.50:6789/0 conn(0x7f7c7815c3c0 legacy=0x7f7c7815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:41.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.386+0000 7f7c767fc640 1 -- 172.21.15.50:0/1919216581 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7806e950 con 0x7f7c7815f350 2024-09-11T22:22:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.386+0000 7f7c767fc640 1 --2- 172.21.15.50:0/1919216581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7815f350 0x7f7c7815fe60 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f7c780cfbd0 tx=0x7f7c6002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6731d94258d25d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.386+0000 7f7c75ffb640 1 -- 172.21.15.50:0/1919216581 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60037070 con 0x7f7c7815f350 2024-09-11T22:22:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.387+0000 7f7c75ffb640 1 -- 172.21.15.50:0/1919216581 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c60032440 con 0x7f7c7815f350 2024-09-11T22:22:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.387+0000 7f7c75ffb640 1 -- 172.21.15.50:0/1919216581 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6002ae60 con 0x7f7c7815f350 2024-09-11T22:22:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.387+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/1919216581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7815f350 msgr2=0x7f7c7815fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.387+0000 7f7c7d8ba640 1 --2- 172.21.15.50:0/1919216581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7815f350 0x7f7c7815fe60 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f7c780cfbd0 tx=0x7f7c6002a110 comp rx=0 tx=0).stop 2024-09-11T22:22:41.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.387+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/1919216581 shutdown_connections 2024-09-11T22:22:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.387+0000 7f7c7d8ba640 1 --2- 172.21.15.50:0/1919216581 >> v2:172.21.15.77:3300/0 conn(0x7f7c780679c0 0x7f7c78067e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.387+0000 7f7c7d8ba640 1 --2- 172.21.15.50:0/1919216581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7815f350 0x7f7c7815fe60 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.387+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/1919216581 >> 172.21.15.50:0/1919216581 conn(0x7f7c78075060 msgr2=0x7f7c7806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.387+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/1919216581 shutdown_connections 2024-09-11T22:22:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.387+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/1919216581 wait complete. 2024-09-11T22:22:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.388+0000 7f7c7d8ba640 1 Processor -- start 2024-09-11T22:22:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.389+0000 7f7c7d8ba640 1 -- start start 2024-09-11T22:22:41.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.389+0000 7f7c7d8ba640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c780679c0 0x7f7c78160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.389+0000 7f7c7d8ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c7815c3c0 0x7f7c78159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.389+0000 7f7c7d8ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7815f350 0x7f7c78148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.389+0000 7f7c7d8ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7806f150 con 0x7f7c7815f350 2024-09-11T22:22:41.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.389+0000 7f7c7d8ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c780d0940 con 0x7f7c7815c3c0 2024-09-11T22:22:41.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.389+0000 7f7c7d8ba640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c7806f2d0 con 0x7f7c780679c0 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c777fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7815f350 0x7f7c78148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c777fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7815f350 0x7f7c78148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45646/0 (socket says 172.21.15.50:45646) 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c777fe640 1 -- 172.21.15.50:0/3729956923 learned_addr learned my addr 172.21.15.50:0/3729956923 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c76ffd640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c780679c0 0x7f7c78160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c767fc640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c7815c3c0 0x7f7c78159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c777fe640 1 -- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c780679c0 msgr2=0x7f7c78160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c777fe640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c780679c0 0x7f7c78160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c777fe640 1 -- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c7815c3c0 msgr2=0x7f7c78159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c777fe640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c7815c3c0 0x7f7c78159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c777fe640 1 -- 172.21.15.50:0/3729956923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c78153150 con 0x7f7c7815f350 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c777fe640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7815f350 0x7f7c78148cb0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000d830 tx=0x7f7c7000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c6ffff640 1 -- 172.21.15.50:0/3729956923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000b6c0 con 0x7f7c7815f350 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c6ffff640 1 -- 172.21.15.50:0/3729956923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c70019070 con 0x7f7c7815f350 2024-09-11T22:22:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/3729956923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c78153430 con 0x7f7c7815f350 2024-09-11T22:22:41.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c6ffff640 1 -- 172.21.15.50:0/3729956923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000bac0 con 0x7f7c7815f350 2024-09-11T22:22:41.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.390+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/3729956923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c781539f0 con 0x7f7c7815f350 2024-09-11T22:22:41.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.391+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/3729956923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c7815fe60 con 0x7f7c7815f350 2024-09-11T22:22:41.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.392+0000 7f7c6ffff640 1 -- 172.21.15.50:0/3729956923 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c7001e460 con 0x7f7c7815f350 2024-09-11T22:22:41.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.392+0000 7f7c6ffff640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c5806be60 0x7f7c5806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.392+0000 7f7c6ffff640 1 -- 172.21.15.50:0/3729956923 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f7c7008b430 con 0x7f7c7815f350 2024-09-11T22:22:41.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.392+0000 7f7c76ffd640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c5806be60 0x7f7c5806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.393+0000 7f7c76ffd640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c5806be60 0x7f7c5806e320 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f7c680012e0 tx=0x7f7c68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.397+0000 7f7c6ffff640 1 -- 172.21.15.50:0/3729956923 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c70059e50 con 0x7f7c7815f350 2024-09-11T22:22:41.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.569+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/3729956923 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7c78160eb0 con 0x7f7c5806be60 2024-09-11T22:22:41.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.575+0000 7f7c6ffff640 1 -- 172.21.15.50:0/3729956923 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252400 (secure 0 0 0) 0x7f7c78160eb0 con 0x7f7c5806be60 2024-09-11T22:22:41.578 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:41.580 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:22:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.578+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c5806be60 msgr2=0x7f7c5806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.578+0000 7f7c7d8ba640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c5806be60 0x7f7c5806e320 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f7c680012e0 tx=0x7f7c68009040 comp rx=0 tx=0).stop 2024-09-11T22:22:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.578+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/3729956923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7815f350 msgr2=0x7f7c78148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.578+0000 7f7c7d8ba640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7815f350 0x7f7c78148cb0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000d830 tx=0x7f7c7000dcf0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.579+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/3729956923 shutdown_connections 2024-09-11T22:22:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.579+0000 7f7c7d8ba640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c5806be60 0x7f7c5806e320 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.579+0000 7f7c7d8ba640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7815f350 0x7f7c78148cb0 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.579+0000 7f7c7d8ba640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c7815c3c0 0x7f7c78159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.579+0000 7f7c7d8ba640 1 --2- 172.21.15.50:0/3729956923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c780679c0 0x7f7c78160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.579+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/3729956923 >> 172.21.15.50:0/3729956923 conn(0x7f7c78075060 msgr2=0x7f7c7815a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.579+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/3729956923 shutdown_connections 2024-09-11T22:22:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.579+0000 7f7c7d8ba640 1 -- 172.21.15.50:0/3729956923 wait complete. 2024-09-11T22:22:41.591 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":521,"stamp":"2024-09-11T22:22:41.529504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":429236,"kb_used_data":18696,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754545484,"statfs":{"total":773094113280,"available":772654575616,"internally_reserved":0,"allocated":19144704,"data_stored":9054596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":420204081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002103"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105011+0000","last_change":"2024-09-11T22:22:33.873367+0000","last_active":"2024-09-11T22:22:35.105011+0000","last_peered":"2024-09-11T22:22:35.105011+0000","last_clean":"2024-09-11T22:22:35.105011+0000","last_became_active":"2024-09-11T22:22:33.873099+0000","last_became_peered":"2024-09-11T22:22:33.873099+0000","last_unstale":"2024-09-11T22:22:35.105011+0000","last_undegraded":"2024-09-11T22:22:35.105011+0000","last_fullsized":"2024-09-11T22:22:35.105011+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:42.507465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864404+0000","last_change":"2024-09-11T22:22:33.866561+0000","last_active":"2024-09-11T22:22:34.864404+0000","last_peered":"2024-09-11T22:22:34.864404+0000","last_clean":"2024-09-11T22:22:34.864404+0000","last_became_active":"2024-09-11T22:22:33.866301+0000","last_became_peered":"2024-09-11T22:22:33.866301+0000","last_unstale":"2024-09-11T22:22:34.864404+0000","last_undegraded":"2024-09-11T22:22:34.864404+0000","last_fullsized":"2024-09-11T22:22:34.864404+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:20.158581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104734+0000","last_change":"2024-09-11T22:22:33.868962+0000","last_active":"2024-09-11T22:22:35.104734+0000","last_peered":"2024-09-11T22:22:35.104734+0000","last_clean":"2024-09-11T22:22:35.104734+0000","last_became_active":"2024-09-11T22:22:33.868653+0000","last_became_peered":"2024-09-11T22:22:33.868653+0000","last_unstale":"2024-09-11T22:22:35.104734+0000","last_undegraded":"2024-09-11T22:22:35.104734+0000","last_fullsized":"2024-09-11T22:22:35.104734+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:33.447406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879550+0000","last_change":"2024-09-11T22:22:33.873473+0000","last_active":"2024-09-11T22:22:34.879550+0000","last_peered":"2024-09-11T22:22:34.879550+0000","last_clean":"2024-09-11T22:22:34.879550+0000","last_became_active":"2024-09-11T22:22:33.873210+0000","last_became_peered":"2024-09-11T22:22:33.873210+0000","last_unstale":"2024-09-11T22:22:34.879550+0000","last_undegraded":"2024-09-11T22:22:34.879550+0000","last_fullsized":"2024-09-11T22:22:34.879550+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:45:28.677309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.860242+0000","last_change":"2024-09-11T22:22:33.884861+0000","last_active":"2024-09-11T22:22:34.860242+0000","last_peered":"2024-09-11T22:22:34.860242+0000","last_clean":"2024-09-11T22:22:34.860242+0000","last_became_active":"2024-09-11T22:22:33.884592+0000","last_became_peered":"2024-09-11T22:22:33.884592+0000","last_unstale":"2024-09-11T22:22:34.860242+0000","last_undegraded":"2024-09-11T22:22:34.860242+0000","last_fullsized":"2024-09-11T22:22:34.860242+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:31.713389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.860098+0000","last_change":"2024-09-11T22:22:33.874296+0000","last_active":"2024-09-11T22:22:34.860098+0000","last_peered":"2024-09-11T22:22:34.860098+0000","last_clean":"2024-09-11T22:22:34.860098+0000","last_became_active":"2024-09-11T22:22:33.873767+0000","last_became_peered":"2024-09-11T22:22:33.873767+0000","last_unstale":"2024-09-11T22:22:34.860098+0000","last_undegraded":"2024-09-11T22:22:34.860098+0000","last_fullsized":"2024-09-11T22:22:34.860098+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:33.770973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104869+0000","last_change":"2024-09-11T22:22:33.871884+0000","last_active":"2024-09-11T22:22:35.104869+0000","last_peered":"2024-09-11T22:22:35.104869+0000","last_clean":"2024-09-11T22:22:35.104869+0000","last_became_active":"2024-09-11T22:22:33.871465+0000","last_became_peered":"2024-09-11T22:22:33.871465+0000","last_unstale":"2024-09-11T22:22:35.104869+0000","last_undegraded":"2024-09-11T22:22:35.104869+0000","last_fullsized":"2024-09-11T22:22:35.104869+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:01.098360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.859960+0000","last_change":"2024-09-11T22:22:33.872124+0000","last_active":"2024-09-11T22:22:34.859960+0000","last_peered":"2024-09-11T22:22:34.859960+0000","last_clean":"2024-09-11T22:22:34.859960+0000","last_became_active":"2024-09-11T22:22:33.871835+0000","last_became_peered":"2024-09-11T22:22:33.871835+0000","last_unstale":"2024-09-11T22:22:34.859960+0000","last_undegraded":"2024-09-11T22:22:34.859960+0000","last_fullsized":"2024-09-11T22:22:34.859960+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:34.702974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.865108+0000","last_change":"2024-09-11T22:22:33.869901+0000","last_active":"2024-09-11T22:22:34.865108+0000","last_peered":"2024-09-11T22:22:34.865108+0000","last_clean":"2024-09-11T22:22:34.865108+0000","last_became_active":"2024-09-11T22:22:33.869519+0000","last_became_peered":"2024-09-11T22:22:33.869519+0000","last_unstale":"2024-09-11T22:22:34.865108+0000","last_undegraded":"2024-09-11T22:22:34.865108+0000","last_fullsized":"2024-09-11T22:22:34.865108+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:53.631866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104596+0000","last_change":"2024-09-11T22:22:33.891761+0000","last_active":"2024-09-11T22:22:35.104596+0000","last_peered":"2024-09-11T22:22:35.104596+0000","last_clean":"2024-09-11T22:22:35.104596+0000","last_became_active":"2024-09-11T22:22:33.891431+0000","last_became_peered":"2024-09-11T22:22:33.891431+0000","last_unstale":"2024-09-11T22:22:35.104596+0000","last_undegraded":"2024-09-11T22:22:35.104596+0000","last_fullsized":"2024-09-11T22:22:35.104596+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:19.197550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104945+0000","last_change":"2024-09-11T22:22:33.871995+0000","last_active":"2024-09-11T22:22:35.104945+0000","last_peered":"2024-09-11T22:22:35.104945+0000","last_clean":"2024-09-11T22:22:35.104945+0000","last_became_active":"2024-09-11T22:22:33.870641+0000","last_became_peered":"2024-09-11T22:22:33.870641+0000","last_unstale":"2024-09-11T22:22:35.104945+0000","last_undegraded":"2024-09-11T22:22:35.104945+0000","last_fullsized":"2024-09-11T22:22:35.104945+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:53.922070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.881520+0000","last_change":"2024-09-11T22:22:33.873332+0000","last_active":"2024-09-11T22:22:34.881520+0000","last_peered":"2024-09-11T22:22:34.881520+0000","last_clean":"2024-09-11T22:22:34.881520+0000","last_became_active":"2024-09-11T22:22:33.873063+0000","last_became_peered":"2024-09-11T22:22:33.873063+0000","last_unstale":"2024-09-11T22:22:34.881520+0000","last_undegraded":"2024-09-11T22:22:34.881520+0000","last_fullsized":"2024-09-11T22:22:34.881520+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:22.133776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.881492+0000","last_change":"2024-09-11T22:22:33.872546+0000","last_active":"2024-09-11T22:22:34.881492+0000","last_peered":"2024-09-11T22:22:34.881492+0000","last_clean":"2024-09-11T22:22:34.881492+0000","last_became_active":"2024-09-11T22:22:33.871688+0000","last_became_peered":"2024-09-11T22:22:33.871688+0000","last_unstale":"2024-09-11T22:22:34.881492+0000","last_undegraded":"2024-09-11T22:22:34.881492+0000","last_fullsized":"2024-09-11T22:22:34.881492+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:42.215498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104499+0000","last_change":"2024-09-11T22:22:33.882001+0000","last_active":"2024-09-11T22:22:35.104499+0000","last_peered":"2024-09-11T22:22:35.104499+0000","last_clean":"2024-09-11T22:22:35.104499+0000","last_became_active":"2024-09-11T22:22:33.881567+0000","last_became_peered":"2024-09-11T22:22:33.881567+0000","last_unstale":"2024-09-11T22:22:35.104499+0000","last_undegraded":"2024-09-11T22:22:35.104499+0000","last_fullsized":"2024-09-11T22:22:35.104499+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:59.243443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105026+0000","last_change":"2024-09-11T22:22:33.883282+0000","last_active":"2024-09-11T22:22:35.105026+0000","last_peered":"2024-09-11T22:22:35.105026+0000","last_clean":"2024-09-11T22:22:35.105026+0000","last_became_active":"2024-09-11T22:22:33.882864+0000","last_became_peered":"2024-09-11T22:22:33.882864+0000","last_unstale":"2024-09-11T22:22:35.105026+0000","last_undegraded":"2024-09-11T22:22:35.105026+0000","last_fullsized":"2024-09-11T22:22:35.105026+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:17.763593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104765+0000","last_change":"2024-09-11T22:22:33.887311+0000","last_active":"2024-09-11T22:22:35.104765+0000","last_peered":"2024-09-11T22:22:35.104765+0000","last_clean":"2024-09-11T22:22:35.104765+0000","last_became_active":"2024-09-11T22:22:33.881922+0000","last_became_peered":"2024-09-11T22:22:33.881922+0000","last_unstale":"2024-09-11T22:22:35.104765+0000","last_undegraded":"2024-09-11T22:22:35.104765+0000","last_fullsized":"2024-09-11T22:22:35.104765+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:26.836404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105162+0000","last_change":"2024-09-11T22:22:33.876445+0000","last_active":"2024-09-11T22:22:35.105162+0000","last_peered":"2024-09-11T22:22:35.105162+0000","last_clean":"2024-09-11T22:22:35.105162+0000","last_became_active":"2024-09-11T22:22:33.876147+0000","last_became_peered":"2024-09-11T22:22:33.876147+0000","last_unstale":"2024-09-11T22:22:35.105162+0000","last_undegraded":"2024-09-11T22:22:35.105162+0000","last_fullsized":"2024-09-11T22:22:35.105162+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:19.197550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104737+0000","last_change":"2024-09-11T22:22:33.883306+0000","last_active":"2024-09-11T22:22:35.104737+0000","last_peered":"2024-09-11T22:22:35.104737+0000","last_clean":"2024-09-11T22:22:35.104737+0000","last_became_active":"2024-09-11T22:22:33.882092+0000","last_became_peered":"2024-09-11T22:22:33.882092+0000","last_unstale":"2024-09-11T22:22:35.104737+0000","last_undegraded":"2024-09-11T22:22:35.104737+0000","last_fullsized":"2024-09-11T22:22:35.104737+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:22.714269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104425+0000","last_change":"2024-09-11T22:22:33.883694+0000","last_active":"2024-09-11T22:22:35.104425+0000","last_peered":"2024-09-11T22:22:35.104425+0000","last_clean":"2024-09-11T22:22:35.104425+0000","last_became_active":"2024-09-11T22:22:33.883401+0000","last_became_peered":"2024-09-11T22:22:33.883401+0000","last_unstale":"2024-09-11T22:22:35.104425+0000","last_undegraded":"2024-09-11T22:22:35.104425+0000","last_fullsized":"2024-09-11T22:22:35.104425+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:59.963692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.860355+0000","last_change":"2024-09-11T22:22:33.884828+0000","last_active":"2024-09-11T22:22:34.860355+0000","last_peered":"2024-09-11T22:22:34.860355+0000","last_clean":"2024-09-11T22:22:34.860355+0000","last_became_active":"2024-09-11T22:22:33.884077+0000","last_became_peered":"2024-09-11T22:22:33.884077+0000","last_unstale":"2024-09-11T22:22:34.860355+0000","last_undegraded":"2024-09-11T22:22:34.860355+0000","last_fullsized":"2024-09-11T22:22:34.860355+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:37.798733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879371+0000","last_change":"2024-09-11T22:22:33.882845+0000","last_active":"2024-09-11T22:22:34.879371+0000","last_peered":"2024-09-11T22:22:34.879371+0000","last_clean":"2024-09-11T22:22:34.879371+0000","last_became_active":"2024-09-11T22:22:33.882459+0000","last_became_peered":"2024-09-11T22:22:33.882459+0000","last_unstale":"2024-09-11T22:22:34.879371+0000","last_undegraded":"2024-09-11T22:22:34.879371+0000","last_fullsized":"2024-09-11T22:22:34.879371+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:54.725640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.863931+0000","last_change":"2024-09-11T22:22:33.886316+0000","last_active":"2024-09-11T22:22:34.863931+0000","last_peered":"2024-09-11T22:22:34.863931+0000","last_clean":"2024-09-11T22:22:34.863931+0000","last_became_active":"2024-09-11T22:22:33.886001+0000","last_became_peered":"2024-09-11T22:22:33.886001+0000","last_unstale":"2024-09-11T22:22:34.863931+0000","last_undegraded":"2024-09-11T22:22:34.863931+0000","last_fullsized":"2024-09-11T22:22:34.863931+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:59.833957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864614+0000","last_change":"2024-09-11T22:22:33.876492+0000","last_active":"2024-09-11T22:22:34.864614+0000","last_peered":"2024-09-11T22:22:34.864614+0000","last_clean":"2024-09-11T22:22:34.864614+0000","last_became_active":"2024-09-11T22:22:33.876047+0000","last_became_peered":"2024-09-11T22:22:33.876047+0000","last_unstale":"2024-09-11T22:22:34.864614+0000","last_undegraded":"2024-09-11T22:22:34.864614+0000","last_fullsized":"2024-09-11T22:22:34.864614+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:42.215498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879400+0000","last_change":"2024-09-11T22:22:33.872959+0000","last_active":"2024-09-11T22:22:34.879400+0000","last_peered":"2024-09-11T22:22:34.879400+0000","last_clean":"2024-09-11T22:22:34.879400+0000","last_became_active":"2024-09-11T22:22:33.872676+0000","last_became_peered":"2024-09-11T22:22:33.872676+0000","last_unstale":"2024-09-11T22:22:34.879400+0000","last_undegraded":"2024-09-11T22:22:34.879400+0000","last_fullsized":"2024-09-11T22:22:34.879400+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.461678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864808+0000","last_change":"2024-09-11T22:22:33.884369+0000","last_active":"2024-09-11T22:22:34.864808+0000","last_peered":"2024-09-11T22:22:34.864808+0000","last_clean":"2024-09-11T22:22:34.864808+0000","last_became_active":"2024-09-11T22:22:33.884089+0000","last_became_peered":"2024-09-11T22:22:33.884089+0000","last_unstale":"2024-09-11T22:22:34.864808+0000","last_undegraded":"2024-09-11T22:22:34.864808+0000","last_fullsized":"2024-09-11T22:22:34.864808+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:17.020580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105094+0000","last_change":"2024-09-11T22:22:33.870192+0000","last_active":"2024-09-11T22:22:35.105094+0000","last_peered":"2024-09-11T22:22:35.105094+0000","last_clean":"2024-09-11T22:22:35.105094+0000","last_became_active":"2024-09-11T22:22:33.869842+0000","last_became_peered":"2024-09-11T22:22:33.869842+0000","last_unstale":"2024-09-11T22:22:35.105094+0000","last_undegraded":"2024-09-11T22:22:35.105094+0000","last_fullsized":"2024-09-11T22:22:35.105094+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:59.963692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.881495+0000","last_change":"2024-09-11T22:22:33.874097+0000","last_active":"2024-09-11T22:22:34.881495+0000","last_peered":"2024-09-11T22:22:34.881495+0000","last_clean":"2024-09-11T22:22:34.881495+0000","last_became_active":"2024-09-11T22:22:33.873815+0000","last_became_peered":"2024-09-11T22:22:33.873815+0000","last_unstale":"2024-09-11T22:22:34.881495+0000","last_undegraded":"2024-09-11T22:22:34.881495+0000","last_fullsized":"2024-09-11T22:22:34.881495+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:53.631866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104578+0000","last_change":"2024-09-11T22:22:33.878017+0000","last_active":"2024-09-11T22:22:35.104578+0000","last_peered":"2024-09-11T22:22:35.104578+0000","last_clean":"2024-09-11T22:22:35.104578+0000","last_became_active":"2024-09-11T22:22:33.877721+0000","last_became_peered":"2024-09-11T22:22:33.877721+0000","last_unstale":"2024-09-11T22:22:35.104578+0000","last_undegraded":"2024-09-11T22:22:35.104578+0000","last_fullsized":"2024-09-11T22:22:35.104578+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:50.188912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.881339+0000","last_change":"2024-09-11T22:22:33.873410+0000","last_active":"2024-09-11T22:22:34.881339+0000","last_peered":"2024-09-11T22:22:34.881339+0000","last_clean":"2024-09-11T22:22:34.881339+0000","last_became_active":"2024-09-11T22:22:33.873139+0000","last_became_peered":"2024-09-11T22:22:33.873139+0000","last_unstale":"2024-09-11T22:22:34.881339+0000","last_undegraded":"2024-09-11T22:22:34.881339+0000","last_fullsized":"2024-09-11T22:22:34.881339+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:02.469571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.863773+0000","last_change":"2024-09-11T22:22:33.875556+0000","last_active":"2024-09-11T22:22:34.863773+0000","last_peered":"2024-09-11T22:22:34.863773+0000","last_clean":"2024-09-11T22:22:34.863773+0000","last_became_active":"2024-09-11T22:22:33.875271+0000","last_became_peered":"2024-09-11T22:22:33.875271+0000","last_unstale":"2024-09-11T22:22:34.863773+0000","last_undegraded":"2024-09-11T22:22:34.863773+0000","last_fullsized":"2024-09-11T22:22:34.863773+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:19.441983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104024+0000","last_change":"2024-09-11T22:22:33.871266+0000","last_active":"2024-09-11T22:22:35.104024+0000","last_peered":"2024-09-11T22:22:35.104024+0000","last_clean":"2024-09-11T22:22:35.104024+0000","last_became_active":"2024-09-11T22:22:33.870953+0000","last_became_peered":"2024-09-11T22:22:33.870953+0000","last_unstale":"2024-09-11T22:22:35.104024+0000","last_undegraded":"2024-09-11T22:22:35.104024+0000","last_fullsized":"2024-09-11T22:22:35.104024+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:14.276292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104075+0000","last_change":"2024-09-11T22:22:33.881317+0000","last_active":"2024-09-11T22:22:35.104075+0000","last_peered":"2024-09-11T22:22:35.104075+0000","last_clean":"2024-09-11T22:22:35.104075+0000","last_became_active":"2024-09-11T22:22:33.880855+0000","last_became_peered":"2024-09-11T22:22:33.880855+0000","last_unstale":"2024-09-11T22:22:35.104075+0000","last_undegraded":"2024-09-11T22:22:35.104075+0000","last_fullsized":"2024-09-11T22:22:35.104075+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:48:06.450712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864532+0000","last_change":"2024-09-11T22:22:33.874494+0000","last_active":"2024-09-11T22:22:34.864532+0000","last_peered":"2024-09-11T22:22:34.864532+0000","last_clean":"2024-09-11T22:22:34.864532+0000","last_became_active":"2024-09-11T22:22:33.874228+0000","last_became_peered":"2024-09-11T22:22:33.874228+0000","last_unstale":"2024-09-11T22:22:34.864532+0000","last_undegraded":"2024-09-11T22:22:34.864532+0000","last_fullsized":"2024-09-11T22:22:34.864532+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:59.833957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"177'4","reported_seq":18,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.881661+0000","last_change":"2024-09-11T22:22:32.875504+0000","last_active":"2024-09-11T22:22:34.881661+0000","last_peered":"2024-09-11T22:22:34.881661+0000","last_clean":"2024-09-11T22:22:34.881661+0000","last_became_active":"2024-09-11T22:22:32.875253+0000","last_became_peered":"2024-09-11T22:22:32.875253+0000","last_unstale":"2024-09-11T22:22:34.881661+0000","last_undegraded":"2024-09-11T22:22:34.881661+0000","last_fullsized":"2024-09-11T22:22:34.881661+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:56.207572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864122+0000","last_change":"2024-09-11T22:22:33.875788+0000","last_active":"2024-09-11T22:22:34.864122+0000","last_peered":"2024-09-11T22:22:34.864122+0000","last_clean":"2024-09-11T22:22:34.864122+0000","last_became_active":"2024-09-11T22:22:33.875491+0000","last_became_peered":"2024-09-11T22:22:33.875491+0000","last_unstale":"2024-09-11T22:22:34.864122+0000","last_undegraded":"2024-09-11T22:22:34.864122+0000","last_fullsized":"2024-09-11T22:22:34.864122+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:02.469571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"177'1","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864609+0000","last_change":"2024-09-11T22:22:32.872040+0000","last_active":"2024-09-11T22:22:34.864609+0000","last_peered":"2024-09-11T22:22:34.864609+0000","last_clean":"2024-09-11T22:22:34.864609+0000","last_became_active":"2024-09-11T22:22:32.871733+0000","last_became_peered":"2024-09-11T22:22:32.871733+0000","last_unstale":"2024-09-11T22:22:34.864609+0000","last_undegraded":"2024-09-11T22:22:34.864609+0000","last_fullsized":"2024-09-11T22:22:34.864609+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:57.631086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104289+0000","last_change":"2024-09-11T22:22:33.871433+0000","last_active":"2024-09-11T22:22:35.104289+0000","last_peered":"2024-09-11T22:22:35.104289+0000","last_clean":"2024-09-11T22:22:35.104289+0000","last_became_active":"2024-09-11T22:22:33.871134+0000","last_became_peered":"2024-09-11T22:22:33.871134+0000","last_unstale":"2024-09-11T22:22:35.104289+0000","last_undegraded":"2024-09-11T22:22:35.104289+0000","last_fullsized":"2024-09-11T22:22:35.104289+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:44.490870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"177'2","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105046+0000","last_change":"2024-09-11T22:22:32.871683+0000","last_active":"2024-09-11T22:22:35.105046+0000","last_peered":"2024-09-11T22:22:35.105046+0000","last_clean":"2024-09-11T22:22:35.105046+0000","last_became_active":"2024-09-11T22:22:32.871394+0000","last_became_peered":"2024-09-11T22:22:32.871394+0000","last_unstale":"2024-09-11T22:22:35.105046+0000","last_undegraded":"2024-09-11T22:22:35.105046+0000","last_fullsized":"2024-09-11T22:22:35.105046+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:25.624911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104113+0000","last_change":"2024-09-11T22:22:33.885084+0000","last_active":"2024-09-11T22:22:35.104113+0000","last_peered":"2024-09-11T22:22:35.104113+0000","last_clean":"2024-09-11T22:22:35.104113+0000","last_became_active":"2024-09-11T22:22:33.884682+0000","last_became_peered":"2024-09-11T22:22:33.884682+0000","last_unstale":"2024-09-11T22:22:35.104113+0000","last_undegraded":"2024-09-11T22:22:35.104113+0000","last_fullsized":"2024-09-11T22:22:35.104113+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:01.098360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"177'2","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879612+0000","last_change":"2024-09-11T22:22:32.873503+0000","last_active":"2024-09-11T22:22:34.879612+0000","last_peered":"2024-09-11T22:22:34.879612+0000","last_clean":"2024-09-11T22:22:34.879612+0000","last_became_active":"2024-09-11T22:22:32.873227+0000","last_became_peered":"2024-09-11T22:22:32.873227+0000","last_unstale":"2024-09-11T22:22:34.879612+0000","last_undegraded":"2024-09-11T22:22:34.879612+0000","last_fullsized":"2024-09-11T22:22:34.879612+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:09.224692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879392+0000","last_change":"2024-09-11T22:22:33.874211+0000","last_active":"2024-09-11T22:22:34.879392+0000","last_peered":"2024-09-11T22:22:34.879392+0000","last_clean":"2024-09-11T22:22:34.879392+0000","last_became_active":"2024-09-11T22:22:33.873948+0000","last_became_peered":"2024-09-11T22:22:33.873948+0000","last_unstale":"2024-09-11T22:22:34.879392+0000","last_undegraded":"2024-09-11T22:22:34.879392+0000","last_fullsized":"2024-09-11T22:22:34.879392+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.466819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"177'1","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.860347+0000","last_change":"2024-09-11T22:22:32.876739+0000","last_active":"2024-09-11T22:22:34.860347+0000","last_peered":"2024-09-11T22:22:34.860347+0000","last_clean":"2024-09-11T22:22:34.860347+0000","last_became_active":"2024-09-11T22:22:32.876472+0000","last_became_peered":"2024-09-11T22:22:32.876472+0000","last_unstale":"2024-09-11T22:22:34.860347+0000","last_undegraded":"2024-09-11T22:22:34.860347+0000","last_fullsized":"2024-09-11T22:22:34.860347+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:47.992674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.860040+0000","last_change":"2024-09-11T22:22:33.872839+0000","last_active":"2024-09-11T22:22:34.860040+0000","last_peered":"2024-09-11T22:22:34.860040+0000","last_clean":"2024-09-11T22:22:34.860040+0000","last_became_active":"2024-09-11T22:22:33.872541+0000","last_became_peered":"2024-09-11T22:22:33.872541+0000","last_unstale":"2024-09-11T22:22:34.860040+0000","last_undegraded":"2024-09-11T22:22:34.860040+0000","last_fullsized":"2024-09-11T22:22:34.860040+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:36.335359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.859924+0000","last_change":"2024-09-11T22:22:32.868319+0000","last_active":"2024-09-11T22:22:34.859924+0000","last_peered":"2024-09-11T22:22:34.859924+0000","last_clean":"2024-09-11T22:22:34.859924+0000","last_became_active":"2024-09-11T22:22:32.868050+0000","last_became_peered":"2024-09-11T22:22:32.868050+0000","last_unstale":"2024-09-11T22:22:34.859924+0000","last_undegraded":"2024-09-11T22:22:34.859924+0000","last_fullsized":"2024-09-11T22:22:34.859924+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:01.463502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879439+0000","last_change":"2024-09-11T22:22:33.875498+0000","last_active":"2024-09-11T22:22:34.879439+0000","last_peered":"2024-09-11T22:22:34.879439+0000","last_clean":"2024-09-11T22:22:34.879439+0000","last_became_active":"2024-09-11T22:22:33.874795+0000","last_became_peered":"2024-09-11T22:22:33.874795+0000","last_unstale":"2024-09-11T22:22:34.879439+0000","last_undegraded":"2024-09-11T22:22:34.879439+0000","last_fullsized":"2024-09-11T22:22:34.879439+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:40.227649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.863562+0000","last_change":"2024-09-11T22:22:32.876471+0000","last_active":"2024-09-11T22:22:34.863562+0000","last_peered":"2024-09-11T22:22:34.863562+0000","last_clean":"2024-09-11T22:22:34.863562+0000","last_became_active":"2024-09-11T22:22:32.876165+0000","last_became_peered":"2024-09-11T22:22:32.876165+0000","last_unstale":"2024-09-11T22:22:34.863562+0000","last_undegraded":"2024-09-11T22:22:34.863562+0000","last_fullsized":"2024-09-11T22:22:34.863562+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:59.849409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879663+0000","last_change":"2024-09-11T22:22:33.871288+0000","last_active":"2024-09-11T22:22:34.879663+0000","last_peered":"2024-09-11T22:22:34.879663+0000","last_clean":"2024-09-11T22:22:34.879663+0000","last_became_active":"2024-09-11T22:22:33.870994+0000","last_became_peered":"2024-09-11T22:22:33.870994+0000","last_unstale":"2024-09-11T22:22:34.879663+0000","last_undegraded":"2024-09-11T22:22:34.879663+0000","last_fullsized":"2024-09-11T22:22:34.879663+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:08.940215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.860091+0000","last_change":"2024-09-11T22:22:32.868187+0000","last_active":"2024-09-11T22:22:34.860091+0000","last_peered":"2024-09-11T22:22:34.860091+0000","last_clean":"2024-09-11T22:22:34.860091+0000","last_became_active":"2024-09-11T22:22:32.867873+0000","last_became_peered":"2024-09-11T22:22:32.867873+0000","last_unstale":"2024-09-11T22:22:34.860091+0000","last_undegraded":"2024-09-11T22:22:34.860091+0000","last_fullsized":"2024-09-11T22:22:34.860091+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:16.014510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105316+0000","last_change":"2024-09-11T22:22:33.876012+0000","last_active":"2024-09-11T22:22:35.105316+0000","last_peered":"2024-09-11T22:22:35.105316+0000","last_clean":"2024-09-11T22:22:35.105316+0000","last_became_active":"2024-09-11T22:22:33.875720+0000","last_became_peered":"2024-09-11T22:22:33.875720+0000","last_unstale":"2024-09-11T22:22:35.105316+0000","last_undegraded":"2024-09-11T22:22:35.105316+0000","last_fullsized":"2024-09-11T22:22:35.105316+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:43:33.761223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864151+0000","last_change":"2024-09-11T22:22:32.871536+0000","last_active":"2024-09-11T22:22:34.864151+0000","last_peered":"2024-09-11T22:22:34.864151+0000","last_clean":"2024-09-11T22:22:34.864151+0000","last_became_active":"2024-09-11T22:22:32.870670+0000","last_became_peered":"2024-09-11T22:22:32.870670+0000","last_unstale":"2024-09-11T22:22:34.864151+0000","last_undegraded":"2024-09-11T22:22:34.864151+0000","last_fullsized":"2024-09-11T22:22:34.864151+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:50.728988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879583+0000","last_change":"2024-09-11T22:22:33.871247+0000","last_active":"2024-09-11T22:22:34.879583+0000","last_peered":"2024-09-11T22:22:34.879583+0000","last_clean":"2024-09-11T22:22:34.879583+0000","last_became_active":"2024-09-11T22:22:33.870952+0000","last_became_peered":"2024-09-11T22:22:33.870952+0000","last_unstale":"2024-09-11T22:22:34.879583+0000","last_undegraded":"2024-09-11T22:22:34.879583+0000","last_fullsized":"2024-09-11T22:22:34.879583+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:08.678884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"177'3","reported_seq":17,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104518+0000","last_change":"2024-09-11T22:22:32.874858+0000","last_active":"2024-09-11T22:22:35.104518+0000","last_peered":"2024-09-11T22:22:35.104518+0000","last_clean":"2024-09-11T22:22:35.104518+0000","last_became_active":"2024-09-11T22:22:32.874556+0000","last_became_peered":"2024-09-11T22:22:32.874556+0000","last_unstale":"2024-09-11T22:22:35.104518+0000","last_undegraded":"2024-09-11T22:22:35.104518+0000","last_fullsized":"2024-09-11T22:22:35.104518+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:41.633829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105464+0000","last_change":"2024-09-11T22:22:33.880424+0000","last_active":"2024-09-11T22:22:35.105464+0000","last_peered":"2024-09-11T22:22:35.105464+0000","last_clean":"2024-09-11T22:22:35.105464+0000","last_became_active":"2024-09-11T22:22:33.880082+0000","last_became_peered":"2024-09-11T22:22:33.880082+0000","last_unstale":"2024-09-11T22:22:35.105464+0000","last_undegraded":"2024-09-11T22:22:35.105464+0000","last_fullsized":"2024-09-11T22:22:35.105464+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.774654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"177'6","reported_seq":20,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879631+0000","last_change":"2024-09-11T22:22:32.874281+0000","last_active":"2024-09-11T22:22:34.879631+0000","last_peered":"2024-09-11T22:22:34.879631+0000","last_clean":"2024-09-11T22:22:34.879631+0000","last_became_active":"2024-09-11T22:22:32.873683+0000","last_became_peered":"2024-09-11T22:22:32.873683+0000","last_unstale":"2024-09-11T22:22:34.879631+0000","last_undegraded":"2024-09-11T22:22:34.879631+0000","last_fullsized":"2024-09-11T22:22:34.879631+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:04.618180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.860260+0000","last_change":"2024-09-11T22:22:33.885274+0000","last_active":"2024-09-11T22:22:34.860260+0000","last_peered":"2024-09-11T22:22:34.860260+0000","last_clean":"2024-09-11T22:22:34.860260+0000","last_became_active":"2024-09-11T22:22:33.884990+0000","last_became_peered":"2024-09-11T22:22:33.884990+0000","last_unstale":"2024-09-11T22:22:34.860260+0000","last_undegraded":"2024-09-11T22:22:34.860260+0000","last_fullsized":"2024-09-11T22:22:34.860260+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:09.538162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"177'2","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864144+0000","last_change":"2024-09-11T22:22:32.872106+0000","last_active":"2024-09-11T22:22:34.864144+0000","last_peered":"2024-09-11T22:22:34.864144+0000","last_clean":"2024-09-11T22:22:34.864144+0000","last_became_active":"2024-09-11T22:22:32.871772+0000","last_became_peered":"2024-09-11T22:22:32.871772+0000","last_unstale":"2024-09-11T22:22:34.864144+0000","last_undegraded":"2024-09-11T22:22:34.864144+0000","last_fullsized":"2024-09-11T22:22:34.864144+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.839583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105093+0000","last_change":"2024-09-11T22:22:33.882949+0000","last_active":"2024-09-11T22:22:35.105093+0000","last_peered":"2024-09-11T22:22:35.105093+0000","last_clean":"2024-09-11T22:22:35.105093+0000","last_became_active":"2024-09-11T22:22:33.882659+0000","last_became_peered":"2024-09-11T22:22:33.882659+0000","last_unstale":"2024-09-11T22:22:35.105093+0000","last_undegraded":"2024-09-11T22:22:35.105093+0000","last_fullsized":"2024-09-11T22:22:35.105093+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.774654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864150+0000","last_change":"2024-09-11T22:22:32.869908+0000","last_active":"2024-09-11T22:22:34.864150+0000","last_peered":"2024-09-11T22:22:34.864150+0000","last_clean":"2024-09-11T22:22:34.864150+0000","last_became_active":"2024-09-11T22:22:32.869622+0000","last_became_peered":"2024-09-11T22:22:32.869622+0000","last_unstale":"2024-09-11T22:22:34.864150+0000","last_undegraded":"2024-09-11T22:22:34.864150+0000","last_fullsized":"2024-09-11T22:22:34.864150+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:26.942462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105608+0000","last_change":"2024-09-11T22:22:33.873149+0000","last_active":"2024-09-11T22:22:35.105608+0000","last_peered":"2024-09-11T22:22:35.105608+0000","last_clean":"2024-09-11T22:22:35.105608+0000","last_became_active":"2024-09-11T22:22:33.870569+0000","last_became_peered":"2024-09-11T22:22:33.870569+0000","last_unstale":"2024-09-11T22:22:35.105608+0000","last_undegraded":"2024-09-11T22:22:35.105608+0000","last_fullsized":"2024-09-11T22:22:35.105608+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:30.251297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.103976+0000","last_change":"2024-09-11T22:22:32.874747+0000","last_active":"2024-09-11T22:22:35.103976+0000","last_peered":"2024-09-11T22:22:35.103976+0000","last_clean":"2024-09-11T22:22:35.103976+0000","last_became_active":"2024-09-11T22:22:32.874454+0000","last_became_peered":"2024-09-11T22:22:32.874454+0000","last_unstale":"2024-09-11T22:22:35.103976+0000","last_undegraded":"2024-09-11T22:22:35.103976+0000","last_fullsized":"2024-09-11T22:22:35.103976+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:20.850041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105172+0000","last_change":"2024-09-11T22:22:33.871139+0000","last_active":"2024-09-11T22:22:35.105172+0000","last_peered":"2024-09-11T22:22:35.105172+0000","last_clean":"2024-09-11T22:22:35.105172+0000","last_became_active":"2024-09-11T22:22:33.870706+0000","last_became_peered":"2024-09-11T22:22:33.870706+0000","last_unstale":"2024-09-11T22:22:35.105172+0000","last_undegraded":"2024-09-11T22:22:35.105172+0000","last_fullsized":"2024-09-11T22:22:35.105172+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:22.714269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"177'8","reported_seq":22,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105633+0000","last_change":"2024-09-11T22:22:32.870819+0000","last_active":"2024-09-11T22:22:35.105633+0000","last_peered":"2024-09-11T22:22:35.105633+0000","last_clean":"2024-09-11T22:22:35.105633+0000","last_became_active":"2024-09-11T22:22:32.870541+0000","last_became_peered":"2024-09-11T22:22:32.870541+0000","last_unstale":"2024-09-11T22:22:35.105633+0000","last_undegraded":"2024-09-11T22:22:35.105633+0000","last_fullsized":"2024-09-11T22:22:35.105633+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:40.741597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864588+0000","last_change":"2024-09-11T22:22:33.869366+0000","last_active":"2024-09-11T22:22:34.864588+0000","last_peered":"2024-09-11T22:22:34.864588+0000","last_clean":"2024-09-11T22:22:34.864588+0000","last_became_active":"2024-09-11T22:22:33.869095+0000","last_became_peered":"2024-09-11T22:22:33.869095+0000","last_unstale":"2024-09-11T22:22:34.864588+0000","last_undegraded":"2024-09-11T22:22:34.864588+0000","last_fullsized":"2024-09-11T22:22:34.864588+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:08.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"177'1","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.860145+0000","last_change":"2024-09-11T22:22:32.869194+0000","last_active":"2024-09-11T22:22:34.860145+0000","last_peered":"2024-09-11T22:22:34.860145+0000","last_clean":"2024-09-11T22:22:34.860145+0000","last_became_active":"2024-09-11T22:22:32.868931+0000","last_became_peered":"2024-09-11T22:22:32.868931+0000","last_unstale":"2024-09-11T22:22:34.860145+0000","last_undegraded":"2024-09-11T22:22:34.860145+0000","last_fullsized":"2024-09-11T22:22:34.860145+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:41.209428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864900+0000","last_change":"2024-09-11T22:22:33.884363+0000","last_active":"2024-09-11T22:22:34.864900+0000","last_peered":"2024-09-11T22:22:34.864900+0000","last_clean":"2024-09-11T22:22:34.864900+0000","last_became_active":"2024-09-11T22:22:33.884103+0000","last_became_peered":"2024-09-11T22:22:33.884103+0000","last_unstale":"2024-09-11T22:22:34.864900+0000","last_undegraded":"2024-09-11T22:22:34.864900+0000","last_fullsized":"2024-09-11T22:22:34.864900+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:42.215498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"177'2","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864672+0000","last_change":"2024-09-11T22:22:32.875435+0000","last_active":"2024-09-11T22:22:34.864672+0000","last_peered":"2024-09-11T22:22:34.864672+0000","last_clean":"2024-09-11T22:22:34.864672+0000","last_became_active":"2024-09-11T22:22:32.875176+0000","last_became_peered":"2024-09-11T22:22:32.875176+0000","last_unstale":"2024-09-11T22:22:34.864672+0000","last_undegraded":"2024-09-11T22:22:34.864672+0000","last_fullsized":"2024-09-11T22:22:34.864672+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:28.777018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105584+0000","last_change":"2024-09-11T22:22:33.863470+0000","last_active":"2024-09-11T22:22:35.105584+0000","last_peered":"2024-09-11T22:22:35.105584+0000","last_clean":"2024-09-11T22:22:35.105584+0000","last_became_active":"2024-09-11T22:22:33.863138+0000","last_became_peered":"2024-09-11T22:22:33.863138+0000","last_unstale":"2024-09-11T22:22:35.105584+0000","last_undegraded":"2024-09-11T22:22:35.105584+0000","last_fullsized":"2024-09-11T22:22:35.105584+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:23.571456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"177'1","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104628+0000","last_change":"2024-09-11T22:22:32.873935+0000","last_active":"2024-09-11T22:22:35.104628+0000","last_peered":"2024-09-11T22:22:35.104628+0000","last_clean":"2024-09-11T22:22:35.104628+0000","last_became_active":"2024-09-11T22:22:32.872709+0000","last_became_peered":"2024-09-11T22:22:32.872709+0000","last_unstale":"2024-09-11T22:22:35.104628+0000","last_undegraded":"2024-09-11T22:22:35.104628+0000","last_fullsized":"2024-09-11T22:22:35.104628+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:50.413075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104270+0000","last_change":"2024-09-11T22:22:33.879571+0000","last_active":"2024-09-11T22:22:35.104270+0000","last_peered":"2024-09-11T22:22:35.104270+0000","last_clean":"2024-09-11T22:22:35.104270+0000","last_became_active":"2024-09-11T22:22:33.879288+0000","last_became_peered":"2024-09-11T22:22:33.879288+0000","last_unstale":"2024-09-11T22:22:35.104270+0000","last_undegraded":"2024-09-11T22:22:35.104270+0000","last_fullsized":"2024-09-11T22:22:35.104270+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:42.507465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104718+0000","last_change":"2024-09-11T22:22:32.869179+0000","last_active":"2024-09-11T22:22:35.104718+0000","last_peered":"2024-09-11T22:22:35.104718+0000","last_clean":"2024-09-11T22:22:35.104718+0000","last_became_active":"2024-09-11T22:22:32.868874+0000","last_became_peered":"2024-09-11T22:22:32.868874+0000","last_unstale":"2024-09-11T22:22:35.104718+0000","last_undegraded":"2024-09-11T22:22:35.104718+0000","last_fullsized":"2024-09-11T22:22:35.104718+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:05.433343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104317+0000","last_change":"2024-09-11T22:22:33.882673+0000","last_active":"2024-09-11T22:22:35.104317+0000","last_peered":"2024-09-11T22:22:35.104317+0000","last_clean":"2024-09-11T22:22:35.104317+0000","last_became_active":"2024-09-11T22:22:33.881961+0000","last_became_peered":"2024-09-11T22:22:33.881961+0000","last_unstale":"2024-09-11T22:22:35.104317+0000","last_undegraded":"2024-09-11T22:22:35.104317+0000","last_fullsized":"2024-09-11T22:22:35.104317+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:17.763593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"177'2","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105190+0000","last_change":"2024-09-11T22:22:32.871013+0000","last_active":"2024-09-11T22:22:35.105190+0000","last_peered":"2024-09-11T22:22:35.105190+0000","last_clean":"2024-09-11T22:22:35.105190+0000","last_became_active":"2024-09-11T22:22:32.869592+0000","last_became_peered":"2024-09-11T22:22:32.869592+0000","last_unstale":"2024-09-11T22:22:35.105190+0000","last_undegraded":"2024-09-11T22:22:35.105190+0000","last_fullsized":"2024-09-11T22:22:35.105190+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:02.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105642+0000","last_change":"2024-09-11T22:22:33.874000+0000","last_active":"2024-09-11T22:22:35.105642+0000","last_peered":"2024-09-11T22:22:35.105642+0000","last_clean":"2024-09-11T22:22:35.105642+0000","last_became_active":"2024-09-11T22:22:33.873677+0000","last_became_peered":"2024-09-11T22:22:33.873677+0000","last_unstale":"2024-09-11T22:22:35.105642+0000","last_undegraded":"2024-09-11T22:22:35.105642+0000","last_fullsized":"2024-09-11T22:22:35.105642+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:02.713795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104846+0000","last_change":"2024-09-11T22:22:32.868236+0000","last_active":"2024-09-11T22:22:35.104846+0000","last_peered":"2024-09-11T22:22:35.104846+0000","last_clean":"2024-09-11T22:22:35.104846+0000","last_became_active":"2024-09-11T22:22:32.867876+0000","last_became_peered":"2024-09-11T22:22:32.867876+0000","last_unstale":"2024-09-11T22:22:35.104846+0000","last_undegraded":"2024-09-11T22:22:35.104846+0000","last_fullsized":"2024-09-11T22:22:35.104846+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:51.010593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.863591+0000","last_change":"2024-09-11T22:22:33.866913+0000","last_active":"2024-09-11T22:22:34.863591+0000","last_peered":"2024-09-11T22:22:34.863591+0000","last_clean":"2024-09-11T22:22:34.863591+0000","last_became_active":"2024-09-11T22:22:33.866628+0000","last_became_peered":"2024-09-11T22:22:33.866628+0000","last_unstale":"2024-09-11T22:22:34.863591+0000","last_undegraded":"2024-09-11T22:22:34.863591+0000","last_fullsized":"2024-09-11T22:22:34.863591+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:02.469571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105263+0000","last_change":"2024-09-11T22:22:32.872329+0000","last_active":"2024-09-11T22:22:35.105263+0000","last_peered":"2024-09-11T22:22:35.105263+0000","last_clean":"2024-09-11T22:22:35.105263+0000","last_became_active":"2024-09-11T22:22:32.871836+0000","last_became_peered":"2024-09-11T22:22:32.871836+0000","last_unstale":"2024-09-11T22:22:35.105263+0000","last_undegraded":"2024-09-11T22:22:35.105263+0000","last_fullsized":"2024-09-11T22:22:35.105263+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:16.999557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864338+0000","last_change":"2024-09-11T22:22:33.876747+0000","last_active":"2024-09-11T22:22:34.864338+0000","last_peered":"2024-09-11T22:22:34.864338+0000","last_clean":"2024-09-11T22:22:34.864338+0000","last_became_active":"2024-09-11T22:22:33.876137+0000","last_became_peered":"2024-09-11T22:22:33.876137+0000","last_unstale":"2024-09-11T22:22:34.864338+0000","last_undegraded":"2024-09-11T22:22:34.864338+0000","last_fullsized":"2024-09-11T22:22:34.864338+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:17.020580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.860076+0000","last_change":"2024-09-11T22:22:32.873479+0000","last_active":"2024-09-11T22:22:34.860076+0000","last_peered":"2024-09-11T22:22:34.860076+0000","last_clean":"2024-09-11T22:22:34.860076+0000","last_became_active":"2024-09-11T22:22:32.873187+0000","last_became_peered":"2024-09-11T22:22:32.873187+0000","last_unstale":"2024-09-11T22:22:34.860076+0000","last_undegraded":"2024-09-11T22:22:34.860076+0000","last_fullsized":"2024-09-11T22:22:34.860076+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:52.625796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.881512+0000","last_change":"2024-09-11T22:22:33.882379+0000","last_active":"2024-09-11T22:22:34.881512+0000","last_peered":"2024-09-11T22:22:34.881512+0000","last_clean":"2024-09-11T22:22:34.881512+0000","last_became_active":"2024-09-11T22:22:33.882098+0000","last_became_peered":"2024-09-11T22:22:33.882098+0000","last_unstale":"2024-09-11T22:22:34.881512+0000","last_undegraded":"2024-09-11T22:22:34.881512+0000","last_fullsized":"2024-09-11T22:22:34.881512+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:48.998744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"177'2","reported_seq":16,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105419+0000","last_change":"2024-09-11T22:22:32.873658+0000","last_active":"2024-09-11T22:22:35.105419+0000","last_peered":"2024-09-11T22:22:35.105419+0000","last_clean":"2024-09-11T22:22:35.105419+0000","last_became_active":"2024-09-11T22:22:32.872822+0000","last_became_peered":"2024-09-11T22:22:32.872822+0000","last_unstale":"2024-09-11T22:22:35.105419+0000","last_undegraded":"2024-09-11T22:22:35.105419+0000","last_fullsized":"2024-09-11T22:22:35.105419+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:54.311584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105304+0000","last_change":"2024-09-11T22:22:33.880882+0000","last_active":"2024-09-11T22:22:35.105304+0000","last_peered":"2024-09-11T22:22:35.105304+0000","last_clean":"2024-09-11T22:22:35.105304+0000","last_became_active":"2024-09-11T22:22:33.880577+0000","last_became_peered":"2024-09-11T22:22:33.880577+0000","last_unstale":"2024-09-11T22:22:35.105304+0000","last_undegraded":"2024-09-11T22:22:35.105304+0000","last_fullsized":"2024-09-11T22:22:35.105304+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:26.836404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"178'1","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879669+0000","last_change":"2024-09-11T22:22:32.875400+0000","last_active":"2024-09-11T22:22:34.879669+0000","last_peered":"2024-09-11T22:22:34.879669+0000","last_clean":"2024-09-11T22:22:34.879669+0000","last_became_active":"2024-09-11T22:22:32.875056+0000","last_became_peered":"2024-09-11T22:22:32.875056+0000","last_unstale":"2024-09-11T22:22:34.879669+0000","last_undegraded":"2024-09-11T22:22:34.879669+0000","last_fullsized":"2024-09-11T22:22:34.879669+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:51.454702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864288+0000","last_change":"2024-09-11T22:22:33.875215+0000","last_active":"2024-09-11T22:22:34.864288+0000","last_peered":"2024-09-11T22:22:34.864288+0000","last_clean":"2024-09-11T22:22:34.864288+0000","last_became_active":"2024-09-11T22:22:33.874961+0000","last_became_peered":"2024-09-11T22:22:33.874961+0000","last_unstale":"2024-09-11T22:22:34.864288+0000","last_undegraded":"2024-09-11T22:22:34.864288+0000","last_fullsized":"2024-09-11T22:22:34.864288+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:21.561002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.860428+0000","last_change":"2024-09-11T22:22:32.867763+0000","last_active":"2024-09-11T22:22:34.860428+0000","last_peered":"2024-09-11T22:22:34.860428+0000","last_clean":"2024-09-11T22:22:34.860428+0000","last_became_active":"2024-09-11T22:22:32.867493+0000","last_became_peered":"2024-09-11T22:22:32.867493+0000","last_unstale":"2024-09-11T22:22:34.860428+0000","last_undegraded":"2024-09-11T22:22:34.860428+0000","last_fullsized":"2024-09-11T22:22:34.860428+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:13.188631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.863993+0000","last_change":"2024-09-11T22:22:33.871871+0000","last_active":"2024-09-11T22:22:34.863993+0000","last_peered":"2024-09-11T22:22:34.863993+0000","last_clean":"2024-09-11T22:22:34.863993+0000","last_became_active":"2024-09-11T22:22:33.871567+0000","last_became_peered":"2024-09-11T22:22:33.871567+0000","last_unstale":"2024-09-11T22:22:34.863993+0000","last_undegraded":"2024-09-11T22:22:34.863993+0000","last_fullsized":"2024-09-11T22:22:34.863993+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:08.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104811+0000","last_change":"2024-09-11T22:22:32.875098+0000","last_active":"2024-09-11T22:22:35.104811+0000","last_peered":"2024-09-11T22:22:35.104811+0000","last_clean":"2024-09-11T22:22:35.104811+0000","last_became_active":"2024-09-11T22:22:32.872807+0000","last_became_peered":"2024-09-11T22:22:32.872807+0000","last_unstale":"2024-09-11T22:22:35.104811+0000","last_undegraded":"2024-09-11T22:22:35.104811+0000","last_fullsized":"2024-09-11T22:22:35.104811+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:06.287546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104762+0000","last_change":"2024-09-11T22:22:33.872648+0000","last_active":"2024-09-11T22:22:35.104762+0000","last_peered":"2024-09-11T22:22:35.104762+0000","last_clean":"2024-09-11T22:22:35.104762+0000","last_became_active":"2024-09-11T22:22:33.872364+0000","last_became_peered":"2024-09-11T22:22:33.872364+0000","last_unstale":"2024-09-11T22:22:35.104762+0000","last_undegraded":"2024-09-11T22:22:35.104762+0000","last_fullsized":"2024-09-11T22:22:35.104762+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:14.276292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879438+0000","last_change":"2024-09-11T22:22:32.877875+0000","last_active":"2024-09-11T22:22:34.879438+0000","last_peered":"2024-09-11T22:22:34.879438+0000","last_clean":"2024-09-11T22:22:34.879438+0000","last_became_active":"2024-09-11T22:22:32.877559+0000","last_became_peered":"2024-09-11T22:22:32.877559+0000","last_unstale":"2024-09-11T22:22:34.879438+0000","last_undegraded":"2024-09-11T22:22:34.879438+0000","last_fullsized":"2024-09-11T22:22:34.879438+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:05.308567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.881390+0000","last_change":"2024-09-11T22:22:33.882413+0000","last_active":"2024-09-11T22:22:34.881390+0000","last_peered":"2024-09-11T22:22:34.881390+0000","last_clean":"2024-09-11T22:22:34.881390+0000","last_became_active":"2024-09-11T22:22:33.882153+0000","last_became_peered":"2024-09-11T22:22:33.882153+0000","last_unstale":"2024-09-11T22:22:34.881390+0000","last_undegraded":"2024-09-11T22:22:34.881390+0000","last_fullsized":"2024-09-11T22:22:34.881390+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:17.020580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.860446+0000","last_change":"2024-09-11T22:22:32.876657+0000","last_active":"2024-09-11T22:22:34.860446+0000","last_peered":"2024-09-11T22:22:34.860446+0000","last_clean":"2024-09-11T22:22:34.860446+0000","last_became_active":"2024-09-11T22:22:32.876140+0000","last_became_peered":"2024-09-11T22:22:32.876140+0000","last_unstale":"2024-09-11T22:22:34.860446+0000","last_undegraded":"2024-09-11T22:22:34.860446+0000","last_fullsized":"2024-09-11T22:22:34.860446+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:21.127707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.105514+0000","last_change":"2024-09-11T22:22:33.873842+0000","last_active":"2024-09-11T22:22:35.105514+0000","last_peered":"2024-09-11T22:22:35.105514+0000","last_clean":"2024-09-11T22:22:35.105514+0000","last_became_active":"2024-09-11T22:22:33.873564+0000","last_became_peered":"2024-09-11T22:22:33.873564+0000","last_unstale":"2024-09-11T22:22:35.105514+0000","last_undegraded":"2024-09-11T22:22:35.105514+0000","last_fullsized":"2024-09-11T22:22:35.105514+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:37:42.342912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.864502+0000","last_change":"2024-09-11T22:22:32.874909+0000","last_active":"2024-09-11T22:22:34.864502+0000","last_peered":"2024-09-11T22:22:34.864502+0000","last_clean":"2024-09-11T22:22:34.864502+0000","last_became_active":"2024-09-11T22:22:32.874627+0000","last_became_peered":"2024-09-11T22:22:32.874627+0000","last_unstale":"2024-09-11T22:22:34.864502+0000","last_undegraded":"2024-09-11T22:22:34.864502+0000","last_fullsized":"2024-09-11T22:22:34.864502+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:56.207572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.863698+0000","last_change":"2024-09-11T22:22:33.871239+0000","last_active":"2024-09-11T22:22:34.863698+0000","last_peered":"2024-09-11T22:22:34.863698+0000","last_clean":"2024-09-11T22:22:34.863698+0000","last_became_active":"2024-09-11T22:22:33.870917+0000","last_became_peered":"2024-09-11T22:22:33.870917+0000","last_unstale":"2024-09-11T22:22:34.863698+0000","last_undegraded":"2024-09-11T22:22:34.863698+0000","last_fullsized":"2024-09-11T22:22:34.863698+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:13.685778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":14,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.881213+0000","last_change":"2024-09-11T22:22:32.876591+0000","last_active":"2024-09-11T22:22:34.881213+0000","last_peered":"2024-09-11T22:22:34.881213+0000","last_clean":"2024-09-11T22:22:34.881213+0000","last_became_active":"2024-09-11T22:22:32.876343+0000","last_became_peered":"2024-09-11T22:22:32.876343+0000","last_unstale":"2024-09-11T22:22:34.881213+0000","last_undegraded":"2024-09-11T22:22:34.881213+0000","last_fullsized":"2024-09-11T22:22:34.881213+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.839583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":12,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:35.104631+0000","last_change":"2024-09-11T22:22:33.881708+0000","last_active":"2024-09-11T22:22:35.104631+0000","last_peered":"2024-09-11T22:22:35.104631+0000","last_clean":"2024-09-11T22:22:35.104631+0000","last_became_active":"2024-09-11T22:22:33.880955+0000","last_became_peered":"2024-09-11T22:22:33.880955+0000","last_unstale":"2024-09-11T22:22:35.104631+0000","last_undegraded":"2024-09-11T22:22:35.104631+0000","last_fullsized":"2024-09-11T22:22:35.104631+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:32.848058+0000","last_clean_scrub_stamp":"2024-09-11T22:22:32.848058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:41.584550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"177'1","reported_seq":15,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.881500+0000","last_change":"2024-09-11T22:22:32.876390+0000","last_active":"2024-09-11T22:22:34.881500+0000","last_peered":"2024-09-11T22:22:34.881500+0000","last_clean":"2024-09-11T22:22:34.881500+0000","last_became_active":"2024-09-11T22:22:32.876077+0000","last_became_peered":"2024-09-11T22:22:32.876077+0000","last_unstale":"2024-09-11T22:22:34.881500+0000","last_undegraded":"2024-09-11T22:22:34.881500+0000","last_fullsized":"2024-09-11T22:22:34.881500+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:31.841988+0000","last_clean_scrub_stamp":"2024-09-11T22:22:31.841988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:16.948428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":455,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-11T22:22:34.879265+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:22:34.879265+0000","last_peered":"2024-09-11T22:22:34.879265+0000","last_clean":"2024-09-11T22:22:34.879265+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:22:34.879265+0000","last_undegraded":"2024-09-11T22:22:34.879265+0000","last_fullsized":"2024-09-11T22:22:34.879265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509584,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55592,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316248,"statfs":{"total":96636764160,"available":96579837952,"internally_reserved":0,"allocated":2240512,"data_stored":984212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509581,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51424,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320416,"statfs":{"total":96636764160,"available":96584105984,"internally_reserved":0,"allocated":2240512,"data_stored":984212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509583,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63920,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307920,"statfs":{"total":96636764160,"available":96571310080,"internally_reserved":0,"allocated":2256896,"data_stored":985346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509583,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47272,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324568,"statfs":{"total":96636764160,"available":96588357632,"internally_reserved":0,"allocated":2248704,"data_stored":983812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509583,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47272,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324568,"statfs":{"total":96636764160,"available":96588357632,"internally_reserved":0,"allocated":2244608,"data_stored":983686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509582,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60324,"kb_used_data":2768,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311516,"statfs":{"total":96636764160,"available":96574992384,"internally_reserved":0,"allocated":2834432,"data_stored":1574088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56172,"kb_used_data":2776,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315668,"statfs":{"total":96636764160,"available":96579244032,"internally_reserved":0,"allocated":2842624,"data_stored":1575610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47260,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324580,"statfs":{"total":96636764160,"available":96588369920,"internally_reserved":0,"allocated":2236416,"data_stored":983630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:22:41.595 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:22:41.595 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T22:22:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.740+0000 7ff110103640 1 Processor -- start 2024-09-11T22:22:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.740+0000 7ff110103640 1 -- start start 2024-09-11T22:22:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.741+0000 7ff110103640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff10815e840 0x7ff1080b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.741+0000 7ff110103640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1080cf580 0x7ff10806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.741+0000 7ff110103640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1080ce5f0 con 0x7ff1080cdd50 2024-09-11T22:22:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.741+0000 7ff110103640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ff10806c240 con 0x7ff1080cf580 2024-09-11T22:22:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.741+0000 7ff110103640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1080d0470 con 0x7ff10815e840 2024-09-11T22:22:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.741+0000 7ff10e6a0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1080cf580 0x7ff10806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.741+0000 7ff10e6a0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff1080cf580 0x7ff10806c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45650/0 (socket says 172.21.15.50:45650) 2024-09-11T22:22:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.741+0000 7ff10e6a0640 1 -- 172.21.15.50:0/1165252086 learned_addr learned my addr 172.21.15.50:0/1165252086 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.741+0000 7ff10de9f640 1 --2- 172.21.15.50:0/1165252086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff10815e840 0x7ff1080b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.741+0000 7ff10e6a0640 1 -- 172.21.15.50:0/1165252086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff10815e840 msgr2=0x7ff1080b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.741+0000 7ff10e6a0640 1 --2- 172.21.15.50:0/1165252086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff10815e840 0x7ff1080b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.741+0000 7ff10e6a0640 1 -- 172.21.15.50:0/1165252086 >> v1:172.21.15.77:6789/0 conn(0x7ff1080cdd50 legacy=0x7ff1080cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.741+0000 7ff10e6a0640 1 -- 172.21.15.50:0/1165252086 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1080ce310 con 0x7ff1080cf580 2024-09-11T22:22:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.742+0000 7ff10e6a0640 1 --2- 172.21.15.50:0/1165252086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1080cf580 0x7ff10806c6d0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7ff100009e50 tx=0x7ff10002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab38c5dd0bac05b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.742+0000 7ff10ce9d640 1 -- 172.21.15.50:0/1165252086 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100036070 con 0x7ff1080cf580 2024-09-11T22:22:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.742+0000 7ff10ce9d640 1 -- 172.21.15.50:0/1165252086 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff100031600 con 0x7ff1080cf580 2024-09-11T22:22:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.742+0000 7ff10ce9d640 1 -- 172.21.15.50:0/1165252086 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1000319d0 con 0x7ff1080cf580 2024-09-11T22:22:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.742+0000 7ff110103640 1 -- 172.21.15.50:0/1165252086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1080cf580 msgr2=0x7ff10806c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.743+0000 7ff110103640 1 --2- 172.21.15.50:0/1165252086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1080cf580 0x7ff10806c6d0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7ff100009e50 tx=0x7ff10002a710 comp rx=0 tx=0).stop 2024-09-11T22:22:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.743+0000 7ff110103640 1 -- 172.21.15.50:0/1165252086 shutdown_connections 2024-09-11T22:22:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.743+0000 7ff110103640 1 --2- 172.21.15.50:0/1165252086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1080cf580 0x7ff10806c6d0 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.743+0000 7ff110103640 1 --2- 172.21.15.50:0/1165252086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff10815e840 0x7ff1080b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.743+0000 7ff110103640 1 -- 172.21.15.50:0/1165252086 >> 172.21.15.50:0/1165252086 conn(0x7ff1080b4150 msgr2=0x7ff1080b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.743+0000 7ff110103640 1 -- 172.21.15.50:0/1165252086 shutdown_connections 2024-09-11T22:22:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.743+0000 7ff110103640 1 -- 172.21.15.50:0/1165252086 wait complete. 2024-09-11T22:22:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.744+0000 7ff110103640 1 Processor -- start 2024-09-11T22:22:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.744+0000 7ff110103640 1 -- start start 2024-09-11T22:22:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff110103640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1080cdd50 0x7ff1080b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff110103640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1080cf580 0x7ff1080c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff110103640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff10815e840 0x7ff1080c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff110103640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff10815ec20 con 0x7ff1080cdd50 2024-09-11T22:22:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff110103640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff10806bed0 con 0x7ff1080cf580 2024-09-11T22:22:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff110103640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff10815eda0 con 0x7ff10815e840 2024-09-11T22:22:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff10de9f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1080cdd50 0x7ff1080b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff10de9f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1080cdd50 0x7ff1080b7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45662/0 (socket says 172.21.15.50:45662) 2024-09-11T22:22:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff10de9f640 1 -- 172.21.15.50:0/2415616847 learned_addr learned my addr 172.21.15.50:0/2415616847 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff10e6a0640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff10815e840 0x7ff1080c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff10d69e640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1080cf580 0x7ff1080c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff10de9f640 1 -- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff10815e840 msgr2=0x7ff1080c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff10de9f640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff10815e840 0x7ff1080c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff10de9f640 1 -- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1080cf580 msgr2=0x7ff1080c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff10de9f640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1080cf580 0x7ff1080c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff10de9f640 1 -- 172.21.15.50:0/2415616847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1080c63b0 con 0x7ff1080cdd50 2024-09-11T22:22:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff10d69e640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1080cf580 0x7ff1080c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff10de9f640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1080cdd50 0x7ff1080b7aa0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7ff10400e870 tx=0x7ff10400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff0fe7fc640 1 -- 172.21.15.50:0/2415616847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff104017070 con 0x7ff1080cdd50 2024-09-11T22:22:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff0fe7fc640 1 -- 172.21.15.50:0/2415616847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff10400c940 con 0x7ff1080cdd50 2024-09-11T22:22:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff110103640 1 -- 172.21.15.50:0/2415616847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1080b6fc0 con 0x7ff1080cdd50 2024-09-11T22:22:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff0fe7fc640 1 -- 172.21.15.50:0/2415616847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10400cd30 con 0x7ff1080cdd50 2024-09-11T22:22:41.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.745+0000 7ff110103640 1 -- 172.21.15.50:0/2415616847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1080c6690 con 0x7ff1080cdd50 2024-09-11T22:22:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.746+0000 7ff110103640 1 -- 172.21.15.50:0/2415616847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1080b7190 con 0x7ff1080cdd50 2024-09-11T22:22:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.747+0000 7ff0fe7fc640 1 -- 172.21.15.50:0/2415616847 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff10401a070 con 0x7ff1080cdd50 2024-09-11T22:22:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.747+0000 7ff0fe7fc640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff0ec06be60 0x7ff0ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.748+0000 7ff0fe7fc640 1 -- 172.21.15.50:0/2415616847 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7ff10408af40 con 0x7ff1080cdd50 2024-09-11T22:22:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.748+0000 7ff10d69e640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff0ec06be60 0x7ff0ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.748+0000 7ff10d69e640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff0ec06be60 0x7ff0ec06e320 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff1080cc950 tx=0x7ff0f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.752+0000 7ff0fe7fc640 1 -- 172.21.15.50:0/2415616847 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff104059330 con 0x7ff1080cdd50 2024-09-11T22:22:41.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.996+0000 7ff110103640 1 -- 172.21.15.50:0/2415616847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff1080b4c70 con 0x7ff1080cdd50 2024-09-11T22:22:41.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:41.998+0000 7ff0fe7fc640 1 -- 172.21.15.50:0/2415616847 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7ff10405d630 con 0x7ff1080cdd50 2024-09-11T22:22:41.999 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:22:41.999 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:22:41.999 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-09-11T22:22:41.999 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-09-11T22:22:41.999 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T22:22:42.000 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-11T22:22:42.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.000+0000 7ff110103640 1 -- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff0ec06be60 msgr2=0x7ff0ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.000+0000 7ff110103640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff0ec06be60 0x7ff0ec06e320 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff1080cc950 tx=0x7ff0f8009040 comp rx=0 tx=0).stop 2024-09-11T22:22:42.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.000+0000 7ff110103640 1 -- 172.21.15.50:0/2415616847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1080cdd50 msgr2=0x7ff1080b7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.000+0000 7ff110103640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1080cdd50 0x7ff1080b7aa0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7ff10400e870 tx=0x7ff10400ed30 comp rx=0 tx=0).stop 2024-09-11T22:22:42.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.000+0000 7ff110103640 1 -- 172.21.15.50:0/2415616847 shutdown_connections 2024-09-11T22:22:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.000+0000 7ff110103640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff0ec06be60 0x7ff0ec06e320 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.000+0000 7ff110103640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff10815e840 0x7ff1080c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.000+0000 7ff110103640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1080cf580 0x7ff1080c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.000+0000 7ff110103640 1 --2- 172.21.15.50:0/2415616847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1080cdd50 0x7ff1080b7aa0 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.000+0000 7ff110103640 1 -- 172.21.15.50:0/2415616847 >> 172.21.15.50:0/2415616847 conn(0x7ff1080b4150 msgr2=0x7ff1080707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.000+0000 7ff110103640 1 -- 172.21.15.50:0/2415616847 shutdown_connections 2024-09-11T22:22:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.000+0000 7ff110103640 1 -- 172.21.15.50:0/2415616847 wait complete. 2024-09-11T22:22:42.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:22:42.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.113+0000 7f0642778640 1 Processor -- start 2024-09-11T22:22:42.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.113+0000 7f0642778640 1 -- start start 2024-09-11T22:22:42.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f0642778640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f063c15c2c0 0x7f063c0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f0642778640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f063c0d05e0 0x7f063c0ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f0642778640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f063c0b4f00 con 0x7f063c0b3e10 2024-09-11T22:22:42.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f0642778640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f063c0b4360 con 0x7f063c0d05e0 2024-09-11T22:22:42.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f0642778640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f063c0b51c0 con 0x7f063c15c2c0 2024-09-11T22:22:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f0640d15640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f063c0d05e0 0x7f063c0ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f063b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f063c0b3e10 0x7f063c0cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59892/0 (socket says 172.21.15.50:59892) 2024-09-11T22:22:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f063b7fe640 1 -- 172.21.15.50:0/1471493094 learned_addr learned my addr 172.21.15.50:0/1471493094 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f063bfff640 1 --2- 172.21.15.50:0/1471493094 >> v2:172.21.15.77:3300/0 conn(0x7f063c15c2c0 0x7f063c0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f0640d15640 1 -- 172.21.15.50:0/1471493094 >> v2:172.21.15.77:3300/0 conn(0x7f063c15c2c0 msgr2=0x7f063c0b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f0640d15640 1 --2- 172.21.15.50:0/1471493094 >> v2:172.21.15.77:3300/0 conn(0x7f063c15c2c0 0x7f063c0b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f0640d15640 1 -- 172.21.15.50:0/1471493094 >> v1:172.21.15.50:6789/0 conn(0x7f063c0b3e10 legacy=0x7f063c0cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f0640d15640 1 -- 172.21.15.50:0/1471493094 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c0b54a0 con 0x7f063c0d05e0 2024-09-11T22:22:42.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.114+0000 7f063affd640 1 -- 172.21.15.50:0/1471493094 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 993128027 0 0) 0x7f063c0b4f00 con 0x7f063c0b3e10 2024-09-11T22:22:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.115+0000 7f0640d15640 1 --2- 172.21.15.50:0/1471493094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c0d05e0 0x7f063c0ce790 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f063c06cdb0 tx=0x7f063402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4ea04fc0c5c263 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:42.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.115+0000 7f063affd640 1 -- 172.21.15.50:0/1471493094 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634007740 con 0x7f063c0d05e0 2024-09-11T22:22:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.115+0000 7f063affd640 1 -- 172.21.15.50:0/1471493094 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06340078e0 con 0x7f063c0d05e0 2024-09-11T22:22:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.115+0000 7f063affd640 1 -- 172.21.15.50:0/1471493094 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634007cb0 con 0x7f063c0d05e0 2024-09-11T22:22:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.116+0000 7f0642778640 1 -- 172.21.15.50:0/1471493094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c0d05e0 msgr2=0x7f063c0ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.116+0000 7f0642778640 1 --2- 172.21.15.50:0/1471493094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c0d05e0 0x7f063c0ce790 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f063c06cdb0 tx=0x7f063402a680 comp rx=0 tx=0).stop 2024-09-11T22:22:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.116+0000 7f0642778640 1 -- 172.21.15.50:0/1471493094 shutdown_connections 2024-09-11T22:22:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.116+0000 7f0642778640 1 --2- 172.21.15.50:0/1471493094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c0d05e0 0x7f063c0ce790 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.116+0000 7f0642778640 1 --2- 172.21.15.50:0/1471493094 >> v2:172.21.15.77:3300/0 conn(0x7f063c15c2c0 0x7f063c0b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.116+0000 7f0642778640 1 -- 172.21.15.50:0/1471493094 >> 172.21.15.50:0/1471493094 conn(0x7f063c0679c0 msgr2=0x7f063c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.116+0000 7f0642778640 1 -- 172.21.15.50:0/1471493094 shutdown_connections 2024-09-11T22:22:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.116+0000 7f0642778640 1 -- 172.21.15.50:0/1471493094 wait complete. 2024-09-11T22:22:42.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.117+0000 7f0642778640 1 Processor -- start 2024-09-11T22:22:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.117+0000 7f0642778640 1 -- start start 2024-09-11T22:22:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f0642778640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063c0b3e10 0x7f063c149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f0642778640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c0d05e0 0x7f063c15eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f0642778640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c15c2c0 0x7f063c1e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f0642778640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f063c06d070 con 0x7f063c0d05e0 2024-09-11T22:22:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f0642778640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f063c0ce200 con 0x7f063c0b3e10 2024-09-11T22:22:42.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f0642778640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f063c06d1f0 con 0x7f063c15c2c0 2024-09-11T22:22:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f063b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c0d05e0 0x7f063c15eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f063b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c0d05e0 0x7f063c15eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45690/0 (socket says 172.21.15.50:45690) 2024-09-11T22:22:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f063b7fe640 1 -- 172.21.15.50:0/1763431553 learned_addr learned my addr 172.21.15.50:0/1763431553 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f0640d15640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c15c2c0 0x7f063c1e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f063bfff640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063c0b3e10 0x7f063c149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f063b7fe640 1 -- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c15c2c0 msgr2=0x7f063c1e68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f063b7fe640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c15c2c0 0x7f063c1e68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f063b7fe640 1 -- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063c0b3e10 msgr2=0x7f063c149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f063b7fe640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063c0b3e10 0x7f063c149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.118+0000 7f063b7fe640 1 -- 172.21.15.50:0/1763431553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c15f2d0 con 0x7f063c0d05e0 2024-09-11T22:22:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.119+0000 7f063b7fe640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c0d05e0 0x7f063c15eb30 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f063000c500 tx=0x7f063000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:42.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.119+0000 7f0638ff9640 1 -- 172.21.15.50:0/1763431553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630018070 con 0x7f063c0d05e0 2024-09-11T22:22:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.119+0000 7f0638ff9640 1 -- 172.21.15.50:0/1763431553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0630007580 con 0x7f063c0d05e0 2024-09-11T22:22:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.119+0000 7f0642778640 1 -- 172.21.15.50:0/1763431553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063c15f5b0 con 0x7f063c0d05e0 2024-09-11T22:22:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.119+0000 7f0638ff9640 1 -- 172.21.15.50:0/1763431553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630004a20 con 0x7f063c0d05e0 2024-09-11T22:22:42.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.119+0000 7f0642778640 1 -- 172.21.15.50:0/1763431553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063c1e60f0 con 0x7f063c0d05e0 2024-09-11T22:22:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.120+0000 7f0642778640 1 -- 172.21.15.50:0/1763431553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f063c067f80 con 0x7f063c0d05e0 2024-09-11T22:22:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.120+0000 7f0638ff9640 1 -- 172.21.15.50:0/1763431553 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f063001b070 con 0x7f063c0d05e0 2024-09-11T22:22:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.121+0000 7f0638ff9640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062806be30 0x7f062806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.121+0000 7f0638ff9640 1 -- 172.21.15.50:0/1763431553 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f063008a1e0 con 0x7f063c0d05e0 2024-09-11T22:22:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.121+0000 7f063bfff640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062806be30 0x7f062806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.122+0000 7f063bfff640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062806be30 0x7f062806e2f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f062c006fd0 tx=0x7f062c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:42.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.125+0000 7f0638ff9640 1 -- 172.21.15.50:0/1763431553 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0630058b80 con 0x7f063c0d05e0 2024-09-11T22:22:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.337+0000 7f0642778640 1 -- 172.21.15.50:0/1763431553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f063c0cc9f0 con 0x7f063c0d05e0 2024-09-11T22:22:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.338+0000 7f0638ff9640 1 -- 172.21.15.50:0/1763431553 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+5239 (secure 0 0 0) 0x7f0630058480 con 0x7f063c0d05e0 2024-09-11T22:22:42.339 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:42.339 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":130,"btime":"2024-09-11T22:22:35:871475+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2188519592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2188519592},{"type":"v1","addr":"172.21.15.77:6836","nonce":2188519592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8165,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3754154405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3754154405},{"type":"v1","addr":"172.21.15.77:6837","nonce":3754154405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":127},{"gid":10317,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1024203584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1024203584},{"type":"v1","addr":"172.21.15.50:6833","nonce":1024203584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:22:33.219787+0000","modified":"2024-09-11T22:22:35.216759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10320":{"gid":10320,"name":"c","rank":0,"incarnation":128,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4092595783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4092595783},{"type":"v1","addr":"172.21.15.50:6835","nonce":4092595783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10320,"qdb_cluster":[10320]},"id":13}]} 2024-09-11T22:22:42.339 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 130 2024-09-11T22:22:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.340+0000 7f0642778640 1 -- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062806be30 msgr2=0x7f062806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.340+0000 7f0642778640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062806be30 0x7f062806e2f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f062c006fd0 tx=0x7f062c008040 comp rx=0 tx=0).stop 2024-09-11T22:22:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.340+0000 7f0642778640 1 -- 172.21.15.50:0/1763431553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c0d05e0 msgr2=0x7f063c15eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.340+0000 7f0642778640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c0d05e0 0x7f063c15eb30 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f063000c500 tx=0x7f063000c9c0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.340+0000 7f0642778640 1 -- 172.21.15.50:0/1763431553 shutdown_connections 2024-09-11T22:22:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.340+0000 7f0642778640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f062806be30 0x7f062806e2f0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.340+0000 7f0642778640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f063c15c2c0 0x7f063c1e68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.340+0000 7f0642778640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f063c0d05e0 0x7f063c15eb30 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.340+0000 7f0642778640 1 --2- 172.21.15.50:0/1763431553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f063c0b3e10 0x7f063c149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.340+0000 7f0642778640 1 -- 172.21.15.50:0/1763431553 >> 172.21.15.50:0/1763431553 conn(0x7f063c0679c0 msgr2=0x7f063c15ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:42.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.340+0000 7f0642778640 1 -- 172.21.15.50:0/1763431553 shutdown_connections 2024-09-11T22:22:42.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.340+0000 7f0642778640 1 -- 172.21.15.50:0/1763431553 wait complete. 2024-09-11T22:22:42.756 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 130, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:22:33.219787+0000', 'modified': '2024-09-11T22:22:35.216759+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10320}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10320': {'gid': 10320, 'name': 'c', 'rank': 0, 'incarnation': 128, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/4092595783', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 4092595783}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 4092595783}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10320, 'qdb_cluster': [10320]} 2024-09-11T22:22:42.756 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:22:42.756 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T22:22:42.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.864+0000 7f7690e77640 1 Processor -- start 2024-09-11T22:22:42.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.864+0000 7f7690e77640 1 -- start start 2024-09-11T22:22:42.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.865+0000 7f7690e77640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f768c15b400 0x7f768c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.865+0000 7f7690e77640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f768c072e60 0x7f768c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.865+0000 7f7690e77640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f768c15b7e0 con 0x7f768c06df20 2024-09-11T22:22:42.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.865+0000 7f7690e77640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f768c15f140 con 0x7f768c15b400 2024-09-11T22:22:42.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.865+0000 7f7690e77640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f768c15f420 con 0x7f768c072e60 2024-09-11T22:22:42.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.865+0000 7f768ad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f768c06df20 0x7f768c0b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59900/0 (socket says 172.21.15.50:59900) 2024-09-11T22:22:42.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.865+0000 7f768ad9d640 1 -- 172.21.15.50:0/58271451 learned_addr learned my addr 172.21.15.50:0/58271451 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:42.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.865+0000 7f7683fff640 1 --2- 172.21.15.50:0/58271451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f768c072e60 0x7f768c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.865+0000 7f768a59c640 1 --2- 172.21.15.50:0/58271451 >> v2:172.21.15.77:3300/0 conn(0x7f768c15b400 0x7f768c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.865+0000 7f7689d9b640 1 -- 172.21.15.50:0/58271451 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4183485001 0 0) 0x7f768c15b7e0 con 0x7f768c06df20 2024-09-11T22:22:42.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.865+0000 7f7689d9b640 1 -- 172.21.15.50:0/58271451 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7678003520 con 0x7f768c06df20 2024-09-11T22:22:42.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.866+0000 7f7683fff640 1 -- 172.21.15.50:0/58271451 >> v2:172.21.15.77:3300/0 conn(0x7f768c15b400 msgr2=0x7f768c06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:42.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.866+0000 7f7683fff640 1 --2- 172.21.15.50:0/58271451 >> v2:172.21.15.77:3300/0 conn(0x7f768c15b400 0x7f768c06d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.866+0000 7f7683fff640 1 -- 172.21.15.50:0/58271451 >> v1:172.21.15.50:6789/0 conn(0x7f768c06df20 legacy=0x7f768c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.866+0000 7f7683fff640 1 -- 172.21.15.50:0/58271451 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768c15f700 con 0x7f768c072e60 2024-09-11T22:22:42.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.866+0000 7f768a59c640 1 --2- 172.21.15.50:0/58271451 >> v2:172.21.15.77:3300/0 conn(0x7f768c15b400 0x7f768c06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:42.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.866+0000 7f7683fff640 1 --2- 172.21.15.50:0/58271451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f768c072e60 0x7f768c06d9e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f76740097a0 tx=0x7f767402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=283910cd54186ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:42.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.867+0000 7f7689d9b640 1 -- 172.21.15.50:0/58271451 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674037070 con 0x7f768c072e60 2024-09-11T22:22:42.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.867+0000 7f7689d9b640 1 -- 172.21.15.50:0/58271451 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7674032440 con 0x7f768c072e60 2024-09-11T22:22:42.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.867+0000 7f7689d9b640 1 -- 172.21.15.50:0/58271451 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76740327f0 con 0x7f768c072e60 2024-09-11T22:22:42.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.867+0000 7f7690e77640 1 -- 172.21.15.50:0/58271451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f768c072e60 msgr2=0x7f768c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.867+0000 7f7690e77640 1 --2- 172.21.15.50:0/58271451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f768c072e60 0x7f768c06d9e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f76740097a0 tx=0x7f767402a180 comp rx=0 tx=0).stop 2024-09-11T22:22:42.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.867+0000 7f7690e77640 1 -- 172.21.15.50:0/58271451 shutdown_connections 2024-09-11T22:22:42.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.867+0000 7f7690e77640 1 --2- 172.21.15.50:0/58271451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f768c072e60 0x7f768c06d9e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.867+0000 7f7690e77640 1 --2- 172.21.15.50:0/58271451 >> v2:172.21.15.77:3300/0 conn(0x7f768c15b400 0x7f768c06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.867+0000 7f7690e77640 1 -- 172.21.15.50:0/58271451 >> 172.21.15.50:0/58271451 conn(0x7f768c0679c0 msgr2=0x7f768c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:42.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.867+0000 7f7690e77640 1 -- 172.21.15.50:0/58271451 shutdown_connections 2024-09-11T22:22:42.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.867+0000 7f7690e77640 1 -- 172.21.15.50:0/58271451 wait complete. 2024-09-11T22:22:42.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.869+0000 7f7690e77640 1 Processor -- start 2024-09-11T22:22:42.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.869+0000 7f7690e77640 1 -- start start 2024-09-11T22:22:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.869+0000 7f7690e77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f768c06df20 0x7f768c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.869+0000 7f7690e77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f768c072e60 0x7f768c14aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.869+0000 7f7690e77640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f768c15b400 0x7f768c14a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.869+0000 7f7690e77640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f768c0721d0 con 0x7f768c06df20 2024-09-11T22:22:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.869+0000 7f7690e77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f768c0cfc50 con 0x7f768c072e60 2024-09-11T22:22:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.869+0000 7f7690e77640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f768c072350 con 0x7f768c15b400 2024-09-11T22:22:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f768a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f768c06df20 0x7f768c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f768a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f768c06df20 0x7f768c0cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45694/0 (socket says 172.21.15.50:45694) 2024-09-11T22:22:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f768a59c640 1 -- 172.21.15.50:0/4239122329 learned_addr learned my addr 172.21.15.50:0/4239122329 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:42.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f768ad9d640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f768c15b400 0x7f768c14a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f7683fff640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f768c072e60 0x7f768c14aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f768a59c640 1 -- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f768c15b400 msgr2=0x7f768c14a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f768a59c640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f768c15b400 0x7f768c14a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f768a59c640 1 -- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f768c072e60 msgr2=0x7f768c14aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f768a59c640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f768c072e60 0x7f768c14aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f768a59c640 1 -- 172.21.15.50:0/4239122329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768c15b7e0 con 0x7f768c06df20 2024-09-11T22:22:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f768a59c640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f768c06df20 0x7f768c0cd7c0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f767c00ebe0 tx=0x7f767c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f7682ffd640 1 -- 172.21.15.50:0/4239122329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c017070 con 0x7f768c06df20 2024-09-11T22:22:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f7682ffd640 1 -- 172.21.15.50:0/4239122329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767c00cc30 con 0x7f768c06df20 2024-09-11T22:22:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f7690e77640 1 -- 172.21.15.50:0/4239122329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768c14b940 con 0x7f768c06df20 2024-09-11T22:22:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f7682ffd640 1 -- 172.21.15.50:0/4239122329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c013470 con 0x7f768c06df20 2024-09-11T22:22:42.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.870+0000 7f7690e77640 1 -- 172.21.15.50:0/4239122329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f768c14bf00 con 0x7f768c06df20 2024-09-11T22:22:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.872+0000 7f7682ffd640 1 -- 172.21.15.50:0/4239122329 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f767c01a070 con 0x7f768c06df20 2024-09-11T22:22:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.872+0000 7f7682ffd640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f766c06be30 0x7f766c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.872+0000 7f7682ffd640 1 -- 172.21.15.50:0/4239122329 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f767c08ad60 con 0x7f768c06df20 2024-09-11T22:22:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.873+0000 7f7683fff640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f766c06be30 0x7f766c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.873+0000 7f7683fff640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f766c06be30 0x7f766c06e2f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7674034000 tx=0x7f767402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.873+0000 7f7693c10740 1 Processor -- start 2024-09-11T22:22:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.874+0000 7f7693c10740 1 -- start start 2024-09-11T22:22:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.874+0000 7f7693c10740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc8966d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.874+0000 7f7693c10740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 0x55dc89689290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.874+0000 7f7693c10740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc89640a80 0x55dc896897d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.874+0000 7f7693c10740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dc895a5520 con 0x55dc8966d120 2024-09-11T22:22:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.874+0000 7f7693c10740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dc8954d3e0 con 0x55dc89687ae0 2024-09-11T22:22:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.874+0000 7f7693c10740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dc895a14e0 con 0x55dc89640a80 2024-09-11T22:22:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.874+0000 7f768a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc8966d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.874+0000 7f768a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc8966d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45700/0 (socket says 172.21.15.50:45700) 2024-09-11T22:22:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.874+0000 7f768a59c640 1 -- 172.21.15.50:0/1719689275 learned_addr learned my addr 172.21.15.50:0/1719689275 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.874+0000 7f7683fff640 1 --2- 172.21.15.50:0/1719689275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 0x55dc89689290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.875+0000 7f768ad9d640 1 --2- 172.21.15.50:0/1719689275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc89640a80 0x55dc896897d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.875+0000 7f768a59c640 1 -- 172.21.15.50:0/1719689275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc89640a80 msgr2=0x55dc896897d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.875+0000 7f768a59c640 1 --2- 172.21.15.50:0/1719689275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc89640a80 0x55dc896897d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.875+0000 7f768a59c640 1 -- 172.21.15.50:0/1719689275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 msgr2=0x55dc89689290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.875+0000 7f768a59c640 1 --2- 172.21.15.50:0/1719689275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 0x55dc89689290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.875+0000 7f768a59c640 1 -- 172.21.15.50:0/1719689275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc895682f0 con 0x55dc8966d120 2024-09-11T22:22:42.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.875+0000 7f768a59c640 1 --2- 172.21.15.50:0/1719689275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc8966d500 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f767c0892b0 tx=0x7f767c0590c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75760a84db82da2d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:42.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.875+0000 7f766bfff640 1 -- 172.21.15.50:0/1719689275 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c071020 con 0x55dc8966d120 2024-09-11T22:22:42.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.875+0000 7f766bfff640 1 -- 172.21.15.50:0/1719689275 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767c061bf0 con 0x55dc8966d120 2024-09-11T22:22:42.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.875+0000 7f766bfff640 1 -- 172.21.15.50:0/1719689275 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c021040 con 0x55dc8966d120 2024-09-11T22:22:42.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.876+0000 7f7693c10740 1 -- 172.21.15.50:0/1719689275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 msgr2=0x55dc8966d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.876+0000 7f7693c10740 1 --2- 172.21.15.50:0/1719689275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc8966d500 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f767c0892b0 tx=0x7f767c0590c0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.876+0000 7f7693c10740 1 -- 172.21.15.50:0/1719689275 shutdown_connections 2024-09-11T22:22:42.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.876+0000 7f7693c10740 1 --2- 172.21.15.50:0/1719689275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc89640a80 0x55dc896897d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.876+0000 7f7693c10740 1 --2- 172.21.15.50:0/1719689275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 0x55dc89689290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.876+0000 7f7693c10740 1 --2- 172.21.15.50:0/1719689275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc8966d500 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.876+0000 7f7693c10740 1 -- 172.21.15.50:0/1719689275 >> 172.21.15.50:0/1719689275 conn(0x55dc8963fa80 msgr2=0x55dc89687f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:42.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.876+0000 7f7693c10740 1 -- 172.21.15.50:0/1719689275 shutdown_connections 2024-09-11T22:22:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.876+0000 7f7693c10740 1 -- 172.21.15.50:0/1719689275 wait complete. 2024-09-11T22:22:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.876+0000 7f7693c10740 1 -- start start 2024-09-11T22:22:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.876+0000 7f7693c10740 1 Processor -- start 2024-09-11T22:22:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.877+0000 7f7693c10740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8966d120 0x55dc89690990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.877+0000 7f7693c10740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc89687ae0 0x55dc8966e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.877+0000 7f7693c10740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc8969d0b0 0x55dc89685ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.877+0000 7f7693c10740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dc8966dee0 con 0x55dc89687ae0 2024-09-11T22:22:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.877+0000 7f7693c10740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dc8952e450 con 0x55dc8969d0b0 2024-09-11T22:22:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.877+0000 7f7693c10740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dc89688770 con 0x55dc8966d120 2024-09-11T22:22:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.877+0000 7f7693c10740 10 client.0 _ll_register_callbacks cb 0x55dc892b7ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.877+0000 7f7683fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc89687ae0 0x55dc8966e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f7683fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc89687ae0 0x55dc8966e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45712/0 (socket says 172.21.15.50:45712) 2024-09-11T22:22:42.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f7683fff640 1 -- 172.21.15.50:0/2433622088 learned_addr learned my addr 172.21.15.50:0/2433622088 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f768a59c640 1 --2- 172.21.15.50:0/2433622088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8966d120 0x55dc89690990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f768ad9d640 1 --2- 172.21.15.50:0/2433622088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc8969d0b0 0x55dc89685ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f7683fff640 1 -- 172.21.15.50:0/2433622088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8966d120 msgr2=0x55dc89690990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f7683fff640 1 --2- 172.21.15.50:0/2433622088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8966d120 0x55dc89690990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f7683fff640 1 -- 172.21.15.50:0/2433622088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc8969d0b0 msgr2=0x55dc89685ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f7683fff640 1 --2- 172.21.15.50:0/2433622088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc8969d0b0 0x55dc89685ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f7683fff640 1 -- 172.21.15.50:0/2433622088 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc892b82d0 con 0x55dc89687ae0 2024-09-11T22:22:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f7683fff640 1 --2- 172.21.15.50:0/2433622088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc89687ae0 0x55dc8966e2e0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f767402a770 tx=0x7f7674004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240d0da019bf7887 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f76697fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f76697fa640 1 -- 172.21.15.50:0/2433622088 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767404f020 con 0x55dc89687ae0 2024-09-11T22:22:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f76697fa640 1 -- 172.21.15.50:0/2433622088 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f767403f6f0 con 0x55dc89687ae0 2024-09-11T22:22:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f7693c10740 1 -- 172.21.15.50:0/2433622088 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f767c061bf0 con 0x55dc89687ae0 2024-09-11T22:22:42.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f76697fa640 1 -- 172.21.15.50:0/2433622088 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f7674037040 con 0x55dc89687ae0 2024-09-11T22:22:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f7693c10740 10 client.10476 fetch_fsmap learned FSMap version 130 2024-09-11T22:22:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f7693c10740 1 -- 172.21.15.50:0/2433622088 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55dc893826b0 con 0x55dc89687ae0 2024-09-11T22:22:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.878+0000 7f76697fa640 1 -- 172.21.15.50:0/2433622088 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767c061bf0 con 0x55dc89687ae0 2024-09-11T22:22:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.879+0000 7f76697fa640 1 -- 172.21.15.50:0/2433622088 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7f767403f020 con 0x55dc89687ae0 2024-09-11T22:22:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.879+0000 7f7693c10740 10 client.10476 fetch_fsmap finished waiting for FSMap version 130 2024-09-11T22:22:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.879+0000 7f7693c10740 10 client.10476 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:22:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.879+0000 7f7693c10740 20 client.10476 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.879+0000 7f7693c10740 1 --2- 172.21.15.50:0/2433622088 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55dc896a81e0 0x55dc896aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.879+0000 7f7693c10740 4 client.10476 mds_command: new command op to 10320 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:22:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.879+0000 7f7693c10740 1 -- 172.21.15.50:0/2433622088 --> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc895b2c50 con 0x55dc896a81e0 2024-09-11T22:22:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.879+0000 7f768a59c640 1 --2- 172.21.15.50:0/2433622088 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55dc896a81e0 0x55dc896aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.879+0000 7f768a59c640 1 --2- 172.21.15.50:0/2433622088 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55dc896a81e0 0x55dc896aa5d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3414b975a8e5752f server_cookie=18da214d4e18a40c in_seq=0 out_seq=0 2024-09-11T22:22:42.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.879+0000 7f76697fa640 10 client.10476 ms_handle_connect on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f76697fa640 1 -- 172.21.15.50:0/2433622088 <== mds.0 v2:172.21.15.50:6834/4092595783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc895b2c50 con 0x55dc896a81e0 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f76697fa640 10 client.10476 handle_command_reply: tid=0 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f7693c10740 1 client.10476 shutdown 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f7693c10740 1 -- 172.21.15.50:0/2433622088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc89687ae0 msgr2=0x55dc8966e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f7693c10740 1 --2- 172.21.15.50:0/2433622088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc89687ae0 0x55dc8966e2e0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f767402a770 tx=0x7f7674004730 comp rx=0 tx=0).stop 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f7693c10740 1 -- 172.21.15.50:0/2433622088 shutdown_connections 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f7693c10740 1 --2- 172.21.15.50:0/2433622088 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55dc896a81e0 0x55dc896aa5d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f7693c10740 1 --2- 172.21.15.50:0/2433622088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc8969d0b0 0x55dc89685ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f7693c10740 1 --2- 172.21.15.50:0/2433622088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc89687ae0 0x55dc8966e2e0 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f7693c10740 1 --2- 172.21.15.50:0/2433622088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8966d120 0x55dc89690990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f76697fa640 0 client.10476 ms_handle_reset on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f7693c10740 1 -- 172.21.15.50:0/2433622088 >> 172.21.15.50:0/2433622088 conn(0x55dc89640a80 msgr2=0x55dc896918d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f7693c10740 1 -- 172.21.15.50:0/2433622088 shutdown_connections 2024-09-11T22:22:42.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f7693c10740 1 -- 172.21.15.50:0/2433622088 wait complete. 2024-09-11T22:22:42.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.880+0000 7f7693c10740 20 client.10476 trim_cache size 0 max 16384 2024-09-11T22:22:42.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.898+0000 7f7693c10740 1 Processor -- start 2024-09-11T22:22:42.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.899+0000 7f7693c10740 1 -- start start 2024-09-11T22:22:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.899+0000 7f7693c10740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc89670a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.899+0000 7f7693c10740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 0x55dc89670f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.899+0000 7f7693c10740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8969d0b0 0x55dc896916c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.899+0000 7f7693c10740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f768c1684e0 con 0x55dc8966d120 2024-09-11T22:22:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.899+0000 7f7693c10740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f768c151550 con 0x55dc89687ae0 2024-09-11T22:22:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.899+0000 7f7693c10740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f768c151ba0 con 0x55dc8969d0b0 2024-09-11T22:22:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.899+0000 7f768a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc89670a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.899+0000 7f768a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc89670a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45720/0 (socket says 172.21.15.50:45720) 2024-09-11T22:22:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.899+0000 7f768a59c640 1 -- 172.21.15.50:0/699467636 learned_addr learned my addr 172.21.15.50:0/699467636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.899+0000 7f768ad9d640 1 --2- 172.21.15.50:0/699467636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8969d0b0 0x55dc896916c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.899+0000 7f7683fff640 1 --2- 172.21.15.50:0/699467636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 0x55dc89670f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.900+0000 7f768a59c640 1 -- 172.21.15.50:0/699467636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8969d0b0 msgr2=0x55dc896916c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.900+0000 7f768a59c640 1 --2- 172.21.15.50:0/699467636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8969d0b0 0x55dc896916c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.900+0000 7f768a59c640 1 -- 172.21.15.50:0/699467636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 msgr2=0x55dc89670f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.900+0000 7f768a59c640 1 --2- 172.21.15.50:0/699467636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 0x55dc89670f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.900+0000 7f768a59c640 1 -- 172.21.15.50:0/699467636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc89643310 con 0x55dc8966d120 2024-09-11T22:22:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.900+0000 7f7683fff640 1 --2- 172.21.15.50:0/699467636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 0x55dc89670f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.900+0000 7f768a59c640 1 --2- 172.21.15.50:0/699467636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc89670a40 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f767c055520 tx=0x7f767c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704e201ff10764b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.900+0000 7f766b7fe640 1 -- 172.21.15.50:0/699467636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c021040 con 0x55dc8966d120 2024-09-11T22:22:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.900+0000 7f766b7fe640 1 -- 172.21.15.50:0/699467636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767c0780c0 con 0x55dc8966d120 2024-09-11T22:22:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.900+0000 7f766b7fe640 1 -- 172.21.15.50:0/699467636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c071040 con 0x55dc8966d120 2024-09-11T22:22:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.901+0000 7f7693c10740 1 -- 172.21.15.50:0/699467636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 msgr2=0x55dc89670a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.901+0000 7f7693c10740 1 --2- 172.21.15.50:0/699467636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc89670a40 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f767c055520 tx=0x7f767c01e000 comp rx=0 tx=0).stop 2024-09-11T22:22:42.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.901+0000 7f7693c10740 1 -- 172.21.15.50:0/699467636 shutdown_connections 2024-09-11T22:22:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.901+0000 7f7693c10740 1 --2- 172.21.15.50:0/699467636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8969d0b0 0x55dc896916c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.901+0000 7f7693c10740 1 --2- 172.21.15.50:0/699467636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 0x55dc89670f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.901+0000 7f7693c10740 1 --2- 172.21.15.50:0/699467636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc89670a40 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.901+0000 7f7693c10740 1 -- 172.21.15.50:0/699467636 >> 172.21.15.50:0/699467636 conn(0x55dc89640a80 msgr2=0x55dc89690760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.901+0000 7f7693c10740 1 -- 172.21.15.50:0/699467636 shutdown_connections 2024-09-11T22:22:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.901+0000 7f7693c10740 1 -- 172.21.15.50:0/699467636 wait complete. 2024-09-11T22:22:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.901+0000 7f7693c10740 1 -- start start 2024-09-11T22:22:42.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.901+0000 7f7693c10740 1 Processor -- start 2024-09-11T22:22:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.902+0000 7f7693c10740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc896916c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.902+0000 7f7693c10740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 0x55dc89691c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.902+0000 7f7693c10740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8969d0b0 0x55dc896848c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.902+0000 7f7693c10740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dc896866d0 con 0x55dc8966d120 2024-09-11T22:22:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.902+0000 7f7693c10740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dc8966e820 con 0x55dc89687ae0 2024-09-11T22:22:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.902+0000 7f7693c10740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dc8969f190 con 0x55dc8969d0b0 2024-09-11T22:22:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.902+0000 7f7693c10740 10 client.0 _ll_register_callbacks cb 0x7f767c009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.902+0000 7f768a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc896916c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.902+0000 7f768a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc896916c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45734/0 (socket says 172.21.15.50:45734) 2024-09-11T22:22:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.902+0000 7f768a59c640 1 -- 172.21.15.50:0/328822019 learned_addr learned my addr 172.21.15.50:0/328822019 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.902+0000 7f7683fff640 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 0x55dc89691c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.902+0000 7f768ad9d640 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8969d0b0 0x55dc896848c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f768a59c640 1 -- 172.21.15.50:0/328822019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8969d0b0 msgr2=0x55dc896848c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f768a59c640 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8969d0b0 0x55dc896848c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f768a59c640 1 -- 172.21.15.50:0/328822019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 msgr2=0x55dc89691c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f768a59c640 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 0x55dc89691c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f768a59c640 1 -- 172.21.15.50:0/328822019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc8966d680 con 0x55dc8966d120 2024-09-11T22:22:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f768ad9d640 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8969d0b0 0x55dc896848c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f768a59c640 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc896916c0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f767c055520 tx=0x7f767c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cc96928a3439a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f76697fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f76697fa640 1 -- 172.21.15.50:0/328822019 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c021070 con 0x55dc8966d120 2024-09-11T22:22:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f76697fa640 1 -- 172.21.15.50:0/328822019 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f767c058510 con 0x55dc8966d120 2024-09-11T22:22:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f7693c10740 1 -- 172.21.15.50:0/328822019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f767c0780c0 con 0x55dc8966d120 2024-09-11T22:22:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f76697fa640 1 -- 172.21.15.50:0/328822019 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f767c071040 con 0x55dc8966d120 2024-09-11T22:22:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f7693c10740 10 client.10482 fetch_fsmap learned FSMap version 130 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f7693c10740 1 -- 172.21.15.50:0/328822019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55dc89687460 con 0x55dc8966d120 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f76697fa640 1 -- 172.21.15.50:0/328822019 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767c0780c0 con 0x55dc8966d120 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f76697fa640 1 -- 172.21.15.50:0/328822019 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7f767c024060 con 0x55dc8966d120 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f7693c10740 10 client.10482 fetch_fsmap finished waiting for FSMap version 130 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f7693c10740 10 client.10482 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f7693c10740 20 client.10482 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f7693c10740 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55dc897098c0 0x55dc89709ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f7693c10740 4 client.10482 mds_command: new command op to 10320 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f7693c10740 1 -- 172.21.15.50:0/328822019 --> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] -- command(tid 0: {"prefix": "status"}) -- 0x55dc895acfa0 con 0x55dc897098c0 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.903+0000 7f7683fff640 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55dc897098c0 0x55dc89709ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f76697fa640 10 client.10482 ms_handle_connect on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f7683fff640 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55dc897098c0 0x55dc89709ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d7888faf2f1d280 server_cookie=cfe5831e8aa35a in_seq=0 out_seq=0 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f76697fa640 1 -- 172.21.15.50:0/328822019 <== mds.0 v2:172.21.15.50:6834/4092595783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x55dc895acfa0 con 0x55dc897098c0 2024-09-11T22:22:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f76697fa640 10 client.10482 handle_command_reply: tid=0 2024-09-11T22:22:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f7693c10740 1 client.10482 shutdown 2024-09-11T22:22:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f7693c10740 1 -- 172.21.15.50:0/328822019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 msgr2=0x55dc896916c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f7693c10740 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc896916c0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f767c055520 tx=0x7f767c000bc0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f7693c10740 1 -- 172.21.15.50:0/328822019 shutdown_connections 2024-09-11T22:22:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f7693c10740 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55dc897098c0 0x55dc89709ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f7693c10740 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dc8969d0b0 0x55dc896848c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f7693c10740 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dc89687ae0 0x55dc89691c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f7693c10740 1 --2- 172.21.15.50:0/328822019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8966d120 0x55dc896916c0 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f76697fa640 0 client.10482 ms_handle_reset on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f7693c10740 1 -- 172.21.15.50:0/328822019 >> 172.21.15.50:0/328822019 conn(0x55dc89640a80 msgr2=0x55dc89670a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f7693c10740 1 -- 172.21.15.50:0/328822019 shutdown_connections 2024-09-11T22:22:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f7693c10740 1 -- 172.21.15.50:0/328822019 wait complete. 2024-09-11T22:22:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.904+0000 7f7693c10740 20 client.10482 trim_cache size 0 max 16384 2024-09-11T22:22:42.912 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:22:42.912 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:22:42.912 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:22:42.912 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 10320, 2024-09-11T22:22:42.912 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:22:42.912 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:22:42.912 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:22:42.912 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 9.0390885310000009, 2024-09-11T22:22:42.912 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 130, 2024-09-11T22:22:42.912 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 178, 2024-09-11T22:22:42.912 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 178, 2024-09-11T22:22:42.912 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 13.067611455 2024-09-11T22:22:42.913 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:22:42.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.905+0000 7f7690e77640 1 -- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f766c06be30 msgr2=0x7f766c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.905+0000 7f7690e77640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f766c06be30 0x7f766c06e2f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7674034000 tx=0x7f767402e000 comp rx=0 tx=0).stop 2024-09-11T22:22:42.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.905+0000 7f7690e77640 1 -- 172.21.15.50:0/4239122329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f768c06df20 msgr2=0x7f768c0cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.905+0000 7f7690e77640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f768c06df20 0x7f768c0cd7c0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f767c00ebe0 tx=0x7f767c00c520 comp rx=0 tx=0).stop 2024-09-11T22:22:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.905+0000 7f7690e77640 1 -- 172.21.15.50:0/4239122329 shutdown_connections 2024-09-11T22:22:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.905+0000 7f7690e77640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f766c06be30 0x7f766c06e2f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.905+0000 7f7690e77640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f768c15b400 0x7f768c14a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.905+0000 7f7690e77640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f768c072e60 0x7f768c14aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.905+0000 7f7690e77640 1 --2- 172.21.15.50:0/4239122329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f768c06df20 0x7f768c0cd7c0 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.905+0000 7f7690e77640 1 -- 172.21.15.50:0/4239122329 >> 172.21.15.50:0/4239122329 conn(0x7f768c0679c0 msgr2=0x7f768c0b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.905+0000 7f7690e77640 1 -- 172.21.15.50:0/4239122329 shutdown_connections 2024-09-11T22:22:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:42.905+0000 7f7690e77640 1 -- 172.21.15.50:0/4239122329 wait complete. 2024-09-11T22:22:42.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:22:43.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.019+0000 7f2f7f1f8640 1 Processor -- start 2024-09-11T22:22:43.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.019+0000 7f2f7f1f8640 1 -- start start 2024-09-11T22:22:43.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.019+0000 7f2f7f1f8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2f780d18a0 0x7f2f780d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.019+0000 7f2f7f1f8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f780cfa80 con 0x7f2f780d3a30 2024-09-11T22:22:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.019+0000 7f2f7f1f8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f780d40d0 con 0x7f2f7815e870 2024-09-11T22:22:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.019+0000 7f2f7f1f8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2f780d3ea0 con 0x7f2f780d18a0 2024-09-11T22:22:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f7d795640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2f780d3a30 0x7f2f780b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59904/0 (socket says 172.21.15.50:59904) 2024-09-11T22:22:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f7d795640 1 -- 172.21.15.50:0/4238961249 learned_addr learned my addr 172.21.15.50:0/4238961249 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f77fff640 1 --2- 172.21.15.50:0/4238961249 >> v2:172.21.15.77:3300/0 conn(0x7f2f780d18a0 0x7f2f780d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4225746754 0 0) 0x7f2f68001110 con 0x7f2f780d3a30 2024-09-11T22:22:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f60003520 con 0x7f2f780d3a30 2024-09-11T22:22:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 986706311 0 0) 0x7f2f60003520 con 0x7f2f780d3a30 2024-09-11T22:22:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 >> v2:172.21.15.77:3300/0 conn(0x7f2f780d18a0 msgr2=0x7f2f780d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 --2- 172.21.15.50:0/4238961249 >> v2:172.21.15.77:3300/0 conn(0x7f2f780d18a0 0x7f2f780d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 >> v1:172.21.15.77:6789/0 conn(0x7f2f7815e870 legacy=0x7f2f780d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f780d43b0 con 0x7f2f780d3a30 2024-09-11T22:22:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f2f68001840 con 0x7f2f780d3a30 2024-09-11T22:22:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f77fff640 1 --2- 172.21.15.50:0/4238961249 >> v2:172.21.15.77:3300/0 conn(0x7f2f780d18a0 0x7f2f780d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 >> v1:172.21.15.50:6789/0 conn(0x7f2f780d3a30 legacy=0x7f2f780b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 --2- 172.21.15.50:0/4238961249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f600039b0 0x7f2f60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 --2- 172.21.15.50:0/4238961249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f60004800 0x7f2f60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 --2- 172.21.15.50:0/4238961249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f600051c0 0x7f2f6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6000c030 con 0x7f2f600051c0 2024-09-11T22:22:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6000c1e0 con 0x7f2f60004800 2024-09-11T22:22:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2f6000c3e0 con 0x7f2f600039b0 2024-09-11T22:22:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f7d795640 1 --2- 172.21.15.50:0/4238961249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f600051c0 0x7f2f6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f7cf94640 1 --2- 172.21.15.50:0/4238961249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f600039b0 0x7f2f60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.020+0000 7f2f77fff640 1 --2- 172.21.15.50:0/4238961249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f60004800 0x7f2f60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.021+0000 7f2f7d795640 1 -- 172.21.15.50:0/4238961249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f600039b0 msgr2=0x7f2f60003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:43.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.021+0000 7f2f7d795640 1 --2- 172.21.15.50:0/4238961249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f600039b0 0x7f2f60003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:43.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.021+0000 7f2f7d795640 1 -- 172.21.15.50:0/4238961249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f60004800 msgr2=0x7f2f60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:43.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.021+0000 7f2f7d795640 1 --2- 172.21.15.50:0/4238961249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f60004800 0x7f2f60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:43.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.021+0000 7f2f7d795640 1 -- 172.21.15.50:0/4238961249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f60003520 con 0x7f2f600051c0 2024-09-11T22:22:43.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.021+0000 7f2f7d795640 1 -- 172.21.15.50:0/4238961249 reap_dead start 2024-09-11T22:22:43.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.021+0000 7f2f7d795640 1 --2- 172.21.15.50:0/4238961249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f600051c0 0x7f2f6000b9c0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800c4c0 tx=0x7f2f60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45c34d5d1b38e0e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:43.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.021+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6800c0e0 con 0x7f2f600051c0 2024-09-11T22:22:43.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.021+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f680058d0 con 0x7f2f600051c0 2024-09-11T22:22:43.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.022+0000 7f2f777fe640 1 -- 172.21.15.50:0/4238961249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f68005ce0 con 0x7f2f600051c0 2024-09-11T22:22:43.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.022+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/4238961249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f600051c0 msgr2=0x7f2f6000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:43.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.022+0000 7f2f7f1f8640 1 --2- 172.21.15.50:0/4238961249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f600051c0 0x7f2f6000b9c0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800c4c0 tx=0x7f2f60005830 comp rx=0 tx=0).stop 2024-09-11T22:22:43.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.022+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/4238961249 shutdown_connections 2024-09-11T22:22:43.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.022+0000 7f2f7f1f8640 1 --2- 172.21.15.50:0/4238961249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f600051c0 0x7f2f6000b9c0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:43.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.022+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/4238961249 >> 172.21.15.50:0/4238961249 conn(0x7f2f780727a0 msgr2=0x7f2f780679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:43.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.022+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/4238961249 shutdown_connections 2024-09-11T22:22:43.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.022+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/4238961249 wait complete. 2024-09-11T22:22:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.023+0000 7f2f7f1f8640 1 Processor -- start 2024-09-11T22:22:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.023+0000 7f2f7f1f8640 1 -- start start 2024-09-11T22:22:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.024+0000 7f2f7f1f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f600051c0 0x7f2f78159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.024+0000 7f2f7f1f8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f780ce0b0 0x7f2f780cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.024+0000 7f2f7f1f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f78160370 0x7f2f78155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.024+0000 7f2f7f1f8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7815ec50 con 0x7f2f780ce0b0 2024-09-11T22:22:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.024+0000 7f2f7f1f8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2f780b7ee0 con 0x7f2f600051c0 2024-09-11T22:22:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.024+0000 7f2f7f1f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2f780b78b0 con 0x7f2f78160370 2024-09-11T22:22:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.024+0000 7f2f77fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f780ce0b0 0x7f2f780cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.024+0000 7f2f77fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f780ce0b0 0x7f2f780cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45746/0 (socket says 172.21.15.50:45746) 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.024+0000 7f2f77fff640 1 -- 172.21.15.50:0/2219785591 learned_addr learned my addr 172.21.15.50:0/2219785591 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.024+0000 7f2f7cf94640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f600051c0 0x7f2f78159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.024+0000 7f2f7d795640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f78160370 0x7f2f78155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.025+0000 7f2f77fff640 1 -- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f78160370 msgr2=0x7f2f78155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.025+0000 7f2f77fff640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f78160370 0x7f2f78155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.025+0000 7f2f77fff640 1 -- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f600051c0 msgr2=0x7f2f78159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.025+0000 7f2f77fff640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f600051c0 0x7f2f78159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.025+0000 7f2f77fff640 1 -- 172.21.15.50:0/2219785591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7815a1b0 con 0x7f2f780ce0b0 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.025+0000 7f2f7d795640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f78160370 0x7f2f78155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.025+0000 7f2f77fff640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f780ce0b0 0x7f2f780cc500 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c011ac0 tx=0x7f2f6c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.025+0000 7f2f757fa640 1 -- 172.21.15.50:0/2219785591 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00fbb0 con 0x7f2f780ce0b0 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.025+0000 7f2f757fa640 1 -- 172.21.15.50:0/2219785591 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6c00fd50 con 0x7f2f780ce0b0 2024-09-11T22:22:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.025+0000 7f2f757fa640 1 -- 172.21.15.50:0/2219785591 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c004260 con 0x7f2f780ce0b0 2024-09-11T22:22:43.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.025+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/2219785591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7815a490 con 0x7f2f780ce0b0 2024-09-11T22:22:43.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.025+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/2219785591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7815aa50 con 0x7f2f780ce0b0 2024-09-11T22:22:43.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.026+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/2219785591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f780d34f0 con 0x7f2f780ce0b0 2024-09-11T22:22:43.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.027+0000 7f2f757fa640 1 -- 172.21.15.50:0/2219785591 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f6c012040 con 0x7f2f780ce0b0 2024-09-11T22:22:43.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.027+0000 7f2f757fa640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2f6406be60 0x7f2f6406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:43.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.027+0000 7f2f757fa640 1 -- 172.21.15.50:0/2219785591 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f2f6c08b190 con 0x7f2f780ce0b0 2024-09-11T22:22:43.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.027+0000 7f2f7cf94640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2f6406be60 0x7f2f6406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:43.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.028+0000 7f2f7cf94640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2f6406be60 0x7f2f6406e320 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2f781614e0 tx=0x7f2f70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:43.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.031+0000 7f2f757fa640 1 -- 172.21.15.50:0/2219785591 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f6c019030 con 0x7f2f780ce0b0 2024-09-11T22:22:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.240+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/2219785591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2f7815d7d0 con 0x7f2f780ce0b0 2024-09-11T22:22:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.240+0000 7f2f757fa640 1 -- 172.21.15.50:0/2219785591 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v130) ==== 53+0+73 (secure 0 0 0) 0x7f2f6c059580 con 0x7f2f780ce0b0 2024-09-11T22:22:43.241 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:22:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.242+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2f6406be60 msgr2=0x7f2f6406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.242+0000 7f2f7f1f8640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2f6406be60 0x7f2f6406e320 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2f781614e0 tx=0x7f2f70009040 comp rx=0 tx=0).stop 2024-09-11T22:22:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.242+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/2219785591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f780ce0b0 msgr2=0x7f2f780cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.242+0000 7f2f7f1f8640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f780ce0b0 0x7f2f780cc500 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c011ac0 tx=0x7f2f6c011f80 comp rx=0 tx=0).stop 2024-09-11T22:22:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.242+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/2219785591 shutdown_connections 2024-09-11T22:22:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.242+0000 7f2f7f1f8640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2f6406be60 0x7f2f6406e320 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.242+0000 7f2f7f1f8640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f78160370 0x7f2f78155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.242+0000 7f2f7f1f8640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f780ce0b0 0x7f2f780cc500 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.242+0000 7f2f7f1f8640 1 --2- 172.21.15.50:0/2219785591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f600051c0 0x7f2f78159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.242+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/2219785591 >> 172.21.15.50:0/2219785591 conn(0x7f2f780727a0 msgr2=0x7f2f780d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.242+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/2219785591 shutdown_connections 2024-09-11T22:22:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43.242+0000 7f2f7f1f8640 1 -- 172.21.15.50:0/2219785591 wait complete. 2024-09-11T22:22:43.254 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:22:43.254 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:22:43.254 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:22:43.254 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:22:43.255 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:22:43.255 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:22:43.255 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:22:43.255 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:22:43.255 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:22:43.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:43.255 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:22:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:22:43.271 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:22:43.271 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:22:43.271 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:43.272 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:22:43.272 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:22:43.272 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:22:43.272 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:22:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:22:43.272 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:22:43.272 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:22:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:22:43.272 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:22:43.272 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:22:43.272 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:22:43.272 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42032sec preferred_lft 42032sec 2024-09-11T22:22:43.273 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:22:43.273 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:22:43.273 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:22:43.273 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:22:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:22:43.273 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:22:43.273 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:22:43.273 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:43.273 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:22:43.273 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:22:43.274 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:22:43.274 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:22:43.274 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:22:43.274 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:22:43.274 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:22:43.274 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:22:43.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:43.274 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:22:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:22:43.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:43.337 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:22:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:22:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:22:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:22:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:22:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:22:43.395 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:22:43.395 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:22:43.395 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:22:43.395 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:22:43.395 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:22:43.395 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:22:43.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:22:43.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:43.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:43.523 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:22:43.539 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:22:43.539 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:22:43.539 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:22:43.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:43.540 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:22:43.605 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:22:43.605 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:22:43.662 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:22:43.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:22:43.662 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:22:43.718 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:22:43.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:43.718 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:22:43.803 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:22:43.803 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:22:43.811 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:22:43.811 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:22:43.811 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:22:43.811 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:22:43.811 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:22:43.812 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:22:43.812 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:22:43.812 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:22:43.812 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:22:43.812 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:22:43.813 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:22:43.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:43.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:22:43.839 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:22:43.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:22:43.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:22:43.941 INFO:teuthology.orchestra.run.smithi050.stdout:client10491 2024-09-11T22:22:43.942 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:22:43.942 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:22:43.959 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-11T22:22:44.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.103+0000 7f1ff1976640 1 Processor -- start 2024-09-11T22:22:44.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.104+0000 7f1ff1976640 1 -- start start 2024-09-11T22:22:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.104+0000 7f1ff1976640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1fec15e870 0x7f1fec0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.104+0000 7f1ff1976640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fec0d16d0 0x7f1fec0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.104+0000 7f1ff1976640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1fec0d3a30 0x7f1fec0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.104+0000 7f1ff1976640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f1fec0d1b40 con 0x7f1fec0d16d0 2024-09-11T22:22:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.104+0000 7f1ff1976640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1fec0cfa80 con 0x7f1fec15e870 2024-09-11T22:22:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.104+0000 7f1ff1976640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec0d3e50 con 0x7f1fec0d3a30 2024-09-11T22:22:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.104+0000 7f1fea7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fec0d16d0 0x7f1fec0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.105+0000 7f1fea7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1fec0d16d0 0x7f1fec0d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45762/0 (socket says 172.21.15.50:45762) 2024-09-11T22:22:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.105+0000 7f1fea7fc640 1 -- 172.21.15.50:0/1487784760 learned_addr learned my addr 172.21.15.50:0/1487784760 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.105+0000 7f1feaffd640 1 --2- 172.21.15.50:0/1487784760 >> v2:172.21.15.77:3300/0 conn(0x7f1fec15e870 0x7f1fec0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.105+0000 7f1feb7fe640 1 --2- 172.21.15.50:0/1487784760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1fec0d3a30 0x7f1fec0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.105+0000 7f1fea7fc640 1 -- 172.21.15.50:0/1487784760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1fec0d3a30 msgr2=0x7f1fec0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.105+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/1487784760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1fec0d3a30 0x7f1fec0b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.105+0000 7f1fea7fc640 1 -- 172.21.15.50:0/1487784760 >> v2:172.21.15.77:3300/0 conn(0x7f1fec15e870 msgr2=0x7f1fec0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.105+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/1487784760 >> v2:172.21.15.77:3300/0 conn(0x7f1fec15e870 0x7f1fec0d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.105+0000 7f1fea7fc640 1 -- 172.21.15.50:0/1487784760 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec0d40d0 con 0x7f1fec0d16d0 2024-09-11T22:22:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.105+0000 7f1feb7fe640 1 --2- 172.21.15.50:0/1487784760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1fec0d3a30 0x7f1fec0b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:44.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.106+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/1487784760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fec0d16d0 0x7f1fec0d34f0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0d4000 tx=0x7f1fe002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20f12d86f03a40a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.106+0000 7f1fe9ffb640 1 -- 172.21.15.50:0/1487784760 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0037070 con 0x7f1fec0d16d0 2024-09-11T22:22:44.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.106+0000 7f1fe9ffb640 1 -- 172.21.15.50:0/1487784760 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe0032440 con 0x7f1fec0d16d0 2024-09-11T22:22:44.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.106+0000 7f1fe9ffb640 1 -- 172.21.15.50:0/1487784760 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0032810 con 0x7f1fec0d16d0 2024-09-11T22:22:44.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.106+0000 7f1ff1976640 1 -- 172.21.15.50:0/1487784760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fec0d16d0 msgr2=0x7f1fec0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.106+0000 7f1ff1976640 1 --2- 172.21.15.50:0/1487784760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fec0d16d0 0x7f1fec0d34f0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0d4000 tx=0x7f1fe002a1c0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.106+0000 7f1ff1976640 1 -- 172.21.15.50:0/1487784760 shutdown_connections 2024-09-11T22:22:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.106+0000 7f1ff1976640 1 --2- 172.21.15.50:0/1487784760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1fec0d3a30 0x7f1fec0b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.106+0000 7f1ff1976640 1 --2- 172.21.15.50:0/1487784760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fec0d16d0 0x7f1fec0d34f0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.106+0000 7f1ff1976640 1 --2- 172.21.15.50:0/1487784760 >> v2:172.21.15.77:3300/0 conn(0x7f1fec15e870 0x7f1fec0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.106+0000 7f1ff1976640 1 -- 172.21.15.50:0/1487784760 >> 172.21.15.50:0/1487784760 conn(0x7f1fec0727a0 msgr2=0x7f1fec0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.106+0000 7f1ff1976640 1 -- 172.21.15.50:0/1487784760 shutdown_connections 2024-09-11T22:22:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.106+0000 7f1ff1976640 1 -- 172.21.15.50:0/1487784760 wait complete. 2024-09-11T22:22:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.108+0000 7f1ff1976640 1 Processor -- start 2024-09-11T22:22:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.108+0000 7f1ff1976640 1 -- start start 2024-09-11T22:22:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.108+0000 7f1ff1976640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fec0d16d0 0x7f1fec14dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.108+0000 7f1ff1976640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1fec0d3a30 0x7f1fec14e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1ff1976640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fec15e870 0x7f1fec0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1ff1976640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0b7ee0 con 0x7f1fec0d16d0 2024-09-11T22:22:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1ff1976640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0b7c00 con 0x7f1fec15e870 2024-09-11T22:22:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1ff1976640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec15ec50 con 0x7f1fec0d3a30 2024-09-11T22:22:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1feaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fec0d16d0 0x7f1fec14dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1feaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fec0d16d0 0x7f1fec14dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45770/0 (socket says 172.21.15.50:45770) 2024-09-11T22:22:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1feaffd640 1 -- 172.21.15.50:0/3441515098 learned_addr learned my addr 172.21.15.50:0/3441515098 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1fec0d3a30 0x7f1fec14e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1feaffd640 1 -- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1fec0d3a30 msgr2=0x7f1fec14e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1feaffd640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1fec0d3a30 0x7f1fec14e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1feaffd640 1 -- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fec15e870 msgr2=0x7f1fec0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1feb7fe640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fec15e870 0x7f1fec0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1feaffd640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fec15e870 0x7f1fec0cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1feaffd640 1 -- 172.21.15.50:0/3441515098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec14ede0 con 0x7f1fec0d16d0 2024-09-11T22:22:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1feaffd640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fec0d16d0 0x7f1fec14dc00 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00d5f0 tx=0x7f1fdc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1fd3fff640 1 -- 172.21.15.50:0/3441515098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0125f0 con 0x7f1fec0d16d0 2024-09-11T22:22:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1fd3fff640 1 -- 172.21.15.50:0/3441515098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fdc019070 con 0x7f1fec0d16d0 2024-09-11T22:22:44.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1ff1976640 1 -- 172.21.15.50:0/3441515098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec14f0c0 con 0x7f1fec0d16d0 2024-09-11T22:22:44.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1fd3fff640 1 -- 172.21.15.50:0/3441515098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0129d0 con 0x7f1fec0d16d0 2024-09-11T22:22:44.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.109+0000 7f1ff1976640 1 -- 172.21.15.50:0/3441515098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec14f680 con 0x7f1fec0d16d0 2024-09-11T22:22:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.111+0000 7f1fd3fff640 1 -- 172.21.15.50:0/3441515098 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fdc012b70 con 0x7f1fec0d16d0 2024-09-11T22:22:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.111+0000 7f1fd3fff640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1fd806be30 0x7f1fd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.112+0000 7f1fd3fff640 1 -- 172.21.15.50:0/3441515098 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f1fdc08b270 con 0x7f1fec0d16d0 2024-09-11T22:22:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.112+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1fd806be30 0x7f1fd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.112+0000 7f1ff47ed740 1 Processor -- start 2024-09-11T22:22:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.112+0000 7f1ff47ed740 1 -- start start 2024-09-11T22:22:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.112+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1fd806be30 0x7f1fd806e2f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0034000 tx=0x7f1fe002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1ff47ed740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb171d5d0 0x55cfb171d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1ff47ed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171ad90 0x55cfb171c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1ff47ed740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb16fd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1ff47ed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cfb16395d0 con 0x55cfb171ad90 2024-09-11T22:22:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1ff47ed740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cfb15e1470 con 0x55cfb171b1f0 2024-09-11T22:22:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1ff47ed740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cfb1635590 con 0x55cfb171d5d0 2024-09-11T22:22:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1fea7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171ad90 0x55cfb171c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1fea7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171ad90 0x55cfb171c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45776/0 (socket says 172.21.15.50:45776) 2024-09-11T22:22:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1fea7fc640 1 -- 172.21.15.50:0/373984913 learned_addr learned my addr 172.21.15.50:0/373984913 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1feaffd640 1 --2- 172.21.15.50:0/373984913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb171d5d0 0x55cfb171d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1feb7fe640 1 --2- 172.21.15.50:0/373984913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb16fd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1fea7fc640 1 -- 172.21.15.50:0/373984913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb171d5d0 msgr2=0x55cfb171d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/373984913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb171d5d0 0x55cfb171d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1fea7fc640 1 -- 172.21.15.50:0/373984913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 msgr2=0x55cfb16fd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/373984913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb16fd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1fea7fc640 1 -- 172.21.15.50:0/373984913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb15c9860 con 0x55cfb171ad90 2024-09-11T22:22:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.113+0000 7f1feb7fe640 1 --2- 172.21.15.50:0/373984913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb16fd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.114+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/373984913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171ad90 0x55cfb171c920 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0000c00 tx=0x7f1fe002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b06e7e938ac97e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.114+0000 7f1fd17fa640 1 -- 172.21.15.50:0/373984913 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe004e070 con 0x55cfb171ad90 2024-09-11T22:22:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.114+0000 7f1fd17fa640 1 -- 172.21.15.50:0/373984913 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe0032e00 con 0x55cfb171ad90 2024-09-11T22:22:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.114+0000 7f1fd17fa640 1 -- 172.21.15.50:0/373984913 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0037040 con 0x55cfb171ad90 2024-09-11T22:22:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.114+0000 7f1ff47ed740 1 -- 172.21.15.50:0/373984913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171ad90 msgr2=0x55cfb171c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.114+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/373984913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171ad90 0x55cfb171c920 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0000c00 tx=0x7f1fe002c000 comp rx=0 tx=0).stop 2024-09-11T22:22:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.115+0000 7f1ff47ed740 1 -- 172.21.15.50:0/373984913 shutdown_connections 2024-09-11T22:22:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.115+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/373984913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb16fd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.115+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/373984913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171ad90 0x55cfb171c920 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.115+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/373984913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb171d5d0 0x55cfb171d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.115+0000 7f1ff47ed740 1 -- 172.21.15.50:0/373984913 >> 172.21.15.50:0/373984913 conn(0x55cfb16d3230 msgr2=0x55cfb171b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.115+0000 7f1ff47ed740 1 -- 172.21.15.50:0/373984913 shutdown_connections 2024-09-11T22:22:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.115+0000 7f1ff47ed740 1 -- 172.21.15.50:0/373984913 wait complete. 2024-09-11T22:22:44.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.115+0000 7f1ff47ed740 1 -- start start 2024-09-11T22:22:44.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.115+0000 7f1ff47ed740 1 Processor -- start 2024-09-11T22:22:44.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1ff47ed740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb172c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1ff47ed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 0x55cfb1715190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1ff47ed740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb1718570 0x55cfb1715c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1ff47ed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cfb1719cf0 con 0x55cfb171d5d0 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1ff47ed740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cfb15c2620 con 0x55cfb171b1f0 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1ff47ed740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cfb1719fd0 con 0x55cfb1718570 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1ff47ed740 10 client.0 _ll_register_callbacks cb 0x55cfb15e65b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1fea7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 0x55cfb1715190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1fea7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 0x55cfb1715190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45786/0 (socket says 172.21.15.50:45786) 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1fea7fc640 1 -- 172.21.15.50:0/273574921 learned_addr learned my addr 172.21.15.50:0/273574921 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1feb7fe640 1 --2- 172.21.15.50:0/273574921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb1718570 0x55cfb1715c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1feaffd640 1 --2- 172.21.15.50:0/273574921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb172c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1fea7fc640 1 -- 172.21.15.50:0/273574921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb1718570 msgr2=0x55cfb1715c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/273574921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb1718570 0x55cfb1715c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1fea7fc640 1 -- 172.21.15.50:0/273574921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 msgr2=0x55cfb172c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/273574921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb172c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.116+0000 7f1fea7fc640 1 -- 172.21.15.50:0/273574921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfb134c3f0 con 0x55cfb171d5d0 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/273574921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 0x55cfb1715190 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00090b0 tx=0x7f1fe0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d2d4e213e1e6c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1fca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1fca7fc640 1 -- 172.21.15.50:0/273574921 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe004e070 con 0x55cfb171d5d0 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1fca7fc640 1 -- 172.21.15.50:0/273574921 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f1fe003e9d0 con 0x55cfb171d5d0 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1ff47ed740 1 -- 172.21.15.50:0/273574921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fe0032e00 con 0x55cfb171d5d0 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1fca7fc640 1 -- 172.21.15.50:0/273574921 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f1fe0058050 con 0x55cfb171d5d0 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1ff47ed740 10 client.10503 fetch_fsmap learned FSMap version 130 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1ff47ed740 1 -- 172.21.15.50:0/273574921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55cfb14167d0 con 0x55cfb171d5d0 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1fca7fc640 1 -- 172.21.15.50:0/273574921 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe0032e00 con 0x55cfb171d5d0 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1fca7fc640 1 -- 172.21.15.50:0/273574921 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7f1fe005b020 con 0x55cfb171d5d0 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1ff47ed740 10 client.10503 fetch_fsmap finished waiting for FSMap version 130 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1ff47ed740 10 client.10503 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1ff47ed740 20 client.10503 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:44.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/273574921 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55cfb172f060 0x55cfb172f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1ff47ed740 4 client.10503 mds_command: new command op to 10320 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:22:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1ff47ed740 1 -- 172.21.15.50:0/273574921 --> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfb1698030 con 0x55cfb172f060 2024-09-11T22:22:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.117+0000 7f1feaffd640 1 --2- 172.21.15.50:0/273574921 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55cfb172f060 0x55cfb172f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.118+0000 7f1feaffd640 1 --2- 172.21.15.50:0/273574921 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55cfb172f060 0x55cfb172f4b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cec8340638a5ea7 server_cookie=60479f107b1da7d in_seq=0 out_seq=0 2024-09-11T22:22:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.118+0000 7f1fca7fc640 10 client.10503 ms_handle_connect on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.118+0000 7f1fca7fc640 1 -- 172.21.15.50:0/273574921 <== mds.0 v2:172.21.15.50:6834/4092595783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cfb1698030 con 0x55cfb172f060 2024-09-11T22:22:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.118+0000 7f1fca7fc640 10 client.10503 handle_command_reply: tid=0 2024-09-11T22:22:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.118+0000 7f1ff47ed740 1 client.10503 shutdown 2024-09-11T22:22:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.118+0000 7f1ff47ed740 1 -- 172.21.15.50:0/273574921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 msgr2=0x55cfb1715190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.118+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/273574921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 0x55cfb1715190 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00090b0 tx=0x7f1fe0004730 comp rx=0 tx=0).stop 2024-09-11T22:22:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.118+0000 7f1ff47ed740 1 -- 172.21.15.50:0/273574921 shutdown_connections 2024-09-11T22:22:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.118+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/273574921 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55cfb172f060 0x55cfb172f4b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.118+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/273574921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb1718570 0x55cfb1715c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.118+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/273574921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 0x55cfb1715190 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.118+0000 7f1fca7fc640 0 client.10503 ms_handle_reset on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.118+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/273574921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb172c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.119+0000 7f1ff47ed740 1 -- 172.21.15.50:0/273574921 >> 172.21.15.50:0/273574921 conn(0x55cfb171ad90 msgr2=0x55cfb16fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.119+0000 7f1ff47ed740 1 -- 172.21.15.50:0/273574921 shutdown_connections 2024-09-11T22:22:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.119+0000 7f1ff47ed740 1 -- 172.21.15.50:0/273574921 wait complete. 2024-09-11T22:22:44.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.119+0000 7f1ff47ed740 20 client.10503 trim_cache size 0 max 16384 2024-09-11T22:22:44.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.132+0000 7f1ff47ed740 1 Processor -- start 2024-09-11T22:22:44.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.132+0000 7f1ff47ed740 1 -- start start 2024-09-11T22:22:44.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1ff47ed740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb1718570 0x55cfb171e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1ff47ed740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb16d67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1ff47ed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 0x55cfb171ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1ff47ed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec200b50 con 0x55cfb171d5d0 2024-09-11T22:22:44.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1ff47ed740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec150b20 con 0x55cfb171b1f0 2024-09-11T22:22:44.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1ff47ed740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec14fe80 con 0x55cfb1718570 2024-09-11T22:22:44.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1feb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 0x55cfb171ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1feb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 0x55cfb171ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45788/0 (socket says 172.21.15.50:45788) 2024-09-11T22:22:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1feb7fe640 1 -- 172.21.15.50:0/2276053059 learned_addr learned my addr 172.21.15.50:0/2276053059 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1feaffd640 1 --2- 172.21.15.50:0/2276053059 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb1718570 0x55cfb171e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/2276053059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb16d67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1feb7fe640 1 -- 172.21.15.50:0/2276053059 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb1718570 msgr2=0x55cfb171e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1feb7fe640 1 --2- 172.21.15.50:0/2276053059 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb1718570 0x55cfb171e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1feb7fe640 1 -- 172.21.15.50:0/2276053059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 msgr2=0x55cfb16d67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1feb7fe640 1 --2- 172.21.15.50:0/2276053059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb16d67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1feb7fe640 1 -- 172.21.15.50:0/2276053059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb171dd20 con 0x55cfb171d5d0 2024-09-11T22:22:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/2276053059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb16d67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1feb7fe640 1 --2- 172.21.15.50:0/2276053059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 0x55cfb171ed00 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4008f30 tx=0x7f1fe400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bad1091ef83db05 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1fd0ff9640 1 -- 172.21.15.50:0/2276053059 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400a810 con 0x55cfb171d5d0 2024-09-11T22:22:44.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1fd0ff9640 1 -- 172.21.15.50:0/2276053059 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe401c070 con 0x55cfb171d5d0 2024-09-11T22:22:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.133+0000 7f1fd0ff9640 1 -- 172.21.15.50:0/2276053059 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400abb0 con 0x55cfb171d5d0 2024-09-11T22:22:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.134+0000 7f1ff47ed740 1 -- 172.21.15.50:0/2276053059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 msgr2=0x55cfb171ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.134+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/2276053059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 0x55cfb171ed00 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4008f30 tx=0x7f1fe400c8b0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.134+0000 7f1ff47ed740 1 -- 172.21.15.50:0/2276053059 shutdown_connections 2024-09-11T22:22:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.134+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/2276053059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171d5d0 0x55cfb171ed00 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.134+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/2276053059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb171b1f0 0x55cfb16d67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.134+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/2276053059 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb1718570 0x55cfb171e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.134+0000 7f1ff47ed740 1 -- 172.21.15.50:0/2276053059 >> 172.21.15.50:0/2276053059 conn(0x55cfb171ad90 msgr2=0x55cfb1735930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.134+0000 7f1ff47ed740 1 -- 172.21.15.50:0/2276053059 shutdown_connections 2024-09-11T22:22:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.134+0000 7f1ff47ed740 1 -- 172.21.15.50:0/2276053059 wait complete. 2024-09-11T22:22:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.135+0000 7f1ff47ed740 1 -- start start 2024-09-11T22:22:44.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.135+0000 7f1ff47ed740 1 Processor -- start 2024-09-11T22:22:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.135+0000 7f1ff47ed740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb1718570 0x55cfb177f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1ff47ed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171b1f0 0x55cfb1715000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1ff47ed740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb171d5d0 0x55cfb172be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1ff47ed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cfb1735470 con 0x55cfb171b1f0 2024-09-11T22:22:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1ff47ed740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec1504d0 con 0x55cfb1718570 2024-09-11T22:22:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1ff47ed740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cfb14af940 con 0x55cfb171d5d0 2024-09-11T22:22:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1ff47ed740 10 client.0 _ll_register_callbacks cb 0x7f1fe00096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1fea7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171b1f0 0x55cfb1715000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1fea7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171b1f0 0x55cfb1715000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45792/0 (socket says 172.21.15.50:45792) 2024-09-11T22:22:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1fea7fc640 1 -- 172.21.15.50:0/2685092385 learned_addr learned my addr 172.21.15.50:0/2685092385 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1feaffd640 1 --2- 172.21.15.50:0/2685092385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb1718570 0x55cfb177f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1feb7fe640 1 --2- 172.21.15.50:0/2685092385 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb171d5d0 0x55cfb172be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1fea7fc640 1 -- 172.21.15.50:0/2685092385 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb171d5d0 msgr2=0x55cfb172be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/2685092385 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb171d5d0 0x55cfb172be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1fea7fc640 1 -- 172.21.15.50:0/2685092385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb1718570 msgr2=0x55cfb177f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/2685092385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb1718570 0x55cfb177f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1fea7fc640 1 -- 172.21.15.50:0/2685092385 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfb172b850 con 0x55cfb171b1f0 2024-09-11T22:22:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1fea7fc640 1 --2- 172.21.15.50:0/2685092385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171b1f0 0x55cfb1715000 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009380 tx=0x7f1fe0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7276a337cf6653 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1fca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1fca7fc640 1 -- 172.21.15.50:0/2685092385 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe004e040 con 0x55cfb171b1f0 2024-09-11T22:22:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1fca7fc640 1 -- 172.21.15.50:0/2685092385 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f1fe0032e00 con 0x55cfb171b1f0 2024-09-11T22:22:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1ff47ed740 1 -- 172.21.15.50:0/2685092385 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fe401c070 con 0x55cfb171b1f0 2024-09-11T22:22:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1fca7fc640 1 -- 172.21.15.50:0/2685092385 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f1fe0037040 con 0x55cfb171b1f0 2024-09-11T22:22:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1ff47ed740 10 client.10509 fetch_fsmap learned FSMap version 130 2024-09-11T22:22:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.136+0000 7f1ff47ed740 1 -- 172.21.15.50:0/2685092385 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55cfb16fc090 con 0x55cfb171b1f0 2024-09-11T22:22:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1fca7fc640 1 -- 172.21.15.50:0/2685092385 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe401c070 con 0x55cfb171b1f0 2024-09-11T22:22:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1fca7fc640 1 -- 172.21.15.50:0/2685092385 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7f1fe005b040 con 0x55cfb171b1f0 2024-09-11T22:22:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 10 client.10509 fetch_fsmap finished waiting for FSMap version 130 2024-09-11T22:22:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 10 client.10509 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-11T22:22:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 20 client.10509 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/2685092385 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55cfb1715540 0x55cfb172c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 4 client.10509 mds_command: new command op to 10320 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:22:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 1 -- 172.21.15.50:0/2685092385 --> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cfb1646d00 con 0x55cfb1715540 2024-09-11T22:22:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1feaffd640 1 --2- 172.21.15.50:0/2685092385 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55cfb1715540 0x55cfb172c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1feaffd640 1 --2- 172.21.15.50:0/2685092385 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55cfb1715540 0x55cfb172c350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26829923f61e5b35 server_cookie=81dfc63e0d2358af in_seq=0 out_seq=0 2024-09-11T22:22:44.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1fca7fc640 10 client.10509 ms_handle_connect on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1fca7fc640 1 -- 172.21.15.50:0/2685092385 <== mds.0 v2:172.21.15.50:6834/4092595783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cfb1646d00 con 0x55cfb1715540 2024-09-11T22:22:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1fca7fc640 10 client.10509 handle_command_reply: tid=0 2024-09-11T22:22:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 1 client.10509 shutdown 2024-09-11T22:22:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 1 -- 172.21.15.50:0/2685092385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171b1f0 msgr2=0x55cfb1715000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/2685092385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171b1f0 0x55cfb1715000 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009380 tx=0x7f1fe0008030 comp rx=0 tx=0).stop 2024-09-11T22:22:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 1 -- 172.21.15.50:0/2685092385 shutdown_connections 2024-09-11T22:22:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/2685092385 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55cfb1715540 0x55cfb172c350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/2685092385 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cfb171d5d0 0x55cfb172be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/2685092385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfb171b1f0 0x55cfb1715000 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1fca7fc640 0 client.10509 ms_handle_reset on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 1 --2- 172.21.15.50:0/2685092385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cfb1718570 0x55cfb177f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.137+0000 7f1ff47ed740 1 -- 172.21.15.50:0/2685092385 >> 172.21.15.50:0/2685092385 conn(0x55cfb171ad90 msgr2=0x55cfb16d67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff47ed740 1 -- 172.21.15.50:0/2685092385 shutdown_connections 2024-09-11T22:22:44.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff47ed740 1 -- 172.21.15.50:0/2685092385 wait complete. 2024-09-11T22:22:44.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff47ed740 20 client.10509 trim_cache size 0 max 16384 2024-09-11T22:22:44.145 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-11T22:22:44.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff1976640 1 -- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1fd806be30 msgr2=0x7f1fd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff1976640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1fd806be30 0x7f1fd806e2f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0034000 tx=0x7f1fe002e000 comp rx=0 tx=0).stop 2024-09-11T22:22:44.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff1976640 1 -- 172.21.15.50:0/3441515098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fec0d16d0 msgr2=0x7f1fec14dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff1976640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fec0d16d0 0x7f1fec14dc00 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00d5f0 tx=0x7f1fdc00dab0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff1976640 1 -- 172.21.15.50:0/3441515098 shutdown_connections 2024-09-11T22:22:44.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff1976640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f1fd806be30 0x7f1fd806e2f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff1976640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1fec0d3a30 0x7f1fec14e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff1976640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fec15e870 0x7f1fec0cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff1976640 1 --2- 172.21.15.50:0/3441515098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fec0d16d0 0x7f1fec14dc00 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff1976640 1 -- 172.21.15.50:0/3441515098 >> 172.21.15.50:0/3441515098 conn(0x7f1fec0727a0 msgr2=0x7f1fec15f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff1976640 1 -- 172.21.15.50:0/3441515098 shutdown_connections 2024-09-11T22:22:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.138+0000 7f1ff1976640 1 -- 172.21.15.50:0/3441515098 wait complete. 2024-09-11T22:22:44.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T22:22:44.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.251+0000 7f923950a640 1 Processor -- start 2024-09-11T22:22:44.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.251+0000 7f923950a640 1 -- start start 2024-09-11T22:22:44.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.252+0000 7f923950a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f92341463b0 0x7f92340cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.252+0000 7f923950a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92340ce0e0 0x7f92340b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.252+0000 7f923950a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9234072630 con 0x7f923415db60 2024-09-11T22:22:44.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.252+0000 7f923950a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f92340d0670 con 0x7f92340ce0e0 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.252+0000 7f923950a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9234146790 con 0x7f92341463b0 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.252+0000 7f92337fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92340ce0e0 0x7f92340b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.252+0000 7f92337fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92340ce0e0 0x7f92340b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45798/0 (socket says 172.21.15.50:45798) 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.252+0000 7f92337fe640 1 -- 172.21.15.50:0/3216899881 learned_addr learned my addr 172.21.15.50:0/3216899881 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.252+0000 7f9232ffd640 1 --2- 172.21.15.50:0/3216899881 >> v2:172.21.15.77:3300/0 conn(0x7f92341463b0 0x7f92340cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.252+0000 7f92337fe640 1 -- 172.21.15.50:0/3216899881 >> v2:172.21.15.77:3300/0 conn(0x7f92341463b0 msgr2=0x7f92340cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.252+0000 7f92337fe640 1 --2- 172.21.15.50:0/3216899881 >> v2:172.21.15.77:3300/0 conn(0x7f92341463b0 0x7f92340cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.252+0000 7f92337fe640 1 -- 172.21.15.50:0/3216899881 >> v1:172.21.15.77:6789/0 conn(0x7f923415db60 legacy=0x7f92340cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.252+0000 7f92337fe640 1 -- 172.21.15.50:0/3216899881 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92340728d0 con 0x7f92340ce0e0 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.253+0000 7f92337fe640 1 --2- 172.21.15.50:0/3216899881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92340ce0e0 0x7f92340b3990 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f92340b35b0 tx=0x7f922c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9cf064006419a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.253+0000 7f9231ffb640 1 -- 172.21.15.50:0/3216899881 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c036070 con 0x7f92340ce0e0 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.253+0000 7f9231ffb640 1 -- 172.21.15.50:0/3216899881 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c031600 con 0x7f92340ce0e0 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.253+0000 7f9231ffb640 1 -- 172.21.15.50:0/3216899881 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c0319d0 con 0x7f92340ce0e0 2024-09-11T22:22:44.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.254+0000 7f923950a640 1 -- 172.21.15.50:0/3216899881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92340ce0e0 msgr2=0x7f92340b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.254+0000 7f923950a640 1 --2- 172.21.15.50:0/3216899881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92340ce0e0 0x7f92340b3990 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f92340b35b0 tx=0x7f922c02a730 comp rx=0 tx=0).stop 2024-09-11T22:22:44.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.254+0000 7f923950a640 1 -- 172.21.15.50:0/3216899881 shutdown_connections 2024-09-11T22:22:44.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.254+0000 7f923950a640 1 --2- 172.21.15.50:0/3216899881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92340ce0e0 0x7f92340b3990 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.254+0000 7f923950a640 1 --2- 172.21.15.50:0/3216899881 >> v2:172.21.15.77:3300/0 conn(0x7f92341463b0 0x7f92340cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.254+0000 7f923950a640 1 -- 172.21.15.50:0/3216899881 >> 172.21.15.50:0/3216899881 conn(0x7f9234068240 msgr2=0x7f92340b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.254+0000 7f923950a640 1 -- 172.21.15.50:0/3216899881 shutdown_connections 2024-09-11T22:22:44.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.254+0000 7f923950a640 1 -- 172.21.15.50:0/3216899881 wait complete. 2024-09-11T22:22:44.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.255+0000 7f923950a640 1 Processor -- start 2024-09-11T22:22:44.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.255+0000 7f923950a640 1 -- start start 2024-09-11T22:22:44.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f923950a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92340ce0e0 0x7f92341415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f923950a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92341463b0 0x7f923415a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f923950a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923415db60 0x7f92341e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f923950a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f92340d0180 con 0x7f923415db60 2024-09-11T22:22:44.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f923950a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9234072f20 con 0x7f92340ce0e0 2024-09-11T22:22:44.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f923950a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f92340d0300 con 0x7f92341463b0 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f92337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923415db60 0x7f92341e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f92337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923415db60 0x7f92341e7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45810/0 (socket says 172.21.15.50:45810) 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f92337fe640 1 -- 172.21.15.50:0/345610105 learned_addr learned my addr 172.21.15.50:0/345610105 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f9232ffd640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92340ce0e0 0x7f92341415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f92327fc640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92341463b0 0x7f923415a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f92337fe640 1 -- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92341463b0 msgr2=0x7f923415a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f92337fe640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92341463b0 0x7f923415a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f92337fe640 1 -- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92340ce0e0 msgr2=0x7f92341415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f92337fe640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92340ce0e0 0x7f92341415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f92337fe640 1 -- 172.21.15.50:0/345610105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923415aa60 con 0x7f923415db60 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.256+0000 7f92337fe640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923415db60 0x7f92341e7d90 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f922c009f40 tx=0x7f922c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.257+0000 7f921b7fe640 1 -- 172.21.15.50:0/345610105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c036050 con 0x7f923415db60 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.257+0000 7f921b7fe640 1 -- 172.21.15.50:0/345610105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c042070 con 0x7f923415db60 2024-09-11T22:22:44.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.257+0000 7f921b7fe640 1 -- 172.21.15.50:0/345610105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c009510 con 0x7f923415db60 2024-09-11T22:22:44.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.257+0000 7f923950a640 1 -- 172.21.15.50:0/345610105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9234158b60 con 0x7f923415db60 2024-09-11T22:22:44.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.257+0000 7f923950a640 1 -- 172.21.15.50:0/345610105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9234159120 con 0x7f923415db60 2024-09-11T22:22:44.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.258+0000 7f923950a640 1 -- 172.21.15.50:0/345610105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92340733b0 con 0x7f923415db60 2024-09-11T22:22:44.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.258+0000 7f921b7fe640 1 -- 172.21.15.50:0/345610105 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f922c007bf0 con 0x7f923415db60 2024-09-11T22:22:44.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.259+0000 7f921b7fe640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f922006be30 0x7f922006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.259+0000 7f921b7fe640 1 -- 172.21.15.50:0/345610105 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f922c0ab9d0 con 0x7f923415db60 2024-09-11T22:22:44.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.259+0000 7f9232ffd640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f922006be30 0x7f922006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.260+0000 7f9232ffd640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f922006be30 0x7f922006e2f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f92341e8c30 tx=0x7f9224009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.263+0000 7f921b7fe640 1 -- 172.21.15.50:0/345610105 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f922c079dc0 con 0x7f923415db60 2024-09-11T22:22:44.316 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:22:44.319 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:22:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.477+0000 7f923950a640 1 -- 172.21.15.50:0/345610105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f92340b2b60 con 0x7f923415db60 2024-09-11T22:22:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.478+0000 7f921b7fe640 1 -- 172.21.15.50:0/345610105 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f922c07e0c0 con 0x7f923415db60 2024-09-11T22:22:44.479 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:22:44.479 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T22:22:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.480+0000 7f923950a640 1 -- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f922006be30 msgr2=0x7f922006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.480+0000 7f923950a640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f922006be30 0x7f922006e2f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f92341e8c30 tx=0x7f9224009190 comp rx=0 tx=0).stop 2024-09-11T22:22:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.480+0000 7f923950a640 1 -- 172.21.15.50:0/345610105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923415db60 msgr2=0x7f92341e7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.480+0000 7f923950a640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923415db60 0x7f92341e7d90 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f922c009f40 tx=0x7f922c004a40 comp rx=0 tx=0).stop 2024-09-11T22:22:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.480+0000 7f923950a640 1 -- 172.21.15.50:0/345610105 shutdown_connections 2024-09-11T22:22:44.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.480+0000 7f923950a640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f922006be30 0x7f922006e2f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.480+0000 7f923950a640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92341463b0 0x7f923415a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.480+0000 7f923950a640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923415db60 0x7f92341e7d90 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.480+0000 7f923950a640 1 --2- 172.21.15.50:0/345610105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92340ce0e0 0x7f92341415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.480+0000 7f923950a640 1 -- 172.21.15.50:0/345610105 >> 172.21.15.50:0/345610105 conn(0x7f9234068240 msgr2=0x7f923415cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.480+0000 7f923950a640 1 -- 172.21.15.50:0/345610105 shutdown_connections 2024-09-11T22:22:44.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.480+0000 7f923950a640 1 -- 172.21.15.50:0/345610105 wait complete. 2024-09-11T22:22:44.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:44.492 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub start '~mdsdir' recursive 2024-09-11T22:22:44.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.598+0000 7f238918d640 1 Processor -- start 2024-09-11T22:22:44.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.598+0000 7f238918d640 1 -- start start 2024-09-11T22:22:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.599+0000 7f238918d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2384161ea0 0x7f23840b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.599+0000 7f238918d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2384162280 con 0x7f238406ffb0 2024-09-11T22:22:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.599+0000 7f238918d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238406c700 con 0x7f238406f300 2024-09-11T22:22:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.599+0000 7f238918d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f238406c9e0 con 0x7f2384161ea0 2024-09-11T22:22:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.599+0000 7f2382d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2384161ea0 0x7f23840b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.599+0000 7f238359e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f238406ffb0 0x7f23840d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59918/0 (socket says 172.21.15.50:59918) 2024-09-11T22:22:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.599+0000 7f238359e640 1 -- 172.21.15.50:0/2282829580 learned_addr learned my addr 172.21.15.50:0/2282829580 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:44.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.599+0000 7f2382d9d640 1 -- 172.21.15.50:0/2282829580 >> v1:172.21.15.77:6789/0 conn(0x7f238406f300 legacy=0x7f238406f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.599+0000 7f2382d9d640 1 -- 172.21.15.50:0/2282829580 >> v1:172.21.15.50:6789/0 conn(0x7f238406ffb0 legacy=0x7f23840d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.599+0000 7f2382d9d640 1 -- 172.21.15.50:0/2282829580 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238406ccc0 con 0x7f2384161ea0 2024-09-11T22:22:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.599+0000 7f2381d9b640 1 -- 172.21.15.50:0/2282829580 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 703093911 0 0) 0x7f2384162280 con 0x7f238406ffb0 2024-09-11T22:22:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.600+0000 7f2382d9d640 1 --2- 172.21.15.50:0/2282829580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2384161ea0 0x7f23840b4c70 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f23740097a0 tx=0x7f237402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469c1057c57aced1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.600+0000 7f2381d9b640 1 -- 172.21.15.50:0/2282829580 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374037070 con 0x7f2384161ea0 2024-09-11T22:22:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.600+0000 7f2381d9b640 1 -- 172.21.15.50:0/2282829580 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237402ae50 con 0x7f2384161ea0 2024-09-11T22:22:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.600+0000 7f2381d9b640 1 -- 172.21.15.50:0/2282829580 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374032660 con 0x7f2384161ea0 2024-09-11T22:22:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.600+0000 7f238918d640 1 -- 172.21.15.50:0/2282829580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2384161ea0 msgr2=0x7f23840b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.600+0000 7f238918d640 1 --2- 172.21.15.50:0/2282829580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2384161ea0 0x7f23840b4c70 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f23740097a0 tx=0x7f237402a140 comp rx=0 tx=0).stop 2024-09-11T22:22:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.600+0000 7f238918d640 1 -- 172.21.15.50:0/2282829580 shutdown_connections 2024-09-11T22:22:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.600+0000 7f238918d640 1 --2- 172.21.15.50:0/2282829580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2384161ea0 0x7f23840b4c70 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.600+0000 7f238918d640 1 -- 172.21.15.50:0/2282829580 >> 172.21.15.50:0/2282829580 conn(0x7f23840b4150 msgr2=0x7f23840b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.601+0000 7f238918d640 1 -- 172.21.15.50:0/2282829580 shutdown_connections 2024-09-11T22:22:44.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.601+0000 7f238918d640 1 -- 172.21.15.50:0/2282829580 wait complete. 2024-09-11T22:22:44.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.602+0000 7f238918d640 1 Processor -- start 2024-09-11T22:22:44.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.602+0000 7f238918d640 1 -- start start 2024-09-11T22:22:44.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238918d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f238406f300 0x7f2384160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238918d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238406ffb0 0x7f23840c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238918d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2384161ea0 0x7f238415b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238918d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f238406d7a0 con 0x7f238406ffb0 2024-09-11T22:22:44.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238918d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f238406d280 con 0x7f238406f300 2024-09-11T22:22:44.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238918d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f238406d920 con 0x7f2384161ea0 2024-09-11T22:22:44.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238406ffb0 0x7f23840c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238406ffb0 0x7f23840c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45834/0 (socket says 172.21.15.50:45834) 2024-09-11T22:22:44.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238259c640 1 -- 172.21.15.50:0/193299057 learned_addr learned my addr 172.21.15.50:0/193299057 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238359e640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2384161ea0 0x7f238415b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f2382d9d640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f238406f300 0x7f2384160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238259c640 1 -- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2384161ea0 msgr2=0x7f238415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238259c640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2384161ea0 0x7f238415b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238259c640 1 -- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f238406f300 msgr2=0x7f2384160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238259c640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f238406f300 0x7f2384160570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238259c640 1 -- 172.21.15.50:0/193299057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23840c60a0 con 0x7f238406ffb0 2024-09-11T22:22:44.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f2382d9d640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f238406f300 0x7f2384160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:44.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f238259c640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238406ffb0 0x7f23840c78e0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f237800c440 tx=0x7f237800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.603+0000 7f236b7fe640 1 -- 172.21.15.50:0/193299057 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378017070 con 0x7f238406ffb0 2024-09-11T22:22:44.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.604+0000 7f236b7fe640 1 -- 172.21.15.50:0/193299057 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23780035f0 con 0x7f238406ffb0 2024-09-11T22:22:44.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.604+0000 7f238918d640 1 -- 172.21.15.50:0/193299057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23840c6340 con 0x7f238406ffb0 2024-09-11T22:22:44.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.604+0000 7f236b7fe640 1 -- 172.21.15.50:0/193299057 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23780039e0 con 0x7f238406ffb0 2024-09-11T22:22:44.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.604+0000 7f238918d640 1 -- 172.21.15.50:0/193299057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23840c6900 con 0x7f238406ffb0 2024-09-11T22:22:44.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.605+0000 7f236b7fe640 1 -- 172.21.15.50:0/193299057 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f237801a070 con 0x7f238406ffb0 2024-09-11T22:22:44.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.606+0000 7f236b7fe640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f237006be30 0x7f237006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.606+0000 7f236b7fe640 1 -- 172.21.15.50:0/193299057 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f237808a280 con 0x7f238406ffb0 2024-09-11T22:22:44.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.606+0000 7f2382d9d640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f237006be30 0x7f237006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.606+0000 7f2382d9d640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f237006be30 0x7f237006e2f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2374034000 tx=0x7f237402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.607+0000 7f238c006740 1 Processor -- start 2024-09-11T22:22:44.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.607+0000 7f238c006740 1 -- start start 2024-09-11T22:22:44.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f238c006740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 0x55e3659e08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f238c006740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659ddcc0 0x55e3659df850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f238c006740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f238c006740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e3658fcac0 con 0x55e3659e0500 2024-09-11T22:22:44.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f238c006740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e3658a47b0 con 0x55e3659ddcc0 2024-09-11T22:22:44.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f238c006740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e3658f8a80 con 0x55e3659de120 2024-09-11T22:22:44.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f2382d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 0x55e3659e08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f2382d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 0x55e3659e08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45838/0 (socket says 172.21.15.50:45838) 2024-09-11T22:22:44.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f2382d9d640 1 -- 172.21.15.50:0/2096017955 learned_addr learned my addr 172.21.15.50:0/2096017955 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f238259c640 1 --2- 172.21.15.50:0/2096017955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659ddcc0 0x55e3659df850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f238359e640 1 --2- 172.21.15.50:0/2096017955 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f2382d9d640 1 -- 172.21.15.50:0/2096017955 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 msgr2=0x55e3659c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f2382d9d640 1 --2- 172.21.15.50:0/2096017955 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659c0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f2382d9d640 1 -- 172.21.15.50:0/2096017955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659ddcc0 msgr2=0x55e3659df850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f2382d9d640 1 --2- 172.21.15.50:0/2096017955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659ddcc0 0x55e3659df850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f2382d9d640 1 -- 172.21.15.50:0/2096017955 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3656dba20 con 0x55e3659e0500 2024-09-11T22:22:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f2382d9d640 1 --2- 172.21.15.50:0/2096017955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 0x55e3659e08e0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f237402a730 tx=0x7f237402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6a11fe9de02684 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f2368ff9640 1 -- 172.21.15.50:0/2096017955 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237404e070 con 0x55e3659e0500 2024-09-11T22:22:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f2368ff9640 1 -- 172.21.15.50:0/2096017955 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2374032d70 con 0x55e3659e0500 2024-09-11T22:22:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.608+0000 7f2368ff9640 1 -- 172.21.15.50:0/2096017955 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374037040 con 0x55e3659e0500 2024-09-11T22:22:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.609+0000 7f238c006740 1 -- 172.21.15.50:0/2096017955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 msgr2=0x55e3659e08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.609+0000 7f238c006740 1 --2- 172.21.15.50:0/2096017955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 0x55e3659e08e0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f237402a730 tx=0x7f237402c000 comp rx=0 tx=0).stop 2024-09-11T22:22:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.609+0000 7f238c006740 1 -- 172.21.15.50:0/2096017955 shutdown_connections 2024-09-11T22:22:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.609+0000 7f238c006740 1 --2- 172.21.15.50:0/2096017955 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.609+0000 7f238c006740 1 --2- 172.21.15.50:0/2096017955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659ddcc0 0x55e3659df850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.609+0000 7f238c006740 1 --2- 172.21.15.50:0/2096017955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 0x55e3659e08e0 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.609+0000 7f238c006740 1 -- 172.21.15.50:0/2096017955 >> 172.21.15.50:0/2096017955 conn(0x55e365996160 msgr2=0x55e3659de570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.609+0000 7f238c006740 1 -- 172.21.15.50:0/2096017955 shutdown_connections 2024-09-11T22:22:44.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.609+0000 7f238c006740 1 -- 172.21.15.50:0/2096017955 wait complete. 2024-09-11T22:22:44.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.610+0000 7f238c006740 1 -- start start 2024-09-11T22:22:44.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.610+0000 7f238c006740 1 Processor -- start 2024-09-11T22:22:44.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238c006740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659ee700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238c006740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659e0500 0x55e3659eec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238c006740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 0x55e3659da180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238c006740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e3659dcc20 con 0x55e3659d5640 2024-09-11T22:22:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238c006740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e3658857b0 con 0x55e3659e0500 2024-09-11T22:22:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238c006740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e3659dcf00 con 0x55e3659de120 2024-09-11T22:22:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238c006740 10 client.0 _ll_register_callbacks cb 0x55e36560ee00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 0x55e3659da180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 0x55e3659da180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45844/0 (socket says 172.21.15.50:45844) 2024-09-11T22:22:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238359e640 1 -- 172.21.15.50:0/1832560991 learned_addr learned my addr 172.21.15.50:0/1832560991 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f2382d9d640 1 --2- 172.21.15.50:0/1832560991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238259c640 1 --2- 172.21.15.50:0/1832560991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659e0500 0x55e3659eec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238359e640 1 -- 172.21.15.50:0/1832560991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 msgr2=0x55e3659ee700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238359e640 1 --2- 172.21.15.50:0/1832560991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659ee700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238359e640 1 -- 172.21.15.50:0/1832560991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659e0500 msgr2=0x55e3659eec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238359e640 1 --2- 172.21.15.50:0/1832560991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659e0500 0x55e3659eec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238359e640 1 -- 172.21.15.50:0/1832560991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3655cf310 con 0x55e3659d5640 2024-09-11T22:22:44.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238359e640 1 --2- 172.21.15.50:0/1832560991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 0x55e3659da180 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f237c007380 tx=0x7f237c007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607520a251900003 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f2361ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:44.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f2361ffb640 1 -- 172.21.15.50:0/1832560991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c018030 con 0x55e3659d5640 2024-09-11T22:22:44.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f2361ffb640 1 -- 172.21.15.50:0/1832560991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f237c0107c0 con 0x55e3659d5640 2024-09-11T22:22:44.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.611+0000 7f238c006740 1 -- 172.21.15.50:0/1832560991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2374032d70 con 0x55e3659d5640 2024-09-11T22:22:44.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f2361ffb640 1 -- 172.21.15.50:0/1832560991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f237c021050 con 0x55e3659d5640 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f238c006740 10 client.10530 fetch_fsmap learned FSMap version 130 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f238c006740 1 -- 172.21.15.50:0/1832560991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55e36573c1b0 con 0x55e3659d5640 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f2361ffb640 1 -- 172.21.15.50:0/1832560991 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2374032d70 con 0x55e3659d5640 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f2361ffb640 1 -- 172.21.15.50:0/1832560991 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7f237c024020 con 0x55e3659d5640 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f238c006740 10 client.10530 fetch_fsmap finished waiting for FSMap version 130 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f238c006740 10 client.10530 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f238c006740 20 client.10530 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f238c006740 1 --2- 172.21.15.50:0/1832560991 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55e3659d7ef0 0x55e3659d82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f238c006740 4 client.10530 mds_command: new command op to 10320 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f238c006740 1 -- 172.21.15.50:0/1832560991 --> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e36590a1f0 con 0x55e3659d7ef0 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f2382d9d640 1 --2- 172.21.15.50:0/1832560991 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55e3659d7ef0 0x55e3659d82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f2382d9d640 1 --2- 172.21.15.50:0/1832560991 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55e3659d7ef0 0x55e3659d82d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65f5ecfc515d25ac server_cookie=9ad7c180aa655caa in_seq=0 out_seq=0 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.612+0000 7f2361ffb640 10 client.10530 ms_handle_connect on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:44.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f2361ffb640 1 -- 172.21.15.50:0/1832560991 <== mds.0 v2:172.21.15.50:6834/4092595783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e36590a1f0 con 0x55e3659d7ef0 2024-09-11T22:22:44.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f2361ffb640 10 client.10530 handle_command_reply: tid=0 2024-09-11T22:22:44.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f238c006740 1 client.10530 shutdown 2024-09-11T22:22:44.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f238c006740 1 -- 172.21.15.50:0/1832560991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 msgr2=0x55e3659da180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f238c006740 1 --2- 172.21.15.50:0/1832560991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 0x55e3659da180 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f237c007380 tx=0x7f237c007840 comp rx=0 tx=0).stop 2024-09-11T22:22:44.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f238c006740 1 -- 172.21.15.50:0/1832560991 shutdown_connections 2024-09-11T22:22:44.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f238c006740 1 --2- 172.21.15.50:0/1832560991 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55e3659d7ef0 0x55e3659d82d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f238c006740 1 --2- 172.21.15.50:0/1832560991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 0x55e3659da180 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f238c006740 1 --2- 172.21.15.50:0/1832560991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659e0500 0x55e3659eec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f2361ffb640 0 client.10530 ms_handle_reset on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:44.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f238c006740 1 --2- 172.21.15.50:0/1832560991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f238c006740 1 -- 172.21.15.50:0/1832560991 >> 172.21.15.50:0/1832560991 conn(0x55e3659ddcc0 msgr2=0x55e3659e0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f238c006740 1 -- 172.21.15.50:0/1832560991 shutdown_connections 2024-09-11T22:22:44.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f238c006740 1 -- 172.21.15.50:0/1832560991 wait complete. 2024-09-11T22:22:44.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.613+0000 7f238c006740 20 client.10530 trim_cache size 0 max 16384 2024-09-11T22:22:44.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.631+0000 7f238c006740 1 Processor -- start 2024-09-11T22:22:44.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.631+0000 7f238c006740 1 -- start start 2024-09-11T22:22:44.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.631+0000 7f238c006740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 0x55e3659de7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.631+0000 7f238c006740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659d76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f238c006740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659e0500 0x55e3659bff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f238c006740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2384200be0 con 0x55e3659d5640 2024-09-11T22:22:44.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f238c006740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f23841ffc80 con 0x55e3659e0500 2024-09-11T22:22:44.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f238c006740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f23840b5db0 con 0x55e3659de120 2024-09-11T22:22:44.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f2382d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 0x55e3659de7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f2382d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 0x55e3659de7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45850/0 (socket says 172.21.15.50:45850) 2024-09-11T22:22:44.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f2382d9d640 1 -- 172.21.15.50:0/3218740035 learned_addr learned my addr 172.21.15.50:0/3218740035 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f2382d9d640 1 -- 172.21.15.50:0/3218740035 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 msgr2=0x55e3659d76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f2382d9d640 1 --2- 172.21.15.50:0/3218740035 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659d76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f2382d9d640 1 -- 172.21.15.50:0/3218740035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659e0500 msgr2=0x55e3659bff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f2382d9d640 1 --2- 172.21.15.50:0/3218740035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659e0500 0x55e3659bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f2382d9d640 1 -- 172.21.15.50:0/3218740035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3659da4f0 con 0x55e3659d5640 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f2382d9d640 1 --2- 172.21.15.50:0/3218740035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 0x55e3659de7e0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f23740097a0 tx=0x7f2374009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c21786282a696 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f2363fff640 1 -- 172.21.15.50:0/3218740035 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237404e040 con 0x55e3659d5640 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f2363fff640 1 -- 172.21.15.50:0/3218740035 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237403c740 con 0x55e3659d5640 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.632+0000 7f2363fff640 1 -- 172.21.15.50:0/3218740035 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374037040 con 0x55e3659d5640 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.633+0000 7f238c006740 1 -- 172.21.15.50:0/3218740035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 msgr2=0x55e3659de7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.633+0000 7f238c006740 1 --2- 172.21.15.50:0/3218740035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 0x55e3659de7e0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f23740097a0 tx=0x7f2374009190 comp rx=0 tx=0).stop 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.633+0000 7f238c006740 1 -- 172.21.15.50:0/3218740035 shutdown_connections 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.633+0000 7f238c006740 1 --2- 172.21.15.50:0/3218740035 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659d76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.633+0000 7f238c006740 1 --2- 172.21.15.50:0/3218740035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659e0500 0x55e3659bff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.633+0000 7f238c006740 1 --2- 172.21.15.50:0/3218740035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659d5640 0x55e3659de7e0 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.633+0000 7f238c006740 1 -- 172.21.15.50:0/3218740035 >> 172.21.15.50:0/3218740035 conn(0x55e3659ddcc0 msgr2=0x55e3659d6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.633+0000 7f238c006740 1 -- 172.21.15.50:0/3218740035 shutdown_connections 2024-09-11T22:22:44.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.633+0000 7f238c006740 1 -- 172.21.15.50:0/3218740035 wait complete. 2024-09-11T22:22:44.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.633+0000 7f238c006740 1 -- start start 2024-09-11T22:22:44.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.633+0000 7f238c006740 1 Processor -- start 2024-09-11T22:22:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.634+0000 7f238c006740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659d5640 0x55e365a5c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.634+0000 7f238c006740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659fdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.634+0000 7f238c006740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 0x55e3659fe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.634+0000 7f238c006740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e3659d7be0 con 0x55e3659e0500 2024-09-11T22:22:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.634+0000 7f238c006740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f23840b6400 con 0x55e3659d5640 2024-09-11T22:22:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.634+0000 7f238c006740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e3659d97a0 con 0x55e3659de120 2024-09-11T22:22:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.634+0000 7f238c006740 10 client.0 _ll_register_callbacks cb 0x7f237c005dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.634+0000 7f238359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 0x55e3659fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.634+0000 7f238359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 0x55e3659fe090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45852/0 (socket says 172.21.15.50:45852) 2024-09-11T22:22:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.634+0000 7f238359e640 1 -- 172.21.15.50:0/3858163024 learned_addr learned my addr 172.21.15.50:0/3858163024 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.634+0000 7f238259c640 1 --2- 172.21.15.50:0/3858163024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659fdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.634+0000 7f2382d9d640 1 --2- 172.21.15.50:0/3858163024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659d5640 0x55e365a5c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238359e640 1 -- 172.21.15.50:0/3858163024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 msgr2=0x55e3659fdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238359e640 1 --2- 172.21.15.50:0/3858163024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659fdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238359e640 1 -- 172.21.15.50:0/3858163024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659d5640 msgr2=0x55e365a5c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238359e640 1 --2- 172.21.15.50:0/3858163024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659d5640 0x55e365a5c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238359e640 1 -- 172.21.15.50:0/3858163024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3655a83d0 con 0x55e3659e0500 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238359e640 1 --2- 172.21.15.50:0/3858163024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 0x55e3659fe090 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f237c007880 tx=0x7f237c001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fdf6b558aa8a0e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f2361ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f2361ffb640 1 -- 172.21.15.50:0/3858163024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c018070 con 0x55e3659e0500 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f2361ffb640 1 -- 172.21.15.50:0/3858163024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f237c01d640 con 0x55e3659e0500 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238c006740 1 -- 172.21.15.50:0/3858163024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f237403c740 con 0x55e3659e0500 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f2361ffb640 1 -- 172.21.15.50:0/3858163024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f237c031050 con 0x55e3659e0500 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238c006740 10 client.10536 fetch_fsmap learned FSMap version 130 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238c006740 1 -- 172.21.15.50:0/3858163024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55e365a01270 con 0x55e3659e0500 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f2361ffb640 1 -- 172.21.15.50:0/3858163024 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237403c740 con 0x55e3659e0500 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f2361ffb640 1 -- 172.21.15.50:0/3858163024 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7f237c034020 con 0x55e3659e0500 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238c006740 10 client.10536 fetch_fsmap finished waiting for FSMap version 130 2024-09-11T22:22:44.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238c006740 10 client.10536 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-11T22:22:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238c006740 20 client.10536 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238c006740 1 --2- 172.21.15.50:0/3858163024 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55e3659c3ca0 0x55e3659e15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238c006740 4 client.10536 mds_command: new command op to 10320 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-11T22:22:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.635+0000 7f238c006740 1 -- 172.21.15.50:0/3858163024 --> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x55e365904540 con 0x55e3659c3ca0 2024-09-11T22:22:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.636+0000 7f2382d9d640 1 --2- 172.21.15.50:0/3858163024 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55e3659c3ca0 0x55e3659e15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.636+0000 7f2361ffb640 10 client.10536 ms_handle_connect on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.636+0000 7f2382d9d640 1 --2- 172.21.15.50:0/3858163024 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55e3659c3ca0 0x55e3659e15d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b6f1affc8ef2bcb server_cookie=319f92027fd8326c in_seq=0 out_seq=0 2024-09-11T22:22:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.636+0000 7f2361ffb640 1 -- 172.21.15.50:0/3858163024 <== mds.0 v2:172.21.15.50:6834/4092595783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e365904540 con 0x55e3659c3ca0 2024-09-11T22:22:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.636+0000 7f2361ffb640 10 client.10536 handle_command_reply: tid=0 2024-09-11T22:22:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.636+0000 7f238c006740 1 client.10536 shutdown 2024-09-11T22:22:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.636+0000 7f238c006740 1 -- 172.21.15.50:0/3858163024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 msgr2=0x55e3659fe090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.636+0000 7f238c006740 1 --2- 172.21.15.50:0/3858163024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 0x55e3659fe090 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f237c007880 tx=0x7f237c001770 comp rx=0 tx=0).stop 2024-09-11T22:22:44.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238c006740 1 -- 172.21.15.50:0/3858163024 shutdown_connections 2024-09-11T22:22:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238c006740 1 --2- 172.21.15.50:0/3858163024 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55e3659c3ca0 0x55e3659e15d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238c006740 1 --2- 172.21.15.50:0/3858163024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e3659de120 0x55e3659fdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238c006740 1 --2- 172.21.15.50:0/3858163024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3659e0500 0x55e3659fe090 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f2361ffb640 0 client.10536 ms_handle_reset on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238c006740 1 --2- 172.21.15.50:0/3858163024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e3659d5640 0x55e365a5c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238c006740 1 -- 172.21.15.50:0/3858163024 >> 172.21.15.50:0/3858163024 conn(0x55e3659ddcc0 msgr2=0x55e365999f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238c006740 1 -- 172.21.15.50:0/3858163024 shutdown_connections 2024-09-11T22:22:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238c006740 1 -- 172.21.15.50:0/3858163024 wait complete. 2024-09-11T22:22:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238c006740 20 client.10536 trim_cache size 0 max 16384 2024-09-11T22:22:44.643 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:22:44.643 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:22:44.644 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "a92098d0-992b-464e-8d6c-3c9659317bb1", 2024-09-11T22:22:44.644 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:22:44.644 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:22:44.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238918d640 1 -- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f237006be30 msgr2=0x7f237006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238918d640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f237006be30 0x7f237006e2f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2374034000 tx=0x7f237402e000 comp rx=0 tx=0).stop 2024-09-11T22:22:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238918d640 1 -- 172.21.15.50:0/193299057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238406ffb0 msgr2=0x7f23840c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238918d640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238406ffb0 0x7f23840c78e0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f237800c440 tx=0x7f237800c900 comp rx=0 tx=0).stop 2024-09-11T22:22:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238918d640 1 -- 172.21.15.50:0/193299057 shutdown_connections 2024-09-11T22:22:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238918d640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f237006be30 0x7f237006e2f0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238918d640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2384161ea0 0x7f238415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238918d640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f238406ffb0 0x7f23840c78e0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238918d640 1 --2- 172.21.15.50:0/193299057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f238406f300 0x7f2384160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238918d640 1 -- 172.21.15.50:0/193299057 >> 172.21.15.50:0/193299057 conn(0x7f23840b4150 msgr2=0x7f23840af640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238918d640 1 -- 172.21.15.50:0/193299057 shutdown_connections 2024-09-11T22:22:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.637+0000 7f238918d640 1 -- 172.21.15.50:0/193299057 wait complete. 2024-09-11T22:22:44.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:22:44.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-11T22:22:44.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.753+0000 7fa4b6f98640 1 Processor -- start 2024-09-11T22:22:44.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.753+0000 7fa4b6f98640 1 -- start start 2024-09-11T22:22:44.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.754+0000 7fa4b6f98640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4b015e870 0x7fa4b00d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.754+0000 7fa4b6f98640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa4b00d3c00 0x7fa4b00b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.754+0000 7fa4b6f98640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b00cfa80 con 0x7fa4b00d16d0 2024-09-11T22:22:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.754+0000 7fa4b6f98640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b00d1b10 con 0x7fa4b00d3c00 2024-09-11T22:22:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.754+0000 7fa4b6f98640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b00d40d0 con 0x7fa4b015e870 2024-09-11T22:22:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.754+0000 7fa4affff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa4b00d16d0 0x7fa4b00d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59920/0 (socket says 172.21.15.50:59920) 2024-09-11T22:22:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.754+0000 7fa4affff640 1 -- 172.21.15.50:0/630010387 learned_addr learned my addr 172.21.15.50:0/630010387 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:22:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/630010387 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4b015e870 0x7fa4b00d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2483482038 0 0) 0x7fa4a4001110 con 0x7fa4b00d16d0 2024-09-11T22:22:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa498003520 con 0x7fa4b00d16d0 2024-09-11T22:22:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4b5535640 1 --2- 172.21.15.50:0/630010387 >> v2:172.21.15.77:3300/0 conn(0x7fa4b00d3c00 0x7fa4b00b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3804201325 0 0) 0x7fa498003520 con 0x7fa4b00d16d0 2024-09-11T22:22:44.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4b015e870 msgr2=0x7fa4b00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 --2- 172.21.15.50:0/630010387 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4b015e870 0x7fa4b00d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 >> v2:172.21.15.77:3300/0 conn(0x7fa4b00d3c00 msgr2=0x7fa4b00b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 --2- 172.21.15.50:0/630010387 >> v2:172.21.15.77:3300/0 conn(0x7fa4b00d3c00 0x7fa4b00b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b00d43b0 con 0x7fa4b00d16d0 2024-09-11T22:22:44.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fa4a4001860 con 0x7fa4b00d16d0 2024-09-11T22:22:44.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 >> v1:172.21.15.50:6789/0 conn(0x7fa4b00d16d0 legacy=0x7fa4b00d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 --2- 172.21.15.50:0/630010387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4980039b0 0x7fa498003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 --2- 172.21.15.50:0/630010387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa498004800 0x7fa498004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 --2- 172.21.15.50:0/630010387 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4b015e870 0x7fa4980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b00d1b10 con 0x7fa498004800 2024-09-11T22:22:44.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b00d40d0 con 0x7fa4980039b0 2024-09-11T22:22:44.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa49800b9c0 con 0x7fa4b015e870 2024-09-11T22:22:44.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4affff640 1 --2- 172.21.15.50:0/630010387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa498004800 0x7fa498004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/630010387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4980039b0 0x7fa498003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4b5535640 1 --2- 172.21.15.50:0/630010387 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4b015e870 0x7fa4980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4affff640 1 -- 172.21.15.50:0/630010387 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4b015e870 msgr2=0x7fa4980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4affff640 1 --2- 172.21.15.50:0/630010387 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4b015e870 0x7fa4980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4affff640 1 -- 172.21.15.50:0/630010387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4980039b0 msgr2=0x7fa498003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4affff640 1 --2- 172.21.15.50:0/630010387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4980039b0 0x7fa498003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4affff640 1 -- 172.21.15.50:0/630010387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa498003520 con 0x7fa498004800 2024-09-11T22:22:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.755+0000 7fa4b5535640 1 --2- 172.21.15.50:0/630010387 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4b015e870 0x7fa4980051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.756+0000 7fa4affff640 1 --2- 172.21.15.50:0/630010387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa498004800 0x7fa498004c80 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00b41b0 tx=0x7fa498005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1b2416a350a28b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.756+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400c0e0 con 0x7fa498004800 2024-09-11T22:22:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.756+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a4034070 con 0x7fa498004800 2024-09-11T22:22:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.756+0000 7fa4af7fe640 1 -- 172.21.15.50:0/630010387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4005d10 con 0x7fa498004800 2024-09-11T22:22:44.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.757+0000 7fa4b6f98640 1 -- 172.21.15.50:0/630010387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa498004800 msgr2=0x7fa498004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.757+0000 7fa4b6f98640 1 --2- 172.21.15.50:0/630010387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa498004800 0x7fa498004c80 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00b41b0 tx=0x7fa498005830 comp rx=0 tx=0).stop 2024-09-11T22:22:44.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.757+0000 7fa4b5535640 1 -- 172.21.15.50:0/630010387 reap_dead start 2024-09-11T22:22:44.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.757+0000 7fa4b6f98640 1 -- 172.21.15.50:0/630010387 shutdown_connections 2024-09-11T22:22:44.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.757+0000 7fa4b6f98640 1 -- 172.21.15.50:0/630010387 >> 172.21.15.50:0/630010387 conn(0x7fa4b00727a0 msgr2=0x7fa4b00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.757+0000 7fa4b6f98640 1 -- 172.21.15.50:0/630010387 shutdown_connections 2024-09-11T22:22:44.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.757+0000 7fa4b6f98640 1 -- 172.21.15.50:0/630010387 wait complete. 2024-09-11T22:22:44.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.758+0000 7fa4b6f98640 1 Processor -- start 2024-09-11T22:22:44.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.758+0000 7fa4b6f98640 1 -- start start 2024-09-11T22:22:44.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b6f98640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa498004800 0x7fa4b00b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b6f98640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b00cd380 0x7fa4b00cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b6f98640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4b00cf190 0x7fa4b01f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b6f98640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b015ec50 con 0x7fa4b00cf190 2024-09-11T22:22:44.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b6f98640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b00b7ee0 con 0x7fa4b00cd380 2024-09-11T22:22:44.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b6f98640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b00b78b0 con 0x7fa498004800 2024-09-11T22:22:44.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b5535640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4b00cf190 0x7fa4b01f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b5535640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4b00cf190 0x7fa4b01f7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45860/0 (socket says 172.21.15.50:45860) 2024-09-11T22:22:44.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b5535640 1 -- 172.21.15.50:0/1979380015 learned_addr learned my addr 172.21.15.50:0/1979380015 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa498004800 0x7fa4b00b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4affff640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b00cd380 0x7fa4b00cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b5535640 1 -- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa498004800 msgr2=0x7fa4b00b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b5535640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa498004800 0x7fa4b00b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b5535640 1 -- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b00cd380 msgr2=0x7fa4b00cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b5535640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b00cd380 0x7fa4b00cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4b5535640 1 -- 172.21.15.50:0/1979380015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b00cc2e0 con 0x7fa4b00cf190 2024-09-11T22:22:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.759+0000 7fa4affff640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b00cd380 0x7fa4b00cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:22:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.760+0000 7fa4b5535640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4b00cf190 0x7fa4b01f7ff0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00d57c0 tx=0x7fa4a8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.760+0000 7fa4ad7fa640 1 -- 172.21.15.50:0/1979380015 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a801a030 con 0x7fa4b00cf190 2024-09-11T22:22:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.760+0000 7fa4ad7fa640 1 -- 172.21.15.50:0/1979380015 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a8010e00 con 0x7fa4b00cf190 2024-09-11T22:22:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.760+0000 7fa4b6f98640 1 -- 172.21.15.50:0/1979380015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b00cc5c0 con 0x7fa4b00cf190 2024-09-11T22:22:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.760+0000 7fa4ad7fa640 1 -- 172.21.15.50:0/1979380015 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8003bd0 con 0x7fa4b00cf190 2024-09-11T22:22:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.760+0000 7fa4b6f98640 1 -- 172.21.15.50:0/1979380015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b00ccb80 con 0x7fa4b00cf190 2024-09-11T22:22:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.762+0000 7fa4ad7fa640 1 -- 172.21.15.50:0/1979380015 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4a801d070 con 0x7fa4b00cf190 2024-09-11T22:22:44.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.762+0000 7fa4ad7fa640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa49c06be30 0x7fa49c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.762+0000 7fa4ad7fa640 1 -- 172.21.15.50:0/1979380015 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7fa4a808b940 con 0x7fa4b00cf190 2024-09-11T22:22:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.763+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa49c06be30 0x7fa49c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.763+0000 7fa4b9e11740 1 Processor -- start 2024-09-11T22:22:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.763+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa49c06be30 0x7fa49c06e2f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0009a60 tx=0x7fa4a0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.763+0000 7fa4b9e11740 1 -- start start 2024-09-11T22:22:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4b9e11740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f1920 0x55d967a370c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4b9e11740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ef0e0 0x55d9679f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4b9e11740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f30b0 0x55d9679ec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4b9e11740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d9679546f0 con 0x55d9679ef0e0 2024-09-11T22:22:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4b9e11740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d9678fc330 con 0x55d9679f30b0 2024-09-11T22:22:44.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4b9e11740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d9679506b0 con 0x55d9679f1920 2024-09-11T22:22:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ef0e0 0x55d9679f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ef0e0 0x55d9679f1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45866/0 (socket says 172.21.15.50:45866) 2024-09-11T22:22:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4affff640 1 -- 172.21.15.50:0/2297137973 learned_addr learned my addr 172.21.15.50:0/2297137973 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4b5535640 1 --2- 172.21.15.50:0/2297137973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f30b0 0x55d9679ec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/2297137973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f1920 0x55d967a370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4affff640 1 -- 172.21.15.50:0/2297137973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f1920 msgr2=0x55d967a370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4affff640 1 --2- 172.21.15.50:0/2297137973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f1920 0x55d967a370c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4affff640 1 -- 172.21.15.50:0/2297137973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f30b0 msgr2=0x55d9679ec1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4affff640 1 --2- 172.21.15.50:0/2297137973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f30b0 0x55d9679ec1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4affff640 1 -- 172.21.15.50:0/2297137973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9679220d0 con 0x55d9679ef0e0 2024-09-11T22:22:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4affff640 1 --2- 172.21.15.50:0/2297137973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ef0e0 0x55d9679f1d00 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7fa4a402afc0 tx=0x7fa4a4007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62581e9785251f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.764+0000 7fa4967fc640 1 -- 172.21.15.50:0/2297137973 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4001620 con 0x55d9679ef0e0 2024-09-11T22:22:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.765+0000 7fa4967fc640 1 -- 172.21.15.50:0/2297137973 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a4034040 con 0x55d9679ef0e0 2024-09-11T22:22:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.765+0000 7fa4967fc640 1 -- 172.21.15.50:0/2297137973 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a40047e0 con 0x55d9679ef0e0 2024-09-11T22:22:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.765+0000 7fa4b9e11740 1 -- 172.21.15.50:0/2297137973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ef0e0 msgr2=0x55d9679f1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.765+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/2297137973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ef0e0 0x55d9679f1d00 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7fa4a402afc0 tx=0x7fa4a4007000 comp rx=0 tx=0).stop 2024-09-11T22:22:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.765+0000 7fa4b9e11740 1 -- 172.21.15.50:0/2297137973 shutdown_connections 2024-09-11T22:22:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.765+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/2297137973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f30b0 0x55d9679ec1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.765+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/2297137973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ef0e0 0x55d9679f1d00 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.765+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/2297137973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f1920 0x55d967a370c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.765+0000 7fa4b9e11740 1 -- 172.21.15.50:0/2297137973 >> 172.21.15.50:0/2297137973 conn(0x55d9679ee370 msgr2=0x55d967a36590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.765+0000 7fa4b9e11740 1 -- 172.21.15.50:0/2297137973 shutdown_connections 2024-09-11T22:22:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.765+0000 7fa4b9e11740 1 -- 172.21.15.50:0/2297137973 wait complete. 2024-09-11T22:22:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.766+0000 7fa4b9e11740 1 -- start start 2024-09-11T22:22:44.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.766+0000 7fa4b9e11740 1 Processor -- start 2024-09-11T22:22:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4b9e11740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f1920 0x55d967a11500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4b9e11740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f30b0 0x55d967a46e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4b9e11740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679ebff0 0x55d9679ec470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4b9e11740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d9679ed810 con 0x55d9679f30b0 2024-09-11T22:22:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4b9e11740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d9678dd4f0 con 0x55d9679f1920 2024-09-11T22:22:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4b9e11740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d967a378f0 con 0x55d9679ebff0 2024-09-11T22:22:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4b9e11740 10 client.0 _ll_register_callbacks cb 0x55d9678feb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f30b0 0x55d967a46e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f30b0 0x55d967a46e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45874/0 (socket says 172.21.15.50:45874) 2024-09-11T22:22:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4affff640 1 -- 172.21.15.50:0/1511613522 learned_addr learned my addr 172.21.15.50:0/1511613522 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4b5535640 1 --2- 172.21.15.50:0/1511613522 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679ebff0 0x55d9679ec470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/1511613522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f1920 0x55d967a11500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4affff640 1 -- 172.21.15.50:0/1511613522 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679ebff0 msgr2=0x55d9679ec470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4affff640 1 --2- 172.21.15.50:0/1511613522 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679ebff0 0x55d9679ec470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4affff640 1 -- 172.21.15.50:0/1511613522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f1920 msgr2=0x55d967a11500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4affff640 1 --2- 172.21.15.50:0/1511613522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f1920 0x55d967a11500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4affff640 1 -- 172.21.15.50:0/1511613522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9677317d0 con 0x55d9679f30b0 2024-09-11T22:22:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4affff640 1 --2- 172.21.15.50:0/1511613522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f30b0 0x55d967a46e80 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400c490 tx=0x7fa4a4001c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146530a5ad261d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa48f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa48f7fe640 1 -- 172.21.15.50:0/1511613522 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a404c060 con 0x55d9679f30b0 2024-09-11T22:22:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa48f7fe640 1 -- 172.21.15.50:0/1511613522 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7fa4a4004c40 con 0x55d9679f30b0 2024-09-11T22:22:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.767+0000 7fa4b9e11740 1 -- 172.21.15.50:0/1511613522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4a4034040 con 0x55d9679f30b0 2024-09-11T22:22:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa48f7fe640 1 -- 172.21.15.50:0/1511613522 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7fa4a4007110 con 0x55d9679f30b0 2024-09-11T22:22:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa4b9e11740 10 client.10548 fetch_fsmap learned FSMap version 130 2024-09-11T22:22:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa4b9e11740 1 -- 172.21.15.50:0/1511613522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55d9676673f0 con 0x55d9679f30b0 2024-09-11T22:22:44.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa48f7fe640 1 -- 172.21.15.50:0/1511613522 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a4034040 con 0x55d9679f30b0 2024-09-11T22:22:44.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa48f7fe640 1 -- 172.21.15.50:0/1511613522 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7fa4a4055080 con 0x55d9679f30b0 2024-09-11T22:22:44.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa4b9e11740 10 client.10548 fetch_fsmap finished waiting for FSMap version 130 2024-09-11T22:22:44.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa4b9e11740 10 client.10548 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-11T22:22:44.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa4b9e11740 20 client.10548 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:44.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/1511613522 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55d967a197d0 0x55d967a19c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa4b9e11740 4 client.10548 mds_command: new command op to 10320 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:22:44.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa4b9e11740 1 -- 172.21.15.50:0/1511613522 --> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d967961e20 con 0x55d967a197d0 2024-09-11T22:22:44.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/1511613522 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55d967a197d0 0x55d967a19c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa48f7fe640 10 client.10548 ms_handle_connect on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:44.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.768+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/1511613522 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55d967a197d0 0x55d967a19c10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73a371649046f369 server_cookie=dc5c8199091233c0 in_seq=0 out_seq=0 2024-09-11T22:22:44.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa48f7fe640 1 -- 172.21.15.50:0/1511613522 <== mds.0 v2:172.21.15.50:6834/4092595783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d967961e20 con 0x55d967a197d0 2024-09-11T22:22:44.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa48f7fe640 10 client.10548 handle_command_reply: tid=0 2024-09-11T22:22:44.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa4b9e11740 1 client.10548 shutdown 2024-09-11T22:22:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa4b9e11740 1 -- 172.21.15.50:0/1511613522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f30b0 msgr2=0x55d967a46e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/1511613522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f30b0 0x55d967a46e80 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400c490 tx=0x7fa4a4001c30 comp rx=0 tx=0).stop 2024-09-11T22:22:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa4b9e11740 1 -- 172.21.15.50:0/1511613522 shutdown_connections 2024-09-11T22:22:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/1511613522 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55d967a197d0 0x55d967a19c10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/1511613522 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679ebff0 0x55d9679ec470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/1511613522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f30b0 0x55d967a46e80 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa48f7fe640 0 client.10548 ms_handle_reset on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/1511613522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f1920 0x55d967a11500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa4b9e11740 1 -- 172.21.15.50:0/1511613522 >> 172.21.15.50:0/1511613522 conn(0x55d9679ef0e0 msgr2=0x55d967a39aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa4b9e11740 1 -- 172.21.15.50:0/1511613522 shutdown_connections 2024-09-11T22:22:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa4b9e11740 1 -- 172.21.15.50:0/1511613522 wait complete. 2024-09-11T22:22:44.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.769+0000 7fa4b9e11740 20 client.10548 trim_cache size 0 max 16384 2024-09-11T22:22:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.787+0000 7fa4b9e11740 1 Processor -- start 2024-09-11T22:22:44.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.787+0000 7fa4b9e11740 1 -- start start 2024-09-11T22:22:44.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b9e11740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ebff0 0x55d967a337e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b9e11740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f1920 0x55d967a36560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b9e11740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f30b0 0x55d967a36aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b9e11740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b0201540 con 0x55d9679ebff0 2024-09-11T22:22:44.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b9e11740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b0200580 con 0x55d9679f30b0 2024-09-11T22:22:44.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b9e11740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b01f5790 con 0x55d9679f1920 2024-09-11T22:22:44.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b4d34640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ebff0 0x55d967a337e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b4d34640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ebff0 0x55d967a337e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45884/0 (socket says 172.21.15.50:45884) 2024-09-11T22:22:44.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b4d34640 1 -- 172.21.15.50:0/623585601 learned_addr learned my addr 172.21.15.50:0/623585601 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b4d34640 1 -- 172.21.15.50:0/623585601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f1920 msgr2=0x55d967a36560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/623585601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f1920 0x55d967a36560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b4d34640 1 -- 172.21.15.50:0/623585601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f30b0 msgr2=0x55d967a36aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/623585601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f30b0 0x55d967a36aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b4d34640 1 -- 172.21.15.50:0/623585601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9676270f0 con 0x55d9679ebff0 2024-09-11T22:22:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/623585601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ebff0 0x55d967a337e0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0004390 tx=0x7fa4a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bfe4092928bfcfd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa495ffb640 1 -- 172.21.15.50:0/623585601 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a003a070 con 0x55d9679ebff0 2024-09-11T22:22:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa495ffb640 1 -- 172.21.15.50:0/623585601 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a0003b10 con 0x55d9679ebff0 2024-09-11T22:22:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.788+0000 7fa495ffb640 1 -- 172.21.15.50:0/623585601 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a001b070 con 0x55d9679ebff0 2024-09-11T22:22:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.789+0000 7fa4b9e11740 1 -- 172.21.15.50:0/623585601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ebff0 msgr2=0x55d967a337e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.789+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/623585601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ebff0 0x55d967a337e0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0004390 tx=0x7fa4a0017000 comp rx=0 tx=0).stop 2024-09-11T22:22:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.789+0000 7fa4b9e11740 1 -- 172.21.15.50:0/623585601 shutdown_connections 2024-09-11T22:22:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.789+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/623585601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f1920 0x55d967a36560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.789+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/623585601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679f30b0 0x55d967a36aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.789+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/623585601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679ebff0 0x55d967a337e0 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.789+0000 7fa4b9e11740 1 -- 172.21.15.50:0/623585601 >> 172.21.15.50:0/623585601 conn(0x55d9679ef0e0 msgr2=0x55d967a110e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.789+0000 7fa4b9e11740 1 -- 172.21.15.50:0/623585601 shutdown_connections 2024-09-11T22:22:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.789+0000 7fa4b9e11740 1 -- 172.21.15.50:0/623585601 wait complete. 2024-09-11T22:22:44.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.790+0000 7fa4b9e11740 1 -- start start 2024-09-11T22:22:44.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.790+0000 7fa4b9e11740 1 Processor -- start 2024-09-11T22:22:44.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4b9e11740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679ebff0 0x55d967a339d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4b9e11740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f1920 0x55d9679eb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4b9e11740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f30b0 0x55d9679eb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4b9e11740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b015a1f0 con 0x55d9679f1920 2024-09-11T22:22:44.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4b9e11740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d9679f1f30 con 0x55d9679ebff0 2024-09-11T22:22:44.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4b9e11740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d967ab61b0 con 0x55d9679f30b0 2024-09-11T22:22:44.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4b9e11740 10 client.0 _ll_register_callbacks cb 0x7fa4a8007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:22:44.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f1920 0x55d9679eb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f1920 0x55d9679eb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45900/0 (socket says 172.21.15.50:45900) 2024-09-11T22:22:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4affff640 1 -- 172.21.15.50:0/2489664842 learned_addr learned my addr 172.21.15.50:0/2489664842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:22:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/2489664842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679ebff0 0x55d967a339d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4b5535640 1 --2- 172.21.15.50:0/2489664842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f30b0 0x55d9679eb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4affff640 1 -- 172.21.15.50:0/2489664842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f30b0 msgr2=0x55d9679eb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4affff640 1 --2- 172.21.15.50:0/2489664842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f30b0 0x55d9679eb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4affff640 1 -- 172.21.15.50:0/2489664842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679ebff0 msgr2=0x55d967a339d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4affff640 1 --2- 172.21.15.50:0/2489664842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679ebff0 0x55d967a339d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4affff640 1 -- 172.21.15.50:0/2489664842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d967a51290 con 0x55d9679f1920 2024-09-11T22:22:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4affff640 1 --2- 172.21.15.50:0/2489664842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f1920 0x55d9679eb0c0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7fa4a402afc0 tx=0x7fa4b00d4580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50de277f0e6ec142 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa48f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:22:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa48f7fe640 1 -- 172.21.15.50:0/2489664842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4004c00 con 0x55d9679f1920 2024-09-11T22:22:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa48f7fe640 1 -- 172.21.15.50:0/2489664842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7fa4a404c820 con 0x55d9679f1920 2024-09-11T22:22:44.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.791+0000 7fa4b9e11740 1 -- 172.21.15.50:0/2489664842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4a0003b10 con 0x55d9679f1920 2024-09-11T22:22:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa48f7fe640 1 -- 172.21.15.50:0/2489664842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7fa4a404ca20 con 0x55d9679f1920 2024-09-11T22:22:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa4b9e11740 10 client.10554 fetch_fsmap learned FSMap version 130 2024-09-11T22:22:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa4b9e11740 1 -- 172.21.15.50:0/2489664842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55d967ab5ef0 con 0x55d9679f1920 2024-09-11T22:22:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa48f7fe640 1 -- 172.21.15.50:0/2489664842 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a0003b10 con 0x55d9679f1920 2024-09-11T22:22:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa48f7fe640 1 -- 172.21.15.50:0/2489664842 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7fa4a404cbc0 con 0x55d9679f1920 2024-09-11T22:22:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa4b9e11740 10 client.10554 fetch_fsmap finished waiting for FSMap version 130 2024-09-11T22:22:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa4b9e11740 10 client.10554 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-11T22:22:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa4b9e11740 20 client.10554 populate_metadata read hostname 'smithi050' 2024-09-11T22:22:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/2489664842 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55d967a0fb80 0x55d967a0ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa4b9e11740 4 client.10554 mds_command: new command op to 10320 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:22:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa4b9e11740 1 -- 172.21.15.50:0/2489664842 --> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d96795c170 con 0x55d967a0fb80 2024-09-11T22:22:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/2489664842 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55d967a0fb80 0x55d967a0ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa48f7fe640 10 client.10554 ms_handle_connect on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.792+0000 7fa4b4d34640 1 --2- 172.21.15.50:0/2489664842 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55d967a0fb80 0x55d967a0ff60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bcd4e80b8862977 server_cookie=4446806c5019afd9 in_seq=0 out_seq=0 2024-09-11T22:22:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa48f7fe640 1 -- 172.21.15.50:0/2489664842 <== mds.0 v2:172.21.15.50:6834/4092595783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+257 (crc 0 0 0) 0x55d96795c170 con 0x55d967a0fb80 2024-09-11T22:22:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa48f7fe640 10 client.10554 handle_command_reply: tid=0 2024-09-11T22:22:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b9e11740 1 client.10554 shutdown 2024-09-11T22:22:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b9e11740 1 -- 172.21.15.50:0/2489664842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f1920 msgr2=0x55d9679eb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/2489664842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f1920 0x55d9679eb0c0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7fa4a402afc0 tx=0x7fa4b00d4580 comp rx=0 tx=0).stop 2024-09-11T22:22:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b9e11740 1 -- 172.21.15.50:0/2489664842 shutdown_connections 2024-09-11T22:22:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/2489664842 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55d967a0fb80 0x55d967a0ff60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/2489664842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d9679f30b0 0x55d9679eb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa48f7fe640 0 client.10554 ms_handle_reset on v2:172.21.15.50:6834/4092595783 2024-09-11T22:22:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/2489664842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d9679f1920 0x55d9679eb0c0 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b9e11740 1 --2- 172.21.15.50:0/2489664842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d9679ebff0 0x55d967a339d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b9e11740 1 -- 172.21.15.50:0/2489664842 >> 172.21.15.50:0/2489664842 conn(0x55d9679ef0e0 msgr2=0x55d967a11ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b9e11740 1 -- 172.21.15.50:0/2489664842 shutdown_connections 2024-09-11T22:22:44.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b9e11740 1 -- 172.21.15.50:0/2489664842 wait complete. 2024-09-11T22:22:44.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b9e11740 20 client.10554 trim_cache size 0 max 16384 2024-09-11T22:22:44.800 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:22:44.800 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:22:44.800 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-11T22:22:44.800 INFO:teuthology.orchestra.run.smithi050.stdout: "a92098d0-992b-464e-8d6c-3c9659317bb1": { 2024-09-11T22:22:44.800 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "~mds0", 2024-09-11T22:22:44.800 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "a92098d0-992b-464e-8d6c-3c9659317bb1", 2024-09-11T22:22:44.801 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive" 2024-09-11T22:22:44.801 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:44.801 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:22:44.801 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:22:44.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b6f98640 1 -- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa49c06be30 msgr2=0x7fa49c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b6f98640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa49c06be30 0x7fa49c06e2f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0009a60 tx=0x7fa4a0009190 comp rx=0 tx=0).stop 2024-09-11T22:22:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b6f98640 1 -- 172.21.15.50:0/1979380015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4b00cf190 msgr2=0x7fa4b01f7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.793+0000 7fa4b6f98640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4b00cf190 0x7fa4b01f7ff0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00d57c0 tx=0x7fa4a8010590 comp rx=0 tx=0).stop 2024-09-11T22:22:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.794+0000 7fa4b6f98640 1 -- 172.21.15.50:0/1979380015 shutdown_connections 2024-09-11T22:22:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.794+0000 7fa4b6f98640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa49c06be30 0x7fa49c06e2f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.794+0000 7fa4b6f98640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4b00cf190 0x7fa4b01f7ff0 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.794+0000 7fa4b6f98640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b00cd380 0x7fa4b00cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.794+0000 7fa4b6f98640 1 --2- 172.21.15.50:0/1979380015 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa498004800 0x7fa4b00b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.794+0000 7fa4b6f98640 1 -- 172.21.15.50:0/1979380015 >> 172.21.15.50:0/1979380015 conn(0x7fa4b00727a0 msgr2=0x7fa4b00b6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.794+0000 7fa4b6f98640 1 -- 172.21.15.50:0/1979380015 shutdown_connections 2024-09-11T22:22:44.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:22:44.794+0000 7fa4b6f98640 1 -- 172.21.15.50:0/1979380015 wait complete. 2024-09-11T22:22:44.805 INFO:tasks.cephfs.filesystem:scrub status for tag:a92098d0-992b-464e-8d6c-3c9659317bb1 - {'path': '~mds0', 'tag': 'a92098d0-992b-464e-8d6c-3c9659317bb1', 'options': 'recursive'} 2024-09-11T22:23:14.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:23:14.377 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:23:14.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:14.807 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-11T22:23:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.923+0000 7f9cd654b640 1 Processor -- start 2024-09-11T22:23:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.923+0000 7f9cd654b640 1 -- start start 2024-09-11T22:23:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.924+0000 7f9cd654b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9cd015e840 0x7f9cd00b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.924+0000 7f9cd654b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9cd00cf580 0x7f9cd006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.924+0000 7f9cd654b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd00ce5f0 con 0x7f9cd00cdd50 2024-09-11T22:23:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.924+0000 7f9cd654b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd006c240 con 0x7f9cd00cf580 2024-09-11T22:23:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.924+0000 7f9cd654b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd00d0470 con 0x7f9cd015e840 2024-09-11T22:23:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.924+0000 7f9cd4ae8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9cd00cf580 0x7f9cd006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.924+0000 7f9cd4ae8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9cd00cf580 0x7f9cd006c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41804/0 (socket says 172.21.15.50:41804) 2024-09-11T22:23:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.924+0000 7f9cd4ae8640 1 -- 172.21.15.50:0/608717851 learned_addr learned my addr 172.21.15.50:0/608717851 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.924+0000 7f9ccffff640 1 --2- 172.21.15.50:0/608717851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9cd015e840 0x7f9cd00b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.925+0000 7f9cd4ae8640 1 -- 172.21.15.50:0/608717851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9cd015e840 msgr2=0x7f9cd00b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.925+0000 7f9cd4ae8640 1 --2- 172.21.15.50:0/608717851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9cd015e840 0x7f9cd00b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.925+0000 7f9cd4ae8640 1 -- 172.21.15.50:0/608717851 >> v1:172.21.15.77:6789/0 conn(0x7f9cd00cdd50 legacy=0x7f9cd00cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.925+0000 7f9cd4ae8640 1 -- 172.21.15.50:0/608717851 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd00ce310 con 0x7f9cd00cf580 2024-09-11T22:23:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.925+0000 7f9ccffff640 1 --2- 172.21.15.50:0/608717851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9cd015e840 0x7f9cd00b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.925+0000 7f9cd4ae8640 1 --2- 172.21.15.50:0/608717851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd00cf580 0x7f9cd006c6d0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009e50 tx=0x7f9cc802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c722250208d21554 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.925+0000 7f9cceffd640 1 -- 172.21.15.50:0/608717851 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8036070 con 0x7f9cd00cf580 2024-09-11T22:23:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.926+0000 7f9cceffd640 1 -- 172.21.15.50:0/608717851 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc8031600 con 0x7f9cd00cf580 2024-09-11T22:23:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.926+0000 7f9cceffd640 1 -- 172.21.15.50:0/608717851 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc80319d0 con 0x7f9cd00cf580 2024-09-11T22:23:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.926+0000 7f9cd654b640 1 -- 172.21.15.50:0/608717851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd00cf580 msgr2=0x7f9cd006c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.926+0000 7f9cd654b640 1 --2- 172.21.15.50:0/608717851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd00cf580 0x7f9cd006c6d0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009e50 tx=0x7f9cc802a710 comp rx=0 tx=0).stop 2024-09-11T22:23:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.926+0000 7f9cd654b640 1 -- 172.21.15.50:0/608717851 shutdown_connections 2024-09-11T22:23:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.926+0000 7f9cd654b640 1 --2- 172.21.15.50:0/608717851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd00cf580 0x7f9cd006c6d0 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.926+0000 7f9cd654b640 1 --2- 172.21.15.50:0/608717851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9cd015e840 0x7f9cd00b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.926+0000 7f9cd654b640 1 -- 172.21.15.50:0/608717851 >> 172.21.15.50:0/608717851 conn(0x7f9cd00b4150 msgr2=0x7f9cd00b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.926+0000 7f9cd654b640 1 -- 172.21.15.50:0/608717851 shutdown_connections 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.926+0000 7f9cd654b640 1 -- 172.21.15.50:0/608717851 wait complete. 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.927+0000 7f9cd654b640 1 Processor -- start 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.928+0000 7f9cd654b640 1 -- start start 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.928+0000 7f9cd654b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd00cdd50 0x7f9cd00b7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.928+0000 7f9cd654b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9cd00cf580 0x7f9cd0155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.928+0000 7f9cd654b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cd015e840 0x7f9cd00b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.928+0000 7f9cd654b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd015ec20 con 0x7f9cd00cdd50 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.928+0000 7f9cd654b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd006bed0 con 0x7f9cd015e840 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.928+0000 7f9cd654b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd015eda0 con 0x7f9cd00cf580 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.928+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd00cdd50 0x7f9cd00b7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.928+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd00cdd50 0x7f9cd00b7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41820/0 (socket says 172.21.15.50:41820) 2024-09-11T22:23:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.928+0000 7f9ccffff640 1 -- 172.21.15.50:0/376062854 learned_addr learned my addr 172.21.15.50:0/376062854 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.929+0000 7f9ccf7fe640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9cd00cf580 0x7f9cd0155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.929+0000 7f9cd4ae8640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cd015e840 0x7f9cd00b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.929+0000 7f9ccffff640 1 -- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9cd00cf580 msgr2=0x7f9cd0155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.929+0000 7f9ccffff640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9cd00cf580 0x7f9cd0155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.929+0000 7f9ccffff640 1 -- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cd015e840 msgr2=0x7f9cd00b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.929+0000 7f9ccffff640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cd015e840 0x7f9cd00b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.929+0000 7f9ccffff640 1 -- 172.21.15.50:0/376062854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd00cbbb0 con 0x7f9cd00cdd50 2024-09-11T22:23:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.929+0000 7f9ccffff640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd00cdd50 0x7f9cd00b7ce0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000d800 tx=0x7f9cc000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.929+0000 7f9cccff9640 1 -- 172.21.15.50:0/376062854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0004030 con 0x7f9cd00cdd50 2024-09-11T22:23:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.929+0000 7f9cccff9640 1 -- 172.21.15.50:0/376062854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc00041d0 con 0x7f9cd00cdd50 2024-09-11T22:23:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.929+0000 7f9cccff9640 1 -- 172.21.15.50:0/376062854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc00096a0 con 0x7f9cd00cdd50 2024-09-11T22:23:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.929+0000 7f9cd654b640 1 -- 172.21.15.50:0/376062854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd01f4a90 con 0x7f9cd00cdd50 2024-09-11T22:23:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.929+0000 7f9cd654b640 1 -- 172.21.15.50:0/376062854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd00cc110 con 0x7f9cd00cdd50 2024-09-11T22:23:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.931+0000 7f9cccff9640 1 -- 172.21.15.50:0/376062854 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9cc0009840 con 0x7f9cd00cdd50 2024-09-11T22:23:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.931+0000 7f9cccff9640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9cbc06be30 0x7f9cbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.931+0000 7f9cccff9640 1 -- 172.21.15.50:0/376062854 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f9cc008afa0 con 0x7f9cd00cdd50 2024-09-11T22:23:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.932+0000 7f9ccf7fe640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9cbc06be30 0x7f9cbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.932+0000 7f9ccf7fe640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9cbc06be30 0x7f9cbc06e2f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00b0370 tx=0x7f9cc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.932+0000 7f9cd93c2740 1 Processor -- start 2024-09-11T22:23:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.932+0000 7f9cd93c2740 1 -- start start 2024-09-11T22:23:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9cd93c2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 0x5653ee7000c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9cd93c2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6b80e0 0x5653ee6bad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9cd93c2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6bc0b0 0x5653ee6b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9cd93c2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5653ee61d6f0 con 0x5653ee6ba920 2024-09-11T22:23:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9cd93c2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5653ee5c5330 con 0x5653ee6bc0b0 2024-09-11T22:23:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9cd93c2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5653ee6196b0 con 0x5653ee6b80e0 2024-09-11T22:23:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 0x5653ee7000c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 0x5653ee7000c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41836/0 (socket says 172.21.15.50:41836) 2024-09-11T22:23:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9ccffff640 1 -- 172.21.15.50:0/768259283 learned_addr learned my addr 172.21.15.50:0/768259283 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9ccf7fe640 1 --2- 172.21.15.50:0/768259283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6b80e0 0x5653ee6bad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9cd4ae8640 1 --2- 172.21.15.50:0/768259283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6bc0b0 0x5653ee6b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9ccffff640 1 -- 172.21.15.50:0/768259283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6b80e0 msgr2=0x5653ee6bad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9ccffff640 1 --2- 172.21.15.50:0/768259283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6b80e0 0x5653ee6bad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9ccffff640 1 -- 172.21.15.50:0/768259283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6bc0b0 msgr2=0x5653ee6b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9ccffff640 1 --2- 172.21.15.50:0/768259283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6bc0b0 0x5653ee6b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.933+0000 7f9ccffff640 1 -- 172.21.15.50:0/768259283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ee5eb0d0 con 0x5653ee6ba920 2024-09-11T22:23:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.934+0000 7f9ccffff640 1 --2- 172.21.15.50:0/768259283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 0x5653ee7000c0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0089470 tx=0x7f9cc0058f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9345c26944a8919b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.934+0000 7f9cb5ffb640 1 -- 172.21.15.50:0/768259283 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0057600 con 0x5653ee6ba920 2024-09-11T22:23:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.934+0000 7f9cb5ffb640 1 -- 172.21.15.50:0/768259283 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc0087070 con 0x5653ee6ba920 2024-09-11T22:23:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.934+0000 7f9cb5ffb640 1 -- 172.21.15.50:0/768259283 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc00710d0 con 0x5653ee6ba920 2024-09-11T22:23:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.934+0000 7f9cd93c2740 1 -- 172.21.15.50:0/768259283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 msgr2=0x5653ee7000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.934+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/768259283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 0x5653ee7000c0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0089470 tx=0x7f9cc0058f70 comp rx=0 tx=0).stop 2024-09-11T22:23:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.934+0000 7f9cd93c2740 1 -- 172.21.15.50:0/768259283 shutdown_connections 2024-09-11T22:23:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.934+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/768259283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6b80e0 0x5653ee6bad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.934+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/768259283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6bc0b0 0x5653ee6b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.934+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/768259283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 0x5653ee7000c0 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.934+0000 7f9cd93c2740 1 -- 172.21.15.50:0/768259283 >> 172.21.15.50:0/768259283 conn(0x5653ee6b7370 msgr2=0x5653ee6ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.935+0000 7f9cd93c2740 1 -- 172.21.15.50:0/768259283 shutdown_connections 2024-09-11T22:23:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.935+0000 7f9cd93c2740 1 -- 172.21.15.50:0/768259283 wait complete. 2024-09-11T22:23:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.935+0000 7f9cd93c2740 1 -- start start 2024-09-11T22:23:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.935+0000 7f9cd93c2740 1 Processor -- start 2024-09-11T22:23:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.936+0000 7f9cd93c2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 0x5653ee6dcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.936+0000 7f9cd93c2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6bc0b0 0x5653ee6e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.936+0000 7f9cd93c2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6e4c10 0x5653ee6dd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.936+0000 7f9cd93c2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5653ee6b6810 con 0x5653ee6ba920 2024-09-11T22:23:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.936+0000 7f9cd93c2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5653ee5a64f0 con 0x5653ee6e4c10 2024-09-11T22:23:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.936+0000 7f9cd93c2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5653ee7008f0 con 0x5653ee6bc0b0 2024-09-11T22:23:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.936+0000 7f9cd93c2740 10 client.0 _ll_register_callbacks cb 0x5653ee5c7b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:23:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.936+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 0x5653ee6dcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.936+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 0x5653ee6dcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41848/0 (socket says 172.21.15.50:41848) 2024-09-11T22:23:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.936+0000 7f9ccffff640 1 -- 172.21.15.50:0/3768038010 learned_addr learned my addr 172.21.15.50:0/3768038010 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.936+0000 7f9cd4ae8640 1 --2- 172.21.15.50:0/3768038010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6e4c10 0x5653ee6dd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.936+0000 7f9ccf7fe640 1 --2- 172.21.15.50:0/3768038010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6bc0b0 0x5653ee6e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9ccffff640 1 -- 172.21.15.50:0/3768038010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6bc0b0 msgr2=0x5653ee6e46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9ccffff640 1 --2- 172.21.15.50:0/3768038010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6bc0b0 0x5653ee6e46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9ccffff640 1 -- 172.21.15.50:0/3768038010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6e4c10 msgr2=0x5653ee6dd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9ccffff640 1 --2- 172.21.15.50:0/3768038010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6e4c10 0x5653ee6dd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9ccffff640 1 -- 172.21.15.50:0/3768038010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ee3fa7d0 con 0x5653ee6ba920 2024-09-11T22:23:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9ccffff640 1 --2- 172.21.15.50:0/3768038010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 0x5653ee6dcee0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0055760 tx=0x7f9cc005c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90dddca9680ee5a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9caeffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:23:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9caeffd640 1 -- 172.21.15.50:0/3768038010 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0078170 con 0x5653ee6ba920 2024-09-11T22:23:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9caeffd640 1 -- 172.21.15.50:0/3768038010 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f9cc0071040 con 0x5653ee6ba920 2024-09-11T22:23:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9cd93c2740 1 -- 172.21.15.50:0/3768038010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cc0087070 con 0x5653ee6ba920 2024-09-11T22:23:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9caeffd640 1 -- 172.21.15.50:0/3768038010 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f9cc007e050 con 0x5653ee6ba920 2024-09-11T22:23:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9cd93c2740 10 client.10566 fetch_fsmap learned FSMap version 130 2024-09-11T22:23:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9cd93c2740 1 -- 172.21.15.50:0/3768038010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x5653ee3303f0 con 0x5653ee6ba920 2024-09-11T22:23:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9caeffd640 1 -- 172.21.15.50:0/3768038010 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc0087070 con 0x5653ee6ba920 2024-09-11T22:23:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9caeffd640 1 -- 172.21.15.50:0/3768038010 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7f9cc0081080 con 0x5653ee6ba920 2024-09-11T22:23:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9cd93c2740 10 client.10566 fetch_fsmap finished waiting for FSMap version 130 2024-09-11T22:23:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9cd93c2740 10 client.10566 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-11T22:23:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9cd93c2740 20 client.10566 populate_metadata read hostname 'smithi050' 2024-09-11T22:23:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/3768038010 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x5653ee6ddf30 0x5653ee6e28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9cd93c2740 4 client.10566 mds_command: new command op to 10320 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:23:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.937+0000 7f9cd93c2740 1 -- 172.21.15.50:0/3768038010 --> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653ee62ae20 con 0x5653ee6ddf30 2024-09-11T22:23:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.938+0000 7f9ccf7fe640 1 --2- 172.21.15.50:0/3768038010 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x5653ee6ddf30 0x5653ee6e28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.938+0000 7f9ccf7fe640 1 --2- 172.21.15.50:0/3768038010 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x5653ee6ddf30 0x5653ee6e28f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e83be429c725ddb server_cookie=459e8eb443029f in_seq=0 out_seq=0 2024-09-11T22:23:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.938+0000 7f9caeffd640 10 client.10566 ms_handle_connect on v2:172.21.15.50:6834/4092595783 2024-09-11T22:23:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.938+0000 7f9caeffd640 1 -- 172.21.15.50:0/3768038010 <== mds.0 v2:172.21.15.50:6834/4092595783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653ee62ae20 con 0x5653ee6ddf30 2024-09-11T22:23:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.938+0000 7f9caeffd640 10 client.10566 handle_command_reply: tid=0 2024-09-11T22:23:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.938+0000 7f9cd93c2740 1 client.10566 shutdown 2024-09-11T22:23:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.939+0000 7f9cd93c2740 1 -- 172.21.15.50:0/3768038010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 msgr2=0x5653ee6dcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.939+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/3768038010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 0x5653ee6dcee0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0055760 tx=0x7f9cc005c040 comp rx=0 tx=0).stop 2024-09-11T22:23:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.939+0000 7f9cd93c2740 1 -- 172.21.15.50:0/3768038010 shutdown_connections 2024-09-11T22:23:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.939+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/3768038010 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x5653ee6ddf30 0x5653ee6e28f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.939+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/3768038010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6bc0b0 0x5653ee6e46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.939+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/3768038010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6e4c10 0x5653ee6dd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.939+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/3768038010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6ba920 0x5653ee6dcee0 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.939+0000 7f9caeffd640 0 client.10566 ms_handle_reset on v2:172.21.15.50:6834/4092595783 2024-09-11T22:23:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.939+0000 7f9cd93c2740 1 -- 172.21.15.50:0/3768038010 >> 172.21.15.50:0/3768038010 conn(0x5653ee6b80e0 msgr2=0x5653ee6fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.939+0000 7f9cd93c2740 1 -- 172.21.15.50:0/3768038010 shutdown_connections 2024-09-11T22:23:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.939+0000 7f9cd93c2740 1 -- 172.21.15.50:0/3768038010 wait complete. 2024-09-11T22:23:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.939+0000 7f9cd93c2740 20 client.10566 trim_cache size 0 max 16384 2024-09-11T22:23:14.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.956+0000 7f9cd93c2740 1 Processor -- start 2024-09-11T22:23:14.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.957+0000 7f9cd93c2740 1 -- start start 2024-09-11T22:23:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.957+0000 7f9cd93c2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6ba920 0x5653ee6ff200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.957+0000 7f9cd93c2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6bc0b0 0x5653ee6ff740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.957+0000 7f9cd93c2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 0x5653ee6e3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.957+0000 7f9cd93c2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5653ee6e58c0 con 0x5653ee6e4c10 2024-09-11T22:23:14.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.957+0000 7f9cd93c2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd0200e20 con 0x5653ee6bc0b0 2024-09-11T22:23:14.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.957+0000 7f9cd93c2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd01ffe90 con 0x5653ee6ba920 2024-09-11T22:23:14.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.957+0000 7f9cd4ae8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 0x5653ee6e3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.957+0000 7f9cd4ae8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 0x5653ee6e3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41864/0 (socket says 172.21.15.50:41864) 2024-09-11T22:23:14.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.957+0000 7f9cd4ae8640 1 -- 172.21.15.50:0/1169423524 learned_addr learned my addr 172.21.15.50:0/1169423524 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:14.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.957+0000 7f9ccffff640 1 --2- 172.21.15.50:0/1169423524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6ba920 0x5653ee6ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.957+0000 7f9ccf7fe640 1 --2- 172.21.15.50:0/1169423524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6bc0b0 0x5653ee6ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.958+0000 7f9cd4ae8640 1 -- 172.21.15.50:0/1169423524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6ba920 msgr2=0x5653ee6ff200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:14.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.958+0000 7f9cd4ae8640 1 --2- 172.21.15.50:0/1169423524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6ba920 0x5653ee6ff200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.958+0000 7f9cd4ae8640 1 -- 172.21.15.50:0/1169423524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6bc0b0 msgr2=0x5653ee6ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:14.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.958+0000 7f9cd4ae8640 1 --2- 172.21.15.50:0/1169423524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6bc0b0 0x5653ee6ff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.958+0000 7f9cd4ae8640 1 -- 172.21.15.50:0/1169423524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ee6e4a40 con 0x5653ee6e4c10 2024-09-11T22:23:14.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.958+0000 7f9cd4ae8640 1 --2- 172.21.15.50:0/1169423524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 0x5653ee6e3260 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80093e0 tx=0x7f9cc802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11100fe226c5907b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.958+0000 7f9cb57fa640 1 -- 172.21.15.50:0/1169423524 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8036040 con 0x5653ee6e4c10 2024-09-11T22:23:14.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.958+0000 7f9cb57fa640 1 -- 172.21.15.50:0/1169423524 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc8037040 con 0x5653ee6e4c10 2024-09-11T22:23:14.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.958+0000 7f9cb57fa640 1 -- 172.21.15.50:0/1169423524 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8031ac0 con 0x5653ee6e4c10 2024-09-11T22:23:14.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.959+0000 7f9cd93c2740 1 -- 172.21.15.50:0/1169423524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 msgr2=0x5653ee6e3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.959+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/1169423524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 0x5653ee6e3260 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80093e0 tx=0x7f9cc802e000 comp rx=0 tx=0).stop 2024-09-11T22:23:14.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.959+0000 7f9cd93c2740 1 -- 172.21.15.50:0/1169423524 shutdown_connections 2024-09-11T22:23:14.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.959+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/1169423524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 0x5653ee6e3260 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.959+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/1169423524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6bc0b0 0x5653ee6ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.959+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/1169423524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6ba920 0x5653ee6ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.959+0000 7f9cd93c2740 1 -- 172.21.15.50:0/1169423524 >> 172.21.15.50:0/1169423524 conn(0x5653ee6b80e0 msgr2=0x5653ee6fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:14.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.959+0000 7f9cd93c2740 1 -- 172.21.15.50:0/1169423524 shutdown_connections 2024-09-11T22:23:14.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.959+0000 7f9cd93c2740 1 -- 172.21.15.50:0/1169423524 wait complete. 2024-09-11T22:23:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.959+0000 7f9cd93c2740 1 -- start start 2024-09-11T22:23:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.959+0000 7f9cd93c2740 1 Processor -- start 2024-09-11T22:23:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.960+0000 7f9cd93c2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6ba920 0x5653ee6fcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.960+0000 7f9cd93c2740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6bc0b0 0x5653ee6ff200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.960+0000 7f9cd93c2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 0x5653ee6ff740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.960+0000 7f9cd93c2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01ff840 con 0x5653ee6e4c10 2024-09-11T22:23:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.960+0000 7f9cd93c2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01ff220 con 0x5653ee6ba920 2024-09-11T22:23:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.960+0000 7f9cd93c2740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5653ee6ff040 con 0x5653ee6bc0b0 2024-09-11T22:23:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.960+0000 7f9cd93c2740 10 client.0 _ll_register_callbacks cb 0x7f9cc8009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:23:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.960+0000 7f9cd4ae8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 0x5653ee6ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.960+0000 7f9cd4ae8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 0x5653ee6ff740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41870/0 (socket says 172.21.15.50:41870) 2024-09-11T22:23:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.960+0000 7f9cd4ae8640 1 -- 172.21.15.50:0/2792569139 learned_addr learned my addr 172.21.15.50:0/2792569139 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.960+0000 7f9ccffff640 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6ba920 0x5653ee6fcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.960+0000 7f9ccf7fe640 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6bc0b0 0x5653ee6ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9cd4ae8640 1 -- 172.21.15.50:0/2792569139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6bc0b0 msgr2=0x5653ee6ff200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9cd4ae8640 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6bc0b0 0x5653ee6ff200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9cd4ae8640 1 -- 172.21.15.50:0/2792569139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6ba920 msgr2=0x5653ee6fcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9cd4ae8640 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6ba920 0x5653ee6fcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9cd4ae8640 1 -- 172.21.15.50:0/2792569139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ee6bb070 con 0x5653ee6e4c10 2024-09-11T22:23:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9ccf7fe640 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6bc0b0 0x5653ee6ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9cd4ae8640 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 0x5653ee6ff740 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009f70 tx=0x7f9cc8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1eb7532eb333b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9caeffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:23:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9caeffd640 1 -- 172.21.15.50:0/2792569139 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8051070 con 0x5653ee6e4c10 2024-09-11T22:23:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9caeffd640 1 -- 172.21.15.50:0/2792569139 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f9cc804a480 con 0x5653ee6e4c10 2024-09-11T22:23:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9cd93c2740 1 -- 172.21.15.50:0/2792569139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cc8037040 con 0x5653ee6e4c10 2024-09-11T22:23:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9caeffd640 1 -- 172.21.15.50:0/2792569139 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f9cc805c050 con 0x5653ee6e4c10 2024-09-11T22:23:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9cd93c2740 10 client.10572 fetch_fsmap learned FSMap version 130 2024-09-11T22:23:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9cd93c2740 1 -- 172.21.15.50:0/2792569139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x5653ee2f00f0 con 0x5653ee6e4c10 2024-09-11T22:23:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9caeffd640 1 -- 172.21.15.50:0/2792569139 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc8037040 con 0x5653ee6e4c10 2024-09-11T22:23:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9caeffd640 1 -- 172.21.15.50:0/2792569139 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7f9cc805f020 con 0x5653ee6e4c10 2024-09-11T22:23:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9cd93c2740 10 client.10572 fetch_fsmap finished waiting for FSMap version 130 2024-09-11T22:23:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9cd93c2740 10 client.10572 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-11T22:23:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9cd93c2740 20 client.10572 populate_metadata read hostname 'smithi050' 2024-09-11T22:23:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.961+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x5653ee6e1620 0x5653ee6da890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9cd93c2740 4 client.10572 mds_command: new command op to 10320 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:23:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9cd93c2740 1 -- 172.21.15.50:0/2792569139 --> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5653ee625170 con 0x5653ee6e1620 2024-09-11T22:23:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9ccffff640 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x5653ee6e1620 0x5653ee6da890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9caeffd640 10 client.10572 ms_handle_connect on v2:172.21.15.50:6834/4092595783 2024-09-11T22:23:14.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9ccffff640 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x5653ee6e1620 0x5653ee6da890 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de33cf333e04b3cd server_cookie=39f916073846f36f in_seq=0 out_seq=0 2024-09-11T22:23:14.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9caeffd640 1 -- 172.21.15.50:0/2792569139 <== mds.0 v2:172.21.15.50:6834/4092595783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5653ee625170 con 0x5653ee6e1620 2024-09-11T22:23:14.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9caeffd640 10 client.10572 handle_command_reply: tid=0 2024-09-11T22:23:14.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9cd93c2740 1 client.10572 shutdown 2024-09-11T22:23:14.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9cd93c2740 1 -- 172.21.15.50:0/2792569139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 msgr2=0x5653ee6ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 0x5653ee6ff740 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009f70 tx=0x7f9cc8004ab0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9cd93c2740 1 -- 172.21.15.50:0/2792569139 shutdown_connections 2024-09-11T22:23:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x5653ee6e1620 0x5653ee6da890 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5653ee6bc0b0 0x5653ee6ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653ee6e4c10 0x5653ee6ff740 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9caeffd640 0 client.10572 ms_handle_reset on v2:172.21.15.50:6834/4092595783 2024-09-11T22:23:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9cd93c2740 1 --2- 172.21.15.50:0/2792569139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5653ee6ba920 0x5653ee6fcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9cd93c2740 1 -- 172.21.15.50:0/2792569139 >> 172.21.15.50:0/2792569139 conn(0x5653ee6b80e0 msgr2=0x5653ee6fb890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.962+0000 7f9cd93c2740 1 -- 172.21.15.50:0/2792569139 shutdown_connections 2024-09-11T22:23:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd93c2740 1 -- 172.21.15.50:0/2792569139 wait complete. 2024-09-11T22:23:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd93c2740 20 client.10572 trim_cache size 0 max 16384 2024-09-11T22:23:14.970 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:23:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-11T22:23:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-11T22:23:14.971 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:23:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd654b640 1 -- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9cbc06be30 msgr2=0x7f9cbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd654b640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9cbc06be30 0x7f9cbc06e2f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00b0370 tx=0x7f9cc4009040 comp rx=0 tx=0).stop 2024-09-11T22:23:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd654b640 1 -- 172.21.15.50:0/376062854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd00cdd50 msgr2=0x7f9cd00b7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd654b640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd00cdd50 0x7f9cd00b7ce0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000d800 tx=0x7f9cc000dcc0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd654b640 1 -- 172.21.15.50:0/376062854 shutdown_connections 2024-09-11T22:23:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd654b640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9cbc06be30 0x7f9cbc06e2f0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd654b640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9cd00cf580 0x7f9cd0155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd654b640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cd015e840 0x7f9cd00b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd654b640 1 --2- 172.21.15.50:0/376062854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cd00cdd50 0x7f9cd00b7ce0 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd654b640 1 -- 172.21.15.50:0/376062854 >> 172.21.15.50:0/376062854 conn(0x7f9cd00b4150 msgr2=0x7f9cd00d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:14.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd654b640 1 -- 172.21.15.50:0/376062854 shutdown_connections 2024-09-11T22:23:14.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:14.963+0000 7f9cd654b640 1 -- 172.21.15.50:0/376062854 wait complete. 2024-09-11T22:23:14.975 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:23:14.975 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-11T22:23:15.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.079+0000 7fc7e44d0640 1 Processor -- start 2024-09-11T22:23:15.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.079+0000 7fc7e44d0640 1 -- start start 2024-09-11T22:23:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.080+0000 7fc7e44d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0cf580 0x7fc7dc0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.080+0000 7fc7e44d0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7dc0ce5f0 con 0x7fc7dc0cdd50 2024-09-11T22:23:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.080+0000 7fc7e44d0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7dc0ce310 con 0x7fc7dc15e840 2024-09-11T22:23:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.080+0000 7fc7e44d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc7dc06c240 con 0x7fc7dc0cf580 2024-09-11T22:23:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.080+0000 7fc7e2a6d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc7dc0cdd50 0x7fc7dc06c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60694/0 (socket says 172.21.15.50:60694) 2024-09-11T22:23:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.080+0000 7fc7e2a6d640 1 -- 172.21.15.50:0/603226607 learned_addr learned my addr 172.21.15.50:0/603226607 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.080+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/603226607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0cf580 0x7fc7dc0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790356972 0 0) 0x7fc7dc0ce5f0 con 0x7fc7dc0cdd50 2024-09-11T22:23:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7c4003520 con 0x7fc7dc0cdd50 2024-09-11T22:23:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646529482 0 0) 0x7fc7dc0ce310 con 0x7fc7dc15e840 2024-09-11T22:23:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7dc0ce5f0 con 0x7fc7dc15e840 2024-09-11T22:23:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1039042878 0 0) 0x7fc7c4003520 con 0x7fc7dc0cdd50 2024-09-11T22:23:15.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0cf580 msgr2=0x7fc7dc0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 --2- 172.21.15.50:0/603226607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0cf580 0x7fc7dc0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 >> v1:172.21.15.77:6789/0 conn(0x7fc7dc15e840 legacy=0x7fc7dc0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc06bbf0 con 0x7fc7dc0cdd50 2024-09-11T22:23:15.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fc7cc0019f0 con 0x7fc7dc0cdd50 2024-09-11T22:23:15.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/603226607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0cf580 0x7fc7dc0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:15.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 >> v1:172.21.15.50:6789/0 conn(0x7fc7dc0cdd50 legacy=0x7fc7dc06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 --2- 172.21.15.50:0/603226607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0cf580 0x7fc7c4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 --2- 172.21.15.50:0/603226607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7c40040b0 0x7fc7c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 --2- 172.21.15.50:0/603226607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7c4004d40 0x7fc7c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc06c240 con 0x7fc7c4004d40 2024-09-11T22:23:15.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c400ba70 con 0x7fc7c40040b0 2024-09-11T22:23:15.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c400bc70 con 0x7fc7dc0cf580 2024-09-11T22:23:15.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e2a6d640 1 --2- 172.21.15.50:0/603226607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7c4004d40 0x7fc7c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e226c640 1 --2- 172.21.15.50:0/603226607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0cf580 0x7fc7c4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/603226607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7c40040b0 0x7fc7c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e2a6d640 1 -- 172.21.15.50:0/603226607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0cf580 msgr2=0x7fc7c4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e2a6d640 1 --2- 172.21.15.50:0/603226607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0cf580 0x7fc7c4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e2a6d640 1 -- 172.21.15.50:0/603226607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7c40040b0 msgr2=0x7fc7c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e2a6d640 1 --2- 172.21.15.50:0/603226607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7c40040b0 0x7fc7c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.081+0000 7fc7e2a6d640 1 -- 172.21.15.50:0/603226607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c4003520 con 0x7fc7c4004d40 2024-09-11T22:23:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.082+0000 7fc7e2a6d640 1 --2- 172.21.15.50:0/603226607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7c4004d40 0x7fc7c40051c0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00a7c0 tx=0x7fc7c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d451758b0ff9aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:15.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.082+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc00a410 con 0x7fc7c4004d40 2024-09-11T22:23:15.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.082+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7cc02f070 con 0x7fc7c4004d40 2024-09-11T22:23:15.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.082+0000 7fc7e126a640 1 -- 172.21.15.50:0/603226607 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc02bc20 con 0x7fc7c4004d40 2024-09-11T22:23:15.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.083+0000 7fc7e44d0640 1 -- 172.21.15.50:0/603226607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7c4004d40 msgr2=0x7fc7c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.083+0000 7fc7e44d0640 1 --2- 172.21.15.50:0/603226607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7c4004d40 0x7fc7c40051c0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00a7c0 tx=0x7fc7c4005830 comp rx=0 tx=0).stop 2024-09-11T22:23:15.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.083+0000 7fc7e2a6d640 1 -- 172.21.15.50:0/603226607 reap_dead start 2024-09-11T22:23:15.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.083+0000 7fc7e44d0640 1 -- 172.21.15.50:0/603226607 shutdown_connections 2024-09-11T22:23:15.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.083+0000 7fc7e44d0640 1 -- 172.21.15.50:0/603226607 >> 172.21.15.50:0/603226607 conn(0x7fc7dc0b4150 msgr2=0x7fc7dc0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:15.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.083+0000 7fc7e44d0640 1 -- 172.21.15.50:0/603226607 shutdown_connections 2024-09-11T22:23:15.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.083+0000 7fc7e44d0640 1 -- 172.21.15.50:0/603226607 wait complete. 2024-09-11T22:23:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.084+0000 7fc7e44d0640 1 Processor -- start 2024-09-11T22:23:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.084+0000 7fc7e44d0640 1 -- start start 2024-09-11T22:23:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e44d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7c4004d40 0x7fc7dc14d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e44d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7dc15fd50 0x7fc7dc0b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e44d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0b6f80 0x7fc7dc14ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e44d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc15ec20 con 0x7fc7c4004d40 2024-09-11T22:23:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e44d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc0d0470 con 0x7fc7dc15fd50 2024-09-11T22:23:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e44d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc7dc15eda0 con 0x7fc7dc0b6f80 2024-09-11T22:23:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e226c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7c4004d40 0x7fc7dc14d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e226c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7c4004d40 0x7fc7dc14d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41880/0 (socket says 172.21.15.50:41880) 2024-09-11T22:23:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e226c640 1 -- 172.21.15.50:0/3161172645 learned_addr learned my addr 172.21.15.50:0/3161172645 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e2a6d640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0b6f80 0x7fc7dc14ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7dc15fd50 0x7fc7dc0b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e226c640 1 -- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0b6f80 msgr2=0x7fc7dc14ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e226c640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0b6f80 0x7fc7dc14ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e226c640 1 -- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7dc15fd50 msgr2=0x7fc7dc0b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e226c640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7dc15fd50 0x7fc7dc0b6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e226c640 1 -- 172.21.15.50:0/3161172645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc15efd0 con 0x7fc7c4004d40 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.085+0000 7fc7e226c640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7c4004d40 0x7fc7dc14d730 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400f7d0 tx=0x7fc7d400fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.086+0000 7fc7daffd640 1 -- 172.21.15.50:0/3161172645 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40052e0 con 0x7fc7c4004d40 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.086+0000 7fc7daffd640 1 -- 172.21.15.50:0/3161172645 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d4018070 con 0x7fc7c4004d40 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.086+0000 7fc7daffd640 1 -- 172.21.15.50:0/3161172645 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d400d970 con 0x7fc7c4004d40 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.086+0000 7fc7e44d0640 1 -- 172.21.15.50:0/3161172645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7dc150d00 con 0x7fc7c4004d40 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.086+0000 7fc7e44d0640 1 -- 172.21.15.50:0/3161172645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7dc15f550 con 0x7fc7c4004d40 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.088+0000 7fc7daffd640 1 -- 172.21.15.50:0/3161172645 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7d400db10 con 0x7fc7c4004d40 2024-09-11T22:23:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.088+0000 7fc7daffd640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc7c806be60 0x7fc7c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.088+0000 7fc7daffd640 1 -- 172.21.15.50:0/3161172645 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7fc7d408acb0 con 0x7fc7c4004d40 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.088+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc7c806be60 0x7fc7c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.089+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc7c806be60 0x7fc7c806e320 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc1f7700 tx=0x7fc7d0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.089+0000 7fc7e726c740 1 Processor -- start 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.089+0000 7fc7e726c740 1 -- start start 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e726c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 0x55559af609b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e726c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5dd90 0x55559af5f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e726c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 0x55559af40550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e726c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55559ae7c5d0 con 0x55559af5dd90 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e726c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55559ae24470 con 0x55559af5e1f0 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e726c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55559ae78590 con 0x55559af605d0 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e1a6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5dd90 0x55559af5f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e1a6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5dd90 0x55559af5f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41882/0 (socket says 172.21.15.50:41882) 2024-09-11T22:23:15.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e1a6b640 1 -- 172.21.15.50:0/3918275644 learned_addr learned my addr 172.21.15.50:0/3918275644 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e226c640 1 --2- 172.21.15.50:0/3918275644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 0x55559af609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e2a6d640 1 --2- 172.21.15.50:0/3918275644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 0x55559af40550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e1a6b640 1 -- 172.21.15.50:0/3918275644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 msgr2=0x55559af609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/3918275644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 0x55559af609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e1a6b640 1 -- 172.21.15.50:0/3918275644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 msgr2=0x55559af40550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/3918275644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 0x55559af40550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e1a6b640 1 -- 172.21.15.50:0/3918275644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55559ae0c860 con 0x55559af5dd90 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e226c640 1 --2- 172.21.15.50:0/3918275644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 0x55559af609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.090+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/3918275644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5dd90 0x55559af5f920 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0d24e0 tx=0x7fc7d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df809fbbeceed617 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.091+0000 7fc7c3fff640 1 -- 172.21.15.50:0/3918275644 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d001b070 con 0x55559af5dd90 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.091+0000 7fc7c3fff640 1 -- 172.21.15.50:0/3918275644 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d0015e30 con 0x55559af5dd90 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.091+0000 7fc7c3fff640 1 -- 172.21.15.50:0/3918275644 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d002a630 con 0x55559af5dd90 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.091+0000 7fc7e726c740 1 -- 172.21.15.50:0/3918275644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5dd90 msgr2=0x55559af5f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.091+0000 7fc7e726c740 1 --2- 172.21.15.50:0/3918275644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5dd90 0x55559af5f920 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0d24e0 tx=0x7fc7d0017000 comp rx=0 tx=0).stop 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.091+0000 7fc7e726c740 1 -- 172.21.15.50:0/3918275644 shutdown_connections 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.091+0000 7fc7e726c740 1 --2- 172.21.15.50:0/3918275644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 0x55559af40550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.091+0000 7fc7e726c740 1 --2- 172.21.15.50:0/3918275644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5dd90 0x55559af5f920 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.091+0000 7fc7e726c740 1 --2- 172.21.15.50:0/3918275644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 0x55559af609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.091+0000 7fc7e726c740 1 -- 172.21.15.50:0/3918275644 >> 172.21.15.50:0/3918275644 conn(0x55559af16230 msgr2=0x55559af5e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.092+0000 7fc7e726c740 1 -- 172.21.15.50:0/3918275644 shutdown_connections 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.092+0000 7fc7e726c740 1 -- 172.21.15.50:0/3918275644 wait complete. 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.092+0000 7fc7e726c740 1 -- start start 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.092+0000 7fc7e726c740 1 Processor -- start 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e726c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 0x55559af6e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e726c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 0x55559af56de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e726c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af43b10 0x55559af43f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e726c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55559af5ccf0 con 0x55559af43b10 2024-09-11T22:23:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e726c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55559ae05620 con 0x55559af5e1f0 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e726c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55559af5cfd0 con 0x55559af605d0 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e726c740 10 client.0 _ll_register_callbacks cb 0x55559ae295b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e2a6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af43b10 0x55559af43f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e2a6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af43b10 0x55559af43f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41884/0 (socket says 172.21.15.50:41884) 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e2a6d640 1 -- 172.21.15.50:0/2409289336 learned_addr learned my addr 172.21.15.50:0/2409289336 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/2409289336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 0x55559af56de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e226c640 1 --2- 172.21.15.50:0/2409289336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 0x55559af6e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e2a6d640 1 -- 172.21.15.50:0/2409289336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 msgr2=0x55559af56de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e2a6d640 1 --2- 172.21.15.50:0/2409289336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 0x55559af56de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e2a6d640 1 -- 172.21.15.50:0/2409289336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 msgr2=0x55559af6e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e2a6d640 1 --2- 172.21.15.50:0/2409289336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 0x55559af6e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.093+0000 7fc7e2a6d640 1 -- 172.21.15.50:0/2409289336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55559ab8f3f0 con 0x55559af43b10 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7e2a6d640 1 --2- 172.21.15.50:0/2409289336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af43b10 0x55559af43f90 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc02b470 tx=0x7fc7dc06c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0a41065a409193 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7c17fa640 1 -- 172.21.15.50:0/2409289336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc046060 con 0x55559af43b10 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7c17fa640 1 -- 172.21.15.50:0/2409289336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7fc7cc02bbd0 con 0x55559af43b10 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7e726c740 1 -- 172.21.15.50:0/2409289336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7d0015e30 con 0x55559af43b10 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7c17fa640 1 -- 172.21.15.50:0/2409289336 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7fc7cc02bdd0 con 0x55559af43b10 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7e726c740 10 client.10584 fetch_fsmap learned FSMap version 130 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7e726c740 1 -- 172.21.15.50:0/2409289336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55559ac597d0 con 0x55559af43b10 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7c17fa640 1 -- 172.21.15.50:0/2409289336 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d0015e30 con 0x55559af43b10 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7c17fa640 1 -- 172.21.15.50:0/2409289336 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7fc7cc034470 con 0x55559af43b10 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7e726c740 10 client.10584 fetch_fsmap finished waiting for FSMap version 130 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7e726c740 10 client.10584 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7e726c740 20 client.10584 populate_metadata read hostname 'smithi050' 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7e726c740 1 --2- 172.21.15.50:0/2409289336 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55559af559b0 0x55559af55dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7e726c740 4 client.10584 mds_command: new command op to 10320 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:23:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7e726c740 1 -- 172.21.15.50:0/2409289336 --> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55559aedb030 con 0x55559af559b0 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.094+0000 7fc7e226c640 1 --2- 172.21.15.50:0/2409289336 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55559af559b0 0x55559af55dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.095+0000 7fc7c17fa640 10 client.10584 ms_handle_connect on v2:172.21.15.50:6834/4092595783 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.095+0000 7fc7e226c640 1 --2- 172.21.15.50:0/2409289336 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55559af559b0 0x55559af55dd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=900458eadac45433 server_cookie=17c09bfc6d7fa681 in_seq=0 out_seq=0 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.095+0000 7fc7c17fa640 1 -- 172.21.15.50:0/2409289336 <== mds.0 v2:172.21.15.50:6834/4092595783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55559aedb030 con 0x55559af559b0 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.095+0000 7fc7c17fa640 10 client.10584 handle_command_reply: tid=0 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.095+0000 7fc7e726c740 1 client.10584 shutdown 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.095+0000 7fc7e726c740 1 -- 172.21.15.50:0/2409289336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af43b10 msgr2=0x55559af43f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.095+0000 7fc7e726c740 1 --2- 172.21.15.50:0/2409289336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af43b10 0x55559af43f90 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc02b470 tx=0x7fc7dc06c1b0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.096+0000 7fc7e726c740 1 -- 172.21.15.50:0/2409289336 shutdown_connections 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.096+0000 7fc7e726c740 1 --2- 172.21.15.50:0/2409289336 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55559af559b0 0x55559af55dd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.096+0000 7fc7e726c740 1 --2- 172.21.15.50:0/2409289336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 0x55559af56de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.096+0000 7fc7e726c740 1 --2- 172.21.15.50:0/2409289336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af43b10 0x55559af43f90 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.096+0000 7fc7c17fa640 0 client.10584 ms_handle_reset on v2:172.21.15.50:6834/4092595783 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.096+0000 7fc7e726c740 1 --2- 172.21.15.50:0/2409289336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 0x55559af6e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.096+0000 7fc7e726c740 1 -- 172.21.15.50:0/2409289336 >> 172.21.15.50:0/2409289336 conn(0x55559af5dd90 msgr2=0x55559af40b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:15.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.096+0000 7fc7e726c740 1 -- 172.21.15.50:0/2409289336 shutdown_connections 2024-09-11T22:23:15.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.096+0000 7fc7e726c740 1 -- 172.21.15.50:0/2409289336 wait complete. 2024-09-11T22:23:15.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.096+0000 7fc7e726c740 20 client.10584 trim_cache size 0 max 16384 2024-09-11T22:23:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.109+0000 7fc7e726c740 1 Processor -- start 2024-09-11T22:23:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.109+0000 7fc7e726c740 1 -- start start 2024-09-11T22:23:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e726c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af43b10 0x55559af5b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e726c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 0x55559af61fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e726c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af605d0 0x55559af5e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e726c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc201390 con 0x55559af605d0 2024-09-11T22:23:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e726c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc200370 con 0x55559af5e1f0 2024-09-11T22:23:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e726c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc7dc14ed10 con 0x55559af43b10 2024-09-11T22:23:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e2a6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af605d0 0x55559af5e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e2a6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af605d0 0x55559af5e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41888/0 (socket says 172.21.15.50:41888) 2024-09-11T22:23:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e2a6d640 1 -- 172.21.15.50:0/3029805570 learned_addr learned my addr 172.21.15.50:0/3029805570 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e226c640 1 --2- 172.21.15.50:0/3029805570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af43b10 0x55559af5b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/3029805570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 0x55559af61fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e2a6d640 1 -- 172.21.15.50:0/3029805570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af43b10 msgr2=0x55559af5b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e2a6d640 1 --2- 172.21.15.50:0/3029805570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af43b10 0x55559af5b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e2a6d640 1 -- 172.21.15.50:0/3029805570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 msgr2=0x55559af61fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e2a6d640 1 --2- 172.21.15.50:0/3029805570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 0x55559af61fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e2a6d640 1 -- 172.21.15.50:0/3029805570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55559af400c0 con 0x55559af605d0 2024-09-11T22:23:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.110+0000 7fc7e2a6d640 1 --2- 172.21.15.50:0/3029805570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af605d0 0x55559af5e5d0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0012f0 tx=0x7fc7cc041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd9a2ca6b370c41 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.111+0000 7fc7c37fe640 1 -- 172.21.15.50:0/3029805570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc046020 con 0x55559af605d0 2024-09-11T22:23:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.111+0000 7fc7c37fe640 1 -- 172.21.15.50:0/3029805570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7cc02f040 con 0x55559af605d0 2024-09-11T22:23:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.111+0000 7fc7c37fe640 1 -- 172.21.15.50:0/3029805570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc02b9d0 con 0x55559af605d0 2024-09-11T22:23:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.111+0000 7fc7e726c740 1 -- 172.21.15.50:0/3029805570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af605d0 msgr2=0x55559af5e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.111+0000 7fc7e726c740 1 --2- 172.21.15.50:0/3029805570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af605d0 0x55559af5e5d0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0012f0 tx=0x7fc7cc041000 comp rx=0 tx=0).stop 2024-09-11T22:23:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.111+0000 7fc7e726c740 1 -- 172.21.15.50:0/3029805570 shutdown_connections 2024-09-11T22:23:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.111+0000 7fc7e726c740 1 --2- 172.21.15.50:0/3029805570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af605d0 0x55559af5e5d0 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.111+0000 7fc7e726c740 1 --2- 172.21.15.50:0/3029805570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af5e1f0 0x55559af61fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.111+0000 7fc7e726c740 1 --2- 172.21.15.50:0/3029805570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af43b10 0x55559af5b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.111+0000 7fc7e726c740 1 -- 172.21.15.50:0/3029805570 >> 172.21.15.50:0/3029805570 conn(0x55559af5dd90 msgr2=0x55559af5f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.111+0000 7fc7e726c740 1 -- 172.21.15.50:0/3029805570 shutdown_connections 2024-09-11T22:23:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.111+0000 7fc7e726c740 1 -- 172.21.15.50:0/3029805570 wait complete. 2024-09-11T22:23:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.112+0000 7fc7e726c740 1 -- start start 2024-09-11T22:23:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.112+0000 7fc7e726c740 1 Processor -- start 2024-09-11T22:23:15.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e726c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af43b10 0x55559afd6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e726c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5e1f0 0x55559af3dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e726c740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 0x55559af3e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e726c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55559af57b00 con 0x55559af5e1f0 2024-09-11T22:23:15.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e726c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc1ffd10 con 0x55559af43b10 2024-09-11T22:23:15.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e726c740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55559af54cf0 con 0x55559af605d0 2024-09-11T22:23:15.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e726c740 10 client.0 _ll_register_callbacks cb 0x7fc7cc0011c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:23:15.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e1a6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5e1f0 0x55559af3dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e1a6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5e1f0 0x55559af3dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41904/0 (socket says 172.21.15.50:41904) 2024-09-11T22:23:15.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e1a6b640 1 -- 172.21.15.50:0/1232819823 learned_addr learned my addr 172.21.15.50:0/1232819823 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:15.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e2a6d640 1 --2- 172.21.15.50:0/1232819823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 0x55559af3e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e226c640 1 --2- 172.21.15.50:0/1232819823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af43b10 0x55559afd6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e1a6b640 1 -- 172.21.15.50:0/1232819823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 msgr2=0x55559af3e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/1232819823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 0x55559af3e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e1a6b640 1 -- 172.21.15.50:0/1232819823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af43b10 msgr2=0x55559afd6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/1232819823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af43b10 0x55559afd6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e1a6b640 1 -- 172.21.15.50:0/1232819823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55559af42000 con 0x55559af5e1f0 2024-09-11T22:23:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7e1a6b640 1 --2- 172.21.15.50:0/1232819823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5e1f0 0x55559af3dc80 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0027000 tx=0x7fc7d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae044a89ff64e994 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.113+0000 7fc7c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:23:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7c17fa640 1 -- 172.21.15.50:0/1232819823 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d001b040 con 0x55559af5e1f0 2024-09-11T22:23:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7c17fa640 1 -- 172.21.15.50:0/1232819823 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7fc7d0004250 con 0x55559af5e1f0 2024-09-11T22:23:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7e726c740 1 -- 172.21.15.50:0/1232819823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7cc02f040 con 0x55559af5e1f0 2024-09-11T22:23:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7c17fa640 1 -- 172.21.15.50:0/1232819823 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7fc7d0042050 con 0x55559af5e1f0 2024-09-11T22:23:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7e726c740 10 client.10590 fetch_fsmap learned FSMap version 130 2024-09-11T22:23:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7e726c740 1 -- 172.21.15.50:0/1232819823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x55559af71000 con 0x55559af5e1f0 2024-09-11T22:23:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7c17fa640 1 -- 172.21.15.50:0/1232819823 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7cc02f040 con 0x55559af5e1f0 2024-09-11T22:23:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7c17fa640 1 -- 172.21.15.50:0/1232819823 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7fc7d0045020 con 0x55559af5e1f0 2024-09-11T22:23:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7e726c740 10 client.10590 fetch_fsmap finished waiting for FSMap version 130 2024-09-11T22:23:15.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7e726c740 10 client.10590 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-11T22:23:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7e726c740 20 client.10590 populate_metadata read hostname 'smithi050' 2024-09-11T22:23:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7e726c740 1 --2- 172.21.15.50:0/1232819823 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55559af82d10 0x55559afdce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7e726c740 4 client.10590 mds_command: new command op to 10320 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:23:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7e726c740 1 -- 172.21.15.50:0/1232819823 --> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55559ae89d00 con 0x55559af82d10 2024-09-11T22:23:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.114+0000 7fc7e226c640 1 --2- 172.21.15.50:0/1232819823 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55559af82d10 0x55559afdce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7c17fa640 10 client.10590 ms_handle_connect on v2:172.21.15.50:6834/4092595783 2024-09-11T22:23:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7e226c640 1 --2- 172.21.15.50:0/1232819823 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55559af82d10 0x55559afdce60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2403d1e85db9e0f server_cookie=5b659e1eeb4af64f in_seq=0 out_seq=0 2024-09-11T22:23:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7c17fa640 1 -- 172.21.15.50:0/1232819823 <== mds.0 v2:172.21.15.50:6834/4092595783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55559ae89d00 con 0x55559af82d10 2024-09-11T22:23:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7c17fa640 10 client.10590 handle_command_reply: tid=0 2024-09-11T22:23:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7e726c740 1 client.10590 shutdown 2024-09-11T22:23:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7e726c740 1 -- 172.21.15.50:0/1232819823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5e1f0 msgr2=0x55559af3dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7e726c740 1 --2- 172.21.15.50:0/1232819823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5e1f0 0x55559af3dc80 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0027000 tx=0x7fc7d00046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7e726c740 1 -- 172.21.15.50:0/1232819823 shutdown_connections 2024-09-11T22:23:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7e726c740 1 --2- 172.21.15.50:0/1232819823 >> [v2:172.21.15.50:6834/4092595783,v1:172.21.15.50:6835/4092595783] conn(0x55559af82d10 0x55559afdce60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7e726c740 1 --2- 172.21.15.50:0/1232819823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55559af605d0 0x55559af3e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7c17fa640 0 client.10590 ms_handle_reset on v2:172.21.15.50:6834/4092595783 2024-09-11T22:23:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7e726c740 1 --2- 172.21.15.50:0/1232819823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55559af5e1f0 0x55559af3dc80 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7e726c740 1 --2- 172.21.15.50:0/1232819823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55559af43b10 0x55559afd6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7e726c740 1 -- 172.21.15.50:0/1232819823 >> 172.21.15.50:0/1232819823 conn(0x55559af5dd90 msgr2=0x55559af5b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7e726c740 1 -- 172.21.15.50:0/1232819823 shutdown_connections 2024-09-11T22:23:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7e726c740 1 -- 172.21.15.50:0/1232819823 wait complete. 2024-09-11T22:23:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.115+0000 7fc7e726c740 20 client.10590 trim_cache size 0 max 16384 2024-09-11T22:23:15.130 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-11T22:23:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.116+0000 7fc7e44d0640 1 -- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc7c806be60 msgr2=0x7fc7c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.116+0000 7fc7e44d0640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc7c806be60 0x7fc7c806e320 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc1f7700 tx=0x7fc7d0009190 comp rx=0 tx=0).stop 2024-09-11T22:23:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.116+0000 7fc7e44d0640 1 -- 172.21.15.50:0/3161172645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7c4004d40 msgr2=0x7fc7dc14d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.116+0000 7fc7e44d0640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7c4004d40 0x7fc7dc14d730 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400f7d0 tx=0x7fc7d400fc90 comp rx=0 tx=0).stop 2024-09-11T22:23:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.116+0000 7fc7e44d0640 1 -- 172.21.15.50:0/3161172645 shutdown_connections 2024-09-11T22:23:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.116+0000 7fc7e44d0640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fc7c806be60 0x7fc7c806e320 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.116+0000 7fc7e44d0640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7dc0b6f80 0x7fc7dc14ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.116+0000 7fc7e44d0640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7dc15fd50 0x7fc7dc0b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.116+0000 7fc7e44d0640 1 --2- 172.21.15.50:0/3161172645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7c4004d40 0x7fc7dc14d730 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.116+0000 7fc7e44d0640 1 -- 172.21.15.50:0/3161172645 >> 172.21.15.50:0/3161172645 conn(0x7fc7dc0b4150 msgr2=0x7fc7dc0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.116+0000 7fc7e44d0640 1 -- 172.21.15.50:0/3161172645 shutdown_connections 2024-09-11T22:23:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.116+0000 7fc7e44d0640 1 -- 172.21.15.50:0/3161172645 wait complete. 2024-09-11T22:23:15.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T22:23:15.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.234+0000 7f6c46f5f640 1 Processor -- start 2024-09-11T22:23:15.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.234+0000 7f6c46f5f640 1 -- start start 2024-09-11T22:23:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c46f5f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6c4015aad0 0x7f6c40072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c46f5f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4006d780 0x7f6c400b3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c46f5f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c400b5020 con 0x7f6c4015bb00 2024-09-11T22:23:15.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c46f5f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6c4015aeb0 con 0x7f6c4015aad0 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c46f5f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6c400714d0 con 0x7f6c4006d780 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c37fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6c4015bb00 0x7f6c4006d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60706/0 (socket says 172.21.15.50:60706) 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c37fff640 1 -- 172.21.15.50:0/2778140895 learned_addr learned my addr 172.21.15.50:0/2778140895 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c454fc640 1 --2- 172.21.15.50:0/2778140895 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4006d780 0x7f6c400b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 719131801 0 0) 0x7f6c400b5020 con 0x7f6c4015bb00 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c44cfb640 1 --2- 172.21.15.50:0/2778140895 >> v2:172.21.15.77:3300/0 conn(0x7f6c4015aad0 0x7f6c40072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c28003520 con 0x7f6c4015bb00 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2779614105 0 0) 0x7f6c28003520 con 0x7f6c4015bb00 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4006d780 msgr2=0x7f6c400b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c377fe640 1 --2- 172.21.15.50:0/2778140895 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4006d780 0x7f6c400b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 >> v2:172.21.15.77:3300/0 conn(0x7f6c4015aad0 msgr2=0x7f6c40072cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c377fe640 1 --2- 172.21.15.50:0/2778140895 >> v2:172.21.15.77:3300/0 conn(0x7f6c4015aad0 0x7f6c40072cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c400717b0 con 0x7f6c4015bb00 2024-09-11T22:23:15.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.235+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f6c30001670 con 0x7f6c4015bb00 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 >> v1:172.21.15.50:6789/0 conn(0x7f6c4015bb00 legacy=0x7f6c4006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c377fe640 1 --2- 172.21.15.50:0/2778140895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c280039b0 0x7f6c28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c377fe640 1 --2- 172.21.15.50:0/2778140895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c28004800 0x7f6c28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c377fe640 1 --2- 172.21.15.50:0/2778140895 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4006d780 0x7f6c280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4015aeb0 con 0x7f6c28004800 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c400714d0 con 0x7f6c280039b0 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2800dbd0 con 0x7f6c4006d780 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c37fff640 1 --2- 172.21.15.50:0/2778140895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c28004800 0x7f6c28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c44cfb640 1 --2- 172.21.15.50:0/2778140895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c280039b0 0x7f6c28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c454fc640 1 --2- 172.21.15.50:0/2778140895 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4006d780 0x7f6c280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c37fff640 1 -- 172.21.15.50:0/2778140895 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4006d780 msgr2=0x7f6c280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c37fff640 1 --2- 172.21.15.50:0/2778140895 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4006d780 0x7f6c280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c37fff640 1 -- 172.21.15.50:0/2778140895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c280039b0 msgr2=0x7f6c28003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c37fff640 1 --2- 172.21.15.50:0/2778140895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c280039b0 0x7f6c28003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.236+0000 7f6c37fff640 1 -- 172.21.15.50:0/2778140895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c28003520 con 0x7f6c28004800 2024-09-11T22:23:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.237+0000 7f6c37fff640 1 --2- 172.21.15.50:0/2778140895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c28004800 0x7f6c28004c80 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f6c30007fd0 tx=0x7f6c28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317c88e4080cf3f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.237+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30007d50 con 0x7f6c28004800 2024-09-11T22:23:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.237+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c30005ad0 con 0x7f6c28004800 2024-09-11T22:23:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.237+0000 7f6c377fe640 1 -- 172.21.15.50:0/2778140895 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30007070 con 0x7f6c28004800 2024-09-11T22:23:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.237+0000 7f6c46f5f640 1 -- 172.21.15.50:0/2778140895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c28004800 msgr2=0x7f6c28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.237+0000 7f6c46f5f640 1 --2- 172.21.15.50:0/2778140895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c28004800 0x7f6c28004c80 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f6c30007fd0 tx=0x7f6c28005830 comp rx=0 tx=0).stop 2024-09-11T22:23:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.237+0000 7f6c454fc640 1 -- 172.21.15.50:0/2778140895 reap_dead start 2024-09-11T22:23:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.237+0000 7f6c46f5f640 1 -- 172.21.15.50:0/2778140895 shutdown_connections 2024-09-11T22:23:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.237+0000 7f6c46f5f640 1 -- 172.21.15.50:0/2778140895 >> 172.21.15.50:0/2778140895 conn(0x7f6c400679c0 msgr2=0x7f6c40067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.238+0000 7f6c46f5f640 1 -- 172.21.15.50:0/2778140895 shutdown_connections 2024-09-11T22:23:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.238+0000 7f6c46f5f640 1 -- 172.21.15.50:0/2778140895 wait complete. 2024-09-11T22:23:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.239+0000 7f6c46f5f640 1 Processor -- start 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.239+0000 7f6c46f5f640 1 -- start start 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c46f5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c28004800 0x7f6c4014e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c46f5f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c400ae8e0 0x7f6c400cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c46f5f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c400c7e50 0x7f6c400c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c46f5f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4015bf50 con 0x7f6c28004800 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c46f5f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c40071d70 con 0x7f6c400c7e50 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c46f5f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6c40072290 con 0x7f6c400ae8e0 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c44cfb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c28004800 0x7f6c4014e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c44cfb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c28004800 0x7f6c4014e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41918/0 (socket says 172.21.15.50:41918) 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c44cfb640 1 -- 172.21.15.50:0/3298623031 learned_addr learned my addr 172.21.15.50:0/3298623031 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c37fff640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c400ae8e0 0x7f6c400cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c454fc640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c400c7e50 0x7f6c400c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c44cfb640 1 -- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c400ae8e0 msgr2=0x7f6c400cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c44cfb640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c400ae8e0 0x7f6c400cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c44cfb640 1 -- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c400c7e50 msgr2=0x7f6c400c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c44cfb640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c400c7e50 0x7f6c400c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c44cfb640 1 -- 172.21.15.50:0/3298623031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4014ecc0 con 0x7f6c28004800 2024-09-11T22:23:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c44cfb640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c28004800 0x7f6c4014e780 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c011960 tx=0x7f6c3c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c357fa640 1 -- 172.21.15.50:0/3298623031 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c00faf0 con 0x7f6c28004800 2024-09-11T22:23:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c357fa640 1 -- 172.21.15.50:0/3298623031 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c00fc90 con 0x7f6c28004800 2024-09-11T22:23:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c357fa640 1 -- 172.21.15.50:0/3298623031 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c014440 con 0x7f6c28004800 2024-09-11T22:23:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c46f5f640 1 -- 172.21.15.50:0/3298623031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c400ad840 con 0x7f6c28004800 2024-09-11T22:23:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.240+0000 7f6c46f5f640 1 -- 172.21.15.50:0/3298623031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c400ade00 con 0x7f6c28004800 2024-09-11T22:23:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.241+0000 7f6c46f5f640 1 -- 172.21.15.50:0/3298623031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c40072cb0 con 0x7f6c28004800 2024-09-11T22:23:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.242+0000 7f6c357fa640 1 -- 172.21.15.50:0/3298623031 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c3c012040 con 0x7f6c28004800 2024-09-11T22:23:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.242+0000 7f6c357fa640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c2c06be60 0x7f6c2c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.242+0000 7f6c357fa640 1 -- 172.21.15.50:0/3298623031 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f6c3c08b520 con 0x7f6c28004800 2024-09-11T22:23:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.243+0000 7f6c37fff640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c2c06be60 0x7f6c2c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.243+0000 7f6c37fff640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c2c06be60 0x7f6c2c06e320 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6c30033000 tx=0x7f6c30009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.247+0000 7f6c357fa640 1 -- 172.21.15.50:0/3298623031 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c4014ecc0 con 0x7f6c28004800 2024-09-11T22:23:15.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.459+0000 7f6c46f5f640 1 -- 172.21.15.50:0/3298623031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6c400cef40 con 0x7f6c28004800 2024-09-11T22:23:15.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.459+0000 7f6c357fa640 1 -- 172.21.15.50:0/3298623031 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6c3c019030 con 0x7f6c28004800 2024-09-11T22:23:15.460 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:15.460 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T22:23:15.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.461+0000 7f6c46f5f640 1 -- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c2c06be60 msgr2=0x7f6c2c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.461+0000 7f6c46f5f640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c2c06be60 0x7f6c2c06e320 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6c30033000 tx=0x7f6c30009030 comp rx=0 tx=0).stop 2024-09-11T22:23:15.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.461+0000 7f6c46f5f640 1 -- 172.21.15.50:0/3298623031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c28004800 msgr2=0x7f6c4014e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.461+0000 7f6c46f5f640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c28004800 0x7f6c4014e780 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c011960 tx=0x7f6c3c011e20 comp rx=0 tx=0).stop 2024-09-11T22:23:15.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.462+0000 7f6c46f5f640 1 -- 172.21.15.50:0/3298623031 shutdown_connections 2024-09-11T22:23:15.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.462+0000 7f6c46f5f640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6c2c06be60 0x7f6c2c06e320 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.462+0000 7f6c46f5f640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c400ae8e0 0x7f6c400cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.462+0000 7f6c46f5f640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c400c7e50 0x7f6c400c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.462+0000 7f6c46f5f640 1 --2- 172.21.15.50:0/3298623031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c28004800 0x7f6c4014e780 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.462+0000 7f6c46f5f640 1 -- 172.21.15.50:0/3298623031 >> 172.21.15.50:0/3298623031 conn(0x7f6c400679c0 msgr2=0x7f6c400ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:15.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.462+0000 7f6c46f5f640 1 -- 172.21.15.50:0/3298623031 shutdown_connections 2024-09-11T22:23:15.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.462+0000 7f6c46f5f640 1 -- 172.21.15.50:0/3298623031 wait complete. 2024-09-11T22:23:15.473 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:23:15.474 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:23:15.510 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:23:15.553 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:23:15.553 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:23:15.554 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:23:15.554 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:23:15.571 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:23:15.571 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:23:15.628 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:23:15.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.771+0000 7f2904159640 1 Processor -- start 2024-09-11T22:23:15.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.771+0000 7f2904159640 1 -- start start 2024-09-11T22:23:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.772+0000 7f2904159640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28fc15c2c0 0x7f28fc0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.772+0000 7f2904159640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28fc0b3e10 0x7f28fc0cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.772+0000 7f2904159640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28fc0b4f00 con 0x7f28fc0d0410 2024-09-11T22:23:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.772+0000 7f2904159640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f28fc0cf7a0 con 0x7f28fc0b3e10 2024-09-11T22:23:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.772+0000 7f2904159640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f28fc0d0840 con 0x7f28fc15c2c0 2024-09-11T22:23:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.772+0000 7f29016f4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28fc0b3e10 0x7f28fc0cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.772+0000 7f29016f4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28fc0b3e10 0x7f28fc0cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41922/0 (socket says 172.21.15.50:41922) 2024-09-11T22:23:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.772+0000 7f29016f4640 1 -- 172.21.15.50:0/1749827607 learned_addr learned my addr 172.21.15.50:0/1749827607 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.772+0000 7f2901ef5640 1 --2- 172.21.15.50:0/1749827607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28fc15c2c0 0x7f28fc0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.772+0000 7f29016f4640 1 -- 172.21.15.50:0/1749827607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28fc15c2c0 msgr2=0x7f28fc0b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.772+0000 7f29016f4640 1 --2- 172.21.15.50:0/1749827607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28fc15c2c0 0x7f28fc0b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.772+0000 7f29016f4640 1 -- 172.21.15.50:0/1749827607 >> v1:172.21.15.77:6789/0 conn(0x7f28fc0d0410 legacy=0x7f28fc15fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.772+0000 7f29016f4640 1 -- 172.21.15.50:0/1749827607 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc0b4360 con 0x7f28fc0b3e10 2024-09-11T22:23:15.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.773+0000 7f29016f4640 1 --2- 172.21.15.50:0/1749827607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28fc0b3e10 0x7f28fc0cfed0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009870 tx=0x7f28f802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6012e42d706c250 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:15.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.773+0000 7f2900ef3640 1 -- 172.21.15.50:0/1749827607 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8037070 con 0x7f28fc0b3e10 2024-09-11T22:23:15.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.773+0000 7f2900ef3640 1 -- 172.21.15.50:0/1749827607 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f8032440 con 0x7f28fc0b3e10 2024-09-11T22:23:15.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.773+0000 7f2900ef3640 1 -- 172.21.15.50:0/1749827607 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8032810 con 0x7f28fc0b3e10 2024-09-11T22:23:15.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.774+0000 7f2904159640 1 -- 172.21.15.50:0/1749827607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28fc0b3e10 msgr2=0x7f28fc0cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.774+0000 7f2904159640 1 --2- 172.21.15.50:0/1749827607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28fc0b3e10 0x7f28fc0cfed0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009870 tx=0x7f28f802a1c0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.774+0000 7f2904159640 1 -- 172.21.15.50:0/1749827607 shutdown_connections 2024-09-11T22:23:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.774+0000 7f2904159640 1 --2- 172.21.15.50:0/1749827607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28fc0b3e10 0x7f28fc0cfed0 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.774+0000 7f2904159640 1 --2- 172.21.15.50:0/1749827607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28fc15c2c0 0x7f28fc0b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.774+0000 7f2904159640 1 -- 172.21.15.50:0/1749827607 >> 172.21.15.50:0/1749827607 conn(0x7f28fc0679c0 msgr2=0x7f28fc067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.774+0000 7f2904159640 1 -- 172.21.15.50:0/1749827607 shutdown_connections 2024-09-11T22:23:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.774+0000 7f2904159640 1 -- 172.21.15.50:0/1749827607 wait complete. 2024-09-11T22:23:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.775+0000 7f2904159640 1 Processor -- start 2024-09-11T22:23:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.775+0000 7f2904159640 1 -- start start 2024-09-11T22:23:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.776+0000 7f2904159640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28fc0b3e10 0x7f28fc154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.776+0000 7f2904159640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28fc0d0410 0x7f28fc157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.776+0000 7f2904159640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15c2c0 0x7f28fc143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.776+0000 7f2904159640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc0cfc10 con 0x7f28fc0b3e10 2024-09-11T22:23:15.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.776+0000 7f2904159640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc0b54a0 con 0x7f28fc15c2c0 2024-09-11T22:23:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.776+0000 7f2904159640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f28fc0ce200 con 0x7f28fc0d0410 2024-09-11T22:23:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.776+0000 7f2901ef5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28fc0b3e10 0x7f28fc154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.776+0000 7f2901ef5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28fc0b3e10 0x7f28fc154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41934/0 (socket says 172.21.15.50:41934) 2024-09-11T22:23:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.776+0000 7f2901ef5640 1 -- 172.21.15.50:0/3186354046 learned_addr learned my addr 172.21.15.50:0/3186354046 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.776+0000 7f29016f4640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28fc0d0410 0x7f28fc157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.776+0000 7f29026f6640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15c2c0 0x7f28fc143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.777+0000 7f2901ef5640 1 -- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28fc0d0410 msgr2=0x7f28fc157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.777+0000 7f2901ef5640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28fc0d0410 0x7f28fc157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.777+0000 7f2901ef5640 1 -- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15c2c0 msgr2=0x7f28fc143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.777+0000 7f2901ef5640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15c2c0 0x7f28fc143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.777+0000 7f2901ef5640 1 -- 172.21.15.50:0/3186354046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc14f960 con 0x7f28fc0b3e10 2024-09-11T22:23:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.777+0000 7f29016f4640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28fc0d0410 0x7f28fc157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.777+0000 7f29026f6640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15c2c0 0x7f28fc143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.777+0000 7f2901ef5640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28fc0b3e10 0x7f28fc154cf0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00d830 tx=0x7f28ec00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.777+0000 7f28f27fc640 1 -- 172.21.15.50:0/3186354046 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec00b660 con 0x7f28fc0b3e10 2024-09-11T22:23:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.777+0000 7f28f27fc640 1 -- 172.21.15.50:0/3186354046 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ec019070 con 0x7f28fc0b3e10 2024-09-11T22:23:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.777+0000 7f2904159640 1 -- 172.21.15.50:0/3186354046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28fc14fc40 con 0x7f28fc0b3e10 2024-09-11T22:23:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.777+0000 7f28f27fc640 1 -- 172.21.15.50:0/3186354046 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec00ba60 con 0x7f28fc0b3e10 2024-09-11T22:23:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.777+0000 7f2904159640 1 -- 172.21.15.50:0/3186354046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28fc150200 con 0x7f28fc0b3e10 2024-09-11T22:23:15.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.778+0000 7f2904159640 1 -- 172.21.15.50:0/3186354046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28fc06d070 con 0x7f28fc0b3e10 2024-09-11T22:23:15.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.779+0000 7f28f27fc640 1 -- 172.21.15.50:0/3186354046 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28ec01e460 con 0x7f28fc0b3e10 2024-09-11T22:23:15.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.779+0000 7f28f27fc640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f28e006be60 0x7f28e006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:15.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.779+0000 7f28f27fc640 1 -- 172.21.15.50:0/3186354046 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f28ec08b440 con 0x7f28fc0b3e10 2024-09-11T22:23:15.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.779+0000 7f29016f4640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f28e006be60 0x7f28e006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:15.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.780+0000 7f29016f4640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f28e006be60 0x7f28e006e320 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f28f8034000 tx=0x7f28f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:15.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.783+0000 7f28f27fc640 1 -- 172.21.15.50:0/3186354046 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f28ec059e80 con 0x7f28fc0b3e10 2024-09-11T22:23:15.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.970+0000 7f2904159640 1 -- 172.21.15.50:0/3186354046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f28fc159420 con 0x7f28fc0b3e10 2024-09-11T22:23:15.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.970+0000 7f28f27fc640 1 -- 172.21.15.50:0/3186354046 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v178) ==== 80+0+0 (secure 0 0 0) 0x7f28ec059780 con 0x7f28fc0b3e10 2024-09-11T22:23:15.971 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:23:15.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.972+0000 7f2904159640 1 -- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f28e006be60 msgr2=0x7f28e006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.972+0000 7f2904159640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f28e006be60 0x7f28e006e320 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f28f8034000 tx=0x7f28f802e000 comp rx=0 tx=0).stop 2024-09-11T22:23:15.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.972+0000 7f2904159640 1 -- 172.21.15.50:0/3186354046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28fc0b3e10 msgr2=0x7f28fc154cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.972+0000 7f2904159640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28fc0b3e10 0x7f28fc154cf0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00d830 tx=0x7f28ec00dcf0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.972+0000 7f2904159640 1 -- 172.21.15.50:0/3186354046 shutdown_connections 2024-09-11T22:23:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.972+0000 7f2904159640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f28e006be60 0x7f28e006e320 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.972+0000 7f2904159640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28fc0d0410 0x7f28fc157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.972+0000 7f2904159640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc15c2c0 0x7f28fc143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.972+0000 7f2904159640 1 --2- 172.21.15.50:0/3186354046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28fc0b3e10 0x7f28fc154cf0 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.973+0000 7f2904159640 1 -- 172.21.15.50:0/3186354046 >> 172.21.15.50:0/3186354046 conn(0x7f28fc0679c0 msgr2=0x7f28fc14ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.973+0000 7f2904159640 1 -- 172.21.15.50:0/3186354046 shutdown_connections 2024-09-11T22:23:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:15.973+0000 7f2904159640 1 -- 172.21.15.50:0/3186354046 wait complete. 2024-09-11T22:23:15.984 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:23:15.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:15.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:23:16.014 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:23:16.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:16.014 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:23:16.071 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:23:16.071 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:23:16.071 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:23:16.090 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:23:16.090 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:23:16.091 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:23:16.091 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:23:16.126 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:23:16.127 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:23:16.127 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:23:16.127 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:23:16.148 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:23:16.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:23:16.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.268+0000 7f81b074b640 1 Processor -- start 2024-09-11T22:23:16.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.268+0000 7f81b074b640 1 -- start start 2024-09-11T22:23:16.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.269+0000 7f81b074b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f81a815ffb0 0x7f81a80d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.269+0000 7f81b074b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81a80b3a40 0x7f81a80d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.269+0000 7f81b074b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81a80d0ee0 0x7f81a8160470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.269+0000 7f81b074b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f81a80b2890 con 0x7f81a80b3a40 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.269+0000 7f81b074b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f81a80b2b70 con 0x7f81a815ffb0 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.269+0000 7f81b074b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f81a80b2e50 con 0x7f81a80d0ee0 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.269+0000 7f81adce6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81a80b3a40 0x7f81a80d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.269+0000 7f81adce6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81a80b3a40 0x7f81a80d09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41948/0 (socket says 172.21.15.50:41948) 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.269+0000 7f81adce6640 1 -- 172.21.15.50:0/2832641305 learned_addr learned my addr 172.21.15.50:0/2832641305 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.269+0000 7f81aece8640 1 --2- 172.21.15.50:0/2832641305 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81a80d0ee0 0x7f81a8160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.269+0000 7f81ae4e7640 1 --2- 172.21.15.50:0/2832641305 >> v2:172.21.15.77:3300/0 conn(0x7f81a815ffb0 0x7f81a80d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.270+0000 7f81adce6640 1 -- 172.21.15.50:0/2832641305 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81a80d0ee0 msgr2=0x7f81a8160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.270+0000 7f81adce6640 1 --2- 172.21.15.50:0/2832641305 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81a80d0ee0 0x7f81a8160470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.270+0000 7f81adce6640 1 -- 172.21.15.50:0/2832641305 >> v2:172.21.15.77:3300/0 conn(0x7f81a815ffb0 msgr2=0x7f81a80d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.270+0000 7f81adce6640 1 --2- 172.21.15.50:0/2832641305 >> v2:172.21.15.77:3300/0 conn(0x7f81a815ffb0 0x7f81a80d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.270+0000 7f81adce6640 1 -- 172.21.15.50:0/2832641305 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a80b3130 con 0x7f81a80b3a40 2024-09-11T22:23:16.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.270+0000 7f81ae4e7640 1 --2- 172.21.15.50:0/2832641305 >> v2:172.21.15.77:3300/0 conn(0x7f81a815ffb0 0x7f81a80d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:16.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.270+0000 7f81aece8640 1 --2- 172.21.15.50:0/2832641305 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81a80d0ee0 0x7f81a8160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.270+0000 7f81adce6640 1 --2- 172.21.15.50:0/2832641305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a80b3a40 0x7f81a80d09a0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f81a8072e10 tx=0x7f819c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4668bedef3f49848 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.270+0000 7f81ad4e5640 1 -- 172.21.15.50:0/2832641305 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c037070 con 0x7f81a80b3a40 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.271+0000 7f81ad4e5640 1 -- 172.21.15.50:0/2832641305 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f819c032440 con 0x7f81a80b3a40 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.271+0000 7f81ad4e5640 1 -- 172.21.15.50:0/2832641305 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c032810 con 0x7f81a80b3a40 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.271+0000 7f81b074b640 1 -- 172.21.15.50:0/2832641305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a80b3a40 msgr2=0x7f81a80d09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.271+0000 7f81b074b640 1 --2- 172.21.15.50:0/2832641305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a80b3a40 0x7f81a80d09a0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f81a8072e10 tx=0x7f819c02a140 comp rx=0 tx=0).stop 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.271+0000 7f81b074b640 1 -- 172.21.15.50:0/2832641305 shutdown_connections 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.271+0000 7f81b074b640 1 --2- 172.21.15.50:0/2832641305 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81a80d0ee0 0x7f81a8160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.271+0000 7f81b074b640 1 --2- 172.21.15.50:0/2832641305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a80b3a40 0x7f81a80d09a0 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.271+0000 7f81b074b640 1 --2- 172.21.15.50:0/2832641305 >> v2:172.21.15.77:3300/0 conn(0x7f81a815ffb0 0x7f81a80d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.271+0000 7f81b074b640 1 -- 172.21.15.50:0/2832641305 >> 172.21.15.50:0/2832641305 conn(0x7f81a80b40b0 msgr2=0x7f81a80b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.271+0000 7f81b074b640 1 -- 172.21.15.50:0/2832641305 shutdown_connections 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.271+0000 7f81b074b640 1 -- 172.21.15.50:0/2832641305 wait complete. 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.272+0000 7f81b074b640 1 Processor -- start 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.273+0000 7f81b074b640 1 -- start start 2024-09-11T22:23:16.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.273+0000 7f81b074b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81a80b3a40 0x7f81a80c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.273+0000 7f81b074b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a80d0ee0 0x7f81a8156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.273+0000 7f81b074b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81a815ffb0 0x7f81a80c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.273+0000 7f81b074b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f81a8160b30 con 0x7f81a80d0ee0 2024-09-11T22:23:16.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.273+0000 7f81b074b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81a81609b0 con 0x7f81a80b3a40 2024-09-11T22:23:16.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.273+0000 7f81b074b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f81a8160cb0 con 0x7f81a815ffb0 2024-09-11T22:23:16.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.273+0000 7f81adce6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a80d0ee0 0x7f81a8156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.273+0000 7f81adce6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a80d0ee0 0x7f81a8156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41958/0 (socket says 172.21.15.50:41958) 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.273+0000 7f81adce6640 1 -- 172.21.15.50:0/2945125999 learned_addr learned my addr 172.21.15.50:0/2945125999 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.273+0000 7f81aece8640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81a815ffb0 0x7f81a80c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.273+0000 7f81ae4e7640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81a80b3a40 0x7f81a80c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.274+0000 7f81adce6640 1 -- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81a815ffb0 msgr2=0x7f81a80c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.274+0000 7f81adce6640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81a815ffb0 0x7f81a80c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.274+0000 7f81adce6640 1 -- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81a80b3a40 msgr2=0x7f81a80c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.274+0000 7f81adce6640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81a80b3a40 0x7f81a80c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.274+0000 7f81adce6640 1 -- 172.21.15.50:0/2945125999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a80ca1b0 con 0x7f81a80d0ee0 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.274+0000 7f81ae4e7640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81a80b3a40 0x7f81a80c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.274+0000 7f81adce6640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a80d0ee0 0x7f81a8156b40 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f819c000c00 tx=0x7f819c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.274+0000 7f81a6ffd640 1 -- 172.21.15.50:0/2945125999 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c041020 con 0x7f81a80d0ee0 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.274+0000 7f81a6ffd640 1 -- 172.21.15.50:0/2945125999 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f819c0306c0 con 0x7f81a80d0ee0 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.274+0000 7f81b074b640 1 -- 172.21.15.50:0/2945125999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a80af510 con 0x7f81a80d0ee0 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.274+0000 7f81a6ffd640 1 -- 172.21.15.50:0/2945125999 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c037040 con 0x7f81a80d0ee0 2024-09-11T22:23:16.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.274+0000 7f81b074b640 1 -- 172.21.15.50:0/2945125999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a81f88b0 con 0x7f81a80d0ee0 2024-09-11T22:23:16.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.275+0000 7f81b074b640 1 -- 172.21.15.50:0/2945125999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a80b4e80 con 0x7f81a80d0ee0 2024-09-11T22:23:16.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.276+0000 7f81a6ffd640 1 -- 172.21.15.50:0/2945125999 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f819c044020 con 0x7f81a80d0ee0 2024-09-11T22:23:16.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.276+0000 7f81a6ffd640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f819406be60 0x7f819406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.276+0000 7f81a6ffd640 1 -- 172.21.15.50:0/2945125999 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f819c0ab590 con 0x7f81a80d0ee0 2024-09-11T22:23:16.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.276+0000 7f81ae4e7640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f819406be60 0x7f819406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.277+0000 7f81ae4e7640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f819406be60 0x7f819406e320 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f81a80b1eb0 tx=0x7f81a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:16.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.281+0000 7f81a6ffd640 1 -- 172.21.15.50:0/2945125999 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f819c04b030 con 0x7f81a80d0ee0 2024-09-11T22:23:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.494+0000 7f81b074b640 1 -- 172.21.15.50:0/2945125999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81a80b84e0 con 0x7f81a80d0ee0 2024-09-11T22:23:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.495+0000 7f81a6ffd640 1 -- 172.21.15.50:0/2945125999 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+5239 (secure 0 0 0) 0x7f81a80ca1b0 con 0x7f81a80d0ee0 2024-09-11T22:23:16.496 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:16.496 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":130,"btime":"2024-09-11T22:22:35:871475+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2188519592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2188519592},{"type":"v1","addr":"172.21.15.77:6836","nonce":2188519592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8165,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3754154405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3754154405},{"type":"v1","addr":"172.21.15.77:6837","nonce":3754154405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":127},{"gid":10317,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1024203584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1024203584},{"type":"v1","addr":"172.21.15.50:6833","nonce":1024203584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:22:33.219787+0000","modified":"2024-09-11T22:22:35.216759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10320":{"gid":10320,"name":"c","rank":0,"incarnation":128,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4092595783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4092595783},{"type":"v1","addr":"172.21.15.50:6835","nonce":4092595783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10320,"qdb_cluster":[10320]},"id":13}]} 2024-09-11T22:23:16.496 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 130 2024-09-11T22:23:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.497+0000 7f81b074b640 1 -- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f819406be60 msgr2=0x7f819406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.497+0000 7f81b074b640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f819406be60 0x7f819406e320 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f81a80b1eb0 tx=0x7f81a0008040 comp rx=0 tx=0).stop 2024-09-11T22:23:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.497+0000 7f81b074b640 1 -- 172.21.15.50:0/2945125999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a80d0ee0 msgr2=0x7f81a8156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.497+0000 7f81b074b640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a80d0ee0 0x7f81a8156b40 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f819c000c00 tx=0x7f819c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.497+0000 7f81b074b640 1 -- 172.21.15.50:0/2945125999 shutdown_connections 2024-09-11T22:23:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.497+0000 7f81b074b640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f819406be60 0x7f819406e320 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.497+0000 7f81b074b640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81a815ffb0 0x7f81a80c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.497+0000 7f81b074b640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81a80d0ee0 0x7f81a8156b40 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.497+0000 7f81b074b640 1 --2- 172.21.15.50:0/2945125999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81a80b3a40 0x7f81a80c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.497+0000 7f81b074b640 1 -- 172.21.15.50:0/2945125999 >> 172.21.15.50:0/2945125999 conn(0x7f81a80b40b0 msgr2=0x7f81a80cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:16.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.497+0000 7f81b074b640 1 -- 172.21.15.50:0/2945125999 shutdown_connections 2024-09-11T22:23:16.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.497+0000 7f81b074b640 1 -- 172.21.15.50:0/2945125999 wait complete. 2024-09-11T22:23:16.511 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:23:16.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.613+0000 7f9b3d16f640 1 Processor -- start 2024-09-11T22:23:16.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.613+0000 7f9b3d16f640 1 -- start start 2024-09-11T22:23:16.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.613+0000 7f9b3d16f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9b38161fa0 0x7f9b380b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.613+0000 7f9b3d16f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b380b1600 0x7f9b380cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.613+0000 7f9b3d16f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b380cf440 0x7f9b3806bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.613+0000 7f9b3d16f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9b380d1220 con 0x7f9b380b1600 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.613+0000 7f9b3d16f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9b380d17e0 con 0x7f9b38161fa0 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.613+0000 7f9b3d16f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9b380cfbd0 con 0x7f9b380cf440 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.614+0000 7f9b3659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b380b1600 0x7f9b380cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.614+0000 7f9b3659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b380b1600 0x7f9b380cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41970/0 (socket says 172.21.15.50:41970) 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.614+0000 7f9b3659c640 1 -- 172.21.15.50:0/3686810579 learned_addr learned my addr 172.21.15.50:0/3686810579 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.614+0000 7f9b36d9d640 1 --2- 172.21.15.50:0/3686810579 >> v2:172.21.15.77:3300/0 conn(0x7f9b38161fa0 0x7f9b380b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.614+0000 7f9b3759e640 1 --2- 172.21.15.50:0/3686810579 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b380cf440 0x7f9b3806bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.614+0000 7f9b3659c640 1 -- 172.21.15.50:0/3686810579 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b380cf440 msgr2=0x7f9b3806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.614+0000 7f9b3659c640 1 --2- 172.21.15.50:0/3686810579 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b380cf440 0x7f9b3806bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.614+0000 7f9b3659c640 1 -- 172.21.15.50:0/3686810579 >> v2:172.21.15.77:3300/0 conn(0x7f9b38161fa0 msgr2=0x7f9b380b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:16.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.614+0000 7f9b3659c640 1 --2- 172.21.15.50:0/3686810579 >> v2:172.21.15.77:3300/0 conn(0x7f9b38161fa0 0x7f9b380b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.614+0000 7f9b3659c640 1 -- 172.21.15.50:0/3686810579 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b380cfeb0 con 0x7f9b380b1600 2024-09-11T22:23:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.615+0000 7f9b3659c640 1 --2- 172.21.15.50:0/3686810579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b380b1600 0x7f9b380cef00 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f9b38072960 tx=0x7f9b2002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af4c2300a236b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.615+0000 7f9b35d9b640 1 -- 172.21.15.50:0/3686810579 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20037070 con 0x7f9b380b1600 2024-09-11T22:23:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.615+0000 7f9b35d9b640 1 -- 172.21.15.50:0/3686810579 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b20032440 con 0x7f9b380b1600 2024-09-11T22:23:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.615+0000 7f9b35d9b640 1 -- 172.21.15.50:0/3686810579 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20032810 con 0x7f9b380b1600 2024-09-11T22:23:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.615+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3686810579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b380b1600 msgr2=0x7f9b380cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.615+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/3686810579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b380b1600 0x7f9b380cef00 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f9b38072960 tx=0x7f9b2002a1e0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.615+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3686810579 shutdown_connections 2024-09-11T22:23:16.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.615+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/3686810579 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b380cf440 0x7f9b3806bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.615+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/3686810579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b380b1600 0x7f9b380cef00 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.615+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/3686810579 >> v2:172.21.15.77:3300/0 conn(0x7f9b38161fa0 0x7f9b380b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.615+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3686810579 >> 172.21.15.50:0/3686810579 conn(0x7f9b3809ba50 msgr2=0x7f9b380b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.615+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3686810579 shutdown_connections 2024-09-11T22:23:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.615+0000 7f9b3d16f640 1 -- 172.21.15.50:0/3686810579 wait complete. 2024-09-11T22:23:16.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.617+0000 7f9b3d16f640 1 Processor -- start 2024-09-11T22:23:16.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.617+0000 7f9b3d16f640 1 -- start start 2024-09-11T22:23:16.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3d16f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b380b1600 0x7f9b381f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3d16f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b380cf440 0x7f9b380cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3d16f640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b38161fa0 0x7f9b380b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3d16f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9b38162380 con 0x7f9b380cf440 2024-09-11T22:23:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3d16f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9b380cf8b0 con 0x7f9b380b1600 2024-09-11T22:23:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3d16f640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9b38162500 con 0x7f9b38161fa0 2024-09-11T22:23:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b380cf440 0x7f9b380cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b380cf440 0x7f9b380cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41986/0 (socket says 172.21.15.50:41986) 2024-09-11T22:23:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3659c640 1 -- 172.21.15.50:0/2422607975 learned_addr learned my addr 172.21.15.50:0/2422607975 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:16.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3759e640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b38161fa0 0x7f9b380b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b36d9d640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b380b1600 0x7f9b381f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3659c640 1 -- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b38161fa0 msgr2=0x7f9b380b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3659c640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b38161fa0 0x7f9b380b7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3659c640 1 -- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b380b1600 msgr2=0x7f9b381f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3659c640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b380b1600 0x7f9b381f4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3659c640 1 -- 172.21.15.50:0/2422607975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b380b6ef0 con 0x7f9b380cf440 2024-09-11T22:23:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3759e640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b38161fa0 0x7f9b380b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3659c640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b380cf440 0x7f9b380cbcf0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f9b2002a220 tx=0x7f9b200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b2f7fe640 1 -- 172.21.15.50:0/2422607975 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20041020 con 0x7f9b380cf440 2024-09-11T22:23:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b2f7fe640 1 -- 172.21.15.50:0/2422607975 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b200306c0 con 0x7f9b380cf440 2024-09-11T22:23:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b3d16f640 1 -- 172.21.15.50:0/2422607975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b380b71d0 con 0x7f9b380cf440 2024-09-11T22:23:16.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.618+0000 7f9b2f7fe640 1 -- 172.21.15.50:0/2422607975 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20037040 con 0x7f9b380cf440 2024-09-11T22:23:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.619+0000 7f9b3d16f640 1 -- 172.21.15.50:0/2422607975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b380b7790 con 0x7f9b380cf440 2024-09-11T22:23:16.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.620+0000 7f9b3d16f640 1 -- 172.21.15.50:0/2422607975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b380d1c70 con 0x7f9b380cf440 2024-09-11T22:23:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.620+0000 7f9b2f7fe640 1 -- 172.21.15.50:0/2422607975 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b20044020 con 0x7f9b380cf440 2024-09-11T22:23:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.620+0000 7f9b2f7fe640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b1806be30 0x7f9b1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.620+0000 7f9b2f7fe640 1 -- 172.21.15.50:0/2422607975 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f9b200ab740 con 0x7f9b380cf440 2024-09-11T22:23:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.621+0000 7f9b36d9d640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b1806be30 0x7f9b1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.621+0000 7f9b36d9d640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b1806be30 0x7f9b1806e2f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009940 tx=0x7f9b28003cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:16.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.625+0000 7f9b2f7fe640 1 -- 172.21.15.50:0/2422607975 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b2004b030 con 0x7f9b380cf440 2024-09-11T22:23:16.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.836+0000 7f9b3d16f640 1 -- 172.21.15.50:0/2422607975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b3806c690 con 0x7f9b380cf440 2024-09-11T22:23:16.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.836+0000 7f9b2f7fe640 1 -- 172.21.15.50:0/2422607975 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+5239 (secure 0 0 0) 0x7f9b2007a050 con 0x7f9b380cf440 2024-09-11T22:23:16.837 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:16.838 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":130,"btime":"2024-09-11T22:22:35:871475+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2188519592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2188519592},{"type":"v1","addr":"172.21.15.77:6836","nonce":2188519592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8165,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3754154405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3754154405},{"type":"v1","addr":"172.21.15.77:6837","nonce":3754154405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":127},{"gid":10317,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1024203584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1024203584},{"type":"v1","addr":"172.21.15.50:6833","nonce":1024203584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:22:33.219787+0000","modified":"2024-09-11T22:22:35.216759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10320":{"gid":10320,"name":"c","rank":0,"incarnation":128,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4092595783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4092595783},{"type":"v1","addr":"172.21.15.50:6835","nonce":4092595783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10320,"qdb_cluster":[10320]},"id":13}]} 2024-09-11T22:23:16.838 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 130 2024-09-11T22:23:16.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.838+0000 7f9b3d16f640 1 -- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b1806be30 msgr2=0x7f9b1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.838+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b1806be30 0x7f9b1806e2f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009940 tx=0x7f9b28003cd0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.838+0000 7f9b3d16f640 1 -- 172.21.15.50:0/2422607975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b380cf440 msgr2=0x7f9b380cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.838+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b380cf440 0x7f9b380cbcf0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f9b2002a220 tx=0x7f9b200046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.838+0000 7f9b3d16f640 1 -- 172.21.15.50:0/2422607975 shutdown_connections 2024-09-11T22:23:16.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.838+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9b1806be30 0x7f9b1806e2f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.838+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b38161fa0 0x7f9b380b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.838+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b380cf440 0x7f9b380cbcf0 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.838+0000 7f9b3d16f640 1 --2- 172.21.15.50:0/2422607975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b380b1600 0x7f9b381f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.838+0000 7f9b3d16f640 1 -- 172.21.15.50:0/2422607975 >> 172.21.15.50:0/2422607975 conn(0x7f9b3809ba50 msgr2=0x7f9b380b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.838+0000 7f9b3d16f640 1 -- 172.21.15.50:0/2422607975 shutdown_connections 2024-09-11T22:23:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.839+0000 7f9b3d16f640 1 -- 172.21.15.50:0/2422607975 wait complete. 2024-09-11T22:23:16.851 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:23:16.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.952+0000 7fd9f4976640 1 Processor -- start 2024-09-11T22:23:16.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.952+0000 7fd9f4976640 1 -- start start 2024-09-11T22:23:16.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.953+0000 7fd9f4976640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd9f015e880 0x7fd9f00d5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.953+0000 7fd9f4976640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f015ec60 con 0x7fd9f00ceff0 2024-09-11T22:23:16.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.953+0000 7fd9f4976640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f00cf9d0 con 0x7fd9f00b6ea0 2024-09-11T22:23:16.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.953+0000 7fd9f4976640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd9f00d4dd0 con 0x7fd9f015e880 2024-09-11T22:23:16.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.953+0000 7fd9edd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd9f00ceff0 0x7fd9f00b6790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60716/0 (socket says 172.21.15.50:60716) 2024-09-11T22:23:16.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.953+0000 7fd9edd9b640 1 -- 172.21.15.50:0/1454678206 learned_addr learned my addr 172.21.15.50:0/1454678206 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:16.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.953+0000 7fd9ee59c640 1 --2- 172.21.15.50:0/1454678206 >> v2:172.21.15.77:3300/0 conn(0x7fd9f015e880 0x7fd9f00d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.953+0000 7fd9ed59a640 1 -- 172.21.15.50:0/1454678206 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099139839 0 0) 0x7fd9f015ec60 con 0x7fd9f00ceff0 2024-09-11T22:23:16.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.954+0000 7fd9ed59a640 1 -- 172.21.15.50:0/1454678206 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9dc003520 con 0x7fd9f00ceff0 2024-09-11T22:23:16.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.954+0000 7fd9ee59c640 1 -- 172.21.15.50:0/1454678206 >> v1:172.21.15.77:6789/0 conn(0x7fd9f00b6ea0 legacy=0x7fd9f00b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.954+0000 7fd9ed59a640 1 -- 172.21.15.50:0/1454678206 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 376641170 0 0) 0x7fd9dc003520 con 0x7fd9f00ceff0 2024-09-11T22:23:16.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.954+0000 7fd9ee59c640 1 -- 172.21.15.50:0/1454678206 >> v1:172.21.15.50:6789/0 conn(0x7fd9f00ceff0 legacy=0x7fd9f00b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.954+0000 7fd9ee59c640 1 -- 172.21.15.50:0/1454678206 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f00cfcb0 con 0x7fd9f015e880 2024-09-11T22:23:16.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.954+0000 7fd9ee59c640 1 --2- 172.21.15.50:0/1454678206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015e880 0x7fd9f00d5260 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009d90 tx=0x7fd9e002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1b1f2eeacc3ac06 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:16.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.955+0000 7fd9ed59a640 1 -- 172.21.15.50:0/1454678206 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8001670 con 0x7fd9f015e880 2024-09-11T22:23:16.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.955+0000 7fd9ed59a640 1 -- 172.21.15.50:0/1454678206 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e0007540 con 0x7fd9f015e880 2024-09-11T22:23:16.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.955+0000 7fd9ed59a640 1 -- 172.21.15.50:0/1454678206 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00078f0 con 0x7fd9f015e880 2024-09-11T22:23:16.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.955+0000 7fd9f4976640 1 -- 172.21.15.50:0/1454678206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015e880 msgr2=0x7fd9f00d5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.955+0000 7fd9f4976640 1 --2- 172.21.15.50:0/1454678206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015e880 0x7fd9f00d5260 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009d90 tx=0x7fd9e002a680 comp rx=0 tx=0).stop 2024-09-11T22:23:16.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.955+0000 7fd9f4976640 1 -- 172.21.15.50:0/1454678206 shutdown_connections 2024-09-11T22:23:16.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.955+0000 7fd9f4976640 1 --2- 172.21.15.50:0/1454678206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015e880 0x7fd9f00d5260 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.955+0000 7fd9f4976640 1 -- 172.21.15.50:0/1454678206 >> 172.21.15.50:0/1454678206 conn(0x7fd9f00723b0 msgr2=0x7fd9f00727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:16.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.955+0000 7fd9f4976640 1 -- 172.21.15.50:0/1454678206 shutdown_connections 2024-09-11T22:23:16.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.955+0000 7fd9f4976640 1 -- 172.21.15.50:0/1454678206 wait complete. 2024-09-11T22:23:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.957+0000 7fd9f4976640 1 Processor -- start 2024-09-11T22:23:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.957+0000 7fd9f4976640 1 -- start start 2024-09-11T22:23:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9f4976640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9f00b6ea0 0x7fd9f00ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9f4976640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f00ceff0 0x7fd9f0155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9f4976640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9f015e880 0x7fd9f01574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9f4976640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f00d24b0 con 0x7fd9f00b6ea0 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9f4976640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f00d4a60 con 0x7fd9f00ceff0 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9f4976640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f00d2630 con 0x7fd9f015e880 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9ee59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9f00b6ea0 0x7fd9f00ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9ee59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9f00b6ea0 0x7fd9f00ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42002/0 (socket says 172.21.15.50:42002) 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9ee59c640 1 -- 172.21.15.50:0/2197975874 learned_addr learned my addr 172.21.15.50:0/2197975874 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9eed9d640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9f015e880 0x7fd9f01574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9edd9b640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f00ceff0 0x7fd9f0155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9ee59c640 1 -- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9f015e880 msgr2=0x7fd9f01574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9ee59c640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9f015e880 0x7fd9f01574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9ee59c640 1 -- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f00ceff0 msgr2=0x7fd9f0155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9ee59c640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f00ceff0 0x7fd9f0155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9ee59c640 1 -- 172.21.15.50:0/2197975874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f00cc950 con 0x7fd9f00b6ea0 2024-09-11T22:23:16.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9ee59c640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9f00b6ea0 0x7fd9f00ca6b0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fd9e002ac70 tx=0x7fd9e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:16.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.958+0000 7fd9e6ffd640 1 -- 172.21.15.50:0/2197975874 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0009450 con 0x7fd9f00b6ea0 2024-09-11T22:23:16.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.959+0000 7fd9e6ffd640 1 -- 172.21.15.50:0/2197975874 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e0004240 con 0x7fd9f00b6ea0 2024-09-11T22:23:16.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.959+0000 7fd9f4976640 1 -- 172.21.15.50:0/2197975874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f00ccc30 con 0x7fd9f00b6ea0 2024-09-11T22:23:16.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.959+0000 7fd9e6ffd640 1 -- 172.21.15.50:0/2197975874 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00045f0 con 0x7fd9f00b6ea0 2024-09-11T22:23:16.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.959+0000 7fd9f4976640 1 -- 172.21.15.50:0/2197975874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f00cd1f0 con 0x7fd9f00b6ea0 2024-09-11T22:23:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.960+0000 7fd9f4976640 1 -- 172.21.15.50:0/2197975874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f00d0580 con 0x7fd9f00b6ea0 2024-09-11T22:23:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.960+0000 7fd9e6ffd640 1 -- 172.21.15.50:0/2197975874 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9e0039040 con 0x7fd9f00b6ea0 2024-09-11T22:23:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.961+0000 7fd9e6ffd640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd9d006be60 0x7fd9d006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.961+0000 7fd9e6ffd640 1 -- 172.21.15.50:0/2197975874 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7fd9e00ac3b0 con 0x7fd9f00b6ea0 2024-09-11T22:23:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.961+0000 7fd9edd9b640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd9d006be60 0x7fd9d006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.961+0000 7fd9edd9b640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd9d006be60 0x7fd9d006e320 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00b36c0 tx=0x7fd9d8000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:16.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:16.965+0000 7fd9e6ffd640 1 -- 172.21.15.50:0/2197975874 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd9f00d0580 con 0x7fd9f00b6ea0 2024-09-11T22:23:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.141+0000 7fd9f4976640 1 -- 172.21.15.50:0/2197975874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9f00b4720 con 0x7fd9f00b6ea0 2024-09-11T22:23:17.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.142+0000 7fd9e6ffd640 1 -- 172.21.15.50:0/2197975874 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) ==== 74+0+16707 (secure 0 0 0) 0x7fd9e0040030 con 0x7fd9f00b6ea0 2024-09-11T22:23:17.143 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:17.143 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":178,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:22:34.856834+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:22:31.181552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-11T22:22:32.207726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:23:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.144+0000 7fd9f4976640 1 -- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd9d006be60 msgr2=0x7fd9d006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.144+0000 7fd9f4976640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd9d006be60 0x7fd9d006e320 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00b36c0 tx=0x7fd9d8000bc0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.144+0000 7fd9f4976640 1 -- 172.21.15.50:0/2197975874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9f00b6ea0 msgr2=0x7fd9f00ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.144+0000 7fd9f4976640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9f00b6ea0 0x7fd9f00ca6b0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fd9e002ac70 tx=0x7fd9e0004a40 comp rx=0 tx=0).stop 2024-09-11T22:23:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.145+0000 7fd9f4976640 1 -- 172.21.15.50:0/2197975874 shutdown_connections 2024-09-11T22:23:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.145+0000 7fd9f4976640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd9d006be60 0x7fd9d006e320 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.145+0000 7fd9f4976640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9f015e880 0x7fd9f01574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.145+0000 7fd9f4976640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f00ceff0 0x7fd9f0155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.145+0000 7fd9f4976640 1 --2- 172.21.15.50:0/2197975874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9f00b6ea0 0x7fd9f00ca6b0 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.145+0000 7fd9f4976640 1 -- 172.21.15.50:0/2197975874 >> 172.21.15.50:0/2197975874 conn(0x7fd9f00723b0 msgr2=0x7fd9f00b78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.145+0000 7fd9f4976640 1 -- 172.21.15.50:0/2197975874 shutdown_connections 2024-09-11T22:23:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.145+0000 7fd9f4976640 1 -- 172.21.15.50:0/2197975874 wait complete. 2024-09-11T22:23:17.157 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:23:17.157 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:23:17.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.259+0000 7f42966e6640 1 Processor -- start 2024-09-11T22:23:17.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.259+0000 7f42966e6640 1 -- start start 2024-09-11T22:23:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f42966e6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f429015fd80 0x7f42900b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f42966e6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42900af4c0 0x7f42900b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f42966e6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42900af940 con 0x7f42900b2970 2024-09-11T22:23:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f42966e6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f42900afc20 con 0x7f42900af4c0 2024-09-11T22:23:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f42966e6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f42900aff00 con 0x7f429015fd80 2024-09-11T22:23:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f428f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42900af4c0 0x7f42900b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f4294c83640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f42900b2970 0x7f42900d04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60722/0 (socket says 172.21.15.50:60722) 2024-09-11T22:23:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f4294c83640 1 -- 172.21.15.50:0/2002128013 learned_addr learned my addr 172.21.15.50:0/2002128013 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f428ffff640 1 --2- 172.21.15.50:0/2002128013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f429015fd80 0x7f42900b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f428f7fe640 1 -- 172.21.15.50:0/2002128013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f429015fd80 msgr2=0x7f42900b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:17.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f428f7fe640 1 --2- 172.21.15.50:0/2002128013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f429015fd80 0x7f42900b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f428f7fe640 1 -- 172.21.15.50:0/2002128013 >> v1:172.21.15.50:6789/0 conn(0x7f42900b2970 legacy=0x7f42900d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f428f7fe640 1 -- 172.21.15.50:0/2002128013 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42900b01e0 con 0x7f42900af4c0 2024-09-11T22:23:17.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.260+0000 7f428effd640 1 -- 172.21.15.50:0/2002128013 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806280207 0 0) 0x7f42900af940 con 0x7f42900b2970 2024-09-11T22:23:17.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.261+0000 7f428f7fe640 1 --2- 172.21.15.50:0/2002128013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42900af4c0 0x7f42900b2430 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f42840097a0 tx=0x7f428402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e112c80bac6dea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:17.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.261+0000 7f428effd640 1 -- 172.21.15.50:0/2002128013 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4284037070 con 0x7f42900af4c0 2024-09-11T22:23:17.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.261+0000 7f428effd640 1 -- 172.21.15.50:0/2002128013 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f428402ae50 con 0x7f42900af4c0 2024-09-11T22:23:17.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.261+0000 7f428effd640 1 -- 172.21.15.50:0/2002128013 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4284032660 con 0x7f42900af4c0 2024-09-11T22:23:17.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.262+0000 7f42966e6640 1 -- 172.21.15.50:0/2002128013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42900af4c0 msgr2=0x7f42900b2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.262+0000 7f42966e6640 1 --2- 172.21.15.50:0/2002128013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42900af4c0 0x7f42900b2430 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f42840097a0 tx=0x7f428402a100 comp rx=0 tx=0).stop 2024-09-11T22:23:17.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.262+0000 7f42966e6640 1 -- 172.21.15.50:0/2002128013 shutdown_connections 2024-09-11T22:23:17.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.262+0000 7f42966e6640 1 --2- 172.21.15.50:0/2002128013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42900af4c0 0x7f42900b2430 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.262+0000 7f42966e6640 1 --2- 172.21.15.50:0/2002128013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f429015fd80 0x7f42900b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.262+0000 7f42966e6640 1 -- 172.21.15.50:0/2002128013 >> 172.21.15.50:0/2002128013 conn(0x7f429009ba50 msgr2=0x7f42900b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.262+0000 7f42966e6640 1 -- 172.21.15.50:0/2002128013 shutdown_connections 2024-09-11T22:23:17.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.262+0000 7f42966e6640 1 -- 172.21.15.50:0/2002128013 wait complete. 2024-09-11T22:23:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.263+0000 7f42966e6640 1 Processor -- start 2024-09-11T22:23:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.263+0000 7f42966e6640 1 -- start start 2024-09-11T22:23:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f42966e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42900af4c0 0x7f42901553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f42966e6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42900b2970 0x7f4290157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f42966e6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429015fd80 0x7f42900b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f42966e6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4290160160 con 0x7f42900af4c0 2024-09-11T22:23:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f42966e6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f42900b3ee0 con 0x7f429015fd80 2024-09-11T22:23:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f42966e6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f42901602e0 con 0x7f42900b2970 2024-09-11T22:23:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f428ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42900af4c0 0x7f42901553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f428ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42900af4c0 0x7f42901553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42014/0 (socket says 172.21.15.50:42014) 2024-09-11T22:23:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f428ffff640 1 -- 172.21.15.50:0/944929448 learned_addr learned my addr 172.21.15.50:0/944929448 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f428f7fe640 1 --2- 172.21.15.50:0/944929448 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42900b2970 0x7f4290157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f428ffff640 1 -- 172.21.15.50:0/944929448 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42900b2970 msgr2=0x7f4290157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f428ffff640 1 --2- 172.21.15.50:0/944929448 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42900b2970 0x7f4290157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f428ffff640 1 -- 172.21.15.50:0/944929448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429015fd80 msgr2=0x7f42900b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f428ffff640 1 --2- 172.21.15.50:0/944929448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429015fd80 0x7f42900b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f428ffff640 1 -- 172.21.15.50:0/944929448 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42901558f0 con 0x7f42900af4c0 2024-09-11T22:23:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.264+0000 7f428ffff640 1 --2- 172.21.15.50:0/944929448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42900af4c0 0x7f42901553b0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f428000e870 tx=0x7f428000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.265+0000 7f428cff9640 1 -- 172.21.15.50:0/944929448 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280017070 con 0x7f42900af4c0 2024-09-11T22:23:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.265+0000 7f428cff9640 1 -- 172.21.15.50:0/944929448 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f428000c940 con 0x7f42900af4c0 2024-09-11T22:23:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.265+0000 7f42966e6640 1 -- 172.21.15.50:0/944929448 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4290157ec0 con 0x7f42900af4c0 2024-09-11T22:23:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.265+0000 7f428cff9640 1 -- 172.21.15.50:0/944929448 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428000cd30 con 0x7f42900af4c0 2024-09-11T22:23:17.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.265+0000 7f42966e6640 1 -- 172.21.15.50:0/944929448 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4290158480 con 0x7f42900af4c0 2024-09-11T22:23:17.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.266+0000 7f42966e6640 1 -- 172.21.15.50:0/944929448 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4290158ba0 con 0x7f42900af4c0 2024-09-11T22:23:17.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.266+0000 7f428cff9640 1 -- 172.21.15.50:0/944929448 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f428001a070 con 0x7f42900af4c0 2024-09-11T22:23:17.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.267+0000 7f428cff9640 1 --2- 172.21.15.50:0/944929448 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f427c06be60 0x7f427c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.267+0000 7f428cff9640 1 -- 172.21.15.50:0/944929448 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f428008ac80 con 0x7f42900af4c0 2024-09-11T22:23:17.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.267+0000 7f428f7fe640 1 --2- 172.21.15.50:0/944929448 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f427c06be60 0x7f427c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.267+0000 7f428f7fe640 1 --2- 172.21.15.50:0/944929448 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f427c06be60 0x7f427c06e320 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4284034000 tx=0x7f428402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:17.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.271+0000 7f428cff9640 1 -- 172.21.15.50:0/944929448 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42800596c0 con 0x7f42900af4c0 2024-09-11T22:23:17.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.482+0000 7f42966e6640 1 -- 172.21.15.50:0/944929448 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42900cb820 con 0x7f42900af4c0 2024-09-11T22:23:17.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.482+0000 7f428cff9640 1 -- 172.21.15.50:0/944929448 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+5239 (secure 0 0 0) 0x7f4280058fc0 con 0x7f42900af4c0 2024-09-11T22:23:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:17.483 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":130,"btime":"2024-09-11T22:22:35:871475+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2188519592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2188519592},{"type":"v1","addr":"172.21.15.77:6836","nonce":2188519592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8165,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3754154405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3754154405},{"type":"v1","addr":"172.21.15.77:6837","nonce":3754154405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":127},{"gid":10317,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1024203584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1024203584},{"type":"v1","addr":"172.21.15.50:6833","nonce":1024203584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:22:33.219787+0000","modified":"2024-09-11T22:22:35.216759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10320":{"gid":10320,"name":"c","rank":0,"incarnation":128,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4092595783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4092595783},{"type":"v1","addr":"172.21.15.50:6835","nonce":4092595783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10320,"qdb_cluster":[10320]},"id":13}]} 2024-09-11T22:23:17.483 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 130 2024-09-11T22:23:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.484+0000 7f42966e6640 1 -- 172.21.15.50:0/944929448 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f427c06be60 msgr2=0x7f427c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.484+0000 7f42966e6640 1 --2- 172.21.15.50:0/944929448 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f427c06be60 0x7f427c06e320 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4284034000 tx=0x7f428402e000 comp rx=0 tx=0).stop 2024-09-11T22:23:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.484+0000 7f42966e6640 1 -- 172.21.15.50:0/944929448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42900af4c0 msgr2=0x7f42901553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.484+0000 7f42966e6640 1 --2- 172.21.15.50:0/944929448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42900af4c0 0x7f42901553b0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f428000e870 tx=0x7f428000ed30 comp rx=0 tx=0).stop 2024-09-11T22:23:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.484+0000 7f42966e6640 1 -- 172.21.15.50:0/944929448 shutdown_connections 2024-09-11T22:23:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.484+0000 7f42966e6640 1 --2- 172.21.15.50:0/944929448 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f427c06be60 0x7f427c06e320 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.484+0000 7f42966e6640 1 --2- 172.21.15.50:0/944929448 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42900b2970 0x7f4290157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.484+0000 7f42966e6640 1 --2- 172.21.15.50:0/944929448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429015fd80 0x7f42900b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.484+0000 7f42966e6640 1 --2- 172.21.15.50:0/944929448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42900af4c0 0x7f42901553b0 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.484+0000 7f42966e6640 1 -- 172.21.15.50:0/944929448 >> 172.21.15.50:0/944929448 conn(0x7f429009ba50 msgr2=0x7f42900cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.485+0000 7f42966e6640 1 -- 172.21.15.50:0/944929448 shutdown_connections 2024-09-11T22:23:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.485+0000 7f42966e6640 1 -- 172.21.15.50:0/944929448 wait complete. 2024-09-11T22:23:17.496 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:23:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.598+0000 7f5d07976640 1 Processor -- start 2024-09-11T22:23:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.598+0000 7f5d07976640 1 -- start start 2024-09-11T22:23:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.599+0000 7f5d07976640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5d0006d780 0x7f5d0015bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.599+0000 7f5d07976640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d000b5020 con 0x7f5d00072cb0 2024-09-11T22:23:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.599+0000 7f5d07976640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d00073090 con 0x7f5d0015aad0 2024-09-11T22:23:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.599+0000 7f5d07976640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5d000d0a60 con 0x7f5d0006d780 2024-09-11T22:23:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.599+0000 7f5d05712640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5d00072cb0 0x7f5d000d0350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55008/0 (socket says 172.21.15.50:55008) 2024-09-11T22:23:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.599+0000 7f5d05f13640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5d0006d780 0x7f5d0015bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.599+0000 7f5d05712640 1 -- 172.21.15.50:0/2770121996 learned_addr learned my addr 172.21.15.50:0/2770121996 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.599+0000 7f5d05f13640 1 -- 172.21.15.50:0/2770121996 >> v1:172.21.15.77:6789/0 conn(0x7f5d0015aad0 legacy=0x7f5d0006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.599+0000 7f5d05f13640 1 -- 172.21.15.50:0/2770121996 >> v1:172.21.15.50:6789/0 conn(0x7f5d00072cb0 legacy=0x7f5d000d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.599+0000 7f5d05f13640 1 -- 172.21.15.50:0/2770121996 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d000714d0 con 0x7f5d0006d780 2024-09-11T22:23:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.600+0000 7f5d05f13640 1 --2- 172.21.15.50:0/2770121996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d0006d780 0x7f5d0015bb00 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009d90 tx=0x7f5cf802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70bdd2b5b9eae8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.600+0000 7f5cf7fff640 1 -- 172.21.15.50:0/2770121996 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8007740 con 0x7f5d0006d780 2024-09-11T22:23:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.600+0000 7f5cf7fff640 1 -- 172.21.15.50:0/2770121996 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf80078e0 con 0x7f5d0006d780 2024-09-11T22:23:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.600+0000 7f5cf7fff640 1 -- 172.21.15.50:0/2770121996 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8007cb0 con 0x7f5d0006d780 2024-09-11T22:23:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.601+0000 7f5d07976640 1 -- 172.21.15.50:0/2770121996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d0006d780 msgr2=0x7f5d0015bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.601+0000 7f5d07976640 1 --2- 172.21.15.50:0/2770121996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d0006d780 0x7f5d0015bb00 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009d90 tx=0x7f5cf802a6a0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.601+0000 7f5d07976640 1 -- 172.21.15.50:0/2770121996 shutdown_connections 2024-09-11T22:23:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.601+0000 7f5d07976640 1 --2- 172.21.15.50:0/2770121996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d0006d780 0x7f5d0015bb00 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.601+0000 7f5d07976640 1 -- 172.21.15.50:0/2770121996 >> 172.21.15.50:0/2770121996 conn(0x7f5d000679c0 msgr2=0x7f5d00067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.601+0000 7f5d07976640 1 -- 172.21.15.50:0/2770121996 shutdown_connections 2024-09-11T22:23:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.601+0000 7f5d07976640 1 -- 172.21.15.50:0/2770121996 wait complete. 2024-09-11T22:23:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.602+0000 7f5d07976640 1 Processor -- start 2024-09-11T22:23:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.602+0000 7f5d07976640 1 -- start start 2024-09-11T22:23:17.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d07976640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d0006d780 0x7f5d001f6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d07976640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00072cb0 0x7f5d00157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d07976640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d0015aad0 0x7f5d001f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d07976640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0015c040 con 0x7f5d00072cb0 2024-09-11T22:23:17.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d07976640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0015af20 con 0x7f5d0006d780 2024-09-11T22:23:17.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d07976640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d00071a90 con 0x7f5d0015aad0 2024-09-11T22:23:17.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d04f11640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00072cb0 0x7f5d00157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d04f11640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00072cb0 0x7f5d00157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47596/0 (socket says 172.21.15.50:47596) 2024-09-11T22:23:17.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d04f11640 1 -- 172.21.15.50:0/3712256280 learned_addr learned my addr 172.21.15.50:0/3712256280 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:17.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d05712640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d0006d780 0x7f5d001f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d05f13640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d0015aad0 0x7f5d001f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d04f11640 1 -- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d0015aad0 msgr2=0x7f5d001f20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d04f11640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d0015aad0 0x7f5d001f20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d04f11640 1 -- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d0006d780 msgr2=0x7f5d001f6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d04f11640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d0006d780 0x7f5d001f6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d04f11640 1 -- 172.21.15.50:0/3712256280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d001f2bb0 con 0x7f5d00072cb0 2024-09-11T22:23:17.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.603+0000 7f5d05712640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d0006d780 0x7f5d001f6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:17.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.604+0000 7f5d04f11640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00072cb0 0x7f5d00157070 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000b3f0 tx=0x7f5cf000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:17.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.604+0000 7f5cf5ffb640 1 -- 172.21.15.50:0/3712256280 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0015020 con 0x7f5d00072cb0 2024-09-11T22:23:17.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.604+0000 7f5cf5ffb640 1 -- 172.21.15.50:0/3712256280 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf0011830 con 0x7f5d00072cb0 2024-09-11T22:23:17.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.604+0000 7f5d07976640 1 -- 172.21.15.50:0/3712256280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d001f2e90 con 0x7f5d00072cb0 2024-09-11T22:23:17.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.604+0000 7f5cf5ffb640 1 -- 172.21.15.50:0/3712256280 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0011c20 con 0x7f5d00072cb0 2024-09-11T22:23:17.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.604+0000 7f5d07976640 1 -- 172.21.15.50:0/3712256280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d001f5990 con 0x7f5d00072cb0 2024-09-11T22:23:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.605+0000 7f5d07976640 1 -- 172.21.15.50:0/3712256280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d00071d70 con 0x7f5d00072cb0 2024-09-11T22:23:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.605+0000 7f5cf5ffb640 1 -- 172.21.15.50:0/3712256280 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cf0018020 con 0x7f5d00072cb0 2024-09-11T22:23:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.606+0000 7f5cf5ffb640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ce406be30 0x7f5ce406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.606+0000 7f5cf5ffb640 1 -- 172.21.15.50:0/3712256280 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f5cf008ab40 con 0x7f5d00072cb0 2024-09-11T22:23:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.606+0000 7f5d05712640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ce406be30 0x7f5ce406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.606+0000 7f5d05712640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ce406be30 0x7f5ce406e2f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5d000af5b0 tx=0x7f5cfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.610+0000 7f5cf5ffb640 1 -- 172.21.15.50:0/3712256280 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5cf001f030 con 0x7f5d00072cb0 2024-09-11T22:23:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.822+0000 7f5d07976640 1 -- 172.21.15.50:0/3712256280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d001575b0 con 0x7f5d00072cb0 2024-09-11T22:23:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.822+0000 7f5cf5ffb640 1 -- 172.21.15.50:0/3712256280 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+5239 (secure 0 0 0) 0x7f5cf00172c0 con 0x7f5d00072cb0 2024-09-11T22:23:17.823 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:17.824 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":130,"btime":"2024-09-11T22:22:35:871475+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2188519592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2188519592},{"type":"v1","addr":"172.21.15.77:6836","nonce":2188519592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8165,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3754154405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3754154405},{"type":"v1","addr":"172.21.15.77:6837","nonce":3754154405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":127},{"gid":10317,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1024203584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1024203584},{"type":"v1","addr":"172.21.15.50:6833","nonce":1024203584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:22:33.219787+0000","modified":"2024-09-11T22:22:35.216759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10320":{"gid":10320,"name":"c","rank":0,"incarnation":128,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4092595783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":4092595783},{"type":"v1","addr":"172.21.15.50:6835","nonce":4092595783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10320,"qdb_cluster":[10320]},"id":13}]} 2024-09-11T22:23:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 130 2024-09-11T22:23:17.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.824+0000 7f5d07976640 1 -- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ce406be30 msgr2=0x7f5ce406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.824+0000 7f5d07976640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ce406be30 0x7f5ce406e2f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5d000af5b0 tx=0x7f5cfc009040 comp rx=0 tx=0).stop 2024-09-11T22:23:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.824+0000 7f5d07976640 1 -- 172.21.15.50:0/3712256280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00072cb0 msgr2=0x7f5d00157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.824+0000 7f5d07976640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00072cb0 0x7f5d00157070 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000b3f0 tx=0x7f5cf000b8b0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.824+0000 7f5d07976640 1 -- 172.21.15.50:0/3712256280 shutdown_connections 2024-09-11T22:23:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.824+0000 7f5d07976640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5ce406be30 0x7f5ce406e2f0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.824+0000 7f5d07976640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d0015aad0 0x7f5d001f20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.824+0000 7f5d07976640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00072cb0 0x7f5d00157070 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.824+0000 7f5d07976640 1 --2- 172.21.15.50:0/3712256280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d0006d780 0x7f5d001f6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.824+0000 7f5d07976640 1 -- 172.21.15.50:0/3712256280 >> 172.21.15.50:0/3712256280 conn(0x7f5d000679c0 msgr2=0x7f5d00072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.825+0000 7f5d07976640 1 -- 172.21.15.50:0/3712256280 shutdown_connections 2024-09-11T22:23:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.825+0000 7f5d07976640 1 -- 172.21.15.50:0/3712256280 wait complete. 2024-09-11T22:23:17.836 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:23:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.938+0000 7f05b5998640 1 Processor -- start 2024-09-11T22:23:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.938+0000 7f05b5998640 1 -- start start 2024-09-11T22:23:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.939+0000 7f05b5998640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05b00d1c90 0x7f05b00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.939+0000 7f05b5998640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f05b0162350 0x7f05b01627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.939+0000 7f05b5998640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05b0163080 con 0x7f05b015e8e0 2024-09-11T22:23:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.939+0000 7f05b5998640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f05b015ecc0 con 0x7f05b0162350 2024-09-11T22:23:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.939+0000 7f05b5998640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f05b00d2ad0 con 0x7f05b00d1c90 2024-09-11T22:23:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.939+0000 7f05af7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f05b0162350 0x7f05b01627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.939+0000 7f05af7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f05b0162350 0x7f05b01627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47608/0 (socket says 172.21.15.50:47608) 2024-09-11T22:23:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.939+0000 7f05af7fe640 1 -- 172.21.15.50:0/3897220816 learned_addr learned my addr 172.21.15.50:0/3897220816 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.939+0000 7f05ae7fc640 1 --2- 172.21.15.50:0/3897220816 >> v2:172.21.15.77:3300/0 conn(0x7f05b00d1c90 0x7f05b00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.939+0000 7f05af7fe640 1 -- 172.21.15.50:0/3897220816 >> v2:172.21.15.77:3300/0 conn(0x7f05b00d1c90 msgr2=0x7f05b00b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.939+0000 7f05af7fe640 1 --2- 172.21.15.50:0/3897220816 >> v2:172.21.15.77:3300/0 conn(0x7f05b00d1c90 0x7f05b00b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.939+0000 7f05af7fe640 1 -- 172.21.15.50:0/3897220816 >> v1:172.21.15.77:6789/0 conn(0x7f05b015e8e0 legacy=0x7f05b00d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.939+0000 7f05af7fe640 1 -- 172.21.15.50:0/3897220816 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b00d2d20 con 0x7f05b0162350 2024-09-11T22:23:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.940+0000 7f05af7fe640 1 --2- 172.21.15.50:0/3897220816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b0162350 0x7f05b01627a0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f05b01622b0 tx=0x7f05a802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ea47384e2c9211 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.940+0000 7f05adffb640 1 -- 172.21.15.50:0/3897220816 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a8036070 con 0x7f05b0162350 2024-09-11T22:23:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.940+0000 7f05adffb640 1 -- 172.21.15.50:0/3897220816 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a8031600 con 0x7f05b0162350 2024-09-11T22:23:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.940+0000 7f05adffb640 1 -- 172.21.15.50:0/3897220816 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a80319d0 con 0x7f05b0162350 2024-09-11T22:23:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.941+0000 7f05b5998640 1 -- 172.21.15.50:0/3897220816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b0162350 msgr2=0x7f05b01627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.941+0000 7f05b5998640 1 --2- 172.21.15.50:0/3897220816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b0162350 0x7f05b01627a0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f05b01622b0 tx=0x7f05a802a780 comp rx=0 tx=0).stop 2024-09-11T22:23:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.941+0000 7f05b5998640 1 -- 172.21.15.50:0/3897220816 shutdown_connections 2024-09-11T22:23:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.941+0000 7f05b5998640 1 --2- 172.21.15.50:0/3897220816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b0162350 0x7f05b01627a0 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.941+0000 7f05b5998640 1 --2- 172.21.15.50:0/3897220816 >> v2:172.21.15.77:3300/0 conn(0x7f05b00d1c90 0x7f05b00b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.941+0000 7f05b5998640 1 -- 172.21.15.50:0/3897220816 >> 172.21.15.50:0/3897220816 conn(0x7f05b0067ba0 msgr2=0x7f05b0067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.941+0000 7f05b5998640 1 -- 172.21.15.50:0/3897220816 shutdown_connections 2024-09-11T22:23:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.941+0000 7f05b5998640 1 -- 172.21.15.50:0/3897220816 wait complete. 2024-09-11T22:23:17.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.942+0000 7f05b5998640 1 Processor -- start 2024-09-11T22:23:17.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.942+0000 7f05b5998640 1 -- start start 2024-09-11T22:23:17.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05b5998640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05b00d1c90 0x7f05b0155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05b5998640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b015e8e0 0x7f05b00b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05b5998640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b0162350 0x7f05b00d4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05b5998640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f05b0162ce0 con 0x7f05b015e8e0 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05b5998640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f05b00d3370 con 0x7f05b0162350 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05b5998640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f05b0162e60 con 0x7f05b00d1c90 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05ae7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b015e8e0 0x7f05b00b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05ae7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b015e8e0 0x7f05b00b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47622/0 (socket says 172.21.15.50:47622) 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05ae7fc640 1 -- 172.21.15.50:0/2778903393 learned_addr learned my addr 172.21.15.50:0/2778903393 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05aeffd640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05b00d1c90 0x7f05b0155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05af7fe640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b0162350 0x7f05b00d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05ae7fc640 1 -- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05b00d1c90 msgr2=0x7f05b0155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05ae7fc640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05b00d1c90 0x7f05b0155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05ae7fc640 1 -- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b0162350 msgr2=0x7f05b00d4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05ae7fc640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b0162350 0x7f05b00d4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05ae7fc640 1 -- 172.21.15.50:0/2778903393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b00b4250 con 0x7f05b015e8e0 2024-09-11T22:23:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.943+0000 7f05ae7fc640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b015e8e0 0x7f05b00b6250 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f05a400c7f0 tx=0x7f05a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.944+0000 7f0597fff640 1 -- 172.21.15.50:0/2778903393 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4015070 con 0x7f05b015e8e0 2024-09-11T22:23:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.944+0000 7f0597fff640 1 -- 172.21.15.50:0/2778903393 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a4004220 con 0x7f05b015e8e0 2024-09-11T22:23:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.944+0000 7f05b5998640 1 -- 172.21.15.50:0/2778903393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b00b4510 con 0x7f05b015e8e0 2024-09-11T22:23:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.944+0000 7f0597fff640 1 -- 172.21.15.50:0/2778903393 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4003610 con 0x7f05b015e8e0 2024-09-11T22:23:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.944+0000 7f05b5998640 1 -- 172.21.15.50:0/2778903393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b00b4ad0 con 0x7f05b015e8e0 2024-09-11T22:23:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.944+0000 7f05b5998640 1 -- 172.21.15.50:0/2778903393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b00b7880 con 0x7f05b015e8e0 2024-09-11T22:23:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.945+0000 7f0597fff640 1 -- 172.21.15.50:0/2778903393 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05a40039c0 con 0x7f05b015e8e0 2024-09-11T22:23:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.945+0000 7f0597fff640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f059c06be30 0x7f059c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.946+0000 7f0597fff640 1 -- 172.21.15.50:0/2778903393 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7f05a408ad40 con 0x7f05b015e8e0 2024-09-11T22:23:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.946+0000 7f05aeffd640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f059c06be30 0x7f059c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:17.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.946+0000 7f05aeffd640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f059c06be30 0x7f059c06e2f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f05a00017f0 tx=0x7f05a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:17.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:17.950+0000 7f0597fff640 1 -- 172.21.15.50:0/2778903393 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05a40590a0 con 0x7f05b015e8e0 2024-09-11T22:23:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.127+0000 7f05b5998640 1 -- 172.21.15.50:0/2778903393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05b00b4030 con 0x7f05b015e8e0 2024-09-11T22:23:18.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.128+0000 7f0597fff640 1 -- 172.21.15.50:0/2778903393 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) ==== 74+0+16707 (secure 0 0 0) 0x7f05a405d3a0 con 0x7f05b015e8e0 2024-09-11T22:23:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:18.129 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":178,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:22:34.856834+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:22:31.181552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-11T22:22:32.207726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:23:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.130+0000 7f05b5998640 1 -- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f059c06be30 msgr2=0x7f059c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.130+0000 7f05b5998640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f059c06be30 0x7f059c06e2f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f05a00017f0 tx=0x7f05a0009040 comp rx=0 tx=0).stop 2024-09-11T22:23:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.130+0000 7f05b5998640 1 -- 172.21.15.50:0/2778903393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b015e8e0 msgr2=0x7f05b00b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.130+0000 7f05b5998640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b015e8e0 0x7f05b00b6250 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f05a400c7f0 tx=0x7f05a400ccb0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.130+0000 7f05b5998640 1 -- 172.21.15.50:0/2778903393 shutdown_connections 2024-09-11T22:23:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.130+0000 7f05b5998640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f059c06be30 0x7f059c06e2f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.130+0000 7f05b5998640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b0162350 0x7f05b00d4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.130+0000 7f05b5998640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05b015e8e0 0x7f05b00b6250 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.130+0000 7f05b5998640 1 --2- 172.21.15.50:0/2778903393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05b00d1c90 0x7f05b0155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.130+0000 7f05b5998640 1 -- 172.21.15.50:0/2778903393 >> 172.21.15.50:0/2778903393 conn(0x7f05b0067ba0 msgr2=0x7f05b0067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:18.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.130+0000 7f05b5998640 1 -- 172.21.15.50:0/2778903393 shutdown_connections 2024-09-11T22:23:18.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.130+0000 7f05b5998640 1 -- 172.21.15.50:0/2778903393 wait complete. 2024-09-11T22:23:18.143 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:23:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.246+0000 7fa0f4e42640 1 Processor -- start 2024-09-11T22:23:18.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.246+0000 7fa0f4e42640 1 -- start start 2024-09-11T22:23:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.247+0000 7fa0f4e42640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa0f015f350 0x7fa0f015fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.247+0000 7fa0f4e42640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f015f7f0 con 0x7fa0f015c3c0 2024-09-11T22:23:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.247+0000 7fa0f4e42640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f015fad0 con 0x7fa0f00679c0 2024-09-11T22:23:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.247+0000 7fa0f4e42640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa0f006e700 con 0x7fa0f015f350 2024-09-11T22:23:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.247+0000 7fa0ee59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa0f015c3c0 0x7fa0f015ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55022/0 (socket says 172.21.15.50:55022) 2024-09-11T22:23:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.247+0000 7fa0ee59c640 1 -- 172.21.15.50:0/3638251994 learned_addr learned my addr 172.21.15.50:0/3638251994 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.247+0000 7fa0edd9b640 1 --2- 172.21.15.50:0/3638251994 >> v2:172.21.15.77:3300/0 conn(0x7fa0f015f350 0x7fa0f015fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.247+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891017880 0 0) 0x7fa0f015f7f0 con 0x7fa0f015c3c0 2024-09-11T22:23:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.247+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0d8003520 con 0x7fa0f015c3c0 2024-09-11T22:23:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 246449371 0 0) 0x7fa0d8003520 con 0x7fa0f015c3c0 2024-09-11T22:23:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 >> v2:172.21.15.77:3300/0 conn(0x7fa0f015f350 msgr2=0x7fa0f015fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ed59a640 1 --2- 172.21.15.50:0/3638251994 >> v2:172.21.15.77:3300/0 conn(0x7fa0f015f350 0x7fa0f015fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 >> v1:172.21.15.77:6789/0 conn(0x7fa0f00679c0 legacy=0x7fa0f006f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f006e950 con 0x7fa0f015c3c0 2024-09-11T22:23:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fa0e0001670 con 0x7fa0f015c3c0 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 >> v1:172.21.15.50:6789/0 conn(0x7fa0f015c3c0 legacy=0x7fa0f015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ed59a640 1 --2- 172.21.15.50:0/3638251994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0d8003a00 0x7fa0d8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ed59a640 1 --2- 172.21.15.50:0/3638251994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d8004800 0x7fa0d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ed59a640 1 --2- 172.21.15.50:0/3638251994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d8005210 0x7fa0d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f006e700 con 0x7fa0d8005210 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d800c160 con 0x7fa0d8004800 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa0d800c360 con 0x7fa0d8003a00 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0eed9d640 1 --2- 172.21.15.50:0/3638251994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d8005210 0x7fa0d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0edd9b640 1 --2- 172.21.15.50:0/3638251994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d8004800 0x7fa0d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0ee59c640 1 --2- 172.21.15.50:0/3638251994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0d8003a00 0x7fa0d8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0eed9d640 1 -- 172.21.15.50:0/3638251994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0d8003a00 msgr2=0x7fa0d8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0eed9d640 1 --2- 172.21.15.50:0/3638251994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0d8003a00 0x7fa0d8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0eed9d640 1 -- 172.21.15.50:0/3638251994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d8004800 msgr2=0x7fa0d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0eed9d640 1 --2- 172.21.15.50:0/3638251994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d8004800 0x7fa0d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.248+0000 7fa0eed9d640 1 -- 172.21.15.50:0/3638251994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d8003520 con 0x7fa0d8005210 2024-09-11T22:23:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.249+0000 7fa0eed9d640 1 -- 172.21.15.50:0/3638251994 reap_dead start 2024-09-11T22:23:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.249+0000 7fa0eed9d640 1 --2- 172.21.15.50:0/3638251994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d8005210 0x7fa0d800b9c0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8001e20 tx=0x7fa0d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b401788ac97259 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.249+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8001a70 con 0x7fa0d8005210 2024-09-11T22:23:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.249+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e802ae40 con 0x7fa0d8005210 2024-09-11T22:23:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.249+0000 7fa0ed59a640 1 -- 172.21.15.50:0/3638251994 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8003bb0 con 0x7fa0d8005210 2024-09-11T22:23:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.250+0000 7fa0f4e42640 1 -- 172.21.15.50:0/3638251994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d8005210 msgr2=0x7fa0d800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.250+0000 7fa0f4e42640 1 --2- 172.21.15.50:0/3638251994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d8005210 0x7fa0d800b9c0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8001e20 tx=0x7fa0d8005830 comp rx=0 tx=0).stop 2024-09-11T22:23:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.250+0000 7fa0f4e42640 1 -- 172.21.15.50:0/3638251994 shutdown_connections 2024-09-11T22:23:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.250+0000 7fa0f4e42640 1 --2- 172.21.15.50:0/3638251994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d8005210 0x7fa0d800b9c0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.250+0000 7fa0f4e42640 1 -- 172.21.15.50:0/3638251994 >> 172.21.15.50:0/3638251994 conn(0x7fa0f0075060 msgr2=0x7fa0f006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.250+0000 7fa0f4e42640 1 -- 172.21.15.50:0/3638251994 shutdown_connections 2024-09-11T22:23:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.250+0000 7fa0f4e42640 1 -- 172.21.15.50:0/3638251994 wait complete. 2024-09-11T22:23:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.251+0000 7fa0f4e42640 1 Processor -- start 2024-09-11T22:23:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.251+0000 7fa0f4e42640 1 -- start start 2024-09-11T22:23:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0f4e42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0d8005210 0x7fa0f01490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0f4e42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0f00cab40 0x7fa0f00cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0f4e42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f015eb20 0x7fa0f00cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0f4e42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f015fe60 con 0x7fa0f015eb20 2024-09-11T22:23:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0f4e42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f00d0940 con 0x7fa0f00cab40 2024-09-11T22:23:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0f4e42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f015ffe0 con 0x7fa0d8005210 2024-09-11T22:23:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0eed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f015eb20 0x7fa0f00cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0eed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f015eb20 0x7fa0f00cce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47644/0 (socket says 172.21.15.50:47644) 2024-09-11T22:23:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0eed9d640 1 -- 172.21.15.50:0/280613435 learned_addr learned my addr 172.21.15.50:0/280613435 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0ee59c640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0d8005210 0x7fa0f01490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0edd9b640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0f00cab40 0x7fa0f00cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0eed9d640 1 -- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0d8005210 msgr2=0x7fa0f01490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0eed9d640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0d8005210 0x7fa0f01490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0eed9d640 1 -- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0f00cab40 msgr2=0x7fa0f00cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0eed9d640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0f00cab40 0x7fa0f00cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0eed9d640 1 -- 172.21.15.50:0/280613435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f00cb090 con 0x7fa0f015eb20 2024-09-11T22:23:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.252+0000 7fa0eed9d640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f015eb20 0x7fa0f00cce50 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7fa0e802a8f0 tx=0x7fa0e80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.253+0000 7fa0deffd640 1 -- 172.21.15.50:0/280613435 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8007db0 con 0x7fa0f015eb20 2024-09-11T22:23:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.253+0000 7fa0deffd640 1 -- 172.21.15.50:0/280613435 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e8006d60 con 0x7fa0f015eb20 2024-09-11T22:23:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.253+0000 7fa0f4e42640 1 -- 172.21.15.50:0/280613435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f00cb370 con 0x7fa0f015eb20 2024-09-11T22:23:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.253+0000 7fa0deffd640 1 -- 172.21.15.50:0/280613435 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80056c0 con 0x7fa0f015eb20 2024-09-11T22:23:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.253+0000 7fa0f4e42640 1 -- 172.21.15.50:0/280613435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f00cb930 con 0x7fa0f015eb20 2024-09-11T22:23:18.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.254+0000 7fa0f4e42640 1 -- 172.21.15.50:0/280613435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f006cae0 con 0x7fa0f015eb20 2024-09-11T22:23:18.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.254+0000 7fa0deffd640 1 -- 172.21.15.50:0/280613435 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0e8007030 con 0x7fa0f015eb20 2024-09-11T22:23:18.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.255+0000 7fa0deffd640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa0d006be30 0x7fa0d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:18.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.255+0000 7fa0deffd640 1 -- 172.21.15.50:0/280613435 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7fa0e80aa720 con 0x7fa0f015eb20 2024-09-11T22:23:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.255+0000 7fa0ee59c640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa0d006be30 0x7fa0d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.255+0000 7fa0ee59c640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa0d006be30 0x7fa0d006e2f0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0001050 tx=0x7fa0e0000f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.259+0000 7fa0deffd640 1 -- 172.21.15.50:0/280613435 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0e8043060 con 0x7fa0f015eb20 2024-09-11T22:23:18.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.474+0000 7fa0f4e42640 1 -- 172.21.15.50:0/280613435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa0f00b4eb0 con 0x7fa0f015eb20 2024-09-11T22:23:18.475 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:23:18.474+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:23:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.476+0000 7fa0deffd640 1 -- 172.21.15.50:0/280613435 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v131) ==== 161+0+0 (secure 0 0 0) 0x7fa0e8039070 con 0x7fa0f015eb20 2024-09-11T22:23:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:23:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.478+0000 7fa0f4e42640 1 -- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa0d006be30 msgr2=0x7fa0d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.478+0000 7fa0f4e42640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa0d006be30 0x7fa0d006e2f0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0001050 tx=0x7fa0e0000f80 comp rx=0 tx=0).stop 2024-09-11T22:23:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.478+0000 7fa0f4e42640 1 -- 172.21.15.50:0/280613435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f015eb20 msgr2=0x7fa0f00cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.478+0000 7fa0f4e42640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f015eb20 0x7fa0f00cce50 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7fa0e802a8f0 tx=0x7fa0e80014a0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.478+0000 7fa0f4e42640 1 -- 172.21.15.50:0/280613435 shutdown_connections 2024-09-11T22:23:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.478+0000 7fa0f4e42640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa0d006be30 0x7fa0d006e2f0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.478+0000 7fa0f4e42640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f015eb20 0x7fa0f00cce50 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.478+0000 7fa0f4e42640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0f00cab40 0x7fa0f00cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.478+0000 7fa0f4e42640 1 --2- 172.21.15.50:0/280613435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0d8005210 0x7fa0f01490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.478+0000 7fa0f4e42640 1 -- 172.21.15.50:0/280613435 >> 172.21.15.50:0/280613435 conn(0x7fa0f0075060 msgr2=0x7fa0f00d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.479+0000 7fa0f4e42640 1 -- 172.21.15.50:0/280613435 shutdown_connections 2024-09-11T22:23:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.479+0000 7fa0f4e42640 1 -- 172.21.15.50:0/280613435 wait complete. 2024-09-11T22:23:18.481 INFO:tasks.ceph.mds.c.smithi050.stderr: -3549> 2024-09-11T22:22:35.160+0000 7f99d3ab9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:23:18.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:23:18.510 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:23:18.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.596+0000 7f79fca00640 1 Processor -- start 2024-09-11T22:23:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.596+0000 7f79fca00640 1 -- start start 2024-09-11T22:23:18.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.597+0000 7f79fca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79f80d1550 0x7f79f80b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:18.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.597+0000 7f79fca00640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f80d44e0 con 0x7f79f80d10e0 2024-09-11T22:23:18.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.597+0000 7f79fca00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f80d3440 con 0x7f79f815e7e0 2024-09-11T22:23:18.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.597+0000 7f79fca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f79f80ba640 con 0x7f79f80d1550 2024-09-11T22:23:18.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.597+0000 7f79f659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f79f80d10e0 0x7f79f80b76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55030/0 (socket says 172.21.15.50:55030) 2024-09-11T22:23:18.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.597+0000 7f79f659c640 1 -- 172.21.15.50:0/1229393386 learned_addr learned my addr 172.21.15.50:0/1229393386 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:18.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.597+0000 7f79f759e640 1 --2- 172.21.15.50:0/1229393386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79f80d1550 0x7f79f80b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:18.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.597+0000 7f79f5d9b640 1 -- 172.21.15.50:0/1229393386 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1030961923 0 0) 0x7f79f80d44e0 con 0x7f79f80d10e0 2024-09-11T22:23:18.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.597+0000 7f79f5d9b640 1 -- 172.21.15.50:0/1229393386 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79e0003520 con 0x7f79f80d10e0 2024-09-11T22:23:18.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.597+0000 7f79f5d9b640 1 -- 172.21.15.50:0/1229393386 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2111014048 0 0) 0x7f79e0003520 con 0x7f79f80d10e0 2024-09-11T22:23:18.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.597+0000 7f79f759e640 1 -- 172.21.15.50:0/1229393386 >> v1:172.21.15.77:6789/0 conn(0x7f79f815e7e0 legacy=0x7f79f80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.597+0000 7f79f759e640 1 -- 172.21.15.50:0/1229393386 >> v1:172.21.15.50:6789/0 conn(0x7f79f80d10e0 legacy=0x7f79f80b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.597+0000 7f79f759e640 1 -- 172.21.15.50:0/1229393386 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f80d3720 con 0x7f79f80d1550 2024-09-11T22:23:18.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.598+0000 7f79f759e640 1 --2- 172.21.15.50:0/1229393386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79f80d1550 0x7f79f80b7e00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009dc0 tx=0x7f79f002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35d0f2a27a9004f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:18.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.598+0000 7f79f5d9b640 1 -- 172.21.15.50:0/1229393386 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec001670 con 0x7f79f80d1550 2024-09-11T22:23:18.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.598+0000 7f79f5d9b640 1 -- 172.21.15.50:0/1229393386 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f0007540 con 0x7f79f80d1550 2024-09-11T22:23:18.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.598+0000 7f79f5d9b640 1 -- 172.21.15.50:0/1229393386 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f00078f0 con 0x7f79f80d1550 2024-09-11T22:23:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.599+0000 7f79fca00640 1 -- 172.21.15.50:0/1229393386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79f80d1550 msgr2=0x7f79f80b7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.599+0000 7f79fca00640 1 --2- 172.21.15.50:0/1229393386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79f80d1550 0x7f79f80b7e00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009dc0 tx=0x7f79f002a660 comp rx=0 tx=0).stop 2024-09-11T22:23:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.599+0000 7f79fca00640 1 -- 172.21.15.50:0/1229393386 shutdown_connections 2024-09-11T22:23:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.599+0000 7f79fca00640 1 --2- 172.21.15.50:0/1229393386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79f80d1550 0x7f79f80b7e00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.599+0000 7f79fca00640 1 -- 172.21.15.50:0/1229393386 >> 172.21.15.50:0/1229393386 conn(0x7f79f8072590 msgr2=0x7f79f80729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.599+0000 7f79fca00640 1 -- 172.21.15.50:0/1229393386 shutdown_connections 2024-09-11T22:23:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.599+0000 7f79fca00640 1 -- 172.21.15.50:0/1229393386 wait complete. 2024-09-11T22:23:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.600+0000 7f79fca00640 1 Processor -- start 2024-09-11T22:23:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.600+0000 7f79fca00640 1 -- start start 2024-09-11T22:23:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.601+0000 7f79fca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80d10e0 0x7f79f815b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.601+0000 7f79fca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79f80d1550 0x7f79f80c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.601+0000 7f79fca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f815e7e0 0x7f79f80cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.601+0000 7f79fca00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f79f80d3ce0 con 0x7f79f815e7e0 2024-09-11T22:23:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.601+0000 7f79fca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f79f80d4050 con 0x7f79f80d10e0 2024-09-11T22:23:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.601+0000 7f79fca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f79f80d19e0 con 0x7f79f80d1550 2024-09-11T22:23:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.601+0000 7f79f759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f815e7e0 0x7f79f80cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.601+0000 7f79f759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f815e7e0 0x7f79f80cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47676/0 (socket says 172.21.15.50:47676) 2024-09-11T22:23:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.601+0000 7f79f759e640 1 -- 172.21.15.50:0/1621234713 learned_addr learned my addr 172.21.15.50:0/1621234713 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.601+0000 7f79f659c640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79f80d1550 0x7f79f80c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.601+0000 7f79f6d9d640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80d10e0 0x7f79f815b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.602+0000 7f79f759e640 1 -- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79f80d1550 msgr2=0x7f79f80c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.602+0000 7f79f759e640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79f80d1550 0x7f79f80c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.602+0000 7f79f759e640 1 -- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80d10e0 msgr2=0x7f79f815b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.602+0000 7f79f759e640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80d10e0 0x7f79f815b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.602+0000 7f79f759e640 1 -- 172.21.15.50:0/1621234713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f80ca500 con 0x7f79f815e7e0 2024-09-11T22:23:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.602+0000 7f79f759e640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f815e7e0 0x7f79f80cddd0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009ee0 tx=0x7f79f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.602+0000 7f79df7fe640 1 -- 172.21.15.50:0/1621234713 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f0040070 con 0x7f79f815e7e0 2024-09-11T22:23:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.602+0000 7f79df7fe640 1 -- 172.21.15.50:0/1621234713 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f0031c40 con 0x7f79f815e7e0 2024-09-11T22:23:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.602+0000 7f79fca00640 1 -- 172.21.15.50:0/1621234713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f80ca7e0 con 0x7f79f815e7e0 2024-09-11T22:23:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.602+0000 7f79df7fe640 1 -- 172.21.15.50:0/1621234713 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f0009450 con 0x7f79f815e7e0 2024-09-11T22:23:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.602+0000 7f79fca00640 1 -- 172.21.15.50:0/1621234713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f80cb7d0 con 0x7f79f815e7e0 2024-09-11T22:23:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.603+0000 7f79fca00640 1 -- 172.21.15.50:0/1621234713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f80cfd20 con 0x7f79f815e7e0 2024-09-11T22:23:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.604+0000 7f79df7fe640 1 -- 172.21.15.50:0/1621234713 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79f0039040 con 0x7f79f815e7e0 2024-09-11T22:23:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.604+0000 7f79df7fe640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79e406be30 0x7f79e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.604+0000 7f79df7fe640 1 -- 172.21.15.50:0/1621234713 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 5795+0+0 (secure 0 0 0) 0x7f79f00ac130 con 0x7f79f815e7e0 2024-09-11T22:23:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.604+0000 7f79f6d9d640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79e406be30 0x7f79e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.605+0000 7f79f6d9d640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79e406be30 0x7f79e406e2f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f79f8161070 tx=0x7f79e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:18.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.608+0000 7f79df7fe640 1 -- 172.21.15.50:0/1621234713 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79f007a4c0 con 0x7f79f815e7e0 2024-09-11T22:23:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:18.821+0000 7f79fca00640 1 -- 172.21.15.50:0/1621234713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f79f80b8a20 con 0x7f79f815e7e0 2024-09-11T22:23:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.477+0000 7f79df7fe640 1 -- 172.21.15.50:0/1621234713 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v132) ==== 104+0+0 (secure 0 0 0) 0x7f79f007e7c0 con 0x7f79f815e7e0 2024-09-11T22:23:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.480+0000 7f79fca00640 1 -- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79e406be30 msgr2=0x7f79e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.480+0000 7f79fca00640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79e406be30 0x7f79e406e2f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f79f8161070 tx=0x7f79e8009040 comp rx=0 tx=0).stop 2024-09-11T22:23:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.480+0000 7f79fca00640 1 -- 172.21.15.50:0/1621234713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f815e7e0 msgr2=0x7f79f80cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.480+0000 7f79fca00640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f815e7e0 0x7f79f80cddd0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009ee0 tx=0x7f79f0004a40 comp rx=0 tx=0).stop 2024-09-11T22:23:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.480+0000 7f79fca00640 1 -- 172.21.15.50:0/1621234713 shutdown_connections 2024-09-11T22:23:19.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.480+0000 7f79fca00640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79e406be30 0x7f79e406e2f0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.480+0000 7f79fca00640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79f80d1550 0x7f79f80c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.480+0000 7f79fca00640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79f815e7e0 0x7f79f80cddd0 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.480+0000 7f79fca00640 1 --2- 172.21.15.50:0/1621234713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80d10e0 0x7f79f815b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.480+0000 7f79fca00640 1 -- 172.21.15.50:0/1621234713 >> 172.21.15.50:0/1621234713 conn(0x7f79f8072590 msgr2=0x7f79f80b5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.480+0000 7f79fca00640 1 -- 172.21.15.50:0/1621234713 shutdown_connections 2024-09-11T22:23:19.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.480+0000 7f79fca00640 1 -- 172.21.15.50:0/1621234713 wait complete. 2024-09-11T22:23:19.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:23:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.650+0000 7f0c33942640 1 Processor -- start 2024-09-11T22:23:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.650+0000 7f0c33942640 1 -- start start 2024-09-11T22:23:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.651+0000 7f0c33942640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c2c0b6ba0 0x7f0c2c0b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.651+0000 7f0c33942640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2c0b7990 con 0x7f0c2c0b6730 2024-09-11T22:23:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.651+0000 7f0c33942640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2c0d4530 con 0x7f0c2c161d60 2024-09-11T22:23:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.651+0000 7f0c33942640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2c0d3f70 con 0x7f0c2c0b6ba0 2024-09-11T22:23:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.651+0000 7f0c31edf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c2c0b6ba0 0x7f0c2c0b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.651+0000 7f0c30edd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0c2c0b6730 0x7f0c2c0b8150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55038/0 (socket says 172.21.15.50:55038) 2024-09-11T22:23:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.651+0000 7f0c30edd640 1 -- 172.21.15.50:0/1244053154 learned_addr learned my addr 172.21.15.50:0/1244053154 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.652+0000 7f0c31edf640 1 -- 172.21.15.50:0/1244053154 >> v1:172.21.15.77:6789/0 conn(0x7f0c2c161d60 legacy=0x7f0c2c0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.652+0000 7f0c31edf640 1 -- 172.21.15.50:0/1244053154 >> v1:172.21.15.50:6789/0 conn(0x7f0c2c0b6730 legacy=0x7f0c2c0b8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.652+0000 7f0c23fff640 1 -- 172.21.15.50:0/1244053154 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831068204 0 0) 0x7f0c2c0b7990 con 0x7f0c2c0b6730 2024-09-11T22:23:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.652+0000 7f0c31edf640 1 -- 172.21.15.50:0/1244053154 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c0d4250 con 0x7f0c2c0b6ba0 2024-09-11T22:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.652+0000 7f0c31edf640 1 --2- 172.21.15.50:0/1244053154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0b6ba0 0x7f0c2c0b8860 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009d90 tx=0x7f0c2402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa25f6b31c39a476 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.652+0000 7f0c23fff640 1 -- 172.21.15.50:0/1244053154 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24007740 con 0x7f0c2c0b6ba0 2024-09-11T22:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.653+0000 7f0c23fff640 1 -- 172.21.15.50:0/1244053154 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c240078e0 con 0x7f0c2c0b6ba0 2024-09-11T22:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.653+0000 7f0c23fff640 1 -- 172.21.15.50:0/1244053154 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24007cb0 con 0x7f0c2c0b6ba0 2024-09-11T22:23:19.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.653+0000 7f0c33942640 1 -- 172.21.15.50:0/1244053154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0b6ba0 msgr2=0x7f0c2c0b8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.653+0000 7f0c33942640 1 --2- 172.21.15.50:0/1244053154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0b6ba0 0x7f0c2c0b8860 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009d90 tx=0x7f0c2402a660 comp rx=0 tx=0).stop 2024-09-11T22:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.653+0000 7f0c33942640 1 -- 172.21.15.50:0/1244053154 shutdown_connections 2024-09-11T22:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.653+0000 7f0c33942640 1 --2- 172.21.15.50:0/1244053154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0b6ba0 0x7f0c2c0b8860 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.653+0000 7f0c33942640 1 -- 172.21.15.50:0/1244053154 >> 172.21.15.50:0/1244053154 conn(0x7f0c2c067db0 msgr2=0x7f0c2c0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.653+0000 7f0c33942640 1 -- 172.21.15.50:0/1244053154 shutdown_connections 2024-09-11T22:23:19.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.653+0000 7f0c33942640 1 -- 172.21.15.50:0/1244053154 wait complete. 2024-09-11T22:23:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.654+0000 7f0c33942640 1 Processor -- start 2024-09-11T22:23:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.654+0000 7f0c33942640 1 -- start start 2024-09-11T22:23:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.655+0000 7f0c33942640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0b6730 0x7f0c2c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.655+0000 7f0c33942640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c2c0b6ba0 0x7f0c2c15bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.655+0000 7f0c33942640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c161d60 0x7f0c2c1f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.655+0000 7f0c33942640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c0cf930 con 0x7f0c2c0b6730 2024-09-11T22:23:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.655+0000 7f0c33942640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c0b6fd0 con 0x7f0c2c0b6ba0 2024-09-11T22:23:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.655+0000 7f0c33942640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c0d3bc0 con 0x7f0c2c161d60 2024-09-11T22:23:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.655+0000 7f0c316de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0b6730 0x7f0c2c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.655+0000 7f0c316de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0b6730 0x7f0c2c15e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47702/0 (socket says 172.21.15.50:47702) 2024-09-11T22:23:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.655+0000 7f0c316de640 1 -- 172.21.15.50:0/3173746071 learned_addr learned my addr 172.21.15.50:0/3173746071 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.655+0000 7f0c31edf640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c161d60 0x7f0c2c1f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.655+0000 7f0c30edd640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c2c0b6ba0 0x7f0c2c15bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.656+0000 7f0c316de640 1 -- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c161d60 msgr2=0x7f0c2c1f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.656+0000 7f0c316de640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c161d60 0x7f0c2c1f4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.656+0000 7f0c316de640 1 -- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c2c0b6ba0 msgr2=0x7f0c2c15bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.656+0000 7f0c316de640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c2c0b6ba0 0x7f0c2c15bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.656+0000 7f0c316de640 1 -- 172.21.15.50:0/3173746071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c1f54e0 con 0x7f0c2c0b6730 2024-09-11T22:23:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.656+0000 7f0c316de640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0b6730 0x7f0c2c15e7f0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800c480 tx=0x7f0c2800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.656+0000 7f0c21ffb640 1 -- 172.21.15.50:0/3173746071 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c280052d0 con 0x7f0c2c0b6730 2024-09-11T22:23:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.656+0000 7f0c21ffb640 1 -- 172.21.15.50:0/3173746071 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c28005470 con 0x7f0c2c0b6730 2024-09-11T22:23:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.656+0000 7f0c33942640 1 -- 172.21.15.50:0/3173746071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c1f57c0 con 0x7f0c2c0b6730 2024-09-11T22:23:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.656+0000 7f0c21ffb640 1 -- 172.21.15.50:0/3173746071 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c28012870 con 0x7f0c2c0b6730 2024-09-11T22:23:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.656+0000 7f0c33942640 1 -- 172.21.15.50:0/3173746071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c146510 con 0x7f0c2c0b6730 2024-09-11T22:23:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.657+0000 7f0c33942640 1 -- 172.21.15.50:0/3173746071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2c0d34b0 con 0x7f0c2c0b6730 2024-09-11T22:23:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.658+0000 7f0c21ffb640 1 -- 172.21.15.50:0/3173746071 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c28012a10 con 0x7f0c2c0b6730 2024-09-11T22:23:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.658+0000 7f0c21ffb640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c1006be30 0x7f0c1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.658+0000 7f0c21ffb640 1 -- 172.21.15.50:0/3173746071 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 5795+0+0 (secure 0 0 0) 0x7f0c2808aae0 con 0x7f0c2c0b6730 2024-09-11T22:23:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.658+0000 7f0c30edd640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c1006be30 0x7f0c1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.659+0000 7f0c30edd640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c1006be30 0x7f0c1006e2f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c068e20 tx=0x7f0c1c007d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:19.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.662+0000 7f0c21ffb640 1 -- 172.21.15.50:0/3173746071 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c280594c0 con 0x7f0c2c0b6730 2024-09-11T22:23:19.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:19.841+0000 7f0c33942640 1 -- 172.21.15.50:0/3173746071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0c2c0ba6c0 con 0x7f0c2c0b6730 2024-09-11T22:23:20.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.484+0000 7f0c21ffb640 1 -- 172.21.15.50:0/3173746071 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v180) ==== 181+0+0 (secure 0 0 0) 0x7f0c28058dc0 con 0x7f0c2c0b6730 2024-09-11T22:23:20.485 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:23:20.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.488+0000 7f0c33942640 1 -- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c1006be30 msgr2=0x7f0c1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:20.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.488+0000 7f0c33942640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c1006be30 0x7f0c1006e2f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c068e20 tx=0x7f0c1c007d00 comp rx=0 tx=0).stop 2024-09-11T22:23:20.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.488+0000 7f0c33942640 1 -- 172.21.15.50:0/3173746071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0b6730 msgr2=0x7f0c2c15e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:20.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.488+0000 7f0c33942640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0b6730 0x7f0c2c15e7f0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800c480 tx=0x7f0c2800c940 comp rx=0 tx=0).stop 2024-09-11T22:23:20.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.488+0000 7f0c33942640 1 -- 172.21.15.50:0/3173746071 shutdown_connections 2024-09-11T22:23:20.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.488+0000 7f0c33942640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0c1006be30 0x7f0c1006e2f0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:20.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.488+0000 7f0c33942640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0c2c161d60 0x7f0c2c1f4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:20.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.488+0000 7f0c33942640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c2c0b6ba0 0x7f0c2c15bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:20.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.488+0000 7f0c33942640 1 --2- 172.21.15.50:0/3173746071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2c0b6730 0x7f0c2c15e7f0 secure :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800c480 tx=0x7f0c2800c940 comp rx=0 tx=0).stop 2024-09-11T22:23:20.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.488+0000 7f0c33942640 1 -- 172.21.15.50:0/3173746071 >> 172.21.15.50:0/3173746071 conn(0x7f0c2c067db0 msgr2=0x7f0c2c0b8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:20.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.488+0000 7f0c33942640 1 -- 172.21.15.50:0/3173746071 shutdown_connections 2024-09-11T22:23:20.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.489+0000 7f0c33942640 1 -- 172.21.15.50:0/3173746071 wait complete. 2024-09-11T22:23:20.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:23:20.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.615+0000 7fefdd103640 1 Processor -- start 2024-09-11T22:23:20.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.615+0000 7fefdd103640 1 -- start start 2024-09-11T22:23:20.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefdd103640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fefd815c680 0x7fefd80c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:20.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefdd103640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fefd815dd50 0x7fefd806e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefdd103640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd815ca60 con 0x7fefd80c5e00 2024-09-11T22:23:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefdd103640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fefd80b3fd0 con 0x7fefd815c680 2024-09-11T22:23:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefdd103640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fefd80c6380 con 0x7fefd815dd50 2024-09-11T22:23:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd759e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fefd80c5e00 0x7fefd80cf3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55044/0 (socket says 172.21.15.50:55044) 2024-09-11T22:23:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd759e640 1 -- 172.21.15.50:0/955245276 learned_addr learned my addr 172.21.15.50:0/955245276 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd659c640 1 --2- 172.21.15.50:0/955245276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fefd815dd50 0x7fefd806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd6d9d640 1 --2- 172.21.15.50:0/955245276 >> v2:172.21.15.77:3300/0 conn(0x7fefd815c680 0x7fefd80c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3636658961 0 0) 0x7fefd0001490 con 0x7fefd80c5e00 2024-09-11T22:23:20.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefc0003520 con 0x7fefd80c5e00 2024-09-11T22:23:20.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2005825436 0 0) 0x7fefc0003520 con 0x7fefd80c5e00 2024-09-11T22:23:20.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fefd815dd50 msgr2=0x7fefd806e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:20.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 --2- 172.21.15.50:0/955245276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fefd815dd50 0x7fefd806e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:20.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 >> v2:172.21.15.77:3300/0 conn(0x7fefd815c680 msgr2=0x7fefd80c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:20.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 --2- 172.21.15.50:0/955245276 >> v2:172.21.15.77:3300/0 conn(0x7fefd815c680 0x7fefd80c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:20.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd80b4220 con 0x7fefd80c5e00 2024-09-11T22:23:20.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fefd0001bc0 con 0x7fefd80c5e00 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 >> v1:172.21.15.50:6789/0 conn(0x7fefd80c5e00 legacy=0x7fefd80cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 --2- 172.21.15.50:0/955245276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefc00039b0 0x7fefc0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 --2- 172.21.15.50:0/955245276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fefd815dd50 0x7fefc0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 --2- 172.21.15.50:0/955245276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc0004d40 0x7fefc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fefd80b3fd0 con 0x7fefc0004d40 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fefd80c6380 con 0x7fefc00039b0 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.616+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fefc000b9c0 con 0x7fefd815dd50 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.617+0000 7fefd759e640 1 --2- 172.21.15.50:0/955245276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc0004d40 0x7fefc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.617+0000 7fefd6d9d640 1 --2- 172.21.15.50:0/955245276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefc00039b0 0x7fefc0003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.617+0000 7fefd659c640 1 --2- 172.21.15.50:0/955245276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fefd815dd50 0x7fefc0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.617+0000 7fefd759e640 1 -- 172.21.15.50:0/955245276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fefd815dd50 msgr2=0x7fefc0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.617+0000 7fefd759e640 1 --2- 172.21.15.50:0/955245276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fefd815dd50 0x7fefc0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.617+0000 7fefd759e640 1 -- 172.21.15.50:0/955245276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefc00039b0 msgr2=0x7fefc0003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:20.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.617+0000 7fefd759e640 1 --2- 172.21.15.50:0/955245276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefc00039b0 0x7fefc0003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.617+0000 7fefd759e640 1 -- 172.21.15.50:0/955245276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc0003520 con 0x7fefc0004d40 2024-09-11T22:23:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.618+0000 7fefd759e640 1 --2- 172.21.15.50:0/955245276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc0004d40 0x7fefc00051c0 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7fefd80c62b0 tx=0x7fefc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94843ec11a594aac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.618+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd000a6d0 con 0x7fefc0004d40 2024-09-11T22:23:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.618+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd002f070 con 0x7fefc0004d40 2024-09-11T22:23:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.618+0000 7fefd5d9b640 1 -- 172.21.15.50:0/955245276 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd0034470 con 0x7fefc0004d40 2024-09-11T22:23:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.618+0000 7fefdd103640 1 -- 172.21.15.50:0/955245276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc0004d40 msgr2=0x7fefc00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.618+0000 7fefdd103640 1 --2- 172.21.15.50:0/955245276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc0004d40 0x7fefc00051c0 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7fefd80c62b0 tx=0x7fefc0005830 comp rx=0 tx=0).stop 2024-09-11T22:23:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.618+0000 7fefd759e640 1 -- 172.21.15.50:0/955245276 reap_dead start 2024-09-11T22:23:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.618+0000 7fefdd103640 1 -- 172.21.15.50:0/955245276 shutdown_connections 2024-09-11T22:23:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.618+0000 7fefdd103640 1 -- 172.21.15.50:0/955245276 >> 172.21.15.50:0/955245276 conn(0x7fefd8075270 msgr2=0x7fefd80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.618+0000 7fefdd103640 1 -- 172.21.15.50:0/955245276 shutdown_connections 2024-09-11T22:23:20.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.618+0000 7fefdd103640 1 -- 172.21.15.50:0/955245276 wait complete. 2024-09-11T22:23:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.620+0000 7fefdd103640 1 Processor -- start 2024-09-11T22:23:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.620+0000 7fefdd103640 1 -- start start 2024-09-11T22:23:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefdd103640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefd8146f70 0x7fefd80ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefdd103640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd81f63f0 0x7fefd8157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefdd103640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fefd8158160 0x7fefd81f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefdd103640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fefd815da90 con 0x7fefd81f63f0 2024-09-11T22:23:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefdd103640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fefd80b47e0 con 0x7fefd8146f70 2024-09-11T22:23:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefdd103640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fefd80cfab0 con 0x7fefd8158160 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefd659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd81f63f0 0x7fefd8157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefd659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd81f63f0 0x7fefd8157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47714/0 (socket says 172.21.15.50:47714) 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefd659c640 1 -- 172.21.15.50:0/2176757090 learned_addr learned my addr 172.21.15.50:0/2176757090 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefd6d9d640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefd8146f70 0x7fefd80ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefd759e640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fefd8158160 0x7fefd81f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefd659c640 1 -- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fefd8158160 msgr2=0x7fefd81f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefd659c640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fefd8158160 0x7fefd81f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefd659c640 1 -- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefd8146f70 msgr2=0x7fefd80ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefd659c640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefd8146f70 0x7fefd80ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefd659c640 1 -- 172.21.15.50:0/2176757090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd8156b80 con 0x7fefd81f63f0 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefd659c640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd81f63f0 0x7fefd8157c20 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0119d0 tx=0x7fefcc011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefbf7fe640 1 -- 172.21.15.50:0/2176757090 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc00faf0 con 0x7fefd81f63f0 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefbf7fe640 1 -- 172.21.15.50:0/2176757090 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefcc00fc90 con 0x7fefd81f63f0 2024-09-11T22:23:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefdd103640 1 -- 172.21.15.50:0/2176757090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd8156e60 con 0x7fefd81f63f0 2024-09-11T22:23:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefbf7fe640 1 -- 172.21.15.50:0/2176757090 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc014440 con 0x7fefd81f63f0 2024-09-11T22:23:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.621+0000 7fefdd103640 1 -- 172.21.15.50:0/2176757090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd8157420 con 0x7fefd81f63f0 2024-09-11T22:23:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.622+0000 7fefdd103640 1 -- 172.21.15.50:0/2176757090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd80cfe90 con 0x7fefd81f63f0 2024-09-11T22:23:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.623+0000 7fefbf7fe640 1 -- 172.21.15.50:0/2176757090 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fefcc012040 con 0x7fefd81f63f0 2024-09-11T22:23:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.623+0000 7fefbf7fe640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fefc406be30 0x7fefc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.623+0000 7fefbf7fe640 1 -- 172.21.15.50:0/2176757090 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5357+0+0 (secure 0 0 0) 0x7fefcc08b2e0 con 0x7fefd81f63f0 2024-09-11T22:23:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.624+0000 7fefd6d9d640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fefc406be30 0x7fefc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.624+0000 7fefd6d9d640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fefc406be30 0x7fefc406e2f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fefc8009bc0 tx=0x7fefc8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:20.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.628+0000 7fefbf7fe640 1 -- 172.21.15.50:0/2176757090 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fefcc019030 con 0x7fefd81f63f0 2024-09-11T22:23:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:20.808+0000 7fefdd103640 1 -- 172.21.15.50:0/2176757090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fefd81f6870 con 0x7fefd81f63f0 2024-09-11T22:23:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.486+0000 7fefbf7fe640 1 -- 172.21.15.50:0/2176757090 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v181) ==== 169+0+0 (secure 0 0 0) 0x7fefcc059df0 con 0x7fefd81f63f0 2024-09-11T22:23:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:23:21.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.490+0000 7fefdd103640 1 -- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fefc406be30 msgr2=0x7fefc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:21.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.490+0000 7fefdd103640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fefc406be30 0x7fefc406e2f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fefc8009bc0 tx=0x7fefc8009190 comp rx=0 tx=0).stop 2024-09-11T22:23:21.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.490+0000 7fefdd103640 1 -- 172.21.15.50:0/2176757090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd81f63f0 msgr2=0x7fefd8157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:21.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.490+0000 7fefdd103640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd81f63f0 0x7fefd8157c20 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0119d0 tx=0x7fefcc011dd0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.490+0000 7fefdd103640 1 -- 172.21.15.50:0/2176757090 shutdown_connections 2024-09-11T22:23:21.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.490+0000 7fefdd103640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fefc406be30 0x7fefc406e2f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.490+0000 7fefdd103640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fefd8158160 0x7fefd81f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.490+0000 7fefdd103640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd81f63f0 0x7fefd8157c20 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.490+0000 7fefdd103640 1 --2- 172.21.15.50:0/2176757090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefd8146f70 0x7fefd80ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.490+0000 7fefdd103640 1 -- 172.21.15.50:0/2176757090 >> 172.21.15.50:0/2176757090 conn(0x7fefd8075270 msgr2=0x7fefd8072470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:21.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.490+0000 7fefdd103640 1 -- 172.21.15.50:0/2176757090 shutdown_connections 2024-09-11T22:23:21.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.491+0000 7fefdd103640 1 -- 172.21.15.50:0/2176757090 wait complete. 2024-09-11T22:23:21.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T22:23:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.617+0000 7f4ad638d640 1 Processor -- start 2024-09-11T22:23:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.617+0000 7f4ad638d640 1 -- start start 2024-09-11T22:23:21.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.617+0000 7f4ad638d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ad015e9b0 0x7f4ad015f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.617+0000 7f4ad638d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad00b5fd0 con 0x7f4ad00b6d90 2024-09-11T22:23:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.617+0000 7f4ad638d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad00b62b0 con 0x7f4ad006bb50 2024-09-11T22:23:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.617+0000 7f4ad638d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4ad00b6900 con 0x7f4ad015e9b0 2024-09-11T22:23:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.618+0000 7f4acffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ad015e9b0 0x7f4ad015f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.618+0000 7f4ad492a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4ad00b6d90 0x7f4ad006c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55058/0 (socket says 172.21.15.50:55058) 2024-09-11T22:23:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.618+0000 7f4ad492a640 1 -- 172.21.15.50:0/950566563 learned_addr learned my addr 172.21.15.50:0/950566563 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.618+0000 7f4acffff640 1 -- 172.21.15.50:0/950566563 >> v1:172.21.15.77:6789/0 conn(0x7f4ad006bb50 legacy=0x7f4ad00af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.618+0000 7f4acffff640 1 -- 172.21.15.50:0/950566563 >> v1:172.21.15.50:6789/0 conn(0x7f4ad00b6d90 legacy=0x7f4ad006c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.618+0000 7f4acf7fe640 1 -- 172.21.15.50:0/950566563 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518713728 0 0) 0x7f4ad00b5fd0 con 0x7f4ad00b6d90 2024-09-11T22:23:21.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.618+0000 7f4acffff640 1 -- 172.21.15.50:0/950566563 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad00b6590 con 0x7f4ad015e9b0 2024-09-11T22:23:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.619+0000 7f4acffff640 1 --2- 172.21.15.50:0/950566563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad015e9b0 0x7f4ad015f820 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00097a0 tx=0x7f4ac002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1abeb6f95628c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.619+0000 7f4acf7fe640 1 -- 172.21.15.50:0/950566563 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0037070 con 0x7f4ad015e9b0 2024-09-11T22:23:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.619+0000 7f4acf7fe640 1 -- 172.21.15.50:0/950566563 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac0032440 con 0x7f4ad015e9b0 2024-09-11T22:23:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.619+0000 7f4acf7fe640 1 -- 172.21.15.50:0/950566563 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0032810 con 0x7f4ad015e9b0 2024-09-11T22:23:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.619+0000 7f4ad638d640 1 -- 172.21.15.50:0/950566563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad015e9b0 msgr2=0x7f4ad015f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.619+0000 7f4ad638d640 1 --2- 172.21.15.50:0/950566563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad015e9b0 0x7f4ad015f820 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00097a0 tx=0x7f4ac002a230 comp rx=0 tx=0).stop 2024-09-11T22:23:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.620+0000 7f4ad638d640 1 -- 172.21.15.50:0/950566563 shutdown_connections 2024-09-11T22:23:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.620+0000 7f4ad638d640 1 --2- 172.21.15.50:0/950566563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad015e9b0 0x7f4ad015f820 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.620+0000 7f4ad638d640 1 -- 172.21.15.50:0/950566563 >> 172.21.15.50:0/950566563 conn(0x7f4ad00b7940 msgr2=0x7f4ad00b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.620+0000 7f4ad638d640 1 -- 172.21.15.50:0/950566563 shutdown_connections 2024-09-11T22:23:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.620+0000 7f4ad638d640 1 -- 172.21.15.50:0/950566563 wait complete. 2024-09-11T22:23:21.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.621+0000 7f4ad638d640 1 Processor -- start 2024-09-11T22:23:21.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.621+0000 7f4ad638d640 1 -- start start 2024-09-11T22:23:21.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.621+0000 7f4ad638d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad006bb50 0x7f4ad00cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:21.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.621+0000 7f4ad638d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad00b6d90 0x7f4ad0153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.621+0000 7f4ad638d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0153e80 0x7f4ad0154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ad638d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad006d310 con 0x7f4ad00b6d90 2024-09-11T22:23:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ad638d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad015feb0 con 0x7f4ad0153e80 2024-09-11T22:23:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ad638d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad006d490 con 0x7f4ad006bb50 2024-09-11T22:23:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ac7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad00b6d90 0x7f4ad0153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ac7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad00b6d90 0x7f4ad0153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47728/0 (socket says 172.21.15.50:47728) 2024-09-11T22:23:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ac7fff640 1 -- 172.21.15.50:0/3767506980 learned_addr learned my addr 172.21.15.50:0/3767506980 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4acffff640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad006bb50 0x7f4ad00cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ad492a640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0153e80 0x7f4ad0154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ac7fff640 1 -- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad006bb50 msgr2=0x7f4ad00cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ac7fff640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad006bb50 0x7f4ad00cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ac7fff640 1 -- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0153e80 msgr2=0x7f4ad0154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ac7fff640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0153e80 0x7f4ad0154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ac7fff640 1 -- 172.21.15.50:0/3767506980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad00cd620 con 0x7f4ad00b6d90 2024-09-11T22:23:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4acffff640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad006bb50 0x7f4ad00cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ad492a640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0153e80 0x7f4ad0154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ac7fff640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad00b6d90 0x7f4ad0153770 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c450 tx=0x7f4ab800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4acd7fa640 1 -- 172.21.15.50:0/3767506980 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80052d0 con 0x7f4ad00b6d90 2024-09-11T22:23:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4acd7fa640 1 -- 172.21.15.50:0/3767506980 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab8005470 con 0x7f4ad00b6d90 2024-09-11T22:23:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ad638d640 1 -- 172.21.15.50:0/3767506980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad00cd900 con 0x7f4ad00b6d90 2024-09-11T22:23:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4acd7fa640 1 -- 172.21.15.50:0/3767506980 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8012870 con 0x7f4ad00b6d90 2024-09-11T22:23:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.622+0000 7f4ad638d640 1 -- 172.21.15.50:0/3767506980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad00cc7c0 con 0x7f4ad00b6d90 2024-09-11T22:23:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.623+0000 7f4ad638d640 1 -- 172.21.15.50:0/3767506980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad00b5a10 con 0x7f4ad00b6d90 2024-09-11T22:23:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.624+0000 7f4acd7fa640 1 -- 172.21.15.50:0/3767506980 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ab8012a10 con 0x7f4ad00b6d90 2024-09-11T22:23:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.624+0000 7f4acd7fa640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ab006be30 0x7f4ab006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.624+0000 7f4acd7fa640 1 -- 172.21.15.50:0/3767506980 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 4943+0+0 (secure 0 0 0) 0x7f4ab808a6e0 con 0x7f4ad00b6d90 2024-09-11T22:23:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.625+0000 7f4acffff640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ab006be30 0x7f4ab006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.625+0000 7f4acffff640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ab006be30 0x7f4ab006e2f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0034000 tx=0x7f4ac002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.629+0000 7f4acd7fa640 1 -- 172.21.15.50:0/3767506980 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ad00b5a10 con 0x7f4ad00b6d90 2024-09-11T22:23:21.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.804+0000 7f4ad638d640 1 -- 172.21.15.50:0/3767506980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f4ad015f820 con 0x7f4ad00b6d90 2024-09-11T22:23:21.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.808+0000 7f4acd7fa640 1 -- 172.21.15.50:0/3767506980 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v47) ==== 104+0+0 (secure 0 0 0) 0x7f4ab8059420 con 0x7f4ad00b6d90 2024-09-11T22:23:21.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.810+0000 7f4ad638d640 1 -- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ab006be30 msgr2=0x7f4ab006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:21.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.810+0000 7f4ad638d640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ab006be30 0x7f4ab006e2f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0034000 tx=0x7f4ac002e000 comp rx=0 tx=0).stop 2024-09-11T22:23:21.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.810+0000 7f4ad638d640 1 -- 172.21.15.50:0/3767506980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad00b6d90 msgr2=0x7f4ad0153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:21.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.810+0000 7f4ad638d640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad00b6d90 0x7f4ad0153770 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c450 tx=0x7f4ab800c910 comp rx=0 tx=0).stop 2024-09-11T22:23:21.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.810+0000 7f4ad638d640 1 -- 172.21.15.50:0/3767506980 shutdown_connections 2024-09-11T22:23:21.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.810+0000 7f4ad638d640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ab006be30 0x7f4ab006e2f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.810+0000 7f4ad638d640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0153e80 0x7f4ad0154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.810+0000 7f4ad638d640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ad00b6d90 0x7f4ad0153770 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.810+0000 7f4ad638d640 1 --2- 172.21.15.50:0/3767506980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad006bb50 0x7f4ad00cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.810+0000 7f4ad638d640 1 -- 172.21.15.50:0/3767506980 >> 172.21.15.50:0/3767506980 conn(0x7f4ad00b7940 msgr2=0x7f4ad006fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:21.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.810+0000 7f4ad638d640 1 -- 172.21.15.50:0/3767506980 shutdown_connections 2024-09-11T22:23:21.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.810+0000 7f4ad638d640 1 -- 172.21.15.50:0/3767506980 wait complete. 2024-09-11T22:23:21.821 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-11T22:23:21.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.924+0000 7f68a8f6d640 1 Processor -- start 2024-09-11T22:23:21.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.924+0000 7f68a8f6d640 1 -- start start 2024-09-11T22:23:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.925+0000 7f68a8f6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68a4161fa0 0x7f68a40b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.925+0000 7f68a8f6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f68a40b1600 0x7f68a40cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.925+0000 7f68a8f6d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f68a40cf440 0x7f68a406bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.925+0000 7f68a8f6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f68a40d1220 con 0x7f68a40b1600 2024-09-11T22:23:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.925+0000 7f68a8f6d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f68a40d17e0 con 0x7f68a40cf440 2024-09-11T22:23:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.925+0000 7f68a8f6d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f68a40cfbd0 con 0x7f68a4161fa0 2024-09-11T22:23:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.925+0000 7f68a1d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f68a40b1600 0x7f68a40cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.925+0000 7f68a1d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f68a40b1600 0x7f68a40cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47738/0 (socket says 172.21.15.50:47738) 2024-09-11T22:23:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.925+0000 7f68a1d9b640 1 -- 172.21.15.50:0/4114299168 learned_addr learned my addr 172.21.15.50:0/4114299168 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.925+0000 7f68a259c640 1 --2- 172.21.15.50:0/4114299168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68a4161fa0 0x7f68a40b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.925+0000 7f68a2d9d640 1 --2- 172.21.15.50:0/4114299168 >> v2:172.21.15.77:3300/0 conn(0x7f68a40cf440 0x7f68a406bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.925+0000 7f68a1d9b640 1 -- 172.21.15.50:0/4114299168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68a4161fa0 msgr2=0x7f68a40b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.926+0000 7f68a1d9b640 1 --2- 172.21.15.50:0/4114299168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68a4161fa0 0x7f68a40b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.926+0000 7f68a1d9b640 1 -- 172.21.15.50:0/4114299168 >> v2:172.21.15.77:3300/0 conn(0x7f68a40cf440 msgr2=0x7f68a406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.926+0000 7f68a1d9b640 1 --2- 172.21.15.50:0/4114299168 >> v2:172.21.15.77:3300/0 conn(0x7f68a40cf440 0x7f68a406bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.926+0000 7f68a1d9b640 1 -- 172.21.15.50:0/4114299168 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a40cfeb0 con 0x7f68a40b1600 2024-09-11T22:23:21.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.926+0000 7f68a1d9b640 1 --2- 172.21.15.50:0/4114299168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68a40b1600 0x7f68a40cef00 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f68a4073640 tx=0x7f689802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58c415a3ffefb13 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:21.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.926+0000 7f68a159a640 1 -- 172.21.15.50:0/4114299168 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6898037070 con 0x7f68a40b1600 2024-09-11T22:23:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.926+0000 7f68a159a640 1 -- 172.21.15.50:0/4114299168 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6898032440 con 0x7f68a40b1600 2024-09-11T22:23:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.927+0000 7f68a159a640 1 -- 172.21.15.50:0/4114299168 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6898032810 con 0x7f68a40b1600 2024-09-11T22:23:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.927+0000 7f68a8f6d640 1 -- 172.21.15.50:0/4114299168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68a40b1600 msgr2=0x7f68a40cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.927+0000 7f68a8f6d640 1 --2- 172.21.15.50:0/4114299168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68a40b1600 0x7f68a40cef00 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f68a4073640 tx=0x7f689802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.927+0000 7f68a8f6d640 1 -- 172.21.15.50:0/4114299168 shutdown_connections 2024-09-11T22:23:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.927+0000 7f68a8f6d640 1 --2- 172.21.15.50:0/4114299168 >> v2:172.21.15.77:3300/0 conn(0x7f68a40cf440 0x7f68a406bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.927+0000 7f68a8f6d640 1 --2- 172.21.15.50:0/4114299168 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68a40b1600 0x7f68a40cef00 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.927+0000 7f68a8f6d640 1 --2- 172.21.15.50:0/4114299168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68a4161fa0 0x7f68a40b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.927+0000 7f68a8f6d640 1 -- 172.21.15.50:0/4114299168 >> 172.21.15.50:0/4114299168 conn(0x7f68a409ba50 msgr2=0x7f68a40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.927+0000 7f68a8f6d640 1 -- 172.21.15.50:0/4114299168 shutdown_connections 2024-09-11T22:23:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.927+0000 7f68a8f6d640 1 -- 172.21.15.50:0/4114299168 wait complete. 2024-09-11T22:23:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.928+0000 7f68a8f6d640 1 Processor -- start 2024-09-11T22:23:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.928+0000 7f68a8f6d640 1 -- start start 2024-09-11T22:23:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.929+0000 7f68a8f6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68a40b1600 0x7f68a4155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.929+0000 7f68a8f6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a40cf440 0x7f68a4070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.929+0000 7f68a8f6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68a4161fa0 0x7f68a4070890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.929+0000 7f68a8f6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f68a4162380 con 0x7f68a4161fa0 2024-09-11T22:23:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.929+0000 7f68a8f6d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f68a40cf8f0 con 0x7f68a40cf440 2024-09-11T22:23:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.929+0000 7f68a8f6d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f68a4162500 con 0x7f68a40b1600 2024-09-11T22:23:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.929+0000 7f68a2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68a4161fa0 0x7f68a4070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.929+0000 7f68a2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68a4161fa0 0x7f68a4070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47750/0 (socket says 172.21.15.50:47750) 2024-09-11T22:23:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.929+0000 7f68a2d9d640 1 -- 172.21.15.50:0/807740060 learned_addr learned my addr 172.21.15.50:0/807740060 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.929+0000 7f68a259c640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68a40b1600 0x7f68a4155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.929+0000 7f68a1d9b640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a40cf440 0x7f68a4070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.930+0000 7f68a2d9d640 1 -- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68a40b1600 msgr2=0x7f68a4155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.930+0000 7f68a2d9d640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68a40b1600 0x7f68a4155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.930+0000 7f68a2d9d640 1 -- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a40cf440 msgr2=0x7f68a4070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.930+0000 7f68a2d9d640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a40cf440 0x7f68a4070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.930+0000 7f68a2d9d640 1 -- 172.21.15.50:0/807740060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a415f020 con 0x7f68a4161fa0 2024-09-11T22:23:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.930+0000 7f68a2d9d640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68a4161fa0 0x7f68a4070890 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f689c007e40 tx=0x7f689c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.930+0000 7f6892ffd640 1 -- 172.21.15.50:0/807740060 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c014620 con 0x7f68a4161fa0 2024-09-11T22:23:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.930+0000 7f6892ffd640 1 -- 172.21.15.50:0/807740060 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689c019070 con 0x7f68a4161fa0 2024-09-11T22:23:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.930+0000 7f68a8f6d640 1 -- 172.21.15.50:0/807740060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a415f2c0 con 0x7f68a4161fa0 2024-09-11T22:23:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.930+0000 7f6892ffd640 1 -- 172.21.15.50:0/807740060 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c014a20 con 0x7f68a4161fa0 2024-09-11T22:23:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.930+0000 7f68a8f6d640 1 -- 172.21.15.50:0/807740060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a415f880 con 0x7f68a4161fa0 2024-09-11T22:23:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.931+0000 7f68a8f6d640 1 -- 172.21.15.50:0/807740060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a40d1c70 con 0x7f68a4161fa0 2024-09-11T22:23:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.931+0000 7f6892ffd640 1 -- 172.21.15.50:0/807740060 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f689c014bc0 con 0x7f68a4161fa0 2024-09-11T22:23:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.932+0000 7f6892ffd640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f688406be60 0x7f688406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.932+0000 7f6892ffd640 1 -- 172.21.15.50:0/807740060 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 4943+0+0 (secure 0 0 0) 0x7f689c08b230 con 0x7f68a4161fa0 2024-09-11T22:23:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.932+0000 7f68a259c640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f688406be60 0x7f688406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.933+0000 7f68a259c640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f688406be60 0x7f688406e320 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f6894007920 tx=0x7f6894008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:21.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:21.936+0000 7f6892ffd640 1 -- 172.21.15.50:0/807740060 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f689c059920 con 0x7f68a4161fa0 2024-09-11T22:23:22.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.179+0000 7f68a8f6d640 1 -- 172.21.15.50:0/807740060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f68a40af560 con 0x7f68a4161fa0 2024-09-11T22:23:22.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.490+0000 7f6892ffd640 1 -- 172.21.15.50:0/807740060 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v580) ==== 140+0+0 (secure 0 0 0) 0x7f689c05dc20 con 0x7f68a4161fa0 2024-09-11T22:23:22.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.492+0000 7f68a8f6d640 1 -- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f688406be60 msgr2=0x7f688406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:22.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.492+0000 7f68a8f6d640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f688406be60 0x7f688406e320 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f6894007920 tx=0x7f6894008040 comp rx=0 tx=0).stop 2024-09-11T22:23:22.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.492+0000 7f68a8f6d640 1 -- 172.21.15.50:0/807740060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68a4161fa0 msgr2=0x7f68a4070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:22.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.492+0000 7f68a8f6d640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68a4161fa0 0x7f68a4070890 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f689c007e40 tx=0x7f689c00e4b0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.492+0000 7f68a8f6d640 1 -- 172.21.15.50:0/807740060 shutdown_connections 2024-09-11T22:23:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.492+0000 7f68a8f6d640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f688406be60 0x7f688406e320 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.492+0000 7f68a8f6d640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68a4161fa0 0x7f68a4070890 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.492+0000 7f68a8f6d640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a40cf440 0x7f68a4070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.492+0000 7f68a8f6d640 1 --2- 172.21.15.50:0/807740060 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68a40b1600 0x7f68a4155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.492+0000 7f68a8f6d640 1 -- 172.21.15.50:0/807740060 >> 172.21.15.50:0/807740060 conn(0x7f68a409ba50 msgr2=0x7f68a40b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.493+0000 7f68a8f6d640 1 -- 172.21.15.50:0/807740060 shutdown_connections 2024-09-11T22:23:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.493+0000 7f68a8f6d640 1 -- 172.21.15.50:0/807740060 wait complete. 2024-09-11T22:23:22.505 INFO:tasks.cephfs_test_runner:test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-11T22:23:22.506 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-11T22:23:22.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:23:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.609+0000 7f755a017640 1 Processor -- start 2024-09-11T22:23:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.609+0000 7f755a017640 1 -- start start 2024-09-11T22:23:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.610+0000 7f755a017640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7554161fa0 0x7f75540b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.610+0000 7f755a017640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75540b1600 0x7f75540cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.610+0000 7f755a017640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75540cfbd0 con 0x7f75540cf440 2024-09-11T22:23:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.610+0000 7f755a017640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f75540cdce0 con 0x7f75540b1600 2024-09-11T22:23:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.610+0000 7f755a017640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f75540d1220 con 0x7f7554161fa0 2024-09-11T22:23:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.610+0000 7f7552ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75540b1600 0x7f75540cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.610+0000 7f7552ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75540b1600 0x7f75540cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47760/0 (socket says 172.21.15.50:47760) 2024-09-11T22:23:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.610+0000 7f7552ffd640 1 -- 172.21.15.50:0/3820795098 learned_addr learned my addr 172.21.15.50:0/3820795098 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.610+0000 7f75537fe640 1 --2- 172.21.15.50:0/3820795098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7554161fa0 0x7f75540b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.611+0000 7f7552ffd640 1 -- 172.21.15.50:0/3820795098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7554161fa0 msgr2=0x7f75540b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.611+0000 7f7552ffd640 1 --2- 172.21.15.50:0/3820795098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7554161fa0 0x7f75540b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.611+0000 7f7552ffd640 1 -- 172.21.15.50:0/3820795098 >> v1:172.21.15.77:6789/0 conn(0x7f75540cf440 legacy=0x7f755406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.611+0000 7f7552ffd640 1 -- 172.21.15.50:0/3820795098 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75540cfeb0 con 0x7f75540b1600 2024-09-11T22:23:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.611+0000 7f75537fe640 1 --2- 172.21.15.50:0/3820795098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7554161fa0 0x7f75540b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.611+0000 7f7552ffd640 1 --2- 172.21.15.50:0/3820795098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75540b1600 0x7f75540cef00 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f7548009870 tx=0x7f754802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ab9d801335ba9c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.611+0000 7f75527fc640 1 -- 172.21.15.50:0/3820795098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548037070 con 0x7f75540b1600 2024-09-11T22:23:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.612+0000 7f75527fc640 1 -- 172.21.15.50:0/3820795098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7548032440 con 0x7f75540b1600 2024-09-11T22:23:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.612+0000 7f75527fc640 1 -- 172.21.15.50:0/3820795098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548032810 con 0x7f75540b1600 2024-09-11T22:23:22.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.612+0000 7f755a017640 1 -- 172.21.15.50:0/3820795098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75540b1600 msgr2=0x7f75540cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:22.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.612+0000 7f755a017640 1 --2- 172.21.15.50:0/3820795098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75540b1600 0x7f75540cef00 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f7548009870 tx=0x7f754802a270 comp rx=0 tx=0).stop 2024-09-11T22:23:22.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.612+0000 7f755a017640 1 -- 172.21.15.50:0/3820795098 shutdown_connections 2024-09-11T22:23:22.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.612+0000 7f755a017640 1 --2- 172.21.15.50:0/3820795098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75540b1600 0x7f75540cef00 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.612+0000 7f755a017640 1 --2- 172.21.15.50:0/3820795098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7554161fa0 0x7f75540b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.612+0000 7f755a017640 1 -- 172.21.15.50:0/3820795098 >> 172.21.15.50:0/3820795098 conn(0x7f755409ba50 msgr2=0x7f75540b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:22.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.612+0000 7f755a017640 1 -- 172.21.15.50:0/3820795098 shutdown_connections 2024-09-11T22:23:22.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.612+0000 7f755a017640 1 -- 172.21.15.50:0/3820795098 wait complete. 2024-09-11T22:23:22.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.613+0000 7f755a017640 1 Processor -- start 2024-09-11T22:23:22.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.614+0000 7f755a017640 1 -- start start 2024-09-11T22:23:22.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.614+0000 7f755a017640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75540b1600 0x7f75540b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:22.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.614+0000 7f755a017640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f75540cf440 0x7f75540b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:22.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.614+0000 7f755a017640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554161fa0 0x7f75541f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:22.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.614+0000 7f755a017640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f75540cf8f0 con 0x7f7554161fa0 2024-09-11T22:23:22.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.614+0000 7f755a017640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f75540d17e0 con 0x7f75540b1600 2024-09-11T22:23:22.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.614+0000 7f755a017640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7554162380 con 0x7f75540cf440 2024-09-11T22:23:22.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.614+0000 7f7553fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554161fa0 0x7f75541f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:22.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.614+0000 7f7553fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554161fa0 0x7f75541f4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47774/0 (socket says 172.21.15.50:47774) 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.614+0000 7f7553fff640 1 -- 172.21.15.50:0/3862630710 learned_addr learned my addr 172.21.15.50:0/3862630710 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f7552ffd640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f75540cf440 0x7f75540b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f75537fe640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75540b1600 0x7f75540b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f7553fff640 1 -- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f75540cf440 msgr2=0x7f75540b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f7553fff640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f75540cf440 0x7f75540b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f7553fff640 1 -- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75540b1600 msgr2=0x7f75540b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f7553fff640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75540b1600 0x7f75540b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f7553fff640 1 -- 172.21.15.50:0/3862630710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7554161050 con 0x7f7554161fa0 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f7552ffd640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f75540cf440 0x7f75540b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f7553fff640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554161fa0 0x7f75541f4960 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f754c00c710 tx=0x7f754c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f753bfff640 1 -- 172.21.15.50:0/3862630710 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c016020 con 0x7f7554161fa0 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f753bfff640 1 -- 172.21.15.50:0/3862630710 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f754c006d50 con 0x7f7554161fa0 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f753bfff640 1 -- 172.21.15.50:0/3862630710 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c003bb0 con 0x7f7554161fa0 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f755a017640 1 -- 172.21.15.50:0/3862630710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7554161330 con 0x7f7554161fa0 2024-09-11T22:23:22.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.615+0000 7f755a017640 1 -- 172.21.15.50:0/3862630710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7554161610 con 0x7f7554161fa0 2024-09-11T22:23:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.616+0000 7f755a017640 1 -- 172.21.15.50:0/3862630710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75540d1c70 con 0x7f7554161fa0 2024-09-11T22:23:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.617+0000 7f753bfff640 1 -- 172.21.15.50:0/3862630710 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f754c00a850 con 0x7f7554161fa0 2024-09-11T22:23:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.617+0000 7f753bfff640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f754006be30 0x7f754006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.617+0000 7f753bfff640 1 -- 172.21.15.50:0/3862630710 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 4943+0+0 (secure 0 0 0) 0x7f754c08a7a0 con 0x7f7554161fa0 2024-09-11T22:23:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.617+0000 7f75537fe640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f754006be30 0x7f754006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.618+0000 7f75537fe640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f754006be30 0x7f754006e2f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f7544006fd0 tx=0x7f7544008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.621+0000 7f753bfff640 1 -- 172.21.15.50:0/3862630710 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f754c020020 con 0x7f7554161fa0 2024-09-11T22:23:22.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.796+0000 7f755a017640 1 -- 172.21.15.50:0/3862630710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75540b2190 con 0x7f7554161fa0 2024-09-11T22:23:22.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.797+0000 7f753bfff640 1 -- 172.21.15.50:0/3862630710 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) ==== 74+0+13006 (secure 0 0 0) 0x7f754c019310 con 0x7f7554161fa0 2024-09-11T22:23:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:22.798 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":181,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:23:21.485478+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/4092595783":"2024-09-12T22:23:18.475356+0000","172.21.15.50:6834/4092595783":"2024-09-12T22:23:18.475356+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:23:22.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.799+0000 7f755a017640 1 -- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f754006be30 msgr2=0x7f754006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:22.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.799+0000 7f755a017640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f754006be30 0x7f754006e2f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f7544006fd0 tx=0x7f7544008040 comp rx=0 tx=0).stop 2024-09-11T22:23:22.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.799+0000 7f755a017640 1 -- 172.21.15.50:0/3862630710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554161fa0 msgr2=0x7f75541f4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:22.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.799+0000 7f755a017640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554161fa0 0x7f75541f4960 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f754c00c710 tx=0x7f754c00cbd0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.799+0000 7f755a017640 1 -- 172.21.15.50:0/3862630710 shutdown_connections 2024-09-11T22:23:22.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.799+0000 7f755a017640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f754006be30 0x7f754006e2f0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.799+0000 7f755a017640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f75540cf440 0x7f75540b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.799+0000 7f755a017640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7554161fa0 0x7f75541f4960 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.799+0000 7f755a017640 1 --2- 172.21.15.50:0/3862630710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75540b1600 0x7f75540b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.799+0000 7f755a017640 1 -- 172.21.15.50:0/3862630710 >> 172.21.15.50:0/3862630710 conn(0x7f755409ba50 msgr2=0x7f755406c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:22.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.799+0000 7f755a017640 1 -- 172.21.15.50:0/3862630710 shutdown_connections 2024-09-11T22:23:22.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.799+0000 7f755a017640 1 -- 172.21.15.50:0/3862630710 wait complete. 2024-09-11T22:23:22.811 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:11:03.407373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:23:22.812 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:23:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.916+0000 7f2290877640 1 Processor -- start 2024-09-11T22:23:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.916+0000 7f2290877640 1 -- start start 2024-09-11T22:23:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.917+0000 7f2290877640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f228c15e870 0x7f228c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.917+0000 7f2290877640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f228c0d16d0 0x7f228c0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.917+0000 7f2290877640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228c0cfa80 con 0x7f228c0d3a30 2024-09-11T22:23:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.917+0000 7f2290877640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f228c0d1b10 con 0x7f228c15e870 2024-09-11T22:23:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.917+0000 7f2290877640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f228c0d3e80 con 0x7f228c0d16d0 2024-09-11T22:23:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.917+0000 7f228ad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f228c0d3a30 0x7f228c0b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55072/0 (socket says 172.21.15.50:55072) 2024-09-11T22:23:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.917+0000 7f228ad9d640 1 -- 172.21.15.50:0/8367272 learned_addr learned my addr 172.21.15.50:0/8367272 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.917+0000 7f2289d9b640 1 --2- 172.21.15.50:0/8367272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f228c0d16d0 0x7f228c0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.917+0000 7f228a59c640 1 --2- 172.21.15.50:0/8367272 >> v2:172.21.15.77:3300/0 conn(0x7f228c15e870 0x7f228c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.917+0000 7f228959a640 1 -- 172.21.15.50:0/8367272 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1309358391 0 0) 0x7f2284001490 con 0x7f228c0d3a30 2024-09-11T22:23:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.917+0000 7f228959a640 1 -- 172.21.15.50:0/8367272 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2278003520 con 0x7f228c0d3a30 2024-09-11T22:23:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.918+0000 7f228959a640 1 -- 172.21.15.50:0/8367272 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2591465702 0 0) 0x7f2278003520 con 0x7f228c0d3a30 2024-09-11T22:23:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.918+0000 7f228a59c640 1 -- 172.21.15.50:0/8367272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f228c0d16d0 msgr2=0x7f228c0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.918+0000 7f228a59c640 1 --2- 172.21.15.50:0/8367272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f228c0d16d0 0x7f228c0d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.918+0000 7f228a59c640 1 -- 172.21.15.50:0/8367272 >> v1:172.21.15.50:6789/0 conn(0x7f228c0d3a30 legacy=0x7f228c0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.918+0000 7f228a59c640 1 -- 172.21.15.50:0/8367272 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c0d40d0 con 0x7f228c15e870 2024-09-11T22:23:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.918+0000 7f2289d9b640 1 --2- 172.21.15.50:0/8367272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f228c0d16d0 0x7f228c0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.918+0000 7f228a59c640 1 --2- 172.21.15.50:0/8367272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f228c15e870 0x7f228c0d1190 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f22740097a0 tx=0x7f227402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8a65030fb20125a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.919+0000 7f228959a640 1 -- 172.21.15.50:0/8367272 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2274037070 con 0x7f228c15e870 2024-09-11T22:23:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.919+0000 7f228959a640 1 -- 172.21.15.50:0/8367272 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227402aba0 con 0x7f228c15e870 2024-09-11T22:23:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.919+0000 7f228959a640 1 -- 172.21.15.50:0/8367272 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284001bc0 con 0x7f228c15e870 2024-09-11T22:23:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.919+0000 7f2290877640 1 -- 172.21.15.50:0/8367272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f228c15e870 msgr2=0x7f228c0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.919+0000 7f2290877640 1 --2- 172.21.15.50:0/8367272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f228c15e870 0x7f228c0d1190 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f22740097a0 tx=0x7f227402a110 comp rx=0 tx=0).stop 2024-09-11T22:23:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.919+0000 7f2290877640 1 -- 172.21.15.50:0/8367272 shutdown_connections 2024-09-11T22:23:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.919+0000 7f2290877640 1 --2- 172.21.15.50:0/8367272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f228c0d16d0 0x7f228c0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.919+0000 7f2290877640 1 --2- 172.21.15.50:0/8367272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f228c15e870 0x7f228c0d1190 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.919+0000 7f2290877640 1 -- 172.21.15.50:0/8367272 >> 172.21.15.50:0/8367272 conn(0x7f228c0727a0 msgr2=0x7f228c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.919+0000 7f2290877640 1 -- 172.21.15.50:0/8367272 shutdown_connections 2024-09-11T22:23:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.919+0000 7f2290877640 1 -- 172.21.15.50:0/8367272 wait complete. 2024-09-11T22:23:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.921+0000 7f2290877640 1 Processor -- start 2024-09-11T22:23:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.921+0000 7f2290877640 1 -- start start 2024-09-11T22:23:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.921+0000 7f2290877640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f228c0d16d0 0x7f228c15b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.921+0000 7f2290877640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228c0d3a30 0x7f228c15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.921+0000 7f2290877640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f228c15e870 0x7f228c0cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.921+0000 7f2290877640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f228c0b7ee0 con 0x7f228c0d3a30 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.921+0000 7f2290877640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f228c0b7c00 con 0x7f228c15e870 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.921+0000 7f2290877640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f228c15ec50 con 0x7f228c0d16d0 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.921+0000 7f2289d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228c0d3a30 0x7f228c15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.921+0000 7f2289d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228c0d3a30 0x7f228c15ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47786/0 (socket says 172.21.15.50:47786) 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.921+0000 7f2289d9b640 1 -- 172.21.15.50:0/1550099978 learned_addr learned my addr 172.21.15.50:0/1550099978 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f228a59c640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f228c0d16d0 0x7f228c15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f228ad9d640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f228c15e870 0x7f228c0cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f2289d9b640 1 -- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f228c0d16d0 msgr2=0x7f228c15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f2289d9b640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f228c0d16d0 0x7f228c15b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f2289d9b640 1 -- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f228c15e870 msgr2=0x7f228c0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f2289d9b640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f228c15e870 0x7f228c0cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f2289d9b640 1 -- 172.21.15.50:0/1550099978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c0b6b60 con 0x7f228c0d3a30 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f228ad9d640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f228c15e870 0x7f228c0cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f2289d9b640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228c0d3a30 0x7f228c15ad80 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f227c00ebe0 tx=0x7f227c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f2282ffd640 1 -- 172.21.15.50:0/1550099978 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c017070 con 0x7f228c0d3a30 2024-09-11T22:23:22.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f2282ffd640 1 -- 172.21.15.50:0/1550099978 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c00cc30 con 0x7f228c0d3a30 2024-09-11T22:23:22.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f2290877640 1 -- 172.21.15.50:0/1550099978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c0cb510 con 0x7f228c0d3a30 2024-09-11T22:23:22.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f2282ffd640 1 -- 172.21.15.50:0/1550099978 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c013470 con 0x7f228c0d3a30 2024-09-11T22:23:22.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.922+0000 7f2290877640 1 -- 172.21.15.50:0/1550099978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c0b65a0 con 0x7f228c0d3a30 2024-09-11T22:23:22.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.923+0000 7f2290877640 1 -- 172.21.15.50:0/1550099978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c075770 con 0x7f228c0d3a30 2024-09-11T22:23:22.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.924+0000 7f2282ffd640 1 -- 172.21.15.50:0/1550099978 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f227c01a070 con 0x7f228c0d3a30 2024-09-11T22:23:22.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.924+0000 7f2282ffd640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f226c06be30 0x7f226c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:22.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.924+0000 7f2282ffd640 1 -- 172.21.15.50:0/1550099978 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 4943+0+0 (secure 0 0 0) 0x7f227c08a9d0 con 0x7f228c0d3a30 2024-09-11T22:23:22.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.925+0000 7f228a59c640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f226c06be30 0x7f226c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:22.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.925+0000 7f228a59c640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f226c06be30 0x7f226c06e2f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f2274034000 tx=0x7f227402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:22.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:22.929+0000 7f2282ffd640 1 -- 172.21.15.50:0/1550099978 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f228c075770 con 0x7f228c0d3a30 2024-09-11T22:23:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.103+0000 7f2290877640 1 -- 172.21.15.50:0/1550099978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f228c0b78b0 con 0x7f228c0d3a30 2024-09-11T22:23:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.104+0000 7f2282ffd640 1 -- 172.21.15.50:0/1550099978 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v181) ==== 93+0+10 (secure 0 0 0) 0x7f227c0590c0 con 0x7f228c0d3a30 2024-09-11T22:23:23.104 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-11T22:23:23.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.105+0000 7f2290877640 1 -- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f226c06be30 msgr2=0x7f226c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.105+0000 7f2290877640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f226c06be30 0x7f226c06e2f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f2274034000 tx=0x7f227402e000 comp rx=0 tx=0).stop 2024-09-11T22:23:23.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.105+0000 7f2290877640 1 -- 172.21.15.50:0/1550099978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228c0d3a30 msgr2=0x7f228c15ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.105+0000 7f2290877640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228c0d3a30 0x7f228c15ad80 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f227c00ebe0 tx=0x7f227c00c520 comp rx=0 tx=0).stop 2024-09-11T22:23:23.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.105+0000 7f2290877640 1 -- 172.21.15.50:0/1550099978 shutdown_connections 2024-09-11T22:23:23.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.105+0000 7f2290877640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f226c06be30 0x7f226c06e2f0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.105+0000 7f2290877640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f228c15e870 0x7f228c0cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.105+0000 7f2290877640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f228c0d3a30 0x7f228c15ad80 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.105+0000 7f2290877640 1 --2- 172.21.15.50:0/1550099978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f228c0d16d0 0x7f228c15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.105+0000 7f2290877640 1 -- 172.21.15.50:0/1550099978 >> 172.21.15.50:0/1550099978 conn(0x7f228c0727a0 msgr2=0x7f228c0d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:23.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.106+0000 7f2290877640 1 -- 172.21.15.50:0/1550099978 shutdown_connections 2024-09-11T22:23:23.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.106+0000 7f2290877640 1 -- 172.21.15.50:0/1550099978 wait complete. 2024-09-11T22:23:23.118 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-11T22:23:23.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.219+0000 7f701660e640 1 Processor -- start 2024-09-11T22:23:23.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.219+0000 7f701660e640 1 -- start start 2024-09-11T22:23:23.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.220+0000 7f701660e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7010161fa0 0x7f70100b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.220+0000 7f701660e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70100cf610 0x7f70100cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.220+0000 7f701660e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70100cfbd0 con 0x7f70100b1600 2024-09-11T22:23:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.220+0000 7f701660e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f70100d1220 con 0x7f70100cf610 2024-09-11T22:23:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.220+0000 7f701660e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f70100d17e0 con 0x7f7010161fa0 2024-09-11T22:23:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.220+0000 7f7014bab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70100cf610 0x7f70100cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.220+0000 7f7014bab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70100cf610 0x7f70100cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47798/0 (socket says 172.21.15.50:47798) 2024-09-11T22:23:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.220+0000 7f7014bab640 1 -- 172.21.15.50:0/1377739166 learned_addr learned my addr 172.21.15.50:0/1377739166 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.220+0000 7f700ffff640 1 --2- 172.21.15.50:0/1377739166 >> v2:172.21.15.77:3300/0 conn(0x7f7010161fa0 0x7f70100b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.220+0000 7f7014bab640 1 -- 172.21.15.50:0/1377739166 >> v2:172.21.15.77:3300/0 conn(0x7f7010161fa0 msgr2=0x7f70100b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.220+0000 7f7014bab640 1 --2- 172.21.15.50:0/1377739166 >> v2:172.21.15.77:3300/0 conn(0x7f7010161fa0 0x7f70100b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.220+0000 7f7014bab640 1 -- 172.21.15.50:0/1377739166 >> v1:172.21.15.50:6789/0 conn(0x7f70100b1600 legacy=0x7f70100cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.221+0000 7f7014bab640 1 -- 172.21.15.50:0/1377739166 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70100cfeb0 con 0x7f70100cf610 2024-09-11T22:23:23.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.221+0000 7f700effd640 1 -- 172.21.15.50:0/1377739166 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2331005326 0 0) 0x7f70100cfbd0 con 0x7f70100b1600 2024-09-11T22:23:23.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.221+0000 7f7014bab640 1 --2- 172.21.15.50:0/1377739166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70100cf610 0x7f70100cccd0 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f7010072960 tx=0x7f700802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157acdf78ce587ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:23.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.221+0000 7f700effd640 1 -- 172.21.15.50:0/1377739166 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008036070 con 0x7f70100cf610 2024-09-11T22:23:23.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.221+0000 7f700effd640 1 -- 172.21.15.50:0/1377739166 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7008031600 con 0x7f70100cf610 2024-09-11T22:23:23.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.221+0000 7f700effd640 1 -- 172.21.15.50:0/1377739166 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70080319d0 con 0x7f70100cf610 2024-09-11T22:23:23.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.222+0000 7f701660e640 1 -- 172.21.15.50:0/1377739166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70100cf610 msgr2=0x7f70100cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.222+0000 7f701660e640 1 --2- 172.21.15.50:0/1377739166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70100cf610 0x7f70100cccd0 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f7010072960 tx=0x7f700802a730 comp rx=0 tx=0).stop 2024-09-11T22:23:23.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.222+0000 7f701660e640 1 -- 172.21.15.50:0/1377739166 shutdown_connections 2024-09-11T22:23:23.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.222+0000 7f701660e640 1 --2- 172.21.15.50:0/1377739166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70100cf610 0x7f70100cccd0 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.222+0000 7f701660e640 1 --2- 172.21.15.50:0/1377739166 >> v2:172.21.15.77:3300/0 conn(0x7f7010161fa0 0x7f70100b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.222+0000 7f701660e640 1 -- 172.21.15.50:0/1377739166 >> 172.21.15.50:0/1377739166 conn(0x7f701009ba50 msgr2=0x7f70100b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:23.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.222+0000 7f701660e640 1 -- 172.21.15.50:0/1377739166 shutdown_connections 2024-09-11T22:23:23.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.222+0000 7f701660e640 1 -- 172.21.15.50:0/1377739166 wait complete. 2024-09-11T22:23:23.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.223+0000 7f701660e640 1 Processor -- start 2024-09-11T22:23:23.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.223+0000 7f701660e640 1 -- start start 2024-09-11T22:23:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.224+0000 7f701660e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70100b1600 0x7f7010161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.224+0000 7f701660e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70100cf610 0x7f70100b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.224+0000 7f701660e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7010161fa0 0x7f70101f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.224+0000 7f701660e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7010162500 con 0x7f70100cf610 2024-09-11T22:23:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.224+0000 7f701660e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7010162380 con 0x7f7010161fa0 2024-09-11T22:23:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.224+0000 7f701660e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f70100d1c70 con 0x7f70100b1600 2024-09-11T22:23:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.224+0000 7f700f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70100cf610 0x7f70100b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.224+0000 7f700f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70100cf610 0x7f70100b7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47806/0 (socket says 172.21.15.50:47806) 2024-09-11T22:23:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.224+0000 7f700f7fe640 1 -- 172.21.15.50:0/2441493741 learned_addr learned my addr 172.21.15.50:0/2441493741 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.224+0000 7f700ffff640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70100b1600 0x7f7010161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.224+0000 7f7014bab640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7010161fa0 0x7f70101f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.225+0000 7f700f7fe640 1 -- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70100b1600 msgr2=0x7f7010161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.225+0000 7f700f7fe640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70100b1600 0x7f7010161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.225+0000 7f700f7fe640 1 -- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7010161fa0 msgr2=0x7f70101f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.225+0000 7f700f7fe640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7010161fa0 0x7f70101f7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.225+0000 7f700f7fe640 1 -- 172.21.15.50:0/2441493741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70101603c0 con 0x7f70100cf610 2024-09-11T22:23:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.225+0000 7f7014bab640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7010161fa0 0x7f70101f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.225+0000 7f700f7fe640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70100cf610 0x7f70100b7de0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f700400c410 tx=0x7f700400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.225+0000 7f700cff9640 1 -- 172.21.15.50:0/2441493741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7004017070 con 0x7f70100cf610 2024-09-11T22:23:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.225+0000 7f700cff9640 1 -- 172.21.15.50:0/2441493741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70040035f0 con 0x7f70100cf610 2024-09-11T22:23:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.225+0000 7f701660e640 1 -- 172.21.15.50:0/2441493741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70101606a0 con 0x7f70100cf610 2024-09-11T22:23:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.225+0000 7f700cff9640 1 -- 172.21.15.50:0/2441493741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70040039e0 con 0x7f70100cf610 2024-09-11T22:23:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.225+0000 7f701660e640 1 -- 172.21.15.50:0/2441493741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70100b3190 con 0x7f70100cf610 2024-09-11T22:23:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.226+0000 7f701660e640 1 -- 172.21.15.50:0/2441493741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70100b4d20 con 0x7f70100cf610 2024-09-11T22:23:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.227+0000 7f700cff9640 1 -- 172.21.15.50:0/2441493741 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f700401a070 con 0x7f70100cf610 2024-09-11T22:23:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.227+0000 7f700cff9640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6ffc06be30 0x7f6ffc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.227+0000 7f700cff9640 1 -- 172.21.15.50:0/2441493741 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 4943+0+0 (secure 0 0 0) 0x7f7004089f60 con 0x7f70100cf610 2024-09-11T22:23:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.227+0000 7f700ffff640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6ffc06be30 0x7f6ffc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.228+0000 7f700ffff640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6ffc06be30 0x7f6ffc06e2f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f700000a970 tx=0x7f7000008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:23.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.231+0000 7f700cff9640 1 -- 172.21.15.50:0/2441493741 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7004058c10 con 0x7f70100cf610 2024-09-11T22:23:23.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.476+0000 7f701660e640 1 -- 172.21.15.50:0/2441493741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f70100d20a0 con 0x7f70100cf610 2024-09-11T22:23:23.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.491+0000 7f700cff9640 1 -- 172.21.15.50:0/2441493741 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v581) ==== 136+0+0 (secure 0 0 0) 0x7f7004058510 con 0x7f70100cf610 2024-09-11T22:23:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.493+0000 7f701660e640 1 -- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6ffc06be30 msgr2=0x7f6ffc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.493+0000 7f701660e640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6ffc06be30 0x7f6ffc06e2f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f700000a970 tx=0x7f7000008040 comp rx=0 tx=0).stop 2024-09-11T22:23:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.493+0000 7f701660e640 1 -- 172.21.15.50:0/2441493741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70100cf610 msgr2=0x7f70100b7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.493+0000 7f701660e640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70100cf610 0x7f70100b7de0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f700400c410 tx=0x7f700400c8d0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.493+0000 7f701660e640 1 -- 172.21.15.50:0/2441493741 shutdown_connections 2024-09-11T22:23:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.493+0000 7f701660e640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6ffc06be30 0x7f6ffc06e2f0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.493+0000 7f701660e640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7010161fa0 0x7f70101f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.493+0000 7f701660e640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70100cf610 0x7f70100b7de0 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.493+0000 7f701660e640 1 --2- 172.21.15.50:0/2441493741 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70100b1600 0x7f7010161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.493+0000 7f701660e640 1 -- 172.21.15.50:0/2441493741 >> 172.21.15.50:0/2441493741 conn(0x7f701009ba50 msgr2=0x7f70100b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:23.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.493+0000 7f701660e640 1 -- 172.21.15.50:0/2441493741 shutdown_connections 2024-09-11T22:23:23.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.493+0000 7f701660e640 1 -- 172.21.15.50:0/2441493741 wait complete. 2024-09-11T22:23:23.505 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T22:23:23.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.610+0000 7f275aed9640 1 Processor -- start 2024-09-11T22:23:23.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.610+0000 7f275aed9640 1 -- start start 2024-09-11T22:23:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.610+0000 7f275aed9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27540d18a0 0x7f27540d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.610+0000 7f275aed9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27540cfa80 con 0x7f27540d3a30 2024-09-11T22:23:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.610+0000 7f275aed9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27540d40d0 con 0x7f275415e870 2024-09-11T22:23:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.610+0000 7f275aed9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f27540d3ea0 con 0x7f27540d18a0 2024-09-11T22:23:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.611+0000 7f2753fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27540d18a0 0x7f27540d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.611+0000 7f2759476640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f27540d3a30 0x7f27540b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55098/0 (socket says 172.21.15.50:55098) 2024-09-11T22:23:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.611+0000 7f2759476640 1 -- 172.21.15.50:0/3352942220 learned_addr learned my addr 172.21.15.50:0/3352942220 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.611+0000 7f2753fff640 1 -- 172.21.15.50:0/3352942220 >> v1:172.21.15.77:6789/0 conn(0x7f275415e870 legacy=0x7f27540d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.611+0000 7f2753fff640 1 -- 172.21.15.50:0/3352942220 >> v1:172.21.15.50:6789/0 conn(0x7f27540d3a30 legacy=0x7f27540b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.611+0000 7f27537fe640 1 -- 172.21.15.50:0/3352942220 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627289647 0 0) 0x7f274c001490 con 0x7f27540d3a30 2024-09-11T22:23:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.611+0000 7f2753fff640 1 -- 172.21.15.50:0/3352942220 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27540d43b0 con 0x7f27540d18a0 2024-09-11T22:23:23.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.612+0000 7f2753fff640 1 --2- 172.21.15.50:0/3352942220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27540d18a0 0x7f27540d34f0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f27400097a0 tx=0x7f274002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78257b95e94639c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.612+0000 7f27537fe640 1 -- 172.21.15.50:0/3352942220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740037070 con 0x7f27540d18a0 2024-09-11T22:23:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.612+0000 7f27537fe640 1 -- 172.21.15.50:0/3352942220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2740032440 con 0x7f27540d18a0 2024-09-11T22:23:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.612+0000 7f27537fe640 1 -- 172.21.15.50:0/3352942220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740032810 con 0x7f27540d18a0 2024-09-11T22:23:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.612+0000 7f275aed9640 1 -- 172.21.15.50:0/3352942220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27540d18a0 msgr2=0x7f27540d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.612+0000 7f275aed9640 1 --2- 172.21.15.50:0/3352942220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27540d18a0 0x7f27540d34f0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f27400097a0 tx=0x7f274002a1e0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.612+0000 7f275aed9640 1 -- 172.21.15.50:0/3352942220 shutdown_connections 2024-09-11T22:23:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.612+0000 7f275aed9640 1 --2- 172.21.15.50:0/3352942220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27540d18a0 0x7f27540d34f0 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.612+0000 7f275aed9640 1 -- 172.21.15.50:0/3352942220 >> 172.21.15.50:0/3352942220 conn(0x7f27540727a0 msgr2=0x7f27540679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.612+0000 7f275aed9640 1 -- 172.21.15.50:0/3352942220 shutdown_connections 2024-09-11T22:23:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.612+0000 7f275aed9640 1 -- 172.21.15.50:0/3352942220 wait complete. 2024-09-11T22:23:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.614+0000 7f275aed9640 1 Processor -- start 2024-09-11T22:23:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.614+0000 7f275aed9640 1 -- start start 2024-09-11T22:23:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.614+0000 7f275aed9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27540d18a0 0x7f27540cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.614+0000 7f275aed9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27540d3a30 0x7f27540ce720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.614+0000 7f275aed9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f275415e870 0x7f275414e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.614+0000 7f275aed9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f275415ec50 con 0x7f27540d18a0 2024-09-11T22:23:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.614+0000 7f275aed9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f27540b7ee0 con 0x7f27540d3a30 2024-09-11T22:23:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.614+0000 7f275aed9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f27540b78b0 con 0x7f275415e870 2024-09-11T22:23:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f2758c75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27540d18a0 0x7f27540cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f2758c75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27540d18a0 0x7f27540cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47818/0 (socket says 172.21.15.50:47818) 2024-09-11T22:23:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f2758c75640 1 -- 172.21.15.50:0/4062150245 learned_addr learned my addr 172.21.15.50:0/4062150245 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f2759476640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f275415e870 0x7f275414e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f2753fff640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27540d3a30 0x7f27540ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f2758c75640 1 -- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f275415e870 msgr2=0x7f275414e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f2758c75640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f275415e870 0x7f275414e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f2758c75640 1 -- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27540d3a30 msgr2=0x7f27540ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f2758c75640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27540d3a30 0x7f27540ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f2758c75640 1 -- 172.21.15.50:0/4062150245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275414f050 con 0x7f27540d18a0 2024-09-11T22:23:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f2758c75640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27540d18a0 0x7f27540cb850 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7f274800c430 tx=0x7f274800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f27517fa640 1 -- 172.21.15.50:0/4062150245 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748011790 con 0x7f27540d18a0 2024-09-11T22:23:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f27517fa640 1 -- 172.21.15.50:0/4062150245 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2748017070 con 0x7f27540d18a0 2024-09-11T22:23:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f275aed9640 1 -- 172.21.15.50:0/4062150245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275414f330 con 0x7f27540d18a0 2024-09-11T22:23:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f27517fa640 1 -- 172.21.15.50:0/4062150245 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748011b70 con 0x7f27540d18a0 2024-09-11T22:23:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.615+0000 7f275aed9640 1 -- 172.21.15.50:0/4062150245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275415d6c0 con 0x7f27540d18a0 2024-09-11T22:23:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.616+0000 7f275aed9640 1 -- 172.21.15.50:0/4062150245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27540cbd90 con 0x7f27540d18a0 2024-09-11T22:23:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.617+0000 7f27517fa640 1 -- 172.21.15.50:0/4062150245 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2748011d10 con 0x7f27540d18a0 2024-09-11T22:23:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.617+0000 7f27517fa640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f273806be30 0x7f273806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.617+0000 7f27517fa640 1 -- 172.21.15.50:0/4062150245 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 4943+0+0 (secure 0 0 0) 0x7f274808a940 con 0x7f27540d18a0 2024-09-11T22:23:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.617+0000 7f2753fff640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f273806be30 0x7f273806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.618+0000 7f2753fff640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f273806be30 0x7f273806e2f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f2740034000 tx=0x7f274002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.621+0000 7f27517fa640 1 -- 172.21.15.50:0/4062150245 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2748059680 con 0x7f27540d18a0 2024-09-11T22:23:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.799+0000 7f275aed9640 1 -- 172.21.15.50:0/4062150245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f275414f850 con 0x7f27540d18a0 2024-09-11T22:23:23.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.802+0000 7f27517fa640 1 -- 172.21.15.50:0/4062150245 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v48)=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f2748058f80 con 0x7f27540d18a0 2024-09-11T22:23:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.805+0000 7f275aed9640 1 -- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f273806be30 msgr2=0x7f273806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.805+0000 7f275aed9640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f273806be30 0x7f273806e2f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f2740034000 tx=0x7f274002e000 comp rx=0 tx=0).stop 2024-09-11T22:23:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.805+0000 7f275aed9640 1 -- 172.21.15.50:0/4062150245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27540d18a0 msgr2=0x7f27540cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.805+0000 7f275aed9640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27540d18a0 0x7f27540cb850 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7f274800c430 tx=0x7f274800c8f0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.805+0000 7f275aed9640 1 -- 172.21.15.50:0/4062150245 shutdown_connections 2024-09-11T22:23:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.805+0000 7f275aed9640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f273806be30 0x7f273806e2f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.805+0000 7f275aed9640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f275415e870 0x7f275414e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.805+0000 7f275aed9640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27540d3a30 0x7f27540ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.805+0000 7f275aed9640 1 --2- 172.21.15.50:0/4062150245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27540d18a0 0x7f27540cb850 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.805+0000 7f275aed9640 1 -- 172.21.15.50:0/4062150245 >> 172.21.15.50:0/4062150245 conn(0x7f27540727a0 msgr2=0x7f27540b6360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.805+0000 7f275aed9640 1 -- 172.21.15.50:0/4062150245 shutdown_connections 2024-09-11T22:23:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:23.805+0000 7f275aed9640 1 -- 172.21.15.50:0/4062150245 wait complete. 2024-09-11T22:23:23.817 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:23:23.817 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:23:23.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:23:23.911 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:23:23.911 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:23:23.911 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:23:23.927 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:23:23.927 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:23:23.927 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:23:23.946 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:23:23.946 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:23:23.946 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:23:23.983 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:23:23.983 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:23:23.983 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:23:24.004 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:23:24.005 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T22:23:24.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:23:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.125+0000 7f3a4e4c9640 1 Processor -- start 2024-09-11T22:23:24.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.125+0000 7f3a4e4c9640 1 -- start start 2024-09-11T22:23:24.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.126+0000 7f3a4e4c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3a480d18a0 0x7f3a480d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:24.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.126+0000 7f3a4e4c9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a480d3a30 0x7f3a480b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:24.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.126+0000 7f3a4e4c9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a480cfa80 con 0x7f3a4815e870 2024-09-11T22:23:24.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.126+0000 7f3a4e4c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3a480d3ea0 con 0x7f3a480d18a0 2024-09-11T22:23:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.126+0000 7f3a4e4c9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3a480d40d0 con 0x7f3a480d3a30 2024-09-11T22:23:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.127+0000 7f3a477fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3a480d18a0 0x7f3a480d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.127+0000 7f3a4ca66640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a480d3a30 0x7f3a480b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.127+0000 7f3a477fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3a480d18a0 0x7f3a480d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:54692/0 (socket says 172.21.15.50:54692) 2024-09-11T22:23:24.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.127+0000 7f3a477fe640 1 -- 172.21.15.50:0/202792512 learned_addr learned my addr 172.21.15.50:0/202792512 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:24.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.127+0000 7f3a477fe640 1 -- 172.21.15.50:0/202792512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a480d3a30 msgr2=0x7f3a480b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.127+0000 7f3a477fe640 1 --2- 172.21.15.50:0/202792512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a480d3a30 0x7f3a480b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.127+0000 7f3a477fe640 1 -- 172.21.15.50:0/202792512 >> v1:172.21.15.77:6789/0 conn(0x7f3a4815e870 legacy=0x7f3a480d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.127+0000 7f3a46ffd640 1 -- 172.21.15.50:0/202792512 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2530265292 0 0) 0x7f3a38001110 con 0x7f3a4815e870 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.127+0000 7f3a477fe640 1 -- 172.21.15.50:0/202792512 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a480d43b0 con 0x7f3a480d18a0 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.128+0000 7f3a477fe640 1 --2- 172.21.15.50:0/202792512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a480d18a0 0x7f3a480d34f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009870 tx=0x7f3a3c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf056e0e1ee65ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.128+0000 7f3a46ffd640 1 -- 172.21.15.50:0/202792512 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c037070 con 0x7f3a480d18a0 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.128+0000 7f3a46ffd640 1 -- 172.21.15.50:0/202792512 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a3c032440 con 0x7f3a480d18a0 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.128+0000 7f3a46ffd640 1 -- 172.21.15.50:0/202792512 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c032810 con 0x7f3a480d18a0 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.129+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/202792512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a480d18a0 msgr2=0x7f3a480d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.129+0000 7f3a4e4c9640 1 --2- 172.21.15.50:0/202792512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a480d18a0 0x7f3a480d34f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009870 tx=0x7f3a3c02a270 comp rx=0 tx=0).stop 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.129+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/202792512 shutdown_connections 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.129+0000 7f3a4e4c9640 1 --2- 172.21.15.50:0/202792512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a480d3a30 0x7f3a480b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.129+0000 7f3a4e4c9640 1 --2- 172.21.15.50:0/202792512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a480d18a0 0x7f3a480d34f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.129+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/202792512 >> 172.21.15.50:0/202792512 conn(0x7f3a480727a0 msgr2=0x7f3a480679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.129+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/202792512 shutdown_connections 2024-09-11T22:23:24.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.129+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/202792512 wait complete. 2024-09-11T22:23:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.130+0000 7f3a4e4c9640 1 Processor -- start 2024-09-11T22:23:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.130+0000 7f3a4e4c9640 1 -- start start 2024-09-11T22:23:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a4e4c9640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a480d18a0 0x7f3a480cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a4e4c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a480d3a30 0x7f3a4815b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a4e4c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a4815e870 0x7f3a480cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a4e4c9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4815ec50 con 0x7f3a480d3a30 2024-09-11T22:23:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a4e4c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3a480b7ee0 con 0x7f3a4815e870 2024-09-11T22:23:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a4e4c9640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3a480b78b0 con 0x7f3a480d18a0 2024-09-11T22:23:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a477fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a480d3a30 0x7f3a4815b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:24.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a477fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a480d3a30 0x7f3a4815b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47822/0 (socket says 172.21.15.50:47822) 2024-09-11T22:23:24.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a477fe640 1 -- 172.21.15.50:0/1696567138 learned_addr learned my addr 172.21.15.50:0/1696567138 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a47fff640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a480d18a0 0x7f3a480cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a4ca66640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a4815e870 0x7f3a480cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a477fe640 1 -- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a480d18a0 msgr2=0x7f3a480cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a477fe640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a480d18a0 0x7f3a480cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a477fe640 1 -- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a4815e870 msgr2=0x7f3a480cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a477fe640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a4815e870 0x7f3a480cd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a477fe640 1 -- 172.21.15.50:0/1696567138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a480cb2e0 con 0x7f3a480d3a30 2024-09-11T22:23:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a47fff640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a480d18a0 0x7f3a480cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.131+0000 7f3a4ca66640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a4815e870 0x7f3a480cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:24.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.132+0000 7f3a477fe640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a480d3a30 0x7f3a4815b1d0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c035040 tx=0x7f3a3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.132+0000 7f3a44ff9640 1 -- 172.21.15.50:0/1696567138 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c037040 con 0x7f3a480d3a30 2024-09-11T22:23:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.132+0000 7f3a44ff9640 1 -- 172.21.15.50:0/1696567138 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a3c004030 con 0x7f3a480d3a30 2024-09-11T22:23:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.132+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/1696567138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a4815b710 con 0x7f3a480d3a30 2024-09-11T22:23:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.132+0000 7f3a44ff9640 1 -- 172.21.15.50:0/1696567138 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c004420 con 0x7f3a480d3a30 2024-09-11T22:23:24.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.132+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/1696567138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a480cc540 con 0x7f3a480d3a30 2024-09-11T22:23:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.133+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/1696567138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a480d34f0 con 0x7f3a480d3a30 2024-09-11T22:23:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.133+0000 7f3a44ff9640 1 -- 172.21.15.50:0/1696567138 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a3c03a070 con 0x7f3a480d3a30 2024-09-11T22:23:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.134+0000 7f3a44ff9640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3a3406be30 0x7f3a3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.134+0000 7f3a44ff9640 1 -- 172.21.15.50:0/1696567138 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 4943+0+0 (secure 0 0 0) 0x7f3a3c0ab050 con 0x7f3a480d3a30 2024-09-11T22:23:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.134+0000 7f3a47fff640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3a3406be30 0x7f3a3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:24.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.134+0000 7f3a47fff640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3a3406be30 0x7f3a3406e2f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3a38000f60 tx=0x7f3a38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:24.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.138+0000 7f3a44ff9640 1 -- 172.21.15.50:0/1696567138 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a3c041020 con 0x7f3a480d3a30 2024-09-11T22:23:24.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.358+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/1696567138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a480d0c40 con 0x7f3a480d3a30 2024-09-11T22:23:24.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.359+0000 7f3a44ff9640 1 -- 172.21.15.50:0/1696567138 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 132 v132) ==== 95+0+3918 (secure 0 0 0) 0x7f3a3c079d90 con 0x7f3a480d3a30 2024-09-11T22:23:24.360 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:24.360 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":132,"btime":"2024-09-11T22:23:19:476944+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2188519592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2188519592},{"type":"v1","addr":"172.21.15.77:6836","nonce":2188519592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8165,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3754154405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3754154405},{"type":"v1","addr":"172.21.15.77:6837","nonce":3754154405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":127},{"gid":10317,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1024203584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1024203584},{"type":"v1","addr":"172.21.15.50:6833","nonce":1024203584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":10656,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2273539961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2273539961},{"type":"v1","addr":"172.21.15.50:6835","nonce":2273539961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[]} 2024-09-11T22:23:24.360 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 132 2024-09-11T22:23:24.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.361+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3a3406be30 msgr2=0x7f3a3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:24.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.361+0000 7f3a4e4c9640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3a3406be30 0x7f3a3406e2f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3a38000f60 tx=0x7f3a38009040 comp rx=0 tx=0).stop 2024-09-11T22:23:24.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.361+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/1696567138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a480d3a30 msgr2=0x7f3a4815b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:24.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.361+0000 7f3a4e4c9640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a480d3a30 0x7f3a4815b1d0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c035040 tx=0x7f3a3c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.361+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/1696567138 shutdown_connections 2024-09-11T22:23:24.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.361+0000 7f3a4e4c9640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3a3406be30 0x7f3a3406e2f0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.361+0000 7f3a4e4c9640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a4815e870 0x7f3a480cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.361+0000 7f3a4e4c9640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a480d3a30 0x7f3a4815b1d0 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.361+0000 7f3a4e4c9640 1 --2- 172.21.15.50:0/1696567138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a480d18a0 0x7f3a480cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.361+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/1696567138 >> 172.21.15.50:0/1696567138 conn(0x7f3a480727a0 msgr2=0x7f3a480b97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:24.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.361+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/1696567138 shutdown_connections 2024-09-11T22:23:24.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.361+0000 7f3a4e4c9640 1 -- 172.21.15.50:0/1696567138 wait complete. 2024-09-11T22:23:24.373 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:23:24.374 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T22:23:24.374 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:23:24.374 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:23:24.374 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:23:24.374 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T22:23:24.374 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:23:24.375 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:23:24.375 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:23:24.375 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T22:23:24.375 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:23:24.375 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:23:24.375 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:23:24.375 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T22:23:24.376 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:23:24.376 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:23:24.384 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:23:24.384 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:23:24.385 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:23:24.385 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:23:24.389 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:23:24.389 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:23:24.390 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:23:24.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:23:24.427 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:23:24.427 DEBUG:teuthology.parallel:result is None 2024-09-11T22:23:24.427 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:23:24.428 DEBUG:teuthology.parallel:result is None 2024-09-11T22:23:24.431 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:23:24.432 DEBUG:teuthology.parallel:result is None 2024-09-11T22:23:24.432 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:23:24.432 DEBUG:teuthology.parallel:result is None 2024-09-11T22:23:24.433 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T22:23:24.505 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2024-09-11T22:23:24.506 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:23:24.513 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-11T22:23:24.513 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-11T22:23:24.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.539+0000 7f985e7fd640 1 Processor -- start 2024-09-11T22:23:24.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.539+0000 7f985e7fd640 1 -- start start 2024-09-11T22:23:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.540+0000 7f985e7fd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98580b0f60 0x7f98580b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.540+0000 7f985e7fd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98580b1340 0x7f9858162600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.540+0000 7f985e7fd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9858163410 con 0x7f9858162b40 2024-09-11T22:23:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.540+0000 7f985e7fd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f98580b17a0 con 0x7f98580b1340 2024-09-11T22:23:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.540+0000 7f985e7fd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f985806d550 con 0x7f98580b0f60 2024-09-11T22:23:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.540+0000 7f985cd9a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9858162b40 0x7f98580d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55116/0 (socket says 172.21.15.50:55116) 2024-09-11T22:23:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.540+0000 7f985cd9a640 1 -- 172.21.15.50:0/2816643094 learned_addr learned my addr 172.21.15.50:0/2816643094 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.541+0000 7f9857fff640 1 --2- 172.21.15.50:0/2816643094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98580b0f60 0x7f98580b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.541+0000 7f98577fe640 1 --2- 172.21.15.50:0/2816643094 >> v2:172.21.15.50:3300/0 conn(0x7f98580b1340 0x7f9858162600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.541+0000 7f9856ffd640 1 -- 172.21.15.50:0/2816643094 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484264027 0 0) 0x7f9858163410 con 0x7f9858162b40 2024-09-11T22:23:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.541+0000 7f9856ffd640 1 -- 172.21.15.50:0/2816643094 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9840003520 con 0x7f9858162b40 2024-09-11T22:23:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.541+0000 7f9857fff640 1 -- 172.21.15.50:0/2816643094 >> v2:172.21.15.50:3300/0 conn(0x7f98580b1340 msgr2=0x7f9858162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.541+0000 7f9857fff640 1 --2- 172.21.15.50:0/2816643094 >> v2:172.21.15.50:3300/0 conn(0x7f98580b1340 0x7f9858162600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.541+0000 7f9857fff640 1 -- 172.21.15.50:0/2816643094 >> v1:172.21.15.50:6789/0 conn(0x7f9858162b40 legacy=0x7f98580d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.541+0000 7f9857fff640 1 -- 172.21.15.50:0/2816643094 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985806cc20 con 0x7f98580b0f60 2024-09-11T22:23:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.541+0000 7f98577fe640 1 --2- 172.21.15.50:0/2816643094 >> v2:172.21.15.50:3300/0 conn(0x7f98580b1340 0x7f9858162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.542+0000 7f9857fff640 1 --2- 172.21.15.50:0/2816643094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98580b0f60 0x7f98580b4bd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98480097a0 tx=0x7f984802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e179386034ef9b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.542+0000 7f9856ffd640 1 -- 172.21.15.50:0/2816643094 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848037070 con 0x7f98580b0f60 2024-09-11T22:23:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.542+0000 7f9856ffd640 1 -- 172.21.15.50:0/2816643094 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9848032440 con 0x7f98580b0f60 2024-09-11T22:23:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.542+0000 7f9856ffd640 1 -- 172.21.15.50:0/2816643094 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98480327f0 con 0x7f98580b0f60 2024-09-11T22:23:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.543+0000 7f985e7fd640 1 -- 172.21.15.50:0/2816643094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98580b0f60 msgr2=0x7f98580b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.543+0000 7f985e7fd640 1 --2- 172.21.15.50:0/2816643094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98580b0f60 0x7f98580b4bd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98480097a0 tx=0x7f984802a180 comp rx=0 tx=0).stop 2024-09-11T22:23:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.543+0000 7f985e7fd640 1 -- 172.21.15.50:0/2816643094 shutdown_connections 2024-09-11T22:23:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.543+0000 7f985e7fd640 1 --2- 172.21.15.50:0/2816643094 >> v2:172.21.15.50:3300/0 conn(0x7f98580b1340 0x7f9858162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.543+0000 7f985e7fd640 1 --2- 172.21.15.50:0/2816643094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98580b0f60 0x7f98580b4bd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.543+0000 7f985e7fd640 1 -- 172.21.15.50:0/2816643094 >> 172.21.15.50:0/2816643094 conn(0x7f98580b40b0 msgr2=0x7f98580b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.543+0000 7f985e7fd640 1 -- 172.21.15.50:0/2816643094 shutdown_connections 2024-09-11T22:23:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.543+0000 7f985e7fd640 1 -- 172.21.15.50:0/2816643094 wait complete. 2024-09-11T22:23:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.544+0000 7f985e7fd640 1 Processor -- start 2024-09-11T22:23:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.544+0000 7f985e7fd640 1 -- start start 2024-09-11T22:23:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f985e7fd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98580b0f60 0x7f985815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f985e7fd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98580b1340 0x7f98580c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f985e7fd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9858162b40 0x7f98580c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f985e7fd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f985806d9e0 con 0x7f98580b0f60 2024-09-11T22:23:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f985e7fd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f985806d1e0 con 0x7f98580b1340 2024-09-11T22:23:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f985e7fd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f985806db60 con 0x7f9858162b40 2024-09-11T22:23:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f9857fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98580b0f60 0x7f985815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f9857fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98580b0f60 0x7f985815ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47866/0 (socket says 172.21.15.50:47866) 2024-09-11T22:23:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f9857fff640 1 -- 172.21.15.50:0/83912101 learned_addr learned my addr 172.21.15.50:0/83912101 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f985cd9a640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9858162b40 0x7f98580c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f9857fff640 1 -- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9858162b40 msgr2=0x7f98580c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f9857fff640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9858162b40 0x7f98580c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f9857fff640 1 -- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98580b1340 msgr2=0x7f98580c82c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:23:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f98577fe640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98580b1340 0x7f98580c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f9857fff640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98580b1340 0x7f98580c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f9857fff640 1 -- 172.21.15.50:0/83912101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98580c8b30 con 0x7f98580b0f60 2024-09-11T22:23:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f985cd9a640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9858162b40 0x7f98580c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.545+0000 7f9857fff640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98580b0f60 0x7f985815ab30 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f984802a1c0 tx=0x7f98480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.546+0000 7f9854ff9640 1 -- 172.21.15.50:0/83912101 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848037040 con 0x7f98580b0f60 2024-09-11T22:23:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.546+0000 7f9854ff9640 1 -- 172.21.15.50:0/83912101 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9848042070 con 0x7f98580b0f60 2024-09-11T22:23:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.546+0000 7f9854ff9640 1 -- 172.21.15.50:0/83912101 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984803b930 con 0x7f98580b0f60 2024-09-11T22:23:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.546+0000 7f985e7fd640 1 -- 172.21.15.50:0/83912101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98580c8e10 con 0x7f98580b0f60 2024-09-11T22:23:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.546+0000 7f985e7fd640 1 -- 172.21.15.50:0/83912101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98580b6120 con 0x7f98580b0f60 2024-09-11T22:23:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.547+0000 7f985e7fd640 1 -- 172.21.15.50:0/83912101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98580ceff0 con 0x7f98580b0f60 2024-09-11T22:23:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.547+0000 7f9854ff9640 1 -- 172.21.15.50:0/83912101 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f984803bad0 con 0x7f98580b0f60 2024-09-11T22:23:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.548+0000 7f9854ff9640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f984406be30 0x7f984406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.548+0000 7f9854ff9640 1 -- 172.21.15.50:0/83912101 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 4943+0+0 (secure 0 0 0) 0x7f98480ab4a0 con 0x7f98580b0f60 2024-09-11T22:23:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.548+0000 7f98577fe640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f984406be30 0x7f984406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.549+0000 7f98577fe640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f984406be30 0x7f984406e2f0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f98580cf430 tx=0x7f984c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.552+0000 7f9854ff9640 1 -- 172.21.15.50:0/83912101 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98580ceff0 con 0x7f98580b0f60 2024-09-11T22:23:24.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:24.741+0000 7f985e7fd640 1 -- 172.21.15.50:0/83912101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9858162ff0 con 0x7f98580b0f60 2024-09-11T22:23:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.506+0000 7f9854ff9640 1 -- 172.21.15.50:0/83912101 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v183) ==== 97+0+0 (secure 0 0 0) 0x7f984807a0c0 con 0x7f98580b0f60 2024-09-11T22:23:25.506 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2024-09-11T22:23:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.509+0000 7f985e7fd640 1 -- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f984406be30 msgr2=0x7f984406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.509+0000 7f985e7fd640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f984406be30 0x7f984406e2f0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f98580cf430 tx=0x7f984c008040 comp rx=0 tx=0).stop 2024-09-11T22:23:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.509+0000 7f985e7fd640 1 -- 172.21.15.50:0/83912101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98580b0f60 msgr2=0x7f985815ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.509+0000 7f985e7fd640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98580b0f60 0x7f985815ab30 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f984802a1c0 tx=0x7f98480046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.509+0000 7f985e7fd640 1 -- 172.21.15.50:0/83912101 shutdown_connections 2024-09-11T22:23:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.509+0000 7f985e7fd640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f984406be30 0x7f984406e2f0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.509+0000 7f985e7fd640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9858162b40 0x7f98580c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.509+0000 7f985e7fd640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98580b1340 0x7f98580c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.509+0000 7f985e7fd640 1 --2- 172.21.15.50:0/83912101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98580b0f60 0x7f985815ab30 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.509+0000 7f985e7fd640 1 -- 172.21.15.50:0/83912101 >> 172.21.15.50:0/83912101 conn(0x7f98580b40b0 msgr2=0x7f98580af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.510+0000 7f985e7fd640 1 -- 172.21.15.50:0/83912101 shutdown_connections 2024-09-11T22:23:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.510+0000 7f985e7fd640 1 -- 172.21.15.50:0/83912101 wait complete. 2024-09-11T22:23:25.525 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T22:23:25.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.633+0000 7f2f86f23640 1 Processor -- start 2024-09-11T22:23:25.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.633+0000 7f2f86f23640 1 -- start start 2024-09-11T22:23:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.634+0000 7f2f86f23640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f8015e8e0 0x7f2f800b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.634+0000 7f2f86f23640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f80162350 0x7f2f80162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.634+0000 7f2f86f23640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f80163080 con 0x7f2f800d1580 2024-09-11T22:23:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.634+0000 7f2f86f23640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2f8015ecc0 con 0x7f2f80162350 2024-09-11T22:23:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.634+0000 7f2f86f23640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2f800d2ad0 con 0x7f2f8015e8e0 2024-09-11T22:23:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.634+0000 7f2f854c0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f80162350 0x7f2f80162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.634+0000 7f2f854c0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f80162350 0x7f2f80162800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47872/0 (socket says 172.21.15.50:47872) 2024-09-11T22:23:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.634+0000 7f2f854c0640 1 -- 172.21.15.50:0/3864192409 learned_addr learned my addr 172.21.15.50:0/3864192409 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.634+0000 7f2f84cbf640 1 --2- 172.21.15.50:0/3864192409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f8015e8e0 0x7f2f800b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.634+0000 7f2f854c0640 1 -- 172.21.15.50:0/3864192409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f8015e8e0 msgr2=0x7f2f800b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.634+0000 7f2f854c0640 1 --2- 172.21.15.50:0/3864192409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f8015e8e0 0x7f2f800b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.634+0000 7f2f854c0640 1 -- 172.21.15.50:0/3864192409 >> v1:172.21.15.77:6789/0 conn(0x7f2f800d1580 legacy=0x7f2f800d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:25.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.634+0000 7f2f854c0640 1 -- 172.21.15.50:0/3864192409 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f800d2d20 con 0x7f2f80162350 2024-09-11T22:23:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.635+0000 7f2f854c0640 1 --2- 172.21.15.50:0/3864192409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f80162350 0x7f2f80162800 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009e50 tx=0x7f2f7802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4a162f0cc63d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.635+0000 7f2f7f7fe640 1 -- 172.21.15.50:0/3864192409 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78036070 con 0x7f2f80162350 2024-09-11T22:23:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.635+0000 7f2f7f7fe640 1 -- 172.21.15.50:0/3864192409 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f78031600 con 0x7f2f80162350 2024-09-11T22:23:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.635+0000 7f2f7f7fe640 1 -- 172.21.15.50:0/3864192409 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f780319d0 con 0x7f2f80162350 2024-09-11T22:23:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.636+0000 7f2f86f23640 1 -- 172.21.15.50:0/3864192409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f80162350 msgr2=0x7f2f80162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.636+0000 7f2f86f23640 1 --2- 172.21.15.50:0/3864192409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f80162350 0x7f2f80162800 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009e50 tx=0x7f2f7802a7a0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.636+0000 7f2f86f23640 1 -- 172.21.15.50:0/3864192409 shutdown_connections 2024-09-11T22:23:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.636+0000 7f2f86f23640 1 --2- 172.21.15.50:0/3864192409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f80162350 0x7f2f80162800 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.636+0000 7f2f86f23640 1 --2- 172.21.15.50:0/3864192409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f8015e8e0 0x7f2f800b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.636+0000 7f2f86f23640 1 -- 172.21.15.50:0/3864192409 >> 172.21.15.50:0/3864192409 conn(0x7f2f80067ba0 msgr2=0x7f2f80067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.636+0000 7f2f86f23640 1 -- 172.21.15.50:0/3864192409 shutdown_connections 2024-09-11T22:23:25.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.636+0000 7f2f86f23640 1 -- 172.21.15.50:0/3864192409 wait complete. 2024-09-11T22:23:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.637+0000 7f2f86f23640 1 Processor -- start 2024-09-11T22:23:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.637+0000 7f2f86f23640 1 -- start start 2024-09-11T22:23:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.638+0000 7f2f86f23640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f800d1580 0x7f2f80155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.638+0000 7f2f86f23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f8015e8e0 0x7f2f800b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.638+0000 7f2f86f23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f80162350 0x7f2f800b6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.638+0000 7f2f86f23640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2f80162d40 con 0x7f2f8015e8e0 2024-09-11T22:23:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.638+0000 7f2f86f23640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2f800d3370 con 0x7f2f80162350 2024-09-11T22:23:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.638+0000 7f2f86f23640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2f800d3800 con 0x7f2f800d1580 2024-09-11T22:23:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.638+0000 7f2f7ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f8015e8e0 0x7f2f800b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.638+0000 7f2f7ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f8015e8e0 0x7f2f800b6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47876/0 (socket says 172.21.15.50:47876) 2024-09-11T22:23:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.638+0000 7f2f7ffff640 1 -- 172.21.15.50:0/2249981569 learned_addr learned my addr 172.21.15.50:0/2249981569 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.638+0000 7f2f84cbf640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f800d1580 0x7f2f80155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.638+0000 7f2f854c0640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f80162350 0x7f2f800b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.639+0000 7f2f7ffff640 1 -- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f800d1580 msgr2=0x7f2f80155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.639+0000 7f2f7ffff640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f800d1580 0x7f2f80155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.639+0000 7f2f7ffff640 1 -- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f80162350 msgr2=0x7f2f800b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.639+0000 7f2f7ffff640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f80162350 0x7f2f800b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.639+0000 7f2f7ffff640 1 -- 172.21.15.50:0/2249981569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f801e9310 con 0x7f2f8015e8e0 2024-09-11T22:23:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.639+0000 7f2f84cbf640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f800d1580 0x7f2f80155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.639+0000 7f2f854c0640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f80162350 0x7f2f800b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.639+0000 7f2f7ffff640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f8015e8e0 0x7f2f800b6340 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00c440 tx=0x7f2f6c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.639+0000 7f2f7d7fa640 1 -- 172.21.15.50:0/2249981569 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c0052d0 con 0x7f2f8015e8e0 2024-09-11T22:23:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.639+0000 7f2f7d7fa640 1 -- 172.21.15.50:0/2249981569 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6c005470 con 0x7f2f8015e8e0 2024-09-11T22:23:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.639+0000 7f2f86f23640 1 -- 172.21.15.50:0/2249981569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f801e95f0 con 0x7f2f8015e8e0 2024-09-11T22:23:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.639+0000 7f2f7d7fa640 1 -- 172.21.15.50:0/2249981569 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c007260 con 0x7f2f8015e8e0 2024-09-11T22:23:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.639+0000 7f2f86f23640 1 -- 172.21.15.50:0/2249981569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f801e9bb0 con 0x7f2f8015e8e0 2024-09-11T22:23:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.640+0000 7f2f86f23640 1 -- 172.21.15.50:0/2249981569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f800b7880 con 0x7f2f8015e8e0 2024-09-11T22:23:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.640+0000 7f2f7d7fa640 1 -- 172.21.15.50:0/2249981569 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f6c007400 con 0x7f2f8015e8e0 2024-09-11T22:23:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.641+0000 7f2f7d7fa640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2f6406be30 0x7f2f6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.641+0000 7f2f7d7fa640 1 -- 172.21.15.50:0/2249981569 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 4857+0+0 (secure 0 0 0) 0x7f2f6c089fa0 con 0x7f2f8015e8e0 2024-09-11T22:23:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.641+0000 7f2f84cbf640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2f6406be30 0x7f2f6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:25.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.642+0000 7f2f84cbf640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2f6406be30 0x7f2f6406e2f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009b90 tx=0x7f2f74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:25.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.645+0000 7f2f7d7fa640 1 -- 172.21.15.50:0/2249981569 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f6c058d30 con 0x7f2f8015e8e0 2024-09-11T22:23:25.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.885+0000 7f2f86f23640 1 -- 172.21.15.50:0/2249981569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f2f800ba770 con 0x7f2f8015e8e0 2024-09-11T22:23:25.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.885+0000 7f2f7d7fa640 1 -- 172.21.15.50:0/2249981569 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) ==== 80+0+5304 (secure 0 0 0) 0x7f2f6c058630 con 0x7f2f8015e8e0 2024-09-11T22:23:25.887 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:25.887 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:23:25.887 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2024-09-11T22:23:25.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.887 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2024-09-11T22:23:25.888 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmi3SLGRAA9QLhh+HRiNwF+w7o5Yat8w==", 2024-09-11T22:23:25.888 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.888 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:23:25.888 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:23:25.888 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:23:25.888 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.888 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.888 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2024-09-11T22:23:25.888 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmPVttJRAA31PX1GhNbp+xAaM1VMOokg==", 2024-09-11T22:23:25.888 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.889 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:23:25.889 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:23:25.889 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:23:25.889 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.889 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.889 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2024-09-11T22:23:25.889 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmBbW8IBAAjbvZG9bt6KDXmRG3cf/BHQ==", 2024-09-11T22:23:25.889 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.890 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:23:25.890 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:23:25.890 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:23:25.890 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.890 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.890 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2024-09-11T22:23:25.890 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmogBuLBAApZlBC4YqX2Hf7TniHmNLCw==", 2024-09-11T22:23:25.890 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.890 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:23:25.890 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:23:25.890 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:23:25.891 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.891 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.891 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2024-09-11T22:23:25.891 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBIFeJm79QJFRAAMzRgD6+sY3+u0HvXB2c4rg==", 2024-09-11T22:23:25.891 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.891 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:23:25.891 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:23:25.891 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.891 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.892 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2024-09-11T22:23:25.892 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBLFeJm7NDZFhAAfsfoVMonJO5cGwoqU9L0jQ==", 2024-09-11T22:23:25.892 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.892 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:23:25.892 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:23:25.892 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.892 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.892 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2024-09-11T22:23:25.892 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBOFeJm+PhvOBAAjNK20HZWJMoaX1g1uuzALg==", 2024-09-11T22:23:25.892 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.892 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:23:25.893 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:23:25.893 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.893 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.893 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2024-09-11T22:23:25.893 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBSFeJmq/flDhAAd+3bKQVQ6ljxwGUPx4Mjdg==", 2024-09-11T22:23:25.893 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.893 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:23:25.893 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:23:25.893 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.893 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBYFeJmI1KqGxAAD4kraPUE+cC3HGfnMLD01A==", 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBcFeJmS27FHRAAli7Wff8/p2oSmnVEkk96pw==", 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.894 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:23:25.895 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:23:25.895 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.895 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.895 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2024-09-11T22:23:25.895 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBgFeJmIAm8DxAAq89vpxeHdPs7+Y12LKN48A==", 2024-09-11T22:23:25.895 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.895 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:23:25.895 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:23:25.895 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.895 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.896 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2024-09-11T22:23:25.896 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBkFeJmKT2MERAAIkfia7XgM3HHefdqC7jLyw==", 2024-09-11T22:23:25.896 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.896 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2024-09-11T22:23:25.896 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2024-09-11T22:23:25.896 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.896 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.896 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2024-09-11T22:23:25.896 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew==", 2024-09-11T22:23:25.896 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.897 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:23:25.897 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2024-09-11T22:23:25.897 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T22:23:25.897 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.897 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2024-09-11T22:23:25.897 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmg6p+ORAAKYi+9mw0fYyWkIpambHAqw==", 2024-09-11T22:23:25.897 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.897 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:23:25.897 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:23:25.897 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:23:25.897 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmSrhCNhAASjfWr+aPVUgkWrSliiIthg==", 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.898 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2024-09-11T22:23:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBHFeJmhE91AxAAkIV56YzG7wbDHs2Mn3vjNw==", 2024-09-11T22:23:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2024-09-11T22:23:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2024-09-11T22:23:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2024-09-11T22:23:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2024-09-11T22:23:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2024-09-11T22:23:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBFFeJmAq9+OBAAANc9KfDvm3+wt/uED7WCvA==", 2024-09-11T22:23:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.899 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:23:25.900 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2024-09-11T22:23:25.900 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2024-09-11T22:23:25.900 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.900 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.900 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2024-09-11T22:23:25.900 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmqZU/FhAAjQCCwUfHSeiyDYNxXx9V5g==", 2024-09-11T22:23:25.900 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.900 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:23:25.900 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:23:25.900 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.900 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-11T22:23:25.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:25.901 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2024-09-11T22:23:25.901 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQBGFeJmDnPGERAAZNwko3fp06duFwEGoKK1Cg==", 2024-09-11T22:23:25.901 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2024-09-11T22:23:25.901 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2024-09-11T22:23:25.901 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2024-09-11T22:23:25.901 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2024-09-11T22:23:25.901 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.901 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:25.901 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-11T22:23:25.901 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:23:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.887+0000 7f2f86f23640 1 -- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2f6406be30 msgr2=0x7f2f6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.887+0000 7f2f86f23640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2f6406be30 0x7f2f6406e2f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009b90 tx=0x7f2f74008040 comp rx=0 tx=0).stop 2024-09-11T22:23:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.887+0000 7f2f86f23640 1 -- 172.21.15.50:0/2249981569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f8015e8e0 msgr2=0x7f2f800b6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.887+0000 7f2f86f23640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f8015e8e0 0x7f2f800b6340 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00c440 tx=0x7f2f6c001e70 comp rx=0 tx=0).stop 2024-09-11T22:23:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.888+0000 7f2f86f23640 1 -- 172.21.15.50:0/2249981569 shutdown_connections 2024-09-11T22:23:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.888+0000 7f2f86f23640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2f6406be30 0x7f2f6406e2f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.888+0000 7f2f86f23640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f80162350 0x7f2f800b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.888+0000 7f2f86f23640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f8015e8e0 0x7f2f800b6340 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.888+0000 7f2f86f23640 1 --2- 172.21.15.50:0/2249981569 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f800d1580 0x7f2f80155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.888+0000 7f2f86f23640 1 -- 172.21.15.50:0/2249981569 >> 172.21.15.50:0/2249981569 conn(0x7f2f80067ba0 msgr2=0x7f2f800b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:25.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.888+0000 7f2f86f23640 1 -- 172.21.15.50:0/2249981569 shutdown_connections 2024-09-11T22:23:25.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:25.888+0000 7f2f86f23640 1 -- 172.21.15.50:0/2249981569 wait complete. 2024-09-11T22:23:25.904 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:23:26.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.004+0000 7f2953617640 1 Processor -- start 2024-09-11T22:23:26.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.004+0000 7f2953617640 1 -- start start 2024-09-11T22:23:26.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.005+0000 7f2953617640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f294c15b400 0x7f294c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:26.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.005+0000 7f2953617640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f294c06e0f0 0x7f294c0711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:26.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.005+0000 7f2953617640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294c15b7e0 con 0x7f294c072e60 2024-09-11T22:23:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.005+0000 7f2953617640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f294c15f140 con 0x7f294c15b400 2024-09-11T22:23:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.005+0000 7f2953617640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f294c15f420 con 0x7f294c06e0f0 2024-09-11T22:23:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.005+0000 7f29513b3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f294c15b400 0x7f294c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.005+0000 7f29513b3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f294c15b400 0x7f294c06d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47880/0 (socket says 172.21.15.50:47880) 2024-09-11T22:23:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.005+0000 7f29513b3640 1 -- 172.21.15.50:0/3231860147 learned_addr learned my addr 172.21.15.50:0/3231860147 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.006+0000 7f2951bb4640 1 --2- 172.21.15.50:0/3231860147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f294c06e0f0 0x7f294c0711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.006+0000 7f29513b3640 1 -- 172.21.15.50:0/3231860147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f294c06e0f0 msgr2=0x7f294c0711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.006+0000 7f29513b3640 1 --2- 172.21.15.50:0/3231860147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f294c06e0f0 0x7f294c0711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.006+0000 7f29513b3640 1 -- 172.21.15.50:0/3231860147 >> v1:172.21.15.77:6789/0 conn(0x7f294c072e60 legacy=0x7f294c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.006+0000 7f29513b3640 1 -- 172.21.15.50:0/3231860147 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294c15f700 con 0x7f294c15b400 2024-09-11T22:23:26.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.006+0000 7f29513b3640 1 --2- 172.21.15.50:0/3231860147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294c15b400 0x7f294c06d070 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f2944009870 tx=0x7f294402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb39eab4a1dbf918 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:26.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.006+0000 7f294bfff640 1 -- 172.21.15.50:0/3231860147 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944037070 con 0x7f294c15b400 2024-09-11T22:23:26.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.007+0000 7f294bfff640 1 -- 172.21.15.50:0/3231860147 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2944032440 con 0x7f294c15b400 2024-09-11T22:23:26.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.007+0000 7f294bfff640 1 -- 172.21.15.50:0/3231860147 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944032810 con 0x7f294c15b400 2024-09-11T22:23:26.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.007+0000 7f2953617640 1 -- 172.21.15.50:0/3231860147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294c15b400 msgr2=0x7f294c06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:26.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.007+0000 7f2953617640 1 --2- 172.21.15.50:0/3231860147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294c15b400 0x7f294c06d070 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f2944009870 tx=0x7f294402a270 comp rx=0 tx=0).stop 2024-09-11T22:23:26.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.007+0000 7f2953617640 1 -- 172.21.15.50:0/3231860147 shutdown_connections 2024-09-11T22:23:26.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.007+0000 7f2953617640 1 --2- 172.21.15.50:0/3231860147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f294c06e0f0 0x7f294c0711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:26.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.007+0000 7f2953617640 1 --2- 172.21.15.50:0/3231860147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294c15b400 0x7f294c06d070 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:26.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.007+0000 7f2953617640 1 -- 172.21.15.50:0/3231860147 >> 172.21.15.50:0/3231860147 conn(0x7f294c0679c0 msgr2=0x7f294c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:26.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.007+0000 7f2953617640 1 -- 172.21.15.50:0/3231860147 shutdown_connections 2024-09-11T22:23:26.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.007+0000 7f2953617640 1 -- 172.21.15.50:0/3231860147 wait complete. 2024-09-11T22:23:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.008+0000 7f2953617640 1 Processor -- start 2024-09-11T22:23:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.008+0000 7f2953617640 1 -- start start 2024-09-11T22:23:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2953617640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f294c06e0f0 0x7f294c144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2953617640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f294c072e60 0x7f294c15e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2953617640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294c15b400 0x7f294c1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:26.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2953617640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f294c071700 con 0x7f294c15b400 2024-09-11T22:23:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2953617640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f294c0cfc50 con 0x7f294c072e60 2024-09-11T22:23:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2953617640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f294c071880 con 0x7f294c06e0f0 2024-09-11T22:23:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2951bb4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294c15b400 0x7f294c1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2951bb4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294c15b400 0x7f294c1575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47890/0 (socket says 172.21.15.50:47890) 2024-09-11T22:23:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2951bb4640 1 -- 172.21.15.50:0/1726709044 learned_addr learned my addr 172.21.15.50:0/1726709044 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f29513b3640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f294c06e0f0 0x7f294c144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2950bb2640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f294c072e60 0x7f294c15e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2951bb4640 1 -- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f294c06e0f0 msgr2=0x7f294c144c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2951bb4640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f294c06e0f0 0x7f294c144c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2951bb4640 1 -- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f294c072e60 msgr2=0x7f294c15e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2951bb4640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f294c072e60 0x7f294c15e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2951bb4640 1 -- 172.21.15.50:0/1726709044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294c15d610 con 0x7f294c15b400 2024-09-11T22:23:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.009+0000 7f2950bb2640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f294c072e60 0x7f294c15e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.010+0000 7f2951bb4640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294c15b400 0x7f294c1575e0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f293c007de0 tx=0x7f293c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.010+0000 7f2949ffb640 1 -- 172.21.15.50:0/1726709044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c014620 con 0x7f294c15b400 2024-09-11T22:23:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.010+0000 7f2949ffb640 1 -- 172.21.15.50:0/1726709044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f293c019070 con 0x7f294c15b400 2024-09-11T22:23:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.010+0000 7f2953617640 1 -- 172.21.15.50:0/1726709044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f294c15d8f0 con 0x7f294c15b400 2024-09-11T22:23:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.010+0000 7f2949ffb640 1 -- 172.21.15.50:0/1726709044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c014a20 con 0x7f294c15b400 2024-09-11T22:23:26.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.010+0000 7f2953617640 1 -- 172.21.15.50:0/1726709044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f294c15deb0 con 0x7f294c15b400 2024-09-11T22:23:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.011+0000 7f2953617640 1 -- 172.21.15.50:0/1726709044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f294c0711c0 con 0x7f294c15b400 2024-09-11T22:23:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.012+0000 7f2949ffb640 1 -- 172.21.15.50:0/1726709044 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f293c014bc0 con 0x7f294c15b400 2024-09-11T22:23:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.012+0000 7f2949ffb640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f293806be60 0x7f293806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.012+0000 7f2949ffb640 1 -- 172.21.15.50:0/1726709044 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 4857+0+0 (secure 0 0 0) 0x7f293c08b3b0 con 0x7f294c15b400 2024-09-11T22:23:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.012+0000 7f29513b3640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f293806be60 0x7f293806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:26.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.013+0000 7f29513b3640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f293806be60 0x7f293806e320 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f2944034000 tx=0x7f294402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:26.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.016+0000 7f2949ffb640 1 -- 172.21.15.50:0/1726709044 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f293c05a0b0 con 0x7f294c15b400 2024-09-11T22:23:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.193+0000 7f2953617640 1 -- 172.21.15.50:0/1726709044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f294c0d0430 con 0x7f294c15b400 2024-09-11T22:23:26.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.194+0000 7f2949ffb640 1 -- 172.21.15.50:0/1726709044 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v185) ==== 84+0+65 (secure 0 0 0) 0x7f293c0599b0 con 0x7f294c15b400 2024-09-11T22:23:26.195 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:26.196 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-11T22:23:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-11T22:23:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-11T22:23:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-11T22:23:26.196 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:26.196 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-11T22:23:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.196+0000 7f2953617640 1 -- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f293806be60 msgr2=0x7f293806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.196+0000 7f2953617640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f293806be60 0x7f293806e320 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f2944034000 tx=0x7f294402e000 comp rx=0 tx=0).stop 2024-09-11T22:23:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.196+0000 7f2953617640 1 -- 172.21.15.50:0/1726709044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294c15b400 msgr2=0x7f294c1575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.196+0000 7f2953617640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294c15b400 0x7f294c1575e0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f293c007de0 tx=0x7f293c00e4b0 comp rx=0 tx=0).stop 2024-09-11T22:23:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.196+0000 7f2953617640 1 -- 172.21.15.50:0/1726709044 shutdown_connections 2024-09-11T22:23:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.196+0000 7f2953617640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f293806be60 0x7f293806e320 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.196+0000 7f2953617640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f294c15b400 0x7f294c1575e0 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.196+0000 7f2953617640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f294c072e60 0x7f294c15e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.196+0000 7f2953617640 1 --2- 172.21.15.50:0/1726709044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f294c06e0f0 0x7f294c144c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.196+0000 7f2953617640 1 -- 172.21.15.50:0/1726709044 >> 172.21.15.50:0/1726709044 conn(0x7f294c0679c0 msgr2=0x7f294c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:26.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.196+0000 7f2953617640 1 -- 172.21.15.50:0/1726709044 shutdown_connections 2024-09-11T22:23:26.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.196+0000 7f2953617640 1 -- 172.21.15.50:0/1726709044 wait complete. 2024-09-11T22:23:26.208 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:23:26.209 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:23:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.313+0000 7f2a5862e640 1 Processor -- start 2024-09-11T22:23:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.313+0000 7f2a5862e640 1 -- start start 2024-09-11T22:23:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.314+0000 7f2a5862e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a500d09b0 0x7f2a5006f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.314+0000 7f2a5862e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a500afdf0 con 0x7f2a500d0d90 2024-09-11T22:23:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.314+0000 7f2a5862e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a50070bd0 con 0x7f2a500710d0 2024-09-11T22:23:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.314+0000 7f2a5862e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f2a500b06e0 con 0x7f2a500d09b0 2024-09-11T22:23:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.314+0000 7f2a563ca640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a500d09b0 0x7f2a5006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.314+0000 7f2a563ca640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a500d09b0 0x7f2a5006f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47900/0 (socket says 172.21.15.50:47900) 2024-09-11T22:23:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.314+0000 7f2a56bcb640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2a500d0d90 0x7f2a500b0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:55122/0 (socket says 172.21.15.50:55122) 2024-09-11T22:23:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.314+0000 7f2a563ca640 1 -- 172.21.15.50:0/2623386201 learned_addr learned my addr 172.21.15.50:0/2623386201 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.315+0000 7f2a563ca640 1 -- 172.21.15.50:0/2623386201 >> v1:172.21.15.77:6789/0 conn(0x7f2a500710d0 legacy=0x7f2a5006f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.315+0000 7f2a563ca640 1 -- 172.21.15.50:0/2623386201 >> v1:172.21.15.50:6789/0 conn(0x7f2a500d0d90 legacy=0x7f2a500b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:26.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.315+0000 7f2a563ca640 1 -- 172.21.15.50:0/2623386201 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a500b0090 con 0x7f2a500d09b0 2024-09-11T22:23:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.315+0000 7f2a563ca640 1 --2- 172.21.15.50:0/2623386201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500d09b0 0x7f2a5006f300 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009870 tx=0x7f2a4c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574518e115b5b427 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.316+0000 7f2a553c8640 1 -- 172.21.15.50:0/2623386201 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c037070 con 0x7f2a500d09b0 2024-09-11T22:23:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.316+0000 7f2a553c8640 1 -- 172.21.15.50:0/2623386201 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4c02ae50 con 0x7f2a500d09b0 2024-09-11T22:23:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.316+0000 7f2a553c8640 1 -- 172.21.15.50:0/2623386201 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c032860 con 0x7f2a500d09b0 2024-09-11T22:23:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.316+0000 7f2a5862e640 1 -- 172.21.15.50:0/2623386201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500d09b0 msgr2=0x7f2a5006f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.316+0000 7f2a5862e640 1 --2- 172.21.15.50:0/2623386201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500d09b0 0x7f2a5006f300 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009870 tx=0x7f2a4c02a300 comp rx=0 tx=0).stop 2024-09-11T22:23:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.316+0000 7f2a5862e640 1 -- 172.21.15.50:0/2623386201 shutdown_connections 2024-09-11T22:23:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.316+0000 7f2a5862e640 1 --2- 172.21.15.50:0/2623386201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500d09b0 0x7f2a5006f300 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.316+0000 7f2a5862e640 1 -- 172.21.15.50:0/2623386201 >> 172.21.15.50:0/2623386201 conn(0x7f2a500b4150 msgr2=0x7f2a500b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.316+0000 7f2a5862e640 1 -- 172.21.15.50:0/2623386201 shutdown_connections 2024-09-11T22:23:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.316+0000 7f2a5862e640 1 -- 172.21.15.50:0/2623386201 wait complete. 2024-09-11T22:23:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.317+0000 7f2a5862e640 1 Processor -- start 2024-09-11T22:23:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.318+0000 7f2a5862e640 1 -- start start 2024-09-11T22:23:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.318+0000 7f2a5862e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500710d0 0x7f2a5015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.318+0000 7f2a5862e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a500d09b0 0x7f2a500b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.318+0000 7f2a5862e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500d0d90 0x7f2a5015f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.318+0000 7f2a5862e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2a500b5090 con 0x7f2a500710d0 2024-09-11T22:23:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.318+0000 7f2a5862e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2a500b4f10 con 0x7f2a500d09b0 2024-09-11T22:23:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.318+0000 7f2a5862e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5006ff50 con 0x7f2a500d0d90 2024-09-11T22:23:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.318+0000 7f2a563ca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500710d0 0x7f2a5015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.318+0000 7f2a563ca640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500710d0 0x7f2a5015af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47914/0 (socket says 172.21.15.50:47914) 2024-09-11T22:23:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.318+0000 7f2a563ca640 1 -- 172.21.15.50:0/771745379 learned_addr learned my addr 172.21.15.50:0/771745379 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.319+0000 7f2a55bc9640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a500d09b0 0x7f2a500b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.319+0000 7f2a56bcb640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500d0d90 0x7f2a5015f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.319+0000 7f2a563ca640 1 -- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500d0d90 msgr2=0x7f2a5015f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.319+0000 7f2a563ca640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500d0d90 0x7f2a5015f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.319+0000 7f2a563ca640 1 -- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a500d09b0 msgr2=0x7f2a500b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.319+0000 7f2a563ca640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a500d09b0 0x7f2a500b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.319+0000 7f2a563ca640 1 -- 172.21.15.50:0/771745379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a500b6c30 con 0x7f2a500710d0 2024-09-11T22:23:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.319+0000 7f2a563ca640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500710d0 0x7f2a5015af60 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c000c00 tx=0x7f2a4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.319+0000 7f2a42ffd640 1 -- 172.21.15.50:0/771745379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c041070 con 0x7f2a500710d0 2024-09-11T22:23:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.319+0000 7f2a42ffd640 1 -- 172.21.15.50:0/771745379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4c03c890 con 0x7f2a500710d0 2024-09-11T22:23:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.319+0000 7f2a42ffd640 1 -- 172.21.15.50:0/771745379 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c037040 con 0x7f2a500710d0 2024-09-11T22:23:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.319+0000 7f2a5862e640 1 -- 172.21.15.50:0/771745379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a500b6f10 con 0x7f2a500710d0 2024-09-11T22:23:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.319+0000 7f2a5862e640 1 -- 172.21.15.50:0/771745379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5015ccc0 con 0x7f2a500710d0 2024-09-11T22:23:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.320+0000 7f2a5862e640 1 -- 172.21.15.50:0/771745379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a500b3f70 con 0x7f2a500710d0 2024-09-11T22:23:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.321+0000 7f2a42ffd640 1 -- 172.21.15.50:0/771745379 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a4c044070 con 0x7f2a500710d0 2024-09-11T22:23:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.321+0000 7f2a42ffd640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2a3406be60 0x7f2a3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.321+0000 7f2a42ffd640 1 -- 172.21.15.50:0/771745379 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 4857+0+0 (secure 0 0 0) 0x7f2a4c0ab670 con 0x7f2a500710d0 2024-09-11T22:23:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.321+0000 7f2a55bc9640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2a3406be60 0x7f2a3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.322+0000 7f2a55bc9640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2a3406be60 0x7f2a3406e320 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f2a501f5ef0 tx=0x7f2a44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:26.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.326+0000 7f2a42ffd640 1 -- 172.21.15.50:0/771745379 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a500b3f70 con 0x7f2a500710d0 2024-09-11T22:23:26.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:26.502+0000 7f2a5862e640 1 -- 172.21.15.50:0/771745379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2a50070630 con 0x7f2a500710d0 2024-09-11T22:23:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.508+0000 7f2a42ffd640 1 -- 172.21.15.50:0/771745379 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v186) ==== 138+0+0 (secure 0 0 0) 0x7f2a4c07a520 con 0x7f2a500710d0 2024-09-11T22:23:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-11T22:23:27.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.512+0000 7f2a5862e640 1 -- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2a3406be60 msgr2=0x7f2a3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:27.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.512+0000 7f2a5862e640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2a3406be60 0x7f2a3406e320 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f2a501f5ef0 tx=0x7f2a44009040 comp rx=0 tx=0).stop 2024-09-11T22:23:27.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.512+0000 7f2a5862e640 1 -- 172.21.15.50:0/771745379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500710d0 msgr2=0x7f2a5015af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:27.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.512+0000 7f2a5862e640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500710d0 0x7f2a5015af60 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c000c00 tx=0x7f2a4c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:27.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.512+0000 7f2a5862e640 1 -- 172.21.15.50:0/771745379 shutdown_connections 2024-09-11T22:23:27.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.512+0000 7f2a5862e640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f2a3406be60 0x7f2a3406e320 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:27.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.512+0000 7f2a5862e640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500d0d90 0x7f2a5015f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:27.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.512+0000 7f2a5862e640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a500d09b0 0x7f2a500b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:27.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.512+0000 7f2a5862e640 1 --2- 172.21.15.50:0/771745379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500710d0 0x7f2a5015af60 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:27.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.512+0000 7f2a5862e640 1 -- 172.21.15.50:0/771745379 >> 172.21.15.50:0/771745379 conn(0x7f2a500b4150 msgr2=0x7f2a500cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:27.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.512+0000 7f2a5862e640 1 -- 172.21.15.50:0/771745379 shutdown_connections 2024-09-11T22:23:27.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.513+0000 7f2a5862e640 1 -- 172.21.15.50:0/771745379 wait complete. 2024-09-11T22:23:27.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:23:27.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.644+0000 7f4832f3a640 1 Processor -- start 2024-09-11T22:23:27.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.645+0000 7f4832f3a640 1 -- start start 2024-09-11T22:23:27.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.645+0000 7f4832f3a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f482c0d18a0 0x7f482c0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.645+0000 7f4832f3a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f482c0d3a30 0x7f482c0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.645+0000 7f4832f3a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f482c0cfa80 con 0x7f482c15e870 2024-09-11T22:23:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.645+0000 7f4832f3a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f482c0d3ea0 con 0x7f482c0d18a0 2024-09-11T22:23:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.645+0000 7f4832f3a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f482c0d40d0 con 0x7f482c0d3a30 2024-09-11T22:23:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.645+0000 7f482bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f482c0d18a0 0x7f482c0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.646+0000 7f482bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f482c0d18a0 0x7f482c0d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54186/0 (socket says 172.21.15.50:54186) 2024-09-11T22:23:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.646+0000 7f482bfff640 1 -- 172.21.15.50:0/3257649353 learned_addr learned my addr 172.21.15.50:0/3257649353 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.646+0000 7f48314d7640 1 --2- 172.21.15.50:0/3257649353 >> v2:172.21.15.77:3300/0 conn(0x7f482c0d3a30 0x7f482c0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.646+0000 7f482bfff640 1 -- 172.21.15.50:0/3257649353 >> v2:172.21.15.77:3300/0 conn(0x7f482c0d3a30 msgr2=0x7f482c0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.646+0000 7f482bfff640 1 --2- 172.21.15.50:0/3257649353 >> v2:172.21.15.77:3300/0 conn(0x7f482c0d3a30 0x7f482c0b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.646+0000 7f482bfff640 1 -- 172.21.15.50:0/3257649353 >> v1:172.21.15.77:6789/0 conn(0x7f482c15e870 legacy=0x7f482c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:27.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.646+0000 7f482bfff640 1 -- 172.21.15.50:0/3257649353 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482c0d43b0 con 0x7f482c0d18a0 2024-09-11T22:23:27.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.647+0000 7f482bfff640 1 --2- 172.21.15.50:0/3257649353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f482c0d18a0 0x7f482c0d34f0 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f482c0684c0 tx=0x7f482002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6909416499250889 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.647+0000 7f482b7fe640 1 -- 172.21.15.50:0/3257649353 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820037070 con 0x7f482c0d18a0 2024-09-11T22:23:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.647+0000 7f482b7fe640 1 -- 172.21.15.50:0/3257649353 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4820032440 con 0x7f482c0d18a0 2024-09-11T22:23:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.647+0000 7f482b7fe640 1 -- 172.21.15.50:0/3257649353 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820032810 con 0x7f482c0d18a0 2024-09-11T22:23:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.647+0000 7f4832f3a640 1 -- 172.21.15.50:0/3257649353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f482c0d18a0 msgr2=0x7f482c0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.647+0000 7f4832f3a640 1 --2- 172.21.15.50:0/3257649353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f482c0d18a0 0x7f482c0d34f0 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f482c0684c0 tx=0x7f482002a230 comp rx=0 tx=0).stop 2024-09-11T22:23:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.647+0000 7f4832f3a640 1 -- 172.21.15.50:0/3257649353 shutdown_connections 2024-09-11T22:23:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.647+0000 7f4832f3a640 1 --2- 172.21.15.50:0/3257649353 >> v2:172.21.15.77:3300/0 conn(0x7f482c0d3a30 0x7f482c0b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.647+0000 7f4832f3a640 1 --2- 172.21.15.50:0/3257649353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f482c0d18a0 0x7f482c0d34f0 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.647+0000 7f4832f3a640 1 -- 172.21.15.50:0/3257649353 >> 172.21.15.50:0/3257649353 conn(0x7f482c0727a0 msgr2=0x7f482c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.647+0000 7f4832f3a640 1 -- 172.21.15.50:0/3257649353 shutdown_connections 2024-09-11T22:23:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.647+0000 7f4832f3a640 1 -- 172.21.15.50:0/3257649353 wait complete. 2024-09-11T22:23:27.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.649+0000 7f4832f3a640 1 Processor -- start 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.649+0000 7f4832f3a640 1 -- start start 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.649+0000 7f4832f3a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f482c0d18a0 0x7f482c1e82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4832f3a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c0d3a30 0x7f482c158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4832f3a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f482c15e870 0x7f482c158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4832f3a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f482c15ec50 con 0x7f482c0d18a0 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4832f3a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f482c0b7ee0 con 0x7f482c0d3a30 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4832f3a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f482c0b78b0 con 0x7f482c15e870 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4830cd6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f482c0d18a0 0x7f482c1e82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4830cd6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f482c0d18a0 0x7f482c1e82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54194/0 (socket says 172.21.15.50:54194) 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4830cd6640 1 -- 172.21.15.50:0/893252938 learned_addr learned my addr 172.21.15.50:0/893252938 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f482bfff640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c0d3a30 0x7f482c158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f48314d7640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f482c15e870 0x7f482c158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4830cd6640 1 -- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f482c15e870 msgr2=0x7f482c158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4830cd6640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f482c15e870 0x7f482c158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4830cd6640 1 -- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c0d3a30 msgr2=0x7f482c158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4830cd6640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c0d3a30 0x7f482c158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4830cd6640 1 -- 172.21.15.50:0/893252938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482c1e7210 con 0x7f482c0d18a0 2024-09-11T22:23:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f482bfff640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c0d3a30 0x7f482c158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4830cd6640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f482c0d18a0 0x7f482c1e82b0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f481c00c430 tx=0x7f481c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f48297fa640 1 -- 172.21.15.50:0/893252938 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c011790 con 0x7f482c0d18a0 2024-09-11T22:23:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f48297fa640 1 -- 172.21.15.50:0/893252938 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481c017070 con 0x7f482c0d18a0 2024-09-11T22:23:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4832f3a640 1 -- 172.21.15.50:0/893252938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f482c1e74f0 con 0x7f482c0d18a0 2024-09-11T22:23:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f48297fa640 1 -- 172.21.15.50:0/893252938 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c011bb0 con 0x7f482c0d18a0 2024-09-11T22:23:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.650+0000 7f4832f3a640 1 -- 172.21.15.50:0/893252938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f482c1e7ab0 con 0x7f482c0d18a0 2024-09-11T22:23:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.651+0000 7f4832f3a640 1 -- 172.21.15.50:0/893252938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f482c0d34f0 con 0x7f482c0d18a0 2024-09-11T22:23:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.652+0000 7f48297fa640 1 -- 172.21.15.50:0/893252938 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f481c01c460 con 0x7f482c0d18a0 2024-09-11T22:23:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.653+0000 7f48297fa640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f481806be30 0x7f481806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.653+0000 7f48297fa640 1 -- 172.21.15.50:0/893252938 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5227+0+0 (secure 0 0 0) 0x7f481c08ac20 con 0x7f482c0d18a0 2024-09-11T22:23:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.653+0000 7f482bfff640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f481806be30 0x7f481806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.653+0000 7f482bfff640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f481806be30 0x7f481806e2f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f4820034000 tx=0x7f482002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:27.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.657+0000 7f48297fa640 1 -- 172.21.15.50:0/893252938 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f481c059710 con 0x7f482c0d18a0 2024-09-11T22:23:27.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:27.832+0000 7f4832f3a640 1 -- 172.21.15.50:0/893252938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f482c15e1b0 con 0x7f482c0d18a0 2024-09-11T22:23:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.514+0000 7f48297fa640 1 -- 172.21.15.50:0/893252938 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v187) ==== 170+0+0 (secure 0 0 0) 0x7f481c059010 con 0x7f482c0d18a0 2024-09-11T22:23:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-11T22:23:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.517+0000 7f4832f3a640 1 -- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f481806be30 msgr2=0x7f481806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.517+0000 7f4832f3a640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f481806be30 0x7f481806e2f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f4820034000 tx=0x7f482002e000 comp rx=0 tx=0).stop 2024-09-11T22:23:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.517+0000 7f4832f3a640 1 -- 172.21.15.50:0/893252938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f482c0d18a0 msgr2=0x7f482c1e82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.517+0000 7f4832f3a640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f482c0d18a0 0x7f482c1e82b0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f481c00c430 tx=0x7f481c00c8f0 comp rx=0 tx=0).stop 2024-09-11T22:23:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.517+0000 7f4832f3a640 1 -- 172.21.15.50:0/893252938 shutdown_connections 2024-09-11T22:23:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.517+0000 7f4832f3a640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f481806be30 0x7f481806e2f0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.517+0000 7f4832f3a640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f482c15e870 0x7f482c158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.517+0000 7f4832f3a640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c0d3a30 0x7f482c158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.517+0000 7f4832f3a640 1 --2- 172.21.15.50:0/893252938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f482c0d18a0 0x7f482c1e82b0 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.517+0000 7f4832f3a640 1 -- 172.21.15.50:0/893252938 >> 172.21.15.50:0/893252938 conn(0x7f482c0727a0 msgr2=0x7f482c0b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.518+0000 7f4832f3a640 1 -- 172.21.15.50:0/893252938 shutdown_connections 2024-09-11T22:23:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.518+0000 7f4832f3a640 1 -- 172.21.15.50:0/893252938 wait complete. 2024-09-11T22:23:28.550 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:23:28.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.659+0000 7fe4bd6f8640 1 Processor -- start 2024-09-11T22:23:28.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.659+0000 7fe4bd6f8640 1 -- start start 2024-09-11T22:23:28.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4bd6f8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe4b815b400 0x7fe4b806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:28.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4bd6f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b8072e60 0x7fe4b806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4bd6f8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4b806df20 0x7fe4b80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4bd6f8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe4b815b7e0 con 0x7fe4b806df20 2024-09-11T22:23:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4bd6f8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe4b815f140 con 0x7fe4b815b400 2024-09-11T22:23:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4bd6f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b815f420 con 0x7fe4b8072e60 2024-09-11T22:23:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4b77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4b806df20 0x7fe4b80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4b77fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4b806df20 0x7fe4b80b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54204/0 (socket says 172.21.15.50:54204) 2024-09-11T22:23:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4b77fe640 1 -- 172.21.15.50:0/1658642391 learned_addr learned my addr 172.21.15.50:0/1658642391 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4b6ffd640 1 --2- 172.21.15.50:0/1658642391 >> v2:172.21.15.77:3300/0 conn(0x7fe4b815b400 0x7fe4b806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4b67fc640 1 --2- 172.21.15.50:0/1658642391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b8072e60 0x7fe4b806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4b77fe640 1 -- 172.21.15.50:0/1658642391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b8072e60 msgr2=0x7fe4b806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4b77fe640 1 --2- 172.21.15.50:0/1658642391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b8072e60 0x7fe4b806d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4b77fe640 1 -- 172.21.15.50:0/1658642391 >> v2:172.21.15.77:3300/0 conn(0x7fe4b815b400 msgr2=0x7fe4b806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:28.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4b77fe640 1 --2- 172.21.15.50:0/1658642391 >> v2:172.21.15.77:3300/0 conn(0x7fe4b815b400 0x7fe4b806d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:28.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4b77fe640 1 -- 172.21.15.50:0/1658642391 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b815f700 con 0x7fe4b806df20 2024-09-11T22:23:28.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.660+0000 7fe4b6ffd640 1 --2- 172.21.15.50:0/1658642391 >> v2:172.21.15.77:3300/0 conn(0x7fe4b815b400 0x7fe4b806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:28.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.661+0000 7fe4b77fe640 1 --2- 172.21.15.50:0/1658642391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b806df20 0x7fe4b80b4610 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80b56e0 tx=0x7fe4b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99636a58362a6ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:28.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.661+0000 7fe4b5ffb640 1 -- 172.21.15.50:0/1658642391 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0037070 con 0x7fe4b806df20 2024-09-11T22:23:28.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.661+0000 7fe4b5ffb640 1 -- 172.21.15.50:0/1658642391 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b0032440 con 0x7fe4b806df20 2024-09-11T22:23:28.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.661+0000 7fe4b5ffb640 1 -- 172.21.15.50:0/1658642391 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0032810 con 0x7fe4b806df20 2024-09-11T22:23:28.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.662+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1658642391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b806df20 msgr2=0x7fe4b80b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:28.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.662+0000 7fe4bd6f8640 1 --2- 172.21.15.50:0/1658642391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b806df20 0x7fe4b80b4610 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80b56e0 tx=0x7fe4b002a1e0 comp rx=0 tx=0).stop 2024-09-11T22:23:28.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.662+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1658642391 shutdown_connections 2024-09-11T22:23:28.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.662+0000 7fe4bd6f8640 1 --2- 172.21.15.50:0/1658642391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b806df20 0x7fe4b80b4610 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:28.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.662+0000 7fe4bd6f8640 1 --2- 172.21.15.50:0/1658642391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b8072e60 0x7fe4b806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.662+0000 7fe4bd6f8640 1 --2- 172.21.15.50:0/1658642391 >> v2:172.21.15.77:3300/0 conn(0x7fe4b815b400 0x7fe4b806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.662+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1658642391 >> 172.21.15.50:0/1658642391 conn(0x7fe4b80679c0 msgr2=0x7fe4b8067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.662+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1658642391 shutdown_connections 2024-09-11T22:23:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.662+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1658642391 wait complete. 2024-09-11T22:23:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.663+0000 7fe4bd6f8640 1 Processor -- start 2024-09-11T22:23:28.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.663+0000 7fe4bd6f8640 1 -- start start 2024-09-11T22:23:28.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4bd6f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b806df20 0x7fe4b814e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:28.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4bd6f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4b8072e60 0x7fe4b8151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:28.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4bd6f8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b815b400 0x7fe4b81523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:28.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4bd6f8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b80b4b50 con 0x7fe4b815b400 2024-09-11T22:23:28.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4bd6f8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b80cfc50 con 0x7fe4b8072e60 2024-09-11T22:23:28.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4bd6f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b80b4cd0 con 0x7fe4b806df20 2024-09-11T22:23:28.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4b77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b815b400 0x7fe4b81523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:28.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4b77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b815b400 0x7fe4b81523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54218/0 (socket says 172.21.15.50:54218) 2024-09-11T22:23:28.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4b77fe640 1 -- 172.21.15.50:0/1459044997 learned_addr learned my addr 172.21.15.50:0/1459044997 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:28.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4b6ffd640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b806df20 0x7fe4b814e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:28.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4b67fc640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4b8072e60 0x7fe4b8151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:28.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4b77fe640 1 -- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b806df20 msgr2=0x7fe4b814e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:28.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4b77fe640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b806df20 0x7fe4b814e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:28.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4b77fe640 1 -- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4b8072e60 msgr2=0x7fe4b8151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:28.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.664+0000 7fe4b77fe640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4b8072e60 0x7fe4b8151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:28.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.665+0000 7fe4b77fe640 1 -- 172.21.15.50:0/1459044997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b80b12d0 con 0x7fe4b815b400 2024-09-11T22:23:28.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.665+0000 7fe4b77fe640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b815b400 0x7fe4b81523d0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00090b0 tx=0x7fe4b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:28.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.665+0000 7fe4af7fe640 1 -- 172.21.15.50:0/1459044997 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0041070 con 0x7fe4b815b400 2024-09-11T22:23:28.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.665+0000 7fe4af7fe640 1 -- 172.21.15.50:0/1459044997 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b003c870 con 0x7fe4b815b400 2024-09-11T22:23:28.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.665+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1459044997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b80b15b0 con 0x7fe4b815b400 2024-09-11T22:23:28.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.665+0000 7fe4af7fe640 1 -- 172.21.15.50:0/1459044997 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0037040 con 0x7fe4b815b400 2024-09-11T22:23:28.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.665+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1459044997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b80b1b70 con 0x7fe4b815b400 2024-09-11T22:23:28.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.666+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1459044997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b80b5100 con 0x7fe4b815b400 2024-09-11T22:23:28.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.667+0000 7fe4af7fe640 1 -- 172.21.15.50:0/1459044997 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe4b0044070 con 0x7fe4b815b400 2024-09-11T22:23:28.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.667+0000 7fe4af7fe640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe49806be60 0x7fe49806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:28.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.667+0000 7fe4af7fe640 1 -- 172.21.15.50:0/1459044997 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5609+0+0 (secure 0 0 0) 0x7fe4b00ab920 con 0x7fe4b815b400 2024-09-11T22:23:28.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.667+0000 7fe4b6ffd640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe49806be60 0x7fe49806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:28.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.668+0000 7fe4b6ffd640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe49806be60 0x7fe49806e320 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009fd0 tx=0x7fe4a80097f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:28.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.671+0000 7fe4af7fe640 1 -- 172.21.15.50:0/1459044997 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe4b0079e50 con 0x7fe4b815b400 2024-09-11T22:23:28.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:28.884+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1459044997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe4b80b3cb0 con 0x7fe4b815b400 2024-09-11T22:23:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 28 and data pool 29 2024-09-11T22:23:29.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.526+0000 7fe4af7fe640 1 -- 172.21.15.50:0/1459044997 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 28 and data pool 29 v135) ==== 174+0+0 (secure 0 0 0) 0x7fe4b007e150 con 0x7fe4b815b400 2024-09-11T22:23:29.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.534+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe49806be60 msgr2=0x7fe49806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:29.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.534+0000 7fe4bd6f8640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe49806be60 0x7fe49806e320 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009fd0 tx=0x7fe4a80097f0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.534+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1459044997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b815b400 msgr2=0x7fe4b81523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:29.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.534+0000 7fe4bd6f8640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b815b400 0x7fe4b81523d0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00090b0 tx=0x7fe4b00046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.535+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1459044997 shutdown_connections 2024-09-11T22:23:29.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.535+0000 7fe4bd6f8640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe49806be60 0x7fe49806e320 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.535+0000 7fe4bd6f8640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4b815b400 0x7fe4b81523d0 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.535+0000 7fe4bd6f8640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4b8072e60 0x7fe4b8151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.535+0000 7fe4bd6f8640 1 --2- 172.21.15.50:0/1459044997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b806df20 0x7fe4b814e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.535+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1459044997 >> 172.21.15.50:0/1459044997 conn(0x7fe4b80679c0 msgr2=0x7fe4b80b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:29.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.535+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1459044997 shutdown_connections 2024-09-11T22:23:29.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.536+0000 7fe4bd6f8640 1 -- 172.21.15.50:0/1459044997 wait complete. 2024-09-11T22:23:29.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:23:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.660+0000 7fa58f978640 1 Processor -- start 2024-09-11T22:23:29.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.660+0000 7fa58f978640 1 -- start start 2024-09-11T22:23:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58f978640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa58815e8e0 0x7fa5880b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58f978640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa5880d1580 0x7fa5880d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58f978640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5880d1ee0 con 0x7fa588162350 2024-09-11T22:23:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58f978640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa58815ecc0 con 0x7fa5880d1580 2024-09-11T22:23:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58f978640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa5880d2ad0 con 0x7fa58815e8e0 2024-09-11T22:23:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58cf13640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa5880d1580 0x7fa5880d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58cf13640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa5880d1580 0x7fa5880d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:34258/0 (socket says 172.21.15.50:34258) 2024-09-11T22:23:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58df15640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa588162350 0x7fa588162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:59618/0 (socket says 172.21.15.50:59618) 2024-09-11T22:23:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58cf13640 1 -- 172.21.15.50:0/3093930326 learned_addr learned my addr 172.21.15.50:0/3093930326 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:29.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58d714640 1 --2- 172.21.15.50:0/3093930326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa58815e8e0 0x7fa5880b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58d714640 1 -- 172.21.15.50:0/3093930326 >> v2:172.21.15.77:3300/0 conn(0x7fa5880d1580 msgr2=0x7fa5880d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58d714640 1 --2- 172.21.15.50:0/3093930326 >> v2:172.21.15.77:3300/0 conn(0x7fa5880d1580 0x7fa5880d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58d714640 1 -- 172.21.15.50:0/3093930326 >> v1:172.21.15.77:6789/0 conn(0x7fa588162350 legacy=0x7fa588162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58d714640 1 -- 172.21.15.50:0/3093930326 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa588163080 con 0x7fa58815e8e0 2024-09-11T22:23:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58cf13640 1 --2- 172.21.15.50:0/3093930326 >> v2:172.21.15.77:3300/0 conn(0x7fa5880d1580 0x7fa5880d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa58d714640 1 --2- 172.21.15.50:0/3093930326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa58815e8e0 0x7fa5880b7880 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa5840097a0 tx=0x7fa58402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47c7711d4e89d99b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.662+0000 7fa57ffff640 1 -- 172.21.15.50:0/3093930326 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584037070 con 0x7fa58815e8e0 2024-09-11T22:23:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.663+0000 7fa57ffff640 1 -- 172.21.15.50:0/3093930326 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa584032440 con 0x7fa58815e8e0 2024-09-11T22:23:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.663+0000 7fa57ffff640 1 -- 172.21.15.50:0/3093930326 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584032810 con 0x7fa58815e8e0 2024-09-11T22:23:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.663+0000 7fa58f978640 1 -- 172.21.15.50:0/3093930326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa58815e8e0 msgr2=0x7fa5880b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.663+0000 7fa58f978640 1 --2- 172.21.15.50:0/3093930326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa58815e8e0 0x7fa5880b7880 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa5840097a0 tx=0x7fa58402a210 comp rx=0 tx=0).stop 2024-09-11T22:23:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.663+0000 7fa58f978640 1 -- 172.21.15.50:0/3093930326 shutdown_connections 2024-09-11T22:23:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.663+0000 7fa58f978640 1 --2- 172.21.15.50:0/3093930326 >> v2:172.21.15.77:3300/0 conn(0x7fa5880d1580 0x7fa5880d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.663+0000 7fa58f978640 1 --2- 172.21.15.50:0/3093930326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa58815e8e0 0x7fa5880b7880 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.663+0000 7fa58f978640 1 -- 172.21.15.50:0/3093930326 >> 172.21.15.50:0/3093930326 conn(0x7fa588067ba0 msgr2=0x7fa588067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:29.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.663+0000 7fa58f978640 1 -- 172.21.15.50:0/3093930326 shutdown_connections 2024-09-11T22:23:29.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.663+0000 7fa58f978640 1 -- 172.21.15.50:0/3093930326 wait complete. 2024-09-11T22:23:29.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.664+0000 7fa58f978640 1 Processor -- start 2024-09-11T22:23:29.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.664+0000 7fa58f978640 1 -- start start 2024-09-11T22:23:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.665+0000 7fa58f978640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5880d1580 0x7fa5881581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.665+0000 7fa58f978640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815e8e0 0x7fa5880b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.665+0000 7fa58f978640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa588162350 0x7fa58815da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.665+0000 7fa58f978640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa5880d3000 con 0x7fa58815e8e0 2024-09-11T22:23:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.665+0000 7fa58f978640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa5880d3370 con 0x7fa588162350 2024-09-11T22:23:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.665+0000 7fa58f978640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa5880d3800 con 0x7fa5880d1580 2024-09-11T22:23:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.665+0000 7fa58cf13640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815e8e0 0x7fa5880b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.665+0000 7fa58cf13640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815e8e0 0x7fa5880b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54222/0 (socket says 172.21.15.50:54222) 2024-09-11T22:23:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.665+0000 7fa58cf13640 1 -- 172.21.15.50:0/1104999838 learned_addr learned my addr 172.21.15.50:0/1104999838 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa58d714640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5880d1580 0x7fa5881581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa58df15640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa588162350 0x7fa58815da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa58cf13640 1 -- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5880d1580 msgr2=0x7fa5881581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa58cf13640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5880d1580 0x7fa5881581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa58cf13640 1 -- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa588162350 msgr2=0x7fa58815da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa58cf13640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa588162350 0x7fa58815da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa58cf13640 1 -- 172.21.15.50:0/1104999838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa588157400 con 0x7fa58815e8e0 2024-09-11T22:23:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa58df15640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa588162350 0x7fa58815da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa58d714640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5880d1580 0x7fa5881581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa58cf13640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815e8e0 0x7fa5880b5c30 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7fa57800e9e0 tx=0x7fa57800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa57dffb640 1 -- 172.21.15.50:0/1104999838 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578017070 con 0x7fa58815e8e0 2024-09-11T22:23:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa57dffb640 1 -- 172.21.15.50:0/1104999838 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa57800ca30 con 0x7fa58815e8e0 2024-09-11T22:23:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa58f978640 1 -- 172.21.15.50:0/1104999838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5881576e0 con 0x7fa58815e8e0 2024-09-11T22:23:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa57dffb640 1 -- 172.21.15.50:0/1104999838 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57800ce20 con 0x7fa58815e8e0 2024-09-11T22:23:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.666+0000 7fa58f978640 1 -- 172.21.15.50:0/1104999838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5880b6170 con 0x7fa58815e8e0 2024-09-11T22:23:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.667+0000 7fa58f978640 1 -- 172.21.15.50:0/1104999838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5880d19a0 con 0x7fa58815e8e0 2024-09-11T22:23:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.668+0000 7fa57dffb640 1 -- 172.21.15.50:0/1104999838 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa57801a070 con 0x7fa58815e8e0 2024-09-11T22:23:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.668+0000 7fa57dffb640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa56c06be30 0x7fa56c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.668+0000 7fa57dffb640 1 -- 172.21.15.50:0/1104999838 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fa57808b1c0 con 0x7fa58815e8e0 2024-09-11T22:23:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.668+0000 7fa58d714640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa56c06be30 0x7fa56c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.669+0000 7fa58d714640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa56c06be30 0x7fa56c06e2f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa584034000 tx=0x7fa58402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.673+0000 7fa57dffb640 1 -- 172.21.15.50:0/1104999838 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa578059af0 con 0x7fa58815e8e0 2024-09-11T22:23:29.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.851+0000 7fa58f978640 1 -- 172.21.15.50:0/1104999838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5880ba770 con 0x7fa58815e8e0 2024-09-11T22:23:29.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.852+0000 7fa57dffb640 1 -- 172.21.15.50:0/1104999838 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) ==== 74+0+16716 (secure 0 0 0) 0x7fa5780593f0 con 0x7fa58815e8e0 2024-09-11T22:23:29.854 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:29.854 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":188,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:23:28.886477+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:23:26.537609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-11T22:23:27.864958+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:23:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.855+0000 7fa58f978640 1 -- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa56c06be30 msgr2=0x7fa56c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.855+0000 7fa58f978640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa56c06be30 0x7fa56c06e2f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa584034000 tx=0x7fa58402e000 comp rx=0 tx=0).stop 2024-09-11T22:23:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.855+0000 7fa58f978640 1 -- 172.21.15.50:0/1104999838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815e8e0 msgr2=0x7fa5880b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.855+0000 7fa58f978640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815e8e0 0x7fa5880b5c30 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7fa57800e9e0 tx=0x7fa57800eea0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.855+0000 7fa58f978640 1 -- 172.21.15.50:0/1104999838 shutdown_connections 2024-09-11T22:23:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.855+0000 7fa58f978640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa56c06be30 0x7fa56c06e2f0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.855+0000 7fa58f978640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa588162350 0x7fa58815da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.855+0000 7fa58f978640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815e8e0 0x7fa5880b5c30 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.855+0000 7fa58f978640 1 --2- 172.21.15.50:0/1104999838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5880d1580 0x7fa5881581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.855+0000 7fa58f978640 1 -- 172.21.15.50:0/1104999838 >> 172.21.15.50:0/1104999838 conn(0x7fa588067ba0 msgr2=0x7fa588067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.855+0000 7fa58f978640 1 -- 172.21.15.50:0/1104999838 shutdown_connections 2024-09-11T22:23:29.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.855+0000 7fa58f978640 1 -- 172.21.15.50:0/1104999838 wait complete. 2024-09-11T22:23:29.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:23:29.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.968+0000 7f49523d6640 1 Processor -- start 2024-09-11T22:23:29.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.968+0000 7f49523d6640 1 -- start start 2024-09-11T22:23:29.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f49523d6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f494c1463b0 0x7f494c0cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:29.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f49523d6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f494c15db60 0x7f494c0cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:29.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f49523d6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f494c072630 con 0x7f494c0d0180 2024-09-11T22:23:29.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f49523d6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f494c0d0670 con 0x7f494c1463b0 2024-09-11T22:23:29.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f49523d6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f494c146790 con 0x7f494c15db60 2024-09-11T22:23:29.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f494bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f494c1463b0 0x7f494c0cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:29.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f494bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f494c1463b0 0x7f494c0cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54230/0 (socket says 172.21.15.50:54230) 2024-09-11T22:23:29.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f494bfff640 1 -- 172.21.15.50:0/3623880388 learned_addr learned my addr 172.21.15.50:0/3623880388 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:29.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f494b7fe640 1 --2- 172.21.15.50:0/3623880388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f494c15db60 0x7f494c0cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:29.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f494bfff640 1 -- 172.21.15.50:0/3623880388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f494c15db60 msgr2=0x7f494c0cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:29.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f494bfff640 1 --2- 172.21.15.50:0/3623880388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f494c15db60 0x7f494c0cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f494bfff640 1 -- 172.21.15.50:0/3623880388 >> v1:172.21.15.50:6789/0 conn(0x7f494c0d0180 legacy=0x7f494c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:29.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f494bfff640 1 -- 172.21.15.50:0/3623880388 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c0728d0 con 0x7f494c1463b0 2024-09-11T22:23:29.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f494affd640 1 -- 172.21.15.50:0/3623880388 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2807048089 0 0) 0x7f494c072630 con 0x7f494c0d0180 2024-09-11T22:23:29.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.970+0000 7f494bfff640 1 --2- 172.21.15.50:0/3623880388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c1463b0 0x7f494c0cfc40 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f493c009870 tx=0x7f493c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c1ad94e7d282af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:29.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.971+0000 7f494affd640 1 -- 172.21.15.50:0/3623880388 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c037070 con 0x7f494c1463b0 2024-09-11T22:23:29.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.971+0000 7f494affd640 1 -- 172.21.15.50:0/3623880388 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493c032440 con 0x7f494c1463b0 2024-09-11T22:23:29.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.971+0000 7f494affd640 1 -- 172.21.15.50:0/3623880388 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c032810 con 0x7f494c1463b0 2024-09-11T22:23:29.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.971+0000 7f49523d6640 1 -- 172.21.15.50:0/3623880388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c1463b0 msgr2=0x7f494c0cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:29.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.971+0000 7f49523d6640 1 --2- 172.21.15.50:0/3623880388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c1463b0 0x7f494c0cfc40 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f493c009870 tx=0x7f493c02a270 comp rx=0 tx=0).stop 2024-09-11T22:23:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.971+0000 7f49523d6640 1 -- 172.21.15.50:0/3623880388 shutdown_connections 2024-09-11T22:23:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.971+0000 7f49523d6640 1 --2- 172.21.15.50:0/3623880388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f494c15db60 0x7f494c0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.971+0000 7f49523d6640 1 --2- 172.21.15.50:0/3623880388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c1463b0 0x7f494c0cfc40 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.971+0000 7f49523d6640 1 -- 172.21.15.50:0/3623880388 >> 172.21.15.50:0/3623880388 conn(0x7f494c068240 msgr2=0x7f494c0b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.971+0000 7f49523d6640 1 -- 172.21.15.50:0/3623880388 shutdown_connections 2024-09-11T22:23:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.971+0000 7f49523d6640 1 -- 172.21.15.50:0/3623880388 wait complete. 2024-09-11T22:23:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.972+0000 7f49523d6640 1 Processor -- start 2024-09-11T22:23:29.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.973+0000 7f49523d6640 1 -- start start 2024-09-11T22:23:29.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.973+0000 7f49523d6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f494c0d0180 0x7f494c141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:29.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.973+0000 7f49523d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c1463b0 0x7f494c13a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:29.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.973+0000 7f49523d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c15db60 0x7f494c13a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:29.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.973+0000 7f49523d6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f494c0733b0 con 0x7f494c15db60 2024-09-11T22:23:29.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.973+0000 7f49523d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f494c072f20 con 0x7f494c1463b0 2024-09-11T22:23:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.973+0000 7f49523d6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f494c073530 con 0x7f494c0d0180 2024-09-11T22:23:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.973+0000 7f4950973640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c15db60 0x7f494c13a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.973+0000 7f4950973640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c15db60 0x7f494c13a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54240/0 (socket says 172.21.15.50:54240) 2024-09-11T22:23:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.973+0000 7f4950973640 1 -- 172.21.15.50:0/3226860713 learned_addr learned my addr 172.21.15.50:0/3226860713 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f494bfff640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f494c0d0180 0x7f494c141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f494b7fe640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c1463b0 0x7f494c13a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f4950973640 1 -- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f494c0d0180 msgr2=0x7f494c141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f4950973640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f494c0d0180 0x7f494c141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f4950973640 1 -- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c1463b0 msgr2=0x7f494c13a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f4950973640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c1463b0 0x7f494c13a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f4950973640 1 -- 172.21.15.50:0/3226860713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c13e1b0 con 0x7f494c15db60 2024-09-11T22:23:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f494bfff640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f494c0d0180 0x7f494c141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f4950973640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c15db60 0x7f494c13a5c0 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f494400c760 tx=0x7f494400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f4948ff9640 1 -- 172.21.15.50:0/3226860713 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4944003da0 con 0x7f494c15db60 2024-09-11T22:23:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f4948ff9640 1 -- 172.21.15.50:0/3226860713 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4944005070 con 0x7f494c15db60 2024-09-11T22:23:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f4948ff9640 1 -- 172.21.15.50:0/3226860713 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4944005460 con 0x7f494c15db60 2024-09-11T22:23:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f49523d6640 1 -- 172.21.15.50:0/3226860713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494c13ed10 con 0x7f494c15db60 2024-09-11T22:23:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.974+0000 7f49523d6640 1 -- 172.21.15.50:0/3226860713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f494c13f2d0 con 0x7f494c15db60 2024-09-11T22:23:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.976+0000 7f49523d6640 1 -- 172.21.15.50:0/3226860713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f494c13f4d0 con 0x7f494c15db60 2024-09-11T22:23:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.976+0000 7f4948ff9640 1 -- 172.21.15.50:0/3226860713 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4944005600 con 0x7f494c15db60 2024-09-11T22:23:29.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.976+0000 7f4948ff9640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f493806be30 0x7f493806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:29.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.976+0000 7f4948ff9640 1 -- 172.21.15.50:0/3226860713 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f494408ae00 con 0x7f494c15db60 2024-09-11T22:23:29.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.976+0000 7f494bfff640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f493806be30 0x7f493806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:29.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.978+0000 7f494bfff640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f493806be30 0x7f493806e2f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f493c034000 tx=0x7f493c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:29.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:29.981+0000 7f4948ff9640 1 -- 172.21.15.50:0/3226860713 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49440597b0 con 0x7f494c15db60 2024-09-11T22:23:30.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.157+0000 7f49523d6640 1 -- 172.21.15.50:0/3226860713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f494c0cfc40 con 0x7f494c15db60 2024-09-11T22:23:30.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.158+0000 7f4948ff9640 1 -- 172.21.15.50:0/3226860713 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) ==== 74+0+16716 (secure 0 0 0) 0x7f49440590b0 con 0x7f494c15db60 2024-09-11T22:23:30.159 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:30.159 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":188,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:23:28.886477+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:23:26.537609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-11T22:23:27.864958+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:23:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.161+0000 7f49523d6640 1 -- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f493806be30 msgr2=0x7f493806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.161+0000 7f49523d6640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f493806be30 0x7f493806e2f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f493c034000 tx=0x7f493c02e000 comp rx=0 tx=0).stop 2024-09-11T22:23:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.161+0000 7f49523d6640 1 -- 172.21.15.50:0/3226860713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c15db60 msgr2=0x7f494c13a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.161+0000 7f49523d6640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c15db60 0x7f494c13a5c0 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f494400c760 tx=0x7f494400cc20 comp rx=0 tx=0).stop 2024-09-11T22:23:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.161+0000 7f49523d6640 1 -- 172.21.15.50:0/3226860713 shutdown_connections 2024-09-11T22:23:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.161+0000 7f49523d6640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f493806be30 0x7f493806e2f0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.161+0000 7f49523d6640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f494c15db60 0x7f494c13a5c0 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.161+0000 7f49523d6640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c1463b0 0x7f494c13a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.161+0000 7f49523d6640 1 --2- 172.21.15.50:0/3226860713 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f494c0d0180 0x7f494c141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.161+0000 7f49523d6640 1 -- 172.21.15.50:0/3226860713 >> 172.21.15.50:0/3226860713 conn(0x7f494c068240 msgr2=0x7f494c15e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.161+0000 7f49523d6640 1 -- 172.21.15.50:0/3226860713 shutdown_connections 2024-09-11T22:23:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.161+0000 7f49523d6640 1 -- 172.21.15.50:0/3226860713 wait complete. 2024-09-11T22:23:30.173 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:23:30.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.277+0000 7fd7c4d52640 1 Processor -- start 2024-09-11T22:23:30.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.277+0000 7fd7c4d52640 1 -- start start 2024-09-11T22:23:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.278+0000 7fd7c4d52640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd7c00cf790 0x7fd7c00b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.278+0000 7fd7c4d52640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd7c00d11d0 0x7fd7c00d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.278+0000 7fd7c4d52640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7c0162110 con 0x7fd7c0161d30 2024-09-11T22:23:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.278+0000 7fd7c4d52640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd7c00d3450 con 0x7fd7c00d11d0 2024-09-11T22:23:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.278+0000 7fd7c4d52640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd7c00b7e30 con 0x7fd7c00cf790 2024-09-11T22:23:30.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.278+0000 7fd7bed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd7c00d11d0 0x7fd7c00d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.278+0000 7fd7bed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd7c00d11d0 0x7fd7c00d1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54250/0 (socket says 172.21.15.50:54250) 2024-09-11T22:23:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.278+0000 7fd7bed9d640 1 -- 172.21.15.50:0/3009961931 learned_addr learned my addr 172.21.15.50:0/3009961931 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.278+0000 7fd7bdd9b640 1 --2- 172.21.15.50:0/3009961931 >> v2:172.21.15.77:3300/0 conn(0x7fd7c00cf790 0x7fd7c00b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.279+0000 7fd7bed9d640 1 -- 172.21.15.50:0/3009961931 >> v2:172.21.15.77:3300/0 conn(0x7fd7c00cf790 msgr2=0x7fd7c00b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.279+0000 7fd7bed9d640 1 --2- 172.21.15.50:0/3009961931 >> v2:172.21.15.77:3300/0 conn(0x7fd7c00cf790 0x7fd7c00b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.279+0000 7fd7bed9d640 1 -- 172.21.15.50:0/3009961931 >> v1:172.21.15.77:6789/0 conn(0x7fd7c0161d30 legacy=0x7fd7c0162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:30.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.279+0000 7fd7bed9d640 1 -- 172.21.15.50:0/3009961931 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c00cfd70 con 0x7fd7c00d11d0 2024-09-11T22:23:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.279+0000 7fd7bed9d640 1 --2- 172.21.15.50:0/3009961931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7c00d11d0 0x7fd7c00d1600 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0068730 tx=0x7fd7b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c714da32b7b246cb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.279+0000 7fd7bd59a640 1 -- 172.21.15.50:0/3009961931 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8037070 con 0x7fd7c00d11d0 2024-09-11T22:23:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.279+0000 7fd7bd59a640 1 -- 172.21.15.50:0/3009961931 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b8032440 con 0x7fd7c00d11d0 2024-09-11T22:23:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.279+0000 7fd7bd59a640 1 -- 172.21.15.50:0/3009961931 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8032810 con 0x7fd7c00d11d0 2024-09-11T22:23:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.280+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009961931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7c00d11d0 msgr2=0x7fd7c00d1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:30.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.280+0000 7fd7c4d52640 1 --2- 172.21.15.50:0/3009961931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7c00d11d0 0x7fd7c00d1600 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0068730 tx=0x7fd7b802a270 comp rx=0 tx=0).stop 2024-09-11T22:23:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.280+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009961931 shutdown_connections 2024-09-11T22:23:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.280+0000 7fd7c4d52640 1 --2- 172.21.15.50:0/3009961931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7c00d11d0 0x7fd7c00d1600 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.280+0000 7fd7c4d52640 1 --2- 172.21.15.50:0/3009961931 >> v2:172.21.15.77:3300/0 conn(0x7fd7c00cf790 0x7fd7c00b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.280+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009961931 >> 172.21.15.50:0/3009961931 conn(0x7fd7c00727a0 msgr2=0x7fd7c00679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.280+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009961931 shutdown_connections 2024-09-11T22:23:30.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.280+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009961931 wait complete. 2024-09-11T22:23:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.281+0000 7fd7c4d52640 1 Processor -- start 2024-09-11T22:23:30.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.281+0000 7fd7c4d52640 1 -- start start 2024-09-11T22:23:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.282+0000 7fd7c4d52640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7c00cf790 0x7fd7c00caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.282+0000 7fd7c4d52640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7c00d11d0 0x7fd7c00b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.282+0000 7fd7c4d52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c0161d30 0x7fd7c00b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.282+0000 7fd7c4d52640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c00d2e00 con 0x7fd7c00d11d0 2024-09-11T22:23:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.282+0000 7fd7c4d52640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c00d1b40 con 0x7fd7c0161d30 2024-09-11T22:23:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.282+0000 7fd7c4d52640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c00d30e0 con 0x7fd7c00cf790 2024-09-11T22:23:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.282+0000 7fd7bdd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7c00d11d0 0x7fd7c00b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.282+0000 7fd7bdd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7c00d11d0 0x7fd7c00b6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54258/0 (socket says 172.21.15.50:54258) 2024-09-11T22:23:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.282+0000 7fd7bdd9b640 1 -- 172.21.15.50:0/3009104358 learned_addr learned my addr 172.21.15.50:0/3009104358 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.282+0000 7fd7bed9d640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c0161d30 0x7fd7c00b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.282+0000 7fd7be59c640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7c00cf790 0x7fd7c00caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.283+0000 7fd7bdd9b640 1 -- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7c00cf790 msgr2=0x7fd7c00caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:30.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.283+0000 7fd7bdd9b640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7c00cf790 0x7fd7c00caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.283+0000 7fd7bdd9b640 1 -- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c0161d30 msgr2=0x7fd7c00b7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.283+0000 7fd7bdd9b640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c0161d30 0x7fd7c00b7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.283+0000 7fd7bdd9b640 1 -- 172.21.15.50:0/3009104358 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c00c8800 con 0x7fd7c00d11d0 2024-09-11T22:23:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.283+0000 7fd7bdd9b640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7c00d11d0 0x7fd7c00b6b40 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7fd7a800d800 tx=0x7fd7a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.283+0000 7fd7b6ffd640 1 -- 172.21.15.50:0/3009104358 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a800b6c0 con 0x7fd7c00d11d0 2024-09-11T22:23:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.283+0000 7fd7b6ffd640 1 -- 172.21.15.50:0/3009104358 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a8019070 con 0x7fd7c00d11d0 2024-09-11T22:23:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.283+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009104358 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c00c8ae0 con 0x7fd7c00d11d0 2024-09-11T22:23:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.283+0000 7fd7b6ffd640 1 -- 172.21.15.50:0/3009104358 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a800ba80 con 0x7fd7c00d11d0 2024-09-11T22:23:30.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.283+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009104358 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c00c90a0 con 0x7fd7c00d11d0 2024-09-11T22:23:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.284+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009104358 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c00b78f0 con 0x7fd7c00d11d0 2024-09-11T22:23:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.284+0000 7fd7b6ffd640 1 -- 172.21.15.50:0/3009104358 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7a800bc20 con 0x7fd7c00d11d0 2024-09-11T22:23:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.285+0000 7fd7b6ffd640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd7a006be30 0x7fd7a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.285+0000 7fd7b6ffd640 1 -- 172.21.15.50:0/3009104358 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fd7a808b160 con 0x7fd7c00d11d0 2024-09-11T22:23:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.285+0000 7fd7be59c640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd7a006be30 0x7fd7a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.286+0000 7fd7be59c640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd7a006be30 0x7fd7a006e2f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0001e70 tx=0x7fd7b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:30.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.289+0000 7fd7b6ffd640 1 -- 172.21.15.50:0/3009104358 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7a8059550 con 0x7fd7c00d11d0 2024-09-11T22:23:30.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.500+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009104358 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd7c01f4750 con 0x7fd7c00d11d0 2024-09-11T22:23:30.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.527+0000 7fd7b6ffd640 1 -- 172.21.15.50:0/3009104358 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v136) ==== 118+0+0 (secure 0 0 0) 0x7fd7a805d850 con 0x7fd7c00d11d0 2024-09-11T22:23:30.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.529+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd7a006be30 msgr2=0x7fd7a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:30.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.529+0000 7fd7c4d52640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd7a006be30 0x7fd7a006e2f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0001e70 tx=0x7fd7b0009040 comp rx=0 tx=0).stop 2024-09-11T22:23:30.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.529+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009104358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7c00d11d0 msgr2=0x7fd7c00b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:30.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.529+0000 7fd7c4d52640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7c00d11d0 0x7fd7c00b6b40 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7fd7a800d800 tx=0x7fd7a800dcc0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.529+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009104358 shutdown_connections 2024-09-11T22:23:30.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.529+0000 7fd7c4d52640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd7a006be30 0x7fd7a006e2f0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.529+0000 7fd7c4d52640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7c0161d30 0x7fd7c00b7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.529+0000 7fd7c4d52640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7c00d11d0 0x7fd7c00b6b40 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.529+0000 7fd7c4d52640 1 --2- 172.21.15.50:0/3009104358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7c00cf790 0x7fd7c00caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.529+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009104358 >> 172.21.15.50:0/3009104358 conn(0x7fd7c00727a0 msgr2=0x7fd7c00b90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:30.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.530+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009104358 shutdown_connections 2024-09-11T22:23:30.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.530+0000 7fd7c4d52640 1 -- 172.21.15.50:0/3009104358 wait complete. 2024-09-11T22:23:30.542 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T22:23:30.542 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:23:30.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.647+0000 7f05f0959640 1 Processor -- start 2024-09-11T22:23:30.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.647+0000 7f05f0959640 1 -- start start 2024-09-11T22:23:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.648+0000 7f05f0959640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05ec15c3c0 0x7f05ec15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:30.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.648+0000 7f05f0959640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f05ec0680d0 0x7f05ec15f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.648+0000 7f05f0959640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05ec15f7f0 con 0x7f05ec15ec40 2024-09-11T22:23:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.648+0000 7f05f0959640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f05ec06e700 con 0x7f05ec0680d0 2024-09-11T22:23:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.648+0000 7f05f0959640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f05ec15fad0 con 0x7f05ec15c3c0 2024-09-11T22:23:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.649+0000 7f05ead9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f05ec0680d0 0x7f05ec15f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.649+0000 7f05ead9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f05ec0680d0 0x7f05ec15f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54260/0 (socket says 172.21.15.50:54260) 2024-09-11T22:23:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.649+0000 7f05ead9d640 1 -- 172.21.15.50:0/676481238 learned_addr learned my addr 172.21.15.50:0/676481238 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.649+0000 7f05ea59c640 1 --2- 172.21.15.50:0/676481238 >> v2:172.21.15.77:3300/0 conn(0x7f05ec15c3c0 0x7f05ec15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.649+0000 7f05ead9d640 1 -- 172.21.15.50:0/676481238 >> v2:172.21.15.77:3300/0 conn(0x7f05ec15c3c0 msgr2=0x7f05ec15fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.649+0000 7f05ead9d640 1 --2- 172.21.15.50:0/676481238 >> v2:172.21.15.77:3300/0 conn(0x7f05ec15c3c0 0x7f05ec15fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.649+0000 7f05ead9d640 1 -- 172.21.15.50:0/676481238 >> v1:172.21.15.77:6789/0 conn(0x7f05ec15ec40 legacy=0x7f05ec0679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:30.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.649+0000 7f05ead9d640 1 -- 172.21.15.50:0/676481238 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ec06e950 con 0x7f05ec0680d0 2024-09-11T22:23:30.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.650+0000 7f05ead9d640 1 --2- 172.21.15.50:0/676481238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05ec0680d0 0x7f05ec15f0b0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f05ec071b10 tx=0x7f05e402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66be60831e6ca080 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.650+0000 7f05e959a640 1 -- 172.21.15.50:0/676481238 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e4036070 con 0x7f05ec0680d0 2024-09-11T22:23:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.650+0000 7f05e959a640 1 -- 172.21.15.50:0/676481238 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e4031600 con 0x7f05ec0680d0 2024-09-11T22:23:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.650+0000 7f05e959a640 1 -- 172.21.15.50:0/676481238 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e40319d0 con 0x7f05ec0680d0 2024-09-11T22:23:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.650+0000 7f05f0959640 1 -- 172.21.15.50:0/676481238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05ec0680d0 msgr2=0x7f05ec15f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.650+0000 7f05f0959640 1 --2- 172.21.15.50:0/676481238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05ec0680d0 0x7f05ec15f0b0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f05ec071b10 tx=0x7f05e402a660 comp rx=0 tx=0).stop 2024-09-11T22:23:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.650+0000 7f05f0959640 1 -- 172.21.15.50:0/676481238 shutdown_connections 2024-09-11T22:23:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.650+0000 7f05f0959640 1 --2- 172.21.15.50:0/676481238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05ec0680d0 0x7f05ec15f0b0 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.650+0000 7f05f0959640 1 --2- 172.21.15.50:0/676481238 >> v2:172.21.15.77:3300/0 conn(0x7f05ec15c3c0 0x7f05ec15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.650+0000 7f05f0959640 1 -- 172.21.15.50:0/676481238 >> 172.21.15.50:0/676481238 conn(0x7f05ec075060 msgr2=0x7f05ec06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.650+0000 7f05f0959640 1 -- 172.21.15.50:0/676481238 shutdown_connections 2024-09-11T22:23:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.650+0000 7f05f0959640 1 -- 172.21.15.50:0/676481238 wait complete. 2024-09-11T22:23:30.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.652+0000 7f05f0959640 1 Processor -- start 2024-09-11T22:23:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.652+0000 7f05f0959640 1 -- start start 2024-09-11T22:23:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.652+0000 7f05f0959640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05ec0680d0 0x7f05ec147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.652+0000 7f05f0959640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05ec15c3c0 0x7f05ec147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.652+0000 7f05f0959640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05ec15ec40 0x7f05ec14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.652+0000 7f05f0959640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec06f150 con 0x7f05ec15c3c0 2024-09-11T22:23:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.652+0000 7f05f0959640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec0d0940 con 0x7f05ec0680d0 2024-09-11T22:23:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.652+0000 7f05f0959640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f05ec06f2d0 con 0x7f05ec15ec40 2024-09-11T22:23:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05e9d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05ec15c3c0 0x7f05ec147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05e9d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05ec15c3c0 0x7f05ec147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54264/0 (socket says 172.21.15.50:54264) 2024-09-11T22:23:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05e9d9b640 1 -- 172.21.15.50:0/519329694 learned_addr learned my addr 172.21.15.50:0/519329694 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05ea59c640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05ec0680d0 0x7f05ec147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05ead9d640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05ec15ec40 0x7f05ec14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05e9d9b640 1 -- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05ec15ec40 msgr2=0x7f05ec14b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05e9d9b640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05ec15ec40 0x7f05ec14b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05e9d9b640 1 -- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05ec0680d0 msgr2=0x7f05ec147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05e9d9b640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05ec0680d0 0x7f05ec147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05e9d9b640 1 -- 172.21.15.50:0/519329694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ec14bf50 con 0x7f05ec15c3c0 2024-09-11T22:23:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05e9d9b640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05ec15c3c0 0x7f05ec147870 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f05e000b420 tx=0x7f05e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05daffd640 1 -- 172.21.15.50:0/519329694 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0011830 con 0x7f05ec15c3c0 2024-09-11T22:23:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05daffd640 1 -- 172.21.15.50:0/519329694 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e0016070 con 0x7f05ec15c3c0 2024-09-11T22:23:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05daffd640 1 -- 172.21.15.50:0/519329694 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0011c10 con 0x7f05ec15c3c0 2024-09-11T22:23:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05f0959640 1 -- 172.21.15.50:0/519329694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ec14c230 con 0x7f05ec15c3c0 2024-09-11T22:23:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.653+0000 7f05f0959640 1 -- 172.21.15.50:0/519329694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ec14c7f0 con 0x7f05ec15c3c0 2024-09-11T22:23:30.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.654+0000 7f05f0959640 1 -- 172.21.15.50:0/519329694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ec06cae0 con 0x7f05ec15c3c0 2024-09-11T22:23:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.655+0000 7f05daffd640 1 -- 172.21.15.50:0/519329694 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05e001b460 con 0x7f05ec15c3c0 2024-09-11T22:23:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.655+0000 7f05daffd640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05cc06be30 0x7f05cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.655+0000 7f05daffd640 1 -- 172.21.15.50:0/519329694 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f05e008a880 con 0x7f05ec15c3c0 2024-09-11T22:23:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.656+0000 7f05ea59c640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05cc06be30 0x7f05cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.656+0000 7f05ea59c640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05cc06be30 0x7f05cc06e2f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f05dc006fd0 tx=0x7f05dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.660+0000 7f05daffd640 1 -- 172.21.15.50:0/519329694 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05e0020020 con 0x7f05ec15c3c0 2024-09-11T22:23:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:30.877+0000 7f05f0959640 1 -- 172.21.15.50:0/519329694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f05ec15fe60 con 0x7f05ec15c3c0 2024-09-11T22:23:31.512 INFO:tasks.ceph.mds.c.smithi050.stderr:2024-09-11T22:23:31.509+0000 7fd41e5ec640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:23:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.534+0000 7f05daffd640 1 -- 172.21.15.50:0/519329694 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v137) ==== 122+0+0 (secure 0 0 0) 0x7f05e0058b40 con 0x7f05ec15c3c0 2024-09-11T22:23:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.537+0000 7f05f0959640 1 -- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05cc06be30 msgr2=0x7f05cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.537+0000 7f05f0959640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05cc06be30 0x7f05cc06e2f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f05dc006fd0 tx=0x7f05dc008040 comp rx=0 tx=0).stop 2024-09-11T22:23:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.537+0000 7f05f0959640 1 -- 172.21.15.50:0/519329694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05ec15c3c0 msgr2=0x7f05ec147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.537+0000 7f05f0959640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05ec15c3c0 0x7f05ec147870 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f05e000b420 tx=0x7f05e000b8e0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.537+0000 7f05f0959640 1 -- 172.21.15.50:0/519329694 shutdown_connections 2024-09-11T22:23:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.537+0000 7f05f0959640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f05cc06be30 0x7f05cc06e2f0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.537+0000 7f05f0959640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05ec15ec40 0x7f05ec14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.537+0000 7f05f0959640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05ec15c3c0 0x7f05ec147870 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.537+0000 7f05f0959640 1 --2- 172.21.15.50:0/519329694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05ec0680d0 0x7f05ec147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.537+0000 7f05f0959640 1 -- 172.21.15.50:0/519329694 >> 172.21.15.50:0/519329694 conn(0x7f05ec075060 msgr2=0x7f05ec0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.537+0000 7f05f0959640 1 -- 172.21.15.50:0/519329694 shutdown_connections 2024-09-11T22:23:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.537+0000 7f05f0959640 1 -- 172.21.15.50:0/519329694 wait complete. 2024-09-11T22:23:31.552 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:23:31.553 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:23:31.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.661+0000 7f0e1fd52640 1 Processor -- start 2024-09-11T22:23:31.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.661+0000 7f0e1fd52640 1 -- start start 2024-09-11T22:23:31.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.662+0000 7f0e1fd52640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0e18162940 0x7f0e1806e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:31.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.662+0000 7f0e1fd52640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e180b44a0 con 0x7f0e180d0930 2024-09-11T22:23:31.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.662+0000 7f0e1fd52640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e180b3400 con 0x7f0e1806ec50 2024-09-11T22:23:31.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.662+0000 7f0e1fd52640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0e180b36e0 con 0x7f0e18162940 2024-09-11T22:23:31.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.662+0000 7f0e1e2ef640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0e180d0930 0x7f0e18071030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53564/0 (socket says 172.21.15.50:53564) 2024-09-11T22:23:31.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.662+0000 7f0e1e2ef640 1 -- 172.21.15.50:0/2823387671 learned_addr learned my addr 172.21.15.50:0/2823387671 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.662+0000 7f0e1daee640 1 --2- 172.21.15.50:0/2823387671 >> v2:172.21.15.77:3300/0 conn(0x7f0e18162940 0x7f0e1806e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.662+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2142201648 0 0) 0x7f0e180b44a0 con 0x7f0e180d0930 2024-09-11T22:23:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.662+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e00003520 con 0x7f0e180d0930 2024-09-11T22:23:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 614382587 0 0) 0x7f0e00003520 con 0x7f0e180d0930 2024-09-11T22:23:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 >> v2:172.21.15.77:3300/0 conn(0x7f0e18162940 msgr2=0x7f0e1806e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1caec640 1 --2- 172.21.15.50:0/2823387671 >> v2:172.21.15.77:3300/0 conn(0x7f0e18162940 0x7f0e1806e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 >> v1:172.21.15.77:6789/0 conn(0x7f0e1806ec50 legacy=0x7f0e180d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e180b39c0 con 0x7f0e180d0930 2024-09-11T22:23:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f0e080019f0 con 0x7f0e180d0930 2024-09-11T22:23:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 >> v1:172.21.15.50:6789/0 conn(0x7f0e180d0930 legacy=0x7f0e18071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1caec640 1 --2- 172.21.15.50:0/2823387671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e000039b0 0x7f0e00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1caec640 1 --2- 172.21.15.50:0/2823387671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00004800 0x7f0e00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1caec640 1 --2- 172.21.15.50:0/2823387671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e000051c0 0x7f0e0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0e180b36e0 con 0x7f0e00004800 2024-09-11T22:23:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0000c060 con 0x7f0e000051c0 2024-09-11T22:23:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0e0000c260 con 0x7f0e000039b0 2024-09-11T22:23:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1d2ed640 1 --2- 172.21.15.50:0/2823387671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00004800 0x7f0e00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1daee640 1 --2- 172.21.15.50:0/2823387671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e000039b0 0x7f0e00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1e2ef640 1 --2- 172.21.15.50:0/2823387671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e000051c0 0x7f0e0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1d2ed640 1 -- 172.21.15.50:0/2823387671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e000039b0 msgr2=0x7f0e00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1d2ed640 1 --2- 172.21.15.50:0/2823387671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e000039b0 0x7f0e00003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1d2ed640 1 -- 172.21.15.50:0/2823387671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e000051c0 msgr2=0x7f0e0000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1d2ed640 1 --2- 172.21.15.50:0/2823387671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e000051c0 0x7f0e0000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1d2ed640 1 -- 172.21.15.50:0/2823387671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e00003520 con 0x7f0e00004800 2024-09-11T22:23:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.663+0000 7f0e1e2ef640 1 -- 172.21.15.50:0/2823387671 reap_dead start 2024-09-11T22:23:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.664+0000 7f0e1d2ed640 1 --2- 172.21.15.50:0/2823387671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00004800 0x7f0e00004c80 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c001750 tx=0x7f0e00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd400e687be9453 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.664+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c001370 con 0x7f0e00004800 2024-09-11T22:23:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.664+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0c0052d0 con 0x7f0e00004800 2024-09-11T22:23:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.664+0000 7f0e1caec640 1 -- 172.21.15.50:0/2823387671 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c02abc0 con 0x7f0e00004800 2024-09-11T22:23:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.665+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2823387671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00004800 msgr2=0x7f0e00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.665+0000 7f0e1fd52640 1 --2- 172.21.15.50:0/2823387671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00004800 0x7f0e00004c80 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c001750 tx=0x7f0e00005830 comp rx=0 tx=0).stop 2024-09-11T22:23:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.665+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2823387671 shutdown_connections 2024-09-11T22:23:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.665+0000 7f0e1fd52640 1 --2- 172.21.15.50:0/2823387671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00004800 0x7f0e00004c80 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.665+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2823387671 >> 172.21.15.50:0/2823387671 conn(0x7f0e180679c0 msgr2=0x7f0e18067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.665+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2823387671 shutdown_connections 2024-09-11T22:23:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.665+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2823387671 wait complete. 2024-09-11T22:23:31.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.666+0000 7f0e1fd52640 1 Processor -- start 2024-09-11T22:23:31.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.666+0000 7f0e1fd52640 1 -- start start 2024-09-11T22:23:31.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1fd52640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00004800 0x7f0e181f9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:31.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1fd52640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e181f9350 0x7f0e18157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:31.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1fd52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e18071ac0 0x7f0e18071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:31.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1fd52640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1806f0c0 con 0x7f0e00004800 2024-09-11T22:23:31.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1fd52640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0e180b3f80 con 0x7f0e18071ac0 2024-09-11T22:23:31.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1fd52640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0e18162d20 con 0x7f0e181f9350 2024-09-11T22:23:31.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1daee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00004800 0x7f0e181f9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:31.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1daee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00004800 0x7f0e181f9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54274/0 (socket says 172.21.15.50:54274) 2024-09-11T22:23:31.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1daee640 1 -- 172.21.15.50:0/2682131839 learned_addr learned my addr 172.21.15.50:0/2682131839 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:31.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1e2ef640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e18071ac0 0x7f0e18071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:31.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1d2ed640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e181f9350 0x7f0e18157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1daee640 1 -- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e181f9350 msgr2=0x7f0e18157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1daee640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e181f9350 0x7f0e18157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1daee640 1 -- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e18071ac0 msgr2=0x7f0e18071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1daee640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e18071ac0 0x7f0e18071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1daee640 1 -- 172.21.15.50:0/2682131839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e18159450 con 0x7f0e00004800 2024-09-11T22:23:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1daee640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00004800 0x7f0e181f9a90 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f0e10011890 tx=0x7f0e10011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e167fc640 1 -- 172.21.15.50:0/2682131839 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10019070 con 0x7f0e00004800 2024-09-11T22:23:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e167fc640 1 -- 172.21.15.50:0/2682131839 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e10004240 con 0x7f0e00004800 2024-09-11T22:23:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2682131839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e18159730 con 0x7f0e00004800 2024-09-11T22:23:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e167fc640 1 -- 172.21.15.50:0/2682131839 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1000f820 con 0x7f0e00004800 2024-09-11T22:23:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.667+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2682131839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e18159cf0 con 0x7f0e00004800 2024-09-11T22:23:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.669+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2682131839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1806e710 con 0x7f0e00004800 2024-09-11T22:23:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.669+0000 7f0e167fc640 1 -- 172.21.15.50:0/2682131839 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e1001c070 con 0x7f0e00004800 2024-09-11T22:23:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.669+0000 7f0e167fc640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e0406be30 0x7f0e0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.670+0000 7f0e167fc640 1 -- 172.21.15.50:0/2682131839 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f0e1008b310 con 0x7f0e00004800 2024-09-11T22:23:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.670+0000 7f0e1d2ed640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e0406be30 0x7f0e0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.670+0000 7f0e1d2ed640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e0406be30 0x7f0e0406e2f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c032000 tx=0x7f0e0c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.674+0000 7f0e167fc640 1 -- 172.21.15.50:0/2682131839 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e10059cc0 con 0x7f0e00004800 2024-09-11T22:23:31.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.886+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2682131839 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e18161780 con 0x7f0e00004800 2024-09-11T22:23:31.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.886+0000 7f0e167fc640 1 -- 172.21.15.50:0/2682131839 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) ==== 95+0+5232 (secure 0 0 0) 0x7f0e100595c0 con 0x7f0e00004800 2024-09-11T22:23:31.887 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:31.887 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":137,"btime":"2024-09-11T22:23:31:534171+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8441,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/15411963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":15411963},{"type":"v1","addr":"172.21.15.50:6833","nonce":15411963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":8450,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1953468151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1953468151},{"type":"v1","addr":"172.21.15.77:6836","nonce":1953468151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":8453,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3577421742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3577421742},{"type":"v1","addr":"172.21.15.77:6837","nonce":3577421742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134}],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:23:28.886790+0000","modified":"2024-09-11T22:23:30.878557+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10734":{"gid":10734,"name":"c","rank":0,"incarnation":135,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2876091212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2876091212},{"type":"v1","addr":"172.21.15.50:6835","nonce":2876091212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10734,"qdb_cluster":[10734]},"id":14}]} 2024-09-11T22:23:31.887 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 137 2024-09-11T22:23:31.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.888+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e0406be30 msgr2=0x7f0e0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:31.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.888+0000 7f0e1fd52640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e0406be30 0x7f0e0406e2f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c032000 tx=0x7f0e0c02e000 comp rx=0 tx=0).stop 2024-09-11T22:23:31.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.888+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2682131839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00004800 msgr2=0x7f0e181f9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:31.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.888+0000 7f0e1fd52640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00004800 0x7f0e181f9a90 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f0e10011890 tx=0x7f0e10011d50 comp rx=0 tx=0).stop 2024-09-11T22:23:31.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.888+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2682131839 shutdown_connections 2024-09-11T22:23:31.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.888+0000 7f0e1fd52640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0e0406be30 0x7f0e0406e2f0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.888+0000 7f0e1fd52640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e181f9350 0x7f0e18157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.888+0000 7f0e1fd52640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e18071ac0 0x7f0e18071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.888+0000 7f0e1fd52640 1 --2- 172.21.15.50:0/2682131839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e00004800 0x7f0e181f9a90 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.888+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2682131839 >> 172.21.15.50:0/2682131839 conn(0x7f0e180679c0 msgr2=0x7f0e180b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.888+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2682131839 shutdown_connections 2024-09-11T22:23:31.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:31.888+0000 7f0e1fd52640 1 -- 172.21.15.50:0/2682131839 wait complete. 2024-09-11T22:23:31.900 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:23:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.001+0000 7f89e7e3c640 1 Processor -- start 2024-09-11T22:23:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.001+0000 7f89e7e3c640 1 -- start start 2024-09-11T22:23:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e7e3c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f89e00735a0 0x7f89e015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e7e3c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e00b4e80 con 0x7f89e015f0e0 2024-09-11T22:23:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e7e3c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e015c620 con 0x7f89e015c240 2024-09-11T22:23:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e7e3c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f89e015f560 con 0x7f89e00735a0 2024-09-11T22:23:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e63d9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f89e015f0e0 0x7f89e00728e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53576/0 (socket says 172.21.15.50:53576) 2024-09-11T22:23:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e63d9640 1 -- 172.21.15.50:0/4028233869 learned_addr learned my addr 172.21.15.50:0/4028233869 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e53d7640 1 --2- 172.21.15.50:0/4028233869 >> v2:172.21.15.77:3300/0 conn(0x7f89e00735a0 0x7f89e015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e4bd6640 1 -- 172.21.15.50:0/4028233869 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483082317 0 0) 0x7f89e00b4e80 con 0x7f89e015f0e0 2024-09-11T22:23:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e4bd6640 1 -- 172.21.15.50:0/4028233869 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89cc003520 con 0x7f89e015f0e0 2024-09-11T22:23:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e4bd6640 1 -- 172.21.15.50:0/4028233869 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932125043 0 0) 0x7f89e015c620 con 0x7f89e015c240 2024-09-11T22:23:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e4bd6640 1 -- 172.21.15.50:0/4028233869 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89e00b4e80 con 0x7f89e015c240 2024-09-11T22:23:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e4bd6640 1 -- 172.21.15.50:0/4028233869 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3424129229 0 0) 0x7f89cc003520 con 0x7f89e015f0e0 2024-09-11T22:23:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e53d7640 1 -- 172.21.15.50:0/4028233869 >> v1:172.21.15.77:6789/0 conn(0x7f89e015c240 legacy=0x7f89e00b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.002+0000 7f89e53d7640 1 -- 172.21.15.50:0/4028233869 >> v1:172.21.15.50:6789/0 conn(0x7f89e015f0e0 legacy=0x7f89e00728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.003+0000 7f89e53d7640 1 -- 172.21.15.50:0/4028233869 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e015f840 con 0x7f89e00735a0 2024-09-11T22:23:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.003+0000 7f89e53d7640 1 --2- 172.21.15.50:0/4028233869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e00735a0 0x7f89e015eba0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f89d00097a0 tx=0x7f89d002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5682979cd55689b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.004+0000 7f89e4bd6640 1 -- 172.21.15.50:0/4028233869 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0037070 con 0x7f89e00735a0 2024-09-11T22:23:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.004+0000 7f89e4bd6640 1 -- 172.21.15.50:0/4028233869 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d002ac50 con 0x7f89e00735a0 2024-09-11T22:23:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.004+0000 7f89e4bd6640 1 -- 172.21.15.50:0/4028233869 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d80019f0 con 0x7f89e00735a0 2024-09-11T22:23:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.004+0000 7f89e7e3c640 1 -- 172.21.15.50:0/4028233869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e00735a0 msgr2=0x7f89e015eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.004+0000 7f89e7e3c640 1 --2- 172.21.15.50:0/4028233869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e00735a0 0x7f89e015eba0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f89d00097a0 tx=0x7f89d002a1c0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.004+0000 7f89e7e3c640 1 -- 172.21.15.50:0/4028233869 shutdown_connections 2024-09-11T22:23:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.004+0000 7f89e7e3c640 1 --2- 172.21.15.50:0/4028233869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e00735a0 0x7f89e015eba0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.004+0000 7f89e7e3c640 1 -- 172.21.15.50:0/4028233869 >> 172.21.15.50:0/4028233869 conn(0x7f89e00b2bd0 msgr2=0x7f89e00b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.004+0000 7f89e7e3c640 1 -- 172.21.15.50:0/4028233869 shutdown_connections 2024-09-11T22:23:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.004+0000 7f89e7e3c640 1 -- 172.21.15.50:0/4028233869 wait complete. 2024-09-11T22:23:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.005+0000 7f89e7e3c640 1 Processor -- start 2024-09-11T22:23:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.005+0000 7f89e7e3c640 1 -- start start 2024-09-11T22:23:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e7e3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e00735a0 0x7f89e0157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e7e3c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89e015c240 0x7f89e0150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e7e3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e015f0e0 0x7f89e0151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e7e3c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f89e00b4250 con 0x7f89e00735a0 2024-09-11T22:23:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e7e3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89e00b3f70 con 0x7f89e015f0e0 2024-09-11T22:23:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e7e3c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f89e0072ff0 con 0x7f89e015c240 2024-09-11T22:23:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e5bd8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e00735a0 0x7f89e0157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e5bd8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e00735a0 0x7f89e0157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54286/0 (socket says 172.21.15.50:54286) 2024-09-11T22:23:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e5bd8640 1 -- 172.21.15.50:0/3044804742 learned_addr learned my addr 172.21.15.50:0/3044804742 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e53d7640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89e015c240 0x7f89e0150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e63d9640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e015f0e0 0x7f89e0151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e5bd8640 1 -- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89e015c240 msgr2=0x7f89e0150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e5bd8640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89e015c240 0x7f89e0150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e5bd8640 1 -- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e015f0e0 msgr2=0x7f89e0151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.006+0000 7f89e5bd8640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e015f0e0 0x7f89e0151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.007+0000 7f89e5bd8640 1 -- 172.21.15.50:0/3044804742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e00d0180 con 0x7f89e00735a0 2024-09-11T22:23:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.007+0000 7f89e53d7640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89e015c240 0x7f89e0150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.007+0000 7f89e63d9640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e015f0e0 0x7f89e0151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.007+0000 7f89e5bd8640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e00735a0 0x7f89e0157b40 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00c490 tx=0x7f89dc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.007+0000 7f89d67fc640 1 -- 172.21.15.50:0/3044804742 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc0052d0 con 0x7f89e00735a0 2024-09-11T22:23:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.007+0000 7f89d67fc640 1 -- 172.21.15.50:0/3044804742 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89dc005470 con 0x7f89e00735a0 2024-09-11T22:23:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.007+0000 7f89e7e3c640 1 -- 172.21.15.50:0/3044804742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e0151c10 con 0x7f89e00735a0 2024-09-11T22:23:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.007+0000 7f89d67fc640 1 -- 172.21.15.50:0/3044804742 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc012850 con 0x7f89e00735a0 2024-09-11T22:23:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.007+0000 7f89e7e3c640 1 -- 172.21.15.50:0/3044804742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e01521d0 con 0x7f89e00735a0 2024-09-11T22:23:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.008+0000 7f89e7e3c640 1 -- 172.21.15.50:0/3044804742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e015eba0 con 0x7f89e00735a0 2024-09-11T22:23:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.008+0000 7f89d67fc640 1 -- 172.21.15.50:0/3044804742 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89dc0129f0 con 0x7f89e00735a0 2024-09-11T22:23:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.009+0000 7f89d67fc640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f89c406be30 0x7f89c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.009+0000 7f89d67fc640 1 -- 172.21.15.50:0/3044804742 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f89dc08aac0 con 0x7f89e00735a0 2024-09-11T22:23:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.009+0000 7f89e53d7640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f89c406be30 0x7f89c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.010+0000 7f89e53d7640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f89c406be30 0x7f89c406e2f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f89d0034000 tx=0x7f89d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:32.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.013+0000 7f89d67fc640 1 -- 172.21.15.50:0/3044804742 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89dc059500 con 0x7f89e00735a0 2024-09-11T22:23:32.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.191+0000 7f89e7e3c640 1 -- 172.21.15.50:0/3044804742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89e015e700 con 0x7f89e00735a0 2024-09-11T22:23:32.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.192+0000 7f89d67fc640 1 -- 172.21.15.50:0/3044804742 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) ==== 74+0+16703 (secure 0 0 0) 0x7f89dc058e00 con 0x7f89e00735a0 2024-09-11T22:23:32.193 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:32.193 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":189,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:23:30.517550+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:23:26.537609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-11T22:23:27.864958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:23:32.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.194+0000 7f89e7e3c640 1 -- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f89c406be30 msgr2=0x7f89c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.194+0000 7f89e7e3c640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f89c406be30 0x7f89c406e2f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f89d0034000 tx=0x7f89d002e000 comp rx=0 tx=0).stop 2024-09-11T22:23:32.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.194+0000 7f89e7e3c640 1 -- 172.21.15.50:0/3044804742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e00735a0 msgr2=0x7f89e0157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.194+0000 7f89e7e3c640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e00735a0 0x7f89e0157b40 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00c490 tx=0x7f89dc00c950 comp rx=0 tx=0).stop 2024-09-11T22:23:32.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.194+0000 7f89e7e3c640 1 -- 172.21.15.50:0/3044804742 shutdown_connections 2024-09-11T22:23:32.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.194+0000 7f89e7e3c640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f89c406be30 0x7f89c406e2f0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.194+0000 7f89e7e3c640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89e015c240 0x7f89e0150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.194+0000 7f89e7e3c640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89e015f0e0 0x7f89e0151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.194+0000 7f89e7e3c640 1 --2- 172.21.15.50:0/3044804742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89e00735a0 0x7f89e0157b40 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.194+0000 7f89e7e3c640 1 -- 172.21.15.50:0/3044804742 >> 172.21.15.50:0/3044804742 conn(0x7f89e00b2bd0 msgr2=0x7f89e015d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:32.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.194+0000 7f89e7e3c640 1 -- 172.21.15.50:0/3044804742 shutdown_connections 2024-09-11T22:23:32.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.194+0000 7f89e7e3c640 1 -- 172.21.15.50:0/3044804742 wait complete. 2024-09-11T22:23:32.206 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:23:32.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:23:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.308+0000 7faf2b01e640 1 Processor -- start 2024-09-11T22:23:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.308+0000 7faf2b01e640 1 -- start start 2024-09-11T22:23:32.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf2b01e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf2415b400 0x7faf2406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf2b01e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faf24072e60 0x7faf2406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf2b01e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf2406df20 0x7faf240b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf2b01e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7faf2406e390 con 0x7faf2406df20 2024-09-11T22:23:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf2b01e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7faf2415b7e0 con 0x7faf24072e60 2024-09-11T22:23:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf2b01e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faf2415f140 con 0x7faf2415b400 2024-09-11T22:23:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf295bb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf2406df20 0x7faf240b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf295bb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf2406df20 0x7faf240b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54292/0 (socket says 172.21.15.50:54292) 2024-09-11T22:23:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf295bb640 1 -- 172.21.15.50:0/4121043154 learned_addr learned my addr 172.21.15.50:0/4121043154 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf28dba640 1 --2- 172.21.15.50:0/4121043154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf2415b400 0x7faf2406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf23fff640 1 --2- 172.21.15.50:0/4121043154 >> v2:172.21.15.77:3300/0 conn(0x7faf24072e60 0x7faf2406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf295bb640 1 -- 172.21.15.50:0/4121043154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf2415b400 msgr2=0x7faf2406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf295bb640 1 --2- 172.21.15.50:0/4121043154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf2415b400 0x7faf2406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.309+0000 7faf295bb640 1 -- 172.21.15.50:0/4121043154 >> v2:172.21.15.77:3300/0 conn(0x7faf24072e60 msgr2=0x7faf2406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.310+0000 7faf295bb640 1 --2- 172.21.15.50:0/4121043154 >> v2:172.21.15.77:3300/0 conn(0x7faf24072e60 0x7faf2406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.310+0000 7faf295bb640 1 -- 172.21.15.50:0/4121043154 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2415f420 con 0x7faf2406df20 2024-09-11T22:23:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.310+0000 7faf23fff640 1 --2- 172.21.15.50:0/4121043154 >> v2:172.21.15.77:3300/0 conn(0x7faf24072e60 0x7faf2406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.310+0000 7faf28dba640 1 --2- 172.21.15.50:0/4121043154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf2415b400 0x7faf2406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.310+0000 7faf295bb640 1 --2- 172.21.15.50:0/4121043154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf2406df20 0x7faf240b4610 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7faf240b5850 tx=0x7faf0c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5cc97537ed327d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.310+0000 7faf237fe640 1 -- 172.21.15.50:0/4121043154 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c032790 con 0x7faf2406df20 2024-09-11T22:23:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.310+0000 7faf237fe640 1 -- 172.21.15.50:0/4121043154 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0c038070 con 0x7faf2406df20 2024-09-11T22:23:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.310+0000 7faf237fe640 1 -- 172.21.15.50:0/4121043154 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c032b50 con 0x7faf2406df20 2024-09-11T22:23:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.311+0000 7faf2b01e640 1 -- 172.21.15.50:0/4121043154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf2406df20 msgr2=0x7faf240b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.311+0000 7faf2b01e640 1 --2- 172.21.15.50:0/4121043154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf2406df20 0x7faf240b4610 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7faf240b5850 tx=0x7faf0c02c890 comp rx=0 tx=0).stop 2024-09-11T22:23:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.311+0000 7faf2b01e640 1 -- 172.21.15.50:0/4121043154 shutdown_connections 2024-09-11T22:23:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.311+0000 7faf2b01e640 1 --2- 172.21.15.50:0/4121043154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf2406df20 0x7faf240b4610 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.311+0000 7faf2b01e640 1 --2- 172.21.15.50:0/4121043154 >> v2:172.21.15.77:3300/0 conn(0x7faf24072e60 0x7faf2406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.311+0000 7faf2b01e640 1 --2- 172.21.15.50:0/4121043154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf2415b400 0x7faf2406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.311+0000 7faf2b01e640 1 -- 172.21.15.50:0/4121043154 >> 172.21.15.50:0/4121043154 conn(0x7faf240679c0 msgr2=0x7faf24067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.311+0000 7faf2b01e640 1 -- 172.21.15.50:0/4121043154 shutdown_connections 2024-09-11T22:23:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.311+0000 7faf2b01e640 1 -- 172.21.15.50:0/4121043154 wait complete. 2024-09-11T22:23:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.312+0000 7faf2b01e640 1 Processor -- start 2024-09-11T22:23:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.312+0000 7faf2b01e640 1 -- start start 2024-09-11T22:23:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.313+0000 7faf2b01e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf2406df20 0x7faf24143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.313+0000 7faf2b01e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf24072e60 0x7faf24152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.313+0000 7faf2b01e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf2415b400 0x7faf240b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.313+0000 7faf2b01e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faf240cfc50 con 0x7faf2406df20 2024-09-11T22:23:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.313+0000 7faf2b01e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf2415f9e0 con 0x7faf24072e60 2024-09-11T22:23:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.313+0000 7faf2b01e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faf240b4b50 con 0x7faf2415b400 2024-09-11T22:23:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.313+0000 7faf28dba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf2406df20 0x7faf24143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.313+0000 7faf28dba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf2406df20 0x7faf24143dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54308/0 (socket says 172.21.15.50:54308) 2024-09-11T22:23:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.313+0000 7faf28dba640 1 -- 172.21.15.50:0/2438219969 learned_addr learned my addr 172.21.15.50:0/2438219969 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.314+0000 7faf28dba640 1 -- 172.21.15.50:0/2438219969 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf2415b400 msgr2=0x7faf240b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.314+0000 7faf28dba640 1 --2- 172.21.15.50:0/2438219969 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf2415b400 0x7faf240b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.314+0000 7faf28dba640 1 -- 172.21.15.50:0/2438219969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf24072e60 msgr2=0x7faf24152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.314+0000 7faf23fff640 1 --2- 172.21.15.50:0/2438219969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf24072e60 0x7faf24152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.314+0000 7faf28dba640 1 --2- 172.21.15.50:0/2438219969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf24072e60 0x7faf24152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.314+0000 7faf28dba640 1 -- 172.21.15.50:0/2438219969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf240afd20 con 0x7faf2406df20 2024-09-11T22:23:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.314+0000 7faf28dba640 1 --2- 172.21.15.50:0/2438219969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf2406df20 0x7faf24143dd0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00ce00 tx=0x7faf1c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.314+0000 7faf217fa640 1 -- 172.21.15.50:0/2438219969 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00f890 con 0x7faf2406df20 2024-09-11T22:23:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.314+0000 7faf217fa640 1 -- 172.21.15.50:0/2438219969 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1c00fa30 con 0x7faf2406df20 2024-09-11T22:23:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.314+0000 7faf217fa640 1 -- 172.21.15.50:0/2438219969 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00fe40 con 0x7faf2406df20 2024-09-11T22:23:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.314+0000 7faf2b01e640 1 -- 172.21.15.50:0/2438219969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf241443b0 con 0x7faf2406df20 2024-09-11T22:23:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.314+0000 7faf2b01e640 1 -- 172.21.15.50:0/2438219969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf24144970 con 0x7faf2406df20 2024-09-11T22:23:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.315+0000 7faf2b01e640 1 -- 172.21.15.50:0/2438219969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf2406d9e0 con 0x7faf2406df20 2024-09-11T22:23:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.316+0000 7faf217fa640 1 -- 172.21.15.50:0/2438219969 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf1c018400 con 0x7faf2406df20 2024-09-11T22:23:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.316+0000 7faf217fa640 1 --2- 172.21.15.50:0/2438219969 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faf0406be60 0x7faf0406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.316+0000 7faf217fa640 1 -- 172.21.15.50:0/2438219969 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7faf1c08bcb0 con 0x7faf2406df20 2024-09-11T22:23:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.316+0000 7faf23fff640 1 --2- 172.21.15.50:0/2438219969 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faf0406be60 0x7faf0406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.317+0000 7faf23fff640 1 --2- 172.21.15.50:0/2438219969 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faf0406be60 0x7faf0406e320 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7faf14006fd0 tx=0x7faf14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.320+0000 7faf217fa640 1 -- 172.21.15.50:0/2438219969 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf1c014030 con 0x7faf2406df20 2024-09-11T22:23:32.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.493+0000 7faf2b01e640 1 -- 172.21.15.50:0/2438219969 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf24069c40 con 0x7faf0406be60 2024-09-11T22:23:32.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.499+0000 7faf217fa640 1 -- 172.21.15.50:0/2438219969 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246154 (secure 0 0 0) 0x7faf24069c40 con 0x7faf0406be60 2024-09-11T22:23:32.503 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:32.505 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:23:32.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.503+0000 7faf2b01e640 1 -- 172.21.15.50:0/2438219969 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faf0406be60 msgr2=0x7faf0406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.503+0000 7faf2b01e640 1 --2- 172.21.15.50:0/2438219969 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faf0406be60 0x7faf0406e320 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7faf14006fd0 tx=0x7faf14008040 comp rx=0 tx=0).stop 2024-09-11T22:23:32.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.503+0000 7faf2b01e640 1 -- 172.21.15.50:0/2438219969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf2406df20 msgr2=0x7faf24143dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.503+0000 7faf2b01e640 1 --2- 172.21.15.50:0/2438219969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf2406df20 0x7faf24143dd0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00ce00 tx=0x7faf1c00a650 comp rx=0 tx=0).stop 2024-09-11T22:23:32.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.503+0000 7faf2b01e640 1 -- 172.21.15.50:0/2438219969 shutdown_connections 2024-09-11T22:23:32.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.503+0000 7faf2b01e640 1 --2- 172.21.15.50:0/2438219969 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7faf0406be60 0x7faf0406e320 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.503+0000 7faf2b01e640 1 --2- 172.21.15.50:0/2438219969 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf2415b400 0x7faf240b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.503+0000 7faf2b01e640 1 --2- 172.21.15.50:0/2438219969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf24072e60 0x7faf24152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.503+0000 7faf2b01e640 1 --2- 172.21.15.50:0/2438219969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf2406df20 0x7faf24143dd0 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.503+0000 7faf2b01e640 1 -- 172.21.15.50:0/2438219969 >> 172.21.15.50:0/2438219969 conn(0x7faf240679c0 msgr2=0x7faf240cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:32.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.503+0000 7faf2b01e640 1 -- 172.21.15.50:0/2438219969 shutdown_connections 2024-09-11T22:23:32.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.503+0000 7faf2b01e640 1 -- 172.21.15.50:0/2438219969 wait complete. 2024-09-11T22:23:32.515 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2024-09-11T22:23:31.542831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":434288,"kb_used_data":19580,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754540432,"statfs":{"total":773094113280,"available":772649402368,"internally_reserved":0,"allocated":20049920,"data_stored":9453427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":424463921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031425"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521815+0000","last_change":"2024-09-11T22:23:28.521815+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521815+0000","last_undegraded":"2024-09-11T22:23:28.521815+0000","last_fullsized":"2024-09-11T22:23:28.521815+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.525336+0000","last_change":"2024-09-11T22:23:28.525336+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.525336+0000","last_undegraded":"2024-09-11T22:23:28.525336+0000","last_fullsized":"2024-09-11T22:23:28.525336+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.529760+0000","last_change":"2024-09-11T22:23:28.529760+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.529760+0000","last_undegraded":"2024-09-11T22:23:28.529760+0000","last_fullsized":"2024-09-11T22:23:28.529760+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527739+0000","last_change":"2024-09-11T22:23:28.527739+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527739+0000","last_undegraded":"2024-09-11T22:23:28.527739+0000","last_fullsized":"2024-09-11T22:23:28.527739+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522938+0000","last_change":"2024-09-11T22:23:28.522938+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522938+0000","last_undegraded":"2024-09-11T22:23:28.522938+0000","last_fullsized":"2024-09-11T22:23:28.522938+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.525322+0000","last_change":"2024-09-11T22:23:28.525322+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.525322+0000","last_undegraded":"2024-09-11T22:23:28.525322+0000","last_fullsized":"2024-09-11T22:23:28.525322+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.541990+0000","last_change":"2024-09-11T22:23:29.526180+0000","last_active":"2024-09-11T22:23:30.541990+0000","last_peered":"2024-09-11T22:23:30.541990+0000","last_clean":"2024-09-11T22:23:30.541990+0000","last_became_active":"2024-09-11T22:23:29.525856+0000","last_became_peered":"2024-09-11T22:23:29.525856+0000","last_unstale":"2024-09-11T22:23:30.541990+0000","last_undegraded":"2024-09-11T22:23:30.541990+0000","last_fullsized":"2024-09-11T22:23:30.541990+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:01.977359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528066+0000","last_change":"2024-09-11T22:23:28.528066+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528066+0000","last_undegraded":"2024-09-11T22:23:28.528066+0000","last_fullsized":"2024-09-11T22:23:28.528066+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522407+0000","last_change":"2024-09-11T22:23:28.522407+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522407+0000","last_undegraded":"2024-09-11T22:23:28.522407+0000","last_fullsized":"2024-09-11T22:23:28.522407+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522074+0000","last_change":"2024-09-11T22:23:28.522074+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522074+0000","last_undegraded":"2024-09-11T22:23:28.522074+0000","last_fullsized":"2024-09-11T22:23:28.522074+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521478+0000","last_change":"2024-09-11T22:23:28.521478+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521478+0000","last_undegraded":"2024-09-11T22:23:28.521478+0000","last_fullsized":"2024-09-11T22:23:28.521478+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520953+0000","last_change":"2024-09-11T22:23:28.520953+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520953+0000","last_undegraded":"2024-09-11T22:23:28.520953+0000","last_fullsized":"2024-09-11T22:23:28.520953+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.529557+0000","last_change":"2024-09-11T22:23:28.529557+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.529557+0000","last_undegraded":"2024-09-11T22:23:28.529557+0000","last_fullsized":"2024-09-11T22:23:28.529557+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521354+0000","last_change":"2024-09-11T22:23:28.521354+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521354+0000","last_undegraded":"2024-09-11T22:23:28.521354+0000","last_fullsized":"2024-09-11T22:23:28.521354+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522057+0000","last_change":"2024-09-11T22:23:28.522057+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522057+0000","last_undegraded":"2024-09-11T22:23:28.522057+0000","last_fullsized":"2024-09-11T22:23:28.522057+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521871+0000","last_change":"2024-09-11T22:23:28.521871+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521871+0000","last_undegraded":"2024-09-11T22:23:28.521871+0000","last_fullsized":"2024-09-11T22:23:28.521871+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527806+0000","last_change":"2024-09-11T22:23:28.527806+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527806+0000","last_undegraded":"2024-09-11T22:23:28.527806+0000","last_fullsized":"2024-09-11T22:23:28.527806+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522410+0000","last_change":"2024-09-11T22:23:28.522410+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522410+0000","last_undegraded":"2024-09-11T22:23:28.522410+0000","last_fullsized":"2024-09-11T22:23:28.522410+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527298+0000","last_change":"2024-09-11T22:23:28.527298+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527298+0000","last_undegraded":"2024-09-11T22:23:28.527298+0000","last_fullsized":"2024-09-11T22:23:28.527298+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528117+0000","last_change":"2024-09-11T22:23:28.528117+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528117+0000","last_undegraded":"2024-09-11T22:23:28.528117+0000","last_fullsized":"2024-09-11T22:23:28.528117+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526592+0000","last_change":"2024-09-11T22:23:28.526592+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526592+0000","last_undegraded":"2024-09-11T22:23:28.526592+0000","last_fullsized":"2024-09-11T22:23:28.526592+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542327+0000","last_change":"2024-09-11T22:23:29.533731+0000","last_active":"2024-09-11T22:23:30.542327+0000","last_peered":"2024-09-11T22:23:30.542327+0000","last_clean":"2024-09-11T22:23:30.542327+0000","last_became_active":"2024-09-11T22:23:29.532721+0000","last_became_peered":"2024-09-11T22:23:29.532721+0000","last_unstale":"2024-09-11T22:23:30.542327+0000","last_undegraded":"2024-09-11T22:23:30.542327+0000","last_fullsized":"2024-09-11T22:23:30.542327+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:01.286972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521958+0000","last_change":"2024-09-11T22:23:28.521958+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521958+0000","last_undegraded":"2024-09-11T22:23:28.521958+0000","last_fullsized":"2024-09-11T22:23:28.521958+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521683+0000","last_change":"2024-09-11T22:23:28.521683+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521683+0000","last_undegraded":"2024-09-11T22:23:28.521683+0000","last_fullsized":"2024-09-11T22:23:28.521683+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.530987+0000","last_change":"2024-09-11T22:23:28.530987+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.530987+0000","last_undegraded":"2024-09-11T22:23:28.530987+0000","last_fullsized":"2024-09-11T22:23:28.530987+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526019+0000","last_change":"2024-09-11T22:23:28.526019+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526019+0000","last_undegraded":"2024-09-11T22:23:28.526019+0000","last_fullsized":"2024-09-11T22:23:28.526019+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.524336+0000","last_change":"2024-09-11T22:23:28.524336+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.524336+0000","last_undegraded":"2024-09-11T22:23:28.524336+0000","last_fullsized":"2024-09-11T22:23:28.524336+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534341+0000","last_change":"2024-09-11T22:23:28.533479+0000","last_active":"2024-09-11T22:23:28.534341+0000","last_peered":"2024-09-11T22:23:28.534341+0000","last_clean":"2024-09-11T22:23:28.534341+0000","last_became_active":"2024-09-11T22:23:28.533187+0000","last_became_peered":"2024-09-11T22:23:28.533187+0000","last_unstale":"2024-09-11T22:23:28.534341+0000","last_undegraded":"2024-09-11T22:23:28.534341+0000","last_fullsized":"2024-09-11T22:23:28.534341+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:52.004425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542369+0000","last_change":"2024-09-11T22:23:29.536415+0000","last_active":"2024-09-11T22:23:30.542369+0000","last_peered":"2024-09-11T22:23:30.542369+0000","last_clean":"2024-09-11T22:23:30.542369+0000","last_became_active":"2024-09-11T22:23:29.536111+0000","last_became_peered":"2024-09-11T22:23:29.536111+0000","last_unstale":"2024-09-11T22:23:30.542369+0000","last_undegraded":"2024-09-11T22:23:30.542369+0000","last_fullsized":"2024-09-11T22:23:30.542369+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:47.495340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531316+0000","last_change":"2024-09-11T22:23:28.530365+0000","last_active":"2024-09-11T22:23:28.531316+0000","last_peered":"2024-09-11T22:23:28.531316+0000","last_clean":"2024-09-11T22:23:28.531316+0000","last_became_active":"2024-09-11T22:23:28.530069+0000","last_became_peered":"2024-09-11T22:23:28.530069+0000","last_unstale":"2024-09-11T22:23:28.531316+0000","last_undegraded":"2024-09-11T22:23:28.531316+0000","last_fullsized":"2024-09-11T22:23:28.531316+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:23.081602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520583+0000","last_change":"2024-09-11T22:23:28.520583+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520583+0000","last_undegraded":"2024-09-11T22:23:28.520583+0000","last_fullsized":"2024-09-11T22:23:28.520583+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.529721+0000","last_change":"2024-09-11T22:23:28.528837+0000","last_active":"2024-09-11T22:23:28.529721+0000","last_peered":"2024-09-11T22:23:28.529721+0000","last_clean":"2024-09-11T22:23:28.529721+0000","last_became_active":"2024-09-11T22:23:28.528534+0000","last_became_peered":"2024-09-11T22:23:28.528534+0000","last_unstale":"2024-09-11T22:23:28.529721+0000","last_undegraded":"2024-09-11T22:23:28.529721+0000","last_fullsized":"2024-09-11T22:23:28.529721+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:54.377250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1b","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542149+0000","last_change":"2024-09-11T22:23:28.527628+0000","last_active":"2024-09-11T22:23:30.542149+0000","last_peered":"2024-09-11T22:23:30.542149+0000","last_clean":"2024-09-11T22:23:30.542149+0000","last_became_active":"2024-09-11T22:23:28.527319+0000","last_became_peered":"2024-09-11T22:23:28.527319+0000","last_unstale":"2024-09-11T22:23:30.542149+0000","last_undegraded":"2024-09-11T22:23:30.542149+0000","last_fullsized":"2024-09-11T22:23:30.542149+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:25.526650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526841+0000","last_change":"2024-09-11T22:23:28.526841+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526841+0000","last_undegraded":"2024-09-11T22:23:28.526841+0000","last_fullsized":"2024-09-11T22:23:28.526841+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.532396+0000","last_change":"2024-09-11T22:23:28.531543+0000","last_active":"2024-09-11T22:23:28.532396+0000","last_peered":"2024-09-11T22:23:28.532396+0000","last_clean":"2024-09-11T22:23:28.532396+0000","last_became_active":"2024-09-11T22:23:28.531271+0000","last_became_peered":"2024-09-11T22:23:28.531271+0000","last_unstale":"2024-09-11T22:23:28.532396+0000","last_undegraded":"2024-09-11T22:23:28.532396+0000","last_fullsized":"2024-09-11T22:23:28.532396+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:00.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521842+0000","last_change":"2024-09-11T22:23:28.521842+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521842+0000","last_undegraded":"2024-09-11T22:23:28.521842+0000","last_fullsized":"2024-09-11T22:23:28.521842+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.527014+0000","last_change":"2024-09-11T22:23:28.525318+0000","last_active":"2024-09-11T22:23:28.527014+0000","last_peered":"2024-09-11T22:23:28.527014+0000","last_clean":"2024-09-11T22:23:28.527014+0000","last_became_active":"2024-09-11T22:23:28.525023+0000","last_became_peered":"2024-09-11T22:23:28.525023+0000","last_unstale":"2024-09-11T22:23:28.527014+0000","last_undegraded":"2024-09-11T22:23:28.527014+0000","last_fullsized":"2024-09-11T22:23:28.527014+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.555667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520614+0000","last_change":"2024-09-11T22:23:28.520614+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520614+0000","last_undegraded":"2024-09-11T22:23:28.520614+0000","last_fullsized":"2024-09-11T22:23:28.520614+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.529406+0000","last_change":"2024-09-11T22:23:28.527081+0000","last_active":"2024-09-11T22:23:28.529406+0000","last_peered":"2024-09-11T22:23:28.529406+0000","last_clean":"2024-09-11T22:23:28.529406+0000","last_became_active":"2024-09-11T22:23:28.526812+0000","last_became_peered":"2024-09-11T22:23:28.526812+0000","last_unstale":"2024-09-11T22:23:28.529406+0000","last_undegraded":"2024-09-11T22:23:28.529406+0000","last_fullsized":"2024-09-11T22:23:28.529406+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:54.132096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520931+0000","last_change":"2024-09-11T22:23:28.520931+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520931+0000","last_undegraded":"2024-09-11T22:23:28.520931+0000","last_fullsized":"2024-09-11T22:23:28.520931+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:27.504517+0000","last_change":"2024-09-11T22:23:27.504517+0000","last_active":"2024-09-11T22:23:27.504517+0000","last_peered":"2024-09-11T22:23:27.504517+0000","last_clean":"2024-09-11T22:23:27.504517+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:27.504517+0000","last_undegraded":"2024-09-11T22:23:27.504517+0000","last_fullsized":"2024-09-11T22:23:27.504517+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.529435+0000","last_change":"2024-09-11T22:23:28.528735+0000","last_active":"2024-09-11T22:23:28.529435+0000","last_peered":"2024-09-11T22:23:28.529435+0000","last_clean":"2024-09-11T22:23:28.529435+0000","last_became_active":"2024-09-11T22:23:28.528439+0000","last_became_peered":"2024-09-11T22:23:28.528439+0000","last_unstale":"2024-09-11T22:23:28.529435+0000","last_undegraded":"2024-09-11T22:23:28.529435+0000","last_fullsized":"2024-09-11T22:23:28.529435+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:45.684076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520387+0000","last_change":"2024-09-11T22:23:28.520387+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520387+0000","last_undegraded":"2024-09-11T22:23:28.520387+0000","last_fullsized":"2024-09-11T22:23:28.520387+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.540499+0000","last_change":"2024-09-11T22:23:28.538934+0000","last_active":"2024-09-11T22:23:28.540499+0000","last_peered":"2024-09-11T22:23:28.540499+0000","last_clean":"2024-09-11T22:23:28.540499+0000","last_became_active":"2024-09-11T22:23:28.538183+0000","last_became_peered":"2024-09-11T22:23:28.538183+0000","last_unstale":"2024-09-11T22:23:28.540499+0000","last_undegraded":"2024-09-11T22:23:28.540499+0000","last_fullsized":"2024-09-11T22:23:28.540499+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:16.512571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531636+0000","last_change":"2024-09-11T22:23:28.529858+0000","last_active":"2024-09-11T22:23:28.531636+0000","last_peered":"2024-09-11T22:23:28.531636+0000","last_clean":"2024-09-11T22:23:28.531636+0000","last_became_active":"2024-09-11T22:23:28.529559+0000","last_became_peered":"2024-09-11T22:23:28.529559+0000","last_unstale":"2024-09-11T22:23:28.531636+0000","last_undegraded":"2024-09-11T22:23:28.531636+0000","last_fullsized":"2024-09-11T22:23:28.531636+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:25.609039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526401+0000","last_change":"2024-09-11T22:23:28.526401+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526401+0000","last_undegraded":"2024-09-11T22:23:28.526401+0000","last_fullsized":"2024-09-11T22:23:28.526401+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542211+0000","last_change":"2024-09-11T22:23:28.533696+0000","last_active":"2024-09-11T22:23:30.542211+0000","last_peered":"2024-09-11T22:23:30.542211+0000","last_clean":"2024-09-11T22:23:30.542211+0000","last_became_active":"2024-09-11T22:23:28.533412+0000","last_became_peered":"2024-09-11T22:23:28.533412+0000","last_unstale":"2024-09-11T22:23:30.542211+0000","last_undegraded":"2024-09-11T22:23:30.542211+0000","last_fullsized":"2024-09-11T22:23:30.542211+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:56.393853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.529550+0000","last_change":"2024-09-11T22:23:28.529550+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.529550+0000","last_undegraded":"2024-09-11T22:23:28.529550+0000","last_fullsized":"2024-09-11T22:23:28.529550+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.525004+0000","last_change":"2024-09-11T22:23:28.524567+0000","last_active":"2024-09-11T22:23:28.525004+0000","last_peered":"2024-09-11T22:23:28.525004+0000","last_clean":"2024-09-11T22:23:28.525004+0000","last_became_active":"2024-09-11T22:23:28.524261+0000","last_became_peered":"2024-09-11T22:23:28.524261+0000","last_unstale":"2024-09-11T22:23:28.525004+0000","last_undegraded":"2024-09-11T22:23:28.525004+0000","last_fullsized":"2024-09-11T22:23:28.525004+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:25.609039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527406+0000","last_change":"2024-09-11T22:23:28.527406+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527406+0000","last_undegraded":"2024-09-11T22:23:28.527406+0000","last_fullsized":"2024-09-11T22:23:28.527406+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.541049+0000","last_change":"2024-09-11T22:23:28.540359+0000","last_active":"2024-09-11T22:23:28.541049+0000","last_peered":"2024-09-11T22:23:28.541049+0000","last_clean":"2024-09-11T22:23:28.541049+0000","last_became_active":"2024-09-11T22:23:28.540041+0000","last_became_peered":"2024-09-11T22:23:28.540041+0000","last_unstale":"2024-09-11T22:23:28.541049+0000","last_undegraded":"2024-09-11T22:23:28.541049+0000","last_fullsized":"2024-09-11T22:23:28.541049+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:37.296359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520108+0000","last_change":"2024-09-11T22:23:28.520108+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520108+0000","last_undegraded":"2024-09-11T22:23:28.520108+0000","last_fullsized":"2024-09-11T22:23:28.520108+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.535368+0000","last_change":"2024-09-11T22:23:28.534953+0000","last_active":"2024-09-11T22:23:28.535368+0000","last_peered":"2024-09-11T22:23:28.535368+0000","last_clean":"2024-09-11T22:23:28.535368+0000","last_became_active":"2024-09-11T22:23:28.534637+0000","last_became_peered":"2024-09-11T22:23:28.534637+0000","last_unstale":"2024-09-11T22:23:28.535368+0000","last_undegraded":"2024-09-11T22:23:28.535368+0000","last_fullsized":"2024-09-11T22:23:28.535368+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.555667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542341+0000","last_change":"2024-09-11T22:23:29.527227+0000","last_active":"2024-09-11T22:23:30.542341+0000","last_peered":"2024-09-11T22:23:30.542341+0000","last_clean":"2024-09-11T22:23:30.542341+0000","last_became_active":"2024-09-11T22:23:29.526934+0000","last_became_peered":"2024-09-11T22:23:29.526934+0000","last_unstale":"2024-09-11T22:23:30.542341+0000","last_undegraded":"2024-09-11T22:23:30.542341+0000","last_fullsized":"2024-09-11T22:23:30.542341+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:55.674466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534454+0000","last_change":"2024-09-11T22:23:28.532266+0000","last_active":"2024-09-11T22:23:28.534454+0000","last_peered":"2024-09-11T22:23:28.534454+0000","last_clean":"2024-09-11T22:23:28.534454+0000","last_became_active":"2024-09-11T22:23:28.531883+0000","last_became_peered":"2024-09-11T22:23:28.531883+0000","last_unstale":"2024-09-11T22:23:28.534454+0000","last_undegraded":"2024-09-11T22:23:28.534454+0000","last_fullsized":"2024-09-11T22:23:28.534454+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:12.662086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521404+0000","last_change":"2024-09-11T22:23:28.521404+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521404+0000","last_undegraded":"2024-09-11T22:23:28.521404+0000","last_fullsized":"2024-09-11T22:23:28.521404+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.536442+0000","last_change":"2024-09-11T22:23:28.535869+0000","last_active":"2024-09-11T22:23:28.536442+0000","last_peered":"2024-09-11T22:23:28.536442+0000","last_clean":"2024-09-11T22:23:28.536442+0000","last_became_active":"2024-09-11T22:23:28.535425+0000","last_became_peered":"2024-09-11T22:23:28.535425+0000","last_unstale":"2024-09-11T22:23:28.536442+0000","last_undegraded":"2024-09-11T22:23:28.536442+0000","last_fullsized":"2024-09-11T22:23:28.536442+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:54.420567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527510+0000","last_change":"2024-09-11T22:23:28.527510+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527510+0000","last_undegraded":"2024-09-11T22:23:28.527510+0000","last_fullsized":"2024-09-11T22:23:28.527510+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:27.504517+0000","last_change":"2024-09-11T22:23:27.504517+0000","last_active":"2024-09-11T22:23:27.504517+0000","last_peered":"2024-09-11T22:23:27.504517+0000","last_clean":"2024-09-11T22:23:27.504517+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:27.504517+0000","last_undegraded":"2024-09-11T22:23:27.504517+0000","last_fullsized":"2024-09-11T22:23:27.504517+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.524913+0000","last_change":"2024-09-11T22:23:28.524913+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.524913+0000","last_undegraded":"2024-09-11T22:23:28.524913+0000","last_fullsized":"2024-09-11T22:23:28.524913+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.540690+0000","last_change":"2024-09-11T22:23:28.536841+0000","last_active":"2024-09-11T22:23:28.540690+0000","last_peered":"2024-09-11T22:23:28.540690+0000","last_clean":"2024-09-11T22:23:28.540690+0000","last_became_active":"2024-09-11T22:23:28.536520+0000","last_became_peered":"2024-09-11T22:23:28.536520+0000","last_unstale":"2024-09-11T22:23:28.540690+0000","last_undegraded":"2024-09-11T22:23:28.540690+0000","last_fullsized":"2024-09-11T22:23:28.540690+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:45.684076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527075+0000","last_change":"2024-09-11T22:23:28.527075+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527075+0000","last_undegraded":"2024-09-11T22:23:28.527075+0000","last_fullsized":"2024-09-11T22:23:28.527075+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.538652+0000","last_change":"2024-09-11T22:23:28.537499+0000","last_active":"2024-09-11T22:23:28.538652+0000","last_peered":"2024-09-11T22:23:28.538652+0000","last_clean":"2024-09-11T22:23:28.538652+0000","last_became_active":"2024-09-11T22:23:28.537241+0000","last_became_peered":"2024-09-11T22:23:28.537241+0000","last_unstale":"2024-09-11T22:23:28.538652+0000","last_undegraded":"2024-09-11T22:23:28.538652+0000","last_fullsized":"2024-09-11T22:23:28.538652+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:01.375011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528136+0000","last_change":"2024-09-11T22:23:28.528136+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528136+0000","last_undegraded":"2024-09-11T22:23:28.528136+0000","last_fullsized":"2024-09-11T22:23:28.528136+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531563+0000","last_change":"2024-09-11T22:23:28.530647+0000","last_active":"2024-09-11T22:23:28.531563+0000","last_peered":"2024-09-11T22:23:28.531563+0000","last_clean":"2024-09-11T22:23:28.531563+0000","last_became_active":"2024-09-11T22:23:28.530268+0000","last_became_peered":"2024-09-11T22:23:28.530268+0000","last_unstale":"2024-09-11T22:23:28.531563+0000","last_undegraded":"2024-09-11T22:23:28.531563+0000","last_fullsized":"2024-09-11T22:23:28.531563+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:46:18.742814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542012+0000","last_change":"2024-09-11T22:23:29.528818+0000","last_active":"2024-09-11T22:23:30.542012+0000","last_peered":"2024-09-11T22:23:30.542012+0000","last_clean":"2024-09-11T22:23:30.542012+0000","last_became_active":"2024-09-11T22:23:29.528503+0000","last_became_peered":"2024-09-11T22:23:29.528503+0000","last_unstale":"2024-09-11T22:23:30.542012+0000","last_undegraded":"2024-09-11T22:23:30.542012+0000","last_fullsized":"2024-09-11T22:23:30.542012+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:05.893484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534169+0000","last_change":"2024-09-11T22:23:28.533383+0000","last_active":"2024-09-11T22:23:28.534169+0000","last_peered":"2024-09-11T22:23:28.534169+0000","last_clean":"2024-09-11T22:23:28.534169+0000","last_became_active":"2024-09-11T22:23:28.533009+0000","last_became_peered":"2024-09-11T22:23:28.533009+0000","last_unstale":"2024-09-11T22:23:28.534169+0000","last_undegraded":"2024-09-11T22:23:28.534169+0000","last_fullsized":"2024-09-11T22:23:28.534169+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:12.662086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.530590+0000","last_change":"2024-09-11T22:23:28.530590+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.530590+0000","last_undegraded":"2024-09-11T22:23:28.530590+0000","last_fullsized":"2024-09-11T22:23:28.530590+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534512+0000","last_change":"2024-09-11T22:23:28.533228+0000","last_active":"2024-09-11T22:23:28.534512+0000","last_peered":"2024-09-11T22:23:28.534512+0000","last_clean":"2024-09-11T22:23:28.534512+0000","last_became_active":"2024-09-11T22:23:28.532945+0000","last_became_peered":"2024-09-11T22:23:28.532945+0000","last_unstale":"2024-09-11T22:23:28.534512+0000","last_undegraded":"2024-09-11T22:23:28.534512+0000","last_fullsized":"2024-09-11T22:23:28.534512+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.673122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528185+0000","last_change":"2024-09-11T22:23:28.528185+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528185+0000","last_undegraded":"2024-09-11T22:23:28.528185+0000","last_fullsized":"2024-09-11T22:23:28.528185+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.541398+0000","last_change":"2024-09-11T22:23:28.539834+0000","last_active":"2024-09-11T22:23:28.541398+0000","last_peered":"2024-09-11T22:23:28.541398+0000","last_clean":"2024-09-11T22:23:28.541398+0000","last_became_active":"2024-09-11T22:23:28.539533+0000","last_became_peered":"2024-09-11T22:23:28.539533+0000","last_unstale":"2024-09-11T22:23:28.541398+0000","last_undegraded":"2024-09-11T22:23:28.541398+0000","last_fullsized":"2024-09-11T22:23:28.541398+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:46.075605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527147+0000","last_change":"2024-09-11T22:23:28.527147+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527147+0000","last_undegraded":"2024-09-11T22:23:28.527147+0000","last_fullsized":"2024-09-11T22:23:28.527147+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:27.504517+0000","last_change":"2024-09-11T22:23:27.504517+0000","last_active":"2024-09-11T22:23:27.504517+0000","last_peered":"2024-09-11T22:23:27.504517+0000","last_clean":"2024-09-11T22:23:27.504517+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:27.504517+0000","last_undegraded":"2024-09-11T22:23:27.504517+0000","last_fullsized":"2024-09-11T22:23:27.504517+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527083+0000","last_change":"2024-09-11T22:23:28.527083+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527083+0000","last_undegraded":"2024-09-11T22:23:28.527083+0000","last_fullsized":"2024-09-11T22:23:28.527083+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:27.504517+0000","last_change":"2024-09-11T22:23:27.504517+0000","last_active":"2024-09-11T22:23:27.504517+0000","last_peered":"2024-09-11T22:23:27.504517+0000","last_clean":"2024-09-11T22:23:27.504517+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:27.504517+0000","last_undegraded":"2024-09-11T22:23:27.504517+0000","last_fullsized":"2024-09-11T22:23:27.504517+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.531504+0000","last_change":"2024-09-11T22:23:28.531504+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.531504+0000","last_undegraded":"2024-09-11T22:23:28.531504+0000","last_fullsized":"2024-09-11T22:23:28.531504+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.539220+0000","last_change":"2024-09-11T22:23:28.538694+0000","last_active":"2024-09-11T22:23:28.539220+0000","last_peered":"2024-09-11T22:23:28.539220+0000","last_clean":"2024-09-11T22:23:28.539220+0000","last_became_active":"2024-09-11T22:23:28.538434+0000","last_became_peered":"2024-09-11T22:23:28.538434+0000","last_unstale":"2024-09-11T22:23:28.539220+0000","last_undegraded":"2024-09-11T22:23:28.539220+0000","last_fullsized":"2024-09-11T22:23:28.539220+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:46.891077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.519844+0000","last_change":"2024-09-11T22:23:28.519844+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.519844+0000","last_undegraded":"2024-09-11T22:23:28.519844+0000","last_fullsized":"2024-09-11T22:23:28.519844+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.536914+0000","last_change":"2024-09-11T22:23:28.535813+0000","last_active":"2024-09-11T22:23:28.536914+0000","last_peered":"2024-09-11T22:23:28.536914+0000","last_clean":"2024-09-11T22:23:28.536914+0000","last_became_active":"2024-09-11T22:23:28.535523+0000","last_became_peered":"2024-09-11T22:23:28.535523+0000","last_unstale":"2024-09-11T22:23:28.536914+0000","last_undegraded":"2024-09-11T22:23:28.536914+0000","last_fullsized":"2024-09-11T22:23:28.536914+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:59.580534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526821+0000","last_change":"2024-09-11T22:23:28.526821+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526821+0000","last_undegraded":"2024-09-11T22:23:28.526821+0000","last_fullsized":"2024-09-11T22:23:28.526821+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531088+0000","last_change":"2024-09-11T22:23:28.530346+0000","last_active":"2024-09-11T22:23:28.531088+0000","last_peered":"2024-09-11T22:23:28.531088+0000","last_clean":"2024-09-11T22:23:28.531088+0000","last_became_active":"2024-09-11T22:23:28.530073+0000","last_became_peered":"2024-09-11T22:23:28.530073+0000","last_unstale":"2024-09-11T22:23:28.531088+0000","last_undegraded":"2024-09-11T22:23:28.531088+0000","last_fullsized":"2024-09-11T22:23:28.531088+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:05.774908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527000+0000","last_change":"2024-09-11T22:23:28.527000+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527000+0000","last_undegraded":"2024-09-11T22:23:28.527000+0000","last_fullsized":"2024-09-11T22:23:28.527000+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.540998+0000","last_change":"2024-09-11T22:23:28.539672+0000","last_active":"2024-09-11T22:23:28.540998+0000","last_peered":"2024-09-11T22:23:28.540998+0000","last_clean":"2024-09-11T22:23:28.540998+0000","last_became_active":"2024-09-11T22:23:28.539297+0000","last_became_peered":"2024-09-11T22:23:28.539297+0000","last_unstale":"2024-09-11T22:23:28.540998+0000","last_undegraded":"2024-09-11T22:23:28.540998+0000","last_fullsized":"2024-09-11T22:23:28.540998+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:57.831523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534492+0000","last_change":"2024-09-11T22:23:28.533170+0000","last_active":"2024-09-11T22:23:28.534492+0000","last_peered":"2024-09-11T22:23:28.534492+0000","last_clean":"2024-09-11T22:23:28.534492+0000","last_became_active":"2024-09-11T22:23:28.532610+0000","last_became_peered":"2024-09-11T22:23:28.532610+0000","last_unstale":"2024-09-11T22:23:28.534492+0000","last_undegraded":"2024-09-11T22:23:28.534492+0000","last_fullsized":"2024-09-11T22:23:28.534492+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:59.580534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531593+0000","last_change":"2024-09-11T22:23:28.530787+0000","last_active":"2024-09-11T22:23:28.531593+0000","last_peered":"2024-09-11T22:23:28.531593+0000","last_clean":"2024-09-11T22:23:28.531593+0000","last_became_active":"2024-09-11T22:23:28.530333+0000","last_became_peered":"2024-09-11T22:23:28.530333+0000","last_unstale":"2024-09-11T22:23:28.531593+0000","last_undegraded":"2024-09-11T22:23:28.531593+0000","last_fullsized":"2024-09-11T22:23:28.531593+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:00.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":466,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T22:23:25.856533+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:23:25.856533+0000","last_peered":"2024-09-11T22:23:25.856533+0000","last_clean":"2024-09-11T22:23:25.856533+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:23:25.856533+0000","last_undegraded":"2024-09-11T22:23:25.856533+0000","last_fullsized":"2024-09-11T22:23:25.856533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":56,"acting":56,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509594,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55700,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316140,"statfs":{"total":96636764160,"available":96579727360,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51540,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320300,"statfs":{"total":96636764160,"available":96583987200,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509593,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64020,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307820,"statfs":{"total":96636764160,"available":96571207680,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47376,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324464,"statfs":{"total":96636764160,"available":96588251136,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47380,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324460,"statfs":{"total":96636764160,"available":96588247040,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509592,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60436,"kb_used_data":2880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311404,"statfs":{"total":96636764160,"available":96574877696,"internally_reserved":0,"allocated":2949120,"data_stored":1624123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60412,"kb_used_data":2856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311428,"statfs":{"total":96636764160,"available":96574902272,"internally_reserved":0,"allocated":2924544,"data_stored":1612031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47424,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324416,"statfs":{"total":96636764160,"available":96588201984,"internally_reserved":0,"allocated":2400256,"data_stored":1048498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:23:32.520 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:23:32.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.657+0000 7f3bf98f1640 1 Processor -- start 2024-09-11T22:23:32.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.657+0000 7f3bf98f1640 1 -- start start 2024-09-11T22:23:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf98f1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3bf415c2c0 0x7f3bf40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf98f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf40d05e0 0x7f3bf40ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf98f1640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf40b4f00 con 0x7f3bf40b3e10 2024-09-11T22:23:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf98f1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf40b4360 con 0x7f3bf415c2c0 2024-09-11T22:23:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf98f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf40b51c0 con 0x7f3bf40d05e0 2024-09-11T22:23:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf2ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3bf415c2c0 0x7f3bf40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf27fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3bf40b3e10 0x7f3bf40cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53580/0 (socket says 172.21.15.50:53580) 2024-09-11T22:23:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf27fc640 1 -- 172.21.15.50:0/1683121541 learned_addr learned my addr 172.21.15.50:0/1683121541 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf37fe640 1 --2- 172.21.15.50:0/1683121541 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf40d05e0 0x7f3bf40ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf2ffd640 1 -- 172.21.15.50:0/1683121541 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf40d05e0 msgr2=0x7f3bf40ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf2ffd640 1 --2- 172.21.15.50:0/1683121541 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf40d05e0 0x7f3bf40ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf2ffd640 1 -- 172.21.15.50:0/1683121541 >> v1:172.21.15.50:6789/0 conn(0x7f3bf40b3e10 legacy=0x7f3bf40cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf2ffd640 1 -- 172.21.15.50:0/1683121541 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf40b54a0 con 0x7f3bf415c2c0 2024-09-11T22:23:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.658+0000 7f3bf37fe640 1 --2- 172.21.15.50:0/1683121541 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf40d05e0 0x7f3bf40ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.659+0000 7f3bf2ffd640 1 --2- 172.21.15.50:0/1683121541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf415c2c0 0x7f3bf40b46a0 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f3be40097a0 tx=0x7f3be402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62dc3d1e46f1b252 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.659+0000 7f3bf1ffb640 1 -- 172.21.15.50:0/1683121541 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be4037070 con 0x7f3bf415c2c0 2024-09-11T22:23:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.659+0000 7f3bf1ffb640 1 -- 172.21.15.50:0/1683121541 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be4032440 con 0x7f3bf415c2c0 2024-09-11T22:23:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.659+0000 7f3bf1ffb640 1 -- 172.21.15.50:0/1683121541 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be4032810 con 0x7f3bf415c2c0 2024-09-11T22:23:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.660+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1683121541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf415c2c0 msgr2=0x7f3bf40b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.660+0000 7f3bf98f1640 1 --2- 172.21.15.50:0/1683121541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf415c2c0 0x7f3bf40b46a0 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f3be40097a0 tx=0x7f3be402a180 comp rx=0 tx=0).stop 2024-09-11T22:23:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.660+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1683121541 shutdown_connections 2024-09-11T22:23:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.660+0000 7f3bf98f1640 1 --2- 172.21.15.50:0/1683121541 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf40d05e0 0x7f3bf40ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.660+0000 7f3bf98f1640 1 --2- 172.21.15.50:0/1683121541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf415c2c0 0x7f3bf40b46a0 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.660+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1683121541 >> 172.21.15.50:0/1683121541 conn(0x7f3bf40679c0 msgr2=0x7f3bf4067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.660+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1683121541 shutdown_connections 2024-09-11T22:23:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.660+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1683121541 wait complete. 2024-09-11T22:23:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.661+0000 7f3bf98f1640 1 Processor -- start 2024-09-11T22:23:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.661+0000 7f3bf98f1640 1 -- start start 2024-09-11T22:23:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf98f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40b3e10 0x7f3bf41f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf98f1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf40d05e0 0x7f3bf40aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf98f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf415c2c0 0x7f3bf41f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf98f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf406d070 con 0x7f3bf415c2c0 2024-09-11T22:23:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf98f1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf40ce200 con 0x7f3bf40b3e10 2024-09-11T22:23:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf98f1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf406d1f0 con 0x7f3bf40d05e0 2024-09-11T22:23:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf415c2c0 0x7f3bf41f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf415c2c0 0x7f3bf41f4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54336/0 (socket says 172.21.15.50:54336) 2024-09-11T22:23:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf37fe640 1 -- 172.21.15.50:0/1031346057 learned_addr learned my addr 172.21.15.50:0/1031346057 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf27fc640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf40d05e0 0x7f3bf40aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf2ffd640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40b3e10 0x7f3bf41f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf37fe640 1 -- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf40d05e0 msgr2=0x7f3bf40aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf37fe640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf40d05e0 0x7f3bf40aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf37fe640 1 -- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40b3e10 msgr2=0x7f3bf41f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf37fe640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40b3e10 0x7f3bf41f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.662+0000 7f3bf37fe640 1 -- 172.21.15.50:0/1031346057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf40ac030 con 0x7f3bf415c2c0 2024-09-11T22:23:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.663+0000 7f3bf37fe640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf415c2c0 0x7f3bf41f4e90 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00cef0 tx=0x7f3bec00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.663+0000 7f3bdbfff640 1 -- 172.21.15.50:0/1031346057 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec01a070 con 0x7f3bf415c2c0 2024-09-11T22:23:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.663+0000 7f3bdbfff640 1 -- 172.21.15.50:0/1031346057 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bec00d860 con 0x7f3bf415c2c0 2024-09-11T22:23:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.663+0000 7f3bdbfff640 1 -- 172.21.15.50:0/1031346057 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00dc50 con 0x7f3bf415c2c0 2024-09-11T22:23:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.663+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1031346057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf40ac310 con 0x7f3bf415c2c0 2024-09-11T22:23:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.663+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1031346057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf40ac8d0 con 0x7f3bf415c2c0 2024-09-11T22:23:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.664+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1031346057 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf415c6a0 con 0x7f3bf415c2c0 2024-09-11T22:23:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.664+0000 7f3bdbfff640 1 -- 172.21.15.50:0/1031346057 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3bec01d070 con 0x7f3bf415c2c0 2024-09-11T22:23:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.665+0000 7f3bdbfff640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3be006be30 0x7f3be006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.665+0000 7f3bdbfff640 1 -- 172.21.15.50:0/1031346057 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f3bec08b690 con 0x7f3bf415c2c0 2024-09-11T22:23:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.665+0000 7f3bf2ffd640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3be006be30 0x7f3be006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:32.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.666+0000 7f3bf2ffd640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3be006be30 0x7f3be006e2f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3be4034000 tx=0x7f3be402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:32.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.669+0000 7f3bdbfff640 1 -- 172.21.15.50:0/1031346057 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3bec059ab0 con 0x7f3bf415c2c0 2024-09-11T22:23:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.843+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1031346057 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3bf40cf3f0 con 0x7f3be006be30 2024-09-11T22:23:32.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.849+0000 7f3bdbfff640 1 -- 172.21.15.50:0/1031346057 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246154 (secure 0 0 0) 0x7f3bf40cf3f0 con 0x7f3be006be30 2024-09-11T22:23:32.853 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:32.854 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:23:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.852+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3be006be30 msgr2=0x7f3be006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.852+0000 7f3bf98f1640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3be006be30 0x7f3be006e2f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3be4034000 tx=0x7f3be402e000 comp rx=0 tx=0).stop 2024-09-11T22:23:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.852+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1031346057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf415c2c0 msgr2=0x7f3bf41f4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.852+0000 7f3bf98f1640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf415c2c0 0x7f3bf41f4e90 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00cef0 tx=0x7f3bec00a710 comp rx=0 tx=0).stop 2024-09-11T22:23:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.852+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1031346057 shutdown_connections 2024-09-11T22:23:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.852+0000 7f3bf98f1640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3be006be30 0x7f3be006e2f0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.852+0000 7f3bf98f1640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf40d05e0 0x7f3bf40aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.852+0000 7f3bf98f1640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3bf415c2c0 0x7f3bf41f4e90 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.852+0000 7f3bf98f1640 1 --2- 172.21.15.50:0/1031346057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40b3e10 0x7f3bf41f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.852+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1031346057 >> 172.21.15.50:0/1031346057 conn(0x7f3bf40679c0 msgr2=0x7f3bf40b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.852+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1031346057 shutdown_connections 2024-09-11T22:23:32.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:32.852+0000 7f3bf98f1640 1 -- 172.21.15.50:0/1031346057 wait complete. 2024-09-11T22:23:32.864 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2024-09-11T22:23:31.542831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":434288,"kb_used_data":19580,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754540432,"statfs":{"total":773094113280,"available":772649402368,"internally_reserved":0,"allocated":20049920,"data_stored":9453427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":424463921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031425"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521815+0000","last_change":"2024-09-11T22:23:28.521815+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521815+0000","last_undegraded":"2024-09-11T22:23:28.521815+0000","last_fullsized":"2024-09-11T22:23:28.521815+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.525336+0000","last_change":"2024-09-11T22:23:28.525336+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.525336+0000","last_undegraded":"2024-09-11T22:23:28.525336+0000","last_fullsized":"2024-09-11T22:23:28.525336+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.529760+0000","last_change":"2024-09-11T22:23:28.529760+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.529760+0000","last_undegraded":"2024-09-11T22:23:28.529760+0000","last_fullsized":"2024-09-11T22:23:28.529760+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527739+0000","last_change":"2024-09-11T22:23:28.527739+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527739+0000","last_undegraded":"2024-09-11T22:23:28.527739+0000","last_fullsized":"2024-09-11T22:23:28.527739+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522938+0000","last_change":"2024-09-11T22:23:28.522938+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522938+0000","last_undegraded":"2024-09-11T22:23:28.522938+0000","last_fullsized":"2024-09-11T22:23:28.522938+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.525322+0000","last_change":"2024-09-11T22:23:28.525322+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.525322+0000","last_undegraded":"2024-09-11T22:23:28.525322+0000","last_fullsized":"2024-09-11T22:23:28.525322+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.541990+0000","last_change":"2024-09-11T22:23:29.526180+0000","last_active":"2024-09-11T22:23:30.541990+0000","last_peered":"2024-09-11T22:23:30.541990+0000","last_clean":"2024-09-11T22:23:30.541990+0000","last_became_active":"2024-09-11T22:23:29.525856+0000","last_became_peered":"2024-09-11T22:23:29.525856+0000","last_unstale":"2024-09-11T22:23:30.541990+0000","last_undegraded":"2024-09-11T22:23:30.541990+0000","last_fullsized":"2024-09-11T22:23:30.541990+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:01.977359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528066+0000","last_change":"2024-09-11T22:23:28.528066+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528066+0000","last_undegraded":"2024-09-11T22:23:28.528066+0000","last_fullsized":"2024-09-11T22:23:28.528066+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522407+0000","last_change":"2024-09-11T22:23:28.522407+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522407+0000","last_undegraded":"2024-09-11T22:23:28.522407+0000","last_fullsized":"2024-09-11T22:23:28.522407+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522074+0000","last_change":"2024-09-11T22:23:28.522074+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522074+0000","last_undegraded":"2024-09-11T22:23:28.522074+0000","last_fullsized":"2024-09-11T22:23:28.522074+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521478+0000","last_change":"2024-09-11T22:23:28.521478+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521478+0000","last_undegraded":"2024-09-11T22:23:28.521478+0000","last_fullsized":"2024-09-11T22:23:28.521478+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520953+0000","last_change":"2024-09-11T22:23:28.520953+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520953+0000","last_undegraded":"2024-09-11T22:23:28.520953+0000","last_fullsized":"2024-09-11T22:23:28.520953+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.529557+0000","last_change":"2024-09-11T22:23:28.529557+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.529557+0000","last_undegraded":"2024-09-11T22:23:28.529557+0000","last_fullsized":"2024-09-11T22:23:28.529557+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521354+0000","last_change":"2024-09-11T22:23:28.521354+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521354+0000","last_undegraded":"2024-09-11T22:23:28.521354+0000","last_fullsized":"2024-09-11T22:23:28.521354+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522057+0000","last_change":"2024-09-11T22:23:28.522057+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522057+0000","last_undegraded":"2024-09-11T22:23:28.522057+0000","last_fullsized":"2024-09-11T22:23:28.522057+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521871+0000","last_change":"2024-09-11T22:23:28.521871+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521871+0000","last_undegraded":"2024-09-11T22:23:28.521871+0000","last_fullsized":"2024-09-11T22:23:28.521871+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527806+0000","last_change":"2024-09-11T22:23:28.527806+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527806+0000","last_undegraded":"2024-09-11T22:23:28.527806+0000","last_fullsized":"2024-09-11T22:23:28.527806+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522410+0000","last_change":"2024-09-11T22:23:28.522410+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522410+0000","last_undegraded":"2024-09-11T22:23:28.522410+0000","last_fullsized":"2024-09-11T22:23:28.522410+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527298+0000","last_change":"2024-09-11T22:23:28.527298+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527298+0000","last_undegraded":"2024-09-11T22:23:28.527298+0000","last_fullsized":"2024-09-11T22:23:28.527298+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528117+0000","last_change":"2024-09-11T22:23:28.528117+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528117+0000","last_undegraded":"2024-09-11T22:23:28.528117+0000","last_fullsized":"2024-09-11T22:23:28.528117+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526592+0000","last_change":"2024-09-11T22:23:28.526592+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526592+0000","last_undegraded":"2024-09-11T22:23:28.526592+0000","last_fullsized":"2024-09-11T22:23:28.526592+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542327+0000","last_change":"2024-09-11T22:23:29.533731+0000","last_active":"2024-09-11T22:23:30.542327+0000","last_peered":"2024-09-11T22:23:30.542327+0000","last_clean":"2024-09-11T22:23:30.542327+0000","last_became_active":"2024-09-11T22:23:29.532721+0000","last_became_peered":"2024-09-11T22:23:29.532721+0000","last_unstale":"2024-09-11T22:23:30.542327+0000","last_undegraded":"2024-09-11T22:23:30.542327+0000","last_fullsized":"2024-09-11T22:23:30.542327+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:01.286972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521958+0000","last_change":"2024-09-11T22:23:28.521958+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521958+0000","last_undegraded":"2024-09-11T22:23:28.521958+0000","last_fullsized":"2024-09-11T22:23:28.521958+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521683+0000","last_change":"2024-09-11T22:23:28.521683+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521683+0000","last_undegraded":"2024-09-11T22:23:28.521683+0000","last_fullsized":"2024-09-11T22:23:28.521683+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.530987+0000","last_change":"2024-09-11T22:23:28.530987+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.530987+0000","last_undegraded":"2024-09-11T22:23:28.530987+0000","last_fullsized":"2024-09-11T22:23:28.530987+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526019+0000","last_change":"2024-09-11T22:23:28.526019+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526019+0000","last_undegraded":"2024-09-11T22:23:28.526019+0000","last_fullsized":"2024-09-11T22:23:28.526019+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.524336+0000","last_change":"2024-09-11T22:23:28.524336+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.524336+0000","last_undegraded":"2024-09-11T22:23:28.524336+0000","last_fullsized":"2024-09-11T22:23:28.524336+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534341+0000","last_change":"2024-09-11T22:23:28.533479+0000","last_active":"2024-09-11T22:23:28.534341+0000","last_peered":"2024-09-11T22:23:28.534341+0000","last_clean":"2024-09-11T22:23:28.534341+0000","last_became_active":"2024-09-11T22:23:28.533187+0000","last_became_peered":"2024-09-11T22:23:28.533187+0000","last_unstale":"2024-09-11T22:23:28.534341+0000","last_undegraded":"2024-09-11T22:23:28.534341+0000","last_fullsized":"2024-09-11T22:23:28.534341+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:52.004425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542369+0000","last_change":"2024-09-11T22:23:29.536415+0000","last_active":"2024-09-11T22:23:30.542369+0000","last_peered":"2024-09-11T22:23:30.542369+0000","last_clean":"2024-09-11T22:23:30.542369+0000","last_became_active":"2024-09-11T22:23:29.536111+0000","last_became_peered":"2024-09-11T22:23:29.536111+0000","last_unstale":"2024-09-11T22:23:30.542369+0000","last_undegraded":"2024-09-11T22:23:30.542369+0000","last_fullsized":"2024-09-11T22:23:30.542369+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:47.495340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531316+0000","last_change":"2024-09-11T22:23:28.530365+0000","last_active":"2024-09-11T22:23:28.531316+0000","last_peered":"2024-09-11T22:23:28.531316+0000","last_clean":"2024-09-11T22:23:28.531316+0000","last_became_active":"2024-09-11T22:23:28.530069+0000","last_became_peered":"2024-09-11T22:23:28.530069+0000","last_unstale":"2024-09-11T22:23:28.531316+0000","last_undegraded":"2024-09-11T22:23:28.531316+0000","last_fullsized":"2024-09-11T22:23:28.531316+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:23.081602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520583+0000","last_change":"2024-09-11T22:23:28.520583+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520583+0000","last_undegraded":"2024-09-11T22:23:28.520583+0000","last_fullsized":"2024-09-11T22:23:28.520583+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.529721+0000","last_change":"2024-09-11T22:23:28.528837+0000","last_active":"2024-09-11T22:23:28.529721+0000","last_peered":"2024-09-11T22:23:28.529721+0000","last_clean":"2024-09-11T22:23:28.529721+0000","last_became_active":"2024-09-11T22:23:28.528534+0000","last_became_peered":"2024-09-11T22:23:28.528534+0000","last_unstale":"2024-09-11T22:23:28.529721+0000","last_undegraded":"2024-09-11T22:23:28.529721+0000","last_fullsized":"2024-09-11T22:23:28.529721+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:54.377250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1b","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542149+0000","last_change":"2024-09-11T22:23:28.527628+0000","last_active":"2024-09-11T22:23:30.542149+0000","last_peered":"2024-09-11T22:23:30.542149+0000","last_clean":"2024-09-11T22:23:30.542149+0000","last_became_active":"2024-09-11T22:23:28.527319+0000","last_became_peered":"2024-09-11T22:23:28.527319+0000","last_unstale":"2024-09-11T22:23:30.542149+0000","last_undegraded":"2024-09-11T22:23:30.542149+0000","last_fullsized":"2024-09-11T22:23:30.542149+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:25.526650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526841+0000","last_change":"2024-09-11T22:23:28.526841+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526841+0000","last_undegraded":"2024-09-11T22:23:28.526841+0000","last_fullsized":"2024-09-11T22:23:28.526841+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.532396+0000","last_change":"2024-09-11T22:23:28.531543+0000","last_active":"2024-09-11T22:23:28.532396+0000","last_peered":"2024-09-11T22:23:28.532396+0000","last_clean":"2024-09-11T22:23:28.532396+0000","last_became_active":"2024-09-11T22:23:28.531271+0000","last_became_peered":"2024-09-11T22:23:28.531271+0000","last_unstale":"2024-09-11T22:23:28.532396+0000","last_undegraded":"2024-09-11T22:23:28.532396+0000","last_fullsized":"2024-09-11T22:23:28.532396+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:00.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521842+0000","last_change":"2024-09-11T22:23:28.521842+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521842+0000","last_undegraded":"2024-09-11T22:23:28.521842+0000","last_fullsized":"2024-09-11T22:23:28.521842+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.527014+0000","last_change":"2024-09-11T22:23:28.525318+0000","last_active":"2024-09-11T22:23:28.527014+0000","last_peered":"2024-09-11T22:23:28.527014+0000","last_clean":"2024-09-11T22:23:28.527014+0000","last_became_active":"2024-09-11T22:23:28.525023+0000","last_became_peered":"2024-09-11T22:23:28.525023+0000","last_unstale":"2024-09-11T22:23:28.527014+0000","last_undegraded":"2024-09-11T22:23:28.527014+0000","last_fullsized":"2024-09-11T22:23:28.527014+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.555667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520614+0000","last_change":"2024-09-11T22:23:28.520614+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520614+0000","last_undegraded":"2024-09-11T22:23:28.520614+0000","last_fullsized":"2024-09-11T22:23:28.520614+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.529406+0000","last_change":"2024-09-11T22:23:28.527081+0000","last_active":"2024-09-11T22:23:28.529406+0000","last_peered":"2024-09-11T22:23:28.529406+0000","last_clean":"2024-09-11T22:23:28.529406+0000","last_became_active":"2024-09-11T22:23:28.526812+0000","last_became_peered":"2024-09-11T22:23:28.526812+0000","last_unstale":"2024-09-11T22:23:28.529406+0000","last_undegraded":"2024-09-11T22:23:28.529406+0000","last_fullsized":"2024-09-11T22:23:28.529406+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:54.132096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520931+0000","last_change":"2024-09-11T22:23:28.520931+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520931+0000","last_undegraded":"2024-09-11T22:23:28.520931+0000","last_fullsized":"2024-09-11T22:23:28.520931+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:27.504517+0000","last_change":"2024-09-11T22:23:27.504517+0000","last_active":"2024-09-11T22:23:27.504517+0000","last_peered":"2024-09-11T22:23:27.504517+0000","last_clean":"2024-09-11T22:23:27.504517+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:27.504517+0000","last_undegraded":"2024-09-11T22:23:27.504517+0000","last_fullsized":"2024-09-11T22:23:27.504517+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.529435+0000","last_change":"2024-09-11T22:23:28.528735+0000","last_active":"2024-09-11T22:23:28.529435+0000","last_peered":"2024-09-11T22:23:28.529435+0000","last_clean":"2024-09-11T22:23:28.529435+0000","last_became_active":"2024-09-11T22:23:28.528439+0000","last_became_peered":"2024-09-11T22:23:28.528439+0000","last_unstale":"2024-09-11T22:23:28.529435+0000","last_undegraded":"2024-09-11T22:23:28.529435+0000","last_fullsized":"2024-09-11T22:23:28.529435+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:45.684076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520387+0000","last_change":"2024-09-11T22:23:28.520387+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520387+0000","last_undegraded":"2024-09-11T22:23:28.520387+0000","last_fullsized":"2024-09-11T22:23:28.520387+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.540499+0000","last_change":"2024-09-11T22:23:28.538934+0000","last_active":"2024-09-11T22:23:28.540499+0000","last_peered":"2024-09-11T22:23:28.540499+0000","last_clean":"2024-09-11T22:23:28.540499+0000","last_became_active":"2024-09-11T22:23:28.538183+0000","last_became_peered":"2024-09-11T22:23:28.538183+0000","last_unstale":"2024-09-11T22:23:28.540499+0000","last_undegraded":"2024-09-11T22:23:28.540499+0000","last_fullsized":"2024-09-11T22:23:28.540499+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:16.512571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531636+0000","last_change":"2024-09-11T22:23:28.529858+0000","last_active":"2024-09-11T22:23:28.531636+0000","last_peered":"2024-09-11T22:23:28.531636+0000","last_clean":"2024-09-11T22:23:28.531636+0000","last_became_active":"2024-09-11T22:23:28.529559+0000","last_became_peered":"2024-09-11T22:23:28.529559+0000","last_unstale":"2024-09-11T22:23:28.531636+0000","last_undegraded":"2024-09-11T22:23:28.531636+0000","last_fullsized":"2024-09-11T22:23:28.531636+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:25.609039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526401+0000","last_change":"2024-09-11T22:23:28.526401+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526401+0000","last_undegraded":"2024-09-11T22:23:28.526401+0000","last_fullsized":"2024-09-11T22:23:28.526401+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542211+0000","last_change":"2024-09-11T22:23:28.533696+0000","last_active":"2024-09-11T22:23:30.542211+0000","last_peered":"2024-09-11T22:23:30.542211+0000","last_clean":"2024-09-11T22:23:30.542211+0000","last_became_active":"2024-09-11T22:23:28.533412+0000","last_became_peered":"2024-09-11T22:23:28.533412+0000","last_unstale":"2024-09-11T22:23:30.542211+0000","last_undegraded":"2024-09-11T22:23:30.542211+0000","last_fullsized":"2024-09-11T22:23:30.542211+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:56.393853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.529550+0000","last_change":"2024-09-11T22:23:28.529550+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.529550+0000","last_undegraded":"2024-09-11T22:23:28.529550+0000","last_fullsized":"2024-09-11T22:23:28.529550+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.525004+0000","last_change":"2024-09-11T22:23:28.524567+0000","last_active":"2024-09-11T22:23:28.525004+0000","last_peered":"2024-09-11T22:23:28.525004+0000","last_clean":"2024-09-11T22:23:28.525004+0000","last_became_active":"2024-09-11T22:23:28.524261+0000","last_became_peered":"2024-09-11T22:23:28.524261+0000","last_unstale":"2024-09-11T22:23:28.525004+0000","last_undegraded":"2024-09-11T22:23:28.525004+0000","last_fullsized":"2024-09-11T22:23:28.525004+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:25.609039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527406+0000","last_change":"2024-09-11T22:23:28.527406+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527406+0000","last_undegraded":"2024-09-11T22:23:28.527406+0000","last_fullsized":"2024-09-11T22:23:28.527406+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.541049+0000","last_change":"2024-09-11T22:23:28.540359+0000","last_active":"2024-09-11T22:23:28.541049+0000","last_peered":"2024-09-11T22:23:28.541049+0000","last_clean":"2024-09-11T22:23:28.541049+0000","last_became_active":"2024-09-11T22:23:28.540041+0000","last_became_peered":"2024-09-11T22:23:28.540041+0000","last_unstale":"2024-09-11T22:23:28.541049+0000","last_undegraded":"2024-09-11T22:23:28.541049+0000","last_fullsized":"2024-09-11T22:23:28.541049+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:37.296359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520108+0000","last_change":"2024-09-11T22:23:28.520108+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520108+0000","last_undegraded":"2024-09-11T22:23:28.520108+0000","last_fullsized":"2024-09-11T22:23:28.520108+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.535368+0000","last_change":"2024-09-11T22:23:28.534953+0000","last_active":"2024-09-11T22:23:28.535368+0000","last_peered":"2024-09-11T22:23:28.535368+0000","last_clean":"2024-09-11T22:23:28.535368+0000","last_became_active":"2024-09-11T22:23:28.534637+0000","last_became_peered":"2024-09-11T22:23:28.534637+0000","last_unstale":"2024-09-11T22:23:28.535368+0000","last_undegraded":"2024-09-11T22:23:28.535368+0000","last_fullsized":"2024-09-11T22:23:28.535368+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.555667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542341+0000","last_change":"2024-09-11T22:23:29.527227+0000","last_active":"2024-09-11T22:23:30.542341+0000","last_peered":"2024-09-11T22:23:30.542341+0000","last_clean":"2024-09-11T22:23:30.542341+0000","last_became_active":"2024-09-11T22:23:29.526934+0000","last_became_peered":"2024-09-11T22:23:29.526934+0000","last_unstale":"2024-09-11T22:23:30.542341+0000","last_undegraded":"2024-09-11T22:23:30.542341+0000","last_fullsized":"2024-09-11T22:23:30.542341+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:55.674466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534454+0000","last_change":"2024-09-11T22:23:28.532266+0000","last_active":"2024-09-11T22:23:28.534454+0000","last_peered":"2024-09-11T22:23:28.534454+0000","last_clean":"2024-09-11T22:23:28.534454+0000","last_became_active":"2024-09-11T22:23:28.531883+0000","last_became_peered":"2024-09-11T22:23:28.531883+0000","last_unstale":"2024-09-11T22:23:28.534454+0000","last_undegraded":"2024-09-11T22:23:28.534454+0000","last_fullsized":"2024-09-11T22:23:28.534454+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:12.662086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521404+0000","last_change":"2024-09-11T22:23:28.521404+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521404+0000","last_undegraded":"2024-09-11T22:23:28.521404+0000","last_fullsized":"2024-09-11T22:23:28.521404+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.536442+0000","last_change":"2024-09-11T22:23:28.535869+0000","last_active":"2024-09-11T22:23:28.536442+0000","last_peered":"2024-09-11T22:23:28.536442+0000","last_clean":"2024-09-11T22:23:28.536442+0000","last_became_active":"2024-09-11T22:23:28.535425+0000","last_became_peered":"2024-09-11T22:23:28.535425+0000","last_unstale":"2024-09-11T22:23:28.536442+0000","last_undegraded":"2024-09-11T22:23:28.536442+0000","last_fullsized":"2024-09-11T22:23:28.536442+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:54.420567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527510+0000","last_change":"2024-09-11T22:23:28.527510+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527510+0000","last_undegraded":"2024-09-11T22:23:28.527510+0000","last_fullsized":"2024-09-11T22:23:28.527510+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:27.504517+0000","last_change":"2024-09-11T22:23:27.504517+0000","last_active":"2024-09-11T22:23:27.504517+0000","last_peered":"2024-09-11T22:23:27.504517+0000","last_clean":"2024-09-11T22:23:27.504517+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:27.504517+0000","last_undegraded":"2024-09-11T22:23:27.504517+0000","last_fullsized":"2024-09-11T22:23:27.504517+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.524913+0000","last_change":"2024-09-11T22:23:28.524913+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.524913+0000","last_undegraded":"2024-09-11T22:23:28.524913+0000","last_fullsized":"2024-09-11T22:23:28.524913+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.540690+0000","last_change":"2024-09-11T22:23:28.536841+0000","last_active":"2024-09-11T22:23:28.540690+0000","last_peered":"2024-09-11T22:23:28.540690+0000","last_clean":"2024-09-11T22:23:28.540690+0000","last_became_active":"2024-09-11T22:23:28.536520+0000","last_became_peered":"2024-09-11T22:23:28.536520+0000","last_unstale":"2024-09-11T22:23:28.540690+0000","last_undegraded":"2024-09-11T22:23:28.540690+0000","last_fullsized":"2024-09-11T22:23:28.540690+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:45.684076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527075+0000","last_change":"2024-09-11T22:23:28.527075+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527075+0000","last_undegraded":"2024-09-11T22:23:28.527075+0000","last_fullsized":"2024-09-11T22:23:28.527075+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.538652+0000","last_change":"2024-09-11T22:23:28.537499+0000","last_active":"2024-09-11T22:23:28.538652+0000","last_peered":"2024-09-11T22:23:28.538652+0000","last_clean":"2024-09-11T22:23:28.538652+0000","last_became_active":"2024-09-11T22:23:28.537241+0000","last_became_peered":"2024-09-11T22:23:28.537241+0000","last_unstale":"2024-09-11T22:23:28.538652+0000","last_undegraded":"2024-09-11T22:23:28.538652+0000","last_fullsized":"2024-09-11T22:23:28.538652+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:01.375011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528136+0000","last_change":"2024-09-11T22:23:28.528136+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528136+0000","last_undegraded":"2024-09-11T22:23:28.528136+0000","last_fullsized":"2024-09-11T22:23:28.528136+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531563+0000","last_change":"2024-09-11T22:23:28.530647+0000","last_active":"2024-09-11T22:23:28.531563+0000","last_peered":"2024-09-11T22:23:28.531563+0000","last_clean":"2024-09-11T22:23:28.531563+0000","last_became_active":"2024-09-11T22:23:28.530268+0000","last_became_peered":"2024-09-11T22:23:28.530268+0000","last_unstale":"2024-09-11T22:23:28.531563+0000","last_undegraded":"2024-09-11T22:23:28.531563+0000","last_fullsized":"2024-09-11T22:23:28.531563+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:46:18.742814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542012+0000","last_change":"2024-09-11T22:23:29.528818+0000","last_active":"2024-09-11T22:23:30.542012+0000","last_peered":"2024-09-11T22:23:30.542012+0000","last_clean":"2024-09-11T22:23:30.542012+0000","last_became_active":"2024-09-11T22:23:29.528503+0000","last_became_peered":"2024-09-11T22:23:29.528503+0000","last_unstale":"2024-09-11T22:23:30.542012+0000","last_undegraded":"2024-09-11T22:23:30.542012+0000","last_fullsized":"2024-09-11T22:23:30.542012+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:05.893484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534169+0000","last_change":"2024-09-11T22:23:28.533383+0000","last_active":"2024-09-11T22:23:28.534169+0000","last_peered":"2024-09-11T22:23:28.534169+0000","last_clean":"2024-09-11T22:23:28.534169+0000","last_became_active":"2024-09-11T22:23:28.533009+0000","last_became_peered":"2024-09-11T22:23:28.533009+0000","last_unstale":"2024-09-11T22:23:28.534169+0000","last_undegraded":"2024-09-11T22:23:28.534169+0000","last_fullsized":"2024-09-11T22:23:28.534169+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:12.662086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.530590+0000","last_change":"2024-09-11T22:23:28.530590+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.530590+0000","last_undegraded":"2024-09-11T22:23:28.530590+0000","last_fullsized":"2024-09-11T22:23:28.530590+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534512+0000","last_change":"2024-09-11T22:23:28.533228+0000","last_active":"2024-09-11T22:23:28.534512+0000","last_peered":"2024-09-11T22:23:28.534512+0000","last_clean":"2024-09-11T22:23:28.534512+0000","last_became_active":"2024-09-11T22:23:28.532945+0000","last_became_peered":"2024-09-11T22:23:28.532945+0000","last_unstale":"2024-09-11T22:23:28.534512+0000","last_undegraded":"2024-09-11T22:23:28.534512+0000","last_fullsized":"2024-09-11T22:23:28.534512+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.673122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528185+0000","last_change":"2024-09-11T22:23:28.528185+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528185+0000","last_undegraded":"2024-09-11T22:23:28.528185+0000","last_fullsized":"2024-09-11T22:23:28.528185+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.541398+0000","last_change":"2024-09-11T22:23:28.539834+0000","last_active":"2024-09-11T22:23:28.541398+0000","last_peered":"2024-09-11T22:23:28.541398+0000","last_clean":"2024-09-11T22:23:28.541398+0000","last_became_active":"2024-09-11T22:23:28.539533+0000","last_became_peered":"2024-09-11T22:23:28.539533+0000","last_unstale":"2024-09-11T22:23:28.541398+0000","last_undegraded":"2024-09-11T22:23:28.541398+0000","last_fullsized":"2024-09-11T22:23:28.541398+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:46.075605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527147+0000","last_change":"2024-09-11T22:23:28.527147+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527147+0000","last_undegraded":"2024-09-11T22:23:28.527147+0000","last_fullsized":"2024-09-11T22:23:28.527147+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:27.504517+0000","last_change":"2024-09-11T22:23:27.504517+0000","last_active":"2024-09-11T22:23:27.504517+0000","last_peered":"2024-09-11T22:23:27.504517+0000","last_clean":"2024-09-11T22:23:27.504517+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:27.504517+0000","last_undegraded":"2024-09-11T22:23:27.504517+0000","last_fullsized":"2024-09-11T22:23:27.504517+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527083+0000","last_change":"2024-09-11T22:23:28.527083+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527083+0000","last_undegraded":"2024-09-11T22:23:28.527083+0000","last_fullsized":"2024-09-11T22:23:28.527083+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:27.504517+0000","last_change":"2024-09-11T22:23:27.504517+0000","last_active":"2024-09-11T22:23:27.504517+0000","last_peered":"2024-09-11T22:23:27.504517+0000","last_clean":"2024-09-11T22:23:27.504517+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:27.504517+0000","last_undegraded":"2024-09-11T22:23:27.504517+0000","last_fullsized":"2024-09-11T22:23:27.504517+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.531504+0000","last_change":"2024-09-11T22:23:28.531504+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.531504+0000","last_undegraded":"2024-09-11T22:23:28.531504+0000","last_fullsized":"2024-09-11T22:23:28.531504+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.539220+0000","last_change":"2024-09-11T22:23:28.538694+0000","last_active":"2024-09-11T22:23:28.539220+0000","last_peered":"2024-09-11T22:23:28.539220+0000","last_clean":"2024-09-11T22:23:28.539220+0000","last_became_active":"2024-09-11T22:23:28.538434+0000","last_became_peered":"2024-09-11T22:23:28.538434+0000","last_unstale":"2024-09-11T22:23:28.539220+0000","last_undegraded":"2024-09-11T22:23:28.539220+0000","last_fullsized":"2024-09-11T22:23:28.539220+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:46.891077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.519844+0000","last_change":"2024-09-11T22:23:28.519844+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.519844+0000","last_undegraded":"2024-09-11T22:23:28.519844+0000","last_fullsized":"2024-09-11T22:23:28.519844+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.536914+0000","last_change":"2024-09-11T22:23:28.535813+0000","last_active":"2024-09-11T22:23:28.536914+0000","last_peered":"2024-09-11T22:23:28.536914+0000","last_clean":"2024-09-11T22:23:28.536914+0000","last_became_active":"2024-09-11T22:23:28.535523+0000","last_became_peered":"2024-09-11T22:23:28.535523+0000","last_unstale":"2024-09-11T22:23:28.536914+0000","last_undegraded":"2024-09-11T22:23:28.536914+0000","last_fullsized":"2024-09-11T22:23:28.536914+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:59.580534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526821+0000","last_change":"2024-09-11T22:23:28.526821+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526821+0000","last_undegraded":"2024-09-11T22:23:28.526821+0000","last_fullsized":"2024-09-11T22:23:28.526821+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531088+0000","last_change":"2024-09-11T22:23:28.530346+0000","last_active":"2024-09-11T22:23:28.531088+0000","last_peered":"2024-09-11T22:23:28.531088+0000","last_clean":"2024-09-11T22:23:28.531088+0000","last_became_active":"2024-09-11T22:23:28.530073+0000","last_became_peered":"2024-09-11T22:23:28.530073+0000","last_unstale":"2024-09-11T22:23:28.531088+0000","last_undegraded":"2024-09-11T22:23:28.531088+0000","last_fullsized":"2024-09-11T22:23:28.531088+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:05.774908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527000+0000","last_change":"2024-09-11T22:23:28.527000+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527000+0000","last_undegraded":"2024-09-11T22:23:28.527000+0000","last_fullsized":"2024-09-11T22:23:28.527000+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.540998+0000","last_change":"2024-09-11T22:23:28.539672+0000","last_active":"2024-09-11T22:23:28.540998+0000","last_peered":"2024-09-11T22:23:28.540998+0000","last_clean":"2024-09-11T22:23:28.540998+0000","last_became_active":"2024-09-11T22:23:28.539297+0000","last_became_peered":"2024-09-11T22:23:28.539297+0000","last_unstale":"2024-09-11T22:23:28.540998+0000","last_undegraded":"2024-09-11T22:23:28.540998+0000","last_fullsized":"2024-09-11T22:23:28.540998+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:57.831523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534492+0000","last_change":"2024-09-11T22:23:28.533170+0000","last_active":"2024-09-11T22:23:28.534492+0000","last_peered":"2024-09-11T22:23:28.534492+0000","last_clean":"2024-09-11T22:23:28.534492+0000","last_became_active":"2024-09-11T22:23:28.532610+0000","last_became_peered":"2024-09-11T22:23:28.532610+0000","last_unstale":"2024-09-11T22:23:28.534492+0000","last_undegraded":"2024-09-11T22:23:28.534492+0000","last_fullsized":"2024-09-11T22:23:28.534492+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:59.580534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531593+0000","last_change":"2024-09-11T22:23:28.530787+0000","last_active":"2024-09-11T22:23:28.531593+0000","last_peered":"2024-09-11T22:23:28.531593+0000","last_clean":"2024-09-11T22:23:28.531593+0000","last_became_active":"2024-09-11T22:23:28.530333+0000","last_became_peered":"2024-09-11T22:23:28.530333+0000","last_unstale":"2024-09-11T22:23:28.531593+0000","last_undegraded":"2024-09-11T22:23:28.531593+0000","last_fullsized":"2024-09-11T22:23:28.531593+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:00.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":466,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T22:23:25.856533+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:23:25.856533+0000","last_peered":"2024-09-11T22:23:25.856533+0000","last_clean":"2024-09-11T22:23:25.856533+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:23:25.856533+0000","last_undegraded":"2024-09-11T22:23:25.856533+0000","last_fullsized":"2024-09-11T22:23:25.856533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":56,"acting":56,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509594,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55700,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316140,"statfs":{"total":96636764160,"available":96579727360,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51540,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320300,"statfs":{"total":96636764160,"available":96583987200,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509593,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64020,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307820,"statfs":{"total":96636764160,"available":96571207680,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47376,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324464,"statfs":{"total":96636764160,"available":96588251136,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47380,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324460,"statfs":{"total":96636764160,"available":96588247040,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509592,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60436,"kb_used_data":2880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311404,"statfs":{"total":96636764160,"available":96574877696,"internally_reserved":0,"allocated":2949120,"data_stored":1624123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60412,"kb_used_data":2856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311428,"statfs":{"total":96636764160,"available":96574902272,"internally_reserved":0,"allocated":2924544,"data_stored":1612031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47424,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324416,"statfs":{"total":96636764160,"available":96588201984,"internally_reserved":0,"allocated":2400256,"data_stored":1048498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:23:32.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:23:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.006+0000 7ff5153b7640 1 Processor -- start 2024-09-11T22:23:33.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.007+0000 7ff5153b7640 1 -- start start 2024-09-11T22:23:33.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.007+0000 7ff5153b7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff510072cb0 0x7ff51015bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.007+0000 7ff5153b7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5100b5020 con 0x7ff51006d780 2024-09-11T22:23:33.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.007+0000 7ff5153b7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51015aeb0 con 0x7ff51015aad0 2024-09-11T22:23:33.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.007+0000 7ff5153b7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff51015c040 con 0x7ff510072cb0 2024-09-11T22:23:33.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.008+0000 7ff50e7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff51006d780 0x7ff5100b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53596/0 (socket says 172.21.15.50:53596) 2024-09-11T22:23:33.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.008+0000 7ff50e7fc640 1 -- 172.21.15.50:0/3401459893 learned_addr learned my addr 172.21.15.50:0/3401459893 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:33.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.008+0000 7ff50f7fe640 1 --2- 172.21.15.50:0/3401459893 >> v2:172.21.15.77:3300/0 conn(0x7ff510072cb0 0x7ff51015bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.008+0000 7ff50dffb640 1 -- 172.21.15.50:0/3401459893 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837059559 0 0) 0x7ff5100b5020 con 0x7ff51006d780 2024-09-11T22:23:33.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.008+0000 7ff50dffb640 1 -- 172.21.15.50:0/3401459893 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4f8003520 con 0x7ff51006d780 2024-09-11T22:23:33.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.008+0000 7ff50dffb640 1 -- 172.21.15.50:0/3401459893 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2705467513 0 0) 0x7ff51015aeb0 con 0x7ff51015aad0 2024-09-11T22:23:33.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.008+0000 7ff50dffb640 1 -- 172.21.15.50:0/3401459893 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5100b5020 con 0x7ff51015aad0 2024-09-11T22:23:33.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.008+0000 7ff50f7fe640 1 -- 172.21.15.50:0/3401459893 >> v1:172.21.15.77:6789/0 conn(0x7ff51015aad0 legacy=0x7ff51006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.008+0000 7ff50dffb640 1 -- 172.21.15.50:0/3401459893 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1836283774 0 0) 0x7ff4f8003520 con 0x7ff51006d780 2024-09-11T22:23:33.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.008+0000 7ff50f7fe640 1 -- 172.21.15.50:0/3401459893 >> v1:172.21.15.50:6789/0 conn(0x7ff51006d780 legacy=0x7ff5100b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.008+0000 7ff50f7fe640 1 -- 172.21.15.50:0/3401459893 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5100714d0 con 0x7ff510072cb0 2024-09-11T22:23:33.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.009+0000 7ff50f7fe640 1 --2- 172.21.15.50:0/3401459893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff510072cb0 0x7ff51015bb00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff50800aea0 tx=0x7ff50802b7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a94c84a3183656 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:33.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.009+0000 7ff50dffb640 1 -- 172.21.15.50:0/3401459893 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff508037070 con 0x7ff510072cb0 2024-09-11T22:23:33.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.009+0000 7ff50dffb640 1 -- 172.21.15.50:0/3401459893 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff508008440 con 0x7ff510072cb0 2024-09-11T22:23:33.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.009+0000 7ff50dffb640 1 -- 172.21.15.50:0/3401459893 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504001670 con 0x7ff510072cb0 2024-09-11T22:23:33.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.010+0000 7ff5153b7640 1 -- 172.21.15.50:0/3401459893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff510072cb0 msgr2=0x7ff51015bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.010+0000 7ff5153b7640 1 --2- 172.21.15.50:0/3401459893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff510072cb0 0x7ff51015bb00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff50800aea0 tx=0x7ff50802b7d0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.010+0000 7ff5153b7640 1 -- 172.21.15.50:0/3401459893 shutdown_connections 2024-09-11T22:23:33.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.010+0000 7ff5153b7640 1 --2- 172.21.15.50:0/3401459893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff510072cb0 0x7ff51015bb00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.010+0000 7ff5153b7640 1 -- 172.21.15.50:0/3401459893 >> 172.21.15.50:0/3401459893 conn(0x7ff5100679c0 msgr2=0x7ff510067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:33.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.010+0000 7ff5153b7640 1 -- 172.21.15.50:0/3401459893 shutdown_connections 2024-09-11T22:23:33.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.010+0000 7ff5153b7640 1 -- 172.21.15.50:0/3401459893 wait complete. 2024-09-11T22:23:33.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.011+0000 7ff5153b7640 1 Processor -- start 2024-09-11T22:23:33.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.011+0000 7ff5153b7640 1 -- start start 2024-09-11T22:23:33.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff5153b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51006d780 0x7ff5100c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff5153b7640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff510072cb0 0x7ff5100c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff5153b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff51015aad0 0x7ff5100ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff5153b7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff510071d70 con 0x7ff51015aad0 2024-09-11T22:23:33.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff5153b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff510071a90 con 0x7ff51006d780 2024-09-11T22:23:33.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff5153b7640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff510072290 con 0x7ff510072cb0 2024-09-11T22:23:33.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff50f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff51015aad0 0x7ff5100ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff50f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff51015aad0 0x7ff5100ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54342/0 (socket says 172.21.15.50:54342) 2024-09-11T22:23:33.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff50f7fe640 1 -- 172.21.15.50:0/3973094534 learned_addr learned my addr 172.21.15.50:0/3973094534 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:33.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff50effd640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51006d780 0x7ff5100c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff50e7fc640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff510072cb0 0x7ff5100c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff50f7fe640 1 -- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff510072cb0 msgr2=0x7ff5100c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff50f7fe640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff510072cb0 0x7ff5100c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff50f7fe640 1 -- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51006d780 msgr2=0x7ff5100c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff50f7fe640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51006d780 0x7ff5100c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff50f7fe640 1 -- 172.21.15.50:0/3973094534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5100cbac0 con 0x7ff51015aad0 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff50effd640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51006d780 0x7ff5100c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.012+0000 7ff50f7fe640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff51015aad0 0x7ff5100ae890 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7ff508035040 tx=0x7ff508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.013+0000 7ff4f77fe640 1 -- 172.21.15.50:0/3973094534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff508037040 con 0x7ff51015aad0 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.013+0000 7ff4f77fe640 1 -- 172.21.15.50:0/3973094534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff508003bb0 con 0x7ff51015aad0 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.013+0000 7ff5153b7640 1 -- 172.21.15.50:0/3973094534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5100cbda0 con 0x7ff51015aad0 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.013+0000 7ff4f77fe640 1 -- 172.21.15.50:0/3973094534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50800a560 con 0x7ff51015aad0 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.013+0000 7ff5153b7640 1 -- 172.21.15.50:0/3973094534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5100c7e00 con 0x7ff51015aad0 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.014+0000 7ff5153b7640 1 -- 172.21.15.50:0/3973094534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff51015bb00 con 0x7ff51015aad0 2024-09-11T22:23:33.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.014+0000 7ff4f77fe640 1 -- 172.21.15.50:0/3973094534 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff508004030 con 0x7ff51015aad0 2024-09-11T22:23:33.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.015+0000 7ff4f77fe640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff4fc06be30 0x7ff4fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.015+0000 7ff4f77fe640 1 -- 172.21.15.50:0/3973094534 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7ff5080ab860 con 0x7ff51015aad0 2024-09-11T22:23:33.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.015+0000 7ff50effd640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff4fc06be30 0x7ff4fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.015+0000 7ff50effd640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff4fc06be30 0x7ff4fc06e2f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff5000011e0 tx=0x7ff500009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:33.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.019+0000 7ff4f77fe640 1 -- 172.21.15.50:0/3973094534 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff50807a220 con 0x7ff51015aad0 2024-09-11T22:23:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.190+0000 7ff5153b7640 1 -- 172.21.15.50:0/3973094534 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5100cc130 con 0x7ff4fc06be30 2024-09-11T22:23:33.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.196+0000 7ff4f77fe640 1 -- 172.21.15.50:0/3973094534 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246154 (secure 0 0 0) 0x7ff5100cc130 con 0x7ff4fc06be30 2024-09-11T22:23:33.199 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:23:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.198+0000 7ff5153b7640 1 -- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff4fc06be30 msgr2=0x7ff4fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.198+0000 7ff5153b7640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff4fc06be30 0x7ff4fc06e2f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff5000011e0 tx=0x7ff500009040 comp rx=0 tx=0).stop 2024-09-11T22:23:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.198+0000 7ff5153b7640 1 -- 172.21.15.50:0/3973094534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff51015aad0 msgr2=0x7ff5100ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.198+0000 7ff5153b7640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff51015aad0 0x7ff5100ae890 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7ff508035040 tx=0x7ff508004a40 comp rx=0 tx=0).stop 2024-09-11T22:23:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.199+0000 7ff5153b7640 1 -- 172.21.15.50:0/3973094534 shutdown_connections 2024-09-11T22:23:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.199+0000 7ff5153b7640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff4fc06be30 0x7ff4fc06e2f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.199+0000 7ff5153b7640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff510072cb0 0x7ff5100c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.199+0000 7ff5153b7640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff51015aad0 0x7ff5100ae890 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.199+0000 7ff5153b7640 1 --2- 172.21.15.50:0/3973094534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51006d780 0x7ff5100c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.199+0000 7ff5153b7640 1 -- 172.21.15.50:0/3973094534 >> 172.21.15.50:0/3973094534 conn(0x7ff5100679c0 msgr2=0x7ff5100cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.199+0000 7ff5153b7640 1 -- 172.21.15.50:0/3973094534 shutdown_connections 2024-09-11T22:23:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.199+0000 7ff5153b7640 1 -- 172.21.15.50:0/3973094534 wait complete. 2024-09-11T22:23:33.210 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2024-09-11T22:23:31.542831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":434288,"kb_used_data":19580,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754540432,"statfs":{"total":773094113280,"available":772649402368,"internally_reserved":0,"allocated":20049920,"data_stored":9453427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":424463921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031425"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521815+0000","last_change":"2024-09-11T22:23:28.521815+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521815+0000","last_undegraded":"2024-09-11T22:23:28.521815+0000","last_fullsized":"2024-09-11T22:23:28.521815+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.525336+0000","last_change":"2024-09-11T22:23:28.525336+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.525336+0000","last_undegraded":"2024-09-11T22:23:28.525336+0000","last_fullsized":"2024-09-11T22:23:28.525336+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.529760+0000","last_change":"2024-09-11T22:23:28.529760+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.529760+0000","last_undegraded":"2024-09-11T22:23:28.529760+0000","last_fullsized":"2024-09-11T22:23:28.529760+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527739+0000","last_change":"2024-09-11T22:23:28.527739+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527739+0000","last_undegraded":"2024-09-11T22:23:28.527739+0000","last_fullsized":"2024-09-11T22:23:28.527739+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522938+0000","last_change":"2024-09-11T22:23:28.522938+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522938+0000","last_undegraded":"2024-09-11T22:23:28.522938+0000","last_fullsized":"2024-09-11T22:23:28.522938+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.525322+0000","last_change":"2024-09-11T22:23:28.525322+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.525322+0000","last_undegraded":"2024-09-11T22:23:28.525322+0000","last_fullsized":"2024-09-11T22:23:28.525322+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.541990+0000","last_change":"2024-09-11T22:23:29.526180+0000","last_active":"2024-09-11T22:23:30.541990+0000","last_peered":"2024-09-11T22:23:30.541990+0000","last_clean":"2024-09-11T22:23:30.541990+0000","last_became_active":"2024-09-11T22:23:29.525856+0000","last_became_peered":"2024-09-11T22:23:29.525856+0000","last_unstale":"2024-09-11T22:23:30.541990+0000","last_undegraded":"2024-09-11T22:23:30.541990+0000","last_fullsized":"2024-09-11T22:23:30.541990+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:01.977359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528066+0000","last_change":"2024-09-11T22:23:28.528066+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528066+0000","last_undegraded":"2024-09-11T22:23:28.528066+0000","last_fullsized":"2024-09-11T22:23:28.528066+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522407+0000","last_change":"2024-09-11T22:23:28.522407+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522407+0000","last_undegraded":"2024-09-11T22:23:28.522407+0000","last_fullsized":"2024-09-11T22:23:28.522407+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522074+0000","last_change":"2024-09-11T22:23:28.522074+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522074+0000","last_undegraded":"2024-09-11T22:23:28.522074+0000","last_fullsized":"2024-09-11T22:23:28.522074+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521478+0000","last_change":"2024-09-11T22:23:28.521478+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521478+0000","last_undegraded":"2024-09-11T22:23:28.521478+0000","last_fullsized":"2024-09-11T22:23:28.521478+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520953+0000","last_change":"2024-09-11T22:23:28.520953+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520953+0000","last_undegraded":"2024-09-11T22:23:28.520953+0000","last_fullsized":"2024-09-11T22:23:28.520953+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.529557+0000","last_change":"2024-09-11T22:23:28.529557+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.529557+0000","last_undegraded":"2024-09-11T22:23:28.529557+0000","last_fullsized":"2024-09-11T22:23:28.529557+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521354+0000","last_change":"2024-09-11T22:23:28.521354+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521354+0000","last_undegraded":"2024-09-11T22:23:28.521354+0000","last_fullsized":"2024-09-11T22:23:28.521354+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522057+0000","last_change":"2024-09-11T22:23:28.522057+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522057+0000","last_undegraded":"2024-09-11T22:23:28.522057+0000","last_fullsized":"2024-09-11T22:23:28.522057+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521871+0000","last_change":"2024-09-11T22:23:28.521871+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521871+0000","last_undegraded":"2024-09-11T22:23:28.521871+0000","last_fullsized":"2024-09-11T22:23:28.521871+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527806+0000","last_change":"2024-09-11T22:23:28.527806+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527806+0000","last_undegraded":"2024-09-11T22:23:28.527806+0000","last_fullsized":"2024-09-11T22:23:28.527806+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522410+0000","last_change":"2024-09-11T22:23:28.522410+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522410+0000","last_undegraded":"2024-09-11T22:23:28.522410+0000","last_fullsized":"2024-09-11T22:23:28.522410+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527298+0000","last_change":"2024-09-11T22:23:28.527298+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527298+0000","last_undegraded":"2024-09-11T22:23:28.527298+0000","last_fullsized":"2024-09-11T22:23:28.527298+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528117+0000","last_change":"2024-09-11T22:23:28.528117+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528117+0000","last_undegraded":"2024-09-11T22:23:28.528117+0000","last_fullsized":"2024-09-11T22:23:28.528117+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526592+0000","last_change":"2024-09-11T22:23:28.526592+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526592+0000","last_undegraded":"2024-09-11T22:23:28.526592+0000","last_fullsized":"2024-09-11T22:23:28.526592+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542327+0000","last_change":"2024-09-11T22:23:29.533731+0000","last_active":"2024-09-11T22:23:30.542327+0000","last_peered":"2024-09-11T22:23:30.542327+0000","last_clean":"2024-09-11T22:23:30.542327+0000","last_became_active":"2024-09-11T22:23:29.532721+0000","last_became_peered":"2024-09-11T22:23:29.532721+0000","last_unstale":"2024-09-11T22:23:30.542327+0000","last_undegraded":"2024-09-11T22:23:30.542327+0000","last_fullsized":"2024-09-11T22:23:30.542327+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:01.286972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521958+0000","last_change":"2024-09-11T22:23:28.521958+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521958+0000","last_undegraded":"2024-09-11T22:23:28.521958+0000","last_fullsized":"2024-09-11T22:23:28.521958+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521683+0000","last_change":"2024-09-11T22:23:28.521683+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521683+0000","last_undegraded":"2024-09-11T22:23:28.521683+0000","last_fullsized":"2024-09-11T22:23:28.521683+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.530987+0000","last_change":"2024-09-11T22:23:28.530987+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.530987+0000","last_undegraded":"2024-09-11T22:23:28.530987+0000","last_fullsized":"2024-09-11T22:23:28.530987+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526019+0000","last_change":"2024-09-11T22:23:28.526019+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526019+0000","last_undegraded":"2024-09-11T22:23:28.526019+0000","last_fullsized":"2024-09-11T22:23:28.526019+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.524336+0000","last_change":"2024-09-11T22:23:28.524336+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.524336+0000","last_undegraded":"2024-09-11T22:23:28.524336+0000","last_fullsized":"2024-09-11T22:23:28.524336+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534341+0000","last_change":"2024-09-11T22:23:28.533479+0000","last_active":"2024-09-11T22:23:28.534341+0000","last_peered":"2024-09-11T22:23:28.534341+0000","last_clean":"2024-09-11T22:23:28.534341+0000","last_became_active":"2024-09-11T22:23:28.533187+0000","last_became_peered":"2024-09-11T22:23:28.533187+0000","last_unstale":"2024-09-11T22:23:28.534341+0000","last_undegraded":"2024-09-11T22:23:28.534341+0000","last_fullsized":"2024-09-11T22:23:28.534341+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:52.004425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542369+0000","last_change":"2024-09-11T22:23:29.536415+0000","last_active":"2024-09-11T22:23:30.542369+0000","last_peered":"2024-09-11T22:23:30.542369+0000","last_clean":"2024-09-11T22:23:30.542369+0000","last_became_active":"2024-09-11T22:23:29.536111+0000","last_became_peered":"2024-09-11T22:23:29.536111+0000","last_unstale":"2024-09-11T22:23:30.542369+0000","last_undegraded":"2024-09-11T22:23:30.542369+0000","last_fullsized":"2024-09-11T22:23:30.542369+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:47.495340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531316+0000","last_change":"2024-09-11T22:23:28.530365+0000","last_active":"2024-09-11T22:23:28.531316+0000","last_peered":"2024-09-11T22:23:28.531316+0000","last_clean":"2024-09-11T22:23:28.531316+0000","last_became_active":"2024-09-11T22:23:28.530069+0000","last_became_peered":"2024-09-11T22:23:28.530069+0000","last_unstale":"2024-09-11T22:23:28.531316+0000","last_undegraded":"2024-09-11T22:23:28.531316+0000","last_fullsized":"2024-09-11T22:23:28.531316+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:23.081602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520583+0000","last_change":"2024-09-11T22:23:28.520583+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520583+0000","last_undegraded":"2024-09-11T22:23:28.520583+0000","last_fullsized":"2024-09-11T22:23:28.520583+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.529721+0000","last_change":"2024-09-11T22:23:28.528837+0000","last_active":"2024-09-11T22:23:28.529721+0000","last_peered":"2024-09-11T22:23:28.529721+0000","last_clean":"2024-09-11T22:23:28.529721+0000","last_became_active":"2024-09-11T22:23:28.528534+0000","last_became_peered":"2024-09-11T22:23:28.528534+0000","last_unstale":"2024-09-11T22:23:28.529721+0000","last_undegraded":"2024-09-11T22:23:28.529721+0000","last_fullsized":"2024-09-11T22:23:28.529721+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:54.377250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1b","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542149+0000","last_change":"2024-09-11T22:23:28.527628+0000","last_active":"2024-09-11T22:23:30.542149+0000","last_peered":"2024-09-11T22:23:30.542149+0000","last_clean":"2024-09-11T22:23:30.542149+0000","last_became_active":"2024-09-11T22:23:28.527319+0000","last_became_peered":"2024-09-11T22:23:28.527319+0000","last_unstale":"2024-09-11T22:23:30.542149+0000","last_undegraded":"2024-09-11T22:23:30.542149+0000","last_fullsized":"2024-09-11T22:23:30.542149+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:25.526650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526841+0000","last_change":"2024-09-11T22:23:28.526841+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526841+0000","last_undegraded":"2024-09-11T22:23:28.526841+0000","last_fullsized":"2024-09-11T22:23:28.526841+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.532396+0000","last_change":"2024-09-11T22:23:28.531543+0000","last_active":"2024-09-11T22:23:28.532396+0000","last_peered":"2024-09-11T22:23:28.532396+0000","last_clean":"2024-09-11T22:23:28.532396+0000","last_became_active":"2024-09-11T22:23:28.531271+0000","last_became_peered":"2024-09-11T22:23:28.531271+0000","last_unstale":"2024-09-11T22:23:28.532396+0000","last_undegraded":"2024-09-11T22:23:28.532396+0000","last_fullsized":"2024-09-11T22:23:28.532396+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:00.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521842+0000","last_change":"2024-09-11T22:23:28.521842+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521842+0000","last_undegraded":"2024-09-11T22:23:28.521842+0000","last_fullsized":"2024-09-11T22:23:28.521842+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.527014+0000","last_change":"2024-09-11T22:23:28.525318+0000","last_active":"2024-09-11T22:23:28.527014+0000","last_peered":"2024-09-11T22:23:28.527014+0000","last_clean":"2024-09-11T22:23:28.527014+0000","last_became_active":"2024-09-11T22:23:28.525023+0000","last_became_peered":"2024-09-11T22:23:28.525023+0000","last_unstale":"2024-09-11T22:23:28.527014+0000","last_undegraded":"2024-09-11T22:23:28.527014+0000","last_fullsized":"2024-09-11T22:23:28.527014+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.555667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520614+0000","last_change":"2024-09-11T22:23:28.520614+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520614+0000","last_undegraded":"2024-09-11T22:23:28.520614+0000","last_fullsized":"2024-09-11T22:23:28.520614+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.529406+0000","last_change":"2024-09-11T22:23:28.527081+0000","last_active":"2024-09-11T22:23:28.529406+0000","last_peered":"2024-09-11T22:23:28.529406+0000","last_clean":"2024-09-11T22:23:28.529406+0000","last_became_active":"2024-09-11T22:23:28.526812+0000","last_became_peered":"2024-09-11T22:23:28.526812+0000","last_unstale":"2024-09-11T22:23:28.529406+0000","last_undegraded":"2024-09-11T22:23:28.529406+0000","last_fullsized":"2024-09-11T22:23:28.529406+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:54.132096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520931+0000","last_change":"2024-09-11T22:23:28.520931+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520931+0000","last_undegraded":"2024-09-11T22:23:28.520931+0000","last_fullsized":"2024-09-11T22:23:28.520931+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:27.504517+0000","last_change":"2024-09-11T22:23:27.504517+0000","last_active":"2024-09-11T22:23:27.504517+0000","last_peered":"2024-09-11T22:23:27.504517+0000","last_clean":"2024-09-11T22:23:27.504517+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:27.504517+0000","last_undegraded":"2024-09-11T22:23:27.504517+0000","last_fullsized":"2024-09-11T22:23:27.504517+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.529435+0000","last_change":"2024-09-11T22:23:28.528735+0000","last_active":"2024-09-11T22:23:28.529435+0000","last_peered":"2024-09-11T22:23:28.529435+0000","last_clean":"2024-09-11T22:23:28.529435+0000","last_became_active":"2024-09-11T22:23:28.528439+0000","last_became_peered":"2024-09-11T22:23:28.528439+0000","last_unstale":"2024-09-11T22:23:28.529435+0000","last_undegraded":"2024-09-11T22:23:28.529435+0000","last_fullsized":"2024-09-11T22:23:28.529435+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:45.684076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520387+0000","last_change":"2024-09-11T22:23:28.520387+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520387+0000","last_undegraded":"2024-09-11T22:23:28.520387+0000","last_fullsized":"2024-09-11T22:23:28.520387+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.540499+0000","last_change":"2024-09-11T22:23:28.538934+0000","last_active":"2024-09-11T22:23:28.540499+0000","last_peered":"2024-09-11T22:23:28.540499+0000","last_clean":"2024-09-11T22:23:28.540499+0000","last_became_active":"2024-09-11T22:23:28.538183+0000","last_became_peered":"2024-09-11T22:23:28.538183+0000","last_unstale":"2024-09-11T22:23:28.540499+0000","last_undegraded":"2024-09-11T22:23:28.540499+0000","last_fullsized":"2024-09-11T22:23:28.540499+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:16.512571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531636+0000","last_change":"2024-09-11T22:23:28.529858+0000","last_active":"2024-09-11T22:23:28.531636+0000","last_peered":"2024-09-11T22:23:28.531636+0000","last_clean":"2024-09-11T22:23:28.531636+0000","last_became_active":"2024-09-11T22:23:28.529559+0000","last_became_peered":"2024-09-11T22:23:28.529559+0000","last_unstale":"2024-09-11T22:23:28.531636+0000","last_undegraded":"2024-09-11T22:23:28.531636+0000","last_fullsized":"2024-09-11T22:23:28.531636+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:25.609039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526401+0000","last_change":"2024-09-11T22:23:28.526401+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526401+0000","last_undegraded":"2024-09-11T22:23:28.526401+0000","last_fullsized":"2024-09-11T22:23:28.526401+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542211+0000","last_change":"2024-09-11T22:23:28.533696+0000","last_active":"2024-09-11T22:23:30.542211+0000","last_peered":"2024-09-11T22:23:30.542211+0000","last_clean":"2024-09-11T22:23:30.542211+0000","last_became_active":"2024-09-11T22:23:28.533412+0000","last_became_peered":"2024-09-11T22:23:28.533412+0000","last_unstale":"2024-09-11T22:23:30.542211+0000","last_undegraded":"2024-09-11T22:23:30.542211+0000","last_fullsized":"2024-09-11T22:23:30.542211+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:56.393853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.529550+0000","last_change":"2024-09-11T22:23:28.529550+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.529550+0000","last_undegraded":"2024-09-11T22:23:28.529550+0000","last_fullsized":"2024-09-11T22:23:28.529550+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.525004+0000","last_change":"2024-09-11T22:23:28.524567+0000","last_active":"2024-09-11T22:23:28.525004+0000","last_peered":"2024-09-11T22:23:28.525004+0000","last_clean":"2024-09-11T22:23:28.525004+0000","last_became_active":"2024-09-11T22:23:28.524261+0000","last_became_peered":"2024-09-11T22:23:28.524261+0000","last_unstale":"2024-09-11T22:23:28.525004+0000","last_undegraded":"2024-09-11T22:23:28.525004+0000","last_fullsized":"2024-09-11T22:23:28.525004+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:25.609039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527406+0000","last_change":"2024-09-11T22:23:28.527406+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527406+0000","last_undegraded":"2024-09-11T22:23:28.527406+0000","last_fullsized":"2024-09-11T22:23:28.527406+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.541049+0000","last_change":"2024-09-11T22:23:28.540359+0000","last_active":"2024-09-11T22:23:28.541049+0000","last_peered":"2024-09-11T22:23:28.541049+0000","last_clean":"2024-09-11T22:23:28.541049+0000","last_became_active":"2024-09-11T22:23:28.540041+0000","last_became_peered":"2024-09-11T22:23:28.540041+0000","last_unstale":"2024-09-11T22:23:28.541049+0000","last_undegraded":"2024-09-11T22:23:28.541049+0000","last_fullsized":"2024-09-11T22:23:28.541049+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:37.296359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520108+0000","last_change":"2024-09-11T22:23:28.520108+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520108+0000","last_undegraded":"2024-09-11T22:23:28.520108+0000","last_fullsized":"2024-09-11T22:23:28.520108+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.535368+0000","last_change":"2024-09-11T22:23:28.534953+0000","last_active":"2024-09-11T22:23:28.535368+0000","last_peered":"2024-09-11T22:23:28.535368+0000","last_clean":"2024-09-11T22:23:28.535368+0000","last_became_active":"2024-09-11T22:23:28.534637+0000","last_became_peered":"2024-09-11T22:23:28.534637+0000","last_unstale":"2024-09-11T22:23:28.535368+0000","last_undegraded":"2024-09-11T22:23:28.535368+0000","last_fullsized":"2024-09-11T22:23:28.535368+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.555667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542341+0000","last_change":"2024-09-11T22:23:29.527227+0000","last_active":"2024-09-11T22:23:30.542341+0000","last_peered":"2024-09-11T22:23:30.542341+0000","last_clean":"2024-09-11T22:23:30.542341+0000","last_became_active":"2024-09-11T22:23:29.526934+0000","last_became_peered":"2024-09-11T22:23:29.526934+0000","last_unstale":"2024-09-11T22:23:30.542341+0000","last_undegraded":"2024-09-11T22:23:30.542341+0000","last_fullsized":"2024-09-11T22:23:30.542341+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:55.674466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534454+0000","last_change":"2024-09-11T22:23:28.532266+0000","last_active":"2024-09-11T22:23:28.534454+0000","last_peered":"2024-09-11T22:23:28.534454+0000","last_clean":"2024-09-11T22:23:28.534454+0000","last_became_active":"2024-09-11T22:23:28.531883+0000","last_became_peered":"2024-09-11T22:23:28.531883+0000","last_unstale":"2024-09-11T22:23:28.534454+0000","last_undegraded":"2024-09-11T22:23:28.534454+0000","last_fullsized":"2024-09-11T22:23:28.534454+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:12.662086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521404+0000","last_change":"2024-09-11T22:23:28.521404+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521404+0000","last_undegraded":"2024-09-11T22:23:28.521404+0000","last_fullsized":"2024-09-11T22:23:28.521404+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.536442+0000","last_change":"2024-09-11T22:23:28.535869+0000","last_active":"2024-09-11T22:23:28.536442+0000","last_peered":"2024-09-11T22:23:28.536442+0000","last_clean":"2024-09-11T22:23:28.536442+0000","last_became_active":"2024-09-11T22:23:28.535425+0000","last_became_peered":"2024-09-11T22:23:28.535425+0000","last_unstale":"2024-09-11T22:23:28.536442+0000","last_undegraded":"2024-09-11T22:23:28.536442+0000","last_fullsized":"2024-09-11T22:23:28.536442+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:54.420567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527510+0000","last_change":"2024-09-11T22:23:28.527510+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527510+0000","last_undegraded":"2024-09-11T22:23:28.527510+0000","last_fullsized":"2024-09-11T22:23:28.527510+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:27.504517+0000","last_change":"2024-09-11T22:23:27.504517+0000","last_active":"2024-09-11T22:23:27.504517+0000","last_peered":"2024-09-11T22:23:27.504517+0000","last_clean":"2024-09-11T22:23:27.504517+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:27.504517+0000","last_undegraded":"2024-09-11T22:23:27.504517+0000","last_fullsized":"2024-09-11T22:23:27.504517+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.524913+0000","last_change":"2024-09-11T22:23:28.524913+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.524913+0000","last_undegraded":"2024-09-11T22:23:28.524913+0000","last_fullsized":"2024-09-11T22:23:28.524913+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.540690+0000","last_change":"2024-09-11T22:23:28.536841+0000","last_active":"2024-09-11T22:23:28.540690+0000","last_peered":"2024-09-11T22:23:28.540690+0000","last_clean":"2024-09-11T22:23:28.540690+0000","last_became_active":"2024-09-11T22:23:28.536520+0000","last_became_peered":"2024-09-11T22:23:28.536520+0000","last_unstale":"2024-09-11T22:23:28.540690+0000","last_undegraded":"2024-09-11T22:23:28.540690+0000","last_fullsized":"2024-09-11T22:23:28.540690+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:45.684076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527075+0000","last_change":"2024-09-11T22:23:28.527075+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527075+0000","last_undegraded":"2024-09-11T22:23:28.527075+0000","last_fullsized":"2024-09-11T22:23:28.527075+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.538652+0000","last_change":"2024-09-11T22:23:28.537499+0000","last_active":"2024-09-11T22:23:28.538652+0000","last_peered":"2024-09-11T22:23:28.538652+0000","last_clean":"2024-09-11T22:23:28.538652+0000","last_became_active":"2024-09-11T22:23:28.537241+0000","last_became_peered":"2024-09-11T22:23:28.537241+0000","last_unstale":"2024-09-11T22:23:28.538652+0000","last_undegraded":"2024-09-11T22:23:28.538652+0000","last_fullsized":"2024-09-11T22:23:28.538652+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:01.375011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528136+0000","last_change":"2024-09-11T22:23:28.528136+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528136+0000","last_undegraded":"2024-09-11T22:23:28.528136+0000","last_fullsized":"2024-09-11T22:23:28.528136+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531563+0000","last_change":"2024-09-11T22:23:28.530647+0000","last_active":"2024-09-11T22:23:28.531563+0000","last_peered":"2024-09-11T22:23:28.531563+0000","last_clean":"2024-09-11T22:23:28.531563+0000","last_became_active":"2024-09-11T22:23:28.530268+0000","last_became_peered":"2024-09-11T22:23:28.530268+0000","last_unstale":"2024-09-11T22:23:28.531563+0000","last_undegraded":"2024-09-11T22:23:28.531563+0000","last_fullsized":"2024-09-11T22:23:28.531563+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:46:18.742814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542012+0000","last_change":"2024-09-11T22:23:29.528818+0000","last_active":"2024-09-11T22:23:30.542012+0000","last_peered":"2024-09-11T22:23:30.542012+0000","last_clean":"2024-09-11T22:23:30.542012+0000","last_became_active":"2024-09-11T22:23:29.528503+0000","last_became_peered":"2024-09-11T22:23:29.528503+0000","last_unstale":"2024-09-11T22:23:30.542012+0000","last_undegraded":"2024-09-11T22:23:30.542012+0000","last_fullsized":"2024-09-11T22:23:30.542012+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:05.893484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534169+0000","last_change":"2024-09-11T22:23:28.533383+0000","last_active":"2024-09-11T22:23:28.534169+0000","last_peered":"2024-09-11T22:23:28.534169+0000","last_clean":"2024-09-11T22:23:28.534169+0000","last_became_active":"2024-09-11T22:23:28.533009+0000","last_became_peered":"2024-09-11T22:23:28.533009+0000","last_unstale":"2024-09-11T22:23:28.534169+0000","last_undegraded":"2024-09-11T22:23:28.534169+0000","last_fullsized":"2024-09-11T22:23:28.534169+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:12.662086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.530590+0000","last_change":"2024-09-11T22:23:28.530590+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.530590+0000","last_undegraded":"2024-09-11T22:23:28.530590+0000","last_fullsized":"2024-09-11T22:23:28.530590+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534512+0000","last_change":"2024-09-11T22:23:28.533228+0000","last_active":"2024-09-11T22:23:28.534512+0000","last_peered":"2024-09-11T22:23:28.534512+0000","last_clean":"2024-09-11T22:23:28.534512+0000","last_became_active":"2024-09-11T22:23:28.532945+0000","last_became_peered":"2024-09-11T22:23:28.532945+0000","last_unstale":"2024-09-11T22:23:28.534512+0000","last_undegraded":"2024-09-11T22:23:28.534512+0000","last_fullsized":"2024-09-11T22:23:28.534512+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.673122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528185+0000","last_change":"2024-09-11T22:23:28.528185+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528185+0000","last_undegraded":"2024-09-11T22:23:28.528185+0000","last_fullsized":"2024-09-11T22:23:28.528185+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.541398+0000","last_change":"2024-09-11T22:23:28.539834+0000","last_active":"2024-09-11T22:23:28.541398+0000","last_peered":"2024-09-11T22:23:28.541398+0000","last_clean":"2024-09-11T22:23:28.541398+0000","last_became_active":"2024-09-11T22:23:28.539533+0000","last_became_peered":"2024-09-11T22:23:28.539533+0000","last_unstale":"2024-09-11T22:23:28.541398+0000","last_undegraded":"2024-09-11T22:23:28.541398+0000","last_fullsized":"2024-09-11T22:23:28.541398+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:46.075605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527147+0000","last_change":"2024-09-11T22:23:28.527147+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527147+0000","last_undegraded":"2024-09-11T22:23:28.527147+0000","last_fullsized":"2024-09-11T22:23:28.527147+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:27.504517+0000","last_change":"2024-09-11T22:23:27.504517+0000","last_active":"2024-09-11T22:23:27.504517+0000","last_peered":"2024-09-11T22:23:27.504517+0000","last_clean":"2024-09-11T22:23:27.504517+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:27.504517+0000","last_undegraded":"2024-09-11T22:23:27.504517+0000","last_fullsized":"2024-09-11T22:23:27.504517+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527083+0000","last_change":"2024-09-11T22:23:28.527083+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527083+0000","last_undegraded":"2024-09-11T22:23:28.527083+0000","last_fullsized":"2024-09-11T22:23:28.527083+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:27.504517+0000","last_change":"2024-09-11T22:23:27.504517+0000","last_active":"2024-09-11T22:23:27.504517+0000","last_peered":"2024-09-11T22:23:27.504517+0000","last_clean":"2024-09-11T22:23:27.504517+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:27.504517+0000","last_undegraded":"2024-09-11T22:23:27.504517+0000","last_fullsized":"2024-09-11T22:23:27.504517+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.531504+0000","last_change":"2024-09-11T22:23:28.531504+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.531504+0000","last_undegraded":"2024-09-11T22:23:28.531504+0000","last_fullsized":"2024-09-11T22:23:28.531504+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.539220+0000","last_change":"2024-09-11T22:23:28.538694+0000","last_active":"2024-09-11T22:23:28.539220+0000","last_peered":"2024-09-11T22:23:28.539220+0000","last_clean":"2024-09-11T22:23:28.539220+0000","last_became_active":"2024-09-11T22:23:28.538434+0000","last_became_peered":"2024-09-11T22:23:28.538434+0000","last_unstale":"2024-09-11T22:23:28.539220+0000","last_undegraded":"2024-09-11T22:23:28.539220+0000","last_fullsized":"2024-09-11T22:23:28.539220+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:46.891077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.519844+0000","last_change":"2024-09-11T22:23:28.519844+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.519844+0000","last_undegraded":"2024-09-11T22:23:28.519844+0000","last_fullsized":"2024-09-11T22:23:28.519844+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.536914+0000","last_change":"2024-09-11T22:23:28.535813+0000","last_active":"2024-09-11T22:23:28.536914+0000","last_peered":"2024-09-11T22:23:28.536914+0000","last_clean":"2024-09-11T22:23:28.536914+0000","last_became_active":"2024-09-11T22:23:28.535523+0000","last_became_peered":"2024-09-11T22:23:28.535523+0000","last_unstale":"2024-09-11T22:23:28.536914+0000","last_undegraded":"2024-09-11T22:23:28.536914+0000","last_fullsized":"2024-09-11T22:23:28.536914+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:59.580534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526821+0000","last_change":"2024-09-11T22:23:28.526821+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526821+0000","last_undegraded":"2024-09-11T22:23:28.526821+0000","last_fullsized":"2024-09-11T22:23:28.526821+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531088+0000","last_change":"2024-09-11T22:23:28.530346+0000","last_active":"2024-09-11T22:23:28.531088+0000","last_peered":"2024-09-11T22:23:28.531088+0000","last_clean":"2024-09-11T22:23:28.531088+0000","last_became_active":"2024-09-11T22:23:28.530073+0000","last_became_peered":"2024-09-11T22:23:28.530073+0000","last_unstale":"2024-09-11T22:23:28.531088+0000","last_undegraded":"2024-09-11T22:23:28.531088+0000","last_fullsized":"2024-09-11T22:23:28.531088+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:05.774908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527000+0000","last_change":"2024-09-11T22:23:28.527000+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527000+0000","last_undegraded":"2024-09-11T22:23:28.527000+0000","last_fullsized":"2024-09-11T22:23:28.527000+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.540998+0000","last_change":"2024-09-11T22:23:28.539672+0000","last_active":"2024-09-11T22:23:28.540998+0000","last_peered":"2024-09-11T22:23:28.540998+0000","last_clean":"2024-09-11T22:23:28.540998+0000","last_became_active":"2024-09-11T22:23:28.539297+0000","last_became_peered":"2024-09-11T22:23:28.539297+0000","last_unstale":"2024-09-11T22:23:28.540998+0000","last_undegraded":"2024-09-11T22:23:28.540998+0000","last_fullsized":"2024-09-11T22:23:28.540998+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:57.831523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534492+0000","last_change":"2024-09-11T22:23:28.533170+0000","last_active":"2024-09-11T22:23:28.534492+0000","last_peered":"2024-09-11T22:23:28.534492+0000","last_clean":"2024-09-11T22:23:28.534492+0000","last_became_active":"2024-09-11T22:23:28.532610+0000","last_became_peered":"2024-09-11T22:23:28.532610+0000","last_unstale":"2024-09-11T22:23:28.534492+0000","last_undegraded":"2024-09-11T22:23:28.534492+0000","last_fullsized":"2024-09-11T22:23:28.534492+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:59.580534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T22:23:28.510780+0000","last_change":"2024-09-11T22:23:28.510780+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.510780+0000","last_undegraded":"2024-09-11T22:23:28.510780+0000","last_fullsized":"2024-09-11T22:23:28.510780+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531593+0000","last_change":"2024-09-11T22:23:28.530787+0000","last_active":"2024-09-11T22:23:28.531593+0000","last_peered":"2024-09-11T22:23:28.531593+0000","last_clean":"2024-09-11T22:23:28.531593+0000","last_became_active":"2024-09-11T22:23:28.530333+0000","last_became_peered":"2024-09-11T22:23:28.530333+0000","last_unstale":"2024-09-11T22:23:28.531593+0000","last_undegraded":"2024-09-11T22:23:28.531593+0000","last_fullsized":"2024-09-11T22:23:28.531593+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:00.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":466,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T22:23:25.856533+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:23:25.856533+0000","last_peered":"2024-09-11T22:23:25.856533+0000","last_clean":"2024-09-11T22:23:25.856533+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:23:25.856533+0000","last_undegraded":"2024-09-11T22:23:25.856533+0000","last_fullsized":"2024-09-11T22:23:25.856533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":56,"acting":56,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509594,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55700,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316140,"statfs":{"total":96636764160,"available":96579727360,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51540,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320300,"statfs":{"total":96636764160,"available":96583987200,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509593,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64020,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307820,"statfs":{"total":96636764160,"available":96571207680,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47376,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324464,"statfs":{"total":96636764160,"available":96588251136,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47380,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324460,"statfs":{"total":96636764160,"available":96588247040,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509592,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60436,"kb_used_data":2880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311404,"statfs":{"total":96636764160,"available":96574877696,"internally_reserved":0,"allocated":2949120,"data_stored":1624123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60412,"kb_used_data":2856,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311428,"statfs":{"total":96636764160,"available":96574902272,"internally_reserved":0,"allocated":2924544,"data_stored":1612031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47424,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324416,"statfs":{"total":96636764160,"available":96588201984,"internally_reserved":0,"allocated":2400256,"data_stored":1048498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:23:33.214 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3f is not active+clean 2024-09-11T22:23:33.214 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:28.510780+0000', 'last_change': '2024-09-11T22:23:28.510780+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.510780+0000', 'last_undegraded': '2024-09-11T22:23:28.510780+0000', 'last_fullsized': '2024-09-11T22:23:28.510780+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.214 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3e is not active+clean 2024-09-11T22:23:33.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.521815+0000', 'last_change': '2024-09-11T22:23:28.521815+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.521815+0000', 'last_undegraded': '2024-09-11T22:23:28.521815+0000', 'last_fullsized': '2024-09-11T22:23:28.521815+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:23:33.215 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3d is not active+clean 2024-09-11T22:23:33.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.525336+0000', 'last_change': '2024-09-11T22:23:28.525336+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.525336+0000', 'last_undegraded': '2024-09-11T22:23:28.525336+0000', 'last_fullsized': '2024-09-11T22:23:28.525336+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:23:33.215 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3c is not active+clean 2024-09-11T22:23:33.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.529760+0000', 'last_change': '2024-09-11T22:23:28.529760+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.529760+0000', 'last_undegraded': '2024-09-11T22:23:28.529760+0000', 'last_fullsized': '2024-09-11T22:23:28.529760+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:23:33.215 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3b is not active+clean 2024-09-11T22:23:33.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.527739+0000', 'last_change': '2024-09-11T22:23:28.527739+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.527739+0000', 'last_undegraded': '2024-09-11T22:23:28.527739+0000', 'last_fullsized': '2024-09-11T22:23:28.527739+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:23:33.215 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3a is not active+clean 2024-09-11T22:23:33.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.522938+0000', 'last_change': '2024-09-11T22:23:28.522938+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.522938+0000', 'last_undegraded': '2024-09-11T22:23:28.522938+0000', 'last_fullsized': '2024-09-11T22:23:28.522938+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:23:33.215 INFO:tasks.ceph.ceph_manager.ceph:PG 29.39 is not active+clean 2024-09-11T22:23:33.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.525322+0000', 'last_change': '2024-09-11T22:23:28.525322+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.525322+0000', 'last_undegraded': '2024-09-11T22:23:28.525322+0000', 'last_fullsized': '2024-09-11T22:23:28.525322+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:23:33.216 INFO:tasks.ceph.ceph_manager.ceph:PG 29.37 is not active+clean 2024-09-11T22:23:33.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.528066+0000', 'last_change': '2024-09-11T22:23:28.528066+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.528066+0000', 'last_undegraded': '2024-09-11T22:23:28.528066+0000', 'last_fullsized': '2024-09-11T22:23:28.528066+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:23:33.216 INFO:tasks.ceph.ceph_manager.ceph:PG 29.36 is not active+clean 2024-09-11T22:23:33.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.522407+0000', 'last_change': '2024-09-11T22:23:28.522407+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.522407+0000', 'last_undegraded': '2024-09-11T22:23:28.522407+0000', 'last_fullsized': '2024-09-11T22:23:28.522407+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:23:33.216 INFO:tasks.ceph.ceph_manager.ceph:PG 29.35 is not active+clean 2024-09-11T22:23:33.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:28.510780+0000', 'last_change': '2024-09-11T22:23:28.510780+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.510780+0000', 'last_undegraded': '2024-09-11T22:23:28.510780+0000', 'last_fullsized': '2024-09-11T22:23:28.510780+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.216 INFO:tasks.ceph.ceph_manager.ceph:PG 29.34 is not active+clean 2024-09-11T22:23:33.217 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.522074+0000', 'last_change': '2024-09-11T22:23:28.522074+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.522074+0000', 'last_undegraded': '2024-09-11T22:23:28.522074+0000', 'last_fullsized': '2024-09-11T22:23:28.522074+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:23:33.217 INFO:tasks.ceph.ceph_manager.ceph:PG 29.33 is not active+clean 2024-09-11T22:23:33.217 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.521478+0000', 'last_change': '2024-09-11T22:23:28.521478+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.521478+0000', 'last_undegraded': '2024-09-11T22:23:28.521478+0000', 'last_fullsized': '2024-09-11T22:23:28.521478+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:23:33.217 INFO:tasks.ceph.ceph_manager.ceph:PG 29.32 is not active+clean 2024-09-11T22:23:33.217 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.520953+0000', 'last_change': '2024-09-11T22:23:28.520953+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.520953+0000', 'last_undegraded': '2024-09-11T22:23:28.520953+0000', 'last_fullsized': '2024-09-11T22:23:28.520953+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:23:33.218 INFO:tasks.ceph.ceph_manager.ceph:PG 29.31 is not active+clean 2024-09-11T22:23:33.218 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.529557+0000', 'last_change': '2024-09-11T22:23:28.529557+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.529557+0000', 'last_undegraded': '2024-09-11T22:23:28.529557+0000', 'last_fullsized': '2024-09-11T22:23:28.529557+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:23:33.218 INFO:tasks.ceph.ceph_manager.ceph:PG 29.30 is not active+clean 2024-09-11T22:23:33.218 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.521354+0000', 'last_change': '2024-09-11T22:23:28.521354+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.521354+0000', 'last_undegraded': '2024-09-11T22:23:28.521354+0000', 'last_fullsized': '2024-09-11T22:23:28.521354+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:23:33.218 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2f is not active+clean 2024-09-11T22:23:33.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.522057+0000', 'last_change': '2024-09-11T22:23:28.522057+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.522057+0000', 'last_undegraded': '2024-09-11T22:23:28.522057+0000', 'last_fullsized': '2024-09-11T22:23:28.522057+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:23:33.219 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2e is not active+clean 2024-09-11T22:23:33.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.521871+0000', 'last_change': '2024-09-11T22:23:28.521871+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.521871+0000', 'last_undegraded': '2024-09-11T22:23:28.521871+0000', 'last_fullsized': '2024-09-11T22:23:28.521871+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:23:33.219 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2d is not active+clean 2024-09-11T22:23:33.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.527806+0000', 'last_change': '2024-09-11T22:23:28.527806+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.527806+0000', 'last_undegraded': '2024-09-11T22:23:28.527806+0000', 'last_fullsized': '2024-09-11T22:23:28.527806+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:23:33.219 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2c is not active+clean 2024-09-11T22:23:33.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.522410+0000', 'last_change': '2024-09-11T22:23:28.522410+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.522410+0000', 'last_undegraded': '2024-09-11T22:23:28.522410+0000', 'last_fullsized': '2024-09-11T22:23:28.522410+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:23:33.219 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2b is not active+clean 2024-09-11T22:23:33.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.527298+0000', 'last_change': '2024-09-11T22:23:28.527298+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.527298+0000', 'last_undegraded': '2024-09-11T22:23:28.527298+0000', 'last_fullsized': '2024-09-11T22:23:28.527298+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:23:33.220 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2a is not active+clean 2024-09-11T22:23:33.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.528117+0000', 'last_change': '2024-09-11T22:23:28.528117+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.528117+0000', 'last_undegraded': '2024-09-11T22:23:28.528117+0000', 'last_fullsized': '2024-09-11T22:23:28.528117+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:23:33.220 INFO:tasks.ceph.ceph_manager.ceph:PG 29.29 is not active+clean 2024-09-11T22:23:33.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:28.510780+0000', 'last_change': '2024-09-11T22:23:28.510780+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.510780+0000', 'last_undegraded': '2024-09-11T22:23:28.510780+0000', 'last_fullsized': '2024-09-11T22:23:28.510780+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.221 INFO:tasks.ceph.ceph_manager.ceph:PG 29.28 is not active+clean 2024-09-11T22:23:33.221 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.526592+0000', 'last_change': '2024-09-11T22:23:28.526592+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.526592+0000', 'last_undegraded': '2024-09-11T22:23:28.526592+0000', 'last_fullsized': '2024-09-11T22:23:28.526592+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:23:33.221 INFO:tasks.ceph.ceph_manager.ceph:PG 29.27 is not active+clean 2024-09-11T22:23:33.221 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:28.510780+0000', 'last_change': '2024-09-11T22:23:28.510780+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.510780+0000', 'last_undegraded': '2024-09-11T22:23:28.510780+0000', 'last_fullsized': '2024-09-11T22:23:28.510780+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.221 INFO:tasks.ceph.ceph_manager.ceph:PG 29.25 is not active+clean 2024-09-11T22:23:33.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:28.510780+0000', 'last_change': '2024-09-11T22:23:28.510780+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.510780+0000', 'last_undegraded': '2024-09-11T22:23:28.510780+0000', 'last_fullsized': '2024-09-11T22:23:28.510780+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.222 INFO:tasks.ceph.ceph_manager.ceph:PG 29.24 is not active+clean 2024-09-11T22:23:33.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.521958+0000', 'last_change': '2024-09-11T22:23:28.521958+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.521958+0000', 'last_undegraded': '2024-09-11T22:23:28.521958+0000', 'last_fullsized': '2024-09-11T22:23:28.521958+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:23:33.222 INFO:tasks.ceph.ceph_manager.ceph:PG 29.23 is not active+clean 2024-09-11T22:23:33.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.521683+0000', 'last_change': '2024-09-11T22:23:28.521683+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.521683+0000', 'last_undegraded': '2024-09-11T22:23:28.521683+0000', 'last_fullsized': '2024-09-11T22:23:28.521683+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:23:33.222 INFO:tasks.ceph.ceph_manager.ceph:PG 29.22 is not active+clean 2024-09-11T22:23:33.223 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:28.510780+0000', 'last_change': '2024-09-11T22:23:28.510780+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.510780+0000', 'last_undegraded': '2024-09-11T22:23:28.510780+0000', 'last_fullsized': '2024-09-11T22:23:28.510780+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.223 INFO:tasks.ceph.ceph_manager.ceph:PG 29.21 is not active+clean 2024-09-11T22:23:33.223 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.530987+0000', 'last_change': '2024-09-11T22:23:28.530987+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.530987+0000', 'last_undegraded': '2024-09-11T22:23:28.530987+0000', 'last_fullsized': '2024-09-11T22:23:28.530987+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:23:33.223 INFO:tasks.ceph.ceph_manager.ceph:PG 29.20 is not active+clean 2024-09-11T22:23:33.223 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.526019+0000', 'last_change': '2024-09-11T22:23:28.526019+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.526019+0000', 'last_undegraded': '2024-09-11T22:23:28.526019+0000', 'last_fullsized': '2024-09-11T22:23:28.526019+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:23:33.223 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1e is not active+clean 2024-09-11T22:23:33.224 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.524336+0000', 'last_change': '2024-09-11T22:23:28.524336+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.524336+0000', 'last_undegraded': '2024-09-11T22:23:28.524336+0000', 'last_fullsized': '2024-09-11T22:23:28.524336+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:23:33.224 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1d is not active+clean 2024-09-11T22:23:33.224 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.520583+0000', 'last_change': '2024-09-11T22:23:28.520583+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.520583+0000', 'last_undegraded': '2024-09-11T22:23:28.520583+0000', 'last_fullsized': '2024-09-11T22:23:28.520583+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:23:33.224 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1a is not active+clean 2024-09-11T22:23:33.224 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:28.510780+0000', 'last_change': '2024-09-11T22:23:28.510780+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.510780+0000', 'last_undegraded': '2024-09-11T22:23:28.510780+0000', 'last_fullsized': '2024-09-11T22:23:28.510780+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.224 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1b is not active+clean 2024-09-11T22:23:33.224 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.526841+0000', 'last_change': '2024-09-11T22:23:28.526841+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.526841+0000', 'last_undegraded': '2024-09-11T22:23:28.526841+0000', 'last_fullsized': '2024-09-11T22:23:28.526841+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:23:33.224 INFO:tasks.ceph.ceph_manager.ceph:PG 29.18 is not active+clean 2024-09-11T22:23:33.224 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.521842+0000', 'last_change': '2024-09-11T22:23:28.521842+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.521842+0000', 'last_undegraded': '2024-09-11T22:23:28.521842+0000', 'last_fullsized': '2024-09-11T22:23:28.521842+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:23:33.224 INFO:tasks.ceph.ceph_manager.ceph:PG 29.19 is not active+clean 2024-09-11T22:23:33.225 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.520614+0000', 'last_change': '2024-09-11T22:23:28.520614+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.520614+0000', 'last_undegraded': '2024-09-11T22:23:28.520614+0000', 'last_fullsized': '2024-09-11T22:23:28.520614+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:23:33.225 INFO:tasks.ceph.ceph_manager.ceph:PG 29.16 is not active+clean 2024-09-11T22:23:33.225 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.520931+0000', 'last_change': '2024-09-11T22:23:28.520931+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.520931+0000', 'last_undegraded': '2024-09-11T22:23:28.520931+0000', 'last_fullsized': '2024-09-11T22:23:28.520931+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:23:33.225 INFO:tasks.ceph.ceph_manager.ceph:PG 28.17 is not active+clean 2024-09-11T22:23:33.225 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:27.504517+0000', 'last_change': '2024-09-11T22:23:27.504517+0000', 'last_active': '2024-09-11T22:23:27.504517+0000', 'last_peered': '2024-09-11T22:23:27.504517+0000', 'last_clean': '2024-09-11T22:23:27.504517+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:27.504517+0000', 'last_undegraded': '2024-09-11T22:23:27.504517+0000', 'last_fullsized': '2024-09-11T22:23:27.504517+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:27.504517+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:27.504517+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:27.504517+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.225 INFO:tasks.ceph.ceph_manager.ceph:PG 29.17 is not active+clean 2024-09-11T22:23:33.225 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:28.510780+0000', 'last_change': '2024-09-11T22:23:28.510780+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.510780+0000', 'last_undegraded': '2024-09-11T22:23:28.510780+0000', 'last_fullsized': '2024-09-11T22:23:28.510780+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.225 INFO:tasks.ceph.ceph_manager.ceph:PG 29.14 is not active+clean 2024-09-11T22:23:33.225 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.520387+0000', 'last_change': '2024-09-11T22:23:28.520387+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.520387+0000', 'last_undegraded': '2024-09-11T22:23:28.520387+0000', 'last_fullsized': '2024-09-11T22:23:28.520387+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:23:33.226 INFO:tasks.ceph.ceph_manager.ceph:PG 29.15 is not active+clean 2024-09-11T22:23:33.226 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:28.510780+0000', 'last_change': '2024-09-11T22:23:28.510780+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.510780+0000', 'last_undegraded': '2024-09-11T22:23:28.510780+0000', 'last_fullsized': '2024-09-11T22:23:28.510780+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.226 INFO:tasks.ceph.ceph_manager.ceph:PG 29.12 is not active+clean 2024-09-11T22:23:33.226 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.526401+0000', 'last_change': '2024-09-11T22:23:28.526401+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.526401+0000', 'last_undegraded': '2024-09-11T22:23:28.526401+0000', 'last_fullsized': '2024-09-11T22:23:28.526401+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:23:33.226 INFO:tasks.ceph.ceph_manager.ceph:PG 29.13 is not active+clean 2024-09-11T22:23:33.226 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.529550+0000', 'last_change': '2024-09-11T22:23:28.529550+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.529550+0000', 'last_undegraded': '2024-09-11T22:23:28.529550+0000', 'last_fullsized': '2024-09-11T22:23:28.529550+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:23:33.226 INFO:tasks.ceph.ceph_manager.ceph:PG 29.10 is not active+clean 2024-09-11T22:23:33.226 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.527406+0000', 'last_change': '2024-09-11T22:23:28.527406+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.527406+0000', 'last_undegraded': '2024-09-11T22:23:28.527406+0000', 'last_fullsized': '2024-09-11T22:23:28.527406+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:23:33.226 INFO:tasks.ceph.ceph_manager.ceph:PG 29.11 is not active+clean 2024-09-11T22:23:33.226 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.520108+0000', 'last_change': '2024-09-11T22:23:28.520108+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.520108+0000', 'last_undegraded': '2024-09-11T22:23:28.520108+0000', 'last_fullsized': '2024-09-11T22:23:28.520108+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T22:23:33.226 INFO:tasks.ceph.ceph_manager.ceph:PG 29.f is not active+clean 2024-09-11T22:23:33.226 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.521404+0000', 'last_change': '2024-09-11T22:23:28.521404+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.521404+0000', 'last_undegraded': '2024-09-11T22:23:28.521404+0000', 'last_fullsized': '2024-09-11T22:23:28.521404+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T22:23:33.227 INFO:tasks.ceph.ceph_manager.ceph:PG 29.c is not active+clean 2024-09-11T22:23:33.227 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.527510+0000', 'last_change': '2024-09-11T22:23:28.527510+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.527510+0000', 'last_undegraded': '2024-09-11T22:23:28.527510+0000', 'last_fullsized': '2024-09-11T22:23:28.527510+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:23:33.227 INFO:tasks.ceph.ceph_manager.ceph:PG 28.d is not active+clean 2024-09-11T22:23:33.227 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:27.504517+0000', 'last_change': '2024-09-11T22:23:27.504517+0000', 'last_active': '2024-09-11T22:23:27.504517+0000', 'last_peered': '2024-09-11T22:23:27.504517+0000', 'last_clean': '2024-09-11T22:23:27.504517+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:27.504517+0000', 'last_undegraded': '2024-09-11T22:23:27.504517+0000', 'last_fullsized': '2024-09-11T22:23:27.504517+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:27.504517+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:27.504517+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:27.504517+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.227 INFO:tasks.ceph.ceph_manager.ceph:PG 29.d is not active+clean 2024-09-11T22:23:33.227 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.524913+0000', 'last_change': '2024-09-11T22:23:28.524913+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.524913+0000', 'last_undegraded': '2024-09-11T22:23:28.524913+0000', 'last_fullsized': '2024-09-11T22:23:28.524913+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:23:33.227 INFO:tasks.ceph.ceph_manager.ceph:PG 29.a is not active+clean 2024-09-11T22:23:33.227 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.527075+0000', 'last_change': '2024-09-11T22:23:28.527075+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.527075+0000', 'last_undegraded': '2024-09-11T22:23:28.527075+0000', 'last_fullsized': '2024-09-11T22:23:28.527075+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:23:33.227 INFO:tasks.ceph.ceph_manager.ceph:PG 29.b is not active+clean 2024-09-11T22:23:33.227 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.528136+0000', 'last_change': '2024-09-11T22:23:28.528136+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.528136+0000', 'last_undegraded': '2024-09-11T22:23:28.528136+0000', 'last_fullsized': '2024-09-11T22:23:28.528136+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:23:33.227 INFO:tasks.ceph.ceph_manager.ceph:PG 29.9 is not active+clean 2024-09-11T22:23:33.227 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.530590+0000', 'last_change': '2024-09-11T22:23:28.530590+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.530590+0000', 'last_undegraded': '2024-09-11T22:23:28.530590+0000', 'last_fullsized': '2024-09-11T22:23:28.530590+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:23:33.228 INFO:tasks.ceph.ceph_manager.ceph:PG 29.6 is not active+clean 2024-09-11T22:23:33.228 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.528185+0000', 'last_change': '2024-09-11T22:23:28.528185+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.528185+0000', 'last_undegraded': '2024-09-11T22:23:28.528185+0000', 'last_fullsized': '2024-09-11T22:23:28.528185+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:23:33.228 INFO:tasks.ceph.ceph_manager.ceph:PG 29.7 is not active+clean 2024-09-11T22:23:33.228 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.527147+0000', 'last_change': '2024-09-11T22:23:28.527147+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.527147+0000', 'last_undegraded': '2024-09-11T22:23:28.527147+0000', 'last_fullsized': '2024-09-11T22:23:28.527147+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:23:33.228 INFO:tasks.ceph.ceph_manager.ceph:PG 28.6 is not active+clean 2024-09-11T22:23:33.228 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:27.504517+0000', 'last_change': '2024-09-11T22:23:27.504517+0000', 'last_active': '2024-09-11T22:23:27.504517+0000', 'last_peered': '2024-09-11T22:23:27.504517+0000', 'last_clean': '2024-09-11T22:23:27.504517+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:27.504517+0000', 'last_undegraded': '2024-09-11T22:23:27.504517+0000', 'last_fullsized': '2024-09-11T22:23:27.504517+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:27.504517+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:27.504517+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:27.504517+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.228 INFO:tasks.ceph.ceph_manager.ceph:PG 29.4 is not active+clean 2024-09-11T22:23:33.228 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.527083+0000', 'last_change': '2024-09-11T22:23:28.527083+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.527083+0000', 'last_undegraded': '2024-09-11T22:23:28.527083+0000', 'last_fullsized': '2024-09-11T22:23:28.527083+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:23:33.228 INFO:tasks.ceph.ceph_manager.ceph:PG 28.5 is not active+clean 2024-09-11T22:23:33.228 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:27.504517+0000', 'last_change': '2024-09-11T22:23:27.504517+0000', 'last_active': '2024-09-11T22:23:27.504517+0000', 'last_peered': '2024-09-11T22:23:27.504517+0000', 'last_clean': '2024-09-11T22:23:27.504517+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:27.504517+0000', 'last_undegraded': '2024-09-11T22:23:27.504517+0000', 'last_fullsized': '2024-09-11T22:23:27.504517+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:27.504517+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:27.504517+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:27.504517+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.229 INFO:tasks.ceph.ceph_manager.ceph:PG 29.5 is not active+clean 2024-09-11T22:23:33.229 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.531504+0000', 'last_change': '2024-09-11T22:23:28.531504+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.531504+0000', 'last_undegraded': '2024-09-11T22:23:28.531504+0000', 'last_fullsized': '2024-09-11T22:23:28.531504+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T22:23:33.229 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2 is not active+clean 2024-09-11T22:23:33.229 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.519844+0000', 'last_change': '2024-09-11T22:23:28.519844+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.519844+0000', 'last_undegraded': '2024-09-11T22:23:28.519844+0000', 'last_fullsized': '2024-09-11T22:23:28.519844+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T22:23:33.229 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3 is not active+clean 2024-09-11T22:23:33.229 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.526821+0000', 'last_change': '2024-09-11T22:23:28.526821+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.526821+0000', 'last_undegraded': '2024-09-11T22:23:28.526821+0000', 'last_fullsized': '2024-09-11T22:23:28.526821+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:23:33.229 INFO:tasks.ceph.ceph_manager.ceph:PG 29.0 is not active+clean 2024-09-11T22:23:33.229 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2024-09-11T22:23:28.527000+0000', 'last_change': '2024-09-11T22:23:28.527000+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.527000+0000', 'last_undegraded': '2024-09-11T22:23:28.527000+0000', 'last_fullsized': '2024-09-11T22:23:28.527000+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T22:23:33.229 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1 is not active+clean 2024-09-11T22:23:33.229 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:28.510780+0000', 'last_change': '2024-09-11T22:23:28.510780+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.510780+0000', 'last_undegraded': '2024-09-11T22:23:28.510780+0000', 'last_fullsized': '2024-09-11T22:23:28.510780+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.229 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1c is not active+clean 2024-09-11T22:23:33.229 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T22:23:28.510780+0000', 'last_change': '2024-09-11T22:23:28.510780+0000', 'last_active': '2024-09-11T22:23:28.510780+0000', 'last_peered': '2024-09-11T22:23:28.510780+0000', 'last_clean': '2024-09-11T22:23:28.510780+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:23:28.510780+0000', 'last_undegraded': '2024-09-11T22:23:28.510780+0000', 'last_fullsized': '2024-09-11T22:23:28.510780+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'last_clean_scrub_stamp': '2024-09-11T22:23:28.510780+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T22:23:33.230 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:23:33.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.351+0000 7f590ba8d640 1 Processor -- start 2024-09-11T22:23:33.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.352+0000 7f590ba8d640 1 -- start start 2024-09-11T22:23:33.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.352+0000 7f590ba8d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5904072e60 0x7f590406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.352+0000 7f590ba8d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f590415b7e0 con 0x7f590415b400 2024-09-11T22:23:33.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.352+0000 7f590ba8d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f590415f140 con 0x7f590406e0f0 2024-09-11T22:23:33.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.352+0000 7f590ba8d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f590415f420 con 0x7f5904072e60 2024-09-11T22:23:33.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.353+0000 7f590a02a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5904072e60 0x7f590406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.353+0000 7f5909829640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f590415b400 0x7f590406d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53608/0 (socket says 172.21.15.50:53608) 2024-09-11T22:23:33.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.353+0000 7f590a02a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5904072e60 0x7f590406d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54348/0 (socket says 172.21.15.50:54348) 2024-09-11T22:23:33.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.353+0000 7f5909829640 1 -- 172.21.15.50:0/2932060634 learned_addr learned my addr 172.21.15.50:0/2932060634 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:33.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.353+0000 7f590a02a640 1 -- 172.21.15.50:0/2932060634 >> v1:172.21.15.77:6789/0 conn(0x7f590406e0f0 legacy=0x7f59040711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.353+0000 7f590a02a640 1 -- 172.21.15.50:0/2932060634 >> v1:172.21.15.50:6789/0 conn(0x7f590415b400 legacy=0x7f590406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.353+0000 7f590a02a640 1 -- 172.21.15.50:0/2932060634 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590415f700 con 0x7f5904072e60 2024-09-11T22:23:33.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.354+0000 7f590a02a640 1 --2- 172.21.15.50:0/2932060634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5904072e60 0x7f590406d070 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f58f4009d90 tx=0x7f58f402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b892ddf6020bd5a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:33.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.354+0000 7f5908827640 1 -- 172.21.15.50:0/2932060634 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4007740 con 0x7f5904072e60 2024-09-11T22:23:33.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.354+0000 7f5908827640 1 -- 172.21.15.50:0/2932060634 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f40078e0 con 0x7f5904072e60 2024-09-11T22:23:33.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.354+0000 7f5908827640 1 -- 172.21.15.50:0/2932060634 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4007cb0 con 0x7f5904072e60 2024-09-11T22:23:33.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.354+0000 7f590ba8d640 1 -- 172.21.15.50:0/2932060634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5904072e60 msgr2=0x7f590406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.354+0000 7f590ba8d640 1 --2- 172.21.15.50:0/2932060634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5904072e60 0x7f590406d070 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f58f4009d90 tx=0x7f58f402a6f0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.354+0000 7f590ba8d640 1 -- 172.21.15.50:0/2932060634 shutdown_connections 2024-09-11T22:23:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.354+0000 7f590ba8d640 1 --2- 172.21.15.50:0/2932060634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5904072e60 0x7f590406d070 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.354+0000 7f590ba8d640 1 -- 172.21.15.50:0/2932060634 >> 172.21.15.50:0/2932060634 conn(0x7f59040679c0 msgr2=0x7f5904067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.354+0000 7f590ba8d640 1 -- 172.21.15.50:0/2932060634 shutdown_connections 2024-09-11T22:23:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.354+0000 7f590ba8d640 1 -- 172.21.15.50:0/2932060634 wait complete. 2024-09-11T22:23:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.356+0000 7f590ba8d640 1 Processor -- start 2024-09-11T22:23:33.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.356+0000 7f590ba8d640 1 -- start start 2024-09-11T22:23:33.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.356+0000 7f590ba8d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f590406e0f0 0x7f590414cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.356+0000 7f590ba8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5904072e60 0x7f59040c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.356+0000 7f590ba8d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f590415b400 0x7f59040c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.356+0000 7f590ba8d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f59040718d0 con 0x7f590406e0f0 2024-09-11T22:23:33.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.356+0000 7f590ba8d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f59040cfc50 con 0x7f5904072e60 2024-09-11T22:23:33.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.356+0000 7f590ba8d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5904071a50 con 0x7f590415b400 2024-09-11T22:23:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.356+0000 7f5909829640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f590406e0f0 0x7f590414cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.356+0000 7f5909829640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f590406e0f0 0x7f590414cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54360/0 (socket says 172.21.15.50:54360) 2024-09-11T22:23:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f5909829640 1 -- 172.21.15.50:0/3157807898 learned_addr learned my addr 172.21.15.50:0/3157807898 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f590a02a640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f590415b400 0x7f59040c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f5909028640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5904072e60 0x7f59040c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f5909829640 1 -- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f590415b400 msgr2=0x7f59040c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f5909829640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f590415b400 0x7f59040c6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f5909829640 1 -- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5904072e60 msgr2=0x7f59040c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f5909829640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5904072e60 0x7f59040c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f5909829640 1 -- 172.21.15.50:0/3157807898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59040c58b0 con 0x7f590406e0f0 2024-09-11T22:23:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f5909028640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5904072e60 0x7f59040c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f5909829640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f590406e0f0 0x7f590414cfd0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00c480 tx=0x7f58fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f59027fc640 1 -- 172.21.15.50:0/3157807898 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58fc017070 con 0x7f590406e0f0 2024-09-11T22:23:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f59027fc640 1 -- 172.21.15.50:0/3157807898 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58fc005ce0 con 0x7f590406e0f0 2024-09-11T22:23:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f590ba8d640 1 -- 172.21.15.50:0/3157807898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59040c5b50 con 0x7f590406e0f0 2024-09-11T22:23:33.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f59027fc640 1 -- 172.21.15.50:0/3157807898 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58fc0072f0 con 0x7f590406e0f0 2024-09-11T22:23:33.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.357+0000 7f590ba8d640 1 -- 172.21.15.50:0/3157807898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59040c6110 con 0x7f590406e0f0 2024-09-11T22:23:33.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.358+0000 7f590ba8d640 1 -- 172.21.15.50:0/3157807898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59041587c0 con 0x7f590406e0f0 2024-09-11T22:23:33.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.359+0000 7f59027fc640 1 -- 172.21.15.50:0/3157807898 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58fc01a070 con 0x7f590406e0f0 2024-09-11T22:23:33.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.359+0000 7f59027fc640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58f006be30 0x7f58f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.359+0000 7f59027fc640 1 -- 172.21.15.50:0/3157807898 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f58fc08a0c0 con 0x7f590406e0f0 2024-09-11T22:23:33.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.360+0000 7f5909028640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58f006be30 0x7f58f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.360+0000 7f5909028640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58f006be30 0x7f58f006e2f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f59040cce80 tx=0x7f58f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:33.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.364+0000 7f59027fc640 1 -- 172.21.15.50:0/3157807898 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59041587c0 con 0x7f590406e0f0 2024-09-11T22:23:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.606+0000 7f590ba8d640 1 -- 172.21.15.50:0/3157807898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f59040ce9b0 con 0x7f590406e0f0 2024-09-11T22:23:33.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.607+0000 7f59027fc640 1 -- 172.21.15.50:0/3157807898 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1512 (secure 0 0 0) 0x7f58fc0584b0 con 0x7f590406e0f0 2024-09-11T22:23:33.608 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:33.608 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":762,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":189,"num_osds":8,"num_up_osds":8,"osd_up_since":1726092663,"num_in_osds":8,"osd_in_since":1726092653,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":48},{"state_name":"active+clean","count":34},{"state_name":"unknown","count":15}],"num_pgs":97,"num_pools":3,"num_objects":4,"data_bytes":590402,"bytes_used":444710912,"bytes_avail":772649402368,"bytes_total":773094113280,"unknown_pgs_ratio":0.15463916957378387,"inactive_pgs_ratio":0.49484536051750183,"write_bytes_sec":1778,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":137,"btime":"2024-09-11T22:23:31:534171+0000","id":14,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":14,"rank":0,"name":"c","status":"up:active","gid":10734}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":32,"modified":"2024-09-11T22:22:23.525304+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:23:33.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.609+0000 7f590ba8d640 1 -- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58f006be30 msgr2=0x7f58f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.609+0000 7f590ba8d640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58f006be30 0x7f58f006e2f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f59040cce80 tx=0x7f58f8009040 comp rx=0 tx=0).stop 2024-09-11T22:23:33.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.609+0000 7f590ba8d640 1 -- 172.21.15.50:0/3157807898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f590406e0f0 msgr2=0x7f590414cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.609+0000 7f590ba8d640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f590406e0f0 0x7f590414cfd0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00c480 tx=0x7f58fc00c940 comp rx=0 tx=0).stop 2024-09-11T22:23:33.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.609+0000 7f590ba8d640 1 -- 172.21.15.50:0/3157807898 shutdown_connections 2024-09-11T22:23:33.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.609+0000 7f590ba8d640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f58f006be30 0x7f58f006e2f0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.609+0000 7f590ba8d640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f590415b400 0x7f59040c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.609+0000 7f590ba8d640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5904072e60 0x7f59040c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.609+0000 7f590ba8d640 1 --2- 172.21.15.50:0/3157807898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f590406e0f0 0x7f590414cfd0 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.609+0000 7f590ba8d640 1 -- 172.21.15.50:0/3157807898 >> 172.21.15.50:0/3157807898 conn(0x7f59040679c0 msgr2=0x7f59040b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:33.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.609+0000 7f590ba8d640 1 -- 172.21.15.50:0/3157807898 shutdown_connections 2024-09-11T22:23:33.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.609+0000 7f590ba8d640 1 -- 172.21.15.50:0/3157807898 wait complete. 2024-09-11T22:23:33.621 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T22:23:33.621 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:23:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.722+0000 7fbcfa4d0640 1 Processor -- start 2024-09-11T22:23:33.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.722+0000 7fbcfa4d0640 1 -- start start 2024-09-11T22:23:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.723+0000 7fbcfa4d0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbcf40cf790 0x7fbcf40b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.723+0000 7fbcfa4d0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbcf40d11d0 0x7fbcf40d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.723+0000 7fbcfa4d0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf4162110 con 0x7fbcf4161d30 2024-09-11T22:23:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.723+0000 7fbcfa4d0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf40d3450 con 0x7fbcf40d11d0 2024-09-11T22:23:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.723+0000 7fbcfa4d0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf40b7e30 con 0x7fbcf40cf790 2024-09-11T22:23:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.723+0000 7fbcf8a6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbcf40d11d0 0x7fbcf40d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.723+0000 7fbcf3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbcf4161d30 0x7fbcf4162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53616/0 (socket says 172.21.15.50:53616) 2024-09-11T22:23:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.723+0000 7fbcf3fff640 1 -- 172.21.15.50:0/3064541164 learned_addr learned my addr 172.21.15.50:0/3064541164 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.723+0000 7fbcf37fe640 1 --2- 172.21.15.50:0/3064541164 >> v2:172.21.15.77:3300/0 conn(0x7fbcf40cf790 0x7fbcf40b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.723+0000 7fbcf8a6d640 1 -- 172.21.15.50:0/3064541164 >> v2:172.21.15.77:3300/0 conn(0x7fbcf40cf790 msgr2=0x7fbcf40b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.723+0000 7fbcf8a6d640 1 --2- 172.21.15.50:0/3064541164 >> v2:172.21.15.77:3300/0 conn(0x7fbcf40cf790 0x7fbcf40b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.723+0000 7fbcf8a6d640 1 -- 172.21.15.50:0/3064541164 >> v1:172.21.15.50:6789/0 conn(0x7fbcf4161d30 legacy=0x7fbcf4162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.723+0000 7fbcf8a6d640 1 -- 172.21.15.50:0/3064541164 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf40cfd70 con 0x7fbcf40d11d0 2024-09-11T22:23:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.724+0000 7fbcf8a6d640 1 --2- 172.21.15.50:0/3064541164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf40d11d0 0x7fbcf40d1600 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4068730 tx=0x7fbcec02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b4e9ca05eeaaba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.724+0000 7fbcf2ffd640 1 -- 172.21.15.50:0/3064541164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec007740 con 0x7fbcf40d11d0 2024-09-11T22:23:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.724+0000 7fbcf2ffd640 1 -- 172.21.15.50:0/3064541164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcec0078e0 con 0x7fbcf40d11d0 2024-09-11T22:23:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.724+0000 7fbcf2ffd640 1 -- 172.21.15.50:0/3064541164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec007cb0 con 0x7fbcf40d11d0 2024-09-11T22:23:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.725+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/3064541164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf40d11d0 msgr2=0x7fbcf40d1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.725+0000 7fbcfa4d0640 1 --2- 172.21.15.50:0/3064541164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf40d11d0 0x7fbcf40d1600 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4068730 tx=0x7fbcec02a680 comp rx=0 tx=0).stop 2024-09-11T22:23:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.725+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/3064541164 shutdown_connections 2024-09-11T22:23:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.725+0000 7fbcfa4d0640 1 --2- 172.21.15.50:0/3064541164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf40d11d0 0x7fbcf40d1600 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.725+0000 7fbcfa4d0640 1 --2- 172.21.15.50:0/3064541164 >> v2:172.21.15.77:3300/0 conn(0x7fbcf40cf790 0x7fbcf40b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.725+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/3064541164 >> 172.21.15.50:0/3064541164 conn(0x7fbcf40727a0 msgr2=0x7fbcf40679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.725+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/3064541164 shutdown_connections 2024-09-11T22:23:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.725+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/3064541164 wait complete. 2024-09-11T22:23:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.726+0000 7fbcfa4d0640 1 Processor -- start 2024-09-11T22:23:33.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.726+0000 7fbcfa4d0640 1 -- start start 2024-09-11T22:23:33.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcfa4d0640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf40cf790 0x7fbcf415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcfa4d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf40d11d0 0x7fbcf415d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcfa4d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf4161d30 0x7fbcf415dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcfa4d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf40d2e00 con 0x7fbcf4161d30 2024-09-11T22:23:33.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcfa4d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf40d1b40 con 0x7fbcf40d11d0 2024-09-11T22:23:33.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcfa4d0640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf40d30e0 con 0x7fbcf40cf790 2024-09-11T22:23:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcf8a6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf4161d30 0x7fbcf415dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcf8a6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf4161d30 0x7fbcf415dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54368/0 (socket says 172.21.15.50:54368) 2024-09-11T22:23:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcf8a6d640 1 -- 172.21.15.50:0/103313161 learned_addr learned my addr 172.21.15.50:0/103313161 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcf37fe640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf40d11d0 0x7fbcf415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcf3fff640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf40cf790 0x7fbcf415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcf8a6d640 1 -- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf40cf790 msgr2=0x7fbcf415bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcf8a6d640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf40cf790 0x7fbcf415bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcf8a6d640 1 -- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf40d11d0 msgr2=0x7fbcf415d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcf8a6d640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf40d11d0 0x7fbcf415d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcf8a6d640 1 -- 172.21.15.50:0/103313161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf40ca1f0 con 0x7fbcf4161d30 2024-09-11T22:23:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.727+0000 7fbcf8a6d640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf4161d30 0x7fbcf415dc70 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fbcec02ac70 tx=0x7fbcec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.728+0000 7fbcf0ff9640 1 -- 172.21.15.50:0/103313161 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec040070 con 0x7fbcf4161d30 2024-09-11T22:23:33.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.728+0000 7fbcf0ff9640 1 -- 172.21.15.50:0/103313161 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcec031bc0 con 0x7fbcf4161d30 2024-09-11T22:23:33.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.728+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/103313161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf40ca4d0 con 0x7fbcf4161d30 2024-09-11T22:23:33.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.728+0000 7fbcf0ff9640 1 -- 172.21.15.50:0/103313161 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec045460 con 0x7fbcf4161d30 2024-09-11T22:23:33.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.728+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/103313161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf40caa90 con 0x7fbcf4161d30 2024-09-11T22:23:33.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.729+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/103313161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf40b78f0 con 0x7fbcf4161d30 2024-09-11T22:23:33.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.729+0000 7fbcf0ff9640 1 -- 172.21.15.50:0/103313161 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcec039040 con 0x7fbcf4161d30 2024-09-11T22:23:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.730+0000 7fbcf0ff9640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbce006be30 0x7fbce006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.730+0000 7fbcf0ff9640 1 -- 172.21.15.50:0/103313161 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7fbcec0ac800 con 0x7fbcf4161d30 2024-09-11T22:23:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.730+0000 7fbcf3fff640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbce006be30 0x7fbce006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.730+0000 7fbcf3fff640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbce006be30 0x7fbce006e2f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fbce4000f60 tx=0x7fbce4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:33.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.734+0000 7fbcf0ff9640 1 -- 172.21.15.50:0/103313161 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbcec07b1b0 con 0x7fbcf4161d30 2024-09-11T22:23:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.906+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/103313161 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbcf415e1b0 con 0x7fbce006be30 2024-09-11T22:23:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.913+0000 7fbcf0ff9640 1 -- 172.21.15.50:0/103313161 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248419 (secure 0 0 0) 0x7fbcf415e1b0 con 0x7fbce006be30 2024-09-11T22:23:33.915 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:33.917 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:23:33.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.915+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbce006be30 msgr2=0x7fbce006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.915+0000 7fbcfa4d0640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbce006be30 0x7fbce006e2f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fbce4000f60 tx=0x7fbce4009040 comp rx=0 tx=0).stop 2024-09-11T22:23:33.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.915+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/103313161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf4161d30 msgr2=0x7fbcf415dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:33.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.915+0000 7fbcfa4d0640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf4161d30 0x7fbcf415dc70 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fbcec02ac70 tx=0x7fbcec004a40 comp rx=0 tx=0).stop 2024-09-11T22:23:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.915+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/103313161 shutdown_connections 2024-09-11T22:23:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.915+0000 7fbcfa4d0640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbce006be30 0x7fbce006e2f0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.915+0000 7fbcfa4d0640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf4161d30 0x7fbcf415dc70 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.915+0000 7fbcfa4d0640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf40d11d0 0x7fbcf415d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.915+0000 7fbcfa4d0640 1 --2- 172.21.15.50:0/103313161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf40cf790 0x7fbcf415bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.915+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/103313161 >> 172.21.15.50:0/103313161 conn(0x7fbcf40727a0 msgr2=0x7fbcf40ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.916+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/103313161 shutdown_connections 2024-09-11T22:23:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:33.916+0000 7fbcfa4d0640 1 -- 172.21.15.50:0/103313161 wait complete. 2024-09-11T22:23:33.927 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":558,"stamp":"2024-09-11T22:23:33.543172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590472,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":164,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":434348,"kb_used_data":19632,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754540372,"statfs":{"total":773094113280,"available":772649340928,"internally_reserved":0,"allocated":20103168,"data_stored":9478664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":424463921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":104,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001163"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540631+0000","last_change":"2024-09-11T22:23:29.541014+0000","last_active":"2024-09-11T22:23:30.540631+0000","last_peered":"2024-09-11T22:23:30.540631+0000","last_clean":"2024-09-11T22:23:30.540631+0000","last_became_active":"2024-09-11T22:23:29.540734+0000","last_became_peered":"2024-09-11T22:23:29.540734+0000","last_unstale":"2024-09-11T22:23:30.540631+0000","last_undegraded":"2024-09-11T22:23:30.540631+0000","last_fullsized":"2024-09-11T22:23:30.540631+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:57.887612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521815+0000","last_change":"2024-09-11T22:23:28.521815+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521815+0000","last_undegraded":"2024-09-11T22:23:28.521815+0000","last_fullsized":"2024-09-11T22:23:28.521815+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.525336+0000","last_change":"2024-09-11T22:23:28.525336+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.525336+0000","last_undegraded":"2024-09-11T22:23:28.525336+0000","last_fullsized":"2024-09-11T22:23:28.525336+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.529760+0000","last_change":"2024-09-11T22:23:28.529760+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.529760+0000","last_undegraded":"2024-09-11T22:23:28.529760+0000","last_fullsized":"2024-09-11T22:23:28.529760+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527739+0000","last_change":"2024-09-11T22:23:28.527739+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527739+0000","last_undegraded":"2024-09-11T22:23:28.527739+0000","last_fullsized":"2024-09-11T22:23:28.527739+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522938+0000","last_change":"2024-09-11T22:23:28.522938+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522938+0000","last_undegraded":"2024-09-11T22:23:28.522938+0000","last_fullsized":"2024-09-11T22:23:28.522938+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.525322+0000","last_change":"2024-09-11T22:23:28.525322+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.525322+0000","last_undegraded":"2024-09-11T22:23:28.525322+0000","last_fullsized":"2024-09-11T22:23:28.525322+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.541990+0000","last_change":"2024-09-11T22:23:29.526180+0000","last_active":"2024-09-11T22:23:30.541990+0000","last_peered":"2024-09-11T22:23:30.541990+0000","last_clean":"2024-09-11T22:23:30.541990+0000","last_became_active":"2024-09-11T22:23:29.525856+0000","last_became_peered":"2024-09-11T22:23:29.525856+0000","last_unstale":"2024-09-11T22:23:30.541990+0000","last_undegraded":"2024-09-11T22:23:30.541990+0000","last_fullsized":"2024-09-11T22:23:30.541990+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:01.977359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528066+0000","last_change":"2024-09-11T22:23:28.528066+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528066+0000","last_undegraded":"2024-09-11T22:23:28.528066+0000","last_fullsized":"2024-09-11T22:23:28.528066+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522407+0000","last_change":"2024-09-11T22:23:28.522407+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522407+0000","last_undegraded":"2024-09-11T22:23:28.522407+0000","last_fullsized":"2024-09-11T22:23:28.522407+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540440+0000","last_change":"2024-09-11T22:23:29.542059+0000","last_active":"2024-09-11T22:23:30.540440+0000","last_peered":"2024-09-11T22:23:30.540440+0000","last_clean":"2024-09-11T22:23:30.540440+0000","last_became_active":"2024-09-11T22:23:29.541774+0000","last_became_peered":"2024-09-11T22:23:29.541774+0000","last_unstale":"2024-09-11T22:23:30.540440+0000","last_undegraded":"2024-09-11T22:23:30.540440+0000","last_fullsized":"2024-09-11T22:23:30.540440+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:00.856060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522074+0000","last_change":"2024-09-11T22:23:28.522074+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522074+0000","last_undegraded":"2024-09-11T22:23:28.522074+0000","last_fullsized":"2024-09-11T22:23:28.522074+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521478+0000","last_change":"2024-09-11T22:23:28.521478+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521478+0000","last_undegraded":"2024-09-11T22:23:28.521478+0000","last_fullsized":"2024-09-11T22:23:28.521478+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520953+0000","last_change":"2024-09-11T22:23:28.520953+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520953+0000","last_undegraded":"2024-09-11T22:23:28.520953+0000","last_fullsized":"2024-09-11T22:23:28.520953+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.529557+0000","last_change":"2024-09-11T22:23:28.529557+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.529557+0000","last_undegraded":"2024-09-11T22:23:28.529557+0000","last_fullsized":"2024-09-11T22:23:28.529557+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521354+0000","last_change":"2024-09-11T22:23:28.521354+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521354+0000","last_undegraded":"2024-09-11T22:23:28.521354+0000","last_fullsized":"2024-09-11T22:23:28.521354+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522057+0000","last_change":"2024-09-11T22:23:28.522057+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522057+0000","last_undegraded":"2024-09-11T22:23:28.522057+0000","last_fullsized":"2024-09-11T22:23:28.522057+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521871+0000","last_change":"2024-09-11T22:23:28.521871+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521871+0000","last_undegraded":"2024-09-11T22:23:28.521871+0000","last_fullsized":"2024-09-11T22:23:28.521871+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527806+0000","last_change":"2024-09-11T22:23:28.527806+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527806+0000","last_undegraded":"2024-09-11T22:23:28.527806+0000","last_fullsized":"2024-09-11T22:23:28.527806+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.522410+0000","last_change":"2024-09-11T22:23:28.522410+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.522410+0000","last_undegraded":"2024-09-11T22:23:28.522410+0000","last_fullsized":"2024-09-11T22:23:28.522410+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527298+0000","last_change":"2024-09-11T22:23:28.527298+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527298+0000","last_undegraded":"2024-09-11T22:23:28.527298+0000","last_fullsized":"2024-09-11T22:23:28.527298+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528117+0000","last_change":"2024-09-11T22:23:28.528117+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528117+0000","last_undegraded":"2024-09-11T22:23:28.528117+0000","last_fullsized":"2024-09-11T22:23:28.528117+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540193+0000","last_change":"2024-09-11T22:23:29.536620+0000","last_active":"2024-09-11T22:23:30.540193+0000","last_peered":"2024-09-11T22:23:30.540193+0000","last_clean":"2024-09-11T22:23:30.540193+0000","last_became_active":"2024-09-11T22:23:29.536275+0000","last_became_peered":"2024-09-11T22:23:29.536275+0000","last_unstale":"2024-09-11T22:23:30.540193+0000","last_undegraded":"2024-09-11T22:23:30.540193+0000","last_fullsized":"2024-09-11T22:23:30.540193+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:18.845529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526592+0000","last_change":"2024-09-11T22:23:28.526592+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526592+0000","last_undegraded":"2024-09-11T22:23:28.526592+0000","last_fullsized":"2024-09-11T22:23:28.526592+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540630+0000","last_change":"2024-09-11T22:23:29.539853+0000","last_active":"2024-09-11T22:23:30.540630+0000","last_peered":"2024-09-11T22:23:30.540630+0000","last_clean":"2024-09-11T22:23:30.540630+0000","last_became_active":"2024-09-11T22:23:29.539555+0000","last_became_peered":"2024-09-11T22:23:29.539555+0000","last_unstale":"2024-09-11T22:23:30.540630+0000","last_undegraded":"2024-09-11T22:23:30.540630+0000","last_fullsized":"2024-09-11T22:23:30.540630+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:10.940087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542327+0000","last_change":"2024-09-11T22:23:29.533731+0000","last_active":"2024-09-11T22:23:30.542327+0000","last_peered":"2024-09-11T22:23:30.542327+0000","last_clean":"2024-09-11T22:23:30.542327+0000","last_became_active":"2024-09-11T22:23:29.532721+0000","last_became_peered":"2024-09-11T22:23:29.532721+0000","last_unstale":"2024-09-11T22:23:30.542327+0000","last_undegraded":"2024-09-11T22:23:30.542327+0000","last_fullsized":"2024-09-11T22:23:30.542327+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:01.286972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540628+0000","last_change":"2024-09-11T22:23:29.542712+0000","last_active":"2024-09-11T22:23:30.540628+0000","last_peered":"2024-09-11T22:23:30.540628+0000","last_clean":"2024-09-11T22:23:30.540628+0000","last_became_active":"2024-09-11T22:23:29.542455+0000","last_became_peered":"2024-09-11T22:23:29.542455+0000","last_unstale":"2024-09-11T22:23:30.540628+0000","last_undegraded":"2024-09-11T22:23:30.540628+0000","last_fullsized":"2024-09-11T22:23:30.540628+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:59.273434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521958+0000","last_change":"2024-09-11T22:23:28.521958+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521958+0000","last_undegraded":"2024-09-11T22:23:28.521958+0000","last_fullsized":"2024-09-11T22:23:28.521958+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521683+0000","last_change":"2024-09-11T22:23:28.521683+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521683+0000","last_undegraded":"2024-09-11T22:23:28.521683+0000","last_fullsized":"2024-09-11T22:23:28.521683+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540234+0000","last_change":"2024-09-11T22:23:29.550354+0000","last_active":"2024-09-11T22:23:30.540234+0000","last_peered":"2024-09-11T22:23:30.540234+0000","last_clean":"2024-09-11T22:23:30.540234+0000","last_became_active":"2024-09-11T22:23:29.550066+0000","last_became_peered":"2024-09-11T22:23:29.550066+0000","last_unstale":"2024-09-11T22:23:30.540234+0000","last_undegraded":"2024-09-11T22:23:30.540234+0000","last_fullsized":"2024-09-11T22:23:30.540234+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:10.874883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.530987+0000","last_change":"2024-09-11T22:23:28.530987+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.530987+0000","last_undegraded":"2024-09-11T22:23:28.530987+0000","last_fullsized":"2024-09-11T22:23:28.530987+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526019+0000","last_change":"2024-09-11T22:23:28.526019+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526019+0000","last_undegraded":"2024-09-11T22:23:28.526019+0000","last_fullsized":"2024-09-11T22:23:28.526019+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.524336+0000","last_change":"2024-09-11T22:23:28.524336+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.524336+0000","last_undegraded":"2024-09-11T22:23:28.524336+0000","last_fullsized":"2024-09-11T22:23:28.524336+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534341+0000","last_change":"2024-09-11T22:23:28.533479+0000","last_active":"2024-09-11T22:23:28.534341+0000","last_peered":"2024-09-11T22:23:28.534341+0000","last_clean":"2024-09-11T22:23:28.534341+0000","last_became_active":"2024-09-11T22:23:28.533187+0000","last_became_peered":"2024-09-11T22:23:28.533187+0000","last_unstale":"2024-09-11T22:23:28.534341+0000","last_undegraded":"2024-09-11T22:23:28.534341+0000","last_fullsized":"2024-09-11T22:23:28.534341+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:52.004425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542369+0000","last_change":"2024-09-11T22:23:29.536415+0000","last_active":"2024-09-11T22:23:30.542369+0000","last_peered":"2024-09-11T22:23:30.542369+0000","last_clean":"2024-09-11T22:23:30.542369+0000","last_became_active":"2024-09-11T22:23:29.536111+0000","last_became_peered":"2024-09-11T22:23:29.536111+0000","last_unstale":"2024-09-11T22:23:30.542369+0000","last_undegraded":"2024-09-11T22:23:30.542369+0000","last_fullsized":"2024-09-11T22:23:30.542369+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:47.495340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531316+0000","last_change":"2024-09-11T22:23:28.530365+0000","last_active":"2024-09-11T22:23:28.531316+0000","last_peered":"2024-09-11T22:23:28.531316+0000","last_clean":"2024-09-11T22:23:28.531316+0000","last_became_active":"2024-09-11T22:23:28.530069+0000","last_became_peered":"2024-09-11T22:23:28.530069+0000","last_unstale":"2024-09-11T22:23:28.531316+0000","last_undegraded":"2024-09-11T22:23:28.531316+0000","last_fullsized":"2024-09-11T22:23:28.531316+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:23.081602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520583+0000","last_change":"2024-09-11T22:23:28.520583+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520583+0000","last_undegraded":"2024-09-11T22:23:28.520583+0000","last_fullsized":"2024-09-11T22:23:28.520583+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.529721+0000","last_change":"2024-09-11T22:23:28.528837+0000","last_active":"2024-09-11T22:23:28.529721+0000","last_peered":"2024-09-11T22:23:28.529721+0000","last_clean":"2024-09-11T22:23:28.529721+0000","last_became_active":"2024-09-11T22:23:28.528534+0000","last_became_peered":"2024-09-11T22:23:28.528534+0000","last_unstale":"2024-09-11T22:23:28.529721+0000","last_undegraded":"2024-09-11T22:23:28.529721+0000","last_fullsized":"2024-09-11T22:23:28.529721+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:54.377250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540216+0000","last_change":"2024-09-11T22:23:29.550504+0000","last_active":"2024-09-11T22:23:30.540216+0000","last_peered":"2024-09-11T22:23:30.540216+0000","last_clean":"2024-09-11T22:23:30.540216+0000","last_became_active":"2024-09-11T22:23:29.550220+0000","last_became_peered":"2024-09-11T22:23:29.550220+0000","last_unstale":"2024-09-11T22:23:30.540216+0000","last_undegraded":"2024-09-11T22:23:30.540216+0000","last_fullsized":"2024-09-11T22:23:30.540216+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:39.821369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542149+0000","last_change":"2024-09-11T22:23:28.527628+0000","last_active":"2024-09-11T22:23:30.542149+0000","last_peered":"2024-09-11T22:23:30.542149+0000","last_clean":"2024-09-11T22:23:30.542149+0000","last_became_active":"2024-09-11T22:23:28.527319+0000","last_became_peered":"2024-09-11T22:23:28.527319+0000","last_unstale":"2024-09-11T22:23:30.542149+0000","last_undegraded":"2024-09-11T22:23:30.542149+0000","last_fullsized":"2024-09-11T22:23:30.542149+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:25.526650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526841+0000","last_change":"2024-09-11T22:23:28.526841+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526841+0000","last_undegraded":"2024-09-11T22:23:28.526841+0000","last_fullsized":"2024-09-11T22:23:28.526841+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.532396+0000","last_change":"2024-09-11T22:23:28.531543+0000","last_active":"2024-09-11T22:23:28.532396+0000","last_peered":"2024-09-11T22:23:28.532396+0000","last_clean":"2024-09-11T22:23:28.532396+0000","last_became_active":"2024-09-11T22:23:28.531271+0000","last_became_peered":"2024-09-11T22:23:28.531271+0000","last_unstale":"2024-09-11T22:23:28.532396+0000","last_undegraded":"2024-09-11T22:23:28.532396+0000","last_fullsized":"2024-09-11T22:23:28.532396+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:00.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521842+0000","last_change":"2024-09-11T22:23:28.521842+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521842+0000","last_undegraded":"2024-09-11T22:23:28.521842+0000","last_fullsized":"2024-09-11T22:23:28.521842+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.527014+0000","last_change":"2024-09-11T22:23:28.525318+0000","last_active":"2024-09-11T22:23:28.527014+0000","last_peered":"2024-09-11T22:23:28.527014+0000","last_clean":"2024-09-11T22:23:28.527014+0000","last_became_active":"2024-09-11T22:23:28.525023+0000","last_became_peered":"2024-09-11T22:23:28.525023+0000","last_unstale":"2024-09-11T22:23:28.527014+0000","last_undegraded":"2024-09-11T22:23:28.527014+0000","last_fullsized":"2024-09-11T22:23:28.527014+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.555667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520614+0000","last_change":"2024-09-11T22:23:28.520614+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520614+0000","last_undegraded":"2024-09-11T22:23:28.520614+0000","last_fullsized":"2024-09-11T22:23:28.520614+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.529406+0000","last_change":"2024-09-11T22:23:28.527081+0000","last_active":"2024-09-11T22:23:28.529406+0000","last_peered":"2024-09-11T22:23:28.529406+0000","last_clean":"2024-09-11T22:23:28.529406+0000","last_became_active":"2024-09-11T22:23:28.526812+0000","last_became_peered":"2024-09-11T22:23:28.526812+0000","last_unstale":"2024-09-11T22:23:28.529406+0000","last_undegraded":"2024-09-11T22:23:28.529406+0000","last_fullsized":"2024-09-11T22:23:28.529406+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:54.132096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520931+0000","last_change":"2024-09-11T22:23:28.520931+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520931+0000","last_undegraded":"2024-09-11T22:23:28.520931+0000","last_fullsized":"2024-09-11T22:23:28.520931+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540760+0000","last_change":"2024-09-11T22:23:28.535525+0000","last_active":"2024-09-11T22:23:30.540760+0000","last_peered":"2024-09-11T22:23:30.540760+0000","last_clean":"2024-09-11T22:23:30.540760+0000","last_became_active":"2024-09-11T22:23:28.535228+0000","last_became_peered":"2024-09-11T22:23:28.535228+0000","last_unstale":"2024-09-11T22:23:30.540760+0000","last_undegraded":"2024-09-11T22:23:30.540760+0000","last_fullsized":"2024-09-11T22:23:30.540760+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:04.023245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540750+0000","last_change":"2024-09-11T22:23:29.535426+0000","last_active":"2024-09-11T22:23:30.540750+0000","last_peered":"2024-09-11T22:23:30.540750+0000","last_clean":"2024-09-11T22:23:30.540750+0000","last_became_active":"2024-09-11T22:23:29.535017+0000","last_became_peered":"2024-09-11T22:23:29.535017+0000","last_unstale":"2024-09-11T22:23:30.540750+0000","last_undegraded":"2024-09-11T22:23:30.540750+0000","last_fullsized":"2024-09-11T22:23:30.540750+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.675389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.529435+0000","last_change":"2024-09-11T22:23:28.528735+0000","last_active":"2024-09-11T22:23:28.529435+0000","last_peered":"2024-09-11T22:23:28.529435+0000","last_clean":"2024-09-11T22:23:28.529435+0000","last_became_active":"2024-09-11T22:23:28.528439+0000","last_became_peered":"2024-09-11T22:23:28.528439+0000","last_unstale":"2024-09-11T22:23:28.529435+0000","last_undegraded":"2024-09-11T22:23:28.529435+0000","last_fullsized":"2024-09-11T22:23:28.529435+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:45.684076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520387+0000","last_change":"2024-09-11T22:23:28.520387+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520387+0000","last_undegraded":"2024-09-11T22:23:28.520387+0000","last_fullsized":"2024-09-11T22:23:28.520387+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.540499+0000","last_change":"2024-09-11T22:23:28.538934+0000","last_active":"2024-09-11T22:23:28.540499+0000","last_peered":"2024-09-11T22:23:28.540499+0000","last_clean":"2024-09-11T22:23:28.540499+0000","last_became_active":"2024-09-11T22:23:28.538183+0000","last_became_peered":"2024-09-11T22:23:28.538183+0000","last_unstale":"2024-09-11T22:23:28.540499+0000","last_undegraded":"2024-09-11T22:23:28.540499+0000","last_fullsized":"2024-09-11T22:23:28.540499+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:16.512571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540497+0000","last_change":"2024-09-11T22:23:29.537202+0000","last_active":"2024-09-11T22:23:30.540497+0000","last_peered":"2024-09-11T22:23:30.540497+0000","last_clean":"2024-09-11T22:23:30.540497+0000","last_became_active":"2024-09-11T22:23:29.535118+0000","last_became_peered":"2024-09-11T22:23:29.535118+0000","last_unstale":"2024-09-11T22:23:30.540497+0000","last_undegraded":"2024-09-11T22:23:30.540497+0000","last_fullsized":"2024-09-11T22:23:30.540497+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:15.608920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531636+0000","last_change":"2024-09-11T22:23:28.529858+0000","last_active":"2024-09-11T22:23:28.531636+0000","last_peered":"2024-09-11T22:23:28.531636+0000","last_clean":"2024-09-11T22:23:28.531636+0000","last_became_active":"2024-09-11T22:23:28.529559+0000","last_became_peered":"2024-09-11T22:23:28.529559+0000","last_unstale":"2024-09-11T22:23:28.531636+0000","last_undegraded":"2024-09-11T22:23:28.531636+0000","last_fullsized":"2024-09-11T22:23:28.531636+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:25.609039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526401+0000","last_change":"2024-09-11T22:23:28.526401+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526401+0000","last_undegraded":"2024-09-11T22:23:28.526401+0000","last_fullsized":"2024-09-11T22:23:28.526401+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542211+0000","last_change":"2024-09-11T22:23:28.533696+0000","last_active":"2024-09-11T22:23:30.542211+0000","last_peered":"2024-09-11T22:23:30.542211+0000","last_clean":"2024-09-11T22:23:30.542211+0000","last_became_active":"2024-09-11T22:23:28.533412+0000","last_became_peered":"2024-09-11T22:23:28.533412+0000","last_unstale":"2024-09-11T22:23:30.542211+0000","last_undegraded":"2024-09-11T22:23:30.542211+0000","last_fullsized":"2024-09-11T22:23:30.542211+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:56.393853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.529550+0000","last_change":"2024-09-11T22:23:28.529550+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.529550+0000","last_undegraded":"2024-09-11T22:23:28.529550+0000","last_fullsized":"2024-09-11T22:23:28.529550+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.525004+0000","last_change":"2024-09-11T22:23:28.524567+0000","last_active":"2024-09-11T22:23:28.525004+0000","last_peered":"2024-09-11T22:23:28.525004+0000","last_clean":"2024-09-11T22:23:28.525004+0000","last_became_active":"2024-09-11T22:23:28.524261+0000","last_became_peered":"2024-09-11T22:23:28.524261+0000","last_unstale":"2024-09-11T22:23:28.525004+0000","last_undegraded":"2024-09-11T22:23:28.525004+0000","last_fullsized":"2024-09-11T22:23:28.525004+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:25.609039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527406+0000","last_change":"2024-09-11T22:23:28.527406+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527406+0000","last_undegraded":"2024-09-11T22:23:28.527406+0000","last_fullsized":"2024-09-11T22:23:28.527406+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.541049+0000","last_change":"2024-09-11T22:23:28.540359+0000","last_active":"2024-09-11T22:23:28.541049+0000","last_peered":"2024-09-11T22:23:28.541049+0000","last_clean":"2024-09-11T22:23:28.541049+0000","last_became_active":"2024-09-11T22:23:28.540041+0000","last_became_peered":"2024-09-11T22:23:28.540041+0000","last_unstale":"2024-09-11T22:23:28.541049+0000","last_undegraded":"2024-09-11T22:23:28.541049+0000","last_fullsized":"2024-09-11T22:23:28.541049+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:37.296359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.520108+0000","last_change":"2024-09-11T22:23:28.520108+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.520108+0000","last_undegraded":"2024-09-11T22:23:28.520108+0000","last_fullsized":"2024-09-11T22:23:28.520108+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.535368+0000","last_change":"2024-09-11T22:23:28.534953+0000","last_active":"2024-09-11T22:23:28.535368+0000","last_peered":"2024-09-11T22:23:28.535368+0000","last_clean":"2024-09-11T22:23:28.535368+0000","last_became_active":"2024-09-11T22:23:28.534637+0000","last_became_peered":"2024-09-11T22:23:28.534637+0000","last_unstale":"2024-09-11T22:23:28.535368+0000","last_undegraded":"2024-09-11T22:23:28.535368+0000","last_fullsized":"2024-09-11T22:23:28.535368+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.555667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542341+0000","last_change":"2024-09-11T22:23:29.527227+0000","last_active":"2024-09-11T22:23:30.542341+0000","last_peered":"2024-09-11T22:23:30.542341+0000","last_clean":"2024-09-11T22:23:30.542341+0000","last_became_active":"2024-09-11T22:23:29.526934+0000","last_became_peered":"2024-09-11T22:23:29.526934+0000","last_unstale":"2024-09-11T22:23:30.542341+0000","last_undegraded":"2024-09-11T22:23:30.542341+0000","last_fullsized":"2024-09-11T22:23:30.542341+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:55.674466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534454+0000","last_change":"2024-09-11T22:23:28.532266+0000","last_active":"2024-09-11T22:23:28.534454+0000","last_peered":"2024-09-11T22:23:28.534454+0000","last_clean":"2024-09-11T22:23:28.534454+0000","last_became_active":"2024-09-11T22:23:28.531883+0000","last_became_peered":"2024-09-11T22:23:28.531883+0000","last_unstale":"2024-09-11T22:23:28.534454+0000","last_undegraded":"2024-09-11T22:23:28.534454+0000","last_fullsized":"2024-09-11T22:23:28.534454+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:12.662086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.521404+0000","last_change":"2024-09-11T22:23:28.521404+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.521404+0000","last_undegraded":"2024-09-11T22:23:28.521404+0000","last_fullsized":"2024-09-11T22:23:28.521404+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.536442+0000","last_change":"2024-09-11T22:23:28.535869+0000","last_active":"2024-09-11T22:23:28.536442+0000","last_peered":"2024-09-11T22:23:28.536442+0000","last_clean":"2024-09-11T22:23:28.536442+0000","last_became_active":"2024-09-11T22:23:28.535425+0000","last_became_peered":"2024-09-11T22:23:28.535425+0000","last_unstale":"2024-09-11T22:23:28.536442+0000","last_undegraded":"2024-09-11T22:23:28.536442+0000","last_fullsized":"2024-09-11T22:23:28.536442+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:54.420567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527510+0000","last_change":"2024-09-11T22:23:28.527510+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527510+0000","last_undegraded":"2024-09-11T22:23:28.527510+0000","last_fullsized":"2024-09-11T22:23:28.527510+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540568+0000","last_change":"2024-09-11T22:23:28.541515+0000","last_active":"2024-09-11T22:23:30.540568+0000","last_peered":"2024-09-11T22:23:30.540568+0000","last_clean":"2024-09-11T22:23:30.540568+0000","last_became_active":"2024-09-11T22:23:28.541244+0000","last_became_peered":"2024-09-11T22:23:28.541244+0000","last_unstale":"2024-09-11T22:23:30.540568+0000","last_undegraded":"2024-09-11T22:23:30.540568+0000","last_fullsized":"2024-09-11T22:23:30.540568+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.816581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.524913+0000","last_change":"2024-09-11T22:23:28.524913+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.524913+0000","last_undegraded":"2024-09-11T22:23:28.524913+0000","last_fullsized":"2024-09-11T22:23:28.524913+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.540690+0000","last_change":"2024-09-11T22:23:28.536841+0000","last_active":"2024-09-11T22:23:28.540690+0000","last_peered":"2024-09-11T22:23:28.540690+0000","last_clean":"2024-09-11T22:23:28.540690+0000","last_became_active":"2024-09-11T22:23:28.536520+0000","last_became_peered":"2024-09-11T22:23:28.536520+0000","last_unstale":"2024-09-11T22:23:28.540690+0000","last_undegraded":"2024-09-11T22:23:28.540690+0000","last_fullsized":"2024-09-11T22:23:28.540690+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:45.684076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527075+0000","last_change":"2024-09-11T22:23:28.527075+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527075+0000","last_undegraded":"2024-09-11T22:23:28.527075+0000","last_fullsized":"2024-09-11T22:23:28.527075+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.538652+0000","last_change":"2024-09-11T22:23:28.537499+0000","last_active":"2024-09-11T22:23:28.538652+0000","last_peered":"2024-09-11T22:23:28.538652+0000","last_clean":"2024-09-11T22:23:28.538652+0000","last_became_active":"2024-09-11T22:23:28.537241+0000","last_became_peered":"2024-09-11T22:23:28.537241+0000","last_unstale":"2024-09-11T22:23:28.538652+0000","last_undegraded":"2024-09-11T22:23:28.538652+0000","last_fullsized":"2024-09-11T22:23:28.538652+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:01.375011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528136+0000","last_change":"2024-09-11T22:23:28.528136+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528136+0000","last_undegraded":"2024-09-11T22:23:28.528136+0000","last_fullsized":"2024-09-11T22:23:28.528136+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531563+0000","last_change":"2024-09-11T22:23:28.530647+0000","last_active":"2024-09-11T22:23:28.531563+0000","last_peered":"2024-09-11T22:23:28.531563+0000","last_clean":"2024-09-11T22:23:28.531563+0000","last_became_active":"2024-09-11T22:23:28.530268+0000","last_became_peered":"2024-09-11T22:23:28.530268+0000","last_unstale":"2024-09-11T22:23:28.531563+0000","last_undegraded":"2024-09-11T22:23:28.531563+0000","last_fullsized":"2024-09-11T22:23:28.531563+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:46:18.742814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542012+0000","last_change":"2024-09-11T22:23:29.528818+0000","last_active":"2024-09-11T22:23:30.542012+0000","last_peered":"2024-09-11T22:23:30.542012+0000","last_clean":"2024-09-11T22:23:30.542012+0000","last_became_active":"2024-09-11T22:23:29.528503+0000","last_became_peered":"2024-09-11T22:23:29.528503+0000","last_unstale":"2024-09-11T22:23:30.542012+0000","last_undegraded":"2024-09-11T22:23:30.542012+0000","last_fullsized":"2024-09-11T22:23:30.542012+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:05.893484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534169+0000","last_change":"2024-09-11T22:23:28.533383+0000","last_active":"2024-09-11T22:23:28.534169+0000","last_peered":"2024-09-11T22:23:28.534169+0000","last_clean":"2024-09-11T22:23:28.534169+0000","last_became_active":"2024-09-11T22:23:28.533009+0000","last_became_peered":"2024-09-11T22:23:28.533009+0000","last_unstale":"2024-09-11T22:23:28.534169+0000","last_undegraded":"2024-09-11T22:23:28.534169+0000","last_fullsized":"2024-09-11T22:23:28.534169+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:12.662086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.530590+0000","last_change":"2024-09-11T22:23:28.530590+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.530590+0000","last_undegraded":"2024-09-11T22:23:28.530590+0000","last_fullsized":"2024-09-11T22:23:28.530590+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534512+0000","last_change":"2024-09-11T22:23:28.533228+0000","last_active":"2024-09-11T22:23:28.534512+0000","last_peered":"2024-09-11T22:23:28.534512+0000","last_clean":"2024-09-11T22:23:28.534512+0000","last_became_active":"2024-09-11T22:23:28.532945+0000","last_became_peered":"2024-09-11T22:23:28.532945+0000","last_unstale":"2024-09-11T22:23:28.534512+0000","last_undegraded":"2024-09-11T22:23:28.534512+0000","last_fullsized":"2024-09-11T22:23:28.534512+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.673122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.528185+0000","last_change":"2024-09-11T22:23:28.528185+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.528185+0000","last_undegraded":"2024-09-11T22:23:28.528185+0000","last_fullsized":"2024-09-11T22:23:28.528185+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.541398+0000","last_change":"2024-09-11T22:23:28.539834+0000","last_active":"2024-09-11T22:23:28.541398+0000","last_peered":"2024-09-11T22:23:28.541398+0000","last_clean":"2024-09-11T22:23:28.541398+0000","last_became_active":"2024-09-11T22:23:28.539533+0000","last_became_peered":"2024-09-11T22:23:28.539533+0000","last_unstale":"2024-09-11T22:23:28.541398+0000","last_undegraded":"2024-09-11T22:23:28.541398+0000","last_fullsized":"2024-09-11T22:23:28.541398+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:46.075605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527147+0000","last_change":"2024-09-11T22:23:28.527147+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527147+0000","last_undegraded":"2024-09-11T22:23:28.527147+0000","last_fullsized":"2024-09-11T22:23:28.527147+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"189'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.541721+0000","last_change":"2024-09-11T22:23:28.539679+0000","last_active":"2024-09-11T22:23:30.541721+0000","last_peered":"2024-09-11T22:23:30.541721+0000","last_clean":"2024-09-11T22:23:30.541721+0000","last_became_active":"2024-09-11T22:23:28.539329+0000","last_became_peered":"2024-09-11T22:23:28.539329+0000","last_unstale":"2024-09-11T22:23:30.541721+0000","last_undegraded":"2024-09-11T22:23:30.541721+0000","last_fullsized":"2024-09-11T22:23:30.541721+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:32.744023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527083+0000","last_change":"2024-09-11T22:23:28.527083+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527083+0000","last_undegraded":"2024-09-11T22:23:28.527083+0000","last_fullsized":"2024-09-11T22:23:28.527083+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540639+0000","last_change":"2024-09-11T22:23:28.539999+0000","last_active":"2024-09-11T22:23:30.540639+0000","last_peered":"2024-09-11T22:23:30.540639+0000","last_clean":"2024-09-11T22:23:30.540639+0000","last_became_active":"2024-09-11T22:23:28.539770+0000","last_became_peered":"2024-09-11T22:23:28.539770+0000","last_unstale":"2024-09-11T22:23:30.540639+0000","last_undegraded":"2024-09-11T22:23:30.540639+0000","last_fullsized":"2024-09-11T22:23:30.540639+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:53.362785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.531504+0000","last_change":"2024-09-11T22:23:28.531504+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.531504+0000","last_undegraded":"2024-09-11T22:23:28.531504+0000","last_fullsized":"2024-09-11T22:23:28.531504+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.539220+0000","last_change":"2024-09-11T22:23:28.538694+0000","last_active":"2024-09-11T22:23:28.539220+0000","last_peered":"2024-09-11T22:23:28.539220+0000","last_clean":"2024-09-11T22:23:28.539220+0000","last_became_active":"2024-09-11T22:23:28.538434+0000","last_became_peered":"2024-09-11T22:23:28.538434+0000","last_unstale":"2024-09-11T22:23:28.539220+0000","last_undegraded":"2024-09-11T22:23:28.539220+0000","last_fullsized":"2024-09-11T22:23:28.539220+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:46.891077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.519844+0000","last_change":"2024-09-11T22:23:28.519844+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.519844+0000","last_undegraded":"2024-09-11T22:23:28.519844+0000","last_fullsized":"2024-09-11T22:23:28.519844+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.536914+0000","last_change":"2024-09-11T22:23:28.535813+0000","last_active":"2024-09-11T22:23:28.536914+0000","last_peered":"2024-09-11T22:23:28.536914+0000","last_clean":"2024-09-11T22:23:28.536914+0000","last_became_active":"2024-09-11T22:23:28.535523+0000","last_became_peered":"2024-09-11T22:23:28.535523+0000","last_unstale":"2024-09-11T22:23:28.536914+0000","last_undegraded":"2024-09-11T22:23:28.536914+0000","last_fullsized":"2024-09-11T22:23:28.536914+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:59.580534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.526821+0000","last_change":"2024-09-11T22:23:28.526821+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.526821+0000","last_undegraded":"2024-09-11T22:23:28.526821+0000","last_fullsized":"2024-09-11T22:23:28.526821+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531088+0000","last_change":"2024-09-11T22:23:28.530346+0000","last_active":"2024-09-11T22:23:28.531088+0000","last_peered":"2024-09-11T22:23:28.531088+0000","last_clean":"2024-09-11T22:23:28.531088+0000","last_became_active":"2024-09-11T22:23:28.530073+0000","last_became_peered":"2024-09-11T22:23:28.530073+0000","last_unstale":"2024-09-11T22:23:28.531088+0000","last_undegraded":"2024-09-11T22:23:28.531088+0000","last_fullsized":"2024-09-11T22:23:28.531088+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:05.774908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2024-09-11T22:23:28.527000+0000","last_change":"2024-09-11T22:23:28.527000+0000","last_active":"2024-09-11T22:23:28.510780+0000","last_peered":"2024-09-11T22:23:28.510780+0000","last_clean":"2024-09-11T22:23:28.510780+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:23:28.527000+0000","last_undegraded":"2024-09-11T22:23:28.527000+0000","last_fullsized":"2024-09-11T22:23:28.527000+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.540998+0000","last_change":"2024-09-11T22:23:28.539672+0000","last_active":"2024-09-11T22:23:28.540998+0000","last_peered":"2024-09-11T22:23:28.540998+0000","last_clean":"2024-09-11T22:23:28.540998+0000","last_became_active":"2024-09-11T22:23:28.539297+0000","last_became_peered":"2024-09-11T22:23:28.539297+0000","last_unstale":"2024-09-11T22:23:28.540998+0000","last_undegraded":"2024-09-11T22:23:28.540998+0000","last_fullsized":"2024-09-11T22:23:28.540998+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:57.831523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540253+0000","last_change":"2024-09-11T22:23:29.535903+0000","last_active":"2024-09-11T22:23:30.540253+0000","last_peered":"2024-09-11T22:23:30.540253+0000","last_clean":"2024-09-11T22:23:30.540253+0000","last_became_active":"2024-09-11T22:23:29.535471+0000","last_became_peered":"2024-09-11T22:23:29.535471+0000","last_unstale":"2024-09-11T22:23:30.540253+0000","last_undegraded":"2024-09-11T22:23:30.540253+0000","last_fullsized":"2024-09-11T22:23:30.540253+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:00.493935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.534492+0000","last_change":"2024-09-11T22:23:28.533170+0000","last_active":"2024-09-11T22:23:28.534492+0000","last_peered":"2024-09-11T22:23:28.534492+0000","last_clean":"2024-09-11T22:23:28.534492+0000","last_became_active":"2024-09-11T22:23:28.532610+0000","last_became_peered":"2024-09-11T22:23:28.532610+0000","last_unstale":"2024-09-11T22:23:28.534492+0000","last_undegraded":"2024-09-11T22:23:28.534492+0000","last_fullsized":"2024-09-11T22:23:28.534492+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:59.580534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540438+0000","last_change":"2024-09-11T22:23:29.536908+0000","last_active":"2024-09-11T22:23:30.540438+0000","last_peered":"2024-09-11T22:23:30.540438+0000","last_clean":"2024-09-11T22:23:30.540438+0000","last_became_active":"2024-09-11T22:23:29.535490+0000","last_became_peered":"2024-09-11T22:23:29.535490+0000","last_unstale":"2024-09-11T22:23:30.540438+0000","last_undegraded":"2024-09-11T22:23:30.540438+0000","last_fullsized":"2024-09-11T22:23:30.540438+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:24.519389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-11T22:23:28.531593+0000","last_change":"2024-09-11T22:23:28.530787+0000","last_active":"2024-09-11T22:23:28.531593+0000","last_peered":"2024-09-11T22:23:28.531593+0000","last_clean":"2024-09-11T22:23:28.531593+0000","last_became_active":"2024-09-11T22:23:28.530333+0000","last_became_peered":"2024-09-11T22:23:28.530333+0000","last_unstale":"2024-09-11T22:23:28.531593+0000","last_undegraded":"2024-09-11T22:23:28.531593+0000","last_fullsized":"2024-09-11T22:23:28.531593+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:00.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":474,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540044+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:23:30.540044+0000","last_peered":"2024-09-11T22:23:30.540044+0000","last_clean":"2024-09-11T22:23:30.540044+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:23:30.540044+0000","last_undegraded":"2024-09-11T22:23:30.540044+0000","last_fullsized":"2024-09-11T22:23:30.540044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":104,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509594,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55700,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316140,"statfs":{"total":96636764160,"available":96579727360,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51540,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320300,"statfs":{"total":96636764160,"available":96583987200,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509593,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64020,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307820,"statfs":{"total":96636764160,"available":96571207680,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47376,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324464,"statfs":{"total":96636764160,"available":96588251136,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47380,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324460,"statfs":{"total":96636764160,"available":96588247040,"internally_reserved":0,"allocated":2355200,"data_stored":1033755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509592,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60436,"kb_used_data":2880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311404,"statfs":{"total":96636764160,"available":96574877696,"internally_reserved":0,"allocated":2949120,"data_stored":1624123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60472,"kb_used_data":2908,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311368,"statfs":{"total":96636764160,"available":96574840832,"internally_reserved":0,"allocated":2977792,"data_stored":1637268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47424,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324416,"statfs":{"total":96636764160,"available":96588201984,"internally_reserved":0,"allocated":2400256,"data_stored":1048498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:23:36.932 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:23:37.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.046+0000 7f596c34b640 1 Processor -- start 2024-09-11T22:23:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.046+0000 7f596c34b640 1 -- start start 2024-09-11T22:23:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.047+0000 7f596c34b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f596415ffb0 0x7f59640d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.047+0000 7f596c34b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f59640b3a40 0x7f59640d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.047+0000 7f596c34b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59640b2890 con 0x7f59640d0ee0 2024-09-11T22:23:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.047+0000 7f596c34b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f59640b2b70 con 0x7f59640b3a40 2024-09-11T22:23:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.047+0000 7f596c34b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f59640b2e50 con 0x7f596415ffb0 2024-09-11T22:23:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f596a8e8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f59640d0ee0 0x7f5964160470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53630/0 (socket says 172.21.15.50:53630) 2024-09-11T22:23:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f596a8e8640 1 -- 172.21.15.50:0/83616746 learned_addr learned my addr 172.21.15.50:0/83616746 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f596a0e7640 1 --2- 172.21.15.50:0/83616746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f596415ffb0 0x7f59640d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59698e6640 1 --2- 172.21.15.50:0/83616746 >> v2:172.21.15.77:3300/0 conn(0x7f59640b3a40 0x7f59640d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368286586 0 0) 0x7f59640b2890 con 0x7f59640d0ee0 2024-09-11T22:23:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5950003520 con 0x7f59640d0ee0 2024-09-11T22:23:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2030386067 0 0) 0x7f5950003520 con 0x7f59640d0ee0 2024-09-11T22:23:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f596415ffb0 msgr2=0x7f59640d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 --2- 172.21.15.50:0/83616746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f596415ffb0 0x7f59640d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 >> v2:172.21.15.77:3300/0 conn(0x7f59640b3a40 msgr2=0x7f59640d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 --2- 172.21.15.50:0/83616746 >> v2:172.21.15.77:3300/0 conn(0x7f59640b3a40 0x7f59640d09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59640b3130 con 0x7f59640d0ee0 2024-09-11T22:23:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f595c0019f0 con 0x7f59640d0ee0 2024-09-11T22:23:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59698e6640 1 --2- 172.21.15.50:0/83616746 >> v2:172.21.15.77:3300/0 conn(0x7f59640b3a40 0x7f59640d09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 >> v1:172.21.15.50:6789/0 conn(0x7f59640d0ee0 legacy=0x7f5964160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 --2- 172.21.15.50:0/83616746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f596415ffb0 0x7f59500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 --2- 172.21.15.50:0/83616746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5950003f30 0x7f5950004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 --2- 172.21.15.50:0/83616746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5950004d40 0x7f59500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f59640b2b70 con 0x7f5950003f30 2024-09-11T22:23:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f59640b2e50 con 0x7f5950004d40 2024-09-11T22:23:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f595000ba10 con 0x7f596415ffb0 2024-09-11T22:23:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f59698e6640 1 --2- 172.21.15.50:0/83616746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5950003f30 0x7f5950004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f596a0e7640 1 --2- 172.21.15.50:0/83616746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f596415ffb0 0x7f59500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.048+0000 7f596a8e8640 1 --2- 172.21.15.50:0/83616746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5950004d40 0x7f59500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.049+0000 7f59698e6640 1 -- 172.21.15.50:0/83616746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f596415ffb0 msgr2=0x7f59500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.049+0000 7f59698e6640 1 --2- 172.21.15.50:0/83616746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f596415ffb0 0x7f59500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.049+0000 7f59698e6640 1 -- 172.21.15.50:0/83616746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5950004d40 msgr2=0x7f59500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.049+0000 7f59698e6640 1 --2- 172.21.15.50:0/83616746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5950004d40 0x7f59500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.049+0000 7f59698e6640 1 -- 172.21.15.50:0/83616746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5950003520 con 0x7f5950003f30 2024-09-11T22:23:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.049+0000 7f596a8e8640 1 --2- 172.21.15.50:0/83616746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5950004d40 0x7f59500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.049+0000 7f59698e6640 1 --2- 172.21.15.50:0/83616746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5950003f30 0x7f5950004800 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f5954009c90 tx=0x7f5950005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4042d119c451c662 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.050+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954009860 con 0x7f5950003f30 2024-09-11T22:23:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.050+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5954004020 con 0x7f5950003f30 2024-09-11T22:23:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.050+0000 7f59690e5640 1 -- 172.21.15.50:0/83616746 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59540043f0 con 0x7f5950003f30 2024-09-11T22:23:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.050+0000 7f596c34b640 1 -- 172.21.15.50:0/83616746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5950003f30 msgr2=0x7f5950004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.050+0000 7f596c34b640 1 --2- 172.21.15.50:0/83616746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5950003f30 0x7f5950004800 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f5954009c90 tx=0x7f5950005830 comp rx=0 tx=0).stop 2024-09-11T22:23:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.050+0000 7f596a8e8640 1 -- 172.21.15.50:0/83616746 reap_dead start 2024-09-11T22:23:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.050+0000 7f596c34b640 1 -- 172.21.15.50:0/83616746 shutdown_connections 2024-09-11T22:23:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.050+0000 7f596c34b640 1 -- 172.21.15.50:0/83616746 >> 172.21.15.50:0/83616746 conn(0x7f59640b40b0 msgr2=0x7f59640b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.050+0000 7f596c34b640 1 -- 172.21.15.50:0/83616746 shutdown_connections 2024-09-11T22:23:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.050+0000 7f596c34b640 1 -- 172.21.15.50:0/83616746 wait complete. 2024-09-11T22:23:37.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.051+0000 7f596c34b640 1 Processor -- start 2024-09-11T22:23:37.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.052+0000 7f596c34b640 1 -- start start 2024-09-11T22:23:37.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.052+0000 7f596c34b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5950003f30 0x7f5964153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.052+0000 7f596c34b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59640b7290 0x7f59640ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.052+0000 7f596c34b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59640b76f0 0x7f59640ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.052+0000 7f596c34b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f59640b0520 con 0x7f5950003f30 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.052+0000 7f596c34b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f59640b03a0 con 0x7f59640b76f0 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.052+0000 7f596c34b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f59640d0460 con 0x7f59640b7290 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.052+0000 7f596a0e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5950003f30 0x7f5964153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.052+0000 7f596a0e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5950003f30 0x7f5964153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54378/0 (socket says 172.21.15.50:54378) 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.052+0000 7f596a0e7640 1 -- 172.21.15.50:0/3374151281 learned_addr learned my addr 172.21.15.50:0/3374151281 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f59698e6640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59640b7290 0x7f59640ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f596a8e8640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59640b76f0 0x7f59640ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f596a0e7640 1 -- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59640b7290 msgr2=0x7f59640ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f596a0e7640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59640b7290 0x7f59640ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f596a0e7640 1 -- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59640b76f0 msgr2=0x7f59640ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f596a0e7640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59640b76f0 0x7f59640ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f596a0e7640 1 -- 172.21.15.50:0/3374151281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5964159f70 con 0x7f5950003f30 2024-09-11T22:23:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f59698e6640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59640b7290 0x7f59640ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f596a8e8640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59640b76f0 0x7f59640ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f596a0e7640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5950003f30 0x7f5964153ba0 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f59600119d0 tx=0x7f5960011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f595affd640 1 -- 172.21.15.50:0/3374151281 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596000fb50 con 0x7f5950003f30 2024-09-11T22:23:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f595affd640 1 -- 172.21.15.50:0/3374151281 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596000fcf0 con 0x7f5950003f30 2024-09-11T22:23:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f596c34b640 1 -- 172.21.15.50:0/3374151281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596415a250 con 0x7f5950003f30 2024-09-11T22:23:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f595affd640 1 -- 172.21.15.50:0/3374151281 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596000fea0 con 0x7f5950003f30 2024-09-11T22:23:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.053+0000 7f596c34b640 1 -- 172.21.15.50:0/3374151281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596415a810 con 0x7f5950003f30 2024-09-11T22:23:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.054+0000 7f596c34b640 1 -- 172.21.15.50:0/3374151281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59640d0760 con 0x7f5950003f30 2024-09-11T22:23:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.055+0000 7f595affd640 1 -- 172.21.15.50:0/3374151281 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5960012040 con 0x7f5950003f30 2024-09-11T22:23:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.055+0000 7f595affd640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f594806be60 0x7f594806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.055+0000 7f595affd640 1 -- 172.21.15.50:0/3374151281 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f596008b4d0 con 0x7f5950003f30 2024-09-11T22:23:37.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.056+0000 7f59698e6640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f594806be60 0x7f594806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.056+0000 7f59698e6640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f594806be60 0x7f594806e320 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f5954032000 tx=0x7f5954008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:37.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.060+0000 7f595affd640 1 -- 172.21.15.50:0/3374151281 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5960019030 con 0x7f5950003f30 2024-09-11T22:23:37.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.232+0000 7f596c34b640 1 -- 172.21.15.50:0/3374151281 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f59640b4e80 con 0x7f594806be60 2024-09-11T22:23:37.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.239+0000 7f595affd640 1 -- 172.21.15.50:0/3374151281 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252479 (secure 0 0 0) 0x7f595407ea50 con 0x7f594806be60 2024-09-11T22:23:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:37.244 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:23:37.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.242+0000 7f596c34b640 1 -- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f594806be60 msgr2=0x7f594806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.242+0000 7f596c34b640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f594806be60 0x7f594806e320 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f5954032000 tx=0x7f5954008030 comp rx=0 tx=0).stop 2024-09-11T22:23:37.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.242+0000 7f596c34b640 1 -- 172.21.15.50:0/3374151281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5950003f30 msgr2=0x7f5964153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.242+0000 7f596c34b640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5950003f30 0x7f5964153ba0 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f59600119d0 tx=0x7f5960011e90 comp rx=0 tx=0).stop 2024-09-11T22:23:37.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.242+0000 7f596c34b640 1 -- 172.21.15.50:0/3374151281 shutdown_connections 2024-09-11T22:23:37.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.242+0000 7f596c34b640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f594806be60 0x7f594806e320 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.242+0000 7f596c34b640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59640b7290 0x7f59640ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.242+0000 7f596c34b640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59640b76f0 0x7f59640ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.242+0000 7f596c34b640 1 --2- 172.21.15.50:0/3374151281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5950003f30 0x7f5964153ba0 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.242+0000 7f596c34b640 1 -- 172.21.15.50:0/3374151281 >> 172.21.15.50:0/3374151281 conn(0x7f59640b40b0 msgr2=0x7f59640cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:37.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.242+0000 7f596c34b640 1 -- 172.21.15.50:0/3374151281 shutdown_connections 2024-09-11T22:23:37.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.242+0000 7f596c34b640 1 -- 172.21.15.50:0/3374151281 wait complete. 2024-09-11T22:23:37.254 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":559,"stamp":"2024-09-11T22:23:35.543719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":460824,"kb_used_data":19816,"kb_used_omap":12,"kb_used_meta":440819,"kb_avail":754513896,"statfs":{"total":773094113280,"available":772622229504,"internally_reserved":0,"allocated":20291584,"data_stored":9560196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":451399217},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.025484"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540631+0000","last_change":"2024-09-11T22:23:29.541014+0000","last_active":"2024-09-11T22:23:30.540631+0000","last_peered":"2024-09-11T22:23:30.540631+0000","last_clean":"2024-09-11T22:23:30.540631+0000","last_became_active":"2024-09-11T22:23:29.540734+0000","last_became_peered":"2024-09-11T22:23:29.540734+0000","last_unstale":"2024-09-11T22:23:30.540631+0000","last_undegraded":"2024-09-11T22:23:30.540631+0000","last_fullsized":"2024-09-11T22:23:30.540631+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:57.887612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159458+0000","last_change":"2024-09-11T22:23:29.544245+0000","last_active":"2024-09-11T22:23:32.159458+0000","last_peered":"2024-09-11T22:23:32.159458+0000","last_clean":"2024-09-11T22:23:32.159458+0000","last_became_active":"2024-09-11T22:23:29.543937+0000","last_became_peered":"2024-09-11T22:23:29.543937+0000","last_unstale":"2024-09-11T22:23:32.159458+0000","last_undegraded":"2024-09-11T22:23:32.159458+0000","last_fullsized":"2024-09-11T22:23:32.159458+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:36.367566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522962+0000","last_change":"2024-09-11T22:23:29.544164+0000","last_active":"2024-09-11T22:23:30.522962+0000","last_peered":"2024-09-11T22:23:30.522962+0000","last_clean":"2024-09-11T22:23:30.522962+0000","last_became_active":"2024-09-11T22:23:29.543900+0000","last_became_peered":"2024-09-11T22:23:29.543900+0000","last_unstale":"2024-09-11T22:23:30.522962+0000","last_undegraded":"2024-09-11T22:23:30.522962+0000","last_fullsized":"2024-09-11T22:23:30.522962+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:02.180620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520526+0000","last_change":"2024-09-11T22:23:29.541306+0000","last_active":"2024-09-11T22:23:30.520526+0000","last_peered":"2024-09-11T22:23:30.520526+0000","last_clean":"2024-09-11T22:23:30.520526+0000","last_became_active":"2024-09-11T22:23:29.540789+0000","last_became_peered":"2024-09-11T22:23:29.540789+0000","last_unstale":"2024-09-11T22:23:30.520526+0000","last_undegraded":"2024-09-11T22:23:30.520526+0000","last_fullsized":"2024-09-11T22:23:30.520526+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:43.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520490+0000","last_change":"2024-09-11T22:23:29.539252+0000","last_active":"2024-09-11T22:23:30.520490+0000","last_peered":"2024-09-11T22:23:30.520490+0000","last_clean":"2024-09-11T22:23:30.520490+0000","last_became_active":"2024-09-11T22:23:29.538975+0000","last_became_peered":"2024-09-11T22:23:29.538975+0000","last_unstale":"2024-09-11T22:23:30.520490+0000","last_undegraded":"2024-09-11T22:23:30.520490+0000","last_fullsized":"2024-09-11T22:23:30.520490+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:13.737423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.158884+0000","last_change":"2024-09-11T22:23:29.525289+0000","last_active":"2024-09-11T22:23:32.158884+0000","last_peered":"2024-09-11T22:23:32.158884+0000","last_clean":"2024-09-11T22:23:32.158884+0000","last_became_active":"2024-09-11T22:23:29.524998+0000","last_became_peered":"2024-09-11T22:23:29.524998+0000","last_unstale":"2024-09-11T22:23:32.158884+0000","last_undegraded":"2024-09-11T22:23:32.158884+0000","last_fullsized":"2024-09-11T22:23:32.158884+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:27.591573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522218+0000","last_change":"2024-09-11T22:23:29.546260+0000","last_active":"2024-09-11T22:23:30.522218+0000","last_peered":"2024-09-11T22:23:30.522218+0000","last_clean":"2024-09-11T22:23:30.522218+0000","last_became_active":"2024-09-11T22:23:29.545855+0000","last_became_peered":"2024-09-11T22:23:29.545855+0000","last_unstale":"2024-09-11T22:23:30.522218+0000","last_undegraded":"2024-09-11T22:23:30.522218+0000","last_fullsized":"2024-09-11T22:23:30.522218+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:10.437376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.541990+0000","last_change":"2024-09-11T22:23:29.526180+0000","last_active":"2024-09-11T22:23:30.541990+0000","last_peered":"2024-09-11T22:23:30.541990+0000","last_clean":"2024-09-11T22:23:30.541990+0000","last_became_active":"2024-09-11T22:23:29.525856+0000","last_became_peered":"2024-09-11T22:23:29.525856+0000","last_unstale":"2024-09-11T22:23:30.541990+0000","last_undegraded":"2024-09-11T22:23:30.541990+0000","last_fullsized":"2024-09-11T22:23:30.541990+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:01.977359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.523131+0000","last_change":"2024-09-11T22:23:29.541365+0000","last_active":"2024-09-11T22:23:30.523131+0000","last_peered":"2024-09-11T22:23:30.523131+0000","last_clean":"2024-09-11T22:23:30.523131+0000","last_became_active":"2024-09-11T22:23:29.541012+0000","last_became_peered":"2024-09-11T22:23:29.541012+0000","last_unstale":"2024-09-11T22:23:30.523131+0000","last_undegraded":"2024-09-11T22:23:30.523131+0000","last_fullsized":"2024-09-11T22:23:30.523131+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:48.335124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159181+0000","last_change":"2024-09-11T22:23:29.530328+0000","last_active":"2024-09-11T22:23:32.159181+0000","last_peered":"2024-09-11T22:23:32.159181+0000","last_clean":"2024-09-11T22:23:32.159181+0000","last_became_active":"2024-09-11T22:23:29.529948+0000","last_became_peered":"2024-09-11T22:23:29.529948+0000","last_unstale":"2024-09-11T22:23:32.159181+0000","last_undegraded":"2024-09-11T22:23:32.159181+0000","last_fullsized":"2024-09-11T22:23:32.159181+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:44.894213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540440+0000","last_change":"2024-09-11T22:23:29.542059+0000","last_active":"2024-09-11T22:23:30.540440+0000","last_peered":"2024-09-11T22:23:30.540440+0000","last_clean":"2024-09-11T22:23:30.540440+0000","last_became_active":"2024-09-11T22:23:29.541774+0000","last_became_peered":"2024-09-11T22:23:29.541774+0000","last_unstale":"2024-09-11T22:23:30.540440+0000","last_undegraded":"2024-09-11T22:23:30.540440+0000","last_fullsized":"2024-09-11T22:23:30.540440+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:00.856060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159459+0000","last_change":"2024-09-11T22:23:29.535828+0000","last_active":"2024-09-11T22:23:32.159459+0000","last_peered":"2024-09-11T22:23:32.159459+0000","last_clean":"2024-09-11T22:23:32.159459+0000","last_became_active":"2024-09-11T22:23:29.535510+0000","last_became_peered":"2024-09-11T22:23:29.535510+0000","last_unstale":"2024-09-11T22:23:32.159459+0000","last_undegraded":"2024-09-11T22:23:32.159459+0000","last_fullsized":"2024-09-11T22:23:32.159459+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:14.988472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159421+0000","last_change":"2024-09-11T22:23:29.525533+0000","last_active":"2024-09-11T22:23:32.159421+0000","last_peered":"2024-09-11T22:23:32.159421+0000","last_clean":"2024-09-11T22:23:32.159421+0000","last_became_active":"2024-09-11T22:23:29.525233+0000","last_became_peered":"2024-09-11T22:23:29.525233+0000","last_unstale":"2024-09-11T22:23:32.159421+0000","last_undegraded":"2024-09-11T22:23:32.159421+0000","last_fullsized":"2024-09-11T22:23:32.159421+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:02.113434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522268+0000","last_change":"2024-09-11T22:23:29.532055+0000","last_active":"2024-09-11T22:23:30.522268+0000","last_peered":"2024-09-11T22:23:30.522268+0000","last_clean":"2024-09-11T22:23:30.522268+0000","last_became_active":"2024-09-11T22:23:29.531734+0000","last_became_peered":"2024-09-11T22:23:29.531734+0000","last_unstale":"2024-09-11T22:23:30.522268+0000","last_undegraded":"2024-09-11T22:23:30.522268+0000","last_fullsized":"2024-09-11T22:23:30.522268+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:12:40.153593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.158451+0000","last_change":"2024-09-11T22:23:29.545580+0000","last_active":"2024-09-11T22:23:32.158451+0000","last_peered":"2024-09-11T22:23:32.158451+0000","last_clean":"2024-09-11T22:23:32.158451+0000","last_became_active":"2024-09-11T22:23:29.545275+0000","last_became_peered":"2024-09-11T22:23:29.545275+0000","last_unstale":"2024-09-11T22:23:32.158451+0000","last_undegraded":"2024-09-11T22:23:32.158451+0000","last_fullsized":"2024-09-11T22:23:32.158451+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:12.908473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159345+0000","last_change":"2024-09-11T22:23:29.525481+0000","last_active":"2024-09-11T22:23:32.159345+0000","last_peered":"2024-09-11T22:23:32.159345+0000","last_clean":"2024-09-11T22:23:32.159345+0000","last_became_active":"2024-09-11T22:23:29.525158+0000","last_became_peered":"2024-09-11T22:23:29.525158+0000","last_unstale":"2024-09-11T22:23:32.159345+0000","last_undegraded":"2024-09-11T22:23:32.159345+0000","last_fullsized":"2024-09-11T22:23:32.159345+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:47.081867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.523203+0000","last_change":"2024-09-11T22:23:29.531329+0000","last_active":"2024-09-11T22:23:30.523203+0000","last_peered":"2024-09-11T22:23:30.523203+0000","last_clean":"2024-09-11T22:23:30.523203+0000","last_became_active":"2024-09-11T22:23:29.530989+0000","last_became_peered":"2024-09-11T22:23:29.530989+0000","last_unstale":"2024-09-11T22:23:30.523203+0000","last_undegraded":"2024-09-11T22:23:30.523203+0000","last_fullsized":"2024-09-11T22:23:30.523203+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:37.247272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159234+0000","last_change":"2024-09-11T22:23:29.544053+0000","last_active":"2024-09-11T22:23:32.159234+0000","last_peered":"2024-09-11T22:23:32.159234+0000","last_clean":"2024-09-11T22:23:32.159234+0000","last_became_active":"2024-09-11T22:23:29.543724+0000","last_became_peered":"2024-09-11T22:23:29.543724+0000","last_unstale":"2024-09-11T22:23:32.159234+0000","last_undegraded":"2024-09-11T22:23:32.159234+0000","last_fullsized":"2024-09-11T22:23:32.159234+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:36:56.928785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520783+0000","last_change":"2024-09-11T22:23:29.536985+0000","last_active":"2024-09-11T22:23:30.520783+0000","last_peered":"2024-09-11T22:23:30.520783+0000","last_clean":"2024-09-11T22:23:30.520783+0000","last_became_active":"2024-09-11T22:23:29.536709+0000","last_became_peered":"2024-09-11T22:23:29.536709+0000","last_unstale":"2024-09-11T22:23:30.520783+0000","last_undegraded":"2024-09-11T22:23:30.520783+0000","last_fullsized":"2024-09-11T22:23:30.520783+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:46.659830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159123+0000","last_change":"2024-09-11T22:23:29.526719+0000","last_active":"2024-09-11T22:23:32.159123+0000","last_peered":"2024-09-11T22:23:32.159123+0000","last_clean":"2024-09-11T22:23:32.159123+0000","last_became_active":"2024-09-11T22:23:29.526433+0000","last_became_peered":"2024-09-11T22:23:29.526433+0000","last_unstale":"2024-09-11T22:23:32.159123+0000","last_undegraded":"2024-09-11T22:23:32.159123+0000","last_fullsized":"2024-09-11T22:23:32.159123+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:14:47.863542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520649+0000","last_change":"2024-09-11T22:23:29.536242+0000","last_active":"2024-09-11T22:23:30.520649+0000","last_peered":"2024-09-11T22:23:30.520649+0000","last_clean":"2024-09-11T22:23:30.520649+0000","last_became_active":"2024-09-11T22:23:29.535953+0000","last_became_peered":"2024-09-11T22:23:29.535953+0000","last_unstale":"2024-09-11T22:23:30.520649+0000","last_undegraded":"2024-09-11T22:23:30.520649+0000","last_fullsized":"2024-09-11T22:23:30.520649+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:45.813439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.158650+0000","last_change":"2024-09-11T22:23:29.528545+0000","last_active":"2024-09-11T22:23:32.158650+0000","last_peered":"2024-09-11T22:23:32.158650+0000","last_clean":"2024-09-11T22:23:32.158650+0000","last_became_active":"2024-09-11T22:23:29.528245+0000","last_became_peered":"2024-09-11T22:23:29.528245+0000","last_unstale":"2024-09-11T22:23:32.158650+0000","last_undegraded":"2024-09-11T22:23:32.158650+0000","last_fullsized":"2024-09-11T22:23:32.158650+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:14:47.863542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540193+0000","last_change":"2024-09-11T22:23:29.536620+0000","last_active":"2024-09-11T22:23:30.540193+0000","last_peered":"2024-09-11T22:23:30.540193+0000","last_clean":"2024-09-11T22:23:30.540193+0000","last_became_active":"2024-09-11T22:23:29.536275+0000","last_became_peered":"2024-09-11T22:23:29.536275+0000","last_unstale":"2024-09-11T22:23:30.540193+0000","last_undegraded":"2024-09-11T22:23:30.540193+0000","last_fullsized":"2024-09-11T22:23:30.540193+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:18.845529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520313+0000","last_change":"2024-09-11T22:23:29.538049+0000","last_active":"2024-09-11T22:23:30.520313+0000","last_peered":"2024-09-11T22:23:30.520313+0000","last_clean":"2024-09-11T22:23:30.520313+0000","last_became_active":"2024-09-11T22:23:29.537768+0000","last_became_peered":"2024-09-11T22:23:29.537768+0000","last_unstale":"2024-09-11T22:23:30.520313+0000","last_undegraded":"2024-09-11T22:23:30.520313+0000","last_fullsized":"2024-09-11T22:23:30.520313+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:10.437376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540630+0000","last_change":"2024-09-11T22:23:29.539853+0000","last_active":"2024-09-11T22:23:30.540630+0000","last_peered":"2024-09-11T22:23:30.540630+0000","last_clean":"2024-09-11T22:23:30.540630+0000","last_became_active":"2024-09-11T22:23:29.539555+0000","last_became_peered":"2024-09-11T22:23:29.539555+0000","last_unstale":"2024-09-11T22:23:30.540630+0000","last_undegraded":"2024-09-11T22:23:30.540630+0000","last_fullsized":"2024-09-11T22:23:30.540630+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:10.940087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542327+0000","last_change":"2024-09-11T22:23:29.533731+0000","last_active":"2024-09-11T22:23:30.542327+0000","last_peered":"2024-09-11T22:23:30.542327+0000","last_clean":"2024-09-11T22:23:30.542327+0000","last_became_active":"2024-09-11T22:23:29.532721+0000","last_became_peered":"2024-09-11T22:23:29.532721+0000","last_unstale":"2024-09-11T22:23:30.542327+0000","last_undegraded":"2024-09-11T22:23:30.542327+0000","last_fullsized":"2024-09-11T22:23:30.542327+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:01.286972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540628+0000","last_change":"2024-09-11T22:23:29.542712+0000","last_active":"2024-09-11T22:23:30.540628+0000","last_peered":"2024-09-11T22:23:30.540628+0000","last_clean":"2024-09-11T22:23:30.540628+0000","last_became_active":"2024-09-11T22:23:29.542455+0000","last_became_peered":"2024-09-11T22:23:29.542455+0000","last_unstale":"2024-09-11T22:23:30.540628+0000","last_undegraded":"2024-09-11T22:23:30.540628+0000","last_fullsized":"2024-09-11T22:23:30.540628+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:59.273434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159123+0000","last_change":"2024-09-11T22:23:29.534459+0000","last_active":"2024-09-11T22:23:32.159123+0000","last_peered":"2024-09-11T22:23:32.159123+0000","last_clean":"2024-09-11T22:23:32.159123+0000","last_became_active":"2024-09-11T22:23:29.534154+0000","last_became_peered":"2024-09-11T22:23:29.534154+0000","last_unstale":"2024-09-11T22:23:32.159123+0000","last_undegraded":"2024-09-11T22:23:32.159123+0000","last_fullsized":"2024-09-11T22:23:32.159123+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.521814+0000","last_change":"2024-09-11T22:23:29.544785+0000","last_active":"2024-09-11T22:23:30.521814+0000","last_peered":"2024-09-11T22:23:30.521814+0000","last_clean":"2024-09-11T22:23:30.521814+0000","last_became_active":"2024-09-11T22:23:29.544490+0000","last_became_peered":"2024-09-11T22:23:29.544490+0000","last_unstale":"2024-09-11T22:23:30.521814+0000","last_undegraded":"2024-09-11T22:23:30.521814+0000","last_fullsized":"2024-09-11T22:23:30.521814+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:49.986300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540234+0000","last_change":"2024-09-11T22:23:29.550354+0000","last_active":"2024-09-11T22:23:30.540234+0000","last_peered":"2024-09-11T22:23:30.540234+0000","last_clean":"2024-09-11T22:23:30.540234+0000","last_became_active":"2024-09-11T22:23:29.550066+0000","last_became_peered":"2024-09-11T22:23:29.550066+0000","last_unstale":"2024-09-11T22:23:30.540234+0000","last_undegraded":"2024-09-11T22:23:30.540234+0000","last_fullsized":"2024-09-11T22:23:30.540234+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:10.874883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520407+0000","last_change":"2024-09-11T22:23:29.527802+0000","last_active":"2024-09-11T22:23:30.520407+0000","last_peered":"2024-09-11T22:23:30.520407+0000","last_clean":"2024-09-11T22:23:30.520407+0000","last_became_active":"2024-09-11T22:23:29.527485+0000","last_became_peered":"2024-09-11T22:23:29.527485+0000","last_unstale":"2024-09-11T22:23:30.520407+0000","last_undegraded":"2024-09-11T22:23:30.520407+0000","last_fullsized":"2024-09-11T22:23:30.520407+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:37.456203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.158450+0000","last_change":"2024-09-11T22:23:29.541292+0000","last_active":"2024-09-11T22:23:32.158450+0000","last_peered":"2024-09-11T22:23:32.158450+0000","last_clean":"2024-09-11T22:23:32.158450+0000","last_became_active":"2024-09-11T22:23:29.541010+0000","last_became_peered":"2024-09-11T22:23:29.541010+0000","last_unstale":"2024-09-11T22:23:32.158450+0000","last_undegraded":"2024-09-11T22:23:32.158450+0000","last_fullsized":"2024-09-11T22:23:32.158450+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:27.591573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.523128+0000","last_change":"2024-09-11T22:23:29.543119+0000","last_active":"2024-09-11T22:23:30.523128+0000","last_peered":"2024-09-11T22:23:30.523128+0000","last_clean":"2024-09-11T22:23:30.523128+0000","last_became_active":"2024-09-11T22:23:29.541201+0000","last_became_peered":"2024-09-11T22:23:29.541201+0000","last_unstale":"2024-09-11T22:23:30.523128+0000","last_undegraded":"2024-09-11T22:23:30.523128+0000","last_fullsized":"2024-09-11T22:23:30.523128+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:37.456203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"188'4","reported_seq":18,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.158453+0000","last_change":"2024-09-11T22:23:28.533479+0000","last_active":"2024-09-11T22:23:32.158453+0000","last_peered":"2024-09-11T22:23:32.158453+0000","last_clean":"2024-09-11T22:23:32.158453+0000","last_became_active":"2024-09-11T22:23:28.533187+0000","last_became_peered":"2024-09-11T22:23:28.533187+0000","last_unstale":"2024-09-11T22:23:32.158453+0000","last_undegraded":"2024-09-11T22:23:32.158453+0000","last_fullsized":"2024-09-11T22:23:32.158453+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:32.118678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542369+0000","last_change":"2024-09-11T22:23:29.536415+0000","last_active":"2024-09-11T22:23:30.542369+0000","last_peered":"2024-09-11T22:23:30.542369+0000","last_clean":"2024-09-11T22:23:30.542369+0000","last_became_active":"2024-09-11T22:23:29.536111+0000","last_became_peered":"2024-09-11T22:23:29.536111+0000","last_unstale":"2024-09-11T22:23:30.542369+0000","last_undegraded":"2024-09-11T22:23:30.542369+0000","last_fullsized":"2024-09-11T22:23:30.542369+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:47.495340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159584+0000","last_change":"2024-09-11T22:23:28.530365+0000","last_active":"2024-09-11T22:23:32.159584+0000","last_peered":"2024-09-11T22:23:32.159584+0000","last_clean":"2024-09-11T22:23:32.159584+0000","last_became_active":"2024-09-11T22:23:28.530069+0000","last_became_peered":"2024-09-11T22:23:28.530069+0000","last_unstale":"2024-09-11T22:23:32.159584+0000","last_undegraded":"2024-09-11T22:23:32.159584+0000","last_fullsized":"2024-09-11T22:23:32.159584+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:59.580534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.521699+0000","last_change":"2024-09-11T22:23:29.545072+0000","last_active":"2024-09-11T22:23:30.521699+0000","last_peered":"2024-09-11T22:23:30.521699+0000","last_clean":"2024-09-11T22:23:30.521699+0000","last_became_active":"2024-09-11T22:23:29.544711+0000","last_became_peered":"2024-09-11T22:23:29.544711+0000","last_unstale":"2024-09-11T22:23:30.521699+0000","last_undegraded":"2024-09-11T22:23:30.521699+0000","last_fullsized":"2024-09-11T22:23:30.521699+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:42:19.649264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159327+0000","last_change":"2024-09-11T22:23:28.528837+0000","last_active":"2024-09-11T22:23:32.159327+0000","last_peered":"2024-09-11T22:23:32.159327+0000","last_clean":"2024-09-11T22:23:32.159327+0000","last_became_active":"2024-09-11T22:23:28.528534+0000","last_became_peered":"2024-09-11T22:23:28.528534+0000","last_unstale":"2024-09-11T22:23:32.159327+0000","last_undegraded":"2024-09-11T22:23:32.159327+0000","last_fullsized":"2024-09-11T22:23:32.159327+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:12.662086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540216+0000","last_change":"2024-09-11T22:23:29.550504+0000","last_active":"2024-09-11T22:23:30.540216+0000","last_peered":"2024-09-11T22:23:30.540216+0000","last_clean":"2024-09-11T22:23:30.540216+0000","last_became_active":"2024-09-11T22:23:29.550220+0000","last_became_peered":"2024-09-11T22:23:29.550220+0000","last_unstale":"2024-09-11T22:23:30.540216+0000","last_undegraded":"2024-09-11T22:23:30.540216+0000","last_fullsized":"2024-09-11T22:23:30.540216+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:39.821369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542149+0000","last_change":"2024-09-11T22:23:28.527628+0000","last_active":"2024-09-11T22:23:30.542149+0000","last_peered":"2024-09-11T22:23:30.542149+0000","last_clean":"2024-09-11T22:23:30.542149+0000","last_became_active":"2024-09-11T22:23:28.527319+0000","last_became_peered":"2024-09-11T22:23:28.527319+0000","last_unstale":"2024-09-11T22:23:30.542149+0000","last_undegraded":"2024-09-11T22:23:30.542149+0000","last_fullsized":"2024-09-11T22:23:30.542149+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:25.526650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520677+0000","last_change":"2024-09-11T22:23:29.550140+0000","last_active":"2024-09-11T22:23:30.520677+0000","last_peered":"2024-09-11T22:23:30.520677+0000","last_clean":"2024-09-11T22:23:30.520677+0000","last_became_active":"2024-09-11T22:23:29.549855+0000","last_became_peered":"2024-09-11T22:23:29.549855+0000","last_unstale":"2024-09-11T22:23:30.520677+0000","last_undegraded":"2024-09-11T22:23:30.520677+0000","last_fullsized":"2024-09-11T22:23:30.520677+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:02.180620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522012+0000","last_change":"2024-09-11T22:23:28.531543+0000","last_active":"2024-09-11T22:23:30.522012+0000","last_peered":"2024-09-11T22:23:30.522012+0000","last_clean":"2024-09-11T22:23:30.522012+0000","last_became_active":"2024-09-11T22:23:28.531271+0000","last_became_peered":"2024-09-11T22:23:28.531271+0000","last_unstale":"2024-09-11T22:23:30.522012+0000","last_undegraded":"2024-09-11T22:23:30.522012+0000","last_fullsized":"2024-09-11T22:23:30.522012+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:36.708165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.158886+0000","last_change":"2024-09-11T22:23:29.526674+0000","last_active":"2024-09-11T22:23:32.158886+0000","last_peered":"2024-09-11T22:23:32.158886+0000","last_clean":"2024-09-11T22:23:32.158886+0000","last_became_active":"2024-09-11T22:23:29.526389+0000","last_became_peered":"2024-09-11T22:23:29.526389+0000","last_unstale":"2024-09-11T22:23:32.158886+0000","last_undegraded":"2024-09-11T22:23:32.158886+0000","last_fullsized":"2024-09-11T22:23:32.158886+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:12.908473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.521470+0000","last_change":"2024-09-11T22:23:28.525318+0000","last_active":"2024-09-11T22:23:30.521470+0000","last_peered":"2024-09-11T22:23:30.521470+0000","last_clean":"2024-09-11T22:23:30.521470+0000","last_became_active":"2024-09-11T22:23:28.525023+0000","last_became_peered":"2024-09-11T22:23:28.525023+0000","last_unstale":"2024-09-11T22:23:30.521470+0000","last_undegraded":"2024-09-11T22:23:30.521470+0000","last_fullsized":"2024-09-11T22:23:30.521470+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:01.375011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159432+0000","last_change":"2024-09-11T22:23:29.537109+0000","last_active":"2024-09-11T22:23:32.159432+0000","last_peered":"2024-09-11T22:23:32.159432+0000","last_clean":"2024-09-11T22:23:32.159432+0000","last_became_active":"2024-09-11T22:23:29.536859+0000","last_became_peered":"2024-09-11T22:23:29.536859+0000","last_unstale":"2024-09-11T22:23:32.159432+0000","last_undegraded":"2024-09-11T22:23:32.159432+0000","last_fullsized":"2024-09-11T22:23:32.159432+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:38.302621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.158996+0000","last_change":"2024-09-11T22:23:28.527081+0000","last_active":"2024-09-11T22:23:32.158996+0000","last_peered":"2024-09-11T22:23:32.158996+0000","last_clean":"2024-09-11T22:23:32.158996+0000","last_became_active":"2024-09-11T22:23:28.526812+0000","last_became_peered":"2024-09-11T22:23:28.526812+0000","last_unstale":"2024-09-11T22:23:32.158996+0000","last_undegraded":"2024-09-11T22:23:32.158996+0000","last_fullsized":"2024-09-11T22:23:32.158996+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:54.420567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159498+0000","last_change":"2024-09-11T22:23:29.540072+0000","last_active":"2024-09-11T22:23:32.159498+0000","last_peered":"2024-09-11T22:23:32.159498+0000","last_clean":"2024-09-11T22:23:32.159498+0000","last_became_active":"2024-09-11T22:23:29.539787+0000","last_became_peered":"2024-09-11T22:23:29.539787+0000","last_unstale":"2024-09-11T22:23:32.159498+0000","last_undegraded":"2024-09-11T22:23:32.159498+0000","last_fullsized":"2024-09-11T22:23:32.159498+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:42:19.649264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540760+0000","last_change":"2024-09-11T22:23:28.535525+0000","last_active":"2024-09-11T22:23:30.540760+0000","last_peered":"2024-09-11T22:23:30.540760+0000","last_clean":"2024-09-11T22:23:30.540760+0000","last_became_active":"2024-09-11T22:23:28.535228+0000","last_became_peered":"2024-09-11T22:23:28.535228+0000","last_unstale":"2024-09-11T22:23:30.540760+0000","last_undegraded":"2024-09-11T22:23:30.540760+0000","last_fullsized":"2024-09-11T22:23:30.540760+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:04.023245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540750+0000","last_change":"2024-09-11T22:23:29.535426+0000","last_active":"2024-09-11T22:23:30.540750+0000","last_peered":"2024-09-11T22:23:30.540750+0000","last_clean":"2024-09-11T22:23:30.540750+0000","last_became_active":"2024-09-11T22:23:29.535017+0000","last_became_peered":"2024-09-11T22:23:29.535017+0000","last_unstale":"2024-09-11T22:23:30.540750+0000","last_undegraded":"2024-09-11T22:23:30.540750+0000","last_fullsized":"2024-09-11T22:23:30.540750+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.675389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.158563+0000","last_change":"2024-09-11T22:23:28.528735+0000","last_active":"2024-09-11T22:23:32.158563+0000","last_peered":"2024-09-11T22:23:32.158563+0000","last_clean":"2024-09-11T22:23:32.158563+0000","last_became_active":"2024-09-11T22:23:28.528439+0000","last_became_peered":"2024-09-11T22:23:28.528439+0000","last_unstale":"2024-09-11T22:23:32.158563+0000","last_undegraded":"2024-09-11T22:23:32.158563+0000","last_fullsized":"2024-09-11T22:23:32.158563+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:47.203142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522388+0000","last_change":"2024-09-11T22:23:29.541480+0000","last_active":"2024-09-11T22:23:30.522388+0000","last_peered":"2024-09-11T22:23:30.522388+0000","last_clean":"2024-09-11T22:23:30.522388+0000","last_became_active":"2024-09-11T22:23:29.541170+0000","last_became_peered":"2024-09-11T22:23:29.541170+0000","last_unstale":"2024-09-11T22:23:30.522388+0000","last_undegraded":"2024-09-11T22:23:30.522388+0000","last_fullsized":"2024-09-11T22:23:30.522388+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:54.906166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"188'3","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520839+0000","last_change":"2024-09-11T22:23:28.538934+0000","last_active":"2024-09-11T22:23:30.520839+0000","last_peered":"2024-09-11T22:23:30.520839+0000","last_clean":"2024-09-11T22:23:30.520839+0000","last_became_active":"2024-09-11T22:23:28.538183+0000","last_became_peered":"2024-09-11T22:23:28.538183+0000","last_unstale":"2024-09-11T22:23:30.520839+0000","last_undegraded":"2024-09-11T22:23:30.520839+0000","last_fullsized":"2024-09-11T22:23:30.520839+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:53.899903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540497+0000","last_change":"2024-09-11T22:23:29.537202+0000","last_active":"2024-09-11T22:23:30.540497+0000","last_peered":"2024-09-11T22:23:30.540497+0000","last_clean":"2024-09-11T22:23:30.540497+0000","last_became_active":"2024-09-11T22:23:29.535118+0000","last_became_peered":"2024-09-11T22:23:29.535118+0000","last_unstale":"2024-09-11T22:23:30.540497+0000","last_undegraded":"2024-09-11T22:23:30.540497+0000","last_fullsized":"2024-09-11T22:23:30.540497+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:15.608920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"188'6","reported_seq":20,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159232+0000","last_change":"2024-09-11T22:23:28.529858+0000","last_active":"2024-09-11T22:23:32.159232+0000","last_peered":"2024-09-11T22:23:32.159232+0000","last_clean":"2024-09-11T22:23:32.159232+0000","last_became_active":"2024-09-11T22:23:28.529559+0000","last_became_peered":"2024-09-11T22:23:28.529559+0000","last_unstale":"2024-09-11T22:23:32.159232+0000","last_undegraded":"2024-09-11T22:23:32.159232+0000","last_fullsized":"2024-09-11T22:23:32.159232+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:05.774908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.158793+0000","last_change":"2024-09-11T22:23:29.536832+0000","last_active":"2024-09-11T22:23:32.158793+0000","last_peered":"2024-09-11T22:23:32.158793+0000","last_clean":"2024-09-11T22:23:32.158793+0000","last_became_active":"2024-09-11T22:23:29.536519+0000","last_became_peered":"2024-09-11T22:23:29.536519+0000","last_unstale":"2024-09-11T22:23:32.158793+0000","last_undegraded":"2024-09-11T22:23:32.158793+0000","last_fullsized":"2024-09-11T22:23:32.158793+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542211+0000","last_change":"2024-09-11T22:23:28.533696+0000","last_active":"2024-09-11T22:23:30.542211+0000","last_peered":"2024-09-11T22:23:30.542211+0000","last_clean":"2024-09-11T22:23:30.542211+0000","last_became_active":"2024-09-11T22:23:28.533412+0000","last_became_peered":"2024-09-11T22:23:28.533412+0000","last_unstale":"2024-09-11T22:23:30.542211+0000","last_undegraded":"2024-09-11T22:23:30.542211+0000","last_fullsized":"2024-09-11T22:23:30.542211+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:56.393853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522177+0000","last_change":"2024-09-11T22:23:29.544049+0000","last_active":"2024-09-11T22:23:30.522177+0000","last_peered":"2024-09-11T22:23:30.522177+0000","last_clean":"2024-09-11T22:23:30.522177+0000","last_became_active":"2024-09-11T22:23:29.543531+0000","last_became_peered":"2024-09-11T22:23:29.543531+0000","last_unstale":"2024-09-11T22:23:30.522177+0000","last_undegraded":"2024-09-11T22:23:30.522177+0000","last_fullsized":"2024-09-11T22:23:30.522177+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:22.499127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.158786+0000","last_change":"2024-09-11T22:23:28.524567+0000","last_active":"2024-09-11T22:23:32.158786+0000","last_peered":"2024-09-11T22:23:32.158786+0000","last_clean":"2024-09-11T22:23:32.158786+0000","last_became_active":"2024-09-11T22:23:28.524261+0000","last_became_peered":"2024-09-11T22:23:28.524261+0000","last_unstale":"2024-09-11T22:23:32.158786+0000","last_undegraded":"2024-09-11T22:23:32.158786+0000","last_fullsized":"2024-09-11T22:23:32.158786+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:04.079975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.521594+0000","last_change":"2024-09-11T22:23:29.538840+0000","last_active":"2024-09-11T22:23:30.521594+0000","last_peered":"2024-09-11T22:23:30.521594+0000","last_clean":"2024-09-11T22:23:30.521594+0000","last_became_active":"2024-09-11T22:23:29.534892+0000","last_became_peered":"2024-09-11T22:23:29.534892+0000","last_unstale":"2024-09-11T22:23:30.521594+0000","last_undegraded":"2024-09-11T22:23:30.521594+0000","last_fullsized":"2024-09-11T22:23:30.521594+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:14.860272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520756+0000","last_change":"2024-09-11T22:23:28.540359+0000","last_active":"2024-09-11T22:23:30.520756+0000","last_peered":"2024-09-11T22:23:30.520756+0000","last_clean":"2024-09-11T22:23:30.520756+0000","last_became_active":"2024-09-11T22:23:28.540041+0000","last_became_peered":"2024-09-11T22:23:28.540041+0000","last_unstale":"2024-09-11T22:23:30.520756+0000","last_undegraded":"2024-09-11T22:23:30.520756+0000","last_fullsized":"2024-09-11T22:23:30.520756+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:48.980037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522072+0000","last_change":"2024-09-11T22:23:29.528172+0000","last_active":"2024-09-11T22:23:30.522072+0000","last_peered":"2024-09-11T22:23:30.522072+0000","last_clean":"2024-09-11T22:23:30.522072+0000","last_became_active":"2024-09-11T22:23:29.527833+0000","last_became_peered":"2024-09-11T22:23:29.527833+0000","last_unstale":"2024-09-11T22:23:30.522072+0000","last_undegraded":"2024-09-11T22:23:30.522072+0000","last_fullsized":"2024-09-11T22:23:30.522072+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:02.113434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"188'8","reported_seq":22,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159255+0000","last_change":"2024-09-11T22:23:28.534953+0000","last_active":"2024-09-11T22:23:32.159255+0000","last_peered":"2024-09-11T22:23:32.159255+0000","last_clean":"2024-09-11T22:23:32.159255+0000","last_became_active":"2024-09-11T22:23:28.534637+0000","last_became_peered":"2024-09-11T22:23:28.534637+0000","last_unstale":"2024-09-11T22:23:32.159255+0000","last_undegraded":"2024-09-11T22:23:32.159255+0000","last_fullsized":"2024-09-11T22:23:32.159255+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:00.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542341+0000","last_change":"2024-09-11T22:23:29.527227+0000","last_active":"2024-09-11T22:23:30.542341+0000","last_peered":"2024-09-11T22:23:30.542341+0000","last_clean":"2024-09-11T22:23:30.542341+0000","last_became_active":"2024-09-11T22:23:29.526934+0000","last_became_peered":"2024-09-11T22:23:29.526934+0000","last_unstale":"2024-09-11T22:23:30.542341+0000","last_undegraded":"2024-09-11T22:23:30.542341+0000","last_fullsized":"2024-09-11T22:23:30.542341+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:55.674466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.523227+0000","last_change":"2024-09-11T22:23:28.532266+0000","last_active":"2024-09-11T22:23:30.523227+0000","last_peered":"2024-09-11T22:23:30.523227+0000","last_clean":"2024-09-11T22:23:30.523227+0000","last_became_active":"2024-09-11T22:23:28.531883+0000","last_became_peered":"2024-09-11T22:23:28.531883+0000","last_unstale":"2024-09-11T22:23:30.523227+0000","last_undegraded":"2024-09-11T22:23:30.523227+0000","last_fullsized":"2024-09-11T22:23:30.523227+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:13.982210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159219+0000","last_change":"2024-09-11T22:23:29.544041+0000","last_active":"2024-09-11T22:23:32.159219+0000","last_peered":"2024-09-11T22:23:32.159219+0000","last_clean":"2024-09-11T22:23:32.159219+0000","last_became_active":"2024-09-11T22:23:29.543749+0000","last_became_peered":"2024-09-11T22:23:29.543749+0000","last_unstale":"2024-09-11T22:23:32.159219+0000","last_undegraded":"2024-09-11T22:23:32.159219+0000","last_fullsized":"2024-09-11T22:23:32.159219+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:21.533382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.158662+0000","last_change":"2024-09-11T22:23:28.535869+0000","last_active":"2024-09-11T22:23:32.158662+0000","last_peered":"2024-09-11T22:23:32.158662+0000","last_clean":"2024-09-11T22:23:32.158662+0000","last_became_active":"2024-09-11T22:23:28.535425+0000","last_became_peered":"2024-09-11T22:23:28.535425+0000","last_unstale":"2024-09-11T22:23:32.158662+0000","last_undegraded":"2024-09-11T22:23:32.158662+0000","last_fullsized":"2024-09-11T22:23:32.158662+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:20.254727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522447+0000","last_change":"2024-09-11T22:23:29.542962+0000","last_active":"2024-09-11T22:23:30.522447+0000","last_peered":"2024-09-11T22:23:30.522447+0000","last_clean":"2024-09-11T22:23:30.522447+0000","last_became_active":"2024-09-11T22:23:29.541345+0000","last_became_peered":"2024-09-11T22:23:29.541345+0000","last_unstale":"2024-09-11T22:23:30.522447+0000","last_undegraded":"2024-09-11T22:23:30.522447+0000","last_fullsized":"2024-09-11T22:23:30.522447+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:13.737423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540568+0000","last_change":"2024-09-11T22:23:28.541515+0000","last_active":"2024-09-11T22:23:30.540568+0000","last_peered":"2024-09-11T22:23:30.540568+0000","last_clean":"2024-09-11T22:23:30.540568+0000","last_became_active":"2024-09-11T22:23:28.541244+0000","last_became_peered":"2024-09-11T22:23:28.541244+0000","last_unstale":"2024-09-11T22:23:30.540568+0000","last_undegraded":"2024-09-11T22:23:30.540568+0000","last_fullsized":"2024-09-11T22:23:30.540568+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:09.816581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522857+0000","last_change":"2024-09-11T22:23:29.543234+0000","last_active":"2024-09-11T22:23:30.522857+0000","last_peered":"2024-09-11T22:23:30.522857+0000","last_clean":"2024-09-11T22:23:30.522857+0000","last_became_active":"2024-09-11T22:23:29.541291+0000","last_became_peered":"2024-09-11T22:23:29.541291+0000","last_unstale":"2024-09-11T22:23:30.522857+0000","last_undegraded":"2024-09-11T22:23:30.522857+0000","last_fullsized":"2024-09-11T22:23:30.522857+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:45.813439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159254+0000","last_change":"2024-09-11T22:23:28.536841+0000","last_active":"2024-09-11T22:23:32.159254+0000","last_peered":"2024-09-11T22:23:32.159254+0000","last_clean":"2024-09-11T22:23:32.159254+0000","last_became_active":"2024-09-11T22:23:28.536520+0000","last_became_peered":"2024-09-11T22:23:28.536520+0000","last_unstale":"2024-09-11T22:23:32.159254+0000","last_undegraded":"2024-09-11T22:23:32.159254+0000","last_fullsized":"2024-09-11T22:23:32.159254+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:52.004425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520482+0000","last_change":"2024-09-11T22:23:29.525433+0000","last_active":"2024-09-11T22:23:30.520482+0000","last_peered":"2024-09-11T22:23:30.520482+0000","last_clean":"2024-09-11T22:23:30.520482+0000","last_became_active":"2024-09-11T22:23:29.525144+0000","last_became_peered":"2024-09-11T22:23:29.525144+0000","last_unstale":"2024-09-11T22:23:30.520482+0000","last_undegraded":"2024-09-11T22:23:30.520482+0000","last_fullsized":"2024-09-11T22:23:30.520482+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:18.428141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.523077+0000","last_change":"2024-09-11T22:23:28.537499+0000","last_active":"2024-09-11T22:23:30.523077+0000","last_peered":"2024-09-11T22:23:30.523077+0000","last_clean":"2024-09-11T22:23:30.523077+0000","last_became_active":"2024-09-11T22:23:28.537241+0000","last_became_peered":"2024-09-11T22:23:28.537241+0000","last_unstale":"2024-09-11T22:23:30.523077+0000","last_undegraded":"2024-09-11T22:23:30.523077+0000","last_fullsized":"2024-09-11T22:23:30.523077+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:46.075605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522345+0000","last_change":"2024-09-11T22:23:29.544272+0000","last_active":"2024-09-11T22:23:30.522345+0000","last_peered":"2024-09-11T22:23:30.522345+0000","last_clean":"2024-09-11T22:23:30.522345+0000","last_became_active":"2024-09-11T22:23:29.543474+0000","last_became_peered":"2024-09-11T22:23:29.543474+0000","last_unstale":"2024-09-11T22:23:30.522345+0000","last_undegraded":"2024-09-11T22:23:30.522345+0000","last_fullsized":"2024-09-11T22:23:30.522345+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:18.428141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522376+0000","last_change":"2024-09-11T22:23:28.530647+0000","last_active":"2024-09-11T22:23:30.522376+0000","last_peered":"2024-09-11T22:23:30.522376+0000","last_clean":"2024-09-11T22:23:30.522376+0000","last_became_active":"2024-09-11T22:23:28.530268+0000","last_became_peered":"2024-09-11T22:23:28.530268+0000","last_unstale":"2024-09-11T22:23:30.522376+0000","last_undegraded":"2024-09-11T22:23:30.522376+0000","last_fullsized":"2024-09-11T22:23:30.522376+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:36.708165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.542012+0000","last_change":"2024-09-11T22:23:29.528818+0000","last_active":"2024-09-11T22:23:30.542012+0000","last_peered":"2024-09-11T22:23:30.542012+0000","last_clean":"2024-09-11T22:23:30.542012+0000","last_became_active":"2024-09-11T22:23:29.528503+0000","last_became_peered":"2024-09-11T22:23:29.528503+0000","last_unstale":"2024-09-11T22:23:30.542012+0000","last_undegraded":"2024-09-11T22:23:30.542012+0000","last_fullsized":"2024-09-11T22:23:30.542012+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:05.893484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522246+0000","last_change":"2024-09-11T22:23:28.533383+0000","last_active":"2024-09-11T22:23:30.522246+0000","last_peered":"2024-09-11T22:23:30.522246+0000","last_clean":"2024-09-11T22:23:30.522246+0000","last_became_active":"2024-09-11T22:23:28.533009+0000","last_became_peered":"2024-09-11T22:23:28.533009+0000","last_unstale":"2024-09-11T22:23:30.522246+0000","last_undegraded":"2024-09-11T22:23:30.522246+0000","last_fullsized":"2024-09-11T22:23:30.522246+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:46.891077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520655+0000","last_change":"2024-09-11T22:23:29.527135+0000","last_active":"2024-09-11T22:23:30.520655+0000","last_peered":"2024-09-11T22:23:30.520655+0000","last_clean":"2024-09-11T22:23:30.520655+0000","last_became_active":"2024-09-11T22:23:29.526819+0000","last_became_peered":"2024-09-11T22:23:29.526819+0000","last_unstale":"2024-09-11T22:23:30.520655+0000","last_undegraded":"2024-09-11T22:23:30.520655+0000","last_fullsized":"2024-09-11T22:23:30.520655+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:03.585689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.521737+0000","last_change":"2024-09-11T22:23:28.533228+0000","last_active":"2024-09-11T22:23:30.521737+0000","last_peered":"2024-09-11T22:23:30.521737+0000","last_clean":"2024-09-11T22:23:30.521737+0000","last_became_active":"2024-09-11T22:23:28.532945+0000","last_became_peered":"2024-09-11T22:23:28.532945+0000","last_unstale":"2024-09-11T22:23:30.521737+0000","last_undegraded":"2024-09-11T22:23:30.521737+0000","last_fullsized":"2024-09-11T22:23:30.521737+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:57.831523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520777+0000","last_change":"2024-09-11T22:23:29.541054+0000","last_active":"2024-09-11T22:23:30.520777+0000","last_peered":"2024-09-11T22:23:30.520777+0000","last_clean":"2024-09-11T22:23:30.520777+0000","last_became_active":"2024-09-11T22:23:29.540750+0000","last_became_peered":"2024-09-11T22:23:29.540750+0000","last_unstale":"2024-09-11T22:23:30.520777+0000","last_undegraded":"2024-09-11T22:23:30.520777+0000","last_fullsized":"2024-09-11T22:23:30.520777+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:48.335124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520877+0000","last_change":"2024-09-11T22:23:28.539834+0000","last_active":"2024-09-11T22:23:30.520877+0000","last_peered":"2024-09-11T22:23:30.520877+0000","last_clean":"2024-09-11T22:23:30.520877+0000","last_became_active":"2024-09-11T22:23:28.539533+0000","last_became_peered":"2024-09-11T22:23:28.539533+0000","last_unstale":"2024-09-11T22:23:30.520877+0000","last_undegraded":"2024-09-11T22:23:30.520877+0000","last_fullsized":"2024-09-11T22:23:30.520877+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:12:39.147330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.523141+0000","last_change":"2024-09-11T22:23:29.534440+0000","last_active":"2024-09-11T22:23:30.523141+0000","last_peered":"2024-09-11T22:23:30.523141+0000","last_clean":"2024-09-11T22:23:30.523141+0000","last_became_active":"2024-09-11T22:23:29.534121+0000","last_became_peered":"2024-09-11T22:23:29.534121+0000","last_unstale":"2024-09-11T22:23:30.523141+0000","last_undegraded":"2024-09-11T22:23:30.523141+0000","last_fullsized":"2024-09-11T22:23:30.523141+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:05.199979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"189'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.541721+0000","last_change":"2024-09-11T22:23:28.539679+0000","last_active":"2024-09-11T22:23:30.541721+0000","last_peered":"2024-09-11T22:23:30.541721+0000","last_clean":"2024-09-11T22:23:30.541721+0000","last_became_active":"2024-09-11T22:23:28.539329+0000","last_became_peered":"2024-09-11T22:23:28.539329+0000","last_unstale":"2024-09-11T22:23:30.541721+0000","last_undegraded":"2024-09-11T22:23:30.541721+0000","last_fullsized":"2024-09-11T22:23:30.541721+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:32.744023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522615+0000","last_change":"2024-09-11T22:23:29.543203+0000","last_active":"2024-09-11T22:23:30.522615+0000","last_peered":"2024-09-11T22:23:30.522615+0000","last_clean":"2024-09-11T22:23:30.522615+0000","last_became_active":"2024-09-11T22:23:29.540967+0000","last_became_peered":"2024-09-11T22:23:29.540967+0000","last_unstale":"2024-09-11T22:23:30.522615+0000","last_undegraded":"2024-09-11T22:23:30.522615+0000","last_fullsized":"2024-09-11T22:23:30.522615+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:03.585689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540639+0000","last_change":"2024-09-11T22:23:28.539999+0000","last_active":"2024-09-11T22:23:30.540639+0000","last_peered":"2024-09-11T22:23:30.540639+0000","last_clean":"2024-09-11T22:23:30.540639+0000","last_became_active":"2024-09-11T22:23:28.539770+0000","last_became_peered":"2024-09-11T22:23:28.539770+0000","last_unstale":"2024-09-11T22:23:30.540639+0000","last_undegraded":"2024-09-11T22:23:30.540639+0000","last_fullsized":"2024-09-11T22:23:30.540639+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:53.362785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520702+0000","last_change":"2024-09-11T22:23:29.534279+0000","last_active":"2024-09-11T22:23:30.520702+0000","last_peered":"2024-09-11T22:23:30.520702+0000","last_clean":"2024-09-11T22:23:30.520702+0000","last_became_active":"2024-09-11T22:23:29.533605+0000","last_became_peered":"2024-09-11T22:23:29.533605+0000","last_unstale":"2024-09-11T22:23:30.520702+0000","last_undegraded":"2024-09-11T22:23:30.520702+0000","last_fullsized":"2024-09-11T22:23:30.520702+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:05.199979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522708+0000","last_change":"2024-09-11T22:23:28.538694+0000","last_active":"2024-09-11T22:23:30.522708+0000","last_peered":"2024-09-11T22:23:30.522708+0000","last_clean":"2024-09-11T22:23:30.522708+0000","last_became_active":"2024-09-11T22:23:28.538434+0000","last_became_peered":"2024-09-11T22:23:28.538434+0000","last_unstale":"2024-09-11T22:23:30.522708+0000","last_undegraded":"2024-09-11T22:23:30.522708+0000","last_fullsized":"2024-09-11T22:23:30.522708+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:16.512571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.159506+0000","last_change":"2024-09-11T22:23:29.527566+0000","last_active":"2024-09-11T22:23:32.159506+0000","last_peered":"2024-09-11T22:23:32.159506+0000","last_clean":"2024-09-11T22:23:32.159506+0000","last_became_active":"2024-09-11T22:23:29.527241+0000","last_became_peered":"2024-09-11T22:23:29.527241+0000","last_unstale":"2024-09-11T22:23:32.159506+0000","last_undegraded":"2024-09-11T22:23:32.159506+0000","last_fullsized":"2024-09-11T22:23:32.159506+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:49.986300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.521912+0000","last_change":"2024-09-11T22:23:28.535813+0000","last_active":"2024-09-11T22:23:30.521912+0000","last_peered":"2024-09-11T22:23:30.521912+0000","last_clean":"2024-09-11T22:23:30.521912+0000","last_became_active":"2024-09-11T22:23:28.535523+0000","last_became_peered":"2024-09-11T22:23:28.535523+0000","last_unstale":"2024-09-11T22:23:30.521912+0000","last_undegraded":"2024-09-11T22:23:30.521912+0000","last_fullsized":"2024-09-11T22:23:30.521912+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:46.673122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522485+0000","last_change":"2024-09-11T22:23:29.543811+0000","last_active":"2024-09-11T22:23:30.522485+0000","last_peered":"2024-09-11T22:23:30.522485+0000","last_clean":"2024-09-11T22:23:30.522485+0000","last_became_active":"2024-09-11T22:23:29.543217+0000","last_became_peered":"2024-09-11T22:23:29.543217+0000","last_unstale":"2024-09-11T22:23:30.522485+0000","last_undegraded":"2024-09-11T22:23:30.522485+0000","last_fullsized":"2024-09-11T22:23:30.522485+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:43.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:32.158877+0000","last_change":"2024-09-11T22:23:28.530346+0000","last_active":"2024-09-11T22:23:32.158877+0000","last_peered":"2024-09-11T22:23:32.158877+0000","last_clean":"2024-09-11T22:23:32.158877+0000","last_became_active":"2024-09-11T22:23:28.530073+0000","last_became_peered":"2024-09-11T22:23:28.530073+0000","last_unstale":"2024-09-11T22:23:32.158877+0000","last_undegraded":"2024-09-11T22:23:32.158877+0000","last_fullsized":"2024-09-11T22:23:32.158877+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:47.370341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.521944+0000","last_change":"2024-09-11T22:23:29.539068+0000","last_active":"2024-09-11T22:23:30.521944+0000","last_peered":"2024-09-11T22:23:30.521944+0000","last_clean":"2024-09-11T22:23:30.521944+0000","last_became_active":"2024-09-11T22:23:29.534654+0000","last_became_peered":"2024-09-11T22:23:29.534654+0000","last_unstale":"2024-09-11T22:23:30.521944+0000","last_undegraded":"2024-09-11T22:23:30.521944+0000","last_fullsized":"2024-09-11T22:23:30.521944+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:18.376991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.520813+0000","last_change":"2024-09-11T22:23:28.539672+0000","last_active":"2024-09-11T22:23:30.520813+0000","last_peered":"2024-09-11T22:23:30.520813+0000","last_clean":"2024-09-11T22:23:30.520813+0000","last_became_active":"2024-09-11T22:23:28.539297+0000","last_became_peered":"2024-09-11T22:23:28.539297+0000","last_unstale":"2024-09-11T22:23:30.520813+0000","last_undegraded":"2024-09-11T22:23:30.520813+0000","last_fullsized":"2024-09-11T22:23:30.520813+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:01.107172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540253+0000","last_change":"2024-09-11T22:23:29.535903+0000","last_active":"2024-09-11T22:23:30.540253+0000","last_peered":"2024-09-11T22:23:30.540253+0000","last_clean":"2024-09-11T22:23:30.540253+0000","last_became_active":"2024-09-11T22:23:29.535471+0000","last_became_peered":"2024-09-11T22:23:29.535471+0000","last_unstale":"2024-09-11T22:23:30.540253+0000","last_undegraded":"2024-09-11T22:23:30.540253+0000","last_fullsized":"2024-09-11T22:23:30.540253+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:00.493935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.521877+0000","last_change":"2024-09-11T22:23:28.533170+0000","last_active":"2024-09-11T22:23:30.521877+0000","last_peered":"2024-09-11T22:23:30.521877+0000","last_clean":"2024-09-11T22:23:30.521877+0000","last_became_active":"2024-09-11T22:23:28.532610+0000","last_became_peered":"2024-09-11T22:23:28.532610+0000","last_unstale":"2024-09-11T22:23:30.521877+0000","last_undegraded":"2024-09-11T22:23:30.521877+0000","last_fullsized":"2024-09-11T22:23:30.521877+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:37.296359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540438+0000","last_change":"2024-09-11T22:23:29.536908+0000","last_active":"2024-09-11T22:23:30.540438+0000","last_peered":"2024-09-11T22:23:30.540438+0000","last_clean":"2024-09-11T22:23:30.540438+0000","last_became_active":"2024-09-11T22:23:29.535490+0000","last_became_peered":"2024-09-11T22:23:29.535490+0000","last_unstale":"2024-09-11T22:23:30.540438+0000","last_undegraded":"2024-09-11T22:23:30.540438+0000","last_fullsized":"2024-09-11T22:23:30.540438+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:28.510780+0000","last_clean_scrub_stamp":"2024-09-11T22:23:28.510780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:24.519389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.522569+0000","last_change":"2024-09-11T22:23:28.530787+0000","last_active":"2024-09-11T22:23:30.522569+0000","last_peered":"2024-09-11T22:23:30.522569+0000","last_clean":"2024-09-11T22:23:30.522569+0000","last_became_active":"2024-09-11T22:23:28.530333+0000","last_became_peered":"2024-09-11T22:23:28.530333+0000","last_unstale":"2024-09-11T22:23:30.522569+0000","last_undegraded":"2024-09-11T22:23:30.522569+0000","last_fullsized":"2024-09-11T22:23:30.522569+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:27.504517+0000","last_clean_scrub_stamp":"2024-09-11T22:23:27.504517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:13.659001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":474,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T22:23:30.540044+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:23:30.540044+0000","last_peered":"2024-09-11T22:23:30.540044+0000","last_clean":"2024-09-11T22:23:30.540044+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:23:30.540044+0000","last_undegraded":"2024-09-11T22:23:30.540044+0000","last_fullsized":"2024-09-11T22:23:30.540044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509595,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55728,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316112,"statfs":{"total":96636764160,"available":96579698688,"internally_reserved":0,"allocated":2387968,"data_stored":1046886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509592,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55724,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316116,"statfs":{"total":96636764160,"available":96579702784,"internally_reserved":0,"allocated":2379776,"data_stored":1046830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509594,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82028,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94289812,"statfs":{"total":96636764160,"available":96552767488,"internally_reserved":0,"allocated":2383872,"data_stored":1047412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81590725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509594,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47416,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324424,"statfs":{"total":96636764160,"available":96588210176,"internally_reserved":0,"allocated":2396160,"data_stored":1048512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509594,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51564,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320276,"statfs":{"total":96636764160,"available":96583962624,"internally_reserved":0,"allocated":2383872,"data_stored":1046920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509593,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60468,"kb_used_data":2912,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311372,"statfs":{"total":96636764160,"available":96574844928,"internally_reserved":0,"allocated":2981888,"data_stored":1637870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60472,"kb_used_data":2908,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311368,"statfs":{"total":96636764160,"available":96574840832,"internally_reserved":0,"allocated":2977792,"data_stored":1637268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47424,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324416,"statfs":{"total":96636764160,"available":96588201984,"internally_reserved":0,"allocated":2400256,"data_stored":1048498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:23:37.258 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:23:37.258 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T22:23:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.403+0000 7fe1b358d640 1 Processor -- start 2024-09-11T22:23:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.404+0000 7fe1b358d640 1 -- start start 2024-09-11T22:23:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.404+0000 7fe1b358d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1ac15e870 0x7fe1ac0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.404+0000 7fe1b358d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1ac0d16d0 0x7fe1ac0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.404+0000 7fe1b358d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1ac0cfa80 con 0x7fe1ac0d3a30 2024-09-11T22:23:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.404+0000 7fe1b358d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe1ac0d1b10 con 0x7fe1ac15e870 2024-09-11T22:23:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.404+0000 7fe1b358d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe1ac0d3e80 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.405+0000 7fe1b1329640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1ac15e870 0x7fe1ac0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.405+0000 7fe1b1329640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe1ac15e870 0x7fe1ac0d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54386/0 (socket says 172.21.15.50:54386) 2024-09-11T22:23:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.405+0000 7fe1b1b2a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe1ac0d3a30 0x7fe1ac0b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53634/0 (socket says 172.21.15.50:53634) 2024-09-11T22:23:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.405+0000 7fe1b1329640 1 -- 172.21.15.50:0/2155549890 learned_addr learned my addr 172.21.15.50:0/2155549890 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.405+0000 7fe1b0b28640 1 --2- 172.21.15.50:0/2155549890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1ac0d16d0 0x7fe1ac0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.405+0000 7fe1b1329640 1 -- 172.21.15.50:0/2155549890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1ac0d16d0 msgr2=0x7fe1ac0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.405+0000 7fe1b1329640 1 --2- 172.21.15.50:0/2155549890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1ac0d16d0 0x7fe1ac0d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.405+0000 7fe1b1329640 1 -- 172.21.15.50:0/2155549890 >> v1:172.21.15.50:6789/0 conn(0x7fe1ac0d3a30 legacy=0x7fe1ac0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.405+0000 7fe1abfff640 1 -- 172.21.15.50:0/2155549890 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 417278904 0 0) 0x7fe1a4001110 con 0x7fe1ac0d3a30 2024-09-11T22:23:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.405+0000 7fe1b1329640 1 -- 172.21.15.50:0/2155549890 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ac0d40d0 con 0x7fe1ac15e870 2024-09-11T22:23:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.406+0000 7fe1b1329640 1 --2- 172.21.15.50:0/2155549890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1ac15e870 0x7fe1ac0d1190 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009e50 tx=0x7fe19c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ca3eb4808fe86f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.406+0000 7fe1abfff640 1 -- 172.21.15.50:0/2155549890 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c036070 con 0x7fe1ac15e870 2024-09-11T22:23:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.406+0000 7fe1abfff640 1 -- 172.21.15.50:0/2155549890 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe19c031600 con 0x7fe1ac15e870 2024-09-11T22:23:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.406+0000 7fe1abfff640 1 -- 172.21.15.50:0/2155549890 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c0319d0 con 0x7fe1ac15e870 2024-09-11T22:23:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.406+0000 7fe1b358d640 1 -- 172.21.15.50:0/2155549890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1ac15e870 msgr2=0x7fe1ac0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.406+0000 7fe1b358d640 1 --2- 172.21.15.50:0/2155549890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1ac15e870 0x7fe1ac0d1190 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009e50 tx=0x7fe19c02a710 comp rx=0 tx=0).stop 2024-09-11T22:23:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.406+0000 7fe1b358d640 1 -- 172.21.15.50:0/2155549890 shutdown_connections 2024-09-11T22:23:37.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.406+0000 7fe1b358d640 1 --2- 172.21.15.50:0/2155549890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1ac0d16d0 0x7fe1ac0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.406+0000 7fe1b358d640 1 --2- 172.21.15.50:0/2155549890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1ac15e870 0x7fe1ac0d1190 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.406+0000 7fe1b358d640 1 -- 172.21.15.50:0/2155549890 >> 172.21.15.50:0/2155549890 conn(0x7fe1ac0727a0 msgr2=0x7fe1ac0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:37.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.406+0000 7fe1b358d640 1 -- 172.21.15.50:0/2155549890 shutdown_connections 2024-09-11T22:23:37.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.406+0000 7fe1b358d640 1 -- 172.21.15.50:0/2155549890 wait complete. 2024-09-11T22:23:37.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.408+0000 7fe1b358d640 1 Processor -- start 2024-09-11T22:23:37.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.408+0000 7fe1b358d640 1 -- start start 2024-09-11T22:23:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.408+0000 7fe1b358d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1ac0d16d0 0x7fe1ac1f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.408+0000 7fe1b358d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1ac0d3a30 0x7fe1ac0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.408+0000 7fe1b358d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac15e870 0x7fe1ac0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.408+0000 7fe1b358d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac0b7ee0 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.408+0000 7fe1b358d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac0b7c00 con 0x7fe1ac15e870 2024-09-11T22:23:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.408+0000 7fe1b358d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe1ac15ec50 con 0x7fe1ac0d3a30 2024-09-11T22:23:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1b1329640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1ac0d16d0 0x7fe1ac1f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1b1329640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1ac0d16d0 0x7fe1ac1f43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54396/0 (socket says 172.21.15.50:54396) 2024-09-11T22:23:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1b1329640 1 -- 172.21.15.50:0/1732672698 learned_addr learned my addr 172.21.15.50:0/1732672698 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1b0b28640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1ac0d3a30 0x7fe1ac0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1b1b2a640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac15e870 0x7fe1ac0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1b1329640 1 -- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1ac0d3a30 msgr2=0x7fe1ac0cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1b1329640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1ac0d3a30 0x7fe1ac0cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1b1329640 1 -- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac15e870 msgr2=0x7fe1ac0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1b1329640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac15e870 0x7fe1ac0ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1b1329640 1 -- 172.21.15.50:0/1732672698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ac0cae70 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1b1329640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1ac0d16d0 0x7fe1ac1f43a0 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7fe19c034040 tx=0x7fe19c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1a9ffb640 1 -- 172.21.15.50:0/1732672698 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c036050 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1a9ffb640 1 -- 172.21.15.50:0/1732672698 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe19c042070 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1b358d640 1 -- 172.21.15.50:0/1732672698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ac0cd1d0 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.409+0000 7fe1a9ffb640 1 -- 172.21.15.50:0/1732672698 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c009510 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.410+0000 7fe1b358d640 1 -- 172.21.15.50:0/1732672698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ac0c8430 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.410+0000 7fe1b358d640 1 -- 172.21.15.50:0/1732672698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1ac161f10 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.411+0000 7fe1a9ffb640 1 -- 172.21.15.50:0/1732672698 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe19c007c70 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.411+0000 7fe1a9ffb640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe19806be30 0x7fe19806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.412+0000 7fe1a9ffb640 1 -- 172.21.15.50:0/1732672698 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7fe19c0abcf0 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.412+0000 7fe1b0b28640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe19806be30 0x7fe19806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.412+0000 7fe1b0b28640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe19806be30 0x7fe19806e2f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac067d10 tx=0x7fe1a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:37.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.416+0000 7fe1a9ffb640 1 -- 172.21.15.50:0/1732672698 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1ac161f10 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.661+0000 7fe1b358d640 1 -- 172.21.15.50:0/1732672698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe1ac0b78b0 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.663+0000 7fe1a9ffb640 1 -- 172.21.15.50:0/1732672698 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) ==== 190+0+147 (secure 0 0 0) 0x7fe19c07a600 con 0x7fe1ac0d16d0 2024-09-11T22:23:37.665 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-11T22:23:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBGFeJmHGaRMBAAH3k05mbNteyN9+K+gscgew== 2024-09-11T22:23:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2024-09-11T22:23:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2024-09-11T22:23:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T22:23:37.666 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2024-09-11T22:23:37.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.665+0000 7fe1b358d640 1 -- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe19806be30 msgr2=0x7fe19806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.665+0000 7fe1b358d640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe19806be30 0x7fe19806e2f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac067d10 tx=0x7fe1a0008040 comp rx=0 tx=0).stop 2024-09-11T22:23:37.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.665+0000 7fe1b358d640 1 -- 172.21.15.50:0/1732672698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1ac0d16d0 msgr2=0x7fe1ac1f43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.665+0000 7fe1b358d640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1ac0d16d0 0x7fe1ac1f43a0 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7fe19c034040 tx=0x7fe19c004a40 comp rx=0 tx=0).stop 2024-09-11T22:23:37.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.665+0000 7fe1b358d640 1 -- 172.21.15.50:0/1732672698 shutdown_connections 2024-09-11T22:23:37.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.665+0000 7fe1b358d640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe19806be30 0x7fe19806e2f0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.665+0000 7fe1b358d640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe1ac0d3a30 0x7fe1ac0cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.665+0000 7fe1b358d640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac15e870 0x7fe1ac0ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.665+0000 7fe1b358d640 1 --2- 172.21.15.50:0/1732672698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1ac0d16d0 0x7fe1ac1f43a0 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.665+0000 7fe1b358d640 1 -- 172.21.15.50:0/1732672698 >> 172.21.15.50:0/1732672698 conn(0x7fe1ac0727a0 msgr2=0x7fe1ac15f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:37.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.666+0000 7fe1b358d640 1 -- 172.21.15.50:0/1732672698 shutdown_connections 2024-09-11T22:23:37.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.666+0000 7fe1b358d640 1 -- 172.21.15.50:0/1732672698 wait complete. 2024-09-11T22:23:37.677 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:23:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.779+0000 7fbfa70af640 1 Processor -- start 2024-09-11T22:23:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.779+0000 7fbfa70af640 1 -- start start 2024-09-11T22:23:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa70af640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfa015b400 0x7fbfa006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa70af640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbfa0072e60 0x7fbfa006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa70af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfa006df20 0x7fbfa00b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa70af640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa015b7e0 con 0x7fbfa015b400 2024-09-11T22:23:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa70af640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa015f140 con 0x7fbfa0072e60 2024-09-11T22:23:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa70af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa015f420 con 0x7fbfa006df20 2024-09-11T22:23:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa4e4b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfa015b400 0x7fbfa006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa4e4b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfa015b400 0x7fbfa006d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49166/0 (socket says 172.21.15.50:49166) 2024-09-11T22:23:37.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa4e4b640 1 -- 172.21.15.50:0/1575316452 learned_addr learned my addr 172.21.15.50:0/1575316452 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:37.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa564c640 1 --2- 172.21.15.50:0/1575316452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfa006df20 0x7fbfa00b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa4e4b640 1 -- 172.21.15.50:0/1575316452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfa006df20 msgr2=0x7fbfa00b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:37.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa4e4b640 1 --2- 172.21.15.50:0/1575316452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfa006df20 0x7fbfa00b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa4e4b640 1 -- 172.21.15.50:0/1575316452 >> v2:172.21.15.77:3300/0 conn(0x7fbfa0072e60 msgr2=0x7fbfa006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:37.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbf9ffff640 1 --2- 172.21.15.50:0/1575316452 >> v2:172.21.15.77:3300/0 conn(0x7fbfa0072e60 0x7fbfa006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa4e4b640 1 --2- 172.21.15.50:0/1575316452 >> v2:172.21.15.77:3300/0 conn(0x7fbfa0072e60 0x7fbfa006d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa4e4b640 1 -- 172.21.15.50:0/1575316452 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa015f700 con 0x7fbfa015b400 2024-09-11T22:23:37.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbfa564c640 1 --2- 172.21.15.50:0/1575316452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfa006df20 0x7fbfa00b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:37.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.780+0000 7fbf9ffff640 1 --2- 172.21.15.50:0/1575316452 >> v2:172.21.15.77:3300/0 conn(0x7fbfa0072e60 0x7fbfa006d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:37.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.781+0000 7fbfa4e4b640 1 --2- 172.21.15.50:0/1575316452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfa015b400 0x7fbfa006d070 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00b56b0 tx=0x7fbf9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3095c6aeb1e61b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:37.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.781+0000 7fbf9f7fe640 1 -- 172.21.15.50:0/1575316452 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf94037070 con 0x7fbfa015b400 2024-09-11T22:23:37.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.781+0000 7fbf9f7fe640 1 -- 172.21.15.50:0/1575316452 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf94032440 con 0x7fbfa015b400 2024-09-11T22:23:37.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.781+0000 7fbf9f7fe640 1 -- 172.21.15.50:0/1575316452 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf94032810 con 0x7fbfa015b400 2024-09-11T22:23:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.782+0000 7fbfa70af640 1 -- 172.21.15.50:0/1575316452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfa015b400 msgr2=0x7fbfa006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.782+0000 7fbfa70af640 1 --2- 172.21.15.50:0/1575316452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfa015b400 0x7fbfa006d070 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00b56b0 tx=0x7fbf9402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.782+0000 7fbfa70af640 1 -- 172.21.15.50:0/1575316452 shutdown_connections 2024-09-11T22:23:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.782+0000 7fbfa70af640 1 --2- 172.21.15.50:0/1575316452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfa006df20 0x7fbfa00b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.782+0000 7fbfa70af640 1 --2- 172.21.15.50:0/1575316452 >> v2:172.21.15.77:3300/0 conn(0x7fbfa0072e60 0x7fbfa006d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.782+0000 7fbfa70af640 1 --2- 172.21.15.50:0/1575316452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfa015b400 0x7fbfa006d070 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.782+0000 7fbfa70af640 1 -- 172.21.15.50:0/1575316452 >> 172.21.15.50:0/1575316452 conn(0x7fbfa00679c0 msgr2=0x7fbfa0067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.782+0000 7fbfa70af640 1 -- 172.21.15.50:0/1575316452 shutdown_connections 2024-09-11T22:23:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.782+0000 7fbfa70af640 1 -- 172.21.15.50:0/1575316452 wait complete. 2024-09-11T22:23:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.783+0000 7fbfa70af640 1 Processor -- start 2024-09-11T22:23:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.783+0000 7fbfa70af640 1 -- start start 2024-09-11T22:23:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.784+0000 7fbfa70af640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfa006df20 0x7fbfa0143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.784+0000 7fbfa70af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfa0072e60 0x7fbfa0154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.784+0000 7fbfa70af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfa015b400 0x7fbfa0154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.784+0000 7fbfa70af640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa00b4b50 con 0x7fbfa0072e60 2024-09-11T22:23:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.784+0000 7fbfa70af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa00cfc50 con 0x7fbfa015b400 2024-09-11T22:23:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.784+0000 7fbfa70af640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa00b4cd0 con 0x7fbfa006df20 2024-09-11T22:23:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.784+0000 7fbf9ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfa0072e60 0x7fbfa0154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.784+0000 7fbf9ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfa0072e60 0x7fbfa0154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49182/0 (socket says 172.21.15.50:49182) 2024-09-11T22:23:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.784+0000 7fbf9ffff640 1 -- 172.21.15.50:0/1490615832 learned_addr learned my addr 172.21.15.50:0/1490615832 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.784+0000 7fbfa4e4b640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfa006df20 0x7fbfa0143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.784+0000 7fbfa564c640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfa015b400 0x7fbfa0154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.784+0000 7fbf9ffff640 1 -- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfa006df20 msgr2=0x7fbfa0143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.785+0000 7fbf9ffff640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfa006df20 0x7fbfa0143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.785+0000 7fbf9ffff640 1 -- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfa015b400 msgr2=0x7fbfa0154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.785+0000 7fbf9ffff640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfa015b400 0x7fbfa0154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.785+0000 7fbf9ffff640 1 -- 172.21.15.50:0/1490615832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa0153380 con 0x7fbfa0072e60 2024-09-11T22:23:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.785+0000 7fbf9ffff640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfa0072e60 0x7fbfa0154640 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00c7f0 tx=0x7fbf8c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.785+0000 7fbf9d7fa640 1 -- 172.21.15.50:0/1490615832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c015070 con 0x7fbfa0072e60 2024-09-11T22:23:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.785+0000 7fbf9d7fa640 1 -- 172.21.15.50:0/1490615832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf8c007a30 con 0x7fbfa0072e60 2024-09-11T22:23:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.785+0000 7fbfa70af640 1 -- 172.21.15.50:0/1490615832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa0153660 con 0x7fbfa0072e60 2024-09-11T22:23:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.785+0000 7fbf9d7fa640 1 -- 172.21.15.50:0/1490615832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c007e00 con 0x7fbfa0072e60 2024-09-11T22:23:37.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.785+0000 7fbfa70af640 1 -- 172.21.15.50:0/1490615832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa01524a0 con 0x7fbfa0072e60 2024-09-11T22:23:37.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.786+0000 7fbfa70af640 1 -- 172.21.15.50:0/1490615832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa015a520 con 0x7fbfa0072e60 2024-09-11T22:23:37.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.787+0000 7fbf9d7fa640 1 -- 172.21.15.50:0/1490615832 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf8c018070 con 0x7fbfa0072e60 2024-09-11T22:23:37.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.787+0000 7fbf9d7fa640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbf8406be30 0x7fbf8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.787+0000 7fbf9d7fa640 1 -- 172.21.15.50:0/1490615832 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7fbf8c08ada0 con 0x7fbfa0072e60 2024-09-11T22:23:37.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.787+0000 7fbfa4e4b640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbf8406be30 0x7fbf8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.788+0000 7fbfa4e4b640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbf8406be30 0x7fbf8406e2f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fbf94034000 tx=0x7fbf9402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:37.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:37.791+0000 7fbf9d7fa640 1 -- 172.21.15.50:0/1490615832 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf8c059100 con 0x7fbfa0072e60 2024-09-11T22:23:38.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.004+0000 7fbfa70af640 1 -- 172.21.15.50:0/1490615832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfa00b4610 con 0x7fbfa0072e60 2024-09-11T22:23:38.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.004+0000 7fbf9d7fa640 1 -- 172.21.15.50:0/1490615832 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) ==== 95+0+5232 (secure 0 0 0) 0x7fbf8c05d400 con 0x7fbfa0072e60 2024-09-11T22:23:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:38.005 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":137,"btime":"2024-09-11T22:23:31:534171+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8441,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/15411963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":15411963},{"type":"v1","addr":"172.21.15.50:6833","nonce":15411963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":8450,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1953468151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1953468151},{"type":"v1","addr":"172.21.15.77:6836","nonce":1953468151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":8453,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3577421742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3577421742},{"type":"v1","addr":"172.21.15.77:6837","nonce":3577421742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134}],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:23:28.886790+0000","modified":"2024-09-11T22:23:30.878557+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10734":{"gid":10734,"name":"c","rank":0,"incarnation":135,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2876091212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2876091212},{"type":"v1","addr":"172.21.15.50:6835","nonce":2876091212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10734,"qdb_cluster":[10734]},"id":14}]} 2024-09-11T22:23:38.006 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 137 2024-09-11T22:23:38.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.006+0000 7fbfa70af640 1 -- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbf8406be30 msgr2=0x7fbf8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.006+0000 7fbfa70af640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbf8406be30 0x7fbf8406e2f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fbf94034000 tx=0x7fbf9402e000 comp rx=0 tx=0).stop 2024-09-11T22:23:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.007+0000 7fbfa70af640 1 -- 172.21.15.50:0/1490615832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfa0072e60 msgr2=0x7fbfa0154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.007+0000 7fbfa70af640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfa0072e60 0x7fbfa0154640 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00c7f0 tx=0x7fbf8c00cbf0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.007+0000 7fbfa70af640 1 -- 172.21.15.50:0/1490615832 shutdown_connections 2024-09-11T22:23:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.007+0000 7fbfa70af640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fbf8406be30 0x7fbf8406e2f0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.007+0000 7fbfa70af640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfa015b400 0x7fbfa0154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.007+0000 7fbfa70af640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfa0072e60 0x7fbfa0154640 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.007+0000 7fbfa70af640 1 --2- 172.21.15.50:0/1490615832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfa006df20 0x7fbfa0143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.007+0000 7fbfa70af640 1 -- 172.21.15.50:0/1490615832 >> 172.21.15.50:0/1490615832 conn(0x7fbfa00679c0 msgr2=0x7fbfa006e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.007+0000 7fbfa70af640 1 -- 172.21.15.50:0/1490615832 shutdown_connections 2024-09-11T22:23:38.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.007+0000 7fbfa70af640 1 -- 172.21.15.50:0/1490615832 wait complete. 2024-09-11T22:23:38.421 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 137, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:23:28.886790+0000', 'modified': '2024-09-11T22:23:30.878557+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10734}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10734': {'gid': 10734, 'name': 'c', 'rank': 0, 'incarnation': 135, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/2876091212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 2876091212}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 2876091212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10734, 'qdb_cluster': [10734]} 2024-09-11T22:23:38.421 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:23:38.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T22:23:38.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.529+0000 7f6f507f6640 1 Processor -- start 2024-09-11T22:23:38.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.529+0000 7f6f507f6640 1 -- start start 2024-09-11T22:23:38.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.530+0000 7f6f507f6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6f4815e870 0x7f6f480d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.530+0000 7f6f507f6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f480cfa80 con 0x7f6f480d16d0 2024-09-11T22:23:38.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.530+0000 7f6f507f6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f480d40d0 con 0x7f6f480d3c00 2024-09-11T22:23:38.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.530+0000 7f6f507f6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6f480d1b40 con 0x7f6f4815e870 2024-09-11T22:23:38.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.530+0000 7f6f4e592640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6f4815e870 0x7f6f480d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.530+0000 7f6f4dd91640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6f480d16d0 0x7f6f480d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38566/0 (socket says 172.21.15.50:38566) 2024-09-11T22:23:38.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.530+0000 7f6f4dd91640 1 -- 172.21.15.50:0/893038290 learned_addr learned my addr 172.21.15.50:0/893038290 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:38.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.531+0000 7f6f4e592640 1 -- 172.21.15.50:0/893038290 >> v1:172.21.15.77:6789/0 conn(0x7f6f480d3c00 legacy=0x7f6f480b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.531+0000 7f6f4e592640 1 -- 172.21.15.50:0/893038290 >> v1:172.21.15.50:6789/0 conn(0x7f6f480d16d0 legacy=0x7f6f480d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.531+0000 7f6f4e592640 1 -- 172.21.15.50:0/893038290 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f480d43b0 con 0x7f6f4815e870 2024-09-11T22:23:38.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.531+0000 7f6f4e592640 1 --2- 172.21.15.50:0/893038290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f4815e870 0x7f6f480d1190 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7f6f440097a0 tx=0x7f6f4402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a192dd16dbbdcab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:38.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.532+0000 7f6f4d590640 1 -- 172.21.15.50:0/893038290 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44037070 con 0x7f6f4815e870 2024-09-11T22:23:38.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.532+0000 7f6f4d590640 1 -- 172.21.15.50:0/893038290 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f44032440 con 0x7f6f4815e870 2024-09-11T22:23:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.532+0000 7f6f4d590640 1 -- 172.21.15.50:0/893038290 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44032810 con 0x7f6f4815e870 2024-09-11T22:23:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.532+0000 7f6f507f6640 1 -- 172.21.15.50:0/893038290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f4815e870 msgr2=0x7f6f480d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.532+0000 7f6f507f6640 1 --2- 172.21.15.50:0/893038290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f4815e870 0x7f6f480d1190 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7f6f440097a0 tx=0x7f6f4402a230 comp rx=0 tx=0).stop 2024-09-11T22:23:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.532+0000 7f6f507f6640 1 -- 172.21.15.50:0/893038290 shutdown_connections 2024-09-11T22:23:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.532+0000 7f6f507f6640 1 --2- 172.21.15.50:0/893038290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f4815e870 0x7f6f480d1190 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.532+0000 7f6f507f6640 1 -- 172.21.15.50:0/893038290 >> 172.21.15.50:0/893038290 conn(0x7f6f480727a0 msgr2=0x7f6f480679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.532+0000 7f6f507f6640 1 -- 172.21.15.50:0/893038290 shutdown_connections 2024-09-11T22:23:38.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.532+0000 7f6f507f6640 1 -- 172.21.15.50:0/893038290 wait complete. 2024-09-11T22:23:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.533+0000 7f6f507f6640 1 Processor -- start 2024-09-11T22:23:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.534+0000 7f6f507f6640 1 -- start start 2024-09-11T22:23:38.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.534+0000 7f6f507f6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f480d16d0 0x7f6f480cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.534+0000 7f6f507f6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f480d3c00 0x7f6f480c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.534+0000 7f6f507f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f4815e870 0x7f6f480b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.534+0000 7f6f507f6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4815ec50 con 0x7f6f4815e870 2024-09-11T22:23:38.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.534+0000 7f6f507f6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f480b7ee0 con 0x7f6f480d16d0 2024-09-11T22:23:38.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.534+0000 7f6f507f6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6f480b78b0 con 0x7f6f480d3c00 2024-09-11T22:23:38.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.534+0000 7f6f4ed93640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f4815e870 0x7f6f480b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.534+0000 7f6f4ed93640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f4815e870 0x7f6f480b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49210/0 (socket says 172.21.15.50:49210) 2024-09-11T22:23:38.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.534+0000 7f6f4ed93640 1 -- 172.21.15.50:0/2726181133 learned_addr learned my addr 172.21.15.50:0/2726181133 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:38.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.534+0000 7f6f4e592640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f480d16d0 0x7f6f480cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.535+0000 7f6f4dd91640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f480d3c00 0x7f6f480c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.535+0000 7f6f4ed93640 1 -- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f480d3c00 msgr2=0x7f6f480c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.535+0000 7f6f4ed93640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f480d3c00 0x7f6f480c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.535+0000 7f6f4ed93640 1 -- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f480d16d0 msgr2=0x7f6f480cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.535+0000 7f6f4ed93640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f480d16d0 0x7f6f480cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.535+0000 7f6f4ed93640 1 -- 172.21.15.50:0/2726181133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4815c920 con 0x7f6f4815e870 2024-09-11T22:23:38.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.535+0000 7f6f4ed93640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f4815e870 0x7f6f480b24a0 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000c730 tx=0x7f6f4000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:38.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.535+0000 7f6f3effd640 1 -- 172.21.15.50:0/2726181133 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40003b70 con 0x7f6f4815e870 2024-09-11T22:23:38.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.535+0000 7f6f3effd640 1 -- 172.21.15.50:0/2726181133 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f40003d10 con 0x7f6f4815e870 2024-09-11T22:23:38.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.535+0000 7f6f507f6640 1 -- 172.21.15.50:0/2726181133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f4815cc00 con 0x7f6f4815e870 2024-09-11T22:23:38.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.535+0000 7f6f3effd640 1 -- 172.21.15.50:0/2726181133 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4000aa90 con 0x7f6f4815e870 2024-09-11T22:23:38.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.535+0000 7f6f507f6640 1 -- 172.21.15.50:0/2726181133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f4815d1c0 con 0x7f6f4815e870 2024-09-11T22:23:38.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.537+0000 7f6f3effd640 1 -- 172.21.15.50:0/2726181133 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f4000ac30 con 0x7f6f4815e870 2024-09-11T22:23:38.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.538+0000 7f6f3effd640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.538+0000 7f6f3effd640 1 -- 172.21.15.50:0/2726181133 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f6f4008ac30 con 0x7f6f4815e870 2024-09-11T22:23:38.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.538+0000 7f6f4e592640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.538+0000 7f6f53669740 1 Processor -- start 2024-09-11T22:23:38.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.539+0000 7f6f53669740 1 -- start start 2024-09-11T22:23:38.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.539+0000 7f6f4e592640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6f44034000 tx=0x7f6f4402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.539+0000 7f6f53669740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 0x55f39c820a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.539+0000 7f6f53669740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7d8a80 0x55f39c7db6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.539+0000 7f6f53669740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7dca50 0x55f39c7d58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.539+0000 7f6f53669740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f39c73d520 con 0x55f39c7db2c0 2024-09-11T22:23:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.539+0000 7f6f53669740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f39c6e53e0 con 0x55f39c7dca50 2024-09-11T22:23:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.539+0000 7f6f53669740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f39c7394e0 con 0x55f39c7d8a80 2024-09-11T22:23:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.539+0000 7f6f4e592640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 0x55f39c820a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.539+0000 7f6f4e592640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 0x55f39c820a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49218/0 (socket says 172.21.15.50:49218) 2024-09-11T22:23:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.539+0000 7f6f4e592640 1 -- 172.21.15.50:0/2405008266 learned_addr learned my addr 172.21.15.50:0/2405008266 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.540+0000 7f6f4ed93640 1 --2- 172.21.15.50:0/2405008266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7dca50 0x55f39c7d58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.540+0000 7f6f4dd91640 1 --2- 172.21.15.50:0/2405008266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7d8a80 0x55f39c7db6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.540+0000 7f6f4e592640 1 -- 172.21.15.50:0/2405008266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7d8a80 msgr2=0x55f39c7db6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.540+0000 7f6f4e592640 1 --2- 172.21.15.50:0/2405008266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7d8a80 0x55f39c7db6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.540+0000 7f6f4e592640 1 -- 172.21.15.50:0/2405008266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7dca50 msgr2=0x55f39c7d58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.540+0000 7f6f4e592640 1 --2- 172.21.15.50:0/2405008266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7dca50 0x55f39c7d58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.540+0000 7f6f4e592640 1 -- 172.21.15.50:0/2405008266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f39c7002f0 con 0x55f39c7db2c0 2024-09-11T22:23:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.540+0000 7f6f4ed93640 1 --2- 172.21.15.50:0/2405008266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7dca50 0x55f39c7d58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.540+0000 7f6f4e592640 1 --2- 172.21.15.50:0/2405008266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 0x55f39c820a60 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f6f4403e040 tx=0x7f6f4402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2908605f25f489f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.540+0000 7f6f2bfff640 1 -- 172.21.15.50:0/2405008266 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44037040 con 0x55f39c7db2c0 2024-09-11T22:23:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.540+0000 7f6f2bfff640 1 -- 172.21.15.50:0/2405008266 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4404e070 con 0x55f39c7db2c0 2024-09-11T22:23:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.540+0000 7f6f2bfff640 1 -- 172.21.15.50:0/2405008266 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4403c640 con 0x55f39c7db2c0 2024-09-11T22:23:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.541+0000 7f6f53669740 1 -- 172.21.15.50:0/2405008266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 msgr2=0x55f39c820a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.541+0000 7f6f53669740 1 --2- 172.21.15.50:0/2405008266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 0x55f39c820a60 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f6f4403e040 tx=0x7f6f4402c000 comp rx=0 tx=0).stop 2024-09-11T22:23:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.541+0000 7f6f53669740 1 -- 172.21.15.50:0/2405008266 shutdown_connections 2024-09-11T22:23:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.541+0000 7f6f53669740 1 --2- 172.21.15.50:0/2405008266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7d8a80 0x55f39c7db6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.541+0000 7f6f53669740 1 --2- 172.21.15.50:0/2405008266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7dca50 0x55f39c7d58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.541+0000 7f6f53669740 1 --2- 172.21.15.50:0/2405008266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 0x55f39c820a60 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.541+0000 7f6f53669740 1 -- 172.21.15.50:0/2405008266 >> 172.21.15.50:0/2405008266 conn(0x55f39c7d7a80 msgr2=0x55f39c81ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:38.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.541+0000 7f6f53669740 1 -- 172.21.15.50:0/2405008266 shutdown_connections 2024-09-11T22:23:38.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.541+0000 7f6f53669740 1 -- 172.21.15.50:0/2405008266 wait complete. 2024-09-11T22:23:38.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.542+0000 7f6f53669740 1 -- start start 2024-09-11T22:23:38.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.542+0000 7f6f53669740 1 Processor -- start 2024-09-11T22:23:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f53669740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7db2c0 0x55f39c805b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f53669740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 0x55f39c7fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f53669740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7fe5f0 0x55f39c7fea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f53669740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f39c7d6f20 con 0x55f39c7dca50 2024-09-11T22:23:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f53669740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f39c6c6450 con 0x55f39c7db2c0 2024-09-11T22:23:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f53669740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f39c821290 con 0x55f39c7fe5f0 2024-09-11T22:23:38.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f53669740 10 client.0 _ll_register_callbacks cb 0x55f39c44fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:23:38.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f4dd91640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 0x55f39c7fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f4dd91640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 0x55f39c7fbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49228/0 (socket says 172.21.15.50:49228) 2024-09-11T22:23:38.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f4dd91640 1 -- 172.21.15.50:0/288135760 learned_addr learned my addr 172.21.15.50:0/288135760 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:38.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f4e592640 1 --2- 172.21.15.50:0/288135760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7db2c0 0x55f39c805b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f4ed93640 1 --2- 172.21.15.50:0/288135760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7fe5f0 0x55f39c7fea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f4dd91640 1 -- 172.21.15.50:0/288135760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7fe5f0 msgr2=0x55f39c7fea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:38.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f4dd91640 1 --2- 172.21.15.50:0/288135760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7fe5f0 0x55f39c7fea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f4dd91640 1 -- 172.21.15.50:0/288135760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7db2c0 msgr2=0x55f39c805b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:38.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f4dd91640 1 --2- 172.21.15.50:0/288135760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7db2c0 0x55f39c805b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f4dd91640 1 -- 172.21.15.50:0/288135760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f39c4502d0 con 0x55f39c7dca50 2024-09-11T22:23:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f4dd91640 1 --2- 172.21.15.50:0/288135760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 0x55f39c7fbd90 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f6f38001e70 tx=0x7f6f38012750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2df2c19e84c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f297fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:23:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f297fa640 1 -- 172.21.15.50:0/288135760 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38019020 con 0x55f39c7dca50 2024-09-11T22:23:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f297fa640 1 -- 172.21.15.50:0/288135760 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f6f38005ac0 con 0x55f39c7dca50 2024-09-11T22:23:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.543+0000 7f6f53669740 1 -- 172.21.15.50:0/288135760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f4404e070 con 0x55f39c7dca50 2024-09-11T22:23:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f297fa640 1 -- 172.21.15.50:0/288135760 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) ==== 24+0+0 (secure 0 0 0) 0x7f6f38023050 con 0x55f39c7dca50 2024-09-11T22:23:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f53669740 10 client.10896 fetch_fsmap learned FSMap version 137 2024-09-11T22:23:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f53669740 1 -- 172.21.15.50:0/288135760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) -- 0x55f39c51a6b0 con 0x55f39c7dca50 2024-09-11T22:23:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f297fa640 1 -- 172.21.15.50:0/288135760 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4404e070 con 0x55f39c7dca50 2024-09-11T22:23:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f297fa640 1 -- 172.21.15.50:0/288135760 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 137) ==== 3502+0+0 (secure 0 0 0) 0x7f6f38026020 con 0x55f39c7dca50 2024-09-11T22:23:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f53669740 10 client.10896 fetch_fsmap finished waiting for FSMap version 137 2024-09-11T22:23:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f53669740 10 client.10896 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:23:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f53669740 20 client.10896 populate_metadata read hostname 'smithi050' 2024-09-11T22:23:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f53669740 1 --2- 172.21.15.50:0/288135760 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55f39c833460 0x55f39c833840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f53669740 4 client.10896 mds_command: new command op to 10734 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:23:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f53669740 1 -- 172.21.15.50:0/288135760 --> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f39c74ac50 con 0x55f39c833460 2024-09-11T22:23:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f4e592640 1 --2- 172.21.15.50:0/288135760 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55f39c833460 0x55f39c833840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f297fa640 10 client.10896 ms_handle_connect on v2:172.21.15.50:6834/2876091212 2024-09-11T22:23:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.544+0000 7f6f4e592640 1 --2- 172.21.15.50:0/288135760 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55f39c833460 0x55f39c833840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcebd5ea8aa64862 server_cookie=6a0b0f91d02ba993 in_seq=0 out_seq=0 2024-09-11T22:23:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f297fa640 1 -- 172.21.15.50:0/288135760 <== mds.0 v2:172.21.15.50:6834/2876091212 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f39c74ac50 con 0x55f39c833460 2024-09-11T22:23:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f297fa640 10 client.10896 handle_command_reply: tid=0 2024-09-11T22:23:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f53669740 1 client.10896 shutdown 2024-09-11T22:23:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f53669740 1 -- 172.21.15.50:0/288135760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 msgr2=0x55f39c7fbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f53669740 1 --2- 172.21.15.50:0/288135760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 0x55f39c7fbd90 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f6f38001e70 tx=0x7f6f38012750 comp rx=0 tx=0).stop 2024-09-11T22:23:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f53669740 1 -- 172.21.15.50:0/288135760 shutdown_connections 2024-09-11T22:23:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f53669740 1 --2- 172.21.15.50:0/288135760 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55f39c833460 0x55f39c833840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f53669740 1 --2- 172.21.15.50:0/288135760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7fe5f0 0x55f39c7fea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f53669740 1 --2- 172.21.15.50:0/288135760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 0x55f39c7fbd90 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f297fa640 0 client.10896 ms_handle_reset on v2:172.21.15.50:6834/2876091212 2024-09-11T22:23:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f53669740 1 --2- 172.21.15.50:0/288135760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7db2c0 0x55f39c805b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f53669740 1 -- 172.21.15.50:0/288135760 >> 172.21.15.50:0/288135760 conn(0x55f39c7d8a80 msgr2=0x55f39c821a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f53669740 1 -- 172.21.15.50:0/288135760 shutdown_connections 2024-09-11T22:23:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.545+0000 7f6f53669740 1 -- 172.21.15.50:0/288135760 wait complete. 2024-09-11T22:23:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.546+0000 7f6f53669740 20 client.10896 trim_cache size 0 max 16384 2024-09-11T22:23:38.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.564+0000 7f6f53669740 1 Processor -- start 2024-09-11T22:23:38.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.564+0000 7f6f53669740 1 -- start start 2024-09-11T22:23:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f53669740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 0x55f39c7fb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f53669740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7dca50 0x55f39c8012f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f53669740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7fe5f0 0x55f39c801830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f53669740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6f480ac880 con 0x55f39c7db2c0 2024-09-11T22:23:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f53669740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f481f8a20 con 0x55f39c7fe5f0 2024-09-11T22:23:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f53669740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6f480ac230 con 0x55f39c7dca50 2024-09-11T22:23:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f4e592640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 0x55f39c7fb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f4e592640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 0x55f39c7fb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49244/0 (socket says 172.21.15.50:49244) 2024-09-11T22:23:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f4e592640 1 -- 172.21.15.50:0/2083623656 learned_addr learned my addr 172.21.15.50:0/2083623656 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f4dd91640 1 --2- 172.21.15.50:0/2083623656 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7dca50 0x55f39c8012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f4ed93640 1 --2- 172.21.15.50:0/2083623656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7fe5f0 0x55f39c801830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f4e592640 1 -- 172.21.15.50:0/2083623656 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7dca50 msgr2=0x55f39c8012f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f4e592640 1 --2- 172.21.15.50:0/2083623656 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7dca50 0x55f39c8012f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f4e592640 1 -- 172.21.15.50:0/2083623656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7fe5f0 msgr2=0x55f39c801830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f4e592640 1 --2- 172.21.15.50:0/2083623656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7fe5f0 0x55f39c801830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f4e592640 1 -- 172.21.15.50:0/2083623656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f39c7fc680 con 0x55f39c7db2c0 2024-09-11T22:23:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f4dd91640 1 --2- 172.21.15.50:0/2083623656 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7dca50 0x55f39c8012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f4ed93640 1 --2- 172.21.15.50:0/2083623656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7fe5f0 0x55f39c801830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f4e592640 1 --2- 172.21.15.50:0/2083623656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 0x55f39c7fb420 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f6f440098c0 tx=0x7f6f4403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12698190cfccfb74 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f2b7fe640 1 -- 172.21.15.50:0/2083623656 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4405e020 con 0x55f39c7db2c0 2024-09-11T22:23:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f2b7fe640 1 -- 172.21.15.50:0/2083623656 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4404e040 con 0x55f39c7db2c0 2024-09-11T22:23:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.565+0000 7f6f2b7fe640 1 -- 172.21.15.50:0/2083623656 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44037040 con 0x55f39c7db2c0 2024-09-11T22:23:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.566+0000 7f6f53669740 1 -- 172.21.15.50:0/2083623656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 msgr2=0x55f39c7fb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.566+0000 7f6f53669740 1 --2- 172.21.15.50:0/2083623656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 0x55f39c7fb420 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f6f440098c0 tx=0x7f6f4403c000 comp rx=0 tx=0).stop 2024-09-11T22:23:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.566+0000 7f6f53669740 1 -- 172.21.15.50:0/2083623656 shutdown_connections 2024-09-11T22:23:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.566+0000 7f6f53669740 1 --2- 172.21.15.50:0/2083623656 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7dca50 0x55f39c8012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.566+0000 7f6f53669740 1 --2- 172.21.15.50:0/2083623656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7fe5f0 0x55f39c801830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.566+0000 7f6f53669740 1 --2- 172.21.15.50:0/2083623656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7db2c0 0x55f39c7fb420 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.566+0000 7f6f53669740 1 -- 172.21.15.50:0/2083623656 >> 172.21.15.50:0/2083623656 conn(0x55f39c7d8a80 msgr2=0x55f39c821a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.566+0000 7f6f53669740 1 -- 172.21.15.50:0/2083623656 shutdown_connections 2024-09-11T22:23:38.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.566+0000 7f6f53669740 1 -- 172.21.15.50:0/2083623656 wait complete. 2024-09-11T22:23:38.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.567+0000 7f6f53669740 1 -- start start 2024-09-11T22:23:38.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.567+0000 7f6f53669740 1 Processor -- start 2024-09-11T22:23:38.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.567+0000 7f6f53669740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7db2c0 0x55f39c820090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.567+0000 7f6f53669740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 0x55f39c81e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.567+0000 7f6f53669740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7fe5f0 0x55f39c7ffb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.567+0000 7f6f53669740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f39c7fc2d0 con 0x55f39c7dca50 2024-09-11T22:23:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.567+0000 7f6f53669740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f39c7fc860 con 0x55f39c7fe5f0 2024-09-11T22:23:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.567+0000 7f6f53669740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f39c7fe170 con 0x55f39c7db2c0 2024-09-11T22:23:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f53669740 10 client.0 _ll_register_callbacks cb 0x7f6f38001100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:23:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f4dd91640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 0x55f39c81e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f4dd91640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 0x55f39c81e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49254/0 (socket says 172.21.15.50:49254) 2024-09-11T22:23:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f4dd91640 1 -- 172.21.15.50:0/2195276863 learned_addr learned my addr 172.21.15.50:0/2195276863 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f4e592640 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7db2c0 0x55f39c820090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f4ed93640 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7fe5f0 0x55f39c7ffb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f4dd91640 1 -- 172.21.15.50:0/2195276863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7db2c0 msgr2=0x55f39c820090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f4dd91640 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7db2c0 0x55f39c820090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f4dd91640 1 -- 172.21.15.50:0/2195276863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7fe5f0 msgr2=0x55f39c7ffb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f4dd91640 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7fe5f0 0x55f39c7ffb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f4dd91640 1 -- 172.21.15.50:0/2195276863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f39c839c40 con 0x55f39c7dca50 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f4ed93640 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7fe5f0 0x55f39c7ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f4dd91640 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 0x55f39c81e0d0 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f6f38001e70 tx=0x7f6f380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4934a3cf1c316 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f297fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f297fa640 1 -- 172.21.15.50:0/2195276863 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3802b070 con 0x55f39c7dca50 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f297fa640 1 -- 172.21.15.50:0/2195276863 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f6f38007ac0 con 0x55f39c7dca50 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f53669740 1 -- 172.21.15.50:0/2195276863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f4404e040 con 0x55f39c7dca50 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f297fa640 1 -- 172.21.15.50:0/2195276863 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) ==== 24+0+0 (secure 0 0 0) 0x7f6f38036050 con 0x55f39c7dca50 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f53669740 10 client.10902 fetch_fsmap learned FSMap version 137 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.568+0000 7f6f53669740 1 -- 172.21.15.50:0/2195276863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) -- 0x55f39c7fdc50 con 0x55f39c7dca50 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f297fa640 1 -- 172.21.15.50:0/2195276863 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4404e040 con 0x55f39c7dca50 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f297fa640 1 -- 172.21.15.50:0/2195276863 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 137) ==== 3502+0+0 (secure 0 0 0) 0x7f6f38039020 con 0x55f39c7dca50 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f53669740 10 client.10902 fetch_fsmap finished waiting for FSMap version 137 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f53669740 10 client.10902 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:23:38.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f53669740 20 client.10902 populate_metadata read hostname 'smithi050' 2024-09-11T22:23:38.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f53669740 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55f39c8000a0 0x55f39c800480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f53669740 4 client.10902 mds_command: new command op to 10734 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:23:38.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f53669740 1 -- 172.21.15.50:0/2195276863 --> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] -- command(tid 0: {"prefix": "status"}) -- 0x55f39c744fa0 con 0x55f39c8000a0 2024-09-11T22:23:38.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f4e592640 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55f39c8000a0 0x55f39c800480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f297fa640 10 client.10902 ms_handle_connect on v2:172.21.15.50:6834/2876091212 2024-09-11T22:23:38.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f4e592640 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55f39c8000a0 0x55f39c800480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb68a32f37c44e40 server_cookie=c4c41b203a949192 in_seq=0 out_seq=0 2024-09-11T22:23:38.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f297fa640 1 -- 172.21.15.50:0/2195276863 <== mds.0 v2:172.21.15.50:6834/2876091212 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x55f39c744fa0 con 0x55f39c8000a0 2024-09-11T22:23:38.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f297fa640 10 client.10902 handle_command_reply: tid=0 2024-09-11T22:23:38.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.569+0000 7f6f53669740 1 client.10902 shutdown 2024-09-11T22:23:38.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f53669740 1 -- 172.21.15.50:0/2195276863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 msgr2=0x55f39c81e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f53669740 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 0x55f39c81e0d0 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f6f38001e70 tx=0x7f6f380057f0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f53669740 1 -- 172.21.15.50:0/2195276863 shutdown_connections 2024-09-11T22:23:38.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f53669740 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55f39c8000a0 0x55f39c800480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f53669740 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f39c7fe5f0 0x55f39c7ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f53669740 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f39c7dca50 0x55f39c81e0d0 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f297fa640 0 client.10902 ms_handle_reset on v2:172.21.15.50:6834/2876091212 2024-09-11T22:23:38.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f53669740 1 --2- 172.21.15.50:0/2195276863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f39c7db2c0 0x55f39c820090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f53669740 1 -- 172.21.15.50:0/2195276863 >> 172.21.15.50:0/2195276863 conn(0x55f39c7d8a80 msgr2=0x55f39c7fb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:38.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f53669740 1 -- 172.21.15.50:0/2195276863 shutdown_connections 2024-09-11T22:23:38.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f53669740 1 -- 172.21.15.50:0/2195276863 wait complete. 2024-09-11T22:23:38.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f53669740 20 client.10902 trim_cache size 0 max 16384 2024-09-11T22:23:38.577 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:23:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "a6d32825-9a2d-4e99-ad9a-1aac010fe65a", 2024-09-11T22:23:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-11T22:23:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 10734, 2024-09-11T22:23:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-11T22:23:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-11T22:23:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-11T22:23:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 9.0419834360000007, 2024-09-11T22:23:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 137, 2024-09-11T22:23:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 189, 2024-09-11T22:23:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 189, 2024-09-11T22:23:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 14.061517351000001 2024-09-11T22:23:38.578 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:23:38.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f507f6640 1 -- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6f2c06be30 msgr2=0x7f6f2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f507f6640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6f44034000 tx=0x7f6f4402e000 comp rx=0 tx=0).stop 2024-09-11T22:23:38.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f507f6640 1 -- 172.21.15.50:0/2726181133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f4815e870 msgr2=0x7f6f480b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f507f6640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f4815e870 0x7f6f480b24a0 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000c730 tx=0x7f6f4000cbf0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f507f6640 1 -- 172.21.15.50:0/2726181133 shutdown_connections 2024-09-11T22:23:38.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f507f6640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f507f6640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f480d3c00 0x7f6f480c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f507f6640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f4815e870 0x7f6f480b24a0 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f507f6640 1 --2- 172.21.15.50:0/2726181133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f480d16d0 0x7f6f480cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f507f6640 1 -- 172.21.15.50:0/2726181133 >> 172.21.15.50:0/2726181133 conn(0x7f6f480727a0 msgr2=0x7f6f48161740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:38.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f507f6640 1 -- 172.21.15.50:0/2726181133 shutdown_connections 2024-09-11T22:23:38.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.570+0000 7f6f507f6640 1 -- 172.21.15.50:0/2726181133 wait complete. 2024-09-11T22:23:38.582 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:23:38.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.685+0000 7ffad5b28640 1 Processor -- start 2024-09-11T22:23:38.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.685+0000 7ffad5b28640 1 -- start start 2024-09-11T22:23:38.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.686+0000 7ffad5b28640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffad00d05e0 0x7ffad00b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.686+0000 7ffad5b28640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad00b4f00 con 0x7ffad00b3e10 2024-09-11T22:23:38.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.686+0000 7ffad5b28640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad00b4360 con 0x7ffad015c2c0 2024-09-11T22:23:38.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.686+0000 7ffad5b28640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7ffad00b51c0 con 0x7ffad00d05e0 2024-09-11T22:23:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.686+0000 7ffacffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffad00b3e10 0x7ffad00ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38572/0 (socket says 172.21.15.50:38572) 2024-09-11T22:23:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.686+0000 7ffaceffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffad00d05e0 0x7ffad00b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.686+0000 7ffacffff640 1 -- 172.21.15.50:0/411483668 learned_addr learned my addr 172.21.15.50:0/411483668 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.687+0000 7ffaceffd640 1 -- 172.21.15.50:0/411483668 >> v1:172.21.15.77:6789/0 conn(0x7ffad015c2c0 legacy=0x7ffad00cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.687+0000 7ffaceffd640 1 -- 172.21.15.50:0/411483668 >> v1:172.21.15.50:6789/0 conn(0x7ffad00b3e10 legacy=0x7ffad00ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.687+0000 7ffaceffd640 1 -- 172.21.15.50:0/411483668 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad00b54a0 con 0x7ffad00d05e0 2024-09-11T22:23:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.687+0000 7fface7fc640 1 -- 172.21.15.50:0/411483668 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420159457 0 0) 0x7ffad00b4f00 con 0x7ffad00b3e10 2024-09-11T22:23:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.687+0000 7ffaceffd640 1 --2- 172.21.15.50:0/411483668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad00d05e0 0x7ffad00b46a0 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7ffac40097a0 tx=0x7ffac402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20499de0811228d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.687+0000 7fface7fc640 1 -- 172.21.15.50:0/411483668 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4037070 con 0x7ffad00d05e0 2024-09-11T22:23:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.688+0000 7fface7fc640 1 -- 172.21.15.50:0/411483668 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac4032440 con 0x7ffad00d05e0 2024-09-11T22:23:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.688+0000 7fface7fc640 1 -- 172.21.15.50:0/411483668 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4032810 con 0x7ffad00d05e0 2024-09-11T22:23:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.688+0000 7ffad5b28640 1 -- 172.21.15.50:0/411483668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad00d05e0 msgr2=0x7ffad00b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.688+0000 7ffad5b28640 1 --2- 172.21.15.50:0/411483668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad00d05e0 0x7ffad00b46a0 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7ffac40097a0 tx=0x7ffac402a230 comp rx=0 tx=0).stop 2024-09-11T22:23:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.688+0000 7ffad5b28640 1 -- 172.21.15.50:0/411483668 shutdown_connections 2024-09-11T22:23:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.688+0000 7ffad5b28640 1 --2- 172.21.15.50:0/411483668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad00d05e0 0x7ffad00b46a0 unknown :-1 s=CLOSED pgs=2292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.688+0000 7ffad5b28640 1 -- 172.21.15.50:0/411483668 >> 172.21.15.50:0/411483668 conn(0x7ffad00679c0 msgr2=0x7ffad0067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.688+0000 7ffad5b28640 1 -- 172.21.15.50:0/411483668 shutdown_connections 2024-09-11T22:23:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.688+0000 7ffad5b28640 1 -- 172.21.15.50:0/411483668 wait complete. 2024-09-11T22:23:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.689+0000 7ffad5b28640 1 Processor -- start 2024-09-11T22:23:38.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.689+0000 7ffad5b28640 1 -- start start 2024-09-11T22:23:38.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.690+0000 7ffad5b28640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad00b3e10 0x7ffad014f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.690+0000 7ffad5b28640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffad00d05e0 0x7ffad014e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.690+0000 7ffad5b28640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad015c2c0 0x7ffad0151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.690+0000 7ffad5b28640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffad006d070 con 0x7ffad00b3e10 2024-09-11T22:23:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.690+0000 7ffad5b28640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffad00ce200 con 0x7ffad00d05e0 2024-09-11T22:23:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.690+0000 7ffad5b28640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffad006d1f0 con 0x7ffad015c2c0 2024-09-11T22:23:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.690+0000 7ffacf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad00b3e10 0x7ffad014f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.690+0000 7ffacf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad00b3e10 0x7ffad014f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49280/0 (socket says 172.21.15.50:49280) 2024-09-11T22:23:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.690+0000 7ffacf7fe640 1 -- 172.21.15.50:0/2155004472 learned_addr learned my addr 172.21.15.50:0/2155004472 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.690+0000 7ffaceffd640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffad00d05e0 0x7ffad014e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.690+0000 7ffacffff640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad015c2c0 0x7ffad0151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.691+0000 7ffacf7fe640 1 -- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad015c2c0 msgr2=0x7ffad0151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.691+0000 7ffacf7fe640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad015c2c0 0x7ffad0151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.691+0000 7ffacf7fe640 1 -- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffad00d05e0 msgr2=0x7ffad014e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.691+0000 7ffacf7fe640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffad00d05e0 0x7ffad014e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.691+0000 7ffacf7fe640 1 -- 172.21.15.50:0/2155004472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad01e69c0 con 0x7ffad00b3e10 2024-09-11T22:23:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.691+0000 7ffacffff640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad015c2c0 0x7ffad0151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.691+0000 7ffacf7fe640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad00b3e10 0x7ffad014f010 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7ffac000c400 tx=0x7ffac000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.691+0000 7ffab7fff640 1 -- 172.21.15.50:0/2155004472 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0017070 con 0x7ffad00b3e10 2024-09-11T22:23:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.691+0000 7ffab7fff640 1 -- 172.21.15.50:0/2155004472 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac00052d0 con 0x7ffad00b3e10 2024-09-11T22:23:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.691+0000 7ffad5b28640 1 -- 172.21.15.50:0/2155004472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad01e6ca0 con 0x7ffad00b3e10 2024-09-11T22:23:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.691+0000 7ffab7fff640 1 -- 172.21.15.50:0/2155004472 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0003830 con 0x7ffad00b3e10 2024-09-11T22:23:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.691+0000 7ffad5b28640 1 -- 172.21.15.50:0/2155004472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad01e7260 con 0x7ffad00b3e10 2024-09-11T22:23:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.692+0000 7ffad5b28640 1 -- 172.21.15.50:0/2155004472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad015c6a0 con 0x7ffad00b3e10 2024-09-11T22:23:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.693+0000 7ffab7fff640 1 -- 172.21.15.50:0/2155004472 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffac001a070 con 0x7ffad00b3e10 2024-09-11T22:23:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.693+0000 7ffab7fff640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffabc06be30 0x7ffabc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.693+0000 7ffab7fff640 1 -- 172.21.15.50:0/2155004472 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7ffac008a1d0 con 0x7ffad00b3e10 2024-09-11T22:23:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.693+0000 7ffaceffd640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffabc06be30 0x7ffabc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.694+0000 7ffaceffd640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffabc06be30 0x7ffabc06e2f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ffac4034000 tx=0x7ffac402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:38.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.698+0000 7ffab7fff640 1 -- 172.21.15.50:0/2155004472 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffac00584a0 con 0x7ffad00b3e10 2024-09-11T22:23:38.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.906+0000 7ffad5b28640 1 -- 172.21.15.50:0/2155004472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffad00b1280 con 0x7ffad00b3e10 2024-09-11T22:23:38.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.906+0000 7ffab7fff640 1 -- 172.21.15.50:0/2155004472 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v137) ==== 53+0+73 (secure 0 0 0) 0x7ffac005c7a0 con 0x7ffad00b3e10 2024-09-11T22:23:38.907 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:23:38.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.908+0000 7ffad5b28640 1 -- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffabc06be30 msgr2=0x7ffabc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.908+0000 7ffad5b28640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffabc06be30 0x7ffabc06e2f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ffac4034000 tx=0x7ffac402e000 comp rx=0 tx=0).stop 2024-09-11T22:23:38.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.908+0000 7ffad5b28640 1 -- 172.21.15.50:0/2155004472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad00b3e10 msgr2=0x7ffad014f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.908+0000 7ffad5b28640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad00b3e10 0x7ffad014f010 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7ffac000c400 tx=0x7ffac000c8c0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.908+0000 7ffad5b28640 1 -- 172.21.15.50:0/2155004472 shutdown_connections 2024-09-11T22:23:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.908+0000 7ffad5b28640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ffabc06be30 0x7ffabc06e2f0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.908+0000 7ffad5b28640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad015c2c0 0x7ffad0151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.908+0000 7ffad5b28640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffad00d05e0 0x7ffad014e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.908+0000 7ffad5b28640 1 --2- 172.21.15.50:0/2155004472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffad00b3e10 0x7ffad014f010 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.909+0000 7ffad5b28640 1 -- 172.21.15.50:0/2155004472 >> 172.21.15.50:0/2155004472 conn(0x7ffad00679c0 msgr2=0x7ffad00ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.909+0000 7ffad5b28640 1 -- 172.21.15.50:0/2155004472 shutdown_connections 2024-09-11T22:23:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:38.909+0000 7ffad5b28640 1 -- 172.21.15.50:0/2155004472 wait complete. 2024-09-11T22:23:38.921 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:23:38.921 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:23:38.921 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-11T22:23:38.921 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:23:38.921 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:23:38.921 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:23:38.921 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T22:23:38.921 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:23:38.921 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:23:38.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:38.922 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-11T22:23:38.938 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:23:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:23:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:23:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:23:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-11T22:23:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:23:38.938 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:23:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:23:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-11T22:23:38.939 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:23:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:23:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-11T22:23:38.939 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:23:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:23:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-11T22:23:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:23:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41976sec preferred_lft 41976sec 2024-09-11T22:23:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-11T22:23:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:23:38.939 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d490:c0ff:fe66:1043/64 scope link 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether ae:67:fa:e9:41:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ac67:faff:fee9:4152/64 scope link 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T22:23:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 26:6f:0d:65:36:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:23:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::246f:dff:fe65:36bc/64 scope link 2024-09-11T22:23:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:23:38.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:38.941 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:23:39.003 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-11T22:23:39.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:39.005 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-11T22:23:39.062 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-11T22:23:39.063 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:23:39.063 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:23:39.063 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:23:39.063 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:23:39.063 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:23:39.063 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-11T22:23:39.063 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:23:39.064 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:23:39.064 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:23:39.064 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-11T22:23:39.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:23:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:23:39.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:39.191 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:23:39.207 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:23:39.207 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:23:39.207 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:23:39.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:39.208 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-11T22:23:39.273 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:23:39.273 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:23:39.329 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:23:39.329 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:23:39.329 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:23:39.385 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T22:23:39.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:39.386 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:23:39.470 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:23:39.470 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:23:39.478 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T22:23:39.478 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T22:23:39.478 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-11T22:23:39.478 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@a6d32825-9a2d-4e99-ad9a-1aac010fe65a.cephfs=/ 2024-09-11T22:23:39.478 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.50:3300/172.21.15.77:3300/172.21.15.77:3301" will pass to kernel 2024-09-11T22:23:39.479 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:23:39.479 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:23:39.479 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:23:39.479 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:23:39.479 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:23:39.481 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:23:39.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:39.481 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:23:39.512 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:23:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:23:39.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:23:39.610 INFO:teuthology.orchestra.run.smithi050.stdout:client9700 2024-09-11T22:23:39.610 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:23:39.610 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:23:39.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:39.626 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-11T22:23:39.685 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:23:39.685 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:23:39.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:39.741 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-11T22:23:39.836 INFO:teuthology.orchestra.run.smithi050.stderr:6+0 records in 2024-09-11T22:23:39.837 INFO:teuthology.orchestra.run.smithi050.stderr:6+0 records out 2024-09-11T22:23:39.837 INFO:teuthology.orchestra.run.smithi050.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0375351 s, 168 MB/s 2024-09-11T22:23:39.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T22:23:39.841 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T22:23:39.883 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-09-11T22:23:39.883 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-09-11T22:23:39.883 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T22:23:39.883 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-09-11T22:23:39.884 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.884 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-09-11T22:23:39.884 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.884 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-09-11T22:23:39.884 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.884 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-09-11T22:23:39.884 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-09-11T22:23:39.884 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.884 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-09-11T22:23:39.884 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-09-11T22:23:39.884 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.884 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T22:23:39.884 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-09-11T22:23:39.885 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T22:23:39.886 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T22:23:39.886 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-09-11T22:23:39.886 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.886 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T22:23:39.886 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.886 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-09-11T22:23:39.886 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.886 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-09-11T22:23:39.886 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.886 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-09-11T22:23:39.886 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-09-11T22:23:39.886 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-09-11T22:23:39.886 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-11T22:23:39.887 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on skipped message = False 2024-09-11T22:23:39.887 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = a6d32825-9a2d-4e99-ad9a-1aac010fe65a 2024-09-11T22:23:39.887 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.887 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-09-11T22:23:39.887 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-09-11T22:23:39.887 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.887 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-09-11T22:23:39.887 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2024-09-11T22:23:39.887 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-09-11T22:23:39.887 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.887 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-09-11T22:23:39.887 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-09-11T22:23:39.887 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.888 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-09-11T22:23:39.888 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-09-11T22:23:39.888 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-09-11T22:23:39.888 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug trim objects = true 2024-09-11T22:23:39.888 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.888 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-09-11T22:23:39.888 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-09-11T22:23:39.888 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.888 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-09-11T22:23:39.888 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.888 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-09-11T22:23:39.888 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: bdev async discard = True 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: bdev enable discard = True 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore allocator = bitmap 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 1/20 2024-09-11T22:23:39.889 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 1/20 2024-09-11T22:23:39.890 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:23:39.890 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-09-11T22:23:39.890 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 4/10 2024-09-11T22:23:39.890 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T22:23:39.890 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-09-11T22:23:39.890 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-09-11T22:23:39.890 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-09-11T22:23:39.890 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-09-11T22:23:39.890 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-09-11T22:23:39.890 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.890 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-09-11T22:23:39.890 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:23:39.890 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-09-11T22:23:39.891 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-09-11T22:23:39.892 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:23:39.892 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-09-11T22:23:39.892 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-09-11T22:23:39.892 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:23:39.892 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.892 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T22:23:39.892 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T22:23:39.892 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T22:23:39.892 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.892 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T22:23:39.892 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T22:23:39.892 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T22:23:39.892 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.893 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-09-11T22:23:39.893 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-09-11T22:23:39.893 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.893 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-09-11T22:23:39.893 INFO:teuthology.orchestra.run.smithi050.stdout: mon down mkfs grace = 300 2024-09-11T22:23:39.893 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2024-09-11T22:23:39.893 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on pool no app = False 2024-09-11T22:23:39.893 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.893 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-09-11T22:23:39.893 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-09-11T22:23:39.893 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2024-09-11T22:23:39.893 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-09-11T22:23:39.893 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = "" 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-09-11T22:23:39.894 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2024-09-11T22:23:39.895 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2024-09-11T22:23:39.895 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2024-09-11T22:23:39.895 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds balancer = 20 2024-09-11T22:23:39.895 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:23:39.895 INFO:teuthology.orchestra.run.smithi050.stdout: mds cache max size = 1000 2024-09-11T22:23:39.895 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2024-09-11T22:23:39.895 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2024-09-11T22:23:39.895 INFO:teuthology.orchestra.run.smithi050.stdout: mds log max segments = 1 2024-09-11T22:23:39.895 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2024-09-11T22:23:39.895 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = False 2024-09-11T22:23:39.895 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-09-11T22:23:39.895 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-09-11T22:23:39.895 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-09-11T22:23:39.896 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-09-11T22:23:39.896 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-09-11T22:23:39.896 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T22:23:39.896 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-09-11T22:23:39.896 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.896 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-09-11T22:23:39.897 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.897 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-09-11T22:23:39.897 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.897 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-09-11T22:23:39.897 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-09-11T22:23:39.897 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.897 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-09-11T22:23:39.897 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-09-11T22:23:39.897 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.897 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T22:23:39.897 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-09-11T22:23:39.897 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.898 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T22:23:39.898 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T22:23:39.898 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.898 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-09-11T22:23:39.898 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.898 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-09-11T22:23:39.898 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-09-11T22:23:39.898 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-09-11T22:23:39.898 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-09-11T22:23:39.898 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-09-11T22:23:39.898 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-09-11T22:23:39.898 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-09-11T22:23:39.898 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T22:23:39.899 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T22:23:39.899 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-09-11T22:23:39.899 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.899 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T22:23:39.899 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.899 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-09-11T22:23:39.899 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.899 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-09-11T22:23:39.899 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.899 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-09-11T22:23:39.899 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-09-11T22:23:39.899 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-09-11T22:23:39.899 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.50,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-11T22:23:39.900 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on skipped message = False 2024-09-11T22:23:39.900 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = a6d32825-9a2d-4e99-ad9a-1aac010fe65a 2024-09-11T22:23:39.900 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.900 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-09-11T22:23:39.900 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-09-11T22:23:39.900 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.900 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-09-11T22:23:39.900 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-09-11T22:23:39.900 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-09-11T22:23:39.900 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.900 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-09-11T22:23:39.900 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-09-11T22:23:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-09-11T22:23:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-09-11T22:23:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-09-11T22:23:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-09-11T22:23:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-09-11T22:23:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-09-11T22:23:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-09-11T22:23:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-09-11T22:23:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: bdev async discard = True 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: bdev enable discard = True 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore allocator = bitmap 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 1/20 2024-09-11T22:23:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 1/20 2024-09-11T22:23:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:23:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-09-11T22:23:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 4/10 2024-09-11T22:23:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T22:23:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-09-11T22:23:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-09-11T22:23:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-09-11T22:23:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-09-11T22:23:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-09-11T22:23:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.903 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-09-11T22:23:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:23:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-09-11T22:23:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-11T22:23:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-11T22:23:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:23:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:23:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-09-11T22:23:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-09-11T22:23:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.904 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-09-11T22:23:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:23:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-11T22:23:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-09-11T22:23:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T22:23:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: mon down mkfs grace = 300 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: mon op complaint time = 120 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on pool no app = False 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-09-11T22:23:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T22:23:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T22:23:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 600 2024-09-11T22:23:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-09-11T22:23:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:23:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2024-09-11T22:23:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-09-11T22:23:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-09-11T22:23:39.907 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-09-11T22:23:39.907 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-09-11T22:23:39.907 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-09-11T22:23:39.907 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-09-11T22:23:39.907 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-09-11T22:23:39.907 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds = 20 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds balancer = 20 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: mds cache max size = 1000 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug frag = True 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = True 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: mds log max segments = 1 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: mds op complaint time = 180 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = False 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-09-11T22:23:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-09-11T22:23:39.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T22:23:39.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T22:23:39.994 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-09-11T22:23:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-09-11T22:23:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T22:23:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-09-11T22:23:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T22:23:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T22:23:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-09-11T22:23:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-09-11T22:23:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-09-11T22:23:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-09-11T22:23:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-09-11T22:23:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-09-11T22:23:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-09-11T22:23:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-09-11T22:23:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-11T22:23:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on skipped message = False 2024-09-11T22:23:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = a6d32825-9a2d-4e99-ad9a-1aac010fe65a 2024-09-11T22:23:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.998 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-09-11T22:23:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-09-11T22:23:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-09-11T22:23:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2024-09-11T22:23:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-09-11T22:23:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-09-11T22:23:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-09-11T22:23:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-09-11T22:23:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-09-11T22:23:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-09-11T22:23:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug trim objects = true 2024-09-11T22:23:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-09-11T22:23:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-09-11T22:23:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-09-11T22:23:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-09-11T22:23:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-09-11T22:23:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: bdev async discard = True 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: bdev enable discard = True 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore allocator = bitmap 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 1/20 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 1/20 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:23:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 4/10 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-11T22:23:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:23:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:23:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-09-11T22:23:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-09-11T22:23:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:40.002 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-09-11T22:23:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:23:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-11T22:23:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-09-11T22:23:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-11T22:23:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-09-11T22:23:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-09-11T22:23:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:23:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-09-11T22:23:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-09-11T22:23:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:23:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T22:23:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T22:23:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T22:23:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T22:23:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T22:23:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T22:23:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-09-11T22:23:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-09-11T22:23:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-09-11T22:23:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: mon down mkfs grace = 300 2024-09-11T22:23:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2024-09-11T22:23:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on pool no app = False 2024-09-11T22:23:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:40.004 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-09-11T22:23:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-09-11T22:23:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2024-09-11T22:23:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-09-11T22:23:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T22:23:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T22:23:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2024-09-11T22:23:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2024-09-11T22:23:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:23:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = "" 2024-09-11T22:23:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-09-11T22:23:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-09-11T22:23:40.005 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-09-11T22:23:40.005 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2024-09-11T22:23:40.005 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2024-09-11T22:23:40.005 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds balancer = 20 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: mds cache max size = 1000 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = False 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: mds log max segments = 1 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = False 2024-09-11T22:23:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2024-09-11T22:23:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2024-09-11T22:23:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2024-09-11T22:23:40.008 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-09-11T22:23:40.008 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-09-11T22:23:40.008 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T22:23:40.008 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-09-11T22:23:40.008 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-09-11T22:23:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-09-11T22:23:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-09-11T22:23:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-09-11T22:23:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-09-11T22:23:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-09-11T22:23:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T22:23:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-09-11T22:23:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T22:23:40.010 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T22:23:40.011 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-09-11T22:23:40.011 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.011 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T22:23:40.011 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.011 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-09-11T22:23:40.011 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.011 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-09-11T22:23:40.011 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.011 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-09-11T22:23:40.011 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-09-11T22:23:40.011 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-09-11T22:23:40.011 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.50,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-11T22:23:40.011 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on skipped message = False 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = a6d32825-9a2d-4e99-ad9a-1aac010fe65a 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-09-11T22:23:40.012 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-09-11T22:23:40.013 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-09-11T22:23:40.014 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.014 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-09-11T22:23:40.014 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-09-11T22:23:40.014 INFO:teuthology.orchestra.run.smithi077.stdout: bdev async discard = True 2024-09-11T22:23:40.014 INFO:teuthology.orchestra.run.smithi077.stdout: bdev enable discard = True 2024-09-11T22:23:40.014 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore allocator = bitmap 2024-09-11T22:23:40.014 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-09-11T22:23:40.014 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-09-11T22:23:40.014 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 1/20 2024-09-11T22:23:40.014 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 1/20 2024-09-11T22:23:40.014 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:23:40.014 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-09-11T22:23:40.014 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 4/10 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:23:40.015 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:23:40.016 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-09-11T22:23:40.016 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-09-11T22:23:40.016 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.016 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-09-11T22:23:40.016 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:23:40.016 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-11T22:23:40.016 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-09-11T22:23:40.016 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-11T22:23:40.016 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-09-11T22:23:40.016 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-09-11T22:23:40.016 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:23:40.016 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-09-11T22:23:40.017 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-09-11T22:23:40.017 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:23:40.017 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.017 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T22:23:40.017 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T22:23:40.017 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T22:23:40.017 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.017 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T22:23:40.017 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T22:23:40.017 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T22:23:40.017 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.017 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-09-11T22:23:40.018 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-09-11T22:23:40.018 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.018 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-09-11T22:23:40.018 INFO:teuthology.orchestra.run.smithi077.stdout: mon down mkfs grace = 300 2024-09-11T22:23:40.018 INFO:teuthology.orchestra.run.smithi077.stdout: mon op complaint time = 120 2024-09-11T22:23:40.018 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on pool no app = False 2024-09-11T22:23:40.018 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-11T22:23:40.018 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-09-11T22:23:40.018 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-09-11T22:23:40.018 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-09-11T22:23:40.018 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-09-11T22:23:40.018 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T22:23:40.018 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 600 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-09-11T22:23:40.019 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2024-09-11T22:23:40.020 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds = 20 2024-09-11T22:23:40.020 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds balancer = 20 2024-09-11T22:23:40.020 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-11T22:23:40.020 INFO:teuthology.orchestra.run.smithi077.stdout: mds cache max size = 1000 2024-09-11T22:23:40.020 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug frag = True 2024-09-11T22:23:40.020 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = False 2024-09-11T22:23:40.020 INFO:teuthology.orchestra.run.smithi077.stdout: mds log max segments = 1 2024-09-11T22:23:40.020 INFO:teuthology.orchestra.run.smithi077.stdout: mds op complaint time = 180 2024-09-11T22:23:40.020 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = False 2024-09-11T22:23:40.020 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-09-11T22:23:40.020 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-09-11T22:23:40.020 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-09-11T22:23:40.021 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2024-09-11T22:23:40.021 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-11T22:23:40.021 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2024-09-11T22:23:40.021 DEBUG:teuthology.orchestra.run.smithi050:> import json 2024-09-11T22:23:40.021 DEBUG:teuthology.orchestra.run.smithi050:> import sys 2024-09-11T22:23:40.021 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:23:40.021 DEBUG:teuthology.orchestra.run.smithi050:> try: 2024-09-11T22:23:40.021 DEBUG:teuthology.orchestra.run.smithi050:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-11T22:23:40.021 DEBUG:teuthology.orchestra.run.smithi050:> except OSError as e: 2024-09-11T22:23:40.021 DEBUG:teuthology.orchestra.run.smithi050:> sys.exit(e.errno) 2024-09-11T22:23:40.021 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:23:40.021 DEBUG:teuthology.orchestra.run.smithi050:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-11T22:23:40.022 DEBUG:teuthology.orchestra.run.smithi050:> print(json.dumps( 2024-09-11T22:23:40.022 DEBUG:teuthology.orchestra.run.smithi050:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-11T22:23:40.022 DEBUG:teuthology.orchestra.run.smithi050:> indent=2)) 2024-09-11T22:23:40.022 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-11T22:23:40.117 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:23:40.117 INFO:teuthology.orchestra.run.smithi050.stdout: "st_mode": 33188, 2024-09-11T22:23:40.117 INFO:teuthology.orchestra.run.smithi050.stdout: "st_ino": 1099511627777, 2024-09-11T22:23:40.117 INFO:teuthology.orchestra.run.smithi050.stdout: "st_dev": 42, 2024-09-11T22:23:40.117 INFO:teuthology.orchestra.run.smithi050.stdout: "st_nlink": 1, 2024-09-11T22:23:40.117 INFO:teuthology.orchestra.run.smithi050.stdout: "st_uid": 1000, 2024-09-11T22:23:40.120 INFO:teuthology.orchestra.run.smithi050.stdout: "st_gid": 1333, 2024-09-11T22:23:40.120 INFO:teuthology.orchestra.run.smithi050.stdout: "st_size": 6291456, 2024-09-11T22:23:40.120 INFO:teuthology.orchestra.run.smithi050.stdout: "st_atime": 1726093419.7976372, 2024-09-11T22:23:40.120 INFO:teuthology.orchestra.run.smithi050.stdout: "st_mtime": 1726093419.8176367, 2024-09-11T22:23:40.120 INFO:teuthology.orchestra.run.smithi050.stdout: "st_ctime": 1726093419.8176367 2024-09-11T22:23:40.120 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:23:40.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:23:40.126 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:23:40.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.268+0000 7f5faf168640 1 Processor -- start 2024-09-11T22:23:40.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.268+0000 7f5faf168640 1 -- start start 2024-09-11T22:23:40.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.269+0000 7f5faf168640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fa815e9b0 0x7f5fa815f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.269+0000 7f5faf168640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80b6d90 0x7f5fa80b7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.269+0000 7f5faf168640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fa80b5fd0 con 0x7f5fa806bb50 2024-09-11T22:23:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.269+0000 7f5faf168640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa80b6900 con 0x7f5fa815e9b0 2024-09-11T22:23:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.269+0000 7f5faf168640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa80b62b0 con 0x7f5fa80b6d90 2024-09-11T22:23:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.269+0000 7f5facf04640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fa815e9b0 0x7f5fa815f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.269+0000 7f5facf04640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fa815e9b0 0x7f5fa815f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49282/0 (socket says 172.21.15.50:49282) 2024-09-11T22:23:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.269+0000 7f5facf04640 1 -- 172.21.15.50:0/575424955 learned_addr learned my addr 172.21.15.50:0/575424955 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.269+0000 7f5facf04640 1 -- 172.21.15.50:0/575424955 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80b6d90 msgr2=0x7f5fa80b7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.269+0000 7f5facf04640 1 --2- 172.21.15.50:0/575424955 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80b6d90 0x7f5fa80b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.270+0000 7f5facf04640 1 -- 172.21.15.50:0/575424955 >> v1:172.21.15.77:6789/0 conn(0x7f5fa806bb50 legacy=0x7f5fa80af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.270+0000 7f5facf04640 1 -- 172.21.15.50:0/575424955 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa80b6590 con 0x7f5fa815e9b0 2024-09-11T22:23:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.270+0000 7f5facf04640 1 --2- 172.21.15.50:0/575424955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa815e9b0 0x7f5fa815f820 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009870 tx=0x7f5f9c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fd26272fb49dbf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.270+0000 7f5fa77fe640 1 -- 172.21.15.50:0/575424955 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c037070 con 0x7f5fa815e9b0 2024-09-11T22:23:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.270+0000 7f5fa77fe640 1 -- 172.21.15.50:0/575424955 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f9c032440 con 0x7f5fa815e9b0 2024-09-11T22:23:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.270+0000 7f5fa77fe640 1 -- 172.21.15.50:0/575424955 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c032810 con 0x7f5fa815e9b0 2024-09-11T22:23:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.271+0000 7f5faf168640 1 -- 172.21.15.50:0/575424955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa815e9b0 msgr2=0x7f5fa815f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.271+0000 7f5faf168640 1 --2- 172.21.15.50:0/575424955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa815e9b0 0x7f5fa815f820 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009870 tx=0x7f5f9c02a210 comp rx=0 tx=0).stop 2024-09-11T22:23:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.271+0000 7f5faf168640 1 -- 172.21.15.50:0/575424955 shutdown_connections 2024-09-11T22:23:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.271+0000 7f5faf168640 1 --2- 172.21.15.50:0/575424955 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80b6d90 0x7f5fa80b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.271+0000 7f5faf168640 1 --2- 172.21.15.50:0/575424955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa815e9b0 0x7f5fa815f820 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.271+0000 7f5faf168640 1 -- 172.21.15.50:0/575424955 >> 172.21.15.50:0/575424955 conn(0x7f5fa80b7940 msgr2=0x7f5fa80b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.271+0000 7f5faf168640 1 -- 172.21.15.50:0/575424955 shutdown_connections 2024-09-11T22:23:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.271+0000 7f5faf168640 1 -- 172.21.15.50:0/575424955 wait complete. 2024-09-11T22:23:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.272+0000 7f5faf168640 1 Processor -- start 2024-09-11T22:23:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.272+0000 7f5faf168640 1 -- start start 2024-09-11T22:23:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.273+0000 7f5faf168640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa806bb50 0x7f5fa806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.273+0000 7f5faf168640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fa80b6d90 0x7f5fa815b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.273+0000 7f5faf168640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa815bdc0 0x7f5fa814db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.273+0000 7f5faf168640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa806d310 con 0x7f5fa815bdc0 2024-09-11T22:23:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.273+0000 7f5faf168640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa815feb0 con 0x7f5fa80b6d90 2024-09-11T22:23:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.273+0000 7f5faf168640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa806d490 con 0x7f5fa806bb50 2024-09-11T22:23:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.273+0000 7f5fad705640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa815bdc0 0x7f5fa814db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.273+0000 7f5fad705640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa815bdc0 0x7f5fa814db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49288/0 (socket says 172.21.15.50:49288) 2024-09-11T22:23:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.273+0000 7f5fad705640 1 -- 172.21.15.50:0/2320580620 learned_addr learned my addr 172.21.15.50:0/2320580620 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.273+0000 7f5facf04640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa806bb50 0x7f5fa806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.273+0000 7f5fa7fff640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fa80b6d90 0x7f5fa815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.274+0000 7f5fad705640 1 -- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa806bb50 msgr2=0x7f5fa806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.274+0000 7f5fad705640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa806bb50 0x7f5fa806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.274+0000 7f5fad705640 1 -- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fa80b6d90 msgr2=0x7f5fa815b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.274+0000 7f5fad705640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fa80b6d90 0x7f5fa815b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.274+0000 7f5fad705640 1 -- 172.21.15.50:0/2320580620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa80cb7a0 con 0x7f5fa815bdc0 2024-09-11T22:23:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.274+0000 7f5fad705640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa815bdc0 0x7f5fa814db30 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000b970 tx=0x7f5fa000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.274+0000 7f5fa57fa640 1 -- 172.21.15.50:0/2320580620 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0019070 con 0x7f5fa815bdc0 2024-09-11T22:23:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.274+0000 7f5fa57fa640 1 -- 172.21.15.50:0/2320580620 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa000cb60 con 0x7f5fa815bdc0 2024-09-11T22:23:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.274+0000 7f5faf168640 1 -- 172.21.15.50:0/2320580620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa80cba80 con 0x7f5fa815bdc0 2024-09-11T22:23:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.274+0000 7f5fa57fa640 1 -- 172.21.15.50:0/2320580620 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0014440 con 0x7f5fa815bdc0 2024-09-11T22:23:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.274+0000 7f5faf168640 1 -- 172.21.15.50:0/2320580620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa80cc320 con 0x7f5fa815bdc0 2024-09-11T22:23:40.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.275+0000 7f5faf168640 1 -- 172.21.15.50:0/2320580620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa80cbc50 con 0x7f5fa815bdc0 2024-09-11T22:23:40.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.276+0000 7f5fa57fa640 1 -- 172.21.15.50:0/2320580620 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5fa001c070 con 0x7f5fa815bdc0 2024-09-11T22:23:40.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.276+0000 7f5fa57fa640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5f8c06be30 0x7f5f8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.276+0000 7f5fa57fa640 1 -- 172.21.15.50:0/2320580620 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f5fa008ab20 con 0x7f5fa815bdc0 2024-09-11T22:23:40.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.276+0000 7f5facf04640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5f8c06be30 0x7f5f8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.277+0000 7f5facf04640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5f8c06be30 0x7f5f8c06e2f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c034000 tx=0x7f5f9c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.280+0000 7f5fa57fa640 1 -- 172.21.15.50:0/2320580620 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5fa0058e80 con 0x7f5fa815bdc0 2024-09-11T22:23:40.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.494+0000 7f5faf168640 1 -- 172.21.15.50:0/2320580620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fa80693f0 con 0x7f5fa815bdc0 2024-09-11T22:23:40.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.495+0000 7f5fa57fa640 1 -- 172.21.15.50:0/2320580620 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) ==== 95+0+5232 (secure 0 0 0) 0x7f5fa80693f0 con 0x7f5fa815bdc0 2024-09-11T22:23:40.496 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:23:40.496 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":137,"btime":"2024-09-11T22:23:31:534171+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8441,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/15411963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":15411963},{"type":"v1","addr":"172.21.15.50:6833","nonce":15411963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":8450,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1953468151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1953468151},{"type":"v1","addr":"172.21.15.77:6836","nonce":1953468151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":8453,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3577421742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3577421742},{"type":"v1","addr":"172.21.15.77:6837","nonce":3577421742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134}],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:23:28.886790+0000","modified":"2024-09-11T22:23:30.878557+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10734":{"gid":10734,"name":"c","rank":0,"incarnation":135,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2876091212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2876091212},{"type":"v1","addr":"172.21.15.50:6835","nonce":2876091212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10734,"qdb_cluster":[10734]},"id":14}]} 2024-09-11T22:23:40.496 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 137 2024-09-11T22:23:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.497+0000 7f5faf168640 1 -- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5f8c06be30 msgr2=0x7f5f8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.497+0000 7f5faf168640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5f8c06be30 0x7f5f8c06e2f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c034000 tx=0x7f5f9c02e000 comp rx=0 tx=0).stop 2024-09-11T22:23:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.497+0000 7f5faf168640 1 -- 172.21.15.50:0/2320580620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa815bdc0 msgr2=0x7f5fa814db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.497+0000 7f5faf168640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa815bdc0 0x7f5fa814db30 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000b970 tx=0x7f5fa000be30 comp rx=0 tx=0).stop 2024-09-11T22:23:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.497+0000 7f5faf168640 1 -- 172.21.15.50:0/2320580620 shutdown_connections 2024-09-11T22:23:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.497+0000 7f5faf168640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5f8c06be30 0x7f5f8c06e2f0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.497+0000 7f5faf168640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fa815bdc0 0x7f5fa814db30 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.497+0000 7f5faf168640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fa80b6d90 0x7f5fa815b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.497+0000 7f5faf168640 1 --2- 172.21.15.50:0/2320580620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa806bb50 0x7f5fa806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.497+0000 7f5faf168640 1 -- 172.21.15.50:0/2320580620 >> 172.21.15.50:0/2320580620 conn(0x7f5fa80b7940 msgr2=0x7f5fa80b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.497+0000 7f5faf168640 1 -- 172.21.15.50:0/2320580620 shutdown_connections 2024-09-11T22:23:40.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.497+0000 7f5faf168640 1 -- 172.21.15.50:0/2320580620 wait complete. 2024-09-11T22:23:40.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-11T22:23:40.634 INFO:teuthology.orchestra.run.smithi050.stdout:{"message":"","return_code":0} 2024-09-11T22:23:40.634 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-11T22:23:40.634 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent '' 2024-09-11T22:23:40.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.679+0000 7f80af51ef40 1 Processor -- start 2024-09-11T22:23:40.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.679+0000 7f80af51ef40 1 -- start start 2024-09-11T22:23:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.680+0000 7f80af51ef40 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2a3e29b0 0x559f2a3d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.680+0000 7f80af51ef40 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2a3e2d90 0x559f2a3d82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.680+0000 7f80af51ef40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2a3e9f50 0x559f2a3d8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.680+0000 7f80af51ef40 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559f2a25c510 con 0x559f2a3e29b0 2024-09-11T22:23:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.680+0000 7f80af51ef40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559f2a34b020 con 0x559f2a3e9f50 2024-09-11T22:23:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.680+0000 7f80af51ef40 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559f2a354960 con 0x559f2a3e2d90 2024-09-11T22:23:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.680+0000 7f80ac5af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2a3e29b0 0x559f2a3d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.680+0000 7f80ac5af640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2a3e29b0 0x559f2a3d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49306/0 (socket says 172.21.15.50:49306) 2024-09-11T22:23:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.680+0000 7f80ac5af640 1 -- 172.21.15.50:0/3586930708 learned_addr learned my addr 172.21.15.50:0/3586930708 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.680+0000 7f80abdae640 1 --2- 172.21.15.50:0/3586930708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2a3e2d90 0x559f2a3d82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.680+0000 7f80acdb0640 1 --2- 172.21.15.50:0/3586930708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2a3e9f50 0x559f2a3d8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.680+0000 7f80ac5af640 1 -- 172.21.15.50:0/3586930708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2a3e2d90 msgr2=0x559f2a3d82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.680+0000 7f80ac5af640 1 --2- 172.21.15.50:0/3586930708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2a3e2d90 0x559f2a3d82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80ac5af640 1 -- 172.21.15.50:0/3586930708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2a3e9f50 msgr2=0x559f2a3d8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80ac5af640 1 --2- 172.21.15.50:0/3586930708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2a3e9f50 0x559f2a3d8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80ac5af640 1 -- 172.21.15.50:0/3586930708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f2a3d68e0 con 0x559f2a3e29b0 2024-09-11T22:23:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80acdb0640 1 --2- 172.21.15.50:0/3586930708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2a3e9f50 0x559f2a3d8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80ac5af640 1 --2- 172.21.15.50:0/3586930708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2a3e29b0 0x559f2a3d13a0 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f809c001db0 tx=0x7f809c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafb806d3f6efbbc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80aadac640 1 -- 172.21.15.50:0/3586930708 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c00bde0 con 0x559f2a3e29b0 2024-09-11T22:23:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80aadac640 1 -- 172.21.15.50:0/3586930708 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809c00f400 con 0x559f2a3e29b0 2024-09-11T22:23:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80aadac640 1 -- 172.21.15.50:0/3586930708 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c00f7f0 con 0x559f2a3e29b0 2024-09-11T22:23:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80af51ef40 1 -- 172.21.15.50:0/3586930708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2a3e29b0 msgr2=0x559f2a3d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80af51ef40 1 --2- 172.21.15.50:0/3586930708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2a3e29b0 0x559f2a3d13a0 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f809c001db0 tx=0x7f809c00b5b0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80af51ef40 1 -- 172.21.15.50:0/3586930708 shutdown_connections 2024-09-11T22:23:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80af51ef40 1 --2- 172.21.15.50:0/3586930708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2a3e2d90 0x559f2a3d82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80af51ef40 1 --2- 172.21.15.50:0/3586930708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2a3e9f50 0x559f2a3d8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80af51ef40 1 --2- 172.21.15.50:0/3586930708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2a3e29b0 0x559f2a3d13a0 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80af51ef40 1 -- 172.21.15.50:0/3586930708 >> 172.21.15.50:0/3586930708 conn(0x559f2a335610 msgr2=0x559f2a34a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80af51ef40 1 -- 172.21.15.50:0/3586930708 shutdown_connections 2024-09-11T22:23:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.681+0000 7f80af51ef40 1 -- 172.21.15.50:0/3586930708 wait complete. 2024-09-11T22:23:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.682+0000 7f80af51ef40 1 Processor -- start 2024-09-11T22:23:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.682+0000 7f80af51ef40 1 -- start start 2024-09-11T22:23:40.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80af51ef40 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2a3e29b0 0x559f2a3cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80af51ef40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2a3e2d90 0x559f2a3cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80af51ef40 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2a3e9f50 0x559f2a3e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80af51ef40 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559f2a3d6b80 con 0x559f2a3e9f50 2024-09-11T22:23:40.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80af51ef40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559f2a3d8d60 con 0x559f2a3e2d90 2024-09-11T22:23:40.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80af51ef40 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559f2a3543a0 con 0x559f2a3e29b0 2024-09-11T22:23:40.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80acdb0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2a3e9f50 0x559f2a3e0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80acdb0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2a3e9f50 0x559f2a3e0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49320/0 (socket says 172.21.15.50:49320) 2024-09-11T22:23:40.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80acdb0640 1 -- 172.21.15.50:0/3813859480 learned_addr learned my addr 172.21.15.50:0/3813859480 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80ac5af640 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2a3e29b0 0x559f2a3cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80abdae640 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2a3e2d90 0x559f2a3cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80acdb0640 1 -- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2a3e29b0 msgr2=0x559f2a3cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80acdb0640 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f2a3e29b0 0x559f2a3cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80acdb0640 1 -- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2a3e2d90 msgr2=0x559f2a3cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80acdb0640 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f2a3e2d90 0x559f2a3cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80acdb0640 1 -- 172.21.15.50:0/3813859480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f2a3cf6c0 con 0x559f2a3e9f50 2024-09-11T22:23:40.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.683+0000 7f80acdb0640 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2a3e9f50 0x559f2a3e0a20 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f80a4025a90 tx=0x7f80a4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.684+0000 7f80a9daa640 1 -- 172.21.15.50:0/3813859480 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a404fb70 con 0x559f2a3e9f50 2024-09-11T22:23:40.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.684+0000 7f80a9daa640 1 -- 172.21.15.50:0/3813859480 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a404fd10 con 0x559f2a3e9f50 2024-09-11T22:23:40.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.684+0000 7f80a9daa640 1 -- 172.21.15.50:0/3813859480 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4062600 con 0x559f2a3e9f50 2024-09-11T22:23:40.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.684+0000 7f80af51ef40 1 -- 172.21.15.50:0/3813859480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f2a355440 con 0x559f2a3e9f50 2024-09-11T22:23:40.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.684+0000 7f80af51ef40 1 -- 172.21.15.50:0/3813859480 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f2a3dfad0 con 0x559f2a3e9f50 2024-09-11T22:23:40.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.685+0000 7f80a9daa640 1 -- 172.21.15.50:0/3813859480 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80a40627a0 con 0x559f2a3e9f50 2024-09-11T22:23:40.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.685+0000 7f80a9daa640 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f809806a810 0x7f809806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.685+0000 7f80a9daa640 1 -- 172.21.15.50:0/3813859480 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f80a40cd5b0 con 0x559f2a3e9f50 2024-09-11T22:23:40.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.686+0000 7f80ac5af640 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f809806a810 0x7f809806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.686+0000 7f80af51ef40 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x559f2a3dc390 0x559f2a479910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.686+0000 7f80af51ef40 1 -- 172.21.15.50:0/3813859480 --> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] -- osd_op(unknown.0.0:1 29.7 29:e2e07930:::10000000001.00000000:head [setxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e189) -- 0x559f2a352a20 con 0x559f2a3dc390 2024-09-11T22:23:40.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.686+0000 7f80abdae640 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x559f2a3dc390 0x559f2a479910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.686+0000 7f80ac5af640 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f809806a810 0x7f809806ccd0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f809c00b5f0 tx=0x7f809c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.686+0000 7f80abdae640 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x559f2a3dc390 0x559f2a479910 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.687+0000 7f80abdae640 1 -- 172.21.15.50:0/3813859480 <== osd.6 v2:172.21.15.77:6808/2920422022 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr] v189'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f80a0009b10 con 0x559f2a3dc390 2024-09-11T22:23:40.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.687+0000 7f80af51ef40 1 -- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x559f2a3dc390 msgr2=0x559f2a479910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.687+0000 7f80af51ef40 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x559f2a3dc390 0x559f2a479910 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.687+0000 7f80af51ef40 1 -- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f809806a810 msgr2=0x7f809806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.687+0000 7f80af51ef40 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f809806a810 0x7f809806ccd0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f809c00b5f0 tx=0x7f809c009000 comp rx=0 tx=0).stop 2024-09-11T22:23:40.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.687+0000 7f80af51ef40 1 -- 172.21.15.50:0/3813859480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2a3e9f50 msgr2=0x559f2a3e0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.687+0000 7f80af51ef40 1 --2- 172.21.15.50:0/3813859480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559f2a3e9f50 0x559f2a3e0a20 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f80a4025a90 tx=0x7f80a4003330 comp rx=0 tx=0).stop 2024-09-11T22:23:40.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.687+0000 7f80acdb0640 1 -- 172.21.15.50:0/3813859480 reap_dead start 2024-09-11T22:23:40.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.687+0000 7f80af51ef40 1 -- 172.21.15.50:0/3813859480 shutdown_connections 2024-09-11T22:23:40.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.687+0000 7f80af51ef40 1 -- 172.21.15.50:0/3813859480 >> 172.21.15.50:0/3813859480 conn(0x559f2a335610 msgr2=0x559f2a34a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.687+0000 7f80af51ef40 1 -- 172.21.15.50:0/3813859480 shutdown_connections 2024-09-11T22:23:40.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.687+0000 7f80af51ef40 1 -- 172.21.15.50:0/3813859480 wait complete. 2024-09-11T22:23:40.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:40.693 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub start / recursive,repair 2024-09-11T22:23:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.798+0000 7fa6685c4640 1 Processor -- start 2024-09-11T22:23:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.798+0000 7fa6685c4640 1 -- start start 2024-09-11T22:23:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.799+0000 7fa6685c4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa66015e8e0 0x7fa6600b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.799+0000 7fa6685c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa660162350 0x7fa6601627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.799+0000 7fa6685c4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa660163080 con 0x7fa6600d1580 2024-09-11T22:23:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.799+0000 7fa6685c4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa66015ecc0 con 0x7fa66015e8e0 2024-09-11T22:23:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.799+0000 7fa6685c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa6600d2ad0 con 0x7fa660162350 2024-09-11T22:23:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.799+0000 7fa665b5f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa6600d1580 0x7fa6600d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38582/0 (socket says 172.21.15.50:38582) 2024-09-11T22:23:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.799+0000 7fa665b5f640 1 -- 172.21.15.50:0/190733086 learned_addr learned my addr 172.21.15.50:0/190733086 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.799+0000 7fa666360640 1 --2- 172.21.15.50:0/190733086 >> v2:172.21.15.77:3300/0 conn(0x7fa66015e8e0 0x7fa6600b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.799+0000 7fa666b61640 1 --2- 172.21.15.50:0/190733086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa660162350 0x7fa6601627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.800+0000 7fa66535e640 1 -- 172.21.15.50:0/190733086 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2581171597 0 0) 0x7fa660163080 con 0x7fa6600d1580 2024-09-11T22:23:40.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.800+0000 7fa66535e640 1 -- 172.21.15.50:0/190733086 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa648003520 con 0x7fa6600d1580 2024-09-11T22:23:40.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.800+0000 7fa666b61640 1 -- 172.21.15.50:0/190733086 >> v2:172.21.15.77:3300/0 conn(0x7fa66015e8e0 msgr2=0x7fa6600b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.800+0000 7fa666b61640 1 --2- 172.21.15.50:0/190733086 >> v2:172.21.15.77:3300/0 conn(0x7fa66015e8e0 0x7fa6600b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.800+0000 7fa666b61640 1 -- 172.21.15.50:0/190733086 >> v1:172.21.15.50:6789/0 conn(0x7fa6600d1580 legacy=0x7fa6600d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.800+0000 7fa666b61640 1 -- 172.21.15.50:0/190733086 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6600d2d20 con 0x7fa660162350 2024-09-11T22:23:40.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.800+0000 7fa666360640 1 --2- 172.21.15.50:0/190733086 >> v2:172.21.15.77:3300/0 conn(0x7fa66015e8e0 0x7fa6600b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:40.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.801+0000 7fa666b61640 1 --2- 172.21.15.50:0/190733086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa660162350 0x7fa6601627e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa6580097a0 tx=0x7fa65802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbcb53b3d49f2272 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.801+0000 7fa66535e640 1 -- 172.21.15.50:0/190733086 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa658037070 con 0x7fa660162350 2024-09-11T22:23:40.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.801+0000 7fa66535e640 1 -- 172.21.15.50:0/190733086 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa658032440 con 0x7fa660162350 2024-09-11T22:23:40.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.801+0000 7fa66535e640 1 -- 172.21.15.50:0/190733086 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa658032810 con 0x7fa660162350 2024-09-11T22:23:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.801+0000 7fa6685c4640 1 -- 172.21.15.50:0/190733086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa660162350 msgr2=0x7fa6601627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.801+0000 7fa6685c4640 1 --2- 172.21.15.50:0/190733086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa660162350 0x7fa6601627e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa6580097a0 tx=0x7fa65802a210 comp rx=0 tx=0).stop 2024-09-11T22:23:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.801+0000 7fa6685c4640 1 -- 172.21.15.50:0/190733086 shutdown_connections 2024-09-11T22:23:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.801+0000 7fa6685c4640 1 --2- 172.21.15.50:0/190733086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa660162350 0x7fa6601627e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.801+0000 7fa6685c4640 1 --2- 172.21.15.50:0/190733086 >> v2:172.21.15.77:3300/0 conn(0x7fa66015e8e0 0x7fa6600b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.801+0000 7fa6685c4640 1 -- 172.21.15.50:0/190733086 >> 172.21.15.50:0/190733086 conn(0x7fa660067ba0 msgr2=0x7fa660067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.801+0000 7fa6685c4640 1 -- 172.21.15.50:0/190733086 shutdown_connections 2024-09-11T22:23:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.801+0000 7fa6685c4640 1 -- 172.21.15.50:0/190733086 wait complete. 2024-09-11T22:23:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.803+0000 7fa6685c4640 1 Processor -- start 2024-09-11T22:23:40.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.803+0000 7fa6685c4640 1 -- start start 2024-09-11T22:23:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.803+0000 7fa6685c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6600d1580 0x7fa66015cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.803+0000 7fa6685c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66015e8e0 0x7fa6600ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.803+0000 7fa6685c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660162350 0x7fa66015d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.803+0000 7fa6685c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa660162d20 con 0x7fa660162350 2024-09-11T22:23:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.803+0000 7fa6685c4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6600d3370 con 0x7fa66015e8e0 2024-09-11T22:23:40.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.803+0000 7fa6685c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa6600d3800 con 0x7fa6600d1580 2024-09-11T22:23:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa666b61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660162350 0x7fa66015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa666b61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660162350 0x7fa66015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49336/0 (socket says 172.21.15.50:49336) 2024-09-11T22:23:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa666b61640 1 -- 172.21.15.50:0/691078430 learned_addr learned my addr 172.21.15.50:0/691078430 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa665b5f640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66015e8e0 0x7fa6600ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa666360640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6600d1580 0x7fa66015cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa666b61640 1 -- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6600d1580 msgr2=0x7fa66015cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa666b61640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6600d1580 0x7fa66015cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa666b61640 1 -- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66015e8e0 msgr2=0x7fa6600ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa666b61640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66015e8e0 0x7fa6600ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa666b61640 1 -- 172.21.15.50:0/691078430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66015bfd0 con 0x7fa660162350 2024-09-11T22:23:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa666b61640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660162350 0x7fa66015d960 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fa658035040 tx=0x7fa6580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa65effd640 1 -- 172.21.15.50:0/691078430 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa658037040 con 0x7fa660162350 2024-09-11T22:23:40.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa65effd640 1 -- 172.21.15.50:0/691078430 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65803b430 con 0x7fa660162350 2024-09-11T22:23:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa6685c4640 1 -- 172.21.15.50:0/691078430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66015c2b0 con 0x7fa660162350 2024-09-11T22:23:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa65effd640 1 -- 172.21.15.50:0/691078430 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65803b800 con 0x7fa660162350 2024-09-11T22:23:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.804+0000 7fa6685c4640 1 -- 172.21.15.50:0/691078430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66015c870 con 0x7fa660162350 2024-09-11T22:23:40.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.806+0000 7fa65effd640 1 -- 172.21.15.50:0/691078430 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa658044020 con 0x7fa660162350 2024-09-11T22:23:40.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.806+0000 7fa65effd640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa64c06be30 0x7fa64c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.806+0000 7fa65effd640 1 -- 172.21.15.50:0/691078430 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7fa6580ab0d0 con 0x7fa660162350 2024-09-11T22:23:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.807+0000 7fa666360640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa64c06be30 0x7fa64c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.807+0000 7fa666360640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa64c06be30 0x7fa64c06e2f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa650009bd0 tx=0x7fa65000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.807+0000 7fa66b438740 1 Processor -- start 2024-09-11T22:23:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.808+0000 7fa66b438740 1 -- start start 2024-09-11T22:23:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.808+0000 7fa66b438740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc12ab690 0x55ecc12aba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.808+0000 7fa66b438740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a8e50 0x55ecc12aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.808+0000 7fa66b438740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12a92b0 0x55ecc128b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.808+0000 7fa66b438740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ecc1227000 con 0x55ecc12a8e50 2024-09-11T22:23:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.808+0000 7fa66b438740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ecc11c79f0 con 0x55ecc12a92b0 2024-09-11T22:23:40.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.808+0000 7fa66b438740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ecc116f7c0 con 0x55ecc12ab690 2024-09-11T22:23:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.808+0000 7fa666360640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc12ab690 0x55ecc12aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.808+0000 7fa665b5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a8e50 0x55ecc12aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.808+0000 7fa666360640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc12ab690 0x55ecc12aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:49652/0 (socket says 172.21.15.50:49652) 2024-09-11T22:23:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.809+0000 7fa666b61640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12a92b0 0x55ecc128b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.809+0000 7fa666360640 1 -- 172.21.15.50:0/3423544908 learned_addr learned my addr 172.21.15.50:0/3423544908 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.809+0000 7fa665b5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a8e50 0x55ecc12aa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49352/0 (socket says 172.21.15.50:49352) 2024-09-11T22:23:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.809+0000 7fa666360640 1 -- 172.21.15.50:0/3423544908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12a92b0 msgr2=0x55ecc128b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.809+0000 7fa666360640 1 --2- 172.21.15.50:0/3423544908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12a92b0 0x55ecc128b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.809+0000 7fa666360640 1 -- 172.21.15.50:0/3423544908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a8e50 msgr2=0x55ecc12aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.809+0000 7fa666360640 1 --2- 172.21.15.50:0/3423544908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a8e50 0x55ecc12aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.809+0000 7fa666360640 1 -- 172.21.15.50:0/3423544908 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc0ebe470 con 0x55ecc12ab690 2024-09-11T22:23:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.809+0000 7fa665b5f640 1 --2- 172.21.15.50:0/3423544908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a8e50 0x55ecc12aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:40.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.809+0000 7fa666360640 1 --2- 172.21.15.50:0/3423544908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc12ab690 0x55ecc12aba70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa650009ba0 tx=0x7fa650014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac13a3e04a8bbc72 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.809+0000 7fa647fff640 1 -- 172.21.15.50:0/3423544908 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65001d050 con 0x55ecc12ab690 2024-09-11T22:23:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.809+0000 7fa647fff640 1 -- 172.21.15.50:0/3423544908 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa650027070 con 0x55ecc12ab690 2024-09-11T22:23:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.809+0000 7fa647fff640 1 -- 172.21.15.50:0/3423544908 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650017d90 con 0x55ecc12ab690 2024-09-11T22:23:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.810+0000 7fa66b438740 1 -- 172.21.15.50:0/3423544908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc12ab690 msgr2=0x55ecc12aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.810+0000 7fa66b438740 1 --2- 172.21.15.50:0/3423544908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc12ab690 0x55ecc12aba70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa650009ba0 tx=0x7fa650014000 comp rx=0 tx=0).stop 2024-09-11T22:23:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.810+0000 7fa66b438740 1 -- 172.21.15.50:0/3423544908 shutdown_connections 2024-09-11T22:23:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.810+0000 7fa66b438740 1 --2- 172.21.15.50:0/3423544908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12a92b0 0x55ecc128b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.810+0000 7fa66b438740 1 --2- 172.21.15.50:0/3423544908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a8e50 0x55ecc12aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.810+0000 7fa66b438740 1 --2- 172.21.15.50:0/3423544908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc12ab690 0x55ecc12aba70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.810+0000 7fa66b438740 1 -- 172.21.15.50:0/3423544908 >> 172.21.15.50:0/3423544908 conn(0x55ecc1261580 msgr2=0x55ecc12a9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.810+0000 7fa66b438740 1 -- 172.21.15.50:0/3423544908 shutdown_connections 2024-09-11T22:23:40.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.810+0000 7fa66b438740 1 -- 172.21.15.50:0/3423544908 wait complete. 2024-09-11T22:23:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.811+0000 7fa66b438740 1 -- start start 2024-09-11T22:23:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.811+0000 7fa66b438740 1 Processor -- start 2024-09-11T22:23:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.811+0000 7fa66b438740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc12a92b0 0x55ecc12a6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa66b438740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 0x55ecc128a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa66b438740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc128d990 0x55ecc128e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa66b438740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ecc1150680 con 0x55ecc128d990 2024-09-11T22:23:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa66b438740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ecc11c39b0 con 0x55ecc12ab690 2024-09-11T22:23:40.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa66b438740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ecc12a7db0 con 0x55ecc12a92b0 2024-09-11T22:23:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa66b438740 10 client.0 _ll_register_callbacks cb 0x55ecc0ed9c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:23:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa666b61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc128d990 0x55ecc128e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa666b61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc128d990 0x55ecc128e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49368/0 (socket says 172.21.15.50:49368) 2024-09-11T22:23:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa666b61640 1 -- 172.21.15.50:0/4180821768 learned_addr learned my addr 172.21.15.50:0/4180821768 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa665b5f640 1 --2- 172.21.15.50:0/4180821768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 0x55ecc128a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa666360640 1 --2- 172.21.15.50:0/4180821768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc12a92b0 0x55ecc12a6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa666b61640 1 -- 172.21.15.50:0/4180821768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc12a92b0 msgr2=0x55ecc12a6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa666b61640 1 --2- 172.21.15.50:0/4180821768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc12a92b0 0x55ecc12a6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa666b61640 1 -- 172.21.15.50:0/4180821768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 msgr2=0x55ecc128a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa666b61640 1 --2- 172.21.15.50:0/4180821768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 0x55ecc128a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa666b61640 1 -- 172.21.15.50:0/4180821768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc0fa27e0 con 0x55ecc128d990 2024-09-11T22:23:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa666b61640 1 --2- 172.21.15.50:0/4180821768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc128d990 0x55ecc128e800 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fa6580a9620 tx=0x7fa658079b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c581687c519258 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa6457fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa6457fa640 1 -- 172.21.15.50:0/4180821768 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6580913b0 con 0x55ecc128d990 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa66b438740 1 -- 172.21.15.50:0/4180821768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa650027070 con 0x55ecc128d990 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa6457fa640 1 -- 172.21.15.50:0/4180821768 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7fa658081ad0 con 0x55ecc128d990 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa6457fa640 1 -- 172.21.15.50:0/4180821768 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) ==== 24+0+0 (secure 0 0 0) 0x7fa6580a7050 con 0x55ecc128d990 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa66b438740 10 client.10938 fetch_fsmap learned FSMap version 137 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.812+0000 7fa66b438740 1 -- 172.21.15.50:0/4180821768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) -- 0x55ecc1002f70 con 0x55ecc128d990 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.813+0000 7fa6457fa640 1 -- 172.21.15.50:0/4180821768 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa650027070 con 0x55ecc128d990 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.813+0000 7fa6457fa640 1 -- 172.21.15.50:0/4180821768 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 137) ==== 3502+0+0 (secure 0 0 0) 0x7fa65803a070 con 0x55ecc128d990 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.813+0000 7fa66b438740 10 client.10938 fetch_fsmap finished waiting for FSMap version 137 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.813+0000 7fa66b438740 10 client.10938 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.813+0000 7fa66b438740 20 client.10938 populate_metadata read hostname 'smithi050' 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.813+0000 7fa66b438740 1 --2- 172.21.15.50:0/4180821768 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ecc128c6e0 0x55ecc128cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.813+0000 7fa66b438740 4 client.10938 mds_command: new command op to 10734 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.813+0000 7fa66b438740 1 -- 172.21.15.50:0/4180821768 --> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecc11d5120 con 0x55ecc128c6e0 2024-09-11T22:23:40.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.813+0000 7fa666360640 1 --2- 172.21.15.50:0/4180821768 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ecc128c6e0 0x55ecc128cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.813+0000 7fa666360640 1 --2- 172.21.15.50:0/4180821768 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ecc128c6e0 0x55ecc128cac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d404bae13502d3a7 server_cookie=313969a31ba7a7e8 in_seq=0 out_seq=0 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.813+0000 7fa6457fa640 10 client.10938 ms_handle_connect on v2:172.21.15.50:6834/2876091212 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa6457fa640 1 -- 172.21.15.50:0/4180821768 <== mds.0 v2:172.21.15.50:6834/2876091212 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ecc11d5120 con 0x55ecc128c6e0 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa6457fa640 10 client.10938 handle_command_reply: tid=0 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa66b438740 1 client.10938 shutdown 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa66b438740 1 -- 172.21.15.50:0/4180821768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc128d990 msgr2=0x55ecc128e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa66b438740 1 --2- 172.21.15.50:0/4180821768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc128d990 0x55ecc128e800 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fa6580a9620 tx=0x7fa658079b40 comp rx=0 tx=0).stop 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa66b438740 1 -- 172.21.15.50:0/4180821768 shutdown_connections 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa66b438740 1 --2- 172.21.15.50:0/4180821768 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ecc128c6e0 0x55ecc128cac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa66b438740 1 --2- 172.21.15.50:0/4180821768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc128d990 0x55ecc128e800 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa6457fa640 0 client.10938 ms_handle_reset on v2:172.21.15.50:6834/2876091212 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa66b438740 1 --2- 172.21.15.50:0/4180821768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 0x55ecc128a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa66b438740 1 --2- 172.21.15.50:0/4180821768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc12a92b0 0x55ecc12a6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa66b438740 1 -- 172.21.15.50:0/4180821768 >> 172.21.15.50:0/4180821768 conn(0x55ecc12a8e50 msgr2=0x55ecc12acc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa66b438740 1 -- 172.21.15.50:0/4180821768 shutdown_connections 2024-09-11T22:23:40.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa66b438740 1 -- 172.21.15.50:0/4180821768 wait complete. 2024-09-11T22:23:40.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.814+0000 7fa66b438740 20 client.10938 trim_cache size 0 max 16384 2024-09-11T22:23:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.832+0000 7fa66b438740 1 Processor -- start 2024-09-11T22:23:40.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.832+0000 7fa66b438740 1 -- start start 2024-09-11T22:23:40.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.832+0000 7fa66b438740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc128d990 0x55ecc12a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.832+0000 7fa66b438740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 0x55ecc128cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.832+0000 7fa66b438740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 0x55ecc12a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.832+0000 7fa66b438740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa660200940 con 0x55ecc12a92b0 2024-09-11T22:23:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.832+0000 7fa66b438740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6601ffa70 con 0x55ecc12ab690 2024-09-11T22:23:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.832+0000 7fa66b438740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa6601f7a90 con 0x55ecc128d990 2024-09-11T22:23:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.832+0000 7fa665b5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 0x55ecc128cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.833+0000 7fa665b5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 0x55ecc128cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49376/0 (socket says 172.21.15.50:49376) 2024-09-11T22:23:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.833+0000 7fa665b5f640 1 -- 172.21.15.50:0/2157804210 learned_addr learned my addr 172.21.15.50:0/2157804210 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.833+0000 7fa666360640 1 --2- 172.21.15.50:0/2157804210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc128d990 0x55ecc12a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.833+0000 7fa666b61640 1 --2- 172.21.15.50:0/2157804210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 0x55ecc12a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.833+0000 7fa665b5f640 1 -- 172.21.15.50:0/2157804210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc128d990 msgr2=0x55ecc12a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.833+0000 7fa665b5f640 1 --2- 172.21.15.50:0/2157804210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc128d990 0x55ecc12a7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.833+0000 7fa665b5f640 1 -- 172.21.15.50:0/2157804210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 msgr2=0x55ecc12a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.833+0000 7fa665b5f640 1 --2- 172.21.15.50:0/2157804210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 0x55ecc12a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.833+0000 7fa665b5f640 1 -- 172.21.15.50:0/2157804210 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc0e9a170 con 0x55ecc12a92b0 2024-09-11T22:23:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.833+0000 7fa665b5f640 1 --2- 172.21.15.50:0/2157804210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 0x55ecc128cd60 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fa654005c50 tx=0x7fa654009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4e3a4fa07541d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.833+0000 7fa6477fe640 1 -- 172.21.15.50:0/2157804210 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654005e60 con 0x55ecc12a92b0 2024-09-11T22:23:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.833+0000 7fa6477fe640 1 -- 172.21.15.50:0/2157804210 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6540018b0 con 0x55ecc12a92b0 2024-09-11T22:23:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.833+0000 7fa6477fe640 1 -- 172.21.15.50:0/2157804210 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654001c60 con 0x55ecc12a92b0 2024-09-11T22:23:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.834+0000 7fa66b438740 1 -- 172.21.15.50:0/2157804210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 msgr2=0x55ecc128cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.834+0000 7fa66b438740 1 --2- 172.21.15.50:0/2157804210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 0x55ecc128cd60 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fa654005c50 tx=0x7fa654009040 comp rx=0 tx=0).stop 2024-09-11T22:23:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.834+0000 7fa66b438740 1 -- 172.21.15.50:0/2157804210 shutdown_connections 2024-09-11T22:23:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.834+0000 7fa66b438740 1 --2- 172.21.15.50:0/2157804210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 0x55ecc12a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.834+0000 7fa66b438740 1 --2- 172.21.15.50:0/2157804210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 0x55ecc128cd60 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.834+0000 7fa66b438740 1 --2- 172.21.15.50:0/2157804210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc128d990 0x55ecc12a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.834+0000 7fa66b438740 1 -- 172.21.15.50:0/2157804210 >> 172.21.15.50:0/2157804210 conn(0x55ecc12a8e50 msgr2=0x55ecc125aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.834+0000 7fa66b438740 1 -- 172.21.15.50:0/2157804210 shutdown_connections 2024-09-11T22:23:40.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.834+0000 7fa66b438740 1 -- 172.21.15.50:0/2157804210 wait complete. 2024-09-11T22:23:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.834+0000 7fa66b438740 1 -- start start 2024-09-11T22:23:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.834+0000 7fa66b438740 1 Processor -- start 2024-09-11T22:23:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.835+0000 7fa66b438740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc128d990 0x55ecc129f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.835+0000 7fa66b438740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 0x55ecc1260890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.835+0000 7fa66b438740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 0x55ecc1325e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.835+0000 7fa66b438740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ecc12a4e80 con 0x55ecc12a92b0 2024-09-11T22:23:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.835+0000 7fa66b438740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6601f80e0 con 0x55ecc12ab690 2024-09-11T22:23:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.835+0000 7fa66b438740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ecc12a5f60 con 0x55ecc128d990 2024-09-11T22:23:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.835+0000 7fa66b438740 10 client.0 _ll_register_callbacks cb 0x7fa6580791e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:23:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.835+0000 7fa665b5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 0x55ecc1260890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.835+0000 7fa666b61640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 0x55ecc1325e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.835+0000 7fa666360640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc128d990 0x55ecc129f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.835+0000 7fa665b5f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 0x55ecc1260890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49384/0 (socket says 172.21.15.50:49384) 2024-09-11T22:23:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.835+0000 7fa665b5f640 1 -- 172.21.15.50:0/1615712220 learned_addr learned my addr 172.21.15.50:0/1615712220 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa665b5f640 1 -- 172.21.15.50:0/1615712220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc128d990 msgr2=0x55ecc129f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa665b5f640 1 --2- 172.21.15.50:0/1615712220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc128d990 0x55ecc129f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa665b5f640 1 -- 172.21.15.50:0/1615712220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 msgr2=0x55ecc1325e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa665b5f640 1 --2- 172.21.15.50:0/1615712220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 0x55ecc1325e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa665b5f640 1 -- 172.21.15.50:0/1615712220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc129fba0 con 0x55ecc12a92b0 2024-09-11T22:23:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa665b5f640 1 --2- 172.21.15.50:0/1615712220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 0x55ecc1260890 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7fa65401a6d0 tx=0x7fa6540010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a25b4da3a8c8ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa6457fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:23:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa6457fa640 1 -- 172.21.15.50:0/1615712220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65402a060 con 0x55ecc12a92b0 2024-09-11T22:23:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa6457fa640 1 -- 172.21.15.50:0/1615712220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7fa654025b00 con 0x55ecc12a92b0 2024-09-11T22:23:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa66b438740 1 -- 172.21.15.50:0/1615712220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6540018b0 con 0x55ecc12a92b0 2024-09-11T22:23:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa6457fa640 1 -- 172.21.15.50:0/1615712220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) ==== 24+0+0 (secure 0 0 0) 0x7fa654025d00 con 0x55ecc12a92b0 2024-09-11T22:23:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa66b438740 10 client.10944 fetch_fsmap learned FSMap version 137 2024-09-11T22:23:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa66b438740 1 -- 172.21.15.50:0/1615712220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) -- 0x55ecc1260dd0 con 0x55ecc12a92b0 2024-09-11T22:23:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.836+0000 7fa6457fa640 1 -- 172.21.15.50:0/1615712220 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6540018b0 con 0x55ecc12a92b0 2024-09-11T22:23:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.837+0000 7fa6457fa640 1 -- 172.21.15.50:0/1615712220 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 137) ==== 3502+0+0 (secure 0 0 0) 0x7fa65401aac0 con 0x55ecc12a92b0 2024-09-11T22:23:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.837+0000 7fa66b438740 10 client.10944 fetch_fsmap finished waiting for FSMap version 137 2024-09-11T22:23:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.837+0000 7fa66b438740 10 client.10944 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-11T22:23:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.837+0000 7fa66b438740 20 client.10944 populate_metadata read hostname 'smithi050' 2024-09-11T22:23:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.837+0000 7fa66b438740 1 --2- 172.21.15.50:0/1615712220 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ecc1326450 0x55ecc1329fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.837+0000 7fa66b438740 4 client.10944 mds_command: new command op to 10734 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-11T22:23:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.837+0000 7fa66b438740 1 -- 172.21.15.50:0/1615712220 --> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x55ecc11cf470 con 0x55ecc1326450 2024-09-11T22:23:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.837+0000 7fa666360640 1 --2- 172.21.15.50:0/1615712220 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ecc1326450 0x55ecc1329fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.837+0000 7fa6457fa640 10 client.10944 ms_handle_connect on v2:172.21.15.50:6834/2876091212 2024-09-11T22:23:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.837+0000 7fa666360640 1 --2- 172.21.15.50:0/1615712220 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ecc1326450 0x55ecc1329fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ea4fffa2ab14a20 server_cookie=f6126dc58f839a22 in_seq=0 out_seq=0 2024-09-11T22:23:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa6457fa640 1 -- 172.21.15.50:0/1615712220 <== mds.0 v2:172.21.15.50:6834/2876091212 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ecc11cf470 con 0x55ecc1326450 2024-09-11T22:23:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa6457fa640 10 client.10944 handle_command_reply: tid=0 2024-09-11T22:23:40.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa66b438740 1 client.10944 shutdown 2024-09-11T22:23:40.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa66b438740 1 -- 172.21.15.50:0/1615712220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 msgr2=0x55ecc1260890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa66b438740 1 --2- 172.21.15.50:0/1615712220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 0x55ecc1260890 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7fa65401a6d0 tx=0x7fa6540010a0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa66b438740 1 -- 172.21.15.50:0/1615712220 shutdown_connections 2024-09-11T22:23:40.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa66b438740 1 --2- 172.21.15.50:0/1615712220 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ecc1326450 0x55ecc1329fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.843 INFO:tasks.ceph.mds.c.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fd41a5e4640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-09-11T22:23:39.814636+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={9700=0-12582912@1} caps={9700=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=9700 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55fc2e7d6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(29)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-11T22:23:40.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa66b438740 1 --2- 172.21.15.50:0/1615712220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ecc12ab690 0x55ecc1325e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa66b438740 1 --2- 172.21.15.50:0/1615712220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecc12a92b0 0x55ecc1260890 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa66b438740 1 --2- 172.21.15.50:0/1615712220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ecc128d990 0x55ecc129f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa66b438740 1 -- 172.21.15.50:0/1615712220 >> 172.21.15.50:0/1615712220 conn(0x55ecc12a8e50 msgr2=0x55ecc12648a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa6457fa640 0 client.10944 ms_handle_reset on v2:172.21.15.50:6834/2876091212 2024-09-11T22:23:40.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa66b438740 1 -- 172.21.15.50:0/1615712220 shutdown_connections 2024-09-11T22:23:40.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa66b438740 1 -- 172.21.15.50:0/1615712220 wait complete. 2024-09-11T22:23:40.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.838+0000 7fa66b438740 20 client.10944 trim_cache size 0 max 16384 2024-09-11T22:23:40.845 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:23:40.845 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-11T22:23:40.845 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "b78caa8f-a57a-4896-a62f-2966fb47f29c", 2024-09-11T22:23:40.845 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-11T22:23:40.845 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:23:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.839+0000 7fa6685c4640 1 -- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa64c06be30 msgr2=0x7fa64c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.839+0000 7fa6685c4640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa64c06be30 0x7fa64c06e2f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa650009bd0 tx=0x7fa65000b040 comp rx=0 tx=0).stop 2024-09-11T22:23:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.839+0000 7fa6685c4640 1 -- 172.21.15.50:0/691078430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660162350 msgr2=0x7fa66015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.839+0000 7fa6685c4640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660162350 0x7fa66015d960 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fa658035040 tx=0x7fa6580046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.839+0000 7fa6685c4640 1 -- 172.21.15.50:0/691078430 shutdown_connections 2024-09-11T22:23:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.839+0000 7fa6685c4640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fa64c06be30 0x7fa64c06e2f0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.839+0000 7fa6685c4640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa660162350 0x7fa66015d960 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.839+0000 7fa6685c4640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa66015e8e0 0x7fa6600ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.839+0000 7fa6685c4640 1 --2- 172.21.15.50:0/691078430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6600d1580 0x7fa66015cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.839+0000 7fa6685c4640 1 -- 172.21.15.50:0/691078430 >> 172.21.15.50:0/691078430 conn(0x7fa660067ba0 msgr2=0x7fa66015fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.839+0000 7fa6685c4640 1 -- 172.21.15.50:0/691078430 shutdown_connections 2024-09-11T22:23:40.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.839+0000 7fa6685c4640 1 -- 172.21.15.50:0/691078430 wait complete. 2024-09-11T22:23:40.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:23:40.851 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-11T22:23:40.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.954+0000 7f0b6a247640 1 Processor -- start 2024-09-11T22:23:40.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.955+0000 7f0b6a247640 1 -- start start 2024-09-11T22:23:40.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.955+0000 7f0b6a247640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b6415e9b0 0x7f0b6415f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.955+0000 7f0b6a247640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b640b5fd0 con 0x7f0b6406bb50 2024-09-11T22:23:40.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.955+0000 7f0b6a247640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b640b62b0 con 0x7f0b640b6d90 2024-09-11T22:23:40.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.955+0000 7f0b6a247640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0b640b6900 con 0x7f0b6415e9b0 2024-09-11T22:23:40.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b62ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0b6406bb50 0x7f0b640af3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38584/0 (socket says 172.21.15.50:38584) 2024-09-11T22:23:40.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b62ffd640 1 -- 172.21.15.50:0/1382678599 learned_addr learned my addr 172.21.15.50:0/1382678599 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b637fe640 1 --2- 172.21.15.50:0/1382678599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b6415e9b0 0x7f0b6415f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012039833 0 0) 0x7f0b640b5fd0 con 0x7f0b6406bb50 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b4c003520 con 0x7f0b6406bb50 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 818141351 0 0) 0x7f0b4c003520 con 0x7f0b6406bb50 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b6415e9b0 msgr2=0x7f0b6415f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 --2- 172.21.15.50:0/1382678599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b6415e9b0 0x7f0b6415f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 >> v1:172.21.15.77:6789/0 conn(0x7f0b640b6d90 legacy=0x7f0b6406c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b640b6590 con 0x7f0b6406bb50 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f0b58001670 con 0x7f0b6406bb50 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 >> v1:172.21.15.50:6789/0 conn(0x7f0b6406bb50 legacy=0x7f0b640af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 --2- 172.21.15.50:0/1382678599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b4c0039e0 0x7f0b4c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 --2- 172.21.15.50:0/1382678599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b4c004390 0x7f0b4c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 --2- 172.21.15.50:0/1382678599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b4c005060 0x7f0b4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b640b6900 con 0x7f0b4c0039e0 2024-09-11T22:23:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c00bf00 con 0x7f0b4c004390 2024-09-11T22:23:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c00c080 con 0x7f0b4c005060 2024-09-11T22:23:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b637fe640 1 --2- 172.21.15.50:0/1382678599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b4c0039e0 0x7f0b4c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/1382678599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b4c004390 0x7f0b4c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.956+0000 7f0b63fff640 1 --2- 172.21.15.50:0/1382678599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b4c005060 0x7f0b4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.957+0000 7f0b637fe640 1 -- 172.21.15.50:0/1382678599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b4c005060 msgr2=0x7f0b4c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.957+0000 7f0b637fe640 1 --2- 172.21.15.50:0/1382678599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b4c005060 0x7f0b4c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.957+0000 7f0b637fe640 1 -- 172.21.15.50:0/1382678599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b4c004390 msgr2=0x7f0b4c004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.957+0000 7f0b637fe640 1 --2- 172.21.15.50:0/1382678599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b4c004390 0x7f0b4c004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.957+0000 7f0b637fe640 1 -- 172.21.15.50:0/1382678599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c003520 con 0x7f0b4c0039e0 2024-09-11T22:23:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.957+0000 7f0b637fe640 1 --2- 172.21.15.50:0/1382678599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b4c0039e0 0x7f0b4c003dc0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009ac0 tx=0x7f0b4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f4a90ef73ce80d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.958+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54036070 con 0x7f0b4c0039e0 2024-09-11T22:23:40.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.958+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b54031400 con 0x7f0b4c0039e0 2024-09-11T22:23:40.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.958+0000 7f0b627fc640 1 -- 172.21.15.50:0/1382678599 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54009690 con 0x7f0b4c0039e0 2024-09-11T22:23:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.958+0000 7f0b6a247640 1 -- 172.21.15.50:0/1382678599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b4c0039e0 msgr2=0x7f0b4c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.958+0000 7f0b6a247640 1 --2- 172.21.15.50:0/1382678599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b4c0039e0 0x7f0b4c003dc0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009ac0 tx=0x7f0b4c005830 comp rx=0 tx=0).stop 2024-09-11T22:23:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.958+0000 7f0b63fff640 1 -- 172.21.15.50:0/1382678599 reap_dead start 2024-09-11T22:23:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.958+0000 7f0b6a247640 1 -- 172.21.15.50:0/1382678599 shutdown_connections 2024-09-11T22:23:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.958+0000 7f0b6a247640 1 -- 172.21.15.50:0/1382678599 >> 172.21.15.50:0/1382678599 conn(0x7f0b640b7940 msgr2=0x7f0b640b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.958+0000 7f0b6a247640 1 -- 172.21.15.50:0/1382678599 shutdown_connections 2024-09-11T22:23:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.958+0000 7f0b6a247640 1 -- 172.21.15.50:0/1382678599 wait complete. 2024-09-11T22:23:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.959+0000 7f0b6a247640 1 Processor -- start 2024-09-11T22:23:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.960+0000 7f0b6a247640 1 -- start start 2024-09-11T22:23:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.960+0000 7f0b6a247640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b4c0039e0 0x7f0b64162b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.960+0000 7f0b6a247640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b641f8100 0x7f0b640cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.960+0000 7f0b6a247640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b640cdae0 0x7f0b64160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.960+0000 7f0b6a247640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6406d310 con 0x7f0b641f8100 2024-09-11T22:23:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.960+0000 7f0b6a247640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6415feb0 con 0x7f0b640cdae0 2024-09-11T22:23:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.960+0000 7f0b6a247640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0b6406d490 con 0x7f0b4c0039e0 2024-09-11T22:23:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.960+0000 7f0b62ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b641f8100 0x7f0b640cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.960+0000 7f0b62ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b641f8100 0x7f0b640cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49398/0 (socket says 172.21.15.50:49398) 2024-09-11T22:23:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.960+0000 7f0b62ffd640 1 -- 172.21.15.50:0/1575219899 learned_addr learned my addr 172.21.15.50:0/1575219899 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.960+0000 7f0b637fe640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b4c0039e0 0x7f0b64162b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.960+0000 7f0b63fff640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b640cdae0 0x7f0b64160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.961+0000 7f0b62ffd640 1 -- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b4c0039e0 msgr2=0x7f0b64162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.961+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b4c0039e0 0x7f0b64162b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.961+0000 7f0b62ffd640 1 -- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b640cdae0 msgr2=0x7f0b64160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.961+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b640cdae0 0x7f0b64160250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.961+0000 7f0b62ffd640 1 -- 172.21.15.50:0/1575219899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b64163180 con 0x7f0b641f8100 2024-09-11T22:23:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.961+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b641f8100 0x7f0b640cc600 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f0b58007340 tx=0x7f0b58007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.961+0000 7f0b4bfff640 1 -- 172.21.15.50:0/1575219899 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800f8c0 con 0x7f0b641f8100 2024-09-11T22:23:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.961+0000 7f0b4bfff640 1 -- 172.21.15.50:0/1575219899 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b58018070 con 0x7f0b641f8100 2024-09-11T22:23:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.961+0000 7f0b6a247640 1 -- 172.21.15.50:0/1575219899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b640cb840 con 0x7f0b641f8100 2024-09-11T22:23:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.961+0000 7f0b4bfff640 1 -- 172.21.15.50:0/1575219899 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800fce0 con 0x7f0b641f8100 2024-09-11T22:23:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.961+0000 7f0b6a247640 1 -- 172.21.15.50:0/1575219899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b640cbe00 con 0x7f0b641f8100 2024-09-11T22:23:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.963+0000 7f0b4bfff640 1 -- 172.21.15.50:0/1575219899 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b5801d460 con 0x7f0b641f8100 2024-09-11T22:23:40.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.963+0000 7f0b4bfff640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0b5006be60 0x7f0b5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.963+0000 7f0b4bfff640 1 -- 172.21.15.50:0/1575219899 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f0b5808acb0 con 0x7f0b641f8100 2024-09-11T22:23:40.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.963+0000 7f0b637fe640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0b5006be60 0x7f0b5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.964+0000 7f0b6cfdf740 1 Processor -- start 2024-09-11T22:23:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.964+0000 7f0b637fe640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0b5006be60 0x7f0b5006e320 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0b54033000 tx=0x7f0b54008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.964+0000 7f0b6cfdf740 1 -- start start 2024-09-11T22:23:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b6cfdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a144920 0x55af5a18a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b6cfdf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1420e0 0x55af5a144d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b6cfdf740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a1460b0 0x55af5a13f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b6cfdf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55af5a0a76f0 con 0x55af5a1420e0 2024-09-11T22:23:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b6cfdf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55af5a04f330 con 0x55af5a144920 2024-09-11T22:23:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b6cfdf740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55af5a0a36b0 con 0x55af5a1460b0 2024-09-11T22:23:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b62ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1420e0 0x55af5a144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b62ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1420e0 0x55af5a144d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49414/0 (socket says 172.21.15.50:49414) 2024-09-11T22:23:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b62ffd640 1 -- 172.21.15.50:0/557697760 learned_addr learned my addr 172.21.15.50:0/557697760 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b637fe640 1 --2- 172.21.15.50:0/557697760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a144920 0x55af5a18a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b63fff640 1 --2- 172.21.15.50:0/557697760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a1460b0 0x55af5a13f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b62ffd640 1 -- 172.21.15.50:0/557697760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a1460b0 msgr2=0x55af5a13f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/557697760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a1460b0 0x55af5a13f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b62ffd640 1 -- 172.21.15.50:0/557697760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a144920 msgr2=0x55af5a18a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/557697760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a144920 0x55af5a18a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.965+0000 7f0b62ffd640 1 -- 172.21.15.50:0/557697760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af5a0750d0 con 0x55af5a1420e0 2024-09-11T22:23:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.966+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/557697760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1420e0 0x55af5a144d00 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f0b58089210 tx=0x7f0b58058dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f338e2566a477c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.966+0000 7f0b497fa640 1 -- 172.21.15.50:0/557697760 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58087070 con 0x55af5a1420e0 2024-09-11T22:23:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.966+0000 7f0b497fa640 1 -- 172.21.15.50:0/557697760 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b58061c90 con 0x55af5a1420e0 2024-09-11T22:23:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.966+0000 7f0b497fa640 1 -- 172.21.15.50:0/557697760 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5805d0f0 con 0x55af5a1420e0 2024-09-11T22:23:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.966+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/557697760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1420e0 msgr2=0x55af5a144d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.966+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/557697760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1420e0 0x55af5a144d00 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f0b58089210 tx=0x7f0b58058dd0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.966+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/557697760 shutdown_connections 2024-09-11T22:23:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.966+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/557697760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a1460b0 0x55af5a13f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.966+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/557697760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1420e0 0x55af5a144d00 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.966+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/557697760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a144920 0x55af5a18a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.966+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/557697760 >> 172.21.15.50:0/557697760 conn(0x55af5a141370 msgr2=0x55af5a189590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.966+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/557697760 shutdown_connections 2024-09-11T22:23:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.966+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/557697760 wait complete. 2024-09-11T22:23:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.967+0000 7f0b6cfdf740 1 -- start start 2024-09-11T22:23:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.967+0000 7f0b6cfdf740 1 Processor -- start 2024-09-11T22:23:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b6cfdf740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a144920 0x55af5a169140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b6cfdf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 0x55af5a157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b6cfdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a16eef0 0x55af5a16d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b6cfdf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55af5a140810 con 0x55af5a1460b0 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b6cfdf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55af5a0304f0 con 0x55af5a16eef0 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b6cfdf740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55af5a18a8f0 con 0x55af5a144920 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b6cfdf740 10 client.0 _ll_register_callbacks cb 0x55af5a051b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b62ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 0x55af5a157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b62ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 0x55af5a157ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49430/0 (socket says 172.21.15.50:49430) 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b62ffd640 1 -- 172.21.15.50:0/4030060143 learned_addr learned my addr 172.21.15.50:0/4030060143 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b63fff640 1 --2- 172.21.15.50:0/4030060143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a16eef0 0x55af5a16d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b637fe640 1 --2- 172.21.15.50:0/4030060143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a144920 0x55af5a169140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b62ffd640 1 -- 172.21.15.50:0/4030060143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a144920 msgr2=0x55af5a169140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/4030060143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a144920 0x55af5a169140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b62ffd640 1 -- 172.21.15.50:0/4030060143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a16eef0 msgr2=0x55af5a16d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/4030060143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a16eef0 0x55af5a16d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b62ffd640 1 -- 172.21.15.50:0/4030060143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af59e847d0 con 0x55af5a1460b0 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/4030060143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 0x55af5a157ef0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800f5a0 tx=0x7f0b58001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bcf421b98bfdb76 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.968+0000 7f0b427fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:23:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b427fc640 1 -- 172.21.15.50:0/4030060143 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58087040 con 0x55af5a1460b0 2024-09-11T22:23:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b427fc640 1 -- 172.21.15.50:0/4030060143 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f0b5805d050 con 0x55af5a1460b0 2024-09-11T22:23:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/4030060143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b58061c90 con 0x55af5a1460b0 2024-09-11T22:23:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b427fc640 1 -- 172.21.15.50:0/4030060143 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) ==== 24+0+0 (secure 0 0 0) 0x7f0b5807f050 con 0x55af5a1460b0 2024-09-11T22:23:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b6cfdf740 10 client.10956 fetch_fsmap learned FSMap version 137 2024-09-11T22:23:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/4030060143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) -- 0x55af59dba3f0 con 0x55af5a1460b0 2024-09-11T22:23:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b427fc640 1 -- 172.21.15.50:0/4030060143 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b58061c90 con 0x55af5a1460b0 2024-09-11T22:23:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b427fc640 1 -- 172.21.15.50:0/4030060143 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 137) ==== 3502+0+0 (secure 0 0 0) 0x7f0b58073030 con 0x55af5a1460b0 2024-09-11T22:23:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b6cfdf740 10 client.10956 fetch_fsmap finished waiting for FSMap version 137 2024-09-11T22:23:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b6cfdf740 10 client.10956 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-11T22:23:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b6cfdf740 20 client.10956 populate_metadata read hostname 'smithi050' 2024-09-11T22:23:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/4030060143 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55af5a16da00 0x55af5a166db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b6cfdf740 4 client.10956 mds_command: new command op to 10734 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/4030060143 --> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af5a0b4e20 con 0x55af5a16da00 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.969+0000 7f0b637fe640 1 --2- 172.21.15.50:0/4030060143 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55af5a16da00 0x55af5a166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b427fc640 10 client.10956 ms_handle_connect on v2:172.21.15.50:6834/2876091212 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b637fe640 1 --2- 172.21.15.50:0/4030060143 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55af5a16da00 0x55af5a166db0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29b3c2670a7194d9 server_cookie=cd6f6208e16054d1 in_seq=0 out_seq=0 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b427fc640 1 -- 172.21.15.50:0/4030060143 <== mds.0 v2:172.21.15.50:6834/2876091212 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55af5a0b4e20 con 0x55af5a16da00 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b427fc640 10 client.10956 handle_command_reply: tid=0 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b6cfdf740 1 client.10956 shutdown 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/4030060143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 msgr2=0x55af5a157ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/4030060143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 0x55af5a157ef0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800f5a0 tx=0x7f0b58001a40 comp rx=0 tx=0).stop 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/4030060143 shutdown_connections 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/4030060143 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55af5a16da00 0x55af5a166db0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/4030060143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a16eef0 0x55af5a16d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/4030060143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 0x55af5a157ef0 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b427fc640 0 client.10956 ms_handle_reset on v2:172.21.15.50:6834/2876091212 2024-09-11T22:23:40.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/4030060143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a144920 0x55af5a169140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/4030060143 >> 172.21.15.50:0/4030060143 conn(0x55af5a1420e0 msgr2=0x55af5a188db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/4030060143 shutdown_connections 2024-09-11T22:23:40.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.970+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/4030060143 wait complete. 2024-09-11T22:23:40.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.971+0000 7f0b6cfdf740 20 client.10956 trim_cache size 0 max 16384 2024-09-11T22:23:40.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.988+0000 7f0b6cfdf740 1 Processor -- start 2024-09-11T22:23:40.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.988+0000 7f0b6cfdf740 1 -- start start 2024-09-11T22:23:40.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b6cfdf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a144920 0x55af5a167db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b6cfdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a1460b0 0x55af5a187800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b6cfdf740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a16eef0 0x55af5a169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b6cfdf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b64200e40 con 0x55af5a144920 2024-09-11T22:23:40.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b6cfdf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b641ffe70 con 0x55af5a1460b0 2024-09-11T22:23:40.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b6cfdf740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0b641f4930 con 0x55af5a16eef0 2024-09-11T22:23:40.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b637fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a144920 0x55af5a167db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b637fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a144920 0x55af5a167db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49446/0 (socket says 172.21.15.50:49446) 2024-09-11T22:23:40.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b637fe640 1 -- 172.21.15.50:0/2709331906 learned_addr learned my addr 172.21.15.50:0/2709331906 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b63fff640 1 --2- 172.21.15.50:0/2709331906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a16eef0 0x55af5a169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/2709331906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a1460b0 0x55af5a187800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b637fe640 1 -- 172.21.15.50:0/2709331906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a16eef0 msgr2=0x55af5a169ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b637fe640 1 --2- 172.21.15.50:0/2709331906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a16eef0 0x55af5a169ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b637fe640 1 -- 172.21.15.50:0/2709331906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a1460b0 msgr2=0x55af5a187800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b637fe640 1 --2- 172.21.15.50:0/2709331906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a1460b0 0x55af5a187800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b637fe640 1 -- 172.21.15.50:0/2709331906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af59d7a0f0 con 0x55af5a144920 2024-09-11T22:23:40.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b637fe640 1 --2- 172.21.15.50:0/2709331906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a144920 0x55af5a167db0 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f0b540044a0 tx=0x7f0b5402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8dff7848c7eaf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b48ff9640 1 -- 172.21.15.50:0/2709331906 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54056070 con 0x55af5a144920 2024-09-11T22:23:40.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b48ff9640 1 -- 172.21.15.50:0/2709331906 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b54003ad0 con 0x55af5a144920 2024-09-11T22:23:40.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.989+0000 7f0b48ff9640 1 -- 172.21.15.50:0/2709331906 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54036040 con 0x55af5a144920 2024-09-11T22:23:40.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.990+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/2709331906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a144920 msgr2=0x55af5a167db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.990+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/2709331906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a144920 0x55af5a167db0 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f0b540044a0 tx=0x7f0b5402e000 comp rx=0 tx=0).stop 2024-09-11T22:23:40.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.990+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/2709331906 shutdown_connections 2024-09-11T22:23:40.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.990+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/2709331906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a16eef0 0x55af5a169ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.990+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/2709331906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a1460b0 0x55af5a187800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.990+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/2709331906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a144920 0x55af5a167db0 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.990+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/2709331906 >> 172.21.15.50:0/2709331906 conn(0x55af5a1420e0 msgr2=0x55af5a140b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.990+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/2709331906 shutdown_connections 2024-09-11T22:23:40.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.990+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/2709331906 wait complete. 2024-09-11T22:23:40.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.991+0000 7f0b6cfdf740 1 -- start start 2024-09-11T22:23:40.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.991+0000 7f0b6cfdf740 1 Processor -- start 2024-09-11T22:23:40.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.991+0000 7f0b6cfdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a144920 0x55af5a16ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.991+0000 7f0b6cfdf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 0x55af5a1895b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.991+0000 7f0b6cfdf740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a16eef0 0x55af5a1efe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.991+0000 7f0b6cfdf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b641f4f80 con 0x55af5a1460b0 2024-09-11T22:23:40.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.991+0000 7f0b6cfdf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55af5a207620 con 0x55af5a144920 2024-09-11T22:23:40.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.991+0000 7f0b6cfdf740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55af5a143ad0 con 0x55af5a16eef0 2024-09-11T22:23:40.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.991+0000 7f0b6cfdf740 10 client.0 _ll_register_callbacks cb 0x7f0b58085070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:23:40.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.991+0000 7f0b62ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 0x55af5a1895b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b62ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 0x55af5a1895b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49454/0 (socket says 172.21.15.50:49454) 2024-09-11T22:23:40.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b637fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a144920 0x55af5a16ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b62ffd640 1 -- 172.21.15.50:0/2551079519 learned_addr learned my addr 172.21.15.50:0/2551079519 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:23:40.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b63fff640 1 --2- 172.21.15.50:0/2551079519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a16eef0 0x55af5a1efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:40.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b62ffd640 1 -- 172.21.15.50:0/2551079519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a16eef0 msgr2=0x55af5a1efe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/2551079519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a16eef0 0x55af5a1efe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b62ffd640 1 -- 172.21.15.50:0/2551079519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a144920 msgr2=0x55af5a16ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:40.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/2551079519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a144920 0x55af5a16ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b62ffd640 1 -- 172.21.15.50:0/2551079519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af5a142e90 con 0x55af5a1460b0 2024-09-11T22:23:40.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b62ffd640 1 --2- 172.21.15.50:0/2551079519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 0x55af5a1895b0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f0b580555c0 tx=0x7f0b580078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cafb7b955d0bfda server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:40.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b427fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:23:40.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b427fc640 1 -- 172.21.15.50:0/2551079519 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58087070 con 0x55af5a1460b0 2024-09-11T22:23:40.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b427fc640 1 -- 172.21.15.50:0/2551079519 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f0b580585b0 con 0x55af5a1460b0 2024-09-11T22:23:40.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/2551079519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b54003ad0 con 0x55af5a1460b0 2024-09-11T22:23:40.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b427fc640 1 -- 172.21.15.50:0/2551079519 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) ==== 24+0+0 (secure 0 0 0) 0x7f0b58055400 con 0x55af5a1460b0 2024-09-11T22:23:40.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b6cfdf740 10 client.10962 fetch_fsmap learned FSMap version 137 2024-09-11T22:23:40.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/2551079519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) -- 0x55af5a206ed0 con 0x55af5a1460b0 2024-09-11T22:23:40.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.992+0000 7f0b427fc640 1 -- 172.21.15.50:0/2551079519 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b54003ad0 con 0x55af5a1460b0 2024-09-11T22:23:40.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b427fc640 1 -- 172.21.15.50:0/2551079519 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 137) ==== 3502+0+0 (secure 0 0 0) 0x7f0b58073040 con 0x55af5a1460b0 2024-09-11T22:23:40.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 10 client.10962 fetch_fsmap finished waiting for FSMap version 137 2024-09-11T22:23:40.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 10 client.10962 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-11T22:23:40.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 20 client.10962 populate_metadata read hostname 'smithi050' 2024-09-11T22:23:40.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/2551079519 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55af5a189af0 0x55af5a1f0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:40.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 4 client.10962 mds_command: new command op to 10734 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/2551079519 --> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55af5a0af170 con 0x55af5a189af0 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b637fe640 1 --2- 172.21.15.50:0/2551079519 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55af5a189af0 0x55af5a1f0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b427fc640 10 client.10962 ms_handle_connect on v2:172.21.15.50:6834/2876091212 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b637fe640 1 --2- 172.21.15.50:0/2551079519 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55af5a189af0 0x55af5a1f0360 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca49168b5fad46cf server_cookie=6c87da0e63dc2b43 in_seq=0 out_seq=0 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b427fc640 1 -- 172.21.15.50:0/2551079519 <== mds.0 v2:172.21.15.50:6834/2876091212 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x55af5a0af170 con 0x55af5a189af0 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b427fc640 10 client.10962 handle_command_reply: tid=0 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 1 client.10962 shutdown 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/2551079519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 msgr2=0x55af5a1895b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/2551079519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 0x55af5a1895b0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f0b580555c0 tx=0x7f0b580078f0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/2551079519 shutdown_connections 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/2551079519 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55af5a189af0 0x55af5a1f0360 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/2551079519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55af5a16eef0 0x55af5a1efe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/2551079519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5a1460b0 0x55af5a1895b0 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b427fc640 0 client.10962 ms_handle_reset on v2:172.21.15.50:6834/2876091212 2024-09-11T22:23:41.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 1 --2- 172.21.15.50:0/2551079519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55af5a144920 0x55af5a16ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/2551079519 >> 172.21.15.50:0/2551079519 conn(0x55af5a1420e0 msgr2=0x55af5a168380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:41.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/2551079519 shutdown_connections 2024-09-11T22:23:41.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.993+0000 7f0b6cfdf740 1 -- 172.21.15.50:0/2551079519 wait complete. 2024-09-11T22:23:41.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.994+0000 7f0b6cfdf740 20 client.10962 trim_cache size 0 max 16384 2024-09-11T22:23:41.001 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:23:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:23:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-11T22:23:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "b78caa8f-a57a-4896-a62f-2966fb47f29c": { 2024-09-11T22:23:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-11T22:23:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "b78caa8f-a57a-4896-a62f-2966fb47f29c", 2024-09-11T22:23:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,repair" 2024-09-11T22:23:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-11T22:23:41.002 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:23:41.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.994+0000 7f0b6a247640 1 -- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0b5006be60 msgr2=0x7f0b5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:41.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.994+0000 7f0b6a247640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0b5006be60 0x7f0b5006e320 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0b54033000 tx=0x7f0b54008030 comp rx=0 tx=0).stop 2024-09-11T22:23:41.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.994+0000 7f0b6a247640 1 -- 172.21.15.50:0/1575219899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b641f8100 msgr2=0x7f0b640cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:41.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.994+0000 7f0b6a247640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b641f8100 0x7f0b640cc600 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f0b58007340 tx=0x7f0b58007800 comp rx=0 tx=0).stop 2024-09-11T22:23:41.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.994+0000 7f0b6a247640 1 -- 172.21.15.50:0/1575219899 shutdown_connections 2024-09-11T22:23:41.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.994+0000 7f0b6a247640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0b5006be60 0x7f0b5006e320 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.994+0000 7f0b6a247640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b640cdae0 0x7f0b64160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.994+0000 7f0b6a247640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b641f8100 0x7f0b640cc600 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.994+0000 7f0b6a247640 1 --2- 172.21.15.50:0/1575219899 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b4c0039e0 0x7f0b64162b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.994+0000 7f0b6a247640 1 -- 172.21.15.50:0/1575219899 >> 172.21.15.50:0/1575219899 conn(0x7f0b640b7940 msgr2=0x7f0b64159410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:41.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.994+0000 7f0b6a247640 1 -- 172.21.15.50:0/1575219899 shutdown_connections 2024-09-11T22:23:41.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:23:40.994+0000 7f0b6a247640 1 -- 172.21.15.50:0/1575219899 wait complete. 2024-09-11T22:23:41.006 INFO:tasks.cephfs.filesystem:scrub status for tag:b78caa8f-a57a-4896-a62f-2966fb47f29c - {'path': '/', 'tag': 'b78caa8f-a57a-4896-a62f-2966fb47f29c', 'options': 'recursive,repair'} 2024-09-11T22:23:44.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:23:44.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:24:11.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:11.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-11T22:24:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.125+0000 7f930b36d640 1 Processor -- start 2024-09-11T22:24:11.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.125+0000 7f930b36d640 1 -- start start 2024-09-11T22:24:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f930b36d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9304161fa0 0x7f93040b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f930b36d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93040b1600 0x7f93040cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f930b36d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93040cfbd0 con 0x7f93040cf440 2024-09-11T22:24:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f930b36d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f93040cdce0 con 0x7f9304161fa0 2024-09-11T22:24:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f930b36d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f93040d1220 con 0x7f93040b1600 2024-09-11T22:24:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f930990a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f93040cf440 0x7f930406bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49468/0 (socket says 172.21.15.50:49468) 2024-09-11T22:24:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f930990a640 1 -- 172.21.15.50:0/2301544303 learned_addr learned my addr 172.21.15.50:0/2301544303 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f9308908640 1 --2- 172.21.15.50:0/2301544303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93040b1600 0x7f93040cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f9309109640 1 --2- 172.21.15.50:0/2301544303 >> v2:172.21.15.77:3300/0 conn(0x7f9304161fa0 0x7f93040b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 819976439 0 0) 0x7f93040cfbd0 con 0x7f93040cf440 2024-09-11T22:24:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92f0003520 con 0x7f93040cf440 2024-09-11T22:24:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 825234335 0 0) 0x7f92f0003520 con 0x7f93040cf440 2024-09-11T22:24:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93040b1600 msgr2=0x7f93040cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f92fbfff640 1 --2- 172.21.15.50:0/2301544303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93040b1600 0x7f93040cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 >> v2:172.21.15.77:3300/0 conn(0x7f9304161fa0 msgr2=0x7f93040b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f92fbfff640 1 --2- 172.21.15.50:0/2301544303 >> v2:172.21.15.77:3300/0 conn(0x7f9304161fa0 0x7f93040b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93040cfeb0 con 0x7f93040cf440 2024-09-11T22:24:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f92fc0019f0 con 0x7f93040cf440 2024-09-11T22:24:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 >> v1:172.21.15.50:6789/0 conn(0x7f93040cf440 legacy=0x7f930406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.126+0000 7f92fbfff640 1 --2- 172.21.15.50:0/2301544303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f00039b0 0x7f92f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.127+0000 7f92fbfff640 1 --2- 172.21.15.50:0/2301544303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92f0004800 0x7f92f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.127+0000 7f92fbfff640 1 --2- 172.21.15.50:0/2301544303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93040b1600 0x7f92f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.127+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f93040d1220 con 0x7f92f00039b0 2024-09-11T22:24:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.127+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f92f000b9c0 con 0x7f92f0004800 2024-09-11T22:24:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.127+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f92f000bb40 con 0x7f93040b1600 2024-09-11T22:24:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.127+0000 7f9309109640 1 --2- 172.21.15.50:0/2301544303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f00039b0 0x7f92f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.127+0000 7f9308908640 1 --2- 172.21.15.50:0/2301544303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92f0004800 0x7f92f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.127+0000 7f930990a640 1 --2- 172.21.15.50:0/2301544303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93040b1600 0x7f92f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.127+0000 7f9309109640 1 -- 172.21.15.50:0/2301544303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93040b1600 msgr2=0x7f92f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.127+0000 7f9309109640 1 --2- 172.21.15.50:0/2301544303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93040b1600 0x7f92f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.127+0000 7f9309109640 1 -- 172.21.15.50:0/2301544303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92f0004800 msgr2=0x7f92f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.127+0000 7f9309109640 1 --2- 172.21.15.50:0/2301544303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92f0004800 0x7f92f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.127+0000 7f9309109640 1 -- 172.21.15.50:0/2301544303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f0003520 con 0x7f92f00039b0 2024-09-11T22:24:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.128+0000 7f9309109640 1 --2- 172.21.15.50:0/2301544303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f00039b0 0x7f92f0003dd0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f9300009ac0 tx=0x7f92f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519d57d31b6f404 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.128+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300036070 con 0x7f92f00039b0 2024-09-11T22:24:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.128+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9300031400 con 0x7f92f00039b0 2024-09-11T22:24:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.128+0000 7f92fbfff640 1 -- 172.21.15.50:0/2301544303 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300009690 con 0x7f92f00039b0 2024-09-11T22:24:11.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.128+0000 7f930b36d640 1 -- 172.21.15.50:0/2301544303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f00039b0 msgr2=0x7f92f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.128+0000 7f930b36d640 1 --2- 172.21.15.50:0/2301544303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f00039b0 0x7f92f0003dd0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f9300009ac0 tx=0x7f92f0005830 comp rx=0 tx=0).stop 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.128+0000 7f930990a640 1 -- 172.21.15.50:0/2301544303 reap_dead start 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.128+0000 7f930b36d640 1 -- 172.21.15.50:0/2301544303 shutdown_connections 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.128+0000 7f930b36d640 1 -- 172.21.15.50:0/2301544303 >> 172.21.15.50:0/2301544303 conn(0x7f930409ba50 msgr2=0x7f93040b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.129+0000 7f930b36d640 1 -- 172.21.15.50:0/2301544303 shutdown_connections 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.129+0000 7f930b36d640 1 -- 172.21.15.50:0/2301544303 wait complete. 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.130+0000 7f930b36d640 1 Processor -- start 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.130+0000 7f930b36d640 1 -- start start 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f930b36d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92f00039b0 0x7f9304070d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f930b36d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f930415b980 0x7f93040b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f930b36d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93040caa30 0x7f93040caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f930b36d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f93040cf8f0 con 0x7f930415b980 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f930b36d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f93040d17e0 con 0x7f93040caa30 2024-09-11T22:24:11.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f930b36d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9304162380 con 0x7f92f00039b0 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f9308908640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f930415b980 0x7f93040b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f9308908640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f930415b980 0x7f93040b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35526/0 (socket says 172.21.15.50:35526) 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f9308908640 1 -- 172.21.15.50:0/125423692 learned_addr learned my addr 172.21.15.50:0/125423692 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f9309109640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92f00039b0 0x7f9304070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f930990a640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93040caa30 0x7f93040caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f9308908640 1 -- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92f00039b0 msgr2=0x7f9304070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f9308908640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92f00039b0 0x7f9304070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f9308908640 1 -- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93040caa30 msgr2=0x7f93040caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f9308908640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93040caa30 0x7f93040caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f9308908640 1 -- 172.21.15.50:0/125423692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93040702c0 con 0x7f930415b980 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f9308908640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f930415b980 0x7f93040b3ab0 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f92f4011930 tx=0x7f92f4011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.131+0000 7f92f9ffb640 1 -- 172.21.15.50:0/125423692 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f400f9d0 con 0x7f930415b980 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.132+0000 7f92f9ffb640 1 -- 172.21.15.50:0/125423692 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f400fb70 con 0x7f930415b980 2024-09-11T22:24:11.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.132+0000 7f92f9ffb640 1 -- 172.21.15.50:0/125423692 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4014440 con 0x7f930415b980 2024-09-11T22:24:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.132+0000 7f930b36d640 1 -- 172.21.15.50:0/125423692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93040b30b0 con 0x7f930415b980 2024-09-11T22:24:11.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.132+0000 7f930b36d640 1 -- 172.21.15.50:0/125423692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93040b3390 con 0x7f930415b980 2024-09-11T22:24:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.133+0000 7f92f9ffb640 1 -- 172.21.15.50:0/125423692 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92f4012040 con 0x7f930415b980 2024-09-11T22:24:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.134+0000 7f92f9ffb640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92e806be30 0x7f92e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.134+0000 7f92f9ffb640 1 -- 172.21.15.50:0/125423692 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5854+0+0 (secure 0 0 0) 0x7f92f408b310 con 0x7f930415b980 2024-09-11T22:24:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.134+0000 7f9309109640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92e806be30 0x7f92e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.135+0000 7f9309109640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92e806be30 0x7f92e806e2f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f9300033000 tx=0x7f9300008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.135+0000 7f930e1ea740 1 Processor -- start 2024-09-11T22:24:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.135+0000 7f930e1ea740 1 -- start start 2024-09-11T22:24:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f930e1ea740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d9e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f930e1ea740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d560e0 0x55ab44d58d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f930e1ea740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d5a0b0 0x55ab44d531a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f930e1ea740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ab44cbb6f0 con 0x55ab44d58920 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f930e1ea740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ab44c63330 con 0x55ab44d5a0b0 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f930e1ea740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ab44cb76b0 con 0x55ab44d560e0 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f9309109640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d9e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f9309109640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d9e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35538/0 (socket says 172.21.15.50:35538) 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f9309109640 1 -- 172.21.15.50:0/1922741520 learned_addr learned my addr 172.21.15.50:0/1922741520 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f9308908640 1 --2- 172.21.15.50:0/1922741520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d560e0 0x55ab44d58d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f930990a640 1 --2- 172.21.15.50:0/1922741520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d5a0b0 0x55ab44d531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f9309109640 1 -- 172.21.15.50:0/1922741520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d560e0 msgr2=0x55ab44d58d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f9309109640 1 --2- 172.21.15.50:0/1922741520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d560e0 0x55ab44d58d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f9309109640 1 -- 172.21.15.50:0/1922741520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d5a0b0 msgr2=0x55ab44d531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f9309109640 1 --2- 172.21.15.50:0/1922741520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d5a0b0 0x55ab44d531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f9309109640 1 -- 172.21.15.50:0/1922741520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab44c890d0 con 0x55ab44d58920 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f9309109640 1 --2- 172.21.15.50:0/1922741520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d9e0c0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f9300034040 tx=0x7f930002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f82def2f3f3d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f92e6ffd640 1 -- 172.21.15.50:0/1922741520 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300036040 con 0x55ab44d58920 2024-09-11T22:24:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f92e6ffd640 1 -- 172.21.15.50:0/1922741520 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f930004c070 con 0x55ab44d58920 2024-09-11T22:24:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.136+0000 7f92e6ffd640 1 -- 172.21.15.50:0/1922741520 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300003ce0 con 0x55ab44d58920 2024-09-11T22:24:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.137+0000 7f930e1ea740 1 -- 172.21.15.50:0/1922741520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 msgr2=0x55ab44d9e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.137+0000 7f930e1ea740 1 --2- 172.21.15.50:0/1922741520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d9e0c0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f9300034040 tx=0x7f930002e000 comp rx=0 tx=0).stop 2024-09-11T22:24:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.137+0000 7f930e1ea740 1 -- 172.21.15.50:0/1922741520 shutdown_connections 2024-09-11T22:24:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.137+0000 7f930e1ea740 1 --2- 172.21.15.50:0/1922741520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d560e0 0x55ab44d58d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.137+0000 7f930e1ea740 1 --2- 172.21.15.50:0/1922741520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d5a0b0 0x55ab44d531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.137+0000 7f930e1ea740 1 --2- 172.21.15.50:0/1922741520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d9e0c0 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.137+0000 7f930e1ea740 1 -- 172.21.15.50:0/1922741520 >> 172.21.15.50:0/1922741520 conn(0x55ab44d55370 msgr2=0x55ab44d9d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.137+0000 7f930e1ea740 1 -- 172.21.15.50:0/1922741520 shutdown_connections 2024-09-11T22:24:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.137+0000 7f930e1ea740 1 -- 172.21.15.50:0/1922741520 wait complete. 2024-09-11T22:24:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.138+0000 7f930e1ea740 1 -- start start 2024-09-11T22:24:11.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.138+0000 7f930e1ea740 1 Processor -- start 2024-09-11T22:24:11.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f930e1ea740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d7c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f930e1ea740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d5a0b0 0x55ab44d9a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f930e1ea740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d7acb0 0x55ab44d82670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f930e1ea740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ab44d54810 con 0x55ab44d58920 2024-09-11T22:24:11.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f930e1ea740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ab44c444f0 con 0x55ab44d5a0b0 2024-09-11T22:24:11.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f930e1ea740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ab44d9e8f0 con 0x55ab44d7acb0 2024-09-11T22:24:11.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f930e1ea740 10 client.0 _ll_register_callbacks cb 0x55ab44c65b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:24:11.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f9309109640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d7c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f9309109640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d7c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35544/0 (socket says 172.21.15.50:35544) 2024-09-11T22:24:11.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f9309109640 1 -- 172.21.15.50:0/871254260 learned_addr learned my addr 172.21.15.50:0/871254260 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f930990a640 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d7acb0 0x55ab44d82670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f9308908640 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d5a0b0 0x55ab44d9a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f9309109640 1 -- 172.21.15.50:0/871254260 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d7acb0 msgr2=0x55ab44d82670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f9309109640 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d7acb0 0x55ab44d82670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f9309109640 1 -- 172.21.15.50:0/871254260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d5a0b0 msgr2=0x55ab44d9a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f9309109640 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d5a0b0 0x55ab44d9a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f9309109640 1 -- 172.21.15.50:0/871254260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab44a987d0 con 0x55ab44d58920 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f9308908640 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d5a0b0 0x55ab44d9a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f9309109640 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d7c590 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f930002abe0 tx=0x7f93000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a3e9dcc0107b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.139+0000 7f92dffff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f92dffff640 1 -- 172.21.15.50:0/871254260 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300056070 con 0x55ab44d58920 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f92dffff640 1 -- 172.21.15.50:0/871254260 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 5854+0+0 (secure 0 0 0) 0x7f9300003ef0 con 0x55ab44d58920 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f930e1ea740 1 -- 172.21.15.50:0/871254260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f930004c070 con 0x55ab44d58920 2024-09-11T22:24:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f92dffff640 1 -- 172.21.15.50:0/871254260 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) ==== 24+0+0 (secure 0 0 0) 0x7f9300061050 con 0x55ab44d58920 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f930e1ea740 10 client.10974 fetch_fsmap learned FSMap version 137 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f930e1ea740 1 -- 172.21.15.50:0/871254260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) -- 0x55ab449ce3f0 con 0x55ab44d58920 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f92dffff640 1 -- 172.21.15.50:0/871254260 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f930004c070 con 0x55ab44d58920 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f92dffff640 1 -- 172.21.15.50:0/871254260 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 137) ==== 3502+0+0 (secure 0 0 0) 0x7f9300064020 con 0x55ab44d58920 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f930e1ea740 10 client.10974 fetch_fsmap finished waiting for FSMap version 137 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f930e1ea740 10 client.10974 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f930e1ea740 20 client.10974 populate_metadata read hostname 'smithi050' 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f930e1ea740 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ab44d81030 0x55ab44d81410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f930e1ea740 4 client.10974 mds_command: new command op to 10734 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f930e1ea740 1 -- 172.21.15.50:0/871254260 --> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab44cc8e20 con 0x55ab44d81030 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f9308908640 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ab44d81030 0x55ab44d81410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.140+0000 7f92dffff640 10 client.10974 ms_handle_connect on v2:172.21.15.50:6834/2876091212 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f9308908640 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ab44d81030 0x55ab44d81410 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3624f6b610ef2d72 server_cookie=99d3e4b9e54db519 in_seq=0 out_seq=0 2024-09-11T22:24:11.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f92dffff640 1 -- 172.21.15.50:0/871254260 <== mds.0 v2:172.21.15.50:6834/2876091212 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab44cc8e20 con 0x55ab44d81030 2024-09-11T22:24:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f92dffff640 10 client.10974 handle_command_reply: tid=0 2024-09-11T22:24:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f930e1ea740 1 client.10974 shutdown 2024-09-11T22:24:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f930e1ea740 1 -- 172.21.15.50:0/871254260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 msgr2=0x55ab44d7c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f930e1ea740 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d7c590 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f930002abe0 tx=0x7f93000046c0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f930e1ea740 1 -- 172.21.15.50:0/871254260 shutdown_connections 2024-09-11T22:24:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f930e1ea740 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ab44d81030 0x55ab44d81410 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f930e1ea740 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d7acb0 0x55ab44d82670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f930e1ea740 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d5a0b0 0x55ab44d9a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f92dffff640 0 client.10974 ms_handle_reset on v2:172.21.15.50:6834/2876091212 2024-09-11T22:24:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f930e1ea740 1 --2- 172.21.15.50:0/871254260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d7c590 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f930e1ea740 1 -- 172.21.15.50:0/871254260 >> 172.21.15.50:0/871254260 conn(0x55ab44d560e0 msgr2=0x55ab44d9f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.141+0000 7f930e1ea740 1 -- 172.21.15.50:0/871254260 shutdown_connections 2024-09-11T22:24:11.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.142+0000 7f930e1ea740 1 -- 172.21.15.50:0/871254260 wait complete. 2024-09-11T22:24:11.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.142+0000 7f930e1ea740 20 client.10974 trim_cache size 0 max 16384 2024-09-11T22:24:11.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.159+0000 7f930e1ea740 1 Processor -- start 2024-09-11T22:24:11.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.159+0000 7f930e1ea740 1 -- start start 2024-09-11T22:24:11.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f930e1ea740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d9b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f930e1ea740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d5a0b0 0x55ab44d9ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f930e1ea740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d7acb0 0x55ab44d78890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f930e1ea740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f93042014d0 con 0x55ab44d58920 2024-09-11T22:24:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f930e1ea740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9304200550 con 0x55ab44d7acb0 2024-09-11T22:24:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f930e1ea740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f93041ff8b0 con 0x55ab44d5a0b0 2024-09-11T22:24:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f9309109640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d9b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f9309109640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d9b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35548/0 (socket says 172.21.15.50:35548) 2024-09-11T22:24:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f9309109640 1 -- 172.21.15.50:0/2855905458 learned_addr learned my addr 172.21.15.50:0/2855905458 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f9309109640 1 -- 172.21.15.50:0/2855905458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d5a0b0 msgr2=0x55ab44d9ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f9309109640 1 --2- 172.21.15.50:0/2855905458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d5a0b0 0x55ab44d9ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f9309109640 1 -- 172.21.15.50:0/2855905458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d7acb0 msgr2=0x55ab44d78890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f9309109640 1 --2- 172.21.15.50:0/2855905458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d7acb0 0x55ab44d78890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.160+0000 7f9309109640 1 -- 172.21.15.50:0/2855905458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab4498e0f0 con 0x55ab44d58920 2024-09-11T22:24:11.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.161+0000 7f9309109640 1 --2- 172.21.15.50:0/2855905458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d9b540 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f9300003e80 tx=0x7f930004f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ec103358896db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.161+0000 7f92e67fc640 1 -- 172.21.15.50:0/2855905458 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300056070 con 0x55ab44d58920 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.161+0000 7f92e67fc640 1 -- 172.21.15.50:0/2855905458 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f930004c040 con 0x55ab44d58920 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.161+0000 7f92e67fc640 1 -- 172.21.15.50:0/2855905458 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300036040 con 0x55ab44d58920 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.161+0000 7f930e1ea740 1 -- 172.21.15.50:0/2855905458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 msgr2=0x55ab44d9b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.161+0000 7f930e1ea740 1 --2- 172.21.15.50:0/2855905458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d9b540 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f9300003e80 tx=0x7f930004f000 comp rx=0 tx=0).stop 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.161+0000 7f930e1ea740 1 -- 172.21.15.50:0/2855905458 shutdown_connections 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.161+0000 7f930e1ea740 1 --2- 172.21.15.50:0/2855905458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d5a0b0 0x55ab44d9ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.161+0000 7f930e1ea740 1 --2- 172.21.15.50:0/2855905458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d7acb0 0x55ab44d78890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.161+0000 7f930e1ea740 1 --2- 172.21.15.50:0/2855905458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d58920 0x55ab44d9b540 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.161+0000 7f930e1ea740 1 -- 172.21.15.50:0/2855905458 >> 172.21.15.50:0/2855905458 conn(0x55ab44d560e0 msgr2=0x55ab44d9d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.161+0000 7f930e1ea740 1 -- 172.21.15.50:0/2855905458 shutdown_connections 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.161+0000 7f930e1ea740 1 -- 172.21.15.50:0/2855905458 wait complete. 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.162+0000 7f930e1ea740 1 -- start start 2024-09-11T22:24:11.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.162+0000 7f930e1ea740 1 Processor -- start 2024-09-11T22:24:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930e1ea740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d58920 0x55ab44d9b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930e1ea740 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d5a0b0 0x55ab44d7be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930e1ea740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d7acb0 0x55ab44d7c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930e1ea740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ab44d7b690 con 0x55ab44d7acb0 2024-09-11T22:24:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930e1ea740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f93041fff00 con 0x55ab44d58920 2024-09-11T22:24:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930e1ea740 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ab44d7aab0 con 0x55ab44d5a0b0 2024-09-11T22:24:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930e1ea740 10 client.0 _ll_register_callbacks cb 0x7f92fc001930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:24:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930990a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d7acb0 0x55ab44d7c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930990a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d7acb0 0x55ab44d7c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35552/0 (socket says 172.21.15.50:35552) 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930990a640 1 -- 172.21.15.50:0/894564597 learned_addr learned my addr 172.21.15.50:0/894564597 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f9309109640 1 --2- 172.21.15.50:0/894564597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d58920 0x55ab44d9b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930990a640 1 -- 172.21.15.50:0/894564597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d5a0b0 msgr2=0x55ab44d7be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930990a640 1 --2- 172.21.15.50:0/894564597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d5a0b0 0x55ab44d7be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930990a640 1 -- 172.21.15.50:0/894564597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d58920 msgr2=0x55ab44d9b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930990a640 1 --2- 172.21.15.50:0/894564597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d58920 0x55ab44d9b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930990a640 1 -- 172.21.15.50:0/894564597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab44db0ef0 con 0x55ab44d7acb0 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f930990a640 1 --2- 172.21.15.50:0/894564597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d7acb0 0x55ab44d7c390 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f92fc002230 tx=0x7f92fc005fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e4cb51b42fcce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.163+0000 7f92dffff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f92dffff640 1 -- 172.21.15.50:0/894564597 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc017cd0 con 0x55ab44d7acb0 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f92dffff640 1 -- 172.21.15.50:0/894564597 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 5854+0+0 (secure 0 0 0) 0x7f92fc0203f0 con 0x55ab44d7acb0 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f930e1ea740 1 -- 172.21.15.50:0/894564597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f930004c040 con 0x55ab44d7acb0 2024-09-11T22:24:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f92dffff640 1 -- 172.21.15.50:0/894564597 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) ==== 24+0+0 (secure 0 0 0) 0x7f92fc0205f0 con 0x55ab44d7acb0 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f930e1ea740 10 client.10980 fetch_fsmap learned FSMap version 137 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f930e1ea740 1 -- 172.21.15.50:0/894564597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) -- 0x55ab44d9b0c0 con 0x55ab44d7acb0 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f92dffff640 1 -- 172.21.15.50:0/894564597 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f930004c040 con 0x55ab44d7acb0 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f92dffff640 1 -- 172.21.15.50:0/894564597 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 137) ==== 3502+0+0 (secure 0 0 0) 0x7f92fc01f3a0 con 0x55ab44d7acb0 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f930e1ea740 10 client.10980 fetch_fsmap finished waiting for FSMap version 137 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f930e1ea740 10 client.10980 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f930e1ea740 20 client.10980 populate_metadata read hostname 'smithi050' 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f930e1ea740 1 --2- 172.21.15.50:0/894564597 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ab44d9f7b0 0x55ab44e1acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f930e1ea740 4 client.10980 mds_command: new command op to 10734 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f930e1ea740 1 -- 172.21.15.50:0/894564597 --> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ab44cc3170 con 0x55ab44d9f7b0 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.164+0000 7f9309109640 1 --2- 172.21.15.50:0/894564597 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ab44d9f7b0 0x55ab44e1acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f92dffff640 10 client.10980 ms_handle_connect on v2:172.21.15.50:6834/2876091212 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f9309109640 1 --2- 172.21.15.50:0/894564597 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ab44d9f7b0 0x55ab44e1acc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e555cd63b2eb06a3 server_cookie=86576fe293899451 in_seq=0 out_seq=0 2024-09-11T22:24:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f92dffff640 1 -- 172.21.15.50:0/894564597 <== mds.0 v2:172.21.15.50:6834/2876091212 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ab44cc3170 con 0x55ab44d9f7b0 2024-09-11T22:24:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f92dffff640 10 client.10980 handle_command_reply: tid=0 2024-09-11T22:24:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f930e1ea740 1 client.10980 shutdown 2024-09-11T22:24:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f930e1ea740 1 -- 172.21.15.50:0/894564597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d7acb0 msgr2=0x55ab44d7c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f930e1ea740 1 --2- 172.21.15.50:0/894564597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d7acb0 0x55ab44d7c390 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f92fc002230 tx=0x7f92fc005fc0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f930e1ea740 1 -- 172.21.15.50:0/894564597 shutdown_connections 2024-09-11T22:24:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f930e1ea740 1 --2- 172.21.15.50:0/894564597 >> [v2:172.21.15.50:6834/2876091212,v1:172.21.15.50:6835/2876091212] conn(0x55ab44d9f7b0 0x55ab44e1acc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f930e1ea740 1 --2- 172.21.15.50:0/894564597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ab44d5a0b0 0x55ab44d7be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f930e1ea740 1 --2- 172.21.15.50:0/894564597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab44d7acb0 0x55ab44d7c390 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f930e1ea740 1 --2- 172.21.15.50:0/894564597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab44d58920 0x55ab44d9b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f92dffff640 0 client.10980 ms_handle_reset on v2:172.21.15.50:6834/2876091212 2024-09-11T22:24:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f930e1ea740 1 -- 172.21.15.50:0/894564597 >> 172.21.15.50:0/894564597 conn(0x55ab44d560e0 msgr2=0x55ab44d4e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f930e1ea740 1 -- 172.21.15.50:0/894564597 shutdown_connections 2024-09-11T22:24:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f930e1ea740 1 -- 172.21.15.50:0/894564597 wait complete. 2024-09-11T22:24:11.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.165+0000 7f930e1ea740 20 client.10980 trim_cache size 0 max 16384 2024-09-11T22:24:11.172 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:24:11.172 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-11T22:24:11.172 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-11T22:24:11.172 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:24:11.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.166+0000 7f930b36d640 1 -- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92e806be30 msgr2=0x7f92e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.166+0000 7f930b36d640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92e806be30 0x7f92e806e2f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f9300033000 tx=0x7f9300008030 comp rx=0 tx=0).stop 2024-09-11T22:24:11.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.166+0000 7f930b36d640 1 -- 172.21.15.50:0/125423692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f930415b980 msgr2=0x7f93040b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.166+0000 7f930b36d640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f930415b980 0x7f93040b3ab0 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f92f4011930 tx=0x7f92f4011d30 comp rx=0 tx=0).stop 2024-09-11T22:24:11.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.166+0000 7f930b36d640 1 -- 172.21.15.50:0/125423692 shutdown_connections 2024-09-11T22:24:11.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.166+0000 7f930b36d640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92e806be30 0x7f92e806e2f0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.166+0000 7f930b36d640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93040caa30 0x7f93040caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.166+0000 7f930b36d640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f930415b980 0x7f93040b3ab0 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.166+0000 7f930b36d640 1 --2- 172.21.15.50:0/125423692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92f00039b0 0x7f9304070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.166+0000 7f930b36d640 1 -- 172.21.15.50:0/125423692 >> 172.21.15.50:0/125423692 conn(0x7f930409ba50 msgr2=0x7f930415df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:11.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.166+0000 7f930b36d640 1 -- 172.21.15.50:0/125423692 shutdown_connections 2024-09-11T22:24:11.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.166+0000 7f930b36d640 1 -- 172.21.15.50:0/125423692 wait complete. 2024-09-11T22:24:11.177 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:24:11.178 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2024-09-11T22:24:11.178 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-11T22:24:11.178 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2024-09-11T22:24:11.178 DEBUG:teuthology.orchestra.run.smithi050:> import json 2024-09-11T22:24:11.178 DEBUG:teuthology.orchestra.run.smithi050:> import sys 2024-09-11T22:24:11.178 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:24:11.178 DEBUG:teuthology.orchestra.run.smithi050:> try: 2024-09-11T22:24:11.178 DEBUG:teuthology.orchestra.run.smithi050:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-11T22:24:11.179 DEBUG:teuthology.orchestra.run.smithi050:> except OSError as e: 2024-09-11T22:24:11.179 DEBUG:teuthology.orchestra.run.smithi050:> sys.exit(e.errno) 2024-09-11T22:24:11.179 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-11T22:24:11.179 DEBUG:teuthology.orchestra.run.smithi050:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-11T22:24:11.179 DEBUG:teuthology.orchestra.run.smithi050:> print(json.dumps( 2024-09-11T22:24:11.179 DEBUG:teuthology.orchestra.run.smithi050:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-11T22:24:11.179 DEBUG:teuthology.orchestra.run.smithi050:> indent=2)) 2024-09-11T22:24:11.179 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-11T22:24:11.248 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:24:11.248 INFO:teuthology.orchestra.run.smithi050.stdout: "st_mode": 33188, 2024-09-11T22:24:11.248 INFO:teuthology.orchestra.run.smithi050.stdout: "st_ino": 1099511627777, 2024-09-11T22:24:11.248 INFO:teuthology.orchestra.run.smithi050.stdout: "st_dev": 42, 2024-09-11T22:24:11.249 INFO:teuthology.orchestra.run.smithi050.stdout: "st_nlink": 1, 2024-09-11T22:24:11.249 INFO:teuthology.orchestra.run.smithi050.stdout: "st_uid": 1000, 2024-09-11T22:24:11.249 INFO:teuthology.orchestra.run.smithi050.stdout: "st_gid": 1333, 2024-09-11T22:24:11.249 INFO:teuthology.orchestra.run.smithi050.stdout: "st_size": 6291456, 2024-09-11T22:24:11.249 INFO:teuthology.orchestra.run.smithi050.stdout: "st_atime": 1726093419.7976372, 2024-09-11T22:24:11.249 INFO:teuthology.orchestra.run.smithi050.stdout: "st_mtime": 1726093419.8176367, 2024-09-11T22:24:11.249 INFO:teuthology.orchestra.run.smithi050.stdout: "st_ctime": 1726093419.8176367 2024-09-11T22:24:11.249 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:24:11.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:24:11.258 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:24:11.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.401+0000 7f1016c65640 1 Processor -- start 2024-09-11T22:24:11.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.401+0000 7f1016c65640 1 -- start start 2024-09-11T22:24:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1016c65640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f101015e8e0 0x7f10100b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1016c65640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10100d1580 0x7f10100d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1016c65640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1010162350 0x7f1010162800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1016c65640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f101015ecc0 con 0x7f101015e8e0 2024-09-11T22:24:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1016c65640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f10100d2ad0 con 0x7f1010162350 2024-09-11T22:24:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1016c65640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f10100d3370 con 0x7f10100d1580 2024-09-11T22:24:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1014a01640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f101015e8e0 0x7f10100b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1014a01640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f101015e8e0 0x7f10100b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35562/0 (socket says 172.21.15.50:35562) 2024-09-11T22:24:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1014a01640 1 -- 172.21.15.50:0/1133321267 learned_addr learned my addr 172.21.15.50:0/1133321267 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f100ffff640 1 --2- 172.21.15.50:0/1133321267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10100d1580 0x7f10100d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1015202640 1 --2- 172.21.15.50:0/1133321267 >> v2:172.21.15.77:3300/0 conn(0x7f1010162350 0x7f1010162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1014a01640 1 -- 172.21.15.50:0/1133321267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10100d1580 msgr2=0x7f10100d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1014a01640 1 --2- 172.21.15.50:0/1133321267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10100d1580 0x7f10100d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1014a01640 1 -- 172.21.15.50:0/1133321267 >> v2:172.21.15.77:3300/0 conn(0x7f1010162350 msgr2=0x7f1010162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1014a01640 1 --2- 172.21.15.50:0/1133321267 >> v2:172.21.15.77:3300/0 conn(0x7f1010162350 0x7f1010162800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1014a01640 1 -- 172.21.15.50:0/1133321267 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10100d1ee0 con 0x7f101015e8e0 2024-09-11T22:24:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.402+0000 7f1015202640 1 --2- 172.21.15.50:0/1133321267 >> v2:172.21.15.77:3300/0 conn(0x7f1010162350 0x7f1010162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:24:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.403+0000 7f1014a01640 1 --2- 172.21.15.50:0/1133321267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101015e8e0 0x7f10100b7880 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f10100b76d0 tx=0x7f100402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347a7b7f589aaa7c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.403+0000 7f100f7fe640 1 -- 172.21.15.50:0/1133321267 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004037070 con 0x7f101015e8e0 2024-09-11T22:24:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.403+0000 7f100f7fe640 1 -- 172.21.15.50:0/1133321267 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1004032440 con 0x7f101015e8e0 2024-09-11T22:24:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.403+0000 7f100f7fe640 1 -- 172.21.15.50:0/1133321267 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004032810 con 0x7f101015e8e0 2024-09-11T22:24:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.404+0000 7f1016c65640 1 -- 172.21.15.50:0/1133321267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101015e8e0 msgr2=0x7f10100b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.404+0000 7f1016c65640 1 --2- 172.21.15.50:0/1133321267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101015e8e0 0x7f10100b7880 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f10100b76d0 tx=0x7f100402a270 comp rx=0 tx=0).stop 2024-09-11T22:24:11.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.404+0000 7f1016c65640 1 -- 172.21.15.50:0/1133321267 shutdown_connections 2024-09-11T22:24:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.404+0000 7f1016c65640 1 --2- 172.21.15.50:0/1133321267 >> v2:172.21.15.77:3300/0 conn(0x7f1010162350 0x7f1010162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.404+0000 7f1016c65640 1 --2- 172.21.15.50:0/1133321267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10100d1580 0x7f10100d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.404+0000 7f1016c65640 1 --2- 172.21.15.50:0/1133321267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101015e8e0 0x7f10100b7880 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.404+0000 7f1016c65640 1 -- 172.21.15.50:0/1133321267 >> 172.21.15.50:0/1133321267 conn(0x7f1010067ba0 msgr2=0x7f1010067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.404+0000 7f1016c65640 1 -- 172.21.15.50:0/1133321267 shutdown_connections 2024-09-11T22:24:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.404+0000 7f1016c65640 1 -- 172.21.15.50:0/1133321267 wait complete. 2024-09-11T22:24:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.405+0000 7f1016c65640 1 Processor -- start 2024-09-11T22:24:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.405+0000 7f1016c65640 1 -- start start 2024-09-11T22:24:11.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f1016c65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10100d1580 0x7f1010152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f1016c65640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101015e8e0 0x7f10101f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f1016c65640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1010162350 0x7f10100b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f1016c65640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f10100d3000 con 0x7f101015e8e0 2024-09-11T22:24:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f1016c65640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f10100d2d20 con 0x7f10100d1580 2024-09-11T22:24:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f1016c65640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1010162d40 con 0x7f1010162350 2024-09-11T22:24:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f100ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101015e8e0 0x7f10101f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f100ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101015e8e0 0x7f10101f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35574/0 (socket says 172.21.15.50:35574) 2024-09-11T22:24:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f100ffff640 1 -- 172.21.15.50:0/1252592849 learned_addr learned my addr 172.21.15.50:0/1252592849 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f1014a01640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10100d1580 0x7f1010152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f1015202640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1010162350 0x7f10100b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f100ffff640 1 -- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1010162350 msgr2=0x7f10100b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f100ffff640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1010162350 0x7f10100b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f100ffff640 1 -- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10100d1580 msgr2=0x7f1010152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f100ffff640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10100d1580 0x7f1010152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f100ffff640 1 -- 172.21.15.50:0/1252592849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10101f4800 con 0x7f101015e8e0 2024-09-11T22:24:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.406+0000 7f100ffff640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101015e8e0 0x7f10101f52c0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00e890 tx=0x7f0ffc00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.407+0000 7f100d7fa640 1 -- 172.21.15.50:0/1252592849 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc017070 con 0x7f101015e8e0 2024-09-11T22:24:11.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.407+0000 7f100d7fa640 1 -- 172.21.15.50:0/1252592849 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ffc00c940 con 0x7f101015e8e0 2024-09-11T22:24:11.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.407+0000 7f100d7fa640 1 -- 172.21.15.50:0/1252592849 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00cd10 con 0x7f101015e8e0 2024-09-11T22:24:11.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.407+0000 7f1016c65640 1 -- 172.21.15.50:0/1252592849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10100b4bc0 con 0x7f101015e8e0 2024-09-11T22:24:11.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.407+0000 7f1016c65640 1 -- 172.21.15.50:0/1252592849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10101f4ac0 con 0x7f101015e8e0 2024-09-11T22:24:11.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.408+0000 7f1016c65640 1 -- 172.21.15.50:0/1252592849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10100b7880 con 0x7f101015e8e0 2024-09-11T22:24:11.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.408+0000 7f100d7fa640 1 -- 172.21.15.50:0/1252592849 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ffc01a070 con 0x7f101015e8e0 2024-09-11T22:24:11.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.409+0000 7f100d7fa640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ff406be30 0x7f0ff406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.409+0000 7f100d7fa640 1 -- 172.21.15.50:0/1252592849 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5854+0+0 (secure 0 0 0) 0x7f0ffc08ada0 con 0x7f101015e8e0 2024-09-11T22:24:11.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.409+0000 7f1014a01640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ff406be30 0x7f0ff406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.409+0000 7f1014a01640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ff406be30 0x7f0ff406e2f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1004034000 tx=0x7f100402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.413+0000 7f100d7fa640 1 -- 172.21.15.50:0/1252592849 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ffc059100 con 0x7f101015e8e0 2024-09-11T22:24:11.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.624+0000 7f1016c65640 1 -- 172.21.15.50:0/1252592849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10100ba770 con 0x7f101015e8e0 2024-09-11T22:24:11.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.625+0000 7f100d7fa640 1 -- 172.21.15.50:0/1252592849 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) ==== 95+0+5232 (secure 0 0 0) 0x7f0ffc05d400 con 0x7f101015e8e0 2024-09-11T22:24:11.626 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:11.626 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":137,"btime":"2024-09-11T22:23:31:534171+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8441,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/15411963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":15411963},{"type":"v1","addr":"172.21.15.50:6833","nonce":15411963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":8450,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1953468151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1953468151},{"type":"v1","addr":"172.21.15.77:6836","nonce":1953468151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":8453,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3577421742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3577421742},{"type":"v1","addr":"172.21.15.77:6837","nonce":3577421742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134}],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:23:28.886790+0000","modified":"2024-09-11T22:23:30.878557+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10734":{"gid":10734,"name":"c","rank":0,"incarnation":135,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2876091212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2876091212},{"type":"v1","addr":"172.21.15.50:6835","nonce":2876091212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10734,"qdb_cluster":[10734]},"id":14}]} 2024-09-11T22:24:11.626 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 137 2024-09-11T22:24:11.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.627+0000 7f1016c65640 1 -- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ff406be30 msgr2=0x7f0ff406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.627+0000 7f1016c65640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ff406be30 0x7f0ff406e2f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1004034000 tx=0x7f100402e000 comp rx=0 tx=0).stop 2024-09-11T22:24:11.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.627+0000 7f1016c65640 1 -- 172.21.15.50:0/1252592849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101015e8e0 msgr2=0x7f10101f52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.627+0000 7f1016c65640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101015e8e0 0x7f10101f52c0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00e890 tx=0x7f0ffc00ed50 comp rx=0 tx=0).stop 2024-09-11T22:24:11.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.627+0000 7f1016c65640 1 -- 172.21.15.50:0/1252592849 shutdown_connections 2024-09-11T22:24:11.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.627+0000 7f1016c65640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0ff406be30 0x7f0ff406e2f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.627+0000 7f1016c65640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1010162350 0x7f10100b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.627+0000 7f1016c65640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f101015e8e0 0x7f10101f52c0 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.627+0000 7f1016c65640 1 --2- 172.21.15.50:0/1252592849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10100d1580 0x7f1010152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.627+0000 7f1016c65640 1 -- 172.21.15.50:0/1252592849 >> 172.21.15.50:0/1252592849 conn(0x7f1010067ba0 msgr2=0x7f1010067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:11.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.627+0000 7f1016c65640 1 -- 172.21.15.50:0/1252592849 shutdown_connections 2024-09-11T22:24:11.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.627+0000 7f1016c65640 1 -- 172.21.15.50:0/1252592849 wait complete. 2024-09-11T22:24:11.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-11T22:24:11.763 INFO:teuthology.orchestra.run.smithi050.stdout:{"message":"","return_code":0} 2024-09-11T22:24:11.763 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-11T22:24:11.763 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-11T22:24:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.807+0000 7f86ef130f40 1 Processor -- start 2024-09-11T22:24:11.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.807+0000 7f86ef130f40 1 -- start start 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ef130f40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7c37f79b0 0x55d7c37e91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ef130f40 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d7c37f7d90 0x55d7c37ec9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ef130f40 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7c37fef50 0x55d7c3769210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ef130f40 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d7c3671510 con 0x55d7c37fef50 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ef130f40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d7c37f8b00 con 0x55d7c37f79b0 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ef130f40 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d7c3768d80 con 0x55d7c37f7d90 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ed429640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7c37fef50 0x55d7c3769210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ed429640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7c37fef50 0x55d7c3769210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35582/0 (socket says 172.21.15.50:35582) 2024-09-11T22:24:11.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ed429640 1 -- 172.21.15.50:0/1826733815 learned_addr learned my addr 172.21.15.50:0/1826733815 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:11.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ed429640 1 -- 172.21.15.50:0/1826733815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d7c37f7d90 msgr2=0x55d7c37ec9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ed429640 1 --2- 172.21.15.50:0/1826733815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d7c37f7d90 0x55d7c37ec9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ed429640 1 -- 172.21.15.50:0/1826733815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7c37f79b0 msgr2=0x55d7c37e91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:11.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ed429640 1 --2- 172.21.15.50:0/1826733815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7c37f79b0 0x55d7c37e91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.808+0000 7f86ed429640 1 -- 172.21.15.50:0/1826733815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7c3768450 con 0x55d7c37fef50 2024-09-11T22:24:11.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.809+0000 7f86ed429640 1 --2- 172.21.15.50:0/1826733815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7c37fef50 0x55d7c3769210 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f86e800b610 tx=0x7f86e800bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7896b8d47c27eedd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.809+0000 7f86e6ffd640 1 -- 172.21.15.50:0/1826733815 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8014020 con 0x55d7c37fef50 2024-09-11T22:24:11.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.809+0000 7f86e6ffd640 1 -- 172.21.15.50:0/1826733815 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e8010820 con 0x55d7c37fef50 2024-09-11T22:24:11.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.809+0000 7f86e6ffd640 1 -- 172.21.15.50:0/1826733815 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8010c10 con 0x55d7c37fef50 2024-09-11T22:24:11.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.809+0000 7f86ef130f40 1 -- 172.21.15.50:0/1826733815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7c37fef50 msgr2=0x55d7c3769210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.809+0000 7f86ef130f40 1 --2- 172.21.15.50:0/1826733815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7c37fef50 0x55d7c3769210 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f86e800b610 tx=0x7f86e800bad0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.809+0000 7f86ef130f40 1 -- 172.21.15.50:0/1826733815 shutdown_connections 2024-09-11T22:24:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.809+0000 7f86ef130f40 1 --2- 172.21.15.50:0/1826733815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d7c37f7d90 0x55d7c37ec9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.809+0000 7f86ef130f40 1 --2- 172.21.15.50:0/1826733815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7c37fef50 0x55d7c3769210 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.809+0000 7f86ef130f40 1 --2- 172.21.15.50:0/1826733815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7c37f79b0 0x55d7c37e91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.809+0000 7f86ef130f40 1 -- 172.21.15.50:0/1826733815 >> 172.21.15.50:0/1826733815 conn(0x55d7c374a610 msgr2=0x55d7c37fa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.809+0000 7f86ef130f40 1 -- 172.21.15.50:0/1826733815 shutdown_connections 2024-09-11T22:24:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.809+0000 7f86ef130f40 1 -- 172.21.15.50:0/1826733815 wait complete. 2024-09-11T22:24:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.810+0000 7f86ef130f40 1 Processor -- start 2024-09-11T22:24:11.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.810+0000 7f86ef130f40 1 -- start start 2024-09-11T22:24:11.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86ef130f40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7c37f79b0 0x55d7c388d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86ef130f40 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7c37f7d90 0x55d7c37fda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86ef130f40 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d7c37fef50 0x55d7c3769210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86ef130f40 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d7c3768a10 con 0x55d7c37f7d90 2024-09-11T22:24:11.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86ef130f40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d7c3768730 con 0x55d7c37f79b0 2024-09-11T22:24:11.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86ef130f40 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d7c37f14c0 con 0x55d7c37fef50 2024-09-11T22:24:11.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7c37f7d90 0x55d7c37fda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7c37f7d90 0x55d7c37fda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35596/0 (socket says 172.21.15.50:35596) 2024-09-11T22:24:11.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86e7fff640 1 -- 172.21.15.50:0/3346638446 learned_addr learned my addr 172.21.15.50:0/3346638446 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:11.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86ecc28640 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7c37f79b0 0x55d7c388d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86ed429640 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d7c37fef50 0x55d7c3769210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86e7fff640 1 -- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d7c37fef50 msgr2=0x55d7c3769210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86e7fff640 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d7c37fef50 0x55d7c3769210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86e7fff640 1 -- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7c37f79b0 msgr2=0x55d7c388d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86e7fff640 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7c37f79b0 0x55d7c388d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86e7fff640 1 -- 172.21.15.50:0/3346638446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7c37fb060 con 0x55d7c37f7d90 2024-09-11T22:24:11.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86e7fff640 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7c37f7d90 0x55d7c37fda10 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7f86d800bd20 tx=0x7f86d8009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86e5ffb640 1 -- 172.21.15.50:0/3346638446 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d8008070 con 0x55d7c37f7d90 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86e5ffb640 1 -- 172.21.15.50:0/3346638446 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d800f630 con 0x55d7c37f7d90 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86ef130f40 1 -- 172.21.15.50:0/3346638446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7c37fb340 con 0x55d7c37f7d90 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86e5ffb640 1 -- 172.21.15.50:0/3346638446 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d800fa00 con 0x55d7c37f7d90 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.811+0000 7f86ef130f40 1 -- 172.21.15.50:0/3346638446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7c388da30 con 0x55d7c37f7d90 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.813+0000 7f86e5ffb640 1 -- 172.21.15.50:0/3346638446 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f86d800fba0 con 0x55d7c37f7d90 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.813+0000 7f86e5ffb640 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f86d006a840 0x7f86d006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.813+0000 7f86e5ffb640 1 -- 172.21.15.50:0/3346638446 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5854+0+0 (secure 0 0 0) 0x7f86d8089c00 con 0x55d7c37f7d90 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.813+0000 7f86ef130f40 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x55d7c37ef3f0 0x55d7c37ef800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.813+0000 7f86ef130f40 1 -- 172.21.15.50:0/3346638446 --> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] -- osd_op(unknown.0.0:1 29.7 29:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191) -- 0x55d7c37efd40 con 0x55d7c37ef3f0 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.813+0000 7f86ecc28640 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f86d006a840 0x7f86d006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.814+0000 7f86ed429640 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x55d7c37ef3f0 0x55d7c37ef800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:11.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.814+0000 7f86ecc28640 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f86d006a840 0x7f86d006cd00 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f86e0057000 tx=0x7f86e0051000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.814+0000 7f86ed429640 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x55d7c37ef3f0 0x55d7c37ef800 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:11.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.814+0000 7f86ed429640 1 -- 172.21.15.50:0/3346638446 <== osd.6 v2:172.21.15.77:6808/2920422022 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv5 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f86e80109d0 con 0x55d7c37ef3f0 2024-09-11T22:24:11.819 INFO:teuthology.orchestra.run.smithi050.stdout:Ysixmegssubdir  2024-09-11T22:24:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.814+0000 7f86ef130f40 1 -- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x55d7c37ef3f0 msgr2=0x55d7c37ef800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.814+0000 7f86ef130f40 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x55d7c37ef3f0 0x55d7c37ef800 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.815+0000 7f86ef130f40 1 -- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f86d006a840 msgr2=0x7f86d006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.815+0000 7f86ef130f40 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f86d006a840 0x7f86d006cd00 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f86e0057000 tx=0x7f86e0051000 comp rx=0 tx=0).stop 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.815+0000 7f86ef130f40 1 -- 172.21.15.50:0/3346638446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7c37f7d90 msgr2=0x55d7c37fda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.815+0000 7f86ef130f40 1 --2- 172.21.15.50:0/3346638446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7c37f7d90 0x55d7c37fda10 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7f86d800bd20 tx=0x7f86d8009560 comp rx=0 tx=0).stop 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.815+0000 7f86ed429640 1 -- 172.21.15.50:0/3346638446 reap_dead start 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.815+0000 7f86ef130f40 1 -- 172.21.15.50:0/3346638446 shutdown_connections 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.815+0000 7f86ef130f40 1 -- 172.21.15.50:0/3346638446 >> 172.21.15.50:0/3346638446 conn(0x55d7c374a610 msgr2=0x55d7c37671a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.815+0000 7f86ef130f40 1 -- 172.21.15.50:0/3346638446 shutdown_connections 2024-09-11T22:24:11.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:11.815+0000 7f86ef130f40 1 -- 172.21.15.50:0/3346638446 wait complete. 2024-09-11T22:24:11.822 DEBUG:teuthology.orchestra.run.smithi050:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-11T22:24:11.956 INFO:teuthology.orchestra.run.smithi050.stderr:error: stray data at end of buffer, offset 95 2024-09-11T22:24:11.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:24:11.964 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T22:24:11.964 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:24:12.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T22:24:12.062 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T22:24:12.062 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:24:12.062 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:24:12.062 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:24:12.079 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:24:12.079 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:24:12.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:24:12.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.278+0000 7fcc2e303640 1 Processor -- start 2024-09-11T22:24:12.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.278+0000 7fcc2e303640 1 -- start start 2024-09-11T22:24:12.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc2e303640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcc2815e870 0x7fcc280d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:12.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc2e303640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcc280d3c00 0x7fcc280b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc2e303640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc280cfa80 con 0x7fcc280d16d0 2024-09-11T22:24:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc2e303640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fcc280d1b40 con 0x7fcc280d3c00 2024-09-11T22:24:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc2e303640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcc280d40d0 con 0x7fcc2815e870 2024-09-11T22:24:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc2c8a0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcc280d3c00 0x7fcc280b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc277fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcc280d16d0 0x7fcc280d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49486/0 (socket says 172.21.15.50:49486) 2024-09-11T22:24:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc2c8a0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcc280d3c00 0x7fcc280b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35610/0 (socket says 172.21.15.50:35610) 2024-09-11T22:24:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc277fe640 1 -- 172.21.15.50:0/1386196600 learned_addr learned my addr 172.21.15.50:0/1386196600 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc27fff640 1 --2- 172.21.15.50:0/1386196600 >> v2:172.21.15.77:3300/0 conn(0x7fcc2815e870 0x7fcc280d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc2c8a0640 1 -- 172.21.15.50:0/1386196600 >> v2:172.21.15.77:3300/0 conn(0x7fcc2815e870 msgr2=0x7fcc280d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc2c8a0640 1 --2- 172.21.15.50:0/1386196600 >> v2:172.21.15.77:3300/0 conn(0x7fcc2815e870 0x7fcc280d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc2c8a0640 1 -- 172.21.15.50:0/1386196600 >> v1:172.21.15.50:6789/0 conn(0x7fcc280d16d0 legacy=0x7fcc280d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc2c8a0640 1 -- 172.21.15.50:0/1386196600 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc280d43b0 con 0x7fcc280d3c00 2024-09-11T22:24:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc26ffd640 1 -- 172.21.15.50:0/1386196600 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1266248184 0 0) 0x7fcc1c001110 con 0x7fcc280d16d0 2024-09-11T22:24:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.279+0000 7fcc27fff640 1 --2- 172.21.15.50:0/1386196600 >> v2:172.21.15.77:3300/0 conn(0x7fcc2815e870 0x7fcc280d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.280+0000 7fcc2c8a0640 1 --2- 172.21.15.50:0/1386196600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc280d3c00 0x7fcc280b8400 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fcc280d57c0 tx=0x7fcc2002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8ce5d17a55540e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.280+0000 7fcc26ffd640 1 -- 172.21.15.50:0/1386196600 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20007740 con 0x7fcc280d3c00 2024-09-11T22:24:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.280+0000 7fcc26ffd640 1 -- 172.21.15.50:0/1386196600 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc200078e0 con 0x7fcc280d3c00 2024-09-11T22:24:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.280+0000 7fcc26ffd640 1 -- 172.21.15.50:0/1386196600 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20007cb0 con 0x7fcc280d3c00 2024-09-11T22:24:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.281+0000 7fcc2e303640 1 -- 172.21.15.50:0/1386196600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc280d3c00 msgr2=0x7fcc280b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.281+0000 7fcc2e303640 1 --2- 172.21.15.50:0/1386196600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc280d3c00 0x7fcc280b8400 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fcc280d57c0 tx=0x7fcc2002a680 comp rx=0 tx=0).stop 2024-09-11T22:24:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.281+0000 7fcc2e303640 1 -- 172.21.15.50:0/1386196600 shutdown_connections 2024-09-11T22:24:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.281+0000 7fcc2e303640 1 --2- 172.21.15.50:0/1386196600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc280d3c00 0x7fcc280b8400 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:12.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.281+0000 7fcc2e303640 1 --2- 172.21.15.50:0/1386196600 >> v2:172.21.15.77:3300/0 conn(0x7fcc2815e870 0x7fcc280d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:12.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.281+0000 7fcc2e303640 1 -- 172.21.15.50:0/1386196600 >> 172.21.15.50:0/1386196600 conn(0x7fcc280727a0 msgr2=0x7fcc280679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:12.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.281+0000 7fcc2e303640 1 -- 172.21.15.50:0/1386196600 shutdown_connections 2024-09-11T22:24:12.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.281+0000 7fcc2e303640 1 -- 172.21.15.50:0/1386196600 wait complete. 2024-09-11T22:24:12.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.282+0000 7fcc2e303640 1 Processor -- start 2024-09-11T22:24:12.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.282+0000 7fcc2e303640 1 -- start start 2024-09-11T22:24:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2e303640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc280d16d0 0x7fcc280c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2e303640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc280d3c00 0x7fcc280b9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2e303640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc2815e870 0x7fcc281f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2e303640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2815ec50 con 0x7fcc2815e870 2024-09-11T22:24:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2e303640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcc280b7ee0 con 0x7fcc280d3c00 2024-09-11T22:24:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2e303640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcc280b78b0 con 0x7fcc280d16d0 2024-09-11T22:24:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2c8a0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc2815e870 0x7fcc281f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2c8a0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc2815e870 0x7fcc281f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35624/0 (socket says 172.21.15.50:35624) 2024-09-11T22:24:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2c8a0640 1 -- 172.21.15.50:0/2926528689 learned_addr learned my addr 172.21.15.50:0/2926528689 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc27fff640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc280d16d0 0x7fcc280c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc277fe640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc280d3c00 0x7fcc280b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2c8a0640 1 -- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc280d16d0 msgr2=0x7fcc280c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2c8a0640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc280d16d0 0x7fcc280c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2c8a0640 1 -- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc280d3c00 msgr2=0x7fcc280b9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2c8a0640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc280d3c00 0x7fcc280b9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2c8a0640 1 -- 172.21.15.50:0/2926528689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc280c8ae0 con 0x7fcc2815e870 2024-09-11T22:24:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc27fff640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc280d16d0 0x7fcc280c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc277fe640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc280d3c00 0x7fcc280b9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.283+0000 7fcc2c8a0640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc2815e870 0x7fcc281f42a0 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009e50 tx=0x7fcc20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.284+0000 7fcc24ff9640 1 -- 172.21.15.50:0/2926528689 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20040070 con 0x7fcc2815e870 2024-09-11T22:24:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.284+0000 7fcc24ff9640 1 -- 172.21.15.50:0/2926528689 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc20031cc0 con 0x7fcc2815e870 2024-09-11T22:24:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.284+0000 7fcc2e303640 1 -- 172.21.15.50:0/2926528689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc280c8dc0 con 0x7fcc2815e870 2024-09-11T22:24:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.284+0000 7fcc24ff9640 1 -- 172.21.15.50:0/2926528689 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20045680 con 0x7fcc2815e870 2024-09-11T22:24:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.284+0000 7fcc2e303640 1 -- 172.21.15.50:0/2926528689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc280c87d0 con 0x7fcc2815e870 2024-09-11T22:24:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.285+0000 7fcc2e303640 1 -- 172.21.15.50:0/2926528689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc280d1190 con 0x7fcc2815e870 2024-09-11T22:24:12.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.285+0000 7fcc24ff9640 1 -- 172.21.15.50:0/2926528689 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc20039040 con 0x7fcc2815e870 2024-09-11T22:24:12.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.286+0000 7fcc24ff9640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcc1406be30 0x7fcc1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:12.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.286+0000 7fcc24ff9640 1 -- 172.21.15.50:0/2926528689 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5854+0+0 (secure 0 0 0) 0x7fcc200ac8a0 con 0x7fcc2815e870 2024-09-11T22:24:12.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.286+0000 7fcc27fff640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcc1406be30 0x7fcc1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:12.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.287+0000 7fcc27fff640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcc1406be30 0x7fcc1406e2f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcc18006fd0 tx=0x7fcc18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:12.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.290+0000 7fcc24ff9640 1 -- 172.21.15.50:0/2926528689 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc2007acc0 con 0x7fcc2815e870 2024-09-11T22:24:12.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.478+0000 7fcc2e303640 1 -- 172.21.15.50:0/2926528689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcc28067e90 con 0x7fcc2815e870 2024-09-11T22:24:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.478+0000 7fcc24ff9640 1 -- 172.21.15.50:0/2926528689 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v191) ==== 80+0+0 (secure 0 0 0) 0x7fcc2007efc0 con 0x7fcc2815e870 2024-09-11T22:24:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2024-09-11T22:24:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.480+0000 7fcc2e303640 1 -- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcc1406be30 msgr2=0x7fcc1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.480+0000 7fcc2e303640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcc1406be30 0x7fcc1406e2f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcc18006fd0 tx=0x7fcc18008040 comp rx=0 tx=0).stop 2024-09-11T22:24:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.480+0000 7fcc2e303640 1 -- 172.21.15.50:0/2926528689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc2815e870 msgr2=0x7fcc281f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.480+0000 7fcc2e303640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc2815e870 0x7fcc281f42a0 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009e50 tx=0x7fcc20004a40 comp rx=0 tx=0).stop 2024-09-11T22:24:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.480+0000 7fcc2e303640 1 -- 172.21.15.50:0/2926528689 shutdown_connections 2024-09-11T22:24:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.480+0000 7fcc2e303640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcc1406be30 0x7fcc1406e2f0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.480+0000 7fcc2e303640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc2815e870 0x7fcc281f42a0 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.480+0000 7fcc2e303640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc280d3c00 0x7fcc280b9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.480+0000 7fcc2e303640 1 --2- 172.21.15.50:0/2926528689 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc280d16d0 0x7fcc280c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.480+0000 7fcc2e303640 1 -- 172.21.15.50:0/2926528689 >> 172.21.15.50:0/2926528689 conn(0x7fcc280727a0 msgr2=0x7fcc280b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.480+0000 7fcc2e303640 1 -- 172.21.15.50:0/2926528689 shutdown_connections 2024-09-11T22:24:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.480+0000 7fcc2e303640 1 -- 172.21.15.50:0/2926528689 wait complete. 2024-09-11T22:24:12.492 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:24:12.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:12.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:24:12.535 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:24:12.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:12.535 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:24:12.591 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:24:12.592 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:24:12.592 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:24:12.610 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:24:12.610 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:24:12.610 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:24:12.611 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:24:12.647 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:24:12.648 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T22:24:12.648 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:24:12.648 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:24:12.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:24:12.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:24:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.788+0000 7fe0cff31640 1 Processor -- start 2024-09-11T22:24:12.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.788+0000 7fe0cff31640 1 -- start start 2024-09-11T22:24:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.789+0000 7fe0cff31640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0c8162a60 0x7fe0c80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.789+0000 7fe0cff31640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c8163080 con 0x7fe0c80d1c90 2024-09-11T22:24:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.789+0000 7fe0cff31640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c80d2d20 con 0x7fe0c815e8e0 2024-09-11T22:24:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.789+0000 7fe0cff31640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe0c815ecc0 con 0x7fe0c8162a60 2024-09-11T22:24:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.789+0000 7fe0ce4ce640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0c8162a60 0x7fe0c80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.789+0000 7fe0cd4cc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe0c80d1c90 0x7fe0c8162350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49496/0 (socket says 172.21.15.50:49496) 2024-09-11T22:24:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.789+0000 7fe0ce4ce640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe0c8162a60 0x7fe0c80b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35628/0 (socket says 172.21.15.50:35628) 2024-09-11T22:24:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.789+0000 7fe0cd4cc640 1 -- 172.21.15.50:0/690488119 learned_addr learned my addr 172.21.15.50:0/690488119 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.789+0000 7fe0ce4ce640 1 -- 172.21.15.50:0/690488119 >> v1:172.21.15.77:6789/0 conn(0x7fe0c815e8e0 legacy=0x7fe0c80d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.789+0000 7fe0ce4ce640 1 -- 172.21.15.50:0/690488119 >> v1:172.21.15.50:6789/0 conn(0x7fe0c80d1c90 legacy=0x7fe0c8162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.789+0000 7fe0ce4ce640 1 -- 172.21.15.50:0/690488119 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c80d3000 con 0x7fe0c8162a60 2024-09-11T22:24:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.790+0000 7fe0ce4ce640 1 --2- 172.21.15.50:0/690488119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c8162a60 0x7fe0c80b7880 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009d90 tx=0x7fe0c002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3884e6ccd8865b88 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.790+0000 7fe0ccccb640 1 -- 172.21.15.50:0/690488119 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0007740 con 0x7fe0c8162a60 2024-09-11T22:24:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.790+0000 7fe0ccccb640 1 -- 172.21.15.50:0/690488119 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c00078e0 con 0x7fe0c8162a60 2024-09-11T22:24:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.790+0000 7fe0ccccb640 1 -- 172.21.15.50:0/690488119 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0007cb0 con 0x7fe0c8162a60 2024-09-11T22:24:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.791+0000 7fe0cff31640 1 -- 172.21.15.50:0/690488119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c8162a60 msgr2=0x7fe0c80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.791+0000 7fe0cff31640 1 --2- 172.21.15.50:0/690488119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c8162a60 0x7fe0c80b7880 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009d90 tx=0x7fe0c002a730 comp rx=0 tx=0).stop 2024-09-11T22:24:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.791+0000 7fe0cff31640 1 -- 172.21.15.50:0/690488119 shutdown_connections 2024-09-11T22:24:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.791+0000 7fe0cff31640 1 --2- 172.21.15.50:0/690488119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c8162a60 0x7fe0c80b7880 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.791+0000 7fe0cff31640 1 -- 172.21.15.50:0/690488119 >> 172.21.15.50:0/690488119 conn(0x7fe0c8067ba0 msgr2=0x7fe0c8067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.791+0000 7fe0cff31640 1 -- 172.21.15.50:0/690488119 shutdown_connections 2024-09-11T22:24:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.791+0000 7fe0cff31640 1 -- 172.21.15.50:0/690488119 wait complete. 2024-09-11T22:24:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.792+0000 7fe0cff31640 1 Processor -- start 2024-09-11T22:24:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.792+0000 7fe0cff31640 1 -- start start 2024-09-11T22:24:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.793+0000 7fe0cff31640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe0c80d1c90 0x7fe0c80ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.793+0000 7fe0cff31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c815e8e0 0x7fe0c814e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.793+0000 7fe0cff31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0c8162a60 0x7fe0c80b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.793+0000 7fe0cff31640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c80d3c10 con 0x7fe0c815e8e0 2024-09-11T22:24:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.793+0000 7fe0cff31640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c80d3a90 con 0x7fe0c8162a60 2024-09-11T22:24:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.793+0000 7fe0cff31640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c80d3d90 con 0x7fe0c80d1c90 2024-09-11T22:24:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.793+0000 7fe0cd4cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c815e8e0 0x7fe0c814e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.793+0000 7fe0cd4cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c815e8e0 0x7fe0c814e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35636/0 (socket says 172.21.15.50:35636) 2024-09-11T22:24:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.793+0000 7fe0cd4cc640 1 -- 172.21.15.50:0/108153590 learned_addr learned my addr 172.21.15.50:0/108153590 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.793+0000 7fe0ce4ce640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0c8162a60 0x7fe0c80b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.793+0000 7fe0cdccd640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe0c80d1c90 0x7fe0c80ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.794+0000 7fe0cd4cc640 1 -- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe0c80d1c90 msgr2=0x7fe0c80ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.794+0000 7fe0cd4cc640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe0c80d1c90 0x7fe0c80ab420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.794+0000 7fe0cd4cc640 1 -- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0c8162a60 msgr2=0x7fe0c80b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.794+0000 7fe0cd4cc640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0c8162a60 0x7fe0c80b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.794+0000 7fe0cd4cc640 1 -- 172.21.15.50:0/108153590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c80cd720 con 0x7fe0c815e8e0 2024-09-11T22:24:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.794+0000 7fe0cd4cc640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c815e8e0 0x7fe0c814e700 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800c400 tx=0x7fe0b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.794+0000 7fe0be7fc640 1 -- 172.21.15.50:0/108153590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8017070 con 0x7fe0c815e8e0 2024-09-11T22:24:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.794+0000 7fe0be7fc640 1 -- 172.21.15.50:0/108153590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b8005ce0 con 0x7fe0c815e8e0 2024-09-11T22:24:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.794+0000 7fe0cff31640 1 -- 172.21.15.50:0/108153590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c80b4c10 con 0x7fe0c815e8e0 2024-09-11T22:24:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.794+0000 7fe0be7fc640 1 -- 172.21.15.50:0/108153590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80072f0 con 0x7fe0c815e8e0 2024-09-11T22:24:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.794+0000 7fe0cff31640 1 -- 172.21.15.50:0/108153590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c80b51d0 con 0x7fe0c815e8e0 2024-09-11T22:24:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.795+0000 7fe0cff31640 1 -- 172.21.15.50:0/108153590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c80b7880 con 0x7fe0c815e8e0 2024-09-11T22:24:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.796+0000 7fe0be7fc640 1 -- 172.21.15.50:0/108153590 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0b801a070 con 0x7fe0c815e8e0 2024-09-11T22:24:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.796+0000 7fe0be7fc640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe0ac06be30 0x7fe0ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.796+0000 7fe0be7fc640 1 -- 172.21.15.50:0/108153590 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5854+0+0 (secure 0 0 0) 0x7fe0b808a240 con 0x7fe0c815e8e0 2024-09-11T22:24:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.796+0000 7fe0cdccd640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe0ac06be30 0x7fe0ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.797+0000 7fe0cdccd640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe0ac06be30 0x7fe0ac06e2f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4004f60 tx=0x7fe0c4007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:12.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:12.800+0000 7fe0be7fc640 1 -- 172.21.15.50:0/108153590 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe0b8058510 con 0x7fe0c815e8e0 2024-09-11T22:24:13.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.017+0000 7fe0cff31640 1 -- 172.21.15.50:0/108153590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0c80ba770 con 0x7fe0c815e8e0 2024-09-11T22:24:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.017+0000 7fe0be7fc640 1 -- 172.21.15.50:0/108153590 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) ==== 95+0+5232 (secure 0 0 0) 0x7fe0b805c810 con 0x7fe0c815e8e0 2024-09-11T22:24:13.018 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:13.018 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":137,"btime":"2024-09-11T22:23:31:534171+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8441,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/15411963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":15411963},{"type":"v1","addr":"172.21.15.50:6833","nonce":15411963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":8450,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1953468151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1953468151},{"type":"v1","addr":"172.21.15.77:6836","nonce":1953468151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":8453,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3577421742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3577421742},{"type":"v1","addr":"172.21.15.77:6837","nonce":3577421742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134}],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:23:28.886790+0000","modified":"2024-09-11T22:23:30.878557+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10734":{"gid":10734,"name":"c","rank":0,"incarnation":135,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2876091212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2876091212},{"type":"v1","addr":"172.21.15.50:6835","nonce":2876091212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10734,"qdb_cluster":[10734]},"id":14}]} 2024-09-11T22:24:13.019 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 137 2024-09-11T22:24:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.020+0000 7fe0cff31640 1 -- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe0ac06be30 msgr2=0x7fe0ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.020+0000 7fe0cff31640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe0ac06be30 0x7fe0ac06e2f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4004f60 tx=0x7fe0c4007e30 comp rx=0 tx=0).stop 2024-09-11T22:24:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.020+0000 7fe0cff31640 1 -- 172.21.15.50:0/108153590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c815e8e0 msgr2=0x7fe0c814e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.020+0000 7fe0cff31640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c815e8e0 0x7fe0c814e700 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800c400 tx=0x7fe0b800c8c0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.020+0000 7fe0cff31640 1 -- 172.21.15.50:0/108153590 shutdown_connections 2024-09-11T22:24:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.020+0000 7fe0cff31640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe0ac06be30 0x7fe0ac06e2f0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.020+0000 7fe0cff31640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0c8162a60 0x7fe0c80b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.020+0000 7fe0cff31640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0c815e8e0 0x7fe0c814e700 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.020+0000 7fe0cff31640 1 --2- 172.21.15.50:0/108153590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe0c80d1c90 0x7fe0c80ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.020+0000 7fe0cff31640 1 -- 172.21.15.50:0/108153590 >> 172.21.15.50:0/108153590 conn(0x7fe0c8067ba0 msgr2=0x7fe0c80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.020+0000 7fe0cff31640 1 -- 172.21.15.50:0/108153590 shutdown_connections 2024-09-11T22:24:13.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.020+0000 7fe0cff31640 1 -- 172.21.15.50:0/108153590 wait complete. 2024-09-11T22:24:13.032 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:24:13.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.133+0000 7f24eb43c640 1 Processor -- start 2024-09-11T22:24:13.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.133+0000 7f24eb43c640 1 -- start start 2024-09-11T22:24:13.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.134+0000 7f24eb43c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24e40b1600 0x7f24e40b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.134+0000 7f24eb43c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24e40cfbd0 con 0x7f24e40cf610 2024-09-11T22:24:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.134+0000 7f24eb43c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24e40cfeb0 con 0x7f24e4161fa0 2024-09-11T22:24:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.134+0000 7f24eb43c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f24e40d1220 con 0x7f24e40b1600 2024-09-11T22:24:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.134+0000 7f24e89d7640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f24e40cf610 0x7f24e40cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49508/0 (socket says 172.21.15.50:49508) 2024-09-11T22:24:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.134+0000 7f24e89d7640 1 -- 172.21.15.50:0/2795784227 learned_addr learned my addr 172.21.15.50:0/2795784227 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.134+0000 7f24e99d9640 1 --2- 172.21.15.50:0/2795784227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24e40b1600 0x7f24e40b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.134+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033689120 0 0) 0x7f24e40cfbd0 con 0x7f24e40cf610 2024-09-11T22:24:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.134+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24d0003520 con 0x7f24e40cf610 2024-09-11T22:24:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2770471150 0 0) 0x7f24d0003520 con 0x7f24e40cf610 2024-09-11T22:24:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24e40b1600 msgr2=0x7f24e40b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24dbfff640 1 --2- 172.21.15.50:0/2795784227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24e40b1600 0x7f24e40b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 >> v1:172.21.15.77:6789/0 conn(0x7f24e4161fa0 legacy=0x7f24e40cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e40d1470 con 0x7f24e40cf610 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f24d4001670 con 0x7f24e40cf610 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 >> v1:172.21.15.50:6789/0 conn(0x7f24e40cf610 legacy=0x7f24e40cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24dbfff640 1 --2- 172.21.15.50:0/2795784227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d00039e0 0x7f24d0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24dbfff640 1 --2- 172.21.15.50:0/2795784227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24e40b1600 0x7f24d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24dbfff640 1 --2- 172.21.15.50:0/2795784227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d0004d40 0x7f24d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24e40d1220 con 0x7f24d00039e0 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24d000ba70 con 0x7f24d0004d40 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f24d000bc70 con 0x7f24e40b1600 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24e91d8640 1 --2- 172.21.15.50:0/2795784227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d00039e0 0x7f24d0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24e89d7640 1 --2- 172.21.15.50:0/2795784227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24e40b1600 0x7f24d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24e99d9640 1 --2- 172.21.15.50:0/2795784227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d0004d40 0x7f24d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24e91d8640 1 -- 172.21.15.50:0/2795784227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24e40b1600 msgr2=0x7f24d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24e91d8640 1 --2- 172.21.15.50:0/2795784227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24e40b1600 0x7f24d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24e91d8640 1 -- 172.21.15.50:0/2795784227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d0004d40 msgr2=0x7f24d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:13.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24e91d8640 1 --2- 172.21.15.50:0/2795784227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d0004d40 0x7f24d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.135+0000 7f24e91d8640 1 -- 172.21.15.50:0/2795784227 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d0003520 con 0x7f24d00039e0 2024-09-11T22:24:13.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.136+0000 7f24e91d8640 1 --2- 172.21.15.50:0/2795784227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d00039e0 0x7f24d0003e00 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f24e0001720 tx=0x7f24d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2222e548396ac520 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:13.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.136+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e0001370 con 0x7f24d00039e0 2024-09-11T22:24:13.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.136+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e00052d0 con 0x7f24d00039e0 2024-09-11T22:24:13.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.136+0000 7f24dbfff640 1 -- 172.21.15.50:0/2795784227 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e002abc0 con 0x7f24d00039e0 2024-09-11T22:24:13.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.136+0000 7f24eb43c640 1 -- 172.21.15.50:0/2795784227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d00039e0 msgr2=0x7f24d0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.137+0000 7f24eb43c640 1 --2- 172.21.15.50:0/2795784227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24d00039e0 0x7f24d0003e00 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f24e0001720 tx=0x7f24d0005830 comp rx=0 tx=0).stop 2024-09-11T22:24:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.137+0000 7f24e99d9640 1 -- 172.21.15.50:0/2795784227 reap_dead start 2024-09-11T22:24:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.137+0000 7f24eb43c640 1 -- 172.21.15.50:0/2795784227 shutdown_connections 2024-09-11T22:24:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.137+0000 7f24eb43c640 1 -- 172.21.15.50:0/2795784227 >> 172.21.15.50:0/2795784227 conn(0x7f24e409ba50 msgr2=0x7f24e40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.137+0000 7f24eb43c640 1 -- 172.21.15.50:0/2795784227 shutdown_connections 2024-09-11T22:24:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.137+0000 7f24eb43c640 1 -- 172.21.15.50:0/2795784227 wait complete. 2024-09-11T22:24:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.138+0000 7f24eb43c640 1 Processor -- start 2024-09-11T22:24:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.138+0000 7f24eb43c640 1 -- start start 2024-09-11T22:24:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24eb43c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d00039e0 0x7f24e40cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24eb43c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24e41f4e40 0x7f24e4153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24eb43c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e41f5510 0x7f24e40b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24eb43c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24e40d1c70 con 0x7f24e41f5510 2024-09-11T22:24:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24eb43c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24e40d17e0 con 0x7f24d00039e0 2024-09-11T22:24:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24eb43c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f24e40d1df0 con 0x7f24e41f4e40 2024-09-11T22:24:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24e99d9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e41f5510 0x7f24e40b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24e99d9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e41f5510 0x7f24e40b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35652/0 (socket says 172.21.15.50:35652) 2024-09-11T22:24:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24e99d9640 1 -- 172.21.15.50:0/159072044 learned_addr learned my addr 172.21.15.50:0/159072044 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24e91d8640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d00039e0 0x7f24e40cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24e89d7640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24e41f4e40 0x7f24e4153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24e99d9640 1 -- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24e41f4e40 msgr2=0x7f24e4153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24e99d9640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24e41f4e40 0x7f24e4153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24e99d9640 1 -- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d00039e0 msgr2=0x7f24e40cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24e99d9640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d00039e0 0x7f24e40cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24e99d9640 1 -- 172.21.15.50:0/159072044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e4154070 con 0x7f24e41f5510 2024-09-11T22:24:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24e99d9640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e41f5510 0x7f24e40b30b0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7f24dc011bf0 tx=0x7f24dc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:13.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24d9ffb640 1 -- 172.21.15.50:0/159072044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc00fe10 con 0x7f24e41f5510 2024-09-11T22:24:13.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24d9ffb640 1 -- 172.21.15.50:0/159072044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24dc01d070 con 0x7f24e41f5510 2024-09-11T22:24:13.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24eb43c640 1 -- 172.21.15.50:0/159072044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e41f52c0 con 0x7f24e41f5510 2024-09-11T22:24:13.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.139+0000 7f24d9ffb640 1 -- 172.21.15.50:0/159072044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc015670 con 0x7f24e41f5510 2024-09-11T22:24:13.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.140+0000 7f24eb43c640 1 -- 172.21.15.50:0/159072044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e40c7ac0 con 0x7f24e41f5510 2024-09-11T22:24:13.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.141+0000 7f24eb43c640 1 -- 172.21.15.50:0/159072044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e40b4d20 con 0x7f24e41f5510 2024-09-11T22:24:13.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.141+0000 7f24d9ffb640 1 -- 172.21.15.50:0/159072044 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24dc015810 con 0x7f24e41f5510 2024-09-11T22:24:13.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.142+0000 7f24d9ffb640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f24c806be60 0x7f24c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.142+0000 7f24d9ffb640 1 -- 172.21.15.50:0/159072044 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5854+0+0 (secure 0 0 0) 0x7f24dc08b630 con 0x7f24e41f5510 2024-09-11T22:24:13.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.142+0000 7f24e91d8640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f24c806be60 0x7f24c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.143+0000 7f24e91d8640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f24c806be60 0x7f24c806e320 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f24e0032000 tx=0x7f24e002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:13.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.146+0000 7f24d9ffb640 1 -- 172.21.15.50:0/159072044 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24e4154070 con 0x7f24e41f5510 2024-09-11T22:24:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.357+0000 7f24eb43c640 1 -- 172.21.15.50:0/159072044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24e40afee0 con 0x7f24e41f5510 2024-09-11T22:24:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.358+0000 7f24d9ffb640 1 -- 172.21.15.50:0/159072044 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) ==== 95+0+5232 (secure 0 0 0) 0x7f24dc010040 con 0x7f24e41f5510 2024-09-11T22:24:13.359 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:13.359 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":137,"btime":"2024-09-11T22:23:31:534171+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8441,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/15411963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":15411963},{"type":"v1","addr":"172.21.15.50:6833","nonce":15411963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":8450,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1953468151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1953468151},{"type":"v1","addr":"172.21.15.77:6836","nonce":1953468151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":8453,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3577421742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3577421742},{"type":"v1","addr":"172.21.15.77:6837","nonce":3577421742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134}],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:23:28.886790+0000","modified":"2024-09-11T22:23:30.878557+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10734":{"gid":10734,"name":"c","rank":0,"incarnation":135,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2876091212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2876091212},{"type":"v1","addr":"172.21.15.50:6835","nonce":2876091212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10734,"qdb_cluster":[10734]},"id":14}]} 2024-09-11T22:24:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 137 2024-09-11T22:24:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.360+0000 7f24eb43c640 1 -- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f24c806be60 msgr2=0x7f24c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.360+0000 7f24eb43c640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f24c806be60 0x7f24c806e320 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f24e0032000 tx=0x7f24e002e000 comp rx=0 tx=0).stop 2024-09-11T22:24:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.360+0000 7f24eb43c640 1 -- 172.21.15.50:0/159072044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e41f5510 msgr2=0x7f24e40b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.360+0000 7f24eb43c640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e41f5510 0x7f24e40b30b0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7f24dc011bf0 tx=0x7f24dc00f580 comp rx=0 tx=0).stop 2024-09-11T22:24:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.360+0000 7f24eb43c640 1 -- 172.21.15.50:0/159072044 shutdown_connections 2024-09-11T22:24:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.360+0000 7f24eb43c640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f24c806be60 0x7f24c806e320 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.360+0000 7f24eb43c640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24e41f4e40 0x7f24e4153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.360+0000 7f24eb43c640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e41f5510 0x7f24e40b30b0 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.360+0000 7f24eb43c640 1 --2- 172.21.15.50:0/159072044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d00039e0 0x7f24e40cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.360+0000 7f24eb43c640 1 -- 172.21.15.50:0/159072044 >> 172.21.15.50:0/159072044 conn(0x7f24e409ba50 msgr2=0x7f24e40b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:13.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.360+0000 7f24eb43c640 1 -- 172.21.15.50:0/159072044 shutdown_connections 2024-09-11T22:24:13.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.360+0000 7f24eb43c640 1 -- 172.21.15.50:0/159072044 wait complete. 2024-09-11T22:24:13.372 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:24:13.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.474+0000 7f9c2192a640 1 Processor -- start 2024-09-11T22:24:13.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.474+0000 7f9c2192a640 1 -- start start 2024-09-11T22:24:13.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.475+0000 7f9c2192a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9c1c15e8e0 0x7f9c1c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.475+0000 7f9c2192a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c1c163080 con 0x7f9c1c0d1580 2024-09-11T22:24:13.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.475+0000 7f9c2192a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c1c0d2d20 con 0x7f9c1c162350 2024-09-11T22:24:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.475+0000 7f9c2192a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f9c1c15ecc0 con 0x7f9c1c15e8e0 2024-09-11T22:24:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.475+0000 7f9c1affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9c1c15e8e0 0x7f9c1c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.475+0000 7f9c1a7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9c1c0d1580 0x7f9c1c0d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49512/0 (socket says 172.21.15.50:49512) 2024-09-11T22:24:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.475+0000 7f9c1a7fc640 1 -- 172.21.15.50:0/1646893786 learned_addr learned my addr 172.21.15.50:0/1646893786 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.475+0000 7f9c1affd640 1 --2- 172.21.15.50:0/1646893786 >> v2:172.21.15.50:3300/0 conn(0x7f9c1c15e8e0 0x7f9c1c0b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35656/0 (socket says 172.21.15.50:35656) 2024-09-11T22:24:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.475+0000 7f9c1affd640 1 -- 172.21.15.50:0/1646893786 >> v1:172.21.15.77:6789/0 conn(0x7f9c1c162350 legacy=0x7f9c1c1627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.475+0000 7f9c1affd640 1 -- 172.21.15.50:0/1646893786 >> v1:172.21.15.50:6789/0 conn(0x7f9c1c0d1580 legacy=0x7f9c1c0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.475+0000 7f9c1affd640 1 -- 172.21.15.50:0/1646893786 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1c0d3000 con 0x7f9c1c15e8e0 2024-09-11T22:24:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.476+0000 7f9c1affd640 1 --2- 172.21.15.50:0/1646893786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c15e8e0 0x7f9c1c0b7880 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097a0 tx=0x7f9c0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e83a8495136302 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.476+0000 7f9c19ffb640 1 -- 172.21.15.50:0/1646893786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c037070 con 0x7f9c1c15e8e0 2024-09-11T22:24:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.476+0000 7f9c19ffb640 1 -- 172.21.15.50:0/1646893786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0c032440 con 0x7f9c1c15e8e0 2024-09-11T22:24:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.476+0000 7f9c19ffb640 1 -- 172.21.15.50:0/1646893786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c032810 con 0x7f9c1c15e8e0 2024-09-11T22:24:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.477+0000 7f9c2192a640 1 -- 172.21.15.50:0/1646893786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c15e8e0 msgr2=0x7f9c1c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.477+0000 7f9c2192a640 1 --2- 172.21.15.50:0/1646893786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c15e8e0 0x7f9c1c0b7880 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097a0 tx=0x7f9c0c02a270 comp rx=0 tx=0).stop 2024-09-11T22:24:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.477+0000 7f9c2192a640 1 -- 172.21.15.50:0/1646893786 shutdown_connections 2024-09-11T22:24:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.477+0000 7f9c2192a640 1 --2- 172.21.15.50:0/1646893786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c15e8e0 0x7f9c1c0b7880 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.477+0000 7f9c2192a640 1 -- 172.21.15.50:0/1646893786 >> 172.21.15.50:0/1646893786 conn(0x7f9c1c067ba0 msgr2=0x7f9c1c067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.477+0000 7f9c2192a640 1 -- 172.21.15.50:0/1646893786 shutdown_connections 2024-09-11T22:24:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.477+0000 7f9c2192a640 1 -- 172.21.15.50:0/1646893786 wait complete. 2024-09-11T22:24:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.478+0000 7f9c2192a640 1 Processor -- start 2024-09-11T22:24:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.478+0000 7f9c2192a640 1 -- start start 2024-09-11T22:24:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c2192a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0d1580 0x7f9c1c1e93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c2192a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c1c15e8e0 0x7f9c1c14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c2192a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1c162350 0x7f9c1c0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c2192a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c0d3c10 con 0x7f9c1c0d1580 2024-09-11T22:24:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c2192a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c0d3a90 con 0x7f9c1c162350 2024-09-11T22:24:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c2192a640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1c0d3d90 con 0x7f9c1c15e8e0 2024-09-11T22:24:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c1affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0d1580 0x7f9c1c1e93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c1affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0d1580 0x7f9c1c1e93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35664/0 (socket says 172.21.15.50:35664) 2024-09-11T22:24:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c1affd640 1 -- 172.21.15.50:0/2176477893 learned_addr learned my addr 172.21.15.50:0/2176477893 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c1a7fc640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c1c15e8e0 0x7f9c1c14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c1b7fe640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1c162350 0x7f9c1c0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c1affd640 1 -- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c1c15e8e0 msgr2=0x7f9c1c14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c1affd640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c1c15e8e0 0x7f9c1c14fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c1affd640 1 -- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1c162350 msgr2=0x7f9c1c0cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c1affd640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1c162350 0x7f9c1c0cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c1affd640 1 -- 172.21.15.50:0/2176477893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1c1e9900 con 0x7f9c1c0d1580 2024-09-11T22:24:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c1b7fe640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1c162350 0x7f9c1c0cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c1a7fc640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c1c15e8e0 0x7f9c1c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.479+0000 7f9c1affd640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0d1580 0x7f9c1c1e93c0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0098c0 tx=0x7f9c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.480+0000 7f9c03fff640 1 -- 172.21.15.50:0/2176477893 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c037040 con 0x7f9c1c0d1580 2024-09-11T22:24:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.480+0000 7f9c03fff640 1 -- 172.21.15.50:0/2176477893 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0c042070 con 0x7f9c1c0d1580 2024-09-11T22:24:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.480+0000 7f9c2192a640 1 -- 172.21.15.50:0/2176477893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c1c1e8320 con 0x7f9c1c0d1580 2024-09-11T22:24:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.480+0000 7f9c03fff640 1 -- 172.21.15.50:0/2176477893 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c030a70 con 0x7f9c1c0d1580 2024-09-11T22:24:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.480+0000 7f9c2192a640 1 -- 172.21.15.50:0/2176477893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c1c1e8bc0 con 0x7f9c1c0d1580 2024-09-11T22:24:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.481+0000 7f9c2192a640 1 -- 172.21.15.50:0/2176477893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c1c1e8710 con 0x7f9c1c0d1580 2024-09-11T22:24:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.481+0000 7f9c03fff640 1 -- 172.21.15.50:0/2176477893 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c0c030c10 con 0x7f9c1c0d1580 2024-09-11T22:24:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.482+0000 7f9c03fff640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.482+0000 7f9c03fff640 1 -- 172.21.15.50:0/2176477893 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5854+0+0 (secure 0 0 0) 0x7f9c0c0ab9b0 con 0x7f9c1c0d1580 2024-09-11T22:24:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.482+0000 7f9c1a7fc640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.483+0000 7f9c1a7fc640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c15df20 tx=0x7f9c10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.486+0000 7f9c03fff640 1 -- 172.21.15.50:0/2176477893 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c0c045360 con 0x7f9c1c0d1580 2024-09-11T22:24:13.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.666+0000 7f9c2192a640 1 -- 172.21.15.50:0/2176477893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c1c0ba770 con 0x7f9c1c0d1580 2024-09-11T22:24:13.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.667+0000 7f9c03fff640 1 -- 172.21.15.50:0/2176477893 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) ==== 74+0+16943 (secure 0 0 0) 0x7f9c0c07a2d0 con 0x7f9c1c0d1580 2024-09-11T22:24:13.669 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:13.669 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":191,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:23:57.592016+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:23:26.537609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-11T22:23:27.864958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.4","mappings":[{"from":6,"to":0}]},{"pgid":"29.d","mappings":[{"from":6,"to":0}]},{"pgid":"29.14","mappings":[{"from":6,"to":0}]},{"pgid":"29.19","mappings":[{"from":6,"to":0}]},{"pgid":"29.22","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:24:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.670+0000 7f9c2192a640 1 -- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 msgr2=0x7f9c0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.670+0000 7f9c2192a640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c15df20 tx=0x7f9c10009040 comp rx=0 tx=0).stop 2024-09-11T22:24:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.670+0000 7f9c2192a640 1 -- 172.21.15.50:0/2176477893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0d1580 msgr2=0x7f9c1c1e93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.670+0000 7f9c2192a640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0d1580 0x7f9c1c1e93c0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0098c0 tx=0x7f9c0c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.670+0000 7f9c2192a640 1 -- 172.21.15.50:0/2176477893 shutdown_connections 2024-09-11T22:24:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.670+0000 7f9c2192a640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9c0806be30 0x7f9c0806e2f0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.670+0000 7f9c2192a640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c1c15e8e0 0x7f9c1c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.670+0000 7f9c2192a640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1c162350 0x7f9c1c0cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.670+0000 7f9c2192a640 1 --2- 172.21.15.50:0/2176477893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c1c0d1580 0x7f9c1c1e93c0 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.670+0000 7f9c2192a640 1 -- 172.21.15.50:0/2176477893 >> 172.21.15.50:0/2176477893 conn(0x7f9c1c067ba0 msgr2=0x7f9c1c0cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.670+0000 7f9c2192a640 1 -- 172.21.15.50:0/2176477893 shutdown_connections 2024-09-11T22:24:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.670+0000 7f9c2192a640 1 -- 172.21.15.50:0/2176477893 wait complete. 2024-09-11T22:24:13.683 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:24:13.683 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:24:13.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.784+0000 7f4bad1bd640 1 Processor -- start 2024-09-11T22:24:13.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.784+0000 7f4bad1bd640 1 -- start start 2024-09-11T22:24:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.785+0000 7f4bad1bd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ba815e870 0x7f4ba80d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.785+0000 7f4bad1bd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ba80d16d0 0x7f4ba80d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.785+0000 7f4bad1bd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba80cfa80 con 0x7f4ba80d3a30 2024-09-11T22:24:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.785+0000 7f4bad1bd640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba80d3ea0 con 0x7f4ba80d16d0 2024-09-11T22:24:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.785+0000 7f4bad1bd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba80d1b10 con 0x7f4ba815e870 2024-09-11T22:24:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.785+0000 7f4ba659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ba80d16d0 0x7f4ba80d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.786+0000 7f4ba659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ba80d16d0 0x7f4ba80d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35678/0 (socket says 172.21.15.50:35678) 2024-09-11T22:24:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.786+0000 7f4ba659c640 1 -- 172.21.15.50:0/1660916283 learned_addr learned my addr 172.21.15.50:0/1660916283 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.786+0000 7f4ba659c640 1 -- 172.21.15.50:0/1660916283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ba815e870 msgr2=0x7f4ba80d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.786+0000 7f4ba6d9d640 1 --2- 172.21.15.50:0/1660916283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ba815e870 0x7f4ba80d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.786+0000 7f4ba659c640 1 --2- 172.21.15.50:0/1660916283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ba815e870 0x7f4ba80d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.786+0000 7f4ba659c640 1 -- 172.21.15.50:0/1660916283 >> v1:172.21.15.77:6789/0 conn(0x7f4ba80d3a30 legacy=0x7f4ba80b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.786+0000 7f4ba659c640 1 -- 172.21.15.50:0/1660916283 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba80d40d0 con 0x7f4ba80d16d0 2024-09-11T22:24:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.786+0000 7f4ba6d9d640 1 --2- 172.21.15.50:0/1660916283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ba815e870 0x7f4ba80d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.787+0000 7f4ba659c640 1 --2- 172.21.15.50:0/1660916283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ba80d16d0 0x7f4ba80d34f0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009870 tx=0x7f4b9c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc2262e29ab4148 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.787+0000 7f4ba5d9b640 1 -- 172.21.15.50:0/1660916283 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c037070 con 0x7f4ba80d16d0 2024-09-11T22:24:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.787+0000 7f4ba5d9b640 1 -- 172.21.15.50:0/1660916283 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9c032440 con 0x7f4ba80d16d0 2024-09-11T22:24:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.787+0000 7f4ba5d9b640 1 -- 172.21.15.50:0/1660916283 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c032810 con 0x7f4ba80d16d0 2024-09-11T22:24:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.787+0000 7f4bad1bd640 1 -- 172.21.15.50:0/1660916283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ba80d16d0 msgr2=0x7f4ba80d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.787+0000 7f4bad1bd640 1 --2- 172.21.15.50:0/1660916283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ba80d16d0 0x7f4ba80d34f0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009870 tx=0x7f4b9c02a210 comp rx=0 tx=0).stop 2024-09-11T22:24:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.787+0000 7f4bad1bd640 1 -- 172.21.15.50:0/1660916283 shutdown_connections 2024-09-11T22:24:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.787+0000 7f4bad1bd640 1 --2- 172.21.15.50:0/1660916283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ba80d16d0 0x7f4ba80d34f0 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.787+0000 7f4bad1bd640 1 --2- 172.21.15.50:0/1660916283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ba815e870 0x7f4ba80d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.787+0000 7f4bad1bd640 1 -- 172.21.15.50:0/1660916283 >> 172.21.15.50:0/1660916283 conn(0x7f4ba80727a0 msgr2=0x7f4ba80679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.787+0000 7f4bad1bd640 1 -- 172.21.15.50:0/1660916283 shutdown_connections 2024-09-11T22:24:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.787+0000 7f4bad1bd640 1 -- 172.21.15.50:0/1660916283 wait complete. 2024-09-11T22:24:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.789+0000 7f4bad1bd640 1 Processor -- start 2024-09-11T22:24:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.789+0000 7f4bad1bd640 1 -- start start 2024-09-11T22:24:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4bad1bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ba80d16d0 0x7f4ba80ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4bad1bd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ba80d3a30 0x7f4ba814a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4bad1bd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ba815e870 0x7f4ba814a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4bad1bd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba80b7ee0 con 0x7f4ba815e870 2024-09-11T22:24:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4bad1bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba80b7c00 con 0x7f4ba80d16d0 2024-09-11T22:24:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4bad1bd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba815ec50 con 0x7f4ba80d3a30 2024-09-11T22:24:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4ba759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ba815e870 0x7f4ba814a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4ba759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ba815e870 0x7f4ba814a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35680/0 (socket says 172.21.15.50:35680) 2024-09-11T22:24:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4ba759e640 1 -- 172.21.15.50:0/3958957929 learned_addr learned my addr 172.21.15.50:0/3958957929 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4ba6d9d640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ba80d16d0 0x7f4ba80ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4ba659c640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ba80d3a30 0x7f4ba814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4ba759e640 1 -- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ba80d3a30 msgr2=0x7f4ba814a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4ba759e640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ba80d3a30 0x7f4ba814a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4ba759e640 1 -- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ba80d16d0 msgr2=0x7f4ba80ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4ba759e640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ba80d16d0 0x7f4ba80ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4ba759e640 1 -- 172.21.15.50:0/3958957929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba8150ea0 con 0x7f4ba815e870 2024-09-11T22:24:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4ba759e640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ba815e870 0x7f4ba814a7d0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c780 tx=0x7f4ba000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4b8f7fe640 1 -- 172.21.15.50:0/3958957929 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0004b60 con 0x7f4ba815e870 2024-09-11T22:24:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4b8f7fe640 1 -- 172.21.15.50:0/3958957929 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba0004d00 con 0x7f4ba815e870 2024-09-11T22:24:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4bad1bd640 1 -- 172.21.15.50:0/3958957929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba81e8930 con 0x7f4ba815e870 2024-09-11T22:24:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.790+0000 7f4b8f7fe640 1 -- 172.21.15.50:0/3958957929 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000aa90 con 0x7f4ba815e870 2024-09-11T22:24:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.791+0000 7f4bad1bd640 1 -- 172.21.15.50:0/3958957929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba81e8eb0 con 0x7f4ba815e870 2024-09-11T22:24:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.792+0000 7f4bad1bd640 1 -- 172.21.15.50:0/3958957929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba814ad10 con 0x7f4ba815e870 2024-09-11T22:24:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.792+0000 7f4b8f7fe640 1 -- 172.21.15.50:0/3958957929 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ba000ac30 con 0x7f4ba815e870 2024-09-11T22:24:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.792+0000 7f4b8f7fe640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b9406be60 0x7f4b9406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.792+0000 7f4b8f7fe640 1 -- 172.21.15.50:0/3958957929 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5854+0+0 (secure 0 0 0) 0x7f4ba008aff0 con 0x7f4ba815e870 2024-09-11T22:24:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.793+0000 7f4ba6d9d640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b9406be60 0x7f4b9406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.793+0000 7f4ba6d9d640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b9406be60 0x7f4b9406e320 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800aac0 tx=0x7f4b98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:13.797+0000 7f4b8f7fe640 1 -- 172.21.15.50:0/3958957929 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ba0020070 con 0x7f4ba815e870 2024-09-11T22:24:14.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.008+0000 7f4bad1bd640 1 -- 172.21.15.50:0/3958957929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ba80b7940 con 0x7f4ba815e870 2024-09-11T22:24:14.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.008+0000 7f4b8f7fe640 1 -- 172.21.15.50:0/3958957929 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) ==== 95+0+5232 (secure 0 0 0) 0x7f4ba00592c0 con 0x7f4ba815e870 2024-09-11T22:24:14.009 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:14.009 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":137,"btime":"2024-09-11T22:23:31:534171+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8441,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/15411963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":15411963},{"type":"v1","addr":"172.21.15.50:6833","nonce":15411963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":8450,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1953468151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1953468151},{"type":"v1","addr":"172.21.15.77:6836","nonce":1953468151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":8453,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3577421742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3577421742},{"type":"v1","addr":"172.21.15.77:6837","nonce":3577421742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134}],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:23:28.886790+0000","modified":"2024-09-11T22:23:30.878557+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10734":{"gid":10734,"name":"c","rank":0,"incarnation":135,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2876091212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2876091212},{"type":"v1","addr":"172.21.15.50:6835","nonce":2876091212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10734,"qdb_cluster":[10734]},"id":14}]} 2024-09-11T22:24:14.010 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 137 2024-09-11T22:24:14.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.010+0000 7f4bad1bd640 1 -- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b9406be60 msgr2=0x7f4b9406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.010+0000 7f4bad1bd640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b9406be60 0x7f4b9406e320 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800aac0 tx=0x7f4b98008040 comp rx=0 tx=0).stop 2024-09-11T22:24:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.010+0000 7f4bad1bd640 1 -- 172.21.15.50:0/3958957929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ba815e870 msgr2=0x7f4ba814a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.010+0000 7f4bad1bd640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ba815e870 0x7f4ba814a7d0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c780 tx=0x7f4ba000cc40 comp rx=0 tx=0).stop 2024-09-11T22:24:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.010+0000 7f4bad1bd640 1 -- 172.21.15.50:0/3958957929 shutdown_connections 2024-09-11T22:24:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.010+0000 7f4bad1bd640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4b9406be60 0x7f4b9406e320 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.010+0000 7f4bad1bd640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ba80d3a30 0x7f4ba814a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.010+0000 7f4bad1bd640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ba815e870 0x7f4ba814a7d0 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.010+0000 7f4bad1bd640 1 --2- 172.21.15.50:0/3958957929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ba80d16d0 0x7f4ba80ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.010+0000 7f4bad1bd640 1 -- 172.21.15.50:0/3958957929 >> 172.21.15.50:0/3958957929 conn(0x7f4ba80727a0 msgr2=0x7f4ba815eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.011+0000 7f4bad1bd640 1 -- 172.21.15.50:0/3958957929 shutdown_connections 2024-09-11T22:24:14.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.011+0000 7f4bad1bd640 1 -- 172.21.15.50:0/3958957929 wait complete. 2024-09-11T22:24:14.023 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:24:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.124+0000 7f4308bf6640 1 Processor -- start 2024-09-11T22:24:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.124+0000 7f4308bf6640 1 -- start start 2024-09-11T22:24:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.125+0000 7f4308bf6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43040d05e0 0x7f43040b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.125+0000 7f4308bf6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43040b4f00 con 0x7f43040b3e10 2024-09-11T22:24:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.125+0000 7f4308bf6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43040b4360 con 0x7f430415c2c0 2024-09-11T22:24:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.125+0000 7f4308bf6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f43040b51c0 con 0x7f43040d05e0 2024-09-11T22:24:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.125+0000 7f4301d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43040d05e0 0x7f43040b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.125+0000 7f4302d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f43040b3e10 0x7f43040ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49520/0 (socket says 172.21.15.50:49520) 2024-09-11T22:24:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.125+0000 7f4302d9d640 1 -- 172.21.15.50:0/563856387 learned_addr learned my addr 172.21.15.50:0/563856387 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:14.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.125+0000 7f4301d9b640 1 -- 172.21.15.50:0/563856387 >> v1:172.21.15.77:6789/0 conn(0x7f430415c2c0 legacy=0x7f43040cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.125+0000 7f4301d9b640 1 -- 172.21.15.50:0/563856387 >> v1:172.21.15.50:6789/0 conn(0x7f43040b3e10 legacy=0x7f43040ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.125+0000 7f430159a640 1 -- 172.21.15.50:0/563856387 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2665979959 0 0) 0x7f43040b4f00 con 0x7f43040b3e10 2024-09-11T22:24:14.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.125+0000 7f4301d9b640 1 -- 172.21.15.50:0/563856387 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43040b54a0 con 0x7f43040d05e0 2024-09-11T22:24:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.126+0000 7f4301d9b640 1 --2- 172.21.15.50:0/563856387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43040d05e0 0x7f43040b46a0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f42f80097a0 tx=0x7f42f802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4b979a886fa7d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.126+0000 7f430159a640 1 -- 172.21.15.50:0/563856387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8037070 con 0x7f43040d05e0 2024-09-11T22:24:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.126+0000 7f430159a640 1 -- 172.21.15.50:0/563856387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f8032440 con 0x7f43040d05e0 2024-09-11T22:24:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.126+0000 7f430159a640 1 -- 172.21.15.50:0/563856387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8032810 con 0x7f43040d05e0 2024-09-11T22:24:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.127+0000 7f4308bf6640 1 -- 172.21.15.50:0/563856387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43040d05e0 msgr2=0x7f43040b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.127+0000 7f4308bf6640 1 --2- 172.21.15.50:0/563856387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43040d05e0 0x7f43040b46a0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f42f80097a0 tx=0x7f42f802a230 comp rx=0 tx=0).stop 2024-09-11T22:24:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.127+0000 7f4308bf6640 1 -- 172.21.15.50:0/563856387 shutdown_connections 2024-09-11T22:24:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.127+0000 7f4308bf6640 1 --2- 172.21.15.50:0/563856387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43040d05e0 0x7f43040b46a0 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.127+0000 7f4308bf6640 1 -- 172.21.15.50:0/563856387 >> 172.21.15.50:0/563856387 conn(0x7f43040679c0 msgr2=0x7f4304067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.127+0000 7f4308bf6640 1 -- 172.21.15.50:0/563856387 shutdown_connections 2024-09-11T22:24:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.127+0000 7f4308bf6640 1 -- 172.21.15.50:0/563856387 wait complete. 2024-09-11T22:24:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.128+0000 7f4308bf6640 1 Processor -- start 2024-09-11T22:24:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.128+0000 7f4308bf6640 1 -- start start 2024-09-11T22:24:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.129+0000 7f4308bf6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43040b3e10 0x7f43041553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.129+0000 7f4308bf6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43040d05e0 0x7f4304152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.129+0000 7f4308bf6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f430415c2c0 0x7f4304150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.129+0000 7f4308bf6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f430406d070 con 0x7f43040b3e10 2024-09-11T22:24:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.129+0000 7f4308bf6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43040ce200 con 0x7f43040d05e0 2024-09-11T22:24:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.129+0000 7f4308bf6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f430406d1f0 con 0x7f430415c2c0 2024-09-11T22:24:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.129+0000 7f430259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43040b3e10 0x7f43041553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.129+0000 7f430259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43040b3e10 0x7f43041553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35696/0 (socket says 172.21.15.50:35696) 2024-09-11T22:24:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.129+0000 7f430259c640 1 -- 172.21.15.50:0/462260949 learned_addr learned my addr 172.21.15.50:0/462260949 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.129+0000 7f4302d9d640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f430415c2c0 0x7f4304150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.129+0000 7f4301d9b640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43040d05e0 0x7f4304152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.130+0000 7f430259c640 1 -- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f430415c2c0 msgr2=0x7f4304150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.130+0000 7f430259c640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f430415c2c0 0x7f4304150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.130+0000 7f430259c640 1 -- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43040d05e0 msgr2=0x7f4304152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.130+0000 7f430259c640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43040d05e0 0x7f4304152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.130+0000 7f430259c640 1 -- 172.21.15.50:0/462260949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4304154320 con 0x7f43040b3e10 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.130+0000 7f4301d9b640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43040d05e0 0x7f4304152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.130+0000 7f430259c640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43040b3e10 0x7f43041553c0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f42f400c430 tx=0x7f42f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.130+0000 7f42f2ffd640 1 -- 172.21.15.50:0/462260949 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4017070 con 0x7f43040b3e10 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.130+0000 7f42f2ffd640 1 -- 172.21.15.50:0/462260949 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f40052d0 con 0x7f43040b3e10 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.130+0000 7f4308bf6640 1 -- 172.21.15.50:0/462260949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4304154600 con 0x7f43040b3e10 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.130+0000 7f42f2ffd640 1 -- 172.21.15.50:0/462260949 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4003830 con 0x7f43040b3e10 2024-09-11T22:24:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.130+0000 7f4308bf6640 1 -- 172.21.15.50:0/462260949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4304154ea0 con 0x7f43040b3e10 2024-09-11T22:24:14.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.131+0000 7f4308bf6640 1 -- 172.21.15.50:0/462260949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430415c6a0 con 0x7f43040b3e10 2024-09-11T22:24:14.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.131+0000 7f42f2ffd640 1 -- 172.21.15.50:0/462260949 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42f401a070 con 0x7f43040b3e10 2024-09-11T22:24:14.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.132+0000 7f42f2ffd640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f42e406be30 0x7f42e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.132+0000 7f42f2ffd640 1 -- 172.21.15.50:0/462260949 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5854+0+0 (secure 0 0 0) 0x7f42f408a1d0 con 0x7f43040b3e10 2024-09-11T22:24:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.132+0000 7f4301d9b640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f42e406be30 0x7f42e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.132+0000 7f4301d9b640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f42e406be30 0x7f42e406e2f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f42f8034000 tx=0x7f42f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.136+0000 7f42f2ffd640 1 -- 172.21.15.50:0/462260949 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42f4058b80 con 0x7f43040b3e10 2024-09-11T22:24:14.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.350+0000 7f4308bf6640 1 -- 172.21.15.50:0/462260949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43041547d0 con 0x7f43040b3e10 2024-09-11T22:24:14.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.350+0000 7f42f2ffd640 1 -- 172.21.15.50:0/462260949 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) ==== 95+0+5232 (secure 0 0 0) 0x7f42f4058480 con 0x7f43040b3e10 2024-09-11T22:24:14.351 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:14.352 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":137,"btime":"2024-09-11T22:23:31:534171+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8441,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/15411963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":15411963},{"type":"v1","addr":"172.21.15.50:6833","nonce":15411963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":8450,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1953468151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1953468151},{"type":"v1","addr":"172.21.15.77:6836","nonce":1953468151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":8453,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3577421742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3577421742},{"type":"v1","addr":"172.21.15.77:6837","nonce":3577421742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134}],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:23:28.886790+0000","modified":"2024-09-11T22:23:30.878557+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10734":{"gid":10734,"name":"c","rank":0,"incarnation":135,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2876091212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2876091212},{"type":"v1","addr":"172.21.15.50:6835","nonce":2876091212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10734,"qdb_cluster":[10734]},"id":14}]} 2024-09-11T22:24:14.352 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 137 2024-09-11T22:24:14.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.352+0000 7f4308bf6640 1 -- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f42e406be30 msgr2=0x7f42e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.352+0000 7f4308bf6640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f42e406be30 0x7f42e406e2f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f42f8034000 tx=0x7f42f802e000 comp rx=0 tx=0).stop 2024-09-11T22:24:14.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.352+0000 7f4308bf6640 1 -- 172.21.15.50:0/462260949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43040b3e10 msgr2=0x7f43041553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.352+0000 7f4308bf6640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43040b3e10 0x7f43041553c0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f42f400c430 tx=0x7f42f400c8f0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.353+0000 7f4308bf6640 1 -- 172.21.15.50:0/462260949 shutdown_connections 2024-09-11T22:24:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.353+0000 7f4308bf6640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f42e406be30 0x7f42e406e2f0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.353+0000 7f4308bf6640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f430415c2c0 0x7f4304150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.353+0000 7f4308bf6640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43040d05e0 0x7f4304152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.353+0000 7f4308bf6640 1 --2- 172.21.15.50:0/462260949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43040b3e10 0x7f43041553c0 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.353+0000 7f4308bf6640 1 -- 172.21.15.50:0/462260949 >> 172.21.15.50:0/462260949 conn(0x7f43040679c0 msgr2=0x7f43040b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.353+0000 7f4308bf6640 1 -- 172.21.15.50:0/462260949 shutdown_connections 2024-09-11T22:24:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.353+0000 7f4308bf6640 1 -- 172.21.15.50:0/462260949 wait complete. 2024-09-11T22:24:14.365 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:24:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.466+0000 7fe597d52640 1 Processor -- start 2024-09-11T22:24:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.466+0000 7fe597d52640 1 -- start start 2024-09-11T22:24:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.467+0000 7fe597d52640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe590161d30 0x7fe5900cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.467+0000 7fe597d52640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe590162110 con 0x7fe5900d11d0 2024-09-11T22:24:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.467+0000 7fe597d52640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5900cfd70 con 0x7fe5900b78f0 2024-09-11T22:24:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.467+0000 7fe597d52640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe5900d3450 con 0x7fe590161d30 2024-09-11T22:24:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.467+0000 7fe595aee640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe590161d30 0x7fe5900cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.467+0000 7fe5962ef640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe5900d11d0 0x7fe5900d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49534/0 (socket says 172.21.15.50:49534) 2024-09-11T22:24:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.467+0000 7fe595aee640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe590161d30 0x7fe5900cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35702/0 (socket says 172.21.15.50:35702) 2024-09-11T22:24:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.467+0000 7fe5962ef640 1 -- 172.21.15.50:0/333189215 learned_addr learned my addr 172.21.15.50:0/333189215 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.467+0000 7fe595aee640 1 -- 172.21.15.50:0/333189215 >> v1:172.21.15.77:6789/0 conn(0x7fe5900b78f0 legacy=0x7fe590162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.467+0000 7fe595aee640 1 -- 172.21.15.50:0/333189215 >> v1:172.21.15.50:6789/0 conn(0x7fe5900d11d0 legacy=0x7fe5900d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.467+0000 7fe595aee640 1 -- 172.21.15.50:0/333189215 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5900d2b20 con 0x7fe590161d30 2024-09-11T22:24:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.468+0000 7fe595aee640 1 --2- 172.21.15.50:0/333189215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe590161d30 0x7fe5900cf790 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7fe5840097a0 tx=0x7fe58402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1fec772d3b94a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.468+0000 7fe594aec640 1 -- 172.21.15.50:0/333189215 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe584037070 con 0x7fe590161d30 2024-09-11T22:24:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.468+0000 7fe594aec640 1 -- 172.21.15.50:0/333189215 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe584032440 con 0x7fe590161d30 2024-09-11T22:24:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.468+0000 7fe594aec640 1 -- 172.21.15.50:0/333189215 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe584032810 con 0x7fe590161d30 2024-09-11T22:24:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.469+0000 7fe597d52640 1 -- 172.21.15.50:0/333189215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe590161d30 msgr2=0x7fe5900cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.469+0000 7fe597d52640 1 --2- 172.21.15.50:0/333189215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe590161d30 0x7fe5900cf790 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7fe5840097a0 tx=0x7fe58402a230 comp rx=0 tx=0).stop 2024-09-11T22:24:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.469+0000 7fe597d52640 1 -- 172.21.15.50:0/333189215 shutdown_connections 2024-09-11T22:24:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.469+0000 7fe597d52640 1 --2- 172.21.15.50:0/333189215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe590161d30 0x7fe5900cf790 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.469+0000 7fe597d52640 1 -- 172.21.15.50:0/333189215 >> 172.21.15.50:0/333189215 conn(0x7fe5900727a0 msgr2=0x7fe5900679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.469+0000 7fe597d52640 1 -- 172.21.15.50:0/333189215 shutdown_connections 2024-09-11T22:24:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.469+0000 7fe597d52640 1 -- 172.21.15.50:0/333189215 wait complete. 2024-09-11T22:24:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.470+0000 7fe597d52640 1 Processor -- start 2024-09-11T22:24:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.470+0000 7fe597d52640 1 -- start start 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe597d52640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5900b78f0 0x7fe5900b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe597d52640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5900d11d0 0x7fe59015df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe597d52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe590161d30 0x7fe590156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe597d52640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5900b7d60 con 0x7fe5900b78f0 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe597d52640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe5900d30e0 con 0x7fe590161d30 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe597d52640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe5900d1600 con 0x7fe5900d11d0 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe595aee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5900b78f0 0x7fe5900b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe595aee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5900b78f0 0x7fe5900b5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35714/0 (socket says 172.21.15.50:35714) 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe595aee640 1 -- 172.21.15.50:0/3478001671 learned_addr learned my addr 172.21.15.50:0/3478001671 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe5952ed640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5900d11d0 0x7fe59015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe5962ef640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe590161d30 0x7fe590156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe595aee640 1 -- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5900d11d0 msgr2=0x7fe59015df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe595aee640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5900d11d0 0x7fe59015df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe595aee640 1 -- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe590161d30 msgr2=0x7fe590156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe595aee640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe590161d30 0x7fe590156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe595aee640 1 -- 172.21.15.50:0/3478001671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59015e450 con 0x7fe5900b78f0 2024-09-11T22:24:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.471+0000 7fe595aee640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5900b78f0 0x7fe5900b5250 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7fe584035040 tx=0x7fe5840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.472+0000 7fe5827fc640 1 -- 172.21.15.50:0/3478001671 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe584037040 con 0x7fe5900b78f0 2024-09-11T22:24:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.472+0000 7fe5827fc640 1 -- 172.21.15.50:0/3478001671 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe584030770 con 0x7fe5900b78f0 2024-09-11T22:24:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.472+0000 7fe597d52640 1 -- 172.21.15.50:0/3478001671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5900b5880 con 0x7fe5900b78f0 2024-09-11T22:24:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.472+0000 7fe5827fc640 1 -- 172.21.15.50:0/3478001671 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe584030b80 con 0x7fe5900b78f0 2024-09-11T22:24:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.472+0000 7fe597d52640 1 -- 172.21.15.50:0/3478001671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5900b5e40 con 0x7fe5900b78f0 2024-09-11T22:24:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.473+0000 7fe597d52640 1 -- 172.21.15.50:0/3478001671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5900d1990 con 0x7fe5900b78f0 2024-09-11T22:24:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.473+0000 7fe5827fc640 1 -- 172.21.15.50:0/3478001671 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe584044020 con 0x7fe5900b78f0 2024-09-11T22:24:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.474+0000 7fe5827fc640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe57406be30 0x7fe57406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.474+0000 7fe5827fc640 1 -- 172.21.15.50:0/3478001671 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5854+0+0 (secure 0 0 0) 0x7fe5840ab380 con 0x7fe5900b78f0 2024-09-11T22:24:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.474+0000 7fe5952ed640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe57406be30 0x7fe57406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.475+0000 7fe5952ed640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe57406be30 0x7fe57406e2f0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fe59014e1c0 tx=0x7fe58c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.478+0000 7fe5827fc640 1 -- 172.21.15.50:0/3478001671 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe584032e20 con 0x7fe5900b78f0 2024-09-11T22:24:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.657+0000 7fe597d52640 1 -- 172.21.15.50:0/3478001671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5900d2900 con 0x7fe5900b78f0 2024-09-11T22:24:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.658+0000 7fe5827fc640 1 -- 172.21.15.50:0/3478001671 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) ==== 74+0+16943 (secure 0 0 0) 0x7fe584079650 con 0x7fe5900b78f0 2024-09-11T22:24:14.659 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:14.659 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":191,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:23:57.592016+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:23:26.537609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-11T22:23:27.864958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.4","mappings":[{"from":6,"to":0}]},{"pgid":"29.d","mappings":[{"from":6,"to":0}]},{"pgid":"29.14","mappings":[{"from":6,"to":0}]},{"pgid":"29.19","mappings":[{"from":6,"to":0}]},{"pgid":"29.22","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:24:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.660+0000 7fe597d52640 1 -- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe57406be30 msgr2=0x7fe57406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.660+0000 7fe597d52640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe57406be30 0x7fe57406e2f0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fe59014e1c0 tx=0x7fe58c009040 comp rx=0 tx=0).stop 2024-09-11T22:24:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.660+0000 7fe597d52640 1 -- 172.21.15.50:0/3478001671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5900b78f0 msgr2=0x7fe5900b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.660+0000 7fe597d52640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5900b78f0 0x7fe5900b5250 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7fe584035040 tx=0x7fe5840046c0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.661+0000 7fe597d52640 1 -- 172.21.15.50:0/3478001671 shutdown_connections 2024-09-11T22:24:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.661+0000 7fe597d52640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe57406be30 0x7fe57406e2f0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.661+0000 7fe597d52640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5900d11d0 0x7fe59015df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.661+0000 7fe597d52640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe590161d30 0x7fe590156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.661+0000 7fe597d52640 1 --2- 172.21.15.50:0/3478001671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5900b78f0 0x7fe5900b5250 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.661+0000 7fe597d52640 1 -- 172.21.15.50:0/3478001671 >> 172.21.15.50:0/3478001671 conn(0x7fe5900727a0 msgr2=0x7fe5900cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.661+0000 7fe597d52640 1 -- 172.21.15.50:0/3478001671 shutdown_connections 2024-09-11T22:24:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.661+0000 7fe597d52640 1 -- 172.21.15.50:0/3478001671 wait complete. 2024-09-11T22:24:14.672 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:24:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.775+0000 7f4659a04640 1 Processor -- start 2024-09-11T22:24:14.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.775+0000 7f4659a04640 1 -- start start 2024-09-11T22:24:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.776+0000 7f4659a04640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f465415ff10 0x7f46540ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.776+0000 7f4659a04640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540ce4b0 0x7f46540ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.776+0000 7f4659a04640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46540aeba0 con 0x7f46541602f0 2024-09-11T22:24:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.776+0000 7f4659a04640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f46540aee80 con 0x7f465415ff10 2024-09-11T22:24:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.776+0000 7f4659a04640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f46540af160 con 0x7f46540ce4b0 2024-09-11T22:24:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.776+0000 7f46527fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f46541602f0 0x7f4654160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49542/0 (socket says 172.21.15.50:49542) 2024-09-11T22:24:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.776+0000 7f46527fc640 1 -- 172.21.15.50:0/2526818311 learned_addr learned my addr 172.21.15.50:0/2526818311 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.776+0000 7f46537fe640 1 --2- 172.21.15.50:0/2526818311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540ce4b0 0x7f46540ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.776+0000 7f4652ffd640 1 --2- 172.21.15.50:0/2526818311 >> v2:172.21.15.77:3300/0 conn(0x7f465415ff10 0x7f46540ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.776+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 887418587 0 0) 0x7f46540aeba0 con 0x7f46541602f0 2024-09-11T22:24:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.776+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f463c003520 con 0x7f46541602f0 2024-09-11T22:24:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2010236086 0 0) 0x7f463c003520 con 0x7f46541602f0 2024-09-11T22:24:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540ce4b0 msgr2=0x7f46540ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 --2- 172.21.15.50:0/2526818311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540ce4b0 0x7f46540ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 >> v2:172.21.15.77:3300/0 conn(0x7f465415ff10 msgr2=0x7f46540ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 --2- 172.21.15.50:0/2526818311 >> v2:172.21.15.77:3300/0 conn(0x7f465415ff10 0x7f46540ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46540af440 con 0x7f46541602f0 2024-09-11T22:24:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f4648001690 con 0x7f46541602f0 2024-09-11T22:24:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 >> v1:172.21.15.50:6789/0 conn(0x7f46541602f0 legacy=0x7f4654160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 --2- 172.21.15.50:0/2526818311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540ce4b0 0x7f463c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 --2- 172.21.15.50:0/2526818311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f463c003f30 0x7f463c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 --2- 172.21.15.50:0/2526818311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c004d40 0x7f463c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f46540aee80 con 0x7f463c004d40 2024-09-11T22:24:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46540af160 con 0x7f463c003f30 2024-09-11T22:24:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f463c00ba10 con 0x7f46540ce4b0 2024-09-11T22:24:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f46537fe640 1 --2- 172.21.15.50:0/2526818311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c004d40 0x7f463c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f4652ffd640 1 --2- 172.21.15.50:0/2526818311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540ce4b0 0x7f463c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f46527fc640 1 --2- 172.21.15.50:0/2526818311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f463c003f30 0x7f463c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f46537fe640 1 -- 172.21.15.50:0/2526818311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540ce4b0 msgr2=0x7f463c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f46537fe640 1 --2- 172.21.15.50:0/2526818311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540ce4b0 0x7f463c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f46537fe640 1 -- 172.21.15.50:0/2526818311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f463c003f30 msgr2=0x7f463c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f46537fe640 1 --2- 172.21.15.50:0/2526818311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f463c003f30 0x7f463c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.777+0000 7f46537fe640 1 -- 172.21.15.50:0/2526818311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463c003520 con 0x7f463c004d40 2024-09-11T22:24:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.778+0000 7f46537fe640 1 --2- 172.21.15.50:0/2526818311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c004d40 0x7f463c0051c0 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f464c00e170 tx=0x7f463c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6592916f5d00198 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.778+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c034020 con 0x7f463c004d40 2024-09-11T22:24:14.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.778+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f464c0305f0 con 0x7f463c004d40 2024-09-11T22:24:14.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.778+0000 7f4651ffb640 1 -- 172.21.15.50:0/2526818311 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c009c10 con 0x7f463c004d40 2024-09-11T22:24:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.779+0000 7f4659a04640 1 -- 172.21.15.50:0/2526818311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c004d40 msgr2=0x7f463c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.779+0000 7f4659a04640 1 --2- 172.21.15.50:0/2526818311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f463c004d40 0x7f463c0051c0 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f464c00e170 tx=0x7f463c005830 comp rx=0 tx=0).stop 2024-09-11T22:24:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.779+0000 7f46537fe640 1 -- 172.21.15.50:0/2526818311 reap_dead start 2024-09-11T22:24:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.779+0000 7f4659a04640 1 -- 172.21.15.50:0/2526818311 shutdown_connections 2024-09-11T22:24:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.779+0000 7f4659a04640 1 -- 172.21.15.50:0/2526818311 >> 172.21.15.50:0/2526818311 conn(0x7f4654067ff0 msgr2=0x7f46540b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.779+0000 7f4659a04640 1 -- 172.21.15.50:0/2526818311 shutdown_connections 2024-09-11T22:24:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.779+0000 7f4659a04640 1 -- 172.21.15.50:0/2526818311 wait complete. 2024-09-11T22:24:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.780+0000 7f4659a04640 1 Processor -- start 2024-09-11T22:24:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.780+0000 7f4659a04640 1 -- start start 2024-09-11T22:24:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f4659a04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465414f6a0 0x7f46540cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f4659a04640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f465415e7a0 0x7f465415ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f4659a04640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540b33d0 0x7f46540b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f4659a04640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f46540afdc0 con 0x7f465415e7a0 2024-09-11T22:24:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f4659a04640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46540afc40 con 0x7f465414f6a0 2024-09-11T22:24:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f4659a04640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f465415a180 con 0x7f46540b33d0 2024-09-11T22:24:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f46527fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f465415e7a0 0x7f465415ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f46527fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f465415e7a0 0x7f465415ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35726/0 (socket says 172.21.15.50:35726) 2024-09-11T22:24:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f46527fc640 1 -- 172.21.15.50:0/3125472304 learned_addr learned my addr 172.21.15.50:0/3125472304 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f4652ffd640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465414f6a0 0x7f46540cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f46537fe640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540b33d0 0x7f46540b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f46527fc640 1 -- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540b33d0 msgr2=0x7f46540b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f46527fc640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540b33d0 0x7f46540b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f46527fc640 1 -- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465414f6a0 msgr2=0x7f46540cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f46527fc640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465414f6a0 0x7f46540cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f46527fc640 1 -- 172.21.15.50:0/3125472304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46541f4490 con 0x7f465415e7a0 2024-09-11T22:24:14.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f46537fe640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540b33d0 0x7f46540b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:24:14.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f46527fc640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f465415e7a0 0x7f465415ec20 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f4648001eb0 tx=0x7f4648007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:14.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.781+0000 7f463bfff640 1 -- 172.21.15.50:0/3125472304 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464800f960 con 0x7f465415e7a0 2024-09-11T22:24:14.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.782+0000 7f463bfff640 1 -- 172.21.15.50:0/3125472304 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4648018070 con 0x7f465415e7a0 2024-09-11T22:24:14.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.782+0000 7f4659a04640 1 -- 172.21.15.50:0/3125472304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46541f4770 con 0x7f465415e7a0 2024-09-11T22:24:14.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.782+0000 7f463bfff640 1 -- 172.21.15.50:0/3125472304 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464800fd60 con 0x7f465415e7a0 2024-09-11T22:24:14.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.782+0000 7f4659a04640 1 -- 172.21.15.50:0/3125472304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46541f4d30 con 0x7f465415e7a0 2024-09-11T22:24:14.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.783+0000 7f4659a04640 1 -- 172.21.15.50:0/3125472304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46540ae160 con 0x7f465415e7a0 2024-09-11T22:24:14.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.783+0000 7f463bfff640 1 -- 172.21.15.50:0/3125472304 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f464801d460 con 0x7f465415e7a0 2024-09-11T22:24:14.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.783+0000 7f463bfff640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f464006be60 0x7f464006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.783+0000 7f463bfff640 1 -- 172.21.15.50:0/3125472304 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5854+0+0 (secure 0 0 0) 0x7f464808aee0 con 0x7f465415e7a0 2024-09-11T22:24:14.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.784+0000 7f4652ffd640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f464006be60 0x7f464006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.784+0000 7f4652ffd640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f464006be60 0x7f464006e320 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f4644009c40 tx=0x7f4644009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:14.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.788+0000 7f463bfff640 1 -- 172.21.15.50:0/3125472304 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4648059800 con 0x7f465415e7a0 2024-09-11T22:24:14.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:24:14.865 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:24:14.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:14.998+0000 7f4659a04640 1 -- 172.21.15.50:0/3125472304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f465415c0e0 con 0x7f465415e7a0 2024-09-11T22:24:14.999 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-11T22:24:14.999+0000 7f2a0b8d0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:24:15.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.001+0000 7f463bfff640 1 -- 172.21.15.50:0/3125472304 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v138) ==== 161+0+0 (secure 0 0 0) 0x7f4648059100 con 0x7f465415e7a0 2024-09-11T22:24:15.001 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:24:15.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.003+0000 7f4659a04640 1 -- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f464006be60 msgr2=0x7f464006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.003+0000 7f4659a04640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f464006be60 0x7f464006e320 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f4644009c40 tx=0x7f4644009190 comp rx=0 tx=0).stop 2024-09-11T22:24:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.003+0000 7f4659a04640 1 -- 172.21.15.50:0/3125472304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f465415e7a0 msgr2=0x7f465415ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.003+0000 7f4659a04640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f465415e7a0 0x7f465415ec20 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f4648001eb0 tx=0x7f4648007660 comp rx=0 tx=0).stop 2024-09-11T22:24:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.003+0000 7f4659a04640 1 -- 172.21.15.50:0/3125472304 shutdown_connections 2024-09-11T22:24:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.003+0000 7f4659a04640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f464006be60 0x7f464006e320 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.003+0000 7f4659a04640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46540b33d0 0x7f46540b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.003+0000 7f4659a04640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f465415e7a0 0x7f465415ec20 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.003+0000 7f4659a04640 1 --2- 172.21.15.50:0/3125472304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f465414f6a0 0x7f46540cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.003+0000 7f4659a04640 1 -- 172.21.15.50:0/3125472304 >> 172.21.15.50:0/3125472304 conn(0x7f4654067ff0 msgr2=0x7f465415f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.004+0000 7f4659a04640 1 -- 172.21.15.50:0/3125472304 shutdown_connections 2024-09-11T22:24:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.004+0000 7f4659a04640 1 -- 172.21.15.50:0/3125472304 wait complete. 2024-09-11T22:24:15.007 INFO:tasks.ceph.mds.c.smithi050.stderr: -5172> 2024-09-11T22:23:31.509+0000 7fd41e5ec640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:24:15.009 INFO:tasks.ceph.mds.c.smithi050.stderr: -3190> 2024-09-11T22:23:40.838+0000 7fd41a5e4640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-09-11T22:23:39.814636+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={9700=0-12582912@1} caps={9700=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=9700 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55fc2e7d6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(29)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-11T22:24:15.016 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:24:15.038 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2024-09-11T22:24:15.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.121+0000 7f5bbc41e640 1 Processor -- start 2024-09-11T22:24:15.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.122+0000 7f5bbc41e640 1 -- start start 2024-09-11T22:24:15.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.122+0000 7f5bbc41e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5bb40cf610 0x7f5bb40b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.122+0000 7f5bbc41e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bb40cfbd0 con 0x7f5bb4161fa0 2024-09-11T22:24:15.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.123+0000 7f5bbc41e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bb40cfeb0 con 0x7f5bb40b1600 2024-09-11T22:24:15.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.123+0000 7f5bbc41e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb40d1220 con 0x7f5bb40cf610 2024-09-11T22:24:15.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.123+0000 7f5bba1ba640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5bb4161fa0 0x7f5bb40cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49560/0 (socket says 172.21.15.50:49560) 2024-09-11T22:24:15.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.123+0000 7f5bba1ba640 1 -- 172.21.15.50:0/1722843840 learned_addr learned my addr 172.21.15.50:0/1722843840 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:15.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.123+0000 7f5bb99b9640 1 --2- 172.21.15.50:0/1722843840 >> v2:172.21.15.50:3300/0 conn(0x7f5bb40cf610 0x7f5bb40b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.123+0000 7f5bb99b9640 1 -- 172.21.15.50:0/1722843840 >> v1:172.21.15.77:6789/0 conn(0x7f5bb40b1600 legacy=0x7f5bb40cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.123+0000 7f5bb99b9640 1 -- 172.21.15.50:0/1722843840 >> v1:172.21.15.50:6789/0 conn(0x7f5bb4161fa0 legacy=0x7f5bb40cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.123+0000 7f5bb99b9640 1 -- 172.21.15.50:0/1722843840 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb40d1470 con 0x7f5bb40cf610 2024-09-11T22:24:15.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.123+0000 7f5bb91b8640 1 -- 172.21.15.50:0/1722843840 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165204402 0 0) 0x7f5bb40cfbd0 con 0x7f5bb4161fa0 2024-09-11T22:24:15.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.124+0000 7f5bb99b9640 1 --2- 172.21.15.50:0/1722843840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb40cf610 0x7f5bb40b4d20 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40097a0 tx=0x7f5ba402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20b5026a14b9209 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:15.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.124+0000 7f5bb91b8640 1 -- 172.21.15.50:0/1722843840 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4037070 con 0x7f5bb40cf610 2024-09-11T22:24:15.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.124+0000 7f5bb91b8640 1 -- 172.21.15.50:0/1722843840 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4032440 con 0x7f5bb40cf610 2024-09-11T22:24:15.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.124+0000 7f5bb91b8640 1 -- 172.21.15.50:0/1722843840 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4032810 con 0x7f5bb40cf610 2024-09-11T22:24:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.124+0000 7f5bbc41e640 1 -- 172.21.15.50:0/1722843840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb40cf610 msgr2=0x7f5bb40b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.124+0000 7f5bbc41e640 1 --2- 172.21.15.50:0/1722843840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb40cf610 0x7f5bb40b4d20 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40097a0 tx=0x7f5ba402a230 comp rx=0 tx=0).stop 2024-09-11T22:24:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.124+0000 7f5bbc41e640 1 -- 172.21.15.50:0/1722843840 shutdown_connections 2024-09-11T22:24:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.124+0000 7f5bbc41e640 1 --2- 172.21.15.50:0/1722843840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb40cf610 0x7f5bb40b4d20 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.124+0000 7f5bbc41e640 1 -- 172.21.15.50:0/1722843840 >> 172.21.15.50:0/1722843840 conn(0x7f5bb409ba50 msgr2=0x7f5bb40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.125+0000 7f5bbc41e640 1 -- 172.21.15.50:0/1722843840 shutdown_connections 2024-09-11T22:24:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.125+0000 7f5bbc41e640 1 -- 172.21.15.50:0/1722843840 wait complete. 2024-09-11T22:24:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.126+0000 7f5bbc41e640 1 Processor -- start 2024-09-11T22:24:15.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.126+0000 7f5bbc41e640 1 -- start start 2024-09-11T22:24:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.126+0000 7f5bbc41e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb40b1600 0x7f5bb40b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.126+0000 7f5bbc41e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb40cf610 0x7f5bb40b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.126+0000 7f5bbc41e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb4161fa0 0x7f5bb40b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.126+0000 7f5bbc41e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb40d1c70 con 0x7f5bb40b1600 2024-09-11T22:24:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.126+0000 7f5bbc41e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb40d17e0 con 0x7f5bb40cf610 2024-09-11T22:24:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.126+0000 7f5bbc41e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb40d1df0 con 0x7f5bb4161fa0 2024-09-11T22:24:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bba1ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb40b1600 0x7f5bb40b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bba1ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb40b1600 0x7f5bb40b7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35760/0 (socket says 172.21.15.50:35760) 2024-09-11T22:24:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bba1ba640 1 -- 172.21.15.50:0/3276396528 learned_addr learned my addr 172.21.15.50:0/3276396528 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bb99b9640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb40cf610 0x7f5bb40b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bba9bb640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb4161fa0 0x7f5bb40b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bba1ba640 1 -- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb4161fa0 msgr2=0x7f5bb40b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bba1ba640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb4161fa0 0x7f5bb40b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bba1ba640 1 -- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb40cf610 msgr2=0x7f5bb40b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bba1ba640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb40cf610 0x7f5bb40b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bba1ba640 1 -- 172.21.15.50:0/3276396528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb40b68c0 con 0x7f5bb40b1600 2024-09-11T22:24:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bba9bb640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb4161fa0 0x7f5bb40b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:24:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bba1ba640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb40b1600 0x7f5bb40b7f10 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000c4d0 tx=0x7f5bb000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5baaffd640 1 -- 172.21.15.50:0/3276396528 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0018070 con 0x7f5bb40b1600 2024-09-11T22:24:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5baaffd640 1 -- 172.21.15.50:0/3276396528 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb00074e0 con 0x7f5bb40b1600 2024-09-11T22:24:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5baaffd640 1 -- 172.21.15.50:0/3276396528 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0004a20 con 0x7f5bb40b1600 2024-09-11T22:24:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bbc41e640 1 -- 172.21.15.50:0/3276396528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb40b8450 con 0x7f5bb40b1600 2024-09-11T22:24:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.127+0000 7f5bbc41e640 1 -- 172.21.15.50:0/3276396528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb40c9e10 con 0x7f5bb40b1600 2024-09-11T22:24:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.128+0000 7f5bbc41e640 1 -- 172.21.15.50:0/3276396528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb40a0830 con 0x7f5bb40b1600 2024-09-11T22:24:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.129+0000 7f5baaffd640 1 -- 172.21.15.50:0/3276396528 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5bb001b070 con 0x7f5bb40b1600 2024-09-11T22:24:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.129+0000 7f5baaffd640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b9806be30 0x7f5b9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.129+0000 7f5baaffd640 1 -- 172.21.15.50:0/3276396528 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5940+0+0 (secure 0 0 0) 0x7f5bb008a190 con 0x7f5bb40b1600 2024-09-11T22:24:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.129+0000 7f5bb99b9640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b9806be30 0x7f5b9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.130+0000 7f5bb99b9640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b9806be30 0x7f5b9806e2f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4034000 tx=0x7f5ba402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.133+0000 7f5baaffd640 1 -- 172.21.15.50:0/3276396528 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5bb0058490 con 0x7f5bb40b1600 2024-09-11T22:24:15.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:15.347+0000 7f5bbc41e640 1 -- 172.21.15.50:0/3276396528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5bb406e240 con 0x7f5bb40b1600 2024-09-11T22:24:16.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.006+0000 7f5baaffd640 1 -- 172.21.15.50:0/3276396528 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v139) ==== 104+0+0 (secure 0 0 0) 0x7f5bb005c790 con 0x7f5bb40b1600 2024-09-11T22:24:16.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.009+0000 7f5bbc41e640 1 -- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b9806be30 msgr2=0x7f5b9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:16.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.009+0000 7f5bbc41e640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b9806be30 0x7f5b9806e2f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4034000 tx=0x7f5ba402e000 comp rx=0 tx=0).stop 2024-09-11T22:24:16.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.009+0000 7f5bbc41e640 1 -- 172.21.15.50:0/3276396528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb40b1600 msgr2=0x7f5bb40b7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:16.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.009+0000 7f5bbc41e640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb40b1600 0x7f5bb40b7f10 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000c4d0 tx=0x7f5bb000c990 comp rx=0 tx=0).stop 2024-09-11T22:24:16.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.009+0000 7f5bbc41e640 1 -- 172.21.15.50:0/3276396528 shutdown_connections 2024-09-11T22:24:16.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.009+0000 7f5bbc41e640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b9806be30 0x7f5b9806e2f0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:16.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.009+0000 7f5bbc41e640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb4161fa0 0x7f5bb40b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:16.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.009+0000 7f5bbc41e640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb40cf610 0x7f5bb40b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:16.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.009+0000 7f5bbc41e640 1 --2- 172.21.15.50:0/3276396528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bb40b1600 0x7f5bb40b7f10 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:16.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.009+0000 7f5bbc41e640 1 -- 172.21.15.50:0/3276396528 >> 172.21.15.50:0/3276396528 conn(0x7f5bb409ba50 msgr2=0x7f5bb40af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:16.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.009+0000 7f5bbc41e640 1 -- 172.21.15.50:0/3276396528 shutdown_connections 2024-09-11T22:24:16.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.010+0000 7f5bbc41e640 1 -- 172.21.15.50:0/3276396528 wait complete. 2024-09-11T22:24:16.025 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:24:16.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.179+0000 7fb59608c640 1 Processor -- start 2024-09-11T22:24:16.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.179+0000 7fb59608c640 1 -- start start 2024-09-11T22:24:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb59608c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb59015e870 0x7fb5900d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb59608c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb5900d3c00 0x7fb5900b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb59608c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5900cfa80 con 0x7fb5900d16d0 2024-09-11T22:24:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb59608c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fb5900d1b40 con 0x7fb59015e870 2024-09-11T22:24:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb59608c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb5900d40d0 con 0x7fb5900d3c00 2024-09-11T22:24:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb58f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb59015e870 0x7fb5900d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb586ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb5900d16d0 0x7fb5900d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49570/0 (socket says 172.21.15.50:49570) 2024-09-11T22:24:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb586ffd640 1 -- 172.21.15.50:0/2963442126 learned_addr learned my addr 172.21.15.50:0/2963442126 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:16.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb58f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb59015e870 0x7fb5900d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35772/0 (socket says 172.21.15.50:35772) 2024-09-11T22:24:16.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb58ffff640 1 --2- 172.21.15.50:0/2963442126 >> v2:172.21.15.77:3300/0 conn(0x7fb5900d3c00 0x7fb5900b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:16.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb58f7fe640 1 -- 172.21.15.50:0/2963442126 >> v2:172.21.15.77:3300/0 conn(0x7fb5900d3c00 msgr2=0x7fb5900b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:16.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb58f7fe640 1 --2- 172.21.15.50:0/2963442126 >> v2:172.21.15.77:3300/0 conn(0x7fb5900d3c00 0x7fb5900b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:16.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb58f7fe640 1 -- 172.21.15.50:0/2963442126 >> v1:172.21.15.50:6789/0 conn(0x7fb5900d16d0 legacy=0x7fb5900d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:16.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb58f7fe640 1 -- 172.21.15.50:0/2963442126 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5900d43b0 con 0x7fb59015e870 2024-09-11T22:24:16.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.180+0000 7fb58effd640 1 -- 172.21.15.50:0/2963442126 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1260460677 0 0) 0x7fb578001110 con 0x7fb5900d16d0 2024-09-11T22:24:16.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.181+0000 7fb58f7fe640 1 --2- 172.21.15.50:0/2963442126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb59015e870 0x7fb5900d1190 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7fb590068490 tx=0x7fb58002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7d3006b7c3d3d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:16.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.181+0000 7fb58effd640 1 -- 172.21.15.50:0/2963442126 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb580037070 con 0x7fb59015e870 2024-09-11T22:24:16.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.181+0000 7fb58effd640 1 -- 172.21.15.50:0/2963442126 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb580032440 con 0x7fb59015e870 2024-09-11T22:24:16.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.181+0000 7fb58effd640 1 -- 172.21.15.50:0/2963442126 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb580032810 con 0x7fb59015e870 2024-09-11T22:24:16.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.182+0000 7fb59608c640 1 -- 172.21.15.50:0/2963442126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb59015e870 msgr2=0x7fb5900d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:16.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.182+0000 7fb59608c640 1 --2- 172.21.15.50:0/2963442126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb59015e870 0x7fb5900d1190 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7fb590068490 tx=0x7fb58002a1a0 comp rx=0 tx=0).stop 2024-09-11T22:24:16.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.182+0000 7fb59608c640 1 -- 172.21.15.50:0/2963442126 shutdown_connections 2024-09-11T22:24:16.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.182+0000 7fb59608c640 1 --2- 172.21.15.50:0/2963442126 >> v2:172.21.15.77:3300/0 conn(0x7fb5900d3c00 0x7fb5900b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:16.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.182+0000 7fb59608c640 1 --2- 172.21.15.50:0/2963442126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb59015e870 0x7fb5900d1190 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:16.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.182+0000 7fb59608c640 1 -- 172.21.15.50:0/2963442126 >> 172.21.15.50:0/2963442126 conn(0x7fb5900727a0 msgr2=0x7fb5900679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:16.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.182+0000 7fb59608c640 1 -- 172.21.15.50:0/2963442126 shutdown_connections 2024-09-11T22:24:16.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.182+0000 7fb59608c640 1 -- 172.21.15.50:0/2963442126 wait complete. 2024-09-11T22:24:16.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.183+0000 7fb59608c640 1 Processor -- start 2024-09-11T22:24:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.183+0000 7fb59608c640 1 -- start start 2024-09-11T22:24:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb59608c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900d16d0 0x7fb590161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb59608c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5900d3c00 0x7fb5900b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb59608c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb59015e870 0x7fb5901547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb59608c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb59015ec50 con 0x7fb5900d16d0 2024-09-11T22:24:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb59608c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb5900b7ee0 con 0x7fb59015e870 2024-09-11T22:24:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb59608c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb5900b78b0 con 0x7fb5900d3c00 2024-09-11T22:24:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb58f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900d16d0 0x7fb590161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb58f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900d16d0 0x7fb590161290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35780/0 (socket says 172.21.15.50:35780) 2024-09-11T22:24:16.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb58f7fe640 1 -- 172.21.15.50:0/2365590217 learned_addr learned my addr 172.21.15.50:0/2365590217 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb58f7fe640 1 -- 172.21.15.50:0/2365590217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5900d3c00 msgr2=0x7fb5900b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb58f7fe640 1 --2- 172.21.15.50:0/2365590217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5900d3c00 0x7fb5900b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb58f7fe640 1 -- 172.21.15.50:0/2365590217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb59015e870 msgr2=0x7fb5901547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb58f7fe640 1 --2- 172.21.15.50:0/2365590217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb59015e870 0x7fb5901547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb58f7fe640 1 -- 172.21.15.50:0/2365590217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5900ca380 con 0x7fb5900d16d0 2024-09-11T22:24:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.184+0000 7fb58f7fe640 1 --2- 172.21.15.50:0/2365590217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900d16d0 0x7fb590161290 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7fb580000c00 tx=0x7fb5800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.185+0000 7fb58cff9640 1 -- 172.21.15.50:0/2365590217 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb580037040 con 0x7fb5900d16d0 2024-09-11T22:24:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.185+0000 7fb58cff9640 1 -- 172.21.15.50:0/2365590217 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb580042070 con 0x7fb5900d16d0 2024-09-11T22:24:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.185+0000 7fb59608c640 1 -- 172.21.15.50:0/2365590217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5900ca660 con 0x7fb5900d16d0 2024-09-11T22:24:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.185+0000 7fb58cff9640 1 -- 172.21.15.50:0/2365590217 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb580030bd0 con 0x7fb5900d16d0 2024-09-11T22:24:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.185+0000 7fb59608c640 1 -- 172.21.15.50:0/2365590217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5900cac20 con 0x7fb5900d16d0 2024-09-11T22:24:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.186+0000 7fb59608c640 1 -- 172.21.15.50:0/2365590217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5900d1190 con 0x7fb5900d16d0 2024-09-11T22:24:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.186+0000 7fb58cff9640 1 -- 172.21.15.50:0/2365590217 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb580047460 con 0x7fb5900d16d0 2024-09-11T22:24:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.187+0000 7fb58cff9640 1 --2- 172.21.15.50:0/2365590217 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb57006be30 0x7fb57006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.187+0000 7fb58cff9640 1 -- 172.21.15.50:0/2365590217 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5940+0+0 (secure 0 0 0) 0x7fb5800abbc0 con 0x7fb5900d16d0 2024-09-11T22:24:16.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.187+0000 7fb586ffd640 1 --2- 172.21.15.50:0/2365590217 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb57006be30 0x7fb57006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:16.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.187+0000 7fb586ffd640 1 --2- 172.21.15.50:0/2365590217 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb57006be30 0x7fb57006e2f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb578007fd0 tx=0x7fb578007960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.191+0000 7fb58cff9640 1 -- 172.21.15.50:0/2365590217 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb580032e20 con 0x7fb5900d16d0 2024-09-11T22:24:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:16.368+0000 7fb59608c640 1 -- 172.21.15.50:0/2365590217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb5900cb2d0 con 0x7fb5900d16d0 2024-09-11T22:24:17.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.007+0000 7fb58cff9640 1 -- 172.21.15.50:0/2365590217 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v193) ==== 181+0+0 (secure 0 0 0) 0x7fb580045360 con 0x7fb5900d16d0 2024-09-11T22:24:17.008 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:24:17.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.011+0000 7fb59608c640 1 -- 172.21.15.50:0/2365590217 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb57006be30 msgr2=0x7fb57006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:17.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.011+0000 7fb59608c640 1 --2- 172.21.15.50:0/2365590217 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb57006be30 0x7fb57006e2f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb578007fd0 tx=0x7fb578007960 comp rx=0 tx=0).stop 2024-09-11T22:24:17.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.011+0000 7fb59608c640 1 -- 172.21.15.50:0/2365590217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900d16d0 msgr2=0x7fb590161290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:17.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.011+0000 7fb59608c640 1 --2- 172.21.15.50:0/2365590217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900d16d0 0x7fb590161290 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7fb580000c00 tx=0x7fb5800046c0 comp rx=0 tx=0).stop 2024-09-11T22:24:17.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.011+0000 7fb59608c640 1 -- 172.21.15.50:0/2365590217 shutdown_connections 2024-09-11T22:24:17.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.011+0000 7fb59608c640 1 --2- 172.21.15.50:0/2365590217 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fb57006be30 0x7fb57006e2f0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.011+0000 7fb59608c640 1 --2- 172.21.15.50:0/2365590217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5900d3c00 0x7fb5900b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.011+0000 7fb59608c640 1 --2- 172.21.15.50:0/2365590217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb59015e870 0x7fb5901547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.011+0000 7fb59608c640 1 --2- 172.21.15.50:0/2365590217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5900d16d0 0x7fb590161290 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.011+0000 7fb59608c640 1 -- 172.21.15.50:0/2365590217 >> 172.21.15.50:0/2365590217 conn(0x7fb5900727a0 msgr2=0x7fb5900d2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.011+0000 7fb59608c640 1 -- 172.21.15.50:0/2365590217 shutdown_connections 2024-09-11T22:24:17.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.012+0000 7fb59608c640 1 -- 172.21.15.50:0/2365590217 wait complete. 2024-09-11T22:24:17.026 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:24:17.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.137+0000 7f98a413b640 1 Processor -- start 2024-09-11T22:24:17.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.137+0000 7f98a413b640 1 -- start start 2024-09-11T22:24:17.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.138+0000 7f98a413b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f989c0b2d90 0x7f989c141400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:17.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.138+0000 7f98a413b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989c141940 con 0x7f989c06e870 2024-09-11T22:24:17.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.138+0000 7f98a413b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989c0b4ba0 con 0x7f989c140b70 2024-09-11T22:24:17.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.138+0000 7f98a413b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f989c0b4950 con 0x7f989c0b2d90 2024-09-11T22:24:17.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.138+0000 7f98a1ed7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f989c0b2d90 0x7f989c141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:17.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.138+0000 7f98a26d8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f989c06e870 0x7f989c13ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49584/0 (socket says 172.21.15.50:49584) 2024-09-11T22:24:17.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.138+0000 7f98a26d8640 1 -- 172.21.15.50:0/3925809799 learned_addr learned my addr 172.21.15.50:0/3925809799 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:17.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.138+0000 7f98a1ed7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f989c0b2d90 0x7f989c141400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35784/0 (socket says 172.21.15.50:35784) 2024-09-11T22:24:17.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.138+0000 7f98a1ed7640 1 -- 172.21.15.50:0/3925809799 >> v1:172.21.15.77:6789/0 conn(0x7f989c140b70 legacy=0x7f989c06e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:17.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.139+0000 7f98a1ed7640 1 -- 172.21.15.50:0/3925809799 >> v1:172.21.15.50:6789/0 conn(0x7f989c06e870 legacy=0x7f989c13ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:17.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.139+0000 7f98a0ed5640 1 -- 172.21.15.50:0/3925809799 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223663117 0 0) 0x7f988c001490 con 0x7f989c06e870 2024-09-11T22:24:17.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.139+0000 7f98a1ed7640 1 -- 172.21.15.50:0/3925809799 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c0b4e80 con 0x7f989c0b2d90 2024-09-11T22:24:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.139+0000 7f98a1ed7640 1 --2- 172.21.15.50:0/3925809799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c0b2d90 0x7f989c141400 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f98940097a0 tx=0x7f989402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a743402543463274 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.139+0000 7f98a0ed5640 1 -- 172.21.15.50:0/3925809799 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894037070 con 0x7f989c0b2d90 2024-09-11T22:24:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.139+0000 7f98a0ed5640 1 -- 172.21.15.50:0/3925809799 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9894032440 con 0x7f989c0b2d90 2024-09-11T22:24:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.140+0000 7f98a0ed5640 1 -- 172.21.15.50:0/3925809799 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894032810 con 0x7f989c0b2d90 2024-09-11T22:24:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.140+0000 7f98a413b640 1 -- 172.21.15.50:0/3925809799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c0b2d90 msgr2=0x7f989c141400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.140+0000 7f98a413b640 1 --2- 172.21.15.50:0/3925809799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c0b2d90 0x7f989c141400 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f98940097a0 tx=0x7f989402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:24:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.140+0000 7f98a413b640 1 -- 172.21.15.50:0/3925809799 shutdown_connections 2024-09-11T22:24:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.140+0000 7f98a413b640 1 --2- 172.21.15.50:0/3925809799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c0b2d90 0x7f989c141400 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.140+0000 7f98a413b640 1 -- 172.21.15.50:0/3925809799 >> 172.21.15.50:0/3925809799 conn(0x7f989c075270 msgr2=0x7f989c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.140+0000 7f98a413b640 1 -- 172.21.15.50:0/3925809799 shutdown_connections 2024-09-11T22:24:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.140+0000 7f98a413b640 1 -- 172.21.15.50:0/3925809799 wait complete. 2024-09-11T22:24:17.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.141+0000 7f98a413b640 1 Processor -- start 2024-09-11T22:24:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.141+0000 7f98a413b640 1 -- start start 2024-09-11T22:24:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.142+0000 7f98a413b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f989c06e870 0x7f989c1f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.142+0000 7f98a413b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c0b2d90 0x7f989c0b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.142+0000 7f98a413b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c140b70 0x7f989c0b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.142+0000 7f98a413b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f989c0b5720 con 0x7f989c0b2d90 2024-09-11T22:24:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.142+0000 7f98a413b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f989c0b5440 con 0x7f989c140b70 2024-09-11T22:24:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.142+0000 7f98a413b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f989c0b3170 con 0x7f989c06e870 2024-09-11T22:24:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.142+0000 7f98a16d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c0b2d90 0x7f989c0b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.142+0000 7f98a16d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c0b2d90 0x7f989c0b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35800/0 (socket says 172.21.15.50:35800) 2024-09-11T22:24:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.142+0000 7f98a16d6640 1 -- 172.21.15.50:0/2158158909 learned_addr learned my addr 172.21.15.50:0/2158158909 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.142+0000 7f98a26d8640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c140b70 0x7f989c0b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.142+0000 7f98a1ed7640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f989c06e870 0x7f989c1f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.143+0000 7f98a16d6640 1 -- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f989c06e870 msgr2=0x7f989c1f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.143+0000 7f98a16d6640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f989c06e870 0x7f989c1f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.143+0000 7f98a16d6640 1 -- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c140b70 msgr2=0x7f989c0b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.143+0000 7f98a16d6640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c140b70 0x7f989c0b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.143+0000 7f98a16d6640 1 -- 172.21.15.50:0/2158158909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c13d430 con 0x7f989c0b2d90 2024-09-11T22:24:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.143+0000 7f98a16d6640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c0b2d90 0x7f989c0b3840 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f989000b3c0 tx=0x7f989000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.143+0000 7f989a7fc640 1 -- 172.21.15.50:0/2158158909 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890015020 con 0x7f989c0b2d90 2024-09-11T22:24:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.143+0000 7f989a7fc640 1 -- 172.21.15.50:0/2158158909 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9890011830 con 0x7f989c0b2d90 2024-09-11T22:24:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.143+0000 7f989a7fc640 1 -- 172.21.15.50:0/2158158909 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890011c60 con 0x7f989c0b2d90 2024-09-11T22:24:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.143+0000 7f98a413b640 1 -- 172.21.15.50:0/2158158909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989c0aad60 con 0x7f989c0b2d90 2024-09-11T22:24:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.143+0000 7f98a413b640 1 -- 172.21.15.50:0/2158158909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f989c0ab320 con 0x7f989c0b2d90 2024-09-11T22:24:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.144+0000 7f98a413b640 1 -- 172.21.15.50:0/2158158909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f989c141400 con 0x7f989c0b2d90 2024-09-11T22:24:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.144+0000 7f989a7fc640 1 -- 172.21.15.50:0/2158158909 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9890018020 con 0x7f989c0b2d90 2024-09-11T22:24:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.145+0000 7f989a7fc640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f988806be30 0x7f988806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.145+0000 7f989a7fc640 1 -- 172.21.15.50:0/2158158909 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 5502+0+0 (secure 0 0 0) 0x7f989008a960 con 0x7f989c0b2d90 2024-09-11T22:24:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.145+0000 7f98a1ed7640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f988806be30 0x7f988806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.146+0000 7f98a1ed7640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f988806be30 0x7f988806e2f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f9894034000 tx=0x7f989402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:17.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.149+0000 7f989a7fc640 1 -- 172.21.15.50:0/2158158909 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f989001f030 con 0x7f989c0b2d90 2024-09-11T22:24:17.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:17.327+0000 7f98a413b640 1 -- 172.21.15.50:0/2158158909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f989c15c9c0 con 0x7f989c0b2d90 2024-09-11T22:24:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.012+0000 7f989a7fc640 1 -- 172.21.15.50:0/2158158909 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v194) ==== 169+0+0 (secure 0 0 0) 0x7f98900593d0 con 0x7f989c0b2d90 2024-09-11T22:24:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-11T22:24:18.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.017+0000 7f98a413b640 1 -- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f988806be30 msgr2=0x7f988806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.017+0000 7f98a413b640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f988806be30 0x7f988806e2f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f9894034000 tx=0x7f989402e000 comp rx=0 tx=0).stop 2024-09-11T22:24:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.017+0000 7f98a413b640 1 -- 172.21.15.50:0/2158158909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c0b2d90 msgr2=0x7f989c0b3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.017+0000 7f98a413b640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c0b2d90 0x7f989c0b3840 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f989000b3c0 tx=0x7f989000b880 comp rx=0 tx=0).stop 2024-09-11T22:24:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.017+0000 7f98a413b640 1 -- 172.21.15.50:0/2158158909 shutdown_connections 2024-09-11T22:24:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.017+0000 7f98a413b640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f988806be30 0x7f988806e2f0 secure :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f9894034000 tx=0x7f989402e000 comp rx=0 tx=0).stop 2024-09-11T22:24:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.017+0000 7f98a413b640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f989c140b70 0x7f989c0b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.017+0000 7f98a413b640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c0b2d90 0x7f989c0b3840 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.017+0000 7f98a413b640 1 --2- 172.21.15.50:0/2158158909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f989c06e870 0x7f989c1f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.017+0000 7f98a413b640 1 -- 172.21.15.50:0/2158158909 >> 172.21.15.50:0/2158158909 conn(0x7f989c075270 msgr2=0x7f989c072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.018+0000 7f98a413b640 1 -- 172.21.15.50:0/2158158909 shutdown_connections 2024-09-11T22:24:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.018+0000 7f98a413b640 1 -- 172.21.15.50:0/2158158909 wait complete. 2024-09-11T22:24:18.034 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T22:24:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.147+0000 7fd52f62e640 1 Processor -- start 2024-09-11T22:24:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.147+0000 7fd52f62e640 1 -- start start 2024-09-11T22:24:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.148+0000 7fd52f62e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd52806ee20 0x7fd5280d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.148+0000 7fd52f62e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5280d0760 0x7fd528071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.148+0000 7fd52f62e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5280b44a0 con 0x7fd528162940 2024-09-11T22:24:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.148+0000 7fd52f62e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd5280b3400 con 0x7fd5280d0760 2024-09-11T22:24:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.148+0000 7fd52f62e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5280b36e0 con 0x7fd52806ee20 2024-09-11T22:24:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.148+0000 7fd52d3ca640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd528162940 0x7fd52806e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51784/0 (socket says 172.21.15.50:51784) 2024-09-11T22:24:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.148+0000 7fd52d3ca640 1 -- 172.21.15.50:0/3578533038 learned_addr learned my addr 172.21.15.50:0/3578533038 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.148+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 777698526 0 0) 0x7fd5280b44a0 con 0x7fd528162940 2024-09-11T22:24:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd514003520 con 0x7fd528162940 2024-09-11T22:24:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd52dbcb640 1 --2- 172.21.15.50:0/3578533038 >> v2:172.21.15.77:3300/0 conn(0x7fd5280d0760 0x7fd528071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd52cbc9640 1 --2- 172.21.15.50:0/3578533038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd52806ee20 0x7fd5280d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1215716462 0 0) 0x7fd514003520 con 0x7fd528162940 2024-09-11T22:24:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd52806ee20 msgr2=0x7fd5280d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 --2- 172.21.15.50:0/3578533038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd52806ee20 0x7fd5280d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 >> v2:172.21.15.77:3300/0 conn(0x7fd5280d0760 msgr2=0x7fd528071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 --2- 172.21.15.50:0/3578533038 >> v2:172.21.15.77:3300/0 conn(0x7fd5280d0760 0x7fd528071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5280b39c0 con 0x7fd528162940 2024-09-11T22:24:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7fd524001670 con 0x7fd528162940 2024-09-11T22:24:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 >> v1:172.21.15.50:6789/0 conn(0x7fd528162940 legacy=0x7fd52806e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 --2- 172.21.15.50:0/3578533038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5140039b0 0x7fd514003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 --2- 172.21.15.50:0/3578533038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514004800 0x7fd514004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 --2- 172.21.15.50:0/3578533038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd52806ee20 0x7fd5140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd5280b3400 con 0x7fd5140039b0 2024-09-11T22:24:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5280b36e0 con 0x7fd514004800 2024-09-11T22:24:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd51400baa0 con 0x7fd52806ee20 2024-09-11T22:24:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd52d3ca640 1 --2- 172.21.15.50:0/3578533038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5140039b0 0x7fd514003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd52cbc9640 1 --2- 172.21.15.50:0/3578533038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514004800 0x7fd514004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd52dbcb640 1 --2- 172.21.15.50:0/3578533038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd52806ee20 0x7fd5140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd52d3ca640 1 -- 172.21.15.50:0/3578533038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd52806ee20 msgr2=0x7fd5140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd52d3ca640 1 --2- 172.21.15.50:0/3578533038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd52806ee20 0x7fd5140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd52d3ca640 1 -- 172.21.15.50:0/3578533038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514004800 msgr2=0x7fd514004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd52d3ca640 1 --2- 172.21.15.50:0/3578533038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514004800 0x7fd514004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.149+0000 7fd52d3ca640 1 -- 172.21.15.50:0/3578533038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd514003520 con 0x7fd5140039b0 2024-09-11T22:24:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.150+0000 7fd52d3ca640 1 --2- 172.21.15.50:0/3578533038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5140039b0 0x7fd514003dd0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7fd524007fd0 tx=0x7fd514005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63841f04e011f31f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.150+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524007d50 con 0x7fd5140039b0 2024-09-11T22:24:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.150+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5240058d0 con 0x7fd5140039b0 2024-09-11T22:24:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.150+0000 7fd51ffff640 1 -- 172.21.15.50:0/3578533038 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524005ca0 con 0x7fd5140039b0 2024-09-11T22:24:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.151+0000 7fd52f62e640 1 -- 172.21.15.50:0/3578533038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5140039b0 msgr2=0x7fd514003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.151+0000 7fd52f62e640 1 --2- 172.21.15.50:0/3578533038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5140039b0 0x7fd514003dd0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7fd524007fd0 tx=0x7fd514005830 comp rx=0 tx=0).stop 2024-09-11T22:24:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.151+0000 7fd52dbcb640 1 -- 172.21.15.50:0/3578533038 reap_dead start 2024-09-11T22:24:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.151+0000 7fd52f62e640 1 -- 172.21.15.50:0/3578533038 shutdown_connections 2024-09-11T22:24:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.151+0000 7fd52f62e640 1 -- 172.21.15.50:0/3578533038 >> 172.21.15.50:0/3578533038 conn(0x7fd5280679c0 msgr2=0x7fd528067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.151+0000 7fd52f62e640 1 -- 172.21.15.50:0/3578533038 shutdown_connections 2024-09-11T22:24:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.151+0000 7fd52f62e640 1 -- 172.21.15.50:0/3578533038 wait complete. 2024-09-11T22:24:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.152+0000 7fd52f62e640 1 Processor -- start 2024-09-11T22:24:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.152+0000 7fd52f62e640 1 -- start start 2024-09-11T22:24:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52f62e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5140039b0 0x7fd528157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52f62e640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd52815b3b0 0x7fd5281fc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52f62e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd52815c4b0 0x7fd52815c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52f62e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd5280d0bb0 con 0x7fd52815c4b0 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52f62e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5280b3f80 con 0x7fd5140039b0 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52f62e640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd528162d20 con 0x7fd52815b3b0 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52dbcb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd52815c4b0 0x7fd52815c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52dbcb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd52815c4b0 0x7fd52815c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40576/0 (socket says 172.21.15.50:40576) 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52dbcb640 1 -- 172.21.15.50:0/4073229123 learned_addr learned my addr 172.21.15.50:0/4073229123 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52d3ca640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5140039b0 0x7fd528157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52cbc9640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd52815b3b0 0x7fd5281fc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52dbcb640 1 -- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd52815b3b0 msgr2=0x7fd5281fc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52dbcb640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd52815b3b0 0x7fd5281fc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52dbcb640 1 -- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5140039b0 msgr2=0x7fd528157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52dbcb640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5140039b0 0x7fd528157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52dbcb640 1 -- 172.21.15.50:0/4073229123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5281fcdd0 con 0x7fd52815c4b0 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.153+0000 7fd52dbcb640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd52815c4b0 0x7fd52815c930 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7fd5280b5850 tx=0x7fd520007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.154+0000 7fd51dffb640 1 -- 172.21.15.50:0/4073229123 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5200046a0 con 0x7fd52815c4b0 2024-09-11T22:24:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.154+0000 7fd51dffb640 1 -- 172.21.15.50:0/4073229123 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd52001a070 con 0x7fd52815c4b0 2024-09-11T22:24:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.154+0000 7fd52f62e640 1 -- 172.21.15.50:0/4073229123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5281fd0b0 con 0x7fd52815c4b0 2024-09-11T22:24:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.154+0000 7fd51dffb640 1 -- 172.21.15.50:0/4073229123 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520015640 con 0x7fd52815c4b0 2024-09-11T22:24:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.154+0000 7fd52f62e640 1 -- 172.21.15.50:0/4073229123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd528158fd0 con 0x7fd52815c4b0 2024-09-11T22:24:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.155+0000 7fd52f62e640 1 -- 172.21.15.50:0/4073229123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd528072850 con 0x7fd52815c4b0 2024-09-11T22:24:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.155+0000 7fd51dffb640 1 -- 172.21.15.50:0/4073229123 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5200157e0 con 0x7fd52815c4b0 2024-09-11T22:24:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.156+0000 7fd51dffb640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd50c06be30 0x7fd50c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.156+0000 7fd51dffb640 1 -- 172.21.15.50:0/4073229123 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fd52008afa0 con 0x7fd52815c4b0 2024-09-11T22:24:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.156+0000 7fd52d3ca640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd50c06be30 0x7fd50c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.156+0000 7fd52d3ca640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd50c06be30 0x7fd50c06e2f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fd524033000 tx=0x7fd524009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.160+0000 7fd51dffb640 1 -- 172.21.15.50:0/4073229123 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd520059600 con 0x7fd52815c4b0 2024-09-11T22:24:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.337+0000 7fd52f62e640 1 -- 172.21.15.50:0/4073229123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fd5280731a0 con 0x7fd52815c4b0 2024-09-11T22:24:18.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.341+0000 7fd51dffb640 1 -- 172.21.15.50:0/4073229123 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7fd52005d900 con 0x7fd52815c4b0 2024-09-11T22:24:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.343+0000 7fd52f62e640 1 -- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd50c06be30 msgr2=0x7fd50c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.343+0000 7fd52f62e640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd50c06be30 0x7fd50c06e2f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fd524033000 tx=0x7fd524009030 comp rx=0 tx=0).stop 2024-09-11T22:24:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.343+0000 7fd52f62e640 1 -- 172.21.15.50:0/4073229123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd52815c4b0 msgr2=0x7fd52815c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.343+0000 7fd52f62e640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd52815c4b0 0x7fd52815c930 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7fd5280b5850 tx=0x7fd520007700 comp rx=0 tx=0).stop 2024-09-11T22:24:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.343+0000 7fd52f62e640 1 -- 172.21.15.50:0/4073229123 shutdown_connections 2024-09-11T22:24:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.343+0000 7fd52f62e640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd50c06be30 0x7fd50c06e2f0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.343+0000 7fd52f62e640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd52815b3b0 0x7fd5281fc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.343+0000 7fd52f62e640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd52815c4b0 0x7fd52815c930 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.343+0000 7fd52f62e640 1 --2- 172.21.15.50:0/4073229123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5140039b0 0x7fd528157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.343+0000 7fd52f62e640 1 -- 172.21.15.50:0/4073229123 >> 172.21.15.50:0/4073229123 conn(0x7fd5280679c0 msgr2=0x7fd528158370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.343+0000 7fd52f62e640 1 -- 172.21.15.50:0/4073229123 shutdown_connections 2024-09-11T22:24:18.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.343+0000 7fd52f62e640 1 -- 172.21.15.50:0/4073229123 wait complete. 2024-09-11T22:24:18.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-11T22:24:18.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.456+0000 7f7c569a6640 1 Processor -- start 2024-09-11T22:24:18.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.456+0000 7f7c569a6640 1 -- start start 2024-09-11T22:24:18.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.457+0000 7f7c569a6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5006e0f0 0x7f7c5006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.457+0000 7f7c569a6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7c50072e60 0x7f7c500711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.457+0000 7f7c569a6640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c5015b7e0 con 0x7f7c5015b400 2024-09-11T22:24:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.457+0000 7f7c569a6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7c5015f140 con 0x7f7c50072e60 2024-09-11T22:24:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.457+0000 7f7c569a6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c5015f420 con 0x7f7c5006e0f0 2024-09-11T22:24:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.457+0000 7f7c4ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7c5015b400 0x7f7c5006d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51796/0 (socket says 172.21.15.50:51796) 2024-09-11T22:24:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.457+0000 7f7c4ffff640 1 -- 172.21.15.50:0/3538037286 learned_addr learned my addr 172.21.15.50:0/3538037286 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.458+0000 7f7c54f43640 1 --2- 172.21.15.50:0/3538037286 >> v2:172.21.15.77:3300/0 conn(0x7f7c50072e60 0x7f7c500711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.458+0000 7f7c4f7fe640 1 --2- 172.21.15.50:0/3538037286 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5006e0f0 0x7f7c5006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.458+0000 7f7c4effd640 1 -- 172.21.15.50:0/3538037286 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2375287032 0 0) 0x7f7c5015b7e0 con 0x7f7c5015b400 2024-09-11T22:24:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.458+0000 7f7c4effd640 1 -- 172.21.15.50:0/3538037286 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c38003520 con 0x7f7c5015b400 2024-09-11T22:24:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.458+0000 7f7c4f7fe640 1 -- 172.21.15.50:0/3538037286 >> v2:172.21.15.77:3300/0 conn(0x7f7c50072e60 msgr2=0x7f7c500711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:18.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.458+0000 7f7c4f7fe640 1 --2- 172.21.15.50:0/3538037286 >> v2:172.21.15.77:3300/0 conn(0x7f7c50072e60 0x7f7c500711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.458+0000 7f7c4effd640 1 -- 172.21.15.50:0/3538037286 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2160553853 0 0) 0x7f7c38003520 con 0x7f7c5015b400 2024-09-11T22:24:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.458+0000 7f7c4f7fe640 1 -- 172.21.15.50:0/3538037286 >> v1:172.21.15.50:6789/0 conn(0x7f7c5015b400 legacy=0x7f7c5006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.458+0000 7f7c4f7fe640 1 -- 172.21.15.50:0/3538037286 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5015f700 con 0x7f7c5006e0f0 2024-09-11T22:24:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.458+0000 7f7c54f43640 1 --2- 172.21.15.50:0/3538037286 >> v2:172.21.15.77:3300/0 conn(0x7f7c50072e60 0x7f7c500711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:24:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.459+0000 7f7c4f7fe640 1 --2- 172.21.15.50:0/3538037286 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5006e0f0 0x7f7c5006d070 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7c440097a0 tx=0x7f7c4402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=639f2180ba261f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.459+0000 7f7c4effd640 1 -- 172.21.15.50:0/3538037286 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c44037070 con 0x7f7c5006e0f0 2024-09-11T22:24:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.459+0000 7f7c4effd640 1 -- 172.21.15.50:0/3538037286 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4402aba0 con 0x7f7c5006e0f0 2024-09-11T22:24:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.459+0000 7f7c4effd640 1 -- 172.21.15.50:0/3538037286 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40001670 con 0x7f7c5006e0f0 2024-09-11T22:24:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.459+0000 7f7c569a6640 1 -- 172.21.15.50:0/3538037286 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5006e0f0 msgr2=0x7f7c5006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.459+0000 7f7c569a6640 1 --2- 172.21.15.50:0/3538037286 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5006e0f0 0x7f7c5006d070 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7c440097a0 tx=0x7f7c4402a110 comp rx=0 tx=0).stop 2024-09-11T22:24:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.460+0000 7f7c569a6640 1 -- 172.21.15.50:0/3538037286 shutdown_connections 2024-09-11T22:24:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.460+0000 7f7c569a6640 1 --2- 172.21.15.50:0/3538037286 >> v2:172.21.15.77:3300/0 conn(0x7f7c50072e60 0x7f7c500711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.460+0000 7f7c569a6640 1 --2- 172.21.15.50:0/3538037286 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5006e0f0 0x7f7c5006d070 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.460+0000 7f7c569a6640 1 -- 172.21.15.50:0/3538037286 >> 172.21.15.50:0/3538037286 conn(0x7f7c500679c0 msgr2=0x7f7c50067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.460+0000 7f7c569a6640 1 -- 172.21.15.50:0/3538037286 shutdown_connections 2024-09-11T22:24:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.460+0000 7f7c569a6640 1 -- 172.21.15.50:0/3538037286 wait complete. 2024-09-11T22:24:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.461+0000 7f7c569a6640 1 Processor -- start 2024-09-11T22:24:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.461+0000 7f7c569a6640 1 -- start start 2024-09-11T22:24:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c569a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5006e0f0 0x7f7c5015e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c569a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50072e60 0x7f7c50156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c569a6640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5015b400 0x7f7c5015b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c569a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c50071700 con 0x7f7c5006e0f0 2024-09-11T22:24:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c569a6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c500cfc50 con 0x7f7c50072e60 2024-09-11T22:24:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c569a6640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c50071880 con 0x7f7c5015b400 2024-09-11T22:24:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c4ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5006e0f0 0x7f7c5015e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c4ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5006e0f0 0x7f7c5015e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40578/0 (socket says 172.21.15.50:40578) 2024-09-11T22:24:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c4ffff640 1 -- 172.21.15.50:0/2634918213 learned_addr learned my addr 172.21.15.50:0/2634918213 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c54f43640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5015b400 0x7f7c5015b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c4f7fe640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50072e60 0x7f7c50156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c4ffff640 1 -- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5015b400 msgr2=0x7f7c5015b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c4ffff640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5015b400 0x7f7c5015b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c4ffff640 1 -- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50072e60 msgr2=0x7f7c50156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c4ffff640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50072e60 0x7f7c50156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c4ffff640 1 -- 172.21.15.50:0/2634918213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c50157850 con 0x7f7c5006e0f0 2024-09-11T22:24:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c4f7fe640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50072e60 0x7f7c50156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.462+0000 7f7c4ffff640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5006e0f0 0x7f7c5015e110 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000c700 tx=0x7f7c4000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.463+0000 7f7c4cff9640 1 -- 172.21.15.50:0/2634918213 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40017070 con 0x7f7c5006e0f0 2024-09-11T22:24:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.463+0000 7f7c4cff9640 1 -- 172.21.15.50:0/2634918213 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c40005ce0 con 0x7f7c5006e0f0 2024-09-11T22:24:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.463+0000 7f7c569a6640 1 -- 172.21.15.50:0/2634918213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c50157b30 con 0x7f7c5006e0f0 2024-09-11T22:24:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.463+0000 7f7c4cff9640 1 -- 172.21.15.50:0/2634918213 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40007270 con 0x7f7c5006e0f0 2024-09-11T22:24:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.463+0000 7f7c569a6640 1 -- 172.21.15.50:0/2634918213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c5014afd0 con 0x7f7c5006e0f0 2024-09-11T22:24:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.464+0000 7f7c569a6640 1 -- 172.21.15.50:0/2634918213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c5014b260 con 0x7f7c5006e0f0 2024-09-11T22:24:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.464+0000 7f7c4cff9640 1 -- 172.21.15.50:0/2634918213 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c4001a070 con 0x7f7c5006e0f0 2024-09-11T22:24:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.465+0000 7f7c4cff9640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c3c06be30 0x7f7c3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.465+0000 7f7c4cff9640 1 -- 172.21.15.50:0/2634918213 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f7c40089db0 con 0x7f7c5006e0f0 2024-09-11T22:24:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.465+0000 7f7c4f7fe640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c3c06be30 0x7f7c3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.466+0000 7f7c4f7fe640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c3c06be30 0x7f7c3c06e2f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7c44034000 tx=0x7f7c4402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:18.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.469+0000 7f7c4cff9640 1 -- 172.21.15.50:0/2634918213 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c5014b260 con 0x7f7c5006e0f0 2024-09-11T22:24:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:18.712+0000 7f7c569a6640 1 -- 172.21.15.50:0/2634918213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f7c5006d070 con 0x7f7c5006e0f0 2024-09-11T22:24:19.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:19.014+0000 7f7c4cff9640 1 -- 172.21.15.50:0/2634918213 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v623) ==== 133+0+0 (secure 0 0 0) 0x7f7c400584a0 con 0x7f7c5006e0f0 2024-09-11T22:24:19.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:19.017+0000 7f7c569a6640 1 -- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c3c06be30 msgr2=0x7f7c3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:19.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:19.017+0000 7f7c569a6640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c3c06be30 0x7f7c3c06e2f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7c44034000 tx=0x7f7c4402e000 comp rx=0 tx=0).stop 2024-09-11T22:24:19.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:19.017+0000 7f7c569a6640 1 -- 172.21.15.50:0/2634918213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5006e0f0 msgr2=0x7f7c5015e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:19.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:19.017+0000 7f7c569a6640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5006e0f0 0x7f7c5015e110 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000c700 tx=0x7f7c4000cb00 comp rx=0 tx=0).stop 2024-09-11T22:24:19.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:19.017+0000 7f7c569a6640 1 -- 172.21.15.50:0/2634918213 shutdown_connections 2024-09-11T22:24:19.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:19.017+0000 7f7c569a6640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c3c06be30 0x7f7c3c06e2f0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:19.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:19.017+0000 7f7c569a6640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5015b400 0x7f7c5015b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:19.017+0000 7f7c569a6640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50072e60 0x7f7c50156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:19.017+0000 7f7c569a6640 1 --2- 172.21.15.50:0/2634918213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c5006e0f0 0x7f7c5015e110 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:19.017+0000 7f7c569a6640 1 -- 172.21.15.50:0/2634918213 >> 172.21.15.50:0/2634918213 conn(0x7f7c500679c0 msgr2=0x7f7c500b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:19.018+0000 7f7c569a6640 1 -- 172.21.15.50:0/2634918213 shutdown_connections 2024-09-11T22:24:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:19.018+0000 7f7c569a6640 1 -- 172.21.15.50:0/2634918213 wait complete. 2024-09-11T22:24:19.035 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ERROR 2024-09-11T22:24:19.035 INFO:tasks.cephfs_test_runner: 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_scrub.py", line 175, in test_scrub_backtrace 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner: self._scrub(BacktraceWorkload(self, self.fs, self.mount_a)) 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_scrub.py", line 143, in _scrub 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner: errors = workload.validate() 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_scrub.py", line 70, in validate 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner: bt = self._filesystem.read_backtrace(st['st_ino']) 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-11T22:24:19.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner: 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner:Ran 13 tests in 761.454s 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner: 2024-09-11T22:24:19.037 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-09-11T22:24:19.038 INFO:tasks.cephfs_test_runner: 2024-09-11T22:24:19.038 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-11T22:24:19.038 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-11T22:24:19.038 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-11T22:24:19.038 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_scrub.py", line 175, in test_scrub_backtrace 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: self._scrub(BacktraceWorkload(self, self.fs, self.mount_a)) 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_scrub.py", line 143, in _scrub 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: errors = workload.validate() 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_scrub.py", line 70, in validate 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: bt = self._filesystem.read_backtrace(st['st_ino']) 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-11T22:24:19.039 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-11T22:24:19.040 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-11T22:24:19.040 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-11T22:24:19.040 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-11T22:24:19.040 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-11T22:24:19.040 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-11T22:24:19.040 INFO:tasks.cephfs_test_runner: 2024-09-11T22:24:19.040 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-11T22:24:19.824 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d77c5cc798bd40cdb867436cd1641c29 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-11T22:24:19.827 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-11T22:24:19.837 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-11T22:24:19.844 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-11T22:24:19.845 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:24:19.845 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:24:19.868 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:24:19.868 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-11T22:24:19.868 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:24:19.928 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=247 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T22:24:19.928 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:24:19.928 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:24:19.948 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:24:19.948 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-11T22:24:19.948 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:24:20.007 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=316 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T22:24:20.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:20.007 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:24:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T22:24:20.028 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:24:20.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:20.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T22:24:20.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:20.100 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:24:20.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:20.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-09-11T22:24:20.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:20.262 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-11T22:24:20.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:20.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-09-11T22:24:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2024-09-11T22:24:20.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:24:20.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:20.352 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-11T22:24:20.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T22:24:20.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T22:24:20.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:20.372 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T22:24:20.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:20.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T22:24:20.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:20.511 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-09-11T22:24:20.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:20.608 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-11T22:24:20.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:24:20.624 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-09-11T22:24:20.693 INFO:teuthology.orchestra.run.smithi077.stderr:Cannot find device "ceph-brx" 2024-09-11T22:24:20.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:24:20.694 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T22:24:20.705 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:24:20.705 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:24:20.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.819+0000 7f4ce5159640 1 Processor -- start 2024-09-11T22:24:20.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.819+0000 7f4ce5159640 1 -- start start 2024-09-11T22:24:20.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.820+0000 7f4ce5159640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ce015c2c0 0x7f4ce00b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:20.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.820+0000 7f4ce5159640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ce00b3e10 0x7f4ce00cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:20.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.820+0000 7f4ce5159640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ce00b4f00 con 0x7f4ce00d0410 2024-09-11T22:24:20.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.820+0000 7f4ce5159640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f4ce00cf7a0 con 0x7f4ce015c2c0 2024-09-11T22:24:20.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.820+0000 7f4ce5159640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce00d0840 con 0x7f4ce00b3e10 2024-09-11T22:24:20.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.820+0000 7f4cded9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ce015c2c0 0x7f4ce00b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:20.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.820+0000 7f4cded9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ce015c2c0 0x7f4ce00b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40580/0 (socket says 172.21.15.50:40580) 2024-09-11T22:24:20.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.820+0000 7f4cded9d640 1 -- 172.21.15.50:0/2529113951 learned_addr learned my addr 172.21.15.50:0/2529113951 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:20.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.820+0000 7f4cdf59e640 1 --1- 172.21.15.50:0/2529113951 >> v1:172.21.15.50:6789/0 conn(0x7f4ce00d0410 0x7f4ce015fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51812/0 (socket says 172.21.15.50:51812) 2024-09-11T22:24:20.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.820+0000 7f4cde59c640 1 --2- 172.21.15.50:0/2529113951 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ce00b3e10 0x7f4ce00cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:20.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.821+0000 7f4cded9d640 1 -- 172.21.15.50:0/2529113951 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ce00b3e10 msgr2=0x7f4ce00cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:20.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.821+0000 7f4cded9d640 1 --2- 172.21.15.50:0/2529113951 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ce00b3e10 0x7f4ce00cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:20.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.821+0000 7f4cded9d640 1 -- 172.21.15.50:0/2529113951 >> v1:172.21.15.50:6789/0 conn(0x7f4ce00d0410 legacy=0x7f4ce015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:20.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.821+0000 7f4cded9d640 1 -- 172.21.15.50:0/2529113951 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce00b4360 con 0x7f4ce015c2c0 2024-09-11T22:24:20.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.821+0000 7f4cded9d640 1 --2- 172.21.15.50:0/2529113951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce015c2c0 0x7f4ce00b46a0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009e50 tx=0x7f4cd002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e336b5ed2cec98b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:20.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.821+0000 7f4cddd9b640 1 -- 172.21.15.50:0/2529113951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0036070 con 0x7f4ce015c2c0 2024-09-11T22:24:20.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.821+0000 7f4cddd9b640 1 -- 172.21.15.50:0/2529113951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd0031600 con 0x7f4ce015c2c0 2024-09-11T22:24:20.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.821+0000 7f4cddd9b640 1 -- 172.21.15.50:0/2529113951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00319d0 con 0x7f4ce015c2c0 2024-09-11T22:24:20.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.822+0000 7f4ce5159640 1 -- 172.21.15.50:0/2529113951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce015c2c0 msgr2=0x7f4ce00b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:20.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.822+0000 7f4ce5159640 1 --2- 172.21.15.50:0/2529113951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce015c2c0 0x7f4ce00b46a0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009e50 tx=0x7f4cd002a680 comp rx=0 tx=0).stop 2024-09-11T22:24:20.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.822+0000 7f4ce5159640 1 -- 172.21.15.50:0/2529113951 shutdown_connections 2024-09-11T22:24:20.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.822+0000 7f4ce5159640 1 --2- 172.21.15.50:0/2529113951 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ce00b3e10 0x7f4ce00cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:20.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.822+0000 7f4ce5159640 1 --2- 172.21.15.50:0/2529113951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce015c2c0 0x7f4ce00b46a0 unknown :-1 s=CLOSED pgs=2365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:20.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.822+0000 7f4ce5159640 1 -- 172.21.15.50:0/2529113951 >> 172.21.15.50:0/2529113951 conn(0x7f4ce00679c0 msgr2=0x7f4ce0067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:20.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.822+0000 7f4ce5159640 1 -- 172.21.15.50:0/2529113951 shutdown_connections 2024-09-11T22:24:20.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.822+0000 7f4ce5159640 1 -- 172.21.15.50:0/2529113951 wait complete. 2024-09-11T22:24:20.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.824+0000 7f4ce5159640 1 Processor -- start 2024-09-11T22:24:20.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.824+0000 7f4ce5159640 1 -- start start 2024-09-11T22:24:20.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.824+0000 7f4ce5159640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ce00b3e10 0x7f4ce013dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:20.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.824+0000 7f4ce5159640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce00d0410 0x7f4ce014a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:20.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.824+0000 7f4ce5159640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce015c2c0 0x7f4ce014a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:20.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.824+0000 7f4ce5159640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce00cfc10 con 0x7f4ce015c2c0 2024-09-11T22:24:20.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.824+0000 7f4ce5159640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce00b54a0 con 0x7f4ce00d0410 2024-09-11T22:24:20.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.824+0000 7f4ce5159640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce00ce200 con 0x7f4ce00b3e10 2024-09-11T22:24:20.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cdf59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce015c2c0 0x7f4ce014a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:20.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cded9d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ce00b3e10 0x7f4ce013dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:20.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cde59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce00d0410 0x7f4ce014a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:20.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cdf59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce015c2c0 0x7f4ce014a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40596/0 (socket says 172.21.15.50:40596) 2024-09-11T22:24:20.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cdf59e640 1 -- 172.21.15.50:0/2748084460 learned_addr learned my addr 172.21.15.50:0/2748084460 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:20.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cdf59e640 1 -- 172.21.15.50:0/2748084460 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ce00b3e10 msgr2=0x7f4ce013dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:20.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cdf59e640 1 --2- 172.21.15.50:0/2748084460 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ce00b3e10 0x7f4ce013dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:20.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cdf59e640 1 -- 172.21.15.50:0/2748084460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce00d0410 msgr2=0x7f4ce014a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:20.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cdf59e640 1 --2- 172.21.15.50:0/2748084460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce00d0410 0x7f4ce014a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:20.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cdf59e640 1 -- 172.21.15.50:0/2748084460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce014c250 con 0x7f4ce015c2c0 2024-09-11T22:24:20.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cde59c640 1 --2- 172.21.15.50:0/2748084460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce00d0410 0x7f4ce014a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:24:20.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cdf59e640 1 --2- 172.21.15.50:0/2748084460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce015c2c0 0x7f4ce014a710 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800c3c0 tx=0x7f4cd800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:20.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cc77fe640 1 -- 172.21.15.50:0/2748084460 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80074e0 con 0x7f4ce015c2c0 2024-09-11T22:24:20.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cc77fe640 1 -- 172.21.15.50:0/2748084460 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd8007680 con 0x7f4ce015c2c0 2024-09-11T22:24:20.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4ce5159640 1 -- 172.21.15.50:0/2748084460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce014ad40 con 0x7f4ce015c2c0 2024-09-11T22:24:20.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4cc77fe640 1 -- 172.21.15.50:0/2748084460 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8004a00 con 0x7f4ce015c2c0 2024-09-11T22:24:20.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.825+0000 7f4ce5159640 1 -- 172.21.15.50:0/2748084460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce014b300 con 0x7f4ce015c2c0 2024-09-11T22:24:20.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.827+0000 7f4ce5159640 1 -- 172.21.15.50:0/2748084460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce006d830 con 0x7f4ce015c2c0 2024-09-11T22:24:20.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.827+0000 7f4cc77fe640 1 -- 172.21.15.50:0/2748084460 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cd801a020 con 0x7f4ce015c2c0 2024-09-11T22:24:20.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.828+0000 7f4cc77fe640 1 --2- 172.21.15.50:0/2748084460 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ccc06be30 0x7f4ccc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:20.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.828+0000 7f4cc77fe640 1 -- 172.21.15.50:0/2748084460 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f4cd808a100 con 0x7f4ce015c2c0 2024-09-11T22:24:20.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.828+0000 7f4cded9d640 1 --2- 172.21.15.50:0/2748084460 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ccc06be30 0x7f4ccc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:20.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.828+0000 7f4cded9d640 1 --2- 172.21.15.50:0/2748084460 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ccc06be30 0x7f4ccc06e2f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0033000 tx=0x7f4cd0009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:20.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:20.832+0000 7f4cc77fe640 1 -- 172.21.15.50:0/2748084460 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4cd80587f0 con 0x7f4ce015c2c0 2024-09-11T22:24:21.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.004+0000 7f4ce5159640 1 -- 172.21.15.50:0/2748084460 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ce00b0bd0 con 0x7f4ccc06be30 2024-09-11T22:24:21.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.006+0000 7f4cc77fe640 1 -- 172.21.15.50:0/2748084460 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13468 (secure 0 0 0) 0x7f4ce00b0bd0 con 0x7f4ccc06be30 2024-09-11T22:24:21.006 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:21.007 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:24:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.007+0000 7f4ce5159640 1 -- 172.21.15.50:0/2748084460 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ccc06be30 msgr2=0x7f4ccc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.007+0000 7f4ce5159640 1 --2- 172.21.15.50:0/2748084460 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ccc06be30 0x7f4ccc06e2f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0033000 tx=0x7f4cd0009000 comp rx=0 tx=0).stop 2024-09-11T22:24:21.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.007+0000 7f4ce5159640 1 -- 172.21.15.50:0/2748084460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce015c2c0 msgr2=0x7f4ce014a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.007+0000 7f4ce5159640 1 --2- 172.21.15.50:0/2748084460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce015c2c0 0x7f4ce014a710 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800c3c0 tx=0x7f4cd800c880 comp rx=0 tx=0).stop 2024-09-11T22:24:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.007+0000 7f4ce5159640 1 -- 172.21.15.50:0/2748084460 shutdown_connections 2024-09-11T22:24:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.007+0000 7f4ce5159640 1 --2- 172.21.15.50:0/2748084460 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f4ccc06be30 0x7f4ccc06e2f0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.007+0000 7f4ce5159640 1 --2- 172.21.15.50:0/2748084460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ce015c2c0 0x7f4ce014a710 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.007+0000 7f4ce5159640 1 --2- 172.21.15.50:0/2748084460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce00d0410 0x7f4ce014a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.007+0000 7f4ce5159640 1 --2- 172.21.15.50:0/2748084460 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ce00b3e10 0x7f4ce013dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.007+0000 7f4ce5159640 1 -- 172.21.15.50:0/2748084460 >> 172.21.15.50:0/2748084460 conn(0x7f4ce00679c0 msgr2=0x7f4ce006deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.008+0000 7f4ce5159640 1 -- 172.21.15.50:0/2748084460 shutdown_connections 2024-09-11T22:24:21.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.008+0000 7f4ce5159640 1 -- 172.21.15.50:0/2748084460 wait complete. 2024-09-11T22:24:21.019 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":586,"stamp":"2024-09-11T22:24:19.555295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":446680,"kb_used_data":22312,"kb_used_omap":12,"kb_used_meta":424179,"kb_avail":754528040,"statfs":{"total":773094113280,"available":772636712960,"internally_reserved":0,"allocated":22847488,"data_stored":11888953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":434359857},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6305473,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-5,"num_read_kb":-3,"num_write":-77,"num_write_kb":-6183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001436"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":482,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T22:24:17.011143+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:24:17.011143+0000","last_peered":"2024-09-11T22:24:17.011143+0000","last_clean":"2024-09-11T22:24:17.011143+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:24:17.011143+0000","last_undegraded":"2024-09-11T22:24:17.011143+0000","last_fullsized":"2024-09-11T22:24:17.011143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509604,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55788,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316052,"statfs":{"total":96636764160,"available":96579637248,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509601,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55792,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316048,"statfs":{"total":96636764160,"available":96579633152,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509603,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65456,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306384,"statfs":{"total":96636764160,"available":96569737216,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509603,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47452,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324388,"statfs":{"total":96636764160,"available":96588173312,"internally_reserved":0,"allocated":2433024,"data_stored":1071489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509603,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51632,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320208,"statfs":{"total":96636764160,"available":96583892992,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509602,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60532,"kb_used_data":2972,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311308,"statfs":{"total":96636764160,"available":96574779392,"internally_reserved":0,"allocated":3043328,"data_stored":1667507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60512,"kb_used_data":2956,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311328,"statfs":{"total":96636764160,"available":96574799872,"internally_reserved":0,"allocated":3026944,"data_stored":1661857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49516,"kb_used_data":4440,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94322324,"statfs":{"total":96636764160,"available":96586059776,"internally_reserved":0,"allocated":4546560,"data_stored":3179544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:24:21.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:24:21.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.121+0000 7fed580dd640 1 Processor -- start 2024-09-11T22:24:21.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.121+0000 7fed580dd640 1 -- start start 2024-09-11T22:24:21.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.122+0000 7fed580dd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed500d1c90 0x7fed500b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.122+0000 7fed580dd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed50162350 0x7fed501627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.122+0000 7fed580dd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed50163080 con 0x7fed5015e8e0 2024-09-11T22:24:21.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.122+0000 7fed580dd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fed5015ecc0 con 0x7fed500d1c90 2024-09-11T22:24:21.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.122+0000 7fed580dd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fed500d2ad0 con 0x7fed50162350 2024-09-11T22:24:21.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.122+0000 7fed5667a640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed50162350 0x7fed501627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.122+0000 7fed55678640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed500d1c90 0x7fed500b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.122+0000 7fed55e79640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fed5015e8e0 0x7fed500d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:47190/0 (socket says 172.21.15.50:47190) 2024-09-11T22:24:21.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.122+0000 7fed55e79640 1 -- 172.21.15.50:0/1405086686 learned_addr learned my addr 172.21.15.50:0/1405086686 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:21.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.123+0000 7fed55678640 1 -- 172.21.15.50:0/1405086686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed50162350 msgr2=0x7fed501627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:21.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.123+0000 7fed55678640 1 --2- 172.21.15.50:0/1405086686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed50162350 0x7fed501627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.123+0000 7fed55678640 1 -- 172.21.15.50:0/1405086686 >> v1:172.21.15.77:6789/0 conn(0x7fed5015e8e0 legacy=0x7fed500d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.123+0000 7fed54e77640 1 -- 172.21.15.50:0/1405086686 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3875262396 0 0) 0x7fed50163080 con 0x7fed5015e8e0 2024-09-11T22:24:21.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.123+0000 7fed55678640 1 -- 172.21.15.50:0/1405086686 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed500d2d20 con 0x7fed500d1c90 2024-09-11T22:24:21.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.123+0000 7fed5667a640 1 --2- 172.21.15.50:0/1405086686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed50162350 0x7fed501627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:24:21.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.123+0000 7fed55678640 1 --2- 172.21.15.50:0/1405086686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed500d1c90 0x7fed500b7880 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fed400097a0 tx=0x7fed4002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3bc2c7cff2c3ccf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:21.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.124+0000 7fed54e77640 1 -- 172.21.15.50:0/1405086686 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40037070 con 0x7fed500d1c90 2024-09-11T22:24:21.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.124+0000 7fed54e77640 1 -- 172.21.15.50:0/1405086686 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed40032440 con 0x7fed500d1c90 2024-09-11T22:24:21.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.124+0000 7fed54e77640 1 -- 172.21.15.50:0/1405086686 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40032810 con 0x7fed500d1c90 2024-09-11T22:24:21.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.124+0000 7fed580dd640 1 -- 172.21.15.50:0/1405086686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed500d1c90 msgr2=0x7fed500b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.124+0000 7fed580dd640 1 --2- 172.21.15.50:0/1405086686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed500d1c90 0x7fed500b7880 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fed400097a0 tx=0x7fed4002a210 comp rx=0 tx=0).stop 2024-09-11T22:24:21.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.124+0000 7fed580dd640 1 -- 172.21.15.50:0/1405086686 shutdown_connections 2024-09-11T22:24:21.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.124+0000 7fed580dd640 1 --2- 172.21.15.50:0/1405086686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed50162350 0x7fed501627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.124+0000 7fed580dd640 1 --2- 172.21.15.50:0/1405086686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed500d1c90 0x7fed500b7880 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.124+0000 7fed580dd640 1 -- 172.21.15.50:0/1405086686 >> 172.21.15.50:0/1405086686 conn(0x7fed50067ba0 msgr2=0x7fed50067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:21.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.124+0000 7fed580dd640 1 -- 172.21.15.50:0/1405086686 shutdown_connections 2024-09-11T22:24:21.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.124+0000 7fed580dd640 1 -- 172.21.15.50:0/1405086686 wait complete. 2024-09-11T22:24:21.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.125+0000 7fed580dd640 1 Processor -- start 2024-09-11T22:24:21.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.125+0000 7fed580dd640 1 -- start start 2024-09-11T22:24:21.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.126+0000 7fed580dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed500d1c90 0x7fed500b6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.126+0000 7fed580dd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed5015e8e0 0x7fed500cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.126+0000 7fed580dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed50162350 0x7fed5015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.126+0000 7fed580dd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fed50162d20 con 0x7fed500d1c90 2024-09-11T22:24:21.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.126+0000 7fed580dd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed500d3370 con 0x7fed50162350 2024-09-11T22:24:21.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.126+0000 7fed580dd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fed500d3800 con 0x7fed5015e8e0 2024-09-11T22:24:21.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.126+0000 7fed55e79640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed500d1c90 0x7fed500b6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.126+0000 7fed55e79640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed500d1c90 0x7fed500b6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40600/0 (socket says 172.21.15.50:40600) 2024-09-11T22:24:21.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.126+0000 7fed55e79640 1 -- 172.21.15.50:0/3644639881 learned_addr learned my addr 172.21.15.50:0/3644639881 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:21.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.126+0000 7fed5667a640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed50162350 0x7fed5015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.126+0000 7fed55678640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed5015e8e0 0x7fed500cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.127+0000 7fed55e79640 1 -- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed5015e8e0 msgr2=0x7fed500cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.127+0000 7fed55e79640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed5015e8e0 0x7fed500cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.127+0000 7fed55e79640 1 -- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed50162350 msgr2=0x7fed5015c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.127+0000 7fed55e79640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed50162350 0x7fed5015c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.127+0000 7fed55e79640 1 -- 172.21.15.50:0/3644639881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed500cd0e0 con 0x7fed500d1c90 2024-09-11T22:24:21.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.127+0000 7fed55e79640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed500d1c90 0x7fed500b6a80 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c4d0 tx=0x7fed4c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:21.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.127+0000 7fed467fc640 1 -- 172.21.15.50:0/3644639881 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0074e0 con 0x7fed500d1c90 2024-09-11T22:24:21.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.127+0000 7fed467fc640 1 -- 172.21.15.50:0/3644639881 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed4c0047e0 con 0x7fed500d1c90 2024-09-11T22:24:21.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.127+0000 7fed580dd640 1 -- 172.21.15.50:0/3644639881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed500cd3c0 con 0x7fed500d1c90 2024-09-11T22:24:21.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.127+0000 7fed467fc640 1 -- 172.21.15.50:0/3644639881 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4c004bd0 con 0x7fed500d1c90 2024-09-11T22:24:21.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.127+0000 7fed580dd640 1 -- 172.21.15.50:0/3644639881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed50158eb0 con 0x7fed500d1c90 2024-09-11T22:24:21.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.128+0000 7fed580dd640 1 -- 172.21.15.50:0/3644639881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed500b7880 con 0x7fed500d1c90 2024-09-11T22:24:21.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.129+0000 7fed467fc640 1 -- 172.21.15.50:0/3644639881 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed4c011070 con 0x7fed500d1c90 2024-09-11T22:24:21.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.129+0000 7fed467fc640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed3406be30 0x7fed3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.129+0000 7fed467fc640 1 -- 172.21.15.50:0/3644639881 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fed4c08a6b0 con 0x7fed500d1c90 2024-09-11T22:24:21.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.129+0000 7fed55678640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed3406be30 0x7fed3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.130+0000 7fed55678640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed3406be30 0x7fed3406e2f0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fed40034000 tx=0x7fed4002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:21.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.133+0000 7fed467fc640 1 -- 172.21.15.50:0/3644639881 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed4c0593f0 con 0x7fed500d1c90 2024-09-11T22:24:21.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.305+0000 7fed580dd640 1 -- 172.21.15.50:0/3644639881 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed500ba770 con 0x7fed3406be30 2024-09-11T22:24:21.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.306+0000 7fed467fc640 1 -- 172.21.15.50:0/3644639881 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13468 (secure 0 0 0) 0x7fed500ba770 con 0x7fed3406be30 2024-09-11T22:24:21.307 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:21.308 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:24:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.309+0000 7fed580dd640 1 -- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed3406be30 msgr2=0x7fed3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.309+0000 7fed580dd640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed3406be30 0x7fed3406e2f0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fed40034000 tx=0x7fed4002e000 comp rx=0 tx=0).stop 2024-09-11T22:24:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.309+0000 7fed580dd640 1 -- 172.21.15.50:0/3644639881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed500d1c90 msgr2=0x7fed500b6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.309+0000 7fed580dd640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed500d1c90 0x7fed500b6a80 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c4d0 tx=0x7fed4c00c8d0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.309+0000 7fed580dd640 1 -- 172.21.15.50:0/3644639881 shutdown_connections 2024-09-11T22:24:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.309+0000 7fed580dd640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fed3406be30 0x7fed3406e2f0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.309+0000 7fed580dd640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed5015e8e0 0x7fed500cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.309+0000 7fed580dd640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed50162350 0x7fed5015c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.309+0000 7fed580dd640 1 --2- 172.21.15.50:0/3644639881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed500d1c90 0x7fed500b6a80 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.309+0000 7fed580dd640 1 -- 172.21.15.50:0/3644639881 >> 172.21.15.50:0/3644639881 conn(0x7fed50067ba0 msgr2=0x7fed50160880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:21.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.309+0000 7fed580dd640 1 -- 172.21.15.50:0/3644639881 shutdown_connections 2024-09-11T22:24:21.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.309+0000 7fed580dd640 1 -- 172.21.15.50:0/3644639881 wait complete. 2024-09-11T22:24:21.321 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":586,"stamp":"2024-09-11T22:24:19.555295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":446680,"kb_used_data":22312,"kb_used_omap":12,"kb_used_meta":424179,"kb_avail":754528040,"statfs":{"total":773094113280,"available":772636712960,"internally_reserved":0,"allocated":22847488,"data_stored":11888953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":434359857},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6305473,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-5,"num_read_kb":-3,"num_write":-77,"num_write_kb":-6183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001436"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":482,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T22:24:17.011143+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:24:17.011143+0000","last_peered":"2024-09-11T22:24:17.011143+0000","last_clean":"2024-09-11T22:24:17.011143+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:24:17.011143+0000","last_undegraded":"2024-09-11T22:24:17.011143+0000","last_fullsized":"2024-09-11T22:24:17.011143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509604,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55788,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316052,"statfs":{"total":96636764160,"available":96579637248,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509601,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55792,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316048,"statfs":{"total":96636764160,"available":96579633152,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509603,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65456,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306384,"statfs":{"total":96636764160,"available":96569737216,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509603,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47452,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324388,"statfs":{"total":96636764160,"available":96588173312,"internally_reserved":0,"allocated":2433024,"data_stored":1071489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509603,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51632,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320208,"statfs":{"total":96636764160,"available":96583892992,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509602,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60532,"kb_used_data":2972,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311308,"statfs":{"total":96636764160,"available":96574779392,"internally_reserved":0,"allocated":3043328,"data_stored":1667507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60512,"kb_used_data":2956,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311328,"statfs":{"total":96636764160,"available":96574799872,"internally_reserved":0,"allocated":3026944,"data_stored":1661857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49516,"kb_used_data":4440,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94322324,"statfs":{"total":96636764160,"available":96586059776,"internally_reserved":0,"allocated":4546560,"data_stored":3179544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:24:21.321 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:24:21.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:24:21.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.423+0000 7fd07a7e8640 1 Processor -- start 2024-09-11T22:24:21.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.423+0000 7fd07a7e8640 1 -- start start 2024-09-11T22:24:21.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.424+0000 7fd07a7e8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd07415e870 0x7fd0740d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.424+0000 7fd07a7e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0740d16d0 0x7fd0740d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.424+0000 7fd07a7e8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0740d3a30 0x7fd0740b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.424+0000 7fd07a7e8640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd0740d1b10 con 0x7fd07415e870 2024-09-11T22:24:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.424+0000 7fd07a7e8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd0740d3e80 con 0x7fd0740d3a30 2024-09-11T22:24:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.424+0000 7fd07a7e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd0740cfa80 con 0x7fd0740d16d0 2024-09-11T22:24:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.424+0000 7fd073fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd07415e870 0x7fd0740d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.424+0000 7fd073fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd07415e870 0x7fd0740d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40610/0 (socket says 172.21.15.50:40610) 2024-09-11T22:24:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.424+0000 7fd073fff640 1 -- 172.21.15.50:0/2951874322 learned_addr learned my addr 172.21.15.50:0/2951874322 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:21.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.424+0000 7fd0737fe640 1 --2- 172.21.15.50:0/2951874322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0740d16d0 0x7fd0740d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.424+0000 7fd078d85640 1 --2- 172.21.15.50:0/2951874322 >> v2:172.21.15.77:3300/0 conn(0x7fd0740d3a30 0x7fd0740b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.425+0000 7fd073fff640 1 -- 172.21.15.50:0/2951874322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0740d16d0 msgr2=0x7fd0740d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:21.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.425+0000 7fd073fff640 1 --2- 172.21.15.50:0/2951874322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0740d16d0 0x7fd0740d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.425+0000 7fd073fff640 1 -- 172.21.15.50:0/2951874322 >> v2:172.21.15.77:3300/0 conn(0x7fd0740d3a30 msgr2=0x7fd0740b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:21.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.425+0000 7fd073fff640 1 --2- 172.21.15.50:0/2951874322 >> v2:172.21.15.77:3300/0 conn(0x7fd0740d3a30 0x7fd0740b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.425+0000 7fd073fff640 1 -- 172.21.15.50:0/2951874322 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0740d40d0 con 0x7fd07415e870 2024-09-11T22:24:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.425+0000 7fd073fff640 1 --2- 172.21.15.50:0/2951874322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07415e870 0x7fd0740d1190 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7fd0740ced60 tx=0x7fd06402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62ea4dc47dbe96d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.426+0000 7fd072ffd640 1 -- 172.21.15.50:0/2951874322 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064037070 con 0x7fd07415e870 2024-09-11T22:24:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.426+0000 7fd072ffd640 1 -- 172.21.15.50:0/2951874322 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd064032440 con 0x7fd07415e870 2024-09-11T22:24:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.426+0000 7fd072ffd640 1 -- 172.21.15.50:0/2951874322 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064032810 con 0x7fd07415e870 2024-09-11T22:24:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.426+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2951874322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07415e870 msgr2=0x7fd0740d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.426+0000 7fd07a7e8640 1 --2- 172.21.15.50:0/2951874322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07415e870 0x7fd0740d1190 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7fd0740ced60 tx=0x7fd06402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.426+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2951874322 shutdown_connections 2024-09-11T22:24:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.426+0000 7fd07a7e8640 1 --2- 172.21.15.50:0/2951874322 >> v2:172.21.15.77:3300/0 conn(0x7fd0740d3a30 0x7fd0740b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.426+0000 7fd07a7e8640 1 --2- 172.21.15.50:0/2951874322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0740d16d0 0x7fd0740d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.426+0000 7fd07a7e8640 1 --2- 172.21.15.50:0/2951874322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07415e870 0x7fd0740d1190 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.426+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2951874322 >> 172.21.15.50:0/2951874322 conn(0x7fd0740727a0 msgr2=0x7fd0740679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:21.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.426+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2951874322 shutdown_connections 2024-09-11T22:24:21.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.426+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2951874322 wait complete. 2024-09-11T22:24:21.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.427+0000 7fd07a7e8640 1 Processor -- start 2024-09-11T22:24:21.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.428+0000 7fd07a7e8640 1 -- start start 2024-09-11T22:24:21.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.428+0000 7fd07a7e8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0740d16d0 0x7fd074155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.428+0000 7fd07a7e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0740d3a30 0x7fd0740c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.428+0000 7fd07a7e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07415e870 0x7fd0740c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.428+0000 7fd07a7e8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd0740b7ee0 con 0x7fd07415e870 2024-09-11T22:24:21.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.428+0000 7fd07a7e8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd0740b7c00 con 0x7fd0740d3a30 2024-09-11T22:24:21.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.428+0000 7fd07a7e8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd07415ec50 con 0x7fd0740d16d0 2024-09-11T22:24:21.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd078d85640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07415e870 0x7fd0740c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd078d85640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07415e870 0x7fd0740c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40620/0 (socket says 172.21.15.50:40620) 2024-09-11T22:24:21.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd078d85640 1 -- 172.21.15.50:0/2206219576 learned_addr learned my addr 172.21.15.50:0/2206219576 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:21.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd073fff640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0740d16d0 0x7fd074155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd0737fe640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0740d3a30 0x7fd0740c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd078d85640 1 -- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0740d16d0 msgr2=0x7fd074155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd078d85640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0740d16d0 0x7fd074155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd078d85640 1 -- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0740d3a30 msgr2=0x7fd0740c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd078d85640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0740d3a30 0x7fd0740c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd078d85640 1 -- 172.21.15.50:0/2206219576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd074155e40 con 0x7fd07415e870 2024-09-11T22:24:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd073fff640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0740d16d0 0x7fd074155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:24:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd078d85640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07415e870 0x7fd0740c8c60 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7fd06c009dd0 tx=0x7fd06c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd070ff9640 1 -- 172.21.15.50:0/2206219576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c018020 con 0x7fd07415e870 2024-09-11T22:24:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd070ff9640 1 -- 172.21.15.50:0/2206219576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd06c014480 con 0x7fd07415e870 2024-09-11T22:24:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2206219576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0740ca870 con 0x7fd07415e870 2024-09-11T22:24:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd070ff9640 1 -- 172.21.15.50:0/2206219576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c014870 con 0x7fd07415e870 2024-09-11T22:24:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.429+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2206219576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0740cae30 con 0x7fd07415e870 2024-09-11T22:24:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.430+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2206219576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0740b78b0 con 0x7fd07415e870 2024-09-11T22:24:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.431+0000 7fd070ff9640 1 -- 172.21.15.50:0/2206219576 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd06c005d10 con 0x7fd07415e870 2024-09-11T22:24:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.432+0000 7fd070ff9640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd06006be60 0x7fd06006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.432+0000 7fd070ff9640 1 -- 172.21.15.50:0/2206219576 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fd06c08b430 con 0x7fd07415e870 2024-09-11T22:24:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.432+0000 7fd073fff640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd06006be60 0x7fd06006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.432+0000 7fd073fff640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd06006be60 0x7fd06006e320 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd064034000 tx=0x7fd06402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.436+0000 7fd070ff9640 1 -- 172.21.15.50:0/2206219576 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd06c022070 con 0x7fd07415e870 2024-09-11T22:24:21.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.609+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2206219576 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0740ceb70 con 0x7fd06006be60 2024-09-11T22:24:21.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.610+0000 7fd070ff9640 1 -- 172.21.15.50:0/2206219576 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13455 (secure 0 0 0) 0x7fd0740ceb70 con 0x7fd06006be60 2024-09-11T22:24:21.611 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:21.611 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:24:21.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.613+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd06006be60 msgr2=0x7fd06006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.613+0000 7fd07a7e8640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd06006be60 0x7fd06006e320 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd064034000 tx=0x7fd06402e000 comp rx=0 tx=0).stop 2024-09-11T22:24:21.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.613+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2206219576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07415e870 msgr2=0x7fd0740c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.613+0000 7fd07a7e8640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07415e870 0x7fd0740c8c60 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7fd06c009dd0 tx=0x7fd06c00c490 comp rx=0 tx=0).stop 2024-09-11T22:24:21.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.613+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2206219576 shutdown_connections 2024-09-11T22:24:21.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.613+0000 7fd07a7e8640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd06006be60 0x7fd06006e320 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.613+0000 7fd07a7e8640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07415e870 0x7fd0740c8c60 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.613+0000 7fd07a7e8640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0740d3a30 0x7fd0740c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.613+0000 7fd07a7e8640 1 --2- 172.21.15.50:0/2206219576 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0740d16d0 0x7fd074155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.613+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2206219576 >> 172.21.15.50:0/2206219576 conn(0x7fd0740727a0 msgr2=0x7fd0740cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:21.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.613+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2206219576 shutdown_connections 2024-09-11T22:24:21.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.613+0000 7fd07a7e8640 1 -- 172.21.15.50:0/2206219576 wait complete. 2024-09-11T22:24:21.624 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":587,"stamp":"2024-09-11T22:24:21.555787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":444636,"kb_used_data":20264,"kb_used_omap":12,"kb_used_meta":424179,"kb_avail":754530084,"statfs":{"total":773094113280,"available":772638806016,"internally_reserved":0,"allocated":20750336,"data_stored":9786548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":434359857},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6309249,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-8,"num_read_kb":-4,"num_write":-92,"num_write_kb":-6196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.552511"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":482,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T22:24:17.011143+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:24:17.011143+0000","last_peered":"2024-09-11T22:24:17.011143+0000","last_clean":"2024-09-11T22:24:17.011143+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:24:17.011143+0000","last_undegraded":"2024-09-11T22:24:17.011143+0000","last_fullsized":"2024-09-11T22:24:17.011143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509604,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55788,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316052,"statfs":{"total":96636764160,"available":96579637248,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509601,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55792,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316048,"statfs":{"total":96636764160,"available":96579633152,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509603,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65456,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306384,"statfs":{"total":96636764160,"available":96569737216,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509603,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47452,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324388,"statfs":{"total":96636764160,"available":96588173312,"internally_reserved":0,"allocated":2433024,"data_stored":1071489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509603,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51632,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320208,"statfs":{"total":96636764160,"available":96583892992,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509602,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60532,"kb_used_data":2972,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311308,"statfs":{"total":96636764160,"available":96574779392,"internally_reserved":0,"allocated":3043328,"data_stored":1667507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60512,"kb_used_data":2956,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311328,"statfs":{"total":96636764160,"available":96574799872,"internally_reserved":0,"allocated":3026944,"data_stored":1661857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575010,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47472,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324368,"statfs":{"total":96636764160,"available":96588152832,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:24:21.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:24:21.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.727+0000 7f6c1ca3c640 1 Processor -- start 2024-09-11T22:24:21.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.727+0000 7f6c1ca3c640 1 -- start start 2024-09-11T22:24:21.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.728+0000 7f6c1ca3c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6c180d1c90 0x7f6c180b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.728+0000 7f6c1ca3c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c18163080 con 0x7f6c1815e8e0 2024-09-11T22:24:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.728+0000 7f6c1ca3c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c180d2d20 con 0x7f6c18162350 2024-09-11T22:24:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.728+0000 7f6c1ca3c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6c1815ecc0 con 0x7f6c180d1c90 2024-09-11T22:24:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.728+0000 7f6c1659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6c1815e8e0 0x7f6c180d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51822/0 (socket says 172.21.15.50:51822) 2024-09-11T22:24:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.728+0000 7f6c1659c640 1 -- 172.21.15.50:0/1196834940 learned_addr learned my addr 172.21.15.50:0/1196834940 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.728+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1096896080 0 0) 0x7f6c18163080 con 0x7f6c1815e8e0 2024-09-11T22:24:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.728+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c04003520 con 0x7f6c1815e8e0 2024-09-11T22:24:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.728+0000 7f6c0ffff640 1 --2- 172.21.15.50:0/1196834940 >> v2:172.21.15.77:3300/0 conn(0x7f6c180d1c90 0x7f6c180b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.728+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 526179403 0 0) 0x7f6c04003520 con 0x7f6c1815e8e0 2024-09-11T22:24:21.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.728+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 >> v2:172.21.15.77:3300/0 conn(0x7f6c180d1c90 msgr2=0x7f6c180b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:21.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.728+0000 7f6c15d9b640 1 --2- 172.21.15.50:0/1196834940 >> v2:172.21.15.77:3300/0 conn(0x7f6c180d1c90 0x7f6c180b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.728+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 >> v1:172.21.15.77:6789/0 conn(0x7f6c18162350 legacy=0x7f6c181627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c180d3000 con 0x7f6c1815e8e0 2024-09-11T22:24:21.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f6c08001670 con 0x7f6c1815e8e0 2024-09-11T22:24:21.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 >> v1:172.21.15.50:6789/0 conn(0x7f6c1815e8e0 legacy=0x7f6c180d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c15d9b640 1 --2- 172.21.15.50:0/1196834940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c040039b0 0x7f6c04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c15d9b640 1 --2- 172.21.15.50:0/1196834940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c04004800 0x7f6c04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c15d9b640 1 --2- 172.21.15.50:0/1196834940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c040051c0 0x7f6c0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0400c0c0 con 0x7f6c04004800 2024-09-11T22:24:21.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0400c270 con 0x7f6c040039b0 2024-09-11T22:24:21.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6c0400c470 con 0x7f6c040051c0 2024-09-11T22:24:21.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c0ffff640 1 --2- 172.21.15.50:0/1196834940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c04004800 0x7f6c04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c1659c640 1 --2- 172.21.15.50:0/1196834940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c040039b0 0x7f6c04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c16d9d640 1 --2- 172.21.15.50:0/1196834940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c040051c0 0x7f6c0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c0ffff640 1 -- 172.21.15.50:0/1196834940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c040051c0 msgr2=0x7f6c0400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:21.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c0ffff640 1 --2- 172.21.15.50:0/1196834940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c040051c0 0x7f6c0400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c0ffff640 1 -- 172.21.15.50:0/1196834940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c040039b0 msgr2=0x7f6c04003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:21.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c0ffff640 1 --2- 172.21.15.50:0/1196834940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c040039b0 0x7f6c04003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c0ffff640 1 -- 172.21.15.50:0/1196834940 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c04003520 con 0x7f6c04004800 2024-09-11T22:24:21.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c16d9d640 1 --2- 172.21.15.50:0/1196834940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c040051c0 0x7f6c0400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:24:21.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.729+0000 7f6c16d9d640 1 -- 172.21.15.50:0/1196834940 reap_dead start 2024-09-11T22:24:21.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.730+0000 7f6c0ffff640 1 --2- 172.21.15.50:0/1196834940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c04004800 0x7f6c04004c80 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000ba30 tx=0x7f6c04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f879952a0a83d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:21.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.730+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c00030070 con 0x7f6c04004800 2024-09-11T22:24:21.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.730+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0002ade0 con 0x7f6c04004800 2024-09-11T22:24:21.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.730+0000 7f6c15d9b640 1 -- 172.21.15.50:0/1196834940 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000b600 con 0x7f6c04004800 2024-09-11T22:24:21.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.730+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/1196834940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c04004800 msgr2=0x7f6c04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.730+0000 7f6c1ca3c640 1 --2- 172.21.15.50:0/1196834940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c04004800 0x7f6c04004c80 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000ba30 tx=0x7f6c04005830 comp rx=0 tx=0).stop 2024-09-11T22:24:21.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.730+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/1196834940 shutdown_connections 2024-09-11T22:24:21.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.731+0000 7f6c1ca3c640 1 --2- 172.21.15.50:0/1196834940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c04004800 0x7f6c04004c80 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.731+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/1196834940 >> 172.21.15.50:0/1196834940 conn(0x7f6c18067ba0 msgr2=0x7f6c18067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:21.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.731+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/1196834940 shutdown_connections 2024-09-11T22:24:21.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.731+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/1196834940 wait complete. 2024-09-11T22:24:21.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.732+0000 7f6c1ca3c640 1 Processor -- start 2024-09-11T22:24:21.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.732+0000 7f6c1ca3c640 1 -- start start 2024-09-11T22:24:21.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1ca3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c04004800 0x7f6c18157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1ca3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c180cdf70 0x7f6c180ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1ca3c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c181e9240 0x7f6c181e96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1ca3c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6c180b7c10 con 0x7f6c04004800 2024-09-11T22:24:21.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1ca3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c180b7a90 con 0x7f6c180cdf70 2024-09-11T22:24:21.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1ca3c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6c180d2ad0 con 0x7f6c181e9240 2024-09-11T22:24:21.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c04004800 0x7f6c18157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c04004800 0x7f6c18157f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40646/0 (socket says 172.21.15.50:40646) 2024-09-11T22:24:21.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1659c640 1 -- 172.21.15.50:0/2499104055 learned_addr learned my addr 172.21.15.50:0/2499104055 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:21.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1659c640 1 -- 172.21.15.50:0/2499104055 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c181e9240 msgr2=0x7f6c181e96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1659c640 1 --2- 172.21.15.50:0/2499104055 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c181e9240 0x7f6c181e96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1659c640 1 -- 172.21.15.50:0/2499104055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c180cdf70 msgr2=0x7f6c180ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c0ffff640 1 --2- 172.21.15.50:0/2499104055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c180cdf70 0x7f6c180ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1659c640 1 --2- 172.21.15.50:0/2499104055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c180cdf70 0x7f6c180ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1659c640 1 -- 172.21.15.50:0/2499104055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c181e9f70 con 0x7f6c04004800 2024-09-11T22:24:21.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c1659c640 1 --2- 172.21.15.50:0/2499104055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c04004800 0x7f6c18157f70 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f6c080072c0 tx=0x7f6c08007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:21.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.733+0000 7f6c0effd640 1 -- 172.21.15.50:0/2499104055 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0801a070 con 0x7f6c04004800 2024-09-11T22:24:21.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.734+0000 7f6c0effd640 1 -- 172.21.15.50:0/2499104055 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0800f9a0 con 0x7f6c04004800 2024-09-11T22:24:21.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.734+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/2499104055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c181ea250 con 0x7f6c04004800 2024-09-11T22:24:21.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.734+0000 7f6c0effd640 1 -- 172.21.15.50:0/2499104055 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800fd90 con 0x7f6c04004800 2024-09-11T22:24:21.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.734+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/2499104055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c181ea810 con 0x7f6c04004800 2024-09-11T22:24:21.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.735+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/2499104055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c180d1580 con 0x7f6c04004800 2024-09-11T22:24:21.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.735+0000 7f6c0effd640 1 -- 172.21.15.50:0/2499104055 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c0801d070 con 0x7f6c04004800 2024-09-11T22:24:21.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.736+0000 7f6c0effd640 1 --2- 172.21.15.50:0/2499104055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6bf806be60 0x7f6bf806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:21.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.736+0000 7f6c0effd640 1 -- 172.21.15.50:0/2499104055 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f6c0808a510 con 0x7f6c04004800 2024-09-11T22:24:21.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.736+0000 7f6c0ffff640 1 --2- 172.21.15.50:0/2499104055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6bf806be60 0x7f6bf806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:21.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.737+0000 7f6c0ffff640 1 --2- 172.21.15.50:0/2499104055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6bf806be60 0x7f6bf806e320 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000ba00 tx=0x7f6c00030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:21.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.740+0000 7f6c0effd640 1 -- 172.21.15.50:0/2499104055 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c08059250 con 0x7f6c04004800 2024-09-11T22:24:21.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.915+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/2499104055 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c180ba770 con 0x7f6c04004800 2024-09-11T22:24:21.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.916+0000 7f6c0effd640 1 -- 172.21.15.50:0/2499104055 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) ==== 74+0+13006 (secure 0 0 0) 0x7f6c08058b50 con 0x7f6c04004800 2024-09-11T22:24:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:21.917 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":194,"fsid":"a6d32825-9a2d-4e99-ad9a-1aac010fe65a","created":"2024-09-11T22:10:51.175292+0000","modified":"2024-09-11T22:24:18.008932+0000","last_up_change":"2024-09-11T22:11:03.607787+0000","last_in_change":"2024-09-11T22:10:53.206017+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:11:03.407373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fc71803a-7700-4360-a3cb-8faf8b68d7af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3121805052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6819","nonce":3121805052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6823","nonce":3121805052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3121805052},{"type":"v1","addr":"172.21.15.50:6821","nonce":3121805052}]},"public_addr":"172.21.15.50:6817/3121805052","cluster_addr":"172.21.15.50:6819/3121805052","heartbeat_back_addr":"172.21.15.50:6823/3121805052","heartbeat_front_addr":"172.21.15.50:6821/3121805052","state":["exists","up"]},{"osd":1,"uuid":"2b7bd0a5-e817-4719-8b2f-60c73a078699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6825","nonce":3862509209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6827","nonce":3862509209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6831","nonce":3862509209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3862509209},{"type":"v1","addr":"172.21.15.50:6829","nonce":3862509209}]},"public_addr":"172.21.15.50:6825/3862509209","cluster_addr":"172.21.15.50:6827/3862509209","heartbeat_back_addr":"172.21.15.50:6831/3862509209","heartbeat_front_addr":"172.21.15.50:6829/3862509209","state":["exists","up"]},{"osd":2,"uuid":"fa8c2b13-3785-408e-83eb-bdc6aebde1bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6809","nonce":2284963545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6811","nonce":2284963545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6815","nonce":2284963545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2284963545},{"type":"v1","addr":"172.21.15.50:6813","nonce":2284963545}]},"public_addr":"172.21.15.50:6809/2284963545","cluster_addr":"172.21.15.50:6811/2284963545","heartbeat_back_addr":"172.21.15.50:6815/2284963545","heartbeat_front_addr":"172.21.15.50:6813/2284963545","state":["exists","up"]},{"osd":3,"uuid":"aacbe13f-b97b-45f2-b57f-bdf55d6693ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6801","nonce":593319808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6803","nonce":593319808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6807","nonce":593319808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":593319808},{"type":"v1","addr":"172.21.15.50:6805","nonce":593319808}]},"public_addr":"172.21.15.50:6801/593319808","cluster_addr":"172.21.15.50:6803/593319808","heartbeat_back_addr":"172.21.15.50:6807/593319808","heartbeat_front_addr":"172.21.15.50:6805/593319808","state":["exists","up"]},{"osd":4,"uuid":"c055cfa0-4d24-4a11-8008-69a4e696492c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6801","nonce":1015337735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6803","nonce":1015337735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6807","nonce":1015337735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1015337735},{"type":"v1","addr":"172.21.15.77:6805","nonce":1015337735}]},"public_addr":"172.21.15.77:6801/1015337735","cluster_addr":"172.21.15.77:6803/1015337735","heartbeat_back_addr":"172.21.15.77:6807/1015337735","heartbeat_front_addr":"172.21.15.77:6805/1015337735","state":["exists","up"]},{"osd":5,"uuid":"6d5829dd-b5e7-40ab-a57e-147ac7d2ee29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6825","nonce":2559965953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6827","nonce":2559965953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6831","nonce":2559965953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2559965953},{"type":"v1","addr":"172.21.15.77:6829","nonce":2559965953}]},"public_addr":"172.21.15.77:6825/2559965953","cluster_addr":"172.21.15.77:6827/2559965953","heartbeat_back_addr":"172.21.15.77:6831/2559965953","heartbeat_front_addr":"172.21.15.77:6829/2559965953","state":["exists","up"]},{"osd":6,"uuid":"1ba39422-f5e9-4d24-bc07-c9837bfa32f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6809","nonce":2920422022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6811","nonce":2920422022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6815","nonce":2920422022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2920422022},{"type":"v1","addr":"172.21.15.77:6813","nonce":2920422022}]},"public_addr":"172.21.15.77:6809/2920422022","cluster_addr":"172.21.15.77:6811/2920422022","heartbeat_back_addr":"172.21.15.77:6815/2920422022","heartbeat_front_addr":"172.21.15.77:6813/2920422022","state":["exists","up"]},{"osd":7,"uuid":"50d64521-840a-4e13-b3ea-a861978fe0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6817","nonce":3980920894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6819","nonce":3980920894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6823","nonce":3980920894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3980920894},{"type":"v1","addr":"172.21.15.77:6821","nonce":3980920894}]},"public_addr":"172.21.15.77:6817/3980920894","cluster_addr":"172.21.15.77:6819/3980920894","heartbeat_back_addr":"172.21.15.77:6823/3980920894","heartbeat_front_addr":"172.21.15.77:6821/3980920894","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.390921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.504434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.246941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.484043+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.427505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.527365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.497387+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:11:00.318361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/2876091212":"2024-09-12T22:24:15.000090+0000","172.21.15.50:6834/2876091212":"2024-09-12T22:24:15.000090+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:24:21.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.918+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/2499104055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6bf806be60 msgr2=0x7f6bf806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.918+0000 7f6c1ca3c640 1 --2- 172.21.15.50:0/2499104055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6bf806be60 0x7f6bf806e320 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000ba00 tx=0x7f6c00030000 comp rx=0 tx=0).stop 2024-09-11T22:24:21.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.918+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/2499104055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c04004800 msgr2=0x7f6c18157f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.918+0000 7f6c1ca3c640 1 --2- 172.21.15.50:0/2499104055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c04004800 0x7f6c18157f70 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f6c080072c0 tx=0x7f6c08007780 comp rx=0 tx=0).stop 2024-09-11T22:24:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.918+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/2499104055 shutdown_connections 2024-09-11T22:24:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.918+0000 7f6c1ca3c640 1 --2- 172.21.15.50:0/2499104055 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6bf806be60 0x7f6bf806e320 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.918+0000 7f6c1ca3c640 1 --2- 172.21.15.50:0/2499104055 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c181e9240 0x7f6c181e96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.918+0000 7f6c1ca3c640 1 --2- 172.21.15.50:0/2499104055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c180cdf70 0x7f6c180ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.918+0000 7f6c1ca3c640 1 --2- 172.21.15.50:0/2499104055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c04004800 0x7f6c18157f70 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.918+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/2499104055 >> 172.21.15.50:0/2499104055 conn(0x7f6c18067ba0 msgr2=0x7f6c180cb060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:21.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.918+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/2499104055 shutdown_connections 2024-09-11T22:24:21.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:21.918+0000 7f6c1ca3c640 1 -- 172.21.15.50:0/2499104055 wait complete. 2024-09-11T22:24:22.931 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T22:24:22.931 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:24:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.051+0000 7f79dde8d640 1 Processor -- start 2024-09-11T22:24:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.051+0000 7f79dde8d640 1 -- start start 2024-09-11T22:24:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79dde8d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79d8161d60 0x7f79d80d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79dde8d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79d80d39f0 0x7f79d80b6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79dde8d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f79d80b6c70 0x7f79d80d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79dde8d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f79d80b70c0 con 0x7f79d80d39f0 2024-09-11T22:24:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79dde8d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f79d80b7990 con 0x7f79d80b6c70 2024-09-11T22:24:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79dde8d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f79d80d4530 con 0x7f79d8161d60 2024-09-11T22:24:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79d6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79d80d39f0 0x7f79d80b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79d6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79d80d39f0 0x7f79d80b6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40660/0 (socket says 172.21.15.50:40660) 2024-09-11T22:24:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79d6ffd640 1 -- 172.21.15.50:0/3681011879 learned_addr learned my addr 172.21.15.50:0/3681011879 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79d77fe640 1 --2- 172.21.15.50:0/3681011879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79d8161d60 0x7f79d80d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79d7fff640 1 --2- 172.21.15.50:0/3681011879 >> v2:172.21.15.77:3300/0 conn(0x7f79d80b6c70 0x7f79d80d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79d6ffd640 1 -- 172.21.15.50:0/3681011879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79d8161d60 msgr2=0x7f79d80d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:23.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79d6ffd640 1 --2- 172.21.15.50:0/3681011879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79d8161d60 0x7f79d80d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79d6ffd640 1 -- 172.21.15.50:0/3681011879 >> v2:172.21.15.77:3300/0 conn(0x7f79d80b6c70 msgr2=0x7f79d80d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:23.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79d6ffd640 1 --2- 172.21.15.50:0/3681011879 >> v2:172.21.15.77:3300/0 conn(0x7f79d80b6c70 0x7f79d80d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.052+0000 7f79d6ffd640 1 -- 172.21.15.50:0/3681011879 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d80d3f70 con 0x7f79d80d39f0 2024-09-11T22:24:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.053+0000 7f79d6ffd640 1 --2- 172.21.15.50:0/3681011879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d80d39f0 0x7f79d80b6730 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f79d80b7640 tx=0x7f79cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356192aedc44ada4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.053+0000 7f79d67fc640 1 -- 172.21.15.50:0/3681011879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc037070 con 0x7f79d80d39f0 2024-09-11T22:24:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.053+0000 7f79d67fc640 1 -- 172.21.15.50:0/3681011879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79cc032440 con 0x7f79d80d39f0 2024-09-11T22:24:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.053+0000 7f79d67fc640 1 -- 172.21.15.50:0/3681011879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc032810 con 0x7f79d80d39f0 2024-09-11T22:24:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.054+0000 7f79dde8d640 1 -- 172.21.15.50:0/3681011879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d80d39f0 msgr2=0x7f79d80b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.054+0000 7f79dde8d640 1 --2- 172.21.15.50:0/3681011879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d80d39f0 0x7f79d80b6730 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f79d80b7640 tx=0x7f79cc02a1e0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.054+0000 7f79dde8d640 1 -- 172.21.15.50:0/3681011879 shutdown_connections 2024-09-11T22:24:23.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.054+0000 7f79dde8d640 1 --2- 172.21.15.50:0/3681011879 >> v2:172.21.15.77:3300/0 conn(0x7f79d80b6c70 0x7f79d80d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.054+0000 7f79dde8d640 1 --2- 172.21.15.50:0/3681011879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d80d39f0 0x7f79d80b6730 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.054+0000 7f79dde8d640 1 --2- 172.21.15.50:0/3681011879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79d8161d60 0x7f79d80d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.054+0000 7f79dde8d640 1 -- 172.21.15.50:0/3681011879 >> 172.21.15.50:0/3681011879 conn(0x7f79d8067db0 msgr2=0x7f79d80681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.054+0000 7f79dde8d640 1 -- 172.21.15.50:0/3681011879 shutdown_connections 2024-09-11T22:24:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.054+0000 7f79dde8d640 1 -- 172.21.15.50:0/3681011879 wait complete. 2024-09-11T22:24:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.055+0000 7f79dde8d640 1 Processor -- start 2024-09-11T22:24:23.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.055+0000 7f79dde8d640 1 -- start start 2024-09-11T22:24:23.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79dde8d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79d80b6c70 0x7f79d81587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79dde8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d80d39f0 0x7f79d8159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79dde8d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d8161d60 0x7f79d815b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79dde8d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f79d80cf930 con 0x7f79d8161d60 2024-09-11T22:24:23.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79dde8d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f79d80b7c30 con 0x7f79d80d39f0 2024-09-11T22:24:23.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79dde8d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f79d80d16b0 con 0x7f79d80b6c70 2024-09-11T22:24:23.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d8161d60 0x7f79d815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d8161d60 0x7f79d815b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40666/0 (socket says 172.21.15.50:40666) 2024-09-11T22:24:23.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79d7fff640 1 -- 172.21.15.50:0/2271836725 learned_addr learned my addr 172.21.15.50:0/2271836725 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:23.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79d77fe640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79d80b6c70 0x7f79d81587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79d6ffd640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d80d39f0 0x7f79d8159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79d7fff640 1 -- 172.21.15.50:0/2271836725 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79d80b6c70 msgr2=0x7f79d81587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79d7fff640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79d80b6c70 0x7f79d81587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79d7fff640 1 -- 172.21.15.50:0/2271836725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d80d39f0 msgr2=0x7f79d8159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79d7fff640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d80d39f0 0x7f79d8159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.056+0000 7f79d7fff640 1 -- 172.21.15.50:0/2271836725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d815a850 con 0x7f79d8161d60 2024-09-11T22:24:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.057+0000 7f79d7fff640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d8161d60 0x7f79d815b800 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f79d0007e90 tx=0x7f79d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.057+0000 7f79bffff640 1 -- 172.21.15.50:0/2271836725 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0014420 con 0x7f79d8161d60 2024-09-11T22:24:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.057+0000 7f79bffff640 1 -- 172.21.15.50:0/2271836725 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d0019070 con 0x7f79d8161d60 2024-09-11T22:24:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.057+0000 7f79bffff640 1 -- 172.21.15.50:0/2271836725 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0014820 con 0x7f79d8161d60 2024-09-11T22:24:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.057+0000 7f79dde8d640 1 -- 172.21.15.50:0/2271836725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d815ab30 con 0x7f79d8161d60 2024-09-11T22:24:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.057+0000 7f79dde8d640 1 -- 172.21.15.50:0/2271836725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d815ced0 con 0x7f79d8161d60 2024-09-11T22:24:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.058+0000 7f79dde8d640 1 -- 172.21.15.50:0/2271836725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f79d80b6730 con 0x7f79d8161d60 2024-09-11T22:24:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.058+0000 7f79bffff640 1 -- 172.21.15.50:0/2271836725 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79d00149c0 con 0x7f79d8161d60 2024-09-11T22:24:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.059+0000 7f79bffff640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79c406be30 0x7f79c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.059+0000 7f79bffff640 1 -- 172.21.15.50:0/2271836725 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f79d008b1f0 con 0x7f79d8161d60 2024-09-11T22:24:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.059+0000 7f79bffff640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] conn(0x7f79c4071cf0 0x7f79c4074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.059+0000 7f79bffff640 1 -- 172.21.15.50:0/2271836725 --> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79d0014e50 con 0x7f79c4071cf0 2024-09-11T22:24:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.059+0000 7f79bffff640 1 -- 172.21.15.50:0/2271836725 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7f79d0092050 con 0x7f79d8161d60 2024-09-11T22:24:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.059+0000 7f79d77fe640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79c406be30 0x7f79c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.059+0000 7f79d6ffd640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] conn(0x7f79c4071cf0 0x7f79c4074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.060+0000 7f79d6ffd640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] conn(0x7f79c4071cf0 0x7f79c4074110 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.060+0000 7f79d77fe640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79c406be30 0x7f79c406e2f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f79c80079a0 tx=0x7f79c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.060+0000 7f79bffff640 1 -- 172.21.15.50:0/2271836725 <== osd.0 v2:172.21.15.50:6816/3121805052 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f79d0014e50 con 0x7f79c4071cf0 2024-09-11T22:24:23.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.073+0000 7f79dde8d640 1 -- 172.21.15.50:0/2271836725 --> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f79d8158d10 con 0x7f79c4071cf0 2024-09-11T22:24:23.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.073+0000 7f79bffff640 1 -- 172.21.15.50:0/2271836725 <== osd.0 v2:172.21.15.50:6816/3121805052 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f79d8158d10 con 0x7f79c4071cf0 2024-09-11T22:24:23.074 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:24:23.074 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:24:23.074 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:24:23.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.073+0000 7f79dde8d640 1 -- 172.21.15.50:0/2271836725 >> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] conn(0x7f79c4071cf0 msgr2=0x7f79c4074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.074+0000 7f79dde8d640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.50:6816/3121805052,v1:172.21.15.50:6817/3121805052] conn(0x7f79c4071cf0 0x7f79c4074110 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.074+0000 7f79dde8d640 1 -- 172.21.15.50:0/2271836725 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79c406be30 msgr2=0x7f79c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.074+0000 7f79dde8d640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f79c406be30 0x7f79c406e2f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f79c80079a0 tx=0x7f79c8008040 comp rx=0 tx=0).stop 2024-09-11T22:24:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.074+0000 7f79dde8d640 1 -- 172.21.15.50:0/2271836725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d8161d60 msgr2=0x7f79d815b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.074+0000 7f79dde8d640 1 --2- 172.21.15.50:0/2271836725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79d8161d60 0x7f79d815b800 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f79d0007e90 tx=0x7f79d000e4b0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.074+0000 7f79d7fff640 1 -- 172.21.15.50:0/2271836725 reap_dead start 2024-09-11T22:24:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.074+0000 7f79dde8d640 1 -- 172.21.15.50:0/2271836725 shutdown_connections 2024-09-11T22:24:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.074+0000 7f79dde8d640 1 -- 172.21.15.50:0/2271836725 >> 172.21.15.50:0/2271836725 conn(0x7f79d8067db0 msgr2=0x7f79d80b7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:23.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.074+0000 7f79dde8d640 1 -- 172.21.15.50:0/2271836725 shutdown_connections 2024-09-11T22:24:23.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.074+0000 7f79dde8d640 1 -- 172.21.15.50:0/2271836725 wait complete. 2024-09-11T22:24:23.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T22:24:23.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.188+0000 7ff53c303640 1 Processor -- start 2024-09-11T22:24:23.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.188+0000 7ff53c303640 1 -- start start 2024-09-11T22:24:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.189+0000 7ff53c303640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff5340d05e0 0x7ff5340b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.189+0000 7ff53c303640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5340b4f00 con 0x7ff5340b3e10 2024-09-11T22:24:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.189+0000 7ff53c303640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5340b4360 con 0x7ff53415c2c0 2024-09-11T22:24:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.189+0000 7ff53c303640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff5340b51c0 con 0x7ff5340d05e0 2024-09-11T22:24:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.189+0000 7ff53a8a0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff5340b3e10 0x7ff5340ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51826/0 (socket says 172.21.15.50:51826) 2024-09-11T22:24:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.189+0000 7ff53a8a0640 1 -- 172.21.15.50:0/3388847223 learned_addr learned my addr 172.21.15.50:0/3388847223 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.189+0000 7ff53989e640 1 --2- 172.21.15.50:0/3388847223 >> v2:172.21.15.77:3300/0 conn(0x7ff5340d05e0 0x7ff5340b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.189+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464528062 0 0) 0x7ff5340b4f00 con 0x7ff5340b3e10 2024-09-11T22:24:23.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.189+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff51c003520 con 0x7ff5340b3e10 2024-09-11T22:24:23.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 589142324 0 0) 0x7ff51c003520 con 0x7ff5340b3e10 2024-09-11T22:24:23.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 >> v2:172.21.15.77:3300/0 conn(0x7ff5340d05e0 msgr2=0x7ff5340b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:23.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53909d640 1 --2- 172.21.15.50:0/3388847223 >> v2:172.21.15.77:3300/0 conn(0x7ff5340d05e0 0x7ff5340b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 >> v1:172.21.15.77:6789/0 conn(0x7ff53415c2c0 legacy=0x7ff5340cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5340b54a0 con 0x7ff5340b3e10 2024-09-11T22:24:23.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7ff52c001670 con 0x7ff5340b3e10 2024-09-11T22:24:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 >> v1:172.21.15.50:6789/0 conn(0x7ff5340b3e10 legacy=0x7ff5340ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53909d640 1 --2- 172.21.15.50:0/3388847223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff51c0039b0 0x7ff51c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53909d640 1 --2- 172.21.15.50:0/3388847223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff51c004800 0x7ff51c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53909d640 1 --2- 172.21.15.50:0/3388847223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51c0051c0 0x7ff51c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff5340b51c0 con 0x7ff51c0039b0 2024-09-11T22:24:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c00c060 con 0x7ff51c0051c0 2024-09-11T22:24:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff51c00c260 con 0x7ff51c004800 2024-09-11T22:24:23.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53989e640 1 --2- 172.21.15.50:0/3388847223 >> v2:172.21.15.77:3300/0 conn(0x7ff5340d05e0 0x7ff5340b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:24:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53a09f640 1 --2- 172.21.15.50:0/3388847223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff51c0039b0 0x7ff51c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53a8a0640 1 --2- 172.21.15.50:0/3388847223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51c0051c0 0x7ff51c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53989e640 1 --2- 172.21.15.50:0/3388847223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff51c004800 0x7ff51c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53a09f640 1 -- 172.21.15.50:0/3388847223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff51c004800 msgr2=0x7ff51c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53a09f640 1 --2- 172.21.15.50:0/3388847223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff51c004800 0x7ff51c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53a09f640 1 -- 172.21.15.50:0/3388847223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51c0051c0 msgr2=0x7ff51c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53a09f640 1 --2- 172.21.15.50:0/3388847223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51c0051c0 0x7ff51c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53a09f640 1 -- 172.21.15.50:0/3388847223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c003520 con 0x7ff51c0039b0 2024-09-11T22:24:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53a8a0640 1 --2- 172.21.15.50:0/3388847223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51c0051c0 0x7ff51c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:24:23.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.190+0000 7ff53a8a0640 1 -- 172.21.15.50:0/3388847223 reap_dead start 2024-09-11T22:24:23.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.191+0000 7ff53a09f640 1 --2- 172.21.15.50:0/3388847223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff51c0039b0 0x7ff51c003dd0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7ff524001e50 tx=0x7ff51c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96d57752d6299c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.191+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524001a70 con 0x7ff51c0039b0 2024-09-11T22:24:23.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.191+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff52402ae40 con 0x7ff51c0039b0 2024-09-11T22:24:23.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.191+0000 7ff53909d640 1 -- 172.21.15.50:0/3388847223 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524003bb0 con 0x7ff51c0039b0 2024-09-11T22:24:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.192+0000 7ff53c303640 1 -- 172.21.15.50:0/3388847223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff51c0039b0 msgr2=0x7ff51c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.192+0000 7ff53c303640 1 --2- 172.21.15.50:0/3388847223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff51c0039b0 0x7ff51c003dd0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7ff524001e50 tx=0x7ff51c005830 comp rx=0 tx=0).stop 2024-09-11T22:24:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.192+0000 7ff53c303640 1 -- 172.21.15.50:0/3388847223 shutdown_connections 2024-09-11T22:24:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.192+0000 7ff53c303640 1 --2- 172.21.15.50:0/3388847223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff51c0039b0 0x7ff51c003dd0 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.192+0000 7ff53c303640 1 -- 172.21.15.50:0/3388847223 >> 172.21.15.50:0/3388847223 conn(0x7ff5340679c0 msgr2=0x7ff534067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.192+0000 7ff53c303640 1 -- 172.21.15.50:0/3388847223 shutdown_connections 2024-09-11T22:24:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.192+0000 7ff53c303640 1 -- 172.21.15.50:0/3388847223 wait complete. 2024-09-11T22:24:23.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.193+0000 7ff53c303640 1 Processor -- start 2024-09-11T22:24:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.193+0000 7ff53c303640 1 -- start start 2024-09-11T22:24:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53c303640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff51c0039b0 0x7ff534142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53c303640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5341f5db0 0x7ff5341f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53c303640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5340b0ce0 0x7ff5340b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53c303640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff53406d070 con 0x7ff5341f5db0 2024-09-11T22:24:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53c303640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff5340ce200 con 0x7ff5340b0ce0 2024-09-11T22:24:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53c303640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff53406d1f0 con 0x7ff51c0039b0 2024-09-11T22:24:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53989e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5341f5db0 0x7ff5341f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53989e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5341f5db0 0x7ff5341f6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40686/0 (socket says 172.21.15.50:40686) 2024-09-11T22:24:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53989e640 1 -- 172.21.15.50:0/2729509025 learned_addr learned my addr 172.21.15.50:0/2729509025 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53a09f640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff51c0039b0 0x7ff534142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53a8a0640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5340b0ce0 0x7ff5340b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53989e640 1 -- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff51c0039b0 msgr2=0x7ff534142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53989e640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff51c0039b0 0x7ff534142c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53989e640 1 -- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5340b0ce0 msgr2=0x7ff5340b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53989e640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5340b0ce0 0x7ff5340b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53989e640 1 -- 172.21.15.50:0/2729509025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53415d660 con 0x7ff5341f5db0 2024-09-11T22:24:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53a09f640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff51c0039b0 0x7ff534142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53a8a0640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5340b0ce0 0x7ff5340b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff53989e640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5341f5db0 0x7ff5341f6230 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7ff528011900 tx=0x7ff528011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff532ffd640 1 -- 172.21.15.50:0/2729509025 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52800fbd0 con 0x7ff5341f5db0 2024-09-11T22:24:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff532ffd640 1 -- 172.21.15.50:0/2729509025 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff52800fd70 con 0x7ff5341f5db0 2024-09-11T22:24:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.194+0000 7ff532ffd640 1 -- 172.21.15.50:0/2729509025 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528015660 con 0x7ff5341f5db0 2024-09-11T22:24:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.195+0000 7ff53c303640 1 -- 172.21.15.50:0/2729509025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5341f6870 con 0x7ff5341f5db0 2024-09-11T22:24:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.195+0000 7ff53c303640 1 -- 172.21.15.50:0/2729509025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff534158580 con 0x7ff5341f5db0 2024-09-11T22:24:23.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.196+0000 7ff53c303640 1 -- 172.21.15.50:0/2729509025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff53415c6a0 con 0x7ff5341f5db0 2024-09-11T22:24:23.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.196+0000 7ff532ffd640 1 -- 172.21.15.50:0/2729509025 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff528015800 con 0x7ff5341f5db0 2024-09-11T22:24:23.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.197+0000 7ff532ffd640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff52006be30 0x7ff52006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.197+0000 7ff532ffd640 1 -- 172.21.15.50:0/2729509025 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7ff52808b590 con 0x7ff5341f5db0 2024-09-11T22:24:23.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.197+0000 7ff53a09f640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff52006be30 0x7ff52006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.198+0000 7ff53a09f640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff52006be30 0x7ff52006e2f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff524032000 tx=0x7ff52402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.201+0000 7ff532ffd640 1 -- 172.21.15.50:0/2729509025 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff53415d660 con 0x7ff5341f5db0 2024-09-11T22:24:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.376+0000 7ff53c303640 1 -- 172.21.15.50:0/2729509025 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff53415a430 con 0x7ff52006be30 2024-09-11T22:24:23.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.377+0000 7ff532ffd640 1 -- 172.21.15.50:0/2729509025 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff53415a430 con 0x7ff52006be30 2024-09-11T22:24:23.377 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T22:24:23.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.379+0000 7ff53c303640 1 -- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff52006be30 msgr2=0x7ff52006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.379+0000 7ff53c303640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff52006be30 0x7ff52006e2f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff524032000 tx=0x7ff52402e000 comp rx=0 tx=0).stop 2024-09-11T22:24:23.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.379+0000 7ff53c303640 1 -- 172.21.15.50:0/2729509025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5341f5db0 msgr2=0x7ff5341f6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.379+0000 7ff53c303640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5341f5db0 0x7ff5341f6230 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7ff528011900 tx=0x7ff528011dc0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.379+0000 7ff53c303640 1 -- 172.21.15.50:0/2729509025 shutdown_connections 2024-09-11T22:24:23.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.379+0000 7ff53c303640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff52006be30 0x7ff52006e2f0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.379+0000 7ff53c303640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5340b0ce0 0x7ff5340b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.379+0000 7ff53c303640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5341f5db0 0x7ff5341f6230 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.379+0000 7ff53c303640 1 --2- 172.21.15.50:0/2729509025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff51c0039b0 0x7ff534142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.379+0000 7ff53c303640 1 -- 172.21.15.50:0/2729509025 >> 172.21.15.50:0/2729509025 conn(0x7ff5340679c0 msgr2=0x7ff53415ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:23.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.379+0000 7ff53c303640 1 -- 172.21.15.50:0/2729509025 shutdown_connections 2024-09-11T22:24:23.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.379+0000 7ff53c303640 1 -- 172.21.15.50:0/2729509025 wait complete. 2024-09-11T22:24:23.390 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T22:24:23.390 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:24:23.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.496+0000 7f0a83723640 1 Processor -- start 2024-09-11T22:24:23.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.496+0000 7f0a83723640 1 -- start start 2024-09-11T22:24:23.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a83723640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a7c0b2d90 0x7f0a7c141400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a83723640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a7c140b70 0x7f0a7c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a83723640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7c141940 con 0x7f0a7c06e6a0 2024-09-11T22:24:23.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a83723640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0a7c0b4950 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a83723640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7c0b4ba0 con 0x7f0a7c140b70 2024-09-11T22:24:23.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a814bf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a7c0b2d90 0x7f0a7c141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a81cc0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0a7c06e6a0 0x7f0a7c0cf490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51832/0 (socket says 172.21.15.50:51832) 2024-09-11T22:24:23.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a814bf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a7c0b2d90 0x7f0a7c141400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40696/0 (socket says 172.21.15.50:40696) 2024-09-11T22:24:23.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a81cc0640 1 -- 172.21.15.50:0/259637554 learned_addr learned my addr 172.21.15.50:0/259637554 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:23.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a80cbe640 1 --2- 172.21.15.50:0/259637554 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a7c140b70 0x7f0a7c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a814bf640 1 -- 172.21.15.50:0/259637554 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a7c140b70 msgr2=0x7f0a7c06e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:23.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a814bf640 1 --2- 172.21.15.50:0/259637554 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a7c140b70 0x7f0a7c06e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a814bf640 1 -- 172.21.15.50:0/259637554 >> v1:172.21.15.50:6789/0 conn(0x7f0a7c06e6a0 legacy=0x7f0a7c0cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a73fff640 1 -- 172.21.15.50:0/259637554 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132824565 0 0) 0x7f0a74001490 con 0x7f0a7c06e6a0 2024-09-11T22:24:23.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.497+0000 7f0a814bf640 1 -- 172.21.15.50:0/259637554 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c0b4e80 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.498+0000 7f0a814bf640 1 --2- 172.21.15.50:0/259637554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7c0b2d90 0x7f0a7c141400 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f0a780097a0 tx=0x7f0a7802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9f768729c30d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.498+0000 7f0a73fff640 1 -- 172.21.15.50:0/259637554 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a78037070 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.498+0000 7f0a73fff640 1 -- 172.21.15.50:0/259637554 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a78032440 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.498+0000 7f0a73fff640 1 -- 172.21.15.50:0/259637554 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a78032810 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.499+0000 7f0a83723640 1 -- 172.21.15.50:0/259637554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7c0b2d90 msgr2=0x7f0a7c141400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.499+0000 7f0a83723640 1 --2- 172.21.15.50:0/259637554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7c0b2d90 0x7f0a7c141400 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f0a780097a0 tx=0x7f0a7802a180 comp rx=0 tx=0).stop 2024-09-11T22:24:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.499+0000 7f0a83723640 1 -- 172.21.15.50:0/259637554 shutdown_connections 2024-09-11T22:24:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.499+0000 7f0a83723640 1 --2- 172.21.15.50:0/259637554 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a7c140b70 0x7f0a7c06e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.499+0000 7f0a83723640 1 --2- 172.21.15.50:0/259637554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7c0b2d90 0x7f0a7c141400 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.499+0000 7f0a83723640 1 -- 172.21.15.50:0/259637554 >> 172.21.15.50:0/259637554 conn(0x7f0a7c075270 msgr2=0x7f0a7c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.499+0000 7f0a83723640 1 -- 172.21.15.50:0/259637554 shutdown_connections 2024-09-11T22:24:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.499+0000 7f0a83723640 1 -- 172.21.15.50:0/259637554 wait complete. 2024-09-11T22:24:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.500+0000 7f0a83723640 1 Processor -- start 2024-09-11T22:24:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.500+0000 7f0a83723640 1 -- start start 2024-09-11T22:24:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a83723640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a7c06e6a0 0x7f0a7c0cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a83723640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7c0b2d90 0x7f0a7c0b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a83723640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a7c140b70 0x7f0a7c0b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a83723640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c0b5720 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a83723640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c0b5440 con 0x7f0a7c140b70 2024-09-11T22:24:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a83723640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7c0b3170 con 0x7f0a7c06e6a0 2024-09-11T22:24:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a80cbe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7c0b2d90 0x7f0a7c0b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a80cbe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7c0b2d90 0x7f0a7c0b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40700/0 (socket says 172.21.15.50:40700) 2024-09-11T22:24:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a80cbe640 1 -- 172.21.15.50:0/3911064118 learned_addr learned my addr 172.21.15.50:0/3911064118 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a814bf640 1 --2- 172.21.15.50:0/3911064118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a7c06e6a0 0x7f0a7c0cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a80cbe640 1 -- 172.21.15.50:0/3911064118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a7c06e6a0 msgr2=0x7f0a7c0cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a80cbe640 1 --2- 172.21.15.50:0/3911064118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a7c06e6a0 0x7f0a7c0cdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a80cbe640 1 -- 172.21.15.50:0/3911064118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a7c140b70 msgr2=0x7f0a7c0b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a80cbe640 1 --2- 172.21.15.50:0/3911064118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a7c140b70 0x7f0a7c0b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.501+0000 7f0a80cbe640 1 -- 172.21.15.50:0/3911064118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c1f59d0 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.502+0000 7f0a80cbe640 1 --2- 172.21.15.50:0/3911064118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7c0b2d90 0x7f0a7c0b3840 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00d620 tx=0x7f0a6c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.502+0000 7f0a71ffb640 1 -- 172.21.15.50:0/3911064118 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00b620 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.502+0000 7f0a71ffb640 1 -- 172.21.15.50:0/3911064118 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a6c019070 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.502+0000 7f0a83723640 1 -- 172.21.15.50:0/3911064118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7c1346c0 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.502+0000 7f0a71ffb640 1 -- 172.21.15.50:0/3911064118 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00ba00 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.502+0000 7f0a83723640 1 -- 172.21.15.50:0/3911064118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a7c133900 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.503+0000 7f0a83723640 1 -- 172.21.15.50:0/3911064118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0a7c141400 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.503+0000 7f0a71ffb640 1 -- 172.21.15.50:0/3911064118 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a6c00bba0 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.504+0000 7f0a71ffb640 1 --2- 172.21.15.50:0/3911064118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0a6006be30 0x7f0a6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.504+0000 7f0a71ffb640 1 -- 172.21.15.50:0/3911064118 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f0a6c08b0a0 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.504+0000 7f0a71ffb640 1 --2- 172.21.15.50:0/3911064118 >> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] conn(0x7f0a60071cf0 0x7f0a60074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.504+0000 7f0a71ffb640 1 -- 172.21.15.50:0/3911064118 --> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a600747c0 con 0x7f0a60071cf0 2024-09-11T22:24:23.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.504+0000 7f0a71ffb640 1 -- 172.21.15.50:0/3911064118 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7f0a6c092050 con 0x7f0a7c0b2d90 2024-09-11T22:24:23.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.504+0000 7f0a814bf640 1 --2- 172.21.15.50:0/3911064118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0a6006be30 0x7f0a6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.504+0000 7f0a81cc0640 1 --2- 172.21.15.50:0/3911064118 >> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] conn(0x7f0a60071cf0 0x7f0a60074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.504+0000 7f0a81cc0640 1 --2- 172.21.15.50:0/3911064118 >> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] conn(0x7f0a60071cf0 0x7f0a60074110 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.504+0000 7f0a814bf640 1 --2- 172.21.15.50:0/3911064118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0a6006be30 0x7f0a6006e2f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f0a78034000 tx=0x7f0a7802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.505+0000 7f0a71ffb640 1 -- 172.21.15.50:0/3911064118 <== osd.1 v2:172.21.15.50:6824/3862509209 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a600747c0 con 0x7f0a60071cf0 2024-09-11T22:24:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.517+0000 7f0a83723640 1 -- 172.21.15.50:0/3911064118 --> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0a7c15e470 con 0x7f0a60071cf0 2024-09-11T22:24:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.518+0000 7f0a71ffb640 1 -- 172.21.15.50:0/3911064118 <== osd.1 v2:172.21.15.50:6824/3862509209 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0a7c15e470 con 0x7f0a60071cf0 2024-09-11T22:24:23.519 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:24:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:24:23.519 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:24:23.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.518+0000 7f0a83723640 1 -- 172.21.15.50:0/3911064118 >> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] conn(0x7f0a60071cf0 msgr2=0x7f0a60074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.518+0000 7f0a83723640 1 --2- 172.21.15.50:0/3911064118 >> [v2:172.21.15.50:6824/3862509209,v1:172.21.15.50:6825/3862509209] conn(0x7f0a60071cf0 0x7f0a60074110 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.518+0000 7f0a83723640 1 -- 172.21.15.50:0/3911064118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0a6006be30 msgr2=0x7f0a6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.518+0000 7f0a83723640 1 --2- 172.21.15.50:0/3911064118 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0a6006be30 0x7f0a6006e2f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f0a78034000 tx=0x7f0a7802e000 comp rx=0 tx=0).stop 2024-09-11T22:24:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.518+0000 7f0a83723640 1 -- 172.21.15.50:0/3911064118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7c0b2d90 msgr2=0x7f0a7c0b3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.518+0000 7f0a83723640 1 --2- 172.21.15.50:0/3911064118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a7c0b2d90 0x7f0a7c0b3840 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00d620 tx=0x7f0a6c00dae0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.518+0000 7f0a81cc0640 1 -- 172.21.15.50:0/3911064118 reap_dead start 2024-09-11T22:24:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.518+0000 7f0a83723640 1 -- 172.21.15.50:0/3911064118 shutdown_connections 2024-09-11T22:24:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.518+0000 7f0a83723640 1 -- 172.21.15.50:0/3911064118 >> 172.21.15.50:0/3911064118 conn(0x7f0a7c075270 msgr2=0x7f0a7c15cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.518+0000 7f0a83723640 1 -- 172.21.15.50:0/3911064118 shutdown_connections 2024-09-11T22:24:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.518+0000 7f0a83723640 1 -- 172.21.15.50:0/3911064118 wait complete. 2024-09-11T22:24:23.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T22:24:23.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.633+0000 7fd176e7b640 1 Processor -- start 2024-09-11T22:24:23.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.633+0000 7fd176e7b640 1 -- start start 2024-09-11T22:24:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd176e7b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1700cf790 0x7fd1700b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd176e7b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1700d11d0 0x7fd1700d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd176e7b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd170162110 con 0x7fd170161d30 2024-09-11T22:24:23.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd176e7b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd1700d1b80 con 0x7fd1700cf790 2024-09-11T22:24:23.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd176e7b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1700d3450 con 0x7fd1700d11d0 2024-09-11T22:24:23.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd175418640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1700d11d0 0x7fd1700d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd16ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1700cf790 0x7fd1700b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd175418640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1700d11d0 0x7fd1700d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:60656/0 (socket says 172.21.15.50:60656) 2024-09-11T22:24:23.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd175418640 1 -- 172.21.15.50:0/2699168572 learned_addr learned my addr 172.21.15.50:0/2699168572 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:23.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd16ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1700cf790 0x7fd1700b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.50:40964/0 (socket says 172.21.15.50:40964) 2024-09-11T22:24:23.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd175418640 1 -- 172.21.15.50:0/2699168572 >> v2:172.21.15.77:3300/0 conn(0x7fd1700cf790 msgr2=0x7fd1700b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:23.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd175418640 1 --2- 172.21.15.50:0/2699168572 >> v2:172.21.15.77:3300/0 conn(0x7fd1700cf790 0x7fd1700b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd175418640 1 -- 172.21.15.50:0/2699168572 >> v1:172.21.15.77:6789/0 conn(0x7fd170161d30 legacy=0x7fd170162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.634+0000 7fd175418640 1 -- 172.21.15.50:0/2699168572 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1700cfd70 con 0x7fd1700d11d0 2024-09-11T22:24:23.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.635+0000 7fd175418640 1 --2- 172.21.15.50:0/2699168572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1700d11d0 0x7fd1700d1640 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd168009e50 tx=0x7fd16802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c21048d06e11e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.635+0000 7fd16f7fe640 1 -- 172.21.15.50:0/2699168572 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168036070 con 0x7fd1700d11d0 2024-09-11T22:24:23.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.635+0000 7fd16f7fe640 1 -- 172.21.15.50:0/2699168572 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd168031600 con 0x7fd1700d11d0 2024-09-11T22:24:23.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.635+0000 7fd16f7fe640 1 -- 172.21.15.50:0/2699168572 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1680319d0 con 0x7fd1700d11d0 2024-09-11T22:24:23.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.636+0000 7fd176e7b640 1 -- 172.21.15.50:0/2699168572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1700d11d0 msgr2=0x7fd1700d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.636+0000 7fd176e7b640 1 --2- 172.21.15.50:0/2699168572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1700d11d0 0x7fd1700d1640 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd168009e50 tx=0x7fd16802a710 comp rx=0 tx=0).stop 2024-09-11T22:24:23.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.636+0000 7fd176e7b640 1 -- 172.21.15.50:0/2699168572 shutdown_connections 2024-09-11T22:24:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.636+0000 7fd176e7b640 1 --2- 172.21.15.50:0/2699168572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1700d11d0 0x7fd1700d1640 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.636+0000 7fd176e7b640 1 --2- 172.21.15.50:0/2699168572 >> v2:172.21.15.77:3300/0 conn(0x7fd1700cf790 0x7fd1700b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.636+0000 7fd176e7b640 1 -- 172.21.15.50:0/2699168572 >> 172.21.15.50:0/2699168572 conn(0x7fd1700727a0 msgr2=0x7fd1700679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.636+0000 7fd176e7b640 1 -- 172.21.15.50:0/2699168572 shutdown_connections 2024-09-11T22:24:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.636+0000 7fd176e7b640 1 -- 172.21.15.50:0/2699168572 wait complete. 2024-09-11T22:24:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.637+0000 7fd176e7b640 1 Processor -- start 2024-09-11T22:24:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.637+0000 7fd176e7b640 1 -- start start 2024-09-11T22:24:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.638+0000 7fd176e7b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1700cf790 0x7fd170159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.638+0000 7fd176e7b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1700d11d0 0x7fd1700c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.638+0000 7fd176e7b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd170161d30 0x7fd17015a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.638+0000 7fd176e7b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1700d2e00 con 0x7fd170161d30 2024-09-11T22:24:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.638+0000 7fd176e7b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd1700b7e30 con 0x7fd1700d11d0 2024-09-11T22:24:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.638+0000 7fd176e7b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1700d30e0 con 0x7fd1700cf790 2024-09-11T22:24:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.638+0000 7fd175418640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd170161d30 0x7fd17015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.638+0000 7fd175418640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd170161d30 0x7fd17015a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40714/0 (socket says 172.21.15.50:40714) 2024-09-11T22:24:23.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.638+0000 7fd175418640 1 -- 172.21.15.50:0/1470637852 learned_addr learned my addr 172.21.15.50:0/1470637852 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:23.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.638+0000 7fd174c17640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1700cf790 0x7fd170159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.638+0000 7fd16ffff640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1700d11d0 0x7fd1700c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.639+0000 7fd175418640 1 -- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1700cf790 msgr2=0x7fd170159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.639+0000 7fd175418640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1700cf790 0x7fd170159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.639+0000 7fd175418640 1 -- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1700d11d0 msgr2=0x7fd1700c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.639+0000 7fd175418640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1700d11d0 0x7fd1700c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.639+0000 7fd175418640 1 -- 172.21.15.50:0/1470637852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1700c9970 con 0x7fd170161d30 2024-09-11T22:24:23.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.639+0000 7fd175418640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd170161d30 0x7fd17015a880 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7fd168034040 tx=0x7fd168004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.639+0000 7fd16d7fa640 1 -- 172.21.15.50:0/1470637852 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16803f020 con 0x7fd170161d30 2024-09-11T22:24:23.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.639+0000 7fd176e7b640 1 -- 172.21.15.50:0/1470637852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1700c9c50 con 0x7fd170161d30 2024-09-11T22:24:23.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.639+0000 7fd16d7fa640 1 -- 172.21.15.50:0/1470637852 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd168037040 con 0x7fd170161d30 2024-09-11T22:24:23.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.639+0000 7fd16d7fa640 1 -- 172.21.15.50:0/1470637852 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168036070 con 0x7fd170161d30 2024-09-11T22:24:23.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.639+0000 7fd176e7b640 1 -- 172.21.15.50:0/1470637852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1700ca210 con 0x7fd170161d30 2024-09-11T22:24:23.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.640+0000 7fd176e7b640 1 -- 172.21.15.50:0/1470637852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1700b78f0 con 0x7fd170161d30 2024-09-11T22:24:23.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.641+0000 7fd16d7fa640 1 -- 172.21.15.50:0/1470637852 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd168042020 con 0x7fd170161d30 2024-09-11T22:24:23.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.641+0000 7fd16d7fa640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd15406be30 0x7fd15406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.641+0000 7fd16d7fa640 1 -- 172.21.15.50:0/1470637852 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fd1680aaed0 con 0x7fd170161d30 2024-09-11T22:24:23.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.641+0000 7fd174c17640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd15406be30 0x7fd15406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.642+0000 7fd174c17640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd15406be30 0x7fd15406e2f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd1640016e0 tx=0x7fd164009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.646+0000 7fd16d7fa640 1 -- 172.21.15.50:0/1470637852 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd168049030 con 0x7fd170161d30 2024-09-11T22:24:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.821+0000 7fd176e7b640 1 -- 172.21.15.50:0/1470637852 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd1700d5270 con 0x7fd15406be30 2024-09-11T22:24:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.821+0000 7fd16d7fa640 1 -- 172.21.15.50:0/1470637852 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd1700d5270 con 0x7fd15406be30 2024-09-11T22:24:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T22:24:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.823+0000 7fd176e7b640 1 -- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd15406be30 msgr2=0x7fd15406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.823+0000 7fd176e7b640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd15406be30 0x7fd15406e2f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd1640016e0 tx=0x7fd164009040 comp rx=0 tx=0).stop 2024-09-11T22:24:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.823+0000 7fd176e7b640 1 -- 172.21.15.50:0/1470637852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd170161d30 msgr2=0x7fd17015a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.823+0000 7fd176e7b640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd170161d30 0x7fd17015a880 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7fd168034040 tx=0x7fd168004a40 comp rx=0 tx=0).stop 2024-09-11T22:24:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.823+0000 7fd176e7b640 1 -- 172.21.15.50:0/1470637852 shutdown_connections 2024-09-11T22:24:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.823+0000 7fd176e7b640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd15406be30 0x7fd15406e2f0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.823+0000 7fd176e7b640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd170161d30 0x7fd17015a880 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.823+0000 7fd176e7b640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1700d11d0 0x7fd1700c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.823+0000 7fd176e7b640 1 --2- 172.21.15.50:0/1470637852 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1700cf790 0x7fd170159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.823+0000 7fd176e7b640 1 -- 172.21.15.50:0/1470637852 >> 172.21.15.50:0/1470637852 conn(0x7fd1700727a0 msgr2=0x7fd1700cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.823+0000 7fd176e7b640 1 -- 172.21.15.50:0/1470637852 shutdown_connections 2024-09-11T22:24:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.823+0000 7fd176e7b640 1 -- 172.21.15.50:0/1470637852 wait complete. 2024-09-11T22:24:23.835 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T22:24:23.835 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:24:23.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.941+0000 7fd841053640 1 Processor -- start 2024-09-11T22:24:23.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.941+0000 7fd841053640 1 -- start start 2024-09-11T22:24:23.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd841053640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd83c0cff00 0x7fd83c0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd841053640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd83c0b4e90 0x7fd83c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd841053640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83c0b53a0 con 0x7fd83c06e6a0 2024-09-11T22:24:23.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd841053640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd83c06eaf0 con 0x7fd83c0b4e90 2024-09-11T22:24:23.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd841053640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd83c0b5680 con 0x7fd83c0cff00 2024-09-11T22:24:23.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd83a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd83c0b4e90 0x7fd83c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd83a59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd83c0b4e90 0x7fd83c06e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40720/0 (socket says 172.21.15.50:40720) 2024-09-11T22:24:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd83b59e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd83c06e6a0 0x7fd83c15ef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51834/0 (socket says 172.21.15.50:51834) 2024-09-11T22:24:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd83a59c640 1 -- 172.21.15.50:0/2485362491 learned_addr learned my addr 172.21.15.50:0/2485362491 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd83ad9d640 1 --2- 172.21.15.50:0/2485362491 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd83c0cff00 0x7fd83c0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd83a59c640 1 -- 172.21.15.50:0/2485362491 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd83c0cff00 msgr2=0x7fd83c0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd83a59c640 1 --2- 172.21.15.50:0/2485362491 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd83c0cff00 0x7fd83c0b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd83a59c640 1 -- 172.21.15.50:0/2485362491 >> v1:172.21.15.50:6789/0 conn(0x7fd83c06e6a0 legacy=0x7fd83c15ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd83a59c640 1 -- 172.21.15.50:0/2485362491 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c15cc60 con 0x7fd83c0b4e90 2024-09-11T22:24:23.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.942+0000 7fd839d9b640 1 -- 172.21.15.50:0/2485362491 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1416595026 0 0) 0x7fd83c0b53a0 con 0x7fd83c06e6a0 2024-09-11T22:24:23.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.943+0000 7fd83a59c640 1 --2- 172.21.15.50:0/2485362491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0b4e90 0x7fd83c06e160 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7fd82400bb10 tx=0x7fd82402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fd77e7f9a212f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.943+0000 7fd839d9b640 1 -- 172.21.15.50:0/2485362491 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824036020 con 0x7fd83c0b4e90 2024-09-11T22:24:23.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.943+0000 7fd839d9b640 1 -- 172.21.15.50:0/2485362491 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd824032820 con 0x7fd83c0b4e90 2024-09-11T22:24:23.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.943+0000 7fd839d9b640 1 -- 172.21.15.50:0/2485362491 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824032bf0 con 0x7fd83c0b4e90 2024-09-11T22:24:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.944+0000 7fd841053640 1 -- 172.21.15.50:0/2485362491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0b4e90 msgr2=0x7fd83c06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.944+0000 7fd841053640 1 --2- 172.21.15.50:0/2485362491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0b4e90 0x7fd83c06e160 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7fd82400bb10 tx=0x7fd82402c920 comp rx=0 tx=0).stop 2024-09-11T22:24:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.944+0000 7fd841053640 1 -- 172.21.15.50:0/2485362491 shutdown_connections 2024-09-11T22:24:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.944+0000 7fd841053640 1 --2- 172.21.15.50:0/2485362491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0b4e90 0x7fd83c06e160 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.944+0000 7fd841053640 1 --2- 172.21.15.50:0/2485362491 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd83c0cff00 0x7fd83c0b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.944+0000 7fd841053640 1 -- 172.21.15.50:0/2485362491 >> 172.21.15.50:0/2485362491 conn(0x7fd83c075270 msgr2=0x7fd83c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.944+0000 7fd841053640 1 -- 172.21.15.50:0/2485362491 shutdown_connections 2024-09-11T22:24:23.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.944+0000 7fd841053640 1 -- 172.21.15.50:0/2485362491 wait complete. 2024-09-11T22:24:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.945+0000 7fd841053640 1 Processor -- start 2024-09-11T22:24:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.945+0000 7fd841053640 1 -- start start 2024-09-11T22:24:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd841053640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c06e6a0 0x7fd83c145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd841053640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0b4e90 0x7fd83c146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd841053640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd83c0cff00 0x7fd83c1480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd841053640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c15bbc0 con 0x7fd83c0b4e90 2024-09-11T22:24:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd841053640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c0d02e0 con 0x7fd83c06e6a0 2024-09-11T22:24:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd841053640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd83c15e470 con 0x7fd83c0cff00 2024-09-11T22:24:23.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd83a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0b4e90 0x7fd83c146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd83a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0b4e90 0x7fd83c146110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40724/0 (socket says 172.21.15.50:40724) 2024-09-11T22:24:23.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd83a59c640 1 -- 172.21.15.50:0/2365010568 learned_addr learned my addr 172.21.15.50:0/2365010568 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:23.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd83ad9d640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c06e6a0 0x7fd83c145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd83b59e640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd83c0cff00 0x7fd83c1480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd83a59c640 1 -- 172.21.15.50:0/2365010568 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd83c0cff00 msgr2=0x7fd83c1480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd83a59c640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd83c0cff00 0x7fd83c1480c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd83a59c640 1 -- 172.21.15.50:0/2365010568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c06e6a0 msgr2=0x7fd83c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd83a59c640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c06e6a0 0x7fd83c145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd83a59c640 1 -- 172.21.15.50:0/2365010568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c145e90 con 0x7fd83c0b4e90 2024-09-11T22:24:23.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.946+0000 7fd83ad9d640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c06e6a0 0x7fd83c145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:24:23.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.947+0000 7fd83a59c640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0b4e90 0x7fd83c146110 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7fd82402c960 tx=0x7fd8240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.947+0000 7fd8337fe640 1 -- 172.21.15.50:0/2365010568 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824036040 con 0x7fd83c0b4e90 2024-09-11T22:24:23.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.947+0000 7fd8337fe640 1 -- 172.21.15.50:0/2365010568 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd82403cd70 con 0x7fd83c0b4e90 2024-09-11T22:24:23.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.947+0000 7fd841053640 1 -- 172.21.15.50:0/2365010568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83c146650 con 0x7fd83c0b4e90 2024-09-11T22:24:23.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.947+0000 7fd8337fe640 1 -- 172.21.15.50:0/2365010568 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824046630 con 0x7fd83c0b4e90 2024-09-11T22:24:23.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.947+0000 7fd841053640 1 -- 172.21.15.50:0/2365010568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83c152a70 con 0x7fd83c0b4e90 2024-09-11T22:24:23.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.948+0000 7fd841053640 1 -- 172.21.15.50:0/2365010568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd83c06e160 con 0x7fd83c0b4e90 2024-09-11T22:24:23.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.948+0000 7fd8337fe640 1 -- 172.21.15.50:0/2365010568 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd82404d060 con 0x7fd83c0b4e90 2024-09-11T22:24:23.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.949+0000 7fd8337fe640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd81c06be30 0x7fd81c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.949+0000 7fd8337fe640 1 -- 172.21.15.50:0/2365010568 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fd8240add90 con 0x7fd83c0b4e90 2024-09-11T22:24:23.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.949+0000 7fd8337fe640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] conn(0x7fd81c071cf0 0x7fd81c074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:23.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.949+0000 7fd8337fe640 1 -- 172.21.15.50:0/2365010568 --> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd824043e50 con 0x7fd81c071cf0 2024-09-11T22:24:23.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.949+0000 7fd8337fe640 1 -- 172.21.15.50:0/2365010568 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7fd8240b0490 con 0x7fd83c0b4e90 2024-09-11T22:24:23.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.949+0000 7fd83b59e640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] conn(0x7fd81c071cf0 0x7fd81c074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.949+0000 7fd83ad9d640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd81c06be30 0x7fd81c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:23.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.950+0000 7fd83b59e640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] conn(0x7fd81c071cf0 0x7fd81c074110 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.950+0000 7fd83ad9d640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd81c06be30 0x7fd81c06e2f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fd834006fd0 tx=0x7fd834008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:23.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.950+0000 7fd8337fe640 1 -- 172.21.15.50:0/2365010568 <== osd.2 v2:172.21.15.50:6808/2284963545 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd824043e50 con 0x7fd81c071cf0 2024-09-11T22:24:23.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.963+0000 7fd841053640 1 -- 172.21.15.50:0/2365010568 --> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd83c148880 con 0x7fd81c071cf0 2024-09-11T22:24:23.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.963+0000 7fd8337fe640 1 -- 172.21.15.50:0/2365010568 <== osd.2 v2:172.21.15.50:6808/2284963545 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd83c148880 con 0x7fd81c071cf0 2024-09-11T22:24:23.964 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:24:23.964 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:24:23.964 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:24:23.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.963+0000 7fd841053640 1 -- 172.21.15.50:0/2365010568 >> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] conn(0x7fd81c071cf0 msgr2=0x7fd81c074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.963+0000 7fd841053640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.50:6808/2284963545,v1:172.21.15.50:6809/2284963545] conn(0x7fd81c071cf0 0x7fd81c074110 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.963+0000 7fd841053640 1 -- 172.21.15.50:0/2365010568 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd81c06be30 msgr2=0x7fd81c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.963+0000 7fd841053640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd81c06be30 0x7fd81c06e2f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fd834006fd0 tx=0x7fd834008040 comp rx=0 tx=0).stop 2024-09-11T22:24:23.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.963+0000 7fd841053640 1 -- 172.21.15.50:0/2365010568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0b4e90 msgr2=0x7fd83c146110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.963+0000 7fd841053640 1 --2- 172.21.15.50:0/2365010568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c0b4e90 0x7fd83c146110 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7fd82402c960 tx=0x7fd8240046c0 comp rx=0 tx=0).stop 2024-09-11T22:24:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.963+0000 7fd83b59e640 1 -- 172.21.15.50:0/2365010568 reap_dead start 2024-09-11T22:24:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.963+0000 7fd841053640 1 -- 172.21.15.50:0/2365010568 shutdown_connections 2024-09-11T22:24:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.963+0000 7fd841053640 1 -- 172.21.15.50:0/2365010568 >> 172.21.15.50:0/2365010568 conn(0x7fd83c075270 msgr2=0x7fd83c0b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.964+0000 7fd841053640 1 -- 172.21.15.50:0/2365010568 shutdown_connections 2024-09-11T22:24:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:23.964+0000 7fd841053640 1 -- 172.21.15.50:0/2365010568 wait complete. 2024-09-11T22:24:23.975 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T22:24:24.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.077+0000 7fe223e8d640 1 Processor -- start 2024-09-11T22:24:24.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.077+0000 7fe223e8d640 1 -- start start 2024-09-11T22:24:24.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.078+0000 7fe223e8d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe21c161d30 0x7fe21c0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.078+0000 7fe223e8d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe21c0b78f0 0x7fe21c162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.078+0000 7fe223e8d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c1632e0 con 0x7fe21c0d11d0 2024-09-11T22:24:24.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.078+0000 7fe223e8d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fe21c0d3450 con 0x7fe21c161d30 2024-09-11T22:24:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.078+0000 7fe223e8d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe21c162110 con 0x7fe21c0b78f0 2024-09-11T22:24:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.078+0000 7fe221c29640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe21c161d30 0x7fe21c0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.078+0000 7fe221c29640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe21c161d30 0x7fe21c0cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40736/0 (socket says 172.21.15.50:40736) 2024-09-11T22:24:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.078+0000 7fe22242a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe21c0d11d0 0x7fe21c0d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51848/0 (socket says 172.21.15.50:51848) 2024-09-11T22:24:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.078+0000 7fe221c29640 1 -- 172.21.15.50:0/3930062435 learned_addr learned my addr 172.21.15.50:0/3930062435 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.078+0000 7fe221c29640 1 -- 172.21.15.50:0/3930062435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe21c0b78f0 msgr2=0x7fe21c162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.078+0000 7fe221428640 1 --2- 172.21.15.50:0/3930062435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe21c0b78f0 0x7fe21c162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.078+0000 7fe220c27640 1 -- 172.21.15.50:0/3930062435 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347034793 0 0) 0x7fe21c1632e0 con 0x7fe21c0d11d0 2024-09-11T22:24:24.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.078+0000 7fe221c29640 1 --2- 172.21.15.50:0/3930062435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe21c0b78f0 0x7fe21c162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.079+0000 7fe221c29640 1 -- 172.21.15.50:0/3930062435 >> v1:172.21.15.50:6789/0 conn(0x7fe21c0d11d0 legacy=0x7fe21c0d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.079+0000 7fe221c29640 1 -- 172.21.15.50:0/3930062435 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c0cfd70 con 0x7fe21c161d30 2024-09-11T22:24:24.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.079+0000 7fe221c29640 1 --2- 172.21.15.50:0/3930062435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe21c161d30 0x7fe21c0cf790 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7fe218009870 tx=0x7fe21802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc56b70150dbd64 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.079+0000 7fe220c27640 1 -- 172.21.15.50:0/3930062435 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe218037070 con 0x7fe21c161d30 2024-09-11T22:24:24.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.079+0000 7fe220c27640 1 -- 172.21.15.50:0/3930062435 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe218032440 con 0x7fe21c161d30 2024-09-11T22:24:24.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.079+0000 7fe220c27640 1 -- 172.21.15.50:0/3930062435 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe218032810 con 0x7fe21c161d30 2024-09-11T22:24:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.080+0000 7fe223e8d640 1 -- 172.21.15.50:0/3930062435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe21c161d30 msgr2=0x7fe21c0cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.080+0000 7fe223e8d640 1 --2- 172.21.15.50:0/3930062435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe21c161d30 0x7fe21c0cf790 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7fe218009870 tx=0x7fe21802a270 comp rx=0 tx=0).stop 2024-09-11T22:24:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.080+0000 7fe223e8d640 1 -- 172.21.15.50:0/3930062435 shutdown_connections 2024-09-11T22:24:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.080+0000 7fe223e8d640 1 --2- 172.21.15.50:0/3930062435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe21c0b78f0 0x7fe21c162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.080+0000 7fe223e8d640 1 --2- 172.21.15.50:0/3930062435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe21c161d30 0x7fe21c0cf790 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.080+0000 7fe223e8d640 1 -- 172.21.15.50:0/3930062435 >> 172.21.15.50:0/3930062435 conn(0x7fe21c0727a0 msgr2=0x7fe21c0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.080+0000 7fe223e8d640 1 -- 172.21.15.50:0/3930062435 shutdown_connections 2024-09-11T22:24:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.080+0000 7fe223e8d640 1 -- 172.21.15.50:0/3930062435 wait complete. 2024-09-11T22:24:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.081+0000 7fe223e8d640 1 Processor -- start 2024-09-11T22:24:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.081+0000 7fe223e8d640 1 -- start start 2024-09-11T22:24:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe223e8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe21c0b78f0 0x7fe21c1f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe223e8d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe21c0d11d0 0x7fe21c1f7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe223e8d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe21c161d30 0x7fe21c0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe223e8d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0d30e0 con 0x7fe21c0d11d0 2024-09-11T22:24:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe223e8d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0d2e00 con 0x7fe21c0b78f0 2024-09-11T22:24:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe223e8d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe21c0b7d30 con 0x7fe21c161d30 2024-09-11T22:24:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe221428640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe21c0d11d0 0x7fe21c1f7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe221428640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe21c0d11d0 0x7fe21c1f7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40742/0 (socket says 172.21.15.50:40742) 2024-09-11T22:24:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe221428640 1 -- 172.21.15.50:0/2481491612 learned_addr learned my addr 172.21.15.50:0/2481491612 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe22242a640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe21c161d30 0x7fe21c0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe221c29640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe21c0b78f0 0x7fe21c1f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe221428640 1 -- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe21c161d30 msgr2=0x7fe21c0ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe221428640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe21c161d30 0x7fe21c0ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe221428640 1 -- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe21c0b78f0 msgr2=0x7fe21c1f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe221428640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe21c0b78f0 0x7fe21c1f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.082+0000 7fe221428640 1 -- 172.21.15.50:0/2481491612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c0c9860 con 0x7fe21c0d11d0 2024-09-11T22:24:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.083+0000 7fe22242a640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe21c161d30 0x7fe21c0ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.083+0000 7fe221c29640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe21c0b78f0 0x7fe21c1f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.083+0000 7fe221428640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe21c0d11d0 0x7fe21c1f7820 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00c820 tx=0x7fe20c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.083+0000 7fe2127fc640 1 -- 172.21.15.50:0/2481491612 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c015070 con 0x7fe21c0d11d0 2024-09-11T22:24:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.083+0000 7fe2127fc640 1 -- 172.21.15.50:0/2481491612 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe20c004220 con 0x7fe21c0d11d0 2024-09-11T22:24:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.083+0000 7fe223e8d640 1 -- 172.21.15.50:0/2481491612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21c0b5380 con 0x7fe21c0d11d0 2024-09-11T22:24:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.083+0000 7fe2127fc640 1 -- 172.21.15.50:0/2481491612 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c00ce10 con 0x7fe21c0d11d0 2024-09-11T22:24:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.083+0000 7fe223e8d640 1 -- 172.21.15.50:0/2481491612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21c0b5940 con 0x7fe21c0d11d0 2024-09-11T22:24:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.084+0000 7fe223e8d640 1 -- 172.21.15.50:0/2481491612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe21c0cf790 con 0x7fe21c0d11d0 2024-09-11T22:24:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.085+0000 7fe2127fc640 1 -- 172.21.15.50:0/2481491612 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe20c007830 con 0x7fe21c0d11d0 2024-09-11T22:24:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.085+0000 7fe2127fc640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe20006be30 0x7fe20006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.085+0000 7fe2127fc640 1 -- 172.21.15.50:0/2481491612 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fe20c08a980 con 0x7fe21c0d11d0 2024-09-11T22:24:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.085+0000 7fe221c29640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe20006be30 0x7fe20006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.086+0000 7fe221c29640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe20006be30 0x7fe20006e2f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fe218034000 tx=0x7fe21802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.089+0000 7fe2127fc640 1 -- 172.21.15.50:0/2481491612 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe20c0596c0 con 0x7fe21c0d11d0 2024-09-11T22:24:24.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.263+0000 7fe223e8d640 1 -- 172.21.15.50:0/2481491612 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe21c0cb050 con 0x7fe20006be30 2024-09-11T22:24:24.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.264+0000 7fe2127fc640 1 -- 172.21.15.50:0/2481491612 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe218032710 con 0x7fe20006be30 2024-09-11T22:24:24.265 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T22:24:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.266+0000 7fe223e8d640 1 -- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe20006be30 msgr2=0x7fe20006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.266+0000 7fe223e8d640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe20006be30 0x7fe20006e2f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fe218034000 tx=0x7fe21802e000 comp rx=0 tx=0).stop 2024-09-11T22:24:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.266+0000 7fe223e8d640 1 -- 172.21.15.50:0/2481491612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe21c0d11d0 msgr2=0x7fe21c1f7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.266+0000 7fe223e8d640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe21c0d11d0 0x7fe21c1f7820 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00c820 tx=0x7fe20c00cce0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.266+0000 7fe223e8d640 1 -- 172.21.15.50:0/2481491612 shutdown_connections 2024-09-11T22:24:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.266+0000 7fe223e8d640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fe20006be30 0x7fe20006e2f0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.266+0000 7fe223e8d640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe21c161d30 0x7fe21c0ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.266+0000 7fe223e8d640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe21c0d11d0 0x7fe21c1f7820 unknown :-1 s=CLOSED pgs=2387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.266+0000 7fe223e8d640 1 --2- 172.21.15.50:0/2481491612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe21c0b78f0 0x7fe21c1f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.266+0000 7fe223e8d640 1 -- 172.21.15.50:0/2481491612 >> 172.21.15.50:0/2481491612 conn(0x7fe21c0727a0 msgr2=0x7fe21c0cb890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.266+0000 7fe223e8d640 1 -- 172.21.15.50:0/2481491612 shutdown_connections 2024-09-11T22:24:24.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.266+0000 7fe223e8d640 1 -- 172.21.15.50:0/2481491612 wait complete. 2024-09-11T22:24:24.277 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T22:24:24.278 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:24:24.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.384+0000 7f11137bd640 1 Processor -- start 2024-09-11T22:24:24.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.384+0000 7f11137bd640 1 -- start start 2024-09-11T22:24:24.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.385+0000 7f11137bd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f110c0cf610 0x7f110c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.385+0000 7f11137bd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110c0cfbd0 con 0x7f110c0b1600 2024-09-11T22:24:24.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.385+0000 7f11137bd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110c0cfeb0 con 0x7f110c161fa0 2024-09-11T22:24:24.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.385+0000 7f11137bd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f110c0d1220 con 0x7f110c0cf610 2024-09-11T22:24:24.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.385+0000 7f1111d5a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f110c0b1600 0x7f110c0cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51850/0 (socket says 172.21.15.50:51850) 2024-09-11T22:24:24.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.385+0000 7f1111d5a640 1 -- 172.21.15.50:0/700249237 learned_addr learned my addr 172.21.15.50:0/700249237 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:24.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.385+0000 7f1110d58640 1 --2- 172.21.15.50:0/700249237 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f110c0cf610 0x7f110c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.386+0000 7f110bfff640 1 -- 172.21.15.50:0/700249237 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564105631 0 0) 0x7f110c0cfbd0 con 0x7f110c0b1600 2024-09-11T22:24:24.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.386+0000 7f110bfff640 1 -- 172.21.15.50:0/700249237 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10f4003520 con 0x7f110c0b1600 2024-09-11T22:24:24.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.386+0000 7f110bfff640 1 -- 172.21.15.50:0/700249237 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1695750439 0 0) 0x7f110c0cfeb0 con 0x7f110c161fa0 2024-09-11T22:24:24.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.386+0000 7f110bfff640 1 -- 172.21.15.50:0/700249237 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f110c0cfbd0 con 0x7f110c161fa0 2024-09-11T22:24:24.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.386+0000 7f1110d58640 1 -- 172.21.15.50:0/700249237 >> v1:172.21.15.77:6789/0 conn(0x7f110c161fa0 legacy=0x7f110c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.386+0000 7f1110d58640 1 -- 172.21.15.50:0/700249237 >> v1:172.21.15.50:6789/0 conn(0x7f110c0b1600 legacy=0x7f110c0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.386+0000 7f1110d58640 1 -- 172.21.15.50:0/700249237 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110c0d1470 con 0x7f110c0cf610 2024-09-11T22:24:24.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.387+0000 7f1110d58640 1 --2- 172.21.15.50:0/700249237 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f110c0cf610 0x7f110c0b4d20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f11000097d0 tx=0x7f110002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3389cc9c69b756b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.387+0000 7f110bfff640 1 -- 172.21.15.50:0/700249237 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100037070 con 0x7f110c0cf610 2024-09-11T22:24:24.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.387+0000 7f110bfff640 1 -- 172.21.15.50:0/700249237 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1100032440 con 0x7f110c0cf610 2024-09-11T22:24:24.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.387+0000 7f110bfff640 1 -- 172.21.15.50:0/700249237 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11000327f0 con 0x7f110c0cf610 2024-09-11T22:24:24.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.387+0000 7f11137bd640 1 -- 172.21.15.50:0/700249237 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f110c0cf610 msgr2=0x7f110c0b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.387+0000 7f11137bd640 1 --2- 172.21.15.50:0/700249237 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f110c0cf610 0x7f110c0b4d20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f11000097d0 tx=0x7f110002a210 comp rx=0 tx=0).stop 2024-09-11T22:24:24.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.387+0000 7f11137bd640 1 -- 172.21.15.50:0/700249237 shutdown_connections 2024-09-11T22:24:24.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.387+0000 7f11137bd640 1 --2- 172.21.15.50:0/700249237 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f110c0cf610 0x7f110c0b4d20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.387+0000 7f11137bd640 1 -- 172.21.15.50:0/700249237 >> 172.21.15.50:0/700249237 conn(0x7f110c09ba50 msgr2=0x7f110c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:24.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.387+0000 7f11137bd640 1 -- 172.21.15.50:0/700249237 shutdown_connections 2024-09-11T22:24:24.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.387+0000 7f11137bd640 1 -- 172.21.15.50:0/700249237 wait complete. 2024-09-11T22:24:24.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.389+0000 7f11137bd640 1 Processor -- start 2024-09-11T22:24:24.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.389+0000 7f11137bd640 1 -- start start 2024-09-11T22:24:24.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.389+0000 7f11137bd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c0b1600 0x7f110c15bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.389+0000 7f11137bd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f110c0cf610 0x7f110c0b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.389+0000 7f11137bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f110c161fa0 0x7f110c15ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.389+0000 7f11137bd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f110c0d1c70 con 0x7f110c0b1600 2024-09-11T22:24:24.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.389+0000 7f11137bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f110c0d17e0 con 0x7f110c161fa0 2024-09-11T22:24:24.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.389+0000 7f11137bd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f110c0d1df0 con 0x7f110c0cf610 2024-09-11T22:24:24.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.389+0000 7f1111559640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c0b1600 0x7f110c15bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1111559640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c0b1600 0x7f110c15bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40754/0 (socket says 172.21.15.50:40754) 2024-09-11T22:24:24.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1111559640 1 -- 172.21.15.50:0/1365863478 learned_addr learned my addr 172.21.15.50:0/1365863478 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:24.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1110d58640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f110c0cf610 0x7f110c0b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1111d5a640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f110c161fa0 0x7f110c15ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1111559640 1 -- 172.21.15.50:0/1365863478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f110c0cf610 msgr2=0x7f110c0b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1111559640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f110c0cf610 0x7f110c0b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1111559640 1 -- 172.21.15.50:0/1365863478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f110c161fa0 msgr2=0x7f110c15ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1111559640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f110c161fa0 0x7f110c15ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1111559640 1 -- 172.21.15.50:0/1365863478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110c1f7b60 con 0x7f110c0b1600 2024-09-11T22:24:24.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1110d58640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f110c0cf610 0x7f110c0b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:24:24.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1111559640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c0b1600 0x7f110c15bc90 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7f110400c530 tx=0x7f110400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1109ffb640 1 -- 172.21.15.50:0/1365863478 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11040052d0 con 0x7f110c0b1600 2024-09-11T22:24:24.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f11137bd640 1 -- 172.21.15.50:0/1365863478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f110c1f7e40 con 0x7f110c0b1600 2024-09-11T22:24:24.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1109ffb640 1 -- 172.21.15.50:0/1365863478 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1104005490 con 0x7f110c0b1600 2024-09-11T22:24:24.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f1109ffb640 1 -- 172.21.15.50:0/1365863478 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104012870 con 0x7f110c0b1600 2024-09-11T22:24:24.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.390+0000 7f11137bd640 1 -- 172.21.15.50:0/1365863478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f110c1f8400 con 0x7f110c0b1600 2024-09-11T22:24:24.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.391+0000 7f11137bd640 1 -- 172.21.15.50:0/1365863478 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f110c1f7910 con 0x7f110c0b1600 2024-09-11T22:24:24.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.392+0000 7f1109ffb640 1 -- 172.21.15.50:0/1365863478 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1104012a10 con 0x7f110c0b1600 2024-09-11T22:24:24.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.392+0000 7f1109ffb640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f10f806be60 0x7f10f806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.392+0000 7f1109ffb640 1 -- 172.21.15.50:0/1365863478 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f110408a880 con 0x7f110c0b1600 2024-09-11T22:24:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.392+0000 7f1109ffb640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x7f10f8071d20 0x7f10f8074140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.393+0000 7f1109ffb640 1 -- 172.21.15.50:0/1365863478 --> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10f80747f0 con 0x7f10f8071d20 2024-09-11T22:24:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.393+0000 7f1109ffb640 1 -- 172.21.15.50:0/1365863478 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7f110408f2a0 con 0x7f110c0b1600 2024-09-11T22:24:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.393+0000 7f1110d58640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f10f806be60 0x7f10f806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.393+0000 7f1111d5a640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x7f10f8071d20 0x7f10f8074140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.393+0000 7f1111d5a640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x7f10f8071d20 0x7f10f8074140 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.393+0000 7f1110d58640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f10f806be60 0x7f10f806e320 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f1100034000 tx=0x7f110002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.394+0000 7f1109ffb640 1 -- 172.21.15.50:0/1365863478 <== osd.3 v2:172.21.15.50:6800/593319808 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10f80747f0 con 0x7f10f8071d20 2024-09-11T22:24:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.406+0000 7f11137bd640 1 -- 172.21.15.50:0/1365863478 --> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f110c0b4d20 con 0x7f10f8071d20 2024-09-11T22:24:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.406+0000 7f1109ffb640 1 -- 172.21.15.50:0/1365863478 <== osd.3 v2:172.21.15.50:6800/593319808 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f110c0b4d20 con 0x7f10f8071d20 2024-09-11T22:24:24.407 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:24:24.408 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:24:24.408 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:24:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.407+0000 7f11137bd640 1 -- 172.21.15.50:0/1365863478 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x7f10f8071d20 msgr2=0x7f10f8074140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.407+0000 7f11137bd640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.50:6800/593319808,v1:172.21.15.50:6801/593319808] conn(0x7f10f8071d20 0x7f10f8074140 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.407+0000 7f11137bd640 1 -- 172.21.15.50:0/1365863478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f10f806be60 msgr2=0x7f10f806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.407+0000 7f11137bd640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f10f806be60 0x7f10f806e320 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f1100034000 tx=0x7f110002e000 comp rx=0 tx=0).stop 2024-09-11T22:24:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.407+0000 7f11137bd640 1 -- 172.21.15.50:0/1365863478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c0b1600 msgr2=0x7f110c15bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.407+0000 7f11137bd640 1 --2- 172.21.15.50:0/1365863478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f110c0b1600 0x7f110c15bc90 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7f110400c530 tx=0x7f110400c9f0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.407+0000 7f1111d5a640 1 -- 172.21.15.50:0/1365863478 reap_dead start 2024-09-11T22:24:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.407+0000 7f11137bd640 1 -- 172.21.15.50:0/1365863478 shutdown_connections 2024-09-11T22:24:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.407+0000 7f11137bd640 1 -- 172.21.15.50:0/1365863478 >> 172.21.15.50:0/1365863478 conn(0x7f110c09ba50 msgr2=0x7f110c0afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.407+0000 7f11137bd640 1 -- 172.21.15.50:0/1365863478 shutdown_connections 2024-09-11T22:24:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.407+0000 7f11137bd640 1 -- 172.21.15.50:0/1365863478 wait complete. 2024-09-11T22:24:24.418 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T22:24:24.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.521+0000 7fd7565cf640 1 Processor -- start 2024-09-11T22:24:24.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.521+0000 7fd7565cf640 1 -- start start 2024-09-11T22:24:24.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd7565cf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75015c2c0 0x7fd7500b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd7565cf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd7500d05e0 0x7fd7500ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd7565cf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7500b4f00 con 0x7fd7500b3e10 2024-09-11T22:24:24.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd7565cf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fd7500b4360 con 0x7fd7500d05e0 2024-09-11T22:24:24.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd7565cf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd7500b51c0 con 0x7fd75015c2c0 2024-09-11T22:24:24.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd754b6c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd7500d05e0 0x7fd7500ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd754b6c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd7500d05e0 0x7fd7500ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40770/0 (socket says 172.21.15.50:40770) 2024-09-11T22:24:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd754b6c640 1 -- 172.21.15.50:0/308960333 learned_addr learned my addr 172.21.15.50:0/308960333 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd74f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd7500b3e10 0x7fd7500cfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51860/0 (socket says 172.21.15.50:51860) 2024-09-11T22:24:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd74ffff640 1 --2- 172.21.15.50:0/308960333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75015c2c0 0x7fd7500b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd754b6c640 1 -- 172.21.15.50:0/308960333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75015c2c0 msgr2=0x7fd7500b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd754b6c640 1 --2- 172.21.15.50:0/308960333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75015c2c0 0x7fd7500b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd754b6c640 1 -- 172.21.15.50:0/308960333 >> v1:172.21.15.50:6789/0 conn(0x7fd7500b3e10 legacy=0x7fd7500cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd754b6c640 1 -- 172.21.15.50:0/308960333 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7500b54a0 con 0x7fd7500d05e0 2024-09-11T22:24:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.522+0000 7fd74effd640 1 -- 172.21.15.50:0/308960333 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1070736021 0 0) 0x7fd7500b4f00 con 0x7fd7500b3e10 2024-09-11T22:24:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.523+0000 7fd754b6c640 1 --2- 172.21.15.50:0/308960333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7500d05e0 0x7fd7500ce790 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7fd748009e50 tx=0x7fd74802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3dab9fe4a9487a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.523+0000 7fd74effd640 1 -- 172.21.15.50:0/308960333 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd748036070 con 0x7fd7500d05e0 2024-09-11T22:24:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.523+0000 7fd74effd640 1 -- 172.21.15.50:0/308960333 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd748031600 con 0x7fd7500d05e0 2024-09-11T22:24:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.523+0000 7fd74effd640 1 -- 172.21.15.50:0/308960333 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7480319d0 con 0x7fd7500d05e0 2024-09-11T22:24:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.524+0000 7fd7565cf640 1 -- 172.21.15.50:0/308960333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7500d05e0 msgr2=0x7fd7500ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.524+0000 7fd7565cf640 1 --2- 172.21.15.50:0/308960333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7500d05e0 0x7fd7500ce790 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7fd748009e50 tx=0x7fd74802a680 comp rx=0 tx=0).stop 2024-09-11T22:24:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.524+0000 7fd7565cf640 1 -- 172.21.15.50:0/308960333 shutdown_connections 2024-09-11T22:24:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.524+0000 7fd7565cf640 1 --2- 172.21.15.50:0/308960333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7500d05e0 0x7fd7500ce790 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.524+0000 7fd7565cf640 1 --2- 172.21.15.50:0/308960333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75015c2c0 0x7fd7500b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.524+0000 7fd7565cf640 1 -- 172.21.15.50:0/308960333 >> 172.21.15.50:0/308960333 conn(0x7fd7500679c0 msgr2=0x7fd750067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.524+0000 7fd7565cf640 1 -- 172.21.15.50:0/308960333 shutdown_connections 2024-09-11T22:24:24.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.524+0000 7fd7565cf640 1 -- 172.21.15.50:0/308960333 wait complete. 2024-09-11T22:24:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.525+0000 7fd7565cf640 1 Processor -- start 2024-09-11T22:24:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.525+0000 7fd7565cf640 1 -- start start 2024-09-11T22:24:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd7565cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7500b3e10 0x7fd75006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd7565cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7500d05e0 0x7fd7500ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd7565cf640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75015c2c0 0x7fd7500aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd7565cf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd75006d070 con 0x7fd7500d05e0 2024-09-11T22:24:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd7565cf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd7500ce200 con 0x7fd7500b3e10 2024-09-11T22:24:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd7565cf640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd75006d1f0 con 0x7fd75015c2c0 2024-09-11T22:24:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd74f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7500d05e0 0x7fd7500ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd74f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7500d05e0 0x7fd7500ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40782/0 (socket says 172.21.15.50:40782) 2024-09-11T22:24:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd74f7fe640 1 -- 172.21.15.50:0/2590604957 learned_addr learned my addr 172.21.15.50:0/2590604957 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd74ffff640 1 --2- 172.21.15.50:0/2590604957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7500b3e10 0x7fd75006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd74f7fe640 1 -- 172.21.15.50:0/2590604957 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75015c2c0 msgr2=0x7fd7500aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd74f7fe640 1 --2- 172.21.15.50:0/2590604957 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75015c2c0 0x7fd7500aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd74f7fe640 1 -- 172.21.15.50:0/2590604957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7500b3e10 msgr2=0x7fd75006ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd74f7fe640 1 --2- 172.21.15.50:0/2590604957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7500b3e10 0x7fd75006ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd74f7fe640 1 -- 172.21.15.50:0/2590604957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75014cf20 con 0x7fd7500d05e0 2024-09-11T22:24:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.526+0000 7fd74f7fe640 1 --2- 172.21.15.50:0/2590604957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7500d05e0 0x7fd7500ae8c0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7fd74400c4d0 tx=0x7fd74400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.527+0000 7fd74cff9640 1 -- 172.21.15.50:0/2590604957 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744018070 con 0x7fd7500d05e0 2024-09-11T22:24:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.527+0000 7fd74cff9640 1 -- 172.21.15.50:0/2590604957 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd744007500 con 0x7fd7500d05e0 2024-09-11T22:24:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.527+0000 7fd7565cf640 1 -- 172.21.15.50:0/2590604957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75014d200 con 0x7fd7500d05e0 2024-09-11T22:24:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.527+0000 7fd74cff9640 1 -- 172.21.15.50:0/2590604957 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744004a20 con 0x7fd7500d05e0 2024-09-11T22:24:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.527+0000 7fd7565cf640 1 -- 172.21.15.50:0/2590604957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd75014d7c0 con 0x7fd7500d05e0 2024-09-11T22:24:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.528+0000 7fd7565cf640 1 -- 172.21.15.50:0/2590604957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7500b13a0 con 0x7fd7500d05e0 2024-09-11T22:24:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.528+0000 7fd74cff9640 1 -- 172.21.15.50:0/2590604957 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd74401b070 con 0x7fd7500d05e0 2024-09-11T22:24:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.529+0000 7fd74cff9640 1 --2- 172.21.15.50:0/2590604957 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd73c06be30 0x7fd73c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.529+0000 7fd74cff9640 1 -- 172.21.15.50:0/2590604957 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fd744089e50 con 0x7fd7500d05e0 2024-09-11T22:24:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.529+0000 7fd74ffff640 1 --2- 172.21.15.50:0/2590604957 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd73c06be30 0x7fd73c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.529+0000 7fd74ffff640 1 --2- 172.21.15.50:0/2590604957 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd73c06be30 0x7fd73c06e2f0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd74000b7c0 tx=0x7fd740008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.533+0000 7fd74cff9640 1 -- 172.21.15.50:0/2590604957 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd744058b90 con 0x7fd7500d05e0 2024-09-11T22:24:24.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.706+0000 7fd7565cf640 1 -- 172.21.15.50:0/2590604957 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fd7500d0a60 con 0x7fd73c06be30 2024-09-11T22:24:24.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.706+0000 7fd74cff9640 1 -- 172.21.15.50:0/2590604957 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd7500d0a60 con 0x7fd73c06be30 2024-09-11T22:24:24.707 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T22:24:24.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.708+0000 7fd7565cf640 1 -- 172.21.15.50:0/2590604957 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd73c06be30 msgr2=0x7fd73c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.708+0000 7fd7565cf640 1 --2- 172.21.15.50:0/2590604957 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd73c06be30 0x7fd73c06e2f0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd74000b7c0 tx=0x7fd740008040 comp rx=0 tx=0).stop 2024-09-11T22:24:24.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.708+0000 7fd7565cf640 1 -- 172.21.15.50:0/2590604957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7500d05e0 msgr2=0x7fd7500ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.708+0000 7fd7565cf640 1 --2- 172.21.15.50:0/2590604957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7500d05e0 0x7fd7500ae8c0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7fd74400c4d0 tx=0x7fd74400c990 comp rx=0 tx=0).stop 2024-09-11T22:24:24.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.708+0000 7fd7565cf640 1 -- 172.21.15.50:0/2590604957 shutdown_connections 2024-09-11T22:24:24.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.708+0000 7fd7565cf640 1 --2- 172.21.15.50:0/2590604957 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fd73c06be30 0x7fd73c06e2f0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.708+0000 7fd7565cf640 1 --2- 172.21.15.50:0/2590604957 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75015c2c0 0x7fd7500aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.708+0000 7fd7565cf640 1 --2- 172.21.15.50:0/2590604957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7500d05e0 0x7fd7500ae8c0 unknown :-1 s=CLOSED pgs=2392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.708+0000 7fd7565cf640 1 --2- 172.21.15.50:0/2590604957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7500b3e10 0x7fd75006ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.708+0000 7fd7565cf640 1 -- 172.21.15.50:0/2590604957 >> 172.21.15.50:0/2590604957 conn(0x7fd7500679c0 msgr2=0x7fd7500b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:24.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.709+0000 7fd7565cf640 1 -- 172.21.15.50:0/2590604957 shutdown_connections 2024-09-11T22:24:24.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.709+0000 7fd7565cf640 1 -- 172.21.15.50:0/2590604957 wait complete. 2024-09-11T22:24:24.720 INFO:tasks.ceph:Scrubbing osd.4 2024-09-11T22:24:24.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:24:24.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.826+0000 7f9e38186640 1 Processor -- start 2024-09-11T22:24:24.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.826+0000 7f9e38186640 1 -- start start 2024-09-11T22:24:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.827+0000 7f9e38186640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e3015e8e0 0x7f9e300b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.827+0000 7f9e38186640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9e300d1580 0x7f9e300d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.827+0000 7f9e38186640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e300d1ee0 con 0x7f9e30162350 2024-09-11T22:24:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.827+0000 7f9e38186640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9e3015ecc0 con 0x7f9e300d1580 2024-09-11T22:24:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.827+0000 7f9e38186640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9e300d2ad0 con 0x7f9e3015e8e0 2024-09-11T22:24:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.827+0000 7f9e35f22640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e3015e8e0 0x7f9e300b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.827+0000 7f9e35721640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9e300d1580 0x7f9e300d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.827+0000 7f9e35f22640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e3015e8e0 0x7f9e300b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.50:60762/0 (socket says 172.21.15.50:60762) 2024-09-11T22:24:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.827+0000 7f9e35f22640 1 -- 172.21.15.50:0/4071606617 learned_addr learned my addr 172.21.15.50:0/4071606617 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.827+0000 7f9e36723640 1 --1- 172.21.15.50:0/4071606617 >> v1:172.21.15.77:6789/0 conn(0x7f9e30162350 0x7f9e30162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.50:47244/0 (socket says 172.21.15.50:47244) 2024-09-11T22:24:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.828+0000 7f9e35f22640 1 -- 172.21.15.50:0/4071606617 >> v2:172.21.15.77:3300/0 conn(0x7f9e300d1580 msgr2=0x7f9e300d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.828+0000 7f9e35f22640 1 --2- 172.21.15.50:0/4071606617 >> v2:172.21.15.77:3300/0 conn(0x7f9e300d1580 0x7f9e300d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.828+0000 7f9e35f22640 1 -- 172.21.15.50:0/4071606617 >> v1:172.21.15.77:6789/0 conn(0x7f9e30162350 legacy=0x7f9e30162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.828+0000 7f9e35f22640 1 -- 172.21.15.50:0/4071606617 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e30163080 con 0x7f9e3015e8e0 2024-09-11T22:24:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.828+0000 7f9e35721640 1 --2- 172.21.15.50:0/4071606617 >> v2:172.21.15.77:3300/0 conn(0x7f9e300d1580 0x7f9e300d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:24:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.828+0000 7f9e35f22640 1 --2- 172.21.15.50:0/4071606617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e3015e8e0 0x7f9e300b7880 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009870 tx=0x7f9e2c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1702abdf04b924b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.829+0000 7f9e34f20640 1 -- 172.21.15.50:0/4071606617 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c037070 con 0x7f9e3015e8e0 2024-09-11T22:24:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.829+0000 7f9e34f20640 1 -- 172.21.15.50:0/4071606617 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e2c02ae50 con 0x7f9e3015e8e0 2024-09-11T22:24:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.829+0000 7f9e34f20640 1 -- 172.21.15.50:0/4071606617 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c032860 con 0x7f9e3015e8e0 2024-09-11T22:24:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.829+0000 7f9e38186640 1 -- 172.21.15.50:0/4071606617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e3015e8e0 msgr2=0x7f9e300b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.829+0000 7f9e38186640 1 --2- 172.21.15.50:0/4071606617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e3015e8e0 0x7f9e300b7880 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009870 tx=0x7f9e2c02a300 comp rx=0 tx=0).stop 2024-09-11T22:24:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.829+0000 7f9e38186640 1 -- 172.21.15.50:0/4071606617 shutdown_connections 2024-09-11T22:24:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.829+0000 7f9e38186640 1 --2- 172.21.15.50:0/4071606617 >> v2:172.21.15.77:3300/0 conn(0x7f9e300d1580 0x7f9e300d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.829+0000 7f9e38186640 1 --2- 172.21.15.50:0/4071606617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e3015e8e0 0x7f9e300b7880 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.829+0000 7f9e38186640 1 -- 172.21.15.50:0/4071606617 >> 172.21.15.50:0/4071606617 conn(0x7f9e30067ba0 msgr2=0x7f9e30067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.829+0000 7f9e38186640 1 -- 172.21.15.50:0/4071606617 shutdown_connections 2024-09-11T22:24:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.829+0000 7f9e38186640 1 -- 172.21.15.50:0/4071606617 wait complete. 2024-09-11T22:24:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.830+0000 7f9e38186640 1 Processor -- start 2024-09-11T22:24:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.830+0000 7f9e38186640 1 -- start start 2024-09-11T22:24:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.831+0000 7f9e38186640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e300d1580 0x7f9e30161060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.831+0000 7f9e38186640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e3015e8e0 0x7f9e301f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.831+0000 7f9e38186640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e30162350 0x7f9e300b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.831+0000 7f9e38186640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9e300d3000 con 0x7f9e300d1580 2024-09-11T22:24:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.831+0000 7f9e38186640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e300d3370 con 0x7f9e30162350 2024-09-11T22:24:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.831+0000 7f9e38186640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9e300d3800 con 0x7f9e3015e8e0 2024-09-11T22:24:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.831+0000 7f9e35f22640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e300d1580 0x7f9e30161060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.831+0000 7f9e35f22640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e300d1580 0x7f9e30161060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40794/0 (socket says 172.21.15.50:40794) 2024-09-11T22:24:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.831+0000 7f9e35f22640 1 -- 172.21.15.50:0/1336702034 learned_addr learned my addr 172.21.15.50:0/1336702034 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.831+0000 7f9e35721640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e3015e8e0 0x7f9e301f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.832+0000 7f9e36723640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e30162350 0x7f9e300b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.832+0000 7f9e35f22640 1 -- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e3015e8e0 msgr2=0x7f9e301f7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.832+0000 7f9e35f22640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e3015e8e0 0x7f9e301f7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.832+0000 7f9e35f22640 1 -- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e30162350 msgr2=0x7f9e300b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.832+0000 7f9e35f22640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e30162350 0x7f9e300b62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.832+0000 7f9e35f22640 1 -- 172.21.15.50:0/1336702034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e30156d50 con 0x7f9e300d1580 2024-09-11T22:24:24.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.832+0000 7f9e35f22640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e300d1580 0x7f9e30161060 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009870 tx=0x7f9e2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.832+0000 7f9e267fc640 1 -- 172.21.15.50:0/1336702034 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c042070 con 0x7f9e300d1580 2024-09-11T22:24:24.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.832+0000 7f9e267fc640 1 -- 172.21.15.50:0/1336702034 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e2c03e660 con 0x7f9e300d1580 2024-09-11T22:24:24.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.832+0000 7f9e267fc640 1 -- 172.21.15.50:0/1336702034 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c037040 con 0x7f9e300d1580 2024-09-11T22:24:24.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.832+0000 7f9e38186640 1 -- 172.21.15.50:0/1336702034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e30156fd0 con 0x7f9e300d1580 2024-09-11T22:24:24.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.832+0000 7f9e38186640 1 -- 172.21.15.50:0/1336702034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e301f8c20 con 0x7f9e300d1580 2024-09-11T22:24:24.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.833+0000 7f9e38186640 1 -- 172.21.15.50:0/1336702034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e300d19a0 con 0x7f9e300d1580 2024-09-11T22:24:24.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.834+0000 7f9e267fc640 1 -- 172.21.15.50:0/1336702034 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e2c045070 con 0x7f9e300d1580 2024-09-11T22:24:24.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.834+0000 7f9e267fc640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9e1406be60 0x7f9e1406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.834+0000 7f9e267fc640 1 -- 172.21.15.50:0/1336702034 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f9e2c0ab5d0 con 0x7f9e300d1580 2024-09-11T22:24:24.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.834+0000 7f9e267fc640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x7f9e14071d20 0x7f9e14074140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.834+0000 7f9e267fc640 1 -- 172.21.15.50:0/1336702034 --> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e2c02be50 con 0x7f9e14071d20 2024-09-11T22:24:24.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.834+0000 7f9e267fc640 1 -- 172.21.15.50:0/1336702034 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7f9e2c0b2050 con 0x7f9e300d1580 2024-09-11T22:24:24.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.834+0000 7f9e35721640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9e1406be60 0x7f9e1406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.834+0000 7f9e36723640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x7f9e14071d20 0x7f9e14074140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.835+0000 7f9e35721640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9e1406be60 0x7f9e1406e320 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009560 tx=0x7f9e20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.835+0000 7f9e36723640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x7f9e14071d20 0x7f9e14074140 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.836+0000 7f9e267fc640 1 -- 172.21.15.50:0/1336702034 <== osd.4 v2:172.21.15.77:6800/1015337735 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e2c02be50 con 0x7f9e14071d20 2024-09-11T22:24:24.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.848+0000 7f9e38186640 1 -- 172.21.15.50:0/1336702034 --> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9e300ba770 con 0x7f9e14071d20 2024-09-11T22:24:24.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.849+0000 7f9e267fc640 1 -- 172.21.15.50:0/1336702034 <== osd.4 v2:172.21.15.77:6800/1015337735 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9e300ba770 con 0x7f9e14071d20 2024-09-11T22:24:24.849 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:24:24.850 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:24:24.850 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:24:24.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.849+0000 7f9e38186640 1 -- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x7f9e14071d20 msgr2=0x7f9e14074140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.849+0000 7f9e38186640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:6800/1015337735,v1:172.21.15.77:6801/1015337735] conn(0x7f9e14071d20 0x7f9e14074140 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.849+0000 7f9e38186640 1 -- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9e1406be60 msgr2=0x7f9e1406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.849+0000 7f9e38186640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f9e1406be60 0x7f9e1406e320 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009560 tx=0x7f9e20008040 comp rx=0 tx=0).stop 2024-09-11T22:24:24.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.849+0000 7f9e38186640 1 -- 172.21.15.50:0/1336702034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e300d1580 msgr2=0x7f9e30161060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.849+0000 7f9e38186640 1 --2- 172.21.15.50:0/1336702034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e300d1580 0x7f9e30161060 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009870 tx=0x7f9e2c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.849+0000 7f9e36723640 1 -- 172.21.15.50:0/1336702034 reap_dead start 2024-09-11T22:24:24.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.849+0000 7f9e38186640 1 -- 172.21.15.50:0/1336702034 shutdown_connections 2024-09-11T22:24:24.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.849+0000 7f9e38186640 1 -- 172.21.15.50:0/1336702034 >> 172.21.15.50:0/1336702034 conn(0x7f9e30067ba0 msgr2=0x7f9e300b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:24.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.849+0000 7f9e38186640 1 -- 172.21.15.50:0/1336702034 shutdown_connections 2024-09-11T22:24:24.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.849+0000 7f9e38186640 1 -- 172.21.15.50:0/1336702034 wait complete. 2024-09-11T22:24:24.860 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-11T22:24:24.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.962+0000 7f3d468dd640 1 Processor -- start 2024-09-11T22:24:24.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.962+0000 7f3d468dd640 1 -- start start 2024-09-11T22:24:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.963+0000 7f3d468dd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d4015e870 0x7f3d400d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.963+0000 7f3d468dd640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d400cfa80 con 0x7f3d400d16d0 2024-09-11T22:24:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.963+0000 7f3d468dd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d400d40d0 con 0x7f3d400d3c00 2024-09-11T22:24:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.963+0000 7f3d468dd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3d400d1b10 con 0x7f3d4015e870 2024-09-11T22:24:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.963+0000 7f3d37fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3d400d16d0 0x7f3d400d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51874/0 (socket says 172.21.15.50:51874) 2024-09-11T22:24:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.963+0000 7f3d37fff640 1 -- 172.21.15.50:0/12498111 learned_addr learned my addr 172.21.15.50:0/12498111 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3ffff640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d4015e870 0x7f3d400d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587057704 0 0) 0x7f3d28001110 con 0x7f3d400d16d0 2024-09-11T22:24:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d2c003520 con 0x7f3d400d16d0 2024-09-11T22:24:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3234021061 0 0) 0x7f3d400d40d0 con 0x7f3d400d3c00 2024-09-11T22:24:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d28001110 con 0x7f3d400d3c00 2024-09-11T22:24:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 48790160 0 0) 0x7f3d2c003520 con 0x7f3d400d16d0 2024-09-11T22:24:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d4015e870 msgr2=0x7f3d400d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d4015e870 0x7f3d400d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 >> v1:172.21.15.77:6789/0 conn(0x7f3d400d3c00 legacy=0x7f3d400b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d400d43b0 con 0x7f3d400d16d0 2024-09-11T22:24:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f3d28001860 con 0x7f3d400d16d0 2024-09-11T22:24:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3ffff640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d4015e870 0x7f3d400d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:24:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 >> v1:172.21.15.50:6789/0 conn(0x7f3d400d16d0 legacy=0x7f3d400d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c003b70 0x7f3d2c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d2c004800 0x7f3d2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d4015e870 0x7f3d2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3d400d1b10 con 0x7f3d2c003b70 2024-09-11T22:24:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2c00ba70 con 0x7f3d2c004800 2024-09-11T22:24:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2c00bc40 con 0x7f3d4015e870 2024-09-11T22:24:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3ffff640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c003b70 0x7f3d2c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d37fff640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d2c004800 0x7f3d2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d44e7a640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d4015e870 0x7f3d2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3ffff640 1 -- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d4015e870 msgr2=0x7f3d2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3ffff640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d4015e870 0x7f3d2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3ffff640 1 -- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d2c004800 msgr2=0x7f3d2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3ffff640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d2c004800 0x7f3d2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d3ffff640 1 -- 172.21.15.50:0/12498111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2c003520 con 0x7f3d2c003b70 2024-09-11T22:24:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d37fff640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d2c004800 0x7f3d2c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:24:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.964+0000 7f3d44e7a640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d4015e870 0x7f3d2c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:24:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.965+0000 7f3d3ffff640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c003b70 0x7f3d2c003f70 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009c60 tx=0x7f3d2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9be6e3e0382d6d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.965+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30036070 con 0x7f3d2c003b70 2024-09-11T22:24:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.965+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d30031400 con 0x7f3d2c003b70 2024-09-11T22:24:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.965+0000 7f3d3f7fe640 1 -- 172.21.15.50:0/12498111 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30009860 con 0x7f3d2c003b70 2024-09-11T22:24:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.966+0000 7f3d468dd640 1 -- 172.21.15.50:0/12498111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c003b70 msgr2=0x7f3d2c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.966+0000 7f3d468dd640 1 --2- 172.21.15.50:0/12498111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c003b70 0x7f3d2c003f70 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009c60 tx=0x7f3d2c005830 comp rx=0 tx=0).stop 2024-09-11T22:24:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.966+0000 7f3d44e7a640 1 -- 172.21.15.50:0/12498111 reap_dead start 2024-09-11T22:24:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.966+0000 7f3d468dd640 1 -- 172.21.15.50:0/12498111 shutdown_connections 2024-09-11T22:24:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.966+0000 7f3d468dd640 1 -- 172.21.15.50:0/12498111 >> 172.21.15.50:0/12498111 conn(0x7f3d400727a0 msgr2=0x7f3d400679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.966+0000 7f3d468dd640 1 -- 172.21.15.50:0/12498111 shutdown_connections 2024-09-11T22:24:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.966+0000 7f3d468dd640 1 -- 172.21.15.50:0/12498111 wait complete. 2024-09-11T22:24:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.967+0000 7f3d468dd640 1 Processor -- start 2024-09-11T22:24:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.967+0000 7f3d468dd640 1 -- start start 2024-09-11T22:24:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d468dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c003b70 0x7f3d4015b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d468dd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d400abeb0 0x7f3d400accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d468dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d400ad1f0 0x7f3d400ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d468dd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4015ec50 con 0x7f3d2c003b70 2024-09-11T22:24:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d468dd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d400b7ee0 con 0x7f3d400ad1f0 2024-09-11T22:24:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d468dd640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3d400b78b0 con 0x7f3d400abeb0 2024-09-11T22:24:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d3ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c003b70 0x7f3d4015b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d3ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c003b70 0x7f3d4015b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40804/0 (socket says 172.21.15.50:40804) 2024-09-11T22:24:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d3ffff640 1 -- 172.21.15.50:0/3506692779 learned_addr learned my addr 172.21.15.50:0/3506692779 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d44e7a640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d400ad1f0 0x7f3d400ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d37fff640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d400abeb0 0x7f3d400accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d3ffff640 1 -- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d400abeb0 msgr2=0x7f3d400accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d3ffff640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d400abeb0 0x7f3d400accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d3ffff640 1 -- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d400ad1f0 msgr2=0x7f3d400ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d3ffff640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d400ad1f0 0x7f3d400ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d3ffff640 1 -- 172.21.15.50:0/3506692779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d400ad770 con 0x7f3d2c003b70 2024-09-11T22:24:24.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.968+0000 7f3d37fff640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d400abeb0 0x7f3d400accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:24.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.969+0000 7f3d3ffff640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c003b70 0x7f3d4015b610 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f3d30000c00 tx=0x7f3d30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.969+0000 7f3d3d7fa640 1 -- 172.21.15.50:0/3506692779 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30040070 con 0x7f3d2c003b70 2024-09-11T22:24:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.969+0000 7f3d3d7fa640 1 -- 172.21.15.50:0/3506692779 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d300093e0 con 0x7f3d2c003b70 2024-09-11T22:24:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.969+0000 7f3d468dd640 1 -- 172.21.15.50:0/3506692779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d400ab3d0 con 0x7f3d2c003b70 2024-09-11T22:24:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.969+0000 7f3d3d7fa640 1 -- 172.21.15.50:0/3506692779 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30036040 con 0x7f3d2c003b70 2024-09-11T22:24:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.969+0000 7f3d468dd640 1 -- 172.21.15.50:0/3506692779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d401f5950 con 0x7f3d2c003b70 2024-09-11T22:24:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.970+0000 7f3d468dd640 1 -- 172.21.15.50:0/3506692779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d400d1190 con 0x7f3d2c003b70 2024-09-11T22:24:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.970+0000 7f3d3d7fa640 1 -- 172.21.15.50:0/3506692779 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d30043070 con 0x7f3d2c003b70 2024-09-11T22:24:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.971+0000 7f3d3d7fa640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3d2006be60 0x7f3d2006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.971+0000 7f3d3d7fa640 1 -- 172.21.15.50:0/3506692779 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f3d300ab0d0 con 0x7f3d2c003b70 2024-09-11T22:24:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.971+0000 7f3d37fff640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3d2006be60 0x7f3d2006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:24.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.972+0000 7f3d37fff640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3d2006be60 0x7f3d2006e320 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3d28001010 tx=0x7f3d28001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:24.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:24.975+0000 7f3d3d7fa640 1 -- 172.21.15.50:0/3506692779 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d300797c0 con 0x7f3d2c003b70 2024-09-11T22:24:25.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.153+0000 7f3d468dd640 1 -- 172.21.15.50:0/3506692779 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f3d400ba160 con 0x7f3d2006be60 2024-09-11T22:24:25.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.154+0000 7f3d3d7fa640 1 -- 172.21.15.50:0/3506692779 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3d400ba160 con 0x7f3d2006be60 2024-09-11T22:24:25.155 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 4 to deep-scrub 2024-09-11T22:24:25.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.156+0000 7f3d468dd640 1 -- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3d2006be60 msgr2=0x7f3d2006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.156+0000 7f3d468dd640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3d2006be60 0x7f3d2006e320 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3d28001010 tx=0x7f3d28001380 comp rx=0 tx=0).stop 2024-09-11T22:24:25.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.156+0000 7f3d468dd640 1 -- 172.21.15.50:0/3506692779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c003b70 msgr2=0x7f3d4015b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.156+0000 7f3d468dd640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c003b70 0x7f3d4015b610 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f3d30000c00 tx=0x7f3d30004730 comp rx=0 tx=0).stop 2024-09-11T22:24:25.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.156+0000 7f3d468dd640 1 -- 172.21.15.50:0/3506692779 shutdown_connections 2024-09-11T22:24:25.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.156+0000 7f3d468dd640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f3d2006be60 0x7f3d2006e320 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.156+0000 7f3d468dd640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d400abeb0 0x7f3d400accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.156+0000 7f3d468dd640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d400ad1f0 0x7f3d400ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.156+0000 7f3d468dd640 1 --2- 172.21.15.50:0/3506692779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c003b70 0x7f3d4015b610 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.156+0000 7f3d468dd640 1 -- 172.21.15.50:0/3506692779 >> 172.21.15.50:0/3506692779 conn(0x7f3d400727a0 msgr2=0x7f3d40161990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:25.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.157+0000 7f3d468dd640 1 -- 172.21.15.50:0/3506692779 shutdown_connections 2024-09-11T22:24:25.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.157+0000 7f3d468dd640 1 -- 172.21.15.50:0/3506692779 wait complete. 2024-09-11T22:24:25.168 INFO:tasks.ceph:Scrubbing osd.5 2024-09-11T22:24:25.168 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:24:25.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.274+0000 7ff97f035640 1 Processor -- start 2024-09-11T22:24:25.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.274+0000 7ff97f035640 1 -- start start 2024-09-11T22:24:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.275+0000 7ff97f035640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff9780b6730 0x7ff9780b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.275+0000 7ff97f035640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9780b8150 0x7ff9780b8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.275+0000 7ff97f035640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9780b7990 con 0x7ff978161d60 2024-09-11T22:24:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.275+0000 7ff97f035640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff9780b70e0 con 0x7ff9780b6730 2024-09-11T22:24:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.275+0000 7ff97f035640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff9780d4530 con 0x7ff9780b8150 2024-09-11T22:24:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.275+0000 7ff97cdd1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff978161d60 0x7ff9780d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51884/0 (socket says 172.21.15.50:51884) 2024-09-11T22:24:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.275+0000 7ff97cdd1640 1 -- 172.21.15.50:0/1773054018 learned_addr learned my addr 172.21.15.50:0/1773054018 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:25.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.276+0000 7ff97d5d2640 1 --2- 172.21.15.50:0/1773054018 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9780b8150 0x7ff9780b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.276+0000 7ff977fff640 1 --2- 172.21.15.50:0/1773054018 >> v2:172.21.15.77:3300/0 conn(0x7ff9780b6730 0x7ff9780b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.276+0000 7ff9777fe640 1 -- 172.21.15.50:0/1773054018 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2669778337 0 0) 0x7ff9780b7990 con 0x7ff978161d60 2024-09-11T22:24:25.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.276+0000 7ff9777fe640 1 -- 172.21.15.50:0/1773054018 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff964003520 con 0x7ff978161d60 2024-09-11T22:24:25.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.276+0000 7ff97d5d2640 1 -- 172.21.15.50:0/1773054018 >> v2:172.21.15.77:3300/0 conn(0x7ff9780b6730 msgr2=0x7ff9780b6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:25.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.276+0000 7ff97d5d2640 1 --2- 172.21.15.50:0/1773054018 >> v2:172.21.15.77:3300/0 conn(0x7ff9780b6730 0x7ff9780b6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.276+0000 7ff97d5d2640 1 -- 172.21.15.50:0/1773054018 >> v1:172.21.15.50:6789/0 conn(0x7ff978161d60 legacy=0x7ff9780d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.276+0000 7ff97d5d2640 1 -- 172.21.15.50:0/1773054018 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9780d3f70 con 0x7ff9780b8150 2024-09-11T22:24:25.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.277+0000 7ff97d5d2640 1 --2- 172.21.15.50:0/1773054018 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9780b8150 0x7ff9780b8550 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff9700097a0 tx=0x7ff97002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd7e0503e301e26e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.277+0000 7ff9777fe640 1 -- 172.21.15.50:0/1773054018 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970037070 con 0x7ff9780b8150 2024-09-11T22:24:25.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.277+0000 7ff9777fe640 1 -- 172.21.15.50:0/1773054018 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff970032440 con 0x7ff9780b8150 2024-09-11T22:24:25.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.277+0000 7ff9777fe640 1 -- 172.21.15.50:0/1773054018 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970032810 con 0x7ff9780b8150 2024-09-11T22:24:25.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.277+0000 7ff97f035640 1 -- 172.21.15.50:0/1773054018 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9780b8150 msgr2=0x7ff9780b8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.277+0000 7ff97f035640 1 --2- 172.21.15.50:0/1773054018 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9780b8150 0x7ff9780b8550 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff9700097a0 tx=0x7ff97002a180 comp rx=0 tx=0).stop 2024-09-11T22:24:25.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.277+0000 7ff97f035640 1 -- 172.21.15.50:0/1773054018 shutdown_connections 2024-09-11T22:24:25.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.277+0000 7ff97f035640 1 --2- 172.21.15.50:0/1773054018 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9780b8150 0x7ff9780b8550 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.277+0000 7ff97f035640 1 --2- 172.21.15.50:0/1773054018 >> v2:172.21.15.77:3300/0 conn(0x7ff9780b6730 0x7ff9780b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.277+0000 7ff97f035640 1 -- 172.21.15.50:0/1773054018 >> 172.21.15.50:0/1773054018 conn(0x7ff978067db0 msgr2=0x7ff9780681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:25.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.278+0000 7ff97f035640 1 -- 172.21.15.50:0/1773054018 shutdown_connections 2024-09-11T22:24:25.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.278+0000 7ff97f035640 1 -- 172.21.15.50:0/1773054018 wait complete. 2024-09-11T22:24:25.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.279+0000 7ff97f035640 1 Processor -- start 2024-09-11T22:24:25.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.279+0000 7ff97f035640 1 -- start start 2024-09-11T22:24:25.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97f035640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9780b6730 0x7ff9780ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97f035640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9780b8150 0x7ff9780cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97f035640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff978161d60 0x7ff97815d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97f035640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff9780cf930 con 0x7ff978161d60 2024-09-11T22:24:25.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97f035640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9780b7c30 con 0x7ff9780b6730 2024-09-11T22:24:25.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97f035640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff9780d3bc0 con 0x7ff9780b8150 2024-09-11T22:24:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97d5d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff978161d60 0x7ff97815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97d5d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff978161d60 0x7ff97815d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40810/0 (socket says 172.21.15.50:40810) 2024-09-11T22:24:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97d5d2640 1 -- 172.21.15.50:0/1060138033 learned_addr learned my addr 172.21.15.50:0/1060138033 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff977fff640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9780b8150 0x7ff9780cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97cdd1640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9780b6730 0x7ff9780ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97d5d2640 1 -- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9780b8150 msgr2=0x7ff9780cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97d5d2640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9780b8150 0x7ff9780cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97d5d2640 1 -- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9780b6730 msgr2=0x7ff9780ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97d5d2640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9780b6730 0x7ff9780ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97d5d2640 1 -- 172.21.15.50:0/1060138033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9780cacc0 con 0x7ff978161d60 2024-09-11T22:24:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff977fff640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9780b8150 0x7ff9780cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:24:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97d5d2640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff978161d60 0x7ff97815d850 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7ff970035040 tx=0x7ff9700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff9757fa640 1 -- 172.21.15.50:0/1060138033 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970041020 con 0x7ff978161d60 2024-09-11T22:24:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff9757fa640 1 -- 172.21.15.50:0/1060138033 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97003d640 con 0x7ff978161d60 2024-09-11T22:24:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff9757fa640 1 -- 172.21.15.50:0/1060138033 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970037040 con 0x7ff978161d60 2024-09-11T22:24:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97f035640 1 -- 172.21.15.50:0/1060138033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9780ceaf0 con 0x7ff978161d60 2024-09-11T22:24:25.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.280+0000 7ff97f035640 1 -- 172.21.15.50:0/1060138033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9780cf0b0 con 0x7ff978161d60 2024-09-11T22:24:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.281+0000 7ff97f035640 1 -- 172.21.15.50:0/1060138033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9780b6ba0 con 0x7ff978161d60 2024-09-11T22:24:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.282+0000 7ff9757fa640 1 -- 172.21.15.50:0/1060138033 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff970044020 con 0x7ff978161d60 2024-09-11T22:24:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.282+0000 7ff9757fa640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff95806be30 0x7ff95806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.283+0000 7ff9757fa640 1 -- 172.21.15.50:0/1060138033 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7ff9700ab7a0 con 0x7ff978161d60 2024-09-11T22:24:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.283+0000 7ff9757fa640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] conn(0x7ff958071cf0 0x7ff958074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.283+0000 7ff9757fa640 1 -- 172.21.15.50:0/1060138033 --> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff970032440 con 0x7ff958071cf0 2024-09-11T22:24:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.283+0000 7ff9757fa640 1 -- 172.21.15.50:0/1060138033 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7ff9700abc30 con 0x7ff978161d60 2024-09-11T22:24:25.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.283+0000 7ff97cdd1640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff95806be30 0x7ff95806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.283+0000 7ff977fff640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] conn(0x7ff958071cf0 0x7ff958074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.283+0000 7ff977fff640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] conn(0x7ff958071cf0 0x7ff958074110 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.283+0000 7ff97cdd1640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff95806be30 0x7ff95806e2f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff968005c00 tx=0x7ff968009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.284+0000 7ff9757fa640 1 -- 172.21.15.50:0/1060138033 <== osd.5 v2:172.21.15.77:6824/2559965953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff970032440 con 0x7ff958071cf0 2024-09-11T22:24:25.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.296+0000 7ff97f035640 1 -- 172.21.15.50:0/1060138033 --> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff9780ba420 con 0x7ff958071cf0 2024-09-11T22:24:25.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.297+0000 7ff9757fa640 1 -- 172.21.15.50:0/1060138033 <== osd.5 v2:172.21.15.77:6824/2559965953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff9780ba420 con 0x7ff958071cf0 2024-09-11T22:24:25.298 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:24:25.298 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:24:25.298 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:24:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.297+0000 7ff97f035640 1 -- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] conn(0x7ff958071cf0 msgr2=0x7ff958074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.297+0000 7ff97f035640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:6824/2559965953,v1:172.21.15.77:6825/2559965953] conn(0x7ff958071cf0 0x7ff958074110 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.298+0000 7ff97f035640 1 -- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff95806be30 msgr2=0x7ff95806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.298+0000 7ff97f035640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff95806be30 0x7ff95806e2f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff968005c00 tx=0x7ff968009040 comp rx=0 tx=0).stop 2024-09-11T22:24:25.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.298+0000 7ff97f035640 1 -- 172.21.15.50:0/1060138033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff978161d60 msgr2=0x7ff97815d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.298+0000 7ff97f035640 1 --2- 172.21.15.50:0/1060138033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff978161d60 0x7ff97815d850 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7ff970035040 tx=0x7ff9700046c0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.298+0000 7ff97d5d2640 1 -- 172.21.15.50:0/1060138033 reap_dead start 2024-09-11T22:24:25.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.298+0000 7ff97f035640 1 -- 172.21.15.50:0/1060138033 shutdown_connections 2024-09-11T22:24:25.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.298+0000 7ff97f035640 1 -- 172.21.15.50:0/1060138033 >> 172.21.15.50:0/1060138033 conn(0x7ff978067db0 msgr2=0x7ff9780b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:25.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.298+0000 7ff97f035640 1 -- 172.21.15.50:0/1060138033 shutdown_connections 2024-09-11T22:24:25.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.298+0000 7ff97f035640 1 -- 172.21.15.50:0/1060138033 wait complete. 2024-09-11T22:24:25.309 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-11T22:24:25.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.411+0000 7f5b7ceed640 1 Processor -- start 2024-09-11T22:24:25.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.411+0000 7f5b7ceed640 1 -- start start 2024-09-11T22:24:25.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.412+0000 7f5b7ceed640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b780b1600 0x7f5b780b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.412+0000 7f5b7ceed640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b780cfbd0 con 0x7f5b780cf610 2024-09-11T22:24:25.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.412+0000 7f5b7ceed640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b780cfeb0 con 0x7f5b78161fa0 2024-09-11T22:24:25.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.412+0000 7f5b7ceed640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f5b780d1220 con 0x7f5b780b1600 2024-09-11T22:24:25.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.412+0000 7f5b76d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b780b1600 0x7f5b780b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.412+0000 7f5b75d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5b780cf610 0x7f5b780cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51894/0 (socket says 172.21.15.50:51894) 2024-09-11T22:24:25.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.412+0000 7f5b75d9b640 1 -- 172.21.15.50:0/3408347654 learned_addr learned my addr 172.21.15.50:0/3408347654 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:25.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.413+0000 7f5b76d9d640 1 -- 172.21.15.50:0/3408347654 >> v1:172.21.15.77:6789/0 conn(0x7f5b78161fa0 legacy=0x7f5b780cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.413+0000 7f5b76d9d640 1 -- 172.21.15.50:0/3408347654 >> v1:172.21.15.50:6789/0 conn(0x7f5b780cf610 legacy=0x7f5b780cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.413+0000 7f5b76d9d640 1 -- 172.21.15.50:0/3408347654 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b780d1470 con 0x7f5b780b1600 2024-09-11T22:24:25.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.413+0000 7f5b76d9d640 1 --2- 172.21.15.50:0/3408347654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b780b1600 0x7f5b780b4d20 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009d90 tx=0x7f5b7002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990215d2cbc7b07c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.413+0000 7f5b7559a640 1 -- 172.21.15.50:0/3408347654 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b70007740 con 0x7f5b780b1600 2024-09-11T22:24:25.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.413+0000 7f5b7559a640 1 -- 172.21.15.50:0/3408347654 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b700078e0 con 0x7f5b780b1600 2024-09-11T22:24:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.414+0000 7f5b7559a640 1 -- 172.21.15.50:0/3408347654 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b70007cb0 con 0x7f5b780b1600 2024-09-11T22:24:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.414+0000 7f5b7ceed640 1 -- 172.21.15.50:0/3408347654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b780b1600 msgr2=0x7f5b780b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.414+0000 7f5b7ceed640 1 --2- 172.21.15.50:0/3408347654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b780b1600 0x7f5b780b4d20 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009d90 tx=0x7f5b7002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.414+0000 7f5b7ceed640 1 -- 172.21.15.50:0/3408347654 shutdown_connections 2024-09-11T22:24:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.414+0000 7f5b7ceed640 1 --2- 172.21.15.50:0/3408347654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b780b1600 0x7f5b780b4d20 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.414+0000 7f5b7ceed640 1 -- 172.21.15.50:0/3408347654 >> 172.21.15.50:0/3408347654 conn(0x7f5b7809ba50 msgr2=0x7f5b780b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.414+0000 7f5b7ceed640 1 -- 172.21.15.50:0/3408347654 shutdown_connections 2024-09-11T22:24:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.414+0000 7f5b7ceed640 1 -- 172.21.15.50:0/3408347654 wait complete. 2024-09-11T22:24:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.415+0000 7f5b7ceed640 1 Processor -- start 2024-09-11T22:24:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.416+0000 7f5b7ceed640 1 -- start start 2024-09-11T22:24:25.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.416+0000 7f5b7ceed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b780b1600 0x7f5b78153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.416+0000 7f5b7ceed640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b780cf610 0x7f5b781611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.416+0000 7f5b7ceed640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b78161fa0 0x7f5b780cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.416+0000 7f5b7ceed640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5b780d1c70 con 0x7f5b780b1600 2024-09-11T22:24:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.416+0000 7f5b7ceed640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b780d17e0 con 0x7f5b780cf610 2024-09-11T22:24:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.416+0000 7f5b7ceed640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5b780d1df0 con 0x7f5b78161fa0 2024-09-11T22:24:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.416+0000 7f5b7659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b780b1600 0x7f5b78153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.416+0000 7f5b7659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b780b1600 0x7f5b78153530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40816/0 (socket says 172.21.15.50:40816) 2024-09-11T22:24:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.416+0000 7f5b7659c640 1 -- 172.21.15.50:0/2118577810 learned_addr learned my addr 172.21.15.50:0/2118577810 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.417+0000 7f5b76d9d640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b78161fa0 0x7f5b780cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.417+0000 7f5b75d9b640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b780cf610 0x7f5b781611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.417+0000 7f5b7659c640 1 -- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b78161fa0 msgr2=0x7f5b780cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.417+0000 7f5b7659c640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b78161fa0 0x7f5b780cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.417+0000 7f5b7659c640 1 -- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b780cf610 msgr2=0x7f5b781611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.417+0000 7f5b7659c640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b780cf610 0x7f5b781611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.417+0000 7f5b7659c640 1 -- 172.21.15.50:0/2118577810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b780ca620 con 0x7f5b780b1600 2024-09-11T22:24:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.417+0000 7f5b7659c640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b780b1600 0x7f5b78153530 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c400 tx=0x7f5b6800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.417+0000 7f5b66ffd640 1 -- 172.21.15.50:0/2118577810 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b680052d0 con 0x7f5b780b1600 2024-09-11T22:24:25.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.417+0000 7f5b66ffd640 1 -- 172.21.15.50:0/2118577810 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b68005490 con 0x7f5b780b1600 2024-09-11T22:24:25.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.417+0000 7f5b7ceed640 1 -- 172.21.15.50:0/2118577810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b780ca900 con 0x7f5b780b1600 2024-09-11T22:24:25.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.417+0000 7f5b66ffd640 1 -- 172.21.15.50:0/2118577810 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68007260 con 0x7f5b780b1600 2024-09-11T22:24:25.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.417+0000 7f5b7ceed640 1 -- 172.21.15.50:0/2118577810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b780c7770 con 0x7f5b780b1600 2024-09-11T22:24:25.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.418+0000 7f5b7ceed640 1 -- 172.21.15.50:0/2118577810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b780c7970 con 0x7f5b780b1600 2024-09-11T22:24:25.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.419+0000 7f5b66ffd640 1 -- 172.21.15.50:0/2118577810 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b68007400 con 0x7f5b780b1600 2024-09-11T22:24:25.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.419+0000 7f5b66ffd640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b5806be30 0x7f5b5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.419+0000 7f5b66ffd640 1 -- 172.21.15.50:0/2118577810 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f5b68089fe0 con 0x7f5b780b1600 2024-09-11T22:24:25.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.420+0000 7f5b75d9b640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b5806be30 0x7f5b5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.420+0000 7f5b75d9b640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b5806be30 0x7f5b5806e2f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f5b7806c5b0 tx=0x7f5b6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.423+0000 7f5b66ffd640 1 -- 172.21.15.50:0/2118577810 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b780c7970 con 0x7f5b780b1600 2024-09-11T22:24:25.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.599+0000 7f5b7ceed640 1 -- 172.21.15.50:0/2118577810 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f5b780b4d20 con 0x7f5b5806be30 2024-09-11T22:24:25.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.599+0000 7f5b66ffd640 1 -- 172.21.15.50:0/2118577810 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5b780b4d20 con 0x7f5b5806be30 2024-09-11T22:24:25.600 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 5 to deep-scrub 2024-09-11T22:24:25.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.601+0000 7f5b7ceed640 1 -- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b5806be30 msgr2=0x7f5b5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.601+0000 7f5b7ceed640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b5806be30 0x7f5b5806e2f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f5b7806c5b0 tx=0x7f5b6c009040 comp rx=0 tx=0).stop 2024-09-11T22:24:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.601+0000 7f5b7ceed640 1 -- 172.21.15.50:0/2118577810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b780b1600 msgr2=0x7f5b78153530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.601+0000 7f5b7ceed640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b780b1600 0x7f5b78153530 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c400 tx=0x7f5b6800c8c0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.601+0000 7f5b7ceed640 1 -- 172.21.15.50:0/2118577810 shutdown_connections 2024-09-11T22:24:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.601+0000 7f5b7ceed640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f5b5806be30 0x7f5b5806e2f0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.601+0000 7f5b7ceed640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b78161fa0 0x7f5b780cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.601+0000 7f5b7ceed640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b780cf610 0x7f5b781611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.601+0000 7f5b7ceed640 1 --2- 172.21.15.50:0/2118577810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b780b1600 0x7f5b78153530 unknown :-1 s=CLOSED pgs=2401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.601+0000 7f5b7ceed640 1 -- 172.21.15.50:0/2118577810 >> 172.21.15.50:0/2118577810 conn(0x7f5b7809ba50 msgr2=0x7f5b780af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:25.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.601+0000 7f5b7ceed640 1 -- 172.21.15.50:0/2118577810 shutdown_connections 2024-09-11T22:24:25.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.602+0000 7f5b7ceed640 1 -- 172.21.15.50:0/2118577810 wait complete. 2024-09-11T22:24:25.613 INFO:tasks.ceph:Scrubbing osd.6 2024-09-11T22:24:25.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:24:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.719+0000 7f92db933640 1 Processor -- start 2024-09-11T22:24:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.720+0000 7f92db933640 1 -- start start 2024-09-11T22:24:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.720+0000 7f92db933640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92d415eae0 0x7f92d40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.720+0000 7f92db933640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d40affd0 con 0x7f92d40b1070 2024-09-11T22:24:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.720+0000 7f92db933640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d40b02b0 con 0x7f92d406cbe0 2024-09-11T22:24:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.720+0000 7f92db933640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f92d40b1490 con 0x7f92d415eae0 2024-09-11T22:24:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.720+0000 7f92d96cf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f92d415eae0 0x7f92d40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.721+0000 7f92d8ece640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f92d40b1070 0x7f92d406c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51896/0 (socket says 172.21.15.50:51896) 2024-09-11T22:24:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.721+0000 7f92d8ece640 1 -- 172.21.15.50:0/653423202 learned_addr learned my addr 172.21.15.50:0/653423202 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.721+0000 7f92d96cf640 1 -- 172.21.15.50:0/653423202 >> v1:172.21.15.77:6789/0 conn(0x7f92d406cbe0 legacy=0x7f92d40c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.721+0000 7f92d96cf640 1 -- 172.21.15.50:0/653423202 >> v1:172.21.15.50:6789/0 conn(0x7f92d40b1070 legacy=0x7f92d406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.721+0000 7f92d96cf640 1 -- 172.21.15.50:0/653423202 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d40b0590 con 0x7f92d415eae0 2024-09-11T22:24:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.722+0000 7f92d96cf640 1 --2- 172.21.15.50:0/653423202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d415eae0 0x7f92d40b4d40 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009d90 tx=0x7f92cc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691dcea5a35e2068 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.722+0000 7f92d3fff640 1 -- 172.21.15.50:0/653423202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc007740 con 0x7f92d415eae0 2024-09-11T22:24:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.722+0000 7f92d3fff640 1 -- 172.21.15.50:0/653423202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92cc0078e0 con 0x7f92d415eae0 2024-09-11T22:24:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.722+0000 7f92d3fff640 1 -- 172.21.15.50:0/653423202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc007cb0 con 0x7f92d415eae0 2024-09-11T22:24:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.722+0000 7f92db933640 1 -- 172.21.15.50:0/653423202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d415eae0 msgr2=0x7f92d40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.722+0000 7f92db933640 1 --2- 172.21.15.50:0/653423202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d415eae0 0x7f92d40b4d40 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009d90 tx=0x7f92cc02a6a0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.722+0000 7f92db933640 1 -- 172.21.15.50:0/653423202 shutdown_connections 2024-09-11T22:24:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.722+0000 7f92db933640 1 --2- 172.21.15.50:0/653423202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d415eae0 0x7f92d40b4d40 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.722+0000 7f92db933640 1 -- 172.21.15.50:0/653423202 >> 172.21.15.50:0/653423202 conn(0x7f92d40b41b0 msgr2=0x7f92d40b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.722+0000 7f92db933640 1 -- 172.21.15.50:0/653423202 shutdown_connections 2024-09-11T22:24:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.722+0000 7f92db933640 1 -- 172.21.15.50:0/653423202 wait complete. 2024-09-11T22:24:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.724+0000 7f92db933640 1 Processor -- start 2024-09-11T22:24:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.724+0000 7f92db933640 1 -- start start 2024-09-11T22:24:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.724+0000 7f92db933640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d406cbe0 0x7f92d4155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.724+0000 7f92db933640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d40b1070 0x7f92d40b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.724+0000 7f92db933640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92d415eae0 0x7f92d40b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.724+0000 7f92db933640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f92d40d0150 con 0x7f92d406cbe0 2024-09-11T22:24:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.724+0000 7f92db933640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f92d40b0b50 con 0x7f92d415eae0 2024-09-11T22:24:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.724+0000 7f92db933640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f92d40d02d0 con 0x7f92d40b1070 2024-09-11T22:24:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.724+0000 7f92d96cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d406cbe0 0x7f92d4155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.724+0000 7f92d96cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d406cbe0 0x7f92d4155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40836/0 (socket says 172.21.15.50:40836) 2024-09-11T22:24:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.724+0000 7f92d96cf640 1 -- 172.21.15.50:0/545570577 learned_addr learned my addr 172.21.15.50:0/545570577 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.725+0000 7f92d8ece640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d40b1070 0x7f92d40b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.725+0000 7f92d9ed0640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92d415eae0 0x7f92d40b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.725+0000 7f92d96cf640 1 -- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d40b1070 msgr2=0x7f92d40b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.725+0000 7f92d96cf640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92d40b1070 0x7f92d40b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.725+0000 7f92d96cf640 1 -- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92d415eae0 msgr2=0x7f92d40b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.725+0000 7f92d96cf640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92d415eae0 0x7f92d40b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.725+0000 7f92d96cf640 1 -- 172.21.15.50:0/545570577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d41f7ca0 con 0x7f92d406cbe0 2024-09-11T22:24:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.725+0000 7f92d96cf640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d406cbe0 0x7f92d4155620 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009eb0 tx=0x7f92cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.725+0000 7f92d1ffb640 1 -- 172.21.15.50:0/545570577 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc03f070 con 0x7f92d406cbe0 2024-09-11T22:24:25.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.725+0000 7f92d1ffb640 1 -- 172.21.15.50:0/545570577 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92cc031d00 con 0x7f92d406cbe0 2024-09-11T22:24:25.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.725+0000 7f92d1ffb640 1 -- 172.21.15.50:0/545570577 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc044660 con 0x7f92d406cbe0 2024-09-11T22:24:25.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.725+0000 7f92db933640 1 -- 172.21.15.50:0/545570577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d41f7f80 con 0x7f92d406cbe0 2024-09-11T22:24:25.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.725+0000 7f92db933640 1 -- 172.21.15.50:0/545570577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d41f8540 con 0x7f92d406cbe0 2024-09-11T22:24:25.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.726+0000 7f92db933640 1 -- 172.21.15.50:0/545570577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92d40b4d40 con 0x7f92d406cbe0 2024-09-11T22:24:25.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.727+0000 7f92d1ffb640 1 -- 172.21.15.50:0/545570577 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92cc03b410 con 0x7f92d406cbe0 2024-09-11T22:24:25.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.727+0000 7f92d1ffb640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92c006be30 0x7f92c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.727+0000 7f92d1ffb640 1 -- 172.21.15.50:0/545570577 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f92cc0ac3d0 con 0x7f92d406cbe0 2024-09-11T22:24:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.728+0000 7f92d1ffb640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x7f92c0071cf0 0x7f92c0074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.728+0000 7f92d1ffb640 1 -- 172.21.15.50:0/545570577 --> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92c00747c0 con 0x7f92c0071cf0 2024-09-11T22:24:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.728+0000 7f92d1ffb640 1 -- 172.21.15.50:0/545570577 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7f92cc0b3050 con 0x7f92d406cbe0 2024-09-11T22:24:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.728+0000 7f92d8ece640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92c006be30 0x7f92c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.728+0000 7f92d9ed0640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x7f92c0071cf0 0x7f92c0074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.728+0000 7f92d8ece640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92c006be30 0x7f92c006e2f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f92d415e460 tx=0x7f92c8007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.728+0000 7f92d9ed0640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x7f92c0071cf0 0x7f92c0074110 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.729+0000 7f92d1ffb640 1 -- 172.21.15.50:0/545570577 <== osd.6 v2:172.21.15.77:6808/2920422022 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f92c00747c0 con 0x7f92c0071cf0 2024-09-11T22:24:25.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.741+0000 7f92db933640 1 -- 172.21.15.50:0/545570577 --> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f92d40d1d50 con 0x7f92c0071cf0 2024-09-11T22:24:25.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.742+0000 7f92d1ffb640 1 -- 172.21.15.50:0/545570577 <== osd.6 v2:172.21.15.77:6808/2920422022 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f92d40d1d50 con 0x7f92c0071cf0 2024-09-11T22:24:25.743 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:24:25.743 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:24:25.743 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:24:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.742+0000 7f92db933640 1 -- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x7f92c0071cf0 msgr2=0x7f92c0074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.742+0000 7f92db933640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:6808/2920422022,v1:172.21.15.77:6809/2920422022] conn(0x7f92c0071cf0 0x7f92c0074110 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.742+0000 7f92db933640 1 -- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92c006be30 msgr2=0x7f92c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.742+0000 7f92db933640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f92c006be30 0x7f92c006e2f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f92d415e460 tx=0x7f92c8007e80 comp rx=0 tx=0).stop 2024-09-11T22:24:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.742+0000 7f92db933640 1 -- 172.21.15.50:0/545570577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d406cbe0 msgr2=0x7f92d4155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.742+0000 7f92db933640 1 --2- 172.21.15.50:0/545570577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92d406cbe0 0x7f92d4155620 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009eb0 tx=0x7f92cc004a40 comp rx=0 tx=0).stop 2024-09-11T22:24:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.742+0000 7f92d9ed0640 1 -- 172.21.15.50:0/545570577 reap_dead start 2024-09-11T22:24:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.742+0000 7f92db933640 1 -- 172.21.15.50:0/545570577 shutdown_connections 2024-09-11T22:24:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.742+0000 7f92db933640 1 -- 172.21.15.50:0/545570577 >> 172.21.15.50:0/545570577 conn(0x7f92d40b41b0 msgr2=0x7f92d406f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.742+0000 7f92db933640 1 -- 172.21.15.50:0/545570577 shutdown_connections 2024-09-11T22:24:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.742+0000 7f92db933640 1 -- 172.21.15.50:0/545570577 wait complete. 2024-09-11T22:24:25.753 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-11T22:24:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.856+0000 7fcb489c4640 1 Processor -- start 2024-09-11T22:24:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.856+0000 7fcb489c4640 1 -- start start 2024-09-11T22:24:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.856+0000 7fcb489c4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcb4415b400 0x7fcb4406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb489c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb44072e60 0x7fcb4406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb489c4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb4406df20 0x7fcb440b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb489c4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7fcb4415b7e0 con 0x7fcb4406df20 2024-09-11T22:24:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb489c4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcb4415f140 con 0x7fcb4415b400 2024-09-11T22:24:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb489c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4415f420 con 0x7fcb44072e60 2024-09-11T22:24:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb42d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb4406df20 0x7fcb440b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb42d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb4406df20 0x7fcb440b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40840/0 (socket says 172.21.15.50:40840) 2024-09-11T22:24:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb42d9d640 1 -- 172.21.15.50:0/773873883 learned_addr learned my addr 172.21.15.50:0/773873883 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb39d9b640 1 --2- 172.21.15.50:0/773873883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb44072e60 0x7fcb4406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb4259c640 1 --2- 172.21.15.50:0/773873883 >> v2:172.21.15.77:3300/0 conn(0x7fcb4415b400 0x7fcb4406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb42d9d640 1 -- 172.21.15.50:0/773873883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb44072e60 msgr2=0x7fcb4406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb42d9d640 1 --2- 172.21.15.50:0/773873883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb44072e60 0x7fcb4406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb42d9d640 1 -- 172.21.15.50:0/773873883 >> v2:172.21.15.77:3300/0 conn(0x7fcb4415b400 msgr2=0x7fcb4406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb42d9d640 1 --2- 172.21.15.50:0/773873883 >> v2:172.21.15.77:3300/0 conn(0x7fcb4415b400 0x7fcb4406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.857+0000 7fcb42d9d640 1 -- 172.21.15.50:0/773873883 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4415f700 con 0x7fcb4406df20 2024-09-11T22:24:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.858+0000 7fcb42d9d640 1 --2- 172.21.15.50:0/773873883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb4406df20 0x7fcb440b4610 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7fcb440b56e0 tx=0x7fcb3c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf3daa0bd60b596 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.858+0000 7fcb41d9b640 1 -- 172.21.15.50:0/773873883 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c036070 con 0x7fcb4406df20 2024-09-11T22:24:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.858+0000 7fcb41d9b640 1 -- 172.21.15.50:0/773873883 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c031600 con 0x7fcb4406df20 2024-09-11T22:24:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.858+0000 7fcb41d9b640 1 -- 172.21.15.50:0/773873883 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0319d0 con 0x7fcb4406df20 2024-09-11T22:24:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.858+0000 7fcb489c4640 1 -- 172.21.15.50:0/773873883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb4406df20 msgr2=0x7fcb440b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.858+0000 7fcb489c4640 1 --2- 172.21.15.50:0/773873883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb4406df20 0x7fcb440b4610 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7fcb440b56e0 tx=0x7fcb3c02a6a0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.859+0000 7fcb489c4640 1 -- 172.21.15.50:0/773873883 shutdown_connections 2024-09-11T22:24:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.859+0000 7fcb489c4640 1 --2- 172.21.15.50:0/773873883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb4406df20 0x7fcb440b4610 unknown :-1 s=CLOSED pgs=2405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.859+0000 7fcb489c4640 1 --2- 172.21.15.50:0/773873883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb44072e60 0x7fcb4406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.859+0000 7fcb489c4640 1 --2- 172.21.15.50:0/773873883 >> v2:172.21.15.77:3300/0 conn(0x7fcb4415b400 0x7fcb4406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.859+0000 7fcb489c4640 1 -- 172.21.15.50:0/773873883 >> 172.21.15.50:0/773873883 conn(0x7fcb440679c0 msgr2=0x7fcb44067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.859+0000 7fcb489c4640 1 -- 172.21.15.50:0/773873883 shutdown_connections 2024-09-11T22:24:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.859+0000 7fcb489c4640 1 -- 172.21.15.50:0/773873883 wait complete. 2024-09-11T22:24:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.860+0000 7fcb489c4640 1 Processor -- start 2024-09-11T22:24:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.860+0000 7fcb489c4640 1 -- start start 2024-09-11T22:24:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb489c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4406df20 0x7fcb4414f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb489c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb44072e60 0x7fcb44158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb489c4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb4415b400 0x7fcb44159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb489c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb440b4b50 con 0x7fcb44072e60 2024-09-11T22:24:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb489c4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb440cfc50 con 0x7fcb4406df20 2024-09-11T22:24:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb489c4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcb440b4cd0 con 0x7fcb4415b400 2024-09-11T22:24:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb39d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb44072e60 0x7fcb44158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb39d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb44072e60 0x7fcb44158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40846/0 (socket says 172.21.15.50:40846) 2024-09-11T22:24:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb39d9b640 1 -- 172.21.15.50:0/3338767660 learned_addr learned my addr 172.21.15.50:0/3338767660 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb4259c640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4406df20 0x7fcb4414f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb42d9d640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb4415b400 0x7fcb44159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb39d9b640 1 -- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb4415b400 msgr2=0x7fcb44159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb39d9b640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb4415b400 0x7fcb44159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb39d9b640 1 -- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4406df20 msgr2=0x7fcb4414f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb39d9b640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4406df20 0x7fcb4414f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.861+0000 7fcb39d9b640 1 -- 172.21.15.50:0/3338767660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb441528d0 con 0x7fcb44072e60 2024-09-11T22:24:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.862+0000 7fcb39d9b640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb44072e60 0x7fcb44158b40 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00e890 tx=0x7fcb2c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.862+0000 7fcb3b7fe640 1 -- 172.21.15.50:0/3338767660 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c017070 con 0x7fcb44072e60 2024-09-11T22:24:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.862+0000 7fcb3b7fe640 1 -- 172.21.15.50:0/3338767660 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb2c00c940 con 0x7fcb44072e60 2024-09-11T22:24:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.862+0000 7fcb489c4640 1 -- 172.21.15.50:0/3338767660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb441581d0 con 0x7fcb44072e60 2024-09-11T22:24:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.862+0000 7fcb3b7fe640 1 -- 172.21.15.50:0/3338767660 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c00cd10 con 0x7fcb44072e60 2024-09-11T22:24:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.862+0000 7fcb489c4640 1 -- 172.21.15.50:0/3338767660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb44158790 con 0x7fcb44072e60 2024-09-11T22:24:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.863+0000 7fcb489c4640 1 -- 172.21.15.50:0/3338767660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb440b5100 con 0x7fcb44072e60 2024-09-11T22:24:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.863+0000 7fcb3b7fe640 1 -- 172.21.15.50:0/3338767660 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb2c01a070 con 0x7fcb44072e60 2024-09-11T22:24:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.864+0000 7fcb3b7fe640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb2406be30 0x7fcb2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.864+0000 7fcb3b7fe640 1 -- 172.21.15.50:0/3338767660 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fcb2c08ad20 con 0x7fcb44072e60 2024-09-11T22:24:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.864+0000 7fcb4259c640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb2406be30 0x7fcb2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.865+0000 7fcb4259c640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb2406be30 0x7fcb2406e2f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fcb4415eee0 tx=0x7fcb34009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:25.868+0000 7fcb3b7fe640 1 -- 172.21.15.50:0/3338767660 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb2c059410 con 0x7fcb44072e60 2024-09-11T22:24:26.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.042+0000 7fcb489c4640 1 -- 172.21.15.50:0/3338767660 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fcb440b3c40 con 0x7fcb2406be30 2024-09-11T22:24:26.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.043+0000 7fcb3b7fe640 1 -- 172.21.15.50:0/3338767660 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcb440b3c40 con 0x7fcb2406be30 2024-09-11T22:24:26.043 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 6 to deep-scrub 2024-09-11T22:24:26.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.045+0000 7fcb489c4640 1 -- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb2406be30 msgr2=0x7fcb2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.045+0000 7fcb489c4640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb2406be30 0x7fcb2406e2f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fcb4415eee0 tx=0x7fcb34009190 comp rx=0 tx=0).stop 2024-09-11T22:24:26.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.045+0000 7fcb489c4640 1 -- 172.21.15.50:0/3338767660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb44072e60 msgr2=0x7fcb44158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.045+0000 7fcb489c4640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb44072e60 0x7fcb44158b40 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00e890 tx=0x7fcb2c00ed50 comp rx=0 tx=0).stop 2024-09-11T22:24:26.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.045+0000 7fcb489c4640 1 -- 172.21.15.50:0/3338767660 shutdown_connections 2024-09-11T22:24:26.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.045+0000 7fcb489c4640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7fcb2406be30 0x7fcb2406e2f0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.045+0000 7fcb489c4640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb4415b400 0x7fcb44159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.045+0000 7fcb489c4640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb44072e60 0x7fcb44158b40 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.045+0000 7fcb489c4640 1 --2- 172.21.15.50:0/3338767660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4406df20 0x7fcb4414f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.045+0000 7fcb489c4640 1 -- 172.21.15.50:0/3338767660 >> 172.21.15.50:0/3338767660 conn(0x7fcb440679c0 msgr2=0x7fcb44156bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:26.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.045+0000 7fcb489c4640 1 -- 172.21.15.50:0/3338767660 shutdown_connections 2024-09-11T22:24:26.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.045+0000 7fcb489c4640 1 -- 172.21.15.50:0/3338767660 wait complete. 2024-09-11T22:24:26.057 INFO:tasks.ceph:Scrubbing osd.7 2024-09-11T22:24:26.057 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:24:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.162+0000 7f0b16511640 1 Processor -- start 2024-09-11T22:24:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.162+0000 7f0b16511640 1 -- start start 2024-09-11T22:24:26.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b16511640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b100cfc40 0x7f0b100d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b16511640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b1006e940 0x7f0b1006edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b16511640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b1006d8a0 con 0x7f0b1015c540 2024-09-11T22:24:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b16511640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f0b1006e4b0 con 0x7f0b1006e940 2024-09-11T22:24:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b16511640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1006db80 con 0x7f0b100cfc40 2024-09-11T22:24:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b14aae640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b1006e940 0x7f0b1006edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b14aae640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b1006e940 0x7f0b1006edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40860/0 (socket says 172.21.15.50:40860) 2024-09-11T22:24:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b0ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0b1015c540 0x7f0b100cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51900/0 (socket says 172.21.15.50:51900) 2024-09-11T22:24:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b14aae640 1 -- 172.21.15.50:0/1102404188 learned_addr learned my addr 172.21.15.50:0/1102404188 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b0f7fe640 1 --2- 172.21.15.50:0/1102404188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b100cfc40 0x7f0b100d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b14aae640 1 -- 172.21.15.50:0/1102404188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b100cfc40 msgr2=0x7f0b100d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b14aae640 1 --2- 172.21.15.50:0/1102404188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b100cfc40 0x7f0b100d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b14aae640 1 -- 172.21.15.50:0/1102404188 >> v1:172.21.15.50:6789/0 conn(0x7f0b1015c540 legacy=0x7f0b100cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.163+0000 7f0b14aae640 1 -- 172.21.15.50:0/1102404188 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1006de60 con 0x7f0b1006e940 2024-09-11T22:24:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.164+0000 7f0b14aae640 1 --2- 172.21.15.50:0/1102404188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b1006e940 0x7f0b1006edf0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009e50 tx=0x7f0b0802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5a79243c26cefe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.164+0000 7f0b0effd640 1 -- 172.21.15.50:0/1102404188 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b08036070 con 0x7f0b1006e940 2024-09-11T22:24:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.164+0000 7f0b0effd640 1 -- 172.21.15.50:0/1102404188 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b08031600 con 0x7f0b1006e940 2024-09-11T22:24:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.164+0000 7f0b0effd640 1 -- 172.21.15.50:0/1102404188 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b080319d0 con 0x7f0b1006e940 2024-09-11T22:24:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.165+0000 7f0b16511640 1 -- 172.21.15.50:0/1102404188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b1006e940 msgr2=0x7f0b1006edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.165+0000 7f0b16511640 1 --2- 172.21.15.50:0/1102404188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b1006e940 0x7f0b1006edf0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009e50 tx=0x7f0b0802a710 comp rx=0 tx=0).stop 2024-09-11T22:24:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.165+0000 7f0b16511640 1 -- 172.21.15.50:0/1102404188 shutdown_connections 2024-09-11T22:24:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.165+0000 7f0b16511640 1 --2- 172.21.15.50:0/1102404188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b1006e940 0x7f0b1006edf0 unknown :-1 s=CLOSED pgs=2408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.165+0000 7f0b16511640 1 --2- 172.21.15.50:0/1102404188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b100cfc40 0x7f0b100d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.165+0000 7f0b16511640 1 -- 172.21.15.50:0/1102404188 >> 172.21.15.50:0/1102404188 conn(0x7f0b100b07e0 msgr2=0x7f0b100b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.165+0000 7f0b16511640 1 -- 172.21.15.50:0/1102404188 shutdown_connections 2024-09-11T22:24:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.165+0000 7f0b16511640 1 -- 172.21.15.50:0/1102404188 wait complete. 2024-09-11T22:24:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.166+0000 7f0b16511640 1 Processor -- start 2024-09-11T22:24:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.166+0000 7f0b16511640 1 -- start start 2024-09-11T22:24:26.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b16511640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b1006e940 0x7f0b101564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b16511640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b100cfc40 0x7f0b10156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b16511640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1015c540 0x7f0b10150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b16511640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1006d570 con 0x7f0b1006e940 2024-09-11T22:24:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b16511640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1015c920 con 0x7f0b1015c540 2024-09-11T22:24:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b16511640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0b100d05c0 con 0x7f0b100cfc40 2024-09-11T22:24:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b1006e940 0x7f0b101564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b0ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b1006e940 0x7f0b101564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40864/0 (socket says 172.21.15.50:40864) 2024-09-11T22:24:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b0ffff640 1 -- 172.21.15.50:0/4095871211 learned_addr learned my addr 172.21.15.50:0/4095871211 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b0f7fe640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b100cfc40 0x7f0b10156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b14aae640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1015c540 0x7f0b10150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b0ffff640 1 -- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b100cfc40 msgr2=0x7f0b10156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b0ffff640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b100cfc40 0x7f0b10156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b0ffff640 1 -- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1015c540 msgr2=0x7f0b10150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b0ffff640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1015c540 0x7f0b10150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.167+0000 7f0b0ffff640 1 -- 172.21.15.50:0/4095871211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b10151b50 con 0x7f0b1006e940 2024-09-11T22:24:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.168+0000 7f0b0ffff640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b1006e940 0x7f0b101564e0 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000c3c0 tx=0x7f0b0000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.168+0000 7f0b0cff9640 1 -- 172.21.15.50:0/4095871211 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b000074e0 con 0x7f0b1006e940 2024-09-11T22:24:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.168+0000 7f0b0cff9640 1 -- 172.21.15.50:0/4095871211 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b00007680 con 0x7f0b1006e940 2024-09-11T22:24:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.168+0000 7f0b16511640 1 -- 172.21.15.50:0/4095871211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b10151e30 con 0x7f0b1006e940 2024-09-11T22:24:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.168+0000 7f0b0cff9640 1 -- 172.21.15.50:0/4095871211 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b00004a00 con 0x7f0b1006e940 2024-09-11T22:24:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.168+0000 7f0b16511640 1 -- 172.21.15.50:0/4095871211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b101523f0 con 0x7f0b1006e940 2024-09-11T22:24:26.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.169+0000 7f0b16511640 1 -- 172.21.15.50:0/4095871211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b100d0080 con 0x7f0b1006e940 2024-09-11T22:24:26.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.169+0000 7f0b0cff9640 1 -- 172.21.15.50:0/4095871211 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b0001a020 con 0x7f0b1006e940 2024-09-11T22:24:26.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.170+0000 7f0b0cff9640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0afc06be30 0x7f0afc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.170+0000 7f0b0cff9640 1 -- 172.21.15.50:0/4095871211 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f0b0008a250 con 0x7f0b1006e940 2024-09-11T22:24:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.170+0000 7f0b0cff9640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] conn(0x7f0afc071cf0 0x7f0afc074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.170+0000 7f0b0cff9640 1 -- 172.21.15.50:0/4095871211 --> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0afc0747c0 con 0x7f0afc071cf0 2024-09-11T22:24:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.170+0000 7f0b0f7fe640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0afc06be30 0x7f0afc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.170+0000 7f0b0cff9640 1 -- 172.21.15.50:0/4095871211 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7f0b00091050 con 0x7f0b1006e940 2024-09-11T22:24:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.170+0000 7f0b14aae640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] conn(0x7f0afc071cf0 0x7f0afc074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.170+0000 7f0b0f7fe640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0afc06be30 0x7f0afc06e2f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f0b101571e0 tx=0x7f0b04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.171+0000 7f0b14aae640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] conn(0x7f0afc071cf0 0x7f0afc074110 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:26.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.171+0000 7f0b0cff9640 1 -- 172.21.15.50:0/4095871211 <== osd.7 v2:172.21.15.77:6816/3980920894 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0afc0747c0 con 0x7f0afc071cf0 2024-09-11T22:24:26.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.184+0000 7f0b16511640 1 -- 172.21.15.50:0/4095871211 --> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0b1015e2a0 con 0x7f0afc071cf0 2024-09-11T22:24:26.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.185+0000 7f0b0cff9640 1 -- 172.21.15.50:0/4095871211 <== osd.7 v2:172.21.15.77:6816/3980920894 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0b1015e2a0 con 0x7f0afc071cf0 2024-09-11T22:24:26.185 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-11T22:24:26.186 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:24:26.186 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-11T22:24:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.185+0000 7f0b16511640 1 -- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] conn(0x7f0afc071cf0 msgr2=0x7f0afc074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.185+0000 7f0b16511640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:6816/3980920894,v1:172.21.15.77:6817/3980920894] conn(0x7f0afc071cf0 0x7f0afc074110 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.185+0000 7f0b16511640 1 -- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0afc06be30 msgr2=0x7f0afc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.185+0000 7f0b16511640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f0afc06be30 0x7f0afc06e2f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f0b101571e0 tx=0x7f0b04008040 comp rx=0 tx=0).stop 2024-09-11T22:24:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.185+0000 7f0b16511640 1 -- 172.21.15.50:0/4095871211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b1006e940 msgr2=0x7f0b101564e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.185+0000 7f0b16511640 1 --2- 172.21.15.50:0/4095871211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b1006e940 0x7f0b101564e0 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000c3c0 tx=0x7f0b0000c880 comp rx=0 tx=0).stop 2024-09-11T22:24:26.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.185+0000 7f0b14aae640 1 -- 172.21.15.50:0/4095871211 reap_dead start 2024-09-11T22:24:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.185+0000 7f0b16511640 1 -- 172.21.15.50:0/4095871211 shutdown_connections 2024-09-11T22:24:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.185+0000 7f0b16511640 1 -- 172.21.15.50:0/4095871211 >> 172.21.15.50:0/4095871211 conn(0x7f0b100b07e0 msgr2=0x7f0b100b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.185+0000 7f0b16511640 1 -- 172.21.15.50:0/4095871211 shutdown_connections 2024-09-11T22:24:26.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.185+0000 7f0b16511640 1 -- 172.21.15.50:0/4095871211 wait complete. 2024-09-11T22:24:26.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-11T22:24:26.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.299+0000 7f6d45b42640 1 Processor -- start 2024-09-11T22:24:26.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.299+0000 7f6d45b42640 1 -- start start 2024-09-11T22:24:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d45b42640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d4015e870 0x7f6d400d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d45b42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d400d16d0 0x7f6d400d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d45b42640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d400cfa80 con 0x7f6d400d3a30 2024-09-11T22:24:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d45b42640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f6d400d1b10 con 0x7f6d4015e870 2024-09-11T22:24:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d45b42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6d400d3e80 con 0x7f6d400d16d0 2024-09-11T22:24:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d3f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d4015e870 0x7f6d400d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d3f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6d4015e870 0x7f6d400d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40880/0 (socket says 172.21.15.50:40880) 2024-09-11T22:24:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d3f7fe640 1 -- 172.21.15.50:0/964299030 learned_addr learned my addr 172.21.15.50:0/964299030 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d36ffd640 1 --2- 172.21.15.50:0/964299030 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d400d16d0 0x7f6d400d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d3f7fe640 1 -- 172.21.15.50:0/964299030 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d400d16d0 msgr2=0x7f6d400d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:26.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d3f7fe640 1 --2- 172.21.15.50:0/964299030 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d400d16d0 0x7f6d400d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d3f7fe640 1 -- 172.21.15.50:0/964299030 >> v1:172.21.15.77:6789/0 conn(0x7f6d400d3a30 legacy=0x7f6d400b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:26.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d3f7fe640 1 -- 172.21.15.50:0/964299030 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d400d40d0 con 0x7f6d4015e870 2024-09-11T22:24:26.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.300+0000 7f6d36ffd640 1 --2- 172.21.15.50:0/964299030 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d400d16d0 0x7f6d400d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:26.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.301+0000 7f6d3f7fe640 1 --2- 172.21.15.50:0/964299030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4015e870 0x7f6d400d1190 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009870 tx=0x7f6d3002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f58a071e9c2542 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:26.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.301+0000 7f6d3effd640 1 -- 172.21.15.50:0/964299030 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30037070 con 0x7f6d4015e870 2024-09-11T22:24:26.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.301+0000 7f6d3effd640 1 -- 172.21.15.50:0/964299030 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d30032440 con 0x7f6d4015e870 2024-09-11T22:24:26.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.301+0000 7f6d3effd640 1 -- 172.21.15.50:0/964299030 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30032810 con 0x7f6d4015e870 2024-09-11T22:24:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.301+0000 7f6d45b42640 1 -- 172.21.15.50:0/964299030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4015e870 msgr2=0x7f6d400d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.301+0000 7f6d45b42640 1 --2- 172.21.15.50:0/964299030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4015e870 0x7f6d400d1190 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009870 tx=0x7f6d3002a210 comp rx=0 tx=0).stop 2024-09-11T22:24:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.302+0000 7f6d45b42640 1 -- 172.21.15.50:0/964299030 shutdown_connections 2024-09-11T22:24:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.302+0000 7f6d45b42640 1 --2- 172.21.15.50:0/964299030 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d400d16d0 0x7f6d400d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.302+0000 7f6d45b42640 1 --2- 172.21.15.50:0/964299030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4015e870 0x7f6d400d1190 unknown :-1 s=CLOSED pgs=2410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.302+0000 7f6d45b42640 1 -- 172.21.15.50:0/964299030 >> 172.21.15.50:0/964299030 conn(0x7f6d400727a0 msgr2=0x7f6d400679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.302+0000 7f6d45b42640 1 -- 172.21.15.50:0/964299030 shutdown_connections 2024-09-11T22:24:26.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.302+0000 7f6d45b42640 1 -- 172.21.15.50:0/964299030 wait complete. 2024-09-11T22:24:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.303+0000 7f6d45b42640 1 Processor -- start 2024-09-11T22:24:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.303+0000 7f6d45b42640 1 -- start start 2024-09-11T22:24:26.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d45b42640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d400d16d0 0x7f6d40154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d45b42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d400d3a30 0x7f6d400b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d45b42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4015e870 0x7f6d400b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d45b42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6d400b7ee0 con 0x7f6d4015e870 2024-09-11T22:24:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d45b42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6d400b7c00 con 0x7f6d400d3a30 2024-09-11T22:24:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d45b42640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4015ec50 con 0x7f6d400d16d0 2024-09-11T22:24:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d3ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4015e870 0x7f6d400b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d3ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4015e870 0x7f6d400b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40892/0 (socket says 172.21.15.50:40892) 2024-09-11T22:24:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d3ffff640 1 -- 172.21.15.50:0/3270539927 learned_addr learned my addr 172.21.15.50:0/3270539927 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d3f7fe640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d400d16d0 0x7f6d40154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d36ffd640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d400d3a30 0x7f6d400b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d3ffff640 1 -- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d400d16d0 msgr2=0x7f6d40154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d3ffff640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d400d16d0 0x7f6d40154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d3ffff640 1 -- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d400d3a30 msgr2=0x7f6d400b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d3ffff640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d400d3a30 0x7f6d400b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d3ffff640 1 -- 172.21.15.50:0/3270539927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d400c8330 con 0x7f6d4015e870 2024-09-11T22:24:26.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d3ffff640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4015e870 0x7f6d400b3900 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800c780 tx=0x7f6d3800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d3cff9640 1 -- 172.21.15.50:0/3270539927 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d38004b60 con 0x7f6d4015e870 2024-09-11T22:24:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.304+0000 7f6d3cff9640 1 -- 172.21.15.50:0/3270539927 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d38004d00 con 0x7f6d4015e870 2024-09-11T22:24:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.305+0000 7f6d3cff9640 1 -- 172.21.15.50:0/3270539927 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3800aa90 con 0x7f6d4015e870 2024-09-11T22:24:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.305+0000 7f6d45b42640 1 -- 172.21.15.50:0/3270539927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d400c8610 con 0x7f6d4015e870 2024-09-11T22:24:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.305+0000 7f6d45b42640 1 -- 172.21.15.50:0/3270539927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d400c8bd0 con 0x7f6d4015e870 2024-09-11T22:24:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.305+0000 7f6d45b42640 1 -- 172.21.15.50:0/3270539927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d400d2580 con 0x7f6d4015e870 2024-09-11T22:24:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.306+0000 7f6d3cff9640 1 -- 172.21.15.50:0/3270539927 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d3800ac30 con 0x7f6d4015e870 2024-09-11T22:24:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.307+0000 7f6d3cff9640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6d2006be30 0x7f6d2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.307+0000 7f6d3cff9640 1 -- 172.21.15.50:0/3270539927 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f6d3808ad50 con 0x7f6d4015e870 2024-09-11T22:24:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.307+0000 7f6d3f7fe640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6d2006be30 0x7f6d2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.307+0000 7f6d3f7fe640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6d2006be30 0x7f6d2006e2f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6d30034000 tx=0x7f6d3002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.311+0000 7f6d3cff9640 1 -- 172.21.15.50:0/3270539927 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d400d2580 con 0x7f6d4015e870 2024-09-11T22:24:26.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.488+0000 7f6d45b42640 1 -- 172.21.15.50:0/3270539927 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f6d401550d0 con 0x7f6d2006be30 2024-09-11T22:24:26.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.489+0000 7f6d3cff9640 1 -- 172.21.15.50:0/3270539927 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6d300327f0 con 0x7f6d2006be30 2024-09-11T22:24:26.490 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 7 to deep-scrub 2024-09-11T22:24:26.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.491+0000 7f6d45b42640 1 -- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6d2006be30 msgr2=0x7f6d2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.491+0000 7f6d45b42640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6d2006be30 0x7f6d2006e2f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6d30034000 tx=0x7f6d3002e000 comp rx=0 tx=0).stop 2024-09-11T22:24:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.491+0000 7f6d45b42640 1 -- 172.21.15.50:0/3270539927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4015e870 msgr2=0x7f6d400b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.491+0000 7f6d45b42640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4015e870 0x7f6d400b3900 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800c780 tx=0x7f6d3800cc40 comp rx=0 tx=0).stop 2024-09-11T22:24:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.491+0000 7f6d45b42640 1 -- 172.21.15.50:0/3270539927 shutdown_connections 2024-09-11T22:24:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.491+0000 7f6d45b42640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f6d2006be30 0x7f6d2006e2f0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.491+0000 7f6d45b42640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4015e870 0x7f6d400b3900 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.491+0000 7f6d45b42640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d400d3a30 0x7f6d400b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.491+0000 7f6d45b42640 1 --2- 172.21.15.50:0/3270539927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d400d16d0 0x7f6d40154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.491+0000 7f6d45b42640 1 -- 172.21.15.50:0/3270539927 >> 172.21.15.50:0/3270539927 conn(0x7f6d400727a0 msgr2=0x7f6d40160520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.491+0000 7f6d45b42640 1 -- 172.21.15.50:0/3270539927 shutdown_connections 2024-09-11T22:24:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.491+0000 7f6d45b42640 1 -- 172.21.15.50:0/3270539927 wait complete. 2024-09-11T22:24:26.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:24:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.604+0000 7ff38ed6d640 1 Processor -- start 2024-09-11T22:24:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.604+0000 7ff38ed6d640 1 -- start start 2024-09-11T22:24:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff38ed6d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff38806bb50 0x7ff38815f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff38ed6d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3880b5fd0 con 0x7ff38815e9b0 2024-09-11T22:24:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff38ed6d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3880b62b0 con 0x7ff3880b6d90 2024-09-11T22:24:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff38ed6d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff3880b6900 con 0x7ff38806bb50 2024-09-11T22:24:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff38cb09640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff38815e9b0 0x7ff3880af3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51914/0 (socket says 172.21.15.50:51914) 2024-09-11T22:24:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff38cb09640 1 -- 172.21.15.50:0/3862912272 learned_addr learned my addr 172.21.15.50:0/3862912272 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff387fff640 1 --2- 172.21.15.50:0/3862912272 >> v2:172.21.15.77:3300/0 conn(0x7ff38806bb50 0x7ff38815f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2923456126 0 0) 0x7ff3880b5fd0 con 0x7ff38815e9b0 2024-09-11T22:24:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff378003520 con 0x7ff38815e9b0 2024-09-11T22:24:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3969053779 0 0) 0x7ff3880b62b0 con 0x7ff3880b6d90 2024-09-11T22:24:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3880b5fd0 con 0x7ff3880b6d90 2024-09-11T22:24:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1643392937 0 0) 0x7ff378003520 con 0x7ff38815e9b0 2024-09-11T22:24:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 >> v2:172.21.15.77:3300/0 conn(0x7ff38806bb50 msgr2=0x7ff38815f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.605+0000 7ff3877fe640 1 --2- 172.21.15.50:0/3862912272 >> v2:172.21.15.77:3300/0 conn(0x7ff38806bb50 0x7ff38815f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 >> v1:172.21.15.77:6789/0 conn(0x7ff3880b6d90 legacy=0x7ff38806c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3880b6590 con 0x7ff38815e9b0 2024-09-11T22:24:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7ff37c001670 con 0x7ff38815e9b0 2024-09-11T22:24:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff387fff640 1 --2- 172.21.15.50:0/3862912272 >> v2:172.21.15.77:3300/0 conn(0x7ff38806bb50 0x7ff38815f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:24:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 >> v1:172.21.15.50:6789/0 conn(0x7ff38815e9b0 legacy=0x7ff3880af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff3877fe640 1 --2- 172.21.15.50:0/3862912272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff378003b40 0x7ff378003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff3877fe640 1 --2- 172.21.15.50:0/3862912272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff378004800 0x7ff378004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff3877fe640 1 --2- 172.21.15.50:0/3862912272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3780051c0 0x7ff37800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff3880b6900 con 0x7ff3780051c0 2024-09-11T22:24:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff37800c040 con 0x7ff378004800 2024-09-11T22:24:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff37800c240 con 0x7ff378003b40 2024-09-11T22:24:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff38d30a640 1 --2- 172.21.15.50:0/3862912272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3780051c0 0x7ff37800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff387fff640 1 --2- 172.21.15.50:0/3862912272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff378004800 0x7ff378004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff38cb09640 1 --2- 172.21.15.50:0/3862912272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff378003b40 0x7ff378003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff38d30a640 1 -- 172.21.15.50:0/3862912272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff378003b40 msgr2=0x7ff378003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff38d30a640 1 --2- 172.21.15.50:0/3862912272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff378003b40 0x7ff378003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff38d30a640 1 -- 172.21.15.50:0/3862912272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff378004800 msgr2=0x7ff378004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff38d30a640 1 --2- 172.21.15.50:0/3862912272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff378004800 0x7ff378004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.606+0000 7ff38d30a640 1 -- 172.21.15.50:0/3862912272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff378003520 con 0x7ff3780051c0 2024-09-11T22:24:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.607+0000 7ff38d30a640 1 -- 172.21.15.50:0/3862912272 reap_dead start 2024-09-11T22:24:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.607+0000 7ff38d30a640 1 --2- 172.21.15.50:0/3862912272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3780051c0 0x7ff37800b9c0 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7ff380001fd0 tx=0x7ff378005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0b7842afde7d8b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.607+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff380001bf0 con 0x7ff3780051c0 2024-09-11T22:24:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.607+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff380003b70 con 0x7ff3780051c0 2024-09-11T22:24:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.607+0000 7ff3877fe640 1 -- 172.21.15.50:0/3862912272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3800050d0 con 0x7ff3780051c0 2024-09-11T22:24:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.607+0000 7ff38ed6d640 1 -- 172.21.15.50:0/3862912272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3780051c0 msgr2=0x7ff37800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.607+0000 7ff38ed6d640 1 --2- 172.21.15.50:0/3862912272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3780051c0 0x7ff37800b9c0 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7ff380001fd0 tx=0x7ff378005830 comp rx=0 tx=0).stop 2024-09-11T22:24:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.607+0000 7ff38ed6d640 1 -- 172.21.15.50:0/3862912272 shutdown_connections 2024-09-11T22:24:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.607+0000 7ff38ed6d640 1 --2- 172.21.15.50:0/3862912272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3780051c0 0x7ff37800b9c0 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.607+0000 7ff38ed6d640 1 -- 172.21.15.50:0/3862912272 >> 172.21.15.50:0/3862912272 conn(0x7ff3880b7940 msgr2=0x7ff3880b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:26.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.608+0000 7ff38ed6d640 1 -- 172.21.15.50:0/3862912272 shutdown_connections 2024-09-11T22:24:26.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.608+0000 7ff38ed6d640 1 -- 172.21.15.50:0/3862912272 wait complete. 2024-09-11T22:24:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.609+0000 7ff38ed6d640 1 Processor -- start 2024-09-11T22:24:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.609+0000 7ff38ed6d640 1 -- start start 2024-09-11T22:24:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38ed6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3780051c0 0x7ff388154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38ed6d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3881f8230 0x7ff388162640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38ed6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff388162b80 0x7ff3880cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38ed6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff38806d490 con 0x7ff388162b80 2024-09-11T22:24:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38ed6d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff38806d310 con 0x7ff3780051c0 2024-09-11T22:24:26.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38ed6d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff38815f820 con 0x7ff3881f8230 2024-09-11T22:24:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38d30a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff388162b80 0x7ff3880cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38d30a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff388162b80 0x7ff3880cbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40912/0 (socket says 172.21.15.50:40912) 2024-09-11T22:24:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38d30a640 1 -- 172.21.15.50:0/2980572131 learned_addr learned my addr 172.21.15.50:0/2980572131 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff387fff640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3881f8230 0x7ff388162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38cb09640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3780051c0 0x7ff388154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38d30a640 1 -- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3881f8230 msgr2=0x7ff388162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38d30a640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3881f8230 0x7ff388162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38d30a640 1 -- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3780051c0 msgr2=0x7ff388154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38d30a640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3780051c0 0x7ff388154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38d30a640 1 -- 172.21.15.50:0/2980572131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff388161e80 con 0x7ff388162b80 2024-09-11T22:24:26.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38cb09640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3780051c0 0x7ff388154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:24:26.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38d30a640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff388162b80 0x7ff3880cbce0 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7ff38002aab0 tx=0x7ff380001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:26.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff3857fa640 1 -- 172.21.15.50:0/2980572131 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff380041070 con 0x7ff388162b80 2024-09-11T22:24:26.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff3857fa640 1 -- 172.21.15.50:0/2980572131 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff380003970 con 0x7ff388162b80 2024-09-11T22:24:26.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.610+0000 7ff38ed6d640 1 -- 172.21.15.50:0/2980572131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff388154a80 con 0x7ff388162b80 2024-09-11T22:24:26.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.611+0000 7ff3857fa640 1 -- 172.21.15.50:0/2980572131 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff380005520 con 0x7ff388162b80 2024-09-11T22:24:26.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.611+0000 7ff38ed6d640 1 -- 172.21.15.50:0/2980572131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff388162120 con 0x7ff388162b80 2024-09-11T22:24:26.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.611+0000 7ff38ed6d640 1 -- 172.21.15.50:0/2980572131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff38815fb20 con 0x7ff388162b80 2024-09-11T22:24:26.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.612+0000 7ff3857fa640 1 -- 172.21.15.50:0/2980572131 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff380044070 con 0x7ff388162b80 2024-09-11T22:24:26.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.612+0000 7ff3857fa640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff36c06be30 0x7ff36c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:26.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.613+0000 7ff3857fa640 1 -- 172.21.15.50:0/2980572131 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7ff3800aa070 con 0x7ff388162b80 2024-09-11T22:24:26.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.613+0000 7ff38cb09640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff36c06be30 0x7ff36c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:26.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.613+0000 7ff38cb09640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff36c06be30 0x7ff36c06e2f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff37c001eb0 tx=0x7ff37c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:26.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.617+0000 7ff3857fa640 1 -- 172.21.15.50:0/2980572131 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff380003b40 con 0x7ff388162b80 2024-09-11T22:24:26.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.791+0000 7ff38ed6d640 1 -- 172.21.15.50:0/2980572131 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff388070760 con 0x7ff36c06be30 2024-09-11T22:24:26.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.792+0000 7ff3857fa640 1 -- 172.21.15.50:0/2980572131 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13394 (secure 0 0 0) 0x7ff388070760 con 0x7ff36c06be30 2024-09-11T22:24:26.793 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:26.793 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:24:26.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.794+0000 7ff38ed6d640 1 -- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff36c06be30 msgr2=0x7ff36c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.794+0000 7ff38ed6d640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff36c06be30 0x7ff36c06e2f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff37c001eb0 tx=0x7ff37c009040 comp rx=0 tx=0).stop 2024-09-11T22:24:26.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.794+0000 7ff38ed6d640 1 -- 172.21.15.50:0/2980572131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff388162b80 msgr2=0x7ff3880cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:26.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.794+0000 7ff38ed6d640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff388162b80 0x7ff3880cbce0 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7ff38002aab0 tx=0x7ff380001650 comp rx=0 tx=0).stop 2024-09-11T22:24:26.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.795+0000 7ff38ed6d640 1 -- 172.21.15.50:0/2980572131 shutdown_connections 2024-09-11T22:24:26.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.795+0000 7ff38ed6d640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7ff36c06be30 0x7ff36c06e2f0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.795+0000 7ff38ed6d640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3881f8230 0x7ff388162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.795+0000 7ff38ed6d640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff388162b80 0x7ff3880cbce0 unknown :-1 s=CLOSED pgs=2414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.795+0000 7ff38ed6d640 1 --2- 172.21.15.50:0/2980572131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3780051c0 0x7ff388154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:26.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.795+0000 7ff38ed6d640 1 -- 172.21.15.50:0/2980572131 >> 172.21.15.50:0/2980572131 conn(0x7ff3880b7940 msgr2=0x7ff38806f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:26.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.795+0000 7ff38ed6d640 1 -- 172.21.15.50:0/2980572131 shutdown_connections 2024-09-11T22:24:26.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:26.795+0000 7ff38ed6d640 1 -- 172.21.15.50:0/2980572131 wait complete. 2024-09-11T22:24:26.806 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":589,"stamp":"2024-09-11T22:24:25.556468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":444676,"kb_used_data":20296,"kb_used_omap":12,"kb_used_meta":424179,"kb_avail":754530044,"statfs":{"total":773094113280,"available":772638765056,"internally_reserved":0,"allocated":20783104,"data_stored":9797848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":434359857},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-7,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.546984"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":484,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T22:24:19.024143+0000","last_change":"2024-09-11T22:11:05.244971+0000","last_active":"2024-09-11T22:24:19.024143+0000","last_peered":"2024-09-11T22:24:19.024143+0000","last_clean":"2024-09-11T22:24:19.024143+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:24:19.024143+0000","last_undegraded":"2024-09-11T22:24:19.024143+0000","last_fullsized":"2024-09-11T22:24:19.024143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:11:03.607787+0000","last_clean_scrub_stamp":"2024-09-11T22:11:03.607787+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:10.852414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509605,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55788,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316052,"statfs":{"total":96636764160,"available":96579637248,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509602,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55792,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316048,"statfs":{"total":96636764160,"available":96579633152,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65456,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306384,"statfs":{"total":96636764160,"available":96569737216,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47472,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324368,"statfs":{"total":96636764160,"available":96588152832,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51632,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320208,"statfs":{"total":96636764160,"available":96583892992,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509603,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60532,"kb_used_data":2972,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311308,"statfs":{"total":96636764160,"available":96574779392,"internally_reserved":0,"allocated":3043328,"data_stored":1667507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60532,"kb_used_data":2972,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311308,"statfs":{"total":96636764160,"available":96574779392,"internally_reserved":0,"allocated":3043328,"data_stored":1667507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575010,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47472,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324368,"statfs":{"total":96636764160,"available":96588152832,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:24:26.809 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T22:11:03.607787+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=11, tm_sec=3, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=24, tm_sec=21, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:24:26.809 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T22:24:44.984 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:24:44.988 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:24:46.811 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:24:46.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.915+0000 7f5659e17640 1 Processor -- start 2024-09-11T22:24:46.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.915+0000 7f5659e17640 1 -- start start 2024-09-11T22:24:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5659e17640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f565415b400 0x7f565406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5659e17640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f565406e0f0 0x7f56540711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5659e17640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f565415b7e0 con 0x7f5654072e60 2024-09-11T22:24:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5659e17640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f565415f140 con 0x7f565406e0f0 2024-09-11T22:24:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5659e17640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f565415f420 con 0x7f565415b400 2024-09-11T22:24:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5653fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f565406e0f0 0x7f56540711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:46.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5653fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f565406e0f0 0x7f56540711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58802/0 (socket says 172.21.15.50:58802) 2024-09-11T22:24:46.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5653fff640 1 -- 172.21.15.50:0/1913325767 learned_addr learned my addr 172.21.15.50:0/1913325767 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:46.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f56537fe640 1 --2- 172.21.15.50:0/1913325767 >> v2:172.21.15.77:3300/0 conn(0x7f565415b400 0x7f565406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:46.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5653fff640 1 -- 172.21.15.50:0/1913325767 >> v2:172.21.15.77:3300/0 conn(0x7f565415b400 msgr2=0x7f565406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:46.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5653fff640 1 --2- 172.21.15.50:0/1913325767 >> v2:172.21.15.77:3300/0 conn(0x7f565415b400 0x7f565406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:46.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5653fff640 1 -- 172.21.15.50:0/1913325767 >> v1:172.21.15.77:6789/0 conn(0x7f5654072e60 legacy=0x7f565406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:46.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5653fff640 1 -- 172.21.15.50:0/1913325767 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565415f700 con 0x7f565406e0f0 2024-09-11T22:24:46.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f56537fe640 1 --2- 172.21.15.50:0/1913325767 >> v2:172.21.15.77:3300/0 conn(0x7f565415b400 0x7f565406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:46.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5653fff640 1 --2- 172.21.15.50:0/1913325767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f565406e0f0 0x7f56540711c0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f56540b56e0 tx=0x7f564c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad03745ec797b73 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:46.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5652ffd640 1 -- 172.21.15.50:0/1913325767 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564c036070 con 0x7f565406e0f0 2024-09-11T22:24:46.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5652ffd640 1 -- 172.21.15.50:0/1913325767 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f564c031600 con 0x7f565406e0f0 2024-09-11T22:24:46.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.917+0000 7f5652ffd640 1 -- 172.21.15.50:0/1913325767 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564c0319d0 con 0x7f565406e0f0 2024-09-11T22:24:46.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.918+0000 7f5659e17640 1 -- 172.21.15.50:0/1913325767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f565406e0f0 msgr2=0x7f56540711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:46.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.918+0000 7f5659e17640 1 --2- 172.21.15.50:0/1913325767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f565406e0f0 0x7f56540711c0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f56540b56e0 tx=0x7f564c02a6f0 comp rx=0 tx=0).stop 2024-09-11T22:24:46.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.918+0000 7f5659e17640 1 -- 172.21.15.50:0/1913325767 shutdown_connections 2024-09-11T22:24:46.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.918+0000 7f5659e17640 1 --2- 172.21.15.50:0/1913325767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f565406e0f0 0x7f56540711c0 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:46.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.918+0000 7f5659e17640 1 --2- 172.21.15.50:0/1913325767 >> v2:172.21.15.77:3300/0 conn(0x7f565415b400 0x7f565406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:46.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.918+0000 7f5659e17640 1 -- 172.21.15.50:0/1913325767 >> 172.21.15.50:0/1913325767 conn(0x7f56540679c0 msgr2=0x7f5654067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:46.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.918+0000 7f5659e17640 1 -- 172.21.15.50:0/1913325767 shutdown_connections 2024-09-11T22:24:46.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.918+0000 7f5659e17640 1 -- 172.21.15.50:0/1913325767 wait complete. 2024-09-11T22:24:46.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.919+0000 7f5659e17640 1 Processor -- start 2024-09-11T22:24:46.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.919+0000 7f5659e17640 1 -- start start 2024-09-11T22:24:46.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.920+0000 7f5659e17640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f565406e0f0 0x7f56541e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.920+0000 7f5659e17640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5654072e60 0x7f56541e57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.920+0000 7f5659e17640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f565415b400 0x7f56540aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.920+0000 7f5659e17640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5654071700 con 0x7f5654072e60 2024-09-11T22:24:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.920+0000 7f5659e17640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f56540cfc50 con 0x7f565406e0f0 2024-09-11T22:24:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.920+0000 7f5659e17640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5654071880 con 0x7f565415b400 2024-09-11T22:24:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.920+0000 7f564affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5654072e60 0x7f56541e57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.920+0000 7f564affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5654072e60 0x7f56541e57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58806/0 (socket says 172.21.15.50:58806) 2024-09-11T22:24:46.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.920+0000 7f564affd640 1 -- 172.21.15.50:0/2337697658 learned_addr learned my addr 172.21.15.50:0/2337697658 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:46.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.920+0000 7f56537fe640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f565406e0f0 0x7f56541e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:46.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.920+0000 7f5653fff640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f565415b400 0x7f56540aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:46.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.921+0000 7f564affd640 1 -- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f565415b400 msgr2=0x7f56540aa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:46.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.921+0000 7f564affd640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f565415b400 0x7f56540aa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:46.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.921+0000 7f564affd640 1 -- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f565406e0f0 msgr2=0x7f56541e5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:46.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.921+0000 7f564affd640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f565406e0f0 0x7f56541e5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:46.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.921+0000 7f564affd640 1 -- 172.21.15.50:0/2337697658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5654143910 con 0x7f5654072e60 2024-09-11T22:24:46.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.921+0000 7f564affd640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5654072e60 0x7f56541e57b0 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7f563c00c430 tx=0x7f563c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:46.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.921+0000 7f5650ff9640 1 -- 172.21.15.50:0/2337697658 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c011790 con 0x7f5654072e60 2024-09-11T22:24:46.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.921+0000 7f5650ff9640 1 -- 172.21.15.50:0/2337697658 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563c017070 con 0x7f5654072e60 2024-09-11T22:24:46.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.921+0000 7f5659e17640 1 -- 172.21.15.50:0/2337697658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5654143bf0 con 0x7f5654072e60 2024-09-11T22:24:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.921+0000 7f5650ff9640 1 -- 172.21.15.50:0/2337697658 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c011b70 con 0x7f5654072e60 2024-09-11T22:24:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.921+0000 7f5659e17640 1 -- 172.21.15.50:0/2337697658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56541441b0 con 0x7f5654072e60 2024-09-11T22:24:46.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.922+0000 7f5659e17640 1 -- 172.21.15.50:0/2337697658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56540711c0 con 0x7f5654072e60 2024-09-11T22:24:46.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.922+0000 7f5650ff9640 1 -- 172.21.15.50:0/2337697658 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f563c011d10 con 0x7f5654072e60 2024-09-11T22:24:46.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.923+0000 7f5650ff9640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f563406be30 0x7f563406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:46.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.923+0000 7f5650ff9640 1 -- 172.21.15.50:0/2337697658 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f563c08a870 con 0x7f5654072e60 2024-09-11T22:24:46.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.923+0000 7f56537fe640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f563406be30 0x7f563406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:46.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.924+0000 7f56537fe640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f563406be30 0x7f563406e2f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f564400aac0 tx=0x7f5644008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:46.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:46.927+0000 7f5650ff9640 1 -- 172.21.15.50:0/2337697658 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f563c058ed0 con 0x7f5654072e60 2024-09-11T22:24:47.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.099+0000 7f5659e17640 1 -- 172.21.15.50:0/2337697658 --> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56540b4ce0 con 0x7f563406be30 2024-09-11T22:24:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.101+0000 7f5650ff9640 1 -- 172.21.15.50:0/2337697658 <== mgr.4100 v2:172.21.15.77:6832/2944691311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13385 (secure 0 0 0) 0x7f56540b4ce0 con 0x7f563406be30 2024-09-11T22:24:47.102 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-11T22:24:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.103+0000 7f5659e17640 1 -- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f563406be30 msgr2=0x7f563406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.103+0000 7f5659e17640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f563406be30 0x7f563406e2f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f564400aac0 tx=0x7f5644008040 comp rx=0 tx=0).stop 2024-09-11T22:24:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.103+0000 7f5659e17640 1 -- 172.21.15.50:0/2337697658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5654072e60 msgr2=0x7f56541e57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.103+0000 7f5659e17640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5654072e60 0x7f56541e57b0 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7f563c00c430 tx=0x7f563c00c8f0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.103+0000 7f5659e17640 1 -- 172.21.15.50:0/2337697658 shutdown_connections 2024-09-11T22:24:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.103+0000 7f5659e17640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f563406be30 0x7f563406e2f0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.103+0000 7f5659e17640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f565415b400 0x7f56540aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.103+0000 7f5659e17640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5654072e60 0x7f56541e57b0 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.103+0000 7f5659e17640 1 --2- 172.21.15.50:0/2337697658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f565406e0f0 0x7f56541e5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.103+0000 7f5659e17640 1 -- 172.21.15.50:0/2337697658 >> 172.21.15.50:0/2337697658 conn(0x7f56540679c0 msgr2=0x7f56540b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:47.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.103+0000 7f5659e17640 1 -- 172.21.15.50:0/2337697658 shutdown_connections 2024-09-11T22:24:47.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.103+0000 7f5659e17640 1 -- 172.21.15.50:0/2337697658 wait complete. 2024-09-11T22:24:47.115 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":599,"stamp":"2024-09-11T22:24:45.560651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":444660,"kb_used_data":20296,"kb_used_omap":12,"kb_used_meta":424179,"kb_avail":754530060,"statfs":{"total":773094113280,"available":772638781440,"internally_reserved":0,"allocated":20783104,"data_stored":9797848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":434359857},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002406"},"pg_stats":[{"pgid":"1.0","version":"194'119","reported_seq":495,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T22:24:27.128714+0000","last_change":"2024-09-11T22:24:27.128772+0000","last_active":"2024-09-11T22:24:27.128714+0000","last_peered":"2024-09-11T22:24:27.128714+0000","last_clean":"2024-09-11T22:24:27.128714+0000","last_became_active":"2024-09-11T22:11:05.244006+0000","last_became_peered":"2024-09-11T22:11:05.244006+0000","last_unstale":"2024-09-11T22:24:27.128714+0000","last_undegraded":"2024-09-11T22:24:27.128714+0000","last_fullsized":"2024-09-11T22:24:27.128714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"194'119","last_scrub_stamp":"2024-09-11T22:24:27.128602+0000","last_deep_scrub":"194'119","last_deep_scrub_stamp":"2024-09-11T22:24:27.128602+0000","last_clean_scrub_stamp":"2024-09-11T22:24:27.128602+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:34.051316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509609,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55788,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316052,"statfs":{"total":96636764160,"available":96579637248,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509606,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55792,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316048,"statfs":{"total":96636764160,"available":96579633152,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509608,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65456,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306384,"statfs":{"total":96636764160,"available":96569737216,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509608,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47472,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324368,"statfs":{"total":96636764160,"available":96588152832,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509608,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51632,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320208,"statfs":{"total":96636764160,"available":96583892992,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509607,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60524,"kb_used_data":2972,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311316,"statfs":{"total":96636764160,"available":96574787584,"internally_reserved":0,"allocated":3043328,"data_stored":1667507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60524,"kb_used_data":2972,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311316,"statfs":{"total":96636764160,"available":96574787584,"internally_reserved":0,"allocated":3043328,"data_stored":1667507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575014,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47472,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324368,"statfs":{"total":96636764160,"available":96588152832,"internally_reserved":0,"allocated":2449408,"data_stored":1077139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:24:47.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T22:24:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.216+0000 7f990e0e4640 1 Processor -- start 2024-09-11T22:24:47.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.217+0000 7f990e0e4640 1 -- start start 2024-09-11T22:24:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.217+0000 7f990e0e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f990815e870 0x7f99080d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.217+0000 7f990e0e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f99080d3c00 0x7f99080b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.217+0000 7f990e0e4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99080cfa80 con 0x7f99080d16d0 2024-09-11T22:24:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.217+0000 7f990e0e4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 -- 0x7f99080d1b40 con 0x7f990815e870 2024-09-11T22:24:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.217+0000 7f990e0e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f99080d40d0 con 0x7f99080d3c00 2024-09-11T22:24:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.218+0000 7f99077fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f990815e870 0x7f99080d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.218+0000 7f9906ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f99080d16d0 0x7f99080d34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57652/0 (socket says 172.21.15.50:57652) 2024-09-11T22:24:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.218+0000 7f9906ffd640 1 -- 172.21.15.50:0/2439180102 learned_addr learned my addr 172.21.15.50:0/2439180102 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.218+0000 7f9907fff640 1 --2- 172.21.15.50:0/2439180102 >> v2:172.21.15.77:3300/0 conn(0x7f99080d3c00 0x7f99080b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.218+0000 7f99077fe640 1 -- 172.21.15.50:0/2439180102 >> v2:172.21.15.77:3300/0 conn(0x7f99080d3c00 msgr2=0x7f99080b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.218+0000 7f99077fe640 1 --2- 172.21.15.50:0/2439180102 >> v2:172.21.15.77:3300/0 conn(0x7f99080d3c00 0x7f99080b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.218+0000 7f99077fe640 1 -- 172.21.15.50:0/2439180102 >> v1:172.21.15.50:6789/0 conn(0x7f99080d16d0 legacy=0x7f99080d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.218+0000 7f99077fe640 1 -- 172.21.15.50:0/2439180102 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99080d43b0 con 0x7f990815e870 2024-09-11T22:24:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.218+0000 7f99067fc640 1 -- 172.21.15.50:0/2439180102 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3253915438 0 0) 0x7f98fc001110 con 0x7f99080d16d0 2024-09-11T22:24:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.219+0000 7f99077fe640 1 --2- 172.21.15.50:0/2439180102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f990815e870 0x7f99080d1190 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7f9908068490 tx=0x7f98f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796555f0f246ef6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.219+0000 7f99067fc640 1 -- 172.21.15.50:0/2439180102 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8037070 con 0x7f990815e870 2024-09-11T22:24:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.219+0000 7f99067fc640 1 -- 172.21.15.50:0/2439180102 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f8032440 con 0x7f990815e870 2024-09-11T22:24:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.219+0000 7f99067fc640 1 -- 172.21.15.50:0/2439180102 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8032810 con 0x7f990815e870 2024-09-11T22:24:47.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.219+0000 7f990e0e4640 1 -- 172.21.15.50:0/2439180102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f990815e870 msgr2=0x7f99080d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.219+0000 7f990e0e4640 1 --2- 172.21.15.50:0/2439180102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f990815e870 0x7f99080d1190 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7f9908068490 tx=0x7f98f802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.219+0000 7f990e0e4640 1 -- 172.21.15.50:0/2439180102 shutdown_connections 2024-09-11T22:24:47.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.219+0000 7f990e0e4640 1 --2- 172.21.15.50:0/2439180102 >> v2:172.21.15.77:3300/0 conn(0x7f99080d3c00 0x7f99080b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.219+0000 7f990e0e4640 1 --2- 172.21.15.50:0/2439180102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f990815e870 0x7f99080d1190 unknown :-1 s=CLOSED pgs=2418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.219+0000 7f990e0e4640 1 -- 172.21.15.50:0/2439180102 >> 172.21.15.50:0/2439180102 conn(0x7f99080727a0 msgr2=0x7f99080679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:47.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.219+0000 7f990e0e4640 1 -- 172.21.15.50:0/2439180102 shutdown_connections 2024-09-11T22:24:47.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.219+0000 7f990e0e4640 1 -- 172.21.15.50:0/2439180102 wait complete. 2024-09-11T22:24:47.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.221+0000 7f990e0e4640 1 Processor -- start 2024-09-11T22:24:47.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.221+0000 7f990e0e4640 1 -- start start 2024-09-11T22:24:47.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.221+0000 7f990e0e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99080d16d0 0x7f9908155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.221+0000 7f990e0e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99080d3c00 0x7f9908154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.221+0000 7f990e0e4640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990815e870 0x7f990815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.221+0000 7f990e0e4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f990815ec50 con 0x7f99080d3c00 2024-09-11T22:24:47.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.221+0000 7f990e0e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f99080b7ee0 con 0x7f99080d16d0 2024-09-11T22:24:47.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f990e0e4640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f99080b78b0 con 0x7f990815e870 2024-09-11T22:24:47.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f9906ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99080d3c00 0x7f9908154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f9906ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99080d3c00 0x7f9908154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58824/0 (socket says 172.21.15.50:58824) 2024-09-11T22:24:47.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f9906ffd640 1 -- 172.21.15.50:0/1358999646 learned_addr learned my addr 172.21.15.50:0/1358999646 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:47.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f99077fe640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99080d16d0 0x7f9908155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f9907fff640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990815e870 0x7f990815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f9906ffd640 1 -- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990815e870 msgr2=0x7f990815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f9906ffd640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990815e870 0x7f990815b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f9906ffd640 1 -- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99080d16d0 msgr2=0x7f9908155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f9906ffd640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99080d16d0 0x7f9908155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f9906ffd640 1 -- 172.21.15.50:0/1358999646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990815a8a0 con 0x7f99080d3c00 2024-09-11T22:24:47.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f99077fe640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99080d16d0 0x7f9908155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:47.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f9907fff640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990815e870 0x7f990815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:24:47.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f9906ffd640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99080d3c00 0x7f9908154a80 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00c460 tx=0x7f98fc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:47.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f98effff640 1 -- 172.21.15.50:0/1358999646 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0074e0 con 0x7f99080d3c00 2024-09-11T22:24:47.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f98effff640 1 -- 172.21.15.50:0/1358999646 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98fc0047e0 con 0x7f99080d3c00 2024-09-11T22:24:47.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f990e0e4640 1 -- 172.21.15.50:0/1358999646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990815ab80 con 0x7f99080d3c00 2024-09-11T22:24:47.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f98effff640 1 -- 172.21.15.50:0/1358999646 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc004bd0 con 0x7f99080d3c00 2024-09-11T22:24:47.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.222+0000 7f990e0e4640 1 -- 172.21.15.50:0/1358999646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f990815ba90 con 0x7f99080d3c00 2024-09-11T22:24:47.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.223+0000 7f990e0e4640 1 -- 172.21.15.50:0/1358999646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99080d1190 con 0x7f99080d3c00 2024-09-11T22:24:47.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.224+0000 7f98effff640 1 -- 172.21.15.50:0/1358999646 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98fc011070 con 0x7f99080d3c00 2024-09-11T22:24:47.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.224+0000 7f98effff640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98f406be30 0x7f98f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.224+0000 7f98effff640 1 -- 172.21.15.50:0/1358999646 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f98fc08a790 con 0x7f99080d3c00 2024-09-11T22:24:47.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.224+0000 7f99077fe640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98f406be30 0x7f98f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.225+0000 7f99077fe640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98f406be30 0x7f98f406e2f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f98f8034000 tx=0x7f98f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:47.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.229+0000 7f98effff640 1 -- 172.21.15.50:0/1358999646 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99080cfa80 con 0x7f99080d3c00 2024-09-11T22:24:47.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.405+0000 7f990e0e4640 1 -- 172.21.15.50:0/1358999646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f99080ba2c0 con 0x7f99080d3c00 2024-09-11T22:24:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.408+0000 7f98effff640 1 -- 172.21.15.50:0/1358999646 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v50)=0 v50) ==== 123+0+0 (secure 0 0 0) 0x7f98fc00e280 con 0x7f99080d3c00 2024-09-11T22:24:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.408+0000 7f98effff640 1 -- 172.21.15.50:0/1358999646 <== mon.0 v2:172.21.15.50:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f98fc058d40 con 0x7f99080d3c00 2024-09-11T22:24:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.410+0000 7f990e0e4640 1 -- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98f406be30 msgr2=0x7f98f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.410+0000 7f990e0e4640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98f406be30 0x7f98f406e2f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f98f8034000 tx=0x7f98f802e000 comp rx=0 tx=0).stop 2024-09-11T22:24:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.410+0000 7f990e0e4640 1 -- 172.21.15.50:0/1358999646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99080d3c00 msgr2=0x7f9908154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.410+0000 7f990e0e4640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99080d3c00 0x7f9908154a80 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00c460 tx=0x7f98fc00c920 comp rx=0 tx=0).stop 2024-09-11T22:24:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.410+0000 7f990e0e4640 1 -- 172.21.15.50:0/1358999646 shutdown_connections 2024-09-11T22:24:47.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.410+0000 7f990e0e4640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f98f406be30 0x7f98f406e2f0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.410+0000 7f990e0e4640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f990815e870 0x7f990815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.410+0000 7f990e0e4640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99080d3c00 0x7f9908154a80 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.410+0000 7f990e0e4640 1 --2- 172.21.15.50:0/1358999646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99080d16d0 0x7f9908155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.410+0000 7f990e0e4640 1 -- 172.21.15.50:0/1358999646 >> 172.21.15.50:0/1358999646 conn(0x7f99080727a0 msgr2=0x7f99080cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:47.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.410+0000 7f990e0e4640 1 -- 172.21.15.50:0/1358999646 shutdown_connections 2024-09-11T22:24:47.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.410+0000 7f990e0e4640 1 -- 172.21.15.50:0/1358999646 wait complete. 2024-09-11T22:24:47.422 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:24:47.422 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:24:47.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.523+0000 7f7c40e7b640 1 Processor -- start 2024-09-11T22:24:47.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.523+0000 7f7c40e7b640 1 -- start start 2024-09-11T22:24:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.524+0000 7f7c40e7b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7c3c06e0f0 0x7f7c3c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.524+0000 7f7c40e7b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c3c15b7e0 con 0x7f7c3c072e60 2024-09-11T22:24:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.524+0000 7f7c40e7b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c3c15f140 con 0x7f7c3c15b400 2024-09-11T22:24:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.524+0000 7f7c40e7b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7c3c15f420 con 0x7f7c3c06e0f0 2024-09-11T22:24:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.524+0000 7f7c3ad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7c3c072e60 0x7f7c3c0711c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49656/0 (socket says 172.21.15.50:49656) 2024-09-11T22:24:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.524+0000 7f7c3ad9d640 1 -- 172.21.15.50:0/3678605978 learned_addr learned my addr 172.21.15.50:0/3678605978 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-09-11T22:24:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.524+0000 7f7c39d9b640 1 --2- 172.21.15.50:0/3678605978 >> v2:172.21.15.77:3300/0 conn(0x7f7c3c06e0f0 0x7f7c3c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793596968 0 0) 0x7f7c3c15b7e0 con 0x7f7c3c072e60 2024-09-11T22:24:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c28003520 con 0x7f7c3c072e60 2024-09-11T22:24:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220694280 0 0) 0x7f7c3c15f140 con 0x7f7c3c15b400 2024-09-11T22:24:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c3c15b7e0 con 0x7f7c3c15b400 2024-09-11T22:24:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2024430626 0 0) 0x7f7c28003520 con 0x7f7c3c072e60 2024-09-11T22:24:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 >> v2:172.21.15.77:3300/0 conn(0x7f7c3c06e0f0 msgr2=0x7f7c3c06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 --2- 172.21.15.50:0/3678605978 >> v2:172.21.15.77:3300/0 conn(0x7f7c3c06e0f0 0x7f7c3c06d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 >> v1:172.21.15.77:6789/0 conn(0x7f7c3c15b400 legacy=0x7f7c3c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3c15f700 con 0x7f7c3c072e60 2024-09-11T22:24:47.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 196435441 0 0) 0x7f7c34001670 con 0x7f7c3c072e60 2024-09-11T22:24:47.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 >> v1:172.21.15.50:6789/0 conn(0x7f7c3c072e60 legacy=0x7f7c3c0711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 --2- 172.21.15.50:0/3678605978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c28003b40 0x7f7c28003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 --2- 172.21.15.50:0/3678605978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28004800 0x7f7c28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 --2- 172.21.15.50:0/3678605978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c280051c0 0x7f7c2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3c15f420 con 0x7f7c28004800 2024-09-11T22:24:47.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2800c040 con 0x7f7c28003b40 2024-09-11T22:24:47.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2800c240 con 0x7f7c280051c0 2024-09-11T22:24:47.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c39d9b640 1 --2- 172.21.15.50:0/3678605978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28004800 0x7f7c28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3a59c640 1 --2- 172.21.15.50:0/3678605978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c28003b40 0x7f7c28003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3ad9d640 1 --2- 172.21.15.50:0/3678605978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c280051c0 0x7f7c2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c39d9b640 1 -- 172.21.15.50:0/3678605978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c280051c0 msgr2=0x7f7c2800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:47.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c39d9b640 1 --2- 172.21.15.50:0/3678605978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c280051c0 0x7f7c2800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c39d9b640 1 -- 172.21.15.50:0/3678605978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c28003b40 msgr2=0x7f7c28003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:47.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c39d9b640 1 --2- 172.21.15.50:0/3678605978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c28003b40 0x7f7c28003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c39d9b640 1 -- 172.21.15.50:0/3678605978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c28003520 con 0x7f7c28004800 2024-09-11T22:24:47.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.525+0000 7f7c3ad9d640 1 -- 172.21.15.50:0/3678605978 reap_dead start 2024-09-11T22:24:47.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.526+0000 7f7c39d9b640 1 --2- 172.21.15.50:0/3678605978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28004800 0x7f7c28004c80 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009aa0 tx=0x7f7c28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b345e5e196d99cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:47.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.526+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c24036070 con 0x7f7c28004800 2024-09-11T22:24:47.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.526+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7c24031400 con 0x7f7c28004800 2024-09-11T22:24:47.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.526+0000 7f7c3959a640 1 -- 172.21.15.50:0/3678605978 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c24009670 con 0x7f7c28004800 2024-09-11T22:24:47.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.527+0000 7f7c40e7b640 1 -- 172.21.15.50:0/3678605978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28004800 msgr2=0x7f7c28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.527+0000 7f7c40e7b640 1 --2- 172.21.15.50:0/3678605978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28004800 0x7f7c28004c80 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009aa0 tx=0x7f7c28005830 comp rx=0 tx=0).stop 2024-09-11T22:24:47.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.527+0000 7f7c40e7b640 1 -- 172.21.15.50:0/3678605978 shutdown_connections 2024-09-11T22:24:47.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.527+0000 7f7c40e7b640 1 --2- 172.21.15.50:0/3678605978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28004800 0x7f7c28004c80 unknown :-1 s=CLOSED pgs=2421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.527+0000 7f7c40e7b640 1 -- 172.21.15.50:0/3678605978 >> 172.21.15.50:0/3678605978 conn(0x7f7c3c0679c0 msgr2=0x7f7c3c067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:47.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.527+0000 7f7c40e7b640 1 -- 172.21.15.50:0/3678605978 shutdown_connections 2024-09-11T22:24:47.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.527+0000 7f7c40e7b640 1 -- 172.21.15.50:0/3678605978 wait complete. 2024-09-11T22:24:47.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.528+0000 7f7c40e7b640 1 Processor -- start 2024-09-11T22:24:47.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.528+0000 7f7c40e7b640 1 -- start start 2024-09-11T22:24:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c40e7b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28004800 0x7f7c3c14acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c40e7b640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c3c15a9a0 0x7f7c3c157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c40e7b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c3c157ff0 0x7f7c3c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c40e7b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3c06d070 con 0x7f7c28004800 2024-09-11T22:24:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c40e7b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3c0cfc50 con 0x7f7c3c157ff0 2024-09-11T22:24:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c40e7b640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3c06d1f0 con 0x7f7c3c15a9a0 2024-09-11T22:24:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c3a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28004800 0x7f7c3c14acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c3a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28004800 0x7f7c3c14acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56908/0 (socket says 172.21.15.50:56908) 2024-09-11T22:24:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c3a59c640 1 -- 172.21.15.50:0/4179063442 learned_addr learned my addr 172.21.15.50:0/4179063442 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-11T22:24:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c39d9b640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c3c15a9a0 0x7f7c3c157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c3ad9d640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c3c157ff0 0x7f7c3c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c3a59c640 1 -- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c3c15a9a0 msgr2=0x7f7c3c157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c3a59c640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c3c15a9a0 0x7f7c3c157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c3a59c640 1 -- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c3c157ff0 msgr2=0x7f7c3c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c3a59c640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c3c157ff0 0x7f7c3c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.529+0000 7f7c3a59c640 1 -- 172.21.15.50:0/4179063442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3c1584b0 con 0x7f7c28004800 2024-09-11T22:24:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.530+0000 7f7c3a59c640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28004800 0x7f7c3c14acd0 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00fb10 tx=0x7f7c2c00ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.530+0000 7f7c32ffd640 1 -- 172.21.15.50:0/4179063442 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c01a070 con 0x7f7c28004800 2024-09-11T22:24:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.530+0000 7f7c32ffd640 1 -- 172.21.15.50:0/4179063442 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7c2c006d60 con 0x7f7c28004800 2024-09-11T22:24:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.530+0000 7f7c40e7b640 1 -- 172.21.15.50:0/4179063442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3c159ec0 con 0x7f7c28004800 2024-09-11T22:24:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.530+0000 7f7c32ffd640 1 -- 172.21.15.50:0/4179063442 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c003bd0 con 0x7f7c28004800 2024-09-11T22:24:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.530+0000 7f7c40e7b640 1 -- 172.21.15.50:0/4179063442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c3c15a480 con 0x7f7c28004800 2024-09-11T22:24:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.531+0000 7f7c40e7b640 1 -- 172.21.15.50:0/4179063442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c3c06d9e0 con 0x7f7c28004800 2024-09-11T22:24:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.531+0000 7f7c32ffd640 1 -- 172.21.15.50:0/4179063442 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c2c01d070 con 0x7f7c28004800 2024-09-11T22:24:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.532+0000 7f7c32ffd640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c1c06be30 0x7f7c1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.532+0000 7f7c32ffd640 1 -- 172.21.15.50:0/4179063442 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f7c2c08a5c0 con 0x7f7c28004800 2024-09-11T22:24:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.532+0000 7f7c39d9b640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c1c06be30 0x7f7c1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.533+0000 7f7c39d9b640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c1c06be30 0x7f7c1c06e2f0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f7c24033000 tx=0x7f7c24008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.537+0000 7f7c32ffd640 1 -- 172.21.15.50:0/4179063442 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c2c058b90 con 0x7f7c28004800 2024-09-11T22:24:47.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.749+0000 7f7c40e7b640 1 -- 172.21.15.50:0/4179063442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c3c06c030 con 0x7f7c28004800 2024-09-11T22:24:47.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.749+0000 7f7c32ffd640 1 -- 172.21.15.50:0/4179063442 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 139 v139) ==== 95+0+3911 (secure 0 0 0) 0x7f7c2c05ce90 con 0x7f7c28004800 2024-09-11T22:24:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-11T22:24:47.751 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":139,"btime":"2024-09-11T22:24:16:002318+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8441,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/15411963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":15411963},{"type":"v1","addr":"172.21.15.50:6833","nonce":15411963}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":8450,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1953468151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1953468151},{"type":"v1","addr":"172.21.15.77:6836","nonce":1953468151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":8453,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3577421742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3577421742},{"type":"v1","addr":"172.21.15.77:6837","nonce":3577421742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":11067,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2000635956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2000635956},{"type":"v1","addr":"172.21.15.50:6835","nonce":2000635956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139}],"filesystems":[]} 2024-09-11T22:24:47.751 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 139 2024-09-11T22:24:47.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.751+0000 7f7c40e7b640 1 -- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c1c06be30 msgr2=0x7f7c1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.751+0000 7f7c40e7b640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c1c06be30 0x7f7c1c06e2f0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f7c24033000 tx=0x7f7c24008030 comp rx=0 tx=0).stop 2024-09-11T22:24:47.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.751+0000 7f7c40e7b640 1 -- 172.21.15.50:0/4179063442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28004800 msgr2=0x7f7c3c14acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:47.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.751+0000 7f7c40e7b640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28004800 0x7f7c3c14acd0 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00fb10 tx=0x7f7c2c00ff10 comp rx=0 tx=0).stop 2024-09-11T22:24:47.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.751+0000 7f7c40e7b640 1 -- 172.21.15.50:0/4179063442 shutdown_connections 2024-09-11T22:24:47.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.751+0000 7f7c40e7b640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:6832/2944691311,v1:172.21.15.77:6833/2944691311] conn(0x7f7c1c06be30 0x7f7c1c06e2f0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.751+0000 7f7c40e7b640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c3c15a9a0 0x7f7c3c157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.751+0000 7f7c40e7b640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c3c157ff0 0x7f7c3c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.751+0000 7f7c40e7b640 1 --2- 172.21.15.50:0/4179063442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28004800 0x7f7c3c14acd0 unknown :-1 s=CLOSED pgs=2422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:47.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.751+0000 7f7c40e7b640 1 -- 172.21.15.50:0/4179063442 >> 172.21.15.50:0/4179063442 conn(0x7f7c3c0679c0 msgr2=0x7f7c3c0cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:47.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.751+0000 7f7c40e7b640 1 -- 172.21.15.50:0/4179063442 shutdown_connections 2024-09-11T22:24:47.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-11T22:24:47.751+0000 7f7c40e7b640 1 -- 172.21.15.50:0/4179063442 wait complete. 2024-09-11T22:24:47.763 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-11T22:24:47.763 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T22:24:47.763 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:24:47.763 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:47.772 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:24:47.773 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:24:47.773 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:47.822 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:24:47.822 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:24:47.822 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:47.834 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:24:47.834 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:24:47.834 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:47.886 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:24:47.886 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T22:24:47.886 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T22:24:47.886 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:47.924 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T22:24:47.924 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T22:24:47.924 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:47.998 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T22:24:47.998 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T22:24:47.998 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:48.066 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T22:24:48.066 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T22:24:48.066 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:48.134 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T22:24:48.135 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-11T22:24:48.135 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:48.169 INFO:tasks.ceph.osd.4:Stopped 2024-09-11T22:24:48.170 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-11T22:24:48.170 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:48.241 INFO:tasks.ceph.osd.5:Stopped 2024-09-11T22:24:48.242 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-11T22:24:48.242 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:48.319 INFO:tasks.ceph.osd.6:Stopped 2024-09-11T22:24:48.319 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-11T22:24:48.319 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:48.398 INFO:tasks.ceph.osd.7:Stopped 2024-09-11T22:24:48.398 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T22:24:48.399 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-11T22:24:48.399 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:48.424 INFO:tasks.ceph.mgr.y:Stopped 2024-09-11T22:24:48.425 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T22:24:48.425 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:48.466 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T22:24:48.467 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T22:24:48.467 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:24:48.467 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:48.479 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:24:48.480 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T22:24:48.480 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:48.519 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T22:24:48.519 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-11T22:24:48.520 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:24:48.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-11T22:24:48.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-11T22:24:48.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-11T22:24:48.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-11T22:24:48.572 INFO:tasks.ceph.mon.c:Stopped 2024-09-11T22:24:48.572 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T22:24:48.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-09-11T22:24:48.609 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:24:48.610 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T22:24:48.876 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:24:48.876 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T22:24:48.992 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:24:48.992 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T22:24:49.064 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:24:49.065 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T22:24:49.124 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-11T22:24:49.124 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-11T22:24:49.306 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-11T22:24:49.306 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-11T22:24:49.390 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-11T22:24:49.391 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-11T22:24:49.449 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-11T22:24:49.449 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-11T22:24:49.489 INFO:tasks.ceph:Archiving mon data... 2024-09-11T22:24:49.491 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901414/data/mon.a.tgz 2024-09-11T22:24:49.491 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-11T22:24:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.t8xLmmEpq6 2024-09-11T22:24:49.508 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.t8xLmmEpq6 2024-09-11T22:24:49.692 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.t8xLmmEpq6 2024-09-11T22:24:49.776 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.t8xLmmEpq6 is 517KB 2024-09-11T22:24:49.847 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.t8xLmmEpq6 2024-09-11T22:24:49.863 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901414/data/mon.b.tgz 2024-09-11T22:24:49.864 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-09-11T22:24:49.881 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.SSbDYvQ05r 2024-09-11T22:24:49.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.SSbDYvQ05r 2024-09-11T22:24:50.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.SSbDYvQ05r 2024-09-11T22:24:50.134 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.SSbDYvQ05r is 525KB 2024-09-11T22:24:50.204 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.SSbDYvQ05r 2024-09-11T22:24:50.219 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901414/data/mon.c.tgz 2024-09-11T22:24:50.219 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-09-11T22:24:50.275 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.76Orwl62Io 2024-09-11T22:24:50.275 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.76Orwl62Io 2024-09-11T22:24:50.433 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.76Orwl62Io 2024-09-11T22:24:50.517 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.76Orwl62Io is 525KB 2024-09-11T22:24:50.614 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.76Orwl62Io 2024-09-11T22:24:50.629 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T22:24:50.630 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T22:24:50.633 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T22:24:50.714 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T22:24:50.751 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T22:24:50.751 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T22:24:50.753 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901414/remote/smithi050/crash 2024-09-11T22:24:50.754 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T22:24:50.781 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901414/remote/smithi077/crash 2024-09-11T22:24:50.782 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T22:24:50.814 INFO:tasks.ceph:Shutting down logrotate 2024-09-11T22:24:50.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:24:50.825 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:24:50.926 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-11T22:24:50.951 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-11T22:24:50.976 INFO:tasks.ceph:Compressing logs... 2024-09-11T22:24:50.976 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T22:24:50.994 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T22:24:51.017 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T22:24:51.017 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99652.log 2024-09-11T22:24:51.018 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54081.log 2024-09-11T22:24:51.055 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42790.log 2024-09-11T22:24:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36845.log 2024-09-11T22:24:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.3.42790.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-11T22:24:51.056 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42790.log.gz 2024-09-11T22:24:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36714.log 2024-09-11T22:24:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.7.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36845.log.gz 2024-09-11T22:24:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-11T22:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36885.log 2024-09-11T22:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mds.b.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.36714.log.gz 2024-09-11T22:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-11T22:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36885.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T22:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.4.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36885.log.gz 2024-09-11T22:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42393.log 2024-09-11T22:24:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-11T22:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.1.42393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42393.log.gz 2024-09-11T22:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36594.log 2024-09-11T22:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36797.log 2024-09-11T22:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.36594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36754.log 2024-09-11T22:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36594.log.gz 2024-09-11T22:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36797.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-11T22:24:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36754.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36797.log.gz 2024-09-11T22:24:51.059 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-11T22:24:51.059 INFO:teuthology.orchestra.run.smithi077.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36754.log.gz 2024-09-11T22:24:51.059 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36634.log 2024-09-11T22:24:51.059 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T22:24:51.059 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36634.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36634.log.gz 2024-09-11T22:24:51.059 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-11T22:24:51.059 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.log: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T22:24:51.059 INFO:teuthology.orchestra.run.smithi077.stderr: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T22:24:51.060 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T22:24:51.060 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36674.log 2024-09-11T22:24:51.067 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-11T22:24:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36674.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36674.log.gz 2024-09-11T22:24:51.326 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mon.b.log: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T22:24:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55129.log 2024-09-11T22:24:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.99652.log: /var/log/ceph/ceph-client.admin.54081.log: gzip -5 --verbose -- 89.2% /var/log/ceph/ceph-client.admin.66562.log 2024-09-11T22:24:51.386 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99652.log.gz 2024-09-11T22:24:51.386 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54081.log.gz 2024-09-11T22:24:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58311.log 2024-09-11T22:24:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55129.log: /var/log/ceph/ceph-client.admin.66562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101650.log 2024-09-11T22:24:51.387 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55129.log.gz 2024-09-11T22:24:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58311.log: gzip -5 87.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.66562.log.gz 2024-09-11T22:24:51.387 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.66478.log 2024-09-11T22:24:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56376.log 2024-09-11T22:24:51.387 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58311.log.gz 2024-09-11T22:24:51.387 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101650.log.gz 2024-09-11T22:24:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95984.log 2024-09-11T22:24:51.388 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66478.log.gz 2024-09-11T22:24:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86316.log 2024-09-11T22:24:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80824.log 2024-09-11T22:24:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86316.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95984.log.gz 2024-09-11T22:24:51.388 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56376.log.gz 2024-09-11T22:24:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105814.log 2024-09-11T22:24:51.389 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86316.log.gz 2024-09-11T22:24:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.80824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86479.log 2024-09-11T22:24:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60226.log 2024-09-11T22:24:51.389 INFO:teuthology.orchestra.run.smithi050.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.80824.log.gz 2024-09-11T22:24:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95848.log 2024-09-11T22:24:51.389 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105814.log.gz 2024-09-11T22:24:51.389 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86479.log.gz 2024-09-11T22:24:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104088.log 2024-09-11T22:24:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60386.log 2024-09-11T22:24:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95848.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60226.log.gz 2024-09-11T22:24:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104088.log: gzip -5 --verbose 88.9% -- -- replaced with /var/log/ceph/ceph-client.admin.95848.log.gz /var/log/ceph/ceph-client.admin.93239.log 2024-09-11T22:24:51.390 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.390 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104088.log.gz 2024-09-11T22:24:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100787.log 2024-09-11T22:24:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.93239.log: gzip -5 --verbose 89.0% -- -- replaced with /var/log/ceph/ceph-client.admin.60386.log.gz /var/log/ceph/ceph-client.admin.65317.log 2024-09-11T22:24:51.390 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45348.log 2024-09-11T22:24:51.391 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93239.log.gz 2024-09-11T22:24:51.391 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100787.log.gz 2024-09-11T22:24:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101436.log 2024-09-11T22:24:51.391 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65317.log.gz 2024-09-11T22:24:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106464.log 2024-09-11T22:24:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101436.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45348.log.gz 2024-09-11T22:24:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77317.log 2024-09-11T22:24:51.391 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101436.log.gz 2024-09-11T22:24:51.392 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65046.log 2024-09-11T22:24:51.392 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.106464.log.gz/var/log/ceph/ceph-client.admin.77317.log: 2024-09-11T22:24:51.392 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59389.log 2024-09-11T22:24:51.392 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65046.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77317.log.gz 2024-09-11T22:24:51.392 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83057.log 2024-09-11T22:24:51.392 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65046.log.gz 2024-09-11T22:24:51.392 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77546.log 2024-09-11T22:24:51.392 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59389.log.gz 2024-09-11T22:24:51.392 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62835.log 2024-09-11T22:24:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77546.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.83057.log.gz 2024-09-11T22:24:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44871.log 2024-09-11T22:24:51.393 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.77546.log.gz 2024-09-11T22:24:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41935.log 2024-09-11T22:24:51.393 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62835.log.gz/var/log/ceph/ceph-client.admin.44871.log: 2024-09-11T22:24:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40964.log 2024-09-11T22:24:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41935.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44871.log.gz 2024-09-11T22:24:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63091.log 2024-09-11T22:24:51.394 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41935.log.gz 2024-09-11T22:24:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90444.log 2024-09-11T22:24:51.394 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40964.log.gz 2024-09-11T22:24:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96152.log 2024-09-11T22:24:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90444.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63091.log.gz 2024-09-11T22:24:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.104892.log 2024-09-11T22:24:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103566.log 2024-09-11T22:24:51.394 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.90444.log.gz 2024-09-11T22:24:51.395 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96152.log.gz 2024-09-11T22:24:51.395 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.104892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81271.log 2024-09-11T22:24:51.395 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.104892.log.gz 2024-09-11T22:24:51.395 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54877.log 2024-09-11T22:24:51.395 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103566.log.gz 2024-09-11T22:24:51.395 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.81271.log: /var/log/ceph/ceph-client.admin.85449.log 2024-09-11T22:24:51.395 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45598.log 2024-09-11T22:24:51.395 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81271.log.gz 2024-09-11T22:24:51.396 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54877.log: /var/log/ceph/ceph-client.admin.85449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61893.log 2024-09-11T22:24:51.396 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54877.log.gz 2024-09-11T22:24:51.396 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.85449.log.gz 2024-09-11T22:24:51.396 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45724.log 2024-09-11T22:24:51.396 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46077.log 2024-09-11T22:24:51.396 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61893.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45598.log.gz 2024-09-11T22:24:51.396 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45724.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61893.log.gz -5 2024-09-11T22:24:51.396 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.68772.log 2024-09-11T22:24:51.397 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45724.log.gz 2024-09-11T22:24:51.397 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82242.log 2024-09-11T22:24:51.397 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53237.log 2024-09-11T22:24:51.397 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46077.log.gz 2024-09-11T22:24:51.397 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68772.log.gz 2024-09-11T22:24:51.397 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101986.log 2024-09-11T22:24:51.397 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.82242.log.gz 2024-09-11T22:24:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86521.log 2024-09-11T22:24:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65275.log 2024-09-11T22:24:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44161.log 2024-09-11T22:24:51.398 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53237.log.gz 2024-09-11T22:24:51.398 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.101986.log.gz 2024-09-11T22:24:51.398 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.86521.log.gz 2024-09-11T22:24:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60570.log 2024-09-11T22:24:51.398 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65275.log.gz 2024-09-11T22:24:51.399 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90810.log 2024-09-11T22:24:51.399 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91031.log 2024-09-11T22:24:51.399 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44161.log.gz 2024-09-11T22:24:51.399 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61622.log 2024-09-11T22:24:51.399 INFO:teuthology.orchestra.run.smithi050.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60570.log.gz 2024-09-11T22:24:51.399 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91031.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.90810.log.gz 2024-09-11T22:24:51.399 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95297.log 2024-09-11T22:24:51.399 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61622.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.91031.log.gz 2024-09-11T22:24:51.400 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91209.log 2024-09-11T22:24:51.400 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61622.log.gz 2024-09-11T22:24:51.400 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69928.log 2024-09-11T22:24:51.400 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95297.log.gz 2024-09-11T22:24:51.400 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70308.log 2024-09-11T22:24:51.400 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77672.log 2024-09-11T22:24:51.400 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91209.log.gz 2024-09-11T22:24:51.400 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69928.log.gz 2024-09-11T22:24:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.70308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70308.log.gz 2024-09-11T22:24:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70120.log 2024-09-11T22:24:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101254.log 2024-09-11T22:24:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77672.log: /var/log/ceph/ceph-client.admin.70120.log: gzip 88.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.77672.log.gz -- 2024-09-11T22:24:51.401 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.61107.log 2024-09-11T22:24:51.401 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8%/var/log/ceph/ceph-client.admin.101254.log: -- replaced with /var/log/ceph/ceph-client.admin.70120.log.gz 2024-09-11T22:24:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84957.log 2024-09-11T22:24:51.401 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101254.log.gz 2024-09-11T22:24:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.61107.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.100390.log 2024-09-11T22:24:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77810.log 2024-09-11T22:24:51.402 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61107.log.gz 2024-09-11T22:24:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65232.log 2024-09-11T22:24:51.402 INFO:teuthology.orchestra.run.smithi050.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100390.log.gz 2024-09-11T22:24:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77810.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.84957.log.gz 2024-09-11T22:24:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87425.log 2024-09-11T22:24:51.402 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77810.log.gz 2024-09-11T22:24:51.403 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45989.log 2024-09-11T22:24:51.403 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65232.log.gz 2024-09-11T22:24:51.403 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86012.log 2024-09-11T22:24:51.403 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87425.log: /var/log/ceph/ceph-client.admin.45989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77367.log 2024-09-11T22:24:51.403 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.87425.log.gz 2024-09-11T22:24:51.403 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45989.log.gz 2024-09-11T22:24:51.403 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68940.log 2024-09-11T22:24:51.403 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86012.log.gz 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55321.log 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68940.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77367.log.gz 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65587.log 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68940.log.gz 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42607.log 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55321.log.gz 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103906.log 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42607.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65587.log.gz 2024-09-11T22:24:51.405 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97416.log 2024-09-11T22:24:51.405 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42607.log.gz 2024-09-11T22:24:51.405 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92049.log 2024-09-11T22:24:51.405 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103906.log.gz 2024-09-11T22:24:51.405 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106884.log 2024-09-11T22:24:51.405 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92049.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97416.log.gz 2024-09-11T22:24:51.405 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87913.log 2024-09-11T22:24:51.405 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106884.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92049.log.gz 2024-09-11T22:24:51.405 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53087.log 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106884.log.gz 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77065.log 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53087.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.87913.log.gz 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95423.log 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78118.log 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77065.log.gz 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi050.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.53087.log.gz 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2024-09-11T22:24:51.407 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95423.log.gz 2024-09-11T22:24:51.407 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66310.log 2024-09-11T22:24:51.407 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42603.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78118.log.gz 2024-09-11T22:24:51.407 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77504.log 2024-09-11T22:24:51.407 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2024-09-11T22:24:51.407 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95339.log 2024-09-11T22:24:51.407 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77504.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66310.log.gz 2024-09-11T22:24:51.407 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93118.log 2024-09-11T22:24:51.408 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77504.log.gz 2024-09-11T22:24:51.408 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56479.log 2024-09-11T22:24:51.408 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95339.log.gz 2024-09-11T22:24:51.408 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.93118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81649.log 2024-09-11T22:24:51.408 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93118.log.gz 2024-09-11T22:24:51.408 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87295.log 2024-09-11T22:24:51.408 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100619.log 2024-09-11T22:24:51.408 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81649.log.gz 2024-09-11T22:24:51.408 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87295.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56479.log.gz 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87295.log.gz 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86689.log 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.1.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100619.log.gz 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58073.log 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92356.log 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86689.log.gz 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78859.log 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63007.log 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92356.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58073.log.gz 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78859.log: gzip -5 --verbose 88.1% -- -- replaced with /var/log/ceph/ceph-client.admin.92356.log.gz /var/log/ceph/ceph-client.admin.86274.log 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.78859.log.gz 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68207.log 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63007.log: /var/log/ceph/ceph-client.admin.86274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100050.log 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63007.log.gz 2024-09-11T22:24:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68207.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86274.log.gz 2024-09-11T22:24:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41068.log 2024-09-11T22:24:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80758.log 2024-09-11T22:24:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100050.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68207.log.gz 2024-09-11T22:24:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54505.log 2024-09-11T22:24:51.411 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.100050.log.gz 2024-09-11T22:24:51.411 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7%/var/log/ceph/ceph-client.admin.80758.log: -- replaced with /var/log/ceph/ceph-client.admin.41068.log.gz 2024-09-11T22:24:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66646.log 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63427.log 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54505.log.gz 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82465.log 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi050.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.80758.log.gz 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58834.log 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63427.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.66646.log.gz 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69760.log 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.63427.log.gz 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44455.log 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58834.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.82465.log.gz 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41936.log 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58834.log.gz 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69760.log.gz 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106103.log 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44455.log: /var/log/ceph/ceph-client.admin.41936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103042.log 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44455.log.gz 2024-09-11T22:24:51.414 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41936.log.gz 2024-09-11T22:24:51.414 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41933.log 2024-09-11T22:24:51.414 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103042.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106103.log.gz 2024-09-11T22:24:51.414 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65359.log 2024-09-11T22:24:51.414 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103042.log.gz 2024-09-11T22:24:51.414 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104704.log 2024-09-11T22:24:51.414 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41933.log: /var/log/ceph/ceph-client.admin.65359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101008.log 2024-09-11T22:24:51.414 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41933.log.gz 2024-09-11T22:24:51.414 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104704.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65359.log.gz 2024-09-11T22:24:51.415 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42608.log 2024-09-11T22:24:51.415 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100871.log 2024-09-11T22:24:51.415 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101008.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104704.log.gz 2024-09-11T22:24:51.415 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42608.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101008.log.gz 2024-09-11T22:24:51.415 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58666.log 2024-09-11T22:24:51.415 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42608.log.gz 2024-09-11T22:24:51.415 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67320.log 2024-09-11T22:24:51.415 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100871.log: /var/log/ceph/ceph-client.admin.58666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90040.log 2024-09-11T22:24:51.416 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100871.log.gz 2024-09-11T22:24:51.416 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58666.log.gz 2024-09-11T22:24:51.416 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.67320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66520.log 2024-09-11T22:24:51.416 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67320.log.gz 2024-09-11T22:24:51.416 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95667.log 2024-09-11T22:24:51.416 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90040.log: /var/log/ceph/ceph-client.admin.66520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57846.log 2024-09-11T22:24:51.416 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90040.log.gz 2024-09-11T22:24:51.416 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95667.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66520.log.gz 2024-09-11T22:24:51.417 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41587.log 2024-09-11T22:24:51.417 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95667.log.gz 2024-09-11T22:24:51.417 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63277.log 2024-09-11T22:24:51.417 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57846.log: /var/log/ceph/ceph-client.admin.41587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90552.log 2024-09-11T22:24:51.417 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57846.log.gz 2024-09-11T22:24:51.417 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63277.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41587.log.gz 2024-09-11T22:24:51.417 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103951.log 2024-09-11T22:24:51.417 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89908.log 2024-09-11T22:24:51.418 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90552.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63277.log.gz 2024-09-11T22:24:51.418 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103951.log: gzip -5 --verbose 89.3% -- -- replaced with /var/log/ceph/ceph-client.admin.90552.log.gz /var/log/ceph/ceph-client.admin.106061.log 2024-09-11T22:24:51.418 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.418 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103951.log.gz 2024-09-11T22:24:51.418 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.89908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102595.log 2024-09-11T22:24:51.418 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45513.log 2024-09-11T22:24:51.418 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102595.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106061.log.gz 2024-09-11T22:24:51.418 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70054.log 2024-09-11T22:24:51.418 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.89908.log.gz 2024-09-11T22:24:51.419 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87253.log 2024-09-11T22:24:51.419 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45513.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.102595.log.gz 2024-09-11T22:24:51.419 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.70054.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.45513.log.gz --verbose 2024-09-11T22:24:51.419 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.86358.log 2024-09-11T22:24:51.419 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102661.log 2024-09-11T22:24:51.419 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87253.log: /var/log/ceph/ceph-client.admin.86358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60493.log 2024-09-11T22:24:51.420 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% 91.3% -- replaced with /var/log/ceph/ceph-client.admin.70054.log.gz 2024-09-11T22:24:51.420 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87253.log.gz 2024-09-11T22:24:51.420 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45640.log 2024-09-11T22:24:51.420 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86358.log.gz 2024-09-11T22:24:51.420 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107220.log 2024-09-11T22:24:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60493.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.102661.log.gz 2024-09-11T22:24:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92133.log 2024-09-11T22:24:51.421 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60493.log.gz 2024-09-11T22:24:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63897.log 2024-09-11T22:24:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107220.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45640.log.gz 2024-09-11T22:24:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78793.log 2024-09-11T22:24:51.421 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107220.log.gz 2024-09-11T22:24:51.421 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92133.log.gz 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60694.log 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103398.log 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78793.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.63897.log.gz 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106380.log 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60694.log: /var/log/ceph/ceph-client.admin.103398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97668.log 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60694.log.gz 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.78793.log.gz 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103398.log.gz 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107136.log 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106380.log.gz 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45766.log 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97668.log: /var/log/ceph/ceph-client.admin.107136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59431.log 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107136.log.gz 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58792.log 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.97668.log.gz 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95753.log 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59431.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45766.log.gz 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91732.log 88.9% 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59431.log.gz 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58792.log.gz 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82286.log 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95753.log: /var/log/ceph/ceph-client.admin.91732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44413.log 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95753.log.gz 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91732.log.gz 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81691.log 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.82286.log.gz 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103440.log 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62751.log 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44413.log.gz 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81691.log.gz 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67481.log 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62751.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103440.log.gz 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43723.log 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62751.log.gz 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92091.log 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.67481.log: /var/log/ceph/ceph-client.admin.43723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95195.log 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67481.log.gz 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92091.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43723.log.gz 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54165.log 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105730.log 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92091.log.gz 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95195.log: /var/log/ceph/ceph-client.admin.54165.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95195.log.gz 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92780.log 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54165.log.gz 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61977.log 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105730.log: /var/log/ceph/ceph-client.admin.92780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90936.log 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105730.log.gz 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61977.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92780.log.gz 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60873.log 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61977.log.gz 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56677.log 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90936.log.gz 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92822.log 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60873.log: /var/log/ceph/ceph-client.admin.56677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61319.log 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60873.log.gz 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90210.log 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56677.log.gz 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92822.log.gz 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66100.log 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61319.log.gz 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41928.log 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90210.log: /var/log/ceph/ceph-client.admin.66100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46455.log 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.90210.log.gz 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66100.log.gz 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79047.log 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41293.log 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41928.log.gz 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46455.log: /var/log/ceph/ceph-client.0.79047.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46455.log.gz 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.79047.log.gz 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53422.log 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104260.log 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41293.log: /var/log/ceph/ceph-client.admin.53422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67120.log 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41293.log.gz 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104260.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53422.log.gz 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65545.log 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.67120.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104260.log.gz 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96110.log 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67120.log.gz 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67650.log 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65545.log: /var/log/ceph/ceph-client.admin.96110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44566.log 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65545.log.gz 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.67650.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96110.log.gz 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57214.log 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 88.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.67650.log.gz /var/log/ceph/ceph-client.admin.59683.log 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44566.log: /var/log/ceph/ceph-client.admin.57214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59557.log 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44566.log.gz 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90294.log 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59683.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.57214.log.gz 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59557.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59683.log.gz 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95942.log 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59557.log.gz 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42847.log 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90294.log: /var/log/ceph/ceph-client.admin.95942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81996.log 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.90294.log.gz 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95942.log.gz 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44734.log 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42847.log.gz 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86232.log 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81996.log: /var/log/ceph/ceph-client.admin.44734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104554.log 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81996.log.gz 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44734.log.gz 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91869.log 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86232.log.gz 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44955.log 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104554.log: /var/log/ceph/ceph-client.admin.91869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103084.log 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104554.log.gz 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44955.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91869.log.gz 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56423.log 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44955.log.gz 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77107.log 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103084.log: /var/log/ceph/ceph-client.admin.56423.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103084.log.gz 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42265.log 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56423.log.gz 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106018.log 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77107.log: /var/log/ceph/ceph-client.admin.42265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90852.log 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77107.log.gz 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81355.log 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42265.log.gz 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106018.log.gz 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61851.log 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.90852.log.gz 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41755.log 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81355.log: /var/log/ceph/ceph-client.admin.61851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68092.log 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.81355.log.gz 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61851.log.gz 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96483.log 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61935.log 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68092.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41755.log.gz 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96483.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68092.log.gz 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82949.log 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96483.log.gz 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66352.log 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61935.log: /var/log/ceph/ceph-client.admin.82949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41163.log 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61935.log.gz 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.82949.log.gz 2024-09-11T22:24:51.439 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106674.log 2024-09-11T22:24:51.439 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66352.log.gz 2024-09-11T22:24:51.439 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45556.log 2024-09-11T22:24:51.439 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41163.log.gz 2024-09-11T22:24:51.439 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81313.log 2024-09-11T22:24:51.439 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106674.log: /var/log/ceph/ceph-client.admin.45556.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106674.log.gz 2024-09-11T22:24:51.439 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55509.log 2024-09-11T22:24:51.440 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45556.log.gz 2024-09-11T22:24:51.440 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60693.log 2024-09-11T22:24:51.440 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.55509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100474.log 2024-09-11T22:24:51.440 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55509.log.gz 2024-09-11T22:24:51.440 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81313.log.gz 2024-09-11T22:24:51.441 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104344.log 2024-09-11T22:24:51.441 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100474.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60693.log.gz 2024-09-11T22:24:51.441 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87763.log 2024-09-11T22:24:51.441 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.104344.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41934.log 2024-09-11T22:24:51.441 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100474.log.gz 2024-09-11T22:24:51.441 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87763.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104344.log.gz 2024-09-11T22:24:51.441 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66394.log 2024-09-11T22:24:51.442 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87763.log.gz 2024-09-11T22:24:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63133.log 2024-09-11T22:24:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41934.log: /var/log/ceph/ceph-client.admin.66394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97584.log 2024-09-11T22:24:51.442 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41934.log.gz 2024-09-11T22:24:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63133.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66394.log.gz 2024-09-11T22:24:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57954.log 2024-09-11T22:24:51.442 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63133.log.gz 2024-09-11T22:24:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62145.log 2024-09-11T22:24:51.443 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64298.log 2024-09-11T22:24:51.443 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97584.log.gz 2024-09-11T22:24:51.443 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57954.log: /var/log/ceph/ceph-client.admin.62145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68333.log 2024-09-11T22:24:51.443 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62145.log.gz 2024-09-11T22:24:51.443 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42266.log 2024-09-11T22:24:51.443 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57954.log.gz 2024-09-11T22:24:51.443 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97248.log 2024-09-11T22:24:51.443 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64298.log.gz 2024-09-11T22:24:51.443 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42266.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68333.log.gz 2024-09-11T22:24:51.444 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78541.log 2024-09-11T22:24:51.444 INFO:teuthology.orchestra.run.smithi050.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42266.log.gz 2024-09-11T22:24:51.444 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95153.log 2024-09-11T22:24:51.444 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59263.log 2024-09-11T22:24:51.444 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1%/var/log/ceph/ceph-client.admin.78541.log: -- replaced with /var/log/ceph/ceph-client.admin.97248.log.gz 2024-09-11T22:24:51.444 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95153.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78541.log.gz 2024-09-11T22:24:51.444 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46287.log 2024-09-11T22:24:51.444 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95153.log.gz 2024-09-11T22:24:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92864.log 2024-09-11T22:24:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59263.log: /var/log/ceph/ceph-client.admin.46287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81397.log 2024-09-11T22:24:51.445 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59263.log.gz 2024-09-11T22:24:51.445 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46287.log.gz 2024-09-11T22:24:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54729.log 2024-09-11T22:24:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93197.log 2024-09-11T22:24:51.445 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.92864.log.gz 2024-09-11T22:24:51.445 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81397.log.gz 2024-09-11T22:24:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96026.log 2024-09-11T22:24:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53955.log 2024-09-11T22:24:51.446 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54729.log.gz 2024-09-11T22:24:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.93197.log: /var/log/ceph/ceph-client.admin.96026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92272.log 2024-09-11T22:24:51.446 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93197.log.gz 2024-09-11T22:24:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53955.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96026.log.gz 2024-09-11T22:24:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102445.log 2024-09-11T22:24:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53516.log 2024-09-11T22:24:51.447 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53955.log.gz 2024-09-11T22:24:51.447 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92272.log: /var/log/ceph/ceph-client.admin.102445.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92272.log.gz 2024-09-11T22:24:51.447 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104638.log 2024-09-11T22:24:51.447 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45682.log 2024-09-11T22:24:51.447 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53516.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.102445.log.gz 2024-09-11T22:24:51.447 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42264.log 2024-09-11T22:24:51.447 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53516.log.gz 2024-09-11T22:24:51.447 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81901.log 2024-09-11T22:24:51.448 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45682.log: /var/log/ceph/ceph-client.admin.42264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56194.log 2024-09-11T22:24:51.448 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.104638.log.gz 2024-09-11T22:24:51.448 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45682.log.gz 2024-09-11T22:24:51.448 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42264.log.gz 2024-09-11T22:24:51.448 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102511.log 2024-09-11T22:24:51.448 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78055.log 2024-09-11T22:24:51.448 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81901.log.gz 2024-09-11T22:24:51.448 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85665.log 2024-09-11T22:24:51.449 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0%/var/log/ceph/ceph-client.admin.78055.log: -- replaced with /var/log/ceph/ceph-client.admin.56194.log.gz 2024-09-11T22:24:51.449 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58395.log 2024-09-11T22:24:51.449 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.102511.log.gz 2024-09-11T22:24:51.449 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78055.log.gz 2024-09-11T22:24:51.449 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69077.log 2024-09-11T22:24:51.449 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87072.log 2024-09-11T22:24:51.450 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85665.log.gz 2024-09-11T22:24:51.450 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58395.log.gz 2024-09-11T22:24:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91648.log 2024-09-11T22:24:51.450 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69077.log.gz 2024-09-11T22:24:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45123.log 2024-09-11T22:24:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60953.log 2024-09-11T22:24:51.450 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87072.log.gz 2024-09-11T22:24:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91648.log: /var/log/ceph/ceph-client.admin.45123.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91648.log.gz 2024-09-11T22:24:51.451 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85197.log 2024-09-11T22:24:51.451 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45123.log.gz 2024-09-11T22:24:51.451 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97458.log 2024-09-11T22:24:51.451 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60953.log: /var/log/ceph/ceph-client.admin.85197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42973.log 2024-09-11T22:24:51.451 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60953.log.gz 2024-09-11T22:24:51.451 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85197.log.gz 2024-09-11T22:24:51.451 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46245.log 2024-09-11T22:24:51.451 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97458.log.gz 2024-09-11T22:24:51.452 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45810.log 2024-09-11T22:24:51.452 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42973.log.gz 2024-09-11T22:24:51.452 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86148.log 2024-09-11T22:24:51.452 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46245.log: /var/log/ceph/ceph-client.admin.45810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57888.log 2024-09-11T22:24:51.452 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46245.log.gz 2024-09-11T22:24:51.452 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7%/var/log/ceph/ceph-client.admin.86148.log: -- replaced with /var/log/ceph/ceph-client.admin.45810.log.gz 2024-09-11T22:24:51.452 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66226.log 2024-09-11T22:24:51.452 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86148.log.gz 2024-09-11T22:24:51.453 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65503.log 2024-09-11T22:24:51.453 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57888.log: /var/log/ceph/ceph-client.admin.66226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104046.log 2024-09-11T22:24:51.453 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65503.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66226.log.gz 2024-09-11T22:24:51.453 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66016.log 2024-09-11T22:24:51.453 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57888.log.gz 2024-09-11T22:24:51.453 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65503.log.gz 2024-09-11T22:24:51.453 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78667.log 2024-09-11T22:24:51.453 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104046.log: /var/log/ceph/ceph-client.admin.66016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77714.log 2024-09-11T22:24:51.453 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104046.log.gz 2024-09-11T22:24:51.454 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66016.log.gz 2024-09-11T22:24:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96315.log 2024-09-11T22:24:51.454 INFO:teuthology.orchestra.run.smithi050.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.78667.log.gz 2024-09-11T22:24:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100661.log 2024-09-11T22:24:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77714.log: /var/log/ceph/ceph-client.admin.96315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85833.log 2024-09-11T22:24:51.454 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77714.log.gz 2024-09-11T22:24:51.454 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96315.log.gz 2024-09-11T22:24:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100661.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T22:24:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59175.log 2024-09-11T22:24:51.455 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100661.log.gz 2024-09-11T22:24:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85833.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85833.log.gz 2024-09-11T22:24:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61580.log 2024-09-11T22:24:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57526.log 2024-09-11T22:24:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59175.log: /var/log/ceph/ceph-client.admin.61580.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59175.log.gz -5 2024-09-11T22:24:51.455 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.101212.log 2024-09-11T22:24:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57526.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61580.log.gz 2024-09-11T22:24:51.456 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67321.log 2024-09-11T22:24:51.456 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87467.log 2024-09-11T22:24:51.456 INFO:teuthology.orchestra.run.smithi050.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.57526.log.gz 2024-09-11T22:24:51.456 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.67321.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101212.log.gz 2024-09-11T22:24:51.456 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90660.log 2024-09-11T22:24:51.456 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67321.log.gz 2024-09-11T22:24:51.456 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97164.log 2024-09-11T22:24:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90660.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87467.log.gz 2024-09-11T22:24:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82553.log 2024-09-11T22:24:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87635.log 2024-09-11T22:24:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82553.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97164.log.gz 2024-09-11T22:24:51.457 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.90660.log.gz 2024-09-11T22:24:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53642.log 2024-09-11T22:24:51.457 INFO:teuthology.orchestra.run.smithi050.stderr: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T22:24:51.457 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.82553.log.gz 2024-09-11T22:24:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69462.log 2024-09-11T22:24:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87635.log: /var/log/ceph/ceph-client.admin.53642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64406.log 2024-09-11T22:24:51.458 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87635.log.gz 2024-09-11T22:24:51.458 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53642.log.gz 2024-09-11T22:24:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66900.log 2024-09-11T22:24:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85791.log 2024-09-11T22:24:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64406.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69462.log.gz 2024-09-11T22:24:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.66900.log: gzip -5 --verbose 89.3% -- -- replaced with /var/log/ceph/ceph-client.admin.64406.log.gz /var/log/ceph/ceph-client.admin.95381.log 2024-09-11T22:24:51.459 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.459 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66900.log.gz 2024-09-11T22:24:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.85791.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.103168.log 2024-09-11T22:24:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45226.log 2024-09-11T22:24:51.459 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85791.log.gz 2024-09-11T22:24:51.459 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95381.log.gz 2024-09-11T22:24:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85323.log 2024-09-11T22:24:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45226.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103168.log.gz 2024-09-11T22:24:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85023.log 2024-09-11T22:24:51.460 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45226.log.gz 2024-09-11T22:24:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77890.log 2024-09-11T22:24:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85323.log: /var/log/ceph/ceph-client.admin.85023.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.85323.log.gz -5 2024-09-11T22:24:51.460 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.64962.log 2024-09-11T22:24:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87847.log 2024-09-11T22:24:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77890.log: /var/log/ceph/ceph-client.admin.64962.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.85023.log.gz 2024-09-11T22:24:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36513.log 2024-09-11T22:24:51.461 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77890.log.gz 2024-09-11T22:24:51.461 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64962.log.gz 2024-09-11T22:24:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87805.log 2024-09-11T22:24:51.461 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105856.log 2024-09-11T22:24:51.461 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36513.log.gz 2024-09-11T22:24:51.462 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.87847.log.gz 2024-09-11T22:24:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92930.log 2024-09-11T22:24:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105856.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87805.log.gz 2024-09-11T22:24:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61538.log 2024-09-11T22:24:51.462 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105856.log.gz 2024-09-11T22:24:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59851.log 2024-09-11T22:24:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92930.log: /var/log/ceph/ceph-client.admin.61538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70387.log 2024-09-11T22:24:51.463 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92930.log.gz 2024-09-11T22:24:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59851.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61538.log.gz 2024-09-11T22:24:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69546.log 2024-09-11T22:24:51.463 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59851.log.gz 2024-09-11T22:24:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.70387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59767.log 2024-09-11T22:24:51.463 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70387.log.gz 2024-09-11T22:24:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99920.log 2024-09-11T22:24:51.464 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69546.log.gz 2024-09-11T22:24:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82511.log 2024-09-11T22:24:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105940.log 2024-09-11T22:24:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.99920.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59767.log.gz 2024-09-11T22:24:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96068.log 2024-09-11T22:24:51.464 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.99920.log.gz 2024-09-11T22:24:51.464 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.82511.log.gz 2024-09-11T22:24:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.105940.log: -- /var/log/ceph/ceph-client.admin.53600.log 2024-09-11T22:24:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96068.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105940.log.gz 2024-09-11T22:24:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56611.log 2024-09-11T22:24:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104302.log 2024-09-11T22:24:51.465 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96068.log.gz 2024-09-11T22:24:51.465 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53600.log: /var/log/ceph/ceph-client.admin.56611.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53600.log.gz 2024-09-11T22:24:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68646.log 2024-09-11T22:24:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78709.log 2024-09-11T22:24:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104302.log: /var/log/ceph/ceph-client.admin.68646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107178.log 2024-09-11T22:24:51.466 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104302.log.gz 2024-09-11T22:24:51.466 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56611.log.gz 2024-09-11T22:24:51.466 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68646.log.gz 2024-09-11T22:24:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100574.log 2024-09-11T22:24:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107178.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78709.log.gz 2024-09-11T22:24:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58437.log 2024-09-11T22:24:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63049.log 2024-09-11T22:24:51.467 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107178.log.gz 2024-09-11T22:24:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100574.log: /var/log/ceph/ceph-client.admin.58437.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100574.log.gz 2024-09-11T22:24:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44329.log 2024-09-11T22:24:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46329.log 2024-09-11T22:24:51.467 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58437.log.gz 2024-09-11T22:24:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63049.log: /var/log/ceph/ceph-client.admin.44329.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63049.log.gz 2024-09-11T22:24:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82381.log 2024-09-11T22:24:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54340.log 2024-09-11T22:24:51.468 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44329.log.gz 2024-09-11T22:24:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46329.log: /var/log/ceph/ceph-client.admin.82381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61706.log 2024-09-11T22:24:51.468 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46329.log.gz 2024-09-11T22:24:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56851.log 2024-09-11T22:24:51.469 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.82381.log.gz 2024-09-11T22:24:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54340.log: /var/log/ceph/ceph-client.admin.61706.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54340.log.gz 2024-09-11T22:24:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53818.log 2024-09-11T22:24:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67604.log 2024-09-11T22:24:51.469 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56851.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61706.log.gz 2024-09-11T22:24:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61496.log 2024-09-11T22:24:51.470 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53818.log.gz 2024-09-11T22:24:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.67604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81523.log 2024-09-11T22:24:51.470 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56851.log.gz 2024-09-11T22:24:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81481.log 88.9% 2024-09-11T22:24:51.470 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67604.log.gz 2024-09-11T22:24:51.470 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61496.log.gz 2024-09-11T22:24:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105898.log 2024-09-11T22:24:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81523.log: /var/log/ceph/ceph-client.admin.81481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87030.log 2024-09-11T22:24:51.471 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81523.log.gz 2024-09-11T22:24:51.471 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81481.log.gz 2024-09-11T22:24:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104176.log 2024-09-11T22:24:51.471 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105898.log.gz 2024-09-11T22:24:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90168.log 2024-09-11T22:24:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53871.log 2024-09-11T22:24:51.472 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3%/var/log/ceph/ceph-client.admin.104176.log: -- replaced with /var/log/ceph/ceph-client.admin.87030.log.gz 2024-09-11T22:24:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90168.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104176.log.gz 2024-09-11T22:24:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102385.log 2024-09-11T22:24:51.472 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.90168.log.gz 2024-09-11T22:24:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87593.log 2024-09-11T22:24:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53871.log: /var/log/ceph/ceph-client.admin.102385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68898.log 2024-09-11T22:24:51.473 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53871.log.gz 2024-09-11T22:24:51.473 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87593.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102385.log.gz 2024-09-11T22:24:51.473 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100516.log 2024-09-11T22:24:51.473 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68898.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.87593.log.gz 2024-09-11T22:24:51.473 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91429.log 2024-09-11T22:24:51.473 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68898.log.gz 2024-09-11T22:24:51.474 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82847.log 2024-09-11T22:24:51.474 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100516.log: /var/log/ceph/ceph-client.admin.91429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69367.log 2024-09-11T22:24:51.474 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100516.log.gz 2024-09-11T22:24:51.474 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91429.log.gz 2024-09-11T22:24:51.474 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41927.log 2024-09-11T22:24:51.474 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42272.log 2024-09-11T22:24:51.475 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.82847.log.gz 2024-09-11T22:24:51.475 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69367.log: /var/log/ceph/ceph-client.admin.41927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67800.log 2024-09-11T22:24:51.475 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69367.log.gz 2024-09-11T22:24:51.475 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41927.log.gz 2024-09-11T22:24:51.475 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42931.log 2024-09-11T22:24:51.475 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42272.log: /var/log/ceph/ceph-client.admin.67800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92696.log 2024-09-11T22:24:51.476 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42272.log.gz 2024-09-11T22:24:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42931.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67800.log.gz 2024-09-11T22:24:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42606.log 2024-09-11T22:24:51.476 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42931.log.gz 2024-09-11T22:24:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41929.log 2024-09-11T22:24:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44371.log 2024-09-11T22:24:51.477 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92696.log.gz/var/log/ceph/ceph-client.admin.42606.log: 2024-09-11T22:24:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41929.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42606.log.gz 2024-09-11T22:24:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46563.log 2024-09-11T22:24:51.477 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41929.log.gz 2024-09-11T22:24:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44287.log 2024-09-11T22:24:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44371.log: /var/log/ceph/ceph-client.admin.46563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104386.log 2024-09-11T22:24:51.478 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44371.log.gz 2024-09-11T22:24:51.478 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44287.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46563.log.gz 2024-09-11T22:24:51.478 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101860.log 2024-09-11T22:24:51.478 INFO:teuthology.orchestra.run.smithi050.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44287.log.gz 2024-09-11T22:24:51.478 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55045.log 2024-09-11T22:24:51.478 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60695.log 2024-09-11T22:24:51.479 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3%/var/log/ceph/ceph-client.admin.101860.log: -- replaced with /var/log/ceph/ceph-client.admin.104386.log.gz 2024-09-11T22:24:51.479 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55045.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101860.log.gz 2024-09-11T22:24:51.479 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102822.log 2024-09-11T22:24:51.479 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55045.log.gz 2024-09-11T22:24:51.479 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41713.log 2024-09-11T22:24:51.479 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60695.log: /var/log/ceph/ceph-client.admin.102822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62187.log 2024-09-11T22:24:51.479 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60695.log.gz 2024-09-11T22:24:51.480 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41713.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102822.log.gz 2024-09-11T22:24:51.480 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78415.log 2024-09-11T22:24:51.480 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41713.log.gz 2024-09-11T22:24:51.480 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91690.log 2024-09-11T22:24:51.480 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55213.log 2024-09-11T22:24:51.480 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62187.log.gz 2024-09-11T22:24:51.480 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78415.log: /var/log/ceph/ceph-client.admin.91690.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78415.log.gz 2024-09-11T22:24:51.481 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57396.log 2024-09-11T22:24:51.481 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91690.log.gz 2024-09-11T22:24:51.481 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101608.log 2024-09-11T22:24:51.481 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55213.log: /var/log/ceph/ceph-client.admin.57396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95711.log 2024-09-11T22:24:51.481 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55213.log.gz 2024-09-11T22:24:51.481 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105772.log 2024-09-11T22:24:51.481 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101608.log.gz 2024-09-11T22:24:51.481 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60268.log 2024-09-11T22:24:51.482 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57396.log.gz 2024-09-11T22:24:51.482 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102916.log 2024-09-11T22:24:51.482 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105772.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95711.log.gz 2024-09-11T22:24:51.482 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54463.log 2024-09-11T22:24:51.482 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105772.log.gz 2024-09-11T22:24:51.482 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60268.log.gz 2024-09-11T22:24:51.482 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69844.log 2024-09-11T22:24:51.482 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78457.log 2024-09-11T22:24:51.483 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54463.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.102916.log.gz 2024-09-11T22:24:51.483 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69844.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54463.log.gz 2024-09-11T22:24:51.483 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105688.log 2024-09-11T22:24:51.483 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69844.log.gz 2024-09-11T22:24:51.483 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41247.log 2024-09-11T22:24:51.483 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78457.log: /var/log/ceph/ceph-client.admin.105688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77462.log 2024-09-11T22:24:51.483 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78457.log.gz 2024-09-11T22:24:51.483 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105688.log.gz 2024-09-11T22:24:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.102240.log 2024-09-11T22:24:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77462.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41247.log.gz 2024-09-11T22:24:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64340.log 2024-09-11T22:24:51.484 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77462.log.gz 2024-09-11T22:24:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.102240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.102240.log.gz 2024-09-11T22:24:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66184.log 2024-09-11T22:24:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59091.log 2024-09-11T22:24:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42262.log 2024-09-11T22:24:51.485 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.64340.log.gz 2024-09-11T22:24:51.485 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66268.log 2024-09-11T22:24:51.485 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66184.log.gz 2024-09-11T22:24:51.485 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59091.log.gz 2024-09-11T22:24:51.485 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86647.log 2024-09-11T22:24:51.485 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55171.log 2024-09-11T22:24:51.485 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66268.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42262.log.gz 2024-09-11T22:24:51.485 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86647.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66268.log.gz 2024-09-11T22:24:51.485 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59347.log 2024-09-11T22:24:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62271.log 2024-09-11T22:24:51.486 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4%/var/log/ceph/ceph-client.admin.55171.log: -- replaced with /var/log/ceph/ceph-client.admin.86647.log.gz 2024-09-11T22:24:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59347.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55171.log.gz 2024-09-11T22:24:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36248.log 2024-09-11T22:24:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86773.log 2024-09-11T22:24:51.486 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59347.log.gz 2024-09-11T22:24:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62271.log: /var/log/ceph/ceph-client.admin.36248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65927.log 88.0% 2024-09-11T22:24:51.486 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62271.log.gz 2024-09-11T22:24:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45429.log 2024-09-11T22:24:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86773.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36248.log.gz 2024-09-11T22:24:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65927.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.86773.log.gz 2024-09-11T22:24:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107010.log 2024-09-11T22:24:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78583.log 2024-09-11T22:24:51.487 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65927.log.gz 2024-09-11T22:24:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45429.log: /var/log/ceph/ceph-client.admin.107010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85089.log 2024-09-11T22:24:51.487 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45429.log.gz 2024-09-11T22:24:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose 87.4% -- /var/log/ceph/ceph-client.admin.68688.log -- replaced with /var/log/ceph/ceph-client.admin.107010.log.gz 2024-09-11T22:24:51.488 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78583.log: /var/log/ceph/ceph-client.admin.85089.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78583.log.gz 2024-09-11T22:24:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53021.log 2024-09-11T22:24:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45268.log 2024-09-11T22:24:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68688.log: /var/log/ceph/ceph-client.admin.53021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87202.log 2024-09-11T22:24:51.488 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85089.log.gz 2024-09-11T22:24:51.488 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68688.log.gz 2024-09-11T22:24:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69970.log 2024-09-11T22:24:51.489 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96866.log 2024-09-11T22:24:51.489 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53021.log.gz -- replaced with /var/log/ceph/ceph-client.admin.45268.log.gz 2024-09-11T22:24:51.489 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.489 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.87202.log.gz 2024-09-11T22:24:51.489 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46035.log 2024-09-11T22:24:51.489 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69970.log: /var/log/ceph/ceph-client.admin.96866.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69970.log.gz 2024-09-11T22:24:51.489 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85239.log 2024-09-11T22:24:51.489 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80974.log 2024-09-11T22:24:51.490 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96866.log.gz 2024-09-11T22:24:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46035.log: /var/log/ceph/ceph-client.admin.85239.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46035.log.gz -5 2024-09-11T22:24:51.490 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57297.log 2024-09-11T22:24:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76634.log 2024-09-11T22:24:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.80974.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85239.log.gz 2024-09-11T22:24:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57582.log 2024-09-11T22:24:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.76634.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.80974.log.gz 2024-09-11T22:24:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58489.log 2024-09-11T22:24:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57582.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.57297.log.gzgzip 2024-09-11T22:24:51.491 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56111.log 2024-09-11T22:24:51.491 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.76634.log.gz 2024-09-11T22:24:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68814.log 2024-09-11T22:24:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56111.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58489.log.gz 2024-09-11T22:24:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85623.log 2024-09-11T22:24:51.491 INFO:teuthology.orchestra.run.smithi050.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57582.log.gz 2024-09-11T22:24:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-11T22:24:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68814.log: /var/log/ceph/ceph-client.admin.85623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76568.log 89.2% 2024-09-11T22:24:51.492 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68814.log.gz 2024-09-11T22:24:51.492 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56111.log.gz 2024-09-11T22:24:51.492 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85623.log.gz 2024-09-11T22:24:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77191.log 2024-09-11T22:24:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.76568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96194.log 2024-09-11T22:24:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64690.log 2024-09-11T22:24:51.492 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.76568.log.gz 2024-09-11T22:24:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96194.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77191.log.gz 2024-09-11T22:24:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56951.log 2024-09-11T22:24:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64690.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.96194.log.gz --verbose 2024-09-11T22:24:51.493 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.106590.log 2024-09-11T22:24:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69157.log 2024-09-11T22:24:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106590.log: gzip 91.1% -- replaced with /var/log/ceph/ceph-client.admin.64690.log.gz 2024-09-11T22:24:51.493 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96950.log 2024-09-11T22:24:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69157.log: 88.9% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.106590.log.gz -- replaced with /var/log/ceph/ceph-client.admin.56951.log.gz 2024-09-11T22:24:51.493 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99855.log 2024-09-11T22:24:51.494 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69157.log.gz 2024-09-11T22:24:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57714.log 2024-09-11T22:24:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96950.log: /var/log/ceph/ceph-client.admin.99855.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96950.log.gz 2024-09-11T22:24:51.494 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69718.log 2024-09-11T22:24:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57714.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.99855.log.gz 2024-09-11T22:24:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82330.log 2024-09-11T22:24:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69718.log: gzip -5 --verbose -- 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57714.log.gz 2024-09-11T22:24:51.495 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.62019.log 2024-09-11T22:24:51.495 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8%/var/log/ceph/ceph-client.admin.82330.log: -- replaced with /var/log/ceph/ceph-client.admin.69718.log.gz 2024-09-11T22:24:51.495 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53997.log 2024-09-11T22:24:51.495 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.82330.log.gz 2024-09-11T22:24:51.495 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103000.log 2024-09-11T22:24:51.495 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53997.log: gzip -5 --verbose 88.9% -- -- replaced with /var/log/ceph/ceph-client.admin.62019.log.gz /var/log/ceph/ceph-client.admin.81439.log 2024-09-11T22:24:51.495 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.495 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53997.log.gz 2024-09-11T22:24:51.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77420.log 2024-09-11T22:24:51.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81439.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103000.log.gz 2024-09-11T22:24:51.496 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91167.log 2024-09-11T22:24:51.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77420.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81439.log.gz 2024-09-11T22:24:51.496 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92486.log 2024-09-11T22:24:51.496 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.77420.log.gz 2024-09-11T22:24:51.496 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107094.log 2024-09-11T22:24:51.496 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91167.log.gz 2024-09-11T22:24:51.497 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43237.log 2024-09-11T22:24:51.497 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107094.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92486.log.gz 2024-09-11T22:24:51.497 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44245.log 2024-09-11T22:24:51.497 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0%/var/log/ceph/ceph-client.admin.43237.log: -- replaced with /var/log/ceph/ceph-client.admin.107094.log.gz 2024-09-11T22:24:51.497 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60999.log 2024-09-11T22:24:51.497 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43237.log.gz/var/log/ceph/ceph-client.admin.44245.log: 2024-09-11T22:24:51.497 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67946.log 2024-09-11T22:24:51.497 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44245.log.gz 2024-09-11T22:24:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97922.log 2024-09-11T22:24:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62229.log 2024-09-11T22:24:51.498 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60999.log.gz 2024-09-11T22:24:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.67946.log: /var/log/ceph/ceph-client.0.97922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106548.log 2024-09-11T22:24:51.498 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.97922.log.gz 2024-09-11T22:24:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62229.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.67946.log.gzgzip 2024-09-11T22:24:51.498 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65972.log 2024-09-11T22:24:51.498 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62229.log.gz 2024-09-11T22:24:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54835.log 2024-09-11T22:24:51.499 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106548.log.gz 2024-09-11T22:24:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68417.log 2024-09-11T22:24:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57016.log 2024-09-11T22:24:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54835.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65972.log.gz 2024-09-11T22:24:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64011.log 2024-09-11T22:24:51.499 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54835.log.gz 2024-09-11T22:24:51.499 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68417.log.gz 2024-09-11T22:24:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95570.log 2024-09-11T22:24:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57016.log: /var/log/ceph/ceph-client.admin.64011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101088.log 2024-09-11T22:24:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95570.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.64011.log.gz --verbose 2024-09-11T22:24:51.500 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.0.64594.log 2024-09-11T22:24:51.500 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57016.log.gz 2024-09-11T22:24:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101088.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30133.log 2024-09-11T22:24:51.501 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95570.log.gz 2024-09-11T22:24:51.501 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.64594.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.82805.log -- replaced with /var/log/ceph/ceph-client.admin.101088.log.gz 2024-09-11T22:24:51.501 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.501 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64594.log.gz 2024-09-11T22:24:51.501 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.tmp-client.admin.30133.log: gzip 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30133.log.gz -5 2024-09-11T22:24:51.501 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45039.log 2024-09-11T22:24:51.501 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81082.log 2024-09-11T22:24:51.501 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82805.log: /var/log/ceph/ceph-client.admin.45039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42602.log 2024-09-11T22:24:51.502 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.82805.log.gz 2024-09-11T22:24:51.502 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45039.log.gz 2024-09-11T22:24:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40153.log 2024-09-11T22:24:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105094.log 2024-09-11T22:24:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42602.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.81082.log.gz 2024-09-11T22:24:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94913.log 2024-09-11T22:24:51.503 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42602.log.gz 2024-09-11T22:24:51.503 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40153.log.gz 2024-09-11T22:24:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59641.log 2024-09-11T22:24:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105094.log: /var/log/ceph/ceph-client.admin.94913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77233.log 2024-09-11T22:24:51.503 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105094.log.gz 2024-09-11T22:24:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103356.log 2024-09-11T22:24:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77233.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59641.log.gz 2024-09-11T22:24:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:gzip 90.9% -- replaced with /var/log/ceph/ceph-client.admin.94913.log.gz 2024-09-11T22:24:51.504 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.81565.log 2024-09-11T22:24:51.504 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77233.log.gz 2024-09-11T22:24:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100913.log 2024-09-11T22:24:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81565.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103356.log.gz 2024-09-11T22:24:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59305.log 2024-09-11T22:24:51.504 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.81565.log.gz 2024-09-11T22:24:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101776.log 2024-09-11T22:24:51.505 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100913.log.gz 2024-09-11T22:24:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68459.log 2024-09-11T22:24:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62923.log 2024-09-11T22:24:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101776.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59305.log.gz 2024-09-11T22:24:51.505 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68459.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.101776.log.gz -5 2024-09-11T22:24:51.505 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41937.log 2024-09-11T22:24:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62923.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68459.log.gz 2024-09-11T22:24:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63777.log 2024-09-11T22:24:51.506 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62923.log.gz 2024-09-11T22:24:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61748.log 2024-09-11T22:24:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63777.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41937.log.gz 2024-09-11T22:24:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68982.log 2024-09-11T22:24:51.507 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63777.log.gz 2024-09-11T22:24:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85707.log 2024-09-11T22:24:51.507 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61748.log.gz 2024-09-11T22:24:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57082.log 2024-09-11T22:24:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68291.log 2024-09-11T22:24:51.507 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68982.log.gz 2024-09-11T22:24:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85707.log: gzip/var/log/ceph/ceph-client.admin.57082.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45081.log 2024-09-11T22:24:51.508 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85707.log.gz 2024-09-11T22:24:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65885.log 2024-09-11T22:24:51.508 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68291.log.gz 2024-09-11T22:24:51.508 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57082.log.gz 2024-09-11T22:24:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60147.log 2024-09-11T22:24:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76785.log 2024-09-11T22:24:51.509 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65885.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45081.log.gz 2024-09-11T22:24:51.509 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.60147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78162.log 2024-09-11T22:24:51.509 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65885.log.gz 2024-09-11T22:24:51.509 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.0.60147.log.gz 2024-09-11T22:24:51.509 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.76785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40922.log 2024-09-11T22:24:51.509 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103271.log 2024-09-11T22:24:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40922.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78162.log.gz 2024-09-11T22:24:51.510 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.76785.log.gz 2024-09-11T22:24:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61149.log 2024-09-11T22:24:51.510 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40922.log.gz 2024-09-11T22:24:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107292.log 2024-09-11T22:24:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61149.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103271.log.gz 2024-09-11T22:24:51.511 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T22:24:51.511 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107292.log: gzip -5 88.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.61149.log.gz /var/log/ceph/ceph-client.admin.82200.log 2024-09-11T22:24:51.511 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.511 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.a.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107292.log.gz 2024-09-11T22:24:51.511 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101692.log 2024-09-11T22:24:51.511 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105259.log 2024-09-11T22:24:51.512 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82200.log: /var/log/ceph/ceph-client.admin.101692.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91251.log 2024-09-11T22:24:51.512 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.82200.log.gz 2024-09-11T22:24:51.512 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58227.log 2024-09-11T22:24:51.512 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101692.log.gz 2024-09-11T22:24:51.512 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5/var/log/ceph/ceph-client.admin.91251.log: --verbose -- /var/log/ceph/ceph-client.admin.45905.log 2024-09-11T22:24:51.512 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.105259.log.gz/var/log/ceph/ceph-client.admin.58227.log: 2024-09-11T22:24:51.512 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91251.log.gz 2024-09-11T22:24:51.513 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69411.log 2024-09-11T22:24:51.513 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58227.log.gz 2024-09-11T22:24:51.513 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106632.log 2024-09-11T22:24:51.513 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105137.log 2024-09-11T22:24:51.513 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45905.log.gz 2024-09-11T22:24:51.513 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.106632.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.65172.log 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69411.log.gz 2024-09-11T22:24:51.513 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.513 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105137.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106632.log.gz 2024-09-11T22:24:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- 89.8% /var/log/ceph/ceph-client.admin.86948.log 2024-09-11T22:24:51.514 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105137.log.gz 2024-09-11T22:24:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43015.log 2024-09-11T22:24:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86948.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65172.log.gz 2024-09-11T22:24:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81607.log 2024-09-11T22:24:51.514 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86948.log.gz 2024-09-11T22:24:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.43015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105469.log 2024-09-11T22:24:51.514 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43015.log.gz 2024-09-11T22:24:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95045.log 2024-09-11T22:24:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81607.log: /var/log/ceph/ceph-client.admin.105469.log: gzip -5 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81607.log.gz 2024-09-11T22:24:51.515 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.77149.log 2024-09-11T22:24:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95045.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105469.log.gz 2024-09-11T22:24:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101342.log 2024-09-11T22:24:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.77149.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.105594.log 2024-09-11T22:24:51.515 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.95045.log.gz/var/log/ceph/ceph-client.admin.101342.log: 2024-09-11T22:24:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54961.log 2024-09-11T22:24:51.515 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77149.log.gz 2024-09-11T22:24:51.516 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101342.log.gz 2024-09-11T22:24:51.516 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5/var/log/ceph/ceph-client.admin.105594.log: --verbose -- /var/log/ceph/ceph-client.admin.92654.log 2024-09-11T22:24:51.516 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54961.log: gzip -5 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105594.log.gz 2024-09-11T22:24:51.516 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36616.log 2024-09-11T22:24:51.516 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54961.log.gz 2024-09-11T22:24:51.516 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78289.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92654.log.gz 2024-09-11T22:24:51.516 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.516 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86106.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36616.log.gz 2024-09-11T22:24:51.517 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.517 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97206.log 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78289.log.gz 2024-09-11T22:24:51.517 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.517 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86106.log: gzip -5 --verbose 87.5% -- /var/log/ceph/ceph-client.admin.97374.log -- replaced with /var/log/ceph/ceph-client.admin.86106.log.gz 2024-09-11T22:24:51.517 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.517 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45181.log 2024-09-11T22:24:51.517 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97206.log: /var/log/ceph/ceph-client.admin.97374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42889.log 2024-09-11T22:24:51.517 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97206.log.gz 2024-09-11T22:24:51.518 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60696.log 2024-09-11T22:24:51.518 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97374.log.gz 2024-09-11T22:24:51.518 INFO:teuthology.orchestra.run.smithi050.stderr:gzip 88.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.45181.log.gz -- 2024-09-11T22:24:51.518 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.0.43587.log 2024-09-11T22:24:51.518 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42889.log: /var/log/ceph/ceph-client.admin.60696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62656.log 2024-09-11T22:24:51.518 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42889.log.gz 2024-09-11T22:24:51.518 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76971.log 2024-09-11T22:24:51.518 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60696.log.gz 2024-09-11T22:24:51.518 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.43587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43587.log.gz 2024-09-11T22:24:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53303.log 2024-09-11T22:24:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62656.log: /var/log/ceph/ceph-client.admin.76971.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62656.log.gz 2024-09-11T22:24:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97080.log 2024-09-11T22:24:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5/var/log/ceph/ceph-client.admin.53303.log: --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76971.log.gz 2024-09-11T22:24:51.519 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.69504.log 2024-09-11T22:24:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97080.log: gzip -5 --verbose -- 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97080.log.gz 2024-09-11T22:24:51.520 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.69676.log 2024-09-11T22:24:51.520 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53303.log.gz 2024-09-11T22:24:51.520 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86408.log 2024-09-11T22:24:51.520 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69504.log.gz 2024-09-11T22:24:51.520 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85875.log 2024-09-11T22:24:51.521 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69676.log.gz 2024-09-11T22:24:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92570.log 2024-09-11T22:24:51.521 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.86408.log.gz 2024-09-11T22:24:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.85875.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64012.log 2024-09-11T22:24:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92570.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85875.log.gz 2024-09-11T22:24:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92570.log.gz 2024-09-11T22:24:51.521 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.54123.log 2024-09-11T22:24:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46413.log 2024-09-11T22:24:51.522 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64012.log.gz 2024-09-11T22:24:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95237.log 2024-09-11T22:24:51.522 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54123.log.gz 2024-09-11T22:24:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64013.log 2024-09-11T22:24:51.522 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46413.log.gz 2024-09-11T22:24:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62611.log 2024-09-11T22:24:51.523 INFO:teuthology.orchestra.run.smithi050.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.95237.log.gz 2024-09-11T22:24:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61808.log 2024-09-11T22:24:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64013.log.gz 2024-09-11T22:24:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62611.log: --verbose -- /var/log/ceph/ceph-client.admin.69886.log 2024-09-11T22:24:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61808.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62611.log.gz 2024-09-11T22:24:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62366.log 2024-09-11T22:24:51.523 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61808.log.gz 2024-09-11T22:24:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5/var/log/ceph/ceph-client.admin.69886.log: --verbose -- /var/log/ceph/ceph-client.admin.56045.log 2024-09-11T22:24:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62366.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69886.log.gz 2024-09-11T22:24:51.524 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.77275.log 2024-09-11T22:24:51.524 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62366.log.gz 2024-09-11T22:24:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100432.log 2024-09-11T22:24:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.77275.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.90336.log 2024-09-11T22:24:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100432.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56045.log.gz 2024-09-11T22:24:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55003.log 2024-09-11T22:24:51.524 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77275.log.gz 2024-09-11T22:24:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:gzip 88.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.94979.log 2024-09-11T22:24:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90336.log: -- replaced with /var/log/ceph/ceph-client.admin.100432.log.gz 2024-09-11T22:24:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55003.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81859.log 2024-09-11T22:24:51.525 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90336.log.gz 2024-09-11T22:24:51.525 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55003.log.gz 2024-09-11T22:24:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94979.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T22:24:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107052.log 2024-09-11T22:24:51.525 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2%/var/log/ceph/ceph-osd.2.log: -- replaced with /var/log/ceph/ceph-client.admin.81859.log.gz 2024-09-11T22:24:51.526 INFO:teuthology.orchestra.run.smithi050.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.94979.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103822.log 2024-09-11T22:24:51.526 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.526 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63319.log 2024-09-11T22:24:51.526 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103822.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107052.log.gz 2024-09-11T22:24:51.526 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78625.log 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103822.log.gz 2024-09-11T22:24:51.526 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.526 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41503.log 2024-09-11T22:24:51.526 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63319.log.gz 2024-09-11T22:24:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78625.log: gzip -5 --verbose 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78625.log.gz 2024-09-11T22:24:51.527 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.76700.log 2024-09-11T22:24:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105343.log 2024-09-11T22:24:51.527 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41503.log.gz 2024-09-11T22:24:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.76700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65762.log 2024-09-11T22:24:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105343.log: gzip -5 --verbose 90.8% -- /var/log/ceph/ceph-client.admin.42268.log -- replaced with /var/log/ceph/ceph-client.admin.76700.log.gz 2024-09-11T22:24:51.527 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90126.log 2024-09-11T22:24:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65762.log: /var/log/ceph/ceph-client.admin.42268.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.105343.log.gz 2024-09-11T22:24:51.528 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65762.log.gz 2024-09-11T22:24:51.528 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42268.log.gz 2024-09-11T22:24:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41112.log 2024-09-11T22:24:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46497.log 2024-09-11T22:24:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41112.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.90126.log.gz 2024-09-11T22:24:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90726.log 2024-09-11T22:24:51.528 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41112.log.gz 2024-09-11T22:24:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87509.log 2024-09-11T22:24:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46497.log: /var/log/ceph/ceph-client.admin.90726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68730.log 2024-09-11T22:24:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87509.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90726.log.gz 2024-09-11T22:24:51.529 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41006.log 2024-09-11T22:24:51.529 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87509.log.gz 2024-09-11T22:24:51.529 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.46497.log.gz 2024-09-11T22:24:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68730.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68730.log.gz 2024-09-11T22:24:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91480.log 2024-09-11T22:24:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55979.log 2024-09-11T22:24:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92738.log 2024-09-11T22:24:51.530 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41006.log.gz 2024-09-11T22:24:51.530 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5%/var/log/ceph/ceph-client.admin.55979.log: -- replaced with /var/log/ceph/ceph-client.admin.91480.log.gz 2024-09-11T22:24:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103126.log 2024-09-11T22:24:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68012.log 2024-09-11T22:24:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103126.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55979.log.gz 2024-09-11T22:24:51.530 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92738.log.gz 2024-09-11T22:24:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103126.log.gz 2024-09-11T22:24:51.531 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.95485.log 2024-09-11T22:24:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100703.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68012.log.gz 2024-09-11T22:24:51.531 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57479.log 2024-09-11T22:24:51.531 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95485.log.gz 2024-09-11T22:24:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59725.log 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100703.log.gz 2024-09-11T22:24:51.531 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61041.log 2024-09-11T22:24:51.532 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87551.log 2024-09-11T22:24:51.532 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57479.log.gz 2024-09-11T22:24:51.532 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59725.log.gz 2024-09-11T22:24:51.532 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67323.log 2024-09-11T22:24:51.532 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61041.log: /var/log/ceph/ceph-client.admin.87551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55847.log 2024-09-11T22:24:51.532 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.87551.log.gz/var/log/ceph/ceph-client.admin.67323.log: 2024-09-11T22:24:51.532 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.61041.log.gz 2024-09-11T22:24:51.532 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67323.log.gz 2024-09-11T22:24:51.532 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104130.log 2024-09-11T22:24:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92177.log 2024-09-11T22:24:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65088.log 2024-09-11T22:24:51.533 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.55847.log.gz 2024-09-11T22:24:51.533 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104130.log.gz 2024-09-11T22:24:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82763.log 2024-09-11T22:24:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61381.log 2024-09-11T22:24:51.534 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92177.log.gz 2024-09-11T22:24:51.534 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82763.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65088.log.gz 2024-09-11T22:24:51.534 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82763.log.gz 2024-09-11T22:24:51.534 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41419.log 2024-09-11T22:24:51.534 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61381.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61381.log.gz 2024-09-11T22:24:51.534 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.86563.log 2024-09-11T22:24:51.534 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61664.log 2024-09-11T22:24:51.535 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41419.log.gz 2024-09-11T22:24:51.535 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86563.log: gzip -5 --verbose 88.1% -- replaced with /var/log/ceph/ceph-client.admin.86563.log.gz 2024-09-11T22:24:51.535 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.91293.log 2024-09-11T22:24:51.535 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61253.log 2024-09-11T22:24:51.535 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61664.log.gz 2024-09-11T22:24:51.535 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91293.log: gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91293.log.gz 2024-09-11T22:24:51.535 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.77971.log 2024-09-11T22:24:51.536 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90084.log 2024-09-11T22:24:51.536 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54775.log 2024-09-11T22:24:51.536 INFO:teuthology.orchestra.run.smithi050.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.61253.log.gz 2024-09-11T22:24:51.536 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.77971.log.gz 2024-09-11T22:24:51.536 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67842.log 2024-09-11T22:24:51.536 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90084.log.gz/var/log/ceph/ceph-client.admin.54775.log: 2024-09-11T22:24:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78373.log 2024-09-11T22:24:51.537 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54775.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55781.log 2024-09-11T22:24:51.537 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.67842.log: /var/log/ceph/ceph-client.admin.78373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53684.log 2024-09-11T22:24:51.537 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67842.log.gz/var/log/ceph/ceph-client.admin.55781.log: 2024-09-11T22:24:51.537 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78373.log.gz 2024-09-11T22:24:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57148.log 2024-09-11T22:24:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53684.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55781.log.gz 2024-09-11T22:24:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46830.log 2024-09-11T22:24:51.538 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53684.log.gz 2024-09-11T22:24:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76852.log 2024-09-11T22:24:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57148.log: /var/log/ceph/ceph-client.admin.46830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81733.log 2024-09-11T22:24:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.76852.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46830.log.gz 2024-09-11T22:24:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69634.log 2024-09-11T22:24:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81733.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.76852.log.gz 2024-09-11T22:24:51.538 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.57148.log.gz 2024-09-11T22:24:51.539 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91335.log 2024-09-11T22:24:51.539 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81733.log.gz 2024-09-11T22:24:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92528.log 2024-09-11T22:24:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46371.log 2024-09-11T22:24:51.539 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69634.log.gz 2024-09-11T22:24:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91335.log: /var/log/ceph/ceph-client.admin.92528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90378.log 2024-09-11T22:24:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46371.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91335.log.gz 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92528.log.gz 2024-09-11T22:24:51.539 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46371.log.gz 2024-09-11T22:24:51.540 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.97626.log 2024-09-11T22:24:51.540 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64209.log 2024-09-11T22:24:51.540 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41377.log 2024-09-11T22:24:51.540 INFO:teuthology.orchestra.run.smithi050.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.90378.log.gz 2024-09-11T22:24:51.540 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97626.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.88101.log 2024-09-11T22:24:51.540 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.540 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64209.log: /var/log/ceph/ceph-client.admin.41377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69281.log 2024-09-11T22:24:51.540 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6%/var/log/ceph/ceph-client.0.88101.log: -- replaced with /var/log/ceph/ceph-client.admin.64209.log.gz 2024-09-11T22:24:51.541 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41377.log.gz 2024-09-11T22:24:51.541 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.0.88101.log.gz 2024-09-11T22:24:51.541 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-11T22:24:51.541 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63361.log 2024-09-11T22:24:51.541 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2%/var/log/ceph/ceph-mgr.y.log: -- replaced with /var/log/ceph/ceph-client.admin.69281.log.gz 2024-09-11T22:24:51.541 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87383.log 2024-09-11T22:24:51.541 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53153.log 2024-09-11T22:24:51.541 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63361.log: /var/log/ceph/ceph-client.admin.87383.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87383.log.gz 2024-09-11T22:24:51.542 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66436.log 2024-09-11T22:24:51.542 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53153.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.63361.log.gz 2024-09-11T22:24:51.542 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78204.log 2024-09-11T22:24:51.542 INFO:teuthology.orchestra.run.smithi050.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.53153.log.gz 2024-09-11T22:24:51.542 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106716.log 2024-09-11T22:24:51.542 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66436.log: /var/log/ceph/ceph-client.admin.78204.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78204.log.gz 2024-09-11T22:24:51.542 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66436.log.gz 2024-09-11T22:24:51.542 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85917.log 2024-09-11T22:24:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58353.log 2024-09-11T22:24:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106716.log: /var/log/ceph/ceph-client.admin.85917.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106716.log.gz 2024-09-11T22:24:51.543 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85917.log.gz 2024-09-11T22:24:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96793.log 2024-09-11T22:24:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41461.log 2024-09-11T22:24:51.543 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58353.log.gz 2024-09-11T22:24:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46161.log 2024-09-11T22:24:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41461.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96793.log.gz 2024-09-11T22:24:51.544 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41461.log.gz 2024-09-11T22:24:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97734.log 2024-09-11T22:24:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91606.log 2024-09-11T22:24:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97734.log: /var/log/ceph/ceph-client.admin.46161.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46161.log.gz 2024-09-11T22:24:51.544 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97734.log.gz 2024-09-11T22:24:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92444.log 2024-09-11T22:24:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92314.log 2024-09-11T22:24:51.544 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91606.log.gz 2024-09-11T22:24:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64252.log 2024-09-11T22:24:51.545 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92444.log.gz 2024-09-11T22:24:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92314.log: 94.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-11T22:24:51.545 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.92314.log.gz 2024-09-11T22:24:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103864.log 2024-09-11T22:24:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41335.log 2024-09-11T22:24:51.545 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64252.log.gz/var/log/ceph/ceph-client.admin.103864.log: 2024-09-11T22:24:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83245.log 2024-09-11T22:24:51.546 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103864.log.gz 2024-09-11T22:24:51.546 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103524.log 2024-09-11T22:24:51.546 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90252.log 2024-09-11T22:24:51.546 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.83245.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41335.log.gz/var/log/ceph/ceph-client.admin.103524.log: 2024-09-11T22:24:51.546 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.83245.log.gz 2024-09-11T22:24:51.546 INFO:teuthology.orchestra.run.smithi050.stderr:gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103524.log.gz 2024-09-11T22:24:51.546 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42269.log 2024-09-11T22:24:51.546 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90252.log: gzip -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.90252.log.gz 2024-09-11T22:24:51.547 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.78331.log 2024-09-11T22:24:51.547 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66058.log 2024-09-11T22:24:51.547 INFO:teuthology.orchestra.run.smithi050.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42269.log.gz 2024-09-11T22:24:51.547 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56785.log 2024-09-11T22:24:51.547 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78331.log.gz 2024-09-11T22:24:51.547 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66058.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T22:24:51.547 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66058.log.gz 2024-09-11T22:24:51.547 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92402.log 2024-09-11T22:24:51.548 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56785.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58750.log 2024-09-11T22:24:51.548 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92402.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56785.log.gz 2024-09-11T22:24:51.548 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92402.log.gz 2024-09-11T22:24:51.548 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104596.log 2024-09-11T22:24:51.548 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85155.log 2024-09-11T22:24:51.548 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58750.log.gz 2024-09-11T22:24:51.548 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105426.log 2024-09-11T22:24:51.548 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85155.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104596.log.gz 2024-09-11T22:24:51.548 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85155.log.gz 2024-09-11T22:24:51.549 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53913.log 2024-09-11T22:24:51.549 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101818.log 2024-09-11T22:24:51.549 INFO:teuthology.orchestra.run.smithi050.stderr: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T22:24:51.549 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105426.log: /var/log/ceph/ceph-client.admin.53913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96994.log 2024-09-11T22:24:51.549 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105426.log.gz 2024-09-11T22:24:51.549 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9%/var/log/ceph/ceph-client.admin.101818.log: -- replaced with /var/log/ceph/ceph-client.admin.53913.log.gz 2024-09-11T22:24:51.549 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54039.log 2024-09-11T22:24:51.549 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8%/var/log/ceph/ceph-client.admin.96994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97542.log 2024-09-11T22:24:51.550 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101818.log.gz 2024-09-11T22:24:51.550 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96994.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58624.log 2024-09-11T22:24:51.550 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.550 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54039.log: /var/log/ceph/ceph-client.admin.97542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55715.log 2024-09-11T22:24:51.550 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54039.log.gz 2024-09-11T22:24:51.550 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58624.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97542.log.gz 2024-09-11T22:24:51.550 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58624.log.gz 2024-09-11T22:24:51.550 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44203.log 2024-09-11T22:24:51.552 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66712.log 2024-09-11T22:24:51.552 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81775.log 2024-09-11T22:24:51.552 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55715.log.gz 2024-09-11T22:24:51.553 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44203.log.gz 2024-09-11T22:24:51.553 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55255.log 2024-09-11T22:24:51.553 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66712.log: /var/log/ceph/ceph-client.admin.81775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59133.log 2024-09-11T22:24:51.553 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55255.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66712.log.gz 2024-09-11T22:24:51.553 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81775.log.gz 2024-09-11T22:24:51.553 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58540.log 2024-09-11T22:24:51.553 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59133.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55255.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67562.log 2024-09-11T22:24:51.553 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.554 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59133.log.gz 2024-09-11T22:24:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5/var/log/ceph/ceph-client.admin.58540.log: --verbose -- /var/log/ceph/ceph-client.admin.42609.log 2024-09-11T22:24:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.67562.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58540.log.gz 2024-09-11T22:24:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46751.log 2024-09-11T22:24:51.554 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67562.log.gz/var/log/ceph/ceph-client.admin.42609.log: 2024-09-11T22:24:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97122.log 2024-09-11T22:24:51.554 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42609.log.gz 2024-09-11T22:24:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106968.log 2024-09-11T22:24:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.46751.log: /var/log/ceph/ceph-client.admin.97122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41205.log 2024-09-11T22:24:51.555 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46751.log.gz 2024-09-11T22:24:51.555 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97122.log.gz 2024-09-11T22:24:51.555 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58582.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106968.log.gz 2024-09-11T22:24:51.555 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.555 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41205.log: gzip -5 --verbose -- 89.4% /var/log/ceph/ceph-client.admin.44829.log 2024-09-11T22:24:51.555 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41205.log.gz 2024-09-11T22:24:51.555 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90768.log 2024-09-11T22:24:51.555 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58582.log.gz 2024-09-11T22:24:51.556 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59809.log 2024-09-11T22:24:51.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99747.log 2024-09-11T22:24:51.556 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7%/var/log/ceph/ceph-client.admin.90768.log: -- replaced with /var/log/ceph/ceph-client.admin.44829.log.gz 2024-09-11T22:24:51.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59809.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90768.log.gz 2024-09-11T22:24:51.556 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59809.log.gz 2024-09-11T22:24:51.556 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59515.log 2024-09-11T22:24:51.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.99747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82096.log 2024-09-11T22:24:51.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59515.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99747.log.gz 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70012.log 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59515.log.gz 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78246.log 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.82096.log.gz 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100263.log 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.70012.log: /var/log/ceph/ceph-client.admin.78246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41545.log 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70012.log.gz 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78246.log.gz/var/log/ceph/ceph-client.admin.100263.log: 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89842.log 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100263.log.gz 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67884.log 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41545.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53558.log 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.89842.log: /var/log/ceph/ceph-client.admin.67884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68375.log 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53558.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67884.log.gz 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.89842.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91774.log 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53558.log.gz 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82721.log 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86605.log 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68375.log.gz 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82721.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91774.log.gz 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi050.stderr:gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.82721.log.gz 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.81040.log 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86605.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86605.log.gz 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.66142.log 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101524.log 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.81040.log.gz 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63615.log 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66142.log.gz 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56743.log 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85365.log 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.63615.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101524.log.gz 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63615.log.gz 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85749.log 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56743.log.gz 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59009.log 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.85365.log.gz 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62793.log 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85749.log: /var/log/ceph/ceph-client.admin.59009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92221.log 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62793.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.85749.log.gz 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59009.log.gz 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.562 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62793.log.gz 2024-09-11T22:24:51.562 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46203.log 2024-09-11T22:24:51.562 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92221.log: gzip -5 --verbose -- 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92221.log.gz 2024-09-11T22:24:51.562 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.99694.log 2024-09-11T22:24:51.562 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82158.log 2024-09-11T22:24:51.562 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46203.log.gz 2024-09-11T22:24:51.562 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.99694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63235.log 2024-09-11T22:24:51.562 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99694.log.gz 2024-09-11T22:24:51.563 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69802.log 2024-09-11T22:24:51.563 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82158.log: /var/log/ceph/ceph-client.admin.63235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59959.log 2024-09-11T22:24:51.563 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69802.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82158.log.gz 2024-09-11T22:24:51.563 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63235.log.gz 2024-09-11T22:24:51.563 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69802.log.gz 2024-09-11T22:24:51.563 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77630.log 2024-09-11T22:24:51.563 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42604.log 2024-09-11T22:24:51.563 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96246.log 2024-09-11T22:24:51.563 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59959.log.gz 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77630.log: /var/log/ceph/ceph-client.admin.42604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67013.log 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0%/var/log/ceph/ceph-client.admin.96246.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42604.log.gz 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77630.log.gz 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96246.log.gz 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87114.log 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.67013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57648.log 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87114.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67013.log.gz 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69239.log 2024-09-11T22:24:51.565 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87114.log.gz 2024-09-11T22:24:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56293.log 2024-09-11T22:24:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69239.log: 90.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97332.log 2024-09-11T22:24:51.565 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57648.log.gz 2024-09-11T22:24:51.565 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69239.log.gz 2024-09-11T22:24:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101902.log 2024-09-11T22:24:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100829.log 2024-09-11T22:24:51.565 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56293.log.gz 2024-09-11T22:24:51.566 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97332.log.gz 2024-09-11T22:24:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103661.log 2024-09-11T22:24:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101944.log 2024-09-11T22:24:51.566 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101902.log.gz 2024-09-11T22:24:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59219.log 2024-09-11T22:24:51.566 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100829.log.gz 2024-09-11T22:24:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103661.log: /var/log/ceph/ceph-client.admin.101944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77588.log 2024-09-11T22:24:51.566 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103661.log.gz 2024-09-11T22:24:51.566 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101944.log.gz 2024-09-11T22:24:51.567 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100306.log 2024-09-11T22:24:51.567 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65004.log 2024-09-11T22:24:51.567 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59219.log.gz 2024-09-11T22:24:51.567 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.77588.log: /var/log/ceph/ceph-client.admin.100306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104218.log 2024-09-11T22:24:51.567 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65004.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.77588.log.gz 2024-09-11T22:24:51.567 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100306.log.gz 2024-09-11T22:24:51.567 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54645.log 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65004.log.gz 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.104218.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96357.log 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54645.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104218.log.gz 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46119.log 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54645.log.gz 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97038.log 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96357.log: /var/log/ceph/ceph-client.admin.46119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64010.log 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97038.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96357.log.gz 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46119.log.gz 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45471.log 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97038.log.gz 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86731.log 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106422.log 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64010.log.gz 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45471.log: /var/log/ceph/ceph-client.admin.86731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40744.log 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45471.log.gz/var/log/ceph/ceph-client.admin.106422.log: 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86731.log.gz 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91125.log 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106422.log.gz 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67322.log 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82595.log 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40744.log.gz 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91125.log.gz/var/log/ceph/ceph-client.admin.67322.log: 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45947.log 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82595.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67322.log.gz 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.82595.log.gz 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44027.log 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59473.log 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.2.44027.log: 89.1% 0.0% -- replaced with /var/log/ceph/ceph-client.2.44027.log.gz 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45947.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96441.log 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55913.log 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59473.log: /var/log/ceph/ceph-client.admin.96441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100168.log 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55913.log: 87.4% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96441.log.gz 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59473.log.gz 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97500.log 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100168.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.55913.log.gz 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42273.log 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100168.log.gz 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54260.log 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97500.log: /var/log/ceph/ceph-client.admin.42273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107374.log 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42273.log.gz 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3%/var/log/ceph/ceph-client.admin.54260.log: -- replaced with /var/log/ceph/ceph-client.admin.97500.log.gz 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54260.log.gz 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103741.log 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106842.log 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103741.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107374.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80890.log 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103741.log.gz 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100745.log 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106842.log: /var/log/ceph/ceph-client.admin.80890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96567.log 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106842.log.gz 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100745.log: gzip -5 --verbose 90.6% -- replaced with /var/log/ceph/ceph-client.admin.80890.log.gz 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.64826.log 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96567.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44913.log 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100745.log.gz 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96567.log.gz 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68519.log 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64826.log.gz/var/log/ceph/ceph-client.admin.44913.log: 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44913.log.gz 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.65843.log 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68519.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68519.log.gz 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.65401.log 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65843.log: gzip -5 87.8% --verbose -- /var/log/ceph/ceph-client.admin.101566.log 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65843.log.gz 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103228.log 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6%/var/log/ceph/ceph-client.admin.101566.log: -- replaced with /var/log/ceph/ceph-client.admin.65401.log.gz 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68562.log 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101566.log.gz 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106187.log 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62881.log 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68562.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103228.log.gz 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42805.log 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68562.log.gz 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.106187.log.gz 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103313.log 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62881.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95111.log 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42805.log: /var/log/ceph/ceph-client.admin.103313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101394.log 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7%/var/log/ceph/ceph-client.admin.95111.log: -- replaced with /var/log/ceph/ceph-client.admin.42805.log.gz 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103313.log.gz 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95111.log.gz 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102052.log 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101394.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101394.log.gz 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.85557.log 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54919.log 89.0% 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102052.log.gz 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59599.log 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.54919.log: -- /var/log/ceph/ceph-client.admin.87341.log 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi050.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.85557.log.gz 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54919.log.gz/var/log/ceph/ceph-client.admin.59599.log: 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85491.log 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62700.log 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59599.log.gz 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85491.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87678.log 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87341.log.gz 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103482.log 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62700.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.85491.log.gz 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.87678.log: -- /var/log/ceph/ceph-client.admin.57780.log 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62700.log.gz 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66604.log 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87678.log.gz 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103482.log: /var/log/ceph/ceph-client.admin.57780.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103482.log.gz 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82991.log 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105193.log 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66604.log.gz 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82991.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57780.log.gz 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44997.log 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69592.log 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44997.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.82991.log.gz 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44997.log.gz 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.105193.log.gz 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45854.log 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69323.log 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69592.log.gz 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.45854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68856.log 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45854.log.gz 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85407.log 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69323.log.gz 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81177.log 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.68856.log.gz 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100348.log 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85407.log: /var/log/ceph/ceph-client.admin.81177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102727.log 2024-09-11T22:24:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100348.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.85407.log.gz 2024-09-11T22:24:51.583 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.81177.log.gz 2024-09-11T22:24:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.67197.log 2024-09-11T22:24:51.583 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100348.log.gz 2024-09-11T22:24:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54594.log/var/log/ceph/ceph-client.admin.102727.log: 2024-09-11T22:24:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.67197.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58708.log 2024-09-11T22:24:51.583 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102727.log.gz 2024-09-11T22:24:51.583 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.54594.log: -- /var/log/ceph/ceph-client.admin.101734.log 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.67197.log.gz 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99789.log 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54594.log.gz 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58708.log.gz 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82679.log 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101734.log.gz/var/log/ceph/ceph-client.admin.99789.log: 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102958.log 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82679.log: 90.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101298.log 2024-09-11T22:24:51.585 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99789.log.gz 2024-09-11T22:24:51.585 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.82679.log.gz 2024-09-11T22:24:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106926.log 2024-09-11T22:24:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86868.log 2024-09-11T22:24:51.585 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102958.log.gz 2024-09-11T22:24:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106926.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43057.log 2024-09-11T22:24:51.585 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101298.log.gz 2024-09-11T22:24:51.585 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106926.log.gz 2024-09-11T22:24:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67758.log 2024-09-11T22:24:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86868.log: /var/log/ceph/ceph-client.admin.43057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91522.log 2024-09-11T22:24:51.586 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7%/var/log/ceph/ceph-client.admin.67758.log: -- replaced with /var/log/ceph/ceph-client.admin.86868.log.gz 2024-09-11T22:24:51.586 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43057.log.gz 2024-09-11T22:24:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67758.log.gz -5 2024-09-11T22:24:51.586 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.106506.log 2024-09-11T22:24:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106145.log 2024-09-11T22:24:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106506.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91522.log.gz 2024-09-11T22:24:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44644.log 2024-09-11T22:24:51.587 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106506.log.gz 2024-09-11T22:24:51.587 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43099.log 2024-09-11T22:24:51.587 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106145.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68604.log 2024-09-11T22:24:51.587 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.587 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.44644.log: /var/log/ceph/ceph-client.admin.43099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58185.log 2024-09-11T22:24:51.587 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68604.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44644.log.gz 2024-09-11T22:24:51.587 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96908.log 2024-09-11T22:24:51.587 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68604.log.gz 2024-09-11T22:24:51.588 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43099.log.gz 2024-09-11T22:24:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60310.log 2024-09-11T22:24:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58185.log: /var/log/ceph/ceph-client.admin.96908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40840.log 2024-09-11T22:24:51.588 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58185.log.gz 2024-09-11T22:24:51.588 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96908.log.gz 2024-09-11T22:24:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102319.log 2024-09-11T22:24:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82637.log 2024-09-11T22:24:51.588 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60310.log.gz/var/log/ceph/ceph-client.admin.40840.log: 2024-09-11T22:24:51.588 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102319.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62965.log 2024-09-11T22:24:51.589 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40840.log.gz/var/log/ceph/ceph-client.admin.82637.log: 2024-09-11T22:24:51.589 INFO:teuthology.orchestra.run.smithi050.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.102319.log.gz 2024-09-11T22:24:51.589 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.82637.log.gz 2024-09-11T22:24:51.589 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67692.log 2024-09-11T22:24:51.589 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.62965.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41629.log 2024-09-11T22:24:51.589 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.67692.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62965.log.gz 2024-09-11T22:24:51.589 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55650.log 2024-09-11T22:24:51.589 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68249.log 91.1% -- replaced with /var/log/ceph/ceph-client.admin.67692.log.gz 2024-09-11T22:24:51.590 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.590 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55650.log: /var/log/ceph/ceph-client.admin.41629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91564.log 2024-09-11T22:24:51.590 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41629.log.gz 2024-09-11T22:24:51.590 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68249.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.55650.log.gz 2024-09-11T22:24:51.590 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58269.log 2024-09-11T22:24:51.590 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68249.log.gz 2024-09-11T22:24:51.590 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63175.log 2024-09-11T22:24:51.590 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92007.log 2024-09-11T22:24:51.590 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91564.log.gz 2024-09-11T22:24:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58269.log: gzip/var/log/ceph/ceph-client.admin.63175.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96704.log 2024-09-11T22:24:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92007.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58269.log.gz 2024-09-11T22:24:51.591 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63175.log.gz 2024-09-11T22:24:51.591 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92007.log.gz 2024-09-11T22:24:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85281.log 2024-09-11T22:24:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95528.log 2024-09-11T22:24:51.591 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2%/var/log/ceph/ceph-client.admin.85281.log: -- replaced with /var/log/ceph/ceph-client.admin.96704.log.gz 2024-09-11T22:24:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55087.log 89.6% -- replaced with /var/log/ceph/ceph-client.admin.85281.log.gz 2024-09-11T22:24:51.592 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:24:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95528.log: gzip -5 --verbose 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95528.log.gz 2024-09-11T22:24:51.592 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.99985.log 2024-09-11T22:24:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101170.log 2024-09-11T22:24:51.592 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55087.log.gz 2024-09-11T22:24:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.99985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95612.log 2024-09-11T22:24:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101170.log: gzip 91.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.99985.log.gz --verbose 2024-09-11T22:24:51.592 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.53726.log 2024-09-11T22:24:51.592 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101170.log.gz 2024-09-11T22:24:51.593 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86190.log 2024-09-11T22:24:51.593 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59893.log 2024-09-11T22:24:51.593 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6%/var/log/ceph/ceph-client.admin.53726.log: -- replaced with /var/log/ceph/ceph-client.admin.95612.log.gz/var/log/ceph/ceph-client.admin.86190.log: 2024-09-11T22:24:51.593 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9%gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.86190.log.gz -- 2024-09-11T22:24:51.593 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.81817.log 2024-09-11T22:24:51.593 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53726.log.gz 2024-09-11T22:24:51.593 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5/var/log/ceph/ceph-client.admin.59893.log: --verbose -- /var/log/ceph/ceph-client.admin.82889.log 2024-09-11T22:24:51.593 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90894.log 2024-09-11T22:24:51.594 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.81817.log.gz 2024-09-11T22:24:51.594 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59893.log.gz 2024-09-11T22:24:51.594 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96525.log 2024-09-11T22:24:51.594 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0%/var/log/ceph/ceph-client.admin.90894.log: -- replaced with /var/log/ceph/ceph-client.admin.82889.log.gz 2024-09-11T22:24:51.594 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87721.log 2024-09-11T22:24:51.594 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90894.log.gz 2024-09-11T22:24:51.594 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65130.log 2024-09-11T22:24:51.594 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96525.log: /var/log/ceph/ceph-client.admin.87721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62103.log 2024-09-11T22:24:51.595 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96525.log.gz 2024-09-11T22:24:51.595 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3%/var/log/ceph/ceph-client.admin.65130.log: -- replaced with /var/log/ceph/ceph-client.admin.87721.log.gz 2024-09-11T22:24:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65130.log.gz 2024-09-11T22:24:51.595 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.54550.log 2024-09-11T22:24:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54687.log 2024-09-11T22:24:51.595 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62103.log.gz 2024-09-11T22:24:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61191.log 2024-09-11T22:24:51.595 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54550.log.gz 2024-09-11T22:24:51.596 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92612.log 2024-09-11T22:24:51.596 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54687.log: /var/log/ceph/ceph-client.admin.61191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96609.log 2024-09-11T22:24:51.596 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.92612.log: 88.1% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54687.log.gz 2024-09-11T22:24:51.596 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61191.log.gz 2024-09-11T22:24:51.596 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92612.log.gz 2024-09-11T22:24:51.596 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41671.log 2024-09-11T22:24:51.596 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.96609.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.106800.log 2024-09-11T22:24:51.596 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.41671.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96609.log.gz 2024-09-11T22:24:51.596 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89974.log 2024-09-11T22:24:51.597 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz 2024-09-11T22:24:51.597 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T22:24:51.597 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106800.log: /var/log/ceph/ceph-client.admin.89974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62569.log 2024-09-11T22:24:51.597 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106800.log.gz 2024-09-11T22:24:51.597 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91377.log 2024-09-11T22:24:51.597 INFO:teuthology.orchestra.run.smithi050.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.89974.log.gz 2024-09-11T22:24:51.597 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90510.log 2024-09-11T22:24:51.597 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62569.log.gz 2024-09-11T22:24:51.598 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78751.log 2024-09-11T22:24:51.598 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91377.log.gz 2024-09-11T22:24:51.598 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56545.log 2024-09-11T22:24:51.598 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90510.log.gz 2024-09-11T22:24:51.598 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54421.log 2024-09-11T22:24:51.598 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1%/var/log/ceph/ceph-client.admin.56545.log: -- replaced with /var/log/ceph/ceph-client.admin.78751.log.gz 2024-09-11T22:24:51.598 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90594.log 2024-09-11T22:24:51.598 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56545.log.gz 2024-09-11T22:24:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54421.log: gzip 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54421.log.gz 2024-09-11T22:24:51.599 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-11T22:24:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65461.log 2024-09-11T22:24:51.599 INFO:teuthology.orchestra.run.smithi050.stderr: 90.9%/var/log/ceph/ceph-mds.c.log: -- replaced with /var/log/ceph/ceph-client.admin.90594.log.gz 2024-09-11T22:24:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42469.log 2024-09-11T22:24:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65461.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65461.log.gz 2024-09-11T22:24:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63854.log 2024-09-11T22:24:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.42469.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42469.log.gz 2024-09-11T22:24:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96399.log 2024-09-11T22:24:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63854.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63854.log.gz 2024-09-11T22:24:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104512.log 2024-09-11T22:24:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96399.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96399.log.gz 2024-09-11T22:24:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103995.log 2024-09-11T22:24:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104512.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104512.log.gz 2024-09-11T22:24:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78013.log 2024-09-11T22:24:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103995.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103995.log.gz 2024-09-11T22:24:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62446.log 2024-09-11T22:24:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78013.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78013.log.gz 2024-09-11T22:24:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58929.log 2024-09-11T22:24:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62446.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62446.log.gz 2024-09-11T22:24:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65682.log 2024-09-11T22:24:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58929.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58929.log.gz 2024-09-11T22:24:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62061.log 2024-09-11T22:24:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65682.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65682.log.gz 2024-09-11T22:24:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53768.log 2024-09-11T22:24:51.602 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62061.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62061.log.gz 2024-09-11T22:24:51.602 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101478.log 2024-09-11T22:24:51.602 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53768.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53768.log.gz 2024-09-11T22:24:51.602 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104470.log 2024-09-11T22:24:51.602 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101478.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101478.log.gz 2024-09-11T22:24:51.602 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87158.log 2024-09-11T22:24:51.602 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104470.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104470.log.gz 2024-09-11T22:24:51.602 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106758.log 2024-09-11T22:24:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87158.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87158.log.gz 2024-09-11T22:24:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62527.log 2024-09-11T22:24:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106758.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106758.log.gz 2024-09-11T22:24:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104428.log 2024-09-11T22:24:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62527.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62527.log.gz 2024-09-11T22:24:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82423.log 2024-09-11T22:24:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104428.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104428.log.gz 2024-09-11T22:24:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97290.log 2024-09-11T22:24:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82423.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.82423.log.gz 2024-09-11T22:24:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78499.log 2024-09-11T22:24:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97290.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97290.log.gz 2024-09-11T22:24:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107332.log 2024-09-11T22:24:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78499.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78499.log.gz 2024-09-11T22:24:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64920.log 2024-09-11T22:24:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107332.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107332.log.gz 2024-09-11T22:24:51.605 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64920.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64920.log.gz 2024-09-11T22:24:51.605 INFO:teuthology.orchestra.run.smithi077.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-11T22:24:51.703 INFO:teuthology.orchestra.run.smithi077.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-11T22:24:52.395 INFO:teuthology.orchestra.run.smithi050.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T22:24:52.484 INFO:teuthology.orchestra.run.smithi077.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-11T22:24:52.730 INFO:teuthology.orchestra.run.smithi077.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-11T22:24:53.047 INFO:teuthology.orchestra.run.smithi077.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-11T22:24:53.206 INFO:teuthology.orchestra.run.smithi050.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T22:24:53.245 INFO:teuthology.orchestra.run.smithi077.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-11T22:24:53.292 INFO:teuthology.orchestra.run.smithi077.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-11T22:24:53.295 INFO:teuthology.orchestra.run.smithi077.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-11T22:24:53.297 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-11T22:24:53.297 INFO:teuthology.orchestra.run.smithi077.stderr:real 0m2.265s 2024-09-11T22:24:53.298 INFO:teuthology.orchestra.run.smithi077.stderr:user 0m12.470s 2024-09-11T22:24:53.298 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m0.439s 2024-09-11T22:24:53.315 INFO:teuthology.orchestra.run.smithi050.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T22:24:53.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-11T22:24:53.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-11T22:24:53.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-11T22:24:53.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-11T22:24:53.635 INFO:teuthology.orchestra.run.smithi050.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T22:24:53.693 INFO:teuthology.orchestra.run.smithi050.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T22:25:15.071 INFO:teuthology.orchestra.run.smithi050.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-11T22:25:17.828 INFO:teuthology.orchestra.run.smithi050.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-11T22:25:17.830 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-11T22:25:17.830 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m26.823s 2024-09-11T22:25:17.830 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m59.442s 2024-09-11T22:25:17.830 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m2.286s 2024-09-11T22:25:17.831 INFO:tasks.ceph:Archiving logs... 2024-09-11T22:25:17.831 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901414/remote/smithi050/log 2024-09-11T22:25:17.832 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T22:25:25.862 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901414/remote/smithi077/log 2024-09-11T22:25:25.863 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T22:25:27.260 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T22:25:27.268 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T22:25:27.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T22:25:27.272 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T22:25:27.364 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T22:25:27.374 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T22:25:27.374 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:25:27.376 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:25:27.392 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:25:27.393 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:25:27.397 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:25:27.397 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-09-11T22:25:27.397 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv01.front.sepia.ceph.com 3 6 377 44 +1043us[+1024us] +/- 44ms 2024-09-11T22:25:27.397 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -52us[ -52us] +/- 64ms 2024-09-11T22:25:27.398 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 -1602us[-1621us] +/- 71ms 2024-09-11T22:25:27.398 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:25:27.399 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:25:27.399 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-09-11T22:25:27.400 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +1024us[+1015us] +/- 44ms 2024-09-11T22:25:27.400 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -89us[ -98us] +/- 64ms 2024-09-11T22:25:27.400 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 -1633us[-1633us] +/- 71ms 2024-09-11T22:25:27.400 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:25:27.400 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T22:25:27.416 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T22:25:27.417 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T22:25:27.432 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T22:25:27.540 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T22:25:27.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:25:27.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:25:27.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:25:27.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:25:27.680 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T22:25:27.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T22:25:27.698 INFO:teuthology.task.internal:Duration was 1248.862442 seconds 2024-09-11T22:25:27.699 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T22:25:27.707 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T22:25:27.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T22:25:27.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T22:25:27.752 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:25:27.761 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:25:28.074 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T22:25:28.075 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-09-11T22:25:28.075 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T22:25:28.141 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-09-11T22:25:28.141 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T22:25:28.166 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T22:25:28.166 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T22:25:28.184 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T22:25:28.232 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T22:25:28.233 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T22:25:28.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T22:25:28.407 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T22:25:28.417 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T22:25:28.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T22:25:28.443 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T22:25:28.468 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T22:25:28.478 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:25:28.486 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:25:28.507 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-09-11T22:25:28.532 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-09-11T22:25:28.545 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:25:28.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:25:28.576 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:25:28.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:25:28.600 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T22:25:28.609 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T22:25:28.610 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901414/remote/smithi050 2024-09-11T22:25:28.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T22:25:28.654 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901414/remote/smithi077 2024-09-11T22:25:28.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T22:25:28.687 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T22:25:28.687 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T22:25:28.690 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T22:25:28.737 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T22:25:28.749 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T22:25:28.749 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T22:25:28.759 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T22:25:28.760 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T22:25:28.762 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T22:25:28.777 INFO:teuthology.orchestra.run.smithi050.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 22:25 /home/ubuntu/cephtest 2024-09-11T22:25:28.791 INFO:teuthology.orchestra.run.smithi077.stdout: 266064 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 22:25 /home/ubuntu/cephtest 2024-09-11T22:25:28.793 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T22:25:28.803 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T22:25:28.826 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/scrub} duration: 1248.862441778183 failure_reason: 'Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=d77c5cc798bd40cdb867436cd1641c29 status: fail success: false 2024-09-11T22:25:28.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T22:25:28.904 INFO:teuthology.run:FAIL